2024-04-26T11:04:30.705 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T11:04:30.705 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} --archive /home/teuthworker/archive/leonidus-2024-04-26_10:54:14-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674683 --name leonidus-2024-04-26_10:54:14-fs-wip-lusov-quiescer-fixes-distro-default-smithi --owner scheduled_leonidus@teuthology --verbose -- /home/teuthworker/archive/leonidus-2024-04-26_10:54:14-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674683/orig.config.yaml 2024-04-26T11:04:30.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T11:04:30.862 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-26_10:54:14-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674683 branch: wip-lusov-quiescer-fixes description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} email: null first_in_suite: false job_id: '7674683' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: leonidus-2024-04-26_10:54:14-fs-wip-lusov-quiescer-fixes-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer-fixes ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer-fixes sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4375 sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer-fixes suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQbLB75SE4MknW46eHn2H56x6FpxiULsvOcT/5Vef+BKWAYb9b0UT6+VcoPjsJawJVLyKFEWHxocWME8wgl7Cc= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAD0aO7FC7YWPATAn1QTgz7BnskzIB4mnqtJNJGgybbLYVO2amtwon387z66nmUzvw/biThRYetgG1V0HBKkzI= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFjoAIVt0hZvl9jQ2J2WTbz9HJRq4zUzbjCWmfYE4xgNfXVqFBElayGxEMmyhNJdviEJABXJji8X36Wn8vD/7tA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_10:54:14 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T11:04:30.862 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa; will attempt to use it 2024-04-26T11:04:30.863 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks 2024-04-26T11:04:30.863 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T11:04:30.865 INFO:teuthology.task.internal:Checking packages... 2024-04-26T11:04:30.891 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1' 2024-04-26T11:04:30.891 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T11:04:30.891 INFO:teuthology.packaging:ref: None 2024-04-26T11:04:30.891 INFO:teuthology.packaging:tag: None 2024-04-26T11:04:30.891 INFO:teuthology.packaging:branch: wip-lusov-quiescer-fixes 2024-04-26T11:04:30.891 INFO:teuthology.packaging:sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:04:30.892 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer-fixes 2024-04-26T11:04:31.108 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3267.gbc94a2a9 2024-04-26T11:04:31.110 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T11:04:31.119 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T11:04:31.119 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T11:04:31.133 INFO:teuthology.task.internal:Saving configuration 2024-04-26T11:04:31.156 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T11:04:31.167 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T11:04:31.192 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_10:54:14-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674683', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:59:28.230575', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQbLB75SE4MknW46eHn2H56x6FpxiULsvOcT/5Vef+BKWAYb9b0UT6+VcoPjsJawJVLyKFEWHxocWME8wgl7Cc='} 2024-04-26T11:04:31.214 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_10:54:14-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674683', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:59:28.229231', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAD0aO7FC7YWPATAn1QTgz7BnskzIB4mnqtJNJGgybbLYVO2amtwon387z66nmUzvw/biThRYetgG1V0HBKkzI='} 2024-04-26T11:04:31.239 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_10:54:14-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674683', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:59:28.227679', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFjoAIVt0hZvl9jQ2J2WTbz9HJRq4zUzbjCWmfYE4xgNfXVqFBElayGxEMmyhNJdviEJABXJji8X36Wn8vD/7tA='} 2024-04-26T11:04:31.239 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T11:04:31.247 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-26T11:04:31.247 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-26T11:04:31.248 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-26T11:04:31.248 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T11:04:31.356 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f479c0600d0>, signals=[15]) 2024-04-26T11:04:31.357 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T11:04:31.365 INFO:teuthology.task.internal:Opening connections... 2024-04-26T11:04:31.365 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-04-26T11:04:31.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:04:31.449 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-04-26T11:04:31.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:04:31.526 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-04-26T11:04:31.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:04:31.602 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T11:04:31.613 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-04-26T11:04:31.631 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-04-26T11:04:31.632 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-04-26T11:04:31.689 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-04-26T11:04:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:04:31.691 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T11:04:31.691 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T11:04:31.691 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-04-26T11:04:31.720 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-04-26T11:04:31.738 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-04-26T11:04:31.738 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-04-26T11:04:31.795 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:04:31.796 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T11:04:31.797 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T11:04:31.797 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-04-26T11:04:31.820 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-04-26T11:04:31.838 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-04-26T11:04:31.838 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-04-26T11:04:31.898 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T11:04:31.899 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T11:04:31.899 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T11:04:31.899 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-04-26T11:04:31.953 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T11:04:31.966 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T11:04:31.977 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T11:04:31.977 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:04:31.980 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:04:31.982 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:04:31.998 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T11:04:32.008 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T11:04:32.009 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:04:32.036 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:04:32.039 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:04:32.142 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T11:04:32.224 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T11:04:32.243 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-26T11:04:32.243 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-26T11:04:32.243 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-26T11:04:32.243 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:04:32.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:04:32.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-26T11:04:32.519 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T11:04:32.519 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T11:04:32.520 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-04-26T11:04:32.537 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-437.el9.x86_64 2024-04-26T11:04:32.537 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T11:04:32.537 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T11:04:32.538 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum upgrade -y linux-firmware 2024-04-26T11:04:34.708 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-26T11:04:36.751 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-26T11:04:40.935 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T11:04:43.483 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-26T11:05:07.102 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 913 kB/s | 21 MB 00:23 2024-04-26T11:05:12.098 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-26T11:05:14.161 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-26T11:05:14.162 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-04-26T11:05:14.162 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-26T11:05:14.267 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T11:05:14.268 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T11:05:14.490 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-26T11:05:14.490 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-26T11:05:14.493 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi110.front.sepia.ceph.com to complete... 2024-04-26T11:05:38.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26 11:05:38 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-26T11:05:38.093 INFO:teuthology.orchestra.run.smithi110.stderr:FINISHED --2024-04-26 11:05:38-- 2024-04-26T11:05:38.093 INFO:teuthology.orchestra.run.smithi110.stderr:Total wall clock time: 24s 2024-04-26T11:05:38.093 INFO:teuthology.orchestra.run.smithi110.stderr:Downloaded: 1 files, 341M in 23s (14.6 MB/s) 2024-04-26T11:05:38.096 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-26T11:05:38.096 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-26T11:05:40.207 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying... ######################################## 2024-04-26T11:05:40.428 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing... ######################################## 2024-04-26T11:05:40.550 INFO:teuthology.orchestra.run.smithi110.stdout:Updating / installing... 2024-04-26T11:05:48.530 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-26T11:06:27.772 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-26T11:06:27.773 DEBUG:teuthology.orchestra.run.smithi110:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-26T11:06:27.859 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T11:06:27.859 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T11:06:27.859 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T11:06:27.859 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-26T11:06:27.859 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-26T11:06:27.859 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T11:06:27.860 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-26T11:06:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T11:06:27.862 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T11:06:27.863 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T11:06:27.864 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-26T11:06:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T11:06:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T11:06:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T11:06:27.868 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T11:06:27.869 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-26T11:06:27.870 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T11:06:27.871 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T11:06:27.872 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T11:06:27.873 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-26T11:06:27.874 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-26T11:06:27.875 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T11:06:27.876 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-26T11:06:27.877 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T11:06:27.878 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T11:06:27.879 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T11:06:27.880 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T11:06:27.881 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T11:06:27.882 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T11:06:27.883 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T11:06:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T11:06:27.885 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T11:06:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T11:06:27.887 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T11:06:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T11:06:27.889 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T11:06:27.890 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T11:06:27.891 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T11:06:27.892 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T11:06:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T11:06:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T11:06:27.895 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T11:06:27.896 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T11:06:27.897 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T11:06:27.898 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T11:06:27.899 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-26T11:06:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T11:06:27.901 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T11:06:27.902 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-26T11:06:27.903 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-26T11:06:27.904 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T11:06:27.905 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T11:06:27.906 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-26T11:06:27.907 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T11:06:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T11:06:27.909 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T11:06:27.910 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T11:06:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-26T11:06:27.912 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T11:06:27.913 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-26T11:06:27.914 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-26T11:06:27.915 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T11:06:27.916 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T11:06:27.917 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-26T11:06:27.918 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T11:06:27.919 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T11:06:27.920 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-26T11:06:27.921 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T11:06:27.922 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T11:06:27.923 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T11:06:27.924 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T11:06:27.925 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T11:06:27.926 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T11:06:27.927 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T11:06:27.928 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-26T11:06:27.929 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T11:06:27.930 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-26T11:06:27.931 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T11:06:27.932 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T11:06:27.933 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T11:06:27.934 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T11:06:27.935 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T11:06:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T11:06:27.937 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T11:06:27.938 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T11:06:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T11:06:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T11:06:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-26T11:06:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-26T11:06:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T11:06:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T11:06:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-26T11:06:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T11:06:27.939 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-26T11:06:27.940 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T11:06:27.941 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T11:06:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-26T11:06:27.943 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T11:06:27.944 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T11:06:27.945 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T11:06:27.946 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T11:06:27.947 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T11:06:27.948 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T11:06:27.949 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-26T11:06:27.950 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T11:06:27.951 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T11:06:27.952 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T11:06:27.953 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-26T11:06:27.954 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T11:06:27.955 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-26T11:06:27.956 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-26T11:06:27.957 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T11:06:27.958 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T11:06:27.959 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T11:06:27.960 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T11:06:27.961 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T11:06:27.962 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-26T11:06:27.963 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-26T11:06:27.964 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T11:06:27.965 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-26T11:06:27.966 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-26T11:06:27.967 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-26T11:06:27.968 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T11:06:27.969 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-26T11:06:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T11:06:27.971 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T11:06:27.972 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-26T11:06:27.973 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T11:06:27.974 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T11:06:27.975 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T11:06:27.976 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T11:06:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T11:06:27.978 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T11:06:27.979 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T11:06:27.980 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T11:06:27.981 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T11:06:27.982 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T11:06:27.983 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T11:06:27.984 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T11:06:27.985 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T11:06:27.986 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T11:06:27.987 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T11:06:27.988 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T11:06:27.989 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T11:06:27.990 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T11:06:27.991 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T11:06:27.992 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T11:06:27.993 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T11:06:27.994 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T11:06:27.995 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T11:06:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-26T11:06:27.997 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T11:06:27.998 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T11:06:28.003 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T11:06:28.003 DEBUG:teuthology.orchestra.run.smithi110:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-26T11:06:28.026 INFO:teuthology.orchestra.run.smithi110.stdout:postinstall scriptlet (using /bin/sh): 2024-04-26T11:06:28.026 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T11:06:28.026 INFO:teuthology.orchestra.run.smithi110.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-26T11:06:28.026 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout:for file in vmlinuz System.map config; do 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout: fi 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-04-26T11:06:28.027 INFO:teuthology.orchestra.run.smithi110.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-26T11:06:28.028 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-26T11:06:28.028 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-26T11:06:28.028 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-04-26T11:06:28.028 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-04-26T11:06:28.110 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-04-26T11:06:28.110 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-04-26T11:06:28.111 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-04-26T11:06:28.111 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 68.el9 2024-04-26T11:06:28.111 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-04-26T11:06:28.112 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-26T11:06:28.112 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-04-26T11:06:28.112 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8264254 2024-04-26T11:06:28.112 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-04-26T11:06:28.113 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-26T11:06:28.113 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-26T11:06:28.113 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-26T11:06:28.113 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-26T11:06:28.113 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-04-26T11:06:28.113 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-04-26T11:06:28.114 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T11:06:28.114 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-04-26T11:06:28.114 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-04-26T11:06:28.114 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:06:28.114 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T11:06:28.115 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T11:06:28.115 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T11:06:28.115 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-04-26T11:06:28.115 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:06:28.115 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T11:06:28.116 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T11:06:28.116 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 6.9.0-rc3-g806ec36b2112 2024-04-26T11:06:28.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T11:06:28.693 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-04-26T11:06:30.102 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-26T11:06:30.135 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-04-26T11:06:30.137 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-04-26T11:06:30.152 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.27HmUgmZzX 2024-04-26T11:06:30.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.27HmUgmZzX 2024-04-26T11:06:30.218 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.27HmUgmZzX 2024-04-26T11:06:30.357 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.27HmUgmZzX is 6KB 2024-04-26T11:06:30.377 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.27HmUgmZzX 2024-04-26T11:06:30.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T11:06:30.460 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-26T11:06:30.460 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-26T11:06:30.460 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-26T11:06:30.460 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-26T11:06:30.461 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-26T11:06:30.631 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-04-26T11:07:00.634 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-26T11:07:00.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-26T11:07:00.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:07:19.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-26T11:07:28.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-26T11:07:28.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:07:31.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-04-26T11:07:43.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-26T11:07:43.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:08:15.159 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-04-26T11:08:15.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-26T11:08:15.802 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T11:08:15.803 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-04-26T11:08:15.849 INFO:teuthology.orchestra.run.smithi110.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T11:08:15.849 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T11:08:15.849 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:08:15.849 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T11:08:16.852 DEBUG:teuthology.parallel:result is None 2024-04-26T11:08:16.852 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T11:08:16.861 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T11:08:16.861 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:08:16.866 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:08:16.869 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:08:16.910 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T11:08:16.916 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T11:08:16.922 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T11:08:16.922 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:08:16.926 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:08:16.928 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:08:16.984 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T11:08:16.991 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T11:08:16.992 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:08:17.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:08:17.015 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:08:17.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:08:17.032 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:08:17.037 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:08:17.057 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:08:17.087 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:08:17.106 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:08:17.123 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:08:17.136 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:08:17.154 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:08:17.200 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T11:08:17.208 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T11:08:17.208 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:08:17.213 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:08:17.215 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:08:17.279 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T11:08:17.289 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T11:08:17.289 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:08:17.294 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:08:17.296 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:08:17.331 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:08:17.441 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:08:17.533 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:08:17.601 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:08:17.694 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:08:17.694 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:08:17.774 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:08:17.819 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:08:17.874 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:08:17.956 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:08:17.997 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:08:17.998 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:08:18.063 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:08:18.107 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:08:18.167 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:08:18.212 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:08:18.253 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:08:18.253 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:08:18.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-04-26T11:08:18.323 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-04-26T11:08:18.325 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-04-26T11:08:18.362 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:08:18.394 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:08:18.415 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:08:18.991 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T11:08:18.999 INFO:teuthology.task.internal:Starting timer... 2024-04-26T11:08:18.999 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T11:08:19.013 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T11:08:19.021 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-26T11:08:19.022 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-04-26T11:08:19.135 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-04-26T11:08:19.139 DEBUG:teuthology.orchestra.run.smithi193:> sudo service auditd rotate 2024-04-26T11:08:19.217 INFO:teuthology.orchestra.run.smithi193.stdout:Rotating logs: 2024-04-26T11:08:19.219 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2024-04-26T11:08:19.291 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: 2024-04-26T11:08:19.293 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T11:08:19.293 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-04-26T11:08:19.349 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-04-26T11:08:19.349 DEBUG:teuthology.orchestra.run.smithi193:> /usr/sbin/getenforce 2024-04-26T11:08:19.390 INFO:teuthology.orchestra.run.smithi193.stdout:Permissive 2024-04-26T11:08:19.391 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2024-04-26T11:08:19.408 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2024-04-26T11:08:19.408 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi193.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2024-04-26T11:08:19.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T11:08:19.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:08:19.481 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T11:08:19.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:08:19.506 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T11:08:19.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:08:19.530 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T11:08:19.530 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:08:19.622 DEBUG:teuthology.orchestra.run.smithi193:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:08:19.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:08:19.677 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T11:08:19.687 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T11:08:19.706 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T11:08:19.708 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi110.front.sepia.ceph.com,smithi193.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T11:14:13.116 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-04-26T11:14:13.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-26T11:14:13.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:14:13.234 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-04-26T11:14:13.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-04-26T11:14:13.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-26T11:14:13.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:14:13.466 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-04-26T11:14:13.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-04-26T11:14:13.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-26T11:14:13.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:14:13.628 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-04-26T11:14:13.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-04-26T11:14:13.709 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T11:14:13.719 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T11:14:13.719 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:14:13.720 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:14:13.727 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:14:13.728 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:14:13.730 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:14:13.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:14:13.760 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T11:14:13.775 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T11:14:13.777 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T11:14:13.792 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T11:14:13.799 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: ntpd: command not found 2024-04-26T11:14:13.810 INFO:teuthology.orchestra.run.smithi193.stdout:506 Cannot talk to daemon 2024-04-26T11:14:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T11:14:13.818 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2024-04-26T11:14:13.825 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T11:14:13.827 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2024-04-26T11:14:13.838 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T11:14:13.841 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T11:14:13.854 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T11:14:13.855 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T11:14:13.897 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-04-26T11:14:13.901 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:14:13.901 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-04-26T11:14:13.901 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:13.901 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:13.901 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:13.901 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:13.911 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-04-26T11:14:13.914 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:14:13.914 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-04-26T11:14:13.914 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:13.915 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:13.915 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:13.915 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:13.927 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-04-26T11:14:13.959 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-04-26T11:14:14.002 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T11:14:14.042 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T11:14:14.174 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-04-26T11:14:14.183 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:14:14.184 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-04-26T11:14:14.184 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:14.184 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:14.184 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:14.184 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:14:14.185 INFO:teuthology.run_tasks:Running task install... 2024-04-26T11:14:14.194 DEBUG:teuthology.task.install:project ceph 2024-04-26T11:14:14.194 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}} 2024-04-26T11:14:14.194 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'} 2024-04-26T11:14:14.194 INFO:teuthology.task.install:Using flavor: default 2024-04-26T11:14:14.200 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T11:14:14.200 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T11:14:14.201 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T11:14:14.201 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:14:14.203 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T11:14:14.203 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:14:14.204 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T11:14:14.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:14:14.350 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T11:14:14.350 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T11:14:14.360 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T11:14:14.361 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T11:14:14.439 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T11:14:14.440 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T11:14:14.521 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T11:14:14.522 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:14:14.522 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T11:14:14.529 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T11:14:14.529 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:14:14.529 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T11:14:14.544 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T11:14:14.544 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:14:14.544 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T11:14:14.558 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T11:14:14.558 DEBUG:teuthology.orchestra.run.smithi193:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T11:14:14.570 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T11:14:14.570 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T11:14:14.606 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T11:14:14.606 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T11:14:14.625 DEBUG:teuthology.orchestra.run.smithi193:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T11:14:14.634 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T11:14:14.700 DEBUG:teuthology.orchestra.run.smithi193:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T11:14:14.707 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T11:14:14.734 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi193.stdout:check_obsoletes = 1 2024-04-26T11:14:14.766 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum clean all 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2024-04-26T11:14:14.772 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2024-04-26T11:14:14.844 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T11:14:14.922 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-04-26T11:14:14.927 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-04-26T11:14:14.994 INFO:teuthology.orchestra.run.smithi193.stdout:48 files removed 2024-04-26T11:14:14.997 INFO:teuthology.orchestra.run.smithi196.stdout:48 files removed 2024-04-26T11:14:15.021 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T11:14:15.024 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T11:14:15.249 INFO:teuthology.orchestra.run.smithi110.stdout:48 files removed 2024-04-26T11:14:15.288 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 261 kB/s | 84 kB 00:00 2024-04-26T11:14:15.714 INFO:teuthology.orchestra.run.smithi193.stdout:ceph packages for x86_64 194 kB/s | 84 kB 00:00 2024-04-26T11:14:16.053 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-04-26T11:14:16.107 INFO:teuthology.orchestra.run.smithi193.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-04-26T11:14:16.321 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 140 kB/s | 84 kB 00:00 2024-04-26T11:14:16.430 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-04-26T11:14:16.524 INFO:teuthology.orchestra.run.smithi193.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-26T11:14:16.863 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-04-26T11:14:17.293 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-26T11:14:17.414 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-04-26T11:14:17.523 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.0 MB 00:01 2024-04-26T11:14:18.559 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.0 MB 00:01 2024-04-26T11:14:19.270 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-26T11:14:19.549 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-26T11:14:20.627 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-26T11:14:23.708 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-26T11:14:25.037 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-26T11:14:25.336 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 6.2 MB 00:00 2024-04-26T11:14:25.579 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 16 kB 00:00 2024-04-26T11:14:26.261 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-26T11:14:26.998 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-26T11:14:28.608 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-26T11:14:31.369 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-04-26T11:14:33.496 INFO:teuthology.orchestra.run.smithi193.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T11:14:33.496 INFO:teuthology.orchestra.run.smithi193.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T11:14:33.507 INFO:teuthology.orchestra.run.smithi193.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T11:14:33.508 INFO:teuthology.orchestra.run.smithi193.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T11:14:33.509 INFO:teuthology.orchestra.run.smithi193.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T11:14:33.510 INFO:teuthology.orchestra.run.smithi193.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T11:14:33.511 INFO:teuthology.orchestra.run.smithi193.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T11:14:33.513 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T11:14:33.514 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T11:14:33.573 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-04-26T11:14:33.591 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-04-26T11:14:33.591 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-04-26T11:14:33.591 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-04-26T11:14:33.591 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T11:14:33.592 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T11:14:33.593 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrading: 2024-04-26T11:14:33.594 INFO:teuthology.orchestra.run.smithi193.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T11:14:33.595 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T11:14:33.595 INFO:teuthology.orchestra.run.smithi193.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T11:14:33.595 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T11:14:33.595 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-04-26T11:14:33.595 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T11:14:33.596 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T11:14:33.597 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T11:14:33.598 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T11:14:33.599 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T11:14:33.599 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T11:14:33.599 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T11:14:33.599 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T11:14:33.599 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T11:14:33.599 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T11:14:33.599 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T11:14:33.599 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T11:14:33.599 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T11:14:33.600 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T11:14:33.600 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T11:14:33.600 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T11:14:33.600 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T11:14:33.600 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T11:14:33.600 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T11:14:33.600 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T11:14:33.600 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T11:14:33.601 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T11:14:33.602 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T11:14:33.603 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout:Installing weak dependencies: 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-04-26T11:14:33.604 INFO:teuthology.orchestra.run.smithi193.stdout:Install 148 Packages 2024-04-26T11:14:33.605 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrade 4 Packages 2024-04-26T11:14:33.605 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:14:33.605 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 222 M 2024-04-26T11:14:33.605 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-04-26T11:14:34.566 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-26T11:14:36.948 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T11:14:36.950 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T11:14:36.970 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T11:14:37.050 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-04-26T11:14:37.073 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-04-26T11:14:37.073 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-04-26T11:14:37.073 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-04-26T11:14:37.073 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-04-26T11:14:37.073 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T11:14:37.073 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T11:14:37.074 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T11:14:37.075 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-04-26T11:14:37.076 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T11:14:37.077 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T11:14:37.078 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T11:14:37.079 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T11:14:37.080 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T11:14:37.081 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T11:14:37.082 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T11:14:37.082 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T11:14:37.082 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T11:14:37.082 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T11:14:37.082 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T11:14:37.083 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T11:14:37.084 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout:Install 148 Packages 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 4 Packages 2024-04-26T11:14:37.085 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:14:37.086 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 222 M 2024-04-26T11:14:37.086 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-04-26T11:14:42.122 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 21 MB 00:16 2024-04-26T11:14:47.155 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-04-26T11:14:49.300 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T11:14:49.301 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T11:14:49.311 INFO:teuthology.orchestra.run.smithi196.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T11:14:49.312 INFO:teuthology.orchestra.run.smithi196.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T11:14:49.313 INFO:teuthology.orchestra.run.smithi196.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T11:14:49.313 INFO:teuthology.orchestra.run.smithi196.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T11:14:49.315 INFO:teuthology.orchestra.run.smithi196.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T11:14:49.317 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T11:14:49.318 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi196.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi196.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi196.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi196.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi196.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T11:14:49.401 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T11:14:49.402 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T11:14:49.402 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T11:14:49.402 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T11:14:49.402 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi196.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout:Install 148 Packages 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 4 Packages 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 222 M 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-04-26T11:14:50.775 INFO:teuthology.orchestra.run.smithi196.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 13 kB/s | 6.6 kB 00:00 2024-04-26T11:14:51.052 INFO:teuthology.orchestra.run.smithi193.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-26T11:14:51.542 INFO:teuthology.orchestra.run.smithi196.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.1 MB/s | 890 kB 00:00 2024-04-26T11:14:51.652 INFO:teuthology.orchestra.run.smithi193.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.4 MB/s | 890 kB 00:00 2024-04-26T11:14:51.691 INFO:teuthology.orchestra.run.smithi196.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 965 kB/s | 145 kB 00:00 2024-04-26T11:14:51.785 INFO:teuthology.orchestra.run.smithi193.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 1.1 MB/s | 145 kB 00:00 2024-04-26T11:14:52.761 INFO:teuthology.orchestra.run.smithi193.stdout:(4/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 2.4 MB/s | 2.4 MB 00:00 2024-04-26T11:14:53.242 INFO:teuthology.orchestra.run.smithi196.stdout:(4/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 1.8 MB/s | 5.4 MB 00:02 2024-04-26T11:14:53.486 INFO:teuthology.orchestra.run.smithi193.stdout:(5/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-04-26T11:14:53.592 INFO:teuthology.orchestra.run.smithi196.stdout:(5/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 4.3 MB/s | 1.5 MB 00:00 2024-04-26T11:14:54.459 INFO:teuthology.orchestra.run.smithi196.stdout:(6/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 5.4 MB/s | 4.7 MB 00:00 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi193.stdout:(6/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 1.4 MB/s | 5.4 MB 00:03 2024-04-26T11:14:55.409 INFO:teuthology.orchestra.run.smithi196.stdout:(7/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 650 kB/s | 2.4 MB 00:03 2024-04-26T11:14:55.550 INFO:teuthology.orchestra.run.smithi110.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-04-26T11:14:55.903 INFO:teuthology.orchestra.run.smithi193.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 1.9 MB/s | 4.7 MB 00:02 2024-04-26T11:14:56.534 INFO:teuthology.orchestra.run.smithi110.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 905 kB/s | 890 kB 00:00 2024-04-26T11:14:56.749 INFO:teuthology.orchestra.run.smithi110.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 675 kB/s | 145 kB 00:00 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi110.stdout:(4/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 2.0 MB/s | 2.4 MB 00:01 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi196.stdout:(8/152): ceph-common-19.0.0-3267.gbc94a2a9.el9. 2.7 MB/s | 21 MB 00:07 2024-04-26T11:14:58.084 INFO:teuthology.orchestra.run.smithi196.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 233 kB/s | 25 kB 00:00 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi110.stdout:(5/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 1.8 MB/s | 5.4 MB 00:03 2024-04-26T11:14:58.393 INFO:teuthology.orchestra.run.smithi110.stdout:(6/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 3.2 MB/s | 1.5 MB 00:00 2024-04-26T11:14:58.668 INFO:teuthology.orchestra.run.smithi196.stdout:(10/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x8 4.0 MB/s | 17 MB 00:04 2024-04-26T11:14:58.809 INFO:teuthology.orchestra.run.smithi196.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 1.6 MB/s | 224 kB 00:00 2024-04-26T11:14:58.910 INFO:teuthology.orchestra.run.smithi196.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 269 kB/s | 27 kB 00:00 2024-04-26T11:14:59.027 INFO:teuthology.orchestra.run.smithi196.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 272 kB/s | 32 kB 00:00 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi196.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 1.9 MB/s | 746 kB 00:00 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi196.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 1.7 MB/s | 163 kB 00:00 2024-04-26T11:14:59.636 INFO:teuthology.orchestra.run.smithi196.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 1.0 MB/s | 127 kB 00:00 2024-04-26T11:14:59.886 INFO:teuthology.orchestra.run.smithi196.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 2.0 MB/s | 501 kB 00:00 2024-04-26T11:15:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 2.4 MB/s | 4.7 MB 00:01 2024-04-26T11:15:01.785 INFO:teuthology.orchestra.run.smithi110.stdout:(8/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x86 5.0 MB/s | 17 MB 00:03 2024-04-26T11:15:01.868 INFO:teuthology.orchestra.run.smithi110.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 307 kB/s | 25 kB 00:00 2024-04-26T11:15:01.878 INFO:teuthology.orchestra.run.smithi196.stdout:(18/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 2.7 MB/s | 5.4 MB 00:01 2024-04-26T11:15:01.970 INFO:teuthology.orchestra.run.smithi196.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 494 kB/s | 45 kB 00:00 2024-04-26T11:15:02.061 INFO:teuthology.orchestra.run.smithi196.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 1.4 MB/s | 135 kB 00:00 2024-04-26T11:15:02.153 INFO:teuthology.orchestra.run.smithi196.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 1.7 MB/s | 162 kB 00:00 2024-04-26T11:15:02.329 INFO:teuthology.orchestra.run.smithi196.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 1.8 MB/s | 320 kB 00:00 2024-04-26T11:15:02.479 INFO:teuthology.orchestra.run.smithi196.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 1.9 MB/s | 298 kB 00:00 2024-04-26T11:15:02.571 INFO:teuthology.orchestra.run.smithi196.stdout:(24/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 1.1 MB/s | 99 kB 00:00 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi196.stdout:(25/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 933 kB/s | 85 kB 00:00 2024-04-26T11:15:03.796 INFO:teuthology.orchestra.run.smithi196.stdout:(26/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 2.7 MB/s | 3.1 MB 00:01 2024-04-26T11:15:03.938 INFO:teuthology.orchestra.run.smithi196.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 1.2 MB/s | 170 kB 00:00 2024-04-26T11:15:04.039 INFO:teuthology.orchestra.run.smithi196.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 342 kB/s | 34 kB 00:00 2024-04-26T11:15:04.140 INFO:teuthology.orchestra.run.smithi196.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.4 MB/s | 142 kB 00:00 2024-04-26T11:15:04.194 INFO:teuthology.orchestra.run.smithi193.stdout:(8/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el9 1.3 MB/s | 11 MB 00:08 2024-04-26T11:15:04.311 INFO:teuthology.orchestra.run.smithi193.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 216 kB/s | 25 kB 00:00 2024-04-26T11:15:04.344 INFO:teuthology.orchestra.run.smithi110.stdout:(10/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el 2.5 MB/s | 11 MB 00:04 2024-04-26T11:15:04.527 INFO:teuthology.orchestra.run.smithi110.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 1.2 MB/s | 224 kB 00:00 2024-04-26T11:15:04.652 INFO:teuthology.orchestra.run.smithi110.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 217 kB/s | 27 kB 00:00 2024-04-26T11:15:04.664 INFO:teuthology.orchestra.run.smithi196.stdout:(30/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el 1.1 MB/s | 11 MB 00:09 2024-04-26T11:15:04.761 INFO:teuthology.orchestra.run.smithi110.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 295 kB/s | 32 kB 00:00 2024-04-26T11:15:05.111 INFO:teuthology.orchestra.run.smithi110.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 2.1 MB/s | 746 kB 00:00 2024-04-26T11:15:05.220 INFO:teuthology.orchestra.run.smithi110.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 1.5 MB/s | 163 kB 00:00 2024-04-26T11:15:05.354 INFO:teuthology.orchestra.run.smithi110.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 954 kB/s | 127 kB 00:00 2024-04-26T11:15:05.464 INFO:teuthology.orchestra.run.smithi196.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 2.7 MB/s | 3.5 MB 00:01 2024-04-26T11:15:05.623 INFO:teuthology.orchestra.run.smithi196.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 1.5 MB/s | 249 kB 00:00 2024-04-26T11:15:05.698 INFO:teuthology.orchestra.run.smithi196.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 659 kB/s | 49 kB 00:00 2024-04-26T11:15:05.704 INFO:teuthology.orchestra.run.smithi110.stdout:(17/152): ceph-common-19.0.0-3267.gbc94a2a9.el9 2.0 MB/s | 21 MB 00:10 2024-04-26T11:15:05.754 INFO:teuthology.orchestra.run.smithi110.stdout:(18/152): libradosstriper1-19.0.0-3267.gbc94a2a 1.2 MB/s | 501 kB 00:00 2024-04-26T11:15:05.773 INFO:teuthology.orchestra.run.smithi196.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3267.gb 220 kB/s | 16 kB 00:00 2024-04-26T11:15:05.940 INFO:teuthology.orchestra.run.smithi196.stdout:(35/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 1.6 MB/s | 273 kB 00:00 2024-04-26T11:15:06.063 INFO:teuthology.orchestra.run.smithi110.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 147 kB/s | 45 kB 00:00 2024-04-26T11:15:06.255 INFO:teuthology.orchestra.run.smithi110.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 708 kB/s | 135 kB 00:00 2024-04-26T11:15:06.332 INFO:teuthology.orchestra.run.smithi196.stdout:(36/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 1.9 MB/s | 762 kB 00:00 2024-04-26T11:15:06.422 INFO:teuthology.orchestra.run.smithi110.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 976 kB/s | 162 kB 00:00 2024-04-26T11:15:06.424 INFO:teuthology.orchestra.run.smithi196.stdout:(37/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 199 kB/s | 18 kB 00:00 2024-04-26T11:15:06.549 INFO:teuthology.orchestra.run.smithi196.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 643 kB/s | 80 kB 00:00 2024-04-26T11:15:06.650 INFO:teuthology.orchestra.run.smithi196.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 7.9 MB/s | 803 kB 00:00 2024-04-26T11:15:06.672 INFO:teuthology.orchestra.run.smithi110.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 1.3 MB/s | 320 kB 00:00 2024-04-26T11:15:06.700 INFO:teuthology.orchestra.run.smithi196.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi196.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-04-26T11:15:06.847 INFO:teuthology.orchestra.run.smithi110.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 1.7 MB/s | 298 kB 00:00 2024-04-26T11:15:06.900 INFO:teuthology.orchestra.run.smithi196.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 8.7 MB/s | 1.2 MB 00:00 2024-04-26T11:15:06.942 INFO:teuthology.orchestra.run.smithi196.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-26T11:15:06.948 INFO:teuthology.orchestra.run.smithi110.stdout:(24/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 997 kB/s | 99 kB 00:00 2024-04-26T11:15:06.984 INFO:teuthology.orchestra.run.smithi196.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-26T11:15:07.026 INFO:teuthology.orchestra.run.smithi196.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-04-26T11:15:07.048 INFO:teuthology.orchestra.run.smithi110.stdout:(25/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 859 kB/s | 85 kB 00:00 2024-04-26T11:15:07.068 INFO:teuthology.orchestra.run.smithi196.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-04-26T11:15:07.127 INFO:teuthology.orchestra.run.smithi196.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-04-26T11:15:07.194 INFO:teuthology.orchestra.run.smithi196.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-26T11:15:07.227 INFO:teuthology.orchestra.run.smithi196.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 107 kB 00:00 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi196.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 648 kB/s | 21 kB 00:00 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi196.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi196.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 980 kB/s | 33 kB 00:00 2024-04-26T11:15:07.487 INFO:teuthology.orchestra.run.smithi196.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-04-26T11:15:07.502 INFO:teuthology.orchestra.run.smithi193.stdout:(10/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x8 1.3 MB/s | 17 MB 00:12 2024-04-26T11:15:07.512 INFO:teuthology.orchestra.run.smithi196.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 730 kB/s | 18 kB 00:00 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi196.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 336 kB/s | 11 kB 00:00 2024-04-26T11:15:07.613 INFO:teuthology.orchestra.run.smithi196.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-04-26T11:15:07.646 INFO:teuthology.orchestra.run.smithi196.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-26T11:15:07.705 INFO:teuthology.orchestra.run.smithi196.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-26T11:15:07.719 INFO:teuthology.orchestra.run.smithi193.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 1.0 MB/s | 224 kB 00:00 2024-04-26T11:15:07.756 INFO:teuthology.orchestra.run.smithi196.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 582 kB 00:00 2024-04-26T11:15:07.797 INFO:teuthology.orchestra.run.smithi196.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 612 kB/s | 25 kB 00:00 2024-04-26T11:15:07.828 INFO:teuthology.orchestra.run.smithi193.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 250 kB/s | 27 kB 00:00 2024-04-26T11:15:07.831 INFO:teuthology.orchestra.run.smithi196.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-26T11:15:07.856 INFO:teuthology.orchestra.run.smithi110.stdout:(26/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 2.5 MB/s | 5.4 MB 00:02 2024-04-26T11:15:07.873 INFO:teuthology.orchestra.run.smithi196.stdout:(62/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-04-26T11:15:07.915 INFO:teuthology.orchestra.run.smithi196.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-04-26T11:15:07.920 INFO:teuthology.orchestra.run.smithi193.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 346 kB/s | 32 kB 00:00 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi196.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 846 kB/s | 35 kB 00:00 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi110.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 1.2 MB/s | 170 kB 00:00 2024-04-26T11:15:08.099 INFO:teuthology.orchestra.run.smithi110.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 326 kB/s | 34 kB 00:00 2024-04-26T11:15:08.124 INFO:teuthology.orchestra.run.smithi196.stdout:(65/152): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2024-04-26T11:15:08.191 INFO:teuthology.orchestra.run.smithi110.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.5 MB/s | 142 kB 00:00 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi196.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-04-26T11:15:08.324 INFO:teuthology.orchestra.run.smithi110.stdout:(30/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 2.4 MB/s | 3.1 MB 00:01 2024-04-26T11:15:08.361 INFO:teuthology.orchestra.run.smithi193.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 1.7 MB/s | 746 kB 00:00 2024-04-26T11:15:08.366 INFO:teuthology.orchestra.run.smithi196.stdout:(67/152): ceph-mgr-diskprediction-local-19.0.0- 2.0 MB/s | 7.4 MB 00:03 2024-04-26T11:15:08.408 INFO:teuthology.orchestra.run.smithi196.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-26T11:15:08.441 INFO:teuthology.orchestra.run.smithi196.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-04-26T11:15:08.462 INFO:teuthology.orchestra.run.smithi193.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 1.6 MB/s | 163 kB 00:00 2024-04-26T11:15:08.466 INFO:teuthology.orchestra.run.smithi196.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-04-26T11:15:08.575 INFO:teuthology.orchestra.run.smithi196.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.4 MB/s | 1.0 MB 00:00 2024-04-26T11:15:08.604 INFO:teuthology.orchestra.run.smithi193.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 894 kB/s | 127 kB 00:00 2024-04-26T11:15:08.667 INFO:teuthology.orchestra.run.smithi196.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-04-26T11:15:08.692 INFO:teuthology.orchestra.run.smithi196.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 763 kB/s | 87 kB 00:00 2024-04-26T11:15:08.743 INFO:teuthology.orchestra.run.smithi196.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-04-26T11:15:08.801 INFO:teuthology.orchestra.run.smithi196.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.3 MB/s | 248 kB 00:00 2024-04-26T11:15:08.877 INFO:teuthology.orchestra.run.smithi196.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-04-26T11:15:08.895 INFO:teuthology.orchestra.run.smithi193.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 1.7 MB/s | 501 kB 00:00 2024-04-26T11:15:08.902 INFO:teuthology.orchestra.run.smithi196.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 261 kB/s | 26 kB 00:00 2024-04-26T11:15:08.927 INFO:teuthology.orchestra.run.smithi196.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-04-26T11:15:08.952 INFO:teuthology.orchestra.run.smithi196.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-26T11:15:08.978 INFO:teuthology.orchestra.run.smithi196.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-04-26T11:15:09.036 INFO:teuthology.orchestra.run.smithi196.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 250 kB 00:00 2024-04-26T11:15:09.153 INFO:teuthology.orchestra.run.smithi196.stdout:(82/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-04-26T11:15:09.179 INFO:teuthology.orchestra.run.smithi196.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-04-26T11:15:09.204 INFO:teuthology.orchestra.run.smithi196.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-26T11:15:09.221 INFO:teuthology.orchestra.run.smithi196.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-04-26T11:15:09.246 INFO:teuthology.orchestra.run.smithi196.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-04-26T11:15:09.272 INFO:teuthology.orchestra.run.smithi196.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T11:15:09.297 INFO:teuthology.orchestra.run.smithi196.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-26T11:15:09.322 INFO:teuthology.orchestra.run.smithi196.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-26T11:15:09.347 INFO:teuthology.orchestra.run.smithi196.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T11:15:09.398 INFO:teuthology.orchestra.run.smithi196.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 842 kB/s | 42 kB 00:00 2024-04-26T11:15:09.465 INFO:teuthology.orchestra.run.smithi196.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 685 kB/s | 44 kB 00:00 2024-04-26T11:15:09.565 INFO:teuthology.orchestra.run.smithi196.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-04-26T11:15:09.782 INFO:teuthology.orchestra.run.smithi196.stdout:(94/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-04-26T11:15:09.800 INFO:teuthology.orchestra.run.smithi110.stdout:(31/152): ceph-test-19.0.0-3267.gbc94a2a9.el9.x 6.2 MB/s | 49 MB 00:07 2024-04-26T11:15:09.807 INFO:teuthology.orchestra.run.smithi196.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 150 kB/s | 36 kB 00:00 2024-04-26T11:15:09.832 INFO:teuthology.orchestra.run.smithi196.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-04-26T11:15:09.858 INFO:teuthology.orchestra.run.smithi196.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-26T11:15:09.883 INFO:teuthology.orchestra.run.smithi196.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-26T11:15:09.883 INFO:teuthology.orchestra.run.smithi110.stdout:(32/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 2.1 MB/s | 3.5 MB 00:01 2024-04-26T11:15:09.908 INFO:teuthology.orchestra.run.smithi196.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-26T11:15:09.929 INFO:teuthology.orchestra.run.smithi193.stdout:(18/152): ceph-common-19.0.0-3267.gbc94a2a9.el9 1.1 MB/s | 21 MB 00:19 2024-04-26T11:15:09.933 INFO:teuthology.orchestra.run.smithi196.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-26T11:15:09.950 INFO:teuthology.orchestra.run.smithi110.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3267.gbc 1.6 MB/s | 249 kB 00:00 2024-04-26T11:15:09.959 INFO:teuthology.orchestra.run.smithi196.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-04-26T11:15:09.967 INFO:teuthology.orchestra.run.smithi110.stdout:(34/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 596 kB/s | 49 kB 00:00 2024-04-26T11:15:09.984 INFO:teuthology.orchestra.run.smithi196.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2024-04-26T11:15:10.022 INFO:teuthology.orchestra.run.smithi193.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 494 kB/s | 45 kB 00:00 2024-04-26T11:15:10.026 INFO:teuthology.orchestra.run.smithi110.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3267.gb 221 kB/s | 16 kB 00:00 2024-04-26T11:15:10.026 INFO:teuthology.orchestra.run.smithi196.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-04-26T11:15:10.134 INFO:teuthology.orchestra.run.smithi110.stdout:(36/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 1.6 MB/s | 273 kB 00:00 2024-04-26T11:15:10.188 INFO:teuthology.orchestra.run.smithi193.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 812 kB/s | 135 kB 00:00 2024-04-26T11:15:10.218 INFO:teuthology.orchestra.run.smithi110.stdout:(37/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 3.9 MB/s | 762 kB 00:00 2024-04-26T11:15:10.246 INFO:teuthology.orchestra.run.smithi110.stdout:(38/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 169 kB/s | 18 kB 00:00 2024-04-26T11:15:10.355 INFO:teuthology.orchestra.run.smithi193.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 970 kB/s | 162 kB 00:00 2024-04-26T11:15:10.443 INFO:teuthology.orchestra.run.smithi196.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-26T11:15:10.443 INFO:teuthology.orchestra.run.smithi110.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 358 kB/s | 80 kB 00:00 2024-04-26T11:15:10.468 INFO:teuthology.orchestra.run.smithi196.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 699 kB/s | 309 kB 00:00 2024-04-26T11:15:10.519 INFO:teuthology.orchestra.run.smithi110.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-04-26T11:15:10.535 INFO:teuthology.orchestra.run.smithi196.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 212 kB/s | 19 kB 00:00 2024-04-26T11:15:10.552 INFO:teuthology.orchestra.run.smithi110.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-26T11:15:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.8 MB/s | 253 kB 00:00 2024-04-26T11:15:10.605 INFO:teuthology.orchestra.run.smithi193.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 1.3 MB/s | 320 kB 00:00 2024-04-26T11:15:10.610 INFO:teuthology.orchestra.run.smithi196.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-26T11:15:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-04-26T11:15:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-04-26T11:15:10.685 INFO:teuthology.orchestra.run.smithi196.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 650 kB/s | 49 kB 00:00 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi110.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 215 kB 00:00 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi196.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 736 kB/s | 67 kB 00:00 2024-04-26T11:15:10.823 INFO:teuthology.orchestra.run.smithi110.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 6.9 MB/s | 689 kB 00:00 2024-04-26T11:15:10.844 INFO:teuthology.orchestra.run.smithi196.stdout:(110/152): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-26T11:15:10.847 INFO:teuthology.orchestra.run.smithi193.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 1.2 MB/s | 298 kB 00:00 2024-04-26T11:15:10.870 INFO:teuthology.orchestra.run.smithi196.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-26T11:15:10.873 INFO:teuthology.orchestra.run.smithi110.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 8.4 MB/s | 943 kB 00:00 2024-04-26T11:15:10.890 INFO:teuthology.orchestra.run.smithi110.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-26T11:15:10.928 INFO:teuthology.orchestra.run.smithi196.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-04-26T11:15:10.939 INFO:teuthology.orchestra.run.smithi193.stdout:(24/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 1.1 MB/s | 99 kB 00:00 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi196.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi196.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi110.stdout:(51/152): ceph-mgr-diskprediction-local-19.0.0- 2.7 MB/s | 7.4 MB 00:02 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi193.stdout:(25/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 789 kB/s | 85 kB 00:00 2024-04-26T11:15:11.071 INFO:teuthology.orchestra.run.smithi196.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-04-26T11:15:11.075 INFO:teuthology.orchestra.run.smithi110.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-04-26T11:15:11.096 INFO:teuthology.orchestra.run.smithi196.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-04-26T11:15:11.116 INFO:teuthology.orchestra.run.smithi110.stdout:(53/152): elfutils-libelf-devel-0.190-2.el9.x86 89 kB/s | 21 kB 00:00 2024-04-26T11:15:11.158 INFO:teuthology.orchestra.run.smithi110.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 289 kB/s | 33 kB 00:00 2024-04-26T11:15:11.163 INFO:teuthology.orchestra.run.smithi196.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-04-26T11:15:11.188 INFO:teuthology.orchestra.run.smithi196.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-26T11:15:11.189 INFO:teuthology.orchestra.run.smithi193.stdout:(26/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 2.3 MB/s | 5.4 MB 00:02 2024-04-26T11:15:11.263 INFO:teuthology.orchestra.run.smithi196.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-04-26T11:15:11.267 INFO:teuthology.orchestra.run.smithi110.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-04-26T11:15:11.289 INFO:teuthology.orchestra.run.smithi196.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 352 kB/s | 35 kB 00:00 2024-04-26T11:15:11.289 INFO:teuthology.orchestra.run.smithi193.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 1.7 MB/s | 170 kB 00:00 2024-04-26T11:15:11.309 INFO:teuthology.orchestra.run.smithi110.stdout:(56/152): flexiblas-openblas-openmp-3.0.4-8.el9 134 kB/s | 18 kB 00:00 2024-04-26T11:15:11.347 INFO:teuthology.orchestra.run.smithi196.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-04-26T11:15:11.351 INFO:teuthology.orchestra.run.smithi110.stdout:(57/152): libaio-devel-0.3.111-13.el9.x86_64.rp 63 kB/s | 11 kB 00:00 2024-04-26T11:15:11.382 INFO:teuthology.orchestra.run.smithi193.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 373 kB/s | 34 kB 00:00 2024-04-26T11:15:11.384 INFO:teuthology.orchestra.run.smithi110.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-04-26T11:15:11.434 INFO:teuthology.orchestra.run.smithi110.stdout:(59/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 558 kB/s | 45 kB 00:00 2024-04-26T11:15:11.456 INFO:teuthology.orchestra.run.smithi196.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-04-26T11:15:11.468 INFO:teuthology.orchestra.run.smithi110.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 5.7 MB/s | 662 kB 00:00 2024-04-26T11:15:11.481 INFO:teuthology.orchestra.run.smithi196.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-26T11:15:11.482 INFO:teuthology.orchestra.run.smithi193.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.4 MB/s | 142 kB 00:00 2024-04-26T11:15:11.523 INFO:teuthology.orchestra.run.smithi196.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-04-26T11:15:11.535 INFO:teuthology.orchestra.run.smithi110.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 3.8 MB/s | 582 kB 00:00 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi196.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 265 kB/s | 18 kB 00:00 2024-04-26T11:15:11.577 INFO:teuthology.orchestra.run.smithi110.stdout:(62/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 248 kB/s | 25 kB 00:00 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi196.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 346 kB/s | 23 kB 00:00 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi196.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi110.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 328 kB/s | 47 kB 00:00 2024-04-26T11:15:11.644 INFO:teuthology.orchestra.run.smithi110.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.7 MB/s | 292 kB 00:00 2024-04-26T11:15:11.657 INFO:teuthology.orchestra.run.smithi196.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi110.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 1.9 MB/s | 188 kB 00:00 2024-04-26T11:15:11.728 INFO:teuthology.orchestra.run.smithi110.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 435 kB/s | 35 kB 00:00 2024-04-26T11:15:11.741 INFO:teuthology.orchestra.run.smithi196.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-04-26T11:15:11.775 INFO:teuthology.orchestra.run.smithi196.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-04-26T11:15:11.841 INFO:teuthology.orchestra.run.smithi196.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 789 kB/s | 79 kB 00:00 2024-04-26T11:15:11.858 INFO:teuthology.orchestra.run.smithi196.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 691 kB/s | 58 kB 00:00 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi110.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 19 MB/s | 4.7 MB 00:00 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi196.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-26T11:15:11.934 INFO:teuthology.orchestra.run.smithi196.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-26T11:15:11.984 INFO:teuthology.orchestra.run.smithi196.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-26T11:15:12.020 INFO:teuthology.orchestra.run.smithi110.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-26T11:15:12.059 INFO:teuthology.orchestra.run.smithi196.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 225 kB/s | 28 kB 00:00 2024-04-26T11:15:12.070 INFO:teuthology.orchestra.run.smithi110.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 4.7 MB/s | 1.6 MB 00:00 2024-04-26T11:15:12.076 INFO:teuthology.orchestra.run.smithi196.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 335 kB/s | 31 kB 00:00 2024-04-26T11:15:12.104 INFO:teuthology.orchestra.run.smithi110.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 4.6 MB/s | 911 kB 00:00 2024-04-26T11:15:12.135 INFO:teuthology.orchestra.run.smithi196.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-26T11:15:12.154 INFO:teuthology.orchestra.run.smithi110.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 2.7 MB/s | 133 kB 00:00 2024-04-26T11:15:12.160 INFO:teuthology.orchestra.run.smithi196.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 708 kB/s | 59 kB 00:00 2024-04-26T11:15:12.219 INFO:teuthology.orchestra.run.smithi196.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 428 kB/s | 36 kB 00:00 2024-04-26T11:15:12.244 INFO:teuthology.orchestra.run.smithi196.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 610 kB/s | 51 kB 00:00 2024-04-26T11:15:12.246 INFO:teuthology.orchestra.run.smithi110.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 7.2 MB/s | 1.0 MB 00:00 2024-04-26T11:15:12.288 INFO:teuthology.orchestra.run.smithi110.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 711 kB/s | 87 kB 00:00 2024-04-26T11:15:12.303 INFO:teuthology.orchestra.run.smithi196.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi196.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi196.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi110.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi196.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-04-26T11:15:12.470 INFO:teuthology.orchestra.run.smithi196.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-26T11:15:12.531 INFO:teuthology.orchestra.run.smithi110.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.0 MB/s | 244 kB 00:00 2024-04-26T11:15:12.537 INFO:teuthology.orchestra.run.smithi196.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-26T11:15:12.714 INFO:teuthology.orchestra.run.smithi110.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-04-26T11:15:12.748 INFO:teuthology.orchestra.run.smithi110.stdout:(77/152): python3-jinja2-2.11.3-5.el9.noarch.rp 773 kB/s | 248 kB 00:00 2024-04-26T11:15:12.773 INFO:teuthology.orchestra.run.smithi110.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 110 kB/s | 26 kB 00:00 2024-04-26T11:15:12.790 INFO:teuthology.orchestra.run.smithi110.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 265 kB/s | 19 kB 00:00 2024-04-26T11:15:12.807 INFO:teuthology.orchestra.run.smithi110.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 1.1 MB/s | 35 kB 00:00 2024-04-26T11:15:12.840 INFO:teuthology.orchestra.run.smithi110.stdout:(81/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-04-26T11:15:12.941 INFO:teuthology.orchestra.run.smithi110.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 250 kB 00:00 2024-04-26T11:15:12.951 INFO:teuthology.orchestra.run.smithi193.stdout:(30/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 1.6 MB/s | 3.1 MB 00:01 2024-04-26T11:15:13.034 INFO:teuthology.orchestra.run.smithi193.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 2.3 MB/s | 3.5 MB 00:01 2024-04-26T11:15:13.049 INFO:teuthology.orchestra.run.smithi110.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-04-26T11:15:13.150 INFO:teuthology.orchestra.run.smithi110.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-04-26T11:15:13.175 INFO:teuthology.orchestra.run.smithi110.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 347 kB/s | 77 kB 00:00 2024-04-26T11:15:13.200 INFO:teuthology.orchestra.run.smithi110.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 296 kB/s | 42 kB 00:00 2024-04-26T11:15:13.225 INFO:teuthology.orchestra.run.smithi110.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 159 kB 00:00 2024-04-26T11:15:13.235 INFO:teuthology.orchestra.run.smithi193.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 1.2 MB/s | 249 kB 00:00 2024-04-26T11:15:13.259 INFO:teuthology.orchestra.run.smithi110.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-04-26T11:15:13.284 INFO:teuthology.orchestra.run.smithi110.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 915 kB/s | 51 kB 00:00 2024-04-26T11:15:13.310 INFO:teuthology.orchestra.run.smithi110.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-04-26T11:15:13.343 INFO:teuthology.orchestra.run.smithi110.stdout:(91/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-04-26T11:15:13.352 INFO:teuthology.orchestra.run.smithi193.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 423 kB/s | 49 kB 00:00 2024-04-26T11:15:13.369 INFO:teuthology.orchestra.run.smithi110.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 751 kB/s | 42 kB 00:00 2024-04-26T11:15:13.445 INFO:teuthology.orchestra.run.smithi110.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 443 kB/s | 44 kB 00:00 2024-04-26T11:15:13.477 INFO:teuthology.orchestra.run.smithi193.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3267.gb 132 kB/s | 16 kB 00:00 2024-04-26T11:15:13.511 INFO:teuthology.orchestra.run.smithi110.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-04-26T11:15:13.695 INFO:teuthology.orchestra.run.smithi110.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 152 kB/s | 36 kB 00:00 2024-04-26T11:15:13.727 INFO:teuthology.orchestra.run.smithi193.stdout:(35/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 1.1 MB/s | 273 kB 00:00 2024-04-26T11:15:13.754 INFO:teuthology.orchestra.run.smithi110.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 202 kB/s | 47 kB 00:00 2024-04-26T11:15:14.045 INFO:teuthology.orchestra.run.smithi110.stdout:(97/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-04-26T11:15:14.087 INFO:teuthology.orchestra.run.smithi110.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 812 kB/s | 305 kB 00:00 2024-04-26T11:15:14.112 INFO:teuthology.orchestra.run.smithi110.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 168 kB/s | 58 kB 00:00 2024-04-26T11:15:14.138 INFO:teuthology.orchestra.run.smithi110.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-04-26T11:15:14.163 INFO:teuthology.orchestra.run.smithi110.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-04-26T11:15:14.171 INFO:teuthology.orchestra.run.smithi196.stdout:(148/152): ceph-test-19.0.0-3267.gbc94a2a9.el9. 3.1 MB/s | 49 MB 00:16 2024-04-26T11:15:14.197 INFO:teuthology.orchestra.run.smithi110.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 545 kB/s | 45 kB 00:00 2024-04-26T11:15:14.222 INFO:teuthology.orchestra.run.smithi110.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 271 kB/s | 22 kB 00:00 2024-04-26T11:15:14.229 INFO:teuthology.orchestra.run.smithi196.stdout:(149/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 1.9 MB/s | 3.1 MB 00:01 2024-04-26T11:15:14.244 INFO:teuthology.orchestra.run.smithi193.stdout:(36/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 1.4 MB/s | 762 kB 00:00 2024-04-26T11:15:14.263 INFO:teuthology.orchestra.run.smithi196.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 15 MB/s | 1.3 MB 00:00 2024-04-26T11:15:14.297 INFO:teuthology.orchestra.run.smithi110.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 8.5 MB/s | 863 kB 00:00 2024-04-26T11:15:14.353 INFO:teuthology.orchestra.run.smithi193.stdout:(37/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 168 kB/s | 18 kB 00:00 2024-04-26T11:15:14.396 INFO:teuthology.orchestra.run.smithi196.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-04-26T11:15:14.461 INFO:teuthology.orchestra.run.smithi193.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 742 kB/s | 80 kB 00:00 2024-04-26T11:15:14.570 INFO:teuthology.orchestra.run.smithi193.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-04-26T11:15:14.612 INFO:teuthology.orchestra.run.smithi193.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-04-26T11:15:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:(152/152): librados2-19.0.0-3267.gbc94a2a9.el9. 1.6 MB/s | 3.4 MB 00:02 2024-04-26T11:15:14.640 INFO:teuthology.orchestra.run.smithi110.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 57 kB/s | 19 kB 00:00 2024-04-26T11:15:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:15:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:Total 8.8 MB/s | 222 MB 00:25 2024-04-26T11:15:14.654 INFO:teuthology.orchestra.run.smithi193.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-04-26T11:15:14.721 INFO:teuthology.orchestra.run.smithi193.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-26T11:15:14.754 INFO:teuthology.orchestra.run.smithi193.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-04-26T11:15:14.790 INFO:teuthology.orchestra.run.smithi110.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 545 kB/s | 309 kB 00:00 2024-04-26T11:15:14.797 INFO:teuthology.orchestra.run.smithi193.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-26T11:15:14.847 INFO:teuthology.orchestra.run.smithi193.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-26T11:15:14.890 INFO:teuthology.orchestra.run.smithi110.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 262 kB/s | 26 kB 00:00 2024-04-26T11:15:14.914 INFO:teuthology.orchestra.run.smithi193.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-26T11:15:14.932 INFO:teuthology.orchestra.run.smithi110.stdout:(108/152): abseil-cpp-20211102.0-3.el9.x86_64.r 747 kB/s | 548 kB 00:00 2024-04-26T11:15:14.964 INFO:teuthology.orchestra.run.smithi193.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-04-26T11:15:14.974 INFO:teuthology.orchestra.run.smithi110.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 588 kB/s | 49 kB 00:00 2024-04-26T11:15:15.023 INFO:teuthology.orchestra.run.smithi193.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-26T11:15:15.056 INFO:teuthology.orchestra.run.smithi193.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 107 kB 00:00 2024-04-26T11:15:15.060 INFO:teuthology.orchestra.run.smithi110.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 531 kB/s | 67 kB 00:00 2024-04-26T11:15:15.090 INFO:teuthology.orchestra.run.smithi193.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 644 kB/s | 21 kB 00:00 2024-04-26T11:15:15.099 INFO:teuthology.orchestra.run.smithi110.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-04-26T11:15:15.132 INFO:teuthology.orchestra.run.smithi193.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-04-26T11:15:15.173 INFO:teuthology.orchestra.run.smithi193.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 787 kB/s | 33 kB 00:00 2024-04-26T11:15:15.275 INFO:teuthology.orchestra.run.smithi110.stdout:(112/152): libarrow-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-04-26T11:15:15.290 INFO:teuthology.orchestra.run.smithi193.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-26T11:15:15.316 INFO:teuthology.orchestra.run.smithi110.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 839 kB 00:00 2024-04-26T11:15:15.332 INFO:teuthology.orchestra.run.smithi193.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 435 kB/s | 18 kB 00:00 2024-04-26T11:15:15.350 INFO:teuthology.orchestra.run.smithi110.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-04-26T11:15:15.366 INFO:teuthology.orchestra.run.smithi193.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 335 kB/s | 11 kB 00:00 2024-04-26T11:15:15.375 INFO:teuthology.orchestra.run.smithi110.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 436 kB/s | 43 kB 00:00 2024-04-26T11:15:15.401 INFO:teuthology.orchestra.run.smithi110.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 387 kB/s | 32 kB 00:00 2024-04-26T11:15:15.416 INFO:teuthology.orchestra.run.smithi193.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-26T11:15:15.443 INFO:teuthology.orchestra.run.smithi110.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2024-04-26T11:15:15.458 INFO:teuthology.orchestra.run.smithi193.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-26T11:15:15.476 INFO:teuthology.orchestra.run.smithi110.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-26T11:15:15.526 INFO:teuthology.orchestra.run.smithi110.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-04-26T11:15:15.542 INFO:teuthology.orchestra.run.smithi193.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-04-26T11:15:15.560 INFO:teuthology.orchestra.run.smithi110.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-26T11:15:15.577 INFO:teuthology.orchestra.run.smithi110.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 353 kB/s | 35 kB 00:00 2024-04-26T11:15:15.601 INFO:teuthology.orchestra.run.smithi193.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 582 kB 00:00 2024-04-26T11:15:15.644 INFO:teuthology.orchestra.run.smithi110.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-04-26T11:15:15.659 INFO:teuthology.orchestra.run.smithi193.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 437 kB/s | 25 kB 00:00 2024-04-26T11:15:15.686 INFO:teuthology.orchestra.run.smithi110.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi193.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi110.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi193.stdout:(62/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi110.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 193 kB/s | 18 kB 00:00 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi193.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-04-26T11:15:15.844 INFO:teuthology.orchestra.run.smithi193.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-04-26T11:15:15.861 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-04-26T11:15:15.861 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-04-26T11:15:15.862 INFO:teuthology.orchestra.run.smithi110.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 6.8 MB/s | 2.0 MB 00:00 2024-04-26T11:15:15.887 INFO:teuthology.orchestra.run.smithi110.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 174 kB/s | 23 kB 00:00 2024-04-26T11:15:15.912 INFO:teuthology.orchestra.run.smithi110.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 146 kB/s | 19 kB 00:00 2024-04-26T11:15:15.962 INFO:teuthology.orchestra.run.smithi110.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 198 kB/s | 20 kB 00:00 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi110.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 510 kB/s | 46 kB 00:00 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi193.stdout:(65/152): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-04-26T11:15:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-04-26T11:15:16.088 INFO:teuthology.orchestra.run.smithi110.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 694 kB/s | 58 kB 00:00 2024-04-26T11:15:16.114 INFO:teuthology.orchestra.run.smithi110.stdout:(133/152): python3-more-itertools-8.12.0-2.el9. 523 kB/s | 79 kB 00:00 2024-04-26T11:15:16.189 INFO:teuthology.orchestra.run.smithi110.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-04-26T11:15:16.214 INFO:teuthology.orchestra.run.smithi110.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2024-04-26T11:15:16.228 INFO:teuthology.orchestra.run.smithi193.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-04-26T11:15:16.240 INFO:teuthology.orchestra.run.smithi110.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 719 kB/s | 90 kB 00:00 2024-04-26T11:15:16.282 INFO:teuthology.orchestra.run.smithi110.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 309 kB/s | 28 kB 00:00 2024-04-26T11:15:16.307 INFO:teuthology.orchestra.run.smithi110.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 336 kB/s | 31 kB 00:00 2024-04-26T11:15:16.328 INFO:teuthology.orchestra.run.smithi193.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-26T11:15:16.332 INFO:teuthology.orchestra.run.smithi110.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-04-26T11:15:16.358 INFO:teuthology.orchestra.run.smithi110.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 789 kB/s | 59 kB 00:00 2024-04-26T11:15:16.383 INFO:teuthology.orchestra.run.smithi110.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 478 kB/s | 36 kB 00:00 2024-04-26T11:15:16.395 INFO:teuthology.orchestra.run.smithi193.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 13 MB/s | 911 kB 00:00 2024-04-26T11:15:16.408 INFO:teuthology.orchestra.run.smithi110.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 682 kB/s | 51 kB 00:00 2024-04-26T11:15:16.445 INFO:teuthology.orchestra.run.smithi193.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.6 MB/s | 133 kB 00:00 2024-04-26T11:15:16.475 INFO:teuthology.orchestra.run.smithi110.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-26T11:15:16.500 INFO:teuthology.orchestra.run.smithi110.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 771 kB/s | 90 kB 00:00 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi110.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi110.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi110.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-26T11:15:16.693 INFO:teuthology.orchestra.run.smithi110.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-04-26T11:15:16.703 INFO:teuthology.orchestra.run.smithi193.stdout:(70/152): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi193.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi110.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 11 MB/s | 1.3 MB 00:00 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi193.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-04-26T11:15:16.994 INFO:teuthology.orchestra.run.smithi110.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-04-26T11:15:17.080 INFO:teuthology.orchestra.run.smithi193.stdout:(73/152): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-04-26T11:15:17.172 INFO:teuthology.orchestra.run.smithi193.stdout:(74/152): ceph-mgr-diskprediction-local-19.0.0- 1.8 MB/s | 7.4 MB 00:04 2024-04-26T11:15:17.197 INFO:teuthology.orchestra.run.smithi193.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-04-26T11:15:17.227 INFO:teuthology.orchestra.run.smithi110.stdout:(151/152): librados2-19.0.0-3267.gbc94a2a9.el9. 5.2 MB/s | 3.4 MB 00:00 2024-04-26T11:15:17.230 INFO:teuthology.orchestra.run.smithi193.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-04-26T11:15:17.247 INFO:teuthology.orchestra.run.smithi193.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-04-26T11:15:17.264 INFO:teuthology.orchestra.run.smithi193.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 569 kB/s | 19 kB 00:00 2024-04-26T11:15:17.289 INFO:teuthology.orchestra.run.smithi193.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-04-26T11:15:17.315 INFO:teuthology.orchestra.run.smithi193.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-04-26T11:15:17.482 INFO:teuthology.orchestra.run.smithi193.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 5.1 MB 00:00 2024-04-26T11:15:17.507 INFO:teuthology.orchestra.run.smithi193.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-04-26T11:15:17.532 INFO:teuthology.orchestra.run.smithi193.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-26T11:15:17.544 INFO:teuthology.orchestra.run.smithi110.stdout:(152/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-04-26T11:15:17.558 INFO:teuthology.orchestra.run.smithi193.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-26T11:15:17.560 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:15:17.561 INFO:teuthology.orchestra.run.smithi110.stdout:Total 5.5 MB/s | 222 MB 00:40 2024-04-26T11:15:17.583 INFO:teuthology.orchestra.run.smithi193.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-04-26T11:15:17.608 INFO:teuthology.orchestra.run.smithi193.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-04-26T11:15:17.633 INFO:teuthology.orchestra.run.smithi193.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T11:15:17.659 INFO:teuthology.orchestra.run.smithi193.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-26T11:15:17.670 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-04-26T11:15:17.671 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-04-26T11:15:17.684 INFO:teuthology.orchestra.run.smithi193.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-26T11:15:17.709 INFO:teuthology.orchestra.run.smithi193.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T11:15:17.951 INFO:teuthology.orchestra.run.smithi193.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 173 kB/s | 42 kB 00:00 2024-04-26T11:15:18.352 INFO:teuthology.orchestra.run.smithi193.stdout:(92/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-04-26T11:15:18.377 INFO:teuthology.orchestra.run.smithi193.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 104 kB/s | 44 kB 00:00 2024-04-26T11:15:18.510 INFO:teuthology.orchestra.run.smithi193.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-04-26T11:15:18.552 INFO:teuthology.orchestra.run.smithi193.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 205 kB/s | 36 kB 00:00 2024-04-26T11:15:18.586 INFO:teuthology.orchestra.run.smithi193.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-04-26T11:15:18.628 INFO:teuthology.orchestra.run.smithi193.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-04-26T11:15:18.653 INFO:teuthology.orchestra.run.smithi193.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-04-26T11:15:18.678 INFO:teuthology.orchestra.run.smithi193.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-26T11:15:18.720 INFO:teuthology.orchestra.run.smithi193.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 954 kB/s | 64 kB 00:00 2024-04-26T11:15:18.879 INFO:teuthology.orchestra.run.smithi193.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 224 kB/s | 45 kB 00:00 2024-04-26T11:15:19.037 INFO:teuthology.orchestra.run.smithi193.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 70 kB/s | 22 kB 00:00 2024-04-26T11:15:19.313 INFO:teuthology.orchestra.run.smithi193.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-04-26T11:15:19.630 INFO:teuthology.orchestra.run.smithi193.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 928 kB/s | 548 kB 00:00 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi193.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 607 kB/s | 309 kB 00:00 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi193.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-26T11:15:20.164 INFO:teuthology.orchestra.run.smithi193.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 97 kB/s | 26 kB 00:00 2024-04-26T11:15:20.407 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-04-26T11:15:20.514 INFO:teuthology.orchestra.run.smithi193.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-04-26T11:15:20.864 INFO:teuthology.orchestra.run.smithi193.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 192 kB/s | 67 kB 00:00 2024-04-26T11:15:21.189 INFO:teuthology.orchestra.run.smithi193.stdout:(110/152): libarrow-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-04-26T11:15:21.298 INFO:teuthology.orchestra.run.smithi193.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 349 kB/s | 151 kB 00:00 2024-04-26T11:15:21.890 INFO:teuthology.orchestra.run.smithi193.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.2 MB/s | 839 kB 00:00 2024-04-26T11:15:21.915 INFO:teuthology.orchestra.run.smithi193.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 889 kB/s | 548 kB 00:00 2024-04-26T11:15:22.191 INFO:teuthology.orchestra.run.smithi193.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 117 kB/s | 32 kB 00:00 2024-04-26T11:15:22.233 INFO:teuthology.orchestra.run.smithi193.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-04-26T11:15:22.457 INFO:teuthology.orchestra.run.smithi193.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-26T11:15:22.666 INFO:teuthology.orchestra.run.smithi193.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 396 kB/s | 172 kB 00:00 2024-04-26T11:15:22.966 INFO:teuthology.orchestra.run.smithi193.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 705 kB/s | 358 kB 00:00 2024-04-26T11:15:23.293 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-04-26T11:15:23.294 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-04-26T11:15:23.467 INFO:teuthology.orchestra.run.smithi193.stdout:(119/152): ceph-test-19.0.0-3267.gbc94a2a9.el9. 2.6 MB/s | 49 MB 00:19 2024-04-26T11:15:23.492 INFO:teuthology.orchestra.run.smithi193.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 367 kB/s | 303 kB 00:00 2024-04-26T11:15:23.651 INFO:teuthology.orchestra.run.smithi193.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 52 kB/s | 35 kB 00:00 2024-04-26T11:15:23.852 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-04-26T11:15:23.942 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T11:15:23.976 INFO:teuthology.orchestra.run.smithi193.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 404 kB/s | 206 kB 00:00 2024-04-26T11:15:23.979 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T11:15:24.033 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T11:15:24.067 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi193.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 333 kB/s | 144 kB 00:00 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T11:15:24.193 INFO:teuthology.orchestra.run.smithi193.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 49 kB/s | 11 kB 00:00 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi193.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 59 kB/s | 18 kB 00:00 2024-04-26T11:15:24.435 INFO:teuthology.orchestra.run.smithi193.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 2.2 MB/s | 2.0 MB 00:00 2024-04-26T11:15:24.460 INFO:teuthology.orchestra.run.smithi193.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-04-26T11:15:24.514 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T11:15:24.586 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T11:15:24.661 INFO:teuthology.orchestra.run.smithi193.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 70 kB/s | 19 kB 00:00 2024-04-26T11:15:24.706 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T11:15:24.719 INFO:teuthology.orchestra.run.smithi193.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 69 kB/s | 20 kB 00:00 2024-04-26T11:15:24.736 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T11:15:24.827 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T11:15:25.004 INFO:teuthology.orchestra.run.smithi193.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 135 kB/s | 46 kB 00:00 2024-04-26T11:15:25.024 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T11:15:25.070 INFO:teuthology.orchestra.run.smithi193.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 225 kB/s | 79 kB 00:00 2024-04-26T11:15:25.079 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T11:15:25.108 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T11:15:25.193 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T11:15:25.211 INFO:teuthology.orchestra.run.smithi193.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 1.4 MB/s | 1.0 MB 00:00 2024-04-26T11:15:25.216 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T11:15:25.295 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T11:15:25.317 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T11:15:25.342 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T11:15:25.353 INFO:teuthology.orchestra.run.smithi193.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 165 kB/s | 58 kB 00:00 2024-04-26T11:15:25.479 INFO:teuthology.orchestra.run.smithi193.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 61 kB/s | 16 kB 00:00 2024-04-26T11:15:25.534 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T11:15:25.566 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T11:15:25.579 INFO:teuthology.orchestra.run.smithi193.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 535 kB/s | 272 kB 00:00 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi193.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 251 kB/s | 90 kB 00:00 2024-04-26T11:15:25.760 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T11:15:25.763 INFO:teuthology.orchestra.run.smithi193.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 99 kB/s | 28 kB 00:00 2024-04-26T11:15:25.799 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T11:15:25.842 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T11:15:25.846 INFO:teuthology.orchestra.run.smithi193.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 115 kB/s | 31 kB 00:00 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T11:15:25.941 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T11:15:25.984 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T11:15:26.017 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T11:15:26.045 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T11:15:26.113 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T11:15:26.113 INFO:teuthology.orchestra.run.smithi193.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 169 kB/s | 59 kB 00:00 2024-04-26T11:15:26.138 INFO:teuthology.orchestra.run.smithi193.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 123 kB/s | 36 kB 00:00 2024-04-26T11:15:26.172 INFO:teuthology.orchestra.run.smithi193.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 411 kB/s | 188 kB 00:00 2024-04-26T11:15:26.175 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T11:15:26.206 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T11:15:26.241 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T11:15:26.316 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T11:15:26.352 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T11:15:26.395 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T11:15:26.424 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T11:15:26.480 INFO:teuthology.orchestra.run.smithi193.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-26T11:15:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T11:15:26.522 INFO:teuthology.orchestra.run.smithi193.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 256 kB/s | 90 kB 00:00 2024-04-26T11:15:26.538 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T11:15:26.612 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T11:15:26.648 INFO:teuthology.orchestra.run.smithi193.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 451 kB/s | 230 kB 00:00 2024-04-26T11:15:26.762 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T11:15:26.790 INFO:teuthology.orchestra.run.smithi193.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-04-26T11:15:26.816 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T11:15:27.065 INFO:teuthology.orchestra.run.smithi193.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 731 kB/s | 427 kB 00:00 2024-04-26T11:15:27.165 INFO:teuthology.orchestra.run.smithi193.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 371 kB/s | 192 kB 00:00 2024-04-26T11:15:27.338 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T11:15:27.419 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T11:15:27.448 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T11:15:27.483 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T11:15:27.521 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T11:15:27.563 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T11:15:27.565 INFO:teuthology.orchestra.run.smithi193.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-04-26T11:15:27.665 INFO:teuthology.orchestra.run.smithi193.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 14 MB/s | 1.3 MB 00:00 2024-04-26T11:15:27.724 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T11:15:27.773 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T11:15:27.824 INFO:teuthology.orchestra.run.smithi193.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-04-26T11:15:27.827 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T11:15:27.909 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T11:15:27.940 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T11:15:27.977 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T11:15:28.024 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T11:15:28.060 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T11:15:28.099 INFO:teuthology.orchestra.run.smithi193.stdout:(151/152): librados2-19.0.0-3267.gbc94a2a9.el9. 3.3 MB/s | 3.4 MB 00:01 2024-04-26T11:15:28.102 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T11:15:28.144 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T11:15:28.280 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi193.stdout:(152/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 2.7 MB/s | 3.1 MB 00:01 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi193.stdout:Total 4.0 MB/s | 222 MB 00:54 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T11:15:28.482 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T11:15:28.522 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T11:15:28.587 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T11:15:28.612 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T11:15:28.686 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T11:15:28.813 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T11:15:28.844 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T11:15:28.863 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T11:15:28.898 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T11:15:29.058 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T11:15:29.091 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T11:15:29.133 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T11:15:29.167 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T11:15:29.297 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T11:15:29.328 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T11:15:29.375 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T11:15:29.404 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-04-26T11:15:29.473 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T11:15:29.537 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T11:15:29.549 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-04-26T11:15:29.549 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-04-26T11:15:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T11:15:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T11:15:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T11:15:30.045 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T11:15:30.177 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T11:15:30.248 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T11:15:30.293 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T11:15:30.326 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T11:15:30.423 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T11:15:30.562 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T11:15:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T11:15:30.603 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T11:15:30.700 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T11:15:30.780 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T11:15:30.809 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T11:15:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T11:15:30.886 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T11:15:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T11:15:31.037 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T11:15:31.093 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T11:15:31.379 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-04-26T11:15:31.379 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-04-26T11:15:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T11:15:31.481 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T11:15:31.505 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T11:15:31.526 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T11:15:31.639 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T11:15:31.650 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T11:15:31.682 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T11:15:31.791 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T11:15:31.824 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T11:15:31.884 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T11:15:32.142 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T11:15:32.179 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T11:15:32.362 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T11:15:32.483 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T11:15:32.526 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T11:15:32.571 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T11:15:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T11:15:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T11:15:32.772 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T11:15:32.816 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T11:15:32.848 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T11:15:32.851 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T11:15:32.929 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T11:15:32.958 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T11:15:32.960 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T11:15:32.990 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T11:15:33.033 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T11:15:33.066 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T11:15:33.229 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T11:15:33.270 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T11:15:33.300 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T11:15:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T11:15:33.345 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T11:15:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T11:15:33.435 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T11:15:33.466 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T11:15:33.483 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T11:15:33.502 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T11:15:33.549 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T11:15:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T11:15:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T11:15:33.979 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T11:15:34.006 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T11:15:34.076 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T11:15:34.099 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T11:15:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T11:15:34.679 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T11:15:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T11:15:34.910 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T11:15:35.164 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T11:15:35.228 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T11:15:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T11:15:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T11:15:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T11:15:35.508 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T11:15:35.578 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T11:15:35.626 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T11:15:35.688 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T11:15:35.752 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T11:15:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T11:15:35.998 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T11:15:36.035 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T11:15:36.090 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T11:15:36.218 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T11:15:36.268 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T11:15:36.317 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T11:15:36.320 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T11:15:36.350 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T11:15:36.354 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T11:15:36.383 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T11:15:36.566 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T11:15:36.743 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T11:15:36.789 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T11:15:36.828 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T11:15:36.898 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T11:15:36.903 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T11:15:36.932 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T11:15:36.968 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T11:15:37.025 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T11:15:37.025 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T11:15:37.025 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T11:15:37.025 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:37.026 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T11:15:37.058 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T11:15:37.069 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T11:15:37.115 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T11:15:37.164 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T11:15:37.247 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T11:15:37.296 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T11:15:37.439 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T11:15:37.443 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-04-26T11:15:37.510 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T11:15:37.528 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T11:15:37.554 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T11:15:37.574 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T11:15:37.628 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T11:15:37.820 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T11:15:37.882 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T11:15:38.067 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T11:15:38.171 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T11:15:38.422 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T11:15:38.452 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T11:15:38.604 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T11:15:38.657 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T11:15:38.685 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T11:15:38.780 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T11:15:38.802 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T11:15:38.831 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T11:15:38.848 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T11:15:38.870 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T11:15:38.881 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T11:15:38.890 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T11:15:38.915 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T11:15:39.034 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T11:15:39.044 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T11:15:39.078 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T11:15:39.103 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T11:15:39.185 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T11:15:39.194 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T11:15:39.233 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T11:15:39.281 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T11:15:39.319 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T11:15:39.353 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T11:15:39.418 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T11:15:39.461 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T11:15:39.464 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T11:15:39.496 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T11:15:39.504 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T11:15:39.537 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T11:15:39.565 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T11:15:39.611 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T11:15:39.633 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T11:15:39.687 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T11:15:39.718 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T11:15:39.752 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T11:15:39.829 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T11:15:39.872 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T11:15:39.907 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T11:15:39.935 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T11:15:40.006 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T11:15:40.067 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T11:15:40.142 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T11:15:40.276 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T11:15:40.328 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T11:15:40.445 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T11:15:40.593 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T11:15:40.868 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T11:15:40.957 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T11:15:40.993 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T11:15:41.036 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T11:15:41.074 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T11:15:41.116 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T11:15:41.278 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T11:15:41.319 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T11:15:41.373 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T11:15:41.446 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T11:15:41.478 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T11:15:41.514 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T11:15:41.560 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T11:15:41.597 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T11:15:41.640 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T11:15:41.682 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T11:15:41.818 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T11:15:41.862 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T11:15:41.892 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T11:15:41.934 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T11:15:42.027 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T11:15:42.059 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T11:15:42.099 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T11:15:42.125 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T11:15:42.149 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T11:15:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T11:15:42.224 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T11:15:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T11:15:42.289 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T11:15:42.329 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T11:15:42.350 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T11:15:42.381 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T11:15:42.409 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T11:15:42.443 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T11:15:42.483 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T11:15:42.514 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T11:15:42.544 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T11:15:42.570 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T11:15:42.603 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T11:15:42.645 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T11:15:42.680 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T11:15:42.702 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T11:15:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T11:15:42.767 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T11:15:42.810 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T11:15:42.841 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T11:15:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T11:15:42.897 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T11:15:42.911 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T11:15:42.955 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T11:15:43.203 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T11:15:43.259 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T11:15:43.495 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T11:15:43.527 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T11:15:43.619 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T11:15:43.645 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T11:15:43.979 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T11:15:44.031 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T11:15:44.065 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T11:15:44.165 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T11:15:44.215 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T11:15:44.301 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T11:15:44.333 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T11:15:44.511 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T11:15:44.556 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T11:15:44.634 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T11:15:45.277 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T11:15:45.396 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T11:15:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T11:15:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T11:15:46.623 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T11:15:46.700 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T11:15:46.728 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T11:15:46.761 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T11:15:47.072 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T11:15:47.108 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T11:15:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T11:15:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T11:15:47.197 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T11:15:47.221 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T11:15:47.257 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T11:15:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T11:15:47.325 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T11:15:47.325 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T11:15:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:15:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T11:15:47.735 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T11:15:47.769 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T11:15:47.842 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T11:15:47.862 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T11:15:48.466 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T11:15:48.466 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2024-04-26T11:15:48.466 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2024-04-26T11:15:48.466 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2024-04-26T11:15:48.466 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2024-04-26T11:15:48.466 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2024-04-26T11:15:48.466 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /root 2024-04-26T11:15:48.466 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2024-04-26T11:15:48.467 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:48.636 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T11:15:48.651 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T11:15:48.651 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:15:48.651 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T11:15:48.651 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:50.138 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T11:15:50.151 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T11:15:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T11:15:50.164 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:15:50.164 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T11:15:50.164 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T11:15:50.164 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T11:15:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:50.185 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T11:15:50.389 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T11:15:50.411 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T11:15:50.411 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:15:50.411 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T11:15:50.411 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T11:15:50.411 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T11:15:50.411 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:50.724 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T11:15:50.771 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T11:15:50.856 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T11:15:50.865 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T11:15:50.865 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T11:15:50.865 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T11:15:50.865 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:15:50.878 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T11:15:50.879 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:15:50.879 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T11:15:50.879 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T11:15:50.879 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T11:15:50.879 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:50.898 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T11:15:50.986 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T11:15:51.035 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T11:15:51.089 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T11:15:51.273 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T11:15:51.323 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T11:15:51.392 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T11:15:51.480 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T11:15:51.620 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T11:15:51.656 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T11:15:51.688 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T11:15:51.716 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T11:15:52.135 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T11:15:52.165 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T11:15:52.205 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T11:15:52.274 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T11:15:52.304 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T11:15:53.354 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T11:15:53.397 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T11:15:54.368 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T11:15:54.398 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T11:15:54.499 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T11:15:54.670 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T11:15:54.700 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T11:15:54.723 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T11:15:54.723 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:15:54.723 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T11:15:54.723 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T11:15:54.723 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T11:15:54.723 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:54.767 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T11:15:54.778 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T11:15:54.877 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T11:15:54.923 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T11:15:55.850 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T11:15:55.878 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T11:15:55.900 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T11:15:55.900 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:15:55.900 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T11:15:55.901 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:15:55.901 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:15:55.901 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:55.945 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T11:15:55.966 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T11:15:55.966 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:15:55.967 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T11:15:55.967 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:56.013 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T11:15:56.034 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T11:15:56.034 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:15:56.034 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T11:15:56.034 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T11:15:56.034 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T11:15:56.034 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:56.338 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T11:15:56.361 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T11:15:56.361 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:15:56.361 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T11:15:56.361 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T11:15:56.361 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T11:15:56.361 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:15:59.938 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T11:15:59.938 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-04-26T11:15:59.939 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-04-26T11:15:59.939 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-04-26T11:15:59.939 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-04-26T11:15:59.939 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-04-26T11:15:59.939 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-04-26T11:15:59.939 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-04-26T11:15:59.939 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:00.172 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T11:16:00.218 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T11:16:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T11:16:00.218 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:00.975 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T11:16:01.016 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T11:16:01.057 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T11:16:01.089 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T11:16:01.116 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T11:16:01.298 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T11:16:01.345 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T11:16:01.375 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T11:16:01.831 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T11:16:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T11:16:01.912 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:01.912 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T11:16:01.912 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T11:16:01.912 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T11:16:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:01.940 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T11:16:01.981 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T11:16:02.000 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T11:16:02.156 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T11:16:02.224 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T11:16:02.224 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:02.224 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T11:16:02.224 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T11:16:02.224 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T11:16:02.224 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:02.579 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T11:16:02.579 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /sys 2024-04-26T11:16:02.579 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /proc 2024-04-26T11:16:02.580 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /mnt 2024-04-26T11:16:02.580 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /var/tmp 2024-04-26T11:16:02.580 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /home 2024-04-26T11:16:02.580 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /root 2024-04-26T11:16:02.580 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /tmp 2024-04-26T11:16:02.580 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:02.707 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T11:16:02.750 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T11:16:02.765 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T11:16:02.765 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:02.765 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T11:16:02.765 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:02.774 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T11:16:02.774 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:02.774 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T11:16:02.774 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T11:16:02.774 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T11:16:02.774 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:02.828 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T11:16:02.899 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T11:16:02.921 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T11:16:02.962 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T11:16:02.967 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T11:16:03.039 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T11:16:03.042 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T11:16:03.074 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T11:16:03.074 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T11:16:03.158 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T11:16:03.191 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T11:16:03.191 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T11:16:03.265 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T11:16:03.278 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T11:16:03.336 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T11:16:03.348 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T11:16:03.422 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T11:16:03.530 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T11:16:03.697 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T11:16:03.749 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T11:16:03.784 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T11:16:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T11:16:04.244 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T11:16:04.269 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T11:16:04.270 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:04.270 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T11:16:04.270 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T11:16:04.270 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T11:16:04.270 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:04.495 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T11:16:04.508 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T11:16:04.517 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T11:16:04.517 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:04.517 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T11:16:04.517 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T11:16:04.518 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T11:16:04.518 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:04.546 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T11:16:04.623 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T11:16:04.716 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T11:16:04.749 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T11:16:04.962 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T11:16:04.984 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T11:16:04.984 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:04.984 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T11:16:04.984 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T11:16:04.984 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T11:16:04.985 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:05.092 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T11:16:05.149 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T11:16:05.205 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T11:16:05.392 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T11:16:05.446 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T11:16:05.524 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T11:16:05.613 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T11:16:05.753 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T11:16:05.796 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T11:16:05.828 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T11:16:05.855 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T11:16:06.056 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T11:16:06.109 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T11:16:06.190 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T11:16:06.212 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T11:16:06.244 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T11:16:06.307 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T11:16:06.335 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T11:16:07.214 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T11:16:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T11:16:07.374 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T11:16:07.389 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T11:16:07.403 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T11:16:07.567 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T11:16:07.595 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T11:16:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T11:16:07.666 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:07.666 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T11:16:07.666 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T11:16:07.666 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T11:16:07.666 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:07.729 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T11:16:07.767 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T11:16:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T11:16:07.952 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T11:16:08.371 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T11:16:08.395 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T11:16:08.498 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T11:16:08.783 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T11:16:08.814 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T11:16:08.836 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T11:16:08.836 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:08.837 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T11:16:08.837 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T11:16:08.837 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T11:16:08.837 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:08.882 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T11:16:08.892 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T11:16:08.965 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T11:16:08.990 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T11:16:08.998 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T11:16:09.039 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T11:16:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T11:16:09.068 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:09.068 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T11:16:09.068 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:16:09.069 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:16:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:09.124 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T11:16:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T11:16:09.193 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:09.193 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T11:16:09.193 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:09.257 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T11:16:09.331 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T11:16:09.332 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:09.332 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T11:16:09.332 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T11:16:09.332 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T11:16:09.332 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:09.454 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T11:16:09.454 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T11:16:09.455 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T11:16:09.456 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T11:16:09.468 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T11:16:09.468 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T11:16:09.468 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T11:16:09.468 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T11:16:09.469 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T11:16:09.470 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T11:16:09.471 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T11:16:09.472 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T11:16:09.473 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T11:16:09.474 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T11:16:09.475 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T11:16:09.476 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T11:16:09.477 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T11:16:09.683 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T11:16:09.753 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T11:16:09.753 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:09.753 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T11:16:09.753 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T11:16:09.753 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T11:16:09.753 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:09.963 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T11:16:09.992 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T11:16:10.014 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T11:16:10.014 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:10.014 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T11:16:10.014 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:16:10.018 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:16:10.018 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:10.059 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T11:16:10.080 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T11:16:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T11:16:10.081 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:10.126 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T11:16:10.148 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T11:16:10.149 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:10.149 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T11:16:10.149 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T11:16:10.149 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T11:16:10.149 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:10.460 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T11:16:10.482 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T11:16:10.483 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T11:16:10.483 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T11:16:10.483 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T11:16:10.483 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T11:16:10.483 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:11.597 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T11:16:11.597 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:16:11.597 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2024-04-26T11:16:11.597 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.597 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.597 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T11:16:11.597 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T11:16:11.597 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-04-26T11:16:11.597 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.598 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.599 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T11:16:11.600 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.601 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T11:16:11.602 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.603 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T11:16:11.604 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T11:16:11.605 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T11:16:11.606 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T11:16:11.606 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T11:16:11.606 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T11:16:11.606 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T11:16:11.606 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T11:16:11.606 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T11:16:11.606 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T11:16:11.610 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T11:16:11.610 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T11:16:11.610 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T11:16:11.610 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T11:16:11.610 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T11:16:11.610 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T11:16:11.610 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T11:16:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:11.612 INFO:teuthology.orchestra.run.smithi196.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T11:16:11.613 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T11:16:11.613 INFO:teuthology.orchestra.run.smithi196.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T11:16:11.613 INFO:teuthology.orchestra.run.smithi196.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T11:16:11.613 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T11:16:11.613 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T11:16:11.613 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T11:16:11.613 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:16:11.614 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-04-26T11:16:11.977 DEBUG:teuthology.parallel:result is None 2024-04-26T11:16:14.777 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T11:16:14.831 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T11:16:14.912 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T11:16:14.955 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T11:16:15.002 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T11:16:15.056 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T11:16:15.105 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T11:16:15.147 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T11:16:15.178 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T11:16:15.205 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T11:16:15.320 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T11:16:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T11:16:15.391 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T11:16:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T11:16:15.434 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T11:16:15.456 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T11:16:15.987 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T11:16:16.028 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T11:16:16.048 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T11:16:16.283 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T11:16:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T11:16:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T11:16:16.879 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T11:16:16.966 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T11:16:17.008 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T11:16:17.092 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T11:16:17.137 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T11:16:17.137 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T11:16:17.221 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T11:16:17.254 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T11:16:17.254 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T11:16:17.341 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T11:16:17.411 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T11:16:17.734 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T11:16:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T11:16:17.927 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T11:16:18.141 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T11:16:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T11:16:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T11:16:18.311 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T11:16:18.352 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T11:16:18.353 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T11:16:18.526 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T11:16:18.656 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T11:16:18.993 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T11:16:18.993 INFO:teuthology.orchestra.run.smithi110.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-26T11:16:18.993 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:23.021 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T11:16:23.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T11:16:23.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T11:16:23.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T11:16:23.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T11:16:23.021 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T11:16:23.022 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T11:16:23.023 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T11:16:23.024 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T11:16:23.037 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T11:16:23.038 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T11:16:23.039 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T11:16:23.040 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T11:16:23.041 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T11:16:23.042 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T11:16:23.042 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T11:16:23.042 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T11:16:23.042 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T11:16:23.043 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T11:16:23.043 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T11:16:23.043 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T11:16:23.043 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T11:16:23.043 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T11:16:23.043 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T11:16:23.043 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T11:16:23.044 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T11:16:23.044 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T11:16:23.044 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T11:16:23.044 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T11:16:23.044 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T11:16:23.044 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T11:16:23.044 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T11:16:23.044 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T11:16:23.044 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T11:16:23.045 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T11:16:23.046 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T11:16:23.046 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T11:16:23.046 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T11:16:23.046 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T11:16:23.047 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T11:16:23.048 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T11:16:23.048 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T11:16:23.048 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T11:16:23.048 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T11:16:23.048 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T11:16:23.048 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T11:16:23.049 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T11:16:23.049 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T11:16:23.049 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T11:16:23.049 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T11:16:23.049 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T11:16:23.049 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T11:16:23.049 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T11:16:23.050 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T11:16:23.050 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T11:16:23.050 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T11:16:23.050 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T11:16:23.050 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T11:16:23.050 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T11:16:23.050 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T11:16:23.050 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T11:16:23.050 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T11:16:25.089 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T11:16:25.089 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T11:16:25.089 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T11:16:25.089 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T11:16:25.090 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T11:16:25.091 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T11:16:25.102 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T11:16:25.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T11:16:25.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T11:16:25.105 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T11:16:25.106 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T11:16:25.107 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T11:16:25.108 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T11:16:25.109 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T11:16:25.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T11:16:25.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T11:16:25.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T11:16:25.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T11:16:25.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T11:16:25.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T11:16:25.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T11:16:25.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T11:16:25.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T11:16:25.198 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T11:16:25.198 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:25.198 INFO:teuthology.orchestra.run.smithi193.stdout:Upgraded: 2024-04-26T11:16:25.198 INFO:teuthology.orchestra.run.smithi193.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.199 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.200 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T11:16:25.201 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.202 INFO:teuthology.orchestra.run.smithi193.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T11:16:25.203 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T11:16:25.204 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T11:16:25.205 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T11:16:25.206 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T11:16:25.207 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.208 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.209 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:25.209 INFO:teuthology.orchestra.run.smithi193.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T11:16:25.209 INFO:teuthology.orchestra.run.smithi193.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T11:16:25.209 INFO:teuthology.orchestra.run.smithi193.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T11:16:25.209 INFO:teuthology.orchestra.run.smithi193.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T11:16:25.209 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T11:16:25.209 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T11:16:25.209 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T11:16:25.210 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-04-26T11:16:25.210 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-04-26T11:16:25.611 DEBUG:teuthology.parallel:result is None 2024-04-26T11:16:27.510 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T11:16:27.510 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T11:16:27.511 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.512 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T11:16:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T11:16:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T11:16:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T11:16:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T11:16:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T11:16:27.518 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T11:16:27.519 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T11:16:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T11:16:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T11:16:27.522 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T11:16:27.522 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T11:16:27.522 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T11:16:27.522 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T11:16:27.522 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T11:16:27.522 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T11:16:27.522 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T11:16:27.522 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T11:16:27.523 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T11:16:27.524 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T11:16:27.524 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:16:27.524 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-04-26T11:16:28.060 DEBUG:teuthology.parallel:result is None 2024-04-26T11:16:28.061 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:16:28.208 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T11:16:28.257 INFO:teuthology.orchestra.run.smithi110.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T11:16:28.258 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T11:16:28.258 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T11:16:28.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:16:28.414 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T11:16:28.439 INFO:teuthology.orchestra.run.smithi193.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T11:16:28.439 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T11:16:28.439 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T11:16:28.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:16:28.654 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T11:16:28.680 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T11:16:28.680 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T11:16:28.681 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T11:16:28.682 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T11:16:28.683 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:16:28.683 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:16:28.753 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:16:28.754 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:16:28.784 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:16:28.784 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:16:28.815 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T11:16:28.815 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:16:28.815 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:16:28.882 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:16:28.989 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:16:28.989 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:16:29.035 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:16:29.102 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:16:29.102 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:16:29.130 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:16:29.197 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T11:16:29.197 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:16:29.197 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:16:29.268 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:16:29.383 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:16:29.383 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:16:29.410 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:16:29.478 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:16:29.478 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:16:29.502 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:16:29.568 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T11:16:29.568 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:16:29.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:16:29.641 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:16:29.747 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:16:29.747 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:16:29.774 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:16:29.842 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:16:29.842 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:16:29.866 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:16:29.930 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-26T11:16:30.036 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'subvols': {'create': 2}} 2024-04-26T11:16:30.036 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:16:30.036 INFO:tasks.cephadm:Cluster fsid is 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:16:30.036 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-26T11:16:30.037 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.110', 'mon.b': '172.21.15.193', 'mon.c': '172.21.15.196'} 2024-04-26T11:16:30.037 INFO:tasks.cephadm:First mon is mon.a on smithi110 2024-04-26T11:16:30.037 INFO:tasks.cephadm:First mgr is x 2024-04-26T11:16:30.037 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-26T11:16:30.037 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname $(hostname -s) 2024-04-26T11:16:30.110 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname $(hostname -s) 2024-04-26T11:16:30.139 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname $(hostname -s) 2024-04-26T11:16:30.163 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-26T11:16:30.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:16:30.377 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78913/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3267-gbc94a2a9', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3267.gbc94a2a9'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-26 08:22:46.917786', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-quiescer-fixes', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-04-26T11:16:30.515 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-lusov-quiescer-fixes, sha1 bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:16:30.517 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm 2024-04-26T11:16:30.517 DEBUG:teuthology.orchestra.run.smithi110:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T11:16:32.049 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r--. 1 ubuntu ubuntu 781590 Apr 26 11:16 /home/ubuntu/cephtest/cephadm 2024-04-26T11:16:32.049 DEBUG:teuthology.orchestra.run.smithi193:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T11:16:33.169 INFO:teuthology.orchestra.run.smithi193.stdout:-rw-r--r--. 1 ubuntu ubuntu 781590 Apr 26 11:16 /home/ubuntu/cephtest/cephadm 2024-04-26T11:16:33.170 DEBUG:teuthology.orchestra.run.smithi196:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T11:16:34.133 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r--. 1 ubuntu ubuntu 781590 Apr 26 11:16 /home/ubuntu/cephtest/cephadm 2024-04-26T11:16:34.134 DEBUG:teuthology.orchestra.run.smithi110:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T11:16:34.180 DEBUG:teuthology.orchestra.run.smithi193:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T11:16:34.198 DEBUG:teuthology.orchestra.run.smithi196:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T11:16:34.236 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 on all hosts... 2024-04-26T11:16:34.236 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 pull 2024-04-26T11:16:34.241 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 pull 2024-04-26T11:16:34.243 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 pull 2024-04-26T11:16:35.799 INFO:teuthology.orchestra.run.smithi196.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T11:16:35.852 INFO:teuthology.orchestra.run.smithi193.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T11:16:36.431 INFO:teuthology.orchestra.run.smithi110.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T11:17:14.438 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:17:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T11:17:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "image_id": "3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555", 2024-04-26T11:17:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "repo_digests": [ 2024-04-26T11:17:14.438 INFO:teuthology.orchestra.run.smithi110.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc" 2024-04-26T11:17:14.439 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-04-26T11:17:14.439 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:17:36.230 INFO:teuthology.orchestra.run.smithi193.stdout:{ 2024-04-26T11:17:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T11:17:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "image_id": "3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555", 2024-04-26T11:17:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "repo_digests": [ 2024-04-26T11:17:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc" 2024-04-26T11:17:36.231 INFO:teuthology.orchestra.run.smithi193.stdout: ] 2024-04-26T11:17:36.231 INFO:teuthology.orchestra.run.smithi193.stdout:} 2024-04-26T11:17:43.857 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-04-26T11:17:43.957 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T11:17:43.957 INFO:teuthology.orchestra.run.smithi196.stdout: "image_id": "3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555", 2024-04-26T11:17:43.957 INFO:teuthology.orchestra.run.smithi196.stdout: "repo_digests": [ 2024-04-26T11:17:43.957 INFO:teuthology.orchestra.run.smithi196.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc" 2024-04-26T11:17:43.958 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-04-26T11:17:43.958 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-04-26T11:17:43.959 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph 2024-04-26T11:17:44.056 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph 2024-04-26T11:17:44.088 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph 2024-04-26T11:17:44.114 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /etc/ceph 2024-04-26T11:17:44.202 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /etc/ceph 2024-04-26T11:17:44.229 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /etc/ceph 2024-04-26T11:17:44.253 INFO:tasks.cephadm:Writing seed config... 2024-04-26T11:17:44.254 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-26T11:17:44.254 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-26T11:17:44.254 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-26T11:17:44.254 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-26T11:17:44.254 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-26T11:17:44.255 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-26T11:17:44.256 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-26T11:17:44.257 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-26T11:17:44.257 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-26T11:17:44.257 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-26T11:17:44.257 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-26T11:17:44.257 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-26T11:17:44.257 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-26T11:17:44.257 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-26T11:17:44.257 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-26T11:17:44.257 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-26T11:17:44.258 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:17:44.258 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-26T11:17:44.315 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6e439470-03be-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-26T11:17:44.315 DEBUG:teuthology.orchestra.run.smithi110:mon.a> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mon.a.service 2024-04-26T11:17:44.363 DEBUG:teuthology.orchestra.run.smithi110:mgr.x> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mgr.x.service 2024-04-26T11:17:44.408 INFO:tasks.cephadm:Bootstrapping... 2024-04-26T11:17:44.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 -v bootstrap --fsid 6e439470-03be-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.110 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-26T11:17:44.684 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:17:44.684 INFO:teuthology.orchestra.run.smithi110.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', '-v', 'bootstrap', '--fsid', '6e439470-03be-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.110', '--skip-admin-label'] 2024-04-26T11:17:44.684 INFO:teuthology.orchestra.run.smithi110.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-26T11:17:44.684 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying podman|docker is present... 2024-04-26T11:17:44.743 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T11:17:44.743 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying lvm2 is present... 2024-04-26T11:17:44.744 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying time synchronization is in place... 2024-04-26T11:17:44.758 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T11:17:44.759 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T11:17:44.772 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T11:17:44.772 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-04-26T11:17:44.786 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout enabled 2024-04-26T11:17:44.799 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout active 2024-04-26T11:17:44.800 INFO:teuthology.orchestra.run.smithi110.stdout:Unit chronyd.service is enabled and running 2024-04-26T11:17:44.800 INFO:teuthology.orchestra.run.smithi110.stdout:Repeating the final host check... 2024-04-26T11:17:44.849 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T11:17:44.849 INFO:teuthology.orchestra.run.smithi110.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-26T11:17:44.849 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl is present 2024-04-26T11:17:44.849 INFO:teuthology.orchestra.run.smithi110.stdout:lvcreate is present 2024-04-26T11:17:44.864 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T11:17:44.864 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T11:17:44.883 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T11:17:44.883 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-04-26T11:17:44.905 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout enabled 2024-04-26T11:17:44.925 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout active 2024-04-26T11:17:44.926 INFO:teuthology.orchestra.run.smithi110.stdout:Unit chronyd.service is enabled and running 2024-04-26T11:17:44.926 INFO:teuthology.orchestra.run.smithi110.stdout:Host looks OK 2024-04-26T11:17:44.926 INFO:teuthology.orchestra.run.smithi110.stdout:Cluster fsid: 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:17:44.926 INFO:teuthology.orchestra.run.smithi110.stdout:Acquiring lock 139634327133344 on /run/cephadm/6e439470-03be-11ef-bc93-c7b262605968.lock 2024-04-26T11:17:44.926 INFO:teuthology.orchestra.run.smithi110.stdout:Lock 139634327133344 acquired on /run/cephadm/6e439470-03be-11ef-bc93-c7b262605968.lock 2024-04-26T11:17:44.927 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying IP 172.21.15.110 port 3300 ... 2024-04-26T11:17:44.927 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying IP 172.21.15.110 port 6789 ... 2024-04-26T11:17:44.927 INFO:teuthology.orchestra.run.smithi110.stdout:Base mon IP(s) is [172.21.15.110:3300, 172.21.15.110:6789], mon addrv is [v2:172.21.15.110:3300,v1:172.21.15.110:6789] 2024-04-26T11:17:44.936 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.110 metric 100 2024-04-26T11:17:44.936 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.110 metric 100 2024-04-26T11:17:44.944 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-26T11:17:44.944 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-26T11:17:44.944 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-04-26T11:17:44.952 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-26T11:17:44.952 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-26T11:17:44.952 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T11:17:44.952 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-26T11:17:44.952 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-04-26T11:17:44.953 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T11:17:44.953 INFO:teuthology.orchestra.run.smithi110.stdout:Mon IP `172.21.15.110` is in CIDR network `172.21.0.0/20` 2024-04-26T11:17:44.953 INFO:teuthology.orchestra.run.smithi110.stdout:Mon IP `172.21.15.110` is in CIDR network `172.21.0.0/20` 2024-04-26T11:17:44.954 INFO:teuthology.orchestra.run.smithi110.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-26T11:17:44.954 INFO:teuthology.orchestra.run.smithi110.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-26T11:17:44.955 INFO:teuthology.orchestra.run.smithi110.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T11:17:45.513 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 2024-04-26T11:17:45.513 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T11:17:45.513 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Getting image source signatures 2024-04-26T11:17:45.513 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Copying blob sha256:449452a284afe5840255d087488a224329a4679c5f5d200bb867a639c75ddfd2 2024-04-26T11:17:45.514 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-26T11:17:45.514 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Copying config sha256:3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 2024-04-26T11:17:45.514 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-26T11:17:46.761 INFO:teuthology.orchestra.run.smithi110.stdout:ceph: stdout ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:17:46.761 INFO:teuthology.orchestra.run.smithi110.stdout:Ceph version: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:17:46.761 INFO:teuthology.orchestra.run.smithi110.stdout:Extracting ceph user uid/gid from container image... 2024-04-26T11:17:48.033 INFO:teuthology.orchestra.run.smithi110.stdout:stat: stdout 167 167 2024-04-26T11:17:48.034 INFO:teuthology.orchestra.run.smithi110.stdout:Creating initial keys... 2024-04-26T11:17:49.064 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph-authtool: stdout AQBcjStmJ9FPHBAAFOu7zoiNFau4eCreSIwEGw== 2024-04-26T11:17:50.447 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph-authtool: stdout AQBdjStmdseaIBAASfqYWKeaepMVTq7fCg2Z6Q== 2024-04-26T11:17:51.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph-authtool: stdout AQBejStmlyykOBAAGXxkPiPau4jJ5JiC/ZDNdw== 2024-04-26T11:17:51.620 INFO:teuthology.orchestra.run.smithi110.stdout:Creating initial monmap... 2024-04-26T11:17:52.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T11:17:52.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-26T11:17:52.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:17:52.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T11:17:52.702 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool for a [v2:172.21.15.110:3300,v1:172.21.15.110:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T11:17:52.702 INFO:teuthology.orchestra.run.smithi110.stdout:setting min_mon_release = quincy 2024-04-26T11:17:52.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: set fsid to 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:17:52.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T11:17:52.702 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:17:52.702 INFO:teuthology.orchestra.run.smithi110.stdout:Creating mon... 2024-04-26T11:17:53.870 INFO:teuthology.orchestra.run.smithi110.stdout:create mon.a on 2024-04-26T11:17:54.266 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-26T11:17:54.504 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-26T11:17:54.798 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6e439470-03be-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-6e439470-03be-11ef-bc93-c7b262605968.target. 2024-04-26T11:17:54.799 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6e439470-03be-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-6e439470-03be-11ef-bc93-c7b262605968.target. 2024-04-26T11:17:55.394 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6e439470-03be-11ef-bc93-c7b262605968@mon.a 2024-04-26T11:17:55.394 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6e439470-03be-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-6e439470-03be-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-26T11:17:55.677 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6e439470-03be-11ef-bc93-c7b262605968.target.wants/ceph-6e439470-03be-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-6e439470-03be-11ef-bc93-c7b262605968@.service. 2024-04-26T11:17:56.354 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:56 smithi110 podman[27684]: 2024-04-26 11:17:56.097365891 +0000 UTC m=+0.157449737 container create c90e0fa386efc92cedb2ef5d4da66facbae8a7fa6156ecd38c1d1f2598749cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:17:56.354 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:56 smithi110 podman[27684]: 2024-04-26 11:17:56.351275488 +0000 UTC m=+0.411359341 container init c90e0fa386efc92cedb2ef5d4da66facbae8a7fa6156ecd38c1d1f2598749cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T11:17:56.464 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T11:17:56.464 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-04-26T11:17:56.480 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T11:17:56.480 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-04-26T11:17:56.480 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-04-26T11:17:56.480 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T11:17:56.481 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mon to start... 2024-04-26T11:17:56.481 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mon... 2024-04-26T11:17:56.632 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:56 smithi110 podman[27684]: 2024-04-26 11:17:56.361397291 +0000 UTC m=+0.421481107 container start c90e0fa386efc92cedb2ef5d4da66facbae8a7fa6156ecd38c1d1f2598749cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:17:56.632 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:56 smithi110 bash[27684]: c90e0fa386efc92cedb2ef5d4da66facbae8a7fa6156ecd38c1d1f2598749cb4 2024-04-26T11:17:56.632 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:56 smithi110 systemd[1]: Started Ceph mon.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:17:56.632 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:56 smithi110 ceph-mon[27702]: mkfs 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:17:56.632 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:56 smithi110 ceph-mon[27702]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T11:17:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T11:17:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: monmap epoch 1 2024-04-26T11:17:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:17:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: last_changed 2024-04-26T11:17:52.091691+0000 2024-04-26T11:17:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:17:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: min_mon_release 19 (squid) 2024-04-26T11:17:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: election_strategy: 1 2024-04-26T11:17:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:17:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: fsmap 2024-04-26T11:17:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T11:17:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: mgrmap e1: no daemons active 2024-04-26T11:17:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:57 smithi110 ceph-mon[27702]: from='client.? 172.21.15.110:0/2545636362' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout cluster: 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout id: 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout services: 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.717934s) 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout data: 2024-04-26T11:17:57.805 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout pgs: 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.061+0000 7f16c6e00700 1 Processor -- start 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.061+0000 7f16c6e00700 1 -- start start 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.062+0000 7f16c6e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c0107a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.062+0000 7f16c6e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f16c007ce50 con 0x7f16c01075f0 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.063+0000 7f16bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c0107a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.063+0000 7f16bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c0107a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52724/0 (socket says 172.21.15.110:52724) 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.063+0000 7f16bfe00700 1 -- 172.21.15.110:0/14573959 learned_addr learned my addr 172.21.15.110:0/14573959 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.063+0000 7f16bfe00700 1 -- 172.21.15.110:0/14573959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c0107f50 con 0x7f16c01075f0 2024-04-26T11:17:57.806 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.064+0000 7f16bfe00700 1 --2- 172.21.15.110:0/14573959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c0107a10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f16b00098a0 tx=0x7f16b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be25fa0de5f24248 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.064+0000 7f16bea00700 1 -- 172.21.15.110:0/14573959 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b0004160 con 0x7f16c01075f0 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.064+0000 7f16bea00700 1 -- 172.21.15.110:0/14573959 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b0004300 con 0x7f16c01075f0 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.064+0000 7f16bea00700 1 -- 172.21.15.110:0/14573959 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b00036a0 con 0x7f16c01075f0 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.065+0000 7f16c6e00700 1 -- 172.21.15.110:0/14573959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 msgr2=0x7f16c0107a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.065+0000 7f16c6e00700 1 --2- 172.21.15.110:0/14573959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c0107a10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f16b00098a0 tx=0x7f16b0009bb0 comp rx=0 tx=0).stop 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.065+0000 7f16c6e00700 1 -- 172.21.15.110:0/14573959 shutdown_connections 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.065+0000 7f16c6e00700 1 --2- 172.21.15.110:0/14573959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c0107a10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.065+0000 7f16c6e00700 1 -- 172.21.15.110:0/14573959 >> 172.21.15.110:0/14573959 conn(0x7f16c0103210 msgr2=0x7f16c0105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.065+0000 7f16c6e00700 1 -- 172.21.15.110:0/14573959 shutdown_connections 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.065+0000 7f16c6e00700 1 -- 172.21.15.110:0/14573959 wait complete. 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.066+0000 7f16c6e00700 1 Processor -- start 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.066+0000 7f16c6e00700 1 -- start start 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.066+0000 7f16c6e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c019e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:17:57.807 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.066+0000 7f16c6e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0108480 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.067+0000 7f16bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c019e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.067+0000 7f16bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c019e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52728/0 (socket says 172.21.15.110:52728) 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.067+0000 7f16bfe00700 1 -- 172.21.15.110:0/2545636362 learned_addr learned my addr 172.21.15.110:0/2545636362 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.067+0000 7f16bfe00700 1 -- 172.21.15.110:0/2545636362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c019eb70 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.067+0000 7f16bfe00700 1 --2- 172.21.15.110:0/2545636362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c019e630 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000c00 tx=0x7f16b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.068+0000 7f16bcc00700 1 -- 172.21.15.110:0/2545636362 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b0003db0 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.068+0000 7f16bcc00700 1 -- 172.21.15.110:0/2545636362 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b0011630 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.068+0000 7f16c6e00700 1 -- 172.21.15.110:0/2545636362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c019ee00 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.068+0000 7f16bcc00700 1 -- 172.21.15.110:0/2545636362 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b0011950 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.068+0000 7f16c6e00700 1 -- 172.21.15.110:0/2545636362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c01a1af0 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.068+0000 7f16bcc00700 1 -- 172.21.15.110:0/2545636362 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f16b0011af0 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.068+0000 7f16bcc00700 1 -- 172.21.15.110:0/2545636362 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f16b001c450 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.069+0000 7f16c6e00700 1 -- 172.21.15.110:0/2545636362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c0064a80 con 0x7f16c01075f0 2024-04-26T11:17:57.808 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.073+0000 7f16bcc00700 1 -- 172.21.15.110:0/2545636362 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f16b0032020 con 0x7f16c01075f0 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.152+0000 7f16c6e00700 1 -- 172.21.15.110:0/2545636362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f16c01a1fe0 con 0x7f16c01075f0 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.153+0000 7f16bcc00700 1 -- 172.21.15.110:0/2545636362 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f16b0004260 con 0x7f16c01075f0 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.154+0000 7f16c6e00700 1 -- 172.21.15.110:0/2545636362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 msgr2=0x7f16c019e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.154+0000 7f16c6e00700 1 --2- 172.21.15.110:0/2545636362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c019e630 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000c00 tx=0x7f16b0004750 comp rx=0 tx=0).stop 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.155+0000 7f16c6e00700 1 -- 172.21.15.110:0/2545636362 shutdown_connections 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.155+0000 7f16c6e00700 1 --2- 172.21.15.110:0/2545636362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c01075f0 0x7f16c019e630 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.155+0000 7f16c6e00700 1 -- 172.21.15.110:0/2545636362 >> 172.21.15.110:0/2545636362 conn(0x7f16c0103210 msgr2=0x7f16c0194c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.155+0000 7f16c6e00700 1 -- 172.21.15.110:0/2545636362 shutdown_connections 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:57.155+0000 7f16c6e00700 1 -- 172.21.15.110:0/2545636362 wait complete. 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:mon is available 2024-04-26T11:17:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:Assimilating anything we can from ceph.conf... 2024-04-26T11:17:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:58 smithi110 ceph-mon[27702]: from='client.? 172.21.15.110:0/2443083792' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T11:17:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:58 smithi110 ceph-mon[27702]: from='client.? 172.21.15.110:0/2443083792' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-26T11:17:59.155 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:17:59.156 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T11:17:59.156 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout fsid = 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:17:59.156 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T11:17:59.156 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.110:3300,v1:172.21.15.110:6789] 2024-04-26T11:17:59.156 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T11:17:59.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.441+0000 7fe964c00700 1 Processor -- start 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.441+0000 7fe964c00700 1 -- start start 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.442+0000 7fe964c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.442+0000 7fe964c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe960112620 con 0x7fe96010fcf0 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.442+0000 7fe95de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.442+0000 7fe95de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52730/0 (socket says 172.21.15.110:52730) 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.442+0000 7fe95de00700 1 -- 172.21.15.110:0/3470041293 learned_addr learned my addr 172.21.15.110:0/3470041293 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.443+0000 7fe95de00700 1 -- 172.21.15.110:0/3470041293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9601127a0 con 0x7fe96010fcf0 2024-04-26T11:17:59.160 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.443+0000 7fe95de00700 1 --2- 172.21.15.110:0/3470041293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601120e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe9500098a0 tx=0x7fe950009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118811133211fc20 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:17:59.164 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.444+0000 7fe95ca00700 1 -- 172.21.15.110:0/3470041293 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950004160 con 0x7fe96010fcf0 2024-04-26T11:17:59.164 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.444+0000 7fe95ca00700 1 -- 172.21.15.110:0/3470041293 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950004300 con 0x7fe96010fcf0 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.444+0000 7fe95ca00700 1 -- 172.21.15.110:0/3470041293 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9500036a0 con 0x7fe96010fcf0 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.444+0000 7fe964c00700 1 -- 172.21.15.110:0/3470041293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 msgr2=0x7fe9601120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.444+0000 7fe964c00700 1 --2- 172.21.15.110:0/3470041293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601120e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe9500098a0 tx=0x7fe950009bb0 comp rx=0 tx=0).stop 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.444+0000 7fe964c00700 1 -- 172.21.15.110:0/3470041293 shutdown_connections 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.444+0000 7fe964c00700 1 --2- 172.21.15.110:0/3470041293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601120e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.444+0000 7fe964c00700 1 -- 172.21.15.110:0/3470041293 >> 172.21.15.110:0/3470041293 conn(0x7fe96007e300 msgr2=0x7fe960080760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.445+0000 7fe964c00700 1 -- 172.21.15.110:0/3470041293 shutdown_connections 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.445+0000 7fe964c00700 1 -- 172.21.15.110:0/3470041293 wait complete. 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.446+0000 7fe964c00700 1 Processor -- start 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.446+0000 7fe964c00700 1 -- start start 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.446+0000 7fe964c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.446+0000 7fe964c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe960112bb0 con 0x7fe96010fcf0 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.446+0000 7fe95de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:17:59.165 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.446+0000 7fe95de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601a2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52740/0 (socket says 172.21.15.110:52740) 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.446+0000 7fe95de00700 1 -- 172.21.15.110:0/2443083792 learned_addr learned my addr 172.21.15.110:0/2443083792 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.447+0000 7fe95de00700 1 -- 172.21.15.110:0/2443083792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9601a2f50 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.447+0000 7fe95de00700 1 --2- 172.21.15.110:0/2443083792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601a2a10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe950000c00 tx=0x7fe950004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.447+0000 7fe956a00700 1 -- 172.21.15.110:0/2443083792 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950003db0 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.447+0000 7fe956a00700 1 -- 172.21.15.110:0/2443083792 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950011630 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.447+0000 7fe956a00700 1 -- 172.21.15.110:0/2443083792 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe950011950 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.447+0000 7fe964c00700 1 -- 172.21.15.110:0/2443083792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9601a31e0 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.448+0000 7fe964c00700 1 -- 172.21.15.110:0/2443083792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9601a5ed0 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.448+0000 7fe956a00700 1 -- 172.21.15.110:0/2443083792 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe95001a460 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.448+0000 7fe956a00700 1 -- 172.21.15.110:0/2443083792 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe95001b780 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.449+0000 7fe964c00700 1 -- 172.21.15.110:0/2443083792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe960064a80 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.451+0000 7fe956a00700 1 -- 172.21.15.110:0/2443083792 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe950004260 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.529+0000 7fe964c00700 1 -- 172.21.15.110:0/2443083792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe96002e650 con 0x7fe96010fcf0 2024-04-26T11:17:59.166 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.538+0000 7fe956a00700 1 -- 172.21.15.110:0/2443083792 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+467 (secure 0 0 0) 0x7fe95001a750 con 0x7fe96010fcf0 2024-04-26T11:17:59.167 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.540+0000 7fe964c00700 1 -- 172.21.15.110:0/2443083792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 msgr2=0x7fe9601a2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:17:59.167 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.540+0000 7fe964c00700 1 --2- 172.21.15.110:0/2443083792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601a2a10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe950000c00 tx=0x7fe950004750 comp rx=0 tx=0).stop 2024-04-26T11:17:59.167 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.540+0000 7fe964c00700 1 -- 172.21.15.110:0/2443083792 shutdown_connections 2024-04-26T11:17:59.167 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.540+0000 7fe964c00700 1 --2- 172.21.15.110:0/2443083792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe96010fcf0 0x7fe9601a2a10 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:17:59.167 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.540+0000 7fe964c00700 1 -- 172.21.15.110:0/2443083792 >> 172.21.15.110:0/2443083792 conn(0x7fe96007e300 msgr2=0x7fe96007f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:17:59.167 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.540+0000 7fe964c00700 1 -- 172.21.15.110:0/2443083792 shutdown_connections 2024-04-26T11:17:59.167 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:58.540+0000 7fe964c00700 1 -- 172.21.15.110:0/2443083792 wait complete. 2024-04-26T11:17:59.167 INFO:teuthology.orchestra.run.smithi110.stdout:Generating new minimal ceph.conf... 2024-04-26T11:18:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:17:59 smithi110 ceph-mon[27702]: from='client.? 172.21.15.110:0/1698784033' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:18:00.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.763+0000 7fc303e00700 1 Processor -- start 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.763+0000 7fc303e00700 1 -- start start 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.763+0000 7fc303e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc304109060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.763+0000 7fc303e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc304109630 con 0x7fc304108c40 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.764+0000 7fc302a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc304109060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.764+0000 7fc302a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc304109060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52750/0 (socket says 172.21.15.110:52750) 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.764+0000 7fc302a00700 1 -- 172.21.15.110:0/1506869142 learned_addr learned my addr 172.21.15.110:0/1506869142 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.764+0000 7fc302a00700 1 -- 172.21.15.110:0/1506869142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc304109df0 con 0x7fc304108c40 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.765+0000 7fc302a00700 1 --2- 172.21.15.110:0/1506869142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc304109060 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40098a0 tx=0x7fc2f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c0d46fa074cc7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.765+0000 7fc301600700 1 -- 172.21.15.110:0/1506869142 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f4004160 con 0x7fc304108c40 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.765+0000 7fc301600700 1 -- 172.21.15.110:0/1506869142 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc2f4004300 con 0x7fc304108c40 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.765+0000 7fc301600700 1 -- 172.21.15.110:0/1506869142 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f4011af0 con 0x7fc304108c40 2024-04-26T11:18:00.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.766+0000 7fc303e00700 1 -- 172.21.15.110:0/1506869142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 msgr2=0x7fc304109060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.766+0000 7fc303e00700 1 --2- 172.21.15.110:0/1506869142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc304109060 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40098a0 tx=0x7fc2f4009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.766+0000 7fc303e00700 1 -- 172.21.15.110:0/1506869142 shutdown_connections 2024-04-26T11:18:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.766+0000 7fc303e00700 1 --2- 172.21.15.110:0/1506869142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc304109060 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.766+0000 7fc303e00700 1 -- 172.21.15.110:0/1506869142 >> 172.21.15.110:0/1506869142 conn(0x7fc304104260 msgr2=0x7fc304106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.766+0000 7fc303e00700 1 -- 172.21.15.110:0/1506869142 shutdown_connections 2024-04-26T11:18:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.766+0000 7fc303e00700 1 -- 172.21.15.110:0/1506869142 wait complete. 2024-04-26T11:18:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.767+0000 7fc303e00700 1 Processor -- start 2024-04-26T11:18:00.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.768+0000 7fc303e00700 1 -- start start 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.768+0000 7fc303e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc30419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.768+0000 7fc303e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc30410d1a0 con 0x7fc304108c40 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.768+0000 7fc302a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc30419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.768+0000 7fc302a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc30419eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52764/0 (socket says 172.21.15.110:52764) 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.768+0000 7fc302a00700 1 -- 172.21.15.110:0/1698784033 learned_addr learned my addr 172.21.15.110:0/1698784033 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.769+0000 7fc302a00700 1 -- 172.21.15.110:0/1698784033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30419f2e0 con 0x7fc304108c40 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.769+0000 7fc302a00700 1 --2- 172.21.15.110:0/1698784033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc30419eda0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4000c00 tx=0x7fc2f4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.769+0000 7fc2fb400700 1 -- 172.21.15.110:0/1698784033 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f4003b20 con 0x7fc304108c40 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.769+0000 7fc2fb400700 1 -- 172.21.15.110:0/1698784033 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc2f401a8c0 con 0x7fc304108c40 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.769+0000 7fc303e00700 1 -- 172.21.15.110:0/1698784033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30419f570 con 0x7fc304108c40 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.769+0000 7fc2fb400700 1 -- 172.21.15.110:0/1698784033 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f4024940 con 0x7fc304108c40 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.770+0000 7fc303e00700 1 -- 172.21.15.110:0/1698784033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3041a2260 con 0x7fc304108c40 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.770+0000 7fc2fb400700 1 -- 172.21.15.110:0/1698784033 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc2f4022020 con 0x7fc304108c40 2024-04-26T11:18:00.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.770+0000 7fc2fb400700 1 -- 172.21.15.110:0/1698784033 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc2f402ddd0 con 0x7fc304108c40 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.771+0000 7fc303e00700 1 -- 172.21.15.110:0/1698784033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30406a530 con 0x7fc304108c40 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.774+0000 7fc2fb400700 1 -- 172.21.15.110:0/1698784033 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc2f4042e50 con 0x7fc304108c40 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.851+0000 7fc303e00700 1 -- 172.21.15.110:0/1698784033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc3041a2700 con 0x7fc304108c40 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.851+0000 7fc2fb400700 1 -- 172.21.15.110:0/1698784033 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7fc2f4031030 con 0x7fc304108c40 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.853+0000 7fc303e00700 1 -- 172.21.15.110:0/1698784033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 msgr2=0x7fc30419eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.853+0000 7fc303e00700 1 --2- 172.21.15.110:0/1698784033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc30419eda0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4000c00 tx=0x7fc2f4011b70 comp rx=0 tx=0).stop 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.853+0000 7fc303e00700 1 -- 172.21.15.110:0/1698784033 shutdown_connections 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.853+0000 7fc303e00700 1 --2- 172.21.15.110:0/1698784033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc304108c40 0x7fc30419eda0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.853+0000 7fc303e00700 1 -- 172.21.15.110:0/1698784033 >> 172.21.15.110:0/1698784033 conn(0x7fc304104260 msgr2=0x7fc304104cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.853+0000 7fc303e00700 1 -- 172.21.15.110:0/1698784033 shutdown_connections 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:17:59.853+0000 7fc303e00700 1 -- 172.21.15.110:0/1698784033 wait complete. 2024-04-26T11:18:00.570 INFO:teuthology.orchestra.run.smithi110.stdout:Restarting the monitor... 2024-04-26T11:18:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:00 smithi110 systemd[1]: Stopping Ceph mon.a for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:18:01.355 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a[27698]: 2024-04-26T11:18:01.076+0000 7f40f5000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T11:18:01.355 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a[27698]: 2024-04-26T11:18:01.076+0000 7f40f5000700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-26T11:18:01.659 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:01 smithi110 podman[27945]: 2024-04-26 11:18:01.35455813 +0000 UTC m=+0.399024101 container died c90e0fa386efc92cedb2ef5d4da66facbae8a7fa6156ecd38c1d1f2598749cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:18:01.961 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:01 smithi110 podman[27945]: 2024-04-26 11:18:01.759510401 +0000 UTC m=+0.803976399 container cleanup c90e0fa386efc92cedb2ef5d4da66facbae8a7fa6156ecd38c1d1f2598749cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:18:01.961 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:01 smithi110 bash[27945]: ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a 2024-04-26T11:18:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:01 smithi110 podman[27959]: 2024-04-26 11:18:01.960229894 +0000 UTC m=+0.592160749 container remove c90e0fa386efc92cedb2ef5d4da66facbae8a7fa6156ecd38c1d1f2598749cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T11:18:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:02 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-26T11:18:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:02 smithi110 systemd[1]: Stopped Ceph mon.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:18:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:02 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mon.a.service: Consumed 1.930s CPU time. 2024-04-26T11:18:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:02 smithi110 systemd[1]: Starting Ceph mon.a for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:18:03.102 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:02 smithi110 podman[28051]: 2024-04-26 11:18:02.728761773 +0000 UTC m=+0.032690375 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:18:03.102 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:02 smithi110 podman[28051]: 2024-04-26 11:18:02.849692656 +0000 UTC m=+0.153621290 container create bb40b9490e8b2b7e7260ae81ae47038529dc72cf84661accdb8216f631b14159 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-26T11:18:03.103 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 podman[28051]: 2024-04-26 11:18:03.101158883 +0000 UTC m=+0.405087519 container init bb40b9490e8b2b7e7260ae81ae47038529dc72cf84661accdb8216f631b14159 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T11:18:03.186 INFO:teuthology.orchestra.run.smithi110.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-26T11:18:03.463 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 podman[28051]: 2024-04-26 11:18:03.11055457 +0000 UTC m=+0.414483207 container start bb40b9490e8b2b7e7260ae81ae47038529dc72cf84661accdb8216f631b14159 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-26T11:18:03.463 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T11:18:03.463 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev), process ceph-mon, pid 2 2024-04-26T11:18:03.464 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: pidfile_write: ignore empty --pid-file 2024-04-26T11:18:03.464 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: load: jerasure load: lrc 2024-04-26T11:18:03.464 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: RocksDB version: 7.9.2 2024-04-26T11:18:03.464 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Git sha 0 2024-04-26T11:18:03.464 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Compile date 2024-04-26 07:20:26 2024-04-26T11:18:03.464 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: DB SUMMARY 2024-04-26T11:18:03.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: DB Session ID: EROJF1J1FJV4K8R2VTQQ 2024-04-26T11:18:03.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: CURRENT file: CURRENT 2024-04-26T11:18:03.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T11:18:03.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-26T11:18:03.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-26T11:18:03.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104568 ; 2024-04-26T11:18:03.466 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.error_if_exists: 0 2024-04-26T11:18:03.466 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.create_if_missing: 0 2024-04-26T11:18:03.466 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.paranoid_checks: 1 2024-04-26T11:18:03.466 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T11:18:03.466 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T11:18:03.466 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T11:18:03.467 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.env: 0x562043284cc0 2024-04-26T11:18:03.467 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T11:18:03.467 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.info_log: 0x562048ebddc0 2024-04-26T11:18:03.467 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T11:18:03.467 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.statistics: (nil) 2024-04-26T11:18:03.467 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.use_fsync: 0 2024-04-26T11:18:03.468 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_log_file_size: 0 2024-04-26T11:18:03.468 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T11:18:03.468 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T11:18:03.468 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T11:18:03.468 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T11:18:03.468 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.allow_fallocate: 1 2024-04-26T11:18:03.469 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T11:18:03.469 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T11:18:03.469 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.use_direct_reads: 0 2024-04-26T11:18:03.469 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T11:18:03.469 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T11:18:03.469 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.db_log_dir: 2024-04-26T11:18:03.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.wal_dir: 2024-04-26T11:18:03.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T11:18:03.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T11:18:03.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T11:18:03.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T11:18:03.471 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T11:18:03.471 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T11:18:03.471 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T11:18:03.471 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T11:18:03.471 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.write_buffer_manager: 0x562048e8f0e0 2024-04-26T11:18:03.471 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T11:18:03.472 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T11:18:03.472 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T11:18:03.472 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T11:18:03.472 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T11:18:03.472 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T11:18:03.473 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T11:18:03.473 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T11:18:03.473 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.unordered_write: 0 2024-04-26T11:18:03.473 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T11:18:03.473 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T11:18:03.473 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T11:18:03.473 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T11:18:03.474 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.row_cache: None 2024-04-26T11:18:03.474 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.wal_filter: None 2024-04-26T11:18:03.474 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T11:18:03.474 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T11:18:03.474 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.two_write_queues: 0 2024-04-26T11:18:03.475 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T11:18:03.475 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.wal_compression: 0 2024-04-26T11:18:03.475 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.atomic_flush: 0 2024-04-26T11:18:03.475 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T11:18:03.475 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T11:18:03.475 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T11:18:03.477 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.log_readahead_size: 0 2024-04-26T11:18:03.478 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T11:18:03.478 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T11:18:03.478 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T11:18:03.478 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T11:18:03.478 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T11:18:03.478 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T11:18:03.479 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T11:18:03.479 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_background_jobs: 2 2024-04-26T11:18:03.479 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_background_compactions: -1 2024-04-26T11:18:03.479 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_subcompactions: 1 2024-04-26T11:18:03.479 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T11:18:03.479 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T11:18:03.479 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T11:18:03.479 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T11:18:03.479 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T11:18:03.480 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T11:18:03.480 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T11:18:03.480 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T11:18:03.480 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_open_files: -1 2024-04-26T11:18:03.480 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T11:18:03.480 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T11:18:03.480 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T11:18:03.480 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T11:18:03.481 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_background_flushes: -1 2024-04-26T11:18:03.481 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Compression algorithms supported: 2024-04-26T11:18:03.481 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T11:18:03.481 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: kZSTD supported: 0 2024-04-26T11:18:03.481 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: kXpressCompression supported: 0 2024-04-26T11:18:03.481 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T11:18:03.481 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: kZlibCompression supported: 1 2024-04-26T11:18:03.481 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: kSnappyCompression supported: 1 2024-04-26T11:18:03.482 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: kLZ4Compression supported: 1 2024-04-26T11:18:03.482 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: kBZip2Compression supported: 0 2024-04-26T11:18:03.482 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T11:18:03.482 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T11:18:03.482 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-26T11:18:03.482 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T11:18:03.482 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.merge_operator: 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_filter: None 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562048ebdf80) 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout: cache_index_and_filter_blocks: 1 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout: pin_top_level_index_and_filter: 1 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout: index_type: 0 2024-04-26T11:18:03.483 INFO:journalctl@ceph.mon.a.smithi110.stdout: data_block_index_type: 0 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: index_shortening: 1 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: checksum: 4 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: no_block_cache: 0 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_cache: 0x562048ec11f0 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_cache_name: BinnedLRUCache 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_cache_options: 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: capacity : 536870912 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: num_shard_bits : 4 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: strict_capacity_limit : 0 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: high_pri_pool_ratio: 0.000 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_cache_compressed: (nil) 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: persistent_cache: (nil) 2024-04-26T11:18:03.484 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_size: 4096 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_size_deviation: 10 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_restart_interval: 16 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: index_block_restart_interval: 1 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: metadata_block_size: 4096 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: partition_filters: 0 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: use_delta_encoding: 1 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: filter_policy: bloomfilter 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: whole_key_filtering: 1 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: verify_compression: 0 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: read_amp_bytes_per_bit: 0 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: format_version: 5 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: enable_index_compression: 1 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_align: 0 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: max_auto_readahead_size: 262144 2024-04-26T11:18:03.485 INFO:journalctl@ceph.mon.a.smithi110.stdout: prepopulate_block_cache: 0 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout: initial_auto_readahead_size: 8192 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression: NoCompression 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.num_levels: 7 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T11:18:03.486 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T11:18:03.487 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T11:18:03.488 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T11:18:03.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.inplace_update_support: 0 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.bloom_locality: 0 2024-04-26T11:18:03.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.max_successive_merges: 0 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.ttl: 2592000 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.enable_blob_files: false 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.min_blob_size: 0 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T11:18:03.491 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 98f62672-1068-4df5-b885-8f65d7209944 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714130283168175, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714130283170085, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99795, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97677, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14028, "raw_average_key_size": 49, "raw_value_size": 90035, "raw_average_value_size": 318, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714130283, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "98f62672-1068-4df5-b885-8f65d7209944", "db_session_id": "EROJF1J1FJV4K8R2VTQQ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714130283170256, "job": 1, "event": "recovery_finished"} 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-26T11:18:03.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562048fde000 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: DB pointer 0x562048fca000 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: ** DB Stats ** 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-04-26T11:18:03.493 INFO:journalctl@ceph.mon.a.smithi110.stdout: ** Compaction Stats [default] ** 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: L0 2/0 99.32 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: Sum 2/0 99.32 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: ** Compaction Stats [default] ** 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 80.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T11:18:03.494 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: Cumulative compaction: 0.00 GB write, 13.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: Interval compaction: 0.00 GB write, 13.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: Block cache BinnedLRUCache@0x562048ec11f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-04-26T11:18:03.495 INFO:journalctl@ceph.mon.a.smithi110.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: starting mon.a rank 0 at public addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] at bind addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 bash[28051]: bb40b9490e8b2b7e7260ae81ae47038529dc72cf84661accdb8216f631b14159 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mon.a@-1(???) e1 preinit fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mon.a@-1(???).mds e1 new map 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mon.a@-1(???).mds e1 print_map 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout: e1 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout: legacy client fscid: -1 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout: No filesystems configured 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T11:18:03.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 systemd[1]: Started Ceph mon.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: monmap epoch 1 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: last_changed 2024-04-26T11:17:52.091691+0000 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: min_mon_release 19 (squid) 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: election_strategy: 1 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: fsmap 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T11:18:03.497 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:03 smithi110 ceph-mon[28069]: mgrmap e1: no daemons active 2024-04-26T11:18:04.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.814+0000 7fc088e00700 1 Processor -- start 2024-04-26T11:18:04.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.814+0000 7fc088e00700 1 -- start start 2024-04-26T11:18:04.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.814+0000 7fc088e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc08407fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:04.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.814+0000 7fc088e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc084080240 con 0x7fc08407f850 2024-04-26T11:18:04.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.815+0000 7fc081e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc08407fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.816+0000 7fc081e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc08407fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39040/0 (socket says 172.21.15.110:39040) 2024-04-26T11:18:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.816+0000 7fc081e00700 1 -- 172.21.15.110:0/985557864 learned_addr learned my addr 172.21.15.110:0/985557864 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.816+0000 7fc081e00700 1 -- 172.21.15.110:0/985557864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc084080aa0 con 0x7fc08407f850 2024-04-26T11:18:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.817+0000 7fc081e00700 1 --2- 172.21.15.110:0/985557864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc08407fc70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc0740098a0 tx=0x7fc074009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e550c2fb1d228ae9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.817+0000 7fc081400700 1 -- 172.21.15.110:0/985557864 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074004160 con 0x7fc08407f850 2024-04-26T11:18:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.817+0000 7fc081400700 1 -- 172.21.15.110:0/985557864 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc074004300 con 0x7fc08407f850 2024-04-26T11:18:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.817+0000 7fc081400700 1 -- 172.21.15.110:0/985557864 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074011af0 con 0x7fc08407f850 2024-04-26T11:18:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.818+0000 7fc088e00700 1 -- 172.21.15.110:0/985557864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 msgr2=0x7fc08407fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.818+0000 7fc088e00700 1 --2- 172.21.15.110:0/985557864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc08407fc70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc0740098a0 tx=0x7fc074009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.818+0000 7fc088e00700 1 -- 172.21.15.110:0/985557864 shutdown_connections 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.818+0000 7fc088e00700 1 --2- 172.21.15.110:0/985557864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc08407fc70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.818+0000 7fc088e00700 1 -- 172.21.15.110:0/985557864 >> 172.21.15.110:0/985557864 conn(0x7fc08407e300 msgr2=0x7fc08407e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.818+0000 7fc088e00700 1 -- 172.21.15.110:0/985557864 shutdown_connections 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.818+0000 7fc088e00700 1 -- 172.21.15.110:0/985557864 wait complete. 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.820+0000 7fc088e00700 1 Processor -- start 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.820+0000 7fc088e00700 1 -- start start 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.820+0000 7fc088e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc0841a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.820+0000 7fc088e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc084081e60 con 0x7fc08407f850 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.820+0000 7fc081e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc0841a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.821+0000 7fc081e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc0841a32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39048/0 (socket says 172.21.15.110:39048) 2024-04-26T11:18:04.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.821+0000 7fc081e00700 1 -- 172.21.15.110:0/1260882794 learned_addr learned my addr 172.21.15.110:0/1260882794 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:04.504 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.821+0000 7fc081e00700 1 -- 172.21.15.110:0/1260882794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0841a37e0 con 0x7fc08407f850 2024-04-26T11:18:04.504 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.821+0000 7fc081e00700 1 --2- 172.21.15.110:0/1260882794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc0841a32a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc074011ac0 tx=0x7fc074011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:04.504 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.822+0000 7fc07b400700 1 -- 172.21.15.110:0/1260882794 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074003970 con 0x7fc08407f850 2024-04-26T11:18:04.504 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.822+0000 7fc07b400700 1 -- 172.21.15.110:0/1260882794 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc074003b10 con 0x7fc08407f850 2024-04-26T11:18:04.504 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.822+0000 7fc088e00700 1 -- 172.21.15.110:0/1260882794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0841a3a70 con 0x7fc08407f850 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.822+0000 7fc07b400700 1 -- 172.21.15.110:0/1260882794 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074024610 con 0x7fc08407f850 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.822+0000 7fc088e00700 1 -- 172.21.15.110:0/1260882794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0841a6760 con 0x7fc08407f850 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.822+0000 7fc07b400700 1 -- 172.21.15.110:0/1260882794 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc074024c20 con 0x7fc08407f850 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.822+0000 7fc07b400700 1 -- 172.21.15.110:0/1260882794 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc0740193c0 con 0x7fc08407f850 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.823+0000 7fc088e00700 1 -- 172.21.15.110:0/1260882794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc084064a80 con 0x7fc08407f850 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.826+0000 7fc07b400700 1 -- 172.21.15.110:0/1260882794 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc07401a9e0 con 0x7fc08407f850 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.903+0000 7fc088e00700 1 -- 172.21.15.110:0/1260882794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fc08402e700 con 0x7fc08407f850 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.907+0000 7fc07b400700 1 -- 172.21.15.110:0/1260882794 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fc07402d3f0 con 0x7fc08407f850 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.908+0000 7fc088e00700 1 -- 172.21.15.110:0/1260882794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 msgr2=0x7fc0841a32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:04.505 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.908+0000 7fc088e00700 1 --2- 172.21.15.110:0/1260882794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc0841a32a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc074011ac0 tx=0x7fc074011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:04.506 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.909+0000 7fc088e00700 1 -- 172.21.15.110:0/1260882794 shutdown_connections 2024-04-26T11:18:04.506 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.909+0000 7fc088e00700 1 --2- 172.21.15.110:0/1260882794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc08407f850 0x7fc0841a32a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:04.506 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.909+0000 7fc088e00700 1 -- 172.21.15.110:0/1260882794 >> 172.21.15.110:0/1260882794 conn(0x7fc08407e300 msgr2=0x7fc084199f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:04.506 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.909+0000 7fc088e00700 1 -- 172.21.15.110:0/1260882794 shutdown_connections 2024-04-26T11:18:04.506 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:03.909+0000 7fc088e00700 1 -- 172.21.15.110:0/1260882794 wait complete. 2024-04-26T11:18:04.507 INFO:teuthology.orchestra.run.smithi110.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-26T11:18:04.531 INFO:teuthology.orchestra.run.smithi110.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-26T11:18:04.532 INFO:teuthology.orchestra.run.smithi110.stdout:Creating mgr... 2024-04-26T11:18:04.533 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-26T11:18:04.534 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-26T11:18:04.966 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6e439470-03be-11ef-bc93-c7b262605968@mgr.x 2024-04-26T11:18:04.966 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6e439470-03be-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-6e439470-03be-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-26T11:18:05.229 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6e439470-03be-11ef-bc93-c7b262605968.target.wants/ceph-6e439470-03be-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-6e439470-03be-11ef-bc93-c7b262605968@.service. 2024-04-26T11:18:05.263 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:04 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1260882794' entity='client.admin' 2024-04-26T11:18:05.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:05 smithi110 systemd[1]: Starting Ceph mgr.x for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:18:05.914 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:05 smithi110 podman[28281]: 2024-04-26 11:18:05.542910031 +0000 UTC m=+0.038079727 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T11:18:05.914 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:05 smithi110 podman[28281]: 2024-04-26 11:18:05.668111632 +0000 UTC m=+0.163281349 container create 830fb23ccb57f32001f9706e943f505747f42c485fa4f55ecb25ab742a7be0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS) 2024-04-26T11:18:05.914 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:05 smithi110 podman[28281]: 2024-04-26 11:18:05.912200182 +0000 UTC m=+0.407369899 container init 830fb23ccb57f32001f9706e943f505747f42c485fa4f55ecb25ab742a7be0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T11:18:06.035 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T11:18:06.036 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-04-26T11:18:06.051 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T11:18:06.051 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-04-26T11:18:06.052 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-04-26T11:18:06.052 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T11:18:06.070 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T11:18:06.070 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-04-26T11:18:06.086 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T11:18:06.086 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-04-26T11:18:06.086 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-04-26T11:18:06.086 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-26T11:18:06.086 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr to start... 2024-04-26T11:18:06.086 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr... 2024-04-26T11:18:06.170 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:05 smithi110 podman[28281]: 2024-04-26 11:18:05.921969297 +0000 UTC m=+0.417139013 container start 830fb23ccb57f32001f9706e943f505747f42c485fa4f55ecb25ab742a7be0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:18:06.170 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:06 smithi110 bash[28281]: 830fb23ccb57f32001f9706e943f505747f42c485fa4f55ecb25ab742a7be0b0 2024-04-26T11:18:06.170 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:06 smithi110 systemd[1]: Started Ceph mgr.x for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:18:06.425 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:06.167+0000 7fde4a5b8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:18:06.694 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:06.422+0000 7fde4a5b8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:18:06.695 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:06.558+0000 7fde4a5b8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:18:06.971 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:06 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2852342780' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T11:18:07.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:06.969+0000 7fde4a5b8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:18:07.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:07.087+0000 7fde4a5b8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:18:07.478 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:18:07.481 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-04-26T11:18:07.481 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:18:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T11:18:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T11:18:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T11:18:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T11:18:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T11:18:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T11:18:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 0 2024-04-26T11:18:07.482 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T11:18:07.483 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:07.484 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T11:18:07.484 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T11:18:07.495 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T11:18:07.495 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T11:18:07.495 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T11:18:07.495 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T11:18:07.495 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:07.495 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T11:18:07.495 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T11:18:07.495 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T11:18:07.496 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T11:18:07.496 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T11:18:07.496 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T11:18:07.496 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T11:18:07.496 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T11:18:07.496 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T11:18:07.496 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:07.496 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T11:18:07.496 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T11:18:07.497 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T11:18:07.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:07.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T11:18:07.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:07.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T11:18:07.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:07.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T11:17:56.438247+0000", 2024-04-26T11:18:07.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T11:18:07.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:07.498 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T11:18:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-04-26T11:18:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.692+0000 7f958ae00700 1 Processor -- start 2024-04-26T11:18:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.692+0000 7f958ae00700 1 -- start start 2024-04-26T11:18:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.693+0000 7f958ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f9584107850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.693+0000 7f958ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f958407ce50 con 0x7f9584107430 2024-04-26T11:18:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.693+0000 7f9589a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f9584107850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.693+0000 7f9589a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f9584107850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39086/0 (socket says 172.21.15.110:39086) 2024-04-26T11:18:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.693+0000 7f9589a00700 1 -- 172.21.15.110:0/2799192766 learned_addr learned my addr 172.21.15.110:0/2799192766 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:07.499 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.694+0000 7f9589a00700 1 -- 172.21.15.110:0/2799192766 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9584107d90 con 0x7f9584107430 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.694+0000 7f9589a00700 1 --2- 172.21.15.110:0/2799192766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f9584107850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f95780098a0 tx=0x7f9578009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f95adf6394ad566 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.694+0000 7f9583e00700 1 -- 172.21.15.110:0/2799192766 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9578004160 con 0x7f9584107430 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.695+0000 7f9583e00700 1 -- 172.21.15.110:0/2799192766 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9578004300 con 0x7f9584107430 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.695+0000 7f9583e00700 1 -- 172.21.15.110:0/2799192766 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9578011af0 con 0x7f9584107430 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.695+0000 7f958ae00700 1 -- 172.21.15.110:0/2799192766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 msgr2=0x7f9584107850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.695+0000 7f958ae00700 1 --2- 172.21.15.110:0/2799192766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f9584107850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f95780098a0 tx=0x7f9578009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.696+0000 7f958ae00700 1 -- 172.21.15.110:0/2799192766 shutdown_connections 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.696+0000 7f958ae00700 1 --2- 172.21.15.110:0/2799192766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f9584107850 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.696+0000 7f958ae00700 1 -- 172.21.15.110:0/2799192766 >> 172.21.15.110:0/2799192766 conn(0x7f9584102fd0 msgr2=0x7f9584105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:07.500 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.696+0000 7f958ae00700 1 -- 172.21.15.110:0/2799192766 shutdown_connections 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.696+0000 7f958ae00700 1 -- 172.21.15.110:0/2799192766 wait complete. 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.697+0000 7f958ae00700 1 Processor -- start 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.697+0000 7f958ae00700 1 -- start start 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.697+0000 7f958ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f958419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.697+0000 7f958ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9584108dc0 con 0x7f9584107430 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.697+0000 7f9589a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f958419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.697+0000 7f9589a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f958419ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39098/0 (socket says 172.21.15.110:39098) 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.698+0000 7f9589a00700 1 -- 172.21.15.110:0/2852342780 learned_addr learned my addr 172.21.15.110:0/2852342780 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.698+0000 7f9589a00700 1 -- 172.21.15.110:0/2852342780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958419f240 con 0x7f9584107430 2024-04-26T11:18:07.501 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.698+0000 7f9589a00700 1 --2- 172.21.15.110:0/2852342780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f958419ed00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9578011ac0 tx=0x7f9578011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:07.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.698+0000 7f9582000700 1 -- 172.21.15.110:0/2852342780 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9578003970 con 0x7f9584107430 2024-04-26T11:18:07.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.699+0000 7f9582000700 1 -- 172.21.15.110:0/2852342780 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9578003b10 con 0x7f9584107430 2024-04-26T11:18:07.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.699+0000 7f958ae00700 1 -- 172.21.15.110:0/2852342780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958419f4d0 con 0x7f9584107430 2024-04-26T11:18:07.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.699+0000 7f9582000700 1 -- 172.21.15.110:0/2852342780 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9578024610 con 0x7f9584107430 2024-04-26T11:18:07.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.699+0000 7f958ae00700 1 -- 172.21.15.110:0/2852342780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95841a21b0 con 0x7f9584107430 2024-04-26T11:18:07.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.699+0000 7f9582000700 1 -- 172.21.15.110:0/2852342780 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9578024bd0 con 0x7f9584107430 2024-04-26T11:18:07.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.699+0000 7f9582000700 1 -- 172.21.15.110:0/2852342780 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9578019700 con 0x7f9584107430 2024-04-26T11:18:07.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.700+0000 7f958ae00700 1 -- 172.21.15.110:0/2852342780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9564005360 con 0x7f9584107430 2024-04-26T11:18:07.502 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.702+0000 7f9582000700 1 -- 172.21.15.110:0/2852342780 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9578043e50 con 0x7f9584107430 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.782+0000 7f958ae00700 1 -- 172.21.15.110:0/2852342780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9564005920 con 0x7f9584107430 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.783+0000 7f9582000700 1 -- 172.21.15.110:0/2852342780 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f9578032030 con 0x7f9584107430 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.784+0000 7f958ae00700 1 -- 172.21.15.110:0/2852342780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 msgr2=0x7f958419ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.784+0000 7f958ae00700 1 --2- 172.21.15.110:0/2852342780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f958419ed00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9578011ac0 tx=0x7f9578011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.784+0000 7f958ae00700 1 -- 172.21.15.110:0/2852342780 shutdown_connections 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.784+0000 7f958ae00700 1 --2- 172.21.15.110:0/2852342780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9584107430 0x7f958419ed00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.784+0000 7f958ae00700 1 -- 172.21.15.110:0/2852342780 >> 172.21.15.110:0/2852342780 conn(0x7f9584102fd0 msgr2=0x7f9584195940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.784+0000 7f958ae00700 1 -- 172.21.15.110:0/2852342780 shutdown_connections 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:06.784+0000 7f958ae00700 1 -- 172.21.15.110:0/2852342780 wait complete. 2024-04-26T11:18:07.503 INFO:teuthology.orchestra.run.smithi110.stdout:mgr not available, waiting (1/15)... 2024-04-26T11:18:09.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:08.654+0000 7fde4a5b8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:18:09.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:08.878+0000 7fde4a5b8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:18:09.468 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:09.093+0000 7fde4a5b8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:18:09.552 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:09.466+0000 7fde4a5b8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:18:09.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:09.598+0000 7fde4a5b8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:18:10.054 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:09.858+0000 7fde4a5b8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:18:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:10 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2168060952' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T11:18:10.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:10.118+0000 7fde4a5b8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:18:11.077 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:18:11.077 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-04-26T11:18:11.077 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:18:11.077 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T11:18:11.077 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T11:18:11.077 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T11:18:11.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T11:18:11.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:11.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T11:18:11.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T11:18:11.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 0 2024-04-26T11:18:11.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:11.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T11:18:11.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T11:18:11.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T11:18:11.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T11:18:11.087 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T11:18:11.087 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T11:18:11.087 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T11:18:11.087 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:11.087 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T11:18:11.087 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T11:18:11.087 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T11:18:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T11:17:56.438247+0000", 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.125+0000 7f21a0a00700 1 Processor -- start 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.125+0000 7f21a0a00700 1 -- start start 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.126+0000 7f21a0a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c07d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.126+0000 7f21a0a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f219c07d8d0 con 0x7f219c07eea0 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.126+0000 7f219a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c07d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.126+0000 7f219a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c07d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39104/0 (socket says 172.21.15.110:39104) 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.126+0000 7f219a800700 1 -- 172.21.15.110:0/398643426 learned_addr learned my addr 172.21.15.110:0/398643426 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.127+0000 7f219a800700 1 -- 172.21.15.110:0/398643426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c07da50 con 0x7f219c07eea0 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.127+0000 7f219a800700 1 --2- 172.21.15.110:0/398643426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c07d300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f218c0098a0 tx=0x7f218c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd879ec6ef772e3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.127+0000 7f2199400700 1 -- 172.21.15.110:0/398643426 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c004160 con 0x7f219c07eea0 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.127+0000 7f2199400700 1 -- 172.21.15.110:0/398643426 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f218c004300 con 0x7f219c07eea0 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.127+0000 7f2199400700 1 -- 172.21.15.110:0/398643426 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c011af0 con 0x7f219c07eea0 2024-04-26T11:18:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.128+0000 7f21a0a00700 1 -- 172.21.15.110:0/398643426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 msgr2=0x7f219c07d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.128+0000 7f21a0a00700 1 --2- 172.21.15.110:0/398643426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c07d300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f218c0098a0 tx=0x7f218c009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.128+0000 7f21a0a00700 1 -- 172.21.15.110:0/398643426 shutdown_connections 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.128+0000 7f21a0a00700 1 --2- 172.21.15.110:0/398643426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c07d300 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.128+0000 7f21a0a00700 1 -- 172.21.15.110:0/398643426 >> 172.21.15.110:0/398643426 conn(0x7f219c1040f0 msgr2=0x7f219c106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.128+0000 7f21a0a00700 1 -- 172.21.15.110:0/398643426 shutdown_connections 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.128+0000 7f21a0a00700 1 -- 172.21.15.110:0/398643426 wait complete. 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.129+0000 7f21a0a00700 1 Processor -- start 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.130+0000 7f21a0a00700 1 -- start start 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.130+0000 7f21a0a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.130+0000 7f21a0a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f219c10f100 con 0x7f219c07eea0 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.130+0000 7f219a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.130+0000 7f219a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c19ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39110/0 (socket says 172.21.15.110:39110) 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.130+0000 7f219a800700 1 -- 172.21.15.110:0/2168060952 learned_addr learned my addr 172.21.15.110:0/2168060952 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:11.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.131+0000 7f219a800700 1 -- 172.21.15.110:0/2168060952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c19f230 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.131+0000 7f219a800700 1 --2- 172.21.15.110:0/2168060952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c19ecf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f218c011ac0 tx=0x7f218c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.131+0000 7f2193400700 1 -- 172.21.15.110:0/2168060952 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c003970 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.131+0000 7f2193400700 1 -- 172.21.15.110:0/2168060952 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f218c003b10 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.131+0000 7f2193400700 1 -- 172.21.15.110:0/2168060952 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218c024610 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.131+0000 7f21a0a00700 1 -- 172.21.15.110:0/2168060952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c19f4c0 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.131+0000 7f21a0a00700 1 -- 172.21.15.110:0/2168060952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c1a21a0 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.132+0000 7f2193400700 1 -- 172.21.15.110:0/2168060952 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f218c024bd0 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.132+0000 7f2193400700 1 -- 172.21.15.110:0/2168060952 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f218c019700 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.132+0000 7f21a0a00700 1 -- 172.21.15.110:0/2168060952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c06a530 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.135+0000 7f2193400700 1 -- 172.21.15.110:0/2168060952 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f218c01a9e0 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.214+0000 7f21a0a00700 1 -- 172.21.15.110:0/2168060952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f219c1a2370 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.215+0000 7f2193400700 1 -- 172.21.15.110:0/2168060952 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f218c01a430 con 0x7f219c07eea0 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.216+0000 7f21a0a00700 1 -- 172.21.15.110:0/2168060952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 msgr2=0x7f219c19ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.216+0000 7f21a0a00700 1 --2- 172.21.15.110:0/2168060952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c19ecf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f218c011ac0 tx=0x7f218c011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:11.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.217+0000 7f21a0a00700 1 -- 172.21.15.110:0/2168060952 shutdown_connections 2024-04-26T11:18:11.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.217+0000 7f21a0a00700 1 --2- 172.21.15.110:0/2168060952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f219c07eea0 0x7f219c19ecf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:11.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.217+0000 7f21a0a00700 1 -- 172.21.15.110:0/2168060952 >> 172.21.15.110:0/2168060952 conn(0x7f219c1040f0 msgr2=0x7f219c104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:11.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.217+0000 7f21a0a00700 1 -- 172.21.15.110:0/2168060952 shutdown_connections 2024-04-26T11:18:11.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:10.217+0000 7f21a0a00700 1 -- 172.21.15.110:0/2168060952 wait complete. 2024-04-26T11:18:11.093 INFO:teuthology.orchestra.run.smithi110.stdout:mgr not available, waiting (2/15)... 2024-04-26T11:18:11.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:10.955+0000 7fde4a5b8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:18:11.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:11.507+0000 7fde4a5b8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:18:11.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:11.635+0000 7fde4a5b8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:18:12.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:11.895+0000 7fde4a5b8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:18:12.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:12.536+0000 7fde4a5b8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:18:12.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:12.661+0000 7fde4a5b8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:18:13.234 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:12.979+0000 7fde4a5b8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:18:13.234 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:13.160+0000 7fde4a5b8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:18:13.487 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:13.286+0000 7fde4a5b8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:18:13.487 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:13.440+0000 7fde4a5b8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:18:14.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:13.831+0000 7fde4a5b8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:18:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:13 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/4258261225' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T11:18:14.373 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:18:14.374 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-04-26T11:18:14.374 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:18:14.374 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T11:18:14.375 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T11:18:14.375 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T11:18:14.375 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T11:18:14.375 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:14.375 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T11:18:14.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T11:18:14.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 0 2024-04-26T11:18:14.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:14.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T11:18:14.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T11:18:14.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:14.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-26T11:18:14.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T11:18:14.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:14.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T11:18:14.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T11:18:14.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:14.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T11:18:14.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:14.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T11:18:14.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T11:18:14.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T11:18:14.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T11:18:14.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T11:18:14.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T11:18:14.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:14.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T11:18:14.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T11:18:14.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T11:18:14.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T11:18:14.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T11:18:14.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T11:18:14.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T11:18:14.381 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T11:18:14.381 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T11:18:14.381 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:14.382 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T11:18:14.382 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:14.382 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T11:18:14.383 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T11:18:14.383 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:14.383 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T11:18:14.383 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T11:18:14.383 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T11:18:14.383 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T11:18:14.383 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T11:18:14.384 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T11:18:14.385 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T11:18:14.385 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:14.385 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T11:18:14.385 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:14.385 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T11:18:14.385 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:14.385 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T11:17:56.438247+0000", 2024-04-26T11:18:14.385 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T11:18:14.385 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:14.388 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T11:18:14.388 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-04-26T11:18:14.388 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.626+0000 7ff311600700 1 Processor -- start 2024-04-26T11:18:14.388 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.626+0000 7ff311600700 1 -- start start 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.627+0000 7ff311600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c07d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.627+0000 7ff311600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c07d840 con 0x7ff30c07ee00 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.627+0000 7ff30aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c07d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.627+0000 7ff30aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c07d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55878/0 (socket says 172.21.15.110:55878) 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.627+0000 7ff30aa00700 1 -- 172.21.15.110:0/524794323 learned_addr learned my addr 172.21.15.110:0/524794323 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.628+0000 7ff30aa00700 1 -- 172.21.15.110:0/524794323 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c07d9c0 con 0x7ff30c07ee00 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.628+0000 7ff30aa00700 1 --2- 172.21.15.110:0/524794323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c07d300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098a0 tx=0x7ff2fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5720e9c709ad8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.628+0000 7ff309600700 1 -- 172.21.15.110:0/524794323 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2fc004160 con 0x7ff30c07ee00 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.629+0000 7ff309600700 1 -- 172.21.15.110:0/524794323 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff2fc004300 con 0x7ff30c07ee00 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.629+0000 7ff309600700 1 -- 172.21.15.110:0/524794323 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2fc011af0 con 0x7ff30c07ee00 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.629+0000 7ff311600700 1 -- 172.21.15.110:0/524794323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 msgr2=0x7ff30c07d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.629+0000 7ff311600700 1 --2- 172.21.15.110:0/524794323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c07d300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098a0 tx=0x7ff2fc009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.629+0000 7ff311600700 1 -- 172.21.15.110:0/524794323 shutdown_connections 2024-04-26T11:18:14.389 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.629+0000 7ff311600700 1 --2- 172.21.15.110:0/524794323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c07d300 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.629+0000 7ff311600700 1 -- 172.21.15.110:0/524794323 >> 172.21.15.110:0/524794323 conn(0x7ff30c1043c0 msgr2=0x7ff30c1067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.630+0000 7ff311600700 1 -- 172.21.15.110:0/524794323 shutdown_connections 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.630+0000 7ff311600700 1 -- 172.21.15.110:0/524794323 wait complete. 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.631+0000 7ff311600700 1 Processor -- start 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.631+0000 7ff311600700 1 -- start start 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.631+0000 7ff311600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.631+0000 7ff311600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c10f310 con 0x7ff30c07ee00 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.631+0000 7ff30aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.631+0000 7ff30aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55890/0 (socket says 172.21.15.110:55890) 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.632+0000 7ff30aa00700 1 -- 172.21.15.110:0/4258261225 learned_addr learned my addr 172.21.15.110:0/4258261225 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:14.390 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.632+0000 7ff30aa00700 1 -- 172.21.15.110:0/4258261225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c19f420 con 0x7ff30c07ee00 2024-04-26T11:18:14.392 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.632+0000 7ff30aa00700 1 --2- 172.21.15.110:0/4258261225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c19eee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009fb0 tx=0x7ff2fc011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.632+0000 7ff303400700 1 -- 172.21.15.110:0/4258261225 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2fc0036a0 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.632+0000 7ff303400700 1 -- 172.21.15.110:0/4258261225 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff2fc01a430 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.632+0000 7ff303400700 1 -- 172.21.15.110:0/4258261225 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2fc019550 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.632+0000 7ff311600700 1 -- 172.21.15.110:0/4258261225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c19f6b0 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.633+0000 7ff311600700 1 -- 172.21.15.110:0/4258261225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c1a23a0 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.633+0000 7ff303400700 1 -- 172.21.15.110:0/4258261225 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2fc019b90 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.633+0000 7ff303400700 1 -- 172.21.15.110:0/4258261225 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff2fc024730 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.634+0000 7ff311600700 1 -- 172.21.15.110:0/4258261225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c064a80 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.638+0000 7ff303400700 1 -- 172.21.15.110:0/4258261225 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff2fc043e50 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.718+0000 7ff311600700 1 -- 172.21.15.110:0/4258261225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff30c1a28f0 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.718+0000 7ff303400700 1 -- 172.21.15.110:0/4258261225 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7ff2fc032030 con 0x7ff30c07ee00 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.720+0000 7ff311600700 1 -- 172.21.15.110:0/4258261225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 msgr2=0x7ff30c19eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.720+0000 7ff311600700 1 --2- 172.21.15.110:0/4258261225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c19eee0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009fb0 tx=0x7ff2fc011940 comp rx=0 tx=0).stop 2024-04-26T11:18:14.393 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.720+0000 7ff311600700 1 -- 172.21.15.110:0/4258261225 shutdown_connections 2024-04-26T11:18:14.394 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.720+0000 7ff311600700 1 --2- 172.21.15.110:0/4258261225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff30c07ee00 0x7ff30c19eee0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:14.394 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.720+0000 7ff311600700 1 -- 172.21.15.110:0/4258261225 >> 172.21.15.110:0/4258261225 conn(0x7ff30c1043c0 msgr2=0x7ff30c104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:14.394 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.720+0000 7ff311600700 1 -- 172.21.15.110:0/4258261225 shutdown_connections 2024-04-26T11:18:14.394 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:13.720+0000 7ff311600700 1 -- 172.21.15.110:0/4258261225 wait complete. 2024-04-26T11:18:14.394 INFO:teuthology.orchestra.run.smithi110.stdout:mgr not available, waiting (3/15)... 2024-04-26T11:18:14.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:14.597+0000 7fde4a5b8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:18:15.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:14.883+0000 7fde4a5b8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:18:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: Activating manager daemon x 2024-04-26T11:18:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: mgrmap e2: x(active, starting, since 0.0115889s) 2024-04-26T11:18:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T11:18:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T11:18:15.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T11:18:15.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:18:15.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T11:18:15.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: Manager daemon x is now available 2024-04-26T11:18:15.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T11:18:15.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T11:18:15.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' 2024-04-26T11:18:15.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' 2024-04-26T11:18:15.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:14 smithi110 ceph-mon[28069]: from='mgr.14100 172.21.15.110:0/3743031147' entity='mgr.x' 2024-04-26T11:18:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:16 smithi110 ceph-mon[28069]: mgrmap e3: x(active, since 1.0223s) 2024-04-26T11:18:18.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:18:18.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-04-26T11:18:18.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:18:18.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 0 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T11:18:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:18.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T11:18:18.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T11:18:18.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:18.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T11:18:18.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:18.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T11:18:18.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T11:18:18.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T11:18:18.103 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T11:18:18.104 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T11:17:56.438247+0000", 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T11:18:18.105 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.992+0000 7fb511800700 1 Processor -- start 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.992+0000 7fb511800700 1 -- start start 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.992+0000 7fb511800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c07d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.992+0000 7fb511800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c07d880 con 0x7fb50c07ee40 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.993+0000 7fb50aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c07d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.993+0000 7fb50aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c07d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55958/0 (socket says 172.21.15.110:55958) 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.993+0000 7fb50aa00700 1 -- 172.21.15.110:0/2809788929 learned_addr learned my addr 172.21.15.110:0/2809788929 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.994+0000 7fb50aa00700 1 -- 172.21.15.110:0/2809788929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c07da00 con 0x7fb50c07ee40 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.994+0000 7fb50aa00700 1 --2- 172.21.15.110:0/2809788929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c07d340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0098a0 tx=0x7fb4fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca945c5a7a54bf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.994+0000 7fb509600700 1 -- 172.21.15.110:0/2809788929 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc004160 con 0x7fb50c07ee40 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.994+0000 7fb509600700 1 -- 172.21.15.110:0/2809788929 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb4fc004300 con 0x7fb50c07ee40 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.994+0000 7fb509600700 1 -- 172.21.15.110:0/2809788929 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc011af0 con 0x7fb50c07ee40 2024-04-26T11:18:18.106 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.995+0000 7fb511800700 1 -- 172.21.15.110:0/2809788929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 msgr2=0x7fb50c07d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.995+0000 7fb511800700 1 --2- 172.21.15.110:0/2809788929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c07d340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0098a0 tx=0x7fb4fc009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.995+0000 7fb511800700 1 -- 172.21.15.110:0/2809788929 shutdown_connections 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.995+0000 7fb511800700 1 --2- 172.21.15.110:0/2809788929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c07d340 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.995+0000 7fb511800700 1 -- 172.21.15.110:0/2809788929 >> 172.21.15.110:0/2809788929 conn(0x7fb50c104360 msgr2=0x7fb50c106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.995+0000 7fb511800700 1 -- 172.21.15.110:0/2809788929 shutdown_connections 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.995+0000 7fb511800700 1 -- 172.21.15.110:0/2809788929 wait complete. 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.996+0000 7fb511800700 1 Processor -- start 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.996+0000 7fb511800700 1 -- start start 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.997+0000 7fb511800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.997+0000 7fb511800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb50c10f2d0 con 0x7fb50c07ee40 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.997+0000 7fb50aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.997+0000 7fb50aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c19ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55962/0 (socket says 172.21.15.110:55962) 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.997+0000 7fb50aa00700 1 -- 172.21.15.110:0/418399880 learned_addr learned my addr 172.21.15.110:0/418399880 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.997+0000 7fb50aa00700 1 -- 172.21.15.110:0/418399880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50c19f380 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.997+0000 7fb50aa00700 1 --2- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c19ee40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc011ac0 tx=0x7fb4fc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.998+0000 7fb503400700 1 -- 172.21.15.110:0/418399880 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc003b20 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.998+0000 7fb503400700 1 -- 172.21.15.110:0/418399880 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb4fc01a8c0 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.998+0000 7fb503400700 1 -- 172.21.15.110:0/418399880 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4fc0248d0 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.998+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50c19f610 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.998+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb50c1a2300 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.999+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50c064a80 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:16.999+0000 7fb503400700 1 -- 172.21.15.110:0/418399880 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fb4fc022020 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.000+0000 7fb503400700 1 --2- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fb4f00395b0 0x7fb4f003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.000+0000 7fb503400700 1 -- 172.21.15.110:0/418399880 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb4fc04d490 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.000+0000 7fb50a000700 1 --2- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fb4f00395b0 0x7fb4f003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.001+0000 7fb50a000700 1 --2- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fb4f00395b0 0x7fb4f003ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8006fd0 tx=0x7fb4f8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.006+0000 7fb503400700 1 -- 172.21.15.110:0/418399880 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb4fc00f2e0 con 0x7fb50c07ee40 2024-04-26T11:18:18.108 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.322+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb50c1a24d0 con 0x7fb50c07ee40 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.323+0000 7fb503400700 1 -- 172.21.15.110:0/418399880 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fb50c1a24d0 con 0x7fb50c07ee40 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.326+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fb4f00395b0 msgr2=0x7fb4f003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.326+0000 7fb511800700 1 --2- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fb4f00395b0 0x7fb4f003ba70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8006fd0 tx=0x7fb4f8006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.326+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 msgr2=0x7fb50c19ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.326+0000 7fb511800700 1 --2- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c19ee40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc011ac0 tx=0x7fb4fc011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.326+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 shutdown_connections 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.326+0000 7fb511800700 1 --2- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fb4f00395b0 0x7fb4f003ba70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.326+0000 7fb511800700 1 --2- 172.21.15.110:0/418399880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb50c07ee40 0x7fb50c19ee40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.326+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 >> 172.21.15.110:0/418399880 conn(0x7fb50c104360 msgr2=0x7fb50c104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.327+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 shutdown_connections 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:17.327+0000 7fb511800700 1 -- 172.21.15.110:0/418399880 wait complete. 2024-04-26T11:18:18.109 INFO:teuthology.orchestra.run.smithi110.stdout:mgr is available 2024-04-26T11:18:18.249 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:17 smithi110 ceph-mon[28069]: mgrmap e4: x(active, since 2s) 2024-04-26T11:18:18.249 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:17 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/418399880' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T11:18:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:18 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/905048145' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T11:18:19.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:18:19.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout fsid = 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T11:18:19.588 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T11:18:19.589 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T11:18:19.589 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T11:18:19.589 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.687+0000 7f18cce00700 1 Processor -- start 2024-04-26T11:18:19.589 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.687+0000 7f18cce00700 1 -- start start 2024-04-26T11:18:19.589 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.688+0000 7f18cce00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c807d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:19.594 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.688+0000 7f18cce00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f18c807d8d0 con 0x7f18c807eea0 2024-04-26T11:18:19.594 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.688+0000 7f18c7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c807d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:19.594 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.688+0000 7f18c7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c807d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55974/0 (socket says 172.21.15.110:55974) 2024-04-26T11:18:19.594 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.688+0000 7f18c7400700 1 -- 172.21.15.110:0/437056722 learned_addr learned my addr 172.21.15.110:0/437056722 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:19.594 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.689+0000 7f18c7400700 1 -- 172.21.15.110:0/437056722 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c807da50 con 0x7f18c807eea0 2024-04-26T11:18:19.594 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.689+0000 7f18c7400700 1 --2- 172.21.15.110:0/437056722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c807d300 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f18b80098a0 tx=0x7f18b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417ce451d6f0fdd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:19.594 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.689+0000 7f18c6a00700 1 -- 172.21.15.110:0/437056722 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8004160 con 0x7f18c807eea0 2024-04-26T11:18:19.594 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.689+0000 7f18c6a00700 1 -- 172.21.15.110:0/437056722 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f18b8004300 con 0x7f18c807eea0 2024-04-26T11:18:19.594 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.689+0000 7f18c6a00700 1 -- 172.21.15.110:0/437056722 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8011af0 con 0x7f18c807eea0 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.690+0000 7f18cce00700 1 -- 172.21.15.110:0/437056722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 msgr2=0x7f18c807d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.690+0000 7f18cce00700 1 --2- 172.21.15.110:0/437056722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c807d300 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f18b80098a0 tx=0x7f18b8009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.690+0000 7f18cce00700 1 -- 172.21.15.110:0/437056722 shutdown_connections 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.690+0000 7f18cce00700 1 --2- 172.21.15.110:0/437056722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c807d300 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.690+0000 7f18cce00700 1 -- 172.21.15.110:0/437056722 >> 172.21.15.110:0/437056722 conn(0x7f18c81040f0 msgr2=0x7f18c8106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.690+0000 7f18cce00700 1 -- 172.21.15.110:0/437056722 shutdown_connections 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.691+0000 7f18cce00700 1 -- 172.21.15.110:0/437056722 wait complete. 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.691+0000 7f18cce00700 1 Processor -- start 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.692+0000 7f18cce00700 1 -- start start 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.692+0000 7f18cce00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.692+0000 7f18cce00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f18c810f100 con 0x7f18c807eea0 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.692+0000 7f18c7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.692+0000 7f18c7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c819ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55990/0 (socket says 172.21.15.110:55990) 2024-04-26T11:18:19.595 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.692+0000 7f18c7400700 1 -- 172.21.15.110:0/905048145 learned_addr learned my addr 172.21.15.110:0/905048145 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.693+0000 7f18c7400700 1 -- 172.21.15.110:0/905048145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c819f230 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.693+0000 7f18c7400700 1 --2- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c819ecf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f18b8011ac0 tx=0x7f18b8011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.693+0000 7f18c4c00700 1 -- 172.21.15.110:0/905048145 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8003970 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.693+0000 7f18c4c00700 1 -- 172.21.15.110:0/905048145 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f18b8003b10 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.693+0000 7f18c4c00700 1 -- 172.21.15.110:0/905048145 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8024610 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.693+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c819f4c0 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.694+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c81a21a0 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.694+0000 7f18c4c00700 1 -- 172.21.15.110:0/905048145 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f18b801a430 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.695+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c806a530 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.695+0000 7f18c4c00700 1 --2- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f18ac039600 0x7f18ac03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.695+0000 7f18c4c00700 1 -- 172.21.15.110:0/905048145 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f18b804d850 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.695+0000 7f18bea00700 1 --2- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f18ac039600 0x7f18ac03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.696+0000 7f18bea00700 1 --2- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f18ac039600 0x7f18ac03bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18b0006fd0 tx=0x7f18b0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.700+0000 7f18c4c00700 1 -- 172.21.15.110:0/905048145 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f18b8016260 con 0x7f18c807eea0 2024-04-26T11:18:19.596 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.923+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f18c81a2370 con 0x7f18c807eea0 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.926+0000 7f18c4c00700 1 -- 172.21.15.110:0/905048145 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f18c81a2370 con 0x7f18c807eea0 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.929+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f18ac039600 msgr2=0x7f18ac03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.929+0000 7f18cce00700 1 --2- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f18ac039600 0x7f18ac03bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18b0006fd0 tx=0x7f18b0006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.929+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 msgr2=0x7f18c819ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.929+0000 7f18cce00700 1 --2- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c819ecf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f18b8011ac0 tx=0x7f18b8011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.929+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 shutdown_connections 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.929+0000 7f18cce00700 1 --2- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f18ac039600 0x7f18ac03bac0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.929+0000 7f18cce00700 1 --2- 172.21.15.110:0/905048145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18c807eea0 0x7f18c819ecf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.929+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 >> 172.21.15.110:0/905048145 conn(0x7f18c81040f0 msgr2=0x7f18c8104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.930+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 shutdown_connections 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:18.930+0000 7f18cce00700 1 -- 172.21.15.110:0/905048145 wait complete. 2024-04-26T11:18:19.597 INFO:teuthology.orchestra.run.smithi110.stdout:Enabling cephadm module... 2024-04-26T11:18:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:20 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3102465469' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-26T11:18:20.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: ignoring --setuser ceph since I am not root 2024-04-26T11:18:20.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: ignoring --setgroup ceph since I am not root 2024-04-26T11:18:21.218 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:20.838+0000 7f2b3ff1b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:18:21.218 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:21 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:21.083+0000 7f2b3ff1b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.192+0000 7fa161400700 1 Processor -- start 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.192+0000 7fa161400700 1 -- start start 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.193+0000 7fa161400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c07d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.193+0000 7fa161400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c07d910 con 0x7fa15c07eee0 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.193+0000 7fa15be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c07d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.193+0000 7fa15be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c07d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56004/0 (socket says 172.21.15.110:56004) 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.193+0000 7fa15be00700 1 -- 172.21.15.110:0/2235794486 learned_addr learned my addr 172.21.15.110:0/2235794486 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.194+0000 7fa15be00700 1 -- 172.21.15.110:0/2235794486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c07da90 con 0x7fa15c07eee0 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.194+0000 7fa15be00700 1 --2- 172.21.15.110:0/2235794486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c07d340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0098a0 tx=0x7fa14c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98e380149c76e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.194+0000 7fa15aa00700 1 -- 172.21.15.110:0/2235794486 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa14c004160 con 0x7fa15c07eee0 2024-04-26T11:18:21.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.195+0000 7fa15aa00700 1 -- 172.21.15.110:0/2235794486 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa14c004300 con 0x7fa15c07eee0 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.195+0000 7fa15aa00700 1 -- 172.21.15.110:0/2235794486 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa14c011af0 con 0x7fa15c07eee0 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.195+0000 7fa161400700 1 -- 172.21.15.110:0/2235794486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 msgr2=0x7fa15c07d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.195+0000 7fa161400700 1 --2- 172.21.15.110:0/2235794486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c07d340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0098a0 tx=0x7fa14c009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.195+0000 7fa161400700 1 -- 172.21.15.110:0/2235794486 shutdown_connections 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.195+0000 7fa161400700 1 --2- 172.21.15.110:0/2235794486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c07d340 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.195+0000 7fa161400700 1 -- 172.21.15.110:0/2235794486 >> 172.21.15.110:0/2235794486 conn(0x7fa15c1040f0 msgr2=0x7fa15c106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.195+0000 7fa161400700 1 -- 172.21.15.110:0/2235794486 shutdown_connections 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.196+0000 7fa161400700 1 -- 172.21.15.110:0/2235794486 wait complete. 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.197+0000 7fa161400700 1 Processor -- start 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.197+0000 7fa161400700 1 -- start start 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.197+0000 7fa161400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:21.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.197+0000 7fa161400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c10f0c0 con 0x7fa15c07eee0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.197+0000 7fa15be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.197+0000 7fa15be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56016/0 (socket says 172.21.15.110:56016) 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.197+0000 7fa15be00700 1 -- 172.21.15.110:0/3102465469 learned_addr learned my addr 172.21.15.110:0/3102465469 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.198+0000 7fa15be00700 1 -- 172.21.15.110:0/3102465469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c19f240 con 0x7fa15c07eee0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.198+0000 7fa15be00700 1 --2- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c19ed00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009fb0 tx=0x7fa14c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.198+0000 7fa158c00700 1 -- 172.21.15.110:0/3102465469 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa14c0036a0 con 0x7fa15c07eee0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.198+0000 7fa158c00700 1 -- 172.21.15.110:0/3102465469 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa14c01a430 con 0x7fa15c07eee0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.198+0000 7fa158c00700 1 -- 172.21.15.110:0/3102465469 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa14c019550 con 0x7fa15c07eee0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.198+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15c19f4d0 con 0x7fa15c07eee0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.198+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15c1a21b0 con 0x7fa15c07eee0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.199+0000 7fa158c00700 1 -- 172.21.15.110:0/3102465469 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fa14c01a8e0 con 0x7fa15c07eee0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.199+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15c06a530 con 0x7fa15c07eee0 2024-04-26T11:18:21.250 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.200+0000 7fa158c00700 1 --2- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fa140039560 0x7fa14003ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.200+0000 7fa158c00700 1 -- 172.21.15.110:0/3102465469 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa14c04d800 con 0x7fa15c07eee0 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.200+0000 7fa15b400700 1 --2- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fa140039560 0x7fa14003ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.201+0000 7fa15b400700 1 --2- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fa140039560 0x7fa14003ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa148006fd0 tx=0x7fa148006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.207+0000 7fa158c00700 1 -- 172.21.15.110:0/3102465469 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa14c020240 con 0x7fa15c07eee0 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.494+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fa15c1a2380 con 0x7fa15c07eee0 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.548+0000 7fa158c00700 1 -- 172.21.15.110:0/3102465469 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fa15c1a2380 con 0x7fa15c07eee0 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.552+0000 7fa158c00700 1 -- 172.21.15.110:0/3102465469 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fa14c019800 con 0x7fa15c07eee0 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fa140039560 msgr2=0x7fa14003ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 --2- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fa140039560 0x7fa14003ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa148006fd0 tx=0x7fa148006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 msgr2=0x7fa15c19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 --2- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c19ed00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009fb0 tx=0x7fa14c011940 comp rx=0 tx=0).stop 2024-04-26T11:18:21.251 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 shutdown_connections 2024-04-26T11:18:21.252 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 --2- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7fa140039560 0x7fa14003ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:21.252 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 --2- 172.21.15.110:0/3102465469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c07eee0 0x7fa15c19ed00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:21.252 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 >> 172.21.15.110:0/3102465469 conn(0x7fa15c1040f0 msgr2=0x7fa15c104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:21.252 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 shutdown_connections 2024-04-26T11:18:21.252 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:20.553+0000 7fa161400700 1 -- 172.21.15.110:0/3102465469 wait complete. 2024-04-26T11:18:21.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:21 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:21.215+0000 7f2b3ff1b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:18:21.829 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:21 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3102465469' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-26T11:18:21.829 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:21 smithi110 ceph-mon[28069]: mgrmap e5: x(active, since 5s) 2024-04-26T11:18:21.830 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:21 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:21.624+0000 7f2b3ff1b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:18:21.830 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:21 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:21.738+0000 7f2b3ff1b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:18:22.781 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:22 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1857673932' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T11:18:22.796 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-04-26T11:18:22.796 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-26T11:18:22.796 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T11:18:22.796 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.826+0000 7f87c6a00700 1 Processor -- start 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.826+0000 7f87c6a00700 1 -- start start 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.827+0000 7f87c6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c007d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.827+0000 7f87c6a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f87c007d840 con 0x7f87c007ee50 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.827+0000 7f87bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c007d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.827+0000 7f87bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c007d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56042/0 (socket says 172.21.15.110:56042) 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.827+0000 7f87bfe00700 1 -- 172.21.15.110:0/2448277712 learned_addr learned my addr 172.21.15.110:0/2448277712 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.828+0000 7f87bfe00700 1 -- 172.21.15.110:0/2448277712 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c007d9c0 con 0x7f87c007ee50 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.828+0000 7f87bfe00700 1 --2- 172.21.15.110:0/2448277712 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c007d300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f87b00098a0 tx=0x7f87b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf8e4827ce4aad8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.828+0000 7f87bea00700 1 -- 172.21.15.110:0/2448277712 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0004160 con 0x7f87c007ee50 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.829+0000 7f87bea00700 1 -- 172.21.15.110:0/2448277712 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f87b0004300 con 0x7f87c007ee50 2024-04-26T11:18:22.797 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.829+0000 7f87bea00700 1 -- 172.21.15.110:0/2448277712 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0011af0 con 0x7f87c007ee50 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.829+0000 7f87c6a00700 1 -- 172.21.15.110:0/2448277712 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 msgr2=0x7f87c007d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.829+0000 7f87c6a00700 1 --2- 172.21.15.110:0/2448277712 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c007d300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f87b00098a0 tx=0x7f87b0009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.829+0000 7f87c6a00700 1 -- 172.21.15.110:0/2448277712 shutdown_connections 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.829+0000 7f87c6a00700 1 --2- 172.21.15.110:0/2448277712 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c007d300 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.829+0000 7f87c6a00700 1 -- 172.21.15.110:0/2448277712 >> 172.21.15.110:0/2448277712 conn(0x7f87c0104300 msgr2=0x7f87c0106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.829+0000 7f87c6a00700 1 -- 172.21.15.110:0/2448277712 shutdown_connections 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.830+0000 7f87c6a00700 1 -- 172.21.15.110:0/2448277712 wait complete. 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.830+0000 7f87c6a00700 1 Processor -- start 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.831+0000 7f87c6a00700 1 -- start start 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.831+0000 7f87c6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.831+0000 7f87c6a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010f2b0 con 0x7f87c007ee50 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.831+0000 7f87bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:22.798 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.831+0000 7f87bfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c019ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56058/0 (socket says 172.21.15.110:56058) 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.831+0000 7f87bfe00700 1 -- 172.21.15.110:0/1857673932 learned_addr learned my addr 172.21.15.110:0/1857673932 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.832+0000 7f87bfe00700 1 -- 172.21.15.110:0/1857673932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c019f3c0 con 0x7f87c007ee50 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.832+0000 7f87bfe00700 1 --2- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c019ee80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f87b0011ac0 tx=0x7f87b0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.832+0000 7f87bcc00700 1 -- 172.21.15.110:0/1857673932 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b0003b20 con 0x7f87c007ee50 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.832+0000 7f87bcc00700 1 -- 172.21.15.110:0/1857673932 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f87b001a8c0 con 0x7f87c007ee50 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.832+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c019f650 con 0x7f87c007ee50 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.832+0000 7f87bcc00700 1 -- 172.21.15.110:0/1857673932 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87b00248d0 con 0x7f87c007ee50 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.832+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c01a2340 con 0x7f87c007ee50 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.833+0000 7f87bcc00700 1 -- 172.21.15.110:0/1857673932 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f87b0022020 con 0x7f87c007ee50 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.833+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c0064a80 con 0x7f87c007ee50 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.834+0000 7f87bcc00700 1 --2- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f87a4039600 0x7f87a403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.834+0000 7f87bcc00700 1 -- 172.21.15.110:0/1857673932 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f87b004d660 con 0x7f87c007ee50 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.834+0000 7f87bf400700 1 -- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f87a4039600 msgr2=0x7f87a403bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/878579821 2024-04-26T11:18:22.799 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.834+0000 7f87bf400700 1 --2- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f87a4039600 0x7f87a403bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:21.839+0000 7f87bcc00700 1 -- 172.21.15.110:0/1857673932 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f87b002cdf0 con 0x7f87c007ee50 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.035+0000 7f87bf400700 1 -- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f87a4039600 msgr2=0x7f87a403bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/878579821 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.035+0000 7f87bf400700 1 --2- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f87a4039600 0x7f87a403bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.124+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f87c01a2510 con 0x7f87c007ee50 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.125+0000 7f87bcc00700 1 -- 172.21.15.110:0/1857673932 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f87c01a2510 con 0x7f87c007ee50 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f87a4039600 msgr2=0x7f87a403bac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 --2- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f87a4039600 0x7f87a403bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 msgr2=0x7f87c019ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 --2- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c019ee80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f87b0011ac0 tx=0x7f87b0011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 shutdown_connections 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 --2- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f87a4039600 0x7f87a403bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 --2- 172.21.15.110:0/1857673932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87c007ee50 0x7f87c019ee80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 >> 172.21.15.110:0/1857673932 conn(0x7f87c0104300 msgr2=0x7f87c0104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:22.800 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 shutdown_connections 2024-04-26T11:18:22.801 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:22.128+0000 7f87c6a00700 1 -- 172.21.15.110:0/1857673932 wait complete. 2024-04-26T11:18:22.801 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for the mgr to restart... 2024-04-26T11:18:22.801 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr epoch 5... 2024-04-26T11:18:23.348 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:23 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:23.296+0000 7f2b3ff1b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:18:23.740 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:23 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:23.524+0000 7f2b3ff1b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:18:23.740 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:23 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:23.737+0000 7f2b3ff1b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:18:24.488 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:24 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:24.113+0000 7f2b3ff1b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:18:24.489 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:24 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:24.234+0000 7f2b3ff1b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:18:24.759 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:24 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:24.485+0000 7f2b3ff1b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:18:24.759 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:24 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:24.735+0000 7f2b3ff1b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:18:25.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:25 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:25.512+0000 7f2b3ff1b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:18:26.357 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:26 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:26.057+0000 7f2b3ff1b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:18:26.357 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:26 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:26.185+0000 7f2b3ff1b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:18:26.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:26 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:26.452+0000 7f2b3ff1b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:18:27.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:27 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:27.100+0000 7f2b3ff1b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:18:27.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:27 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:27.222+0000 7f2b3ff1b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:18:27.843 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:27 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:27.540+0000 7f2b3ff1b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:18:27.843 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:27 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:27.714+0000 7f2b3ff1b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:18:28.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:27 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:27.840+0000 7f2b3ff1b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:18:28.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:27 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:27.990+0000 7f2b3ff1b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:18:28.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:28.354+0000 7f2b3ff1b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:18:29.385 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:29.099+0000 7f2b3ff1b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:18:29.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:29.382+0000 7f2b3ff1b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:18:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: Active manager daemon x restarted 2024-04-26T11:18:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: Activating manager daemon x 2024-04-26T11:18:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: osdmap e2: 0 total, 0 up, 0 in 2024-04-26T11:18:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: mgrmap e6: x(active, starting, since 0.00848245s) 2024-04-26T11:18:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:18:29.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T11:18:29.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T11:18:29.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T11:18:29.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T11:18:29.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:29 smithi110 ceph-mon[28069]: Manager daemon x is now available 2024-04-26T11:18:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: Found migration_current of "None". Setting to last migration. 2024-04-26T11:18:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:18:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:18:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T11:18:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T11:18:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:18:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:30 smithi110 ceph-mon[28069]: mgrmap e7: x(active, since 1.01762s) 2024-04-26T11:18:31.148 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-04-26T11:18:31.149 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-26T11:18:31.149 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T11:18:31.149 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-04-26T11:18:31.150 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.345+0000 7f72df000700 1 Processor -- start 2024-04-26T11:18:31.150 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.345+0000 7f72df000700 1 -- start start 2024-04-26T11:18:31.150 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.346+0000 7f72df000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d8108f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:31.150 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.346+0000 7f72df000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f72d8109520 con 0x7f72d8108b30 2024-04-26T11:18:31.150 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.346+0000 7f72ddc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d8108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:31.152 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.346+0000 7f72ddc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d8108f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35154/0 (socket says 172.21.15.110:35154) 2024-04-26T11:18:31.152 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.346+0000 7f72ddc00700 1 -- 172.21.15.110:0/2868926121 learned_addr learned my addr 172.21.15.110:0/2868926121 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:31.152 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.347+0000 7f72ddc00700 1 -- 172.21.15.110:0/2868926121 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d8109d30 con 0x7f72d8108b30 2024-04-26T11:18:31.152 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.347+0000 7f72ddc00700 1 --2- 172.21.15.110:0/2868926121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d8108f50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0098a0 tx=0x7f72cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac4faacc937bc97 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:31.152 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.348+0000 7f72d7e00700 1 -- 172.21.15.110:0/2868926121 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72cc004160 con 0x7f72d8108b30 2024-04-26T11:18:31.152 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.348+0000 7f72d7e00700 1 -- 172.21.15.110:0/2868926121 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f72cc004300 con 0x7f72d8108b30 2024-04-26T11:18:31.152 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.348+0000 7f72d7e00700 1 -- 172.21.15.110:0/2868926121 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72cc011af0 con 0x7f72d8108b30 2024-04-26T11:18:31.153 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.348+0000 7f72df000700 1 -- 172.21.15.110:0/2868926121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 msgr2=0x7f72d8108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:31.153 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.348+0000 7f72df000700 1 --2- 172.21.15.110:0/2868926121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d8108f50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0098a0 tx=0x7f72cc009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:31.153 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.349+0000 7f72df000700 1 -- 172.21.15.110:0/2868926121 shutdown_connections 2024-04-26T11:18:31.153 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.349+0000 7f72df000700 1 --2- 172.21.15.110:0/2868926121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d8108f50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:31.153 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.349+0000 7f72df000700 1 -- 172.21.15.110:0/2868926121 >> 172.21.15.110:0/2868926121 conn(0x7f72d81040f0 msgr2=0x7f72d8106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:31.153 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.349+0000 7f72df000700 1 -- 172.21.15.110:0/2868926121 shutdown_connections 2024-04-26T11:18:31.153 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.349+0000 7f72df000700 1 -- 172.21.15.110:0/2868926121 wait complete. 2024-04-26T11:18:31.153 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.350+0000 7f72df000700 1 Processor -- start 2024-04-26T11:18:31.156 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.350+0000 7f72df000700 1 -- start start 2024-04-26T11:18:31.156 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.350+0000 7f72df000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.350+0000 7f72df000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f72d810d0e0 con 0x7f72d8108b30 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.350+0000 7f72ddc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.350+0000 7f72ddc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35170/0 (socket says 172.21.15.110:35170) 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.350+0000 7f72ddc00700 1 -- 172.21.15.110:0/2125000778 learned_addr learned my addr 172.21.15.110:0/2125000778 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.351+0000 7f72ddc00700 1 -- 172.21.15.110:0/2125000778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d819d080 con 0x7f72d8108b30 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.351+0000 7f72ddc00700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d819cb40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009fb0 tx=0x7f72cc011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.351+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72cc0036a0 con 0x7f72d8108b30 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.351+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f72cc01a430 con 0x7f72d8108b30 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.351+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72cc019550 con 0x7f72d8108b30 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.351+0000 7f72df000700 1 -- 172.21.15.110:0/2125000778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d819d310 con 0x7f72d8108b30 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.352+0000 7f72df000700 1 -- 172.21.15.110:0/2125000778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d81a0000 con 0x7f72d8108b30 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.353+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f72cc01a8e0 con 0x7f72d8108b30 2024-04-26T11:18:31.157 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.353+0000 7f72d6000700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 0x7f72c003ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.353+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 --> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f72c003c130 con 0x7f72c0039560 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.353+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f72cc04d910 con 0x7f72d8108b30 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.353+0000 7f72dd200700 1 -- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 msgr2=0x7f72c003ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/878579821 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.353+0000 7f72dd200700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 0x7f72c003ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.554+0000 7f72dd200700 1 -- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 msgr2=0x7f72c003ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/878579821 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.554+0000 7f72dd200700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 0x7f72c003ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.955+0000 7f72dd200700 1 -- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 msgr2=0x7f72c003ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/878579821 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:23.955+0000 7f72dd200700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 0x7f72c003ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:24.756+0000 7f72dd200700 1 -- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 msgr2=0x7f72c003ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/878579821 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:24.756+0000 7f72dd200700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 0x7f72c003ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:26.358+0000 7f72dd200700 1 -- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 msgr2=0x7f72c003ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/878579821 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:26.358+0000 7f72dd200700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 0x7f72c003ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:29.391+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7f72cc019850 con 0x7f72d8108b30 2024-04-26T11:18:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:29.391+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 msgr2=0x7f72c003ba20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:18:31.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:29.391+0000 7f72d6000700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 0x7f72c003ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:31.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.397+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f72cc023390 con 0x7f72d8108b30 2024-04-26T11:18:31.159 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.397+0000 7f72d6000700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f72c003ce50 0x7f72c003f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:31.161 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.397+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f72c003c130 con 0x7f72c003ce50 2024-04-26T11:18:31.161 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.398+0000 7f72dd200700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f72c003ce50 0x7f72c003f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:31.161 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.402+0000 7f72dd200700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f72c003ce50 0x7f72c003f240 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72c4003a10 tx=0x7f72c4009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:31.161 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.404+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 <== mgr.14120 v2:172.21.15.110:6800/4292256031 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f72c003c130 con 0x7f72c003ce50 2024-04-26T11:18:31.161 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.413+0000 7f72df000700 1 -- 172.21.15.110:0/2125000778 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f72d806a530 con 0x7f72c003ce50 2024-04-26T11:18:31.161 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.414+0000 7f72d6000700 1 -- 172.21.15.110:0/2125000778 <== mgr.14120 v2:172.21.15.110:6800/4292256031 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f72d806a530 con 0x7f72c003ce50 2024-04-26T11:18:31.161 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 -- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f72c003ce50 msgr2=0x7f72c003f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f72c003ce50 0x7f72c003f240 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72c4003a10 tx=0x7f72c4009290 comp rx=0 tx=0).stop 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 -- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 msgr2=0x7f72d819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d819cb40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009fb0 tx=0x7f72cc011940 comp rx=0 tx=0).stop 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 -- 172.21.15.110:0/2125000778 shutdown_connections 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f72c003ce50 0x7f72c003f240 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d8108b30 0x7f72d819cb40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 --2- 172.21.15.110:0/2125000778 >> [v2:172.21.15.110:6800/878579821,v1:172.21.15.110:6801/878579821] conn(0x7f72c0039560 0x7f72c003ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 -- 172.21.15.110:0/2125000778 >> 172.21.15.110:0/2125000778 conn(0x7f72d81040f0 msgr2=0x7f72d8104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 -- 172.21.15.110:0/2125000778 shutdown_connections 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:30.415+0000 7f72df000700 1 -- 172.21.15.110:0/2125000778 wait complete. 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:mgr epoch 5 is available 2024-04-26T11:18:31.162 INFO:teuthology.orchestra.run.smithi110.stdout:Setting orchestrator backend to cephadm... 2024-04-26T11:18:31.732 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:31 smithi110 ceph-mon[28069]: [26/Apr/2024:11:18:29] ENGINE Bus STARTING 2024-04-26T11:18:31.732 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:31 smithi110 ceph-mon[28069]: [26/Apr/2024:11:18:29] ENGINE Serving on https://172.21.15.110:7150 2024-04-26T11:18:31.732 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:31 smithi110 ceph-mon[28069]: [26/Apr/2024:11:18:29] ENGINE Serving on http://172.21.15.110:8765 2024-04-26T11:18:31.732 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:31 smithi110 ceph-mon[28069]: [26/Apr/2024:11:18:29] ENGINE Bus STARTED 2024-04-26T11:18:31.732 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:31 smithi110 ceph-mon[28069]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T11:18:31.732 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:31 smithi110 ceph-mon[28069]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T11:18:32.653 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:32 smithi110 ceph-mon[28069]: mgrmap e8: x(active, since 2s) 2024-04-26T11:18:32.653 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:32 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:32.653 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:32 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:18:32.674 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.730+0000 7f1b91c00700 1 Processor -- start 2024-04-26T11:18:32.674 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.730+0000 7f1b91c00700 1 -- start start 2024-04-26T11:18:32.674 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.730+0000 7f1b91c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c109170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:32.674 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.730+0000 7f1b91c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c109740 con 0x7f1b8c108d50 2024-04-26T11:18:32.674 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.731+0000 7f1b8aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.731+0000 7f1b8aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35250/0 (socket says 172.21.15.110:35250) 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.731+0000 7f1b8aa00700 1 -- 172.21.15.110:0/1912082098 learned_addr learned my addr 172.21.15.110:0/1912082098 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.731+0000 7f1b8aa00700 1 -- 172.21.15.110:0/1912082098 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c109f50 con 0x7f1b8c108d50 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.732+0000 7f1b8aa00700 1 --2- 172.21.15.110:0/1912082098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c109170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0098a0 tx=0x7f1b7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f34498206be1a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.732+0000 7f1b89600700 1 -- 172.21.15.110:0/1912082098 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7c004160 con 0x7f1b8c108d50 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.732+0000 7f1b89600700 1 -- 172.21.15.110:0/1912082098 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1b7c004300 con 0x7f1b8c108d50 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.732+0000 7f1b89600700 1 -- 172.21.15.110:0/1912082098 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7c011af0 con 0x7f1b8c108d50 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.733+0000 7f1b91c00700 1 -- 172.21.15.110:0/1912082098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 msgr2=0x7f1b8c109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.733+0000 7f1b91c00700 1 --2- 172.21.15.110:0/1912082098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c109170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0098a0 tx=0x7f1b7c009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.733+0000 7f1b91c00700 1 -- 172.21.15.110:0/1912082098 shutdown_connections 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.733+0000 7f1b91c00700 1 --2- 172.21.15.110:0/1912082098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c109170 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.733+0000 7f1b91c00700 1 -- 172.21.15.110:0/1912082098 >> 172.21.15.110:0/1912082098 conn(0x7f1b8c1042b0 msgr2=0x7f1b8c106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:32.675 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.733+0000 7f1b91c00700 1 -- 172.21.15.110:0/1912082098 shutdown_connections 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.733+0000 7f1b91c00700 1 -- 172.21.15.110:0/1912082098 wait complete. 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.734+0000 7f1b91c00700 1 Processor -- start 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.734+0000 7f1b91c00700 1 -- start start 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.735+0000 7f1b91c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c07eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.735+0000 7f1b91c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10d300 con 0x7f1b8c108d50 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.735+0000 7f1b8aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c07eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.735+0000 7f1b8aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c07eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35262/0 (socket says 172.21.15.110:35262) 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.735+0000 7f1b8aa00700 1 -- 172.21.15.110:0/1565627769 learned_addr learned my addr 172.21.15.110:0/1565627769 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.735+0000 7f1b8aa00700 1 -- 172.21.15.110:0/1565627769 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c07f0d0 con 0x7f1b8c108d50 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.736+0000 7f1b8aa00700 1 --2- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c07eb90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0117b0 tx=0x7f1b7c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.736+0000 7f1b83400700 1 -- 172.21.15.110:0/1565627769 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7c003af0 con 0x7f1b8c108d50 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.736+0000 7f1b83400700 1 -- 172.21.15.110:0/1565627769 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1b7c020070 con 0x7f1b8c108d50 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.736+0000 7f1b83400700 1 -- 172.21.15.110:0/1565627769 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7c019630 con 0x7f1b8c108d50 2024-04-26T11:18:32.676 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.736+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c07d2c0 con 0x7f1b8c108d50 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.736+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c07d800 con 0x7f1b8c108d50 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.737+0000 7f1b83400700 1 -- 172.21.15.110:0/1565627769 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f1b7c01a9c0 con 0x7f1b8c108d50 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.737+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8c064a80 con 0x7f1b8c108d50 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.738+0000 7f1b83400700 1 --2- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1b70039600 0x7f1b7003bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.738+0000 7f1b83400700 1 -- 172.21.15.110:0/1565627769 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1b7c04dbf0 con 0x7f1b8c108d50 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.738+0000 7f1b8a000700 1 --2- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1b70039600 0x7f1b7003bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.739+0000 7f1b8a000700 1 --2- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1b70039600 0x7f1b7003bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1b78006fd0 tx=0x7f1b78006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.744+0000 7f1b83400700 1 -- 172.21.15.110:0/1565627769 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1b7c00e260 con 0x7f1b8c108d50 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.982+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f1b8c07e060 con 0x7f1b70039600 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.992+0000 7f1b83400700 1 -- 172.21.15.110:0/1565627769 <== mgr.14120 v2:172.21.15.110:6800/4292256031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1b8c07e060 con 0x7f1b70039600 2024-04-26T11:18:32.677 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.995+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1b70039600 msgr2=0x7f1b7003bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:32.678 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.995+0000 7f1b91c00700 1 --2- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1b70039600 0x7f1b7003bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1b78006fd0 tx=0x7f1b78006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:32.678 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.995+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 msgr2=0x7f1b8c07eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:32.678 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.995+0000 7f1b91c00700 1 --2- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c07eb90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0117b0 tx=0x7f1b7c011b70 comp rx=0 tx=0).stop 2024-04-26T11:18:32.678 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.995+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 shutdown_connections 2024-04-26T11:18:32.678 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.995+0000 7f1b91c00700 1 --2- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1b70039600 0x7f1b7003bac0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:32.678 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.995+0000 7f1b91c00700 1 --2- 172.21.15.110:0/1565627769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b8c108d50 0x7f1b8c07eb90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:32.678 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.995+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 >> 172.21.15.110:0/1565627769 conn(0x7f1b8c1042b0 msgr2=0x7f1b8c104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:32.678 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.996+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 shutdown_connections 2024-04-26T11:18:32.678 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:31.996+0000 7f1b91c00700 1 -- 172.21.15.110:0/1565627769 wait complete. 2024-04-26T11:18:33.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:33 smithi110 ceph-mon[28069]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:18:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-26T11:18:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.289+0000 7eff95600700 1 Processor -- start 2024-04-26T11:18:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.290+0000 7eff95600700 1 -- start start 2024-04-26T11:18:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.290+0000 7eff95600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff90109170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.290+0000 7eff95600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7eff90109740 con 0x7eff90108d50 2024-04-26T11:18:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.290+0000 7eff8ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff90109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.291+0000 7eff8ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff90109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55662/0 (socket says 172.21.15.110:55662) 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.291+0000 7eff8ea00700 1 -- 172.21.15.110:0/1247394973 learned_addr learned my addr 172.21.15.110:0/1247394973 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.291+0000 7eff8ea00700 1 -- 172.21.15.110:0/1247394973 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff90109f50 con 0x7eff90108d50 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.291+0000 7eff8ea00700 1 --2- 172.21.15.110:0/1247394973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff90109170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff800098a0 tx=0x7eff80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7446c4c75328b7af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.291+0000 7eff8d600700 1 -- 172.21.15.110:0/1247394973 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff80004160 con 0x7eff90108d50 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.292+0000 7eff8d600700 1 -- 172.21.15.110:0/1247394973 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7eff80004300 con 0x7eff90108d50 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.292+0000 7eff8d600700 1 -- 172.21.15.110:0/1247394973 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff80011af0 con 0x7eff90108d50 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.292+0000 7eff95600700 1 -- 172.21.15.110:0/1247394973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 msgr2=0x7eff90109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.292+0000 7eff95600700 1 --2- 172.21.15.110:0/1247394973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff90109170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff800098a0 tx=0x7eff80009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.292+0000 7eff95600700 1 -- 172.21.15.110:0/1247394973 shutdown_connections 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.292+0000 7eff95600700 1 --2- 172.21.15.110:0/1247394973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff90109170 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.292+0000 7eff95600700 1 -- 172.21.15.110:0/1247394973 >> 172.21.15.110:0/1247394973 conn(0x7eff901042b0 msgr2=0x7eff90106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.292+0000 7eff95600700 1 -- 172.21.15.110:0/1247394973 shutdown_connections 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.292+0000 7eff95600700 1 -- 172.21.15.110:0/1247394973 wait complete. 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.293+0000 7eff95600700 1 Processor -- start 2024-04-26T11:18:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.294+0000 7eff95600700 1 -- start start 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.294+0000 7eff95600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff9019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.294+0000 7eff95600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7eff9010d300 con 0x7eff90108d50 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.294+0000 7eff8ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff9019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.294+0000 7eff8ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff9019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55676/0 (socket says 172.21.15.110:55676) 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.294+0000 7eff8ea00700 1 -- 172.21.15.110:0/2504977904 learned_addr learned my addr 172.21.15.110:0/2504977904 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.295+0000 7eff8ea00700 1 -- 172.21.15.110:0/2504977904 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9019d240 con 0x7eff90108d50 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.295+0000 7eff8ea00700 1 --2- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff9019cd00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7eff80009fb0 tx=0x7eff80011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.295+0000 7eff87400700 1 -- 172.21.15.110:0/2504977904 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff800036a0 con 0x7eff90108d50 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.295+0000 7eff87400700 1 -- 172.21.15.110:0/2504977904 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7eff8001a430 con 0x7eff90108d50 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.295+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9019d4d0 con 0x7eff90108d50 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.295+0000 7eff87400700 1 -- 172.21.15.110:0/2504977904 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff80019550 con 0x7eff90108d50 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.295+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff901a01b0 con 0x7eff90108d50 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.296+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9006a530 con 0x7eff90108d50 2024-04-26T11:18:34.245 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.296+0000 7eff87400700 1 -- 172.21.15.110:0/2504977904 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7eff8001a8e0 con 0x7eff90108d50 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.297+0000 7eff87400700 1 --2- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7eff74039560 0x7eff7403ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.297+0000 7eff87400700 1 -- 172.21.15.110:0/2504977904 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7eff8004d9e0 con 0x7eff90108d50 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.297+0000 7eff8e000700 1 --2- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7eff74039560 0x7eff7403ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.298+0000 7eff8e000700 1 --2- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7eff74039560 0x7eff7403ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff7c006fd0 tx=0x7eff7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.303+0000 7eff87400700 1 -- 172.21.15.110:0/2504977904 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7eff8001a690 con 0x7eff90108d50 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.529+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7eff90105590 con 0x7eff74039560 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.531+0000 7eff87400700 1 -- 172.21.15.110:0/2504977904 <== mgr.14120 v2:172.21.15.110:6800/4292256031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7eff90105590 con 0x7eff74039560 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7eff74039560 msgr2=0x7eff7403ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 --2- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7eff74039560 0x7eff7403ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff7c006fd0 tx=0x7eff7c006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 msgr2=0x7eff9019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 --2- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff9019cd00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7eff80009fb0 tx=0x7eff80011940 comp rx=0 tx=0).stop 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 shutdown_connections 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 --2- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7eff74039560 0x7eff7403ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:34.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 --2- 172.21.15.110:0/2504977904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff90108d50 0x7eff9019cd00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:34.247 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 >> 172.21.15.110:0/2504977904 conn(0x7eff901042b0 msgr2=0x7eff90104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:34.247 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 shutdown_connections 2024-04-26T11:18:34.247 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:33.535+0000 7eff95600700 1 -- 172.21.15.110:0/2504977904 wait complete. 2024-04-26T11:18:34.247 INFO:teuthology.orchestra.run.smithi110.stdout:Generating ssh key... 2024-04-26T11:18:34.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:34 smithi110 ceph-mon[28069]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: Generating public/private rsa key pair. 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: Your identification has been saved in /tmp/tmppyl39nj6/key. 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: Your public key has been saved in /tmp/tmppyl39nj6/key.pub. 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: The key fingerprint is: 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: SHA256:Tk3XzIOEe2a8VzaY/FuatVe+gIL/cpjCDCs2WINhDrI ceph-6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: The key's randomart image is: 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: +---[RSA 3072]----+ 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: | .. | 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: | .. = | 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: | .o+ B | 2024-04-26T11:18:35.955 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: |oo o..=+ oo| 2024-04-26T11:18:35.956 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: |=.o S .+ ..o.| 2024-04-26T11:18:35.956 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: |Eo o . o. o ..+| 2024-04-26T11:18:35.956 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: | o . =...o. o ==| 2024-04-26T11:18:35.956 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: | . + . +.+.. +oo| 2024-04-26T11:18:35.956 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: | . o ..+. .o| 2024-04-26T11:18:35.956 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:35 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: +----[SHA256]-----+ 2024-04-26T11:18:36.237 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.822+0000 7f1d2e000700 1 Processor -- start 2024-04-26T11:18:36.237 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.822+0000 7f1d2e000700 1 -- start start 2024-04-26T11:18:36.237 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.823+0000 7f1d2e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.823+0000 7f1d2e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1d28083580 con 0x7f1d2810fcf0 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.823+0000 7f1d27400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.823+0000 7f1d27400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55692/0 (socket says 172.21.15.110:55692) 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.823+0000 7f1d27400700 1 -- 172.21.15.110:0/447982046 learned_addr learned my addr 172.21.15.110:0/447982046 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.824+0000 7f1d27400700 1 -- 172.21.15.110:0/447982046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d28112620 con 0x7f1d2810fcf0 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.824+0000 7f1d27400700 1 --2- 172.21.15.110:0/447982046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281120e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1d180098a0 tx=0x7f1d18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12731dac3db43ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.825+0000 7f1d26000700 1 -- 172.21.15.110:0/447982046 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d18004160 con 0x7f1d2810fcf0 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.825+0000 7f1d26000700 1 -- 172.21.15.110:0/447982046 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1d18004300 con 0x7f1d2810fcf0 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.825+0000 7f1d26000700 1 -- 172.21.15.110:0/447982046 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d18011af0 con 0x7f1d2810fcf0 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.826+0000 7f1d2e000700 1 -- 172.21.15.110:0/447982046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 msgr2=0x7f1d281120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.826+0000 7f1d2e000700 1 --2- 172.21.15.110:0/447982046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281120e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1d180098a0 tx=0x7f1d18009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.826+0000 7f1d2e000700 1 -- 172.21.15.110:0/447982046 shutdown_connections 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.826+0000 7f1d2e000700 1 --2- 172.21.15.110:0/447982046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281120e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:36.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.826+0000 7f1d2e000700 1 -- 172.21.15.110:0/447982046 >> 172.21.15.110:0/447982046 conn(0x7f1d2807e350 msgr2=0x7f1d28080770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.826+0000 7f1d2e000700 1 -- 172.21.15.110:0/447982046 shutdown_connections 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.826+0000 7f1d2e000700 1 -- 172.21.15.110:0/447982046 wait complete. 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.827+0000 7f1d2e000700 1 Processor -- start 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.827+0000 7f1d2e000700 1 -- start start 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.828+0000 7f1d2e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281a3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.828+0000 7f1d2e000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1d281136a0 con 0x7f1d2810fcf0 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.828+0000 7f1d27400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.828+0000 7f1d27400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281a3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55696/0 (socket says 172.21.15.110:55696) 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.828+0000 7f1d27400700 1 -- 172.21.15.110:0/407650784 learned_addr learned my addr 172.21.15.110:0/407650784 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.828+0000 7f1d27400700 1 -- 172.21.15.110:0/407650784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d281a3760 con 0x7f1d2810fcf0 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.829+0000 7f1d27400700 1 --2- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281a3220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d18011ac0 tx=0x7f1d18011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.829+0000 7f1d1fe00700 1 -- 172.21.15.110:0/407650784 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d18003b20 con 0x7f1d2810fcf0 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.829+0000 7f1d1fe00700 1 -- 172.21.15.110:0/407650784 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1d1801a8c0 con 0x7f1d2810fcf0 2024-04-26T11:18:36.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.829+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d281a39f0 con 0x7f1d2810fcf0 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.829+0000 7f1d1fe00700 1 -- 172.21.15.110:0/407650784 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d180248d0 con 0x7f1d2810fcf0 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.829+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d281a66e0 con 0x7f1d2810fcf0 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.830+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d28064a80 con 0x7f1d2810fcf0 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.830+0000 7f1d1fe00700 1 -- 172.21.15.110:0/407650784 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f1d18022020 con 0x7f1d2810fcf0 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.831+0000 7f1d1fe00700 1 --2- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1d0c039600 0x7f1d0c03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.831+0000 7f1d1fe00700 1 -- 172.21.15.110:0/407650784 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1d1804d900 con 0x7f1d2810fcf0 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.831+0000 7f1d26a00700 1 --2- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1d0c039600 0x7f1d0c03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.831+0000 7f1d26a00700 1 --2- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1d0c039600 0x7f1d0c03bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d14006fd0 tx=0x7f1d14006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:34.836+0000 7f1d1fe00700 1 -- 172.21.15.110:0/407650784 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1d1801ab20 con 0x7f1d2810fcf0 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.065+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f1d2807f570 con 0x7f1d0c039600 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.587+0000 7f1d1fe00700 1 -- 172.21.15.110:0/407650784 <== mgr.14120 v2:172.21.15.110:6800/4292256031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1d2807f570 con 0x7f1d0c039600 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.590+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1d0c039600 msgr2=0x7f1d0c03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.590+0000 7f1d2e000700 1 --2- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1d0c039600 0x7f1d0c03bac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d14006fd0 tx=0x7f1d14006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.590+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 msgr2=0x7f1d281a3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.590+0000 7f1d2e000700 1 --2- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281a3220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d18011ac0 tx=0x7f1d18011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:36.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.591+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 shutdown_connections 2024-04-26T11:18:36.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.591+0000 7f1d2e000700 1 --2- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f1d0c039600 0x7f1d0c03bac0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:36.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.591+0000 7f1d2e000700 1 --2- 172.21.15.110:0/407650784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2810fcf0 0x7f1d281a3220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:36.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.591+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 >> 172.21.15.110:0/407650784 conn(0x7f1d2807e350 msgr2=0x7f1d2807ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:36.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.591+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 shutdown_connections 2024-04-26T11:18:36.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:35.591+0000 7f1d2e000700 1 -- 172.21.15.110:0/407650784 wait complete. 2024-04-26T11:18:36.762 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:36 smithi110 ceph-mon[28069]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:18:36.762 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:36 smithi110 ceph-mon[28069]: Generating ssh key... 2024-04-26T11:18:36.762 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:36 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:36.762 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:36 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:37.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQhASfOqoEVR7eqsHNxz5C+R0YkyRla7p8Xt1U7GFwPYVPLkoe9wFs/E04S7EexAUgZgi+K+SEkLk/7Z/iLDF7gZleld/yoOaXFSr7MqiS4j+P/boI3bNge4E4w8trMr4DqCdROLBD5HOmQJa0+5gtT4Bx9uUZUELXOW4WZCes+RAfv88pGLSh8g3WGsNbEW4P74axMLpFmFoMJbg1P8xpKxKn29xJvowyTYNkoO3QQD+2RCIEzfFsSQ5zqBMqMkwHD5a3Ks4iBpiN/dK3IZQOuNwmiaFfXYPRuH/yR5E+zc+414NON4dMo+xT+dP5xzOAZ6Xm18FTwJ+rqxwErdoFjOUzh+QM9YI4LGNXFXyQwaPSVO/11yKPFPtFD4MH7/6OeB2RHEdOIGAj8UfLVYZFRk1kIVtfbysbT3xXeLMoVyjZvXfy9DA8ez5Vo5PFBNduS6qsLmbOOZxbElbce46tegrXUKUNji8Jy/JTxXtWC/GubdVI6lX4P72rRL7oVbc= ceph-6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:18:37.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.838+0000 7fb0dfc00700 1 Processor -- start 2024-04-26T11:18:37.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.838+0000 7fb0dfc00700 1 -- start start 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.839+0000 7fb0dfc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d810b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.839+0000 7fb0dfc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d810b8c0 con 0x7fb0d810af60 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.839+0000 7fb0dd200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d810b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.839+0000 7fb0dd200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d810b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55708/0 (socket says 172.21.15.110:55708) 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.839+0000 7fb0dd200700 1 -- 172.21.15.110:0/1140661189 learned_addr learned my addr 172.21.15.110:0/1140661189 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.840+0000 7fb0dd200700 1 -- 172.21.15.110:0/1140661189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d810c070 con 0x7fb0d810af60 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.840+0000 7fb0dd200700 1 --2- 172.21.15.110:0/1140661189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d810b380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0098a0 tx=0x7fb0cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f4f515923b2daa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.841+0000 7fb0d7400700 1 -- 172.21.15.110:0/1140661189 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0cc004160 con 0x7fb0d810af60 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.841+0000 7fb0d7400700 1 -- 172.21.15.110:0/1140661189 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb0cc004300 con 0x7fb0d810af60 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.841+0000 7fb0d7400700 1 -- 172.21.15.110:0/1140661189 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0cc011af0 con 0x7fb0d810af60 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.842+0000 7fb0dfc00700 1 -- 172.21.15.110:0/1140661189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 msgr2=0x7fb0d810b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:37.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.842+0000 7fb0dfc00700 1 --2- 172.21.15.110:0/1140661189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d810b380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0098a0 tx=0x7fb0cc009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.842+0000 7fb0dfc00700 1 -- 172.21.15.110:0/1140661189 shutdown_connections 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.842+0000 7fb0dfc00700 1 --2- 172.21.15.110:0/1140661189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d810b380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.842+0000 7fb0dfc00700 1 -- 172.21.15.110:0/1140661189 >> 172.21.15.110:0/1140661189 conn(0x7fb0d807e350 msgr2=0x7fb0d807e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.842+0000 7fb0dfc00700 1 -- 172.21.15.110:0/1140661189 shutdown_connections 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.842+0000 7fb0dfc00700 1 -- 172.21.15.110:0/1140661189 wait complete. 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.843+0000 7fb0dfc00700 1 Processor -- start 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.843+0000 7fb0dfc00700 1 -- start start 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.844+0000 7fb0dfc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.844+0000 7fb0dfc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d810f4b0 con 0x7fb0d810af60 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.844+0000 7fb0dd200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d819ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.844+0000 7fb0dd200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d819ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55724/0 (socket says 172.21.15.110:55724) 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.844+0000 7fb0dd200700 1 -- 172.21.15.110:0/4167143563 learned_addr learned my addr 172.21.15.110:0/4167143563 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.844+0000 7fb0dd200700 1 -- 172.21.15.110:0/4167143563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d819f390 con 0x7fb0d810af60 2024-04-26T11:18:37.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.845+0000 7fb0dd200700 1 --2- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d819ee50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc011ac0 tx=0x7fb0cc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.845+0000 7fb0d5600700 1 -- 172.21.15.110:0/4167143563 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0cc003b20 con 0x7fb0d810af60 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.845+0000 7fb0d5600700 1 -- 172.21.15.110:0/4167143563 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb0cc01a8c0 con 0x7fb0d810af60 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.845+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d819f620 con 0x7fb0d810af60 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.845+0000 7fb0d5600700 1 -- 172.21.15.110:0/4167143563 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0cc0248d0 con 0x7fb0d810af60 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.845+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d81a2310 con 0x7fb0d810af60 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.846+0000 7fb0d5600700 1 -- 172.21.15.110:0/4167143563 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fb0cc022020 con 0x7fb0d810af60 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.846+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d8064a80 con 0x7fb0d810af60 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.847+0000 7fb0d5600700 1 --2- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fb0c00395b0 0x7fb0c003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.847+0000 7fb0d5600700 1 -- 172.21.15.110:0/4167143563 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb0cc04d900 con 0x7fb0d810af60 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.847+0000 7fb0d7e00700 1 --2- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fb0c00395b0 0x7fb0c003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.848+0000 7fb0d7e00700 1 --2- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fb0c00395b0 0x7fb0c003ba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4006fd0 tx=0x7fb0c4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:36.852+0000 7fb0d5600700 1 -- 172.21.15.110:0/4167143563 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb0cc04d290 con 0x7fb0d810af60 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.083+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fb0d8108ba0 con 0x7fb0c00395b0 2024-04-26T11:18:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.084+0000 7fb0d5600700 1 -- 172.21.15.110:0/4167143563 <== mgr.14120 v2:172.21.15.110:6800/4292256031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fb0d8108ba0 con 0x7fb0c00395b0 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.087+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fb0c00395b0 msgr2=0x7fb0c003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.087+0000 7fb0dfc00700 1 --2- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fb0c00395b0 0x7fb0c003ba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4006fd0 tx=0x7fb0c4006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.087+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 msgr2=0x7fb0d819ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.087+0000 7fb0dfc00700 1 --2- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d819ee50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc011ac0 tx=0x7fb0cc011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.087+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 shutdown_connections 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.087+0000 7fb0dfc00700 1 --2- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fb0c00395b0 0x7fb0c003ba70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.087+0000 7fb0dfc00700 1 --2- 172.21.15.110:0/4167143563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0d810af60 0x7fb0d819ee50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.087+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 >> 172.21.15.110:0/4167143563 conn(0x7fb0d807e350 msgr2=0x7fb0d8108490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.087+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 shutdown_connections 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:37.088+0000 7fb0dfc00700 1 -- 172.21.15.110:0/4167143563 wait complete. 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-26T11:18:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:Adding key to root@localhost authorized_keys... 2024-04-26T11:18:37.730 INFO:teuthology.orchestra.run.smithi110.stdout:Adding host smithi110... 2024-04-26T11:18:38.019 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:37 smithi110 ceph-mon[28069]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:18:38.948 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:38 smithi110 ceph-mon[28069]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi110", "addr": "172.21.15.110", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:18:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:40 smithi110 ceph-mon[28069]: Deploying cephadm binary to smithi110 2024-04-26T11:18:45.354 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Added host 'smithi110' with addr '172.21.15.110' 2024-04-26T11:18:45.354 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.314+0000 7ff586800700 1 Processor -- start 2024-04-26T11:18:45.354 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.314+0000 7ff586800700 1 -- start start 2024-04-26T11:18:45.355 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.315+0000 7ff586800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58007d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:45.355 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.315+0000 7ff586800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff58007d910 con 0x7ff58007ee90 2024-04-26T11:18:45.355 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.315+0000 7ff57f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58007d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:45.355 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.315+0000 7ff57f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58007d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55738/0 (socket says 172.21.15.110:55738) 2024-04-26T11:18:45.355 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.315+0000 7ff57f400700 1 -- 172.21.15.110:0/4112501495 learned_addr learned my addr 172.21.15.110:0/4112501495 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:45.355 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.316+0000 7ff57f400700 1 -- 172.21.15.110:0/4112501495 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58007da90 con 0x7ff58007ee90 2024-04-26T11:18:45.356 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.316+0000 7ff57f400700 1 --2- 172.21.15.110:0/4112501495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58007d340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff5700098a0 tx=0x7ff570009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55948dddc1c1581 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:45.356 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.316+0000 7ff57e000700 1 -- 172.21.15.110:0/4112501495 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff570004160 con 0x7ff58007ee90 2024-04-26T11:18:45.356 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.317+0000 7ff57e000700 1 -- 172.21.15.110:0/4112501495 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff570004300 con 0x7ff58007ee90 2024-04-26T11:18:45.356 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.317+0000 7ff57e000700 1 -- 172.21.15.110:0/4112501495 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff570011af0 con 0x7ff58007ee90 2024-04-26T11:18:45.356 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.317+0000 7ff586800700 1 -- 172.21.15.110:0/4112501495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 msgr2=0x7ff58007d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:45.356 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.317+0000 7ff586800700 1 --2- 172.21.15.110:0/4112501495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58007d340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff5700098a0 tx=0x7ff570009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:45.357 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.317+0000 7ff586800700 1 -- 172.21.15.110:0/4112501495 shutdown_connections 2024-04-26T11:18:45.357 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.317+0000 7ff586800700 1 --2- 172.21.15.110:0/4112501495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58007d340 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:45.357 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.317+0000 7ff586800700 1 -- 172.21.15.110:0/4112501495 >> 172.21.15.110:0/4112501495 conn(0x7ff580104300 msgr2=0x7ff580106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:45.357 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.317+0000 7ff586800700 1 -- 172.21.15.110:0/4112501495 shutdown_connections 2024-04-26T11:18:45.357 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.317+0000 7ff586800700 1 -- 172.21.15.110:0/4112501495 wait complete. 2024-04-26T11:18:45.358 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.318+0000 7ff586800700 1 Processor -- start 2024-04-26T11:18:45.358 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.319+0000 7ff586800700 1 -- start start 2024-04-26T11:18:45.358 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.319+0000 7ff586800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:45.358 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.319+0000 7ff586800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff58010f270 con 0x7ff58007ee90 2024-04-26T11:18:45.358 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.319+0000 7ff57f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:45.358 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.319+0000 7ff57f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58019ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55742/0 (socket says 172.21.15.110:55742) 2024-04-26T11:18:45.359 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.319+0000 7ff57f400700 1 -- 172.21.15.110:0/3914757456 learned_addr learned my addr 172.21.15.110:0/3914757456 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:45.359 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.320+0000 7ff57f400700 1 -- 172.21.15.110:0/3914757456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58019f390 con 0x7ff58007ee90 2024-04-26T11:18:45.359 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.320+0000 7ff57f400700 1 --2- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58019ee50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff570011ac0 tx=0x7ff570011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:45.359 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.320+0000 7ff577e00700 1 -- 172.21.15.110:0/3914757456 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff570003b20 con 0x7ff58007ee90 2024-04-26T11:18:45.359 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.320+0000 7ff577e00700 1 -- 172.21.15.110:0/3914757456 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff57001a8c0 con 0x7ff58007ee90 2024-04-26T11:18:45.360 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.320+0000 7ff577e00700 1 -- 172.21.15.110:0/3914757456 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5700248d0 con 0x7ff58007ee90 2024-04-26T11:18:45.360 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.320+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58019f620 con 0x7ff58007ee90 2024-04-26T11:18:45.360 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.320+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5801a2310 con 0x7ff58007ee90 2024-04-26T11:18:45.360 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.322+0000 7ff577e00700 1 -- 172.21.15.110:0/3914757456 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7ff570022020 con 0x7ff58007ee90 2024-04-26T11:18:45.360 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.322+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff580064a80 con 0x7ff58007ee90 2024-04-26T11:18:45.360 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.322+0000 7ff577e00700 1 --2- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7ff564039600 0x7ff56403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:45.361 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.322+0000 7ff577e00700 1 -- 172.21.15.110:0/3914757456 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff57004d900 con 0x7ff58007ee90 2024-04-26T11:18:45.361 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.322+0000 7ff57ea00700 1 --2- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7ff564039600 0x7ff56403bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:45.361 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.323+0000 7ff57ea00700 1 --2- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7ff564039600 0x7ff56403bac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff56c006fd0 tx=0x7ff56c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:45.361 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.328+0000 7ff577e00700 1 -- 172.21.15.110:0/3914757456 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff57000f2e0 con 0x7ff58007ee90 2024-04-26T11:18:45.361 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:38.559+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi110", "addr": "172.21.15.110", "target": ["mon-mgr", ""]}) -- 0x7ff580105570 con 0x7ff564039600 2024-04-26T11:18:45.361 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.666+0000 7ff577e00700 1 -- 172.21.15.110:0/3914757456 <== mgr.14120 v2:172.21.15.110:6800/4292256031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7ff580105570 con 0x7ff564039600 2024-04-26T11:18:45.362 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.671+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7ff564039600 msgr2=0x7ff56403bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:45.362 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.671+0000 7ff586800700 1 --2- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7ff564039600 0x7ff56403bac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff56c006fd0 tx=0x7ff56c006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:45.362 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.671+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 msgr2=0x7ff58019ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:45.362 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.671+0000 7ff586800700 1 --2- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58019ee50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff570011ac0 tx=0x7ff570011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:45.362 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.671+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 shutdown_connections 2024-04-26T11:18:45.363 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.671+0000 7ff586800700 1 --2- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7ff564039600 0x7ff56403bac0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:45.363 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.671+0000 7ff586800700 1 --2- 172.21.15.110:0/3914757456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff58007ee90 0x7ff58019ee50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:45.363 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.671+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 >> 172.21.15.110:0/3914757456 conn(0x7ff580104300 msgr2=0x7ff580104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:45.363 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.672+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 shutdown_connections 2024-04-26T11:18:45.363 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:44.672+0000 7ff586800700 1 -- 172.21.15.110:0/3914757456 wait complete. 2024-04-26T11:18:45.363 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying unmanaged mon service... 2024-04-26T11:18:45.908 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:45 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:45.908 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:45 smithi110 ceph-mon[28069]: Added host smithi110 2024-04-26T11:18:45.909 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:45 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:18:46.868 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.940+0000 7fbe6a400700 1 Processor -- start 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.941+0000 7fbe6a400700 1 -- start start 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.941+0000 7fbe6a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6410bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.941+0000 7fbe6a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6407ce50 con 0x7fbe64109800 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.941+0000 7fbe63400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6410bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.942+0000 7fbe63400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6410bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54388/0 (socket says 172.21.15.110:54388) 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.942+0000 7fbe63400700 1 -- 172.21.15.110:0/662486778 learned_addr learned my addr 172.21.15.110:0/662486778 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.942+0000 7fbe63400700 1 -- 172.21.15.110:0/662486778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6410c130 con 0x7fbe64109800 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.942+0000 7fbe63400700 1 --2- 172.21.15.110:0/662486778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6410bbf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe540098a0 tx=0x7fbe54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d782f255cddf7c69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:46.869 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.943+0000 7fbe62000700 1 -- 172.21.15.110:0/662486778 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe54004160 con 0x7fbe64109800 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.943+0000 7fbe62000700 1 -- 172.21.15.110:0/662486778 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbe54004300 con 0x7fbe64109800 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.943+0000 7fbe62000700 1 -- 172.21.15.110:0/662486778 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe54011af0 con 0x7fbe64109800 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.943+0000 7fbe6a400700 1 -- 172.21.15.110:0/662486778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 msgr2=0x7fbe6410bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.943+0000 7fbe6a400700 1 --2- 172.21.15.110:0/662486778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6410bbf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe540098a0 tx=0x7fbe54009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.943+0000 7fbe6a400700 1 -- 172.21.15.110:0/662486778 shutdown_connections 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.943+0000 7fbe6a400700 1 --2- 172.21.15.110:0/662486778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6410bbf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.944+0000 7fbe6a400700 1 -- 172.21.15.110:0/662486778 >> 172.21.15.110:0/662486778 conn(0x7fbe64103210 msgr2=0x7fbe64105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.944+0000 7fbe6a400700 1 -- 172.21.15.110:0/662486778 shutdown_connections 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.944+0000 7fbe6a400700 1 -- 172.21.15.110:0/662486778 wait complete. 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.945+0000 7fbe6a400700 1 Processor -- start 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.945+0000 7fbe6a400700 1 -- start start 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.945+0000 7fbe6a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:46.870 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.945+0000 7fbe6a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6410d090 con 0x7fbe64109800 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.946+0000 7fbe63400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.946+0000 7fbe63400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54392/0 (socket says 172.21.15.110:54392) 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.946+0000 7fbe63400700 1 -- 172.21.15.110:0/2209719676 learned_addr learned my addr 172.21.15.110:0/2209719676 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.946+0000 7fbe63400700 1 -- 172.21.15.110:0/2209719676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6419d200 con 0x7fbe64109800 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.946+0000 7fbe63400700 1 --2- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6419ccc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe54011ac0 tx=0x7fbe54011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.947+0000 7fbe5be00700 1 -- 172.21.15.110:0/2209719676 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe54003b20 con 0x7fbe64109800 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.947+0000 7fbe5be00700 1 -- 172.21.15.110:0/2209719676 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbe5401a8c0 con 0x7fbe64109800 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.947+0000 7fbe5be00700 1 -- 172.21.15.110:0/2209719676 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe540248d0 con 0x7fbe64109800 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.947+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6419d490 con 0x7fbe64109800 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.947+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe641a0180 con 0x7fbe64109800 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.948+0000 7fbe5be00700 1 -- 172.21.15.110:0/2209719676 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fbe54022020 con 0x7fbe64109800 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.948+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe64064a80 con 0x7fbe64109800 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.948+0000 7fbe5be00700 1 --2- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fbe48039600 0x7fbe4803bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.948+0000 7fbe5be00700 1 -- 172.21.15.110:0/2209719676 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbe5404d830 con 0x7fbe64109800 2024-04-26T11:18:46.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.949+0000 7fbe62a00700 1 --2- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fbe48039600 0x7fbe4803bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:46.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.949+0000 7fbe62a00700 1 --2- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fbe48039600 0x7fbe4803bac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbe50006fd0 tx=0x7fbe50006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:46.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:45.954+0000 7fbe5be00700 1 -- 172.21.15.110:0/2209719676 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbe5401ab20 con 0x7fbe64109800 2024-04-26T11:18:46.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.201+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fbe64104480 con 0x7fbe48039600 2024-04-26T11:18:46.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.207+0000 7fbe5be00700 1 -- 172.21.15.110:0/2209719676 <== mgr.14120 v2:172.21.15.110:6800/4292256031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbe64104480 con 0x7fbe48039600 2024-04-26T11:18:46.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.209+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fbe48039600 msgr2=0x7fbe4803bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:46.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.210+0000 7fbe6a400700 1 --2- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fbe48039600 0x7fbe4803bac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbe50006fd0 tx=0x7fbe50006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:46.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.210+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 msgr2=0x7fbe6419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:46.872 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.210+0000 7fbe6a400700 1 --2- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6419ccc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe54011ac0 tx=0x7fbe54011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:46.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.210+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 shutdown_connections 2024-04-26T11:18:46.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.210+0000 7fbe6a400700 1 --2- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fbe48039600 0x7fbe4803bac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:46.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.210+0000 7fbe6a400700 1 --2- 172.21.15.110:0/2209719676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe64109800 0x7fbe6419ccc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:46.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.210+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 >> 172.21.15.110:0/2209719676 conn(0x7fbe64103210 msgr2=0x7fbe64103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:46.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.210+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 shutdown_connections 2024-04-26T11:18:46.873 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:46.210+0000 7fbe6a400700 1 -- 172.21.15.110:0/2209719676 wait complete. 2024-04-26T11:18:46.873 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying unmanaged mgr service... 2024-04-26T11:18:47.375 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:47 smithi110 ceph-mon[28069]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:18:47.375 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:47 smithi110 ceph-mon[28069]: Saving service mon spec with placement count:5 2024-04-26T11:18:47.376 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:47 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:48.974 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:48 smithi110 ceph-mon[28069]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:18:48.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:48 smithi110 ceph-mon[28069]: Saving service mgr spec with placement count:2 2024-04-26T11:18:48.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:48 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:48.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:48 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:49.018 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-26T11:18:49.018 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.679+0000 7f278fe00700 1 Processor -- start 2024-04-26T11:18:49.018 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.679+0000 7f278fe00700 1 -- start start 2024-04-26T11:18:49.018 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.680+0000 7f278fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278807d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:49.018 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.680+0000 7f278fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f278807d840 con 0x7f278807ee50 2024-04-26T11:18:49.018 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.680+0000 7f278d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278807d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:49.018 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.680+0000 7f278d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278807d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54400/0 (socket says 172.21.15.110:54400) 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.680+0000 7f278d400700 1 -- 172.21.15.110:0/3567221133 learned_addr learned my addr 172.21.15.110:0/3567221133 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.681+0000 7f278d400700 1 -- 172.21.15.110:0/3567221133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278807d9c0 con 0x7f278807ee50 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.681+0000 7f278d400700 1 --2- 172.21.15.110:0/3567221133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278807d300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f277c0098a0 tx=0x7f277c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e30f84fc93b24ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.682+0000 7f2787e00700 1 -- 172.21.15.110:0/3567221133 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f277c004160 con 0x7f278807ee50 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.682+0000 7f2787e00700 1 -- 172.21.15.110:0/3567221133 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f277c004300 con 0x7f278807ee50 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.682+0000 7f2787e00700 1 -- 172.21.15.110:0/3567221133 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f277c011af0 con 0x7f278807ee50 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.682+0000 7f278fe00700 1 -- 172.21.15.110:0/3567221133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 msgr2=0x7f278807d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.682+0000 7f278fe00700 1 --2- 172.21.15.110:0/3567221133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278807d300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f277c0098a0 tx=0x7f277c009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.682+0000 7f278fe00700 1 -- 172.21.15.110:0/3567221133 shutdown_connections 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.682+0000 7f278fe00700 1 --2- 172.21.15.110:0/3567221133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278807d300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:49.019 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.682+0000 7f278fe00700 1 -- 172.21.15.110:0/3567221133 >> 172.21.15.110:0/3567221133 conn(0x7f2788104300 msgr2=0x7f2788106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.683+0000 7f278fe00700 1 -- 172.21.15.110:0/3567221133 shutdown_connections 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.683+0000 7f278fe00700 1 -- 172.21.15.110:0/3567221133 wait complete. 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.684+0000 7f278fe00700 1 Processor -- start 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.684+0000 7f278fe00700 1 -- start start 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.684+0000 7f278fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.684+0000 7f278fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f278810f2b0 con 0x7f278807ee50 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.684+0000 7f278d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.684+0000 7f278d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278819ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54406/0 (socket says 172.21.15.110:54406) 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.684+0000 7f278d400700 1 -- 172.21.15.110:0/1066341382 learned_addr learned my addr 172.21.15.110:0/1066341382 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.685+0000 7f278d400700 1 -- 172.21.15.110:0/1066341382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278819f380 con 0x7f278807ee50 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.685+0000 7f278d400700 1 --2- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278819ee40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f277c011ac0 tx=0x7f277c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.685+0000 7f2786000700 1 -- 172.21.15.110:0/1066341382 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f277c003b20 con 0x7f278807ee50 2024-04-26T11:18:49.020 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.685+0000 7f2786000700 1 -- 172.21.15.110:0/1066341382 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f277c01a8c0 con 0x7f278807ee50 2024-04-26T11:18:49.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.685+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278819f610 con 0x7f278807ee50 2024-04-26T11:18:49.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.685+0000 7f2786000700 1 -- 172.21.15.110:0/1066341382 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f277c0248d0 con 0x7f278807ee50 2024-04-26T11:18:49.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.686+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27881a2300 con 0x7f278807ee50 2024-04-26T11:18:49.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.687+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2788064a80 con 0x7f278807ee50 2024-04-26T11:18:49.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.687+0000 7f2786000700 1 -- 172.21.15.110:0/1066341382 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f277c022020 con 0x7f278807ee50 2024-04-26T11:18:49.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.688+0000 7f2786000700 1 --2- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f2770039600 0x7f277003bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:49.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.688+0000 7f2786000700 1 -- 172.21.15.110:0/1066341382 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f277c04d8f0 con 0x7f278807ee50 2024-04-26T11:18:49.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.688+0000 7f278ca00700 1 --2- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f2770039600 0x7f277003bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:49.021 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.689+0000 7f278ca00700 1 --2- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f2770039600 0x7f277003bac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2774006fd0 tx=0x7f2774006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.693+0000 7f2786000700 1 -- 172.21.15.110:0/1066341382 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f277c01ab20 con 0x7f278807ee50 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.936+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2788105580 con 0x7f2770039600 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.945+0000 7f2786000700 1 -- 172.21.15.110:0/1066341382 <== mgr.14120 v2:172.21.15.110:6800/4292256031 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2788105580 con 0x7f2770039600 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.948+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f2770039600 msgr2=0x7f277003bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.948+0000 7f278fe00700 1 --2- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f2770039600 0x7f277003bac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2774006fd0 tx=0x7f2774006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.948+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 msgr2=0x7f278819ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.948+0000 7f278fe00700 1 --2- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278819ee40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f277c011ac0 tx=0x7f277c011ba0 comp rx=0 tx=0).stop 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.948+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 shutdown_connections 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.948+0000 7f278fe00700 1 --2- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f2770039600 0x7f277003bac0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.948+0000 7f278fe00700 1 --2- 172.21.15.110:0/1066341382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f278807ee50 0x7f278819ee40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.948+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 >> 172.21.15.110:0/1066341382 conn(0x7f2788104300 msgr2=0x7f2788104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.949+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 shutdown_connections 2024-04-26T11:18:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:47.949+0000 7f278fe00700 1 -- 172.21.15.110:0/1066341382 wait complete. 2024-04-26T11:18:50.493 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:50 smithi110 ceph-mon[28069]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:18:50.493 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:50 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:50.493 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:50 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3148112234' entity='client.admin' 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.585+0000 7f47d8a00700 1 Processor -- start 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.585+0000 7f47d8a00700 1 -- start start 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.586+0000 7f47d8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.586+0000 7f47d8a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f47d407ced0 con 0x7f47d4107570 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.586+0000 7f47d1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.586+0000 7f47d1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41099a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54416/0 (socket says 172.21.15.110:54416) 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.586+0000 7f47d1e00700 1 -- 172.21.15.110:0/2011070083 learned_addr learned my addr 172.21.15.110:0/2011070083 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.586+0000 7f47d1e00700 1 -- 172.21.15.110:0/2011070083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d4109ee0 con 0x7f47d4107570 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.587+0000 7f47d1e00700 1 --2- 172.21.15.110:0/2011070083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41099a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f47c40098a0 tx=0x7f47c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7677b379812be3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.587+0000 7f47d0a00700 1 -- 172.21.15.110:0/2011070083 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c4004160 con 0x7f47d4107570 2024-04-26T11:18:50.511 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.587+0000 7f47d0a00700 1 -- 172.21.15.110:0/2011070083 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47c4004300 con 0x7f47d4107570 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.587+0000 7f47d0a00700 1 -- 172.21.15.110:0/2011070083 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c4011a20 con 0x7f47d4107570 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.588+0000 7f47d8a00700 1 -- 172.21.15.110:0/2011070083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 msgr2=0x7f47d41099a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.588+0000 7f47d8a00700 1 --2- 172.21.15.110:0/2011070083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41099a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f47c40098a0 tx=0x7f47c4009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.588+0000 7f47d8a00700 1 -- 172.21.15.110:0/2011070083 shutdown_connections 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.588+0000 7f47d8a00700 1 --2- 172.21.15.110:0/2011070083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41099a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.588+0000 7f47d8a00700 1 -- 172.21.15.110:0/2011070083 >> 172.21.15.110:0/2011070083 conn(0x7f47d4103210 msgr2=0x7f47d4105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.588+0000 7f47d8a00700 1 -- 172.21.15.110:0/2011070083 shutdown_connections 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.588+0000 7f47d8a00700 1 -- 172.21.15.110:0/2011070083 wait complete. 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.589+0000 7f47d8a00700 1 Processor -- start 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.589+0000 7f47d8a00700 1 -- start start 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.590+0000 7f47d8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41a3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.590+0000 7f47d8a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f47d410af50 con 0x7f47d4107570 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.590+0000 7f47d1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:50.512 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.590+0000 7f47d1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54432/0 (socket says 172.21.15.110:54432) 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.590+0000 7f47d1e00700 1 -- 172.21.15.110:0/3148112234 learned_addr learned my addr 172.21.15.110:0/3148112234 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.590+0000 7f47d1e00700 1 -- 172.21.15.110:0/3148112234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d41a3780 con 0x7f47d4107570 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.591+0000 7f47d1e00700 1 --2- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41a3240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47c40116e0 tx=0x7f47c4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.591+0000 7f47caa00700 1 -- 172.21.15.110:0/3148112234 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c4003a60 con 0x7f47d4107570 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.591+0000 7f47caa00700 1 -- 172.21.15.110:0/3148112234 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47c401b8f0 con 0x7f47d4107570 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.591+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d41a3a10 con 0x7f47d4107570 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.591+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d41a6700 con 0x7f47d4107570 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.591+0000 7f47caa00700 1 -- 172.21.15.110:0/3148112234 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47c4019860 con 0x7f47d4107570 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.592+0000 7f47caa00700 1 -- 172.21.15.110:0/3148112234 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f47c4019ba0 con 0x7f47d4107570 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.592+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d4064a80 con 0x7f47d4107570 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.593+0000 7f47caa00700 1 --2- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f47b8039560 0x7f47b803ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.593+0000 7f47caa00700 1 -- 172.21.15.110:0/3148112234 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f47c404ddb0 con 0x7f47d4107570 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.593+0000 7f47d1400700 1 --2- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f47b8039560 0x7f47b803ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.594+0000 7f47d1400700 1 --2- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f47b8039560 0x7f47b803ba20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47c0006fd0 tx=0x7f47c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:50.513 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.598+0000 7f47caa00700 1 -- 172.21.15.110:0/3148112234 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f47c4052070 con 0x7f47d4107570 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.825+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f47d402e6e0 con 0x7f47d4107570 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.829+0000 7f47caa00700 1 -- 172.21.15.110:0/3148112234 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f47c401f030 con 0x7f47d4107570 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.832+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f47b8039560 msgr2=0x7f47b803ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.832+0000 7f47d8a00700 1 --2- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f47b8039560 0x7f47b803ba20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47c0006fd0 tx=0x7f47c0006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.832+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 msgr2=0x7f47d41a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.832+0000 7f47d8a00700 1 --2- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41a3240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47c40116e0 tx=0x7f47c4011aa0 comp rx=0 tx=0).stop 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.832+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 shutdown_connections 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.832+0000 7f47d8a00700 1 --2- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f47b8039560 0x7f47b803ba20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.832+0000 7f47d8a00700 1 --2- 172.21.15.110:0/3148112234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47d4107570 0x7f47d41a3240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.832+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 >> 172.21.15.110:0/3148112234 conn(0x7f47d4103210 msgr2=0x7f47d4105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.833+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 shutdown_connections 2024-04-26T11:18:50.514 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:49.833+0000 7f47d8a00700 1 -- 172.21.15.110:0/3148112234 wait complete. 2024-04-26T11:18:52.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.115+0000 7fed23a00700 1 Processor -- start 2024-04-26T11:18:52.246 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.115+0000 7fed23a00700 1 -- start start 2024-04-26T11:18:52.247 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.115+0000 7fed23a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c10b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:52.247 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.116+0000 7fed23a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c10b880 con 0x7fed1c10af20 2024-04-26T11:18:52.247 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.116+0000 7fed21000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c10b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:52.248 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.116+0000 7fed21000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c10b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54434/0 (socket says 172.21.15.110:54434) 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.116+0000 7fed21000700 1 -- 172.21.15.110:0/875044471 learned_addr learned my addr 172.21.15.110:0/875044471 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.117+0000 7fed21000700 1 -- 172.21.15.110:0/875044471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c10c080 con 0x7fed1c10af20 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.117+0000 7fed21000700 1 --2- 172.21.15.110:0/875044471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c10b340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed100098a0 tx=0x7fed10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580b944fe03f3009 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.118+0000 7fed1b400700 1 -- 172.21.15.110:0/875044471 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed10004160 con 0x7fed1c10af20 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.118+0000 7fed1b400700 1 -- 172.21.15.110:0/875044471 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed10004300 con 0x7fed1c10af20 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.118+0000 7fed1b400700 1 -- 172.21.15.110:0/875044471 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed10011a20 con 0x7fed1c10af20 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.118+0000 7fed23a00700 1 -- 172.21.15.110:0/875044471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 msgr2=0x7fed1c10b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.118+0000 7fed23a00700 1 --2- 172.21.15.110:0/875044471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c10b340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed100098a0 tx=0x7fed10009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.119+0000 7fed23a00700 1 -- 172.21.15.110:0/875044471 shutdown_connections 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.119+0000 7fed23a00700 1 --2- 172.21.15.110:0/875044471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c10b340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.119+0000 7fed23a00700 1 -- 172.21.15.110:0/875044471 >> 172.21.15.110:0/875044471 conn(0x7fed1c07e350 msgr2=0x7fed1c07e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.119+0000 7fed23a00700 1 -- 172.21.15.110:0/875044471 shutdown_connections 2024-04-26T11:18:52.249 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.119+0000 7fed23a00700 1 -- 172.21.15.110:0/875044471 wait complete. 2024-04-26T11:18:52.253 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.120+0000 7fed23a00700 1 Processor -- start 2024-04-26T11:18:52.253 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.120+0000 7fed23a00700 1 -- start start 2024-04-26T11:18:52.253 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.121+0000 7fed23a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c19edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.121+0000 7fed23a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fed1c10f4c0 con 0x7fed1c10af20 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.121+0000 7fed21000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c19edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.121+0000 7fed21000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c19edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54436/0 (socket says 172.21.15.110:54436) 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.121+0000 7fed21000700 1 -- 172.21.15.110:0/3627813039 learned_addr learned my addr 172.21.15.110:0/3627813039 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.121+0000 7fed21000700 1 -- 172.21.15.110:0/3627813039 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1c19f310 con 0x7fed1c10af20 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.122+0000 7fed21000700 1 --2- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c19edd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed100116e0 tx=0x7fed10011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.122+0000 7fed19600700 1 -- 172.21.15.110:0/3627813039 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed10003a60 con 0x7fed1c10af20 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.122+0000 7fed19600700 1 -- 172.21.15.110:0/3627813039 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed1001b8f0 con 0x7fed1c10af20 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.122+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1c19f5a0 con 0x7fed1c10af20 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.122+0000 7fed19600700 1 -- 172.21.15.110:0/3627813039 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed10019860 con 0x7fed1c10af20 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.122+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed1c1a2290 con 0x7fed1c10af20 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.123+0000 7fed19600700 1 -- 172.21.15.110:0/3627813039 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fed1001b440 con 0x7fed1c10af20 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.124+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed1c10f640 con 0x7fed1c10af20 2024-04-26T11:18:52.254 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.124+0000 7fed19600700 1 --2- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fed040395b0 0x7fed0403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.124+0000 7fed19600700 1 -- 172.21.15.110:0/3627813039 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fed1004dd70 con 0x7fed1c10af20 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.124+0000 7fed1be00700 1 --2- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fed040395b0 0x7fed0403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.125+0000 7fed1be00700 1 --2- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fed040395b0 0x7fed0403ba70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fed08006fd0 tx=0x7fed08006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.129+0000 7fed19600700 1 -- 172.21.15.110:0/3627813039 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fed1001f030 con 0x7fed1c10af20 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.357+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fed1c1a28b0 con 0x7fed1c10af20 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.363+0000 7fed19600700 1 -- 172.21.15.110:0/3627813039 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fed100223b0 con 0x7fed1c10af20 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.367+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fed040395b0 msgr2=0x7fed0403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.367+0000 7fed23a00700 1 --2- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fed040395b0 0x7fed0403ba70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fed08006fd0 tx=0x7fed08006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.367+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 msgr2=0x7fed1c19edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.367+0000 7fed23a00700 1 --2- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c19edd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed100116e0 tx=0x7fed10011aa0 comp rx=0 tx=0).stop 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.367+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 shutdown_connections 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.367+0000 7fed23a00700 1 --2- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fed040395b0 0x7fed0403ba70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.367+0000 7fed23a00700 1 --2- 172.21.15.110:0/3627813039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c10af20 0x7fed1c19edd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.367+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 >> 172.21.15.110:0/3627813039 conn(0x7fed1c07e350 msgr2=0x7fed1c108410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:52.256 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.367+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 shutdown_connections 2024-04-26T11:18:52.256 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:51.368+0000 7fed23a00700 1 -- 172.21.15.110:0/3627813039 wait complete. 2024-04-26T11:18:52.256 INFO:teuthology.orchestra.run.smithi110.stdout:Enabling the dashboard module... 2024-04-26T11:18:52.512 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:52 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3627813039' entity='client.admin' 2024-04-26T11:18:52.512 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:52 smithi110 ceph-mon[28069]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:18:52.512 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:52 smithi110 ceph-mon[28069]: from='mgr.14120 172.21.15.110:0/3331504577' entity='mgr.x' 2024-04-26T11:18:53.410 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:53 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1734349107' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-26T11:18:53.699 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:53 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: ignoring --setuser ceph since I am not root 2024-04-26T11:18:53.699 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:53 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: ignoring --setgroup ceph since I am not root 2024-04-26T11:18:53.699 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:53 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:53.696+0000 7f272e0a3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:18:54.091 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.817+0000 7f3c3ba00700 1 Processor -- start 2024-04-26T11:18:54.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.817+0000 7f3c3ba00700 1 -- start start 2024-04-26T11:18:54.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.817+0000 7f3c3ba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c34109160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:54.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.818+0000 7f3c3ba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3c34109730 con 0x7f3c34108d40 2024-04-26T11:18:54.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.818+0000 7f3c39000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c34109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:54.092 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.818+0000 7f3c39000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c34109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39712/0 (socket says 172.21.15.110:39712) 2024-04-26T11:18:54.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.818+0000 7f3c39000700 1 -- 172.21.15.110:0/630082213 learned_addr learned my addr 172.21.15.110:0/630082213 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:54.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.819+0000 7f3c39000700 1 -- 172.21.15.110:0/630082213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c34109ef0 con 0x7f3c34108d40 2024-04-26T11:18:54.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.819+0000 7f3c39000700 1 --2- 172.21.15.110:0/630082213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c34109160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009e80 tx=0x7f3c2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec4d80d9f780c73 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:54.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.819+0000 7f3c33400700 1 -- 172.21.15.110:0/630082213 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c28017070 con 0x7f3c34108d40 2024-04-26T11:18:54.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.819+0000 7f3c33400700 1 -- 172.21.15.110:0/630082213 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c2800b8c0 con 0x7f3c34108d40 2024-04-26T11:18:54.093 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.819+0000 7f3c33400700 1 -- 172.21.15.110:0/630082213 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c28004490 con 0x7f3c34108d40 2024-04-26T11:18:54.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.820+0000 7f3c3ba00700 1 -- 172.21.15.110:0/630082213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 msgr2=0x7f3c34109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:54.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.820+0000 7f3c3ba00700 1 --2- 172.21.15.110:0/630082213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c34109160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009e80 tx=0x7f3c2800b330 comp rx=0 tx=0).stop 2024-04-26T11:18:54.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.820+0000 7f3c3ba00700 1 -- 172.21.15.110:0/630082213 shutdown_connections 2024-04-26T11:18:54.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.820+0000 7f3c3ba00700 1 --2- 172.21.15.110:0/630082213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c34109160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:54.094 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.820+0000 7f3c3ba00700 1 -- 172.21.15.110:0/630082213 >> 172.21.15.110:0/630082213 conn(0x7f3c34104300 msgr2=0x7f3c34106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:54.095 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.820+0000 7f3c3ba00700 1 -- 172.21.15.110:0/630082213 shutdown_connections 2024-04-26T11:18:54.095 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.820+0000 7f3c3ba00700 1 -- 172.21.15.110:0/630082213 wait complete. 2024-04-26T11:18:54.095 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.821+0000 7f3c3ba00700 1 Processor -- start 2024-04-26T11:18:54.095 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.822+0000 7f3c3ba00700 1 -- start start 2024-04-26T11:18:54.095 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.822+0000 7f3c3ba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c3419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:54.095 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.822+0000 7f3c3ba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3410d2a0 con 0x7f3c34108d40 2024-04-26T11:18:54.096 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.822+0000 7f3c39000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c3419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:54.096 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.822+0000 7f3c39000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c3419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39718/0 (socket says 172.21.15.110:39718) 2024-04-26T11:18:54.096 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.822+0000 7f3c39000700 1 -- 172.21.15.110:0/1734349107 learned_addr learned my addr 172.21.15.110:0/1734349107 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:54.096 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.823+0000 7f3c39000700 1 -- 172.21.15.110:0/1734349107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3419d1c0 con 0x7f3c34108d40 2024-04-26T11:18:54.096 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.823+0000 7f3c39000700 1 --2- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c3419cc80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800b7b0 tx=0x7f3c2800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:54.096 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.823+0000 7f3c31600700 1 -- 172.21.15.110:0/1734349107 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c28020020 con 0x7f3c34108d40 2024-04-26T11:18:54.097 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.823+0000 7f3c31600700 1 -- 172.21.15.110:0/1734349107 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c28003b50 con 0x7f3c34108d40 2024-04-26T11:18:54.097 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.823+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3419d450 con 0x7f3c34108d40 2024-04-26T11:18:54.097 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.823+0000 7f3c31600700 1 -- 172.21.15.110:0/1734349107 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c28017040 con 0x7f3c34108d40 2024-04-26T11:18:54.097 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.823+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c341a0140 con 0x7f3c34108d40 2024-04-26T11:18:54.097 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.824+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c34064a80 con 0x7f3c34108d40 2024-04-26T11:18:54.098 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.824+0000 7f3c31600700 1 -- 172.21.15.110:0/1734349107 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f3c28023020 con 0x7f3c34108d40 2024-04-26T11:18:54.098 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.825+0000 7f3c31600700 1 --2- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f3c1c039600 0x7f3c1c03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:54.098 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.825+0000 7f3c31600700 1 -- 172.21.15.110:0/1734349107 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3c2800f050 con 0x7f3c34108d40 2024-04-26T11:18:54.098 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.825+0000 7f3c33e00700 1 --2- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f3c1c039600 0x7f3c1c03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:54.098 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.826+0000 7f3c33e00700 1 --2- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f3c1c039600 0x7f3c1c03bac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3c20006fd0 tx=0x7f3c20006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:54.099 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:52.830+0000 7f3c31600700 1 -- 172.21.15.110:0/1734349107 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3c2802a020 con 0x7f3c34108d40 2024-04-26T11:18:54.099 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.131+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f3c341a0310 con 0x7f3c34108d40 2024-04-26T11:18:54.099 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.376+0000 7f3c31600700 1 -- 172.21.15.110:0/1734349107 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f3c341a0310 con 0x7f3c34108d40 2024-04-26T11:18:54.099 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.378+0000 7f3c31600700 1 -- 172.21.15.110:0/1734349107 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f3c28025400 con 0x7f3c34108d40 2024-04-26T11:18:54.099 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.379+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f3c1c039600 msgr2=0x7f3c1c03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:54.099 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.379+0000 7f3c3ba00700 1 --2- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f3c1c039600 0x7f3c1c03bac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3c20006fd0 tx=0x7f3c20006e40 comp rx=0 tx=0).stop 2024-04-26T11:18:54.100 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.379+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 msgr2=0x7f3c3419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:54.100 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.379+0000 7f3c3ba00700 1 --2- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c3419cc80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800b7b0 tx=0x7f3c2800bd30 comp rx=0 tx=0).stop 2024-04-26T11:18:54.100 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.380+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 shutdown_connections 2024-04-26T11:18:54.100 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.380+0000 7f3c3ba00700 1 --2- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f3c1c039600 0x7f3c1c03bac0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:54.100 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.380+0000 7f3c3ba00700 1 --2- 172.21.15.110:0/1734349107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c34108d40 0x7f3c3419cc80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:54.100 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.380+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 >> 172.21.15.110:0/1734349107 conn(0x7f3c34104300 msgr2=0x7f3c34104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:54.101 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.380+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 shutdown_connections 2024-04-26T11:18:54.101 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:53.380+0000 7f3c3ba00700 1 -- 172.21.15.110:0/1734349107 wait complete. 2024-04-26T11:18:54.251 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:53 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:53.946+0000 7f272e0a3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:18:54.252 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:54 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:54.081+0000 7f272e0a3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:18:54.504 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:54 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1734349107' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-26T11:18:54.504 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:54 smithi110 ceph-mon[28069]: mgrmap e9: x(active, since 23s) 2024-04-26T11:18:54.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:54 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:54.502+0000 7f272e0a3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:18:54.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:54 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:54.615+0000 7f272e0a3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:18:55.644 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:18:55 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3115580232' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.709+0000 7f0414200700 1 Processor -- start 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.709+0000 7f0414200700 1 -- start start 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.709+0000 7f0414200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c07d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.709+0000 7f0414200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f040c07d930 con 0x7f040c07eeb0 2024-04-26T11:18:55.660 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.710+0000 7f0411800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c07d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.710+0000 7f0411800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c07d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39754/0 (socket says 172.21.15.110:39754) 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.710+0000 7f0411800700 1 -- 172.21.15.110:0/2334071617 learned_addr learned my addr 172.21.15.110:0/2334071617 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.710+0000 7f0411800700 1 -- 172.21.15.110:0/2334071617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c07dab0 con 0x7f040c07eeb0 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.710+0000 7f0411800700 1 --2- 172.21.15.110:0/2334071617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c07d360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04000098a0 tx=0x7f0400009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ef723406aa0879 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.711+0000 7f040be00700 1 -- 172.21.15.110:0/2334071617 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0400004160 con 0x7f040c07eeb0 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.711+0000 7f040be00700 1 -- 172.21.15.110:0/2334071617 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0400004300 con 0x7f040c07eeb0 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.711+0000 7f040be00700 1 -- 172.21.15.110:0/2334071617 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0400011a20 con 0x7f040c07eeb0 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.711+0000 7f0414200700 1 -- 172.21.15.110:0/2334071617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 msgr2=0x7f040c07d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.711+0000 7f0414200700 1 --2- 172.21.15.110:0/2334071617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c07d360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04000098a0 tx=0x7f0400009bb0 comp rx=0 tx=0).stop 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.712+0000 7f0414200700 1 -- 172.21.15.110:0/2334071617 shutdown_connections 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.712+0000 7f0414200700 1 --2- 172.21.15.110:0/2334071617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c07d360 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.712+0000 7f0414200700 1 -- 172.21.15.110:0/2334071617 >> 172.21.15.110:0/2334071617 conn(0x7f040c104300 msgr2=0x7f040c106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.712+0000 7f0414200700 1 -- 172.21.15.110:0/2334071617 shutdown_connections 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.712+0000 7f0414200700 1 -- 172.21.15.110:0/2334071617 wait complete. 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.713+0000 7f0414200700 1 Processor -- start 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.713+0000 7f0414200700 1 -- start start 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.713+0000 7f0414200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.713+0000 7f0414200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f040c10f300 con 0x7f040c07eeb0 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.713+0000 7f0411800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.713+0000 7f0411800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c19edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39764/0 (socket says 172.21.15.110:39764) 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.713+0000 7f0411800700 1 -- 172.21.15.110:0/3115580232 learned_addr learned my addr 172.21.15.110:0/3115580232 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.714+0000 7f0411800700 1 -- 172.21.15.110:0/3115580232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c19f330 con 0x7f040c07eeb0 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.714+0000 7f0411800700 1 --2- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c19edf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0400000c00 tx=0x7f0400011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.714+0000 7f040a000700 1 -- 172.21.15.110:0/3115580232 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0400003aa0 con 0x7f040c07eeb0 2024-04-26T11:18:55.662 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.714+0000 7f040a000700 1 -- 172.21.15.110:0/3115580232 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f040001b8f0 con 0x7f040c07eeb0 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.714+0000 7f040a000700 1 -- 172.21.15.110:0/3115580232 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0400023870 con 0x7f040c07eeb0 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.714+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c19f5c0 con 0x7f040c07eeb0 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.715+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c1a22b0 con 0x7f040c07eeb0 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.716+0000 7f040a000700 1 -- 172.21.15.110:0/3115580232 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f040001b440 con 0x7f040c07eeb0 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.716+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040c064a80 con 0x7f040c07eeb0 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.716+0000 7f040a000700 1 --2- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f03f4039660 0x7f03f403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.716+0000 7f040a000700 1 -- 172.21.15.110:0/3115580232 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f040004df20 con 0x7f040c07eeb0 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.716+0000 7f0410e00700 1 -- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f03f4039660 msgr2=0x7f03f403bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/4292256031 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.716+0000 7f0410e00700 1 --2- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f03f4039660 0x7f03f403bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.722+0000 7f040a000700 1 -- 172.21.15.110:0/3115580232 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f040001f030 con 0x7f040c07eeb0 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.917+0000 7f0410e00700 1 -- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f03f4039660 msgr2=0x7f03f403bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/4292256031 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:54.917+0000 7f0410e00700 1 --2- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f03f4039660 0x7f03f403bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.003+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f040c1a28a0 con 0x7f040c07eeb0 2024-04-26T11:18:55.663 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.004+0000 7f040a000700 1 -- 172.21.15.110:0/3115580232 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f040000e260 con 0x7f040c07eeb0 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f03f4039660 msgr2=0x7f03f403bb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 --2- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f03f4039660 0x7f03f403bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 msgr2=0x7f040c19edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 --2- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c19edf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0400000c00 tx=0x7f0400011aa0 comp rx=0 tx=0).stop 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 shutdown_connections 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 --2- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7f03f4039660 0x7f03f403bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 --2- 172.21.15.110:0/3115580232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f040c07eeb0 0x7f040c19edf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 >> 172.21.15.110:0/3115580232 conn(0x7f040c104300 msgr2=0x7f040c104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 shutdown_connections 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:55.007+0000 7f0414200700 1 -- 172.21.15.110:0/3115580232 wait complete. 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for the mgr to restart... 2024-04-26T11:18:55.664 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr epoch 9... 2024-04-26T11:18:56.451 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:56 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:56.196+0000 7f272e0a3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:18:56.451 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:56 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:56.421+0000 7f272e0a3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:18:56.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:56 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:56.636+0000 7f272e0a3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:18:57.135 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:57 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:57.013+0000 7f272e0a3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:18:57.135 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:57 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:57.132+0000 7f272e0a3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:18:57.637 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:57 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:57.384+0000 7f272e0a3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:18:57.637 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:57 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:57.634+0000 7f272e0a3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:18:58.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:58 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:58.413+0000 7f272e0a3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:18:59.254 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:58 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:58.959+0000 7f272e0a3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:18:59.255 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:59 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:59.087+0000 7f272e0a3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:18:59.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:18:59 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:18:59.351+0000 7f272e0a3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:19:00.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:19:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:19:00.011+0000 7f272e0a3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:19:00.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:19:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:19:00.139+0000 7f272e0a3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:19:00.770 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:19:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:19:00.460+0000 7f272e0a3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:19:00.770 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:19:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:19:00.638+0000 7f272e0a3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:19:00.770 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:19:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:19:00.768+0000 7f272e0a3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:19:01.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:19:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:19:00.918+0000 7f272e0a3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:19:01.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:19:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:19:01.286+0000 7f272e0a3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:19:02.327 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:19:02.041+0000 7f272e0a3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:19:02.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:19:02.325+0000 7f272e0a3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:19:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: Active manager daemon x restarted 2024-04-26T11:19:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: Activating manager daemon x 2024-04-26T11:19:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: osdmap e3: 0 total, 0 up, 0 in 2024-04-26T11:19:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: mgrmap e10: x(active, starting, since 0.00662022s) 2024-04-26T11:19:02.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:19:02.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T11:19:02.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T11:19:02.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T11:19:02.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T11:19:02.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:02 smithi110 ceph-mon[28069]: Manager daemon x is now available 2024-04-26T11:19:03.701 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:19:03.701 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T11:19:03.701 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T11:19:03.701 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:03 smithi110 ceph-mon[28069]: mgrmap e11: x(active, since 1.00913s) 2024-04-26T11:19:04.226 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-04-26T11:19:04.227 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-26T11:19:04.227 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T11:19:04.227 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-04-26T11:19:04.228 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.240+0000 7fd85ec00700 1 Processor -- start 2024-04-26T11:19:04.228 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.240+0000 7fd85ec00700 1 -- start start 2024-04-26T11:19:04.228 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.241+0000 7fd85ec00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85807d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:04.229 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.241+0000 7fd85ec00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd85807d820 con 0x7fd85807ee30 2024-04-26T11:19:04.229 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.241+0000 7fd857e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85807d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:04.229 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.241+0000 7fd857e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85807d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39774/0 (socket says 172.21.15.110:39774) 2024-04-26T11:19:04.229 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.241+0000 7fd857e00700 1 -- 172.21.15.110:0/731944679 learned_addr learned my addr 172.21.15.110:0/731944679 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:04.230 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.242+0000 7fd857e00700 1 -- 172.21.15.110:0/731944679 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85807d9a0 con 0x7fd85807ee30 2024-04-26T11:19:04.231 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.242+0000 7fd857e00700 1 --2- 172.21.15.110:0/731944679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85807d2e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8480098a0 tx=0x7fd848009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77a36e6d36f814a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:04.231 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.242+0000 7fd856a00700 1 -- 172.21.15.110:0/731944679 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd848004160 con 0x7fd85807ee30 2024-04-26T11:19:04.231 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.242+0000 7fd856a00700 1 -- 172.21.15.110:0/731944679 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd848004300 con 0x7fd85807ee30 2024-04-26T11:19:04.231 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.242+0000 7fd856a00700 1 -- 172.21.15.110:0/731944679 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd848011a20 con 0x7fd85807ee30 2024-04-26T11:19:04.231 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.243+0000 7fd85ec00700 1 -- 172.21.15.110:0/731944679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 msgr2=0x7fd85807d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:04.233 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.243+0000 7fd85ec00700 1 --2- 172.21.15.110:0/731944679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85807d2e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd8480098a0 tx=0x7fd848009bb0 comp rx=0 tx=0).stop 2024-04-26T11:19:04.233 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.243+0000 7fd85ec00700 1 -- 172.21.15.110:0/731944679 shutdown_connections 2024-04-26T11:19:04.233 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.243+0000 7fd85ec00700 1 --2- 172.21.15.110:0/731944679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85807d2e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:04.233 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.243+0000 7fd85ec00700 1 -- 172.21.15.110:0/731944679 >> 172.21.15.110:0/731944679 conn(0x7fd858104300 msgr2=0x7fd858106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:04.233 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.243+0000 7fd85ec00700 1 -- 172.21.15.110:0/731944679 shutdown_connections 2024-04-26T11:19:04.233 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.243+0000 7fd85ec00700 1 -- 172.21.15.110:0/731944679 wait complete. 2024-04-26T11:19:04.233 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.244+0000 7fd85ec00700 1 Processor -- start 2024-04-26T11:19:04.233 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.245+0000 7fd85ec00700 1 -- start start 2024-04-26T11:19:04.233 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.245+0000 7fd85ec00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:04.234 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.245+0000 7fd85ec00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd85810f2c0 con 0x7fd85807ee30 2024-04-26T11:19:04.234 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.245+0000 7fd857e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:04.234 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.245+0000 7fd857e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85819edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39784/0 (socket says 172.21.15.110:39784) 2024-04-26T11:19:04.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.245+0000 7fd857e00700 1 -- 172.21.15.110:0/2634336575 learned_addr learned my addr 172.21.15.110:0/2634336575 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:04.238 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.246+0000 7fd857e00700 1 -- 172.21.15.110:0/2634336575 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85819f330 con 0x7fd85807ee30 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.246+0000 7fd857e00700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85819edf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd848000c00 tx=0x7fd848011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.246+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd848003aa0 con 0x7fd85807ee30 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.246+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd84801b8f0 con 0x7fd85807ee30 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.246+0000 7fd85ec00700 1 -- 172.21.15.110:0/2634336575 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85819f5c0 con 0x7fd85807ee30 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.246+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd848023870 con 0x7fd85807ee30 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.246+0000 7fd85ec00700 1 -- 172.21.15.110:0/2634336575 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8581a22b0 con 0x7fd85807ee30 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.247+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7fd848023b70 con 0x7fd85807ee30 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.248+0000 7fd854c00700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 0x7fd83c03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.248+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 --> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd83c03c1d0 con 0x7fd83c039600 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.248+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd84804df80 con 0x7fd85807ee30 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.248+0000 7fd857400700 1 -- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 msgr2=0x7fd83c03bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/4292256031 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.248+0000 7fd857400700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 0x7fd83c03bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.449+0000 7fd857400700 1 -- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 msgr2=0x7fd83c03bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/4292256031 2024-04-26T11:19:04.239 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.449+0000 7fd857400700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 0x7fd83c03bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.850+0000 7fd857400700 1 -- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 msgr2=0x7fd83c03bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/4292256031 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:56.850+0000 7fd857400700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 0x7fd83c03bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:57.651+0000 7fd857400700 1 -- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 msgr2=0x7fd83c03bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/4292256031 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:57.651+0000 7fd857400700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 0x7fd83c03bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:59.253+0000 7fd857400700 1 -- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 msgr2=0x7fd83c03bac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/4292256031 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:18:59.253+0000 7fd857400700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 0x7fd83c03bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:02.333+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7fd84802c3f0 con 0x7fd85807ee30 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:02.334+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 msgr2=0x7fd83c03bac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:02.334+0000 7fd854c00700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 0x7fd83c03bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.336+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7fd84800bce0 con 0x7fd85807ee30 2024-04-26T11:19:04.240 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.336+0000 7fd854c00700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd83c03cfe0 0x7fd83c03f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.336+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd83c03c1d0 con 0x7fd83c03cfe0 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.336+0000 7fd857400700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd83c03cfe0 0x7fd83c03f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.337+0000 7fd857400700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd83c03cfe0 0x7fd83c03f3d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd844003a10 tx=0x7fd844009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.339+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fd83c03c1d0 con 0x7fd83c03cfe0 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.348+0000 7fd85ec00700 1 -- 172.21.15.110:0/2634336575 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fd85806a530 con 0x7fd83c03cfe0 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.349+0000 7fd854c00700 1 -- 172.21.15.110:0/2634336575 <== mgr.14152 v2:172.21.15.110:6800/2430566216 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fd85806a530 con 0x7fd83c03cfe0 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.349+0000 7fd85ec00700 1 -- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd83c03cfe0 msgr2=0x7fd83c03f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.349+0000 7fd85ec00700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd83c03cfe0 0x7fd83c03f3d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd844003a10 tx=0x7fd844009270 comp rx=0 tx=0).stop 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.349+0000 7fd85ec00700 1 -- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 msgr2=0x7fd85819edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.349+0000 7fd85ec00700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85819edf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd848000c00 tx=0x7fd848011aa0 comp rx=0 tx=0).stop 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.349+0000 7fd85ec00700 1 -- 172.21.15.110:0/2634336575 shutdown_connections 2024-04-26T11:19:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.349+0000 7fd85ec00700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd83c03cfe0 0x7fd83c03f3d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:04.242 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.350+0000 7fd85ec00700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd85807ee30 0x7fd85819edf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:04.242 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.350+0000 7fd85ec00700 1 --2- 172.21.15.110:0/2634336575 >> [v2:172.21.15.110:6800/4292256031,v1:172.21.15.110:6801/4292256031] conn(0x7fd83c039600 0x7fd83c03bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:04.242 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.350+0000 7fd85ec00700 1 -- 172.21.15.110:0/2634336575 >> 172.21.15.110:0/2634336575 conn(0x7fd858104300 msgr2=0x7fd858104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:04.242 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.350+0000 7fd85ec00700 1 -- 172.21.15.110:0/2634336575 shutdown_connections 2024-04-26T11:19:04.242 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:03.350+0000 7fd85ec00700 1 -- 172.21.15.110:0/2634336575 wait complete. 2024-04-26T11:19:04.242 INFO:teuthology.orchestra.run.smithi110.stdout:mgr epoch 9 is available 2024-04-26T11:19:04.242 INFO:teuthology.orchestra.run.smithi110.stdout:Generating a dashboard self-signed certificate... 2024-04-26T11:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:04 smithi110 ceph-mon[28069]: [26/Apr/2024:11:19:02] ENGINE Bus STARTING 2024-04-26T11:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:04 smithi110 ceph-mon[28069]: [26/Apr/2024:11:19:03] ENGINE Serving on http://172.21.15.110:8765 2024-04-26T11:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:04 smithi110 ceph-mon[28069]: [26/Apr/2024:11:19:03] ENGINE Serving on https://172.21.15.110:7150 2024-04-26T11:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:04 smithi110 ceph-mon[28069]: [26/Apr/2024:11:19:03] ENGINE Bus STARTED 2024-04-26T11:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:04 smithi110 ceph-mon[28069]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T11:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:04 smithi110 ceph-mon[28069]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T11:19:05.680 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:05 smithi110 ceph-mon[28069]: mgrmap e12: x(active, since 2s) 2024-04-26T11:19:05.680 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:05 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:06.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-26T11:19:06.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.263+0000 7efef8600700 1 Processor -- start 2024-04-26T11:19:06.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.263+0000 7efef8600700 1 -- start start 2024-04-26T11:19:06.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.263+0000 7efef8600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef0109160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:06.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.263+0000 7efef8600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efef0109730 con 0x7efef0108d40 2024-04-26T11:19:06.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.264+0000 7efef5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef0109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:06.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.264+0000 7efef5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef0109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57352/0 (socket says 172.21.15.110:57352) 2024-04-26T11:19:06.296 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.264+0000 7efef5c00700 1 -- 172.21.15.110:0/3412583071 learned_addr learned my addr 172.21.15.110:0/3412583071 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:06.296 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.264+0000 7efef5c00700 1 -- 172.21.15.110:0/3412583071 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef0109ef0 con 0x7efef0108d40 2024-04-26T11:19:06.296 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.264+0000 7efef5c00700 1 --2- 172.21.15.110:0/3412583071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef0109160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efee40098a0 tx=0x7efee4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a780730d275ac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:06.296 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.265+0000 7efeefe00700 1 -- 172.21.15.110:0/3412583071 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee4004160 con 0x7efef0108d40 2024-04-26T11:19:06.296 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.265+0000 7efeefe00700 1 -- 172.21.15.110:0/3412583071 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efee4004300 con 0x7efef0108d40 2024-04-26T11:19:06.296 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.265+0000 7efeefe00700 1 -- 172.21.15.110:0/3412583071 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee4011a20 con 0x7efef0108d40 2024-04-26T11:19:06.296 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.265+0000 7efef8600700 1 -- 172.21.15.110:0/3412583071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 msgr2=0x7efef0109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:06.299 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.265+0000 7efef8600700 1 --2- 172.21.15.110:0/3412583071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef0109160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efee40098a0 tx=0x7efee4009bb0 comp rx=0 tx=0).stop 2024-04-26T11:19:06.299 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.266+0000 7efef8600700 1 -- 172.21.15.110:0/3412583071 shutdown_connections 2024-04-26T11:19:06.299 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.266+0000 7efef8600700 1 --2- 172.21.15.110:0/3412583071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef0109160 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.266+0000 7efef8600700 1 -- 172.21.15.110:0/3412583071 >> 172.21.15.110:0/3412583071 conn(0x7efef0104300 msgr2=0x7efef0106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.266+0000 7efef8600700 1 -- 172.21.15.110:0/3412583071 shutdown_connections 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.266+0000 7efef8600700 1 -- 172.21.15.110:0/3412583071 wait complete. 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.267+0000 7efef8600700 1 Processor -- start 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.267+0000 7efef8600700 1 -- start start 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.267+0000 7efef8600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef007eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.267+0000 7efef8600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efef010d2a0 con 0x7efef0108d40 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.268+0000 7efef5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef007eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.268+0000 7efef5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef007eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57356/0 (socket says 172.21.15.110:57356) 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.268+0000 7efef5c00700 1 -- 172.21.15.110:0/3845253728 learned_addr learned my addr 172.21.15.110:0/3845253728 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.268+0000 7efef5c00700 1 -- 172.21.15.110:0/3845253728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef007f0d0 con 0x7efef0108d40 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.268+0000 7efef5c00700 1 --2- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef007eb90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efee4009520 tx=0x7efee4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.269+0000 7efeee000700 1 -- 172.21.15.110:0/3845253728 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee40039e0 con 0x7efef0108d40 2024-04-26T11:19:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.269+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef007d2c0 con 0x7efef0108d40 2024-04-26T11:19:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.269+0000 7efeee000700 1 -- 172.21.15.110:0/3845253728 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efee401b8f0 con 0x7efef0108d40 2024-04-26T11:19:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.269+0000 7efeee000700 1 -- 172.21.15.110:0/3845253728 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efee4019770 con 0x7efef0108d40 2024-04-26T11:19:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.269+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef007d800 con 0x7efef0108d40 2024-04-26T11:19:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.270+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef0064a80 con 0x7efef0108d40 2024-04-26T11:19:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.270+0000 7efeee000700 1 -- 172.21.15.110:0/3845253728 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7efee4019a20 con 0x7efef0108d40 2024-04-26T11:19:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.271+0000 7efeee000700 1 --2- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efed8039650 0x7efed803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.271+0000 7efeee000700 1 -- 172.21.15.110:0/3845253728 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efee404e2f0 con 0x7efef0108d40 2024-04-26T11:19:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.271+0000 7efef5200700 1 --2- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efed8039650 0x7efed803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.272+0000 7efef5200700 1 --2- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efed8039650 0x7efed803bb10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efedc006fd0 tx=0x7efedc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.277+0000 7efeee000700 1 -- 172.21.15.110:0/3845253728 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efee401f030 con 0x7efef0108d40 2024-04-26T11:19:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.513+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7efef007e010 con 0x7efed8039650 2024-04-26T11:19:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.678+0000 7efeee000700 1 -- 172.21.15.110:0/3845253728 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7efef007e010 con 0x7efed8039650 2024-04-26T11:19:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efed8039650 msgr2=0x7efed803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 --2- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efed8039650 0x7efed803bb10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efedc006fd0 tx=0x7efedc006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 msgr2=0x7efef007eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:06.302 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 --2- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef007eb90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efee4009520 tx=0x7efee4011aa0 comp rx=0 tx=0).stop 2024-04-26T11:19:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 shutdown_connections 2024-04-26T11:19:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 --2- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efed8039650 0x7efed803bb10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 --2- 172.21.15.110:0/3845253728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efef0108d40 0x7efef007eb90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 >> 172.21.15.110:0/3845253728 conn(0x7efef0104300 msgr2=0x7efef0104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 shutdown_connections 2024-04-26T11:19:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:05.681+0000 7efef8600700 1 -- 172.21.15.110:0/3845253728 wait complete. 2024-04-26T11:19:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:Creating initial admin user... 2024-04-26T11:19:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:06 smithi110 ceph-mon[28069]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:19:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:06.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:08.074 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ZokSSHmIx9ahM34ittq21uXx6opYEDuuCFdpDcYvQP35acHQ0GUkW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714130347, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-26T11:19:08.074 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.876+0000 7f02e1600700 1 Processor -- start 2024-04-26T11:19:08.074 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.877+0000 7f02e1600700 1 -- start start 2024-04-26T11:19:08.074 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.877+0000 7f02e1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc108fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:08.074 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.877+0000 7f02e1600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1095b0 con 0x7f02dc108bc0 2024-04-26T11:19:08.075 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.878+0000 7f02dbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc108fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:08.075 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.878+0000 7f02dbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc108fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57364/0 (socket says 172.21.15.110:57364) 2024-04-26T11:19:08.077 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.878+0000 7f02dbe00700 1 -- 172.21.15.110:0/1883548902 learned_addr learned my addr 172.21.15.110:0/1883548902 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.878+0000 7f02dbe00700 1 -- 172.21.15.110:0/1883548902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc109d70 con 0x7f02dc108bc0 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.879+0000 7f02dbe00700 1 --2- 172.21.15.110:0/1883548902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc108fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0098a0 tx=0x7f02cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a582818fa0227f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.879+0000 7f02db400700 1 -- 172.21.15.110:0/1883548902 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02cc004160 con 0x7f02dc108bc0 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.879+0000 7f02db400700 1 -- 172.21.15.110:0/1883548902 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02cc004300 con 0x7f02dc108bc0 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.879+0000 7f02db400700 1 -- 172.21.15.110:0/1883548902 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02cc011a20 con 0x7f02dc108bc0 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.880+0000 7f02e1600700 1 -- 172.21.15.110:0/1883548902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 msgr2=0x7f02dc108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.880+0000 7f02e1600700 1 --2- 172.21.15.110:0/1883548902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc108fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0098a0 tx=0x7f02cc009bb0 comp rx=0 tx=0).stop 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.880+0000 7f02e1600700 1 -- 172.21.15.110:0/1883548902 shutdown_connections 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.880+0000 7f02e1600700 1 --2- 172.21.15.110:0/1883548902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc108fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.880+0000 7f02e1600700 1 -- 172.21.15.110:0/1883548902 >> 172.21.15.110:0/1883548902 conn(0x7f02dc104160 msgr2=0x7f02dc1065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.880+0000 7f02e1600700 1 -- 172.21.15.110:0/1883548902 shutdown_connections 2024-04-26T11:19:08.078 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.881+0000 7f02e1600700 1 -- 172.21.15.110:0/1883548902 wait complete. 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.881+0000 7f02e1600700 1 Processor -- start 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.882+0000 7f02e1600700 1 -- start start 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.882+0000 7f02e1600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.882+0000 7f02e1600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc10d120 con 0x7f02dc108bc0 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.882+0000 7f02dbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.882+0000 7f02dbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc19ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57372/0 (socket says 172.21.15.110:57372) 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.882+0000 7f02dbe00700 1 -- 172.21.15.110:0/879948281 learned_addr learned my addr 172.21.15.110:0/879948281 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.883+0000 7f02dbe00700 1 -- 172.21.15.110:0/879948281 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc19f200 con 0x7f02dc108bc0 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.883+0000 7f02dbe00700 1 --2- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc19ecc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0119f0 tx=0x7f02cc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.883+0000 7f02d9600700 1 -- 172.21.15.110:0/879948281 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02cc0039e0 con 0x7f02dc108bc0 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.883+0000 7f02d9600700 1 -- 172.21.15.110:0/879948281 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02cc01b8f0 con 0x7f02dc108bc0 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.883+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02dc19f490 con 0x7f02dc108bc0 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.883+0000 7f02d9600700 1 -- 172.21.15.110:0/879948281 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02cc0237a0 con 0x7f02dc108bc0 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.884+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02dc1a2180 con 0x7f02dc108bc0 2024-04-26T11:19:08.079 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.885+0000 7f02d9600700 1 -- 172.21.15.110:0/879948281 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f02cc02c3f0 con 0x7f02dc108bc0 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.885+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02dc06a530 con 0x7f02dc108bc0 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.885+0000 7f02d9600700 1 --2- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02c0039610 0x7f02c003bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.885+0000 7f02d9600700 1 -- 172.21.15.110:0/879948281 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f02cc04e170 con 0x7f02dc108bc0 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.886+0000 7f02d3400700 1 --2- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02c0039610 0x7f02c003bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.886+0000 7f02d3400700 1 --2- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02c0039610 0x7f02c003bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02c4006fd0 tx=0x7f02c4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:06.891+0000 7f02d9600700 1 -- 172.21.15.110:0/879948281 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f02cc01f030 con 0x7f02dc108bc0 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.141+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f02dc19f970 con 0x7f02c0039610 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.380+0000 7f02d9600700 1 -- 172.21.15.110:0/879948281 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f02dc19f970 con 0x7f02c0039610 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.383+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02c0039610 msgr2=0x7f02c003bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.383+0000 7f02e1600700 1 --2- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02c0039610 0x7f02c003bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02c4006fd0 tx=0x7f02c4006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.383+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 msgr2=0x7f02dc19ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.383+0000 7f02e1600700 1 --2- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc19ecc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0119f0 tx=0x7f02cc011ad0 comp rx=0 tx=0).stop 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.384+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 shutdown_connections 2024-04-26T11:19:08.080 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.384+0000 7f02e1600700 1 --2- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02c0039610 0x7f02c003bad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:08.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.384+0000 7f02e1600700 1 --2- 172.21.15.110:0/879948281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02dc108bc0 0x7f02dc19ecc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:08.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.384+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 >> 172.21.15.110:0/879948281 conn(0x7f02dc104160 msgr2=0x7f02dc104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:08.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.384+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 shutdown_connections 2024-04-26T11:19:08.081 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:07.384+0000 7f02e1600700 1 -- 172.21.15.110:0/879948281 wait complete. 2024-04-26T11:19:08.081 INFO:teuthology.orchestra.run.smithi110.stdout:Fetching dashboard port number... 2024-04-26T11:19:08.414 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:08 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:08.415 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:08 smithi110 ceph-mon[28069]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:19:08.415 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:08 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:10.278 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:10 smithi110 ceph-mon[28069]: mgrmap e13: x(active, since 6s) 2024-04-26T11:19:10.278 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:10 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3435948959' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-26T11:19:10.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 8443 2024-04-26T11:19:10.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.891+0000 7f110fe00700 1 Processor -- start 2024-04-26T11:19:10.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.891+0000 7f110fe00700 1 -- start start 2024-04-26T11:19:10.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.891+0000 7f110fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f110810bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:10.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.891+0000 7f110fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f110807ceb0 con 0x7f11081097a0 2024-04-26T11:19:10.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.892+0000 7f110d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f110810bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:10.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.892+0000 7f110d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f110810bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57378/0 (socket says 172.21.15.110:57378) 2024-04-26T11:19:10.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.892+0000 7f110d400700 1 -- 172.21.15.110:0/70430944 learned_addr learned my addr 172.21.15.110:0/70430944 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:10.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.892+0000 7f110d400700 1 -- 172.21.15.110:0/70430944 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110810c0d0 con 0x7f11081097a0 2024-04-26T11:19:10.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.892+0000 7f110d400700 1 --2- 172.21.15.110:0/70430944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f110810bb90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0098a0 tx=0x7f10fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fde35850bcc9fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:10.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.893+0000 7f1107e00700 1 -- 172.21.15.110:0/70430944 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc004160 con 0x7f11081097a0 2024-04-26T11:19:10.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.893+0000 7f1107e00700 1 -- 172.21.15.110:0/70430944 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10fc004300 con 0x7f11081097a0 2024-04-26T11:19:10.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.893+0000 7f1107e00700 1 -- 172.21.15.110:0/70430944 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc011a20 con 0x7f11081097a0 2024-04-26T11:19:10.292 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.893+0000 7f110fe00700 1 -- 172.21.15.110:0/70430944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 msgr2=0x7f110810bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.893+0000 7f110fe00700 1 --2- 172.21.15.110:0/70430944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f110810bb90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0098a0 tx=0x7f10fc009bb0 comp rx=0 tx=0).stop 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.894+0000 7f110fe00700 1 -- 172.21.15.110:0/70430944 shutdown_connections 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.894+0000 7f110fe00700 1 --2- 172.21.15.110:0/70430944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f110810bb90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.894+0000 7f110fe00700 1 -- 172.21.15.110:0/70430944 >> 172.21.15.110:0/70430944 conn(0x7f1108103210 msgr2=0x7f1108105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.894+0000 7f110fe00700 1 -- 172.21.15.110:0/70430944 shutdown_connections 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.894+0000 7f110fe00700 1 -- 172.21.15.110:0/70430944 wait complete. 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.895+0000 7f110fe00700 1 Processor -- start 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.895+0000 7f110fe00700 1 -- start start 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.895+0000 7f110fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f1108109020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.895+0000 7f110fe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f110810d0d0 con 0x7f11081097a0 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.895+0000 7f110d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f1108109020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.895+0000 7f110d400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f1108109020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57384/0 (socket says 172.21.15.110:57384) 2024-04-26T11:19:10.293 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.895+0000 7f110d400700 1 -- 172.21.15.110:0/3435948959 learned_addr learned my addr 172.21.15.110:0/3435948959 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.896+0000 7f110d400700 1 -- 172.21.15.110:0/3435948959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1108109560 con 0x7f11081097a0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.896+0000 7f110d400700 1 --2- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f1108109020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10fc000c00 tx=0x7f10fc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.896+0000 7f1106000700 1 -- 172.21.15.110:0/3435948959 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc003aa0 con 0x7f11081097a0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.896+0000 7f1106000700 1 -- 172.21.15.110:0/3435948959 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10fc01b8f0 con 0x7f11081097a0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.896+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1108107750 con 0x7f11081097a0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.896+0000 7f1106000700 1 -- 172.21.15.110:0/3435948959 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10fc023870 con 0x7f11081097a0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.896+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1108107c90 con 0x7f11081097a0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.898+0000 7f1106000700 1 -- 172.21.15.110:0/3435948959 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f10fc01b440 con 0x7f11081097a0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.898+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1108064a80 con 0x7f11081097a0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.898+0000 7f1106000700 1 --2- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f10f0039660 0x7f10f003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.898+0000 7f1106000700 1 -- 172.21.15.110:0/3435948959 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f10fc04dff0 con 0x7f11081097a0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.898+0000 7f110ca00700 1 --2- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f10f0039660 0x7f10f003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.899+0000 7f110ca00700 1 --2- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f10f0039660 0x7f10f003bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006fd0 tx=0x7f10f4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:10.294 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:08.904+0000 7f1106000700 1 -- 172.21.15.110:0/3435948959 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f10fc01f030 con 0x7f11081097a0 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.117+0000 7f1106000700 1 -- 172.21.15.110:0/3435948959 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f10fc02c3f0 con 0x7f11081097a0 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.131+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f1108107f70 con 0x7f11081097a0 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.132+0000 7f1106000700 1 -- 172.21.15.110:0/3435948959 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f10fc0292a0 con 0x7f11081097a0 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f10f0039660 msgr2=0x7f10f003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 --2- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f10f0039660 0x7f10f003bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10f4006fd0 tx=0x7f10f4006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 msgr2=0x7f1108109020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 --2- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f1108109020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10fc000c00 tx=0x7f10fc011aa0 comp rx=0 tx=0).stop 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 shutdown_connections 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 --2- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f10f0039660 0x7f10f003bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 --2- 172.21.15.110:0/3435948959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11081097a0 0x7f1108109020 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 >> 172.21.15.110:0/3435948959 conn(0x7f1108103210 msgr2=0x7f1108103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 shutdown_connections 2024-04-26T11:19:10.295 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:09.135+0000 7f110fe00700 1 -- 172.21.15.110:0/3435948959 wait complete. 2024-04-26T11:19:10.325 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T11:19:10.325 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-04-26T11:19:10.348 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T11:19:10.348 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-04-26T11:19:10.348 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-04-26T11:19:10.348 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-26T11:19:10.356 INFO:teuthology.orchestra.run.smithi110.stdout:Ceph Dashboard is now available at: 2024-04-26T11:19:10.356 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:10.356 INFO:teuthology.orchestra.run.smithi110.stdout: URL: https://smithi110.front.sepia.ceph.com:8443/ 2024-04-26T11:19:10.356 INFO:teuthology.orchestra.run.smithi110.stdout: User: admin 2024-04-26T11:19:10.356 INFO:teuthology.orchestra.run.smithi110.stdout: Password: k6b30um7rw 2024-04-26T11:19:10.356 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:10.357 INFO:teuthology.orchestra.run.smithi110.stdout:Saving cluster configuration to /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config directory 2024-04-26T11:19:10.359 INFO:teuthology.orchestra.run.smithi110.stdout:Enabling autotune for osd_memory_target 2024-04-26T11:19:11.823 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.961+0000 7f844cc00700 1 Processor -- start 2024-04-26T11:19:11.823 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.962+0000 7f844cc00700 1 -- start start 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.962+0000 7f844cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844807d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.962+0000 7f844cc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f844807d910 con 0x7f844807ee90 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.963+0000 7f8447400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844807d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.963+0000 7f8447400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844807d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57400/0 (socket says 172.21.15.110:57400) 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.963+0000 7f8447400700 1 -- 172.21.15.110:0/3240125236 learned_addr learned my addr 172.21.15.110:0/3240125236 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.963+0000 7f8447400700 1 -- 172.21.15.110:0/3240125236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844807da90 con 0x7f844807ee90 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.964+0000 7f8447400700 1 --2- 172.21.15.110:0/3240125236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844807d340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84380098a0 tx=0x7f8438009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd41aeb051639fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.964+0000 7f8446000700 1 -- 172.21.15.110:0/3240125236 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8438004160 con 0x7f844807ee90 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.964+0000 7f8446000700 1 -- 172.21.15.110:0/3240125236 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8438004300 con 0x7f844807ee90 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.964+0000 7f8446000700 1 -- 172.21.15.110:0/3240125236 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8438011a20 con 0x7f844807ee90 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.965+0000 7f844cc00700 1 -- 172.21.15.110:0/3240125236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 msgr2=0x7f844807d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.965+0000 7f844cc00700 1 --2- 172.21.15.110:0/3240125236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844807d340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84380098a0 tx=0x7f8438009bb0 comp rx=0 tx=0).stop 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.965+0000 7f844cc00700 1 -- 172.21.15.110:0/3240125236 shutdown_connections 2024-04-26T11:19:11.824 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.965+0000 7f844cc00700 1 --2- 172.21.15.110:0/3240125236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844807d340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.965+0000 7f844cc00700 1 -- 172.21.15.110:0/3240125236 >> 172.21.15.110:0/3240125236 conn(0x7f8448104190 msgr2=0x7f84481065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.965+0000 7f844cc00700 1 -- 172.21.15.110:0/3240125236 shutdown_connections 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.965+0000 7f844cc00700 1 -- 172.21.15.110:0/3240125236 wait complete. 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.966+0000 7f844cc00700 1 Processor -- start 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.966+0000 7f844cc00700 1 -- start start 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.966+0000 7f844cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.966+0000 7f844cc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f844810f130 con 0x7f844807ee90 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.967+0000 7f8447400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.967+0000 7f8447400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844819ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57406/0 (socket says 172.21.15.110:57406) 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.967+0000 7f8447400700 1 -- 172.21.15.110:0/2657329741 learned_addr learned my addr 172.21.15.110:0/2657329741 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.967+0000 7f8447400700 1 -- 172.21.15.110:0/2657329741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844819f1c0 con 0x7f844807ee90 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.967+0000 7f8447400700 1 --2- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844819ec80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84380116e0 tx=0x7f8438011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.968+0000 7f843fe00700 1 -- 172.21.15.110:0/2657329741 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8438003b20 con 0x7f844807ee90 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.968+0000 7f843fe00700 1 -- 172.21.15.110:0/2657329741 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f843801b8f0 con 0x7f844807ee90 2024-04-26T11:19:11.825 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.968+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844819f450 con 0x7f844807ee90 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.968+0000 7f843fe00700 1 -- 172.21.15.110:0/2657329741 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84380238c0 con 0x7f844807ee90 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.968+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84481a2140 con 0x7f844807ee90 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.969+0000 7f843fe00700 1 -- 172.21.15.110:0/2657329741 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f843801baa0 con 0x7f844807ee90 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.969+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844806a530 con 0x7f844807ee90 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.969+0000 7f843fe00700 1 --2- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f842c0396b0 0x7f842c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.970+0000 7f843fe00700 1 -- 172.21.15.110:0/2657329741 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f843804e2a0 con 0x7f844807ee90 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.970+0000 7f8446a00700 1 --2- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f842c0396b0 0x7f842c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.971+0000 7f8446a00700 1 --2- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f842c0396b0 0x7f842c03bb70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8434006fd0 tx=0x7f8434006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:10.975+0000 7f843fe00700 1 -- 172.21.15.110:0/2657329741 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f843801f030 con 0x7f844807ee90 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.198+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f84481a2760 con 0x7f844807ee90 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.198+0000 7f843fe00700 1 -- 172.21.15.110:0/2657329741 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f843802bb60 con 0x7f844807ee90 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.201+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f842c0396b0 msgr2=0x7f842c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.201+0000 7f844cc00700 1 --2- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f842c0396b0 0x7f842c03bb70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8434006fd0 tx=0x7f8434006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:11.826 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.201+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 msgr2=0x7f844819ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:11.827 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.201+0000 7f844cc00700 1 --2- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844819ec80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84380116e0 tx=0x7f8438011aa0 comp rx=0 tx=0).stop 2024-04-26T11:19:11.827 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.201+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 shutdown_connections 2024-04-26T11:19:11.827 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.201+0000 7f844cc00700 1 --2- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f842c0396b0 0x7f842c03bb70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:11.827 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.201+0000 7f844cc00700 1 --2- 172.21.15.110:0/2657329741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f844807ee90 0x7f844819ec80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:11.827 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.201+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 >> 172.21.15.110:0/2657329741 conn(0x7f8448104190 msgr2=0x7f8448104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:11.827 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.202+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 shutdown_connections 2024-04-26T11:19:11.827 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:11.202+0000 7f844cc00700 1 -- 172.21.15.110:0/2657329741 wait complete. 2024-04-26T11:19:13.490 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.427+0000 7f5780e00700 1 Processor -- start 2024-04-26T11:19:13.490 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.427+0000 7f5780e00700 1 -- start start 2024-04-26T11:19:13.490 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.428+0000 7f5780e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:13.490 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.428+0000 7f5780e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f577c112620 con 0x7f577c10fcf0 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.428+0000 7f5779e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.428+0000 7f5779e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43946/0 (socket says 172.21.15.110:43946) 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.428+0000 7f5779e00700 1 -- 172.21.15.110:0/1322564731 learned_addr learned my addr 172.21.15.110:0/1322564731 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.429+0000 7f5779e00700 1 -- 172.21.15.110:0/1322564731 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c1127a0 con 0x7f577c10fcf0 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.429+0000 7f5779e00700 1 --2- 172.21.15.110:0/1322564731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1120e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f576c0098a0 tx=0x7f576c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a66ad3eac7c254 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.429+0000 7f5778a00700 1 -- 172.21.15.110:0/1322564731 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c004160 con 0x7f577c10fcf0 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.429+0000 7f5778a00700 1 -- 172.21.15.110:0/1322564731 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f576c004300 con 0x7f577c10fcf0 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.430+0000 7f5778a00700 1 -- 172.21.15.110:0/1322564731 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c011a20 con 0x7f577c10fcf0 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.430+0000 7f5780e00700 1 -- 172.21.15.110:0/1322564731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 msgr2=0x7f577c1120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.430+0000 7f5780e00700 1 --2- 172.21.15.110:0/1322564731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1120e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f576c0098a0 tx=0x7f576c009bb0 comp rx=0 tx=0).stop 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.430+0000 7f5780e00700 1 -- 172.21.15.110:0/1322564731 shutdown_connections 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.430+0000 7f5780e00700 1 --2- 172.21.15.110:0/1322564731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1120e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:13.491 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.430+0000 7f5780e00700 1 -- 172.21.15.110:0/1322564731 >> 172.21.15.110:0/1322564731 conn(0x7f577c07e300 msgr2=0x7f577c080760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.430+0000 7f5780e00700 1 -- 172.21.15.110:0/1322564731 shutdown_connections 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.430+0000 7f5780e00700 1 -- 172.21.15.110:0/1322564731 wait complete. 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.431+0000 7f5780e00700 1 Processor -- start 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.432+0000 7f5780e00700 1 -- start start 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.432+0000 7f5780e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.432+0000 7f5780e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f577c113740 con 0x7f577c10fcf0 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.432+0000 7f5779e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.432+0000 7f5779e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1a32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43960/0 (socket says 172.21.15.110:43960) 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.432+0000 7f5779e00700 1 -- 172.21.15.110:0/2437370817 learned_addr learned my addr 172.21.15.110:0/2437370817 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.433+0000 7f5779e00700 1 -- 172.21.15.110:0/2437370817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c1a37e0 con 0x7f577c10fcf0 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.433+0000 7f5779e00700 1 --2- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1a32a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f576c004660 tx=0x7f576c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.433+0000 7f5772a00700 1 -- 172.21.15.110:0/2437370817 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c003aa0 con 0x7f577c10fcf0 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.433+0000 7f5772a00700 1 -- 172.21.15.110:0/2437370817 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f576c01b8f0 con 0x7f577c10fcf0 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.433+0000 7f5772a00700 1 -- 172.21.15.110:0/2437370817 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c023900 con 0x7f577c10fcf0 2024-04-26T11:19:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.433+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577c1a3a70 con 0x7f577c10fcf0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.433+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f577c1a6760 con 0x7f577c10fcf0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.434+0000 7f5772a00700 1 -- 172.21.15.110:0/2437370817 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f576c01baa0 con 0x7f577c10fcf0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.434+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f577c064a80 con 0x7f577c10fcf0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.435+0000 7f5772a00700 1 --2- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5760039700 0x7f576003bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.435+0000 7f5772a00700 1 -- 172.21.15.110:0/2437370817 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f576c04e000 con 0x7f577c10fcf0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.435+0000 7f5779400700 1 --2- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5760039700 0x7f576003bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.436+0000 7f5779400700 1 --2- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5760039700 0x7f576003bbc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5768006fd0 tx=0x7f5768006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.440+0000 7f5772a00700 1 -- 172.21.15.110:0/2437370817 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f576c01f030 con 0x7f577c10fcf0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.784+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f577c1a6d50 con 0x7f577c10fcf0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.789+0000 7f5772a00700 1 -- 172.21.15.110:0/2437370817 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f576c018350 con 0x7f577c10fcf0 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.792+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5760039700 msgr2=0x7f576003bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.792+0000 7f5780e00700 1 --2- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5760039700 0x7f576003bbc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5768006fd0 tx=0x7f5768006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.792+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 msgr2=0x7f577c1a32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:13.493 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.792+0000 7f5780e00700 1 --2- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1a32a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f576c004660 tx=0x7f576c011aa0 comp rx=0 tx=0).stop 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.792+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 shutdown_connections 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.792+0000 7f5780e00700 1 --2- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5760039700 0x7f576003bbc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.792+0000 7f5780e00700 1 --2- 172.21.15.110:0/2437370817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f577c10fcf0 0x7f577c1a32a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.792+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 >> 172.21.15.110:0/2437370817 conn(0x7f577c07e300 msgr2=0x7f577c07ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.793+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 shutdown_connections 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-04-26T11:19:12.793+0000 7f5780e00700 1 -- 172.21.15.110:0/2437370817 wait complete. 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout:Or, if you are only running a single cluster on this host: 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-26T11:19:13.494 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:13.495 INFO:teuthology.orchestra.run.smithi110.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-26T11:19:13.495 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:13.495 INFO:teuthology.orchestra.run.smithi110.stdout: ceph telemetry on 2024-04-26T11:19:13.495 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:13.495 INFO:teuthology.orchestra.run.smithi110.stdout:For more information see: 2024-04-26T11:19:13.495 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:13.495 INFO:teuthology.orchestra.run.smithi110.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-26T11:19:13.495 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:13.495 INFO:teuthology.orchestra.run.smithi110.stdout:Bootstrap complete. 2024-04-26T11:19:13.584 INFO:tasks.cephadm:Fetching config... 2024-04-26T11:19:13.584 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:19:13.584 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-26T11:19:13.630 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-26T11:19:13.630 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:19:13.631 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-26T11:19:13.714 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-26T11:19:13.714 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:19:13.715 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-26T11:19:13.829 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-26T11:19:13.830 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:19:13.830 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-26T11:19:13.925 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-26T11:19:13.926 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQhASfOqoEVR7eqsHNxz5C+R0YkyRla7p8Xt1U7GFwPYVPLkoe9wFs/E04S7EexAUgZgi+K+SEkLk/7Z/iLDF7gZleld/yoOaXFSr7MqiS4j+P/boI3bNge4E4w8trMr4DqCdROLBD5HOmQJa0+5gtT4Bx9uUZUELXOW4WZCes+RAfv88pGLSh8g3WGsNbEW4P74axMLpFmFoMJbg1P8xpKxKn29xJvowyTYNkoO3QQD+2RCIEzfFsSQ5zqBMqMkwHD5a3Ks4iBpiN/dK3IZQOuNwmiaFfXYPRuH/yR5E+zc+414NON4dMo+xT+dP5xzOAZ6Xm18FTwJ+rqxwErdoFjOUzh+QM9YI4LGNXFXyQwaPSVO/11yKPFPtFD4MH7/6OeB2RHEdOIGAj8UfLVYZFRk1kIVtfbysbT3xXeLMoVyjZvXfy9DA8ez5Vo5PFBNduS6qsLmbOOZxbElbce46tegrXUKUNji8Jy/JTxXtWC/GubdVI6lX4P72rRL7oVbc= ceph-6e439470-03be-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T11:19:14.025 INFO:teuthology.orchestra.run.smithi110.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQhASfOqoEVR7eqsHNxz5C+R0YkyRla7p8Xt1U7GFwPYVPLkoe9wFs/E04S7EexAUgZgi+K+SEkLk/7Z/iLDF7gZleld/yoOaXFSr7MqiS4j+P/boI3bNge4E4w8trMr4DqCdROLBD5HOmQJa0+5gtT4Bx9uUZUELXOW4WZCes+RAfv88pGLSh8g3WGsNbEW4P74axMLpFmFoMJbg1P8xpKxKn29xJvowyTYNkoO3QQD+2RCIEzfFsSQ5zqBMqMkwHD5a3Ks4iBpiN/dK3IZQOuNwmiaFfXYPRuH/yR5E+zc+414NON4dMo+xT+dP5xzOAZ6Xm18FTwJ+rqxwErdoFjOUzh+QM9YI4LGNXFXyQwaPSVO/11yKPFPtFD4MH7/6OeB2RHEdOIGAj8UfLVYZFRk1kIVtfbysbT3xXeLMoVyjZvXfy9DA8ez5Vo5PFBNduS6qsLmbOOZxbElbce46tegrXUKUNji8Jy/JTxXtWC/GubdVI6lX4P72rRL7oVbc= ceph-6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:19:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:13 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2437370817' entity='client.admin' 2024-04-26T11:19:14.056 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQhASfOqoEVR7eqsHNxz5C+R0YkyRla7p8Xt1U7GFwPYVPLkoe9wFs/E04S7EexAUgZgi+K+SEkLk/7Z/iLDF7gZleld/yoOaXFSr7MqiS4j+P/boI3bNge4E4w8trMr4DqCdROLBD5HOmQJa0+5gtT4Bx9uUZUELXOW4WZCes+RAfv88pGLSh8g3WGsNbEW4P74axMLpFmFoMJbg1P8xpKxKn29xJvowyTYNkoO3QQD+2RCIEzfFsSQ5zqBMqMkwHD5a3Ks4iBpiN/dK3IZQOuNwmiaFfXYPRuH/yR5E+zc+414NON4dMo+xT+dP5xzOAZ6Xm18FTwJ+rqxwErdoFjOUzh+QM9YI4LGNXFXyQwaPSVO/11yKPFPtFD4MH7/6OeB2RHEdOIGAj8UfLVYZFRk1kIVtfbysbT3xXeLMoVyjZvXfy9DA8ez5Vo5PFBNduS6qsLmbOOZxbElbce46tegrXUKUNji8Jy/JTxXtWC/GubdVI6lX4P72rRL7oVbc= ceph-6e439470-03be-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T11:19:14.098 INFO:teuthology.orchestra.run.smithi193.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQhASfOqoEVR7eqsHNxz5C+R0YkyRla7p8Xt1U7GFwPYVPLkoe9wFs/E04S7EexAUgZgi+K+SEkLk/7Z/iLDF7gZleld/yoOaXFSr7MqiS4j+P/boI3bNge4E4w8trMr4DqCdROLBD5HOmQJa0+5gtT4Bx9uUZUELXOW4WZCes+RAfv88pGLSh8g3WGsNbEW4P74axMLpFmFoMJbg1P8xpKxKn29xJvowyTYNkoO3QQD+2RCIEzfFsSQ5zqBMqMkwHD5a3Ks4iBpiN/dK3IZQOuNwmiaFfXYPRuH/yR5E+zc+414NON4dMo+xT+dP5xzOAZ6Xm18FTwJ+rqxwErdoFjOUzh+QM9YI4LGNXFXyQwaPSVO/11yKPFPtFD4MH7/6OeB2RHEdOIGAj8UfLVYZFRk1kIVtfbysbT3xXeLMoVyjZvXfy9DA8ez5Vo5PFBNduS6qsLmbOOZxbElbce46tegrXUKUNji8Jy/JTxXtWC/GubdVI6lX4P72rRL7oVbc= ceph-6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:19:14.110 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQhASfOqoEVR7eqsHNxz5C+R0YkyRla7p8Xt1U7GFwPYVPLkoe9wFs/E04S7EexAUgZgi+K+SEkLk/7Z/iLDF7gZleld/yoOaXFSr7MqiS4j+P/boI3bNge4E4w8trMr4DqCdROLBD5HOmQJa0+5gtT4Bx9uUZUELXOW4WZCes+RAfv88pGLSh8g3WGsNbEW4P74axMLpFmFoMJbg1P8xpKxKn29xJvowyTYNkoO3QQD+2RCIEzfFsSQ5zqBMqMkwHD5a3Ks4iBpiN/dK3IZQOuNwmiaFfXYPRuH/yR5E+zc+414NON4dMo+xT+dP5xzOAZ6Xm18FTwJ+rqxwErdoFjOUzh+QM9YI4LGNXFXyQwaPSVO/11yKPFPtFD4MH7/6OeB2RHEdOIGAj8UfLVYZFRk1kIVtfbysbT3xXeLMoVyjZvXfy9DA8ez5Vo5PFBNduS6qsLmbOOZxbElbce46tegrXUKUNji8Jy/JTxXtWC/GubdVI6lX4P72rRL7oVbc= ceph-6e439470-03be-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T11:19:14.152 INFO:teuthology.orchestra.run.smithi196.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQhASfOqoEVR7eqsHNxz5C+R0YkyRla7p8Xt1U7GFwPYVPLkoe9wFs/E04S7EexAUgZgi+K+SEkLk/7Z/iLDF7gZleld/yoOaXFSr7MqiS4j+P/boI3bNge4E4w8trMr4DqCdROLBD5HOmQJa0+5gtT4Bx9uUZUELXOW4WZCes+RAfv88pGLSh8g3WGsNbEW4P74axMLpFmFoMJbg1P8xpKxKn29xJvowyTYNkoO3QQD+2RCIEzfFsSQ5zqBMqMkwHD5a3Ks4iBpiN/dK3IZQOuNwmiaFfXYPRuH/yR5E+zc+414NON4dMo+xT+dP5xzOAZ6Xm18FTwJ+rqxwErdoFjOUzh+QM9YI4LGNXFXyQwaPSVO/11yKPFPtFD4MH7/6OeB2RHEdOIGAj8UfLVYZFRk1kIVtfbysbT3xXeLMoVyjZvXfy9DA8ez5Vo5PFBNduS6qsLmbOOZxbElbce46tegrXUKUNji8Jy/JTxXtWC/GubdVI6lX4P72rRL7oVbc= ceph-6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:19:14.164 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-26T11:19:14.579 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:19:17.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.083+0000 7ff596000700 1 -- 172.21.15.110:0/2982110031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 msgr2=0x7ff5901054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:17.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.083+0000 7ff596000700 1 --2- 172.21.15.110:0/2982110031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 0x7ff5901054c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff580009910 tx=0x7ff580009c20 comp rx=0 tx=0).stop 2024-04-26T11:19:17.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.083+0000 7ff596000700 1 -- 172.21.15.110:0/2982110031 shutdown_connections 2024-04-26T11:19:17.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.083+0000 7ff596000700 1 --2- 172.21.15.110:0/2982110031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 0x7ff5901054c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:17.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.083+0000 7ff596000700 1 -- 172.21.15.110:0/2982110031 >> 172.21.15.110:0/2982110031 conn(0x7ff590100640 msgr2=0x7ff590102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:17.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.083+0000 7ff596000700 1 -- 172.21.15.110:0/2982110031 shutdown_connections 2024-04-26T11:19:17.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.083+0000 7ff596000700 1 -- 172.21.15.110:0/2982110031 wait complete. 2024-04-26T11:19:17.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.084+0000 7ff596000700 1 Processor -- start 2024-04-26T11:19:17.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.084+0000 7ff596000700 1 -- start start 2024-04-26T11:19:17.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.085+0000 7ff596000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 0x7ff59019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.085+0000 7ff596000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff59010afe0 con 0x7ff5901050a0 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.085+0000 7ff58f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 0x7ff59019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.085+0000 7ff58f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 0x7ff59019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43964/0 (socket says 172.21.15.110:43964) 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.085+0000 7ff58f400700 1 -- 172.21.15.110:0/3136863078 learned_addr learned my addr 172.21.15.110:0/3136863078 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.085+0000 7ff58f400700 1 -- 172.21.15.110:0/3136863078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59019ac10 con 0x7ff5901050a0 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.086+0000 7ff58f400700 1 --2- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 0x7ff59019a6d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff580005800 tx=0x7ff580009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.086+0000 7ff587e00700 1 -- 172.21.15.110:0/3136863078 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff580027070 con 0x7ff5901050a0 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.086+0000 7ff587e00700 1 -- 172.21.15.110:0/3136863078 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff58000be10 con 0x7ff5901050a0 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.086+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59019aea0 con 0x7ff5901050a0 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.086+0000 7ff587e00700 1 -- 172.21.15.110:0/3136863078 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff58000f460 con 0x7ff5901050a0 2024-04-26T11:19:17.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.086+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff59019db90 con 0x7ff5901050a0 2024-04-26T11:19:17.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.087+0000 7ff587e00700 1 -- 172.21.15.110:0/3136863078 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7ff58002a070 con 0x7ff5901050a0 2024-04-26T11:19:17.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.087+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff59010b760 con 0x7ff5901050a0 2024-04-26T11:19:17.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.088+0000 7ff587e00700 1 --2- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5740396b0 0x7ff57403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:17.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.088+0000 7ff587e00700 1 -- 172.21.15.110:0/3136863078 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff58001e030 con 0x7ff5901050a0 2024-04-26T11:19:17.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.088+0000 7ff58ea00700 1 --2- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5740396b0 0x7ff57403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:17.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.089+0000 7ff58ea00700 1 --2- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5740396b0 0x7ff57403bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006fd0 tx=0x7ff57c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:17.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.094+0000 7ff587e00700 1 -- 172.21.15.110:0/3136863078 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff580013070 con 0x7ff5901050a0 2024-04-26T11:19:17.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.319+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7ff59002e5a0 con 0x7ff5901050a0 2024-04-26T11:19:17.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.324+0000 7ff587e00700 1 -- 172.21.15.110:0/3136863078 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7ff580031020 con 0x7ff5901050a0 2024-04-26T11:19:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.327+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5740396b0 msgr2=0x7ff57403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.327+0000 7ff596000700 1 --2- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5740396b0 0x7ff57403bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006fd0 tx=0x7ff57c006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.327+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 msgr2=0x7ff59019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.327+0000 7ff596000700 1 --2- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 0x7ff59019a6d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff580005800 tx=0x7ff580009f60 comp rx=0 tx=0).stop 2024-04-26T11:19:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.327+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 shutdown_connections 2024-04-26T11:19:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.327+0000 7ff596000700 1 --2- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5740396b0 0x7ff57403bb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.327+0000 7ff596000700 1 --2- 172.21.15.110:0/3136863078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5901050a0 0x7ff59019a6d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.327+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 >> 172.21.15.110:0/3136863078 conn(0x7ff590100640 msgr2=0x7ff590101110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.328+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 shutdown_connections 2024-04-26T11:19:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:17.328+0000 7ff596000700 1 -- 172.21.15.110:0/3136863078 wait complete. 2024-04-26T11:19:17.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:17.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:17.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi110", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:19:17.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:17.976 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:19:17.976 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:17.976 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:17 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3136863078' entity='client.admin' 2024-04-26T11:19:17.976 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:19:17.976 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:18.033 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-26T11:19:18.033 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-26T11:19:18.455 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:19:20.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.366+0000 7fd3c2600700 1 -- 172.21.15.110:0/3928166047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 msgr2=0x7fd3bc0758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:20.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.366+0000 7fd3c2600700 1 --2- 172.21.15.110:0/3928166047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 0x7fd3bc0758b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009910 tx=0x7fd3a0009c20 comp rx=0 tx=0).stop 2024-04-26T11:19:20.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.367+0000 7fd3c2600700 1 -- 172.21.15.110:0/3928166047 shutdown_connections 2024-04-26T11:19:20.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.367+0000 7fd3c2600700 1 --2- 172.21.15.110:0/3928166047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 0x7fd3bc0758b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:20.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.367+0000 7fd3c2600700 1 -- 172.21.15.110:0/3928166047 >> 172.21.15.110:0/3928166047 conn(0x7fd3bc0fe250 msgr2=0x7fd3bc100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:20.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.367+0000 7fd3c2600700 1 -- 172.21.15.110:0/3928166047 shutdown_connections 2024-04-26T11:19:20.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.367+0000 7fd3c2600700 1 -- 172.21.15.110:0/3928166047 wait complete. 2024-04-26T11:19:20.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.368+0000 7fd3c2600700 1 Processor -- start 2024-04-26T11:19:20.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.368+0000 7fd3c2600700 1 -- start start 2024-04-26T11:19:20.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.368+0000 7fd3c2600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 0x7fd3bc19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:20.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.368+0000 7fd3c2600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc10adf0 con 0x7fd3bc077450 2024-04-26T11:19:20.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.368+0000 7fd3c1200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 0x7fd3bc19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:20.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.368+0000 7fd3c1200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 0x7fd3bc19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43976/0 (socket says 172.21.15.110:43976) 2024-04-26T11:19:20.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.368+0000 7fd3c1200700 1 -- 172.21.15.110:0/2721648816 learned_addr learned my addr 172.21.15.110:0/2721648816 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:20.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.369+0000 7fd3c1200700 1 -- 172.21.15.110:0/2721648816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc19aa90 con 0x7fd3bc077450 2024-04-26T11:19:20.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.369+0000 7fd3c1200700 1 --2- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 0x7fd3bc19a550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0005950 tx=0x7fd3a0004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:20.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.369+0000 7fd3ba000700 1 -- 172.21.15.110:0/2721648816 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3a0026070 con 0x7fd3bc077450 2024-04-26T11:19:20.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.369+0000 7fd3ba000700 1 -- 172.21.15.110:0/2721648816 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3a000bc00 con 0x7fd3bc077450 2024-04-26T11:19:20.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.369+0000 7fd3ba000700 1 -- 172.21.15.110:0/2721648816 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3a0003a10 con 0x7fd3bc077450 2024-04-26T11:19:20.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.370+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3bc19ad20 con 0x7fd3bc077450 2024-04-26T11:19:20.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.370+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3bc19da10 con 0x7fd3bc077450 2024-04-26T11:19:20.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.371+0000 7fd3ba000700 1 -- 172.21.15.110:0/2721648816 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fd3a0029070 con 0x7fd3bc077450 2024-04-26T11:19:20.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.371+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3bc10b570 con 0x7fd3bc077450 2024-04-26T11:19:20.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.371+0000 7fd3ba000700 1 --2- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd3980396b0 0x7fd39803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:20.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.371+0000 7fd3ba000700 1 -- 172.21.15.110:0/2721648816 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd3a001e070 con 0x7fd3bc077450 2024-04-26T11:19:20.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.372+0000 7fd3b3e00700 1 --2- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd3980396b0 0x7fd39803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:20.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.373+0000 7fd3b3e00700 1 --2- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd3980396b0 0x7fd39803bb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8006fd0 tx=0x7fd3a8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:20.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.377+0000 7fd3ba000700 1 -- 172.21.15.110:0/2721648816 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd3a0013070 con 0x7fd3bc077450 2024-04-26T11:19:20.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.606+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fd3bc02e5a0 con 0x7fd3980396b0 2024-04-26T11:19:20.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.614+0000 7fd3ba000700 1 -- 172.21.15.110:0/2721648816 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd3bc02e5a0 con 0x7fd3980396b0 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd3980396b0 msgr2=0x7fd39803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 --2- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd3980396b0 0x7fd39803bb70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8006fd0 tx=0x7fd3a8006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 msgr2=0x7fd3bc19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 --2- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 0x7fd3bc19a550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0005950 tx=0x7fd3a0004fa0 comp rx=0 tx=0).stop 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 shutdown_connections 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 --2- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd3980396b0 0x7fd39803bb70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 --2- 172.21.15.110:0/2721648816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3bc077450 0x7fd3bc19a550 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 >> 172.21.15.110:0/2721648816 conn(0x7fd3bc0fe250 msgr2=0x7fd3bc0fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 shutdown_connections 2024-04-26T11:19:20.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:20.617+0000 7fd3c2600700 1 -- 172.21.15.110:0/2721648816 wait complete. 2024-04-26T11:19:21.403 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi193 2024-04-26T11:19:21.403 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:19:21.403 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.conf 2024-04-26T11:19:21.421 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:19:21.421 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:19:21.479 INFO:tasks.cephadm:Adding host smithi193 to orchestrator... 2024-04-26T11:19:21.479 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch host add smithi193 2024-04-26T11:19:21.888 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:19:22.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:21 smithi110 ceph-mon[28069]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:19:22.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:22.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:19:22.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:19:22.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:19:22.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:21 smithi110 ceph-mon[28069]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-26T11:19:22.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:21 smithi110 ceph-mon[28069]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:19:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:22 smithi110 ceph-mon[28069]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:19:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:22 smithi110 ceph-mon[28069]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:22 smithi110 ceph-mon[28069]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:19:23.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.848+0000 7f05d0a00700 1 -- 172.21.15.110:0/175040833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 msgr2=0x7f05cc101fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:23.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.848+0000 7f05d0a00700 1 --2- 172.21.15.110:0/175040833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 0x7f05cc101fb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009910 tx=0x7f05bc009c20 comp rx=0 tx=0).stop 2024-04-26T11:19:23.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.848+0000 7f05d0a00700 1 -- 172.21.15.110:0/175040833 shutdown_connections 2024-04-26T11:19:23.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.848+0000 7f05d0a00700 1 --2- 172.21.15.110:0/175040833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 0x7f05cc101fb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:23.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.848+0000 7f05d0a00700 1 -- 172.21.15.110:0/175040833 >> 172.21.15.110:0/175040833 conn(0x7f05cc0789f0 msgr2=0x7f05cc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:23.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.848+0000 7f05d0a00700 1 -- 172.21.15.110:0/175040833 shutdown_connections 2024-04-26T11:19:23.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.848+0000 7f05d0a00700 1 -- 172.21.15.110:0/175040833 wait complete. 2024-04-26T11:19:23.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.850+0000 7f05d0a00700 1 Processor -- start 2024-04-26T11:19:23.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.850+0000 7f05d0a00700 1 -- start start 2024-04-26T11:19:23.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.850+0000 7f05d0a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 0x7f05cc1a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:23.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.850+0000 7f05d0a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc10f540 con 0x7f05cc101bd0 2024-04-26T11:19:23.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.850+0000 7f05c9e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 0x7f05cc1a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:23.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.850+0000 7f05c9e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 0x7f05cc1a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57236/0 (socket says 172.21.15.110:57236) 2024-04-26T11:19:23.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.851+0000 7f05c9e00700 1 -- 172.21.15.110:0/1084568063 learned_addr learned my addr 172.21.15.110:0/1084568063 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:23.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.851+0000 7f05c9e00700 1 -- 172.21.15.110:0/1084568063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc1a0cd0 con 0x7f05cc101bd0 2024-04-26T11:19:23.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.851+0000 7f05c9e00700 1 --2- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 0x7f05cc1a0790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f05bc006010 tx=0x7f05bc005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:23.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.851+0000 7f05c3400700 1 -- 172.21.15.110:0/1084568063 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05bc026070 con 0x7f05cc101bd0 2024-04-26T11:19:23.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.852+0000 7f05c3400700 1 -- 172.21.15.110:0/1084568063 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05bc00bc00 con 0x7f05cc101bd0 2024-04-26T11:19:23.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.852+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05cc1a0f60 con 0x7f05cc101bd0 2024-04-26T11:19:23.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.852+0000 7f05c3400700 1 -- 172.21.15.110:0/1084568063 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05bc003910 con 0x7f05cc101bd0 2024-04-26T11:19:23.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.852+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05cc19a9a0 con 0x7f05cc101bd0 2024-04-26T11:19:23.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.853+0000 7f05c3400700 1 -- 172.21.15.110:0/1084568063 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f05bc029070 con 0x7f05cc101bd0 2024-04-26T11:19:23.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.853+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05cc06b0b0 con 0x7f05cc101bd0 2024-04-26T11:19:23.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.853+0000 7f05c3400700 1 --2- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f05b0039650 0x7f05b003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:23.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.853+0000 7f05c3400700 1 -- 172.21.15.110:0/1084568063 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f05bc01e070 con 0x7f05cc101bd0 2024-04-26T11:19:23.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.854+0000 7f05c1400700 1 --2- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f05b0039650 0x7f05b003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:23.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.854+0000 7f05c1400700 1 --2- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f05b0039650 0x7f05b003bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f05b4006fd0 tx=0x7f05b4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:23.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:23.859+0000 7f05c3400700 1 -- 172.21.15.110:0/1084568063 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f05bc013070 con 0x7f05cc101bd0 2024-04-26T11:19:24.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:24.090+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}) -- 0x7f05cc19be80 con 0x7f05b0039650 2024-04-26T11:19:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:24 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:24 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:24 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:25.369 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:25 smithi110 ceph-mon[28069]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi193", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:19:25.369 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:25 smithi110 ceph-mon[28069]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:26 smithi110 ceph-mon[28069]: Deploying cephadm binary to smithi193 2024-04-26T11:19:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:27 smithi110 ceph-mon[28069]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:28.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.773+0000 7f05c3400700 1 -- 172.21.15.110:0/1084568063 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f05cc19be80 con 0x7f05b0039650 2024-04-26T11:19:28.776 INFO:teuthology.orchestra.run.smithi110.stdout:Added host 'smithi193' with addr '172.21.15.193' 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.776+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f05b0039650 msgr2=0x7f05b003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.777+0000 7f05d0a00700 1 --2- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f05b0039650 0x7f05b003bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f05b4006fd0 tx=0x7f05b4006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.777+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 msgr2=0x7f05cc1a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.777+0000 7f05d0a00700 1 --2- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 0x7f05cc1a0790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f05bc006010 tx=0x7f05bc005780 comp rx=0 tx=0).stop 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.777+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 shutdown_connections 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.777+0000 7f05d0a00700 1 --2- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f05b0039650 0x7f05b003bb10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.777+0000 7f05d0a00700 1 --2- 172.21.15.110:0/1084568063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05cc101bd0 0x7f05cc1a0790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.777+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 >> 172.21.15.110:0/1084568063 conn(0x7f05cc0789f0 msgr2=0x7f05cc0fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.777+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 shutdown_connections 2024-04-26T11:19:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:28.777+0000 7f05d0a00700 1 -- 172.21.15.110:0/1084568063 wait complete. 2024-04-26T11:19:29.519 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:29 smithi110 ceph-mon[28069]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:29.519 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:29.520 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:19:29.520 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:29.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T11:19:30.006 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:19:30.404 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:30 smithi110 ceph-mon[28069]: Added host smithi193 2024-04-26T11:19:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:30 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:31.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:31 smithi110 ceph-mon[28069]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:32.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.063+0000 7f5e64600700 1 -- 172.21.15.110:0/701000059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 msgr2=0x7f5e5c103460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:32.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.063+0000 7f5e64600700 1 --2- 172.21.15.110:0/701000059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 0x7f5e5c103460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009910 tx=0x7f5e50009c20 comp rx=0 tx=0).stop 2024-04-26T11:19:32.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.064+0000 7f5e64600700 1 -- 172.21.15.110:0/701000059 shutdown_connections 2024-04-26T11:19:32.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.064+0000 7f5e64600700 1 --2- 172.21.15.110:0/701000059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 0x7f5e5c103460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:32.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.064+0000 7f5e64600700 1 -- 172.21.15.110:0/701000059 >> 172.21.15.110:0/701000059 conn(0x7f5e5c0fe910 msgr2=0x7f5e5c100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:32.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.064+0000 7f5e64600700 1 -- 172.21.15.110:0/701000059 shutdown_connections 2024-04-26T11:19:32.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.064+0000 7f5e64600700 1 -- 172.21.15.110:0/701000059 wait complete. 2024-04-26T11:19:32.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.065+0000 7f5e64600700 1 Processor -- start 2024-04-26T11:19:32.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.065+0000 7f5e64600700 1 -- start start 2024-04-26T11:19:32.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.065+0000 7f5e64600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 0x7f5e5c1a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:32.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.065+0000 7f5e64600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c10d300 con 0x7f5e5c103080 2024-04-26T11:19:32.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.065+0000 7f5e61c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 0x7f5e5c1a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:32.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.066+0000 7f5e61c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 0x7f5e5c1a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57258/0 (socket says 172.21.15.110:57258) 2024-04-26T11:19:32.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.066+0000 7f5e61c00700 1 -- 172.21.15.110:0/2373726358 learned_addr learned my addr 172.21.15.110:0/2373726358 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:32.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.066+0000 7f5e61c00700 1 -- 172.21.15.110:0/2373726358 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c1a0c50 con 0x7f5e5c103080 2024-04-26T11:19:32.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.066+0000 7f5e61c00700 1 --2- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 0x7f5e5c1a0710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e50006010 tx=0x7f5e50005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:32.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.066+0000 7f5e5a000700 1 -- 172.21.15.110:0/2373726358 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e50026070 con 0x7f5e5c103080 2024-04-26T11:19:32.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.066+0000 7f5e5a000700 1 -- 172.21.15.110:0/2373726358 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e5000bba0 con 0x7f5e5c103080 2024-04-26T11:19:32.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.066+0000 7f5e5a000700 1 -- 172.21.15.110:0/2373726358 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e50003910 con 0x7f5e5c103080 2024-04-26T11:19:32.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.067+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5c1a0f40 con 0x7f5e5c103080 2024-04-26T11:19:32.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.067+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5c19a8d0 con 0x7f5e5c103080 2024-04-26T11:19:32.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.068+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e5c104560 con 0x7f5e5c103080 2024-04-26T11:19:32.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.068+0000 7f5e5a000700 1 -- 172.21.15.110:0/2373726358 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f5e50029070 con 0x7f5e5c103080 2024-04-26T11:19:32.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.068+0000 7f5e5a000700 1 --2- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5e44039650 0x7f5e4403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:32.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.068+0000 7f5e5a000700 1 -- 172.21.15.110:0/2373726358 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5e5001e070 con 0x7f5e5c103080 2024-04-26T11:19:32.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.069+0000 7f5e61200700 1 --2- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5e44039650 0x7f5e4403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:32.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.069+0000 7f5e61200700 1 --2- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5e44039650 0x7f5e4403bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e48006fd0 tx=0x7f5e48006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:32.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.074+0000 7f5e5a000700 1 -- 172.21.15.110:0/2373726358 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5e50013070 con 0x7f5e5c103080 2024-04-26T11:19:32.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.304+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e5c19be00 con 0x7f5e44039650 2024-04-26T11:19:32.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.306+0000 7f5e5a000700 1 -- 172.21.15.110:0/2373726358 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f5e5c19be00 con 0x7f5e44039650 2024-04-26T11:19:32.308 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:32.308 INFO:teuthology.orchestra.run.smithi110.stdout:[{"addr": "172.21.15.110", "hostname": "smithi110", "labels": [], "status": ""}, {"addr": "172.21.15.193", "hostname": "smithi193", "labels": [], "status": ""}] 2024-04-26T11:19:32.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5e44039650 msgr2=0x7f5e4403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 --2- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5e44039650 0x7f5e4403bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e48006fd0 tx=0x7f5e48006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 msgr2=0x7f5e5c1a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 --2- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 0x7f5e5c1a0710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e50006010 tx=0x7f5e50005780 comp rx=0 tx=0).stop 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 shutdown_connections 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 --2- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5e44039650 0x7f5e4403bb10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 --2- 172.21.15.110:0/2373726358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e5c103080 0x7f5e5c1a0710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 >> 172.21.15.110:0/2373726358 conn(0x7f5e5c0fe910 msgr2=0x7f5e5c075650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 shutdown_connections 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:32.309+0000 7f5e64600700 1 -- 172.21.15.110:0/2373726358 wait complete. 2024-04-26T11:19:32.676 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:32.676 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:32 smithi110 ceph-mon[28069]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:19:32.676 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:32 smithi110 ceph-mon[28069]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:33.065 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi196 2024-04-26T11:19:33.065 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:19:33.065 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/etc/ceph/ceph.conf 2024-04-26T11:19:33.083 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:19:33.084 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:19:33.141 INFO:tasks.cephadm:Adding host smithi196 to orchestrator... 2024-04-26T11:19:33.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch host add smithi196 2024-04-26T11:19:33.570 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:19:35.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.557+0000 7f426a400700 1 -- 172.21.15.110:0/2792697170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 msgr2=0x7f42641043a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:35.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.557+0000 7f426a400700 1 --2- 172.21.15.110:0/2792697170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 0x7f42641043a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4254009910 tx=0x7f4254009c20 comp rx=0 tx=0).stop 2024-04-26T11:19:35.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.557+0000 7f426a400700 1 -- 172.21.15.110:0/2792697170 shutdown_connections 2024-04-26T11:19:35.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.557+0000 7f426a400700 1 --2- 172.21.15.110:0/2792697170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 0x7f42641043a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:35.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.557+0000 7f426a400700 1 -- 172.21.15.110:0/2792697170 >> 172.21.15.110:0/2792697170 conn(0x7f42640789f0 msgr2=0x7f42640ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:35.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.557+0000 7f426a400700 1 -- 172.21.15.110:0/2792697170 shutdown_connections 2024-04-26T11:19:35.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.557+0000 7f426a400700 1 -- 172.21.15.110:0/2792697170 wait complete. 2024-04-26T11:19:35.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.558+0000 7f426a400700 1 Processor -- start 2024-04-26T11:19:35.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.558+0000 7f426a400700 1 -- start start 2024-04-26T11:19:35.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.559+0000 7f426a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 0x7f4264101c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:35.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.559+0000 7f426a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f426410d360 con 0x7f4264103fc0 2024-04-26T11:19:35.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.559+0000 7f4263400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 0x7f4264101c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:35.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.559+0000 7f4263400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 0x7f4264101c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42672/0 (socket says 172.21.15.110:42672) 2024-04-26T11:19:35.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.559+0000 7f4263400700 1 -- 172.21.15.110:0/1281892374 learned_addr learned my addr 172.21.15.110:0/1281892374 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:35.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.560+0000 7f4263400700 1 -- 172.21.15.110:0/1281892374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4264103b10 con 0x7f4264103fc0 2024-04-26T11:19:35.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.560+0000 7f4263400700 1 --2- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 0x7f4264101c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4254006010 tx=0x7f4254005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:35.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.560+0000 7f4260c00700 1 -- 172.21.15.110:0/1281892374 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4254026070 con 0x7f4264103fc0 2024-04-26T11:19:35.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.560+0000 7f4260c00700 1 -- 172.21.15.110:0/1281892374 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f425400bc00 con 0x7f4264103fc0 2024-04-26T11:19:35.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.560+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4264102160 con 0x7f4264103fc0 2024-04-26T11:19:35.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.560+0000 7f4260c00700 1 -- 172.21.15.110:0/1281892374 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4254003910 con 0x7f4264103fc0 2024-04-26T11:19:35.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.560+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4264102620 con 0x7f4264103fc0 2024-04-26T11:19:35.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.561+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426406b130 con 0x7f4264103fc0 2024-04-26T11:19:35.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.562+0000 7f4260c00700 1 -- 172.21.15.110:0/1281892374 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f4254029070 con 0x7f4264103fc0 2024-04-26T11:19:35.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.562+0000 7f4260c00700 1 --2- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f42480396b0 0x7f424803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:35.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.562+0000 7f4260c00700 1 -- 172.21.15.110:0/1281892374 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f425401e070 con 0x7f4264103fc0 2024-04-26T11:19:35.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.562+0000 7f425aa00700 1 --2- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f42480396b0 0x7f424803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:35.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.563+0000 7f425aa00700 1 --2- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f42480396b0 0x7f424803bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f424c006fd0 tx=0x7f424c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:35.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.568+0000 7f4260c00700 1 -- 172.21.15.110:0/1281892374 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4254013070 con 0x7f4264103fc0 2024-04-26T11:19:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:35 smithi110 ceph-mon[28069]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:19:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:19:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:19:35.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:35.804+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}) -- 0x7f4264102850 con 0x7f42480396b0 2024-04-26T11:19:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:36 smithi110 ceph-mon[28069]: Updating smithi193:/etc/ceph/ceph.conf 2024-04-26T11:19:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:36 smithi110 ceph-mon[28069]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:19:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:36 smithi110 ceph-mon[28069]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:19:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:36 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:36 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:36 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:37 smithi110 ceph-mon[28069]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:19:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:37 smithi110 ceph-mon[28069]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:19:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:37 smithi110 ceph-mon[28069]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:37 smithi110 ceph-mon[28069]: Deploying cephadm binary to smithi196 2024-04-26T11:19:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:39 smithi110 ceph-mon[28069]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:40.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.494+0000 7f4260c00700 1 -- 172.21.15.110:0/1281892374 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f4264102850 con 0x7f42480396b0 2024-04-26T11:19:40.496 INFO:teuthology.orchestra.run.smithi110.stdout:Added host 'smithi196' with addr '172.21.15.196' 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f42480396b0 msgr2=0x7f424803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 --2- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f42480396b0 0x7f424803bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f424c006fd0 tx=0x7f424c006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 msgr2=0x7f4264101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 --2- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 0x7f4264101c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4254006010 tx=0x7f4254005780 comp rx=0 tx=0).stop 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 shutdown_connections 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 --2- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f42480396b0 0x7f424803bb70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 --2- 172.21.15.110:0/1281892374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4264103fc0 0x7f4264101c20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 >> 172.21.15.110:0/1281892374 conn(0x7f42640789f0 msgr2=0x7f4264104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 shutdown_connections 2024-04-26T11:19:40.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:40.498+0000 7f426a400700 1 -- 172.21.15.110:0/1281892374 wait complete. 2024-04-26T11:19:41.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T11:19:41.657 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:19:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:41 smithi110 ceph-mon[28069]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:41 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:41 smithi110 ceph-mon[28069]: Added host smithi196 2024-04-26T11:19:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:41 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:19:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:41 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:42 smithi110 ceph-mon[28069]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.616+0000 7fd11a400700 1 -- 172.21.15.110:0/4117755011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 msgr2=0x7fd114105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.616+0000 7fd11a400700 1 --2- 172.21.15.110:0/4117755011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 0x7fd114105650 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd104009910 tx=0x7fd104009c20 comp rx=0 tx=0).stop 2024-04-26T11:19:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.616+0000 7fd11a400700 1 -- 172.21.15.110:0/4117755011 shutdown_connections 2024-04-26T11:19:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.616+0000 7fd11a400700 1 --2- 172.21.15.110:0/4117755011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 0x7fd114105650 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.616+0000 7fd11a400700 1 -- 172.21.15.110:0/4117755011 >> 172.21.15.110:0/4117755011 conn(0x7fd114100b40 msgr2=0x7fd114102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.617+0000 7fd11a400700 1 -- 172.21.15.110:0/4117755011 shutdown_connections 2024-04-26T11:19:43.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.617+0000 7fd11a400700 1 -- 172.21.15.110:0/4117755011 wait complete. 2024-04-26T11:19:43.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.618+0000 7fd11a400700 1 Processor -- start 2024-04-26T11:19:43.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.618+0000 7fd11a400700 1 -- start start 2024-04-26T11:19:43.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.619+0000 7fd11a400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 0x7fd1141a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:43.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.619+0000 7fd11a400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd11410f4f0 con 0x7fd114105270 2024-04-26T11:19:43.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.619+0000 7fd113400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 0x7fd1141a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:43.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.619+0000 7fd113400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 0x7fd1141a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58336/0 (socket says 172.21.15.110:58336) 2024-04-26T11:19:43.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.619+0000 7fd113400700 1 -- 172.21.15.110:0/3307235690 learned_addr learned my addr 172.21.15.110:0/3307235690 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:43.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.620+0000 7fd113400700 1 -- 172.21.15.110:0/3307235690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1141a0c10 con 0x7fd114105270 2024-04-26T11:19:43.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.620+0000 7fd113400700 1 --2- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 0x7fd1141a06d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd104006010 tx=0x7fd104005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:43.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.620+0000 7fd10be00700 1 -- 172.21.15.110:0/3307235690 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd104026070 con 0x7fd114105270 2024-04-26T11:19:43.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.620+0000 7fd10be00700 1 -- 172.21.15.110:0/3307235690 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd10400bba0 con 0x7fd114105270 2024-04-26T11:19:43.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.620+0000 7fd10be00700 1 -- 172.21.15.110:0/3307235690 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd104003910 con 0x7fd114105270 2024-04-26T11:19:43.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.620+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1141a0f00 con 0x7fd114105270 2024-04-26T11:19:43.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.620+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11419a850 con 0x7fd114105270 2024-04-26T11:19:43.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.621+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd114106750 con 0x7fd114105270 2024-04-26T11:19:43.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.622+0000 7fd10be00700 1 -- 172.21.15.110:0/3307235690 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fd104029070 con 0x7fd114105270 2024-04-26T11:19:43.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.622+0000 7fd10be00700 1 --2- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd0f8039650 0x7fd0f803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:43.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.622+0000 7fd10be00700 1 -- 172.21.15.110:0/3307235690 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd10401e070 con 0x7fd114105270 2024-04-26T11:19:43.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.622+0000 7fd112a00700 1 --2- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd0f8039650 0x7fd0f803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:43.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.623+0000 7fd112a00700 1 --2- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd0f8039650 0x7fd0f803bb10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd100006fd0 tx=0x7fd100006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:43.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.628+0000 7fd10be00700 1 -- 172.21.15.110:0/3307235690 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd104013070 con 0x7fd114105270 2024-04-26T11:19:43.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.860+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd11419bd80 con 0x7fd0f8039650 2024-04-26T11:19:43.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.863+0000 7fd10be00700 1 -- 172.21.15.110:0/3307235690 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7fd11419bd80 con 0x7fd0f8039650 2024-04-26T11:19:43.864 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:19:43.864 INFO:teuthology.orchestra.run.smithi110.stdout:[{"addr": "172.21.15.110", "hostname": "smithi110", "labels": [], "status": ""}, {"addr": "172.21.15.193", "hostname": "smithi193", "labels": [], "status": ""}, {"addr": "172.21.15.196", "hostname": "smithi196", "labels": [], "status": ""}] 2024-04-26T11:19:43.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd0f8039650 msgr2=0x7fd0f803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:43.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 --2- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd0f8039650 0x7fd0f803bb10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd100006fd0 tx=0x7fd100006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:43.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 msgr2=0x7fd1141a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:43.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 --2- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 0x7fd1141a06d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd104006010 tx=0x7fd104005780 comp rx=0 tx=0).stop 2024-04-26T11:19:43.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 shutdown_connections 2024-04-26T11:19:43.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 --2- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd0f8039650 0x7fd0f803bb10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:43.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 --2- 172.21.15.110:0/3307235690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd114105270 0x7fd1141a06d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:43.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 >> 172.21.15.110:0/3307235690 conn(0x7fd114100b40 msgr2=0x7fd114106c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:43.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 shutdown_connections 2024-04-26T11:19:43.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:43.866+0000 7fd11a400700 1 -- 172.21.15.110:0/3307235690 wait complete. 2024-04-26T11:19:44.496 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:44.547 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-26T11:19:44.547 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-26T11:19:44.978 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:19:45.409 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:45 smithi110 ceph-mon[28069]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:19:45.410 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:45 smithi110 ceph-mon[28069]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:46.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.947+0000 7f06e3800700 1 -- 172.21.15.110:0/1886205393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 msgr2=0x7f06dc105670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:46.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.947+0000 7f06e3800700 1 --2- 172.21.15.110:0/1886205393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 0x7f06dc105670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009910 tx=0x7f06d0009c20 comp rx=0 tx=0).stop 2024-04-26T11:19:46.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.947+0000 7f06e3800700 1 -- 172.21.15.110:0/1886205393 shutdown_connections 2024-04-26T11:19:46.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.947+0000 7f06e3800700 1 --2- 172.21.15.110:0/1886205393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 0x7f06dc105670 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:46.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.947+0000 7f06e3800700 1 -- 172.21.15.110:0/1886205393 >> 172.21.15.110:0/1886205393 conn(0x7f06dc100b40 msgr2=0x7f06dc102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:46.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.947+0000 7f06e3800700 1 -- 172.21.15.110:0/1886205393 shutdown_connections 2024-04-26T11:19:46.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.947+0000 7f06e3800700 1 -- 172.21.15.110:0/1886205393 wait complete. 2024-04-26T11:19:46.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.948+0000 7f06e3800700 1 Processor -- start 2024-04-26T11:19:46.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.948+0000 7f06e3800700 1 -- start start 2024-04-26T11:19:46.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.949+0000 7f06e3800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 0x7f06dc1a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:46.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.949+0000 7f06e3800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc10f510 con 0x7f06dc105290 2024-04-26T11:19:46.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.949+0000 7f06e0e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 0x7f06dc1a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:46.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.949+0000 7f06e0e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 0x7f06dc1a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58352/0 (socket says 172.21.15.110:58352) 2024-04-26T11:19:46.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.949+0000 7f06e0e00700 1 -- 172.21.15.110:0/317228551 learned_addr learned my addr 172.21.15.110:0/317228551 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:19:46.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.949+0000 7f06e0e00700 1 -- 172.21.15.110:0/317228551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc1a0c30 con 0x7f06dc105290 2024-04-26T11:19:46.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.950+0000 7f06e0e00700 1 --2- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 0x7f06dc1a06f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06d0006010 tx=0x7f06d0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:46.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.950+0000 7f06d9600700 1 -- 172.21.15.110:0/317228551 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d0026070 con 0x7f06dc105290 2024-04-26T11:19:46.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.950+0000 7f06d9600700 1 -- 172.21.15.110:0/317228551 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06d000bba0 con 0x7f06dc105290 2024-04-26T11:19:46.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.950+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc1a0f20 con 0x7f06dc105290 2024-04-26T11:19:46.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.950+0000 7f06d9600700 1 -- 172.21.15.110:0/317228551 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d0003910 con 0x7f06dc105290 2024-04-26T11:19:46.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.950+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc19a8b0 con 0x7f06dc105290 2024-04-26T11:19:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.951+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06dc106770 con 0x7f06dc105290 2024-04-26T11:19:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.951+0000 7f06d9600700 1 -- 172.21.15.110:0/317228551 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f06d0029070 con 0x7f06dc105290 2024-04-26T11:19:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.952+0000 7f06d9600700 1 --2- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f06c40396b0 0x7f06c403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.952+0000 7f06d9600700 1 -- 172.21.15.110:0/317228551 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f06d001e070 con 0x7f06dc105290 2024-04-26T11:19:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.952+0000 7f06dbe00700 1 --2- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f06c40396b0 0x7f06c403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:46.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.953+0000 7f06dbe00700 1 --2- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f06c40396b0 0x7f06c403bb70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06c8006fd0 tx=0x7f06c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:46.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:46.957+0000 7f06d9600700 1 -- 172.21.15.110:0/317228551 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f06d0013070 con 0x7f06dc105290 2024-04-26T11:19:47.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.189+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f06dc19bde0 con 0x7f06dc105290 2024-04-26T11:19:47.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.415+0000 7f06d9600700 1 -- 172.21.15.110:0/317228551 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f06d00282c0 con 0x7f06dc105290 2024-04-26T11:19:47.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f06c40396b0 msgr2=0x7f06c403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 --2- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f06c40396b0 0x7f06c403bb70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06c8006fd0 tx=0x7f06c8006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 msgr2=0x7f06dc1a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 --2- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 0x7f06dc1a06f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06d0006010 tx=0x7f06d0005780 comp rx=0 tx=0).stop 2024-04-26T11:19:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 shutdown_connections 2024-04-26T11:19:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 --2- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f06c40396b0 0x7f06c403bb70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 --2- 172.21.15.110:0/317228551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06dc105290 0x7f06dc1a06f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 >> 172.21.15.110:0/317228551 conn(0x7f06dc100b40 msgr2=0x7f06dc106c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 shutdown_connections 2024-04-26T11:19:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:19:47.420+0000 7f06e3800700 1 -- 172.21.15.110:0/317228551 wait complete. 2024-04-26T11:19:47.423 INFO:teuthology.orchestra.run.smithi110.stderr:adjusted tunables profile to default 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-26T11:19:47.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:47 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/317228551' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T11:19:48.146 INFO:tasks.cephadm:Adding mon.a on smithi110 2024-04-26T11:19:48.146 INFO:tasks.cephadm:Adding mon.b on smithi193 2024-04-26T11:19:48.146 INFO:tasks.cephadm:Adding mon.c on smithi196 2024-04-26T11:19:48.146 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi110:172.21.15.110=a;smithi193:172.21.15.193=b;smithi196:172.21.15.196=c' 2024-04-26T11:19:48.373 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:19:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:48 smithi110 ceph-mon[28069]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:19:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:48 smithi110 ceph-mon[28069]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:19:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:48 smithi110 ceph-mon[28069]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:19:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:48 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/317228551' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T11:19:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:48 smithi110 ceph-mon[28069]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:19:48.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:48 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:48.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:48 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:48.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:48 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:49.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.765+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/2362570266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 msgr2=0x7f1d08103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:49.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.765+0000 7f1d0e6d1700 1 --2- 172.21.15.196:0/2362570266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 0x7f1d08103450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009910 tx=0x7f1cf8009c20 comp rx=0 tx=0).stop 2024-04-26T11:19:49.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.765+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/2362570266 shutdown_connections 2024-04-26T11:19:49.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.765+0000 7f1d0e6d1700 1 --2- 172.21.15.196:0/2362570266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 0x7f1d08103450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:49.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.765+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/2362570266 >> 172.21.15.196:0/2362570266 conn(0x7f1d080fe940 msgr2=0x7f1d08100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:49.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.765+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/2362570266 shutdown_connections 2024-04-26T11:19:49.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.765+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/2362570266 wait complete. 2024-04-26T11:19:49.767 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.766+0000 7f1d0e6d1700 1 Processor -- start 2024-04-26T11:19:49.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.766+0000 7f1d0e6d1700 1 -- start start 2024-04-26T11:19:49.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.766+0000 7f1d0e6d1700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 0x7f1d0819e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:49.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.766+0000 7f1d0e6d1700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0810d2f0 con 0x7f1d08103070 2024-04-26T11:19:49.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.767+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 0x7f1d0819e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:49.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.767+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 0x7f1d0819e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.196:59016/0 (socket says 172.21.15.196:59016) 2024-04-26T11:19:49.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.767+0000 7f1d07fff700 1 -- 172.21.15.196:0/3731632547 learned_addr learned my addr 172.21.15.196:0/3731632547 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:19:49.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.767+0000 7f1d07fff700 1 -- 172.21.15.196:0/3731632547 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0819eaf0 con 0x7f1d08103070 2024-04-26T11:19:49.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.768+0000 7f1d07fff700 1 --2- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 0x7f1d0819e5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80056d0 tx=0x7f1cf80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:49.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.768+0000 7f1d057fa700 1 -- 172.21.15.196:0/3731632547 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cf8026070 con 0x7f1d08103070 2024-04-26T11:19:49.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.768+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0819ede0 con 0x7f1d08103070 2024-04-26T11:19:49.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.768+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d08198850 con 0x7f1d08103070 2024-04-26T11:19:49.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.768+0000 7f1d057fa700 1 -- 172.21.15.196:0/3731632547 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf800bba0 con 0x7f1d08103070 2024-04-26T11:19:49.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.768+0000 7f1d057fa700 1 -- 172.21.15.196:0/3731632547 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cf8030060 con 0x7f1d08103070 2024-04-26T11:19:49.770 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.769+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf4005330 con 0x7f1d08103070 2024-04-26T11:19:49.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.770+0000 7f1d057fa700 1 -- 172.21.15.196:0/3731632547 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f1cf8029070 con 0x7f1d08103070 2024-04-26T11:19:49.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.771+0000 7f1d057fa700 1 --2- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1cf0039650 0x7f1cf003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:49.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.771+0000 7f1d057fa700 1 -- 172.21.15.196:0/3731632547 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1cf801e070 con 0x7f1d08103070 2024-04-26T11:19:49.772 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.771+0000 7f1d077fe700 1 --2- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1cf0039650 0x7f1cf003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:49.773 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.772+0000 7f1d077fe700 1 --2- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1cf0039650 0x7f1cf003bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc006fd0 tx=0x7f1cfc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:49.787 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.786+0000 7f1d057fa700 1 -- 172.21.15.196:0/3731632547 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1cf8013070 con 0x7f1d08103070 2024-04-26T11:19:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:49 smithi110 ceph-mon[28069]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:49.997 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:49.996+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi110:172.21.15.110=a;smithi193:172.21.15.193=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}) -- 0x7f1cf4000c80 con 0x7f1cf0039650 2024-04-26T11:19:50.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.011+0000 7f1d057fa700 1 -- 172.21.15.196:0/3731632547 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1cf4000c80 con 0x7f1cf0039650 2024-04-26T11:19:50.013 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mon update... 2024-04-26T11:19:50.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.013+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1cf0039650 msgr2=0x7f1cf003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:50.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.013+0000 7f1d0e6d1700 1 --2- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1cf0039650 0x7f1cf003bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc006fd0 tx=0x7f1cfc006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:50.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.013+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 msgr2=0x7f1d0819e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:50.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.013+0000 7f1d0e6d1700 1 --2- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 0x7f1d0819e5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80056d0 tx=0x7f1cf80057b0 comp rx=0 tx=0).stop 2024-04-26T11:19:50.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.014+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 shutdown_connections 2024-04-26T11:19:50.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.014+0000 7f1d0e6d1700 1 --2- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1cf0039650 0x7f1cf003bb10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:50.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.014+0000 7f1d0e6d1700 1 --2- 172.21.15.196:0/3731632547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d08103070 0x7f1d0819e5b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:50.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.014+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 >> 172.21.15.196:0/3731632547 conn(0x7f1d080fe940 msgr2=0x7f1d08104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:50.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.014+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 shutdown_connections 2024-04-26T11:19:50.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:50.014+0000 7f1d0e6d1700 1 -- 172.21.15.196:0/3731632547 wait complete. 2024-04-26T11:19:50.653 DEBUG:teuthology.orchestra.run.smithi193:mon.b> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mon.b.service 2024-04-26T11:19:50.656 DEBUG:teuthology.orchestra.run.smithi196:mon.c> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mon.c.service 2024-04-26T11:19:50.658 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T11:19:50.658 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T11:19:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi110:172.21.15.110=a;smithi193:172.21.15.193=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: Saving service mon spec with placement smithi110:172.21.15.110=a;smithi193:172.21.15.193=b;smithi196:172.21.15.196=c;count:3 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: Deploying daemon mon.c on smithi196 2024-04-26T11:19:51.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:51 smithi110 ceph-mon[28069]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:51.788 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:19:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:53 smithi110 ceph-mon[28069]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:54.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.426+0000 7f9815f6a700 1 -- 172.21.15.196:0/3448453166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 msgr2=0x7f9810108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:54.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.426+0000 7f9815f6a700 1 --2- 172.21.15.196:0/3448453166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 0x7f9810108170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9800009910 tx=0x7f9800009c20 comp rx=0 tx=0).stop 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.426+0000 7f9815f6a700 1 -- 172.21.15.196:0/3448453166 shutdown_connections 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.426+0000 7f9815f6a700 1 --2- 172.21.15.196:0/3448453166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 0x7f9810108170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.426+0000 7f9815f6a700 1 -- 172.21.15.196:0/3448453166 >> 172.21.15.196:0/3448453166 conn(0x7f9810078410 msgr2=0x7f9810078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.426+0000 7f9815f6a700 1 -- 172.21.15.196:0/3448453166 shutdown_connections 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.426+0000 7f9815f6a700 1 -- 172.21.15.196:0/3448453166 wait complete. 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.427+0000 7f9815f6a700 1 Processor -- start 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.427+0000 7f9815f6a700 1 -- start start 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.428+0000 7f9815f6a700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 0x7f981019e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.428+0000 7f9815f6a700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f981010c1f0 con 0x7f9810107d90 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.428+0000 7f980f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 0x7f981019e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.428+0000 7f980f7fe700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 0x7f981019e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.196:59040/0 (socket says 172.21.15.196:59040) 2024-04-26T11:19:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.428+0000 7f980f7fe700 1 -- 172.21.15.196:0/433494806 learned_addr learned my addr 172.21.15.196:0/433494806 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:19:54.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.429+0000 7f980f7fe700 1 -- 172.21.15.196:0/433494806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981019eb20 con 0x7f9810107d90 2024-04-26T11:19:54.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.429+0000 7f980f7fe700 1 --2- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 0x7f981019e5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98000056d0 tx=0x7f98000057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:54.431 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.430+0000 7f980cff9700 1 -- 172.21.15.196:0/433494806 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9800026070 con 0x7f9810107d90 2024-04-26T11:19:54.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.430+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981019ee10 con 0x7f9810107d90 2024-04-26T11:19:54.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.430+0000 7f980cff9700 1 -- 172.21.15.196:0/433494806 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f980000bba0 con 0x7f9810107d90 2024-04-26T11:19:54.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.430+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98101988d0 con 0x7f9810107d90 2024-04-26T11:19:54.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.430+0000 7f980cff9700 1 -- 172.21.15.196:0/433494806 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9800030060 con 0x7f9810107d90 2024-04-26T11:19:54.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.431+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9810103530 con 0x7f9810107d90 2024-04-26T11:19:54.432 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.431+0000 7f980cff9700 1 -- 172.21.15.196:0/433494806 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f9800029070 con 0x7f9810107d90 2024-04-26T11:19:54.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.431+0000 7f980cff9700 1 --2- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f97f8039650 0x7f97f803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:19:54.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.431+0000 7f980cff9700 1 -- 172.21.15.196:0/433494806 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f980001e070 con 0x7f9810107d90 2024-04-26T11:19:54.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.432+0000 7f980effd700 1 --2- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f97f8039650 0x7f97f803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:19:54.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.433+0000 7f980effd700 1 --2- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f97f8039650 0x7f97f803bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9804006fd0 tx=0x7f9804006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:19:54.448 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.446+0000 7f980cff9700 1 -- 172.21.15.196:0/433494806 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9800013070 con 0x7f9810107d90 2024-04-26T11:19:54.747 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.746+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f98100008d0 con 0x7f9810107d90 2024-04-26T11:19:54.748 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.747+0000 7f980cff9700 1 -- 172.21.15.196:0/433494806 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f9800004390 con 0x7f9810107d90 2024-04-26T11:19:54.748 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:19:54.748 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":1,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","modified":"2024-04-26T11:17:52.091691Z","created":"2024-04-26T11:17:52.091691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-26T11:19:54.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f97f8039650 msgr2=0x7f97f803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:54.750 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 --2- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f97f8039650 0x7f97f803bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9804006fd0 tx=0x7f9804006e40 comp rx=0 tx=0).stop 2024-04-26T11:19:54.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 msgr2=0x7f981019e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:19:54.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 --2- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 0x7f981019e5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98000056d0 tx=0x7f98000057b0 comp rx=0 tx=0).stop 2024-04-26T11:19:54.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 shutdown_connections 2024-04-26T11:19:54.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 --2- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f97f8039650 0x7f97f803bb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:54.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 --2- 172.21.15.196:0/433494806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9810107d90 0x7f981019e5e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:19:54.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 >> 172.21.15.196:0/433494806 conn(0x7f9810078410 msgr2=0x7f9810105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:19:54.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 shutdown_connections 2024-04-26T11:19:54.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:19:54.749+0000 7f9815f6a700 1 -- 172.21.15.196:0/433494806 wait complete. 2024-04-26T11:19:54.751 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 1 2024-04-26T11:19:54.821 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).mds e1 new map 2024-04-26T11:19:54.821 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout: e1 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout: legacy client fscid: -1 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout: 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout: No filesystems configured 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-26T11:19:54.822 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-26T11:19:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T11:19:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T11:19:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T11:19:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Added host smithi193 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Updating smithi193:/etc/ceph/ceph.conf 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Deploying cephadm binary to smithi196 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Added host smithi196 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:19:55.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:19:55.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:19:55.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-26T11:19:55.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/317228551' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T11:19:55.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:19:55.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:19:55.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:19:55.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/317228551' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi110:172.21.15.110=a;smithi193:172.21.15.193=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Saving service mon spec with placement smithi110:172.21.15.110=a;smithi193:172.21.15.193=b;smithi196:172.21.15.196=c;count:3 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:19:55.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:19:55.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:19:55.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:19:55.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: Deploying daemon mon.c on smithi196 2024-04-26T11:19:55.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:19:55.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 ceph-mon[32572]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-26T11:19:55.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 bash[32552]: c2ff0cfd646eb3946efd4caec4ad04d8f32ec2dd366522b6dcb84fa504819d39 2024-04-26T11:19:55.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:54 smithi196 systemd[1]: Started Ceph mon.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:19:56.410 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T11:19:56.411 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T11:19:56.654 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: mon.a calling monitor election 2024-04-26T11:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: mon.c calling monitor election 2024-04-26T11:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: monmap epoch 2 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: last_changed 2024-04-26T11:19:54.826757+0000 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: min_mon_release 19 (squid) 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: election_strategy: 1 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: fsmap 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: mgrmap e13: x(active, since 57s) 2024-04-26T11:20:00.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: overall HEALTH_OK 2024-04-26T11:20:00.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:00.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:00.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:00.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:00.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:19:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: mon.a calling monitor election 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: mon.c calling monitor election 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: monmap epoch 2 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: last_changed 2024-04-26T11:19:54.826757+0000 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: min_mon_release 19 (squid) 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: election_strategy: 1 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: fsmap 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: mgrmap e13: x(active, since 57s) 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: overall HEALTH_OK 2024-04-26T11:20:00.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:00.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:00.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:00.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:00.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:19:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:01.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.169+0000 7fd8fc617700 1 -- 172.21.15.196:0/2131802644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e00035c0 msgr2=0x7fd8e0005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:01.171 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.169+0000 7fd8fc617700 1 --2- 172.21.15.196:0/2131802644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e00035c0 0x7fd8e0005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4101d60 tx=0x7fd8f000feb0 comp rx=0 tx=0).stop 2024-04-26T11:20:01.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.170+0000 7fd8fc617700 1 -- 172.21.15.196:0/2131802644 shutdown_connections 2024-04-26T11:20:01.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.170+0000 7fd8fc617700 1 --2- 172.21.15.196:0/2131802644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e00035c0 0x7fd8e0005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:01.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.170+0000 7fd8fc617700 1 -- 172.21.15.196:0/2131802644 >> 172.21.15.196:0/2131802644 conn(0x7fd8f40fd960 msgr2=0x7fd8f40ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:01.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.170+0000 7fd8fc617700 1 -- 172.21.15.196:0/2131802644 shutdown_connections 2024-04-26T11:20:01.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.170+0000 7fd8fc617700 1 -- 172.21.15.196:0/2131802644 wait complete. 2024-04-26T11:20:01.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:00 smithi196 ceph-mon[32572]: Deploying daemon mon.b on smithi193 2024-04-26T11:20:01.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:00 smithi196 ceph-mon[32572]: overall HEALTH_OK 2024-04-26T11:20:01.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:00 smithi196 ceph-mon[32572]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:01.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:00 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.171+0000 7fd8fc617700 1 Processor -- start 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.171+0000 7fd8fc617700 1 -- start start 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.171+0000 7fd8fc617700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 0x7fd8f4197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.171+0000 7fd8fc617700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f4197aa0 0x7fd8f4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.171+0000 7fd8fc617700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4109d80 con 0x7fd8f4197aa0 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.171+0000 7fd8fc617700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f4109c00 con 0x7fd8e00035c0 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.171+0000 7fd8fa3b3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 0x7fd8f4197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.171+0000 7fd8fa3b3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 0x7fd8f4197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38276/0 (socket says 172.21.15.196:38276) 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.171+0000 7fd8fa3b3700 1 -- 172.21.15.196:0/1055270148 learned_addr learned my addr 172.21.15.196:0/1055270148 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.172+0000 7fd8fa3b3700 1 -- 172.21.15.196:0/1055270148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 msgr2=0x7fd8f4197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-26T11:20:01.174 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.172+0000 7fd8fa3b3700 1 -- 172.21.15.196:0/1055270148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 msgr2=0x7fd8f4197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T11:20:01.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.172+0000 7fd8fa3b3700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 0x7fd8f4197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T11:20:01.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.172+0000 7fd8fa3b3700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 0x7fd8f4197560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:20:01.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.172+0000 7fd8f9bb2700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f4197aa0 0x7fd8f4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:01.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.172+0000 7fd8f9bb2700 1 -- 172.21.15.196:0/1055270148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 msgr2=0x7fd8f4197560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:20:01.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.172+0000 7fd8f9bb2700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 0x7fd8f4197560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:01.175 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.173+0000 7fd8f9bb2700 1 -- 172.21.15.196:0/1055270148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f406c490 con 0x7fd8f4197aa0 2024-04-26T11:20:01.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.173+0000 7fd8f9bb2700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f4197aa0 0x7fd8f4197f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400b4d0 tx=0x7fd8e400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:01.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.173+0000 7fd8eb7fe700 1 -- 172.21.15.196:0/1055270148 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fd8e4011630 con 0x7fd8f4197aa0 2024-04-26T11:20:01.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.173+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f41a4bd0 con 0x7fd8f4197aa0 2024-04-26T11:20:01.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.173+0000 7fd8eb7fe700 1 -- 172.21.15.196:0/1055270148 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8e4011c80 con 0x7fd8f4197aa0 2024-04-26T11:20:01.176 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.173+0000 7fd8eb7fe700 1 -- 172.21.15.196:0/1055270148 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fd8e401ada0 con 0x7fd8f4197aa0 2024-04-26T11:20:01.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.173+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f41a5130 con 0x7fd8f4197aa0 2024-04-26T11:20:01.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.175+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f4103570 con 0x7fd8f4197aa0 2024-04-26T11:20:01.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.175+0000 7fd8eb7fe700 1 -- 172.21.15.196:0/1055270148 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fd8e4018020 con 0x7fd8f4197aa0 2024-04-26T11:20:01.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.175+0000 7fd8eb7fe700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd8d8039440 0x7fd8d803b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:01.177 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.175+0000 7fd8eb7fe700 1 -- 172.21.15.196:0/1055270148 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd8e404c260 con 0x7fd8f4197aa0 2024-04-26T11:20:01.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.176+0000 7fd8fa3b3700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd8d8039440 0x7fd8d803b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:01.178 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.177+0000 7fd8fa3b3700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd8d8039440 0x7fd8d803b900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000fa60 tx=0x7fd8f0005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:01.191 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.190+0000 7fd8eb7fe700 1 -- 172.21.15.196:0/1055270148 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd8e401f020 con 0x7fd8f4197aa0 2024-04-26T11:20:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:00 smithi110 ceph-mon[28069]: Deploying daemon mon.b on smithi193 2024-04-26T11:20:01.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:00 smithi110 ceph-mon[28069]: overall HEALTH_OK 2024-04-26T11:20:01.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:00 smithi110 ceph-mon[28069]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:01.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:00 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:01.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.478+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd8f41a5450 con 0x7fd8f4197aa0 2024-04-26T11:20:01.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.479+0000 7fd8eb7fe700 1 -- 172.21.15.196:0/1055270148 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7fd8e401a490 con 0x7fd8f4197aa0 2024-04-26T11:20:01.480 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:20:01.481 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":2,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","modified":"2024-04-26T11:19:54.826757Z","created":"2024-04-26T11:17:52.091691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T11:20:01.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd8d8039440 msgr2=0x7fd8d803b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:01.483 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd8d8039440 0x7fd8d803b900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000fa60 tx=0x7fd8f0005a90 comp rx=0 tx=0).stop 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f4197aa0 msgr2=0x7fd8f4197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f4197aa0 0x7fd8f4197f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400b4d0 tx=0x7fd8e400b890 comp rx=0 tx=0).stop 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 shutdown_connections 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd8d8039440 0x7fd8d803b900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8e00035c0 0x7fd8f4197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 --2- 172.21.15.196:0/1055270148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8f4197aa0 0x7fd8f4197f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 >> 172.21.15.196:0/1055270148 conn(0x7fd8f40fd960 msgr2=0x7fd8f40fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 shutdown_connections 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:01.481+0000 7fd8fc617700 1 -- 172.21.15.196:0/1055270148 wait complete. 2024-04-26T11:20:01.484 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 2 2024-04-26T11:20:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:01 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/1055270148' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T11:20:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:01 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/1055270148' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T11:20:03.050 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T11:20:03.051 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T11:20:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:02 smithi196 ceph-mon[32572]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:02 smithi110 ceph-mon[28069]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:03.423 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).mds e1 new map 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout: e1 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout: legacy client fscid: -1 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout: 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout: No filesystems configured 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-26T11:20:04.095 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-26T11:20:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Added host smithi193 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi193", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Updating smithi193:/etc/ceph/ceph.conf 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Deploying cephadm binary to smithi196 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Added host smithi196 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/317228551' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:20:04.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/317228551' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi110:172.21.15.110=a;smithi193:172.21.15.193=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Saving service mon spec with placement smithi110:172.21.15.110=a;smithi193:172.21.15.193=b;smithi196:172.21.15.196=c;count:3 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:04.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Deploying daemon mon.c on smithi196 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.a calling monitor election 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:04.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.c calling monitor election 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: monmap epoch 2 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: last_changed 2024-04-26T11:19:54.826757+0000 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: min_mon_release 19 (squid) 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: election_strategy: 1 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:20:04.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: fsmap 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mgrmap e13: x(active, since 57s) 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: overall HEALTH_OK 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: Deploying daemon mon.b on smithi193 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: overall HEALTH_OK 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.380 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:04.381 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/1055270148' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T11:20:04.381 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:04.381 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 ceph-mon[32782]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-26T11:20:04.381 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 bash[32762]: 0e5b352f22e2db45ce50cd7ed9249395ffb2f3dd76938031da83577dfa8f6005 2024-04-26T11:20:04.381 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:04 smithi193 systemd[1]: Started Ceph mon.b for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:20:09.221 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.219+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2303110025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0035c0 msgr2=0x7fe5bc005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.219+0000 7fe5d87a4700 1 --2- 172.21.15.196:0/2303110025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0035c0 0x7fe5bc005a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0102e70 tx=0x7fe5cc00fe60 comp rx=0 tx=0).stop 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.219+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2303110025 shutdown_connections 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.219+0000 7fe5d87a4700 1 --2- 172.21.15.196:0/2303110025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5bc0035c0 0x7fe5bc005a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.219+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2303110025 >> 172.21.15.196:0/2303110025 conn(0x7fe5d00fea30 msgr2=0x7fe5d0100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.219+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2303110025 shutdown_connections 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.219+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2303110025 wait complete. 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.220+0000 7fe5d87a4700 1 Processor -- start 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.220+0000 7fe5d87a4700 1 -- start start 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.220+0000 7fe5d87a4700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5bc0035c0 0x7fe5d0075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.220+0000 7fe5d87a4700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d0075c60 0x7fe5d00760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.220+0000 7fe5d87a4700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 0x7fe5d01a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:09.222 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.220+0000 7fe5d87a4700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d010ae30 con 0x7fe5d0075c60 2024-04-26T11:20:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.220+0000 7fe5d87a4700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d010acb0 con 0x7fe5bc0035c0 2024-04-26T11:20:09.223 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.220+0000 7fe5d87a4700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d010afb0 con 0x7fe5d01a4ce0 2024-04-26T11:20:09.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6d41700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 0x7fe5d01a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:09.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6d41700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 0x7fe5d01a70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:37390/0 (socket says 172.21.15.196:37390) 2024-04-26T11:20:09.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6d41700 1 -- 172.21.15.196:0/2628348338 learned_addr learned my addr 172.21.15.196:0/2628348338 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:20:09.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6540700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5bc0035c0 0x7fe5d0075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:09.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6d41700 1 -- 172.21.15.196:0/2628348338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 msgr2=0x7fe5d01a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-04-26T11:20:09.224 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6d41700 1 -- 172.21.15.196:0/2628348338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 msgr2=0x7fe5d01a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6d41700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 0x7fe5d01a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6d41700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 0x7fe5d01a70d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d5d3f700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d0075c60 0x7fe5d00760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6540700 1 -- 172.21.15.196:0/2628348338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5bc0035c0 msgr2=0x7fe5d0075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6540700 1 -- 172.21.15.196:0/2628348338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5bc0035c0 msgr2=0x7fe5d0075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6540700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5bc0035c0 0x7fe5d0075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d6540700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5bc0035c0 0x7fe5d0075720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d5d3f700 1 -- 172.21.15.196:0/2628348338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 msgr2=0x7fe5d01a70d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d5d3f700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 0x7fe5d01a70d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d5d3f700 1 -- 172.21.15.196:0/2628348338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5bc0035c0 msgr2=0x7fe5d0075720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d5d3f700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5bc0035c0 0x7fe5d0075720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.221+0000 7fe5d5d3f700 1 -- 172.21.15.196:0/2628348338 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d01a77a0 con 0x7fe5d0075c60 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.222+0000 7fe5d5d3f700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d0075c60 0x7fe5d00760e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000b550 tx=0x7fe5c000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:09.225 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.222+0000 7fe5c77fe700 1 -- 172.21.15.196:0/2628348338 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0004230 con 0x7fe5d0075c60 2024-04-26T11:20:09.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.222+0000 7fe5c77fe700 1 -- 172.21.15.196:0/2628348338 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5c00043d0 con 0x7fe5d0075c60 2024-04-26T11:20:09.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.222+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d01a7a90 con 0x7fe5d0075c60 2024-04-26T11:20:09.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.222+0000 7fe5c77fe700 1 -- 172.21.15.196:0/2628348338 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0011b70 con 0x7fe5d0075c60 2024-04-26T11:20:09.226 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.222+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d01a7fd0 con 0x7fe5d0075c60 2024-04-26T11:20:09.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.223+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d0064a80 con 0x7fe5d0075c60 2024-04-26T11:20:09.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.224+0000 7fe5c77fe700 1 -- 172.21.15.196:0/2628348338 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fe5c00036a0 con 0x7fe5d0075c60 2024-04-26T11:20:09.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.224+0000 7fe5c77fe700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe5b4039ae0 0x7fe5b403bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:09.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.224+0000 7fe5c77fe700 1 -- 172.21.15.196:0/2628348338 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe5c004c360 con 0x7fe5d0075c60 2024-04-26T11:20:09.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.224+0000 7fe5d6540700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe5b4039ae0 0x7fe5b403bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:09.227 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.225+0000 7fe5d6540700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe5b4039ae0 0x7fe5b403bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00fa10 tx=0x7fe5cc005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:09.234 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.233+0000 7fe5c77fe700 1 -- 172.21.15.196:0/2628348338 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe5c0010380 con 0x7fe5d0075c60 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: mon.c calling monitor election 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: mon.a calling monitor election 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: monmap epoch 3 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: last_changed 2024-04-26T11:20:04.099969+0000 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: min_mon_release 19 (squid) 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: election_strategy: 1 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-26T11:20:09.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: 2: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.b 2024-04-26T11:20:09.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: fsmap 2024-04-26T11:20:09.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:09.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: mgrmap e13: x(active, since 66s) 2024-04-26T11:20:09.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: overall HEALTH_OK 2024-04-26T11:20:09.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:09.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:09.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:09.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:09.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.524+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe5d01a83a0 con 0x7fe5d0075c60 2024-04-26T11:20:09.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.525+0000 7fe5c77fe700 1 -- 172.21.15.196:0/2628348338 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7fe5c0003990 con 0x7fe5d0075c60 2024-04-26T11:20:09.526 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-04-26T11:20:09.527 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":3,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","modified":"2024-04-26T11:20:04.099969Z","created":"2024-04-26T11:17:52.091691Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:3300","nonce":0},{"type":"v1","addr":"172.21.15.193:6789","nonce":0}]},"addr":"172.21.15.193:6789/0","public_addr":"172.21.15.193:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T11:20:09.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe5b4039ae0 msgr2=0x7fe5b403bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:09.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe5b4039ae0 0x7fe5b403bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00fa10 tx=0x7fe5cc005de0 comp rx=0 tx=0).stop 2024-04-26T11:20:09.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d0075c60 msgr2=0x7fe5d00760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:09.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d0075c60 0x7fe5d00760e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000b550 tx=0x7fe5c000b910 comp rx=0 tx=0).stop 2024-04-26T11:20:09.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 shutdown_connections 2024-04-26T11:20:09.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe5b4039ae0 0x7fe5b403bfa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:09.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5d01a4ce0 0x7fe5d01a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:09.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5bc0035c0 0x7fe5d0075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:09.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 --2- 172.21.15.196:0/2628348338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5d0075c60 0x7fe5d00760e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:09.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 >> 172.21.15.196:0/2628348338 conn(0x7fe5d00fea30 msgr2=0x7fe5d0106b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:09.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 shutdown_connections 2024-04-26T11:20:09.530 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:09.528+0000 7fe5d87a4700 1 -- 172.21.15.196:0/2628348338 wait complete. 2024-04-26T11:20:09.530 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 3 2024-04-26T11:20:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: mon.c calling monitor election 2024-04-26T11:20:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:20:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: mon.a calling monitor election 2024-04-26T11:20:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: monmap epoch 3 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: last_changed 2024-04-26T11:20:04.099969+0000 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: min_mon_release 19 (squid) 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: election_strategy: 1 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:20:09.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-26T11:20:09.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: 2: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.b 2024-04-26T11:20:09.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: fsmap 2024-04-26T11:20:09.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:09.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: mgrmap e13: x(active, since 66s) 2024-04-26T11:20:09.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: overall HEALTH_OK 2024-04-26T11:20:09.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:09.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:09.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:09.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:10.111 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-26T11:20:10.112 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-26T11:20:10.479 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:10.480 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:10 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/2628348338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T11:20:10.480 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:10.519 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:20:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:10 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/2628348338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T11:20:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mon.c calling monitor election 2024-04-26T11:20:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:20:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mon.a calling monitor election 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: monmap epoch 3 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: last_changed 2024-04-26T11:20:04.099969+0000 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: min_mon_release 19 (squid) 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: election_strategy: 1 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: 2: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.b 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: fsmap 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mgrmap e13: x(active, since 66s) 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: overall HEALTH_OK 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:11.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/2628348338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T11:20:11.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:12.034 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: mon.b calling monitor election 2024-04-26T11:20:12.034 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-26T11:20:12.034 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: Updating smithi193:/etc/ceph/ceph.conf 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: mon.b calling monitor election 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: mon.c calling monitor election 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: mon.a calling monitor election 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: monmap epoch 3 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: last_changed 2024-04-26T11:20:04.099969+0000 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: min_mon_release 19 (squid) 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: election_strategy: 1 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-26T11:20:12.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: 2: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.b 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: fsmap 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: mgrmap e13: x(active, since 68s) 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: overall HEALTH_OK 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.036 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: mon.b calling monitor election 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: Updating smithi193:/etc/ceph/ceph.conf 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: mon.b calling monitor election 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: mon.c calling monitor election 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: mon.a calling monitor election 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: monmap epoch 3 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: last_changed 2024-04-26T11:20:04.099969+0000 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: min_mon_release 19 (squid) 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: election_strategy: 1 2024-04-26T11:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: 2: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.b 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: fsmap 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: mgrmap e13: x(active, since 68s) 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: overall HEALTH_OK 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mon.b calling monitor election 2024-04-26T11:20:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: Updating smithi193:/etc/ceph/ceph.conf 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mon.b calling monitor election 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mon.c calling monitor election 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mon.a calling monitor election 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: monmap epoch 3 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: last_changed 2024-04-26T11:20:04.099969+0000 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: created 2024-04-26T11:17:52.091691+0000 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: min_mon_release 19 (squid) 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: election_strategy: 1 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-04-26T11:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: 2: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.b 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: fsmap 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: mgrmap e13: x(active, since 68s) 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: overall HEALTH_OK 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.511+0000 7fafee600700 1 -- 172.21.15.110:0/191140655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 msgr2=0x7fafe8075ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.511+0000 7fafee600700 1 --2- 172.21.15.110:0/191140655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 0x7fafe8075ba0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fafdc009910 tx=0x7fafdc009c20 comp rx=0 tx=0).stop 2024-04-26T11:20:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.511+0000 7fafee600700 1 -- 172.21.15.110:0/191140655 shutdown_connections 2024-04-26T11:20:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.511+0000 7fafee600700 1 --2- 172.21.15.110:0/191140655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 0x7fafe8075ba0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.511+0000 7fafee600700 1 -- 172.21.15.110:0/191140655 >> 172.21.15.110:0/191140655 conn(0x7fafe80fe770 msgr2=0x7fafe8100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.511+0000 7fafee600700 1 -- 172.21.15.110:0/191140655 shutdown_connections 2024-04-26T11:20:12.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.511+0000 7fafee600700 1 -- 172.21.15.110:0/191140655 wait complete. 2024-04-26T11:20:12.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.512+0000 7fafee600700 1 Processor -- start 2024-04-26T11:20:12.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.512+0000 7fafee600700 1 -- start start 2024-04-26T11:20:12.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafee600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 0x7fafe819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:12.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafee600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafe819f470 0x7fafe81a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:12.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafee600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafe81a3d40 0x7fafe81a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:12.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafee600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fafe8113790 con 0x7fafe80757c0 2024-04-26T11:20:12.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafee600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fafe8113610 con 0x7fafe81a3d40 2024-04-26T11:20:12.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafee600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fafe8113910 con 0x7fafe819f470 2024-04-26T11:20:12.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafed200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 0x7fafe819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:12.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafed200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 0x7fafe819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37780/0 (socket says 172.21.15.110:37780) 2024-04-26T11:20:12.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafed200700 1 -- 172.21.15.110:0/3542900203 learned_addr learned my addr 172.21.15.110:0/3542900203 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafe7e00700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafe819f470 0x7fafe81a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.513+0000 7fafedc00700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafe81a3d40 0x7fafe81a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafed200700 1 -- 172.21.15.110:0/3542900203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafe819f470 msgr2=0x7fafe81a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafed200700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafe819f470 0x7fafe81a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafed200700 1 -- 172.21.15.110:0/3542900203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafe81a3d40 msgr2=0x7fafe81a41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafed200700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafe81a3d40 0x7fafe81a41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafed200700 1 -- 172.21.15.110:0/3542900203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe81abab0 con 0x7fafe80757c0 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafedc00700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafe81a3d40 0x7fafe81a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafed200700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 0x7fafe819ef30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fafdc004f80 tx=0x7fafdc004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafe5600700 1 -- 172.21.15.110:0/3542900203 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc026070 con 0x7fafe80757c0 2024-04-26T11:20:12.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafe5600700 1 -- 172.21.15.110:0/3542900203 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafdc00b750 con 0x7fafe80757c0 2024-04-26T11:20:12.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.514+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe81abc80 con 0x7fafe80757c0 2024-04-26T11:20:12.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.515+0000 7fafe5600700 1 -- 172.21.15.110:0/3542900203 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc003950 con 0x7fafe80757c0 2024-04-26T11:20:12.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.515+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe81ac1b0 con 0x7fafe80757c0 2024-04-26T11:20:12.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.516+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe8064a80 con 0x7fafe80757c0 2024-04-26T11:20:12.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.516+0000 7fafe5600700 1 -- 172.21.15.110:0/3542900203 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fafdc029070 con 0x7fafe80757c0 2024-04-26T11:20:12.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.517+0000 7fafe5600700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fafd0039ae0 0x7fafd003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:12.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.517+0000 7fafe5600700 1 -- 172.21.15.110:0/3542900203 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fafdc04d510 con 0x7fafe80757c0 2024-04-26T11:20:12.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.517+0000 7fafe7e00700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fafd0039ae0 0x7fafd003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:12.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.518+0000 7fafe7e00700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fafd0039ae0 0x7fafd003bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009ad0 tx=0x7fafd4009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:12.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.523+0000 7fafe5600700 1 -- 172.21.15.110:0/3542900203 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fafdc013070 con 0x7fafe80757c0 2024-04-26T11:20:12.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.757+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fafe81ac480 con 0x7fafe80757c0 2024-04-26T11:20:12.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.757+0000 7fafe5600700 1 -- 172.21.15.110:0/3542900203 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7fafdc030090 con 0x7fafe80757c0 2024-04-26T11:20:12.759 INFO:teuthology.orchestra.run.smithi110.stdout:# minimal ceph.conf for 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:12.759 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-04-26T11:20:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:20:12.759 INFO:teuthology.orchestra.run.smithi110.stdout: mon_host = [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-04-26T11:20:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fafd0039ae0 msgr2=0x7fafd003bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fafd0039ae0 0x7fafd003bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009ad0 tx=0x7fafd4009210 comp rx=0 tx=0).stop 2024-04-26T11:20:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 msgr2=0x7fafe819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 0x7fafe819ef30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fafdc004f80 tx=0x7fafdc004fb0 comp rx=0 tx=0).stop 2024-04-26T11:20:12.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 shutdown_connections 2024-04-26T11:20:12.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafe81a3d40 0x7fafe81a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:12.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe80757c0 0x7fafe819ef30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:12.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fafd0039ae0 0x7fafd003bfa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:12.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 --2- 172.21.15.110:0/3542900203 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fafe819f470 0x7fafe81a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:12.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 >> 172.21.15.110:0/3542900203 conn(0x7fafe80fe770 msgr2=0x7fafe80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:12.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 shutdown_connections 2024-04-26T11:20:12.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:12.760+0000 7fafee600700 1 -- 172.21.15.110:0/3542900203 wait complete. 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T11:20:13.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:13.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T11:20:13.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:13.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: Reconfiguring daemon mon.a on smithi110 2024-04-26T11:20:13.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:12 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3542900203' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:13.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:13.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:13.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:13.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T11:20:13.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:13.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T11:20:13.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:13.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: Reconfiguring daemon mon.a on smithi110 2024-04-26T11:20:13.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:12 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3542900203' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:20:13.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:20:13.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:13.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:13.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T11:20:13.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:13.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T11:20:13.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:13.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: Reconfiguring daemon mon.a on smithi110 2024-04-26T11:20:13.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:12 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3542900203' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:13.429 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-26T11:20:13.430 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:20:13.430 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T11:20:13.499 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:20:13.499 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:20:13.605 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:20:13.605 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T11:20:13.637 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:20:13.637 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:20:13.704 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:20:13.704 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T11:20:13.735 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:20:13.736 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:20:13.803 INFO:tasks.cephadm:Adding mgr.x on smithi110 2024-04-26T11:20:13.803 INFO:tasks.cephadm:Adding mgr.y on smithi193 2024-04-26T11:20:13.804 INFO:tasks.cephadm:Adding mgr.z on smithi196 2024-04-26T11:20:13.804 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi110=x;smithi193=y;smithi196=z' 2024-04-26T11:20:14.073 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:20:15.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.433+0000 7fa088a01700 1 -- 172.21.15.196:0/1578248183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa084101ce0 msgr2=0x7fa084102100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:15.438 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.433+0000 7fa088a01700 1 --2- 172.21.15.196:0/1578248183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa084101ce0 0x7fa084102100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa078009910 tx=0x7fa078009c20 comp rx=0 tx=0).stop 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.434+0000 7fa088a01700 1 -- 172.21.15.196:0/1578248183 shutdown_connections 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.434+0000 7fa088a01700 1 --2- 172.21.15.196:0/1578248183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa084101ce0 0x7fa084102100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.434+0000 7fa088a01700 1 -- 172.21.15.196:0/1578248183 >> 172.21.15.196:0/1578248183 conn(0x7fa0840fd280 msgr2=0x7fa0840ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.434+0000 7fa088a01700 1 -- 172.21.15.196:0/1578248183 shutdown_connections 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.434+0000 7fa088a01700 1 -- 172.21.15.196:0/1578248183 wait complete. 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.434+0000 7fa088a01700 1 Processor -- start 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa088a01700 1 -- start start 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa088a01700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa084101ce0 0x7fa084197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa088a01700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa084197980 0x7fa08419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa088a01700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa084197e00 0x7fa08419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:15.439 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa088a01700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa084107c20 con 0x7fa084197e00 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa088a01700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa084107aa0 con 0x7fa084101ce0 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa088a01700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa084107da0 con 0x7fa084197980 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08259c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa084197980 0x7fa08419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08259c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa084197980 0x7fa08419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:37396/0 (socket says 172.21.15.196:37396) 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08259c700 1 -- 172.21.15.196:0/1138603363 learned_addr learned my addr 172.21.15.196:0/1138603363 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa082d9d700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa084101ce0 0x7fa084197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08359e700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa084197e00 0x7fa08419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08259c700 1 -- 172.21.15.196:0/1138603363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa084101ce0 msgr2=0x7fa084197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08259c700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa084101ce0 0x7fa084197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08259c700 1 -- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa084197e00 msgr2=0x7fa08419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08259c700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa084197e00 0x7fa08419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:15.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08259c700 1 -- 172.21.15.196:0/1138603363 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08419f850 con 0x7fa084197980 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.435+0000 7fa08259c700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa084197980 0x7fa08419c9f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa07400b780 tx=0x7fa07400ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.436+0000 7fa06bfff700 1 -- 172.21.15.196:0/1138603363 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074004230 con 0x7fa084197980 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.436+0000 7fa06bfff700 1 -- 172.21.15.196:0/1138603363 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0740043d0 con 0x7fa084197980 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.436+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08419fb40 con 0x7fa084197980 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.436+0000 7fa06bfff700 1 -- 172.21.15.196:0/1138603363 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074011ad0 con 0x7fa084197980 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.436+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0841a0100 con 0x7fa084197980 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.436+0000 7fa06bfff700 1 -- 172.21.15.196:0/1138603363 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fa074011c70 con 0x7fa084197980 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.437+0000 7fa06bfff700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa06c039ae0 0x7fa06c03bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.437+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa084064a80 con 0x7fa084197980 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.437+0000 7fa06bfff700 1 -- 172.21.15.196:0/1138603363 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa07404c3c0 con 0x7fa084197980 2024-04-26T11:20:15.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.437+0000 7fa082d9d700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa06c039ae0 0x7fa06c03bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:15.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.438+0000 7fa082d9d700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa06c039ae0 0x7fa06c03bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa078005190 tx=0x7fa07801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:15.443 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.442+0000 7fa06bfff700 1 -- 172.21.15.196:0/1138603363 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa0740151c0 con 0x7fa084197980 2024-04-26T11:20:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:15 smithi196 ceph-mon[32572]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:15.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:15.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:15.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:15.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T11:20:15.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:15.653 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.652+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi110=x;smithi193=y;smithi196=z", "target": ["mon-mgr", ""]}) -- 0x7fa084063860 con 0x7fa06c039ae0 2024-04-26T11:20:15.664 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:15 smithi193 ceph-mon[32782]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:15.664 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:15.664 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:15.664 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:15.664 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T11:20:15.664 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:15.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.666+0000 7fa06bfff700 1 -- 172.21.15.196:0/1138603363 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa084063860 con 0x7fa06c039ae0 2024-04-26T11:20:15.667 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mgr update... 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa06c039ae0 msgr2=0x7fa06c03bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa06c039ae0 0x7fa06c03bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa078005190 tx=0x7fa07801a040 comp rx=0 tx=0).stop 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa084197980 msgr2=0x7fa08419c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa084197980 0x7fa08419c9f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa07400b780 tx=0x7fa07400ba90 comp rx=0 tx=0).stop 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 shutdown_connections 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa084197e00 0x7fa08419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa084101ce0 0x7fa084197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa06c039ae0 0x7fa06c03bfa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 --2- 172.21.15.196:0/1138603363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa084197980 0x7fa08419c9f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:15.670 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 >> 172.21.15.196:0/1138603363 conn(0x7fa0840fd280 msgr2=0x7fa0840fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:15.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 shutdown_connections 2024-04-26T11:20:15.671 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:20:15.668+0000 7fa088a01700 1 -- 172.21.15.196:0/1138603363 wait complete. 2024-04-26T11:20:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:15 smithi110 ceph-mon[28069]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T11:20:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:16.267 DEBUG:teuthology.orchestra.run.smithi193:mgr.y> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mgr.y.service 2024-04-26T11:20:16.270 DEBUG:teuthology.orchestra.run.smithi196:mgr.z> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mgr.z.service 2024-04-26T11:20:16.272 INFO:tasks.cephadm:Deploying OSDs... 2024-04-26T11:20:16.273 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:20:16.273 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:20:16.329 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:20:16.329 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-04-26T11:20:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:20:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:16.380 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-26T11:20:16.380 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:16.380 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:16.381 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-26 11:19:15.138072311 +0000 2024-04-26T11:20:16.381 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-26 11:13:45.827551968 +0000 2024-04-26T11:20:16.381 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-26 11:13:45.827551968 +0000 2024-04-26T11:20:16.381 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-26 11:13:45.827551968 +0000 2024-04-26T11:20:16.381 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:20:16.460 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-26T11:20:16.460 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-26T11:20:16.460 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000255199 s, 2.0 MB/s 2024-04-26T11:20:16.463 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:20:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:16 smithi196 ceph-mon[32572]: Reconfiguring mon.b (monmap changed)... 2024-04-26T11:20:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:16 smithi196 ceph-mon[32572]: Reconfiguring daemon mon.b on smithi193 2024-04-26T11:20:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:16 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:16.522 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-04-26T11:20:16.572 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:20:16.572 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:16.572 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-26T11:20:16.572 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:16.572 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:16.572 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-26 11:19:15.192071410 +0000 2024-04-26T11:20:16.572 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-26 11:13:46.381542995 +0000 2024-04-26T11:20:16.572 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-26 11:13:46.381542995 +0000 2024-04-26T11:20:16.572 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-26 11:13:46.381542995 +0000 2024-04-26T11:20:16.573 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:20:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:16 smithi193 ceph-mon[32782]: Reconfiguring mon.b (monmap changed)... 2024-04-26T11:20:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:16 smithi193 ceph-mon[32782]: Reconfiguring daemon mon.b on smithi193 2024-04-26T11:20:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:16 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:16.646 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-26T11:20:16.646 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-26T11:20:16.646 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000272787 s, 1.9 MB/s 2024-04-26T11:20:16.649 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:20:16.706 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-04-26T11:20:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:20:16.755 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:16.755 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-26T11:20:16.755 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:16.755 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:16.755 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-26 11:19:15.248070475 +0000 2024-04-26T11:20:16.755 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-26 11:13:46.967533503 +0000 2024-04-26T11:20:16.756 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-26 11:13:46.967533503 +0000 2024-04-26T11:20:16.756 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-26 11:13:46.967533503 +0000 2024-04-26T11:20:16.756 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:20:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:16 smithi110 ceph-mon[28069]: Reconfiguring mon.b (monmap changed)... 2024-04-26T11:20:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:16 smithi110 ceph-mon[28069]: Reconfiguring daemon mon.b on smithi193 2024-04-26T11:20:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:16 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:16.828 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-26T11:20:16.828 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-26T11:20:16.828 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000250413 s, 2.0 MB/s 2024-04-26T11:20:16.831 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:20:16.930 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-04-26T11:20:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:20:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:16.980 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-26T11:20:16.980 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:16.980 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:16.980 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-04-26 11:19:15.306069507 +0000 2024-04-26T11:20:16.980 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-04-26 11:13:47.571523721 +0000 2024-04-26T11:20:16.980 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-04-26 11:13:47.571523721 +0000 2024-04-26T11:20:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-04-26 11:13:47.571523721 +0000 2024-04-26T11:20:16.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:20:17.056 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-04-26T11:20:17.056 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-04-26T11:20:17.057 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000279658 s, 1.8 MB/s 2024-04-26T11:20:17.060 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:20:17.114 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-04-26T11:20:17.115 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:20:17.133 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:20:17.133 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-04-26T11:20:17.189 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:20:17.189 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:17.190 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T11:20:17.190 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:17.190 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:17.190 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-04-26 11:20:03.549370055 +0000 2024-04-26T11:20:17.190 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-04-26 11:12:10.516892643 +0000 2024-04-26T11:20:17.190 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-04-26 11:12:10.516892643 +0000 2024-04-26T11:20:17.190 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-04-26 11:12:10.516892643 +0000 2024-04-26T11:20:17.190 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:20:17.255 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-04-26T11:20:17.255 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-04-26T11:20:17.255 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000250612 s, 2.0 MB/s 2024-04-26T11:20:17.256 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:20:17.314 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-04-26T11:20:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:20:17.370 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:17.370 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-26T11:20:17.370 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:17.370 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:17.370 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-04-26 11:20:03.549370055 +0000 2024-04-26T11:20:17.370 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-04-26 11:12:10.875886925 +0000 2024-04-26T11:20:17.370 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-04-26 11:12:10.875886925 +0000 2024-04-26T11:20:17.371 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-04-26 11:12:10.875886925 +0000 2024-04-26T11:20:17.371 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:20:17.433 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-04-26T11:20:17.433 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-04-26T11:20:17.433 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000250372 s, 2.0 MB/s 2024-04-26T11:20:17.434 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:20:17.491 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-04-26T11:20:17.546 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:20:17.546 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:17.546 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-26T11:20:17.546 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:17.546 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:17.546 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-04-26 11:20:03.549370055 +0000 2024-04-26T11:20:17.546 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-04-26 11:12:11.234881206 +0000 2024-04-26T11:20:17.546 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-04-26 11:12:11.234881206 +0000 2024-04-26T11:20:17.546 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-04-26 11:12:11.234881206 +0000 2024-04-26T11:20:17.547 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:20:17.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi110=x;smithi193=y;smithi196=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:17.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: Saving service mgr spec with placement smithi110=x;smithi193=y;smithi196=z;count:3 2024-04-26T11:20:17.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:17.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:17.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:17.607 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: Reconfiguring mon.c (monmap changed)... 2024-04-26T11:20:17.607 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:17.607 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T11:20:17.607 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:17.607 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:17 smithi193 ceph-mon[32782]: Reconfiguring daemon mon.c on smithi196 2024-04-26T11:20:17.608 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-04-26T11:20:17.608 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-04-26T11:20:17.608 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000213685 s, 2.4 MB/s 2024-04-26T11:20:17.609 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi110=x;smithi193=y;smithi196=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: Saving service mgr spec with placement smithi110=x;smithi193=y;smithi196=z;count:3 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: Reconfiguring mon.c (monmap changed)... 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:17.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:17 smithi196 ceph-mon[32572]: Reconfiguring daemon mon.c on smithi196 2024-04-26T11:20:17.665 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-04-26T11:20:17.721 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:20:17.721 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:17.721 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-26T11:20:17.721 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:17.721 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:17.721 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-04-26 11:20:03.550370039 +0000 2024-04-26T11:20:17.721 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-04-26 11:12:11.572875822 +0000 2024-04-26T11:20:17.721 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-04-26 11:12:11.572875822 +0000 2024-04-26T11:20:17.721 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-04-26 11:12:11.572875822 +0000 2024-04-26T11:20:17.722 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:20:17.783 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-04-26T11:20:17.783 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-04-26T11:20:17.783 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000234153 s, 2.2 MB/s 2024-04-26T11:20:17.784 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi110=x;smithi193=y;smithi196=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: Saving service mgr spec with placement smithi110=x;smithi193=y;smithi196=z;count:3 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: Reconfiguring mon.c (monmap changed)... 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:17 smithi110 ceph-mon[28069]: Reconfiguring daemon mon.c on smithi196 2024-04-26T11:20:17.840 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-04-26T11:20:17.840 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:20:17.856 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:20:17.857 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-04-26T11:20:17.913 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:20:17.914 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:17.914 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-26T11:20:17.914 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:17.914 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:17.914 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-26 11:19:53.928553320 +0000 2024-04-26T11:20:17.914 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-26 11:12:12.939965853 +0000 2024-04-26T11:20:17.914 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-26 11:12:12.939965853 +0000 2024-04-26T11:20:17.914 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-26 11:12:12.939965853 +0000 2024-04-26T11:20:17.914 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:20:17.977 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-26T11:20:17.977 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-26T11:20:17.977 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000210447 s, 2.4 MB/s 2024-04-26T11:20:17.978 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:20:18.035 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-04-26T11:20:18.089 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:20:18.090 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:18.090 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-26T11:20:18.090 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:18.090 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:18.090 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-26 11:19:53.929553298 +0000 2024-04-26T11:20:18.090 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-26 11:12:13.279958314 +0000 2024-04-26T11:20:18.090 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-26 11:12:13.279958314 +0000 2024-04-26T11:20:18.090 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-26 11:12:13.279958314 +0000 2024-04-26T11:20:18.090 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:20:18.152 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-26T11:20:18.152 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-26T11:20:18.152 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000197054 s, 2.6 MB/s 2024-04-26T11:20:18.153 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:20:18.209 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-04-26T11:20:18.265 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:20:18.265 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:18.265 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T11:20:18.265 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:18.265 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:18.266 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-26 11:19:53.930553276 +0000 2024-04-26T11:20:18.266 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-26 11:12:13.630950530 +0000 2024-04-26T11:20:18.266 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-26 11:12:13.630950530 +0000 2024-04-26T11:20:18.266 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-26 11:12:13.630950530 +0000 2024-04-26T11:20:18.266 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:20:18.329 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-26T11:20:18.329 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-26T11:20:18.329 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000258245 s, 2.0 MB/s 2024-04-26T11:20:18.331 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:20:18.390 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-04-26T11:20:18.445 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:20:18.445 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:20:18.445 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-26T11:20:18.445 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:20:18.445 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:20:18.445 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-04-26 11:19:53.930553276 +0000 2024-04-26T11:20:18.445 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-04-26 11:12:13.958943256 +0000 2024-04-26T11:20:18.445 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-04-26 11:12:13.958943256 +0000 2024-04-26T11:20:18.445 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-04-26 11:12:13.958943256 +0000 2024-04-26T11:20:18.445 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:20:18.511 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-04-26T11:20:18.511 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-04-26T11:20:18.511 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000171075 s, 3.0 MB/s 2024-04-26T11:20:18.513 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:20:18.569 INFO:tasks.cephadm:Deploying osd.0 on smithi110 with /dev/vg_nvme/lv_4... 2024-04-26T11:20:18.569 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T11:20:19.001 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:20:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: Deploying daemon mgr.z on smithi196 2024-04-26T11:20:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:18 smithi196 ceph-mon[32572]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:19.279 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:19.279 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:19.279 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:19.280 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:19.280 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:19.280 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:19.280 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T11:20:19.280 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T11:20:19.280 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T11:20:19.280 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:19.280 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: Deploying daemon mgr.z on smithi196 2024-04-26T11:20:19.280 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:18 smithi110 ceph-mon[28069]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T11:20:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T11:20:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T11:20:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: Deploying daemon mgr.z on smithi196 2024-04-26T11:20:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:18 smithi193 ceph-mon[32782]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:20.221 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:19 smithi196 systemd[1]: Starting Ceph mgr.z for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:20:20.506 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 podman[34434]: 2024-04-26 11:20:20.137680208 +0000 UTC m=+0.035757557 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:20:20.506 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 podman[34434]: 2024-04-26 11:20:20.281460039 +0000 UTC m=+0.179537375 container create fe8e86aa0044c5b89518b26e9998e936951db98fcbe2e5d70236b2b788589864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T11:20:20.820 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 podman[34434]: 2024-04-26 11:20:20.517044215 +0000 UTC m=+0.415121551 container init fe8e86aa0044c5b89518b26e9998e936951db98fcbe2e5d70236b2b788589864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-26T11:20:20.821 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 podman[34434]: 2024-04-26 11:20:20.51976014 +0000 UTC m=+0.417837477 container start fe8e86aa0044c5b89518b26e9998e936951db98fcbe2e5d70236b2b788589864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T11:20:20.821 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 ceph-mgr[34454]: -- 172.21.15.196:0/988147462 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5613fbfc45a0 con 0x5613fbf99000 2024-04-26T11:20:20.821 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 bash[34434]: fe8e86aa0044c5b89518b26e9998e936951db98fcbe2e5d70236b2b788589864 2024-04-26T11:20:20.821 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 systemd[1]: Started Ceph mgr.z for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:20:20.821 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:20.672+0000 7f964f2fa200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:20:21.255 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:20.860+0000 7f964f2fa200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:20:21.255 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:20 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:20.962+0000 7f964f2fa200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:20:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:21 smithi193 ceph-mon[32782]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T11:20:21.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T11:20:21.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T11:20:21.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:21.755 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:21.270+0000 7f964f2fa200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:20:21.755 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:21.354+0000 7f964f2fa200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:20:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-mon[32572]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T11:20:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T11:20:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T11:20:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:21 smithi110 ceph-mon[28069]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T11:20:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T11:20:21.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T11:20:21.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:21.826 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T11:20:21.826 INFO:teuthology.orchestra.run.smithi110.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T11:20:21.826 INFO:teuthology.orchestra.run.smithi110.stderr: stderr: 10+0 records in 2024-04-26T11:20:21.826 INFO:teuthology.orchestra.run.smithi110.stderr:10+0 records out 2024-04-26T11:20:21.827 INFO:teuthology.orchestra.run.smithi110.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.033187 s, 316 MB/s 2024-04-26T11:20:21.827 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping successful for: 2024-04-26T11:20:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:22 smithi110 ceph-mon[28069]: Deploying daemon mgr.y on smithi193 2024-04-26T11:20:22.566 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:22 smithi193 ceph-mon[32782]: Deploying daemon mgr.y on smithi193 2024-04-26T11:20:22.737 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_4 2024-04-26T11:20:22.748 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:22 smithi196 ceph-mon[32572]: Deploying daemon mgr.y on smithi193 2024-04-26T11:20:22.748 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:22.576+0000 7f964f2fa200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:20:22.872 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:22 smithi193 systemd[1]: Starting Ceph mgr.y for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:20:23.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:22.745+0000 7f964f2fa200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:20:23.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:22.920+0000 7f964f2fa200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:20:23.176 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:20:23.235 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:22 smithi193 podman[34150]: 2024-04-26 11:20:22.856641698 +0000 UTC m=+0.017725810 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:20:23.235 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:22 smithi193 podman[34150]: 2024-04-26 11:20:22.955660586 +0000 UTC m=+0.116744680 container create d61b164f45bb38b90d5c7b46cb10246446d903ae69519928cdbaae1ecd3be2bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T11:20:23.235 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:23 smithi193 podman[34150]: 2024-04-26 11:20:23.159131806 +0000 UTC m=+0.320215900 container init d61b164f45bb38b90d5c7b46cb10246446d903ae69519928cdbaae1ecd3be2bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:20:23.235 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:23 smithi193 podman[34150]: 2024-04-26 11:20:23.161712088 +0000 UTC m=+0.322796192 container start d61b164f45bb38b90d5c7b46cb10246446d903ae69519928cdbaae1ecd3be2bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-04-26T11:20:23.235 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-mgr[34170]: -- 172.21.15.193:0/1951843066 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56092357a5a0 con 0x56092354ec00 2024-04-26T11:20:23.235 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:23 smithi193 bash[34150]: d61b164f45bb38b90d5c7b46cb10246446d903ae69519928cdbaae1ecd3be2bc 2024-04-26T11:20:23.305 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:23 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:23.211+0000 7f964f2fa200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:20:23.306 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:23 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:23.303+0000 7f964f2fa200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:20:23.502 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-mon[32782]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:23.503 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.503 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.503 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.503 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.503 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:23 smithi193 systemd[1]: Started Ceph mgr.y for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:20:23.503 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:23.314+0000 7f0569b1b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:20:23.503 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:23.501+0000 7f0569b1b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:20:23.573 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:23 smithi110 ceph-mon[28069]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:23.574 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.574 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.574 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.574 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.711 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:23 smithi196 ceph-mon[32572]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:23.711 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.711 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.711 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.711 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:23.712 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:23 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:23.511+0000 7f964f2fa200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:20:23.872 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:23.604+0000 7f0569b1b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:20:24.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:23 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:23.709+0000 7f964f2fa200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:20:24.372 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:23 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:23.930+0000 7f0569b1b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:20:24.372 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:24 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:24.018+0000 7f0569b1b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:20:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:24 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:24.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:24 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:24.756 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:24 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:24.351+0000 7f964f2fa200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:20:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:24 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:25.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.009+0000 7fb26ea00700 1 -- 172.21.15.110:0/2246132377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268104690 msgr2=0x7fb268104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:25.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.009+0000 7fb26ea00700 1 --2- 172.21.15.110:0/2246132377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268104690 0x7fb268104af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb254009990 tx=0x7fb254009ca0 comp rx=0 tx=0).stop 2024-04-26T11:20:25.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.009+0000 7fb26ea00700 1 -- 172.21.15.110:0/2246132377 shutdown_connections 2024-04-26T11:20:25.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.009+0000 7fb26ea00700 1 --2- 172.21.15.110:0/2246132377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb268105030 0x7fb26810b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:25.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.009+0000 7fb26ea00700 1 --2- 172.21.15.110:0/2246132377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268103490 0x7fb2681038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:25.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.009+0000 7fb26ea00700 1 --2- 172.21.15.110:0/2246132377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268104690 0x7fb268104af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:25.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.009+0000 7fb26ea00700 1 -- 172.21.15.110:0/2246132377 >> 172.21.15.110:0/2246132377 conn(0x7fb2680fe9f0 msgr2=0x7fb268100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:25.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.009+0000 7fb26ea00700 1 -- 172.21.15.110:0/2246132377 shutdown_connections 2024-04-26T11:20:25.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.009+0000 7fb26ea00700 1 -- 172.21.15.110:0/2246132377 wait complete. 2024-04-26T11:20:25.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.010+0000 7fb26ea00700 1 Processor -- start 2024-04-26T11:20:25.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.010+0000 7fb26ea00700 1 -- start start 2024-04-26T11:20:25.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.010+0000 7fb26ea00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268103490 0x7fb26819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:25.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.010+0000 7fb26ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268104690 0x7fb26819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:25.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb26ea00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb268105030 0x7fb2681a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb26ea00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb26810ef60 con 0x7fb268104690 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb26ea00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb26810ede0 con 0x7fb268105030 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb26ea00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb26810f0e0 con 0x7fb268103490 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb267e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268103490 0x7fb26819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb267400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268104690 0x7fb26819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb267e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268103490 0x7fb26819b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42214/0 (socket says 172.21.15.110:42214) 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb267e00700 1 -- 172.21.15.110:0/223600942 learned_addr learned my addr 172.21.15.110:0/223600942 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb26ca00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb268105030 0x7fb2681a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb267e00700 1 -- 172.21.15.110:0/223600942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb268105030 msgr2=0x7fb2681a2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb267e00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb268105030 0x7fb2681a2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb267e00700 1 -- 172.21.15.110:0/223600942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268104690 msgr2=0x7fb26819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb267e00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268104690 0x7fb26819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.011+0000 7fb267e00700 1 -- 172.21.15.110:0/223600942 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2681a3470 con 0x7fb268103490 2024-04-26T11:20:25.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.012+0000 7fb267e00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268103490 0x7fb26819b860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb25800ea80 tx=0x7fb25800ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:25.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.012+0000 7fb264c00700 1 -- 172.21.15.110:0/223600942 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25800cbd0 con 0x7fb268103490 2024-04-26T11:20:25.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.012+0000 7fb264c00700 1 -- 172.21.15.110:0/223600942 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb25800cd70 con 0x7fb268103490 2024-04-26T11:20:25.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.012+0000 7fb264c00700 1 -- 172.21.15.110:0/223600942 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258018710 con 0x7fb268103490 2024-04-26T11:20:25.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.012+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2681a3760 con 0x7fb268103490 2024-04-26T11:20:25.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.012+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2681a3c50 con 0x7fb268103490 2024-04-26T11:20:25.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.013+0000 7fb264c00700 1 -- 172.21.15.110:0/223600942 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fb25801f020 con 0x7fb268103490 2024-04-26T11:20:25.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.013+0000 7fb264c00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb24c039890 0x7fb24c03bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:25.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.014+0000 7fb264c00700 1 -- 172.21.15.110:0/223600942 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb25804d8f0 con 0x7fb268103490 2024-04-26T11:20:25.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.014+0000 7fb267400700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb24c039890 0x7fb24c03bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:25.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.014+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26806a110 con 0x7fb268103490 2024-04-26T11:20:25.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.014+0000 7fb267400700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb24c039890 0x7fb24c03bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb25400b2e0 tx=0x7fb254005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:25.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.020+0000 7fb264c00700 1 -- 172.21.15.110:0/223600942 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb25800fa10 con 0x7fb268103490 2024-04-26T11:20:25.096 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:24 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:24.790+0000 7f964f2fa200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:20:25.096 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:24 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:24.891+0000 7f964f2fa200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:20:25.096 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:25.094+0000 7f964f2fa200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:20:25.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:25.262+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb268076d70 con 0x7fb24c039890 2024-04-26T11:20:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:20:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:25.605 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:25.264+0000 7f0569b1b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:20:25.605 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:25.431+0000 7f0569b1b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:20:25.605 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:25.603+0000 7f0569b1b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:20:25.605 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:25.605 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.605 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.605 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.605 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:25.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:25.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T11:20:25.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T11:20:25.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:25.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:20:25.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:20:25.606 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:25.713 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:25.620+0000 7f964f2fa200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:20:25.713 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:25.712+0000 7f964f2fa200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:20:25.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:20:25.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:26.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:25 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:25.954+0000 7f964f2fa200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:20:26.186 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:25.889+0000 7f0569b1b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:20:26.186 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:25 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:25.981+0000 7f0569b1b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:20:26.186 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:26 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:26.185+0000 7f0569b1b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:20:26.447 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:26 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:26.377+0000 7f0569b1b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:20:26.448 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:26 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:26.087+0000 7f964f2fa200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:20:26.448 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:26 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:26.183+0000 7f964f2fa200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:20:26.449 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:26 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:26.299+0000 7f964f2fa200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:20:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:26 smithi196 ceph-mon[32572]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T11:20:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:26 smithi196 ceph-mon[32572]: Reconfiguring daemon mgr.x on smithi110 2024-04-26T11:20:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:26 smithi196 ceph-mon[32572]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:26.756 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:26 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:26.612+0000 7f964f2fa200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:20:26.768 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:26 smithi110 ceph-mon[28069]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T11:20:26.768 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:26 smithi110 ceph-mon[28069]: Reconfiguring daemon mgr.x on smithi110 2024-04-26T11:20:26.768 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:26 smithi110 ceph-mon[28069]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:26 smithi193 ceph-mon[32782]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T11:20:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:26 smithi193 ceph-mon[32782]: Reconfiguring daemon mgr.x on smithi110 2024-04-26T11:20:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:26 smithi193 ceph-mon[32782]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:27.372 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:26 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:26.977+0000 7f0569b1b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:20:27.505 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:27.209+0000 7f964f2fa200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:20:27.505 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:20:27.428+0000 7f964f2fa200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: Standby manager daemon z started 2024-04-26T11:20:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T11:20:27.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:27 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:20:27.697 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:27.398+0000 7f0569b1b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:20:27.697 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:27.497+0000 7f0569b1b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:20:27.697 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:27.694+0000 7f0569b1b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:20:27.697 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:27.697 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.697 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.697 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:27.698 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:27.698 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:27.698 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.698 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T11:20:27.698 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.698 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:20:27.698 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: Standby manager daemon z started 2024-04-26T11:20:27.698 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T11:20:27.698 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:27 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:20:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:27.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T11:20:27.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:27.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:20:27.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: Standby manager daemon z started 2024-04-26T11:20:27.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T11:20:27.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:27 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.196:0/1385361095' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:20:28.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:28.438+0000 7fb264c00700 1 -- 172.21.15.110:0/223600942 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mgrmap(e 14) ==== 92603+0+0 (secure 0 0 0) 0x7fb258021730 con 0x7fb268103490 2024-04-26T11:20:28.557 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:28 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:28.222+0000 7f0569b1b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:20:28.557 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:28 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:28.313+0000 7f0569b1b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:20:28.872 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:28 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:28.554+0000 7f0569b1b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:20:28.872 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:28 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:28.687+0000 7f0569b1b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:20:28.872 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:28 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:28.781+0000 7f0569b1b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:20:29.200 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:28 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:28.895+0000 7f0569b1b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:20:29.200 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:29.198+0000 7f0569b1b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:20:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:29 smithi193 ceph-mon[32782]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:29 smithi193 ceph-mon[32782]: mgrmap e14: x(active, since 86s), standbys: z 2024-04-26T11:20:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T11:20:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:29 smithi196 ceph-mon[32572]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:29 smithi196 ceph-mon[32572]: mgrmap e14: x(active, since 86s), standbys: z 2024-04-26T11:20:29.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T11:20:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:29 smithi110 ceph-mon[28069]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:29 smithi110 ceph-mon[28069]: mgrmap e14: x(active, since 86s), standbys: z 2024-04-26T11:20:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T11:20:30.122 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:29.790+0000 7f0569b1b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:20:30.122 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:20:30.001+0000 7f0569b1b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:20:30.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:30.461+0000 7fb264c00700 1 -- 172.21.15.110:0/223600942 <== mon.1 v2:172.21.15.196:3300/0 8 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7fb25801fba0 con 0x7fb268103490 2024-04-26T11:20:30.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:30 smithi110 ceph-mon[28069]: Standby manager daemon y started 2024-04-26T11:20:30.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:30 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T11:20:30.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:30 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:20:30.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:30 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T11:20:30.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:30 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:20:30.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:30 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/913085405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13eb997d-8b4a-47f5-be11-772d47788972"}]: dispatch 2024-04-26T11:20:30.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:30 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/913085405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13eb997d-8b4a-47f5-be11-772d47788972"}]': finished 2024-04-26T11:20:30.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:30 smithi110 ceph-mon[28069]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T11:20:30.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:30 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:30 smithi196 ceph-mon[32572]: Standby manager daemon y started 2024-04-26T11:20:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:30 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T11:20:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:30 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:20:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:30 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T11:20:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:30 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:20:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:30 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/913085405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13eb997d-8b4a-47f5-be11-772d47788972"}]: dispatch 2024-04-26T11:20:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:30 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/913085405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13eb997d-8b4a-47f5-be11-772d47788972"}]': finished 2024-04-26T11:20:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:30 smithi196 ceph-mon[32572]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T11:20:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:30 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-mon[32782]: Standby manager daemon y started 2024-04-26T11:20:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T11:20:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:20:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T11:20:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.193:0/532277153' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:20:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/913085405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13eb997d-8b4a-47f5-be11-772d47788972"}]: dispatch 2024-04-26T11:20:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/913085405' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13eb997d-8b4a-47f5-be11-772d47788972"}]': finished 2024-04-26T11:20:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-mon[32782]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T11:20:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:30 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:31 smithi193 ceph-mon[32782]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:31 smithi193 ceph-mon[32782]: mgrmap e15: x(active, since 88s), standbys: z, y 2024-04-26T11:20:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T11:20:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:31 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1942016002' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:20:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:31 smithi196 ceph-mon[32572]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:31 smithi196 ceph-mon[32572]: mgrmap e15: x(active, since 88s), standbys: z, y 2024-04-26T11:20:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T11:20:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:31 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1942016002' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:20:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:31 smithi110 ceph-mon[28069]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:31 smithi110 ceph-mon[28069]: mgrmap e15: x(active, since 88s), standbys: z, y 2024-04-26T11:20:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T11:20:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:31 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1942016002' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:20:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:33 smithi196 ceph-mon[32572]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:33 smithi110 ceph-mon[28069]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:33 smithi193 ceph-mon[32782]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:35 smithi196 ceph-mon[32572]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:35 smithi110 ceph-mon[28069]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:35 smithi193 ceph-mon[32782]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:37.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:37 smithi110 ceph-mon[28069]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:37 smithi196 ceph-mon[32572]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:37 smithi193 ceph-mon[32782]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:39 smithi196 ceph-mon[32572]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T11:20:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:39 smithi110 ceph-mon[28069]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T11:20:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:39 smithi193 ceph-mon[32782]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T11:20:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:40.737 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:40 smithi196 ceph-mon[32572]: Deploying daemon osd.0 on smithi110 2024-04-26T11:20:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:40 smithi110 ceph-mon[28069]: Deploying daemon osd.0 on smithi110 2024-04-26T11:20:40.807 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:40 smithi193 ceph-mon[32782]: Deploying daemon osd.0 on smithi110 2024-04-26T11:20:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:41 smithi193 ceph-mon[32782]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:41 smithi196 ceph-mon[32572]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:41 smithi110 ceph-mon[28069]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:43 smithi110 ceph-mon[28069]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:43 smithi196 ceph-mon[32572]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:43 smithi193 ceph-mon[32782]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:45 smithi196 ceph-mon[32572]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:45 smithi110 ceph-mon[28069]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:45 smithi193 ceph-mon[32782]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:47 smithi196 ceph-mon[32572]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:47 smithi110 ceph-mon[28069]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:47 smithi193 ceph-mon[32782]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:49 smithi196 ceph-mon[32572]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:49 smithi110 ceph-mon[28069]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:49 smithi193 ceph-mon[32782]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:50 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:50 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:50 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:50 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:50 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:50 smithi193 ceph-mon[32782]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:50 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:50 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:51.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:50 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:51.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:50 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:51.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:50 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:51.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:50 smithi196 ceph-mon[32572]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:51.276 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:50 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:51.276 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:50 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:51.276 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:50 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:51.276 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:50 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:51.277 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:50 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:51.277 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:50 smithi110 ceph-mon[28069]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:51.715 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 0 on host 'smithi110' 2024-04-26T11:20:51.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.713+0000 7fb264c00700 1 -- 172.21.15.110:0/223600942 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb268076d70 con 0x7fb24c039890 2024-04-26T11:20:51.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb24c039890 msgr2=0x7fb24c03bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb24c039890 0x7fb24c03bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb25400b2e0 tx=0x7fb254005fb0 comp rx=0 tx=0).stop 2024-04-26T11:20:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268103490 msgr2=0x7fb26819b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268103490 0x7fb26819b860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb25800ea80 tx=0x7fb25800ed90 comp rx=0 tx=0).stop 2024-04-26T11:20:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 shutdown_connections 2024-04-26T11:20:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb268105030 0x7fb2681a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb24c039890 0x7fb24c03bd50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb268103490 0x7fb26819b860 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 --2- 172.21.15.110:0/223600942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268104690 0x7fb26819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.717+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 >> 172.21.15.110:0/223600942 conn(0x7fb2680fe9f0 msgr2=0x7fb268075650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:51.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.718+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 shutdown_connections 2024-04-26T11:20:51.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:20:51.718+0000 7fb26ea00700 1 -- 172.21.15.110:0/223600942 wait complete. 2024-04-26T11:20:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:51 smithi110 ceph-mon[28069]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T11:20:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:51 smithi193 ceph-mon[32782]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T11:20:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:51 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:51 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:51 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:51 smithi196 ceph-mon[32572]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T11:20:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:51 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:51 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:51 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:20:52.631 DEBUG:teuthology.orchestra.run.smithi110:osd.0> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.0.service 2024-04-26T11:20:52.637 INFO:tasks.cephadm:Deploying osd.1 on smithi193 with /dev/vg_nvme/lv_4... 2024-04-26T11:20:52.637 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T11:20:52.881 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T11:20:52.989 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:52 smithi193 ceph-mon[32782]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T11:20:52.989 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:52 smithi193 ceph-mon[32782]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T11:20:52.989 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:52 smithi193 ceph-mon[32782]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:20:52.989 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:52 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:52.989 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:52 smithi193 ceph-mon[32782]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:53.190 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:52 smithi110 ceph-mon[28069]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T11:20:53.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:52 smithi110 ceph-mon[28069]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T11:20:53.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:52 smithi110 ceph-mon[28069]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:20:53.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:52 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:53.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:52 smithi110 ceph-mon[28069]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:53.191 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:20:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-0[40438]: 2024-04-26T11:20:52.871+0000 7f2ec1000700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T11:20:53.191 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:20:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-0[40438]: 2024-04-26T11:20:52.881+0000 7f2ebbe00700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:20:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:52 smithi196 ceph-mon[32572]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T11:20:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:52 smithi196 ceph-mon[32572]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T11:20:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:52 smithi196 ceph-mon[32572]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:20:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:52 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:52 smithi196 ceph-mon[32572]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:53 smithi110 ceph-mon[28069]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:20:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:53 smithi110 ceph-mon[28069]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T11:20:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:53 smithi193 ceph-mon[32782]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:20:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:53 smithi193 ceph-mon[32782]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T11:20:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:53 smithi196 ceph-mon[32572]: from='osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:20:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:53 smithi196 ceph-mon[32572]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T11:20:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:54.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:54.562 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T11:20:54.562 INFO:teuthology.orchestra.run.smithi193.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T11:20:54.562 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10+0 records in 2024-04-26T11:20:54.562 INFO:teuthology.orchestra.run.smithi193.stderr:10+0 records out 2024-04-26T11:20:54.562 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114508 s, 916 MB/s 2024-04-26T11:20:54.562 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping successful for: 2024-04-26T11:20:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:54 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:20:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:54 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:20:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:54 smithi110 ceph-mon[28069]: osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] boot 2024-04-26T11:20:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:54 smithi110 ceph-mon[28069]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T11:20:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:54 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:55.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:54 smithi110 ceph-mon[28069]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:54 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:20:55.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:54 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:20:55.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:54 smithi193 ceph-mon[32782]: osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] boot 2024-04-26T11:20:55.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:54 smithi193 ceph-mon[32782]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T11:20:55.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:54 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:55.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:54 smithi193 ceph-mon[32782]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:55.193 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_4 2024-04-26T11:20:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:54 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:20:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:54 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:20:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:54 smithi196 ceph-mon[32572]: osd.0 [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] boot 2024-04-26T11:20:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:54 smithi196 ceph-mon[32572]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T11:20:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:20:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:54 smithi196 ceph-mon[32572]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T11:20:55.429 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T11:20:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:55 smithi193 ceph-mon[32782]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T11:20:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:55 smithi196 ceph-mon[32572]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T11:20:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:55 smithi110 ceph-mon[28069]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T11:20:56.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.987+0000 7f331e25e700 1 -- 172.21.15.193:0/3499745020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 msgr2=0x7f331810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:56.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.987+0000 7f331e25e700 1 --2- 172.21.15.193:0/3499745020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 0x7f331810b8d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f331000b0d0 tx=0x7f331000b3e0 comp rx=0 tx=0).stop 2024-04-26T11:20:56.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.987+0000 7f331e25e700 1 -- 172.21.15.193:0/3499745020 shutdown_connections 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.987+0000 7f331e25e700 1 --2- 172.21.15.193:0/3499745020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 0x7f331810b8d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.987+0000 7f331e25e700 1 --2- 172.21.15.193:0/3499745020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3318103480 0x7f33181038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.987+0000 7f331e25e700 1 --2- 172.21.15.193:0/3499745020 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3318104680 0x7f3318104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.987+0000 7f331e25e700 1 -- 172.21.15.193:0/3499745020 >> 172.21.15.193:0/3499745020 conn(0x7f33180fea20 msgr2=0x7f3318100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.987+0000 7f331e25e700 1 -- 172.21.15.193:0/3499745020 shutdown_connections 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.987+0000 7f331e25e700 1 -- 172.21.15.193:0/3499745020 wait complete. 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f331e25e700 1 Processor -- start 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f331e25e700 1 -- start start 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f331e25e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3318103480 0x7f3318199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f331e25e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3318104680 0x7f3318199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f331e25e700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 0x7f33181a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f331e25e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f331810efc0 con 0x7f3318103480 2024-04-26T11:20:56.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f331e25e700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f331810ee40 con 0x7f3318105020 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f331e25e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f331810f140 con 0x7f3318104680 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f3317fff700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 0x7f33181a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f3317fff700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 0x7f33181a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:44866/0 (socket says 172.21.15.193:44866) 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f3317fff700 1 -- 172.21.15.193:0/318527137 learned_addr learned my addr 172.21.15.193:0/318527137 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f3316ffd700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3318104680 0x7f3318199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f3317fff700 1 -- 172.21.15.193:0/318527137 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3318104680 msgr2=0x7f3318199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f3317fff700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3318104680 0x7f3318199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f3317fff700 1 -- 172.21.15.193:0/318527137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3318103480 msgr2=0x7f3318199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f3317fff700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3318103480 0x7f3318199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.988+0000 7f3317fff700 1 -- 172.21.15.193:0/318527137 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33181a1270 con 0x7f3318105020 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.989+0000 7f3317fff700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 0x7f33181a0bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3310009040 tx=0x7f3310004d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.989+0000 7f3314ff9700 1 -- 172.21.15.193:0/318527137 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331001f030 con 0x7f3318105020 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.989+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33181a1500 con 0x7f3318105020 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.989+0000 7f3314ff9700 1 -- 172.21.15.193:0/318527137 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3310003a00 con 0x7f3318105020 2024-04-26T11:20:56.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.989+0000 7f3314ff9700 1 -- 172.21.15.193:0/318527137 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33100047b0 con 0x7f3318105020 2024-04-26T11:20:56.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.989+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33181a1a30 con 0x7f3318105020 2024-04-26T11:20:56.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.990+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331806a110 con 0x7f3318105020 2024-04-26T11:20:56.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.991+0000 7f3314ff9700 1 -- 172.21.15.193:0/318527137 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7f3310003bb0 con 0x7f3318105020 2024-04-26T11:20:56.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.991+0000 7f3314ff9700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33000a3bb0 0x7f33000a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:20:56.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.992+0000 7f3314ff9700 1 -- 172.21.15.193:0/318527137 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f331000f020 con 0x7f3318105020 2024-04-26T11:20:56.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.992+0000 7f33177fe700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33000a3bb0 0x7f33000a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:20:56.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.993+0000 7f33177fe700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33000a3bb0 0x7f33000a6070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33181044e0 tx=0x7f3308006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:20:56.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:56.996+0000 7f3314ff9700 1 -- 172.21.15.193:0/318527137 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3310029020 con 0x7f3318105020 2024-04-26T11:20:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:56 smithi193 ceph-mon[32782]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:20:57.181 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:56 smithi110 ceph-mon[28069]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:20:57.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:20:57.202+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3318063920 con 0x7f33000a3bb0 2024-04-26T11:20:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:56 smithi196 ceph-mon[32572]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:20:58.113 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:58.113 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:20:58.113 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi110 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 17089M 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:58.114 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi110 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 17089M 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:58.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:20:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:20:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:20:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi110 2024-04-26T11:20:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:20:58.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 17089M 2024-04-26T11:20:58.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:58.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:20:58.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:20:58.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:20:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:58 smithi193 ceph-mon[32782]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:20:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:58 smithi196 ceph-mon[32572]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:20:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:58 smithi110 ceph-mon[28069]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:59 smithi196 ceph-mon[32572]: from='client.? 172.21.15.193:0/1416415559' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7927dc3-dced-4661-8493-840e111241e7"}]: dispatch 2024-04-26T11:21:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:59 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7927dc3-dced-4661-8493-840e111241e7"}]: dispatch 2024-04-26T11:21:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:59 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7927dc3-dced-4661-8493-840e111241e7"}]': finished 2024-04-26T11:21:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:59 smithi196 ceph-mon[32572]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T11:21:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:20:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:00.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:59 smithi110 ceph-mon[28069]: from='client.? 172.21.15.193:0/1416415559' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7927dc3-dced-4661-8493-840e111241e7"}]: dispatch 2024-04-26T11:21:00.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:59 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7927dc3-dced-4661-8493-840e111241e7"}]: dispatch 2024-04-26T11:21:00.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:59 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7927dc3-dced-4661-8493-840e111241e7"}]': finished 2024-04-26T11:21:00.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:59 smithi110 ceph-mon[28069]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T11:21:00.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:20:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:59 smithi193 ceph-mon[32782]: from='client.? 172.21.15.193:0/1416415559' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7927dc3-dced-4661-8493-840e111241e7"}]: dispatch 2024-04-26T11:21:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:59 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7927dc3-dced-4661-8493-840e111241e7"}]: dispatch 2024-04-26T11:21:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:59 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7927dc3-dced-4661-8493-840e111241e7"}]': finished 2024-04-26T11:21:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:59 smithi193 ceph-mon[32782]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T11:21:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:20:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:00 smithi196 ceph-mon[32572]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:00 smithi196 ceph-mon[32572]: from='client.? 172.21.15.193:0/958997511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:21:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:00 smithi110 ceph-mon[28069]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:00 smithi110 ceph-mon[28069]: from='client.? 172.21.15.193:0/958997511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:21:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:00 smithi193 ceph-mon[32782]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:00 smithi193 ceph-mon[32782]: from='client.? 172.21.15.193:0/958997511' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:21:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:03 smithi196 ceph-mon[32572]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:03.791 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:03 smithi193 ceph-mon[32782]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:03 smithi110 ceph-mon[28069]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:05.705 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:05 smithi193 ceph-mon[32782]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:05 smithi196 ceph-mon[32572]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:05 smithi110 ceph-mon[28069]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:07.716 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:07 smithi193 ceph-mon[32782]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:07.716 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T11:21:07.716 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:07 smithi196 ceph-mon[32572]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:07.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T11:21:07.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:07 smithi110 ceph-mon[28069]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T11:21:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:08.692 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:08 smithi193 ceph-mon[32782]: Deploying daemon osd.1 on smithi193 2024-04-26T11:21:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:08 smithi196 ceph-mon[32572]: Deploying daemon osd.1 on smithi193 2024-04-26T11:21:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:08 smithi110 ceph-mon[28069]: Deploying daemon osd.1 on smithi193 2024-04-26T11:21:09.608 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:09 smithi193 ceph-mon[32782]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:09 smithi196 ceph-mon[32572]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:09 smithi110 ceph-mon[28069]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:11.485 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:11 smithi193 ceph-mon[32782]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:11 smithi196 ceph-mon[32572]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:11 smithi110 ceph-mon[28069]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:13 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:13 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:13 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:13 smithi110 ceph-mon[28069]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:13 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:13 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:13 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:13 smithi193 ceph-mon[32782]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:13 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:13 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:13 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:13.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:13 smithi196 ceph-mon[32572]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:15.645 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:15 smithi193 ceph-mon[32782]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:15.646 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:15.646 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:15.646 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:15.646 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:15.646 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:15.745 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 1 on host 'smithi193' 2024-04-26T11:21:15.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.743+0000 7f3314ff9700 1 -- 172.21.15.193:0/318527137 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3318063920 con 0x7f33000a3bb0 2024-04-26T11:21:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33000a3bb0 msgr2=0x7f33000a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33000a3bb0 0x7f33000a6070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33181044e0 tx=0x7f3308006d20 comp rx=0 tx=0).stop 2024-04-26T11:21:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 msgr2=0x7f33181a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:15.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 0x7f33181a0bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3310009040 tx=0x7f3310004d50 comp rx=0 tx=0).stop 2024-04-26T11:21:15.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 shutdown_connections 2024-04-26T11:21:15.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3318105020 0x7f33181a0bd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:15.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3318103480 0x7f3318199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:15.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33000a3bb0 0x7f33000a6070 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:15.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 --2- 172.21.15.193:0/318527137 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3318104680 0x7f3318199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:15.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 >> 172.21.15.193:0/318527137 conn(0x7f33180fea20 msgr2=0x7f3318107a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:21:15.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 shutdown_connections 2024-04-26T11:21:15.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:21:15.746+0000 7f331e25e700 1 -- 172.21.15.193:0/318527137 wait complete. 2024-04-26T11:21:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:15 smithi196 ceph-mon[32572]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:15.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:15 smithi110 ceph-mon[28069]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:15.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:15.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:15.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:15.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:15.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:16.345 DEBUG:teuthology.orchestra.run.smithi193:osd.1> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.1.service 2024-04-26T11:21:16.348 INFO:tasks.cephadm:Deploying osd.2 on smithi196 with /dev/vg_nvme/lv_4... 2024-04-26T11:21:16.348 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T11:21:16.590 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:21:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:16 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:16 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:16 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:16 smithi110 ceph-mon[28069]: from='osd.1 [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T11:21:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:16 smithi110 ceph-mon[28069]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T11:21:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:16 smithi110 ceph-mon[28069]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:16 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:16 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:16.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:16 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:16.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:16 smithi193 ceph-mon[32782]: from='osd.1 [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T11:21:16.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:16 smithi193 ceph-mon[32782]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T11:21:16.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:16 smithi193 ceph-mon[32782]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:16 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:16 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:16 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:16 smithi196 ceph-mon[32572]: from='osd.1 [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T11:21:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:16 smithi196 ceph-mon[32572]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T11:21:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:16 smithi196 ceph-mon[32572]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:17.794 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:17 smithi193 ceph-mon[32782]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T11:21:17.794 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:17 smithi193 ceph-mon[32782]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T11:21:17.794 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:17.794 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:17 smithi193 ceph-mon[32782]: from='osd.1 [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:21:17.794 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:17 smithi193 ceph-mon[32782]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:21:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:17 smithi196 ceph-mon[32572]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T11:21:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:17 smithi196 ceph-mon[32572]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T11:21:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:17 smithi196 ceph-mon[32572]: from='osd.1 [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:21:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:17 smithi196 ceph-mon[32572]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:21:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:17 smithi110 ceph-mon[28069]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T11:21:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:17 smithi110 ceph-mon[28069]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T11:21:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:17 smithi110 ceph-mon[28069]: from='osd.1 [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:21:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:17 smithi110 ceph-mon[28069]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:21:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T11:21:18.560 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T11:21:18.560 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-04-26T11:21:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-04-26T11:21:18.561 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114079 s, 919 MB/s 2024-04-26T11:21:18.561 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-04-26T11:21:18.562 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:18 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-1[37375]: 2024-04-26T11:21:18.157+0000 7f5cbf774700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T11:21:18.563 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:18 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-1[37375]: 2024-04-26T11:21:18.160+0000 7f5cb6d5e700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:21:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:18 smithi193 ceph-mon[32782]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:21:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:18 smithi193 ceph-mon[32782]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T11:21:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:18 smithi193 ceph-mon[32782]: from='osd.1 ' entity='osd.1' 2024-04-26T11:21:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:18 smithi193 ceph-mon[32782]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:18.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:18 smithi196 ceph-mon[32572]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:21:18.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:18 smithi196 ceph-mon[32572]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T11:21:18.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:18.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:18.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:18 smithi196 ceph-mon[32572]: from='osd.1 ' entity='osd.1' 2024-04-26T11:21:18.935 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:18 smithi196 ceph-mon[32572]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:19.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:18 smithi110 ceph-mon[28069]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:21:19.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:18 smithi110 ceph-mon[28069]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T11:21:19.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:19.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:19.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:18 smithi110 ceph-mon[28069]: from='osd.1 ' entity='osd.1' 2024-04-26T11:21:19.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:18 smithi110 ceph-mon[28069]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T11:21:19.292 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_4 2024-04-26T11:21:19.528 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:21:19.972 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: osd.1 [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] boot 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi193 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 17088M 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:19.973 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:19.974 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:19.974 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:21:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:21:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: osd.1 [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] boot 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi193 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 17088M 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:20.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:21:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:21:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: osd.1 [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] boot 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi193 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 17088M 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:20 smithi196 ceph-mon[32572]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:20 smithi110 ceph-mon[28069]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:21.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.041+0000 7f903d680700 1 -- 172.21.15.196:0/745620829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038105020 msgr2=0x7f903810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.041+0000 7f903d680700 1 --2- 172.21.15.196:0/745620829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038105020 0x7f903810b8d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f903000b0a0 tx=0x7f903000b3b0 comp rx=0 tx=0).stop 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.041+0000 7f903d680700 1 -- 172.21.15.196:0/745620829 shutdown_connections 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.041+0000 7f903d680700 1 --2- 172.21.15.196:0/745620829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038105020 0x7f903810b8d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.041+0000 7f903d680700 1 --2- 172.21.15.196:0/745620829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9038103480 0x7f90381038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.041+0000 7f903d680700 1 --2- 172.21.15.196:0/745620829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9038104680 0x7f9038104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.041+0000 7f903d680700 1 -- 172.21.15.196:0/745620829 >> 172.21.15.196:0/745620829 conn(0x7f90380fea20 msgr2=0x7f9038100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.041+0000 7f903d680700 1 -- 172.21.15.196:0/745620829 shutdown_connections 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f903d680700 1 -- 172.21.15.196:0/745620829 wait complete. 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f903d680700 1 Processor -- start 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f903d680700 1 -- start start 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f903d680700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9038103480 0x7f90381996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:21:21.046 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f903d680700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038104680 0x7f9038199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f903d680700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9038105020 0x7f90381a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f903d680700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f903810f010 con 0x7f9038105020 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f903d680700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f903810ee90 con 0x7f9038103480 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f903d680700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f903810f190 con 0x7f9038104680 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f90367fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038104680 0x7f9038199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.042+0000 7f90367fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038104680 0x7f9038199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:45922/0 (socket says 172.21.15.196:45922) 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f90367fc700 1 -- 172.21.15.196:0/4195852693 learned_addr learned my addr 172.21.15.196:0/4195852693 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f9036ffd700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9038103480 0x7f90381996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f90367fc700 1 -- 172.21.15.196:0/4195852693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9038103480 msgr2=0x7f90381996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f90367fc700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9038103480 0x7f90381996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f90367fc700 1 -- 172.21.15.196:0/4195852693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9038105020 msgr2=0x7f90381a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f90367fc700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9038105020 0x7f90381a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:21.047 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f90367fc700 1 -- 172.21.15.196:0/4195852693 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90381a1320 con 0x7f9038104680 2024-04-26T11:21:21.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f90367fc700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038104680 0x7f9038199c00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f902c00b560 tx=0x7f902c00b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:21:21.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f901ffff700 1 -- 172.21.15.196:0/4195852693 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c015020 con 0x7f9038104680 2024-04-26T11:21:21.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f901ffff700 1 -- 172.21.15.196:0/4195852693 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f902c011ce0 con 0x7f9038104680 2024-04-26T11:21:21.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90381a1610 con 0x7f9038104680 2024-04-26T11:21:21.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f901ffff700 1 -- 172.21.15.196:0/4195852693 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c010da0 con 0x7f9038104680 2024-04-26T11:21:21.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.043+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90381a1b80 con 0x7f9038104680 2024-04-26T11:21:21.048 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.044+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903806a110 con 0x7f9038104680 2024-04-26T11:21:21.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.045+0000 7f901ffff700 1 -- 172.21.15.196:0/4195852693 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7f902c018020 con 0x7f9038104680 2024-04-26T11:21:21.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.045+0000 7f901ffff700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f90200a3bb0 0x7f90200a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:21:21.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.046+0000 7f901ffff700 1 -- 172.21.15.196:0/4195852693 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f902c0ce3c0 con 0x7f9038104680 2024-04-26T11:21:21.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.046+0000 7f9036ffd700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f90200a3bb0 0x7f90200a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:21:21.049 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.047+0000 7f9036ffd700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f90200a3bb0 0x7f90200a6070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9028006fd0 tx=0x7f9028008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:21:21.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.051+0000 7f901ffff700 1 -- 172.21.15.196:0/4195852693 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f902c01f020 con 0x7f9038104680 2024-04-26T11:21:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:20 smithi193 ceph-mon[32782]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:21.257 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:21.256+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9038063860 con 0x7f90200a3bb0 2024-04-26T11:21:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:21 smithi196 ceph-mon[32572]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T11:21:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:21 smithi196 ceph-mon[32572]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:21:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:21:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:21:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:21 smithi110 ceph-mon[28069]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T11:21:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:21 smithi110 ceph-mon[28069]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:21:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:21:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:21:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:21 smithi193 ceph-mon[32782]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T11:21:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:21 smithi193 ceph-mon[32782]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:21:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:21:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:21:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:22.996 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:22 smithi196 ceph-mon[32572]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:22 smithi110 ceph-mon[28069]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:22 smithi193 ceph-mon[32782]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:24.132 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:23 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/2518434222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54459a80-91a1-45ba-b7e4-900a4a995219"}]: dispatch 2024-04-26T11:21:24.132 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:23 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54459a80-91a1-45ba-b7e4-900a4a995219"}]: dispatch 2024-04-26T11:21:24.133 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:23 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54459a80-91a1-45ba-b7e4-900a4a995219"}]': finished 2024-04-26T11:21:24.133 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:23 smithi196 ceph-mon[32572]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T11:21:24.133 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:23 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/2518434222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54459a80-91a1-45ba-b7e4-900a4a995219"}]: dispatch 2024-04-26T11:21:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:23 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54459a80-91a1-45ba-b7e4-900a4a995219"}]: dispatch 2024-04-26T11:21:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:23 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54459a80-91a1-45ba-b7e4-900a4a995219"}]': finished 2024-04-26T11:21:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:23 smithi110 ceph-mon[28069]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T11:21:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:23 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/2518434222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54459a80-91a1-45ba-b7e4-900a4a995219"}]: dispatch 2024-04-26T11:21:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:23 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54459a80-91a1-45ba-b7e4-900a4a995219"}]: dispatch 2024-04-26T11:21:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:23 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54459a80-91a1-45ba-b7e4-900a4a995219"}]': finished 2024-04-26T11:21:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:23 smithi193 ceph-mon[32782]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T11:21:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:24 smithi196 ceph-mon[32572]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:24 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/2957057660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:21:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:24 smithi110 ceph-mon[28069]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:24 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/2957057660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:21:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:24 smithi193 ceph-mon[32782]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:24 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/2957057660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:21:27.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:27 smithi196 ceph-mon[32572]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:27 smithi110 ceph-mon[28069]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:27 smithi193 ceph-mon[32782]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:29.669 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:29 smithi196 ceph-mon[32572]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:29 smithi110 ceph-mon[28069]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:29 smithi193 ceph-mon[32782]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:31.632 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:31 smithi196 ceph-mon[32572]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:31.632 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T11:21:31.632 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:31 smithi110 ceph-mon[28069]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T11:21:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:31 smithi193 ceph-mon[32782]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T11:21:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:32.499 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:32 smithi196 ceph-mon[32572]: Deploying daemon osd.2 on smithi196 2024-04-26T11:21:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:32 smithi110 ceph-mon[28069]: Deploying daemon osd.2 on smithi196 2024-04-26T11:21:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:32 smithi193 ceph-mon[32782]: Deploying daemon osd.2 on smithi196 2024-04-26T11:21:33.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:33 smithi196 ceph-mon[32572]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:33 smithi110 ceph-mon[28069]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:33 smithi193 ceph-mon[32782]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:35.713 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:35 smithi196 ceph-mon[32572]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:35 smithi110 ceph-mon[28069]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:35 smithi193 ceph-mon[32782]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:36 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:36 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:36 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:36 smithi196 ceph-mon[32572]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:36 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:36 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:36 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:36 smithi110 ceph-mon[28069]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:36 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:36 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:36 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:36 smithi193 ceph-mon[32782]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:39.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.339+0000 7f901ffff700 1 -- 172.21.15.196:0/4195852693 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9038063860 con 0x7f90200a3bb0 2024-04-26T11:21:39.341 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 2 on host 'smithi196' 2024-04-26T11:21:39.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f90200a3bb0 msgr2=0x7f90200a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:39.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f90200a3bb0 0x7f90200a6070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9028006fd0 tx=0x7f9028008040 comp rx=0 tx=0).stop 2024-04-26T11:21:39.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038104680 msgr2=0x7f9038199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:39.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038104680 0x7f9038199c00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f902c00b560 tx=0x7f902c00b920 comp rx=0 tx=0).stop 2024-04-26T11:21:39.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 shutdown_connections 2024-04-26T11:21:39.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9038105020 0x7f90381a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:39.343 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9038103480 0x7f90381996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:39.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f90200a3bb0 0x7f90200a6070 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:39.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 --2- 172.21.15.196:0/4195852693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9038104680 0x7f9038199c00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:39.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 >> 172.21.15.196:0/4195852693 conn(0x7f90380fea20 msgr2=0x7f9038107aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:21:39.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 shutdown_connections 2024-04-26T11:21:39.344 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:21:39.342+0000 7f903d680700 1 -- 172.21.15.196:0/4195852693 wait complete. 2024-04-26T11:21:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:39 smithi196 ceph-mon[32572]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:39.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:39.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:39 smithi110 ceph-mon[28069]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:39 smithi193 ceph-mon[32782]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:39.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:39.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:21:39.973 DEBUG:teuthology.orchestra.run.smithi196:osd.2> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.2.service 2024-04-26T11:21:39.975 INFO:tasks.cephadm:Deploying osd.3 on smithi110 with /dev/vg_nvme/lv_3... 2024-04-26T11:21:39.975 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T11:21:40.417 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:21:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:40 smithi196 ceph-mon[32572]: from='osd.2 [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T11:21:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:40 smithi196 ceph-mon[32572]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T11:21:40.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:40 smithi110 ceph-mon[28069]: from='osd.2 [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T11:21:40.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:40 smithi110 ceph-mon[28069]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T11:21:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:40 smithi193 ceph-mon[32782]: from='osd.2 [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T11:21:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:40 smithi193 ceph-mon[32782]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T11:21:41.720 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:41 smithi110 ceph-mon[28069]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:41.720 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:41 smithi110 ceph-mon[28069]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T11:21:41.720 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:41 smithi110 ceph-mon[28069]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T11:21:41.720 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:41 smithi110 ceph-mon[28069]: from='osd.2 [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:21:41.721 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:41 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:41.721 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:41 smithi110 ceph-mon[28069]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:21:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:41 smithi196 ceph-mon[32572]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:41 smithi196 ceph-mon[32572]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T11:21:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:41 smithi196 ceph-mon[32572]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T11:21:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:41 smithi196 ceph-mon[32572]: from='osd.2 [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:21:41.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:41 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:41.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:41 smithi196 ceph-mon[32572]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:21:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:41 smithi193 ceph-mon[32782]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:41 smithi193 ceph-mon[32782]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T11:21:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:41 smithi193 ceph-mon[32782]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T11:21:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:41 smithi193 ceph-mon[32782]: from='osd.2 [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:21:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:41 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:41 smithi193 ceph-mon[32782]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:21:42.194 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-2[37746]: 2024-04-26T11:21:41.887+0000 7faa2f1c1700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T11:21:42.194 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-2[37746]: 2024-04-26T11:21:41.892+0000 7faa26fac700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:21:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:42 smithi196 ceph-mon[32572]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:21:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:42 smithi196 ceph-mon[32572]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T11:21:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:42.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:42.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:42 smithi196 ceph-mon[32572]: from='osd.2 ' entity='osd.2' 2024-04-26T11:21:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:42 smithi110 ceph-mon[28069]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:21:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:42 smithi110 ceph-mon[28069]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T11:21:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:42 smithi110 ceph-mon[28069]: from='osd.2 ' entity='osd.2' 2024-04-26T11:21:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:42 smithi193 ceph-mon[32782]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:21:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:42 smithi193 ceph-mon[32782]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T11:21:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:42 smithi193 ceph-mon[32782]: from='osd.2 ' entity='osd.2' 2024-04-26T11:21:43.219 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T11:21:43.219 INFO:teuthology.orchestra.run.smithi110.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T11:21:43.219 INFO:teuthology.orchestra.run.smithi110.stderr: stderr: 10+0 records in 2024-04-26T11:21:43.219 INFO:teuthology.orchestra.run.smithi110.stderr:10+0 records out 2024-04-26T11:21:43.220 INFO:teuthology.orchestra.run.smithi110.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0333746 s, 314 MB/s 2024-04-26T11:21:43.220 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping successful for: 2024-04-26T11:21:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:21:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:21:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: osd.2 [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] boot 2024-04-26T11:21:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T11:21:43.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:43.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:21:43.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:43.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:43.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:21:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: osd.2 [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] boot 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:21:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:21:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-26T11:21:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: osd.2 [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] boot 2024-04-26T11:21:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T11:21:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:21:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:21:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:21:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:44.050 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_3 2024-04-26T11:21:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:21:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:44 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi196 2024-04-26T11:21:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:44 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 17088M 2024-04-26T11:21:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:44 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi196 2024-04-26T11:21:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:44 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 17088M 2024-04-26T11:21:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:44 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi196 2024-04-26T11:21:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:44 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 17088M 2024-04-26T11:21:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:45 smithi196 ceph-mon[32572]: pgmap v89: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:45 smithi196 ceph-mon[32572]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T11:21:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:45 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T11:21:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:45 smithi110 ceph-mon[28069]: pgmap v89: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:45 smithi110 ceph-mon[28069]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T11:21:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:45 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T11:21:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:45 smithi193 ceph-mon[32782]: pgmap v89: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:45 smithi193 ceph-mon[32782]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T11:21:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:45 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.728+0000 7f2b22600700 1 -- 172.21.15.110:0/1669269443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b1c10fa70 msgr2=0x7f2b1c111e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.728+0000 7f2b22600700 1 --2- 172.21.15.110:0/1669269443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b1c10fa70 0x7f2b1c111e60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009f90 tx=0x7f2b1400b330 comp rx=0 tx=0).stop 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.728+0000 7f2b22600700 1 -- 172.21.15.110:0/1669269443 shutdown_connections 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.728+0000 7f2b22600700 1 --2- 172.21.15.110:0/1669269443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b1c10fa70 0x7f2b1c111e60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.728+0000 7f2b22600700 1 --2- 172.21.15.110:0/1669269443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b1c077450 0x7f2b1c0758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.728+0000 7f2b22600700 1 --2- 172.21.15.110:0/1669269443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b1c075e80 0x7f2b1c076300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.728+0000 7f2b22600700 1 -- 172.21.15.110:0/1669269443 >> 172.21.15.110:0/1669269443 conn(0x7f2b1c0fe9f0 msgr2=0x7f2b1c100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.728+0000 7f2b22600700 1 -- 172.21.15.110:0/1669269443 shutdown_connections 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.728+0000 7f2b22600700 1 -- 172.21.15.110:0/1669269443 wait complete. 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.729+0000 7f2b22600700 1 Processor -- start 2024-04-26T11:21:46.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.729+0000 7f2b22600700 1 -- start start 2024-04-26T11:21:46.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b22600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b1c075e80 0x7f2b1c19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:21:46.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b22600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b1c077450 0x7f2b1c1a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:21:46.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b22600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b1c10fa70 0x7f2b1c1a7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:21:46.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b22600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c115520 con 0x7f2b1c077450 2024-04-26T11:21:46.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b22600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c1153a0 con 0x7f2b1c10fa70 2024-04-26T11:21:46.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b22600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c1156a0 con 0x7f2b1c075e80 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1b400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b1c075e80 0x7f2b1c19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1b400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b1c075e80 0x7f2b1c19fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:56678/0 (socket says 172.21.15.110:56678) 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b1c077450 0x7f2b1c1a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1b400700 1 -- 172.21.15.110:0/2140354245 learned_addr learned my addr 172.21.15.110:0/2140354245 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1be00700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b1c10fa70 0x7f2b1c1a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1b400700 1 -- 172.21.15.110:0/2140354245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b1c10fa70 msgr2=0x7f2b1c1a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1b400700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b1c10fa70 0x7f2b1c1a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1b400700 1 -- 172.21.15.110:0/2140354245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b1c077450 msgr2=0x7f2b1c1a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1b400700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b1c077450 0x7f2b1c1a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.730+0000 7f2b1b400700 1 -- 172.21.15.110:0/2140354245 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1c1a77c0 con 0x7f2b1c075e80 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.731+0000 7f2b1b400700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b1c075e80 0x7f2b1c19fb60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00e9a0 tx=0x7f2b0c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.731+0000 7f2b13e00700 1 -- 172.21.15.110:0/2140354245 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c004a30 con 0x7f2b1c075e80 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.731+0000 7f2b13e00700 1 -- 172.21.15.110:0/2140354245 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b0c00ccc0 con 0x7f2b1c075e80 2024-04-26T11:21:46.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.731+0000 7f2b13e00700 1 -- 172.21.15.110:0/2140354245 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c005610 con 0x7f2b1c075e80 2024-04-26T11:21:46.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.731+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1c1a7ab0 con 0x7f2b1c075e80 2024-04-26T11:21:46.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.732+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b1c1a8040 con 0x7f2b1c075e80 2024-04-26T11:21:46.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.733+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b1c06a110 con 0x7f2b1c075e80 2024-04-26T11:21:46.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.735+0000 7f2b13e00700 1 -- 172.21.15.110:0/2140354245 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7f2b0c00c810 con 0x7f2b1c075e80 2024-04-26T11:21:46.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.736+0000 7f2b13e00700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2b000a3c30 0x7f2b000a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:21:46.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.736+0000 7f2b13e00700 1 -- 172.21.15.110:0/2140354245 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f2b0c0cf0a0 con 0x7f2b1c075e80 2024-04-26T11:21:46.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.736+0000 7f2b1aa00700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2b000a3c30 0x7f2b000a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:21:46.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.737+0000 7f2b1aa00700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2b000a3c30 0x7f2b000a60f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009750 tx=0x7f2b08009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:21:46.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.740+0000 7f2b13e00700 1 -- 172.21.15.110:0/2140354245 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2b0c09ce90 con 0x7f2b1c075e80 2024-04-26T11:21:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:46 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T11:21:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:46 smithi196 ceph-mon[32572]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T11:21:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:46 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T11:21:46.756 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T11:21:46.756 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 ceph-mon[28069]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T11:21:46.756 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T11:21:46.756 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44818]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T11:21:46.756 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44818]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:46.756 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44818]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:46.756 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44818]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:46.756 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44823]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T11:21:46.756 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44823]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:46.756 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44823]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:46.757 INFO:journalctl@ceph.osd.0.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44823]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:46.778 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:46 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T11:21:46.778 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:46 smithi193 ceph-mon[32782]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T11:21:46.778 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:46 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T11:21:46.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:46.992+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2b1c063860 con 0x7f2b000a3c30 2024-04-26T11:21:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44845]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T11:21:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44845]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44845]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44845]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44848]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T11:21:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44848]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:46 smithi110 sudo[44848]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 sudo[44848]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.055 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:46 smithi193 sudo[41510]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T11:21:47.056 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:46 smithi193 sudo[41510]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.056 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:46 smithi193 sudo[41510]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.056 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:46 smithi193 sudo[41510]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.056 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:46 smithi193 sudo[41513]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T11:21:47.056 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:46 smithi193 sudo[41513]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.056 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:46 smithi193 sudo[41513]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.056 INFO:journalctl@ceph.osd.1.smithi193.stdout:Apr 26 11:21:46 smithi193 sudo[41513]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.255 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:46 smithi196 sudo[41408]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T11:21:47.255 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:46 smithi196 sudo[41408]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.255 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:46 smithi196 sudo[41408]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.256 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:46 smithi196 sudo[41408]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.256 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:46 smithi196 sudo[41411]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T11:21:47.256 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:46 smithi196 sudo[41411]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.256 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:46 smithi196 sudo[41411]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.256 INFO:journalctl@ceph.osd.2.smithi196.stdout:Apr 26 11:21:46 smithi196 sudo[41411]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 sudo[41414]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T11:21:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 sudo[41414]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 sudo[41414]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 sudo[41414]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 sudo[41417]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T11:21:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 sudo[41417]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 sudo[41417]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 sudo[41417]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 sudo[41516]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T11:21:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 sudo[41516]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 sudo[41516]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 sudo[41516]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 sudo[41519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T11:21:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 sudo[41519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T11:21:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 sudo[41519]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T11:21:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 sudo[41519]: pam_unix(sudo:session): session closed for user root 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T11:21:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:21:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:21:47.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T11:21:47.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:47 smithi196 ceph-mon[32572]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T11:21:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T11:21:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T11:21:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T11:21:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T11:21:47.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:21:47.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:21:47.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:21:47.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T11:21:47.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:47 smithi110 ceph-mon[28069]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T11:21:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T11:21:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T11:21:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T11:21:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:47 smithi193 ceph-mon[32782]: osdmap e22: 3 total, 3 up, 3 in 2024-04-26T11:21:48.517 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:48 smithi110 ceph-mon[28069]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:21:48.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:21:48.520+0000 7f2b13e00700 1 -- 172.21.15.110:0/2140354245 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f2b0c098e00 con 0x7f2b1c075e80 2024-04-26T11:21:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:48 smithi193 ceph-mon[32782]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:21:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:48 smithi196 ceph-mon[32572]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:21:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:49 smithi110 ceph-mon[28069]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:49 smithi110 ceph-mon[28069]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T11:21:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:49 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:21:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:49 smithi110 ceph-mon[28069]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T11:21:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:49 smithi193 ceph-mon[32782]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:49 smithi193 ceph-mon[32782]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T11:21:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:49 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:21:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:49 smithi193 ceph-mon[32782]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T11:21:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:49 smithi196 ceph-mon[32572]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:50.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:49 smithi196 ceph-mon[32572]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-26T11:21:50.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:49 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:21:50.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:49 smithi196 ceph-mon[32572]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T11:21:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:51 smithi110 ceph-mon[28069]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:51 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/110098445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12d8a1be-5edb-4af2-b01d-abd943f89641"}]: dispatch 2024-04-26T11:21:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:51 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/110098445' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12d8a1be-5edb-4af2-b01d-abd943f89641"}]': finished 2024-04-26T11:21:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:51 smithi110 ceph-mon[28069]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T11:21:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:21:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:51 smithi193 ceph-mon[32782]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:51 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/110098445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12d8a1be-5edb-4af2-b01d-abd943f89641"}]: dispatch 2024-04-26T11:21:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:51 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/110098445' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12d8a1be-5edb-4af2-b01d-abd943f89641"}]': finished 2024-04-26T11:21:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:51 smithi193 ceph-mon[32782]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T11:21:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:51 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:21:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:51 smithi196 ceph-mon[32572]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:51 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/110098445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12d8a1be-5edb-4af2-b01d-abd943f89641"}]: dispatch 2024-04-26T11:21:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:51 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/110098445' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12d8a1be-5edb-4af2-b01d-abd943f89641"}]': finished 2024-04-26T11:21:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:51 smithi196 ceph-mon[32572]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T11:21:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:51 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:21:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:52 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3808469766' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:21:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:52 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3808469766' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:21:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:52 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3808469766' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:21:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:53 smithi110 ceph-mon[28069]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:53 smithi193 ceph-mon[32782]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:53 smithi196 ceph-mon[32572]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:55.753 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:55 smithi110 ceph-mon[28069]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:55 smithi193 ceph-mon[32782]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:55 smithi196 ceph-mon[32572]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:57.860 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:57 smithi110 ceph-mon[28069]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:57 smithi193 ceph-mon[32782]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:57 smithi196 ceph-mon[32572]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:59.759 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:21:59 smithi110 ceph-mon[28069]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:21:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:21:59 smithi193 ceph-mon[32782]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:21:59 smithi196 ceph-mon[32572]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:00.835 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:00 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T11:22:00.835 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:00 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:00 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T11:22:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:00 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:00 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T11:22:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:00 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:01.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:01 smithi110 ceph-mon[28069]: Deploying daemon osd.3 on smithi110 2024-04-26T11:22:01.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:01 smithi110 ceph-mon[28069]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:01.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:01 smithi193 ceph-mon[32782]: Deploying daemon osd.3 on smithi110 2024-04-26T11:22:01.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:01 smithi193 ceph-mon[32782]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:01 smithi196 ceph-mon[32572]: Deploying daemon osd.3 on smithi110 2024-04-26T11:22:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:01 smithi196 ceph-mon[32572]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:03 smithi110 ceph-mon[28069]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:03 smithi193 ceph-mon[32782]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:03 smithi196 ceph-mon[32572]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:05.753 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:05 smithi110 ceph-mon[28069]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:05 smithi193 ceph-mon[32782]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:05 smithi196 ceph-mon[32572]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:07.715 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:07 smithi110 ceph-mon[28069]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:07 smithi193 ceph-mon[32782]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:07 smithi196 ceph-mon[32572]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:09.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:09.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:09.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:09.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:09 smithi110 ceph-mon[28069]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:09 smithi193 ceph-mon[32782]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:09 smithi196 ceph-mon[32572]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:11 smithi196 ceph-mon[32572]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:11 smithi110 ceph-mon[28069]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:11 smithi193 ceph-mon[32782]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:12 smithi110 ceph-mon[28069]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T11:22:12.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.739+0000 7f2b13e00700 1 -- 172.21.15.110:0/2140354245 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2b1c063860 con 0x7f2b000a3c30 2024-04-26T11:22:12.741 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 3 on host 'smithi110' 2024-04-26T11:22:12.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2b000a3c30 msgr2=0x7f2b000a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:12.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2b000a3c30 0x7f2b000a60f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009750 tx=0x7f2b08009310 comp rx=0 tx=0).stop 2024-04-26T11:22:12.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b1c075e80 msgr2=0x7f2b1c19fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:12.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b1c075e80 0x7f2b1c19fb60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00e9a0 tx=0x7f2b0c00ecb0 comp rx=0 tx=0).stop 2024-04-26T11:22:12.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 shutdown_connections 2024-04-26T11:22:12.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b1c10fa70 0x7f2b1c1a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:12.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2b000a3c30 0x7f2b000a60f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:12.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2b1c075e80 0x7f2b1c19fb60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:12.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 --2- 172.21.15.110:0/2140354245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b1c077450 0x7f2b1c1a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:12.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 >> 172.21.15.110:0/2140354245 conn(0x7f2b1c0fe9f0 msgr2=0x7f2b1c102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:22:12.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.743+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 shutdown_connections 2024-04-26T11:22:12.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:22:12.744+0000 7f2b22600700 1 -- 172.21.15.110:0/2140354245 wait complete. 2024-04-26T11:22:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:12 smithi196 ceph-mon[32572]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T11:22:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:12 smithi193 ceph-mon[32782]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T11:22:13.671 DEBUG:teuthology.orchestra.run.smithi110:osd.3> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.3.service 2024-04-26T11:22:13.676 INFO:tasks.cephadm:Deploying osd.4 on smithi193 with /dev/vg_nvme/lv_3... 2024-04-26T11:22:13.676 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T11:22:13.742 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:13 smithi110 ceph-mon[28069]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:13.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:13 smithi110 ceph-mon[28069]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T11:22:13.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:13 smithi110 ceph-mon[28069]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T11:22:13.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:13 smithi110 ceph-mon[28069]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:22:13.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:13 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:13.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:13 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:13 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:13 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.743 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:13 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:13 smithi196 ceph-mon[32572]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:13 smithi196 ceph-mon[32572]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T11:22:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:13 smithi196 ceph-mon[32572]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T11:22:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:13 smithi196 ceph-mon[32572]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:22:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:13 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:13 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:13 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:13 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:13 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:13 smithi193 ceph-mon[32782]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:13 smithi193 ceph-mon[32782]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T11:22:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:13 smithi193 ceph-mon[32782]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T11:22:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:13 smithi193 ceph-mon[32782]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:22:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:13 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:13 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:13 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:13 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:13 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:13.918 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T11:22:14.337 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 26 11:22:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-3[47089]: 2024-04-26T11:22:14.138+0000 7f957b200700 -1 osd.3 0 waiting for initial osdmap 2024-04-26T11:22:14.337 INFO:journalctl@ceph.osd.3.smithi110.stdout:Apr 26 11:22:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-3[47089]: 2024-04-26T11:22:14.160+0000 7f9571000700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:22:14.619 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:14 smithi110 ceph-mon[28069]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:22:14.619 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:14 smithi110 ceph-mon[28069]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T11:22:14.619 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:14.619 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:14.619 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:14 smithi110 ceph-mon[28069]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' 2024-04-26T11:22:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:14 smithi193 ceph-mon[32782]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:22:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:14 smithi193 ceph-mon[32782]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T11:22:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:14 smithi193 ceph-mon[32782]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' 2024-04-26T11:22:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:14 smithi196 ceph-mon[32572]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:22:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:14 smithi196 ceph-mon[32572]: osdmap e25: 4 total, 3 up, 4 in 2024-04-26T11:22:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:14.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:14.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:14 smithi196 ceph-mon[32572]: from='osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266]' entity='osd.3' 2024-04-26T11:22:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:15 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:22:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:15 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:22:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:15 smithi110 ceph-mon[28069]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:15 smithi110 ceph-mon[28069]: osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] boot 2024-04-26T11:22:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:15 smithi110 ceph-mon[28069]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T11:22:15.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:15.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:15 smithi110 ceph-mon[28069]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T11:22:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:15 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:22:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:15 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:22:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:15 smithi193 ceph-mon[32782]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:15 smithi193 ceph-mon[32782]: osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] boot 2024-04-26T11:22:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:15 smithi193 ceph-mon[32782]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T11:22:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:15 smithi193 ceph-mon[32782]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T11:22:15.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:15 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:22:15.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:15 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:22:15.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:15 smithi196 ceph-mon[32572]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-26T11:22:15.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:15 smithi196 ceph-mon[32572]: osd.3 [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] boot 2024-04-26T11:22:15.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:15 smithi196 ceph-mon[32572]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T11:22:15.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:22:15.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:15 smithi196 ceph-mon[32572]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T11:22:15.867 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T11:22:15.867 INFO:teuthology.orchestra.run.smithi193.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T11:22:15.868 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10+0 records in 2024-04-26T11:22:15.868 INFO:teuthology.orchestra.run.smithi193.stderr:10+0 records out 2024-04-26T11:22:15.868 INFO:teuthology.orchestra.run.smithi193.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112761 s, 930 MB/s 2024-04-26T11:22:15.868 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping successful for: 2024-04-26T11:22:16.578 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_3 2024-04-26T11:22:16.824 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T11:22:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:17 smithi196 ceph-mon[32572]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:17 smithi196 ceph-mon[32572]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T11:22:17.778 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:17 smithi110 ceph-mon[28069]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:17.778 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:17 smithi110 ceph-mon[28069]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T11:22:17.811 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:17 smithi193 ceph-mon[32782]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:17.811 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:17 smithi193 ceph-mon[32782]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T11:22:18.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.487+0000 7fa9e68ca700 1 -- 172.21.15.193:0/4185282849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e0103f50 msgr2=0x7fa9e010a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:18.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.487+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/4185282849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e0103f50 0x7fa9e010a800 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800b0d0 tx=0x7fa9d800b3e0 comp rx=0 tx=0).stop 2024-04-26T11:22:18.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.487+0000 7fa9e68ca700 1 -- 172.21.15.193:0/4185282849 shutdown_connections 2024-04-26T11:22:18.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.487+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/4185282849 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e0103f50 0x7fa9e010a800 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:18.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.487+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/4185282849 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9e01023b0 0x7fa9e01027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:18.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.487+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/4185282849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9e01035b0 0x7fa9e0103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:18.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.487+0000 7fa9e68ca700 1 -- 172.21.15.193:0/4185282849 >> 172.21.15.193:0/4185282849 conn(0x7fa9e00fd970 msgr2=0x7fa9e00ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:22:18.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.487+0000 7fa9e68ca700 1 -- 172.21.15.193:0/4185282849 shutdown_connections 2024-04-26T11:22:18.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.487+0000 7fa9e68ca700 1 -- 172.21.15.193:0/4185282849 wait complete. 2024-04-26T11:22:18.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9e68ca700 1 Processor -- start 2024-04-26T11:22:18.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9e68ca700 1 -- start start 2024-04-26T11:22:18.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9e68ca700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9e01023b0 0x7fa9e0199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:22:18.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9e68ca700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e01035b0 0x7fa9e0199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:22:18.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9e68ca700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9e0103f50 0x7fa9e01a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:22:18.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9e68ca700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e010df10 con 0x7fa9e01023b0 2024-04-26T11:22:18.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9e68ca700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e010dd90 con 0x7fa9e01035b0 2024-04-26T11:22:18.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9e68ca700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e010e090 con 0x7fa9e0103f50 2024-04-26T11:22:18.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e01035b0 0x7fa9e0199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:22:18.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e01035b0 0x7fa9e0199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:33350/0 (socket says 172.21.15.193:33350) 2024-04-26T11:22:18.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9df7fe700 1 -- 172.21.15.193:0/2560010167 learned_addr learned my addr 172.21.15.193:0/2560010167 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-04-26T11:22:18.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9e4e67700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9e0103f50 0x7fa9e01a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:22:18.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9dffff700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9e01023b0 0x7fa9e0199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:22:18.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9df7fe700 1 -- 172.21.15.193:0/2560010167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9e0103f50 msgr2=0x7fa9e01a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:18.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9df7fe700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9e0103f50 0x7fa9e01a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:18.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.488+0000 7fa9df7fe700 1 -- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9e01023b0 msgr2=0x7fa9e0199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:18.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.489+0000 7fa9df7fe700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9e01023b0 0x7fa9e0199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:18.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.489+0000 7fa9df7fe700 1 -- 172.21.15.193:0/2560010167 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e01a1270 con 0x7fa9e01035b0 2024-04-26T11:22:18.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.489+0000 7fa9df7fe700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e01035b0 0x7fa9e0199b50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400b530 tx=0x7fa9d400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:22:18.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.489+0000 7fa9dd7fa700 1 -- 172.21.15.193:0/2560010167 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4015020 con 0x7fa9e01035b0 2024-04-26T11:22:18.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.489+0000 7fa9dd7fa700 1 -- 172.21.15.193:0/2560010167 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d4011ce0 con 0x7fa9e01035b0 2024-04-26T11:22:18.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.489+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e01a1560 con 0x7fa9e01035b0 2024-04-26T11:22:18.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.489+0000 7fa9dd7fa700 1 -- 172.21.15.193:0/2560010167 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400f2e0 con 0x7fa9e01035b0 2024-04-26T11:22:18.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.489+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e01a1b20 con 0x7fa9e01035b0 2024-04-26T11:22:18.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.490+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e006a110 con 0x7fa9e01035b0 2024-04-26T11:22:18.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.491+0000 7fa9dd7fa700 1 -- 172.21.15.193:0/2560010167 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fa9d4018020 con 0x7fa9e01035b0 2024-04-26T11:22:18.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.492+0000 7fa9dd7fa700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa9c80a3c40 0x7fa9c80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:22:18.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.492+0000 7fa9dd7fa700 1 -- 172.21.15.193:0/2560010167 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3669+0+0 (secure 0 0 0) 0x7fa9d40cea00 con 0x7fa9e01035b0 2024-04-26T11:22:18.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.492+0000 7fa9dffff700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa9c80a3c40 0x7fa9c80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:22:18.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.493+0000 7fa9dffff700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa9c80a3c40 0x7fa9c80a6100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0103410 tx=0x7fa9d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:22:18.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.497+0000 7fa9dd7fa700 1 -- 172.21.15.193:0/2560010167 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa9d401f020 con 0x7fa9e01035b0 2024-04-26T11:22:18.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:18.702+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa9e006c200 con 0x7fa9c80a3c40 2024-04-26T11:22:18.703 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:18 smithi193 ceph-mon[32782]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T11:22:18.703 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.703 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.703 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:18.704 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:18.704 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.704 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:18.704 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:18.704 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:18 smithi196 ceph-mon[32572]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T11:22:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:18.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:18.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:18.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:18.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:18 smithi110 ceph-mon[28069]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T11:22:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:19.611 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:19 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi110 2024-04-26T11:22:19.611 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:19 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 8544M 2024-04-26T11:22:19.612 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:19 smithi193 ceph-mon[32782]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:19.612 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:19 smithi193 ceph-mon[32782]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T11:22:19.612 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:19.612 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:22:19.612 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:22:19.612 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:19 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi110 2024-04-26T11:22:19.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:19 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 8544M 2024-04-26T11:22:19.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:19 smithi196 ceph-mon[32572]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:19.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:19 smithi196 ceph-mon[32572]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T11:22:19.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:19.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:22:19.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:22:19.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:19 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi110 2024-04-26T11:22:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:19 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 8544M 2024-04-26T11:22:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:19 smithi110 ceph-mon[28069]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:19 smithi110 ceph-mon[28069]: osdmap e30: 4 total, 4 up, 4 in 2024-04-26T11:22:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:22:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:22:19.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:20.584 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:20 smithi193 ceph-mon[32782]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:22:20.584 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:20 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:20.584 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:20 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:20.584 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:20 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:20 smithi196 ceph-mon[32572]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:22:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:20 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:20 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:20 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:20 smithi110 ceph-mon[28069]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:22:20.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:20 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:20.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:20 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:20.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:20 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:21 smithi196 ceph-mon[32572]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-26T11:22:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:21 smithi196 ceph-mon[32572]: from='client.? 172.21.15.193:0/84736946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3057080-144b-4f43-9a63-8f415ca76d76"}]: dispatch 2024-04-26T11:22:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:21 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3057080-144b-4f43-9a63-8f415ca76d76"}]: dispatch 2024-04-26T11:22:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:21 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3057080-144b-4f43-9a63-8f415ca76d76"}]': finished 2024-04-26T11:22:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:21 smithi196 ceph-mon[32572]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T11:22:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:21 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:21.778 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:21 smithi193 ceph-mon[32782]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-26T11:22:21.778 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:21 smithi193 ceph-mon[32782]: from='client.? 172.21.15.193:0/84736946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3057080-144b-4f43-9a63-8f415ca76d76"}]: dispatch 2024-04-26T11:22:21.778 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:21 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3057080-144b-4f43-9a63-8f415ca76d76"}]: dispatch 2024-04-26T11:22:21.778 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:21 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3057080-144b-4f43-9a63-8f415ca76d76"}]': finished 2024-04-26T11:22:21.778 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:21 smithi193 ceph-mon[32782]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T11:22:21.778 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:21 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:21 smithi110 ceph-mon[28069]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-26T11:22:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:21 smithi110 ceph-mon[28069]: from='client.? 172.21.15.193:0/84736946' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3057080-144b-4f43-9a63-8f415ca76d76"}]: dispatch 2024-04-26T11:22:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:21 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3057080-144b-4f43-9a63-8f415ca76d76"}]: dispatch 2024-04-26T11:22:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:21 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3057080-144b-4f43-9a63-8f415ca76d76"}]': finished 2024-04-26T11:22:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:21 smithi110 ceph-mon[28069]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T11:22:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:21 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:22 smithi196 ceph-mon[32572]: from='client.? 172.21.15.193:0/2280974235' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:22:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:22 smithi110 ceph-mon[28069]: from='client.? 172.21.15.193:0/2280974235' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:22:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:22 smithi193 ceph-mon[32782]: from='client.? 172.21.15.193:0/2280974235' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:22:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:23 smithi196 ceph-mon[32572]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T11:22:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:23 smithi110 ceph-mon[28069]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T11:22:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:23 smithi193 ceph-mon[32782]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T11:22:25.732 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:25 smithi193 ceph-mon[32782]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-26T11:22:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:25 smithi110 ceph-mon[28069]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-26T11:22:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:25 smithi196 ceph-mon[32572]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-26T11:22:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:27 smithi110 ceph-mon[28069]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T11:22:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:27 smithi193 ceph-mon[32782]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T11:22:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:27 smithi196 ceph-mon[32572]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T11:22:29.700 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:29 smithi193 ceph-mon[32782]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T11:22:29.700 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T11:22:29.701 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:29 smithi110 ceph-mon[28069]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T11:22:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T11:22:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:29 smithi196 ceph-mon[32572]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T11:22:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T11:22:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:30 smithi193 ceph-mon[32782]: Deploying daemon osd.4 on smithi193 2024-04-26T11:22:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:30 smithi110 ceph-mon[28069]: Deploying daemon osd.4 on smithi193 2024-04-26T11:22:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:30 smithi196 ceph-mon[32572]: Deploying daemon osd.4 on smithi193 2024-04-26T11:22:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:31 smithi110 ceph-mon[28069]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:31 smithi193 ceph-mon[32782]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:31 smithi196 ceph-mon[32572]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:33.702 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:33 smithi193 ceph-mon[32782]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:33 smithi110 ceph-mon[28069]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:33 smithi196 ceph-mon[32572]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:35 smithi193 ceph-mon[32782]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:35 smithi196 ceph-mon[32572]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:35 smithi110 ceph-mon[28069]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:37 smithi196 ceph-mon[32572]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:37 smithi110 ceph-mon[28069]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:37.817 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:37 smithi193 ceph-mon[32782]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:37.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.890+0000 7fa9dd7fa700 1 -- 172.21.15.193:0/2560010167 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa9e006c200 con 0x7fa9c80a3c40 2024-04-26T11:22:37.892 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 4 on host 'smithi193' 2024-04-26T11:22:37.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa9c80a3c40 msgr2=0x7fa9c80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:37.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa9c80a3c40 0x7fa9c80a6100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0103410 tx=0x7fa9d0009260 comp rx=0 tx=0).stop 2024-04-26T11:22:37.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e01035b0 msgr2=0x7fa9e0199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:37.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e01035b0 0x7fa9e0199b50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400b530 tx=0x7fa9d400b840 comp rx=0 tx=0).stop 2024-04-26T11:22:37.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 shutdown_connections 2024-04-26T11:22:37.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa9c80a3c40 0x7fa9c80a6100 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:37.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9e0103f50 0x7fa9e01a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:37.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9e01023b0 0x7fa9e0199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:37.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 --2- 172.21.15.193:0/2560010167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9e01035b0 0x7fa9e0199b50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:37.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.892+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 >> 172.21.15.193:0/2560010167 conn(0x7fa9e00fd970 msgr2=0x7fa9e006baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:22:37.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.893+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 shutdown_connections 2024-04-26T11:22:37.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:22:37.893+0000 7fa9e68ca700 1 -- 172.21.15.193:0/2560010167 wait complete. 2024-04-26T11:22:38.606 DEBUG:teuthology.orchestra.run.smithi193:osd.4> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.4.service 2024-04-26T11:22:38.608 INFO:tasks.cephadm:Deploying osd.5 on smithi196 with /dev/vg_nvme/lv_3... 2024-04-26T11:22:38.608 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T11:22:38.853 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:22:38.976 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:38.977 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:38.977 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:38.977 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:38.977 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:38 smithi196 ceph-mon[32572]: from='osd.4 [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T11:22:38.977 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:38 smithi196 ceph-mon[32572]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T11:22:38.977 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:38 smithi196 ceph-mon[32572]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:38 smithi193 ceph-mon[32782]: from='osd.4 [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T11:22:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:38 smithi193 ceph-mon[32782]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T11:22:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:38 smithi193 ceph-mon[32782]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:38 smithi110 ceph-mon[28069]: from='osd.4 [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T11:22:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:38 smithi110 ceph-mon[28069]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T11:22:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:38 smithi110 ceph-mon[28069]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:40.102 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:40 smithi193 ceph-mon[32782]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T11:22:40.103 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:40 smithi193 ceph-mon[32782]: from='osd.4 [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:22:40.103 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:40 smithi193 ceph-mon[32782]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T11:22:40.103 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:40.103 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:40 smithi193 ceph-mon[32782]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:22:40.109 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:40 smithi196 ceph-mon[32572]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T11:22:40.109 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:40 smithi196 ceph-mon[32572]: from='osd.4 [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:22:40.109 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:40 smithi196 ceph-mon[32572]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T11:22:40.109 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:40.109 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:40 smithi196 ceph-mon[32572]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:22:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:40 smithi110 ceph-mon[28069]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T11:22:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:40 smithi110 ceph-mon[28069]: from='osd.4 [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:22:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:40 smithi110 ceph-mon[28069]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T11:22:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:40 smithi110 ceph-mon[28069]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:22:40.653 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T11:22:40.653 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T11:22:40.653 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-04-26T11:22:40.653 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-04-26T11:22:40.653 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011364 s, 923 MB/s 2024-04-26T11:22:40.653 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-04-26T11:22:40.872 INFO:journalctl@ceph.osd.4.smithi193.stdout:Apr 26 11:22:40 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-4[44336]: 2024-04-26T11:22:40.497+0000 7f6b78eb7700 -1 osd.4 0 waiting for initial osdmap 2024-04-26T11:22:40.872 INFO:journalctl@ceph.osd.4.smithi193.stdout:Apr 26 11:22:40 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-4[44336]: 2024-04-26T11:22:40.505+0000 7f6b704a1700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:22:41.271 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:41 smithi196 ceph-mon[32572]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:22:41.271 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:41 smithi196 ceph-mon[32572]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T11:22:41.272 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:41 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:41.272 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:41 smithi196 ceph-mon[32572]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:41.272 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:41 smithi196 ceph-mon[32572]: from='osd.4 ' entity='osd.4' 2024-04-26T11:22:41.272 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:41 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:41.273 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_3 2024-04-26T11:22:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:41 smithi110 ceph-mon[28069]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:22:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:41 smithi110 ceph-mon[28069]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T11:22:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:41 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:41 smithi110 ceph-mon[28069]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:41 smithi110 ceph-mon[28069]: from='osd.4 ' entity='osd.4' 2024-04-26T11:22:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:41 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:41.326 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:41 smithi193 ceph-mon[32782]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:22:41.326 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:41 smithi193 ceph-mon[32782]: osdmap e33: 5 total, 4 up, 5 in 2024-04-26T11:22:41.326 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:41 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:41.326 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:41 smithi193 ceph-mon[32782]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T11:22:41.326 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:41 smithi193 ceph-mon[32782]: from='osd.4 ' entity='osd.4' 2024-04-26T11:22:41.326 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:41 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:41.517 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:22:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:22:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:22:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: osd.4 [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] boot 2024-04-26T11:22:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T11:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:42 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: osd.4 [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] boot 2024-04-26T11:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T11:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:42 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.357 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: osd.4 [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] boot 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:42.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:42 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:43.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.084+0000 7f81aa2c2700 1 -- 172.21.15.196:0/513471440 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a41035a0 msgr2=0x7f81a4103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:43.087 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.084+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/513471440 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a41035a0 0x7f81a4103a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8198009990 tx=0x7f8198009ca0 comp rx=0 tx=0).stop 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.084+0000 7f81aa2c2700 1 -- 172.21.15.196:0/513471440 shutdown_connections 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.084+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/513471440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a4103f40 0x7f81a410a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.084+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/513471440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a41023a0 0x7f81a41027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.084+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/513471440 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a41035a0 0x7f81a4103a00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.084+0000 7f81aa2c2700 1 -- 172.21.15.196:0/513471440 >> 172.21.15.196:0/513471440 conn(0x7f81a40fd980 msgr2=0x7f81a40ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.084+0000 7f81aa2c2700 1 -- 172.21.15.196:0/513471440 shutdown_connections 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.084+0000 7f81aa2c2700 1 -- 172.21.15.196:0/513471440 wait complete. 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81aa2c2700 1 Processor -- start 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81aa2c2700 1 -- start start 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81aa2c2700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a41023a0 0x7f81a406c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81aa2c2700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a41035a0 0x7f81a419e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81aa2c2700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a4103f40 0x7f81a41a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:22:43.088 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81aa2c2700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f81a410deb0 con 0x7f81a41035a0 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81aa2c2700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81a410dd30 con 0x7f81a41023a0 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81aa2c2700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f81a410e030 con 0x7f81a4103f40 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81a885f700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a4103f40 0x7f81a41a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81a885f700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a4103f40 0x7f81a41a09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:55232/0 (socket says 172.21.15.196:55232) 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.085+0000 7f81a885f700 1 -- 172.21.15.196:0/2798374037 learned_addr learned my addr 172.21.15.196:0/2798374037 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a3fff700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a41023a0 0x7f81a406c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a885f700 1 -- 172.21.15.196:0/2798374037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a41023a0 msgr2=0x7f81a406c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a885f700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a41023a0 0x7f81a406c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a885f700 1 -- 172.21.15.196:0/2798374037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a41035a0 msgr2=0x7f81a419e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a885f700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a41035a0 0x7f81a419e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a885f700 1 -- 172.21.15.196:0/2798374037 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a41a12a0 con 0x7f81a4103f40 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a885f700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a4103f40 0x7f81a41a09d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f819c00b970 tx=0x7f819c00bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a17fa700 1 -- 172.21.15.196:0/2798374037 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c019070 con 0x7f81a4103f40 2024-04-26T11:22:43.089 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a17fa700 1 -- 172.21.15.196:0/2798374037 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f819c00cde0 con 0x7f81a4103f40 2024-04-26T11:22:43.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a41a1590 con 0x7f81a4103f40 2024-04-26T11:22:43.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81a17fa700 1 -- 172.21.15.196:0/2798374037 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c007370 con 0x7f81a4103f40 2024-04-26T11:22:43.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.086+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a41a1ad0 con 0x7f81a4103f40 2024-04-26T11:22:43.090 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.087+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a406a110 con 0x7f81a4103f40 2024-04-26T11:22:43.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.088+0000 7f81a17fa700 1 -- 172.21.15.196:0/2798374037 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f819c01c070 con 0x7f81a4103f40 2024-04-26T11:22:43.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.089+0000 7f81a17fa700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f818c0a3c40 0x7f818c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:22:43.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.089+0000 7f81a17fa700 1 -- 172.21.15.196:0/2798374037 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4101+0+0 (secure 0 0 0) 0x7f819c0ce850 con 0x7f81a4103f40 2024-04-26T11:22:43.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.089+0000 7f81a3fff700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f818c0a3c40 0x7f818c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:22:43.091 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.090+0000 7f81a3fff700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f818c0a3c40 0x7f818c0a6100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81a4103400 tx=0x7f819400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:22:43.094 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.093+0000 7f81a17fa700 1 -- 172.21.15.196:0/2798374037 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f819c09c2a0 con 0x7f81a4103f40 2024-04-26T11:22:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:43 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi193 2024-04-26T11:22:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:43 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 8544M 2024-04-26T11:22:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:43 smithi196 ceph-mon[32572]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:43 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi193 2024-04-26T11:22:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:43 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 8544M 2024-04-26T11:22:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:43 smithi110 ceph-mon[28069]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:43.303 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:22:43.302+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f81a4063860 con 0x7f818c0a3c40 2024-04-26T11:22:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:43 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi193 2024-04-26T11:22:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:43 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 8544M 2024-04-26T11:22:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:22:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:43 smithi193 ceph-mon[32782]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:44 smithi196 ceph-mon[32572]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T11:22:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:44 smithi196 ceph-mon[32572]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:22:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:44 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:22:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:44 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:22:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:44 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:44 smithi193 ceph-mon[32782]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T11:22:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:44 smithi193 ceph-mon[32782]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:22:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:44 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:22:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:44 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:22:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:44 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:44.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:44 smithi110 ceph-mon[28069]: osdmap e35: 5 total, 5 up, 5 in 2024-04-26T11:22:44.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:44 smithi110 ceph-mon[28069]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:22:44.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:22:44.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:22:44.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:45 smithi196 ceph-mon[32572]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:45 smithi193 ceph-mon[32782]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:45.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:45 smithi110 ceph-mon[28069]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:46.481 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:46 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/1469230015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0775b9c-938e-4bb4-ae1e-01ef0686cc66"}]: dispatch 2024-04-26T11:22:46.481 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:46 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0775b9c-938e-4bb4-ae1e-01ef0686cc66"}]: dispatch 2024-04-26T11:22:46.481 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:46 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0775b9c-938e-4bb4-ae1e-01ef0686cc66"}]': finished 2024-04-26T11:22:46.481 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:46 smithi196 ceph-mon[32572]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T11:22:46.481 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:46 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:22:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:46 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/1469230015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0775b9c-938e-4bb4-ae1e-01ef0686cc66"}]: dispatch 2024-04-26T11:22:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:46 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0775b9c-938e-4bb4-ae1e-01ef0686cc66"}]: dispatch 2024-04-26T11:22:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:46 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0775b9c-938e-4bb4-ae1e-01ef0686cc66"}]': finished 2024-04-26T11:22:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:46 smithi110 ceph-mon[28069]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T11:22:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:46 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:22:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:46 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/1469230015' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0775b9c-938e-4bb4-ae1e-01ef0686cc66"}]: dispatch 2024-04-26T11:22:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:46 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0775b9c-938e-4bb4-ae1e-01ef0686cc66"}]: dispatch 2024-04-26T11:22:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:46 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0775b9c-938e-4bb4-ae1e-01ef0686cc66"}]': finished 2024-04-26T11:22:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:46 smithi193 ceph-mon[32782]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T11:22:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:46 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:22:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:47 smithi196 ceph-mon[32572]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:47 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/190389409' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:22:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:47 smithi110 ceph-mon[28069]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:47 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/190389409' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:22:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:47 smithi193 ceph-mon[32782]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:47 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/190389409' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:22:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:49 smithi196 ceph-mon[32572]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:49 smithi110 ceph-mon[28069]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:49 smithi193 ceph-mon[32782]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:51 smithi196 ceph-mon[32572]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:51 smithi110 ceph-mon[28069]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:51 smithi193 ceph-mon[32782]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:53 smithi196 ceph-mon[32572]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T11:22:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:53 smithi110 ceph-mon[28069]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T11:22:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:53 smithi193 ceph-mon[32782]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T11:22:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:22:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:54 smithi196 ceph-mon[32572]: Deploying daemon osd.5 on smithi196 2024-04-26T11:22:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:54 smithi110 ceph-mon[28069]: Deploying daemon osd.5 on smithi196 2024-04-26T11:22:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:54 smithi193 ceph-mon[32782]: Deploying daemon osd.5 on smithi196 2024-04-26T11:22:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:55 smithi196 ceph-mon[32572]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:55 smithi110 ceph-mon[28069]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:55 smithi193 ceph-mon[32782]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:57 smithi196 ceph-mon[32572]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:57 smithi110 ceph-mon[28069]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:57 smithi193 ceph-mon[32782]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:59.686 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:59 smithi196 ceph-mon[32572]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:59.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:59.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:59.687 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:22:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:59 smithi110 ceph-mon[28069]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:22:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:22:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:59 smithi193 ceph-mon[32782]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:22:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:22:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:22:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:01.730 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:01 smithi196 ceph-mon[32572]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:23:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:01 smithi110 ceph-mon[28069]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:23:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:01 smithi193 ceph-mon[32782]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:23:02.486 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 5 on host 'smithi196' 2024-04-26T11:23:02.487 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.485+0000 7f81a17fa700 1 -- 172.21.15.196:0/2798374037 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f81a4063860 con 0x7f818c0a3c40 2024-04-26T11:23:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.487+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f818c0a3c40 msgr2=0x7f818c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.487+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f818c0a3c40 0x7f818c0a6100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81a4103400 tx=0x7f819400b410 comp rx=0 tx=0).stop 2024-04-26T11:23:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a4103f40 msgr2=0x7f81a41a09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a4103f40 0x7f81a41a09d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f819c00b970 tx=0x7f819c00bc80 comp rx=0 tx=0).stop 2024-04-26T11:23:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 shutdown_connections 2024-04-26T11:23:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f818c0a3c40 0x7f818c0a6100 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81a4103f40 0x7f81a41a09d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:02.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a41023a0 0x7f81a406c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 --2- 172.21.15.196:0/2798374037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81a41035a0 0x7f81a419e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 >> 172.21.15.196:0/2798374037 conn(0x7f81a40fd980 msgr2=0x7f81a4106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:23:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 shutdown_connections 2024-04-26T11:23:02.490 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:23:02.488+0000 7f81aa2c2700 1 -- 172.21.15.196:0/2798374037 wait complete. 2024-04-26T11:23:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='osd.5 [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T11:23:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:02 smithi196 ceph-mon[32572]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T11:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='osd.5 [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T11:23:02.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:02 smithi193 ceph-mon[32782]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T11:23:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='osd.5 [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T11:23:03.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:02 smithi110 ceph-mon[28069]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T11:23:03.180 DEBUG:teuthology.orchestra.run.smithi196:osd.5> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.5.service 2024-04-26T11:23:03.183 INFO:tasks.cephadm:Deploying osd.6 on smithi110 with /dev/vg_nvme/lv_2... 2024-04-26T11:23:03.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T11:23:03.620 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:23:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:03 smithi196 ceph-mon[32572]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:23:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:03 smithi196 ceph-mon[32572]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T11:23:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:03 smithi196 ceph-mon[32572]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T11:23:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:03 smithi196 ceph-mon[32572]: from='osd.5 [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:23:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:03 smithi196 ceph-mon[32572]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:23:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:03 smithi193 ceph-mon[32782]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:23:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:03 smithi193 ceph-mon[32782]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T11:23:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:03 smithi193 ceph-mon[32782]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T11:23:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:03 smithi193 ceph-mon[32782]: from='osd.5 [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:03 smithi193 ceph-mon[32782]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:23:03.952 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:03 smithi110 ceph-mon[28069]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:23:03.952 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:03 smithi110 ceph-mon[28069]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T11:23:03.952 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:03 smithi110 ceph-mon[28069]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T11:23:03.952 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:03 smithi110 ceph-mon[28069]: from='osd.5 [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:23:03.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:03.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:03 smithi110 ceph-mon[28069]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:23:05.434 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 26 11:23:05 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-26T11:23:05.011+0000 7f71e58a7700 -1 osd.5 0 waiting for initial osdmap 2024-04-26T11:23:05.434 INFO:journalctl@ceph.osd.5.smithi196.stdout:Apr 26 11:23:05 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-5[44307]: 2024-04-26T11:23:05.019+0000 7f71dd692700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:23:05.625 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:05 smithi110 ceph-mon[28069]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:23:05.625 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:05 smithi110 ceph-mon[28069]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:23:05.625 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:05 smithi110 ceph-mon[28069]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T11:23:05.625 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:05 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:05.625 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:05 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:05.626 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:05 smithi110 ceph-mon[28069]: from='osd.5 ' entity='osd.5' 2024-04-26T11:23:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:05 smithi196 ceph-mon[32572]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:23:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:05 smithi196 ceph-mon[32572]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:23:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:05 smithi196 ceph-mon[32572]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T11:23:05.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:05 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:05.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:05 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:05.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:05 smithi196 ceph-mon[32572]: from='osd.5 ' entity='osd.5' 2024-04-26T11:23:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:05 smithi193 ceph-mon[32782]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-04-26T11:23:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:05 smithi193 ceph-mon[32782]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:23:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:05 smithi193 ceph-mon[32782]: osdmap e38: 6 total, 5 up, 6 in 2024-04-26T11:23:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:05 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:05 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:05 smithi193 ceph-mon[32782]: from='osd.5 ' entity='osd.5' 2024-04-26T11:23:06.521 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T11:23:06.521 INFO:teuthology.orchestra.run.smithi110.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T11:23:06.521 INFO:teuthology.orchestra.run.smithi110.stderr: stderr: 10+0 records in 2024-04-26T11:23:06.522 INFO:teuthology.orchestra.run.smithi110.stderr:10+0 records out 2024-04-26T11:23:06.522 INFO:teuthology.orchestra.run.smithi110.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0362126 s, 290 MB/s 2024-04-26T11:23:06.522 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping successful for: 2024-04-26T11:23:06.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:23:06.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:23:06.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: osd.5 [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] boot 2024-04-26T11:23:06.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T11:23:06.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:06.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:06.760 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:06.760 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.760 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:06.760 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:06.760 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.760 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:06 smithi196 ceph-mon[32572]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T11:23:06.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:23:06.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:23:06.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: osd.5 [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] boot 2024-04-26T11:23:06.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T11:23:06.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:06.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:06 smithi110 ceph-mon[28069]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T11:23:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:23:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:23:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: osd.5 [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] boot 2024-04-26T11:23:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T11:23:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:23:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:06.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:06.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:06.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:06.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:06.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:06 smithi193 ceph-mon[32782]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T11:23:07.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_2 2024-04-26T11:23:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:07 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi196 2024-04-26T11:23:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:07 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 8544M 2024-04-26T11:23:07.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:07 smithi196 ceph-mon[32572]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:07 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi196 2024-04-26T11:23:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:07 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 8544M 2024-04-26T11:23:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:07 smithi110 ceph-mon[28069]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:07.838 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:23:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:07 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi196 2024-04-26T11:23:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:07 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 8544M 2024-04-26T11:23:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:07 smithi193 ceph-mon[32782]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:08 smithi196 ceph-mon[32572]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T11:23:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:08 smithi110 ceph-mon[28069]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T11:23:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:08 smithi193 ceph-mon[32782]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T11:23:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:09 smithi110 ceph-mon[28069]: pgmap v154: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:09 smithi110 ceph-mon[28069]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T11:23:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:09 smithi193 ceph-mon[32782]: pgmap v154: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:09 smithi193 ceph-mon[32782]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T11:23:09.929 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:09 smithi196 ceph-mon[32572]: pgmap v154: 1 pgs: 1 peering; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:09.929 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:09 smithi196 ceph-mon[32572]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T11:23:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.012+0000 7fdf58a00700 1 -- 172.21.15.110:0/784623996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf54103e40 msgr2=0x7fdf54106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.012+0000 7fdf58a00700 1 --2- 172.21.15.110:0/784623996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf54103e40 0x7fdf54106230 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf440098f0 tx=0x7fdf44009c00 comp rx=0 tx=0).stop 2024-04-26T11:23:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.012+0000 7fdf58a00700 1 -- 172.21.15.110:0/784623996 shutdown_connections 2024-04-26T11:23:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.012+0000 7fdf58a00700 1 --2- 172.21.15.110:0/784623996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf541090a0 0x7fdf5410b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.012+0000 7fdf58a00700 1 --2- 172.21.15.110:0/784623996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf54103e40 0x7fdf54106230 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.012+0000 7fdf58a00700 1 --2- 172.21.15.110:0/784623996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf54106770 0x7fdf54108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.012+0000 7fdf58a00700 1 -- 172.21.15.110:0/784623996 >> 172.21.15.110:0/784623996 conn(0x7fdf540fd830 msgr2=0x7fdf540ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:23:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.012+0000 7fdf58a00700 1 -- 172.21.15.110:0/784623996 shutdown_connections 2024-04-26T11:23:10.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.012+0000 7fdf58a00700 1 -- 172.21.15.110:0/784623996 wait complete. 2024-04-26T11:23:10.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.013+0000 7fdf58a00700 1 Processor -- start 2024-04-26T11:23:10.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf58a00700 1 -- start start 2024-04-26T11:23:10.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf58a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf54103e40 0x7fdf541994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:23:10.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf58a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf54106770 0x7fdf54199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf58a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf541090a0 0x7fdf541a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf58a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5410eec0 con 0x7fdf54106770 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf58a00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5410ed40 con 0x7fdf54103e40 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf58a00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5410f040 con 0x7fdf541090a0 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf52800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf54103e40 0x7fdf541994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf51e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf54106770 0x7fdf54199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf52800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf54103e40 0x7fdf541994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54650/0 (socket says 172.21.15.110:54650) 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf52800700 1 -- 172.21.15.110:0/3171114542 learned_addr learned my addr 172.21.15.110:0/3171114542 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.014+0000 7fdf53200700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf541090a0 0x7fdf541a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf52800700 1 -- 172.21.15.110:0/3171114542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf541090a0 msgr2=0x7fdf541a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf52800700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf541090a0 0x7fdf541a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf52800700 1 -- 172.21.15.110:0/3171114542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf54106770 msgr2=0x7fdf54199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:10.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf52800700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf54106770 0x7fdf54199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:10.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf52800700 1 -- 172.21.15.110:0/3171114542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf541a1150 con 0x7fdf54103e40 2024-04-26T11:23:10.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf52800700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf54103e40 0x7fdf541994f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c010 tx=0x7fdf44005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:23:10.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf4b400700 1 -- 172.21.15.110:0/3171114542 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44005460 con 0x7fdf54103e40 2024-04-26T11:23:10.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf541a13e0 con 0x7fdf54103e40 2024-04-26T11:23:10.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf4b400700 1 -- 172.21.15.110:0/3171114542 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf44005600 con 0x7fdf54103e40 2024-04-26T11:23:10.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf4b400700 1 -- 172.21.15.110:0/3171114542 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44003b60 con 0x7fdf54103e40 2024-04-26T11:23:10.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.015+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf541a1840 con 0x7fdf54103e40 2024-04-26T11:23:10.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.016+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf5406a110 con 0x7fdf54103e40 2024-04-26T11:23:10.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.018+0000 7fdf4b400700 1 -- 172.21.15.110:0/3171114542 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fdf44003d00 con 0x7fdf54103e40 2024-04-26T11:23:10.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.020+0000 7fdf4b400700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdf380a3c40 0x7fdf380a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:23:10.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.020+0000 7fdf4b400700 1 -- 172.21.15.110:0/3171114542 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4533+0+0 (secure 0 0 0) 0x7fdf440d0670 con 0x7fdf54103e40 2024-04-26T11:23:10.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.020+0000 7fdf51e00700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdf380a3c40 0x7fdf380a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:23:10.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.021+0000 7fdf51e00700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdf380a3c40 0x7fdf380a6100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009750 tx=0x7fdf40009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:23:10.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.022+0000 7fdf4b400700 1 -- 172.21.15.110:0/3171114542 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdf44013030 con 0x7fdf54103e40 2024-04-26T11:23:10.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:10.260+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fdf54063920 con 0x7fdf380a3c40 2024-04-26T11:23:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:10 smithi110 ceph-mon[28069]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T11:23:10.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:23:10.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:23:10.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:10.848 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:10 smithi196 ceph-mon[32572]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T11:23:10.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:23:10.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:23:10.849 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:10 smithi193 ceph-mon[32782]: osdmap e43: 6 total, 6 up, 6 in 2024-04-26T11:23:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:23:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:23:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:11 smithi110 ceph-mon[28069]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:23:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:11 smithi110 ceph-mon[28069]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T11:23:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:11 smithi193 ceph-mon[32782]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:23:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:11 smithi193 ceph-mon[32782]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T11:23:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:11 smithi196 ceph-mon[32572]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:23:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:11 smithi196 ceph-mon[32572]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T11:23:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:13 smithi110 ceph-mon[28069]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T11:23:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:13 smithi193 ceph-mon[32782]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T11:23:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:13 smithi196 ceph-mon[32572]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T11:23:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:14 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1927722207' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea4ea3de-4ec4-48a1-809e-da62fcbb7033"}]: dispatch 2024-04-26T11:23:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:14 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1927722207' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea4ea3de-4ec4-48a1-809e-da62fcbb7033"}]': finished 2024-04-26T11:23:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:14 smithi110 ceph-mon[28069]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T11:23:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:14 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1927722207' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea4ea3de-4ec4-48a1-809e-da62fcbb7033"}]: dispatch 2024-04-26T11:23:14.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:14 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1927722207' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea4ea3de-4ec4-48a1-809e-da62fcbb7033"}]': finished 2024-04-26T11:23:14.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:14 smithi193 ceph-mon[32782]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T11:23:14.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:14 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1927722207' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea4ea3de-4ec4-48a1-809e-da62fcbb7033"}]: dispatch 2024-04-26T11:23:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:14 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1927722207' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea4ea3de-4ec4-48a1-809e-da62fcbb7033"}]': finished 2024-04-26T11:23:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:14 smithi196 ceph-mon[32572]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T11:23:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:15 smithi110 ceph-mon[28069]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-26T11:23:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:15 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1943763642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:23:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:15 smithi193 ceph-mon[32782]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-26T11:23:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:15 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1943763642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:23:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:15 smithi196 ceph-mon[32572]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-04-26T11:23:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:15 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1943763642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:23:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:17 smithi110 ceph-mon[28069]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-26T11:23:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:17 smithi193 ceph-mon[32782]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-26T11:23:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:17 smithi196 ceph-mon[32572]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-26T11:23:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:19 smithi193 ceph-mon[32782]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-26T11:23:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:19 smithi196 ceph-mon[32572]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-26T11:23:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:19 smithi110 ceph-mon[28069]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-04-26T11:23:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:21 smithi110 ceph-mon[28069]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:21 smithi193 ceph-mon[32782]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:21 smithi196 ceph-mon[32572]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:23 smithi110 ceph-mon[28069]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:23 smithi193 ceph-mon[32782]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:23 smithi196 ceph-mon[32572]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:24 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T11:23:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:24 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:24.882 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:24 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T11:23:24.882 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:24 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:24 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T11:23:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:24 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:25.847 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:25 smithi110 ceph-mon[28069]: Deploying daemon osd.6 on smithi110 2024-04-26T11:23:25.847 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:25 smithi110 ceph-mon[28069]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:25 smithi193 ceph-mon[32782]: Deploying daemon osd.6 on smithi110 2024-04-26T11:23:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:25 smithi193 ceph-mon[32782]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:25 smithi196 ceph-mon[32572]: Deploying daemon osd.6 on smithi110 2024-04-26T11:23:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:25 smithi196 ceph-mon[32572]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:27.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:27 smithi110 ceph-mon[28069]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:27 smithi193 ceph-mon[32782]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:27 smithi196 ceph-mon[32572]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:29.765 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:29 smithi110 ceph-mon[28069]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:29 smithi193 ceph-mon[32782]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:29 smithi196 ceph-mon[32572]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:31 smithi193 ceph-mon[32782]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:31.916 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:31 smithi110 ceph-mon[28069]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:31 smithi196 ceph-mon[32572]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:33.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:33 smithi110 ceph-mon[28069]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:33 smithi193 ceph-mon[32782]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:33 smithi196 ceph-mon[32572]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:35.866 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:35 smithi110 ceph-mon[28069]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:35 smithi193 ceph-mon[32782]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:35 smithi196 ceph-mon[32572]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:37 smithi110 ceph-mon[28069]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:37 smithi110 ceph-mon[28069]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T11:23:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:37 smithi193 ceph-mon[32782]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:37 smithi193 ceph-mon[32782]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T11:23:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:37 smithi196 ceph-mon[32572]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:37 smithi196 ceph-mon[32572]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T11:23:37.664 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 6 on host 'smithi110' 2024-04-26T11:23:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.662+0000 7fdf4b400700 1 -- 172.21.15.110:0/3171114542 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdf54063920 con 0x7fdf380a3c40 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.665+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdf380a3c40 msgr2=0x7fdf380a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.665+0000 7fdf58a00700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdf380a3c40 0x7fdf380a6100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009750 tx=0x7fdf40009310 comp rx=0 tx=0).stop 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.665+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf54103e40 msgr2=0x7fdf541994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.665+0000 7fdf58a00700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf54103e40 0x7fdf541994f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c010 tx=0x7fdf44005270 comp rx=0 tx=0).stop 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.666+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 shutdown_connections 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.666+0000 7fdf58a00700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdf380a3c40 0x7fdf380a6100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.666+0000 7fdf58a00700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf541090a0 0x7fdf541a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.666+0000 7fdf58a00700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf54103e40 0x7fdf541994f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.666+0000 7fdf58a00700 1 --2- 172.21.15.110:0/3171114542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf54106770 0x7fdf54199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.666+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 >> 172.21.15.110:0/3171114542 conn(0x7fdf540fd830 msgr2=0x7fdf54105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:23:37.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.666+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 shutdown_connections 2024-04-26T11:23:37.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:23:37.666+0000 7fdf58a00700 1 -- 172.21.15.110:0/3171114542 wait complete. 2024-04-26T11:23:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:38 smithi110 ceph-mon[28069]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T11:23:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:38 smithi110 ceph-mon[28069]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T11:23:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:38 smithi110 ceph-mon[28069]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:23:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:38 smithi193 ceph-mon[32782]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T11:23:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:38 smithi193 ceph-mon[32782]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T11:23:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:38 smithi193 ceph-mon[32782]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:23:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:38.450 DEBUG:teuthology.orchestra.run.smithi110:osd.6> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.6.service 2024-04-26T11:23:38.457 INFO:tasks.cephadm:Deploying osd.7 on smithi193 with /dev/vg_nvme/lv_2... 2024-04-26T11:23:38.457 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T11:23:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:38 smithi196 ceph-mon[32572]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T11:23:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:38 smithi196 ceph-mon[32572]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T11:23:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:38 smithi196 ceph-mon[32572]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:23:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:38.704 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T11:23:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:39 smithi110 ceph-mon[28069]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:23:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:39 smithi110 ceph-mon[28069]: osdmap e46: 7 total, 6 up, 7 in 2024-04-26T11:23:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:39 smithi110 ceph-mon[28069]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:39.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:39 smithi196 ceph-mon[32572]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:23:39.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:39 smithi196 ceph-mon[32572]: osdmap e46: 7 total, 6 up, 7 in 2024-04-26T11:23:39.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:39.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:39.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:39 smithi196 ceph-mon[32572]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:39 smithi193 ceph-mon[32782]: from='osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:23:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:39 smithi193 ceph-mon[32782]: osdmap e46: 7 total, 6 up, 7 in 2024-04-26T11:23:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:39 smithi193 ceph-mon[32782]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 185 MiB used, 536 GiB / 536 GiB avail 2024-04-26T11:23:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:40 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:23:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:40 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:23:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:40 smithi193 ceph-mon[32782]: osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] boot 2024-04-26T11:23:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:40 smithi193 ceph-mon[32782]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T11:23:40.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:40 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:23:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:40 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:23:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:40 smithi196 ceph-mon[32572]: osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] boot 2024-04-26T11:23:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:40 smithi196 ceph-mon[32572]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T11:23:40.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:40.520 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:40 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:23:40.520 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:40 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:23:40.520 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:40 smithi110 ceph-mon[28069]: osd.6 [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] boot 2024-04-26T11:23:40.520 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:40 smithi110 ceph-mon[28069]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T11:23:40.520 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:23:40.669 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T11:23:40.669 INFO:teuthology.orchestra.run.smithi193.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T11:23:40.669 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10+0 records in 2024-04-26T11:23:40.669 INFO:teuthology.orchestra.run.smithi193.stderr:10+0 records out 2024-04-26T11:23:40.669 INFO:teuthology.orchestra.run.smithi193.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131742 s, 796 MB/s 2024-04-26T11:23:40.669 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 2024-04-26T11:23:40.669 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping successful for: 2024-04-26T11:23:41.287 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:41 smithi193 ceph-mon[32782]: osdmap e48: 7 total, 7 up, 7 in 2024-04-26T11:23:41.287 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:41 smithi193 ceph-mon[32782]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:41.315 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_2 2024-04-26T11:23:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:41 smithi196 ceph-mon[32572]: osdmap e48: 7 total, 7 up, 7 in 2024-04-26T11:23:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:41 smithi196 ceph-mon[32572]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:41 smithi110 ceph-mon[28069]: osdmap e48: 7 total, 7 up, 7 in 2024-04-26T11:23:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:41 smithi110 ceph-mon[28069]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:41.556 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 -- 172.21.15.193:0/2901571350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 msgr2=0x7f4c841038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/2901571350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 0x7f4c841038d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4c740099c0 tx=0x7f4c74009cd0 comp rx=0 tx=0).stop 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 -- 172.21.15.193:0/2901571350 shutdown_connections 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/2901571350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84105050 0x7f4c8410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/2901571350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 0x7f4c841038d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/2901571350 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c841046b0 0x7f4c84104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 -- 172.21.15.193:0/2901571350 >> 172.21.15.193:0/2901571350 conn(0x7f4c840fea70 msgr2=0x7f4c84100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 -- 172.21.15.193:0/2901571350 shutdown_connections 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 -- 172.21.15.193:0/2901571350 wait complete. 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 Processor -- start 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.173+0000 7f4c8a92c700 1 -- start start 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c8a92c700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 0x7f4c84199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c8a92c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c841046b0 0x7f4c84199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c8a92c700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84105050 0x7f4c841a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c8a92c700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8410efb0 con 0x7f4c84105050 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c8a92c700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8410ee30 con 0x7f4c841034b0 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c8a92c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8410f130 con 0x7f4c841046b0 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c83fff700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 0x7f4c84199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c83fff700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 0x7f4c84199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:60322/0 (socket says 172.21.15.193:60322) 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c83fff700 1 -- 172.21.15.193:0/67990306 learned_addr learned my addr 172.21.15.193:0/67990306 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c837fe700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c841046b0 0x7f4c84199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c83fff700 1 -- 172.21.15.193:0/67990306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c841046b0 msgr2=0x7f4c84199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c83fff700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c841046b0 0x7f4c84199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c83fff700 1 -- 172.21.15.193:0/67990306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84105050 msgr2=0x7f4c841a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c83fff700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84105050 0x7f4c841a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c83fff700 1 -- 172.21.15.193:0/67990306 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c841a12b0 con 0x7f4c841034b0 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c837fe700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c841046b0 0x7f4c84199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.174+0000 7f4c83fff700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 0x7f4c84199650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4c740038c0 tx=0x7f4c740047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.175+0000 7f4c817fa700 1 -- 172.21.15.193:0/67990306 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74027070 con 0x7f4c841034b0 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.175+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c841a1540 con 0x7f4c841034b0 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.175+0000 7f4c817fa700 1 -- 172.21.15.193:0/67990306 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c740041a0 con 0x7f4c841034b0 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.175+0000 7f4c817fa700 1 -- 172.21.15.193:0/67990306 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7400f460 con 0x7f4c841034b0 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.175+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c841a1a20 con 0x7f4c841034b0 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.176+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8406a110 con 0x7f4c841034b0 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.177+0000 7f4c817fa700 1 -- 172.21.15.193:0/67990306 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f4c7402a070 con 0x7f4c841034b0 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.177+0000 7f4c817fa700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4c6c0a3c40 0x7f4c6c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.178+0000 7f4c817fa700 1 -- 172.21.15.193:0/67990306 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4965+0+0 (secure 0 0 0) 0x7f4c740d0bb0 con 0x7f4c841034b0 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.178+0000 7f4c837fe700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4c6c0a3c40 0x7f4c6c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:23:43.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.179+0000 7f4c837fe700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4c6c0a3c40 0x7f4c6c0a6100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c78005950 tx=0x7f4c780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:23:43.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.181+0000 7f4c817fa700 1 -- 172.21.15.193:0/67990306 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4c74031070 con 0x7f4c841034b0 2024-04-26T11:23:43.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:23:43.388+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4c84063860 con 0x7f4c6c0a3c40 2024-04-26T11:23:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:23:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:23:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:23:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:23:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:43.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:43.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:43.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:43.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:43.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:43.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:43.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:23:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:23:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:23:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:44 smithi193 ceph-mon[32782]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:23:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:44 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi110 2024-04-26T11:23:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:44 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 5696M 2024-04-26T11:23:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:44 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:44 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:44 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:44 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:44 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:44 smithi196 ceph-mon[32572]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:23:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:44 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi110 2024-04-26T11:23:44.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:44 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 5696M 2024-04-26T11:23:44.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:44 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:44.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:44 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:44.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:44 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:44.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:44 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:44.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:44 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:44 smithi110 ceph-mon[28069]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:23:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:44 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi110 2024-04-26T11:23:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:44 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 5696M 2024-04-26T11:23:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:23:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:45 smithi193 ceph-mon[32782]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:45 smithi196 ceph-mon[32572]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:45 smithi110 ceph-mon[28069]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:46 smithi196 ceph-mon[32572]: from='client.? 172.21.15.193:0/2626104974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98af7071-82b3-4732-b2a1-8676e6439cd1"}]: dispatch 2024-04-26T11:23:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:46 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98af7071-82b3-4732-b2a1-8676e6439cd1"}]: dispatch 2024-04-26T11:23:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:46 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98af7071-82b3-4732-b2a1-8676e6439cd1"}]': finished 2024-04-26T11:23:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:46 smithi196 ceph-mon[32572]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T11:23:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:46 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:23:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:46 smithi110 ceph-mon[28069]: from='client.? 172.21.15.193:0/2626104974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98af7071-82b3-4732-b2a1-8676e6439cd1"}]: dispatch 2024-04-26T11:23:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:46 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98af7071-82b3-4732-b2a1-8676e6439cd1"}]: dispatch 2024-04-26T11:23:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:46 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98af7071-82b3-4732-b2a1-8676e6439cd1"}]': finished 2024-04-26T11:23:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:46 smithi110 ceph-mon[28069]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T11:23:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:46 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:23:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:46 smithi193 ceph-mon[32782]: from='client.? 172.21.15.193:0/2626104974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98af7071-82b3-4732-b2a1-8676e6439cd1"}]: dispatch 2024-04-26T11:23:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:46 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98af7071-82b3-4732-b2a1-8676e6439cd1"}]: dispatch 2024-04-26T11:23:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:46 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98af7071-82b3-4732-b2a1-8676e6439cd1"}]': finished 2024-04-26T11:23:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:46 smithi193 ceph-mon[32782]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T11:23:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:46 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:23:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:47 smithi196 ceph-mon[32572]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:47 smithi196 ceph-mon[32572]: from='client.? 172.21.15.193:0/733952302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:23:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:47 smithi110 ceph-mon[28069]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:47 smithi110 ceph-mon[28069]: from='client.? 172.21.15.193:0/733952302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:23:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:47 smithi193 ceph-mon[32782]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:47 smithi193 ceph-mon[32782]: from='client.? 172.21.15.193:0/733952302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:23:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:49 smithi196 ceph-mon[32572]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:49 smithi110 ceph-mon[28069]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:49.823 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:49 smithi193 ceph-mon[32782]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:51 smithi193 ceph-mon[32782]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:51 smithi196 ceph-mon[32572]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:51 smithi110 ceph-mon[28069]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:53 smithi193 ceph-mon[32782]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:53 smithi196 ceph-mon[32572]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:53 smithi110 ceph-mon[28069]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T11:23:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:54.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:54 smithi196 ceph-mon[32572]: Deploying daemon osd.7 on smithi193 2024-04-26T11:23:54.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:54 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T11:23:54.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:54 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:54.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:54 smithi110 ceph-mon[28069]: Deploying daemon osd.7 on smithi193 2024-04-26T11:23:54.835 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:54 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T11:23:54.835 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:54 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:23:54.835 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:54 smithi193 ceph-mon[32782]: Deploying daemon osd.7 on smithi193 2024-04-26T11:23:55.767 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:55 smithi110 ceph-mon[28069]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:55.789 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:55 smithi193 ceph-mon[32782]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:55 smithi196 ceph-mon[32572]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:57 smithi193 ceph-mon[32782]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:57 smithi110 ceph-mon[28069]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:57 smithi196 ceph-mon[32572]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:59 smithi110 ceph-mon[28069]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:23:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:23:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:59 smithi193 ceph-mon[32782]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:23:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:23:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:23:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:59 smithi196 ceph-mon[32572]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:23:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:01 smithi110 ceph-mon[28069]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:01.850 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:01 smithi193 ceph-mon[32782]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:01 smithi196 ceph-mon[32572]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:03.184 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 7 on host 'smithi193' 2024-04-26T11:24:03.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.183+0000 7f4c817fa700 1 -- 172.21.15.193:0/67990306 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4c84063860 con 0x7f4c6c0a3c40 2024-04-26T11:24:03.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.185+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4c6c0a3c40 msgr2=0x7f4c6c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4c6c0a3c40 0x7f4c6c0a6100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c78005950 tx=0x7f4c780058e0 comp rx=0 tx=0).stop 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 msgr2=0x7f4c84199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 0x7f4c84199650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4c740038c0 tx=0x7f4c740047b0 comp rx=0 tx=0).stop 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 shutdown_connections 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c84105050 0x7f4c841a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c841034b0 0x7f4c84199650 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4c6c0a3c40 0x7f4c6c0a6100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 --2- 172.21.15.193:0/67990306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c841046b0 0x7f4c84199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 >> 172.21.15.193:0/67990306 conn(0x7f4c840fea70 msgr2=0x7f4c84107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 shutdown_connections 2024-04-26T11:24:03.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:24:03.186+0000 7f4c8a92c700 1 -- 172.21.15.193:0/67990306 wait complete. 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='osd.7 [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:03.491 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:03.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='osd.7 [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T11:24:03.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T11:24:03.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:03.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='osd.7 [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T11:24:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T11:24:03.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:03.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:03.904 DEBUG:teuthology.orchestra.run.smithi193:osd.7> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.7.service 2024-04-26T11:24:03.908 INFO:tasks.cephadm:Deploying osd.8 on smithi196 with /dev/vg_nvme/lv_2... 2024-04-26T11:24:03.908 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T11:24:04.153 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:24:04.482 INFO:journalctl@ceph.osd.7.smithi193.stdout:Apr 26 11:24:04 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-7[50911]: 2024-04-26T11:24:04.303+0000 7f201fe5a700 -1 osd.7 0 waiting for initial osdmap 2024-04-26T11:24:04.483 INFO:journalctl@ceph.osd.7.smithi193.stdout:Apr 26 11:24:04 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-7[50911]: 2024-04-26T11:24:04.312+0000 7f201bc4d700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:24:04.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:04 smithi193 ceph-mon[32782]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T11:24:04.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:04 smithi193 ceph-mon[32782]: from='osd.7 [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:24:04.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:04 smithi193 ceph-mon[32782]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T11:24:04.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:24:04.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:04 smithi193 ceph-mon[32782]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:24:04.590 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:04 smithi196 ceph-mon[32572]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T11:24:04.590 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:04 smithi196 ceph-mon[32572]: from='osd.7 [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:24:04.590 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:04 smithi196 ceph-mon[32572]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T11:24:04.591 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:04 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:24:04.591 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:04 smithi196 ceph-mon[32572]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:24:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:04 smithi110 ceph-mon[28069]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T11:24:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:04 smithi110 ceph-mon[28069]: from='osd.7 [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:24:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:04 smithi110 ceph-mon[28069]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T11:24:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:04 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:24:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:04 smithi110 ceph-mon[28069]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:24:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:05 smithi193 ceph-mon[32782]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:24:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:05 smithi193 ceph-mon[32782]: osdmap e51: 8 total, 7 up, 8 in 2024-04-26T11:24:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:05 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:24:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:05 smithi193 ceph-mon[32782]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:05.428 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:05 smithi196 ceph-mon[32572]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:24:05.429 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:05 smithi196 ceph-mon[32572]: osdmap e51: 8 total, 7 up, 8 in 2024-04-26T11:24:05.429 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:05 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:24:05.429 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:05 smithi196 ceph-mon[32572]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:05.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:05 smithi110 ceph-mon[28069]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:24:05.795 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:05 smithi110 ceph-mon[28069]: osdmap e51: 8 total, 7 up, 8 in 2024-04-26T11:24:05.795 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:05 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:24:05.795 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:05 smithi110 ceph-mon[28069]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-04-26T11:24:06.005 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T11:24:06.006 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T11:24:06.006 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-04-26T11:24:06.006 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-04-26T11:24:06.006 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113568 s, 923 MB/s 2024-04-26T11:24:06.006 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-04-26T11:24:06.584 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:06 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:24:06.584 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:06 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:24:06.585 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:06 smithi193 ceph-mon[32782]: osd.7 [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] boot 2024-04-26T11:24:06.585 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:06 smithi193 ceph-mon[32782]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T11:24:06.585 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:24:06.585 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:06 smithi193 ceph-mon[32782]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T11:24:06.585 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:06 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:24:06.585 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:06 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:24:06.585 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:06 smithi196 ceph-mon[32572]: osd.7 [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] boot 2024-04-26T11:24:06.585 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:06 smithi196 ceph-mon[32572]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T11:24:06.585 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:24:06.586 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:06 smithi196 ceph-mon[32572]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T11:24:06.612 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_2 2024-04-26T11:24:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:06 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:24:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:06 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:24:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:06 smithi110 ceph-mon[28069]: osd.7 [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] boot 2024-04-26T11:24:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:06 smithi110 ceph-mon[28069]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T11:24:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:24:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:06 smithi110 ceph-mon[28069]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T11:24:06.853 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:24:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: pgmap v195: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:07.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:07.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:07.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:07.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:07 smithi193 ceph-mon[32782]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T11:24:07.666 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: pgmap v195: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:07.666 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.666 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.666 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:07.666 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:07.666 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:07.667 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.667 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:07.667 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:07.667 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.667 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:07 smithi196 ceph-mon[32572]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: pgmap v195: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:07 smithi110 ceph-mon[28069]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.414+0000 7f07a537d700 1 -- 172.21.15.196:0/1594073109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01091d0 msgr2=0x7f07a010b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.414+0000 7f07a537d700 1 --2- 172.21.15.196:0/1594073109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01091d0 0x7f07a010b5e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f079800b0a0 tx=0x7f079800b3b0 comp rx=0 tx=0).stop 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.414+0000 7f07a537d700 1 -- 172.21.15.196:0/1594073109 shutdown_connections 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.414+0000 7f07a537d700 1 --2- 172.21.15.196:0/1594073109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01091d0 0x7f07a010b5e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.414+0000 7f07a537d700 1 --2- 172.21.15.196:0/1594073109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07a0103f70 0x7f07a0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.414+0000 7f07a537d700 1 --2- 172.21.15.196:0/1594073109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07a01068a0 0x7f07a0108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.414+0000 7f07a537d700 1 -- 172.21.15.196:0/1594073109 >> 172.21.15.196:0/1594073109 conn(0x7f07a00fd920 msgr2=0x7f07a00ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.414+0000 7f07a537d700 1 -- 172.21.15.196:0/1594073109 shutdown_connections 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.414+0000 7f07a537d700 1 -- 172.21.15.196:0/1594073109 wait complete. 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f07a537d700 1 Processor -- start 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f07a537d700 1 -- start start 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f07a537d700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07a0103f70 0x7f07a0199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f07a537d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01068a0 0x7f07a0199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f07a537d700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07a01091d0 0x7f07a01a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f07a537d700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f07a010f030 con 0x7f07a01091d0 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f07a537d700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f07a010eeb0 con 0x7f07a0103f70 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f07a537d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f07a010f1b0 con 0x7f07a01068a0 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f079e7fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01068a0 0x7f07a0199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f079e7fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01068a0 0x7f07a0199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:45580/0 (socket says 172.21.15.196:45580) 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f079e7fc700 1 -- 172.21.15.196:0/1802052455 learned_addr learned my addr 172.21.15.196:0/1802052455 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.415+0000 7f079effd700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07a0103f70 0x7f07a0199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f079e7fc700 1 -- 172.21.15.196:0/1802052455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07a0103f70 msgr2=0x7f07a0199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f079e7fc700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07a0103f70 0x7f07a0199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f079e7fc700 1 -- 172.21.15.196:0/1802052455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07a01091d0 msgr2=0x7f07a01a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f079e7fc700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07a01091d0 0x7f07a01a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f079e7fc700 1 -- 172.21.15.196:0/1802052455 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a01a1370 con 0x7f07a01068a0 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f079e7fc700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01068a0 0x7f07a0199c50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f078800b560 tx=0x7f078800b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f0797fff700 1 -- 172.21.15.196:0/1802052455 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788015020 con 0x7f07a01068a0 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a01a1660 con 0x7f07a01068a0 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f0797fff700 1 -- 172.21.15.196:0/1802052455 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0788011ce0 con 0x7f07a01068a0 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f0797fff700 1 -- 172.21.15.196:0/1802052455 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788010da0 con 0x7f07a01068a0 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.416+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a01a1c20 con 0x7f07a01068a0 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.417+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a006a110 con 0x7f07a01068a0 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.418+0000 7f0797fff700 1 -- 172.21.15.196:0/1802052455 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f0788018020 con 0x7f07a01068a0 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.418+0000 7f0797fff700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f078c0a3c40 0x7f078c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.419+0000 7f0797fff700 1 -- 172.21.15.196:0/1802052455 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5397+0+0 (secure 0 0 0) 0x7f07880cf0d0 con 0x7f07a01068a0 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.419+0000 7f079effd700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f078c0a3c40 0x7f078c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.420+0000 7f079effd700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f078c0a3c40 0x7f078c0a6100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0790006fd0 tx=0x7f0790008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.423+0000 7f0797fff700 1 -- 172.21.15.196:0/1802052455 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f078801f020 con 0x7f07a01068a0 2024-04-26T11:24:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:08 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi193 2024-04-26T11:24:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:08 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 5696M 2024-04-26T11:24:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:08 smithi193 ceph-mon[32782]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-04-26T11:24:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:08 smithi193 ceph-mon[32782]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T11:24:08.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:08.628+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f07a0063860 con 0x7f078c0a3c40 2024-04-26T11:24:08.630 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:08 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi193 2024-04-26T11:24:08.630 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:08 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 5696M 2024-04-26T11:24:08.630 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:08 smithi196 ceph-mon[32572]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-04-26T11:24:08.630 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:08 smithi196 ceph-mon[32572]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T11:24:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:08 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi193 2024-04-26T11:24:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:08 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 5696M 2024-04-26T11:24:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:08 smithi110 ceph-mon[28069]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-04-26T11:24:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:08 smithi110 ceph-mon[28069]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T11:24:09.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:09 smithi196 ceph-mon[32572]: pgmap v198: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:09.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:24:09.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:24:09.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:09.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:09 smithi196 ceph-mon[32572]: osdmap e56: 8 total, 8 up, 8 in 2024-04-26T11:24:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:09 smithi193 ceph-mon[32782]: pgmap v198: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:24:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:24:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:09 smithi193 ceph-mon[32782]: osdmap e56: 8 total, 8 up, 8 in 2024-04-26T11:24:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:09 smithi110 ceph-mon[28069]: pgmap v198: 1 pgs: 1 remapped; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:24:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:24:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:09 smithi110 ceph-mon[28069]: osdmap e56: 8 total, 8 up, 8 in 2024-04-26T11:24:10.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:10 smithi196 ceph-mon[32572]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:24:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:10 smithi193 ceph-mon[32782]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:24:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:10 smithi110 ceph-mon[28069]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:24:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:11 smithi193 ceph-mon[32782]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:11.737 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:11 smithi196 ceph-mon[32572]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:11 smithi110 ceph-mon[28069]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:12 smithi193 ceph-mon[32782]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-04-26T11:24:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:12 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:24:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:12 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/2508303679' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7aaa3c52-72f5-4946-a964-609f65b778f4"}]: dispatch 2024-04-26T11:24:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:12 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7aaa3c52-72f5-4946-a964-609f65b778f4"}]: dispatch 2024-04-26T11:24:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:12 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7aaa3c52-72f5-4946-a964-609f65b778f4"}]': finished 2024-04-26T11:24:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:12 smithi193 ceph-mon[32782]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T11:24:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:12.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:12 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/230582167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:24:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:12 smithi196 ceph-mon[32572]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-04-26T11:24:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:12 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:24:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:12 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/2508303679' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7aaa3c52-72f5-4946-a964-609f65b778f4"}]: dispatch 2024-04-26T11:24:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:12 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7aaa3c52-72f5-4946-a964-609f65b778f4"}]: dispatch 2024-04-26T11:24:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:12 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7aaa3c52-72f5-4946-a964-609f65b778f4"}]': finished 2024-04-26T11:24:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:12 smithi196 ceph-mon[32572]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T11:24:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:12 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/230582167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:24:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:12 smithi110 ceph-mon[28069]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-04-26T11:24:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:12 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:24:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:12 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/2508303679' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7aaa3c52-72f5-4946-a964-609f65b778f4"}]: dispatch 2024-04-26T11:24:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:12 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7aaa3c52-72f5-4946-a964-609f65b778f4"}]: dispatch 2024-04-26T11:24:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:12 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7aaa3c52-72f5-4946-a964-609f65b778f4"}]': finished 2024-04-26T11:24:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:12 smithi110 ceph-mon[28069]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T11:24:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:12 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/230582167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:24:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:13 smithi193 ceph-mon[32782]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:13 smithi196 ceph-mon[32572]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:13 smithi110 ceph-mon[28069]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:15.661 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:15 smithi196 ceph-mon[32572]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:15 smithi110 ceph-mon[28069]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:15.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:15 smithi193 ceph-mon[32782]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:17 smithi196 ceph-mon[32572]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:17 smithi110 ceph-mon[28069]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:17 smithi193 ceph-mon[32782]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:19.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:19 smithi196 ceph-mon[32572]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:19.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T11:24:19.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:19 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:19 smithi110 ceph-mon[28069]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T11:24:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:19 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:19 smithi193 ceph-mon[32782]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T11:24:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:19 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:20 smithi196 ceph-mon[32572]: Deploying daemon osd.8 on smithi196 2024-04-26T11:24:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:20 smithi110 ceph-mon[28069]: Deploying daemon osd.8 on smithi196 2024-04-26T11:24:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:20 smithi193 ceph-mon[32782]: Deploying daemon osd.8 on smithi196 2024-04-26T11:24:21.735 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:21 smithi196 ceph-mon[32572]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:21 smithi110 ceph-mon[28069]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:21 smithi193 ceph-mon[32782]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:23.666 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:23 smithi196 ceph-mon[32572]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:23 smithi110 ceph-mon[28069]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:23 smithi193 ceph-mon[32782]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:25 smithi196 ceph-mon[32572]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:25 smithi110 ceph-mon[28069]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:25 smithi193 ceph-mon[32782]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:27.677 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:27 smithi196 ceph-mon[32572]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:27.677 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:27.677 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:27.677 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:27.678 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:27.678 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:27 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:27 smithi110 ceph-mon[28069]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:27 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:27 smithi193 ceph-mon[32782]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:27 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:28.015 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.013+0000 7f0797fff700 1 -- 172.21.15.196:0/1802052455 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f07a0063860 con 0x7f078c0a3c40 2024-04-26T11:24:28.015 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 8 on host 'smithi196' 2024-04-26T11:24:28.016 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f078c0a3c40 msgr2=0x7f078c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f078c0a3c40 0x7f078c0a6100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0790006fd0 tx=0x7f0790008040 comp rx=0 tx=0).stop 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01068a0 msgr2=0x7f07a0199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01068a0 0x7f07a0199c50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f078800b560 tx=0x7f078800b920 comp rx=0 tx=0).stop 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 shutdown_connections 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07a01091d0 0x7f07a01a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07a0103f70 0x7f07a0199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f078c0a3c40 0x7f078c0a6100 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 --2- 172.21.15.196:0/1802052455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07a01068a0 0x7f07a0199c50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.015+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 >> 172.21.15.196:0/1802052455 conn(0x7f07a00fd920 msgr2=0x7f07a01048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.016+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 shutdown_connections 2024-04-26T11:24:28.017 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:24:28.016+0000 7f07a537d700 1 -- 172.21.15.196:0/1802052455 wait complete. 2024-04-26T11:24:28.651 DEBUG:teuthology.orchestra.run.smithi196:osd.8> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.8.service 2024-04-26T11:24:28.654 INFO:tasks.cephadm:Deploying osd.9 on smithi110 with /dev/vg_nvme/lv_1... 2024-04-26T11:24:28.654 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T11:24:29.093 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:24:29.221 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:28 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:29.221 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:28 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:29.221 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:28 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:29.221 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:28 smithi196 ceph-mon[32572]: from='osd.8 [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T11:24:29.221 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:28 smithi196 ceph-mon[32572]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T11:24:29.221 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:28 smithi196 ceph-mon[32572]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:29.243 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:28 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:29.243 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:28 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:29.243 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:28 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:29.243 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:28 smithi110 ceph-mon[28069]: from='osd.8 [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T11:24:29.243 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:28 smithi110 ceph-mon[28069]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T11:24:29.244 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:28 smithi110 ceph-mon[28069]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:28 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:28 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:28 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:28 smithi193 ceph-mon[32782]: from='osd.8 [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T11:24:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:28 smithi193 ceph-mon[32782]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T11:24:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:28 smithi193 ceph-mon[32782]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:30.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:30 smithi196 ceph-mon[32572]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T11:24:30.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:30 smithi196 ceph-mon[32572]: from='osd.8 [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:24:30.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:30 smithi196 ceph-mon[32572]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T11:24:30.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:30 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:30.194 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:30 smithi196 ceph-mon[32572]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:24:30.194 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 26 11:24:30 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-8[51157]: 2024-04-26T11:24:30.016+0000 7f56dbd4f700 -1 osd.8 0 waiting for initial osdmap 2024-04-26T11:24:30.194 INFO:journalctl@ceph.osd.8.smithi196.stdout:Apr 26 11:24:30 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-8[51157]: 2024-04-26T11:24:30.029+0000 7f56d7b42700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:24:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:30 smithi110 ceph-mon[28069]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T11:24:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:30 smithi110 ceph-mon[28069]: from='osd.8 [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:24:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:30 smithi110 ceph-mon[28069]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T11:24:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:30 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:30 smithi110 ceph-mon[28069]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:24:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:30 smithi193 ceph-mon[32782]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T11:24:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:30 smithi193 ceph-mon[32782]: from='osd.8 [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:24:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:30 smithi193 ceph-mon[32782]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T11:24:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:30 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:30 smithi193 ceph-mon[32782]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:24:31.064 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:31 smithi110 ceph-mon[28069]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:24:31.064 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:31 smithi110 ceph-mon[28069]: osdmap e59: 9 total, 8 up, 9 in 2024-04-26T11:24:31.064 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:31.064 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:31 smithi110 ceph-mon[28069]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:31 smithi196 ceph-mon[32572]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:24:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:31 smithi196 ceph-mon[32572]: osdmap e59: 9 total, 8 up, 9 in 2024-04-26T11:24:31.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:31.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:31 smithi196 ceph-mon[32572]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:31.287 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:31 smithi193 ceph-mon[32782]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:24:31.287 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:31 smithi193 ceph-mon[32782]: osdmap e59: 9 total, 8 up, 9 in 2024-04-26T11:24:31.287 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:31.287 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:31 smithi193 ceph-mon[32782]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-04-26T11:24:32.069 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T11:24:32.069 INFO:teuthology.orchestra.run.smithi110.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T11:24:32.069 INFO:teuthology.orchestra.run.smithi110.stderr: stderr: 10+0 records in 2024-04-26T11:24:32.069 INFO:teuthology.orchestra.run.smithi110.stderr:10+0 records out 2024-04-26T11:24:32.069 INFO:teuthology.orchestra.run.smithi110.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0361727 s, 290 MB/s 2024-04-26T11:24:32.069 INFO:teuthology.orchestra.run.smithi110.stderr:--> Zapping successful for: 2024-04-26T11:24:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: osd.8 [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] boot 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:32.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:32 smithi110 ceph-mon[28069]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: osd.8 [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] boot 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:32.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:32.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:32.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:32 smithi193 ceph-mon[32782]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T11:24:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: osd.8 [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] boot 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:24:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:32.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:32 smithi196 ceph-mon[32572]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T11:24:33.087 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_1 2024-04-26T11:24:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:33 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi196 2024-04-26T11:24:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:33 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 5696M 2024-04-26T11:24:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:33 smithi110 ceph-mon[28069]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:33 smithi110 ceph-mon[28069]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T11:24:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:33 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi196 2024-04-26T11:24:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:33 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 5696M 2024-04-26T11:24:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:33 smithi193 ceph-mon[32782]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:33.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:33 smithi193 ceph-mon[32782]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T11:24:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:33 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi196 2024-04-26T11:24:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:33 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 5696M 2024-04-26T11:24:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:33 smithi196 ceph-mon[32572]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:33 smithi196 ceph-mon[32572]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T11:24:33.521 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:24:34.569 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:34 smithi110 ceph-mon[28069]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T11:24:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:34 smithi193 ceph-mon[32782]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T11:24:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:34 smithi196 ceph-mon[32572]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T11:24:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:35 smithi193 ceph-mon[32782]: osdmap e64: 9 total, 9 up, 9 in 2024-04-26T11:24:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:35 smithi193 ceph-mon[32782]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:35.624 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:35 smithi110 ceph-mon[28069]: osdmap e64: 9 total, 9 up, 9 in 2024-04-26T11:24:35.624 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:35 smithi110 ceph-mon[28069]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:35 smithi196 ceph-mon[32572]: osdmap e64: 9 total, 9 up, 9 in 2024-04-26T11:24:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:35 smithi196 ceph-mon[32572]: pgmap v220: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:35.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.794+0000 7fb2ebe00700 1 -- 172.21.15.110:0/3433112349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2ec1045a0 msgr2=0x7fb2ec104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.794+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/3433112349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2ec1045a0 0x7fb2ec104a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009990 tx=0x7fb2d8009ca0 comp rx=0 tx=0).stop 2024-04-26T11:24:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.794+0000 7fb2ebe00700 1 -- 172.21.15.110:0/3433112349 shutdown_connections 2024-04-26T11:24:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.794+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/3433112349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2ec104f40 0x7fb2ec10b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.794+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/3433112349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec1033a0 0x7fb2ec1037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.794+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/3433112349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2ec1045a0 0x7fb2ec104a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.794+0000 7fb2ebe00700 1 -- 172.21.15.110:0/3433112349 >> 172.21.15.110:0/3433112349 conn(0x7fb2ec0fe960 msgr2=0x7fb2ec100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:24:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.794+0000 7fb2ebe00700 1 -- 172.21.15.110:0/3433112349 shutdown_connections 2024-04-26T11:24:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.794+0000 7fb2ebe00700 1 -- 172.21.15.110:0/3433112349 wait complete. 2024-04-26T11:24:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.796+0000 7fb2ebe00700 1 Processor -- start 2024-04-26T11:24:35.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.796+0000 7fb2ebe00700 1 -- start start 2024-04-26T11:24:35.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.796+0000 7fb2ebe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2ec1033a0 0x7fb2ec1994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.796+0000 7fb2ebe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec1045a0 0x7fb2ec199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.796+0000 7fb2ebe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2ec104f40 0x7fb2ec1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.796+0000 7fb2ebe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec10ee80 con 0x7fb2ec1045a0 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.796+0000 7fb2ebe00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec10ed00 con 0x7fb2ec1033a0 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.796+0000 7fb2ebe00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec10f000 con 0x7fb2ec104f40 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.796+0000 7fb2ea000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec1045a0 0x7fb2ec199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2ea000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec1045a0 0x7fb2ec199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50888/0 (socket says 172.21.15.110:50888) 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2ea000700 1 -- 172.21.15.110:0/2925790077 learned_addr learned my addr 172.21.15.110:0/2925790077 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2eb400700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2ec104f40 0x7fb2ec1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:24:35.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2eaa00700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2ec1033a0 0x7fb2ec1994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:24:35.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2eb400700 1 -- 172.21.15.110:0/2925790077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2ec1033a0 msgr2=0x7fb2ec1994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:35.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2eb400700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2ec1033a0 0x7fb2ec1994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:35.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2eb400700 1 -- 172.21.15.110:0/2925790077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec1045a0 msgr2=0x7fb2ec199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:24:35.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2eb400700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec1045a0 0x7fb2ec199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:24:35.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2eb400700 1 -- 172.21.15.110:0/2925790077 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ec1a1120 con 0x7fb2ec104f40 2024-04-26T11:24:35.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.797+0000 7fb2eb400700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2ec104f40 0x7fb2ec1a0a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009f60 tx=0x7fb2e4009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:24:35.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.798+0000 7fb2e3400700 1 -- 172.21.15.110:0/2925790077 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40092e0 con 0x7fb2ec104f40 2024-04-26T11:24:35.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.798+0000 7fb2e3400700 1 -- 172.21.15.110:0/2925790077 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2e4004bb0 con 0x7fb2ec104f40 2024-04-26T11:24:35.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.798+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ec1a13b0 con 0x7fb2ec104f40 2024-04-26T11:24:35.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.798+0000 7fb2e3400700 1 -- 172.21.15.110:0/2925790077 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4004020 con 0x7fb2ec104f40 2024-04-26T11:24:35.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.798+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ec1a1940 con 0x7fb2ec104f40 2024-04-26T11:24:35.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.799+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ec06a110 con 0x7fb2ec104f40 2024-04-26T11:24:35.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.801+0000 7fb2e3400700 1 -- 172.21.15.110:0/2925790077 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fb2e401b030 con 0x7fb2ec104f40 2024-04-26T11:24:35.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.802+0000 7fb2e3400700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2d00a3cc0 0x7fb2d00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:24:35.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.802+0000 7fb2e3400700 1 -- 172.21.15.110:0/2925790077 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5829+0+0 (secure 0 0 0) 0x7fb2e40cf6c0 con 0x7fb2ec104f40 2024-04-26T11:24:35.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.802+0000 7fb2eaa00700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2d00a3cc0 0x7fb2d00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:24:35.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.803+0000 7fb2eaa00700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2d00a3cc0 0x7fb2d00a6180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009680 tx=0x7fb2dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:24:35.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:35.805+0000 7fb2e3400700 1 -- 172.21.15.110:0/2925790077 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb2e4022020 con 0x7fb2ec104f40 2024-04-26T11:24:36.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:24:36.042+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb2ec063860 con 0x7fb2d00a3cc0 2024-04-26T11:24:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:36 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:24:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:36 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:24:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:36 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:36 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:24:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:36 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:24:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:36 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:36 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:24:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:36 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:24:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:36 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:37 smithi193 ceph-mon[32782]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:24:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:37 smithi193 ceph-mon[32782]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-04-26T11:24:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:37 smithi196 ceph-mon[32572]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:24:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:37 smithi196 ceph-mon[32572]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-04-26T11:24:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:37 smithi110 ceph-mon[28069]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:24:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:37 smithi110 ceph-mon[28069]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-04-26T11:24:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:39 smithi196 ceph-mon[32572]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T11:24:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:39 smithi110 ceph-mon[28069]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T11:24:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:39 smithi193 ceph-mon[32782]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T11:24:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:40 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1328557075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cde3ed2-6acd-48a4-a99d-aa558dd85baa"}]: dispatch 2024-04-26T11:24:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:40 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1328557075' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cde3ed2-6acd-48a4-a99d-aa558dd85baa"}]': finished 2024-04-26T11:24:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:40 smithi196 ceph-mon[32572]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T11:24:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:24:40.757 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:40 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1328557075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cde3ed2-6acd-48a4-a99d-aa558dd85baa"}]: dispatch 2024-04-26T11:24:40.757 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:40 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1328557075' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cde3ed2-6acd-48a4-a99d-aa558dd85baa"}]': finished 2024-04-26T11:24:40.757 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:40 smithi110 ceph-mon[28069]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T11:24:40.757 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:24:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:40 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1328557075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cde3ed2-6acd-48a4-a99d-aa558dd85baa"}]: dispatch 2024-04-26T11:24:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:40 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1328557075' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cde3ed2-6acd-48a4-a99d-aa558dd85baa"}]': finished 2024-04-26T11:24:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:40 smithi193 ceph-mon[32782]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T11:24:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:24:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:41 smithi196 ceph-mon[32572]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-26T11:24:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:41 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3065710382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:24:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:41 smithi110 ceph-mon[28069]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-26T11:24:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:41 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3065710382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:24:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:41 smithi193 ceph-mon[32782]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-04-26T11:24:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:41 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3065710382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:24:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:43 smithi196 ceph-mon[32572]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-04-26T11:24:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:43 smithi110 ceph-mon[28069]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-04-26T11:24:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:43 smithi193 ceph-mon[32782]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-04-26T11:24:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:45 smithi196 ceph-mon[32572]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T11:24:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:45 smithi110 ceph-mon[28069]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T11:24:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:45 smithi193 ceph-mon[32782]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T11:24:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:47 smithi110 ceph-mon[28069]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:47 smithi196 ceph-mon[32572]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:47 smithi193 ceph-mon[32782]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:49 smithi196 ceph-mon[32572]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:49 smithi110 ceph-mon[28069]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:49 smithi193 ceph-mon[32782]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:50 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T11:24:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:50 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:50 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T11:24:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:50 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:50 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T11:24:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:50 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:24:51.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:51 smithi196 ceph-mon[32572]: Deploying daemon osd.9 on smithi110 2024-04-26T11:24:51.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:51 smithi196 ceph-mon[32572]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:51 smithi110 ceph-mon[28069]: Deploying daemon osd.9 on smithi110 2024-04-26T11:24:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:51 smithi110 ceph-mon[28069]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:51 smithi193 ceph-mon[32782]: Deploying daemon osd.9 on smithi110 2024-04-26T11:24:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:51 smithi193 ceph-mon[32782]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:53 smithi110 ceph-mon[28069]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:53 smithi193 ceph-mon[32782]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:53 smithi196 ceph-mon[32572]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:55.621 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:55 smithi110 ceph-mon[28069]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:55 smithi193 ceph-mon[32782]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:55 smithi196 ceph-mon[32572]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:57.764 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:57 smithi110 ceph-mon[28069]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:57 smithi193 ceph-mon[32782]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:57 smithi196 ceph-mon[32572]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:24:59 smithi110 ceph-mon[28069]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:24:59 smithi193 ceph-mon[32782]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:24:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:24:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:24:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:24:59 smithi196 ceph-mon[32572]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:01.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:01 smithi110 ceph-mon[28069]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:01 smithi196 ceph-mon[32572]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:01 smithi193 ceph-mon[32782]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:03 smithi193 ceph-mon[32782]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T11:25:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:03 smithi193 ceph-mon[32782]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:03.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.394+0000 7fb2e3400700 1 -- 172.21.15.110:0/2925790077 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb2ec063860 con 0x7fb2d00a3cc0 2024-04-26T11:25:03.397 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 9 on host 'smithi110' 2024-04-26T11:25:03.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2d00a3cc0 msgr2=0x7fb2d00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2d00a3cc0 0x7fb2d00a6180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009680 tx=0x7fb2dc009260 comp rx=0 tx=0).stop 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2ec104f40 msgr2=0x7fb2ec1a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2ec104f40 0x7fb2ec1a0a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009f60 tx=0x7fb2e4009f90 comp rx=0 tx=0).stop 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 shutdown_connections 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2d00a3cc0 0x7fb2d00a6180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2ec104f40 0x7fb2ec1a0a80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2ec1033a0 0x7fb2ec1994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 --2- 172.21.15.110:0/2925790077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2ec1045a0 0x7fb2ec199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.398+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 >> 172.21.15.110:0/2925790077 conn(0x7fb2ec0fe960 msgr2=0x7fb2ec107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.399+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 shutdown_connections 2024-04-26T11:25:03.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:03.399+0000 7fb2ebe00700 1 -- 172.21.15.110:0/2925790077 wait complete. 2024-04-26T11:25:03.474 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:03.474 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:03.475 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:03 smithi110 ceph-mon[28069]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T11:25:03.475 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:03 smithi110 ceph-mon[28069]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:03 smithi196 ceph-mon[32572]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T11:25:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:03 smithi196 ceph-mon[32572]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:04.270 DEBUG:teuthology.orchestra.run.smithi110:osd.9> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.9.service 2024-04-26T11:25:04.275 INFO:tasks.cephadm:Deploying osd.10 on smithi193 with /dev/vg_nvme/lv_1... 2024-04-26T11:25:04.276 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T11:25:04.469 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:04 smithi110 ceph-mon[28069]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T11:25:04.469 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:04 smithi110 ceph-mon[28069]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T11:25:04.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:04 smithi110 ceph-mon[28069]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:25:04.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:04 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:04.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:04 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:04.470 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:04 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:04 smithi196 ceph-mon[32572]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T11:25:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:04 smithi196 ceph-mon[32572]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T11:25:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:04 smithi196 ceph-mon[32572]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:25:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:04 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:04 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:04.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:04 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:04.522 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T11:25:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:04 smithi193 ceph-mon[32782]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T11:25:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:04 smithi193 ceph-mon[32782]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T11:25:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:04 smithi193 ceph-mon[32782]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-04-26T11:25:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:04 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:05.042 INFO:journalctl@ceph.osd.9.smithi110.stdout:Apr 26 11:25:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-9[60491]: 2024-04-26T11:25:04.837+0000 7fe566e00700 -1 osd.9 0 waiting for initial osdmap 2024-04-26T11:25:05.042 INFO:journalctl@ceph.osd.9.smithi110.stdout:Apr 26 11:25:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-9[60491]: 2024-04-26T11:25:04.860+0000 7fe55cc00700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:25:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:05 smithi196 ceph-mon[32572]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:25:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:05 smithi196 ceph-mon[32572]: osdmap e67: 10 total, 9 up, 10 in 2024-04-26T11:25:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:05 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:05 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:05 smithi196 ceph-mon[32572]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:05 smithi196 ceph-mon[32572]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' 2024-04-26T11:25:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:05 smithi110 ceph-mon[28069]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:25:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:05 smithi110 ceph-mon[28069]: osdmap e67: 10 total, 9 up, 10 in 2024-04-26T11:25:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:05 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:05 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:05 smithi110 ceph-mon[28069]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:05 smithi110 ceph-mon[28069]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' 2024-04-26T11:25:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:05 smithi193 ceph-mon[32782]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-04-26T11:25:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:05 smithi193 ceph-mon[32782]: osdmap e67: 10 total, 9 up, 10 in 2024-04-26T11:25:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:05 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:05 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:05 smithi193 ceph-mon[32782]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T11:25:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:05 smithi193 ceph-mon[32782]: from='osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358]' entity='osd.9' 2024-04-26T11:25:06.288 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:06 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:25:06.288 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:06 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:25:06.288 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:06.288 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:06 smithi110 ceph-mon[28069]: osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] boot 2024-04-26T11:25:06.288 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:06 smithi110 ceph-mon[28069]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T11:25:06.288 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:06 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:25:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:06 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:25:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:06 smithi196 ceph-mon[32572]: osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] boot 2024-04-26T11:25:06.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:06 smithi196 ceph-mon[32572]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T11:25:06.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:06.525 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T11:25:06.525 INFO:teuthology.orchestra.run.smithi193.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T11:25:06.525 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 10+0 records in 2024-04-26T11:25:06.525 INFO:teuthology.orchestra.run.smithi193.stderr:10+0 records out 2024-04-26T11:25:06.525 INFO:teuthology.orchestra.run.smithi193.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0132423 s, 792 MB/s 2024-04-26T11:25:06.525 INFO:teuthology.orchestra.run.smithi193.stderr: stderr: 2024-04-26T11:25:06.525 INFO:teuthology.orchestra.run.smithi193.stderr:--> Zapping successful for: 2024-04-26T11:25:06.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:06 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:25:06.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:06 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:25:06.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:06.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:06 smithi193 ceph-mon[32782]: osd.9 [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] boot 2024-04-26T11:25:06.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:06 smithi193 ceph-mon[32782]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T11:25:06.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:25:07.224 DEBUG:teuthology.orchestra.run.smithi193:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi193:vg_nvme/lv_1 2024-04-26T11:25:07.460 INFO:teuthology.orchestra.run.smithi193.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T11:25:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:07 smithi196 ceph-mon[32572]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:07 smithi110 ceph-mon[28069]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:07.583 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:07 smithi193 ceph-mon[32782]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:08 smithi196 ceph-mon[32572]: osdmap e69: 10 total, 10 up, 10 in 2024-04-26T11:25:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:08 smithi110 ceph-mon[28069]: osdmap e69: 10 total, 10 up, 10 in 2024-04-26T11:25:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:08 smithi193 ceph-mon[32782]: osdmap e69: 10 total, 10 up, 10 in 2024-04-26T11:25:09.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.171+0000 7fce4382e700 1 -- 172.21.15.193:0/2072963962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c103920 msgr2=0x7fce3c103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:09.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.171+0000 7fce4382e700 1 --2- 172.21.15.193:0/2072963962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c103920 0x7fce3c103d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fce38009990 tx=0x7fce38009ca0 comp rx=0 tx=0).stop 2024-04-26T11:25:09.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.171+0000 7fce4382e700 1 -- 172.21.15.193:0/2072963962 shutdown_connections 2024-04-26T11:25:09.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.171+0000 7fce4382e700 1 --2- 172.21.15.193:0/2072963962 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c103000 0x7fce3c10a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:09.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.171+0000 7fce4382e700 1 --2- 172.21.15.193:0/2072963962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c103920 0x7fce3c103d40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:09.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.171+0000 7fce4382e700 1 --2- 172.21.15.193:0/2072963962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce3c102660 0x7fce3c102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:09.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.171+0000 7fce4382e700 1 -- 172.21.15.193:0/2072963962 >> 172.21.15.193:0/2072963962 conn(0x7fce3c0fd090 msgr2=0x7fce3c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:25:09.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.172+0000 7fce4382e700 1 -- 172.21.15.193:0/2072963962 shutdown_connections 2024-04-26T11:25:09.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.172+0000 7fce4382e700 1 -- 172.21.15.193:0/2072963962 wait complete. 2024-04-26T11:25:09.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.172+0000 7fce4382e700 1 Processor -- start 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.172+0000 7fce4382e700 1 -- start start 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.172+0000 7fce4382e700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c102660 0x7fce3c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce4382e700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce3c103000 0x7fce3c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce4382e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c103920 0x7fce3c19fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce4382e700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c10df00 con 0x7fce3c103000 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce4382e700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c10dd80 con 0x7fce3c102660 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce4382e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c10e080 con 0x7fce3c103920 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce415ca700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c102660 0x7fce3c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce415ca700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c102660 0x7fce3c1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:52916/0 (socket says 172.21.15.193:52916) 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce415ca700 1 -- 172.21.15.193:0/1872757535 learned_addr learned my addr 172.21.15.193:0/1872757535 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce40dc9700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce3c103000 0x7fce3c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:09.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce415ca700 1 -- 172.21.15.193:0/1872757535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c103920 msgr2=0x7fce3c19fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce415ca700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c103920 0x7fce3c19fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce415ca700 1 -- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce3c103000 msgr2=0x7fce3c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce415ca700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce3c103000 0x7fce3c198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce415ca700 1 -- 172.21.15.193:0/1872757535 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c1a0200 con 0x7fce3c102660 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce40dc9700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce3c103000 0x7fce3c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce415ca700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c102660 0x7fce3c1985a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce38005f50 tx=0x7fce380047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce327fc700 1 -- 172.21.15.193:0/1872757535 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38027070 con 0x7fce3c102660 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c1a0490 con 0x7fce3c102660 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce327fc700 1 -- 172.21.15.193:0/1872757535 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce38022470 con 0x7fce3c102660 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce327fc700 1 -- 172.21.15.193:0/1872757535 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3800f6c0 con 0x7fce3c102660 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.173+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c1015d0 con 0x7fce3c102660 2024-04-26T11:25:09.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.175+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c06a110 con 0x7fce3c102660 2024-04-26T11:25:09.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.175+0000 7fce327fc700 1 -- 172.21.15.193:0/1872757535 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fce3802a070 con 0x7fce3c102660 2024-04-26T11:25:09.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.176+0000 7fce327fc700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce280a5e50 0x7fce280a8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:09.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.176+0000 7fce327fc700 1 -- 172.21.15.193:0/1872757535 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6261+0+0 (secure 0 0 0) 0x7fce380d0b20 con 0x7fce3c102660 2024-04-26T11:25:09.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.176+0000 7fce40dc9700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce280a5e50 0x7fce280a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:09.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.177+0000 7fce40dc9700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce280a5e50 0x7fce280a8310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007900 tx=0x7fce2c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:25:09.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.181+0000 7fce327fc700 1 -- 172.21.15.193:0/1872757535 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fce38013070 con 0x7fce3c102660 2024-04-26T11:25:09.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:09.392+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fce3c1093f0 con 0x7fce280a5e50 2024-04-26T11:25:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:09 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:09 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:09.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:09 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi110 2024-04-26T11:25:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 4272M 2024-04-26T11:25:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:25:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:25:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:25:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi110 2024-04-26T11:25:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 4272M 2024-04-26T11:25:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:25:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:25:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:25:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi110 2024-04-26T11:25:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 4272M 2024-04-26T11:25:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi193:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:25:10.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:25:10.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:25:10.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:11.327 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:11 smithi193 ceph-mon[32782]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:11 smithi110 ceph-mon[28069]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:11 smithi196 ceph-mon[32572]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:12.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:12 smithi193 ceph-mon[32782]: from='client.? 172.21.15.193:0/887987891' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bbaac8f-fe7b-4f0e-a25b-286c3c30926e"}]: dispatch 2024-04-26T11:25:12.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:12 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bbaac8f-fe7b-4f0e-a25b-286c3c30926e"}]: dispatch 2024-04-26T11:25:12.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:12 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bbaac8f-fe7b-4f0e-a25b-286c3c30926e"}]': finished 2024-04-26T11:25:12.527 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:12 smithi193 ceph-mon[32782]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T11:25:12.527 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:12 smithi110 ceph-mon[28069]: from='client.? 172.21.15.193:0/887987891' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bbaac8f-fe7b-4f0e-a25b-286c3c30926e"}]: dispatch 2024-04-26T11:25:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:12 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bbaac8f-fe7b-4f0e-a25b-286c3c30926e"}]: dispatch 2024-04-26T11:25:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:12 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bbaac8f-fe7b-4f0e-a25b-286c3c30926e"}]': finished 2024-04-26T11:25:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:12 smithi110 ceph-mon[28069]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T11:25:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:12 smithi196 ceph-mon[32572]: from='client.? 172.21.15.193:0/887987891' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bbaac8f-fe7b-4f0e-a25b-286c3c30926e"}]: dispatch 2024-04-26T11:25:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:12 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bbaac8f-fe7b-4f0e-a25b-286c3c30926e"}]: dispatch 2024-04-26T11:25:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:12 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bbaac8f-fe7b-4f0e-a25b-286c3c30926e"}]': finished 2024-04-26T11:25:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:12 smithi196 ceph-mon[32572]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T11:25:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:13 smithi110 ceph-mon[28069]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:13 smithi110 ceph-mon[28069]: from='client.? 172.21.15.193:0/894426977' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:25:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:13 smithi193 ceph-mon[32782]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:13 smithi193 ceph-mon[32782]: from='client.? 172.21.15.193:0/894426977' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:25:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:13 smithi196 ceph-mon[32572]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:13 smithi196 ceph-mon[32572]: from='client.? 172.21.15.193:0/894426977' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:25:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:15 smithi196 ceph-mon[32572]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:15 smithi110 ceph-mon[28069]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:15.803 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:15 smithi193 ceph-mon[32782]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:17 smithi193 ceph-mon[32782]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:17 smithi196 ceph-mon[32572]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:17 smithi110 ceph-mon[28069]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:19 smithi196 ceph-mon[32572]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:19 smithi110 ceph-mon[28069]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:19 smithi193 ceph-mon[32782]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:20 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T11:25:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:20 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:20 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T11:25:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:20 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:20 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T11:25:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:20 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:21.735 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:21 smithi193 ceph-mon[32782]: Deploying daemon osd.10 on smithi193 2024-04-26T11:25:21.735 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:21 smithi193 ceph-mon[32782]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:21 smithi110 ceph-mon[28069]: Deploying daemon osd.10 on smithi193 2024-04-26T11:25:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:21 smithi110 ceph-mon[28069]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:21 smithi196 ceph-mon[32572]: Deploying daemon osd.10 on smithi193 2024-04-26T11:25:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:21 smithi196 ceph-mon[32572]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:23 smithi110 ceph-mon[28069]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:23.796 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:23 smithi193 ceph-mon[32782]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:23 smithi196 ceph-mon[32572]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:25 smithi193 ceph-mon[32782]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:25 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:25.795 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:25 smithi110 ceph-mon[28069]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:26.951 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:26.951 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:26.951 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:25 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:26.952 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:25 smithi196 ceph-mon[32572]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:26.952 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:26.952 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:26.952 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:25 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:27.752 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:27 smithi193 ceph-mon[32782]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:27 smithi110 ceph-mon[28069]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:27 smithi196 ceph-mon[32572]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:29.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.434+0000 7fce327fc700 1 -- 172.21.15.193:0/1872757535 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fce3c1093f0 con 0x7fce280a5e50 2024-04-26T11:25:29.435 INFO:teuthology.orchestra.run.smithi193.stdout:Created osd(s) 10 on host 'smithi193' 2024-04-26T11:25:29.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce280a5e50 msgr2=0x7fce280a8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:29.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce280a5e50 0x7fce280a8310 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007900 tx=0x7fce2c008040 comp rx=0 tx=0).stop 2024-04-26T11:25:29.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c102660 msgr2=0x7fce3c1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:29.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c102660 0x7fce3c1985a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce38005f50 tx=0x7fce380047b0 comp rx=0 tx=0).stop 2024-04-26T11:25:29.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 shutdown_connections 2024-04-26T11:25:29.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce280a5e50 0x7fce280a8310 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:29.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c103920 0x7fce3c19fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:29.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c102660 0x7fce3c1985a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:29.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 --2- 172.21.15.193:0/1872757535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce3c103000 0x7fce3c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:29.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 >> 172.21.15.193:0/1872757535 conn(0x7fce3c0fd090 msgr2=0x7fce3c1069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:25:29.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 shutdown_connections 2024-04-26T11:25:29.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-04-26T11:25:29.436+0000 7fce4382e700 1 -- 172.21.15.193:0/1872757535 wait complete. 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='osd.10 [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:29.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='osd.10 [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T11:25:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T11:25:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='osd.10 [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T11:25:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T11:25:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:30.153 DEBUG:teuthology.orchestra.run.smithi193:osd.10> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.10.service 2024-04-26T11:25:30.155 INFO:tasks.cephadm:Deploying osd.11 on smithi196 with /dev/vg_nvme/lv_1... 2024-04-26T11:25:30.155 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T11:25:30.402 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:25:30.788 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:30 smithi196 ceph-mon[32572]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T11:25:30.788 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:30 smithi196 ceph-mon[32572]: from='osd.10 [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:25:30.788 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:30 smithi196 ceph-mon[32572]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T11:25:30.788 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:30 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:30.788 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:30 smithi196 ceph-mon[32572]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:25:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:30 smithi193 ceph-mon[32782]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T11:25:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:30 smithi193 ceph-mon[32782]: from='osd.10 [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:25:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:30 smithi193 ceph-mon[32782]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T11:25:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:30 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:30 smithi193 ceph-mon[32782]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:25:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:30 smithi110 ceph-mon[28069]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T11:25:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:30 smithi110 ceph-mon[28069]: from='osd.10 [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:25:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:30 smithi110 ceph-mon[28069]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T11:25:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:30 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:30 smithi110 ceph-mon[28069]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]: dispatch 2024-04-26T11:25:31.321 INFO:journalctl@ceph.osd.10.smithi193.stdout:Apr 26 11:25:30 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-10[57559]: 2024-04-26T11:25:30.996+0000 7fbcea2b5700 -1 osd.10 0 waiting for initial osdmap 2024-04-26T11:25:31.322 INFO:journalctl@ceph.osd.10.smithi193.stdout:Apr 26 11:25:31 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-10[57559]: 2024-04-26T11:25:31.010+0000 7fbce20a0700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:25:31.858 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:31 smithi193 ceph-mon[32782]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:31.858 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:31 smithi193 ceph-mon[32782]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:25:31.858 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:31 smithi193 ceph-mon[32782]: osdmap e72: 11 total, 10 up, 11 in 2024-04-26T11:25:31.858 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:31.858 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:31.859 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:31 smithi193 ceph-mon[32782]: from='osd.10 ' entity='osd.10' 2024-04-26T11:25:31.862 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:31 smithi196 ceph-mon[32572]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:31.862 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:31 smithi196 ceph-mon[32572]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:25:31.863 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:31 smithi196 ceph-mon[32572]: osdmap e72: 11 total, 10 up, 11 in 2024-04-26T11:25:31.863 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:31.863 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:31.863 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:31 smithi196 ceph-mon[32572]: from='osd.10 ' entity='osd.10' 2024-04-26T11:25:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:31 smithi110 ceph-mon[28069]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T11:25:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:31 smithi110 ceph-mon[28069]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi193", "root=default"]}]': finished 2024-04-26T11:25:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:31 smithi110 ceph-mon[28069]: osdmap e72: 11 total, 10 up, 11 in 2024-04-26T11:25:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:31 smithi110 ceph-mon[28069]: from='osd.10 ' entity='osd.10' 2024-04-26T11:25:32.427 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T11:25:32.427 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T11:25:32.427 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-04-26T11:25:32.427 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-04-26T11:25:32.427 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115585 s, 907 MB/s 2024-04-26T11:25:32.427 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-04-26T11:25:32.715 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:32 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:25:32.715 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:32 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:25:32.715 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:32 smithi193 ceph-mon[32782]: osd.10 [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] boot 2024-04-26T11:25:32.715 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:32 smithi193 ceph-mon[32782]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T11:25:32.715 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:32.715 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:32 smithi193 ceph-mon[32782]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T11:25:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:32 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:25:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:32 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:25:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:32 smithi196 ceph-mon[32572]: osd.10 [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] boot 2024-04-26T11:25:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:32 smithi196 ceph-mon[32572]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T11:25:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:32 smithi196 ceph-mon[32572]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T11:25:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:32 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:25:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:32 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:25:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:32 smithi110 ceph-mon[28069]: osd.10 [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] boot 2024-04-26T11:25:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:32 smithi110 ceph-mon[28069]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T11:25:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:25:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:32 smithi110 ceph-mon[28069]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T11:25:33.114 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_1 2024-04-26T11:25:33.354 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:25:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:33 smithi196 ceph-mon[32572]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T11:25:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:33 smithi193 ceph-mon[32782]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T11:25:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:34.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:34.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:34.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:34.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:34.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:34.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:33 smithi110 ceph-mon[28069]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T11:25:34.745 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:34 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi193 2024-04-26T11:25:34.745 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:34 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 4272M 2024-04-26T11:25:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:34 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi193 2024-04-26T11:25:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:34 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 4272M 2024-04-26T11:25:35.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.002+0000 7fdb71294700 1 -- 172.21.15.196:0/2621471982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 msgr2=0x7fdb6c1027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:35.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.002+0000 7fdb71294700 1 --2- 172.21.15.196:0/2621471982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 0x7fdb6c1027a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009990 tx=0x7fdb5c009ca0 comp rx=0 tx=0).stop 2024-04-26T11:25:35.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.002+0000 7fdb71294700 1 -- 172.21.15.196:0/2621471982 shutdown_connections 2024-04-26T11:25:35.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.002+0000 7fdb71294700 1 --2- 172.21.15.196:0/2621471982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb6c103f20 0x7fdb6c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:35.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.002+0000 7fdb71294700 1 --2- 172.21.15.196:0/2621471982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 0x7fdb6c1027a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:35.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.002+0000 7fdb71294700 1 --2- 172.21.15.196:0/2621471982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb6c103580 0x7fdb6c1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:35.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.002+0000 7fdb71294700 1 -- 172.21.15.196:0/2621471982 >> 172.21.15.196:0/2621471982 conn(0x7fdb6c0fd940 msgr2=0x7fdb6c0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:25:35.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.002+0000 7fdb71294700 1 -- 172.21.15.196:0/2621471982 shutdown_connections 2024-04-26T11:25:35.005 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.002+0000 7fdb71294700 1 -- 172.21.15.196:0/2621471982 wait complete. 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb71294700 1 Processor -- start 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb71294700 1 -- start start 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb71294700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 0x7fdb6c199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb71294700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb6c103580 0x7fdb6c199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb71294700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb6c103f20 0x7fdb6c1a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb71294700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c10de90 con 0x7fdb6c103f20 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb71294700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c10dd10 con 0x7fdb6c103580 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb71294700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c10e010 con 0x7fdb6c102380 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 0x7fdb6c199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 0x7fdb6c199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:45964/0 (socket says 172.21.15.196:45964) 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb6affd700 1 -- 172.21.15.196:0/633776312 learned_addr learned my addr 172.21.15.196:0/633776312 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb63fff700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb6c103580 0x7fdb6c199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb6affd700 1 -- 172.21.15.196:0/633776312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb6c103580 msgr2=0x7fdb6c199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:35.006 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb6affd700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb6c103580 0x7fdb6c199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:35.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb6affd700 1 -- 172.21.15.196:0/633776312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb6c103f20 msgr2=0x7fdb6c1a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:35.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb6affd700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb6c103f20 0x7fdb6c1a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:35.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.003+0000 7fdb6affd700 1 -- 172.21.15.196:0/633776312 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c1a12a0 con 0x7fdb6c102380 2024-04-26T11:25:35.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.004+0000 7fdb6affd700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 0x7fdb6c199640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0047b0 tx=0x7fdb5c00f460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:25:35.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.004+0000 7fdb68ff9700 1 -- 172.21.15.196:0/633776312 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00fc60 con 0x7fdb6c102380 2024-04-26T11:25:35.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.004+0000 7fdb68ff9700 1 -- 172.21.15.196:0/633776312 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb5c00fe00 con 0x7fdb6c102380 2024-04-26T11:25:35.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.004+0000 7fdb68ff9700 1 -- 172.21.15.196:0/633776312 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c017830 con 0x7fdb6c102380 2024-04-26T11:25:35.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.004+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6c1a1530 con 0x7fdb6c102380 2024-04-26T11:25:35.007 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.004+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6c1a19a0 con 0x7fdb6c102380 2024-04-26T11:25:35.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.005+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6c06a140 con 0x7fdb6c102380 2024-04-26T11:25:35.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.006+0000 7fdb68ff9700 1 -- 172.21.15.196:0/633776312 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fdb5c009d10 con 0x7fdb6c102380 2024-04-26T11:25:35.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.006+0000 7fdb68ff9700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdb580a3c40 0x7fdb580a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:35.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.007+0000 7fdb68ff9700 1 -- 172.21.15.196:0/633776312 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6694+0+0 (secure 0 0 0) 0x7fdb5c0d1460 con 0x7fdb6c102380 2024-04-26T11:25:35.008 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.007+0000 7fdb63fff700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdb580a3c40 0x7fdb580a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:35.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.008+0000 7fdb63fff700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdb580a3c40 0x7fdb580a6100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb54006fd0 tx=0x7fdb54008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:25:35.011 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.010+0000 7fdb68ff9700 1 -- 172.21.15.196:0/633776312 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdb6c06a140 con 0x7fdb6c102380 2024-04-26T11:25:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:34 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi193 2024-04-26T11:25:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:34 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 4272M 2024-04-26T11:25:35.216 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:35.215+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fdb6c0ffb40 con 0x7fdb580a3c40 2024-04-26T11:25:35.879 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:35 smithi196 ceph-mon[32572]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:35.879 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:35 smithi196 ceph-mon[32572]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T11:25:35.879 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:25:35.880 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:25:35.880 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:35 smithi110 ceph-mon[28069]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:35 smithi110 ceph-mon[28069]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T11:25:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:25:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:25:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:35 smithi193 ceph-mon[32782]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:35 smithi193 ceph-mon[32782]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T11:25:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T11:25:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T11:25:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:36.883 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:36 smithi196 ceph-mon[32572]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:25:36.883 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:36 smithi196 ceph-mon[32572]: osdmap e77: 11 total, 11 up, 11 in 2024-04-26T11:25:36.884 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:36 smithi196 ceph-mon[32572]: pgmap v264: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T11:25:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:36 smithi110 ceph-mon[28069]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:25:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:36 smithi110 ceph-mon[28069]: osdmap e77: 11 total, 11 up, 11 in 2024-04-26T11:25:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:36 smithi110 ceph-mon[28069]: pgmap v264: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T11:25:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:36 smithi193 ceph-mon[32782]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:25:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:36 smithi193 ceph-mon[32782]: osdmap e77: 11 total, 11 up, 11 in 2024-04-26T11:25:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:36 smithi193 ceph-mon[32782]: pgmap v264: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T11:25:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:38 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/1901520254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e31c248e-1016-4765-bea1-9f31d823ca3d"}]: dispatch 2024-04-26T11:25:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:38 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e31c248e-1016-4765-bea1-9f31d823ca3d"}]: dispatch 2024-04-26T11:25:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:38 smithi193 ceph-mon[32782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e31c248e-1016-4765-bea1-9f31d823ca3d"}]': finished 2024-04-26T11:25:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:38 smithi193 ceph-mon[32782]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T11:25:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:38.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:38 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/1901520254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e31c248e-1016-4765-bea1-9f31d823ca3d"}]: dispatch 2024-04-26T11:25:38.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:38 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e31c248e-1016-4765-bea1-9f31d823ca3d"}]: dispatch 2024-04-26T11:25:38.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:38 smithi196 ceph-mon[32572]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e31c248e-1016-4765-bea1-9f31d823ca3d"}]': finished 2024-04-26T11:25:38.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:38 smithi196 ceph-mon[32572]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T11:25:38.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:38 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/1901520254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e31c248e-1016-4765-bea1-9f31d823ca3d"}]: dispatch 2024-04-26T11:25:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:38 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e31c248e-1016-4765-bea1-9f31d823ca3d"}]: dispatch 2024-04-26T11:25:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:38 smithi110 ceph-mon[28069]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e31c248e-1016-4765-bea1-9f31d823ca3d"}]': finished 2024-04-26T11:25:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:38 smithi110 ceph-mon[28069]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T11:25:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:39 smithi193 ceph-mon[32782]: pgmap v266: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-04-26T11:25:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:39 smithi193 ceph-mon[32782]: from='client.? 172.21.15.196:0/3729536427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:25:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:39 smithi196 ceph-mon[32572]: pgmap v266: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-04-26T11:25:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:39 smithi196 ceph-mon[32572]: from='client.? 172.21.15.196:0/3729536427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:25:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:39 smithi110 ceph-mon[28069]: pgmap v266: 1 pgs: 1 peering; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-04-26T11:25:39.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:39 smithi110 ceph-mon[28069]: from='client.? 172.21.15.196:0/3729536427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T11:25:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:41 smithi196 ceph-mon[32572]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T11:25:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:41 smithi110 ceph-mon[28069]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T11:25:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:41 smithi193 ceph-mon[32782]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-26T11:25:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:43 smithi196 ceph-mon[32572]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T11:25:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:43 smithi110 ceph-mon[28069]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T11:25:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:43 smithi193 ceph-mon[32782]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-26T11:25:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:45 smithi110 ceph-mon[28069]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:45 smithi193 ceph-mon[32782]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:45 smithi196 ceph-mon[32572]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:46 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T11:25:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:46 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:46 smithi110 ceph-mon[28069]: Deploying daemon osd.11 on smithi196 2024-04-26T11:25:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:46 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T11:25:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:46 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:46 smithi193 ceph-mon[32782]: Deploying daemon osd.11 on smithi196 2024-04-26T11:25:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:46 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T11:25:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:46 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:46 smithi196 ceph-mon[32572]: Deploying daemon osd.11 on smithi196 2024-04-26T11:25:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:47 smithi196 ceph-mon[32572]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:47 smithi110 ceph-mon[28069]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:47 smithi193 ceph-mon[32782]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:49.579 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:49 smithi196 ceph-mon[32572]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:49 smithi110 ceph-mon[28069]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:49 smithi193 ceph-mon[32782]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:51 smithi110 ceph-mon[28069]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:51 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:51 smithi193 ceph-mon[32782]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:51 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:51 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:51 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:52.000 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:51 smithi196 ceph-mon[32572]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:52.000 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:51 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:52.000 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:51 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:52.000 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:51 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:53.620 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:53 smithi196 ceph-mon[32572]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:53 smithi110 ceph-mon[28069]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:53 smithi193 ceph-mon[32782]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:55.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.413+0000 7fdb68ff9700 1 -- 172.21.15.196:0/633776312 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fdb6c0ffb40 con 0x7fdb580a3c40 2024-04-26T11:25:55.415 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 11 on host 'smithi196' 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdb580a3c40 msgr2=0x7fdb580a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdb580a3c40 0x7fdb580a6100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb54006fd0 tx=0x7fdb54008040 comp rx=0 tx=0).stop 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 msgr2=0x7fdb6c199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 0x7fdb6c199640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0047b0 tx=0x7fdb5c00f460 comp rx=0 tx=0).stop 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 shutdown_connections 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb6c103f20 0x7fdb6c1a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fdb580a3c40 0x7fdb580a6100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdb6c102380 0x7fdb6c199640 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 --2- 172.21.15.196:0/633776312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb6c103580 0x7fdb6c199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:55.417 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 >> 172.21.15.196:0/633776312 conn(0x7fdb6c0fd940 msgr2=0x7fdb6c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:25:55.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 shutdown_connections 2024-04-26T11:25:55.418 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:25:55.416+0000 7fdb71294700 1 -- 172.21.15.196:0/633776312 wait complete. 2024-04-26T11:25:55.732 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:55 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:55.732 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:55 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:55.732 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:55 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:55.732 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:55 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:55.733 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:55 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:55.733 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:55 smithi196 ceph-mon[32572]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:55.733 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:55 smithi196 ceph-mon[32572]: from='osd.11 [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T11:25:55.733 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:55 smithi196 ceph-mon[32572]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T11:25:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:55 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:55 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:55 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:55 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:55 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:55 smithi110 ceph-mon[28069]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:55 smithi110 ceph-mon[28069]: from='osd.11 [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T11:25:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:55 smithi110 ceph-mon[28069]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T11:25:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:55 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:55 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:55 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:55 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:55 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:55 smithi193 ceph-mon[32782]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:55 smithi193 ceph-mon[32782]: from='osd.11 [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T11:25:55.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:55 smithi193 ceph-mon[32782]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T11:25:56.066 DEBUG:teuthology.orchestra.run.smithi196:osd.11> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@osd.11.service 2024-04-26T11:25:56.069 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-26T11:25:56.070 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-26T11:25:56.513 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:25:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:56 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:56 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:56 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:56 smithi110 ceph-mon[28069]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T11:25:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:56 smithi110 ceph-mon[28069]: from='osd.11 [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:25:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:56 smithi110 ceph-mon[28069]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T11:25:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:56 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:56 smithi110 ceph-mon[28069]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:25:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-mon[32572]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T11:25:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-mon[32572]: from='osd.11 [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:25:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-mon[32572]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T11:25:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-mon[32572]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:25:56.756 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-11[57907]: 2024-04-26T11:25:56.433+0000 7f0f96e43700 -1 osd.11 0 waiting for initial osdmap 2024-04-26T11:25:56.756 INFO:journalctl@ceph.osd.11.smithi196.stdout:Apr 26 11:25:56 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-osd-11[57907]: 2024-04-26T11:25:56.445+0000 7f0f92c36700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:25:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:56 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:56 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:25:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:56 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:56 smithi193 ceph-mon[32782]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T11:25:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:56 smithi193 ceph-mon[32782]: from='osd.11 [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:25:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:56 smithi193 ceph-mon[32782]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T11:25:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:56 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:56 smithi193 ceph-mon[32782]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-04-26T11:25:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:57 smithi110 ceph-mon[28069]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:25:57.684 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:57 smithi110 ceph-mon[28069]: osdmap e80: 12 total, 11 up, 12 in 2024-04-26T11:25:57.684 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:57.684 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:57.684 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:57 smithi110 ceph-mon[28069]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:57 smithi196 ceph-mon[32572]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:25:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:57 smithi196 ceph-mon[32572]: osdmap e80: 12 total, 11 up, 12 in 2024-04-26T11:25:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:57 smithi196 ceph-mon[32572]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:57 smithi193 ceph-mon[32782]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-04-26T11:25:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:57 smithi193 ceph-mon[32782]: osdmap e80: 12 total, 11 up, 12 in 2024-04-26T11:25:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:57 smithi193 ceph-mon[32782]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-04-26T11:25:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:58 smithi196 ceph-mon[32572]: purged_snaps scrub starts 2024-04-26T11:25:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:58 smithi196 ceph-mon[32572]: purged_snaps scrub ok 2024-04-26T11:25:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:58 smithi196 ceph-mon[32572]: osd.11 [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] boot 2024-04-26T11:25:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:58 smithi196 ceph-mon[32572]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T11:25:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:58 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:58.763 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:58 smithi110 ceph-mon[28069]: purged_snaps scrub starts 2024-04-26T11:25:58.764 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:58 smithi110 ceph-mon[28069]: purged_snaps scrub ok 2024-04-26T11:25:58.764 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:58 smithi110 ceph-mon[28069]: osd.11 [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] boot 2024-04-26T11:25:58.764 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:58 smithi110 ceph-mon[28069]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T11:25:58.764 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:58 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:58 smithi193 ceph-mon[32782]: purged_snaps scrub starts 2024-04-26T11:25:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:58 smithi193 ceph-mon[32782]: purged_snaps scrub ok 2024-04-26T11:25:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:58 smithi193 ceph-mon[32782]: osd.11 [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] boot 2024-04-26T11:25:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:58 smithi193 ceph-mon[32782]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T11:25:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:58 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:25:58.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.931+0000 7fe775200700 1 -- 172.21.15.110:0/2415568062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770106840 msgr2=0x7fe770108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:58.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.931+0000 7fe775200700 1 --2- 172.21.15.110:0/2415568062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770106840 0x7fe770108c30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe758009990 tx=0x7fe758009ca0 comp rx=0 tx=0).stop 2024-04-26T11:25:58.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.931+0000 7fe775200700 1 -- 172.21.15.110:0/2415568062 shutdown_connections 2024-04-26T11:25:58.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.931+0000 7fe775200700 1 --2- 172.21.15.110:0/2415568062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe770109170 0x7fe77010b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:58.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.931+0000 7fe775200700 1 --2- 172.21.15.110:0/2415568062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe770103f10 0x7fe770106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:58.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.931+0000 7fe775200700 1 --2- 172.21.15.110:0/2415568062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770106840 0x7fe770108c30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:58.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.931+0000 7fe775200700 1 -- 172.21.15.110:0/2415568062 >> 172.21.15.110:0/2415568062 conn(0x7fe7700fd920 msgr2=0x7fe7700ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:25:58.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.931+0000 7fe775200700 1 -- 172.21.15.110:0/2415568062 shutdown_connections 2024-04-26T11:25:58.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.931+0000 7fe775200700 1 -- 172.21.15.110:0/2415568062 wait complete. 2024-04-26T11:25:58.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.933+0000 7fe775200700 1 Processor -- start 2024-04-26T11:25:58.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.933+0000 7fe775200700 1 -- start start 2024-04-26T11:25:58.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe775200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770103f10 0x7fe770103820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:58.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe775200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe770106840 0x7fe770101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:58.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe775200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe770109170 0x7fe770102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe775200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe77010ef50 con 0x7fe770109170 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe775200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe77010edd0 con 0x7fe770106840 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe775200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe77010f0d0 con 0x7fe770103f10 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe76de00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770103f10 0x7fe770103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe76de00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770103f10 0x7fe770103820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:40434/0 (socket says 172.21.15.110:40434) 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe76de00700 1 -- 172.21.15.110:0/1035741558 learned_addr learned my addr 172.21.15.110:0/1035741558 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe76e800700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe770109170 0x7fe770102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.934+0000 7fe767e00700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe770106840 0x7fe770101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe76de00700 1 -- 172.21.15.110:0/1035741558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe770106840 msgr2=0x7fe770101ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe76de00700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe770106840 0x7fe770101ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe76de00700 1 -- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe770109170 msgr2=0x7fe770102400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe76de00700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe770109170 0x7fe770102400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:58.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe76de00700 1 -- 172.21.15.110:0/1035741558 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe770102cd0 con 0x7fe770103f10 2024-04-26T11:25:58.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe76de00700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770103f10 0x7fe770103820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe76000e9a0 tx=0x7fe76000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:25:58.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe766a00700 1 -- 172.21.15.110:0/1035741558 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76000ca10 con 0x7fe770103f10 2024-04-26T11:25:58.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe766a00700 1 -- 172.21.15.110:0/1035741558 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe76000cbb0 con 0x7fe770103f10 2024-04-26T11:25:58.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7701a37f0 con 0x7fe770103f10 2024-04-26T11:25:58.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe766a00700 1 -- 172.21.15.110:0/1035741558 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760018680 con 0x7fe770103f10 2024-04-26T11:25:58.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.935+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7701a3d50 con 0x7fe770103f10 2024-04-26T11:25:58.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.937+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77006a110 con 0x7fe770103f10 2024-04-26T11:25:58.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.939+0000 7fe766a00700 1 -- 172.21.15.110:0/1035741558 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fe760010430 con 0x7fe770103f10 2024-04-26T11:25:58.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.940+0000 7fe766a00700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe7540a3cc0 0x7fe7540a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:25:58.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.940+0000 7fe766a00700 1 -- 172.21.15.110:0/1035741558 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fe7600d0150 con 0x7fe770103f10 2024-04-26T11:25:58.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.940+0000 7fe767e00700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe7540a3cc0 0x7fe7540a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:25:58.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.941+0000 7fe767e00700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe7540a3cc0 0x7fe7540a6180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe75800b760 tx=0x7fe75800b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:25:58.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:58.944+0000 7fe766a00700 1 -- 172.21.15.110:0/1035741558 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe76009cf30 con 0x7fe770103f10 2024-04-26T11:25:59.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.182+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe770064030 con 0x7fe770103f10 2024-04-26T11:25:59.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.183+0000 7fe766a00700 1 -- 172.21.15.110:0/1035741558 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) ==== 74+0+133 (secure 0 0 0) 0x7fe76009c830 con 0x7fe770103f10 2024-04-26T11:25:59.184 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:25:59.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe7540a3cc0 msgr2=0x7fe7540a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:59.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe7540a3cc0 0x7fe7540a6180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe75800b760 tx=0x7fe75800b280 comp rx=0 tx=0).stop 2024-04-26T11:25:59.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770103f10 msgr2=0x7fe770103820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:25:59.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770103f10 0x7fe770103820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe76000e9a0 tx=0x7fe76000ecb0 comp rx=0 tx=0).stop 2024-04-26T11:25:59.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 shutdown_connections 2024-04-26T11:25:59.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe770109170 0x7fe770102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:59.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fe7540a3cc0 0x7fe7540a6180 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:59.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe770103f10 0x7fe770103820 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:59.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 --2- 172.21.15.110:0/1035741558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe770106840 0x7fe770101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:25:59.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 >> 172.21.15.110:0/1035741558 conn(0x7fe7700fd920 msgr2=0x7fe7701049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:25:59.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.187+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 shutdown_connections 2024-04-26T11:25:59.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:25:59.188+0000 7fe775200700 1 -- 172.21.15.110:0/1035741558 wait complete. 2024-04-26T11:25:59.728 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:25:59 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1035741558' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T11:25:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:25:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:25:59 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1035741558' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T11:25:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:25:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T11:25:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:25:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:25:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:25:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:25:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:25:59 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1035741558' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T11:26:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1714130757,"num_in_osds":12,"osd_in_since":1714130738,"num_remapped_pgs":0} 2024-04-26T11:26:00.205 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T11:26:00.617 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:00 smithi196 ceph-mon[32572]: Detected new or changed devices on smithi196 2024-04-26T11:26:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:00 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 4272M 2024-04-26T11:26:00.762 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:00 smithi110 ceph-mon[28069]: Detected new or changed devices on smithi196 2024-04-26T11:26:00.762 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:00 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 4272M 2024-04-26T11:26:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:00 smithi193 ceph-mon[32782]: Detected new or changed devices on smithi196 2024-04-26T11:26:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:00 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 4272M 2024-04-26T11:26:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:01 smithi196 ceph-mon[32572]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:01.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:01 smithi193 ceph-mon[32782]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:01 smithi110 ceph-mon[28069]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:02.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.817+0000 7f3499000700 1 -- 172.21.15.110:0/3565120528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f349410b660 msgr2=0x7f349410ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:02.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.817+0000 7f3499000700 1 --2- 172.21.15.110:0/3565120528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f349410b660 0x7f349410ba40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f348400b0a0 tx=0x7f348400b3b0 comp rx=0 tx=0).stop 2024-04-26T11:26:02.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.817+0000 7f3499000700 1 -- 172.21.15.110:0/3565120528 shutdown_connections 2024-04-26T11:26:02.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.817+0000 7f3499000700 1 --2- 172.21.15.110:0/3565120528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3494106020 0x7f3494112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:02.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.817+0000 7f3499000700 1 --2- 172.21.15.110:0/3565120528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f349410b660 0x7f349410ba40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:02.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.817+0000 7f3499000700 1 --2- 172.21.15.110:0/3565120528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3494105660 0x7f3494105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:02.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.817+0000 7f3499000700 1 -- 172.21.15.110:0/3565120528 >> 172.21.15.110:0/3565120528 conn(0x7f3494101150 msgr2=0x7f3494103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:02.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.817+0000 7f3499000700 1 -- 172.21.15.110:0/3565120528 shutdown_connections 2024-04-26T11:26:02.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.817+0000 7f3499000700 1 -- 172.21.15.110:0/3565120528 wait complete. 2024-04-26T11:26:02.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.818+0000 7f3499000700 1 Processor -- start 2024-04-26T11:26:02.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.818+0000 7f3499000700 1 -- start start 2024-04-26T11:26:02.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.818+0000 7f3499000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3494105660 0x7f349419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:02.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.818+0000 7f3499000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3494106020 0x7f349419c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:02.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.818+0000 7f3499000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f349410b660 0x7f34941a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:02.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.818+0000 7f3499000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3494115890 con 0x7f3494106020 2024-04-26T11:26:02.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.818+0000 7f3499000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3494115710 con 0x7f3494105660 2024-04-26T11:26:02.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.818+0000 7f3499000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3494115a10 con 0x7f349410b660 2024-04-26T11:26:02.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3491e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3494105660 0x7f349419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3491e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3494105660 0x7f349419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43150/0 (socket says 172.21.15.110:43150) 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3491e00700 1 -- 172.21.15.110:0/3580958528 learned_addr learned my addr 172.21.15.110:0/3580958528 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3489400700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3494106020 0x7f349419c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3492800700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f349410b660 0x7f34941a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3491e00700 1 -- 172.21.15.110:0/3580958528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f349410b660 msgr2=0x7f34941a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3491e00700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f349410b660 0x7f34941a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3491e00700 1 -- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3494106020 msgr2=0x7f349419c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3491e00700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3494106020 0x7f349419c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3491e00700 1 -- 172.21.15.110:0/3580958528 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34941a0d30 con 0x7f3494105660 2024-04-26T11:26:02.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.819+0000 7f3491e00700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3494105660 0x7f349419bd20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f348400d010 tx=0x7f3484004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.820+0000 7f348b400700 1 -- 172.21.15.110:0/3580958528 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484021070 con 0x7f3494105660 2024-04-26T11:26:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.820+0000 7f348b400700 1 -- 172.21.15.110:0/3580958528 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3484007c40 con 0x7f3494105660 2024-04-26T11:26:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.820+0000 7f348b400700 1 -- 172.21.15.110:0/3580958528 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484004760 con 0x7f3494105660 2024-04-26T11:26:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.820+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34941a0fc0 con 0x7f3494105660 2024-04-26T11:26:02.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.820+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34941a88a0 con 0x7f3494105660 2024-04-26T11:26:02.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.821+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349406a110 con 0x7f3494105660 2024-04-26T11:26:02.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.823+0000 7f348b400700 1 -- 172.21.15.110:0/3580958528 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3484003a00 con 0x7f3494105660 2024-04-26T11:26:02.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.824+0000 7f348b400700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f34780a3cc0 0x7f34780a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:02.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.824+0000 7f348b400700 1 -- 172.21.15.110:0/3580958528 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f348400f020 con 0x7f3494105660 2024-04-26T11:26:02.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.825+0000 7f3489400700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f34780a3cc0 0x7f34780a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:02.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.825+0000 7f3489400700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f34780a3cc0 0x7f34780a6180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3494103790 tx=0x7f347c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:02.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:02.827+0000 7f348b400700 1 -- 172.21.15.110:0/3580958528 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f348402a020 con 0x7f3494105660 2024-04-26T11:26:03.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.053+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f349402e490 con 0x7f3494105660 2024-04-26T11:26:03.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.055+0000 7f348b400700 1 -- 172.21.15.110:0/3580958528 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18537 (secure 0 0 0) 0x7f348409e760 con 0x7f3494105660 2024-04-26T11:26:03.057 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:26:03.057 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":82,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","created":"2024-04-26T11:17:56.437545+0000","modified":"2024-04-26T11:25:58.440752+0000","last_up_change":"2024-04-26T11:25:57.427695+0000","last_in_change":"2024-04-26T11:25:38.050280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:44.478027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13eb997d-8b4a-47f5-be11-772d47788972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6803","nonce":1662740885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6805","nonce":1662740885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6809","nonce":1662740885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6807","nonce":1662740885}]},"public_addr":"172.21.15.110:6803/1662740885","cluster_addr":"172.21.15.110:6805/1662740885","heartbeat_back_addr":"172.21.15.110:6809/1662740885","heartbeat_front_addr":"172.21.15.110:6807/1662740885","state":["exists","up"]},{"osd":1,"uuid":"e7927dc3-dced-4661-8493-840e111241e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6801","nonce":1751461680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6803","nonce":1751461680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6807","nonce":1751461680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6805","nonce":1751461680}]},"public_addr":"172.21.15.193:6801/1751461680","cluster_addr":"172.21.15.193:6803/1751461680","heartbeat_back_addr":"172.21.15.193:6807/1751461680","heartbeat_front_addr":"172.21.15.193:6805/1751461680","state":["exists","up"]},{"osd":2,"uuid":"54459a80-91a1-45ba-b7e4-900a4a995219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6801","nonce":1785522554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6803","nonce":1785522554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6807","nonce":1785522554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6805","nonce":1785522554}]},"public_addr":"172.21.15.196:6801/1785522554","cluster_addr":"172.21.15.196:6803/1785522554","heartbeat_back_addr":"172.21.15.196:6807/1785522554","heartbeat_front_addr":"172.21.15.196:6805/1785522554","state":["exists","up"]},{"osd":3,"uuid":"12d8a1be-5edb-4af2-b01d-abd943f89641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6811","nonce":2253549266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6813","nonce":2253549266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6817","nonce":2253549266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6815","nonce":2253549266}]},"public_addr":"172.21.15.110:6811/2253549266","cluster_addr":"172.21.15.110:6813/2253549266","heartbeat_back_addr":"172.21.15.110:6817/2253549266","heartbeat_front_addr":"172.21.15.110:6815/2253549266","state":["exists","up"]},{"osd":4,"uuid":"f3057080-144b-4f43-9a63-8f415ca76d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6809","nonce":1314161856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6811","nonce":1314161856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6815","nonce":1314161856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6813","nonce":1314161856}]},"public_addr":"172.21.15.193:6809/1314161856","cluster_addr":"172.21.15.193:6811/1314161856","heartbeat_back_addr":"172.21.15.193:6815/1314161856","heartbeat_front_addr":"172.21.15.193:6813/1314161856","state":["exists","up"]},{"osd":5,"uuid":"f0775b9c-938e-4bb4-ae1e-01ef0686cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6809","nonce":2359280243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6811","nonce":2359280243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6815","nonce":2359280243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6813","nonce":2359280243}]},"public_addr":"172.21.15.196:6809/2359280243","cluster_addr":"172.21.15.196:6811/2359280243","heartbeat_back_addr":"172.21.15.196:6815/2359280243","heartbeat_front_addr":"172.21.15.196:6813/2359280243","state":["exists","up"]},{"osd":6,"uuid":"ea4ea3de-4ec4-48a1-809e-da62fcbb7033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6819","nonce":1730783886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6821","nonce":1730783886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6825","nonce":1730783886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6823","nonce":1730783886}]},"public_addr":"172.21.15.110:6819/1730783886","cluster_addr":"172.21.15.110:6821/1730783886","heartbeat_back_addr":"172.21.15.110:6825/1730783886","heartbeat_front_addr":"172.21.15.110:6823/1730783886","state":["exists","up"]},{"osd":7,"uuid":"98af7071-82b3-4732-b2a1-8676e6439cd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6817","nonce":4124476381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6819","nonce":4124476381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6823","nonce":4124476381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6821","nonce":4124476381}]},"public_addr":"172.21.15.193:6817/4124476381","cluster_addr":"172.21.15.193:6819/4124476381","heartbeat_back_addr":"172.21.15.193:6823/4124476381","heartbeat_front_addr":"172.21.15.193:6821/4124476381","state":["exists","up"]},{"osd":8,"uuid":"7aaa3c52-72f5-4946-a964-609f65b778f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6817","nonce":2942176519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6819","nonce":2942176519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6823","nonce":2942176519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6821","nonce":2942176519}]},"public_addr":"172.21.15.196:6817/2942176519","cluster_addr":"172.21.15.196:6819/2942176519","heartbeat_back_addr":"172.21.15.196:6823/2942176519","heartbeat_front_addr":"172.21.15.196:6821/2942176519","state":["exists","up"]},{"osd":9,"uuid":"2cde3ed2-6acd-48a4-a99d-aa558dd85baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6827","nonce":2620757358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6829","nonce":2620757358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6833","nonce":2620757358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6831","nonce":2620757358}]},"public_addr":"172.21.15.110:6827/2620757358","cluster_addr":"172.21.15.110:6829/2620757358","heartbeat_back_addr":"172.21.15.110:6833/2620757358","heartbeat_front_addr":"172.21.15.110:6831/2620757358","state":["exists","up"]},{"osd":10,"uuid":"3bbaac8f-fe7b-4f0e-a25b-286c3c30926e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6825","nonce":676480728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6827","nonce":676480728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6831","nonce":676480728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6829","nonce":676480728}]},"public_addr":"172.21.15.193:6825/676480728","cluster_addr":"172.21.15.193:6827/676480728","heartbeat_back_addr":"172.21.15.193:6831/676480728","heartbeat_front_addr":"172.21.15.193:6829/676480728","state":["exists","up"]},{"osd":11,"uuid":"e31c248e-1016-4765-bea1-9f31d823ca3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6825","nonce":2802765812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6827","nonce":2802765812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6831","nonce":2802765812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6829","nonce":2802765812}]},"public_addr":"172.21.15.196:6825/2802765812","cluster_addr":"172.21.15.196:6827/2802765812","heartbeat_back_addr":"172.21.15.196:6831/2802765812","heartbeat_front_addr":"172.21.15.196:6829/2802765812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:20:52.046788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:16.893940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:40.861409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:13.272469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:39.214479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:03.529206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:37.413989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:04.145639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:29.162356+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:03.325672+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:30.353695+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:56.267402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3278958945":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6801/4292256031":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3536224934":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2250601964":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/2775667488":"2024-04-27T11:18:29.387925+0000","172.21.15.110:6801/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/337370067":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3594651859":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/4292256031":"2024-04-27T11:19:02.329691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:26:03.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f34780a3cc0 msgr2=0x7f34780a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:03.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f34780a3cc0 0x7f34780a6180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3494103790 tx=0x7f347c0073d0 comp rx=0 tx=0).stop 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3494105660 msgr2=0x7f349419bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3494105660 0x7f349419bd20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f348400d010 tx=0x7f3484004d00 comp rx=0 tx=0).stop 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 shutdown_connections 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f34780a3cc0 0x7f34780a6180 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f349410b660 0x7f34941a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3494105660 0x7f349419bd20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 --2- 172.21.15.110:0/3580958528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3494106020 0x7f349419c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.058+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 >> 172.21.15.110:0/3580958528 conn(0x7f3494101150 msgr2=0x7f34941018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.059+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 shutdown_connections 2024-04-26T11:26:03.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:03.059+0000 7f3499000700 1 -- 172.21.15.110:0/3580958528 wait complete. 2024-04-26T11:26:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:03 smithi196 ceph-mon[32572]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:03 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3580958528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:26:03.772 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:03 smithi110 ceph-mon[28069]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:03.772 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:03 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3580958528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:26:03.842 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:44.478027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:26:03.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-26T11:26:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:03 smithi193 ceph-mon[32782]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:03 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3580958528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:26:04.270 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:05 smithi196 ceph-mon[32572]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:05 smithi110 ceph-mon[28069]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:05 smithi193 ceph-mon[32782]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:06.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.620+0000 7f9851000700 1 -- 172.21.15.110:0/1559163041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c10a320 msgr2=0x7f984c1167c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:06.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.620+0000 7f9851000700 1 --2- 172.21.15.110:0/1559163041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c10a320 0x7f984c1167c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f984400b0a0 tx=0x7f984400b3b0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.621+0000 7f9851000700 1 -- 172.21.15.110:0/1559163041 shutdown_connections 2024-04-26T11:26:06.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.621+0000 7f9851000700 1 --2- 172.21.15.110:0/1559163041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c10a320 0x7f984c1167c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.621+0000 7f9851000700 1 --2- 172.21.15.110:0/1559163041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c10e830 0x7f984c10ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.621+0000 7f9851000700 1 --2- 172.21.15.110:0/1559163041 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f984c109960 0x7f984c109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.621+0000 7f9851000700 1 -- 172.21.15.110:0/1559163041 >> 172.21.15.110:0/1559163041 conn(0x7f984c0791b0 msgr2=0x7f984c108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:06.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.621+0000 7f9851000700 1 -- 172.21.15.110:0/1559163041 shutdown_connections 2024-04-26T11:26:06.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.621+0000 7f9851000700 1 -- 172.21.15.110:0/1559163041 wait complete. 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.622+0000 7f9851000700 1 Processor -- start 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.622+0000 7f9851000700 1 -- start start 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.622+0000 7f9851000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c109960 0x7f984c1a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.622+0000 7f9851000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f984c10a320 0x7f984c1a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.622+0000 7f9851000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c10e830 0x7f984c1a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.622+0000 7f9851000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f984c119b50 con 0x7f984c109960 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.622+0000 7f9851000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f984c1199d0 con 0x7f984c10e830 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.622+0000 7f9851000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f984c119cd0 con 0x7f984c10a320 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984b400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c109960 0x7f984c1a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984b400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c109960 0x7f984c1a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54574/0 (socket says 172.21.15.110:54574) 2024-04-26T11:26:06.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984b400700 1 -- 172.21.15.110:0/796540978 learned_addr learned my addr 172.21.15.110:0/796540978 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:06.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984be00700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c10e830 0x7f984c1a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:06.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984aa00700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f984c10a320 0x7f984c1a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:06.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984b400700 1 -- 172.21.15.110:0/796540978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f984c10a320 msgr2=0x7f984c1a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:06.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984b400700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f984c10a320 0x7f984c1a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984b400700 1 -- 172.21.15.110:0/796540978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c10e830 msgr2=0x7f984c1a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:06.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984b400700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c10e830 0x7f984c1a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984b400700 1 -- 172.21.15.110:0/796540978 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984c1a5010 con 0x7f984c109960 2024-04-26T11:26:06.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.623+0000 7f984b400700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c109960 0x7f984c1a0000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f983c00d980 tx=0x7f983c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:06.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.624+0000 7f9843e00700 1 -- 172.21.15.110:0/796540978 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c016070 con 0x7f984c109960 2024-04-26T11:26:06.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.624+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984c1a5300 con 0x7f984c109960 2024-04-26T11:26:06.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.624+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f984c1acb80 con 0x7f984c109960 2024-04-26T11:26:06.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.624+0000 7f9843e00700 1 -- 172.21.15.110:0/796540978 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f983c004830 con 0x7f984c109960 2024-04-26T11:26:06.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.624+0000 7f9843e00700 1 -- 172.21.15.110:0/796540978 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c005540 con 0x7f984c109960 2024-04-26T11:26:06.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.625+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c005330 con 0x7f984c109960 2024-04-26T11:26:06.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.627+0000 7f9843e00700 1 -- 172.21.15.110:0/796540978 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f983c004220 con 0x7f984c109960 2024-04-26T11:26:06.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.628+0000 7f9843e00700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98300a3cc0 0x7f98300a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:06.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.629+0000 7f9843e00700 1 -- 172.21.15.110:0/796540978 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f983c0cfbf0 con 0x7f984c109960 2024-04-26T11:26:06.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.629+0000 7f984aa00700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98300a3cc0 0x7f98300a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:06.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.629+0000 7f984aa00700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98300a3cc0 0x7f98300a6180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f984c109510 tx=0x7f9838009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:06.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.633+0000 7f9843e00700 1 -- 172.21.15.110:0/796540978 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f983c01f020 con 0x7f984c109960 2024-04-26T11:26:06.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.857+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f982c005e30 con 0x7f984c109960 2024-04-26T11:26:06.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.858+0000 7f9843e00700 1 -- 172.21.15.110:0/796540978 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f983c022350 con 0x7f984c109960 2024-04-26T11:26:06.859 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-04-26T11:26:06.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98300a3cc0 msgr2=0x7f98300a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:06.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98300a3cc0 0x7f98300a6180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f984c109510 tx=0x7f9838009260 comp rx=0 tx=0).stop 2024-04-26T11:26:06.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c109960 msgr2=0x7f984c1a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:06.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c109960 0x7f984c1a0000 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f983c00d980 tx=0x7f983c00dc90 comp rx=0 tx=0).stop 2024-04-26T11:26:06.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 shutdown_connections 2024-04-26T11:26:06.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f984c10e830 0x7f984c1a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984c109960 0x7f984c1a0000 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98300a3cc0 0x7f98300a6180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 --2- 172.21.15.110:0/796540978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f984c10a320 0x7f984c1a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:06.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 >> 172.21.15.110:0/796540978 conn(0x7f984c0791b0 msgr2=0x7f984c079830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:06.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.861+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 shutdown_connections 2024-04-26T11:26:06.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:06.862+0000 7f9851000700 1 -- 172.21.15.110:0/796540978 wait complete. 2024-04-26T11:26:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:07 smithi110 ceph-mon[28069]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:07 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/796540978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T11:26:07.725 INFO:tasks.cephadm:Adding mds.a on smithi110 2024-04-26T11:26:07.725 INFO:tasks.cephadm:Adding mds.d on smithi110 2024-04-26T11:26:07.725 INFO:tasks.cephadm:Adding mds.g on smithi110 2024-04-26T11:26:07.725 INFO:tasks.cephadm:Adding mds.j on smithi110 2024-04-26T11:26:07.725 INFO:tasks.cephadm:Adding mds.b on smithi193 2024-04-26T11:26:07.725 INFO:tasks.cephadm:Adding mds.e on smithi193 2024-04-26T11:26:07.726 INFO:tasks.cephadm:Adding mds.h on smithi193 2024-04-26T11:26:07.726 INFO:tasks.cephadm:Adding mds.k on smithi193 2024-04-26T11:26:07.726 INFO:tasks.cephadm:Adding mds.c on smithi196 2024-04-26T11:26:07.726 INFO:tasks.cephadm:Adding mds.f on smithi196 2024-04-26T11:26:07.726 INFO:tasks.cephadm:Adding mds.i on smithi196 2024-04-26T11:26:07.726 INFO:tasks.cephadm:Adding mds.l on smithi196 2024-04-26T11:26:07.726 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi193=b;smithi193=e;smithi193=h;smithi193=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l' 2024-04-26T11:26:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:07 smithi196 ceph-mon[32572]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:07 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/796540978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T11:26:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:07 smithi193 ceph-mon[32782]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:07 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/796540978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T11:26:07.978 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T11:26:09.610 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:09 smithi196 ceph-mon[32572]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:09.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.621+0000 7f6b83e57700 1 -- 172.21.15.196:0/4222851568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1035a0 msgr2=0x7f6b7c103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:09.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.621+0000 7f6b83e57700 1 --2- 172.21.15.196:0/4222851568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1035a0 0x7f6b7c103a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009990 tx=0x7f6b6c009ca0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.621+0000 7f6b83e57700 1 -- 172.21.15.196:0/4222851568 shutdown_connections 2024-04-26T11:26:09.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.621+0000 7f6b83e57700 1 --2- 172.21.15.196:0/4222851568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b7c103f40 0x7f6b7c10a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.621+0000 7f6b83e57700 1 --2- 172.21.15.196:0/4222851568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b7c1023a0 0x7f6b7c1027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.621+0000 7f6b83e57700 1 --2- 172.21.15.196:0/4222851568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1035a0 0x7f6b7c103a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.621+0000 7f6b83e57700 1 -- 172.21.15.196:0/4222851568 >> 172.21.15.196:0/4222851568 conn(0x7f6b7c0fd940 msgr2=0x7f6b7c0ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:09.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.621+0000 7f6b83e57700 1 -- 172.21.15.196:0/4222851568 shutdown_connections 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.621+0000 7f6b83e57700 1 -- 172.21.15.196:0/4222851568 wait complete. 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b83e57700 1 Processor -- start 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b83e57700 1 -- start start 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b83e57700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1023a0 0x7f6b7c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b83e57700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b7c1035a0 0x7f6b7c19e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b83e57700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b7c103f40 0x7f6b7c1a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b83e57700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c10df30 con 0x7f6b7c103f40 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b83e57700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c10ddb0 con 0x7f6b7c1035a0 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b83e57700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c10e0b0 con 0x7f6b7c1023a0 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b81bf3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1023a0 0x7f6b7c06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b81bf3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1023a0 0x7f6b7c06c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:36072/0 (socket says 172.21.15.196:36072) 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b81bf3700 1 -- 172.21.15.196:0/1139790078 learned_addr learned my addr 172.21.15.196:0/1139790078 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b813f2700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b7c1035a0 0x7f6b7c19e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b81bf3700 1 -- 172.21.15.196:0/1139790078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b7c1035a0 msgr2=0x7f6b7c19e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:09.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b81bf3700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b7c1035a0 0x7f6b7c19e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b81bf3700 1 -- 172.21.15.196:0/1139790078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b7c103f40 msgr2=0x7f6b7c1a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b81bf3700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b7c103f40 0x7f6b7c1a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b81bf3700 1 -- 172.21.15.196:0/1139790078 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c1a1310 con 0x7f6b7c1023a0 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b813f2700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b7c1035a0 0x7f6b7c19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.622+0000 7f6b81bf3700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1023a0 0x7f6b7c06c6b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800b500 tx=0x7f6b7800b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.623+0000 7f6b72ffd700 1 -- 172.21.15.196:0/1139790078 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78015020 con 0x7f6b7c1023a0 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.623+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7c1a1600 con 0x7f6b7c1023a0 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.623+0000 7f6b72ffd700 1 -- 172.21.15.196:0/1139790078 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b78011ce0 con 0x7f6b7c1023a0 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.623+0000 7f6b72ffd700 1 -- 172.21.15.196:0/1139790078 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78010d60 con 0x7f6b7c1023a0 2024-04-26T11:26:09.626 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.623+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7c1a1c10 con 0x7f6b7c1023a0 2024-04-26T11:26:09.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.624+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b7c06a110 con 0x7f6b7c1023a0 2024-04-26T11:26:09.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.625+0000 7f6b72ffd700 1 -- 172.21.15.196:0/1139790078 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f6b78018020 con 0x7f6b7c1023a0 2024-04-26T11:26:09.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.625+0000 7f6b72ffd700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b680a3c40 0x7f6b680a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:09.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.625+0000 7f6b72ffd700 1 -- 172.21.15.196:0/1139790078 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f6b780cfd40 con 0x7f6b7c1023a0 2024-04-26T11:26:09.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.626+0000 7f6b813f2700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b680a3c40 0x7f6b680a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:09.628 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.627+0000 7f6b813f2700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b680a3c40 0x7f6b680a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c06cc30 tx=0x7f6b6c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:09.630 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.629+0000 7f6b72ffd700 1 -- 172.21.15.196:0/1139790078 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6b7801f020 con 0x7f6b7c1023a0 2024-04-26T11:26:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:09 smithi110 ceph-mon[28069]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:09.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.834+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi193=b;smithi193=e;smithi193=h;smithi193=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}) -- 0x7f6b7c063a60 con 0x7f6b680a3c40 2024-04-26T11:26:09.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.850+0000 7f6b72ffd700 1 -- 172.21.15.196:0/1139790078 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6b7c063a60 con 0x7f6b680a3c40 2024-04-26T11:26:09.851 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mds.all update... 2024-04-26T11:26:09.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b680a3c40 msgr2=0x7f6b680a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:09.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b680a3c40 0x7f6b680a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c06cc30 tx=0x7f6b6c005fd0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1023a0 msgr2=0x7f6b7c06c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1023a0 0x7f6b7c06c6b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800b500 tx=0x7f6b7800b8c0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 shutdown_connections 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b7c103f40 0x7f6b7c1a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b680a3c40 0x7f6b680a6100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b7c1023a0 0x7f6b7c06c6b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 --2- 172.21.15.196:0/1139790078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b7c1035a0 0x7f6b7c19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 >> 172.21.15.196:0/1139790078 conn(0x7f6b7c0fd940 msgr2=0x7f6b7c106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 shutdown_connections 2024-04-26T11:26:09.854 INFO:teuthology.orchestra.run.smithi196.stderr:2024-04-26T11:26:09.852+0000 7f6b83e57700 1 -- 172.21.15.196:0/1139790078 wait complete. 2024-04-26T11:26:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:09 smithi193 ceph-mon[32782]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:10.549 DEBUG:teuthology.orchestra.run.smithi110:mds.a> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service 2024-04-26T11:26:10.554 DEBUG:teuthology.orchestra.run.smithi110:mds.d> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service 2024-04-26T11:26:10.599 DEBUG:teuthology.orchestra.run.smithi110:mds.g> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service 2024-04-26T11:26:10.644 DEBUG:teuthology.orchestra.run.smithi110:mds.j> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service 2024-04-26T11:26:10.690 DEBUG:teuthology.orchestra.run.smithi193:mds.b> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.b.service 2024-04-26T11:26:10.693 DEBUG:teuthology.orchestra.run.smithi193:mds.e> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service 2024-04-26T11:26:10.737 DEBUG:teuthology.orchestra.run.smithi193:mds.h> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.h.service 2024-04-26T11:26:10.780 DEBUG:teuthology.orchestra.run.smithi193:mds.k> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service 2024-04-26T11:26:10.823 DEBUG:teuthology.orchestra.run.smithi196:mds.c> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service 2024-04-26T11:26:10.825 DEBUG:teuthology.orchestra.run.smithi196:mds.f> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service 2024-04-26T11:26:10.868 DEBUG:teuthology.orchestra.run.smithi196:mds.i> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service 2024-04-26T11:26:10.911 DEBUG:teuthology.orchestra.run.smithi196:mds.l> sudo journalctl -f -n 0 -u ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service 2024-04-26T11:26:10.953 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-26T11:26:10.954 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:26:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:10 smithi193 ceph-mon[32782]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi193=b;smithi193=e;smithi193=h;smithi193=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:26:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:10 smithi193 ceph-mon[32782]: Saving service mds.all spec with placement smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi193=b;smithi193=e;smithi193=h;smithi193=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-04-26T11:26:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:10 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:26:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:10 smithi193 ceph-mon[32782]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:10 smithi196 ceph-mon[32572]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi193=b;smithi193=e;smithi193=h;smithi193=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:26:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:10 smithi196 ceph-mon[32572]: Saving service mds.all spec with placement smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi193=b;smithi193=e;smithi193=h;smithi193=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-04-26T11:26:11.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:11.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:10 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:26:11.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:10 smithi196 ceph-mon[32572]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:10 smithi110 ceph-mon[28069]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi193=b;smithi193=e;smithi193=h;smithi193=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:26:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:10 smithi110 ceph-mon[28069]: Saving service mds.all spec with placement smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi193=b;smithi193=e;smithi193=h;smithi193=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-04-26T11:26:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:10 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:26:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:10 smithi110 ceph-mon[28069]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:11.369 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:26:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:11 smithi196 ceph-mon[32572]: Deploying daemon mds.l on smithi196 2024-04-26T11:26:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:26:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:11 smithi193 ceph-mon[32782]: Deploying daemon mds.l on smithi196 2024-04-26T11:26:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:26:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:11 smithi110 ceph-mon[28069]: Deploying daemon mds.l on smithi196 2024-04-26T11:26:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:12 smithi196 ceph-mon[32572]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:13.035 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:12 smithi110 ceph-mon[28069]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:12 smithi193 ceph-mon[32782]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:13.445 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:26:13 smithi196 systemd[1]: Starting Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:26:13.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.570+0000 7efc73200700 1 -- 172.21.15.110:0/2908127154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc741141d0 msgr2=0x7efc741165c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:13.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.570+0000 7efc73200700 1 --2- 172.21.15.110:0/2908127154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc741141d0 0x7efc741165c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00b0a0 tx=0x7efc6c00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.570+0000 7efc73200700 1 -- 172.21.15.110:0/2908127154 shutdown_connections 2024-04-26T11:26:13.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.570+0000 7efc73200700 1 --2- 172.21.15.110:0/2908127154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc741141d0 0x7efc741165c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.570+0000 7efc73200700 1 --2- 172.21.15.110:0/2908127154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc74077950 0x7efc74077d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.570+0000 7efc73200700 1 --2- 172.21.15.110:0/2908127154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc74078270 0x7efc74113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.570+0000 7efc73200700 1 -- 172.21.15.110:0/2908127154 >> 172.21.15.110:0/2908127154 conn(0x7efc74101000 msgr2=0x7efc74103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:13.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.570+0000 7efc73200700 1 -- 172.21.15.110:0/2908127154 shutdown_connections 2024-04-26T11:26:13.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.570+0000 7efc73200700 1 -- 172.21.15.110:0/2908127154 wait complete. 2024-04-26T11:26:13.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.571+0000 7efc73200700 1 Processor -- start 2024-04-26T11:26:13.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.571+0000 7efc73200700 1 -- start start 2024-04-26T11:26:13.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc73200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc74077950 0x7efc7419fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:13.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc73200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc74078270 0x7efc741a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:13.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc73200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc741141d0 0x7efc741a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:13.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc73200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efc74119b80 con 0x7efc741141d0 2024-04-26T11:26:13.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc73200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efc74119a00 con 0x7efc74077950 2024-04-26T11:26:13.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc73200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efc74119d00 con 0x7efc74078270 2024-04-26T11:26:13.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc72800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc741141d0 0x7efc741a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:13.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc71e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc74077950 0x7efc7419fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:13.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc71e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc74077950 0x7efc7419fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:57240/0 (socket says 172.21.15.110:57240) 2024-04-26T11:26:13.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc72800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc741141d0 0x7efc741a48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45832/0 (socket says 172.21.15.110:45832) 2024-04-26T11:26:13.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc71e00700 1 -- 172.21.15.110:0/4065310587 learned_addr learned my addr 172.21.15.110:0/4065310587 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:13.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.572+0000 7efc69400700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc74078270 0x7efc741a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:13.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc71e00700 1 -- 172.21.15.110:0/4065310587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc74078270 msgr2=0x7efc741a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:13.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc71e00700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc74078270 0x7efc741a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc71e00700 1 -- 172.21.15.110:0/4065310587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc741141d0 msgr2=0x7efc741a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:13.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc71e00700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc741141d0 0x7efc741a48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc71e00700 1 -- 172.21.15.110:0/4065310587 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc741a5000 con 0x7efc74077950 2024-04-26T11:26:13.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc71e00700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc74077950 0x7efc7419fff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efc6400e9a0 tx=0x7efc6400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:13.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc6b400700 1 -- 172.21.15.110:0/4065310587 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6400ca10 con 0x7efc74077950 2024-04-26T11:26:13.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc741a52f0 con 0x7efc74077950 2024-04-26T11:26:13.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc6b400700 1 -- 172.21.15.110:0/4065310587 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc6400cbb0 con 0x7efc74077950 2024-04-26T11:26:13.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.573+0000 7efc6b400700 1 -- 172.21.15.110:0/4065310587 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64018680 con 0x7efc74077950 2024-04-26T11:26:13.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.574+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc741acb70 con 0x7efc74077950 2024-04-26T11:26:13.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.575+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7406a110 con 0x7efc74077950 2024-04-26T11:26:13.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.577+0000 7efc6b400700 1 -- 172.21.15.110:0/4065310587 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7efc64010430 con 0x7efc74077950 2024-04-26T11:26:13.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.578+0000 7efc6b400700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efc580a3cc0 0x7efc580a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:13.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.578+0000 7efc6b400700 1 -- 172.21.15.110:0/4065310587 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7efc640d0410 con 0x7efc74077950 2024-04-26T11:26:13.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.579+0000 7efc69400700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efc580a3cc0 0x7efc580a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:13.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.579+0000 7efc69400700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efc580a3cc0 0x7efc580a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc74104690 tx=0x7efc5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:13.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.581+0000 7efc6b400700 1 -- 172.21.15.110:0/4065310587 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efc6409d1f0 con 0x7efc74077950 2024-04-26T11:26:13.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:26:13 smithi196 podman[62421]: 2024-04-26 11:26:13.347606885 +0000 UTC m=+0.018000923 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:13.698 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:26:13 smithi196 podman[62421]: 2024-04-26 11:26:13.467064969 +0000 UTC m=+0.137458971 container create 22b6143e99ba6b37c310f1a8e3c70dab1fe8fcf669788592fe131ed871943f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:26:13.698 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:26:13 smithi196 podman[62421]: 2024-04-26 11:26:13.694678312 +0000 UTC m=+0.365072324 container init 22b6143e99ba6b37c310f1a8e3c70dab1fe8fcf669788592fe131ed871943f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:26:13.698 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:26:13 smithi196 podman[62421]: 2024-04-26 11:26:13.697359591 +0000 UTC m=+0.367753597 container start 22b6143e99ba6b37c310f1a8e3c70dab1fe8fcf669788592fe131ed871943f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-26T11:26:13.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.860+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc7402e490 con 0x7efc74077950 2024-04-26T11:26:13.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.861+0000 7efc6b400700 1 -- 172.21.15.110:0/4065310587 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7efc6409caf0 con 0x7efc74077950 2024-04-26T11:26:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:26:13.862 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T11:26:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efc580a3cc0 msgr2=0x7efc580a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efc580a3cc0 0x7efc580a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc74104690 tx=0x7efc5c009260 comp rx=0 tx=0).stop 2024-04-26T11:26:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc74077950 msgr2=0x7efc7419fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc74077950 0x7efc7419fff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efc6400e9a0 tx=0x7efc6400ecb0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 shutdown_connections 2024-04-26T11:26:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc741141d0 0x7efc741a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc74077950 0x7efc7419fff0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efc580a3cc0 0x7efc580a6180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 --2- 172.21.15.110:0/4065310587 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efc74078270 0x7efc741a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:13.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 >> 172.21.15.110:0/4065310587 conn(0x7efc74101000 msgr2=0x7efc741033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:13.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 shutdown_connections 2024-04-26T11:26:13.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:13.864+0000 7efc73200700 1 -- 172.21.15.110:0/4065310587 wait complete. 2024-04-26T11:26:13.866 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 2 2024-04-26T11:26:14.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:26:13 smithi196 ceph-mds[62440]: -- 172.21.15.196:0/1769349381 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564764e4fa40 con 0x564764e23000 2024-04-26T11:26:14.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:26:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: starting mds.l at 2024-04-26T11:26:14.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:26:13 smithi196 bash[62421]: 22b6143e99ba6b37c310f1a8e3c70dab1fe8fcf669788592fe131ed871943f71 2024-04-26T11:26:14.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:26:13 smithi196 systemd[1]: Started Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:14.781 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:boot 2024-04-26T11:26:14.781 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: fsmap 1 up:standby 2024-04-26T11:26:14.781 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:26:14.781 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:14.781 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/4065310587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:14.781 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:14.781 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:14.781 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:14.782 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:14.782 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:14.782 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: Deploying daemon mds.k on smithi193 2024-04-26T11:26:14.782 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:14 smithi193 ceph-mon[32782]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:boot 2024-04-26T11:26:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: fsmap 1 up:standby 2024-04-26T11:26:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:26:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/4065310587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: Deploying daemon mds.k on smithi193 2024-04-26T11:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:14 smithi196 ceph-mon[32572]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:boot 2024-04-26T11:26:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: fsmap 1 up:standby 2024-04-26T11:26:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:26:15.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:15.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/4065310587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:15.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:15.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:15.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:15.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:15.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:15.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: Deploying daemon mds.k on smithi193 2024-04-26T11:26:15.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:14 smithi110 ceph-mon[28069]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:16.349 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:26:16 smithi193 systemd[1]: Starting Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:26:16.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:26:16 smithi193 podman[61848]: 2024-04-26 11:26:16.251207068 +0000 UTC m=+0.017935690 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:16.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:26:16 smithi193 podman[61848]: 2024-04-26 11:26:16.380055902 +0000 UTC m=+0.146784509 container create 6e428d9e2c928e135332120b189aa6aab37a7f640dba94cb69a293976a111fb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2) 2024-04-26T11:26:16.681 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:26:17.102 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:17.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:26:16 smithi193 podman[61848]: 2024-04-26 11:26:16.648530026 +0000 UTC m=+0.415258633 container init 6e428d9e2c928e135332120b189aa6aab37a7f640dba94cb69a293976a111fb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T11:26:17.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:26:16 smithi193 podman[61848]: 2024-04-26 11:26:16.651251004 +0000 UTC m=+0.417979622 container start 6e428d9e2c928e135332120b189aa6aab37a7f640dba94cb69a293976a111fb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T11:26:17.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:26:16 smithi193 ceph-mds[61867]: -- 172.21.15.193:0/3757997718 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a0f509da40 con 0x55a0f5070800 2024-04-26T11:26:17.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:26:16 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: starting mds.k at 2024-04-26T11:26:17.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:26:16 smithi193 bash[61848]: 6e428d9e2c928e135332120b189aa6aab37a7f640dba94cb69a293976a111fb7 2024-04-26T11:26:17.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:26:16 smithi193 systemd[1]: Started Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:17 smithi110 ceph-mon[28069]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:17 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:17 smithi193 ceph-mon[32782]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:17.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:17.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:17.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:17 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:17 smithi196 ceph-mon[32572]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:17 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:18 smithi110 ceph-mon[28069]: Deploying daemon mds.j on smithi110 2024-04-26T11:26:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:18 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:boot 2024-04-26T11:26:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:18 smithi110 ceph-mon[28069]: fsmap 2 up:standby 2024-04-26T11:26:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:18 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:26:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:18 smithi193 ceph-mon[32782]: Deploying daemon mds.j on smithi110 2024-04-26T11:26:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:18 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:boot 2024-04-26T11:26:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:18 smithi193 ceph-mon[32782]: fsmap 2 up:standby 2024-04-26T11:26:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:18 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:26:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:18 smithi196 ceph-mon[32572]: Deploying daemon mds.j on smithi110 2024-04-26T11:26:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:18 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:boot 2024-04-26T11:26:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:18 smithi196 ceph-mon[32572]: fsmap 2 up:standby 2024-04-26T11:26:19.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:18 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:26:19.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.498+0000 7f3731600700 1 -- 172.21.15.110:0/581594157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c106000 msgr2=0x7f372c112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:19.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.498+0000 7f3731600700 1 --2- 172.21.15.110:0/581594157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c106000 0x7f372c112510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f372400b0a0 tx=0x7f372400b3b0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.498+0000 7f3731600700 1 -- 172.21.15.110:0/581594157 shutdown_connections 2024-04-26T11:26:19.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.498+0000 7f3731600700 1 --2- 172.21.15.110:0/581594157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c106000 0x7f372c112510 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.498+0000 7f3731600700 1 --2- 172.21.15.110:0/581594157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f372c10b640 0x7f372c10ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.498+0000 7f3731600700 1 --2- 172.21.15.110:0/581594157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f372c105640 0x7f372c105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.498+0000 7f3731600700 1 -- 172.21.15.110:0/581594157 >> 172.21.15.110:0/581594157 conn(0x7f372c101130 msgr2=0x7f372c103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:19.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.498+0000 7f3731600700 1 -- 172.21.15.110:0/581594157 shutdown_connections 2024-04-26T11:26:19.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.498+0000 7f3731600700 1 -- 172.21.15.110:0/581594157 wait complete. 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.499+0000 7f3731600700 1 Processor -- start 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.499+0000 7f3731600700 1 -- start start 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f3731600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f372c105640 0x7f372c1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f3731600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f372c106000 0x7f372c1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f3731600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c10b640 0x7f372c19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f3731600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f372c115880 con 0x7f372c10b640 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f3731600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f372c115700 con 0x7f372c105640 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f3731600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f372c115a00 con 0x7f372c106000 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372aa00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f372c105640 0x7f372c1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372aa00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f372c105640 0x7f372c1a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:57264/0 (socket says 172.21.15.110:57264) 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372aa00700 1 -- 172.21.15.110:0/264883520 learned_addr learned my addr 172.21.15.110:0/264883520 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:19.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372b400700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c10b640 0x7f372c19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:19.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372a000700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f372c106000 0x7f372c1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:19.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372aa00700 1 -- 172.21.15.110:0/264883520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f372c106000 msgr2=0x7f372c1a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:19.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372aa00700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f372c106000 0x7f372c1a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372aa00700 1 -- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c10b640 msgr2=0x7f372c19bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:19.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372aa00700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c10b640 0x7f372c19bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.500+0000 7f372aa00700 1 -- 172.21.15.110:0/264883520 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c19c280 con 0x7f372c105640 2024-04-26T11:26:19.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.501+0000 7f372aa00700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f372c105640 0x7f372c1a1910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f371c00eb30 tx=0x7f371c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:19.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.501+0000 7f3723400700 1 -- 172.21.15.110:0/264883520 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c00cbd0 con 0x7f372c105640 2024-04-26T11:26:19.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.501+0000 7f3723400700 1 -- 172.21.15.110:0/264883520 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f371c0044d0 con 0x7f372c105640 2024-04-26T11:26:19.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.501+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372c19c570 con 0x7f372c105640 2024-04-26T11:26:19.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.501+0000 7f3723400700 1 -- 172.21.15.110:0/264883520 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c003e30 con 0x7f372c105640 2024-04-26T11:26:19.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.501+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372c1a87e0 con 0x7f372c105640 2024-04-26T11:26:19.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.502+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372c06a110 con 0x7f372c105640 2024-04-26T11:26:19.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.504+0000 7f3723400700 1 -- 172.21.15.110:0/264883520 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f371c004000 con 0x7f372c105640 2024-04-26T11:26:19.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.505+0000 7f3723400700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37100a3c40 0x7f37100a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:19.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.505+0000 7f3723400700 1 -- 172.21.15.110:0/264883520 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f371c0d02f0 con 0x7f372c105640 2024-04-26T11:26:19.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.506+0000 7f372a000700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37100a3c40 0x7f37100a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:19.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.506+0000 7f372a000700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37100a3c40 0x7f37100a6100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f372c10acb0 tx=0x7f3718009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:19.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.510+0000 7f3723400700 1 -- 172.21.15.110:0/264883520 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f371c0042f0 con 0x7f372c105640 2024-04-26T11:26:19.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.787+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f372c19cff0 con 0x7f372c105640 2024-04-26T11:26:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:19 smithi110 ceph-mon[28069]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:19.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.788+0000 7f3723400700 1 -- 172.21.15.110:0/264883520 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7f372c19cff0 con 0x7f372c105640 2024-04-26T11:26:19.790 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:26:19.790 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T11:26:19.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37100a3c40 msgr2=0x7f37100a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:19.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37100a3c40 0x7f37100a6100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f372c10acb0 tx=0x7f3718009260 comp rx=0 tx=0).stop 2024-04-26T11:26:19.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f372c105640 msgr2=0x7f372c1a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:19.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f372c105640 0x7f372c1a1910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f371c00eb30 tx=0x7f371c00ee40 comp rx=0 tx=0).stop 2024-04-26T11:26:19.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 shutdown_connections 2024-04-26T11:26:19.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c10b640 0x7f372c19bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f372c105640 0x7f372c1a1910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37100a3c40 0x7f37100a6100 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 --2- 172.21.15.110:0/264883520 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f372c106000 0x7f372c1a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:19.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 >> 172.21.15.110:0/264883520 conn(0x7f372c101130 msgr2=0x7f372c101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:19.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 shutdown_connections 2024-04-26T11:26:19.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:19.791+0000 7f3731600700 1 -- 172.21.15.110:0/264883520 wait complete. 2024-04-26T11:26:19.795 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 3 2024-04-26T11:26:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:19 smithi193 ceph-mon[32782]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:19 smithi196 ceph-mon[32572]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:20 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/264883520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:20 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/264883520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:20 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/264883520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:21.855 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:21 smithi196 ceph-mon[32572]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:21 smithi193 ceph-mon[32782]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:21.989 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:21 smithi110 ceph-mon[28069]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:22.292 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:26:21 smithi110 systemd[1]: Starting Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:26:22.668 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:26:22 smithi110 podman[65839]: 2024-04-26 11:26:22.253801053 +0000 UTC m=+0.033386825 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:22.668 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:26:22 smithi110 podman[65839]: 2024-04-26 11:26:22.379645213 +0000 UTC m=+0.159231022 container create 55d77a14f363fcfdf29ddcbc0710ede6e270fd74ac75ac01d2a5d9490d443d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0) 2024-04-26T11:26:22.668 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:26:22 smithi110 podman[65839]: 2024-04-26 11:26:22.666940221 +0000 UTC m=+0.446526053 container init 55d77a14f363fcfdf29ddcbc0710ede6e270fd74ac75ac01d2a5d9490d443d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True) 2024-04-26T11:26:22.673 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:26:23.041 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:26:22 smithi110 podman[65839]: 2024-04-26 11:26:22.677138952 +0000 UTC m=+0.456724761 container start 55d77a14f363fcfdf29ddcbc0710ede6e270fd74ac75ac01d2a5d9490d443d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424) 2024-04-26T11:26:23.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:26:22 smithi110 ceph-mds[65858]: -- 172.21.15.110:0/1139711463 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556bd096ba40 con 0x556bd093f000 2024-04-26T11:26:23.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:26:22 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: starting mds.j at 2024-04-26T11:26:23.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:26:22 smithi110 bash[65839]: 55d77a14f363fcfdf29ddcbc0710ede6e270fd74ac75ac01d2a5d9490d443d9b 2024-04-26T11:26:23.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:26:22 smithi110 systemd[1]: Started Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:23.102 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:23 smithi193 ceph-mon[32782]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:23.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:23 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:23 smithi196 ceph-mon[32572]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:23 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:23 smithi110 ceph-mon[28069]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:23 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:24.703 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:24 smithi110 ceph-mon[28069]: Deploying daemon mds.d on smithi110 2024-04-26T11:26:24.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:24 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:boot 2024-04-26T11:26:24.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:24 smithi110 ceph-mon[28069]: fsmap 3 up:standby 2024-04-26T11:26:24.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:24 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:26:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:24 smithi193 ceph-mon[32782]: Deploying daemon mds.d on smithi110 2024-04-26T11:26:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:24 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:boot 2024-04-26T11:26:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:24 smithi193 ceph-mon[32782]: fsmap 3 up:standby 2024-04-26T11:26:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:24 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:26:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:24 smithi196 ceph-mon[32572]: Deploying daemon mds.d on smithi110 2024-04-26T11:26:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:24 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:boot 2024-04-26T11:26:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:24 smithi196 ceph-mon[32572]: fsmap 3 up:standby 2024-04-26T11:26:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:24 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:26:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.818+0000 7f09ffe00700 1 -- 172.21.15.110:0/3924976028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8106020 msgr2=0x7f09f8112530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.818+0000 7f09ffe00700 1 --2- 172.21.15.110:0/3924976028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8106020 0x7f09f8112530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f09f000b0a0 tx=0x7f09f000b3b0 comp rx=0 tx=0).stop 2024-04-26T11:26:25.821 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:25 smithi110 ceph-mon[28069]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.818+0000 7f09ffe00700 1 -- 172.21.15.110:0/3924976028 shutdown_connections 2024-04-26T11:26:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.818+0000 7f09ffe00700 1 --2- 172.21.15.110:0/3924976028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8106020 0x7f09f8112530 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.818+0000 7f09ffe00700 1 --2- 172.21.15.110:0/3924976028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f810b660 0x7f09f810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.818+0000 7f09ffe00700 1 --2- 172.21.15.110:0/3924976028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09f8105660 0x7f09f8105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.818+0000 7f09ffe00700 1 -- 172.21.15.110:0/3924976028 >> 172.21.15.110:0/3924976028 conn(0x7f09f8101150 msgr2=0x7f09f8103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.818+0000 7f09ffe00700 1 -- 172.21.15.110:0/3924976028 shutdown_connections 2024-04-26T11:26:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.818+0000 7f09ffe00700 1 -- 172.21.15.110:0/3924976028 wait complete. 2024-04-26T11:26:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.819+0000 7f09ffe00700 1 Processor -- start 2024-04-26T11:26:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.820+0000 7f09ffe00700 1 -- start start 2024-04-26T11:26:25.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.820+0000 7f09ffe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8105660 0x7f09f81a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:25.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.820+0000 7f09ffe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f8106020 0x7f09f81a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:25.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.820+0000 7f09ffe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09f810b660 0x7f09f819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:25.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.820+0000 7f09ffe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f09f81158f0 con 0x7f09f8105660 2024-04-26T11:26:25.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.820+0000 7f09ffe00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f09f8115770 con 0x7f09f810b660 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.820+0000 7f09ffe00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f09f8115a70 con 0x7f09f8106020 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.820+0000 7f09fd400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8105660 0x7f09f81a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fd400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8105660 0x7f09f81a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49058/0 (socket says 172.21.15.110:49058) 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fd400700 1 -- 172.21.15.110:0/332938582 learned_addr learned my addr 172.21.15.110:0/332938582 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fca00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f8106020 0x7f09f81a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fde00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09f810b660 0x7f09f819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fd400700 1 -- 172.21.15.110:0/332938582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f8106020 msgr2=0x7f09f81a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fd400700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f8106020 0x7f09f81a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fd400700 1 -- 172.21.15.110:0/332938582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09f810b660 msgr2=0x7f09f819bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fd400700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09f810b660 0x7f09f819bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fd400700 1 -- 172.21.15.110:0/332938582 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f819c3f0 con 0x7f09f8105660 2024-04-26T11:26:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.821+0000 7f09fd400700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8105660 0x7f09f81a1a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00e9a0 tx=0x7f09ec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:25.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.822+0000 7f09f6000700 1 -- 172.21.15.110:0/332938582 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00ca10 con 0x7f09f8105660 2024-04-26T11:26:25.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.822+0000 7f09f6000700 1 -- 172.21.15.110:0/332938582 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09ec00cbb0 con 0x7f09f8105660 2024-04-26T11:26:25.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.822+0000 7f09f6000700 1 -- 172.21.15.110:0/332938582 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec018680 con 0x7f09f8105660 2024-04-26T11:26:25.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.822+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f819c6e0 con 0x7f09f8105660 2024-04-26T11:26:25.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.822+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f81a89c0 con 0x7f09f8105660 2024-04-26T11:26:25.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.823+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f8106da0 con 0x7f09f8105660 2024-04-26T11:26:25.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.828+0000 7f09f6000700 1 -- 172.21.15.110:0/332938582 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f09ec010430 con 0x7f09f8105660 2024-04-26T11:26:25.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.829+0000 7f09f6000700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f09e00a3cc0 0x7f09e00a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:25.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.830+0000 7f09f6000700 1 -- 172.21.15.110:0/332938582 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f09ec0d0090 con 0x7f09f8105660 2024-04-26T11:26:25.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.830+0000 7f09fca00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f09e00a3cc0 0x7f09e00a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:25.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.831+0000 7f09fca00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f09e00a3cc0 0x7f09e00a6180 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09f819d260 tx=0x7f09e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:25.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:25.834+0000 7f09f6000700 1 -- 172.21.15.110:0/332938582 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f09ec09ce70 con 0x7f09f8105660 2024-04-26T11:26:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:25 smithi193 ceph-mon[32782]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:25 smithi196 ceph-mon[32572]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:26.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.113+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09f819cfd0 con 0x7f09f8105660 2024-04-26T11:26:26.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.114+0000 7f09f6000700 1 -- 172.21.15.110:0/332938582 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3052 (secure 0 0 0) 0x7f09ec09c770 con 0x7f09f8105660 2024-04-26T11:26:26.116 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:26:26.117 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-04-26T11:26:26.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f09e00a3cc0 msgr2=0x7f09e00a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:26.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f09e00a3cc0 0x7f09e00a6180 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09f819d260 tx=0x7f09e4009260 comp rx=0 tx=0).stop 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8105660 msgr2=0x7f09f81a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8105660 0x7f09f81a1a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00e9a0 tx=0x7f09ec00ecb0 comp rx=0 tx=0).stop 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 shutdown_connections 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09f810b660 0x7f09f819bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f8105660 0x7f09f81a1a40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f09e00a3cc0 0x7f09e00a6180 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 --2- 172.21.15.110:0/332938582 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f8106020 0x7f09f81a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 >> 172.21.15.110:0/332938582 conn(0x7f09f8101150 msgr2=0x7f09f81016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 shutdown_connections 2024-04-26T11:26:26.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:26.117+0000 7f09ffe00700 1 -- 172.21.15.110:0/332938582 wait complete. 2024-04-26T11:26:26.121 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 4 2024-04-26T11:26:26.749 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:26 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/332938582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:26 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/332938582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:26 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/332938582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:27 smithi193 ceph-mon[32782]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:27.903 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:27 smithi110 ceph-mon[28069]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:27.904 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:26:27 smithi110 podman[66305]: 2024-04-26 11:26:27.614492087 +0000 UTC m=+0.163977838 container create adb439f3eb906b6a1f87fa3a8fe673a1f371c2ed24df099e328c17be0558f3f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T11:26:27.904 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:26:27 smithi110 podman[66305]: 2024-04-26 11:26:27.902041111 +0000 UTC m=+0.451526872 container init adb439f3eb906b6a1f87fa3a8fe673a1f371c2ed24df099e328c17be0558f3f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-26T11:26:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:27 smithi196 ceph-mon[32572]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:28.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:26:27 smithi110 podman[66305]: 2024-04-26 11:26:27.912991876 +0000 UTC m=+0.462477600 container start adb439f3eb906b6a1f87fa3a8fe673a1f371c2ed24df099e328c17be0558f3f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-26T11:26:28.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:26:27 smithi110 ceph-mds[66326]: -- 172.21.15.110:0/1357616648 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5586fb45fa40 con 0x5586fb432800 2024-04-26T11:26:28.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:26:27 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: starting mds.d at 2024-04-26T11:26:28.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:26:28 smithi110 bash[66305]: adb439f3eb906b6a1f87fa3a8fe673a1f371c2ed24df099e328c17be0558f3f4 2024-04-26T11:26:28.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:26:28 smithi110 systemd[1]: Started Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:29.335 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: Deploying daemon mds.e on smithi193 2024-04-26T11:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:boot 2024-04-26T11:26:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: fsmap 4 up:standby 2024-04-26T11:26:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:29 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: Deploying daemon mds.e on smithi193 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:boot 2024-04-26T11:26:29.417 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: fsmap 4 up:standby 2024-04-26T11:26:29.418 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:29 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:26:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: Deploying daemon mds.e on smithi193 2024-04-26T11:26:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:boot 2024-04-26T11:26:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: fsmap 4 up:standby 2024-04-26T11:26:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:29 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:26:29.787 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:30.598 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:26:30 smithi193 systemd[1]: Starting Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:26:30.872 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:26:30 smithi193 podman[62166]: 2024-04-26 11:26:30.500268738 +0000 UTC m=+0.017803907 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:30.872 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:26:30 smithi193 podman[62166]: 2024-04-26 11:26:30.620037996 +0000 UTC m=+0.137573184 container create 0dfb545f153766a0e15f2ef7941dbda06e4ca3e44867798ab7bef3c3e77855b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T11:26:31.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:26:30 smithi193 podman[62166]: 2024-04-26 11:26:30.880779189 +0000 UTC m=+0.398314336 container init 0dfb545f153766a0e15f2ef7941dbda06e4ca3e44867798ab7bef3c3e77855b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True) 2024-04-26T11:26:31.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:26:30 smithi193 podman[62166]: 2024-04-26 11:26:30.883442756 +0000 UTC m=+0.400977907 container start 0dfb545f153766a0e15f2ef7941dbda06e4ca3e44867798ab7bef3c3e77855b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-26T11:26:31.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:26:30 smithi193 ceph-mds[62185]: -- 172.21.15.193:0/2662845720 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5613486d9a40 con 0x5613486ac800 2024-04-26T11:26:31.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:26:30 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: starting mds.e at 2024-04-26T11:26:31.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:26:30 smithi193 bash[62166]: 0dfb545f153766a0e15f2ef7941dbda06e4ca3e44867798ab7bef3c3e77855b7 2024-04-26T11:26:31.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:26:31 smithi193 systemd[1]: Started Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:31 smithi110 ceph-mon[28069]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:31.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:31.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:31.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:31 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:31.861 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:31 smithi196 ceph-mon[32572]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:31.861 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:31.861 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:31.861 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:31.861 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:31.861 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:31.862 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:31 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:31 smithi193 ceph-mon[32782]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:31 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:32.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.008+0000 7fac6be00700 1 -- 172.21.15.110:0/4017628633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075650 msgr2=0x7fac64075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:32.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.008+0000 7fac6be00700 1 --2- 172.21.15.110:0/4017628633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075650 0x7fac64075a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fac58009990 tx=0x7fac58009ca0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.008+0000 7fac6be00700 1 -- 172.21.15.110:0/4017628633 shutdown_connections 2024-04-26T11:26:32.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.008+0000 7fac6be00700 1 --2- 172.21.15.110:0/4017628633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac641145f0 0x7fac641169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.008+0000 7fac6be00700 1 --2- 172.21.15.110:0/4017628633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075650 0x7fac64075a30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.008+0000 7fac6be00700 1 --2- 172.21.15.110:0/4017628633 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac64075f70 0x7fac641140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.008+0000 7fac6be00700 1 -- 172.21.15.110:0/4017628633 >> 172.21.15.110:0/4017628633 conn(0x7fac6407a580 msgr2=0x7fac6407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:32.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.008+0000 7fac6be00700 1 -- 172.21.15.110:0/4017628633 shutdown_connections 2024-04-26T11:26:32.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.008+0000 7fac6be00700 1 -- 172.21.15.110:0/4017628633 wait complete. 2024-04-26T11:26:32.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.009+0000 7fac6be00700 1 Processor -- start 2024-04-26T11:26:32.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.009+0000 7fac6be00700 1 -- start start 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac6be00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac64075650 0x7fac641a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac6be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075f70 0x7fac641a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac6be00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac641145f0 0x7fac641a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac6be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fac64119c30 con 0x7fac64075f70 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac6be00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fac64119ab0 con 0x7fac64075650 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac6be00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fac64119db0 con 0x7fac641145f0 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac69400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac64075650 0x7fac641a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac68a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075f70 0x7fac641a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac69400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac64075650 0x7fac641a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:33058/0 (socket says 172.21.15.110:33058) 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac69400700 1 -- 172.21.15.110:0/3501884487 learned_addr learned my addr 172.21.15.110:0/3501884487 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:32.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac68a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075f70 0x7fac641a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49080/0 (socket says 172.21.15.110:49080) 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.010+0000 7fac69e00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac641145f0 0x7fac641a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac69400700 1 -- 172.21.15.110:0/3501884487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac641145f0 msgr2=0x7fac641a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac69400700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac641145f0 0x7fac641a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac69400700 1 -- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075f70 msgr2=0x7fac641a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac69400700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075f70 0x7fac641a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac69400700 1 -- 172.21.15.110:0/3501884487 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac641a5130 con 0x7fac64075650 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac68a00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075f70 0x7fac641a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac69400700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac64075650 0x7fac641a0120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac58005910 tx=0x7fac5800b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac62000700 1 -- 172.21.15.110:0/3501884487 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58027070 con 0x7fac64075650 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac641a53c0 con 0x7fac64075650 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac62000700 1 -- 172.21.15.110:0/3501884487 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac58022470 con 0x7fac64075650 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.011+0000 7fac62000700 1 -- 172.21.15.110:0/3501884487 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58017650 con 0x7fac64075650 2024-04-26T11:26:32.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.012+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac641acca0 con 0x7fac64075650 2024-04-26T11:26:32.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.013+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac6406a110 con 0x7fac64075650 2024-04-26T11:26:32.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.015+0000 7fac62000700 1 -- 172.21.15.110:0/3501884487 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fac5802a070 con 0x7fac64075650 2024-04-26T11:26:32.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.016+0000 7fac62000700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fac4c0a3c40 0x7fac4c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:32.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.016+0000 7fac62000700 1 -- 172.21.15.110:0/3501884487 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fac580d0ea0 con 0x7fac64075650 2024-04-26T11:26:32.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.016+0000 7fac68a00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fac4c0a3c40 0x7fac4c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:32.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.017+0000 7fac68a00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fac4c0a3c40 0x7fac4c0a6100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac50009680 tx=0x7fac50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:32.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.018+0000 7fac62000700 1 -- 172.21.15.110:0/3501884487 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fac58013070 con 0x7fac64075650 2024-04-26T11:26:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.294+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac641a1480 con 0x7fac64075650 2024-04-26T11:26:32.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.295+0000 7fac62000700 1 -- 172.21.15.110:0/3501884487 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4708 (secure 0 0 0) 0x7fac5809de30 con 0x7fac64075650 2024-04-26T11:26:32.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:26:32.296 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24467,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-26T11:26:32.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fac4c0a3c40 msgr2=0x7fac4c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:32.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fac4c0a3c40 0x7fac4c0a6100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac50009680 tx=0x7fac50009260 comp rx=0 tx=0).stop 2024-04-26T11:26:32.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac64075650 msgr2=0x7fac641a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:32.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac64075650 0x7fac641a0120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac58005910 tx=0x7fac5800b670 comp rx=0 tx=0).stop 2024-04-26T11:26:32.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 shutdown_connections 2024-04-26T11:26:32.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fac4c0a3c40 0x7fac4c0a6100 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac641145f0 0x7fac641a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac64075650 0x7fac641a0120 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 --2- 172.21.15.110:0/3501884487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac64075f70 0x7fac641a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:32.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 >> 172.21.15.110:0/3501884487 conn(0x7fac6407a580 msgr2=0x7fac64110090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:32.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.298+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 shutdown_connections 2024-04-26T11:26:32.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:32.299+0000 7fac6be00700 1 -- 172.21.15.110:0/3501884487 wait complete. 2024-04-26T11:26:32.301 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 6 2024-04-26T11:26:32.648 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:32 smithi193 ceph-mon[32782]: Deploying daemon mds.f on smithi196 2024-04-26T11:26:32.649 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:32 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:boot 2024-04-26T11:26:32.649 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:32 smithi193 ceph-mon[32782]: fsmap 5 up:standby 2024-04-26T11:26:32.649 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:32 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:26:32.649 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:32 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3501884487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:32.700 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:32 smithi110 ceph-mon[28069]: Deploying daemon mds.f on smithi196 2024-04-26T11:26:32.700 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:32 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:boot 2024-04-26T11:26:32.700 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:32 smithi110 ceph-mon[28069]: fsmap 5 up:standby 2024-04-26T11:26:32.701 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:32 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:26:32.701 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:32 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3501884487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:32.864 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:32 smithi196 ceph-mon[32572]: Deploying daemon mds.f on smithi196 2024-04-26T11:26:32.864 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:32 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:boot 2024-04-26T11:26:32.864 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:32 smithi196 ceph-mon[32572]: fsmap 5 up:standby 2024-04-26T11:26:32.864 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:32 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:26:32.865 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:32 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3501884487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:33.540 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:26:33 smithi196 systemd[1]: Starting Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:26:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:33 smithi110 ceph-mon[28069]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:33.817 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:33 smithi196 ceph-mon[32572]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:33.817 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:26:33 smithi196 podman[62732]: 2024-04-26 11:26:33.581424996 +0000 UTC m=+0.017804901 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:33.817 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:26:33 smithi196 podman[62732]: 2024-04-26 11:26:33.695787323 +0000 UTC m=+0.132167215 container create bb0ef47b14bc45134dfe595ffecdd2135e5682ddbf07b0cfaa2a6b15306db1ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-26T11:26:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:33 smithi193 ceph-mon[32782]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:34.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:26:33 smithi196 podman[62732]: 2024-04-26 11:26:33.948722043 +0000 UTC m=+0.385101935 container init bb0ef47b14bc45134dfe595ffecdd2135e5682ddbf07b0cfaa2a6b15306db1ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T11:26:34.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:26:33 smithi196 podman[62732]: 2024-04-26 11:26:33.95143161 +0000 UTC m=+0.387811508 container start bb0ef47b14bc45134dfe595ffecdd2135e5682ddbf07b0cfaa2a6b15306db1ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T11:26:34.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:26:33 smithi196 ceph-mds[62751]: -- 172.21.15.196:0/4280463357 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555959f2fa40 con 0x555959f02c00 2024-04-26T11:26:34.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:26:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: starting mds.f at 2024-04-26T11:26:34.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:26:34 smithi196 bash[62732]: bb0ef47b14bc45134dfe595ffecdd2135e5682ddbf07b0cfaa2a6b15306db1ba 2024-04-26T11:26:34.256 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:26:34 smithi196 systemd[1]: Started Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:35.209 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: Deploying daemon mds.c on smithi196 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:boot 2024-04-26T11:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: fsmap 6 up:standby 2024-04-26T11:26:35.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:35 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:26:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: Deploying daemon mds.c on smithi196 2024-04-26T11:26:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:boot 2024-04-26T11:26:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: fsmap 6 up:standby 2024-04-26T11:26:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:35 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:26:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: Deploying daemon mds.c on smithi196 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:boot 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: fsmap 6 up:standby 2024-04-26T11:26:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:35 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:26:35.647 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:36.508 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:26:36 smithi196 systemd[1]: Starting Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:26:36.888 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:26:36 smithi196 podman[63043]: 2024-04-26 11:26:36.520445636 +0000 UTC m=+0.018390315 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:36.888 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:26:36 smithi196 podman[63043]: 2024-04-26 11:26:36.651298183 +0000 UTC m=+0.149242841 container create c6f8ada6b30dd44d2c88d7c7d5d6076d3c9db42af074bd3ca8def2a64ac8f92d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-26T11:26:36.888 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:26:36 smithi196 podman[63043]: 2024-04-26 11:26:36.887393152 +0000 UTC m=+0.385337804 container init c6f8ada6b30dd44d2c88d7c7d5d6076d3c9db42af074bd3ca8def2a64ac8f92d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T11:26:37.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:26:36 smithi196 podman[63043]: 2024-04-26 11:26:36.890075829 +0000 UTC m=+0.388020490 container start c6f8ada6b30dd44d2c88d7c7d5d6076d3c9db42af074bd3ca8def2a64ac8f92d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-26T11:26:37.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:26:36 smithi196 ceph-mds[63062]: -- 172.21.15.196:0/951976806 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d40ecda40 con 0x555d40ea1000 2024-04-26T11:26:37.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:26:36 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: starting mds.c at 2024-04-26T11:26:37.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:26:36 smithi196 bash[63043]: c6f8ada6b30dd44d2c88d7c7d5d6076d3c9db42af074bd3ca8def2a64ac8f92d 2024-04-26T11:26:37.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:26:36 smithi196 systemd[1]: Started Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:37.712 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:37 smithi110 ceph-mon[28069]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:37.712 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:37.712 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:37.712 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:37.712 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:37.712 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:37.712 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:37.841 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:37 smithi193 ceph-mon[32782]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:37.841 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:37.841 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:37.841 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:37.841 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:37.842 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:37.842 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:37.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.878+0000 7f96b7000700 1 -- 172.21.15.110:0/627320663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b01094a0 msgr2=0x7f96b0109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:37.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.878+0000 7f96b7000700 1 --2- 172.21.15.110:0/627320663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b01094a0 0x7f96b0109880 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f96a000b0a0 tx=0x7f96a000b3b0 comp rx=0 tx=0).stop 2024-04-26T11:26:37.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.878+0000 7f96b7000700 1 -- 172.21.15.110:0/627320663 shutdown_connections 2024-04-26T11:26:37.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.878+0000 7f96b7000700 1 --2- 172.21.15.110:0/627320663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b006bad0 0x7f96b01102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:37.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.878+0000 7f96b7000700 1 --2- 172.21.15.110:0/627320663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b01094a0 0x7f96b0109880 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:37.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.878+0000 7f96b7000700 1 --2- 172.21.15.110:0/627320663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96b006b130 0x7f96b006b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:37.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.878+0000 7f96b7000700 1 -- 172.21.15.110:0/627320663 >> 172.21.15.110:0/627320663 conn(0x7f96b00792d0 msgr2=0x7f96b00796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:37.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.878+0000 7f96b7000700 1 -- 172.21.15.110:0/627320663 shutdown_connections 2024-04-26T11:26:37.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.878+0000 7f96b7000700 1 -- 172.21.15.110:0/627320663 wait complete. 2024-04-26T11:26:37.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.879+0000 7f96b7000700 1 Processor -- start 2024-04-26T11:26:37.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96b7000700 1 -- start start 2024-04-26T11:26:37.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96b7000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b006b130 0x7f96b01023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:37.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96b7000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96b006bad0 0x7f96b0102930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:37.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96b7000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b01094a0 0x7f96b0102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:37.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96b7000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f96b0113590 con 0x7f96b006b130 2024-04-26T11:26:37.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96b7000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f96b0113410 con 0x7f96b006bad0 2024-04-26T11:26:37.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96b7000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96b0113710 con 0x7f96b01094a0 2024-04-26T11:26:37.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96afe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b006b130 0x7f96b01023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:37.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96afe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b006b130 0x7f96b01023f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32862/0 (socket says 172.21.15.110:32862) 2024-04-26T11:26:37.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96afe00700 1 -- 172.21.15.110:0/3047066466 learned_addr learned my addr 172.21.15.110:0/3047066466 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:37.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.880+0000 7f96a7400700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96b006bad0 0x7f96b0102930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:37.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.881+0000 7f96b5000700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b01094a0 0x7f96b0102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:37.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.881+0000 7f96afe00700 1 -- 172.21.15.110:0/3047066466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b01094a0 msgr2=0x7f96b0102e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:37.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.881+0000 7f96afe00700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b01094a0 0x7f96b0102e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.881+0000 7f96afe00700 1 -- 172.21.15.110:0/3047066466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96b006bad0 msgr2=0x7f96b0102930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.881+0000 7f96afe00700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96b006bad0 0x7f96b0102930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.881+0000 7f96afe00700 1 -- 172.21.15.110:0/3047066466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b01a8070 con 0x7f96b006b130 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.881+0000 7f96afe00700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b006b130 0x7f96b01023f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f96a000b070 tx=0x7f96a0004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.881+0000 7f96ad600700 1 -- 172.21.15.110:0/3047066466 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0021070 con 0x7f96b006b130 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.882+0000 7f96ad600700 1 -- 172.21.15.110:0/3047066466 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96a0007e30 con 0x7f96b006b130 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.882+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b01a8300 con 0x7f96b006b130 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.882+0000 7f96ad600700 1 -- 172.21.15.110:0/3047066466 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a00046c0 con 0x7f96b006b130 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.882+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b01a8800 con 0x7f96b006b130 2024-04-26T11:26:37.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.883+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b006a110 con 0x7f96b006b130 2024-04-26T11:26:37.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.885+0000 7f96ad600700 1 -- 172.21.15.110:0/3047066466 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f96a0007980 con 0x7f96b006b130 2024-04-26T11:26:37.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.886+0000 7f96ad600700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96940a3cc0 0x7f96940a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:37.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.886+0000 7f96ad600700 1 -- 172.21.15.110:0/3047066466 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f96a000f020 con 0x7f96b006b130 2024-04-26T11:26:37.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.887+0000 7f96a7400700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96940a3cc0 0x7f96940a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:37.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.887+0000 7f96a7400700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96940a3cc0 0x7f96940a6180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f96b00799b0 tx=0x7f9698009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:37.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:37.891+0000 7f96ad600700 1 -- 172.21.15.110:0/3047066466 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f96a002a020 con 0x7f96b006b130 2024-04-26T11:26:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:37 smithi196 ceph-mon[32572]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:38.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:38.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.170+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96b002e490 con 0x7f96b006b130 2024-04-26T11:26:38.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.171+0000 7f96ad600700 1 -- 172.21.15.110:0/3047066466 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6364 (secure 0 0 0) 0x7f96a009e0b0 con 0x7f96b006b130 2024-04-26T11:26:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:26:38.172 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24467,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-26T11:26:38.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96940a3cc0 msgr2=0x7f96940a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:38.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96940a3cc0 0x7f96940a6180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f96b00799b0 tx=0x7f9698009260 comp rx=0 tx=0).stop 2024-04-26T11:26:38.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b006b130 msgr2=0x7f96b01023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b006b130 0x7f96b01023f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f96a000b070 tx=0x7f96a0004d00 comp rx=0 tx=0).stop 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 shutdown_connections 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96940a3cc0 0x7f96940a6180 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96b01094a0 0x7f96b0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b006b130 0x7f96b01023f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 --2- 172.21.15.110:0/3047066466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96b006bad0 0x7f96b0102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 >> 172.21.15.110:0/3047066466 conn(0x7f96b00792d0 msgr2=0x7f96b01004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 shutdown_connections 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:38.174+0000 7f96b7000700 1 -- 172.21.15.110:0/3047066466 wait complete. 2024-04-26T11:26:38.176 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-04-26T11:26:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:38 smithi110 ceph-mon[28069]: Deploying daemon mds.h on smithi193 2024-04-26T11:26:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:38 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] up:boot 2024-04-26T11:26:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:38 smithi110 ceph-mon[28069]: fsmap 7 up:standby 2024-04-26T11:26:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:26:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:38 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3047066466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:38.813 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:38 smithi193 ceph-mon[32782]: Deploying daemon mds.h on smithi193 2024-04-26T11:26:38.814 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:38 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] up:boot 2024-04-26T11:26:38.814 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:38 smithi193 ceph-mon[32782]: fsmap 7 up:standby 2024-04-26T11:26:38.814 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:26:38.814 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:38 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3047066466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:38 smithi196 ceph-mon[32572]: Deploying daemon mds.h on smithi193 2024-04-26T11:26:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:38 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] up:boot 2024-04-26T11:26:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:38 smithi196 ceph-mon[32572]: fsmap 7 up:standby 2024-04-26T11:26:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:26:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:38 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3047066466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:39.450 INFO:journalctl@ceph.mds.h.smithi193.stdout:Apr 26 11:26:39 smithi193 podman[62490]: 2024-04-26 11:26:39.318908087 +0000 UTC m=+0.018437302 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:39.450 INFO:journalctl@ceph.mds.h.smithi193.stdout:Apr 26 11:26:39 smithi193 podman[62490]: 2024-04-26 11:26:39.449442006 +0000 UTC m=+0.148971208 container create c28fe20e292013625e445e4353a05274a022e04d7c69066bceacbc2228305fdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:26:39.702 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:39 smithi193 ceph-mon[32782]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:39.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:39 smithi196 ceph-mon[32572]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:39 smithi110 ceph-mon[28069]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:40.122 INFO:journalctl@ceph.mds.h.smithi193.stdout:Apr 26 11:26:39 smithi193 podman[62490]: 2024-04-26 11:26:39.702355872 +0000 UTC m=+0.401885074 container init c28fe20e292013625e445e4353a05274a022e04d7c69066bceacbc2228305fdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:26:40.122 INFO:journalctl@ceph.mds.h.smithi193.stdout:Apr 26 11:26:39 smithi193 podman[62490]: 2024-04-26 11:26:39.704930618 +0000 UTC m=+0.404459825 container start c28fe20e292013625e445e4353a05274a022e04d7c69066bceacbc2228305fdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-h, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T11:26:40.122 INFO:journalctl@ceph.mds.h.smithi193.stdout:Apr 26 11:26:39 smithi193 ceph-mds[62510]: -- 172.21.15.193:0/3209218013 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5570d5d97a40 con 0x5570d5d6b000 2024-04-26T11:26:40.122 INFO:journalctl@ceph.mds.h.smithi193.stdout:Apr 26 11:26:39 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-h[62506]: starting mds.h at 2024-04-26T11:26:40.122 INFO:journalctl@ceph.mds.h.smithi193.stdout:Apr 26 11:26:39 smithi193 bash[62490]: c28fe20e292013625e445e4353a05274a022e04d7c69066bceacbc2228305fdd 2024-04-26T11:26:40.122 INFO:journalctl@ceph.mds.h.smithi193.stdout:Apr 26 11:26:39 smithi193 systemd[1]: Started Ceph mds.h for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:41.005 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: Deploying daemon mds.i on smithi196 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6836/324089889,v1:172.21.15.193:6837/324089889] up:boot 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: fsmap 8 up:standby 2024-04-26T11:26:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:40 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T11:26:41.175 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: Deploying daemon mds.i on smithi196 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6836/324089889,v1:172.21.15.193:6837/324089889] up:boot 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: fsmap 8 up:standby 2024-04-26T11:26:41.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:40 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T11:26:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: Deploying daemon mds.i on smithi196 2024-04-26T11:26:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6836/324089889,v1:172.21.15.193:6837/324089889] up:boot 2024-04-26T11:26:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: fsmap 8 up:standby 2024-04-26T11:26:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:40 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T11:26:41.445 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:42.255 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:26:42 smithi196 systemd[1]: Starting Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:26:42.592 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:26:42 smithi196 podman[63363]: 2024-04-26 11:26:42.232047665 +0000 UTC m=+0.018498267 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:42.592 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:26:42 smithi196 podman[63363]: 2024-04-26 11:26:42.365592157 +0000 UTC m=+0.152042783 container create d0b9c24b21c1481428eba191e98463ebe18903be9b9eb79497ab907b4c521dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T11:26:42.592 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:26:42 smithi196 podman[63363]: 2024-04-26 11:26:42.59158465 +0000 UTC m=+0.378035233 container init d0b9c24b21c1481428eba191e98463ebe18903be9b9eb79497ab907b4c521dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:26:43.005 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:26:42 smithi196 podman[63363]: 2024-04-26 11:26:42.594865197 +0000 UTC m=+0.381315791 container start d0b9c24b21c1481428eba191e98463ebe18903be9b9eb79497ab907b4c521dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-26T11:26:43.005 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:26:42 smithi196 ceph-mds[63382]: -- 172.21.15.196:0/2822203727 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5632edf71a40 con 0x5632edf44800 2024-04-26T11:26:43.005 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:26:42 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: starting mds.i at 2024-04-26T11:26:43.005 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:26:42 smithi196 bash[63363]: d0b9c24b21c1481428eba191e98463ebe18903be9b9eb79497ab907b4c521dd9 2024-04-26T11:26:43.005 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:26:42 smithi196 systemd[1]: Started Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:43.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.652+0000 7fd6ff800700 1 -- 172.21.15.110:0/232998012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f806b130 msgr2=0x7fd6f806b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:43.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.652+0000 7fd6ff800700 1 --2- 172.21.15.110:0/232998012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f806b130 0x7fd6f806b590 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009990 tx=0x7fd6e4009ca0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.652+0000 7fd6ff800700 1 -- 172.21.15.110:0/232998012 shutdown_connections 2024-04-26T11:26:43.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.652+0000 7fd6ff800700 1 --2- 172.21.15.110:0/232998012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f806bad0 0x7fd6f81102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.652+0000 7fd6ff800700 1 --2- 172.21.15.110:0/232998012 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6f81094a0 0x7fd6f8109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.652+0000 7fd6ff800700 1 --2- 172.21.15.110:0/232998012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f806b130 0x7fd6f806b590 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.652+0000 7fd6ff800700 1 -- 172.21.15.110:0/232998012 >> 172.21.15.110:0/232998012 conn(0x7fd6f80792d0 msgr2=0x7fd6f80796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:43.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.652+0000 7fd6ff800700 1 -- 172.21.15.110:0/232998012 shutdown_connections 2024-04-26T11:26:43.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.652+0000 7fd6ff800700 1 -- 172.21.15.110:0/232998012 wait complete. 2024-04-26T11:26:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.654+0000 7fd6ff800700 1 Processor -- start 2024-04-26T11:26:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.654+0000 7fd6ff800700 1 -- start start 2024-04-26T11:26:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6ff800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f806b130 0x7fd6f819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6ff800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6f806bad0 0x7fd6f819c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:43.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6ff800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f81094a0 0x7fd6f81a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6ff800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8113600 con 0x7fd6f81094a0 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6ff800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8113480 con 0x7fd6f806b130 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6ff800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8113780 con 0x7fd6f806bad0 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fce00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f806b130 0x7fd6f819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6f7e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6f806bad0 0x7fd6f819c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fce00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f806b130 0x7fd6f819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:37362/0 (socket says 172.21.15.110:37362) 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fce00700 1 -- 172.21.15.110:0/2898217542 learned_addr learned my addr 172.21.15.110:0/2898217542 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fd800700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f81094a0 0x7fd6f81a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fce00700 1 -- 172.21.15.110:0/2898217542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6f806bad0 msgr2=0x7fd6f819c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fce00700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6f806bad0 0x7fd6f819c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fce00700 1 -- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f81094a0 msgr2=0x7fd6f81a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fce00700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f81094a0 0x7fd6f81a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fce00700 1 -- 172.21.15.110:0/2898217542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f81a0da0 con 0x7fd6f806b130 2024-04-26T11:26:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.655+0000 7fd6fd800700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f81094a0 0x7fd6f81a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.656+0000 7fd6fce00700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f806b130 0x7fd6f819bd90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00e9a0 tx=0x7fd6ec00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.656+0000 7fd6f5600700 1 -- 172.21.15.110:0/2898217542 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00cbd0 con 0x7fd6f806b130 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.656+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f81a1090 con 0x7fd6f806b130 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.656+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f81a8910 con 0x7fd6f806b130 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.656+0000 7fd6f5600700 1 -- 172.21.15.110:0/2898217542 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6ec00cd70 con 0x7fd6f806b130 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.656+0000 7fd6f5600700 1 -- 172.21.15.110:0/2898217542 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec018680 con 0x7fd6f806b130 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.657+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d8005330 con 0x7fd6f806b130 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.659+0000 7fd6f5600700 1 -- 172.21.15.110:0/2898217542 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fd6ec010430 con 0x7fd6f806b130 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.660+0000 7fd6f5600700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd6e00a3c40 0x7fd6e00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.661+0000 7fd6f5600700 1 -- 172.21.15.110:0/2898217542 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fd6ec0d00c0 con 0x7fd6f806b130 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.661+0000 7fd6f7e00700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd6e00a3c40 0x7fd6e00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.661+0000 7fd6f7e00700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd6e00a3c40 0x7fd6e00a6100 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8079920 tx=0x7fd6e400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:43.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.665+0000 7fd6f5600700 1 -- 172.21.15.110:0/2898217542 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd6ec09cea0 con 0x7fd6f806b130 2024-04-26T11:26:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:43 smithi110 ceph-mon[28069]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:43 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:43 smithi193 ceph-mon[32782]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:43 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:43.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.944+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6d8005620 con 0x7fd6f806b130 2024-04-26T11:26:43.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.945+0000 7fd6f5600700 1 -- 172.21.15.110:0/2898217542 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8019 (secure 0 0 0) 0x7fd6ec09c7a0 con 0x7fd6f806b130 2024-04-26T11:26:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:26:43.946 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24467,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-26T11:26:43.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd6e00a3c40 msgr2=0x7fd6e00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:43.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd6e00a3c40 0x7fd6e00a6100 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8079920 tx=0x7fd6e400b260 comp rx=0 tx=0).stop 2024-04-26T11:26:43.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f806b130 msgr2=0x7fd6f819bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:43.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f806b130 0x7fd6f819bd90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00e9a0 tx=0x7fd6ec00ecb0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 shutdown_connections 2024-04-26T11:26:43.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f81094a0 0x7fd6f81a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6f806b130 0x7fd6f819bd90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd6e00a3c40 0x7fd6e00a6100 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 --2- 172.21.15.110:0/2898217542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6f806bad0 0x7fd6f819c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:43.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.948+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 >> 172.21.15.110:0/2898217542 conn(0x7fd6f80792d0 msgr2=0x7fd6f810e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:43.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.949+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 shutdown_connections 2024-04-26T11:26:43.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:43.949+0000 7fd6ff800700 1 -- 172.21.15.110:0/2898217542 wait complete. 2024-04-26T11:26:43.951 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 10 2024-04-26T11:26:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:43 smithi196 ceph-mon[32572]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:44.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:44.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:44.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:44.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:43 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:44 smithi110 ceph-mon[28069]: Deploying daemon mds.g on smithi110 2024-04-26T11:26:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:44 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] up:boot 2024-04-26T11:26:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:44 smithi110 ceph-mon[28069]: fsmap 9 up:standby 2024-04-26T11:26:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:44 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:26:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:44 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2898217542' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:44 smithi193 ceph-mon[32782]: Deploying daemon mds.g on smithi110 2024-04-26T11:26:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:44 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] up:boot 2024-04-26T11:26:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:44 smithi193 ceph-mon[32782]: fsmap 9 up:standby 2024-04-26T11:26:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:44 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:26:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:44 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2898217542' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:44 smithi196 ceph-mon[32572]: Deploying daemon mds.g on smithi110 2024-04-26T11:26:45.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:44 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] up:boot 2024-04-26T11:26:45.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:44 smithi196 ceph-mon[32572]: fsmap 9 up:standby 2024-04-26T11:26:45.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:44 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:26:45.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:44 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2898217542' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:45.836 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:45 smithi110 ceph-mon[28069]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:45 smithi193 ceph-mon[32782]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:45 smithi196 ceph-mon[32572]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:47.293 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:26:47 smithi110 podman[67094]: 2024-04-26 11:26:47.055188461 +0000 UTC m=+0.184086859 container create ced00513fd2dc5a2b1a8c395019e217cbacec2bed242fcb703559046e714f685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-26T11:26:47.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:26:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:47 smithi110 ceph-mon[28069]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:47 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:47.791 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:26:47 smithi110 podman[67094]: 2024-04-26 11:26:47.321270507 +0000 UTC m=+0.450168885 container init ced00513fd2dc5a2b1a8c395019e217cbacec2bed242fcb703559046e714f685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T11:26:47.792 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:26:47 smithi110 podman[67094]: 2024-04-26 11:26:47.331106067 +0000 UTC m=+0.460004439 container start ced00513fd2dc5a2b1a8c395019e217cbacec2bed242fcb703559046e714f685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-04-26T11:26:47.792 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:26:47 smithi110 ceph-mds[67120]: -- 172.21.15.110:0/1156103171 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561eb2bf1a40 con 0x561eb2bc4c00 2024-04-26T11:26:47.792 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:26:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: starting mds.g at 2024-04-26T11:26:47.792 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:26:47 smithi110 bash[67094]: ced00513fd2dc5a2b1a8c395019e217cbacec2bed242fcb703559046e714f685 2024-04-26T11:26:47.792 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:26:47 smithi110 systemd[1]: Started Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:47.857 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:47 smithi193 ceph-mon[32782]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:47 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:47 smithi196 ceph-mon[32572]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:47 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:48.821 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:48 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:boot 2024-04-26T11:26:48.821 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:48 smithi110 ceph-mon[28069]: fsmap 10 up:standby 2024-04-26T11:26:48.821 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:48 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:26:48.821 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:48 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:48.821 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:48 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:48.822 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:48 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:48.822 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:48 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:48.822 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:48 smithi110 ceph-mon[28069]: Deploying daemon mds.a on smithi110 2024-04-26T11:26:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:48 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:boot 2024-04-26T11:26:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:48 smithi193 ceph-mon[32782]: fsmap 10 up:standby 2024-04-26T11:26:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:48 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:26:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:48 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:48 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:48 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:48 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:48 smithi193 ceph-mon[32782]: Deploying daemon mds.a on smithi110 2024-04-26T11:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:48 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:boot 2024-04-26T11:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:48 smithi196 ceph-mon[32572]: fsmap 10 up:standby 2024-04-26T11:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:48 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:26:49.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:48 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:49.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:48 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:49.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:48 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:49.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:48 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:49.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:48 smithi196 ceph-mon[32572]: Deploying daemon mds.a on smithi110 2024-04-26T11:26:49.673 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:49 smithi110 ceph-mon[28069]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:49 smithi193 ceph-mon[32782]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:49 smithi196 ceph-mon[32572]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:50.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.300+0000 7f6b5be00700 1 -- 172.21.15.110:0/2712764094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b54106000 msgr2=0x7f6b54112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:50.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.300+0000 7f6b5be00700 1 --2- 172.21.15.110:0/2712764094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b54106000 0x7f6b54112510 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00b0a0 tx=0x7f6b4c00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.300+0000 7f6b5be00700 1 -- 172.21.15.110:0/2712764094 shutdown_connections 2024-04-26T11:26:50.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.300+0000 7f6b5be00700 1 --2- 172.21.15.110:0/2712764094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b54106000 0x7f6b54112510 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.300+0000 7f6b5be00700 1 --2- 172.21.15.110:0/2712764094 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b5410b640 0x7f6b5410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.300+0000 7f6b5be00700 1 --2- 172.21.15.110:0/2712764094 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b54105640 0x7f6b54105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.300+0000 7f6b5be00700 1 -- 172.21.15.110:0/2712764094 >> 172.21.15.110:0/2712764094 conn(0x7f6b54101130 msgr2=0x7f6b54103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:50.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.300+0000 7f6b5be00700 1 -- 172.21.15.110:0/2712764094 shutdown_connections 2024-04-26T11:26:50.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.300+0000 7f6b5be00700 1 -- 172.21.15.110:0/2712764094 wait complete. 2024-04-26T11:26:50.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.301+0000 7f6b5be00700 1 Processor -- start 2024-04-26T11:26:50.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.301+0000 7f6b5be00700 1 -- start start 2024-04-26T11:26:50.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b5be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b54105640 0x7f6b541a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:50.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b5be00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54106000 0x7f6b541a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:50.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b5be00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b5410b640 0x7f6b5419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:50.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b5be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54115890 con 0x7f6b54105640 2024-04-26T11:26:50.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b5be00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54115710 con 0x7f6b5410b640 2024-04-26T11:26:50.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b5be00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54115a10 con 0x7f6b54106000 2024-04-26T11:26:50.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b59400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b54105640 0x7f6b541a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:50.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b59400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b54105640 0x7f6b541a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32776/0 (socket says 172.21.15.110:32776) 2024-04-26T11:26:50.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b59400700 1 -- 172.21.15.110:0/3666856018 learned_addr learned my addr 172.21.15.110:0/3666856018 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:50.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b58a00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54106000 0x7f6b541a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:50.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.302+0000 7f6b59e00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b5410b640 0x7f6b5419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:50.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b58a00700 1 -- 172.21.15.110:0/3666856018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b5410b640 msgr2=0x7f6b5419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:50.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b58a00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b5410b640 0x7f6b5419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b58a00700 1 -- 172.21.15.110:0/3666856018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b54105640 msgr2=0x7f6b541a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:50.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b58a00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b54105640 0x7f6b541a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b58a00700 1 -- 172.21.15.110:0/3666856018 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5419c2b0 con 0x7f6b54106000 2024-04-26T11:26:50.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b59e00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b5410b640 0x7f6b5419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:26:50.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b58a00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54106000 0x7f6b541a1e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000e9f0 tx=0x7f6b4000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:50.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b52000700 1 -- 172.21.15.110:0/3666856018 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000c9c0 con 0x7f6b54106000 2024-04-26T11:26:50.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5419c5a0 con 0x7f6b54106000 2024-04-26T11:26:50.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b52000700 1 -- 172.21.15.110:0/3666856018 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b4000cb60 con 0x7f6b54106000 2024-04-26T11:26:50.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b52000700 1 -- 172.21.15.110:0/3666856018 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40018680 con 0x7f6b54106000 2024-04-26T11:26:50.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.303+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b541a8810 con 0x7f6b54106000 2024-04-26T11:26:50.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.305+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5406a110 con 0x7f6b54106000 2024-04-26T11:26:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.306+0000 7f6b52000700 1 -- 172.21.15.110:0/3666856018 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f6b40010430 con 0x7f6b54106000 2024-04-26T11:26:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.308+0000 7f6b52000700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b3c0a3cc0 0x7f6b3c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.308+0000 7f6b52000700 1 -- 172.21.15.110:0/3666856018 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f6b400d00e0 con 0x7f6b54106000 2024-04-26T11:26:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.308+0000 7f6b59400700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b3c0a3cc0 0x7f6b3c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.309+0000 7f6b59400700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b3c0a3cc0 0x7f6b3c0a6180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009ce0 tx=0x7f6b48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.312+0000 7f6b52000700 1 -- 172.21.15.110:0/3666856018 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6b4009cec0 con 0x7f6b54106000 2024-04-26T11:26:50.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.591+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b5402e490 con 0x7f6b54106000 2024-04-26T11:26:50.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.596+0000 7f6b52000700 1 -- 172.21.15.110:0/3666856018 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8848 (secure 0 0 0) 0x7f6b4009c7c0 con 0x7f6b54106000 2024-04-26T11:26:50.598 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:26:50.598 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24467,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b3c0a3cc0 msgr2=0x7f6b3c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b3c0a3cc0 0x7f6b3c0a6180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009ce0 tx=0x7f6b48009260 comp rx=0 tx=0).stop 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54106000 msgr2=0x7f6b541a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54106000 0x7f6b541a1e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000e9f0 tx=0x7f6b4000ed00 comp rx=0 tx=0).stop 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 shutdown_connections 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b5410b640 0x7f6b5419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b54105640 0x7f6b541a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b3c0a3cc0 0x7f6b3c0a6180 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 --2- 172.21.15.110:0/3666856018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54106000 0x7f6b541a1e80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.599+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 >> 172.21.15.110:0/3666856018 conn(0x7f6b54101130 msgr2=0x7f6b541017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.600+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 shutdown_connections 2024-04-26T11:26:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:50.600+0000 7f6b5be00700 1 -- 172.21.15.110:0/3666856018 wait complete. 2024-04-26T11:26:50.602 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 11 2024-04-26T11:26:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:51 smithi110 ceph-mon[28069]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:51 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3666856018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:51 smithi193 ceph-mon[32782]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:51 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3666856018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:51 smithi196 ceph-mon[32572]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:51 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3666856018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:52.670 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:26:52 smithi110 systemd[1]: Starting Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:26:52.982 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:26:52 smithi110 podman[67560]: 2024-04-26 11:26:52.574555379 +0000 UTC m=+0.035415423 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:52.982 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:26:52 smithi110 podman[67560]: 2024-04-26 11:26:52.701594596 +0000 UTC m=+0.162454667 container create 50045bb5acf7c128ca6be51c2e3eaa9ae822d346dc22825442ec687634ffc64b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424) 2024-04-26T11:26:52.982 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:26:52 smithi110 podman[67560]: 2024-04-26 11:26:52.981197566 +0000 UTC m=+0.442057647 container init 50045bb5acf7c128ca6be51c2e3eaa9ae822d346dc22825442ec687634ffc64b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:26:53.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:26:52 smithi110 podman[67560]: 2024-04-26 11:26:52.991344325 +0000 UTC m=+0.452204362 container start 50045bb5acf7c128ca6be51c2e3eaa9ae822d346dc22825442ec687634ffc64b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:26:53.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:26:53 smithi110 ceph-mds[67579]: -- 172.21.15.110:0/1594700462 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bcf6e65a40 con 0x55bcf6e38c00 2024-04-26T11:26:53.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:26:53 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: starting mds.a at 2024-04-26T11:26:53.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:26:53 smithi110 bash[67560]: 50045bb5acf7c128ca6be51c2e3eaa9ae822d346dc22825442ec687634ffc64b 2024-04-26T11:26:53.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:26:53 smithi110 systemd[1]: Started Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:53 smithi193 ceph-mon[32782]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:53 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:53.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:26:53.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:53 smithi110 ceph-mon[28069]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:53.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:53.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:53.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:53.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:53.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:53.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:53 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:53 smithi196 ceph-mon[32572]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T11:26:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T11:26:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:53 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:26:54.349 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:54.761 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:54 smithi110 ceph-mon[28069]: Deploying daemon mds.b on smithi193 2024-04-26T11:26:54.761 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:54 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:boot 2024-04-26T11:26:54.761 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:54 smithi110 ceph-mon[28069]: fsmap 11 up:standby 2024-04-26T11:26:54.762 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:54 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:26:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:54 smithi193 ceph-mon[32782]: Deploying daemon mds.b on smithi193 2024-04-26T11:26:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:54 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:boot 2024-04-26T11:26:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:54 smithi193 ceph-mon[32782]: fsmap 11 up:standby 2024-04-26T11:26:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:54 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:26:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:54 smithi196 ceph-mon[32572]: Deploying daemon mds.b on smithi193 2024-04-26T11:26:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:54 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:boot 2024-04-26T11:26:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:54 smithi196 ceph-mon[32572]: fsmap 11 up:standby 2024-04-26T11:26:55.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:54 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:26:55.620 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:26:55 smithi193 systemd[1]: Starting Ceph mds.b for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:26:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:55 smithi110 ceph-mon[28069]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:55 smithi193 ceph-mon[32782]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:55.872 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:26:55 smithi193 podman[62801]: 2024-04-26 11:26:55.736541395 +0000 UTC m=+0.112349946 container create e4232c06d77ad47d5ff5cb0d9e4c983df4819789ec5ab72cbe25e8faa167505c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-04-26T11:26:55.872 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:26:55 smithi193 podman[62801]: 2024-04-26 11:26:55.641735996 +0000 UTC m=+0.017544560 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:26:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:55 smithi196 ceph-mon[32572]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:56.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:26:55 smithi193 podman[62801]: 2024-04-26 11:26:55.981415465 +0000 UTC m=+0.357224013 container init e4232c06d77ad47d5ff5cb0d9e4c983df4819789ec5ab72cbe25e8faa167505c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:26:56.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:26:55 smithi193 podman[62801]: 2024-04-26 11:26:55.984161722 +0000 UTC m=+0.359970270 container start e4232c06d77ad47d5ff5cb0d9e4c983df4819789ec5ab72cbe25e8faa167505c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T11:26:56.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:26:56 smithi193 ceph-mds[62820]: -- 172.21.15.193:0/2173908098 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5645203a9a40 con 0x56452037cc00 2024-04-26T11:26:56.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:26:56 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: starting mds.b at 2024-04-26T11:26:56.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:26:56 smithi193 bash[62801]: e4232c06d77ad47d5ff5cb0d9e4c983df4819789ec5ab72cbe25e8faa167505c 2024-04-26T11:26:56.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:26:56 smithi193 systemd[1]: Started Ceph mds.b for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:26:56.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.620+0000 7f8d91a00700 1 -- 172.21.15.110:0/4273444454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d8c06b130 msgr2=0x7f8d8c06b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:56.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.620+0000 7f8d91a00700 1 --2- 172.21.15.110:0/4273444454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d8c06b130 0x7f8d8c06b590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009990 tx=0x7f8d78009ca0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.620+0000 7f8d91a00700 1 -- 172.21.15.110:0/4273444454 shutdown_connections 2024-04-26T11:26:56.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.620+0000 7f8d91a00700 1 --2- 172.21.15.110:0/4273444454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06bad0 0x7f8d8c1102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.620+0000 7f8d91a00700 1 --2- 172.21.15.110:0/4273444454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d8c1094a0 0x7f8d8c109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.620+0000 7f8d91a00700 1 --2- 172.21.15.110:0/4273444454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d8c06b130 0x7f8d8c06b590 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.620+0000 7f8d91a00700 1 -- 172.21.15.110:0/4273444454 >> 172.21.15.110:0/4273444454 conn(0x7f8d8c0792d0 msgr2=0x7f8d8c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:56.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.620+0000 7f8d91a00700 1 -- 172.21.15.110:0/4273444454 shutdown_connections 2024-04-26T11:26:56.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.620+0000 7f8d91a00700 1 -- 172.21.15.110:0/4273444454 wait complete. 2024-04-26T11:26:56.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.622+0000 7f8d91a00700 1 Processor -- start 2024-04-26T11:26:56.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.622+0000 7f8d91a00700 1 -- start start 2024-04-26T11:26:56.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.622+0000 7f8d91a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06b130 0x7f8d8c19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:56.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.622+0000 7f8d91a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d8c06bad0 0x7f8d8c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:56.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.622+0000 7f8d91a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d8c1094a0 0x7f8d8c199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:56.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d91a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c113600 con 0x7f8d8c06b130 2024-04-26T11:26:56.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d91a00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c113480 con 0x7f8d8c1094a0 2024-04-26T11:26:56.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d91a00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c113780 con 0x7f8d8c06bad0 2024-04-26T11:26:56.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d8aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06b130 0x7f8d8c19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:56.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d8aa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06b130 0x7f8d8c19f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35694/0 (socket says 172.21.15.110:35694) 2024-04-26T11:26:56.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d8aa00700 1 -- 172.21.15.110:0/505924189 learned_addr learned my addr 172.21.15.110:0/505924189 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:26:56.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d8b400700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d8c1094a0 0x7f8d8c199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:56.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d8a000700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d8c06bad0 0x7f8d8c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:56.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d8aa00700 1 -- 172.21.15.110:0/505924189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d8c06bad0 msgr2=0x7f8d8c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:56.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d8aa00700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d8c06bad0 0x7f8d8c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d8aa00700 1 -- 172.21.15.110:0/505924189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d8c1094a0 msgr2=0x7f8d8c199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:56.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.623+0000 7f8d8aa00700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d8c1094a0 0x7f8d8c199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.624+0000 7f8d8aa00700 1 -- 172.21.15.110:0/505924189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c19a0e0 con 0x7f8d8c06b130 2024-04-26T11:26:56.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.624+0000 7f8d8aa00700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06b130 0x7f8d8c19f7c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e9c0 tx=0x7f8d7c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:56.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.624+0000 7f8d83400700 1 -- 172.21.15.110:0/505924189 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00cbd0 con 0x7f8d8c06b130 2024-04-26T11:26:56.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.624+0000 7f8d83400700 1 -- 172.21.15.110:0/505924189 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d7c00ee60 con 0x7f8d8c06b130 2024-04-26T11:26:56.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.624+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8c19a3d0 con 0x7f8d8c06b130 2024-04-26T11:26:56.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.625+0000 7f8d83400700 1 -- 172.21.15.110:0/505924189 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0055c0 con 0x7f8d8c06b130 2024-04-26T11:26:56.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.625+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8c1a6690 con 0x7f8d8c06b130 2024-04-26T11:26:56.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.626+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8c06a110 con 0x7f8d8c06b130 2024-04-26T11:26:56.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.628+0000 7f8d83400700 1 -- 172.21.15.110:0/505924189 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f8d7c004750 con 0x7f8d8c06b130 2024-04-26T11:26:56.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.630+0000 7f8d83400700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8d700a3c40 0x7f8d700a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:26:56.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.631+0000 7f8d83400700 1 -- 172.21.15.110:0/505924189 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f8d7c0d0420 con 0x7f8d8c06b130 2024-04-26T11:26:56.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.631+0000 7f8d8a000700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8d700a3c40 0x7f8d700a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:26:56.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.631+0000 7f8d8a000700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8d700a3c40 0x7f8d700a6100 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c079940 tx=0x7f8d78005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:26:56.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.633+0000 7f8d83400700 1 -- 172.21.15.110:0/505924189 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8d7c053ff0 con 0x7f8d8c06b130 2024-04-26T11:26:56.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.917+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d8c19aeb0 con 0x7f8d8c06b130 2024-04-26T11:26:56.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.918+0000 7f8d83400700 1 -- 172.21.15.110:0/505924189 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10500 (secure 0 0 0) 0x7f8d7c09d200 con 0x7f8d8c06b130 2024-04-26T11:26:56.919 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:26:56.920 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24467,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24485,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24518,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-26T11:26:56.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8d700a3c40 msgr2=0x7f8d700a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:56.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8d700a3c40 0x7f8d700a6100 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c079940 tx=0x7f8d78005fd0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06b130 msgr2=0x7f8d8c19f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:26:56.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06b130 0x7f8d8c19f7c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e9c0 tx=0x7f8d7c00ecd0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 shutdown_connections 2024-04-26T11:26:56.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d8c1094a0 0x7f8d8c199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06b130 0x7f8d8c19f7c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8d700a3c40 0x7f8d700a6100 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 --2- 172.21.15.110:0/505924189 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d8c06bad0 0x7f8d8c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:26:56.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.921+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 >> 172.21.15.110:0/505924189 conn(0x7f8d8c0792d0 msgr2=0x7f8d8c100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:26:56.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.922+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 shutdown_connections 2024-04-26T11:26:56.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:26:56.922+0000 7f8d91a00700 1 -- 172.21.15.110:0/505924189 wait complete. 2024-04-26T11:26:56.924 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 13 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:boot 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: fsmap 12 up:standby 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T11:26:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:57 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/505924189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:57.482 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.482 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.482 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.482 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.482 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.482 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:57.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:26:57.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:boot 2024-04-26T11:26:57.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: fsmap 12 up:standby 2024-04-26T11:26:57.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T11:26:57.483 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:57 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/505924189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:57.483 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.483 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.483 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.484 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.484 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:57.484 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:57.484 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:26:57.484 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:boot 2024-04-26T11:26:57.484 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: fsmap 12 up:standby 2024-04-26T11:26:57.484 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T11:26:57.484 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:57 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/505924189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:26:57.809 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-04-26T11:26:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:58 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:58 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:58 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:58 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:58 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:58 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:58 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:58 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:58 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:58 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.811 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:58 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.811 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:58 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.811 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:58 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.812 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:58 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.812 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:58 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:26:58.819 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:26:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:26:59 smithi196 ceph-mon[32572]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:26:59 smithi110 ceph-mon[28069]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:26:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:26:59 smithi193 ceph-mon[32782]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.146+0000 7fb928e00700 1 -- 172.21.15.110:0/1436331740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924109560 msgr2=0x7fb924109940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.146+0000 7fb928e00700 1 --2- 172.21.15.110:0/1436331740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924109560 0x7fb924109940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb9140099c0 tx=0x7fb914009cd0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.146+0000 7fb928e00700 1 -- 172.21.15.110:0/1436331740 shutdown_connections 2024-04-26T11:27:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.146+0000 7fb928e00700 1 --2- 172.21.15.110:0/1436331740 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb924103e80 0x7fb924110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.146+0000 7fb928e00700 1 --2- 172.21.15.110:0/1436331740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924109560 0x7fb924109940 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.146+0000 7fb928e00700 1 --2- 172.21.15.110:0/1436331740 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9241034c0 0x7fb924103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.146+0000 7fb928e00700 1 -- 172.21.15.110:0/1436331740 >> 172.21.15.110:0/1436331740 conn(0x7fb92407a5d0 msgr2=0x7fb92407a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:01.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.146+0000 7fb928e00700 1 -- 172.21.15.110:0/1436331740 shutdown_connections 2024-04-26T11:27:01.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.146+0000 7fb928e00700 1 -- 172.21.15.110:0/1436331740 wait complete. 2024-04-26T11:27:01.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.148+0000 7fb928e00700 1 Processor -- start 2024-04-26T11:27:01.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.148+0000 7fb928e00700 1 -- start start 2024-04-26T11:27:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb928e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9241034c0 0x7fb92419f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb928e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924103e80 0x7fb92419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb928e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb924109560 0x7fb924199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb928e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb9241136c0 con 0x7fb924103e80 2024-04-26T11:27:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb928e00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb924113540 con 0x7fb924109560 2024-04-26T11:27:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb928e00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb924113840 con 0x7fb9241034c0 2024-04-26T11:27:01.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb921400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924103e80 0x7fb92419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb921e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9241034c0 0x7fb92419f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb922800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb924109560 0x7fb924199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb922800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb924109560 0x7fb924199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:55916/0 (socket says 172.21.15.110:55916) 2024-04-26T11:27:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb921e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9241034c0 0x7fb92419f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42702/0 (socket says 172.21.15.110:42702) 2024-04-26T11:27:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb921400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924103e80 0x7fb92419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35704/0 (socket says 172.21.15.110:35704) 2024-04-26T11:27:01.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.149+0000 7fb922800700 1 -- 172.21.15.110:0/1295315288 learned_addr learned my addr 172.21.15.110:0/1295315288 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb922800700 1 -- 172.21.15.110:0/1295315288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9241034c0 msgr2=0x7fb92419f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb922800700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9241034c0 0x7fb92419f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb922800700 1 -- 172.21.15.110:0/1295315288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924103e80 msgr2=0x7fb92419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb922800700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924103e80 0x7fb92419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb922800700 1 -- 172.21.15.110:0/1295315288 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92419a080 con 0x7fb924109560 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb921e00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9241034c0 0x7fb92419f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb922800700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb924109560 0x7fb924199920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00ef30 tx=0x7fb91c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb91aa00700 1 -- 172.21.15.110:0/1295315288 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c004bb0 con 0x7fb924109560 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92419a370 con 0x7fb924109560 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb91aa00700 1 -- 172.21.15.110:0/1295315288 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb91c004d50 con 0x7fb924109560 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.150+0000 7fb91aa00700 1 -- 172.21.15.110:0/1295315288 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c004280 con 0x7fb924109560 2024-04-26T11:27:01.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.151+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb924075650 con 0x7fb924109560 2024-04-26T11:27:01.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.152+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92410b9f0 con 0x7fb924109560 2024-04-26T11:27:01.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.154+0000 7fb91aa00700 1 -- 172.21.15.110:0/1295315288 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fb91c003a00 con 0x7fb924109560 2024-04-26T11:27:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.155+0000 7fb91aa00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb9080a3c40 0x7fb9080a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.155+0000 7fb91aa00700 1 -- 172.21.15.110:0/1295315288 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fb91c0d3b40 con 0x7fb924109560 2024-04-26T11:27:01.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.155+0000 7fb921e00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb9080a3c40 0x7fb9080a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:01.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.156+0000 7fb921e00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb9080a3c40 0x7fb9080a6100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb914000c00 tx=0x7fb914005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:01.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.158+0000 7fb91aa00700 1 -- 172.21.15.110:0/1295315288 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb91c0a0920 con 0x7fb924109560 2024-04-26T11:27:01.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.425+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb92419ae50 con 0x7fb924109560 2024-04-26T11:27:01.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.426+0000 7fb91aa00700 1 -- 172.21.15.110:0/1295315288 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7fb91c0a0220 con 0x7fb924109560 2024-04-26T11:27:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:27:01.427 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2024-04-26T11:27:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-04-26T11:27:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2024-04-26T11:27:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": ".mgr" 2024-04-26T11:27:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:27:01.427 INFO:teuthology.orchestra.run.smithi110.stdout:] 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb9080a3c40 msgr2=0x7fb9080a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb9080a3c40 0x7fb9080a6100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb914000c00 tx=0x7fb914005fb0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb924109560 msgr2=0x7fb924199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb924109560 0x7fb924199920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00ef30 tx=0x7fb91c00c3a0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 shutdown_connections 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb924109560 0x7fb924199920 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb9080a3c40 0x7fb9080a6100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb9241034c0 0x7fb92419f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 --2- 172.21.15.110:0/1295315288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924103e80 0x7fb92419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.428+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 >> 172.21.15.110:0/1295315288 conn(0x7fb92407a5d0 msgr2=0x7fb9241021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.429+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 shutdown_connections 2024-04-26T11:27:01.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:01.429+0000 7fb928e00700 1 -- 172.21.15.110:0/1295315288 wait complete. 2024-04-26T11:27:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:01 smithi110 ceph-mon[28069]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:01 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:01 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:01 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:27:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:01 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:27:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:01 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:01 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1295315288' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T11:27:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:01 smithi193 ceph-mon[32782]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:01 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:01 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:01 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:27:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:01 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:27:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:01 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:01 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1295315288' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T11:27:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:01 smithi196 ceph-mon[32572]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:01 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:01 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:01 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:27:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:01 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:27:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:01 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:01 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1295315288' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T11:27:02.391 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T11:27:02.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T11:27:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:27:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:27:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:27:03.478 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:03.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:03 smithi110 ceph-mon[28069]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:03.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:03.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:03.730 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:03.730 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:03 smithi193 ceph-mon[32782]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:03 smithi196 ceph-mon[32572]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:05.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.759+0000 7f54e7200700 1 -- 172.21.15.110:0/2127071823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e006bad0 msgr2=0x7f54e01102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:05.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.759+0000 7f54e7200700 1 --2- 172.21.15.110:0/2127071823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e006bad0 0x7f54e01102e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54d800b0a0 tx=0x7f54d800b3b0 comp rx=0 tx=0).stop 2024-04-26T11:27:05.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.759+0000 7f54e7200700 1 -- 172.21.15.110:0/2127071823 shutdown_connections 2024-04-26T11:27:05.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.759+0000 7f54e7200700 1 --2- 172.21.15.110:0/2127071823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e006bad0 0x7f54e01102e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:05.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.759+0000 7f54e7200700 1 --2- 172.21.15.110:0/2127071823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54e01094a0 0x7f54e0109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:05.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.759+0000 7f54e7200700 1 --2- 172.21.15.110:0/2127071823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e006b130 0x7f54e006b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:05.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.759+0000 7f54e7200700 1 -- 172.21.15.110:0/2127071823 >> 172.21.15.110:0/2127071823 conn(0x7f54e00792d0 msgr2=0x7f54e00796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:05.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.759+0000 7f54e7200700 1 -- 172.21.15.110:0/2127071823 shutdown_connections 2024-04-26T11:27:05.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.759+0000 7f54e7200700 1 -- 172.21.15.110:0/2127071823 wait complete. 2024-04-26T11:27:05.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.760+0000 7f54e7200700 1 Processor -- start 2024-04-26T11:27:05.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.760+0000 7f54e7200700 1 -- start start 2024-04-26T11:27:05.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54e7200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e006b130 0x7f54e019f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:05.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54e7200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e006bad0 0x7f54e019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:05.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54e7200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54e01094a0 0x7f54e0199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:05.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54e7200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f54e0113620 con 0x7f54e006bad0 2024-04-26T11:27:05.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54e7200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f54e01134a0 con 0x7f54e01094a0 2024-04-26T11:27:05.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54e7200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f54e01137a0 con 0x7f54e006b130 2024-04-26T11:27:05.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54dfe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e006b130 0x7f54e019f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:05.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54df400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e006bad0 0x7f54e019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:05.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54df400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e006bad0 0x7f54e019fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49912/0 (socket says 172.21.15.110:49912) 2024-04-26T11:27:05.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54df400700 1 -- 172.21.15.110:0/3470891396 learned_addr learned my addr 172.21.15.110:0/3470891396 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.761+0000 7f54e5200700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54e01094a0 0x7f54e0199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54dfe00700 1 -- 172.21.15.110:0/3470891396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54e01094a0 msgr2=0x7f54e0199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54dfe00700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54e01094a0 0x7f54e0199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54dfe00700 1 -- 172.21.15.110:0/3470891396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e006bad0 msgr2=0x7f54e019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54dfe00700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e006bad0 0x7f54e019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54dfe00700 1 -- 172.21.15.110:0/3470891396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e019a0a0 con 0x7f54e006b130 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54dfe00700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e006b130 0x7f54e019f780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54d000e9f0 tx=0x7f54d000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54dcc00700 1 -- 172.21.15.110:0/3470891396 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d000c9c0 con 0x7f54e006b130 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54dcc00700 1 -- 172.21.15.110:0/3470891396 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d000cb60 con 0x7f54e006b130 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54dcc00700 1 -- 172.21.15.110:0/3470891396 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0018680 con 0x7f54e006b130 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.762+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e019a390 con 0x7f54e006b130 2024-04-26T11:27:05.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.763+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e01a6650 con 0x7f54e006b130 2024-04-26T11:27:05.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.764+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e006a110 con 0x7f54e006b130 2024-04-26T11:27:05.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.766+0000 7f54dcc00700 1 -- 172.21.15.110:0/3470891396 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f54d0010430 con 0x7f54e006b130 2024-04-26T11:27:05.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.767+0000 7f54dcc00700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f54c40a3cc0 0x7f54c40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:05.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.767+0000 7f54dcc00700 1 -- 172.21.15.110:0/3470891396 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f54d00d0130 con 0x7f54e006b130 2024-04-26T11:27:05.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.767+0000 7f54df400700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f54c40a3cc0 0x7f54c40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:05.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.768+0000 7f54df400700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f54c40a3cc0 0x7f54c40a6180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54e0079880 tx=0x7f54cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:05.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:05.769+0000 7f54dcc00700 1 -- 172.21.15.110:0/3470891396 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f54d009cf10 con 0x7f54e006b130 2024-04-26T11:27:05.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:05 smithi110 ceph-mon[28069]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:05 smithi193 ceph-mon[32782]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:05 smithi196 ceph-mon[32572]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:06.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:06.021+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f54e002e490 con 0x7f54e006b130 2024-04-26T11:27:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.022+0000 7f54dcc00700 1 -- 172.21.15.110:0/3470891396 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7f54d009c810 con 0x7f54e006b130 2024-04-26T11:27:07.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.030+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f54c40a3cc0 msgr2=0x7f54c40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:07.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.030+0000 7f54e7200700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f54c40a3cc0 0x7f54c40a6180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54e0079880 tx=0x7f54cc009260 comp rx=0 tx=0).stop 2024-04-26T11:27:07.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.030+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e006b130 msgr2=0x7f54e019f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:07.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.030+0000 7f54e7200700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e006b130 0x7f54e019f780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54d000e9f0 tx=0x7f54d000ed00 comp rx=0 tx=0).stop 2024-04-26T11:27:07.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.031+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 shutdown_connections 2024-04-26T11:27:07.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.031+0000 7f54e7200700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54e01094a0 0x7f54e0199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:07.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.031+0000 7f54e7200700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f54c40a3cc0 0x7f54c40a6180 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:07.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.031+0000 7f54e7200700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54e006b130 0x7f54e019f780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:07.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.031+0000 7f54e7200700 1 --2- 172.21.15.110:0/3470891396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54e006bad0 0x7f54e019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:07.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.031+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 >> 172.21.15.110:0/3470891396 conn(0x7f54e00792d0 msgr2=0x7f54e0100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.031+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 shutdown_connections 2024-04-26T11:27:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:07.032+0000 7f54e7200700 1 -- 172.21.15.110:0/3470891396 wait complete. 2024-04-26T11:27:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' created 2024-04-26T11:27:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:27:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:27:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:06 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3470891396' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T11:27:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:06 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T11:27:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:06 smithi196 ceph-mon[32572]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:27:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:27:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:06 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3470891396' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T11:27:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:06 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T11:27:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:06 smithi110 ceph-mon[28069]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:27:07.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:27:07.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:27:07.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:06 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3470891396' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T11:27:07.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:06 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T11:27:07.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:06 smithi193 ceph-mon[32782]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:08.096 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T11:27:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:08 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T11:27:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:08 smithi110 ceph-mon[28069]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T11:27:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:08 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T11:27:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:08 smithi193 ceph-mon[32782]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T11:27:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:08 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T11:27:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:08 smithi196 ceph-mon[32572]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T11:27:08.520 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:09 smithi110 ceph-mon[28069]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T11:27:09.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:09 smithi110 ceph-mon[28069]: pgmap v317: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:09.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:09 smithi110 ceph-mon[28069]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T11:27:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:09 smithi193 ceph-mon[32782]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T11:27:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:09 smithi193 ceph-mon[32782]: pgmap v317: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:09 smithi193 ceph-mon[32782]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T11:27:09.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:09 smithi196 ceph-mon[32572]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T11:27:09.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:09 smithi196 ceph-mon[32572]: pgmap v317: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:09.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:09 smithi196 ceph-mon[32572]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T11:27:10.243 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:10 smithi110 ceph-mon[28069]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T11:27:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:10 smithi193 ceph-mon[32782]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T11:27:10.423 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:10 smithi196 ceph-mon[32572]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T11:27:10.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.769+0000 7ff7fe600700 1 -- 172.21.15.110:0/713955432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f81034d0 msgr2=0x7ff7f8103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:10.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.769+0000 7ff7fe600700 1 --2- 172.21.15.110:0/713955432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f81034d0 0x7ff7f8103950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009990 tx=0x7ff7e0009ca0 comp rx=0 tx=0).stop 2024-04-26T11:27:10.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.770+0000 7ff7fe600700 1 -- 172.21.15.110:0/713955432 shutdown_connections 2024-04-26T11:27:10.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.770+0000 7ff7fe600700 1 --2- 172.21.15.110:0/713955432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7f8103e90 0x7ff7f8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:10.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.770+0000 7ff7fe600700 1 --2- 172.21.15.110:0/713955432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f8109550 0x7ff7f8109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:10.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.770+0000 7ff7fe600700 1 --2- 172.21.15.110:0/713955432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f81034d0 0x7ff7f8103950 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:10.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.770+0000 7ff7fe600700 1 -- 172.21.15.110:0/713955432 >> 172.21.15.110:0/713955432 conn(0x7ff7f807a570 msgr2=0x7ff7f807a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:10.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.770+0000 7ff7fe600700 1 -- 172.21.15.110:0/713955432 shutdown_connections 2024-04-26T11:27:10.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.770+0000 7ff7fe600700 1 -- 172.21.15.110:0/713955432 wait complete. 2024-04-26T11:27:10.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.772+0000 7ff7fe600700 1 Processor -- start 2024-04-26T11:27:10.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.772+0000 7ff7fe600700 1 -- start start 2024-04-26T11:27:10.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.772+0000 7ff7fe600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f81034d0 0x7ff7f8075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:10.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.772+0000 7ff7fe600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f8103e90 0x7ff7f8075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:10.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7eea00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f8103e90 0x7ff7f8075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:10.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7f7400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f81034d0 0x7ff7f8075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:10.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7eea00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f8103e90 0x7ff7f8075c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:38294/0 (socket says 172.21.15.110:38294) 2024-04-26T11:27:10.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7f7400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f81034d0 0x7ff7f8075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:35952/0 (socket says 172.21.15.110:35952) 2024-04-26T11:27:10.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7fe600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7f8109550 0x7ff7f80761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:10.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7eea00700 1 -- 172.21.15.110:0/1445687961 learned_addr learned my addr 172.21.15.110:0/1445687961 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:10.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f8113670 con 0x7ff7f8109550 2024-04-26T11:27:10.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f81134f0 con 0x7ff7f81034d0 2024-04-26T11:27:10.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f81137f0 con 0x7ff7f8103e90 2024-04-26T11:27:10.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.773+0000 7ff7f7e00700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7f8109550 0x7ff7f80761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:10.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7eea00700 1 -- 172.21.15.110:0/1445687961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f81034d0 msgr2=0x7ff7f8075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:10.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7eea00700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f81034d0 0x7ff7f8075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:10.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7eea00700 1 -- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7f8109550 msgr2=0x7ff7f80761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:10.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7eea00700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7f8109550 0x7ff7f80761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:10.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7eea00700 1 -- 172.21.15.110:0/1445687961 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f81a8010 con 0x7ff7f8103e90 2024-04-26T11:27:10.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7eea00700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f8103e90 0x7ff7f8075c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0000c00 tx=0x7ff7e00057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:10.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7f4c00700 1 -- 172.21.15.110:0/1445687961 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0027070 con 0x7ff7f8103e90 2024-04-26T11:27:10.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7f4c00700 1 -- 172.21.15.110:0/1445687961 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7e0022470 con 0x7ff7f8103e90 2024-04-26T11:27:10.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7f4c00700 1 -- 172.21.15.110:0/1445687961 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0017650 con 0x7ff7f8103e90 2024-04-26T11:27:10.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f81a82a0 con 0x7ff7f8103e90 2024-04-26T11:27:10.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.774+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f81a86a0 con 0x7ff7f8103e90 2024-04-26T11:27:10.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.776+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f8104bc0 con 0x7ff7f8103e90 2024-04-26T11:27:10.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.777+0000 7ff7f4c00700 1 -- 172.21.15.110:0/1445687961 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff7e002a070 con 0x7ff7f8103e90 2024-04-26T11:27:10.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.779+0000 7ff7f4c00700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff7dc0a3cc0 0x7ff7dc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:10.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.779+0000 7ff7f4c00700 1 -- 172.21.15.110:0/1445687961 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7497+0+0 (secure 0 0 0) 0x7ff7e00d0ef0 con 0x7ff7f8103e90 2024-04-26T11:27:10.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.779+0000 7ff7f7400700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff7dc0a3cc0 0x7ff7dc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:10.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.780+0000 7ff7f7400700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff7dc0a3cc0 0x7ff7dc0a6180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8007b60 tx=0x7ff7e80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:10.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:10.783+0000 7ff7f4c00700 1 -- 172.21.15.110:0/1445687961 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff7e0013070 con 0x7ff7f8103e90 2024-04-26T11:27:11.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.011+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff7f802e6d0 con 0x7ff7f8103e90 2024-04-26T11:27:11.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.069+0000 7ff7f4c00700 1 -- 172.21.15.110:0/1445687961 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) ==== 170+0+0 (secure 0 0 0) 0x7ff7e009dbf0 con 0x7ff7f8103e90 2024-04-26T11:27:11.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.075+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff7dc0a3cc0 msgr2=0x7ff7dc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:11.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.075+0000 7ff7fe600700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff7dc0a3cc0 0x7ff7dc0a6180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8007b60 tx=0x7ff7e80073d0 comp rx=0 tx=0).stop 2024-04-26T11:27:11.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.075+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f8103e90 msgr2=0x7ff7f8075c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:11.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.075+0000 7ff7fe600700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f8103e90 0x7ff7f8075c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0000c00 tx=0x7ff7e00057c0 comp rx=0 tx=0).stop 2024-04-26T11:27:11.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.076+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 shutdown_connections 2024-04-26T11:27:11.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.076+0000 7ff7fe600700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7f8109550 0x7ff7f80761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:11.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.076+0000 7ff7fe600700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7f81034d0 0x7ff7f8075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:11.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.076+0000 7ff7fe600700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff7dc0a3cc0 0x7ff7dc0a6180 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:11.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.076+0000 7ff7fe600700 1 --2- 172.21.15.110:0/1445687961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7f8103e90 0x7ff7f8075c60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:11.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.076+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 >> 172.21.15.110:0/1445687961 conn(0x7ff7f807a570 msgr2=0x7ff7f8102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:11.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.077+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 shutdown_connections 2024-04-26T11:27:11.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:11.077+0000 7ff7fe600700 1 -- 172.21.15.110:0/1445687961 wait complete. 2024-04-26T11:27:11.083 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' created 2024-04-26T11:27:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:11 smithi110 ceph-mon[28069]: pgmap v319: 33 pgs: 3 creating+peering, 13 active+clean, 17 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:11 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1445687961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T11:27:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:11 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T11:27:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:11 smithi193 ceph-mon[32782]: pgmap v319: 33 pgs: 3 creating+peering, 13 active+clean, 17 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:11 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1445687961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T11:27:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:11 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T11:27:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:11 smithi196 ceph-mon[32572]: pgmap v319: 33 pgs: 3 creating+peering, 13 active+clean, 17 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:11 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1445687961' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T11:27:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:11 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T11:27:11.984 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T11:27:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:12 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T11:27:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:12 smithi110 ceph-mon[28069]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T11:27:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:12 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T11:27:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:12 smithi193 ceph-mon[32782]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T11:27:12.438 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:12 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T11:27:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:12 smithi196 ceph-mon[32572]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T11:27:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:13 smithi110 ceph-mon[28069]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T11:27:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:13 smithi110 ceph-mon[28069]: pgmap v322: 97 pgs: 8 creating+peering, 33 active+clean, 56 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:13 smithi193 ceph-mon[32782]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T11:27:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:13 smithi193 ceph-mon[32782]: pgmap v322: 97 pgs: 8 creating+peering, 33 active+clean, 56 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:13 smithi196 ceph-mon[32572]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T11:27:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:13 smithi196 ceph-mon[32572]: pgmap v322: 97 pgs: 8 creating+peering, 33 active+clean, 56 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:14.161 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:14 smithi110 ceph-mon[28069]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T11:27:14.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:14 smithi193 ceph-mon[32782]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T11:27:14.727 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:14 smithi196 ceph-mon[32572]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T11:27:14.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.704+0000 7f3234400700 1 -- 172.21.15.110:0/1923030187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c103470 msgr2=0x7f322c1038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:14.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.704+0000 7f3234400700 1 --2- 172.21.15.110:0/1923030187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c103470 0x7f322c1038f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f32180098f0 tx=0x7f3218009c00 comp rx=0 tx=0).stop 2024-04-26T11:27:14.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.704+0000 7f3234400700 1 -- 172.21.15.110:0/1923030187 shutdown_connections 2024-04-26T11:27:14.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.704+0000 7f3234400700 1 --2- 172.21.15.110:0/1923030187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f322c103e30 0x7f322c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:14.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.704+0000 7f3234400700 1 --2- 172.21.15.110:0/1923030187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322c1094c0 0x7f322c1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:14.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.704+0000 7f3234400700 1 --2- 172.21.15.110:0/1923030187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c103470 0x7f322c1038f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:14.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.704+0000 7f3234400700 1 -- 172.21.15.110:0/1923030187 >> 172.21.15.110:0/1923030187 conn(0x7f322c07a580 msgr2=0x7f322c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:14.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.704+0000 7f3234400700 1 -- 172.21.15.110:0/1923030187 shutdown_connections 2024-04-26T11:27:14.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.704+0000 7f3234400700 1 -- 172.21.15.110:0/1923030187 wait complete. 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.706+0000 7f3234400700 1 Processor -- start 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.706+0000 7f3234400700 1 -- start start 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3234400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f322c103470 0x7f322c19be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3234400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322c103e30 0x7f322c19c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3234400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c1094c0 0x7f322c1a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3234400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f322c113610 con 0x7f322c103e30 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3234400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f322c113490 con 0x7f322c1094c0 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3234400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f322c113790 con 0x7f322c103470 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3231000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322c103e30 0x7f322c19c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3232400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c1094c0 0x7f322c1a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3231a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f322c103470 0x7f322c19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:14.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3232400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c1094c0 0x7f322c1a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:48794/0 (socket says 172.21.15.110:48794) 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3231a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f322c103470 0x7f322c19be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:50650/0 (socket says 172.21.15.110:50650) 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.707+0000 7f3232400700 1 -- 172.21.15.110:0/1085076393 learned_addr learned my addr 172.21.15.110:0/1085076393 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.708+0000 7f3231a00700 1 -- 172.21.15.110:0/1085076393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c1094c0 msgr2=0x7f322c1a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.708+0000 7f3231a00700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c1094c0 0x7f322c1a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.708+0000 7f3231a00700 1 -- 172.21.15.110:0/1085076393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322c103e30 msgr2=0x7f322c19c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.708+0000 7f3231a00700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322c103e30 0x7f322c19c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.708+0000 7f3231a00700 1 -- 172.21.15.110:0/1085076393 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c1a0e30 con 0x7f322c103470 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.708+0000 7f3232400700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c1094c0 0x7f322c1a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.708+0000 7f3231a00700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f322c103470 0x7f322c19be20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f322000e9c0 tx=0x7f322000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.709+0000 7f322a000700 1 -- 172.21.15.110:0/1085076393 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322000c9c0 con 0x7f322c103470 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.709+0000 7f322a000700 1 -- 172.21.15.110:0/1085076393 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f322000cb60 con 0x7f322c103470 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.709+0000 7f322a000700 1 -- 172.21.15.110:0/1085076393 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3220018420 con 0x7f322c103470 2024-04-26T11:27:14.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.709+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c1a1120 con 0x7f322c103470 2024-04-26T11:27:14.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.709+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c1a89a0 con 0x7f322c103470 2024-04-26T11:27:14.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.710+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c06a110 con 0x7f322c103470 2024-04-26T11:27:14.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.712+0000 7f322a000700 1 -- 172.21.15.110:0/1085076393 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3220010430 con 0x7f322c103470 2024-04-26T11:27:14.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.713+0000 7f322a000700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f32140a3c40 0x7f32140a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:14.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.713+0000 7f322a000700 1 -- 172.21.15.110:0/1085076393 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7879+0+0 (secure 0 0 0) 0x7f32200d0350 con 0x7f322c103470 2024-04-26T11:27:14.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.713+0000 7f3231000700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f32140a3c40 0x7f32140a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:14.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.714+0000 7f3231000700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f32140a3c40 0x7f32140a6100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f32180098c0 tx=0x7f3218019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:14.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.717+0000 7f322a000700 1 -- 172.21.15.110:0/1085076393 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f322009ce40 con 0x7f322c103470 2024-04-26T11:27:14.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:14.993+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f322c02e490 con 0x7f322c103470 2024-04-26T11:27:15.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.101+0000 7f322a000700 1 -- 172.21.15.110:0/1085076393 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f322009c740 con 0x7f322c103470 2024-04-26T11:27:15.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.106+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f32140a3c40 msgr2=0x7f32140a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:15.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.106+0000 7f3234400700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f32140a3c40 0x7f32140a6100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f32180098c0 tx=0x7f3218019040 comp rx=0 tx=0).stop 2024-04-26T11:27:15.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.106+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f322c103470 msgr2=0x7f322c19be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:15.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.106+0000 7f3234400700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f322c103470 0x7f322c19be20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f322000e9c0 tx=0x7f322000ecd0 comp rx=0 tx=0).stop 2024-04-26T11:27:15.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.111+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 shutdown_connections 2024-04-26T11:27:15.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.111+0000 7f3234400700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f322c1094c0 0x7f322c1a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:15.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.111+0000 7f3234400700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f32140a3c40 0x7f32140a6100 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:15.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.111+0000 7f3234400700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f322c103470 0x7f322c19be20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:15.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.111+0000 7f3234400700 1 --2- 172.21.15.110:0/1085076393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f322c103e30 0x7f322c19c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:15.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.111+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 >> 172.21.15.110:0/1085076393 conn(0x7f322c07a580 msgr2=0x7f322c10e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:15.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.112+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 shutdown_connections 2024-04-26T11:27:15.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:15.112+0000 7f3234400700 1 -- 172.21.15.110:0/1085076393 wait complete. 2024-04-26T11:27:15.116 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T11:27:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:15 smithi110 ceph-mon[28069]: pgmap v324: 97 pgs: 8 creating+peering, 44 active+clean, 45 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:15 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1085076393' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T11:27:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:15 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T11:27:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:15 smithi110 ceph-mon[28069]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T11:27:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:15 smithi193 ceph-mon[32782]: pgmap v324: 97 pgs: 8 creating+peering, 44 active+clean, 45 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:15 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1085076393' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T11:27:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:15 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T11:27:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:15 smithi193 ceph-mon[32782]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T11:27:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:15 smithi196 ceph-mon[32572]: pgmap v324: 97 pgs: 8 creating+peering, 44 active+clean, 45 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:27:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:15 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1085076393' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T11:27:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:15 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T11:27:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:15 smithi196 ceph-mon[32572]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T11:27:16.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T11:27:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:16 smithi110 ceph-mon[28069]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T11:27:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:16 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T11:27:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:16 smithi110 ceph-mon[28069]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T11:27:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:16 smithi110 ceph-mon[28069]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T11:27:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:16 smithi193 ceph-mon[32782]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T11:27:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:16 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T11:27:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:16 smithi193 ceph-mon[32782]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T11:27:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:16 smithi193 ceph-mon[32782]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T11:27:16.496 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:16 smithi196 ceph-mon[32572]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T11:27:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:16 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T11:27:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:16 smithi196 ceph-mon[32572]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T11:27:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:16 smithi196 ceph-mon[32572]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T11:27:17.109 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:27:16 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:27:16.627+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T11:27:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:17 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:27:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:17 smithi110 ceph-mon[28069]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:17 smithi110 ceph-mon[28069]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:17 smithi110 ceph-mon[28069]: pgmap v326: 97 pgs: 6 creating+peering, 91 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 757 B/s wr, 6 op/s 2024-04-26T11:27:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:17 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:27:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:17 smithi193 ceph-mon[32782]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:17 smithi193 ceph-mon[32782]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:17 smithi193 ceph-mon[32782]: pgmap v326: 97 pgs: 6 creating+peering, 91 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 757 B/s wr, 6 op/s 2024-04-26T11:27:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:17 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:27:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:17 smithi196 ceph-mon[32572]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:17 smithi196 ceph-mon[32572]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:17 smithi196 ceph-mon[32572]: pgmap v326: 97 pgs: 6 creating+peering, 91 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 757 B/s wr, 6 op/s 2024-04-26T11:27:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:18 smithi110 ceph-mon[28069]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T11:27:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:18 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:27:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:18 smithi193 ceph-mon[32782]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T11:27:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:18 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:27:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:18 smithi196 ceph-mon[32572]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T11:27:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:18 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:27:18.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.850+0000 7f51eaa00700 1 -- 172.21.15.110:0/847270494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 msgr2=0x7f51e4105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:18.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.850+0000 7f51eaa00700 1 --2- 172.21.15.110:0/847270494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 0x7f51e4105ac0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009990 tx=0x7f51d0009ca0 comp rx=0 tx=0).stop 2024-04-26T11:27:18.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.850+0000 7f51eaa00700 1 -- 172.21.15.110:0/847270494 shutdown_connections 2024-04-26T11:27:18.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.850+0000 7f51eaa00700 1 --2- 172.21.15.110:0/847270494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51e4106000 0x7f51e4112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:18.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.850+0000 7f51eaa00700 1 --2- 172.21.15.110:0/847270494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51e410b640 0x7f51e410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.850+0000 7f51eaa00700 1 --2- 172.21.15.110:0/847270494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 0x7f51e4105ac0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.850+0000 7f51eaa00700 1 -- 172.21.15.110:0/847270494 >> 172.21.15.110:0/847270494 conn(0x7f51e4101130 msgr2=0x7f51e4103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.851+0000 7f51eaa00700 1 -- 172.21.15.110:0/847270494 shutdown_connections 2024-04-26T11:27:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.851+0000 7f51eaa00700 1 -- 172.21.15.110:0/847270494 wait complete. 2024-04-26T11:27:18.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.852+0000 7f51eaa00700 1 Processor -- start 2024-04-26T11:27:18.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.852+0000 7f51eaa00700 1 -- start start 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.852+0000 7f51eaa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 0x7f51e419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.852+0000 7f51eaa00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51e4106000 0x7f51e419c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.852+0000 7f51eaa00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51e410b640 0x7f51e41a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.852+0000 7f51eaa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f51e4115880 con 0x7f51e4105640 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.852+0000 7f51eaa00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f51e4115700 con 0x7f51e410b640 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.852+0000 7f51eaa00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f51e4115a00 con 0x7f51e4106000 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 0x7f51e419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 0x7f51e419bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46502/0 (socket says 172.21.15.110:46502) 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3e00700 1 -- 172.21.15.110:0/582258279 learned_addr learned my addr 172.21.15.110:0/582258279 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51e4106000 0x7f51e419c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e8a00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51e410b640 0x7f51e41a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3e00700 1 -- 172.21.15.110:0/582258279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51e4106000 msgr2=0x7f51e419c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3e00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51e4106000 0x7f51e419c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:18.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3e00700 1 -- 172.21.15.110:0/582258279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51e410b640 msgr2=0x7f51e41a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:18.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3e00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51e410b640 0x7f51e41a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:18.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3e00700 1 -- 172.21.15.110:0/582258279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e41a0d20 con 0x7f51e4105640 2024-04-26T11:27:18.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.853+0000 7f51e3400700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51e4106000 0x7f51e419c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:27:18.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.854+0000 7f51e3e00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 0x7f51e419bd10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51d400e9c0 tx=0x7f51d400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:18.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.854+0000 7f51e0c00700 1 -- 172.21.15.110:0/582258279 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d400cbd0 con 0x7f51e4105640 2024-04-26T11:27:18.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.854+0000 7f51e0c00700 1 -- 172.21.15.110:0/582258279 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51d400ee60 con 0x7f51e4105640 2024-04-26T11:27:18.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.854+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e41a1010 con 0x7f51e4105640 2024-04-26T11:27:18.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.854+0000 7f51e0c00700 1 -- 172.21.15.110:0/582258279 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d40055c0 con 0x7f51e4105640 2024-04-26T11:27:18.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.854+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e41a8890 con 0x7f51e4105640 2024-04-26T11:27:18.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.855+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e410dbd0 con 0x7f51e4105640 2024-04-26T11:27:18.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.858+0000 7f51e0c00700 1 -- 172.21.15.110:0/582258279 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f51d4004750 con 0x7f51e4105640 2024-04-26T11:27:18.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.859+0000 7f51e0c00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f51c80a3c40 0x7f51c80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:18.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.859+0000 7f51e0c00700 1 -- 172.21.15.110:0/582258279 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f51d40d0770 con 0x7f51e4105640 2024-04-26T11:27:18.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.859+0000 7f51e3400700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f51c80a3c40 0x7f51c80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:18.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.860+0000 7f51e3400700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f51c80a3c40 0x7f51c80a6100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f51d000b2e0 tx=0x7f51d001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:18.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:18.863+0000 7f51e0c00700 1 -- 172.21.15.110:0/582258279 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f51d4053ff0 con 0x7f51e4105640 2024-04-26T11:27:19.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.089+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51e406a110 con 0x7f51e4105640 2024-04-26T11:27:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.094+0000 7f51e0c00700 1 -- 172.21.15.110:0/582258279 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22300 (secure 0 0 0) 0x7f51d409d200 con 0x7f51e4105640 2024-04-26T11:27:19.097 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:27:19.097 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":89,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","created":"2024-04-26T11:17:56.437545+0000","modified":"2024-04-26T11:27:14.996365+0000","last_up_change":"2024-04-26T11:25:57.427695+0000","last_in_change":"2024-04-26T11:25:38.050280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:44.478027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:27:06.034467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T11:27:11.025123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13eb997d-8b4a-47f5-be11-772d47788972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6803","nonce":1662740885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6805","nonce":1662740885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6809","nonce":1662740885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6807","nonce":1662740885}]},"public_addr":"172.21.15.110:6803/1662740885","cluster_addr":"172.21.15.110:6805/1662740885","heartbeat_back_addr":"172.21.15.110:6809/1662740885","heartbeat_front_addr":"172.21.15.110:6807/1662740885","state":["exists","up"]},{"osd":1,"uuid":"e7927dc3-dced-4661-8493-840e111241e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6801","nonce":1751461680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6803","nonce":1751461680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6807","nonce":1751461680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6805","nonce":1751461680}]},"public_addr":"172.21.15.193:6801/1751461680","cluster_addr":"172.21.15.193:6803/1751461680","heartbeat_back_addr":"172.21.15.193:6807/1751461680","heartbeat_front_addr":"172.21.15.193:6805/1751461680","state":["exists","up"]},{"osd":2,"uuid":"54459a80-91a1-45ba-b7e4-900a4a995219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6801","nonce":1785522554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6803","nonce":1785522554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6807","nonce":1785522554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6805","nonce":1785522554}]},"public_addr":"172.21.15.196:6801/1785522554","cluster_addr":"172.21.15.196:6803/1785522554","heartbeat_back_addr":"172.21.15.196:6807/1785522554","heartbeat_front_addr":"172.21.15.196:6805/1785522554","state":["exists","up"]},{"osd":3,"uuid":"12d8a1be-5edb-4af2-b01d-abd943f89641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6811","nonce":2253549266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6813","nonce":2253549266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6817","nonce":2253549266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6815","nonce":2253549266}]},"public_addr":"172.21.15.110:6811/2253549266","cluster_addr":"172.21.15.110:6813/2253549266","heartbeat_back_addr":"172.21.15.110:6817/2253549266","heartbeat_front_addr":"172.21.15.110:6815/2253549266","state":["exists","up"]},{"osd":4,"uuid":"f3057080-144b-4f43-9a63-8f415ca76d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6809","nonce":1314161856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6811","nonce":1314161856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6815","nonce":1314161856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6813","nonce":1314161856}]},"public_addr":"172.21.15.193:6809/1314161856","cluster_addr":"172.21.15.193:6811/1314161856","heartbeat_back_addr":"172.21.15.193:6815/1314161856","heartbeat_front_addr":"172.21.15.193:6813/1314161856","state":["exists","up"]},{"osd":5,"uuid":"f0775b9c-938e-4bb4-ae1e-01ef0686cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6809","nonce":2359280243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6811","nonce":2359280243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6815","nonce":2359280243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6813","nonce":2359280243}]},"public_addr":"172.21.15.196:6809/2359280243","cluster_addr":"172.21.15.196:6811/2359280243","heartbeat_back_addr":"172.21.15.196:6815/2359280243","heartbeat_front_addr":"172.21.15.196:6813/2359280243","state":["exists","up"]},{"osd":6,"uuid":"ea4ea3de-4ec4-48a1-809e-da62fcbb7033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6819","nonce":1730783886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6821","nonce":1730783886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6825","nonce":1730783886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6823","nonce":1730783886}]},"public_addr":"172.21.15.110:6819/1730783886","cluster_addr":"172.21.15.110:6821/1730783886","heartbeat_back_addr":"172.21.15.110:6825/1730783886","heartbeat_front_addr":"172.21.15.110:6823/1730783886","state":["exists","up"]},{"osd":7,"uuid":"98af7071-82b3-4732-b2a1-8676e6439cd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6817","nonce":4124476381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6819","nonce":4124476381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6823","nonce":4124476381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6821","nonce":4124476381}]},"public_addr":"172.21.15.193:6817/4124476381","cluster_addr":"172.21.15.193:6819/4124476381","heartbeat_back_addr":"172.21.15.193:6823/4124476381","heartbeat_front_addr":"172.21.15.193:6821/4124476381","state":["exists","up"]},{"osd":8,"uuid":"7aaa3c52-72f5-4946-a964-609f65b778f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6817","nonce":2942176519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6819","nonce":2942176519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6823","nonce":2942176519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6821","nonce":2942176519}]},"public_addr":"172.21.15.196:6817/2942176519","cluster_addr":"172.21.15.196:6819/2942176519","heartbeat_back_addr":"172.21.15.196:6823/2942176519","heartbeat_front_addr":"172.21.15.196:6821/2942176519","state":["exists","up"]},{"osd":9,"uuid":"2cde3ed2-6acd-48a4-a99d-aa558dd85baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6827","nonce":2620757358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6829","nonce":2620757358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6833","nonce":2620757358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6831","nonce":2620757358}]},"public_addr":"172.21.15.110:6827/2620757358","cluster_addr":"172.21.15.110:6829/2620757358","heartbeat_back_addr":"172.21.15.110:6833/2620757358","heartbeat_front_addr":"172.21.15.110:6831/2620757358","state":["exists","up"]},{"osd":10,"uuid":"3bbaac8f-fe7b-4f0e-a25b-286c3c30926e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6825","nonce":676480728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6827","nonce":676480728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6831","nonce":676480728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6829","nonce":676480728}]},"public_addr":"172.21.15.193:6825/676480728","cluster_addr":"172.21.15.193:6827/676480728","heartbeat_back_addr":"172.21.15.193:6831/676480728","heartbeat_front_addr":"172.21.15.193:6829/676480728","state":["exists","up"]},{"osd":11,"uuid":"e31c248e-1016-4765-bea1-9f31d823ca3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6825","nonce":2802765812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6827","nonce":2802765812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6831","nonce":2802765812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6829","nonce":2802765812}]},"public_addr":"172.21.15.196:6825/2802765812","cluster_addr":"172.21.15.196:6827/2802765812","heartbeat_back_addr":"172.21.15.196:6831/2802765812","heartbeat_front_addr":"172.21.15.196:6829/2802765812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:20:52.046788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:16.893940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:40.861409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:13.272469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:39.214479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:03.529206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:37.413989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:04.145639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:29.162356+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:03.325672+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:30.353695+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:56.267402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3278958945":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6801/4292256031":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3536224934":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2250601964":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/2775667488":"2024-04-27T11:18:29.387925+0000","172.21.15.110:6801/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/337370067":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3594651859":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/4292256031":"2024-04-27T11:19:02.329691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f51c80a3c40 msgr2=0x7f51c80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f51c80a3c40 0x7f51c80a6100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f51d000b2e0 tx=0x7f51d001a040 comp rx=0 tx=0).stop 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 msgr2=0x7f51e419bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 0x7f51e419bd10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51d400e9c0 tx=0x7f51d400ecd0 comp rx=0 tx=0).stop 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 shutdown_connections 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51e410b640 0x7f51e41a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e4105640 0x7f51e419bd10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f51c80a3c40 0x7f51c80a6100 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 --2- 172.21.15.110:0/582258279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f51e4106000 0x7f51e419c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.097+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 >> 172.21.15.110:0/582258279 conn(0x7f51e4101130 msgr2=0x7f51e4101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:19.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.098+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 shutdown_connections 2024-04-26T11:27:19.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:19.098+0000 7f51eaa00700 1 -- 172.21.15.110:0/582258279 wait complete. 2024-04-26T11:27:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:19 smithi193 ceph-mon[32782]: pgmap v327: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 6 op/s 2024-04-26T11:27:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:19 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/582258279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:27:19.475 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:19 smithi110 ceph-mon[28069]: pgmap v327: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 6 op/s 2024-04-26T11:27:19.476 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:19 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/582258279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:27:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:19 smithi196 ceph-mon[32572]: pgmap v327: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 6 op/s 2024-04-26T11:27:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:19 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/582258279' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:27:19.938 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T11:27:20.394 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:21 smithi110 ceph-mon[28069]: pgmap v328: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-26T11:27:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:21 smithi193 ceph-mon[32782]: pgmap v328: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-26T11:27:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:21 smithi196 ceph-mon[32572]: pgmap v328: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-26T11:27:22.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.672+0000 7f4e92c00700 1 -- 172.21.15.110:0/1036307730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e8c1145f0 msgr2=0x7f4e8c1169e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:22.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.672+0000 7f4e92c00700 1 --2- 172.21.15.110:0/1036307730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e8c1145f0 0x7f4e8c1169e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009f90 tx=0x7f4e8400b330 comp rx=0 tx=0).stop 2024-04-26T11:27:22.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.672+0000 7f4e92c00700 1 -- 172.21.15.110:0/1036307730 shutdown_connections 2024-04-26T11:27:22.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.672+0000 7f4e92c00700 1 --2- 172.21.15.110:0/1036307730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e8c1145f0 0x7f4e8c1169e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:22.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.672+0000 7f4e92c00700 1 --2- 172.21.15.110:0/1036307730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8c075650 0x7f4e8c075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:22.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.672+0000 7f4e92c00700 1 --2- 172.21.15.110:0/1036307730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e8c075f70 0x7f4e8c1140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:22.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.672+0000 7f4e92c00700 1 -- 172.21.15.110:0/1036307730 >> 172.21.15.110:0/1036307730 conn(0x7f4e8c07a580 msgr2=0x7f4e8c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:22.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.672+0000 7f4e92c00700 1 -- 172.21.15.110:0/1036307730 shutdown_connections 2024-04-26T11:27:22.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.672+0000 7f4e92c00700 1 -- 172.21.15.110:0/1036307730 wait complete. 2024-04-26T11:27:22.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.674+0000 7f4e92c00700 1 Processor -- start 2024-04-26T11:27:22.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.674+0000 7f4e92c00700 1 -- start start 2024-04-26T11:27:22.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.675+0000 7f4e92c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8c075650 0x7f4e8c1a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:22.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.675+0000 7f4e92c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e8c075f70 0x7f4e8c1a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:22.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.675+0000 7f4e92c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e8c1145f0 0x7f4e8c1a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:22.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.675+0000 7f4e92c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c119c10 con 0x7f4e8c075650 2024-04-26T11:27:22.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.675+0000 7f4e92c00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c119a90 con 0x7f4e8c075f70 2024-04-26T11:27:22.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.675+0000 7f4e92c00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c119d90 con 0x7f4e8c1145f0 2024-04-26T11:27:22.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.675+0000 7f4e8be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8c075650 0x7f4e8c1a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:22.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.675+0000 7f4e8b400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e8c075f70 0x7f4e8c1a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:22.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e90c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e8c1145f0 0x7f4e8c1a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e8b400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e8c075f70 0x7f4e8c1a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:53364/0 (socket says 172.21.15.110:53364) 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e8b400700 1 -- 172.21.15.110:0/4213867225 learned_addr learned my addr 172.21.15.110:0/4213867225 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e90c00700 1 -- 172.21.15.110:0/4213867225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e8c075f70 msgr2=0x7f4e8c1a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e90c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e8c075f70 0x7f4e8c1a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e90c00700 1 -- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8c075650 msgr2=0x7f4e8c1a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e90c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8c075650 0x7f4e8c1a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e90c00700 1 -- 172.21.15.110:0/4213867225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c1a51b0 con 0x7f4e8c1145f0 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e8be00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8c075650 0x7f4e8c1a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e90c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e8c1145f0 0x7f4e8c1a4a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400b6c0 tx=0x7f4e8400cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e88c00700 1 -- 172.21.15.110:0/4213867225 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84021070 con 0x7f4e8c1145f0 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.676+0000 7f4e88c00700 1 -- 172.21.15.110:0/4213867225 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e84007ac0 con 0x7f4e8c1145f0 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.677+0000 7f4e88c00700 1 -- 172.21.15.110:0/4213867225 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84005040 con 0x7f4e8c1145f0 2024-04-26T11:27:22.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.677+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8c1a5440 con 0x7f4e8c1145f0 2024-04-26T11:27:22.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.677+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e8c1acd20 con 0x7f4e8c1145f0 2024-04-26T11:27:22.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.678+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e8c076d40 con 0x7f4e8c1145f0 2024-04-26T11:27:22.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.680+0000 7f4e88c00700 1 -- 172.21.15.110:0/4213867225 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f4e84024070 con 0x7f4e8c1145f0 2024-04-26T11:27:22.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.682+0000 7f4e88c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4e700a3cc0 0x7f4e700a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:22.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.682+0000 7f4e88c00700 1 -- 172.21.15.110:0/4213867225 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f4e8400f020 con 0x7f4e8c1145f0 2024-04-26T11:27:22.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.682+0000 7f4e8be00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4e700a3cc0 0x7f4e700a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:22.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.682+0000 7f4e8be00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4e700a3cc0 0x7f4e700a6180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009750 tx=0x7f4e7c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:22.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.686+0000 7f4e88c00700 1 -- 172.21.15.110:0/4213867225 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4e8402b020 con 0x7f4e8c1145f0 2024-04-26T11:27:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.912+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e8c1a1500 con 0x7f4e8c1145f0 2024-04-26T11:27:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.914+0000 7f4e88c00700 1 -- 172.21.15.110:0/4213867225 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22300 (secure 0 0 0) 0x7f4e84007420 con 0x7f4e8c1145f0 2024-04-26T11:27:22.917 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:27:22.918 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":89,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","created":"2024-04-26T11:17:56.437545+0000","modified":"2024-04-26T11:27:14.996365+0000","last_up_change":"2024-04-26T11:25:57.427695+0000","last_in_change":"2024-04-26T11:25:38.050280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:44.478027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:27:06.034467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T11:27:11.025123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13eb997d-8b4a-47f5-be11-772d47788972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6803","nonce":1662740885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6805","nonce":1662740885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6809","nonce":1662740885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6807","nonce":1662740885}]},"public_addr":"172.21.15.110:6803/1662740885","cluster_addr":"172.21.15.110:6805/1662740885","heartbeat_back_addr":"172.21.15.110:6809/1662740885","heartbeat_front_addr":"172.21.15.110:6807/1662740885","state":["exists","up"]},{"osd":1,"uuid":"e7927dc3-dced-4661-8493-840e111241e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6801","nonce":1751461680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6803","nonce":1751461680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6807","nonce":1751461680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6805","nonce":1751461680}]},"public_addr":"172.21.15.193:6801/1751461680","cluster_addr":"172.21.15.193:6803/1751461680","heartbeat_back_addr":"172.21.15.193:6807/1751461680","heartbeat_front_addr":"172.21.15.193:6805/1751461680","state":["exists","up"]},{"osd":2,"uuid":"54459a80-91a1-45ba-b7e4-900a4a995219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6801","nonce":1785522554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6803","nonce":1785522554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6807","nonce":1785522554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6805","nonce":1785522554}]},"public_addr":"172.21.15.196:6801/1785522554","cluster_addr":"172.21.15.196:6803/1785522554","heartbeat_back_addr":"172.21.15.196:6807/1785522554","heartbeat_front_addr":"172.21.15.196:6805/1785522554","state":["exists","up"]},{"osd":3,"uuid":"12d8a1be-5edb-4af2-b01d-abd943f89641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6811","nonce":2253549266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6813","nonce":2253549266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6817","nonce":2253549266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6815","nonce":2253549266}]},"public_addr":"172.21.15.110:6811/2253549266","cluster_addr":"172.21.15.110:6813/2253549266","heartbeat_back_addr":"172.21.15.110:6817/2253549266","heartbeat_front_addr":"172.21.15.110:6815/2253549266","state":["exists","up"]},{"osd":4,"uuid":"f3057080-144b-4f43-9a63-8f415ca76d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6809","nonce":1314161856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6811","nonce":1314161856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6815","nonce":1314161856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6813","nonce":1314161856}]},"public_addr":"172.21.15.193:6809/1314161856","cluster_addr":"172.21.15.193:6811/1314161856","heartbeat_back_addr":"172.21.15.193:6815/1314161856","heartbeat_front_addr":"172.21.15.193:6813/1314161856","state":["exists","up"]},{"osd":5,"uuid":"f0775b9c-938e-4bb4-ae1e-01ef0686cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6809","nonce":2359280243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6811","nonce":2359280243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6815","nonce":2359280243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6813","nonce":2359280243}]},"public_addr":"172.21.15.196:6809/2359280243","cluster_addr":"172.21.15.196:6811/2359280243","heartbeat_back_addr":"172.21.15.196:6815/2359280243","heartbeat_front_addr":"172.21.15.196:6813/2359280243","state":["exists","up"]},{"osd":6,"uuid":"ea4ea3de-4ec4-48a1-809e-da62fcbb7033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6819","nonce":1730783886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6821","nonce":1730783886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6825","nonce":1730783886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6823","nonce":1730783886}]},"public_addr":"172.21.15.110:6819/1730783886","cluster_addr":"172.21.15.110:6821/1730783886","heartbeat_back_addr":"172.21.15.110:6825/1730783886","heartbeat_front_addr":"172.21.15.110:6823/1730783886","state":["exists","up"]},{"osd":7,"uuid":"98af7071-82b3-4732-b2a1-8676e6439cd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6817","nonce":4124476381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6819","nonce":4124476381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6823","nonce":4124476381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6821","nonce":4124476381}]},"public_addr":"172.21.15.193:6817/4124476381","cluster_addr":"172.21.15.193:6819/4124476381","heartbeat_back_addr":"172.21.15.193:6823/4124476381","heartbeat_front_addr":"172.21.15.193:6821/4124476381","state":["exists","up"]},{"osd":8,"uuid":"7aaa3c52-72f5-4946-a964-609f65b778f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6817","nonce":2942176519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6819","nonce":2942176519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6823","nonce":2942176519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6821","nonce":2942176519}]},"public_addr":"172.21.15.196:6817/2942176519","cluster_addr":"172.21.15.196:6819/2942176519","heartbeat_back_addr":"172.21.15.196:6823/2942176519","heartbeat_front_addr":"172.21.15.196:6821/2942176519","state":["exists","up"]},{"osd":9,"uuid":"2cde3ed2-6acd-48a4-a99d-aa558dd85baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6827","nonce":2620757358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6829","nonce":2620757358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6833","nonce":2620757358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6831","nonce":2620757358}]},"public_addr":"172.21.15.110:6827/2620757358","cluster_addr":"172.21.15.110:6829/2620757358","heartbeat_back_addr":"172.21.15.110:6833/2620757358","heartbeat_front_addr":"172.21.15.110:6831/2620757358","state":["exists","up"]},{"osd":10,"uuid":"3bbaac8f-fe7b-4f0e-a25b-286c3c30926e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6825","nonce":676480728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6827","nonce":676480728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6831","nonce":676480728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6829","nonce":676480728}]},"public_addr":"172.21.15.193:6825/676480728","cluster_addr":"172.21.15.193:6827/676480728","heartbeat_back_addr":"172.21.15.193:6831/676480728","heartbeat_front_addr":"172.21.15.193:6829/676480728","state":["exists","up"]},{"osd":11,"uuid":"e31c248e-1016-4765-bea1-9f31d823ca3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6825","nonce":2802765812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6827","nonce":2802765812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6831","nonce":2802765812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6829","nonce":2802765812}]},"public_addr":"172.21.15.196:6825/2802765812","cluster_addr":"172.21.15.196:6827/2802765812","heartbeat_back_addr":"172.21.15.196:6831/2802765812","heartbeat_front_addr":"172.21.15.196:6829/2802765812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:20:52.046788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:16.893940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:40.861409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:13.272469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:39.214479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:03.529206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:37.413989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:04.145639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:29.162356+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:03.325672+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:30.353695+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:56.267402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3278958945":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6801/4292256031":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3536224934":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2250601964":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/2775667488":"2024-04-27T11:18:29.387925+0000","172.21.15.110:6801/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/337370067":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3594651859":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/4292256031":"2024-04-27T11:19:02.329691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:27:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.917+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4e700a3cc0 msgr2=0x7f4e700a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.917+0000 7f4e92c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4e700a3cc0 0x7f4e700a6180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009750 tx=0x7f4e7c009310 comp rx=0 tx=0).stop 2024-04-26T11:27:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.917+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e8c1145f0 msgr2=0x7f4e8c1a4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.917+0000 7f4e92c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e8c1145f0 0x7f4e8c1a4a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400b6c0 tx=0x7f4e8400cc30 comp rx=0 tx=0).stop 2024-04-26T11:27:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.917+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 shutdown_connections 2024-04-26T11:27:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.918+0000 7f4e92c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4e700a3cc0 0x7f4e700a6180 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.918+0000 7f4e92c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e8c1145f0 0x7f4e8c1a4a70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.918+0000 7f4e92c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e8c075650 0x7f4e8c1a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.918+0000 7f4e92c00700 1 --2- 172.21.15.110:0/4213867225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e8c075f70 0x7f4e8c1a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.918+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 >> 172.21.15.110:0/4213867225 conn(0x7f4e8c07a580 msgr2=0x7f4e8c113420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.918+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 shutdown_connections 2024-04-26T11:27:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:22.918+0000 7f4e92c00700 1 -- 172.21.15.110:0/4213867225 wait complete. 2024-04-26T11:27:23.691 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:23 smithi110 ceph-mon[28069]: pgmap v329: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-26T11:27:23.691 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:23 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/4213867225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:27:23.759 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-04-26T11:27:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:23 smithi193 ceph-mon[32782]: pgmap v329: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-26T11:27:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:23 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/4213867225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:27:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:23 smithi196 ceph-mon[32572]: pgmap v329: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-26T11:27:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:23 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/4213867225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:27:24.200 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:25 smithi110 ceph-mon[28069]: pgmap v330: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T11:27:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:25 smithi193 ceph-mon[32782]: pgmap v330: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T11:27:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:25 smithi196 ceph-mon[32572]: pgmap v330: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T11:27:26.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.462+0000 7fd5a4600700 1 -- 172.21.15.110:0/2939210350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c1094c0 msgr2=0x7fd59c1098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:26.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.462+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2939210350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c1094c0 0x7fd59c1098a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd590009990 tx=0x7fd590009ca0 comp rx=0 tx=0).stop 2024-04-26T11:27:26.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.462+0000 7fd5a4600700 1 -- 172.21.15.110:0/2939210350 shutdown_connections 2024-04-26T11:27:26.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.462+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2939210350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c103e30 0x7fd59c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:26.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.462+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2939210350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c1094c0 0x7fd59c1098a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:26.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.462+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2939210350 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd59c103470 0x7fd59c1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:26.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.462+0000 7fd5a4600700 1 -- 172.21.15.110:0/2939210350 >> 172.21.15.110:0/2939210350 conn(0x7fd59c07a580 msgr2=0x7fd59c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:26.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.462+0000 7fd5a4600700 1 -- 172.21.15.110:0/2939210350 shutdown_connections 2024-04-26T11:27:26.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.462+0000 7fd5a4600700 1 -- 172.21.15.110:0/2939210350 wait complete. 2024-04-26T11:27:26.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.463+0000 7fd5a4600700 1 Processor -- start 2024-04-26T11:27:26.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a4600700 1 -- start start 2024-04-26T11:27:26.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a4600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c103470 0x7fd59c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a4600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd59c103e30 0x7fd59c19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a4600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c1094c0 0x7fd59c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a4600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c113610 con 0x7fd59c1094c0 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a4600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c113490 con 0x7fd59c103470 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a4600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c113790 con 0x7fd59c103e30 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a1c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c103470 0x7fd59c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a1c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c103470 0x7fd59c19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:53376/0 (socket says 172.21.15.110:53376) 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a1c00700 1 -- 172.21.15.110:0/2671277282 learned_addr learned my addr 172.21.15.110:0/2671277282 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.464+0000 7fd5a2600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c1094c0 0x7fd59c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:26.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.465+0000 7fd5a1200700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd59c103e30 0x7fd59c19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:26.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.465+0000 7fd5a2600700 1 -- 172.21.15.110:0/2671277282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd59c103e30 msgr2=0x7fd59c19c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:26.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.465+0000 7fd5a2600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd59c103e30 0x7fd59c19c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:26.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.465+0000 7fd5a2600700 1 -- 172.21.15.110:0/2671277282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c103470 msgr2=0x7fd59c19bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:26.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.465+0000 7fd5a2600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c103470 0x7fd59c19bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:26.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.465+0000 7fd5a2600700 1 -- 172.21.15.110:0/2671277282 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c1a0d50 con 0x7fd59c1094c0 2024-04-26T11:27:26.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.465+0000 7fd5a1200700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd59c103e30 0x7fd59c19c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:27:26.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.465+0000 7fd5a1c00700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c103470 0x7fd59c19bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:27:26.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.465+0000 7fd5a2600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c1094c0 0x7fd59c1a0610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd59400efc0 tx=0x7fd59400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:26.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.466+0000 7fd59a000700 1 -- 172.21.15.110:0/2671277282 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5940092e0 con 0x7fd59c1094c0 2024-04-26T11:27:26.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.466+0000 7fd59a000700 1 -- 172.21.15.110:0/2671277282 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd594004bb0 con 0x7fd59c1094c0 2024-04-26T11:27:26.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.466+0000 7fd59a000700 1 -- 172.21.15.110:0/2671277282 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594004020 con 0x7fd59c1094c0 2024-04-26T11:27:26.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.466+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c1a0fe0 con 0x7fd59c1094c0 2024-04-26T11:27:26.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.466+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c1a88c0 con 0x7fd59c1094c0 2024-04-26T11:27:26.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.467+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c06a110 con 0x7fd59c1094c0 2024-04-26T11:27:26.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.469+0000 7fd59a000700 1 -- 172.21.15.110:0/2671277282 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fd59401b030 con 0x7fd59c1094c0 2024-04-26T11:27:26.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.470+0000 7fd59a000700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd5840a3cc0 0x7fd5840a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:26.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.470+0000 7fd59a000700 1 -- 172.21.15.110:0/2671277282 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fd5940cf880 con 0x7fd59c1094c0 2024-04-26T11:27:26.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.471+0000 7fd5a1c00700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd5840a3cc0 0x7fd5840a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:26.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.471+0000 7fd5a1c00700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd5840a3cc0 0x7fd5840a6180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd590006010 tx=0x7fd59000b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:26.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.475+0000 7fd59a000700 1 -- 172.21.15.110:0/2671277282 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd594010040 con 0x7fd59c1094c0 2024-04-26T11:27:26.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:26.753+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd59c02e490 con 0x7fd59c1094c0 2024-04-26T11:27:27.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.554+0000 7fd59a000700 1 -- 172.21.15.110:0/2671277282 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fd59409c440 con 0x7fd59c1094c0 2024-04-26T11:27:27.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd5840a3cc0 msgr2=0x7fd5840a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:27.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd5840a3cc0 0x7fd5840a6180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd590006010 tx=0x7fd59000b280 comp rx=0 tx=0).stop 2024-04-26T11:27:27.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c1094c0 msgr2=0x7fd59c1a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:27.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c1094c0 0x7fd59c1a0610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd59400efc0 tx=0x7fd59400c3a0 comp rx=0 tx=0).stop 2024-04-26T11:27:27.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 shutdown_connections 2024-04-26T11:27:27.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd59c1094c0 0x7fd59c1a0610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:27.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd59c103470 0x7fd59c19bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:27.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd5840a3cc0 0x7fd5840a6180 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:27.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 --2- 172.21.15.110:0/2671277282 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd59c103e30 0x7fd59c19c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:27.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 >> 172.21.15.110:0/2671277282 conn(0x7fd59c07a580 msgr2=0x7fd59c10e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:27.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.560+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 shutdown_connections 2024-04-26T11:27:27.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:27.561+0000 7fd5a4600700 1 -- 172.21.15.110:0/2671277282 wait complete. 2024-04-26T11:27:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:27 smithi193 ceph-mon[32782]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T11:27:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:27 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2671277282' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T11:27:27.955 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:27 smithi110 ceph-mon[28069]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T11:27:27.956 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:27 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2671277282' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T11:27:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:27 smithi196 ceph-mon[32572]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T11:27:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:27 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2671277282' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T11:27:28.400 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-04-26T11:27:28.400 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-04-26T11:27:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:28 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2671277282' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T11:27:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:28 smithi110 ceph-mon[28069]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:28.851 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:28 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2671277282' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T11:27:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:28 smithi193 ceph-mon[32782]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:28 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2671277282' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T11:27:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:28 smithi196 ceph-mon[32572]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:29 smithi193 ceph-mon[32782]: pgmap v332: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 0 op/s 2024-04-26T11:27:29.916 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:29 smithi110 ceph-mon[28069]: pgmap v332: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 0 op/s 2024-04-26T11:27:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:29 smithi196 ceph-mon[32572]: pgmap v332: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 0 op/s 2024-04-26T11:27:31.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.112+0000 7ff5b4c00700 1 -- 172.21.15.110:0/980937862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b0103470 msgr2=0x7ff5b01038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:31.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.112+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/980937862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b0103470 0x7ff5b01038f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff598009990 tx=0x7ff598009ca0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.113+0000 7ff5b4c00700 1 -- 172.21.15.110:0/980937862 shutdown_connections 2024-04-26T11:27:31.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.113+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/980937862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5b0103e30 0x7ff5b0110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.113+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/980937862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5b01094c0 0x7ff5b01098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.113+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/980937862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b0103470 0x7ff5b01038f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.113+0000 7ff5b4c00700 1 -- 172.21.15.110:0/980937862 >> 172.21.15.110:0/980937862 conn(0x7ff5b007a580 msgr2=0x7ff5b007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:31.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.113+0000 7ff5b4c00700 1 -- 172.21.15.110:0/980937862 shutdown_connections 2024-04-26T11:27:31.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.113+0000 7ff5b4c00700 1 -- 172.21.15.110:0/980937862 wait complete. 2024-04-26T11:27:31.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.114+0000 7ff5b4c00700 1 Processor -- start 2024-04-26T11:27:31.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.114+0000 7ff5b4c00700 1 -- start start 2024-04-26T11:27:31.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.114+0000 7ff5b4c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5b0103470 0x7ff5b019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:31.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.114+0000 7ff5b4c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5b0103e30 0x7ff5b019c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.114+0000 7ff5b4c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b01094c0 0x7ff5b01a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5b4c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0113610 con 0x7ff5b01094c0 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5b4c00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0113490 con 0x7ff5b0103e30 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5b4c00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0113790 con 0x7ff5b0103470 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ade00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5b0103470 0x7ff5b019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ade00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5b0103470 0x7ff5b019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:49172/0 (socket says 172.21.15.110:49172) 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ade00700 1 -- 172.21.15.110:0/3776578486 learned_addr learned my addr 172.21.15.110:0/3776578486 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ae800700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b01094c0 0x7ff5b01a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5a5400700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5b0103e30 0x7ff5b019c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ade00700 1 -- 172.21.15.110:0/3776578486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5b0103e30 msgr2=0x7ff5b019c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ade00700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5b0103e30 0x7ff5b019c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ade00700 1 -- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b01094c0 msgr2=0x7ff5b01a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:31.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ade00700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b01094c0 0x7ff5b01a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ade00700 1 -- 172.21.15.110:0/3776578486 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b01a0d70 con 0x7ff5b0103470 2024-04-26T11:27:31.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.115+0000 7ff5ae800700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b01094c0 0x7ff5b01a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:27:31.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.116+0000 7ff5ade00700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5b0103470 0x7ff5b019bd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000e9a0 tx=0x7ff5a000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:31.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.116+0000 7ff5a7400700 1 -- 172.21.15.110:0/3776578486 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000ca10 con 0x7ff5b0103470 2024-04-26T11:27:31.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.116+0000 7ff5a7400700 1 -- 172.21.15.110:0/3776578486 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5a000cbb0 con 0x7ff5b0103470 2024-04-26T11:27:31.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.116+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b01a1060 con 0x7ff5b0103470 2024-04-26T11:27:31.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.116+0000 7ff5a7400700 1 -- 172.21.15.110:0/3776578486 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0018680 con 0x7ff5b0103470 2024-04-26T11:27:31.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.116+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b01a88e0 con 0x7ff5b0103470 2024-04-26T11:27:31.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.117+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b006a110 con 0x7ff5b0103470 2024-04-26T11:27:31.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.119+0000 7ff5a7400700 1 -- 172.21.15.110:0/3776578486 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff5a0010430 con 0x7ff5b0103470 2024-04-26T11:27:31.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.120+0000 7ff5a7400700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5940a3cc0 0x7ff5940a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:31.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.121+0000 7ff5a7400700 1 -- 172.21.15.110:0/3776578486 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7ff5a00d0460 con 0x7ff5b0103470 2024-04-26T11:27:31.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.121+0000 7ff5a5400700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5940a3cc0 0x7ff5940a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:31.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.121+0000 7ff5a5400700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5940a3cc0 0x7ff5940a6180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5b007af00 tx=0x7ff598005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:31.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.123+0000 7ff5a7400700 1 -- 172.21.15.110:0/3776578486 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff5a009cef0 con 0x7ff5b0103470 2024-04-26T11:27:31.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.400+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7ff5b01a8b10 con 0x7ff5b0103470 2024-04-26T11:27:31.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.576+0000 7ff5a7400700 1 -- 172.21.15.110:0/3776578486 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7ff5a009c7f0 con 0x7ff5b0103470 2024-04-26T11:27:31.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.579+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5940a3cc0 msgr2=0x7ff5940a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:31.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5940a3cc0 0x7ff5940a6180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5b007af00 tx=0x7ff598005fd0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5b0103470 msgr2=0x7ff5b019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:31.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5b0103470 0x7ff5b019bd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000e9a0 tx=0x7ff5a000ecb0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 shutdown_connections 2024-04-26T11:27:31.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b01094c0 0x7ff5b01a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff5940a3cc0 0x7ff5940a6180 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5b0103470 0x7ff5b019bd60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 --2- 172.21.15.110:0/3776578486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5b0103e30 0x7ff5b019c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:31.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 >> 172.21.15.110:0/3776578486 conn(0x7ff5b007a580 msgr2=0x7ff5b010e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:31.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 shutdown_connections 2024-04-26T11:27:31.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:31.580+0000 7ff5b4c00700 1 -- 172.21.15.110:0/3776578486 wait complete. 2024-04-26T11:27:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:31 smithi110 ceph-mon[28069]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 0 op/s 2024-04-26T11:27:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:31 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3776578486' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-26T11:27:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:31 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-26T11:27:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:31 smithi193 ceph-mon[32782]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 0 op/s 2024-04-26T11:27:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:31 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3776578486' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-26T11:27:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:31 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-26T11:27:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:31 smithi196 ceph-mon[32572]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 0 op/s 2024-04-26T11:27:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:31 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3776578486' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-26T11:27:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:31 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-26T11:27:32.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-04-26T11:27:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:32 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T11:27:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:32 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-26T11:27:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:32 smithi193 ceph-mon[32782]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T11:27:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:32 smithi193 ceph-mon[32782]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:32 smithi193 ceph-mon[32782]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-26T11:27:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:32 smithi193 ceph-mon[32782]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:27:32.914 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:32 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T11:27:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:32 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-26T11:27:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:32 smithi196 ceph-mon[32572]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T11:27:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:32 smithi196 ceph-mon[32572]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:32 smithi196 ceph-mon[32572]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-26T11:27:33.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:32 smithi196 ceph-mon[32572]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:27:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:32 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T11:27:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:32 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-26T11:27:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:32 smithi110 ceph-mon[28069]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T11:27:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:32 smithi110 ceph-mon[28069]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T11:27:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:32 smithi110 ceph-mon[28069]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-26T11:27:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:32 smithi110 ceph-mon[28069]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:27:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:33 smithi193 ceph-mon[32782]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s 2024-04-26T11:27:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:33 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] up:active 2024-04-26T11:27:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:33 smithi193 ceph-mon[32782]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T11:27:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:33 smithi193 ceph-mon[32782]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T11:27:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:33 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:27:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:33 smithi193 ceph-mon[32782]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-26T11:27:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:33 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-04-26T11:27:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:33 smithi193 ceph-mon[32782]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T11:27:33.987 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:33 smithi110 ceph-mon[28069]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s 2024-04-26T11:27:33.987 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:33 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] up:active 2024-04-26T11:27:33.987 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:33 smithi110 ceph-mon[28069]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T11:27:33.987 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:33 smithi110 ceph-mon[28069]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T11:27:33.987 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:33 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:27:33.987 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:33 smithi110 ceph-mon[28069]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-26T11:27:33.988 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:33 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-04-26T11:27:33.988 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:33 smithi110 ceph-mon[28069]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T11:27:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:33 smithi196 ceph-mon[32572]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s 2024-04-26T11:27:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:33 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] up:active 2024-04-26T11:27:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:33 smithi196 ceph-mon[32572]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T11:27:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:33 smithi196 ceph-mon[32572]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T11:27:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:33 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:27:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:33 smithi196 ceph-mon[32572]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-26T11:27:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:33 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-04-26T11:27:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:33 smithi196 ceph-mon[32572]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T11:27:34.645 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:34 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] up:active 2024-04-26T11:27:34.645 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:34 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-26T11:27:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:34 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] up:active 2024-04-26T11:27:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:34 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-26T11:27:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:34 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] up:active 2024-04-26T11:27:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:34 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-26T11:27:35.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.188+0000 7ff1f2400700 1 -- 172.21.15.110:0/427461568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec076060 msgr2=0x7ff1ec10f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:35.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.188+0000 7ff1f2400700 1 --2- 172.21.15.110:0/427461568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec076060 0x7ff1ec10f6b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009990 tx=0x7ff1d8009ca0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.188+0000 7ff1f2400700 1 -- 172.21.15.110:0/427461568 shutdown_connections 2024-04-26T11:27:35.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.188+0000 7ff1f2400700 1 --2- 172.21.15.110:0/427461568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec10fbf0 0x7ff1ec111fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.188+0000 7ff1f2400700 1 --2- 172.21.15.110:0/427461568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1ec075740 0x7ff1ec075b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.188+0000 7ff1f2400700 1 --2- 172.21.15.110:0/427461568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec076060 0x7ff1ec10f6b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.188+0000 7ff1f2400700 1 -- 172.21.15.110:0/427461568 >> 172.21.15.110:0/427461568 conn(0x7ff1ec0fee40 msgr2=0x7ff1ec101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:35.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.188+0000 7ff1f2400700 1 -- 172.21.15.110:0/427461568 shutdown_connections 2024-04-26T11:27:35.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.188+0000 7ff1f2400700 1 -- 172.21.15.110:0/427461568 wait complete. 2024-04-26T11:27:35.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.189+0000 7ff1f2400700 1 Processor -- start 2024-04-26T11:27:35.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.189+0000 7ff1f2400700 1 -- start start 2024-04-26T11:27:35.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f2400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec075740 0x7ff1ec1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:35.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f2400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec076060 0x7ff1ec1a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:35.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f2400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1ec10fbf0 0x7ff1ec19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:35.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f2400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec1156f0 con 0x7ff1ec075740 2024-04-26T11:27:35.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f2400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec115570 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f2400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec115870 con 0x7ff1ec076060 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f1000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec075740 0x7ff1ec1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f1000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec075740 0x7ff1ec1a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48676/0 (socket says 172.21.15.110:48676) 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f1000700 1 -- 172.21.15.110:0/2129798954 learned_addr learned my addr 172.21.15.110:0/2129798954 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1f1a00700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1ec10fbf0 0x7ff1ec19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.190+0000 7ff1ebe00700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec076060 0x7ff1ec1a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1f1a00700 1 -- 172.21.15.110:0/2129798954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec076060 msgr2=0x7ff1ec1a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1f1a00700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec076060 0x7ff1ec1a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1f1a00700 1 -- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec075740 msgr2=0x7ff1ec1a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1f1a00700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec075740 0x7ff1ec1a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1f1a00700 1 -- 172.21.15.110:0/2129798954 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec19c1d0 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1f1000700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec075740 0x7ff1ec1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1f1a00700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1ec10fbf0 0x7ff1ec19ba70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400efc0 tx=0x7ff1e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:35.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1e9600700 1 -- 172.21.15.110:0/2129798954 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e40092e0 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ec19c460 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1e9600700 1 -- 172.21.15.110:0/2129798954 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1e4004bb0 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1e9600700 1 -- 172.21.15.110:0/2129798954 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4004020 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.191+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ec1a8730 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.192+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ec06a110 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.194+0000 7ff1e9600700 1 -- 172.21.15.110:0/2129798954 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff1e401b030 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.196+0000 7ff1e9600700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff1d40a3c40 0x7ff1d40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:35.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.196+0000 7ff1e9600700 1 -- 172.21.15.110:0/2129798954 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7ff1e40cfd30 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.196+0000 7ff1f1000700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff1d40a3c40 0x7ff1d40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:35.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.196+0000 7ff1f1000700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff1d40a3c40 0x7ff1d40a6100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec1124c0 tx=0x7ff1e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:35.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.200+0000 7ff1e9600700 1 -- 172.21.15.110:0/2129798954 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff1e4022020 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.458+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7ff1ec02e490 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.623+0000 7ff1e9600700 1 -- 172.21.15.110:0/2129798954 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7ff1e4010040 con 0x7ff1ec10fbf0 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff1d40a3c40 msgr2=0x7ff1d40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff1d40a3c40 0x7ff1d40a6100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec1124c0 tx=0x7ff1e0009260 comp rx=0 tx=0).stop 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1ec10fbf0 msgr2=0x7ff1ec19ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1ec10fbf0 0x7ff1ec19ba70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400efc0 tx=0x7ff1e400c3a0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 shutdown_connections 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1ec10fbf0 0x7ff1ec19ba70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1ec075740 0x7ff1ec1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff1d40a3c40 0x7ff1d40a6100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 --2- 172.21.15.110:0/2129798954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ec076060 0x7ff1ec1a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.626+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 >> 172.21.15.110:0/2129798954 conn(0x7ff1ec0fee40 msgr2=0x7ff1ec0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.627+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 shutdown_connections 2024-04-26T11:27:35.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:35.627+0000 7ff1f2400700 1 -- 172.21.15.110:0/2129798954 wait complete. 2024-04-26T11:27:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:35 smithi110 ceph-mon[28069]: pgmap v335: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 1 op/s 2024-04-26T11:27:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:35 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2129798954' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T11:27:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:35 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T11:27:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:35 smithi196 ceph-mon[32572]: pgmap v335: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 1 op/s 2024-04-26T11:27:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:35 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2129798954' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T11:27:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:35 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T11:27:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:35 smithi193 ceph-mon[32782]: pgmap v335: 97 pgs: 97 active+clean; 580 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 1 op/s 2024-04-26T11:27:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:35 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2129798954' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T11:27:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:35 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T11:27:36.420 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-04-26T11:27:36.877 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:36 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T11:27:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:36 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-26T11:27:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:36 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:27:37.024 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:36 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T11:27:37.024 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:36 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-26T11:27:37.024 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:36 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:27:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:36 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T11:27:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:36 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-26T11:27:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:36 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:27:37.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:37 smithi110 ceph-mon[28069]: pgmap v336: 97 pgs: 97 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.8 KiB/s wr, 6 op/s 2024-04-26T11:27:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:37 smithi196 ceph-mon[32572]: pgmap v336: 97 pgs: 97 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.8 KiB/s wr, 6 op/s 2024-04-26T11:27:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:37 smithi193 ceph-mon[32782]: pgmap v336: 97 pgs: 97 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.8 KiB/s wr, 6 op/s 2024-04-26T11:27:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.200+0000 7fab94400700 1 -- 172.21.15.110:0/3861287905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab8c105640 msgr2=0x7fab8c105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.200+0000 7fab94400700 1 --2- 172.21.15.110:0/3861287905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab8c105640 0x7fab8c105ac0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fab78009990 tx=0x7fab78009ca0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.200+0000 7fab94400700 1 -- 172.21.15.110:0/3861287905 shutdown_connections 2024-04-26T11:27:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.200+0000 7fab94400700 1 --2- 172.21.15.110:0/3861287905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab8c106000 0x7fab8c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.200+0000 7fab94400700 1 --2- 172.21.15.110:0/3861287905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c10b640 0x7fab8c10ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.200+0000 7fab94400700 1 --2- 172.21.15.110:0/3861287905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab8c105640 0x7fab8c105ac0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.200+0000 7fab94400700 1 -- 172.21.15.110:0/3861287905 >> 172.21.15.110:0/3861287905 conn(0x7fab8c101130 msgr2=0x7fab8c103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.201+0000 7fab94400700 1 -- 172.21.15.110:0/3861287905 shutdown_connections 2024-04-26T11:27:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.201+0000 7fab94400700 1 -- 172.21.15.110:0/3861287905 wait complete. 2024-04-26T11:27:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.202+0000 7fab94400700 1 Processor -- start 2024-04-26T11:27:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.202+0000 7fab94400700 1 -- start start 2024-04-26T11:27:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab94400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c105640 0x7fab8c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab94400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab8c106000 0x7fab8c19c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab94400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab8c10b640 0x7fab8c1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab94400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c115890 con 0x7fab8c106000 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab94400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c115710 con 0x7fab8c105640 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab94400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c115a10 con 0x7fab8c10b640 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab91a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c105640 0x7fab8c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab91000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab8c106000 0x7fab8c19c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab91a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c105640 0x7fab8c19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:47300/0 (socket says 172.21.15.110:47300) 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab91a00700 1 -- 172.21.15.110:0/2601096671 learned_addr learned my addr 172.21.15.110:0/2601096671 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.203+0000 7fab92400700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab8c10b640 0x7fab8c1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab91a00700 1 -- 172.21.15.110:0/2601096671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab8c10b640 msgr2=0x7fab8c1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab91a00700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab8c10b640 0x7fab8c1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab91a00700 1 -- 172.21.15.110:0/2601096671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab8c106000 msgr2=0x7fab8c19c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab91a00700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab8c106000 0x7fab8c19c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab91a00700 1 -- 172.21.15.110:0/2601096671 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c1a0d20 con 0x7fab8c105640 2024-04-26T11:27:39.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab91a00700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c105640 0x7fab8c19bd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab8000eb30 tx=0x7fab8000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:39.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab8a000700 1 -- 172.21.15.110:0/2601096671 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8000cbd0 con 0x7fab8c105640 2024-04-26T11:27:39.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1a1010 con 0x7fab8c105640 2024-04-26T11:27:39.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab8a000700 1 -- 172.21.15.110:0/2601096671 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab800044d0 con 0x7fab8c105640 2024-04-26T11:27:39.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab8a000700 1 -- 172.21.15.110:0/2601096671 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80003e30 con 0x7fab8c105640 2024-04-26T11:27:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.204+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a8890 con 0x7fab8c105640 2024-04-26T11:27:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.205+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c06a110 con 0x7fab8c105640 2024-04-26T11:27:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.207+0000 7fab8a000700 1 -- 172.21.15.110:0/2601096671 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fab80004000 con 0x7fab8c105640 2024-04-26T11:27:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.209+0000 7fab8a000700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fab740a3c40 0x7fab740a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.209+0000 7fab8a000700 1 -- 172.21.15.110:0/2601096671 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fab800d0630 con 0x7fab8c105640 2024-04-26T11:27:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.209+0000 7fab91000700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fab740a3c40 0x7fab740a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.210+0000 7fab91000700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fab740a3c40 0x7fab740a6100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab8c103700 tx=0x7fab78005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.211+0000 7fab8a000700 1 -- 172.21.15.110:0/2601096671 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fab800042f0 con 0x7fab8c105640 2024-04-26T11:27:39.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.498+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fab8c02e490 con 0x7fab8c105640 2024-04-26T11:27:39.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.649+0000 7fab8a000700 1 -- 172.21.15.110:0/2601096671 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7fab8009d0c0 con 0x7fab8c105640 2024-04-26T11:27:39.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fab740a3c40 msgr2=0x7fab740a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:39.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fab740a3c40 0x7fab740a6100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab8c103700 tx=0x7fab78005fd0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c105640 msgr2=0x7fab8c19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:39.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c105640 0x7fab8c19bd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab8000eb30 tx=0x7fab8000ee40 comp rx=0 tx=0).stop 2024-04-26T11:27:39.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 shutdown_connections 2024-04-26T11:27:39.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fab740a3c40 0x7fab740a6100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fab8c10b640 0x7fab8c1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c105640 0x7fab8c19bd60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 --2- 172.21.15.110:0/2601096671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab8c106000 0x7fab8c19c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:39.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.653+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 >> 172.21.15.110:0/2601096671 conn(0x7fab8c101130 msgr2=0x7fab8c101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:39.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.654+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 shutdown_connections 2024-04-26T11:27:39.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:39.654+0000 7fab94400700 1 -- 172.21.15.110:0/2601096671 wait complete. 2024-04-26T11:27:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:39 smithi110 ceph-mon[28069]: pgmap v337: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-04-26T11:27:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:39 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2601096671' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T11:27:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:39 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T11:27:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:39 smithi196 ceph-mon[32572]: pgmap v337: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-04-26T11:27:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:39 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2601096671' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T11:27:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:39 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T11:27:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:39 smithi193 ceph-mon[32782]: pgmap v337: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-04-26T11:27:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:39 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2601096671' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T11:27:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:39 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T11:27:40.529 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-04-26T11:27:40.530 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-04-26T11:27:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:40 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T11:27:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:40 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:27:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:40 smithi110 ceph-mon[28069]: pgmap v338: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-04-26T11:27:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:40 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T11:27:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:40 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:27:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:40 smithi196 ceph-mon[32572]: pgmap v338: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-04-26T11:27:41.010 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:40 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T11:27:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:40 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:27:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:40 smithi193 ceph-mon[32782]: pgmap v338: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-04-26T11:27:43.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.251+0000 7ffb2f000700 1 -- 172.21.15.110:0/3308240656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 msgr2=0x7ffb281167c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:43.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.251+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3308240656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 0x7ffb281167c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000b0a0 tx=0x7ffb2000b3b0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.251+0000 7ffb2f000700 1 -- 172.21.15.110:0/3308240656 shutdown_connections 2024-04-26T11:27:43.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.251+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3308240656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 0x7ffb281167c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.251+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3308240656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb2810e830 0x7ffb2810ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.251+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3308240656 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb28109960 0x7ffb28109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.251+0000 7ffb2f000700 1 -- 172.21.15.110:0/3308240656 >> 172.21.15.110:0/3308240656 conn(0x7ffb280791b0 msgr2=0x7ffb28108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:43.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.251+0000 7ffb2f000700 1 -- 172.21.15.110:0/3308240656 shutdown_connections 2024-04-26T11:27:43.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.251+0000 7ffb2f000700 1 -- 172.21.15.110:0/3308240656 wait complete. 2024-04-26T11:27:43.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.252+0000 7ffb2f000700 1 Processor -- start 2024-04-26T11:27:43.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.252+0000 7ffb2f000700 1 -- start start 2024-04-26T11:27:43.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.252+0000 7ffb2f000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb28109960 0x7ffb2819fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:43.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.252+0000 7ffb2f000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 0x7ffb281a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:43.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2f000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb2810e830 0x7ffb281a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2f000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28119b80 con 0x7ffb2810a320 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2f000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28119a00 con 0x7ffb28109960 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2f000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28119d00 con 0x7ffb2810e830 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2d200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 0x7ffb281a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2d200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 0x7ffb281a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53712/0 (socket says 172.21.15.110:53712) 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2d200700 1 -- 172.21.15.110:0/3716747677 learned_addr learned my addr 172.21.15.110:0/3716747677 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2dc00700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb28109960 0x7ffb2819fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2d200700 1 -- 172.21.15.110:0/3716747677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb2810e830 msgr2=0x7ffb281a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2d200700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb2810e830 0x7ffb281a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2d200700 1 -- 172.21.15.110:0/3716747677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb28109960 msgr2=0x7ffb2819fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2d200700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb28109960 0x7ffb2819fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2d200700 1 -- 172.21.15.110:0/3716747677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb281a5000 con 0x7ffb2810a320 2024-04-26T11:27:43.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.253+0000 7ffb2dc00700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb28109960 0x7ffb2819fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:27:43.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.254+0000 7ffb2d200700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 0x7ffb281a0530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e9c0 tx=0x7ffb1800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:43.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.254+0000 7ffb26000700 1 -- 172.21.15.110:0/3716747677 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800cbd0 con 0x7ffb2810a320 2024-04-26T11:27:43.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.254+0000 7ffb26000700 1 -- 172.21.15.110:0/3716747677 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb1800cd70 con 0x7ffb2810a320 2024-04-26T11:27:43.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.254+0000 7ffb26000700 1 -- 172.21.15.110:0/3716747677 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18005610 con 0x7ffb2810a320 2024-04-26T11:27:43.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.254+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb281a52f0 con 0x7ffb2810a320 2024-04-26T11:27:43.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.254+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb281acb70 con 0x7ffb2810a320 2024-04-26T11:27:43.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.255+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb2806a110 con 0x7ffb2810a320 2024-04-26T11:27:43.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.257+0000 7ffb26000700 1 -- 172.21.15.110:0/3716747677 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ffb18004750 con 0x7ffb2810a320 2024-04-26T11:27:43.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.259+0000 7ffb26000700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffb100a3cc0 0x7ffb100a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:43.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.259+0000 7ffb26000700 1 -- 172.21.15.110:0/3716747677 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7ffb180d0620 con 0x7ffb2810a320 2024-04-26T11:27:43.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.259+0000 7ffb2dc00700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffb100a3cc0 0x7ffb100a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:43.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.260+0000 7ffb2dc00700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffb100a3cc0 0x7ffb100a6180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009fd0 tx=0x7ffb1c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:43.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.263+0000 7ffb26000700 1 -- 172.21.15.110:0/3716747677 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffb1809d0b0 con 0x7ffb2810a320 2024-04-26T11:27:43.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.523+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ffb28063860 con 0x7ffb100a3cc0 2024-04-26T11:27:43.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.563+0000 7ffb26000700 1 -- 172.21.15.110:0/3716747677 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ffb28063860 con 0x7ffb100a3cc0 2024-04-26T11:27:43.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.565+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffb100a3cc0 msgr2=0x7ffb100a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:43.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.565+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffb100a3cc0 0x7ffb100a6180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009fd0 tx=0x7ffb1c009260 comp rx=0 tx=0).stop 2024-04-26T11:27:43.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 msgr2=0x7ffb281a0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:43.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 0x7ffb281a0530 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e9c0 tx=0x7ffb1800ecd0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 shutdown_connections 2024-04-26T11:27:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffb100a3cc0 0x7ffb100a6180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb2810e830 0x7ffb281a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb28109960 0x7ffb2819fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 --2- 172.21.15.110:0/3716747677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb2810a320 0x7ffb281a0530 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 >> 172.21.15.110:0/3716747677 conn(0x7ffb280791b0 msgr2=0x7ffb28079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 shutdown_connections 2024-04-26T11:27:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:43.566+0000 7ffb2f000700 1 -- 172.21.15.110:0/3716747677 wait complete. 2024-04-26T11:27:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:43 smithi110 ceph-mon[28069]: pgmap v339: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-04-26T11:27:43.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:27:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:27:43.537+0000 7f2683000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:27:43.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:27:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:27:43.537+0000 7f2683000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:27:43.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:27:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:27:43.537+0000 7f2683000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:27:43.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:27:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:27:43.538+0000 7f2683000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:27:43.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:27:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:27:43.538+0000 7f2683000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:27:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:43 smithi193 ceph-mon[32782]: pgmap v339: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-04-26T11:27:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:43 smithi196 ceph-mon[32572]: pgmap v339: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-04-26T11:27:44.406 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-26T11:27:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:44 smithi110 ceph-mon[28069]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:44.847 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:44 smithi193 ceph-mon[32782]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:44 smithi196 ceph-mon[32572]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:45 smithi193 ceph-mon[32782]: pgmap v340: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-26T11:27:45.913 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:45 smithi110 ceph-mon[28069]: pgmap v340: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-26T11:27:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:45 smithi196 ceph-mon[32572]: pgmap v340: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-26T11:27:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:46 smithi110 ceph-mon[28069]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-04-26T11:27:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:46 smithi193 ceph-mon[32782]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-04-26T11:27:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:46 smithi196 ceph-mon[32572]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-04-26T11:27:47.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.067+0000 7fd957200700 1 -- 172.21.15.110:0/1252397472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 msgr2=0x7fd95006b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.067+0000 7fd957200700 1 --2- 172.21.15.110:0/1252397472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 0x7fd95006b590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd938009990 tx=0x7fd938009ca0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.067+0000 7fd957200700 1 -- 172.21.15.110:0/1252397472 shutdown_connections 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.067+0000 7fd957200700 1 --2- 172.21.15.110:0/1252397472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd95006bad0 0x7fd9501102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.067+0000 7fd957200700 1 --2- 172.21.15.110:0/1252397472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9501094a0 0x7fd950109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.067+0000 7fd957200700 1 --2- 172.21.15.110:0/1252397472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 0x7fd95006b590 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.067+0000 7fd957200700 1 -- 172.21.15.110:0/1252397472 >> 172.21.15.110:0/1252397472 conn(0x7fd9500792d0 msgr2=0x7fd9500796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.067+0000 7fd957200700 1 -- 172.21.15.110:0/1252397472 shutdown_connections 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.067+0000 7fd957200700 1 -- 172.21.15.110:0/1252397472 wait complete. 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.068+0000 7fd957200700 1 Processor -- start 2024-04-26T11:27:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd957200700 1 -- start start 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd957200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 0x7fd95019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd957200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95006bad0 0x7fd95019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd957200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9501094a0 0x7fd9501a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd957200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd950113600 con 0x7fd95006b130 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd957200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd950113480 con 0x7fd9501094a0 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd957200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd950113780 con 0x7fd95006bad0 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd94fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 0x7fd95019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd94fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 0x7fd95019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53752/0 (socket says 172.21.15.110:53752) 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd94fe00700 1 -- 172.21.15.110:0/3893759742 learned_addr learned my addr 172.21.15.110:0/3893759742 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd955200700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9501094a0 0x7fd9501a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.069+0000 7fd947400700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95006bad0 0x7fd95019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.070+0000 7fd94fe00700 1 -- 172.21.15.110:0/3893759742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95006bad0 msgr2=0x7fd95019c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.070+0000 7fd94fe00700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95006bad0 0x7fd95019c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.070+0000 7fd94fe00700 1 -- 172.21.15.110:0/3893759742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9501094a0 msgr2=0x7fd9501a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.070+0000 7fd94fe00700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9501094a0 0x7fd9501a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.070+0000 7fd94fe00700 1 -- 172.21.15.110:0/3893759742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9501a0da0 con 0x7fd95006b130 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.070+0000 7fd955200700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9501094a0 0x7fd9501a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.070+0000 7fd94fe00700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 0x7fd95019bd90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd94000e9c0 tx=0x7fd94000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.070+0000 7fd94d600700 1 -- 172.21.15.110:0/3893759742 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94000cbd0 con 0x7fd95006b130 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.070+0000 7fd94d600700 1 -- 172.21.15.110:0/3893759742 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd94000ee60 con 0x7fd95006b130 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.071+0000 7fd94d600700 1 -- 172.21.15.110:0/3893759742 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9400055c0 con 0x7fd95006b130 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.071+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9501a1090 con 0x7fd95006b130 2024-04-26T11:27:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.071+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9501a8910 con 0x7fd95006b130 2024-04-26T11:27:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.072+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95006a110 con 0x7fd95006b130 2024-04-26T11:27:47.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.074+0000 7fd94d600700 1 -- 172.21.15.110:0/3893759742 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fd940004750 con 0x7fd95006b130 2024-04-26T11:27:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.075+0000 7fd94d600700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd9340a3d50 0x7fd9340a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.075+0000 7fd94d600700 1 -- 172.21.15.110:0/3893759742 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fd9400d0640 con 0x7fd95006b130 2024-04-26T11:27:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.075+0000 7fd947400700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd9340a3d50 0x7fd9340a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:47.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.076+0000 7fd947400700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd9340a3d50 0x7fd9340a6210 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd950079920 tx=0x7fd93800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:47.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.080+0000 7fd94d600700 1 -- 172.21.15.110:0/3893759742 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd94009cf70 con 0x7fd95006b130 2024-04-26T11:27:47.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.340+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd950063860 con 0x7fd9340a3d50 2024-04-26T11:27:47.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.381+0000 7fd94d600700 1 -- 172.21.15.110:0/3893759742 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd950063860 con 0x7fd9340a3d50 2024-04-26T11:27:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.384+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd9340a3d50 msgr2=0x7fd9340a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.384+0000 7fd957200700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd9340a3d50 0x7fd9340a6210 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd950079920 tx=0x7fd93800b260 comp rx=0 tx=0).stop 2024-04-26T11:27:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 msgr2=0x7fd95019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 0x7fd95019bd90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd94000e9c0 tx=0x7fd94000ecd0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 shutdown_connections 2024-04-26T11:27:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9501094a0 0x7fd9501a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95006b130 0x7fd95019bd90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd9340a3d50 0x7fd9340a6210 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 --2- 172.21.15.110:0/3893759742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd95006bad0 0x7fd95019c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:47.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 >> 172.21.15.110:0/3893759742 conn(0x7fd9500792d0 msgr2=0x7fd95010e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:47.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 shutdown_connections 2024-04-26T11:27:47.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:47.385+0000 7fd957200700 1 -- 172.21.15.110:0/3893759742 wait complete. 2024-04-26T11:27:47.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:47 smithi110 ceph-mon[28069]: pgmap v341: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-26T11:27:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:47 smithi193 ceph-mon[32782]: pgmap v341: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-26T11:27:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:47 smithi196 ceph-mon[32572]: pgmap v341: 97 pgs: 97 active+clean; 582 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-04-26T11:27:48.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-26T11:27:48.694 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:48.848 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:48 smithi110 ceph-mon[28069]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:48 smithi193 ceph-mon[32782]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:48 smithi196 ceph-mon[32572]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:49 smithi193 ceph-mon[32782]: pgmap v342: 97 pgs: 97 active+clean; 588 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-04-26T11:27:49.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:49 smithi110 ceph-mon[28069]: pgmap v342: 97 pgs: 97 active+clean; 588 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-04-26T11:27:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:49 smithi196 ceph-mon[32572]: pgmap v342: 97 pgs: 97 active+clean; 588 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-04-26T11:27:50.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.942+0000 7fd26fa00700 1 -- 172.21.15.110:0/3551130977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd268109490 msgr2=0x7fd268109870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:50.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.942+0000 7fd26fa00700 1 --2- 172.21.15.110:0/3551130977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd268109490 0x7fd268109870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00b0a0 tx=0x7fd25c00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:27:50.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.942+0000 7fd26fa00700 1 -- 172.21.15.110:0/3551130977 shutdown_connections 2024-04-26T11:27:50.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.942+0000 7fd26fa00700 1 --2- 172.21.15.110:0/3551130977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd26806c360 0x7fd2681102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:50.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.942+0000 7fd26fa00700 1 --2- 172.21.15.110:0/3551130977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd268109490 0x7fd268109870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:50.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.942+0000 7fd26fa00700 1 --2- 172.21.15.110:0/3551130977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd26806b9c0 0x7fd26806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:50.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.942+0000 7fd26fa00700 1 -- 172.21.15.110:0/3551130977 >> 172.21.15.110:0/3551130977 conn(0x7fd268079290 msgr2=0x7fd2680796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:50.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.943+0000 7fd26fa00700 1 -- 172.21.15.110:0/3551130977 shutdown_connections 2024-04-26T11:27:50.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.943+0000 7fd26fa00700 1 -- 172.21.15.110:0/3551130977 wait complete. 2024-04-26T11:27:50.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.944+0000 7fd26fa00700 1 Processor -- start 2024-04-26T11:27:50.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.944+0000 7fd26fa00700 1 -- start start 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.944+0000 7fd26fa00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd26806b9c0 0x7fd2681023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.944+0000 7fd26fa00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd26806c360 0x7fd268102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.944+0000 7fd26fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd268109490 0x7fd268102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.944+0000 7fd26fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd2681135f0 con 0x7fd268109490 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.944+0000 7fd26fa00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd268113470 con 0x7fd26806c360 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.944+0000 7fd26fa00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd268113770 con 0x7fd26806b9c0 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd26da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd268109490 0x7fd268102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd26da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd268109490 0x7fd268102e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53768/0 (socket says 172.21.15.110:53768) 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd26da00700 1 -- 172.21.15.110:0/22391477 learned_addr learned my addr 172.21.15.110:0/22391477 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd26d000700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd26806b9c0 0x7fd2681023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd267e00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd26806c360 0x7fd268102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd267e00700 1 -- 172.21.15.110:0/22391477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd26806b9c0 msgr2=0x7fd2681023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd267e00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd26806b9c0 0x7fd2681023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd267e00700 1 -- 172.21.15.110:0/22391477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd268109490 msgr2=0x7fd268102e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:50.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd267e00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd268109490 0x7fd268102e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:50.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd267e00700 1 -- 172.21.15.110:0/22391477 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2681a80d0 con 0x7fd26806c360 2024-04-26T11:27:50.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.945+0000 7fd267e00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd26806c360 0x7fd268102920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd25400e9f0 tx=0x7fd25400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:50.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.946+0000 7fd265600700 1 -- 172.21.15.110:0/22391477 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254004220 con 0x7fd26806c360 2024-04-26T11:27:50.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.946+0000 7fd265600700 1 -- 172.21.15.110:0/22391477 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2540043c0 con 0x7fd26806c360 2024-04-26T11:27:50.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.946+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2681a83c0 con 0x7fd26806c360 2024-04-26T11:27:50.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.946+0000 7fd265600700 1 -- 172.21.15.110:0/22391477 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254005020 con 0x7fd26806c360 2024-04-26T11:27:50.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.946+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2681a8900 con 0x7fd26806c360 2024-04-26T11:27:50.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.947+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26806a110 con 0x7fd26806c360 2024-04-26T11:27:50.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.949+0000 7fd265600700 1 -- 172.21.15.110:0/22391477 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fd254004750 con 0x7fd26806c360 2024-04-26T11:27:50.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.950+0000 7fd265600700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd2500a3d50 0x7fd2500a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:50.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.951+0000 7fd265600700 1 -- 172.21.15.110:0/22391477 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7fd2540d0580 con 0x7fd26806c360 2024-04-26T11:27:50.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.951+0000 7fd26d000700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd2500a3d50 0x7fd2500a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:50.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.951+0000 7fd26d000700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd2500a3d50 0x7fd2500a6210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0062a0 tx=0x7fd25c006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:50.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:50.953+0000 7fd265600700 1 -- 172.21.15.110:0/22391477 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd25409ceb0 con 0x7fd26806c360 2024-04-26T11:27:51.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.221+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fd268063860 con 0x7fd2500a3d50 2024-04-26T11:27:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.230+0000 7fd265600700 1 -- 172.21.15.110:0/22391477 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd268063860 con 0x7fd2500a3d50 2024-04-26T11:27:51.231 INFO:teuthology.orchestra.run.smithi110.stdout:/volumes/qa/sv_0/0dd0ab10-8667-437f-b7d3-e3371f37f93b 2024-04-26T11:27:51.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.232+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd2500a3d50 msgr2=0x7fd2500a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:51.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.232+0000 7fd26fa00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd2500a3d50 0x7fd2500a6210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0062a0 tx=0x7fd25c006210 comp rx=0 tx=0).stop 2024-04-26T11:27:51.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.232+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd26806c360 msgr2=0x7fd268102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:51.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.232+0000 7fd26fa00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd26806c360 0x7fd268102920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd25400e9f0 tx=0x7fd25400ed00 comp rx=0 tx=0).stop 2024-04-26T11:27:51.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.233+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 shutdown_connections 2024-04-26T11:27:51.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.233+0000 7fd26fa00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd268109490 0x7fd268102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:51.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.233+0000 7fd26fa00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fd2500a3d50 0x7fd2500a6210 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:51.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.233+0000 7fd26fa00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd26806b9c0 0x7fd2681023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:51.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.233+0000 7fd26fa00700 1 --2- 172.21.15.110:0/22391477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd26806c360 0x7fd268102920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:51.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.233+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 >> 172.21.15.110:0/22391477 conn(0x7fd268079290 msgr2=0x7fd268100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:51.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.233+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 shutdown_connections 2024-04-26T11:27:51.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:51.233+0000 7fd26fa00700 1 -- 172.21.15.110:0/22391477 wait complete. 2024-04-26T11:27:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:51 smithi193 ceph-mon[32782]: pgmap v343: 97 pgs: 97 active+clean; 588 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-04-26T11:27:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:51 smithi196 ceph-mon[32572]: pgmap v343: 97 pgs: 97 active+clean; 588 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-04-26T11:27:52.030 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:51 smithi110 ceph-mon[28069]: pgmap v343: 97 pgs: 97 active+clean; 588 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-04-26T11:27:52.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-26T11:27:52.552 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:52 smithi193 ceph-mon[32782]: from='client.24608 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:52.873 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:52 smithi110 ceph-mon[28069]: from='client.24608 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:52 smithi196 ceph-mon[32572]: from='client.24608 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:53 smithi193 ceph-mon[32782]: pgmap v344: 97 pgs: 97 active+clean; 608 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-04-26T11:27:53.972 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:53 smithi110 ceph-mon[28069]: pgmap v344: 97 pgs: 97 active+clean; 608 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-04-26T11:27:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:53 smithi196 ceph-mon[32572]: pgmap v344: 97 pgs: 97 active+clean; 608 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-04-26T11:27:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.797+0000 7ff4c3400700 1 -- 172.21.15.110:0/1537206822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4bc106000 msgr2=0x7ff4bc112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.797+0000 7ff4c3400700 1 --2- 172.21.15.110:0/1537206822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4bc106000 0x7ff4bc112510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009f90 tx=0x7ff4b400b330 comp rx=0 tx=0).stop 2024-04-26T11:27:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.797+0000 7ff4c3400700 1 -- 172.21.15.110:0/1537206822 shutdown_connections 2024-04-26T11:27:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.797+0000 7ff4c3400700 1 --2- 172.21.15.110:0/1537206822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4bc106000 0x7ff4bc112510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.797+0000 7ff4c3400700 1 --2- 172.21.15.110:0/1537206822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc10b640 0x7ff4bc10ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.797+0000 7ff4c3400700 1 --2- 172.21.15.110:0/1537206822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc105640 0x7ff4bc105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.797+0000 7ff4c3400700 1 -- 172.21.15.110:0/1537206822 >> 172.21.15.110:0/1537206822 conn(0x7ff4bc101130 msgr2=0x7ff4bc103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.797+0000 7ff4c3400700 1 -- 172.21.15.110:0/1537206822 shutdown_connections 2024-04-26T11:27:54.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.797+0000 7ff4c3400700 1 -- 172.21.15.110:0/1537206822 wait complete. 2024-04-26T11:27:54.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.799+0000 7ff4c3400700 1 Processor -- start 2024-04-26T11:27:54.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.799+0000 7ff4c3400700 1 -- start start 2024-04-26T11:27:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc105640 0x7ff4bc1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c3400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4bc106000 0x7ff4bc1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c3400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc10b640 0x7ff4bc19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c3400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1158d0 con 0x7ff4bc10b640 2024-04-26T11:27:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c3400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc115750 con 0x7ff4bc106000 2024-04-26T11:27:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c3400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc115a50 con 0x7ff4bc105640 2024-04-26T11:27:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c0a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc105640 0x7ff4bc1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c0a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc105640 0x7ff4bc1a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:34372/0 (socket says 172.21.15.110:34372) 2024-04-26T11:27:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c0a00700 1 -- 172.21.15.110:0/514722807 learned_addr learned my addr 172.21.15.110:0/514722807 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4bbe00700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4bc106000 0x7ff4bc1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4c1400700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc10b640 0x7ff4bc19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4bbe00700 1 -- 172.21.15.110:0/514722807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc105640 msgr2=0x7ff4bc1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4bbe00700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc105640 0x7ff4bc1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4bbe00700 1 -- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc10b640 msgr2=0x7ff4bc19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4bbe00700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc10b640 0x7ff4bc19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.800+0000 7ff4bbe00700 1 -- 172.21.15.110:0/514722807 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4bc19c2b0 con 0x7ff4bc106000 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.801+0000 7ff4bbe00700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4bc106000 0x7ff4bc1a1e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800eb90 tx=0x7ff4a800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.801+0000 7ff4b9600700 1 -- 172.21.15.110:0/514722807 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800cc90 con 0x7ff4bc106000 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.801+0000 7ff4b9600700 1 -- 172.21.15.110:0/514722807 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4a800ce30 con 0x7ff4bc106000 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.801+0000 7ff4b9600700 1 -- 172.21.15.110:0/514722807 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8010430 con 0x7ff4bc106000 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.801+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4bc19c5a0 con 0x7ff4bc106000 2024-04-26T11:27:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.801+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4bc1a8810 con 0x7ff4bc106000 2024-04-26T11:27:54.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.802+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4bc06a110 con 0x7ff4bc106000 2024-04-26T11:27:54.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.804+0000 7ff4b9600700 1 -- 172.21.15.110:0/514722807 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7ff4a8003ef0 con 0x7ff4bc106000 2024-04-26T11:27:54.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.805+0000 7ff4b9600700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3d50 0x7ff4a40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:54.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.806+0000 7ff4b9600700 1 -- 172.21.15.110:0/514722807 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7ff4a80d0760 con 0x7ff4bc106000 2024-04-26T11:27:54.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.806+0000 7ff4c0a00700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3d50 0x7ff4a40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:54.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.806+0000 7ff4c0a00700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3d50 0x7ff4a40a6210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009ca0 tx=0x7ff4b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:54.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:54.810+0000 7ff4b9600700 1 -- 172.21.15.110:0/514722807 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff4a809d090 con 0x7ff4bc106000 2024-04-26T11:27:55.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.075+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff4bc063860 con 0x7ff4a40a3d50 2024-04-26T11:27:55.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.111+0000 7ff4b9600700 1 -- 172.21.15.110:0/514722807 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff4bc063860 con 0x7ff4a40a3d50 2024-04-26T11:27:55.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.114+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3d50 msgr2=0x7ff4a40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:55.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.114+0000 7ff4c3400700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3d50 0x7ff4a40a6210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0009ca0 tx=0x7ff4b0009260 comp rx=0 tx=0).stop 2024-04-26T11:27:55.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.114+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4bc106000 msgr2=0x7ff4bc1a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:55.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.114+0000 7ff4c3400700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4bc106000 0x7ff4bc1a1e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800eb90 tx=0x7ff4a800eea0 comp rx=0 tx=0).stop 2024-04-26T11:27:55.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.115+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 shutdown_connections 2024-04-26T11:27:55.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.115+0000 7ff4c3400700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4bc10b640 0x7ff4bc19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:55.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.115+0000 7ff4c3400700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3d50 0x7ff4a40a6210 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:55.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.115+0000 7ff4c3400700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4bc105640 0x7ff4bc1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:55.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.115+0000 7ff4c3400700 1 --2- 172.21.15.110:0/514722807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4bc106000 0x7ff4bc1a1e80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:55.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.115+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 >> 172.21.15.110:0/514722807 conn(0x7ff4bc101130 msgr2=0x7ff4bc101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:55.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.115+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 shutdown_connections 2024-04-26T11:27:55.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:55.115+0000 7ff4c3400700 1 -- 172.21.15.110:0/514722807 wait complete. 2024-04-26T11:27:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:55 smithi110 ceph-mon[28069]: pgmap v345: 97 pgs: 97 active+clean; 608 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2024-04-26T11:27:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:55 smithi193 ceph-mon[32782]: pgmap v345: 97 pgs: 97 active+clean; 608 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2024-04-26T11:27:55.947 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-26T11:27:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:55 smithi196 ceph-mon[32572]: pgmap v345: 97 pgs: 97 active+clean; 608 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.9 KiB/s wr, 6 op/s 2024-04-26T11:27:56.398 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:27:56.719 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:56 smithi110 ceph-mon[28069]: from='client.24614 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:56 smithi193 ceph-mon[32782]: from='client.24614 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:56 smithi196 ceph-mon[32572]: from='client.24614 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:27:57.748 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:57 smithi110 ceph-mon[28069]: pgmap v346: 97 pgs: 97 active+clean; 608 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-04-26T11:27:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:57 smithi193 ceph-mon[32782]: pgmap v346: 97 pgs: 97 active+clean; 608 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-04-26T11:27:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:57 smithi196 ceph-mon[32572]: pgmap v346: 97 pgs: 97 active+clean; 608 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-04-26T11:27:58.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.574+0000 7f14e3200700 1 -- 172.21.15.110:0/3273340848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 msgr2=0x7f14e4102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:58.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.574+0000 7f14e3200700 1 --2- 172.21.15.110:0/3273340848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 0x7f14e4102890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f14d40099c0 tx=0x7f14d4009cd0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.574+0000 7f14e3200700 1 -- 172.21.15.110:0/3273340848 shutdown_connections 2024-04-26T11:27:58.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.574+0000 7f14e3200700 1 --2- 172.21.15.110:0/3273340848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14e4107590 0x7f14e410f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.574+0000 7f14e3200700 1 --2- 172.21.15.110:0/3273340848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 0x7f14e4102890 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.574+0000 7f14e3200700 1 --2- 172.21.15.110:0/3273340848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e4102e60 0x7f14e4106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.574+0000 7f14e3200700 1 -- 172.21.15.110:0/3273340848 >> 172.21.15.110:0/3273340848 conn(0x7f14e40fdd40 msgr2=0x7f14e4100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:58.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.574+0000 7f14e3200700 1 -- 172.21.15.110:0/3273340848 shutdown_connections 2024-04-26T11:27:58.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.574+0000 7f14e3200700 1 -- 172.21.15.110:0/3273340848 wait complete. 2024-04-26T11:27:58.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.575+0000 7f14e3200700 1 Processor -- start 2024-04-26T11:27:58.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e3200700 1 -- start start 2024-04-26T11:27:58.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e3200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 0x7f14e4109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:58.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e3200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14e4102e60 0x7f14e41096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:58.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e3200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e4107590 0x7f14e4109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:58.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e3200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f14e406bf00 con 0x7f14e41024b0 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e3200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14e406bd80 con 0x7f14e4102e60 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e3200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f14e41ac340 con 0x7f14e4107590 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 0x7f14e4109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e1400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14e4102e60 0x7f14e41096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 0x7f14e4109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51282/0 (socket says 172.21.15.110:51282) 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.576+0000 7f14e1e00700 1 -- 172.21.15.110:0/3040557225 learned_addr learned my addr 172.21.15.110:0/3040557225 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.577+0000 7f14e2800700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e4107590 0x7f14e4109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.577+0000 7f14e1e00700 1 -- 172.21.15.110:0/3040557225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e4107590 msgr2=0x7f14e4109c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.577+0000 7f14e1e00700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e4107590 0x7f14e4109c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.577+0000 7f14e1e00700 1 -- 172.21.15.110:0/3040557225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14e4102e60 msgr2=0x7f14e41096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.577+0000 7f14e1e00700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14e4102e60 0x7f14e41096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.577+0000 7f14e1e00700 1 -- 172.21.15.110:0/3040557225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e41ac540 con 0x7f14e41024b0 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.577+0000 7f14e1e00700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 0x7f14e4109180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14d4005910 tx=0x7f14d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.578+0000 7f14daa00700 1 -- 172.21.15.110:0/3040557225 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4026070 con 0x7f14e41024b0 2024-04-26T11:27:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.578+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e41ac7d0 con 0x7f14e41024b0 2024-04-26T11:27:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.578+0000 7f14daa00700 1 -- 172.21.15.110:0/3040557225 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14d4003c70 con 0x7f14e41024b0 2024-04-26T11:27:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.578+0000 7f14daa00700 1 -- 172.21.15.110:0/3040557225 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d400fa30 con 0x7f14e41024b0 2024-04-26T11:27:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.578+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e41acc20 con 0x7f14e41024b0 2024-04-26T11:27:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.579+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e4103990 con 0x7f14e41024b0 2024-04-26T11:27:58.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.581+0000 7f14daa00700 1 -- 172.21.15.110:0/3040557225 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f14d4029070 con 0x7f14e41024b0 2024-04-26T11:27:58.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.584+0000 7f14daa00700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14c80a3cd0 0x7f14c80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:27:58.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.584+0000 7f14daa00700 1 -- 172.21.15.110:0/3040557225 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f14d40d11f0 con 0x7f14e41024b0 2024-04-26T11:27:58.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.584+0000 7f14e1400700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14c80a3cd0 0x7f14c80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:27:58.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.585+0000 7f14e1400700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14c80a3cd0 0x7f14c80a6190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14e410a940 tx=0x7f14d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:27:58.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.587+0000 7f14daa00700 1 -- 172.21.15.110:0/3040557225 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f14d4030080 con 0x7f14e41024b0 2024-04-26T11:27:58.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.850+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f14e410e4d0 con 0x7f14c80a3cd0 2024-04-26T11:27:58.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.862+0000 7f14daa00700 1 -- 172.21.15.110:0/3040557225 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f14e410e4d0 con 0x7f14c80a3cd0 2024-04-26T11:27:58.863 INFO:teuthology.orchestra.run.smithi110.stdout:/volumes/qa/sv_1/5209720f-dc0d-4dcc-ad37-e3d1b7a0e6d2 2024-04-26T11:27:58.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14c80a3cd0 msgr2=0x7f14c80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:58.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14c80a3cd0 0x7f14c80a6190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f14e410a940 tx=0x7f14d0009260 comp rx=0 tx=0).stop 2024-04-26T11:27:58.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 msgr2=0x7f14e4109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:27:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 0x7f14e4109180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14d4005910 tx=0x7f14d4004270 comp rx=0 tx=0).stop 2024-04-26T11:27:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 shutdown_connections 2024-04-26T11:27:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14c80a3cd0 0x7f14c80a6190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e4107590 0x7f14e4109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e41024b0 0x7f14e4109180 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 --2- 172.21.15.110:0/3040557225 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14e4102e60 0x7f14e41096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:27:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 >> 172.21.15.110:0/3040557225 conn(0x7f14e40fdd40 msgr2=0x7f14e40ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:27:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 shutdown_connections 2024-04-26T11:27:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:27:58.865+0000 7f14e3200700 1 -- 172.21.15.110:0/3040557225 wait complete. 2024-04-26T11:27:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:27:59 smithi110 ceph-mon[28069]: pgmap v347: 97 pgs: 97 active+clean; 632 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-04-26T11:27:59.680 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:27:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:27:59 smithi196 ceph-mon[32572]: pgmap v347: 97 pgs: 97 active+clean; 632 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-04-26T11:27:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:27:59 smithi193 ceph-mon[32782]: pgmap v347: 97 pgs: 97 active+clean; 632 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-04-26T11:28:00.158 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:00.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:00 smithi110 ceph-mon[28069]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:28:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:00 smithi196 ceph-mon[32572]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:28:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:00 smithi193 ceph-mon[32782]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:28:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:01 smithi110 ceph-mon[28069]: pgmap v348: 97 pgs: 97 active+clean; 632 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-04-26T11:28:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:01 smithi196 ceph-mon[32572]: pgmap v348: 97 pgs: 97 active+clean; 632 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-04-26T11:28:01.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:01 smithi193 ceph-mon[32782]: pgmap v348: 97 pgs: 97 active+clean; 632 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-04-26T11:28:02.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.368+0000 7feed6600700 1 -- 172.21.15.110:0/3260401551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 msgr2=0x7feed010fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:02.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.368+0000 7feed6600700 1 --2- 172.21.15.110:0/3260401551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 0x7feed010fe20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feec0009990 tx=0x7feec0009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.368+0000 7feed6600700 1 -- 172.21.15.110:0/3260401551 shutdown_connections 2024-04-26T11:28:02.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.368+0000 7feed6600700 1 --2- 172.21.15.110:0/3260401551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feed010a450 0x7feed0116910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.368+0000 7feed6600700 1 --2- 172.21.15.110:0/3260401551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 0x7feed010fe20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.368+0000 7feed6600700 1 --2- 172.21.15.110:0/3260401551 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feed0109a90 0x7feed0109f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.368+0000 7feed6600700 1 -- 172.21.15.110:0/3260401551 >> 172.21.15.110:0/3260401551 conn(0x7feed0076bf0 msgr2=0x7feed0079010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:02.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.368+0000 7feed6600700 1 -- 172.21.15.110:0/3260401551 shutdown_connections 2024-04-26T11:28:02.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.368+0000 7feed6600700 1 -- 172.21.15.110:0/3260401551 wait complete. 2024-04-26T11:28:02.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.370+0000 7feed6600700 1 Processor -- start 2024-04-26T11:28:02.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.370+0000 7feed6600700 1 -- start start 2024-04-26T11:28:02.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.370+0000 7feed6600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feed0109a90 0x7feed01a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:02.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.370+0000 7feed6600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feed010a450 0x7feed01a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:02.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.370+0000 7feed6600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 0x7feed01a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:02.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.370+0000 7feed6600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7feed0119cd0 con 0x7feed010fa40 2024-04-26T11:28:02.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.370+0000 7feed6600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feed0119b50 con 0x7feed0109a90 2024-04-26T11:28:02.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.370+0000 7feed6600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7feed0119e50 con 0x7feed010a450 2024-04-26T11:28:02.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 0x7feed01a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:02.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 0x7feed01a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45680/0 (socket says 172.21.15.110:45680) 2024-04-26T11:28:02.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecfe00700 1 -- 172.21.15.110:0/1831694854 learned_addr learned my addr 172.21.15.110:0/1831694854 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:02.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecf400700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feed0109a90 0x7feed01a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecea00700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feed010a450 0x7feed01a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecfe00700 1 -- 172.21.15.110:0/1831694854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feed010a450 msgr2=0x7feed01a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecfe00700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feed010a450 0x7feed01a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecfe00700 1 -- 172.21.15.110:0/1831694854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feed0109a90 msgr2=0x7feed01a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecfe00700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feed0109a90 0x7feed01a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.371+0000 7feecfe00700 1 -- 172.21.15.110:0/1831694854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed01a5170 con 0x7feed010fa40 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.372+0000 7feecfe00700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 0x7feed01a4a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feec800b970 tx=0x7feec800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.372+0000 7feec7e00700 1 -- 172.21.15.110:0/1831694854 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8019070 con 0x7feed010fa40 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.372+0000 7feec7e00700 1 -- 172.21.15.110:0/1831694854 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feec800cde0 con 0x7feed010fa40 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.372+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed01a5460 con 0x7feed010fa40 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.372+0000 7feec7e00700 1 -- 172.21.15.110:0/1831694854 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8007370 con 0x7feed010fa40 2024-04-26T11:28:02.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.372+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed01acce0 con 0x7feed010fa40 2024-04-26T11:28:02.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.374+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed006a110 con 0x7feed010fa40 2024-04-26T11:28:02.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.375+0000 7feec7e00700 1 -- 172.21.15.110:0/1831694854 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7feec801c070 con 0x7feed010fa40 2024-04-26T11:28:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.377+0000 7feec7e00700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7feeb40a3d50 0x7feeb40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.377+0000 7feec7e00700 1 -- 172.21.15.110:0/1831694854 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7feec80cf7f0 con 0x7feed010fa40 2024-04-26T11:28:02.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.377+0000 7feecf400700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7feeb40a3d50 0x7feeb40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:02.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.378+0000 7feecf400700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7feeb40a3d50 0x7feeb40a6210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feec0006010 tx=0x7feec000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:02.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.382+0000 7feec7e00700 1 -- 172.21.15.110:0/1831694854 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feec809c230 con 0x7feed010fa40 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]: dispatch 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-04-26T11:28:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-04-26T11:28:02.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.672+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feed01a14c0 con 0x7feed010fa40 2024-04-26T11:28:02.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.673+0000 7feec7e00700 1 -- 172.21.15.110:0/1831694854 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11889 (secure 0 0 0) 0x7feec809bb30 con 0x7feed010fa40 2024-04-26T11:28:02.675 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:28:02.675 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:27:39.501334+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24502,24518,24487]},"id":1}]} 2024-04-26T11:28:02.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.676+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7feeb40a3d50 msgr2=0x7feeb40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:02.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.676+0000 7feed6600700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7feeb40a3d50 0x7feeb40a6210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feec0006010 tx=0x7feec000b260 comp rx=0 tx=0).stop 2024-04-26T11:28:02.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.676+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 msgr2=0x7feed01a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:02.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.676+0000 7feed6600700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 0x7feed01a4a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feec800b970 tx=0x7feec800bc80 comp rx=0 tx=0).stop 2024-04-26T11:28:02.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.677+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 shutdown_connections 2024-04-26T11:28:02.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.677+0000 7feed6600700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feed010fa40 0x7feed01a4a30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.677+0000 7feed6600700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feed0109a90 0x7feed01a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.677+0000 7feed6600700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7feeb40a3d50 0x7feeb40a6210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.677+0000 7feed6600700 1 --2- 172.21.15.110:0/1831694854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feed010a450 0x7feed01a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:02.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.677+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 >> 172.21.15.110:0/1831694854 conn(0x7feed0076bf0 msgr2=0x7feed0077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:02.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.677+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 shutdown_connections 2024-04-26T11:28:02.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:02.677+0000 7feed6600700 1 -- 172.21.15.110:0/1831694854 wait complete. 2024-04-26T11:28:02.680 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-04-26T11:28:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-26T11:28:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-04-26T11:28:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-04-26T11:28:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-26T11:28:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]: dispatch 2024-04-26T11:28:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-04-26T11:28:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-04-26T11:28:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-04-26T11:28:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-04-26T11:28:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-04-26T11:28:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-04-26T11:28:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-04-26T11:28:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-04-26T11:28:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-26T11:28:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]: dispatch 2024-04-26T11:28:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-04-26T11:28:02.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-04-26T11:28:02.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]: dispatch 2024-04-26T11:28:02.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-04-26T11:28:02.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-04-26T11:28:03.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T11:28:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-26T11:28:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]': finished 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: pgmap v350: 97 pgs: 2 peering, 95 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.6 KiB/s wr, 5 op/s 2024-04-26T11:28:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:03 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1831694854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:28:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T11:28:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: pgmap v350: 97 pgs: 2 peering, 95 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.6 KiB/s wr, 5 op/s 2024-04-26T11:28:03.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:03 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1831694854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:28:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-04-26T11:28:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-04-26T11:28:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-04-26T11:28:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-26T11:28:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]': finished 2024-04-26T11:28:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-04-26T11:28:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-04-26T11:28:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-04-26T11:28:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-04-26T11:28:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-04-26T11:28:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T11:28:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: pgmap v350: 97 pgs: 2 peering, 95 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.6 KiB/s wr, 5 op/s 2024-04-26T11:28:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:03 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1831694854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:28:03.921 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:04.611 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:04 smithi110 ceph-mon[28069]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T11:28:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:04 smithi196 ceph-mon[32572]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T11:28:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:04 smithi193 ceph-mon[32782]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T11:28:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:05 smithi196 ceph-mon[32572]: pgmap v352: 97 pgs: 2 peering, 95 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-04-26T11:28:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:05 smithi110 ceph-mon[28069]: pgmap v352: 97 pgs: 2 peering, 95 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-04-26T11:28:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:05 smithi193 ceph-mon[32782]: pgmap v352: 97 pgs: 2 peering, 95 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-04-26T11:28:06.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.329+0000 7f502fa00700 1 -- 172.21.15.110:0/2495127909 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f502806bad0 msgr2=0x7f50281102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:06.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.329+0000 7f502fa00700 1 --2- 172.21.15.110:0/2495127909 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f502806bad0 0x7f50281102e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f502000b0a0 tx=0x7f502000b3b0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.330+0000 7f502fa00700 1 -- 172.21.15.110:0/2495127909 shutdown_connections 2024-04-26T11:28:06.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.330+0000 7f502fa00700 1 --2- 172.21.15.110:0/2495127909 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f502806bad0 0x7f50281102e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.330+0000 7f502fa00700 1 --2- 172.21.15.110:0/2495127909 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50281094a0 0x7f5028109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.330+0000 7f502fa00700 1 --2- 172.21.15.110:0/2495127909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f502806b130 0x7f502806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.330+0000 7f502fa00700 1 -- 172.21.15.110:0/2495127909 >> 172.21.15.110:0/2495127909 conn(0x7f50280792d0 msgr2=0x7f50280796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:06.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.330+0000 7f502fa00700 1 -- 172.21.15.110:0/2495127909 shutdown_connections 2024-04-26T11:28:06.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.330+0000 7f502fa00700 1 -- 172.21.15.110:0/2495127909 wait complete. 2024-04-26T11:28:06.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.331+0000 7f502fa00700 1 Processor -- start 2024-04-26T11:28:06.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.331+0000 7f502fa00700 1 -- start start 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.331+0000 7f502fa00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f502806b130 0x7f502819f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.331+0000 7f502fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f502806bad0 0x7f502819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.331+0000 7f502fa00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50281094a0 0x7f5028199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.331+0000 7f502fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5028113610 con 0x7f502806bad0 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.331+0000 7f502fa00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5028113490 con 0x7f50281094a0 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.331+0000 7f502fa00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5028113790 con 0x7f502806b130 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502d000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f502806b130 0x7f502819f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502d000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f502806b130 0x7f502819f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42240/0 (socket says 172.21.15.110:42240) 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502d000700 1 -- 172.21.15.110:0/1008524147 learned_addr learned my addr 172.21.15.110:0/1008524147 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502da00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50281094a0 0x7f5028199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f5027e00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f502806bad0 0x7f502819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:06.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502da00700 1 -- 172.21.15.110:0/1008524147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f502806b130 msgr2=0x7f502819f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:06.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502da00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f502806b130 0x7f502819f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502da00700 1 -- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f502806bad0 msgr2=0x7f502819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:06.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502da00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f502806bad0 0x7f502819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502da00700 1 -- 172.21.15.110:0/1008524147 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502819a0b0 con 0x7f50281094a0 2024-04-26T11:28:06.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502d000700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f502806b130 0x7f502819f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:06.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f5027e00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f502806bad0 0x7f502819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:28:06.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.332+0000 7f502da00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50281094a0 0x7f5028199950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f502000b070 tx=0x7f5020004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:06.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.333+0000 7f5025600700 1 -- 172.21.15.110:0/1008524147 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020021070 con 0x7f50281094a0 2024-04-26T11:28:06.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.333+0000 7f5025600700 1 -- 172.21.15.110:0/1008524147 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5020007e30 con 0x7f50281094a0 2024-04-26T11:28:06.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.333+0000 7f5025600700 1 -- 172.21.15.110:0/1008524147 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50200046f0 con 0x7f50281094a0 2024-04-26T11:28:06.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.333+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502819a340 con 0x7f50281094a0 2024-04-26T11:28:06.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.333+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50281a6660 con 0x7f50281094a0 2024-04-26T11:28:06.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.334+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5028104b50 con 0x7f50281094a0 2024-04-26T11:28:06.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.336+0000 7f5025600700 1 -- 172.21.15.110:0/1008524147 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f5020007980 con 0x7f50281094a0 2024-04-26T11:28:06.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.337+0000 7f5025600700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50100a3d50 0x7f50100a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:06.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.338+0000 7f5025600700 1 -- 172.21.15.110:0/1008524147 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f502000f020 con 0x7f50281094a0 2024-04-26T11:28:06.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.338+0000 7f502d000700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50100a3d50 0x7f50100a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:06.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.338+0000 7f502d000700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50100a3d50 0x7f50100a6210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f502819aa90 tx=0x7f501c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.341+0000 7f5025600700 1 -- 172.21.15.110:0/1008524147 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f502002a020 con 0x7f50281094a0 2024-04-26T11:28:06.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.569+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f502802e490 con 0x7f50281094a0 2024-04-26T11:28:06.573 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:28:06.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.571+0000 7f5025600700 1 -- 172.21.15.110:0/1008524147 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22829 (secure 0 0 0) 0x7f5020004000 con 0x7f50281094a0 2024-04-26T11:28:06.574 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":91,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","created":"2024-04-26T11:17:56.437545+0000","modified":"2024-04-26T11:28:03.421580+0000","last_up_change":"2024-04-26T11:25:57.427695+0000","last_in_change":"2024-04-26T11:25:38.050280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:44.478027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:27:06.034467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T11:27:11.025123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13eb997d-8b4a-47f5-be11-772d47788972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6803","nonce":1662740885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6805","nonce":1662740885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6809","nonce":1662740885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6807","nonce":1662740885}]},"public_addr":"172.21.15.110:6803/1662740885","cluster_addr":"172.21.15.110:6805/1662740885","heartbeat_back_addr":"172.21.15.110:6809/1662740885","heartbeat_front_addr":"172.21.15.110:6807/1662740885","state":["exists","up"]},{"osd":1,"uuid":"e7927dc3-dced-4661-8493-840e111241e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6801","nonce":1751461680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6803","nonce":1751461680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6807","nonce":1751461680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6805","nonce":1751461680}]},"public_addr":"172.21.15.193:6801/1751461680","cluster_addr":"172.21.15.193:6803/1751461680","heartbeat_back_addr":"172.21.15.193:6807/1751461680","heartbeat_front_addr":"172.21.15.193:6805/1751461680","state":["exists","up"]},{"osd":2,"uuid":"54459a80-91a1-45ba-b7e4-900a4a995219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6801","nonce":1785522554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6803","nonce":1785522554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6807","nonce":1785522554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6805","nonce":1785522554}]},"public_addr":"172.21.15.196:6801/1785522554","cluster_addr":"172.21.15.196:6803/1785522554","heartbeat_back_addr":"172.21.15.196:6807/1785522554","heartbeat_front_addr":"172.21.15.196:6805/1785522554","state":["exists","up"]},{"osd":3,"uuid":"12d8a1be-5edb-4af2-b01d-abd943f89641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6811","nonce":2253549266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6813","nonce":2253549266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6817","nonce":2253549266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6815","nonce":2253549266}]},"public_addr":"172.21.15.110:6811/2253549266","cluster_addr":"172.21.15.110:6813/2253549266","heartbeat_back_addr":"172.21.15.110:6817/2253549266","heartbeat_front_addr":"172.21.15.110:6815/2253549266","state":["exists","up"]},{"osd":4,"uuid":"f3057080-144b-4f43-9a63-8f415ca76d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6809","nonce":1314161856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6811","nonce":1314161856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6815","nonce":1314161856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6813","nonce":1314161856}]},"public_addr":"172.21.15.193:6809/1314161856","cluster_addr":"172.21.15.193:6811/1314161856","heartbeat_back_addr":"172.21.15.193:6815/1314161856","heartbeat_front_addr":"172.21.15.193:6813/1314161856","state":["exists","up"]},{"osd":5,"uuid":"f0775b9c-938e-4bb4-ae1e-01ef0686cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6809","nonce":2359280243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6811","nonce":2359280243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6815","nonce":2359280243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6813","nonce":2359280243}]},"public_addr":"172.21.15.196:6809/2359280243","cluster_addr":"172.21.15.196:6811/2359280243","heartbeat_back_addr":"172.21.15.196:6815/2359280243","heartbeat_front_addr":"172.21.15.196:6813/2359280243","state":["exists","up"]},{"osd":6,"uuid":"ea4ea3de-4ec4-48a1-809e-da62fcbb7033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6819","nonce":1730783886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6821","nonce":1730783886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6825","nonce":1730783886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6823","nonce":1730783886}]},"public_addr":"172.21.15.110:6819/1730783886","cluster_addr":"172.21.15.110:6821/1730783886","heartbeat_back_addr":"172.21.15.110:6825/1730783886","heartbeat_front_addr":"172.21.15.110:6823/1730783886","state":["exists","up"]},{"osd":7,"uuid":"98af7071-82b3-4732-b2a1-8676e6439cd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6817","nonce":4124476381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6819","nonce":4124476381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6823","nonce":4124476381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6821","nonce":4124476381}]},"public_addr":"172.21.15.193:6817/4124476381","cluster_addr":"172.21.15.193:6819/4124476381","heartbeat_back_addr":"172.21.15.193:6823/4124476381","heartbeat_front_addr":"172.21.15.193:6821/4124476381","state":["exists","up"]},{"osd":8,"uuid":"7aaa3c52-72f5-4946-a964-609f65b778f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6817","nonce":2942176519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6819","nonce":2942176519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6823","nonce":2942176519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6821","nonce":2942176519}]},"public_addr":"172.21.15.196:6817/2942176519","cluster_addr":"172.21.15.196:6819/2942176519","heartbeat_back_addr":"172.21.15.196:6823/2942176519","heartbeat_front_addr":"172.21.15.196:6821/2942176519","state":["exists","up"]},{"osd":9,"uuid":"2cde3ed2-6acd-48a4-a99d-aa558dd85baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6827","nonce":2620757358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6829","nonce":2620757358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6833","nonce":2620757358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6831","nonce":2620757358}]},"public_addr":"172.21.15.110:6827/2620757358","cluster_addr":"172.21.15.110:6829/2620757358","heartbeat_back_addr":"172.21.15.110:6833/2620757358","heartbeat_front_addr":"172.21.15.110:6831/2620757358","state":["exists","up"]},{"osd":10,"uuid":"3bbaac8f-fe7b-4f0e-a25b-286c3c30926e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6825","nonce":676480728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6827","nonce":676480728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6831","nonce":676480728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6829","nonce":676480728}]},"public_addr":"172.21.15.193:6825/676480728","cluster_addr":"172.21.15.193:6827/676480728","heartbeat_back_addr":"172.21.15.193:6831/676480728","heartbeat_front_addr":"172.21.15.193:6829/676480728","state":["exists","up"]},{"osd":11,"uuid":"e31c248e-1016-4765-bea1-9f31d823ca3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6825","nonce":2802765812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6827","nonce":2802765812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6831","nonce":2802765812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6829","nonce":2802765812}]},"public_addr":"172.21.15.196:6825/2802765812","cluster_addr":"172.21.15.196:6827/2802765812","heartbeat_back_addr":"172.21.15.196:6831/2802765812","heartbeat_front_addr":"172.21.15.196:6829/2802765812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:20:52.046788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:16.893940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:40.861409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:13.272469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:39.214479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:03.529206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:37.413989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:04.145639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:29.162356+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:03.325672+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:30.353695+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:56.267402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3278958945":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6801/4292256031":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3536224934":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2250601964":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/2775667488":"2024-04-27T11:18:29.387925+0000","172.21.15.110:6801/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/337370067":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3594651859":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/4292256031":"2024-04-27T11:19:02.329691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:28:06.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50100a3d50 msgr2=0x7f50100a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50100a3d50 0x7f50100a6210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f502819aa90 tx=0x7f501c009260 comp rx=0 tx=0).stop 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50281094a0 msgr2=0x7f5028199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50281094a0 0x7f5028199950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f502000b070 tx=0x7f5020004c80 comp rx=0 tx=0).stop 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 shutdown_connections 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50281094a0 0x7f5028199950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50100a3d50 0x7f50100a6210 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f502806b130 0x7f502819f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 --2- 172.21.15.110:0/1008524147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f502806bad0 0x7f502819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.574+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 >> 172.21.15.110:0/1008524147 conn(0x7f50280792d0 msgr2=0x7f5028100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.575+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 shutdown_connections 2024-04-26T11:28:06.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:06.575+0000 7f502fa00700 1 -- 172.21.15.110:0/1008524147 wait complete. 2024-04-26T11:28:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:06 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:28:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:06 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:28:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:06 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:28:07.509 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T11:28:07.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T11:28:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:07 smithi196 ceph-mon[32572]: pgmap v353: 97 pgs: 2 peering, 95 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 895 B/s wr, 2 op/s; 86 B/s, 1 keys/s, 1 objects/s recovering 2024-04-26T11:28:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:07 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1008524147' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:28:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:07 smithi110 ceph-mon[28069]: pgmap v353: 97 pgs: 2 peering, 95 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 895 B/s wr, 2 op/s; 86 B/s, 1 keys/s, 1 objects/s recovering 2024-04-26T11:28:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:07 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1008524147' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:28:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:07 smithi193 ceph-mon[32782]: pgmap v353: 97 pgs: 2 peering, 95 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 895 B/s wr, 2 op/s; 86 B/s, 1 keys/s, 1 objects/s recovering 2024-04-26T11:28:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:07 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1008524147' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:28:08.557 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:08 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:08 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:08 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:08 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:08 smithi110 ceph-mon[28069]: pgmap v354: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 164 B/s, 1 keys/s, 2 objects/s recovering 2024-04-26T11:28:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:08 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:08 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:08 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:08 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:08 smithi196 ceph-mon[32572]: pgmap v354: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 164 B/s, 1 keys/s, 2 objects/s recovering 2024-04-26T11:28:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:08 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:08 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:08 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:08 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:08 smithi193 ceph-mon[32782]: pgmap v354: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 164 B/s, 1 keys/s, 2 objects/s recovering 2024-04-26T11:28:10.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.855+0000 7f6edac00700 1 -- 172.21.15.110:0/3804244736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed410b640 msgr2=0x7f6ed410ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:10.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.855+0000 7f6edac00700 1 --2- 172.21.15.110:0/3804244736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed410b640 0x7f6ed410ba20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009990 tx=0x7f6ec4009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:10.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.855+0000 7f6edac00700 1 -- 172.21.15.110:0/3804244736 shutdown_connections 2024-04-26T11:28:10.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.855+0000 7f6edac00700 1 --2- 172.21.15.110:0/3804244736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ed4106000 0x7f6ed4112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:10.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.855+0000 7f6edac00700 1 --2- 172.21.15.110:0/3804244736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed410b640 0x7f6ed410ba20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:10.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.855+0000 7f6edac00700 1 --2- 172.21.15.110:0/3804244736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ed4105640 0x7f6ed4105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:10.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.855+0000 7f6edac00700 1 -- 172.21.15.110:0/3804244736 >> 172.21.15.110:0/3804244736 conn(0x7f6ed4101130 msgr2=0x7f6ed4103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:10.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.855+0000 7f6edac00700 1 -- 172.21.15.110:0/3804244736 shutdown_connections 2024-04-26T11:28:10.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.855+0000 7f6edac00700 1 -- 172.21.15.110:0/3804244736 wait complete. 2024-04-26T11:28:10.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.856+0000 7f6edac00700 1 Processor -- start 2024-04-26T11:28:10.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.856+0000 7f6edac00700 1 -- start start 2024-04-26T11:28:10.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.856+0000 7f6edac00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ed4105640 0x7f6ed419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:10.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.856+0000 7f6edac00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed4106000 0x7f6ed419c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.856+0000 7f6edac00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ed410b640 0x7f6ed41a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.856+0000 7f6edac00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4115870 con 0x7f6ed4105640 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6edac00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed41156f0 con 0x7f6ed410b640 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6edac00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed41159f0 con 0x7f6ed4106000 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed4106000 0x7f6ed419c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed4106000 0x7f6ed419c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42262/0 (socket says 172.21.15.110:42262) 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3400700 1 -- 172.21.15.110:0/2405094264 learned_addr learned my addr 172.21.15.110:0/2405094264 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3e00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ed4105640 0x7f6ed419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed8c00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ed410b640 0x7f6ed41a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3400700 1 -- 172.21.15.110:0/2405094264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ed410b640 msgr2=0x7f6ed41a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3400700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ed410b640 0x7f6ed41a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3400700 1 -- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ed4105640 msgr2=0x7f6ed419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:10.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3400700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ed4105640 0x7f6ed419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:10.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3400700 1 -- 172.21.15.110:0/2405094264 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed41a0d20 con 0x7f6ed4106000 2024-04-26T11:28:10.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.857+0000 7f6ed3400700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed4106000 0x7f6ed419c2a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000e9a0 tx=0x7f6ec000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:10.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.858+0000 7f6ed0c00700 1 -- 172.21.15.110:0/2405094264 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000cbd0 con 0x7f6ed4106000 2024-04-26T11:28:10.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.858+0000 7f6ed0c00700 1 -- 172.21.15.110:0/2405094264 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ec000cd70 con 0x7f6ed4106000 2024-04-26T11:28:10.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.858+0000 7f6ed0c00700 1 -- 172.21.15.110:0/2405094264 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0018640 con 0x7f6ed4106000 2024-04-26T11:28:10.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.858+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed41a1010 con 0x7f6ed4106000 2024-04-26T11:28:10.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.858+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed41a8890 con 0x7f6ed4106000 2024-04-26T11:28:10.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.859+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed410dbd0 con 0x7f6ed4106000 2024-04-26T11:28:10.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.862+0000 7f6ed0c00700 1 -- 172.21.15.110:0/2405094264 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f6ec0010970 con 0x7f6ed4106000 2024-04-26T11:28:10.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.863+0000 7f6ed0c00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6eb80a3d50 0x7f6eb80a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:10.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.863+0000 7f6ed0c00700 1 -- 172.21.15.110:0/2405094264 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f6ec00d08a0 con 0x7f6ed4106000 2024-04-26T11:28:10.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.863+0000 7f6ed3e00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6eb80a3d50 0x7f6eb80a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:10.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.864+0000 7f6ed3e00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6eb80a3d50 0x7f6eb80a6210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400b2e0 tx=0x7f6ec401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:10.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:10.865+0000 7f6ed0c00700 1 -- 172.21.15.110:0/2405094264 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6ec009d0a0 con 0x7f6ed4106000 2024-04-26T11:28:11.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.106+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ed419d070 con 0x7f6eb80a3d50 2024-04-26T11:28:11.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.116+0000 7f6ed0c00700 1 -- 172.21.15.110:0/2405094264 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258975 (secure 0 0 0) 0x7f6ed419d070 con 0x7f6eb80a3d50 2024-04-26T11:28:11.122 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:28:11.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6eb80a3d50 msgr2=0x7f6eb80a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:11.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6eb80a3d50 0x7f6eb80a6210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400b2e0 tx=0x7f6ec401a040 comp rx=0 tx=0).stop 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed4106000 msgr2=0x7f6ed419c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed4106000 0x7f6ed419c2a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000e9a0 tx=0x7f6ec000ed60 comp rx=0 tx=0).stop 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 shutdown_connections 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ed410b640 0x7f6ed41a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ed4105640 0x7f6ed419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6eb80a3d50 0x7f6eb80a6210 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 --2- 172.21.15.110:0/2405094264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ed4106000 0x7f6ed419c2a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 >> 172.21.15.110:0/2405094264 conn(0x7f6ed4101130 msgr2=0x7f6ed4101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 shutdown_connections 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:11.120+0000 7f6edac00700 1 -- 172.21.15.110:0/2405094264 wait complete. 2024-04-26T11:28:11.125 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-26T11:28:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:11 smithi196 ceph-mon[32572]: pgmap v355: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 634 B/s wr, 1 op/s; 163 B/s, 1 keys/s, 2 objects/s recovering 2024-04-26T11:28:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:11 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:11 smithi193 ceph-mon[32782]: pgmap v355: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 634 B/s wr, 1 op/s; 163 B/s, 1 keys/s, 2 objects/s recovering 2024-04-26T11:28:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:11 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:12.000 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:11 smithi110 ceph-mon[28069]: pgmap v355: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 634 B/s wr, 1 op/s; 163 B/s, 1 keys/s, 2 objects/s recovering 2024-04-26T11:28:12.000 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:12.000 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:11 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:12.049 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-04-26T11:28:10.492959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656353,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":327,"num_read_kb":297,"num_write":349,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1182052,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":280,"ondisk_log_size":280,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369628,"kb_used_data":12096,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572196,"statfs":{"total":1151940427776,"available":1151561928704,"internally_reserved":0,"allocated":12386304,"data_stored":7759443,"data_compressed":177741,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4257,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":28,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1316,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.069458"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430389+0000","last_change":"2024-04-26T11:27:12.099635+0000","last_active":"2024-04-26T11:28:03.430389+0000","last_peered":"2024-04-26T11:28:03.430389+0000","last_clean":"2024-04-26T11:28:03.430389+0000","last_became_active":"2024-04-26T11:27:12.099342+0000","last_became_peered":"2024-04-26T11:27:12.099342+0000","last_unstale":"2024-04-26T11:28:03.430389+0000","last_undegraded":"2024-04-26T11:28:03.430389+0000","last_fullsized":"2024-04-26T11:28:03.430389+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:36.433968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.440898+0000","last_change":"2024-04-26T11:27:12.090804+0000","last_active":"2024-04-26T11:28:03.440898+0000","last_peered":"2024-04-26T11:28:03.440898+0000","last_clean":"2024-04-26T11:28:03.440898+0000","last_became_active":"2024-04-26T11:27:12.089662+0000","last_became_peered":"2024-04-26T11:27:12.089662+0000","last_unstale":"2024-04-26T11:28:03.440898+0000","last_undegraded":"2024-04-26T11:28:03.440898+0000","last_fullsized":"2024-04-26T11:28:03.440898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.776482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.440532+0000","last_change":"2024-04-26T11:27:12.094739+0000","last_active":"2024-04-26T11:28:03.440532+0000","last_peered":"2024-04-26T11:28:03.440532+0000","last_clean":"2024-04-26T11:28:03.440532+0000","last_became_active":"2024-04-26T11:27:12.094410+0000","last_became_peered":"2024-04-26T11:27:12.094410+0000","last_unstale":"2024-04-26T11:28:03.440532+0000","last_undegraded":"2024-04-26T11:28:03.440532+0000","last_fullsized":"2024-04-26T11:28:03.440532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:17.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.449549+0000","last_change":"2024-04-26T11:28:03.446873+0000","last_active":"2024-04-26T11:28:03.449549+0000","last_peered":"2024-04-26T11:28:03.449549+0000","last_clean":"2024-04-26T11:28:03.449549+0000","last_became_active":"2024-04-26T11:28:03.445335+0000","last_became_peered":"2024-04-26T11:28:03.445335+0000","last_unstale":"2024-04-26T11:28:03.449549+0000","last_undegraded":"2024-04-26T11:28:03.449549+0000","last_fullsized":"2024-04-26T11:28:03.449549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:59.892678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430808+0000","last_change":"2024-04-26T11:27:12.114071+0000","last_active":"2024-04-26T11:28:03.430808+0000","last_peered":"2024-04-26T11:28:03.430808+0000","last_clean":"2024-04-26T11:28:03.430808+0000","last_became_active":"2024-04-26T11:27:12.113795+0000","last_became_peered":"2024-04-26T11:27:12.113795+0000","last_unstale":"2024-04-26T11:28:03.430808+0000","last_undegraded":"2024-04-26T11:28:03.430808+0000","last_fullsized":"2024-04-26T11:28:03.430808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:34.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798340+0000","last_change":"2024-04-26T11:27:12.108449+0000","last_active":"2024-04-26T11:28:03.798340+0000","last_peered":"2024-04-26T11:28:03.798340+0000","last_clean":"2024-04-26T11:28:03.798340+0000","last_became_active":"2024-04-26T11:27:12.108071+0000","last_became_peered":"2024-04-26T11:27:12.108071+0000","last_unstale":"2024-04-26T11:28:03.798340+0000","last_undegraded":"2024-04-26T11:28:03.798340+0000","last_fullsized":"2024-04-26T11:28:03.798340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:04.001728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433970+0000","last_change":"2024-04-26T11:27:12.099363+0000","last_active":"2024-04-26T11:28:03.433970+0000","last_peered":"2024-04-26T11:28:03.433970+0000","last_clean":"2024-04-26T11:28:03.433970+0000","last_became_active":"2024-04-26T11:27:12.098982+0000","last_became_peered":"2024-04-26T11:27:12.098982+0000","last_unstale":"2024-04-26T11:28:03.433970+0000","last_undegraded":"2024-04-26T11:28:03.433970+0000","last_fullsized":"2024-04-26T11:28:03.433970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:48.825504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439560+0000","last_change":"2024-04-26T11:27:12.111215+0000","last_active":"2024-04-26T11:28:03.439560+0000","last_peered":"2024-04-26T11:28:03.439560+0000","last_clean":"2024-04-26T11:28:03.439560+0000","last_became_active":"2024-04-26T11:27:12.110896+0000","last_became_peered":"2024-04-26T11:27:12.110896+0000","last_unstale":"2024-04-26T11:28:03.439560+0000","last_undegraded":"2024-04-26T11:28:03.439560+0000","last_fullsized":"2024-04-26T11:28:03.439560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:17.469534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433252+0000","last_change":"2024-04-26T11:27:12.091871+0000","last_active":"2024-04-26T11:28:03.433252+0000","last_peered":"2024-04-26T11:28:03.433252+0000","last_clean":"2024-04-26T11:28:03.433252+0000","last_became_active":"2024-04-26T11:27:12.091239+0000","last_became_peered":"2024-04-26T11:27:12.091239+0000","last_unstale":"2024-04-26T11:28:03.433252+0000","last_undegraded":"2024-04-26T11:28:03.433252+0000","last_fullsized":"2024-04-26T11:28:03.433252+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:30.526152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798687+0000","last_change":"2024-04-26T11:27:12.093411+0000","last_active":"2024-04-26T11:28:03.798687+0000","last_peered":"2024-04-26T11:28:03.798687+0000","last_clean":"2024-04-26T11:28:03.798687+0000","last_became_active":"2024-04-26T11:27:12.093086+0000","last_became_peered":"2024-04-26T11:27:12.093086+0000","last_unstale":"2024-04-26T11:28:03.798687+0000","last_undegraded":"2024-04-26T11:28:03.798687+0000","last_fullsized":"2024-04-26T11:28:03.798687+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:56.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433069+0000","last_change":"2024-04-26T11:27:12.093317+0000","last_active":"2024-04-26T11:28:03.433069+0000","last_peered":"2024-04-26T11:28:03.433069+0000","last_clean":"2024-04-26T11:28:03.433069+0000","last_became_active":"2024-04-26T11:27:12.092595+0000","last_became_peered":"2024-04-26T11:27:12.092595+0000","last_unstale":"2024-04-26T11:28:03.433069+0000","last_undegraded":"2024-04-26T11:28:03.433069+0000","last_fullsized":"2024-04-26T11:28:03.433069+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.702218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430347+0000","last_change":"2024-04-26T11:27:12.093118+0000","last_active":"2024-04-26T11:28:03.430347+0000","last_peered":"2024-04-26T11:28:03.430347+0000","last_clean":"2024-04-26T11:28:03.430347+0000","last_became_active":"2024-04-26T11:27:12.091482+0000","last_became_peered":"2024-04-26T11:27:12.091482+0000","last_unstale":"2024-04-26T11:28:03.430347+0000","last_undegraded":"2024-04-26T11:28:03.430347+0000","last_fullsized":"2024-04-26T11:28:03.430347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.426213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.448839+0000","last_change":"2024-04-26T11:27:12.114213+0000","last_active":"2024-04-26T11:28:03.448839+0000","last_peered":"2024-04-26T11:28:03.448839+0000","last_clean":"2024-04-26T11:28:03.448839+0000","last_became_active":"2024-04-26T11:27:12.113867+0000","last_became_peered":"2024-04-26T11:27:12.113867+0000","last_unstale":"2024-04-26T11:28:03.448839+0000","last_undegraded":"2024-04-26T11:28:03.448839+0000","last_fullsized":"2024-04-26T11:28:03.448839+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:59.258645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.442920+0000","last_change":"2024-04-26T11:27:12.084301+0000","last_active":"2024-04-26T11:28:03.442920+0000","last_peered":"2024-04-26T11:28:03.442920+0000","last_clean":"2024-04-26T11:28:03.442920+0000","last_became_active":"2024-04-26T11:27:12.083808+0000","last_became_peered":"2024-04-26T11:27:12.083808+0000","last_unstale":"2024-04-26T11:28:03.442920+0000","last_undegraded":"2024-04-26T11:28:03.442920+0000","last_fullsized":"2024-04-26T11:28:03.442920+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:46.107583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439062+0000","last_change":"2024-04-26T11:27:12.089647+0000","last_active":"2024-04-26T11:28:03.439062+0000","last_peered":"2024-04-26T11:28:03.439062+0000","last_clean":"2024-04-26T11:28:03.439062+0000","last_became_active":"2024-04-26T11:27:12.088081+0000","last_became_peered":"2024-04-26T11:27:12.088081+0000","last_unstale":"2024-04-26T11:28:03.439062+0000","last_undegraded":"2024-04-26T11:28:03.439062+0000","last_fullsized":"2024-04-26T11:28:03.439062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:43.423430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432401+0000","last_change":"2024-04-26T11:27:12.098138+0000","last_active":"2024-04-26T11:28:03.432401+0000","last_peered":"2024-04-26T11:28:03.432401+0000","last_clean":"2024-04-26T11:28:03.432401+0000","last_became_active":"2024-04-26T11:27:12.097756+0000","last_became_peered":"2024-04-26T11:27:12.097756+0000","last_unstale":"2024-04-26T11:28:03.432401+0000","last_undegraded":"2024-04-26T11:28:03.432401+0000","last_fullsized":"2024-04-26T11:28:03.432401+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:21.155370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430506+0000","last_change":"2024-04-26T11:27:12.099925+0000","last_active":"2024-04-26T11:28:03.430506+0000","last_peered":"2024-04-26T11:28:03.430506+0000","last_clean":"2024-04-26T11:28:03.430506+0000","last_became_active":"2024-04-26T11:27:12.099600+0000","last_became_peered":"2024-04-26T11:27:12.099600+0000","last_unstale":"2024-04-26T11:28:03.430506+0000","last_undegraded":"2024-04-26T11:28:03.430506+0000","last_fullsized":"2024-04-26T11:28:03.430506+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:23.704624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.443087+0000","last_change":"2024-04-26T11:27:12.104697+0000","last_active":"2024-04-26T11:28:03.443087+0000","last_peered":"2024-04-26T11:28:03.443087+0000","last_clean":"2024-04-26T11:28:03.443087+0000","last_became_active":"2024-04-26T11:27:12.103963+0000","last_became_peered":"2024-04-26T11:27:12.103963+0000","last_unstale":"2024-04-26T11:28:03.443087+0000","last_undegraded":"2024-04-26T11:28:03.443087+0000","last_fullsized":"2024-04-26T11:28:03.443087+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:58.202895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.428174+0000","last_change":"2024-04-26T11:27:12.109216+0000","last_active":"2024-04-26T11:28:03.428174+0000","last_peered":"2024-04-26T11:28:03.428174+0000","last_clean":"2024-04-26T11:28:03.428174+0000","last_became_active":"2024-04-26T11:27:12.108891+0000","last_became_peered":"2024-04-26T11:27:12.108891+0000","last_unstale":"2024-04-26T11:28:03.428174+0000","last_undegraded":"2024-04-26T11:28:03.428174+0000","last_fullsized":"2024-04-26T11:28:03.428174+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:53.741077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.456017+0000","last_change":"2024-04-26T11:28:03.456017+0000","last_active":"2024-04-26T11:28:03.456017+0000","last_peered":"2024-04-26T11:28:03.456017+0000","last_clean":"2024-04-26T11:28:03.456017+0000","last_became_active":"2024-04-26T11:28:03.447016+0000","last_became_peered":"2024-04-26T11:28:03.447016+0000","last_unstale":"2024-04-26T11:28:03.456017+0000","last_undegraded":"2024-04-26T11:28:03.456017+0000","last_fullsized":"2024-04-26T11:28:03.456017+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.616546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434876+0000","last_change":"2024-04-26T11:27:12.112635+0000","last_active":"2024-04-26T11:28:03.434876+0000","last_peered":"2024-04-26T11:28:03.434876+0000","last_clean":"2024-04-26T11:28:03.434876+0000","last_became_active":"2024-04-26T11:27:12.112282+0000","last_became_peered":"2024-04-26T11:27:12.112282+0000","last_unstale":"2024-04-26T11:28:03.434876+0000","last_undegraded":"2024-04-26T11:28:03.434876+0000","last_fullsized":"2024-04-26T11:28:03.434876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:21.482922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.435946+0000","last_change":"2024-04-26T11:27:08.473301+0000","last_active":"2024-04-26T11:28:03.435946+0000","last_peered":"2024-04-26T11:28:03.435946+0000","last_clean":"2024-04-26T11:28:03.435946+0000","last_became_active":"2024-04-26T11:27:08.472769+0000","last_became_peered":"2024-04-26T11:27:08.472769+0000","last_unstale":"2024-04-26T11:28:03.435946+0000","last_undegraded":"2024-04-26T11:28:03.435946+0000","last_fullsized":"2024-04-26T11:28:03.435946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:49.108849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.440949+0000","last_change":"2024-04-26T11:27:12.109725+0000","last_active":"2024-04-26T11:28:03.440949+0000","last_peered":"2024-04-26T11:28:03.440949+0000","last_clean":"2024-04-26T11:28:03.440949+0000","last_became_active":"2024-04-26T11:27:12.109376+0000","last_became_peered":"2024-04-26T11:27:12.109376+0000","last_unstale":"2024-04-26T11:28:03.440949+0000","last_undegraded":"2024-04-26T11:28:03.440949+0000","last_fullsized":"2024-04-26T11:28:03.440949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.464520+0000","last_change":"2024-04-26T11:28:03.464520+0000","last_active":"2024-04-26T11:28:03.464520+0000","last_peered":"2024-04-26T11:28:03.464520+0000","last_clean":"2024-04-26T11:28:03.464520+0000","last_became_active":"2024-04-26T11:28:03.449993+0000","last_became_peered":"2024-04-26T11:28:03.449993+0000","last_unstale":"2024-04-26T11:28:03.464520+0000","last_undegraded":"2024-04-26T11:28:03.464520+0000","last_fullsized":"2024-04-26T11:28:03.464520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:01.465563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432737+0000","last_change":"2024-04-26T11:27:12.100830+0000","last_active":"2024-04-26T11:28:03.432737+0000","last_peered":"2024-04-26T11:28:03.432737+0000","last_clean":"2024-04-26T11:28:03.432737+0000","last_became_active":"2024-04-26T11:27:12.100474+0000","last_became_peered":"2024-04-26T11:27:12.100474+0000","last_unstale":"2024-04-26T11:28:03.432737+0000","last_undegraded":"2024-04-26T11:28:03.432737+0000","last_fullsized":"2024-04-26T11:28:03.432737+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:18.778897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.444580+0000","last_change":"2024-04-26T11:28:03.444580+0000","last_active":"2024-04-26T11:28:03.444580+0000","last_peered":"2024-04-26T11:28:03.444580+0000","last_clean":"2024-04-26T11:28:03.444580+0000","last_became_active":"2024-04-26T11:28:03.435056+0000","last_became_peered":"2024-04-26T11:28:03.435056+0000","last_unstale":"2024-04-26T11:28:03.444580+0000","last_undegraded":"2024-04-26T11:28:03.444580+0000","last_fullsized":"2024-04-26T11:28:03.444580+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:42.640914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434169+0000","last_change":"2024-04-26T11:27:12.093472+0000","last_active":"2024-04-26T11:28:03.434169+0000","last_peered":"2024-04-26T11:28:03.434169+0000","last_clean":"2024-04-26T11:28:03.434169+0000","last_became_active":"2024-04-26T11:27:12.093110+0000","last_became_peered":"2024-04-26T11:27:12.093110+0000","last_unstale":"2024-04-26T11:28:03.434169+0000","last_undegraded":"2024-04-26T11:28:03.434169+0000","last_fullsized":"2024-04-26T11:28:03.434169+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:19.256670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:06.442733+0000","last_change":"2024-04-26T11:28:03.440961+0000","last_active":"2024-04-26T11:28:06.442733+0000","last_peered":"2024-04-26T11:28:06.442733+0000","last_clean":"2024-04-26T11:28:06.442733+0000","last_became_active":"2024-04-26T11:28:03.434607+0000","last_became_peered":"2024-04-26T11:28:03.434607+0000","last_unstale":"2024-04-26T11:28:06.442733+0000","last_undegraded":"2024-04-26T11:28:06.442733+0000","last_fullsized":"2024-04-26T11:28:06.442733+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:37.122557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.447662+0000","last_change":"2024-04-26T11:28:03.447662+0000","last_active":"2024-04-26T11:28:03.447662+0000","last_peered":"2024-04-26T11:28:03.447662+0000","last_clean":"2024-04-26T11:28:03.447662+0000","last_became_active":"2024-04-26T11:28:03.447333+0000","last_became_peered":"2024-04-26T11:28:03.447333+0000","last_unstale":"2024-04-26T11:28:03.447662+0000","last_undegraded":"2024-04-26T11:28:03.447662+0000","last_fullsized":"2024-04-26T11:28:03.447662+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:37.600940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798262+0000","last_change":"2024-04-26T11:27:08.028424+0000","last_active":"2024-04-26T11:28:03.798262+0000","last_peered":"2024-04-26T11:28:03.798262+0000","last_clean":"2024-04-26T11:28:03.798262+0000","last_became_active":"2024-04-26T11:27:08.028134+0000","last_became_peered":"2024-04-26T11:27:08.028134+0000","last_unstale":"2024-04-26T11:28:03.798262+0000","last_undegraded":"2024-04-26T11:28:03.798262+0000","last_fullsized":"2024-04-26T11:28:03.798262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:44.636288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433305+0000","last_change":"2024-04-26T11:27:12.108078+0000","last_active":"2024-04-26T11:28:03.433305+0000","last_peered":"2024-04-26T11:28:03.433305+0000","last_clean":"2024-04-26T11:28:03.433305+0000","last_became_active":"2024-04-26T11:27:12.107713+0000","last_became_peered":"2024-04-26T11:27:12.107713+0000","last_unstale":"2024-04-26T11:28:03.433305+0000","last_undegraded":"2024-04-26T11:28:03.433305+0000","last_fullsized":"2024-04-26T11:28:03.433305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:59.995679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.445457+0000","last_change":"2024-04-26T11:27:08.049134+0000","last_active":"2024-04-26T11:28:03.445457+0000","last_peered":"2024-04-26T11:28:03.445457+0000","last_clean":"2024-04-26T11:28:03.445457+0000","last_became_active":"2024-04-26T11:27:08.047862+0000","last_became_peered":"2024-04-26T11:27:08.047862+0000","last_unstale":"2024-04-26T11:28:03.445457+0000","last_undegraded":"2024-04-26T11:28:03.445457+0000","last_fullsized":"2024-04-26T11:28:03.445457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:55.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433885+0000","last_change":"2024-04-26T11:27:12.117417+0000","last_active":"2024-04-26T11:28:03.433885+0000","last_peered":"2024-04-26T11:28:03.433885+0000","last_clean":"2024-04-26T11:28:03.433885+0000","last_became_active":"2024-04-26T11:27:12.116643+0000","last_became_peered":"2024-04-26T11:27:12.116643+0000","last_unstale":"2024-04-26T11:28:03.433885+0000","last_undegraded":"2024-04-26T11:28:03.433885+0000","last_fullsized":"2024-04-26T11:28:03.433885+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:26.677738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433058+0000","last_change":"2024-04-26T11:27:08.037806+0000","last_active":"2024-04-26T11:28:03.433058+0000","last_peered":"2024-04-26T11:28:03.433058+0000","last_clean":"2024-04-26T11:28:03.433058+0000","last_became_active":"2024-04-26T11:27:08.037309+0000","last_became_peered":"2024-04-26T11:27:08.037309+0000","last_unstale":"2024-04-26T11:28:03.433058+0000","last_undegraded":"2024-04-26T11:28:03.433058+0000","last_fullsized":"2024-04-26T11:28:03.433058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.910219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434737+0000","last_change":"2024-04-26T11:27:12.120986+0000","last_active":"2024-04-26T11:28:03.434737+0000","last_peered":"2024-04-26T11:28:03.434737+0000","last_clean":"2024-04-26T11:28:03.434737+0000","last_became_active":"2024-04-26T11:27:12.120580+0000","last_became_peered":"2024-04-26T11:27:12.120580+0000","last_unstale":"2024-04-26T11:28:03.434737+0000","last_undegraded":"2024-04-26T11:28:03.434737+0000","last_fullsized":"2024-04-26T11:28:03.434737+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:00.996039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":60,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:05.440943+0000","last_change":"2024-04-26T11:27:08.048979+0000","last_active":"2024-04-26T11:28:05.440943+0000","last_peered":"2024-04-26T11:28:05.440943+0000","last_clean":"2024-04-26T11:28:05.440943+0000","last_became_active":"2024-04-26T11:27:08.048641+0000","last_became_peered":"2024-04-26T11:27:08.048641+0000","last_unstale":"2024-04-26T11:28:05.440943+0000","last_undegraded":"2024-04-26T11:28:05.440943+0000","last_fullsized":"2024-04-26T11:28:05.440943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:38.917651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432818+0000","last_change":"2024-04-26T11:27:12.104749+0000","last_active":"2024-04-26T11:28:03.432818+0000","last_peered":"2024-04-26T11:28:03.432818+0000","last_clean":"2024-04-26T11:28:03.432818+0000","last_became_active":"2024-04-26T11:27:12.104358+0000","last_became_peered":"2024-04-26T11:27:12.104358+0000","last_unstale":"2024-04-26T11:28:03.432818+0000","last_undegraded":"2024-04-26T11:28:03.432818+0000","last_fullsized":"2024-04-26T11:28:03.432818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:47.364512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432810+0000","last_change":"2024-04-26T11:27:08.038165+0000","last_active":"2024-04-26T11:28:03.432810+0000","last_peered":"2024-04-26T11:28:03.432810+0000","last_clean":"2024-04-26T11:28:03.432810+0000","last_became_active":"2024-04-26T11:27:08.036930+0000","last_became_peered":"2024-04-26T11:27:08.036930+0000","last_unstale":"2024-04-26T11:28:03.432810+0000","last_undegraded":"2024-04-26T11:28:03.432810+0000","last_fullsized":"2024-04-26T11:28:03.432810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:10.050679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.441082+0000","last_change":"2024-04-26T11:27:12.098702+0000","last_active":"2024-04-26T11:28:03.441082+0000","last_peered":"2024-04-26T11:28:03.441082+0000","last_clean":"2024-04-26T11:28:03.441082+0000","last_became_active":"2024-04-26T11:27:12.089241+0000","last_became_peered":"2024-04-26T11:27:12.089241+0000","last_unstale":"2024-04-26T11:28:03.441082+0000","last_undegraded":"2024-04-26T11:28:03.441082+0000","last_fullsized":"2024-04-26T11:28:03.441082+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.013054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434255+0000","last_change":"2024-04-26T11:27:08.473759+0000","last_active":"2024-04-26T11:28:03.434255+0000","last_peered":"2024-04-26T11:28:03.434255+0000","last_clean":"2024-04-26T11:28:03.434255+0000","last_became_active":"2024-04-26T11:27:08.473288+0000","last_became_peered":"2024-04-26T11:27:08.473288+0000","last_unstale":"2024-04-26T11:28:03.434255+0000","last_undegraded":"2024-04-26T11:28:03.434255+0000","last_fullsized":"2024-04-26T11:28:03.434255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:36.727119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432945+0000","last_change":"2024-04-26T11:27:12.096935+0000","last_active":"2024-04-26T11:28:03.432945+0000","last_peered":"2024-04-26T11:28:03.432945+0000","last_clean":"2024-04-26T11:28:03.432945+0000","last_became_active":"2024-04-26T11:27:12.096481+0000","last_became_peered":"2024-04-26T11:27:12.096481+0000","last_unstale":"2024-04-26T11:28:03.432945+0000","last_undegraded":"2024-04-26T11:28:03.432945+0000","last_fullsized":"2024-04-26T11:28:03.432945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:58.855909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'30","reported_seq":127,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:06.439963+0000","last_change":"2024-04-26T11:27:08.037227+0000","last_active":"2024-04-26T11:28:06.439963+0000","last_peered":"2024-04-26T11:28:06.439963+0000","last_clean":"2024-04-26T11:28:06.439963+0000","last_became_active":"2024-04-26T11:27:08.036852+0000","last_became_peered":"2024-04-26T11:27:08.036852+0000","last_unstale":"2024-04-26T11:28:06.439963+0000","last_undegraded":"2024-04-26T11:28:06.439963+0000","last_fullsized":"2024-04-26T11:28:06.439963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:44.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61750,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":95,"num_write":31,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432077+0000","last_change":"2024-04-26T11:27:12.088586+0000","last_active":"2024-04-26T11:28:03.432077+0000","last_peered":"2024-04-26T11:28:03.432077+0000","last_clean":"2024-04-26T11:28:03.432077+0000","last_became_active":"2024-04-26T11:27:12.088264+0000","last_became_peered":"2024-04-26T11:27:12.088264+0000","last_unstale":"2024-04-26T11:28:03.432077+0000","last_undegraded":"2024-04-26T11:28:03.432077+0000","last_fullsized":"2024-04-26T11:28:03.432077+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:39.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.427928+0000","last_change":"2024-04-26T11:27:08.049289+0000","last_active":"2024-04-26T11:28:03.427928+0000","last_peered":"2024-04-26T11:28:03.427928+0000","last_clean":"2024-04-26T11:28:03.427928+0000","last_became_active":"2024-04-26T11:27:08.048923+0000","last_became_peered":"2024-04-26T11:27:08.048923+0000","last_unstale":"2024-04-26T11:28:03.427928+0000","last_undegraded":"2024-04-26T11:28:03.427928+0000","last_fullsized":"2024-04-26T11:28:03.427928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:42.229383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.446361+0000","last_change":"2024-04-26T11:27:12.118154+0000","last_active":"2024-04-26T11:28:03.446361+0000","last_peered":"2024-04-26T11:28:03.446361+0000","last_clean":"2024-04-26T11:28:03.446361+0000","last_became_active":"2024-04-26T11:27:12.117624+0000","last_became_peered":"2024-04-26T11:27:12.117624+0000","last_unstale":"2024-04-26T11:28:03.446361+0000","last_undegraded":"2024-04-26T11:28:03.446361+0000","last_fullsized":"2024-04-26T11:28:03.446361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:57.947310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432888+0000","last_change":"2024-04-26T11:27:08.045870+0000","last_active":"2024-04-26T11:28:03.432888+0000","last_peered":"2024-04-26T11:28:03.432888+0000","last_clean":"2024-04-26T11:28:03.432888+0000","last_became_active":"2024-04-26T11:27:08.045461+0000","last_became_peered":"2024-04-26T11:27:08.045461+0000","last_unstale":"2024-04-26T11:28:03.432888+0000","last_undegraded":"2024-04-26T11:28:03.432888+0000","last_fullsized":"2024-04-26T11:28:03.432888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:59.899805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433853+0000","last_change":"2024-04-26T11:27:12.116617+0000","last_active":"2024-04-26T11:28:03.433853+0000","last_peered":"2024-04-26T11:28:03.433853+0000","last_clean":"2024-04-26T11:28:03.433853+0000","last_became_active":"2024-04-26T11:27:12.115731+0000","last_became_peered":"2024-04-26T11:27:12.115731+0000","last_unstale":"2024-04-26T11:28:03.433853+0000","last_undegraded":"2024-04-26T11:28:03.433853+0000","last_fullsized":"2024-04-26T11:28:03.433853+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:42.680367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:05.695206+0000","last_change":"2024-04-26T11:27:08.036947+0000","last_active":"2024-04-26T11:28:05.695206+0000","last_peered":"2024-04-26T11:28:05.695206+0000","last_clean":"2024-04-26T11:28:05.695206+0000","last_became_active":"2024-04-26T11:27:08.036596+0000","last_became_peered":"2024-04-26T11:27:08.036596+0000","last_unstale":"2024-04-26T11:28:05.695206+0000","last_undegraded":"2024-04-26T11:28:05.695206+0000","last_fullsized":"2024-04-26T11:28:05.695206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:35.606069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432792+0000","last_change":"2024-04-26T11:27:12.086190+0000","last_active":"2024-04-26T11:28:03.432792+0000","last_peered":"2024-04-26T11:28:03.432792+0000","last_clean":"2024-04-26T11:28:03.432792+0000","last_became_active":"2024-04-26T11:27:12.085839+0000","last_became_peered":"2024-04-26T11:27:12.085839+0000","last_unstale":"2024-04-26T11:28:03.432792+0000","last_undegraded":"2024-04-26T11:28:03.432792+0000","last_fullsized":"2024-04-26T11:28:03.432792+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:31.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.459792+0000","last_change":"2024-04-26T11:28:03.459792+0000","last_active":"2024-04-26T11:28:03.459792+0000","last_peered":"2024-04-26T11:28:03.459792+0000","last_clean":"2024-04-26T11:28:03.459792+0000","last_became_active":"2024-04-26T11:28:03.444101+0000","last_became_peered":"2024-04-26T11:28:03.444101+0000","last_unstale":"2024-04-26T11:28:03.459792+0000","last_undegraded":"2024-04-26T11:28:03.459792+0000","last_fullsized":"2024-04-26T11:28:03.459792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:14.498792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433174+0000","last_change":"2024-04-26T11:27:12.093884+0000","last_active":"2024-04-26T11:28:03.433174+0000","last_peered":"2024-04-26T11:28:03.433174+0000","last_clean":"2024-04-26T11:28:03.433174+0000","last_became_active":"2024-04-26T11:27:12.093573+0000","last_became_peered":"2024-04-26T11:27:12.093573+0000","last_unstale":"2024-04-26T11:28:03.433174+0000","last_undegraded":"2024-04-26T11:28:03.433174+0000","last_fullsized":"2024-04-26T11:28:03.433174+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:32.144889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.431231+0000","last_change":"2024-04-26T11:27:08.035089+0000","last_active":"2024-04-26T11:28:03.431231+0000","last_peered":"2024-04-26T11:28:03.431231+0000","last_clean":"2024-04-26T11:28:03.431231+0000","last_became_active":"2024-04-26T11:27:08.034698+0000","last_became_peered":"2024-04-26T11:27:08.034698+0000","last_unstale":"2024-04-26T11:28:03.431231+0000","last_undegraded":"2024-04-26T11:28:03.431231+0000","last_fullsized":"2024-04-26T11:28:03.431231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:23.731307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429965+0000","last_change":"2024-04-26T11:27:12.097089+0000","last_active":"2024-04-26T11:28:03.429965+0000","last_peered":"2024-04-26T11:28:03.429965+0000","last_clean":"2024-04-26T11:28:03.429965+0000","last_became_active":"2024-04-26T11:27:12.096762+0000","last_became_peered":"2024-04-26T11:27:12.096762+0000","last_unstale":"2024-04-26T11:28:03.429965+0000","last_undegraded":"2024-04-26T11:28:03.429965+0000","last_fullsized":"2024-04-26T11:28:03.429965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.366450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439314+0000","last_change":"2024-04-26T11:27:08.475317+0000","last_active":"2024-04-26T11:28:03.439314+0000","last_peered":"2024-04-26T11:28:03.439314+0000","last_clean":"2024-04-26T11:28:03.439314+0000","last_became_active":"2024-04-26T11:27:08.474464+0000","last_became_peered":"2024-04-26T11:27:08.474464+0000","last_unstale":"2024-04-26T11:28:03.439314+0000","last_undegraded":"2024-04-26T11:28:03.439314+0000","last_fullsized":"2024-04-26T11:28:03.439314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798437+0000","last_change":"2024-04-26T11:27:12.107542+0000","last_active":"2024-04-26T11:28:03.798437+0000","last_peered":"2024-04-26T11:28:03.798437+0000","last_clean":"2024-04-26T11:28:03.798437+0000","last_became_active":"2024-04-26T11:27:12.107162+0000","last_became_peered":"2024-04-26T11:27:12.107162+0000","last_unstale":"2024-04-26T11:28:03.798437+0000","last_undegraded":"2024-04-26T11:28:03.798437+0000","last_fullsized":"2024-04-26T11:28:03.798437+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:55.470638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433547+0000","last_change":"2024-04-26T11:27:08.044101+0000","last_active":"2024-04-26T11:28:03.433547+0000","last_peered":"2024-04-26T11:28:03.433547+0000","last_clean":"2024-04-26T11:28:03.433547+0000","last_became_active":"2024-04-26T11:27:08.043733+0000","last_became_peered":"2024-04-26T11:27:08.043733+0000","last_unstale":"2024-04-26T11:28:03.433547+0000","last_undegraded":"2024-04-26T11:28:03.433547+0000","last_fullsized":"2024-04-26T11:28:03.433547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:03.023620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798349+0000","last_change":"2024-04-26T11:27:12.098713+0000","last_active":"2024-04-26T11:28:03.798349+0000","last_peered":"2024-04-26T11:28:03.798349+0000","last_clean":"2024-04-26T11:28:03.798349+0000","last_became_active":"2024-04-26T11:27:12.098275+0000","last_became_peered":"2024-04-26T11:27:12.098275+0000","last_unstale":"2024-04-26T11:28:03.798349+0000","last_undegraded":"2024-04-26T11:28:03.798349+0000","last_fullsized":"2024-04-26T11:28:03.798349+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:02.229321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433428+0000","last_change":"2024-04-26T11:27:12.093505+0000","last_active":"2024-04-26T11:28:03.433428+0000","last_peered":"2024-04-26T11:28:03.433428+0000","last_clean":"2024-04-26T11:28:03.433428+0000","last_became_active":"2024-04-26T11:27:12.093198+0000","last_became_peered":"2024-04-26T11:27:12.093198+0000","last_unstale":"2024-04-26T11:28:03.433428+0000","last_undegraded":"2024-04-26T11:28:03.433428+0000","last_fullsized":"2024-04-26T11:28:03.433428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:06.100747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:08.698613+0000","last_change":"2024-04-26T11:27:08.474897+0000","last_active":"2024-04-26T11:28:08.698613+0000","last_peered":"2024-04-26T11:28:08.698613+0000","last_clean":"2024-04-26T11:28:08.698613+0000","last_became_active":"2024-04-26T11:27:08.471735+0000","last_became_peered":"2024-04-26T11:27:08.471735+0000","last_unstale":"2024-04-26T11:28:08.698613+0000","last_undegraded":"2024-04-26T11:28:08.698613+0000","last_fullsized":"2024-04-26T11:28:08.698613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:42.066821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439688+0000","last_change":"2024-04-26T11:27:12.116722+0000","last_active":"2024-04-26T11:28:03.439688+0000","last_peered":"2024-04-26T11:28:03.439688+0000","last_clean":"2024-04-26T11:28:03.439688+0000","last_became_active":"2024-04-26T11:27:12.116239+0000","last_became_peered":"2024-04-26T11:27:12.116239+0000","last_unstale":"2024-04-26T11:28:03.439688+0000","last_undegraded":"2024-04-26T11:28:03.439688+0000","last_fullsized":"2024-04-26T11:28:03.439688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:04.962376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430022+0000","last_change":"2024-04-26T11:27:08.047087+0000","last_active":"2024-04-26T11:28:03.430022+0000","last_peered":"2024-04-26T11:28:03.430022+0000","last_clean":"2024-04-26T11:28:03.430022+0000","last_became_active":"2024-04-26T11:27:08.046754+0000","last_became_peered":"2024-04-26T11:27:08.046754+0000","last_unstale":"2024-04-26T11:28:03.430022+0000","last_undegraded":"2024-04-26T11:28:03.430022+0000","last_fullsized":"2024-04-26T11:28:03.430022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:30.481521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":361,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433072+0000","last_change":"2024-04-26T11:25:35.622816+0000","last_active":"2024-04-26T11:28:03.433072+0000","last_peered":"2024-04-26T11:28:03.433072+0000","last_clean":"2024-04-26T11:28:03.433072+0000","last_became_active":"2024-04-26T11:25:35.622329+0000","last_became_peered":"2024-04-26T11:25:35.622329+0000","last_unstale":"2024-04-26T11:28:03.433072+0000","last_undegraded":"2024-04-26T11:28:03.433072+0000","last_fullsized":"2024-04-26T11:28:03.433072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_clean_scrub_stamp":"2024-04-26T11:21:45.465157+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:40.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.445214+0000","last_change":"2024-04-26T11:27:12.098686+0000","last_active":"2024-04-26T11:28:03.445214+0000","last_peered":"2024-04-26T11:28:03.445214+0000","last_clean":"2024-04-26T11:28:03.445214+0000","last_became_active":"2024-04-26T11:27:12.098251+0000","last_became_peered":"2024-04-26T11:27:12.098251+0000","last_unstale":"2024-04-26T11:28:03.445214+0000","last_undegraded":"2024-04-26T11:28:03.445214+0000","last_fullsized":"2024-04-26T11:28:03.445214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:34.433203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433214+0000","last_change":"2024-04-26T11:27:08.036391+0000","last_active":"2024-04-26T11:28:03.433214+0000","last_peered":"2024-04-26T11:28:03.433214+0000","last_clean":"2024-04-26T11:28:03.433214+0000","last_became_active":"2024-04-26T11:27:08.036058+0000","last_became_peered":"2024-04-26T11:27:08.036058+0000","last_unstale":"2024-04-26T11:28:03.433214+0000","last_undegraded":"2024-04-26T11:28:03.433214+0000","last_fullsized":"2024-04-26T11:28:03.433214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:35.646501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432195+0000","last_change":"2024-04-26T11:27:08.472171+0000","last_active":"2024-04-26T11:28:03.432195+0000","last_peered":"2024-04-26T11:28:03.432195+0000","last_clean":"2024-04-26T11:28:03.432195+0000","last_became_active":"2024-04-26T11:27:08.471707+0000","last_became_peered":"2024-04-26T11:27:08.471707+0000","last_unstale":"2024-04-26T11:28:03.432195+0000","last_undegraded":"2024-04-26T11:28:03.432195+0000","last_fullsized":"2024-04-26T11:28:03.432195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:54.319448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.448133+0000","last_change":"2024-04-26T11:27:12.110757+0000","last_active":"2024-04-26T11:28:03.448133+0000","last_peered":"2024-04-26T11:28:03.448133+0000","last_clean":"2024-04-26T11:28:03.448133+0000","last_became_active":"2024-04-26T11:27:12.109048+0000","last_became_peered":"2024-04-26T11:27:12.109048+0000","last_unstale":"2024-04-26T11:28:03.448133+0000","last_undegraded":"2024-04-26T11:28:03.448133+0000","last_fullsized":"2024-04-26T11:28:03.448133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:05.203504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'12","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.443262+0000","last_change":"2024-04-26T11:27:08.051790+0000","last_active":"2024-04-26T11:28:03.443262+0000","last_peered":"2024-04-26T11:28:03.443262+0000","last_clean":"2024-04-26T11:28:03.443262+0000","last_became_active":"2024-04-26T11:27:08.051430+0000","last_became_peered":"2024-04-26T11:27:08.051430+0000","last_unstale":"2024-04-26T11:28:03.443262+0000","last_undegraded":"2024-04-26T11:28:03.443262+0000","last_fullsized":"2024-04-26T11:28:03.443262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:13.607944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434930+0000","last_change":"2024-04-26T11:27:12.116704+0000","last_active":"2024-04-26T11:28:03.434930+0000","last_peered":"2024-04-26T11:28:03.434930+0000","last_clean":"2024-04-26T11:28:03.434930+0000","last_became_active":"2024-04-26T11:27:12.111556+0000","last_became_peered":"2024-04-26T11:27:12.111556+0000","last_unstale":"2024-04-26T11:28:03.434930+0000","last_undegraded":"2024-04-26T11:28:03.434930+0000","last_fullsized":"2024-04-26T11:28:03.434930+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:36.535244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430174+0000","last_change":"2024-04-26T11:27:08.347851+0000","last_active":"2024-04-26T11:28:03.430174+0000","last_peered":"2024-04-26T11:28:03.430174+0000","last_clean":"2024-04-26T11:28:03.430174+0000","last_became_active":"2024-04-26T11:27:08.347460+0000","last_became_peered":"2024-04-26T11:27:08.347460+0000","last_unstale":"2024-04-26T11:28:03.430174+0000","last_undegraded":"2024-04-26T11:28:03.430174+0000","last_fullsized":"2024-04-26T11:28:03.430174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.017834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.441036+0000","last_change":"2024-04-26T11:27:12.105622+0000","last_active":"2024-04-26T11:28:03.441036+0000","last_peered":"2024-04-26T11:28:03.441036+0000","last_clean":"2024-04-26T11:28:03.441036+0000","last_became_active":"2024-04-26T11:27:12.105312+0000","last_became_peered":"2024-04-26T11:27:12.105312+0000","last_unstale":"2024-04-26T11:28:03.441036+0000","last_undegraded":"2024-04-26T11:28:03.441036+0000","last_fullsized":"2024-04-26T11:28:03.441036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:59.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432453+0000","last_change":"2024-04-26T11:27:08.472127+0000","last_active":"2024-04-26T11:28:03.432453+0000","last_peered":"2024-04-26T11:28:03.432453+0000","last_clean":"2024-04-26T11:28:03.432453+0000","last_became_active":"2024-04-26T11:27:08.471709+0000","last_became_peered":"2024-04-26T11:27:08.471709+0000","last_unstale":"2024-04-26T11:28:03.432453+0000","last_undegraded":"2024-04-26T11:28:03.432453+0000","last_fullsized":"2024-04-26T11:28:03.432453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:28.432710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429828+0000","last_change":"2024-04-26T11:27:12.085756+0000","last_active":"2024-04-26T11:28:03.429828+0000","last_peered":"2024-04-26T11:28:03.429828+0000","last_clean":"2024-04-26T11:28:03.429828+0000","last_became_active":"2024-04-26T11:27:12.085397+0000","last_became_peered":"2024-04-26T11:27:12.085397+0000","last_unstale":"2024-04-26T11:28:03.429828+0000","last_undegraded":"2024-04-26T11:28:03.429828+0000","last_fullsized":"2024-04-26T11:28:03.429828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:41.392010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.438514+0000","last_change":"2024-04-26T11:27:08.054831+0000","last_active":"2024-04-26T11:28:03.438514+0000","last_peered":"2024-04-26T11:28:03.438514+0000","last_clean":"2024-04-26T11:28:03.438514+0000","last_became_active":"2024-04-26T11:27:08.054352+0000","last_became_peered":"2024-04-26T11:27:08.054352+0000","last_unstale":"2024-04-26T11:28:03.438514+0000","last_undegraded":"2024-04-26T11:28:03.438514+0000","last_fullsized":"2024-04-26T11:28:03.438514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:53.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429811+0000","last_change":"2024-04-26T11:27:12.095789+0000","last_active":"2024-04-26T11:28:03.429811+0000","last_peered":"2024-04-26T11:28:03.429811+0000","last_clean":"2024-04-26T11:28:03.429811+0000","last_became_active":"2024-04-26T11:27:12.095468+0000","last_became_peered":"2024-04-26T11:27:12.095468+0000","last_unstale":"2024-04-26T11:28:03.429811+0000","last_undegraded":"2024-04-26T11:28:03.429811+0000","last_fullsized":"2024-04-26T11:28:03.429811+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:27.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.427663+0000","last_change":"2024-04-26T11:27:08.044923+0000","last_active":"2024-04-26T11:28:03.427663+0000","last_peered":"2024-04-26T11:28:03.427663+0000","last_clean":"2024-04-26T11:28:03.427663+0000","last_became_active":"2024-04-26T11:27:08.044516+0000","last_became_peered":"2024-04-26T11:27:08.044516+0000","last_unstale":"2024-04-26T11:28:03.427663+0000","last_undegraded":"2024-04-26T11:28:03.427663+0000","last_fullsized":"2024-04-26T11:28:03.427663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:21.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439732+0000","last_change":"2024-04-26T11:27:12.114311+0000","last_active":"2024-04-26T11:28:03.439732+0000","last_peered":"2024-04-26T11:28:03.439732+0000","last_clean":"2024-04-26T11:28:03.439732+0000","last_became_active":"2024-04-26T11:27:12.113538+0000","last_became_peered":"2024-04-26T11:27:12.113538+0000","last_unstale":"2024-04-26T11:28:03.439732+0000","last_undegraded":"2024-04-26T11:28:03.439732+0000","last_fullsized":"2024-04-26T11:28:03.439732+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:55.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430587+0000","last_change":"2024-04-26T11:27:08.036983+0000","last_active":"2024-04-26T11:28:03.430587+0000","last_peered":"2024-04-26T11:28:03.430587+0000","last_clean":"2024-04-26T11:28:03.430587+0000","last_became_active":"2024-04-26T11:27:08.036632+0000","last_became_peered":"2024-04-26T11:27:08.036632+0000","last_unstale":"2024-04-26T11:28:03.430587+0000","last_undegraded":"2024-04-26T11:28:03.430587+0000","last_fullsized":"2024-04-26T11:28:03.430587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:31.731466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433694+0000","last_change":"2024-04-26T11:27:12.102922+0000","last_active":"2024-04-26T11:28:03.433694+0000","last_peered":"2024-04-26T11:28:03.433694+0000","last_clean":"2024-04-26T11:28:03.433694+0000","last_became_active":"2024-04-26T11:27:12.102594+0000","last_became_peered":"2024-04-26T11:27:12.102594+0000","last_unstale":"2024-04-26T11:28:03.433694+0000","last_undegraded":"2024-04-26T11:28:03.433694+0000","last_fullsized":"2024-04-26T11:28:03.433694+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:47.223435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.428111+0000","last_change":"2024-04-26T11:27:08.473262+0000","last_active":"2024-04-26T11:28:03.428111+0000","last_peered":"2024-04-26T11:28:03.428111+0000","last_clean":"2024-04-26T11:28:03.428111+0000","last_became_active":"2024-04-26T11:27:08.472744+0000","last_became_peered":"2024-04-26T11:27:08.472744+0000","last_unstale":"2024-04-26T11:28:03.428111+0000","last_undegraded":"2024-04-26T11:28:03.428111+0000","last_fullsized":"2024-04-26T11:28:03.428111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:16.766438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433441+0000","last_change":"2024-04-26T11:27:12.091754+0000","last_active":"2024-04-26T11:28:03.433441+0000","last_peered":"2024-04-26T11:28:03.433441+0000","last_clean":"2024-04-26T11:28:03.433441+0000","last_became_active":"2024-04-26T11:27:12.091282+0000","last_became_peered":"2024-04-26T11:27:12.091282+0000","last_unstale":"2024-04-26T11:28:03.433441+0000","last_undegraded":"2024-04-26T11:28:03.433441+0000","last_fullsized":"2024-04-26T11:28:03.433441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:07.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433560+0000","last_change":"2024-04-26T11:27:08.048352+0000","last_active":"2024-04-26T11:28:03.433560+0000","last_peered":"2024-04-26T11:28:03.433560+0000","last_clean":"2024-04-26T11:28:03.433560+0000","last_became_active":"2024-04-26T11:27:08.048056+0000","last_became_peered":"2024-04-26T11:27:08.048056+0000","last_unstale":"2024-04-26T11:28:03.433560+0000","last_undegraded":"2024-04-26T11:28:03.433560+0000","last_fullsized":"2024-04-26T11:28:03.433560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:35.363779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432977+0000","last_change":"2024-04-26T11:27:12.108244+0000","last_active":"2024-04-26T11:28:03.432977+0000","last_peered":"2024-04-26T11:28:03.432977+0000","last_clean":"2024-04-26T11:28:03.432977+0000","last_became_active":"2024-04-26T11:27:12.107592+0000","last_became_peered":"2024-04-26T11:27:12.107592+0000","last_unstale":"2024-04-26T11:28:03.432977+0000","last_undegraded":"2024-04-26T11:28:03.432977+0000","last_fullsized":"2024-04-26T11:28:03.432977+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:55.985873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.462136+0000","last_change":"2024-04-26T11:28:03.462136+0000","last_active":"2024-04-26T11:28:03.462136+0000","last_peered":"2024-04-26T11:28:03.462136+0000","last_clean":"2024-04-26T11:28:03.462136+0000","last_became_active":"2024-04-26T11:28:03.449130+0000","last_became_peered":"2024-04-26T11:28:03.449130+0000","last_unstale":"2024-04-26T11:28:03.462136+0000","last_undegraded":"2024-04-26T11:28:03.462136+0000","last_fullsized":"2024-04-26T11:28:03.462136+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:33.181328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433827+0000","last_change":"2024-04-26T11:27:12.090627+0000","last_active":"2024-04-26T11:28:03.433827+0000","last_peered":"2024-04-26T11:28:03.433827+0000","last_clean":"2024-04-26T11:28:03.433827+0000","last_became_active":"2024-04-26T11:27:12.089981+0000","last_became_peered":"2024-04-26T11:27:12.089981+0000","last_unstale":"2024-04-26T11:28:03.433827+0000","last_undegraded":"2024-04-26T11:28:03.433827+0000","last_fullsized":"2024-04-26T11:28:03.433827+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429957+0000","last_change":"2024-04-26T11:27:12.089335+0000","last_active":"2024-04-26T11:28:03.429957+0000","last_peered":"2024-04-26T11:28:03.429957+0000","last_clean":"2024-04-26T11:28:03.429957+0000","last_became_active":"2024-04-26T11:27:12.089019+0000","last_became_peered":"2024-04-26T11:27:12.089019+0000","last_unstale":"2024-04-26T11:28:03.429957+0000","last_undegraded":"2024-04-26T11:28:03.429957+0000","last_fullsized":"2024-04-26T11:28:03.429957+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:18.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.435483+0000","last_change":"2024-04-26T11:28:03.435483+0000","last_active":"2024-04-26T11:28:03.435483+0000","last_peered":"2024-04-26T11:28:03.435483+0000","last_clean":"2024-04-26T11:28:03.435483+0000","last_became_active":"2024-04-26T11:28:03.435088+0000","last_became_peered":"2024-04-26T11:28:03.435088+0000","last_unstale":"2024-04-26T11:28:03.435483+0000","last_undegraded":"2024-04-26T11:28:03.435483+0000","last_fullsized":"2024-04-26T11:28:03.435483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.453906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.427816+0000","last_change":"2024-04-26T11:27:12.112344+0000","last_active":"2024-04-26T11:28:03.427816+0000","last_peered":"2024-04-26T11:28:03.427816+0000","last_clean":"2024-04-26T11:28:03.427816+0000","last_became_active":"2024-04-26T11:27:12.112083+0000","last_became_peered":"2024-04-26T11:27:12.112083+0000","last_unstale":"2024-04-26T11:28:03.427816+0000","last_undegraded":"2024-04-26T11:28:03.427816+0000","last_fullsized":"2024-04-26T11:28:03.427816+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.440337+0000","last_change":"2024-04-26T11:27:12.115707+0000","last_active":"2024-04-26T11:28:03.440337+0000","last_peered":"2024-04-26T11:28:03.440337+0000","last_clean":"2024-04-26T11:28:03.440337+0000","last_became_active":"2024-04-26T11:27:12.115192+0000","last_became_peered":"2024-04-26T11:27:12.115192+0000","last_unstale":"2024-04-26T11:28:03.440337+0000","last_undegraded":"2024-04-26T11:28:03.440337+0000","last_fullsized":"2024-04-26T11:28:03.440337+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:55.475825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.448000+0000","last_change":"2024-04-26T11:27:12.108771+0000","last_active":"2024-04-26T11:28:03.448000+0000","last_peered":"2024-04-26T11:28:03.448000+0000","last_clean":"2024-04-26T11:28:03.448000+0000","last_became_active":"2024-04-26T11:27:12.102910+0000","last_became_peered":"2024-04-26T11:27:12.102910+0000","last_unstale":"2024-04-26T11:28:03.448000+0000","last_undegraded":"2024-04-26T11:28:03.448000+0000","last_fullsized":"2024-04-26T11:28:03.448000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:23.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429839+0000","last_change":"2024-04-26T11:27:12.091226+0000","last_active":"2024-04-26T11:28:03.429839+0000","last_peered":"2024-04-26T11:28:03.429839+0000","last_clean":"2024-04-26T11:28:03.429839+0000","last_became_active":"2024-04-26T11:27:12.090926+0000","last_became_peered":"2024-04-26T11:27:12.090926+0000","last_unstale":"2024-04-26T11:28:03.429839+0000","last_undegraded":"2024-04-26T11:28:03.429839+0000","last_fullsized":"2024-04-26T11:28:03.429839+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:43.005527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.428113+0000","last_change":"2024-04-26T11:27:12.091297+0000","last_active":"2024-04-26T11:28:03.428113+0000","last_peered":"2024-04-26T11:28:03.428113+0000","last_clean":"2024-04-26T11:28:03.428113+0000","last_became_active":"2024-04-26T11:27:12.090946+0000","last_became_peered":"2024-04-26T11:27:12.090946+0000","last_unstale":"2024-04-26T11:28:03.428113+0000","last_undegraded":"2024-04-26T11:28:03.428113+0000","last_fullsized":"2024-04-26T11:28:03.428113+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:06.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.445596+0000","last_change":"2024-04-26T11:28:03.445596+0000","last_active":"2024-04-26T11:28:03.445596+0000","last_peered":"2024-04-26T11:28:03.445596+0000","last_clean":"2024-04-26T11:28:03.445596+0000","last_became_active":"2024-04-26T11:28:03.443717+0000","last_became_peered":"2024-04-26T11:28:03.443717+0000","last_unstale":"2024-04-26T11:28:03.445596+0000","last_undegraded":"2024-04-26T11:28:03.445596+0000","last_fullsized":"2024-04-26T11:28:03.445596+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:44.905902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433161+0000","last_change":"2024-04-26T11:27:12.107987+0000","last_active":"2024-04-26T11:28:03.433161+0000","last_peered":"2024-04-26T11:28:03.433161+0000","last_clean":"2024-04-26T11:28:03.433161+0000","last_became_active":"2024-04-26T11:27:12.107668+0000","last_became_peered":"2024-04-26T11:27:12.107668+0000","last_unstale":"2024-04-26T11:28:03.433161+0000","last_undegraded":"2024-04-26T11:28:03.433161+0000","last_fullsized":"2024-04-26T11:28:03.433161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:06.448570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.438293+0000","last_change":"2024-04-26T11:27:12.105596+0000","last_active":"2024-04-26T11:28:03.438293+0000","last_peered":"2024-04-26T11:28:03.438293+0000","last_clean":"2024-04-26T11:28:03.438293+0000","last_became_active":"2024-04-26T11:27:12.104996+0000","last_became_peered":"2024-04-26T11:27:12.104996+0000","last_unstale":"2024-04-26T11:28:03.438293+0000","last_undegraded":"2024-04-26T11:28:03.438293+0000","last_fullsized":"2024-04-26T11:28:03.438293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:11.947364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433164+0000","last_change":"2024-04-26T11:27:12.116095+0000","last_active":"2024-04-26T11:28:03.433164+0000","last_peered":"2024-04-26T11:28:03.433164+0000","last_clean":"2024-04-26T11:28:03.433164+0000","last_became_active":"2024-04-26T11:27:12.115726+0000","last_became_peered":"2024-04-26T11:27:12.115726+0000","last_unstale":"2024-04-26T11:28:03.433164+0000","last_undegraded":"2024-04-26T11:28:03.433164+0000","last_fullsized":"2024-04-26T11:28:03.433164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:45.056829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.448955+0000","last_change":"2024-04-26T11:27:12.115016+0000","last_active":"2024-04-26T11:28:03.448955+0000","last_peered":"2024-04-26T11:28:03.448955+0000","last_clean":"2024-04-26T11:28:03.448955+0000","last_became_active":"2024-04-26T11:27:12.114671+0000","last_became_peered":"2024-04-26T11:27:12.114671+0000","last_unstale":"2024-04-26T11:28:03.448955+0000","last_undegraded":"2024-04-26T11:28:03.448955+0000","last_fullsized":"2024-04-26T11:28:03.448955+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:11.393056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430213+0000","last_change":"2024-04-26T11:27:12.097130+0000","last_active":"2024-04-26T11:28:03.430213+0000","last_peered":"2024-04-26T11:28:03.430213+0000","last_clean":"2024-04-26T11:28:03.430213+0000","last_became_active":"2024-04-26T11:27:12.096809+0000","last_became_peered":"2024-04-26T11:27:12.096809+0000","last_unstale":"2024-04-26T11:28:03.430213+0000","last_undegraded":"2024-04-26T11:28:03.430213+0000","last_fullsized":"2024-04-26T11:28:03.430213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:31.198452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":213698,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65751,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":191,"num_read_kb":178,"num_write":166,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1316,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351003,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":483736,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612640,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32288,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712864,"statfs":{"total":95995035648,"available":95961972736,"internally_reserved":0,"allocated":1138688,"data_stored":1136736,"data_compressed":41934,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776166,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1003520,"data_stored":483350,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037804,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":482688,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":1075200,"data_compressed":41934,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462969,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":482739,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":544864,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":484010,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":545520,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1007616,"data_stored":483050,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888132,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":483679,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724606,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":1073871,"data_compressed":41934,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34523,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34523,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:28:12.054 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T11:28:12.501 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:12.860 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:12 smithi110 ceph-mon[28069]: from='client.24646 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:28:12.860 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:28:12.860 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:28:12.860 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:12 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:12 smithi193 ceph-mon[32782]: from='client.24646 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:28:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:28:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:28:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:12 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:12 smithi196 ceph-mon[32572]: from='client.24646 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:28:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:28:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:28:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:12 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:28:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:13 smithi193 ceph-mon[32782]: pgmap v356: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 6 op/s; 131 B/s, 0 keys/s, 1 objects/s recovering 2024-04-26T11:28:13.925 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:13 smithi110 ceph-mon[28069]: pgmap v356: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 6 op/s; 131 B/s, 0 keys/s, 1 objects/s recovering 2024-04-26T11:28:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:13 smithi196 ceph-mon[32572]: pgmap v356: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 6 op/s; 131 B/s, 0 keys/s, 1 objects/s recovering 2024-04-26T11:28:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.769+0000 7fb820c00700 1 -- 172.21.15.110:0/2068887533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb81c078270 msgr2=0x7fb81c113c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.769+0000 7fb820c00700 1 --2- 172.21.15.110:0/2068887533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb81c078270 0x7fb81c113c90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb804009990 tx=0x7fb804009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.769+0000 7fb820c00700 1 -- 172.21.15.110:0/2068887533 shutdown_connections 2024-04-26T11:28:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.769+0000 7fb820c00700 1 --2- 172.21.15.110:0/2068887533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb81c1141d0 0x7fb81c1165c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.769+0000 7fb820c00700 1 --2- 172.21.15.110:0/2068887533 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb81c077950 0x7fb81c077d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:14.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.769+0000 7fb820c00700 1 --2- 172.21.15.110:0/2068887533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb81c078270 0x7fb81c113c90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.769+0000 7fb820c00700 1 -- 172.21.15.110:0/2068887533 >> 172.21.15.110:0/2068887533 conn(0x7fb81c101060 msgr2=0x7fb81c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.770+0000 7fb820c00700 1 -- 172.21.15.110:0/2068887533 shutdown_connections 2024-04-26T11:28:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.770+0000 7fb820c00700 1 -- 172.21.15.110:0/2068887533 wait complete. 2024-04-26T11:28:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.771+0000 7fb820c00700 1 Processor -- start 2024-04-26T11:28:14.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.771+0000 7fb820c00700 1 -- start start 2024-04-26T11:28:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.771+0000 7fb820c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb81c077950 0x7fb81c1a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.771+0000 7fb820c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb81c078270 0x7fb81c1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.771+0000 7fb820c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb81c1141d0 0x7fb81c1a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:14.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.771+0000 7fb820c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c119b70 con 0x7fb81c1141d0 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.771+0000 7fb820c00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1199f0 con 0x7fb81c077950 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.771+0000 7fb820c00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c119cf0 con 0x7fb81c078270 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb81b400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb81c077950 0x7fb81c1a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb813e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb81c078270 0x7fb81c1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb81b400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb81c077950 0x7fb81c1a00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:44778/0 (socket says 172.21.15.110:44778) 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb81b400700 1 -- 172.21.15.110:0/3106424861 learned_addr learned my addr 172.21.15.110:0/3106424861 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb81be00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb81c1141d0 0x7fb81c1a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb813e00700 1 -- 172.21.15.110:0/3106424861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb81c077950 msgr2=0x7fb81c1a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb813e00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb81c077950 0x7fb81c1a00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb813e00700 1 -- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb81c1141d0 msgr2=0x7fb81c1a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb813e00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb81c1141d0 0x7fb81c1a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb813e00700 1 -- 172.21.15.110:0/3106424861 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c1a50a0 con 0x7fb81c078270 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb81b400700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb81c077950 0x7fb81c1a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:14.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.772+0000 7fb813e00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb81c078270 0x7fb81c1a0620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb804006010 tx=0x7fb8040057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:14.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.773+0000 7fb818c00700 1 -- 172.21.15.110:0/3106424861 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804027070 con 0x7fb81c078270 2024-04-26T11:28:14.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.773+0000 7fb818c00700 1 -- 172.21.15.110:0/3106424861 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb804022470 con 0x7fb81c078270 2024-04-26T11:28:14.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.773+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c1a5330 con 0x7fb81c078270 2024-04-26T11:28:14.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.773+0000 7fb818c00700 1 -- 172.21.15.110:0/3106424861 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804017650 con 0x7fb81c078270 2024-04-26T11:28:14.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.773+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c1acc10 con 0x7fb81c078270 2024-04-26T11:28:14.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.774+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c079090 con 0x7fb81c078270 2024-04-26T11:28:14.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.776+0000 7fb818c00700 1 -- 172.21.15.110:0/3106424861 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb80402a070 con 0x7fb81c078270 2024-04-26T11:28:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.777+0000 7fb818c00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb8000a3cd0 0x7fb8000a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.778+0000 7fb818c00700 1 -- 172.21.15.110:0/3106424861 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7fb8040d1330 con 0x7fb81c078270 2024-04-26T11:28:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.778+0000 7fb81b400700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb8000a3cd0 0x7fb8000a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:14.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.778+0000 7fb81b400700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb8000a3cd0 0x7fb8000a6190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0104e0 tx=0x7fb80c007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:14.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:14.780+0000 7fb818c00700 1 -- 172.21.15.110:0/3106424861 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb804013070 con 0x7fb81c078270 2024-04-26T11:28:15.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.003+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb81c1a13f0 con 0x7fb8000a3cd0 2024-04-26T11:28:15.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.012+0000 7fb818c00700 1 -- 172.21.15.110:0/3106424861 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258955 (secure 0 0 0) 0x7fb81c1a13f0 con 0x7fb8000a3cd0 2024-04-26T11:28:15.019 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:28:15.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.017+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb8000a3cd0 msgr2=0x7fb8000a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:15.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.017+0000 7fb820c00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb8000a3cd0 0x7fb8000a6190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0104e0 tx=0x7fb80c007480 comp rx=0 tx=0).stop 2024-04-26T11:28:15.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.017+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb81c078270 msgr2=0x7fb81c1a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:15.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.017+0000 7fb820c00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb81c078270 0x7fb81c1a0620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb804006010 tx=0x7fb8040057c0 comp rx=0 tx=0).stop 2024-04-26T11:28:15.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.018+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 shutdown_connections 2024-04-26T11:28:15.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.018+0000 7fb820c00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb81c1141d0 0x7fb81c1a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:15.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.018+0000 7fb820c00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb81c077950 0x7fb81c1a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:15.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.018+0000 7fb820c00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb8000a3cd0 0x7fb8000a6190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:15.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.018+0000 7fb820c00700 1 --2- 172.21.15.110:0/3106424861 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb81c078270 0x7fb81c1a0620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:15.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.018+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 >> 172.21.15.110:0/3106424861 conn(0x7fb81c101060 msgr2=0x7fb81c103450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:15.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.018+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 shutdown_connections 2024-04-26T11:28:15.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:15.018+0000 7fb820c00700 1 -- 172.21.15.110:0/3106424861 wait complete. 2024-04-26T11:28:15.022 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-26T11:28:15.820 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:15 smithi110 ceph-mon[28069]: pgmap v357: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 462 B/s wr, 5 op/s; 118 B/s, 0 keys/s, 1 objects/s recovering 2024-04-26T11:28:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:15 smithi193 ceph-mon[32782]: pgmap v357: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 462 B/s wr, 5 op/s; 118 B/s, 0 keys/s, 1 objects/s recovering 2024-04-26T11:28:15.889 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-04-26T11:28:14.494215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656353,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":352,"num_read_kb":307,"num_write":349,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1182052,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":280,"ondisk_log_size":280,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369628,"kb_used_data":12096,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572196,"statfs":{"total":1151940427776,"available":1151561928704,"internally_reserved":0,"allocated":12386304,"data_stored":7759443,"data_compressed":177741,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4257,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":40,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1316,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.062973"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430389+0000","last_change":"2024-04-26T11:27:12.099635+0000","last_active":"2024-04-26T11:28:03.430389+0000","last_peered":"2024-04-26T11:28:03.430389+0000","last_clean":"2024-04-26T11:28:03.430389+0000","last_became_active":"2024-04-26T11:27:12.099342+0000","last_became_peered":"2024-04-26T11:27:12.099342+0000","last_unstale":"2024-04-26T11:28:03.430389+0000","last_undegraded":"2024-04-26T11:28:03.430389+0000","last_fullsized":"2024-04-26T11:28:03.430389+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:36.433968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.440898+0000","last_change":"2024-04-26T11:27:12.090804+0000","last_active":"2024-04-26T11:28:03.440898+0000","last_peered":"2024-04-26T11:28:03.440898+0000","last_clean":"2024-04-26T11:28:03.440898+0000","last_became_active":"2024-04-26T11:27:12.089662+0000","last_became_peered":"2024-04-26T11:27:12.089662+0000","last_unstale":"2024-04-26T11:28:03.440898+0000","last_undegraded":"2024-04-26T11:28:03.440898+0000","last_fullsized":"2024-04-26T11:28:03.440898+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.776482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.440532+0000","last_change":"2024-04-26T11:27:12.094739+0000","last_active":"2024-04-26T11:28:03.440532+0000","last_peered":"2024-04-26T11:28:03.440532+0000","last_clean":"2024-04-26T11:28:03.440532+0000","last_became_active":"2024-04-26T11:27:12.094410+0000","last_became_peered":"2024-04-26T11:27:12.094410+0000","last_unstale":"2024-04-26T11:28:03.440532+0000","last_undegraded":"2024-04-26T11:28:03.440532+0000","last_fullsized":"2024-04-26T11:28:03.440532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:17.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.449549+0000","last_change":"2024-04-26T11:28:03.446873+0000","last_active":"2024-04-26T11:28:03.449549+0000","last_peered":"2024-04-26T11:28:03.449549+0000","last_clean":"2024-04-26T11:28:03.449549+0000","last_became_active":"2024-04-26T11:28:03.445335+0000","last_became_peered":"2024-04-26T11:28:03.445335+0000","last_unstale":"2024-04-26T11:28:03.449549+0000","last_undegraded":"2024-04-26T11:28:03.449549+0000","last_fullsized":"2024-04-26T11:28:03.449549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:59.892678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430808+0000","last_change":"2024-04-26T11:27:12.114071+0000","last_active":"2024-04-26T11:28:03.430808+0000","last_peered":"2024-04-26T11:28:03.430808+0000","last_clean":"2024-04-26T11:28:03.430808+0000","last_became_active":"2024-04-26T11:27:12.113795+0000","last_became_peered":"2024-04-26T11:27:12.113795+0000","last_unstale":"2024-04-26T11:28:03.430808+0000","last_undegraded":"2024-04-26T11:28:03.430808+0000","last_fullsized":"2024-04-26T11:28:03.430808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:34.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798340+0000","last_change":"2024-04-26T11:27:12.108449+0000","last_active":"2024-04-26T11:28:03.798340+0000","last_peered":"2024-04-26T11:28:03.798340+0000","last_clean":"2024-04-26T11:28:03.798340+0000","last_became_active":"2024-04-26T11:27:12.108071+0000","last_became_peered":"2024-04-26T11:27:12.108071+0000","last_unstale":"2024-04-26T11:28:03.798340+0000","last_undegraded":"2024-04-26T11:28:03.798340+0000","last_fullsized":"2024-04-26T11:28:03.798340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:04.001728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433970+0000","last_change":"2024-04-26T11:27:12.099363+0000","last_active":"2024-04-26T11:28:03.433970+0000","last_peered":"2024-04-26T11:28:03.433970+0000","last_clean":"2024-04-26T11:28:03.433970+0000","last_became_active":"2024-04-26T11:27:12.098982+0000","last_became_peered":"2024-04-26T11:27:12.098982+0000","last_unstale":"2024-04-26T11:28:03.433970+0000","last_undegraded":"2024-04-26T11:28:03.433970+0000","last_fullsized":"2024-04-26T11:28:03.433970+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:48.825504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439560+0000","last_change":"2024-04-26T11:27:12.111215+0000","last_active":"2024-04-26T11:28:03.439560+0000","last_peered":"2024-04-26T11:28:03.439560+0000","last_clean":"2024-04-26T11:28:03.439560+0000","last_became_active":"2024-04-26T11:27:12.110896+0000","last_became_peered":"2024-04-26T11:27:12.110896+0000","last_unstale":"2024-04-26T11:28:03.439560+0000","last_undegraded":"2024-04-26T11:28:03.439560+0000","last_fullsized":"2024-04-26T11:28:03.439560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:17.469534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433252+0000","last_change":"2024-04-26T11:27:12.091871+0000","last_active":"2024-04-26T11:28:03.433252+0000","last_peered":"2024-04-26T11:28:03.433252+0000","last_clean":"2024-04-26T11:28:03.433252+0000","last_became_active":"2024-04-26T11:27:12.091239+0000","last_became_peered":"2024-04-26T11:27:12.091239+0000","last_unstale":"2024-04-26T11:28:03.433252+0000","last_undegraded":"2024-04-26T11:28:03.433252+0000","last_fullsized":"2024-04-26T11:28:03.433252+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:30.526152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798687+0000","last_change":"2024-04-26T11:27:12.093411+0000","last_active":"2024-04-26T11:28:03.798687+0000","last_peered":"2024-04-26T11:28:03.798687+0000","last_clean":"2024-04-26T11:28:03.798687+0000","last_became_active":"2024-04-26T11:27:12.093086+0000","last_became_peered":"2024-04-26T11:27:12.093086+0000","last_unstale":"2024-04-26T11:28:03.798687+0000","last_undegraded":"2024-04-26T11:28:03.798687+0000","last_fullsized":"2024-04-26T11:28:03.798687+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:56.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433069+0000","last_change":"2024-04-26T11:27:12.093317+0000","last_active":"2024-04-26T11:28:03.433069+0000","last_peered":"2024-04-26T11:28:03.433069+0000","last_clean":"2024-04-26T11:28:03.433069+0000","last_became_active":"2024-04-26T11:27:12.092595+0000","last_became_peered":"2024-04-26T11:27:12.092595+0000","last_unstale":"2024-04-26T11:28:03.433069+0000","last_undegraded":"2024-04-26T11:28:03.433069+0000","last_fullsized":"2024-04-26T11:28:03.433069+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.702218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430347+0000","last_change":"2024-04-26T11:27:12.093118+0000","last_active":"2024-04-26T11:28:03.430347+0000","last_peered":"2024-04-26T11:28:03.430347+0000","last_clean":"2024-04-26T11:28:03.430347+0000","last_became_active":"2024-04-26T11:27:12.091482+0000","last_became_peered":"2024-04-26T11:27:12.091482+0000","last_unstale":"2024-04-26T11:28:03.430347+0000","last_undegraded":"2024-04-26T11:28:03.430347+0000","last_fullsized":"2024-04-26T11:28:03.430347+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.426213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.448839+0000","last_change":"2024-04-26T11:27:12.114213+0000","last_active":"2024-04-26T11:28:03.448839+0000","last_peered":"2024-04-26T11:28:03.448839+0000","last_clean":"2024-04-26T11:28:03.448839+0000","last_became_active":"2024-04-26T11:27:12.113867+0000","last_became_peered":"2024-04-26T11:27:12.113867+0000","last_unstale":"2024-04-26T11:28:03.448839+0000","last_undegraded":"2024-04-26T11:28:03.448839+0000","last_fullsized":"2024-04-26T11:28:03.448839+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:59.258645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.442920+0000","last_change":"2024-04-26T11:27:12.084301+0000","last_active":"2024-04-26T11:28:03.442920+0000","last_peered":"2024-04-26T11:28:03.442920+0000","last_clean":"2024-04-26T11:28:03.442920+0000","last_became_active":"2024-04-26T11:27:12.083808+0000","last_became_peered":"2024-04-26T11:27:12.083808+0000","last_unstale":"2024-04-26T11:28:03.442920+0000","last_undegraded":"2024-04-26T11:28:03.442920+0000","last_fullsized":"2024-04-26T11:28:03.442920+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:46.107583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439062+0000","last_change":"2024-04-26T11:27:12.089647+0000","last_active":"2024-04-26T11:28:03.439062+0000","last_peered":"2024-04-26T11:28:03.439062+0000","last_clean":"2024-04-26T11:28:03.439062+0000","last_became_active":"2024-04-26T11:27:12.088081+0000","last_became_peered":"2024-04-26T11:27:12.088081+0000","last_unstale":"2024-04-26T11:28:03.439062+0000","last_undegraded":"2024-04-26T11:28:03.439062+0000","last_fullsized":"2024-04-26T11:28:03.439062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:43.423430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432401+0000","last_change":"2024-04-26T11:27:12.098138+0000","last_active":"2024-04-26T11:28:03.432401+0000","last_peered":"2024-04-26T11:28:03.432401+0000","last_clean":"2024-04-26T11:28:03.432401+0000","last_became_active":"2024-04-26T11:27:12.097756+0000","last_became_peered":"2024-04-26T11:27:12.097756+0000","last_unstale":"2024-04-26T11:28:03.432401+0000","last_undegraded":"2024-04-26T11:28:03.432401+0000","last_fullsized":"2024-04-26T11:28:03.432401+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:21.155370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430506+0000","last_change":"2024-04-26T11:27:12.099925+0000","last_active":"2024-04-26T11:28:03.430506+0000","last_peered":"2024-04-26T11:28:03.430506+0000","last_clean":"2024-04-26T11:28:03.430506+0000","last_became_active":"2024-04-26T11:27:12.099600+0000","last_became_peered":"2024-04-26T11:27:12.099600+0000","last_unstale":"2024-04-26T11:28:03.430506+0000","last_undegraded":"2024-04-26T11:28:03.430506+0000","last_fullsized":"2024-04-26T11:28:03.430506+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:23.704624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.443087+0000","last_change":"2024-04-26T11:27:12.104697+0000","last_active":"2024-04-26T11:28:03.443087+0000","last_peered":"2024-04-26T11:28:03.443087+0000","last_clean":"2024-04-26T11:28:03.443087+0000","last_became_active":"2024-04-26T11:27:12.103963+0000","last_became_peered":"2024-04-26T11:27:12.103963+0000","last_unstale":"2024-04-26T11:28:03.443087+0000","last_undegraded":"2024-04-26T11:28:03.443087+0000","last_fullsized":"2024-04-26T11:28:03.443087+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:58.202895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.428174+0000","last_change":"2024-04-26T11:27:12.109216+0000","last_active":"2024-04-26T11:28:03.428174+0000","last_peered":"2024-04-26T11:28:03.428174+0000","last_clean":"2024-04-26T11:28:03.428174+0000","last_became_active":"2024-04-26T11:27:12.108891+0000","last_became_peered":"2024-04-26T11:27:12.108891+0000","last_unstale":"2024-04-26T11:28:03.428174+0000","last_undegraded":"2024-04-26T11:28:03.428174+0000","last_fullsized":"2024-04-26T11:28:03.428174+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:53.741077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.456017+0000","last_change":"2024-04-26T11:28:03.456017+0000","last_active":"2024-04-26T11:28:03.456017+0000","last_peered":"2024-04-26T11:28:03.456017+0000","last_clean":"2024-04-26T11:28:03.456017+0000","last_became_active":"2024-04-26T11:28:03.447016+0000","last_became_peered":"2024-04-26T11:28:03.447016+0000","last_unstale":"2024-04-26T11:28:03.456017+0000","last_undegraded":"2024-04-26T11:28:03.456017+0000","last_fullsized":"2024-04-26T11:28:03.456017+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.616546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434876+0000","last_change":"2024-04-26T11:27:12.112635+0000","last_active":"2024-04-26T11:28:03.434876+0000","last_peered":"2024-04-26T11:28:03.434876+0000","last_clean":"2024-04-26T11:28:03.434876+0000","last_became_active":"2024-04-26T11:27:12.112282+0000","last_became_peered":"2024-04-26T11:27:12.112282+0000","last_unstale":"2024-04-26T11:28:03.434876+0000","last_undegraded":"2024-04-26T11:28:03.434876+0000","last_fullsized":"2024-04-26T11:28:03.434876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:21.482922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.435946+0000","last_change":"2024-04-26T11:27:08.473301+0000","last_active":"2024-04-26T11:28:03.435946+0000","last_peered":"2024-04-26T11:28:03.435946+0000","last_clean":"2024-04-26T11:28:03.435946+0000","last_became_active":"2024-04-26T11:27:08.472769+0000","last_became_peered":"2024-04-26T11:27:08.472769+0000","last_unstale":"2024-04-26T11:28:03.435946+0000","last_undegraded":"2024-04-26T11:28:03.435946+0000","last_fullsized":"2024-04-26T11:28:03.435946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:49.108849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.440949+0000","last_change":"2024-04-26T11:27:12.109725+0000","last_active":"2024-04-26T11:28:03.440949+0000","last_peered":"2024-04-26T11:28:03.440949+0000","last_clean":"2024-04-26T11:28:03.440949+0000","last_became_active":"2024-04-26T11:27:12.109376+0000","last_became_peered":"2024-04-26T11:27:12.109376+0000","last_unstale":"2024-04-26T11:28:03.440949+0000","last_undegraded":"2024-04-26T11:28:03.440949+0000","last_fullsized":"2024-04-26T11:28:03.440949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.464520+0000","last_change":"2024-04-26T11:28:03.464520+0000","last_active":"2024-04-26T11:28:03.464520+0000","last_peered":"2024-04-26T11:28:03.464520+0000","last_clean":"2024-04-26T11:28:03.464520+0000","last_became_active":"2024-04-26T11:28:03.449993+0000","last_became_peered":"2024-04-26T11:28:03.449993+0000","last_unstale":"2024-04-26T11:28:03.464520+0000","last_undegraded":"2024-04-26T11:28:03.464520+0000","last_fullsized":"2024-04-26T11:28:03.464520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:01.465563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432737+0000","last_change":"2024-04-26T11:27:12.100830+0000","last_active":"2024-04-26T11:28:03.432737+0000","last_peered":"2024-04-26T11:28:03.432737+0000","last_clean":"2024-04-26T11:28:03.432737+0000","last_became_active":"2024-04-26T11:27:12.100474+0000","last_became_peered":"2024-04-26T11:27:12.100474+0000","last_unstale":"2024-04-26T11:28:03.432737+0000","last_undegraded":"2024-04-26T11:28:03.432737+0000","last_fullsized":"2024-04-26T11:28:03.432737+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:18.778897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.444580+0000","last_change":"2024-04-26T11:28:03.444580+0000","last_active":"2024-04-26T11:28:03.444580+0000","last_peered":"2024-04-26T11:28:03.444580+0000","last_clean":"2024-04-26T11:28:03.444580+0000","last_became_active":"2024-04-26T11:28:03.435056+0000","last_became_peered":"2024-04-26T11:28:03.435056+0000","last_unstale":"2024-04-26T11:28:03.444580+0000","last_undegraded":"2024-04-26T11:28:03.444580+0000","last_fullsized":"2024-04-26T11:28:03.444580+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:42.640914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434169+0000","last_change":"2024-04-26T11:27:12.093472+0000","last_active":"2024-04-26T11:28:03.434169+0000","last_peered":"2024-04-26T11:28:03.434169+0000","last_clean":"2024-04-26T11:28:03.434169+0000","last_became_active":"2024-04-26T11:27:12.093110+0000","last_became_peered":"2024-04-26T11:27:12.093110+0000","last_unstale":"2024-04-26T11:28:03.434169+0000","last_undegraded":"2024-04-26T11:28:03.434169+0000","last_fullsized":"2024-04-26T11:28:03.434169+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:19.256670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:11.448764+0000","last_change":"2024-04-26T11:28:03.440961+0000","last_active":"2024-04-26T11:28:11.448764+0000","last_peered":"2024-04-26T11:28:11.448764+0000","last_clean":"2024-04-26T11:28:11.448764+0000","last_became_active":"2024-04-26T11:28:03.434607+0000","last_became_peered":"2024-04-26T11:28:03.434607+0000","last_unstale":"2024-04-26T11:28:11.448764+0000","last_undegraded":"2024-04-26T11:28:11.448764+0000","last_fullsized":"2024-04-26T11:28:11.448764+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:37.122557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.447662+0000","last_change":"2024-04-26T11:28:03.447662+0000","last_active":"2024-04-26T11:28:03.447662+0000","last_peered":"2024-04-26T11:28:03.447662+0000","last_clean":"2024-04-26T11:28:03.447662+0000","last_became_active":"2024-04-26T11:28:03.447333+0000","last_became_peered":"2024-04-26T11:28:03.447333+0000","last_unstale":"2024-04-26T11:28:03.447662+0000","last_undegraded":"2024-04-26T11:28:03.447662+0000","last_fullsized":"2024-04-26T11:28:03.447662+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:37.600940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798262+0000","last_change":"2024-04-26T11:27:08.028424+0000","last_active":"2024-04-26T11:28:03.798262+0000","last_peered":"2024-04-26T11:28:03.798262+0000","last_clean":"2024-04-26T11:28:03.798262+0000","last_became_active":"2024-04-26T11:27:08.028134+0000","last_became_peered":"2024-04-26T11:27:08.028134+0000","last_unstale":"2024-04-26T11:28:03.798262+0000","last_undegraded":"2024-04-26T11:28:03.798262+0000","last_fullsized":"2024-04-26T11:28:03.798262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:44.636288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433305+0000","last_change":"2024-04-26T11:27:12.108078+0000","last_active":"2024-04-26T11:28:03.433305+0000","last_peered":"2024-04-26T11:28:03.433305+0000","last_clean":"2024-04-26T11:28:03.433305+0000","last_became_active":"2024-04-26T11:27:12.107713+0000","last_became_peered":"2024-04-26T11:27:12.107713+0000","last_unstale":"2024-04-26T11:28:03.433305+0000","last_undegraded":"2024-04-26T11:28:03.433305+0000","last_fullsized":"2024-04-26T11:28:03.433305+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:59.995679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.445457+0000","last_change":"2024-04-26T11:27:08.049134+0000","last_active":"2024-04-26T11:28:03.445457+0000","last_peered":"2024-04-26T11:28:03.445457+0000","last_clean":"2024-04-26T11:28:03.445457+0000","last_became_active":"2024-04-26T11:27:08.047862+0000","last_became_peered":"2024-04-26T11:27:08.047862+0000","last_unstale":"2024-04-26T11:28:03.445457+0000","last_undegraded":"2024-04-26T11:28:03.445457+0000","last_fullsized":"2024-04-26T11:28:03.445457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:55.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433885+0000","last_change":"2024-04-26T11:27:12.117417+0000","last_active":"2024-04-26T11:28:03.433885+0000","last_peered":"2024-04-26T11:28:03.433885+0000","last_clean":"2024-04-26T11:28:03.433885+0000","last_became_active":"2024-04-26T11:27:12.116643+0000","last_became_peered":"2024-04-26T11:27:12.116643+0000","last_unstale":"2024-04-26T11:28:03.433885+0000","last_undegraded":"2024-04-26T11:28:03.433885+0000","last_fullsized":"2024-04-26T11:28:03.433885+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:26.677738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433058+0000","last_change":"2024-04-26T11:27:08.037806+0000","last_active":"2024-04-26T11:28:03.433058+0000","last_peered":"2024-04-26T11:28:03.433058+0000","last_clean":"2024-04-26T11:28:03.433058+0000","last_became_active":"2024-04-26T11:27:08.037309+0000","last_became_peered":"2024-04-26T11:27:08.037309+0000","last_unstale":"2024-04-26T11:28:03.433058+0000","last_undegraded":"2024-04-26T11:28:03.433058+0000","last_fullsized":"2024-04-26T11:28:03.433058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.910219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434737+0000","last_change":"2024-04-26T11:27:12.120986+0000","last_active":"2024-04-26T11:28:03.434737+0000","last_peered":"2024-04-26T11:28:03.434737+0000","last_clean":"2024-04-26T11:28:03.434737+0000","last_became_active":"2024-04-26T11:27:12.120580+0000","last_became_peered":"2024-04-26T11:27:12.120580+0000","last_unstale":"2024-04-26T11:28:03.434737+0000","last_undegraded":"2024-04-26T11:28:03.434737+0000","last_fullsized":"2024-04-26T11:28:03.434737+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:00.996039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:10.447515+0000","last_change":"2024-04-26T11:27:08.048979+0000","last_active":"2024-04-26T11:28:10.447515+0000","last_peered":"2024-04-26T11:28:10.447515+0000","last_clean":"2024-04-26T11:28:10.447515+0000","last_became_active":"2024-04-26T11:27:08.048641+0000","last_became_peered":"2024-04-26T11:27:08.048641+0000","last_unstale":"2024-04-26T11:28:10.447515+0000","last_undegraded":"2024-04-26T11:28:10.447515+0000","last_fullsized":"2024-04-26T11:28:10.447515+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:38.917651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432818+0000","last_change":"2024-04-26T11:27:12.104749+0000","last_active":"2024-04-26T11:28:03.432818+0000","last_peered":"2024-04-26T11:28:03.432818+0000","last_clean":"2024-04-26T11:28:03.432818+0000","last_became_active":"2024-04-26T11:27:12.104358+0000","last_became_peered":"2024-04-26T11:27:12.104358+0000","last_unstale":"2024-04-26T11:28:03.432818+0000","last_undegraded":"2024-04-26T11:28:03.432818+0000","last_fullsized":"2024-04-26T11:28:03.432818+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:47.364512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432810+0000","last_change":"2024-04-26T11:27:08.038165+0000","last_active":"2024-04-26T11:28:03.432810+0000","last_peered":"2024-04-26T11:28:03.432810+0000","last_clean":"2024-04-26T11:28:03.432810+0000","last_became_active":"2024-04-26T11:27:08.036930+0000","last_became_peered":"2024-04-26T11:27:08.036930+0000","last_unstale":"2024-04-26T11:28:03.432810+0000","last_undegraded":"2024-04-26T11:28:03.432810+0000","last_fullsized":"2024-04-26T11:28:03.432810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:10.050679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.441082+0000","last_change":"2024-04-26T11:27:12.098702+0000","last_active":"2024-04-26T11:28:03.441082+0000","last_peered":"2024-04-26T11:28:03.441082+0000","last_clean":"2024-04-26T11:28:03.441082+0000","last_became_active":"2024-04-26T11:27:12.089241+0000","last_became_peered":"2024-04-26T11:27:12.089241+0000","last_unstale":"2024-04-26T11:28:03.441082+0000","last_undegraded":"2024-04-26T11:28:03.441082+0000","last_fullsized":"2024-04-26T11:28:03.441082+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.013054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434255+0000","last_change":"2024-04-26T11:27:08.473759+0000","last_active":"2024-04-26T11:28:03.434255+0000","last_peered":"2024-04-26T11:28:03.434255+0000","last_clean":"2024-04-26T11:28:03.434255+0000","last_became_active":"2024-04-26T11:27:08.473288+0000","last_became_peered":"2024-04-26T11:27:08.473288+0000","last_unstale":"2024-04-26T11:28:03.434255+0000","last_undegraded":"2024-04-26T11:28:03.434255+0000","last_fullsized":"2024-04-26T11:28:03.434255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:36.727119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432945+0000","last_change":"2024-04-26T11:27:12.096935+0000","last_active":"2024-04-26T11:28:03.432945+0000","last_peered":"2024-04-26T11:28:03.432945+0000","last_clean":"2024-04-26T11:28:03.432945+0000","last_became_active":"2024-04-26T11:27:12.096481+0000","last_became_peered":"2024-04-26T11:27:12.096481+0000","last_unstale":"2024-04-26T11:28:03.432945+0000","last_undegraded":"2024-04-26T11:28:03.432945+0000","last_fullsized":"2024-04-26T11:28:03.432945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:58.855909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'30","reported_seq":137,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:11.446894+0000","last_change":"2024-04-26T11:27:08.037227+0000","last_active":"2024-04-26T11:28:11.446894+0000","last_peered":"2024-04-26T11:28:11.446894+0000","last_clean":"2024-04-26T11:28:11.446894+0000","last_became_active":"2024-04-26T11:27:08.036852+0000","last_became_peered":"2024-04-26T11:27:08.036852+0000","last_unstale":"2024-04-26T11:28:11.446894+0000","last_undegraded":"2024-04-26T11:28:11.446894+0000","last_fullsized":"2024-04-26T11:28:11.446894+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:44.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61750,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":100,"num_write":31,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432077+0000","last_change":"2024-04-26T11:27:12.088586+0000","last_active":"2024-04-26T11:28:03.432077+0000","last_peered":"2024-04-26T11:28:03.432077+0000","last_clean":"2024-04-26T11:28:03.432077+0000","last_became_active":"2024-04-26T11:27:12.088264+0000","last_became_peered":"2024-04-26T11:27:12.088264+0000","last_unstale":"2024-04-26T11:28:03.432077+0000","last_undegraded":"2024-04-26T11:28:03.432077+0000","last_fullsized":"2024-04-26T11:28:03.432077+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:39.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.427928+0000","last_change":"2024-04-26T11:27:08.049289+0000","last_active":"2024-04-26T11:28:03.427928+0000","last_peered":"2024-04-26T11:28:03.427928+0000","last_clean":"2024-04-26T11:28:03.427928+0000","last_became_active":"2024-04-26T11:27:08.048923+0000","last_became_peered":"2024-04-26T11:27:08.048923+0000","last_unstale":"2024-04-26T11:28:03.427928+0000","last_undegraded":"2024-04-26T11:28:03.427928+0000","last_fullsized":"2024-04-26T11:28:03.427928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:42.229383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.446361+0000","last_change":"2024-04-26T11:27:12.118154+0000","last_active":"2024-04-26T11:28:03.446361+0000","last_peered":"2024-04-26T11:28:03.446361+0000","last_clean":"2024-04-26T11:28:03.446361+0000","last_became_active":"2024-04-26T11:27:12.117624+0000","last_became_peered":"2024-04-26T11:27:12.117624+0000","last_unstale":"2024-04-26T11:28:03.446361+0000","last_undegraded":"2024-04-26T11:28:03.446361+0000","last_fullsized":"2024-04-26T11:28:03.446361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:57.947310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432888+0000","last_change":"2024-04-26T11:27:08.045870+0000","last_active":"2024-04-26T11:28:03.432888+0000","last_peered":"2024-04-26T11:28:03.432888+0000","last_clean":"2024-04-26T11:28:03.432888+0000","last_became_active":"2024-04-26T11:27:08.045461+0000","last_became_peered":"2024-04-26T11:27:08.045461+0000","last_unstale":"2024-04-26T11:28:03.432888+0000","last_undegraded":"2024-04-26T11:28:03.432888+0000","last_fullsized":"2024-04-26T11:28:03.432888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:59.899805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433853+0000","last_change":"2024-04-26T11:27:12.116617+0000","last_active":"2024-04-26T11:28:03.433853+0000","last_peered":"2024-04-26T11:28:03.433853+0000","last_clean":"2024-04-26T11:28:03.433853+0000","last_became_active":"2024-04-26T11:27:12.115731+0000","last_became_peered":"2024-04-26T11:27:12.115731+0000","last_unstale":"2024-04-26T11:28:03.433853+0000","last_undegraded":"2024-04-26T11:28:03.433853+0000","last_fullsized":"2024-04-26T11:28:03.433853+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:42.680367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":70,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:10.702307+0000","last_change":"2024-04-26T11:27:08.036947+0000","last_active":"2024-04-26T11:28:10.702307+0000","last_peered":"2024-04-26T11:28:10.702307+0000","last_clean":"2024-04-26T11:28:10.702307+0000","last_became_active":"2024-04-26T11:27:08.036596+0000","last_became_peered":"2024-04-26T11:27:08.036596+0000","last_unstale":"2024-04-26T11:28:10.702307+0000","last_undegraded":"2024-04-26T11:28:10.702307+0000","last_fullsized":"2024-04-26T11:28:10.702307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:35.606069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432792+0000","last_change":"2024-04-26T11:27:12.086190+0000","last_active":"2024-04-26T11:28:03.432792+0000","last_peered":"2024-04-26T11:28:03.432792+0000","last_clean":"2024-04-26T11:28:03.432792+0000","last_became_active":"2024-04-26T11:27:12.085839+0000","last_became_peered":"2024-04-26T11:27:12.085839+0000","last_unstale":"2024-04-26T11:28:03.432792+0000","last_undegraded":"2024-04-26T11:28:03.432792+0000","last_fullsized":"2024-04-26T11:28:03.432792+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:31.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":66,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.459792+0000","last_change":"2024-04-26T11:28:03.459792+0000","last_active":"2024-04-26T11:28:03.459792+0000","last_peered":"2024-04-26T11:28:03.459792+0000","last_clean":"2024-04-26T11:28:03.459792+0000","last_became_active":"2024-04-26T11:28:03.444101+0000","last_became_peered":"2024-04-26T11:28:03.444101+0000","last_unstale":"2024-04-26T11:28:03.459792+0000","last_undegraded":"2024-04-26T11:28:03.459792+0000","last_fullsized":"2024-04-26T11:28:03.459792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:14.498792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433174+0000","last_change":"2024-04-26T11:27:12.093884+0000","last_active":"2024-04-26T11:28:03.433174+0000","last_peered":"2024-04-26T11:28:03.433174+0000","last_clean":"2024-04-26T11:28:03.433174+0000","last_became_active":"2024-04-26T11:27:12.093573+0000","last_became_peered":"2024-04-26T11:27:12.093573+0000","last_unstale":"2024-04-26T11:28:03.433174+0000","last_undegraded":"2024-04-26T11:28:03.433174+0000","last_fullsized":"2024-04-26T11:28:03.433174+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:32.144889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.431231+0000","last_change":"2024-04-26T11:27:08.035089+0000","last_active":"2024-04-26T11:28:03.431231+0000","last_peered":"2024-04-26T11:28:03.431231+0000","last_clean":"2024-04-26T11:28:03.431231+0000","last_became_active":"2024-04-26T11:27:08.034698+0000","last_became_peered":"2024-04-26T11:27:08.034698+0000","last_unstale":"2024-04-26T11:28:03.431231+0000","last_undegraded":"2024-04-26T11:28:03.431231+0000","last_fullsized":"2024-04-26T11:28:03.431231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:23.731307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429965+0000","last_change":"2024-04-26T11:27:12.097089+0000","last_active":"2024-04-26T11:28:03.429965+0000","last_peered":"2024-04-26T11:28:03.429965+0000","last_clean":"2024-04-26T11:28:03.429965+0000","last_became_active":"2024-04-26T11:27:12.096762+0000","last_became_peered":"2024-04-26T11:27:12.096762+0000","last_unstale":"2024-04-26T11:28:03.429965+0000","last_undegraded":"2024-04-26T11:28:03.429965+0000","last_fullsized":"2024-04-26T11:28:03.429965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.366450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439314+0000","last_change":"2024-04-26T11:27:08.475317+0000","last_active":"2024-04-26T11:28:03.439314+0000","last_peered":"2024-04-26T11:28:03.439314+0000","last_clean":"2024-04-26T11:28:03.439314+0000","last_became_active":"2024-04-26T11:27:08.474464+0000","last_became_peered":"2024-04-26T11:27:08.474464+0000","last_unstale":"2024-04-26T11:28:03.439314+0000","last_undegraded":"2024-04-26T11:28:03.439314+0000","last_fullsized":"2024-04-26T11:28:03.439314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798437+0000","last_change":"2024-04-26T11:27:12.107542+0000","last_active":"2024-04-26T11:28:03.798437+0000","last_peered":"2024-04-26T11:28:03.798437+0000","last_clean":"2024-04-26T11:28:03.798437+0000","last_became_active":"2024-04-26T11:27:12.107162+0000","last_became_peered":"2024-04-26T11:27:12.107162+0000","last_unstale":"2024-04-26T11:28:03.798437+0000","last_undegraded":"2024-04-26T11:28:03.798437+0000","last_fullsized":"2024-04-26T11:28:03.798437+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:55.470638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433547+0000","last_change":"2024-04-26T11:27:08.044101+0000","last_active":"2024-04-26T11:28:03.433547+0000","last_peered":"2024-04-26T11:28:03.433547+0000","last_clean":"2024-04-26T11:28:03.433547+0000","last_became_active":"2024-04-26T11:27:08.043733+0000","last_became_peered":"2024-04-26T11:27:08.043733+0000","last_unstale":"2024-04-26T11:28:03.433547+0000","last_undegraded":"2024-04-26T11:28:03.433547+0000","last_fullsized":"2024-04-26T11:28:03.433547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:03.023620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.798349+0000","last_change":"2024-04-26T11:27:12.098713+0000","last_active":"2024-04-26T11:28:03.798349+0000","last_peered":"2024-04-26T11:28:03.798349+0000","last_clean":"2024-04-26T11:28:03.798349+0000","last_became_active":"2024-04-26T11:27:12.098275+0000","last_became_peered":"2024-04-26T11:27:12.098275+0000","last_unstale":"2024-04-26T11:28:03.798349+0000","last_undegraded":"2024-04-26T11:28:03.798349+0000","last_fullsized":"2024-04-26T11:28:03.798349+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:02.229321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433428+0000","last_change":"2024-04-26T11:27:12.093505+0000","last_active":"2024-04-26T11:28:03.433428+0000","last_peered":"2024-04-26T11:28:03.433428+0000","last_clean":"2024-04-26T11:28:03.433428+0000","last_became_active":"2024-04-26T11:27:12.093198+0000","last_became_peered":"2024-04-26T11:27:12.093198+0000","last_unstale":"2024-04-26T11:28:03.433428+0000","last_undegraded":"2024-04-26T11:28:03.433428+0000","last_fullsized":"2024-04-26T11:28:03.433428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:06.100747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:08.698613+0000","last_change":"2024-04-26T11:27:08.474897+0000","last_active":"2024-04-26T11:28:08.698613+0000","last_peered":"2024-04-26T11:28:08.698613+0000","last_clean":"2024-04-26T11:28:08.698613+0000","last_became_active":"2024-04-26T11:27:08.471735+0000","last_became_peered":"2024-04-26T11:27:08.471735+0000","last_unstale":"2024-04-26T11:28:08.698613+0000","last_undegraded":"2024-04-26T11:28:08.698613+0000","last_fullsized":"2024-04-26T11:28:08.698613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:42.066821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439688+0000","last_change":"2024-04-26T11:27:12.116722+0000","last_active":"2024-04-26T11:28:03.439688+0000","last_peered":"2024-04-26T11:28:03.439688+0000","last_clean":"2024-04-26T11:28:03.439688+0000","last_became_active":"2024-04-26T11:27:12.116239+0000","last_became_peered":"2024-04-26T11:27:12.116239+0000","last_unstale":"2024-04-26T11:28:03.439688+0000","last_undegraded":"2024-04-26T11:28:03.439688+0000","last_fullsized":"2024-04-26T11:28:03.439688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:04.962376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430022+0000","last_change":"2024-04-26T11:27:08.047087+0000","last_active":"2024-04-26T11:28:03.430022+0000","last_peered":"2024-04-26T11:28:03.430022+0000","last_clean":"2024-04-26T11:28:03.430022+0000","last_became_active":"2024-04-26T11:27:08.046754+0000","last_became_peered":"2024-04-26T11:27:08.046754+0000","last_unstale":"2024-04-26T11:28:03.430022+0000","last_undegraded":"2024-04-26T11:28:03.430022+0000","last_fullsized":"2024-04-26T11:28:03.430022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:30.481521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":361,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433072+0000","last_change":"2024-04-26T11:25:35.622816+0000","last_active":"2024-04-26T11:28:03.433072+0000","last_peered":"2024-04-26T11:28:03.433072+0000","last_clean":"2024-04-26T11:28:03.433072+0000","last_became_active":"2024-04-26T11:25:35.622329+0000","last_became_peered":"2024-04-26T11:25:35.622329+0000","last_unstale":"2024-04-26T11:28:03.433072+0000","last_undegraded":"2024-04-26T11:28:03.433072+0000","last_fullsized":"2024-04-26T11:28:03.433072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_clean_scrub_stamp":"2024-04-26T11:21:45.465157+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:40.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.445214+0000","last_change":"2024-04-26T11:27:12.098686+0000","last_active":"2024-04-26T11:28:03.445214+0000","last_peered":"2024-04-26T11:28:03.445214+0000","last_clean":"2024-04-26T11:28:03.445214+0000","last_became_active":"2024-04-26T11:27:12.098251+0000","last_became_peered":"2024-04-26T11:27:12.098251+0000","last_unstale":"2024-04-26T11:28:03.445214+0000","last_undegraded":"2024-04-26T11:28:03.445214+0000","last_fullsized":"2024-04-26T11:28:03.445214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:34.433203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433214+0000","last_change":"2024-04-26T11:27:08.036391+0000","last_active":"2024-04-26T11:28:03.433214+0000","last_peered":"2024-04-26T11:28:03.433214+0000","last_clean":"2024-04-26T11:28:03.433214+0000","last_became_active":"2024-04-26T11:27:08.036058+0000","last_became_peered":"2024-04-26T11:27:08.036058+0000","last_unstale":"2024-04-26T11:28:03.433214+0000","last_undegraded":"2024-04-26T11:28:03.433214+0000","last_fullsized":"2024-04-26T11:28:03.433214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:35.646501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432195+0000","last_change":"2024-04-26T11:27:08.472171+0000","last_active":"2024-04-26T11:28:03.432195+0000","last_peered":"2024-04-26T11:28:03.432195+0000","last_clean":"2024-04-26T11:28:03.432195+0000","last_became_active":"2024-04-26T11:27:08.471707+0000","last_became_peered":"2024-04-26T11:27:08.471707+0000","last_unstale":"2024-04-26T11:28:03.432195+0000","last_undegraded":"2024-04-26T11:28:03.432195+0000","last_fullsized":"2024-04-26T11:28:03.432195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:54.319448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.448133+0000","last_change":"2024-04-26T11:27:12.110757+0000","last_active":"2024-04-26T11:28:03.448133+0000","last_peered":"2024-04-26T11:28:03.448133+0000","last_clean":"2024-04-26T11:28:03.448133+0000","last_became_active":"2024-04-26T11:27:12.109048+0000","last_became_peered":"2024-04-26T11:27:12.109048+0000","last_unstale":"2024-04-26T11:28:03.448133+0000","last_undegraded":"2024-04-26T11:28:03.448133+0000","last_fullsized":"2024-04-26T11:28:03.448133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:05.203504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'12","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.443262+0000","last_change":"2024-04-26T11:27:08.051790+0000","last_active":"2024-04-26T11:28:03.443262+0000","last_peered":"2024-04-26T11:28:03.443262+0000","last_clean":"2024-04-26T11:28:03.443262+0000","last_became_active":"2024-04-26T11:27:08.051430+0000","last_became_peered":"2024-04-26T11:27:08.051430+0000","last_unstale":"2024-04-26T11:28:03.443262+0000","last_undegraded":"2024-04-26T11:28:03.443262+0000","last_fullsized":"2024-04-26T11:28:03.443262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:13.607944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.434930+0000","last_change":"2024-04-26T11:27:12.116704+0000","last_active":"2024-04-26T11:28:03.434930+0000","last_peered":"2024-04-26T11:28:03.434930+0000","last_clean":"2024-04-26T11:28:03.434930+0000","last_became_active":"2024-04-26T11:27:12.111556+0000","last_became_peered":"2024-04-26T11:27:12.111556+0000","last_unstale":"2024-04-26T11:28:03.434930+0000","last_undegraded":"2024-04-26T11:28:03.434930+0000","last_fullsized":"2024-04-26T11:28:03.434930+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:36.535244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430174+0000","last_change":"2024-04-26T11:27:08.347851+0000","last_active":"2024-04-26T11:28:03.430174+0000","last_peered":"2024-04-26T11:28:03.430174+0000","last_clean":"2024-04-26T11:28:03.430174+0000","last_became_active":"2024-04-26T11:27:08.347460+0000","last_became_peered":"2024-04-26T11:27:08.347460+0000","last_unstale":"2024-04-26T11:28:03.430174+0000","last_undegraded":"2024-04-26T11:28:03.430174+0000","last_fullsized":"2024-04-26T11:28:03.430174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.017834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.441036+0000","last_change":"2024-04-26T11:27:12.105622+0000","last_active":"2024-04-26T11:28:03.441036+0000","last_peered":"2024-04-26T11:28:03.441036+0000","last_clean":"2024-04-26T11:28:03.441036+0000","last_became_active":"2024-04-26T11:27:12.105312+0000","last_became_peered":"2024-04-26T11:27:12.105312+0000","last_unstale":"2024-04-26T11:28:03.441036+0000","last_undegraded":"2024-04-26T11:28:03.441036+0000","last_fullsized":"2024-04-26T11:28:03.441036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:59.045120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432453+0000","last_change":"2024-04-26T11:27:08.472127+0000","last_active":"2024-04-26T11:28:03.432453+0000","last_peered":"2024-04-26T11:28:03.432453+0000","last_clean":"2024-04-26T11:28:03.432453+0000","last_became_active":"2024-04-26T11:27:08.471709+0000","last_became_peered":"2024-04-26T11:27:08.471709+0000","last_unstale":"2024-04-26T11:28:03.432453+0000","last_undegraded":"2024-04-26T11:28:03.432453+0000","last_fullsized":"2024-04-26T11:28:03.432453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:28.432710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429828+0000","last_change":"2024-04-26T11:27:12.085756+0000","last_active":"2024-04-26T11:28:03.429828+0000","last_peered":"2024-04-26T11:28:03.429828+0000","last_clean":"2024-04-26T11:28:03.429828+0000","last_became_active":"2024-04-26T11:27:12.085397+0000","last_became_peered":"2024-04-26T11:27:12.085397+0000","last_unstale":"2024-04-26T11:28:03.429828+0000","last_undegraded":"2024-04-26T11:28:03.429828+0000","last_fullsized":"2024-04-26T11:28:03.429828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:41.392010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.438514+0000","last_change":"2024-04-26T11:27:08.054831+0000","last_active":"2024-04-26T11:28:03.438514+0000","last_peered":"2024-04-26T11:28:03.438514+0000","last_clean":"2024-04-26T11:28:03.438514+0000","last_became_active":"2024-04-26T11:27:08.054352+0000","last_became_peered":"2024-04-26T11:27:08.054352+0000","last_unstale":"2024-04-26T11:28:03.438514+0000","last_undegraded":"2024-04-26T11:28:03.438514+0000","last_fullsized":"2024-04-26T11:28:03.438514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:53.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429811+0000","last_change":"2024-04-26T11:27:12.095789+0000","last_active":"2024-04-26T11:28:03.429811+0000","last_peered":"2024-04-26T11:28:03.429811+0000","last_clean":"2024-04-26T11:28:03.429811+0000","last_became_active":"2024-04-26T11:27:12.095468+0000","last_became_peered":"2024-04-26T11:27:12.095468+0000","last_unstale":"2024-04-26T11:28:03.429811+0000","last_undegraded":"2024-04-26T11:28:03.429811+0000","last_fullsized":"2024-04-26T11:28:03.429811+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:27.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.427663+0000","last_change":"2024-04-26T11:27:08.044923+0000","last_active":"2024-04-26T11:28:03.427663+0000","last_peered":"2024-04-26T11:28:03.427663+0000","last_clean":"2024-04-26T11:28:03.427663+0000","last_became_active":"2024-04-26T11:27:08.044516+0000","last_became_peered":"2024-04-26T11:27:08.044516+0000","last_unstale":"2024-04-26T11:28:03.427663+0000","last_undegraded":"2024-04-26T11:28:03.427663+0000","last_fullsized":"2024-04-26T11:28:03.427663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:21.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.439732+0000","last_change":"2024-04-26T11:27:12.114311+0000","last_active":"2024-04-26T11:28:03.439732+0000","last_peered":"2024-04-26T11:28:03.439732+0000","last_clean":"2024-04-26T11:28:03.439732+0000","last_became_active":"2024-04-26T11:27:12.113538+0000","last_became_peered":"2024-04-26T11:27:12.113538+0000","last_unstale":"2024-04-26T11:28:03.439732+0000","last_undegraded":"2024-04-26T11:28:03.439732+0000","last_fullsized":"2024-04-26T11:28:03.439732+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:55.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430587+0000","last_change":"2024-04-26T11:27:08.036983+0000","last_active":"2024-04-26T11:28:03.430587+0000","last_peered":"2024-04-26T11:28:03.430587+0000","last_clean":"2024-04-26T11:28:03.430587+0000","last_became_active":"2024-04-26T11:27:08.036632+0000","last_became_peered":"2024-04-26T11:27:08.036632+0000","last_unstale":"2024-04-26T11:28:03.430587+0000","last_undegraded":"2024-04-26T11:28:03.430587+0000","last_fullsized":"2024-04-26T11:28:03.430587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:31.731466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433694+0000","last_change":"2024-04-26T11:27:12.102922+0000","last_active":"2024-04-26T11:28:03.433694+0000","last_peered":"2024-04-26T11:28:03.433694+0000","last_clean":"2024-04-26T11:28:03.433694+0000","last_became_active":"2024-04-26T11:27:12.102594+0000","last_became_peered":"2024-04-26T11:27:12.102594+0000","last_unstale":"2024-04-26T11:28:03.433694+0000","last_undegraded":"2024-04-26T11:28:03.433694+0000","last_fullsized":"2024-04-26T11:28:03.433694+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:47.223435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.428111+0000","last_change":"2024-04-26T11:27:08.473262+0000","last_active":"2024-04-26T11:28:03.428111+0000","last_peered":"2024-04-26T11:28:03.428111+0000","last_clean":"2024-04-26T11:28:03.428111+0000","last_became_active":"2024-04-26T11:27:08.472744+0000","last_became_peered":"2024-04-26T11:27:08.472744+0000","last_unstale":"2024-04-26T11:28:03.428111+0000","last_undegraded":"2024-04-26T11:28:03.428111+0000","last_fullsized":"2024-04-26T11:28:03.428111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:16.766438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433441+0000","last_change":"2024-04-26T11:27:12.091754+0000","last_active":"2024-04-26T11:28:03.433441+0000","last_peered":"2024-04-26T11:28:03.433441+0000","last_clean":"2024-04-26T11:28:03.433441+0000","last_became_active":"2024-04-26T11:27:12.091282+0000","last_became_peered":"2024-04-26T11:27:12.091282+0000","last_unstale":"2024-04-26T11:28:03.433441+0000","last_undegraded":"2024-04-26T11:28:03.433441+0000","last_fullsized":"2024-04-26T11:28:03.433441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:07.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433560+0000","last_change":"2024-04-26T11:27:08.048352+0000","last_active":"2024-04-26T11:28:03.433560+0000","last_peered":"2024-04-26T11:28:03.433560+0000","last_clean":"2024-04-26T11:28:03.433560+0000","last_became_active":"2024-04-26T11:27:08.048056+0000","last_became_peered":"2024-04-26T11:27:08.048056+0000","last_unstale":"2024-04-26T11:28:03.433560+0000","last_undegraded":"2024-04-26T11:28:03.433560+0000","last_fullsized":"2024-04-26T11:28:03.433560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:35.363779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.432977+0000","last_change":"2024-04-26T11:27:12.108244+0000","last_active":"2024-04-26T11:28:03.432977+0000","last_peered":"2024-04-26T11:28:03.432977+0000","last_clean":"2024-04-26T11:28:03.432977+0000","last_became_active":"2024-04-26T11:27:12.107592+0000","last_became_peered":"2024-04-26T11:27:12.107592+0000","last_unstale":"2024-04-26T11:28:03.432977+0000","last_undegraded":"2024-04-26T11:28:03.432977+0000","last_fullsized":"2024-04-26T11:28:03.432977+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:55.985873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.462136+0000","last_change":"2024-04-26T11:28:03.462136+0000","last_active":"2024-04-26T11:28:03.462136+0000","last_peered":"2024-04-26T11:28:03.462136+0000","last_clean":"2024-04-26T11:28:03.462136+0000","last_became_active":"2024-04-26T11:28:03.449130+0000","last_became_peered":"2024-04-26T11:28:03.449130+0000","last_unstale":"2024-04-26T11:28:03.462136+0000","last_undegraded":"2024-04-26T11:28:03.462136+0000","last_fullsized":"2024-04-26T11:28:03.462136+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:33.181328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433827+0000","last_change":"2024-04-26T11:27:12.090627+0000","last_active":"2024-04-26T11:28:03.433827+0000","last_peered":"2024-04-26T11:28:03.433827+0000","last_clean":"2024-04-26T11:28:03.433827+0000","last_became_active":"2024-04-26T11:27:12.089981+0000","last_became_peered":"2024-04-26T11:27:12.089981+0000","last_unstale":"2024-04-26T11:28:03.433827+0000","last_undegraded":"2024-04-26T11:28:03.433827+0000","last_fullsized":"2024-04-26T11:28:03.433827+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429957+0000","last_change":"2024-04-26T11:27:12.089335+0000","last_active":"2024-04-26T11:28:03.429957+0000","last_peered":"2024-04-26T11:28:03.429957+0000","last_clean":"2024-04-26T11:28:03.429957+0000","last_became_active":"2024-04-26T11:27:12.089019+0000","last_became_peered":"2024-04-26T11:27:12.089019+0000","last_unstale":"2024-04-26T11:28:03.429957+0000","last_undegraded":"2024-04-26T11:28:03.429957+0000","last_fullsized":"2024-04-26T11:28:03.429957+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:18.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.435483+0000","last_change":"2024-04-26T11:28:03.435483+0000","last_active":"2024-04-26T11:28:03.435483+0000","last_peered":"2024-04-26T11:28:03.435483+0000","last_clean":"2024-04-26T11:28:03.435483+0000","last_became_active":"2024-04-26T11:28:03.435088+0000","last_became_peered":"2024-04-26T11:28:03.435088+0000","last_unstale":"2024-04-26T11:28:03.435483+0000","last_undegraded":"2024-04-26T11:28:03.435483+0000","last_fullsized":"2024-04-26T11:28:03.435483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.453906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.427816+0000","last_change":"2024-04-26T11:27:12.112344+0000","last_active":"2024-04-26T11:28:03.427816+0000","last_peered":"2024-04-26T11:28:03.427816+0000","last_clean":"2024-04-26T11:28:03.427816+0000","last_became_active":"2024-04-26T11:27:12.112083+0000","last_became_peered":"2024-04-26T11:27:12.112083+0000","last_unstale":"2024-04-26T11:28:03.427816+0000","last_undegraded":"2024-04-26T11:28:03.427816+0000","last_fullsized":"2024-04-26T11:28:03.427816+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.440337+0000","last_change":"2024-04-26T11:27:12.115707+0000","last_active":"2024-04-26T11:28:03.440337+0000","last_peered":"2024-04-26T11:28:03.440337+0000","last_clean":"2024-04-26T11:28:03.440337+0000","last_became_active":"2024-04-26T11:27:12.115192+0000","last_became_peered":"2024-04-26T11:27:12.115192+0000","last_unstale":"2024-04-26T11:28:03.440337+0000","last_undegraded":"2024-04-26T11:28:03.440337+0000","last_fullsized":"2024-04-26T11:28:03.440337+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:55.475825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.448000+0000","last_change":"2024-04-26T11:27:12.108771+0000","last_active":"2024-04-26T11:28:03.448000+0000","last_peered":"2024-04-26T11:28:03.448000+0000","last_clean":"2024-04-26T11:28:03.448000+0000","last_became_active":"2024-04-26T11:27:12.102910+0000","last_became_peered":"2024-04-26T11:27:12.102910+0000","last_unstale":"2024-04-26T11:28:03.448000+0000","last_undegraded":"2024-04-26T11:28:03.448000+0000","last_fullsized":"2024-04-26T11:28:03.448000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:23.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.429839+0000","last_change":"2024-04-26T11:27:12.091226+0000","last_active":"2024-04-26T11:28:03.429839+0000","last_peered":"2024-04-26T11:28:03.429839+0000","last_clean":"2024-04-26T11:28:03.429839+0000","last_became_active":"2024-04-26T11:27:12.090926+0000","last_became_peered":"2024-04-26T11:27:12.090926+0000","last_unstale":"2024-04-26T11:28:03.429839+0000","last_undegraded":"2024-04-26T11:28:03.429839+0000","last_fullsized":"2024-04-26T11:28:03.429839+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:43.005527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.428113+0000","last_change":"2024-04-26T11:27:12.091297+0000","last_active":"2024-04-26T11:28:03.428113+0000","last_peered":"2024-04-26T11:28:03.428113+0000","last_clean":"2024-04-26T11:28:03.428113+0000","last_became_active":"2024-04-26T11:27:12.090946+0000","last_became_peered":"2024-04-26T11:27:12.090946+0000","last_unstale":"2024-04-26T11:28:03.428113+0000","last_undegraded":"2024-04-26T11:28:03.428113+0000","last_fullsized":"2024-04-26T11:28:03.428113+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:06.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.445596+0000","last_change":"2024-04-26T11:28:03.445596+0000","last_active":"2024-04-26T11:28:03.445596+0000","last_peered":"2024-04-26T11:28:03.445596+0000","last_clean":"2024-04-26T11:28:03.445596+0000","last_became_active":"2024-04-26T11:28:03.443717+0000","last_became_peered":"2024-04-26T11:28:03.443717+0000","last_unstale":"2024-04-26T11:28:03.445596+0000","last_undegraded":"2024-04-26T11:28:03.445596+0000","last_fullsized":"2024-04-26T11:28:03.445596+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:44.905902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433161+0000","last_change":"2024-04-26T11:27:12.107987+0000","last_active":"2024-04-26T11:28:03.433161+0000","last_peered":"2024-04-26T11:28:03.433161+0000","last_clean":"2024-04-26T11:28:03.433161+0000","last_became_active":"2024-04-26T11:27:12.107668+0000","last_became_peered":"2024-04-26T11:27:12.107668+0000","last_unstale":"2024-04-26T11:28:03.433161+0000","last_undegraded":"2024-04-26T11:28:03.433161+0000","last_fullsized":"2024-04-26T11:28:03.433161+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:06.448570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.438293+0000","last_change":"2024-04-26T11:27:12.105596+0000","last_active":"2024-04-26T11:28:03.438293+0000","last_peered":"2024-04-26T11:28:03.438293+0000","last_clean":"2024-04-26T11:28:03.438293+0000","last_became_active":"2024-04-26T11:27:12.104996+0000","last_became_peered":"2024-04-26T11:27:12.104996+0000","last_unstale":"2024-04-26T11:28:03.438293+0000","last_undegraded":"2024-04-26T11:28:03.438293+0000","last_fullsized":"2024-04-26T11:28:03.438293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:11.947364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.433164+0000","last_change":"2024-04-26T11:27:12.116095+0000","last_active":"2024-04-26T11:28:03.433164+0000","last_peered":"2024-04-26T11:28:03.433164+0000","last_clean":"2024-04-26T11:28:03.433164+0000","last_became_active":"2024-04-26T11:27:12.115726+0000","last_became_peered":"2024-04-26T11:27:12.115726+0000","last_unstale":"2024-04-26T11:28:03.433164+0000","last_undegraded":"2024-04-26T11:28:03.433164+0000","last_fullsized":"2024-04-26T11:28:03.433164+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:45.056829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.448955+0000","last_change":"2024-04-26T11:27:12.115016+0000","last_active":"2024-04-26T11:28:03.448955+0000","last_peered":"2024-04-26T11:28:03.448955+0000","last_clean":"2024-04-26T11:28:03.448955+0000","last_became_active":"2024-04-26T11:27:12.114671+0000","last_became_peered":"2024-04-26T11:27:12.114671+0000","last_unstale":"2024-04-26T11:28:03.448955+0000","last_undegraded":"2024-04-26T11:28:03.448955+0000","last_fullsized":"2024-04-26T11:28:03.448955+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:11.393056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:28:03.430213+0000","last_change":"2024-04-26T11:27:12.097130+0000","last_active":"2024-04-26T11:28:03.430213+0000","last_peered":"2024-04-26T11:28:03.430213+0000","last_clean":"2024-04-26T11:28:03.430213+0000","last_became_active":"2024-04-26T11:27:12.096809+0000","last_became_peered":"2024-04-26T11:27:12.096809+0000","last_unstale":"2024-04-26T11:28:03.430213+0000","last_undegraded":"2024-04-26T11:28:03.430213+0000","last_fullsized":"2024-04-26T11:28:03.430213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:31.198452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":213698,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65751,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":216,"num_read_kb":188,"num_write":166,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1316,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351004,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":483736,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612641,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32288,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712864,"statfs":{"total":95995035648,"available":95961972736,"internally_reserved":0,"allocated":1138688,"data_stored":1136736,"data_compressed":41934,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776167,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1003520,"data_stored":483350,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037805,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":482688,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":1075200,"data_compressed":41934,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462969,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":482739,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":544864,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":484010,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":545520,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1007616,"data_stored":483050,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888133,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":483679,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724607,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":1073871,"data_compressed":41934,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34523,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34523,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":62988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:28:15.895 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T11:28:15.895 INFO:tasks.cephadm:Setting up client nodes... 2024-04-26T11:28:15.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-26T11:28:16.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:15 smithi196 ceph-mon[32572]: pgmap v357: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 462 B/s wr, 5 op/s; 118 B/s, 0 keys/s, 1 objects/s recovering 2024-04-26T11:28:16.391 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:16 smithi110 ceph-mon[28069]: from='client.24652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:28:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:16 smithi193 ceph-mon[32782]: from='client.24652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:28:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:16 smithi196 ceph-mon[32572]: from='client.24652 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:28:17.751 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:17 smithi110 ceph-mon[28069]: pgmap v358: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 5 op/s; 109 B/s, 0 keys/s, 1 objects/s recovering 2024-04-26T11:28:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:17 smithi193 ceph-mon[32782]: pgmap v358: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 5 op/s; 109 B/s, 0 keys/s, 1 objects/s recovering 2024-04-26T11:28:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:17 smithi196 ceph-mon[32572]: pgmap v358: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 5 op/s; 109 B/s, 0 keys/s, 1 objects/s recovering 2024-04-26T11:28:18.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.617+0000 7f9848a00700 1 -- 172.21.15.110:0/140325080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98441068d0 msgr2=0x7f9844106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:18.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.617+0000 7f9848a00700 1 --2- 172.21.15.110:0/140325080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98441068d0 0x7f9844106d30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f98300099c0 tx=0x7f9830009cd0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.617+0000 7f9848a00700 1 -- 172.21.15.110:0/140325080 shutdown_connections 2024-04-26T11:28:18.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.617+0000 7f9848a00700 1 --2- 172.21.15.110:0/140325080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9844107270 0x7f984410db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.617+0000 7f9848a00700 1 --2- 172.21.15.110:0/140325080 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98441056d0 0x7f9844105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.617+0000 7f9848a00700 1 --2- 172.21.15.110:0/140325080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98441068d0 0x7f9844106d30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.617+0000 7f9848a00700 1 -- 172.21.15.110:0/140325080 >> 172.21.15.110:0/140325080 conn(0x7f9844100c70 msgr2=0x7f98441030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:18.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.617+0000 7f9848a00700 1 -- 172.21.15.110:0/140325080 shutdown_connections 2024-04-26T11:28:18.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.617+0000 7f9848a00700 1 -- 172.21.15.110:0/140325080 wait complete. 2024-04-26T11:28:18.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.618+0000 7f9848a00700 1 Processor -- start 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9848a00700 1 -- start start 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9848a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98441056d0 0x7f984419b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9848a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98441068d0 0x7f984419bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9848a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9844107270 0x7f98441a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9848a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9844111190 con 0x7f98441068d0 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9848a00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9844111010 con 0x7f9844107270 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9848a00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9844111310 con 0x7f98441056d0 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9841400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98441068d0 0x7f984419bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9841400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98441068d0 0x7f984419bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49676/0 (socket says 172.21.15.110:49676) 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9841e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98441056d0 0x7f984419b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9841400700 1 -- 172.21.15.110:0/312903759 learned_addr learned my addr 172.21.15.110:0/312903759 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.619+0000 7f9842800700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9844107270 0x7f98441a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:18.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f9841e00700 1 -- 172.21.15.110:0/312903759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9844107270 msgr2=0x7f98441a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f9841e00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9844107270 0x7f98441a2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f9841e00700 1 -- 172.21.15.110:0/312903759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98441068d0 msgr2=0x7f984419bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f9841e00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98441068d0 0x7f984419bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f9841e00700 1 -- 172.21.15.110:0/312903759 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98441a33a0 con 0x7f98441056d0 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f9841e00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98441056d0 0x7f984419b740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f983400e9f0 tx=0x7f983400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f983aa00700 1 -- 172.21.15.110:0/312903759 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834004220 con 0x7f98441056d0 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f983aa00700 1 -- 172.21.15.110:0/312903759 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98340043c0 con 0x7f98441056d0 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f983aa00700 1 -- 172.21.15.110:0/312903759 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834003be0 con 0x7f98441056d0 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.620+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98441a3690 con 0x7f98441056d0 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.621+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98441a3b80 con 0x7f98441056d0 2024-04-26T11:28:18.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.622+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9844051960 con 0x7f98441056d0 2024-04-26T11:28:18.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.624+0000 7f983aa00700 1 -- 172.21.15.110:0/312903759 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f983400c7c0 con 0x7f98441056d0 2024-04-26T11:28:18.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.625+0000 7f983aa00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98280a3e00 0x7f98280a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:18.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.625+0000 7f983aa00700 1 -- 172.21.15.110:0/312903759 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f98340d0780 con 0x7f98441056d0 2024-04-26T11:28:18.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.625+0000 7f9841400700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98280a3e00 0x7f98280a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:18.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.626+0000 7f9841400700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98280a3e00 0x7f98280a62c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9830000c00 tx=0x7f9830005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:18.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.631+0000 7f983aa00700 1 -- 172.21.15.110:0/312903759 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f983409cf80 con 0x7f98441056d0 2024-04-26T11:28:18.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.936+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f984402e5f0 con 0x7f98441056d0 2024-04-26T11:28:18.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.944+0000 7f983aa00700 1 -- 172.21.15.110:0/312903759 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f984402e5f0 con 0x7f98441056d0 2024-04-26T11:28:18.947 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-04-26T11:28:18.947 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDSjytmKcQGOBAAAtYkwh1m8qa8U5/86k25DA== 2024-04-26T11:28:18.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98280a3e00 msgr2=0x7f98280a62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98280a3e00 0x7f98280a62c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9830000c00 tx=0x7f9830005fd0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98441056d0 msgr2=0x7f984419b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98441056d0 0x7f984419b740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f983400e9f0 tx=0x7f983400ed00 comp rx=0 tx=0).stop 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 shutdown_connections 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9844107270 0x7f98441a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f98280a3e00 0x7f98280a62c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98441056d0 0x7f984419b740 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 --2- 172.21.15.110:0/312903759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98441068d0 0x7f984419bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 >> 172.21.15.110:0/312903759 conn(0x7f9844100c70 msgr2=0x7f9844109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 shutdown_connections 2024-04-26T11:28:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:18.947+0000 7f9848a00700 1 -- 172.21.15.110:0/312903759 wait complete. 2024-04-26T11:28:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:19 smithi110 ceph-mon[28069]: pgmap v359: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s; 51 B/s, 0 objects/s recovering 2024-04-26T11:28:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:19 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/312903759' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T11:28:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:19 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T11:28:19.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:19 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T11:28:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:19 smithi193 ceph-mon[32782]: pgmap v359: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s; 51 B/s, 0 objects/s recovering 2024-04-26T11:28:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:19 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/312903759' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T11:28:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:19 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T11:28:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:19 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T11:28:19.885 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:28:19.885 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-26T11:28:19.885 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T11:28:20.000 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T11:28:20.000 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-26T11:28:20.000 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-26T11:28:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:19 smithi196 ceph-mon[32572]: pgmap v359: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 7 op/s; 51 B/s, 0 objects/s recovering 2024-04-26T11:28:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:19 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/312903759' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T11:28:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:19 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T11:28:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:19 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T11:28:20.484 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:21 smithi193 ceph-mon[32782]: pgmap v360: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:21 smithi196 ceph-mon[32572]: pgmap v360: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:22.012 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:21 smithi110 ceph-mon[28069]: pgmap v360: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:22.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.833+0000 7fb2bb200700 1 -- 172.21.15.110:0/2650456263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2bc10a320 msgr2=0x7fb2bc1167c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:22.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.833+0000 7fb2bb200700 1 --2- 172.21.15.110:0/2650456263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2bc10a320 0x7fb2bc1167c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400b0a0 tx=0x7fb2b400b3b0 comp rx=0 tx=0).stop 2024-04-26T11:28:22.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.833+0000 7fb2bb200700 1 -- 172.21.15.110:0/2650456263 shutdown_connections 2024-04-26T11:28:22.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.833+0000 7fb2bb200700 1 --2- 172.21.15.110:0/2650456263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2bc10a320 0x7fb2bc1167c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:22.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.833+0000 7fb2bb200700 1 --2- 172.21.15.110:0/2650456263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2bc10e830 0x7fb2bc10ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:22.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.833+0000 7fb2bb200700 1 --2- 172.21.15.110:0/2650456263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2bc109960 0x7fb2bc109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:22.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.833+0000 7fb2bb200700 1 -- 172.21.15.110:0/2650456263 >> 172.21.15.110:0/2650456263 conn(0x7fb2bc0791b0 msgr2=0x7fb2bc108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:22.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.833+0000 7fb2bb200700 1 -- 172.21.15.110:0/2650456263 shutdown_connections 2024-04-26T11:28:22.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.833+0000 7fb2bb200700 1 -- 172.21.15.110:0/2650456263 wait complete. 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.834+0000 7fb2bb200700 1 Processor -- start 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.834+0000 7fb2bb200700 1 -- start start 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.834+0000 7fb2bb200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2bc109960 0x7fb2bc19ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.834+0000 7fb2bb200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2bc10a320 0x7fb2bc1a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.834+0000 7fb2bb200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2bc10e830 0x7fb2bc1a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.834+0000 7fb2bb200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc119b00 con 0x7fb2bc10e830 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.834+0000 7fb2bb200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc119980 con 0x7fb2bc10a320 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.834+0000 7fb2bb200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc119c80 con 0x7fb2bc109960 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2bc109960 0x7fb2bc19ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2bc109960 0x7fb2bc19ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:58908/0 (socket says 172.21.15.110:58908) 2024-04-26T11:28:22.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9e00700 1 -- 172.21.15.110:0/502251097 learned_addr learned my addr 172.21.15.110:0/502251097 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:22.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2ba800700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2bc10e830 0x7fb2bc1a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:22.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9400700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2bc10a320 0x7fb2bc1a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:22.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9400700 1 -- 172.21.15.110:0/502251097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2bc109960 msgr2=0x7fb2bc19ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9400700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2bc109960 0x7fb2bc19ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9400700 1 -- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2bc10e830 msgr2=0x7fb2bc1a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9400700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2bc10e830 0x7fb2bc1a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9400700 1 -- 172.21.15.110:0/502251097 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc1a4f70 con 0x7fb2bc10a320 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2ba800700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2bc10e830 0x7fb2bc1a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9e00700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2bc109960 0x7fb2bc19ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.835+0000 7fb2b9400700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2bc10a320 0x7fb2bc1a04f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800e9f0 tx=0x7fb2a800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.836+0000 7fb2b2a00700 1 -- 172.21.15.110:0/502251097 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800c9c0 con 0x7fb2bc10a320 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.836+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc1a5260 con 0x7fb2bc10a320 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.836+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc1acae0 con 0x7fb2bc10a320 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.836+0000 7fb2b2a00700 1 -- 172.21.15.110:0/502251097 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2a800cb60 con 0x7fb2bc10a320 2024-04-26T11:28:22.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.836+0000 7fb2b2a00700 1 -- 172.21.15.110:0/502251097 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8026060 con 0x7fb2bc10a320 2024-04-26T11:28:22.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.837+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb29c005330 con 0x7fb2bc10a320 2024-04-26T11:28:22.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.840+0000 7fb2b2a00700 1 -- 172.21.15.110:0/502251097 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb2a800cd10 con 0x7fb2bc10a320 2024-04-26T11:28:22.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.841+0000 7fb2b2a00700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2a00a3d50 0x7fb2a00a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:22.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.841+0000 7fb2b2a00700 1 -- 172.21.15.110:0/502251097 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7fb2a80d0600 con 0x7fb2bc10a320 2024-04-26T11:28:22.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.841+0000 7fb2b9e00700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2a00a3d50 0x7fb2a00a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:22.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.842+0000 7fb2b9e00700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2a00a3d50 0x7fb2a00a6210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009680 tx=0x7fb2ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:22.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:22.845+0000 7fb2b2a00700 1 -- 172.21.15.110:0/502251097 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb2a809ce00 con 0x7fb2bc10a320 2024-04-26T11:28:23.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.135+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb29c0058f0 con 0x7fb2bc10a320 2024-04-26T11:28:23.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.141+0000 7fb2b2a00700 1 -- 172.21.15.110:0/502251097 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+265006 (secure 0 0 0) 0x7fb2a809c700 con 0x7fb2bc10a320 2024-04-26T11:28:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:28:23.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2a00a3d50 msgr2=0x7fb2a00a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:23.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2a00a3d50 0x7fb2a00a6210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009680 tx=0x7fb2ac009260 comp rx=0 tx=0).stop 2024-04-26T11:28:23.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2bc10a320 msgr2=0x7fb2bc1a04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:23.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2bc10a320 0x7fb2bc1a04f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800e9f0 tx=0x7fb2a800ed00 comp rx=0 tx=0).stop 2024-04-26T11:28:23.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 shutdown_connections 2024-04-26T11:28:23.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2bc10e830 0x7fb2bc1a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:23.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb2a00a3d50 0x7fb2a00a6210 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:23.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2bc109960 0x7fb2bc19ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:23.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 --2- 172.21.15.110:0/502251097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2bc10a320 0x7fb2bc1a04f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:23.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 >> 172.21.15.110:0/502251097 conn(0x7fb2bc0791b0 msgr2=0x7fb2bc079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:23.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 shutdown_connections 2024-04-26T11:28:23.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:23.147+0000 7fb2bb200700 1 -- 172.21.15.110:0/502251097 wait complete. 2024-04-26T11:28:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:23 smithi193 ceph-mon[32782]: pgmap v361: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:23 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/502251097' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T11:28:23.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:23 smithi110 ceph-mon[28069]: pgmap v361: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:23.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:23 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/502251097' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T11:28:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:23 smithi196 ceph-mon[32572]: pgmap v361: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:23 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/502251097' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T11:28:24.037 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2430566216},{"type":"v1","addr":"172.21.15.110:6801","nonce":2430566216}]},"active_addr":"172.21.15.110:6801/2430566216","active_change":"2024-04-26T11:19:02.329903+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.110:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3533907291}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3329534526}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2963218593}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":813190132}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":4007376252}]}]} 2024-04-26T11:28:24.043 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-26T11:28:24.043 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-26T11:28:24.044 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T11:28:24.509 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:25 smithi193 ceph-mon[32782]: pgmap v362: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:25 smithi196 ceph-mon[32572]: pgmap v362: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:25 smithi110 ceph-mon[28069]: pgmap v362: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:27.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.017+0000 7f73ca000700 1 -- 172.21.15.110:0/1605745697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c4105640 msgr2=0x7f73c4105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:27.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.017+0000 7f73ca000700 1 --2- 172.21.15.110:0/1605745697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c4105640 0x7f73c4105ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009990 tx=0x7f73ac009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.017+0000 7f73ca000700 1 -- 172.21.15.110:0/1605745697 shutdown_connections 2024-04-26T11:28:27.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.017+0000 7f73ca000700 1 --2- 172.21.15.110:0/1605745697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73c4106000 0x7f73c4112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.017+0000 7f73ca000700 1 --2- 172.21.15.110:0/1605745697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c410b640 0x7f73c410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.017+0000 7f73ca000700 1 --2- 172.21.15.110:0/1605745697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c4105640 0x7f73c4105ac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.018+0000 7f73ca000700 1 -- 172.21.15.110:0/1605745697 >> 172.21.15.110:0/1605745697 conn(0x7f73c4101130 msgr2=0x7f73c4103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:27.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.018+0000 7f73ca000700 1 -- 172.21.15.110:0/1605745697 shutdown_connections 2024-04-26T11:28:27.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.018+0000 7f73ca000700 1 -- 172.21.15.110:0/1605745697 wait complete. 2024-04-26T11:28:27.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.019+0000 7f73ca000700 1 Processor -- start 2024-04-26T11:28:27.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.019+0000 7f73ca000700 1 -- start start 2024-04-26T11:28:27.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73ca000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73c4105640 0x7f73c419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:27.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73ca000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c4106000 0x7f73c419c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:27.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73ca000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c410b640 0x7f73c41a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:27.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73ca000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f73c4115890 con 0x7f73c4106000 2024-04-26T11:28:27.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73ca000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f73c4115710 con 0x7f73c410b640 2024-04-26T11:28:27.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73ca000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f73c4115a10 con 0x7f73c4105640 2024-04-26T11:28:27.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73c3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73c4105640 0x7f73c419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73c3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73c4105640 0x7f73c419bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:58932/0 (socket says 172.21.15.110:58932) 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73c3400700 1 -- 172.21.15.110:0/502001270 learned_addr learned my addr 172.21.15.110:0/502001270 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73bbe00700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c4106000 0x7f73c419c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73c3e00700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c410b640 0x7f73c41a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73c3400700 1 -- 172.21.15.110:0/502001270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c410b640 msgr2=0x7f73c41a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.020+0000 7f73c3400700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c410b640 0x7f73c41a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73c3400700 1 -- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c4106000 msgr2=0x7f73c419c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73c3400700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c4106000 0x7f73c419c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73c3400700 1 -- 172.21.15.110:0/502001270 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c41a0d50 con 0x7f73c4105640 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73bbe00700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c4106000 0x7f73c419c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:28:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73c3e00700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c410b640 0x7f73c41a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:28:27.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73c3400700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73c4105640 0x7f73c419bd40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f73b400d950 tx=0x7f73b400dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:27.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73c0c00700 1 -- 172.21.15.110:0/502001270 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4016070 con 0x7f73c4105640 2024-04-26T11:28:27.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73c0c00700 1 -- 172.21.15.110:0/502001270 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73b4010460 con 0x7f73c4105640 2024-04-26T11:28:27.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c41a1040 con 0x7f73c4105640 2024-04-26T11:28:27.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73c0c00700 1 -- 172.21.15.110:0/502001270 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b400f620 con 0x7f73c4105640 2024-04-26T11:28:27.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.021+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c41a88c0 con 0x7f73c4105640 2024-04-26T11:28:27.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.022+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c406a110 con 0x7f73c4105640 2024-04-26T11:28:27.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.024+0000 7f73c0c00700 1 -- 172.21.15.110:0/502001270 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f73b4019070 con 0x7f73c4105640 2024-04-26T11:28:27.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.026+0000 7f73c0c00700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f73a80a3cd0 0x7f73a80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:27.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.026+0000 7f73c0c00700 1 -- 172.21.15.110:0/502001270 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f73b40d0200 con 0x7f73c4105640 2024-04-26T11:28:27.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.026+0000 7f73bbe00700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f73a80a3cd0 0x7f73a80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:27.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.027+0000 7f73bbe00700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f73a80a3cd0 0x7f73a80a6190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00b2e0 tx=0x7f73ac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:27.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.030+0000 7f73c0c00700 1 -- 172.21.15.110:0/502001270 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f73b409ca00 con 0x7f73c4105640 2024-04-26T11:28:27.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.260+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73c402e490 con 0x7f73c4105640 2024-04-26T11:28:27.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.262+0000 7f73c0c00700 1 -- 172.21.15.110:0/502001270 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22829 (secure 0 0 0) 0x7f73b409c300 con 0x7f73c4105640 2024-04-26T11:28:27.264 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:28:27.264 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":91,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","created":"2024-04-26T11:17:56.437545+0000","modified":"2024-04-26T11:28:03.421580+0000","last_up_change":"2024-04-26T11:25:57.427695+0000","last_in_change":"2024-04-26T11:25:38.050280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:44.478027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:27:06.034467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T11:27:11.025123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13eb997d-8b4a-47f5-be11-772d47788972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6803","nonce":1662740885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6805","nonce":1662740885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6809","nonce":1662740885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6807","nonce":1662740885}]},"public_addr":"172.21.15.110:6803/1662740885","cluster_addr":"172.21.15.110:6805/1662740885","heartbeat_back_addr":"172.21.15.110:6809/1662740885","heartbeat_front_addr":"172.21.15.110:6807/1662740885","state":["exists","up"]},{"osd":1,"uuid":"e7927dc3-dced-4661-8493-840e111241e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6801","nonce":1751461680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6803","nonce":1751461680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6807","nonce":1751461680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6805","nonce":1751461680}]},"public_addr":"172.21.15.193:6801/1751461680","cluster_addr":"172.21.15.193:6803/1751461680","heartbeat_back_addr":"172.21.15.193:6807/1751461680","heartbeat_front_addr":"172.21.15.193:6805/1751461680","state":["exists","up"]},{"osd":2,"uuid":"54459a80-91a1-45ba-b7e4-900a4a995219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6801","nonce":1785522554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6803","nonce":1785522554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6807","nonce":1785522554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6805","nonce":1785522554}]},"public_addr":"172.21.15.196:6801/1785522554","cluster_addr":"172.21.15.196:6803/1785522554","heartbeat_back_addr":"172.21.15.196:6807/1785522554","heartbeat_front_addr":"172.21.15.196:6805/1785522554","state":["exists","up"]},{"osd":3,"uuid":"12d8a1be-5edb-4af2-b01d-abd943f89641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6811","nonce":2253549266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6813","nonce":2253549266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6817","nonce":2253549266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6815","nonce":2253549266}]},"public_addr":"172.21.15.110:6811/2253549266","cluster_addr":"172.21.15.110:6813/2253549266","heartbeat_back_addr":"172.21.15.110:6817/2253549266","heartbeat_front_addr":"172.21.15.110:6815/2253549266","state":["exists","up"]},{"osd":4,"uuid":"f3057080-144b-4f43-9a63-8f415ca76d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6809","nonce":1314161856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6811","nonce":1314161856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6815","nonce":1314161856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6813","nonce":1314161856}]},"public_addr":"172.21.15.193:6809/1314161856","cluster_addr":"172.21.15.193:6811/1314161856","heartbeat_back_addr":"172.21.15.193:6815/1314161856","heartbeat_front_addr":"172.21.15.193:6813/1314161856","state":["exists","up"]},{"osd":5,"uuid":"f0775b9c-938e-4bb4-ae1e-01ef0686cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6809","nonce":2359280243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6811","nonce":2359280243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6815","nonce":2359280243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6813","nonce":2359280243}]},"public_addr":"172.21.15.196:6809/2359280243","cluster_addr":"172.21.15.196:6811/2359280243","heartbeat_back_addr":"172.21.15.196:6815/2359280243","heartbeat_front_addr":"172.21.15.196:6813/2359280243","state":["exists","up"]},{"osd":6,"uuid":"ea4ea3de-4ec4-48a1-809e-da62fcbb7033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6819","nonce":1730783886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6821","nonce":1730783886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6825","nonce":1730783886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6823","nonce":1730783886}]},"public_addr":"172.21.15.110:6819/1730783886","cluster_addr":"172.21.15.110:6821/1730783886","heartbeat_back_addr":"172.21.15.110:6825/1730783886","heartbeat_front_addr":"172.21.15.110:6823/1730783886","state":["exists","up"]},{"osd":7,"uuid":"98af7071-82b3-4732-b2a1-8676e6439cd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6817","nonce":4124476381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6819","nonce":4124476381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6823","nonce":4124476381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6821","nonce":4124476381}]},"public_addr":"172.21.15.193:6817/4124476381","cluster_addr":"172.21.15.193:6819/4124476381","heartbeat_back_addr":"172.21.15.193:6823/4124476381","heartbeat_front_addr":"172.21.15.193:6821/4124476381","state":["exists","up"]},{"osd":8,"uuid":"7aaa3c52-72f5-4946-a964-609f65b778f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6817","nonce":2942176519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6819","nonce":2942176519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6823","nonce":2942176519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6821","nonce":2942176519}]},"public_addr":"172.21.15.196:6817/2942176519","cluster_addr":"172.21.15.196:6819/2942176519","heartbeat_back_addr":"172.21.15.196:6823/2942176519","heartbeat_front_addr":"172.21.15.196:6821/2942176519","state":["exists","up"]},{"osd":9,"uuid":"2cde3ed2-6acd-48a4-a99d-aa558dd85baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6827","nonce":2620757358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6829","nonce":2620757358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6833","nonce":2620757358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6831","nonce":2620757358}]},"public_addr":"172.21.15.110:6827/2620757358","cluster_addr":"172.21.15.110:6829/2620757358","heartbeat_back_addr":"172.21.15.110:6833/2620757358","heartbeat_front_addr":"172.21.15.110:6831/2620757358","state":["exists","up"]},{"osd":10,"uuid":"3bbaac8f-fe7b-4f0e-a25b-286c3c30926e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6825","nonce":676480728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6827","nonce":676480728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6831","nonce":676480728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6829","nonce":676480728}]},"public_addr":"172.21.15.193:6825/676480728","cluster_addr":"172.21.15.193:6827/676480728","heartbeat_back_addr":"172.21.15.193:6831/676480728","heartbeat_front_addr":"172.21.15.193:6829/676480728","state":["exists","up"]},{"osd":11,"uuid":"e31c248e-1016-4765-bea1-9f31d823ca3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6825","nonce":2802765812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6827","nonce":2802765812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6831","nonce":2802765812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6829","nonce":2802765812}]},"public_addr":"172.21.15.196:6825/2802765812","cluster_addr":"172.21.15.196:6827/2802765812","heartbeat_back_addr":"172.21.15.196:6831/2802765812","heartbeat_front_addr":"172.21.15.196:6829/2802765812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:20:52.046788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:16.893940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:40.861409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:13.272469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:39.214479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:03.529206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:37.413989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:04.145639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:29.162356+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:03.325672+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:30.353695+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:56.267402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3278958945":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6801/4292256031":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3536224934":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2250601964":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/2775667488":"2024-04-27T11:18:29.387925+0000","172.21.15.110:6801/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/337370067":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3594651859":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/4292256031":"2024-04-27T11:19:02.329691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:28:27.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f73a80a3cd0 msgr2=0x7f73a80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:27.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f73a80a3cd0 0x7f73a80a6190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00b2e0 tx=0x7f73ac01a040 comp rx=0 tx=0).stop 2024-04-26T11:28:27.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73c4105640 msgr2=0x7f73c419bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:27.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73c4105640 0x7f73c419bd40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f73b400d950 tx=0x7f73b400dd10 comp rx=0 tx=0).stop 2024-04-26T11:28:27.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 shutdown_connections 2024-04-26T11:28:27.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73c410b640 0x7f73c41a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f73a80a3cd0 0x7f73a80a6190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73c4105640 0x7f73c419bd40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 --2- 172.21.15.110:0/502001270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c4106000 0x7f73c419c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:27.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.266+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 >> 172.21.15.110:0/502001270 conn(0x7f73c4101130 msgr2=0x7f73c41017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:27.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.267+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 shutdown_connections 2024-04-26T11:28:27.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:27.267+0000 7f73ca000700 1 -- 172.21.15.110:0/502001270 wait complete. 2024-04-26T11:28:27.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:27 smithi193 ceph-mon[32782]: pgmap v363: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:27.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:27 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/502001270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:28:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:27 smithi196 ceph-mon[32572]: pgmap v363: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:27 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/502001270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:28:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:27 smithi110 ceph-mon[28069]: pgmap v363: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:27 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/502001270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:28:28.289 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-26T11:28:28.289 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T11:28:28.748 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:29 smithi193 ceph-mon[32782]: pgmap v364: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:29.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:29 smithi110 ceph-mon[28069]: pgmap v364: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:29 smithi196 ceph-mon[32572]: pgmap v364: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:30.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.956+0000 7f02a6200700 1 -- 172.21.15.110:0/1916260309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a01094c0 msgr2=0x7f02a01098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:30.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.956+0000 7f02a6200700 1 --2- 172.21.15.110:0/1916260309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a01094c0 0x7f02a01098a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0290009990 tx=0x7f0290009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:30.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.956+0000 7f02a6200700 1 -- 172.21.15.110:0/1916260309 shutdown_connections 2024-04-26T11:28:30.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.956+0000 7f02a6200700 1 --2- 172.21.15.110:0/1916260309 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02a0103e30 0x7f02a0110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:30.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.956+0000 7f02a6200700 1 --2- 172.21.15.110:0/1916260309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a01094c0 0x7f02a01098a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:30.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.956+0000 7f02a6200700 1 --2- 172.21.15.110:0/1916260309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a0103470 0x7f02a01038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:30.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.956+0000 7f02a6200700 1 -- 172.21.15.110:0/1916260309 >> 172.21.15.110:0/1916260309 conn(0x7f02a007a580 msgr2=0x7f02a007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:30.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.956+0000 7f02a6200700 1 -- 172.21.15.110:0/1916260309 shutdown_connections 2024-04-26T11:28:30.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.956+0000 7f02a6200700 1 -- 172.21.15.110:0/1916260309 wait complete. 2024-04-26T11:28:30.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.957+0000 7f02a6200700 1 Processor -- start 2024-04-26T11:28:30.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.957+0000 7f02a6200700 1 -- start start 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f02a6200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0103470 0x7f02a0075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f02a6200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02a0103e30 0x7f02a0075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f02a6200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a01094c0 0x7f02a00761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f02a6200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f02a01135c0 con 0x7f02a0103470 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f02a6200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02a0113440 con 0x7f02a01094c0 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f02a6200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f02a0113740 con 0x7f02a0103e30 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f029f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0103470 0x7f02a0075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f029ea00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02a0103e30 0x7f02a0075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f029f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0103470 0x7f02a0075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59360/0 (socket says 172.21.15.110:59360) 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f029f400700 1 -- 172.21.15.110:0/3512092925 learned_addr learned my addr 172.21.15.110:0/3512092925 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:30.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.958+0000 7f029fe00700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a01094c0 0x7f02a00761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:30.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f029f400700 1 -- 172.21.15.110:0/3512092925 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02a0103e30 msgr2=0x7f02a0075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:30.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f029f400700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02a0103e30 0x7f02a0075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f029f400700 1 -- 172.21.15.110:0/3512092925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a01094c0 msgr2=0x7f02a00761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f029f400700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a01094c0 0x7f02a00761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f029f400700 1 -- 172.21.15.110:0/3512092925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a01a8060 con 0x7f02a0103470 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f029ea00700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02a0103e30 0x7f02a0075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f029f400700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0103470 0x7f02a0075720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f02900057c0 tx=0x7f0290009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f0297e00700 1 -- 172.21.15.110:0/3512092925 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290026070 con 0x7f02a0103470 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f0297e00700 1 -- 172.21.15.110:0/3512092925 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0290021410 con 0x7f02a0103470 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.959+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a01a82f0 con 0x7f02a0103470 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.960+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a01a87d0 con 0x7f02a0103470 2024-04-26T11:28:30.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.960+0000 7f0297e00700 1 -- 172.21.15.110:0/3512092925 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290017650 con 0x7f02a0103470 2024-04-26T11:28:30.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.961+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a006a110 con 0x7f02a0103470 2024-04-26T11:28:30.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.963+0000 7f0297e00700 1 -- 172.21.15.110:0/3512092925 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f0290029070 con 0x7f02a0103470 2024-04-26T11:28:30.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.964+0000 7f0297e00700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02840a3cd0 0x7f02840a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:30.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.964+0000 7f0297e00700 1 -- 172.21.15.110:0/3512092925 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f02900d13f0 con 0x7f02a0103470 2024-04-26T11:28:30.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.964+0000 7f029ea00700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02840a3cd0 0x7f02840a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:30.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.965+0000 7f029ea00700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02840a3cd0 0x7f02840a6190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0288009680 tx=0x7f0288009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:30.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:30.969+0000 7f0297e00700 1 -- 172.21.15.110:0/3512092925 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f029005dff0 con 0x7f02a0103470 2024-04-26T11:28:31.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.196+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02a002e490 con 0x7f02a0103470 2024-04-26T11:28:31.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.199+0000 7f0297e00700 1 -- 172.21.15.110:0/3512092925 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22829 (secure 0 0 0) 0x7f0290013070 con 0x7f02a0103470 2024-04-26T11:28:31.201 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:28:31.201 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":91,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","created":"2024-04-26T11:17:56.437545+0000","modified":"2024-04-26T11:28:03.421580+0000","last_up_change":"2024-04-26T11:25:57.427695+0000","last_in_change":"2024-04-26T11:25:38.050280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:44.478027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:27:06.034467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T11:27:11.025123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13eb997d-8b4a-47f5-be11-772d47788972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6803","nonce":1662740885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6805","nonce":1662740885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6809","nonce":1662740885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6807","nonce":1662740885}]},"public_addr":"172.21.15.110:6803/1662740885","cluster_addr":"172.21.15.110:6805/1662740885","heartbeat_back_addr":"172.21.15.110:6809/1662740885","heartbeat_front_addr":"172.21.15.110:6807/1662740885","state":["exists","up"]},{"osd":1,"uuid":"e7927dc3-dced-4661-8493-840e111241e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6801","nonce":1751461680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6803","nonce":1751461680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6807","nonce":1751461680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6805","nonce":1751461680}]},"public_addr":"172.21.15.193:6801/1751461680","cluster_addr":"172.21.15.193:6803/1751461680","heartbeat_back_addr":"172.21.15.193:6807/1751461680","heartbeat_front_addr":"172.21.15.193:6805/1751461680","state":["exists","up"]},{"osd":2,"uuid":"54459a80-91a1-45ba-b7e4-900a4a995219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6801","nonce":1785522554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6803","nonce":1785522554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6807","nonce":1785522554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6805","nonce":1785522554}]},"public_addr":"172.21.15.196:6801/1785522554","cluster_addr":"172.21.15.196:6803/1785522554","heartbeat_back_addr":"172.21.15.196:6807/1785522554","heartbeat_front_addr":"172.21.15.196:6805/1785522554","state":["exists","up"]},{"osd":3,"uuid":"12d8a1be-5edb-4af2-b01d-abd943f89641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6811","nonce":2253549266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6813","nonce":2253549266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6817","nonce":2253549266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6815","nonce":2253549266}]},"public_addr":"172.21.15.110:6811/2253549266","cluster_addr":"172.21.15.110:6813/2253549266","heartbeat_back_addr":"172.21.15.110:6817/2253549266","heartbeat_front_addr":"172.21.15.110:6815/2253549266","state":["exists","up"]},{"osd":4,"uuid":"f3057080-144b-4f43-9a63-8f415ca76d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6809","nonce":1314161856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6811","nonce":1314161856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6815","nonce":1314161856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6813","nonce":1314161856}]},"public_addr":"172.21.15.193:6809/1314161856","cluster_addr":"172.21.15.193:6811/1314161856","heartbeat_back_addr":"172.21.15.193:6815/1314161856","heartbeat_front_addr":"172.21.15.193:6813/1314161856","state":["exists","up"]},{"osd":5,"uuid":"f0775b9c-938e-4bb4-ae1e-01ef0686cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6809","nonce":2359280243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6811","nonce":2359280243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6815","nonce":2359280243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6813","nonce":2359280243}]},"public_addr":"172.21.15.196:6809/2359280243","cluster_addr":"172.21.15.196:6811/2359280243","heartbeat_back_addr":"172.21.15.196:6815/2359280243","heartbeat_front_addr":"172.21.15.196:6813/2359280243","state":["exists","up"]},{"osd":6,"uuid":"ea4ea3de-4ec4-48a1-809e-da62fcbb7033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6819","nonce":1730783886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6821","nonce":1730783886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6825","nonce":1730783886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6823","nonce":1730783886}]},"public_addr":"172.21.15.110:6819/1730783886","cluster_addr":"172.21.15.110:6821/1730783886","heartbeat_back_addr":"172.21.15.110:6825/1730783886","heartbeat_front_addr":"172.21.15.110:6823/1730783886","state":["exists","up"]},{"osd":7,"uuid":"98af7071-82b3-4732-b2a1-8676e6439cd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6817","nonce":4124476381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6819","nonce":4124476381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6823","nonce":4124476381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6821","nonce":4124476381}]},"public_addr":"172.21.15.193:6817/4124476381","cluster_addr":"172.21.15.193:6819/4124476381","heartbeat_back_addr":"172.21.15.193:6823/4124476381","heartbeat_front_addr":"172.21.15.193:6821/4124476381","state":["exists","up"]},{"osd":8,"uuid":"7aaa3c52-72f5-4946-a964-609f65b778f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6817","nonce":2942176519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6819","nonce":2942176519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6823","nonce":2942176519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6821","nonce":2942176519}]},"public_addr":"172.21.15.196:6817/2942176519","cluster_addr":"172.21.15.196:6819/2942176519","heartbeat_back_addr":"172.21.15.196:6823/2942176519","heartbeat_front_addr":"172.21.15.196:6821/2942176519","state":["exists","up"]},{"osd":9,"uuid":"2cde3ed2-6acd-48a4-a99d-aa558dd85baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6827","nonce":2620757358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6829","nonce":2620757358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6833","nonce":2620757358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6831","nonce":2620757358}]},"public_addr":"172.21.15.110:6827/2620757358","cluster_addr":"172.21.15.110:6829/2620757358","heartbeat_back_addr":"172.21.15.110:6833/2620757358","heartbeat_front_addr":"172.21.15.110:6831/2620757358","state":["exists","up"]},{"osd":10,"uuid":"3bbaac8f-fe7b-4f0e-a25b-286c3c30926e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6825","nonce":676480728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6827","nonce":676480728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6831","nonce":676480728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6829","nonce":676480728}]},"public_addr":"172.21.15.193:6825/676480728","cluster_addr":"172.21.15.193:6827/676480728","heartbeat_back_addr":"172.21.15.193:6831/676480728","heartbeat_front_addr":"172.21.15.193:6829/676480728","state":["exists","up"]},{"osd":11,"uuid":"e31c248e-1016-4765-bea1-9f31d823ca3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6825","nonce":2802765812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6827","nonce":2802765812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6831","nonce":2802765812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6829","nonce":2802765812}]},"public_addr":"172.21.15.196:6825/2802765812","cluster_addr":"172.21.15.196:6827/2802765812","heartbeat_back_addr":"172.21.15.196:6831/2802765812","heartbeat_front_addr":"172.21.15.196:6829/2802765812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:20:52.046788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:16.893940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:40.861409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:13.272469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:39.214479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:03.529206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:37.413989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:04.145639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:29.162356+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:03.325672+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:30.353695+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:56.267402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3278958945":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6801/4292256031":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3536224934":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2250601964":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/2775667488":"2024-04-27T11:18:29.387925+0000","172.21.15.110:6801/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/337370067":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3594651859":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/4292256031":"2024-04-27T11:19:02.329691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:28:31.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.202+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02840a3cd0 msgr2=0x7f02840a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:31.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.202+0000 7f02a6200700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02840a3cd0 0x7f02840a6190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0288009680 tx=0x7f0288009260 comp rx=0 tx=0).stop 2024-04-26T11:28:31.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0103470 msgr2=0x7f02a0075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:31.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0103470 0x7f02a0075720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f02900057c0 tx=0x7f0290009580 comp rx=0 tx=0).stop 2024-04-26T11:28:31.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 shutdown_connections 2024-04-26T11:28:31.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a01094c0 0x7f02a00761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:31.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0103470 0x7f02a0075720 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:31.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f02840a3cd0 0x7f02840a6190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:31.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 --2- 172.21.15.110:0/3512092925 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02a0103e30 0x7f02a0075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:31.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 >> 172.21.15.110:0/3512092925 conn(0x7f02a007a580 msgr2=0x7f02a01022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:31.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 shutdown_connections 2024-04-26T11:28:31.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:31.203+0000 7f02a6200700 1 -- 172.21.15.110:0/3512092925 wait complete. 2024-04-26T11:28:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:31 smithi193 ceph-mon[32782]: pgmap v365: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:31 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3512092925' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:28:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:31 smithi196 ceph-mon[32572]: pgmap v365: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:31 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3512092925' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:28:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:31 smithi110 ceph-mon[28069]: pgmap v365: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:31 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3512092925' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:28:32.124 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-26T11:28:32.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-26T11:28:32.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-26T11:28:32.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-26T11:28:32.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-26T11:28:32.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-26T11:28:32.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-26T11:28:32.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-26T11:28:32.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-26T11:28:32.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-26T11:28:32.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-26T11:28:32.129 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-26T11:28:33.258 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.264 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.271 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.272 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.293 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.293 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.294 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.294 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.296 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.298 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.311 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.341 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:28:33.738 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:33 smithi110 ceph-mon[28069]: pgmap v366: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:33 smithi193 ceph-mon[32782]: pgmap v366: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:33 smithi196 ceph-mon[32572]: pgmap v366: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:35.884 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:35 smithi110 ceph-mon[28069]: pgmap v367: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:35 smithi196 ceph-mon[32572]: pgmap v367: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:35 smithi193 ceph-mon[32782]: pgmap v367: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:37.869 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:37 smithi110 ceph-mon[28069]: pgmap v368: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:37 smithi196 ceph-mon[32572]: pgmap v368: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:37 smithi193 ceph-mon[32782]: pgmap v368: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:40.000 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:39 smithi110 ceph-mon[28069]: pgmap v369: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:28:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:39 smithi196 ceph-mon[32572]: pgmap v369: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:28:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:39 smithi193 ceph-mon[32782]: pgmap v369: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:28:41.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.959+0000 7f01efe00700 1 -- 172.21.15.110:0/3427980391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f010e830 msgr2=0x7f01f010ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:41.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.959+0000 7f01efe00700 1 --2- 172.21.15.110:0/3427980391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f010e830 0x7f01f010ec10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009990 tx=0x7f01e0009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:41.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.959+0000 7f01efe00700 1 -- 172.21.15.110:0/3427980391 shutdown_connections 2024-04-26T11:28:41.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.959+0000 7f01efe00700 1 --2- 172.21.15.110:0/3427980391 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01f010a320 0x7f01f01167c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:41.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.959+0000 7f01efe00700 1 --2- 172.21.15.110:0/3427980391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f010e830 0x7f01f010ec10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:41.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.959+0000 7f01efe00700 1 --2- 172.21.15.110:0/3427980391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f0109960 0x7f01f0109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.959+0000 7f01efe00700 1 -- 172.21.15.110:0/3427980391 >> 172.21.15.110:0/3427980391 conn(0x7f01f00791b0 msgr2=0x7f01f0108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.959+0000 7f01efe00700 1 -- 172.21.15.110:0/3427980391 shutdown_connections 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.959+0000 7f01efe00700 1 -- 172.21.15.110:0/3427980391 wait complete. 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.960+0000 7f01efe00700 1 Processor -- start 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.960+0000 7f01efe00700 1 -- start start 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01efe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0109960 0x7f01f01a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01efe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01f010a320 0x7f01f01a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01efe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f010e830 0x7f01f01a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01efe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0119b70 con 0x7f01f0109960 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01efe00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f01f01199f0 con 0x7f01f010e830 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01efe00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0119cf0 con 0x7f01f010a320 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01eea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0109960 0x7f01f01a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01eea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0109960 0x7f01f01a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35626/0 (socket says 172.21.15.110:35626) 2024-04-26T11:28:41.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01eea00700 1 -- 172.21.15.110:0/2665749775 learned_addr learned my addr 172.21.15.110:0/2665749775 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01ef400700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f010e830 0x7f01f01a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01e7e00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01f010a320 0x7f01f01a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01eea00700 1 -- 172.21.15.110:0/2665749775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01f010a320 msgr2=0x7f01f01a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01eea00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01f010a320 0x7f01f01a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01eea00700 1 -- 172.21.15.110:0/2665749775 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f010e830 msgr2=0x7f01f01a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01eea00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f010e830 0x7f01f01a49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.961+0000 7f01eea00700 1 -- 172.21.15.110:0/2665749775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f01a5110 con 0x7f01f0109960 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.962+0000 7f01eea00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0109960 0x7f01f01a0100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f01e0005910 tx=0x7f01e000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.962+0000 7f01f4a00700 1 -- 172.21.15.110:0/2665749775 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0027070 con 0x7f01f0109960 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.962+0000 7f01f4a00700 1 -- 172.21.15.110:0/2665749775 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01e0022470 con 0x7f01f0109960 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.962+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f01a53a0 con 0x7f01f0109960 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.962+0000 7f01f4a00700 1 -- 172.21.15.110:0/2665749775 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0017650 con 0x7f01f0109960 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.962+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f01acc80 con 0x7f01f0109960 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.963+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01f0063b30 con 0x7f01f0109960 2024-04-26T11:28:41.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.965+0000 7f01f4a00700 1 -- 172.21.15.110:0/2665749775 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f01e002a070 con 0x7f01f0109960 2024-04-26T11:28:41.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.966+0000 7f01f4a00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01d40a3d50 0x7f01d40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:41.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.967+0000 7f01f4a00700 1 -- 172.21.15.110:0/2665749775 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f01e00d1700 con 0x7f01f0109960 2024-04-26T11:28:41.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.967+0000 7f01e7e00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01d40a3d50 0x7f01d40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:41.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.967+0000 7f01f4a00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] conn(0x7f01d40ad990 0x7f01d40afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:41.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.967+0000 7f01f4a00700 1 -- 172.21.15.110:0/2665749775 --> [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01d40b0500 con 0x7f01d40ad990 2024-04-26T11:28:41.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.967+0000 7f01f4a00700 1 -- 172.21.15.110:0/2665749775 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f01e00d1ab0 con 0x7f01f0109960 2024-04-26T11:28:41.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.967+0000 7f01ef400700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] conn(0x7f01d40ad990 0x7f01d40afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:41.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.967+0000 7f01e7e00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01d40a3d50 0x7f01d40a6210 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01f0109580 tx=0x7f01d8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:41.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.968+0000 7f01ef400700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] conn(0x7f01d40ad990 0x7f01d40afe30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:41.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.969+0000 7f01f4a00700 1 -- 172.21.15.110:0/2665749775 <== osd.5 v2:172.21.15.196:6808/2359280243 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01d40b0500 con 0x7f01d40ad990 2024-04-26T11:28:41.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.987+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 --> [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f01f0063f30 con 0x7f01d40ad990 2024-04-26T11:28:41.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.988+0000 7f01f4a00700 1 -- 172.21.15.110:0/2665749775 <== osd.5 v2:172.21.15.196:6808/2359280243 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f01f0063f30 con 0x7f01d40ad990 2024-04-26T11:28:41.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.988+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 >> [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] conn(0x7f01d40ad990 msgr2=0x7f01d40afe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:41.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.988+0000 7f01efe00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] conn(0x7f01d40ad990 0x7f01d40afe30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:41.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.988+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01d40a3d50 msgr2=0x7f01d40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:41.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:41 smithi110 ceph-mon[28069]: pgmap v370: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:41.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.988+0000 7f01efe00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01d40a3d50 0x7f01d40a6210 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01f0109580 tx=0x7f01d8009260 comp rx=0 tx=0).stop 2024-04-26T11:28:41.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.988+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0109960 msgr2=0x7f01f01a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:41.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.988+0000 7f01efe00700 1 --2- 172.21.15.110:0/2665749775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01f0109960 0x7f01f01a0100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f01e0005910 tx=0x7f01e000b670 comp rx=0 tx=0).stop 2024-04-26T11:28:41.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.988+0000 7f01ef400700 1 -- 172.21.15.110:0/2665749775 reap_dead start 2024-04-26T11:28:41.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.989+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 shutdown_connections 2024-04-26T11:28:41.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.989+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 >> 172.21.15.110:0/2665749775 conn(0x7f01f00791b0 msgr2=0x7f01f00798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:41.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.989+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 shutdown_connections 2024-04-26T11:28:41.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:38.989+0000 7f01efe00700 1 -- 172.21.15.110:0/2665749775 wait complete. 2024-04-26T11:28:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:41 smithi196 ceph-mon[32572]: pgmap v370: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:41 smithi193 ceph-mon[32782]: pgmap v370: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:43 smithi110 ceph-mon[28069]: pgmap v371: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:28:43.837 INFO:teuthology.orchestra.run.smithi110.stdout:167503724613 2024-04-26T11:28:43.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-26T11:28:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:43 smithi196 ceph-mon[32572]: pgmap v371: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:28:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:43 smithi193 ceph-mon[32782]: pgmap v371: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:28:44.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.510+0000 7f8f93200700 1 -- 172.21.15.110:0/3419777418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9410b600 msgr2=0x7f8f9410b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:44.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.510+0000 7f8f93200700 1 --2- 172.21.15.110:0/3419777418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9410b600 0x7f8f9410b9e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8f840099c0 tx=0x7f8f84009cd0 comp rx=0 tx=0).stop 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.510+0000 7f8f93200700 1 -- 172.21.15.110:0/3419777418 shutdown_connections 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.510+0000 7f8f93200700 1 --2- 172.21.15.110:0/3419777418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f94105f10 0x7f8f941123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.510+0000 7f8f93200700 1 --2- 172.21.15.110:0/3419777418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9410b600 0x7f8f9410b9e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.510+0000 7f8f93200700 1 --2- 172.21.15.110:0/3419777418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f94105550 0x7f8f941059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.510+0000 7f8f93200700 1 -- 172.21.15.110:0/3419777418 >> 172.21.15.110:0/3419777418 conn(0x7f8f94101060 msgr2=0x7f8f94103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.510+0000 7f8f93200700 1 -- 172.21.15.110:0/3419777418 shutdown_connections 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.511+0000 7f8f93200700 1 -- 172.21.15.110:0/3419777418 wait complete. 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.511+0000 7f8f93200700 1 Processor -- start 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f93200700 1 -- start start 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f93200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f94105550 0x7f8f941a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f93200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f94105f10 0x7f8f941a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f93200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9410b600 0x7f8f9419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:44.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f93200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8f94115760 con 0x7f8f94105550 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f93200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8f941155e0 con 0x7f8f94105f10 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f93200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8f941158e0 con 0x7f8f9410b600 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f91e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f94105550 0x7f8f941a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f91e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f94105550 0x7f8f941a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50678/0 (socket says 172.21.15.110:50678) 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f91e00700 1 -- 172.21.15.110:0/764026659 learned_addr learned my addr 172.21.15.110:0/764026659 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.512+0000 7f8f89400700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f94105f10 0x7f8f941a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f92800700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9410b600 0x7f8f9419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f91e00700 1 -- 172.21.15.110:0/764026659 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9410b600 msgr2=0x7f8f9419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f91e00700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9410b600 0x7f8f9419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f91e00700 1 -- 172.21.15.110:0/764026659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f94105f10 msgr2=0x7f8f941a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f91e00700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f94105f10 0x7f8f941a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f91e00700 1 -- 172.21.15.110:0/764026659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9419c1a0 con 0x7f8f94105550 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f91e00700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f94105550 0x7f8f941a1880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f84006010 tx=0x7f8f84005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f8b400700 1 -- 172.21.15.110:0/764026659 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84026070 con 0x7f8f94105550 2024-04-26T11:28:44.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f8b400700 1 -- 172.21.15.110:0/764026659 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f84003c70 con 0x7f8f94105550 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f8b400700 1 -- 172.21.15.110:0/764026659 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8400fad0 con 0x7f8f94105550 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.513+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9419c430 con 0x7f8f94105550 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.514+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f941a8750 con 0x7f8f94105550 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.514+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f94063bb0 con 0x7f8f94105550 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.517+0000 7f8f8b400700 1 -- 172.21.15.110:0/764026659 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f8f84029070 con 0x7f8f94105550 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.518+0000 7f8f8b400700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f780a3d50 0x7f8f780a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.518+0000 7f8f8b400700 1 -- 172.21.15.110:0/764026659 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f8f840d1520 con 0x7f8f94105550 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.518+0000 7f8f89400700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f780a3d50 0x7f8f780a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.519+0000 7f8f8b400700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] conn(0x7f8f780ad990 0x7f8f780afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.519+0000 7f8f8b400700 1 -- 172.21.15.110:0/764026659 --> [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f84022e80 con 0x7f8f780ad990 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.519+0000 7f8f8b400700 1 -- 172.21.15.110:0/764026659 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f8f840d18d0 con 0x7f8f94105550 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.519+0000 7f8f89400700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f780a3d50 0x7f8f780a6210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009680 tx=0x7f8f7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.519+0000 7f8f92800700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] conn(0x7f8f780ad990 0x7f8f780afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.520+0000 7f8f92800700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] conn(0x7f8f780ad990 0x7f8f780afe30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:44.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.521+0000 7f8f8b400700 1 -- 172.21.15.110:0/764026659 <== osd.1 v2:172.21.15.193:6800/1751461680 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f84022e80 con 0x7f8f780ad990 2024-04-26T11:28:44.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.539+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 --> [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8f94064080 con 0x7f8f780ad990 2024-04-26T11:28:44.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f8b400700 1 -- 172.21.15.110:0/764026659 <== osd.1 v2:172.21.15.193:6800/1751461680 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8f94064080 con 0x7f8f780ad990 2024-04-26T11:28:44.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 >> [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] conn(0x7f8f780ad990 msgr2=0x7f8f780afe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:44.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f93200700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] conn(0x7f8f780ad990 0x7f8f780afe30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:44.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f780a3d50 msgr2=0x7f8f780a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:44.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f93200700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f780a3d50 0x7f8f780a6210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009680 tx=0x7f8f7c009260 comp rx=0 tx=0).stop 2024-04-26T11:28:44.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f94105550 msgr2=0x7f8f941a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:44.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f93200700 1 --2- 172.21.15.110:0/764026659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f94105550 0x7f8f941a1880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f84006010 tx=0x7f8f84005280 comp rx=0 tx=0).stop 2024-04-26T11:28:44.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f92800700 1 -- 172.21.15.110:0/764026659 reap_dead start 2024-04-26T11:28:44.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 shutdown_connections 2024-04-26T11:28:44.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.540+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 >> 172.21.15.110:0/764026659 conn(0x7f8f94101060 msgr2=0x7f8f94102820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:44.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.541+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 shutdown_connections 2024-04-26T11:28:44.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.541+0000 7f8f93200700 1 -- 172.21.15.110:0/764026659 wait complete. 2024-04-26T11:28:45.873 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:45 smithi110 ceph-mon[28069]: pgmap v372: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:45 smithi196 ceph-mon[32572]: pgmap v372: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:45 smithi193 ceph-mon[32782]: pgmap v372: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.046+0000 7fce3ae00700 1 -- 172.21.15.110:0/2075777091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce34075650 msgr2=0x7fce34075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.046+0000 7fce3ae00700 1 --2- 172.21.15.110:0/2075777091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce34075650 0x7fce34075a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fce24009990 tx=0x7fce24009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.046+0000 7fce3ae00700 1 -- 172.21.15.110:0/2075777091 shutdown_connections 2024-04-26T11:28:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.046+0000 7fce3ae00700 1 --2- 172.21.15.110:0/2075777091 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3410fe20 0x7fce34112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.046+0000 7fce3ae00700 1 --2- 172.21.15.110:0/2075777091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce34075650 0x7fce34075a30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.046+0000 7fce3ae00700 1 --2- 172.21.15.110:0/2075777091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce34075f70 0x7fce3410f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.046+0000 7fce3ae00700 1 -- 172.21.15.110:0/2075777091 >> 172.21.15.110:0/2075777091 conn(0x7fce3407a580 msgr2=0x7fce3407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.046+0000 7fce3ae00700 1 -- 172.21.15.110:0/2075777091 shutdown_connections 2024-04-26T11:28:46.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.046+0000 7fce3ae00700 1 -- 172.21.15.110:0/2075777091 wait complete. 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.047+0000 7fce3ae00700 1 Processor -- start 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce3ae00700 1 -- start start 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce3ae00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce34075650 0x7fce3419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce3ae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce34075f70 0x7fce3419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce3ae00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3410fe20 0x7fce341a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce3ae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fce34115820 con 0x7fce34075f70 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce3ae00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce341156a0 con 0x7fce34075650 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce3ae00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fce341159a0 con 0x7fce3410fe20 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce33400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce34075f70 0x7fce3419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce33400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce34075f70 0x7fce3419c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50660/0 (socket says 172.21.15.110:50660) 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce33400700 1 -- 172.21.15.110:0/774997977 learned_addr learned my addr 172.21.15.110:0/774997977 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.048+0000 7fce33e00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce34075650 0x7fce3419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:46.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.049+0000 7fce38e00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3410fe20 0x7fce341a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.049+0000 7fce38e00700 1 -- 172.21.15.110:0/774997977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce34075650 msgr2=0x7fce3419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.049+0000 7fce38e00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce34075650 0x7fce3419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.049+0000 7fce38e00700 1 -- 172.21.15.110:0/774997977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce34075f70 msgr2=0x7fce3419c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.049+0000 7fce38e00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce34075f70 0x7fce3419c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.049+0000 7fce38e00700 1 -- 172.21.15.110:0/774997977 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce341a0d30 con 0x7fce3410fe20 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.049+0000 7fce33e00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce34075650 0x7fce3419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.049+0000 7fce33400700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce34075f70 0x7fce3419c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.049+0000 7fce38e00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3410fe20 0x7fce341a05f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007ee0 tx=0x7fce2c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.050+0000 7fce30c00700 1 -- 172.21.15.110:0/774997977 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c004db0 con 0x7fce3410fe20 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.050+0000 7fce30c00700 1 -- 172.21.15.110:0/774997977 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce2c003a00 con 0x7fce3410fe20 2024-04-26T11:28:46.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.050+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce341a1020 con 0x7fce3410fe20 2024-04-26T11:28:46.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.050+0000 7fce30c00700 1 -- 172.21.15.110:0/774997977 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0044e0 con 0x7fce3410fe20 2024-04-26T11:28:46.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.050+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce341a88a0 con 0x7fce3410fe20 2024-04-26T11:28:46.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.051+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce34063bb0 con 0x7fce3410fe20 2024-04-26T11:28:46.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.053+0000 7fce30c00700 1 -- 172.21.15.110:0/774997977 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fce2c01c020 con 0x7fce3410fe20 2024-04-26T11:28:46.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.055+0000 7fce30c00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce180a3d50 0x7fce180a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:46.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.055+0000 7fce30c00700 1 -- 172.21.15.110:0/774997977 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7fce2c0d0a10 con 0x7fce3410fe20 2024-04-26T11:28:46.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.055+0000 7fce33e00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce180a3d50 0x7fce180a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.055+0000 7fce30c00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] conn(0x7fce180ad990 0x7fce180afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.055+0000 7fce30c00700 1 -- 172.21.15.110:0/774997977 --> [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce2c010e50 con 0x7fce180ad990 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.055+0000 7fce30c00700 1 -- 172.21.15.110:0/774997977 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fce2c0d0dc0 con 0x7fce3410fe20 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.056+0000 7fce33400700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] conn(0x7fce180ad990 0x7fce180afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.056+0000 7fce33e00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce180a3d50 0x7fce180a6210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fce24006010 tx=0x7fce2400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.056+0000 7fce33400700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] conn(0x7fce180ad990 0x7fce180afe30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.057+0000 7fce30c00700 1 -- 172.21.15.110:0/774997977 <== osd.7 v2:172.21.15.193:6816/4124476381 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce2c010e50 con 0x7fce180ad990 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.076+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 --> [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce34064030 con 0x7fce180ad990 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.077+0000 7fce30c00700 1 -- 172.21.15.110:0/774997977 <== osd.7 v2:172.21.15.193:6816/4124476381 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fce34064030 con 0x7fce180ad990 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.077+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 >> [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] conn(0x7fce180ad990 msgr2=0x7fce180afe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.077+0000 7fce3ae00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] conn(0x7fce180ad990 0x7fce180afe30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.077+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce180a3d50 msgr2=0x7fce180a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.077+0000 7fce3ae00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fce180a3d50 0x7fce180a6210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fce24006010 tx=0x7fce2400b260 comp rx=0 tx=0).stop 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.077+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3410fe20 msgr2=0x7fce341a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:46.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.077+0000 7fce3ae00700 1 --2- 172.21.15.110:0/774997977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3410fe20 0x7fce341a05f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fce2c007ee0 tx=0x7fce2c00d3b0 comp rx=0 tx=0).stop 2024-04-26T11:28:46.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.077+0000 7fce38e00700 1 -- 172.21.15.110:0/774997977 reap_dead start 2024-04-26T11:28:46.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.078+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 shutdown_connections 2024-04-26T11:28:46.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.078+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 >> 172.21.15.110:0/774997977 conn(0x7fce3407a580 msgr2=0x7fce341006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:46.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.078+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 shutdown_connections 2024-04-26T11:28:46.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:44.078+0000 7fce3ae00700 1 -- 172.21.15.110:0/774997977 wait complete. 2024-04-26T11:28:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:47 smithi196 ceph-mon[32572]: pgmap v373: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:47 smithi110 ceph-mon[28069]: pgmap v373: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:47 smithi193 ceph-mon[32782]: pgmap v373: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:48.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.608+0000 7f14fe200700 1 -- 172.21.15.110:0/2953068798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f8105630 msgr2=0x7f14f8105ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:48.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.608+0000 7f14fe200700 1 --2- 172.21.15.110:0/2953068798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f8105630 0x7f14f8105ab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009990 tx=0x7f14e0009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:48.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.608+0000 7f14fe200700 1 -- 172.21.15.110:0/2953068798 shutdown_connections 2024-04-26T11:28:48.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.608+0000 7f14fe200700 1 --2- 172.21.15.110:0/2953068798 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14f8105ff0 0x7f14f8112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:48.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.608+0000 7f14fe200700 1 --2- 172.21.15.110:0/2953068798 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14f810b630 0x7f14f810ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:48.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.608+0000 7f14fe200700 1 --2- 172.21.15.110:0/2953068798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f8105630 0x7f14f8105ab0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:48.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.608+0000 7f14fe200700 1 -- 172.21.15.110:0/2953068798 >> 172.21.15.110:0/2953068798 conn(0x7f14f8101120 msgr2=0x7f14f8103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:48.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.608+0000 7f14fe200700 1 -- 172.21.15.110:0/2953068798 shutdown_connections 2024-04-26T11:28:48.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.608+0000 7f14fe200700 1 -- 172.21.15.110:0/2953068798 wait complete. 2024-04-26T11:28:48.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.609+0000 7f14fe200700 1 Processor -- start 2024-04-26T11:28:48.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14fe200700 1 -- start start 2024-04-26T11:28:48.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14fe200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14f8105630 0x7f14f819bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:48.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14fe200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f8105ff0 0x7f14f819c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:48.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14fe200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14f810b630 0x7f14f81a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:48.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14fe200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f14f8115860 con 0x7f14f8105ff0 2024-04-26T11:28:48.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14fe200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14f81156e0 con 0x7f14f810b630 2024-04-26T11:28:48.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14fe200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f14f81159e0 con 0x7f14f8105630 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14eea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f8105ff0 0x7f14f819c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14f7400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14f8105630 0x7f14f819bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14eea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f8105ff0 0x7f14f819c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50700/0 (socket says 172.21.15.110:50700) 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.610+0000 7f14eea00700 1 -- 172.21.15.110:0/152176754 learned_addr learned my addr 172.21.15.110:0/152176754 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.611+0000 7f14f7e00700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14f810b630 0x7f14f81a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.611+0000 7f14f7400700 1 -- 172.21.15.110:0/152176754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14f810b630 msgr2=0x7f14f81a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.611+0000 7f14f7400700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14f810b630 0x7f14f81a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.611+0000 7f14f7400700 1 -- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f8105ff0 msgr2=0x7f14f819c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.611+0000 7f14f7400700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f8105ff0 0x7f14f819c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:48.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.611+0000 7f14f7400700 1 -- 172.21.15.110:0/152176754 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f81a0d60 con 0x7f14f8105630 2024-04-26T11:28:48.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.611+0000 7f14f7400700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14f8105630 0x7f14f819bd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14e800e9f0 tx=0x7f14e800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:48.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.612+0000 7f14f4c00700 1 -- 172.21.15.110:0/152176754 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e800cbd0 con 0x7f14f8105630 2024-04-26T11:28:48.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.612+0000 7f14f4c00700 1 -- 172.21.15.110:0/152176754 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14e800cd70 con 0x7f14f8105630 2024-04-26T11:28:48.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.612+0000 7f14f4c00700 1 -- 172.21.15.110:0/152176754 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8018680 con 0x7f14f8105630 2024-04-26T11:28:48.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.612+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f81a1050 con 0x7f14f8105630 2024-04-26T11:28:48.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.612+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f81a88d0 con 0x7f14f8105630 2024-04-26T11:28:48.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.613+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14f8063bb0 con 0x7f14f8105630 2024-04-26T11:28:48.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.616+0000 7f14f4c00700 1 -- 172.21.15.110:0/152176754 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f14e8010430 con 0x7f14f8105630 2024-04-26T11:28:48.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.617+0000 7f14f4c00700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14dc0a3d50 0x7f14dc0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:48.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.617+0000 7f14f4c00700 1 -- 172.21.15.110:0/152176754 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f14e80d0e90 con 0x7f14f8105630 2024-04-26T11:28:48.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.617+0000 7f14eea00700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14dc0a3d50 0x7f14dc0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:48.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.618+0000 7f14f4c00700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] conn(0x7f14dc0ad990 0x7f14dc0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:48.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.618+0000 7f14f4c00700 1 -- 172.21.15.110:0/152176754 --> [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14e8027e50 con 0x7f14dc0ad990 2024-04-26T11:28:48.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.618+0000 7f14f4c00700 1 -- 172.21.15.110:0/152176754 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f14e80d1240 con 0x7f14f8105630 2024-04-26T11:28:48.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.618+0000 7f14f7e00700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] conn(0x7f14dc0ad990 0x7f14dc0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:48.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.618+0000 7f14eea00700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14dc0a3d50 0x7f14dc0a6210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f14f8103780 tx=0x7f14e001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:48.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.618+0000 7f14f7e00700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] conn(0x7f14dc0ad990 0x7f14dc0afe30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:48.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.620+0000 7f14f4c00700 1 -- 172.21.15.110:0/152176754 <== osd.6 v2:172.21.15.110:6818/1730783886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14e8027e50 con 0x7f14dc0ad990 2024-04-26T11:28:48.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.638+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 --> [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14f8063fb0 con 0x7f14dc0ad990 2024-04-26T11:28:48.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.638+0000 7f14f4c00700 1 -- 172.21.15.110:0/152176754 <== osd.6 v2:172.21.15.110:6818/1730783886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f14f8063fb0 con 0x7f14dc0ad990 2024-04-26T11:28:48.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] conn(0x7f14dc0ad990 msgr2=0x7f14dc0afe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:48.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] conn(0x7f14dc0ad990 0x7f14dc0afe30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:48.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14dc0a3d50 msgr2=0x7f14dc0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:48.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f14dc0a3d50 0x7f14dc0a6210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f14f8103780 tx=0x7f14e001a040 comp rx=0 tx=0).stop 2024-04-26T11:28:48.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14f8105630 msgr2=0x7f14f819bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:48.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 --2- 172.21.15.110:0/152176754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14f8105630 0x7f14f819bd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14e800e9f0 tx=0x7f14e800ed00 comp rx=0 tx=0).stop 2024-04-26T11:28:48.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14f7e00700 1 -- 172.21.15.110:0/152176754 reap_dead start 2024-04-26T11:28:48.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 shutdown_connections 2024-04-26T11:28:48.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 >> 172.21.15.110:0/152176754 conn(0x7f14f8101120 msgr2=0x7f14f81018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:48.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 shutdown_connections 2024-04-26T11:28:48.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:48.639+0000 7f14fe200700 1 -- 172.21.15.110:0/152176754 wait complete. 2024-04-26T11:28:49.897 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:49 smithi110 ceph-mon[28069]: pgmap v374: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:28:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:49 smithi196 ceph-mon[32572]: pgmap v374: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:28:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:49 smithi193 ceph-mon[32782]: pgmap v374: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.963+0000 7fbc6dc00700 1 -- 172.21.15.110:0/3618165886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc681094c0 msgr2=0x7fbc681098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.963+0000 7fbc6dc00700 1 --2- 172.21.15.110:0/3618165886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc681094c0 0x7fbc681098a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009990 tx=0x7fbc58009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.963+0000 7fbc6dc00700 1 -- 172.21.15.110:0/3618165886 shutdown_connections 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.963+0000 7fbc6dc00700 1 --2- 172.21.15.110:0/3618165886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc68103e30 0x7fbc68110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.963+0000 7fbc6dc00700 1 --2- 172.21.15.110:0/3618165886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc681094c0 0x7fbc681098a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.963+0000 7fbc6dc00700 1 --2- 172.21.15.110:0/3618165886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc68103470 0x7fbc681038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.963+0000 7fbc6dc00700 1 -- 172.21.15.110:0/3618165886 >> 172.21.15.110:0/3618165886 conn(0x7fbc6807a580 msgr2=0x7fbc6807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.963+0000 7fbc6dc00700 1 -- 172.21.15.110:0/3618165886 shutdown_connections 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.964+0000 7fbc6dc00700 1 -- 172.21.15.110:0/3618165886 wait complete. 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.965+0000 7fbc6dc00700 1 Processor -- start 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.965+0000 7fbc6dc00700 1 -- start start 2024-04-26T11:28:51.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc6dc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc68103470 0x7fbc68075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc6dc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc68103e30 0x7fbc68075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc6dc00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc681094c0 0x7fbc680761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc6dc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbc68113610 con 0x7fbc68103e30 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc6dc00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbc68113490 con 0x7fbc68103470 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc6dc00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbc68113790 con 0x7fbc681094c0 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc5e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc68103e30 0x7fbc68075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc5e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc68103e30 0x7fbc68075c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50730/0 (socket says 172.21.15.110:50730) 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc5e000700 1 -- 172.21.15.110:0/4201385784 learned_addr learned my addr 172.21.15.110:0/4201385784 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc67400700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc681094c0 0x7fbc680761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc66a00700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc68103470 0x7fbc68075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc67400700 1 -- 172.21.15.110:0/4201385784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc68103470 msgr2=0x7fbc68075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.966+0000 7fbc67400700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc68103470 0x7fbc68075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc67400700 1 -- 172.21.15.110:0/4201385784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc68103e30 msgr2=0x7fbc68075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc67400700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc68103e30 0x7fbc68075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc67400700 1 -- 172.21.15.110:0/4201385784 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc681a80b0 con 0x7fbc681094c0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc5e000700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc68103e30 0x7fbc68075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc67400700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc681094c0 0x7fbc680761a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000efc0 tx=0x7fbc6000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc5fe00700 1 -- 172.21.15.110:0/4201385784 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc600092e0 con 0x7fbc681094c0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc5fe00700 1 -- 172.21.15.110:0/4201385784 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc60004bb0 con 0x7fbc681094c0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc681a8340 con 0x7fbc681094c0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc5fe00700 1 -- 172.21.15.110:0/4201385784 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60004020 con 0x7fbc681094c0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.967+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc681a8830 con 0x7fbc681094c0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.968+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc68063b30 con 0x7fbc681094c0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.970+0000 7fbc5fe00700 1 -- 172.21.15.110:0/4201385784 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fbc6001b030 con 0x7fbc681094c0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.971+0000 7fbc5fe00700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbc4c0a3cd0 0x7fbc4c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.972+0000 7fbc5fe00700 1 -- 172.21.15.110:0/4201385784 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7fbc600d0a20 con 0x7fbc681094c0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.972+0000 7fbc66a00700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbc4c0a3cd0 0x7fbc4c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.972+0000 7fbc5fe00700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] conn(0x7fbc4c0ad910 0x7fbc4c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.972+0000 7fbc5fe00700 1 -- 172.21.15.110:0/4201385784 --> [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc6000fe50 con 0x7fbc4c0ad910 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.972+0000 7fbc5fe00700 1 -- 172.21.15.110:0/4201385784 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fbc600d0dd0 con 0x7fbc681094c0 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.972+0000 7fbc5e000700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] conn(0x7fbc4c0ad910 0x7fbc4c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.973+0000 7fbc66a00700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbc4c0a3cd0 0x7fbc4c0a6190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc58006010 tx=0x7fbc5800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.973+0000 7fbc5e000700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] conn(0x7fbc4c0ad910 0x7fbc4c0afdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.974+0000 7fbc5fe00700 1 -- 172.21.15.110:0/4201385784 <== osd.8 v2:172.21.15.196:6816/2942176519 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc6000fe50 con 0x7fbc4c0ad910 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.992+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 --> [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc68063fb0 con 0x7fbc4c0ad910 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.993+0000 7fbc5fe00700 1 -- 172.21.15.110:0/4201385784 <== osd.8 v2:172.21.15.196:6816/2942176519 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbc68063fb0 con 0x7fbc4c0ad910 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.993+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 >> [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] conn(0x7fbc4c0ad910 msgr2=0x7fbc4c0afdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.993+0000 7fbc6dc00700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] conn(0x7fbc4c0ad910 0x7fbc4c0afdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.993+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbc4c0a3cd0 msgr2=0x7fbc4c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.993+0000 7fbc6dc00700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbc4c0a3cd0 0x7fbc4c0a6190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc58006010 tx=0x7fbc5800b260 comp rx=0 tx=0).stop 2024-04-26T11:28:51.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.993+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc681094c0 msgr2=0x7fbc680761a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.993+0000 7fbc6dc00700 1 --2- 172.21.15.110:0/4201385784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc681094c0 0x7fbc680761a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000efc0 tx=0x7fbc6000c3a0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.993+0000 7fbc67400700 1 -- 172.21.15.110:0/4201385784 reap_dead start 2024-04-26T11:28:51.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.994+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 shutdown_connections 2024-04-26T11:28:51.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.994+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 >> 172.21.15.110:0/4201385784 conn(0x7fbc6807a580 msgr2=0x7fbc681022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:51.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.994+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 shutdown_connections 2024-04-26T11:28:51.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:49.994+0000 7fbc6dc00700 1 -- 172.21.15.110:0/4201385784 wait complete. 2024-04-26T11:28:51.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.971+0000 7f4acfe00700 1 -- 172.21.15.110:0/4218098278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad0103590 msgr2=0x7f4ad0103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.971+0000 7f4acfe00700 1 --2- 172.21.15.110:0/4218098278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad0103590 0x7f4ad0103970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00099c0 tx=0x7f4ac0009cd0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.971+0000 7f4acfe00700 1 -- 172.21.15.110:0/4218098278 shutdown_connections 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.971+0000 7f4acfe00700 1 --2- 172.21.15.110:0/4218098278 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ad0108670 0x7f4ad0110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.971+0000 7f4acfe00700 1 --2- 172.21.15.110:0/4218098278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad0103590 0x7f4ad0103970 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.971+0000 7f4acfe00700 1 --2- 172.21.15.110:0/4218098278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ad0103f40 0x7f4ad0107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.971+0000 7f4acfe00700 1 -- 172.21.15.110:0/4218098278 >> 172.21.15.110:0/4218098278 conn(0x7f4ad00fee40 msgr2=0x7f4ad0101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.971+0000 7f4acfe00700 1 -- 172.21.15.110:0/4218098278 shutdown_connections 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.971+0000 7f4acfe00700 1 -- 172.21.15.110:0/4218098278 wait complete. 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.972+0000 7f4acfe00700 1 Processor -- start 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.972+0000 7f4acfe00700 1 -- start start 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4acfe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ad0103590 0x7f4ad019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4acfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad0103f40 0x7f4ad019c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4acfe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ad0108670 0x7f4ad01a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4acfe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0113580 con 0x7f4ad0103f40 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4acfe00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0113400 con 0x7f4ad0108670 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4acfe00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad0113700 con 0x7f4ad0103590 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4ace000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad0103f40 0x7f4ad019c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4ace000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad0103f40 0x7f4ad019c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50744/0 (socket says 172.21.15.110:50744) 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4ace000700 1 -- 172.21.15.110:0/665465069 learned_addr learned my addr 172.21.15.110:0/665465069 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4acea00700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ad0103590 0x7f4ad019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.973+0000 7f4acf400700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ad0108670 0x7f4ad01a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4acea00700 1 -- 172.21.15.110:0/665465069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ad0108670 msgr2=0x7f4ad01a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4acea00700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ad0108670 0x7f4ad01a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4acea00700 1 -- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad0103f40 msgr2=0x7f4ad019c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4acea00700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad0103f40 0x7f4ad019c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4acea00700 1 -- 172.21.15.110:0/665465069 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad01a0d20 con 0x7f4ad0103590 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4acf400700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ad0108670 0x7f4ad01a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:51.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4acea00700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ad0103590 0x7f4ad019bd10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00098e0 tx=0x7f4ac0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4ac7400700 1 -- 172.21.15.110:0/665465069 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0026070 con 0x7f4ad0103590 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad01a0fb0 con 0x7f4ad0103590 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4ac7400700 1 -- 172.21.15.110:0/665465069 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ac0003c70 con 0x7f4ad0103590 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4ac7400700 1 -- 172.21.15.110:0/665465069 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac000fa00 con 0x7f4ad0103590 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.974+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad01a8890 con 0x7f4ad0103590 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.975+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ad00768f0 con 0x7f4ad0103590 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.977+0000 7f4ac7400700 1 -- 172.21.15.110:0/665465069 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f4ac0029070 con 0x7f4ad0103590 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.979+0000 7f4ac7400700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4ab40a3cd0 0x7f4ab40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.979+0000 7f4ac7400700 1 -- 172.21.15.110:0/665465069 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f4ac00d0fd0 con 0x7f4ad0103590 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.979+0000 7f4ace000700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4ab40a3cd0 0x7f4ab40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.979+0000 7f4ac7400700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] conn(0x7f4ab40ad910 0x7f4ab40afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.979+0000 7f4ac7400700 1 -- 172.21.15.110:0/665465069 --> [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ab40b0480 con 0x7f4ab40ad910 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.979+0000 7f4ac7400700 1 -- 172.21.15.110:0/665465069 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f4ac00d1380 con 0x7f4ad0103590 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.980+0000 7f4acf400700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] conn(0x7f4ab40ad910 0x7f4ab40afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.980+0000 7f4ace000700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4ab40a3cd0 0x7f4ab40a6190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0077740 tx=0x7f4abc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.980+0000 7f4acf400700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] conn(0x7f4ab40ad910 0x7f4ab40afdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.981+0000 7f4ac7400700 1 -- 172.21.15.110:0/665465069 <== osd.0 v2:172.21.15.110:6802/1662740885 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ab40b0480 con 0x7f4ab40ad910 2024-04-26T11:28:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:50.999+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 --> [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ad0104a70 con 0x7f4ab40ad910 2024-04-26T11:28:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.000+0000 7f4ac7400700 1 -- 172.21.15.110:0/665465069 <== osd.0 v2:172.21.15.110:6802/1662740885 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4ad0104a70 con 0x7f4ab40ad910 2024-04-26T11:28:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.000+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] conn(0x7f4ab40ad910 msgr2=0x7f4ab40afdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.000+0000 7f4acfe00700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] conn(0x7f4ab40ad910 0x7f4ab40afdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.001+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4ab40a3cd0 msgr2=0x7f4ab40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.001+0000 7f4acfe00700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f4ab40a3cd0 0x7f4ab40a6190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0077740 tx=0x7f4abc009260 comp rx=0 tx=0).stop 2024-04-26T11:28:51.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.001+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ad0103590 msgr2=0x7f4ad019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:51.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.001+0000 7f4acfe00700 1 --2- 172.21.15.110:0/665465069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ad0103590 0x7f4ad019bd10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00098e0 tx=0x7f4ac0004270 comp rx=0 tx=0).stop 2024-04-26T11:28:51.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.001+0000 7f4acf400700 1 -- 172.21.15.110:0/665465069 reap_dead start 2024-04-26T11:28:51.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.001+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 shutdown_connections 2024-04-26T11:28:51.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.001+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 >> 172.21.15.110:0/665465069 conn(0x7f4ad00fee40 msgr2=0x7f4ad01011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:51.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.001+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 shutdown_connections 2024-04-26T11:28:51.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:51.001+0000 7f4acfe00700 1 -- 172.21.15.110:0/665465069 wait complete. 2024-04-26T11:28:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:51 smithi196 ceph-mon[32572]: pgmap v375: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:51 smithi110 ceph-mon[28069]: pgmap v375: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:51 smithi193 ceph-mon[32782]: pgmap v375: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:28:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:52 smithi110 ceph-mon[28069]: pgmap v376: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:52 smithi196 ceph-mon[32572]: pgmap v376: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:52 smithi193 ceph-mon[32782]: pgmap v376: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:53.789 INFO:teuthology.orchestra.run.smithi110.stdout:201863462977 2024-04-26T11:28:53.790 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-26T11:28:54.181 INFO:teuthology.orchestra.run.smithi110.stdout:223338299449 2024-04-26T11:28:54.182 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-26T11:28:54.417 INFO:teuthology.orchestra.run.smithi110.stdout:55834574939 2024-04-26T11:28:54.418 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-26T11:28:54.753 INFO:teuthology.orchestra.run.smithi110.stdout:257698037813 2024-04-26T11:28:54.754 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-26T11:28:55.699 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:55 smithi110 ceph-mon[28069]: pgmap v377: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:55 smithi193 ceph-mon[32782]: pgmap v377: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:55 smithi196 ceph-mon[32572]: pgmap v377: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:28:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.397+0000 7f0057600700 1 -- 172.21.15.110:0/1188704529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0050075f70 msgr2=0x7f005010f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.397+0000 7f0057600700 1 --2- 172.21.15.110:0/1188704529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0050075f70 0x7f005010f8e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f003c009990 tx=0x7f003c009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.397+0000 7f0057600700 1 -- 172.21.15.110:0/1188704529 shutdown_connections 2024-04-26T11:28:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.397+0000 7f0057600700 1 --2- 172.21.15.110:0/1188704529 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f005010fe20 0x7f0050112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.397+0000 7f0057600700 1 --2- 172.21.15.110:0/1188704529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0050075650 0x7f0050075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.397+0000 7f0057600700 1 --2- 172.21.15.110:0/1188704529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0050075f70 0x7f005010f8e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.397+0000 7f0057600700 1 -- 172.21.15.110:0/1188704529 >> 172.21.15.110:0/1188704529 conn(0x7f005007a580 msgr2=0x7f005007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.398+0000 7f0057600700 1 -- 172.21.15.110:0/1188704529 shutdown_connections 2024-04-26T11:28:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.398+0000 7f0057600700 1 -- 172.21.15.110:0/1188704529 wait complete. 2024-04-26T11:28:56.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.399+0000 7f0057600700 1 Processor -- start 2024-04-26T11:28:56.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.399+0000 7f0057600700 1 -- start start 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0057600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0050075650 0x7f005019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0057600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0050075f70 0x7f005019c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0057600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f005010fe20 0x7f00501a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0057600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0050115830 con 0x7f0050075f70 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0057600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f00501156b0 con 0x7f005010fe20 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0057600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f00501159b0 con 0x7f0050075650 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0054c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0050075650 0x7f005019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0054c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0050075650 0x7f005019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39320/0 (socket says 172.21.15.110:39320) 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0054c00700 1 -- 172.21.15.110:0/165267757 learned_addr learned my addr 172.21.15.110:0/165267757 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0055600700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f005010fe20 0x7f00501a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:56.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f004fe00700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0050075f70 0x7f005019c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:56.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0054c00700 1 -- 172.21.15.110:0/165267757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f005010fe20 msgr2=0x7f00501a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0054c00700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f005010fe20 0x7f00501a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0054c00700 1 -- 172.21.15.110:0/165267757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0050075f70 msgr2=0x7f005019c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0054c00700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0050075f70 0x7f005019c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f0054c00700 1 -- 172.21.15.110:0/165267757 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00501a0d70 con 0x7f0050075650 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.400+0000 7f004fe00700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0050075f70 0x7f005019c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.401+0000 7f0054c00700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0050075650 0x7f005019bd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f004400c370 tx=0x7f004400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.401+0000 7f004d600700 1 -- 172.21.15.110:0/165267757 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00440090d0 con 0x7f0050075650 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.401+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00501a1000 con 0x7f0050075650 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.401+0000 7f004d600700 1 -- 172.21.15.110:0/165267757 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0044009270 con 0x7f0050075650 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.401+0000 7f004d600700 1 -- 172.21.15.110:0/165267757 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044004730 con 0x7f0050075650 2024-04-26T11:28:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.401+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00501a88e0 con 0x7f0050075650 2024-04-26T11:28:56.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.403+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0050063bb0 con 0x7f0050075650 2024-04-26T11:28:56.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.406+0000 7f004d600700 1 -- 172.21.15.110:0/165267757 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f004401a020 con 0x7f0050075650 2024-04-26T11:28:56.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.407+0000 7f004d600700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f00380a3d50 0x7f00380a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:56.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.407+0000 7f004d600700 1 -- 172.21.15.110:0/165267757 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f00440d0410 con 0x7f0050075650 2024-04-26T11:28:56.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.408+0000 7f004d600700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] conn(0x7f00380ad990 0x7f00380afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:56.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.408+0000 7f004fe00700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f00380a3d50 0x7f00380a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:56.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.408+0000 7f004d600700 1 -- 172.21.15.110:0/165267757 --> [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0044005ab0 con 0x7f00380ad990 2024-04-26T11:28:56.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.408+0000 7f004d600700 1 -- 172.21.15.110:0/165267757 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f00440d07c0 con 0x7f0050075650 2024-04-26T11:28:56.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.408+0000 7f0055600700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] conn(0x7f00380ad990 0x7f00380afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:56.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.409+0000 7f004fe00700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f00380a3d50 0x7f00380a6210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f003c006010 tx=0x7f003c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:56.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.409+0000 7f0055600700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] conn(0x7f00380ad990 0x7f00380afe30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:56.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.410+0000 7f004d600700 1 -- 172.21.15.110:0/165267757 <== osd.10 v2:172.21.15.193:6824/676480728 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0044005ab0 con 0x7f00380ad990 2024-04-26T11:28:56.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.429+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 --> [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0050063fb0 con 0x7f00380ad990 2024-04-26T11:28:56.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.430+0000 7f004d600700 1 -- 172.21.15.110:0/165267757 <== osd.10 v2:172.21.15.193:6824/676480728 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0050063fb0 con 0x7f00380ad990 2024-04-26T11:28:56.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 >> [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] conn(0x7f00380ad990 msgr2=0x7f00380afe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:56.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] conn(0x7f00380ad990 0x7f00380afe30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:56.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f00380a3d50 msgr2=0x7f00380a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f00380a3d50 0x7f00380a6210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f003c006010 tx=0x7f003c01a040 comp rx=0 tx=0).stop 2024-04-26T11:28:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0050075650 msgr2=0x7f005019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 --2- 172.21.15.110:0/165267757 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0050075650 0x7f005019bd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f004400c370 tx=0x7f004400c730 comp rx=0 tx=0).stop 2024-04-26T11:28:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0055600700 1 -- 172.21.15.110:0/165267757 reap_dead start 2024-04-26T11:28:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 shutdown_connections 2024-04-26T11:28:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 >> 172.21.15.110:0/165267757 conn(0x7f005007a580 msgr2=0x7f0050100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 shutdown_connections 2024-04-26T11:28:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.431+0000 7f0057600700 1 -- 172.21.15.110:0/165267757 wait complete. 2024-04-26T11:28:57.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.180+0000 7f7627800700 1 -- 172.21.15.110:0/260234975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f762006b130 msgr2=0x7f762006b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.180+0000 7f7627800700 1 --2- 172.21.15.110:0/260234975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f762006b130 0x7f762006b590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f760c009990 tx=0x7f760c009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.180+0000 7f7627800700 1 -- 172.21.15.110:0/260234975 shutdown_connections 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.180+0000 7f7627800700 1 --2- 172.21.15.110:0/260234975 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f762006bad0 0x7f76201102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.180+0000 7f7627800700 1 --2- 172.21.15.110:0/260234975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76201094a0 0x7f7620109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.180+0000 7f7627800700 1 --2- 172.21.15.110:0/260234975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f762006b130 0x7f762006b590 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.180+0000 7f7627800700 1 -- 172.21.15.110:0/260234975 >> 172.21.15.110:0/260234975 conn(0x7f76200792d0 msgr2=0x7f76200796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.180+0000 7f7627800700 1 -- 172.21.15.110:0/260234975 shutdown_connections 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.180+0000 7f7627800700 1 -- 172.21.15.110:0/260234975 wait complete. 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.181+0000 7f7627800700 1 Processor -- start 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.181+0000 7f7627800700 1 -- start start 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.181+0000 7f7627800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f762006b130 0x7f76201a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.181+0000 7f7627800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f762006bad0 0x7f76201a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.181+0000 7f7627800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201094a0 0x7f762019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.181+0000 7f7627800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f76201135d0 con 0x7f76201094a0 2024-04-26T11:28:57.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.181+0000 7f7627800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7620113450 con 0x7f762006b130 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.181+0000 7f7627800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7620113750 con 0x7f762006bad0 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7625800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201094a0 0x7f762019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7625800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201094a0 0x7f762019bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52060/0 (socket says 172.21.15.110:52060) 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7625800700 1 -- 172.21.15.110:0/1283463975 learned_addr learned my addr 172.21.15.110:0/1283463975 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7624e00700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f762006b130 0x7f76201a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f761fe00700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f762006bad0 0x7f76201a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7625800700 1 -- 172.21.15.110:0/1283463975 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f762006bad0 msgr2=0x7f76201a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7625800700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f762006bad0 0x7f76201a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7625800700 1 -- 172.21.15.110:0/1283463975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f762006b130 msgr2=0x7f76201a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7625800700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f762006b130 0x7f76201a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7625800700 1 -- 172.21.15.110:0/1283463975 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762019c410 con 0x7f76201094a0 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.182+0000 7f7625800700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201094a0 0x7f762019bb30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f761800ef30 tx=0x7f761800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:57.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.183+0000 7f761d600700 1 -- 172.21.15.110:0/1283463975 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76180092e0 con 0x7f76201094a0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.183+0000 7f761d600700 1 -- 172.21.15.110:0/1283463975 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7618004bb0 con 0x7f76201094a0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.183+0000 7f761d600700 1 -- 172.21.15.110:0/1283463975 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618004020 con 0x7f76201094a0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.183+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762019c6a0 con 0x7f76201094a0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.183+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76201a89e0 con 0x7f76201094a0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.184+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f762019c9e0 con 0x7f76201094a0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.186+0000 7f761d600700 1 -- 172.21.15.110:0/1283463975 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f761801b030 con 0x7f76201094a0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.187+0000 7f761d600700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f76080a3d50 0x7f76080a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.187+0000 7f761d600700 1 -- 172.21.15.110:0/1283463975 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f76180d09b0 con 0x7f76201094a0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.188+0000 7f7624e00700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f76080a3d50 0x7f76080a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.188+0000 7f761d600700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] conn(0x7f76080ad990 0x7f76080afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.188+0000 7f761d600700 1 -- 172.21.15.110:0/1283463975 --> [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76080b0500 con 0x7f76080ad990 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.188+0000 7f761d600700 1 -- 172.21.15.110:0/1283463975 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f76180d0d60 con 0x7f76201094a0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.188+0000 7f761fe00700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] conn(0x7f76080ad990 0x7f76080afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.188+0000 7f7624e00700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f76080a3d50 0x7f76080a6210 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7614009be0 tx=0x7f7614009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:57.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.189+0000 7f761fe00700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] conn(0x7f76080ad990 0x7f76080afe30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.190+0000 7f761d600700 1 -- 172.21.15.110:0/1283463975 <== osd.3 v2:172.21.15.110:6810/2253549266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76080b0500 con 0x7f76080ad990 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.207+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 --> [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7620063dc0 con 0x7f76080ad990 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.208+0000 7f761d600700 1 -- 172.21.15.110:0/1283463975 <== osd.3 v2:172.21.15.110:6810/2253549266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7620063dc0 con 0x7f76080ad990 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.208+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] conn(0x7f76080ad990 msgr2=0x7f76080afe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.208+0000 7f7627800700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] conn(0x7f76080ad990 0x7f76080afe30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.208+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f76080a3d50 msgr2=0x7f76080a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.208+0000 7f7627800700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f76080a3d50 0x7f76080a6210 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7614009be0 tx=0x7f7614009260 comp rx=0 tx=0).stop 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.208+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201094a0 msgr2=0x7f762019bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.208+0000 7f7627800700 1 --2- 172.21.15.110:0/1283463975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201094a0 0x7f762019bb30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f761800ef30 tx=0x7f761800c3a0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.208+0000 7f7625800700 1 -- 172.21.15.110:0/1283463975 reap_dead start 2024-04-26T11:28:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.209+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 shutdown_connections 2024-04-26T11:28:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.209+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 >> 172.21.15.110:0/1283463975 conn(0x7f76200792d0 msgr2=0x7f762010e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.209+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 shutdown_connections 2024-04-26T11:28:57.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:57.209+0000 7f7627800700 1 -- 172.21.15.110:0/1283463975 wait complete. 2024-04-26T11:28:57.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:57 smithi110 ceph-mon[28069]: pgmap v378: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-04-26T11:28:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.305+0000 7f3fa7600700 1 -- 172.21.15.110:0/4113628696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa0103e30 msgr2=0x7f3fa0110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.305+0000 7f3fa7600700 1 --2- 172.21.15.110:0/4113628696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa0103e30 0x7f3fa0110290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800b0a0 tx=0x7f3f9800b3b0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.305+0000 7f3fa7600700 1 -- 172.21.15.110:0/4113628696 shutdown_connections 2024-04-26T11:28:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.305+0000 7f3fa7600700 1 --2- 172.21.15.110:0/4113628696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa0103e30 0x7f3fa0110290 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.305+0000 7f3fa7600700 1 --2- 172.21.15.110:0/4113628696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa01094c0 0x7f3fa01098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.305+0000 7f3fa7600700 1 --2- 172.21.15.110:0/4113628696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3fa0103470 0x7f3fa01038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.305+0000 7f3fa7600700 1 -- 172.21.15.110:0/4113628696 >> 172.21.15.110:0/4113628696 conn(0x7f3fa007a580 msgr2=0x7f3fa007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.305+0000 7f3fa7600700 1 -- 172.21.15.110:0/4113628696 shutdown_connections 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.305+0000 7f3fa7600700 1 -- 172.21.15.110:0/4113628696 wait complete. 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.307+0000 7f3fa7600700 1 Processor -- start 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.307+0000 7f3fa7600700 1 -- start start 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.307+0000 7f3fa7600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103470 0x7f3fa019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.307+0000 7f3fa7600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3fa0103e30 0x7f3fa019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.307+0000 7f3fa7600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01094c0 0x7f3fa0199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.307+0000 7f3fa7600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0113610 con 0x7f3fa01094c0 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.307+0000 7f3fa7600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0113490 con 0x7f3fa0103470 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.307+0000 7f3fa7600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0113790 con 0x7f3fa0103e30 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa5600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01094c0 0x7f3fa0199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa5600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01094c0 0x7f3fa0199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52028/0 (socket says 172.21.15.110:52028) 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa5600700 1 -- 172.21.15.110:0/2072318349 learned_addr learned my addr 172.21.15.110:0/2072318349 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:57.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa4c00700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103470 0x7f3fa019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3f9fe00700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3fa0103e30 0x7f3fa019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa5600700 1 -- 172.21.15.110:0/2072318349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3fa0103e30 msgr2=0x7f3fa019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa5600700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3fa0103e30 0x7f3fa019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa5600700 1 -- 172.21.15.110:0/2072318349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103470 msgr2=0x7f3fa019f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa5600700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103470 0x7f3fa019f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa5600700 1 -- 172.21.15.110:0/2072318349 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa019a070 con 0x7f3fa01094c0 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.308+0000 7f3fa4c00700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3fa0103470 0x7f3fa019f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.309+0000 7f3fa5600700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01094c0 0x7f3fa0199910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800b070 tx=0x7f3f98009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.309+0000 7f3f9d600700 1 -- 172.21.15.110:0/2072318349 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98021070 con 0x7f3fa01094c0 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.309+0000 7f3f9d600700 1 -- 172.21.15.110:0/2072318349 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f98004e40 con 0x7f3fa01094c0 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.309+0000 7f3f9d600700 1 -- 172.21.15.110:0/2072318349 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98004630 con 0x7f3fa01094c0 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.309+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa019a300 con 0x7f3fa01094c0 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.309+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa01a6620 con 0x7f3fa01094c0 2024-04-26T11:28:57.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.310+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fa0063b70 con 0x7f3fa01094c0 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.314+0000 7f3f9d600700 1 -- 172.21.15.110:0/2072318349 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f3f98007980 con 0x7f3fa01094c0 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.315+0000 7f3f9d600700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3f880a3cd0 0x7f3f880a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.315+0000 7f3f9d600700 1 -- 172.21.15.110:0/2072318349 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f3f980d17b0 con 0x7f3fa01094c0 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.315+0000 7f3fa4c00700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3f880a3cd0 0x7f3f880a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.316+0000 7f3f9d600700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] conn(0x7f3f880ad910 0x7f3f880afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.316+0000 7f3f9d600700 1 -- 172.21.15.110:0/2072318349 --> [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f9801ce50 con 0x7f3f880ad910 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.316+0000 7f3f9d600700 1 -- 172.21.15.110:0/2072318349 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f3f980d1c00 con 0x7f3fa01094c0 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.316+0000 7f3f9fe00700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] conn(0x7f3f880ad910 0x7f3f880afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.316+0000 7f3fa4c00700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3f880a3cd0 0x7f3f880a6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009680 tx=0x7f3f94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.316+0000 7f3f9fe00700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] conn(0x7f3f880ad910 0x7f3f880afdb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.317+0000 7f3f9d600700 1 -- 172.21.15.110:0/2072318349 <== osd.9 v2:172.21.15.110:6826/2620757358 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f9801ce50 con 0x7f3f880ad910 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.336+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 --> [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3fa0063ff0 con 0x7f3f880ad910 2024-04-26T11:28:57.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.336+0000 7f3f9d600700 1 -- 172.21.15.110:0/2072318349 <== osd.9 v2:172.21.15.110:6826/2620757358 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3fa0063ff0 con 0x7f3f880ad910 2024-04-26T11:28:57.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] conn(0x7f3f880ad910 msgr2=0x7f3f880afdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] conn(0x7f3f880ad910 0x7f3f880afdb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:57.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3f880a3cd0 msgr2=0x7f3f880a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3f880a3cd0 0x7f3f880a6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009680 tx=0x7f3f94009260 comp rx=0 tx=0).stop 2024-04-26T11:28:57.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01094c0 msgr2=0x7f3fa0199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 --2- 172.21.15.110:0/2072318349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01094c0 0x7f3fa0199910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800b070 tx=0x7f3f98009c90 comp rx=0 tx=0).stop 2024-04-26T11:28:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa5600700 1 -- 172.21.15.110:0/2072318349 reap_dead start 2024-04-26T11:28:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 shutdown_connections 2024-04-26T11:28:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 >> 172.21.15.110:0/2072318349 conn(0x7f3fa007a580 msgr2=0x7f3fa0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 shutdown_connections 2024-04-26T11:28:57.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:56.337+0000 7f3fa7600700 1 -- 172.21.15.110:0/2072318349 wait complete. 2024-04-26T11:28:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:57 smithi193 ceph-mon[32782]: pgmap v378: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-04-26T11:28:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:57 smithi196 ceph-mon[32572]: pgmap v378: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-04-26T11:28:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.465+0000 7fefbee00700 1 -- 172.21.15.110:0/1200260233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb8105610 msgr2=0x7fefb8105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.465+0000 7fefbee00700 1 --2- 172.21.15.110:0/1200260233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb8105610 0x7fefb8105a90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009990 tx=0x7fefa4009ca0 comp rx=0 tx=0).stop 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.465+0000 7fefbee00700 1 -- 172.21.15.110:0/1200260233 shutdown_connections 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.465+0000 7fefbee00700 1 --2- 172.21.15.110:0/1200260233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefb8105fd0 0x7fefb81124e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.465+0000 7fefbee00700 1 --2- 172.21.15.110:0/1200260233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefb810b6a0 0x7fefb810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.465+0000 7fefbee00700 1 --2- 172.21.15.110:0/1200260233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb8105610 0x7fefb8105a90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.465+0000 7fefbee00700 1 -- 172.21.15.110:0/1200260233 >> 172.21.15.110:0/1200260233 conn(0x7fefb8101100 msgr2=0x7fefb8103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.465+0000 7fefbee00700 1 -- 172.21.15.110:0/1200260233 shutdown_connections 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.465+0000 7fefbee00700 1 -- 172.21.15.110:0/1200260233 wait complete. 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.466+0000 7fefbee00700 1 Processor -- start 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.466+0000 7fefbee00700 1 -- start start 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbee00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefb8105610 0x7fefb819bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbee00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefb8105fd0 0x7fefb819c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb810b6a0 0x7fefb81a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fefb8115840 con 0x7fefb810b6a0 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbee00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fefb81156c0 con 0x7fefb8105610 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbee00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fefb81159c0 con 0x7fefb8105fd0 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbce00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb810b6a0 0x7fefb81a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbce00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb810b6a0 0x7fefb81a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52080/0 (socket says 172.21.15.110:52080) 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbce00700 1 -- 172.21.15.110:0/3832428103 learned_addr learned my addr 172.21.15.110:0/3832428103 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefb7e00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefb8105610 0x7fefb819bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefb7400700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefb8105fd0 0x7fefb819c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbce00700 1 -- 172.21.15.110:0/3832428103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefb8105fd0 msgr2=0x7fefb819c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbce00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fefb8105fd0 0x7fefb819c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbce00700 1 -- 172.21.15.110:0/3832428103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefb8105610 msgr2=0x7fefb819bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbce00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fefb8105610 0x7fefb819bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.467+0000 7fefbce00700 1 -- 172.21.15.110:0/3832428103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb81a0d60 con 0x7fefb810b6a0 2024-04-26T11:28:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.468+0000 7fefbce00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb810b6a0 0x7fefb81a0620 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fefb0007ee0 tx=0x7fefb000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.468+0000 7fefb4c00700 1 -- 172.21.15.110:0/3832428103 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb000dd20 con 0x7fefb810b6a0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.468+0000 7fefb4c00700 1 -- 172.21.15.110:0/3832428103 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefb0004020 con 0x7fefb810b6a0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.468+0000 7fefb4c00700 1 -- 172.21.15.110:0/3832428103 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0015660 con 0x7fefb810b6a0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.468+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb81a1050 con 0x7fefb810b6a0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.468+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb81a88d0 con 0x7fefb810b6a0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.469+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fefb8063bb0 con 0x7fefb810b6a0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.472+0000 7fefb4c00700 1 -- 172.21.15.110:0/3832428103 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fefb00041d0 con 0x7fefb810b6a0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.473+0000 7fefb4c00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fef9c0a3d50 0x7fef9c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.473+0000 7fefb4c00700 1 -- 172.21.15.110:0/3832428103 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7fefb00d0a70 con 0x7fefb810b6a0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.473+0000 7fefb7e00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fef9c0a3d50 0x7fef9c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.473+0000 7fefb4c00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] conn(0x7fef9c0ad990 0x7fef9c0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.473+0000 7fefb4c00700 1 -- 172.21.15.110:0/3832428103 --> [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef9c0b0500 con 0x7fef9c0ad990 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.473+0000 7fefb4c00700 1 -- 172.21.15.110:0/3832428103 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fefb00d0e20 con 0x7fefb810b6a0 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.474+0000 7fefb7e00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fef9c0a3d50 0x7fef9c0a6210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009680 tx=0x7fefa8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.474+0000 7fefb7400700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] conn(0x7fef9c0ad990 0x7fef9c0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.474+0000 7fefb7400700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] conn(0x7fef9c0ad990 0x7fef9c0afe30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.475+0000 7fefb4c00700 1 -- 172.21.15.110:0/3832428103 <== osd.11 v2:172.21.15.196:6824/2802765812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef9c0b0500 con 0x7fef9c0ad990 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.493+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 --> [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fefb8064030 con 0x7fef9c0ad990 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.494+0000 7fefb4c00700 1 -- 172.21.15.110:0/3832428103 <== osd.11 v2:172.21.15.196:6824/2802765812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fefb8064030 con 0x7fef9c0ad990 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.494+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 >> [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] conn(0x7fef9c0ad990 msgr2=0x7fef9c0afe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:58.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.494+0000 7fefbee00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] conn(0x7fef9c0ad990 0x7fef9c0afe30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:28:58.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.495+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fef9c0a3d50 msgr2=0x7fef9c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:58.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.495+0000 7fefbee00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fef9c0a3d50 0x7fef9c0a6210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009680 tx=0x7fefa8009260 comp rx=0 tx=0).stop 2024-04-26T11:28:58.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.495+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb810b6a0 msgr2=0x7fefb81a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:28:58.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.495+0000 7fefbee00700 1 --2- 172.21.15.110:0/3832428103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefb810b6a0 0x7fefb81a0620 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fefb0007ee0 tx=0x7fefb000d3b0 comp rx=0 tx=0).stop 2024-04-26T11:28:58.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.495+0000 7fefbce00700 1 -- 172.21.15.110:0/3832428103 reap_dead start 2024-04-26T11:28:58.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.495+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 shutdown_connections 2024-04-26T11:28:58.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.495+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 >> 172.21.15.110:0/3832428103 conn(0x7fefb8101100 msgr2=0x7fefb8102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:28:58.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.495+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 shutdown_connections 2024-04-26T11:28:58.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:28:58.495+0000 7fefbee00700 1 -- 172.21.15.110:0/3832428103 wait complete. 2024-04-26T11:28:58.824 INFO:teuthology.orchestra.run.smithi110.stdout:34359738466 2024-04-26T11:28:58.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-26T11:28:59.597 INFO:teuthology.orchestra.run.smithi110.stdout:313532612650 2024-04-26T11:28:59.598 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-26T11:28:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:28:59 smithi110 ceph-mon[28069]: pgmap v379: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:28:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:28:59 smithi193 ceph-mon[32782]: pgmap v379: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:28:59 smithi196 ceph-mon[32572]: pgmap v379: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:00.577 INFO:teuthology.orchestra.run.smithi110.stdout:347892351014 2024-04-26T11:29:00.577 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-26T11:29:00.997 INFO:teuthology.orchestra.run.smithi110.stdout:292057776177 2024-04-26T11:29:00.998 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-26T11:29:01.685 INFO:teuthology.orchestra.run.smithi110.stdout:111669149778 2024-04-26T11:29:01.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-26T11:29:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:01 smithi193 ceph-mon[32782]: pgmap v380: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:01.915 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:01 smithi110 ceph-mon[28069]: pgmap v380: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:01 smithi196 ceph-mon[32572]: pgmap v380: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:02.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.182+0000 7f8236e00700 1 -- 172.21.15.110:0/3243728366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8230075650 msgr2=0x7f8230075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.182+0000 7f8236e00700 1 --2- 172.21.15.110:0/3243728366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8230075650 0x7f8230075a30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f82200098f0 tx=0x7f8220009c00 comp rx=0 tx=0).stop 2024-04-26T11:29:02.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.182+0000 7f8236e00700 1 -- 172.21.15.110:0/3243728366 shutdown_connections 2024-04-26T11:29:02.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.182+0000 7f8236e00700 1 --2- 172.21.15.110:0/3243728366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f823010fe20 0x7f8230112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.182+0000 7f8236e00700 1 --2- 172.21.15.110:0/3243728366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8230075650 0x7f8230075a30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.182+0000 7f8236e00700 1 --2- 172.21.15.110:0/3243728366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8230075f70 0x7f823010f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.182+0000 7f8236e00700 1 -- 172.21.15.110:0/3243728366 >> 172.21.15.110:0/3243728366 conn(0x7f823007a580 msgr2=0x7f823007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:02.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.182+0000 7f8236e00700 1 -- 172.21.15.110:0/3243728366 shutdown_connections 2024-04-26T11:29:02.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.182+0000 7f8236e00700 1 -- 172.21.15.110:0/3243728366 wait complete. 2024-04-26T11:29:02.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.184+0000 7f8236e00700 1 Processor -- start 2024-04-26T11:29:02.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.184+0000 7f8236e00700 1 -- start start 2024-04-26T11:29:02.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.184+0000 7f8236e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8230075650 0x7f823019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.184+0000 7f8236e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8230075f70 0x7f823019c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.184+0000 7f8236e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f823010fe20 0x7f82301a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.184+0000 7f8236e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8230115820 con 0x7f8230075f70 2024-04-26T11:29:02.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.184+0000 7f8236e00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f82301156a0 con 0x7f8230075650 2024-04-26T11:29:02.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.184+0000 7f8236e00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f82301159a0 con 0x7f823010fe20 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.184+0000 7f822fe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8230075650 0x7f823019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f822f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8230075f70 0x7f823019c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f822fe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8230075650 0x7f823019bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:57312/0 (socket says 172.21.15.110:57312) 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f822fe00700 1 -- 172.21.15.110:0/1274291069 learned_addr learned my addr 172.21.15.110:0/1274291069 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f8234e00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f823010fe20 0x7f82301a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f822fe00700 1 -- 172.21.15.110:0/1274291069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f823010fe20 msgr2=0x7f82301a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f822fe00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f823010fe20 0x7f82301a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f822fe00700 1 -- 172.21.15.110:0/1274291069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8230075f70 msgr2=0x7f823019c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f822fe00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8230075f70 0x7f823019c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f822fe00700 1 -- 172.21.15.110:0/1274291069 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82301a0d30 con 0x7f8230075650 2024-04-26T11:29:02.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.185+0000 7f822f400700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8230075f70 0x7f823019c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:02.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.186+0000 7f822fe00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8230075650 0x7f823019bd70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8220009230 tx=0x7f822000fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:02.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.186+0000 7f822cc00700 1 -- 172.21.15.110:0/1274291069 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82200050c0 con 0x7f8230075650 2024-04-26T11:29:02.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.186+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82301a0fc0 con 0x7f8230075650 2024-04-26T11:29:02.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.186+0000 7f822cc00700 1 -- 172.21.15.110:0/1274291069 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f822000b560 con 0x7f8230075650 2024-04-26T11:29:02.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.186+0000 7f822cc00700 1 -- 172.21.15.110:0/1274291069 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220003a00 con 0x7f8230075650 2024-04-26T11:29:02.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.186+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82301a88a0 con 0x7f8230075650 2024-04-26T11:29:02.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.187+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8230063bb0 con 0x7f8230075650 2024-04-26T11:29:02.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.189+0000 7f822cc00700 1 -- 172.21.15.110:0/1274291069 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f822000b710 con 0x7f8230075650 2024-04-26T11:29:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.191+0000 7f822cc00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f82140a3cd0 0x7f82140a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.191+0000 7f822cc00700 1 -- 172.21.15.110:0/1274291069 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7f82200d1910 con 0x7f8230075650 2024-04-26T11:29:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.191+0000 7f822f400700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f82140a3cd0 0x7f82140a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.191+0000 7f822cc00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] conn(0x7f82140ad7e0 0x7f82140afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.191+0000 7f822cc00700 1 -- 172.21.15.110:0/1274291069 --> [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82140b0350 con 0x7f82140ad7e0 2024-04-26T11:29:02.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.191+0000 7f822cc00700 1 -- 172.21.15.110:0/1274291069 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f82200d1cc0 con 0x7f8230075650 2024-04-26T11:29:02.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.191+0000 7f8234e00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] conn(0x7f82140ad7e0 0x7f82140afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.192+0000 7f822f400700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f82140a3cd0 0x7f82140a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8230102fd0 tx=0x7f821c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:02.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.192+0000 7f8234e00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] conn(0x7f82140ad7e0 0x7f82140afc80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:02.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.193+0000 7f822cc00700 1 -- 172.21.15.110:0/1274291069 <== osd.2 v2:172.21.15.196:6800/1785522554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82140b0350 con 0x7f82140ad7e0 2024-04-26T11:29:02.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.211+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 --> [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8230064030 con 0x7f82140ad7e0 2024-04-26T11:29:02.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.212+0000 7f822cc00700 1 -- 172.21.15.110:0/1274291069 <== osd.2 v2:172.21.15.196:6800/1785522554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8230064030 con 0x7f82140ad7e0 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.212+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 >> [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] conn(0x7f82140ad7e0 msgr2=0x7f82140afc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.212+0000 7f8236e00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] conn(0x7f82140ad7e0 0x7f82140afc80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.213+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f82140a3cd0 msgr2=0x7f82140a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.213+0000 7f8236e00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f82140a3cd0 0x7f82140a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8230102fd0 tx=0x7f821c009260 comp rx=0 tx=0).stop 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.213+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8230075650 msgr2=0x7f823019bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.213+0000 7f8236e00700 1 --2- 172.21.15.110:0/1274291069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8230075650 0x7f823019bd70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8220009230 tx=0x7f822000fa70 comp rx=0 tx=0).stop 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.213+0000 7f8234e00700 1 -- 172.21.15.110:0/1274291069 reap_dead start 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.213+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 shutdown_connections 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.213+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 >> 172.21.15.110:0/1274291069 conn(0x7f823007a580 msgr2=0x7f82301006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.213+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 shutdown_connections 2024-04-26T11:29:02.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.213+0000 7f8236e00700 1 -- 172.21.15.110:0/1274291069 wait complete. 2024-04-26T11:29:02.700 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-26T11:29:02.700 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]: dispatch 2024-04-26T11:29:02.700 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-04-26T11:29:02.700 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:02 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-04-26T11:29:02.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.407+0000 7fb0a5000700 1 -- 172.21.15.110:0/3823766451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a0105660 msgr2=0x7fb0a0105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.407+0000 7fb0a5000700 1 --2- 172.21.15.110:0/3823766451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a0105660 0x7fb0a0105ae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009990 tx=0x7fb08c009ca0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.407+0000 7fb0a5000700 1 -- 172.21.15.110:0/3823766451 shutdown_connections 2024-04-26T11:29:02.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.407+0000 7fb0a5000700 1 --2- 172.21.15.110:0/3823766451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0a0106020 0x7fb0a0112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.407+0000 7fb0a5000700 1 --2- 172.21.15.110:0/3823766451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0a010b660 0x7fb0a010ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.407+0000 7fb0a5000700 1 --2- 172.21.15.110:0/3823766451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a0105660 0x7fb0a0105ae0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.407+0000 7fb0a5000700 1 -- 172.21.15.110:0/3823766451 >> 172.21.15.110:0/3823766451 conn(0x7fb0a0101150 msgr2=0x7fb0a0103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.407+0000 7fb0a5000700 1 -- 172.21.15.110:0/3823766451 shutdown_connections 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.407+0000 7fb0a5000700 1 -- 172.21.15.110:0/3823766451 wait complete. 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.408+0000 7fb0a5000700 1 Processor -- start 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.408+0000 7fb0a5000700 1 -- start start 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb0a5000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0a0105660 0x7fb0a019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb0a5000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a0106020 0x7fb0a019c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb0a5000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0a010b660 0x7fb0a01a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb0a5000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0115890 con 0x7fb0a0105660 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb0a5000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0115710 con 0x7fb0a0106020 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb0a5000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a0115a10 con 0x7fb0a010b660 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb09de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0a0105660 0x7fb0a019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb09de00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0a0105660 0x7fb0a019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59166/0 (socket says 172.21.15.110:59166) 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb09de00700 1 -- 172.21.15.110:0/2542604418 learned_addr learned my addr 172.21.15.110:0/2542604418 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb09d400700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a0106020 0x7fb0a019c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb09e800700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0a010b660 0x7fb0a01a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.409+0000 7fb09de00700 1 -- 172.21.15.110:0/2542604418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0a010b660 msgr2=0x7fb0a01a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb09de00700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0a010b660 0x7fb0a01a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb09de00700 1 -- 172.21.15.110:0/2542604418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a0106020 msgr2=0x7fb0a019c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb09de00700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0a0106020 0x7fb0a019c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb09de00700 1 -- 172.21.15.110:0/2542604418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a01a0d20 con 0x7fb0a0105660 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb09e800700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0a010b660 0x7fb0a01a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb09de00700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0a0105660 0x7fb0a019bd60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb09000e9a0 tx=0x7fb09000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb096a00700 1 -- 172.21.15.110:0/2542604418 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09000cbd0 con 0x7fb0a0105660 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb096a00700 1 -- 172.21.15.110:0/2542604418 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb09000cd70 con 0x7fb0a0105660 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a01a1010 con 0x7fb0a0105660 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb096a00700 1 -- 172.21.15.110:0/2542604418 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090018680 con 0x7fb0a0105660 2024-04-26T11:29:02.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.410+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a01a8890 con 0x7fb0a0105660 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.411+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0a0063bb0 con 0x7fb0a0105660 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.413+0000 7fb096a00700 1 -- 172.21.15.110:0/2542604418 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb090010430 con 0x7fb0a0105660 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.415+0000 7fb096a00700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb0840a3cd0 0x7fb0840a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.415+0000 7fb096a00700 1 -- 172.21.15.110:0/2542604418 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8269+0+0 (secure 0 0 0) 0x7fb0900d0fe0 con 0x7fb0a0105660 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.415+0000 7fb09d400700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb0840a3cd0 0x7fb0840a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.415+0000 7fb096a00700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] conn(0x7fb0840ad910 0x7fb0840afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.415+0000 7fb096a00700 1 -- 172.21.15.110:0/2542604418 --> [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb090027e50 con 0x7fb0840ad910 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.415+0000 7fb096a00700 1 -- 172.21.15.110:0/2542604418 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fb0900d1430 con 0x7fb0a0105660 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.415+0000 7fb09e800700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] conn(0x7fb0840ad910 0x7fb0840afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.416+0000 7fb09d400700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb0840a3cd0 0x7fb0840a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0103790 tx=0x7fb08c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.416+0000 7fb09e800700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] conn(0x7fb0840ad910 0x7fb0840afdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.417+0000 7fb096a00700 1 -- 172.21.15.110:0/2542604418 <== osd.4 v2:172.21.15.193:6808/1314161856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb090027e50 con 0x7fb0840ad910 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.440+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 --> [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb0a0064030 con 0x7fb0840ad910 2024-04-26T11:29:02.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.457+0000 7fb096a00700 1 -- 172.21.15.110:0/2542604418 <== osd.4 v2:172.21.15.193:6808/1314161856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb0a0064030 con 0x7fb0840ad910 2024-04-26T11:29:02.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.459+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 >> [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] conn(0x7fb0840ad910 msgr2=0x7fb0840afdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.459+0000 7fb0a5000700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] conn(0x7fb0840ad910 0x7fb0840afdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.460+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb0840a3cd0 msgr2=0x7fb0840a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.460+0000 7fb0a5000700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fb0840a3cd0 0x7fb0840a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0103790 tx=0x7fb08c005fd0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.460+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0a0105660 msgr2=0x7fb0a019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:02.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.460+0000 7fb0a5000700 1 --2- 172.21.15.110:0/2542604418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0a0105660 0x7fb0a019bd60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb09000e9a0 tx=0x7fb09000ecb0 comp rx=0 tx=0).stop 2024-04-26T11:29:02.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.460+0000 7fb09e800700 1 -- 172.21.15.110:0/2542604418 reap_dead start 2024-04-26T11:29:02.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.460+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 shutdown_connections 2024-04-26T11:29:02.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.460+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 >> 172.21.15.110:0/2542604418 conn(0x7fb0a0101150 msgr2=0x7fb0a0101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:02.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.461+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 shutdown_connections 2024-04-26T11:29:02.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:02.461+0000 7fb0a5000700 1 -- 172.21.15.110:0/2542604418 wait complete. 2024-04-26T11:29:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-26T11:29:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]: dispatch 2024-04-26T11:29:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-04-26T11:29:02.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:02 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-04-26T11:29:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-26T11:29:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]: dispatch 2024-04-26T11:29:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-04-26T11:29:03.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:02 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-04-26T11:29:03.215 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:03.257 INFO:teuthology.orchestra.run.smithi110.stdout:77309411419 2024-04-26T11:29:03.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-26T11:29:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:03 smithi193 ceph-mon[32782]: pgmap v381: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T11:29:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-26T11:29:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-04-26T11:29:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-04-26T11:29:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:03 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-04-26T11:29:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:03 smithi193 ceph-mon[32782]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T11:29:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:03 smithi196 ceph-mon[32572]: pgmap v381: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T11:29:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-26T11:29:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-04-26T11:29:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-04-26T11:29:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:03 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-04-26T11:29:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:03 smithi196 ceph-mon[32572]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T11:29:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:03 smithi110 ceph-mon[28069]: pgmap v381: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T11:29:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-26T11:29:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-04-26T11:29:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-04-26T11:29:04.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:03 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-04-26T11:29:04.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:03 smithi110 ceph-mon[28069]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T11:29:04.123 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:04.127 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:04.128 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:04.128 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:04.183 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:04.188 INFO:teuthology.orchestra.run.smithi110.stdout:146028888144 2024-04-26T11:29:04.188 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-26T11:29:04.199 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:04.199 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:04.203 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:04 smithi193 ceph-mon[32782]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T11:29:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:04 smithi193 ceph-mon[32782]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-04-26T11:29:04.902 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:04 smithi110 ceph-mon[28069]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T11:29:04.902 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:04 smithi110 ceph-mon[28069]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-04-26T11:29:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:04 smithi196 ceph-mon[32572]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T11:29:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:04 smithi196 ceph-mon[32572]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-04-26T11:29:05.629 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:05 smithi110 ceph-mon[28069]: pgmap v384: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 127 B/s wr, 5 op/s 2024-04-26T11:29:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:05 smithi193 ceph-mon[32782]: pgmap v384: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 127 B/s wr, 5 op/s 2024-04-26T11:29:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:05 smithi196 ceph-mon[32572]: pgmap v384: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 127 B/s wr, 5 op/s 2024-04-26T11:29:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:07 smithi110 ceph-mon[28069]: pgmap v385: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-26T11:29:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:07 smithi193 ceph-mon[32782]: pgmap v385: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-26T11:29:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:07 smithi196 ceph-mon[32572]: pgmap v385: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-26T11:29:09.733 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:09 smithi110 ceph-mon[28069]: pgmap v386: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-04-26T11:29:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:09 smithi193 ceph-mon[32782]: pgmap v386: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-04-26T11:29:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:09 smithi196 ceph-mon[32572]: pgmap v386: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-04-26T11:29:10.896 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:10 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/4186091233' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T11:29:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:10 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/4186091233' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T11:29:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:10 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/4186091233' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T11:29:11.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:11 smithi110 ceph-mon[28069]: pgmap v387: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-04-26T11:29:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:11 smithi196 ceph-mon[32572]: pgmap v387: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-04-26T11:29:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:11 smithi193 ceph-mon[32782]: pgmap v387: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-04-26T11:29:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:13 smithi193 ceph-mon[32782]: pgmap v388: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 412 B/s wr, 6 op/s 2024-04-26T11:29:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:13 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:29:13.877 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:13 smithi196 ceph-mon[32572]: pgmap v388: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 412 B/s wr, 6 op/s 2024-04-26T11:29:13.877 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:13 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:29:13.930 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:13 smithi110 ceph-mon[28069]: pgmap v388: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 412 B/s wr, 6 op/s 2024-04-26T11:29:13.930 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:13 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:29:15.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.044+0000 7f50f1a00700 1 -- 172.21.15.110:0/119191064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ec1094c0 msgr2=0x7f50ec1098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.044+0000 7f50f1a00700 1 --2- 172.21.15.110:0/119191064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ec1094c0 0x7f50ec1098a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009990 tx=0x7f50dc009ca0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.044+0000 7f50f1a00700 1 -- 172.21.15.110:0/119191064 shutdown_connections 2024-04-26T11:29:15.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.044+0000 7f50f1a00700 1 --2- 172.21.15.110:0/119191064 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50ec06c490 0x7f50ec110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.044+0000 7f50f1a00700 1 --2- 172.21.15.110:0/119191064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ec1094c0 0x7f50ec1098a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.044+0000 7f50f1a00700 1 --2- 172.21.15.110:0/119191064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50ec06baf0 0x7f50ec06bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.044+0000 7f50f1a00700 1 -- 172.21.15.110:0/119191064 >> 172.21.15.110:0/119191064 conn(0x7f50ec0792d0 msgr2=0x7f50ec0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:15.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.044+0000 7f50f1a00700 1 -- 172.21.15.110:0/119191064 shutdown_connections 2024-04-26T11:29:15.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.044+0000 7f50f1a00700 1 -- 172.21.15.110:0/119191064 wait complete. 2024-04-26T11:29:15.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.045+0000 7f50f1a00700 1 Processor -- start 2024-04-26T11:29:15.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.045+0000 7f50f1a00700 1 -- start start 2024-04-26T11:29:15.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.045+0000 7f50f1a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50ec06baf0 0x7f50ec19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:15.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.045+0000 7f50f1a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50ec06c490 0x7f50ec19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:15.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.045+0000 7f50f1a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ec1094c0 0x7f50ec1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.045+0000 7f50f1a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec113620 con 0x7f50ec06baf0 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.045+0000 7f50f1a00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec1134a0 con 0x7f50ec1094c0 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.045+0000 7f50f1a00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec1137a0 con 0x7f50ec06c490 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50ea000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50ec06c490 0x7f50ec19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50eaa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50ec06baf0 0x7f50ec19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50ea000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50ec06c490 0x7f50ec19c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:60158/0 (socket says 172.21.15.110:60158) 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50ea000700 1 -- 172.21.15.110:0/1681172377 learned_addr learned my addr 172.21.15.110:0/1681172377 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50eb400700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ec1094c0 0x7f50ec1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50ea000700 1 -- 172.21.15.110:0/1681172377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ec1094c0 msgr2=0x7f50ec1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50ea000700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ec1094c0 0x7f50ec1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50ea000700 1 -- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50ec06baf0 msgr2=0x7f50ec19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50ea000700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50ec06baf0 0x7f50ec19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50ea000700 1 -- 172.21.15.110:0/1681172377 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ec1a0d20 con 0x7f50ec06c490 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50eaa00700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50ec06baf0 0x7f50ec19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.046+0000 7f50ea000700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50ec06c490 0x7f50ec19c250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f50d800eb30 tx=0x7f50d800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.047+0000 7f50e3400700 1 -- 172.21.15.110:0/1681172377 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d800cbd0 con 0x7f50ec06c490 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.047+0000 7f50e3400700 1 -- 172.21.15.110:0/1681172377 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50d80044d0 con 0x7f50ec06c490 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.047+0000 7f50e3400700 1 -- 172.21.15.110:0/1681172377 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8003e30 con 0x7f50ec06c490 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.047+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ec1a1010 con 0x7f50ec06c490 2024-04-26T11:29:15.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.047+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ec1a8890 con 0x7f50ec06c490 2024-04-26T11:29:15.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.048+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ec104b70 con 0x7f50ec06c490 2024-04-26T11:29:15.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.050+0000 7f50e3400700 1 -- 172.21.15.110:0/1681172377 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f50d8004000 con 0x7f50ec06c490 2024-04-26T11:29:15.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.051+0000 7f50e3400700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50d00a3c40 0x7f50d00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:15.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.052+0000 7f50e3400700 1 -- 172.21.15.110:0/1681172377 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f50d80d0870 con 0x7f50ec06c490 2024-04-26T11:29:15.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.052+0000 7f50eaa00700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50d00a3c40 0x7f50d00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:15.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.052+0000 7f50eaa00700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50d00a3c40 0x7f50d00a6100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00b2e0 tx=0x7f50dc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:15.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.053+0000 7f50e3400700 1 -- 172.21.15.110:0/1681172377 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f50d80042f0 con 0x7f50ec06c490 2024-04-26T11:29:15.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.282+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f50ec02e490 con 0x7f50ec06c490 2024-04-26T11:29:15.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.283+0000 7f50e3400700 1 -- 172.21.15.110:0/1681172377 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f50d809d150 con 0x7f50ec06c490 2024-04-26T11:29:15.285 INFO:teuthology.orchestra.run.smithi110.stdout:111669149781 2024-04-26T11:29:15.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50d00a3c40 msgr2=0x7f50d00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50d00a3c40 0x7f50d00a6100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00b2e0 tx=0x7f50dc01a040 comp rx=0 tx=0).stop 2024-04-26T11:29:15.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50ec06c490 msgr2=0x7f50ec19c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50ec06c490 0x7f50ec19c250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f50d800eb30 tx=0x7f50d800ee40 comp rx=0 tx=0).stop 2024-04-26T11:29:15.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 shutdown_connections 2024-04-26T11:29:15.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50ec1094c0 0x7f50ec1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50ec06baf0 0x7f50ec19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50d00a3c40 0x7f50d00a6100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 --2- 172.21.15.110:0/1681172377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50ec06c490 0x7f50ec19c250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 >> 172.21.15.110:0/1681172377 conn(0x7f50ec0792d0 msgr2=0x7f50ec10e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:15.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 shutdown_connections 2024-04-26T11:29:15.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:15.286+0000 7f50f1a00700 1 -- 172.21.15.110:0/1681172377 wait complete. 2024-04-26T11:29:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:15 smithi193 ceph-mon[32782]: pgmap v389: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 374 B/s wr, 6 op/s 2024-04-26T11:29:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:15 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:15 smithi196 ceph-mon[32572]: pgmap v389: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 374 B/s wr, 6 op/s 2024-04-26T11:29:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:15 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:15 smithi110 ceph-mon[28069]: pgmap v389: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 374 B/s wr, 6 op/s 2024-04-26T11:29:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:15 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:15.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.730+0000 7f9dcb400700 1 -- 172.21.15.110:0/3982303022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc4075650 msgr2=0x7f9dc4075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.730+0000 7f9dcb400700 1 --2- 172.21.15.110:0/3982303022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc4075650 0x7f9dc4075a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9db80098f0 tx=0x7f9db8009c00 comp rx=0 tx=0).stop 2024-04-26T11:29:15.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.730+0000 7f9dcb400700 1 -- 172.21.15.110:0/3982303022 shutdown_connections 2024-04-26T11:29:15.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.730+0000 7f9dcb400700 1 --2- 172.21.15.110:0/3982303022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc410fe20 0x7f9dc4112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.730+0000 7f9dcb400700 1 --2- 172.21.15.110:0/3982303022 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc4075650 0x7f9dc4075a30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.730+0000 7f9dcb400700 1 --2- 172.21.15.110:0/3982303022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dc4075f70 0x7f9dc410f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.730+0000 7f9dcb400700 1 -- 172.21.15.110:0/3982303022 >> 172.21.15.110:0/3982303022 conn(0x7f9dc407a580 msgr2=0x7f9dc407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:15.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.730+0000 7f9dcb400700 1 -- 172.21.15.110:0/3982303022 shutdown_connections 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.730+0000 7f9dcb400700 1 -- 172.21.15.110:0/3982303022 wait complete. 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.732+0000 7f9dcb400700 1 Processor -- start 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.732+0000 7f9dcb400700 1 -- start start 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.733+0000 7f9dcb400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dc4075650 0x7f9dc419be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.733+0000 7f9dcb400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc4075f70 0x7f9dc419c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.733+0000 7f9dcb400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc410fe20 0x7f9dc41a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.733+0000 7f9dcb400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc4115850 con 0x7f9dc4075650 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.733+0000 7f9dcb400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41156d0 con 0x7f9dc410fe20 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.733+0000 7f9dcb400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41159d0 con 0x7f9dc4075f70 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.733+0000 7f9dc8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dc4075650 0x7f9dc419be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dc4075650 0x7f9dc419be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59176/0 (socket says 172.21.15.110:59176) 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc8a00700 1 -- 172.21.15.110:0/4186091233 learned_addr learned my addr 172.21.15.110:0/4186091233 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc3e00700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc4075f70 0x7f9dc419c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:15.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc9400700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc410fe20 0x7f9dc41a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:15.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc8a00700 1 -- 172.21.15.110:0/4186091233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc4075f70 msgr2=0x7f9dc419c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc8a00700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc4075f70 0x7f9dc419c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc8a00700 1 -- 172.21.15.110:0/4186091233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc410fe20 msgr2=0x7f9dc41a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc8a00700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc410fe20 0x7f9dc41a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc8a00700 1 -- 172.21.15.110:0/4186091233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc41a0e10 con 0x7f9dc4075650 2024-04-26T11:29:15.614 INFO:teuthology.orchestra.run.smithi110.stdout:201863462981 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.734+0000 7f9dc8a00700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dc4075650 0x7f9dc419be00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009230 tx=0x7f9db800fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.735+0000 7f9dc1600700 1 -- 172.21.15.110:0/4186091233 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80050c0 con 0x7f9dc4075650 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.735+0000 7f9dc1600700 1 -- 172.21.15.110:0/4186091233 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9db800b560 con 0x7f9dc4075650 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.735+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc41a10a0 con 0x7f9dc4075650 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.735+0000 7f9dc1600700 1 -- 172.21.15.110:0/4186091233 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8003a00 con 0x7f9dc4075650 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.735+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc41a8980 con 0x7f9dc4075650 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.736+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc406a110 con 0x7f9dc4075650 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.738+0000 7f9dc1600700 1 -- 172.21.15.110:0/4186091233 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f9db800b710 con 0x7f9dc4075650 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.740+0000 7f9dc1600700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f9dac0a3cc0 0x7f9dac0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.741+0000 7f9dc1600700 1 -- 172.21.15.110:0/4186091233 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f9db80d1530 con 0x7f9dc4075650 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.741+0000 7f9dc3e00700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f9dac0a3cc0 0x7f9dac0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:15.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.742+0000 7f9dc3e00700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f9dac0a3cc0 0x7f9dac0a6180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009750 tx=0x7f9db0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:15.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.743+0000 7f9dc1600700 1 -- 172.21.15.110:0/4186091233 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9db805eff0 con 0x7f9dc4075650 2024-04-26T11:29:15.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.978+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9dc402e490 con 0x7f9dc4075650 2024-04-26T11:29:15.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.979+0000 7f9dc1600700 1 -- 172.21.15.110:0/4186091233 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9db8013030 con 0x7f9dc4075650 2024-04-26T11:29:15.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f9dac0a3cc0 msgr2=0x7f9dac0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f9dac0a3cc0 0x7f9dac0a6180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009750 tx=0x7f9db0009310 comp rx=0 tx=0).stop 2024-04-26T11:29:15.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dc4075650 msgr2=0x7f9dc419be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:15.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dc4075650 0x7f9dc419be00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009230 tx=0x7f9db800fa70 comp rx=0 tx=0).stop 2024-04-26T11:29:15.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 shutdown_connections 2024-04-26T11:29:15.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc410fe20 0x7f9dc41a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dc4075650 0x7f9dc419be00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f9dac0a3cc0 0x7f9dac0a6180 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 --2- 172.21.15.110:0/4186091233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dc4075f70 0x7f9dc419c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:15.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 >> 172.21.15.110:0/4186091233 conn(0x7f9dc407a580 msgr2=0x7f9dc4101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:15.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.982+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 shutdown_connections 2024-04-26T11:29:15.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:09.983+0000 7f9dcb400700 1 -- 172.21.15.110:0/4186091233 wait complete. 2024-04-26T11:29:16.225 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:16 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1681172377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T11:29:16.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.340+0000 7f0145c00700 1 -- 172.21.15.110:0/2408909250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014010a410 msgr2=0x7f0140116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:16.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.340+0000 7f0145c00700 1 --2- 172.21.15.110:0/2408909250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014010a410 0x7f0140116920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f013800b0a0 tx=0x7f013800b3b0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.340+0000 7f0145c00700 1 -- 172.21.15.110:0/2408909250 shutdown_connections 2024-04-26T11:29:16.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.340+0000 7f0145c00700 1 --2- 172.21.15.110:0/2408909250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014010a410 0x7f0140116920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.340+0000 7f0145c00700 1 --2- 172.21.15.110:0/2408909250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f014010fa50 0x7f014010fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.340+0000 7f0145c00700 1 --2- 172.21.15.110:0/2408909250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0140109a50 0x7f0140109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.340+0000 7f0145c00700 1 -- 172.21.15.110:0/2408909250 >> 172.21.15.110:0/2408909250 conn(0x7f0140076bf0 msgr2=0x7f0140108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:16.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.340+0000 7f0145c00700 1 -- 172.21.15.110:0/2408909250 shutdown_connections 2024-04-26T11:29:16.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.341+0000 7f0145c00700 1 -- 172.21.15.110:0/2408909250 wait complete. 2024-04-26T11:29:16.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.342+0000 7f0145c00700 1 Processor -- start 2024-04-26T11:29:16.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.342+0000 7f0145c00700 1 -- start start 2024-04-26T11:29:16.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.342+0000 7f0145c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0140109a50 0x7f01401a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:16.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.342+0000 7f0145c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f014010a410 0x7f01401a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:16.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.342+0000 7f0145c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014010fa50 0x7f01401a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:16.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.342+0000 7f0145c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0140119ce0 con 0x7f014010fa50 2024-04-26T11:29:16.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.342+0000 7f0145c00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0140119b60 con 0x7f0140109a50 2024-04-26T11:29:16.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.342+0000 7f0145c00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0140119e60 con 0x7f014010a410 2024-04-26T11:29:16.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.342+0000 7f013ea00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0140109a50 0x7f01401a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013e000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f014010a410 0x7f01401a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014010fa50 0x7f01401a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013ea00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0140109a50 0x7f01401a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:44514/0 (socket says 172.21.15.110:44514) 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013ea00700 1 -- 172.21.15.110:0/1445658722 learned_addr learned my addr 172.21.15.110:0/1445658722 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013ea00700 1 -- 172.21.15.110:0/1445658722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f014010a410 msgr2=0x7f01401a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013ea00700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f014010a410 0x7f01401a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013ea00700 1 -- 172.21.15.110:0/1445658722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014010fa50 msgr2=0x7f01401a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013ea00700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014010fa50 0x7f01401a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013ea00700 1 -- 172.21.15.110:0/1445658722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01401a50f0 con 0x7f0140109a50 2024-04-26T11:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f013ea00700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0140109a50 0x7f01401a0130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f013000e9c0 tx=0x7f013000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:16.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.343+0000 7f0137400700 1 -- 172.21.15.110:0/1445658722 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000cbd0 con 0x7f0140109a50 2024-04-26T11:29:16.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.344+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01401a53e0 con 0x7f0140109a50 2024-04-26T11:29:16.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.344+0000 7f0137400700 1 -- 172.21.15.110:0/1445658722 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f013000ee60 con 0x7f0140109a50 2024-04-26T11:29:16.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.344+0000 7f0137400700 1 -- 172.21.15.110:0/1445658722 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01300055c0 con 0x7f0140109a50 2024-04-26T11:29:16.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.344+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01401acc60 con 0x7f0140109a50 2024-04-26T11:29:16.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.345+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f014006a110 con 0x7f0140109a50 2024-04-26T11:29:16.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.346+0000 7f0137400700 1 -- 172.21.15.110:0/1445658722 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f0130004750 con 0x7f0140109a50 2024-04-26T11:29:16.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.348+0000 7f0137400700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01240a3cc0 0x7f01240a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:16.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.348+0000 7f0137400700 1 -- 172.21.15.110:0/1445658722 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f01300d0640 con 0x7f0140109a50 2024-04-26T11:29:16.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.348+0000 7f013e000700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01240a3cc0 0x7f01240a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:16.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.349+0000 7f013e000700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01240a3cc0 0x7f01240a6180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0140078b20 tx=0x7f012c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:16.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.352+0000 7f0137400700 1 -- 172.21.15.110:0/1445658722 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f013009cf20 con 0x7f0140109a50 2024-04-26T11:29:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:16 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1681172377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T11:29:16.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.581+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f014002e490 con 0x7f0140109a50 2024-04-26T11:29:16.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.582+0000 7f0137400700 1 -- 172.21.15.110:0/1445658722 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f013009c820 con 0x7f0140109a50 2024-04-26T11:29:16.584 INFO:teuthology.orchestra.run.smithi110.stdout:257698037818 2024-04-26T11:29:16.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01240a3cc0 msgr2=0x7f01240a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:16.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01240a3cc0 0x7f01240a6180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0140078b20 tx=0x7f012c009260 comp rx=0 tx=0).stop 2024-04-26T11:29:16.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0140109a50 msgr2=0x7f01401a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:16.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0140109a50 0x7f01401a0130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f013000e9c0 tx=0x7f013000ecd0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 shutdown_connections 2024-04-26T11:29:16.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014010fa50 0x7f01401a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0140109a50 0x7f01401a0130 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f01240a3cc0 0x7f01240a6180 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 --2- 172.21.15.110:0/1445658722 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f014010a410 0x7f01401a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:16.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.584+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 >> 172.21.15.110:0/1445658722 conn(0x7f0140076bf0 msgr2=0x7f01400771b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:16.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.585+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 shutdown_connections 2024-04-26T11:29:16.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:16.585+0000 7f0145c00700 1 -- 172.21.15.110:0/1445658722 wait complete. 2024-04-26T11:29:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:16 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1681172377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T11:29:16.690 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462977 got 201863462981 for osd.6 2024-04-26T11:29:16.691 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:17 smithi110 ceph-mon[28069]: pgmap v390: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-04-26T11:29:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:17 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1445658722' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T11:29:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:17 smithi196 ceph-mon[32572]: pgmap v390: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-04-26T11:29:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:17 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1445658722' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T11:29:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:17 smithi193 ceph-mon[32782]: pgmap v390: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-04-26T11:29:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:17 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1445658722' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T11:29:18.033 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037813 got 257698037818 for osd.8 2024-04-26T11:29:18.034 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:18.326 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:18.326 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:18.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.368+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2672369597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf14103470 msgr2=0x7fcf141038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:18.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.368+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2672369597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf14103470 0x7fcf141038f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcf000098f0 tx=0x7fcf00009c00 comp rx=0 tx=0).stop 2024-04-26T11:29:18.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.368+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2672369597 shutdown_connections 2024-04-26T11:29:18.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.368+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2672369597 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf14103e30 0x7fcf14110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:18.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.368+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2672369597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf141094c0 0x7fcf141098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:18.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.368+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2672369597 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf14103470 0x7fcf141038f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:18.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.368+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2672369597 >> 172.21.15.110:0/2672369597 conn(0x7fcf1407a580 msgr2=0x7fcf1407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:18.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.369+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2672369597 shutdown_connections 2024-04-26T11:29:18.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.369+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2672369597 wait complete. 2024-04-26T11:29:18.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.370+0000 7fcf1bc00700 1 Processor -- start 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.370+0000 7fcf1bc00700 1 -- start start 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf1bc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14103470 0x7fcf1419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf1bc00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf14103e30 0x7fcf1419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf1bc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf141094c0 0x7fcf141a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf1bc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcf14113640 con 0x7fcf14103470 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf1bc00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf141134c0 con 0x7fcf141094c0 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf1bc00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcf141137c0 con 0x7fcf14103e30 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf13e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf14103e30 0x7fcf1419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf13e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf14103e30 0x7fcf1419c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:60196/0 (socket says 172.21.15.110:60196) 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf13e00700 1 -- 172.21.15.110:0/2359182883 learned_addr learned my addr 172.21.15.110:0/2359182883 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:18.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf19200700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14103470 0x7fcf1419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:18.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.371+0000 7fcf19c00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf141094c0 0x7fcf141a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:18.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.372+0000 7fcf13e00700 1 -- 172.21.15.110:0/2359182883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf141094c0 msgr2=0x7fcf141a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:18.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.372+0000 7fcf13e00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf141094c0 0x7fcf141a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:18.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.372+0000 7fcf13e00700 1 -- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14103470 msgr2=0x7fcf1419bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:18.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.372+0000 7fcf13e00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14103470 0x7fcf1419bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:18.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.372+0000 7fcf13e00700 1 -- 172.21.15.110:0/2359182883 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf141a0de0 con 0x7fcf14103e30 2024-04-26T11:29:18.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.372+0000 7fcf13e00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf14103e30 0x7fcf1419c310 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009230 tx=0x7fcf0000fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:18.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.373+0000 7fcf11600700 1 -- 172.21.15.110:0/2359182883 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00005140 con 0x7fcf14103e30 2024-04-26T11:29:18.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.373+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf141a1070 con 0x7fcf14103e30 2024-04-26T11:29:18.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.373+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf141a8950 con 0x7fcf14103e30 2024-04-26T11:29:18.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.373+0000 7fcf11600700 1 -- 172.21.15.110:0/2359182883 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf0000b560 con 0x7fcf14103e30 2024-04-26T11:29:18.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.373+0000 7fcf11600700 1 -- 172.21.15.110:0/2359182883 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00003970 con 0x7fcf14103e30 2024-04-26T11:29:18.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.375+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef4005330 con 0x7fcf14103e30 2024-04-26T11:29:18.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.376+0000 7fcf11600700 1 -- 172.21.15.110:0/2359182883 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fcf00003c70 con 0x7fcf14103e30 2024-04-26T11:29:18.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.378+0000 7fcf11600700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fcefc0a3cc0 0x7fcefc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:18.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.378+0000 7fcf11600700 1 -- 172.21.15.110:0/2359182883 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fcf000d1300 con 0x7fcf14103e30 2024-04-26T11:29:18.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.378+0000 7fcf19200700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fcefc0a3cc0 0x7fcefc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:18.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.379+0000 7fcf19200700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fcefc0a3cc0 0x7fcefc0a6180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcf08005fd0 tx=0x7fcf08009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:18.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.380+0000 7fcf11600700 1 -- 172.21.15.110:0/2359182883 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcf00013030 con 0x7fcf14103e30 2024-04-26T11:29:18.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.615+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcef40058f0 con 0x7fcf14103e30 2024-04-26T11:29:18.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.616+0000 7fcf11600700 1 -- 172.21.15.110:0/2359182883 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf00022e50 con 0x7fcf14103e30 2024-04-26T11:29:18.618 INFO:teuthology.orchestra.run.smithi110.stdout:34359738471 2024-04-26T11:29:18.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fcefc0a3cc0 msgr2=0x7fcefc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:18.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fcefc0a3cc0 0x7fcefc0a6180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcf08005fd0 tx=0x7fcf08009310 comp rx=0 tx=0).stop 2024-04-26T11:29:18.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf14103e30 msgr2=0x7fcf1419c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:18.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf14103e30 0x7fcf1419c310 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009230 tx=0x7fcf0000fa70 comp rx=0 tx=0).stop 2024-04-26T11:29:18.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 shutdown_connections 2024-04-26T11:29:18.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf141094c0 0x7fcf141a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:18.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf14103470 0x7fcf1419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:18.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fcefc0a3cc0 0x7fcefc0a6180 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:18.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 --2- 172.21.15.110:0/2359182883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf14103e30 0x7fcf1419c310 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:18.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 >> 172.21.15.110:0/2359182883 conn(0x7fcf1407a580 msgr2=0x7fcf141020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:18.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 shutdown_connections 2024-04-26T11:29:18.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:18.619+0000 7fcf1bc00700 1 -- 172.21.15.110:0/2359182883 wait complete. 2024-04-26T11:29:19.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.091+0000 7f642d200700 1 -- 172.21.15.110:0/1893435939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64280760e0 msgr2=0x7f6428113e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:19.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.091+0000 7f642d200700 1 --2- 172.21.15.110:0/1893435939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64280760e0 0x7f6428113e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6410009990 tx=0x7f6410009ca0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.091+0000 7f642d200700 1 -- 172.21.15.110:0/1893435939 shutdown_connections 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.091+0000 7f642d200700 1 --2- 172.21.15.110:0/1893435939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428114360 0x7f6428116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.091+0000 7f642d200700 1 --2- 172.21.15.110:0/1893435939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64280757c0 0x7f6428075ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.091+0000 7f642d200700 1 --2- 172.21.15.110:0/1893435939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64280760e0 0x7f6428113e20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.092+0000 7f642d200700 1 -- 172.21.15.110:0/1893435939 >> 172.21.15.110:0/1893435939 conn(0x7f64280feea0 msgr2=0x7f64281012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.092+0000 7f642d200700 1 -- 172.21.15.110:0/1893435939 shutdown_connections 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.092+0000 7f642d200700 1 -- 172.21.15.110:0/1893435939 wait complete. 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.093+0000 7f642d200700 1 Processor -- start 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.093+0000 7f642d200700 1 -- start start 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.093+0000 7f642d200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64280757c0 0x7f64281a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.093+0000 7f642d200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64280760e0 0x7f64281a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.093+0000 7f642d200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428114360 0x7f64281a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.093+0000 7f642d200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6428119bb0 con 0x7f64280760e0 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.093+0000 7f642d200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6428119a30 con 0x7f6428114360 2024-04-26T11:29:19.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.093+0000 7f642d200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6428119d30 con 0x7f64280757c0 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6426a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64280760e0 0x7f64281a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6427400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64280757c0 0x7f64281a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6427400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64280757c0 0x7f64281a00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:60206/0 (socket says 172.21.15.110:60206) 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6427400700 1 -- 172.21.15.110:0/2073875801 learned_addr learned my addr 172.21.15.110:0/2073875801 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6427400700 1 -- 172.21.15.110:0/2073875801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428114360 msgr2=0x7f64281a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6427400700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428114360 0x7f64281a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6427400700 1 -- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64280760e0 msgr2=0x7f64281a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6427400700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64280760e0 0x7f64281a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6427400700 1 -- 172.21.15.110:0/2073875801 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64281a50b0 con 0x7f64280757c0 2024-04-26T11:29:19.678 INFO:teuthology.orchestra.run.smithi110.stdout:167503724621 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.094+0000 7f6426a00700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64280760e0 0x7f64281a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.095+0000 7f6427400700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64280757c0 0x7f64281a00a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f641800e9c0 tx=0x7f641800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.095+0000 7f641fe00700 1 -- 172.21.15.110:0/2073875801 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641800cb50 con 0x7f64280757c0 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.095+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64281a53a0 con 0x7f64280757c0 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.095+0000 7f641fe00700 1 -- 172.21.15.110:0/2073875801 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6418004ce0 con 0x7f64280757c0 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.095+0000 7f641fe00700 1 -- 172.21.15.110:0/2073875801 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64180055e0 con 0x7f64280757c0 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.095+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64281acc20 con 0x7f64280757c0 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.096+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642806a110 con 0x7f64280757c0 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.098+0000 7f641fe00700 1 -- 172.21.15.110:0/2073875801 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f641800ccf0 con 0x7f64280757c0 2024-04-26T11:29:19.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.099+0000 7f641fe00700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f640c0a3c40 0x7f640c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.100+0000 7f641fe00700 1 -- 172.21.15.110:0/2073875801 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f64180d0730 con 0x7f64280757c0 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.100+0000 7f6426a00700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f640c0a3c40 0x7f640c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.100+0000 7f6426a00700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f640c0a3c40 0x7f640c0a6100 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f64281015a0 tx=0x7f641001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.104+0000 7f641fe00700 1 -- 172.21.15.110:0/2073875801 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f641809d010 con 0x7f64280757c0 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.343+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f64281a1400 con 0x7f64280757c0 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.344+0000 7f641fe00700 1 -- 172.21.15.110:0/2073875801 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f641809c910 con 0x7f64280757c0 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f640c0a3c40 msgr2=0x7f640c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f640c0a3c40 0x7f640c0a6100 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f64281015a0 tx=0x7f641001a040 comp rx=0 tx=0).stop 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64280757c0 msgr2=0x7f64281a00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64280757c0 0x7f64281a00a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f641800e9c0 tx=0x7f641800ecd0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 shutdown_connections 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6428114360 0x7f64281a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f640c0a3c40 0x7f640c0a6100 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64280757c0 0x7f64281a00a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 --2- 172.21.15.110:0/2073875801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64280760e0 0x7f64281a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 >> 172.21.15.110:0/2073875801 conn(0x7f64280feea0 msgr2=0x7f6428100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 shutdown_connections 2024-04-26T11:29:19.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:19.348+0000 7f642d200700 1 -- 172.21.15.110:0/2073875801 wait complete. 2024-04-26T11:29:19.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:19 smithi110 ceph-mon[28069]: pgmap v391: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-26T11:29:19.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:19 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2359182883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T11:29:19.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:19 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2073875801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T11:29:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:19 smithi193 ceph-mon[32782]: pgmap v391: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-26T11:29:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:19 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2359182883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T11:29:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:19 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2073875801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T11:29:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:19 smithi196 ceph-mon[32572]: pgmap v391: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-26T11:29:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:19 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2359182883' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T11:29:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:19 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2073875801' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T11:29:20.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.571+0000 7f2dd0c00700 1 -- 172.21.15.110:0/1194486005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dcc103470 msgr2=0x7f2dcc1038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:20.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.571+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/1194486005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dcc103470 0x7f2dcc1038f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009990 tx=0x7f2db8009ca0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.571+0000 7f2dd0c00700 1 -- 172.21.15.110:0/1194486005 shutdown_connections 2024-04-26T11:29:20.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.571+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/1194486005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dcc103e30 0x7f2dcc110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.571+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/1194486005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2dcc1094c0 0x7f2dcc1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.571+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/1194486005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dcc103470 0x7f2dcc1038f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.571+0000 7f2dd0c00700 1 -- 172.21.15.110:0/1194486005 >> 172.21.15.110:0/1194486005 conn(0x7f2dcc07a580 msgr2=0x7f2dcc07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:20.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.571+0000 7f2dd0c00700 1 -- 172.21.15.110:0/1194486005 shutdown_connections 2024-04-26T11:29:20.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.571+0000 7f2dd0c00700 1 -- 172.21.15.110:0/1194486005 wait complete. 2024-04-26T11:29:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.572+0000 7f2dd0c00700 1 Processor -- start 2024-04-26T11:29:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.572+0000 7f2dd0c00700 1 -- start start 2024-04-26T11:29:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.572+0000 7f2dd0c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dcc103470 0x7f2dcc19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.572+0000 7f2dd0c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dcc103e30 0x7f2dcc19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:20.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.572+0000 7f2dd0c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2dcc1094c0 0x7f2dcc1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:20.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.572+0000 7f2dd0c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc1135e0 con 0x7f2dcc103470 2024-04-26T11:29:20.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.572+0000 7f2dd0c00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc113460 con 0x7f2dcc103e30 2024-04-26T11:29:20.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.572+0000 7f2dd0c00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc113760 con 0x7f2dcc1094c0 2024-04-26T11:29:20.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dc9e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dcc103470 0x7f2dcc19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:20.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dc9400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dcc103e30 0x7f2dcc19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:20.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dc9400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dcc103e30 0x7f2dcc19c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:44606/0 (socket says 172.21.15.110:44606) 2024-04-26T11:29:20.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dc9400700 1 -- 172.21.15.110:0/746277128 learned_addr learned my addr 172.21.15.110:0/746277128 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:20.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dca800700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2dcc1094c0 0x7f2dcc1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:20.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dc9e00700 1 -- 172.21.15.110:0/746277128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2dcc1094c0 msgr2=0x7f2dcc1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:20.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dc9e00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2dcc1094c0 0x7f2dcc1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dc9e00700 1 -- 172.21.15.110:0/746277128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dcc103e30 msgr2=0x7f2dcc19c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dc9e00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dcc103e30 0x7f2dcc19c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.573+0000 7f2dc9e00700 1 -- 172.21.15.110:0/746277128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc1a0d50 con 0x7f2dcc103470 2024-04-26T11:29:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.574+0000 7f2dc9e00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dcc103470 0x7f2dcc19bd40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00e9f0 tx=0x7f2dbc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.574+0000 7f2dc2a00700 1 -- 172.21.15.110:0/746277128 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc004220 con 0x7f2dcc103470 2024-04-26T11:29:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.574+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dcc1a1040 con 0x7f2dcc103470 2024-04-26T11:29:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.574+0000 7f2dc2a00700 1 -- 172.21.15.110:0/746277128 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dbc0043c0 con 0x7f2dcc103470 2024-04-26T11:29:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.574+0000 7f2dc2a00700 1 -- 172.21.15.110:0/746277128 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc005020 con 0x7f2dcc103470 2024-04-26T11:29:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.574+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dcc1a88c0 con 0x7f2dcc103470 2024-04-26T11:29:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.575+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dcc06a110 con 0x7f2dcc103470 2024-04-26T11:29:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.577+0000 7f2dc2a00700 1 -- 172.21.15.110:0/746277128 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f2dbc004750 con 0x7f2dcc103470 2024-04-26T11:29:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.578+0000 7f2dc2a00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2db00a3c40 0x7f2db00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.579+0000 7f2dc2a00700 1 -- 172.21.15.110:0/746277128 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f2dbc0d03f0 con 0x7f2dcc103470 2024-04-26T11:29:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.579+0000 7f2dc9400700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2db00a3c40 0x7f2db00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.579+0000 7f2dc9400700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2db00a3c40 0x7f2db00a6100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005cd0 tx=0x7f2db8005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:20.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.583+0000 7f2dc2a00700 1 -- 172.21.15.110:0/746277128 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2dbc09ccd0 con 0x7f2dcc103470 2024-04-26T11:29:20.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.818+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2dcc02e490 con 0x7f2dcc103470 2024-04-26T11:29:20.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.819+0000 7f2dc2a00700 1 -- 172.21.15.110:0/746277128 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2dbc09c5d0 con 0x7f2dcc103470 2024-04-26T11:29:20.820 INFO:teuthology.orchestra.run.smithi110.stdout:55834574947 2024-04-26T11:29:20.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2db00a3c40 msgr2=0x7f2db00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:20.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2db00a3c40 0x7f2db00a6100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005cd0 tx=0x7f2db8005c60 comp rx=0 tx=0).stop 2024-04-26T11:29:20.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dcc103470 msgr2=0x7f2dcc19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:20.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dcc103470 0x7f2dcc19bd40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00e9f0 tx=0x7f2dbc00ed00 comp rx=0 tx=0).stop 2024-04-26T11:29:20.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 shutdown_connections 2024-04-26T11:29:20.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f2db00a3c40 0x7f2db00a6100 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2dcc1094c0 0x7f2dcc1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dcc103470 0x7f2dcc19bd40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 --2- 172.21.15.110:0/746277128 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dcc103e30 0x7f2dcc19c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:20.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 >> 172.21.15.110:0/746277128 conn(0x7f2dcc07a580 msgr2=0x7f2dcc10e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:20.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 shutdown_connections 2024-04-26T11:29:20.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:20.822+0000 7f2dd0c00700 1 -- 172.21.15.110:0/746277128 wait complete. 2024-04-26T11:29:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:21 smithi110 ceph-mon[28069]: pgmap v392: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:21 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/746277128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T11:29:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:21 smithi193 ceph-mon[32782]: pgmap v392: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:21 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/746277128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T11:29:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:21 smithi196 ceph-mon[32572]: pgmap v392: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:21 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/746277128' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T11:29:23.760 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738466 got 34359738471 for osd.0 2024-04-26T11:29:23.760 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:23.850 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:23 smithi110 ceph-mon[28069]: pgmap v393: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:23 smithi193 ceph-mon[32782]: pgmap v393: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:23.908 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724613 got 167503724621 for osd.5 2024-04-26T11:29:23.908 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:23 smithi196 ceph-mon[32572]: pgmap v393: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:24.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.646+0000 7fbd57000700 1 -- 172.21.15.110:0/1665494060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd501145f0 msgr2=0x7fbd501169e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:24.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.646+0000 7fbd57000700 1 --2- 172.21.15.110:0/1665494060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd501145f0 0x7fbd501169e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800b0a0 tx=0x7fbd4800b3b0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.646+0000 7fbd57000700 1 -- 172.21.15.110:0/1665494060 shutdown_connections 2024-04-26T11:29:24.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.646+0000 7fbd57000700 1 --2- 172.21.15.110:0/1665494060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd501145f0 0x7fbd501169e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.646+0000 7fbd57000700 1 --2- 172.21.15.110:0/1665494060 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd50075650 0x7fbd50075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.646+0000 7fbd57000700 1 --2- 172.21.15.110:0/1665494060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd50075f70 0x7fbd501140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.646+0000 7fbd57000700 1 -- 172.21.15.110:0/1665494060 >> 172.21.15.110:0/1665494060 conn(0x7fbd5007a580 msgr2=0x7fbd5007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:24.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.646+0000 7fbd57000700 1 -- 172.21.15.110:0/1665494060 shutdown_connections 2024-04-26T11:29:24.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.646+0000 7fbd57000700 1 -- 172.21.15.110:0/1665494060 wait complete. 2024-04-26T11:29:24.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.647+0000 7fbd57000700 1 Processor -- start 2024-04-26T11:29:24.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.647+0000 7fbd57000700 1 -- start start 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd57000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd50075650 0x7fbd501a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd57000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd50075f70 0x7fbd501a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd57000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd501145f0 0x7fbd501a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd57000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbd50119c10 con 0x7fbd501145f0 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd57000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbd50119a90 con 0x7fbd50075650 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd57000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbd50119d90 con 0x7fbd50075f70 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd4fe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd50075650 0x7fbd501a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd55000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd501145f0 0x7fbd501a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd4f400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd50075f70 0x7fbd501a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd4fe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd50075650 0x7fbd501a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54398/0 (socket says 172.21.15.110:54398) 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd4f400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd50075f70 0x7fbd501a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42798/0 (socket says 172.21.15.110:42798) 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.648+0000 7fbd4fe00700 1 -- 172.21.15.110:0/90596745 learned_addr learned my addr 172.21.15.110:0/90596745 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd4fe00700 1 -- 172.21.15.110:0/90596745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd50075f70 msgr2=0x7fbd501a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:24.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd4fe00700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd50075f70 0x7fbd501a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd4fe00700 1 -- 172.21.15.110:0/90596745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd501145f0 msgr2=0x7fbd501a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:24.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd4fe00700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd501145f0 0x7fbd501a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd4fe00700 1 -- 172.21.15.110:0/90596745 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd501a50d0 con 0x7fbd50075650 2024-04-26T11:29:24.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd4fe00700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd50075650 0x7fbd501a00c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000e9a0 tx=0x7fbd4000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:24.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd4cc00700 1 -- 172.21.15.110:0/90596745 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000ca10 con 0x7fbd50075650 2024-04-26T11:29:24.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd501a53c0 con 0x7fbd50075650 2024-04-26T11:29:24.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd4cc00700 1 -- 172.21.15.110:0/90596745 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd4000cbb0 con 0x7fbd50075650 2024-04-26T11:29:24.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd4cc00700 1 -- 172.21.15.110:0/90596745 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40018680 con 0x7fbd50075650 2024-04-26T11:29:24.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.649+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd501acc40 con 0x7fbd50075650 2024-04-26T11:29:24.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.650+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd5006a110 con 0x7fbd50075650 2024-04-26T11:29:24.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.652+0000 7fbd4cc00700 1 -- 172.21.15.110:0/90596745 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fbd40010430 con 0x7fbd50075650 2024-04-26T11:29:24.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.653+0000 7fbd4cc00700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbd340a3c40 0x7fbd340a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:24.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.654+0000 7fbd4cc00700 1 -- 172.21.15.110:0/90596745 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fbd400d0660 con 0x7fbd50075650 2024-04-26T11:29:24.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.654+0000 7fbd4f400700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbd340a3c40 0x7fbd340a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:24.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.654+0000 7fbd4f400700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbd340a3c40 0x7fbd340a6100 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbd50110f70 tx=0x7fbd3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:24.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.658+0000 7fbd4cc00700 1 -- 172.21.15.110:0/90596745 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbd4009cf40 con 0x7fbd50075650 2024-04-26T11:29:24.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fbd501ace10 con 0x7fbd50075650 2024-04-26T11:29:24.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7fbd4cc00700 1 -- 172.21.15.110:0/90596745 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbd4009c840 con 0x7fbd50075650 2024-04-26T11:29:24.897 INFO:teuthology.orchestra.run.smithi110.stdout:292057776182 2024-04-26T11:29:24.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbd340a3c40 msgr2=0x7fbd340a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:24.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbd340a3c40 0x7fbd340a6100 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbd50110f70 tx=0x7fbd3c009260 comp rx=0 tx=0).stop 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd50075650 msgr2=0x7fbd501a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd50075650 0x7fbd501a00c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000e9a0 tx=0x7fbd4000ecb0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 shutdown_connections 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd501145f0 0x7fbd501a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd50075650 0x7fbd501a00c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbd340a3c40 0x7fbd340a6100 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 --2- 172.21.15.110:0/90596745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd50075f70 0x7fbd501a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 >> 172.21.15.110:0/90596745 conn(0x7fbd5007a580 msgr2=0x7fbd50113420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 shutdown_connections 2024-04-26T11:29:24.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.899+0000 7fbd57000700 1 -- 172.21.15.110:0/90596745 wait complete. 2024-04-26T11:29:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.892+0000 7f82aee00700 1 -- 172.21.15.110:0/3937268545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a8109a50 msgr2=0x7f82a8109ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.892+0000 7f82aee00700 1 --2- 172.21.15.110:0/3937268545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a8109a50 0x7f82a8109ed0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8294009990 tx=0x7f8294009ca0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.892+0000 7f82aee00700 1 -- 172.21.15.110:0/3937268545 shutdown_connections 2024-04-26T11:29:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.892+0000 7f82aee00700 1 --2- 172.21.15.110:0/3937268545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82a810a410 0x7f82a8116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.892+0000 7f82aee00700 1 --2- 172.21.15.110:0/3937268545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82a810fa50 0x7f82a810fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.892+0000 7f82aee00700 1 --2- 172.21.15.110:0/3937268545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a8109a50 0x7f82a8109ed0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.892+0000 7f82aee00700 1 -- 172.21.15.110:0/3937268545 >> 172.21.15.110:0/3937268545 conn(0x7f82a8076bf0 msgr2=0x7f82a8108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.892+0000 7f82aee00700 1 -- 172.21.15.110:0/3937268545 shutdown_connections 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.892+0000 7f82aee00700 1 -- 172.21.15.110:0/3937268545 wait complete. 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.894+0000 7f82aee00700 1 Processor -- start 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.894+0000 7f82aee00700 1 -- start start 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.894+0000 7f82aee00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82a8109a50 0x7f82a81a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.894+0000 7f82aee00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82a810a410 0x7f82a81a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.894+0000 7f82aee00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a810fa50 0x7f82a81a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.894+0000 7f82aee00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f82a8119c90 con 0x7f82a810fa50 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.894+0000 7f82aee00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f82a8119b10 con 0x7f82a810a410 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.894+0000 7f82aee00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f82a8119e10 con 0x7f82a8109a50 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82a8109a50 0x7f82a81a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82a810a410 0x7f82a81a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:25.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82a8109a50 0x7f82a81a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42830/0 (socket says 172.21.15.110:42830) 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82a810a410 0x7f82a81a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54414/0 (socket says 172.21.15.110:54414) 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7400700 1 -- 172.21.15.110:0/2628213811 learned_addr learned my addr 172.21.15.110:0/2628213811 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82ace00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a810fa50 0x7f82a81a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7e00700 1 -- 172.21.15.110:0/2628213811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82a810a410 msgr2=0x7f82a81a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7e00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82a810a410 0x7f82a81a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7e00700 1 -- 172.21.15.110:0/2628213811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a810fa50 msgr2=0x7f82a81a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7e00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a810fa50 0x7f82a81a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7e00700 1 -- 172.21.15.110:0/2628213811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a81a50e0 con 0x7f82a8109a50 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.895+0000 7f82a7400700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82a810a410 0x7f82a81a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.896+0000 7f82a7e00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82a8109a50 0x7f82a81a0120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f829800e9f0 tx=0x7f829800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.896+0000 7f82a4c00700 1 -- 172.21.15.110:0/2628213811 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829800c9c0 con 0x7f82a8109a50 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.896+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a81a53d0 con 0x7f82a8109a50 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.896+0000 7f82a4c00700 1 -- 172.21.15.110:0/2628213811 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f829800cb60 con 0x7f82a8109a50 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.896+0000 7f82a4c00700 1 -- 172.21.15.110:0/2628213811 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8298018680 con 0x7f82a8109a50 2024-04-26T11:29:25.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.896+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a81acc50 con 0x7f82a8109a50 2024-04-26T11:29:25.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.898+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a806a110 con 0x7f82a8109a50 2024-04-26T11:29:25.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.900+0000 7f82a4c00700 1 -- 172.21.15.110:0/2628213811 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f8298010430 con 0x7f82a8109a50 2024-04-26T11:29:25.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.902+0000 7f82a4c00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f828c0a3c40 0x7f828c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:25.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.902+0000 7f82a4c00700 1 -- 172.21.15.110:0/2628213811 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f82980d0540 con 0x7f82a8109a50 2024-04-26T11:29:25.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.902+0000 7f82a7400700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f828c0a3c40 0x7f828c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:25.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.903+0000 7f82a7400700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f828c0a3c40 0x7f828c0a6100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8294009750 tx=0x7f829401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:25.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:24.906+0000 7f82a4c00700 1 -- 172.21.15.110:0/2628213811 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f829809ce80 con 0x7f82a8109a50 2024-04-26T11:29:25.133 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149778 got 111669149781 for osd.3 2024-04-26T11:29:25.134 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:25.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.153+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f82a802e490 con 0x7f82a8109a50 2024-04-26T11:29:25.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.153+0000 7f82a4c00700 1 -- 172.21.15.110:0/2628213811 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f829809c780 con 0x7f82a8109a50 2024-04-26T11:29:25.155 INFO:teuthology.orchestra.run.smithi110.stdout:223338299457 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.156+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f828c0a3c40 msgr2=0x7f828c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.156+0000 7f82aee00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f828c0a3c40 0x7f828c0a6100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8294009750 tx=0x7f829401a040 comp rx=0 tx=0).stop 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.156+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82a8109a50 msgr2=0x7f82a81a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.156+0000 7f82aee00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82a8109a50 0x7f82a81a0120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f829800e9f0 tx=0x7f829800ed00 comp rx=0 tx=0).stop 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.157+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 shutdown_connections 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.157+0000 7f82aee00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a810fa50 0x7f82a81a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.157+0000 7f82aee00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f828c0a3c40 0x7f828c0a6100 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.157+0000 7f82aee00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f82a8109a50 0x7f82a81a0120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.157+0000 7f82aee00700 1 --2- 172.21.15.110:0/2628213811 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f82a810a410 0x7f82a81a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:25.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.157+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 >> 172.21.15.110:0/2628213811 conn(0x7f82a8076bf0 msgr2=0x7f82a8077250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:25.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.157+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 shutdown_connections 2024-04-26T11:29:25.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.157+0000 7f82aee00700 1 -- 172.21.15.110:0/2628213811 wait complete. 2024-04-26T11:29:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:25 smithi193 ceph-mon[32782]: pgmap v394: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:25 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/90596745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T11:29:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:25 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2628213811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T11:29:25.989 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:25 smithi110 ceph-mon[28069]: pgmap v394: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:25.989 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:25 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/90596745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T11:29:25.989 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:25 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2628213811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T11:29:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:25 smithi196 ceph-mon[32572]: pgmap v394: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:25 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/90596745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T11:29:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:25 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2628213811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T11:29:26.472 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299449 got 223338299457 for osd.7 2024-04-26T11:29:26.472 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:26.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.767+0000 7f50b5600700 1 -- 172.21.15.110:0/501868471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 msgr2=0x7f50b01123c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:26.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.767+0000 7f50b5600700 1 --2- 172.21.15.110:0/501868471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 0x7f50b01123c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f50a800b0d0 tx=0x7f50a800b3e0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.767+0000 7f50b5600700 1 -- 172.21.15.110:0/501868471 shutdown_connections 2024-04-26T11:29:26.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.767+0000 7f50b5600700 1 --2- 172.21.15.110:0/501868471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 0x7f50b01123c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.767+0000 7f50b5600700 1 --2- 172.21.15.110:0/501868471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50b010b5f0 0x7f50b010b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.767+0000 7f50b5600700 1 --2- 172.21.15.110:0/501868471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50b0105540 0x7f50b01059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.767+0000 7f50b5600700 1 -- 172.21.15.110:0/501868471 >> 172.21.15.110:0/501868471 conn(0x7f50b0101050 msgr2=0x7f50b0103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.767+0000 7f50b5600700 1 -- 172.21.15.110:0/501868471 shutdown_connections 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.767+0000 7f50b5600700 1 -- 172.21.15.110:0/501868471 wait complete. 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.768+0000 7f50b5600700 1 Processor -- start 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.768+0000 7f50b5600700 1 -- start start 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50b5600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50b0105540 0x7f50b01a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50b5600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 0x7f50b01a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50b5600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50b010b5f0 0x7f50b019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50b5600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f50b0115760 con 0x7f50b0105f00 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50b5600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f50b01155e0 con 0x7f50b0105540 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50b5600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f50b01158e0 con 0x7f50b010b5f0 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50af400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 0x7f50b01a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:26.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50af400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 0x7f50b01a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44414/0 (socket says 172.21.15.110:44414) 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50af400700 1 -- 172.21.15.110:0/1946939825 learned_addr learned my addr 172.21.15.110:0/1946939825 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50afe00700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50b0105540 0x7f50b01a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50b4c00700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50b010b5f0 0x7f50b019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50af400700 1 -- 172.21.15.110:0/1946939825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50b010b5f0 msgr2=0x7f50b019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50af400700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50b010b5f0 0x7f50b019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50af400700 1 -- 172.21.15.110:0/1946939825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50b0105540 msgr2=0x7f50b01a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50af400700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50b0105540 0x7f50b01a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.769+0000 7f50af400700 1 -- 172.21.15.110:0/1946939825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b019c0e0 con 0x7f50b0105f00 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.770+0000 7f50af400700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 0x7f50b01a1cb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f509c00e9c0 tx=0x7f509c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.770+0000 7f50acc00700 1 -- 172.21.15.110:0/1946939825 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c00cbd0 con 0x7f50b0105f00 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.770+0000 7f50acc00700 1 -- 172.21.15.110:0/1946939825 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f509c00cd70 con 0x7f50b0105f00 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.770+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b019c3d0 con 0x7f50b0105f00 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.770+0000 7f50acc00700 1 -- 172.21.15.110:0/1946939825 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c005610 con 0x7f50b0105f00 2024-04-26T11:29:26.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.770+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b01a8640 con 0x7f50b0105f00 2024-04-26T11:29:26.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.771+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b006a110 con 0x7f50b0105f00 2024-04-26T11:29:26.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.774+0000 7f50acc00700 1 -- 172.21.15.110:0/1946939825 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f509c004750 con 0x7f50b0105f00 2024-04-26T11:29:26.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.775+0000 7f50acc00700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50940a3cc0 0x7f50940a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:26.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.775+0000 7f50acc00700 1 -- 172.21.15.110:0/1946939825 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f509c0d07b0 con 0x7f50b0105f00 2024-04-26T11:29:26.579 INFO:teuthology.orchestra.run.smithi110.stdout:313532612656 2024-04-26T11:29:26.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.776+0000 7f50afe00700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50940a3cc0 0x7f50940a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.776+0000 7f50afe00700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50940a3cc0 0x7f50940a6180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f50b010a660 tx=0x7f50a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:25.780+0000 7f50acc00700 1 -- 172.21.15.110:0/1946939825 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f509c09d090 con 0x7f50b0105f00 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.012+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f50b019ce60 con 0x7f50b0105f00 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.013+0000 7f50acc00700 1 -- 172.21.15.110:0/1946939825 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f509c09c990 con 0x7f50b0105f00 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.017+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50940a3cc0 msgr2=0x7f50940a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.017+0000 7f50b5600700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50940a3cc0 0x7f50940a6180 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f50b010a660 tx=0x7f50a0009260 comp rx=0 tx=0).stop 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.017+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 msgr2=0x7f50b01a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.017+0000 7f50b5600700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 0x7f50b01a1cb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f509c00e9c0 tx=0x7f509c00ecd0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.018+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 shutdown_connections 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.018+0000 7f50b5600700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f50940a3cc0 0x7f50940a6180 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.018+0000 7f50b5600700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50b010b5f0 0x7f50b019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.018+0000 7f50b5600700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50b0105540 0x7f50b01a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.018+0000 7f50b5600700 1 --2- 172.21.15.110:0/1946939825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b0105f00 0x7f50b01a1cb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:26.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.018+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 >> 172.21.15.110:0/1946939825 conn(0x7f50b0101050 msgr2=0x7f50b0102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:26.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.018+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 shutdown_connections 2024-04-26T11:29:26.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:26.018+0000 7f50b5600700 1 -- 172.21.15.110:0/1946939825 wait complete. 2024-04-26T11:29:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:26 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1946939825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T11:29:26.893 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:26 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1946939825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T11:29:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:26 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1946939825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T11:29:27.431 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612650 got 313532612656 for osd.10 2024-04-26T11:29:27.431 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:27 smithi110 ceph-mon[28069]: pgmap v395: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:27 smithi193 ceph-mon[32782]: pgmap v395: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:27 smithi196 ceph-mon[32572]: pgmap v395: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:28.962 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574939 got 55834574947 for osd.1 2024-04-26T11:29:28.963 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:29 smithi110 ceph-mon[28069]: pgmap v396: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:29 smithi193 ceph-mon[32782]: pgmap v396: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:29 smithi196 ceph-mon[32572]: pgmap v396: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:30.143 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:30.174 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776177 got 292057776182 for osd.9 2024-04-26T11:29:30.174 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.822+0000 7f87afe00700 1 -- 172.21.15.110:0/2813182701 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87b0109960 msgr2=0x7f87b0109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.822+0000 7f87afe00700 1 --2- 172.21.15.110:0/2813182701 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87b0109960 0x7f87b0109de0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f879c0098f0 tx=0x7f879c009c00 comp rx=0 tx=0).stop 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.822+0000 7f87afe00700 1 -- 172.21.15.110:0/2813182701 shutdown_connections 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.822+0000 7f87afe00700 1 --2- 172.21.15.110:0/2813182701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87b010a320 0x7f87b01167c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.822+0000 7f87afe00700 1 --2- 172.21.15.110:0/2813182701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87b010e830 0x7f87b010ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.822+0000 7f87afe00700 1 --2- 172.21.15.110:0/2813182701 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87b0109960 0x7f87b0109de0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.822+0000 7f87afe00700 1 -- 172.21.15.110:0/2813182701 >> 172.21.15.110:0/2813182701 conn(0x7f87b00791b0 msgr2=0x7f87b0108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.822+0000 7f87afe00700 1 -- 172.21.15.110:0/2813182701 shutdown_connections 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.822+0000 7f87afe00700 1 -- 172.21.15.110:0/2813182701 wait complete. 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.823+0000 7f87afe00700 1 Processor -- start 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.823+0000 7f87afe00700 1 -- start start 2024-04-26T11:29:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87afe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87b0109960 0x7f87b01a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87afe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87b010a320 0x7f87b01a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87afe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87b010e830 0x7f87b01a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87afe00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f87b0119b50 con 0x7f87b0109960 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87afe00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f87b01199d0 con 0x7f87b010e830 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87afe00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f87b0119cd0 con 0x7f87b010a320 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87aea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87b0109960 0x7f87b01a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87aea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87b0109960 0x7f87b01a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44420/0 (socket says 172.21.15.110:44420) 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87aea00700 1 -- 172.21.15.110:0/1441795145 learned_addr learned my addr 172.21.15.110:0/1441795145 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87ae000700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87b010a320 0x7f87b01a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.824+0000 7f87af400700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87b010e830 0x7f87b01a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87aea00700 1 -- 172.21.15.110:0/1441795145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87b010a320 msgr2=0x7f87b01a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87aea00700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87b010a320 0x7f87b01a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87aea00700 1 -- 172.21.15.110:0/1441795145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87b010e830 msgr2=0x7f87b01a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87aea00700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87b010e830 0x7f87b01a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87aea00700 1 -- 172.21.15.110:0/1441795145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b01a5130 con 0x7f87b0109960 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87ae000700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87b010a320 0x7f87b01a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87af400700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87b010e830 0x7f87b01a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87aea00700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87b0109960 0x7f87b01a0120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f87a000e9c0 tx=0x7f87a000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87a7400700 1 -- 172.21.15.110:0/1441795145 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0004a30 con 0x7f87b0109960 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b01a5420 con 0x7f87b0109960 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87a7400700 1 -- 172.21.15.110:0/1441795145 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87a000cc70 con 0x7f87b0109960 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.825+0000 7f87a7400700 1 -- 172.21.15.110:0/1441795145 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0005580 con 0x7f87b0109960 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.826+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b01acca0 con 0x7f87b0109960 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.827+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b006a110 con 0x7f87b0109960 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.829+0000 7f87a7400700 1 -- 172.21.15.110:0/1441795145 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f87a000c7c0 con 0x7f87b0109960 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.830+0000 7f87a7400700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f87940a3c40 0x7f87940a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.831+0000 7f87a7400700 1 -- 172.21.15.110:0/1441795145 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f87a00d0540 con 0x7f87b0109960 2024-04-26T11:29:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.831+0000 7f87ae000700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f87940a3c40 0x7f87940a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:30.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.832+0000 7f87ae000700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f87940a3c40 0x7f87940a6100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f879c0098c0 tx=0x7f879c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:30.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:29.836+0000 7f87a7400700 1 -- 172.21.15.110:0/1441795145 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f87a009ce20 con 0x7f87b0109960 2024-04-26T11:29:30.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.066+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f87b01a1480 con 0x7f87b0109960 2024-04-26T11:29:30.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.067+0000 7f87a7400700 1 -- 172.21.15.110:0/1441795145 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f87a009c720 con 0x7f87b0109960 2024-04-26T11:29:30.288 INFO:teuthology.orchestra.run.smithi110.stdout:347892351020 2024-04-26T11:29:30.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.069+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f87940a3c40 msgr2=0x7f87940a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:30.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.069+0000 7f87afe00700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f87940a3c40 0x7f87940a6100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f879c0098c0 tx=0x7f879c019040 comp rx=0 tx=0).stop 2024-04-26T11:29:30.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.069+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87b0109960 msgr2=0x7f87b01a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:30.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.069+0000 7f87afe00700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87b0109960 0x7f87b01a0120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f87a000e9c0 tx=0x7f87a000ecd0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.070+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 shutdown_connections 2024-04-26T11:29:30.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.070+0000 7f87afe00700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87b010e830 0x7f87b01a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.070+0000 7f87afe00700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87b0109960 0x7f87b01a0120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.070+0000 7f87afe00700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f87940a3c40 0x7f87940a6100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.070+0000 7f87afe00700 1 --2- 172.21.15.110:0/1441795145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87b010a320 0x7f87b01a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.070+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 >> 172.21.15.110:0/1441795145 conn(0x7f87b00791b0 msgr2=0x7f87b00798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:30.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.070+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 shutdown_connections 2024-04-26T11:29:30.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.070+0000 7f87afe00700 1 -- 172.21.15.110:0/1441795145 wait complete. 2024-04-26T11:29:30.846 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:30 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1441795145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T11:29:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.880+0000 7fae6ba00700 1 -- 172.21.15.110:0/1910292678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 msgr2=0x7fae64075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.880+0000 7fae6ba00700 1 --2- 172.21.15.110:0/1910292678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 0x7fae64075a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fae58009990 tx=0x7fae58009ca0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.880+0000 7fae6ba00700 1 -- 172.21.15.110:0/1910292678 shutdown_connections 2024-04-26T11:29:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.880+0000 7fae6ba00700 1 --2- 172.21.15.110:0/1910292678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6410fe80 0x7fae64112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.880+0000 7fae6ba00700 1 --2- 172.21.15.110:0/1910292678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 0x7fae64075a30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.880+0000 7fae6ba00700 1 --2- 172.21.15.110:0/1910292678 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae64075f70 0x7fae6410f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.880+0000 7fae6ba00700 1 -- 172.21.15.110:0/1910292678 >> 172.21.15.110:0/1910292678 conn(0x7fae6407a580 msgr2=0x7fae6407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.880+0000 7fae6ba00700 1 -- 172.21.15.110:0/1910292678 shutdown_connections 2024-04-26T11:29:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.880+0000 7fae6ba00700 1 -- 172.21.15.110:0/1910292678 wait complete. 2024-04-26T11:29:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.882+0000 7fae6ba00700 1 Processor -- start 2024-04-26T11:29:30.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.882+0000 7fae6ba00700 1 -- start start 2024-04-26T11:29:30.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.882+0000 7fae6ba00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 0x7fae6419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:30.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.882+0000 7fae6ba00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae64075f70 0x7fae6419c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:30.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.882+0000 7fae6ba00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6410fe80 0x7fae641a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:30.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.882+0000 7fae6ba00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fae64115890 con 0x7fae6410fe80 2024-04-26T11:29:30.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.882+0000 7fae6ba00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fae64115710 con 0x7fae64075650 2024-04-26T11:29:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.882+0000 7fae6ba00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fae64115a10 con 0x7fae64075f70 2024-04-26T11:29:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 0x7fae6419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae63e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae64075f70 0x7fae6419c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6410fe80 0x7fae641a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 0x7fae6419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54478/0 (socket says 172.21.15.110:54478) 2024-04-26T11:29:30.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69000700 1 -- 172.21.15.110:0/2098915877 learned_addr learned my addr 172.21.15.110:0/2098915877 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69000700 1 -- 172.21.15.110:0/2098915877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae64075f70 msgr2=0x7fae6419c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69000700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae64075f70 0x7fae6419c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69000700 1 -- 172.21.15.110:0/2098915877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6410fe80 msgr2=0x7fae641a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69000700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6410fe80 0x7fae641a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69000700 1 -- 172.21.15.110:0/2098915877 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae641a0d30 con 0x7fae64075650 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae63e00700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae64075f70 0x7fae6419c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.883+0000 7fae69000700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 0x7fae6419bd20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae58000c00 tx=0x7fae580057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.884+0000 7fae61600700 1 -- 172.21.15.110:0/2098915877 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58027070 con 0x7fae64075650 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.884+0000 7fae61600700 1 -- 172.21.15.110:0/2098915877 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae58022470 con 0x7fae64075650 2024-04-26T11:29:30.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.884+0000 7fae61600700 1 -- 172.21.15.110:0/2098915877 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58017650 con 0x7fae64075650 2024-04-26T11:29:30.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.884+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae641a0fc0 con 0x7fae64075650 2024-04-26T11:29:30.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.884+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae641a88a0 con 0x7fae64075650 2024-04-26T11:29:30.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.885+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae64076d10 con 0x7fae64075650 2024-04-26T11:29:30.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.887+0000 7fae61600700 1 -- 172.21.15.110:0/2098915877 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fae5802a070 con 0x7fae64075650 2024-04-26T11:29:30.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.888+0000 7fae61600700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fae4c0a3c40 0x7fae4c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.889+0000 7fae61600700 1 -- 172.21.15.110:0/2098915877 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fae580d11d0 con 0x7fae64075650 2024-04-26T11:29:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.889+0000 7fae63e00700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fae4c0a3c40 0x7fae4c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:30.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.889+0000 7fae63e00700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fae4c0a3c40 0x7fae4c0a6100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fae64111a60 tx=0x7fae50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:30.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:30.891+0000 7fae61600700 1 -- 172.21.15.110:0/2098915877 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fae58013070 con 0x7fae64075650 2024-04-26T11:29:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:30 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1441795145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T11:29:31.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.119+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fae6419d080 con 0x7fae64075650 2024-04-26T11:29:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:30 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1441795145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T11:29:31.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.120+0000 7fae61600700 1 -- 172.21.15.110:0/2098915877 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fae5809db40 con 0x7fae64075650 2024-04-26T11:29:31.122 INFO:teuthology.orchestra.run.smithi110.stdout:77309411425 2024-04-26T11:29:31.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.123+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fae4c0a3c40 msgr2=0x7fae4c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:31.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fae4c0a3c40 0x7fae4c0a6100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fae64111a60 tx=0x7fae50009260 comp rx=0 tx=0).stop 2024-04-26T11:29:31.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 msgr2=0x7fae6419bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:31.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 0x7fae6419bd20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae58000c00 tx=0x7fae580057c0 comp rx=0 tx=0).stop 2024-04-26T11:29:31.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 shutdown_connections 2024-04-26T11:29:31.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6410fe80 0x7fae641a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:31.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae64075650 0x7fae6419bd20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:31.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fae4c0a3c40 0x7fae4c0a6100 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:31.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 --2- 172.21.15.110:0/2098915877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae64075f70 0x7fae6419c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:31.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 >> 172.21.15.110:0/2098915877 conn(0x7fae6407a580 msgr2=0x7fae64100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:31.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 shutdown_connections 2024-04-26T11:29:31.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:31.124+0000 7fae6ba00700 1 -- 172.21.15.110:0/2098915877 wait complete. 2024-04-26T11:29:31.341 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892351014 got 347892351020 for osd.11 2024-04-26T11:29:31.341 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:31.935 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:31 smithi110 ceph-mon[28069]: pgmap v397: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:31.935 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:31 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2098915877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T11:29:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:31 smithi196 ceph-mon[32572]: pgmap v397: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:31 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2098915877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T11:29:32.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:31 smithi193 ceph-mon[32782]: pgmap v397: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:32.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:31 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2098915877' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T11:29:32.502 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411419 got 77309411425 for osd.2 2024-04-26T11:29:32.503 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:33.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:33 smithi110 ceph-mon[28069]: pgmap v398: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:33 smithi196 ceph-mon[32572]: pgmap v398: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:33 smithi193 ceph-mon[32782]: pgmap v398: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.826+0000 7f96db400700 1 -- 172.21.15.110:0/596348534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96d41094c0 msgr2=0x7f96d41098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.826+0000 7f96db400700 1 --2- 172.21.15.110:0/596348534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96d41094c0 0x7f96d41098a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009990 tx=0x7f96c8009ca0 comp rx=0 tx=0).stop 2024-04-26T11:29:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.826+0000 7f96db400700 1 -- 172.21.15.110:0/596348534 shutdown_connections 2024-04-26T11:29:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.826+0000 7f96db400700 1 --2- 172.21.15.110:0/596348534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96d4103e30 0x7f96d4110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.826+0000 7f96db400700 1 --2- 172.21.15.110:0/596348534 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96d41094c0 0x7f96d41098a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.826+0000 7f96db400700 1 --2- 172.21.15.110:0/596348534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96d4103470 0x7f96d41038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.826+0000 7f96db400700 1 -- 172.21.15.110:0/596348534 >> 172.21.15.110:0/596348534 conn(0x7f96d407a580 msgr2=0x7f96d407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:34.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.826+0000 7f96db400700 1 -- 172.21.15.110:0/596348534 shutdown_connections 2024-04-26T11:29:34.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.826+0000 7f96db400700 1 -- 172.21.15.110:0/596348534 wait complete. 2024-04-26T11:29:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.827+0000 7f96db400700 1 Processor -- start 2024-04-26T11:29:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.827+0000 7f96db400700 1 -- start start 2024-04-26T11:29:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96db400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96d4103470 0x7f96d419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96db400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96d4103e30 0x7f96d419c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96db400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96d41094c0 0x7f96d41a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96db400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4113610 con 0x7f96d4103470 2024-04-26T11:29:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96db400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4113490 con 0x7f96d4103e30 2024-04-26T11:29:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96db400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4113790 con 0x7f96d41094c0 2024-04-26T11:29:34.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96d8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96d4103470 0x7f96d419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96d8a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96d4103470 0x7f96d419bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46096/0 (socket says 172.21.15.110:46096) 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96d8a00700 1 -- 172.21.15.110:0/146035305 learned_addr learned my addr 172.21.15.110:0/146035305 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96d3e00700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96d4103e30 0x7f96d419c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.828+0000 7f96d9400700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96d41094c0 0x7f96d41a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.829+0000 7f96d8a00700 1 -- 172.21.15.110:0/146035305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96d41094c0 msgr2=0x7f96d41a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.829+0000 7f96d8a00700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96d41094c0 0x7f96d41a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.829+0000 7f96d8a00700 1 -- 172.21.15.110:0/146035305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96d4103e30 msgr2=0x7f96d419c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.829+0000 7f96d8a00700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96d4103e30 0x7f96d419c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.829+0000 7f96d8a00700 1 -- 172.21.15.110:0/146035305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d41a0d50 con 0x7f96d4103470 2024-04-26T11:29:34.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.829+0000 7f96d3e00700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96d4103e30 0x7f96d419c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:34.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.829+0000 7f96d8a00700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96d4103470 0x7f96d419bd40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96c8000c00 tx=0x7f96c80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:34.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.829+0000 7f96d1600700 1 -- 172.21.15.110:0/146035305 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8027070 con 0x7f96d4103470 2024-04-26T11:29:34.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.830+0000 7f96d1600700 1 -- 172.21.15.110:0/146035305 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96c8022470 con 0x7f96d4103470 2024-04-26T11:29:34.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.830+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d41a0fe0 con 0x7f96d4103470 2024-04-26T11:29:34.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.830+0000 7f96d1600700 1 -- 172.21.15.110:0/146035305 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8017650 con 0x7f96d4103470 2024-04-26T11:29:34.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.830+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d41a88c0 con 0x7f96d4103470 2024-04-26T11:29:34.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.831+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d406a110 con 0x7f96d4103470 2024-04-26T11:29:34.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.833+0000 7f96d1600700 1 -- 172.21.15.110:0/146035305 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f96c802a070 con 0x7f96d4103470 2024-04-26T11:29:34.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.835+0000 7f96d1600700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96bc0a3c40 0x7f96bc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:34.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.835+0000 7f96d1600700 1 -- 172.21.15.110:0/146035305 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f96c80d10e0 con 0x7f96d4103470 2024-04-26T11:29:34.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.836+0000 7f96d3e00700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96bc0a3c40 0x7f96bc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:34.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.836+0000 7f96d3e00700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96bc0a3c40 0x7f96bc0a6100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f96d407ae80 tx=0x7f96c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:34.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:34.840+0000 7f96d1600700 1 -- 172.21.15.110:0/146035305 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f96c8013070 con 0x7f96d4103470 2024-04-26T11:29:35.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.076+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f96d402e490 con 0x7f96d4103470 2024-04-26T11:29:35.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.076+0000 7f96d1600700 1 -- 172.21.15.110:0/146035305 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f96c809dab0 con 0x7f96d4103470 2024-04-26T11:29:35.078 INFO:teuthology.orchestra.run.smithi110.stdout:146028888150 2024-04-26T11:29:35.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96bc0a3c40 msgr2=0x7f96bc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:35.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96bc0a3c40 0x7f96bc0a6100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f96d407ae80 tx=0x7f96c0009260 comp rx=0 tx=0).stop 2024-04-26T11:29:35.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96d4103470 msgr2=0x7f96d419bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:35.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96d4103470 0x7f96d419bd40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96c8000c00 tx=0x7f96c80057c0 comp rx=0 tx=0).stop 2024-04-26T11:29:35.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 shutdown_connections 2024-04-26T11:29:35.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f96bc0a3c40 0x7f96bc0a6100 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:35.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96d41094c0 0x7f96d41a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:35.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96d4103470 0x7f96d419bd40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:35.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 --2- 172.21.15.110:0/146035305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96d4103e30 0x7f96d419c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:35.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 >> 172.21.15.110:0/146035305 conn(0x7f96d407a580 msgr2=0x7f96d410e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:35.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 shutdown_connections 2024-04-26T11:29:35.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:35.079+0000 7f96db400700 1 -- 172.21.15.110:0/146035305 wait complete. 2024-04-26T11:29:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:35 smithi110 ceph-mon[28069]: pgmap v399: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:35 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/146035305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T11:29:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:35 smithi196 ceph-mon[32572]: pgmap v399: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:35 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/146035305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T11:29:36.011 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888144 got 146028888150 for osd.4 2024-04-26T11:29:36.011 DEBUG:teuthology.parallel:result is None 2024-04-26T11:29:36.012 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T11:29:36.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T11:29:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:35 smithi193 ceph-mon[32782]: pgmap v399: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:35 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/146035305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T11:29:36.466 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:37 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:37 smithi110 ceph-mon[28069]: pgmap v400: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:37 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:37 smithi193 ceph-mon[32782]: pgmap v400: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:37 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:37 smithi196 ceph-mon[32572]: pgmap v400: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:38.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:29:38.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:29:38.492 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:29:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:29:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:29:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:29:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:29:38.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.797+0000 7ffbea600700 1 -- 172.21.15.110:0/1741966767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe406c4c0 msgr2=0x7ffbe4110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:38.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.797+0000 7ffbea600700 1 --2- 172.21.15.110:0/1741966767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe406c4c0 0x7ffbe4110310 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00b0a0 tx=0x7ffbdc00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:29:38.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.797+0000 7ffbea600700 1 -- 172.21.15.110:0/1741966767 shutdown_connections 2024-04-26T11:29:38.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.797+0000 7ffbea600700 1 --2- 172.21.15.110:0/1741966767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe406c4c0 0x7ffbe4110310 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:38.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.797+0000 7ffbea600700 1 --2- 172.21.15.110:0/1741966767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffbe41094d0 0x7ffbe41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:38.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.797+0000 7ffbea600700 1 --2- 172.21.15.110:0/1741966767 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbe406bb20 0x7ffbe406bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:38.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.797+0000 7ffbea600700 1 -- 172.21.15.110:0/1741966767 >> 172.21.15.110:0/1741966767 conn(0x7ffbe4079360 msgr2=0x7ffbe4079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:38.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.797+0000 7ffbea600700 1 -- 172.21.15.110:0/1741966767 shutdown_connections 2024-04-26T11:29:38.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.797+0000 7ffbea600700 1 -- 172.21.15.110:0/1741966767 wait complete. 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.798+0000 7ffbea600700 1 Processor -- start 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbea600700 1 -- start start 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbea600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbe406bb20 0x7ffbe4102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbea600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe406c4c0 0x7ffbe4102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbea600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffbe41094d0 0x7ffbe4102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbea600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4113620 con 0x7ffbe406c4c0 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbea600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41134a0 con 0x7ffbe41094d0 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbea600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe41137a0 con 0x7ffbe406bb20 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbe3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbe406bb20 0x7ffbe4102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbe3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbe406bb20 0x7ffbe4102420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:52850/0 (socket says 172.21.15.110:52850) 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbe3400700 1 -- 172.21.15.110:0/1116897989 learned_addr learned my addr 172.21.15.110:0/1116897989 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:38.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.799+0000 7ffbe2a00700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe406c4c0 0x7ffbe4102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:38.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.800+0000 7ffbe3e00700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffbe41094d0 0x7ffbe4102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:38.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.800+0000 7ffbe3400700 1 -- 172.21.15.110:0/1116897989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffbe41094d0 msgr2=0x7ffbe4102ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:38.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.800+0000 7ffbe3400700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffbe41094d0 0x7ffbe4102ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:38.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.800+0000 7ffbe3400700 1 -- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe406c4c0 msgr2=0x7ffbe4102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:38.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.800+0000 7ffbe3400700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe406c4c0 0x7ffbe4102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:38.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.800+0000 7ffbe3400700 1 -- 172.21.15.110:0/1116897989 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe41a7ff0 con 0x7ffbe406bb20 2024-04-26T11:29:38.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.800+0000 7ffbe3400700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbe406bb20 0x7ffbe4102420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400e9a0 tx=0x7ffbd400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:38.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.800+0000 7ffbdbe00700 1 -- 172.21.15.110:0/1116897989 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd400cbd0 con 0x7ffbe406bb20 2024-04-26T11:29:38.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.801+0000 7ffbdbe00700 1 -- 172.21.15.110:0/1116897989 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbd400cd70 con 0x7ffbe406bb20 2024-04-26T11:29:38.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.801+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe41a82e0 con 0x7ffbe406bb20 2024-04-26T11:29:38.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.801+0000 7ffbdbe00700 1 -- 172.21.15.110:0/1116897989 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4018680 con 0x7ffbe406bb20 2024-04-26T11:29:38.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.801+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe41a8870 con 0x7ffbe406bb20 2024-04-26T11:29:38.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.802+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe4104b80 con 0x7ffbe406bb20 2024-04-26T11:29:38.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.804+0000 7ffbdbe00700 1 -- 172.21.15.110:0/1116897989 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ffbd4010430 con 0x7ffbe406bb20 2024-04-26T11:29:38.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.805+0000 7ffbdbe00700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffbc80a3cc0 0x7ffbc80a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:38.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.805+0000 7ffbdbe00700 1 -- 172.21.15.110:0/1116897989 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7ffbd40d0650 con 0x7ffbe406bb20 2024-04-26T11:29:38.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.806+0000 7ffbe2a00700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffbc80a3cc0 0x7ffbc80a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:38.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.806+0000 7ffbe2a00700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffbc80a3cc0 0x7ffbc80a6180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009680 tx=0x7ffbd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:38.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:38.808+0000 7ffbdbe00700 1 -- 172.21.15.110:0/1116897989 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffbd409cf30 con 0x7ffbe406bb20 2024-04-26T11:29:39.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.029+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbe4063860 con 0x7ffbc80a3cc0 2024-04-26T11:29:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.039+0000 7ffbdbe00700 1 -- 172.21.15.110:0/1116897989 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259086 (secure 0 0 0) 0x7ffbe4063860 con 0x7ffbc80a3cc0 2024-04-26T11:29:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffbc80a3cc0 msgr2=0x7ffbc80a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffbc80a3cc0 0x7ffbc80a6180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009680 tx=0x7ffbd0009260 comp rx=0 tx=0).stop 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbe406bb20 msgr2=0x7ffbe4102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbe406bb20 0x7ffbe4102420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400e9a0 tx=0x7ffbd400ecb0 comp rx=0 tx=0).stop 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 shutdown_connections 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffbe41094d0 0x7ffbe4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ffbc80a3cc0 0x7ffbc80a6180 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbe406bb20 0x7ffbe4102420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 --2- 172.21.15.110:0/1116897989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe406c4c0 0x7ffbe4102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.044+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 >> 172.21.15.110:0/1116897989 conn(0x7ffbe4079360 msgr2=0x7ffbe41003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.045+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 shutdown_connections 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:39.045+0000 7ffbea600700 1 -- 172.21.15.110:0/1116897989 wait complete. 2024-04-26T11:29:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-26T11:29:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:39 smithi110 ceph-mon[28069]: pgmap v401: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:39 smithi193 ceph-mon[32782]: pgmap v401: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:39.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:39 smithi196 ceph-mon[32572]: pgmap v401: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:39.910 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2024-04-26T11:29:38.530262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656743,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":863,"num_read_kb":564,"num_write":356,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1182052,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369940,"kb_used_data":12384,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571884,"statfs":{"total":1151940427776,"available":1151561609216,"internally_reserved":0,"allocated":12681216,"data_stored":7968429,"data_compressed":247521,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005608"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825610+0000","last_change":"2024-04-26T11:27:12.099635+0000","last_active":"2024-04-26T11:29:03.825610+0000","last_peered":"2024-04-26T11:29:03.825610+0000","last_clean":"2024-04-26T11:29:03.825610+0000","last_became_active":"2024-04-26T11:27:12.099342+0000","last_became_peered":"2024-04-26T11:27:12.099342+0000","last_unstale":"2024-04-26T11:29:03.825610+0000","last_undegraded":"2024-04-26T11:29:03.825610+0000","last_fullsized":"2024-04-26T11:29:03.825610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:36.433968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595866+0000","last_change":"2024-04-26T11:27:12.090804+0000","last_active":"2024-04-26T11:29:03.595866+0000","last_peered":"2024-04-26T11:29:03.595866+0000","last_clean":"2024-04-26T11:29:03.595866+0000","last_became_active":"2024-04-26T11:27:12.089662+0000","last_became_peered":"2024-04-26T11:27:12.089662+0000","last_unstale":"2024-04-26T11:29:03.595866+0000","last_undegraded":"2024-04-26T11:29:03.595866+0000","last_fullsized":"2024-04-26T11:29:03.595866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.776482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595842+0000","last_change":"2024-04-26T11:27:12.094739+0000","last_active":"2024-04-26T11:29:03.595842+0000","last_peered":"2024-04-26T11:29:03.595842+0000","last_clean":"2024-04-26T11:29:03.595842+0000","last_became_active":"2024-04-26T11:27:12.094410+0000","last_became_peered":"2024-04-26T11:27:12.094410+0000","last_unstale":"2024-04-26T11:29:03.595842+0000","last_undegraded":"2024-04-26T11:29:03.595842+0000","last_fullsized":"2024-04-26T11:29:03.595842+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:17.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602156+0000","last_change":"2024-04-26T11:28:03.446873+0000","last_active":"2024-04-26T11:29:03.602156+0000","last_peered":"2024-04-26T11:29:03.602156+0000","last_clean":"2024-04-26T11:29:03.602156+0000","last_became_active":"2024-04-26T11:28:03.445335+0000","last_became_peered":"2024-04-26T11:28:03.445335+0000","last_unstale":"2024-04-26T11:29:03.602156+0000","last_undegraded":"2024-04-26T11:29:03.602156+0000","last_fullsized":"2024-04-26T11:29:03.602156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:59.892678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592969+0000","last_change":"2024-04-26T11:27:12.114071+0000","last_active":"2024-04-26T11:29:03.592969+0000","last_peered":"2024-04-26T11:29:03.592969+0000","last_clean":"2024-04-26T11:29:03.592969+0000","last_became_active":"2024-04-26T11:27:12.113795+0000","last_became_peered":"2024-04-26T11:27:12.113795+0000","last_unstale":"2024-04-26T11:29:03.592969+0000","last_undegraded":"2024-04-26T11:29:03.592969+0000","last_fullsized":"2024-04-26T11:29:03.592969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:34.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.597486+0000","last_change":"2024-04-26T11:27:12.108449+0000","last_active":"2024-04-26T11:29:03.597486+0000","last_peered":"2024-04-26T11:29:03.597486+0000","last_clean":"2024-04-26T11:29:03.597486+0000","last_became_active":"2024-04-26T11:27:12.108071+0000","last_became_peered":"2024-04-26T11:27:12.108071+0000","last_unstale":"2024-04-26T11:29:03.597486+0000","last_undegraded":"2024-04-26T11:29:03.597486+0000","last_fullsized":"2024-04-26T11:29:03.597486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:04.001728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.603681+0000","last_change":"2024-04-26T11:29:03.603681+0000","last_active":"2024-04-26T11:29:03.603681+0000","last_peered":"2024-04-26T11:29:03.603681+0000","last_clean":"2024-04-26T11:29:03.603681+0000","last_became_active":"2024-04-26T11:29:03.603180+0000","last_became_peered":"2024-04-26T11:29:03.603180+0000","last_unstale":"2024-04-26T11:29:03.603681+0000","last_undegraded":"2024-04-26T11:29:03.603681+0000","last_fullsized":"2024-04-26T11:29:03.603681+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.811471+0000","last_change":"2024-04-26T11:27:12.111215+0000","last_active":"2024-04-26T11:29:03.811471+0000","last_peered":"2024-04-26T11:29:03.811471+0000","last_clean":"2024-04-26T11:29:03.811471+0000","last_became_active":"2024-04-26T11:27:12.110896+0000","last_became_peered":"2024-04-26T11:27:12.110896+0000","last_unstale":"2024-04-26T11:29:03.811471+0000","last_undegraded":"2024-04-26T11:29:03.811471+0000","last_fullsized":"2024-04-26T11:29:03.811471+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:17.469534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691639+0000","last_change":"2024-04-26T11:27:12.091871+0000","last_active":"2024-04-26T11:29:03.691639+0000","last_peered":"2024-04-26T11:29:03.691639+0000","last_clean":"2024-04-26T11:29:03.691639+0000","last_became_active":"2024-04-26T11:27:12.091239+0000","last_became_peered":"2024-04-26T11:27:12.091239+0000","last_unstale":"2024-04-26T11:29:03.691639+0000","last_undegraded":"2024-04-26T11:29:03.691639+0000","last_fullsized":"2024-04-26T11:29:03.691639+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:30.526152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.597808+0000","last_change":"2024-04-26T11:27:12.093411+0000","last_active":"2024-04-26T11:29:03.597808+0000","last_peered":"2024-04-26T11:29:03.597808+0000","last_clean":"2024-04-26T11:29:03.597808+0000","last_became_active":"2024-04-26T11:27:12.093086+0000","last_became_peered":"2024-04-26T11:27:12.093086+0000","last_unstale":"2024-04-26T11:29:03.597808+0000","last_undegraded":"2024-04-26T11:29:03.597808+0000","last_fullsized":"2024-04-26T11:29:03.597808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:56.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599969+0000","last_change":"2024-04-26T11:27:12.093317+0000","last_active":"2024-04-26T11:29:03.599969+0000","last_peered":"2024-04-26T11:29:03.599969+0000","last_clean":"2024-04-26T11:29:03.599969+0000","last_became_active":"2024-04-26T11:27:12.092595+0000","last_became_peered":"2024-04-26T11:27:12.092595+0000","last_unstale":"2024-04-26T11:29:03.599969+0000","last_undegraded":"2024-04-26T11:29:03.599969+0000","last_fullsized":"2024-04-26T11:29:03.599969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.702218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595591+0000","last_change":"2024-04-26T11:27:12.093118+0000","last_active":"2024-04-26T11:29:03.595591+0000","last_peered":"2024-04-26T11:29:03.595591+0000","last_clean":"2024-04-26T11:29:03.595591+0000","last_became_active":"2024-04-26T11:27:12.091482+0000","last_became_peered":"2024-04-26T11:27:12.091482+0000","last_unstale":"2024-04-26T11:29:03.595591+0000","last_undegraded":"2024-04-26T11:29:03.595591+0000","last_fullsized":"2024-04-26T11:29:03.595591+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.426213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.591967+0000","last_change":"2024-04-26T11:27:12.114213+0000","last_active":"2024-04-26T11:29:03.591967+0000","last_peered":"2024-04-26T11:29:03.591967+0000","last_clean":"2024-04-26T11:29:03.591967+0000","last_became_active":"2024-04-26T11:27:12.113867+0000","last_became_peered":"2024-04-26T11:27:12.113867+0000","last_unstale":"2024-04-26T11:29:03.591967+0000","last_undegraded":"2024-04-26T11:29:03.591967+0000","last_fullsized":"2024-04-26T11:29:03.591967+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:59.258645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595148+0000","last_change":"2024-04-26T11:27:12.084301+0000","last_active":"2024-04-26T11:29:03.595148+0000","last_peered":"2024-04-26T11:29:03.595148+0000","last_clean":"2024-04-26T11:29:03.595148+0000","last_became_active":"2024-04-26T11:27:12.083808+0000","last_became_peered":"2024-04-26T11:27:12.083808+0000","last_unstale":"2024-04-26T11:29:03.595148+0000","last_undegraded":"2024-04-26T11:29:03.595148+0000","last_fullsized":"2024-04-26T11:29:03.595148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:46.107583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594934+0000","last_change":"2024-04-26T11:27:12.089647+0000","last_active":"2024-04-26T11:29:03.594934+0000","last_peered":"2024-04-26T11:29:03.594934+0000","last_clean":"2024-04-26T11:29:03.594934+0000","last_became_active":"2024-04-26T11:27:12.088081+0000","last_became_peered":"2024-04-26T11:27:12.088081+0000","last_unstale":"2024-04-26T11:29:03.594934+0000","last_undegraded":"2024-04-26T11:29:03.594934+0000","last_fullsized":"2024-04-26T11:29:03.594934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:43.423430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691271+0000","last_change":"2024-04-26T11:27:12.098138+0000","last_active":"2024-04-26T11:29:03.691271+0000","last_peered":"2024-04-26T11:29:03.691271+0000","last_clean":"2024-04-26T11:29:03.691271+0000","last_became_active":"2024-04-26T11:27:12.097756+0000","last_became_peered":"2024-04-26T11:27:12.097756+0000","last_unstale":"2024-04-26T11:29:03.691271+0000","last_undegraded":"2024-04-26T11:29:03.691271+0000","last_fullsized":"2024-04-26T11:29:03.691271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:21.155370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825725+0000","last_change":"2024-04-26T11:27:12.099925+0000","last_active":"2024-04-26T11:29:03.825725+0000","last_peered":"2024-04-26T11:29:03.825725+0000","last_clean":"2024-04-26T11:29:03.825725+0000","last_became_active":"2024-04-26T11:27:12.099600+0000","last_became_peered":"2024-04-26T11:27:12.099600+0000","last_unstale":"2024-04-26T11:29:03.825725+0000","last_undegraded":"2024-04-26T11:29:03.825725+0000","last_fullsized":"2024-04-26T11:29:03.825725+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:23.704624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602219+0000","last_change":"2024-04-26T11:27:12.104697+0000","last_active":"2024-04-26T11:29:03.602219+0000","last_peered":"2024-04-26T11:29:03.602219+0000","last_clean":"2024-04-26T11:29:03.602219+0000","last_became_active":"2024-04-26T11:27:12.103963+0000","last_became_peered":"2024-04-26T11:27:12.103963+0000","last_unstale":"2024-04-26T11:29:03.602219+0000","last_undegraded":"2024-04-26T11:29:03.602219+0000","last_fullsized":"2024-04-26T11:29:03.602219+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:58.202895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.604555+0000","last_change":"2024-04-26T11:29:03.603898+0000","last_active":"2024-04-26T11:29:03.604555+0000","last_peered":"2024-04-26T11:29:03.604555+0000","last_clean":"2024-04-26T11:29:03.604555+0000","last_became_active":"2024-04-26T11:29:03.603488+0000","last_became_peered":"2024-04-26T11:29:03.603488+0000","last_unstale":"2024-04-26T11:29:03.604555+0000","last_undegraded":"2024-04-26T11:29:03.604555+0000","last_fullsized":"2024-04-26T11:29:03.604555+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:04.137277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602403+0000","last_change":"2024-04-26T11:28:03.456017+0000","last_active":"2024-04-26T11:29:03.602403+0000","last_peered":"2024-04-26T11:29:03.602403+0000","last_clean":"2024-04-26T11:29:03.602403+0000","last_became_active":"2024-04-26T11:28:03.447016+0000","last_became_peered":"2024-04-26T11:28:03.447016+0000","last_unstale":"2024-04-26T11:29:03.602403+0000","last_undegraded":"2024-04-26T11:29:03.602403+0000","last_fullsized":"2024-04-26T11:29:03.602403+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.616546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813392+0000","last_change":"2024-04-26T11:27:12.112635+0000","last_active":"2024-04-26T11:29:03.813392+0000","last_peered":"2024-04-26T11:29:03.813392+0000","last_clean":"2024-04-26T11:29:03.813392+0000","last_became_active":"2024-04-26T11:27:12.112282+0000","last_became_peered":"2024-04-26T11:27:12.112282+0000","last_unstale":"2024-04-26T11:29:03.813392+0000","last_undegraded":"2024-04-26T11:29:03.813392+0000","last_fullsized":"2024-04-26T11:29:03.813392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:21.482922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813721+0000","last_change":"2024-04-26T11:27:08.473301+0000","last_active":"2024-04-26T11:29:03.813721+0000","last_peered":"2024-04-26T11:29:03.813721+0000","last_clean":"2024-04-26T11:29:03.813721+0000","last_became_active":"2024-04-26T11:27:08.472769+0000","last_became_peered":"2024-04-26T11:27:08.472769+0000","last_unstale":"2024-04-26T11:29:03.813721+0000","last_undegraded":"2024-04-26T11:29:03.813721+0000","last_fullsized":"2024-04-26T11:29:03.813721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:49.108849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.596153+0000","last_change":"2024-04-26T11:27:12.109725+0000","last_active":"2024-04-26T11:29:03.596153+0000","last_peered":"2024-04-26T11:29:03.596153+0000","last_clean":"2024-04-26T11:29:03.596153+0000","last_became_active":"2024-04-26T11:27:12.109376+0000","last_became_peered":"2024-04-26T11:27:12.109376+0000","last_unstale":"2024-04-26T11:29:03.596153+0000","last_undegraded":"2024-04-26T11:29:03.596153+0000","last_fullsized":"2024-04-26T11:29:03.596153+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593500+0000","last_change":"2024-04-26T11:28:03.464520+0000","last_active":"2024-04-26T11:29:03.593500+0000","last_peered":"2024-04-26T11:29:03.593500+0000","last_clean":"2024-04-26T11:29:03.593500+0000","last_became_active":"2024-04-26T11:28:03.449993+0000","last_became_peered":"2024-04-26T11:28:03.449993+0000","last_unstale":"2024-04-26T11:29:03.593500+0000","last_undegraded":"2024-04-26T11:29:03.593500+0000","last_fullsized":"2024-04-26T11:29:03.593500+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:01.465563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691297+0000","last_change":"2024-04-26T11:27:12.100830+0000","last_active":"2024-04-26T11:29:03.691297+0000","last_peered":"2024-04-26T11:29:03.691297+0000","last_clean":"2024-04-26T11:29:03.691297+0000","last_became_active":"2024-04-26T11:27:12.100474+0000","last_became_peered":"2024-04-26T11:27:12.100474+0000","last_unstale":"2024-04-26T11:29:03.691297+0000","last_undegraded":"2024-04-26T11:29:03.691297+0000","last_fullsized":"2024-04-26T11:29:03.691297+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:18.778897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825114+0000","last_change":"2024-04-26T11:28:03.444580+0000","last_active":"2024-04-26T11:29:03.825114+0000","last_peered":"2024-04-26T11:29:03.825114+0000","last_clean":"2024-04-26T11:29:03.825114+0000","last_became_active":"2024-04-26T11:28:03.435056+0000","last_became_peered":"2024-04-26T11:28:03.435056+0000","last_unstale":"2024-04-26T11:29:03.825114+0000","last_undegraded":"2024-04-26T11:29:03.825114+0000","last_fullsized":"2024-04-26T11:29:03.825114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:42.640914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826358+0000","last_change":"2024-04-26T11:27:12.093472+0000","last_active":"2024-04-26T11:29:03.826358+0000","last_peered":"2024-04-26T11:29:03.826358+0000","last_clean":"2024-04-26T11:29:03.826358+0000","last_became_active":"2024-04-26T11:27:12.093110+0000","last_became_peered":"2024-04-26T11:27:12.093110+0000","last_unstale":"2024-04-26T11:29:03.826358+0000","last_undegraded":"2024-04-26T11:29:03.826358+0000","last_fullsized":"2024-04-26T11:29:03.826358+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:19.256670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":115,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:35.563133+0000","last_change":"2024-04-26T11:28:03.440961+0000","last_active":"2024-04-26T11:29:35.563133+0000","last_peered":"2024-04-26T11:29:35.563133+0000","last_clean":"2024-04-26T11:29:35.563133+0000","last_became_active":"2024-04-26T11:28:03.434607+0000","last_became_peered":"2024-04-26T11:28:03.434607+0000","last_unstale":"2024-04-26T11:29:35.563133+0000","last_undegraded":"2024-04-26T11:29:35.563133+0000","last_fullsized":"2024-04-26T11:29:35.563133+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:37.122557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592947+0000","last_change":"2024-04-26T11:28:03.447662+0000","last_active":"2024-04-26T11:29:03.592947+0000","last_peered":"2024-04-26T11:29:03.592947+0000","last_clean":"2024-04-26T11:29:03.592947+0000","last_became_active":"2024-04-26T11:28:03.447333+0000","last_became_peered":"2024-04-26T11:28:03.447333+0000","last_unstale":"2024-04-26T11:29:03.592947+0000","last_undegraded":"2024-04-26T11:29:03.592947+0000","last_fullsized":"2024-04-26T11:29:03.592947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:37.600940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.597355+0000","last_change":"2024-04-26T11:27:08.028424+0000","last_active":"2024-04-26T11:29:03.597355+0000","last_peered":"2024-04-26T11:29:03.597355+0000","last_clean":"2024-04-26T11:29:03.597355+0000","last_became_active":"2024-04-26T11:27:08.028134+0000","last_became_peered":"2024-04-26T11:27:08.028134+0000","last_unstale":"2024-04-26T11:29:03.597355+0000","last_undegraded":"2024-04-26T11:29:03.597355+0000","last_fullsized":"2024-04-26T11:29:03.597355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:44.636288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826237+0000","last_change":"2024-04-26T11:27:12.108078+0000","last_active":"2024-04-26T11:29:03.826237+0000","last_peered":"2024-04-26T11:29:03.826237+0000","last_clean":"2024-04-26T11:29:03.826237+0000","last_became_active":"2024-04-26T11:27:12.107713+0000","last_became_peered":"2024-04-26T11:27:12.107713+0000","last_unstale":"2024-04-26T11:29:03.826237+0000","last_undegraded":"2024-04-26T11:29:03.826237+0000","last_fullsized":"2024-04-26T11:29:03.826237+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:59.995679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.591930+0000","last_change":"2024-04-26T11:27:08.049134+0000","last_active":"2024-04-26T11:29:03.591930+0000","last_peered":"2024-04-26T11:29:03.591930+0000","last_clean":"2024-04-26T11:29:03.591930+0000","last_became_active":"2024-04-26T11:27:08.047862+0000","last_became_peered":"2024-04-26T11:27:08.047862+0000","last_unstale":"2024-04-26T11:29:03.591930+0000","last_undegraded":"2024-04-26T11:29:03.591930+0000","last_fullsized":"2024-04-26T11:29:03.591930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:55.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.811773+0000","last_change":"2024-04-26T11:27:12.117417+0000","last_active":"2024-04-26T11:29:03.811773+0000","last_peered":"2024-04-26T11:29:03.811773+0000","last_clean":"2024-04-26T11:29:03.811773+0000","last_became_active":"2024-04-26T11:27:12.116643+0000","last_became_peered":"2024-04-26T11:27:12.116643+0000","last_unstale":"2024-04-26T11:29:03.811773+0000","last_undegraded":"2024-04-26T11:29:03.811773+0000","last_fullsized":"2024-04-26T11:29:03.811773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:26.677738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825873+0000","last_change":"2024-04-26T11:27:08.037806+0000","last_active":"2024-04-26T11:29:03.825873+0000","last_peered":"2024-04-26T11:29:03.825873+0000","last_clean":"2024-04-26T11:29:03.825873+0000","last_became_active":"2024-04-26T11:27:08.037309+0000","last_became_peered":"2024-04-26T11:27:08.037309+0000","last_unstale":"2024-04-26T11:29:03.825873+0000","last_undegraded":"2024-04-26T11:29:03.825873+0000","last_fullsized":"2024-04-26T11:29:03.825873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.910219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.601962+0000","last_change":"2024-04-26T11:27:12.120986+0000","last_active":"2024-04-26T11:29:03.601962+0000","last_peered":"2024-04-26T11:29:03.601962+0000","last_clean":"2024-04-26T11:29:03.601962+0000","last_became_active":"2024-04-26T11:27:12.120580+0000","last_became_peered":"2024-04-26T11:27:12.120580+0000","last_unstale":"2024-04-26T11:29:03.601962+0000","last_undegraded":"2024-04-26T11:29:03.601962+0000","last_fullsized":"2024-04-26T11:29:03.601962+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:00.996039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":155,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:36.563956+0000","last_change":"2024-04-26T11:27:08.048979+0000","last_active":"2024-04-26T11:29:36.563956+0000","last_peered":"2024-04-26T11:29:36.563956+0000","last_clean":"2024-04-26T11:29:36.563956+0000","last_became_active":"2024-04-26T11:27:08.048641+0000","last_became_peered":"2024-04-26T11:27:08.048641+0000","last_unstale":"2024-04-26T11:29:36.563956+0000","last_undegraded":"2024-04-26T11:29:36.563956+0000","last_fullsized":"2024-04-26T11:29:36.563956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:38.917651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691621+0000","last_change":"2024-04-26T11:27:12.104749+0000","last_active":"2024-04-26T11:29:03.691621+0000","last_peered":"2024-04-26T11:29:03.691621+0000","last_clean":"2024-04-26T11:29:03.691621+0000","last_became_active":"2024-04-26T11:27:12.104358+0000","last_became_peered":"2024-04-26T11:27:12.104358+0000","last_unstale":"2024-04-26T11:29:03.691621+0000","last_undegraded":"2024-04-26T11:29:03.691621+0000","last_fullsized":"2024-04-26T11:29:03.691621+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:47.364512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599982+0000","last_change":"2024-04-26T11:27:08.038165+0000","last_active":"2024-04-26T11:29:03.599982+0000","last_peered":"2024-04-26T11:29:03.599982+0000","last_clean":"2024-04-26T11:29:03.599982+0000","last_became_active":"2024-04-26T11:27:08.036930+0000","last_became_peered":"2024-04-26T11:27:08.036930+0000","last_unstale":"2024-04-26T11:29:03.599982+0000","last_undegraded":"2024-04-26T11:29:03.599982+0000","last_fullsized":"2024-04-26T11:29:03.599982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:10.050679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.596156+0000","last_change":"2024-04-26T11:27:12.098702+0000","last_active":"2024-04-26T11:29:03.596156+0000","last_peered":"2024-04-26T11:29:03.596156+0000","last_clean":"2024-04-26T11:29:03.596156+0000","last_became_active":"2024-04-26T11:27:12.089241+0000","last_became_peered":"2024-04-26T11:27:12.089241+0000","last_unstale":"2024-04-26T11:29:03.596156+0000","last_undegraded":"2024-04-26T11:29:03.596156+0000","last_fullsized":"2024-04-26T11:29:03.596156+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.013054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826455+0000","last_change":"2024-04-26T11:27:08.473759+0000","last_active":"2024-04-26T11:29:03.826455+0000","last_peered":"2024-04-26T11:29:03.826455+0000","last_clean":"2024-04-26T11:29:03.826455+0000","last_became_active":"2024-04-26T11:27:08.473288+0000","last_became_peered":"2024-04-26T11:27:08.473288+0000","last_unstale":"2024-04-26T11:29:03.826455+0000","last_undegraded":"2024-04-26T11:29:03.826455+0000","last_fullsized":"2024-04-26T11:29:03.826455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:36.727119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691543+0000","last_change":"2024-04-26T11:27:12.096935+0000","last_active":"2024-04-26T11:29:03.691543+0000","last_peered":"2024-04-26T11:29:03.691543+0000","last_clean":"2024-04-26T11:29:03.691543+0000","last_became_active":"2024-04-26T11:27:12.096481+0000","last_became_peered":"2024-04-26T11:27:12.096481+0000","last_unstale":"2024-04-26T11:29:03.691543+0000","last_undegraded":"2024-04-26T11:29:03.691543+0000","last_fullsized":"2024-04-26T11:29:03.691543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:58.855909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":316,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:36.563925+0000","last_change":"2024-04-26T11:27:08.037227+0000","last_active":"2024-04-26T11:29:36.563925+0000","last_peered":"2024-04-26T11:29:36.563925+0000","last_clean":"2024-04-26T11:29:36.563925+0000","last_became_active":"2024-04-26T11:27:08.036852+0000","last_became_peered":"2024-04-26T11:27:08.036852+0000","last_unstale":"2024-04-26T11:29:36.563925+0000","last_undegraded":"2024-04-26T11:29:36.563925+0000","last_fullsized":"2024-04-26T11:29:36.563925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:44.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61999,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":252,"num_read_kb":186,"num_write":34,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593333+0000","last_change":"2024-04-26T11:27:12.088586+0000","last_active":"2024-04-26T11:29:03.593333+0000","last_peered":"2024-04-26T11:29:03.593333+0000","last_clean":"2024-04-26T11:29:03.593333+0000","last_became_active":"2024-04-26T11:27:12.088264+0000","last_became_peered":"2024-04-26T11:27:12.088264+0000","last_unstale":"2024-04-26T11:29:03.593333+0000","last_undegraded":"2024-04-26T11:29:03.593333+0000","last_fullsized":"2024-04-26T11:29:03.593333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:39.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594570+0000","last_change":"2024-04-26T11:27:08.049289+0000","last_active":"2024-04-26T11:29:03.594570+0000","last_peered":"2024-04-26T11:29:03.594570+0000","last_clean":"2024-04-26T11:29:03.594570+0000","last_became_active":"2024-04-26T11:27:08.048923+0000","last_became_peered":"2024-04-26T11:27:08.048923+0000","last_unstale":"2024-04-26T11:29:03.594570+0000","last_undegraded":"2024-04-26T11:29:03.594570+0000","last_fullsized":"2024-04-26T11:29:03.594570+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:42.229383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.591953+0000","last_change":"2024-04-26T11:27:12.118154+0000","last_active":"2024-04-26T11:29:03.591953+0000","last_peered":"2024-04-26T11:29:03.591953+0000","last_clean":"2024-04-26T11:29:03.591953+0000","last_became_active":"2024-04-26T11:27:12.117624+0000","last_became_peered":"2024-04-26T11:27:12.117624+0000","last_unstale":"2024-04-26T11:29:03.591953+0000","last_undegraded":"2024-04-26T11:29:03.591953+0000","last_fullsized":"2024-04-26T11:29:03.591953+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:57.947310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826180+0000","last_change":"2024-04-26T11:27:08.045870+0000","last_active":"2024-04-26T11:29:03.826180+0000","last_peered":"2024-04-26T11:29:03.826180+0000","last_clean":"2024-04-26T11:29:03.826180+0000","last_became_active":"2024-04-26T11:27:08.045461+0000","last_became_peered":"2024-04-26T11:27:08.045461+0000","last_unstale":"2024-04-26T11:29:03.826180+0000","last_undegraded":"2024-04-26T11:29:03.826180+0000","last_fullsized":"2024-04-26T11:29:03.826180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:59.899805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599750+0000","last_change":"2024-04-26T11:27:12.116617+0000","last_active":"2024-04-26T11:29:03.599750+0000","last_peered":"2024-04-26T11:29:03.599750+0000","last_clean":"2024-04-26T11:29:03.599750+0000","last_became_active":"2024-04-26T11:27:12.115731+0000","last_became_peered":"2024-04-26T11:27:12.115731+0000","last_unstale":"2024-04-26T11:29:03.599750+0000","last_undegraded":"2024-04-26T11:29:03.599750+0000","last_fullsized":"2024-04-26T11:29:03.599750+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:42.680367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":162,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:35.888299+0000","last_change":"2024-04-26T11:27:08.036947+0000","last_active":"2024-04-26T11:29:35.888299+0000","last_peered":"2024-04-26T11:29:35.888299+0000","last_clean":"2024-04-26T11:29:35.888299+0000","last_became_active":"2024-04-26T11:27:08.036596+0000","last_became_peered":"2024-04-26T11:27:08.036596+0000","last_unstale":"2024-04-26T11:29:35.888299+0000","last_undegraded":"2024-04-26T11:29:35.888299+0000","last_fullsized":"2024-04-26T11:29:35.888299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:35.606069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599404+0000","last_change":"2024-04-26T11:27:12.086190+0000","last_active":"2024-04-26T11:29:03.599404+0000","last_peered":"2024-04-26T11:29:03.599404+0000","last_clean":"2024-04-26T11:29:03.599404+0000","last_became_active":"2024-04-26T11:27:12.085839+0000","last_became_peered":"2024-04-26T11:27:12.085839+0000","last_unstale":"2024-04-26T11:29:03.599404+0000","last_undegraded":"2024-04-26T11:29:03.599404+0000","last_fullsized":"2024-04-26T11:29:03.599404+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:31.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":71,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592909+0000","last_change":"2024-04-26T11:28:03.459792+0000","last_active":"2024-04-26T11:29:03.592909+0000","last_peered":"2024-04-26T11:29:03.592909+0000","last_clean":"2024-04-26T11:29:03.592909+0000","last_became_active":"2024-04-26T11:28:03.444101+0000","last_became_peered":"2024-04-26T11:28:03.444101+0000","last_unstale":"2024-04-26T11:29:03.592909+0000","last_undegraded":"2024-04-26T11:29:03.592909+0000","last_fullsized":"2024-04-26T11:29:03.592909+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:14.498792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826071+0000","last_change":"2024-04-26T11:27:12.093884+0000","last_active":"2024-04-26T11:29:03.826071+0000","last_peered":"2024-04-26T11:29:03.826071+0000","last_clean":"2024-04-26T11:29:03.826071+0000","last_became_active":"2024-04-26T11:27:12.093573+0000","last_became_peered":"2024-04-26T11:27:12.093573+0000","last_unstale":"2024-04-26T11:29:03.826071+0000","last_undegraded":"2024-04-26T11:29:03.826071+0000","last_fullsized":"2024-04-26T11:29:03.826071+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:32.144889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593686+0000","last_change":"2024-04-26T11:27:08.035089+0000","last_active":"2024-04-26T11:29:03.593686+0000","last_peered":"2024-04-26T11:29:03.593686+0000","last_clean":"2024-04-26T11:29:03.593686+0000","last_became_active":"2024-04-26T11:27:08.034698+0000","last_became_peered":"2024-04-26T11:27:08.034698+0000","last_unstale":"2024-04-26T11:29:03.593686+0000","last_undegraded":"2024-04-26T11:29:03.593686+0000","last_fullsized":"2024-04-26T11:29:03.593686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:23.731307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825493+0000","last_change":"2024-04-26T11:27:12.097089+0000","last_active":"2024-04-26T11:29:03.825493+0000","last_peered":"2024-04-26T11:29:03.825493+0000","last_clean":"2024-04-26T11:29:03.825493+0000","last_became_active":"2024-04-26T11:27:12.096762+0000","last_became_peered":"2024-04-26T11:27:12.096762+0000","last_unstale":"2024-04-26T11:29:03.825493+0000","last_undegraded":"2024-04-26T11:29:03.825493+0000","last_fullsized":"2024-04-26T11:29:03.825493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.366450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602239+0000","last_change":"2024-04-26T11:27:08.475317+0000","last_active":"2024-04-26T11:29:03.602239+0000","last_peered":"2024-04-26T11:29:03.602239+0000","last_clean":"2024-04-26T11:29:03.602239+0000","last_became_active":"2024-04-26T11:27:08.474464+0000","last_became_peered":"2024-04-26T11:27:08.474464+0000","last_unstale":"2024-04-26T11:29:03.602239+0000","last_undegraded":"2024-04-26T11:29:03.602239+0000","last_fullsized":"2024-04-26T11:29:03.602239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.597271+0000","last_change":"2024-04-26T11:27:12.107542+0000","last_active":"2024-04-26T11:29:03.597271+0000","last_peered":"2024-04-26T11:29:03.597271+0000","last_clean":"2024-04-26T11:29:03.597271+0000","last_became_active":"2024-04-26T11:27:12.107162+0000","last_became_peered":"2024-04-26T11:27:12.107162+0000","last_unstale":"2024-04-26T11:29:03.597271+0000","last_undegraded":"2024-04-26T11:29:03.597271+0000","last_fullsized":"2024-04-26T11:29:03.597271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:55.470638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599798+0000","last_change":"2024-04-26T11:27:08.044101+0000","last_active":"2024-04-26T11:29:03.599798+0000","last_peered":"2024-04-26T11:29:03.599798+0000","last_clean":"2024-04-26T11:29:03.599798+0000","last_became_active":"2024-04-26T11:27:08.043733+0000","last_became_peered":"2024-04-26T11:27:08.043733+0000","last_unstale":"2024-04-26T11:29:03.599798+0000","last_undegraded":"2024-04-26T11:29:03.599798+0000","last_fullsized":"2024-04-26T11:29:03.599798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:03.023620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.604461+0000","last_change":"2024-04-26T11:29:03.604007+0000","last_active":"2024-04-26T11:29:03.604461+0000","last_peered":"2024-04-26T11:29:03.604461+0000","last_clean":"2024-04-26T11:29:03.604461+0000","last_became_active":"2024-04-26T11:29:03.603521+0000","last_became_peered":"2024-04-26T11:29:03.603521+0000","last_unstale":"2024-04-26T11:29:03.604461+0000","last_undegraded":"2024-04-26T11:29:03.604461+0000","last_fullsized":"2024-04-26T11:29:03.604461+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:05.733257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826215+0000","last_change":"2024-04-26T11:27:12.093505+0000","last_active":"2024-04-26T11:29:03.826215+0000","last_peered":"2024-04-26T11:29:03.826215+0000","last_clean":"2024-04-26T11:29:03.826215+0000","last_became_active":"2024-04-26T11:27:12.093198+0000","last_became_peered":"2024-04-26T11:27:12.093198+0000","last_unstale":"2024-04-26T11:29:03.826215+0000","last_undegraded":"2024-04-26T11:29:03.826215+0000","last_fullsized":"2024-04-26T11:29:03.826215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:06.100747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":156,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:33.883680+0000","last_change":"2024-04-26T11:27:08.474897+0000","last_active":"2024-04-26T11:29:33.883680+0000","last_peered":"2024-04-26T11:29:33.883680+0000","last_clean":"2024-04-26T11:29:33.883680+0000","last_became_active":"2024-04-26T11:27:08.471735+0000","last_became_peered":"2024-04-26T11:27:08.471735+0000","last_unstale":"2024-04-26T11:29:33.883680+0000","last_undegraded":"2024-04-26T11:29:33.883680+0000","last_fullsized":"2024-04-26T11:29:33.883680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:42.066821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.812553+0000","last_change":"2024-04-26T11:27:12.116722+0000","last_active":"2024-04-26T11:29:03.812553+0000","last_peered":"2024-04-26T11:29:03.812553+0000","last_clean":"2024-04-26T11:29:03.812553+0000","last_became_active":"2024-04-26T11:27:12.116239+0000","last_became_peered":"2024-04-26T11:27:12.116239+0000","last_unstale":"2024-04-26T11:29:03.812553+0000","last_undegraded":"2024-04-26T11:29:03.812553+0000","last_fullsized":"2024-04-26T11:29:03.812553+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:04.962376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595561+0000","last_change":"2024-04-26T11:27:08.047087+0000","last_active":"2024-04-26T11:29:03.595561+0000","last_peered":"2024-04-26T11:29:03.595561+0000","last_clean":"2024-04-26T11:29:03.595561+0000","last_became_active":"2024-04-26T11:27:08.046754+0000","last_became_peered":"2024-04-26T11:27:08.046754+0000","last_unstale":"2024-04-26T11:29:03.595561+0000","last_undegraded":"2024-04-26T11:29:03.595561+0000","last_fullsized":"2024-04-26T11:29:03.595561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:30.481521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":365,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599448+0000","last_change":"2024-04-26T11:25:35.622816+0000","last_active":"2024-04-26T11:29:03.599448+0000","last_peered":"2024-04-26T11:29:03.599448+0000","last_clean":"2024-04-26T11:29:03.599448+0000","last_became_active":"2024-04-26T11:25:35.622329+0000","last_became_peered":"2024-04-26T11:25:35.622329+0000","last_unstale":"2024-04-26T11:29:03.599448+0000","last_undegraded":"2024-04-26T11:29:03.599448+0000","last_fullsized":"2024-04-26T11:29:03.599448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_clean_scrub_stamp":"2024-04-26T11:21:45.465157+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:40.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.591828+0000","last_change":"2024-04-26T11:27:12.098686+0000","last_active":"2024-04-26T11:29:03.591828+0000","last_peered":"2024-04-26T11:29:03.591828+0000","last_clean":"2024-04-26T11:29:03.591828+0000","last_became_active":"2024-04-26T11:27:12.098251+0000","last_became_peered":"2024-04-26T11:27:12.098251+0000","last_unstale":"2024-04-26T11:29:03.591828+0000","last_undegraded":"2024-04-26T11:29:03.591828+0000","last_fullsized":"2024-04-26T11:29:03.591828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:34.433203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599619+0000","last_change":"2024-04-26T11:27:08.036391+0000","last_active":"2024-04-26T11:29:03.599619+0000","last_peered":"2024-04-26T11:29:03.599619+0000","last_clean":"2024-04-26T11:29:03.599619+0000","last_became_active":"2024-04-26T11:27:08.036058+0000","last_became_peered":"2024-04-26T11:27:08.036058+0000","last_unstale":"2024-04-26T11:29:03.599619+0000","last_undegraded":"2024-04-26T11:29:03.599619+0000","last_fullsized":"2024-04-26T11:29:03.599619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:35.646501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593439+0000","last_change":"2024-04-26T11:27:08.472171+0000","last_active":"2024-04-26T11:29:03.593439+0000","last_peered":"2024-04-26T11:29:03.593439+0000","last_clean":"2024-04-26T11:29:03.593439+0000","last_became_active":"2024-04-26T11:27:08.471707+0000","last_became_peered":"2024-04-26T11:27:08.471707+0000","last_unstale":"2024-04-26T11:29:03.593439+0000","last_undegraded":"2024-04-26T11:29:03.593439+0000","last_fullsized":"2024-04-26T11:29:03.593439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:54.319448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592168+0000","last_change":"2024-04-26T11:27:12.110757+0000","last_active":"2024-04-26T11:29:03.592168+0000","last_peered":"2024-04-26T11:29:03.592168+0000","last_clean":"2024-04-26T11:29:03.592168+0000","last_became_active":"2024-04-26T11:27:12.109048+0000","last_became_peered":"2024-04-26T11:27:12.109048+0000","last_unstale":"2024-04-26T11:29:03.592168+0000","last_undegraded":"2024-04-26T11:29:03.592168+0000","last_fullsized":"2024-04-26T11:29:03.592168+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:05.203504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602337+0000","last_change":"2024-04-26T11:27:08.051790+0000","last_active":"2024-04-26T11:29:03.602337+0000","last_peered":"2024-04-26T11:29:03.602337+0000","last_clean":"2024-04-26T11:29:03.602337+0000","last_became_active":"2024-04-26T11:27:08.051430+0000","last_became_peered":"2024-04-26T11:27:08.051430+0000","last_unstale":"2024-04-26T11:29:03.602337+0000","last_undegraded":"2024-04-26T11:29:03.602337+0000","last_fullsized":"2024-04-26T11:29:03.602337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:13.607944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813969+0000","last_change":"2024-04-26T11:27:12.116704+0000","last_active":"2024-04-26T11:29:03.813969+0000","last_peered":"2024-04-26T11:29:03.813969+0000","last_clean":"2024-04-26T11:29:03.813969+0000","last_became_active":"2024-04-26T11:27:12.111556+0000","last_became_peered":"2024-04-26T11:27:12.111556+0000","last_unstale":"2024-04-26T11:29:03.813969+0000","last_undegraded":"2024-04-26T11:29:03.813969+0000","last_fullsized":"2024-04-26T11:29:03.813969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:36.535244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595793+0000","last_change":"2024-04-26T11:27:08.347851+0000","last_active":"2024-04-26T11:29:03.595793+0000","last_peered":"2024-04-26T11:29:03.595793+0000","last_clean":"2024-04-26T11:29:03.595793+0000","last_became_active":"2024-04-26T11:27:08.347460+0000","last_became_peered":"2024-04-26T11:27:08.347460+0000","last_unstale":"2024-04-26T11:29:03.595793+0000","last_undegraded":"2024-04-26T11:29:03.595793+0000","last_fullsized":"2024-04-26T11:29:03.595793+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.017834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599288+0000","last_change":"2024-04-26T11:29:03.598719+0000","last_active":"2024-04-26T11:29:03.599288+0000","last_peered":"2024-04-26T11:29:03.599288+0000","last_clean":"2024-04-26T11:29:03.599288+0000","last_became_active":"2024-04-26T11:29:03.598192+0000","last_became_peered":"2024-04-26T11:29:03.598192+0000","last_unstale":"2024-04-26T11:29:03.599288+0000","last_undegraded":"2024-04-26T11:29:03.599288+0000","last_fullsized":"2024-04-26T11:29:03.599288+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:57.809995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691253+0000","last_change":"2024-04-26T11:27:08.472127+0000","last_active":"2024-04-26T11:29:03.691253+0000","last_peered":"2024-04-26T11:29:03.691253+0000","last_clean":"2024-04-26T11:29:03.691253+0000","last_became_active":"2024-04-26T11:27:08.471709+0000","last_became_peered":"2024-04-26T11:27:08.471709+0000","last_unstale":"2024-04-26T11:29:03.691253+0000","last_undegraded":"2024-04-26T11:29:03.691253+0000","last_fullsized":"2024-04-26T11:29:03.691253+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:28.432710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592926+0000","last_change":"2024-04-26T11:27:12.085756+0000","last_active":"2024-04-26T11:29:03.592926+0000","last_peered":"2024-04-26T11:29:03.592926+0000","last_clean":"2024-04-26T11:29:03.592926+0000","last_became_active":"2024-04-26T11:27:12.085397+0000","last_became_peered":"2024-04-26T11:27:12.085397+0000","last_unstale":"2024-04-26T11:29:03.592926+0000","last_undegraded":"2024-04-26T11:29:03.592926+0000","last_fullsized":"2024-04-26T11:29:03.592926+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:41.392010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813197+0000","last_change":"2024-04-26T11:27:08.054831+0000","last_active":"2024-04-26T11:29:03.813197+0000","last_peered":"2024-04-26T11:29:03.813197+0000","last_clean":"2024-04-26T11:29:03.813197+0000","last_became_active":"2024-04-26T11:27:08.054352+0000","last_became_peered":"2024-04-26T11:27:08.054352+0000","last_unstale":"2024-04-26T11:29:03.813197+0000","last_undegraded":"2024-04-26T11:29:03.813197+0000","last_fullsized":"2024-04-26T11:29:03.813197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:53.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825573+0000","last_change":"2024-04-26T11:27:12.095789+0000","last_active":"2024-04-26T11:29:03.825573+0000","last_peered":"2024-04-26T11:29:03.825573+0000","last_clean":"2024-04-26T11:29:03.825573+0000","last_became_active":"2024-04-26T11:27:12.095468+0000","last_became_peered":"2024-04-26T11:27:12.095468+0000","last_unstale":"2024-04-26T11:29:03.825573+0000","last_undegraded":"2024-04-26T11:29:03.825573+0000","last_fullsized":"2024-04-26T11:29:03.825573+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:27.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594349+0000","last_change":"2024-04-26T11:27:08.044923+0000","last_active":"2024-04-26T11:29:03.594349+0000","last_peered":"2024-04-26T11:29:03.594349+0000","last_clean":"2024-04-26T11:29:03.594349+0000","last_became_active":"2024-04-26T11:27:08.044516+0000","last_became_peered":"2024-04-26T11:27:08.044516+0000","last_unstale":"2024-04-26T11:29:03.594349+0000","last_undegraded":"2024-04-26T11:29:03.594349+0000","last_fullsized":"2024-04-26T11:29:03.594349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:21.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.812313+0000","last_change":"2024-04-26T11:27:12.114311+0000","last_active":"2024-04-26T11:29:03.812313+0000","last_peered":"2024-04-26T11:29:03.812313+0000","last_clean":"2024-04-26T11:29:03.812313+0000","last_became_active":"2024-04-26T11:27:12.113538+0000","last_became_peered":"2024-04-26T11:27:12.113538+0000","last_unstale":"2024-04-26T11:29:03.812313+0000","last_undegraded":"2024-04-26T11:29:03.812313+0000","last_fullsized":"2024-04-26T11:29:03.812313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:55.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593062+0000","last_change":"2024-04-26T11:27:08.036983+0000","last_active":"2024-04-26T11:29:03.593062+0000","last_peered":"2024-04-26T11:29:03.593062+0000","last_clean":"2024-04-26T11:29:03.593062+0000","last_became_active":"2024-04-26T11:27:08.036632+0000","last_became_peered":"2024-04-26T11:27:08.036632+0000","last_unstale":"2024-04-26T11:29:03.593062+0000","last_undegraded":"2024-04-26T11:29:03.593062+0000","last_fullsized":"2024-04-26T11:29:03.593062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:31.731466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599774+0000","last_change":"2024-04-26T11:27:12.102922+0000","last_active":"2024-04-26T11:29:03.599774+0000","last_peered":"2024-04-26T11:29:03.599774+0000","last_clean":"2024-04-26T11:29:03.599774+0000","last_became_active":"2024-04-26T11:27:12.102594+0000","last_became_peered":"2024-04-26T11:27:12.102594+0000","last_unstale":"2024-04-26T11:29:03.599774+0000","last_undegraded":"2024-04-26T11:29:03.599774+0000","last_fullsized":"2024-04-26T11:29:03.599774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:47.223435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594621+0000","last_change":"2024-04-26T11:27:08.473262+0000","last_active":"2024-04-26T11:29:03.594621+0000","last_peered":"2024-04-26T11:29:03.594621+0000","last_clean":"2024-04-26T11:29:03.594621+0000","last_became_active":"2024-04-26T11:27:08.472744+0000","last_became_peered":"2024-04-26T11:27:08.472744+0000","last_unstale":"2024-04-26T11:29:03.594621+0000","last_undegraded":"2024-04-26T11:29:03.594621+0000","last_fullsized":"2024-04-26T11:29:03.594621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:16.766438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.600075+0000","last_change":"2024-04-26T11:27:12.091754+0000","last_active":"2024-04-26T11:29:03.600075+0000","last_peered":"2024-04-26T11:29:03.600075+0000","last_clean":"2024-04-26T11:29:03.600075+0000","last_became_active":"2024-04-26T11:27:12.091282+0000","last_became_peered":"2024-04-26T11:27:12.091282+0000","last_unstale":"2024-04-26T11:29:03.600075+0000","last_undegraded":"2024-04-26T11:29:03.600075+0000","last_fullsized":"2024-04-26T11:29:03.600075+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:07.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826328+0000","last_change":"2024-04-26T11:27:08.048352+0000","last_active":"2024-04-26T11:29:03.826328+0000","last_peered":"2024-04-26T11:29:03.826328+0000","last_clean":"2024-04-26T11:29:03.826328+0000","last_became_active":"2024-04-26T11:27:08.048056+0000","last_became_peered":"2024-04-26T11:27:08.048056+0000","last_unstale":"2024-04-26T11:29:03.826328+0000","last_undegraded":"2024-04-26T11:29:03.826328+0000","last_fullsized":"2024-04-26T11:29:03.826328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:35.363779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599918+0000","last_change":"2024-04-26T11:27:12.108244+0000","last_active":"2024-04-26T11:29:03.599918+0000","last_peered":"2024-04-26T11:29:03.599918+0000","last_clean":"2024-04-26T11:29:03.599918+0000","last_became_active":"2024-04-26T11:27:12.107592+0000","last_became_peered":"2024-04-26T11:27:12.107592+0000","last_unstale":"2024-04-26T11:29:03.599918+0000","last_undegraded":"2024-04-26T11:29:03.599918+0000","last_fullsized":"2024-04-26T11:29:03.599918+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:55.985873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592097+0000","last_change":"2024-04-26T11:28:03.462136+0000","last_active":"2024-04-26T11:29:03.592097+0000","last_peered":"2024-04-26T11:29:03.592097+0000","last_clean":"2024-04-26T11:29:03.592097+0000","last_became_active":"2024-04-26T11:28:03.449130+0000","last_became_peered":"2024-04-26T11:28:03.449130+0000","last_unstale":"2024-04-26T11:29:03.592097+0000","last_undegraded":"2024-04-26T11:29:03.592097+0000","last_fullsized":"2024-04-26T11:29:03.592097+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:33.181328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.600102+0000","last_change":"2024-04-26T11:27:12.090627+0000","last_active":"2024-04-26T11:29:03.600102+0000","last_peered":"2024-04-26T11:29:03.600102+0000","last_clean":"2024-04-26T11:29:03.600102+0000","last_became_active":"2024-04-26T11:27:12.089981+0000","last_became_peered":"2024-04-26T11:27:12.089981+0000","last_unstale":"2024-04-26T11:29:03.600102+0000","last_undegraded":"2024-04-26T11:29:03.600102+0000","last_fullsized":"2024-04-26T11:29:03.600102+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825720+0000","last_change":"2024-04-26T11:27:12.089335+0000","last_active":"2024-04-26T11:29:03.825720+0000","last_peered":"2024-04-26T11:29:03.825720+0000","last_clean":"2024-04-26T11:29:03.825720+0000","last_became_active":"2024-04-26T11:27:12.089019+0000","last_became_peered":"2024-04-26T11:27:12.089019+0000","last_unstale":"2024-04-26T11:29:03.825720+0000","last_undegraded":"2024-04-26T11:29:03.825720+0000","last_fullsized":"2024-04-26T11:29:03.825720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:18.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594235+0000","last_change":"2024-04-26T11:28:03.435483+0000","last_active":"2024-04-26T11:29:03.594235+0000","last_peered":"2024-04-26T11:29:03.594235+0000","last_clean":"2024-04-26T11:29:03.594235+0000","last_became_active":"2024-04-26T11:28:03.435088+0000","last_became_peered":"2024-04-26T11:28:03.435088+0000","last_unstale":"2024-04-26T11:29:03.594235+0000","last_undegraded":"2024-04-26T11:29:03.594235+0000","last_fullsized":"2024-04-26T11:29:03.594235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.453906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594434+0000","last_change":"2024-04-26T11:27:12.112344+0000","last_active":"2024-04-26T11:29:03.594434+0000","last_peered":"2024-04-26T11:29:03.594434+0000","last_clean":"2024-04-26T11:29:03.594434+0000","last_became_active":"2024-04-26T11:27:12.112083+0000","last_became_peered":"2024-04-26T11:27:12.112083+0000","last_unstale":"2024-04-26T11:29:03.594434+0000","last_undegraded":"2024-04-26T11:29:03.594434+0000","last_fullsized":"2024-04-26T11:29:03.594434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595886+0000","last_change":"2024-04-26T11:27:12.115707+0000","last_active":"2024-04-26T11:29:03.595886+0000","last_peered":"2024-04-26T11:29:03.595886+0000","last_clean":"2024-04-26T11:29:03.595886+0000","last_became_active":"2024-04-26T11:27:12.115192+0000","last_became_peered":"2024-04-26T11:27:12.115192+0000","last_unstale":"2024-04-26T11:29:03.595886+0000","last_undegraded":"2024-04-26T11:29:03.595886+0000","last_fullsized":"2024-04-26T11:29:03.595886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:55.475825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592043+0000","last_change":"2024-04-26T11:27:12.108771+0000","last_active":"2024-04-26T11:29:03.592043+0000","last_peered":"2024-04-26T11:29:03.592043+0000","last_clean":"2024-04-26T11:29:03.592043+0000","last_became_active":"2024-04-26T11:27:12.102910+0000","last_became_peered":"2024-04-26T11:27:12.102910+0000","last_unstale":"2024-04-26T11:29:03.592043+0000","last_undegraded":"2024-04-26T11:29:03.592043+0000","last_fullsized":"2024-04-26T11:29:03.592043+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:23.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825429+0000","last_change":"2024-04-26T11:27:12.091226+0000","last_active":"2024-04-26T11:29:03.825429+0000","last_peered":"2024-04-26T11:29:03.825429+0000","last_clean":"2024-04-26T11:29:03.825429+0000","last_became_active":"2024-04-26T11:27:12.090926+0000","last_became_peered":"2024-04-26T11:27:12.090926+0000","last_unstale":"2024-04-26T11:29:03.825429+0000","last_undegraded":"2024-04-26T11:29:03.825429+0000","last_fullsized":"2024-04-26T11:29:03.825429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:43.005527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594512+0000","last_change":"2024-04-26T11:27:12.091297+0000","last_active":"2024-04-26T11:29:03.594512+0000","last_peered":"2024-04-26T11:29:03.594512+0000","last_clean":"2024-04-26T11:29:03.594512+0000","last_became_active":"2024-04-26T11:27:12.090946+0000","last_became_peered":"2024-04-26T11:27:12.090946+0000","last_unstale":"2024-04-26T11:29:03.594512+0000","last_undegraded":"2024-04-26T11:29:03.594512+0000","last_fullsized":"2024-04-26T11:29:03.594512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:06.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813909+0000","last_change":"2024-04-26T11:28:03.445596+0000","last_active":"2024-04-26T11:29:03.813909+0000","last_peered":"2024-04-26T11:29:03.813909+0000","last_clean":"2024-04-26T11:29:03.813909+0000","last_became_active":"2024-04-26T11:28:03.443717+0000","last_became_peered":"2024-04-26T11:28:03.443717+0000","last_unstale":"2024-04-26T11:29:03.813909+0000","last_undegraded":"2024-04-26T11:29:03.813909+0000","last_fullsized":"2024-04-26T11:29:03.813909+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:44.905902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825884+0000","last_change":"2024-04-26T11:27:12.107987+0000","last_active":"2024-04-26T11:29:03.825884+0000","last_peered":"2024-04-26T11:29:03.825884+0000","last_clean":"2024-04-26T11:29:03.825884+0000","last_became_active":"2024-04-26T11:27:12.107668+0000","last_became_peered":"2024-04-26T11:27:12.107668+0000","last_unstale":"2024-04-26T11:29:03.825884+0000","last_undegraded":"2024-04-26T11:29:03.825884+0000","last_fullsized":"2024-04-26T11:29:03.825884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:06.448570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.812233+0000","last_change":"2024-04-26T11:27:12.105596+0000","last_active":"2024-04-26T11:29:03.812233+0000","last_peered":"2024-04-26T11:29:03.812233+0000","last_clean":"2024-04-26T11:29:03.812233+0000","last_became_active":"2024-04-26T11:27:12.104996+0000","last_became_peered":"2024-04-26T11:27:12.104996+0000","last_unstale":"2024-04-26T11:29:03.812233+0000","last_undegraded":"2024-04-26T11:29:03.812233+0000","last_fullsized":"2024-04-26T11:29:03.812233+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:11.947364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691410+0000","last_change":"2024-04-26T11:27:12.116095+0000","last_active":"2024-04-26T11:29:03.691410+0000","last_peered":"2024-04-26T11:29:03.691410+0000","last_clean":"2024-04-26T11:29:03.691410+0000","last_became_active":"2024-04-26T11:27:12.115726+0000","last_became_peered":"2024-04-26T11:27:12.115726+0000","last_unstale":"2024-04-26T11:29:03.691410+0000","last_undegraded":"2024-04-26T11:29:03.691410+0000","last_fullsized":"2024-04-26T11:29:03.691410+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:45.056829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592063+0000","last_change":"2024-04-26T11:27:12.115016+0000","last_active":"2024-04-26T11:29:03.592063+0000","last_peered":"2024-04-26T11:29:03.592063+0000","last_clean":"2024-04-26T11:29:03.592063+0000","last_became_active":"2024-04-26T11:27:12.114671+0000","last_became_peered":"2024-04-26T11:27:12.114671+0000","last_unstale":"2024-04-26T11:29:03.592063+0000","last_undegraded":"2024-04-26T11:29:03.592063+0000","last_fullsized":"2024-04-26T11:29:03.592063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:11.393056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825303+0000","last_change":"2024-04-26T11:27:12.097130+0000","last_active":"2024-04-26T11:29:03.825303+0000","last_peered":"2024-04-26T11:29:03.825303+0000","last_clean":"2024-04-26T11:29:03.825303+0000","last_became_active":"2024-04-26T11:27:12.096809+0000","last_became_peered":"2024-04-26T11:27:12.096809+0000","last_unstale":"2024-04-26T11:29:03.825303+0000","last_undegraded":"2024-04-26T11:29:03.825303+0000","last_fullsized":"2024-04-26T11:29:03.825303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:31.198452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":213698,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66141,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":727,"num_read_kb":445,"num_write":173,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1316,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":198423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351022,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":501054,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612659,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32320,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712832,"statfs":{"total":95995035648,"available":95961939968,"internally_reserved":0,"allocated":1163264,"data_stored":1154444,"data_compressed":47749,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776185,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1028096,"data_stored":500668,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037823,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":500006,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299460,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":1092659,"data_compressed":47749,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462987,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":500057,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1081344,"data_stored":562431,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":501328,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1093632,"data_stored":563087,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149786,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":500368,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888151,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":501138,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724625,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":1091189,"data_compressed":47749,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34523,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34523,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:29:39.915 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T11:29:40.373 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:40 smithi110 ceph-mon[28069]: from='client.24826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:29:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:40 smithi193 ceph-mon[32782]: from='client.24826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:29:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:40 smithi196 ceph-mon[32572]: from='client.24826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:29:41.553 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:41 smithi110 ceph-mon[28069]: pgmap v402: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:41 smithi193 ceph-mon[32782]: pgmap v402: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:41 smithi196 ceph-mon[32572]: pgmap v402: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:42.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.691+0000 7f2839a00700 1 -- 172.21.15.110:0/2709097944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2834106000 msgr2=0x7f2834112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:42.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.691+0000 7f2839a00700 1 --2- 172.21.15.110:0/2709097944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2834106000 0x7f2834112510 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f282c009f90 tx=0x7f282c00b330 comp rx=0 tx=0).stop 2024-04-26T11:29:42.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.691+0000 7f2839a00700 1 -- 172.21.15.110:0/2709097944 shutdown_connections 2024-04-26T11:29:42.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.691+0000 7f2839a00700 1 --2- 172.21.15.110:0/2709097944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2834106000 0x7f2834112510 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.691+0000 7f2839a00700 1 --2- 172.21.15.110:0/2709097944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f283410b640 0x7f283410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.691+0000 7f2839a00700 1 --2- 172.21.15.110:0/2709097944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2834105640 0x7f2834105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.691+0000 7f2839a00700 1 -- 172.21.15.110:0/2709097944 >> 172.21.15.110:0/2709097944 conn(0x7f2834101130 msgr2=0x7f2834103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:42.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.691+0000 7f2839a00700 1 -- 172.21.15.110:0/2709097944 shutdown_connections 2024-04-26T11:29:42.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.691+0000 7f2839a00700 1 -- 172.21.15.110:0/2709097944 wait complete. 2024-04-26T11:29:42.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.692+0000 7f2839a00700 1 Processor -- start 2024-04-26T11:29:42.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2839a00700 1 -- start start 2024-04-26T11:29:42.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2839a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2834105640 0x7f28341a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:42.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2839a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2834106000 0x7f28341a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:42.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2839a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283410b640 0x7f283419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:42.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2839a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f28341158d0 con 0x7f2834106000 2024-04-26T11:29:42.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2839a00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2834115750 con 0x7f2834105640 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2839a00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2834115a50 con 0x7f283410b640 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2832000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2834106000 0x7f28341a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2832000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2834106000 0x7f28341a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40548/0 (socket says 172.21.15.110:40548) 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2832000700 1 -- 172.21.15.110:0/3269250814 learned_addr learned my addr 172.21.15.110:0/3269250814 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2832a00700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2834105640 0x7f28341a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.693+0000 7f2833400700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283410b640 0x7f283419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.694+0000 7f2832000700 1 -- 172.21.15.110:0/3269250814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283410b640 msgr2=0x7f283419baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.694+0000 7f2832000700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283410b640 0x7f283419baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.694+0000 7f2832000700 1 -- 172.21.15.110:0/3269250814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2834105640 msgr2=0x7f28341a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.694+0000 7f2832000700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2834105640 0x7f28341a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.694+0000 7f2832000700 1 -- 172.21.15.110:0/3269250814 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283419c250 con 0x7f2834106000 2024-04-26T11:29:42.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.694+0000 7f2832000700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2834106000 0x7f28341a1e20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f282000e9c0 tx=0x7f282000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:42.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.694+0000 7f282b400700 1 -- 172.21.15.110:0/3269250814 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820004a30 con 0x7f2834106000 2024-04-26T11:29:42.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.694+0000 7f282b400700 1 -- 172.21.15.110:0/3269250814 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f282000cc70 con 0x7f2834106000 2024-04-26T11:29:42.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.694+0000 7f282b400700 1 -- 172.21.15.110:0/3269250814 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820005490 con 0x7f2834106000 2024-04-26T11:29:42.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.695+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283419c540 con 0x7f2834106000 2024-04-26T11:29:42.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.695+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28341a87b0 con 0x7f2834106000 2024-04-26T11:29:42.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.696+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f283406a110 con 0x7f2834106000 2024-04-26T11:29:42.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.698+0000 7f282b400700 1 -- 172.21.15.110:0/3269250814 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f2820004bd0 con 0x7f2834106000 2024-04-26T11:29:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.700+0000 7f282b400700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f28180a3cc0 0x7f28180a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.700+0000 7f282b400700 1 -- 172.21.15.110:0/3269250814 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f28200d0550 con 0x7f2834106000 2024-04-26T11:29:42.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.700+0000 7f2832a00700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f28180a3cc0 0x7f28180a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:42.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.701+0000 7f2832a00700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f28180a3cc0 0x7f28180a6180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2834103a60 tx=0x7f28240073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:42.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.704+0000 7f282b400700 1 -- 172.21.15.110:0/3269250814 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f282009ce30 con 0x7f2834106000 2024-04-26T11:29:42.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.927+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2834063860 con 0x7f28180a3cc0 2024-04-26T11:29:42.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.940+0000 7f282b400700 1 -- 172.21.15.110:0/3269250814 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259086 (secure 0 0 0) 0x7f2834063860 con 0x7f28180a3cc0 2024-04-26T11:29:42.945 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.944+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f28180a3cc0 msgr2=0x7f28180a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.944+0000 7f2839a00700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f28180a3cc0 0x7f28180a6180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2834103a60 tx=0x7f28240073d0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.944+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2834106000 msgr2=0x7f28341a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.944+0000 7f2839a00700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2834106000 0x7f28341a1e20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f282000e9c0 tx=0x7f282000ecd0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.945+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 shutdown_connections 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.945+0000 7f2839a00700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f28180a3cc0 0x7f28180a6180 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.945+0000 7f2839a00700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f283410b640 0x7f283419baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.945+0000 7f2839a00700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2834105640 0x7f28341a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.945+0000 7f2839a00700 1 --2- 172.21.15.110:0/3269250814 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2834106000 0x7f28341a1e20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.945+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 >> 172.21.15.110:0/3269250814 conn(0x7f2834101130 msgr2=0x7f2834101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.945+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 shutdown_connections 2024-04-26T11:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:42.945+0000 7f2839a00700 1 -- 172.21.15.110:0/3269250814 wait complete. 2024-04-26T11:29:42.949 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-26T11:29:43.778 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":403,"stamp":"2024-04-26T11:29:42.532111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656743,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":893,"num_read_kb":579,"num_write":356,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1182052,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369940,"kb_used_data":12384,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571884,"statfs":{"total":1151940427776,"available":1151561609216,"internally_reserved":0,"allocated":12681216,"data_stored":7968429,"data_compressed":247521,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005048"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825610+0000","last_change":"2024-04-26T11:27:12.099635+0000","last_active":"2024-04-26T11:29:03.825610+0000","last_peered":"2024-04-26T11:29:03.825610+0000","last_clean":"2024-04-26T11:29:03.825610+0000","last_became_active":"2024-04-26T11:27:12.099342+0000","last_became_peered":"2024-04-26T11:27:12.099342+0000","last_unstale":"2024-04-26T11:29:03.825610+0000","last_undegraded":"2024-04-26T11:29:03.825610+0000","last_fullsized":"2024-04-26T11:29:03.825610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:36.433968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595866+0000","last_change":"2024-04-26T11:27:12.090804+0000","last_active":"2024-04-26T11:29:03.595866+0000","last_peered":"2024-04-26T11:29:03.595866+0000","last_clean":"2024-04-26T11:29:03.595866+0000","last_became_active":"2024-04-26T11:27:12.089662+0000","last_became_peered":"2024-04-26T11:27:12.089662+0000","last_unstale":"2024-04-26T11:29:03.595866+0000","last_undegraded":"2024-04-26T11:29:03.595866+0000","last_fullsized":"2024-04-26T11:29:03.595866+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.776482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595842+0000","last_change":"2024-04-26T11:27:12.094739+0000","last_active":"2024-04-26T11:29:03.595842+0000","last_peered":"2024-04-26T11:29:03.595842+0000","last_clean":"2024-04-26T11:29:03.595842+0000","last_became_active":"2024-04-26T11:27:12.094410+0000","last_became_peered":"2024-04-26T11:27:12.094410+0000","last_unstale":"2024-04-26T11:29:03.595842+0000","last_undegraded":"2024-04-26T11:29:03.595842+0000","last_fullsized":"2024-04-26T11:29:03.595842+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:17.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602156+0000","last_change":"2024-04-26T11:28:03.446873+0000","last_active":"2024-04-26T11:29:03.602156+0000","last_peered":"2024-04-26T11:29:03.602156+0000","last_clean":"2024-04-26T11:29:03.602156+0000","last_became_active":"2024-04-26T11:28:03.445335+0000","last_became_peered":"2024-04-26T11:28:03.445335+0000","last_unstale":"2024-04-26T11:29:03.602156+0000","last_undegraded":"2024-04-26T11:29:03.602156+0000","last_fullsized":"2024-04-26T11:29:03.602156+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:59.892678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592969+0000","last_change":"2024-04-26T11:27:12.114071+0000","last_active":"2024-04-26T11:29:03.592969+0000","last_peered":"2024-04-26T11:29:03.592969+0000","last_clean":"2024-04-26T11:29:03.592969+0000","last_became_active":"2024-04-26T11:27:12.113795+0000","last_became_peered":"2024-04-26T11:27:12.113795+0000","last_unstale":"2024-04-26T11:29:03.592969+0000","last_undegraded":"2024-04-26T11:29:03.592969+0000","last_fullsized":"2024-04-26T11:29:03.592969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:34.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.597541+0000","last_change":"2024-04-26T11:27:12.108449+0000","last_active":"2024-04-26T11:29:03.597541+0000","last_peered":"2024-04-26T11:29:03.597541+0000","last_clean":"2024-04-26T11:29:03.597541+0000","last_became_active":"2024-04-26T11:27:12.108071+0000","last_became_peered":"2024-04-26T11:27:12.108071+0000","last_unstale":"2024-04-26T11:29:03.597541+0000","last_undegraded":"2024-04-26T11:29:03.597541+0000","last_fullsized":"2024-04-26T11:29:03.597541+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:04.001728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.603681+0000","last_change":"2024-04-26T11:29:03.603681+0000","last_active":"2024-04-26T11:29:03.603681+0000","last_peered":"2024-04-26T11:29:03.603681+0000","last_clean":"2024-04-26T11:29:03.603681+0000","last_became_active":"2024-04-26T11:29:03.603180+0000","last_became_peered":"2024-04-26T11:29:03.603180+0000","last_unstale":"2024-04-26T11:29:03.603681+0000","last_undegraded":"2024-04-26T11:29:03.603681+0000","last_fullsized":"2024-04-26T11:29:03.603681+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.811471+0000","last_change":"2024-04-26T11:27:12.111215+0000","last_active":"2024-04-26T11:29:03.811471+0000","last_peered":"2024-04-26T11:29:03.811471+0000","last_clean":"2024-04-26T11:29:03.811471+0000","last_became_active":"2024-04-26T11:27:12.110896+0000","last_became_peered":"2024-04-26T11:27:12.110896+0000","last_unstale":"2024-04-26T11:29:03.811471+0000","last_undegraded":"2024-04-26T11:29:03.811471+0000","last_fullsized":"2024-04-26T11:29:03.811471+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:17.469534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691675+0000","last_change":"2024-04-26T11:27:12.091871+0000","last_active":"2024-04-26T11:29:03.691675+0000","last_peered":"2024-04-26T11:29:03.691675+0000","last_clean":"2024-04-26T11:29:03.691675+0000","last_became_active":"2024-04-26T11:27:12.091239+0000","last_became_peered":"2024-04-26T11:27:12.091239+0000","last_unstale":"2024-04-26T11:29:03.691675+0000","last_undegraded":"2024-04-26T11:29:03.691675+0000","last_fullsized":"2024-04-26T11:29:03.691675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:30.526152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.597808+0000","last_change":"2024-04-26T11:27:12.093411+0000","last_active":"2024-04-26T11:29:03.597808+0000","last_peered":"2024-04-26T11:29:03.597808+0000","last_clean":"2024-04-26T11:29:03.597808+0000","last_became_active":"2024-04-26T11:27:12.093086+0000","last_became_peered":"2024-04-26T11:27:12.093086+0000","last_unstale":"2024-04-26T11:29:03.597808+0000","last_undegraded":"2024-04-26T11:29:03.597808+0000","last_fullsized":"2024-04-26T11:29:03.597808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:56.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.600034+0000","last_change":"2024-04-26T11:27:12.093317+0000","last_active":"2024-04-26T11:29:03.600034+0000","last_peered":"2024-04-26T11:29:03.600034+0000","last_clean":"2024-04-26T11:29:03.600034+0000","last_became_active":"2024-04-26T11:27:12.092595+0000","last_became_peered":"2024-04-26T11:27:12.092595+0000","last_unstale":"2024-04-26T11:29:03.600034+0000","last_undegraded":"2024-04-26T11:29:03.600034+0000","last_fullsized":"2024-04-26T11:29:03.600034+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.702218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595591+0000","last_change":"2024-04-26T11:27:12.093118+0000","last_active":"2024-04-26T11:29:03.595591+0000","last_peered":"2024-04-26T11:29:03.595591+0000","last_clean":"2024-04-26T11:29:03.595591+0000","last_became_active":"2024-04-26T11:27:12.091482+0000","last_became_peered":"2024-04-26T11:27:12.091482+0000","last_unstale":"2024-04-26T11:29:03.595591+0000","last_undegraded":"2024-04-26T11:29:03.595591+0000","last_fullsized":"2024-04-26T11:29:03.595591+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.426213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592031+0000","last_change":"2024-04-26T11:27:12.114213+0000","last_active":"2024-04-26T11:29:03.592031+0000","last_peered":"2024-04-26T11:29:03.592031+0000","last_clean":"2024-04-26T11:29:03.592031+0000","last_became_active":"2024-04-26T11:27:12.113867+0000","last_became_peered":"2024-04-26T11:27:12.113867+0000","last_unstale":"2024-04-26T11:29:03.592031+0000","last_undegraded":"2024-04-26T11:29:03.592031+0000","last_fullsized":"2024-04-26T11:29:03.592031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:59.258645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595148+0000","last_change":"2024-04-26T11:27:12.084301+0000","last_active":"2024-04-26T11:29:03.595148+0000","last_peered":"2024-04-26T11:29:03.595148+0000","last_clean":"2024-04-26T11:29:03.595148+0000","last_became_active":"2024-04-26T11:27:12.083808+0000","last_became_peered":"2024-04-26T11:27:12.083808+0000","last_unstale":"2024-04-26T11:29:03.595148+0000","last_undegraded":"2024-04-26T11:29:03.595148+0000","last_fullsized":"2024-04-26T11:29:03.595148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:46.107583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594934+0000","last_change":"2024-04-26T11:27:12.089647+0000","last_active":"2024-04-26T11:29:03.594934+0000","last_peered":"2024-04-26T11:29:03.594934+0000","last_clean":"2024-04-26T11:29:03.594934+0000","last_became_active":"2024-04-26T11:27:12.088081+0000","last_became_peered":"2024-04-26T11:27:12.088081+0000","last_unstale":"2024-04-26T11:29:03.594934+0000","last_undegraded":"2024-04-26T11:29:03.594934+0000","last_fullsized":"2024-04-26T11:29:03.594934+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:43.423430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691271+0000","last_change":"2024-04-26T11:27:12.098138+0000","last_active":"2024-04-26T11:29:03.691271+0000","last_peered":"2024-04-26T11:29:03.691271+0000","last_clean":"2024-04-26T11:29:03.691271+0000","last_became_active":"2024-04-26T11:27:12.097756+0000","last_became_peered":"2024-04-26T11:27:12.097756+0000","last_unstale":"2024-04-26T11:29:03.691271+0000","last_undegraded":"2024-04-26T11:29:03.691271+0000","last_fullsized":"2024-04-26T11:29:03.691271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:21.155370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825725+0000","last_change":"2024-04-26T11:27:12.099925+0000","last_active":"2024-04-26T11:29:03.825725+0000","last_peered":"2024-04-26T11:29:03.825725+0000","last_clean":"2024-04-26T11:29:03.825725+0000","last_became_active":"2024-04-26T11:27:12.099600+0000","last_became_peered":"2024-04-26T11:27:12.099600+0000","last_unstale":"2024-04-26T11:29:03.825725+0000","last_undegraded":"2024-04-26T11:29:03.825725+0000","last_fullsized":"2024-04-26T11:29:03.825725+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:23.704624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602219+0000","last_change":"2024-04-26T11:27:12.104697+0000","last_active":"2024-04-26T11:29:03.602219+0000","last_peered":"2024-04-26T11:29:03.602219+0000","last_clean":"2024-04-26T11:29:03.602219+0000","last_became_active":"2024-04-26T11:27:12.103963+0000","last_became_peered":"2024-04-26T11:27:12.103963+0000","last_unstale":"2024-04-26T11:29:03.602219+0000","last_undegraded":"2024-04-26T11:29:03.602219+0000","last_fullsized":"2024-04-26T11:29:03.602219+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:58.202895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.604555+0000","last_change":"2024-04-26T11:29:03.603898+0000","last_active":"2024-04-26T11:29:03.604555+0000","last_peered":"2024-04-26T11:29:03.604555+0000","last_clean":"2024-04-26T11:29:03.604555+0000","last_became_active":"2024-04-26T11:29:03.603488+0000","last_became_peered":"2024-04-26T11:29:03.603488+0000","last_unstale":"2024-04-26T11:29:03.604555+0000","last_undegraded":"2024-04-26T11:29:03.604555+0000","last_fullsized":"2024-04-26T11:29:03.604555+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:04.137277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602403+0000","last_change":"2024-04-26T11:28:03.456017+0000","last_active":"2024-04-26T11:29:03.602403+0000","last_peered":"2024-04-26T11:29:03.602403+0000","last_clean":"2024-04-26T11:29:03.602403+0000","last_became_active":"2024-04-26T11:28:03.447016+0000","last_became_peered":"2024-04-26T11:28:03.447016+0000","last_unstale":"2024-04-26T11:29:03.602403+0000","last_undegraded":"2024-04-26T11:29:03.602403+0000","last_fullsized":"2024-04-26T11:29:03.602403+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.616546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813392+0000","last_change":"2024-04-26T11:27:12.112635+0000","last_active":"2024-04-26T11:29:03.813392+0000","last_peered":"2024-04-26T11:29:03.813392+0000","last_clean":"2024-04-26T11:29:03.813392+0000","last_became_active":"2024-04-26T11:27:12.112282+0000","last_became_peered":"2024-04-26T11:27:12.112282+0000","last_unstale":"2024-04-26T11:29:03.813392+0000","last_undegraded":"2024-04-26T11:29:03.813392+0000","last_fullsized":"2024-04-26T11:29:03.813392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:21.482922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813721+0000","last_change":"2024-04-26T11:27:08.473301+0000","last_active":"2024-04-26T11:29:03.813721+0000","last_peered":"2024-04-26T11:29:03.813721+0000","last_clean":"2024-04-26T11:29:03.813721+0000","last_became_active":"2024-04-26T11:27:08.472769+0000","last_became_peered":"2024-04-26T11:27:08.472769+0000","last_unstale":"2024-04-26T11:29:03.813721+0000","last_undegraded":"2024-04-26T11:29:03.813721+0000","last_fullsized":"2024-04-26T11:29:03.813721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:49.108849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.596153+0000","last_change":"2024-04-26T11:27:12.109725+0000","last_active":"2024-04-26T11:29:03.596153+0000","last_peered":"2024-04-26T11:29:03.596153+0000","last_clean":"2024-04-26T11:29:03.596153+0000","last_became_active":"2024-04-26T11:27:12.109376+0000","last_became_peered":"2024-04-26T11:27:12.109376+0000","last_unstale":"2024-04-26T11:29:03.596153+0000","last_undegraded":"2024-04-26T11:29:03.596153+0000","last_fullsized":"2024-04-26T11:29:03.596153+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593546+0000","last_change":"2024-04-26T11:28:03.464520+0000","last_active":"2024-04-26T11:29:03.593546+0000","last_peered":"2024-04-26T11:29:03.593546+0000","last_clean":"2024-04-26T11:29:03.593546+0000","last_became_active":"2024-04-26T11:28:03.449993+0000","last_became_peered":"2024-04-26T11:28:03.449993+0000","last_unstale":"2024-04-26T11:29:03.593546+0000","last_undegraded":"2024-04-26T11:29:03.593546+0000","last_fullsized":"2024-04-26T11:29:03.593546+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:01.465563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691297+0000","last_change":"2024-04-26T11:27:12.100830+0000","last_active":"2024-04-26T11:29:03.691297+0000","last_peered":"2024-04-26T11:29:03.691297+0000","last_clean":"2024-04-26T11:29:03.691297+0000","last_became_active":"2024-04-26T11:27:12.100474+0000","last_became_peered":"2024-04-26T11:27:12.100474+0000","last_unstale":"2024-04-26T11:29:03.691297+0000","last_undegraded":"2024-04-26T11:29:03.691297+0000","last_fullsized":"2024-04-26T11:29:03.691297+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:18.778897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825114+0000","last_change":"2024-04-26T11:28:03.444580+0000","last_active":"2024-04-26T11:29:03.825114+0000","last_peered":"2024-04-26T11:29:03.825114+0000","last_clean":"2024-04-26T11:29:03.825114+0000","last_became_active":"2024-04-26T11:28:03.435056+0000","last_became_peered":"2024-04-26T11:28:03.435056+0000","last_unstale":"2024-04-26T11:29:03.825114+0000","last_undegraded":"2024-04-26T11:29:03.825114+0000","last_fullsized":"2024-04-26T11:29:03.825114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:42.640914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826358+0000","last_change":"2024-04-26T11:27:12.093472+0000","last_active":"2024-04-26T11:29:03.826358+0000","last_peered":"2024-04-26T11:29:03.826358+0000","last_clean":"2024-04-26T11:29:03.826358+0000","last_became_active":"2024-04-26T11:27:12.093110+0000","last_became_peered":"2024-04-26T11:27:12.093110+0000","last_unstale":"2024-04-26T11:29:03.826358+0000","last_undegraded":"2024-04-26T11:29:03.826358+0000","last_fullsized":"2024-04-26T11:29:03.826358+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:19.256670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":120,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:40.570182+0000","last_change":"2024-04-26T11:28:03.440961+0000","last_active":"2024-04-26T11:29:40.570182+0000","last_peered":"2024-04-26T11:29:40.570182+0000","last_clean":"2024-04-26T11:29:40.570182+0000","last_became_active":"2024-04-26T11:28:03.434607+0000","last_became_peered":"2024-04-26T11:28:03.434607+0000","last_unstale":"2024-04-26T11:29:40.570182+0000","last_undegraded":"2024-04-26T11:29:40.570182+0000","last_fullsized":"2024-04-26T11:29:40.570182+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:37.122557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592947+0000","last_change":"2024-04-26T11:28:03.447662+0000","last_active":"2024-04-26T11:29:03.592947+0000","last_peered":"2024-04-26T11:29:03.592947+0000","last_clean":"2024-04-26T11:29:03.592947+0000","last_became_active":"2024-04-26T11:28:03.447333+0000","last_became_peered":"2024-04-26T11:28:03.447333+0000","last_unstale":"2024-04-26T11:29:03.592947+0000","last_undegraded":"2024-04-26T11:29:03.592947+0000","last_fullsized":"2024-04-26T11:29:03.592947+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:37.600940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.597419+0000","last_change":"2024-04-26T11:27:08.028424+0000","last_active":"2024-04-26T11:29:03.597419+0000","last_peered":"2024-04-26T11:29:03.597419+0000","last_clean":"2024-04-26T11:29:03.597419+0000","last_became_active":"2024-04-26T11:27:08.028134+0000","last_became_peered":"2024-04-26T11:27:08.028134+0000","last_unstale":"2024-04-26T11:29:03.597419+0000","last_undegraded":"2024-04-26T11:29:03.597419+0000","last_fullsized":"2024-04-26T11:29:03.597419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:44.636288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826237+0000","last_change":"2024-04-26T11:27:12.108078+0000","last_active":"2024-04-26T11:29:03.826237+0000","last_peered":"2024-04-26T11:29:03.826237+0000","last_clean":"2024-04-26T11:29:03.826237+0000","last_became_active":"2024-04-26T11:27:12.107713+0000","last_became_peered":"2024-04-26T11:27:12.107713+0000","last_unstale":"2024-04-26T11:29:03.826237+0000","last_undegraded":"2024-04-26T11:29:03.826237+0000","last_fullsized":"2024-04-26T11:29:03.826237+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:59.995679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.591930+0000","last_change":"2024-04-26T11:27:08.049134+0000","last_active":"2024-04-26T11:29:03.591930+0000","last_peered":"2024-04-26T11:29:03.591930+0000","last_clean":"2024-04-26T11:29:03.591930+0000","last_became_active":"2024-04-26T11:27:08.047862+0000","last_became_peered":"2024-04-26T11:27:08.047862+0000","last_unstale":"2024-04-26T11:29:03.591930+0000","last_undegraded":"2024-04-26T11:29:03.591930+0000","last_fullsized":"2024-04-26T11:29:03.591930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:55.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.812034+0000","last_change":"2024-04-26T11:27:12.117417+0000","last_active":"2024-04-26T11:29:03.812034+0000","last_peered":"2024-04-26T11:29:03.812034+0000","last_clean":"2024-04-26T11:29:03.812034+0000","last_became_active":"2024-04-26T11:27:12.116643+0000","last_became_peered":"2024-04-26T11:27:12.116643+0000","last_unstale":"2024-04-26T11:29:03.812034+0000","last_undegraded":"2024-04-26T11:29:03.812034+0000","last_fullsized":"2024-04-26T11:29:03.812034+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:26.677738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825873+0000","last_change":"2024-04-26T11:27:08.037806+0000","last_active":"2024-04-26T11:29:03.825873+0000","last_peered":"2024-04-26T11:29:03.825873+0000","last_clean":"2024-04-26T11:29:03.825873+0000","last_became_active":"2024-04-26T11:27:08.037309+0000","last_became_peered":"2024-04-26T11:27:08.037309+0000","last_unstale":"2024-04-26T11:29:03.825873+0000","last_undegraded":"2024-04-26T11:29:03.825873+0000","last_fullsized":"2024-04-26T11:29:03.825873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.910219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.601962+0000","last_change":"2024-04-26T11:27:12.120986+0000","last_active":"2024-04-26T11:29:03.601962+0000","last_peered":"2024-04-26T11:29:03.601962+0000","last_clean":"2024-04-26T11:29:03.601962+0000","last_became_active":"2024-04-26T11:27:12.120580+0000","last_became_peered":"2024-04-26T11:27:12.120580+0000","last_unstale":"2024-04-26T11:29:03.601962+0000","last_undegraded":"2024-04-26T11:29:03.601962+0000","last_fullsized":"2024-04-26T11:29:03.601962+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:00.996039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":160,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:40.569683+0000","last_change":"2024-04-26T11:27:08.048979+0000","last_active":"2024-04-26T11:29:40.569683+0000","last_peered":"2024-04-26T11:29:40.569683+0000","last_clean":"2024-04-26T11:29:40.569683+0000","last_became_active":"2024-04-26T11:27:08.048641+0000","last_became_peered":"2024-04-26T11:27:08.048641+0000","last_unstale":"2024-04-26T11:29:40.569683+0000","last_undegraded":"2024-04-26T11:29:40.569683+0000","last_fullsized":"2024-04-26T11:29:40.569683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:38.917651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":126,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691660+0000","last_change":"2024-04-26T11:27:12.104749+0000","last_active":"2024-04-26T11:29:03.691660+0000","last_peered":"2024-04-26T11:29:03.691660+0000","last_clean":"2024-04-26T11:29:03.691660+0000","last_became_active":"2024-04-26T11:27:12.104358+0000","last_became_peered":"2024-04-26T11:27:12.104358+0000","last_unstale":"2024-04-26T11:29:03.691660+0000","last_undegraded":"2024-04-26T11:29:03.691660+0000","last_fullsized":"2024-04-26T11:29:03.691660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:47.364512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599982+0000","last_change":"2024-04-26T11:27:08.038165+0000","last_active":"2024-04-26T11:29:03.599982+0000","last_peered":"2024-04-26T11:29:03.599982+0000","last_clean":"2024-04-26T11:29:03.599982+0000","last_became_active":"2024-04-26T11:27:08.036930+0000","last_became_peered":"2024-04-26T11:27:08.036930+0000","last_unstale":"2024-04-26T11:29:03.599982+0000","last_undegraded":"2024-04-26T11:29:03.599982+0000","last_fullsized":"2024-04-26T11:29:03.599982+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:10.050679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.596196+0000","last_change":"2024-04-26T11:27:12.098702+0000","last_active":"2024-04-26T11:29:03.596196+0000","last_peered":"2024-04-26T11:29:03.596196+0000","last_clean":"2024-04-26T11:29:03.596196+0000","last_became_active":"2024-04-26T11:27:12.089241+0000","last_became_peered":"2024-04-26T11:27:12.089241+0000","last_unstale":"2024-04-26T11:29:03.596196+0000","last_undegraded":"2024-04-26T11:29:03.596196+0000","last_fullsized":"2024-04-26T11:29:03.596196+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.013054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826455+0000","last_change":"2024-04-26T11:27:08.473759+0000","last_active":"2024-04-26T11:29:03.826455+0000","last_peered":"2024-04-26T11:29:03.826455+0000","last_clean":"2024-04-26T11:29:03.826455+0000","last_became_active":"2024-04-26T11:27:08.473288+0000","last_became_peered":"2024-04-26T11:27:08.473288+0000","last_unstale":"2024-04-26T11:29:03.826455+0000","last_undegraded":"2024-04-26T11:29:03.826455+0000","last_fullsized":"2024-04-26T11:29:03.826455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:36.727119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691543+0000","last_change":"2024-04-26T11:27:12.096935+0000","last_active":"2024-04-26T11:29:03.691543+0000","last_peered":"2024-04-26T11:29:03.691543+0000","last_clean":"2024-04-26T11:29:03.691543+0000","last_became_active":"2024-04-26T11:27:12.096481+0000","last_became_peered":"2024-04-26T11:27:12.096481+0000","last_unstale":"2024-04-26T11:29:03.691543+0000","last_undegraded":"2024-04-26T11:29:03.691543+0000","last_fullsized":"2024-04-26T11:29:03.691543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:58.855909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'33","reported_seq":326,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:41.570849+0000","last_change":"2024-04-26T11:27:08.037227+0000","last_active":"2024-04-26T11:29:41.570849+0000","last_peered":"2024-04-26T11:29:41.570849+0000","last_clean":"2024-04-26T11:29:41.570849+0000","last_became_active":"2024-04-26T11:27:08.036852+0000","last_became_peered":"2024-04-26T11:27:08.036852+0000","last_unstale":"2024-04-26T11:29:41.570849+0000","last_undegraded":"2024-04-26T11:29:41.570849+0000","last_fullsized":"2024-04-26T11:29:41.570849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:44.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61999,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":262,"num_read_kb":191,"num_write":34,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593394+0000","last_change":"2024-04-26T11:27:12.088586+0000","last_active":"2024-04-26T11:29:03.593394+0000","last_peered":"2024-04-26T11:29:03.593394+0000","last_clean":"2024-04-26T11:29:03.593394+0000","last_became_active":"2024-04-26T11:27:12.088264+0000","last_became_peered":"2024-04-26T11:27:12.088264+0000","last_unstale":"2024-04-26T11:29:03.593394+0000","last_undegraded":"2024-04-26T11:29:03.593394+0000","last_fullsized":"2024-04-26T11:29:03.593394+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:39.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594570+0000","last_change":"2024-04-26T11:27:08.049289+0000","last_active":"2024-04-26T11:29:03.594570+0000","last_peered":"2024-04-26T11:29:03.594570+0000","last_clean":"2024-04-26T11:29:03.594570+0000","last_became_active":"2024-04-26T11:27:08.048923+0000","last_became_peered":"2024-04-26T11:27:08.048923+0000","last_unstale":"2024-04-26T11:29:03.594570+0000","last_undegraded":"2024-04-26T11:29:03.594570+0000","last_fullsized":"2024-04-26T11:29:03.594570+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:42.229383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.591953+0000","last_change":"2024-04-26T11:27:12.118154+0000","last_active":"2024-04-26T11:29:03.591953+0000","last_peered":"2024-04-26T11:29:03.591953+0000","last_clean":"2024-04-26T11:29:03.591953+0000","last_became_active":"2024-04-26T11:27:12.117624+0000","last_became_peered":"2024-04-26T11:27:12.117624+0000","last_unstale":"2024-04-26T11:29:03.591953+0000","last_undegraded":"2024-04-26T11:29:03.591953+0000","last_fullsized":"2024-04-26T11:29:03.591953+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:57.947310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826180+0000","last_change":"2024-04-26T11:27:08.045870+0000","last_active":"2024-04-26T11:29:03.826180+0000","last_peered":"2024-04-26T11:29:03.826180+0000","last_clean":"2024-04-26T11:29:03.826180+0000","last_became_active":"2024-04-26T11:27:08.045461+0000","last_became_peered":"2024-04-26T11:27:08.045461+0000","last_unstale":"2024-04-26T11:29:03.826180+0000","last_undegraded":"2024-04-26T11:29:03.826180+0000","last_fullsized":"2024-04-26T11:29:03.826180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:59.899805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599750+0000","last_change":"2024-04-26T11:27:12.116617+0000","last_active":"2024-04-26T11:29:03.599750+0000","last_peered":"2024-04-26T11:29:03.599750+0000","last_clean":"2024-04-26T11:29:03.599750+0000","last_became_active":"2024-04-26T11:27:12.115731+0000","last_became_peered":"2024-04-26T11:27:12.115731+0000","last_unstale":"2024-04-26T11:29:03.599750+0000","last_undegraded":"2024-04-26T11:29:03.599750+0000","last_fullsized":"2024-04-26T11:29:03.599750+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:42.680367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'5","reported_seq":167,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:40.898928+0000","last_change":"2024-04-26T11:27:08.036947+0000","last_active":"2024-04-26T11:29:40.898928+0000","last_peered":"2024-04-26T11:29:40.898928+0000","last_clean":"2024-04-26T11:29:40.898928+0000","last_became_active":"2024-04-26T11:27:08.036596+0000","last_became_peered":"2024-04-26T11:27:08.036596+0000","last_unstale":"2024-04-26T11:29:40.898928+0000","last_undegraded":"2024-04-26T11:29:40.898928+0000","last_fullsized":"2024-04-26T11:29:40.898928+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:35.606069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599404+0000","last_change":"2024-04-26T11:27:12.086190+0000","last_active":"2024-04-26T11:29:03.599404+0000","last_peered":"2024-04-26T11:29:03.599404+0000","last_clean":"2024-04-26T11:29:03.599404+0000","last_became_active":"2024-04-26T11:27:12.085839+0000","last_became_peered":"2024-04-26T11:27:12.085839+0000","last_unstale":"2024-04-26T11:29:03.599404+0000","last_undegraded":"2024-04-26T11:29:03.599404+0000","last_fullsized":"2024-04-26T11:29:03.599404+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:31.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":71,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592909+0000","last_change":"2024-04-26T11:28:03.459792+0000","last_active":"2024-04-26T11:29:03.592909+0000","last_peered":"2024-04-26T11:29:03.592909+0000","last_clean":"2024-04-26T11:29:03.592909+0000","last_became_active":"2024-04-26T11:28:03.444101+0000","last_became_peered":"2024-04-26T11:28:03.444101+0000","last_unstale":"2024-04-26T11:29:03.592909+0000","last_undegraded":"2024-04-26T11:29:03.592909+0000","last_fullsized":"2024-04-26T11:29:03.592909+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:14.498792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826071+0000","last_change":"2024-04-26T11:27:12.093884+0000","last_active":"2024-04-26T11:29:03.826071+0000","last_peered":"2024-04-26T11:29:03.826071+0000","last_clean":"2024-04-26T11:29:03.826071+0000","last_became_active":"2024-04-26T11:27:12.093573+0000","last_became_peered":"2024-04-26T11:27:12.093573+0000","last_unstale":"2024-04-26T11:29:03.826071+0000","last_undegraded":"2024-04-26T11:29:03.826071+0000","last_fullsized":"2024-04-26T11:29:03.826071+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:32.144889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593686+0000","last_change":"2024-04-26T11:27:08.035089+0000","last_active":"2024-04-26T11:29:03.593686+0000","last_peered":"2024-04-26T11:29:03.593686+0000","last_clean":"2024-04-26T11:29:03.593686+0000","last_became_active":"2024-04-26T11:27:08.034698+0000","last_became_peered":"2024-04-26T11:27:08.034698+0000","last_unstale":"2024-04-26T11:29:03.593686+0000","last_undegraded":"2024-04-26T11:29:03.593686+0000","last_fullsized":"2024-04-26T11:29:03.593686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:23.731307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825493+0000","last_change":"2024-04-26T11:27:12.097089+0000","last_active":"2024-04-26T11:29:03.825493+0000","last_peered":"2024-04-26T11:29:03.825493+0000","last_clean":"2024-04-26T11:29:03.825493+0000","last_became_active":"2024-04-26T11:27:12.096762+0000","last_became_peered":"2024-04-26T11:27:12.096762+0000","last_unstale":"2024-04-26T11:29:03.825493+0000","last_undegraded":"2024-04-26T11:29:03.825493+0000","last_fullsized":"2024-04-26T11:29:03.825493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.366450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602239+0000","last_change":"2024-04-26T11:27:08.475317+0000","last_active":"2024-04-26T11:29:03.602239+0000","last_peered":"2024-04-26T11:29:03.602239+0000","last_clean":"2024-04-26T11:29:03.602239+0000","last_became_active":"2024-04-26T11:27:08.474464+0000","last_became_peered":"2024-04-26T11:27:08.474464+0000","last_unstale":"2024-04-26T11:29:03.602239+0000","last_undegraded":"2024-04-26T11:29:03.602239+0000","last_fullsized":"2024-04-26T11:29:03.602239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.597271+0000","last_change":"2024-04-26T11:27:12.107542+0000","last_active":"2024-04-26T11:29:03.597271+0000","last_peered":"2024-04-26T11:29:03.597271+0000","last_clean":"2024-04-26T11:29:03.597271+0000","last_became_active":"2024-04-26T11:27:12.107162+0000","last_became_peered":"2024-04-26T11:27:12.107162+0000","last_unstale":"2024-04-26T11:29:03.597271+0000","last_undegraded":"2024-04-26T11:29:03.597271+0000","last_fullsized":"2024-04-26T11:29:03.597271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:55.470638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599798+0000","last_change":"2024-04-26T11:27:08.044101+0000","last_active":"2024-04-26T11:29:03.599798+0000","last_peered":"2024-04-26T11:29:03.599798+0000","last_clean":"2024-04-26T11:29:03.599798+0000","last_became_active":"2024-04-26T11:27:08.043733+0000","last_became_peered":"2024-04-26T11:27:08.043733+0000","last_unstale":"2024-04-26T11:29:03.599798+0000","last_undegraded":"2024-04-26T11:29:03.599798+0000","last_fullsized":"2024-04-26T11:29:03.599798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:03.023620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.604461+0000","last_change":"2024-04-26T11:29:03.604007+0000","last_active":"2024-04-26T11:29:03.604461+0000","last_peered":"2024-04-26T11:29:03.604461+0000","last_clean":"2024-04-26T11:29:03.604461+0000","last_became_active":"2024-04-26T11:29:03.603521+0000","last_became_peered":"2024-04-26T11:29:03.603521+0000","last_unstale":"2024-04-26T11:29:03.604461+0000","last_undegraded":"2024-04-26T11:29:03.604461+0000","last_fullsized":"2024-04-26T11:29:03.604461+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:05.733257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826215+0000","last_change":"2024-04-26T11:27:12.093505+0000","last_active":"2024-04-26T11:29:03.826215+0000","last_peered":"2024-04-26T11:29:03.826215+0000","last_clean":"2024-04-26T11:29:03.826215+0000","last_became_active":"2024-04-26T11:27:12.093198+0000","last_became_peered":"2024-04-26T11:27:12.093198+0000","last_unstale":"2024-04-26T11:29:03.826215+0000","last_undegraded":"2024-04-26T11:29:03.826215+0000","last_fullsized":"2024-04-26T11:29:03.826215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:06.100747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":161,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:38.893346+0000","last_change":"2024-04-26T11:27:08.474897+0000","last_active":"2024-04-26T11:29:38.893346+0000","last_peered":"2024-04-26T11:29:38.893346+0000","last_clean":"2024-04-26T11:29:38.893346+0000","last_became_active":"2024-04-26T11:27:08.471735+0000","last_became_peered":"2024-04-26T11:27:08.471735+0000","last_unstale":"2024-04-26T11:29:38.893346+0000","last_undegraded":"2024-04-26T11:29:38.893346+0000","last_fullsized":"2024-04-26T11:29:38.893346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:42.066821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.812553+0000","last_change":"2024-04-26T11:27:12.116722+0000","last_active":"2024-04-26T11:29:03.812553+0000","last_peered":"2024-04-26T11:29:03.812553+0000","last_clean":"2024-04-26T11:29:03.812553+0000","last_became_active":"2024-04-26T11:27:12.116239+0000","last_became_peered":"2024-04-26T11:27:12.116239+0000","last_unstale":"2024-04-26T11:29:03.812553+0000","last_undegraded":"2024-04-26T11:29:03.812553+0000","last_fullsized":"2024-04-26T11:29:03.812553+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:04.962376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595561+0000","last_change":"2024-04-26T11:27:08.047087+0000","last_active":"2024-04-26T11:29:03.595561+0000","last_peered":"2024-04-26T11:29:03.595561+0000","last_clean":"2024-04-26T11:29:03.595561+0000","last_became_active":"2024-04-26T11:27:08.046754+0000","last_became_peered":"2024-04-26T11:27:08.046754+0000","last_unstale":"2024-04-26T11:29:03.595561+0000","last_undegraded":"2024-04-26T11:29:03.595561+0000","last_fullsized":"2024-04-26T11:29:03.595561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:30.481521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":365,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599448+0000","last_change":"2024-04-26T11:25:35.622816+0000","last_active":"2024-04-26T11:29:03.599448+0000","last_peered":"2024-04-26T11:29:03.599448+0000","last_clean":"2024-04-26T11:29:03.599448+0000","last_became_active":"2024-04-26T11:25:35.622329+0000","last_became_peered":"2024-04-26T11:25:35.622329+0000","last_unstale":"2024-04-26T11:29:03.599448+0000","last_undegraded":"2024-04-26T11:29:03.599448+0000","last_fullsized":"2024-04-26T11:29:03.599448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_clean_scrub_stamp":"2024-04-26T11:21:45.465157+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:40.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.591828+0000","last_change":"2024-04-26T11:27:12.098686+0000","last_active":"2024-04-26T11:29:03.591828+0000","last_peered":"2024-04-26T11:29:03.591828+0000","last_clean":"2024-04-26T11:29:03.591828+0000","last_became_active":"2024-04-26T11:27:12.098251+0000","last_became_peered":"2024-04-26T11:27:12.098251+0000","last_unstale":"2024-04-26T11:29:03.591828+0000","last_undegraded":"2024-04-26T11:29:03.591828+0000","last_fullsized":"2024-04-26T11:29:03.591828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:34.433203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599619+0000","last_change":"2024-04-26T11:27:08.036391+0000","last_active":"2024-04-26T11:29:03.599619+0000","last_peered":"2024-04-26T11:29:03.599619+0000","last_clean":"2024-04-26T11:29:03.599619+0000","last_became_active":"2024-04-26T11:27:08.036058+0000","last_became_peered":"2024-04-26T11:27:08.036058+0000","last_unstale":"2024-04-26T11:29:03.599619+0000","last_undegraded":"2024-04-26T11:29:03.599619+0000","last_fullsized":"2024-04-26T11:29:03.599619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:35.646501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593439+0000","last_change":"2024-04-26T11:27:08.472171+0000","last_active":"2024-04-26T11:29:03.593439+0000","last_peered":"2024-04-26T11:29:03.593439+0000","last_clean":"2024-04-26T11:29:03.593439+0000","last_became_active":"2024-04-26T11:27:08.471707+0000","last_became_peered":"2024-04-26T11:27:08.471707+0000","last_unstale":"2024-04-26T11:29:03.593439+0000","last_undegraded":"2024-04-26T11:29:03.593439+0000","last_fullsized":"2024-04-26T11:29:03.593439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:54.319448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592168+0000","last_change":"2024-04-26T11:27:12.110757+0000","last_active":"2024-04-26T11:29:03.592168+0000","last_peered":"2024-04-26T11:29:03.592168+0000","last_clean":"2024-04-26T11:29:03.592168+0000","last_became_active":"2024-04-26T11:27:12.109048+0000","last_became_peered":"2024-04-26T11:27:12.109048+0000","last_unstale":"2024-04-26T11:29:03.592168+0000","last_undegraded":"2024-04-26T11:29:03.592168+0000","last_fullsized":"2024-04-26T11:29:03.592168+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:05.203504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.602337+0000","last_change":"2024-04-26T11:27:08.051790+0000","last_active":"2024-04-26T11:29:03.602337+0000","last_peered":"2024-04-26T11:29:03.602337+0000","last_clean":"2024-04-26T11:29:03.602337+0000","last_became_active":"2024-04-26T11:27:08.051430+0000","last_became_peered":"2024-04-26T11:27:08.051430+0000","last_unstale":"2024-04-26T11:29:03.602337+0000","last_undegraded":"2024-04-26T11:29:03.602337+0000","last_fullsized":"2024-04-26T11:29:03.602337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:13.607944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813969+0000","last_change":"2024-04-26T11:27:12.116704+0000","last_active":"2024-04-26T11:29:03.813969+0000","last_peered":"2024-04-26T11:29:03.813969+0000","last_clean":"2024-04-26T11:29:03.813969+0000","last_became_active":"2024-04-26T11:27:12.111556+0000","last_became_peered":"2024-04-26T11:27:12.111556+0000","last_unstale":"2024-04-26T11:29:03.813969+0000","last_undegraded":"2024-04-26T11:29:03.813969+0000","last_fullsized":"2024-04-26T11:29:03.813969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:36.535244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595793+0000","last_change":"2024-04-26T11:27:08.347851+0000","last_active":"2024-04-26T11:29:03.595793+0000","last_peered":"2024-04-26T11:29:03.595793+0000","last_clean":"2024-04-26T11:29:03.595793+0000","last_became_active":"2024-04-26T11:27:08.347460+0000","last_became_peered":"2024-04-26T11:27:08.347460+0000","last_unstale":"2024-04-26T11:29:03.595793+0000","last_undegraded":"2024-04-26T11:29:03.595793+0000","last_fullsized":"2024-04-26T11:29:03.595793+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.017834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599288+0000","last_change":"2024-04-26T11:29:03.598719+0000","last_active":"2024-04-26T11:29:03.599288+0000","last_peered":"2024-04-26T11:29:03.599288+0000","last_clean":"2024-04-26T11:29:03.599288+0000","last_became_active":"2024-04-26T11:29:03.598192+0000","last_became_peered":"2024-04-26T11:29:03.598192+0000","last_unstale":"2024-04-26T11:29:03.599288+0000","last_undegraded":"2024-04-26T11:29:03.599288+0000","last_fullsized":"2024-04-26T11:29:03.599288+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:57.809995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691253+0000","last_change":"2024-04-26T11:27:08.472127+0000","last_active":"2024-04-26T11:29:03.691253+0000","last_peered":"2024-04-26T11:29:03.691253+0000","last_clean":"2024-04-26T11:29:03.691253+0000","last_became_active":"2024-04-26T11:27:08.471709+0000","last_became_peered":"2024-04-26T11:27:08.471709+0000","last_unstale":"2024-04-26T11:29:03.691253+0000","last_undegraded":"2024-04-26T11:29:03.691253+0000","last_fullsized":"2024-04-26T11:29:03.691253+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:28.432710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592926+0000","last_change":"2024-04-26T11:27:12.085756+0000","last_active":"2024-04-26T11:29:03.592926+0000","last_peered":"2024-04-26T11:29:03.592926+0000","last_clean":"2024-04-26T11:29:03.592926+0000","last_became_active":"2024-04-26T11:27:12.085397+0000","last_became_peered":"2024-04-26T11:27:12.085397+0000","last_unstale":"2024-04-26T11:29:03.592926+0000","last_undegraded":"2024-04-26T11:29:03.592926+0000","last_fullsized":"2024-04-26T11:29:03.592926+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:41.392010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813197+0000","last_change":"2024-04-26T11:27:08.054831+0000","last_active":"2024-04-26T11:29:03.813197+0000","last_peered":"2024-04-26T11:29:03.813197+0000","last_clean":"2024-04-26T11:29:03.813197+0000","last_became_active":"2024-04-26T11:27:08.054352+0000","last_became_peered":"2024-04-26T11:27:08.054352+0000","last_unstale":"2024-04-26T11:29:03.813197+0000","last_undegraded":"2024-04-26T11:29:03.813197+0000","last_fullsized":"2024-04-26T11:29:03.813197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:53.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825573+0000","last_change":"2024-04-26T11:27:12.095789+0000","last_active":"2024-04-26T11:29:03.825573+0000","last_peered":"2024-04-26T11:29:03.825573+0000","last_clean":"2024-04-26T11:29:03.825573+0000","last_became_active":"2024-04-26T11:27:12.095468+0000","last_became_peered":"2024-04-26T11:27:12.095468+0000","last_unstale":"2024-04-26T11:29:03.825573+0000","last_undegraded":"2024-04-26T11:29:03.825573+0000","last_fullsized":"2024-04-26T11:29:03.825573+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:27.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594349+0000","last_change":"2024-04-26T11:27:08.044923+0000","last_active":"2024-04-26T11:29:03.594349+0000","last_peered":"2024-04-26T11:29:03.594349+0000","last_clean":"2024-04-26T11:29:03.594349+0000","last_became_active":"2024-04-26T11:27:08.044516+0000","last_became_peered":"2024-04-26T11:27:08.044516+0000","last_unstale":"2024-04-26T11:29:03.594349+0000","last_undegraded":"2024-04-26T11:29:03.594349+0000","last_fullsized":"2024-04-26T11:29:03.594349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:21.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.812313+0000","last_change":"2024-04-26T11:27:12.114311+0000","last_active":"2024-04-26T11:29:03.812313+0000","last_peered":"2024-04-26T11:29:03.812313+0000","last_clean":"2024-04-26T11:29:03.812313+0000","last_became_active":"2024-04-26T11:27:12.113538+0000","last_became_peered":"2024-04-26T11:27:12.113538+0000","last_unstale":"2024-04-26T11:29:03.812313+0000","last_undegraded":"2024-04-26T11:29:03.812313+0000","last_fullsized":"2024-04-26T11:29:03.812313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:55.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.593062+0000","last_change":"2024-04-26T11:27:08.036983+0000","last_active":"2024-04-26T11:29:03.593062+0000","last_peered":"2024-04-26T11:29:03.593062+0000","last_clean":"2024-04-26T11:29:03.593062+0000","last_became_active":"2024-04-26T11:27:08.036632+0000","last_became_peered":"2024-04-26T11:27:08.036632+0000","last_unstale":"2024-04-26T11:29:03.593062+0000","last_undegraded":"2024-04-26T11:29:03.593062+0000","last_fullsized":"2024-04-26T11:29:03.593062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:31.731466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599774+0000","last_change":"2024-04-26T11:27:12.102922+0000","last_active":"2024-04-26T11:29:03.599774+0000","last_peered":"2024-04-26T11:29:03.599774+0000","last_clean":"2024-04-26T11:29:03.599774+0000","last_became_active":"2024-04-26T11:27:12.102594+0000","last_became_peered":"2024-04-26T11:27:12.102594+0000","last_unstale":"2024-04-26T11:29:03.599774+0000","last_undegraded":"2024-04-26T11:29:03.599774+0000","last_fullsized":"2024-04-26T11:29:03.599774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:47.223435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594621+0000","last_change":"2024-04-26T11:27:08.473262+0000","last_active":"2024-04-26T11:29:03.594621+0000","last_peered":"2024-04-26T11:29:03.594621+0000","last_clean":"2024-04-26T11:29:03.594621+0000","last_became_active":"2024-04-26T11:27:08.472744+0000","last_became_peered":"2024-04-26T11:27:08.472744+0000","last_unstale":"2024-04-26T11:29:03.594621+0000","last_undegraded":"2024-04-26T11:29:03.594621+0000","last_fullsized":"2024-04-26T11:29:03.594621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:16.766438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.600075+0000","last_change":"2024-04-26T11:27:12.091754+0000","last_active":"2024-04-26T11:29:03.600075+0000","last_peered":"2024-04-26T11:29:03.600075+0000","last_clean":"2024-04-26T11:29:03.600075+0000","last_became_active":"2024-04-26T11:27:12.091282+0000","last_became_peered":"2024-04-26T11:27:12.091282+0000","last_unstale":"2024-04-26T11:29:03.600075+0000","last_undegraded":"2024-04-26T11:29:03.600075+0000","last_fullsized":"2024-04-26T11:29:03.600075+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:07.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.826328+0000","last_change":"2024-04-26T11:27:08.048352+0000","last_active":"2024-04-26T11:29:03.826328+0000","last_peered":"2024-04-26T11:29:03.826328+0000","last_clean":"2024-04-26T11:29:03.826328+0000","last_became_active":"2024-04-26T11:27:08.048056+0000","last_became_peered":"2024-04-26T11:27:08.048056+0000","last_unstale":"2024-04-26T11:29:03.826328+0000","last_undegraded":"2024-04-26T11:29:03.826328+0000","last_fullsized":"2024-04-26T11:29:03.826328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:35.363779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.599918+0000","last_change":"2024-04-26T11:27:12.108244+0000","last_active":"2024-04-26T11:29:03.599918+0000","last_peered":"2024-04-26T11:29:03.599918+0000","last_clean":"2024-04-26T11:29:03.599918+0000","last_became_active":"2024-04-26T11:27:12.107592+0000","last_became_peered":"2024-04-26T11:27:12.107592+0000","last_unstale":"2024-04-26T11:29:03.599918+0000","last_undegraded":"2024-04-26T11:29:03.599918+0000","last_fullsized":"2024-04-26T11:29:03.599918+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:55.985873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592097+0000","last_change":"2024-04-26T11:28:03.462136+0000","last_active":"2024-04-26T11:29:03.592097+0000","last_peered":"2024-04-26T11:29:03.592097+0000","last_clean":"2024-04-26T11:29:03.592097+0000","last_became_active":"2024-04-26T11:28:03.449130+0000","last_became_peered":"2024-04-26T11:28:03.449130+0000","last_unstale":"2024-04-26T11:29:03.592097+0000","last_undegraded":"2024-04-26T11:29:03.592097+0000","last_fullsized":"2024-04-26T11:29:03.592097+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:33.181328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.600102+0000","last_change":"2024-04-26T11:27:12.090627+0000","last_active":"2024-04-26T11:29:03.600102+0000","last_peered":"2024-04-26T11:29:03.600102+0000","last_clean":"2024-04-26T11:29:03.600102+0000","last_became_active":"2024-04-26T11:27:12.089981+0000","last_became_peered":"2024-04-26T11:27:12.089981+0000","last_unstale":"2024-04-26T11:29:03.600102+0000","last_undegraded":"2024-04-26T11:29:03.600102+0000","last_fullsized":"2024-04-26T11:29:03.600102+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825720+0000","last_change":"2024-04-26T11:27:12.089335+0000","last_active":"2024-04-26T11:29:03.825720+0000","last_peered":"2024-04-26T11:29:03.825720+0000","last_clean":"2024-04-26T11:29:03.825720+0000","last_became_active":"2024-04-26T11:27:12.089019+0000","last_became_peered":"2024-04-26T11:27:12.089019+0000","last_unstale":"2024-04-26T11:29:03.825720+0000","last_undegraded":"2024-04-26T11:29:03.825720+0000","last_fullsized":"2024-04-26T11:29:03.825720+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:18.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594235+0000","last_change":"2024-04-26T11:28:03.435483+0000","last_active":"2024-04-26T11:29:03.594235+0000","last_peered":"2024-04-26T11:29:03.594235+0000","last_clean":"2024-04-26T11:29:03.594235+0000","last_became_active":"2024-04-26T11:28:03.435088+0000","last_became_peered":"2024-04-26T11:28:03.435088+0000","last_unstale":"2024-04-26T11:29:03.594235+0000","last_undegraded":"2024-04-26T11:29:03.594235+0000","last_fullsized":"2024-04-26T11:29:03.594235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.453906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594434+0000","last_change":"2024-04-26T11:27:12.112344+0000","last_active":"2024-04-26T11:29:03.594434+0000","last_peered":"2024-04-26T11:29:03.594434+0000","last_clean":"2024-04-26T11:29:03.594434+0000","last_became_active":"2024-04-26T11:27:12.112083+0000","last_became_peered":"2024-04-26T11:27:12.112083+0000","last_unstale":"2024-04-26T11:29:03.594434+0000","last_undegraded":"2024-04-26T11:29:03.594434+0000","last_fullsized":"2024-04-26T11:29:03.594434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.595886+0000","last_change":"2024-04-26T11:27:12.115707+0000","last_active":"2024-04-26T11:29:03.595886+0000","last_peered":"2024-04-26T11:29:03.595886+0000","last_clean":"2024-04-26T11:29:03.595886+0000","last_became_active":"2024-04-26T11:27:12.115192+0000","last_became_peered":"2024-04-26T11:27:12.115192+0000","last_unstale":"2024-04-26T11:29:03.595886+0000","last_undegraded":"2024-04-26T11:29:03.595886+0000","last_fullsized":"2024-04-26T11:29:03.595886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:55.475825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592043+0000","last_change":"2024-04-26T11:27:12.108771+0000","last_active":"2024-04-26T11:29:03.592043+0000","last_peered":"2024-04-26T11:29:03.592043+0000","last_clean":"2024-04-26T11:29:03.592043+0000","last_became_active":"2024-04-26T11:27:12.102910+0000","last_became_peered":"2024-04-26T11:27:12.102910+0000","last_unstale":"2024-04-26T11:29:03.592043+0000","last_undegraded":"2024-04-26T11:29:03.592043+0000","last_fullsized":"2024-04-26T11:29:03.592043+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:23.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825429+0000","last_change":"2024-04-26T11:27:12.091226+0000","last_active":"2024-04-26T11:29:03.825429+0000","last_peered":"2024-04-26T11:29:03.825429+0000","last_clean":"2024-04-26T11:29:03.825429+0000","last_became_active":"2024-04-26T11:27:12.090926+0000","last_became_peered":"2024-04-26T11:27:12.090926+0000","last_unstale":"2024-04-26T11:29:03.825429+0000","last_undegraded":"2024-04-26T11:29:03.825429+0000","last_fullsized":"2024-04-26T11:29:03.825429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:43.005527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.594512+0000","last_change":"2024-04-26T11:27:12.091297+0000","last_active":"2024-04-26T11:29:03.594512+0000","last_peered":"2024-04-26T11:29:03.594512+0000","last_clean":"2024-04-26T11:29:03.594512+0000","last_became_active":"2024-04-26T11:27:12.090946+0000","last_became_peered":"2024-04-26T11:27:12.090946+0000","last_unstale":"2024-04-26T11:29:03.594512+0000","last_undegraded":"2024-04-26T11:29:03.594512+0000","last_fullsized":"2024-04-26T11:29:03.594512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:06.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.813909+0000","last_change":"2024-04-26T11:28:03.445596+0000","last_active":"2024-04-26T11:29:03.813909+0000","last_peered":"2024-04-26T11:29:03.813909+0000","last_clean":"2024-04-26T11:29:03.813909+0000","last_became_active":"2024-04-26T11:28:03.443717+0000","last_became_peered":"2024-04-26T11:28:03.443717+0000","last_unstale":"2024-04-26T11:29:03.813909+0000","last_undegraded":"2024-04-26T11:29:03.813909+0000","last_fullsized":"2024-04-26T11:29:03.813909+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:44.905902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825884+0000","last_change":"2024-04-26T11:27:12.107987+0000","last_active":"2024-04-26T11:29:03.825884+0000","last_peered":"2024-04-26T11:29:03.825884+0000","last_clean":"2024-04-26T11:29:03.825884+0000","last_became_active":"2024-04-26T11:27:12.107668+0000","last_became_peered":"2024-04-26T11:27:12.107668+0000","last_unstale":"2024-04-26T11:29:03.825884+0000","last_undegraded":"2024-04-26T11:29:03.825884+0000","last_fullsized":"2024-04-26T11:29:03.825884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:06.448570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.812233+0000","last_change":"2024-04-26T11:27:12.105596+0000","last_active":"2024-04-26T11:29:03.812233+0000","last_peered":"2024-04-26T11:29:03.812233+0000","last_clean":"2024-04-26T11:29:03.812233+0000","last_became_active":"2024-04-26T11:27:12.104996+0000","last_became_peered":"2024-04-26T11:27:12.104996+0000","last_unstale":"2024-04-26T11:29:03.812233+0000","last_undegraded":"2024-04-26T11:29:03.812233+0000","last_fullsized":"2024-04-26T11:29:03.812233+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:11.947364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.691410+0000","last_change":"2024-04-26T11:27:12.116095+0000","last_active":"2024-04-26T11:29:03.691410+0000","last_peered":"2024-04-26T11:29:03.691410+0000","last_clean":"2024-04-26T11:29:03.691410+0000","last_became_active":"2024-04-26T11:27:12.115726+0000","last_became_peered":"2024-04-26T11:27:12.115726+0000","last_unstale":"2024-04-26T11:29:03.691410+0000","last_undegraded":"2024-04-26T11:29:03.691410+0000","last_fullsized":"2024-04-26T11:29:03.691410+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:45.056829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.592063+0000","last_change":"2024-04-26T11:27:12.115016+0000","last_active":"2024-04-26T11:29:03.592063+0000","last_peered":"2024-04-26T11:29:03.592063+0000","last_clean":"2024-04-26T11:29:03.592063+0000","last_became_active":"2024-04-26T11:27:12.114671+0000","last_became_peered":"2024-04-26T11:27:12.114671+0000","last_unstale":"2024-04-26T11:29:03.592063+0000","last_undegraded":"2024-04-26T11:29:03.592063+0000","last_fullsized":"2024-04-26T11:29:03.592063+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:11.393056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:29:03.825303+0000","last_change":"2024-04-26T11:27:12.097130+0000","last_active":"2024-04-26T11:29:03.825303+0000","last_peered":"2024-04-26T11:29:03.825303+0000","last_clean":"2024-04-26T11:29:03.825303+0000","last_became_active":"2024-04-26T11:27:12.096809+0000","last_became_peered":"2024-04-26T11:27:12.096809+0000","last_unstale":"2024-04-26T11:29:03.825303+0000","last_undegraded":"2024-04-26T11:29:03.825303+0000","last_fullsized":"2024-04-26T11:29:03.825303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:31.198452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":3542208,"data_compressed":213698,"data_compressed_allocated":270336,"data_compressed_original":3506176,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66141,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":757,"num_read_kb":460,"num_write":173,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1316,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":198423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351023,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":501054,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612660,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32320,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712832,"statfs":{"total":95995035648,"available":95961939968,"internally_reserved":0,"allocated":1163264,"data_stored":1154444,"data_compressed":47749,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776186,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1028096,"data_stored":500668,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037824,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":500006,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299461,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":1092659,"data_compressed":47749,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462988,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":500057,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1081344,"data_stored":562431,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":501328,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1093632,"data_stored":563087,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149787,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":500368,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888152,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":501138,"data_compressed":11586,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724626,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":1091189,"data_compressed":47749,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34523,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34523,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:29:43.783 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T11:29:43.783 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T11:29:43.783 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-26T11:29:43.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-26T11:29:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:43 smithi193 ceph-mon[32782]: pgmap v403: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:43.894 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:43 smithi110 ceph-mon[28069]: pgmap v403: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:43 smithi196 ceph-mon[32572]: pgmap v403: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:44.269 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:44.748 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:44 smithi110 ceph-mon[28069]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:29:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:44 smithi193 ceph-mon[32782]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:29:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:44 smithi196 ceph-mon[32572]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:29:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:45 smithi193 ceph-mon[32782]: pgmap v404: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:45 smithi196 ceph-mon[32572]: pgmap v404: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:45 smithi110 ceph-mon[28069]: pgmap v404: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:46.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.588+0000 7ff8f0200700 1 -- 172.21.15.110:0/3815781761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e810a410 msgr2=0x7ff8e8116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:46.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.588+0000 7ff8f0200700 1 --2- 172.21.15.110:0/3815781761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e810a410 0x7ff8e8116920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000b0a0 tx=0x7ff8e000b3b0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.588+0000 7ff8f0200700 1 -- 172.21.15.110:0/3815781761 shutdown_connections 2024-04-26T11:29:46.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.588+0000 7ff8f0200700 1 --2- 172.21.15.110:0/3815781761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e810a410 0x7ff8e8116920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.588+0000 7ff8f0200700 1 --2- 172.21.15.110:0/3815781761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8e810fa50 0x7ff8e810fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.588+0000 7ff8f0200700 1 --2- 172.21.15.110:0/3815781761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8e8109a50 0x7ff8e8109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.588+0000 7ff8f0200700 1 -- 172.21.15.110:0/3815781761 >> 172.21.15.110:0/3815781761 conn(0x7ff8e8076bf0 msgr2=0x7ff8e8079010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:46.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.588+0000 7ff8f0200700 1 -- 172.21.15.110:0/3815781761 shutdown_connections 2024-04-26T11:29:46.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.588+0000 7ff8f0200700 1 -- 172.21.15.110:0/3815781761 wait complete. 2024-04-26T11:29:46.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.589+0000 7ff8f0200700 1 Processor -- start 2024-04-26T11:29:46.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.590+0000 7ff8f0200700 1 -- start start 2024-04-26T11:29:46.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.590+0000 7ff8f0200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8109a50 0x7ff8e81a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:46.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.590+0000 7ff8f0200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8e810a410 0x7ff8e81a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:46.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.590+0000 7ff8f0200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8e810fa50 0x7ff8e81a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:46.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.590+0000 7ff8f0200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8119c90 con 0x7ff8e810fa50 2024-04-26T11:29:46.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.590+0000 7ff8f0200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8119b10 con 0x7ff8e8109a50 2024-04-26T11:29:46.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.590+0000 7ff8f0200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8119e10 con 0x7ff8e810a410 2024-04-26T11:29:46.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ee200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8e810fa50 0x7ff8e81a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:46.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ed800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8109a50 0x7ff8e81a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:46.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ece00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8e810a410 0x7ff8e81a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:46.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ee200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8e810fa50 0x7ff8e81a49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40560/0 (socket says 172.21.15.110:40560) 2024-04-26T11:29:46.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ee200700 1 -- 172.21.15.110:0/1984092327 learned_addr learned my addr 172.21.15.110:0/1984092327 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ee200700 1 -- 172.21.15.110:0/1984092327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8e810a410 msgr2=0x7ff8e81a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ee200700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8e810a410 0x7ff8e81a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ee200700 1 -- 172.21.15.110:0/1984092327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8109a50 msgr2=0x7ff8e81a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ee200700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8109a50 0x7ff8e81a00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ee200700 1 -- 172.21.15.110:0/1984092327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e81a50f0 con 0x7ff8e810fa50 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ece00700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8e810a410 0x7ff8e81a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.591+0000 7ff8ee200700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8e810fa50 0x7ff8e81a49b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000b070 tx=0x7ff8e0009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.592+0000 7ff8e6000700 1 -- 172.21.15.110:0/1984092327 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0021070 con 0x7ff8e810fa50 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.592+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e81a5380 con 0x7ff8e810fa50 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.592+0000 7ff8e6000700 1 -- 172.21.15.110:0/1984092327 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8e0004e40 con 0x7ff8e810fa50 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.592+0000 7ff8e6000700 1 -- 172.21.15.110:0/1984092327 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0004630 con 0x7ff8e810fa50 2024-04-26T11:29:46.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.592+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81acc60 con 0x7ff8e810fa50 2024-04-26T11:29:46.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.593+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e806a110 con 0x7ff8e810fa50 2024-04-26T11:29:46.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.595+0000 7ff8e6000700 1 -- 172.21.15.110:0/1984092327 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff8e0007980 con 0x7ff8e810fa50 2024-04-26T11:29:46.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.597+0000 7ff8e6000700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff8d00a3c40 0x7ff8d00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:46.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.598+0000 7ff8e6000700 1 -- 172.21.15.110:0/1984092327 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7ff8e000f020 con 0x7ff8e810fa50 2024-04-26T11:29:46.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.598+0000 7ff8ed800700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff8d00a3c40 0x7ff8d00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:46.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.598+0000 7ff8ed800700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff8d00a3c40 0x7ff8d00a6100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009be0 tx=0x7ff8dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:46.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.602+0000 7ff8e6000700 1 -- 172.21.15.110:0/1984092327 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff8e002a020 con 0x7ff8e810fa50 2024-04-26T11:29:46.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.884+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8e802e490 con 0x7ff8e810fa50 2024-04-26T11:29:46.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.884+0000 7ff8e6000700 1 -- 172.21.15.110:0/1984092327 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff8e00074e0 con 0x7ff8e810fa50 2024-04-26T11:29:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:29:46.886 INFO:teuthology.orchestra.run.smithi110.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T11:29:46.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.887+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff8d00a3c40 msgr2=0x7ff8d00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:46.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.887+0000 7ff8f0200700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff8d00a3c40 0x7ff8d00a6100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009be0 tx=0x7ff8dc009260 comp rx=0 tx=0).stop 2024-04-26T11:29:46.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.887+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8e810fa50 msgr2=0x7ff8e81a49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:46.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.887+0000 7ff8f0200700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8e810fa50 0x7ff8e81a49b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000b070 tx=0x7ff8e0009c90 comp rx=0 tx=0).stop 2024-04-26T11:29:46.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.887+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 shutdown_connections 2024-04-26T11:29:46.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.888+0000 7ff8f0200700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8e810fa50 0x7ff8e81a49b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.888+0000 7ff8f0200700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8e8109a50 0x7ff8e81a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.888+0000 7ff8f0200700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff8d00a3c40 0x7ff8d00a6100 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.888+0000 7ff8f0200700 1 --2- 172.21.15.110:0/1984092327 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8e810a410 0x7ff8e81a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:46.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.888+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 >> 172.21.15.110:0/1984092327 conn(0x7ff8e8076bf0 msgr2=0x7ff8e8077130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:46.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.888+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 shutdown_connections 2024-04-26T11:29:46.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:46.888+0000 7ff8f0200700 1 -- 172.21.15.110:0/1984092327 wait complete. 2024-04-26T11:29:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:47 smithi193 ceph-mon[32782]: pgmap v405: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:47 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1984092327' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T11:29:47.880 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:47 smithi110 ceph-mon[28069]: pgmap v405: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:47.880 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:47 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1984092327' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T11:29:47.884 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-26T11:29:47.884 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:29:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:47 smithi196 ceph-mon[32572]: pgmap v405: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:47 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1984092327' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T11:29:48.334 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:49 smithi110 ceph-mon[28069]: pgmap v406: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:49 smithi193 ceph-mon[32782]: pgmap v406: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:49 smithi196 ceph-mon[32572]: pgmap v406: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.777+0000 7f37c4800700 1 -- 172.21.15.110:0/1368289077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06bb60 msgr2=0x7f37bc06bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.777+0000 7f37c4800700 1 --2- 172.21.15.110:0/1368289077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06bb60 0x7f37bc06bfe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0099c0 tx=0x7f37ac009cd0 comp rx=0 tx=0).stop 2024-04-26T11:29:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.777+0000 7f37c4800700 1 -- 172.21.15.110:0/1368289077 shutdown_connections 2024-04-26T11:29:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.777+0000 7f37c4800700 1 --2- 172.21.15.110:0/1368289077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37bc06c520 0x7f37bc1102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.777+0000 7f37c4800700 1 --2- 172.21.15.110:0/1368289077 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37bc109490 0x7f37bc109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.777+0000 7f37c4800700 1 --2- 172.21.15.110:0/1368289077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06bb60 0x7f37bc06bfe0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.777+0000 7f37c4800700 1 -- 172.21.15.110:0/1368289077 >> 172.21.15.110:0/1368289077 conn(0x7f37bc078390 msgr2=0x7f37bc0787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.777+0000 7f37c4800700 1 -- 172.21.15.110:0/1368289077 shutdown_connections 2024-04-26T11:29:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.777+0000 7f37c4800700 1 -- 172.21.15.110:0/1368289077 wait complete. 2024-04-26T11:29:50.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.778+0000 7f37c4800700 1 Processor -- start 2024-04-26T11:29:50.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c4800700 1 -- start start 2024-04-26T11:29:50.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c4800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37bc06bb60 0x7f37bc19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:50.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c4800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06c520 0x7f37bc19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:50.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c4800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37bc109490 0x7f37bc1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c4800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc113640 con 0x7f37bc06c520 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c4800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc1134c0 con 0x7f37bc06bb60 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c4800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc1137c0 con 0x7f37bc109490 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c1400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06c520 0x7f37bc19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c1400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06c520 0x7f37bc19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40570/0 (socket says 172.21.15.110:40570) 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c1400700 1 -- 172.21.15.110:0/3595096536 learned_addr learned my addr 172.21.15.110:0/3595096536 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.779+0000 7f37c1e00700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37bc06bb60 0x7f37bc19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37c2800700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37bc109490 0x7f37bc1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37c1400700 1 -- 172.21.15.110:0/3595096536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37bc109490 msgr2=0x7f37bc1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37c1400700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37bc109490 0x7f37bc1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37c1400700 1 -- 172.21.15.110:0/3595096536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37bc06bb60 msgr2=0x7f37bc19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37c1400700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37bc06bb60 0x7f37bc19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37c1400700 1 -- 172.21.15.110:0/3595096536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc1a0d60 con 0x7f37bc06c520 2024-04-26T11:29:50.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37c1e00700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37bc06bb60 0x7f37bc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:50.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37c1400700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06c520 0x7f37bc19c290 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0098e0 tx=0x7f37ac005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:50.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37b6a00700 1 -- 172.21.15.110:0/3595096536 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac026070 con 0x7f37bc06c520 2024-04-26T11:29:50.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37b6a00700 1 -- 172.21.15.110:0/3595096536 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37ac005680 con 0x7f37bc06c520 2024-04-26T11:29:50.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37bc1a0ff0 con 0x7f37bc06c520 2024-04-26T11:29:50.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.780+0000 7f37b6a00700 1 -- 172.21.15.110:0/3595096536 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00fad0 con 0x7f37bc06c520 2024-04-26T11:29:50.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.781+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37bc1a88d0 con 0x7f37bc06c520 2024-04-26T11:29:50.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.782+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37bc104b80 con 0x7f37bc06c520 2024-04-26T11:29:50.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.784+0000 7f37b6a00700 1 -- 172.21.15.110:0/3595096536 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f37ac029070 con 0x7f37bc06c520 2024-04-26T11:29:50.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.785+0000 7f37b6a00700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37a40a3c40 0x7f37a40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:50.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.785+0000 7f37b6a00700 1 -- 172.21.15.110:0/3595096536 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f37ac0d0d10 con 0x7f37bc06c520 2024-04-26T11:29:50.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.785+0000 7f37c1e00700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37a40a3c40 0x7f37a40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:50.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.786+0000 7f37c1e00700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37a40a3c40 0x7f37a40a6100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009fd0 tx=0x7f37b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:50.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:50.790+0000 7f37b6a00700 1 -- 172.21.15.110:0/3595096536 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f37ac05dff0 con 0x7f37bc06c520 2024-04-26T11:29:51.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.064+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37bc1a8aa0 con 0x7f37bc06c520 2024-04-26T11:29:51.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.066+0000 7f37b6a00700 1 -- 172.21.15.110:0/3595096536 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11889 (secure 0 0 0) 0x7f37ac0d6020 con 0x7f37bc06c520 2024-04-26T11:29:51.067 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:29:51.067 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:27:39.501334+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24502,24518,24487]},"id":1}]} 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.068+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37a40a3c40 msgr2=0x7f37a40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.068+0000 7f37c4800700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37a40a3c40 0x7f37a40a6100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37b0009fd0 tx=0x7f37b0009260 comp rx=0 tx=0).stop 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.068+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06c520 msgr2=0x7f37bc19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.068+0000 7f37c4800700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06c520 0x7f37bc19c290 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0098e0 tx=0x7f37ac005280 comp rx=0 tx=0).stop 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.068+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 shutdown_connections 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.068+0000 7f37c4800700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f37a40a3c40 0x7f37a40a6100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.069+0000 7f37c4800700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37bc109490 0x7f37bc1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.069+0000 7f37c4800700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f37bc06bb60 0x7f37bc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.069+0000 7f37c4800700 1 --2- 172.21.15.110:0/3595096536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37bc06c520 0x7f37bc19c290 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.069+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 >> 172.21.15.110:0/3595096536 conn(0x7f37bc078390 msgr2=0x7f37bc10e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:51.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.069+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 shutdown_connections 2024-04-26T11:29:51.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:51.069+0000 7f37c4800700 1 -- 172.21.15.110:0/3595096536 wait complete. 2024-04-26T11:29:51.071 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-04-26T11:29:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:51 smithi110 ceph-mon[28069]: pgmap v407: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:51 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3595096536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:29:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:51 smithi193 ceph-mon[32782]: pgmap v407: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:51 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3595096536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:29:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:51 smithi196 ceph-mon[32572]: pgmap v407: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:51 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3595096536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:29:52.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:29:52.498 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:53 smithi196 ceph-mon[32572]: pgmap v408: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:53 smithi110 ceph-mon[28069]: pgmap v408: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:53 smithi193 ceph-mon[32782]: pgmap v408: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:54.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.961+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2531441388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d0075650 msgr2=0x7fa4d0075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:54.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.961+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2531441388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d0075650 0x7fa4d0075a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009990 tx=0x7fa4c0009ca0 comp rx=0 tx=0).stop 2024-04-26T11:29:54.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.961+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2531441388 shutdown_connections 2024-04-26T11:29:54.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.961+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2531441388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4d010fe20 0x7fa4d0112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:54.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.961+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2531441388 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d0075650 0x7fa4d0075a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:54.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.961+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2531441388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4d0075f70 0x7fa4d010f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:54.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.961+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2531441388 >> 172.21.15.110:0/2531441388 conn(0x7fa4d007a580 msgr2=0x7fa4d007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:54.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.961+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2531441388 shutdown_connections 2024-04-26T11:29:54.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.961+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2531441388 wait complete. 2024-04-26T11:29:54.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.962+0000 7fa4d5c00700 1 Processor -- start 2024-04-26T11:29:54.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4d5c00700 1 -- start start 2024-04-26T11:29:54.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4d5c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4d0075650 0x7fa4d019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4d5c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4d0075f70 0x7fa4d019c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4d5c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d010fe20 0x7fa4d01a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4d5c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d0115840 con 0x7fa4d0075650 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4d5c00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d01156c0 con 0x7fa4d0075f70 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4d5c00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d01159c0 con 0x7fa4d010fe20 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4cea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4d0075650 0x7fa4d019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4c6000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4d0075f70 0x7fa4d019c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4c6000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4d0075f70 0x7fa4d019c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:39076/0 (socket says 172.21.15.110:39076) 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4c6000700 1 -- 172.21.15.110:0/2761499863 learned_addr learned my addr 172.21.15.110:0/2761499863 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.963+0000 7fa4cf400700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d010fe20 0x7fa4d01a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4c6000700 1 -- 172.21.15.110:0/2761499863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d010fe20 msgr2=0x7fa4d01a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4c6000700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d010fe20 0x7fa4d01a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:54.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4c6000700 1 -- 172.21.15.110:0/2761499863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4d0075650 msgr2=0x7fa4d019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:54.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4c6000700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4d0075650 0x7fa4d019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:54.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4c6000700 1 -- 172.21.15.110:0/2761499863 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d01a0d20 con 0x7fa4d0075f70 2024-04-26T11:29:54.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4c6000700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4d0075f70 0x7fa4d019c250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800e970 tx=0x7fa4b800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:54.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4c7e00700 1 -- 172.21.15.110:0/2761499863 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8004220 con 0x7fa4d0075f70 2024-04-26T11:29:54.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d01a1010 con 0x7fa4d0075f70 2024-04-26T11:29:54.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4c7e00700 1 -- 172.21.15.110:0/2761499863 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b80043c0 con 0x7fa4d0075f70 2024-04-26T11:29:54.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4c7e00700 1 -- 172.21.15.110:0/2761499863 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8003ce0 con 0x7fa4d0075f70 2024-04-26T11:29:54.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.964+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d01a8890 con 0x7fa4d0075f70 2024-04-26T11:29:54.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.965+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d006a110 con 0x7fa4d0075f70 2024-04-26T11:29:54.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.968+0000 7fa4c7e00700 1 -- 172.21.15.110:0/2761499863 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa4b800c7e0 con 0x7fa4d0075f70 2024-04-26T11:29:54.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.969+0000 7fa4c7e00700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa4b40a3c40 0x7fa4b40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:54.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.969+0000 7fa4c7e00700 1 -- 172.21.15.110:0/2761499863 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fa4b80d08e0 con 0x7fa4d0075f70 2024-04-26T11:29:54.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.969+0000 7fa4cea00700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa4b40a3c40 0x7fa4b40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:54.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.970+0000 7fa4cea00700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa4b40a3c40 0x7fa4b40a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0006010 tx=0x7fa4c000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:54.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:54.972+0000 7fa4c7e00700 1 -- 172.21.15.110:0/2761499863 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa4b809d1c0 con 0x7fa4d0075f70 2024-04-26T11:29:55.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.249+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4d002e490 con 0x7fa4d0075f70 2024-04-26T11:29:55.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.250+0000 7fa4c7e00700 1 -- 172.21.15.110:0/2761499863 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11889 (secure 0 0 0) 0x7fa4b809cac0 con 0x7fa4d0075f70 2024-04-26T11:29:55.252 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:29:55.252 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:27:39.501334+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24502,24518,24487]},"id":1}]} 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa4b40a3c40 msgr2=0x7fa4b40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa4b40a3c40 0x7fa4b40a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0006010 tx=0x7fa4c000b260 comp rx=0 tx=0).stop 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4d0075f70 msgr2=0x7fa4d019c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4d0075f70 0x7fa4d019c250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800e970 tx=0x7fa4b800ec80 comp rx=0 tx=0).stop 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 shutdown_connections 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa4b40a3c40 0x7fa4b40a6100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa4d010fe20 0x7fa4d01a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4d0075650 0x7fa4d019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 --2- 172.21.15.110:0/2761499863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4d0075f70 0x7fa4d019c250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.253+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 >> 172.21.15.110:0/2761499863 conn(0x7fa4d007a580 msgr2=0x7fa4d0100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.254+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 shutdown_connections 2024-04-26T11:29:55.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:55.254+0000 7fa4d5c00700 1 -- 172.21.15.110:0/2761499863 wait complete. 2024-04-26T11:29:55.256 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-04-26T11:29:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:55 smithi196 ceph-mon[32572]: pgmap v409: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:55 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2761499863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:29:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:55 smithi110 ceph-mon[28069]: pgmap v409: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:55 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2761499863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:29:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:55 smithi193 ceph-mon[32782]: pgmap v409: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:29:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:55 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2761499863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:29:56.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T11:29:56.553 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:29:57.928 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:57 smithi110 ceph-mon[28069]: pgmap v410: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:57 smithi196 ceph-mon[32572]: pgmap v410: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:57 smithi193 ceph-mon[32782]: pgmap v410: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:29:59.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.056+0000 7f3d21400700 1 -- 172.21.15.110:0/3765974683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d1c10a410 msgr2=0x7f3d1c116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:59.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.056+0000 7f3d21400700 1 --2- 172.21.15.110:0/3765974683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d1c10a410 0x7f3d1c116920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400b0a0 tx=0x7f3d1400b3b0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.056+0000 7f3d21400700 1 -- 172.21.15.110:0/3765974683 shutdown_connections 2024-04-26T11:29:59.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.056+0000 7f3d21400700 1 --2- 172.21.15.110:0/3765974683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d1c10a410 0x7f3d1c116920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.056+0000 7f3d21400700 1 --2- 172.21.15.110:0/3765974683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d1c10fa50 0x7f3d1c10fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.056+0000 7f3d21400700 1 --2- 172.21.15.110:0/3765974683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d1c109a50 0x7f3d1c109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.056+0000 7f3d21400700 1 -- 172.21.15.110:0/3765974683 >> 172.21.15.110:0/3765974683 conn(0x7f3d1c076bf0 msgr2=0x7f3d1c108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:59.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.056+0000 7f3d21400700 1 -- 172.21.15.110:0/3765974683 shutdown_connections 2024-04-26T11:29:59.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.056+0000 7f3d21400700 1 -- 172.21.15.110:0/3765974683 wait complete. 2024-04-26T11:29:59.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.057+0000 7f3d21400700 1 Processor -- start 2024-04-26T11:29:59.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.057+0000 7f3d21400700 1 -- start start 2024-04-26T11:29:59.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d21400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d1c109a50 0x7f3d1c1a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:59.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d21400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d1c10a410 0x7f3d1c1a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:59.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d21400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d1c10fa50 0x7f3d1c1a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d21400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c119c90 con 0x7f3d1c109a50 2024-04-26T11:29:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d21400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c119b10 con 0x7f3d1c10fa50 2024-04-26T11:29:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d21400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c119e10 con 0x7f3d1c10a410 2024-04-26T11:29:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d1a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d1c109a50 0x7f3d1c1a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d19e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d1c10a410 0x7f3d1c1a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d1a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d1c109a50 0x7f3d1c1a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36748/0 (socket says 172.21.15.110:36748) 2024-04-26T11:29:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d1a800700 1 -- 172.21.15.110:0/151764086 learned_addr learned my addr 172.21.15.110:0/151764086 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:29:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d1b200700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d1c10fa50 0x7f3d1c1a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:59.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d19e00700 1 -- 172.21.15.110:0/151764086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d1c10fa50 msgr2=0x7f3d1c1a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d19e00700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d1c10fa50 0x7f3d1c1a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d19e00700 1 -- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d1c109a50 msgr2=0x7f3d1c1a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d19e00700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d1c109a50 0x7f3d1c1a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d19e00700 1 -- 172.21.15.110:0/151764086 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c1a50e0 con 0x7f3d1c10a410 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.058+0000 7f3d1a800700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d1c109a50 0x7f3d1c1a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.059+0000 7f3d19e00700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d1c10a410 0x7f3d1c1a0660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800e9f0 tx=0x7f3d0800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.059+0000 7f3d13400700 1 -- 172.21.15.110:0/151764086 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800c9c0 con 0x7f3d1c10a410 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.059+0000 7f3d13400700 1 -- 172.21.15.110:0/151764086 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d0800cb60 con 0x7f3d1c10a410 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.059+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1c1a53d0 con 0x7f3d1c10a410 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.059+0000 7f3d13400700 1 -- 172.21.15.110:0/151764086 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08018680 con 0x7f3d1c10a410 2024-04-26T11:29:59.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.059+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1c1acc50 con 0x7f3d1c10a410 2024-04-26T11:29:59.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.060+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d1c06a110 con 0x7f3d1c10a410 2024-04-26T11:29:59.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.063+0000 7f3d13400700 1 -- 172.21.15.110:0/151764086 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3d08010430 con 0x7f3d1c10a410 2024-04-26T11:29:59.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.064+0000 7f3d13400700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d000a3c40 0x7f3d000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:29:59.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.065+0000 7f3d13400700 1 -- 172.21.15.110:0/151764086 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f3d080d0780 con 0x7f3d1c10a410 2024-04-26T11:29:59.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.065+0000 7f3d1a800700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d000a3c40 0x7f3d000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:29:59.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.065+0000 7f3d1a800700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d000a3c40 0x7f3d000a6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c011550 tx=0x7f3d0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:29:59.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.066+0000 7f3d13400700 1 -- 172.21.15.110:0/151764086 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3d0809d060 con 0x7f3d1c10a410 2024-04-26T11:29:59.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.293+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d1c02e490 con 0x7f3d1c10a410 2024-04-26T11:29:59.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.296+0000 7f3d13400700 1 -- 172.21.15.110:0/151764086 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+23015 (secure 0 0 0) 0x7f3d0809c960 con 0x7f3d1c10a410 2024-04-26T11:29:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:29:59.298 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":93,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","created":"2024-04-26T11:17:56.437545+0000","modified":"2024-04-26T11:29:03.588199+0000","last_up_change":"2024-04-26T11:25:57.427695+0000","last_in_change":"2024-04-26T11:25:38.050280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:44.478027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:27:06.034467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T11:27:11.025123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13eb997d-8b4a-47f5-be11-772d47788972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6803","nonce":1662740885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6805","nonce":1662740885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6809","nonce":1662740885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6807","nonce":1662740885}]},"public_addr":"172.21.15.110:6803/1662740885","cluster_addr":"172.21.15.110:6805/1662740885","heartbeat_back_addr":"172.21.15.110:6809/1662740885","heartbeat_front_addr":"172.21.15.110:6807/1662740885","state":["exists","up"]},{"osd":1,"uuid":"e7927dc3-dced-4661-8493-840e111241e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6801","nonce":1751461680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6803","nonce":1751461680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6807","nonce":1751461680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6805","nonce":1751461680}]},"public_addr":"172.21.15.193:6801/1751461680","cluster_addr":"172.21.15.193:6803/1751461680","heartbeat_back_addr":"172.21.15.193:6807/1751461680","heartbeat_front_addr":"172.21.15.193:6805/1751461680","state":["exists","up"]},{"osd":2,"uuid":"54459a80-91a1-45ba-b7e4-900a4a995219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6801","nonce":1785522554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6803","nonce":1785522554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6807","nonce":1785522554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6805","nonce":1785522554}]},"public_addr":"172.21.15.196:6801/1785522554","cluster_addr":"172.21.15.196:6803/1785522554","heartbeat_back_addr":"172.21.15.196:6807/1785522554","heartbeat_front_addr":"172.21.15.196:6805/1785522554","state":["exists","up"]},{"osd":3,"uuid":"12d8a1be-5edb-4af2-b01d-abd943f89641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6811","nonce":2253549266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6813","nonce":2253549266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6817","nonce":2253549266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6815","nonce":2253549266}]},"public_addr":"172.21.15.110:6811/2253549266","cluster_addr":"172.21.15.110:6813/2253549266","heartbeat_back_addr":"172.21.15.110:6817/2253549266","heartbeat_front_addr":"172.21.15.110:6815/2253549266","state":["exists","up"]},{"osd":4,"uuid":"f3057080-144b-4f43-9a63-8f415ca76d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6809","nonce":1314161856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6811","nonce":1314161856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6815","nonce":1314161856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6813","nonce":1314161856}]},"public_addr":"172.21.15.193:6809/1314161856","cluster_addr":"172.21.15.193:6811/1314161856","heartbeat_back_addr":"172.21.15.193:6815/1314161856","heartbeat_front_addr":"172.21.15.193:6813/1314161856","state":["exists","up"]},{"osd":5,"uuid":"f0775b9c-938e-4bb4-ae1e-01ef0686cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6809","nonce":2359280243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6811","nonce":2359280243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6815","nonce":2359280243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6813","nonce":2359280243}]},"public_addr":"172.21.15.196:6809/2359280243","cluster_addr":"172.21.15.196:6811/2359280243","heartbeat_back_addr":"172.21.15.196:6815/2359280243","heartbeat_front_addr":"172.21.15.196:6813/2359280243","state":["exists","up"]},{"osd":6,"uuid":"ea4ea3de-4ec4-48a1-809e-da62fcbb7033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6819","nonce":1730783886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6821","nonce":1730783886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6825","nonce":1730783886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6823","nonce":1730783886}]},"public_addr":"172.21.15.110:6819/1730783886","cluster_addr":"172.21.15.110:6821/1730783886","heartbeat_back_addr":"172.21.15.110:6825/1730783886","heartbeat_front_addr":"172.21.15.110:6823/1730783886","state":["exists","up"]},{"osd":7,"uuid":"98af7071-82b3-4732-b2a1-8676e6439cd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6817","nonce":4124476381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6819","nonce":4124476381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6823","nonce":4124476381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6821","nonce":4124476381}]},"public_addr":"172.21.15.193:6817/4124476381","cluster_addr":"172.21.15.193:6819/4124476381","heartbeat_back_addr":"172.21.15.193:6823/4124476381","heartbeat_front_addr":"172.21.15.193:6821/4124476381","state":["exists","up"]},{"osd":8,"uuid":"7aaa3c52-72f5-4946-a964-609f65b778f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6817","nonce":2942176519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6819","nonce":2942176519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6823","nonce":2942176519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6821","nonce":2942176519}]},"public_addr":"172.21.15.196:6817/2942176519","cluster_addr":"172.21.15.196:6819/2942176519","heartbeat_back_addr":"172.21.15.196:6823/2942176519","heartbeat_front_addr":"172.21.15.196:6821/2942176519","state":["exists","up"]},{"osd":9,"uuid":"2cde3ed2-6acd-48a4-a99d-aa558dd85baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6827","nonce":2620757358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6829","nonce":2620757358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6833","nonce":2620757358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6831","nonce":2620757358}]},"public_addr":"172.21.15.110:6827/2620757358","cluster_addr":"172.21.15.110:6829/2620757358","heartbeat_back_addr":"172.21.15.110:6833/2620757358","heartbeat_front_addr":"172.21.15.110:6831/2620757358","state":["exists","up"]},{"osd":10,"uuid":"3bbaac8f-fe7b-4f0e-a25b-286c3c30926e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6825","nonce":676480728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6827","nonce":676480728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6831","nonce":676480728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6829","nonce":676480728}]},"public_addr":"172.21.15.193:6825/676480728","cluster_addr":"172.21.15.193:6827/676480728","heartbeat_back_addr":"172.21.15.193:6831/676480728","heartbeat_front_addr":"172.21.15.193:6829/676480728","state":["exists","up"]},{"osd":11,"uuid":"e31c248e-1016-4765-bea1-9f31d823ca3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6825","nonce":2802765812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6827","nonce":2802765812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6831","nonce":2802765812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6829","nonce":2802765812}]},"public_addr":"172.21.15.196:6825/2802765812","cluster_addr":"172.21.15.196:6827/2802765812","heartbeat_back_addr":"172.21.15.196:6831/2802765812","heartbeat_front_addr":"172.21.15.196:6829/2802765812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:20:52.046788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:16.893940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:40.861409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:13.272469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:39.214479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:03.529206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:37.413989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:04.145639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:29.162356+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:03.325672+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:30.353695+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:56.267402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3278958945":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6801/4292256031":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3536224934":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2250601964":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/2775667488":"2024-04-27T11:18:29.387925+0000","172.21.15.110:6801/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/337370067":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3594651859":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/4292256031":"2024-04-27T11:19:02.329691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:29:59.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d000a3c40 msgr2=0x7f3d000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:59.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d000a3c40 0x7f3d000a6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c011550 tx=0x7f3d0c009260 comp rx=0 tx=0).stop 2024-04-26T11:29:59.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d1c10a410 msgr2=0x7f3d1c1a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:29:59.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d1c10a410 0x7f3d1c1a0660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800e9f0 tx=0x7f3d0800ed00 comp rx=0 tx=0).stop 2024-04-26T11:29:59.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 shutdown_connections 2024-04-26T11:29:59.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d1c10fa50 0x7f3d1c1a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d1c109a50 0x7f3d1c1a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d000a3c40 0x7f3d000a6100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 --2- 172.21.15.110:0/151764086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d1c10a410 0x7f3d1c1a0660 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:29:59.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 >> 172.21.15.110:0/151764086 conn(0x7f3d1c076bf0 msgr2=0x7f3d1c0771b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:29:59.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.299+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 shutdown_connections 2024-04-26T11:29:59.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:29:59.300+0000 7f3d21400700 1 -- 172.21.15.110:0/151764086 wait complete. 2024-04-26T11:29:59.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:59 smithi110 ceph-mon[28069]: pgmap v411: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:59.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:29:59 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/151764086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:29:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:59 smithi196 ceph-mon[32572]: pgmap v411: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:29:59 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/151764086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:29:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:59 smithi193 ceph-mon[32782]: pgmap v411: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:29:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:29:59 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/151764086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:30:00.271 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:30:00.727 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:00 smithi196 ceph-mon[32572]: overall HEALTH_OK 2024-04-26T11:30:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:00 smithi110 ceph-mon[28069]: overall HEALTH_OK 2024-04-26T11:30:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:00 smithi193 ceph-mon[32782]: overall HEALTH_OK 2024-04-26T11:30:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:01 smithi196 ceph-mon[32572]: pgmap v412: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:01 smithi110 ceph-mon[28069]: pgmap v412: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:01 smithi193 ceph-mon[32782]: pgmap v412: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:02.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.939+0000 7f3d86400700 1 -- 172.21.15.110:0/407664047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d80075650 msgr2=0x7f3d80075a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:02.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.939+0000 7f3d86400700 1 --2- 172.21.15.110:0/407664047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d80075650 0x7f3d80075a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009990 tx=0x7f3d70009ca0 comp rx=0 tx=0).stop 2024-04-26T11:30:02.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.940+0000 7f3d86400700 1 -- 172.21.15.110:0/407664047 shutdown_connections 2024-04-26T11:30:02.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.940+0000 7f3d86400700 1 --2- 172.21.15.110:0/407664047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d8010fe20 0x7f3d80112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:02.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.940+0000 7f3d86400700 1 --2- 172.21.15.110:0/407664047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d80075650 0x7f3d80075a30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:02.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.940+0000 7f3d86400700 1 --2- 172.21.15.110:0/407664047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d80075f70 0x7f3d8010f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:02.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.940+0000 7f3d86400700 1 -- 172.21.15.110:0/407664047 >> 172.21.15.110:0/407664047 conn(0x7f3d8007a580 msgr2=0x7f3d8007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:02.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.940+0000 7f3d86400700 1 -- 172.21.15.110:0/407664047 shutdown_connections 2024-04-26T11:30:02.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.940+0000 7f3d86400700 1 -- 172.21.15.110:0/407664047 wait complete. 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.941+0000 7f3d86400700 1 Processor -- start 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.941+0000 7f3d86400700 1 -- start start 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.941+0000 7f3d86400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d80075650 0x7f3d801a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.941+0000 7f3d86400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d80075f70 0x7f3d801a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.941+0000 7f3d86400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8010fe20 0x7f3d8019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.941+0000 7f3d86400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3d80115850 con 0x7f3d8010fe20 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.941+0000 7f3d86400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801156d0 con 0x7f3d80075650 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.941+0000 7f3d86400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801159d0 con 0x7f3d80075f70 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7f400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d80075650 0x7f3d801a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:02.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7ea00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d80075f70 0x7f3d801a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8010fe20 0x7f3d8019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7f400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d80075650 0x7f3d801a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:47312/0 (socket says 172.21.15.110:47312) 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7ea00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d80075f70 0x7f3d801a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:55246/0 (socket says 172.21.15.110:55246) 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7f400700 1 -- 172.21.15.110:0/2248703654 learned_addr learned my addr 172.21.15.110:0/2248703654 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7fe00700 1 -- 172.21.15.110:0/2248703654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d80075f70 msgr2=0x7f3d801a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7fe00700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d80075f70 0x7f3d801a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7fe00700 1 -- 172.21.15.110:0/2248703654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d80075650 msgr2=0x7f3d801a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7fe00700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d80075650 0x7f3d801a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7fe00700 1 -- 172.21.15.110:0/2248703654 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8019c410 con 0x7f3d8010fe20 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7f400700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d80075650 0x7f3d801a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.942+0000 7f3d7fe00700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8010fe20 0x7f3d8019bb30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d78007f10 tx=0x7f3d7800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.943+0000 7f3d77e00700 1 -- 172.21.15.110:0/2248703654 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78004db0 con 0x7f3d8010fe20 2024-04-26T11:30:02.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.943+0000 7f3d77e00700 1 -- 172.21.15.110:0/2248703654 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d78009e20 con 0x7f3d8010fe20 2024-04-26T11:30:02.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.943+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8019c700 con 0x7f3d8010fe20 2024-04-26T11:30:02.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.943+0000 7f3d77e00700 1 -- 172.21.15.110:0/2248703654 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78015400 con 0x7f3d8010fe20 2024-04-26T11:30:02.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.943+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d801a89e0 con 0x7f3d8010fe20 2024-04-26T11:30:02.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.944+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d80076d40 con 0x7f3d8010fe20 2024-04-26T11:30:02.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.946+0000 7f3d77e00700 1 -- 172.21.15.110:0/2248703654 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3d78005260 con 0x7f3d8010fe20 2024-04-26T11:30:02.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.948+0000 7f3d77e00700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d640a3c40 0x7f3d640a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:02.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.948+0000 7f3d77e00700 1 -- 172.21.15.110:0/2248703654 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f3d780cfde0 con 0x7f3d8010fe20 2024-04-26T11:30:02.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.948+0000 7f3d7f400700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d640a3c40 0x7f3d640a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:02.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.949+0000 7f3d7f400700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d640a3c40 0x7f3d640a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3d70006010 tx=0x7f3d7001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:02.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:02.952+0000 7f3d77e00700 1 -- 172.21.15.110:0/2248703654 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3d78010070 con 0x7f3d8010fe20 2024-04-26T11:30:03.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.223+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d8019cff0 con 0x7f3d8010fe20 2024-04-26T11:30:03.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.225+0000 7f3d77e00700 1 -- 172.21.15.110:0/2248703654 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11889 (secure 0 0 0) 0x7f3d7809c6c0 con 0x7f3d8010fe20 2024-04-26T11:30:03.227 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:30:03.227 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:27:39.501334+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24502,24518,24487]},"id":1}]} 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.228+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d640a3c40 msgr2=0x7f3d640a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.228+0000 7f3d86400700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d640a3c40 0x7f3d640a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3d70006010 tx=0x7f3d7001a040 comp rx=0 tx=0).stop 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.228+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8010fe20 msgr2=0x7f3d8019bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.228+0000 7f3d86400700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8010fe20 0x7f3d8019bb30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d78007f10 tx=0x7f3d7800d3b0 comp rx=0 tx=0).stop 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.229+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 shutdown_connections 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.229+0000 7f3d86400700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8010fe20 0x7f3d8019bb30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.229+0000 7f3d86400700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d80075650 0x7f3d801a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.229+0000 7f3d86400700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f3d640a3c40 0x7f3d640a6100 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.229+0000 7f3d86400700 1 --2- 172.21.15.110:0/2248703654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d80075f70 0x7f3d801a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.229+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 >> 172.21.15.110:0/2248703654 conn(0x7f3d8007a580 msgr2=0x7f3d80100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.229+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 shutdown_connections 2024-04-26T11:30:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:03.229+0000 7f3d86400700 1 -- 172.21.15.110:0/2248703654 wait complete. 2024-04-26T11:30:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-04-26T11:30:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:03 smithi193 ceph-mon[32782]: pgmap v413: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:03 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2248703654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:30:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:03 smithi196 ceph-mon[32572]: pgmap v413: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:03 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2248703654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:30:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:03 smithi110 ceph-mon[28069]: pgmap v413: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:03 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2248703654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:30:04.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T11:27:14.996270+0000', 'modified': '2024-04-26T11:27:39.501334+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24518, 'mds_1': 24502, 'mds_2': 24487}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24467': {'gid': 24467, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6835/2038926783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 2038926783}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 2038926783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6835/1499716677', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 1499716677}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 1499716677}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6837/324089889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 324089889}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 324089889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.196:6837/1521745566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 1521745566}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 1521745566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.196:6839/1849808245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6838', 'nonce': 1849808245}, {'type': 'v1', 'addr': '172.21.15.196:6839', 'nonce': 1849808245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6839/64494456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 64494456}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 64494456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24518, 'qdb_cluster': [24502, 24518, 24487]} 2024-04-26T11:30:04.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-26T11:30:04.224 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell mds.c status 2024-04-26T11:30:04.686 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:05 smithi193 ceph-mon[32782]: pgmap v414: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:05.873 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:05 smithi110 ceph-mon[28069]: pgmap v414: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:05 smithi196 ceph-mon[32572]: pgmap v414: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.012+0000 7f1a6f200700 1 -- 172.21.15.110:0/2675900269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a68075fb0 msgr2=0x7f1a681140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.013+0000 7f1a6f200700 1 --2- 172.21.15.110:0/2675900269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a68075fb0 0x7f1a681140b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009990 tx=0x7f1a54009ca0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.013+0000 7f1a6f200700 1 -- 172.21.15.110:0/2675900269 shutdown_connections 2024-04-26T11:30:07.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.013+0000 7f1a6f200700 1 --2- 172.21.15.110:0/2675900269 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a681145f0 0x7f1a681169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.013+0000 7f1a6f200700 1 --2- 172.21.15.110:0/2675900269 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a68075690 0x7f1a68075a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.013+0000 7f1a6f200700 1 --2- 172.21.15.110:0/2675900269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a68075fb0 0x7f1a681140b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.013+0000 7f1a6f200700 1 -- 172.21.15.110:0/2675900269 >> 172.21.15.110:0/2675900269 conn(0x7f1a6807a610 msgr2=0x7f1a6807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:07.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.013+0000 7f1a6f200700 1 -- 172.21.15.110:0/2675900269 shutdown_connections 2024-04-26T11:30:07.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.013+0000 7f1a6f200700 1 -- 172.21.15.110:0/2675900269 wait complete. 2024-04-26T11:30:07.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.014+0000 7f1a6f200700 1 Processor -- start 2024-04-26T11:30:07.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.014+0000 7f1a6f200700 1 -- start start 2024-04-26T11:30:07.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a6f200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a68075690 0x7f1a681a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a6f200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a68075fb0 0x7f1a681a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a6f200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a681145f0 0x7f1a681a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a6f200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68119c80 con 0x7f1a68075690 2024-04-26T11:30:07.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a6f200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68119b00 con 0x7f1a681145f0 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a6f200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68119e00 con 0x7f1a68075fb0 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a67e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a68075690 0x7f1a681a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a67400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a68075fb0 0x7f1a681a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a67e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a68075690 0x7f1a681a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47738/0 (socket says 172.21.15.110:47738) 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a67400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a68075fb0 0x7f1a681a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:55268/0 (socket says 172.21.15.110:55268) 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a67e00700 1 -- 172.21.15.110:0/1353524226 learned_addr learned my addr 172.21.15.110:0/1353524226 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.015+0000 7f1a6d200700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a681145f0 0x7f1a681a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a67400700 1 -- 172.21.15.110:0/1353524226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a681145f0 msgr2=0x7f1a681a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a67400700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a681145f0 0x7f1a681a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a67400700 1 -- 172.21.15.110:0/1353524226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a68075690 msgr2=0x7f1a681a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a67400700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a68075690 0x7f1a681a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a67400700 1 -- 172.21.15.110:0/1353524226 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a681a51e0 con 0x7f1a68075fb0 2024-04-26T11:30:07.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a67400700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a68075fb0 0x7f1a681a0710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a54006010 tx=0x7f1a540057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:07.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a64c00700 1 -- 172.21.15.110:0/1353524226 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54027070 con 0x7f1a68075fb0 2024-04-26T11:30:07.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a64c00700 1 -- 172.21.15.110:0/1353524226 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a54022470 con 0x7f1a68075fb0 2024-04-26T11:30:07.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a6f200700 1 -- 172.21.15.110:0/1353524226 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a681a5470 con 0x7f1a68075fb0 2024-04-26T11:30:07.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a64c00700 1 -- 172.21.15.110:0/1353524226 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54017650 con 0x7f1a68075fb0 2024-04-26T11:30:07.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.016+0000 7f1a6f200700 1 -- 172.21.15.110:0/1353524226 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a681acd50 con 0x7f1a68075fb0 2024-04-26T11:30:07.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.020+0000 7f1a64c00700 1 -- 172.21.15.110:0/1353524226 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f1a5402a070 con 0x7f1a68075fb0 2024-04-26T11:30:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.021+0000 7f1a79c56b80 1 Processor -- start 2024-04-26T11:30:07.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.021+0000 7f1a79c56b80 1 -- start start 2024-04-26T11:30:07.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a554790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a554cd0 0x560f3a54fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 0x560f3a5504c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560f3a4a2840 con 0x560f3a550080 2024-04-26T11:30:07.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560f3a441160 con 0x560f3a554cd0 2024-04-26T11:30:07.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560f3a49e800 con 0x560f3a5543b0 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a64c00700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1a4c0a3c40 0x7f1a4c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a6d200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a554790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a67400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 0x560f3a5504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a6d200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a554790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:55278/0 (socket says 172.21.15.110:55278) 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a6d200700 1 -- 172.21.15.110:0/2940591060 learned_addr learned my addr 172.21.15.110:0/2940591060 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a67e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a554cd0 0x560f3a54fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a64c00700 1 -- 172.21.15.110:0/1353524226 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f1a540d1180 con 0x7f1a68075fb0 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a67e00700 1 -- 172.21.15.110:0/2940591060 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 msgr2=0x560f3a554790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a67e00700 1 --2- 172.21.15.110:0/2940591060 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a554790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a6d200700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1a4c0a3c40 0x7f1a4c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a67e00700 1 -- 172.21.15.110:0/2940591060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 msgr2=0x560f3a5504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:07.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a67e00700 1 --2- 172.21.15.110:0/2940591060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 0x560f3a5504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a67e00700 1 -- 172.21.15.110:0/2940591060 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f3a4495e0 con 0x560f3a554cd0 2024-04-26T11:30:07.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.022+0000 7f1a67400700 1 --2- 172.21.15.110:0/2940591060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 0x560f3a5504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:30:07.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.023+0000 7f1a67e00700 1 --2- 172.21.15.110:0/2940591060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a554cd0 0x560f3a54fb40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009d80 tx=0x7f1a58011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19e961bc6a7a1238 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.023+0000 7f1a5d600700 1 -- 172.21.15.110:0/2940591060 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58004a30 con 0x560f3a554cd0 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.023+0000 7f1a5d600700 1 -- 172.21.15.110:0/2940591060 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a580054d0 con 0x560f3a554cd0 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.023+0000 7f1a5d600700 1 -- 172.21.15.110:0/2940591060 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58019830 con 0x560f3a554cd0 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2940591060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a554cd0 msgr2=0x560f3a54fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a6d200700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1a4c0a3c40 0x7f1a4c0a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009710 tx=0x7f1a60004b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2940591060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a554cd0 0x560f3a54fb40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009d80 tx=0x7f1a58011720 comp rx=0 tx=0).stop 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2940591060 shutdown_connections 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2940591060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 0x560f3a5504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2940591060 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a554790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2940591060 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a554cd0 0x560f3a54fb40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2940591060 >> 172.21.15.110:0/2940591060 conn(0x560f3a47d2a0 msgr2=0x560f3a54a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:07.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2940591060 shutdown_connections 2024-04-26T11:30:07.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.024+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2940591060 wait complete. 2024-04-26T11:30:07.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.025+0000 7f1a79c56b80 1 -- start start 2024-04-26T11:30:07.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.025+0000 7f1a79c56b80 1 Processor -- start 2024-04-26T11:30:07.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.025+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 0x560f3a55bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.025+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a5543b0 0x560f3a558db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.025+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a554cd0 0x560f3a5592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.025+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560f3a55c810 con 0x560f3a550080 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.025+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560f3a43d3b0 con 0x560f3a5543b0 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.025+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560f3a55c990 con 0x560f3a554cd0 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a79c56b80 10 client.0 _ll_register_callbacks cb 0x560f3a436330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a6d200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a554cd0 0x560f3a5592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a6d200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a554cd0 0x560f3a5592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:55284/0 (socket says 172.21.15.110:55284) 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a6d200700 1 -- 172.21.15.110:0/2987155734 learned_addr learned my addr 172.21.15.110:0/2987155734 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a67400700 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a5543b0 0x560f3a558db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a67e00700 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 0x560f3a55bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a6d200700 1 -- 172.21.15.110:0/2987155734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a5543b0 msgr2=0x560f3a558db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a6d200700 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a5543b0 0x560f3a558db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a6d200700 1 -- 172.21.15.110:0/2987155734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 msgr2=0x560f3a55bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a6d200700 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 0x560f3a55bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a6d200700 1 -- 172.21.15.110:0/2987155734 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f3a3ef880 con 0x560f3a554cd0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.026+0000 7f1a67400700 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a5543b0 0x560f3a558db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.027+0000 7f1a6d200700 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a554cd0 0x560f3a5592f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a60004a60 tx=0x7f1a60004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ef1248d57806f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.027+0000 7f1a52000700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.027+0000 7f1a52000700 1 -- 172.21.15.110:0/2987155734 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6002a060 con 0x560f3a554cd0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.027+0000 7f1a52000700 1 -- 172.21.15.110:0/2987155734 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f1a60025400 con 0x560f3a554cd0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.027+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2987155734 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a580054d0 con 0x560f3a554cd0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.027+0000 7f1a52000700 1 -- 172.21.15.110:0/2987155734 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a60025600 con 0x560f3a554cd0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.027+0000 7f1a79c56b80 10 client.24874 fetch_fsmap learned FSMap version 25 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.027+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2987155734 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560f3a567100 con 0x560f3a554cd0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.028+0000 7f1a52000700 1 -- 172.21.15.110:0/2987155734 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a580054d0 con 0x560f3a554cd0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.028+0000 7f1a52000700 1 -- 172.21.15.110:0/2987155734 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f1a60018040 con 0x560f3a554cd0 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.028+0000 7f1a79c56b80 10 client.24874 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:30:07.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.028+0000 7f1a79c56b80 10 client.24874 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.028+0000 7f1a79c56b80 20 client.24874 populate_metadata read hostname 'smithi110' 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.028+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x560f3a569740 0x560f3a56abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.028+0000 7f1a79c56b80 4 client.24874 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.028+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2987155734 --> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f3a4b0220 con 0x560f3a569740 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.029+0000 7f1a67e00700 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x560f3a569740 0x560f3a56abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.029+0000 7f1a67e00700 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x560f3a569740 0x560f3a56abb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=162e0d297a0c62e6 server_cookie=205827b6f5ce82ba in_seq=0 out_seq=0 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.029+0000 7f1a52000700 10 client.24874 ms_handle_connect on v2:172.21.15.196:6836/1521745566 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a52000700 1 -- 172.21.15.110:0/2987155734 <== mds.2 v2:172.21.15.196:6836/1521745566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560f3a4b0220 con 0x560f3a569740 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a52000700 10 client.24874 handle_command_reply: tid=0 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 client.24874 shutdown 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2987155734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a554cd0 msgr2=0x560f3a5592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a554cd0 0x560f3a5592f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1a60004a60 tx=0x7f1a60004ad0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2987155734 shutdown_connections 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a554cd0 0x560f3a5592f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x560f3a569740 0x560f3a56abb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a550080 0x560f3a55bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2987155734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a5543b0 0x560f3a558db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2987155734 >> 172.21.15.110:0/2987155734 conn(0x560f3a47d2a0 msgr2=0x560f3a544e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:07.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a52000700 0 client.24874 ms_handle_reset on v2:172.21.15.196:6836/1521745566 2024-04-26T11:30:07.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.030+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2987155734 shutdown_connections 2024-04-26T11:30:07.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.031+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2987155734 wait complete. 2024-04-26T11:30:07.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.031+0000 7f1a79c56b80 20 client.24874 trim_cache size 0 max 16384 2024-04-26T11:30:07.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.052+0000 7f1a79c56b80 1 Processor -- start 2024-04-26T11:30:07.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a79c56b80 1 -- start start 2024-04-26T11:30:07.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 0x560f3a5685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a54db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a54e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560f3a568ef0 con 0x560f3a554cd0 2024-04-26T11:30:07.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560f3a5695c0 con 0x560f3a550080 2024-04-26T11:30:07.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560f3a569c90 con 0x560f3a5543b0 2024-04-26T11:30:07.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a6d200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a54e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a6d200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a54e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47772/0 (socket says 172.21.15.110:47772) 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a6d200700 1 -- 172.21.15.110:0/2796408195 learned_addr learned my addr 172.21.15.110:0/2796408195 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a67e00700 1 --2- 172.21.15.110:0/2796408195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 0x560f3a5685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.053+0000 7f1a67400700 1 --2- 172.21.15.110:0/2796408195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a54db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.054+0000 7f1a67400700 1 -- 172.21.15.110:0/2796408195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 msgr2=0x560f3a5685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.054+0000 7f1a67400700 1 --2- 172.21.15.110:0/2796408195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 0x560f3a5685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.054+0000 7f1a67400700 1 -- 172.21.15.110:0/2796408195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 msgr2=0x560f3a54e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.054+0000 7f1a67400700 1 --2- 172.21.15.110:0/2796408195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a54e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.054+0000 7f1a67400700 1 -- 172.21.15.110:0/2796408195 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f3a54b390 con 0x560f3a5543b0 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.054+0000 7f1a67400700 1 --2- 172.21.15.110:0/2796408195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a54db30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a5409d0f0 tx=0x7f1a54009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1fd8c6cf229c665 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.054+0000 7f1a5cc00700 1 -- 172.21.15.110:0/2796408195 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5409cd50 con 0x560f3a5543b0 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.054+0000 7f1a5cc00700 1 -- 172.21.15.110:0/2796408195 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a540b1070 con 0x560f3a5543b0 2024-04-26T11:30:07.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.054+0000 7f1a5cc00700 1 -- 172.21.15.110:0/2796408195 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5409d650 con 0x560f3a5543b0 2024-04-26T11:30:07.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.055+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2796408195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 msgr2=0x560f3a54db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:07.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.055+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2796408195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a54db30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a5409d0f0 tx=0x7f1a54009ca0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.055+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2796408195 shutdown_connections 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.055+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2796408195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a54e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.055+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2796408195 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 0x560f3a5685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.055+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/2796408195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a54db30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.055+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2796408195 >> 172.21.15.110:0/2796408195 conn(0x560f3a47d2a0 msgr2=0x560f3a5538a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.055+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2796408195 shutdown_connections 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.055+0000 7f1a79c56b80 1 -- 172.21.15.110:0/2796408195 wait complete. 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.056+0000 7f1a79c56b80 1 -- start start 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.056+0000 7f1a79c56b80 1 Processor -- start 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.056+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 0x560f3a5554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.056+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a5559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.056+0000 7f1a79c56b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a573020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.056+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560f3a56aa30 con 0x560f3a554cd0 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560f3a56a360 con 0x560f3a550080 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a79c56b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560f3a56b100 con 0x560f3a5543b0 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a79c56b80 10 client.0 _ll_register_callbacks cb 0x560f3a436330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a5559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a6d200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a573020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a5559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:55304/0 (socket says 172.21.15.110:55304) 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 0x560f3a5554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67400700 1 -- 172.21.15.110:0/3517952681 learned_addr learned my addr 172.21.15.110:0/3517952681 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67400700 1 -- 172.21.15.110:0/3517952681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 msgr2=0x560f3a5554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67400700 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 0x560f3a5554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67400700 1 -- 172.21.15.110:0/3517952681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 msgr2=0x560f3a573020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67400700 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a573020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67400700 1 -- 172.21.15.110:0/3517952681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f3a573560 con 0x560f3a5543b0 2024-04-26T11:30:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a6d200700 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a573020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a67400700 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a5559f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a54099850 tx=0x7f1a5409da10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9757b59da283e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.057+0000 7f1a52000700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.058+0000 7f1a52000700 1 -- 172.21.15.110:0/3517952681 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a540a5d40 con 0x560f3a5543b0 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.058+0000 7f1a52000700 1 -- 172.21.15.110:0/3517952681 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f1a540d3110 con 0x560f3a5543b0 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.058+0000 7f1a79c56b80 1 -- 172.21.15.110:0/3517952681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a540b1070 con 0x560f3a5543b0 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.058+0000 7f1a52000700 1 -- 172.21.15.110:0/3517952681 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a5409d3f0 con 0x560f3a5543b0 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.058+0000 7f1a79c56b80 10 client.24880 fetch_fsmap learned FSMap version 25 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.058+0000 7f1a79c56b80 1 -- 172.21.15.110:0/3517952681 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560f3a574800 con 0x560f3a5543b0 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.058+0000 7f1a52000700 1 -- 172.21.15.110:0/3517952681 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a540b1070 con 0x560f3a5543b0 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.058+0000 7f1a52000700 1 -- 172.21.15.110:0/3517952681 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f1a54005140 con 0x560f3a5543b0 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.058+0000 7f1a79c56b80 10 client.24880 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.059+0000 7f1a79c56b80 10 client.24880 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T11:30:07.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.059+0000 7f1a79c56b80 20 client.24880 populate_metadata read hostname 'smithi110' 2024-04-26T11:30:07.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.059+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x560f3a5d4b90 0x560f3a5d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:07.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.059+0000 7f1a79c56b80 4 client.24880 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T11:30:07.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.059+0000 7f1a79c56b80 1 -- 172.21.15.110:0/3517952681 --> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] -- command(tid 0: {"prefix": "status"}) -- 0x560f3a4aa2c0 con 0x560f3a5d4b90 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.059+0000 7f1a67e00700 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x560f3a5d4b90 0x560f3a5d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.059+0000 7f1a67e00700 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x560f3a5d4b90 0x560f3a5d38a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7464c4df361c853 server_cookie=b205fc0605b4af88 in_seq=0 out_seq=0 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.059+0000 7f1a52000700 10 client.24880 ms_handle_connect on v2:172.21.15.196:6836/1521745566 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a52000700 1 -- 172.21.15.110:0/3517952681 <== mds.2 v2:172.21.15.196:6836/1521745566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560f3a4aa2c0 con 0x560f3a5d4b90 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a52000700 10 client.24880 handle_command_reply: tid=0 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 client.24880 shutdown 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 -- 172.21.15.110:0/3517952681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 msgr2=0x560f3a5559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a5559f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a54099850 tx=0x7f1a5409da10 comp rx=0 tx=0).stop 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 -- 172.21.15.110:0/3517952681 shutdown_connections 2024-04-26T11:30:07.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x560f3a5d4b90 0x560f3a5d38a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f3a554cd0 0x560f3a573020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560f3a550080 0x560f3a5554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a52000700 0 client.24880 ms_handle_reset on v2:172.21.15.196:6836/1521745566 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 --2- 172.21.15.110:0/3517952681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560f3a5543b0 0x560f3a5559f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 -- 172.21.15.110:0/3517952681 >> 172.21.15.110:0/3517952681 conn(0x560f3a47d2a0 msgr2=0x560f3a5685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 -- 172.21.15.110:0/3517952681 shutdown_connections 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 1 -- 172.21.15.110:0/3517952681 wait complete. 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.060+0000 7f1a79c56b80 20 client.24880 trim_cache size 0 max 16384 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:30:07.065 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 2, 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24487, 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 154.453786726, 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 93, 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 210.14501716000001 2024-04-26T11:30:07.066 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:30:07.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 -- 172.21.15.110:0/1353524226 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1a4c0a3c40 msgr2=0x7f1a4c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:07.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1a4c0a3c40 0x7f1a4c0a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009710 tx=0x7f1a60004b40 comp rx=0 tx=0).stop 2024-04-26T11:30:07.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 -- 172.21.15.110:0/1353524226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a68075fb0 msgr2=0x7f1a681a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:07.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a68075fb0 0x7f1a681a0710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a54006010 tx=0x7f1a540057c0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 -- 172.21.15.110:0/1353524226 shutdown_connections 2024-04-26T11:30:07.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a681145f0 0x7f1a681a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a68075690 0x7f1a681a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f1a4c0a3c40 0x7f1a4c0a6100 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 --2- 172.21.15.110:0/1353524226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1a68075fb0 0x7f1a681a0710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:07.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 -- 172.21.15.110:0/1353524226 >> 172.21.15.110:0/1353524226 conn(0x7f1a6807a610 msgr2=0x7f1a68110090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:07.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 -- 172.21.15.110:0/1353524226 shutdown_connections 2024-04-26T11:30:07.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:07.061+0000 7f1a6f200700 1 -- 172.21.15.110:0/1353524226 wait complete. 2024-04-26T11:30:07.771 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:07 smithi110 ceph-mon[28069]: pgmap v415: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:07 smithi193 ceph-mon[32782]: pgmap v415: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:07 smithi196 ceph-mon[32572]: pgmap v415: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:08.029 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-26T11:30:08.463 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:09 smithi110 ceph-mon[28069]: pgmap v416: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:09 smithi193 ceph-mon[32782]: pgmap v416: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:09 smithi196 ceph-mon[32572]: pgmap v416: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:10.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.795+0000 7f45c9800700 1 -- 172.21.15.110:0/4288006760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c406bad0 msgr2=0x7f45c41102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:10.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.795+0000 7f45c9800700 1 --2- 172.21.15.110:0/4288006760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c406bad0 0x7f45c41102e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00b0a0 tx=0x7f45bc00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.795+0000 7f45c9800700 1 -- 172.21.15.110:0/4288006760 shutdown_connections 2024-04-26T11:30:10.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.795+0000 7f45c9800700 1 --2- 172.21.15.110:0/4288006760 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c406bad0 0x7f45c41102e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.795+0000 7f45c9800700 1 --2- 172.21.15.110:0/4288006760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45c41094a0 0x7f45c4109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.795+0000 7f45c9800700 1 --2- 172.21.15.110:0/4288006760 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c406b130 0x7f45c406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.795+0000 7f45c9800700 1 -- 172.21.15.110:0/4288006760 >> 172.21.15.110:0/4288006760 conn(0x7f45c40792d0 msgr2=0x7f45c40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:10.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.795+0000 7f45c9800700 1 -- 172.21.15.110:0/4288006760 shutdown_connections 2024-04-26T11:30:10.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.795+0000 7f45c9800700 1 -- 172.21.15.110:0/4288006760 wait complete. 2024-04-26T11:30:10.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.796+0000 7f45c9800700 1 Processor -- start 2024-04-26T11:30:10.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.796+0000 7f45c9800700 1 -- start start 2024-04-26T11:30:10.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45c9800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c406b130 0x7f45c419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45c9800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c406bad0 0x7f45c419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45c9800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45c41094a0 0x7f45c41999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45c9800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f45c4113610 con 0x7f45c406bad0 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45c9800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f45c4113490 con 0x7f45c41094a0 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45c9800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f45c4113790 con 0x7f45c406b130 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c406bad0 0x7f45c419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c406bad0 0x7f45c419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47802/0 (socket says 172.21.15.110:47802) 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45bbe00700 1 -- 172.21.15.110:0/4148089753 learned_addr learned my addr 172.21.15.110:0/4148089753 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45c2a00700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c406b130 0x7f45c419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45c3400700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45c41094a0 0x7f45c41999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45bbe00700 1 -- 172.21.15.110:0/4148089753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c406b130 msgr2=0x7f45c419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.797+0000 7f45bbe00700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c406b130 0x7f45c419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45bbe00700 1 -- 172.21.15.110:0/4148089753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45c41094a0 msgr2=0x7f45c41999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45bbe00700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45c41094a0 0x7f45c41999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45bbe00700 1 -- 172.21.15.110:0/4148089753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c419a110 con 0x7f45c406bad0 2024-04-26T11:30:10.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45c2a00700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c406b130 0x7f45c419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:10.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45bbe00700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c406bad0 0x7f45c419fd30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00eb30 tx=0x7f45ac00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:10.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45bb400700 1 -- 172.21.15.110:0/4148089753 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00cbd0 con 0x7f45c406bad0 2024-04-26T11:30:10.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45bb400700 1 -- 172.21.15.110:0/4148089753 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45ac0044d0 con 0x7f45c406bad0 2024-04-26T11:30:10.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45c9800700 1 -- 172.21.15.110:0/4148089753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c419a400 con 0x7f45c406bad0 2024-04-26T11:30:10.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45bb400700 1 -- 172.21.15.110:0/4148089753 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac003e30 con 0x7f45c406bad0 2024-04-26T11:30:10.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.798+0000 7f45c9800700 1 -- 172.21.15.110:0/4148089753 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c41a66c0 con 0x7f45c406bad0 2024-04-26T11:30:10.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.802+0000 7f45bb400700 1 -- 172.21.15.110:0/4148089753 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f45ac004000 con 0x7f45c406bad0 2024-04-26T11:30:10.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.803+0000 7f45d4142b80 1 Processor -- start 2024-04-26T11:30:10.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.803+0000 7f45d4142b80 1 -- start start 2024-04-26T11:30:10.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.803+0000 7f45bb400700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f45a80a3c40 0x7f45a80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45bb400700 1 -- 172.21.15.110:0/4148089753 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f45ac0d0850 con 0x7f45c406bad0 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bd1c0 0x55b1858bd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bdb80 0x55b1858c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45d4142b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b185810990 con 0x55b1858bd1c0 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45d4142b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b1857af1f0 con 0x55b1858c2f10 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45d4142b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b18580c950 con 0x55b1858bdb80 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45c3400700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f45a80a3c40 0x7f45a80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bd1c0 0x55b1858bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45c2a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bd1c0 0x55b1858bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47808/0 (socket says 172.21.15.110:47808) 2024-04-26T11:30:10.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45bbe00700 1 -- 172.21.15.110:0/3138143427 learned_addr learned my addr 172.21.15.110:0/3138143427 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:10.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45c3400700 1 --2- 172.21.15.110:0/3138143427 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bdb80 0x55b1858c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45bbe00700 1 -- 172.21.15.110:0/3138143427 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bdb80 msgr2=0x55b1858c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:10.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45bbe00700 1 --2- 172.21.15.110:0/3138143427 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bdb80 0x55b1858c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45bbe00700 1 -- 172.21.15.110:0/3138143427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 msgr2=0x55b1858c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:10.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45bbe00700 1 --2- 172.21.15.110:0/3138143427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.804+0000 7f45bbe00700 1 -- 172.21.15.110:0/3138143427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1857b7710 con 0x55b1858bd1c0 2024-04-26T11:30:10.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.805+0000 7f45c3400700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f45a80a3c40 0x7f45a80a6100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00b780 tx=0x7f45bc00bb90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:10.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.805+0000 7f45bbe00700 1 --2- 172.21.15.110:0/3138143427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bd1c0 0x55b1858bd640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f45ac09c9c0 tx=0x7f45ac098cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a208ed31e7f79834 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:10.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.805+0000 7f45b3e00700 1 -- 172.21.15.110:0/3138143427 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac09c570 con 0x55b1858bd1c0 2024-04-26T11:30:10.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.805+0000 7f45b3e00700 1 -- 172.21.15.110:0/3138143427 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45ac0042f0 con 0x55b1858bd1c0 2024-04-26T11:30:10.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.805+0000 7f45b3e00700 1 -- 172.21.15.110:0/3138143427 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac09c390 con 0x55b1858bd1c0 2024-04-26T11:30:10.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.806+0000 7f45d4142b80 1 -- 172.21.15.110:0/3138143427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bd1c0 msgr2=0x55b1858bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:10.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.806+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3138143427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bd1c0 0x55b1858bd640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f45ac09c9c0 tx=0x7f45ac098cd0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.806+0000 7f45d4142b80 1 -- 172.21.15.110:0/3138143427 shutdown_connections 2024-04-26T11:30:10.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.806+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3138143427 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bdb80 0x55b1858c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.806+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3138143427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.806+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3138143427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bd1c0 0x55b1858bd640 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.806+0000 7f45d4142b80 1 -- 172.21.15.110:0/3138143427 >> 172.21.15.110:0/3138143427 conn(0x55b1857eb3f0 msgr2=0x55b1858b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:10.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.806+0000 7f45d4142b80 1 -- 172.21.15.110:0/3138143427 shutdown_connections 2024-04-26T11:30:10.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.806+0000 7f45d4142b80 1 -- 172.21.15.110:0/3138143427 wait complete. 2024-04-26T11:30:10.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.807+0000 7f45d4142b80 1 -- start start 2024-04-26T11:30:10.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.807+0000 7f45d4142b80 1 Processor -- start 2024-04-26T11:30:10.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45d4142b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b1858ca210 con 0x55b1858bdb80 2024-04-26T11:30:10.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45d4142b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b1857ab440 con 0x55b1858c2f10 2024-04-26T11:30:10.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45d4142b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b1858ca390 con 0x55b1858bd1c0 2024-04-26T11:30:10.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45d4142b80 10 client.0 _ll_register_callbacks cb 0x55b1857a4330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:30:10.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47810/0 (socket says 172.21.15.110:47810) 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45bbe00700 1 -- 172.21.15.110:0/3643222146 learned_addr learned my addr 172.21.15.110:0/3643222146 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45c2a00700 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45c3400700 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45bbe00700 1 -- 172.21.15.110:0/3643222146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 msgr2=0x55b1858c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45bbe00700 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45bbe00700 1 -- 172.21.15.110:0/3643222146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 msgr2=0x55b1858c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.808+0000 7f45bbe00700 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45bbe00700 1 -- 172.21.15.110:0/3643222146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b18575d880 con 0x55b1858bdb80 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45c2a00700 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45bbe00700 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c6b70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00eb00 tx=0x7f45ac003790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb48209b4bb84ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45b0c00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45b0c00700 1 -- 172.21.15.110:0/3643222146 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac09c570 con 0x55b1858bdb80 2024-04-26T11:30:10.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45b0c00700 1 -- 172.21.15.110:0/3643222146 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f45ac0a5210 con 0x55b1858bdb80 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45d4142b80 1 -- 172.21.15.110:0/3643222146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45ac0042f0 con 0x55b1858bdb80 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45b0c00700 1 -- 172.21.15.110:0/3643222146 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f45ac09ca30 con 0x55b1858bdb80 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45d4142b80 10 client.14781 fetch_fsmap learned FSMap version 25 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.809+0000 7f45d4142b80 1 -- 172.21.15.110:0/3643222146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b1858d4970 con 0x55b1858bdb80 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.810+0000 7f45b0c00700 1 -- 172.21.15.110:0/3643222146 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45ac0042f0 con 0x55b1858bdb80 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.810+0000 7f45b0c00700 1 -- 172.21.15.110:0/3643222146 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f45ac098780 con 0x55b1858bdb80 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.810+0000 7f45d4142b80 10 client.14781 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.810+0000 7f45d4142b80 10 client.14781 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.810+0000 7f45d4142b80 20 client.14781 populate_metadata read hostname 'smithi110' 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.810+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55b1858d5cc0 0x55b1858d7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.810+0000 7f45d4142b80 4 client.14781 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:30:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.810+0000 7f45d4142b80 1 -- 172.21.15.110:0/3643222146 --> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b185889b20 con 0x55b1858d5cc0 2024-04-26T11:30:10.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.811+0000 7f45c2a00700 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55b1858d5cc0 0x55b1858d7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.811+0000 7f45c2a00700 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55b1858d5cc0 0x55b1858d7df0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7cbd942711c9e71 server_cookie=a5a6ef044e92da5 in_seq=0 out_seq=0 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.811+0000 7f45b0c00700 10 client.14781 ms_handle_connect on v2:172.21.15.196:6838/1849808245 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45b0c00700 1 -- 172.21.15.110:0/3643222146 <== mds.1 v2:172.21.15.196:6838/1849808245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b185889b20 con 0x55b1858d5cc0 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45b0c00700 10 client.14781 handle_command_reply: tid=0 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45d4142b80 1 client.14781 shutdown 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45d4142b80 1 -- 172.21.15.110:0/3643222146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 msgr2=0x55b1858c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c6b70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00eb00 tx=0x7f45ac003790 comp rx=0 tx=0).stop 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45d4142b80 1 -- 172.21.15.110:0/3643222146 shutdown_connections 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55b1858d5cc0 0x55b1858d7df0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45d4142b80 1 --2- 172.21.15.110:0/3643222146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c6b70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45d4142b80 1 -- 172.21.15.110:0/3643222146 >> 172.21.15.110:0/3643222146 conn(0x55b1857eb3f0 msgr2=0x55b1858b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:10.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.812+0000 7f45b0c00700 0 client.14781 ms_handle_reset on v2:172.21.15.196:6838/1849808245 2024-04-26T11:30:10.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.813+0000 7f45d4142b80 1 -- 172.21.15.110:0/3643222146 shutdown_connections 2024-04-26T11:30:10.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.813+0000 7f45d4142b80 1 -- 172.21.15.110:0/3643222146 wait complete. 2024-04-26T11:30:10.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.813+0000 7f45d4142b80 20 client.14781 trim_cache size 0 max 16384 2024-04-26T11:30:10.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45d4142b80 1 Processor -- start 2024-04-26T11:30:10.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45d4142b80 1 -- start start 2024-04-26T11:30:10.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45d4142b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b1858d6130 con 0x55b1858bdb80 2024-04-26T11:30:10.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45d4142b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b1858d6800 con 0x55b1858c2f10 2024-04-26T11:30:10.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45d4142b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b1858d6ed0 con 0x55b1858bd1c0 2024-04-26T11:30:10.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.835+0000 7f45c2a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47818/0 (socket says 172.21.15.110:47818) 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45bbe00700 1 -- 172.21.15.110:0/359001562 learned_addr learned my addr 172.21.15.110:0/359001562 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45c3400700 1 --2- 172.21.15.110:0/359001562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45c2a00700 1 -- 172.21.15.110:0/359001562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 msgr2=0x55b1858c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45c2a00700 1 --2- 172.21.15.110:0/359001562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45c2a00700 1 -- 172.21.15.110:0/359001562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 msgr2=0x55b1858c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45c2a00700 1 --2- 172.21.15.110:0/359001562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45c2a00700 1 -- 172.21.15.110:0/359001562 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1858b4730 con 0x55b1858bd1c0 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45bbe00700 1 --2- 172.21.15.110:0/359001562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.836+0000 7f45c2a00700 1 --2- 172.21.15.110:0/359001562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c7710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45c419aaf0 tx=0x7f45b4012330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=242d374f1860123e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45b3400700 1 -- 172.21.15.110:0/359001562 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4004240 con 0x55b1858bd1c0 2024-04-26T11:30:10.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45b3400700 1 -- 172.21.15.110:0/359001562 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45b4004ce0 con 0x55b1858bd1c0 2024-04-26T11:30:10.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45b3400700 1 -- 172.21.15.110:0/359001562 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b40055d0 con 0x55b1858bd1c0 2024-04-26T11:30:10.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45d4142b80 1 -- 172.21.15.110:0/359001562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 msgr2=0x55b1858c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:10.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45d4142b80 1 --2- 172.21.15.110:0/359001562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c7710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45c419aaf0 tx=0x7f45b4012330 comp rx=0 tx=0).stop 2024-04-26T11:30:10.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45d4142b80 1 -- 172.21.15.110:0/359001562 shutdown_connections 2024-04-26T11:30:10.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45d4142b80 1 --2- 172.21.15.110:0/359001562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858c2f10 0x55b1858c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45d4142b80 1 --2- 172.21.15.110:0/359001562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858bd1c0 0x55b1858c7710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45d4142b80 1 --2- 172.21.15.110:0/359001562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45d4142b80 1 -- 172.21.15.110:0/359001562 >> 172.21.15.110:0/359001562 conn(0x55b1857eb3f0 msgr2=0x55b1858b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45d4142b80 1 -- 172.21.15.110:0/359001562 shutdown_connections 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.837+0000 7f45d4142b80 1 -- 172.21.15.110:0/359001562 wait complete. 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.838+0000 7f45d4142b80 1 -- start start 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.838+0000 7f45d4142b80 1 Processor -- start 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.838+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858bd1c0 0x55b1858bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.838+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858e1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45d4142b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858c2f10 0x55b1858e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45d4142b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b1858d7c70 con 0x55b1858bdb80 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45d4142b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b1858d75a0 con 0x55b1858bd1c0 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45d4142b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b1858d8340 con 0x55b1858c2f10 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45d4142b80 10 client.0 _ll_register_callbacks cb 0x55b1857a4330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:30:10.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45bbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858e1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45c3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858c2f10 0x55b1858e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45c2a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858bd1c0 0x55b1858bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45c3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858c2f10 0x55b1858e17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:55336/0 (socket says 172.21.15.110:55336) 2024-04-26T11:30:10.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45c3400700 1 -- 172.21.15.110:0/1891130697 learned_addr learned my addr 172.21.15.110:0/1891130697 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:10.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45c3400700 1 -- 172.21.15.110:0/1891130697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858bd1c0 msgr2=0x55b1858bfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:10.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45c3400700 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858bd1c0 0x55b1858bfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45c3400700 1 -- 172.21.15.110:0/1891130697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 msgr2=0x55b1858e1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:10.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45c3400700 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858e1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.839+0000 7f45c3400700 1 -- 172.21.15.110:0/1891130697 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1858c1310 con 0x55b1858c2f10 2024-04-26T11:30:10.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.840+0000 7f45c3400700 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858c2f10 0x55b1858e17a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009e60 tx=0x7f45bc023040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=590f0f41f32a9107 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:10.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.840+0000 7f45b0c00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.840+0000 7f45b0c00700 1 -- 172.21.15.110:0/1891130697 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc031030 con 0x55b1858c2f10 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.840+0000 7f45d4142b80 1 -- 172.21.15.110:0/1891130697 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b4004ce0 con 0x55b1858c2f10 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.840+0000 7f45b0c00700 1 -- 172.21.15.110:0/1891130697 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f45bc007a90 con 0x55b1858c2f10 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.840+0000 7f45b0c00700 1 -- 172.21.15.110:0/1891130697 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f45bc03d050 con 0x55b1858c2f10 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.840+0000 7f45d4142b80 10 client.24898 fetch_fsmap learned FSMap version 25 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.840+0000 7f45d4142b80 1 -- 172.21.15.110:0/1891130697 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b18593df30 con 0x55b1858c2f10 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.841+0000 7f45b0c00700 1 -- 172.21.15.110:0/1891130697 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45b4004ce0 con 0x55b1858c2f10 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.841+0000 7f45b0c00700 1 -- 172.21.15.110:0/1891130697 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f45bc02a070 con 0x55b1858c2f10 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.841+0000 7f45d4142b80 10 client.24898 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.841+0000 7f45d4142b80 10 client.24898 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.841+0000 7f45d4142b80 20 client.24898 populate_metadata read hostname 'smithi110' 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.841+0000 7f45d4142b80 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55b185942b40 0x55b185941850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:10.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.841+0000 7f45d4142b80 4 client.24898 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.841+0000 7f45d4142b80 1 -- 172.21.15.110:0/1891130697 --> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] -- command(tid 0: {"prefix": "status"}) -- 0x55b18581e370 con 0x55b185942b40 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.841+0000 7f45c2a00700 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55b185942b40 0x55b185941850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45c2a00700 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55b185942b40 0x55b185941850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98392a88c14cce4a server_cookie=eefce5607e7f7d5 in_seq=0 out_seq=0 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45b0c00700 10 client.24898 ms_handle_connect on v2:172.21.15.196:6838/1849808245 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45b0c00700 1 -- 172.21.15.110:0/1891130697 <== mds.1 v2:172.21.15.196:6838/1849808245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b18581e370 con 0x55b185942b40 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45b0c00700 10 client.24898 handle_command_reply: tid=0 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 client.24898 shutdown 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 -- 172.21.15.110:0/1891130697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858c2f10 msgr2=0x55b1858e17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858c2f10 0x55b1858e17a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009e60 tx=0x7f45bc023040 comp rx=0 tx=0).stop 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 -- 172.21.15.110:0/1891130697 shutdown_connections 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55b185942b40 0x55b185941850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b1858c2f10 0x55b1858e17a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b1858bd1c0 0x55b1858bfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 --2- 172.21.15.110:0/1891130697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b1858bdb80 0x55b1858e1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45b0c00700 0 client.24898 ms_handle_reset on v2:172.21.15.196:6838/1849808245 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 -- 172.21.15.110:0/1891130697 >> 172.21.15.110:0/1891130697 conn(0x55b1857eb3f0 msgr2=0x55b1858b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.842+0000 7f45d4142b80 1 -- 172.21.15.110:0/1891130697 shutdown_connections 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45d4142b80 1 -- 172.21.15.110:0/1891130697 wait complete. 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45d4142b80 20 client.24898 trim_cache size 0 max 16384 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:30:10.848 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 1, 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24502, 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 159.26026830399999, 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 93, 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 208.22382684999999 2024-04-26T11:30:10.849 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:30:10.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 -- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f45a80a3c40 msgr2=0x7f45a80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:10.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f45a80a3c40 0x7f45a80a6100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00b780 tx=0x7f45bc00bb90 comp rx=0 tx=0).stop 2024-04-26T11:30:10.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 -- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c406bad0 msgr2=0x7f45c419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:10.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c406bad0 0x7f45c419fd30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f45ac00eb30 tx=0x7f45ac00ee40 comp rx=0 tx=0).stop 2024-04-26T11:30:10.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 -- 172.21.15.110:0/4148089753 shutdown_connections 2024-04-26T11:30:10.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45c41094a0 0x7f45c41999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f45a80a3c40 0x7f45a80a6100 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45c406b130 0x7f45c419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 --2- 172.21.15.110:0/4148089753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45c406bad0 0x7f45c419fd30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:10.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.843+0000 7f45c9800700 1 -- 172.21.15.110:0/4148089753 >> 172.21.15.110:0/4148089753 conn(0x7f45c40792d0 msgr2=0x7f45c4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:10.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.844+0000 7f45c9800700 1 -- 172.21.15.110:0/4148089753 shutdown_connections 2024-04-26T11:30:10.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:10.844+0000 7f45c9800700 1 -- 172.21.15.110:0/4148089753 wait complete. 2024-04-26T11:30:11.780 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-26T11:30:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:11 smithi193 ceph-mon[32782]: pgmap v417: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:11 smithi196 ceph-mon[32572]: pgmap v417: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:11 smithi110 ceph-mon[28069]: pgmap v417: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:12.211 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:13.921 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:13 smithi110 ceph-mon[28069]: pgmap v418: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:13 smithi196 ceph-mon[32572]: pgmap v418: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:13 smithi193 ceph-mon[32782]: pgmap v418: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:14.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.490+0000 7fc61ea00700 1 -- 172.21.15.110:0/25725884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 msgr2=0x7fc61810ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.490+0000 7fc61ea00700 1 --2- 172.21.15.110:0/25725884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 0x7fc61810ba00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0099c0 tx=0x7fc60c009cd0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.490+0000 7fc61ea00700 1 -- 172.21.15.110:0/25725884 shutdown_connections 2024-04-26T11:30:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.490+0000 7fc61ea00700 1 --2- 172.21.15.110:0/25725884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc618105f30 0x7fc6181123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.490+0000 7fc61ea00700 1 --2- 172.21.15.110:0/25725884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 0x7fc61810ba00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.490+0000 7fc61ea00700 1 --2- 172.21.15.110:0/25725884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc618105570 0x7fc6181059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.490+0000 7fc61ea00700 1 -- 172.21.15.110:0/25725884 >> 172.21.15.110:0/25725884 conn(0x7fc618101040 msgr2=0x7fc618103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.490+0000 7fc61ea00700 1 -- 172.21.15.110:0/25725884 shutdown_connections 2024-04-26T11:30:14.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.490+0000 7fc61ea00700 1 -- 172.21.15.110:0/25725884 wait complete. 2024-04-26T11:30:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.491+0000 7fc61ea00700 1 Processor -- start 2024-04-26T11:30:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.491+0000 7fc61ea00700 1 -- start start 2024-04-26T11:30:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.491+0000 7fc61ea00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc618105570 0x7fc6181a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61ea00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc618105f30 0x7fc6181a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61ea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 0x7fc61819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61ea00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc618115770 con 0x7fc61810b620 2024-04-26T11:30:14.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61ea00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc6181155f0 con 0x7fc618105f30 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61ea00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc6181158f0 con 0x7fc618105570 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 0x7fc61819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 0x7fc61819b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35868/0 (socket says 172.21.15.110:35868) 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61e000700 1 -- 172.21.15.110:0/2245629802 learned_addr learned my addr 172.21.15.110:0/2245629802 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61cc00700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc618105f30 0x7fc6181a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61d600700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc618105570 0x7fc6181a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61e000700 1 -- 172.21.15.110:0/2245629802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc618105570 msgr2=0x7fc6181a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61e000700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc618105570 0x7fc6181a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61e000700 1 -- 172.21.15.110:0/2245629802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc618105f30 msgr2=0x7fc6181a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61e000700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc618105f30 0x7fc6181a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61e000700 1 -- 172.21.15.110:0/2245629802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61819c110 con 0x7fc61810b620 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.492+0000 7fc61d600700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc618105570 0x7fc6181a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.493+0000 7fc61e000700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 0x7fc61819b9b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc61000ef30 tx=0x7fc61000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:14.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.493+0000 7fc616000700 1 -- 172.21.15.110:0/2245629802 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6100092e0 con 0x7fc61810b620 2024-04-26T11:30:14.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.493+0000 7fc616000700 1 -- 172.21.15.110:0/2245629802 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc610004bb0 con 0x7fc61810b620 2024-04-26T11:30:14.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.493+0000 7fc61ea00700 1 -- 172.21.15.110:0/2245629802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61819c3a0 con 0x7fc61810b620 2024-04-26T11:30:14.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.493+0000 7fc616000700 1 -- 172.21.15.110:0/2245629802 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610004020 con 0x7fc61810b620 2024-04-26T11:30:14.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.493+0000 7fc61ea00700 1 -- 172.21.15.110:0/2245629802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6181a86c0 con 0x7fc61810b620 2024-04-26T11:30:14.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.496+0000 7fc616000700 1 -- 172.21.15.110:0/2245629802 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fc61001b030 con 0x7fc61810b620 2024-04-26T11:30:14.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.498+0000 7fc62a9acb80 1 Processor -- start 2024-04-26T11:30:14.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc62a9acb80 1 -- start start 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc616000700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fc6000a3c40 0x7fc6000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88a630 0x563dca88aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 0x563dca8849e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca884f20 0x563dca885360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc616000700 1 -- 172.21.15.110:0/2245629802 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fc6100cffb0 con 0x7fc61810b620 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563dca7d7840 con 0x563dca88af50 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563dca776160 con 0x563dca884f20 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563dca7d3800 con 0x563dca88a630 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc61cc00700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fc6000a3c40 0x7fc6000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.499+0000 7fc61d600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88a630 0x563dca88aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 0x563dca8849e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61e000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca884f20 0x563dca885360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61d600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88a630 0x563dca88aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39380/0 (socket says 172.21.15.110:39380) 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61d600700 1 -- 172.21.15.110:0/844689568 learned_addr learned my addr 172.21.15.110:0/844689568 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61d600700 1 -- 172.21.15.110:0/844689568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca884f20 msgr2=0x563dca885360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61d600700 1 --2- 172.21.15.110:0/844689568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca884f20 0x563dca885360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61d600700 1 -- 172.21.15.110:0/844689568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 msgr2=0x563dca8849e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61d600700 1 --2- 172.21.15.110:0/844689568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 0x563dca8849e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61d600700 1 -- 172.21.15.110:0/844689568 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dca77e5e0 con 0x563dca88a630 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61cc00700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fc6000a3c40 0x7fc6000a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc61810ac80 tx=0x7fc604009bf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.500+0000 7fc61d600700 1 --2- 172.21.15.110:0/844689568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88a630 0x563dca88aa10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0099c0 tx=0x7fc60c0036e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=954b456dac4bc07b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.501+0000 7fc60aa00700 1 -- 172.21.15.110:0/844689568 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c028070 con 0x563dca88a630 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.501+0000 7fc60aa00700 1 -- 172.21.15.110:0/844689568 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc60c005570 con 0x563dca88a630 2024-04-26T11:30:14.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.501+0000 7fc60aa00700 1 -- 172.21.15.110:0/844689568 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c003c50 con 0x563dca88a630 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 -- 172.21.15.110:0/844689568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88a630 msgr2=0x563dca88aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/844689568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88a630 0x563dca88aa10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0099c0 tx=0x7fc60c0036e0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 -- 172.21.15.110:0/844689568 shutdown_connections 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/844689568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca884f20 0x563dca885360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/844689568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88a630 0x563dca88aa10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/844689568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 0x563dca8849e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 -- 172.21.15.110:0/844689568 >> 172.21.15.110:0/844689568 conn(0x563dca7b22a0 msgr2=0x563dca87f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 -- 172.21.15.110:0/844689568 shutdown_connections 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 -- 172.21.15.110:0/844689568 wait complete. 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.502+0000 7fc62a9acb80 1 -- start start 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc62a9acb80 1 Processor -- start 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca890b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca88de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 0x563dca88e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563dca8918d0 con 0x563dca88af50 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563dca7723b0 con 0x563dca88a630 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563dca891a50 con 0x563dca884f20 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc62a9acb80 10 client.0 _ll_register_callbacks cb 0x563dca76b330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc61d600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca890b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc61d600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca890b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39388/0 (socket says 172.21.15.110:39388) 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.503+0000 7fc61d600700 1 -- 172.21.15.110:0/3591049618 learned_addr learned my addr 172.21.15.110:0/3591049618 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc61e000700 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 0x563dca88e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc61cc00700 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca88de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc61d600700 1 -- 172.21.15.110:0/3591049618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 msgr2=0x563dca88de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc61d600700 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca88de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc61d600700 1 -- 172.21.15.110:0/3591049618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 msgr2=0x563dca88e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc61d600700 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 0x563dca88e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc61d600700 1 -- 172.21.15.110:0/3591049618 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dca724880 con 0x563dca884f20 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc61d600700 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca890b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00b580 tx=0x7fc60c005440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a74a5d8c6960a8e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc5ff400700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc5ff400700 1 -- 172.21.15.110:0/3591049618 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c031060 con 0x563dca884f20 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc62a9acb80 1 -- 172.21.15.110:0/3591049618 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc60c005570 con 0x563dca884f20 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.504+0000 7fc5ff400700 1 -- 172.21.15.110:0/3591049618 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fc60c003ad0 con 0x563dca884f20 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc5ff400700 1 -- 172.21.15.110:0/3591049618 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc60c028040 con 0x563dca884f20 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc62a9acb80 10 client.24910 fetch_fsmap learned FSMap version 25 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc62a9acb80 1 -- 172.21.15.110:0/3591049618 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563dca8918d0 con 0x563dca884f20 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc5ff400700 1 -- 172.21.15.110:0/3591049618 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc60c005570 con 0x563dca884f20 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc5ff400700 1 -- 172.21.15.110:0/3591049618 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fc60c02b070 con 0x563dca884f20 2024-04-26T11:30:14.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc62a9acb80 10 client.24910 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc62a9acb80 10 client.24910 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc62a9acb80 20 client.24910 populate_metadata read hostname 'smithi110' 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563dca89e230 0x563dca89f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc62a9acb80 4 client.24910 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.505+0000 7fc62a9acb80 1 -- 172.21.15.110:0/3591049618 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dca7e5220 con 0x563dca89e230 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.506+0000 7fc61cc00700 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563dca89e230 0x563dca89f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.506+0000 7fc61cc00700 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563dca89e230 0x563dca89f6a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbc92a7ab8e6065e server_cookie=5879aefbd7b8ea32 in_seq=0 out_seq=0 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.506+0000 7fc5ff400700 10 client.24910 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.507+0000 7fc5ff400700 1 -- 172.21.15.110:0/3591049618 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563dca7e5220 con 0x563dca89e230 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.507+0000 7fc5ff400700 10 client.24910 handle_command_reply: tid=0 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.507+0000 7fc62a9acb80 1 client.24910 shutdown 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 -- 172.21.15.110:0/3591049618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 msgr2=0x563dca890b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca890b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00b580 tx=0x7fc60c005440 comp rx=0 tx=0).stop 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 -- 172.21.15.110:0/3591049618 shutdown_connections 2024-04-26T11:30:14.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563dca89e230 0x563dca89f6a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88af50 0x563dca88e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca890b30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc5ff400700 0 client.24910 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:30:14.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/3591049618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca88de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 -- 172.21.15.110:0/3591049618 >> 172.21.15.110:0/3591049618 conn(0x563dca7b22a0 msgr2=0x563dca879e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:14.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 -- 172.21.15.110:0/3591049618 shutdown_connections 2024-04-26T11:30:14.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 1 -- 172.21.15.110:0/3591049618 wait complete. 2024-04-26T11:30:14.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.508+0000 7fc62a9acb80 20 client.24910 trim_cache size 0 max 16384 2024-04-26T11:30:14.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc62a9acb80 1 Processor -- start 2024-04-26T11:30:14.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc62a9acb80 1 -- start start 2024-04-26T11:30:14.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca8849e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88a630 0x563dca88ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88af50 0x563dca8795d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563dca89d9e0 con 0x563dca88a630 2024-04-26T11:30:14.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563dca89e0b0 con 0x563dca88af50 2024-04-26T11:30:14.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563dca89e780 con 0x563dca884f20 2024-04-26T11:30:14.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc61cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88a630 0x563dca88ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc61cc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88a630 0x563dca88ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35888/0 (socket says 172.21.15.110:35888) 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.531+0000 7fc61cc00700 1 -- 172.21.15.110:0/152874577 learned_addr learned my addr 172.21.15.110:0/152874577 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc61d600700 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca8849e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc61e000700 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88af50 0x563dca8795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc61cc00700 1 -- 172.21.15.110:0/152874577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 msgr2=0x563dca8849e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc61cc00700 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca8849e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc61cc00700 1 -- 172.21.15.110:0/152874577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88af50 msgr2=0x563dca8795d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc61cc00700 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88af50 0x563dca8795d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc61cc00700 1 -- 172.21.15.110:0/152874577 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dca877910 con 0x563dca88a630 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc61d600700 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca8849e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc61cc00700 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88a630 0x563dca88ba40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x563dca88f400 tx=0x7fc604021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7168e37f782189 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:14.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.532+0000 7fc60a000700 1 -- 172.21.15.110:0/152874577 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604004410 con 0x563dca88a630 2024-04-26T11:30:14.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc60a000700 1 -- 172.21.15.110:0/152874577 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc60402c900 con 0x563dca88a630 2024-04-26T11:30:14.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc60a000700 1 -- 172.21.15.110:0/152874577 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604004e30 con 0x563dca88a630 2024-04-26T11:30:14.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc62a9acb80 1 -- 172.21.15.110:0/152874577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88a630 msgr2=0x563dca88ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:14.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88a630 0x563dca88ba40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x563dca88f400 tx=0x7fc604021000 comp rx=0 tx=0).stop 2024-04-26T11:30:14.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc62a9acb80 1 -- 172.21.15.110:0/152874577 shutdown_connections 2024-04-26T11:30:14.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88af50 0x563dca8795d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca884f20 0x563dca8849e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/152874577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca88a630 0x563dca88ba40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc62a9acb80 1 -- 172.21.15.110:0/152874577 >> 172.21.15.110:0/152874577 conn(0x563dca7b22a0 msgr2=0x563dca88b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.533+0000 7fc62a9acb80 1 -- 172.21.15.110:0/152874577 shutdown_connections 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.534+0000 7fc62a9acb80 1 -- 172.21.15.110:0/152874577 wait complete. 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.534+0000 7fc62a9acb80 1 -- start start 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.534+0000 7fc62a9acb80 1 Processor -- start 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca884f20 0x563dca8a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca8a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc62a9acb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88af50 0x563dca8fd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563dca89f520 con 0x563dca884f20 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563dca89ee50 con 0x563dca88a630 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc62a9acb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563dca89fbf0 con 0x563dca88af50 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc62a9acb80 10 client.0 _ll_register_callbacks cb 0x563dca76b330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca884f20 0x563dca8a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61cc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca8a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61d600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca884f20 0x563dca8a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35894/0 (socket says 172.21.15.110:35894) 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61cc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca8a56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:47898/0 (socket says 172.21.15.110:47898) 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61d600700 1 -- 172.21.15.110:0/2644599933 learned_addr learned my addr 172.21.15.110:0/2644599933 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:14.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61e000700 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88af50 0x563dca8fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61cc00700 1 -- 172.21.15.110:0/2644599933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88af50 msgr2=0x563dca8fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61cc00700 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88af50 0x563dca8fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61cc00700 1 -- 172.21.15.110:0/2644599933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca884f20 msgr2=0x563dca8a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61cc00700 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca884f20 0x563dca8a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61cc00700 1 -- 172.21.15.110:0/2644599933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dca8fdb60 con 0x563dca88a630 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.535+0000 7fc61d600700 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca884f20 0x563dca8a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.536+0000 7fc61cc00700 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca8a56c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x563dca890640 tx=0x7fc60400f6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4cedd721f212633 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.536+0000 7fc5ff400700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.536+0000 7fc5ff400700 1 -- 172.21.15.110:0/2644599933 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6040044d0 con 0x563dca88a630 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.536+0000 7fc62a9acb80 1 -- 172.21.15.110:0/2644599933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc60402c900 con 0x563dca88a630 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.536+0000 7fc5ff400700 1 -- 172.21.15.110:0/2644599933 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fc60401a040 con 0x563dca88a630 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.536+0000 7fc5ff400700 1 -- 172.21.15.110:0/2644599933 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc60402c450 con 0x563dca88a630 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.536+0000 7fc62a9acb80 10 client.24905 fetch_fsmap learned FSMap version 25 2024-04-26T11:30:14.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.536+0000 7fc62a9acb80 1 -- 172.21.15.110:0/2644599933 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563dca905ec0 con 0x563dca88a630 2024-04-26T11:30:14.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.537+0000 7fc5ff400700 1 -- 172.21.15.110:0/2644599933 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc60402c900 con 0x563dca88a630 2024-04-26T11:30:14.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.537+0000 7fc5ff400700 1 -- 172.21.15.110:0/2644599933 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fc604003710 con 0x563dca88a630 2024-04-26T11:30:14.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.537+0000 7fc62a9acb80 10 client.24905 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:30:14.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.537+0000 7fc62a9acb80 10 client.24905 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T11:30:14.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.537+0000 7fc62a9acb80 20 client.24905 populate_metadata read hostname 'smithi110' 2024-04-26T11:30:14.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.537+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563dca90a6e0 0x563dca9093f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:14.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.537+0000 7fc62a9acb80 4 client.24905 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T11:30:14.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.537+0000 7fc62a9acb80 1 -- 172.21.15.110:0/2644599933 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "status"}) -- 0x563dca7df2c0 con 0x563dca90a6e0 2024-04-26T11:30:14.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.537+0000 7fc61d600700 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563dca90a6e0 0x563dca9093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:14.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc61d600700 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563dca90a6e0 0x563dca9093f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c71502074c28c31 server_cookie=5b2435fbe018f2ee in_seq=0 out_seq=0 2024-04-26T11:30:14.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc5ff400700 10 client.24905 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc5ff400700 1 -- 172.21.15.110:0/2644599933 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563dca7df2c0 con 0x563dca90a6e0 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc5ff400700 10 client.24905 handle_command_reply: tid=0 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc62a9acb80 1 client.24905 shutdown 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc62a9acb80 1 -- 172.21.15.110:0/2644599933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 msgr2=0x563dca8a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca8a56c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x563dca890640 tx=0x7fc60400f6d0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc62a9acb80 1 -- 172.21.15.110:0/2644599933 shutdown_connections 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563dca90a6e0 0x563dca9093f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563dca88af50 0x563dca8fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563dca884f20 0x563dca8a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc5ff400700 0 client.24905 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc62a9acb80 1 --2- 172.21.15.110:0/2644599933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563dca88a630 0x563dca8a56c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.538+0000 7fc62a9acb80 1 -- 172.21.15.110:0/2644599933 >> 172.21.15.110:0/2644599933 conn(0x563dca7b22a0 msgr2=0x563dca8795d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.539+0000 7fc62a9acb80 1 -- 172.21.15.110:0/2644599933 shutdown_connections 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.539+0000 7fc62a9acb80 1 -- 172.21.15.110:0/2644599933 wait complete. 2024-04-26T11:30:14.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.539+0000 7fc62a9acb80 20 client.24905 trim_cache size 0 max 16384 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 0, 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24518, 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 179.44065453799999, 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 93, 2024-04-26T11:30:14.546 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T11:30:14.547 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 198.530093526 2024-04-26T11:30:14.547 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:30:14.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.539+0000 7fc61ea00700 1 -- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fc6000a3c40 msgr2=0x7fc6000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.539+0000 7fc61ea00700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fc6000a3c40 0x7fc6000a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc61810ac80 tx=0x7fc604009bf0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.539+0000 7fc61ea00700 1 -- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 msgr2=0x7fc61819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.539+0000 7fc61ea00700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 0x7fc61819b9b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc61000ef30 tx=0x7fc61000c3a0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.540+0000 7fc61ea00700 1 -- 172.21.15.110:0/2245629802 shutdown_connections 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.540+0000 7fc61ea00700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61810b620 0x7fc61819b9b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.540+0000 7fc61ea00700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fc6000a3c40 0x7fc6000a6100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.540+0000 7fc61ea00700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc618105570 0x7fc6181a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.540+0000 7fc61ea00700 1 --2- 172.21.15.110:0/2245629802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc618105f30 0x7fc6181a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.540+0000 7fc61ea00700 1 -- 172.21.15.110:0/2245629802 >> 172.21.15.110:0/2245629802 conn(0x7fc618101040 msgr2=0x7fc618102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.540+0000 7fc61ea00700 1 -- 172.21.15.110:0/2245629802 shutdown_connections 2024-04-26T11:30:14.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:14.540+0000 7fc61ea00700 1 -- 172.21.15.110:0/2245629802 wait complete. 2024-04-26T11:30:15.316 INFO:tasks.cephadm:Setup complete, yielding 2024-04-26T11:30:15.317 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T11:30:15.326 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-04-26T11:30:15.326 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-26T11:30:15.767 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:15.912 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:15 smithi110 ceph-mon[28069]: pgmap v419: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:15 smithi196 ceph-mon[32572]: pgmap v419: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:15 smithi193 ceph-mon[32782]: pgmap v419: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:17.726 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:17 smithi110 ceph-mon[28069]: pgmap v420: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:17 smithi196 ceph-mon[32572]: pgmap v420: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:18.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.016+0000 7efe5e600700 1 -- 172.21.15.110:0/3214190032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe581067c0 msgr2=0x7efe58106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:18.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.016+0000 7efe5e600700 1 --2- 172.21.15.110:0/3214190032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe581067c0 0x7efe58106c20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe440099c0 tx=0x7efe44009cd0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.016+0000 7efe5e600700 1 -- 172.21.15.110:0/3214190032 shutdown_connections 2024-04-26T11:30:18.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.016+0000 7efe5e600700 1 --2- 172.21.15.110:0/3214190032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe58107160 0x7efe5810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.016+0000 7efe5e600700 1 --2- 172.21.15.110:0/3214190032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe581055c0 0x7efe581059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.016+0000 7efe5e600700 1 --2- 172.21.15.110:0/3214190032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe581067c0 0x7efe58106c20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.016+0000 7efe5e600700 1 -- 172.21.15.110:0/3214190032 >> 172.21.15.110:0/3214190032 conn(0x7efe58100b60 msgr2=0x7efe58102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:18.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.017+0000 7efe5e600700 1 -- 172.21.15.110:0/3214190032 shutdown_connections 2024-04-26T11:30:18.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.017+0000 7efe5e600700 1 -- 172.21.15.110:0/3214190032 wait complete. 2024-04-26T11:30:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.018+0000 7efe5e600700 1 Processor -- start 2024-04-26T11:30:18.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.018+0000 7efe5e600700 1 -- start start 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.018+0000 7efe5e600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe581055c0 0x7efe5819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.018+0000 7efe5e600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe581067c0 0x7efe5819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.018+0000 7efe5e600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe58107160 0x7efe581a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.018+0000 7efe5e600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efe58111030 con 0x7efe58107160 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.018+0000 7efe5e600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efe58110eb0 con 0x7efe581067c0 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.018+0000 7efe5e600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efe581111b0 con 0x7efe581055c0 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5dc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe58107160 0x7efe581a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5dc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe58107160 0x7efe581a2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35916/0 (socket says 172.21.15.110:35916) 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5d200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe581055c0 0x7efe5819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:18.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5dc00700 1 -- 172.21.15.110:0/1461537831 learned_addr learned my addr 172.21.15.110:0/1461537831 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:18.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe57e00700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe581067c0 0x7efe5819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:18.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5dc00700 1 -- 172.21.15.110:0/1461537831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe581055c0 msgr2=0x7efe5819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:18.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5dc00700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe581055c0 0x7efe5819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5dc00700 1 -- 172.21.15.110:0/1461537831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe581067c0 msgr2=0x7efe5819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:18.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5dc00700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe581067c0 0x7efe5819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5dc00700 1 -- 172.21.15.110:0/1461537831 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe581a3310 con 0x7efe58107160 2024-04-26T11:30:18.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.019+0000 7efe5dc00700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe58107160 0x7efe581a2c70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c3a0 tx=0x7efe5000c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:18.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.020+0000 7efe55600700 1 -- 172.21.15.110:0/1461537831 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe500092e0 con 0x7efe58107160 2024-04-26T11:30:18.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.020+0000 7efe55600700 1 -- 172.21.15.110:0/1461537831 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe50003a00 con 0x7efe58107160 2024-04-26T11:30:18.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.020+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe581a35a0 con 0x7efe58107160 2024-04-26T11:30:18.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.020+0000 7efe55600700 1 -- 172.21.15.110:0/1461537831 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50004720 con 0x7efe58107160 2024-04-26T11:30:18.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.020+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe581a3ae0 con 0x7efe58107160 2024-04-26T11:30:18.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.021+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe5806a110 con 0x7efe58107160 2024-04-26T11:30:18.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.023+0000 7efe55600700 1 -- 172.21.15.110:0/1461537831 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7efe5001a020 con 0x7efe58107160 2024-04-26T11:30:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.024+0000 7efe55600700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efe400a3cc0 0x7efe400a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.024+0000 7efe55600700 1 -- 172.21.15.110:0/1461537831 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7efe500cfcf0 con 0x7efe58107160 2024-04-26T11:30:18.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.024+0000 7efe5d200700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efe400a3cc0 0x7efe400a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:18.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.025+0000 7efe5d200700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efe400a3cc0 0x7efe400a6180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efe58106620 tx=0x7efe4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:18.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.029+0000 7efe55600700 1 -- 172.21.15.110:0/1461537831 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7efe50010040 con 0x7efe58107160 2024-04-26T11:30:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:17 smithi193 ceph-mon[32782]: pgmap v420: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:18.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.277+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7efe58063860 con 0x7efe400a3cc0 2024-04-26T11:30:18.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.280+0000 7efe55600700 1 -- 172.21.15.110:0/1461537831 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7efe58063860 con 0x7efe400a3cc0 2024-04-26T11:30:18.282 INFO:teuthology.orchestra.run.smithi110.stdout:Backend: cephadm 2024-04-26T11:30:18.282 INFO:teuthology.orchestra.run.smithi110.stdout:Available: Yes 2024-04-26T11:30:18.282 INFO:teuthology.orchestra.run.smithi110.stdout:Paused: No 2024-04-26T11:30:18.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.283+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efe400a3cc0 msgr2=0x7efe400a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:18.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.283+0000 7efe5e600700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efe400a3cc0 0x7efe400a6180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efe58106620 tx=0x7efe4c009260 comp rx=0 tx=0).stop 2024-04-26T11:30:18.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.283+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe58107160 msgr2=0x7efe581a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:18.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.283+0000 7efe5e600700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe58107160 0x7efe581a2c70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c3a0 tx=0x7efe5000c6b0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.284+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 shutdown_connections 2024-04-26T11:30:18.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.284+0000 7efe5e600700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe58107160 0x7efe581a2c70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.284+0000 7efe5e600700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7efe400a3cc0 0x7efe400a6180 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.284+0000 7efe5e600700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe581055c0 0x7efe5819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.284+0000 7efe5e600700 1 --2- 172.21.15.110:0/1461537831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe581067c0 0x7efe5819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:18.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.284+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 >> 172.21.15.110:0/1461537831 conn(0x7efe58100b60 msgr2=0x7efe58109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:18.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.284+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 shutdown_connections 2024-04-26T11:30:18.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:18.284+0000 7efe5e600700 1 -- 172.21.15.110:0/1461537831 wait complete. 2024-04-26T11:30:19.120 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-26T11:30:19.553 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:19.893 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:19 smithi110 ceph-mon[28069]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:19.894 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:19 smithi110 ceph-mon[28069]: pgmap v421: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:19 smithi196 ceph-mon[32572]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:19 smithi196 ceph-mon[32572]: pgmap v421: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:19 smithi193 ceph-mon[32782]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:19 smithi193 ceph-mon[32782]: pgmap v421: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:21.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.858+0000 7ff4c6400700 1 -- 172.21.15.110:0/583758206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4c01055c0 msgr2=0x7ff4c01059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:21.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.858+0000 7ff4c6400700 1 --2- 172.21.15.110:0/583758206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4c01055c0 0x7ff4c01059e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00099c0 tx=0x7ff4b0009cd0 comp rx=0 tx=0).stop 2024-04-26T11:30:21.861 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:21 smithi110 ceph-mon[28069]: pgmap v422: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:21.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.859+0000 7ff4c6400700 1 -- 172.21.15.110:0/583758206 shutdown_connections 2024-04-26T11:30:21.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.859+0000 7ff4c6400700 1 --2- 172.21.15.110:0/583758206 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4c0107160 0x7ff4c010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:21.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.859+0000 7ff4c6400700 1 --2- 172.21.15.110:0/583758206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4c01055c0 0x7ff4c01059e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:21.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.859+0000 7ff4c6400700 1 --2- 172.21.15.110:0/583758206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c01067c0 0x7ff4c0106c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:21.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.859+0000 7ff4c6400700 1 -- 172.21.15.110:0/583758206 >> 172.21.15.110:0/583758206 conn(0x7ff4c0100b40 msgr2=0x7ff4c0102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:21.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.859+0000 7ff4c6400700 1 -- 172.21.15.110:0/583758206 shutdown_connections 2024-04-26T11:30:21.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.859+0000 7ff4c6400700 1 -- 172.21.15.110:0/583758206 wait complete. 2024-04-26T11:30:21.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.860+0000 7ff4c6400700 1 Processor -- start 2024-04-26T11:30:21.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.861+0000 7ff4c6400700 1 -- start start 2024-04-26T11:30:21.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.861+0000 7ff4c6400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4c01055c0 0x7ff4c019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:21.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.861+0000 7ff4c6400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c01067c0 0x7ff4c019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:21.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.861+0000 7ff4c6400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4c0107160 0x7ff4c01a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:21.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.861+0000 7ff4c6400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0111080 con 0x7ff4c01067c0 2024-04-26T11:30:21.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.861+0000 7ff4c6400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0110f00 con 0x7ff4c0107160 2024-04-26T11:30:21.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.861+0000 7ff4c6400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0111200 con 0x7ff4c01055c0 2024-04-26T11:30:21.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.862+0000 7ff4c5000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4c01055c0 0x7ff4c019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:21.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.862+0000 7ff4c5000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4c01055c0 0x7ff4c019b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39432/0 (socket says 172.21.15.110:39432) 2024-04-26T11:30:21.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.862+0000 7ff4c5000700 1 -- 172.21.15.110:0/3902866707 learned_addr learned my addr 172.21.15.110:0/3902866707 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:21.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.862+0000 7ff4c5000700 1 -- 172.21.15.110:0/3902866707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4c0107160 msgr2=0x7ff4c01a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:21.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.862+0000 7ff4c5000700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4c0107160 0x7ff4c01a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:21.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.862+0000 7ff4c5000700 1 -- 172.21.15.110:0/3902866707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c01067c0 msgr2=0x7ff4c019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:21.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.862+0000 7ff4c5000700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c01067c0 0x7ff4c019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:21.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.862+0000 7ff4c5000700 1 -- 172.21.15.110:0/3902866707 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c01a3340 con 0x7ff4c01055c0 2024-04-26T11:30:21.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.863+0000 7ff4c5000700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4c01055c0 0x7ff4c019b6e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000b580 tx=0x7ff4b0003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:21.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.863+0000 7ff4be000700 1 -- 172.21.15.110:0/3902866707 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0009e60 con 0x7ff4c01055c0 2024-04-26T11:30:21.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.863+0000 7ff4be000700 1 -- 172.21.15.110:0/3902866707 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4b0005570 con 0x7ff4c01055c0 2024-04-26T11:30:21.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.863+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c01a35d0 con 0x7ff4c01055c0 2024-04-26T11:30:21.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.863+0000 7ff4be000700 1 -- 172.21.15.110:0/3902866707 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00173f0 con 0x7ff4c01055c0 2024-04-26T11:30:21.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.863+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c01a3a20 con 0x7ff4c01055c0 2024-04-26T11:30:21.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.864+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c006a110 con 0x7ff4c01055c0 2024-04-26T11:30:21.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.866+0000 7ff4be000700 1 -- 172.21.15.110:0/3902866707 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff4b000f580 con 0x7ff4c01055c0 2024-04-26T11:30:21.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.867+0000 7ff4be000700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3c40 0x7ff4a40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:21.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.868+0000 7ff4be000700 1 -- 172.21.15.110:0/3902866707 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7ff4b00d13a0 con 0x7ff4c01055c0 2024-04-26T11:30:21.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.868+0000 7ff4b7e00700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3c40 0x7ff4a40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:21.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.868+0000 7ff4b7e00700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3c40 0x7ff4a40a6100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8005950 tx=0x7ff4a80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:21.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:21.872+0000 7ff4be000700 1 -- 172.21.15.110:0/3902866707 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff4b0013070 con 0x7ff4c01055c0 2024-04-26T11:30:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:21 smithi196 ceph-mon[32572]: pgmap v422: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:22.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.113+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff4c0063860 con 0x7ff4a40a3c40 2024-04-26T11:30:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:21 smithi193 ceph-mon[32782]: pgmap v422: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:22.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.153+0000 7ff4be000700 1 -- 172.21.15.110:0/3902866707 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7ff4c0063860 con 0x7ff4a40a3c40 2024-04-26T11:30:22.154 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T11:30:22.154 INFO:teuthology.orchestra.run.smithi110.stdout:mds.a smithi110 running (3m) 45s ago 3m 13.0M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 50045bb5acf7 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.b smithi193 running (3m) 67s ago 3m 27.4M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b e4232c06d77a 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.c smithi196 running (3m) 67s ago 3m 21.1M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b c6f8ada6b30d 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.d smithi110 running (3m) 45s ago 3m 13.2M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b adb439f3eb90 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.e smithi193 running (3m) 67s ago 3m 20.6M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 0dfb545f1537 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.f smithi196 running (3m) 67s ago 3m 18.1M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b bb0ef47b14bc 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.g smithi110 running (3m) 45s ago 3m 13.1M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b ced00513fd2d 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.h smithi193 running (3m) 67s ago 3m 20.3M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b c28fe20e2920 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.i smithi196 running (3m) 67s ago 3m 19.4M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b d0b9c24b21c1 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.j smithi110 running (3m) 45s ago 3m 13.3M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 55d77a14f363 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.k smithi193 running (4m) 67s ago 4m 16.2M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 6e428d9e2c92 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mds.l smithi196 running (4m) 67s ago 4m 14.6M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 22b6143e99ba 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.x smithi110 *:9283,8765 running (12m) 45s ago 12m 515M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 830fb23ccb57 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.y smithi193 *:8443,8765 running (9m) 67s ago 9m 454M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b d61b164f45bb 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.z smithi196 *:8443,8765 running (10m) 67s ago 10m 456M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b fe8e86aa0044 2024-04-26T11:30:22.155 INFO:teuthology.orchestra.run.smithi110.stdout:mon.a smithi110 running (12m) 45s ago 12m 49.3M 2048M 19.0.0-3267-gbc94a2a9 3a6bde214c5b bb40b9490e8b 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:mon.b smithi193 running (10m) 67s ago 10m 44.6M 2048M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 0e5b352f22e2 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:mon.c smithi196 running (10m) 67s ago 10m 41.6M 2048M 19.0.0-3267-gbc94a2a9 3a6bde214c5b c2ff0cfd646e 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (9m) 45s ago 9m 46.4M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b edd2a72e9abc 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi193 running (9m) 67s ago 9m 58.1M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 280c17cf6015 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi196 running (8m) 67s ago 8m 60.0M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 1cd9721552a3 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi110 running (8m) 45s ago 8m 56.0M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b f7c75c3f6a04 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi193 running (7m) 67s ago 7m 55.9M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 5da43b76114c 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi196 running (7m) 67s ago 7m 58.5M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 84d217da5da3 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.6 smithi110 running (6m) 45s ago 6m 41.4M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 0f3aa7972f64 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.7 smithi193 running (6m) 67s ago 6m 45.4M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 5258e9b02554 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.8 smithi196 running (5m) 67s ago 5m 44.2M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 63ec1fbc5bc2 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.9 smithi110 running (5m) 45s ago 5m 53.5M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 54001194114b 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.10 smithi193 running (4m) 67s ago 4m 58.7M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 43a2f5a9cb1f 2024-04-26T11:30:22.156 INFO:teuthology.orchestra.run.smithi110.stdout:osd.11 smithi196 running (4m) 67s ago 4m 43.1M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 07e5532e8cbc 2024-04-26T11:30:22.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3c40 msgr2=0x7ff4a40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:22.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3c40 0x7ff4a40a6100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8005950 tx=0x7ff4a80058e0 comp rx=0 tx=0).stop 2024-04-26T11:30:22.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4c01055c0 msgr2=0x7ff4c019b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:22.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4c01055c0 0x7ff4c019b6e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000b580 tx=0x7ff4b0003ba0 comp rx=0 tx=0).stop 2024-04-26T11:30:22.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 shutdown_connections 2024-04-26T11:30:22.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff4c0107160 0x7ff4c01a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:22.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff4a40a3c40 0x7ff4a40a6100 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:22.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4c01055c0 0x7ff4c019b6e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:22.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 --2- 172.21.15.110:0/3902866707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c01067c0 0x7ff4c019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:22.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 >> 172.21.15.110:0/3902866707 conn(0x7ff4c0100b40 msgr2=0x7ff4c0109b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:22.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 shutdown_connections 2024-04-26T11:30:22.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:22.156+0000 7ff4c6400700 1 -- 172.21.15.110:0/3902866707 wait complete. 2024-04-26T11:30:23.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-26T11:30:23.477 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:23.888 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:23 smithi110 ceph-mon[28069]: from='client.24928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:23.888 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:23 smithi110 ceph-mon[28069]: pgmap v423: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:23 smithi196 ceph-mon[32572]: from='client.24928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:23 smithi196 ceph-mon[32572]: pgmap v423: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:23 smithi193 ceph-mon[32782]: from='client.24928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:23 smithi193 ceph-mon[32782]: pgmap v423: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:25.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.815+0000 7fa5e7c00700 1 -- 172.21.15.110:0/3784082130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5e01056c0 msgr2=0x7fa5e0105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:25.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.815+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/3784082130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5e01056c0 0x7fa5e0105ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009920 tx=0x7fa5d4009c30 comp rx=0 tx=0).stop 2024-04-26T11:30:25.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.815+0000 7fa5e7c00700 1 -- 172.21.15.110:0/3784082130 shutdown_connections 2024-04-26T11:30:25.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.815+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/3784082130 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5e0107260 0x7fa5e010db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:25.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.815+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/3784082130 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5e01056c0 0x7fa5e0105ae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:25.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.815+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/3784082130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5e01068c0 0x7fa5e0106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:25.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.815+0000 7fa5e7c00700 1 -- 172.21.15.110:0/3784082130 >> 172.21.15.110:0/3784082130 conn(0x7fa5e0100c80 msgr2=0x7fa5e01030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:25.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.815+0000 7fa5e7c00700 1 -- 172.21.15.110:0/3784082130 shutdown_connections 2024-04-26T11:30:25.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.815+0000 7fa5e7c00700 1 -- 172.21.15.110:0/3784082130 wait complete. 2024-04-26T11:30:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.816+0000 7fa5e7c00700 1 Processor -- start 2024-04-26T11:30:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e7c00700 1 -- start start 2024-04-26T11:30:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e7c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5e01056c0 0x7fa5e019b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e7c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5e01068c0 0x7fa5e019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e7c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5e0107260 0x7fa5e01a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e7c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0111160 con 0x7fa5e01056c0 2024-04-26T11:30:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e7c00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e0110fe0 con 0x7fa5e01068c0 2024-04-26T11:30:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e7c00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e01112e0 con 0x7fa5e0107260 2024-04-26T11:30:25.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e5200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5e01056c0 0x7fa5e019b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e5200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5e01056c0 0x7fa5e019b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37974/0 (socket says 172.21.15.110:37974) 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e5200700 1 -- 172.21.15.110:0/1587976258 learned_addr learned my addr 172.21.15.110:0/1587976258 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5dfe00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5e01068c0 0x7fa5e019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.817+0000 7fa5e5c00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5e0107260 0x7fa5e01a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5e5200700 1 -- 172.21.15.110:0/1587976258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5e0107260 msgr2=0x7fa5e01a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5e5200700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5e0107260 0x7fa5e01a2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5e5200700 1 -- 172.21.15.110:0/1587976258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5e01068c0 msgr2=0x7fa5e019bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5e5200700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5e01068c0 0x7fa5e019bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5e5200700 1 -- 172.21.15.110:0/1587976258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e01a34a0 con 0x7fa5e01056c0 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5e5c00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5e0107260 0x7fa5e01a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5e5200700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5e01056c0 0x7fa5e019b840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4011040 tx=0x7fa5d4005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:25.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5dd600700 1 -- 172.21.15.110:0/1587976258 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4027070 con 0x7fa5e01056c0 2024-04-26T11:30:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5dd600700 1 -- 172.21.15.110:0/1587976258 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5d4005540 con 0x7fa5e01056c0 2024-04-26T11:30:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5dd600700 1 -- 172.21.15.110:0/1587976258 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4004a50 con 0x7fa5e01056c0 2024-04-26T11:30:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.818+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e01a3730 con 0x7fa5e01056c0 2024-04-26T11:30:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.819+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e01a3b80 con 0x7fa5e01056c0 2024-04-26T11:30:25.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.820+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e006a110 con 0x7fa5e01056c0 2024-04-26T11:30:25.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.822+0000 7fa5dd600700 1 -- 172.21.15.110:0/1587976258 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa5d402a070 con 0x7fa5e01056c0 2024-04-26T11:30:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.823+0000 7fa5dd600700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa5c80a3c40 0x7fa5c80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.823+0000 7fa5dd600700 1 -- 172.21.15.110:0/1587976258 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fa5d40d1060 con 0x7fa5e01056c0 2024-04-26T11:30:25.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.823+0000 7fa5dfe00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa5c80a3c40 0x7fa5c80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:25.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.824+0000 7fa5dfe00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa5c80a3c40 0x7fa5c80a6100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009750 tx=0x7fa5cc009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:25.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:25.828+0000 7fa5dd600700 1 -- 172.21.15.110:0/1587976258 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa5d405eff0 con 0x7fa5e01056c0 2024-04-26T11:30:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:25 smithi196 ceph-mon[32572]: pgmap v424: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:25 smithi110 ceph-mon[28069]: pgmap v424: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:26.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.068+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa5e0063860 con 0x7fa5c80a3c40 2024-04-26T11:30:26.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.084+0000 7fa5dd600700 1 -- 172.21.15.110:0/1587976258 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa5e0063860 con 0x7fa5c80a3c40 2024-04-26T11:30:26.085 INFO:teuthology.orchestra.run.smithi110.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-26T11:30:26.086 INFO:teuthology.orchestra.run.smithi110.stdout:mds.all 12/12 71s ago 4m smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi193=b;smithi193=e;smithi193=h;smithi193=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-04-26T11:30:26.086 INFO:teuthology.orchestra.run.smithi110.stdout:mgr 3/3 71s ago 10m smithi110=x;smithi193=y;smithi196=z;count:3 2024-04-26T11:30:26.086 INFO:teuthology.orchestra.run.smithi110.stdout:mon 3/3 71s ago 10m smithi110:172.21.15.110=a;smithi193:172.21.15.193=b;smithi196:172.21.15.196=c;count:3 2024-04-26T11:30:26.086 INFO:teuthology.orchestra.run.smithi110.stdout:osd 12 71s ago - 2024-04-26T11:30:26.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa5c80a3c40 msgr2=0x7fa5c80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:26.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa5c80a3c40 0x7fa5c80a6100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009750 tx=0x7fa5cc009310 comp rx=0 tx=0).stop 2024-04-26T11:30:26.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5e01056c0 msgr2=0x7fa5e019b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:26.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5e01056c0 0x7fa5e019b840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4011040 tx=0x7fa5d4005270 comp rx=0 tx=0).stop 2024-04-26T11:30:26.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 shutdown_connections 2024-04-26T11:30:26.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa5c80a3c40 0x7fa5c80a6100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:26.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa5e0107260 0x7fa5e01a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:26.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5e01056c0 0x7fa5e019b840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:26.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 --2- 172.21.15.110:0/1587976258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5e01068c0 0x7fa5e019bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:26.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 >> 172.21.15.110:0/1587976258 conn(0x7fa5e0100c80 msgr2=0x7fa5e0109cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:26.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 shutdown_connections 2024-04-26T11:30:26.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:26.087+0000 7fa5e7c00700 1 -- 172.21.15.110:0/1587976258 wait complete. 2024-04-26T11:30:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:25 smithi193 ceph-mon[32782]: pgmap v424: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:26.930 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-26T11:30:27.375 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:27 smithi110 ceph-mon[28069]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:27 smithi110 ceph-mon[28069]: pgmap v425: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:27 smithi196 ceph-mon[32572]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:27 smithi196 ceph-mon[32572]: pgmap v425: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:27 smithi193 ceph-mon[32782]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:27 smithi193 ceph-mon[32782]: pgmap v425: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.689+0000 7f6d37e00700 1 -- 172.21.15.110:0/46666982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d3810abb0 msgr2=0x7f6d3810b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.689+0000 7f6d37e00700 1 --2- 172.21.15.110:0/46666982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d3810abb0 0x7f6d3810b010 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d240099c0 tx=0x7f6d24009cd0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.689+0000 7f6d37e00700 1 -- 172.21.15.110:0/46666982 shutdown_connections 2024-04-26T11:30:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.689+0000 7f6d37e00700 1 --2- 172.21.15.110:0/46666982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d3810b550 0x7f6d38111e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.689+0000 7f6d37e00700 1 --2- 172.21.15.110:0/46666982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d381099b0 0x7f6d38109dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.689+0000 7f6d37e00700 1 --2- 172.21.15.110:0/46666982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d3810abb0 0x7f6d3810b010 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.689+0000 7f6d37e00700 1 -- 172.21.15.110:0/46666982 >> 172.21.15.110:0/46666982 conn(0x7f6d38078980 msgr2=0x7f6d3807adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.689+0000 7f6d37e00700 1 -- 172.21.15.110:0/46666982 shutdown_connections 2024-04-26T11:30:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.689+0000 7f6d37e00700 1 -- 172.21.15.110:0/46666982 wait complete. 2024-04-26T11:30:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.690+0000 7f6d37e00700 1 Processor -- start 2024-04-26T11:30:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.690+0000 7f6d37e00700 1 -- start start 2024-04-26T11:30:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d381099b0 0x7f6d3819fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d3810abb0 0x7f6d381a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d3810b550 0x7f6d381a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6d381154f0 con 0x7f6d381099b0 2024-04-26T11:30:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37e00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d38115370 con 0x7f6d3810abb0 2024-04-26T11:30:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37e00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6d38115670 con 0x7f6d3810b550 2024-04-26T11:30:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d36a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d381099b0 0x7f6d3819fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d36a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d381099b0 0x7f6d3819fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38004/0 (socket says 172.21.15.110:38004) 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d36a00700 1 -- 172.21.15.110:0/2988234894 learned_addr learned my addr 172.21.15.110:0/2988234894 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37400700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d3810b550 0x7f6d381a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d36000700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d3810abb0 0x7f6d381a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37400700 1 -- 172.21.15.110:0/2988234894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d3810abb0 msgr2=0x7f6d381a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37400700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d3810abb0 0x7f6d381a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37400700 1 -- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d381099b0 msgr2=0x7f6d3819fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.691+0000 7f6d37400700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d381099b0 0x7f6d3819fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.692+0000 7f6d37400700 1 -- 172.21.15.110:0/2988234894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d381a7790 con 0x7f6d3810b550 2024-04-26T11:30:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.692+0000 7f6d36a00700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d381099b0 0x7f6d3819fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:29.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.692+0000 7f6d37400700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d3810b550 0x7f6d381a70f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000be50 tx=0x7f6d30009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.692+0000 7f6d2f400700 1 -- 172.21.15.110:0/2988234894 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30019070 con 0x7f6d3810b550 2024-04-26T11:30:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.692+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d381a7a80 con 0x7f6d3810b550 2024-04-26T11:30:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.692+0000 7f6d2f400700 1 -- 172.21.15.110:0/2988234894 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d3000cb90 con 0x7f6d3810b550 2024-04-26T11:30:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.692+0000 7f6d2f400700 1 -- 172.21.15.110:0/2988234894 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300125a0 con 0x7f6d3810b550 2024-04-26T11:30:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.692+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d381a7f70 con 0x7f6d3810b550 2024-04-26T11:30:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.693+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3806a110 con 0x7f6d3810b550 2024-04-26T11:30:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.695+0000 7f6d2f400700 1 -- 172.21.15.110:0/2988234894 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f6d3001c070 con 0x7f6d3810b550 2024-04-26T11:30:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.697+0000 7f6d2f400700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6d1c0a3c40 0x7f6d1c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.697+0000 7f6d2f400700 1 -- 172.21.15.110:0/2988234894 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f6d300cfbc0 con 0x7f6d3810b550 2024-04-26T11:30:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.697+0000 7f6d36a00700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6d1c0a3c40 0x7f6d1c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.698+0000 7f6d36a00700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6d1c0a3c40 0x7f6d1c0a6100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6d280105c0 tx=0x7f6d2800b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:29.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.701+0000 7f6d2f400700 1 -- 172.21.15.110:0/2988234894 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6d3009c530 con 0x7f6d3810b550 2024-04-26T11:30:29.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.932+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f6d38063860 con 0x7f6d1c0a3c40 2024-04-26T11:30:29.935 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:29 smithi110 ceph-mon[28069]: pgmap v426: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T11:30:29.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.935+0000 7f6d2f400700 1 -- 172.21.15.110:0/2988234894 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f6d38063860 con 0x7f6d1c0a3c40 2024-04-26T11:30:29.936 INFO:teuthology.orchestra.run.smithi110.stdout:HOST ADDR LABELS STATUS 2024-04-26T11:30:29.936 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110 172.21.15.110 2024-04-26T11:30:29.937 INFO:teuthology.orchestra.run.smithi110.stdout:smithi193 172.21.15.193 2024-04-26T11:30:29.937 INFO:teuthology.orchestra.run.smithi110.stdout:smithi196 172.21.15.196 2024-04-26T11:30:29.937 INFO:teuthology.orchestra.run.smithi110.stdout:3 hosts in cluster 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.939+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6d1c0a3c40 msgr2=0x7f6d1c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.939+0000 7f6d37e00700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6d1c0a3c40 0x7f6d1c0a6100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6d280105c0 tx=0x7f6d2800b4a0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.939+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d3810b550 msgr2=0x7f6d381a70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.939+0000 7f6d37e00700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d3810b550 0x7f6d381a70f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000be50 tx=0x7f6d30009ed0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.940+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 shutdown_connections 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.940+0000 7f6d37e00700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6d1c0a3c40 0x7f6d1c0a6100 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.940+0000 7f6d37e00700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d3810b550 0x7f6d381a70f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.940+0000 7f6d37e00700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d381099b0 0x7f6d3819fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.940+0000 7f6d37e00700 1 --2- 172.21.15.110:0/2988234894 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d3810abb0 0x7f6d381a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.940+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 >> 172.21.15.110:0/2988234894 conn(0x7f6d38078980 msgr2=0x7f6d3810df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:29.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.940+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 shutdown_connections 2024-04-26T11:30:29.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:29.940+0000 7f6d37e00700 1 -- 172.21.15.110:0/2988234894 wait complete. 2024-04-26T11:30:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:29 smithi196 ceph-mon[32572]: pgmap v426: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T11:30:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:29 smithi193 ceph-mon[32782]: pgmap v426: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T11:30:30.775 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-26T11:30:31.213 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:31 smithi196 ceph-mon[32572]: from='client.24940 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:31 smithi196 ceph-mon[32572]: pgmap v427: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-26T11:30:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:31 smithi110 ceph-mon[28069]: from='client.24940 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:31 smithi110 ceph-mon[28069]: pgmap v427: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-26T11:30:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:31 smithi193 ceph-mon[32782]: from='client.24940 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:31 smithi193 ceph-mon[32782]: pgmap v427: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-26T11:30:33.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.525+0000 7f16a5000700 1 -- 172.21.15.110:0/1179069536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a0075e20 msgr2=0x7f16a00762a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:33.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.525+0000 7f16a5000700 1 --2- 172.21.15.110:0/1179069536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a0075e20 0x7f16a00762a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1688009990 tx=0x7f1688009ca0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.525+0000 7f16a5000700 1 -- 172.21.15.110:0/1179069536 shutdown_connections 2024-04-26T11:30:33.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.525+0000 7f16a5000700 1 --2- 172.21.15.110:0/1179069536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16a010b3b0 0x7f16a010d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.525+0000 7f16a5000700 1 --2- 172.21.15.110:0/1179069536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16a00773f0 0x7f16a0075850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.525+0000 7f16a5000700 1 --2- 172.21.15.110:0/1179069536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a0075e20 0x7f16a00762a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.525+0000 7f16a5000700 1 -- 172.21.15.110:0/1179069536 >> 172.21.15.110:0/1179069536 conn(0x7f16a00fea70 msgr2=0x7f16a0100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:33.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.525+0000 7f16a5000700 1 -- 172.21.15.110:0/1179069536 shutdown_connections 2024-04-26T11:30:33.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.525+0000 7f16a5000700 1 -- 172.21.15.110:0/1179069536 wait complete. 2024-04-26T11:30:33.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.527+0000 7f16a5000700 1 Processor -- start 2024-04-26T11:30:33.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.527+0000 7f16a5000700 1 -- start start 2024-04-26T11:30:33.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.527+0000 7f16a5000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16a0075e20 0x7f16a019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:33.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f16a5000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a00773f0 0x7f16a019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:33.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f16a5000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16a010b3b0 0x7f16a01a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:33.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f16a5000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f16a01111a0 con 0x7f16a00773f0 2024-04-26T11:30:33.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f16a5000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0111020 con 0x7f16a0075e20 2024-04-26T11:30:33.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f16a5000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0111320 con 0x7f16a010b3b0 2024-04-26T11:30:33.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f1697e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a00773f0 0x7f16a019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f169de00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16a0075e20 0x7f16a019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f1697e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a00773f0 0x7f16a019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40820/0 (socket says 172.21.15.110:40820) 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f169de00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16a0075e20 0x7f16a019b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38402/0 (socket says 172.21.15.110:38402) 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f1697e00700 1 -- 172.21.15.110:0/2423258539 learned_addr learned my addr 172.21.15.110:0/2423258539 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f169e800700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16a010b3b0 0x7f16a01a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f169de00700 1 -- 172.21.15.110:0/2423258539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16a010b3b0 msgr2=0x7f16a01a2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f169de00700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16a010b3b0 0x7f16a01a2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f169de00700 1 -- 172.21.15.110:0/2423258539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a00773f0 msgr2=0x7f16a019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f169de00700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a00773f0 0x7f16a019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.528+0000 7f169de00700 1 -- 172.21.15.110:0/2423258539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a01a3430 con 0x7f16a0075e20 2024-04-26T11:30:33.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.529+0000 7f169de00700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16a0075e20 0x7f16a019b7d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f169000d950 tx=0x7f169000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:33.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.529+0000 7f1696a00700 1 -- 172.21.15.110:0/2423258539 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690016070 con 0x7f16a0075e20 2024-04-26T11:30:33.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.529+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a01a3720 con 0x7f16a0075e20 2024-04-26T11:30:33.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.529+0000 7f1696a00700 1 -- 172.21.15.110:0/2423258539 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f169000fd40 con 0x7f16a0075e20 2024-04-26T11:30:33.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.529+0000 7f1696a00700 1 -- 172.21.15.110:0/2423258539 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169000e3b0 con 0x7f16a0075e20 2024-04-26T11:30:33.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.529+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a01a3cb0 con 0x7f16a0075e20 2024-04-26T11:30:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.530+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a006a110 con 0x7f16a0075e20 2024-04-26T11:30:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.532+0000 7f1696a00700 1 -- 172.21.15.110:0/2423258539 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f1690019070 con 0x7f16a0075e20 2024-04-26T11:30:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.534+0000 7f1696a00700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f16840a3cc0 0x7f16840a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.534+0000 7f1696a00700 1 -- 172.21.15.110:0/2423258539 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f16900d0080 con 0x7f16a0075e20 2024-04-26T11:30:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.534+0000 7f1697e00700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f16840a3cc0 0x7f16840a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:33.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.535+0000 7f1697e00700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f16840a3cc0 0x7f16840a6180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1688006010 tx=0x7f168800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:33.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.536+0000 7f1696a00700 1 -- 172.21.15.110:0/2423258539 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f169009c960 con 0x7f16a0075e20 2024-04-26T11:30:33.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.775+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 --> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f16a0063860 con 0x7f16840a3cc0 2024-04-26T11:30:33.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.779+0000 7f1696a00700 1 -- 172.21.15.110:0/2423258539 <== mgr.14152 v2:172.21.15.110:6800/2430566216 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f16a0063860 con 0x7f16840a3cc0 2024-04-26T11:30:33.780 INFO:teuthology.orchestra.run.smithi110.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-26T11:30:33.781 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002T480DGN 447G No 5m ago Has a FileSystem, LVM detected 2024-04-26T11:30:33.781 INFO:teuthology.orchestra.run.smithi110.stdout:smithi193 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500HB400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-04-26T11:30:33.781 INFO:teuthology.orchestra.run.smithi110.stdout:smithi196 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-04-26T11:30:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f16840a3cc0 msgr2=0x7f16840a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f16840a3cc0 0x7f16840a6180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1688006010 tx=0x7f168800b260 comp rx=0 tx=0).stop 2024-04-26T11:30:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16a0075e20 msgr2=0x7f16a019b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16a0075e20 0x7f16a019b7d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f169000d950 tx=0x7f169000dc60 comp rx=0 tx=0).stop 2024-04-26T11:30:33.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 shutdown_connections 2024-04-26T11:30:33.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f16840a3cc0 0x7f16840a6180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16a010b3b0 0x7f16a01a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16a0075e20 0x7f16a019b7d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 --2- 172.21.15.110:0/2423258539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16a00773f0 0x7f16a019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:33.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 >> 172.21.15.110:0/2423258539 conn(0x7f16a00fea70 msgr2=0x7f16a0107300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:33.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 shutdown_connections 2024-04-26T11:30:33.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:33.782+0000 7f16a5000700 1 -- 172.21.15.110:0/2423258539 wait complete. 2024-04-26T11:30:33.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:33 smithi193 ceph-mon[32782]: pgmap v428: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T11:30:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:33 smithi196 ceph-mon[32572]: pgmap v428: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T11:30:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:33 smithi110 ceph-mon[28069]: pgmap v428: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T11:30:34.654 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T11:30:34.668 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-04-26T11:30:34.668 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T11:30:35.114 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:35 smithi196 ceph-mon[32572]: from='client.24929 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:35 smithi196 ceph-mon[32572]: pgmap v429: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T11:30:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:35 smithi110 ceph-mon[28069]: from='client.24929 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:35 smithi110 ceph-mon[28069]: pgmap v429: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T11:30:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:35 smithi193 ceph-mon[32782]: from='client.24929 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:30:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:35 smithi193 ceph-mon[32782]: pgmap v429: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T11:30:37.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.439+0000 7fbd05e00700 1 -- 172.21.15.110:0/1481619155 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd0010b360 msgr2=0x7fbd0010d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.439+0000 7fbd05e00700 1 --2- 172.21.15.110:0/1481619155 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd0010b360 0x7fbd0010d7f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800b0a0 tx=0x7fbcf800b3b0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.439+0000 7fbd05e00700 1 -- 172.21.15.110:0/1481619155 shutdown_connections 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.439+0000 7fbd05e00700 1 --2- 172.21.15.110:0/1481619155 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd0010b360 0x7fbd0010d7f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.439+0000 7fbd05e00700 1 --2- 172.21.15.110:0/1481619155 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd00077450 0x7fbd000758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.439+0000 7fbd05e00700 1 --2- 172.21.15.110:0/1481619155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd00075e80 0x7fbd00076300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.439+0000 7fbd05e00700 1 -- 172.21.15.110:0/1481619155 >> 172.21.15.110:0/1481619155 conn(0x7fbd000fe9f0 msgr2=0x7fbd00100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.439+0000 7fbd05e00700 1 -- 172.21.15.110:0/1481619155 shutdown_connections 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.439+0000 7fbd05e00700 1 -- 172.21.15.110:0/1481619155 wait complete. 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.440+0000 7fbd05e00700 1 Processor -- start 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.440+0000 7fbd05e00700 1 -- start start 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbd05e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd00075e80 0x7fbd0019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbd05e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd00077450 0x7fbd0019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:37.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbd05e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0010b360 0x7fbd001a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:37.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbd05e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbd00111170 con 0x7fbd00077450 2024-04-26T11:30:37.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbd05e00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbd00110ff0 con 0x7fbd00075e80 2024-04-26T11:30:37.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbd05e00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001112f0 con 0x7fbd0010b360 2024-04-26T11:30:37.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbcf7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd00077450 0x7fbd0019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:37.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbcf7e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd00077450 0x7fbd0019bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40844/0 (socket says 172.21.15.110:40844) 2024-04-26T11:30:37.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbcfea00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd00075e80 0x7fbd0019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:37.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbcf7e00700 1 -- 172.21.15.110:0/967389724 learned_addr learned my addr 172.21.15.110:0/967389724 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.441+0000 7fbcff400700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0010b360 0x7fbd001a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbcfea00700 1 -- 172.21.15.110:0/967389724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0010b360 msgr2=0x7fbd001a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbcfea00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0010b360 0x7fbd001a2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbcfea00700 1 -- 172.21.15.110:0/967389724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd00077450 msgr2=0x7fbd0019bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbcfea00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd00077450 0x7fbd0019bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbcfea00700 1 -- 172.21.15.110:0/967389724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd001a3410 con 0x7fbd00075e80 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbcfea00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd00075e80 0x7fbd0019b7b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000e9c0 tx=0x7fbcf000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbd04a00700 1 -- 172.21.15.110:0/967389724 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000cb70 con 0x7fbd00075e80 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbd04a00700 1 -- 172.21.15.110:0/967389724 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcf000ee60 con 0x7fbd00075e80 2024-04-26T11:30:37.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd001a3700 con 0x7fbd00075e80 2024-04-26T11:30:37.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.442+0000 7fbd04a00700 1 -- 172.21.15.110:0/967389724 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0003d60 con 0x7fbd00075e80 2024-04-26T11:30:37.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.443+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd001a3c90 con 0x7fbd00075e80 2024-04-26T11:30:37.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.444+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd0006a110 con 0x7fbd00075e80 2024-04-26T11:30:37.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.446+0000 7fbd04a00700 1 -- 172.21.15.110:0/967389724 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fbcf000cd10 con 0x7fbd00075e80 2024-04-26T11:30:37.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.447+0000 7fbd04a00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbce40a3cc0 0x7fbce40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:37.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.447+0000 7fbd04a00700 1 -- 172.21.15.110:0/967389724 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fbcf00d05f0 con 0x7fbd00075e80 2024-04-26T11:30:37.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.447+0000 7fbcf7e00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbce40a3cc0 0x7fbce40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:37.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.448+0000 7fbcf7e00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbce40a3cc0 0x7fbce40a6180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbce8005950 tx=0x7fbce8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:37.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.451+0000 7fbd04a00700 1 -- 172.21.15.110:0/967389724 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbcf009ced0 con 0x7fbd00075e80 2024-04-26T11:30:37.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.728+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbd00064030 con 0x7fbd00075e80 2024-04-26T11:30:37.730 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:37 smithi110 ceph-mon[28069]: pgmap v430: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-26T11:30:37.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.729+0000 7fbd04a00700 1 -- 172.21.15.110:0/967389724 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3062 (secure 0 0 0) 0x7fbcf009c7d0 con 0x7fbd00075e80 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:e25 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 25 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-04-26T11:27:14.996270+0000 2024-04-26T11:30:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-04-26T11:27:39.501334+0000 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 300 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 3 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:in 0,1,2 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=24518,1=24502,2=24487} 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-04-26T11:30:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3] 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data disabled 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 0 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 24518 members: 24502,24518,24487 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b{0:24518} state up:active seq 6 addr [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.h{0:24485} state up:standby-replay seq 1 addr [v2:172.21.15.193:6836/324089889,v1:172.21.15.193:6837/324089889] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.i{1:24502} state up:active seq 14 addr [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f{1:24481} state up:standby-replay seq 1 addr [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c{2:24487} state up:active seq 15 addr [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e{2:24467} state up:standby-replay seq 1 addr [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.733 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:30:37.734 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:30:37.734 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-04-26T11:30:37.734 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:30:37.734 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.g{-1:14403} state up:standby seq 1 addr [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.734 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a{-1:14415} state up:standby seq 1 addr [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.734 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.k{-1:24437} state up:standby seq 1 addr [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.734 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.l{-1:24442} state up:standby seq 1 addr [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.734 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.j{-1:24454} state up:standby seq 1 addr [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.734 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d{-1:24461} state up:standby seq 1 addr [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T11:30:37.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.732+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbce40a3cc0 msgr2=0x7fbce40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:37.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.732+0000 7fbd05e00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbce40a3cc0 0x7fbce40a6180 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbce8005950 tx=0x7fbce8009260 comp rx=0 tx=0).stop 2024-04-26T11:30:37.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.732+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd00075e80 msgr2=0x7fbd0019b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:37.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.732+0000 7fbd05e00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd00075e80 0x7fbd0019b7b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000e9c0 tx=0x7fbcf000ecd0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.733+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 shutdown_connections 2024-04-26T11:30:37.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.733+0000 7fbd05e00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fbce40a3cc0 0x7fbce40a6180 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbce8005950 tx=0x7fbce8009260 comp rx=0 tx=0).stop 2024-04-26T11:30:37.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.733+0000 7fbd05e00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd0010b360 0x7fbd001a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.733+0000 7fbd05e00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd00075e80 0x7fbd0019b7b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.733+0000 7fbd05e00700 1 --2- 172.21.15.110:0/967389724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd00077450 0x7fbd0019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:37.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.733+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 >> 172.21.15.110:0/967389724 conn(0x7fbd000fe9f0 msgr2=0x7fbd00107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:37.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.734+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 shutdown_connections 2024-04-26T11:30:37.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:37.734+0000 7fbd05e00700 1 -- 172.21.15.110:0/967389724 wait complete. 2024-04-26T11:30:37.737 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-04-26T11:30:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:37 smithi196 ceph-mon[32572]: pgmap v430: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-26T11:30:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:37 smithi193 ceph-mon[32782]: pgmap v430: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-26T11:30:38.542 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-26T11:30:38.785 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:30:38.785 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:38 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/967389724' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T11:30:38.785 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:38.785 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:38.785 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:38.785 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:38 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:38.968 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:30:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:38 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/967389724' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T11:30:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:38 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:30:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:38 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/967389724' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T11:30:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:38 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:39 smithi196 ceph-mon[32572]: pgmap v431: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T11:30:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:30:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:30:40.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:39 smithi196 ceph-mon[32572]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:39 smithi110 ceph-mon[28069]: pgmap v431: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T11:30:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:30:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:30:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:39 smithi110 ceph-mon[28069]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:39 smithi193 ceph-mon[32782]: pgmap v431: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-26T11:30:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:30:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:30:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:39 smithi193 ceph-mon[32782]: from='mgr.14152 172.21.15.110:0/3045955216' entity='mgr.x' 2024-04-26T11:30:40.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:40 smithi110 ceph-mon[28069]: pgmap v432: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:40 smithi196 ceph-mon[32572]: pgmap v432: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:40 smithi193 ceph-mon[32782]: pgmap v432: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:41.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.237+0000 7f245be00700 1 -- 172.21.15.110:0/2911121952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 msgr2=0x7f2454111f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:41.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.237+0000 7f245be00700 1 --2- 172.21.15.110:0/2911121952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 0x7f2454111f10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f244c00b0d0 tx=0x7f244c00b3e0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.237+0000 7f245be00700 1 -- 172.21.15.110:0/2911121952 shutdown_connections 2024-04-26T11:30:41.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.237+0000 7f245be00700 1 --2- 172.21.15.110:0/2911121952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 0x7f2454111f10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.237+0000 7f245be00700 1 --2- 172.21.15.110:0/2911121952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2454109ac0 0x7f2454109ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.237+0000 7f245be00700 1 --2- 172.21.15.110:0/2911121952 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f245410acc0 0x7f245410b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.237+0000 7f245be00700 1 -- 172.21.15.110:0/2911121952 >> 172.21.15.110:0/2911121952 conn(0x7f2454078a90 msgr2=0x7f245407aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:41.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.237+0000 7f245be00700 1 -- 172.21.15.110:0/2911121952 shutdown_connections 2024-04-26T11:30:41.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.237+0000 7f245be00700 1 -- 172.21.15.110:0/2911121952 wait complete. 2024-04-26T11:30:41.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.238+0000 7f245be00700 1 Processor -- start 2024-04-26T11:30:41.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.238+0000 7f245be00700 1 -- start start 2024-04-26T11:30:41.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f245be00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2454109ac0 0x7f245419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:41.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f245be00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f245410acc0 0x7f24541a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:41.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f245be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 0x7f24541a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:41.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f245be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2454115590 con 0x7f245410b660 2024-04-26T11:30:41.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f245be00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2454115410 con 0x7f2454109ac0 2024-04-26T11:30:41.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f245be00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2454115710 con 0x7f245410acc0 2024-04-26T11:30:41.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f2459e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 0x7f24541a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:41.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f2459e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 0x7f24541a7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40862/0 (socket says 172.21.15.110:40862) 2024-04-26T11:30:41.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f2459e00700 1 -- 172.21.15.110:0/479271298 learned_addr learned my addr 172.21.15.110:0/479271298 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:41.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f2458a00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f245410acc0 0x7f24541a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:41.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.239+0000 7f2459400700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2454109ac0 0x7f245419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f2459e00700 1 -- 172.21.15.110:0/479271298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f245410acc0 msgr2=0x7f24541a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f2459e00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f245410acc0 0x7f24541a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f2459e00700 1 -- 172.21.15.110:0/479271298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2454109ac0 msgr2=0x7f245419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f2459e00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2454109ac0 0x7f245419fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f2459e00700 1 -- 172.21.15.110:0/479271298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24541a77a0 con 0x7f245410b660 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f2459e00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 0x7f24541a7100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f244c004cb0 tx=0x7f244c004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f2452000700 1 -- 172.21.15.110:0/479271298 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c01f030 con 0x7f245410b660 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f2452000700 1 -- 172.21.15.110:0/479271298 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244c005040 con 0x7f245410b660 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24541a7a30 con 0x7f245410b660 2024-04-26T11:30:41.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f2452000700 1 -- 172.21.15.110:0/479271298 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c01b690 con 0x7f245410b660 2024-04-26T11:30:41.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.240+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24541a7ee0 con 0x7f245410b660 2024-04-26T11:30:41.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.241+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f245406a110 con 0x7f245410b660 2024-04-26T11:30:41.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.243+0000 7f2452000700 1 -- 172.21.15.110:0/479271298 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f244c005480 con 0x7f245410b660 2024-04-26T11:30:41.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.245+0000 7f2452000700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f243c0a3cc0 0x7f243c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:41.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.245+0000 7f2452000700 1 -- 172.21.15.110:0/479271298 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f244c0d0ff0 con 0x7f245410b660 2024-04-26T11:30:41.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.245+0000 7f2459400700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f243c0a3cc0 0x7f243c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:41.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.246+0000 7f2459400700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f243c0a3cc0 0x7f243c0a6180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f245410ab20 tx=0x7f2448009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:41.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.250+0000 7f2452000700 1 -- 172.21.15.110:0/479271298 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f244c09d960 con 0x7f245410b660 2024-04-26T11:30:41.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.472+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f2454064030 con 0x7f245410b660 2024-04-26T11:30:41.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.474+0000 7f2452000700 1 -- 172.21.15.110:0/479271298 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v93) ==== 56+0+5472 (secure 0 0 0) 0x7f244c09d260 con 0x7f245410b660 2024-04-26T11:30:41.475 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 93 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:fsid 6e439470-03be-11ef-bc93-c7b262605968 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-04-26T11:17:56.437545+0000 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-04-26T11:29:03.588199+0000 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:crush_version 26 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:full_ratio 0.95 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:backfillfull_ratio 0.9 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:nearfull_ratio 0.85 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:require_min_compat_client luminous 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:min_compat_client luminous 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:require_osd_release squid 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:stretch_mode_enabled false 2024-04-26T11:30:41.476 INFO:teuthology.orchestra.run.smithi110.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:max_osd 12 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 up in weight 1 up_from 8 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6802/1662740885,v1:172.21.15.110:6803/1662740885] [v2:172.21.15.110:6804/1662740885,v1:172.21.15.110:6805/1662740885] exists,up 13eb997d-8b4a-47f5-be11-772d47788972 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6800/1751461680,v1:172.21.15.193:6801/1751461680] [v2:172.21.15.193:6802/1751461680,v1:172.21.15.193:6803/1751461680] exists,up e7927dc3-dced-4661-8493-840e111241e7 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 up in weight 1 up_from 18 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6800/1785522554,v1:172.21.15.196:6801/1785522554] [v2:172.21.15.196:6802/1785522554,v1:172.21.15.196:6803/1785522554] exists,up 54459a80-91a1-45ba-b7e4-900a4a995219 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 up in weight 1 up_from 26 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6810/2253549266,v1:172.21.15.110:6811/2253549266] [v2:172.21.15.110:6812/2253549266,v1:172.21.15.110:6813/2253549266] exists,up 12d8a1be-5edb-4af2-b01d-abd943f89641 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 up in weight 1 up_from 34 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6808/1314161856,v1:172.21.15.193:6809/1314161856] [v2:172.21.15.193:6810/1314161856,v1:172.21.15.193:6811/1314161856] exists,up f3057080-144b-4f43-9a63-8f415ca76d76 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 up in weight 1 up_from 39 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6808/2359280243,v1:172.21.15.196:6809/2359280243] [v2:172.21.15.196:6810/2359280243,v1:172.21.15.196:6811/2359280243] exists,up f0775b9c-938e-4bb4-ae1e-01ef0686cc66 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.6 up in weight 1 up_from 47 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6818/1730783886,v1:172.21.15.110:6819/1730783886] [v2:172.21.15.110:6820/1730783886,v1:172.21.15.110:6821/1730783886] exists,up ea4ea3de-4ec4-48a1-809e-da62fcbb7033 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.7 up in weight 1 up_from 52 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6816/4124476381,v1:172.21.15.193:6817/4124476381] [v2:172.21.15.193:6818/4124476381,v1:172.21.15.193:6819/4124476381] exists,up 98af7071-82b3-4732-b2a1-8676e6439cd1 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.8 up in weight 1 up_from 60 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6816/2942176519,v1:172.21.15.196:6817/2942176519] [v2:172.21.15.196:6818/2942176519,v1:172.21.15.196:6819/2942176519] exists,up 7aaa3c52-72f5-4946-a964-609f65b778f4 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.9 up in weight 1 up_from 68 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6826/2620757358,v1:172.21.15.110:6827/2620757358] [v2:172.21.15.110:6828/2620757358,v1:172.21.15.110:6829/2620757358] exists,up 2cde3ed2-6acd-48a4-a99d-aa558dd85baa 2024-04-26T11:30:41.477 INFO:teuthology.orchestra.run.smithi110.stdout:osd.10 up in weight 1 up_from 73 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.193:6824/676480728,v1:172.21.15.193:6825/676480728] [v2:172.21.15.193:6826/676480728,v1:172.21.15.193:6827/676480728] exists,up 3bbaac8f-fe7b-4f0e-a25b-286c3c30926e 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:osd.11 up in weight 1 up_from 81 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6824/2802765812,v1:172.21.15.196:6825/2802765812] [v2:172.21.15.196:6826/2802765812,v1:172.21.15.196:6827/2802765812] exists,up e31c248e-1016-4765-bea1-9f31d823ca3d 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 2.e [2,4] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 2.10 [2,4] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 2.1b [5,11] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 2.1c [8,11] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 2.1d [2,6] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 2.1f [8,1] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.3 [4,9] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.6 [3,6] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.1a [5,6] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.21 [4,7] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.27 [4,8] 2024-04-26T11:30:41.478 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.2d [3,9] 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.39 [5,8] 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.3c [4,9] 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/3278958945 expires 2024-04-27T11:19:02.329691+0000 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:6801/4292256031 expires 2024-04-27T11:19:02.329691+0000 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:6800/878579821 expires 2024-04-27T11:18:29.387925+0000 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/3536224934 expires 2024-04-27T11:19:02.329691+0000 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/2250601964 expires 2024-04-27T11:18:29.387925+0000 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/2775667488 expires 2024-04-27T11:18:29.387925+0000 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:6801/878579821 expires 2024-04-27T11:18:29.387925+0000 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/337370067 expires 2024-04-27T11:18:29.387925+0000 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/3594651859 expires 2024-04-27T11:19:02.329691+0000 2024-04-26T11:30:41.479 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:6800/4292256031 expires 2024-04-27T11:19:02.329691+0000 2024-04-26T11:30:41.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.476+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f243c0a3cc0 msgr2=0x7f243c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:41.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.476+0000 7f245be00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f243c0a3cc0 0x7f243c0a6180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f245410ab20 tx=0x7f2448009260 comp rx=0 tx=0).stop 2024-04-26T11:30:41.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.476+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 msgr2=0x7f24541a7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:41.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.476+0000 7f245be00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 0x7f24541a7100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f244c004cb0 tx=0x7f244c004ce0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.477+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 shutdown_connections 2024-04-26T11:30:41.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.477+0000 7f245be00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f245410b660 0x7f24541a7100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.477+0000 7f245be00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2454109ac0 0x7f245419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.477+0000 7f245be00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f243c0a3cc0 0x7f243c0a6180 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.477+0000 7f245be00700 1 --2- 172.21.15.110:0/479271298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f245410acc0 0x7f24541a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:41.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.477+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 >> 172.21.15.110:0/479271298 conn(0x7f2454078a90 msgr2=0x7f245410dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:41.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.477+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 shutdown_connections 2024-04-26T11:30:41.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:41.477+0000 7f245be00700 1 -- 172.21.15.110:0/479271298 wait complete. 2024-04-26T11:30:41.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:41 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/479271298' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T11:30:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:41 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/479271298' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T11:30:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:41 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/479271298' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T11:30:42.321 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-26T11:30:42.332 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:30:42.782 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:42.956 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:42 smithi110 ceph-mon[28069]: pgmap v433: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:42 smithi196 ceph-mon[32572]: pgmap v433: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:42 smithi193 ceph-mon[32782]: pgmap v433: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:45.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.046+0000 7ff57d200700 1 -- 172.21.15.110:0/777274829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff578103e30 msgr2=0x7ff578110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:45.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.046+0000 7ff57d200700 1 --2- 172.21.15.110:0/777274829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff578103e30 0x7ff578110290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff57000b0a0 tx=0x7ff57000b3b0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.046+0000 7ff57d200700 1 -- 172.21.15.110:0/777274829 shutdown_connections 2024-04-26T11:30:45.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.046+0000 7ff57d200700 1 --2- 172.21.15.110:0/777274829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff578103e30 0x7ff578110290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.046+0000 7ff57d200700 1 --2- 172.21.15.110:0/777274829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5781094c0 0x7ff5781098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.046+0000 7ff57d200700 1 --2- 172.21.15.110:0/777274829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff578103470 0x7ff5781038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.046+0000 7ff57d200700 1 -- 172.21.15.110:0/777274829 >> 172.21.15.110:0/777274829 conn(0x7ff57807a580 msgr2=0x7ff57807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:45.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.046+0000 7ff57d200700 1 -- 172.21.15.110:0/777274829 shutdown_connections 2024-04-26T11:30:45.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.046+0000 7ff57d200700 1 -- 172.21.15.110:0/777274829 wait complete. 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.047+0000 7ff57d200700 1 Processor -- start 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.047+0000 7ff57d200700 1 -- start start 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff57d200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff578103470 0x7ff5781a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff57d200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff578103e30 0x7ff5781a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff57d200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5781094c0 0x7ff57819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff57d200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff578113610 con 0x7ff578103470 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff57d200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff578113490 con 0x7ff5781094c0 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff57d200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff578113790 con 0x7ff578103e30 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff575e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff578103470 0x7ff5781a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff575e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff578103470 0x7ff5781a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57172/0 (socket says 172.21.15.110:57172) 2024-04-26T11:30:45.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff575e00700 1 -- 172.21.15.110:0/1718387344 learned_addr learned my addr 172.21.15.110:0/1718387344 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:45.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff576800700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5781094c0 0x7ff57819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:45.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.048+0000 7ff575400700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff578103e30 0x7ff5781a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:45.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.049+0000 7ff576800700 1 -- 172.21.15.110:0/1718387344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff578103e30 msgr2=0x7ff5781a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:45.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.049+0000 7ff576800700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff578103e30 0x7ff5781a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.049+0000 7ff576800700 1 -- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff578103470 msgr2=0x7ff5781a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:45.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.049+0000 7ff576800700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff578103470 0x7ff5781a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.049+0000 7ff576800700 1 -- 172.21.15.110:0/1718387344 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57819c250 con 0x7ff5781094c0 2024-04-26T11:30:45.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.049+0000 7ff575e00700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff578103470 0x7ff5781a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:30:45.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.049+0000 7ff576800700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5781094c0 0x7ff57819baf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff5700062a0 tx=0x7ff570004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:45.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.050+0000 7ff56ea00700 1 -- 172.21.15.110:0/1718387344 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570021070 con 0x7ff5781094c0 2024-04-26T11:30:45.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.050+0000 7ff56ea00700 1 -- 172.21.15.110:0/1718387344 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff570004e30 con 0x7ff5781094c0 2024-04-26T11:30:45.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.050+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57819c4e0 con 0x7ff5781094c0 2024-04-26T11:30:45.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.050+0000 7ff56ea00700 1 -- 172.21.15.110:0/1718387344 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570004620 con 0x7ff5781094c0 2024-04-26T11:30:45.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.050+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5781a8800 con 0x7ff5781094c0 2024-04-26T11:30:45.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.051+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57806a110 con 0x7ff5781094c0 2024-04-26T11:30:45.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.053+0000 7ff56ea00700 1 -- 172.21.15.110:0/1718387344 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff570007980 con 0x7ff5781094c0 2024-04-26T11:30:45.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.054+0000 7ff56ea00700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff55c0a3c40 0x7ff55c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:45.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.054+0000 7ff56ea00700 1 -- 172.21.15.110:0/1718387344 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7ff57000f020 con 0x7ff5781094c0 2024-04-26T11:30:45.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.055+0000 7ff575e00700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff55c0a3c40 0x7ff55c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:45.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.055+0000 7ff575e00700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff55c0a3c40 0x7ff55c0a6100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff568011550 tx=0x7ff568009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:45.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.057+0000 7ff56ea00700 1 -- 172.21.15.110:0/1718387344 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff57002a020 con 0x7ff5781094c0 2024-04-26T11:30:45.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.345+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5781a89d0 con 0x7ff5781094c0 2024-04-26T11:30:45.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.346+0000 7ff56ea00700 1 -- 172.21.15.110:0/1718387344 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11889 (secure 0 0 0) 0x7ff57009e5c0 con 0x7ff5781094c0 2024-04-26T11:30:45.348 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:30:45.348 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:27:39.501334+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24502,24518,24487]},"id":1}]} 2024-04-26T11:30:45.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.349+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff55c0a3c40 msgr2=0x7ff55c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:45.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.349+0000 7ff57d200700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff55c0a3c40 0x7ff55c0a6100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff568011550 tx=0x7ff568009260 comp rx=0 tx=0).stop 2024-04-26T11:30:45.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5781094c0 msgr2=0x7ff57819baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:45.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5781094c0 0x7ff57819baf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff5700062a0 tx=0x7ff570004c80 comp rx=0 tx=0).stop 2024-04-26T11:30:45.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 shutdown_connections 2024-04-26T11:30:45.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff5781094c0 0x7ff57819baf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff578103470 0x7ff5781a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7ff55c0a3c40 0x7ff55c0a6100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 --2- 172.21.15.110:0/1718387344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff578103e30 0x7ff5781a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:45.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 >> 172.21.15.110:0/1718387344 conn(0x7ff57807a580 msgr2=0x7ff57810e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:45.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 shutdown_connections 2024-04-26T11:30:45.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:45.350+0000 7ff57d200700 1 -- 172.21.15.110:0/1718387344 wait complete. 2024-04-26T11:30:45.353 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-04-26T11:30:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:45 smithi193 ceph-mon[32782]: pgmap v434: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:45 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1718387344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:30:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:45 smithi196 ceph-mon[32572]: pgmap v434: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:45 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1718387344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:30:46.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:45 smithi110 ceph-mon[28069]: pgmap v434: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:46.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:45 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1718387344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:30:46.209 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:30:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:47.911 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:47 smithi110 ceph-mon[28069]: pgmap v435: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:47 smithi196 ceph-mon[32572]: pgmap v435: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:47 smithi193 ceph-mon[32782]: pgmap v435: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:48.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.915+0000 7f6b1f200700 1 -- 172.21.15.110:0/2800214040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b2010b600 msgr2=0x7f6b2010b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:48.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.915+0000 7f6b1f200700 1 --2- 172.21.15.110:0/2800214040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b2010b600 0x7f6b2010b9e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b100099c0 tx=0x7f6b10009cd0 comp rx=0 tx=0).stop 2024-04-26T11:30:48.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.915+0000 7f6b1f200700 1 -- 172.21.15.110:0/2800214040 shutdown_connections 2024-04-26T11:30:48.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.915+0000 7f6b1f200700 1 --2- 172.21.15.110:0/2800214040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b20105f10 0x7f6b201123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:48.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.915+0000 7f6b1f200700 1 --2- 172.21.15.110:0/2800214040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b2010b600 0x7f6b2010b9e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:48.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.915+0000 7f6b1f200700 1 --2- 172.21.15.110:0/2800214040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b20105550 0x7f6b201059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:48.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.915+0000 7f6b1f200700 1 -- 172.21.15.110:0/2800214040 >> 172.21.15.110:0/2800214040 conn(0x7f6b20101000 msgr2=0x7f6b20103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:48.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.915+0000 7f6b1f200700 1 -- 172.21.15.110:0/2800214040 shutdown_connections 2024-04-26T11:30:48.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.916+0000 7f6b1f200700 1 -- 172.21.15.110:0/2800214040 wait complete. 2024-04-26T11:30:48.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.917+0000 7f6b1f200700 1 Processor -- start 2024-04-26T11:30:48.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.917+0000 7f6b1f200700 1 -- start start 2024-04-26T11:30:48.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1f200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b20105550 0x7f6b201a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:48.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1f200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b20105f10 0x7f6b201a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:48.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1f200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b2010b600 0x7f6b2019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1f200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6b20115720 con 0x7f6b2010b600 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1f200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6b201155a0 con 0x7f6b20105550 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1f200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6b201158a0 con 0x7f6b20105f10 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1de00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b20105550 0x7f6b201a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1de00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b20105550 0x7f6b201a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:49304/0 (socket says 172.21.15.110:49304) 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1e800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b2010b600 0x7f6b2019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1de00700 1 -- 172.21.15.110:0/3002278818 learned_addr learned my addr 172.21.15.110:0/3002278818 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1d400700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b20105f10 0x7f6b201a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1de00700 1 -- 172.21.15.110:0/3002278818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b20105f10 msgr2=0x7f6b201a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1de00700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b20105f10 0x7f6b201a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1de00700 1 -- 172.21.15.110:0/3002278818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b2010b600 msgr2=0x7f6b2019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.918+0000 7f6b1de00700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b2010b600 0x7f6b2019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:48.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.919+0000 7f6b1de00700 1 -- 172.21.15.110:0/3002278818 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2019c0a0 con 0x7f6b20105550 2024-04-26T11:30:48.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.919+0000 7f6b1de00700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b20105550 0x7f6b201a1780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b100098e0 tx=0x7f6b100057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:48.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.919+0000 7f6b16a00700 1 -- 172.21.15.110:0/3002278818 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10027070 con 0x7f6b20105550 2024-04-26T11:30:48.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.919+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2019c330 con 0x7f6b20105550 2024-04-26T11:30:48.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.919+0000 7f6b16a00700 1 -- 172.21.15.110:0/3002278818 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b10003f20 con 0x7f6b20105550 2024-04-26T11:30:48.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.919+0000 7f6b16a00700 1 -- 172.21.15.110:0/3002278818 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10022ca0 con 0x7f6b20105550 2024-04-26T11:30:48.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.919+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b201a8650 con 0x7f6b20105550 2024-04-26T11:30:48.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.920+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b2010da90 con 0x7f6b20105550 2024-04-26T11:30:48.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.922+0000 7f6b16a00700 1 -- 172.21.15.110:0/3002278818 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f6b1002a070 con 0x7f6b20105550 2024-04-26T11:30:48.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.924+0000 7f6b16a00700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b040a3c40 0x7f6b040a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:48.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.924+0000 7f6b16a00700 1 -- 172.21.15.110:0/3002278818 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f6b100d1780 con 0x7f6b20105550 2024-04-26T11:30:48.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.924+0000 7f6b1d400700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b040a3c40 0x7f6b040a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:48.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.925+0000 7f6b1d400700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b040a3c40 0x7f6b040a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b2010abc0 tx=0x7f6b0c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:48.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:48.926+0000 7f6b16a00700 1 -- 172.21.15.110:0/3002278818 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6b10013070 con 0x7f6b20105550 2024-04-26T11:30:49.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.204+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b2019ce70 con 0x7f6b20105550 2024-04-26T11:30:49.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.205+0000 7f6b16a00700 1 -- 172.21.15.110:0/3002278818 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11889 (secure 0 0 0) 0x7f6b1009e0f0 con 0x7f6b20105550 2024-04-26T11:30:49.206 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:30:49.206 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:27:39.501334+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24502,24518,24487]},"id":1}]} 2024-04-26T11:30:49.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b040a3c40 msgr2=0x7f6b040a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:49.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b040a3c40 0x7f6b040a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b2010abc0 tx=0x7f6b0c0073d0 comp rx=0 tx=0).stop 2024-04-26T11:30:49.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b20105550 msgr2=0x7f6b201a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:49.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b20105550 0x7f6b201a1780 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b100098e0 tx=0x7f6b100057c0 comp rx=0 tx=0).stop 2024-04-26T11:30:49.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 shutdown_connections 2024-04-26T11:30:49.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b2010b600 0x7f6b2019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:49.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6b20105550 0x7f6b201a1780 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:49.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f6b040a3c40 0x7f6b040a6100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:49.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 --2- 172.21.15.110:0/3002278818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b20105f10 0x7f6b201a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:49.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.208+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 >> 172.21.15.110:0/3002278818 conn(0x7f6b20101000 msgr2=0x7f6b20102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:49.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.209+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 shutdown_connections 2024-04-26T11:30:49.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:49.209+0000 7f6b1f200700 1 -- 172.21.15.110:0/3002278818 wait complete. 2024-04-26T11:30:49.211 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-04-26T11:30:49.994 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:49 smithi110 ceph-mon[28069]: pgmap v436: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:49.994 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:49 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3002278818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:30:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:49 smithi196 ceph-mon[32572]: pgmap v436: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:49 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3002278818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:30:50.074 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T11:30:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:49 smithi193 ceph-mon[32782]: pgmap v436: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T11:30:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:49 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3002278818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:30:50.528 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:51.997 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:51 smithi110 ceph-mon[28069]: pgmap v437: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:51 smithi196 ceph-mon[32572]: pgmap v437: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:51 smithi193 ceph-mon[32782]: pgmap v437: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:52.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.891+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1866697963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f9c103e30 msgr2=0x7f8f9c110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:52.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.891+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1866697963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f9c103e30 0x7f8f9c110290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b0a0 tx=0x7f8f9400b3b0 comp rx=0 tx=0).stop 2024-04-26T11:30:52.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.891+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1866697963 shutdown_connections 2024-04-26T11:30:52.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.891+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1866697963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f9c103e30 0x7f8f9c110290 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:52.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.891+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1866697963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9c1094c0 0x7f8f9c1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:52.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.891+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1866697963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c103470 0x7f8f9c1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:52.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.891+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1866697963 >> 172.21.15.110:0/1866697963 conn(0x7f8f9c07a580 msgr2=0x7f8f9c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:52.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.891+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1866697963 shutdown_connections 2024-04-26T11:30:52.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.891+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1866697963 wait complete. 2024-04-26T11:30:52.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.893+0000 7f8fa2a00700 1 Processor -- start 2024-04-26T11:30:52.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.893+0000 7f8fa2a00700 1 -- start start 2024-04-26T11:30:52.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8fa2a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c103470 0x7f8f9c075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:52.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8fa2a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9c103e30 0x7f8f9c075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:52.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8fa2a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f9c1094c0 0x7f8f9c0761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:52.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8fa2a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c113630 con 0x7f8f9c103470 2024-04-26T11:30:52.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8fa2a00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c1134b0 con 0x7f8f9c1094c0 2024-04-26T11:30:52.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8fa2a00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c1137b0 con 0x7f8f9c103e30 2024-04-26T11:30:52.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8f9be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c103470 0x7f8f9c075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:52.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8f93e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9c103e30 0x7f8f9c075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:52.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8f9be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c103470 0x7f8f9c075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47070/0 (socket says 172.21.15.110:47070) 2024-04-26T11:30:52.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8f9be00700 1 -- 172.21.15.110:0/1039790020 learned_addr learned my addr 172.21.15.110:0/1039790020 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.894+0000 7f8fa0a00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f9c1094c0 0x7f8f9c0761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.895+0000 7f8f9be00700 1 -- 172.21.15.110:0/1039790020 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9c103e30 msgr2=0x7f8f9c075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.895+0000 7f8f9be00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9c103e30 0x7f8f9c075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.895+0000 7f8f9be00700 1 -- 172.21.15.110:0/1039790020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f9c1094c0 msgr2=0x7f8f9c0761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.895+0000 7f8f9be00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f9c1094c0 0x7f8f9c0761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.895+0000 7f8f9be00700 1 -- 172.21.15.110:0/1039790020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c1a8130 con 0x7f8f9c103470 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.895+0000 7f8f9be00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c103470 0x7f8f9c075720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00e9c0 tx=0x7f8f8c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.895+0000 7f8f99600700 1 -- 172.21.15.110:0/1039790020 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c00cbd0 con 0x7f8f9c103470 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.895+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9c1a8420 con 0x7f8f9c103470 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.896+0000 7f8f99600700 1 -- 172.21.15.110:0/1039790020 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f8c00ee60 con 0x7f8f9c103470 2024-04-26T11:30:52.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.896+0000 7f8f99600700 1 -- 172.21.15.110:0/1039790020 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0055c0 con 0x7f8f9c103470 2024-04-26T11:30:52.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.896+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9c1a8960 con 0x7f8f9c103470 2024-04-26T11:30:52.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.897+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9c06a110 con 0x7f8f9c103470 2024-04-26T11:30:52.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.899+0000 7f8f99600700 1 -- 172.21.15.110:0/1039790020 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f8f8c004750 con 0x7f8f9c103470 2024-04-26T11:30:52.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.900+0000 7f8f99600700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f800a3cc0 0x7f8f800a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:52.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.900+0000 7f8f99600700 1 -- 172.21.15.110:0/1039790020 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f8f8c0d0640 con 0x7f8f9c103470 2024-04-26T11:30:52.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.901+0000 7f8f93e00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f800a3cc0 0x7f8f800a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:52.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.901+0000 7f8f93e00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f800a3cc0 0x7f8f800a6180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c07aca0 tx=0x7f8f84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:52.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:52.905+0000 7f8f99600700 1 -- 172.21.15.110:0/1039790020 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8f8c09cf20 con 0x7f8f9c103470 2024-04-26T11:30:53.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.134+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f9c02e490 con 0x7f8f9c103470 2024-04-26T11:30:53.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.138+0000 7f8f99600700 1 -- 172.21.15.110:0/1039790020 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+23015 (secure 0 0 0) 0x7f8f8c09c820 con 0x7f8f9c103470 2024-04-26T11:30:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:30:53.140 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":93,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","created":"2024-04-26T11:17:56.437545+0000","modified":"2024-04-26T11:29:03.588199+0000","last_up_change":"2024-04-26T11:25:57.427695+0000","last_in_change":"2024-04-26T11:25:38.050280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:44.478027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:27:06.034467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T11:27:11.025123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13eb997d-8b4a-47f5-be11-772d47788972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6803","nonce":1662740885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6805","nonce":1662740885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6809","nonce":1662740885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6807","nonce":1662740885}]},"public_addr":"172.21.15.110:6803/1662740885","cluster_addr":"172.21.15.110:6805/1662740885","heartbeat_back_addr":"172.21.15.110:6809/1662740885","heartbeat_front_addr":"172.21.15.110:6807/1662740885","state":["exists","up"]},{"osd":1,"uuid":"e7927dc3-dced-4661-8493-840e111241e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6801","nonce":1751461680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6803","nonce":1751461680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6807","nonce":1751461680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6805","nonce":1751461680}]},"public_addr":"172.21.15.193:6801/1751461680","cluster_addr":"172.21.15.193:6803/1751461680","heartbeat_back_addr":"172.21.15.193:6807/1751461680","heartbeat_front_addr":"172.21.15.193:6805/1751461680","state":["exists","up"]},{"osd":2,"uuid":"54459a80-91a1-45ba-b7e4-900a4a995219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6801","nonce":1785522554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6803","nonce":1785522554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6807","nonce":1785522554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6805","nonce":1785522554}]},"public_addr":"172.21.15.196:6801/1785522554","cluster_addr":"172.21.15.196:6803/1785522554","heartbeat_back_addr":"172.21.15.196:6807/1785522554","heartbeat_front_addr":"172.21.15.196:6805/1785522554","state":["exists","up"]},{"osd":3,"uuid":"12d8a1be-5edb-4af2-b01d-abd943f89641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6811","nonce":2253549266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6813","nonce":2253549266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6817","nonce":2253549266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6815","nonce":2253549266}]},"public_addr":"172.21.15.110:6811/2253549266","cluster_addr":"172.21.15.110:6813/2253549266","heartbeat_back_addr":"172.21.15.110:6817/2253549266","heartbeat_front_addr":"172.21.15.110:6815/2253549266","state":["exists","up"]},{"osd":4,"uuid":"f3057080-144b-4f43-9a63-8f415ca76d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6809","nonce":1314161856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6811","nonce":1314161856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6815","nonce":1314161856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6813","nonce":1314161856}]},"public_addr":"172.21.15.193:6809/1314161856","cluster_addr":"172.21.15.193:6811/1314161856","heartbeat_back_addr":"172.21.15.193:6815/1314161856","heartbeat_front_addr":"172.21.15.193:6813/1314161856","state":["exists","up"]},{"osd":5,"uuid":"f0775b9c-938e-4bb4-ae1e-01ef0686cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6809","nonce":2359280243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6811","nonce":2359280243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6815","nonce":2359280243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6813","nonce":2359280243}]},"public_addr":"172.21.15.196:6809/2359280243","cluster_addr":"172.21.15.196:6811/2359280243","heartbeat_back_addr":"172.21.15.196:6815/2359280243","heartbeat_front_addr":"172.21.15.196:6813/2359280243","state":["exists","up"]},{"osd":6,"uuid":"ea4ea3de-4ec4-48a1-809e-da62fcbb7033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6819","nonce":1730783886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6821","nonce":1730783886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6825","nonce":1730783886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6823","nonce":1730783886}]},"public_addr":"172.21.15.110:6819/1730783886","cluster_addr":"172.21.15.110:6821/1730783886","heartbeat_back_addr":"172.21.15.110:6825/1730783886","heartbeat_front_addr":"172.21.15.110:6823/1730783886","state":["exists","up"]},{"osd":7,"uuid":"98af7071-82b3-4732-b2a1-8676e6439cd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6817","nonce":4124476381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6819","nonce":4124476381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6823","nonce":4124476381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6821","nonce":4124476381}]},"public_addr":"172.21.15.193:6817/4124476381","cluster_addr":"172.21.15.193:6819/4124476381","heartbeat_back_addr":"172.21.15.193:6823/4124476381","heartbeat_front_addr":"172.21.15.193:6821/4124476381","state":["exists","up"]},{"osd":8,"uuid":"7aaa3c52-72f5-4946-a964-609f65b778f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6817","nonce":2942176519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6819","nonce":2942176519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6823","nonce":2942176519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6821","nonce":2942176519}]},"public_addr":"172.21.15.196:6817/2942176519","cluster_addr":"172.21.15.196:6819/2942176519","heartbeat_back_addr":"172.21.15.196:6823/2942176519","heartbeat_front_addr":"172.21.15.196:6821/2942176519","state":["exists","up"]},{"osd":9,"uuid":"2cde3ed2-6acd-48a4-a99d-aa558dd85baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6827","nonce":2620757358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6829","nonce":2620757358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6833","nonce":2620757358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6831","nonce":2620757358}]},"public_addr":"172.21.15.110:6827/2620757358","cluster_addr":"172.21.15.110:6829/2620757358","heartbeat_back_addr":"172.21.15.110:6833/2620757358","heartbeat_front_addr":"172.21.15.110:6831/2620757358","state":["exists","up"]},{"osd":10,"uuid":"3bbaac8f-fe7b-4f0e-a25b-286c3c30926e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6825","nonce":676480728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6827","nonce":676480728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6831","nonce":676480728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6829","nonce":676480728}]},"public_addr":"172.21.15.193:6825/676480728","cluster_addr":"172.21.15.193:6827/676480728","heartbeat_back_addr":"172.21.15.193:6831/676480728","heartbeat_front_addr":"172.21.15.193:6829/676480728","state":["exists","up"]},{"osd":11,"uuid":"e31c248e-1016-4765-bea1-9f31d823ca3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6825","nonce":2802765812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6827","nonce":2802765812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6831","nonce":2802765812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6829","nonce":2802765812}]},"public_addr":"172.21.15.196:6825/2802765812","cluster_addr":"172.21.15.196:6827/2802765812","heartbeat_back_addr":"172.21.15.196:6831/2802765812","heartbeat_front_addr":"172.21.15.196:6829/2802765812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:20:52.046788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:16.893940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:40.861409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:13.272469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:39.214479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:03.529206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:37.413989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:04.145639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:29.162356+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:03.325672+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:30.353695+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:56.267402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3278958945":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6801/4292256031":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3536224934":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2250601964":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/2775667488":"2024-04-27T11:18:29.387925+0000","172.21.15.110:6801/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/337370067":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3594651859":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/4292256031":"2024-04-27T11:19:02.329691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:30:53.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f800a3cc0 msgr2=0x7f8f800a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:53.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f800a3cc0 0x7f8f800a6180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c07aca0 tx=0x7f8f84009260 comp rx=0 tx=0).stop 2024-04-26T11:30:53.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c103470 msgr2=0x7f8f9c075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:53.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c103470 0x7f8f9c075720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00e9c0 tx=0x7f8f8c00ecd0 comp rx=0 tx=0).stop 2024-04-26T11:30:53.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 shutdown_connections 2024-04-26T11:30:53.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f9c1094c0 0x7f8f9c0761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:53.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f9c103470 0x7f8f9c075720 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:53.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f8f800a3cc0 0x7f8f800a6180 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:53.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 --2- 172.21.15.110:0/1039790020 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f9c103e30 0x7f8f9c075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:53.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 >> 172.21.15.110:0/1039790020 conn(0x7f8f9c07a580 msgr2=0x7f8f9c102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:53.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 shutdown_connections 2024-04-26T11:30:53.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:53.141+0000 7f8fa2a00700 1 -- 172.21.15.110:0/1039790020 wait complete. 2024-04-26T11:30:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:53 smithi110 ceph-mon[28069]: pgmap v438: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:30:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:53 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1039790020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:30:53.993 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T11:27:14.996270+0000', 'modified': '2024-04-26T11:27:39.501334+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24518, 'mds_1': 24502, 'mds_2': 24487}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24467': {'gid': 24467, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6835/2038926783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 2038926783}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 2038926783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6835/1499716677', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 1499716677}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 1499716677}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6837/324089889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 324089889}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 324089889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.196:6837/1521745566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 1521745566}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 1521745566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.196:6839/1849808245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6838', 'nonce': 1849808245}, {'type': 'v1', 'addr': '172.21.15.196:6839', 'nonce': 1849808245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6839/64494456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 64494456}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 64494456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24518, 'qdb_cluster': [24502, 24518, 24487]} 2024-04-26T11:30:53.993 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-26T11:30:53.994 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell mds.c status 2024-04-26T11:30:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:53 smithi196 ceph-mon[32572]: pgmap v438: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:30:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:53 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1039790020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:30:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:53 smithi193 ceph-mon[32782]: pgmap v438: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:30:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:53 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1039790020' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:30:54.430 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:55 smithi196 ceph-mon[32572]: pgmap v439: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:55 smithi110 ceph-mon[28069]: pgmap v439: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:55 smithi193 ceph-mon[32782]: pgmap v439: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:30:56.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.672+0000 7fa739800700 1 -- 172.21.15.110:0/1757309845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa734105640 msgr2=0x7fa734105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.672+0000 7fa739800700 1 --2- 172.21.15.110:0/1757309845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa734105640 0x7fa734105ac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009990 tx=0x7fa71c009ca0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.672+0000 7fa739800700 1 -- 172.21.15.110:0/1757309845 shutdown_connections 2024-04-26T11:30:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.672+0000 7fa739800700 1 --2- 172.21.15.110:0/1757309845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa734106000 0x7fa734112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.673+0000 7fa739800700 1 --2- 172.21.15.110:0/1757309845 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa73410b640 0x7fa73410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.673+0000 7fa739800700 1 --2- 172.21.15.110:0/1757309845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa734105640 0x7fa734105ac0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.673+0000 7fa739800700 1 -- 172.21.15.110:0/1757309845 >> 172.21.15.110:0/1757309845 conn(0x7fa734101130 msgr2=0x7fa734103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.673+0000 7fa739800700 1 -- 172.21.15.110:0/1757309845 shutdown_connections 2024-04-26T11:30:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.673+0000 7fa739800700 1 -- 172.21.15.110:0/1757309845 wait complete. 2024-04-26T11:30:56.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.674+0000 7fa739800700 1 Processor -- start 2024-04-26T11:30:56.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.674+0000 7fa739800700 1 -- start start 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.674+0000 7fa739800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa734105640 0x7fa73419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.674+0000 7fa739800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa734106000 0x7fa73419c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.674+0000 7fa739800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73410b640 0x7fa7341a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.674+0000 7fa739800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa7341158e0 con 0x7fa73410b640 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.674+0000 7fa739800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa734115760 con 0x7fa734106000 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.674+0000 7fa739800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa734115a60 con 0x7fa734105640 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa732a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa734105640 0x7fa73419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa732a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa734105640 0x7fa73419be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:52500/0 (socket says 172.21.15.110:52500) 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa732a00700 1 -- 172.21.15.110:0/153922360 learned_addr learned my addr 172.21.15.110:0/153922360 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa733400700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73410b640 0x7fa7341a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa72a000700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa734106000 0x7fa73419c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa732a00700 1 -- 172.21.15.110:0/153922360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa734106000 msgr2=0x7fa73419c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa732a00700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa734106000 0x7fa73419c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa732a00700 1 -- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73410b640 msgr2=0x7fa7341a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa732a00700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73410b640 0x7fa7341a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa732a00700 1 -- 172.21.15.110:0/153922360 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7341a0e60 con 0x7fa734105640 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.675+0000 7fa732a00700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa734105640 0x7fa73419be50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa72400b530 tx=0x7fa72400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.676+0000 7fa72be00700 1 -- 172.21.15.110:0/153922360 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724015020 con 0x7fa734105640 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.676+0000 7fa72be00700 1 -- 172.21.15.110:0/153922360 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa724011ce0 con 0x7fa734105640 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.676+0000 7fa739800700 1 -- 172.21.15.110:0/153922360 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7341a1150 con 0x7fa734105640 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.676+0000 7fa72be00700 1 -- 172.21.15.110:0/153922360 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724010dd0 con 0x7fa734105640 2024-04-26T11:30:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.676+0000 7fa739800700 1 -- 172.21.15.110:0/153922360 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7341a89d0 con 0x7fa734105640 2024-04-26T11:30:56.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.679+0000 7fa72be00700 1 -- 172.21.15.110:0/153922360 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa724018020 con 0x7fa734105640 2024-04-26T11:30:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.681+0000 7fa7440f5b80 1 Processor -- start 2024-04-26T11:30:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.681+0000 7fa7440f5b80 1 -- start start 2024-04-26T11:30:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.681+0000 7fa72be00700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa7180a3cc0 0x7fa7180a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119822f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x55651197c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197cb80 0x556511988cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5565118cf990 con 0x556511981f10 2024-04-26T11:30:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55651186e1f0 con 0x55651197cb80 2024-04-26T11:30:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5565118cb950 con 0x55651197c1c0 2024-04-26T11:30:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa72be00700 1 -- 172.21.15.110:0/153922360 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fa7240cfb60 con 0x7fa734105640 2024-04-26T11:30:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa733400700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa7180a3cc0 0x7fa7180a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa732a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa732a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119822f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47100/0 (socket says 172.21.15.110:47100) 2024-04-26T11:30:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa732a00700 1 -- 172.21.15.110:0/2003811101 learned_addr learned my addr 172.21.15.110:0/2003811101 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa72a000700 1 --2- 172.21.15.110:0/2003811101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x55651197c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa732a00700 1 -- 172.21.15.110:0/2003811101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 msgr2=0x55651197c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa732a00700 1 --2- 172.21.15.110:0/2003811101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x55651197c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa732a00700 1 -- 172.21.15.110:0/2003811101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197cb80 msgr2=0x556511988cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa732a00700 1 --2- 172.21.15.110:0/2003811101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197cb80 0x556511988cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.682+0000 7fa732a00700 1 -- 172.21.15.110:0/2003811101 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556511876710 con 0x556511981f10 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.683+0000 7fa733400700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa7180a3cc0 0x7fa7180a6180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009900 tx=0x7fa72c009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.683+0000 7fa732a00700 1 --2- 172.21.15.110:0/2003811101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119822f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa7240981a0 tx=0x7fa72409bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9918bc4ee985446b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.683+0000 7fa723e00700 1 -- 172.21.15.110:0/2003811101 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724091480 con 0x556511981f10 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.683+0000 7fa723e00700 1 -- 172.21.15.110:0/2003811101 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa72409c440 con 0x556511981f10 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.683+0000 7fa723e00700 1 -- 172.21.15.110:0/2003811101 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7240104a0 con 0x556511981f10 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.684+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2003811101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 msgr2=0x5565119822f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.684+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/2003811101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119822f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa7240981a0 tx=0x7fa72409bc10 comp rx=0 tx=0).stop 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.684+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2003811101 shutdown_connections 2024-04-26T11:30:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.684+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/2003811101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197cb80 0x556511988cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.684+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/2003811101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119822f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.684+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/2003811101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x55651197c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.684+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2003811101 >> 172.21.15.110:0/2003811101 conn(0x5565118aa3f0 msgr2=0x556511976ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:56.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.684+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2003811101 shutdown_connections 2024-04-26T11:30:56.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.684+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2003811101 wait complete. 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.685+0000 7fa7440f5b80 1 -- start start 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.685+0000 7fa7440f5b80 1 Processor -- start 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.685+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511988990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.685+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197cb80 0x556511985c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.685+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119861d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.685+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556511989210 con 0x556511981f10 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55651186a440 con 0x55651197cb80 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556511989390 con 0x55651197c1c0 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa7440f5b80 10 client.0 _ll_register_callbacks cb 0x556511863330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa732a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511988990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa732a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511988990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:52506/0 (socket says 172.21.15.110:52506) 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa732a00700 1 -- 172.21.15.110:0/1693594452 learned_addr learned my addr 172.21.15.110:0/1693594452 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa72a000700 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197cb80 0x556511985c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa733400700 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119861d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa732a00700 1 -- 172.21.15.110:0/1693594452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197cb80 msgr2=0x556511985c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa732a00700 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197cb80 0x556511985c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa732a00700 1 -- 172.21.15.110:0/1693594452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 msgr2=0x5565119861d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa732a00700 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119861d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa732a00700 1 -- 172.21.15.110:0/1693594452 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55651181c880 con 0x55651197c1c0 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa732a00700 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511988990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa72400bb90 tx=0x7fa72409bd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19e4d117132391dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.686+0000 7fa720c00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:30:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.687+0000 7fa720c00700 1 -- 172.21.15.110:0/1693594452 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72409bfa0 con 0x55651197c1c0 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.687+0000 7fa720c00700 1 -- 172.21.15.110:0/1693594452 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fa72409c140 con 0x55651197c1c0 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.687+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1693594452 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa72409c440 con 0x55651197c1c0 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.687+0000 7fa720c00700 1 -- 172.21.15.110:0/1693594452 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7240b51f0 con 0x55651197c1c0 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.687+0000 7fa7440f5b80 10 client.24985 fetch_fsmap learned FSMap version 25 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.687+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1693594452 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556511989210 con 0x55651197c1c0 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.687+0000 7fa720c00700 1 -- 172.21.15.110:0/1693594452 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa72409c440 con 0x55651197c1c0 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.688+0000 7fa720c00700 1 -- 172.21.15.110:0/1693594452 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fa724092c20 con 0x55651197c1c0 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.688+0000 7fa7440f5b80 10 client.24985 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.688+0000 7fa7440f5b80 10 client.24985 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.688+0000 7fa7440f5b80 20 client.24985 populate_metadata read hostname 'smithi110' 2024-04-26T11:30:56.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.688+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x5565119959f0 0x556511996e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.688+0000 7fa7440f5b80 4 client.24985 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:30:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.688+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1693594452 --> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556511948b20 con 0x5565119959f0 2024-04-26T11:30:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.688+0000 7fa72a000700 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x5565119959f0 0x556511996e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.689+0000 7fa72a000700 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x5565119959f0 0x556511996e60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=abc4bba552e6abb9 server_cookie=9e134e7192bb70a5 in_seq=0 out_seq=0 2024-04-26T11:30:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.689+0000 7fa720c00700 10 client.24985 ms_handle_connect on v2:172.21.15.196:6836/1521745566 2024-04-26T11:30:56.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa720c00700 1 -- 172.21.15.110:0/1693594452 <== mds.2 v2:172.21.15.196:6836/1521745566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556511948b20 con 0x5565119959f0 2024-04-26T11:30:56.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa720c00700 10 client.24985 handle_command_reply: tid=0 2024-04-26T11:30:56.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa7440f5b80 1 client.24985 shutdown 2024-04-26T11:30:56.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1693594452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 msgr2=0x556511988990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:56.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511988990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa72400bb90 tx=0x7fa72409bd40 comp rx=0 tx=0).stop 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1693594452 shutdown_connections 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x5565119959f0 0x556511996e60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556511981f10 0x5565119861d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511988990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1693594452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197cb80 0x556511985c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1693594452 >> 172.21.15.110:0/1693594452 conn(0x5565118aa3f0 msgr2=0x5565119715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.690+0000 7fa720c00700 0 client.24985 ms_handle_reset on v2:172.21.15.196:6836/1521745566 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.691+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1693594452 shutdown_connections 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.691+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1693594452 wait complete. 2024-04-26T11:30:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.691+0000 7fa7440f5b80 20 client.24985 trim_cache size 0 max 16384 2024-04-26T11:30:56.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.713+0000 7fa7440f5b80 1 Processor -- start 2024-04-26T11:30:56.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.713+0000 7fa7440f5b80 1 -- start start 2024-04-26T11:30:56.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.713+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511980d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.713+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 0x556511981260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.713+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556511981f10 0x5565119a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.713+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5565119951a0 con 0x55651197cb80 2024-04-26T11:30:56.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.713+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556511995870 con 0x556511981f10 2024-04-26T11:30:56.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.713+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556511995f40 con 0x55651197c1c0 2024-04-26T11:30:56.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa732a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511980d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa733400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556511981f10 0x5565119a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa732a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511980d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:52518/0 (socket says 172.21.15.110:52518) 2024-04-26T11:30:56.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa732a00700 1 -- 172.21.15.110:0/2704803315 learned_addr learned my addr 172.21.15.110:0/2704803315 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:56.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa72a000700 1 --2- 172.21.15.110:0/2704803315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 0x556511981260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa732a00700 1 -- 172.21.15.110:0/2704803315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556511981f10 msgr2=0x5565119a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:56.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa732a00700 1 --2- 172.21.15.110:0/2704803315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556511981f10 0x5565119a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa732a00700 1 -- 172.21.15.110:0/2704803315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 msgr2=0x556511981260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa732a00700 1 --2- 172.21.15.110:0/2704803315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 0x556511981260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa732a00700 1 -- 172.21.15.110:0/2704803315 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556511981b30 con 0x55651197c1c0 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa72a000700 1 --2- 172.21.15.110:0/2704803315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 0x556511981260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.714+0000 7fa732a00700 1 --2- 172.21.15.110:0/2704803315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511980d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa724099ff0 tx=0x7fa724009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcfadaa8fe6b857b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa723400700 1 -- 172.21.15.110:0/2704803315 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7240a00f0 con 0x55651197c1c0 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa723400700 1 -- 172.21.15.110:0/2704803315 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7240bc1d0 con 0x55651197c1c0 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa723400700 1 -- 172.21.15.110:0/2704803315 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7240a4780 con 0x55651197c1c0 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2704803315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 msgr2=0x556511980d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/2704803315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511980d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa724099ff0 tx=0x7fa724009400 comp rx=0 tx=0).stop 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2704803315 shutdown_connections 2024-04-26T11:30:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/2704803315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556511981f10 0x5565119a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/2704803315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55651197c1c0 0x556511980d20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/2704803315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 0x556511981260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2704803315 >> 172.21.15.110:0/2704803315 conn(0x5565118aa3f0 msgr2=0x5565119715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:56.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.715+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2704803315 shutdown_connections 2024-04-26T11:30:56.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.716+0000 7fa7440f5b80 1 -- 172.21.15.110:0/2704803315 wait complete. 2024-04-26T11:30:56.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.716+0000 7fa7440f5b80 1 -- start start 2024-04-26T11:30:56.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.716+0000 7fa7440f5b80 1 Processor -- start 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197c1c0 0x55651199c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 0x55651199ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa7440f5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556511981f10 0x5565119fe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556511996ce0 con 0x55651197cb80 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556511996610 con 0x55651197c1c0 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa7440f5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5565119973b0 con 0x556511981f10 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa7440f5b80 10 client.0 _ll_register_callbacks cb 0x556511863330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa733400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556511981f10 0x5565119fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa72a000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 0x55651199ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa733400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556511981f10 0x5565119fe370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:52530/0 (socket says 172.21.15.110:52530) 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa733400700 1 -- 172.21.15.110:0/1656004135 learned_addr learned my addr 172.21.15.110:0/1656004135 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:30:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa732a00700 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197c1c0 0x55651199c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa733400700 1 -- 172.21.15.110:0/1656004135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197c1c0 msgr2=0x55651199c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa733400700 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197c1c0 0x55651199c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa733400700 1 -- 172.21.15.110:0/1656004135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 msgr2=0x55651199ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa733400700 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 0x55651199ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.717+0000 7fa733400700 1 -- 172.21.15.110:0/1656004135 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565119fe930 con 0x556511981f10 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.718+0000 7fa733400700 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556511981f10 0x5565119fe370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00ab20 tx=0x7fa72c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2b91a4081f3f05f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.718+0000 7fa720c00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.718+0000 7fa720c00700 1 -- 172.21.15.110:0/1656004135 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c028060 con 0x556511981f10 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.718+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1656004135 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7240bc1d0 con 0x556511981f10 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.718+0000 7fa720c00700 1 -- 172.21.15.110:0/1656004135 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fa72c023450 con 0x556511981f10 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa720c00700 1 -- 172.21.15.110:0/1656004135 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa72c023650 con 0x556511981f10 2024-04-26T11:30:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa7440f5b80 10 client.24991 fetch_fsmap learned FSMap version 25 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1656004135 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556511a05d90 con 0x556511981f10 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa720c00700 1 -- 172.21.15.110:0/1656004135 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7240bc1d0 con 0x556511981f10 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa720c00700 1 -- 172.21.15.110:0/1656004135 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fa72c017070 con 0x556511981f10 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa7440f5b80 10 client.24991 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa7440f5b80 10 client.24991 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa7440f5b80 20 client.24991 populate_metadata read hostname 'smithi110' 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x556511a0a9c0 0x556511a096d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa7440f5b80 4 client.24991 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.719+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1656004135 --> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] -- command(tid 0: {"prefix": "status"}) -- 0x5565118dd370 con 0x556511a0a9c0 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.720+0000 7fa732a00700 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x556511a0a9c0 0x556511a096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:30:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.720+0000 7fa732a00700 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x556511a0a9c0 0x556511a096d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2faedd51c3cda3ea server_cookie=d484437c1cc76052 in_seq=0 out_seq=0 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.720+0000 7fa720c00700 10 client.24991 ms_handle_connect on v2:172.21.15.196:6836/1521745566 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.720+0000 7fa720c00700 1 -- 172.21.15.110:0/1656004135 <== mds.2 v2:172.21.15.196:6836/1521745566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5565118dd370 con 0x556511a0a9c0 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.720+0000 7fa720c00700 10 client.24991 handle_command_reply: tid=0 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.720+0000 7fa7440f5b80 1 client.24991 shutdown 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.720+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1656004135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556511981f10 msgr2=0x5565119fe370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.720+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556511981f10 0x5565119fe370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00ab20 tx=0x7fa72c004ad0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1656004135 shutdown_connections 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556511981f10 0x5565119fe370 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55651197c1c0 0x55651199c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x556511a0a9c0 0x556511a096d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa7440f5b80 1 --2- 172.21.15.110:0/1656004135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55651197cb80 0x55651199ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1656004135 >> 172.21.15.110:0/1656004135 conn(0x5565118aa3f0 msgr2=0x55651197b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:56.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa720c00700 0 client.24991 ms_handle_reset on v2:172.21.15.196:6836/1521745566 2024-04-26T11:30:56.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1656004135 shutdown_connections 2024-04-26T11:30:56.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa7440f5b80 1 -- 172.21.15.110:0/1656004135 wait complete. 2024-04-26T11:30:56.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.721+0000 7fa7440f5b80 20 client.24991 trim_cache size 0 max 16384 2024-04-26T11:30:56.727 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:30:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:30:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 2, 2024-04-26T11:30:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24487, 2024-04-26T11:30:56.727 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-26T11:30:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-26T11:30:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-26T11:30:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 204.11438109299999, 2024-04-26T11:30:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-04-26T11:30:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 93, 2024-04-26T11:30:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T11:30:56.728 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 259.80561464700003 2024-04-26T11:30:56.728 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:30:56.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 -- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa7180a3cc0 msgr2=0x7fa7180a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:56.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa7180a3cc0 0x7fa7180a6180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009900 tx=0x7fa72c009650 comp rx=0 tx=0).stop 2024-04-26T11:30:56.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 -- 172.21.15.110:0/153922360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa734105640 msgr2=0x7fa73419be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:30:56.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa734105640 0x7fa73419be50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa72400b530 tx=0x7fa72400b840 comp rx=0 tx=0).stop 2024-04-26T11:30:56.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 -- 172.21.15.110:0/153922360 shutdown_connections 2024-04-26T11:30:56.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa73410b640 0x7fa7341a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa7180a3cc0 0x7fa7180a6180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa734105640 0x7fa73419be50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 --2- 172.21.15.110:0/153922360 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa734106000 0x7fa73419c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:30:56.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 -- 172.21.15.110:0/153922360 >> 172.21.15.110:0/153922360 conn(0x7fa734101130 msgr2=0x7fa7341018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:30:56.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 -- 172.21.15.110:0/153922360 shutdown_connections 2024-04-26T11:30:56.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:30:56.722+0000 7fa739800700 1 -- 172.21.15.110:0/153922360 wait complete. 2024-04-26T11:30:57.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-26T11:30:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:57 smithi196 ceph-mon[32572]: pgmap v440: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:57 smithi110 ceph-mon[28069]: pgmap v440: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:57 smithi193 ceph-mon[32782]: pgmap v440: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:30:58.193 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:30:59.973 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:30:59 smithi110 ceph-mon[28069]: pgmap v441: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:31:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:30:59 smithi196 ceph-mon[32572]: pgmap v441: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:31:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:30:59 smithi193 ceph-mon[32782]: pgmap v441: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:31:00.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.504+0000 7f0f7e200700 1 -- 172.21.15.110:0/1884205959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 msgr2=0x7f0f78109ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.504+0000 7f0f7e200700 1 --2- 172.21.15.110:0/1884205959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 0x7f0f78109ed0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009990 tx=0x7f0f64009ca0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.505+0000 7f0f7e200700 1 -- 172.21.15.110:0/1884205959 shutdown_connections 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.505+0000 7f0f7e200700 1 --2- 172.21.15.110:0/1884205959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f7810a410 0x7f0f78116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.505+0000 7f0f7e200700 1 --2- 172.21.15.110:0/1884205959 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f7810fa50 0x7f0f7810fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.505+0000 7f0f7e200700 1 --2- 172.21.15.110:0/1884205959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 0x7f0f78109ed0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.505+0000 7f0f7e200700 1 -- 172.21.15.110:0/1884205959 >> 172.21.15.110:0/1884205959 conn(0x7f0f78076bf0 msgr2=0x7f0f78108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.505+0000 7f0f7e200700 1 -- 172.21.15.110:0/1884205959 shutdown_connections 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.505+0000 7f0f7e200700 1 -- 172.21.15.110:0/1884205959 wait complete. 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f7e200700 1 Processor -- start 2024-04-26T11:31:00.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f7e200700 1 -- start start 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f7e200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 0x7f0f781a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f7e200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f7810a410 0x7f0f781a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f7e200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f7810fa50 0x7f0f781a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f7e200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0f78119ca0 con 0x7f0f78109a50 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f7e200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0f78119b20 con 0x7f0f7810fa50 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f7e200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0f78119e20 con 0x7f0f7810a410 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f77400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 0x7f0f781a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f77400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 0x7f0f781a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47140/0 (socket says 172.21.15.110:47140) 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.506+0000 7f0f77400700 1 -- 172.21.15.110:0/474134159 learned_addr learned my addr 172.21.15.110:0/474134159 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.507+0000 7f0f77e00700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f7810fa50 0x7f0f781a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.507+0000 7f0f76a00700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f7810a410 0x7f0f781a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.507+0000 7f0f77400700 1 -- 172.21.15.110:0/474134159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f7810a410 msgr2=0x7f0f781a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.507+0000 7f0f77400700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f7810a410 0x7f0f781a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.507+0000 7f0f77400700 1 -- 172.21.15.110:0/474134159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f7810fa50 msgr2=0x7f0f781a4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:00.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.507+0000 7f0f77400700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f7810fa50 0x7f0f781a4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.507+0000 7f0f77400700 1 -- 172.21.15.110:0/474134159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f781a5140 con 0x7f0f78109a50 2024-04-26T11:31:00.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.507+0000 7f0f77e00700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f7810fa50 0x7f0f781a4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:00.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.507+0000 7f0f77400700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 0x7f0f781a0130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800e9c0 tx=0x7f0f6800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:00.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.508+0000 7f0f6fe00700 1 -- 172.21.15.110:0/474134159 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800cbd0 con 0x7f0f78109a50 2024-04-26T11:31:00.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.508+0000 7f0f6fe00700 1 -- 172.21.15.110:0/474134159 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f6800ee60 con 0x7f0f78109a50 2024-04-26T11:31:00.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.508+0000 7f0f6fe00700 1 -- 172.21.15.110:0/474134159 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f680055c0 con 0x7f0f78109a50 2024-04-26T11:31:00.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.508+0000 7f0f7e200700 1 -- 172.21.15.110:0/474134159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f781a5430 con 0x7f0f78109a50 2024-04-26T11:31:00.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.508+0000 7f0f7e200700 1 -- 172.21.15.110:0/474134159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f781accb0 con 0x7f0f78109a50 2024-04-26T11:31:00.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.511+0000 7f0f6fe00700 1 -- 172.21.15.110:0/474134159 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f0f68004750 con 0x7f0f78109a50 2024-04-26T11:31:00.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.512+0000 7f0f88bd0b80 1 Processor -- start 2024-04-26T11:31:00.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f6fe00700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f0f5c0a3c40 0x7f0f5c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f88bd0b80 1 -- start start 2024-04-26T11:31:00.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f6fe00700 1 -- 172.21.15.110:0/474134159 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f0f680d06e0 con 0x7f0f78109a50 2024-04-26T11:31:00.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f77e00700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f0f5c0a3c40 0x7f0f5c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b37790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b32b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b334c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ef62a85840 con 0x55ef62b37cd0 2024-04-26T11:31:00.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef62a24160 con 0x55ef62b33080 2024-04-26T11:31:00.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.513+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ef62a81800 con 0x55ef62b373b0 2024-04-26T11:31:00.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f76a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b32b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b334c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:32922/0 (socket says 172.21.15.110:32922) 2024-04-26T11:31:00.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b37790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77e00700 1 -- 172.21.15.110:0/2093239118 learned_addr learned my addr 172.21.15.110:0/2093239118 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77400700 1 -- 172.21.15.110:0/2093239118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 msgr2=0x55ef62b334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77400700 1 --2- 172.21.15.110:0/2093239118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b334c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77400700 1 -- 172.21.15.110:0/2093239118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 msgr2=0x55ef62b32b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77400700 1 --2- 172.21.15.110:0/2093239118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b32b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77400700 1 -- 172.21.15.110:0/2093239118 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef62a2c5e0 con 0x55ef62b373b0 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f76a00700 1 --2- 172.21.15.110:0/2093239118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b32b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77e00700 1 --2- 172.21.15.110:0/2093239118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77e00700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f0f5c0a3c40 0x7f0f5c0a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f70004270 tx=0x7f0f70004630 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:00.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.514+0000 7f0f77400700 1 --2- 172.21.15.110:0/2093239118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b37790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009fd0 tx=0x7f0f6809c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f9641db8530556 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.515+0000 7f0f6cc00700 1 -- 172.21.15.110:0/2093239118 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6809c8c0 con 0x55ef62b373b0 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.515+0000 7f0f6cc00700 1 -- 172.21.15.110:0/2093239118 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f68085e50 con 0x55ef62b373b0 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.515+0000 7f0f6cc00700 1 -- 172.21.15.110:0/2093239118 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68087310 con 0x55ef62b373b0 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.515+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2093239118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 msgr2=0x55ef62b37790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.515+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2093239118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b37790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009fd0 tx=0x7f0f6809c400 comp rx=0 tx=0).stop 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.516+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2093239118 shutdown_connections 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.516+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2093239118 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.516+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2093239118 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b37790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.516+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2093239118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b32b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.516+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2093239118 >> 172.21.15.110:0/2093239118 conn(0x55ef62a602a0 msgr2=0x55ef62b2d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.516+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2093239118 shutdown_connections 2024-04-26T11:31:00.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.516+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2093239118 wait complete. 2024-04-26T11:31:00.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.516+0000 7f0f88bd0b80 1 -- start start 2024-04-26T11:31:00.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.516+0000 7f0f88bd0b80 1 Processor -- start 2024-04-26T11:31:00.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b3ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b3bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b3c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ef62b3f810 con 0x55ef62b37cd0 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef62a203b0 con 0x55ef62b33080 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ef62b3f990 con 0x55ef62b373b0 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f88bd0b80 10 client.0 _ll_register_callbacks cb 0x55ef62a19330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f76a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b3bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f77e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b3c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f76a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b3bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:52570/0 (socket says 172.21.15.110:52570) 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f76a00700 1 -- 172.21.15.110:0/3980484088 learned_addr learned my addr 172.21.15.110:0/3980484088 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f77e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b3c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47156/0 (socket says 172.21.15.110:47156) 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.517+0000 7f0f77400700 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b3ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f76a00700 1 -- 172.21.15.110:0/3980484088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 msgr2=0x55ef62b3ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f76a00700 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b3ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f76a00700 1 -- 172.21.15.110:0/3980484088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 msgr2=0x55ef62b3c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f76a00700 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b3c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f76a00700 1 -- 172.21.15.110:0/3980484088 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef629d2880 con 0x55ef62b373b0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f76a00700 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b3bd50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f64015000 tx=0x7f0f64005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a860ed2ec56614d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f61600700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f61600700 1 -- 172.21.15.110:0/3980484088 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64029060 con 0x55ef62b373b0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f61600700 1 -- 172.21.15.110:0/3980484088 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f0f64003680 con 0x55ef62b373b0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.518+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3980484088 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f68085e50 con 0x55ef62b373b0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.519+0000 7f0f61600700 1 -- 172.21.15.110:0/3980484088 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f64003880 con 0x55ef62b373b0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.519+0000 7f0f88bd0b80 10 client.25003 fetch_fsmap learned FSMap version 25 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.519+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3980484088 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef62b4a010 con 0x55ef62b373b0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.519+0000 7f0f61600700 1 -- 172.21.15.110:0/3980484088 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f68085e50 con 0x55ef62b373b0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.519+0000 7f0f61600700 1 -- 172.21.15.110:0/3980484088 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f0f6400f960 con 0x55ef62b373b0 2024-04-26T11:31:00.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.520+0000 7f0f88bd0b80 10 client.25003 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.520+0000 7f0f88bd0b80 10 client.25003 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.520+0000 7f0f88bd0b80 20 client.25003 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.520+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55ef62b4c620 0x55ef62b4da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.520+0000 7f0f88bd0b80 4 client.25003 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.520+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3980484088 --> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef62a93220 con 0x55ef62b4c620 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.520+0000 7f0f77400700 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55ef62b4c620 0x55ef62b4da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.521+0000 7f0f77400700 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55ef62b4c620 0x55ef62b4da90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20e29dbff83b3ce2 server_cookie=306cf17dbf1280c in_seq=0 out_seq=0 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.521+0000 7f0f61600700 10 client.25003 ms_handle_connect on v2:172.21.15.196:6838/1849808245 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f61600700 1 -- 172.21.15.110:0/3980484088 <== mds.1 v2:172.21.15.196:6838/1849808245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ef62a93220 con 0x55ef62b4c620 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f61600700 10 client.25003 handle_command_reply: tid=0 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 client.25003 shutdown 2024-04-26T11:31:00.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3980484088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 msgr2=0x55ef62b3bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b3bd50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f64015000 tx=0x7f0f64005800 comp rx=0 tx=0).stop 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3980484088 shutdown_connections 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55ef62b4c620 0x55ef62b4da90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b3c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b3ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f61600700 0 client.25003 ms_handle_reset on v2:172.21.15.196:6838/1849808245 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3980484088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b3bd50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3980484088 >> 172.21.15.110:0/3980484088 conn(0x55ef62a602a0 msgr2=0x55ef62b27e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3980484088 shutdown_connections 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3980484088 wait complete. 2024-04-26T11:31:00.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.522+0000 7f0f88bd0b80 20 client.25003 trim_cache size 0 max 16384 2024-04-26T11:31:00.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.545+0000 7f0f88bd0b80 1 Processor -- start 2024-04-26T11:31:00.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.545+0000 7f0f88bd0b80 1 -- start start 2024-04-26T11:31:00.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.545+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b32240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.545+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b390c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.545+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b39600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.545+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ef62b4bdd0 con 0x55ef62b37cd0 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.545+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef62b4c4a0 con 0x55ef62b33080 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.545+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ef62b4cb70 con 0x55ef62b373b0 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.545+0000 7f0f77e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b39600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f77e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b39600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47162/0 (socket says 172.21.15.110:47162) 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f77e00700 1 -- 172.21.15.110:0/3829009961 learned_addr learned my addr 172.21.15.110:0/3829009961 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f77400700 1 --2- 172.21.15.110:0/3829009961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b32240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f76a00700 1 --2- 172.21.15.110:0/3829009961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f77400700 1 -- 172.21.15.110:0/3829009961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 msgr2=0x55ef62b390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f77400700 1 --2- 172.21.15.110:0/3829009961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f77400700 1 -- 172.21.15.110:0/3829009961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 msgr2=0x55ef62b39600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f77400700 1 --2- 172.21.15.110:0/3829009961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b39600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f77400700 1 -- 172.21.15.110:0/3829009961 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef62b29fd0 con 0x55ef62b33080 2024-04-26T11:31:00.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.546+0000 7f0f77400700 1 --2- 172.21.15.110:0/3829009961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b32240 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f6809c850 tx=0x7f0f68087040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=238a43498666b780 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.547+0000 7f0f63e00700 1 -- 172.21.15.110:0/3829009961 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68066070 con 0x55ef62b33080 2024-04-26T11:31:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.547+0000 7f0f63e00700 1 -- 172.21.15.110:0/3829009961 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f68085e50 con 0x55ef62b33080 2024-04-26T11:31:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.547+0000 7f0f63e00700 1 -- 172.21.15.110:0/3829009961 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f680870b0 con 0x55ef62b33080 2024-04-26T11:31:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.547+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3829009961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 msgr2=0x55ef62b32240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.547+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3829009961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b32240 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f6809c850 tx=0x7f0f68087040 comp rx=0 tx=0).stop 2024-04-26T11:31:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.548+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3829009961 shutdown_connections 2024-04-26T11:31:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.548+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3829009961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b37cd0 0x55ef62b39600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.548+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3829009961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b32240 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.548+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/3829009961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b373b0 0x55ef62b390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.548+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3829009961 >> 172.21.15.110:0/3829009961 conn(0x55ef62a602a0 msgr2=0x55ef62b31b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.548+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3829009961 shutdown_connections 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.548+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/3829009961 wait complete. 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.548+0000 7f0f88bd0b80 1 -- start start 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.548+0000 7f0f88bd0b80 1 Processor -- start 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b38d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b373b0 0x55ef62b392d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f88bd0b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b37cd0 0x55ef62b39850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ef62b4d910 con 0x55ef62b373b0 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ef62b4d240 con 0x55ef62b33080 2024-04-26T11:31:00.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f88bd0b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ef62b4dfe0 con 0x55ef62b37cd0 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f88bd0b80 10 client.0 _ll_register_callbacks cb 0x55ef62a19330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f76a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b373b0 0x55ef62b392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f77400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b38d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f76a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b373b0 0x55ef62b392d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47166/0 (socket says 172.21.15.110:47166) 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f76a00700 1 -- 172.21.15.110:0/2629709777 learned_addr learned my addr 172.21.15.110:0/2629709777 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f77e00700 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b37cd0 0x55ef62b39850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f77400700 1 -- 172.21.15.110:0/2629709777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b37cd0 msgr2=0x55ef62b39850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f77400700 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b37cd0 0x55ef62b39850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f77400700 1 -- 172.21.15.110:0/2629709777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b373b0 msgr2=0x55ef62b392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.549+0000 7f0f77400700 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b373b0 0x55ef62b392d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f77400700 1 -- 172.21.15.110:0/2629709777 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef62b555e0 con 0x55ef62b33080 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f77e00700 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b37cd0 0x55ef62b39850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:31:00.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f77400700 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b38d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f6809c850 tx=0x7f0f680097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8157c4834d2d711 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f61600700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f61600700 1 -- 172.21.15.110:0/2629709777 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68066070 con 0x55ef62b33080 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2629709777 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f68085e50 con 0x55ef62b33080 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f61600700 1 -- 172.21.15.110:0/2629709777 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f0f68016dd0 con 0x55ef62b33080 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f61600700 1 -- 172.21.15.110:0/2629709777 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f6809c8c0 con 0x55ef62b33080 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f88bd0b80 10 client.24989 fetch_fsmap learned FSMap version 25 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.550+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2629709777 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ef62bb3cc0 con 0x55ef62b33080 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.551+0000 7f0f61600700 1 -- 172.21.15.110:0/2629709777 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f68085e50 con 0x55ef62b33080 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.551+0000 7f0f61600700 1 -- 172.21.15.110:0/2629709777 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f0f6809cb20 con 0x55ef62b33080 2024-04-26T11:31:00.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.551+0000 7f0f88bd0b80 10 client.24989 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.551+0000 7f0f88bd0b80 10 client.24989 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.551+0000 7f0f88bd0b80 20 client.24989 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.551+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55ef62bb8140 0x55ef62bb6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.551+0000 7f0f88bd0b80 4 client.24989 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.551+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2629709777 --> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] -- command(tid 0: {"prefix": "status"}) -- 0x55ef62a8d2c0 con 0x55ef62bb8140 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.551+0000 7f0f76a00700 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55ef62bb8140 0x55ef62bb6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f61600700 10 client.24989 ms_handle_connect on v2:172.21.15.196:6838/1849808245 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f76a00700 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55ef62bb8140 0x55ef62bb6e50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85f277dacb6dc999 server_cookie=305b1e7b1af07574 in_seq=0 out_seq=0 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f61600700 1 -- 172.21.15.110:0/2629709777 <== mds.1 v2:172.21.15.196:6838/1849808245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55ef62a8d2c0 con 0x55ef62bb8140 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f61600700 10 client.24989 handle_command_reply: tid=0 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f88bd0b80 1 client.24989 shutdown 2024-04-26T11:31:00.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2629709777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 msgr2=0x55ef62b38d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b38d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f6809c850 tx=0x7f0f680097d0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2629709777 shutdown_connections 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x55ef62bb8140 0x55ef62bb6e50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ef62b37cd0 0x55ef62b39850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ef62b33080 0x55ef62b38d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f88bd0b80 1 --2- 172.21.15.110:0/2629709777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ef62b373b0 0x55ef62b392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2629709777 >> 172.21.15.110:0/2629709777 conn(0x55ef62a602a0 msgr2=0x55ef62b3ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.552+0000 7f0f61600700 0 client.24989 ms_handle_reset on v2:172.21.15.196:6838/1849808245 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2629709777 shutdown_connections 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f88bd0b80 1 -- 172.21.15.110:0/2629709777 wait complete. 2024-04-26T11:31:00.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f88bd0b80 20 client.24989 trim_cache size 0 max 16384 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 1, 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24502, 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 208.96933206, 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 93, 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T11:31:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 257.932887806 2024-04-26T11:31:00.561 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:31:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 -- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f0f5c0a3c40 msgr2=0x7f0f5c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f0f5c0a3c40 0x7f0f5c0a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f70004270 tx=0x7f0f70004630 comp rx=0 tx=0).stop 2024-04-26T11:31:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 -- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 msgr2=0x7f0f781a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 0x7f0f781a0130 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800e9c0 tx=0x7f0f6800ecd0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 -- 172.21.15.110:0/474134159 shutdown_connections 2024-04-26T11:31:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f7810fa50 0x7f0f781a4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f78109a50 0x7f0f781a0130 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f0f5c0a3c40 0x7f0f5c0a6100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 --2- 172.21.15.110:0/474134159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f7810a410 0x7f0f781a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.553+0000 7f0f7e200700 1 -- 172.21.15.110:0/474134159 >> 172.21.15.110:0/474134159 conn(0x7f0f78076bf0 msgr2=0x7f0f780771b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.554+0000 7f0f7e200700 1 -- 172.21.15.110:0/474134159 shutdown_connections 2024-04-26T11:31:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:00.554+0000 7f0f7e200700 1 -- 172.21.15.110:0/474134159 wait complete. 2024-04-26T11:31:01.525 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-26T11:31:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:01 smithi110 ceph-mon[28069]: pgmap v442: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:31:01.982 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:01 smithi196 ceph-mon[32572]: pgmap v442: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:31:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:01 smithi193 ceph-mon[32782]: pgmap v442: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:31:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:03 smithi110 ceph-mon[28069]: pgmap v443: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:31:03.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:03 smithi193 ceph-mon[32782]: pgmap v443: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:31:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:03 smithi196 ceph-mon[32572]: pgmap v443: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T11:31:04.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.412+0000 7fa3fd800700 1 -- 172.21.15.110:0/1567793003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f8105640 msgr2=0x7fa3f8105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:04.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.412+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1567793003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f8105640 0x7fa3f8105ac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009990 tx=0x7fa3e4009ca0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.413+0000 7fa3fd800700 1 -- 172.21.15.110:0/1567793003 shutdown_connections 2024-04-26T11:31:04.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.413+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1567793003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8106000 0x7fa3f8112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.413+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1567793003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3f810b640 0x7fa3f810ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.413+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1567793003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f8105640 0x7fa3f8105ac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.413+0000 7fa3fd800700 1 -- 172.21.15.110:0/1567793003 >> 172.21.15.110:0/1567793003 conn(0x7fa3f8101130 msgr2=0x7fa3f8103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:04.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.413+0000 7fa3fd800700 1 -- 172.21.15.110:0/1567793003 shutdown_connections 2024-04-26T11:31:04.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.413+0000 7fa3fd800700 1 -- 172.21.15.110:0/1567793003 wait complete. 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.414+0000 7fa3fd800700 1 Processor -- start 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.414+0000 7fa3fd800700 1 -- start start 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.414+0000 7fa3fd800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3f8105640 0x7fa3f819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.414+0000 7fa3fd800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8106000 0x7fa3f819c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.414+0000 7fa3fd800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f810b640 0x7fa3f81a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.414+0000 7fa3fd800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8115890 con 0x7fa3f8105640 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.414+0000 7fa3fd800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8115710 con 0x7fa3f810b640 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.414+0000 7fa3fd800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8115a10 con 0x7fa3f8106000 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3f8105640 0x7fa3f819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3f8105640 0x7fa3f819bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38824/0 (socket says 172.21.15.110:38824) 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6a00700 1 -- 172.21.15.110:0/1788540052 learned_addr learned my addr 172.21.15.110:0/1788540052 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6000700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8106000 0x7fa3f819c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f7400700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f810b640 0x7fa3f81a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6a00700 1 -- 172.21.15.110:0/1788540052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8106000 msgr2=0x7fa3f819c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:04.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8106000 0x7fa3f819c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6a00700 1 -- 172.21.15.110:0/1788540052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f810b640 msgr2=0x7fa3f81a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f810b640 0x7fa3f81a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6a00700 1 -- 172.21.15.110:0/1788540052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f81a0d30 con 0x7fa3f8105640 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6000700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8106000 0x7fa3f819c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.415+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3f8105640 0x7fa3f819bd20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e9a0 tx=0x7fa3e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.416+0000 7fa3ef400700 1 -- 172.21.15.110:0/1788540052 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800ca10 con 0x7fa3f8105640 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.416+0000 7fa3fd800700 1 -- 172.21.15.110:0/1788540052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f81a1020 con 0x7fa3f8105640 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.416+0000 7fa3ef400700 1 -- 172.21.15.110:0/1788540052 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e800cbb0 con 0x7fa3f8105640 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.416+0000 7fa3ef400700 1 -- 172.21.15.110:0/1788540052 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8018680 con 0x7fa3f8105640 2024-04-26T11:31:04.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.416+0000 7fa3fd800700 1 -- 172.21.15.110:0/1788540052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f81a88a0 con 0x7fa3f8105640 2024-04-26T11:31:04.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.419+0000 7fa3ef400700 1 -- 172.21.15.110:0/1788540052 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa3e8010430 con 0x7fa3f8105640 2024-04-26T11:31:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.421+0000 7fa3ef400700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa3dc0a3c40 0x7fa3dc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.421+0000 7fa408243b80 1 Processor -- start 2024-04-26T11:31:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.421+0000 7fa3ef400700 1 -- 172.21.15.110:0/1788540052 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fa3e80d05e0 con 0x7fa3f8105640 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.421+0000 7fa3f6000700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa3dc0a3c40 0x7fa3dc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.421+0000 7fa408243b80 1 -- start start 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.421+0000 7fa408243b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b93b0 0x559c116b9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.421+0000 7fa408243b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 0x559c116b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.421+0000 7fa408243b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b5080 0x559c116b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa408243b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559c11607840 con 0x559c116b93b0 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa408243b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c115a6160 con 0x559c116b5080 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa408243b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559c11603800 con 0x559c116b9cd0 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b93b0 0x559c116b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b93b0 0x559c116b9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38832/0 (socket says 172.21.15.110:38832) 2024-04-26T11:31:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6000700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa3dc0a3c40 0x7fa3dc0a6100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8103730 tx=0x7fa3e400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6a00700 1 -- 172.21.15.110:0/1040180791 learned_addr learned my addr 172.21.15.110:0/1040180791 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f7400700 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b5080 0x559c116b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6000700 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 0x559c116b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6a00700 1 -- 172.21.15.110:0/1040180791 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 msgr2=0x559c116b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:04.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 0x559c116b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6a00700 1 -- 172.21.15.110:0/1040180791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b5080 msgr2=0x559c116b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:04.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b5080 0x559c116b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f6a00700 1 -- 172.21.15.110:0/1040180791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c115ae5e0 con 0x559c116b93b0 2024-04-26T11:31:04.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.422+0000 7fa3f7400700 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b5080 0x559c116b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:04.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.423+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b93b0 0x559c116b9790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009230 tx=0x7fa3e809cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d954cee3b865e953 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:04.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.423+0000 7fa3e3e00700 1 -- 172.21.15.110:0/1040180791 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80a5430 con 0x559c116b93b0 2024-04-26T11:31:04.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.423+0000 7fa3e3e00700 1 -- 172.21.15.110:0/1040180791 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e800cd60 con 0x559c116b93b0 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.423+0000 7fa3e3e00700 1 -- 172.21.15.110:0/1040180791 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e809bc10 con 0x559c116b93b0 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.424+0000 7fa408243b80 1 -- 172.21.15.110:0/1040180791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b93b0 msgr2=0x559c116b9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.424+0000 7fa408243b80 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b93b0 0x559c116b9790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009230 tx=0x7fa3e809cf90 comp rx=0 tx=0).stop 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.424+0000 7fa408243b80 1 -- 172.21.15.110:0/1040180791 shutdown_connections 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.424+0000 7fa408243b80 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b5080 0x559c116b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.424+0000 7fa408243b80 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b93b0 0x559c116b9790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.424+0000 7fa408243b80 1 --2- 172.21.15.110:0/1040180791 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 0x559c116b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.424+0000 7fa408243b80 1 -- 172.21.15.110:0/1040180791 >> 172.21.15.110:0/1040180791 conn(0x559c115e22a0 msgr2=0x559c116af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.424+0000 7fa408243b80 1 -- 172.21.15.110:0/1040180791 shutdown_connections 2024-04-26T11:31:04.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.424+0000 7fa408243b80 1 -- 172.21.15.110:0/1040180791 wait complete. 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.425+0000 7fa408243b80 1 -- start start 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.425+0000 7fa408243b80 1 Processor -- start 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.425+0000 7fa408243b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.425+0000 7fa408243b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b93b0 0x559c116bde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.425+0000 7fa408243b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b9cd0 0x559c116be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.425+0000 7fa408243b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559c116c1810 con 0x559c116b5080 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.425+0000 7fa408243b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c115a23b0 con 0x559c116b9cd0 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.425+0000 7fa408243b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559c116c1990 con 0x559c116b93b0 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.425+0000 7fa408243b80 10 client.0 _ll_register_callbacks cb 0x559c1159b330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f7400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b9cd0 0x559c116be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f7400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b9cd0 0x559c116be3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43588/0 (socket says 172.21.15.110:43588) 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f7400700 1 -- 172.21.15.110:0/3034353539 learned_addr learned my addr 172.21.15.110:0/3034353539 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f6000700 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b93b0 0x559c116bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f7400700 1 -- 172.21.15.110:0/3034353539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b93b0 msgr2=0x559c116bde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f7400700 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b93b0 0x559c116bde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f7400700 1 -- 172.21.15.110:0/3034353539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 msgr2=0x559c116c0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f7400700 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116c0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f7400700 1 -- 172.21.15.110:0/3034353539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c11554880 con 0x559c116b9cd0 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116c0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.426+0000 7fa3f7400700 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b9cd0 0x559c116be3a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0007c30 tx=0x7fa3f0007f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f2a2aa27602d246 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.427+0000 7fa3e0c00700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.427+0000 7fa3e0c00700 1 -- 172.21.15.110:0/3034353539 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f001a070 con 0x559c116b9cd0 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.427+0000 7fa408243b80 1 -- 172.21.15.110:0/3034353539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3e800cd60 con 0x559c116b9cd0 2024-04-26T11:31:04.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.427+0000 7fa3e0c00700 1 -- 172.21.15.110:0/3034353539 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fa3f0011d60 con 0x559c116b9cd0 2024-04-26T11:31:04.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.427+0000 7fa3e0c00700 1 -- 172.21.15.110:0/3034353539 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa3f001f460 con 0x559c116b9cd0 2024-04-26T11:31:04.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.427+0000 7fa408243b80 10 client.25001 fetch_fsmap learned FSMap version 25 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.427+0000 7fa408243b80 1 -- 172.21.15.110:0/3034353539 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c116cc180 con 0x559c116b9cd0 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.428+0000 7fa3e0c00700 1 -- 172.21.15.110:0/3034353539 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e800cd60 con 0x559c116b9cd0 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.428+0000 7fa3e0c00700 1 -- 172.21.15.110:0/3034353539 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fa3f00297b0 con 0x559c116b9cd0 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.428+0000 7fa408243b80 10 client.25001 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.428+0000 7fa408243b80 10 client.25001 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.428+0000 7fa408243b80 20 client.25001 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.428+0000 7fa408243b80 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559c116ce6d0 0x559c116cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.428+0000 7fa408243b80 4 client.25001 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.428+0000 7fa408243b80 1 -- 172.21.15.110:0/3034353539 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c11615220 con 0x559c116ce6d0 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.428+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559c116ce6d0 0x559c116cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.429+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559c116ce6d0 0x559c116cfb40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c78040b6cc337561 server_cookie=73685da1c416b574 in_seq=0 out_seq=0 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.429+0000 7fa3e0c00700 10 client.25001 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:04.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.429+0000 7fa3e0c00700 1 -- 172.21.15.110:0/3034353539 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559c11615220 con 0x559c116ce6d0 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.429+0000 7fa3e0c00700 10 client.25001 handle_command_reply: tid=0 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.429+0000 7fa408243b80 1 client.25001 shutdown 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 -- 172.21.15.110:0/3034353539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b9cd0 msgr2=0x559c116be3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b9cd0 0x559c116be3a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0007c30 tx=0x7fa3f0007f40 comp rx=0 tx=0).stop 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 -- 172.21.15.110:0/3034353539 shutdown_connections 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559c116ce6d0 0x559c116cfb40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b9cd0 0x559c116be3a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116c0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 --2- 172.21.15.110:0/3034353539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b93b0 0x559c116bde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa3e0c00700 0 client.25001 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 -- 172.21.15.110:0/3034353539 >> 172.21.15.110:0/3034353539 conn(0x559c115e22a0 msgr2=0x559c116a9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 -- 172.21.15.110:0/3034353539 shutdown_connections 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 1 -- 172.21.15.110:0/3034353539 wait complete. 2024-04-26T11:31:04.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.430+0000 7fa408243b80 20 client.25001 trim_cache size 0 max 16384 2024-04-26T11:31:04.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.452+0000 7fa408243b80 1 Processor -- start 2024-04-26T11:31:04.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.452+0000 7fa408243b80 1 -- start start 2024-04-26T11:31:04.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa408243b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b5080 0x559c116af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa408243b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 0x559c116bde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa408243b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b9cd0 0x559c116be360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa408243b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559c116cde80 con 0x559c116b9cd0 2024-04-26T11:31:04.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa408243b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c116ce550 con 0x559c116b93b0 2024-04-26T11:31:04.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa408243b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559c116cec20 con 0x559c116b5080 2024-04-26T11:31:04.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa3f7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b9cd0 0x559c116be360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa3f7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b9cd0 0x559c116be360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38850/0 (socket says 172.21.15.110:38850) 2024-04-26T11:31:04.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa3f7400700 1 -- 172.21.15.110:0/478713526 learned_addr learned my addr 172.21.15.110:0/478713526 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:04.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa3f6000700 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 0x559c116bde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b5080 0x559c116af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa3f7400700 1 -- 172.21.15.110:0/478713526 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b5080 msgr2=0x559c116af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:04.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa3f7400700 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b5080 0x559c116af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa3f7400700 1 -- 172.21.15.110:0/478713526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 msgr2=0x559c116bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:04.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.453+0000 7fa3f7400700 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 0x559c116bde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.454+0000 7fa3f7400700 1 -- 172.21.15.110:0/478713526 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c116c1940 con 0x559c116b9cd0 2024-04-26T11:31:04.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.454+0000 7fa3f6000700 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 0x559c116bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:04.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.454+0000 7fa3f7400700 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b9cd0 0x559c116be360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009a00 tx=0x7fa3f0029da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9071dc1d048ed717 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:04.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.454+0000 7fa3e3400700 1 -- 172.21.15.110:0/478713526 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f001a040 con 0x559c116b9cd0 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.454+0000 7fa3e3400700 1 -- 172.21.15.110:0/478713526 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0011d60 con 0x559c116b9cd0 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.454+0000 7fa3e3400700 1 -- 172.21.15.110:0/478713526 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f001f860 con 0x559c116b9cd0 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.455+0000 7fa408243b80 1 -- 172.21.15.110:0/478713526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b9cd0 msgr2=0x559c116be360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.455+0000 7fa408243b80 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b9cd0 0x559c116be360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009a00 tx=0x7fa3f0029da0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.455+0000 7fa408243b80 1 -- 172.21.15.110:0/478713526 shutdown_connections 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.455+0000 7fa408243b80 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b9cd0 0x559c116be360 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.455+0000 7fa408243b80 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b5080 0x559c116af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.455+0000 7fa408243b80 1 --2- 172.21.15.110:0/478713526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 0x559c116bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.455+0000 7fa408243b80 1 -- 172.21.15.110:0/478713526 >> 172.21.15.110:0/478713526 conn(0x559c115e22a0 msgr2=0x559c116b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.455+0000 7fa408243b80 1 -- 172.21.15.110:0/478713526 shutdown_connections 2024-04-26T11:31:04.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.455+0000 7fa408243b80 1 -- 172.21.15.110:0/478713526 wait complete. 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.456+0000 7fa408243b80 1 -- start start 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.456+0000 7fa408243b80 1 Processor -- start 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.456+0000 7fa408243b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116d8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.456+0000 7fa408243b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 0x559c116d94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.456+0000 7fa408243b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 0x559c116b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.456+0000 7fa408243b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559c116cf9c0 con 0x559c116b5080 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.456+0000 7fa408243b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559c116cf2f0 con 0x559c116b93b0 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.456+0000 7fa408243b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559c116d0090 con 0x559c116b9cd0 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.456+0000 7fa408243b80 10 client.0 _ll_register_callbacks cb 0x559c1159b330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116d8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116d8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38862/0 (socket says 172.21.15.110:38862) 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6a00700 1 -- 172.21.15.110:0/2736589536 learned_addr learned my addr 172.21.15.110:0/2736589536 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6000700 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 0x559c116d94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f7400700 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 0x559c116b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6a00700 1 -- 172.21.15.110:0/2736589536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 msgr2=0x559c116b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 0x559c116b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6a00700 1 -- 172.21.15.110:0/2736589536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 msgr2=0x559c116d94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 0x559c116d94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6a00700 1 -- 172.21.15.110:0/2736589536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c116b3710 con 0x559c116b5080 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3f6a00700 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116d8fb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e970 tx=0x7fa3e8009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f31030578e4a6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3e0c00700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.457+0000 7fa3e0c00700 1 -- 172.21.15.110:0/2736589536 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e809aac0 con 0x559c116b5080 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa3e0c00700 1 -- 172.21.15.110:0/2736589536 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fa3e80870b0 con 0x559c116b5080 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa408243b80 1 -- 172.21.15.110:0/2736589536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f0011d60 con 0x559c116b5080 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa3e0c00700 1 -- 172.21.15.110:0/2736589536 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa3e8067170 con 0x559c116b5080 2024-04-26T11:31:04.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa408243b80 10 client.14916 fetch_fsmap learned FSMap version 25 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa408243b80 1 -- 172.21.15.110:0/2736589536 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c11735800 con 0x559c116b5080 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa3e0c00700 1 -- 172.21.15.110:0/2736589536 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0011d60 con 0x559c116b5080 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa3e0c00700 1 -- 172.21.15.110:0/2736589536 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fa3f0009240 con 0x559c116b5080 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa408243b80 10 client.14916 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa408243b80 10 client.14916 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa408243b80 20 client.14916 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa408243b80 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559c11739d10 0x559c11738a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa408243b80 4 client.14916 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.458+0000 7fa408243b80 1 -- 172.21.15.110:0/2736589536 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "status"}) -- 0x559c1160f2c0 con 0x559c11739d10 2024-04-26T11:31:04.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.459+0000 7fa3f6000700 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559c11739d10 0x559c11738a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.459+0000 7fa3f6000700 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559c11739d10 0x559c11738a20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=503717bd61142e28 server_cookie=ea2d47b2dccb1516 in_seq=0 out_seq=0 2024-04-26T11:31:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.459+0000 7fa3e0c00700 10 client.14916 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa3e0c00700 1 -- 172.21.15.110:0/2736589536 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559c1160f2c0 con 0x559c11739d10 2024-04-26T11:31:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa3e0c00700 10 client.14916 handle_command_reply: tid=0 2024-04-26T11:31:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 client.14916 shutdown 2024-04-26T11:31:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 -- 172.21.15.110:0/2736589536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 msgr2=0x559c116d8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116d8fb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e970 tx=0x7fa3e8009790 comp rx=0 tx=0).stop 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 -- 172.21.15.110:0/2736589536 shutdown_connections 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559c11739d10 0x559c11738a20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559c116b9cd0 0x559c116b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559c116b5080 0x559c116d8fb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 --2- 172.21.15.110:0/2736589536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559c116b93b0 0x559c116d94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 -- 172.21.15.110:0/2736589536 >> 172.21.15.110:0/2736589536 conn(0x559c115e22a0 msgr2=0x559c116af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa3e0c00700 0 client.14916 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 -- 172.21.15.110:0/2736589536 shutdown_connections 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 1 -- 172.21.15.110:0/2736589536 wait complete. 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.460+0000 7fa408243b80 20 client.14916 trim_cache size 0 max 16384 2024-04-26T11:31:04.464 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 0, 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24518, 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 229.36114104200001, 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 93, 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 89, 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 248.450579304 2024-04-26T11:31:04.465 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:31:04.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 -- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa3dc0a3c40 msgr2=0x7fa3dc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:04.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa3dc0a3c40 0x7fa3dc0a6100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8103730 tx=0x7fa3e400b260 comp rx=0 tx=0).stop 2024-04-26T11:31:04.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 -- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3f8105640 msgr2=0x7fa3f819bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:04.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3f8105640 0x7fa3f819bd20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e9a0 tx=0x7fa3e800ecb0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 -- 172.21.15.110:0/1788540052 shutdown_connections 2024-04-26T11:31:04.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3f810b640 0x7fa3f81a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3f8105640 0x7fa3f819bd20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fa3dc0a3c40 0x7fa3dc0a6100 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 --2- 172.21.15.110:0/1788540052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3f8106000 0x7fa3f819c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:04.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 -- 172.21.15.110:0/1788540052 >> 172.21.15.110:0/1788540052 conn(0x7fa3f8101130 msgr2=0x7fa3f81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:04.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 -- 172.21.15.110:0/1788540052 shutdown_connections 2024-04-26T11:31:04.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:04.461+0000 7fa3fd800700 1 -- 172.21.15.110:0/1788540052 wait complete. 2024-04-26T11:31:05.434 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T11:31:05.445 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T11:31:05.446 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T11:31:05.446 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T11:31:05.446 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-26T11:31:05.447 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T11:31:05.447 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-04-26T11:31:05.447 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-26T11:31:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.651+0000 7fba5a400640 1 -- 172.21.15.110:0/2892045209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba541049f0 msgr2=0x7fba54104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.651+0000 7fba5a400640 1 --2- 172.21.15.110:0/2892045209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba541049f0 0x7fba54104e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fba48009900 tx=0x7fba4802a410 comp rx=0 tx=0).stop 2024-04-26T11:31:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.651+0000 7fba5a400640 1 -- 172.21.15.110:0/2892045209 shutdown_connections 2024-04-26T11:31:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.651+0000 7fba5a400640 1 --2- 172.21.15.110:0/2892045209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba541065a0 0x7fba5410ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.651+0000 7fba5a400640 1 --2- 172.21.15.110:0/2892045209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba54105be0 0x7fba54106060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.651+0000 7fba5a400640 1 --2- 172.21.15.110:0/2892045209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba541049f0 0x7fba54104e10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.651+0000 7fba5a400640 1 -- 172.21.15.110:0/2892045209 >> 172.21.15.110:0/2892045209 conn(0x7fba540fffa0 msgr2=0x7fba541023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.651+0000 7fba5a400640 1 -- 172.21.15.110:0/2892045209 shutdown_connections 2024-04-26T11:31:05.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.651+0000 7fba5a400640 1 -- 172.21.15.110:0/2892045209 wait complete. 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.652+0000 7fba5a400640 1 Processor -- start 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.652+0000 7fba5a400640 1 -- start start 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.652+0000 7fba5a400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba541049f0 0x7fba5419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.652+0000 7fba5a400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba54105be0 0x7fba5419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.652+0000 7fba5a400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba541065a0 0x7fba541a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.652+0000 7fba5a400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fba54110540 con 0x7fba54105be0 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.652+0000 7fba5a400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fba541103c0 con 0x7fba541065a0 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.652+0000 7fba5a400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fba541106c0 con 0x7fba541049f0 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba541065a0 0x7fba541a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba53e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba54105be0 0x7fba5419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba541065a0 0x7fba541a2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43618/0 (socket says 172.21.15.110:43618) 2024-04-26T11:31:05.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59a00640 1 -- 172.21.15.110:0/940246862 learned_addr learned my addr 172.21.15.110:0/940246862 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59000640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba541049f0 0x7fba5419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59a00640 1 -- 172.21.15.110:0/940246862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba541049f0 msgr2=0x7fba5419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59a00640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba541049f0 0x7fba5419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59a00640 1 -- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba54105be0 msgr2=0x7fba5419b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59a00640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba54105be0 0x7fba5419b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59a00640 1 -- 172.21.15.110:0/940246862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba541a2800 con 0x7fba541065a0 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba53e00640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba54105be0 0x7fba5419b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.653+0000 7fba59a00640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba541065a0 0x7fba541a2190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00eb10 tx=0x7fba4c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.654+0000 7fba51600640 1 -- 172.21.15.110:0/940246862 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c004b20 con 0x7fba541065a0 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.654+0000 7fba51600640 1 -- 172.21.15.110:0/940246862 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba4c004cc0 con 0x7fba541065a0 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.654+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba541a2af0 con 0x7fba541065a0 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.654+0000 7fba51600640 1 -- 172.21.15.110:0/940246862 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c010670 con 0x7fba541065a0 2024-04-26T11:31:05.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.654+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba541a2ff0 con 0x7fba541065a0 2024-04-26T11:31:05.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.655+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5410bd90 con 0x7fba541065a0 2024-04-26T11:31:05.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.657+0000 7fba51600640 1 -- 172.21.15.110:0/940246862 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fba4c005000 con 0x7fba541065a0 2024-04-26T11:31:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.658+0000 7fba51600640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fba3c0a3ba0 0x7fba3c0a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.659+0000 7fba51600640 1 -- 172.21.15.110:0/940246862 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7fba4c0d0c90 con 0x7fba541065a0 2024-04-26T11:31:05.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.659+0000 7fba59000640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fba3c0a3ba0 0x7fba3c0a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:05.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.659+0000 7fba59000640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fba3c0a3ba0 0x7fba3c0a6060 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba48005ab0 tx=0x7fba48005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:05.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.661+0000 7fba51600640 1 -- 172.21.15.110:0/940246862 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fba4c053ff0 con 0x7fba541065a0 2024-04-26T11:31:05.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:05.919+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fba54063530 con 0x7fba541065a0 2024-04-26T11:31:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:05 smithi196 ceph-mon[32572]: pgmap v444: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:31:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:05 smithi110 ceph-mon[28069]: pgmap v444: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:31:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:05 smithi193 ceph-mon[32782]: pgmap v444: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:31:06.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.694+0000 7fba51600640 1 -- 172.21.15.110:0/940246862 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mgrmap(e 19) ==== 138664+0+0 (secure 0 0 0) 0x7fba4c0994e0 con 0x7fba541065a0 2024-04-26T11:31:06.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.695+0000 7fba51600640 1 -- 172.21.15.110:0/940246862 <== mon.2 v2:172.21.15.193:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fba4c0d1ee0 con 0x7fba541065a0 2024-04-26T11:31:06.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fba3c0a3ba0 msgr2=0x7fba3c0a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:06.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fba3c0a3ba0 0x7fba3c0a6060 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba48005ab0 tx=0x7fba48005a20 comp rx=0 tx=0).stop 2024-04-26T11:31:06.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba541065a0 msgr2=0x7fba541a2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:06.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba541065a0 0x7fba541a2190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00eb10 tx=0x7fba4c00c2d0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 shutdown_connections 2024-04-26T11:31:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7fba3c0a3ba0 0x7fba3c0a6060 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba541065a0 0x7fba541a2190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba54105be0 0x7fba5419b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 --2- 172.21.15.110:0/940246862 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba541049f0 0x7fba5419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 >> 172.21.15.110:0/940246862 conn(0x7fba540fffa0 msgr2=0x7fba54108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 shutdown_connections 2024-04-26T11:31:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.700+0000 7fba5a400640 1 -- 172.21.15.110:0/940246862 wait complete. 2024-04-26T11:31:06.724 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-26T11:31:06.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.896+0000 7f6014000640 1 -- 172.21.15.110:0/4198291068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 msgr2=0x7f600c104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:06.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.896+0000 7f6014000640 1 --2- 172.21.15.110:0/4198291068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 0x7f600c104fe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6000009900 tx=0x7f600002a3f0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.896+0000 7f6014000640 1 -- 172.21.15.110:0/4198291068 shutdown_connections 2024-04-26T11:31:06.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.896+0000 7f6014000640 1 --2- 172.21.15.110:0/4198291068 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c106770 0x7f600c10d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.896+0000 7f6014000640 1 --2- 172.21.15.110:0/4198291068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c105db0 0x7f600c106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.896+0000 7f6014000640 1 --2- 172.21.15.110:0/4198291068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 0x7f600c104fe0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.896+0000 7f6014000640 1 -- 172.21.15.110:0/4198291068 >> 172.21.15.110:0/4198291068 conn(0x7f600c100150 msgr2=0x7f600c102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:06.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.896+0000 7f6014000640 1 -- 172.21.15.110:0/4198291068 shutdown_connections 2024-04-26T11:31:06.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.896+0000 7f6014000640 1 -- 172.21.15.110:0/4198291068 wait complete. 2024-04-26T11:31:06.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.897+0000 7f6014000640 1 Processor -- start 2024-04-26T11:31:06.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.897+0000 7f6014000640 1 -- start start 2024-04-26T11:31:06.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6014000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 0x7f600c19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:06.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6014000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c105db0 0x7f600c19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:06.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6014000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c106770 0x7f600c1a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:06.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6014000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f600c1106c0 con 0x7f600c105db0 2024-04-26T11:31:06.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6014000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f600c110540 con 0x7f600c104bc0 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6014000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f600c110840 con 0x7f600c106770 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6011600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 0x7f600c19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6011600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 0x7f600c19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43638/0 (socket says 172.21.15.110:43638) 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6011600640 1 -- 172.21.15.110:0/32180036 learned_addr learned my addr 172.21.15.110:0/32180036 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6012000640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c106770 0x7f600c1a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6010c00640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c105db0 0x7f600c19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6011600640 1 -- 172.21.15.110:0/32180036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c106770 msgr2=0x7f600c1a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6011600640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c106770 0x7f600c1a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6011600640 1 -- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c105db0 msgr2=0x7f600c19b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6011600640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c105db0 0x7f600c19b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6011600640 1 -- 172.21.15.110:0/32180036 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c1a2930 con 0x7f600c104bc0 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.898+0000 7f6010c00640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c105db0 0x7f600c19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.899+0000 7f6011600640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 0x7f600c19ad20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6000006010 tx=0x7f60000042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:06.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.899+0000 7f600a000640 1 -- 172.21.15.110:0/32180036 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600003f030 con 0x7f600c104bc0 2024-04-26T11:31:06.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.899+0000 7f600a000640 1 -- 172.21.15.110:0/32180036 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60000318f0 con 0x7f600c104bc0 2024-04-26T11:31:06.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.899+0000 7f600a000640 1 -- 172.21.15.110:0/32180036 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000035070 con 0x7f600c104bc0 2024-04-26T11:31:06.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.899+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c1a2bc0 con 0x7f600c104bc0 2024-04-26T11:31:06.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.899+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c1a3060 con 0x7f600c104bc0 2024-04-26T11:31:06.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.900+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f600c10bee0 con 0x7f600c104bc0 2024-04-26T11:31:06.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.904+0000 7f600a000640 1 -- 172.21.15.110:0/32180036 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 19) ==== 138664+0+0 (secure 0 0 0) 0x7f6000042030 con 0x7f600c104bc0 2024-04-26T11:31:06.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.905+0000 7f600a000640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5ff40a3ca0 0x7f5ff40a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:06.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.905+0000 7f6010c00640 1 -- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5ff40a3ca0 msgr2=0x7f5ff40a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/2430566216 2024-04-26T11:31:06.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.905+0000 7f600a000640 1 -- 172.21.15.110:0/32180036 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f60000f0b50 con 0x7f600c104bc0 2024-04-26T11:31:06.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.905+0000 7f6010c00640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5ff40a3ca0 0x7f5ff40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:31:06.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:06.914+0000 7f600a000640 1 -- 172.21.15.110:0/32180036 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f60000bd430 con 0x7f600c104bc0 2024-04-26T11:31:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:06 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/940246862' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T11:31:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:06 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T11:31:07.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: ignoring --setuser ceph since I am not root 2024-04-26T11:31:07.006 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: ignoring --setgroup ceph since I am not root 2024-04-26T11:31:07.006 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:06 smithi196 ceph-mgr[34454]: -- 172.21.15.196:0/435028474 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b5277685a0 con 0x55b52773d000 2024-04-26T11:31:07.006 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:06.869+0000 7efe938d9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:31:07.008 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:06 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/940246862' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T11:31:07.009 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:06 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T11:31:07.009 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: ignoring --setuser ceph since I am not root 2024-04-26T11:31:07.009 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: ignoring --setgroup ceph since I am not root 2024-04-26T11:31:07.009 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:07.006+0000 7f1c08cb3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:31:07.058 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:06 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/940246862' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T11:31:07.058 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:06 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T11:31:07.058 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:06 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: ignoring --setuser ceph since I am not root 2024-04-26T11:31:07.058 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:06 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: ignoring --setgroup ceph since I am not root 2024-04-26T11:31:07.059 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:06 smithi193 ceph-mgr[34170]: -- 172.21.15.193:0/3723541718 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5585c4b085a0 con 0x5585c4add000 2024-04-26T11:31:07.059 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:06 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:06.867+0000 7f85c1ff2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:31:07.059 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:07 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:07.056+0000 7f85c1ff2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:31:07.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.106+0000 7f6010c00640 1 -- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5ff40a3ca0 msgr2=0x7f5ff40a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/2430566216 2024-04-26T11:31:07.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.106+0000 7f6010c00640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5ff40a3ca0 0x7f5ff40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T11:31:07.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.115+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f600c0635d0 con 0x7f600c104bc0 2024-04-26T11:31:07.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.123+0000 7f600a000640 1 -- 172.21.15.110:0/32180036 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7f60000bcd30 con 0x7f600c104bc0 2024-04-26T11:31:07.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5ff40a3ca0 msgr2=0x7f5ff40a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:31:07.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5ff40a3ca0 0x7f5ff40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 msgr2=0x7f600c19ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:07.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 0x7f600c19ad20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6000006010 tx=0x7f60000042f0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 shutdown_connections 2024-04-26T11:31:07.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f5ff40a3ca0 0x7f5ff40a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f600c106770 0x7f600c1a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c105db0 0x7f600c19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 --2- 172.21.15.110:0/32180036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f600c104bc0 0x7f600c19ad20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 >> 172.21.15.110:0/32180036 conn(0x7f600c100150 msgr2=0x7f600c1090b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:07.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 shutdown_connections 2024-04-26T11:31:07.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.126+0000 7f6014000640 1 -- 172.21.15.110:0/32180036 wait complete. 2024-04-26T11:31:07.146 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-26T11:31:07.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.330+0000 7f3340a00640 1 -- 172.21.15.110:0/3531839965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333c103a40 msgr2=0x7f333c103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:07.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.330+0000 7f3340a00640 1 --2- 172.21.15.110:0/3531839965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333c103a40 0x7f333c103ec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3328009900 tx=0x7f332802a410 comp rx=0 tx=0).stop 2024-04-26T11:31:07.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.330+0000 7f3340a00640 1 -- 172.21.15.110:0/3531839965 shutdown_connections 2024-04-26T11:31:07.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.330+0000 7f3340a00640 1 --2- 172.21.15.110:0/3531839965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c104400 0x7f333c10ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.330+0000 7f3340a00640 1 --2- 172.21.15.110:0/3531839965 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333c103a40 0x7f333c103ec0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.330+0000 7f3340a00640 1 --2- 172.21.15.110:0/3531839965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f333c102850 0x7f333c102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.330+0000 7f3340a00640 1 -- 172.21.15.110:0/3531839965 >> 172.21.15.110:0/3531839965 conn(0x7f333c0fddc0 msgr2=0x7f333c100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:07.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.331+0000 7f3340a00640 1 -- 172.21.15.110:0/3531839965 shutdown_connections 2024-04-26T11:31:07.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.331+0000 7f3340a00640 1 -- 172.21.15.110:0/3531839965 wait complete. 2024-04-26T11:31:07.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.331+0000 7f3340a00640 1 Processor -- start 2024-04-26T11:31:07.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f3340a00640 1 -- start start 2024-04-26T11:31:07.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f3340a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f333c102850 0x7f333c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:07.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f3340a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c103a40 0x7f333c19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f3340a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333c104400 0x7f333c1a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f3340a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f333c10e2f0 con 0x7f333c102850 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f3340a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f333c10e170 con 0x7f333c103a40 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f3340a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f333c10e470 con 0x7f333c104400 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f333a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f333c102850 0x7f333c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f333a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f333c102850 0x7f333c19ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38946/0 (socket says 172.21.15.110:38946) 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f3339e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c103a40 0x7f333c19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f333a800640 1 -- 172.21.15.110:0/2397977664 learned_addr learned my addr 172.21.15.110:0/2397977664 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.332+0000 7f333b200640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333c104400 0x7f333c1a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f333a800640 1 -- 172.21.15.110:0/2397977664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333c104400 msgr2=0x7f333c1a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f333a800640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333c104400 0x7f333c1a21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f333a800640 1 -- 172.21.15.110:0/2397977664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c103a40 msgr2=0x7f333c19b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f333a800640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c103a40 0x7f333c19b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f333a800640 1 -- 172.21.15.110:0/2397977664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c1a2860 con 0x7f333c102850 2024-04-26T11:31:07.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f3339e00640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c103a40 0x7f333c19b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:07.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f333a800640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f333c102850 0x7f333c19ac50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f332c00e9c0 tx=0x7f332c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:07.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f3333400640 1 -- 172.21.15.110:0/2397977664 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c00cd80 con 0x7f333c102850 2024-04-26T11:31:07.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f3333400640 1 -- 172.21.15.110:0/2397977664 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f332c0035f0 con 0x7f333c102850 2024-04-26T11:31:07.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c1a2b50 con 0x7f333c102850 2024-04-26T11:31:07.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f3333400640 1 -- 172.21.15.110:0/2397977664 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c010690 con 0x7f333c102850 2024-04-26T11:31:07.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.333+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c1a30a0 con 0x7f333c102850 2024-04-26T11:31:07.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.335+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f333c1a3270 con 0x7f333c102850 2024-04-26T11:31:07.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.336+0000 7f3333400640 1 -- 172.21.15.110:0/2397977664 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 19) ==== 138664+0+0 (secure 0 0 0) 0x7f332c0037a0 con 0x7f333c102850 2024-04-26T11:31:07.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.338+0000 7f3333400640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33200a3bf0 0x7f33200a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:07.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.338+0000 7f3339e00640 1 -- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33200a3bf0 msgr2=0x7f33200a60b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/2430566216 2024-04-26T11:31:07.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.338+0000 7f3333400640 1 -- 172.21.15.110:0/2397977664 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f332c0d08d0 con 0x7f333c102850 2024-04-26T11:31:07.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.339+0000 7f3339e00640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33200a3bf0 0x7f33200a60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:31:07.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.343+0000 7f3333400640 1 -- 172.21.15.110:0/2397977664 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f332c09d210 con 0x7f333c102850 2024-04-26T11:31:07.372 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:07 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:07.160+0000 7f85c1ff2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:31:07.470 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:07.055+0000 7efe938d9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:31:07.470 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:07.159+0000 7efe938d9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:31:07.470 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:07.469+0000 7efe938d9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:31:07.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:07.259+0000 7f1c08cb3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:31:07.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:07.396+0000 7f1c08cb3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:31:07.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.540+0000 7f3339e00640 1 -- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33200a3bf0 msgr2=0x7f33200a60b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/2430566216 2024-04-26T11:31:07.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.540+0000 7f3339e00640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33200a3bf0 0x7f33200a60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T11:31:07.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.548+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f333c1a3440 con 0x7f333c102850 2024-04-26T11:31:07.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.553+0000 7f3333400640 1 -- 172.21.15.110:0/2397977664 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7f332c09cb10 con 0x7f333c102850 2024-04-26T11:31:07.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33200a3bf0 msgr2=0x7f33200a60b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33200a3bf0 0x7f33200a60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f333c102850 msgr2=0x7f333c19ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f333c102850 0x7f333c19ac50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f332c00e9c0 tx=0x7f332c00ee80 comp rx=0 tx=0).stop 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 shutdown_connections 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f33200a3bf0 0x7f33200a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f333c104400 0x7f333c1a21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333c103a40 0x7f333c19b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 --2- 172.21.15.110:0/2397977664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f333c102850 0x7f333c19ac50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 >> 172.21.15.110:0/2397977664 conn(0x7f333c0fddc0 msgr2=0x7f333c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.557+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 shutdown_connections 2024-04-26T11:31:07.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:07.558+0000 7f3340a00640 1 -- 172.21.15.110:0/2397977664 wait complete. 2024-04-26T11:31:07.583 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T11:31:07.651 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T11:31:07.651 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-26T11:31:07.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:31:07.651 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-04-26T11:31:07.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:31:07.706 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-04-26T11:31:07.755 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:07.556+0000 7efe938d9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:31:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:07 smithi196 ceph-mon[32572]: pgmap v445: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:31:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:07 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T11:31:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:07 smithi196 ceph-mon[32572]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-04-26T11:31:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:07 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' 2024-04-26T11:31:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:07 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2397977664' entity='client.admin' 2024-04-26T11:31:07.778 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-04-26T11:31:07.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:31:07.780 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-04-26T11:31:07.780 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T11:31:07.780 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-04-26T11:31:07.780 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-04-26T11:31:07.780 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T11:31:07.840 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:07.812+0000 7f1c08cb3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:31:07.840 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-mon[28069]: pgmap v445: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:31:07.840 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T11:31:07.840 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-mon[28069]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-04-26T11:31:07.840 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' 2024-04-26T11:31:07.841 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2397977664' entity='client.admin' 2024-04-26T11:31:07.871 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:07 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:07.470+0000 7f85c1ff2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:31:07.872 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:07 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:07.556+0000 7f85c1ff2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:31:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:07 smithi193 ceph-mon[32782]: pgmap v445: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T11:31:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:07 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T11:31:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:07 smithi193 ceph-mon[32782]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-04-26T11:31:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:07 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' 2024-04-26T11:31:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:07 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2397977664' entity='client.admin' 2024-04-26T11:31:08.215 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:08.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:07.928+0000 7f1c08cb3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:31:09.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:08.742+0000 7efe938d9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:31:09.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:08.912+0000 7efe938d9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:31:09.075 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:08 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:08.735+0000 7f85c1ff2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:31:09.075 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:08 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:08.903+0000 7f85c1ff2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:31:09.362 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:09 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:09.073+0000 7f85c1ff2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:31:09.362 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:09 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:09.360+0000 7f85c1ff2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:31:09.376 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:09 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:09.085+0000 7efe938d9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:31:09.376 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:09 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:09.375+0000 7efe938d9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:31:09.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:09.537+0000 7f1c08cb3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:31:09.621 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:09 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:09.453+0000 7f85c1ff2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:31:09.675 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:09 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:09.469+0000 7efe938d9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:31:09.675 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:09 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:09.674+0000 7efe938d9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:31:09.998 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:09.768+0000 7f1c08cb3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:31:10.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:09 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:09.869+0000 7efe938d9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:31:10.122 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:09 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:09.660+0000 7f85c1ff2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:31:10.122 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:09 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:09.854+0000 7f85c1ff2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:31:10.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:09.996+0000 7f1c08cb3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:31:10.598 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:10.404+0000 7f1c08cb3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:31:10.598 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:10.533+0000 7f1c08cb3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:31:10.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.640+0000 7f479be00700 1 -- 172.21.15.110:0/932720176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47941094f0 msgr2=0x7f47941098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:10.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.640+0000 7f479be00700 1 --2- 172.21.15.110:0/932720176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47941094f0 0x7f47941098d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47880098f0 tx=0x7f4788009c00 comp rx=0 tx=0).stop 2024-04-26T11:31:10.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.640+0000 7f479be00700 1 -- 172.21.15.110:0/932720176 shutdown_connections 2024-04-26T11:31:10.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.640+0000 7f479be00700 1 --2- 172.21.15.110:0/932720176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4794103e30 0x7f47941102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.640+0000 7f479be00700 1 --2- 172.21.15.110:0/932720176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47941094f0 0x7f47941098d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.640+0000 7f479be00700 1 --2- 172.21.15.110:0/932720176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4794103470 0x7f47941038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.640+0000 7f479be00700 1 -- 172.21.15.110:0/932720176 >> 172.21.15.110:0/932720176 conn(0x7f479407a5d0 msgr2=0x7f479407a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:10.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.640+0000 7f479be00700 1 -- 172.21.15.110:0/932720176 shutdown_connections 2024-04-26T11:31:10.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.640+0000 7f479be00700 1 -- 172.21.15.110:0/932720176 wait complete. 2024-04-26T11:31:10.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.641+0000 7f479be00700 1 Processor -- start 2024-04-26T11:31:10.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.641+0000 7f479be00700 1 -- start start 2024-04-26T11:31:10.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f479be00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4794103470 0x7f4794075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f479be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4794103e30 0x7f4794075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f479be00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47941094f0 0x7f47940761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f479be00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f47941135f0 con 0x7f4794103e30 2024-04-26T11:31:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f479be00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4794113470 con 0x7f47941094f0 2024-04-26T11:31:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f479be00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4794113770 con 0x7f4794103470 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f4799400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4794103470 0x7f4794075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f4799400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4794103470 0x7f4794075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:49120/0 (socket says 172.21.15.110:49120) 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f4799400700 1 -- 172.21.15.110:0/3372958431 learned_addr learned my addr 172.21.15.110:0/3372958431 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f4799e00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47941094f0 0x7f47940761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f4798a00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4794103e30 0x7f4794075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f4799400700 1 -- 172.21.15.110:0/3372958431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47941094f0 msgr2=0x7f47940761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f4799400700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47941094f0 0x7f47940761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f4799400700 1 -- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4794103e30 msgr2=0x7f4794075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.642+0000 7f4799400700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4794103e30 0x7f4794075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.643+0000 7f4799400700 1 -- 172.21.15.110:0/3372958431 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47941a8090 con 0x7f4794103470 2024-04-26T11:31:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.643+0000 7f4799400700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4794103470 0x7f4794075720 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f478800f990 tx=0x7f478800f9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:10.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.643+0000 7f4792000700 1 -- 172.21.15.110:0/3372958431 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788027070 con 0x7f4794103470 2024-04-26T11:31:10.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.643+0000 7f4792000700 1 -- 172.21.15.110:0/3372958431 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4788005570 con 0x7f4794103470 2024-04-26T11:31:10.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.643+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47941a8320 con 0x7f4794103470 2024-04-26T11:31:10.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.643+0000 7f4792000700 1 -- 172.21.15.110:0/3372958431 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788004930 con 0x7f4794103470 2024-04-26T11:31:10.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.643+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47941a8800 con 0x7f4794103470 2024-04-26T11:31:10.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.644+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479406a110 con 0x7f4794103470 2024-04-26T11:31:10.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.646+0000 7f4792000700 1 -- 172.21.15.110:0/3372958431 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 19) ==== 138664+0+0 (secure 0 0 0) 0x7f478802a070 con 0x7f4794103470 2024-04-26T11:31:10.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.648+0000 7f4792000700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f477c0a3c90 0x7f477c0a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:10.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.648+0000 7f4798a00700 1 -- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f477c0a3c90 msgr2=0x7f477c0a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/2430566216 2024-04-26T11:31:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.649+0000 7f4792000700 1 -- 172.21.15.110:0/3372958431 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f47880d10a0 con 0x7f4794103470 2024-04-26T11:31:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.649+0000 7f4798a00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f477c0a3c90 0x7f477c0a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:31:10.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.655+0000 7f4792000700 1 -- 172.21.15.110:0/3372958431 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4788013030 con 0x7f4794103470 2024-04-26T11:31:10.755 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:10 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:10.473+0000 7efe938d9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:31:10.853 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:10.803+0000 7f1c08cb3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:31:10.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.850+0000 7f4798a00700 1 -- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f477c0a3c90 msgr2=0x7f477c0a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/2430566216 2024-04-26T11:31:10.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.850+0000 7f4798a00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f477c0a3c90 0x7f477c0a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T11:31:10.871 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:10 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:10.455+0000 7f85c1ff2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:31:10.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.939+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f479402e650 con 0x7f4794103470 2024-04-26T11:31:10.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.939+0000 7f4792000700 1 -- 172.21.15.110:0/3372958431 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f478809daa0 con 0x7f4794103470 2024-04-26T11:31:10.942 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T11:31:10.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f477c0a3c90 msgr2=0x7f477c0a6150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:31:10.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f477c0a3c90 0x7f477c0a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4794103470 msgr2=0x7f4794075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:10.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4794103470 0x7f4794075720 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f478800f990 tx=0x7f478800f9c0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 shutdown_connections 2024-04-26T11:31:10.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47941094f0 0x7f47940761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f477c0a3c90 0x7f477c0a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4794103470 0x7f4794075720 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 --2- 172.21.15.110:0/3372958431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4794103e30 0x7f4794075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:10.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 >> 172.21.15.110:0/3372958431 conn(0x7f479407a5d0 msgr2=0x7f47941021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:10.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.942+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 shutdown_connections 2024-04-26T11:31:10.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:10.943+0000 7f479be00700 1 -- 172.21.15.110:0/3372958431 wait complete. 2024-04-26T11:31:11.175 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:10 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3372958431' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T11:31:11.175 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:10 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:10.875+0000 7f85c1ff2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:31:11.175 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:10 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:10.971+0000 7f85c1ff2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:31:11.208 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:10 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3372958431' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T11:31:11.208 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:10 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:10.902+0000 7efe938d9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:31:11.209 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:11 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:11.003+0000 7efe938d9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:31:11.209 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:11 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:11.207+0000 7efe938d9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:31:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:10 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3372958431' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T11:31:11.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:11.071+0000 7f1c08cb3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:31:11.621 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:11 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:11.173+0000 7f85c1ff2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:31:11.867 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T11:31:11.867 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T11:31:11.867 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-04-26T11:31:11.867 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T11:31:11.867 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-04-26T11:31:11.868 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T11:31:11.868 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T11:31:11.868 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T11:31:11.868 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-04-26T11:31:11.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:31:11.868 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-04-26T11:31:11.909 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 41823sec preferred_lft 41823sec 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-04-26T11:31:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:31:11.911 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T11:31:11.911 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T11:31:11.911 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-26T11:31:11.911 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2024-04-26T11:31:11.911 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2024-04-26T11:31:11.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2024-04-26T11:31:11.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T11:31:11.912 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-26T11:31:12.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:11 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:11.734+0000 7efe938d9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:31:12.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:11 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:11.828+0000 7efe938d9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:31:12.040 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:11 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:11.702+0000 7f85c1ff2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:31:12.041 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:11 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:11.795+0000 7f85c1ff2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:31:12.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T11:31:12.070 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:11.905+0000 7f1c08cb3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:31:12.372 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:12.039+0000 7f85c1ff2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:31:12.372 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:12.173+0000 7f85c1ff2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:31:12.372 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:12.269+0000 7f85c1ff2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:31:12.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T11:31:12.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:31:12.413 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T11:31:12.422 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:12.072+0000 7efe938d9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:31:12.422 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:12.209+0000 7efe938d9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:31:12.422 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:12.304+0000 7efe938d9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:31:12.422 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:12.421+0000 7efe938d9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:31:12.472 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-04-26T11:31:12.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:31:12.476 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-04-26T11:31:12.545 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-04-26T11:31:12.545 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T11:31:12.545 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T11:31:12.545 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T11:31:12.545 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T11:31:12.546 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T11:31:12.546 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-26T11:31:12.546 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T11:31:12.546 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T11:31:12.546 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T11:31:12.546 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-26T11:31:12.634 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:12.498+0000 7f1c08cb3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:31:12.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T11:31:12.693 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:12.384+0000 7f85c1ff2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:31:12.898 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:12.631+0000 7f1c08cb3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:31:13.005 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:12.726+0000 7efe938d9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:31:13.122 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:12.691+0000 7f85c1ff2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:31:13.274 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:12.909+0000 7f1c08cb3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:31:13.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T11:31:13.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:31:13.286 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-04-26T11:31:13.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:31:13.334 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-04-26T11:31:13.382 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T11:31:13.383 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-26T11:31:13.383 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--tmp-cephfs 2024-04-26T11:31:13.383 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-04-26T11:31:13.383 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-26T11:31:13.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T11:31:13.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T11:31:13.550 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-04-26T11:31:13.550 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T11:31:13.550 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-26T11:31:13.550 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-04-26T11:31:13.550 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T11:31:13.550 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-04-26T11:31:13.550 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-04-26T11:31:13.551 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-04-26T11:31:13.551 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-26T11:31:13.574 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:13.289+0000 7f85c1ff2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:31:13.574 INFO:journalctl@ceph.mgr.y.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-y[34166]: 2024-04-26T11:31:13.505+0000 7f85c1ff2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:31:13.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T11:31:13.755 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:13.330+0000 7efe938d9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:31:13.755 INFO:journalctl@ceph.mgr.z.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-z[34450]: 2024-04-26T11:31:13.548+0000 7efe938d9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:31:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: Standby manager daemon y restarted 2024-04-26T11:31:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: Standby manager daemon y started 2024-04-26T11:31:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T11:31:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:31:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T11:31:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:31:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: Standby manager daemon z restarted 2024-04-26T11:31:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: Standby manager daemon z started 2024-04-26T11:31:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T11:31:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:31:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T11:31:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:13 smithi196 ceph-mon[32572]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:31:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:13.603+0000 7f1c08cb3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:31:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:13.736+0000 7f1c08cb3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:31:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: Standby manager daemon y restarted 2024-04-26T11:31:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: Standby manager daemon y started 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: Standby manager daemon z restarted 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: Standby manager daemon z started 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T11:31:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:13 smithi110 ceph-mon[28069]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:31:13.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T11:31:13.816 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T11:31:13.816 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-04-26T11:31:13.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-04-26T11:31:13.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T11:31:13.816 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-04-26T11:31:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: Standby manager daemon y restarted 2024-04-26T11:31:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: Standby manager daemon y started 2024-04-26T11:31:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T11:31:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:31:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T11:31:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.193:0/2854487808' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:31:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: Standby manager daemon z restarted 2024-04-26T11:31:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: Standby manager daemon z started 2024-04-26T11:31:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T11:31:13.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T11:31:13.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T11:31:13.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:13 smithi193 ceph-mon[32782]: from='mgr.? 172.21.15.196:0/3087897771' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T11:31:13.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T11:31:13.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T11:31:14.004 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T11:31:14.004 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /tmp/cephfs 2024-04-26T11:31:14.048 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/tmp/cephfs' 2024-04-26T11:31:14.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T11:31:14.049 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /tmp/cephfs 2024-04-26T11:31:14.138 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-26T11:31:14.138 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-26T11:31:14.138 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/5209720f-dc0d-4dcc-ad37-e3d1b7a0e6d2 2024-04-26T11:31:14.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:31:14.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/5209720f-dc0d-4dcc-ad37-e3d1b7a0e6d2 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2024-04-26T11:31:14.321 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-04-26T11:31:14.322 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-04-26T11:31:14.409 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:14.081+0000 7f1c08cb3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:31:14.409 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:14.268+0000 7f1c08cb3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:31:14.409 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:14.406+0000 7f1c08cb3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:31:14.749 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:14.574+0000 7f1c08cb3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:31:14.749 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:14 smithi110 ceph-mon[28069]: mgrmap e20: x(active, since 12m), standbys: y, z 2024-04-26T11:31:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:14 smithi193 ceph-mon[32782]: mgrmap e20: x(active, since 12m), standbys: y, z 2024-04-26T11:31:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:14 smithi196 ceph-mon[32572]: mgrmap e20: x(active, since 12m), standbys: y, z 2024-04-26T11:31:15.071 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-04-26T11:31:15.071 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-04-26T11:31:15.072 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.110:3300,172.21.15.193:3300,172.21.15.196:3300" 2024-04-26T11:31:15.072 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 0@6e439470-03be-11ef-bc93-c7b262605968.cephfs=/volumes/qa/sv_1/5209720f-dc0d-4dcc-ad37-e3d1b7a0e6d2 2024-04-26T11:31:15.072 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.110:3300/172.21.15.193:3300/172.21.15.196:3300" will pass to kernel 2024-04-26T11:31:15.079 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T11:31:15.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:31:15.080 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /tmp/cephfs 2024-04-26T11:31:15.148 DEBUG:teuthology.orchestra.run.smithi110:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T11:31:15.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T11:31:15.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T11:31:15.258 INFO:teuthology.orchestra.run.smithi110.stdout:client25049 2024-04-26T11:31:15.259 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-04-26T11:31:15.259 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T11:31:15.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:14.957+0000 7f1c08cb3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:31:15.299 DEBUG:teuthology.orchestra.run.smithi110:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T11:31:15.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T11:31:15.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T11:31:15.453 INFO:teuthology.orchestra.run.smithi110.stdout:client25049 2024-04-26T11:31:15.453 DEBUG:teuthology.orchestra.run.smithi110:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T11:31:15.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T11:31:15.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T11:31:15.566 INFO:teuthology.orchestra.run.smithi110.stdout:client25049 2024-04-26T11:31:15.567 DEBUG:teuthology.orchestra.run.smithi110:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6e439470-03be-11ef-bc93-c7b262605968.client25049/status') 2024-04-26T11:31:15.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T11:31:15.698 INFO:teuthology.orchestra.run.smithi110.stdout:instance: client.25049 (3)172.21.15.110:0/3240209317 2024-04-26T11:31:15.698 INFO:teuthology.orchestra.run.smithi110.stdout:blocklisted: false 2024-04-26T11:31:15.699 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records in 2024-04-26T11:31:15.699 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records out 2024-04-26T11:31:15.699 INFO:teuthology.orchestra.run.smithi110.stderr:72 bytes copied, 6.3915e-05 s, 1.1 MB/s 2024-04-26T11:31:15.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T11:31:15.711 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T11:31:15.720 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T11:31:15.720 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-04-26T11:31:15.720 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-26T11:31:15.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.904+0000 7f5319e00640 1 -- 172.21.15.110:0/696061193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53141023a0 msgr2=0x7f5314102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.904+0000 7f5319e00640 1 --2- 172.21.15.110:0/696061193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53141023a0 0x7f5314102820 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f530c009ca0 tx=0x7f530c02a950 comp rx=0 tx=0).stop 2024-04-26T11:31:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.904+0000 7f5319e00640 1 -- 172.21.15.110:0/696061193 shutdown_connections 2024-04-26T11:31:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.904+0000 7f5319e00640 1 --2- 172.21.15.110:0/696061193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53141023a0 0x7f5314102820 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.904+0000 7f5319e00640 1 --2- 172.21.15.110:0/696061193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5314101a00 0x7f5314101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.904+0000 7f5319e00640 1 --2- 172.21.15.110:0/696061193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53141010a0 0x7f53141014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.904+0000 7f5319e00640 1 -- 172.21.15.110:0/696061193 >> 172.21.15.110:0/696061193 conn(0x7f53140fcc20 msgr2=0x7f53140ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.904+0000 7f5319e00640 1 -- 172.21.15.110:0/696061193 shutdown_connections 2024-04-26T11:31:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.904+0000 7f5319e00640 1 -- 172.21.15.110:0/696061193 wait complete. 2024-04-26T11:31:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.905+0000 7f5319e00640 1 Processor -- start 2024-04-26T11:31:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.905+0000 7f5319e00640 1 -- start start 2024-04-26T11:31:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.905+0000 7f5319e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53141010a0 0x7f531419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.905+0000 7f5319e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5314101a00 0x7f531419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5319e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53141023a0 0x7f53141a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5319e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f53141104e0 con 0x7f5314101a00 2024-04-26T11:31:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5319e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5314110360 con 0x7f53141010a0 2024-04-26T11:31:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5319e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5314110660 con 0x7f53141023a0 2024-04-26T11:31:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5313e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5314101a00 0x7f531419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5318a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53141010a0 0x7f531419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5313e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5314101a00 0x7f531419b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57870/0 (socket says 172.21.15.110:57870) 2024-04-26T11:31:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5313e00640 1 -- 172.21.15.110:0/437606289 learned_addr learned my addr 172.21.15.110:0/437606289 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5318a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53141010a0 0x7f531419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:50040/0 (socket says 172.21.15.110:50040) 2024-04-26T11:31:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5319400640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53141023a0 0x7f53141a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5318a00640 1 -- 172.21.15.110:0/437606289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53141023a0 msgr2=0x7f53141a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5318a00640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53141023a0 0x7f53141a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5318a00640 1 -- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5314101a00 msgr2=0x7f531419b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5318a00640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5314101a00 0x7f531419b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5318a00640 1 -- 172.21.15.110:0/437606289 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53141a2800 con 0x7f53141010a0 2024-04-26T11:31:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.906+0000 7f5313e00640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5314101a00 0x7f531419b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.907+0000 7f5318a00640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53141010a0 0x7f531419abe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f530800e9f0 tx=0x7f530800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.907+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530800ccc0 con 0x7f53141010a0 2024-04-26T11:31:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.907+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53141a2af0 con 0x7f53141010a0 2024-04-26T11:31:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.907+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5308005020 con 0x7f53141010a0 2024-04-26T11:31:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.907+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308004a00 con 0x7f53141010a0 2024-04-26T11:31:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.907+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53141a3040 con 0x7f53141010a0 2024-04-26T11:31:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.908+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531410c040 con 0x7f53141010a0 2024-04-26T11:31:15.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.911+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 20) ==== 138664+0+0 (secure 0 0 0) 0x7f5308004ba0 con 0x7f53141010a0 2024-04-26T11:31:15.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.912+0000 7f5311600640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f52fc0a3bf0 0x7f52fc0a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:15.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.912+0000 7f5313e00640 1 -- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f52fc0a3bf0 msgr2=0x7f52fc0a60b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/2430566216 2024-04-26T11:31:15.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.913+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8385+0+0 (secure 0 0 0) 0x7f53080d0640 con 0x7f53141010a0 2024-04-26T11:31:15.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.913+0000 7f5313e00640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f52fc0a3bf0 0x7f52fc0a60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T11:31:15.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:15.914+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5308042e20 con 0x7f53141010a0 2024-04-26T11:31:16.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:15.762+0000 7f1c08cb3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:31:16.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:16.090+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mgrmap(e 21) ==== 138331+0+0 (secure 0 0 0) 0x7f5308098e90 con 0x7f53141010a0 2024-04-26T11:31:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:16.091+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f52fc0a3bf0 msgr2=0x7f52fc0a60b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:31:16.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:16.091+0000 7f5311600640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:6800/2430566216,v1:172.21.15.110:6801/2430566216] conn(0x7f52fc0a3bf0 0x7f52fc0a60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:16.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:16.184+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f531402dad0 con 0x7f53141010a0 2024-04-26T11:31:16.383 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: Active manager daemon x restarted 2024-04-26T11:31:16.383 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: Activating manager daemon x 2024-04-26T11:31:16.383 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T11:31:16.383 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: mgrmap e21: x(active, starting, since 0.0179551s), standbys: y, z 2024-04-26T11:31:16.383 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:31:16.383 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:31:16.383 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:31:16.383 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:31:16.384 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T11:31:16.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T11:31:16.389 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.067+0000 7f1c08cb3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: Active manager daemon x restarted 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: Activating manager daemon x 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: mgrmap e21: x(active, starting, since 0.0179551s), standbys: y, z 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:31:16.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:31:16.391 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T11:31:16.392 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T11:31:16.396 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: Active manager daemon x restarted 2024-04-26T11:31:16.396 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: Activating manager daemon x 2024-04-26T11:31:16.396 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T11:31:16.396 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: mgrmap e21: x(active, starting, since 0.0179551s), standbys: y, z 2024-04-26T11:31:16.396 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:31:16.397 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T11:31:16.398 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T11:31:16.399 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T11:31:16.399 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T11:31:16.399 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.396+0000 7f1b5e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.396+0000 7f1b5e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.396+0000 7f1b5e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.396+0000 7f1b5e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.396+0000 7f1b5e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.397+0000 7f1b5a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.397+0000 7f1b5a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.397+0000 7f1b5a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.397+0000 7f1b5a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:16.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:31:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:31:16.397+0000 7f1b5a000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:31:17.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.160+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 <== mon.2 v2:172.21.15.193:3300/0 8 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f53080ce0c0 con 0x7f53141010a0 2024-04-26T11:31:17.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.161+0000 7f5311600640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f52fc051d40 0x7f52fc052120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:17.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.161+0000 7f5311600640 1 -- 172.21.15.110:0/437606289 <== mon.2 v2:172.21.15.193:3300/0 9 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f53080cd4f0 con 0x7f53141010a0 2024-04-26T11:31:17.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.163+0000 7f5313e00640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f52fc051d40 0x7f52fc052120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:17.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.165+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f52fc051d40 msgr2=0x7f52fc052120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.165+0000 7f5319e00640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f52fc051d40 0x7f52fc052120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.165+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53141010a0 msgr2=0x7f531419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.165+0000 7f5319e00640 1 --2- 172.21.15.110:0/437606289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53141010a0 0x7f531419abe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f530800e9f0 tx=0x7f530800eeb0 comp rx=0 tx=0).stop 2024-04-26T11:31:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.165+0000 7f5319400640 1 -- 172.21.15.110:0/437606289 reap_dead start 2024-04-26T11:31:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.165+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 shutdown_connections 2024-04-26T11:31:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.165+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 >> 172.21.15.110:0/437606289 conn(0x7f53140fcc20 msgr2=0x7f53140fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.165+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 shutdown_connections 2024-04-26T11:31:17.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:17.166+0000 7f5319e00640 1 -- 172.21.15.110:0/437606289 wait complete. 2024-04-26T11:31:17.192 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-26T11:31:17.765 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T11:31:18.014 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T11:31:18.014 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-04-26T11:31:18.014 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:17 smithi193 ceph-mon[32782]: Manager daemon x is now available 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:17 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/437606289' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:17 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:17 smithi193 ceph-mon[32782]: [26/Apr/2024:11:31:16] ENGINE Bus STARTING 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:17 smithi193 ceph-mon[32782]: [26/Apr/2024:11:31:16] ENGINE Serving on http://172.21.15.110:8765 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:17 smithi196 ceph-mon[32572]: Manager daemon x is now available 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:17 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/437606289' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T11:31:18.016 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:17 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:17 smithi196 ceph-mon[32572]: [26/Apr/2024:11:31:16] ENGINE Bus STARTING 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:17 smithi196 ceph-mon[32572]: [26/Apr/2024:11:31:16] ENGINE Serving on http://172.21.15.110:8765 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:17 smithi110 ceph-mon[28069]: Manager daemon x is now available 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:17 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/437606289' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:17 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:17 smithi110 ceph-mon[28069]: [26/Apr/2024:11:31:16] ENGINE Bus STARTING 2024-04-26T11:31:18.017 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:17 smithi110 ceph-mon[28069]: [26/Apr/2024:11:31:16] ENGINE Serving on http://172.21.15.110:8765 2024-04-26T11:31:18.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.223+0000 7ff681e00640 1 -- 172.21.15.110:0/2602990817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff67c075330 msgr2=0x7ff67c075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:18.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.223+0000 7ff681e00640 1 --2- 172.21.15.110:0/2602990817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff67c075330 0x7ff67c075790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff664009900 tx=0x7ff66402a480 comp rx=0 tx=0).stop 2024-04-26T11:31:18.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.223+0000 7ff681e00640 1 -- 172.21.15.110:0/2602990817 shutdown_connections 2024-04-26T11:31:18.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.223+0000 7ff681e00640 1 --2- 172.21.15.110:0/2602990817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c10a680 0x7ff67c10cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.223+0000 7ff681e00640 1 --2- 172.21.15.110:0/2602990817 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff67c075330 0x7ff67c075790 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.223+0000 7ff681e00640 1 --2- 172.21.15.110:0/2602990817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff67c076910 0x7ff67c074d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.223+0000 7ff681e00640 1 -- 172.21.15.110:0/2602990817 >> 172.21.15.110:0/2602990817 conn(0x7ff67c0fdd60 msgr2=0x7ff67c1001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:18.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.223+0000 7ff681e00640 1 -- 172.21.15.110:0/2602990817 shutdown_connections 2024-04-26T11:31:18.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.223+0000 7ff681e00640 1 -- 172.21.15.110:0/2602990817 wait complete. 2024-04-26T11:31:18.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.224+0000 7ff681e00640 1 Processor -- start 2024-04-26T11:31:18.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.224+0000 7ff681e00640 1 -- start start 2024-04-26T11:31:18.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff681e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff67c075330 0x7ff67c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:18.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff681e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff67c076910 0x7ff67c19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:18.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff681e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c10a680 0x7ff67c1a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:18.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff681e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c110500 con 0x7ff67c075330 2024-04-26T11:31:18.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff681e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c110380 con 0x7ff67c076910 2024-04-26T11:31:18.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff681e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c110680 con 0x7ff67c10a680 2024-04-26T11:31:18.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff673e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff67c076910 0x7ff67c19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:18.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff681400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c10a680 0x7ff67c1a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff680a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff67c075330 0x7ff67c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff673e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff67c076910 0x7ff67c19b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:50160/0 (socket says 172.21.15.110:50160) 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.225+0000 7ff673e00640 1 -- 172.21.15.110:0/3174208284 learned_addr learned my addr 172.21.15.110:0/3174208284 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff681400640 1 -- 172.21.15.110:0/3174208284 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff67c076910 msgr2=0x7ff67c19b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff681400640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff67c076910 0x7ff67c19b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff681400640 1 -- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff67c075330 msgr2=0x7ff67c19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff681400640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff67c075330 0x7ff67c19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff681400640 1 -- 172.21.15.110:0/3174208284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c1a2830 con 0x7ff67c10a680 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff680a00640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff67c075330 0x7ff67c19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff681400640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c10a680 0x7ff67c1a2190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff67400e970 tx=0x7ff67400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff67a000640 1 -- 172.21.15.110:0/3174208284 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67400ccc0 con 0x7ff67c10a680 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff67a000640 1 -- 172.21.15.110:0/3174208284 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff674005020 con 0x7ff67c10a680 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c1a2b20 con 0x7ff67c10a680 2024-04-26T11:31:18.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff67a000640 1 -- 172.21.15.110:0/3174208284 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674004a00 con 0x7ff67c10a680 2024-04-26T11:31:18.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.226+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c1a3020 con 0x7ff67c10a680 2024-04-26T11:31:18.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.228+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c109440 con 0x7ff67c10a680 2024-04-26T11:31:18.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.230+0000 7ff67a000640 1 -- 172.21.15.110:0/3174208284 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 23) ==== 138767+0+0 (secure 0 0 0) 0x7ff674004ba0 con 0x7ff67c10a680 2024-04-26T11:31:18.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.231+0000 7ff67a000640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7ff6600a3d10 0x7ff6600a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:18.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.231+0000 7ff67a000640 1 -- 172.21.15.110:0/3174208284 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7ff6740d08b0 con 0x7ff67c10a680 2024-04-26T11:31:18.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.232+0000 7ff680a00640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7ff6600a3d10 0x7ff6600a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:18.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.232+0000 7ff680a00640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7ff6600a3d10 0x7ff6600a61d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff67c19c0f0 tx=0x7ff66c009500 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:18.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.236+0000 7ff67a000640 1 -- 172.21.15.110:0/3174208284 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff67409ce70 con 0x7ff67c10a680 2024-04-26T11:31:18.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.500+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 --> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7ff67c062d70 con 0x7ff6600a3d10 2024-04-26T11:31:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:18 smithi196 ceph-mon[32572]: [26/Apr/2024:11:31:16] ENGINE Serving on https://172.21.15.110:7150 2024-04-26T11:31:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:18 smithi196 ceph-mon[32572]: [26/Apr/2024:11:31:16] ENGINE Bus STARTED 2024-04-26T11:31:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:18 smithi196 ceph-mon[32572]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T11:31:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:18 smithi196 ceph-mon[32572]: mgrmap e22: x(active, since 1.08754s), standbys: y, z 2024-04-26T11:31:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:18 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:31:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:18 smithi196 ceph-mon[32572]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:18 smithi110 ceph-mon[28069]: [26/Apr/2024:11:31:16] ENGINE Serving on https://172.21.15.110:7150 2024-04-26T11:31:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:18 smithi110 ceph-mon[28069]: [26/Apr/2024:11:31:16] ENGINE Bus STARTED 2024-04-26T11:31:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:18 smithi110 ceph-mon[28069]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T11:31:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:18 smithi110 ceph-mon[28069]: mgrmap e22: x(active, since 1.08754s), standbys: y, z 2024-04-26T11:31:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:18 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:31:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:18 smithi110 ceph-mon[28069]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:18.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.578+0000 7ff67a000640 1 -- 172.21.15.110:0/3174208284 <== mgr.25028 v2:172.21.15.110:6800/2061324969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff67c062d70 con 0x7ff6600a3d10 2024-04-26T11:31:18.579 INFO:teuthology.orchestra.run.smithi110.stdout:Schedule set for path / 2024-04-26T11:31:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7ff6600a3d10 msgr2=0x7ff6600a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7ff6600a3d10 0x7ff6600a61d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff67c19c0f0 tx=0x7ff66c009500 comp rx=0 tx=0).stop 2024-04-26T11:31:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c10a680 msgr2=0x7ff67c1a2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c10a680 0x7ff67c1a2190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff67400e970 tx=0x7ff67400ee30 comp rx=0 tx=0).stop 2024-04-26T11:31:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 shutdown_connections 2024-04-26T11:31:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7ff6600a3d10 0x7ff6600a61d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff67c10a680 0x7ff67c1a2190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff67c076910 0x7ff67c19b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 --2- 172.21.15.110:0/3174208284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff67c075330 0x7ff67c19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 >> 172.21.15.110:0/3174208284 conn(0x7ff67c0fdd60 msgr2=0x7ff67c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:18.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 shutdown_connections 2024-04-26T11:31:18.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.581+0000 7ff681e00640 1 -- 172.21.15.110:0/3174208284 wait complete. 2024-04-26T11:31:18.599 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-26T11:31:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:18 smithi193 ceph-mon[32782]: [26/Apr/2024:11:31:16] ENGINE Serving on https://172.21.15.110:7150 2024-04-26T11:31:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:18 smithi193 ceph-mon[32782]: [26/Apr/2024:11:31:16] ENGINE Bus STARTED 2024-04-26T11:31:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:18 smithi193 ceph-mon[32782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T11:31:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:18 smithi193 ceph-mon[32782]: mgrmap e22: x(active, since 1.08754s), standbys: y, z 2024-04-26T11:31:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:18 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:31:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:18 smithi193 ceph-mon[32782]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:18.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.778+0000 7f476c800640 1 -- 172.21.15.110:0/2879950751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4764104550 msgr2=0x7f476410ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.778+0000 7f476c800640 1 --2- 172.21.15.110:0/2879950751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4764104550 0x7f476410ade0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4760009ca0 tx=0x7f476002a8c0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.778+0000 7f476c800640 1 -- 172.21.15.110:0/2879950751 shutdown_connections 2024-04-26T11:31:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.778+0000 7f476c800640 1 --2- 172.21.15.110:0/2879950751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4764104550 0x7f476410ade0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.778+0000 7f476c800640 1 --2- 172.21.15.110:0/2879950751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4764103b90 0x7f4764104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.778+0000 7f476c800640 1 --2- 172.21.15.110:0/2879950751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47641029a0 0x7f4764102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.778+0000 7f476c800640 1 -- 172.21.15.110:0/2879950751 >> 172.21.15.110:0/2879950751 conn(0x7f47640fdef0 msgr2=0x7f4764100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.778+0000 7f476c800640 1 -- 172.21.15.110:0/2879950751 shutdown_connections 2024-04-26T11:31:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.778+0000 7f476c800640 1 -- 172.21.15.110:0/2879950751 wait complete. 2024-04-26T11:31:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.779+0000 7f476c800640 1 Processor -- start 2024-04-26T11:31:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476c800640 1 -- start start 2024-04-26T11:31:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476c800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47641029a0 0x7f4764198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476c800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4764103b90 0x7f4764199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476c800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4764104550 0x7f47641a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476c800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f476410e4b0 con 0x7f4764103b90 2024-04-26T11:31:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476c800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f476410e330 con 0x7f4764104550 2024-04-26T11:31:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476c800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f476410e630 con 0x7f47641029a0 2024-04-26T11:31:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476a800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4764104550 0x7f47641a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f4769400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4764103b90 0x7f4764199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f4769e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47641029a0 0x7f4764198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476a800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4764104550 0x7f47641a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:50194/0 (socket says 172.21.15.110:50194) 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f4769400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4764103b90 0x7f4764199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57986/0 (socket says 172.21.15.110:57986) 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.780+0000 7f476a800640 1 -- 172.21.15.110:0/215103119 learned_addr learned my addr 172.21.15.110:0/215103119 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f476a800640 1 -- 172.21.15.110:0/215103119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47641029a0 msgr2=0x7f4764198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f476a800640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47641029a0 0x7f4764198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f476a800640 1 -- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4764103b90 msgr2=0x7f4764199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f476a800640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4764103b90 0x7f4764199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f476a800640 1 -- 172.21.15.110:0/215103119 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47641a06f0 con 0x7f4764104550 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f4769e00640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47641029a0 0x7f4764198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f4769400640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4764103b90 0x7f4764199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:18.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f476a800640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4764104550 0x7f47641a0080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f47600097b0 tx=0x7f4760031770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:18.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f475ea00640 1 -- 172.21.15.110:0/215103119 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760003b70 con 0x7f4764104550 2024-04-26T11:31:18.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f475ea00640 1 -- 172.21.15.110:0/215103119 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4760003d10 con 0x7f4764104550 2024-04-26T11:31:18.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.781+0000 7f475ea00640 1 -- 172.21.15.110:0/215103119 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476002fc10 con 0x7f4764104550 2024-04-26T11:31:18.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.782+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47641a0980 con 0x7f4764104550 2024-04-26T11:31:18.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.782+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47641a0e80 con 0x7f4764104550 2024-04-26T11:31:18.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.783+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4764109cc0 con 0x7f4764104550 2024-04-26T11:31:18.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.785+0000 7f475ea00640 1 -- 172.21.15.110:0/215103119 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 23) ==== 138767+0+0 (secure 0 0 0) 0x7f4760004040 con 0x7f4764104550 2024-04-26T11:31:18.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.786+0000 7f475ea00640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f474c0a3e40 0x7f474c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:18.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.786+0000 7f475ea00640 1 -- 172.21.15.110:0/215103119 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f47600f1c10 con 0x7f4764104550 2024-04-26T11:31:18.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.787+0000 7f4769e00640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f474c0a3e40 0x7f474c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:18.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.787+0000 7f4769e00640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f474c0a3e40 0x7f474c0a6300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47641039f0 tx=0x7f4758005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:18.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:18.794+0000 7f475ea00640 1 -- 172.21.15.110:0/215103119 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f47600be2e0 con 0x7f4764104550 2024-04-26T11:31:19.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.067+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 --> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f4764062d70 con 0x7f474c0a3e40 2024-04-26T11:31:19.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.139+0000 7f475ea00640 1 -- 172.21.15.110:0/215103119 <== mgr.25028 v2:172.21.15.110:6800/2061324969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f4764062d70 con 0x7f474c0a3e40 2024-04-26T11:31:19.140 INFO:teuthology.orchestra.run.smithi110.stdout:Retention added to path / 2024-04-26T11:31:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f474c0a3e40 msgr2=0x7f474c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f474c0a3e40 0x7f474c0a6300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47641039f0 tx=0x7f4758005f90 comp rx=0 tx=0).stop 2024-04-26T11:31:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4764104550 msgr2=0x7f47641a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4764104550 0x7f47641a0080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f47600097b0 tx=0x7f4760031770 comp rx=0 tx=0).stop 2024-04-26T11:31:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 shutdown_connections 2024-04-26T11:31:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f474c0a3e40 0x7f474c0a6300 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4764104550 0x7f47641a0080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4764103b90 0x7f4764199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 --2- 172.21.15.110:0/215103119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f47641029a0 0x7f4764198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 >> 172.21.15.110:0/215103119 conn(0x7f47640fdef0 msgr2=0x7f4764106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:19.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 shutdown_connections 2024-04-26T11:31:19.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.141+0000 7f476c800640 1 -- 172.21.15.110:0/215103119 wait complete. 2024-04-26T11:31:19.158 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-26T11:31:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.331+0000 7f57b2600640 1 -- 172.21.15.110:0/1343215422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57ac10a6a0 msgr2=0x7f57ac10cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.331+0000 7f57b2600640 1 --2- 172.21.15.110:0/1343215422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57ac10a6a0 0x7f57ac10cb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009ca0 tx=0x7f57a402a950 comp rx=0 tx=0).stop 2024-04-26T11:31:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.331+0000 7f57b2600640 1 -- 172.21.15.110:0/1343215422 shutdown_connections 2024-04-26T11:31:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.331+0000 7f57b2600640 1 --2- 172.21.15.110:0/1343215422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57ac10a6a0 0x7f57ac10cb30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.331+0000 7f57b2600640 1 --2- 172.21.15.110:0/1343215422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57ac075310 0x7f57ac075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.331+0000 7f57b2600640 1 --2- 172.21.15.110:0/1343215422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57ac0768f0 0x7f57ac074d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.331+0000 7f57b2600640 1 -- 172.21.15.110:0/1343215422 >> 172.21.15.110:0/1343215422 conn(0x7f57ac0fdd60 msgr2=0x7f57ac1001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.331+0000 7f57b2600640 1 -- 172.21.15.110:0/1343215422 shutdown_connections 2024-04-26T11:31:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.331+0000 7f57b2600640 1 -- 172.21.15.110:0/1343215422 wait complete. 2024-04-26T11:31:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.332+0000 7f57b2600640 1 Processor -- start 2024-04-26T11:31:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.332+0000 7f57b2600640 1 -- start start 2024-04-26T11:31:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.332+0000 7f57b2600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57ac075310 0x7f57ac19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.332+0000 7f57b2600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57ac0768f0 0x7f57ac19b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57b2600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57ac10a6a0 0x7f57ac1a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57b2600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac110580 con 0x7f57ac10a6a0 2024-04-26T11:31:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57b2600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac110400 con 0x7f57ac075310 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57b2600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac110700 con 0x7f57ac0768f0 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57abe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57ac0768f0 0x7f57ac19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57abe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57ac0768f0 0x7f57ac19b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:57874/0 (socket says 172.21.15.110:57874) 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57b1200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57ac075310 0x7f57ac19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57abe00640 1 -- 172.21.15.110:0/4069005490 learned_addr learned my addr 172.21.15.110:0/4069005490 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57b1c00640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57ac10a6a0 0x7f57ac1a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57abe00640 1 -- 172.21.15.110:0/4069005490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57ac075310 msgr2=0x7f57ac19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57abe00640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57ac075310 0x7f57ac19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57abe00640 1 -- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57ac10a6a0 msgr2=0x7f57ac1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57abe00640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57ac10a6a0 0x7f57ac1a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57abe00640 1 -- 172.21.15.110:0/4069005490 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ac1a27f0 con 0x7f57ac0768f0 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.333+0000 7f57b1200640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57ac075310 0x7f57ac19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.334+0000 7f57abe00640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57ac0768f0 0x7f57ac19b110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f579800e9f0 tx=0x7f579800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.334+0000 7f57a9600640 1 -- 172.21.15.110:0/4069005490 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579800cd80 con 0x7f57ac0768f0 2024-04-26T11:31:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.334+0000 7f57a9600640 1 -- 172.21.15.110:0/4069005490 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57980108e0 con 0x7f57ac0768f0 2024-04-26T11:31:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.334+0000 7f57a9600640 1 -- 172.21.15.110:0/4069005490 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5798018980 con 0x7f57ac0768f0 2024-04-26T11:31:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.334+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ac1a2ae0 con 0x7f57ac0768f0 2024-04-26T11:31:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.334+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ac1a2fe0 con 0x7f57ac0768f0 2024-04-26T11:31:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.335+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ac109460 con 0x7f57ac0768f0 2024-04-26T11:31:19.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.338+0000 7f57a9600640 1 -- 172.21.15.110:0/4069005490 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 23) ==== 138767+0+0 (secure 0 0 0) 0x7f5798010430 con 0x7f57ac0768f0 2024-04-26T11:31:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.339+0000 7f57a9600640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f57940a3d10 0x7f57940a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.340+0000 7f57a9600640 1 -- 172.21.15.110:0/4069005490 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f57980d0e30 con 0x7f57ac0768f0 2024-04-26T11:31:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.340+0000 7f57b1200640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f57940a3d10 0x7f57940a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:19.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.340+0000 7f57b1200640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f57940a3d10 0x7f57940a61d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009fc0 tx=0x7f57a0005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:19.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.341+0000 7f57a9600640 1 -- 172.21.15.110:0/4069005490 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f579809cda0 con 0x7f57ac0768f0 2024-04-26T11:31:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:19 smithi196 ceph-mon[32572]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:19 smithi196 ceph-mon[32572]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-26T11:31:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:19 smithi196 ceph-mon[32572]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:19 smithi110 ceph-mon[28069]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:19 smithi110 ceph-mon[28069]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-26T11:31:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:19 smithi110 ceph-mon[28069]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:19.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.561+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 --> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f57ac062d70 con 0x7f57940a3d10 2024-04-26T11:31:19.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.574+0000 7f57a9600640 1 -- 172.21.15.110:0/4069005490 <== mgr.25028 v2:172.21.15.110:6800/2061324969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f57ac062d70 con 0x7f57940a3d10 2024-04-26T11:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-26T00:00:00", "created": "2024-04-26T11:31:18", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-26T11:31:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.577+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f57940a3d10 msgr2=0x7f57940a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.577+0000 7f57b2600640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f57940a3d10 0x7f57940a61d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009fc0 tx=0x7f57a0005f90 comp rx=0 tx=0).stop 2024-04-26T11:31:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.577+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57ac0768f0 msgr2=0x7f57ac19b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.578+0000 7f57b2600640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57ac0768f0 0x7f57ac19b110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f579800e9f0 tx=0x7f579800eeb0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.578+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 shutdown_connections 2024-04-26T11:31:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.578+0000 7f57b2600640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f57940a3d10 0x7f57940a61d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.578+0000 7f57b2600640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57ac10a6a0 0x7f57ac1a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.578+0000 7f57b2600640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57ac0768f0 0x7f57ac19b110 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.578+0000 7f57b2600640 1 --2- 172.21.15.110:0/4069005490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57ac075310 0x7f57ac19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.578+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 >> 172.21.15.110:0/4069005490 conn(0x7f57ac0fdd60 msgr2=0x7f57ac106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:19.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.578+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 shutdown_connections 2024-04-26T11:31:19.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.578+0000 7f57b2600640 1 -- 172.21.15.110:0/4069005490 wait complete. 2024-04-26T11:31:19.596 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-26T11:31:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:19 smithi193 ceph-mon[32782]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:19 smithi193 ceph-mon[32782]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-26T11:31:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:19 smithi193 ceph-mon[32782]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:19.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.778+0000 7f7232000640 1 -- 172.21.15.110:0/2855598932 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 msgr2=0x7f722c105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.778+0000 7f7232000640 1 --2- 172.21.15.110:0/2855598932 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 0x7f722c105800 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f721c009900 tx=0x7f721c02a3f0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.778+0000 7f7232000640 1 -- 172.21.15.110:0/2855598932 shutdown_connections 2024-04-26T11:31:19.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.778+0000 7f7232000640 1 --2- 172.21.15.110:0/2855598932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f722c108670 0x7f722c10aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.778+0000 7f7232000640 1 --2- 172.21.15.110:0/2855598932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f722c105d40 0x7f722c108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.778+0000 7f7232000640 1 --2- 172.21.15.110:0/2855598932 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 0x7f722c105800 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.778+0000 7f7232000640 1 -- 172.21.15.110:0/2855598932 >> 172.21.15.110:0/2855598932 conn(0x7f722c0fce20 msgr2=0x7f722c0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:19.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.778+0000 7f7232000640 1 -- 172.21.15.110:0/2855598932 shutdown_connections 2024-04-26T11:31:19.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.778+0000 7f7232000640 1 -- 172.21.15.110:0/2855598932 wait complete. 2024-04-26T11:31:19.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.779+0000 7f7232000640 1 Processor -- start 2024-04-26T11:31:19.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.779+0000 7f7232000640 1 -- start start 2024-04-26T11:31:19.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.779+0000 7f7232000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 0x7f722c102d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.779+0000 7f7232000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f722c105d40 0x7f722c1013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.779+0000 7f7232000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f722c108670 0x7f722c101900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.779+0000 7f7232000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10e540 con 0x7f722c108670 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.779+0000 7f7232000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10e3c0 con 0x7f722c105d40 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.779+0000 7f7232000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f722c10e6c0 con 0x7f722c103410 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f722c108670 0x7f722c101900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 0x7f722c102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f722c105d40 0x7f722c1013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 0x7f722c102d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:57890/0 (socket says 172.21.15.110:57890) 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722b400640 1 -- 172.21.15.110:0/3735704466 learned_addr learned my addr 172.21.15.110:0/3735704466 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722b400640 1 -- 172.21.15.110:0/3735704466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f722c105d40 msgr2=0x7f722c1013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722b400640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f722c105d40 0x7f722c1013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722b400640 1 -- 172.21.15.110:0/3735704466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f722c108670 msgr2=0x7f722c101900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:19.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722b400640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f722c108670 0x7f722c101900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:19.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722b400640 1 -- 172.21.15.110:0/3735704466 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c102190 con 0x7f722c103410 2024-04-26T11:31:19.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722aa00640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f722c105d40 0x7f722c1013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:19.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.780+0000 7f722b400640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 0x7f722c102d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f721c005ab0 tx=0x7f721c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:19.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.781+0000 7f7223e00640 1 -- 172.21.15.110:0/3735704466 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c03f070 con 0x7f722c103410 2024-04-26T11:31:19.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.781+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722c1a2c20 con 0x7f722c103410 2024-04-26T11:31:19.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.781+0000 7f7223e00640 1 -- 172.21.15.110:0/3735704466 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f721c031c50 con 0x7f722c103410 2024-04-26T11:31:19.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.781+0000 7f7223e00640 1 -- 172.21.15.110:0/3735704466 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c035030 con 0x7f722c103410 2024-04-26T11:31:19.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.781+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722c1a31c0 con 0x7f722c103410 2024-04-26T11:31:19.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.782+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f722c0fe910 con 0x7f722c103410 2024-04-26T11:31:19.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.784+0000 7f7223e00640 1 -- 172.21.15.110:0/3735704466 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 23) ==== 138767+0+0 (secure 0 0 0) 0x7f721c042070 con 0x7f722c103410 2024-04-26T11:31:19.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.785+0000 7f7223e00640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f72100a3e40 0x7f72100a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:19.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.785+0000 7f7223e00640 1 -- 172.21.15.110:0/3735704466 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f721c0f1730 con 0x7f722c103410 2024-04-26T11:31:19.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.786+0000 7f722aa00640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f72100a3e40 0x7f72100a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:19.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.786+0000 7f722aa00640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f72100a3e40 0x7f72100a6300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f722c102af0 tx=0x7f7218005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:19.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:19.787+0000 7f7223e00640 1 -- 172.21.15.110:0/3735704466 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f721c0bd6a0 con 0x7f722c103410 2024-04-26T11:31:20.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.045+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 --> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f722c062d70 con 0x7f72100a3e40 2024-04-26T11:31:20.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.053+0000 7f7223e00640 1 -- 172.21.15.110:0/3735704466 <== mgr.25028 v2:172.21.15.110:6800/2061324969 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f722c062d70 con 0x7f72100a3e40 2024-04-26T11:31:20.054 INFO:teuthology.orchestra.run.smithi110.stdout:/ 1m 6m3h 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.055+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f72100a3e40 msgr2=0x7f72100a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.055+0000 7f7232000640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f72100a3e40 0x7f72100a6300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f722c102af0 tx=0x7f7218005f90 comp rx=0 tx=0).stop 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.055+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 msgr2=0x7f722c102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.055+0000 7f7232000640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 0x7f722c102d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f721c005ab0 tx=0x7f721c003b90 comp rx=0 tx=0).stop 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.055+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 shutdown_connections 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.056+0000 7f7232000640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f72100a3e40 0x7f72100a6300 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.056+0000 7f7232000640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f722c108670 0x7f722c101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.056+0000 7f7232000640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f722c105d40 0x7f722c1013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.056+0000 7f7232000640 1 --2- 172.21.15.110:0/3735704466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f722c103410 0x7f722c102d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.056+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 >> 172.21.15.110:0/3735704466 conn(0x7f722c0fce20 msgr2=0x7f722c103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.056+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 shutdown_connections 2024-04-26T11:31:20.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:20.056+0000 7f7232000640 1 -- 172.21.15.110:0/3735704466 wait complete. 2024-04-26T11:31:20.074 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-26T11:31:20.150 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-26T11:31:20.160 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-26T11:31:20.188 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-04-26T11:31:20.189 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-26T11:31:20.197 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-26T11:31:20.212 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T11:31:20.212 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T11:31:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='client.25103 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='client.25132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T11:31:20.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T11:31:20.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T11:31:20.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:20 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T11:31:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='client.25103 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='client.25132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T11:31:20.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:20 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T11:31:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='client.25103 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='client.25132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T11:31:20.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:20 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T11:31:20.636 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: from='client.25138 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:31:21.832 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: from='client.25138 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:31:21.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:31:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: from='client.25138 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T11:31:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-26T11:31:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:31:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:31:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:31:22.782 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T11:31:22.782 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T11:31:22.782 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-26T11:31:22.782 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Updating smithi193:/etc/ceph/ceph.conf 2024-04-26T11:31:22.782 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-26T11:31:22.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:31:22.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:31:22.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:31:22.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:31:22.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:31:22.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T11:31:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T11:31:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-26T11:31:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Updating smithi193:/etc/ceph/ceph.conf 2024-04-26T11:31:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-26T11:31:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:31:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:31:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:31:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:31:22.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:31:22.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:22.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.939+0000 7fc15c400700 1 -- 172.21.15.110:0/1837225552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc154075f70 msgr2=0x7fc15410f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:22.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.939+0000 7fc15c400700 1 --2- 172.21.15.110:0/1837225552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc154075f70 0x7fc15410f8e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc140009990 tx=0x7fc140009ca0 comp rx=0 tx=0).stop 2024-04-26T11:31:22.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.940+0000 7fc15c400700 1 -- 172.21.15.110:0/1837225552 shutdown_connections 2024-04-26T11:31:22.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.940+0000 7fc15c400700 1 --2- 172.21.15.110:0/1837225552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc15410fe20 0x7fc154112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:22.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.940+0000 7fc15c400700 1 --2- 172.21.15.110:0/1837225552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc154075650 0x7fc154075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:22.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.940+0000 7fc15c400700 1 --2- 172.21.15.110:0/1837225552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc154075f70 0x7fc15410f8e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:22.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.940+0000 7fc15c400700 1 -- 172.21.15.110:0/1837225552 >> 172.21.15.110:0/1837225552 conn(0x7fc15407a580 msgr2=0x7fc15407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:22.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.940+0000 7fc15c400700 1 -- 172.21.15.110:0/1837225552 shutdown_connections 2024-04-26T11:31:22.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.940+0000 7fc15c400700 1 -- 172.21.15.110:0/1837225552 wait complete. 2024-04-26T11:31:22.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.941+0000 7fc15c400700 1 Processor -- start 2024-04-26T11:31:22.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.941+0000 7fc15c400700 1 -- start start 2024-04-26T11:31:22.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.941+0000 7fc15c400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc154075650 0x7fc15419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:22.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.941+0000 7fc15c400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc154075f70 0x7fc15419c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:22.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.941+0000 7fc15c400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc15410fe20 0x7fc1541a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:22.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.941+0000 7fc15c400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc154115830 con 0x7fc15410fe20 2024-04-26T11:31:22.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.941+0000 7fc15c400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc1541156b0 con 0x7fc154075650 2024-04-26T11:31:22.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.941+0000 7fc15c400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc1541159b0 con 0x7fc154075f70 2024-04-26T11:31:22.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc154075650 0x7fc15419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:22.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc154075650 0x7fc15419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38596/0 (socket says 172.21.15.110:38596) 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159a00700 1 -- 172.21.15.110:0/3404692015 learned_addr learned my addr 172.21.15.110:0/3404692015 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159000700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc154075f70 0x7fc15419c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc15a400700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc15410fe20 0x7fc1541a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159a00700 1 -- 172.21.15.110:0/3404692015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc154075f70 msgr2=0x7fc15419c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159a00700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc154075f70 0x7fc15419c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159a00700 1 -- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc15410fe20 msgr2=0x7fc1541a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159a00700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc15410fe20 0x7fc1541a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159a00700 1 -- 172.21.15.110:0/3404692015 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1541a0d70 con 0x7fc154075650 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.942+0000 7fc159000700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc154075f70 0x7fc15419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.943+0000 7fc159a00700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc154075650 0x7fc15419bd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc14800eb30 tx=0x7fc14800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:22.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.943+0000 7fc152000700 1 -- 172.21.15.110:0/3404692015 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14800cbd0 con 0x7fc154075650 2024-04-26T11:31:22.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.943+0000 7fc152000700 1 -- 172.21.15.110:0/3404692015 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1480044d0 con 0x7fc154075650 2024-04-26T11:31:22.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.943+0000 7fc152000700 1 -- 172.21.15.110:0/3404692015 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148003df0 con 0x7fc154075650 2024-04-26T11:31:22.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.943+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1541a1060 con 0x7fc154075650 2024-04-26T11:31:22.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.943+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1541a88e0 con 0x7fc154075650 2024-04-26T11:31:22.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.945+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15406a110 con 0x7fc154075650 2024-04-26T11:31:22.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.947+0000 7fc152000700 1 -- 172.21.15.110:0/3404692015 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7fc148003f90 con 0x7fc154075650 2024-04-26T11:31:22.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.948+0000 7fc152000700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc13c0a3ec0 0x7fc13c0a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:22.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.948+0000 7fc152000700 1 -- 172.21.15.110:0/3404692015 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fc1480d0c60 con 0x7fc154075650 2024-04-26T11:31:22.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.948+0000 7fc159000700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc13c0a3ec0 0x7fc13c0a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:22.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.949+0000 7fc159000700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc13c0a3ec0 0x7fc13c0a6380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc154111ae0 tx=0x7fc14000b260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:22.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:22.952+0000 7fc152000700 1 -- 172.21.15.110:0/3404692015 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc14809d0b0 con 0x7fc154075650 2024-04-26T11:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T11:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T11:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Updating smithi110:/etc/ceph/ceph.conf 2024-04-26T11:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Updating smithi193:/etc/ceph/ceph.conf 2024-04-26T11:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Updating smithi196:/etc/ceph/ceph.conf 2024-04-26T11:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:31:23.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:31:23.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Updating smithi193:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:31:23.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T11:31:23.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:23.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:23.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:23.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:23.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.179+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 --> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc154063860 con 0x7fc13c0a3ec0 2024-04-26T11:31:23.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.189+0000 7fc152000700 1 -- 172.21.15.110:0/3404692015 <== mgr.25028 v2:172.21.15.110:6800/2061324969 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258043 (secure 0 0 0) 0x7fc154063860 con 0x7fc13c0a3ec0 2024-04-26T11:31:23.194 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc13c0a3ec0 msgr2=0x7fc13c0a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc13c0a3ec0 0x7fc13c0a6380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc154111ae0 tx=0x7fc14000b260 comp rx=0 tx=0).stop 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc154075650 msgr2=0x7fc15419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc154075650 0x7fc15419bd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc14800eb30 tx=0x7fc14800ee40 comp rx=0 tx=0).stop 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 shutdown_connections 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc13c0a3ec0 0x7fc13c0a6380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc15410fe20 0x7fc1541a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc154075650 0x7fc15419bd60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 --2- 172.21.15.110:0/3404692015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc154075f70 0x7fc15419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 >> 172.21.15.110:0/3404692015 conn(0x7fc15407a580 msgr2=0x7fc154100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 shutdown_connections 2024-04-26T11:31:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:23.195+0000 7fc15c400700 1 -- 172.21.15.110:0/3404692015 wait complete. 2024-04-26T11:31:23.198 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-26T11:31:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:23 smithi193 ceph-mon[32782]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:31:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:23 smithi193 ceph-mon[32782]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:31:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:23 smithi193 ceph-mon[32782]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:23 smithi193 ceph-mon[32782]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:31:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:23 smithi196 ceph-mon[32572]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:31:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:23 smithi196 ceph-mon[32572]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:31:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:23 smithi196 ceph-mon[32572]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:23 smithi196 ceph-mon[32572]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:31:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:23 smithi110 ceph-mon[28069]: Updating smithi196:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:31:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:23 smithi110 ceph-mon[28069]: Updating smithi193:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:31:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:23 smithi110 ceph-mon[28069]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T11:31:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:23 smithi110 ceph-mon[28069]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-04-26T11:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-04-26T11:31:22.105423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188415,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1560,"num_read_kb":953,"num_write":477,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1182052,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370196,"kb_used_data":12684,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571628,"statfs":{"total":1151940427776,"available":1151561347072,"internally_reserved":0,"allocated":12988416,"data_stored":9672657,"data_compressed":358443,"data_compressed_allocated":479232,"data_compressed_original":3809280,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.926164"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432705+0000","last_change":"2024-04-26T11:27:12.099635+0000","last_active":"2024-04-26T11:31:16.432705+0000","last_peered":"2024-04-26T11:31:16.432705+0000","last_clean":"2024-04-26T11:31:16.432705+0000","last_became_active":"2024-04-26T11:27:12.099342+0000","last_became_peered":"2024-04-26T11:27:12.099342+0000","last_unstale":"2024-04-26T11:31:16.432705+0000","last_undegraded":"2024-04-26T11:31:16.432705+0000","last_fullsized":"2024-04-26T11:31:16.432705+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:36.433968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407016+0000","last_change":"2024-04-26T11:27:12.090804+0000","last_active":"2024-04-26T11:31:16.407016+0000","last_peered":"2024-04-26T11:31:16.407016+0000","last_clean":"2024-04-26T11:31:16.407016+0000","last_became_active":"2024-04-26T11:27:12.089662+0000","last_became_peered":"2024-04-26T11:27:12.089662+0000","last_unstale":"2024-04-26T11:31:16.407016+0000","last_undegraded":"2024-04-26T11:31:16.407016+0000","last_fullsized":"2024-04-26T11:31:16.407016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.776482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406765+0000","last_change":"2024-04-26T11:27:12.094739+0000","last_active":"2024-04-26T11:31:16.406765+0000","last_peered":"2024-04-26T11:31:16.406765+0000","last_clean":"2024-04-26T11:31:16.406765+0000","last_became_active":"2024-04-26T11:27:12.094410+0000","last_became_peered":"2024-04-26T11:27:12.094410+0000","last_unstale":"2024-04-26T11:31:16.406765+0000","last_undegraded":"2024-04-26T11:31:16.406765+0000","last_fullsized":"2024-04-26T11:31:16.406765+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:17.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224063+0000","last_change":"2024-04-26T11:28:03.446873+0000","last_active":"2024-04-26T11:31:16.224063+0000","last_peered":"2024-04-26T11:31:16.224063+0000","last_clean":"2024-04-26T11:31:16.224063+0000","last_became_active":"2024-04-26T11:28:03.445335+0000","last_became_peered":"2024-04-26T11:28:03.445335+0000","last_unstale":"2024-04-26T11:31:16.224063+0000","last_undegraded":"2024-04-26T11:31:16.224063+0000","last_fullsized":"2024-04-26T11:31:16.224063+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:59.892678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226479+0000","last_change":"2024-04-26T11:27:12.114071+0000","last_active":"2024-04-26T11:31:16.226479+0000","last_peered":"2024-04-26T11:31:16.226479+0000","last_clean":"2024-04-26T11:31:16.226479+0000","last_became_active":"2024-04-26T11:27:12.113795+0000","last_became_peered":"2024-04-26T11:27:12.113795+0000","last_unstale":"2024-04-26T11:31:16.226479+0000","last_undegraded":"2024-04-26T11:31:16.226479+0000","last_fullsized":"2024-04-26T11:31:16.226479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:34.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083760+0000","last_change":"2024-04-26T11:27:12.108449+0000","last_active":"2024-04-26T11:31:16.083760+0000","last_peered":"2024-04-26T11:31:16.083760+0000","last_clean":"2024-04-26T11:31:16.083760+0000","last_became_active":"2024-04-26T11:27:12.108071+0000","last_became_peered":"2024-04-26T11:27:12.108071+0000","last_unstale":"2024-04-26T11:31:16.083760+0000","last_undegraded":"2024-04-26T11:31:16.083760+0000","last_fullsized":"2024-04-26T11:31:16.083760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:04.001728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405659+0000","last_change":"2024-04-26T11:29:03.603681+0000","last_active":"2024-04-26T11:31:16.405659+0000","last_peered":"2024-04-26T11:31:16.405659+0000","last_clean":"2024-04-26T11:31:16.405659+0000","last_became_active":"2024-04-26T11:29:03.603180+0000","last_became_peered":"2024-04-26T11:29:03.603180+0000","last_unstale":"2024-04-26T11:31:16.405659+0000","last_undegraded":"2024-04-26T11:31:16.405659+0000","last_fullsized":"2024-04-26T11:31:16.405659+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.081996+0000","last_change":"2024-04-26T11:27:12.111215+0000","last_active":"2024-04-26T11:31:16.081996+0000","last_peered":"2024-04-26T11:31:16.081996+0000","last_clean":"2024-04-26T11:31:16.081996+0000","last_became_active":"2024-04-26T11:27:12.110896+0000","last_became_peered":"2024-04-26T11:27:12.110896+0000","last_unstale":"2024-04-26T11:31:16.081996+0000","last_undegraded":"2024-04-26T11:31:16.081996+0000","last_fullsized":"2024-04-26T11:31:16.081996+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:17.469534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406380+0000","last_change":"2024-04-26T11:27:12.091871+0000","last_active":"2024-04-26T11:31:16.406380+0000","last_peered":"2024-04-26T11:31:16.406380+0000","last_clean":"2024-04-26T11:31:16.406380+0000","last_became_active":"2024-04-26T11:27:12.091239+0000","last_became_peered":"2024-04-26T11:27:12.091239+0000","last_unstale":"2024-04-26T11:31:16.406380+0000","last_undegraded":"2024-04-26T11:31:16.406380+0000","last_fullsized":"2024-04-26T11:31:16.406380+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:30.526152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.085135+0000","last_change":"2024-04-26T11:27:12.093411+0000","last_active":"2024-04-26T11:31:16.085135+0000","last_peered":"2024-04-26T11:31:16.085135+0000","last_clean":"2024-04-26T11:31:16.085135+0000","last_became_active":"2024-04-26T11:27:12.093086+0000","last_became_peered":"2024-04-26T11:27:12.093086+0000","last_unstale":"2024-04-26T11:31:16.085135+0000","last_undegraded":"2024-04-26T11:31:16.085135+0000","last_fullsized":"2024-04-26T11:31:16.085135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:56.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406714+0000","last_change":"2024-04-26T11:27:12.093317+0000","last_active":"2024-04-26T11:31:16.406714+0000","last_peered":"2024-04-26T11:31:16.406714+0000","last_clean":"2024-04-26T11:31:16.406714+0000","last_became_active":"2024-04-26T11:27:12.092595+0000","last_became_peered":"2024-04-26T11:27:12.092595+0000","last_unstale":"2024-04-26T11:31:16.406714+0000","last_undegraded":"2024-04-26T11:31:16.406714+0000","last_fullsized":"2024-04-26T11:31:16.406714+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.702218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.114213+0000","last_change":"2024-04-26T11:27:12.093118+0000","last_active":"2024-04-26T11:31:16.114213+0000","last_peered":"2024-04-26T11:31:16.114213+0000","last_clean":"2024-04-26T11:31:16.114213+0000","last_became_active":"2024-04-26T11:27:12.091482+0000","last_became_peered":"2024-04-26T11:27:12.091482+0000","last_unstale":"2024-04-26T11:31:16.114213+0000","last_undegraded":"2024-04-26T11:31:16.114213+0000","last_fullsized":"2024-04-26T11:31:16.114213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.426213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111084+0000","last_change":"2024-04-26T11:27:12.114213+0000","last_active":"2024-04-26T11:31:16.111084+0000","last_peered":"2024-04-26T11:31:16.111084+0000","last_clean":"2024-04-26T11:31:16.111084+0000","last_became_active":"2024-04-26T11:27:12.113867+0000","last_became_peered":"2024-04-26T11:27:12.113867+0000","last_unstale":"2024-04-26T11:31:16.111084+0000","last_undegraded":"2024-04-26T11:31:16.111084+0000","last_fullsized":"2024-04-26T11:31:16.111084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:59.258645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406640+0000","last_change":"2024-04-26T11:27:12.084301+0000","last_active":"2024-04-26T11:31:16.406640+0000","last_peered":"2024-04-26T11:31:16.406640+0000","last_clean":"2024-04-26T11:31:16.406640+0000","last_became_active":"2024-04-26T11:27:12.083808+0000","last_became_peered":"2024-04-26T11:27:12.083808+0000","last_unstale":"2024-04-26T11:31:16.406640+0000","last_undegraded":"2024-04-26T11:31:16.406640+0000","last_fullsized":"2024-04-26T11:31:16.406640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:46.107583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406475+0000","last_change":"2024-04-26T11:27:12.089647+0000","last_active":"2024-04-26T11:31:16.406475+0000","last_peered":"2024-04-26T11:31:16.406475+0000","last_clean":"2024-04-26T11:31:16.406475+0000","last_became_active":"2024-04-26T11:27:12.088081+0000","last_became_peered":"2024-04-26T11:27:12.088081+0000","last_unstale":"2024-04-26T11:31:16.406475+0000","last_undegraded":"2024-04-26T11:31:16.406475+0000","last_fullsized":"2024-04-26T11:31:16.406475+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:43.423430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405624+0000","last_change":"2024-04-26T11:27:12.098138+0000","last_active":"2024-04-26T11:31:16.405624+0000","last_peered":"2024-04-26T11:31:16.405624+0000","last_clean":"2024-04-26T11:31:16.405624+0000","last_became_active":"2024-04-26T11:27:12.097756+0000","last_became_peered":"2024-04-26T11:27:12.097756+0000","last_unstale":"2024-04-26T11:31:16.405624+0000","last_undegraded":"2024-04-26T11:31:16.405624+0000","last_fullsized":"2024-04-26T11:31:16.405624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:21.155370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432793+0000","last_change":"2024-04-26T11:27:12.099925+0000","last_active":"2024-04-26T11:31:16.432793+0000","last_peered":"2024-04-26T11:31:16.432793+0000","last_clean":"2024-04-26T11:31:16.432793+0000","last_became_active":"2024-04-26T11:27:12.099600+0000","last_became_peered":"2024-04-26T11:27:12.099600+0000","last_unstale":"2024-04-26T11:31:16.432793+0000","last_undegraded":"2024-04-26T11:31:16.432793+0000","last_fullsized":"2024-04-26T11:31:16.432793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:23.704624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224238+0000","last_change":"2024-04-26T11:27:12.104697+0000","last_active":"2024-04-26T11:31:16.224238+0000","last_peered":"2024-04-26T11:31:16.224238+0000","last_clean":"2024-04-26T11:31:16.224238+0000","last_became_active":"2024-04-26T11:27:12.103963+0000","last_became_peered":"2024-04-26T11:27:12.103963+0000","last_unstale":"2024-04-26T11:31:16.224238+0000","last_undegraded":"2024-04-26T11:31:16.224238+0000","last_fullsized":"2024-04-26T11:31:16.224238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:58.202895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083872+0000","last_change":"2024-04-26T11:29:03.603898+0000","last_active":"2024-04-26T11:31:16.083872+0000","last_peered":"2024-04-26T11:31:16.083872+0000","last_clean":"2024-04-26T11:31:16.083872+0000","last_became_active":"2024-04-26T11:29:03.603488+0000","last_became_peered":"2024-04-26T11:29:03.603488+0000","last_unstale":"2024-04-26T11:31:16.083872+0000","last_undegraded":"2024-04-26T11:31:16.083872+0000","last_fullsized":"2024-04-26T11:31:16.083872+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:04.137277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":59,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224032+0000","last_change":"2024-04-26T11:28:03.456017+0000","last_active":"2024-04-26T11:31:16.224032+0000","last_peered":"2024-04-26T11:31:16.224032+0000","last_clean":"2024-04-26T11:31:16.224032+0000","last_became_active":"2024-04-26T11:28:03.447016+0000","last_became_peered":"2024-04-26T11:28:03.447016+0000","last_unstale":"2024-04-26T11:31:16.224032+0000","last_undegraded":"2024-04-26T11:31:16.224032+0000","last_fullsized":"2024-04-26T11:31:16.224032+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.616546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082449+0000","last_change":"2024-04-26T11:27:12.112635+0000","last_active":"2024-04-26T11:31:16.082449+0000","last_peered":"2024-04-26T11:31:16.082449+0000","last_clean":"2024-04-26T11:31:16.082449+0000","last_became_active":"2024-04-26T11:27:12.112282+0000","last_became_peered":"2024-04-26T11:27:12.112282+0000","last_unstale":"2024-04-26T11:31:16.082449+0000","last_undegraded":"2024-04-26T11:31:16.082449+0000","last_fullsized":"2024-04-26T11:31:16.082449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:21.482922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082668+0000","last_change":"2024-04-26T11:27:08.473301+0000","last_active":"2024-04-26T11:31:16.082668+0000","last_peered":"2024-04-26T11:31:16.082668+0000","last_clean":"2024-04-26T11:31:16.082668+0000","last_became_active":"2024-04-26T11:27:08.472769+0000","last_became_peered":"2024-04-26T11:27:08.472769+0000","last_unstale":"2024-04-26T11:31:16.082668+0000","last_undegraded":"2024-04-26T11:31:16.082668+0000","last_fullsized":"2024-04-26T11:31:16.082668+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:49.108849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407003+0000","last_change":"2024-04-26T11:27:12.109725+0000","last_active":"2024-04-26T11:31:16.407003+0000","last_peered":"2024-04-26T11:31:16.407003+0000","last_clean":"2024-04-26T11:31:16.407003+0000","last_became_active":"2024-04-26T11:27:12.109376+0000","last_became_peered":"2024-04-26T11:27:12.109376+0000","last_unstale":"2024-04-26T11:31:16.407003+0000","last_undegraded":"2024-04-26T11:31:16.407003+0000","last_fullsized":"2024-04-26T11:31:16.407003+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":49,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226741+0000","last_change":"2024-04-26T11:28:03.464520+0000","last_active":"2024-04-26T11:31:16.226741+0000","last_peered":"2024-04-26T11:31:16.226741+0000","last_clean":"2024-04-26T11:31:16.226741+0000","last_became_active":"2024-04-26T11:28:03.449993+0000","last_became_peered":"2024-04-26T11:28:03.449993+0000","last_unstale":"2024-04-26T11:31:16.226741+0000","last_undegraded":"2024-04-26T11:31:16.226741+0000","last_fullsized":"2024-04-26T11:31:16.226741+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:01.465563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405839+0000","last_change":"2024-04-26T11:27:12.100830+0000","last_active":"2024-04-26T11:31:16.405839+0000","last_peered":"2024-04-26T11:31:16.405839+0000","last_clean":"2024-04-26T11:31:16.405839+0000","last_became_active":"2024-04-26T11:27:12.100474+0000","last_became_peered":"2024-04-26T11:27:12.100474+0000","last_unstale":"2024-04-26T11:31:16.405839+0000","last_undegraded":"2024-04-26T11:31:16.405839+0000","last_fullsized":"2024-04-26T11:31:16.405839+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:18.778897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432390+0000","last_change":"2024-04-26T11:28:03.444580+0000","last_active":"2024-04-26T11:31:16.432390+0000","last_peered":"2024-04-26T11:31:16.432390+0000","last_clean":"2024-04-26T11:31:16.432390+0000","last_became_active":"2024-04-26T11:28:03.435056+0000","last_became_peered":"2024-04-26T11:28:03.435056+0000","last_unstale":"2024-04-26T11:31:16.432390+0000","last_undegraded":"2024-04-26T11:31:16.432390+0000","last_fullsized":"2024-04-26T11:31:16.432390+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:42.640914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101514+0000","last_change":"2024-04-26T11:27:12.093472+0000","last_active":"2024-04-26T11:31:16.101514+0000","last_peered":"2024-04-26T11:31:16.101514+0000","last_clean":"2024-04-26T11:31:16.101514+0000","last_became_active":"2024-04-26T11:27:12.093110+0000","last_became_peered":"2024-04-26T11:27:12.093110+0000","last_unstale":"2024-04-26T11:31:16.101514+0000","last_undegraded":"2024-04-26T11:31:16.101514+0000","last_fullsized":"2024-04-26T11:31:16.101514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:19.256670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":218,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432431+0000","last_change":"2024-04-26T11:28:03.440961+0000","last_active":"2024-04-26T11:31:16.432431+0000","last_peered":"2024-04-26T11:31:16.432431+0000","last_clean":"2024-04-26T11:31:16.432431+0000","last_became_active":"2024-04-26T11:28:03.434607+0000","last_became_peered":"2024-04-26T11:28:03.434607+0000","last_unstale":"2024-04-26T11:31:16.432431+0000","last_undegraded":"2024-04-26T11:31:16.432431+0000","last_fullsized":"2024-04-26T11:31:16.432431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:37.122557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":194,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226334+0000","last_change":"2024-04-26T11:28:03.447662+0000","last_active":"2024-04-26T11:31:16.226334+0000","last_peered":"2024-04-26T11:31:16.226334+0000","last_clean":"2024-04-26T11:31:16.226334+0000","last_became_active":"2024-04-26T11:28:03.447333+0000","last_became_peered":"2024-04-26T11:28:03.447333+0000","last_unstale":"2024-04-26T11:31:16.226334+0000","last_undegraded":"2024-04-26T11:31:16.226334+0000","last_fullsized":"2024-04-26T11:31:16.226334+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:37.600940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083710+0000","last_change":"2024-04-26T11:27:08.028424+0000","last_active":"2024-04-26T11:31:16.083710+0000","last_peered":"2024-04-26T11:31:16.083710+0000","last_clean":"2024-04-26T11:31:16.083710+0000","last_became_active":"2024-04-26T11:27:08.028134+0000","last_became_peered":"2024-04-26T11:27:08.028134+0000","last_unstale":"2024-04-26T11:31:16.083710+0000","last_undegraded":"2024-04-26T11:31:16.083710+0000","last_fullsized":"2024-04-26T11:31:16.083710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:44.636288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101385+0000","last_change":"2024-04-26T11:27:12.108078+0000","last_active":"2024-04-26T11:31:16.101385+0000","last_peered":"2024-04-26T11:31:16.101385+0000","last_clean":"2024-04-26T11:31:16.101385+0000","last_became_active":"2024-04-26T11:27:12.107713+0000","last_became_peered":"2024-04-26T11:27:12.107713+0000","last_unstale":"2024-04-26T11:31:16.101385+0000","last_undegraded":"2024-04-26T11:31:16.101385+0000","last_fullsized":"2024-04-26T11:31:16.101385+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:59.995679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111197+0000","last_change":"2024-04-26T11:27:08.049134+0000","last_active":"2024-04-26T11:31:16.111197+0000","last_peered":"2024-04-26T11:31:16.111197+0000","last_clean":"2024-04-26T11:31:16.111197+0000","last_became_active":"2024-04-26T11:27:08.047862+0000","last_became_peered":"2024-04-26T11:27:08.047862+0000","last_unstale":"2024-04-26T11:31:16.111197+0000","last_undegraded":"2024-04-26T11:31:16.111197+0000","last_fullsized":"2024-04-26T11:31:16.111197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:55.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082204+0000","last_change":"2024-04-26T11:27:12.117417+0000","last_active":"2024-04-26T11:31:16.082204+0000","last_peered":"2024-04-26T11:31:16.082204+0000","last_clean":"2024-04-26T11:31:16.082204+0000","last_became_active":"2024-04-26T11:27:12.116643+0000","last_became_peered":"2024-04-26T11:27:12.116643+0000","last_unstale":"2024-04-26T11:31:16.082204+0000","last_undegraded":"2024-04-26T11:31:16.082204+0000","last_fullsized":"2024-04-26T11:31:16.082204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:26.677738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101334+0000","last_change":"2024-04-26T11:27:08.037806+0000","last_active":"2024-04-26T11:31:16.101334+0000","last_peered":"2024-04-26T11:31:16.101334+0000","last_clean":"2024-04-26T11:31:16.101334+0000","last_became_active":"2024-04-26T11:27:08.037309+0000","last_became_peered":"2024-04-26T11:27:08.037309+0000","last_unstale":"2024-04-26T11:31:16.101334+0000","last_undegraded":"2024-04-26T11:31:16.101334+0000","last_fullsized":"2024-04-26T11:31:16.101334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.910219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.223722+0000","last_change":"2024-04-26T11:27:12.120986+0000","last_active":"2024-04-26T11:31:16.223722+0000","last_peered":"2024-04-26T11:31:16.223722+0000","last_clean":"2024-04-26T11:31:16.223722+0000","last_became_active":"2024-04-26T11:27:12.120580+0000","last_became_peered":"2024-04-26T11:27:12.120580+0000","last_unstale":"2024-04-26T11:31:16.223722+0000","last_undegraded":"2024-04-26T11:31:16.223722+0000","last_fullsized":"2024-04-26T11:31:16.223722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:00.996039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":257,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.085125+0000","last_change":"2024-04-26T11:27:08.048979+0000","last_active":"2024-04-26T11:31:16.085125+0000","last_peered":"2024-04-26T11:31:16.085125+0000","last_clean":"2024-04-26T11:31:16.085125+0000","last_became_active":"2024-04-26T11:27:08.048641+0000","last_became_peered":"2024-04-26T11:27:08.048641+0000","last_unstale":"2024-04-26T11:31:16.085125+0000","last_undegraded":"2024-04-26T11:31:16.085125+0000","last_fullsized":"2024-04-26T11:31:16.085125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:38.917651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":221,"num_read_kb":221,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406196+0000","last_change":"2024-04-26T11:27:12.104749+0000","last_active":"2024-04-26T11:31:16.406196+0000","last_peered":"2024-04-26T11:31:16.406196+0000","last_clean":"2024-04-26T11:31:16.406196+0000","last_became_active":"2024-04-26T11:27:12.104358+0000","last_became_peered":"2024-04-26T11:27:12.104358+0000","last_unstale":"2024-04-26T11:31:16.406196+0000","last_undegraded":"2024-04-26T11:31:16.406196+0000","last_fullsized":"2024-04-26T11:31:16.406196+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:47.364512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406712+0000","last_change":"2024-04-26T11:27:08.038165+0000","last_active":"2024-04-26T11:31:16.406712+0000","last_peered":"2024-04-26T11:31:16.406712+0000","last_clean":"2024-04-26T11:31:16.406712+0000","last_became_active":"2024-04-26T11:27:08.036930+0000","last_became_peered":"2024-04-26T11:27:08.036930+0000","last_unstale":"2024-04-26T11:31:16.406712+0000","last_undegraded":"2024-04-26T11:31:16.406712+0000","last_fullsized":"2024-04-26T11:31:16.406712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:10.050679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407006+0000","last_change":"2024-04-26T11:27:12.098702+0000","last_active":"2024-04-26T11:31:16.407006+0000","last_peered":"2024-04-26T11:31:16.407006+0000","last_clean":"2024-04-26T11:31:16.407006+0000","last_became_active":"2024-04-26T11:27:12.089241+0000","last_became_peered":"2024-04-26T11:27:12.089241+0000","last_unstale":"2024-04-26T11:31:16.407006+0000","last_undegraded":"2024-04-26T11:31:16.407006+0000","last_fullsized":"2024-04-26T11:31:16.407006+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.013054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101577+0000","last_change":"2024-04-26T11:27:08.473759+0000","last_active":"2024-04-26T11:31:16.101577+0000","last_peered":"2024-04-26T11:31:16.101577+0000","last_clean":"2024-04-26T11:31:16.101577+0000","last_became_active":"2024-04-26T11:27:08.473288+0000","last_became_peered":"2024-04-26T11:27:08.473288+0000","last_unstale":"2024-04-26T11:31:16.101577+0000","last_undegraded":"2024-04-26T11:31:16.101577+0000","last_fullsized":"2024-04-26T11:31:16.101577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:36.727119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405908+0000","last_change":"2024-04-26T11:27:12.096935+0000","last_active":"2024-04-26T11:31:16.405908+0000","last_peered":"2024-04-26T11:31:16.405908+0000","last_clean":"2024-04-26T11:31:16.405908+0000","last_became_active":"2024-04-26T11:27:12.096481+0000","last_became_peered":"2024-04-26T11:27:12.096481+0000","last_unstale":"2024-04-26T11:31:16.405908+0000","last_undegraded":"2024-04-26T11:31:16.405908+0000","last_fullsized":"2024-04-26T11:31:16.405908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:58.855909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"94'37","reported_seq":524,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.700522+0000","last_change":"2024-04-26T11:27:08.037227+0000","last_active":"2024-04-26T11:31:16.700522+0000","last_peered":"2024-04-26T11:31:16.700522+0000","last_clean":"2024-04-26T11:31:16.700522+0000","last_became_active":"2024-04-26T11:27:08.036852+0000","last_became_peered":"2024-04-26T11:27:08.036852+0000","last_unstale":"2024-04-26T11:31:16.700522+0000","last_undegraded":"2024-04-26T11:31:16.700522+0000","last_fullsized":"2024-04-26T11:31:16.700522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:44.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68073,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":454,"num_read_kb":293,"num_write":38,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226514+0000","last_change":"2024-04-26T11:27:12.088586+0000","last_active":"2024-04-26T11:31:16.226514+0000","last_peered":"2024-04-26T11:31:16.226514+0000","last_clean":"2024-04-26T11:31:16.226514+0000","last_became_active":"2024-04-26T11:27:12.088264+0000","last_became_peered":"2024-04-26T11:27:12.088264+0000","last_unstale":"2024-04-26T11:31:16.226514+0000","last_undegraded":"2024-04-26T11:31:16.226514+0000","last_fullsized":"2024-04-26T11:31:16.226514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:39.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083583+0000","last_change":"2024-04-26T11:27:08.049289+0000","last_active":"2024-04-26T11:31:16.083583+0000","last_peered":"2024-04-26T11:31:16.083583+0000","last_clean":"2024-04-26T11:31:16.083583+0000","last_became_active":"2024-04-26T11:27:08.048923+0000","last_became_peered":"2024-04-26T11:27:08.048923+0000","last_unstale":"2024-04-26T11:31:16.083583+0000","last_undegraded":"2024-04-26T11:31:16.083583+0000","last_fullsized":"2024-04-26T11:31:16.083583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:42.229383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111431+0000","last_change":"2024-04-26T11:27:12.118154+0000","last_active":"2024-04-26T11:31:16.111431+0000","last_peered":"2024-04-26T11:31:16.111431+0000","last_clean":"2024-04-26T11:31:16.111431+0000","last_became_active":"2024-04-26T11:27:12.117624+0000","last_became_peered":"2024-04-26T11:27:12.117624+0000","last_unstale":"2024-04-26T11:31:16.111431+0000","last_undegraded":"2024-04-26T11:31:16.111431+0000","last_fullsized":"2024-04-26T11:31:16.111431+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:57.947310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101393+0000","last_change":"2024-04-26T11:27:08.045870+0000","last_active":"2024-04-26T11:31:16.101393+0000","last_peered":"2024-04-26T11:31:16.101393+0000","last_clean":"2024-04-26T11:31:16.101393+0000","last_became_active":"2024-04-26T11:27:08.045461+0000","last_became_peered":"2024-04-26T11:27:08.045461+0000","last_unstale":"2024-04-26T11:31:16.101393+0000","last_undegraded":"2024-04-26T11:31:16.101393+0000","last_fullsized":"2024-04-26T11:31:16.101393+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:59.899805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406358+0000","last_change":"2024-04-26T11:27:12.116617+0000","last_active":"2024-04-26T11:31:16.406358+0000","last_peered":"2024-04-26T11:31:16.406358+0000","last_clean":"2024-04-26T11:31:16.406358+0000","last_became_active":"2024-04-26T11:27:12.115731+0000","last_became_peered":"2024-04-26T11:27:12.115731+0000","last_unstale":"2024-04-26T11:31:16.406358+0000","last_undegraded":"2024-04-26T11:31:16.406358+0000","last_fullsized":"2024-04-26T11:31:16.406358+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:42.680367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"94'7","reported_seq":267,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:17.115926+0000","last_change":"2024-04-26T11:27:08.036947+0000","last_active":"2024-04-26T11:31:17.115926+0000","last_peered":"2024-04-26T11:31:17.115926+0000","last_clean":"2024-04-26T11:31:17.115926+0000","last_became_active":"2024-04-26T11:27:08.036596+0000","last_became_peered":"2024-04-26T11:27:08.036596+0000","last_unstale":"2024-04-26T11:31:17.115926+0000","last_undegraded":"2024-04-26T11:31:17.115926+0000","last_fullsized":"2024-04-26T11:31:17.115926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:35.606069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405803+0000","last_change":"2024-04-26T11:27:12.086190+0000","last_active":"2024-04-26T11:31:16.405803+0000","last_peered":"2024-04-26T11:31:16.405803+0000","last_clean":"2024-04-26T11:31:16.405803+0000","last_became_active":"2024-04-26T11:27:12.085839+0000","last_became_peered":"2024-04-26T11:27:12.085839+0000","last_unstale":"2024-04-26T11:31:16.405803+0000","last_undegraded":"2024-04-26T11:31:16.405803+0000","last_fullsized":"2024-04-26T11:31:16.405803+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:31.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226321+0000","last_change":"2024-04-26T11:28:03.459792+0000","last_active":"2024-04-26T11:31:16.226321+0000","last_peered":"2024-04-26T11:31:16.226321+0000","last_clean":"2024-04-26T11:31:16.226321+0000","last_became_active":"2024-04-26T11:28:03.444101+0000","last_became_peered":"2024-04-26T11:28:03.444101+0000","last_unstale":"2024-04-26T11:31:16.226321+0000","last_undegraded":"2024-04-26T11:31:16.226321+0000","last_fullsized":"2024-04-26T11:31:16.226321+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:14.498792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101310+0000","last_change":"2024-04-26T11:27:12.093884+0000","last_active":"2024-04-26T11:31:16.101310+0000","last_peered":"2024-04-26T11:31:16.101310+0000","last_clean":"2024-04-26T11:31:16.101310+0000","last_became_active":"2024-04-26T11:27:12.093573+0000","last_became_peered":"2024-04-26T11:27:12.093573+0000","last_unstale":"2024-04-26T11:31:16.101310+0000","last_undegraded":"2024-04-26T11:31:16.101310+0000","last_fullsized":"2024-04-26T11:31:16.101310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:32.144889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"94'3","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226840+0000","last_change":"2024-04-26T11:27:08.035089+0000","last_active":"2024-04-26T11:31:16.226840+0000","last_peered":"2024-04-26T11:31:16.226840+0000","last_clean":"2024-04-26T11:31:16.226840+0000","last_became_active":"2024-04-26T11:27:08.034698+0000","last_became_peered":"2024-04-26T11:27:08.034698+0000","last_unstale":"2024-04-26T11:31:16.226840+0000","last_undegraded":"2024-04-26T11:31:16.226840+0000","last_fullsized":"2024-04-26T11:31:16.226840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:23.731307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432489+0000","last_change":"2024-04-26T11:27:12.097089+0000","last_active":"2024-04-26T11:31:16.432489+0000","last_peered":"2024-04-26T11:31:16.432489+0000","last_clean":"2024-04-26T11:31:16.432489+0000","last_became_active":"2024-04-26T11:27:12.096762+0000","last_became_peered":"2024-04-26T11:27:12.096762+0000","last_unstale":"2024-04-26T11:31:16.432489+0000","last_undegraded":"2024-04-26T11:31:16.432489+0000","last_fullsized":"2024-04-26T11:31:16.432489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.366450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224023+0000","last_change":"2024-04-26T11:27:08.475317+0000","last_active":"2024-04-26T11:31:16.224023+0000","last_peered":"2024-04-26T11:31:16.224023+0000","last_clean":"2024-04-26T11:31:16.224023+0000","last_became_active":"2024-04-26T11:27:08.474464+0000","last_became_peered":"2024-04-26T11:27:08.474464+0000","last_unstale":"2024-04-26T11:31:16.224023+0000","last_undegraded":"2024-04-26T11:31:16.224023+0000","last_fullsized":"2024-04-26T11:31:16.224023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.084738+0000","last_change":"2024-04-26T11:27:12.107542+0000","last_active":"2024-04-26T11:31:16.084738+0000","last_peered":"2024-04-26T11:31:16.084738+0000","last_clean":"2024-04-26T11:31:16.084738+0000","last_became_active":"2024-04-26T11:27:12.107162+0000","last_became_peered":"2024-04-26T11:27:12.107162+0000","last_unstale":"2024-04-26T11:31:16.084738+0000","last_undegraded":"2024-04-26T11:31:16.084738+0000","last_fullsized":"2024-04-26T11:31:16.084738+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:55.470638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406156+0000","last_change":"2024-04-26T11:27:08.044101+0000","last_active":"2024-04-26T11:31:16.406156+0000","last_peered":"2024-04-26T11:31:16.406156+0000","last_clean":"2024-04-26T11:31:16.406156+0000","last_became_active":"2024-04-26T11:27:08.043733+0000","last_became_peered":"2024-04-26T11:27:08.043733+0000","last_unstale":"2024-04-26T11:31:16.406156+0000","last_undegraded":"2024-04-26T11:31:16.406156+0000","last_fullsized":"2024-04-26T11:31:16.406156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:03.023620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083789+0000","last_change":"2024-04-26T11:29:03.604007+0000","last_active":"2024-04-26T11:31:16.083789+0000","last_peered":"2024-04-26T11:31:16.083789+0000","last_clean":"2024-04-26T11:31:16.083789+0000","last_became_active":"2024-04-26T11:29:03.603521+0000","last_became_peered":"2024-04-26T11:29:03.603521+0000","last_unstale":"2024-04-26T11:31:16.083789+0000","last_undegraded":"2024-04-26T11:31:16.083789+0000","last_fullsized":"2024-04-26T11:31:16.083789+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:05.733257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101794+0000","last_change":"2024-04-26T11:27:12.093505+0000","last_active":"2024-04-26T11:31:16.101794+0000","last_peered":"2024-04-26T11:31:16.101794+0000","last_clean":"2024-04-26T11:31:16.101794+0000","last_became_active":"2024-04-26T11:27:12.093198+0000","last_became_peered":"2024-04-26T11:27:12.093198+0000","last_unstale":"2024-04-26T11:31:16.101794+0000","last_undegraded":"2024-04-26T11:31:16.101794+0000","last_fullsized":"2024-04-26T11:31:16.101794+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:06.100747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"94'6","reported_seq":262,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:17.115149+0000","last_change":"2024-04-26T11:27:08.474897+0000","last_active":"2024-04-26T11:31:17.115149+0000","last_peered":"2024-04-26T11:31:17.115149+0000","last_clean":"2024-04-26T11:31:17.115149+0000","last_became_active":"2024-04-26T11:27:08.471735+0000","last_became_peered":"2024-04-26T11:27:08.471735+0000","last_unstale":"2024-04-26T11:31:17.115149+0000","last_undegraded":"2024-04-26T11:31:17.115149+0000","last_fullsized":"2024-04-26T11:31:17.115149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:42.066821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":222,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082790+0000","last_change":"2024-04-26T11:27:12.116722+0000","last_active":"2024-04-26T11:31:16.082790+0000","last_peered":"2024-04-26T11:31:16.082790+0000","last_clean":"2024-04-26T11:31:16.082790+0000","last_became_active":"2024-04-26T11:27:12.116239+0000","last_became_peered":"2024-04-26T11:27:12.116239+0000","last_unstale":"2024-04-26T11:31:16.082790+0000","last_undegraded":"2024-04-26T11:31:16.082790+0000","last_fullsized":"2024-04-26T11:31:16.082790+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:04.962376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.114176+0000","last_change":"2024-04-26T11:27:08.047087+0000","last_active":"2024-04-26T11:31:16.114176+0000","last_peered":"2024-04-26T11:31:16.114176+0000","last_clean":"2024-04-26T11:31:16.114176+0000","last_became_active":"2024-04-26T11:27:08.046754+0000","last_became_peered":"2024-04-26T11:27:08.046754+0000","last_unstale":"2024-04-26T11:31:16.114176+0000","last_undegraded":"2024-04-26T11:31:16.114176+0000","last_fullsized":"2024-04-26T11:31:16.114176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:30.481521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":368,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405491+0000","last_change":"2024-04-26T11:25:35.622816+0000","last_active":"2024-04-26T11:31:16.405491+0000","last_peered":"2024-04-26T11:31:16.405491+0000","last_clean":"2024-04-26T11:31:16.405491+0000","last_became_active":"2024-04-26T11:25:35.622329+0000","last_became_peered":"2024-04-26T11:25:35.622329+0000","last_unstale":"2024-04-26T11:31:16.405491+0000","last_undegraded":"2024-04-26T11:31:16.405491+0000","last_fullsized":"2024-04-26T11:31:16.405491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_clean_scrub_stamp":"2024-04-26T11:21:45.465157+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:40.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111047+0000","last_change":"2024-04-26T11:27:12.098686+0000","last_active":"2024-04-26T11:31:16.111047+0000","last_peered":"2024-04-26T11:31:16.111047+0000","last_clean":"2024-04-26T11:31:16.111047+0000","last_became_active":"2024-04-26T11:27:12.098251+0000","last_became_peered":"2024-04-26T11:27:12.098251+0000","last_unstale":"2024-04-26T11:31:16.111047+0000","last_undegraded":"2024-04-26T11:31:16.111047+0000","last_fullsized":"2024-04-26T11:31:16.111047+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:34.433203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405731+0000","last_change":"2024-04-26T11:27:08.036391+0000","last_active":"2024-04-26T11:31:16.405731+0000","last_peered":"2024-04-26T11:31:16.405731+0000","last_clean":"2024-04-26T11:31:16.405731+0000","last_became_active":"2024-04-26T11:27:08.036058+0000","last_became_peered":"2024-04-26T11:27:08.036058+0000","last_unstale":"2024-04-26T11:31:16.405731+0000","last_undegraded":"2024-04-26T11:31:16.405731+0000","last_fullsized":"2024-04-26T11:31:16.405731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:35.646501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226579+0000","last_change":"2024-04-26T11:27:08.472171+0000","last_active":"2024-04-26T11:31:16.226579+0000","last_peered":"2024-04-26T11:31:16.226579+0000","last_clean":"2024-04-26T11:31:16.226579+0000","last_became_active":"2024-04-26T11:27:08.471707+0000","last_became_peered":"2024-04-26T11:27:08.471707+0000","last_unstale":"2024-04-26T11:31:16.226579+0000","last_undegraded":"2024-04-26T11:31:16.226579+0000","last_fullsized":"2024-04-26T11:31:16.226579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:54.319448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111458+0000","last_change":"2024-04-26T11:27:12.110757+0000","last_active":"2024-04-26T11:31:16.111458+0000","last_peered":"2024-04-26T11:31:16.111458+0000","last_clean":"2024-04-26T11:31:16.111458+0000","last_became_active":"2024-04-26T11:27:12.109048+0000","last_became_peered":"2024-04-26T11:27:12.109048+0000","last_unstale":"2024-04-26T11:31:16.111458+0000","last_undegraded":"2024-04-26T11:31:16.111458+0000","last_fullsized":"2024-04-26T11:31:16.111458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:05.203504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"94'49","reported_seq":105,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.359123+0000","last_change":"2024-04-26T11:27:08.051790+0000","last_active":"2024-04-26T11:31:16.359123+0000","last_peered":"2024-04-26T11:31:16.359123+0000","last_clean":"2024-04-26T11:31:16.359123+0000","last_became_active":"2024-04-26T11:27:08.051430+0000","last_became_peered":"2024-04-26T11:27:08.051430+0000","last_unstale":"2024-04-26T11:31:16.359123+0000","last_undegraded":"2024-04-26T11:31:16.359123+0000","last_fullsized":"2024-04-26T11:31:16.359123+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:13.607944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":88,"num_write_kb":839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082801+0000","last_change":"2024-04-26T11:27:12.116704+0000","last_active":"2024-04-26T11:31:16.082801+0000","last_peered":"2024-04-26T11:31:16.082801+0000","last_clean":"2024-04-26T11:31:16.082801+0000","last_became_active":"2024-04-26T11:27:12.111556+0000","last_became_peered":"2024-04-26T11:27:12.111556+0000","last_unstale":"2024-04-26T11:31:16.082801+0000","last_undegraded":"2024-04-26T11:31:16.082801+0000","last_fullsized":"2024-04-26T11:31:16.082801+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:36.535244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.114091+0000","last_change":"2024-04-26T11:27:08.347851+0000","last_active":"2024-04-26T11:31:16.114091+0000","last_peered":"2024-04-26T11:31:16.114091+0000","last_clean":"2024-04-26T11:31:16.114091+0000","last_became_active":"2024-04-26T11:27:08.347460+0000","last_became_peered":"2024-04-26T11:27:08.347460+0000","last_unstale":"2024-04-26T11:31:16.114091+0000","last_undegraded":"2024-04-26T11:31:16.114091+0000","last_fullsized":"2024-04-26T11:31:16.114091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.017834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407026+0000","last_change":"2024-04-26T11:29:03.598719+0000","last_active":"2024-04-26T11:31:16.407026+0000","last_peered":"2024-04-26T11:31:16.407026+0000","last_clean":"2024-04-26T11:31:16.407026+0000","last_became_active":"2024-04-26T11:29:03.598192+0000","last_became_peered":"2024-04-26T11:29:03.598192+0000","last_unstale":"2024-04-26T11:31:16.407026+0000","last_undegraded":"2024-04-26T11:31:16.407026+0000","last_fullsized":"2024-04-26T11:31:16.407026+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:57.809995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405595+0000","last_change":"2024-04-26T11:27:08.472127+0000","last_active":"2024-04-26T11:31:16.405595+0000","last_peered":"2024-04-26T11:31:16.405595+0000","last_clean":"2024-04-26T11:31:16.405595+0000","last_became_active":"2024-04-26T11:27:08.471709+0000","last_became_peered":"2024-04-26T11:27:08.471709+0000","last_unstale":"2024-04-26T11:31:16.405595+0000","last_undegraded":"2024-04-26T11:31:16.405595+0000","last_fullsized":"2024-04-26T11:31:16.405595+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:28.432710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226324+0000","last_change":"2024-04-26T11:27:12.085756+0000","last_active":"2024-04-26T11:31:16.226324+0000","last_peered":"2024-04-26T11:31:16.226324+0000","last_clean":"2024-04-26T11:31:16.226324+0000","last_became_active":"2024-04-26T11:27:12.085397+0000","last_became_peered":"2024-04-26T11:27:12.085397+0000","last_unstale":"2024-04-26T11:31:16.226324+0000","last_undegraded":"2024-04-26T11:31:16.226324+0000","last_fullsized":"2024-04-26T11:31:16.226324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:41.392010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.081973+0000","last_change":"2024-04-26T11:27:08.054831+0000","last_active":"2024-04-26T11:31:16.081973+0000","last_peered":"2024-04-26T11:31:16.081973+0000","last_clean":"2024-04-26T11:31:16.081973+0000","last_became_active":"2024-04-26T11:27:08.054352+0000","last_became_peered":"2024-04-26T11:27:08.054352+0000","last_unstale":"2024-04-26T11:31:16.081973+0000","last_undegraded":"2024-04-26T11:31:16.081973+0000","last_fullsized":"2024-04-26T11:31:16.081973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:53.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432298+0000","last_change":"2024-04-26T11:27:12.095789+0000","last_active":"2024-04-26T11:31:16.432298+0000","last_peered":"2024-04-26T11:31:16.432298+0000","last_clean":"2024-04-26T11:31:16.432298+0000","last_became_active":"2024-04-26T11:27:12.095468+0000","last_became_peered":"2024-04-26T11:27:12.095468+0000","last_unstale":"2024-04-26T11:31:16.432298+0000","last_undegraded":"2024-04-26T11:31:16.432298+0000","last_fullsized":"2024-04-26T11:31:16.432298+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:27.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083768+0000","last_change":"2024-04-26T11:27:08.044923+0000","last_active":"2024-04-26T11:31:16.083768+0000","last_peered":"2024-04-26T11:31:16.083768+0000","last_clean":"2024-04-26T11:31:16.083768+0000","last_became_active":"2024-04-26T11:27:08.044516+0000","last_became_peered":"2024-04-26T11:27:08.044516+0000","last_unstale":"2024-04-26T11:31:16.083768+0000","last_undegraded":"2024-04-26T11:31:16.083768+0000","last_fullsized":"2024-04-26T11:31:16.083768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:21.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082214+0000","last_change":"2024-04-26T11:27:12.114311+0000","last_active":"2024-04-26T11:31:16.082214+0000","last_peered":"2024-04-26T11:31:16.082214+0000","last_clean":"2024-04-26T11:31:16.082214+0000","last_became_active":"2024-04-26T11:27:12.113538+0000","last_became_peered":"2024-04-26T11:27:12.113538+0000","last_unstale":"2024-04-26T11:31:16.082214+0000","last_undegraded":"2024-04-26T11:31:16.082214+0000","last_fullsized":"2024-04-26T11:31:16.082214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:55.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226482+0000","last_change":"2024-04-26T11:27:08.036983+0000","last_active":"2024-04-26T11:31:16.226482+0000","last_peered":"2024-04-26T11:31:16.226482+0000","last_clean":"2024-04-26T11:31:16.226482+0000","last_became_active":"2024-04-26T11:27:08.036632+0000","last_became_peered":"2024-04-26T11:27:08.036632+0000","last_unstale":"2024-04-26T11:31:16.226482+0000","last_undegraded":"2024-04-26T11:31:16.226482+0000","last_fullsized":"2024-04-26T11:31:16.226482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:31.731466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406275+0000","last_change":"2024-04-26T11:27:12.102922+0000","last_active":"2024-04-26T11:31:16.406275+0000","last_peered":"2024-04-26T11:31:16.406275+0000","last_clean":"2024-04-26T11:31:16.406275+0000","last_became_active":"2024-04-26T11:27:12.102594+0000","last_became_peered":"2024-04-26T11:27:12.102594+0000","last_unstale":"2024-04-26T11:31:16.406275+0000","last_undegraded":"2024-04-26T11:31:16.406275+0000","last_fullsized":"2024-04-26T11:31:16.406275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:47.223435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083774+0000","last_change":"2024-04-26T11:27:08.473262+0000","last_active":"2024-04-26T11:31:16.083774+0000","last_peered":"2024-04-26T11:31:16.083774+0000","last_clean":"2024-04-26T11:31:16.083774+0000","last_became_active":"2024-04-26T11:27:08.472744+0000","last_became_peered":"2024-04-26T11:27:08.472744+0000","last_unstale":"2024-04-26T11:31:16.083774+0000","last_undegraded":"2024-04-26T11:31:16.083774+0000","last_fullsized":"2024-04-26T11:31:16.083774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:16.766438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406836+0000","last_change":"2024-04-26T11:27:12.091754+0000","last_active":"2024-04-26T11:31:16.406836+0000","last_peered":"2024-04-26T11:31:16.406836+0000","last_clean":"2024-04-26T11:31:16.406836+0000","last_became_active":"2024-04-26T11:27:12.091282+0000","last_became_peered":"2024-04-26T11:27:12.091282+0000","last_unstale":"2024-04-26T11:31:16.406836+0000","last_undegraded":"2024-04-26T11:31:16.406836+0000","last_fullsized":"2024-04-26T11:31:16.406836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:07.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"94'39","reported_seq":80,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.350354+0000","last_change":"2024-04-26T11:27:08.048352+0000","last_active":"2024-04-26T11:31:16.350354+0000","last_peered":"2024-04-26T11:31:16.350354+0000","last_clean":"2024-04-26T11:31:16.350354+0000","last_became_active":"2024-04-26T11:27:08.048056+0000","last_became_peered":"2024-04-26T11:27:08.048056+0000","last_unstale":"2024-04-26T11:31:16.350354+0000","last_undegraded":"2024-04-26T11:31:16.350354+0000","last_fullsized":"2024-04-26T11:31:16.350354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:35.363779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406674+0000","last_change":"2024-04-26T11:27:12.108244+0000","last_active":"2024-04-26T11:31:16.406674+0000","last_peered":"2024-04-26T11:31:16.406674+0000","last_clean":"2024-04-26T11:31:16.406674+0000","last_became_active":"2024-04-26T11:27:12.107592+0000","last_became_peered":"2024-04-26T11:27:12.107592+0000","last_unstale":"2024-04-26T11:31:16.406674+0000","last_undegraded":"2024-04-26T11:31:16.406674+0000","last_fullsized":"2024-04-26T11:31:16.406674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:55.985873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.112034+0000","last_change":"2024-04-26T11:28:03.462136+0000","last_active":"2024-04-26T11:31:16.112034+0000","last_peered":"2024-04-26T11:31:16.112034+0000","last_clean":"2024-04-26T11:31:16.112034+0000","last_became_active":"2024-04-26T11:28:03.449130+0000","last_became_peered":"2024-04-26T11:28:03.449130+0000","last_unstale":"2024-04-26T11:31:16.112034+0000","last_undegraded":"2024-04-26T11:31:16.112034+0000","last_fullsized":"2024-04-26T11:31:16.112034+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:33.181328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406912+0000","last_change":"2024-04-26T11:27:12.090627+0000","last_active":"2024-04-26T11:31:16.406912+0000","last_peered":"2024-04-26T11:31:16.406912+0000","last_clean":"2024-04-26T11:31:16.406912+0000","last_became_active":"2024-04-26T11:27:12.089981+0000","last_became_peered":"2024-04-26T11:27:12.089981+0000","last_unstale":"2024-04-26T11:31:16.406912+0000","last_undegraded":"2024-04-26T11:31:16.406912+0000","last_fullsized":"2024-04-26T11:31:16.406912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432380+0000","last_change":"2024-04-26T11:27:12.089335+0000","last_active":"2024-04-26T11:31:16.432380+0000","last_peered":"2024-04-26T11:31:16.432380+0000","last_clean":"2024-04-26T11:31:16.432380+0000","last_became_active":"2024-04-26T11:27:12.089019+0000","last_became_peered":"2024-04-26T11:27:12.089019+0000","last_unstale":"2024-04-26T11:31:16.432380+0000","last_undegraded":"2024-04-26T11:31:16.432380+0000","last_fullsized":"2024-04-26T11:31:16.432380+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:18.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083546+0000","last_change":"2024-04-26T11:28:03.435483+0000","last_active":"2024-04-26T11:31:16.083546+0000","last_peered":"2024-04-26T11:31:16.083546+0000","last_clean":"2024-04-26T11:31:16.083546+0000","last_became_active":"2024-04-26T11:28:03.435088+0000","last_became_peered":"2024-04-26T11:28:03.435088+0000","last_unstale":"2024-04-26T11:31:16.083546+0000","last_undegraded":"2024-04-26T11:31:16.083546+0000","last_fullsized":"2024-04-26T11:31:16.083546+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.453906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083447+0000","last_change":"2024-04-26T11:27:12.112344+0000","last_active":"2024-04-26T11:31:16.083447+0000","last_peered":"2024-04-26T11:31:16.083447+0000","last_clean":"2024-04-26T11:31:16.083447+0000","last_became_active":"2024-04-26T11:27:12.112083+0000","last_became_peered":"2024-04-26T11:27:12.112083+0000","last_unstale":"2024-04-26T11:31:16.083447+0000","last_undegraded":"2024-04-26T11:31:16.083447+0000","last_fullsized":"2024-04-26T11:31:16.083447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406646+0000","last_change":"2024-04-26T11:27:12.115707+0000","last_active":"2024-04-26T11:31:16.406646+0000","last_peered":"2024-04-26T11:31:16.406646+0000","last_clean":"2024-04-26T11:31:16.406646+0000","last_became_active":"2024-04-26T11:27:12.115192+0000","last_became_peered":"2024-04-26T11:27:12.115192+0000","last_unstale":"2024-04-26T11:31:16.406646+0000","last_undegraded":"2024-04-26T11:31:16.406646+0000","last_fullsized":"2024-04-26T11:31:16.406646+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:55.475825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111343+0000","last_change":"2024-04-26T11:27:12.108771+0000","last_active":"2024-04-26T11:31:16.111343+0000","last_peered":"2024-04-26T11:31:16.111343+0000","last_clean":"2024-04-26T11:31:16.111343+0000","last_became_active":"2024-04-26T11:27:12.102910+0000","last_became_peered":"2024-04-26T11:27:12.102910+0000","last_unstale":"2024-04-26T11:31:16.111343+0000","last_undegraded":"2024-04-26T11:31:16.111343+0000","last_fullsized":"2024-04-26T11:31:16.111343+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:23.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432517+0000","last_change":"2024-04-26T11:27:12.091226+0000","last_active":"2024-04-26T11:31:16.432517+0000","last_peered":"2024-04-26T11:31:16.432517+0000","last_clean":"2024-04-26T11:31:16.432517+0000","last_became_active":"2024-04-26T11:27:12.090926+0000","last_became_peered":"2024-04-26T11:27:12.090926+0000","last_unstale":"2024-04-26T11:31:16.432517+0000","last_undegraded":"2024-04-26T11:31:16.432517+0000","last_fullsized":"2024-04-26T11:31:16.432517+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:43.005527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083947+0000","last_change":"2024-04-26T11:27:12.091297+0000","last_active":"2024-04-26T11:31:16.083947+0000","last_peered":"2024-04-26T11:31:16.083947+0000","last_clean":"2024-04-26T11:31:16.083947+0000","last_became_active":"2024-04-26T11:27:12.090946+0000","last_became_peered":"2024-04-26T11:27:12.090946+0000","last_unstale":"2024-04-26T11:31:16.083947+0000","last_undegraded":"2024-04-26T11:31:16.083947+0000","last_fullsized":"2024-04-26T11:31:16.083947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:06.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082446+0000","last_change":"2024-04-26T11:28:03.445596+0000","last_active":"2024-04-26T11:31:16.082446+0000","last_peered":"2024-04-26T11:31:16.082446+0000","last_clean":"2024-04-26T11:31:16.082446+0000","last_became_active":"2024-04-26T11:28:03.443717+0000","last_became_peered":"2024-04-26T11:28:03.443717+0000","last_unstale":"2024-04-26T11:31:16.082446+0000","last_undegraded":"2024-04-26T11:31:16.082446+0000","last_fullsized":"2024-04-26T11:31:16.082446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:44.905902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101560+0000","last_change":"2024-04-26T11:27:12.107987+0000","last_active":"2024-04-26T11:31:16.101560+0000","last_peered":"2024-04-26T11:31:16.101560+0000","last_clean":"2024-04-26T11:31:16.101560+0000","last_became_active":"2024-04-26T11:27:12.107668+0000","last_became_peered":"2024-04-26T11:27:12.107668+0000","last_unstale":"2024-04-26T11:31:16.101560+0000","last_undegraded":"2024-04-26T11:31:16.101560+0000","last_fullsized":"2024-04-26T11:31:16.101560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:06.448570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.081973+0000","last_change":"2024-04-26T11:27:12.105596+0000","last_active":"2024-04-26T11:31:16.081973+0000","last_peered":"2024-04-26T11:31:16.081973+0000","last_clean":"2024-04-26T11:31:16.081973+0000","last_became_active":"2024-04-26T11:27:12.104996+0000","last_became_peered":"2024-04-26T11:27:12.104996+0000","last_unstale":"2024-04-26T11:31:16.081973+0000","last_undegraded":"2024-04-26T11:31:16.081973+0000","last_fullsized":"2024-04-26T11:31:16.081973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:11.947364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406052+0000","last_change":"2024-04-26T11:27:12.116095+0000","last_active":"2024-04-26T11:31:16.406052+0000","last_peered":"2024-04-26T11:31:16.406052+0000","last_clean":"2024-04-26T11:31:16.406052+0000","last_became_active":"2024-04-26T11:27:12.115726+0000","last_became_peered":"2024-04-26T11:27:12.115726+0000","last_unstale":"2024-04-26T11:31:16.406052+0000","last_undegraded":"2024-04-26T11:31:16.406052+0000","last_fullsized":"2024-04-26T11:31:16.406052+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:45.056829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111194+0000","last_change":"2024-04-26T11:27:12.115016+0000","last_active":"2024-04-26T11:31:16.111194+0000","last_peered":"2024-04-26T11:31:16.111194+0000","last_clean":"2024-04-26T11:31:16.111194+0000","last_became_active":"2024-04-26T11:27:12.114671+0000","last_became_peered":"2024-04-26T11:27:12.114671+0000","last_unstale":"2024-04-26T11:31:16.111194+0000","last_undegraded":"2024-04-26T11:31:16.111194+0000","last_fullsized":"2024-04-26T11:31:16.111194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:11.393056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432521+0000","last_change":"2024-04-26T11:27:12.097130+0000","last_active":"2024-04-26T11:31:16.432521+0000","last_peered":"2024-04-26T11:31:16.432521+0000","last_clean":"2024-04-26T11:31:16.432521+0000","last_became_active":"2024-04-26T11:27:12.096809+0000","last_became_peered":"2024-04-26T11:27:12.096809+0000","last_unstale":"2024-04-26T11:31:16.432521+0000","last_undegraded":"2024-04-26T11:31:16.432521+0000","last_fullsized":"2024-04-26T11:31:16.432521+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:31.198452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108489,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597813,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1424,"num_read_kb":834,"num_write":294,"num_write_kb":1438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1316,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":1793439,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351040,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":510155,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712796,"statfs":{"total":95995035648,"available":95961903104,"internally_reserved":0,"allocated":1204224,"data_stored":1302001,"data_compressed":56823,"data_compressed_allocated":73728,"data_compressed_original":753664,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1064960,"data_stored":902985,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":434176,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037842,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1060864,"data_stored":902323,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":434176,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299479,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1089536,"data_stored":1102542,"data_compressed":50667,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863463006,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":509158,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712896,"statfs":{"total":95995035648,"available":95962005504,"internally_reserved":0,"allocated":1101824,"data_stored":577606,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738494,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":510429,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1114112,"data_stored":578262,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149805,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":1034285,"data_compressed":39806,"data_compressed_allocated":53248,"data_compressed_original":557056,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888169,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1040384,"data_stored":511021,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724644,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":1231890,"data_compressed":56823,"data_compressed_allocated":73728,"data_compressed_original":753664,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":132454,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":202565,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:31:24.141 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T11:31:24.624 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:24.967 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:24 smithi110 ceph-mon[28069]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:31:24.967 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:24 smithi110 ceph-mon[28069]: from='client.25121 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:31:24.967 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:24.967 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:24.967 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:24.967 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:31:24.968 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:31:24.968 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:31:24.968 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:24 smithi196 ceph-mon[32572]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:31:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:24 smithi196 ceph-mon[32572]: from='client.25121 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:31:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:31:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:31:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:31:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:24 smithi193 ceph-mon[32782]: Updating smithi110:/var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T11:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:24 smithi193 ceph-mon[32782]: from='client.25121 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:31:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:25 smithi196 ceph-mon[32572]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 132 KiB/s wr, 76 op/s 2024-04-26T11:31:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:25 smithi110 ceph-mon[28069]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 132 KiB/s wr, 76 op/s 2024-04-26T11:31:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:25 smithi193 ceph-mon[32782]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 132 KiB/s wr, 76 op/s 2024-04-26T11:31:26.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.912+0000 7fa399600700 1 -- 172.21.15.110:0/1555491704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394106020 msgr2=0x7fa394112530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:26.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.912+0000 7fa399600700 1 --2- 172.21.15.110:0/1555491704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394106020 0x7fa394112530 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00b0a0 tx=0x7fa38c00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:31:26.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.912+0000 7fa399600700 1 -- 172.21.15.110:0/1555491704 shutdown_connections 2024-04-26T11:31:26.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.912+0000 7fa399600700 1 --2- 172.21.15.110:0/1555491704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394106020 0x7fa394112530 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:26.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.912+0000 7fa399600700 1 --2- 172.21.15.110:0/1555491704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa39410b660 0x7fa39410ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:26.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.912+0000 7fa399600700 1 --2- 172.21.15.110:0/1555491704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa394105660 0x7fa394105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:26.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.912+0000 7fa399600700 1 -- 172.21.15.110:0/1555491704 >> 172.21.15.110:0/1555491704 conn(0x7fa394101150 msgr2=0x7fa394103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:26.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.912+0000 7fa399600700 1 -- 172.21.15.110:0/1555491704 shutdown_connections 2024-04-26T11:31:26.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.912+0000 7fa399600700 1 -- 172.21.15.110:0/1555491704 wait complete. 2024-04-26T11:31:26.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.914+0000 7fa399600700 1 Processor -- start 2024-04-26T11:31:26.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.914+0000 7fa399600700 1 -- start start 2024-04-26T11:31:26.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.914+0000 7fa399600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394105660 0x7fa3941a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:26.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.914+0000 7fa399600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa394106020 0x7fa3941a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:26.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.914+0000 7fa399600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa39410b660 0x7fa39419bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:26.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.914+0000 7fa399600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941158f0 con 0x7fa394105660 2024-04-26T11:31:26.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.914+0000 7fa399600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa394115770 con 0x7fa39410b660 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.914+0000 7fa399600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa394115a70 con 0x7fa394106020 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394105660 0x7fa3941a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394105660 0x7fa3941a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58212/0 (socket says 172.21.15.110:58212) 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392a00700 1 -- 172.21.15.110:0/1800753998 learned_addr learned my addr 172.21.15.110:0/1800753998 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392000700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa394106020 0x7fa3941a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa393400700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa39410b660 0x7fa39419bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392a00700 1 -- 172.21.15.110:0/1800753998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa394106020 msgr2=0x7fa3941a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392a00700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa394106020 0x7fa3941a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392a00700 1 -- 172.21.15.110:0/1800753998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa39410b660 msgr2=0x7fa39419bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392a00700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa39410b660 0x7fa39419bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392a00700 1 -- 172.21.15.110:0/1800753998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39419c410 con 0x7fa394105660 2024-04-26T11:31:26.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392000700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa394106020 0x7fa3941a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:26.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.915+0000 7fa392a00700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394105660 0x7fa3941a1a60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa38400e9c0 tx=0x7fa38400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:26.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.916+0000 7fa38b400700 1 -- 172.21.15.110:0/1800753998 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38400cbd0 con 0x7fa394105660 2024-04-26T11:31:26.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.916+0000 7fa38b400700 1 -- 172.21.15.110:0/1800753998 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa38400ee60 con 0x7fa394105660 2024-04-26T11:31:26.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.916+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39419c700 con 0x7fa394105660 2024-04-26T11:31:26.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.916+0000 7fa38b400700 1 -- 172.21.15.110:0/1800753998 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3840055c0 con 0x7fa394105660 2024-04-26T11:31:26.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.916+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3941a89e0 con 0x7fa394105660 2024-04-26T11:31:26.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.917+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa394106da0 con 0x7fa394105660 2024-04-26T11:31:26.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.919+0000 7fa38b400700 1 -- 172.21.15.110:0/1800753998 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7fa384004750 con 0x7fa394105660 2024-04-26T11:31:26.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.920+0000 7fa38b400700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa3780a3e40 0x7fa3780a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.921+0000 7fa38b400700 1 -- 172.21.15.110:0/1800753998 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fa3840d0eb0 con 0x7fa394105660 2024-04-26T11:31:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.921+0000 7fa392000700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa3780a3e40 0x7fa3780a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:26.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.922+0000 7fa392000700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa3780a3e40 0x7fa3780a6300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa39419d280 tx=0x7fa380009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:26.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:26.924+0000 7fa38b400700 1 -- 172.21.15.110:0/1800753998 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa384053ff0 con 0x7fa394105660 2024-04-26T11:31:27.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.147+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 --> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa39419cff0 con 0x7fa3780a3e40 2024-04-26T11:31:27.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.171+0000 7fa38b400700 1 -- 172.21.15.110:0/1800753998 <== mgr.25028 v2:172.21.15.110:6800/2061324969 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258073 (secure 0 0 0) 0x7fa39419cff0 con 0x7fa3780a3e40 2024-04-26T11:31:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:31:27.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa3780a3e40 msgr2=0x7fa3780a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:27.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa3780a3e40 0x7fa3780a6300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa39419d280 tx=0x7fa380009260 comp rx=0 tx=0).stop 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394105660 msgr2=0x7fa3941a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394105660 0x7fa3941a1a60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa38400e9c0 tx=0x7fa38400ecd0 comp rx=0 tx=0).stop 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 shutdown_connections 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa3780a3e40 0x7fa3780a6300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa39410b660 0x7fa39419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa394105660 0x7fa3941a1a60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 --2- 172.21.15.110:0/1800753998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa394106020 0x7fa3941a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 >> 172.21.15.110:0/1800753998 conn(0x7fa394101150 msgr2=0x7fa394101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 shutdown_connections 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:27.177+0000 7fa399600700 1 -- 172.21.15.110:0/1800753998 wait complete. 2024-04-26T11:31:27.196 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-26T11:31:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:27 smithi196 ceph-mon[32572]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 59 op/s 2024-04-26T11:31:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:27 smithi110 ceph-mon[28069]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 59 op/s 2024-04-26T11:31:28.102 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-04-26T11:31:26.107091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1385047,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1944,"num_read_kb":1409,"num_write":623,"num_write_kb":5292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1182052,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":958,"ondisk_log_size":958,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370280,"kb_used_data":12756,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571544,"statfs":{"total":1151940427776,"available":1151561261056,"internally_reserved":0,"allocated":13062144,"data_stored":10262553,"data_compressed":386010,"data_compressed_allocated":516096,"data_compressed_original":4362240,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":384,"num_read_kb":456,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.927832"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432757+0000","last_change":"2024-04-26T11:27:12.099635+0000","last_active":"2024-04-26T11:31:16.432757+0000","last_peered":"2024-04-26T11:31:16.432757+0000","last_clean":"2024-04-26T11:31:16.432757+0000","last_became_active":"2024-04-26T11:27:12.099342+0000","last_became_peered":"2024-04-26T11:27:12.099342+0000","last_unstale":"2024-04-26T11:31:16.432757+0000","last_undegraded":"2024-04-26T11:31:16.432757+0000","last_fullsized":"2024-04-26T11:31:16.432757+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:36.433968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407080+0000","last_change":"2024-04-26T11:27:12.090804+0000","last_active":"2024-04-26T11:31:16.407080+0000","last_peered":"2024-04-26T11:31:16.407080+0000","last_clean":"2024-04-26T11:31:16.407080+0000","last_became_active":"2024-04-26T11:27:12.089662+0000","last_became_peered":"2024-04-26T11:27:12.089662+0000","last_unstale":"2024-04-26T11:31:16.407080+0000","last_undegraded":"2024-04-26T11:31:16.407080+0000","last_fullsized":"2024-04-26T11:31:16.407080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.776482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406861+0000","last_change":"2024-04-26T11:27:12.094739+0000","last_active":"2024-04-26T11:31:16.406861+0000","last_peered":"2024-04-26T11:31:16.406861+0000","last_clean":"2024-04-26T11:31:16.406861+0000","last_became_active":"2024-04-26T11:27:12.094410+0000","last_became_peered":"2024-04-26T11:27:12.094410+0000","last_unstale":"2024-04-26T11:31:16.406861+0000","last_undegraded":"2024-04-26T11:31:16.406861+0000","last_fullsized":"2024-04-26T11:31:16.406861+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:17.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224063+0000","last_change":"2024-04-26T11:28:03.446873+0000","last_active":"2024-04-26T11:31:16.224063+0000","last_peered":"2024-04-26T11:31:16.224063+0000","last_clean":"2024-04-26T11:31:16.224063+0000","last_became_active":"2024-04-26T11:28:03.445335+0000","last_became_peered":"2024-04-26T11:28:03.445335+0000","last_unstale":"2024-04-26T11:31:16.224063+0000","last_undegraded":"2024-04-26T11:31:16.224063+0000","last_fullsized":"2024-04-26T11:31:16.224063+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:59.892678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226479+0000","last_change":"2024-04-26T11:27:12.114071+0000","last_active":"2024-04-26T11:31:16.226479+0000","last_peered":"2024-04-26T11:31:16.226479+0000","last_clean":"2024-04-26T11:31:16.226479+0000","last_became_active":"2024-04-26T11:27:12.113795+0000","last_became_peered":"2024-04-26T11:27:12.113795+0000","last_unstale":"2024-04-26T11:31:16.226479+0000","last_undegraded":"2024-04-26T11:31:16.226479+0000","last_fullsized":"2024-04-26T11:31:16.226479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:34.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083760+0000","last_change":"2024-04-26T11:27:12.108449+0000","last_active":"2024-04-26T11:31:16.083760+0000","last_peered":"2024-04-26T11:31:16.083760+0000","last_clean":"2024-04-26T11:31:16.083760+0000","last_became_active":"2024-04-26T11:27:12.108071+0000","last_became_peered":"2024-04-26T11:27:12.108071+0000","last_unstale":"2024-04-26T11:31:16.083760+0000","last_undegraded":"2024-04-26T11:31:16.083760+0000","last_fullsized":"2024-04-26T11:31:16.083760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:04.001728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405659+0000","last_change":"2024-04-26T11:29:03.603681+0000","last_active":"2024-04-26T11:31:16.405659+0000","last_peered":"2024-04-26T11:31:16.405659+0000","last_clean":"2024-04-26T11:31:16.405659+0000","last_became_active":"2024-04-26T11:29:03.603180+0000","last_became_peered":"2024-04-26T11:29:03.603180+0000","last_unstale":"2024-04-26T11:31:16.405659+0000","last_undegraded":"2024-04-26T11:31:16.405659+0000","last_fullsized":"2024-04-26T11:31:16.405659+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.081996+0000","last_change":"2024-04-26T11:27:12.111215+0000","last_active":"2024-04-26T11:31:16.081996+0000","last_peered":"2024-04-26T11:31:16.081996+0000","last_clean":"2024-04-26T11:31:16.081996+0000","last_became_active":"2024-04-26T11:27:12.110896+0000","last_became_peered":"2024-04-26T11:27:12.110896+0000","last_unstale":"2024-04-26T11:31:16.081996+0000","last_undegraded":"2024-04-26T11:31:16.081996+0000","last_fullsized":"2024-04-26T11:31:16.081996+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:17.469534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406380+0000","last_change":"2024-04-26T11:27:12.091871+0000","last_active":"2024-04-26T11:31:16.406380+0000","last_peered":"2024-04-26T11:31:16.406380+0000","last_clean":"2024-04-26T11:31:16.406380+0000","last_became_active":"2024-04-26T11:27:12.091239+0000","last_became_peered":"2024-04-26T11:27:12.091239+0000","last_unstale":"2024-04-26T11:31:16.406380+0000","last_undegraded":"2024-04-26T11:31:16.406380+0000","last_fullsized":"2024-04-26T11:31:16.406380+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:30.526152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.085135+0000","last_change":"2024-04-26T11:27:12.093411+0000","last_active":"2024-04-26T11:31:16.085135+0000","last_peered":"2024-04-26T11:31:16.085135+0000","last_clean":"2024-04-26T11:31:16.085135+0000","last_became_active":"2024-04-26T11:27:12.093086+0000","last_became_peered":"2024-04-26T11:27:12.093086+0000","last_unstale":"2024-04-26T11:31:16.085135+0000","last_undegraded":"2024-04-26T11:31:16.085135+0000","last_fullsized":"2024-04-26T11:31:16.085135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:56.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406714+0000","last_change":"2024-04-26T11:27:12.093317+0000","last_active":"2024-04-26T11:31:16.406714+0000","last_peered":"2024-04-26T11:31:16.406714+0000","last_clean":"2024-04-26T11:31:16.406714+0000","last_became_active":"2024-04-26T11:27:12.092595+0000","last_became_peered":"2024-04-26T11:27:12.092595+0000","last_unstale":"2024-04-26T11:31:16.406714+0000","last_undegraded":"2024-04-26T11:31:16.406714+0000","last_fullsized":"2024-04-26T11:31:16.406714+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.702218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.114213+0000","last_change":"2024-04-26T11:27:12.093118+0000","last_active":"2024-04-26T11:31:16.114213+0000","last_peered":"2024-04-26T11:31:16.114213+0000","last_clean":"2024-04-26T11:31:16.114213+0000","last_became_active":"2024-04-26T11:27:12.091482+0000","last_became_peered":"2024-04-26T11:27:12.091482+0000","last_unstale":"2024-04-26T11:31:16.114213+0000","last_undegraded":"2024-04-26T11:31:16.114213+0000","last_fullsized":"2024-04-26T11:31:16.114213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.426213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111084+0000","last_change":"2024-04-26T11:27:12.114213+0000","last_active":"2024-04-26T11:31:16.111084+0000","last_peered":"2024-04-26T11:31:16.111084+0000","last_clean":"2024-04-26T11:31:16.111084+0000","last_became_active":"2024-04-26T11:27:12.113867+0000","last_became_peered":"2024-04-26T11:27:12.113867+0000","last_unstale":"2024-04-26T11:31:16.111084+0000","last_undegraded":"2024-04-26T11:31:16.111084+0000","last_fullsized":"2024-04-26T11:31:16.111084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:59.258645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406640+0000","last_change":"2024-04-26T11:27:12.084301+0000","last_active":"2024-04-26T11:31:16.406640+0000","last_peered":"2024-04-26T11:31:16.406640+0000","last_clean":"2024-04-26T11:31:16.406640+0000","last_became_active":"2024-04-26T11:27:12.083808+0000","last_became_peered":"2024-04-26T11:27:12.083808+0000","last_unstale":"2024-04-26T11:31:16.406640+0000","last_undegraded":"2024-04-26T11:31:16.406640+0000","last_fullsized":"2024-04-26T11:31:16.406640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:46.107583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406475+0000","last_change":"2024-04-26T11:27:12.089647+0000","last_active":"2024-04-26T11:31:16.406475+0000","last_peered":"2024-04-26T11:31:16.406475+0000","last_clean":"2024-04-26T11:31:16.406475+0000","last_became_active":"2024-04-26T11:27:12.088081+0000","last_became_peered":"2024-04-26T11:27:12.088081+0000","last_unstale":"2024-04-26T11:31:16.406475+0000","last_undegraded":"2024-04-26T11:31:16.406475+0000","last_fullsized":"2024-04-26T11:31:16.406475+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:43.423430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405624+0000","last_change":"2024-04-26T11:27:12.098138+0000","last_active":"2024-04-26T11:31:16.405624+0000","last_peered":"2024-04-26T11:31:16.405624+0000","last_clean":"2024-04-26T11:31:16.405624+0000","last_became_active":"2024-04-26T11:27:12.097756+0000","last_became_peered":"2024-04-26T11:27:12.097756+0000","last_unstale":"2024-04-26T11:31:16.405624+0000","last_undegraded":"2024-04-26T11:31:16.405624+0000","last_fullsized":"2024-04-26T11:31:16.405624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:21.155370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432793+0000","last_change":"2024-04-26T11:27:12.099925+0000","last_active":"2024-04-26T11:31:16.432793+0000","last_peered":"2024-04-26T11:31:16.432793+0000","last_clean":"2024-04-26T11:31:16.432793+0000","last_became_active":"2024-04-26T11:27:12.099600+0000","last_became_peered":"2024-04-26T11:27:12.099600+0000","last_unstale":"2024-04-26T11:31:16.432793+0000","last_undegraded":"2024-04-26T11:31:16.432793+0000","last_fullsized":"2024-04-26T11:31:16.432793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:23.704624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224238+0000","last_change":"2024-04-26T11:27:12.104697+0000","last_active":"2024-04-26T11:31:16.224238+0000","last_peered":"2024-04-26T11:31:16.224238+0000","last_clean":"2024-04-26T11:31:16.224238+0000","last_became_active":"2024-04-26T11:27:12.103963+0000","last_became_peered":"2024-04-26T11:27:12.103963+0000","last_unstale":"2024-04-26T11:31:16.224238+0000","last_undegraded":"2024-04-26T11:31:16.224238+0000","last_fullsized":"2024-04-26T11:31:16.224238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:58.202895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083872+0000","last_change":"2024-04-26T11:29:03.603898+0000","last_active":"2024-04-26T11:31:16.083872+0000","last_peered":"2024-04-26T11:31:16.083872+0000","last_clean":"2024-04-26T11:31:16.083872+0000","last_became_active":"2024-04-26T11:29:03.603488+0000","last_became_peered":"2024-04-26T11:29:03.603488+0000","last_unstale":"2024-04-26T11:31:16.083872+0000","last_undegraded":"2024-04-26T11:31:16.083872+0000","last_fullsized":"2024-04-26T11:31:16.083872+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:04.137277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224061+0000","last_change":"2024-04-26T11:28:03.456017+0000","last_active":"2024-04-26T11:31:16.224061+0000","last_peered":"2024-04-26T11:31:16.224061+0000","last_clean":"2024-04-26T11:31:16.224061+0000","last_became_active":"2024-04-26T11:28:03.447016+0000","last_became_peered":"2024-04-26T11:28:03.447016+0000","last_unstale":"2024-04-26T11:31:16.224061+0000","last_undegraded":"2024-04-26T11:31:16.224061+0000","last_fullsized":"2024-04-26T11:31:16.224061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.616546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082449+0000","last_change":"2024-04-26T11:27:12.112635+0000","last_active":"2024-04-26T11:31:16.082449+0000","last_peered":"2024-04-26T11:31:16.082449+0000","last_clean":"2024-04-26T11:31:16.082449+0000","last_became_active":"2024-04-26T11:27:12.112282+0000","last_became_peered":"2024-04-26T11:27:12.112282+0000","last_unstale":"2024-04-26T11:31:16.082449+0000","last_undegraded":"2024-04-26T11:31:16.082449+0000","last_fullsized":"2024-04-26T11:31:16.082449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:21.482922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082668+0000","last_change":"2024-04-26T11:27:08.473301+0000","last_active":"2024-04-26T11:31:16.082668+0000","last_peered":"2024-04-26T11:31:16.082668+0000","last_clean":"2024-04-26T11:31:16.082668+0000","last_became_active":"2024-04-26T11:27:08.472769+0000","last_became_peered":"2024-04-26T11:27:08.472769+0000","last_unstale":"2024-04-26T11:31:16.082668+0000","last_undegraded":"2024-04-26T11:31:16.082668+0000","last_fullsized":"2024-04-26T11:31:16.082668+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:49.108849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407062+0000","last_change":"2024-04-26T11:27:12.109725+0000","last_active":"2024-04-26T11:31:16.407062+0000","last_peered":"2024-04-26T11:31:16.407062+0000","last_clean":"2024-04-26T11:31:16.407062+0000","last_became_active":"2024-04-26T11:27:12.109376+0000","last_became_peered":"2024-04-26T11:27:12.109376+0000","last_unstale":"2024-04-26T11:31:16.407062+0000","last_undegraded":"2024-04-26T11:31:16.407062+0000","last_fullsized":"2024-04-26T11:31:16.407062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":49,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226741+0000","last_change":"2024-04-26T11:28:03.464520+0000","last_active":"2024-04-26T11:31:16.226741+0000","last_peered":"2024-04-26T11:31:16.226741+0000","last_clean":"2024-04-26T11:31:16.226741+0000","last_became_active":"2024-04-26T11:28:03.449993+0000","last_became_peered":"2024-04-26T11:28:03.449993+0000","last_unstale":"2024-04-26T11:31:16.226741+0000","last_undegraded":"2024-04-26T11:31:16.226741+0000","last_fullsized":"2024-04-26T11:31:16.226741+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:01.465563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405839+0000","last_change":"2024-04-26T11:27:12.100830+0000","last_active":"2024-04-26T11:31:16.405839+0000","last_peered":"2024-04-26T11:31:16.405839+0000","last_clean":"2024-04-26T11:31:16.405839+0000","last_became_active":"2024-04-26T11:27:12.100474+0000","last_became_peered":"2024-04-26T11:27:12.100474+0000","last_unstale":"2024-04-26T11:31:16.405839+0000","last_undegraded":"2024-04-26T11:31:16.405839+0000","last_fullsized":"2024-04-26T11:31:16.405839+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:18.778897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432390+0000","last_change":"2024-04-26T11:28:03.444580+0000","last_active":"2024-04-26T11:31:16.432390+0000","last_peered":"2024-04-26T11:31:16.432390+0000","last_clean":"2024-04-26T11:31:16.432390+0000","last_became_active":"2024-04-26T11:28:03.435056+0000","last_became_peered":"2024-04-26T11:28:03.435056+0000","last_unstale":"2024-04-26T11:31:16.432390+0000","last_undegraded":"2024-04-26T11:31:16.432390+0000","last_fullsized":"2024-04-26T11:31:16.432390+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:42.640914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101514+0000","last_change":"2024-04-26T11:27:12.093472+0000","last_active":"2024-04-26T11:31:16.101514+0000","last_peered":"2024-04-26T11:31:16.101514+0000","last_clean":"2024-04-26T11:31:16.101514+0000","last_became_active":"2024-04-26T11:27:12.093110+0000","last_became_peered":"2024-04-26T11:27:12.093110+0000","last_unstale":"2024-04-26T11:31:16.101514+0000","last_undegraded":"2024-04-26T11:31:16.101514+0000","last_fullsized":"2024-04-26T11:31:16.101514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:19.256670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":223,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:20.705155+0000","last_change":"2024-04-26T11:28:03.440961+0000","last_active":"2024-04-26T11:31:20.705155+0000","last_peered":"2024-04-26T11:31:20.705155+0000","last_clean":"2024-04-26T11:31:20.705155+0000","last_became_active":"2024-04-26T11:28:03.434607+0000","last_became_peered":"2024-04-26T11:28:03.434607+0000","last_unstale":"2024-04-26T11:31:20.705155+0000","last_undegraded":"2024-04-26T11:31:20.705155+0000","last_fullsized":"2024-04-26T11:31:20.705155+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:37.122557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":199,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226334+0000","last_change":"2024-04-26T11:28:03.447662+0000","last_active":"2024-04-26T11:31:16.226334+0000","last_peered":"2024-04-26T11:31:16.226334+0000","last_clean":"2024-04-26T11:31:16.226334+0000","last_became_active":"2024-04-26T11:28:03.447333+0000","last_became_peered":"2024-04-26T11:28:03.447333+0000","last_unstale":"2024-04-26T11:31:16.226334+0000","last_undegraded":"2024-04-26T11:31:16.226334+0000","last_fullsized":"2024-04-26T11:31:16.226334+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:37.600940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083710+0000","last_change":"2024-04-26T11:27:08.028424+0000","last_active":"2024-04-26T11:31:16.083710+0000","last_peered":"2024-04-26T11:31:16.083710+0000","last_clean":"2024-04-26T11:31:16.083710+0000","last_became_active":"2024-04-26T11:27:08.028134+0000","last_became_peered":"2024-04-26T11:27:08.028134+0000","last_unstale":"2024-04-26T11:31:16.083710+0000","last_undegraded":"2024-04-26T11:31:16.083710+0000","last_fullsized":"2024-04-26T11:31:16.083710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:44.636288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101385+0000","last_change":"2024-04-26T11:27:12.108078+0000","last_active":"2024-04-26T11:31:16.101385+0000","last_peered":"2024-04-26T11:31:16.101385+0000","last_clean":"2024-04-26T11:31:16.101385+0000","last_became_active":"2024-04-26T11:27:12.107713+0000","last_became_peered":"2024-04-26T11:27:12.107713+0000","last_unstale":"2024-04-26T11:31:16.101385+0000","last_undegraded":"2024-04-26T11:31:16.101385+0000","last_fullsized":"2024-04-26T11:31:16.101385+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:59.995679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111197+0000","last_change":"2024-04-26T11:27:08.049134+0000","last_active":"2024-04-26T11:31:16.111197+0000","last_peered":"2024-04-26T11:31:16.111197+0000","last_clean":"2024-04-26T11:31:16.111197+0000","last_became_active":"2024-04-26T11:27:08.047862+0000","last_became_peered":"2024-04-26T11:27:08.047862+0000","last_unstale":"2024-04-26T11:31:16.111197+0000","last_undegraded":"2024-04-26T11:31:16.111197+0000","last_fullsized":"2024-04-26T11:31:16.111197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:55.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082204+0000","last_change":"2024-04-26T11:27:12.117417+0000","last_active":"2024-04-26T11:31:16.082204+0000","last_peered":"2024-04-26T11:31:16.082204+0000","last_clean":"2024-04-26T11:31:16.082204+0000","last_became_active":"2024-04-26T11:27:12.116643+0000","last_became_peered":"2024-04-26T11:27:12.116643+0000","last_unstale":"2024-04-26T11:31:16.082204+0000","last_undegraded":"2024-04-26T11:31:16.082204+0000","last_fullsized":"2024-04-26T11:31:16.082204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:26.677738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101334+0000","last_change":"2024-04-26T11:27:08.037806+0000","last_active":"2024-04-26T11:31:16.101334+0000","last_peered":"2024-04-26T11:31:16.101334+0000","last_clean":"2024-04-26T11:31:16.101334+0000","last_became_active":"2024-04-26T11:27:08.037309+0000","last_became_peered":"2024-04-26T11:27:08.037309+0000","last_unstale":"2024-04-26T11:31:16.101334+0000","last_undegraded":"2024-04-26T11:31:16.101334+0000","last_fullsized":"2024-04-26T11:31:16.101334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.910219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.223722+0000","last_change":"2024-04-26T11:27:12.120986+0000","last_active":"2024-04-26T11:31:16.223722+0000","last_peered":"2024-04-26T11:31:16.223722+0000","last_clean":"2024-04-26T11:31:16.223722+0000","last_became_active":"2024-04-26T11:27:12.120580+0000","last_became_peered":"2024-04-26T11:27:12.120580+0000","last_unstale":"2024-04-26T11:31:16.223722+0000","last_undegraded":"2024-04-26T11:31:16.223722+0000","last_fullsized":"2024-04-26T11:31:16.223722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:00.996039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":262,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:20.704526+0000","last_change":"2024-04-26T11:27:08.048979+0000","last_active":"2024-04-26T11:31:20.704526+0000","last_peered":"2024-04-26T11:31:20.704526+0000","last_clean":"2024-04-26T11:31:20.704526+0000","last_became_active":"2024-04-26T11:27:08.048641+0000","last_became_peered":"2024-04-26T11:27:08.048641+0000","last_unstale":"2024-04-26T11:31:20.704526+0000","last_undegraded":"2024-04-26T11:31:20.704526+0000","last_fullsized":"2024-04-26T11:31:20.704526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:38.917651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406196+0000","last_change":"2024-04-26T11:27:12.104749+0000","last_active":"2024-04-26T11:31:16.406196+0000","last_peered":"2024-04-26T11:31:16.406196+0000","last_clean":"2024-04-26T11:31:16.406196+0000","last_became_active":"2024-04-26T11:27:12.104358+0000","last_became_peered":"2024-04-26T11:27:12.104358+0000","last_unstale":"2024-04-26T11:31:16.406196+0000","last_undegraded":"2024-04-26T11:31:16.406196+0000","last_fullsized":"2024-04-26T11:31:16.406196+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:47.364512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406712+0000","last_change":"2024-04-26T11:27:08.038165+0000","last_active":"2024-04-26T11:31:16.406712+0000","last_peered":"2024-04-26T11:31:16.406712+0000","last_clean":"2024-04-26T11:31:16.406712+0000","last_became_active":"2024-04-26T11:27:08.036930+0000","last_became_peered":"2024-04-26T11:27:08.036930+0000","last_unstale":"2024-04-26T11:31:16.406712+0000","last_undegraded":"2024-04-26T11:31:16.406712+0000","last_fullsized":"2024-04-26T11:31:16.406712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:10.050679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407006+0000","last_change":"2024-04-26T11:27:12.098702+0000","last_active":"2024-04-26T11:31:16.407006+0000","last_peered":"2024-04-26T11:31:16.407006+0000","last_clean":"2024-04-26T11:31:16.407006+0000","last_became_active":"2024-04-26T11:27:12.089241+0000","last_became_peered":"2024-04-26T11:27:12.089241+0000","last_unstale":"2024-04-26T11:31:16.407006+0000","last_undegraded":"2024-04-26T11:31:16.407006+0000","last_fullsized":"2024-04-26T11:31:16.407006+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.013054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101577+0000","last_change":"2024-04-26T11:27:08.473759+0000","last_active":"2024-04-26T11:31:16.101577+0000","last_peered":"2024-04-26T11:31:16.101577+0000","last_clean":"2024-04-26T11:31:16.101577+0000","last_became_active":"2024-04-26T11:27:08.473288+0000","last_became_peered":"2024-04-26T11:27:08.473288+0000","last_unstale":"2024-04-26T11:31:16.101577+0000","last_undegraded":"2024-04-26T11:31:16.101577+0000","last_fullsized":"2024-04-26T11:31:16.101577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:36.727119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405908+0000","last_change":"2024-04-26T11:27:12.096935+0000","last_active":"2024-04-26T11:31:16.405908+0000","last_peered":"2024-04-26T11:31:16.405908+0000","last_clean":"2024-04-26T11:31:16.405908+0000","last_became_active":"2024-04-26T11:27:12.096481+0000","last_became_peered":"2024-04-26T11:27:12.096481+0000","last_unstale":"2024-04-26T11:31:16.405908+0000","last_undegraded":"2024-04-26T11:31:16.405908+0000","last_fullsized":"2024-04-26T11:31:16.405908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:58.855909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"94'37","reported_seq":534,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:21.705985+0000","last_change":"2024-04-26T11:27:08.037227+0000","last_active":"2024-04-26T11:31:21.705985+0000","last_peered":"2024-04-26T11:31:21.705985+0000","last_clean":"2024-04-26T11:31:21.705985+0000","last_became_active":"2024-04-26T11:27:08.036852+0000","last_became_peered":"2024-04-26T11:27:08.036852+0000","last_unstale":"2024-04-26T11:31:21.705985+0000","last_undegraded":"2024-04-26T11:31:21.705985+0000","last_fullsized":"2024-04-26T11:31:21.705985+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:44.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68073,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":464,"num_read_kb":298,"num_write":38,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226514+0000","last_change":"2024-04-26T11:27:12.088586+0000","last_active":"2024-04-26T11:31:16.226514+0000","last_peered":"2024-04-26T11:31:16.226514+0000","last_clean":"2024-04-26T11:31:16.226514+0000","last_became_active":"2024-04-26T11:27:12.088264+0000","last_became_peered":"2024-04-26T11:27:12.088264+0000","last_unstale":"2024-04-26T11:31:16.226514+0000","last_undegraded":"2024-04-26T11:31:16.226514+0000","last_fullsized":"2024-04-26T11:31:16.226514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:39.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083583+0000","last_change":"2024-04-26T11:27:08.049289+0000","last_active":"2024-04-26T11:31:16.083583+0000","last_peered":"2024-04-26T11:31:16.083583+0000","last_clean":"2024-04-26T11:31:16.083583+0000","last_became_active":"2024-04-26T11:27:08.048923+0000","last_became_peered":"2024-04-26T11:27:08.048923+0000","last_unstale":"2024-04-26T11:31:16.083583+0000","last_undegraded":"2024-04-26T11:31:16.083583+0000","last_fullsized":"2024-04-26T11:31:16.083583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:42.229383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111431+0000","last_change":"2024-04-26T11:27:12.118154+0000","last_active":"2024-04-26T11:31:16.111431+0000","last_peered":"2024-04-26T11:31:16.111431+0000","last_clean":"2024-04-26T11:31:16.111431+0000","last_became_active":"2024-04-26T11:27:12.117624+0000","last_became_peered":"2024-04-26T11:27:12.117624+0000","last_unstale":"2024-04-26T11:31:16.111431+0000","last_undegraded":"2024-04-26T11:31:16.111431+0000","last_fullsized":"2024-04-26T11:31:16.111431+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:57.947310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101393+0000","last_change":"2024-04-26T11:27:08.045870+0000","last_active":"2024-04-26T11:31:16.101393+0000","last_peered":"2024-04-26T11:31:16.101393+0000","last_clean":"2024-04-26T11:31:16.101393+0000","last_became_active":"2024-04-26T11:27:08.045461+0000","last_became_peered":"2024-04-26T11:27:08.045461+0000","last_unstale":"2024-04-26T11:31:16.101393+0000","last_undegraded":"2024-04-26T11:31:16.101393+0000","last_fullsized":"2024-04-26T11:31:16.101393+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:59.899805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406358+0000","last_change":"2024-04-26T11:27:12.116617+0000","last_active":"2024-04-26T11:31:16.406358+0000","last_peered":"2024-04-26T11:31:16.406358+0000","last_clean":"2024-04-26T11:31:16.406358+0000","last_became_active":"2024-04-26T11:27:12.115731+0000","last_became_peered":"2024-04-26T11:27:12.115731+0000","last_unstale":"2024-04-26T11:31:16.406358+0000","last_undegraded":"2024-04-26T11:31:16.406358+0000","last_fullsized":"2024-04-26T11:31:16.406358+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:42.680367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"94'7","reported_seq":272,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:21.122879+0000","last_change":"2024-04-26T11:27:08.036947+0000","last_active":"2024-04-26T11:31:21.122879+0000","last_peered":"2024-04-26T11:31:21.122879+0000","last_clean":"2024-04-26T11:31:21.122879+0000","last_became_active":"2024-04-26T11:27:08.036596+0000","last_became_peered":"2024-04-26T11:27:08.036596+0000","last_unstale":"2024-04-26T11:31:21.122879+0000","last_undegraded":"2024-04-26T11:31:21.122879+0000","last_fullsized":"2024-04-26T11:31:21.122879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:35.606069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405803+0000","last_change":"2024-04-26T11:27:12.086190+0000","last_active":"2024-04-26T11:31:16.405803+0000","last_peered":"2024-04-26T11:31:16.405803+0000","last_clean":"2024-04-26T11:31:16.405803+0000","last_became_active":"2024-04-26T11:27:12.085839+0000","last_became_peered":"2024-04-26T11:27:12.085839+0000","last_unstale":"2024-04-26T11:31:16.405803+0000","last_undegraded":"2024-04-26T11:31:16.405803+0000","last_fullsized":"2024-04-26T11:31:16.405803+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:31.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226321+0000","last_change":"2024-04-26T11:28:03.459792+0000","last_active":"2024-04-26T11:31:16.226321+0000","last_peered":"2024-04-26T11:31:16.226321+0000","last_clean":"2024-04-26T11:31:16.226321+0000","last_became_active":"2024-04-26T11:28:03.444101+0000","last_became_peered":"2024-04-26T11:28:03.444101+0000","last_unstale":"2024-04-26T11:31:16.226321+0000","last_undegraded":"2024-04-26T11:31:16.226321+0000","last_fullsized":"2024-04-26T11:31:16.226321+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:14.498792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101310+0000","last_change":"2024-04-26T11:27:12.093884+0000","last_active":"2024-04-26T11:31:16.101310+0000","last_peered":"2024-04-26T11:31:16.101310+0000","last_clean":"2024-04-26T11:31:16.101310+0000","last_became_active":"2024-04-26T11:27:12.093573+0000","last_became_peered":"2024-04-26T11:27:12.093573+0000","last_unstale":"2024-04-26T11:31:16.101310+0000","last_undegraded":"2024-04-26T11:31:16.101310+0000","last_fullsized":"2024-04-26T11:31:16.101310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:32.144889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"94'3","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226840+0000","last_change":"2024-04-26T11:27:08.035089+0000","last_active":"2024-04-26T11:31:16.226840+0000","last_peered":"2024-04-26T11:31:16.226840+0000","last_clean":"2024-04-26T11:31:16.226840+0000","last_became_active":"2024-04-26T11:27:08.034698+0000","last_became_peered":"2024-04-26T11:27:08.034698+0000","last_unstale":"2024-04-26T11:31:16.226840+0000","last_undegraded":"2024-04-26T11:31:16.226840+0000","last_fullsized":"2024-04-26T11:31:16.226840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:23.731307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432489+0000","last_change":"2024-04-26T11:27:12.097089+0000","last_active":"2024-04-26T11:31:16.432489+0000","last_peered":"2024-04-26T11:31:16.432489+0000","last_clean":"2024-04-26T11:31:16.432489+0000","last_became_active":"2024-04-26T11:27:12.096762+0000","last_became_peered":"2024-04-26T11:27:12.096762+0000","last_unstale":"2024-04-26T11:31:16.432489+0000","last_undegraded":"2024-04-26T11:31:16.432489+0000","last_fullsized":"2024-04-26T11:31:16.432489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.366450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224078+0000","last_change":"2024-04-26T11:27:08.475317+0000","last_active":"2024-04-26T11:31:16.224078+0000","last_peered":"2024-04-26T11:31:16.224078+0000","last_clean":"2024-04-26T11:31:16.224078+0000","last_became_active":"2024-04-26T11:27:08.474464+0000","last_became_peered":"2024-04-26T11:27:08.474464+0000","last_unstale":"2024-04-26T11:31:16.224078+0000","last_undegraded":"2024-04-26T11:31:16.224078+0000","last_fullsized":"2024-04-26T11:31:16.224078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.084811+0000","last_change":"2024-04-26T11:27:12.107542+0000","last_active":"2024-04-26T11:31:16.084811+0000","last_peered":"2024-04-26T11:31:16.084811+0000","last_clean":"2024-04-26T11:31:16.084811+0000","last_became_active":"2024-04-26T11:27:12.107162+0000","last_became_peered":"2024-04-26T11:27:12.107162+0000","last_unstale":"2024-04-26T11:31:16.084811+0000","last_undegraded":"2024-04-26T11:31:16.084811+0000","last_fullsized":"2024-04-26T11:31:16.084811+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:55.470638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406213+0000","last_change":"2024-04-26T11:27:08.044101+0000","last_active":"2024-04-26T11:31:16.406213+0000","last_peered":"2024-04-26T11:31:16.406213+0000","last_clean":"2024-04-26T11:31:16.406213+0000","last_became_active":"2024-04-26T11:27:08.043733+0000","last_became_peered":"2024-04-26T11:27:08.043733+0000","last_unstale":"2024-04-26T11:31:16.406213+0000","last_undegraded":"2024-04-26T11:31:16.406213+0000","last_fullsized":"2024-04-26T11:31:16.406213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:03.023620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083857+0000","last_change":"2024-04-26T11:29:03.604007+0000","last_active":"2024-04-26T11:31:16.083857+0000","last_peered":"2024-04-26T11:31:16.083857+0000","last_clean":"2024-04-26T11:31:16.083857+0000","last_became_active":"2024-04-26T11:29:03.603521+0000","last_became_peered":"2024-04-26T11:29:03.603521+0000","last_unstale":"2024-04-26T11:31:16.083857+0000","last_undegraded":"2024-04-26T11:31:16.083857+0000","last_fullsized":"2024-04-26T11:31:16.083857+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:05.733257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101794+0000","last_change":"2024-04-26T11:27:12.093505+0000","last_active":"2024-04-26T11:31:16.101794+0000","last_peered":"2024-04-26T11:31:16.101794+0000","last_clean":"2024-04-26T11:31:16.101794+0000","last_became_active":"2024-04-26T11:27:12.093198+0000","last_became_peered":"2024-04-26T11:27:12.093198+0000","last_unstale":"2024-04-26T11:31:16.101794+0000","last_undegraded":"2024-04-26T11:31:16.101794+0000","last_fullsized":"2024-04-26T11:31:16.101794+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:06.100747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"94'6","reported_seq":267,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:21.122053+0000","last_change":"2024-04-26T11:27:08.474897+0000","last_active":"2024-04-26T11:31:21.122053+0000","last_peered":"2024-04-26T11:31:21.122053+0000","last_clean":"2024-04-26T11:31:21.122053+0000","last_became_active":"2024-04-26T11:27:08.471735+0000","last_became_peered":"2024-04-26T11:27:08.471735+0000","last_unstale":"2024-04-26T11:31:21.122053+0000","last_undegraded":"2024-04-26T11:31:21.122053+0000","last_fullsized":"2024-04-26T11:31:21.122053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:42.066821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":227,"num_read_kb":227,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082965+0000","last_change":"2024-04-26T11:27:12.116722+0000","last_active":"2024-04-26T11:31:16.082965+0000","last_peered":"2024-04-26T11:31:16.082965+0000","last_clean":"2024-04-26T11:31:16.082965+0000","last_became_active":"2024-04-26T11:27:12.116239+0000","last_became_peered":"2024-04-26T11:27:12.116239+0000","last_unstale":"2024-04-26T11:31:16.082965+0000","last_undegraded":"2024-04-26T11:31:16.082965+0000","last_fullsized":"2024-04-26T11:31:16.082965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:04.962376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.114176+0000","last_change":"2024-04-26T11:27:08.047087+0000","last_active":"2024-04-26T11:31:16.114176+0000","last_peered":"2024-04-26T11:31:16.114176+0000","last_clean":"2024-04-26T11:31:16.114176+0000","last_became_active":"2024-04-26T11:27:08.046754+0000","last_became_peered":"2024-04-26T11:27:08.046754+0000","last_unstale":"2024-04-26T11:31:16.114176+0000","last_undegraded":"2024-04-26T11:31:16.114176+0000","last_fullsized":"2024-04-26T11:31:16.114176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:30.481521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"94'148","reported_seq":412,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:18.237873+0000","last_change":"2024-04-26T11:25:35.622816+0000","last_active":"2024-04-26T11:31:18.237873+0000","last_peered":"2024-04-26T11:31:18.237873+0000","last_clean":"2024-04-26T11:31:18.237873+0000","last_became_active":"2024-04-26T11:25:35.622329+0000","last_became_peered":"2024-04-26T11:25:35.622329+0000","last_unstale":"2024-04-26T11:31:18.237873+0000","last_undegraded":"2024-04-26T11:31:18.237873+0000","last_fullsized":"2024-04-26T11:31:18.237873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_clean_scrub_stamp":"2024-04-26T11:21:45.465157+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:40.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111106+0000","last_change":"2024-04-26T11:27:12.098686+0000","last_active":"2024-04-26T11:31:16.111106+0000","last_peered":"2024-04-26T11:31:16.111106+0000","last_clean":"2024-04-26T11:31:16.111106+0000","last_became_active":"2024-04-26T11:27:12.098251+0000","last_became_peered":"2024-04-26T11:27:12.098251+0000","last_unstale":"2024-04-26T11:31:16.111106+0000","last_undegraded":"2024-04-26T11:31:16.111106+0000","last_fullsized":"2024-04-26T11:31:16.111106+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:34.433203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405731+0000","last_change":"2024-04-26T11:27:08.036391+0000","last_active":"2024-04-26T11:31:16.405731+0000","last_peered":"2024-04-26T11:31:16.405731+0000","last_clean":"2024-04-26T11:31:16.405731+0000","last_became_active":"2024-04-26T11:27:08.036058+0000","last_became_peered":"2024-04-26T11:27:08.036058+0000","last_unstale":"2024-04-26T11:31:16.405731+0000","last_undegraded":"2024-04-26T11:31:16.405731+0000","last_fullsized":"2024-04-26T11:31:16.405731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:35.646501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226656+0000","last_change":"2024-04-26T11:27:08.472171+0000","last_active":"2024-04-26T11:31:16.226656+0000","last_peered":"2024-04-26T11:31:16.226656+0000","last_clean":"2024-04-26T11:31:16.226656+0000","last_became_active":"2024-04-26T11:27:08.471707+0000","last_became_peered":"2024-04-26T11:27:08.471707+0000","last_unstale":"2024-04-26T11:31:16.226656+0000","last_undegraded":"2024-04-26T11:31:16.226656+0000","last_fullsized":"2024-04-26T11:31:16.226656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:54.319448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111458+0000","last_change":"2024-04-26T11:27:12.110757+0000","last_active":"2024-04-26T11:31:16.111458+0000","last_peered":"2024-04-26T11:31:16.111458+0000","last_clean":"2024-04-26T11:31:16.111458+0000","last_became_active":"2024-04-26T11:27:12.109048+0000","last_became_peered":"2024-04-26T11:27:12.109048+0000","last_unstale":"2024-04-26T11:31:16.111458+0000","last_undegraded":"2024-04-26T11:31:16.111458+0000","last_fullsized":"2024-04-26T11:31:16.111458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:05.203504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"94'102","reported_seq":227,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:20.051652+0000","last_change":"2024-04-26T11:27:08.051790+0000","last_active":"2024-04-26T11:31:20.051652+0000","last_peered":"2024-04-26T11:31:20.051652+0000","last_clean":"2024-04-26T11:31:20.051652+0000","last_became_active":"2024-04-26T11:27:08.051430+0000","last_became_peered":"2024-04-26T11:27:08.051430+0000","last_unstale":"2024-04-26T11:31:20.051652+0000","last_undegraded":"2024-04-26T11:31:20.051652+0000","last_fullsized":"2024-04-26T11:31:20.051652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:13.607944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":187,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082801+0000","last_change":"2024-04-26T11:27:12.116704+0000","last_active":"2024-04-26T11:31:16.082801+0000","last_peered":"2024-04-26T11:31:16.082801+0000","last_clean":"2024-04-26T11:31:16.082801+0000","last_became_active":"2024-04-26T11:27:12.111556+0000","last_became_peered":"2024-04-26T11:27:12.111556+0000","last_unstale":"2024-04-26T11:31:16.082801+0000","last_undegraded":"2024-04-26T11:31:16.082801+0000","last_fullsized":"2024-04-26T11:31:16.082801+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:36.535244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.114091+0000","last_change":"2024-04-26T11:27:08.347851+0000","last_active":"2024-04-26T11:31:16.114091+0000","last_peered":"2024-04-26T11:31:16.114091+0000","last_clean":"2024-04-26T11:31:16.114091+0000","last_became_active":"2024-04-26T11:27:08.347460+0000","last_became_peered":"2024-04-26T11:27:08.347460+0000","last_unstale":"2024-04-26T11:31:16.114091+0000","last_undegraded":"2024-04-26T11:31:16.114091+0000","last_fullsized":"2024-04-26T11:31:16.114091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.017834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407026+0000","last_change":"2024-04-26T11:29:03.598719+0000","last_active":"2024-04-26T11:31:16.407026+0000","last_peered":"2024-04-26T11:31:16.407026+0000","last_clean":"2024-04-26T11:31:16.407026+0000","last_became_active":"2024-04-26T11:29:03.598192+0000","last_became_peered":"2024-04-26T11:29:03.598192+0000","last_unstale":"2024-04-26T11:31:16.407026+0000","last_undegraded":"2024-04-26T11:31:16.407026+0000","last_fullsized":"2024-04-26T11:31:16.407026+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:57.809995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405595+0000","last_change":"2024-04-26T11:27:08.472127+0000","last_active":"2024-04-26T11:31:16.405595+0000","last_peered":"2024-04-26T11:31:16.405595+0000","last_clean":"2024-04-26T11:31:16.405595+0000","last_became_active":"2024-04-26T11:27:08.471709+0000","last_became_peered":"2024-04-26T11:27:08.471709+0000","last_unstale":"2024-04-26T11:31:16.405595+0000","last_undegraded":"2024-04-26T11:31:16.405595+0000","last_fullsized":"2024-04-26T11:31:16.405595+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:28.432710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226324+0000","last_change":"2024-04-26T11:27:12.085756+0000","last_active":"2024-04-26T11:31:16.226324+0000","last_peered":"2024-04-26T11:31:16.226324+0000","last_clean":"2024-04-26T11:31:16.226324+0000","last_became_active":"2024-04-26T11:27:12.085397+0000","last_became_peered":"2024-04-26T11:27:12.085397+0000","last_unstale":"2024-04-26T11:31:16.226324+0000","last_undegraded":"2024-04-26T11:31:16.226324+0000","last_fullsized":"2024-04-26T11:31:16.226324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:41.392010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.081973+0000","last_change":"2024-04-26T11:27:08.054831+0000","last_active":"2024-04-26T11:31:16.081973+0000","last_peered":"2024-04-26T11:31:16.081973+0000","last_clean":"2024-04-26T11:31:16.081973+0000","last_became_active":"2024-04-26T11:27:08.054352+0000","last_became_peered":"2024-04-26T11:27:08.054352+0000","last_unstale":"2024-04-26T11:31:16.081973+0000","last_undegraded":"2024-04-26T11:31:16.081973+0000","last_fullsized":"2024-04-26T11:31:16.081973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:53.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432298+0000","last_change":"2024-04-26T11:27:12.095789+0000","last_active":"2024-04-26T11:31:16.432298+0000","last_peered":"2024-04-26T11:31:16.432298+0000","last_clean":"2024-04-26T11:31:16.432298+0000","last_became_active":"2024-04-26T11:27:12.095468+0000","last_became_peered":"2024-04-26T11:27:12.095468+0000","last_unstale":"2024-04-26T11:31:16.432298+0000","last_undegraded":"2024-04-26T11:31:16.432298+0000","last_fullsized":"2024-04-26T11:31:16.432298+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:27.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083768+0000","last_change":"2024-04-26T11:27:08.044923+0000","last_active":"2024-04-26T11:31:16.083768+0000","last_peered":"2024-04-26T11:31:16.083768+0000","last_clean":"2024-04-26T11:31:16.083768+0000","last_became_active":"2024-04-26T11:27:08.044516+0000","last_became_peered":"2024-04-26T11:27:08.044516+0000","last_unstale":"2024-04-26T11:31:16.083768+0000","last_undegraded":"2024-04-26T11:31:16.083768+0000","last_fullsized":"2024-04-26T11:31:16.083768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:21.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082214+0000","last_change":"2024-04-26T11:27:12.114311+0000","last_active":"2024-04-26T11:31:16.082214+0000","last_peered":"2024-04-26T11:31:16.082214+0000","last_clean":"2024-04-26T11:31:16.082214+0000","last_became_active":"2024-04-26T11:27:12.113538+0000","last_became_peered":"2024-04-26T11:27:12.113538+0000","last_unstale":"2024-04-26T11:31:16.082214+0000","last_undegraded":"2024-04-26T11:31:16.082214+0000","last_fullsized":"2024-04-26T11:31:16.082214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:55.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226482+0000","last_change":"2024-04-26T11:27:08.036983+0000","last_active":"2024-04-26T11:31:16.226482+0000","last_peered":"2024-04-26T11:31:16.226482+0000","last_clean":"2024-04-26T11:31:16.226482+0000","last_became_active":"2024-04-26T11:27:08.036632+0000","last_became_peered":"2024-04-26T11:27:08.036632+0000","last_unstale":"2024-04-26T11:31:16.226482+0000","last_undegraded":"2024-04-26T11:31:16.226482+0000","last_fullsized":"2024-04-26T11:31:16.226482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:31.731466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406275+0000","last_change":"2024-04-26T11:27:12.102922+0000","last_active":"2024-04-26T11:31:16.406275+0000","last_peered":"2024-04-26T11:31:16.406275+0000","last_clean":"2024-04-26T11:31:16.406275+0000","last_became_active":"2024-04-26T11:27:12.102594+0000","last_became_peered":"2024-04-26T11:27:12.102594+0000","last_unstale":"2024-04-26T11:31:16.406275+0000","last_undegraded":"2024-04-26T11:31:16.406275+0000","last_fullsized":"2024-04-26T11:31:16.406275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:47.223435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083774+0000","last_change":"2024-04-26T11:27:08.473262+0000","last_active":"2024-04-26T11:31:16.083774+0000","last_peered":"2024-04-26T11:31:16.083774+0000","last_clean":"2024-04-26T11:31:16.083774+0000","last_became_active":"2024-04-26T11:27:08.472744+0000","last_became_peered":"2024-04-26T11:27:08.472744+0000","last_unstale":"2024-04-26T11:31:16.083774+0000","last_undegraded":"2024-04-26T11:31:16.083774+0000","last_fullsized":"2024-04-26T11:31:16.083774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:16.766438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406836+0000","last_change":"2024-04-26T11:27:12.091754+0000","last_active":"2024-04-26T11:31:16.406836+0000","last_peered":"2024-04-26T11:31:16.406836+0000","last_clean":"2024-04-26T11:31:16.406836+0000","last_became_active":"2024-04-26T11:27:12.091282+0000","last_became_peered":"2024-04-26T11:27:12.091282+0000","last_unstale":"2024-04-26T11:31:16.406836+0000","last_undegraded":"2024-04-26T11:31:16.406836+0000","last_fullsized":"2024-04-26T11:31:16.406836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:07.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"94'65","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:19.569994+0000","last_change":"2024-04-26T11:27:08.048352+0000","last_active":"2024-04-26T11:31:19.569994+0000","last_peered":"2024-04-26T11:31:19.569994+0000","last_clean":"2024-04-26T11:31:19.569994+0000","last_became_active":"2024-04-26T11:27:08.048056+0000","last_became_peered":"2024-04-26T11:27:08.048056+0000","last_unstale":"2024-04-26T11:31:19.569994+0000","last_undegraded":"2024-04-26T11:31:19.569994+0000","last_fullsized":"2024-04-26T11:31:19.569994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:35.363779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406674+0000","last_change":"2024-04-26T11:27:12.108244+0000","last_active":"2024-04-26T11:31:16.406674+0000","last_peered":"2024-04-26T11:31:16.406674+0000","last_clean":"2024-04-26T11:31:16.406674+0000","last_became_active":"2024-04-26T11:27:12.107592+0000","last_became_peered":"2024-04-26T11:27:12.107592+0000","last_unstale":"2024-04-26T11:31:16.406674+0000","last_undegraded":"2024-04-26T11:31:16.406674+0000","last_fullsized":"2024-04-26T11:31:16.406674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:55.985873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.112034+0000","last_change":"2024-04-26T11:28:03.462136+0000","last_active":"2024-04-26T11:31:16.112034+0000","last_peered":"2024-04-26T11:31:16.112034+0000","last_clean":"2024-04-26T11:31:16.112034+0000","last_became_active":"2024-04-26T11:28:03.449130+0000","last_became_peered":"2024-04-26T11:28:03.449130+0000","last_unstale":"2024-04-26T11:31:16.112034+0000","last_undegraded":"2024-04-26T11:31:16.112034+0000","last_fullsized":"2024-04-26T11:31:16.112034+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:33.181328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406912+0000","last_change":"2024-04-26T11:27:12.090627+0000","last_active":"2024-04-26T11:31:16.406912+0000","last_peered":"2024-04-26T11:31:16.406912+0000","last_clean":"2024-04-26T11:31:16.406912+0000","last_became_active":"2024-04-26T11:27:12.089981+0000","last_became_peered":"2024-04-26T11:27:12.089981+0000","last_unstale":"2024-04-26T11:31:16.406912+0000","last_undegraded":"2024-04-26T11:31:16.406912+0000","last_fullsized":"2024-04-26T11:31:16.406912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432427+0000","last_change":"2024-04-26T11:27:12.089335+0000","last_active":"2024-04-26T11:31:16.432427+0000","last_peered":"2024-04-26T11:31:16.432427+0000","last_clean":"2024-04-26T11:31:16.432427+0000","last_became_active":"2024-04-26T11:27:12.089019+0000","last_became_peered":"2024-04-26T11:27:12.089019+0000","last_unstale":"2024-04-26T11:31:16.432427+0000","last_undegraded":"2024-04-26T11:31:16.432427+0000","last_fullsized":"2024-04-26T11:31:16.432427+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:18.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":46,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083620+0000","last_change":"2024-04-26T11:28:03.435483+0000","last_active":"2024-04-26T11:31:16.083620+0000","last_peered":"2024-04-26T11:31:16.083620+0000","last_clean":"2024-04-26T11:31:16.083620+0000","last_became_active":"2024-04-26T11:28:03.435088+0000","last_became_peered":"2024-04-26T11:28:03.435088+0000","last_unstale":"2024-04-26T11:31:16.083620+0000","last_undegraded":"2024-04-26T11:31:16.083620+0000","last_fullsized":"2024-04-26T11:31:16.083620+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.453906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083447+0000","last_change":"2024-04-26T11:27:12.112344+0000","last_active":"2024-04-26T11:31:16.083447+0000","last_peered":"2024-04-26T11:31:16.083447+0000","last_clean":"2024-04-26T11:31:16.083447+0000","last_became_active":"2024-04-26T11:27:12.112083+0000","last_became_peered":"2024-04-26T11:27:12.112083+0000","last_unstale":"2024-04-26T11:31:16.083447+0000","last_undegraded":"2024-04-26T11:31:16.083447+0000","last_fullsized":"2024-04-26T11:31:16.083447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406646+0000","last_change":"2024-04-26T11:27:12.115707+0000","last_active":"2024-04-26T11:31:16.406646+0000","last_peered":"2024-04-26T11:31:16.406646+0000","last_clean":"2024-04-26T11:31:16.406646+0000","last_became_active":"2024-04-26T11:27:12.115192+0000","last_became_peered":"2024-04-26T11:27:12.115192+0000","last_unstale":"2024-04-26T11:31:16.406646+0000","last_undegraded":"2024-04-26T11:31:16.406646+0000","last_fullsized":"2024-04-26T11:31:16.406646+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:55.475825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111343+0000","last_change":"2024-04-26T11:27:12.108771+0000","last_active":"2024-04-26T11:31:16.111343+0000","last_peered":"2024-04-26T11:31:16.111343+0000","last_clean":"2024-04-26T11:31:16.111343+0000","last_became_active":"2024-04-26T11:27:12.102910+0000","last_became_peered":"2024-04-26T11:27:12.102910+0000","last_unstale":"2024-04-26T11:31:16.111343+0000","last_undegraded":"2024-04-26T11:31:16.111343+0000","last_fullsized":"2024-04-26T11:31:16.111343+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:23.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432517+0000","last_change":"2024-04-26T11:27:12.091226+0000","last_active":"2024-04-26T11:31:16.432517+0000","last_peered":"2024-04-26T11:31:16.432517+0000","last_clean":"2024-04-26T11:31:16.432517+0000","last_became_active":"2024-04-26T11:27:12.090926+0000","last_became_peered":"2024-04-26T11:27:12.090926+0000","last_unstale":"2024-04-26T11:31:16.432517+0000","last_undegraded":"2024-04-26T11:31:16.432517+0000","last_fullsized":"2024-04-26T11:31:16.432517+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:43.005527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083947+0000","last_change":"2024-04-26T11:27:12.091297+0000","last_active":"2024-04-26T11:31:16.083947+0000","last_peered":"2024-04-26T11:31:16.083947+0000","last_clean":"2024-04-26T11:31:16.083947+0000","last_became_active":"2024-04-26T11:27:12.090946+0000","last_became_peered":"2024-04-26T11:27:12.090946+0000","last_unstale":"2024-04-26T11:31:16.083947+0000","last_undegraded":"2024-04-26T11:31:16.083947+0000","last_fullsized":"2024-04-26T11:31:16.083947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:06.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082446+0000","last_change":"2024-04-26T11:28:03.445596+0000","last_active":"2024-04-26T11:31:16.082446+0000","last_peered":"2024-04-26T11:31:16.082446+0000","last_clean":"2024-04-26T11:31:16.082446+0000","last_became_active":"2024-04-26T11:28:03.443717+0000","last_became_peered":"2024-04-26T11:28:03.443717+0000","last_unstale":"2024-04-26T11:31:16.082446+0000","last_undegraded":"2024-04-26T11:31:16.082446+0000","last_fullsized":"2024-04-26T11:31:16.082446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:44.905902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101560+0000","last_change":"2024-04-26T11:27:12.107987+0000","last_active":"2024-04-26T11:31:16.101560+0000","last_peered":"2024-04-26T11:31:16.101560+0000","last_clean":"2024-04-26T11:31:16.101560+0000","last_became_active":"2024-04-26T11:27:12.107668+0000","last_became_peered":"2024-04-26T11:27:12.107668+0000","last_unstale":"2024-04-26T11:31:16.101560+0000","last_undegraded":"2024-04-26T11:31:16.101560+0000","last_fullsized":"2024-04-26T11:31:16.101560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:06.448570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.081973+0000","last_change":"2024-04-26T11:27:12.105596+0000","last_active":"2024-04-26T11:31:16.081973+0000","last_peered":"2024-04-26T11:31:16.081973+0000","last_clean":"2024-04-26T11:31:16.081973+0000","last_became_active":"2024-04-26T11:27:12.104996+0000","last_became_peered":"2024-04-26T11:27:12.104996+0000","last_unstale":"2024-04-26T11:31:16.081973+0000","last_undegraded":"2024-04-26T11:31:16.081973+0000","last_fullsized":"2024-04-26T11:31:16.081973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:11.947364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406052+0000","last_change":"2024-04-26T11:27:12.116095+0000","last_active":"2024-04-26T11:31:16.406052+0000","last_peered":"2024-04-26T11:31:16.406052+0000","last_clean":"2024-04-26T11:31:16.406052+0000","last_became_active":"2024-04-26T11:27:12.115726+0000","last_became_peered":"2024-04-26T11:27:12.115726+0000","last_unstale":"2024-04-26T11:31:16.406052+0000","last_undegraded":"2024-04-26T11:31:16.406052+0000","last_fullsized":"2024-04-26T11:31:16.406052+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:45.056829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111194+0000","last_change":"2024-04-26T11:27:12.115016+0000","last_active":"2024-04-26T11:31:16.111194+0000","last_peered":"2024-04-26T11:31:16.111194+0000","last_clean":"2024-04-26T11:31:16.111194+0000","last_became_active":"2024-04-26T11:27:12.114671+0000","last_became_peered":"2024-04-26T11:27:12.114671+0000","last_unstale":"2024-04-26T11:31:16.111194+0000","last_undegraded":"2024-04-26T11:31:16.111194+0000","last_fullsized":"2024-04-26T11:31:16.111194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:11.393056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432521+0000","last_change":"2024-04-26T11:27:12.097130+0000","last_active":"2024-04-26T11:31:16.432521+0000","last_peered":"2024-04-26T11:31:16.432521+0000","last_clean":"2024-04-26T11:31:16.432521+0000","last_became_active":"2024-04-26T11:27:12.096809+0000","last_became_peered":"2024-04-26T11:27:12.096809+0000","last_unstale":"2024-04-26T11:31:16.432521+0000","last_undegraded":"2024-04-26T11:31:16.432521+0000","last_fullsized":"2024-04-26T11:31:16.432521+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:31.198452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108489,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794445,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1707,"num_read_kb":1079,"num_write":420,"num_write_kb":2352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1316,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":651264,"data_stored":2383335,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351041,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":510155,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612679,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32384,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712768,"statfs":{"total":95995035648,"available":95961874432,"internally_reserved":0,"allocated":1228800,"data_stored":1498633,"data_compressed":65869,"data_compressed_allocated":86016,"data_compressed_original":937984,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":902985,"data_compressed":33793,"data_compressed_allocated":45056,"data_compressed_original":434176,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037843,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":902323,"data_compressed":33793,"data_compressed_allocated":45056,"data_compressed_original":434176,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299480,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1089536,"data_stored":1102542,"data_compressed":50667,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863463007,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":509158,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712896,"statfs":{"total":95995035648,"available":95962005504,"internally_reserved":0,"allocated":1101824,"data_stored":577606,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738495,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":510429,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1114112,"data_stored":578262,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149806,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1230917,"data_compressed":48995,"data_compressed_allocated":65536,"data_compressed_original":741376,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888170,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1040384,"data_stored":511021,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724645,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1138688,"data_stored":1428522,"data_compressed":65869,"data_compressed_allocated":86016,"data_compressed_original":937984,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":721732,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":329086,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":399197,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:31:28.107 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T11:31:28.107 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T11:31:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:27 smithi193 ceph-mon[32782]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 59 op/s 2024-04-26T11:31:28.544 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:28 smithi196 ceph-mon[32572]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:31:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:28 smithi110 ceph-mon[28069]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:31:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:28 smithi193 ceph-mon[32782]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:31:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:29 smithi196 ceph-mon[32572]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-04-26T11:31:30.028 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:29 smithi110 ceph-mon[28069]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-04-26T11:31:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:29 smithi193 ceph-mon[32782]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-04-26T11:31:30.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.889+0000 7fa798c00700 1 -- 172.21.15.110:0/2298291410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa79410fe80 msgr2=0x7fa794112270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:30.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.889+0000 7fa798c00700 1 --2- 172.21.15.110:0/2298291410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa79410fe80 0x7fa794112270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00b0a0 tx=0x7fa78c00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:31:30.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.889+0000 7fa798c00700 1 -- 172.21.15.110:0/2298291410 shutdown_connections 2024-04-26T11:31:30.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.889+0000 7fa798c00700 1 --2- 172.21.15.110:0/2298291410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa79410fe80 0x7fa794112270 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:30.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.889+0000 7fa798c00700 1 --2- 172.21.15.110:0/2298291410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794075650 0x7fa794075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:30.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.889+0000 7fa798c00700 1 --2- 172.21.15.110:0/2298291410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa794075f70 0x7fa79410f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:30.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.889+0000 7fa798c00700 1 -- 172.21.15.110:0/2298291410 >> 172.21.15.110:0/2298291410 conn(0x7fa79407a580 msgr2=0x7fa79407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:30.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.889+0000 7fa798c00700 1 -- 172.21.15.110:0/2298291410 shutdown_connections 2024-04-26T11:31:30.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.889+0000 7fa798c00700 1 -- 172.21.15.110:0/2298291410 wait complete. 2024-04-26T11:31:30.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.890+0000 7fa798c00700 1 Processor -- start 2024-04-26T11:31:30.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa798c00700 1 -- start start 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa798c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794075650 0x7fa79419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa798c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa794075f70 0x7fa79419c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa798c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa79410fe80 0x7fa7941a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa798c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa794115880 con 0x7fa79410fe80 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa798c00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa794115700 con 0x7fa794075f70 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa798c00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa794115a00 con 0x7fa794075650 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa78be00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa794075f70 0x7fa79419c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa791e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794075650 0x7fa79419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa78be00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa794075f70 0x7fa79419c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38626/0 (socket says 172.21.15.110:38626) 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa78be00700 1 -- 172.21.15.110:0/1169194237 learned_addr learned my addr 172.21.15.110:0/1169194237 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:30.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.891+0000 7fa792800700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa79410fe80 0x7fa7941a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:30.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.892+0000 7fa78be00700 1 -- 172.21.15.110:0/1169194237 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794075650 msgr2=0x7fa79419bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:30.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.892+0000 7fa78be00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794075650 0x7fa79419bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:30.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.892+0000 7fa78be00700 1 -- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa79410fe80 msgr2=0x7fa7941a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:30.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.892+0000 7fa78be00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa79410fe80 0x7fa7941a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:30.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.892+0000 7fa78be00700 1 -- 172.21.15.110:0/1169194237 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7941a0dc0 con 0x7fa794075f70 2024-04-26T11:31:30.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.892+0000 7fa791e00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794075650 0x7fa79419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:30.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.892+0000 7fa78be00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa794075f70 0x7fa79419c2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00d980 tx=0x7fa77c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:30.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.892+0000 7fa78aa00700 1 -- 172.21.15.110:0/1169194237 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c016070 con 0x7fa794075f70 2024-04-26T11:31:30.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.893+0000 7fa78aa00700 1 -- 172.21.15.110:0/1169194237 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa77c00fd40 con 0x7fa794075f70 2024-04-26T11:31:30.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.893+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7941a10b0 con 0x7fa794075f70 2024-04-26T11:31:30.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.893+0000 7fa78aa00700 1 -- 172.21.15.110:0/1169194237 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c019360 con 0x7fa794075f70 2024-04-26T11:31:30.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.893+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7941a8930 con 0x7fa794075f70 2024-04-26T11:31:30.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.894+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79406a110 con 0x7fa794075f70 2024-04-26T11:31:30.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.896+0000 7fa78aa00700 1 -- 172.21.15.110:0/1169194237 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7fa77c019070 con 0x7fa794075f70 2024-04-26T11:31:30.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.898+0000 7fa78aa00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa7780a3ec0 0x7fa7780a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:30.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.898+0000 7fa78aa00700 1 -- 172.21.15.110:0/1169194237 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fa77c0cfff0 con 0x7fa794075f70 2024-04-26T11:31:30.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.898+0000 7fa791e00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa7780a3ec0 0x7fa7780a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:30.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.899+0000 7fa791e00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa7780a3ec0 0x7fa7780a6380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa7840104e0 tx=0x7fa78400b3c0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:30.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:30.902+0000 7fa78aa00700 1 -- 172.21.15.110:0/1169194237 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa77c09c480 con 0x7fa794075f70 2024-04-26T11:31:31.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.127+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 --> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa794063860 con 0x7fa7780a3ec0 2024-04-26T11:31:31.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.145+0000 7fa78aa00700 1 -- 172.21.15.110:0/1169194237 <== mgr.25028 v2:172.21.15.110:6800/2061324969 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258075 (secure 0 0 0) 0x7fa794063860 con 0x7fa7780a3ec0 2024-04-26T11:31:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:31:31.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.150+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa7780a3ec0 msgr2=0x7fa7780a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:31.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.150+0000 7fa798c00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa7780a3ec0 0x7fa7780a6380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa7840104e0 tx=0x7fa78400b3c0 comp rx=0 tx=0).stop 2024-04-26T11:31:31.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.150+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa794075f70 msgr2=0x7fa79419c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:31.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.150+0000 7fa798c00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa794075f70 0x7fa79419c2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00d980 tx=0x7fa77c00dc90 comp rx=0 tx=0).stop 2024-04-26T11:31:31.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.151+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 shutdown_connections 2024-04-26T11:31:31.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.151+0000 7fa798c00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa7780a3ec0 0x7fa7780a6380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:31.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.151+0000 7fa798c00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa79410fe80 0x7fa7941a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:31.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.151+0000 7fa798c00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa794075650 0x7fa79419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:31.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.151+0000 7fa798c00700 1 --2- 172.21.15.110:0/1169194237 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa794075f70 0x7fa79419c2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:31.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.151+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 >> 172.21.15.110:0/1169194237 conn(0x7fa79407a580 msgr2=0x7fa794101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:31.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.151+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 shutdown_connections 2024-04-26T11:31:31.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:31.151+0000 7fa798c00700 1 -- 172.21.15.110:0/1169194237 wait complete. 2024-04-26T11:31:31.155 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-04-26T11:31:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:31 smithi110 ceph-mon[28069]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T11:31:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:31 smithi196 ceph-mon[32572]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T11:31:32.077 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-04-26T11:31:30.109244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1385047,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1974,"num_read_kb":1424,"num_write":623,"num_write_kb":5292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1182052,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":958,"ondisk_log_size":958,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370280,"kb_used_data":12756,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571544,"statfs":{"total":1151940427776,"available":1151561261056,"internally_reserved":0,"allocated":13062144,"data_stored":10262553,"data_compressed":386010,"data_compressed_allocated":516096,"data_compressed_original":4362240,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":471,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004923"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432757+0000","last_change":"2024-04-26T11:27:12.099635+0000","last_active":"2024-04-26T11:31:16.432757+0000","last_peered":"2024-04-26T11:31:16.432757+0000","last_clean":"2024-04-26T11:31:16.432757+0000","last_became_active":"2024-04-26T11:27:12.099342+0000","last_became_peered":"2024-04-26T11:27:12.099342+0000","last_unstale":"2024-04-26T11:31:16.432757+0000","last_undegraded":"2024-04-26T11:31:16.432757+0000","last_fullsized":"2024-04-26T11:31:16.432757+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:36.433968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407080+0000","last_change":"2024-04-26T11:27:12.090804+0000","last_active":"2024-04-26T11:31:16.407080+0000","last_peered":"2024-04-26T11:31:16.407080+0000","last_clean":"2024-04-26T11:31:16.407080+0000","last_became_active":"2024-04-26T11:27:12.089662+0000","last_became_peered":"2024-04-26T11:27:12.089662+0000","last_unstale":"2024-04-26T11:31:16.407080+0000","last_undegraded":"2024-04-26T11:31:16.407080+0000","last_fullsized":"2024-04-26T11:31:16.407080+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:38.776482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406861+0000","last_change":"2024-04-26T11:27:12.094739+0000","last_active":"2024-04-26T11:31:16.406861+0000","last_peered":"2024-04-26T11:31:16.406861+0000","last_clean":"2024-04-26T11:31:16.406861+0000","last_became_active":"2024-04-26T11:27:12.094410+0000","last_became_peered":"2024-04-26T11:27:12.094410+0000","last_unstale":"2024-04-26T11:31:16.406861+0000","last_undegraded":"2024-04-26T11:31:16.406861+0000","last_fullsized":"2024-04-26T11:31:16.406861+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:17.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224063+0000","last_change":"2024-04-26T11:28:03.446873+0000","last_active":"2024-04-26T11:31:16.224063+0000","last_peered":"2024-04-26T11:31:16.224063+0000","last_clean":"2024-04-26T11:31:16.224063+0000","last_became_active":"2024-04-26T11:28:03.445335+0000","last_became_peered":"2024-04-26T11:28:03.445335+0000","last_unstale":"2024-04-26T11:31:16.224063+0000","last_undegraded":"2024-04-26T11:31:16.224063+0000","last_fullsized":"2024-04-26T11:31:16.224063+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:59.892678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226479+0000","last_change":"2024-04-26T11:27:12.114071+0000","last_active":"2024-04-26T11:31:16.226479+0000","last_peered":"2024-04-26T11:31:16.226479+0000","last_clean":"2024-04-26T11:31:16.226479+0000","last_became_active":"2024-04-26T11:27:12.113795+0000","last_became_peered":"2024-04-26T11:27:12.113795+0000","last_unstale":"2024-04-26T11:31:16.226479+0000","last_undegraded":"2024-04-26T11:31:16.226479+0000","last_fullsized":"2024-04-26T11:31:16.226479+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:34.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083760+0000","last_change":"2024-04-26T11:27:12.108449+0000","last_active":"2024-04-26T11:31:16.083760+0000","last_peered":"2024-04-26T11:31:16.083760+0000","last_clean":"2024-04-26T11:31:16.083760+0000","last_became_active":"2024-04-26T11:27:12.108071+0000","last_became_peered":"2024-04-26T11:27:12.108071+0000","last_unstale":"2024-04-26T11:31:16.083760+0000","last_undegraded":"2024-04-26T11:31:16.083760+0000","last_fullsized":"2024-04-26T11:31:16.083760+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:04.001728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405659+0000","last_change":"2024-04-26T11:29:03.603681+0000","last_active":"2024-04-26T11:31:16.405659+0000","last_peered":"2024-04-26T11:31:16.405659+0000","last_clean":"2024-04-26T11:31:16.405659+0000","last_became_active":"2024-04-26T11:29:03.603180+0000","last_became_peered":"2024-04-26T11:29:03.603180+0000","last_unstale":"2024-04-26T11:31:16.405659+0000","last_undegraded":"2024-04-26T11:31:16.405659+0000","last_fullsized":"2024-04-26T11:31:16.405659+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:16.602090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.081996+0000","last_change":"2024-04-26T11:27:12.111215+0000","last_active":"2024-04-26T11:31:16.081996+0000","last_peered":"2024-04-26T11:31:16.081996+0000","last_clean":"2024-04-26T11:31:16.081996+0000","last_became_active":"2024-04-26T11:27:12.110896+0000","last_became_peered":"2024-04-26T11:27:12.110896+0000","last_unstale":"2024-04-26T11:31:16.081996+0000","last_undegraded":"2024-04-26T11:31:16.081996+0000","last_fullsized":"2024-04-26T11:31:16.081996+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:17.469534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406380+0000","last_change":"2024-04-26T11:27:12.091871+0000","last_active":"2024-04-26T11:31:16.406380+0000","last_peered":"2024-04-26T11:31:16.406380+0000","last_clean":"2024-04-26T11:31:16.406380+0000","last_became_active":"2024-04-26T11:27:12.091239+0000","last_became_peered":"2024-04-26T11:27:12.091239+0000","last_unstale":"2024-04-26T11:31:16.406380+0000","last_undegraded":"2024-04-26T11:31:16.406380+0000","last_fullsized":"2024-04-26T11:31:16.406380+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:30.526152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":43,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.085135+0000","last_change":"2024-04-26T11:27:12.093411+0000","last_active":"2024-04-26T11:31:16.085135+0000","last_peered":"2024-04-26T11:31:16.085135+0000","last_clean":"2024-04-26T11:31:16.085135+0000","last_became_active":"2024-04-26T11:27:12.093086+0000","last_became_peered":"2024-04-26T11:27:12.093086+0000","last_unstale":"2024-04-26T11:31:16.085135+0000","last_undegraded":"2024-04-26T11:31:16.085135+0000","last_fullsized":"2024-04-26T11:31:16.085135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:56.070825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406714+0000","last_change":"2024-04-26T11:27:12.093317+0000","last_active":"2024-04-26T11:31:16.406714+0000","last_peered":"2024-04-26T11:31:16.406714+0000","last_clean":"2024-04-26T11:31:16.406714+0000","last_became_active":"2024-04-26T11:27:12.092595+0000","last_became_peered":"2024-04-26T11:27:12.092595+0000","last_unstale":"2024-04-26T11:31:16.406714+0000","last_undegraded":"2024-04-26T11:31:16.406714+0000","last_fullsized":"2024-04-26T11:31:16.406714+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:54.702218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.114213+0000","last_change":"2024-04-26T11:27:12.093118+0000","last_active":"2024-04-26T11:31:16.114213+0000","last_peered":"2024-04-26T11:31:16.114213+0000","last_clean":"2024-04-26T11:31:16.114213+0000","last_became_active":"2024-04-26T11:27:12.091482+0000","last_became_peered":"2024-04-26T11:27:12.091482+0000","last_unstale":"2024-04-26T11:31:16.114213+0000","last_undegraded":"2024-04-26T11:31:16.114213+0000","last_fullsized":"2024-04-26T11:31:16.114213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:23.426213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111084+0000","last_change":"2024-04-26T11:27:12.114213+0000","last_active":"2024-04-26T11:31:16.111084+0000","last_peered":"2024-04-26T11:31:16.111084+0000","last_clean":"2024-04-26T11:31:16.111084+0000","last_became_active":"2024-04-26T11:27:12.113867+0000","last_became_peered":"2024-04-26T11:27:12.113867+0000","last_unstale":"2024-04-26T11:31:16.111084+0000","last_undegraded":"2024-04-26T11:31:16.111084+0000","last_fullsized":"2024-04-26T11:31:16.111084+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:59.258645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406640+0000","last_change":"2024-04-26T11:27:12.084301+0000","last_active":"2024-04-26T11:31:16.406640+0000","last_peered":"2024-04-26T11:31:16.406640+0000","last_clean":"2024-04-26T11:31:16.406640+0000","last_became_active":"2024-04-26T11:27:12.083808+0000","last_became_peered":"2024-04-26T11:27:12.083808+0000","last_unstale":"2024-04-26T11:31:16.406640+0000","last_undegraded":"2024-04-26T11:31:16.406640+0000","last_fullsized":"2024-04-26T11:31:16.406640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:46.107583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406475+0000","last_change":"2024-04-26T11:27:12.089647+0000","last_active":"2024-04-26T11:31:16.406475+0000","last_peered":"2024-04-26T11:31:16.406475+0000","last_clean":"2024-04-26T11:31:16.406475+0000","last_became_active":"2024-04-26T11:27:12.088081+0000","last_became_peered":"2024-04-26T11:27:12.088081+0000","last_unstale":"2024-04-26T11:31:16.406475+0000","last_undegraded":"2024-04-26T11:31:16.406475+0000","last_fullsized":"2024-04-26T11:31:16.406475+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:43.423430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405624+0000","last_change":"2024-04-26T11:27:12.098138+0000","last_active":"2024-04-26T11:31:16.405624+0000","last_peered":"2024-04-26T11:31:16.405624+0000","last_clean":"2024-04-26T11:31:16.405624+0000","last_became_active":"2024-04-26T11:27:12.097756+0000","last_became_peered":"2024-04-26T11:27:12.097756+0000","last_unstale":"2024-04-26T11:31:16.405624+0000","last_undegraded":"2024-04-26T11:31:16.405624+0000","last_fullsized":"2024-04-26T11:31:16.405624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:21.155370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432793+0000","last_change":"2024-04-26T11:27:12.099925+0000","last_active":"2024-04-26T11:31:16.432793+0000","last_peered":"2024-04-26T11:31:16.432793+0000","last_clean":"2024-04-26T11:31:16.432793+0000","last_became_active":"2024-04-26T11:27:12.099600+0000","last_became_peered":"2024-04-26T11:27:12.099600+0000","last_unstale":"2024-04-26T11:31:16.432793+0000","last_undegraded":"2024-04-26T11:31:16.432793+0000","last_fullsized":"2024-04-26T11:31:16.432793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:23.704624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224238+0000","last_change":"2024-04-26T11:27:12.104697+0000","last_active":"2024-04-26T11:31:16.224238+0000","last_peered":"2024-04-26T11:31:16.224238+0000","last_clean":"2024-04-26T11:31:16.224238+0000","last_became_active":"2024-04-26T11:27:12.103963+0000","last_became_peered":"2024-04-26T11:27:12.103963+0000","last_unstale":"2024-04-26T11:31:16.224238+0000","last_undegraded":"2024-04-26T11:31:16.224238+0000","last_fullsized":"2024-04-26T11:31:16.224238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:58.202895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083872+0000","last_change":"2024-04-26T11:29:03.603898+0000","last_active":"2024-04-26T11:31:16.083872+0000","last_peered":"2024-04-26T11:31:16.083872+0000","last_clean":"2024-04-26T11:31:16.083872+0000","last_became_active":"2024-04-26T11:29:03.603488+0000","last_became_peered":"2024-04-26T11:29:03.603488+0000","last_unstale":"2024-04-26T11:31:16.083872+0000","last_undegraded":"2024-04-26T11:31:16.083872+0000","last_fullsized":"2024-04-26T11:31:16.083872+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:04.137277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'9","reported_seq":60,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224061+0000","last_change":"2024-04-26T11:28:03.456017+0000","last_active":"2024-04-26T11:31:16.224061+0000","last_peered":"2024-04-26T11:31:16.224061+0000","last_clean":"2024-04-26T11:31:16.224061+0000","last_became_active":"2024-04-26T11:28:03.447016+0000","last_became_peered":"2024-04-26T11:28:03.447016+0000","last_unstale":"2024-04-26T11:31:16.224061+0000","last_undegraded":"2024-04-26T11:31:16.224061+0000","last_fullsized":"2024-04-26T11:31:16.224061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.616546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082449+0000","last_change":"2024-04-26T11:27:12.112635+0000","last_active":"2024-04-26T11:31:16.082449+0000","last_peered":"2024-04-26T11:31:16.082449+0000","last_clean":"2024-04-26T11:31:16.082449+0000","last_became_active":"2024-04-26T11:27:12.112282+0000","last_became_peered":"2024-04-26T11:27:12.112282+0000","last_unstale":"2024-04-26T11:31:16.082449+0000","last_undegraded":"2024-04-26T11:31:16.082449+0000","last_fullsized":"2024-04-26T11:31:16.082449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:21.482922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082668+0000","last_change":"2024-04-26T11:27:08.473301+0000","last_active":"2024-04-26T11:31:16.082668+0000","last_peered":"2024-04-26T11:31:16.082668+0000","last_clean":"2024-04-26T11:31:16.082668+0000","last_became_active":"2024-04-26T11:27:08.472769+0000","last_became_peered":"2024-04-26T11:27:08.472769+0000","last_unstale":"2024-04-26T11:31:16.082668+0000","last_undegraded":"2024-04-26T11:31:16.082668+0000","last_fullsized":"2024-04-26T11:31:16.082668+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:49.108849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407062+0000","last_change":"2024-04-26T11:27:12.109725+0000","last_active":"2024-04-26T11:31:16.407062+0000","last_peered":"2024-04-26T11:31:16.407062+0000","last_clean":"2024-04-26T11:31:16.407062+0000","last_became_active":"2024-04-26T11:27:12.109376+0000","last_became_peered":"2024-04-26T11:27:12.109376+0000","last_unstale":"2024-04-26T11:31:16.407062+0000","last_undegraded":"2024-04-26T11:31:16.407062+0000","last_fullsized":"2024-04-26T11:31:16.407062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.977804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":49,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226741+0000","last_change":"2024-04-26T11:28:03.464520+0000","last_active":"2024-04-26T11:31:16.226741+0000","last_peered":"2024-04-26T11:31:16.226741+0000","last_clean":"2024-04-26T11:31:16.226741+0000","last_became_active":"2024-04-26T11:28:03.449993+0000","last_became_peered":"2024-04-26T11:28:03.449993+0000","last_unstale":"2024-04-26T11:31:16.226741+0000","last_undegraded":"2024-04-26T11:31:16.226741+0000","last_fullsized":"2024-04-26T11:31:16.226741+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:01.465563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405839+0000","last_change":"2024-04-26T11:27:12.100830+0000","last_active":"2024-04-26T11:31:16.405839+0000","last_peered":"2024-04-26T11:31:16.405839+0000","last_clean":"2024-04-26T11:31:16.405839+0000","last_became_active":"2024-04-26T11:27:12.100474+0000","last_became_peered":"2024-04-26T11:27:12.100474+0000","last_unstale":"2024-04-26T11:31:16.405839+0000","last_undegraded":"2024-04-26T11:31:16.405839+0000","last_fullsized":"2024-04-26T11:31:16.405839+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:18.778897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":22,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432390+0000","last_change":"2024-04-26T11:28:03.444580+0000","last_active":"2024-04-26T11:31:16.432390+0000","last_peered":"2024-04-26T11:31:16.432390+0000","last_clean":"2024-04-26T11:31:16.432390+0000","last_became_active":"2024-04-26T11:28:03.435056+0000","last_became_peered":"2024-04-26T11:28:03.435056+0000","last_unstale":"2024-04-26T11:31:16.432390+0000","last_undegraded":"2024-04-26T11:31:16.432390+0000","last_fullsized":"2024-04-26T11:31:16.432390+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:42.640914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101514+0000","last_change":"2024-04-26T11:27:12.093472+0000","last_active":"2024-04-26T11:31:16.101514+0000","last_peered":"2024-04-26T11:31:16.101514+0000","last_clean":"2024-04-26T11:31:16.101514+0000","last_became_active":"2024-04-26T11:27:12.093110+0000","last_became_peered":"2024-04-26T11:27:12.093110+0000","last_unstale":"2024-04-26T11:31:16.101514+0000","last_undegraded":"2024-04-26T11:31:16.101514+0000","last_fullsized":"2024-04-26T11:31:16.101514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:19.256670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:25.711785+0000","last_change":"2024-04-26T11:28:03.440961+0000","last_active":"2024-04-26T11:31:25.711785+0000","last_peered":"2024-04-26T11:31:25.711785+0000","last_clean":"2024-04-26T11:31:25.711785+0000","last_became_active":"2024-04-26T11:28:03.434607+0000","last_became_peered":"2024-04-26T11:28:03.434607+0000","last_unstale":"2024-04-26T11:31:25.711785+0000","last_undegraded":"2024-04-26T11:31:25.711785+0000","last_fullsized":"2024-04-26T11:31:25.711785+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:37.122557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":204,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226334+0000","last_change":"2024-04-26T11:28:03.447662+0000","last_active":"2024-04-26T11:31:16.226334+0000","last_peered":"2024-04-26T11:31:16.226334+0000","last_clean":"2024-04-26T11:31:16.226334+0000","last_became_active":"2024-04-26T11:28:03.447333+0000","last_became_peered":"2024-04-26T11:28:03.447333+0000","last_unstale":"2024-04-26T11:31:16.226334+0000","last_undegraded":"2024-04-26T11:31:16.226334+0000","last_fullsized":"2024-04-26T11:31:16.226334+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:37.600940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083710+0000","last_change":"2024-04-26T11:27:08.028424+0000","last_active":"2024-04-26T11:31:16.083710+0000","last_peered":"2024-04-26T11:31:16.083710+0000","last_clean":"2024-04-26T11:31:16.083710+0000","last_became_active":"2024-04-26T11:27:08.028134+0000","last_became_peered":"2024-04-26T11:27:08.028134+0000","last_unstale":"2024-04-26T11:31:16.083710+0000","last_undegraded":"2024-04-26T11:31:16.083710+0000","last_fullsized":"2024-04-26T11:31:16.083710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:44.636288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101385+0000","last_change":"2024-04-26T11:27:12.108078+0000","last_active":"2024-04-26T11:31:16.101385+0000","last_peered":"2024-04-26T11:31:16.101385+0000","last_clean":"2024-04-26T11:31:16.101385+0000","last_became_active":"2024-04-26T11:27:12.107713+0000","last_became_peered":"2024-04-26T11:27:12.107713+0000","last_unstale":"2024-04-26T11:31:16.101385+0000","last_undegraded":"2024-04-26T11:31:16.101385+0000","last_fullsized":"2024-04-26T11:31:16.101385+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:59.995679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111197+0000","last_change":"2024-04-26T11:27:08.049134+0000","last_active":"2024-04-26T11:31:16.111197+0000","last_peered":"2024-04-26T11:31:16.111197+0000","last_clean":"2024-04-26T11:31:16.111197+0000","last_became_active":"2024-04-26T11:27:08.047862+0000","last_became_peered":"2024-04-26T11:27:08.047862+0000","last_unstale":"2024-04-26T11:31:16.111197+0000","last_undegraded":"2024-04-26T11:31:16.111197+0000","last_fullsized":"2024-04-26T11:31:16.111197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:55.294021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082204+0000","last_change":"2024-04-26T11:27:12.117417+0000","last_active":"2024-04-26T11:31:16.082204+0000","last_peered":"2024-04-26T11:31:16.082204+0000","last_clean":"2024-04-26T11:31:16.082204+0000","last_became_active":"2024-04-26T11:27:12.116643+0000","last_became_peered":"2024-04-26T11:27:12.116643+0000","last_unstale":"2024-04-26T11:31:16.082204+0000","last_undegraded":"2024-04-26T11:31:16.082204+0000","last_fullsized":"2024-04-26T11:31:16.082204+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:26.677738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101334+0000","last_change":"2024-04-26T11:27:08.037806+0000","last_active":"2024-04-26T11:31:16.101334+0000","last_peered":"2024-04-26T11:31:16.101334+0000","last_clean":"2024-04-26T11:31:16.101334+0000","last_became_active":"2024-04-26T11:27:08.037309+0000","last_became_peered":"2024-04-26T11:27:08.037309+0000","last_unstale":"2024-04-26T11:31:16.101334+0000","last_undegraded":"2024-04-26T11:31:16.101334+0000","last_fullsized":"2024-04-26T11:31:16.101334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.910219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.223722+0000","last_change":"2024-04-26T11:27:12.120986+0000","last_active":"2024-04-26T11:31:16.223722+0000","last_peered":"2024-04-26T11:31:16.223722+0000","last_clean":"2024-04-26T11:31:16.223722+0000","last_became_active":"2024-04-26T11:27:12.120580+0000","last_became_peered":"2024-04-26T11:27:12.120580+0000","last_unstale":"2024-04-26T11:31:16.223722+0000","last_undegraded":"2024-04-26T11:31:16.223722+0000","last_fullsized":"2024-04-26T11:31:16.223722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:00.996039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":267,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:25.711298+0000","last_change":"2024-04-26T11:27:08.048979+0000","last_active":"2024-04-26T11:31:25.711298+0000","last_peered":"2024-04-26T11:31:25.711298+0000","last_clean":"2024-04-26T11:31:25.711298+0000","last_became_active":"2024-04-26T11:27:08.048641+0000","last_became_peered":"2024-04-26T11:27:08.048641+0000","last_unstale":"2024-04-26T11:31:25.711298+0000","last_undegraded":"2024-04-26T11:31:25.711298+0000","last_fullsized":"2024-04-26T11:31:25.711298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:38.917651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":231,"num_read_kb":231,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406196+0000","last_change":"2024-04-26T11:27:12.104749+0000","last_active":"2024-04-26T11:31:16.406196+0000","last_peered":"2024-04-26T11:31:16.406196+0000","last_clean":"2024-04-26T11:31:16.406196+0000","last_became_active":"2024-04-26T11:27:12.104358+0000","last_became_peered":"2024-04-26T11:27:12.104358+0000","last_unstale":"2024-04-26T11:31:16.406196+0000","last_undegraded":"2024-04-26T11:31:16.406196+0000","last_fullsized":"2024-04-26T11:31:16.406196+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:47.364512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406712+0000","last_change":"2024-04-26T11:27:08.038165+0000","last_active":"2024-04-26T11:31:16.406712+0000","last_peered":"2024-04-26T11:31:16.406712+0000","last_clean":"2024-04-26T11:31:16.406712+0000","last_became_active":"2024-04-26T11:27:08.036930+0000","last_became_peered":"2024-04-26T11:27:08.036930+0000","last_unstale":"2024-04-26T11:31:16.406712+0000","last_undegraded":"2024-04-26T11:31:16.406712+0000","last_fullsized":"2024-04-26T11:31:16.406712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:10.050679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407006+0000","last_change":"2024-04-26T11:27:12.098702+0000","last_active":"2024-04-26T11:31:16.407006+0000","last_peered":"2024-04-26T11:31:16.407006+0000","last_clean":"2024-04-26T11:31:16.407006+0000","last_became_active":"2024-04-26T11:27:12.089241+0000","last_became_peered":"2024-04-26T11:27:12.089241+0000","last_unstale":"2024-04-26T11:31:16.407006+0000","last_undegraded":"2024-04-26T11:31:16.407006+0000","last_fullsized":"2024-04-26T11:31:16.407006+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.013054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101577+0000","last_change":"2024-04-26T11:27:08.473759+0000","last_active":"2024-04-26T11:31:16.101577+0000","last_peered":"2024-04-26T11:31:16.101577+0000","last_clean":"2024-04-26T11:31:16.101577+0000","last_became_active":"2024-04-26T11:27:08.473288+0000","last_became_peered":"2024-04-26T11:27:08.473288+0000","last_unstale":"2024-04-26T11:31:16.101577+0000","last_undegraded":"2024-04-26T11:31:16.101577+0000","last_fullsized":"2024-04-26T11:31:16.101577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:36.727119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405908+0000","last_change":"2024-04-26T11:27:12.096935+0000","last_active":"2024-04-26T11:31:16.405908+0000","last_peered":"2024-04-26T11:31:16.405908+0000","last_clean":"2024-04-26T11:31:16.405908+0000","last_became_active":"2024-04-26T11:27:12.096481+0000","last_became_peered":"2024-04-26T11:27:12.096481+0000","last_unstale":"2024-04-26T11:31:16.405908+0000","last_undegraded":"2024-04-26T11:31:16.405908+0000","last_fullsized":"2024-04-26T11:31:16.405908+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:58.855909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"94'37","reported_seq":544,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:26.712528+0000","last_change":"2024-04-26T11:27:08.037227+0000","last_active":"2024-04-26T11:31:26.712528+0000","last_peered":"2024-04-26T11:31:26.712528+0000","last_clean":"2024-04-26T11:31:26.712528+0000","last_became_active":"2024-04-26T11:27:08.036852+0000","last_became_peered":"2024-04-26T11:27:08.036852+0000","last_unstale":"2024-04-26T11:31:26.712528+0000","last_undegraded":"2024-04-26T11:31:26.712528+0000","last_fullsized":"2024-04-26T11:31:26.712528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:44.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68073,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":303,"num_write":38,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226514+0000","last_change":"2024-04-26T11:27:12.088586+0000","last_active":"2024-04-26T11:31:16.226514+0000","last_peered":"2024-04-26T11:31:16.226514+0000","last_clean":"2024-04-26T11:31:16.226514+0000","last_became_active":"2024-04-26T11:27:12.088264+0000","last_became_peered":"2024-04-26T11:27:12.088264+0000","last_unstale":"2024-04-26T11:31:16.226514+0000","last_undegraded":"2024-04-26T11:31:16.226514+0000","last_fullsized":"2024-04-26T11:31:16.226514+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:39.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083583+0000","last_change":"2024-04-26T11:27:08.049289+0000","last_active":"2024-04-26T11:31:16.083583+0000","last_peered":"2024-04-26T11:31:16.083583+0000","last_clean":"2024-04-26T11:31:16.083583+0000","last_became_active":"2024-04-26T11:27:08.048923+0000","last_became_peered":"2024-04-26T11:27:08.048923+0000","last_unstale":"2024-04-26T11:31:16.083583+0000","last_undegraded":"2024-04-26T11:31:16.083583+0000","last_fullsized":"2024-04-26T11:31:16.083583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:42.229383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111431+0000","last_change":"2024-04-26T11:27:12.118154+0000","last_active":"2024-04-26T11:31:16.111431+0000","last_peered":"2024-04-26T11:31:16.111431+0000","last_clean":"2024-04-26T11:31:16.111431+0000","last_became_active":"2024-04-26T11:27:12.117624+0000","last_became_peered":"2024-04-26T11:27:12.117624+0000","last_unstale":"2024-04-26T11:31:16.111431+0000","last_undegraded":"2024-04-26T11:31:16.111431+0000","last_fullsized":"2024-04-26T11:31:16.111431+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:57.947310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101393+0000","last_change":"2024-04-26T11:27:08.045870+0000","last_active":"2024-04-26T11:31:16.101393+0000","last_peered":"2024-04-26T11:31:16.101393+0000","last_clean":"2024-04-26T11:31:16.101393+0000","last_became_active":"2024-04-26T11:27:08.045461+0000","last_became_peered":"2024-04-26T11:27:08.045461+0000","last_unstale":"2024-04-26T11:31:16.101393+0000","last_undegraded":"2024-04-26T11:31:16.101393+0000","last_fullsized":"2024-04-26T11:31:16.101393+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:59.899805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406358+0000","last_change":"2024-04-26T11:27:12.116617+0000","last_active":"2024-04-26T11:31:16.406358+0000","last_peered":"2024-04-26T11:31:16.406358+0000","last_clean":"2024-04-26T11:31:16.406358+0000","last_became_active":"2024-04-26T11:27:12.115731+0000","last_became_peered":"2024-04-26T11:27:12.115731+0000","last_unstale":"2024-04-26T11:31:16.406358+0000","last_undegraded":"2024-04-26T11:31:16.406358+0000","last_fullsized":"2024-04-26T11:31:16.406358+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:42.680367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"94'7","reported_seq":277,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:26.132752+0000","last_change":"2024-04-26T11:27:08.036947+0000","last_active":"2024-04-26T11:31:26.132752+0000","last_peered":"2024-04-26T11:31:26.132752+0000","last_clean":"2024-04-26T11:31:26.132752+0000","last_became_active":"2024-04-26T11:27:08.036596+0000","last_became_peered":"2024-04-26T11:27:08.036596+0000","last_unstale":"2024-04-26T11:31:26.132752+0000","last_undegraded":"2024-04-26T11:31:26.132752+0000","last_fullsized":"2024-04-26T11:31:26.132752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:35.606069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1902,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":6,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405803+0000","last_change":"2024-04-26T11:27:12.086190+0000","last_active":"2024-04-26T11:31:16.405803+0000","last_peered":"2024-04-26T11:31:16.405803+0000","last_clean":"2024-04-26T11:31:16.405803+0000","last_became_active":"2024-04-26T11:27:12.085839+0000","last_became_peered":"2024-04-26T11:27:12.085839+0000","last_unstale":"2024-04-26T11:31:16.405803+0000","last_undegraded":"2024-04-26T11:31:16.405803+0000","last_fullsized":"2024-04-26T11:31:16.405803+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:31.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":73,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226321+0000","last_change":"2024-04-26T11:28:03.459792+0000","last_active":"2024-04-26T11:31:16.226321+0000","last_peered":"2024-04-26T11:31:16.226321+0000","last_clean":"2024-04-26T11:31:16.226321+0000","last_became_active":"2024-04-26T11:28:03.444101+0000","last_became_peered":"2024-04-26T11:28:03.444101+0000","last_unstale":"2024-04-26T11:31:16.226321+0000","last_undegraded":"2024-04-26T11:31:16.226321+0000","last_fullsized":"2024-04-26T11:31:16.226321+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:14.498792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101310+0000","last_change":"2024-04-26T11:27:12.093884+0000","last_active":"2024-04-26T11:31:16.101310+0000","last_peered":"2024-04-26T11:31:16.101310+0000","last_clean":"2024-04-26T11:31:16.101310+0000","last_became_active":"2024-04-26T11:27:12.093573+0000","last_became_peered":"2024-04-26T11:27:12.093573+0000","last_unstale":"2024-04-26T11:31:16.101310+0000","last_undegraded":"2024-04-26T11:31:16.101310+0000","last_fullsized":"2024-04-26T11:31:16.101310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:32.144889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"94'3","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226840+0000","last_change":"2024-04-26T11:27:08.035089+0000","last_active":"2024-04-26T11:31:16.226840+0000","last_peered":"2024-04-26T11:31:16.226840+0000","last_clean":"2024-04-26T11:31:16.226840+0000","last_became_active":"2024-04-26T11:27:08.034698+0000","last_became_peered":"2024-04-26T11:27:08.034698+0000","last_unstale":"2024-04-26T11:31:16.226840+0000","last_undegraded":"2024-04-26T11:31:16.226840+0000","last_fullsized":"2024-04-26T11:31:16.226840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:23.731307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432489+0000","last_change":"2024-04-26T11:27:12.097089+0000","last_active":"2024-04-26T11:31:16.432489+0000","last_peered":"2024-04-26T11:31:16.432489+0000","last_clean":"2024-04-26T11:31:16.432489+0000","last_became_active":"2024-04-26T11:27:12.096762+0000","last_became_peered":"2024-04-26T11:27:12.096762+0000","last_unstale":"2024-04-26T11:31:16.432489+0000","last_undegraded":"2024-04-26T11:31:16.432489+0000","last_fullsized":"2024-04-26T11:31:16.432489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:35.366450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.224078+0000","last_change":"2024-04-26T11:27:08.475317+0000","last_active":"2024-04-26T11:31:16.224078+0000","last_peered":"2024-04-26T11:31:16.224078+0000","last_clean":"2024-04-26T11:31:16.224078+0000","last_became_active":"2024-04-26T11:27:08.474464+0000","last_became_peered":"2024-04-26T11:27:08.474464+0000","last_unstale":"2024-04-26T11:31:16.224078+0000","last_undegraded":"2024-04-26T11:31:16.224078+0000","last_fullsized":"2024-04-26T11:31:16.224078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.603608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'5","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.084811+0000","last_change":"2024-04-26T11:27:12.107542+0000","last_active":"2024-04-26T11:31:16.084811+0000","last_peered":"2024-04-26T11:31:16.084811+0000","last_clean":"2024-04-26T11:31:16.084811+0000","last_became_active":"2024-04-26T11:27:12.107162+0000","last_became_peered":"2024-04-26T11:27:12.107162+0000","last_unstale":"2024-04-26T11:31:16.084811+0000","last_undegraded":"2024-04-26T11:31:16.084811+0000","last_fullsized":"2024-04-26T11:31:16.084811+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:55.470638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406213+0000","last_change":"2024-04-26T11:27:08.044101+0000","last_active":"2024-04-26T11:31:16.406213+0000","last_peered":"2024-04-26T11:31:16.406213+0000","last_clean":"2024-04-26T11:31:16.406213+0000","last_became_active":"2024-04-26T11:27:08.043733+0000","last_became_peered":"2024-04-26T11:27:08.043733+0000","last_unstale":"2024-04-26T11:31:16.406213+0000","last_undegraded":"2024-04-26T11:31:16.406213+0000","last_fullsized":"2024-04-26T11:31:16.406213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:03.023620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":41,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083857+0000","last_change":"2024-04-26T11:29:03.604007+0000","last_active":"2024-04-26T11:31:16.083857+0000","last_peered":"2024-04-26T11:31:16.083857+0000","last_clean":"2024-04-26T11:31:16.083857+0000","last_became_active":"2024-04-26T11:29:03.603521+0000","last_became_peered":"2024-04-26T11:29:03.603521+0000","last_unstale":"2024-04-26T11:31:16.083857+0000","last_undegraded":"2024-04-26T11:31:16.083857+0000","last_fullsized":"2024-04-26T11:31:16.083857+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:05.733257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101794+0000","last_change":"2024-04-26T11:27:12.093505+0000","last_active":"2024-04-26T11:31:16.101794+0000","last_peered":"2024-04-26T11:31:16.101794+0000","last_clean":"2024-04-26T11:31:16.101794+0000","last_became_active":"2024-04-26T11:27:12.093198+0000","last_became_peered":"2024-04-26T11:27:12.093198+0000","last_unstale":"2024-04-26T11:31:16.101794+0000","last_undegraded":"2024-04-26T11:31:16.101794+0000","last_fullsized":"2024-04-26T11:31:16.101794+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:06.100747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"94'6","reported_seq":272,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:26.131767+0000","last_change":"2024-04-26T11:27:08.474897+0000","last_active":"2024-04-26T11:31:26.131767+0000","last_peered":"2024-04-26T11:31:26.131767+0000","last_clean":"2024-04-26T11:31:26.131767+0000","last_became_active":"2024-04-26T11:27:08.471735+0000","last_became_peered":"2024-04-26T11:27:08.471735+0000","last_unstale":"2024-04-26T11:31:26.131767+0000","last_undegraded":"2024-04-26T11:31:26.131767+0000","last_fullsized":"2024-04-26T11:31:26.131767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:42.066821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082965+0000","last_change":"2024-04-26T11:27:12.116722+0000","last_active":"2024-04-26T11:31:16.082965+0000","last_peered":"2024-04-26T11:31:16.082965+0000","last_clean":"2024-04-26T11:31:16.082965+0000","last_became_active":"2024-04-26T11:27:12.116239+0000","last_became_peered":"2024-04-26T11:27:12.116239+0000","last_unstale":"2024-04-26T11:31:16.082965+0000","last_undegraded":"2024-04-26T11:31:16.082965+0000","last_fullsized":"2024-04-26T11:31:16.082965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:04.962376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.114176+0000","last_change":"2024-04-26T11:27:08.047087+0000","last_active":"2024-04-26T11:31:16.114176+0000","last_peered":"2024-04-26T11:31:16.114176+0000","last_clean":"2024-04-26T11:31:16.114176+0000","last_became_active":"2024-04-26T11:27:08.046754+0000","last_became_peered":"2024-04-26T11:27:08.046754+0000","last_unstale":"2024-04-26T11:31:16.114176+0000","last_undegraded":"2024-04-26T11:31:16.114176+0000","last_fullsized":"2024-04-26T11:31:16.114176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:30.481521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"94'148","reported_seq":412,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:18.237873+0000","last_change":"2024-04-26T11:25:35.622816+0000","last_active":"2024-04-26T11:31:18.237873+0000","last_peered":"2024-04-26T11:31:18.237873+0000","last_clean":"2024-04-26T11:31:18.237873+0000","last_became_active":"2024-04-26T11:25:35.622329+0000","last_became_peered":"2024-04-26T11:25:35.622329+0000","last_unstale":"2024-04-26T11:31:18.237873+0000","last_undegraded":"2024-04-26T11:31:18.237873+0000","last_fullsized":"2024-04-26T11:31:18.237873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:45.465157+0000","last_clean_scrub_stamp":"2024-04-26T11:21:45.465157+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:40.828535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111106+0000","last_change":"2024-04-26T11:27:12.098686+0000","last_active":"2024-04-26T11:31:16.111106+0000","last_peered":"2024-04-26T11:31:16.111106+0000","last_clean":"2024-04-26T11:31:16.111106+0000","last_became_active":"2024-04-26T11:27:12.098251+0000","last_became_peered":"2024-04-26T11:27:12.098251+0000","last_unstale":"2024-04-26T11:31:16.111106+0000","last_undegraded":"2024-04-26T11:31:16.111106+0000","last_fullsized":"2024-04-26T11:31:16.111106+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:34.433203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405731+0000","last_change":"2024-04-26T11:27:08.036391+0000","last_active":"2024-04-26T11:31:16.405731+0000","last_peered":"2024-04-26T11:31:16.405731+0000","last_clean":"2024-04-26T11:31:16.405731+0000","last_became_active":"2024-04-26T11:27:08.036058+0000","last_became_peered":"2024-04-26T11:27:08.036058+0000","last_unstale":"2024-04-26T11:31:16.405731+0000","last_undegraded":"2024-04-26T11:31:16.405731+0000","last_fullsized":"2024-04-26T11:31:16.405731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:35.646501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226656+0000","last_change":"2024-04-26T11:27:08.472171+0000","last_active":"2024-04-26T11:31:16.226656+0000","last_peered":"2024-04-26T11:31:16.226656+0000","last_clean":"2024-04-26T11:31:16.226656+0000","last_became_active":"2024-04-26T11:27:08.471707+0000","last_became_peered":"2024-04-26T11:27:08.471707+0000","last_unstale":"2024-04-26T11:31:16.226656+0000","last_undegraded":"2024-04-26T11:31:16.226656+0000","last_fullsized":"2024-04-26T11:31:16.226656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:54.319448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111576+0000","last_change":"2024-04-26T11:27:12.110757+0000","last_active":"2024-04-26T11:31:16.111576+0000","last_peered":"2024-04-26T11:31:16.111576+0000","last_clean":"2024-04-26T11:31:16.111576+0000","last_became_active":"2024-04-26T11:27:12.109048+0000","last_became_peered":"2024-04-26T11:27:12.109048+0000","last_unstale":"2024-04-26T11:31:16.111576+0000","last_undegraded":"2024-04-26T11:31:16.111576+0000","last_fullsized":"2024-04-26T11:31:16.111576+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:05.203504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"94'102","reported_seq":227,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:20.051652+0000","last_change":"2024-04-26T11:27:08.051790+0000","last_active":"2024-04-26T11:31:20.051652+0000","last_peered":"2024-04-26T11:31:20.051652+0000","last_clean":"2024-04-26T11:31:20.051652+0000","last_became_active":"2024-04-26T11:27:08.051430+0000","last_became_peered":"2024-04-26T11:27:08.051430+0000","last_unstale":"2024-04-26T11:31:20.051652+0000","last_undegraded":"2024-04-26T11:31:20.051652+0000","last_fullsized":"2024-04-26T11:31:20.051652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:13.607944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":187,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082801+0000","last_change":"2024-04-26T11:27:12.116704+0000","last_active":"2024-04-26T11:31:16.082801+0000","last_peered":"2024-04-26T11:31:16.082801+0000","last_clean":"2024-04-26T11:31:16.082801+0000","last_became_active":"2024-04-26T11:27:12.111556+0000","last_became_peered":"2024-04-26T11:27:12.111556+0000","last_unstale":"2024-04-26T11:31:16.082801+0000","last_undegraded":"2024-04-26T11:31:16.082801+0000","last_fullsized":"2024-04-26T11:31:16.082801+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:36.535244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.114171+0000","last_change":"2024-04-26T11:27:08.347851+0000","last_active":"2024-04-26T11:31:16.114171+0000","last_peered":"2024-04-26T11:31:16.114171+0000","last_clean":"2024-04-26T11:31:16.114171+0000","last_became_active":"2024-04-26T11:27:08.347460+0000","last_became_peered":"2024-04-26T11:27:08.347460+0000","last_unstale":"2024-04-26T11:31:16.114171+0000","last_undegraded":"2024-04-26T11:31:16.114171+0000","last_fullsized":"2024-04-26T11:31:16.114171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:10.017834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":40,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.407026+0000","last_change":"2024-04-26T11:29:03.598719+0000","last_active":"2024-04-26T11:31:16.407026+0000","last_peered":"2024-04-26T11:31:16.407026+0000","last_clean":"2024-04-26T11:31:16.407026+0000","last_became_active":"2024-04-26T11:29:03.598192+0000","last_became_peered":"2024-04-26T11:29:03.598192+0000","last_unstale":"2024-04-26T11:31:16.407026+0000","last_undegraded":"2024-04-26T11:31:16.407026+0000","last_fullsized":"2024-04-26T11:31:16.407026+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:57.809995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.405595+0000","last_change":"2024-04-26T11:27:08.472127+0000","last_active":"2024-04-26T11:31:16.405595+0000","last_peered":"2024-04-26T11:31:16.405595+0000","last_clean":"2024-04-26T11:31:16.405595+0000","last_became_active":"2024-04-26T11:27:08.471709+0000","last_became_peered":"2024-04-26T11:27:08.471709+0000","last_unstale":"2024-04-26T11:31:16.405595+0000","last_undegraded":"2024-04-26T11:31:16.405595+0000","last_fullsized":"2024-04-26T11:31:16.405595+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:28.432710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226324+0000","last_change":"2024-04-26T11:27:12.085756+0000","last_active":"2024-04-26T11:31:16.226324+0000","last_peered":"2024-04-26T11:31:16.226324+0000","last_clean":"2024-04-26T11:31:16.226324+0000","last_became_active":"2024-04-26T11:27:12.085397+0000","last_became_peered":"2024-04-26T11:27:12.085397+0000","last_unstale":"2024-04-26T11:31:16.226324+0000","last_undegraded":"2024-04-26T11:31:16.226324+0000","last_fullsized":"2024-04-26T11:31:16.226324+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:41.392010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.081973+0000","last_change":"2024-04-26T11:27:08.054831+0000","last_active":"2024-04-26T11:31:16.081973+0000","last_peered":"2024-04-26T11:31:16.081973+0000","last_clean":"2024-04-26T11:31:16.081973+0000","last_became_active":"2024-04-26T11:27:08.054352+0000","last_became_peered":"2024-04-26T11:27:08.054352+0000","last_unstale":"2024-04-26T11:31:16.081973+0000","last_undegraded":"2024-04-26T11:31:16.081973+0000","last_fullsized":"2024-04-26T11:31:16.081973+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:53.089178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432298+0000","last_change":"2024-04-26T11:27:12.095789+0000","last_active":"2024-04-26T11:31:16.432298+0000","last_peered":"2024-04-26T11:31:16.432298+0000","last_clean":"2024-04-26T11:31:16.432298+0000","last_became_active":"2024-04-26T11:27:12.095468+0000","last_became_peered":"2024-04-26T11:27:12.095468+0000","last_unstale":"2024-04-26T11:31:16.432298+0000","last_undegraded":"2024-04-26T11:31:16.432298+0000","last_fullsized":"2024-04-26T11:31:16.432298+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:27.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083768+0000","last_change":"2024-04-26T11:27:08.044923+0000","last_active":"2024-04-26T11:31:16.083768+0000","last_peered":"2024-04-26T11:31:16.083768+0000","last_clean":"2024-04-26T11:31:16.083768+0000","last_became_active":"2024-04-26T11:27:08.044516+0000","last_became_peered":"2024-04-26T11:27:08.044516+0000","last_unstale":"2024-04-26T11:31:16.083768+0000","last_undegraded":"2024-04-26T11:31:16.083768+0000","last_fullsized":"2024-04-26T11:31:16.083768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:21.307138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082214+0000","last_change":"2024-04-26T11:27:12.114311+0000","last_active":"2024-04-26T11:31:16.082214+0000","last_peered":"2024-04-26T11:31:16.082214+0000","last_clean":"2024-04-26T11:31:16.082214+0000","last_became_active":"2024-04-26T11:27:12.113538+0000","last_became_peered":"2024-04-26T11:27:12.113538+0000","last_unstale":"2024-04-26T11:31:16.082214+0000","last_undegraded":"2024-04-26T11:31:16.082214+0000","last_fullsized":"2024-04-26T11:31:16.082214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:55.506826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.226482+0000","last_change":"2024-04-26T11:27:08.036983+0000","last_active":"2024-04-26T11:31:16.226482+0000","last_peered":"2024-04-26T11:31:16.226482+0000","last_clean":"2024-04-26T11:31:16.226482+0000","last_became_active":"2024-04-26T11:27:08.036632+0000","last_became_peered":"2024-04-26T11:27:08.036632+0000","last_unstale":"2024-04-26T11:31:16.226482+0000","last_undegraded":"2024-04-26T11:31:16.226482+0000","last_fullsized":"2024-04-26T11:31:16.226482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:31.731466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":32,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406275+0000","last_change":"2024-04-26T11:27:12.102922+0000","last_active":"2024-04-26T11:31:16.406275+0000","last_peered":"2024-04-26T11:31:16.406275+0000","last_clean":"2024-04-26T11:31:16.406275+0000","last_became_active":"2024-04-26T11:27:12.102594+0000","last_became_peered":"2024-04-26T11:27:12.102594+0000","last_unstale":"2024-04-26T11:31:16.406275+0000","last_undegraded":"2024-04-26T11:31:16.406275+0000","last_fullsized":"2024-04-26T11:31:16.406275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:47.223435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083774+0000","last_change":"2024-04-26T11:27:08.473262+0000","last_active":"2024-04-26T11:31:16.083774+0000","last_peered":"2024-04-26T11:31:16.083774+0000","last_clean":"2024-04-26T11:31:16.083774+0000","last_became_active":"2024-04-26T11:27:08.472744+0000","last_became_peered":"2024-04-26T11:27:08.472744+0000","last_unstale":"2024-04-26T11:31:16.083774+0000","last_undegraded":"2024-04-26T11:31:16.083774+0000","last_fullsized":"2024-04-26T11:31:16.083774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:16.766438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406836+0000","last_change":"2024-04-26T11:27:12.091754+0000","last_active":"2024-04-26T11:31:16.406836+0000","last_peered":"2024-04-26T11:31:16.406836+0000","last_clean":"2024-04-26T11:31:16.406836+0000","last_became_active":"2024-04-26T11:27:12.091282+0000","last_became_peered":"2024-04-26T11:27:12.091282+0000","last_unstale":"2024-04-26T11:31:16.406836+0000","last_undegraded":"2024-04-26T11:31:16.406836+0000","last_fullsized":"2024-04-26T11:31:16.406836+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:07.649909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"94'65","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:19.569994+0000","last_change":"2024-04-26T11:27:08.048352+0000","last_active":"2024-04-26T11:31:19.569994+0000","last_peered":"2024-04-26T11:31:19.569994+0000","last_clean":"2024-04-26T11:31:19.569994+0000","last_became_active":"2024-04-26T11:27:08.048056+0000","last_became_peered":"2024-04-26T11:27:08.048056+0000","last_unstale":"2024-04-26T11:31:19.569994+0000","last_undegraded":"2024-04-26T11:31:19.569994+0000","last_fullsized":"2024-04-26T11:31:19.569994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:35.363779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'7","reported_seq":34,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406674+0000","last_change":"2024-04-26T11:27:12.108244+0000","last_active":"2024-04-26T11:31:16.406674+0000","last_peered":"2024-04-26T11:31:16.406674+0000","last_clean":"2024-04-26T11:31:16.406674+0000","last_became_active":"2024-04-26T11:27:12.107592+0000","last_became_peered":"2024-04-26T11:27:12.107592+0000","last_unstale":"2024-04-26T11:31:16.406674+0000","last_undegraded":"2024-04-26T11:31:16.406674+0000","last_fullsized":"2024-04-26T11:31:16.406674+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:55.985873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":45,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.112034+0000","last_change":"2024-04-26T11:28:03.462136+0000","last_active":"2024-04-26T11:31:16.112034+0000","last_peered":"2024-04-26T11:31:16.112034+0000","last_clean":"2024-04-26T11:31:16.112034+0000","last_became_active":"2024-04-26T11:28:03.449130+0000","last_became_peered":"2024-04-26T11:28:03.449130+0000","last_unstale":"2024-04-26T11:31:16.112034+0000","last_undegraded":"2024-04-26T11:31:16.112034+0000","last_fullsized":"2024-04-26T11:31:16.112034+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:07.006912+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.006912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:33.181328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406912+0000","last_change":"2024-04-26T11:27:12.090627+0000","last_active":"2024-04-26T11:31:16.406912+0000","last_peered":"2024-04-26T11:31:16.406912+0000","last_clean":"2024-04-26T11:31:16.406912+0000","last_became_active":"2024-04-26T11:27:12.089981+0000","last_became_peered":"2024-04-26T11:27:12.089981+0000","last_unstale":"2024-04-26T11:31:16.406912+0000","last_undegraded":"2024-04-26T11:31:16.406912+0000","last_fullsized":"2024-04-26T11:31:16.406912+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432427+0000","last_change":"2024-04-26T11:27:12.089335+0000","last_active":"2024-04-26T11:31:16.432427+0000","last_peered":"2024-04-26T11:31:16.432427+0000","last_clean":"2024-04-26T11:31:16.432427+0000","last_became_active":"2024-04-26T11:27:12.089019+0000","last_became_peered":"2024-04-26T11:27:12.089019+0000","last_unstale":"2024-04-26T11:31:16.432427+0000","last_undegraded":"2024-04-26T11:31:16.432427+0000","last_fullsized":"2024-04-26T11:31:16.432427+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:18.055406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":46,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083620+0000","last_change":"2024-04-26T11:28:03.435483+0000","last_active":"2024-04-26T11:31:16.083620+0000","last_peered":"2024-04-26T11:31:16.083620+0000","last_clean":"2024-04-26T11:31:16.083620+0000","last_became_active":"2024-04-26T11:28:03.435088+0000","last_became_peered":"2024-04-26T11:28:03.435088+0000","last_unstale":"2024-04-26T11:31:16.083620+0000","last_undegraded":"2024-04-26T11:31:16.083620+0000","last_fullsized":"2024-04-26T11:31:16.083620+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.453906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083518+0000","last_change":"2024-04-26T11:27:12.112344+0000","last_active":"2024-04-26T11:31:16.083518+0000","last_peered":"2024-04-26T11:31:16.083518+0000","last_clean":"2024-04-26T11:31:16.083518+0000","last_became_active":"2024-04-26T11:27:12.112083+0000","last_became_peered":"2024-04-26T11:27:12.112083+0000","last_unstale":"2024-04-26T11:31:16.083518+0000","last_undegraded":"2024-04-26T11:31:16.083518+0000","last_fullsized":"2024-04-26T11:31:16.083518+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.797177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406686+0000","last_change":"2024-04-26T11:27:12.115707+0000","last_active":"2024-04-26T11:31:16.406686+0000","last_peered":"2024-04-26T11:31:16.406686+0000","last_clean":"2024-04-26T11:31:16.406686+0000","last_became_active":"2024-04-26T11:27:12.115192+0000","last_became_peered":"2024-04-26T11:27:12.115192+0000","last_unstale":"2024-04-26T11:31:16.406686+0000","last_undegraded":"2024-04-26T11:31:16.406686+0000","last_fullsized":"2024-04-26T11:31:16.406686+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:55.475825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111343+0000","last_change":"2024-04-26T11:27:12.108771+0000","last_active":"2024-04-26T11:31:16.111343+0000","last_peered":"2024-04-26T11:31:16.111343+0000","last_clean":"2024-04-26T11:31:16.111343+0000","last_became_active":"2024-04-26T11:27:12.102910+0000","last_became_peered":"2024-04-26T11:27:12.102910+0000","last_unstale":"2024-04-26T11:31:16.111343+0000","last_undegraded":"2024-04-26T11:31:16.111343+0000","last_fullsized":"2024-04-26T11:31:16.111343+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:23.692971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432517+0000","last_change":"2024-04-26T11:27:12.091226+0000","last_active":"2024-04-26T11:31:16.432517+0000","last_peered":"2024-04-26T11:31:16.432517+0000","last_clean":"2024-04-26T11:31:16.432517+0000","last_became_active":"2024-04-26T11:27:12.090926+0000","last_became_peered":"2024-04-26T11:27:12.090926+0000","last_unstale":"2024-04-26T11:31:16.432517+0000","last_undegraded":"2024-04-26T11:31:16.432517+0000","last_fullsized":"2024-04-26T11:31:16.432517+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:43.005527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":42,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.083947+0000","last_change":"2024-04-26T11:27:12.091297+0000","last_active":"2024-04-26T11:31:16.083947+0000","last_peered":"2024-04-26T11:31:16.083947+0000","last_clean":"2024-04-26T11:31:16.083947+0000","last_became_active":"2024-04-26T11:27:12.090946+0000","last_became_peered":"2024-04-26T11:27:12.090946+0000","last_unstale":"2024-04-26T11:31:16.083947+0000","last_undegraded":"2024-04-26T11:31:16.083947+0000","last_fullsized":"2024-04-26T11:31:16.083947+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:06.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.082446+0000","last_change":"2024-04-26T11:28:03.445596+0000","last_active":"2024-04-26T11:31:16.082446+0000","last_peered":"2024-04-26T11:31:16.082446+0000","last_clean":"2024-04-26T11:31:16.082446+0000","last_became_active":"2024-04-26T11:28:03.443717+0000","last_became_peered":"2024-04-26T11:28:03.443717+0000","last_unstale":"2024-04-26T11:31:16.082446+0000","last_undegraded":"2024-04-26T11:31:16.082446+0000","last_fullsized":"2024-04-26T11:31:16.082446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:44.905902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.101560+0000","last_change":"2024-04-26T11:27:12.107987+0000","last_active":"2024-04-26T11:31:16.101560+0000","last_peered":"2024-04-26T11:31:16.101560+0000","last_clean":"2024-04-26T11:31:16.101560+0000","last_became_active":"2024-04-26T11:27:12.107668+0000","last_became_peered":"2024-04-26T11:27:12.107668+0000","last_unstale":"2024-04-26T11:31:16.101560+0000","last_undegraded":"2024-04-26T11:31:16.101560+0000","last_fullsized":"2024-04-26T11:31:16.101560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:06.448570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.081973+0000","last_change":"2024-04-26T11:27:12.105596+0000","last_active":"2024-04-26T11:31:16.081973+0000","last_peered":"2024-04-26T11:31:16.081973+0000","last_clean":"2024-04-26T11:31:16.081973+0000","last_became_active":"2024-04-26T11:27:12.104996+0000","last_became_peered":"2024-04-26T11:27:12.104996+0000","last_unstale":"2024-04-26T11:31:16.081973+0000","last_undegraded":"2024-04-26T11:31:16.081973+0000","last_fullsized":"2024-04-26T11:31:16.081973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:11.947364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":37,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.406052+0000","last_change":"2024-04-26T11:27:12.116095+0000","last_active":"2024-04-26T11:31:16.406052+0000","last_peered":"2024-04-26T11:31:16.406052+0000","last_clean":"2024-04-26T11:31:16.406052+0000","last_became_active":"2024-04-26T11:27:12.115726+0000","last_became_peered":"2024-04-26T11:27:12.115726+0000","last_unstale":"2024-04-26T11:31:16.406052+0000","last_undegraded":"2024-04-26T11:31:16.406052+0000","last_fullsized":"2024-04-26T11:31:16.406052+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:45.056829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.111194+0000","last_change":"2024-04-26T11:27:12.115016+0000","last_active":"2024-04-26T11:31:16.111194+0000","last_peered":"2024-04-26T11:31:16.111194+0000","last_clean":"2024-04-26T11:31:16.111194+0000","last_became_active":"2024-04-26T11:27:12.114671+0000","last_became_peered":"2024-04-26T11:27:12.114671+0000","last_unstale":"2024-04-26T11:31:16.111194+0000","last_undegraded":"2024-04-26T11:31:16.111194+0000","last_fullsized":"2024-04-26T11:31:16.111194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:11.393056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":35,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:31:16.432521+0000","last_change":"2024-04-26T11:27:12.097130+0000","last_active":"2024-04-26T11:31:16.432521+0000","last_peered":"2024-04-26T11:31:16.432521+0000","last_clean":"2024-04-26T11:31:16.432521+0000","last_became_active":"2024-04-26T11:27:12.096809+0000","last_became_peered":"2024-04-26T11:27:12.096809+0000","last_unstale":"2024-04-26T11:31:16.432521+0000","last_undegraded":"2024-04-26T11:31:16.432521+0000","last_fullsized":"2024-04-26T11:31:16.432521+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:11.045668+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.045668+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:31.198452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108489,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794445,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1737,"num_read_kb":1094,"num_write":420,"num_write_kb":2352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1316,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":651264,"data_stored":2383335,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":510155,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612680,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32384,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712768,"statfs":{"total":95995035648,"available":95961874432,"internally_reserved":0,"allocated":1228800,"data_stored":1498633,"data_compressed":65869,"data_compressed_allocated":86016,"data_compressed_original":937984,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776206,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":902985,"data_compressed":33793,"data_compressed_allocated":45056,"data_compressed_original":434176,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037844,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":902323,"data_compressed":33793,"data_compressed_allocated":45056,"data_compressed_original":434176,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1089536,"data_stored":1102542,"data_compressed":50667,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863463008,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1028096,"data_stored":509158,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32256,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712896,"statfs":{"total":95995035648,"available":95962005504,"internally_reserved":0,"allocated":1101824,"data_stored":577606,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":510429,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1114112,"data_stored":578262,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149807,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1230917,"data_compressed":48995,"data_compressed_allocated":65536,"data_compressed_original":741376,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888171,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1040384,"data_stored":511021,"data_compressed":14504,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724646,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1138688,"data_stored":1428522,"data_compressed":65869,"data_compressed_allocated":86016,"data_compressed_original":937984,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36163,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":69311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":721732,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":329086,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":399197,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:31:32.082 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:31:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:31 smithi193 ceph-mon[32782]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T11:31:32.573 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:32.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:32 smithi110 ceph-mon[28069]: from='client.25133 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:31:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:32 smithi196 ceph-mon[32572]: from='client.25133 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:31:33.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:32 smithi193 ceph-mon[32782]: from='client.25133 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T11:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.428+0000 7f533e200640 1 -- 172.21.15.110:0/2602180761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f533810f160 msgr2=0x7f53381115b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:33.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.428+0000 7f533e200640 1 --2- 172.21.15.110:0/2602180761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f533810f160 0x7f53381115b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5330009ca0 tx=0x7f533002a950 comp rx=0 tx=0).stop 2024-04-26T11:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.428+0000 7f533e200640 1 -- 172.21.15.110:0/2602180761 shutdown_connections 2024-04-26T11:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.428+0000 7f533e200640 1 --2- 172.21.15.110:0/2602180761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f533810f160 0x7f53381115b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.428+0000 7f533e200640 1 --2- 172.21.15.110:0/2602180761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5338075680 0x7f533810ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.428+0000 7f533e200640 1 --2- 172.21.15.110:0/2602180761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338074d60 0x7f5338075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.428+0000 7f533e200640 1 -- 172.21.15.110:0/2602180761 >> 172.21.15.110:0/2602180761 conn(0x7f53380fe3d0 msgr2=0x7f53381007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.428+0000 7f533e200640 1 -- 172.21.15.110:0/2602180761 shutdown_connections 2024-04-26T11:31:33.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.428+0000 7f533e200640 1 -- 172.21.15.110:0/2602180761 wait complete. 2024-04-26T11:31:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.429+0000 7f533e200640 1 Processor -- start 2024-04-26T11:31:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.429+0000 7f533e200640 1 -- start start 2024-04-26T11:31:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.429+0000 7f533e200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5338074d60 0x7f533819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.429+0000 7f533e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338075680 0x7f533819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.429+0000 7f533e200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f533810f160 0x7f533819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.429+0000 7f533e200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5338114e00 con 0x7f5338075680 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.429+0000 7f533e200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5338114c80 con 0x7f5338074d60 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.429+0000 7f533e200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5338114f80 con 0x7f533810f160 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5336a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338075680 0x7f533819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5338074d60 0x7f533819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5338074d60 0x7f533819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43006/0 (socket says 172.21.15.110:43006) 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337400640 1 -- 172.21.15.110:0/274609944 learned_addr learned my addr 172.21.15.110:0/274609944 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337e00640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f533810f160 0x7f533819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337400640 1 -- 172.21.15.110:0/274609944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f533810f160 msgr2=0x7f533819fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337400640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f533810f160 0x7f533819fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337400640 1 -- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338075680 msgr2=0x7f533819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337400640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338075680 0x7f533819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337400640 1 -- 172.21.15.110:0/274609944 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53381a0270 con 0x7f5338074d60 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5336a00640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338075680 0x7f533819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:33.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.430+0000 7f5337400640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5338074d60 0x7f533819b280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f532800ea60 tx=0x7f532800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:33.434 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.431+0000 7f532fe00640 1 -- 172.21.15.110:0/274609944 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532800cde0 con 0x7f5338074d60 2024-04-26T11:31:33.434 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.431+0000 7f532fe00640 1 -- 172.21.15.110:0/274609944 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53280035f0 con 0x7f5338074d60 2024-04-26T11:31:33.434 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.431+0000 7f532fe00640 1 -- 172.21.15.110:0/274609944 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328010690 con 0x7f5338074d60 2024-04-26T11:31:33.434 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.431+0000 7f533e200640 1 -- 172.21.15.110:0/274609944 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53381a0560 con 0x7f5338074d60 2024-04-26T11:31:33.434 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.431+0000 7f533e200640 1 -- 172.21.15.110:0/274609944 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53381a7df0 con 0x7f5338074d60 2024-04-26T11:31:33.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.434+0000 7f532fe00640 1 -- 172.21.15.110:0/274609944 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7f53280037a0 con 0x7f5338074d60 2024-04-26T11:31:33.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.434+0000 7f53411a8740 1 Processor -- start 2024-04-26T11:31:33.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f53411a8740 1 -- start start 2024-04-26T11:31:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f53411a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b3801b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f53411a8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b38aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f53411a8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b38d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f53411a8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b59b2e5380 con 0x55b59b38afb0 2024-04-26T11:31:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f53411a8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b59b281c30 con 0x55b59b3806f0 2024-04-26T11:31:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f53411a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b59b2e1340 con 0x55b59b37fdd0 2024-04-26T11:31:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f5337400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b38aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f5337e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b3801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f5336a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b38d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f5337e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b3801b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:46238/0 (socket says 172.21.15.110:46238) 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f5337e00640 1 -- 172.21.15.110:0/2999465073 learned_addr learned my addr 172.21.15.110:0/2999465073 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.435+0000 7f5337400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b38aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43008/0 (socket says 172.21.15.110:43008) 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.436+0000 7f5337e00640 1 -- 172.21.15.110:0/2999465073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 msgr2=0x55b59b38aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.436+0000 7f5337e00640 1 --2- 172.21.15.110:0/2999465073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b38aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.436+0000 7f5337e00640 1 -- 172.21.15.110:0/2999465073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 msgr2=0x55b59b38d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.436+0000 7f5337e00640 1 --2- 172.21.15.110:0/2999465073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b38d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.436+0000 7f5337e00640 1 -- 172.21.15.110:0/2999465073 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59b2a3940 con 0x55b59b37fdd0 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.436+0000 7f532fe00640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f531c0a3e60 0x7f531c0a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.436+0000 7f532fe00640 1 -- 172.21.15.110:0/274609944 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f53280d0d20 con 0x7f5338074d60 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.436+0000 7f5337e00640 1 --2- 172.21.15.110:0/2999465073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b3801b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5330009ca0 tx=0x7f5330005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13bfb500cf0a2b33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.436+0000 7f5337400640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f531c0a3e60 0x7f531c0a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.437+0000 7f5323e00640 1 -- 172.21.15.110:0/2999465073 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330048070 con 0x55b59b37fdd0 2024-04-26T11:31:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.437+0000 7f5323e00640 1 -- 172.21.15.110:0/2999465073 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5330003e20 con 0x55b59b37fdd0 2024-04-26T11:31:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.437+0000 7f5323e00640 1 -- 172.21.15.110:0/2999465073 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330034040 con 0x55b59b37fdd0 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.437+0000 7f53411a8740 1 -- 172.21.15.110:0/2999465073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 msgr2=0x55b59b3801b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.437+0000 7f53411a8740 1 --2- 172.21.15.110:0/2999465073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b3801b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5330009ca0 tx=0x7f5330005f80 comp rx=0 tx=0).stop 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.437+0000 7f5337400640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f531c0a3e60 0x7f531c0a6320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53280ce330 tx=0x7f53280d4720 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.437+0000 7f53411a8740 1 -- 172.21.15.110:0/2999465073 shutdown_connections 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.438+0000 7f53411a8740 1 --2- 172.21.15.110:0/2999465073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b38d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.438+0000 7f53411a8740 1 --2- 172.21.15.110:0/2999465073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b38aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.438+0000 7f53411a8740 1 --2- 172.21.15.110:0/2999465073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b3801b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.438+0000 7f53411a8740 1 -- 172.21.15.110:0/2999465073 >> 172.21.15.110:0/2999465073 conn(0x55b59b37c2e0 msgr2=0x55b59b37c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.438+0000 7f53411a8740 1 -- 172.21.15.110:0/2999465073 shutdown_connections 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.438+0000 7f53411a8740 1 -- 172.21.15.110:0/2999465073 wait complete. 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.438+0000 7f53411a8740 1 -- start start 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.438+0000 7f53411a8740 1 Processor -- start 2024-04-26T11:31:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f53411a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b387f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f53411a8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b388490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f53411a8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3889d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f53411a8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b59b38db80 con 0x55b59b38afb0 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f53411a8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b59b26cc60 con 0x55b59b3806f0 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f53411a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b59b38dd00 con 0x55b59b37fdd0 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f53411a8740 10 client.0 _ll_register_callbacks cb 0x55b59b298e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5337e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3889d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5336a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b388490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5337e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b387f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5336a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b388490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43018/0 (socket says 172.21.15.110:43018) 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5336a00640 1 -- 172.21.15.110:0/2853636646 learned_addr learned my addr 172.21.15.110:0/2853636646 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5336a00640 1 -- 172.21.15.110:0/2853636646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 msgr2=0x55b59b387f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5336a00640 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b387f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5336a00640 1 -- 172.21.15.110:0/2853636646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 msgr2=0x55b59b3889d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5336a00640 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3889d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.439+0000 7f5336a00640 1 -- 172.21.15.110:0/2853636646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59b27b510 con 0x55b59b3806f0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.440+0000 7f5336a00640 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b388490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5324012a10 tx=0x7f5324012ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec997503eb40a3fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.440+0000 7f5320c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.440+0000 7f5320c00640 1 -- 172.21.15.110:0/2853636646 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532400f980 con 0x55b59b3806f0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.440+0000 7f5320c00640 1 -- 172.21.15.110:0/2853636646 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f532400fb20 con 0x55b59b3806f0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.440+0000 7f53411a8740 1 -- 172.21.15.110:0/2853636646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5330003e20 con 0x55b59b3806f0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.440+0000 7f5320c00640 1 -- 172.21.15.110:0/2853636646 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f532400fd20 con 0x55b59b3806f0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.440+0000 7f53411a8740 10 client.25145 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.440+0000 7f53411a8740 1 -- 172.21.15.110:0/2853636646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b59aff7210 con 0x55b59b3806f0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.441+0000 7f5320c00640 1 -- 172.21.15.110:0/2853636646 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5330003e20 con 0x55b59b3806f0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.441+0000 7f5320c00640 1 -- 172.21.15.110:0/2853636646 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f532401c420 con 0x55b59b3806f0 2024-04-26T11:31:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.441+0000 7f53411a8740 10 client.25145 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.441+0000 7f53411a8740 10 client.25145 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:31:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.441+0000 7f53411a8740 20 client.25145 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.441+0000 7f53411a8740 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b59b39ada0 0x55b59b39d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.441+0000 7f53411a8740 4 client.25145 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:31:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.441+0000 7f53411a8740 1 -- 172.21.15.110:0/2853636646 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b59b2f2f90 con 0x55b59b39ada0 2024-04-26T11:31:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.441+0000 7f5337e00640 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b59b39ada0 0x55b59b39d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.442+0000 7f5337e00640 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b59b39ada0 0x55b59b39d190 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c3e78ba61d81d19 server_cookie=120c9736a904ed6b in_seq=0 out_seq=0 2024-04-26T11:31:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.442+0000 7f5320c00640 10 client.25145 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.443+0000 7f5320c00640 1 -- 172.21.15.110:0/2853636646 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b59b2f2f90 con 0x55b59b39ada0 2024-04-26T11:31:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.443+0000 7f5320c00640 10 client.25145 handle_command_reply: tid=0 2024-04-26T11:31:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.443+0000 7f53411a8740 1 client.25145 shutdown 2024-04-26T11:31:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.443+0000 7f53411a8740 1 -- 172.21.15.110:0/2853636646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 msgr2=0x55b59b388490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.443+0000 7f53411a8740 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b388490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5324012a10 tx=0x7f5324012ed0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.443+0000 7f53411a8740 1 -- 172.21.15.110:0/2853636646 shutdown_connections 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.443+0000 7f53411a8740 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3889d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.443+0000 7f53411a8740 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b3806f0 0x55b59b388490 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.443+0000 7f53411a8740 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b59b39ada0 0x55b59b39d190 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.444+0000 7f53411a8740 1 --2- 172.21.15.110:0/2853636646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b37fdd0 0x55b59b387f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.444+0000 7f5320c00640 0 client.25145 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.444+0000 7f53411a8740 1 -- 172.21.15.110:0/2853636646 >> 172.21.15.110:0/2853636646 conn(0x55b59b37c2e0 msgr2=0x55b59b382010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.444+0000 7f53411a8740 1 -- 172.21.15.110:0/2853636646 shutdown_connections 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.444+0000 7f53411a8740 1 -- 172.21.15.110:0/2853636646 wait complete. 2024-04-26T11:31:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.444+0000 7f53411a8740 20 client.25145 trim_cache size 0 max 16384 2024-04-26T11:31:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.460+0000 7f53411a8740 1 Processor -- start 2024-04-26T11:31:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.460+0000 7f53411a8740 1 -- start start 2024-04-26T11:31:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.460+0000 7f53411a8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b38a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.460+0000 7f53411a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b3806f0 0x55b59b37bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.460+0000 7f53411a8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3887f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.460+0000 7f53411a8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f53381b3230 con 0x55b59b38afb0 2024-04-26T11:31:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.460+0000 7f53411a8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f53381b0b00 con 0x55b59b37fdd0 2024-04-26T11:31:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.460+0000 7f53411a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53381ae950 con 0x55b59b3806f0 2024-04-26T11:31:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b38a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3887f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3887f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55264/0 (socket says 172.21.15.110:55264) 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5336a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b3806f0 0x55b59b37bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 -- 172.21.15.110:0/3757901968 learned_addr learned my addr 172.21.15.110:0/3757901968 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 -- 172.21.15.110:0/3757901968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b3806f0 msgr2=0x55b59b37bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 --2- 172.21.15.110:0/3757901968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b3806f0 0x55b59b37bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 -- 172.21.15.110:0/3757901968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 msgr2=0x55b59b38a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 --2- 172.21.15.110:0/3757901968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b38a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 -- 172.21.15.110:0/3757901968 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b59b39d500 con 0x55b59b38afb0 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5336a00640 1 --2- 172.21.15.110:0/3757901968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b3806f0 0x55b59b37bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.461+0000 7f5337e00640 1 --2- 172.21.15.110:0/3757901968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3887f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f533002fb40 tx=0x7f533002fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a51520e587fd266 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f5323400640 1 -- 172.21.15.110:0/3757901968 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330048040 con 0x55b59b38afb0 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f5323400640 1 -- 172.21.15.110:0/3757901968 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5330049040 con 0x55b59b38afb0 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f5323400640 1 -- 172.21.15.110:0/3757901968 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330004700 con 0x55b59b38afb0 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f53411a8740 1 -- 172.21.15.110:0/3757901968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 msgr2=0x55b59b3887f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f53411a8740 1 --2- 172.21.15.110:0/3757901968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3887f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f533002fb40 tx=0x7f533002fc10 comp rx=0 tx=0).stop 2024-04-26T11:31:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f53411a8740 1 -- 172.21.15.110:0/3757901968 shutdown_connections 2024-04-26T11:31:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f53411a8740 1 --2- 172.21.15.110:0/3757901968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b38afb0 0x55b59b3887f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f53411a8740 1 --2- 172.21.15.110:0/3757901968 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b3806f0 0x55b59b37bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f53411a8740 1 --2- 172.21.15.110:0/3757901968 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b38a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.462+0000 7f53411a8740 1 -- 172.21.15.110:0/3757901968 >> 172.21.15.110:0/3757901968 conn(0x55b59b37c2e0 msgr2=0x55b59b382010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.463+0000 7f53411a8740 1 -- 172.21.15.110:0/3757901968 shutdown_connections 2024-04-26T11:31:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.463+0000 7f53411a8740 1 -- 172.21.15.110:0/3757901968 wait complete. 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.463+0000 7f53411a8740 1 -- start start 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.463+0000 7f53411a8740 1 Processor -- start 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f53411a8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b393490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f53411a8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b3806f0 0x55b59b384ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f53411a8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b38afb0 0x55b59b385220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f53411a8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f53381aefc0 con 0x55b59b3806f0 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f53411a8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f53381b0430 con 0x55b59b37fdd0 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f53411a8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53381af690 con 0x55b59b38afb0 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f53411a8740 10 client.0 _ll_register_callbacks cb 0x7f5324009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5337e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b393490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5336a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b3806f0 0x55b59b384ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5337e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b393490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43038/0 (socket says 172.21.15.110:43038) 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5336a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b3806f0 0x55b59b384ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55280/0 (socket says 172.21.15.110:55280) 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5337e00640 1 -- 172.21.15.110:0/2636558630 learned_addr learned my addr 172.21.15.110:0/2636558630 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5337e00640 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b38afb0 0x55b59b385220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5336a00640 1 -- 172.21.15.110:0/2636558630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b38afb0 msgr2=0x55b59b385220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5336a00640 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b38afb0 0x55b59b385220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5336a00640 1 -- 172.21.15.110:0/2636558630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 msgr2=0x55b59b393490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5336a00640 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b393490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5336a00640 1 -- 172.21.15.110:0/2636558630 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b59b0c3620 con 0x55b59b3806f0 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.464+0000 7f5337e00640 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b393490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.465+0000 7f5336a00640 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b3806f0 0x55b59b384ae0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5324000c00 tx=0x7f532401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2637d4a19e26d46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.465+0000 7f5320c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.465+0000 7f5320c00640 1 -- 172.21.15.110:0/2636558630 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532401c630 con 0x55b59b3806f0 2024-04-26T11:31:33.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.465+0000 7f5320c00640 1 -- 172.21.15.110:0/2636558630 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f53240050d0 con 0x55b59b3806f0 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.465+0000 7f53411a8740 1 -- 172.21.15.110:0/2636558630 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5330049040 con 0x55b59b3806f0 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.465+0000 7f5320c00640 1 -- 172.21.15.110:0/2636558630 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5324030050 con 0x55b59b3806f0 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.465+0000 7f53411a8740 10 client.15063 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.465+0000 7f53411a8740 1 -- 172.21.15.110:0/2636558630 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b59b29fcb0 con 0x55b59b3806f0 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.465+0000 7f5320c00640 1 -- 172.21.15.110:0/2636558630 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5330049040 con 0x55b59b3806f0 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f5320c00640 1 -- 172.21.15.110:0/2636558630 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f53240038d0 con 0x55b59b3806f0 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f53411a8740 10 client.15063 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f53411a8740 10 client.15063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f53411a8740 20 client.15063 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f53411a8740 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b59b401890 0x55b59b403c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f53411a8740 4 client.15063 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f53411a8740 1 -- 172.21.15.110:0/2636558630 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b59b2ece00 con 0x55b59b401890 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f5337e00640 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b59b401890 0x55b59b403c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f5337e00640 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b59b401890 0x55b59b403c80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=370a5d3236b083db server_cookie=c8397961c9bd588d in_seq=0 out_seq=0 2024-04-26T11:31:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.466+0000 7f5320c00640 10 client.15063 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.477+0000 7f5320c00640 1 -- 172.21.15.110:0/2636558630 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b59b2ece00 con 0x55b59b401890 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.477+0000 7f5320c00640 10 client.15063 handle_command_reply: tid=0 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.477+0000 7f53411a8740 1 client.15063 shutdown 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.477+0000 7f53411a8740 1 -- 172.21.15.110:0/2636558630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b3806f0 msgr2=0x55b59b384ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.477+0000 7f53411a8740 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b3806f0 0x55b59b384ae0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5324000c00 tx=0x7f532401cce0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f53411a8740 1 -- 172.21.15.110:0/2636558630 shutdown_connections 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f53411a8740 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b59b401890 0x55b59b403c80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f53411a8740 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b59b38afb0 0x55b59b385220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f53411a8740 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b59b3806f0 0x55b59b384ae0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f53411a8740 1 --2- 172.21.15.110:0/2636558630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b59b37fdd0 0x55b59b393490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f5320c00640 0 client.15063 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f53411a8740 1 -- 172.21.15.110:0/2636558630 >> 172.21.15.110:0/2636558630 conn(0x55b59b37c2e0 msgr2=0x55b59b395a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f53411a8740 1 -- 172.21.15.110:0/2636558630 shutdown_connections 2024-04-26T11:31:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f53411a8740 1 -- 172.21.15.110:0/2636558630 wait complete. 2024-04-26T11:31:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.478+0000 7f53411a8740 20 client.15063 trim_cache size 0 max 16384 2024-04-26T11:31:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:31:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:31:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:31:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:31:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 -- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f531c0a3e60 msgr2=0x7f531c0a6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f531c0a3e60 0x7f531c0a6320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53280ce330 tx=0x7f53280d4720 comp rx=0 tx=0).stop 2024-04-26T11:31:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 -- 172.21.15.110:0/274609944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5338074d60 msgr2=0x7f533819b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5338074d60 0x7f533819b280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f532800ea60 tx=0x7f532800ef20 comp rx=0 tx=0).stop 2024-04-26T11:31:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 -- 172.21.15.110:0/274609944 shutdown_connections 2024-04-26T11:31:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f531c0a3e60 0x7f531c0a6320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f533810f160 0x7f533819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5338075680 0x7f533819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 --2- 172.21.15.110:0/274609944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5338074d60 0x7f533819b280 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 -- 172.21.15.110:0/274609944 >> 172.21.15.110:0/274609944 conn(0x7f53380fe3d0 msgr2=0x7f53380ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 -- 172.21.15.110:0/274609944 shutdown_connections 2024-04-26T11:31:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:33.479+0000 7f533e200640 1 -- 172.21.15.110:0/274609944 wait complete. 2024-04-26T11:31:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:33 smithi196 ceph-mon[32572]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T11:31:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:33 smithi110 ceph-mon[28069]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T11:31:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:33 smithi193 ceph-mon[32782]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T11:31:34.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.955+0000 7f1f2c000700 1 -- 172.21.15.110:0/1279966219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 msgr2=0x7f1f24105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:34.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.955+0000 7f1f2c000700 1 --2- 172.21.15.110:0/1279966219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 0x7f1f24105ac0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1f100098f0 tx=0x7f1f10009c00 comp rx=0 tx=0).stop 2024-04-26T11:31:34.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.955+0000 7f1f2c000700 1 -- 172.21.15.110:0/1279966219 shutdown_connections 2024-04-26T11:31:34.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.955+0000 7f1f2c000700 1 --2- 172.21.15.110:0/1279966219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f24106000 0x7f1f24112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:34.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.955+0000 7f1f2c000700 1 --2- 172.21.15.110:0/1279966219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2410b640 0x7f1f2410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:34.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.955+0000 7f1f2c000700 1 --2- 172.21.15.110:0/1279966219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 0x7f1f24105ac0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:34.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.955+0000 7f1f2c000700 1 -- 172.21.15.110:0/1279966219 >> 172.21.15.110:0/1279966219 conn(0x7f1f24101130 msgr2=0x7f1f24103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:34.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.955+0000 7f1f2c000700 1 -- 172.21.15.110:0/1279966219 shutdown_connections 2024-04-26T11:31:34.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.955+0000 7f1f2c000700 1 -- 172.21.15.110:0/1279966219 wait complete. 2024-04-26T11:31:34.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.956+0000 7f1f2c000700 1 Processor -- start 2024-04-26T11:31:34.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.956+0000 7f1f2c000700 1 -- start start 2024-04-26T11:31:34.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f2c000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 0x7f1f2419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:34.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f2c000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f24106000 0x7f1f2419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:34.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f2c000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2410b640 0x7f1f241a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:34.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f2c000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1f24115890 con 0x7f1f24105640 2024-04-26T11:31:34.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f2c000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1f24115710 con 0x7f1f24106000 2024-04-26T11:31:34.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f2c000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1f24115a10 con 0x7f1f2410b640 2024-04-26T11:31:34.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f29600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 0x7f1f2419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:34.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f29600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 0x7f1f2419bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55296/0 (socket says 172.21.15.110:55296) 2024-04-26T11:31:34.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f29600700 1 -- 172.21.15.110:0/3710377051 learned_addr learned my addr 172.21.15.110:0/3710377051 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:34.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f2a000700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2410b640 0x7f1f241a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:34.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.957+0000 7f1f28c00700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f24106000 0x7f1f2419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:34.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f29600700 1 -- 172.21.15.110:0/3710377051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2410b640 msgr2=0x7f1f241a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:34.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f29600700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2410b640 0x7f1f241a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:34.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f29600700 1 -- 172.21.15.110:0/3710377051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f24106000 msgr2=0x7f1f2419c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:34.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f29600700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f24106000 0x7f1f2419c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:34.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f29600700 1 -- 172.21.15.110:0/3710377051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f241a0d90 con 0x7f1f24105640 2024-04-26T11:31:34.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f2a000700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2410b640 0x7f1f241a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:34.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f29600700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 0x7f1f2419bd80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800e9c0 tx=0x7f1f1800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:34.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f22000700 1 -- 172.21.15.110:0/3710377051 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800cbd0 con 0x7f1f24105640 2024-04-26T11:31:34.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f241a1080 con 0x7f1f24105640 2024-04-26T11:31:34.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f22000700 1 -- 172.21.15.110:0/3710377051 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f1800ee60 con 0x7f1f24105640 2024-04-26T11:31:34.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f22000700 1 -- 172.21.15.110:0/3710377051 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180055c0 con 0x7f1f24105640 2024-04-26T11:31:34.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.958+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f241a8900 con 0x7f1f24105640 2024-04-26T11:31:34.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.960+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2406a110 con 0x7f1f24105640 2024-04-26T11:31:34.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.962+0000 7f1f22000700 1 -- 172.21.15.110:0/3710377051 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7f1f18004750 con 0x7f1f24105640 2024-04-26T11:31:34.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.963+0000 7f1f22000700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f0c0a3e40 0x7f1f0c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:34.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.964+0000 7f1f22000700 1 -- 172.21.15.110:0/3710377051 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f1f180d0eb0 con 0x7f1f24105640 2024-04-26T11:31:34.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.964+0000 7f1f28c00700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f0c0a3e40 0x7f1f0c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:34.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.965+0000 7f1f28c00700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f0c0a3e40 0x7f1f0c0a6300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f100098c0 tx=0x7f1f10019040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:34.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:34.967+0000 7f1f22000700 1 -- 172.21.15.110:0/3710377051 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1f18053ff0 con 0x7f1f24105640 2024-04-26T11:31:35.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.241+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f2419d0e0 con 0x7f1f24105640 2024-04-26T11:31:35.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.242+0000 7f1f22000700 1 -- 172.21.15.110:0/3710377051 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11889 (secure 0 0 0) 0x7f1f1809d300 con 0x7f1f24105640 2024-04-26T11:31:35.244 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:31:35.244 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:31:16.187674+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24487,24502,24518]},"id":1}]} 2024-04-26T11:31:35.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f0c0a3e40 msgr2=0x7f1f0c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:35.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f0c0a3e40 0x7f1f0c0a6300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f100098c0 tx=0x7f1f10019040 comp rx=0 tx=0).stop 2024-04-26T11:31:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 msgr2=0x7f1f2419bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 0x7f1f2419bd80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800e9c0 tx=0x7f1f1800ecd0 comp rx=0 tx=0).stop 2024-04-26T11:31:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 shutdown_connections 2024-04-26T11:31:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f0c0a3e40 0x7f1f0c0a6300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f2410b640 0x7f1f241a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f24105640 0x7f1f2419bd80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 --2- 172.21.15.110:0/3710377051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f24106000 0x7f1f2419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.245+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 >> 172.21.15.110:0/3710377051 conn(0x7f1f24101130 msgr2=0x7f1f24101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:35.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.246+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 shutdown_connections 2024-04-26T11:31:35.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:35.246+0000 7f1f2c000700 1 -- 172.21.15.110:0/3710377051 wait complete. 2024-04-26T11:31:35.248 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 26 2024-04-26T11:31:36.002 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:35 smithi110 ceph-mon[28069]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-04-26T11:31:36.002 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:35 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3710377051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:31:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:35 smithi196 ceph-mon[32572]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-04-26T11:31:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:35 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3710377051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:31:36.051 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:31:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:35 smithi193 ceph-mon[32782]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-04-26T11:31:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:35 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3710377051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:31:36.499 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:37 smithi196 ceph-mon[32572]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:31:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:37 smithi110 ceph-mon[28069]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:31:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:37 smithi193 ceph-mon[32782]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T11:31:38.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.883+0000 7fa203200700 1 -- 172.21.15.110:0/3662631795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc109a90 msgr2=0x7fa1fc109f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:38.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.883+0000 7fa203200700 1 --2- 172.21.15.110:0/3662631795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc109a90 0x7fa1fc109f10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009990 tx=0x7fa1e8009ca0 comp rx=0 tx=0).stop 2024-04-26T11:31:38.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.883+0000 7fa203200700 1 -- 172.21.15.110:0/3662631795 shutdown_connections 2024-04-26T11:31:38.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.883+0000 7fa203200700 1 --2- 172.21.15.110:0/3662631795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1fc10a450 0x7fa1fc116910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:38.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.883+0000 7fa203200700 1 --2- 172.21.15.110:0/3662631795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1fc10fa40 0x7fa1fc10fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:38.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.883+0000 7fa203200700 1 --2- 172.21.15.110:0/3662631795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc109a90 0x7fa1fc109f10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:38.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.883+0000 7fa203200700 1 -- 172.21.15.110:0/3662631795 >> 172.21.15.110:0/3662631795 conn(0x7fa1fc076bf0 msgr2=0x7fa1fc079010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:38.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.883+0000 7fa203200700 1 -- 172.21.15.110:0/3662631795 shutdown_connections 2024-04-26T11:31:38.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.884+0000 7fa203200700 1 -- 172.21.15.110:0/3662631795 wait complete. 2024-04-26T11:31:38.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.885+0000 7fa203200700 1 Processor -- start 2024-04-26T11:31:38.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.885+0000 7fa203200700 1 -- start start 2024-04-26T11:31:38.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.885+0000 7fa203200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1fc109a90 0x7fa1fc1a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:38.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.885+0000 7fa203200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc10a450 0x7fa1fc1a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:38.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.885+0000 7fa203200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1fc10fa40 0x7fa1fc1a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:38.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa203200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc119cd0 con 0x7fa1fc10a450 2024-04-26T11:31:38.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa203200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc119b50 con 0x7fa1fc109a90 2024-04-26T11:31:38.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa203200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc119e50 con 0x7fa1fc10fa40 2024-04-26T11:31:38.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa1fb400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc10a450 0x7fa1fc1a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:38.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa1fb400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc10a450 0x7fa1fc1a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55318/0 (socket says 172.21.15.110:55318) 2024-04-26T11:31:38.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa1fb400700 1 -- 172.21.15.110:0/2070761326 learned_addr learned my addr 172.21.15.110:0/2070761326 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:38.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa1fbe00700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1fc109a90 0x7fa1fc1a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:38.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa201200700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1fc10fa40 0x7fa1fc1a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:38.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa1fb400700 1 -- 172.21.15.110:0/2070761326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1fc10fa40 msgr2=0x7fa1fc1a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:38.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa1fb400700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1fc10fa40 0x7fa1fc1a4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:38.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa1fb400700 1 -- 172.21.15.110:0/2070761326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1fc109a90 msgr2=0x7fa1fc1a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:38.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa1fb400700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1fc109a90 0x7fa1fc1a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:38.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.886+0000 7fa1fb400700 1 -- 172.21.15.110:0/2070761326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc1a5190 con 0x7fa1fc10a450 2024-04-26T11:31:38.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.887+0000 7fa1fb400700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc10a450 0x7fa1fc1a06c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005910 tx=0x7fa1e80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:38.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.887+0000 7fa1f8c00700 1 -- 172.21.15.110:0/2070761326 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8027070 con 0x7fa1fc10a450 2024-04-26T11:31:38.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.887+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1fc1a5420 con 0x7fa1fc10a450 2024-04-26T11:31:38.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.887+0000 7fa1f8c00700 1 -- 172.21.15.110:0/2070761326 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1e8003f20 con 0x7fa1fc10a450 2024-04-26T11:31:38.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.887+0000 7fa1f8c00700 1 -- 172.21.15.110:0/2070761326 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8022c60 con 0x7fa1fc10a450 2024-04-26T11:31:38.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.888+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1fc1acd00 con 0x7fa1fc10a450 2024-04-26T11:31:38.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.889+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1fc06a110 con 0x7fa1fc10a450 2024-04-26T11:31:38.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.891+0000 7fa1f8c00700 1 -- 172.21.15.110:0/2070761326 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7fa1e802a070 con 0x7fa1fc10a450 2024-04-26T11:31:38.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.892+0000 7fa1f8c00700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa1e00a3e40 0x7fa1e00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:38.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.893+0000 7fa1f8c00700 1 -- 172.21.15.110:0/2070761326 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fa1e8022e00 con 0x7fa1fc10a450 2024-04-26T11:31:38.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.893+0000 7fa1fbe00700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa1e00a3e40 0x7fa1e00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:38.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.894+0000 7fa1fbe00700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa1e00a3e40 0x7fa1e00a6300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec007b60 tx=0x7fa1ec0073d0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:38.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:38.897+0000 7fa1f8c00700 1 -- 172.21.15.110:0/2070761326 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa1e805eff0 con 0x7fa1fc10a450 2024-04-26T11:31:39.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.175+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1fc1a14e0 con 0x7fa1fc10a450 2024-04-26T11:31:39.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.177+0000 7fa1f8c00700 1 -- 172.21.15.110:0/2070761326 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11889 (secure 0 0 0) 0x7fa1e8013070 con 0x7fa1fc10a450 2024-04-26T11:31:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:31:39.178 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:31:16.187674+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24487,24502,24518]},"id":1}]} 2024-04-26T11:31:39.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa1e00a3e40 msgr2=0x7fa1e00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:39.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa1e00a3e40 0x7fa1e00a6300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec007b60 tx=0x7fa1ec0073d0 comp rx=0 tx=0).stop 2024-04-26T11:31:39.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc10a450 msgr2=0x7fa1fc1a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:39.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc10a450 0x7fa1fc1a06c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005910 tx=0x7fa1e80047b0 comp rx=0 tx=0).stop 2024-04-26T11:31:39.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 shutdown_connections 2024-04-26T11:31:39.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa1e00a3e40 0x7fa1e00a6300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:39.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1fc10fa40 0x7fa1fc1a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:39.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1fc109a90 0x7fa1fc1a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:39.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 --2- 172.21.15.110:0/2070761326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1fc10a450 0x7fa1fc1a06c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:39.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 >> 172.21.15.110:0/2070761326 conn(0x7fa1fc076bf0 msgr2=0x7fa1fc077440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:39.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 shutdown_connections 2024-04-26T11:31:39.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:39.180+0000 7fa203200700 1 -- 172.21.15.110:0/2070761326 wait complete. 2024-04-26T11:31:39.183 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 26 2024-04-26T11:31:39.996 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:39 smithi110 ceph-mon[28069]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-26T11:31:39.996 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:39 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2070761326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:31:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:39 smithi196 ceph-mon[32572]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-26T11:31:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:39 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2070761326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:31:40.071 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T11:31:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:39 smithi193 ceph-mon[32782]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-26T11:31:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:39 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2070761326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:31:40.517 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:41 smithi196 ceph-mon[32572]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T11:31:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:41 smithi110 ceph-mon[28069]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T11:31:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:41 smithi193 ceph-mon[32782]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T11:31:42.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.742+0000 7fa0e2e00700 1 -- 172.21.15.110:0/3285387856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc10fe20 msgr2=0x7fa0dc112210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:42.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.742+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/3285387856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc10fe20 0x7fa0dc112210 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400b0a0 tx=0x7fa0d400b3b0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.742+0000 7fa0e2e00700 1 -- 172.21.15.110:0/3285387856 shutdown_connections 2024-04-26T11:31:42.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.742+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/3285387856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc10fe20 0x7fa0dc112210 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.742+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/3285387856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0dc075650 0x7fa0dc075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.742+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/3285387856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0dc075f70 0x7fa0dc10f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.742+0000 7fa0e2e00700 1 -- 172.21.15.110:0/3285387856 >> 172.21.15.110:0/3285387856 conn(0x7fa0dc07a580 msgr2=0x7fa0dc07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:42.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.742+0000 7fa0e2e00700 1 -- 172.21.15.110:0/3285387856 shutdown_connections 2024-04-26T11:31:42.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.742+0000 7fa0e2e00700 1 -- 172.21.15.110:0/3285387856 wait complete. 2024-04-26T11:31:42.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.743+0000 7fa0e2e00700 1 Processor -- start 2024-04-26T11:31:42.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.743+0000 7fa0e2e00700 1 -- start start 2024-04-26T11:31:42.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0e2e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0dc075650 0x7fa0dc1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:42.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0e2e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc075f70 0x7fa0dc1a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:42.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0e2e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0dc10fe20 0x7fa0dc19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:42.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0e2e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc115850 con 0x7fa0dc075650 2024-04-26T11:31:42.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0e2e00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc1156d0 con 0x7fa0dc10fe20 2024-04-26T11:31:42.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0e2e00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc1159d0 con 0x7fa0dc075f70 2024-04-26T11:31:42.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0db400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc075f70 0x7fa0dc1a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:42.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0dbe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0dc075650 0x7fa0dc1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:42.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0db400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc075f70 0x7fa0dc1a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:40116/0 (socket says 172.21.15.110:40116) 2024-04-26T11:31:42.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.744+0000 7fa0db400700 1 -- 172.21.15.110:0/433176365 learned_addr learned my addr 172.21.15.110:0/433176365 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:42.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0e0e00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0dc10fe20 0x7fa0dc19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:42.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0db400700 1 -- 172.21.15.110:0/433176365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0dc10fe20 msgr2=0x7fa0dc19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:42.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0db400700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0dc10fe20 0x7fa0dc19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0db400700 1 -- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0dc075650 msgr2=0x7fa0dc1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:42.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0db400700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0dc075650 0x7fa0dc1a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0db400700 1 -- 172.21.15.110:0/433176365 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc19c210 con 0x7fa0dc075f70 2024-04-26T11:31:42.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0dbe00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0dc075650 0x7fa0dc1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:42.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0db400700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc075f70 0x7fa0dc1a1e30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800eb30 tx=0x7fa0c800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:42.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0d8c00700 1 -- 172.21.15.110:0/433176365 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c800cbd0 con 0x7fa0dc075f70 2024-04-26T11:31:42.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0d8c00700 1 -- 172.21.15.110:0/433176365 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0c80044d0 con 0x7fa0dc075f70 2024-04-26T11:31:42.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.745+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc19c500 con 0x7fa0dc075f70 2024-04-26T11:31:42.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.746+0000 7fa0d8c00700 1 -- 172.21.15.110:0/433176365 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8003e30 con 0x7fa0dc075f70 2024-04-26T11:31:42.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.746+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc1a87c0 con 0x7fa0dc075f70 2024-04-26T11:31:42.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.747+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc06a110 con 0x7fa0dc075f70 2024-04-26T11:31:42.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.749+0000 7fa0d8c00700 1 -- 172.21.15.110:0/433176365 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7fa0c8004000 con 0x7fa0dc075f70 2024-04-26T11:31:42.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.750+0000 7fa0d8c00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa0c00a3ec0 0x7fa0c00a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:42.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.751+0000 7fa0d8c00700 1 -- 172.21.15.110:0/433176365 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fa0c80d0e30 con 0x7fa0dc075f70 2024-04-26T11:31:42.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.751+0000 7fa0dbe00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa0c00a3ec0 0x7fa0c00a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:42.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.751+0000 7fa0dbe00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa0c00a3ec0 0x7fa0c00a6380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc19cbf0 tx=0x7fa0cc009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:42.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.752+0000 7fa0d8c00700 1 -- 172.21.15.110:0/433176365 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa0c80042f0 con 0x7fa0dc075f70 2024-04-26T11:31:42.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.980+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0dc02e490 con 0x7fa0dc075f70 2024-04-26T11:31:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.982+0000 7fa0d8c00700 1 -- 172.21.15.110:0/433176365 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+23398 (secure 0 0 0) 0x7fa0c809d280 con 0x7fa0dc075f70 2024-04-26T11:31:42.985 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:31:42.985 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":94,"fsid":"6e439470-03be-11ef-bc93-c7b262605968","created":"2024-04-26T11:17:56.437545+0000","modified":"2024-04-26T11:31:16.072715+0000","last_up_change":"2024-04-26T11:25:57.427695+0000","last_in_change":"2024-04-26T11:25:38.050280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:44.478027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:27:06.034467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T11:27:11.025123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13eb997d-8b4a-47f5-be11-772d47788972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6803","nonce":1662740885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6805","nonce":1662740885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6809","nonce":1662740885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1662740885},{"type":"v1","addr":"172.21.15.110:6807","nonce":1662740885}]},"public_addr":"172.21.15.110:6803/1662740885","cluster_addr":"172.21.15.110:6805/1662740885","heartbeat_back_addr":"172.21.15.110:6809/1662740885","heartbeat_front_addr":"172.21.15.110:6807/1662740885","state":["exists","up"]},{"osd":1,"uuid":"e7927dc3-dced-4661-8493-840e111241e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6801","nonce":1751461680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6803","nonce":1751461680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6807","nonce":1751461680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1751461680},{"type":"v1","addr":"172.21.15.193:6805","nonce":1751461680}]},"public_addr":"172.21.15.193:6801/1751461680","cluster_addr":"172.21.15.193:6803/1751461680","heartbeat_back_addr":"172.21.15.193:6807/1751461680","heartbeat_front_addr":"172.21.15.193:6805/1751461680","state":["exists","up"]},{"osd":2,"uuid":"54459a80-91a1-45ba-b7e4-900a4a995219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6801","nonce":1785522554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6803","nonce":1785522554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6807","nonce":1785522554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":1785522554},{"type":"v1","addr":"172.21.15.196:6805","nonce":1785522554}]},"public_addr":"172.21.15.196:6801/1785522554","cluster_addr":"172.21.15.196:6803/1785522554","heartbeat_back_addr":"172.21.15.196:6807/1785522554","heartbeat_front_addr":"172.21.15.196:6805/1785522554","state":["exists","up"]},{"osd":3,"uuid":"12d8a1be-5edb-4af2-b01d-abd943f89641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6811","nonce":2253549266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6813","nonce":2253549266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6817","nonce":2253549266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2253549266},{"type":"v1","addr":"172.21.15.110:6815","nonce":2253549266}]},"public_addr":"172.21.15.110:6811/2253549266","cluster_addr":"172.21.15.110:6813/2253549266","heartbeat_back_addr":"172.21.15.110:6817/2253549266","heartbeat_front_addr":"172.21.15.110:6815/2253549266","state":["exists","up"]},{"osd":4,"uuid":"f3057080-144b-4f43-9a63-8f415ca76d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6809","nonce":1314161856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6811","nonce":1314161856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6815","nonce":1314161856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1314161856},{"type":"v1","addr":"172.21.15.193:6813","nonce":1314161856}]},"public_addr":"172.21.15.193:6809/1314161856","cluster_addr":"172.21.15.193:6811/1314161856","heartbeat_back_addr":"172.21.15.193:6815/1314161856","heartbeat_front_addr":"172.21.15.193:6813/1314161856","state":["exists","up"]},{"osd":5,"uuid":"f0775b9c-938e-4bb4-ae1e-01ef0686cc66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6809","nonce":2359280243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6811","nonce":2359280243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6815","nonce":2359280243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2359280243},{"type":"v1","addr":"172.21.15.196:6813","nonce":2359280243}]},"public_addr":"172.21.15.196:6809/2359280243","cluster_addr":"172.21.15.196:6811/2359280243","heartbeat_back_addr":"172.21.15.196:6815/2359280243","heartbeat_front_addr":"172.21.15.196:6813/2359280243","state":["exists","up"]},{"osd":6,"uuid":"ea4ea3de-4ec4-48a1-809e-da62fcbb7033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6819","nonce":1730783886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6821","nonce":1730783886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6825","nonce":1730783886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1730783886},{"type":"v1","addr":"172.21.15.110:6823","nonce":1730783886}]},"public_addr":"172.21.15.110:6819/1730783886","cluster_addr":"172.21.15.110:6821/1730783886","heartbeat_back_addr":"172.21.15.110:6825/1730783886","heartbeat_front_addr":"172.21.15.110:6823/1730783886","state":["exists","up"]},{"osd":7,"uuid":"98af7071-82b3-4732-b2a1-8676e6439cd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6817","nonce":4124476381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6819","nonce":4124476381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6823","nonce":4124476381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":4124476381},{"type":"v1","addr":"172.21.15.193:6821","nonce":4124476381}]},"public_addr":"172.21.15.193:6817/4124476381","cluster_addr":"172.21.15.193:6819/4124476381","heartbeat_back_addr":"172.21.15.193:6823/4124476381","heartbeat_front_addr":"172.21.15.193:6821/4124476381","state":["exists","up"]},{"osd":8,"uuid":"7aaa3c52-72f5-4946-a964-609f65b778f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6817","nonce":2942176519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6819","nonce":2942176519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6823","nonce":2942176519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":2942176519},{"type":"v1","addr":"172.21.15.196:6821","nonce":2942176519}]},"public_addr":"172.21.15.196:6817/2942176519","cluster_addr":"172.21.15.196:6819/2942176519","heartbeat_back_addr":"172.21.15.196:6823/2942176519","heartbeat_front_addr":"172.21.15.196:6821/2942176519","state":["exists","up"]},{"osd":9,"uuid":"2cde3ed2-6acd-48a4-a99d-aa558dd85baa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6827","nonce":2620757358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6829","nonce":2620757358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6833","nonce":2620757358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2620757358},{"type":"v1","addr":"172.21.15.110:6831","nonce":2620757358}]},"public_addr":"172.21.15.110:6827/2620757358","cluster_addr":"172.21.15.110:6829/2620757358","heartbeat_back_addr":"172.21.15.110:6833/2620757358","heartbeat_front_addr":"172.21.15.110:6831/2620757358","state":["exists","up"]},{"osd":10,"uuid":"3bbaac8f-fe7b-4f0e-a25b-286c3c30926e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6825","nonce":676480728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6827","nonce":676480728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6831","nonce":676480728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":676480728},{"type":"v1","addr":"172.21.15.193:6829","nonce":676480728}]},"public_addr":"172.21.15.193:6825/676480728","cluster_addr":"172.21.15.193:6827/676480728","heartbeat_back_addr":"172.21.15.193:6831/676480728","heartbeat_front_addr":"172.21.15.193:6829/676480728","state":["exists","up"]},{"osd":11,"uuid":"e31c248e-1016-4765-bea1-9f31d823ca3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6825","nonce":2802765812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6827","nonce":2802765812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6831","nonce":2802765812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":2802765812},{"type":"v1","addr":"172.21.15.196:6829","nonce":2802765812}]},"public_addr":"172.21.15.196:6825/2802765812","cluster_addr":"172.21.15.196:6827/2802765812","heartbeat_back_addr":"172.21.15.196:6831/2802765812","heartbeat_front_addr":"172.21.15.196:6829/2802765812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:20:52.046788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:16.893940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:40.861409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:13.272469+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:22:39.214479+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:03.529206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:23:37.413989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:04.145639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:24:29.162356+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:03.325672+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:30.353695+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:25:56.267402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/813190132":"2024-04-27T11:31:16.072608+0000","172.21.15.110:6800/2430566216":"2024-04-27T11:31:16.072608+0000","172.21.15.110:0/3329534526":"2024-04-27T11:31:16.072608+0000","172.21.15.110:0/3278958945":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2963218593":"2024-04-27T11:31:16.072608+0000","172.21.15.110:6801/4292256031":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3536224934":"2024-04-27T11:19:02.329691+0000","172.21.15.110:0/2250601964":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/2775667488":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/3533907291":"2024-04-27T11:31:16.072608+0000","172.21.15.110:6801/878579821":"2024-04-27T11:18:29.387925+0000","172.21.15.110:0/337370067":"2024-04-27T11:18:29.387925+0000","172.21.15.110:6801/2430566216":"2024-04-27T11:31:16.072608+0000","172.21.15.110:0/3594651859":"2024-04-27T11:19:02.329691+0000","172.21.15.110:6800/4292256031":"2024-04-27T11:19:02.329691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:31:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa0c00a3ec0 msgr2=0x7fa0c00a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa0c00a3ec0 0x7fa0c00a6380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc19cbf0 tx=0x7fa0cc009260 comp rx=0 tx=0).stop 2024-04-26T11:31:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc075f70 msgr2=0x7fa0dc1a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc075f70 0x7fa0dc1a1e30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800eb30 tx=0x7fa0c800ee40 comp rx=0 tx=0).stop 2024-04-26T11:31:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 shutdown_connections 2024-04-26T11:31:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa0c00a3ec0 0x7fa0c00a6380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0dc10fe20 0x7fa0dc19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0dc075650 0x7fa0dc1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 --2- 172.21.15.110:0/433176365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa0dc075f70 0x7fa0dc1a1e30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 >> 172.21.15.110:0/433176365 conn(0x7fa0dc07a580 msgr2=0x7fa0dc1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 shutdown_connections 2024-04-26T11:31:42.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:42.986+0000 7fa0e2e00700 1 -- 172.21.15.110:0/433176365 wait complete. 2024-04-26T11:31:43.902 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-04-26T11:31:43.979 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:43 smithi110 ceph-mon[28069]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T11:31:43.979 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:43 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/433176365' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:31:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:43 smithi196 ceph-mon[32572]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T11:31:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:43 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/433176365' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:31:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:43 smithi193 ceph-mon[32782]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T11:31:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:43 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/433176365' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T11:31:44.376 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:45 smithi110 ceph-mon[28069]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-26T11:31:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:45 smithi196 ceph-mon[32572]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-26T11:31:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:45 smithi193 ceph-mon[32782]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-26T11:31:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.627+0000 7f090d400640 1 -- 172.21.15.110:0/1862415008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0908108e70 msgr2=0x7f09081092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.627+0000 7f090d400640 1 --2- 172.21.15.110:0/1862415008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0908108e70 0x7f09081092b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009890 tx=0x7f08f002a360 comp rx=0 tx=0).stop 2024-04-26T11:31:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.627+0000 7f090d400640 1 -- 172.21.15.110:0/1862415008 shutdown_connections 2024-04-26T11:31:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.627+0000 7f090d400640 1 --2- 172.21.15.110:0/1862415008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09081097f0 0x7f0908115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.627+0000 7f090d400640 1 --2- 172.21.15.110:0/1862415008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0908108e70 0x7f09081092b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.627+0000 7f090d400640 1 --2- 172.21.15.110:0/1862415008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090810ee00 0x7f090810f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.627+0000 7f090d400640 1 -- 172.21.15.110:0/1862415008 >> 172.21.15.110:0/1862415008 conn(0x7f0908078710 msgr2=0x7f0908107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.627+0000 7f090d400640 1 -- 172.21.15.110:0/1862415008 shutdown_connections 2024-04-26T11:31:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.627+0000 7f090d400640 1 -- 172.21.15.110:0/1862415008 wait complete. 2024-04-26T11:31:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.628+0000 7f090d400640 1 Processor -- start 2024-04-26T11:31:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.628+0000 7f090d400640 1 -- start start 2024-04-26T11:31:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f090d400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0908108e70 0x7f090819f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f090d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09081097f0 0x7f090819fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f090d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090810ee00 0x7f09081a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f090d400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0908118fd0 con 0x7f090810ee00 2024-04-26T11:31:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f090d400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0908118e50 con 0x7f0908108e70 2024-04-26T11:31:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f090d400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0908119150 con 0x7f09081097f0 2024-04-26T11:31:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f0907e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0908108e70 0x7f090819f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f0907e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0908108e70 0x7f090819f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:49050/0 (socket says 172.21.15.110:49050) 2024-04-26T11:31:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f0907e00640 1 -- 172.21.15.110:0/3867937936 learned_addr learned my addr 172.21.15.110:0/3867937936 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f090ca00640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090810ee00 0x7f09081a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.629+0000 7f08ffe00640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09081097f0 0x7f090819fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.630+0000 7f0907e00640 1 -- 172.21.15.110:0/3867937936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09081097f0 msgr2=0x7f090819fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.630+0000 7f0907e00640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09081097f0 0x7f090819fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.630+0000 7f0907e00640 1 -- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090810ee00 msgr2=0x7f09081a3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.630+0000 7f0907e00640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090810ee00 0x7f09081a3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.630+0000 7f0907e00640 1 -- 172.21.15.110:0/3867937936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09081a45e0 con 0x7f0908108e70 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.630+0000 7f0907e00640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0908108e70 0x7f090819f5f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f08f800e9f0 tx=0x7f08f800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.630+0000 7f0905600640 1 -- 172.21.15.110:0/3867937936 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f800cd80 con 0x7f0908108e70 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.630+0000 7f0905600640 1 -- 172.21.15.110:0/3867937936 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08f80108e0 con 0x7f0908108e70 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.630+0000 7f090d400640 1 -- 172.21.15.110:0/3867937936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09081a48d0 con 0x7f0908108e70 2024-04-26T11:31:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.631+0000 7f0905600640 1 -- 172.21.15.110:0/3867937936 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8018980 con 0x7f0908108e70 2024-04-26T11:31:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.631+0000 7f090d400640 1 -- 172.21.15.110:0/3867937936 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09081ac160 con 0x7f0908108e70 2024-04-26T11:31:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.634+0000 7f0911861740 1 Processor -- start 2024-04-26T11:31:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.634+0000 7f0911861740 1 -- start start 2024-04-26T11:31:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.634+0000 7f0905600640 1 -- 172.21.15.110:0/3867937936 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7f08f8010430 con 0x7f0908108e70 2024-04-26T11:31:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.634+0000 7f0911861740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e8b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.634+0000 7f0911861740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8b900 0x55ad56e95c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.634+0000 7f0911861740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 0x55ad56e985b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.634+0000 7f0911861740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ad56df0380 con 0x55ad56e8afe0 2024-04-26T11:31:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.634+0000 7f0911861740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ad56d8cc30 con 0x55ad56e961c0 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.634+0000 7f0911861740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ad56dec340 con 0x55ad56e8b900 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f090ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e8b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f090ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e8b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48470/0 (socket says 172.21.15.110:48470) 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f090ca00640 1 -- 172.21.15.110:0/4070458070 learned_addr learned my addr 172.21.15.110:0/4070458070 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f0907e00640 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8b900 0x55ad56e95c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f08ffe00640 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 0x55ad56e985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f090ca00640 1 -- 172.21.15.110:0/4070458070 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8b900 msgr2=0x55ad56e95c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f090ca00640 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8b900 0x55ad56e95c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f090ca00640 1 -- 172.21.15.110:0/4070458070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 msgr2=0x55ad56e985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f090ca00640 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 0x55ad56e985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f090ca00640 1 -- 172.21.15.110:0/4070458070 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad56dae940 con 0x55ad56e8afe0 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f08ffe00640 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 0x55ad56e985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:31:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.635+0000 7f090ca00640 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e8b3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f090000e580 tx=0x7f09000095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254f32094f7fbb2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f08fd200640 1 -- 172.21.15.110:0/4070458070 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900003970 con 0x55ad56e8afe0 2024-04-26T11:31:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f08fd200640 1 -- 172.21.15.110:0/4070458070 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f090000d830 con 0x55ad56e8afe0 2024-04-26T11:31:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f08fd200640 1 -- 172.21.15.110:0/4070458070 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900004450 con 0x55ad56e8afe0 2024-04-26T11:31:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0905600640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f08ec0a3da0 0x7f08ec0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0905600640 1 -- 172.21.15.110:0/3867937936 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f08f80d0c80 con 0x7f0908108e70 2024-04-26T11:31:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0907e00640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f08ec0a3da0 0x7f08ec0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0911861740 1 -- 172.21.15.110:0/4070458070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 msgr2=0x55ad56e8b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0911861740 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e8b3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f090000e580 tx=0x7f09000095c0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0911861740 1 -- 172.21.15.110:0/4070458070 shutdown_connections 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0911861740 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 0x55ad56e985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0911861740 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8b900 0x55ad56e95c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0911861740 1 --2- 172.21.15.110:0/4070458070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e8b3c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.636+0000 7f0911861740 1 -- 172.21.15.110:0/4070458070 >> 172.21.15.110:0/4070458070 conn(0x55ad56e874f0 msgr2=0x55ad56e878d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.637+0000 7f0911861740 1 -- 172.21.15.110:0/4070458070 shutdown_connections 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.637+0000 7f0911861740 1 -- 172.21.15.110:0/4070458070 wait complete. 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.637+0000 7f0907e00640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f08ec0a3da0 0x7f08ec0a6260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08f80ce2f0 tx=0x7f08f80d4700 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.637+0000 7f0911861740 1 -- start start 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.637+0000 7f0911861740 1 Processor -- start 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f0911861740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e930b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f0911861740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56e935f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f0911861740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 0x55ad56e93b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f0911861740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ad56e98df0 con 0x55ad56e8afe0 2024-04-26T11:31:46.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f0911861740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ad56d77c60 con 0x55ad56e8b900 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f0911861740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ad56e98f70 con 0x55ad56e961c0 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f0911861740 10 client.0 _ll_register_callbacks cb 0x55ad56da3e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f090ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e930b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f08ffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56e935f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f08ffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56e935f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:49064/0 (socket says 172.21.15.110:49064) 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f08ffe00640 1 -- 172.21.15.110:0/2950724056 learned_addr learned my addr 172.21.15.110:0/2950724056 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.638+0000 7f090ca00640 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 0x55ad56e93b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f08ffe00640 1 -- 172.21.15.110:0/2950724056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 msgr2=0x55ad56e93b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f08ffe00640 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 0x55ad56e93b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f08ffe00640 1 -- 172.21.15.110:0/2950724056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 msgr2=0x55ad56e930b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f08ffe00640 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e930b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f08ffe00640 1 -- 172.21.15.110:0/2950724056 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad56d86510 con 0x55ad56e8b900 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f090ca00640 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 0x55ad56e93b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:31:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f08ffe00640 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56e935f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009230 tx=0x7f08f0030ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2c6faf0dff155c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f08f5600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f08f5600640 1 -- 172.21.15.110:0/2950724056 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0037040 con 0x55ad56e8b900 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f0911861740 1 -- 172.21.15.110:0/2950724056 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f090000d830 con 0x55ad56e8b900 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.639+0000 7f08f5600640 1 -- 172.21.15.110:0/2950724056 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f08f0004450 con 0x55ad56e8b900 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f08f5600640 1 -- 172.21.15.110:0/2950724056 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f08f004d050 con 0x55ad56e8b900 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f0911861740 10 client.25181 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f0911861740 1 -- 172.21.15.110:0/2950724056 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ad56b02210 con 0x55ad56e8b900 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f08f5600640 1 -- 172.21.15.110:0/2950724056 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f090000d830 con 0x55ad56e8b900 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f08f5600640 1 -- 172.21.15.110:0/2950724056 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f08f0003a40 con 0x55ad56e8b900 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f0911861740 10 client.25181 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f0911861740 10 client.25181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f0911861740 20 client.25181 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f0911861740 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ad56ea5e60 0x55ad56ea8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f0911861740 4 client.25181 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:31:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.640+0000 7f0911861740 1 -- 172.21.15.110:0/2950724056 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad56dfdf90 con 0x55ad56ea5e60 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.641+0000 7f090ca00640 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ad56ea5e60 0x55ad56ea8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.641+0000 7f090ca00640 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ad56ea5e60 0x55ad56ea8270 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e2ee38b5827a1a server_cookie=25d8b17bd3762a51 in_seq=0 out_seq=0 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.641+0000 7f08f5600640 10 client.25181 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f08f5600640 1 -- 172.21.15.110:0/2950724056 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ad56dfdf90 con 0x55ad56ea5e60 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f08f5600640 10 client.25181 handle_command_reply: tid=0 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 client.25181 shutdown 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 -- 172.21.15.110:0/2950724056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 msgr2=0x55ad56e935f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56e935f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009230 tx=0x7f08f0030ba0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 -- 172.21.15.110:0/2950724056 shutdown_connections 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ad56ea5e60 0x55ad56ea8270 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 0x55ad56e93b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56e935f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 --2- 172.21.15.110:0/2950724056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e930b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f08f5600640 0 client.25181 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 -- 172.21.15.110:0/2950724056 >> 172.21.15.110:0/2950724056 conn(0x55ad56e874f0 msgr2=0x55ad56e8d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 -- 172.21.15.110:0/2950724056 shutdown_connections 2024-04-26T11:31:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 1 -- 172.21.15.110:0/2950724056 wait complete. 2024-04-26T11:31:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.642+0000 7f0911861740 20 client.25181 trim_cache size 0 max 16384 2024-04-26T11:31:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.659+0000 7f0911861740 1 Processor -- start 2024-04-26T11:31:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.659+0000 7f0911861740 1 -- start start 2024-04-26T11:31:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.659+0000 7f0911861740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.659+0000 7f0911861740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56ea1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.659+0000 7f0911861740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 0x55ad56e93780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.659+0000 7f0911861740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b7570 con 0x55ad56e8afe0 2024-04-26T11:31:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.659+0000 7f0911861740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b4e40 con 0x55ad56e8b900 2024-04-26T11:31:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.659+0000 7f0911861740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b2c90 con 0x55ad56e961c0 2024-04-26T11:31:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f090ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f08ffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56ea1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f090ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48480/0 (socket says 172.21.15.110:48480) 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f08ffe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56ea1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:49074/0 (socket says 172.21.15.110:49074) 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f090ca00640 1 -- 172.21.15.110:0/1044669289 learned_addr learned my addr 172.21.15.110:0/1044669289 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f090ca00640 1 --2- 172.21.15.110:0/1044669289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 0x55ad56e93780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f08ffe00640 1 -- 172.21.15.110:0/1044669289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 msgr2=0x55ad56e93780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f08ffe00640 1 --2- 172.21.15.110:0/1044669289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 0x55ad56e93780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f08ffe00640 1 -- 172.21.15.110:0/1044669289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 msgr2=0x55ad56e957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f08ffe00640 1 --2- 172.21.15.110:0/1044669289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.660+0000 7f08ffe00640 1 -- 172.21.15.110:0/1044669289 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad56bce620 con 0x55ad56e8b900 2024-04-26T11:31:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.661+0000 7f08ffe00640 1 --2- 172.21.15.110:0/1044669289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56ea1cb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f08f0003eb0 tx=0x7f08f0005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1895380676cde03f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.661+0000 7f08f7e00640 1 -- 172.21.15.110:0/1044669289 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0037070 con 0x55ad56e8b900 2024-04-26T11:31:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.661+0000 7f08f7e00640 1 -- 172.21.15.110:0/1044669289 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08f0005850 con 0x55ad56e8b900 2024-04-26T11:31:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.661+0000 7f08f7e00640 1 -- 172.21.15.110:0/1044669289 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0049b60 con 0x55ad56e8b900 2024-04-26T11:31:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.662+0000 7f0911861740 1 -- 172.21.15.110:0/1044669289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 msgr2=0x55ad56ea1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.662+0000 7f0911861740 1 --2- 172.21.15.110:0/1044669289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56ea1cb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f08f0003eb0 tx=0x7f08f0005a90 comp rx=0 tx=0).stop 2024-04-26T11:31:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.662+0000 7f0911861740 1 -- 172.21.15.110:0/1044669289 shutdown_connections 2024-04-26T11:31:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.662+0000 7f0911861740 1 --2- 172.21.15.110:0/1044669289 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e961c0 0x55ad56e93780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.662+0000 7f0911861740 1 --2- 172.21.15.110:0/1044669289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e8b900 0x55ad56ea1cb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.662+0000 7f0911861740 1 --2- 172.21.15.110:0/1044669289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8afe0 0x55ad56e957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.662+0000 7f0911861740 1 -- 172.21.15.110:0/1044669289 >> 172.21.15.110:0/1044669289 conn(0x55ad56e874f0 msgr2=0x55ad56e93070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.662+0000 7f0911861740 1 -- 172.21.15.110:0/1044669289 shutdown_connections 2024-04-26T11:31:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.663+0000 7f0911861740 1 -- 172.21.15.110:0/1044669289 wait complete. 2024-04-26T11:31:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.663+0000 7f0911861740 1 -- start start 2024-04-26T11:31:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.663+0000 7f0911861740 1 Processor -- start 2024-04-26T11:31:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f0911861740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8afe0 0x55ad56e99be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f0911861740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8b900 0x55ad56e9a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f0911861740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 0x55ad56e9a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f0911861740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b3300 con 0x55ad56e8b900 2024-04-26T11:31:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f0911861740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b4770 con 0x55ad56e961c0 2024-04-26T11:31:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f0911861740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b39d0 con 0x55ad56e8afe0 2024-04-26T11:31:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f0911861740 10 client.0 _ll_register_callbacks cb 0x7f08f8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f08ffe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8b900 0x55ad56e9a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f08ffe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8b900 0x55ad56e9a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48496/0 (socket says 172.21.15.110:48496) 2024-04-26T11:31:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f08ffe00640 1 -- 172.21.15.110:0/2557418182 learned_addr learned my addr 172.21.15.110:0/2557418182 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f090ca00640 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8afe0 0x55ad56e99be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.664+0000 7f090ca00640 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 0x55ad56e9a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.667 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f08ffe00640 1 -- 172.21.15.110:0/2557418182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8afe0 msgr2=0x55ad56e99be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:46.667 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f08ffe00640 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8afe0 0x55ad56e99be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.667 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f08ffe00640 1 -- 172.21.15.110:0/2557418182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 msgr2=0x55ad56e9a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f08ffe00640 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 0x55ad56e9a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f08ffe00640 1 -- 172.21.15.110:0/2557418182 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad56daacb0 con 0x55ad56e8b900 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f08ffe00640 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8b900 0x55ad56e9a120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f08f0003db0 tx=0x7f08f0004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf914772b797fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f08f5600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f08f5600640 1 -- 172.21.15.110:0/2557418182 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0037040 con 0x55ad56e8b900 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f08f5600640 1 -- 172.21.15.110:0/2557418182 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f08f0049450 con 0x55ad56e8b900 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.665+0000 7f0911861740 1 -- 172.21.15.110:0/2557418182 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08f0005850 con 0x55ad56e8b900 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f08f5600640 1 -- 172.21.15.110:0/2557418182 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f08f005f050 con 0x55ad56e8b900 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f0911861740 10 client.15099 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f0911861740 1 -- 172.21.15.110:0/2557418182 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ad56f0c510 con 0x55ad56e8b900 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f08f5600640 1 -- 172.21.15.110:0/2557418182 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08f0005850 con 0x55ad56e8b900 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f08f5600640 1 -- 172.21.15.110:0/2557418182 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f08f0005140 con 0x55ad56e8b900 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f0911861740 10 client.15099 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f0911861740 10 client.15099 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f0911861740 20 client.15099 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f0911861740 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ad56f0cbf0 0x55ad56f0f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f0911861740 4 client.15099 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:31:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.666+0000 7f0911861740 1 -- 172.21.15.110:0/2557418182 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad56df7e00 con 0x55ad56f0cbf0 2024-04-26T11:31:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.667+0000 7f090ca00640 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ad56f0cbf0 0x55ad56f0f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.667+0000 7f090ca00640 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ad56f0cbf0 0x55ad56f0f010 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94151616186807cc server_cookie=98866c8a6068a788 in_seq=0 out_seq=0 2024-04-26T11:31:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.667+0000 7f08f5600640 10 client.15099 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f08f5600640 1 -- 172.21.15.110:0/2557418182 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ad56df7e00 con 0x55ad56f0cbf0 2024-04-26T11:31:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f08f5600640 10 client.15099 handle_command_reply: tid=0 2024-04-26T11:31:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 client.15099 shutdown 2024-04-26T11:31:46.675 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 -- 172.21.15.110:0/2557418182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8b900 msgr2=0x55ad56e9a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8b900 0x55ad56e9a120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f08f0003db0 tx=0x7f08f0004500 comp rx=0 tx=0).stop 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 -- 172.21.15.110:0/2557418182 shutdown_connections 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ad56e961c0 0x55ad56e9a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad56e8b900 0x55ad56e9a120 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ad56f0cbf0 0x55ad56f0f010 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 --2- 172.21.15.110:0/2557418182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ad56e8afe0 0x55ad56e99be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f08f5600640 0 client.15099 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 -- 172.21.15.110:0/2557418182 >> 172.21.15.110:0/2557418182 conn(0x55ad56e874f0 msgr2=0x55ad56e8d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 -- 172.21.15.110:0/2557418182 shutdown_connections 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 1 -- 172.21.15.110:0/2557418182 wait complete. 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.674+0000 7f0911861740 20 client.15099 trim_cache size 0 max 16384 2024-04-26T11:31:46.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:31:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:31:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:31:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:31:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 -- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f08ec0a3da0 msgr2=0x7f08ec0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f08ec0a3da0 0x7f08ec0a6260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08f80ce2f0 tx=0x7f08f80d4700 comp rx=0 tx=0).stop 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 -- 172.21.15.110:0/3867937936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0908108e70 msgr2=0x7f090819f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0908108e70 0x7f090819f5f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f08f800e9f0 tx=0x7f08f800eeb0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 -- 172.21.15.110:0/3867937936 shutdown_connections 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f08ec0a3da0 0x7f08ec0a6260 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090810ee00 0x7f09081a3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09081097f0 0x7f090819fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 --2- 172.21.15.110:0/3867937936 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0908108e70 0x7f090819f5f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 -- 172.21.15.110:0/3867937936 >> 172.21.15.110:0/3867937936 conn(0x7f0908078710 msgr2=0x7f09080799a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 -- 172.21.15.110:0/3867937936 shutdown_connections 2024-04-26T11:31:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:46.675+0000 7f090d400640 1 -- 172.21.15.110:0/3867937936 wait complete. 2024-04-26T11:31:47.707 INFO:teuthology.orchestra.run.smithi110.stdout:{"run_dir":"/var/run/ceph"} 2024-04-26T11:31:47.708 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-04-26T11:31:47.708 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 4375 2024-04-26T11:31:47.708 DEBUG:tasks.quiescer:Yielding 2024-04-26T11:31:47.708 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T11:31:47.728 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T11:31:47.728 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi110.front.sepia.ceph.com 2024-04-26T11:31:47.728 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-04-26T11:31:47.729 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:31:47.829 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:31:47.865 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem Size Used Avail Use% Mounted on 2024-04-26T11:31:47.865 INFO:teuthology.orchestra.run.smithi110.stdout:0@6e439470-03be-11ef-bc93-c7b262605968.cephfs=/volumes/qa/sv_1/5209720f-dc0d-4dcc-ad37-e3d1b7a0e6d2 340G 0 340G 0% /tmp/cephfs 2024-04-26T11:31:47.872 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-04-26T11:31:47.933 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:47 smithi110 ceph-mon[28069]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T11:31:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:47 smithi196 ceph-mon[32572]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T11:31:48.006 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-04-26T11:31:48.109 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-04-26T11:31:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:47 smithi193 ceph-mon[32782]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T11:31:48.165 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:49 smithi196 ceph-mon[32572]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-04-26T11:31:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:49 smithi110 ceph-mon[28069]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-04-26T11:31:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:49 smithi193 ceph-mon[32782]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-04-26T11:31:50.550 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-04-26T11:31:50.639 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-04-26T11:31:50.646 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-04-26T11:31:50.746 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-04-26T11:31:50.851 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/: 2024-04-26T11:31:50.851 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:31:50.851 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 . 2024-04-26T11:31:50.851 INFO:teuthology.orchestra.run.smithi110.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 .. 2024-04-26T11:31:50.851 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 data 2024-04-26T11:31:50.851 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:31:50.852 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data: 2024-04-26T11:31:50.852 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:31:50.852 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:31:50.852 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 .. 2024-04-26T11:31:50.857 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-04-26T11:31:50.966 INFO:teuthology.orchestra.run.smithi110.stdout:[Service] 2024-04-26T11:31:50.966 INFO:teuthology.orchestra.run.smithi110.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-04-26T11:31:50.966 INFO:teuthology.orchestra.run.smithi110.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-04-26T11:31:50.973 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-04-26T11:31:51.189 INFO:teuthology.orchestra.run.smithi110.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-04-26T11:31:51.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.226+0000 7f4cf1400700 1 -- 172.21.15.110:0/3228499314 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cec103470 msgr2=0x7f4cec1038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:51.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.226+0000 7f4cf1400700 1 --2- 172.21.15.110:0/3228499314 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cec103470 0x7f4cec1038f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009990 tx=0x7f4cd8009ca0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.226+0000 7f4cf1400700 1 -- 172.21.15.110:0/3228499314 shutdown_connections 2024-04-26T11:31:51.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.226+0000 7f4cf1400700 1 --2- 172.21.15.110:0/3228499314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec103e30 0x7f4cec1102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.226+0000 7f4cf1400700 1 --2- 172.21.15.110:0/3228499314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cec1094f0 0x7f4cec1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.226+0000 7f4cf1400700 1 --2- 172.21.15.110:0/3228499314 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cec103470 0x7f4cec1038f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.226+0000 7f4cf1400700 1 -- 172.21.15.110:0/3228499314 >> 172.21.15.110:0/3228499314 conn(0x7f4cec07a5d0 msgr2=0x7f4cec07a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:51.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.226+0000 7f4cf1400700 1 -- 172.21.15.110:0/3228499314 shutdown_connections 2024-04-26T11:31:51.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.226+0000 7f4cf1400700 1 -- 172.21.15.110:0/3228499314 wait complete. 2024-04-26T11:31:51.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.227+0000 7f4cf1400700 1 Processor -- start 2024-04-26T11:31:51.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.228+0000 7f4cf1400700 1 -- start start 2024-04-26T11:31:51.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.228+0000 7f4cf1400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec103470 0x7f4cec19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:51.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.228+0000 7f4cf1400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cec103e30 0x7f4cec19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:51.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.228+0000 7f4cf1400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cec1094f0 0x7f4cec1a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.228+0000 7f4cf1400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec113660 con 0x7f4cec103470 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.228+0000 7f4cf1400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec1134e0 con 0x7f4cec103e30 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.228+0000 7f4cf1400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec1137e0 con 0x7f4cec1094f0 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.228+0000 7f4cea800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec103470 0x7f4cec19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.228+0000 7f4cea800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec103470 0x7f4cec19bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48510/0 (socket says 172.21.15.110:48510) 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.229+0000 7f4ce9e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cec103e30 0x7f4cec19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.229+0000 7f4cea800700 1 -- 172.21.15.110:0/2350630839 learned_addr learned my addr 172.21.15.110:0/2350630839 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.229+0000 7f4ceb200700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cec1094f0 0x7f4cec1a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.229+0000 7f4ce9e00700 1 -- 172.21.15.110:0/2350630839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cec1094f0 msgr2=0x7f4cec1a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.229+0000 7f4ce9e00700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cec1094f0 0x7f4cec1a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.229+0000 7f4ce9e00700 1 -- 172.21.15.110:0/2350630839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec103470 msgr2=0x7f4cec19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.229+0000 7f4ce9e00700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec103470 0x7f4cec19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.229+0000 7f4ce9e00700 1 -- 172.21.15.110:0/2350630839 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cec1a0d80 con 0x7f4cec103e30 2024-04-26T11:31:51.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.229+0000 7f4ce9e00700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cec103e30 0x7f4cec19c2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80098e0 tx=0x7f4cd80057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:51.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.230+0000 7f4ce3400700 1 -- 172.21.15.110:0/2350630839 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8027070 con 0x7f4cec103e30 2024-04-26T11:31:51.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.230+0000 7f4ce3400700 1 -- 172.21.15.110:0/2350630839 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd8022470 con 0x7f4cec103e30 2024-04-26T11:31:51.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.230+0000 7f4ce3400700 1 -- 172.21.15.110:0/2350630839 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8017650 con 0x7f4cec103e30 2024-04-26T11:31:51.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.230+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cec1a1010 con 0x7f4cec103e30 2024-04-26T11:31:51.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.230+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cec1a88f0 con 0x7f4cec103e30 2024-04-26T11:31:51.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.231+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cec104b90 con 0x7f4cec103e30 2024-04-26T11:31:51.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.233+0000 7f4ce3400700 1 -- 172.21.15.110:0/2350630839 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7f4cd802a070 con 0x7f4cec103e30 2024-04-26T11:31:51.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.234+0000 7f4ce3400700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4cd00a3f90 0x7f4cd00a6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:51.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.235+0000 7f4ce3400700 1 -- 172.21.15.110:0/2350630839 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f4cd80d17d0 con 0x7f4cec103e30 2024-04-26T11:31:51.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.235+0000 7f4cea800700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4cd00a3f90 0x7f4cd00a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:51.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.235+0000 7f4cea800700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4cd00a3f90 0x7f4cd00a6450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009ce0 tx=0x7f4cdc009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:51.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.237+0000 7f4ce3400700 1 -- 172.21.15.110:0/2350630839 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4cd8031080 con 0x7f4cec103e30 2024-04-26T11:31:51.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.518+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cec06a110 con 0x7f4cec103e30 2024-04-26T11:31:51.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.519+0000 7f4ce3400700 1 -- 172.21.15.110:0/2350630839 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11889 (secure 0 0 0) 0x7f4cec06a110 con 0x7f4cec103e30 2024-04-26T11:31:51.521 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:31:51.521 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:31:16.187674+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24487,24502,24518]},"id":1}]} 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4cd00a3f90 msgr2=0x7f4cd00a6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4cd00a3f90 0x7f4cd00a6450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009ce0 tx=0x7f4cdc009260 comp rx=0 tx=0).stop 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cec103e30 msgr2=0x7f4cec19c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cec103e30 0x7f4cec19c2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80098e0 tx=0x7f4cd80057c0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 shutdown_connections 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4cd00a3f90 0x7f4cd00a6450 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4cec1094f0 0x7f4cec1a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cec103470 0x7f4cec19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 --2- 172.21.15.110:0/2350630839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cec103e30 0x7f4cec19c2b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.523+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 >> 172.21.15.110:0/2350630839 conn(0x7f4cec07a5d0 msgr2=0x7f4cec10e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.524+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 shutdown_connections 2024-04-26T11:31:51.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:51.524+0000 7f4cf1400700 1 -- 172.21.15.110:0/2350630839 wait complete. 2024-04-26T11:31:51.526 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 26 2024-04-26T11:31:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:51 smithi110 ceph-mon[28069]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T11:31:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:51 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2350630839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:31:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:51 smithi196 ceph-mon[32572]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T11:31:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:51 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2350630839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:31:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:51 smithi193 ceph-mon[32782]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T11:31:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:51 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2350630839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:31:52.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T11:27:14.996270+0000', 'modified': '2024-04-26T11:31:16.187674+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24518, 'mds_1': 24502, 'mds_2': 24487}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24467': {'gid': 24467, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6835/2038926783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 2038926783}, {'type': 'v1', 'addr': '172.21.15.193:6835', 'nonce': 2038926783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6835/1499716677', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 1499716677}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 1499716677}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.193:6837/324089889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6836', 'nonce': 324089889}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 324089889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.196:6837/1521745566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 1521745566}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 1521745566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.196:6839/1849808245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6838', 'nonce': 1849808245}, {'type': 'v1', 'addr': '172.21.15.196:6839', 'nonce': 1849808245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6839/64494456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6838', 'nonce': 64494456}, {'type': 'v1', 'addr': '172.21.15.193:6839', 'nonce': 64494456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24518, 'qdb_cluster': [24487, 24502, 24518]} 2024-04-26T11:31:52.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-26T11:31:52.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell mds.c status 2024-04-26T11:31:52.996 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:53.985 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:53 smithi110 ceph-mon[28069]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T11:31:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:53 smithi196 ceph-mon[32572]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T11:31:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:53 smithi193 ceph-mon[32782]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T11:31:55.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.424+0000 7f2f1ca00700 1 -- 172.21.15.110:0/1258527982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f1810fa50 msgr2=0x7f2f1810fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:55.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.424+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/1258527982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f1810fa50 0x7f2f1810fe30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009990 tx=0x7f2f08009ca0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.424+0000 7f2f1ca00700 1 -- 172.21.15.110:0/1258527982 shutdown_connections 2024-04-26T11:31:55.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.424+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/1258527982 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f1810a410 0x7f2f18116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.424+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/1258527982 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f1810fa50 0x7f2f1810fe30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.424+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/1258527982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18109a50 0x7f2f18109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.424+0000 7f2f1ca00700 1 -- 172.21.15.110:0/1258527982 >> 172.21.15.110:0/1258527982 conn(0x7f2f18076bf0 msgr2=0x7f2f18108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:55.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.424+0000 7f2f1ca00700 1 -- 172.21.15.110:0/1258527982 shutdown_connections 2024-04-26T11:31:55.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.424+0000 7f2f1ca00700 1 -- 172.21.15.110:0/1258527982 wait complete. 2024-04-26T11:31:55.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.425+0000 7f2f1ca00700 1 Processor -- start 2024-04-26T11:31:55.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.425+0000 7f2f1ca00700 1 -- start start 2024-04-26T11:31:55.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f1ca00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18109a50 0x7f2f181a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f1ca00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f1810a410 0x7f2f181a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f1ca00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f1810fa50 0x7f2f181a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f1ca00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2f18119c30 con 0x7f2f18109a50 2024-04-26T11:31:55.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f1ca00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2f18119ab0 con 0x7f2f1810fa50 2024-04-26T11:31:55.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f1ca00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2f18119db0 con 0x7f2f1810a410 2024-04-26T11:31:55.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f15e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18109a50 0x7f2f181a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f15400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f1810a410 0x7f2f181a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f15400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f1810a410 0x7f2f181a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39080/0 (socket says 172.21.15.110:39080) 2024-04-26T11:31:55.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f15400700 1 -- 172.21.15.110:0/237335081 learned_addr learned my addr 172.21.15.110:0/237335081 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:55.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f16800700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f1810fa50 0x7f2f181a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f15400700 1 -- 172.21.15.110:0/237335081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f1810fa50 msgr2=0x7f2f181a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:55.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f15400700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f1810fa50 0x7f2f181a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f15400700 1 -- 172.21.15.110:0/237335081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18109a50 msgr2=0x7f2f181a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:55.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f15400700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18109a50 0x7f2f181a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.426+0000 7f2f15400700 1 -- 172.21.15.110:0/237335081 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f181a50e0 con 0x7f2f1810a410 2024-04-26T11:31:55.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.427+0000 7f2f15400700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f1810a410 0x7f2f181a0660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400e9a0 tx=0x7f2f0400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:55.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.427+0000 7f2f0ea00700 1 -- 172.21.15.110:0/237335081 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400ca10 con 0x7f2f1810a410 2024-04-26T11:31:55.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.427+0000 7f2f0ea00700 1 -- 172.21.15.110:0/237335081 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0400cbb0 con 0x7f2f1810a410 2024-04-26T11:31:55.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.427+0000 7f2f1ca00700 1 -- 172.21.15.110:0/237335081 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f181a53d0 con 0x7f2f1810a410 2024-04-26T11:31:55.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.427+0000 7f2f0ea00700 1 -- 172.21.15.110:0/237335081 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04018680 con 0x7f2f1810a410 2024-04-26T11:31:55.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.427+0000 7f2f1ca00700 1 -- 172.21.15.110:0/237335081 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f181acc50 con 0x7f2f1810a410 2024-04-26T11:31:55.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.431+0000 7f2f0ea00700 1 -- 172.21.15.110:0/237335081 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7f2f04010430 con 0x7f2f1810a410 2024-04-26T11:31:55.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.432+0000 7f2f27321b80 1 Processor -- start 2024-04-26T11:31:55.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.432+0000 7f2f27321b80 1 -- start start 2024-04-26T11:31:55.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.432+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e45a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.432+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 0x56143e455b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.432+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e4564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.432+0000 7f2f27321b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56143e3a8840 con 0x56143e45a3b0 2024-04-26T11:31:55.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.432+0000 7f2f27321b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56143e347160 con 0x56143e456080 2024-04-26T11:31:55.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.432+0000 7f2f27321b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56143e3a4800 con 0x56143e45acd0 2024-04-26T11:31:55.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f16800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e45a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f16800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e45a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56270/0 (socket says 172.21.15.110:56270) 2024-04-26T11:31:55.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f16800700 1 -- 172.21.15.110:0/2450688102 learned_addr learned my addr 172.21.15.110:0/2450688102 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:55.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f15400700 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e4564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f15e00700 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 0x56143e455b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f0ea00700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f2efc0a3e40 0x7f2efc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f15400700 1 -- 172.21.15.110:0/2450688102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 msgr2=0x56143e455b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:55.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f15400700 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 0x56143e455b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f15400700 1 -- 172.21.15.110:0/2450688102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 msgr2=0x56143e45a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f15400700 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e45a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f0ea00700 1 -- 172.21.15.110:0/237335081 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f2f040d0bf0 con 0x7f2f1810a410 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f15400700 1 -- 172.21.15.110:0/2450688102 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143e34f5e0 con 0x56143e456080 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.433+0000 7f2f16800700 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e45a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.434+0000 7f2f16800700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f2efc0a3e40 0x7f2efc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.434+0000 7f2f15e00700 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 0x56143e455b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.434+0000 7f2f15400700 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e4564c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f040ce1a0 tx=0x7f2f04009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=975ac7ddb486c6f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.434+0000 7f2f03400700 1 -- 172.21.15.110:0/2450688102 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0409c2a0 con 0x56143e456080 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.434+0000 7f2f03400700 1 -- 172.21.15.110:0/2450688102 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0409d040 con 0x56143e456080 2024-04-26T11:31:55.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.434+0000 7f2f03400700 1 -- 172.21.15.110:0/2450688102 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04010f10 con 0x56143e456080 2024-04-26T11:31:55.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f27321b80 1 -- 172.21.15.110:0/2450688102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 msgr2=0x56143e4564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f16800700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f2efc0a3e40 0x7f2efc0a6300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2f10007700 tx=0x7f2f10009040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f27321b80 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e4564c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f040ce1a0 tx=0x7f2f04009790 comp rx=0 tx=0).stop 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f27321b80 1 -- 172.21.15.110:0/2450688102 shutdown_connections 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f27321b80 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e4564c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f27321b80 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e45a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f27321b80 1 --2- 172.21.15.110:0/2450688102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 0x56143e455b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f27321b80 1 -- 172.21.15.110:0/2450688102 >> 172.21.15.110:0/2450688102 conn(0x56143e3832a0 msgr2=0x56143e450610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f27321b80 1 -- 172.21.15.110:0/2450688102 shutdown_connections 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.435+0000 7f2f27321b80 1 -- 172.21.15.110:0/2450688102 wait complete. 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.436+0000 7f2f27321b80 1 -- start start 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.436+0000 7f2f27321b80 1 Processor -- start 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.436+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e461ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45a3b0 0x56143e45edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45acd0 0x56143e45f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f27321b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56143e4627b0 con 0x56143e45acd0 2024-04-26T11:31:55.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f27321b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56143e3433b0 con 0x56143e45a3b0 2024-04-26T11:31:55.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f27321b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56143e462930 con 0x56143e456080 2024-04-26T11:31:55.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f27321b80 10 client.0 _ll_register_callbacks cb 0x56143e33c330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:55.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f15e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e461ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f16800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45acd0 0x56143e45f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f15400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45a3b0 0x56143e45edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f15e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e461ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39104/0 (socket says 172.21.15.110:39104) 2024-04-26T11:31:55.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f15e00700 1 -- 172.21.15.110:0/1335750301 learned_addr learned my addr 172.21.15.110:0/1335750301 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:55.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f15e00700 1 -- 172.21.15.110:0/1335750301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45a3b0 msgr2=0x56143e45edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:55.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f15e00700 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45a3b0 0x56143e45edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f15e00700 1 -- 172.21.15.110:0/1335750301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45acd0 msgr2=0x56143e45f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f15e00700 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45acd0 0x56143e45f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f15e00700 1 -- 172.21.15.110:0/1335750301 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143e2f5880 con 0x56143e456080 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.437+0000 7f2f16800700 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45acd0 0x56143e45f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.438+0000 7f2f15e00700 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e461ad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009990 tx=0x7f2f08005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5346fc28658ef93a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.438+0000 7f2ef7e00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.438+0000 7f2ef7e00700 1 -- 172.21.15.110:0/1335750301 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08029060 con 0x56143e456080 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.438+0000 7f2ef7e00700 1 -- 172.21.15.110:0/1335750301 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f2f08003680 con 0x56143e456080 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.438+0000 7f2f27321b80 1 -- 172.21.15.110:0/1335750301 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f0409d040 con 0x56143e456080 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.439+0000 7f2ef7e00700 1 -- 172.21.15.110:0/1335750301 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2f08003880 con 0x56143e456080 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.439+0000 7f2f27321b80 10 client.25225 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.439+0000 7f2f27321b80 1 -- 172.21.15.110:0/1335750301 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56143e46d030 con 0x56143e456080 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.439+0000 7f2ef7e00700 1 -- 172.21.15.110:0/1335750301 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0409d040 con 0x56143e456080 2024-04-26T11:31:55.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.439+0000 7f2ef7e00700 1 -- 172.21.15.110:0/1335750301 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f2f0800f970 con 0x56143e456080 2024-04-26T11:31:55.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.440+0000 7f2f27321b80 10 client.25225 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:55.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.440+0000 7f2f27321b80 10 client.25225 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T11:31:55.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.440+0000 7f2f27321b80 20 client.25225 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:55.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.440+0000 7f2f27321b80 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x56143e46f660 0x56143e470ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.440+0000 7f2f27321b80 4 client.25225 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:31:55.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.440+0000 7f2f27321b80 1 -- 172.21.15.110:0/1335750301 --> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56143e3b6220 con 0x56143e46f660 2024-04-26T11:31:55.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.440+0000 7f2f15400700 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x56143e46f660 0x56143e470ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.441+0000 7f2f15400700 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x56143e46f660 0x56143e470ad0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=119091c30e613f09 server_cookie=20d1f8adeef34f9d in_seq=0 out_seq=0 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.441+0000 7f2ef7e00700 10 client.25225 ms_handle_connect on v2:172.21.15.196:6836/1521745566 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.441+0000 7f2ef7e00700 1 -- 172.21.15.110:0/1335750301 <== mds.2 v2:172.21.15.196:6836/1521745566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56143e3b6220 con 0x56143e46f660 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.441+0000 7f2ef7e00700 10 client.25225 handle_command_reply: tid=0 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.441+0000 7f2f27321b80 1 client.25225 shutdown 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 -- 172.21.15.110:0/1335750301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 msgr2=0x56143e461ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e461ad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009990 tx=0x7f2f08005800 comp rx=0 tx=0).stop 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 -- 172.21.15.110:0/1335750301 shutdown_connections 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x56143e46f660 0x56143e470ad0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45acd0 0x56143e45f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e461ad0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2ef7e00700 0 client.25225 ms_handle_reset on v2:172.21.15.196:6836/1521745566 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 --2- 172.21.15.110:0/1335750301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45a3b0 0x56143e45edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 -- 172.21.15.110:0/1335750301 >> 172.21.15.110:0/1335750301 conn(0x56143e3832a0 msgr2=0x56143e44ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:55.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 -- 172.21.15.110:0/1335750301 shutdown_connections 2024-04-26T11:31:55.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 1 -- 172.21.15.110:0/1335750301 wait complete. 2024-04-26T11:31:55.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.442+0000 7f2f27321b80 20 client.25225 trim_cache size 0 max 16384 2024-04-26T11:31:55.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.465+0000 7f2f27321b80 1 Processor -- start 2024-04-26T11:31:55.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.465+0000 7f2f27321b80 1 -- start start 2024-04-26T11:31:55.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e45f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e456460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45acd0 0x56143e459890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f27321b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56143e46ee10 con 0x56143e45a3b0 2024-04-26T11:31:55.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f27321b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56143e46f4e0 con 0x56143e45acd0 2024-04-26T11:31:55.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f27321b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56143e46fbb0 con 0x56143e456080 2024-04-26T11:31:55.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f15400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e456460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f15e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e45f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f16800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45acd0 0x56143e459890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f15400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e456460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56298/0 (socket says 172.21.15.110:56298) 2024-04-26T11:31:55.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.466+0000 7f2f15400700 1 -- 172.21.15.110:0/2630963365 learned_addr learned my addr 172.21.15.110:0/2630963365 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f15e00700 1 -- 172.21.15.110:0/2630963365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45acd0 msgr2=0x56143e459890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f15e00700 1 --2- 172.21.15.110:0/2630963365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45acd0 0x56143e459890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f15e00700 1 -- 172.21.15.110:0/2630963365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 msgr2=0x56143e456460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f15e00700 1 --2- 172.21.15.110:0/2630963365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e456460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f15e00700 1 -- 172.21.15.110:0/2630963365 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143e451330 con 0x56143e456080 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f15400700 1 --2- 172.21.15.110:0/2630963365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e456460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f15e00700 1 --2- 172.21.15.110:0/2630963365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e45f340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2f080098e0 tx=0x7f2f08001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70d8e5941c2ed4c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f02a00700 1 -- 172.21.15.110:0/2630963365 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08029040 con 0x56143e456080 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f02a00700 1 -- 172.21.15.110:0/2630963365 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0800bd10 con 0x56143e456080 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.467+0000 7f2f02a00700 1 -- 172.21.15.110:0/2630963365 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0802cca0 con 0x56143e456080 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 -- 172.21.15.110:0/2630963365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 msgr2=0x56143e45f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 --2- 172.21.15.110:0/2630963365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e45f340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2f080098e0 tx=0x7f2f08001e70 comp rx=0 tx=0).stop 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 -- 172.21.15.110:0/2630963365 shutdown_connections 2024-04-26T11:31:55.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 --2- 172.21.15.110:0/2630963365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e45acd0 0x56143e459890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 --2- 172.21.15.110:0/2630963365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e456080 0x56143e45f340 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 --2- 172.21.15.110:0/2630963365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e456460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 -- 172.21.15.110:0/2630963365 >> 172.21.15.110:0/2630963365 conn(0x56143e3832a0 msgr2=0x56143e450580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 -- 172.21.15.110:0/2630963365 shutdown_connections 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 -- 172.21.15.110:0/2630963365 wait complete. 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.468+0000 7f2f27321b80 1 -- start start 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.469+0000 7f2f27321b80 1 Processor -- start 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.469+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e479f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.469+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e47a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.469+0000 7f2f27321b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 0x56143e45c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.469+0000 7f2f27321b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56143e470950 con 0x56143e45a3b0 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.469+0000 7f2f27321b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56143e470280 con 0x56143e456080 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.469+0000 7f2f27321b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56143e471020 con 0x56143e45acd0 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.469+0000 7f2f27321b80 10 client.0 _ll_register_callbacks cb 0x56143e33c330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:55.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e47a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e47a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56300/0 (socket says 172.21.15.110:56300) 2024-04-26T11:31:55.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15400700 1 -- 172.21.15.110:0/3779730086 learned_addr learned my addr 172.21.15.110:0/3779730086 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:55.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15e00700 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e479f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f16800700 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 0x56143e45c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15e00700 1 -- 172.21.15.110:0/3779730086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 msgr2=0x56143e45c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:55.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15e00700 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 0x56143e45c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15e00700 1 -- 172.21.15.110:0/3779730086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 msgr2=0x56143e47a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:55.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15e00700 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e47a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15e00700 1 -- 172.21.15.110:0/3779730086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143e45cb40 con 0x56143e456080 2024-04-26T11:31:55.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15400700 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e47a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:55.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2f15e00700 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e479f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f08005010 tx=0x7f2f08003c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3203d8e86d76ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:55.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.470+0000 7f2ef7e00700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:31:55.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.471+0000 7f2ef7e00700 1 -- 172.21.15.110:0/3779730086 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0803b070 con 0x56143e456080 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.471+0000 7f2f27321b80 1 -- 172.21.15.110:0/3779730086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f0800bd10 con 0x56143e456080 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.471+0000 7f2ef7e00700 1 -- 172.21.15.110:0/3779730086 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f2f0802ca10 con 0x56143e456080 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.471+0000 7f2ef7e00700 1 -- 172.21.15.110:0/3779730086 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2f08044050 con 0x56143e456080 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.471+0000 7f2f27321b80 10 client.25211 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.471+0000 7f2f27321b80 1 -- 172.21.15.110:0/3779730086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56143e453d10 con 0x56143e456080 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.471+0000 7f2ef7e00700 1 -- 172.21.15.110:0/3779730086 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f0800bd10 con 0x56143e456080 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.472+0000 7f2ef7e00700 1 -- 172.21.15.110:0/3779730086 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f2f08024480 con 0x56143e456080 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.472+0000 7f2f27321b80 10 client.25211 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.472+0000 7f2f27321b80 10 client.25211 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.472+0000 7f2f27321b80 20 client.25211 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.472+0000 7f2f27321b80 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x56143e4dad70 0x56143e4d9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.472+0000 7f2f27321b80 4 client.25211 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.472+0000 7f2f27321b80 1 -- 172.21.15.110:0/3779730086 --> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] -- command(tid 0: {"prefix": "status"}) -- 0x56143e3b02c0 con 0x56143e4dad70 2024-04-26T11:31:55.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.472+0000 7f2f15400700 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x56143e4dad70 0x56143e4d9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f15400700 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x56143e4dad70 0x56143e4d9a80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b91a0b85556f7026 server_cookie=329b1cef80a5a2f0 in_seq=0 out_seq=0 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2ef7e00700 10 client.25211 ms_handle_connect on v2:172.21.15.196:6836/1521745566 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2ef7e00700 1 -- 172.21.15.110:0/3779730086 <== mds.2 v2:172.21.15.196:6836/1521745566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56143e3b02c0 con 0x56143e4dad70 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2ef7e00700 10 client.25211 handle_command_reply: tid=0 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 client.25211 shutdown 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 -- 172.21.15.110:0/3779730086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 msgr2=0x56143e479f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e479f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f08005010 tx=0x7f2f08003c50 comp rx=0 tx=0).stop 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 -- 172.21.15.110:0/3779730086 shutdown_connections 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56143e45acd0 0x56143e45c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56143e456080 0x56143e479f40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.196:6836/1521745566,v1:172.21.15.196:6837/1521745566] conn(0x56143e4dad70 0x56143e4d9a80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 --2- 172.21.15.110:0/3779730086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56143e45a3b0 0x56143e47a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2ef7e00700 0 client.25211 ms_handle_reset on v2:172.21.15.196:6836/1521745566 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 -- 172.21.15.110:0/3779730086 >> 172.21.15.110:0/3779730086 conn(0x56143e3832a0 msgr2=0x56143e459830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:55.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 -- 172.21.15.110:0/3779730086 shutdown_connections 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.473+0000 7f2f27321b80 1 -- 172.21.15.110:0/3779730086 wait complete. 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.474+0000 7f2f27321b80 20 client.25211 trim_cache size 0 max 16384 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 2, 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24487, 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 262.86711121100001, 2024-04-26T11:31:55.478 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 26, 2024-04-26T11:31:55.479 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 94, 2024-04-26T11:31:55.479 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 94, 2024-04-26T11:31:55.479 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 318.558345132 2024-04-26T11:31:55.479 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:31:55.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.474+0000 7f2f1ca00700 1 -- 172.21.15.110:0/237335081 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f2efc0a3e40 msgr2=0x7f2efc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.474+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f2efc0a3e40 0x7f2efc0a6300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2f10007700 tx=0x7f2f10009040 comp rx=0 tx=0).stop 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.474+0000 7f2f1ca00700 1 -- 172.21.15.110:0/237335081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f1810a410 msgr2=0x7f2f181a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.474+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f1810a410 0x7f2f181a0660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400e9a0 tx=0x7f2f0400ecb0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.475+0000 7f2f1ca00700 1 -- 172.21.15.110:0/237335081 shutdown_connections 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.475+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f2efc0a3e40 0x7f2efc0a6300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.475+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f1810fa50 0x7f2f181a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.475+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18109a50 0x7f2f181a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.475+0000 7f2f1ca00700 1 --2- 172.21.15.110:0/237335081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f1810a410 0x7f2f181a0660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.475+0000 7f2f1ca00700 1 -- 172.21.15.110:0/237335081 >> 172.21.15.110:0/237335081 conn(0x7f2f18076bf0 msgr2=0x7f2f18077250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.475+0000 7f2f1ca00700 1 -- 172.21.15.110:0/237335081 shutdown_connections 2024-04-26T11:31:55.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:55.475+0000 7f2f1ca00700 1 -- 172.21.15.110:0/237335081 wait complete. 2024-04-26T11:31:56.002 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:55 smithi110 ceph-mon[28069]: pgmap v22: 97 pgs: 97 active+clean; 1.8 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-04-26T11:31:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:55 smithi196 ceph-mon[32572]: pgmap v22: 97 pgs: 97 active+clean; 1.8 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-04-26T11:31:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:55 smithi193 ceph-mon[32782]: pgmap v22: 97 pgs: 97 active+clean; 1.8 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-04-26T11:31:56.565 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-26T11:31:57.013 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:31:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:57 smithi196 ceph-mon[32572]: pgmap v23: 97 pgs: 97 active+clean; 1.8 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 52 KiB/s wr, 8 op/s 2024-04-26T11:31:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:57 smithi110 ceph-mon[28069]: pgmap v23: 97 pgs: 97 active+clean; 1.8 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 52 KiB/s wr, 8 op/s 2024-04-26T11:31:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:57 smithi193 ceph-mon[32782]: pgmap v23: 97 pgs: 97 active+clean; 1.8 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 52 KiB/s wr, 8 op/s 2024-04-26T11:31:59.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.303+0000 7fef6fa00700 1 -- 172.21.15.110:0/1045328227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef68109a50 msgr2=0x7fef68109ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.303+0000 7fef6fa00700 1 --2- 172.21.15.110:0/1045328227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef68109a50 0x7fef68109ed0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fef54009990 tx=0x7fef54009ca0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.303+0000 7fef6fa00700 1 -- 172.21.15.110:0/1045328227 shutdown_connections 2024-04-26T11:31:59.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.303+0000 7fef6fa00700 1 --2- 172.21.15.110:0/1045328227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef6810a410 0x7fef68116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.303+0000 7fef6fa00700 1 --2- 172.21.15.110:0/1045328227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef6810fa50 0x7fef6810fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.303+0000 7fef6fa00700 1 --2- 172.21.15.110:0/1045328227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef68109a50 0x7fef68109ed0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.303+0000 7fef6fa00700 1 -- 172.21.15.110:0/1045328227 >> 172.21.15.110:0/1045328227 conn(0x7fef68076bf0 msgr2=0x7fef68108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.303+0000 7fef6fa00700 1 -- 172.21.15.110:0/1045328227 shutdown_connections 2024-04-26T11:31:59.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.303+0000 7fef6fa00700 1 -- 172.21.15.110:0/1045328227 wait complete. 2024-04-26T11:31:59.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.305+0000 7fef6fa00700 1 Processor -- start 2024-04-26T11:31:59.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.305+0000 7fef6fa00700 1 -- start start 2024-04-26T11:31:59.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.305+0000 7fef6fa00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef68109a50 0x7fef681a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.305+0000 7fef6fa00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef6810a410 0x7fef681a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.305+0000 7fef6fa00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef6810fa50 0x7fef681a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.305+0000 7fef6fa00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fef68119c90 con 0x7fef6810fa50 2024-04-26T11:31:59.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.305+0000 7fef6fa00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fef68119b10 con 0x7fef6810a410 2024-04-26T11:31:59.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.305+0000 7fef6fa00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fef68119e10 con 0x7fef68109a50 2024-04-26T11:31:59.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef6810fa50 0x7fef681a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6d000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef68109a50 0x7fef681a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6d000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef68109a50 0x7fef681a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39118/0 (socket says 172.21.15.110:39118) 2024-04-26T11:31:59.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6da00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef6810fa50 0x7fef681a49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56312/0 (socket says 172.21.15.110:56312) 2024-04-26T11:31:59.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6d000700 1 -- 172.21.15.110:0/2920746446 learned_addr learned my addr 172.21.15.110:0/2920746446 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef67e00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef6810a410 0x7fef681a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6da00700 1 -- 172.21.15.110:0/2920746446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef68109a50 msgr2=0x7fef681a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6da00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef68109a50 0x7fef681a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6da00700 1 -- 172.21.15.110:0/2920746446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef6810a410 msgr2=0x7fef681a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6da00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef6810a410 0x7fef681a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.306+0000 7fef6da00700 1 -- 172.21.15.110:0/2920746446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef681a5130 con 0x7fef6810fa50 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.307+0000 7fef6da00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef6810fa50 0x7fef681a49f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fef6000efb0 tx=0x7fef6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.307+0000 7fef65600700 1 -- 172.21.15.110:0/2920746446 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef60003a00 con 0x7fef6810fa50 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.307+0000 7fef65600700 1 -- 172.21.15.110:0/2920746446 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef6000ce50 con 0x7fef6810fa50 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.307+0000 7fef65600700 1 -- 172.21.15.110:0/2920746446 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef600047c0 con 0x7fef6810fa50 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.307+0000 7fef6fa00700 1 -- 172.21.15.110:0/2920746446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef681a5420 con 0x7fef6810fa50 2024-04-26T11:31:59.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.307+0000 7fef6fa00700 1 -- 172.21.15.110:0/2920746446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef681acca0 con 0x7fef6810fa50 2024-04-26T11:31:59.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.310+0000 7fef65600700 1 -- 172.21.15.110:0/2920746446 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7fef60012050 con 0x7fef6810fa50 2024-04-26T11:31:59.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef7a2eeb80 1 Processor -- start 2024-04-26T11:31:59.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef65600700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fef500a3e40 0x7fef500a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef7a2eeb80 1 -- start start 2024-04-26T11:31:59.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef65600700 1 -- 172.21.15.110:0/2920746446 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fef600d02d0 con 0x7fef6810fa50 2024-04-26T11:31:59.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef67e00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fef500a3e40 0x7fef500a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b65790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b65cd0 0x558019b60b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b61080 0x558019b614c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558019ab3840 con 0x558019b65cd0 2024-04-26T11:31:59.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558019a52160 con 0x558019b61080 2024-04-26T11:31:59.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.312+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558019aaf800 con 0x558019b653b0 2024-04-26T11:31:59.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef67e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b65cd0 0x558019b60b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef6d000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b65790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef67e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b65cd0 0x558019b60b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56328/0 (socket says 172.21.15.110:56328) 2024-04-26T11:31:59.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef67e00700 1 -- 172.21.15.110:0/3586856451 learned_addr learned my addr 172.21.15.110:0/3586856451 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef6da00700 1 --2- 172.21.15.110:0/3586856451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b61080 0x558019b614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef67e00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fef500a3e40 0x7fef500a6300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef68078b00 tx=0x7fef54009630 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef6d000700 1 -- 172.21.15.110:0/3586856451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b61080 msgr2=0x558019b614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef6d000700 1 --2- 172.21.15.110:0/3586856451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b61080 0x558019b614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef6d000700 1 -- 172.21.15.110:0/3586856451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b65cd0 msgr2=0x558019b60b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef6d000700 1 --2- 172.21.15.110:0/3586856451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b65cd0 0x558019b60b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.313+0000 7fef6d000700 1 -- 172.21.15.110:0/3586856451 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558019a5a5e0 con 0x558019b653b0 2024-04-26T11:31:59.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.314+0000 7fef6d000700 1 --2- 172.21.15.110:0/3586856451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b65790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009cc0 tx=0x7fef5c011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c09c28b39600da6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.314+0000 7fef5a000700 1 -- 172.21.15.110:0/3586856451 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c011d50 con 0x558019b653b0 2024-04-26T11:31:59.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.314+0000 7fef5a000700 1 -- 172.21.15.110:0/3586856451 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef5c004500 con 0x558019b653b0 2024-04-26T11:31:59.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.314+0000 7fef5a000700 1 -- 172.21.15.110:0/3586856451 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c005280 con 0x558019b653b0 2024-04-26T11:31:59.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.315+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3586856451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 msgr2=0x558019b65790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.315+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/3586856451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b65790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009cc0 tx=0x7fef5c011440 comp rx=0 tx=0).stop 2024-04-26T11:31:59.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.315+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3586856451 shutdown_connections 2024-04-26T11:31:59.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.315+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/3586856451 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b61080 0x558019b614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.315+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/3586856451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b65790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.315+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/3586856451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b65cd0 0x558019b60b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.315+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3586856451 >> 172.21.15.110:0/3586856451 conn(0x558019a8e2a0 msgr2=0x558019b5b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.315+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3586856451 shutdown_connections 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.315+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3586856451 wait complete. 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.316+0000 7fef7a2eeb80 1 -- start start 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.316+0000 7fef7a2eeb80 1 Processor -- start 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.316+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b61080 0x558019b6ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.316+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b653b0 0x558019b69d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.316+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 0x558019b6a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.316+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558019b6d810 con 0x558019b653b0 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.316+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558019a4e3b0 con 0x558019b65cd0 2024-04-26T11:31:59.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.316+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558019b6d990 con 0x558019b61080 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.316+0000 7fef7a2eeb80 10 client.0 _ll_register_callbacks cb 0x558019a47330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef67e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b653b0 0x558019b69d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef6d000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b61080 0x558019b6ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef67e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b653b0 0x558019b69d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56340/0 (socket says 172.21.15.110:56340) 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef67e00700 1 -- 172.21.15.110:0/4275873119 learned_addr learned my addr 172.21.15.110:0/4275873119 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef6da00700 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 0x558019b6a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef6d000700 1 -- 172.21.15.110:0/4275873119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 msgr2=0x558019b6a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef6d000700 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 0x558019b6a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef6d000700 1 -- 172.21.15.110:0/4275873119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b653b0 msgr2=0x558019b69d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef6d000700 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b653b0 0x558019b69d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef6d000700 1 -- 172.21.15.110:0/4275873119 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558019a00880 con 0x558019b61080 2024-04-26T11:31:59.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef6d000700 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b61080 0x558019b6ca20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fef5c004d90 tx=0x7fef5c013cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a037b3a451098af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.317+0000 7fef4ea00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:31:59.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.318+0000 7fef4ea00700 1 -- 172.21.15.110:0/4275873119 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c005d00 con 0x558019b61080 2024-04-26T11:31:59.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.318+0000 7fef4ea00700 1 -- 172.21.15.110:0/4275873119 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fef5c011d60 con 0x558019b61080 2024-04-26T11:31:59.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.318+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4275873119 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef5c004500 con 0x558019b61080 2024-04-26T11:31:59.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.318+0000 7fef4ea00700 1 -- 172.21.15.110:0/4275873119 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fef5c030050 con 0x558019b61080 2024-04-26T11:31:59.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.318+0000 7fef7a2eeb80 10 client.25243 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:59.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.318+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4275873119 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558019b78060 con 0x558019b61080 2024-04-26T11:31:59.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.319+0000 7fef4ea00700 1 -- 172.21.15.110:0/4275873119 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef5c004500 con 0x558019b61080 2024-04-26T11:31:59.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.319+0000 7fef4ea00700 1 -- 172.21.15.110:0/4275873119 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fef5c018070 con 0x558019b61080 2024-04-26T11:31:59.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.319+0000 7fef7a2eeb80 10 client.25243 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:59.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.319+0000 7fef7a2eeb80 10 client.25243 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T11:31:59.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.319+0000 7fef7a2eeb80 20 client.25243 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:59.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.319+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x558019b7a480 0x558019b7b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.319+0000 7fef7a2eeb80 4 client.25243 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:31:59.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.319+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4275873119 --> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558019ac1220 con 0x558019b7a480 2024-04-26T11:31:59.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.319+0000 7fef67e00700 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x558019b7a480 0x558019b7b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.320+0000 7fef4ea00700 10 client.25243 ms_handle_connect on v2:172.21.15.196:6838/1849808245 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.320+0000 7fef67e00700 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x558019b7a480 0x558019b7b8f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36870d9edf030831 server_cookie=924417121f7f42c7 in_seq=0 out_seq=0 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.321+0000 7fef4ea00700 1 -- 172.21.15.110:0/4275873119 <== mds.1 v2:172.21.15.196:6838/1849808245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558019ac1220 con 0x558019b7a480 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.321+0000 7fef4ea00700 10 client.25243 handle_command_reply: tid=0 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.321+0000 7fef7a2eeb80 1 client.25243 shutdown 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.321+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4275873119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b61080 msgr2=0x558019b6ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.321+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b61080 0x558019b6ca20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fef5c004d90 tx=0x7fef5c013cd0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4275873119 shutdown_connections 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x558019b7a480 0x558019b7b8f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 0x558019b6a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b61080 0x558019b6ca20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef4ea00700 0 client.25243 ms_handle_reset on v2:172.21.15.196:6838/1849808245 2024-04-26T11:31:59.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4275873119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b653b0 0x558019b69d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4275873119 >> 172.21.15.110:0/4275873119 conn(0x558019a8e2a0 msgr2=0x558019b55e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4275873119 shutdown_connections 2024-04-26T11:31:59.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4275873119 wait complete. 2024-04-26T11:31:59.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.322+0000 7fef7a2eeb80 20 client.25243 trim_cache size 0 max 16384 2024-04-26T11:31:59.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.344+0000 7fef7a2eeb80 1 Processor -- start 2024-04-26T11:31:59.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.344+0000 7fef7a2eeb80 1 -- start start 2024-04-26T11:31:59.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b67990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b653b0 0x558019b660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b65cd0 0x558019b665f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558019b79c30 con 0x558019b61080 2024-04-26T11:31:59.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558019b7a300 con 0x558019b653b0 2024-04-26T11:31:59.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558019b7a9d0 con 0x558019b65cd0 2024-04-26T11:31:59.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef6d000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b67990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef67e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b653b0 0x558019b660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef6da00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b65cd0 0x558019b665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef6d000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b67990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56342/0 (socket says 172.21.15.110:56342) 2024-04-26T11:31:59.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef6d000700 1 -- 172.21.15.110:0/3655519848 learned_addr learned my addr 172.21.15.110:0/3655519848 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef67e00700 1 -- 172.21.15.110:0/3655519848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b65cd0 msgr2=0x558019b665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef67e00700 1 --2- 172.21.15.110:0/3655519848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b65cd0 0x558019b665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef67e00700 1 -- 172.21.15.110:0/3655519848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 msgr2=0x558019b67990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef67e00700 1 --2- 172.21.15.110:0/3655519848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b67990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef67e00700 1 -- 172.21.15.110:0/3655519848 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558019b5bb50 con 0x558019b653b0 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef6da00700 1 --2- 172.21.15.110:0/3655519848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b65cd0 0x558019b665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.345+0000 7fef6d000700 1 --2- 172.21.15.110:0/3655519848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b67990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.346+0000 7fef67e00700 1 --2- 172.21.15.110:0/3655519848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b653b0 0x558019b660b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x558019b7c150 tx=0x7fef54027000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee9e73c08f0cbe0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.346+0000 7fef59600700 1 -- 172.21.15.110:0/3655519848 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540055e0 con 0x558019b653b0 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.346+0000 7fef59600700 1 -- 172.21.15.110:0/3655519848 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef54003b30 con 0x558019b653b0 2024-04-26T11:31:59.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.346+0000 7fef59600700 1 -- 172.21.15.110:0/3655519848 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5400f7e0 con 0x558019b653b0 2024-04-26T11:31:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.347+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3655519848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b653b0 msgr2=0x558019b660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.347+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/3655519848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b653b0 0x558019b660b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x558019b7c150 tx=0x7fef54027000 comp rx=0 tx=0).stop 2024-04-26T11:31:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.347+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3655519848 shutdown_connections 2024-04-26T11:31:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.347+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/3655519848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b65cd0 0x558019b665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.347+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/3655519848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b67990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.347+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/3655519848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b653b0 0x558019b660b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.347+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3655519848 >> 172.21.15.110:0/3655519848 conn(0x558019a8e2a0 msgr2=0x558019b67280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.347+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3655519848 shutdown_connections 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.347+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/3655519848 wait complete. 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.348+0000 7fef7a2eeb80 1 -- start start 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.348+0000 7fef7a2eeb80 1 Processor -- start 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.348+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b5efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.348+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b84d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.348+0000 7fef7a2eeb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 0x558019b852a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.348+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558019b7b770 con 0x558019b61080 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.348+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558019b7b0a0 con 0x558019b65cd0 2024-04-26T11:31:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.348+0000 7fef7a2eeb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558019b7be40 con 0x558019b653b0 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.348+0000 7fef7a2eeb80 10 client.0 _ll_register_callbacks cb 0x558019b61aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef67e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b84d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef6d000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b5efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef6da00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 0x558019b852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef67e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b84d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39158/0 (socket says 172.21.15.110:39158) 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef67e00700 1 -- 172.21.15.110:0/4002637075 learned_addr learned my addr 172.21.15.110:0/4002637075 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef67e00700 1 -- 172.21.15.110:0/4002637075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 msgr2=0x558019b852a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef67e00700 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 0x558019b852a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef67e00700 1 -- 172.21.15.110:0/4002637075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 msgr2=0x558019b5efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef67e00700 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b5efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef67e00700 1 -- 172.21.15.110:0/4002637075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558019b5dba0 con 0x558019b653b0 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef6d000700 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b5efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.349+0000 7fef6da00700 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 0x558019b852a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.350+0000 7fef67e00700 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b84d60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fef5400bfb0 tx=0x7fef54005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed447f44a2f09cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.350+0000 7fef4ea00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:31:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.350+0000 7fef4ea00700 1 -- 172.21.15.110:0/4002637075 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54003680 con 0x558019b653b0 2024-04-26T11:31:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.350+0000 7fef4ea00700 1 -- 172.21.15.110:0/4002637075 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fef54021070 con 0x558019b653b0 2024-04-26T11:31:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.350+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4002637075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef54003b30 con 0x558019b653b0 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.350+0000 7fef4ea00700 1 -- 172.21.15.110:0/4002637075 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fef54003820 con 0x558019b653b0 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.350+0000 7fef7a2eeb80 10 client.25249 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.350+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4002637075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558019be18c0 con 0x558019b653b0 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.351+0000 7fef4ea00700 1 -- 172.21.15.110:0/4002637075 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef54003b30 con 0x558019b653b0 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.351+0000 7fef4ea00700 1 -- 172.21.15.110:0/4002637075 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fef54042480 con 0x558019b653b0 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.351+0000 7fef7a2eeb80 10 client.25249 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.351+0000 7fef7a2eeb80 10 client.25249 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.351+0000 7fef7a2eeb80 20 client.25249 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.351+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x558019be60b0 0x558019be4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.351+0000 7fef7a2eeb80 4 client.25249 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T11:31:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.351+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4002637075 --> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] -- command(tid 0: {"prefix": "status"}) -- 0x558019abb2c0 con 0x558019be60b0 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.351+0000 7fef6d000700 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x558019be60b0 0x558019be4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef6d000700 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x558019be60b0 0x558019be4dc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49a00717abe46569 server_cookie=7a1d7763609e32c4 in_seq=0 out_seq=0 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef4ea00700 10 client.25249 ms_handle_connect on v2:172.21.15.196:6838/1849808245 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef4ea00700 1 -- 172.21.15.110:0/4002637075 <== mds.1 v2:172.21.15.196:6838/1849808245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558019abb2c0 con 0x558019be60b0 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef4ea00700 10 client.25249 handle_command_reply: tid=0 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef7a2eeb80 1 client.25249 shutdown 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4002637075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 msgr2=0x558019b84d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b84d60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fef5400bfb0 tx=0x7fef54005a00 comp rx=0 tx=0).stop 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4002637075 shutdown_connections 2024-04-26T11:31:59.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.196:6838/1849808245,v1:172.21.15.196:6839/1849808245] conn(0x558019be60b0 0x558019be4dc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558019b65cd0 0x558019b852a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558019b61080 0x558019b5efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef7a2eeb80 1 --2- 172.21.15.110:0/4002637075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558019b653b0 0x558019b84d60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef4ea00700 0 client.25249 ms_handle_reset on v2:172.21.15.196:6838/1849808245 2024-04-26T11:31:59.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.352+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4002637075 >> 172.21.15.110:0/4002637075 conn(0x558019a8e2a0 msgr2=0x558019b55e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4002637075 shutdown_connections 2024-04-26T11:31:59.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef7a2eeb80 1 -- 172.21.15.110:0/4002637075 wait complete. 2024-04-26T11:31:59.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef7a2eeb80 20 client.25249 trim_cache size 0 max 16384 2024-04-26T11:31:59.359 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:31:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:31:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 1, 2024-04-26T11:31:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24502, 2024-04-26T11:31:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-26T11:31:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-26T11:31:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-26T11:31:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 267.769424964, 2024-04-26T11:31:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 26, 2024-04-26T11:31:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 94, 2024-04-26T11:31:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 94, 2024-04-26T11:31:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 316.73298042099998 2024-04-26T11:31:59.360 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:31:59.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 -- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fef500a3e40 msgr2=0x7fef500a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fef500a3e40 0x7fef500a6300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef68078b00 tx=0x7fef54009630 comp rx=0 tx=0).stop 2024-04-26T11:31:59.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 -- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef6810fa50 msgr2=0x7fef681a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef6810fa50 0x7fef681a49f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fef6000efb0 tx=0x7fef6000c3a0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 -- 172.21.15.110:0/2920746446 shutdown_connections 2024-04-26T11:31:59.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fef500a3e40 0x7fef500a6300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef6810fa50 0x7fef681a49f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef68109a50 0x7fef681a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 --2- 172.21.15.110:0/2920746446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef6810a410 0x7fef681a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.353+0000 7fef6fa00700 1 -- 172.21.15.110:0/2920746446 >> 172.21.15.110:0/2920746446 conn(0x7fef68076bf0 msgr2=0x7fef680771b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.354+0000 7fef6fa00700 1 -- 172.21.15.110:0/2920746446 shutdown_connections 2024-04-26T11:31:59.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:31:59.354+0000 7fef6fa00700 1 -- 172.21.15.110:0/2920746446 wait complete. 2024-04-26T11:31:59.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.819+0000 7f6fbfa00640 1 -- 172.21.15.110:0/442727898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 msgr2=0x7f6fb81119c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.819+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/442727898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 0x7f6fb81119c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009ca0 tx=0x7f6fb002a8c0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.819+0000 7f6fbfa00640 1 -- 172.21.15.110:0/442727898 shutdown_connections 2024-04-26T11:31:59.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.819+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/442727898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 0x7f6fb81119c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.819+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/442727898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fb8104b40 0x7f6fb8104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.819+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/442727898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fb810ac00 0x7f6fb810afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.819+0000 7f6fbfa00640 1 -- 172.21.15.110:0/442727898 >> 172.21.15.110:0/442727898 conn(0x7f6fb8100630 msgr2=0x7f6fb8102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.819+0000 7f6fbfa00640 1 -- 172.21.15.110:0/442727898 shutdown_connections 2024-04-26T11:31:59.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.819+0000 7f6fbfa00640 1 -- 172.21.15.110:0/442727898 wait complete. 2024-04-26T11:31:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.820+0000 7f6fbfa00640 1 Processor -- start 2024-04-26T11:31:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.820+0000 7f6fbfa00640 1 -- start start 2024-04-26T11:31:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.820+0000 7f6fbfa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fb8104b40 0x7f6fb819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.820+0000 7f6fbfa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 0x7f6fb819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.820+0000 7f6fbfa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fb810ac00 0x7f6fb819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.820+0000 7f6fbfa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8114e00 con 0x7f6fb8105500 2024-04-26T11:31:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.820+0000 7f6fbfa00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8114c80 con 0x7f6fb810ac00 2024-04-26T11:31:59.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.820+0000 7f6fbfa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8114f80 con 0x7f6fb8104b40 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fb7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 0x7f6fb819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fb7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 0x7f6fb819b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56374/0 (socket says 172.21.15.110:56374) 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fb7e00640 1 -- 172.21.15.110:0/3128811918 learned_addr learned my addr 172.21.15.110:0/3128811918 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fbda00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fb810ac00 0x7f6fb819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fbd000640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fb8104b40 0x7f6fb819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fb7e00640 1 -- 172.21.15.110:0/3128811918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fb8104b40 msgr2=0x7f6fb819b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fb8104b40 0x7f6fb819b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fb7e00640 1 -- 172.21.15.110:0/3128811918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fb810ac00 msgr2=0x7f6fb819faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fb810ac00 0x7f6fb819faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fb7e00640 1 -- 172.21.15.110:0/3128811918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb81a01d0 con 0x7f6fb8105500 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.821+0000 7f6fbda00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fb810ac00 0x7f6fb819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.822+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 0x7f6fb819b720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400e9f0 tx=0x7f6fa400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.822+0000 7f6fb5600640 1 -- 172.21.15.110:0/3128811918 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa400cd80 con 0x7f6fb8105500 2024-04-26T11:31:59.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.822+0000 7f6fb5600640 1 -- 172.21.15.110:0/3128811918 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fa40108e0 con 0x7f6fb8105500 2024-04-26T11:31:59.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.822+0000 7f6fb5600640 1 -- 172.21.15.110:0/3128811918 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4018980 con 0x7f6fb8105500 2024-04-26T11:31:59.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.822+0000 7f6fbfa00640 1 -- 172.21.15.110:0/3128811918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb81a04c0 con 0x7f6fb8105500 2024-04-26T11:31:59.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.822+0000 7f6fbfa00640 1 -- 172.21.15.110:0/3128811918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb81a7d50 con 0x7f6fb8105500 2024-04-26T11:31:59.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.825+0000 7f6fc278c740 1 Processor -- start 2024-04-26T11:31:59.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.825+0000 7f6fb5600640 1 -- 172.21.15.110:0/3128811918 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 24) ==== 138823+0+0 (secure 0 0 0) 0x7f6fa4010430 con 0x7f6fb8105500 2024-04-26T11:31:59.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.825+0000 7f6fc278c740 1 -- start start 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634138f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138fca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 0x5634138ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fc278c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563413857380 con 0x5634138f1dd0 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fc278c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5634137f3c30 con 0x5634138fcfb0 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fc278c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563413853340 con 0x5634138f26f0 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fbda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634138f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fbda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634138f21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56388/0 (socket says 172.21.15.110:56388) 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fbda00640 1 -- 172.21.15.110:0/1871973649 learned_addr learned my addr 172.21.15.110:0/1871973649 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/1871973649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 0x5634138ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.826+0000 7f6fbd000640 1 --2- 172.21.15.110:0/1871973649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.827+0000 7f6fbda00640 1 -- 172.21.15.110:0/1871973649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 msgr2=0x5634138fca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.827+0000 7f6fbda00640 1 --2- 172.21.15.110:0/1871973649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138fca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.827+0000 7f6fbda00640 1 -- 172.21.15.110:0/1871973649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 msgr2=0x5634138ff3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.827+0000 7f6fbda00640 1 --2- 172.21.15.110:0/1871973649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 0x5634138ff3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.827+0000 7f6fbda00640 1 -- 172.21.15.110:0/1871973649 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563413815940 con 0x5634138f1dd0 2024-04-26T11:31:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.827+0000 7f6fbda00640 1 --2- 172.21.15.110:0/1871973649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634138f21b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009ca0 tx=0x7f6fb0009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e2a3ed2369666c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.827+0000 7f6fb5600640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6fa00a3ee0 0x7f6fa00a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.828+0000 7f6fb5600640 1 -- 172.21.15.110:0/3128811918 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6fa40d0cf0 con 0x7f6fb8105500 2024-04-26T11:31:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.828+0000 7f6faa000640 1 -- 172.21.15.110:0/1871973649 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0031650 con 0x5634138f1dd0 2024-04-26T11:31:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.828+0000 7f6fbd000640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6fa00a3ee0 0x7f6fa00a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.828+0000 7f6faa000640 1 -- 172.21.15.110:0/1871973649 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fb0036040 con 0x5634138f1dd0 2024-04-26T11:31:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.828+0000 7f6faa000640 1 -- 172.21.15.110:0/1871973649 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00044b0 con 0x5634138f1dd0 2024-04-26T11:31:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.828+0000 7f6fc278c740 1 -- 172.21.15.110:0/1871973649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 msgr2=0x5634138f21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.828+0000 7f6fbd000640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6fa00a3ee0 0x7f6fa00a63a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x5634138f3370 tx=0x7f6fac00b390 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.828+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1871973649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634138f21b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009ca0 tx=0x7f6fb0009950 comp rx=0 tx=0).stop 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.829+0000 7f6fc278c740 1 -- 172.21.15.110:0/1871973649 shutdown_connections 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.829+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1871973649 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 0x5634138ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.829+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1871973649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138fca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.829+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1871973649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634138f21b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.829+0000 7f6fc278c740 1 -- 172.21.15.110:0/1871973649 >> 172.21.15.110:0/1871973649 conn(0x5634138ee2e0 msgr2=0x5634138ee6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.829+0000 7f6fc278c740 1 -- 172.21.15.110:0/1871973649 shutdown_connections 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.829+0000 7f6fc278c740 1 -- 172.21.15.110:0/1871973649 wait complete. 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.829+0000 7f6fc278c740 1 -- start start 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.829+0000 7f6fc278c740 1 Processor -- start 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f1dd0 0x5634138f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f26f0 0x5634138fa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138fa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fc278c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5634138ffa00 con 0x5634138fcfb0 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fc278c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5634137dec60 con 0x5634138f26f0 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fc278c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5634138ffb80 con 0x5634138f1dd0 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fc278c740 10 client.0 _ll_register_callbacks cb 0x56341380ae50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fbda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138fa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fbda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138fa9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56398/0 (socket says 172.21.15.110:56398) 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fbda00640 1 -- 172.21.15.110:0/1893218356 learned_addr learned my addr 172.21.15.110:0/1893218356 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fbd000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f1dd0 0x5634138f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.830+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f26f0 0x5634138fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.831+0000 7f6fbd000640 1 -- 172.21.15.110:0/1893218356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f26f0 msgr2=0x5634138fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.831+0000 7f6fbd000640 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f26f0 0x5634138fa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.831+0000 7f6fbd000640 1 -- 172.21.15.110:0/1893218356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 msgr2=0x5634138fa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.831+0000 7f6fbd000640 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138fa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.831+0000 7f6fbd000640 1 -- 172.21.15.110:0/1893218356 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634137ed510 con 0x5634138f1dd0 2024-04-26T11:31:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.831+0000 7f6fbda00640 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138fa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.831+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f26f0 0x5634138fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.831+0000 7f6fbd000640 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f1dd0 0x5634138f9f30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0043f0 tx=0x7f6fac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e1bbd6f65f637dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.831+0000 7f6f9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:31:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.832+0000 7f6f9ea00640 1 -- 172.21.15.110:0/1893218356 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac01fca0 con 0x5634138f1dd0 2024-04-26T11:31:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.832+0000 7f6f9ea00640 1 -- 172.21.15.110:0/1893218356 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6fac017030 con 0x5634138f1dd0 2024-04-26T11:31:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.832+0000 7f6fc278c740 1 -- 172.21.15.110:0/1893218356 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fb0036040 con 0x5634138f1dd0 2024-04-26T11:31:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.832+0000 7f6f9ea00640 1 -- 172.21.15.110:0/1893218356 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6fac01fe40 con 0x5634138f1dd0 2024-04-26T11:31:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.832+0000 7f6fc278c740 10 client.25261 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.832+0000 7f6fc278c740 1 -- 172.21.15.110:0/1893218356 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563413569210 con 0x5634138f1dd0 2024-04-26T11:31:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.832+0000 7f6f9ea00640 1 -- 172.21.15.110:0/1893218356 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fb0036040 con 0x5634138f1dd0 2024-04-26T11:31:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.832+0000 7f6f9ea00640 1 -- 172.21.15.110:0/1893218356 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f6fac011600 con 0x5634138f1dd0 2024-04-26T11:31:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.833+0000 7f6fc278c740 10 client.25261 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.833+0000 7f6fc278c740 10 client.25261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.833+0000 7f6fc278c740 20 client.25261 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.833+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56341390cc00 0x56341390f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.833+0000 7f6fc278c740 4 client.25261 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.833+0000 7f6fc278c740 1 -- 172.21.15.110:0/1893218356 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563413864f90 con 0x56341390cc00 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.833+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56341390cc00 0x56341390f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.834+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56341390cc00 0x56341390f070 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22c8397a034ab23e server_cookie=1c4d49e7bb2973bf in_seq=0 out_seq=0 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.834+0000 7f6f9ea00640 10 client.25261 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6f9ea00640 1 -- 172.21.15.110:0/1893218356 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563413864f90 con 0x56341390cc00 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6f9ea00640 10 client.25261 handle_command_reply: tid=0 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 client.25261 shutdown 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 -- 172.21.15.110:0/1893218356 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f1dd0 msgr2=0x5634138f9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.840 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f1dd0 0x5634138f9f30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0043f0 tx=0x7f6fac0046c0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 -- 172.21.15.110:0/1893218356 shutdown_connections 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138fa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f26f0 0x5634138fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56341390cc00 0x56341390f070 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1893218356 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f1dd0 0x5634138f9f30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6f9ea00640 0 client.25261 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 -- 172.21.15.110:0/1893218356 >> 172.21.15.110:0/1893218356 conn(0x5634138ee2e0 msgr2=0x5634138f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 -- 172.21.15.110:0/1893218356 shutdown_connections 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.835+0000 7f6fc278c740 1 -- 172.21.15.110:0/1893218356 wait complete. 2024-04-26T11:31:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.836+0000 7f6fc278c740 20 client.25261 trim_cache size 0 max 16384 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fc278c740 1 Processor -- start 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fc278c740 1 -- start start 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634139088c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138fbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 0x563413914980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fc278c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81b3120 con 0x5634138f1dd0 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fc278c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81b09f0 con 0x5634138fcfb0 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fc278c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81ae840 con 0x5634138f26f0 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fbd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634139088c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fbd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634139088c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56410/0 (socket says 172.21.15.110:56410) 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fbd000640 1 -- 172.21.15.110:0/1297327418 learned_addr learned my addr 172.21.15.110:0/1297327418 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fbda00640 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 0x563413914980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.852+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138fbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fbd000640 1 -- 172.21.15.110:0/1297327418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 msgr2=0x5634138fbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fbd000640 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138fbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fbd000640 1 -- 172.21.15.110:0/1297327418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 msgr2=0x563413914980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fbd000640 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 0x563413914980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fbd000640 1 -- 172.21.15.110:0/1297327418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634138ff710 con 0x5634138f1dd0 2024-04-26T11:31:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fbda00640 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 0x563413914980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fbd000640 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634139088c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6fac000c00 tx=0x7f6fac004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0997c581702c25e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fa9600640 1 -- 172.21.15.110:0/1297327418 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac011440 con 0x5634138f1dd0 2024-04-26T11:31:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fa9600640 1 -- 172.21.15.110:0/1297327418 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fac0054f0 con 0x5634138f1dd0 2024-04-26T11:31:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.853+0000 7f6fa9600640 1 -- 172.21.15.110:0/1297327418 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac004b90 con 0x5634138f1dd0 2024-04-26T11:31:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.854+0000 7f6fc278c740 1 -- 172.21.15.110:0/1297327418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 msgr2=0x5634139088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:31:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.854+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634139088c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6fac000c00 tx=0x7f6fac004460 comp rx=0 tx=0).stop 2024-04-26T11:31:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.854+0000 7f6fc278c740 1 -- 172.21.15.110:0/1297327418 shutdown_connections 2024-04-26T11:31:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.854+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138fcfb0 0x563413914980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.854+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138fbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.854+0000 7f6fc278c740 1 --2- 172.21.15.110:0/1297327418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138f1dd0 0x5634139088c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.854+0000 7f6fc278c740 1 -- 172.21.15.110:0/1297327418 >> 172.21.15.110:0/1297327418 conn(0x5634138ee2e0 msgr2=0x5634138fb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.854+0000 7f6fc278c740 1 -- 172.21.15.110:0/1297327418 shutdown_connections 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.854+0000 7f6fc278c740 1 -- 172.21.15.110:0/1297327418 wait complete. 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.855+0000 7f6fc278c740 1 -- start start 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.855+0000 7f6fc278c740 1 Processor -- start 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.855+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f1dd0 0x5634138f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.855+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.855+0000 7f6fc278c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138f7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.855+0000 7f6fc278c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81aeeb0 con 0x5634138fcfb0 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.855+0000 7f6fc278c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81b0320 con 0x5634138f1dd0 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.855+0000 7f6fc278c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81af580 con 0x5634138f26f0 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.855+0000 7f6fc278c740 10 client.0 _ll_register_callbacks cb 0x7f6fac00bed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:31:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138f7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56424/0 (socket says 172.21.15.110:56424) 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fb7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbda00640 1 -- 172.21.15.110:0/2177320912 learned_addr learned my addr 172.21.15.110:0/2177320912 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbd000640 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f1dd0 0x5634138f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbda00640 1 -- 172.21.15.110:0/2177320912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 msgr2=0x5634138f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbda00640 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138f71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbda00640 1 -- 172.21.15.110:0/2177320912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f1dd0 msgr2=0x5634138f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbda00640 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f1dd0 0x5634138f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbda00640 1 -- 172.21.15.110:0/2177320912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563413635620 con 0x5634138fcfb0 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fb7e00640 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbd000640 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f1dd0 0x5634138f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6fbda00640 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138f7720 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009a60 tx=0x7f6fb0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4306497d176d807b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.856+0000 7f6f9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.857+0000 7f6f9ea00640 1 -- 172.21.15.110:0/2177320912 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0053070 con 0x5634138fcfb0 2024-04-26T11:31:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.857+0000 7f6fc278c740 1 -- 172.21.15.110:0/2177320912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fac0054f0 con 0x5634138fcfb0 2024-04-26T11:31:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.857+0000 7f6f9ea00640 1 -- 172.21.15.110:0/2177320912 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6fb0003f20 con 0x5634138fcfb0 2024-04-26T11:31:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.857+0000 7f6f9ea00640 1 -- 172.21.15.110:0/2177320912 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6fb005f050 con 0x5634138fcfb0 2024-04-26T11:31:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.857+0000 7f6fc278c740 10 client.15159 fetch_fsmap learned FSMap version 26 2024-04-26T11:31:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.857+0000 7f6fc278c740 1 -- 172.21.15.110:0/2177320912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563413811cb0 con 0x5634138fcfb0 2024-04-26T11:31:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.857+0000 7f6f9ea00640 1 -- 172.21.15.110:0/2177320912 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fac0054f0 con 0x5634138fcfb0 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.858+0000 7f6f9ea00640 1 -- 172.21.15.110:0/2177320912 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f6fb0044070 con 0x5634138fcfb0 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.858+0000 7f6fc278c740 10 client.15159 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.858+0000 7f6fc278c740 10 client.15159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.858+0000 7f6fc278c740 20 client.15159 populate_metadata read hostname 'smithi110' 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.858+0000 7f6fc278c740 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563413973710 0x563413975b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.858+0000 7f6fc278c740 4 client.15159 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.858+0000 7f6fc278c740 1 -- 172.21.15.110:0/2177320912 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56341385ee00 con 0x563413973710 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.858+0000 7f6fbd000640 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563413973710 0x563413975b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.859+0000 7f6fbd000640 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563413973710 0x563413975b30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f15edf3d51acca00 server_cookie=a614ad3816a071bc in_seq=0 out_seq=0 2024-04-26T11:31:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:31:59.859+0000 7f6f9ea00640 10 client.15159 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:31:59 smithi196 ceph-mon[32572]: pgmap v24: 97 pgs: 97 active+clean; 25 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 2.0 MiB/s wr, 30 op/s 2024-04-26T11:32:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:31:59 smithi110 ceph-mon[28069]: pgmap v24: 97 pgs: 97 active+clean; 25 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 2.0 MiB/s wr, 30 op/s 2024-04-26T11:32:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:31:59 smithi193 ceph-mon[32782]: pgmap v24: 97 pgs: 97 active+clean; 25 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 2.0 MiB/s wr, 30 op/s 2024-04-26T11:32:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6f9ea00640 1 -- 172.21.15.110:0/2177320912 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56341385ee00 con 0x563413973710 2024-04-26T11:32:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6f9ea00640 10 client.15159 handle_command_reply: tid=0 2024-04-26T11:32:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 client.15159 shutdown 2024-04-26T11:32:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 -- 172.21.15.110:0/2177320912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 msgr2=0x5634138f7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138f7720 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0009a60 tx=0x7f6fb0003ba0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 -- 172.21.15.110:0/2177320912 shutdown_connections 2024-04-26T11:32:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634138fcfb0 0x5634138f7720 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563413973710 0x563413975b30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5634138f26f0 0x5634138f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 --2- 172.21.15.110:0/2177320912 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5634138f1dd0 0x5634138f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 -- 172.21.15.110:0/2177320912 >> 172.21.15.110:0/2177320912 conn(0x5634138ee2e0 msgr2=0x5634138f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6f9ea00640 0 client.15159 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 -- 172.21.15.110:0/2177320912 shutdown_connections 2024-04-26T11:32:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 1 -- 172.21.15.110:0/2177320912 wait complete. 2024-04-26T11:32:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.134+0000 7f6fc278c740 20 client.15159 trim_cache size 0 max 16384 2024-04-26T11:32:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:32:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:32:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:32:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:32:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 -- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6fa00a3ee0 msgr2=0x7f6fa00a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6fa00a3ee0 0x7f6fa00a63a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x5634138f3370 tx=0x7f6fac00b390 comp rx=0 tx=0).stop 2024-04-26T11:32:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 -- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 msgr2=0x7f6fb819b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 0x7f6fb819b720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400e9f0 tx=0x7f6fa400eeb0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 -- 172.21.15.110:0/3128811918 shutdown_connections 2024-04-26T11:32:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6fa00a3ee0 0x7f6fa00a63a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6fb810ac00 0x7f6fb819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb8105500 0x7f6fb819b720 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 --2- 172.21.15.110:0/3128811918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fb8104b40 0x7f6fb819b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.135+0000 7f6fbfa00640 1 -- 172.21.15.110:0/3128811918 >> 172.21.15.110:0/3128811918 conn(0x7f6fb8100630 msgr2=0x7f6fb8101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.136+0000 7f6fbfa00640 1 -- 172.21.15.110:0/3128811918 shutdown_connections 2024-04-26T11:32:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:00.136+0000 7f6fbfa00640 1 -- 172.21.15.110:0/3128811918 wait complete. 2024-04-26T11:32:00.307 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-26T11:32:00.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:32:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:32:00.151+0000 7f1b2ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:32:00.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:32:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:32:00.151+0000 7f1b2ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:32:00.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:32:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:32:00.151+0000 7f1b2ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:32:00.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:32:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:32:00.151+0000 7f1b2ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:32:00.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:32:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:32:00.151+0000 7f1b2ee00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:32:00.830 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:32:01.209 INFO:teuthology.orchestra.run.smithi110.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-04-26T11:32:01.216 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-04-26T11:32:01.326 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/: 2024-04-26T11:32:01.326 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.326 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 . 2024-04-26T11:32:01.326 INFO:teuthology.orchestra.run.smithi110.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 .. 2024-04-26T11:32:01.326 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 data 2024-04-26T11:32:01.326 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.326 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data: 2024-04-26T11:32:01.326 INFO:teuthology.orchestra.run.smithi110.stdout:total 35 2024-04-26T11:32:01.326 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 . 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 .. 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:31 base 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Apr 26 11:31 global 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 log 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_commit_ts 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_dynshmem 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Apr 26 11:31 pg_hba.conf 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Apr 26 11:31 pg_ident.conf 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:32 pg_logical 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 11:31 pg_multixact 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_notify 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_replslot 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_serial 2024-04-26T11:32:01.327 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_snapshots 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_stat 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_stat_tmp 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 pg_subtrans 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_tblspc 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 pg_twophase 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:31 PG_VERSION 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 11:31 pg_wal 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 pg_xact 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Apr 26 11:31 postgresql.auto.conf 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 Apr 26 11:31 postgresql.conf 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base: 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:31 . 2024-04-26T11:32:01.328 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 11:31 1 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 11:31 13493 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 11:32 13494 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/1: 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:total 7777 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 11:31 . 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:31 .. 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 112 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 113 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 11:31 1247 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1247_fsm 2024-04-26T11:32:01.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1247_vm 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Apr 26 11:31 1249 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1249_fsm 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1249_vm 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Apr 26 11:31 1255 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1255_fsm 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1255_vm 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Apr 26 11:31 1259 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1259_fsm 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1259_vm 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Apr 26 11:31 13344 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13344_fsm 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13344_vm 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13346 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13348 2024-04-26T11:32:01.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13349 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13349_fsm 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13349_vm 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13351 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13353 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13354 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13354_fsm 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13354_vm 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13356 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13358 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13359 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13359_fsm 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13359_vm 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13361 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13363 2024-04-26T11:32:01.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 1417 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 1418 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 174 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 175 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2187 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2224 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2328 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2336 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2337 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2579 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2600 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2600_fsm 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2600_vm 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2601 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2601_fsm 2024-04-26T11:32:01.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2601_vm 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 11:31 2602 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2602_fsm 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2602_vm 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2603 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2603_fsm 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2603_vm 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2604 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2605 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2605_fsm 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2605_vm 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2606 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2606_fsm 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2606_vm 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2607 2024-04-26T11:32:01.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2607_fsm 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2607_vm 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Apr 26 11:31 2608 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2608_fsm 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2608_vm 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Apr 26 11:31 2609 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2609_fsm 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2609_vm 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2610 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2610_fsm 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2610_vm 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2611 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2612 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2612_fsm 2024-04-26T11:32:01.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2612_vm 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2613 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2615 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2615_fsm 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2615_vm 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2616 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2616_fsm 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2616_vm 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Apr 26 11:31 2617 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2617_fsm 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2617_vm 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Apr 26 11:31 2618 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2618_fsm 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2618_vm 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Apr 26 11:31 2619 2024-04-26T11:32:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2619_fsm 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2619_vm 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2620 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2650 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2651 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2652 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 2653 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 2654 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2655 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2656 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2657 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Apr 26 11:31 2658 2024-04-26T11:32:01.336 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 11:31 2659 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2660 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2661 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2662 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 11:31 2663 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2664 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2665 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2666 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2667 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2668 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2669 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2670 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Apr 26 11:31 2673 2024-04-26T11:32:01.337 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Apr 26 11:31 2674 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Apr 26 11:31 2675 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2678 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2679 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2680 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2681 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2682 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2683 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2684 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2685 2024-04-26T11:32:01.338 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2686 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2687 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 2688 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 11:31 2689 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Apr 26 11:31 2690 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Apr 26 11:31 2691 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2692 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2693 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2696 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2699 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2701 2024-04-26T11:32:01.339 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2702 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2703 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 2704 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2753 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2753_fsm 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2753_vm 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2754 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2755 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2756 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2757 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2830 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2831 2024-04-26T11:32:01.340 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2832 2024-04-26T11:32:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2833 2024-04-26T11:32:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2834 2024-04-26T11:32:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2835 2024-04-26T11:32:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2836 2024-04-26T11:32:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2837 2024-04-26T11:32:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Apr 26 11:31 2838 2024-04-26T11:32:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2838_fsm 2024-04-26T11:32:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2838_vm 2024-04-26T11:32:01.341 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2839 2024-04-26T11:32:01.342 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2840 2024-04-26T11:32:01.342 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2840_fsm 2024-04-26T11:32:01.342 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2840_vm 2024-04-26T11:32:01.342 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2841 2024-04-26T11:32:01.342 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2995 2024-04-26T11:32:01.342 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2996 2024-04-26T11:32:01.342 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3079 2024-04-26T11:32:01.342 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3079_fsm 2024-04-26T11:32:01.342 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3079_vm 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3080 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3081 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 3085 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3118 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3119 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Apr 26 11:31 3164 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3256 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3257 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3258 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3350 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3351 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3379 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3380 2024-04-26T11:32:01.343 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3381 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3394 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3394_fsm 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3394_vm 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3395 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3429 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3430 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3431 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3433 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3439 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3440 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 3455 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Apr 26 11:31 3456 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3456_fsm 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3456_vm 2024-04-26T11:32:01.344 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3466 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3467 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3468 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3501 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3502 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3503 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3534 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3541 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3541_fsm 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3541_vm 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3542 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3574 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3575 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3576 2024-04-26T11:32:01.345 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3596 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3597 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3598 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3599 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3600 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3600_fsm 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3600_vm 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3601 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3601_fsm 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3601_vm 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3602 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3602_fsm 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3602_vm 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3603 2024-04-26T11:32:01.346 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3603_fsm 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3603_vm 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3604 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3605 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3606 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3607 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3608 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 3609 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3712 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3764 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3764_fsm 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3764_vm 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3766 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3767 2024-04-26T11:32:01.347 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3997 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4143 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4144 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4145 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4146 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4147 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4148 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4149 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4150 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4151 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4152 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4153 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4154 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4155 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4156 2024-04-26T11:32:01.348 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4157 2024-04-26T11:32:01.349 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4158 2024-04-26T11:32:01.349 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4159 2024-04-26T11:32:01.349 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4160 2024-04-26T11:32:01.349 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4161 2024-04-26T11:32:01.349 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4162 2024-04-26T11:32:01.349 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4163 2024-04-26T11:32:01.349 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4164 2024-04-26T11:32:01.349 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4165 2024-04-26T11:32:01.355 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4166 2024-04-26T11:32:01.356 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4167 2024-04-26T11:32:01.356 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4168 2024-04-26T11:32:01.356 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4169 2024-04-26T11:32:01.356 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4170 2024-04-26T11:32:01.356 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4171 2024-04-26T11:32:01.356 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4172 2024-04-26T11:32:01.356 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4173 2024-04-26T11:32:01.356 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4174 2024-04-26T11:32:01.356 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 5002 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 548 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 549 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6102 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6104 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6106 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6110 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6111 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6112 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6113 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6117 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 826 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 827 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 828 2024-04-26T11:32:01.357 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 26 11:31 pg_filenode.map 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:31 PG_VERSION 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:total 7777 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 11:31 . 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:31 .. 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 112 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 113 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 11:31 1247 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1247_fsm 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1247_vm 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Apr 26 11:31 1249 2024-04-26T11:32:01.358 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1249_fsm 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1249_vm 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Apr 26 11:31 1255 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1255_fsm 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1255_vm 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Apr 26 11:31 1259 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1259_fsm 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1259_vm 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Apr 26 11:31 13344 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13344_fsm 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13344_vm 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13346 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13348 2024-04-26T11:32:01.359 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13349 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13349_fsm 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13349_vm 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13351 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13353 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13354 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13354_fsm 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13354_vm 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13356 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13358 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13359 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13359_fsm 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13359_vm 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13361 2024-04-26T11:32:01.360 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13363 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 1417 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 1418 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 174 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 175 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2187 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2224 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2328 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2336 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2337 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2579 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2600 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2600_fsm 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2600_vm 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2601 2024-04-26T11:32:01.361 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2601_fsm 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2601_vm 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 11:31 2602 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2602_fsm 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2602_vm 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2603 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2603_fsm 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2603_vm 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2604 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2605 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2605_fsm 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2605_vm 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2606 2024-04-26T11:32:01.362 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2606_fsm 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2606_vm 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2607 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2607_fsm 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2607_vm 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Apr 26 11:31 2608 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2608_fsm 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2608_vm 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Apr 26 11:31 2609 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2609_fsm 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2609_vm 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2610 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2610_fsm 2024-04-26T11:32:01.363 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2610_vm 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2611 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2612 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2612_fsm 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2612_vm 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2613 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2615 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2615_fsm 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2615_vm 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2616 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2616_fsm 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2616_vm 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Apr 26 11:31 2617 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2617_fsm 2024-04-26T11:32:01.364 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2617_vm 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Apr 26 11:31 2618 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2618_fsm 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2618_vm 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Apr 26 11:31 2619 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2619_fsm 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2619_vm 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2620 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2650 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2651 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2652 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 2653 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 2654 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2655 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2656 2024-04-26T11:32:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2657 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Apr 26 11:31 2658 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 11:31 2659 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2660 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2661 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2662 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 11:31 2663 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2664 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2665 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2666 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2667 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2668 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2669 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2670 2024-04-26T11:32:01.366 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Apr 26 11:31 2673 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Apr 26 11:31 2674 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Apr 26 11:31 2675 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2678 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2679 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2680 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2681 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2682 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2683 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2684 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2685 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2686 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2687 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 2688 2024-04-26T11:32:01.367 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 11:31 2689 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Apr 26 11:31 2690 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Apr 26 11:31 2691 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2692 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2693 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2696 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2699 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2701 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2702 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2703 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 2704 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2753 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2753_fsm 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2753_vm 2024-04-26T11:32:01.368 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2754 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2755 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2756 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2757 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2830 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2831 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2832 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2833 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2834 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2835 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2836 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2837 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Apr 26 11:31 2838 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2838_fsm 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2838_vm 2024-04-26T11:32:01.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2839 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2840 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2840_fsm 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2840_vm 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2841 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2995 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2996 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3079 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3079_fsm 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3079_vm 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3080 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3081 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 3085 2024-04-26T11:32:01.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3118 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3119 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Apr 26 11:31 3164 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3256 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3257 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3258 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3350 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3351 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3379 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3380 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3381 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3394 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3394_fsm 2024-04-26T11:32:01.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3394_vm 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3395 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3429 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3430 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3431 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3433 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3439 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3440 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 3455 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Apr 26 11:31 3456 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3456_fsm 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3456_vm 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3466 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3467 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3468 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3501 2024-04-26T11:32:01.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3502 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3503 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3534 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3541 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3541_fsm 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3541_vm 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3542 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3574 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3575 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3576 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3596 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3597 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3598 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3599 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3600 2024-04-26T11:32:01.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3600_fsm 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3600_vm 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3601 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3601_fsm 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3601_vm 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3602 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3602_fsm 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3602_vm 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3603 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3603_fsm 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3603_vm 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3604 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3605 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3606 2024-04-26T11:32:01.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3607 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3608 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 3609 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3712 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3764 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3764_fsm 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3764_vm 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3766 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3767 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3997 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4143 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4144 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4145 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4146 2024-04-26T11:32:01.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4147 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4148 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4149 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4150 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4151 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4152 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4153 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4154 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4155 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4156 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4157 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4158 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4159 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4160 2024-04-26T11:32:01.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4161 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4162 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4163 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4164 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4165 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4166 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4167 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4168 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4169 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4170 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4171 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4172 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4173 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4174 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 5002 2024-04-26T11:32:01.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 548 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 549 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6102 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6104 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6106 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6110 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6111 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6112 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6113 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6117 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 826 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 827 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 828 2024-04-26T11:32:01.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 26 11:31 pg_filenode.map 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:31 PG_VERSION 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:total 7777 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 11:32 . 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:31 .. 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 112 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 113 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 11:32 1247 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1247_fsm 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1247_vm 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Apr 26 11:32 1249 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1249_fsm 2024-04-26T11:32:01.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1249_vm 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Apr 26 11:31 1255 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 1255_fsm 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1255_vm 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Apr 26 11:32 1259 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 1259_fsm 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1259_vm 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Apr 26 11:31 13344 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13344_fsm 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 13344_vm 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13346 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 13348 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13349 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13349_fsm 2024-04-26T11:32:01.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 13349_vm 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 13351 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 13353 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 13354 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 13354_fsm 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 13354_vm 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 13356 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13358 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13359 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 13359_fsm 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13359_vm 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 13361 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 13363 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 1417 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 1418 2024-04-26T11:32:01.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 174 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 175 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2187 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2224 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 2328 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2336 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2337 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2579 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2600 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2600_fsm 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2600_vm 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2601 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2601_fsm 2024-04-26T11:32:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2601_vm 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 11:31 2602 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2602_fsm 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2602_vm 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:32 2603 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2603_fsm 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2603_vm 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2604 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2605 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2605_fsm 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2605_vm 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2606 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2606_fsm 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2606_vm 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2607 2024-04-26T11:32:01.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2607_fsm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2607_vm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Apr 26 11:32 2608 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2608_fsm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2608_vm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Apr 26 11:31 2609 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2609_fsm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2609_vm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:32 2610 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2610_fsm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2610_vm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2611 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2612 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2612_fsm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2612_vm 2024-04-26T11:32:01.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 2613 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2615 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2615_fsm 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2615_vm 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2616 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2616_fsm 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2616_vm 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Apr 26 11:31 2617 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2617_fsm 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2617_vm 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Apr 26 11:31 2618 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2618_fsm 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2618_vm 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Apr 26 11:31 2619 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2619_fsm 2024-04-26T11:32:01.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2619_vm 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2620 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2650 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2651 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2652 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:32 2653 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:32 2654 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:32 2655 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2656 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2657 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Apr 26 11:31 2658 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 11:32 2659 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2660 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2661 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2662 2024-04-26T11:32:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 11:32 2663 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2664 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2665 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2666 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2667 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2668 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2669 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2670 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Apr 26 11:32 2673 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Apr 26 11:32 2674 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Apr 26 11:31 2675 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2678 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2679 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2680 2024-04-26T11:32:01.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2681 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2682 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2683 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2684 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2685 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2686 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2687 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:31 2688 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 11:31 2689 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Apr 26 11:32 2690 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Apr 26 11:32 2691 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2692 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2693 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2696 2024-04-26T11:32:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2699 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2701 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2702 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:32 2703 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:32 2704 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2753 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2753_fsm 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2753_vm 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2754 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2755 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2756 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 2757 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 2830 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2831 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2832 2024-04-26T11:32:01.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2833 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 2834 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2835 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 2836 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2837 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Apr 26 11:32 2838 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2838_fsm 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2838_vm 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2839 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2840 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 2840_fsm 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2840_vm 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2841 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2995 2024-04-26T11:32:01.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2996 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3079 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3079_fsm 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3079_vm 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 3080 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 3081 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:32 3085 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 3118 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3119 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Apr 26 11:32 3164 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 3256 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3257 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3258 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3350 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3351 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3379 2024-04-26T11:32:01.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3380 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 3381 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 3394 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3394_fsm 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3394_vm 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3395 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 3429 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3430 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3431 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3433 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 3439 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3440 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 11:32 3455 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Apr 26 11:31 3456 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3456_fsm 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3456_vm 2024-04-26T11:32:01.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 3466 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3467 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3468 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3501 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3502 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3503 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3534 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3541 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 3541_fsm 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3541_vm 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 3542 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3574 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3575 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 3576 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3596 2024-04-26T11:32:01.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3597 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3598 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3599 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3600 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3600_fsm 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3600_vm 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3601 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3601_fsm 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3601_vm 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3602 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 3602_fsm 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3602_vm 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 3603 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:32 3603_fsm 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3603_vm 2024-04-26T11:32:01.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 3604 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3605 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 3606 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3607 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3608 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 11:31 3609 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 3712 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3764 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 3764_fsm 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3764_vm 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3766 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 3767 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 3997 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4143 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4144 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 4145 2024-04-26T11:32:01.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4146 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4147 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4148 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4149 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4150 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 4151 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4152 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 4153 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4154 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 4155 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4156 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4157 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4158 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4159 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4160 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 4161 2024-04-26T11:32:01.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4162 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 4163 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4164 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4165 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4166 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 4167 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4168 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4169 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4170 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4171 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4172 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4173 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 4174 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 5002 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 548 2024-04-26T11:32:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 549 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6102 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6104 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 6106 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 6110 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 6111 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 6112 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6113 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6117 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 826 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 827 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 828 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 26 11:32 pg_filenode.map 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:32 PG_VERSION 2024-04-26T11:32:01.398 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/global: 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:total 537 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Apr 26 11:31 . 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1213 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1213_fsm 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1213_vm 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1214 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1214_fsm 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1214_vm 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 1232 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 1233 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1260 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1260_fsm 2024-04-26T11:32:01.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1260_vm 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1261 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1261_fsm 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1261_vm 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 1262 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 1262_fsm 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 1262_vm 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 2396 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 11:31 2396_fsm 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2396_vm 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:32 2397 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2671 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2672 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2676 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2677 2024-04-26T11:32:01.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2694 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2695 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2697 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 11:31 2698 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2846 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2847 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2964 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2965 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 2966 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 2967 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 3592 2024-04-26T11:32:01.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 3593 2024-04-26T11:32:01.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4060 2024-04-26T11:32:01.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4061 2024-04-26T11:32:01.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4175 2024-04-26T11:32:01.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4176 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4177 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4178 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4181 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4182 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4183 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4184 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 4185 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 4186 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6000 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6001 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6002 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 6100 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6114 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 6115 2024-04-26T11:32:01.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 pg_control 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 26 11:31 pg_filenode.map 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/log: 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:32 . 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.404 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:total 1 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:32 . 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 mappings 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Apr 26 11:32 replorigin_checkpoint 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 snapshots 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:32 .. 2024-04-26T11:32:01.405 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 11:32 .. 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 11:31 . 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 members 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 offsets 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-04-26T11:32:01.406 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 . 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 11:31 .. 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 0000 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 . 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 11:31 .. 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 0000 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.407 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 . 2024-04-26T11:32:01.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:31 0000 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-04-26T11:32:01.410 INFO:teuthology.orchestra.run.smithi110.stdout:total 16384 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 11:31 . 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Apr 26 11:32 000000010000000000000001 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 archive_status 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 11:31 . 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 11:31 .. 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 11:31 . 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 11:32 .. 2024-04-26T11:32:01.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 11:32 0000 2024-04-26T11:32:01.412 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-04-26T11:32:01.671 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-04-26T11:32:01.781 INFO:teuthology.orchestra.run.smithi110.stderr:dropping old tables... 2024-04-26T11:32:01.784 INFO:teuthology.orchestra.run.smithi110.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-04-26T11:32:01.784 INFO:teuthology.orchestra.run.smithi110.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-04-26T11:32:01.785 INFO:teuthology.orchestra.run.smithi110.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-04-26T11:32:01.785 INFO:teuthology.orchestra.run.smithi110.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-04-26T11:32:01.785 INFO:teuthology.orchestra.run.smithi110.stderr:creating tables... 2024-04-26T11:32:01.843 INFO:teuthology.orchestra.run.smithi110.stderr:generating data (client-side)... 2024-04-26T11:32:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:01 smithi196 ceph-mon[32572]: pgmap v25: 97 pgs: 97 active+clean; 25 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.0 MiB/s wr, 27 op/s 2024-04-26T11:32:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:01 smithi110 ceph-mon[28069]: pgmap v25: 97 pgs: 97 active+clean; 25 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.0 MiB/s wr, 27 op/s 2024-04-26T11:32:02.049 INFO:teuthology.orchestra.run.smithi110.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.13 s, remaining 4.06 s) 2024-04-26T11:32:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:01 smithi193 ceph-mon[32782]: pgmap v25: 97 pgs: 97 active+clean; 25 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.0 MiB/s wr, 27 op/s 2024-04-26T11:32:02.473 INFO:teuthology.orchestra.run.smithi110.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.55 s, remaining 8.32 s) 2024-04-26T11:32:02.766 INFO:teuthology.orchestra.run.smithi110.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.85 s, remaining 8.20 s) 2024-04-26T11:32:02.882 INFO:teuthology.orchestra.run.smithi110.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.96 s, remaining 6.74 s) 2024-04-26T11:32:03.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.175+0000 7f8196e00700 1 -- 172.21.15.110:0/3988079784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81901094c0 msgr2=0x7f81901098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.175+0000 7f8196e00700 1 --2- 172.21.15.110:0/3988079784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81901094c0 0x7f81901098a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8180009990 tx=0x7f8180009ca0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.175+0000 7f8196e00700 1 -- 172.21.15.110:0/3988079784 shutdown_connections 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.175+0000 7f8196e00700 1 --2- 172.21.15.110:0/3988079784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8190103e30 0x7f8190110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.175+0000 7f8196e00700 1 --2- 172.21.15.110:0/3988079784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81901094c0 0x7f81901098a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.175+0000 7f8196e00700 1 --2- 172.21.15.110:0/3988079784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8190103470 0x7f81901038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.175+0000 7f8196e00700 1 -- 172.21.15.110:0/3988079784 >> 172.21.15.110:0/3988079784 conn(0x7f819007a580 msgr2=0x7f819007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.175+0000 7f8196e00700 1 -- 172.21.15.110:0/3988079784 shutdown_connections 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.175+0000 7f8196e00700 1 -- 172.21.15.110:0/3988079784 wait complete. 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.176+0000 7f8196e00700 1 Processor -- start 2024-04-26T11:32:03.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.176+0000 7f8196e00700 1 -- start start 2024-04-26T11:32:03.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f8196e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190103470 0x7f819019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f8196e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8190103e30 0x7f819019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f8196e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81901094c0 0x7f8190199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f8196e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8190113610 con 0x7f8190103e30 2024-04-26T11:32:03.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f8196e00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8190113490 con 0x7f8190103470 2024-04-26T11:32:03.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f8196e00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8190113790 con 0x7f81901094c0 2024-04-26T11:32:03.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f818fe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190103470 0x7f819019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f818fe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190103470 0x7f819019f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:59520/0 (socket says 172.21.15.110:59520) 2024-04-26T11:32:03.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f818f400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8190103e30 0x7f819019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f818fe00700 1 -- 172.21.15.110:0/228486325 learned_addr learned my addr 172.21.15.110:0/228486325 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.177+0000 7f8194e00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81901094c0 0x7f8190199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.178+0000 7f818fe00700 1 -- 172.21.15.110:0/228486325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81901094c0 msgr2=0x7f8190199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.178+0000 7f818fe00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81901094c0 0x7f8190199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.178+0000 7f818fe00700 1 -- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8190103e30 msgr2=0x7f819019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.178+0000 7f818fe00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8190103e30 0x7f819019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.178+0000 7f818fe00700 1 -- 172.21.15.110:0/228486325 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819019a170 con 0x7f8190103470 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.178+0000 7f818f400700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8190103e30 0x7f819019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.178+0000 7f818fe00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190103470 0x7f819019f850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8180000c00 tx=0x7f81800057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.178+0000 7f818cc00700 1 -- 172.21.15.110:0/228486325 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180023ad0 con 0x7f8190103470 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.179+0000 7f818cc00700 1 -- 172.21.15.110:0/228486325 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f818000fd70 con 0x7f8190103470 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.179+0000 7f818cc00700 1 -- 172.21.15.110:0/228486325 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180017930 con 0x7f8190103470 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.179+0000 7f8196e00700 1 -- 172.21.15.110:0/228486325 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819019a400 con 0x7f8190103470 2024-04-26T11:32:03.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.179+0000 7f8196e00700 1 -- 172.21.15.110:0/228486325 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8190075650 con 0x7f8190103470 2024-04-26T11:32:03.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.184+0000 7f818cc00700 1 -- 172.21.15.110:0/228486325 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 138880+0+0 (secure 0 0 0) 0x7f8180009d10 con 0x7f8190103470 2024-04-26T11:32:03.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.185+0000 7f818cc00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f81740a3f50 0x7f81740a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.185+0000 7f818cc00700 1 -- 172.21.15.110:0/228486325 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f81800d9ff0 con 0x7f8190103470 2024-04-26T11:32:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.185+0000 7f818f400700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f81740a3f50 0x7f81740a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.186+0000 7f81a16c1b80 1 Processor -- start 2024-04-26T11:32:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.186+0000 7f81a16c1b80 1 -- start start 2024-04-26T11:32:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.186+0000 7f818f400700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f81740a3f50 0x7f81740a6410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f819007acb0 tx=0x7f817c009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4df3b0 0x55f86b4df790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4dfcd0 0x55f86b4dab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f86b42d840 con 0x55f86b4df3b0 2024-04-26T11:32:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f86b3cc160 con 0x55f86b4dfcd0 2024-04-26T11:32:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f86b429800 con 0x55f86b4db080 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f818fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4df3b0 0x55f86b4df790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f818fe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4df3b0 0x55f86b4df790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35864/0 (socket says 172.21.15.110:35864) 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f818fe00700 1 -- 172.21.15.110:0/1537915734 learned_addr learned my addr 172.21.15.110:0/1537915734 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f818f400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4dfcd0 0x55f86b4dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f8194e00700 1 --2- 172.21.15.110:0/1537915734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.187+0000 7f818fe00700 1 -- 172.21.15.110:0/1537915734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 msgr2=0x55f86b4db4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.188+0000 7f818fe00700 1 --2- 172.21.15.110:0/1537915734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4db4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.188+0000 7f818fe00700 1 -- 172.21.15.110:0/1537915734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4dfcd0 msgr2=0x55f86b4dab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.188+0000 7f818fe00700 1 --2- 172.21.15.110:0/1537915734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4dfcd0 0x55f86b4dab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.188+0000 7f818fe00700 1 -- 172.21.15.110:0/1537915734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86b3d45e0 con 0x55f86b4df3b0 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.188+0000 7f8194e00700 1 --2- 172.21.15.110:0/1537915734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4db4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.188+0000 7f818fe00700 1 --2- 172.21.15.110:0/1537915734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4df3b0 0x55f86b4df790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f81800ae4f0 tx=0x7f8180005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1df09f06c91629a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.188+0000 7f8185600700 1 -- 172.21.15.110:0/1537915734 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800a8020 con 0x55f86b4df3b0 2024-04-26T11:32:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.188+0000 7f8185600700 1 -- 172.21.15.110:0/1537915734 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81800a5e40 con 0x55f86b4df3b0 2024-04-26T11:32:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.188+0000 7f8185600700 1 -- 172.21.15.110:0/1537915734 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800a6300 con 0x55f86b4df3b0 2024-04-26T11:32:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.189+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1537915734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4df3b0 msgr2=0x55f86b4df790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.189+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1537915734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4df3b0 0x55f86b4df790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f81800ae4f0 tx=0x7f8180005f10 comp rx=0 tx=0).stop 2024-04-26T11:32:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.190+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1537915734 shutdown_connections 2024-04-26T11:32:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.190+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1537915734 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4db4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.190+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1537915734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4df3b0 0x55f86b4df790 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.190+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1537915734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4dfcd0 0x55f86b4dab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.190+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1537915734 >> 172.21.15.110:0/1537915734 conn(0x55f86b4082a0 msgr2=0x55f86b4d5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.190+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1537915734 shutdown_connections 2024-04-26T11:32:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.190+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1537915734 wait complete. 2024-04-26T11:32:03.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.191+0000 7f81a16c1b80 1 -- start start 2024-04-26T11:32:03.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.191+0000 7f81a16c1b80 1 Processor -- start 2024-04-26T11:32:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.191+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4e3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4e4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f86b4e75d0 con 0x55f86b4dfcd0 2024-04-26T11:32:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f86b3c83b0 con 0x55f86b4df3b0 2024-04-26T11:32:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f86b4e7750 con 0x55f86b4db080 2024-04-26T11:32:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f81a16c1b80 10 client.0 _ll_register_callbacks cb 0x55f86b3c1330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f818fe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f818fe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:45686/0 (socket says 172.21.15.110:45686) 2024-04-26T11:32:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f818fe00700 1 -- 172.21.15.110:0/2395408227 learned_addr learned my addr 172.21.15.110:0/2395408227 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f8194e00700 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4e4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f818f400700 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4e3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f818fe00700 1 -- 172.21.15.110:0/2395408227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 msgr2=0x55f86b4e3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f818fe00700 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4e3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f818fe00700 1 -- 172.21.15.110:0/2395408227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 msgr2=0x55f86b4e4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f818fe00700 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4e4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.192+0000 7f818fe00700 1 -- 172.21.15.110:0/2395408227 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86b37a880 con 0x55f86b4db080 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.193+0000 7f818fe00700 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e6a60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f81800098e0 tx=0x7f8180009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3e303e7aaa263b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.193+0000 7f817a000700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.193+0000 7f817a000700 1 -- 172.21.15.110:0/2395408227 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800c4060 con 0x55f86b4db080 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.193+0000 7f81a16c1b80 1 -- 172.21.15.110:0/2395408227 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81800a5e40 con 0x55f86b4db080 2024-04-26T11:32:03.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.193+0000 7f817a000700 1 -- 172.21.15.110:0/2395408227 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f81800a4140 con 0x55f86b4db080 2024-04-26T11:32:03.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.193+0000 7f817a000700 1 -- 172.21.15.110:0/2395408227 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f818008b050 con 0x55f86b4db080 2024-04-26T11:32:03.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.193+0000 7f81a16c1b80 10 client.25285 fetch_fsmap learned FSMap version 26 2024-04-26T11:32:03.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.193+0000 7f81a16c1b80 1 -- 172.21.15.110:0/2395408227 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f86b4e75d0 con 0x55f86b4db080 2024-04-26T11:32:03.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.193+0000 7f817a000700 1 -- 172.21.15.110:0/2395408227 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81800a5e40 con 0x55f86b4db080 2024-04-26T11:32:03.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.194+0000 7f817a000700 1 -- 172.21.15.110:0/2395408227 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f81800ae590 con 0x55f86b4db080 2024-04-26T11:32:03.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.195+0000 7f81a16c1b80 10 client.25285 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:32:03.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.195+0000 7f81a16c1b80 10 client.25285 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T11:32:03.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.195+0000 7f81a16c1b80 20 client.25285 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:03.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.195+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f86b4f4160 0x55f86b4f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.195+0000 7f81a16c1b80 4 client.25285 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:32:03.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.195+0000 7f81a16c1b80 1 -- 172.21.15.110:0/2395408227 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f86b43b220 con 0x55f86b4f4160 2024-04-26T11:32:03.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.196+0000 7f818f400700 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f86b4f4160 0x55f86b4f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.198+0000 7f817a000700 10 client.25285 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:03.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.198+0000 7f818f400700 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f86b4f4160 0x55f86b4f55d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64e8d9dc52cc3d58 server_cookie=bf59a417aee48868 in_seq=0 out_seq=0 2024-04-26T11:32:03.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.198+0000 7f817a000700 1 -- 172.21.15.110:0/2395408227 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f86b43b220 con 0x55f86b4f4160 2024-04-26T11:32:03.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.198+0000 7f817a000700 10 client.25285 handle_command_reply: tid=0 2024-04-26T11:32:03.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.198+0000 7f81a16c1b80 1 client.25285 shutdown 2024-04-26T11:32:03.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 -- 172.21.15.110:0/2395408227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 msgr2=0x55f86b4e6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:03.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e6a60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f81800098e0 tx=0x7f8180009680 comp rx=0 tx=0).stop 2024-04-26T11:32:03.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 -- 172.21.15.110:0/2395408227 shutdown_connections 2024-04-26T11:32:03.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f86b4f4160 0x55f86b4f55d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4e4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e6a60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f817a000700 0 client.25285 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:03.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/2395408227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4e3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 -- 172.21.15.110:0/2395408227 >> 172.21.15.110:0/2395408227 conn(0x55f86b4082a0 msgr2=0x55f86b4cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:03.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 -- 172.21.15.110:0/2395408227 shutdown_connections 2024-04-26T11:32:03.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 1 -- 172.21.15.110:0/2395408227 wait complete. 2024-04-26T11:32:03.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.199+0000 7f81a16c1b80 20 client.25285 trim_cache size 0 max 16384 2024-04-26T11:32:03.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.222+0000 7f81a16c1b80 1 Processor -- start 2024-04-26T11:32:03.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.222+0000 7f81a16c1b80 1 -- start start 2024-04-26T11:32:03.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f86b4f3910 con 0x55f86b4dfcd0 2024-04-26T11:32:03.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f86b4f3fe0 con 0x55f86b4df3b0 2024-04-26T11:32:03.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f86b4f46b0 con 0x55f86b4db080 2024-04-26T11:32:03.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f8194e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f818fe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f818fe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:45690/0 (socket says 172.21.15.110:45690) 2024-04-26T11:32:03.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f818fe00700 1 -- 172.21.15.110:0/3998036957 learned_addr learned my addr 172.21.15.110:0/3998036957 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:03.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.223+0000 7f818f400700 1 --2- 172.21.15.110:0/3998036957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f818fe00700 1 -- 172.21.15.110:0/3998036957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 msgr2=0x55f86b4e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:03.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f818fe00700 1 --2- 172.21.15.110:0/3998036957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f818fe00700 1 -- 172.21.15.110:0/3998036957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 msgr2=0x55f86b4cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:03.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f818fe00700 1 --2- 172.21.15.110:0/3998036957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f818fe00700 1 -- 172.21.15.110:0/3998036957 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86b4e2340 con 0x55f86b4db080 2024-04-26T11:32:03.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f818f400700 1 --2- 172.21.15.110:0/3998036957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:32:03.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f818fe00700 1 --2- 172.21.15.110:0/3998036957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e1220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f818000c010 tx=0x7f8180005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcf327f40bbe3789 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:03.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f8184c00700 1 -- 172.21.15.110:0/3998036957 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800c4030 con 0x55f86b4db080 2024-04-26T11:32:03.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f8184c00700 1 -- 172.21.15.110:0/3998036957 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81800aea20 con 0x55f86b4db080 2024-04-26T11:32:03.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.224+0000 7f8184c00700 1 -- 172.21.15.110:0/3998036957 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800be030 con 0x55f86b4db080 2024-04-26T11:32:03.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.225+0000 7f81a16c1b80 1 -- 172.21.15.110:0/3998036957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 msgr2=0x55f86b4e1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:03.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.225+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/3998036957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e1220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f818000c010 tx=0x7f8180005f10 comp rx=0 tx=0).stop 2024-04-26T11:32:03.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.225+0000 7f81a16c1b80 1 -- 172.21.15.110:0/3998036957 shutdown_connections 2024-04-26T11:32:03.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.225+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/3998036957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.225+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/3998036957 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4e1220 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.225+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/3998036957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.225+0000 7f81a16c1b80 1 -- 172.21.15.110:0/3998036957 >> 172.21.15.110:0/3998036957 conn(0x55f86b4082a0 msgr2=0x55f86b4e26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:03.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.225+0000 7f81a16c1b80 1 -- 172.21.15.110:0/3998036957 shutdown_connections 2024-04-26T11:32:03.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.225+0000 7f81a16c1b80 1 -- 172.21.15.110:0/3998036957 wait complete. 2024-04-26T11:32:03.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.226+0000 7f81a16c1b80 1 -- start start 2024-04-26T11:32:03.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.226+0000 7f81a16c1b80 1 Processor -- start 2024-04-26T11:32:03.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.226+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4fef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f81a16c1b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4d8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f86b4f5450 con 0x55f86b4dfcd0 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f86b4f4d80 con 0x55f86b4df3b0 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f81a16c1b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f86b4f5b20 con 0x55f86b4db080 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f81a16c1b80 10 client.0 _ll_register_callbacks cb 0x55f86b3c1330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f818fe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f818fe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4fea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:45700/0 (socket says 172.21.15.110:45700) 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f818fe00700 1 -- 172.21.15.110:0/1663911648 learned_addr learned my addr 172.21.15.110:0/1663911648 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f818f400700 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4fef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f8194e00700 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4d8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f818fe00700 1 -- 172.21.15.110:0/1663911648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 msgr2=0x55f86b4fef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:03.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f818fe00700 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4fef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f818fe00700 1 -- 172.21.15.110:0/1663911648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 msgr2=0x55f86b4d8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f818fe00700 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4d8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.227+0000 7f818fe00700 1 -- 172.21.15.110:0/1663911648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86b4d9370 con 0x55f86b4db080 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.228+0000 7f818fe00700 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4fea40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f81800051e0 tx=0x7f81800173f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c6d8aa565d4d95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.228+0000 7f817a000700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.228+0000 7f817a000700 1 -- 172.21.15.110:0/1663911648 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800be070 con 0x55f86b4db080 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.228+0000 7f817a000700 1 -- 172.21.15.110:0/1663911648 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f81800a62b0 con 0x55f86b4db080 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.228+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1663911648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81800aea20 con 0x55f86b4db080 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.228+0000 7f817a000700 1 -- 172.21.15.110:0/1663911648 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f81800c4070 con 0x55f86b4db080 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.228+0000 7f81a16c1b80 10 client.25291 fetch_fsmap learned FSMap version 26 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.228+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1663911648 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f86b4d9370 con 0x55f86b4db080 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.229+0000 7f817a000700 1 -- 172.21.15.110:0/1663911648 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81800aea20 con 0x55f86b4db080 2024-04-26T11:32:03.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.229+0000 7f817a000700 1 -- 172.21.15.110:0/1663911648 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f81800ac480 con 0x55f86b4db080 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.229+0000 7f81a16c1b80 10 client.25291 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.229+0000 7f81a16c1b80 10 client.25291 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.229+0000 7f81a16c1b80 20 client.25291 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.229+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f86b55f350 0x55f86b55e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.229+0000 7f81a16c1b80 4 client.25291 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.229+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1663911648 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "status"}) -- 0x55f86b4352c0 con 0x55f86b55f350 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.229+0000 7f818f400700 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f86b55f350 0x55f86b55e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.230+0000 7f818f400700 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f86b55f350 0x55f86b55e060 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363a801a1c771070 server_cookie=7f234c09501ea1e7 in_seq=0 out_seq=0 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.230+0000 7f817a000700 10 client.25291 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.230+0000 7f817a000700 1 -- 172.21.15.110:0/1663911648 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f86b4352c0 con 0x55f86b55f350 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.230+0000 7f817a000700 10 client.25291 handle_command_reply: tid=0 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.230+0000 7f81a16c1b80 1 client.25291 shutdown 2024-04-26T11:32:03.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1663911648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 msgr2=0x55f86b4fea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4fea40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f81800051e0 tx=0x7f81800173f0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1663911648 shutdown_connections 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f86b55f350 0x55f86b55e060 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f86b4dfcd0 0x55f86b4d8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f86b4db080 0x55f86b4fea40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f817a000700 0 client.25291 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 --2- 172.21.15.110:0/1663911648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f86b4df3b0 0x55f86b4fef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1663911648 >> 172.21.15.110:0/1663911648 conn(0x55f86b4082a0 msgr2=0x55f86b4e1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1663911648 shutdown_connections 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 1 -- 172.21.15.110:0/1663911648 wait complete. 2024-04-26T11:32:03.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.231+0000 7f81a16c1b80 20 client.25291 trim_cache size 0 max 16384 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "6e439470-03be-11ef-bc93-c7b262605968", 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 0, 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24518, 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 288.13192221499997, 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 26, 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 94, 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 94, 2024-04-26T11:32:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 307.22135888700001 2024-04-26T11:32:03.236 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:32:03.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 -- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f81740a3f50 msgr2=0x7f81740a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:03.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f81740a3f50 0x7f81740a6410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f819007acb0 tx=0x7f817c009260 comp rx=0 tx=0).stop 2024-04-26T11:32:03.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 -- 172.21.15.110:0/228486325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190103470 msgr2=0x7f819019f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:03.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190103470 0x7f819019f850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8180000c00 tx=0x7f81800057c0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 -- 172.21.15.110:0/228486325 shutdown_connections 2024-04-26T11:32:03.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f81740a3f50 0x7f81740a6410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81901094c0 0x7f8190199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190103470 0x7f819019f850 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 --2- 172.21.15.110:0/228486325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8190103e30 0x7f819019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:03.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 -- 172.21.15.110:0/228486325 >> 172.21.15.110:0/228486325 conn(0x7f819007a580 msgr2=0x7f81901022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:03.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 -- 172.21.15.110:0/228486325 shutdown_connections 2024-04-26T11:32:03.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:03.232+0000 7f8196e00700 1 -- 172.21.15.110:0/228486325 wait complete. 2024-04-26T11:32:03.244 INFO:teuthology.orchestra.run.smithi110.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.33 s, remaining 7.16 s) 2024-04-26T11:32:03.618 INFO:teuthology.orchestra.run.smithi110.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.70 s, remaining 7.36 s) 2024-04-26T11:32:03.716 INFO:teuthology.orchestra.run.smithi110.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.79 s, remaining 6.41 s) 2024-04-26T11:32:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:03 smithi110 ceph-mon[28069]: pgmap v26: 97 pgs: 97 active+clean; 25 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.0 MiB/s wr, 27 op/s 2024-04-26T11:32:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:03 smithi110 ceph-mon[28069]: mgrmap e25: x(active, since 46s), standbys: y, z 2024-04-26T11:32:04.094 INFO:teuthology.orchestra.run.smithi110.stderr:800000 of 3200000 tuples (25%) done (elapsed 2.17 s, remaining 6.52 s) 2024-04-26T11:32:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:03 smithi193 ceph-mon[32782]: pgmap v26: 97 pgs: 97 active+clean; 25 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.0 MiB/s wr, 27 op/s 2024-04-26T11:32:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:03 smithi193 ceph-mon[32782]: mgrmap e25: x(active, since 46s), standbys: y, z 2024-04-26T11:32:04.157 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-26T11:32:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:03 smithi196 ceph-mon[32572]: pgmap v26: 97 pgs: 97 active+clean; 25 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.0 MiB/s wr, 27 op/s 2024-04-26T11:32:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:03 smithi196 ceph-mon[32572]: mgrmap e25: x(active, since 46s), standbys: y, z 2024-04-26T11:32:04.434 INFO:teuthology.orchestra.run.smithi110.stderr:900000 of 3200000 tuples (28%) done (elapsed 2.52 s, remaining 6.43 s) 2024-04-26T11:32:04.541 INFO:teuthology.orchestra.run.smithi110.stderr:1000000 of 3200000 tuples (31%) done (elapsed 2.62 s, remaining 5.77 s) 2024-04-26T11:32:05.004 INFO:teuthology.orchestra.run.smithi110.stderr:1100000 of 3200000 tuples (34%) done (elapsed 3.09 s, remaining 5.89 s) 2024-04-26T11:32:05.125 INFO:teuthology.orchestra.run.smithi110.stderr:1200000 of 3200000 tuples (37%) done (elapsed 3.21 s, remaining 5.34 s) 2024-04-26T11:32:05.470 INFO:teuthology.orchestra.run.smithi110.stderr:1300000 of 3200000 tuples (40%) done (elapsed 3.55 s, remaining 5.19 s) 2024-04-26T11:32:05.930 INFO:teuthology.orchestra.run.smithi110.stderr:1400000 of 3200000 tuples (43%) done (elapsed 4.01 s, remaining 5.16 s) 2024-04-26T11:32:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:05 smithi110 ceph-mon[28069]: pgmap v27: 97 pgs: 97 active+clean; 57 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.2 MiB/s wr, 312 op/s 2024-04-26T11:32:06.057 INFO:teuthology.orchestra.run.smithi110.stderr:1500000 of 3200000 tuples (46%) done (elapsed 4.14 s, remaining 4.69 s) 2024-04-26T11:32:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:05 smithi193 ceph-mon[32782]: pgmap v27: 97 pgs: 97 active+clean; 57 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.2 MiB/s wr, 312 op/s 2024-04-26T11:32:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:05 smithi196 ceph-mon[32572]: pgmap v27: 97 pgs: 97 active+clean; 57 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 5.2 MiB/s wr, 312 op/s 2024-04-26T11:32:06.501 INFO:teuthology.orchestra.run.smithi110.stderr:1600000 of 3200000 tuples (50%) done (elapsed 4.58 s, remaining 4.58 s) 2024-04-26T11:32:06.689 INFO:teuthology.orchestra.run.smithi110.stderr:1700000 of 3200000 tuples (53%) done (elapsed 4.77 s, remaining 4.21 s) 2024-04-26T11:32:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:1800000 of 3200000 tuples (56%) done (elapsed 5.14 s, remaining 4.00 s) 2024-04-26T11:32:07.433 INFO:teuthology.orchestra.run.smithi110.stderr:1900000 of 3200000 tuples (59%) done (elapsed 5.51 s, remaining 3.77 s) 2024-04-26T11:32:07.608 INFO:teuthology.orchestra.run.smithi110.stderr:2000000 of 3200000 tuples (62%) done (elapsed 5.69 s, remaining 3.41 s) 2024-04-26T11:32:08.002 INFO:teuthology.orchestra.run.smithi110.stderr:2100000 of 3200000 tuples (65%) done (elapsed 6.08 s, remaining 3.19 s) 2024-04-26T11:32:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:07 smithi110 ceph-mon[28069]: pgmap v28: 97 pgs: 97 active+clean; 57 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 5.2 MiB/s wr, 307 op/s 2024-04-26T11:32:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:07 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:07 smithi193 ceph-mon[32782]: pgmap v28: 97 pgs: 97 active+clean; 57 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 5.2 MiB/s wr, 307 op/s 2024-04-26T11:32:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:07 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:07 smithi196 ceph-mon[32572]: pgmap v28: 97 pgs: 97 active+clean; 57 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 5.2 MiB/s wr, 307 op/s 2024-04-26T11:32:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:07 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:08.346 INFO:teuthology.orchestra.run.smithi110.stderr:2200000 of 3200000 tuples (68%) done (elapsed 6.43 s, remaining 2.92 s) 2024-04-26T11:32:08.518 INFO:teuthology.orchestra.run.smithi110.stderr:2300000 of 3200000 tuples (71%) done (elapsed 6.60 s, remaining 2.58 s) 2024-04-26T11:32:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:2400000 of 3200000 tuples (75%) done (elapsed 6.97 s, remaining 2.32 s) 2024-04-26T11:32:09.200 INFO:teuthology.orchestra.run.smithi110.stderr:2500000 of 3200000 tuples (78%) done (elapsed 7.28 s, remaining 2.04 s) 2024-04-26T11:32:09.368 INFO:teuthology.orchestra.run.smithi110.stderr:2600000 of 3200000 tuples (81%) done (elapsed 7.45 s, remaining 1.72 s) 2024-04-26T11:32:09.750 INFO:teuthology.orchestra.run.smithi110.stderr:2700000 of 3200000 tuples (84%) done (elapsed 7.83 s, remaining 1.45 s) 2024-04-26T11:32:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:09 smithi110 ceph-mon[28069]: pgmap v29: 97 pgs: 97 active+clean; 234 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 35 MiB/s wr, 329 op/s 2024-04-26T11:32:10.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:09 smithi196 ceph-mon[32572]: pgmap v29: 97 pgs: 97 active+clean; 234 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 35 MiB/s wr, 329 op/s 2024-04-26T11:32:10.096 INFO:teuthology.orchestra.run.smithi110.stderr:2800000 of 3200000 tuples (87%) done (elapsed 8.18 s, remaining 1.17 s) 2024-04-26T11:32:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:09 smithi193 ceph-mon[32782]: pgmap v29: 97 pgs: 97 active+clean; 234 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 35 MiB/s wr, 329 op/s 2024-04-26T11:32:10.304 INFO:teuthology.orchestra.run.smithi110.stderr:2900000 of 3200000 tuples (90%) done (elapsed 8.38 s, remaining 0.87 s) 2024-04-26T11:32:10.617 INFO:teuthology.orchestra.run.smithi110.stderr:3000000 of 3200000 tuples (93%) done (elapsed 8.70 s, remaining 0.58 s) 2024-04-26T11:32:10.937 INFO:teuthology.orchestra.run.smithi110.stderr:3100000 of 3200000 tuples (96%) done (elapsed 9.02 s, remaining 0.29 s) 2024-04-26T11:32:11.037 INFO:teuthology.orchestra.run.smithi110.stderr:3200000 of 3200000 tuples (100%) done (elapsed 9.12 s, remaining 0.00 s) 2024-04-26T11:32:11.127 INFO:teuthology.orchestra.run.smithi110.stderr:vacuuming... 2024-04-26T11:32:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:11 smithi193 ceph-mon[32782]: pgmap v30: 97 pgs: 97 active+clean; 234 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 33 MiB/s wr, 307 op/s 2024-04-26T11:32:12.124 INFO:teuthology.orchestra.run.smithi110.stderr:creating primary keys... 2024-04-26T11:32:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:11 smithi196 ceph-mon[32572]: pgmap v30: 97 pgs: 97 active+clean; 234 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 33 MiB/s wr, 307 op/s 2024-04-26T11:32:12.279 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:11 smithi110 ceph-mon[28069]: pgmap v30: 97 pgs: 97 active+clean; 234 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 33 MiB/s wr, 307 op/s 2024-04-26T11:32:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:12 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:12 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:12 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.296+0000 7f7ff5a00640 1 -- 172.21.15.110:0/3851619805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ff010f220 msgr2=0x7f7ff0111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.296+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/3851619805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ff010f220 0x7f7ff0111610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009ca0 tx=0x7f7fe802a950 comp rx=0 tx=0).stop 2024-04-26T11:32:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.296+0000 7f7ff5a00640 1 -- 172.21.15.110:0/3851619805 shutdown_connections 2024-04-26T11:32:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.296+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/3851619805 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ff010f220 0x7f7ff0111610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.296+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/3851619805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ff0075550 0x7f7ff010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.296+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/3851619805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff0074c30 0x7f7ff0075010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.296+0000 7f7ff5a00640 1 -- 172.21.15.110:0/3851619805 >> 172.21.15.110:0/3851619805 conn(0x7f7ff0079dc0 msgr2=0x7f7ff007a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:13.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.297+0000 7f7ff5a00640 1 -- 172.21.15.110:0/3851619805 shutdown_connections 2024-04-26T11:32:13.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.297+0000 7f7ff5a00640 1 -- 172.21.15.110:0/3851619805 wait complete. 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.297+0000 7f7ff5a00640 1 Processor -- start 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7ff5a00640 1 -- start start 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7ff5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff0074c30 0x7f7ff019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7ff5a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ff0075550 0x7f7ff019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7ff5a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ff010f220 0x7f7ff019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7ff5a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff0114e50 con 0x7f7ff0074c30 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7ff5a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff0114cd0 con 0x7f7ff010f220 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7ff5a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff0114fd0 con 0x7f7ff0075550 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7fef400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ff010f220 0x7f7ff019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7fee000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ff0075550 0x7f7ff019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7fef400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ff010f220 0x7f7ff019fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38880/0 (socket says 172.21.15.110:38880) 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7fef400640 1 -- 172.21.15.110:0/172527456 learned_addr learned my addr 172.21.15.110:0/172527456 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.298+0000 7f7feea00640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff0074c30 0x7f7ff019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7fef400640 1 -- 172.21.15.110:0/172527456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ff0075550 msgr2=0x7f7ff019b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7fef400640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ff0075550 0x7f7ff019b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7fef400640 1 -- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff0074c30 msgr2=0x7f7ff019b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7fef400640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff0074c30 0x7f7ff019b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7fef400640 1 -- 172.21.15.110:0/172527456 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff01a01c0 con 0x7f7ff010f220 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7fef400640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ff010f220 0x7f7ff019fa40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009dc0 tx=0x7f7fe8003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7fe7400640 1 -- 172.21.15.110:0/172527456 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8034040 con 0x7f7ff010f220 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7fe7400640 1 -- 172.21.15.110:0/172527456 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fe8003e50 con 0x7f7ff010f220 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7fe7400640 1 -- 172.21.15.110:0/172527456 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8004600 con 0x7f7ff010f220 2024-04-26T11:32:13.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7ff5a00640 1 -- 172.21.15.110:0/172527456 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff01a0450 con 0x7f7ff010f220 2024-04-26T11:32:13.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.299+0000 7f7ff5a00640 1 -- 172.21.15.110:0/172527456 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff01a0880 con 0x7f7ff010f220 2024-04-26T11:32:13.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.303+0000 7f7fe7400640 1 -- 172.21.15.110:0/172527456 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 138880+0+0 (secure 0 0 0) 0x7f7fe8037020 con 0x7f7ff010f220 2024-04-26T11:32:13.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.303+0000 7f7ff8804740 1 Processor -- start 2024-04-26T11:32:13.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.303+0000 7f7ff8804740 1 -- start start 2024-04-26T11:32:13.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.303+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f4c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.303+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 0x560413f56a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.303+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.303+0000 7f7ff8804740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560413eb1380 con 0x560413f56fb0 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.303+0000 7f7ff8804740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560413e4dc30 con 0x560413f4c6f0 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.303+0000 7f7ff8804740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560413ead340 con 0x560413f4bdd0 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f4c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f4c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:44564/0 (socket says 172.21.15.110:44564) 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 -- 172.21.15.110:0/568674051 learned_addr learned my addr 172.21.15.110:0/568674051 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7feea00640 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 0x560413f56a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 -- 172.21.15.110:0/568674051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 msgr2=0x560413f56a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 0x560413f56a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 -- 172.21.15.110:0/568674051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 msgr2=0x560413f593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:13.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 -- 172.21.15.110:0/568674051 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560413e6f940 con 0x560413f4bdd0 2024-04-26T11:32:13.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7feea00640 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 0x560413f56a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:32:13.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.304+0000 7f7fee000640 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f4c1b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00afd0 tx=0x7f7fdc00a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaf9706c90a5c806 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:13.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.305+0000 7f7fdbe00640 1 -- 172.21.15.110:0/568674051 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc004220 con 0x560413f4bdd0 2024-04-26T11:32:13.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.305+0000 7f7fdbe00640 1 -- 172.21.15.110:0/568674051 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc0043c0 con 0x560413f4bdd0 2024-04-26T11:32:13.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.305+0000 7f7fdbe00640 1 -- 172.21.15.110:0/568674051 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc00f640 con 0x560413f4bdd0 2024-04-26T11:32:13.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.305+0000 7f7fe7400640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7fd40a3ee0 0x7f7fd40a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.305+0000 7f7fe7400640 1 -- 172.21.15.110:0/172527456 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f7fe80f1720 con 0x7f7ff010f220 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.305+0000 7f7feea00640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7fd40a3ee0 0x7f7fd40a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 -- 172.21.15.110:0/568674051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 msgr2=0x560413f4c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f4c1b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00afd0 tx=0x7f7fdc00a620 comp rx=0 tx=0).stop 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 -- 172.21.15.110:0/568674051 shutdown_connections 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 0x560413f56a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 --2- 172.21.15.110:0/568674051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f4c1b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 -- 172.21.15.110:0/568674051 >> 172.21.15.110:0/568674051 conn(0x560413f482e0 msgr2=0x560413f486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 -- 172.21.15.110:0/568674051 shutdown_connections 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 -- 172.21.15.110:0/568674051 wait complete. 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7feea00640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7fd40a3ee0 0x7f7fd40a63a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00095f0 tx=0x7f7fe0005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:13.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.306+0000 7f7ff8804740 1 -- start start 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.307+0000 7f7ff8804740 1 Processor -- start 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.307+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4bdd0 0x560413f53e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.307+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4c6f0 0x560413f54390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.307+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.307+0000 7f7ff8804740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560413f6abf0 con 0x560413f56fb0 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.307+0000 7f7ff8804740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560413e38c60 con 0x560413f4bdd0 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.307+0000 7f7ff8804740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560413f6ad70 con 0x560413f4c6f0 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.307+0000 7f7ff8804740 10 client.0 _ll_register_callbacks cb 0x560413e64e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.307+0000 7f7feea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4bdd0 0x560413f53e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7feea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4bdd0 0x560413f53e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38912/0 (socket says 172.21.15.110:38912) 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7feea00640 1 -- 172.21.15.110:0/2187424944 learned_addr learned my addr 172.21.15.110:0/2187424944 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:13.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fef400640 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fee000640 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4c6f0 0x560413f54390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fef400640 1 -- 172.21.15.110:0/2187424944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4c6f0 msgr2=0x560413f54390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fef400640 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4c6f0 0x560413f54390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fef400640 1 -- 172.21.15.110:0/2187424944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4bdd0 msgr2=0x560413f53e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fef400640 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4bdd0 0x560413f53e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fef400640 1 -- 172.21.15.110:0/2187424944 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560413e47510 con 0x560413f56fb0 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fee000640 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4c6f0 0x560413f54390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fef400640 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f548d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80eed20 tx=0x7f7fe80098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5272c13b8e0ea8de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fd8c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.308+0000 7f7fd8c00640 1 -- 172.21.15.110:0/2187424944 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe802c040 con 0x560413f56fb0 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.309+0000 7f7fd8c00640 1 -- 172.21.15.110:0/2187424944 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f7fe80bd900 con 0x560413f56fb0 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.309+0000 7f7ff8804740 1 -- 172.21.15.110:0/2187424944 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fdc0043c0 con 0x560413f56fb0 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.309+0000 7f7fd8c00640 1 -- 172.21.15.110:0/2187424944 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7fe80bd4a0 con 0x560413f56fb0 2024-04-26T11:32:13.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.309+0000 7f7ff8804740 10 client.15195 fetch_fsmap learned FSMap version 29 2024-04-26T11:32:13.315 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.309+0000 7f7ff8804740 1 -- 172.21.15.110:0/2187424944 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560413bc3210 con 0x560413f56fb0 2024-04-26T11:32:13.315 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.309+0000 7f7fd8c00640 1 -- 172.21.15.110:0/2187424944 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc0043c0 con 0x560413f56fb0 2024-04-26T11:32:13.315 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.310+0000 7f7fd8c00640 1 -- 172.21.15.110:0/2187424944 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7fe80c5c80 con 0x560413f56fb0 2024-04-26T11:32:13.316 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.310+0000 7f7ff8804740 10 client.15195 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T11:32:13.316 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.310+0000 7f7ff8804740 10 client.15195 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.310+0000 7f7ff8804740 20 client.15195 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.310+0000 7f7ff8804740 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560413f77d00 0x560413f7a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.310+0000 7f7ff8804740 4 client.15195 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.310+0000 7f7ff8804740 1 -- 172.21.15.110:0/2187424944 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560413ebef90 con 0x560413f77d00 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.310+0000 7f7feea00640 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560413f77d00 0x560413f7a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.311+0000 7f7feea00640 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560413f77d00 0x560413f7a140 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b7858f4868d40f server_cookie=78a86f5811abfb72 in_seq=0 out_seq=0 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.311+0000 7f7fd8c00640 10 client.15195 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.311+0000 7f7fd8c00640 1 -- 172.21.15.110:0/2187424944 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560413ebef90 con 0x560413f77d00 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.311+0000 7f7fd8c00640 10 client.15195 handle_command_reply: tid=0 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.312+0000 7f7ff8804740 1 client.15195 shutdown 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.312+0000 7f7ff8804740 1 -- 172.21.15.110:0/2187424944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 msgr2=0x560413f548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.312+0000 7f7ff8804740 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f548d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80eed20 tx=0x7f7fe80098d0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.312+0000 7f7ff8804740 1 -- 172.21.15.110:0/2187424944 shutdown_connections 2024-04-26T11:32:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.312+0000 7f7ff8804740 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f548d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.312+0000 7f7ff8804740 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560413f77d00 0x560413f7a140 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.313+0000 7f7ff8804740 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4c6f0 0x560413f54390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.313+0000 7f7fd8c00640 0 client.15195 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.313+0000 7f7ff8804740 1 --2- 172.21.15.110:0/2187424944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4bdd0 0x560413f53e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.313+0000 7f7ff8804740 1 -- 172.21.15.110:0/2187424944 >> 172.21.15.110:0/2187424944 conn(0x560413f482e0 msgr2=0x560413f4e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.313+0000 7f7ff8804740 1 -- 172.21.15.110:0/2187424944 shutdown_connections 2024-04-26T11:32:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.313+0000 7f7ff8804740 1 -- 172.21.15.110:0/2187424944 wait complete. 2024-04-26T11:32:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.313+0000 7f7ff8804740 20 client.15195 trim_cache size 0 max 16384 2024-04-26T11:32:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.344+0000 7f7ff8804740 1 Processor -- start 2024-04-26T11:32:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.344+0000 7f7ff8804740 1 -- start start 2024-04-26T11:32:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f73ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f4c6f0 0x560413f53030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f56fb0 0x560413f55c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7ff8804740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff01aa920 con 0x560413f4c6f0 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7ff8804740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff01a8190 con 0x560413f56fb0 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7ff8804740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff019c4d0 con 0x560413f4bdd0 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7feea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f73ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7feea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f73ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:44584/0 (socket says 172.21.15.110:44584) 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7feea00640 1 -- 172.21.15.110:0/1516566075 learned_addr learned my addr 172.21.15.110:0/1516566075 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7fef400640 1 --2- 172.21.15.110:0/1516566075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f56fb0 0x560413f55c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7fee000640 1 --2- 172.21.15.110:0/1516566075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f4c6f0 0x560413f53030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7feea00640 1 -- 172.21.15.110:0/1516566075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f56fb0 msgr2=0x560413f55c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7feea00640 1 --2- 172.21.15.110:0/1516566075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f56fb0 0x560413f55c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7feea00640 1 -- 172.21.15.110:0/1516566075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f4c6f0 msgr2=0x560413f53030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7feea00640 1 --2- 172.21.15.110:0/1516566075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f4c6f0 0x560413f53030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.345+0000 7f7feea00640 1 -- 172.21.15.110:0/1516566075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560413f4c520 con 0x560413f4bdd0 2024-04-26T11:32:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.346+0000 7f7feea00640 1 --2- 172.21.15.110:0/1516566075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f73ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7fe001d930 tx=0x7f7fe001b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b82999c585b94daf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.346+0000 7f7fdb400640 1 -- 172.21.15.110:0/1516566075 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe001dd60 con 0x560413f4bdd0 2024-04-26T11:32:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.346+0000 7f7fdb400640 1 -- 172.21.15.110:0/1516566075 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fe002b8e0 con 0x560413f4bdd0 2024-04-26T11:32:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.346+0000 7f7fdb400640 1 -- 172.21.15.110:0/1516566075 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0004a00 con 0x560413f4bdd0 2024-04-26T11:32:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.347+0000 7f7ff8804740 1 -- 172.21.15.110:0/1516566075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 msgr2=0x560413f73ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.347+0000 7f7ff8804740 1 --2- 172.21.15.110:0/1516566075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f73ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7fe001d930 tx=0x7f7fe001b000 comp rx=0 tx=0).stop 2024-04-26T11:32:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.347+0000 7f7ff8804740 1 -- 172.21.15.110:0/1516566075 shutdown_connections 2024-04-26T11:32:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.347+0000 7f7ff8804740 1 --2- 172.21.15.110:0/1516566075 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f56fb0 0x560413f55c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.347+0000 7f7ff8804740 1 --2- 172.21.15.110:0/1516566075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f4c6f0 0x560413f53030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.347+0000 7f7ff8804740 1 --2- 172.21.15.110:0/1516566075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f73ab0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.347+0000 7f7ff8804740 1 -- 172.21.15.110:0/1516566075 >> 172.21.15.110:0/1516566075 conn(0x560413f482e0 msgr2=0x560413f55570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.347+0000 7f7ff8804740 1 -- 172.21.15.110:0/1516566075 shutdown_connections 2024-04-26T11:32:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.347+0000 7f7ff8804740 1 -- 172.21.15.110:0/1516566075 wait complete. 2024-04-26T11:32:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.348+0000 7f7ff8804740 1 -- start start 2024-04-26T11:32:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.348+0000 7f7ff8804740 1 Processor -- start 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f50dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 0x560413f51300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7ff8804740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f51840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7ff8804740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff00733b0 con 0x560413f56fb0 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7ff8804740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff0074820 con 0x560413f4c6f0 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7ff8804740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff0073a80 con 0x560413f4bdd0 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7ff8804740 10 client.0 _ll_register_callbacks cb 0x7f7fe8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7feea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f50dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7feea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f50dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:44594/0 (socket says 172.21.15.110:44594) 2024-04-26T11:32:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7feea00640 1 -- 172.21.15.110:0/3150209157 learned_addr learned my addr 172.21.15.110:0/3150209157 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.349+0000 7f7fee000640 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 0x560413f51300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7fef400640 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f51840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7feea00640 1 -- 172.21.15.110:0/3150209157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 msgr2=0x560413f51300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7feea00640 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 0x560413f51300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7feea00640 1 -- 172.21.15.110:0/3150209157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 msgr2=0x560413f51840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7feea00640 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f51840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7feea00640 1 -- 172.21.15.110:0/3150209157 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560413c8f620 con 0x560413f4bdd0 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7fef400640 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f51840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7feea00640 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f50dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0000c00 tx=0x7f7fe001d690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a81b2c587fb279e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7fd8c00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7fd8c00640 1 -- 172.21.15.110:0/3150209157 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe002b430 con 0x560413f4bdd0 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7fd8c00640 1 -- 172.21.15.110:0/3150209157 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f7fe002b5d0 con 0x560413f4bdd0 2024-04-26T11:32:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.350+0000 7f7ff8804740 1 -- 172.21.15.110:0/3150209157 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fe002b8e0 con 0x560413f4bdd0 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7fd8c00640 1 -- 172.21.15.110:0/3150209157 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7fe0043050 con 0x560413f4bdd0 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7ff8804740 10 client.25309 fetch_fsmap learned FSMap version 29 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7ff8804740 1 -- 172.21.15.110:0/3150209157 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560413e6bcb0 con 0x560413f4bdd0 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7fd8c00640 1 -- 172.21.15.110:0/3150209157 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fe002b8e0 con 0x560413f4bdd0 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7fd8c00640 1 -- 172.21.15.110:0/3150209157 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7fe003e480 con 0x560413f4bdd0 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7ff8804740 10 client.25309 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7ff8804740 10 client.25309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7ff8804740 20 client.25309 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7ff8804740 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560413f77d00 0x560413fe0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7ff8804740 4 client.25309 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.351+0000 7f7ff8804740 1 -- 172.21.15.110:0/3150209157 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560413eb8e00 con 0x560413f77d00 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.352+0000 7f7fee000640 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560413f77d00 0x560413fe0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.352+0000 7f7fee000640 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560413f77d00 0x560413fe0be0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5afceebcbb491d90 server_cookie=567428f66e8b5a08 in_seq=0 out_seq=0 2024-04-26T11:32:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.352+0000 7f7fd8c00640 10 client.25309 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7fd8c00640 1 -- 172.21.15.110:0/3150209157 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560413eb8e00 con 0x560413f77d00 2024-04-26T11:32:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7fd8c00640 10 client.25309 handle_command_reply: tid=0 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 client.25309 shutdown 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 -- 172.21.15.110:0/3150209157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 msgr2=0x560413f50dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f50dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0000c00 tx=0x7f7fe001d690 comp rx=0 tx=0).stop 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 -- 172.21.15.110:0/3150209157 shutdown_connections 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560413f56fb0 0x560413f51840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560413f4c6f0 0x560413f51300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560413f77d00 0x560413fe0be0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 --2- 172.21.15.110:0/3150209157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560413f4bdd0 0x560413f50dc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7fd8c00640 0 client.25309 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 -- 172.21.15.110:0/3150209157 >> 172.21.15.110:0/3150209157 conn(0x560413f482e0 msgr2=0x560413f52eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 -- 172.21.15.110:0/3150209157 shutdown_connections 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.395+0000 7f7ff8804740 1 -- 172.21.15.110:0/3150209157 wait complete. 2024-04-26T11:32:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff8804740 20 client.25309 trim_cache size 0 max 16384 2024-04-26T11:32:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:32:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:32:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:32:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff5a00640 1 -- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7fd40a3ee0 msgr2=0x7f7fd40a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7fd40a3ee0 0x7f7fd40a63a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00095f0 tx=0x7f7fe0005f90 comp rx=0 tx=0).stop 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff5a00640 1 -- 172.21.15.110:0/172527456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ff010f220 msgr2=0x7f7ff019fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ff010f220 0x7f7ff019fa40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009dc0 tx=0x7f7fe8003ce0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff5a00640 1 -- 172.21.15.110:0/172527456 shutdown_connections 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7fd40a3ee0 0x7f7fd40a63a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ff010f220 0x7f7ff019fa40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ff0075550 0x7f7ff019b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.396+0000 7f7ff5a00640 1 --2- 172.21.15.110:0/172527456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff0074c30 0x7f7ff019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.397+0000 7f7ff5a00640 1 -- 172.21.15.110:0/172527456 >> 172.21.15.110:0/172527456 conn(0x7f7ff0079dc0 msgr2=0x7f7ff00ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.397+0000 7f7ff5a00640 1 -- 172.21.15.110:0/172527456 shutdown_connections 2024-04-26T11:32:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:13.397+0000 7f7ff5a00640 1 -- 172.21.15.110:0/172527456 wait complete. 2024-04-26T11:32:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:13 smithi110 ceph-mon[28069]: pgmap v31: 97 pgs: 97 active+clean; 234 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 33 MiB/s wr, 307 op/s 2024-04-26T11:32:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:13 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:13 smithi193 ceph-mon[32782]: pgmap v31: 97 pgs: 97 active+clean; 234 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 33 MiB/s wr, 307 op/s 2024-04-26T11:32:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:13 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:13 smithi196 ceph-mon[32572]: pgmap v31: 97 pgs: 97 active+clean; 234 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 33 MiB/s wr, 307 op/s 2024-04-26T11:32:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:13 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:14.737 INFO:teuthology.orchestra.run.smithi110.stderr:done in 12.96 s (drop tables 0.00 s, create tables 0.06 s, client-side generate 9.28 s, vacuum 1.00 s, primary keys 2.61 s). 2024-04-26T11:32:14.748 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-04-26T11:32:14.921 INFO:teuthology.orchestra.run.smithi110.stderr:starting vacuum...end. 2024-04-26T11:32:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:15 smithi193 ceph-mon[32782]: pgmap v32: 97 pgs: 97 active+clean; 395 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 58 MiB/s wr, 332 op/s 2024-04-26T11:32:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:15 smithi196 ceph-mon[32572]: pgmap v32: 97 pgs: 97 active+clean; 395 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 58 MiB/s wr, 332 op/s 2024-04-26T11:32:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:15 smithi110 ceph-mon[28069]: pgmap v32: 97 pgs: 97 active+clean; 395 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 58 MiB/s wr, 332 op/s 2024-04-26T11:32:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:17 smithi193 ceph-mon[32782]: pgmap v33: 97 pgs: 97 active+clean; 395 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 55 MiB/s wr, 46 op/s 2024-04-26T11:32:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:17 smithi196 ceph-mon[32572]: pgmap v33: 97 pgs: 97 active+clean; 395 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 55 MiB/s wr, 46 op/s 2024-04-26T11:32:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:17 smithi110 ceph-mon[28069]: pgmap v33: 97 pgs: 97 active+clean; 395 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 55 MiB/s wr, 46 op/s 2024-04-26T11:32:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:18 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:19.158 INFO:tasks.quiescer.fs.[cephfs]:Total duration (36.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T11:32:19.158 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.0 2024-04-26T11:32:19.159 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:32:19.230 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:18 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:18 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:32:19.770 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:32:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 5.0 s, 3035.0 tps, lat 31.646 ms stddev 33.538 2024-04-26T11:32:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:19 smithi193 ceph-mon[32782]: pgmap v34: 97 pgs: 97 active+clean; 524 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 72 MiB/s wr, 121 op/s 2024-04-26T11:32:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:19 smithi196 ceph-mon[32572]: pgmap v34: 97 pgs: 97 active+clean; 524 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 72 MiB/s wr, 121 op/s 2024-04-26T11:32:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:19 smithi110 ceph-mon[28069]: pgmap v34: 97 pgs: 97 active+clean; 524 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 72 MiB/s wr, 121 op/s 2024-04-26T11:32:22.029 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:21 smithi110 ceph-mon[28069]: pgmap v35: 97 pgs: 97 active+clean; 524 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 42 MiB/s wr, 99 op/s 2024-04-26T11:32:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:21 smithi193 ceph-mon[32782]: pgmap v35: 97 pgs: 97 active+clean; 524 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 42 MiB/s wr, 99 op/s 2024-04-26T11:32:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:21 smithi196 ceph-mon[32572]: pgmap v35: 97 pgs: 97 active+clean; 524 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 42 MiB/s wr, 99 op/s 2024-04-26T11:32:22.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.642+0000 7f8ac0000700 1 -- 172.21.15.110:0/1974908843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8108350 msgr2=0x7f8ab806b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:22.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.642+0000 7f8ac0000700 1 --2- 172.21.15.110:0/1974908843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8108350 0x7f8ab806b130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009990 tx=0x7f8aac009ca0 comp rx=0 tx=0).stop 2024-04-26T11:32:22.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.642+0000 7f8ac0000700 1 -- 172.21.15.110:0/1974908843 shutdown_connections 2024-04-26T11:32:22.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.642+0000 7f8ac0000700 1 --2- 172.21.15.110:0/1974908843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ab8105e60 0x7f8ab81062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:22.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.642+0000 7f8ac0000700 1 --2- 172.21.15.110:0/1974908843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8108350 0x7f8ab806b130 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009990 tx=0x7f8aac009ca0 comp rx=0 tx=0).stop 2024-04-26T11:32:22.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.642+0000 7f8ac0000700 1 --2- 172.21.15.110:0/1974908843 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab806b670 0x7f8ab806bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:22.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.642+0000 7f8ac0000700 1 -- 172.21.15.110:0/1974908843 >> 172.21.15.110:0/1974908843 conn(0x7f8ab80792d0 msgr2=0x7f8ab80796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:22.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.643+0000 7f8ac0000700 1 -- 172.21.15.110:0/1974908843 shutdown_connections 2024-04-26T11:32:22.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.643+0000 7f8ac0000700 1 -- 172.21.15.110:0/1974908843 wait complete. 2024-04-26T11:32:22.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.644+0000 7f8ac0000700 1 Processor -- start 2024-04-26T11:32:22.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.645+0000 7f8ac0000700 1 -- start start 2024-04-26T11:32:22.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.645+0000 7f8ac0000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ab806b670 0x7f8ab81a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:22.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.645+0000 7f8ac0000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8105e60 0x7f8ab81a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:22.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.645+0000 7f8ac0000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab81a4cf0 0x7f8ab81a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.645+0000 7f8ac0000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8119cd0 con 0x7f8ab806b670 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.646+0000 7f8ac0000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8119b50 con 0x7f8ab8105e60 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.646+0000 7f8abcc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8105e60 0x7f8ab81a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.646+0000 7f8abcc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8105e60 0x7f8ab81a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38572/0 (socket says 172.21.15.110:38572) 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.646+0000 7f8abcc00700 1 -- 172.21.15.110:0/139118435 learned_addr learned my addr 172.21.15.110:0/139118435 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.646+0000 7f8abd600700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ab806b670 0x7f8ab81a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.646+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8119e50 con 0x7f8ab81a4cf0 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.646+0000 7f8abe000700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab81a4cf0 0x7f8ab81a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8abcc00700 1 -- 172.21.15.110:0/139118435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab81a4cf0 msgr2=0x7f8ab81a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8abcc00700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab81a4cf0 0x7f8ab81a5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8abcc00700 1 -- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ab806b670 msgr2=0x7f8ab81a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:22.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8abcc00700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ab806b670 0x7f8ab81a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:22.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8abcc00700 1 -- 172.21.15.110:0/139118435 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab81a5810 con 0x7f8ab8105e60 2024-04-26T11:32:22.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8abe000700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab81a4cf0 0x7f8ab81a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:22.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8abcc00700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8105e60 0x7f8ab81a0960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400b530 tx=0x7f8aa400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:22.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8ab6000700 1 -- 172.21.15.110:0/139118435 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4015020 con 0x7f8ab8105e60 2024-04-26T11:32:22.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab81a5b00 con 0x7f8ab8105e60 2024-04-26T11:32:22.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8ab6000700 1 -- 172.21.15.110:0/139118435 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8aa4011ce0 con 0x7f8ab8105e60 2024-04-26T11:32:22.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8ab6000700 1 -- 172.21.15.110:0/139118435 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4010dd0 con 0x7f8ab8105e60 2024-04-26T11:32:22.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.647+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab8108cd0 con 0x7f8ab8105e60 2024-04-26T11:32:22.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.654+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab806a110 con 0x7f8ab8105e60 2024-04-26T11:32:22.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.654+0000 7f8ab6000700 1 -- 172.21.15.110:0/139118435 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 138880+0+0 (secure 0 0 0) 0x7f8aa4018020 con 0x7f8ab8105e60 2024-04-26T11:32:22.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.657+0000 7f8ab6000700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8aa00a3fa0 0x7f8aa00a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:22.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.657+0000 7f8ab6000700 1 -- 172.21.15.110:0/139118435 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f8aa40d0070 con 0x7f8ab8105e60 2024-04-26T11:32:22.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.658+0000 7f8abd600700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8aa00a3fa0 0x7f8aa00a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:22.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.659+0000 7f8abd600700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8aa00a3fa0 0x7f8aa00a6460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00b2e0 tx=0x7f8aac005fd0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:22.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:22.662+0000 7f8ab6000700 1 -- 172.21.15.110:0/139118435 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8aa401f020 con 0x7f8ab8105e60 2024-04-26T11:32:23.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.138+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ab810a110 con 0x7f8ab8105e60 2024-04-26T11:32:23.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.139+0000 7f8ab6000700 1 -- 172.21.15.110:0/139118435 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11896 (secure 0 0 0) 0x7f8aa409c550 con 0x7f8ab8105e60 2024-04-26T11:32:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:23.143 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:32:17.630171+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24487,24502]},"id":1}]} 2024-04-26T11:32:23.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.142+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8aa00a3fa0 msgr2=0x7f8aa00a6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:23.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.142+0000 7f8ac0000700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8aa00a3fa0 0x7f8aa00a6460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00b2e0 tx=0x7f8aac005fd0 comp rx=0 tx=0).stop 2024-04-26T11:32:23.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.142+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8105e60 msgr2=0x7f8ab81a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:23.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.142+0000 7f8ac0000700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8105e60 0x7f8ab81a0960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400b530 tx=0x7f8aa400b840 comp rx=0 tx=0).stop 2024-04-26T11:32:23.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.143+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 shutdown_connections 2024-04-26T11:32:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.143+0000 7f8ac0000700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8aa00a3fa0 0x7f8aa00a6460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.143+0000 7f8ac0000700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8ab81a4cf0 0x7f8ab81a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.143+0000 7f8ac0000700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ab806b670 0x7f8ab81a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.143+0000 7f8ac0000700 1 --2- 172.21.15.110:0/139118435 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ab8105e60 0x7f8ab81a0960 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400b530 tx=0x7f8aa400b840 comp rx=0 tx=0).stop 2024-04-26T11:32:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.143+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 >> 172.21.15.110:0/139118435 conn(0x7f8ab80792d0 msgr2=0x7f8ab8101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.144+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 shutdown_connections 2024-04-26T11:32:23.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:23.144+0000 7f8ac0000700 1 -- 172.21.15.110:0/139118435 wait complete. 2024-04-26T11:32:23.147 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2024-04-26T11:32:24.105 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:23 smithi110 ceph-mon[28069]: pgmap v36: 97 pgs: 97 active+clean; 524 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 42 MiB/s wr, 99 op/s 2024-04-26T11:32:24.105 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:23 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/139118435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:32:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:23 smithi193 ceph-mon[32782]: pgmap v36: 97 pgs: 97 active+clean; 524 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 42 MiB/s wr, 99 op/s 2024-04-26T11:32:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:23 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/139118435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:32:24.177 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db / --timeout 60 --expiration 78.0 --await-for 42.0' 2024-04-26T11:32:24.177 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db / --timeout 60 --expiration 78.0 --await-for 42.0 2024-04-26T11:32:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:23 smithi196 ceph-mon[32572]: pgmap v36: 97 pgs: 97 active+clean; 524 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 42 MiB/s wr, 99 op/s 2024-04-26T11:32:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:23 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/139118435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:32:24.887 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:32:24.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 10.0 s, 2865.2 tps, lat 34.711 ms stddev 38.169 2024-04-26T11:32:25.116 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:32:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:32:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:32:26.112 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:25 smithi110 ceph-mon[28069]: pgmap v37: 97 pgs: 97 active+clean; 902 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 45 MiB/s wr, 361 op/s 2024-04-26T11:32:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:25 smithi193 ceph-mon[32782]: pgmap v37: 97 pgs: 97 active+clean; 902 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 45 MiB/s wr, 361 op/s 2024-04-26T11:32:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:25 smithi196 ceph-mon[32572]: pgmap v37: 97 pgs: 97 active+clean; 902 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 45 MiB/s wr, 361 op/s 2024-04-26T11:32:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.581+0000 7fbab3e00640 1 -- 172.21.15.110:0/1529922437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 msgr2=0x7fbaac10aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.581+0000 7fbab3e00640 1 --2- 172.21.15.110:0/1529922437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 0x7fbaac10aff0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009930 tx=0x7fbaa002a440 comp rx=0 tx=0).stop 2024-04-26T11:32:26.583 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.582+0000 7fbab3e00640 1 -- 172.21.15.110:0/1529922437 shutdown_connections 2024-04-26T11:32:26.583 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.582+0000 7fbab3e00640 1 --2- 172.21.15.110:0/1529922437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaac105510 0x7fbaac1119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.583 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.582+0000 7fbab3e00640 1 --2- 172.21.15.110:0/1529922437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaac104b50 0x7fbaac104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.583 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.582+0000 7fbab3e00640 1 --2- 172.21.15.110:0/1529922437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 0x7fbaac10aff0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.583 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.582+0000 7fbab3e00640 1 -- 172.21.15.110:0/1529922437 >> 172.21.15.110:0/1529922437 conn(0x7fbaac100660 msgr2=0x7fbaac102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:26.584 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.582+0000 7fbab3e00640 1 -- 172.21.15.110:0/1529922437 shutdown_connections 2024-04-26T11:32:26.584 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.583+0000 7fbab3e00640 1 -- 172.21.15.110:0/1529922437 wait complete. 2024-04-26T11:32:26.585 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.584+0000 7fbab3e00640 1 Processor -- start 2024-04-26T11:32:26.585 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.584+0000 7fbab3e00640 1 -- start start 2024-04-26T11:32:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaac104b50 0x7fbaac1117e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaac105510 0x7fbaac10e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab3e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 0x7fbaac10eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab3e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac114dc0 con 0x7fbaac104b50 2024-04-26T11:32:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab3e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac114c40 con 0x7fbaac10ac10 2024-04-26T11:32:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab3e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac114f40 con 0x7fbaac105510 2024-04-26T11:32:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 0x7fbaac10eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 0x7fbaac10eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38578/0 (socket says 172.21.15.110:38578) 2024-04-26T11:32:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1e00640 1 -- 172.21.15.110:0/2909719870 learned_addr learned my addr 172.21.15.110:0/2909719870 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab0a00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaac105510 0x7fbaac10e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1400640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaac104b50 0x7fbaac1117e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1e00640 1 -- 172.21.15.110:0/2909719870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaac105510 msgr2=0x7fbaac10e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1e00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaac105510 0x7fbaac10e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1e00640 1 -- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaac104b50 msgr2=0x7fbaac1117e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1e00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaac104b50 0x7fbaac1117e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1e00640 1 -- 172.21.15.110:0/2909719870 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac10f770 con 0x7fbaac10ac10 2024-04-26T11:32:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.585+0000 7fbab1400640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaac104b50 0x7fbaac1117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:32:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.586+0000 7fbab1e00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 0x7fbaac10eee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400efd0 tx=0x7fbaa400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.586+0000 7fbaaa000640 1 -- 172.21.15.110:0/2909719870 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4003b70 con 0x7fbaac10ac10 2024-04-26T11:32:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.586+0000 7fbaaa000640 1 -- 172.21.15.110:0/2909719870 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa4003d10 con 0x7fbaac10ac10 2024-04-26T11:32:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.586+0000 7fbab3e00640 1 -- 172.21.15.110:0/2909719870 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaac1abb20 con 0x7fbaac10ac10 2024-04-26T11:32:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.586+0000 7fbaaa000640 1 -- 172.21.15.110:0/2909719870 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4010820 con 0x7fbaac10ac10 2024-04-26T11:32:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.587+0000 7fbab3e00640 1 -- 172.21.15.110:0/2909719870 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaac1ac070 con 0x7fbaac10ac10 2024-04-26T11:32:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.595+0000 7fbaaa000640 1 -- 172.21.15.110:0/2909719870 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 25) ==== 138880+0+0 (secure 0 0 0) 0x7fbaa4004020 con 0x7fbaac10ac10 2024-04-26T11:32:26.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.599+0000 7fbaaa000640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fba940a3fe0 0x7fba940a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.599+0000 7fbaaa000640 1 -- 172.21.15.110:0/2909719870 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fbaa40d12b0 con 0x7fbaac10ac10 2024-04-26T11:32:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.601+0000 7fbab6c1a740 1 Processor -- start 2024-04-26T11:32:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.602+0000 7fbab6c1a740 1 -- start start 2024-04-26T11:32:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.602+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc70cdd0 0x55d0bc70d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.602+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70d6f0 0x55d0bc717a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.602+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc717fb0 0x55d0bc71a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.602+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d0bc672380 con 0x55d0bc70d6f0 2024-04-26T11:32:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.602+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d0bc60ec30 con 0x55d0bc717fb0 2024-04-26T11:32:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.602+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d0bc66e340 con 0x55d0bc70cdd0 2024-04-26T11:32:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.603+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc717fb0 0x55d0bc71a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.603+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc717fb0 0x55d0bc71a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38588/0 (socket says 172.21.15.110:38588) 2024-04-26T11:32:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.603+0000 7fbab1e00640 1 -- 172.21.15.110:0/362776946 learned_addr learned my addr 172.21.15.110:0/362776946 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.603+0000 7fbab0a00640 1 --2- 172.21.15.110:0/362776946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70d6f0 0x55d0bc717a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.603+0000 7fbab1e00640 1 -- 172.21.15.110:0/362776946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc70cdd0 msgr2=0x55d0bc70d1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T11:32:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.603+0000 7fbab1e00640 1 --2- 172.21.15.110:0/362776946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc70cdd0 0x55d0bc70d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.603+0000 7fbab1e00640 1 -- 172.21.15.110:0/362776946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70d6f0 msgr2=0x55d0bc717a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.603+0000 7fbab1400640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fba940a3fe0 0x7fba940a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.603+0000 7fbab1e00640 1 --2- 172.21.15.110:0/362776946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70d6f0 0x55d0bc717a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.604+0000 7fbab1e00640 1 -- 172.21.15.110:0/362776946 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0bc630940 con 0x55d0bc717fb0 2024-04-26T11:32:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.604+0000 7fbab0a00640 1 --2- 172.21.15.110:0/362776946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70d6f0 0x55d0bc717a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:32:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.604+0000 7fbab1e00640 1 --2- 172.21.15.110:0/362776946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc717fb0 0x55d0bc71a3a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbaa409ceb0 tx=0x7fbaa409c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd7c9e5e0b12f260 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.605+0000 7fba9e600640 1 -- 172.21.15.110:0/362776946 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa409cf20 con 0x55d0bc717fb0 2024-04-26T11:32:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.605+0000 7fba9e600640 1 -- 172.21.15.110:0/362776946 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa40a12d0 con 0x55d0bc717fb0 2024-04-26T11:32:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.605+0000 7fba9e600640 1 -- 172.21.15.110:0/362776946 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40b6220 con 0x55d0bc717fb0 2024-04-26T11:32:26.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.607+0000 7fbab1400640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fba940a3fe0 0x7fba940a64a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0000c00 tx=0x7fbaa0031400 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:26.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.607+0000 7fbab6c1a740 1 -- 172.21.15.110:0/362776946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc717fb0 msgr2=0x55d0bc71a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.607+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/362776946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc717fb0 0x55d0bc71a3a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbaa409ceb0 tx=0x7fbaa409c880 comp rx=0 tx=0).stop 2024-04-26T11:32:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.607+0000 7fbab6c1a740 1 -- 172.21.15.110:0/362776946 shutdown_connections 2024-04-26T11:32:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.607+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/362776946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc717fb0 0x55d0bc71a3a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.607+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/362776946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70d6f0 0x55d0bc717a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.607+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/362776946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc70cdd0 0x55d0bc70d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.607+0000 7fbab6c1a740 1 -- 172.21.15.110:0/362776946 >> 172.21.15.110:0/362776946 conn(0x55d0bc7092e0 msgr2=0x55d0bc7096c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.608+0000 7fbab6c1a740 1 -- 172.21.15.110:0/362776946 shutdown_connections 2024-04-26T11:32:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.608+0000 7fbab6c1a740 1 -- 172.21.15.110:0/362776946 wait complete. 2024-04-26T11:32:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.609+0000 7fbab6c1a740 1 -- start start 2024-04-26T11:32:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.609+0000 7fbab6c1a740 1 Processor -- start 2024-04-26T11:32:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.610+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70cdd0 0x55d0bc714f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.610+0000 7fbab1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70cdd0 0x55d0bc714f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.610+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc715470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.611+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc717fb0 0x55d0bc7159b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.611+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d0bc71ab80 con 0x55d0bc70cdd0 2024-04-26T11:32:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.611+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d0bc5f9c60 con 0x55d0bc70d6f0 2024-04-26T11:32:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.611+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d0bc71ad00 con 0x55d0bc717fb0 2024-04-26T11:32:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.611+0000 7fbab6c1a740 10 client.0 _ll_register_callbacks cb 0x55d0bc625e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.611+0000 7fbab0a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc715470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.611+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc717fb0 0x55d0bc7159b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.611+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc717fb0 0x55d0bc7159b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:46638/0 (socket says 172.21.15.110:46638) 2024-04-26T11:32:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.611+0000 7fbab1e00640 1 -- 172.21.15.110:0/2935207010 learned_addr learned my addr 172.21.15.110:0/2935207010 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.612+0000 7fbab1400640 1 -- 172.21.15.110:0/2935207010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc717fb0 msgr2=0x55d0bc7159b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.612+0000 7fbab1400640 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc717fb0 0x55d0bc7159b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.612+0000 7fbab1400640 1 -- 172.21.15.110:0/2935207010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 msgr2=0x55d0bc715470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.612+0000 7fbab1400640 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc715470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.612+0000 7fbab1400640 1 -- 172.21.15.110:0/2935207010 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0bc608510 con 0x55d0bc70cdd0 2024-04-26T11:32:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.612+0000 7fbab0a00640 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc715470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:32:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.612+0000 7fbab1e00640 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc717fb0 0x55d0bc7159b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.613+0000 7fbab1400640 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70cdd0 0x55d0bc714f30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbaa002a960 tx=0x7fbaa0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a71181ac407880d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.613+0000 7fba92a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:32:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.614+0000 7fba92a00640 1 -- 172.21.15.110:0/2935207010 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0035050 con 0x55d0bc70cdd0 2024-04-26T11:32:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.614+0000 7fba92a00640 1 -- 172.21.15.110:0/2935207010 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fbaa0005250 con 0x55d0bc70cdd0 2024-04-26T11:32:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.614+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2935207010 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaa40a12d0 con 0x55d0bc70cdd0 2024-04-26T11:32:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.615+0000 7fba92a00640 1 -- 172.21.15.110:0/2935207010 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbaa0005450 con 0x55d0bc70cdd0 2024-04-26T11:32:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.615+0000 7fbab6c1a740 10 client.15207 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:26.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.615+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2935207010 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0bc384210 con 0x55d0bc70cdd0 2024-04-26T11:32:26.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.616+0000 7fba92a00640 1 -- 172.21.15.110:0/2935207010 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa40a12d0 con 0x55d0bc70cdd0 2024-04-26T11:32:26.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.616+0000 7fba92a00640 1 -- 172.21.15.110:0/2935207010 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fbaa0003860 con 0x55d0bc70cdd0 2024-04-26T11:32:26.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.616+0000 7fbab6c1a740 10 client.15207 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:26.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.616+0000 7fbab6c1a740 10 client.15207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:32:26.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.616+0000 7fbab6c1a740 20 client.15207 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:26.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.617+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d0bc727d40 0x55d0bc72a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.617+0000 7fbab6c1a740 4 client.15207 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:32:26.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.617+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2935207010 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0bc67ff90 con 0x55d0bc727d40 2024-04-26T11:32:26.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.617+0000 7fbab0a00640 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d0bc727d40 0x55d0bc72a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.619 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.618+0000 7fbab0a00640 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d0bc727d40 0x55d0bc72a130 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57a7fdcccd70a4c5 server_cookie=ef45e2fded61ade in_seq=0 out_seq=0 2024-04-26T11:32:26.619 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.618+0000 7fba92a00640 10 client.15207 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:26.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.619+0000 7fba92a00640 1 -- 172.21.15.110:0/2935207010 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0bc67ff90 con 0x55d0bc727d40 2024-04-26T11:32:26.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.619+0000 7fba92a00640 10 client.15207 handle_command_reply: tid=0 2024-04-26T11:32:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fbab6c1a740 1 client.15207 shutdown 2024-04-26T11:32:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2935207010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70cdd0 msgr2=0x55d0bc714f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70cdd0 0x55d0bc714f30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbaa002a960 tx=0x7fbaa0009260 comp rx=0 tx=0).stop 2024-04-26T11:32:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2935207010 shutdown_connections 2024-04-26T11:32:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d0bc727d40 0x55d0bc72a130 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc717fb0 0x55d0bc7159b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc715470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2935207010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc70cdd0 0x55d0bc714f30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2935207010 >> 172.21.15.110:0/2935207010 conn(0x55d0bc7092e0 msgr2=0x55d0bc70f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.620+0000 7fba92a00640 0 client.15207 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.621+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2935207010 shutdown_connections 2024-04-26T11:32:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.621+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2935207010 wait complete. 2024-04-26T11:32:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.621+0000 7fbab6c1a740 20 client.15207 trim_cache size 0 max 16384 2024-04-26T11:32:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.645+0000 7fbab6c1a740 1 Processor -- start 2024-04-26T11:32:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.645+0000 7fbab6c1a740 1 -- start start 2024-04-26T11:32:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.645+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc723a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.645+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc70f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.645+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc7082c0 0x55d0bc72fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.646+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b75f0 con 0x55d0bc717fb0 2024-04-26T11:32:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.646+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b4e30 con 0x55d0bc70d6f0 2024-04-26T11:32:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.646+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b2c80 con 0x55d0bc7082c0 2024-04-26T11:32:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.646+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc7082c0 0x55d0bc72fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.646+0000 7fbab1e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc7082c0 0x55d0bc72fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:46654/0 (socket says 172.21.15.110:46654) 2024-04-26T11:32:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.646+0000 7fbab1e00640 1 -- 172.21.15.110:0/1771831169 learned_addr learned my addr 172.21.15.110:0/1771831169 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.646+0000 7fbab1e00640 1 -- 172.21.15.110:0/1771831169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 msgr2=0x55d0bc723a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T11:32:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.647+0000 7fbab1400640 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc723a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.647+0000 7fbab0a00640 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc70f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.647+0000 7fbab1e00640 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc723a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.647+0000 7fbab1e00640 1 -- 172.21.15.110:0/1771831169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 msgr2=0x55d0bc70f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.647+0000 7fbab1e00640 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc70f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.647+0000 7fbab1e00640 1 -- 172.21.15.110:0/1771831169 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0bc450620 con 0x55d0bc7082c0 2024-04-26T11:32:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.647+0000 7fbab0a00640 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc70f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:32:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.648+0000 7fbab1e00640 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc7082c0 0x55d0bc72fa20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40099a0 tx=0x7fbaa4098b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7e8c43725b49cea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.648+0000 7fbab1400640 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc723a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:32:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.648+0000 7fba9dc00640 1 -- 172.21.15.110:0/1771831169 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4080070 con 0x55d0bc7082c0 2024-04-26T11:32:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.648+0000 7fba9dc00640 1 -- 172.21.15.110:0/1771831169 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa40ce6e0 con 0x55d0bc7082c0 2024-04-26T11:32:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.648+0000 7fba9dc00640 1 -- 172.21.15.110:0/1771831169 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40ba070 con 0x55d0bc7082c0 2024-04-26T11:32:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.649+0000 7fbab6c1a740 1 -- 172.21.15.110:0/1771831169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc7082c0 msgr2=0x55d0bc72fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.649+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc7082c0 0x55d0bc72fa20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40099a0 tx=0x7fbaa4098b90 comp rx=0 tx=0).stop 2024-04-26T11:32:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.649+0000 7fbab6c1a740 1 -- 172.21.15.110:0/1771831169 shutdown_connections 2024-04-26T11:32:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.649+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc7082c0 0x55d0bc72fa20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.649+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc70f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.649+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/1771831169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc70d6f0 0x55d0bc723a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.649+0000 7fbab6c1a740 1 -- 172.21.15.110:0/1771831169 >> 172.21.15.110:0/1771831169 conn(0x55d0bc7092e0 msgr2=0x55d0bc707bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:26.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.650+0000 7fbab6c1a740 1 -- 172.21.15.110:0/1771831169 shutdown_connections 2024-04-26T11:32:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.650+0000 7fbab6c1a740 1 -- 172.21.15.110:0/1771831169 wait complete. 2024-04-26T11:32:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.651+0000 7fbab6c1a740 1 -- start start 2024-04-26T11:32:26.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.651+0000 7fbab6c1a740 1 Processor -- start 2024-04-26T11:32:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.652+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc7082c0 0x55d0bc711b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.652+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc70d6f0 0x55d0bc7120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.652+0000 7fbab6c1a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc712610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.652+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b32f0 con 0x55d0bc717fb0 2024-04-26T11:32:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.652+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b4760 con 0x55d0bc7082c0 2024-04-26T11:32:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.652+0000 7fbab6c1a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b39c0 con 0x55d0bc70d6f0 2024-04-26T11:32:26.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.652+0000 7fbab6c1a740 10 client.0 _ll_register_callbacks cb 0x7fbaa40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.652+0000 7fbab1400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc7082c0 0x55d0bc711b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab1400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc7082c0 0x55d0bc711b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38622/0 (socket says 172.21.15.110:38622) 2024-04-26T11:32:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab1400640 1 -- 172.21.15.110:0/2181389893 learned_addr learned my addr 172.21.15.110:0/2181389893 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab1e00640 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc712610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab0a00640 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc70d6f0 0x55d0bc7120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab1e00640 1 -- 172.21.15.110:0/2181389893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc70d6f0 msgr2=0x55d0bc7120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab1e00640 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc70d6f0 0x55d0bc7120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab1e00640 1 -- 172.21.15.110:0/2181389893 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc7082c0 msgr2=0x55d0bc711b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab1e00640 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc7082c0 0x55d0bc711b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab1e00640 1 -- 172.21.15.110:0/2181389893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0bc62ccb0 con 0x55d0bc717fb0 2024-04-26T11:32:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.653+0000 7fbab1400640 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc7082c0 0x55d0bc711b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:26.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.654+0000 7fbab1e00640 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc712610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbaa409cc20 tx=0x7fbaa409c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4266b0e83e3725c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.654+0000 7fba92a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:32:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.655+0000 7fba92a00640 1 -- 172.21.15.110:0/2181389893 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4080070 con 0x55d0bc717fb0 2024-04-26T11:32:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.655+0000 7fba92a00640 1 -- 172.21.15.110:0/2181389893 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fbaa4016e70 con 0x55d0bc717fb0 2024-04-26T11:32:26.656 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.655+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2181389893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaa40ce6e0 con 0x55d0bc717fb0 2024-04-26T11:32:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.656+0000 7fba92a00640 1 -- 172.21.15.110:0/2181389893 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbaa40ba030 con 0x55d0bc717fb0 2024-04-26T11:32:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.656+0000 7fbab6c1a740 10 client.15210 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.656+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2181389893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0bc78e310 con 0x55d0bc717fb0 2024-04-26T11:32:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.657+0000 7fba92a00640 1 -- 172.21.15.110:0/2181389893 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa40ce6e0 con 0x55d0bc717fb0 2024-04-26T11:32:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.657+0000 7fba92a00640 1 -- 172.21.15.110:0/2181389893 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fbaa40a0070 con 0x55d0bc717fb0 2024-04-26T11:32:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.657+0000 7fbab6c1a740 10 client.15210 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.657+0000 7fbab6c1a740 10 client.15210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:32:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.657+0000 7fbab6c1a740 20 client.15210 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.658+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d0bc78e590 0x55d0bc790980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.658+0000 7fbab6c1a740 4 client.15210 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:32:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.658+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2181389893 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0bc679e00 con 0x55d0bc78e590 2024-04-26T11:32:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.658+0000 7fbab1400640 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d0bc78e590 0x55d0bc790980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.659+0000 7fbab1400640 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d0bc78e590 0x55d0bc790980 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4568c504ad53b7a server_cookie=38aca125b85dc46b in_seq=0 out_seq=0 2024-04-26T11:32:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.659+0000 7fba92a00640 10 client.15210 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.676+0000 7fba92a00640 1 -- 172.21.15.110:0/2181389893 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0bc679e00 con 0x55d0bc78e590 2024-04-26T11:32:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.676+0000 7fba92a00640 10 client.15210 handle_command_reply: tid=0 2024-04-26T11:32:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.676+0000 7fbab6c1a740 1 client.15210 shutdown 2024-04-26T11:32:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.676+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2181389893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 msgr2=0x55d0bc712610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.676+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc712610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbaa409cc20 tx=0x7fbaa409c880 comp rx=0 tx=0).stop 2024-04-26T11:32:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2181389893 shutdown_connections 2024-04-26T11:32:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0bc717fb0 0x55d0bc712610 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d0bc78e590 0x55d0bc790980 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d0bc70d6f0 0x55d0bc7120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fbab6c1a740 1 --2- 172.21.15.110:0/2181389893 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d0bc7082c0 0x55d0bc711b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fba92a00640 0 client.15210 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:26.678 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2181389893 >> 172.21.15.110:0/2181389893 conn(0x55d0bc7092e0 msgr2=0x55d0bc713c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2181389893 shutdown_connections 2024-04-26T11:32:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fbab6c1a740 1 -- 172.21.15.110:0/2181389893 wait complete. 2024-04-26T11:32:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.677+0000 7fbab6c1a740 20 client.15210 trim_cache size 0 max 16384 2024-04-26T11:32:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:32:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:32:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:32:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 -- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fba940a3fe0 msgr2=0x7fba940a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fba940a3fe0 0x7fba940a64a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0000c00 tx=0x7fbaa0031400 comp rx=0 tx=0).stop 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 -- 172.21.15.110:0/2909719870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 msgr2=0x7fbaac10eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 0x7fbaac10eee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400efd0 tx=0x7fbaa400c6a0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 -- 172.21.15.110:0/2909719870 shutdown_connections 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fba940a3fe0 0x7fba940a64a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaac10ac10 0x7fbaac10eee0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbaac105510 0x7fbaac10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 --2- 172.21.15.110:0/2909719870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaac104b50 0x7fbaac1117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 -- 172.21.15.110:0/2909719870 >> 172.21.15.110:0/2909719870 conn(0x7fbaac100660 msgr2=0x7fbaac101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 -- 172.21.15.110:0/2909719870 shutdown_connections 2024-04-26T11:32:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:26.678+0000 7fbab3e00640 1 -- 172.21.15.110:0/2909719870 wait complete. 2024-04-26T11:32:27.097 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:26 smithi110 ceph-mon[28069]: pgmap v38: 97 pgs: 97 active+clean; 902 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 20 MiB/s wr, 336 op/s 2024-04-26T11:32:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:26 smithi193 ceph-mon[32782]: pgmap v38: 97 pgs: 97 active+clean; 902 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 20 MiB/s wr, 336 op/s 2024-04-26T11:32:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:26 smithi196 ceph-mon[32572]: pgmap v38: 97 pgs: 97 active+clean; 902 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 20 MiB/s wr, 336 op/s 2024-04-26T11:32:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:32:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:32:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:32:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:32:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:32:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:32:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:32:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:32:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:32:28.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.312+0000 7f11d7400700 1 -- 172.21.15.110:0/2540798324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11d01094d0 msgr2=0x7f11d01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:28.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.312+0000 7f11d7400700 1 --2- 172.21.15.110:0/2540798324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11d01094d0 0x7f11d01098b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11c00098f0 tx=0x7f11c0009c00 comp rx=0 tx=0).stop 2024-04-26T11:32:28.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.313+0000 7f11d7400700 1 -- 172.21.15.110:0/2540798324 shutdown_connections 2024-04-26T11:32:28.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.313+0000 7f11d7400700 1 --2- 172.21.15.110:0/2540798324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11d006bae0 0x7f11d01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.313+0000 7f11d7400700 1 --2- 172.21.15.110:0/2540798324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11d01094d0 0x7f11d01098b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.313+0000 7f11d7400700 1 --2- 172.21.15.110:0/2540798324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11d006b120 0x7f11d006b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.313+0000 7f11d7400700 1 -- 172.21.15.110:0/2540798324 >> 172.21.15.110:0/2540798324 conn(0x7f11d00792c0 msgr2=0x7f11d00796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:28.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.314+0000 7f11d7400700 1 -- 172.21.15.110:0/2540798324 shutdown_connections 2024-04-26T11:32:28.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.314+0000 7f11d7400700 1 -- 172.21.15.110:0/2540798324 wait complete. 2024-04-26T11:32:28.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.315+0000 7f11d7400700 1 Processor -- start 2024-04-26T11:32:28.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.316+0000 7f11d7400700 1 -- start start 2024-04-26T11:32:28.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.317+0000 7f11d7400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11d006b120 0x7f11d01102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.317+0000 7f11d7400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11d006bae0 0x7f11d010e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.317+0000 7f11d7400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11d01094d0 0x7f11d010eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.318+0000 7f11d7400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f11d0111490 con 0x7f11d01094d0 2024-04-26T11:32:28.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.318+0000 7f11cfe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11d006bae0 0x7f11d010e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.318+0000 7f11d7400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f11d0111310 con 0x7f11d006b120 2024-04-26T11:32:28.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.318+0000 7f11d7400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f11d0111610 con 0x7f11d006bae0 2024-04-26T11:32:28.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.318+0000 7f11cfe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11d006bae0 0x7f11d010e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:46698/0 (socket says 172.21.15.110:46698) 2024-04-26T11:32:28.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.318+0000 7f11cfe00700 1 -- 172.21.15.110:0/4244775395 learned_addr learned my addr 172.21.15.110:0/4244775395 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:28.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.318+0000 7f11d4a00700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11d006b120 0x7f11d01102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.318+0000 7f11d5400700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11d01094d0 0x7f11d010eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.319+0000 7f11cfe00700 1 -- 172.21.15.110:0/4244775395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11d006b120 msgr2=0x7f11d01102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:28.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.319+0000 7f11cfe00700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11d006b120 0x7f11d01102a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.319+0000 7f11cfe00700 1 -- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11d01094d0 msgr2=0x7f11d010eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:28.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.319+0000 7f11cfe00700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11d01094d0 0x7f11d010eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.319+0000 7f11cfe00700 1 -- 172.21.15.110:0/4244775395 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d01ac4b0 con 0x7f11d006bae0 2024-04-26T11:32:28.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.319+0000 7f11cfe00700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11d006bae0 0x7f11d010e400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00b530 tx=0x7f11bc00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:28.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.320+0000 7f11cd600700 1 -- 172.21.15.110:0/4244775395 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc015020 con 0x7f11d006bae0 2024-04-26T11:32:28.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.321+0000 7f11cd600700 1 -- 172.21.15.110:0/4244775395 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11bc011ce0 con 0x7f11d006bae0 2024-04-26T11:32:28.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.321+0000 7f11d7400700 1 -- 172.21.15.110:0/4244775395 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d01ac7a0 con 0x7f11d006bae0 2024-04-26T11:32:28.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.321+0000 7f11d7400700 1 -- 172.21.15.110:0/4244775395 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d01acce0 con 0x7f11d006bae0 2024-04-26T11:32:28.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.321+0000 7f11cd600700 1 -- 172.21.15.110:0/4244775395 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc010dd0 con 0x7f11d006bae0 2024-04-26T11:32:28.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.329+0000 7f11cd600700 1 -- 172.21.15.110:0/4244775395 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 25) ==== 138880+0+0 (secure 0 0 0) 0x7f11bc018020 con 0x7f11d006bae0 2024-04-26T11:32:28.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.330+0000 7f11e1e86b80 1 Processor -- start 2024-04-26T11:32:28.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.331+0000 7f11e1e86b80 1 -- start start 2024-04-26T11:32:28.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.331+0000 7f11cd600700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f11b40a4150 0x7f11b40a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.331+0000 7f11cd600700 1 -- 172.21.15.110:0/4244775395 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f11bc0cfe10 con 0x7f11d006bae0 2024-04-26T11:32:28.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.331+0000 7f11d5400700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f11b40a4150 0x7f11b40a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.332+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d44216dc40 0x55d44216e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.332+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d4421683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.332+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 0x55d442174990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.332+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d4420baa20 con 0x55d442167f70 2024-04-26T11:32:28.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.332+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d442059340 con 0x55d44216dc40 2024-04-26T11:32:28.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.332+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d4420b69e0 con 0x55d442168910 2024-04-26T11:32:28.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.332+0000 7f11cfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d4421683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.333+0000 7f11cfe00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d4421683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36492/0 (socket says 172.21.15.110:36492) 2024-04-26T11:32:28.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.333+0000 7f11cfe00700 1 -- 172.21.15.110:0/1397187320 learned_addr learned my addr 172.21.15.110:0/1397187320 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:28.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.333+0000 7f11d5400700 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 0x55d442174990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.334+0000 7f11d4a00700 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d44216dc40 0x55d44216e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.334+0000 7f11cfe00700 1 -- 172.21.15.110:0/1397187320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 msgr2=0x55d442174990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:28.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.334+0000 7f11cfe00700 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 0x55d442174990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.334+0000 7f11cfe00700 1 -- 172.21.15.110:0/1397187320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d44216dc40 msgr2=0x55d44216e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:28.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.334+0000 7f11cfe00700 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d44216dc40 0x55d44216e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.334+0000 7f11d5400700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f11b40a4150 0x7f11b40a6610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11c8003ec0 tx=0x7f11c8009130 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:28.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.334+0000 7f11cfe00700 1 -- 172.21.15.110:0/1397187320 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4420617c0 con 0x55d442167f70 2024-04-26T11:32:28.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.334+0000 7f11d4a00700 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d44216dc40 0x55d44216e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:32:28.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.335+0000 7f11cfe00700 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d4421683d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f11bc010980 tx=0x7f11bc09c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333e70c7c3c3a9ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:28.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.335+0000 7f11c6000700 1 -- 172.21.15.110:0/1397187320 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0a4800 con 0x55d442167f70 2024-04-26T11:32:28.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.336+0000 7f11c6000700 1 -- 172.21.15.110:0/1397187320 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11bc099e90 con 0x55d442167f70 2024-04-26T11:32:28.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.337+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1397187320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 msgr2=0x55d4421683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:28.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.337+0000 7f11c6000700 1 -- 172.21.15.110:0/1397187320 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0a4800 con 0x55d442167f70 2024-04-26T11:32:28.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.337+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d4421683d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f11bc010980 tx=0x7f11bc09c390 comp rx=0 tx=0).stop 2024-04-26T11:32:28.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.338+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1397187320 shutdown_connections 2024-04-26T11:32:28.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.338+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 0x55d442174990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.338+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d44216dc40 0x55d44216e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.338+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1397187320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d4421683d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.338+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1397187320 >> 172.21.15.110:0/1397187320 conn(0x55d442095480 msgr2=0x55d442162b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:28.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.338+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1397187320 shutdown_connections 2024-04-26T11:32:28.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.338+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1397187320 wait complete. 2024-04-26T11:32:28.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.339+0000 7f11e1e86b80 1 -- start start 2024-04-26T11:32:28.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.339+0000 7f11e1e86b80 1 Processor -- start 2024-04-26T11:32:28.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442167f70 0x55d4421744e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 0x55d4421717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d44216dc40 0x55d442171d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d44216e670 con 0x55d44216dc40 2024-04-26T11:32:28.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d442055590 con 0x55d442167f70 2024-04-26T11:32:28.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d442185ee0 con 0x55d442168910 2024-04-26T11:32:28.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11e1e86b80 10 client.0 _ll_register_callbacks cb 0x55d44204e510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:28.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11d4a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442167f70 0x55d4421744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11d4a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442167f70 0x55d4421744e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38656/0 (socket says 172.21.15.110:38656) 2024-04-26T11:32:28.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11d4a00700 1 -- 172.21.15.110:0/3782438455 learned_addr learned my addr 172.21.15.110:0/3782438455 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.340+0000 7f11cfe00700 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 0x55d4421717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11d5400700 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d44216dc40 0x55d442171d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11cfe00700 1 -- 172.21.15.110:0/3782438455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442167f70 msgr2=0x55d4421744e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11cfe00700 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442167f70 0x55d4421744e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11cfe00700 1 -- 172.21.15.110:0/3782438455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d44216dc40 msgr2=0x55d442171d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11cfe00700 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d44216dc40 0x55d442171d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11cfe00700 1 -- 172.21.15.110:0/3782438455 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d442007a60 con 0x55d442168910 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11d4a00700 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442167f70 0x55d4421744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11cfe00700 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 0x55d4421717e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f11bc010980 tx=0x7f11bc011a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16819dea5546fe06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:28.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11baa00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:32:28.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11baa00700 1 -- 172.21.15.110:0/3782438455 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc097e30 con 0x55d442168910 2024-04-26T11:32:28.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.341+0000 7f11baa00700 1 -- 172.21.15.110:0/3782438455 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f11bc0cdbd0 con 0x55d442168910 2024-04-26T11:32:28.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.342+0000 7f11e1e86b80 1 -- 172.21.15.110:0/3782438455 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11bc099e90 con 0x55d442168910 2024-04-26T11:32:28.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.342+0000 7f11baa00700 1 -- 172.21.15.110:0/3782438455 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f11bc0a4800 con 0x55d442168910 2024-04-26T11:32:28.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.343+0000 7f11e1e86b80 10 client.25339 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:28.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.343+0000 7f11e1e86b80 1 -- 172.21.15.110:0/3782438455 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d4421902f0 con 0x55d442168910 2024-04-26T11:32:28.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.343+0000 7f11baa00700 1 -- 172.21.15.110:0/3782438455 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11bc099e90 con 0x55d442168910 2024-04-26T11:32:28.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.343+0000 7f11baa00700 1 -- 172.21.15.110:0/3782438455 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f11bc022060 con 0x55d442168910 2024-04-26T11:32:28.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.343+0000 7f11e1e86b80 10 client.25339 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:28.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.343+0000 7f11e1e86b80 10 client.25339 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:32:28.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.344+0000 7f11e1e86b80 20 client.25339 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:28.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.344+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d4421927c0 0x55d442194bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.344+0000 7f11e1e86b80 4 client.25339 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:32:28.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.344+0000 7f11e1e86b80 1 -- 172.21.15.110:0/3782438455 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4420c8400 con 0x55d4421927c0 2024-04-26T11:32:28.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.344+0000 7f11d4a00700 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d4421927c0 0x55d442194bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.345+0000 7f11baa00700 10 client.25339 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:28.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.345+0000 7f11d4a00700 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d4421927c0 0x55d442194bb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d0b5f79f726cfc6 server_cookie=844e9a3e77a8e4d3 in_seq=0 out_seq=0 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11baa00700 1 -- 172.21.15.110:0/3782438455 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d4420c8400 con 0x55d4421927c0 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11baa00700 10 client.25339 handle_command_reply: tid=0 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11e1e86b80 1 client.25339 shutdown 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11e1e86b80 1 -- 172.21.15.110:0/3782438455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 msgr2=0x55d4421717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 0x55d4421717e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f11bc010980 tx=0x7f11bc011a60 comp rx=0 tx=0).stop 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11e1e86b80 1 -- 172.21.15.110:0/3782438455 shutdown_connections 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d4421927c0 0x55d442194bb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d44216dc40 0x55d442171d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442167f70 0x55d4421744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/3782438455 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442168910 0x55d4421717e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11e1e86b80 1 -- 172.21.15.110:0/3782438455 >> 172.21.15.110:0/3782438455 conn(0x55d442095480 msgr2=0x55d44216cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:28.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.346+0000 7f11baa00700 0 client.25339 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:28.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.347+0000 7f11e1e86b80 1 -- 172.21.15.110:0/3782438455 shutdown_connections 2024-04-26T11:32:28.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.347+0000 7f11e1e86b80 1 -- 172.21.15.110:0/3782438455 wait complete. 2024-04-26T11:32:28.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.347+0000 7f11e1e86b80 20 client.25339 trim_cache size 0 max 16384 2024-04-26T11:32:28.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.378+0000 7f11e1e86b80 1 Processor -- start 2024-04-26T11:32:28.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.378+0000 7f11e1e86b80 1 -- start start 2024-04-26T11:32:28.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.378+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442167f70 0x55d44215d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.378+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44219a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.378+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d44216dc40 0x55d44219a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.378+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0010150 con 0x55d44216dc40 2024-04-26T11:32:28.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.378+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f11b000d950 con 0x55d442168910 2024-04-26T11:32:28.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.378+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f11b000b7a0 con 0x55d442167f70 2024-04-26T11:32:28.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11d4a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442167f70 0x55d44215d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11cfe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44219a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11cfe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44219a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38660/0 (socket says 172.21.15.110:38660) 2024-04-26T11:32:28.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11cfe00700 1 -- 172.21.15.110:0/967951196 learned_addr learned my addr 172.21.15.110:0/967951196 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:28.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11d4a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442167f70 0x55d44215d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:46714/0 (socket says 172.21.15.110:46714) 2024-04-26T11:32:28.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11cfe00700 1 -- 172.21.15.110:0/967951196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442167f70 msgr2=0x55d44215d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:28.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11cfe00700 1 --2- 172.21.15.110:0/967951196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442167f70 0x55d44215d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11cfe00700 1 -- 172.21.15.110:0/967951196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d44216dc40 msgr2=0x55d44219a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:28.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11cfe00700 1 --2- 172.21.15.110:0/967951196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d44216dc40 0x55d44219a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.379+0000 7f11cfe00700 1 -- 172.21.15.110:0/967951196 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d44218ecc0 con 0x55d442168910 2024-04-26T11:32:28.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.380+0000 7f11cfe00700 1 --2- 172.21.15.110:0/967951196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44219a210 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f11bc097ff0 tx=0x7f11bc0a4730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222d0cadee831901 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:28.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.381+0000 7f11c5600700 1 -- 172.21.15.110:0/967951196 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc097e30 con 0x55d442168910 2024-04-26T11:32:28.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.381+0000 7f11c5600700 1 -- 172.21.15.110:0/967951196 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11bc099e90 con 0x55d442168910 2024-04-26T11:32:28.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.381+0000 7f11c5600700 1 -- 172.21.15.110:0/967951196 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc09b960 con 0x55d442168910 2024-04-26T11:32:28.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.382+0000 7f11e1e86b80 1 -- 172.21.15.110:0/967951196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 msgr2=0x55d44219a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:28.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.382+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/967951196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44219a210 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f11bc097ff0 tx=0x7f11bc0a4730 comp rx=0 tx=0).stop 2024-04-26T11:32:28.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.382+0000 7f11e1e86b80 1 -- 172.21.15.110:0/967951196 shutdown_connections 2024-04-26T11:32:28.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.382+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/967951196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d44216dc40 0x55d44219a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.382+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/967951196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d442167f70 0x55d44215d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.382+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/967951196 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44219a210 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.382+0000 7f11e1e86b80 1 -- 172.21.15.110:0/967951196 >> 172.21.15.110:0/967951196 conn(0x55d442095480 msgr2=0x55d44215caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:28.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.383+0000 7f11e1e86b80 1 -- 172.21.15.110:0/967951196 shutdown_connections 2024-04-26T11:32:28.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.383+0000 7f11e1e86b80 1 -- 172.21.15.110:0/967951196 wait complete. 2024-04-26T11:32:28.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.383+0000 7f11e1e86b80 1 -- start start 2024-04-26T11:32:28.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.384+0000 7f11e1e86b80 1 Processor -- start 2024-04-26T11:32:28.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.384+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d44218b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.384+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44216a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.384+0000 7f11e1e86b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d44216dc40 0x55d44216adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.384+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f11b000be10 con 0x55d442167f70 2024-04-26T11:32:28.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.384+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f11b000d280 con 0x55d442168910 2024-04-26T11:32:28.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.384+0000 7f11e1e86b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f11b000c4e0 con 0x55d44216dc40 2024-04-26T11:32:28.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.384+0000 7f11e1e86b80 10 client.0 _ll_register_callbacks cb 0x55d44204e510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:28.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.385+0000 7f11d4a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d44218b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.385+0000 7f11cfe00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44216a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.385+0000 7f11d5400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d44216dc40 0x55d44216adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.385+0000 7f11d5400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d44216dc40 0x55d44216adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:46716/0 (socket says 172.21.15.110:46716) 2024-04-26T11:32:28.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.385+0000 7f11d5400700 1 -- 172.21.15.110:0/1217714366 learned_addr learned my addr 172.21.15.110:0/1217714366 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:28.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.386+0000 7f11d5400700 1 -- 172.21.15.110:0/1217714366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 msgr2=0x55d44216a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:28.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.386+0000 7f11d5400700 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44216a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.386+0000 7f11d5400700 1 -- 172.21.15.110:0/1217714366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 msgr2=0x55d44218b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:28.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.386+0000 7f11d5400700 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d44218b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:28.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.387+0000 7f11d5400700 1 -- 172.21.15.110:0/1217714366 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d44216c4b0 con 0x55d44216dc40 2024-04-26T11:32:28.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.387+0000 7f11d5400700 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d44216dc40 0x55d44216adc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009f10 tx=0x7f11c8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=797f05141e52ba4c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:28.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.387+0000 7f11baa00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:32:28.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.388+0000 7f11baa00700 1 -- 172.21.15.110:0/1217714366 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8026070 con 0x55d44216dc40 2024-04-26T11:32:28.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.388+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1217714366 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11bc099e90 con 0x55d44216dc40 2024-04-26T11:32:28.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.388+0000 7f11baa00700 1 -- 172.21.15.110:0/1217714366 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f11c8008220 con 0x55d44216dc40 2024-04-26T11:32:28.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.388+0000 7f11baa00700 1 -- 172.21.15.110:0/1217714366 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f11c8031050 con 0x55d44216dc40 2024-04-26T11:32:28.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.388+0000 7f11e1e86b80 10 client.25345 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:28.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.388+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1217714366 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d4421f8ff0 con 0x55d44216dc40 2024-04-26T11:32:28.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.389+0000 7f11baa00700 1 -- 172.21.15.110:0/1217714366 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11bc099e90 con 0x55d44216dc40 2024-04-26T11:32:28.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.391+0000 7f11baa00700 1 -- 172.21.15.110:0/1217714366 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f11c8007720 con 0x55d44216dc40 2024-04-26T11:32:28.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.391+0000 7f11e1e86b80 10 client.25345 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:28.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.391+0000 7f11e1e86b80 10 client.25345 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:32:28.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.391+0000 7f11e1e86b80 20 client.25345 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:28.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.391+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d4421f9750 0x55d4421fbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:28.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.391+0000 7f11e1e86b80 4 client.25345 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.0, "await_for": 42.0}] 2024-04-26T11:32:28.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.391+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1217714366 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.0, "await_for": 42.0}) -- 0x55d4420c24a0 con 0x55d4421f9750 2024-04-26T11:32:28.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.392+0000 7f11d4a00700 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d4421f9750 0x55d4421fbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:28.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.393+0000 7f11d4a00700 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d4421f9750 0x55d4421fbb70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a0c77fac902370e server_cookie=1f6be8adcd42ae2e in_seq=0 out_seq=0 2024-04-26T11:32:28.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:28.393+0000 7f11baa00700 10 client.25345 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:29.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.045+0000 7f11baa00700 1 -- 172.21.15.110:0/1217714366 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55d4420c24a0 con 0x55d4421f9750 2024-04-26T11:32:29.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.045+0000 7f11baa00700 10 client.25345 handle_command_reply: tid=0 2024-04-26T11:32:29.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.045+0000 7f11e1e86b80 1 client.25345 shutdown 2024-04-26T11:32:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.045+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1217714366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d44216dc40 msgr2=0x55d44216adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.045+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d44216dc40 0x55d44216adc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009f10 tx=0x7f11c8004ad0 comp rx=0 tx=0).stop 2024-04-26T11:32:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.045+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1217714366 shutdown_connections 2024-04-26T11:32:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.045+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d4421f9750 0x55d4421fbb70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:29.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.046+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d44216dc40 0x55d44216adc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.046+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d442167f70 0x55d44218b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.046+0000 7f11e1e86b80 1 --2- 172.21.15.110:0/1217714366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d442168910 0x55d44216a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.046+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1217714366 >> 172.21.15.110:0/1217714366 conn(0x55d442095480 msgr2=0x55d442166f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.046+0000 7f11baa00700 0 client.25345 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.046+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1217714366 shutdown_connections 2024-04-26T11:32:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.046+0000 7f11e1e86b80 1 -- 172.21.15.110:0/1217714366 wait complete. 2024-04-26T11:32:29.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.046+0000 7f11e1e86b80 20 client.25345 trim_cache size 0 max 16384 2024-04-26T11:32:29.048 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 30, 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 2, 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "d509ee23": { 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 2, 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "QUIESCED", 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:32:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 78.0, 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": false, 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "QUIESCED", 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:29.050 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.047+0000 7f11d7400700 1 -- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f11b40a4150 msgr2=0x7f11b40a6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.047+0000 7f11d7400700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f11b40a4150 0x7f11b40a6610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11c8003ec0 tx=0x7f11c8009130 comp rx=0 tx=0).stop 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.047+0000 7f11d7400700 1 -- 172.21.15.110:0/4244775395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11d006bae0 msgr2=0x7f11d010e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.047+0000 7f11d7400700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11d006bae0 0x7f11d010e400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00b530 tx=0x7f11bc00b840 comp rx=0 tx=0).stop 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.048+0000 7f11d7400700 1 -- 172.21.15.110:0/4244775395 shutdown_connections 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.048+0000 7f11d7400700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f11b40a4150 0x7f11b40a6610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.048+0000 7f11d7400700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11d01094d0 0x7f11d010eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.048+0000 7f11d7400700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11d006b120 0x7f11d01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.048+0000 7f11d7400700 1 --2- 172.21.15.110:0/4244775395 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f11d006bae0 0x7f11d010e400 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:29.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.048+0000 7f11d7400700 1 -- 172.21.15.110:0/4244775395 >> 172.21.15.110:0/4244775395 conn(0x7f11d00792c0 msgr2=0x7f11d0100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:29.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.048+0000 7f11d7400700 1 -- 172.21.15.110:0/4244775395 shutdown_connections 2024-04-26T11:32:29.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:29.048+0000 7f11d7400700 1 -- 172.21.15.110:0/4244775395 wait complete. 2024-04-26T11:32:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:28 smithi196 ceph-mon[32572]: pgmap v39: 97 pgs: 97 active+clean; 940 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 24 MiB/s wr, 630 op/s 2024-04-26T11:32:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:28 smithi110 ceph-mon[28069]: pgmap v39: 97 pgs: 97 active+clean; 940 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 24 MiB/s wr, 630 op/s 2024-04-26T11:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:28 smithi193 ceph-mon[32782]: pgmap v39: 97 pgs: 97 active+clean; 940 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 24 MiB/s wr, 630 op/s 2024-04-26T11:32:29.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 15.0 s, 1975.4 tps, lat 35.669 ms stddev 46.201 2024-04-26T11:32:29.986 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd509ee23', quiesce took 10.8 seconds. Will release after: 18.0 2024-04-26T11:32:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:31 smithi196 ceph-mon[32572]: pgmap v40: 97 pgs: 97 active+clean; 940 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.1 MiB/s wr, 555 op/s 2024-04-26T11:32:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:31 smithi110 ceph-mon[28069]: pgmap v40: 97 pgs: 97 active+clean; 940 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.1 MiB/s wr, 555 op/s 2024-04-26T11:32:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:31 smithi193 ceph-mon[32782]: pgmap v40: 97 pgs: 97 active+clean; 940 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.1 MiB/s wr, 555 op/s 2024-04-26T11:32:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:33 smithi196 ceph-mon[32572]: pgmap v41: 97 pgs: 97 active+clean; 940 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.1 MiB/s wr, 555 op/s 2024-04-26T11:32:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:33 smithi110 ceph-mon[28069]: pgmap v41: 97 pgs: 97 active+clean; 940 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.1 MiB/s wr, 555 op/s 2024-04-26T11:32:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:33 smithi193 ceph-mon[32782]: pgmap v41: 97 pgs: 97 active+clean; 940 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.1 MiB/s wr, 555 op/s 2024-04-26T11:32:34.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 20.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:32:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:35 smithi196 ceph-mon[32572]: pgmap v42: 97 pgs: 97 active+clean; 946 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 8.0 MiB/s wr, 716 op/s 2024-04-26T11:32:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:35 smithi110 ceph-mon[28069]: pgmap v42: 97 pgs: 97 active+clean; 946 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 8.0 MiB/s wr, 716 op/s 2024-04-26T11:32:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:35 smithi193 ceph-mon[32782]: pgmap v42: 97 pgs: 97 active+clean; 946 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 8.0 MiB/s wr, 716 op/s 2024-04-26T11:32:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:37 smithi196 ceph-mon[32572]: pgmap v43: 97 pgs: 97 active+clean; 946 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 5.2 MiB/s wr, 454 op/s 2024-04-26T11:32:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:37 smithi110 ceph-mon[28069]: pgmap v43: 97 pgs: 97 active+clean; 946 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 5.2 MiB/s wr, 454 op/s 2024-04-26T11:32:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:37 smithi193 ceph-mon[32782]: pgmap v43: 97 pgs: 97 active+clean; 946 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 5.2 MiB/s wr, 454 op/s 2024-04-26T11:32:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:39 smithi196 ceph-mon[32572]: pgmap v44: 97 pgs: 97 active+clean; 947 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 6.0 MiB/s wr, 468 op/s 2024-04-26T11:32:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:39 smithi110 ceph-mon[28069]: pgmap v44: 97 pgs: 97 active+clean; 947 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 6.0 MiB/s wr, 468 op/s 2024-04-26T11:32:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:39 smithi193 ceph-mon[32782]: pgmap v44: 97 pgs: 97 active+clean; 947 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 6.0 MiB/s wr, 468 op/s 2024-04-26T11:32:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.837+0000 7f6965800640 1 -- 172.21.15.110:0/1693080008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 msgr2=0x7f696010f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.837+0000 7f6965800640 1 --2- 172.21.15.110:0/1693080008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 0x7f696010f800 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6958009890 tx=0x7f695802a360 comp rx=0 tx=0).stop 2024-04-26T11:32:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.837+0000 7f6965800640 1 -- 172.21.15.110:0/1693080008 shutdown_connections 2024-04-26T11:32:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.837+0000 7f6965800640 1 --2- 172.21.15.110:0/1693080008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 0x7f696010f800 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.837+0000 7f6965800640 1 --2- 172.21.15.110:0/1693080008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6960102930 0x7f6960102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.837+0000 7f6965800640 1 --2- 172.21.15.110:0/1693080008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960108940 0x7f6960108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.837+0000 7f6965800640 1 -- 172.21.15.110:0/1693080008 >> 172.21.15.110:0/1693080008 conn(0x7f69600fe3c0 msgr2=0x7f69601007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.838+0000 7f6965800640 1 -- 172.21.15.110:0/1693080008 shutdown_connections 2024-04-26T11:32:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.838+0000 7f6965800640 1 -- 172.21.15.110:0/1693080008 wait complete. 2024-04-26T11:32:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.838+0000 7f6965800640 1 Processor -- start 2024-04-26T11:32:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f6965800640 1 -- start start 2024-04-26T11:32:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f6965800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6960102930 0x7f6960199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f6965800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 0x7f69601995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f6965800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960108940 0x7f696019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f6965800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6960112bd0 con 0x7f69601032f0 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f6965800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6960112a50 con 0x7f6960108940 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f6965800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6960112d50 con 0x7f6960102930 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f695e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 0x7f69601995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f695e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 0x7f69601995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40392/0 (socket says 172.21.15.110:40392) 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f695e000640 1 -- 172.21.15.110:0/3082924927 learned_addr learned my addr 172.21.15.110:0/3082924927 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f695ea00640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6960102930 0x7f6960199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.839+0000 7f695f400640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960108940 0x7f696019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f695e000640 1 -- 172.21.15.110:0/3082924927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6960102930 msgr2=0x7f6960199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f695e000640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6960102930 0x7f6960199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f695e000640 1 -- 172.21.15.110:0/3082924927 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960108940 msgr2=0x7f696019d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f695e000640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960108940 0x7f696019d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f695e000640 1 -- 172.21.15.110:0/3082924927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696019e060 con 0x7f69601032f0 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f695ea00640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6960102930 0x7f6960199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f695e000640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 0x7f69601995b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f694800e9f0 tx=0x7f694800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f6957400640 1 -- 172.21.15.110:0/3082924927 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694800cd80 con 0x7f69601032f0 2024-04-26T11:32:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f6957400640 1 -- 172.21.15.110:0/3082924927 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69480108e0 con 0x7f69601032f0 2024-04-26T11:32:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f6965800640 1 -- 172.21.15.110:0/3082924927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696019e350 con 0x7f69601032f0 2024-04-26T11:32:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.840+0000 7f6957400640 1 -- 172.21.15.110:0/3082924927 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948018980 con 0x7f69601032f0 2024-04-26T11:32:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.841+0000 7f6965800640 1 -- 172.21.15.110:0/3082924927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69601a5be0 con 0x7f69601032f0 2024-04-26T11:32:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.844+0000 7f6968589740 1 Processor -- start 2024-04-26T11:32:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.844+0000 7f6957400640 1 -- 172.21.15.110:0/3082924927 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 25) ==== 138880+0+0 (secure 0 0 0) 0x7f6948010430 con 0x7f69601032f0 2024-04-26T11:32:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.844+0000 7f6968589740 1 -- start start 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.844+0000 7f6968589740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.844+0000 7f6968589740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.844+0000 7f6968589740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e1627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.844+0000 7f6968589740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56410e0b6380 con 0x56410e151630 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.844+0000 7f6968589740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56410e052c30 con 0x56410e1603c0 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.844+0000 7f6968589740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56410e0b2340 con 0x56410e150d10 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40394/0 (socket says 172.21.15.110:40394) 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695ea00640 1 -- 172.21.15.110:0/19289695 learned_addr learned my addr 172.21.15.110:0/19289695 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695e000640 1 --2- 172.21.15.110:0/19289695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e1627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695ea00640 1 -- 172.21.15.110:0/19289695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 msgr2=0x56410e1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695ea00640 1 --2- 172.21.15.110:0/19289695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695ea00640 1 -- 172.21.15.110:0/19289695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 msgr2=0x56410e1627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695ea00640 1 --2- 172.21.15.110:0/19289695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e1627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695ea00640 1 -- 172.21.15.110:0/19289695 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56410e074940 con 0x56410e151630 2024-04-26T11:32:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f6957400640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f69440a3ee0 0x7f69440a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.845+0000 7f695ea00640 1 --2- 172.21.15.110:0/19289695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15fe80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6950009a50 tx=0x7f695000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796bbb84ba1b083d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.846+0000 7f6957400640 1 -- 172.21.15.110:0/3082924927 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f69480d0e90 con 0x7f69601032f0 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.846+0000 7f694fe00640 1 -- 172.21.15.110:0/19289695 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950004b20 con 0x56410e151630 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.846+0000 7f694fe00640 1 -- 172.21.15.110:0/19289695 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6950004cc0 con 0x56410e151630 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.846+0000 7f694fe00640 1 -- 172.21.15.110:0/19289695 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950005840 con 0x56410e151630 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.846+0000 7f695f400640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f69440a3ee0 0x7f69440a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 -- 172.21.15.110:0/19289695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 msgr2=0x56410e15fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f695f400640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f69440a3ee0 0x7f69440a63a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69580057c0 tx=0x7f695802c040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 --2- 172.21.15.110:0/19289695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15fe80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6950009a50 tx=0x7f695000ec30 comp rx=0 tx=0).stop 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 -- 172.21.15.110:0/19289695 shutdown_connections 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 --2- 172.21.15.110:0/19289695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e1627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 --2- 172.21.15.110:0/19289695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15fe80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 --2- 172.21.15.110:0/19289695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 -- 172.21.15.110:0/19289695 >> 172.21.15.110:0/19289695 conn(0x56410e14d2e0 msgr2=0x56410e14d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 -- 172.21.15.110:0/19289695 shutdown_connections 2024-04-26T11:32:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 -- 172.21.15.110:0/19289695 wait complete. 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 -- start start 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.847+0000 7f6968589740 1 Processor -- start 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f6968589740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f6968589740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f6968589740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f6968589740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56410e162f90 con 0x56410e151630 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f6968589740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56410e03dc60 con 0x56410e1603c0 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f6968589740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56410e163110 con 0x56410e150d10 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f6968589740 10 client.0 _ll_register_callbacks cb 0x56410e069e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f695e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f695ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f695ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:44736/0 (socket says 172.21.15.110:44736) 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f695ea00640 1 -- 172.21.15.110:0/3017367053 learned_addr learned my addr 172.21.15.110:0/3017367053 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f695e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40408/0 (socket says 172.21.15.110:40408) 2024-04-26T11:32:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.848+0000 7f695f400640 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f695ea00640 1 -- 172.21.15.110:0/3017367053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 msgr2=0x56410e15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f695ea00640 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f695ea00640 1 -- 172.21.15.110:0/3017367053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 msgr2=0x56410e15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f695ea00640 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f695ea00640 1 -- 172.21.15.110:0/3017367053 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56410e04c510 con 0x56410e150d10 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f695f400640 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f695e000640 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f695ea00640 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15d2d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6950006010 tx=0x7f6950009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b9ef674741291d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f694cc00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f694cc00640 1 -- 172.21.15.110:0/3017367053 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950025030 con 0x56410e150d10 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f6968589740 1 -- 172.21.15.110:0/3017367053 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6950004cc0 con 0x56410e150d10 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.849+0000 7f694cc00640 1 -- 172.21.15.110:0/3017367053 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f695001d050 con 0x56410e150d10 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f694cc00640 1 -- 172.21.15.110:0/3017367053 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6950031050 con 0x56410e150d10 2024-04-26T11:32:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f6968589740 10 client.25357 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f6968589740 1 -- 172.21.15.110:0/3017367053 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56410ddc8210 con 0x56410e150d10 2024-04-26T11:32:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f694cc00640 1 -- 172.21.15.110:0/3017367053 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6950004cc0 con 0x56410e150d10 2024-04-26T11:32:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f694cc00640 1 -- 172.21.15.110:0/3017367053 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f695000b040 con 0x56410e150d10 2024-04-26T11:32:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f6968589740 10 client.25357 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f6968589740 10 client.25357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f6968589740 20 client.25357 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f6968589740 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56410e170040 0x56410e172430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f6968589740 4 client.25357 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.850+0000 7f6968589740 1 -- 172.21.15.110:0/3017367053 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56410e0c3f90 con 0x56410e170040 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.851+0000 7f695e000640 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56410e170040 0x56410e172430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.851+0000 7f695e000640 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56410e170040 0x56410e172430 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=302932ef00f9bac9 server_cookie=4c44ee1251c19dae in_seq=0 out_seq=0 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.851+0000 7f694cc00640 10 client.25357 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f694cc00640 1 -- 172.21.15.110:0/3017367053 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56410e0c3f90 con 0x56410e170040 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f694cc00640 10 client.25357 handle_command_reply: tid=0 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 client.25357 shutdown 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 -- 172.21.15.110:0/3017367053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 msgr2=0x56410e15d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15d2d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6950006010 tx=0x7f6950009c00 comp rx=0 tx=0).stop 2024-04-26T11:32:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 -- 172.21.15.110:0/3017367053 shutdown_connections 2024-04-26T11:32:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56410e170040 0x56410e172430 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 --2- 172.21.15.110:0/3017367053 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15d2d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 -- 172.21.15.110:0/3017367053 >> 172.21.15.110:0/3017367053 conn(0x56410e14d2e0 msgr2=0x56410e153060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f694cc00640 0 client.25357 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 -- 172.21.15.110:0/3017367053 shutdown_connections 2024-04-26T11:32:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.852+0000 7f6968589740 1 -- 172.21.15.110:0/3017367053 wait complete. 2024-04-26T11:32:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.853+0000 7f6968589740 20 client.25357 trim_cache size 0 max 16384 2024-04-26T11:32:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f6968589740 1 Processor -- start 2024-04-26T11:32:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f6968589740 1 -- start start 2024-04-26T11:32:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f6968589740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f6968589740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e14c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f6968589740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e16bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f6968589740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f69601aeee0 con 0x56410e151630 2024-04-26T11:32:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f6968589740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ac720 con 0x56410e1603c0 2024-04-26T11:32:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f6968589740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f69601aa570 con 0x56410e150d10 2024-04-26T11:32:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f695e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e14c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f695e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e14c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40412/0 (socket says 172.21.15.110:40412) 2024-04-26T11:32:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f695ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f695e000640 1 -- 172.21.15.110:0/3154931028 learned_addr learned my addr 172.21.15.110:0/3154931028 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.869+0000 7f695f400640 1 --2- 172.21.15.110:0/3154931028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e16bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f695ea00640 1 -- 172.21.15.110:0/3154931028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 msgr2=0x56410e16bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f695ea00640 1 --2- 172.21.15.110:0/3154931028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e16bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f695ea00640 1 -- 172.21.15.110:0/3154931028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 msgr2=0x56410e14c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f695ea00640 1 --2- 172.21.15.110:0/3154931028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e14c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f695ea00640 1 -- 172.21.15.110:0/3154931028 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56410de94620 con 0x56410e150d10 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f695f400640 1 --2- 172.21.15.110:0/3154931028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e16bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f695ea00640 1 --2- 172.21.15.110:0/3154931028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15fa00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f695000ec70 tx=0x7f69500095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=146c6c47e2c07b6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f694f400640 1 -- 172.21.15.110:0/3154931028 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950025040 con 0x56410e150d10 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f694f400640 1 -- 172.21.15.110:0/3154931028 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6950009360 con 0x56410e150d10 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.870+0000 7f694f400640 1 -- 172.21.15.110:0/3154931028 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69500051f0 con 0x56410e150d10 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 -- 172.21.15.110:0/3154931028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 msgr2=0x56410e15fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 --2- 172.21.15.110:0/3154931028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15fa00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f695000ec70 tx=0x7f69500095e0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 -- 172.21.15.110:0/3154931028 shutdown_connections 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 --2- 172.21.15.110:0/3154931028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e1603c0 0x56410e16bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 --2- 172.21.15.110:0/3154931028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e151630 0x56410e14c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 --2- 172.21.15.110:0/3154931028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e15fa00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 -- 172.21.15.110:0/3154931028 >> 172.21.15.110:0/3154931028 conn(0x56410e14d2e0 msgr2=0x56410e15c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 -- 172.21.15.110:0/3154931028 shutdown_connections 2024-04-26T11:32:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 -- 172.21.15.110:0/3154931028 wait complete. 2024-04-26T11:32:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.871+0000 7f6968589740 1 -- start start 2024-04-26T11:32:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f6968589740 1 Processor -- start 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f6968589740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e168780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f6968589740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e151630 0x56410e159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f6968589740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e1603c0 0x56410e15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f6968589740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f69601aabe0 con 0x56410e1603c0 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f6968589740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ac050 con 0x56410e151630 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f6968589740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f69601ab2b0 con 0x56410e150d10 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f6968589740 10 client.0 _ll_register_callbacks cb 0x7f69480d47f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f695f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e1603c0 0x56410e15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.872+0000 7f695ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e168780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f695f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e1603c0 0x56410e15a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40416/0 (socket says 172.21.15.110:40416) 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f695f400640 1 -- 172.21.15.110:0/3443251353 learned_addr learned my addr 172.21.15.110:0/3443251353 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f695e000640 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e151630 0x56410e159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f695ea00640 1 -- 172.21.15.110:0/3443251353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e151630 msgr2=0x56410e159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f695ea00640 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e151630 0x56410e159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f695ea00640 1 -- 172.21.15.110:0/3443251353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e1603c0 msgr2=0x56410e15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f695ea00640 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e1603c0 0x56410e15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f695ea00640 1 -- 172.21.15.110:0/3443251353 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56410e070cb0 con 0x56410e150d10 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f695ea00640 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e168780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6950003c10 tx=0x7f6950009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c516254b4d7f8354 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f694cc00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.873+0000 7f694cc00640 1 -- 172.21.15.110:0/3443251353 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950025040 con 0x56410e150d10 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f6968589740 1 -- 172.21.15.110:0/3443251353 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6950009360 con 0x56410e150d10 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f694cc00640 1 -- 172.21.15.110:0/3443251353 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6950002030 con 0x56410e150d10 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f694cc00640 1 -- 172.21.15.110:0/3443251353 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6950044050 con 0x56410e150d10 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f6968589740 10 client.25363 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f6968589740 1 -- 172.21.15.110:0/3443251353 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56410e1d6260 con 0x56410e150d10 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f694cc00640 1 -- 172.21.15.110:0/3443251353 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6950009360 con 0x56410e150d10 2024-04-26T11:32:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f694cc00640 1 -- 172.21.15.110:0/3443251353 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f695000b070 con 0x56410e150d10 2024-04-26T11:32:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f6968589740 10 client.25363 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f6968589740 10 client.25363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:32:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f6968589740 20 client.25363 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f6968589740 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56410e1d6810 0x56410e1d8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f6968589740 4 client.25363 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:32:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.874+0000 7f6968589740 1 -- 172.21.15.110:0/3443251353 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56410e0bde00 con 0x56410e1d6810 2024-04-26T11:32:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.875+0000 7f695e000640 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56410e1d6810 0x56410e1d8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.876+0000 7f695e000640 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56410e1d6810 0x56410e1d8c30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a993066941dfc9 server_cookie=10ac3979f3325e05 in_seq=0 out_seq=0 2024-04-26T11:32:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.876+0000 7f694cc00640 10 client.25363 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.907+0000 7f694cc00640 1 -- 172.21.15.110:0/3443251353 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56410e0bde00 con 0x56410e1d6810 2024-04-26T11:32:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.907+0000 7f694cc00640 10 client.25363 handle_command_reply: tid=0 2024-04-26T11:32:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.907+0000 7f6968589740 1 client.25363 shutdown 2024-04-26T11:32:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.907+0000 7f6968589740 1 -- 172.21.15.110:0/3443251353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 msgr2=0x56410e168780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.907+0000 7f6968589740 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e168780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6950003c10 tx=0x7f6950009f70 comp rx=0 tx=0).stop 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f6968589740 1 -- 172.21.15.110:0/3443251353 shutdown_connections 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f6968589740 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56410e1603c0 0x56410e15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f6968589740 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56410e151630 0x56410e159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f6968589740 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56410e1d6810 0x56410e1d8c30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f6968589740 1 --2- 172.21.15.110:0/3443251353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56410e150d10 0x56410e168780 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f694cc00640 0 client.25363 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f6968589740 1 -- 172.21.15.110:0/3443251353 >> 172.21.15.110:0/3443251353 conn(0x56410e14d2e0 msgr2=0x56410e1526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f6968589740 1 -- 172.21.15.110:0/3443251353 shutdown_connections 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f6968589740 1 -- 172.21.15.110:0/3443251353 wait complete. 2024-04-26T11:32:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.908+0000 7f6968589740 20 client.25363 trim_cache size 0 max 16384 2024-04-26T11:32:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:32:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:32:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:32:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 -- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f69440a3ee0 msgr2=0x7f69440a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f69440a3ee0 0x7f69440a63a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69580057c0 tx=0x7f695802c040 comp rx=0 tx=0).stop 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 -- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 msgr2=0x7f69601995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 0x7f69601995b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f694800e9f0 tx=0x7f694800eeb0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 -- 172.21.15.110:0/3082924927 shutdown_connections 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f69440a3ee0 0x7f69440a63a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6960108940 0x7f696019d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69601032f0 0x7f69601995b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 --2- 172.21.15.110:0/3082924927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6960102930 0x7f6960199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 -- 172.21.15.110:0/3082924927 >> 172.21.15.110:0/3082924927 conn(0x7f69600fe3c0 msgr2=0x7f69600fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 -- 172.21.15.110:0/3082924927 shutdown_connections 2024-04-26T11:32:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:39.909+0000 7f6965800640 1 -- 172.21.15.110:0/3082924927 wait complete. 2024-04-26T11:32:39.925 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 25.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:32:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:41 smithi196 ceph-mon[32572]: pgmap v45: 97 pgs: 97 active+clean; 947 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-04-26T11:32:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:41 smithi110 ceph-mon[28069]: pgmap v45: 97 pgs: 97 active+clean; 947 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-04-26T11:32:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:41 smithi193 ceph-mon[32782]: pgmap v45: 97 pgs: 97 active+clean; 947 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-04-26T11:32:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:43 smithi196 ceph-mon[32572]: pgmap v46: 97 pgs: 97 active+clean; 947 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-04-26T11:32:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:43 smithi110 ceph-mon[28069]: pgmap v46: 97 pgs: 97 active+clean; 947 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-04-26T11:32:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:43 smithi193 ceph-mon[32782]: pgmap v46: 97 pgs: 97 active+clean; 947 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 1.8 MiB/s wr, 174 op/s 2024-04-26T11:32:44.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 30.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:32:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:45 smithi196 ceph-mon[32572]: pgmap v47: 97 pgs: 97 active+clean; 943 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 1.8 MiB/s wr, 185 op/s 2024-04-26T11:32:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:45 smithi110 ceph-mon[28069]: pgmap v47: 97 pgs: 97 active+clean; 943 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 1.8 MiB/s wr, 185 op/s 2024-04-26T11:32:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:45 smithi193 ceph-mon[32782]: pgmap v47: 97 pgs: 97 active+clean; 943 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 1.8 MiB/s wr, 185 op/s 2024-04-26T11:32:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:47 smithi196 ceph-mon[32572]: pgmap v48: 97 pgs: 97 active+clean; 943 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 909 KiB/s wr, 24 op/s 2024-04-26T11:32:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:47 smithi110 ceph-mon[28069]: pgmap v48: 97 pgs: 97 active+clean; 943 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 909 KiB/s wr, 24 op/s 2024-04-26T11:32:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:47 smithi193 ceph-mon[32782]: pgmap v48: 97 pgs: 97 active+clean; 943 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 909 KiB/s wr, 24 op/s 2024-04-26T11:32:47.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:32:48.433 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:32:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:49 smithi196 ceph-mon[32572]: pgmap v49: 97 pgs: 97 active+clean; 943 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 82 op/s 2024-04-26T11:32:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:49 smithi196 ceph-mon[32572]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-26T11:32:49.509 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:49 smithi110 ceph-mon[28069]: pgmap v49: 97 pgs: 97 active+clean; 943 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 82 op/s 2024-04-26T11:32:49.509 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:49 smithi110 ceph-mon[28069]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-26T11:32:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:49 smithi193 ceph-mon[32782]: pgmap v49: 97 pgs: 97 active+clean; 943 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 82 op/s 2024-04-26T11:32:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:49 smithi193 ceph-mon[32782]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-26T11:32:49.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 35.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.917+0000 7f46b3200700 1 -- 172.21.15.110:0/2165115109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4075740 msgr2=0x7f46b4075b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.917+0000 7f46b3200700 1 --2- 172.21.15.110:0/2165115109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4075740 0x7f46b4075b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009990 tx=0x7f46a4009ca0 comp rx=0 tx=0).stop 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.917+0000 7f46b3200700 1 -- 172.21.15.110:0/2165115109 shutdown_connections 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.917+0000 7f46b3200700 1 --2- 172.21.15.110:0/2165115109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46b410fc00 0x7f46b4111ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.917+0000 7f46b3200700 1 --2- 172.21.15.110:0/2165115109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4075740 0x7f46b4075b20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.917+0000 7f46b3200700 1 --2- 172.21.15.110:0/2165115109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46b4076060 0x7f46b410f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.917+0000 7f46b3200700 1 -- 172.21.15.110:0/2165115109 >> 172.21.15.110:0/2165115109 conn(0x7f46b40fee30 msgr2=0x7f46b4101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.917+0000 7f46b3200700 1 -- 172.21.15.110:0/2165115109 shutdown_connections 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.917+0000 7f46b3200700 1 -- 172.21.15.110:0/2165115109 wait complete. 2024-04-26T11:32:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.918+0000 7f46b3200700 1 Processor -- start 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.918+0000 7f46b3200700 1 -- start start 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.918+0000 7f46b3200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46b4075740 0x7f46b41a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.918+0000 7f46b3200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4076060 0x7f46b41a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.918+0000 7f46b3200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46b410fc00 0x7f46b419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b3200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4115730 con 0x7f46b4075740 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b3200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41155b0 con 0x7f46b4076060 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b3200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41158b0 con 0x7f46b410fc00 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4076060 0x7f46b41a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46b4075740 0x7f46b41a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4076060 0x7f46b41a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:32836/0 (socket says 172.21.15.110:32836) 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46b4075740 0x7f46b41a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41344/0 (socket says 172.21.15.110:41344) 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1400700 1 -- 172.21.15.110:0/2177696259 learned_addr learned my addr 172.21.15.110:0/2177696259 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b2800700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46b410fc00 0x7f46b419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:50.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1400700 1 -- 172.21.15.110:0/2177696259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46b410fc00 msgr2=0x7f46b419ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1400700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46b410fc00 0x7f46b419ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1400700 1 -- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46b4075740 msgr2=0x7f46b41a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1400700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46b4075740 0x7f46b41a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1400700 1 -- 172.21.15.110:0/2177696259 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b419c1d0 con 0x7f46b4076060 2024-04-26T11:32:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.919+0000 7f46b1e00700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46b4075740 0x7f46b41a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.920+0000 7f46b1400700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4076060 0x7f46b41a1df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46a000e9a0 tx=0x7f46a000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.920+0000 7f46aaa00700 1 -- 172.21.15.110:0/2177696259 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a000ca10 con 0x7f46b4076060 2024-04-26T11:32:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.920+0000 7f46aaa00700 1 -- 172.21.15.110:0/2177696259 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46a000cbb0 con 0x7f46b4076060 2024-04-26T11:32:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.920+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b419c4c0 con 0x7f46b4076060 2024-04-26T11:32:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.920+0000 7f46aaa00700 1 -- 172.21.15.110:0/2177696259 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0018680 con 0x7f46b4076060 2024-04-26T11:32:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.920+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b41a8780 con 0x7f46b4076060 2024-04-26T11:32:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.921+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b406a110 con 0x7f46b4076060 2024-04-26T11:32:50.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.924+0000 7f46aaa00700 1 -- 172.21.15.110:0/2177696259 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f46a0010430 con 0x7f46b4076060 2024-04-26T11:32:50.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.926+0000 7f46aaa00700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f46980a3db0 0x7f46980a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:50.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.926+0000 7f46aaa00700 1 -- 172.21.15.110:0/2177696259 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f46a00d0d90 con 0x7f46b4076060 2024-04-26T11:32:50.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.926+0000 7f46b1e00700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f46980a3db0 0x7f46980a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:50.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.927+0000 7f46b1e00700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f46980a3db0 0x7f46980a6270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f46b419cbb0 tx=0x7f46a400b260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:50.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:50.927+0000 7f46aaa00700 1 -- 172.21.15.110:0/2177696259 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f46a009d350 con 0x7f46b4076060 2024-04-26T11:32:51.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.202+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46b402e490 con 0x7f46b4076060 2024-04-26T11:32:51.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.204+0000 7f46aaa00700 1 -- 172.21.15.110:0/2177696259 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11896 (secure 0 0 0) 0x7f46a009cc50 con 0x7f46b4076060 2024-04-26T11:32:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:51.205 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:32:17.630171+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24487,24502]},"id":1}]} 2024-04-26T11:32:51.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f46980a3db0 msgr2=0x7f46980a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:51.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f46980a3db0 0x7f46980a6270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f46b419cbb0 tx=0x7f46a400b260 comp rx=0 tx=0).stop 2024-04-26T11:32:51.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4076060 msgr2=0x7f46b41a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:51.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4076060 0x7f46b41a1df0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46a000e9a0 tx=0x7f46a000ecb0 comp rx=0 tx=0).stop 2024-04-26T11:32:51.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 shutdown_connections 2024-04-26T11:32:51.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f46980a3db0 0x7f46980a6270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:51.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46b410fc00 0x7f46b419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:51.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46b4075740 0x7f46b41a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:51.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 --2- 172.21.15.110:0/2177696259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46b4076060 0x7f46b41a1df0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:51.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 >> 172.21.15.110:0/2177696259 conn(0x7f46b40fee30 msgr2=0x7f46b40ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:51.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 shutdown_connections 2024-04-26T11:32:51.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:51.207+0000 7f46b3200700 1 -- 172.21.15.110:0/2177696259 wait complete. 2024-04-26T11:32:51.209 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2024-04-26T11:32:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:51 smithi196 ceph-mon[32572]: pgmap v50: 97 pgs: 97 active+clean; 943 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 68 op/s 2024-04-26T11:32:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:51 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2177696259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:32:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:51 smithi110 ceph-mon[28069]: pgmap v50: 97 pgs: 97 active+clean; 943 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 68 op/s 2024-04-26T11:32:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:51 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2177696259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:32:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:51 smithi193 ceph-mon[32782]: pgmap v50: 97 pgs: 97 active+clean; 943 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 68 op/s 2024-04-26T11:32:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:51 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2177696259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:32:52.189 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db --set-id d509ee23 --release --await' 2024-04-26T11:32:52.189 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db --set-id d509ee23 --release --await 2024-04-26T11:32:52.633 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:32:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.058+0000 7f0457e00640 1 -- 172.21.15.110:0/4191580512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045010f1f0 msgr2=0x7f04501115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.058+0000 7f0457e00640 1 --2- 172.21.15.110:0/4191580512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045010f1f0 0x7f04501115e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0448009ca0 tx=0x7f044802a8c0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.058+0000 7f0457e00640 1 -- 172.21.15.110:0/4191580512 shutdown_connections 2024-04-26T11:32:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.059+0000 7f0457e00640 1 --2- 172.21.15.110:0/4191580512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045010f1f0 0x7f04501115e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.059+0000 7f0457e00640 1 --2- 172.21.15.110:0/4191580512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f045006b6a0 0x7f045006bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.059+0000 7f0457e00640 1 --2- 172.21.15.110:0/4191580512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0450103810 0x7f045006b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.059+0000 7f0457e00640 1 -- 172.21.15.110:0/4191580512 >> 172.21.15.110:0/4191580512 conn(0x7f0450077560 msgr2=0x7f0450077970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.059+0000 7f0457e00640 1 -- 172.21.15.110:0/4191580512 shutdown_connections 2024-04-26T11:32:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.059+0000 7f0457e00640 1 -- 172.21.15.110:0/4191580512 wait complete. 2024-04-26T11:32:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.060+0000 7f0457e00640 1 Processor -- start 2024-04-26T11:32:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.060+0000 7f0457e00640 1 -- start start 2024-04-26T11:32:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0457e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045006b6a0 0x7f045019b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0457e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0450103810 0x7f045019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0457e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f045010f1f0 0x7f045019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0457e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0450114da0 con 0x7f045010f1f0 2024-04-26T11:32:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0457e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0450114c20 con 0x7f045006b6a0 2024-04-26T11:32:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0457e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0450114f20 con 0x7f0450103810 2024-04-26T11:32:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0455e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f045010f1f0 0x7f045019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0455400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045006b6a0 0x7f045019b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0455e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f045010f1f0 0x7f045019fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42652/0 (socket says 172.21.15.110:42652) 2024-04-26T11:32:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0455400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045006b6a0 0x7f045019b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:42988/0 (socket says 172.21.15.110:42988) 2024-04-26T11:32:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.061+0000 7f0455e00640 1 -- 172.21.15.110:0/496798355 learned_addr learned my addr 172.21.15.110:0/496798355 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f0455400640 1 -- 172.21.15.110:0/496798355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0450103810 msgr2=0x7f045019b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f0455400640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0450103810 0x7f045019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f0455400640 1 -- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f045010f1f0 msgr2=0x7f045019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f0455400640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f045010f1f0 0x7f045019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f0455400640 1 -- 172.21.15.110:0/496798355 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04501a0210 con 0x7f045006b6a0 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f0455e00640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f045010f1f0 0x7f045019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f0455400640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045006b6a0 0x7f045019b220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f044400e9f0 tx=0x7f044400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f044e000640 1 -- 172.21.15.110:0/496798355 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044400ccc0 con 0x7f045006b6a0 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f044e000640 1 -- 172.21.15.110:0/496798355 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04440108e0 con 0x7f045006b6a0 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f044e000640 1 -- 172.21.15.110:0/496798355 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444018880 con 0x7f045006b6a0 2024-04-26T11:32:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f0457e00640 1 -- 172.21.15.110:0/496798355 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04501a0500 con 0x7f045006b6a0 2024-04-26T11:32:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.062+0000 7f0457e00640 1 -- 172.21.15.110:0/496798355 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04501a7d90 con 0x7f045006b6a0 2024-04-26T11:32:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.066+0000 7f045abc1740 1 Processor -- start 2024-04-26T11:32:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.066+0000 7f045abc1740 1 -- start start 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.066+0000 7f044e000640 1 -- 172.21.15.110:0/496798355 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0444010430 con 0x7f045006b6a0 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.066+0000 7f045abc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1cdd0 0x556b67e1d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.066+0000 7f045abc1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1d6f0 0x556b67e27a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.066+0000 7f045abc1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e27fb0 0x556b67e2a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.066+0000 7f045abc1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556b67d82380 con 0x556b67e27fb0 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.066+0000 7f045abc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556b67d1ec30 con 0x556b67e1cdd0 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.066+0000 7f045abc1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556b67d7e340 con 0x556b67e1d6f0 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1cdd0 0x556b67e1d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1cdd0 0x556b67e1d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:42998/0 (socket says 172.21.15.110:42998) 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455e00640 1 -- 172.21.15.110:0/3755098459 learned_addr learned my addr 172.21.15.110:0/3755098459 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455400640 1 --2- 172.21.15.110:0/3755098459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1d6f0 0x556b67e27a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0454a00640 1 --2- 172.21.15.110:0/3755098459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e27fb0 0x556b67e2a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455e00640 1 -- 172.21.15.110:0/3755098459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1d6f0 msgr2=0x556b67e27a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455e00640 1 --2- 172.21.15.110:0/3755098459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1d6f0 0x556b67e27a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455e00640 1 -- 172.21.15.110:0/3755098459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e27fb0 msgr2=0x556b67e2a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455e00640 1 --2- 172.21.15.110:0/3755098459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e27fb0 0x556b67e2a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455e00640 1 -- 172.21.15.110:0/3755098459 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b67d40940 con 0x556b67e1cdd0 2024-04-26T11:32:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.067+0000 7f0455e00640 1 --2- 172.21.15.110:0/3755098459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1cdd0 0x556b67e1d1b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f044802f310 tx=0x7f044802f340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=926be8340b061cc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.068+0000 7f044e000640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f04380a3e40 0x7f04380a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.068+0000 7f0442600640 1 -- 172.21.15.110:0/3755098459 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448031450 con 0x556b67e1cdd0 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.068+0000 7f0442600640 1 -- 172.21.15.110:0/3755098459 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0448036040 con 0x556b67e1cdd0 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.068+0000 7f0442600640 1 -- 172.21.15.110:0/3755098459 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04480044a0 con 0x556b67e1cdd0 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.068+0000 7f044e000640 1 -- 172.21.15.110:0/496798355 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f04440d0b40 con 0x7f045006b6a0 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.068+0000 7f0455400640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f04380a3e40 0x7f04380a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.068+0000 7f045abc1740 1 -- 172.21.15.110:0/3755098459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1cdd0 msgr2=0x556b67e1d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.068+0000 7f045abc1740 1 --2- 172.21.15.110:0/3755098459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1cdd0 0x556b67e1d1b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f044802f310 tx=0x7f044802f340 comp rx=0 tx=0).stop 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f045abc1740 1 -- 172.21.15.110:0/3755098459 shutdown_connections 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f0455400640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f04380a3e40 0x7f04380a6300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04440ce2c0 tx=0x7f04440d4690 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f045abc1740 1 --2- 172.21.15.110:0/3755098459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e27fb0 0x556b67e2a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f045abc1740 1 --2- 172.21.15.110:0/3755098459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1d6f0 0x556b67e27a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f045abc1740 1 --2- 172.21.15.110:0/3755098459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1cdd0 0x556b67e1d1b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f045abc1740 1 -- 172.21.15.110:0/3755098459 >> 172.21.15.110:0/3755098459 conn(0x556b67e192e0 msgr2=0x556b67e196c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f045abc1740 1 -- 172.21.15.110:0/3755098459 shutdown_connections 2024-04-26T11:32:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f045abc1740 1 -- 172.21.15.110:0/3755098459 wait complete. 2024-04-26T11:32:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f045abc1740 1 -- start start 2024-04-26T11:32:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.069+0000 7f045abc1740 1 Processor -- start 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f045abc1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e24f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f045abc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e25470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f045abc1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 0x556b67e259b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f045abc1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556b67e2aa00 con 0x556b67e1cdd0 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f045abc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556b67d09c60 con 0x556b67e1d6f0 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f045abc1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556b67e2ab80 con 0x556b67e27fb0 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f045abc1740 10 client.0 _ll_register_callbacks cb 0x556b67d35e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f0455e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e24f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f0455e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e24f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42664/0 (socket says 172.21.15.110:42664) 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f0455e00640 1 -- 172.21.15.110:0/3120585459 learned_addr learned my addr 172.21.15.110:0/3120585459 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.070+0000 7f0454a00640 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e25470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0455e00640 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 0x556b67e259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0454a00640 1 -- 172.21.15.110:0/3120585459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 msgr2=0x556b67e259b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0454a00640 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 0x556b67e259b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0454a00640 1 -- 172.21.15.110:0/3120585459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 msgr2=0x556b67e24f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0454a00640 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e24f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0454a00640 1 -- 172.21.15.110:0/3120585459 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b67d18510 con 0x556b67e1d6f0 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0455e00640 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e24f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0454a00640 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e25470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556b67e1a470 tx=0x7f043c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=782e18e25410dc7e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0436a00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0436a00640 1 -- 172.21.15.110:0/3120585459 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c005020 con 0x556b67e1d6f0 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f045abc1740 1 -- 172.21.15.110:0/3120585459 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0448036040 con 0x556b67e1d6f0 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.071+0000 7f0436a00640 1 -- 172.21.15.110:0/3120585459 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f043c0051c0 con 0x556b67e1d6f0 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f0436a00640 1 -- 172.21.15.110:0/3120585459 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f043c0053c0 con 0x556b67e1d6f0 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f045abc1740 10 client.25355 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f045abc1740 1 -- 172.21.15.110:0/3120585459 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556b67a94210 con 0x556b67e1d6f0 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f0436a00640 1 -- 172.21.15.110:0/3120585459 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0448036040 con 0x556b67e1d6f0 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f0436a00640 1 -- 172.21.15.110:0/3120585459 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f043c00e9a0 con 0x556b67e1d6f0 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f045abc1740 10 client.25355 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f045abc1740 10 client.25355 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f045abc1740 20 client.25355 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f045abc1740 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556b67e37c30 0x556b67e3a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f045abc1740 4 client.25355 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.072+0000 7f045abc1740 1 -- 172.21.15.110:0/3120585459 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b67d8ff90 con 0x556b67e37c30 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.073+0000 7f0455e00640 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556b67e37c30 0x556b67e3a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.073+0000 7f0455e00640 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556b67e37c30 0x556b67e3a060 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14465b11dcf0dfa7 server_cookie=5f71d9995943db5f in_seq=0 out_seq=0 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.073+0000 7f0436a00640 10 client.25355 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f0436a00640 1 -- 172.21.15.110:0/3120585459 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556b67d8ff90 con 0x556b67e37c30 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f0436a00640 10 client.25355 handle_command_reply: tid=0 2024-04-26T11:32:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f045abc1740 1 client.25355 shutdown 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f045abc1740 1 -- 172.21.15.110:0/3120585459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 msgr2=0x556b67e25470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f045abc1740 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e25470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556b67e1a470 tx=0x7f043c0118d0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f045abc1740 1 -- 172.21.15.110:0/3120585459 shutdown_connections 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f045abc1740 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556b67e37c30 0x556b67e3a060 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f045abc1740 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 0x556b67e259b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f045abc1740 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e25470 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f045abc1740 1 --2- 172.21.15.110:0/3120585459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e24f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f045abc1740 1 -- 172.21.15.110:0/3120585459 >> 172.21.15.110:0/3120585459 conn(0x556b67e192e0 msgr2=0x556b67e1f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.074+0000 7f0436a00640 0 client.25355 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.075+0000 7f045abc1740 1 -- 172.21.15.110:0/3120585459 shutdown_connections 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.075+0000 7f045abc1740 1 -- 172.21.15.110:0/3120585459 wait complete. 2024-04-26T11:32:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.075+0000 7f045abc1740 20 client.25355 trim_cache size 0 max 16384 2024-04-26T11:32:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.091+0000 7f045abc1740 1 Processor -- start 2024-04-26T11:32:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.091+0000 7f045abc1740 1 -- start start 2024-04-26T11:32:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.091+0000 7f045abc1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1cdd0 0x556b67e338c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.091+0000 7f045abc1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1d6f0 0x556b67e3f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.091+0000 7f045abc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e27fb0 0x556b67e3ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.091+0000 7f045abc1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f04501b3210 con 0x556b67e1d6f0 2024-04-26T11:32:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.091+0000 7f045abc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04501b0a50 con 0x556b67e27fb0 2024-04-26T11:32:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.091+0000 7f045abc1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f04501ae8a0 con 0x556b67e1cdd0 2024-04-26T11:32:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0454a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1d6f0 0x556b67e3f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0454a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1d6f0 0x556b67e3f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42668/0 (socket says 172.21.15.110:42668) 2024-04-26T11:32:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0454a00640 1 -- 172.21.15.110:0/233018092 learned_addr learned my addr 172.21.15.110:0/233018092 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0455e00640 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1cdd0 0x556b67e338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0455e00640 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e27fb0 0x556b67e3ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0454a00640 1 -- 172.21.15.110:0/233018092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1cdd0 msgr2=0x556b67e338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0454a00640 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1cdd0 0x556b67e338c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0454a00640 1 -- 172.21.15.110:0/233018092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e27fb0 msgr2=0x556b67e3ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0454a00640 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e27fb0 0x556b67e3ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0454a00640 1 -- 172.21.15.110:0/233018092 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b67b60620 con 0x556b67e1d6f0 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0455e00640 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e27fb0 0x556b67e3ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.092+0000 7f0454a00640 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1d6f0 0x556b67e3f9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f043c004700 tx=0x7f043c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e4f9eaae14e8eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f0441c00640 1 -- 172.21.15.110:0/233018092 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c019410 con 0x556b67e1d6f0 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f0441c00640 1 -- 172.21.15.110:0/233018092 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f043c0195b0 con 0x556b67e1d6f0 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f0441c00640 1 -- 172.21.15.110:0/233018092 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c0216a0 con 0x556b67e1d6f0 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f045abc1740 1 -- 172.21.15.110:0/233018092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1d6f0 msgr2=0x556b67e3f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f045abc1740 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1d6f0 0x556b67e3f9c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f043c004700 tx=0x7f043c009510 comp rx=0 tx=0).stop 2024-04-26T11:32:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f045abc1740 1 -- 172.21.15.110:0/233018092 shutdown_connections 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f045abc1740 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e27fb0 0x556b67e3ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f045abc1740 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1d6f0 0x556b67e3f9c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f045abc1740 1 --2- 172.21.15.110:0/233018092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e1cdd0 0x556b67e338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.093+0000 7f045abc1740 1 -- 172.21.15.110:0/233018092 >> 172.21.15.110:0/233018092 conn(0x556b67e192e0 msgr2=0x556b67e20230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.094+0000 7f045abc1740 1 -- 172.21.15.110:0/233018092 shutdown_connections 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.094+0000 7f045abc1740 1 -- 172.21.15.110:0/233018092 wait complete. 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.094+0000 7f045abc1740 1 -- start start 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.094+0000 7f045abc1740 1 Processor -- start 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f045abc1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e2ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f045abc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e21740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f045abc1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 0x556b67e21c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f045abc1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f04501aef10 con 0x556b67e1cdd0 2024-04-26T11:32:53.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f045abc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04501b0380 con 0x556b67e1d6f0 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f045abc1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f04501af5e0 con 0x556b67e27fb0 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f045abc1740 10 client.0 _ll_register_callbacks cb 0x7f043c0096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0454a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e21740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0455e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e2ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0454a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e21740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43026/0 (socket says 172.21.15.110:43026) 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0454a00640 1 -- 172.21.15.110:0/1942307446 learned_addr learned my addr 172.21.15.110:0/1942307446 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0455e00640 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 0x556b67e21c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0454a00640 1 -- 172.21.15.110:0/1942307446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 msgr2=0x556b67e21c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0454a00640 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 0x556b67e21c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0454a00640 1 -- 172.21.15.110:0/1942307446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 msgr2=0x556b67e2ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0454a00640 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e2ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0454a00640 1 -- 172.21.15.110:0/1942307446 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b67d3ccb0 con 0x556b67e1d6f0 2024-04-26T11:32:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.095+0000 7f0455e00640 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 0x556b67e21c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:32:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.096+0000 7f0454a00640 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e21740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f043c000c00 tx=0x7f043c005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c7c5a28be1724da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.096+0000 7f0436a00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:32:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.096+0000 7f0436a00640 1 -- 172.21.15.110:0/1942307446 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c038060 con 0x556b67e1d6f0 2024-04-26T11:32:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.096+0000 7f0436a00640 1 -- 172.21.15.110:0/1942307446 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f043c00e940 con 0x556b67e1d6f0 2024-04-26T11:32:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.096+0000 7f045abc1740 1 -- 172.21.15.110:0/1942307446 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f043c0195b0 con 0x556b67e1d6f0 2024-04-26T11:32:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.096+0000 7f0436a00640 1 -- 172.21.15.110:0/1942307446 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f043c02f040 con 0x556b67e1d6f0 2024-04-26T11:32:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.096+0000 7f045abc1740 10 client.25361 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.096+0000 7f045abc1740 1 -- 172.21.15.110:0/1942307446 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556b67e9dd40 con 0x556b67e1d6f0 2024-04-26T11:32:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.097+0000 7f0436a00640 1 -- 172.21.15.110:0/1942307446 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f043c0195b0 con 0x556b67e1d6f0 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.097+0000 7f0436a00640 1 -- 172.21.15.110:0/1942307446 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f043c032070 con 0x556b67e1d6f0 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.097+0000 7f045abc1740 10 client.25361 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.097+0000 7f045abc1740 10 client.25361 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.097+0000 7f045abc1740 20 client.25361 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.097+0000 7f045abc1740 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556b67e9e2f0 0x556b67ea06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.097+0000 7f045abc1740 4 client.25361 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.097+0000 7f045abc1740 1 -- 172.21.15.110:0/1942307446 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556b67d89e00 con 0x556b67e9e2f0 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.097+0000 7f0455e00640 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556b67e9e2f0 0x556b67ea06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.098+0000 7f0455e00640 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556b67e9e2f0 0x556b67ea06e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98729c92b742e369 server_cookie=4bfcc7a9d13f09af in_seq=0 out_seq=0 2024-04-26T11:32:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.098+0000 7f0436a00640 10 client.25361 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.111+0000 7f0436a00640 1 -- 172.21.15.110:0/1942307446 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556b67d89e00 con 0x556b67e9e2f0 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.111+0000 7f0436a00640 10 client.25361 handle_command_reply: tid=0 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.111+0000 7f045abc1740 1 client.25361 shutdown 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 -- 172.21.15.110:0/1942307446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 msgr2=0x556b67e21740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e21740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f043c000c00 tx=0x7f043c005da0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 -- 172.21.15.110:0/1942307446 shutdown_connections 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556b67e9e2f0 0x556b67ea06e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556b67e27fb0 0x556b67e21c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556b67e1d6f0 0x556b67e21740 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 --2- 172.21.15.110:0/1942307446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b67e1cdd0 0x556b67e2ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f0436a00640 0 client.25361 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 -- 172.21.15.110:0/1942307446 >> 172.21.15.110:0/1942307446 conn(0x556b67e192e0 msgr2=0x556b67e23740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 -- 172.21.15.110:0/1942307446 shutdown_connections 2024-04-26T11:32:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 1 -- 172.21.15.110:0/1942307446 wait complete. 2024-04-26T11:32:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.112+0000 7f045abc1740 20 client.25361 trim_cache size 0 max 16384 2024-04-26T11:32:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:32:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:32:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:32:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:32:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 -- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f04380a3e40 msgr2=0x7f04380a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f04380a3e40 0x7f04380a6300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f04440ce2c0 tx=0x7f04440d4690 comp rx=0 tx=0).stop 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 -- 172.21.15.110:0/496798355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045006b6a0 msgr2=0x7f045019b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045006b6a0 0x7f045019b220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f044400e9f0 tx=0x7f044400eeb0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 -- 172.21.15.110:0/496798355 shutdown_connections 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f04380a3e40 0x7f04380a6300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f045010f1f0 0x7f045019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0450103810 0x7f045019b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 --2- 172.21.15.110:0/496798355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f045006b6a0 0x7f045019b220 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 -- 172.21.15.110:0/496798355 >> 172.21.15.110:0/496798355 conn(0x7f0450077560 msgr2=0x7f045010ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 -- 172.21.15.110:0/496798355 shutdown_connections 2024-04-26T11:32:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:32:53.113+0000 7f0457e00640 1 -- 172.21.15.110:0/496798355 wait complete. 2024-04-26T11:32:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:53 smithi196 ceph-mon[32572]: pgmap v51: 97 pgs: 97 active+clean; 943 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 68 op/s 2024-04-26T11:32:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:53 smithi110 ceph-mon[28069]: pgmap v51: 97 pgs: 97 active+clean; 943 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 68 op/s 2024-04-26T11:32:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:53 smithi193 ceph-mon[32782]: pgmap v51: 97 pgs: 97 active+clean; 943 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 68 op/s 2024-04-26T11:32:54.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 40.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:32:55.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.115+0000 7f6ce8200700 1 -- 172.21.15.110:0/3915369050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce01094c0 msgr2=0x7f6ce01098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:55.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.115+0000 7f6ce8200700 1 --2- 172.21.15.110:0/3915369050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce01094c0 0x7f6ce01098a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009990 tx=0x7f6cd4009ca0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.115+0000 7f6ce8200700 1 -- 172.21.15.110:0/3915369050 shutdown_connections 2024-04-26T11:32:55.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.115+0000 7f6ce8200700 1 --2- 172.21.15.110:0/3915369050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0103e30 0x7f6ce0110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.115+0000 7f6ce8200700 1 --2- 172.21.15.110:0/3915369050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce01094c0 0x7f6ce01098a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.115+0000 7f6ce8200700 1 --2- 172.21.15.110:0/3915369050 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ce0103470 0x7f6ce01038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.115+0000 7f6ce8200700 1 -- 172.21.15.110:0/3915369050 >> 172.21.15.110:0/3915369050 conn(0x7f6ce007a580 msgr2=0x7f6ce007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.115+0000 7f6ce8200700 1 -- 172.21.15.110:0/3915369050 shutdown_connections 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.115+0000 7f6ce8200700 1 -- 172.21.15.110:0/3915369050 wait complete. 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.116+0000 7f6ce8200700 1 Processor -- start 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.116+0000 7f6ce8200700 1 -- start start 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce8200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce0103470 0x7f6ce019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce8200700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0103e30 0x7f6ce019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce8200700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ce01094c0 0x7f6ce01a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce8200700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce0113640 con 0x7f6ce0103470 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce8200700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce01134c0 con 0x7f6ce0103e30 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce8200700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce01137c0 con 0x7f6ce01094c0 2024-04-26T11:32:55.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce0103470 0x7f6ce019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce0103470 0x7f6ce019be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42692/0 (socket says 172.21.15.110:42692) 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce5800700 1 -- 172.21.15.110:0/1106576581 learned_addr learned my addr 172.21.15.110:0/1106576581 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce4e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0103e30 0x7f6ce019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce6200700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ce01094c0 0x7f6ce01a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce4e00700 1 -- 172.21.15.110:0/1106576581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ce01094c0 msgr2=0x7f6ce01a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ce01094c0 0x7f6ce01a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce4e00700 1 -- 172.21.15.110:0/1106576581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce0103470 msgr2=0x7f6ce019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce0103470 0x7f6ce019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.117+0000 7f6ce4e00700 1 -- 172.21.15.110:0/1106576581 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce01a0e60 con 0x7f6ce0103e30 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.118+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0103e30 0x7f6ce019c390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00e9f0 tx=0x7f6ccc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.118+0000 7f6cde000700 1 -- 172.21.15.110:0/1106576581 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc004220 con 0x7f6ce0103e30 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.118+0000 7f6ce8200700 1 -- 172.21.15.110:0/1106576581 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce01a1150 con 0x7f6ce0103e30 2024-04-26T11:32:55.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.118+0000 7f6cde000700 1 -- 172.21.15.110:0/1106576581 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ccc0043c0 con 0x7f6ce0103e30 2024-04-26T11:32:55.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.118+0000 7f6cde000700 1 -- 172.21.15.110:0/1106576581 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc005020 con 0x7f6ce0103e30 2024-04-26T11:32:55.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.118+0000 7f6ce8200700 1 -- 172.21.15.110:0/1106576581 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce01a89d0 con 0x7f6ce0103e30 2024-04-26T11:32:55.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.121+0000 7f6cde000700 1 -- 172.21.15.110:0/1106576581 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6ccc004750 con 0x7f6ce0103e30 2024-04-26T11:32:55.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.123+0000 7f6cf2c6ab80 1 Processor -- start 2024-04-26T11:32:55.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.123+0000 7f6cde000700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6cc80a3db0 0x7f6cc80a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.123+0000 7f6cf2c6ab80 1 -- start start 2024-04-26T11:32:55.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.123+0000 7f6cde000700 1 -- 172.21.15.110:0/1106576581 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6ccc0d0870 con 0x7f6ce0103e30 2024-04-26T11:32:55.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.123+0000 7f6ce6200700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6cc80a3db0 0x7f6cc80a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.123+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c266f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c261340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c26d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a15c1b3990 con 0x55a15c260ee0 2024-04-26T11:32:55.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a15c1522b0 con 0x55a15c261880 2024-04-26T11:32:55.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a15c1af950 con 0x55a15c266bb0 2024-04-26T11:32:55.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce5800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c266f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce4e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c261340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce5800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c266f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39376/0 (socket says 172.21.15.110:39376) 2024-04-26T11:32:55.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce5800700 1 -- 172.21.15.110:0/3650002627 learned_addr learned my addr 172.21.15.110:0/3650002627 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:55.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce6200700 1 --2- 172.21.15.110:0/3650002627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c26d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce5800700 1 -- 172.21.15.110:0/3650002627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 msgr2=0x55a15c26d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:55.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce5800700 1 --2- 172.21.15.110:0/3650002627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c26d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce6200700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6cc80a3db0 0x7f6cc80a6270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800f590 tx=0x7f6cd800b040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:55.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce5800700 1 -- 172.21.15.110:0/3650002627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 msgr2=0x55a15c261340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:55.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce5800700 1 --2- 172.21.15.110:0/3650002627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c261340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.124+0000 7f6ce5800700 1 -- 172.21.15.110:0/3650002627 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15c15a730 con 0x55a15c266bb0 2024-04-26T11:32:55.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.125+0000 7f6ce5800700 1 --2- 172.21.15.110:0/3650002627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c266f90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40096d0 tx=0x7f6cd4009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a21f0c1dc02f4c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.125+0000 7f6cd2a00700 1 -- 172.21.15.110:0/3650002627 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4027070 con 0x55a15c266bb0 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.125+0000 7f6cd2a00700 1 -- 172.21.15.110:0/3650002627 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cd40056d0 con 0x55a15c266bb0 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.125+0000 7f6cd2a00700 1 -- 172.21.15.110:0/3650002627 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4003ce0 con 0x55a15c266bb0 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.126+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3650002627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 msgr2=0x55a15c266f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.126+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3650002627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c266f90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40096d0 tx=0x7f6cd4009700 comp rx=0 tx=0).stop 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.126+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3650002627 shutdown_connections 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.126+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3650002627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c26d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.126+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3650002627 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c266f90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.126+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3650002627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c261340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.126+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3650002627 >> 172.21.15.110:0/3650002627 conn(0x55a15c18e3f0 msgr2=0x55a15c25ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.126+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3650002627 shutdown_connections 2024-04-26T11:32:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.126+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3650002627 wait complete. 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.127+0000 7f6cf2c6ab80 1 -- start start 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.127+0000 7f6cf2c6ab80 1 Processor -- start 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.127+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c260ee0 0x55a15c26d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.127+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c26a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.127+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c26ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.127+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a15c26de40 con 0x55a15c266bb0 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.127+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a15c14e500 con 0x55a15c261880 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.127+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a15c26dfc0 con 0x55a15c260ee0 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6cf2c6ab80 10 client.0 _ll_register_callbacks cb 0x55a15c147480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce5800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c260ee0 0x55a15c26d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce6200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c26ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce4e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c26a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce5800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c260ee0 0x55a15c26d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39390/0 (socket says 172.21.15.110:39390) 2024-04-26T11:32:55.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce5800700 1 -- 172.21.15.110:0/1498547228 learned_addr learned my addr 172.21.15.110:0/1498547228 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce4e00700 1 -- 172.21.15.110:0/1498547228 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c260ee0 msgr2=0x55a15c26d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c260ee0 0x55a15c26d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce4e00700 1 -- 172.21.15.110:0/1498547228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 msgr2=0x55a15c26ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c26ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce4e00700 1 -- 172.21.15.110:0/1498547228 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15c1009d0 con 0x55a15c261880 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.128+0000 7f6ce6200700 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c26ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.129+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c26a7e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0cdee0 tx=0x7f6ccc09c610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=478606ccc239ec93 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.129+0000 7f6cc7400700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.129+0000 7f6cc7400700 1 -- 172.21.15.110:0/1498547228 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc01c040 con 0x55a15c261880 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.129+0000 7f6cc7400700 1 -- 172.21.15.110:0/1498547228 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6ccc09aa30 con 0x55a15c261880 2024-04-26T11:32:55.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.129+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/1498547228 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cd40056d0 con 0x55a15c261880 2024-04-26T11:32:55.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.129+0000 7f6cc7400700 1 -- 172.21.15.110:0/1498547228 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6ccc0a0ae0 con 0x55a15c261880 2024-04-26T11:32:55.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.129+0000 7f6cf2c6ab80 10 client.25373 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:55.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.129+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/1498547228 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a15c2785b0 con 0x55a15c261880 2024-04-26T11:32:55.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.130+0000 7f6cc7400700 1 -- 172.21.15.110:0/1498547228 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cd40056d0 con 0x55a15c261880 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.130+0000 7f6cc7400700 1 -- 172.21.15.110:0/1498547228 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f6ccc09c990 con 0x55a15c261880 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.130+0000 7f6cf2c6ab80 10 client.25373 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.130+0000 7f6cf2c6ab80 10 client.25373 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.130+0000 7f6cf2c6ab80 20 client.25373 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.130+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a15c27ac90 0x55a15c27d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.130+0000 7f6cf2c6ab80 4 client.25373 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.130+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/1498547228 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a15c1c1370 con 0x55a15c27ac90 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.131+0000 7f6ce5800700 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a15c27ac90 0x55a15c27d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.131+0000 7f6ce5800700 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a15c27ac90 0x55a15c27d0b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b41ab143b88b81a server_cookie=34cb708ddd67ec80 in_seq=0 out_seq=0 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.131+0000 7f6cc7400700 10 client.25373 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.132+0000 7f6cc7400700 1 -- 172.21.15.110:0/1498547228 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a15c1c1370 con 0x55a15c27ac90 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.132+0000 7f6cc7400700 10 client.25373 handle_command_reply: tid=0 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.132+0000 7f6cf2c6ab80 1 client.25373 shutdown 2024-04-26T11:32:55.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.132+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/1498547228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 msgr2=0x55a15c26a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.132+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c26a7e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0cdee0 tx=0x7f6ccc09c610 comp rx=0 tx=0).stop 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.132+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/1498547228 shutdown_connections 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.132+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a15c27ac90 0x55a15c27d0b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.133+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c26ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.133+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c260ee0 0x55a15c26d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.133+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/1498547228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c26a7e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.133+0000 7f6cc7400700 0 client.25373 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.133+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/1498547228 >> 172.21.15.110:0/1498547228 conn(0x55a15c18e3f0 msgr2=0x55a15c265ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.133+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/1498547228 shutdown_connections 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.133+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/1498547228 wait complete. 2024-04-26T11:32:55.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.133+0000 7f6cf2c6ab80 20 client.25373 trim_cache size 0 max 16384 2024-04-26T11:32:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6cf2c6ab80 1 Processor -- start 2024-04-26T11:32:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6cf2c6ab80 1 -- start start 2024-04-26T11:32:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c260ee0 0x55a15c269960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c261880 0x55a15c264eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c276c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce01b2b80 con 0x55a15c266bb0 2024-04-26T11:32:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce01b0380 con 0x55a15c260ee0 2024-04-26T11:32:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce01ae1d0 con 0x55a15c261880 2024-04-26T11:32:55.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6ce6200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c276c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6ce6200700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c276c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42710/0 (socket says 172.21.15.110:42710) 2024-04-26T11:32:55.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6ce6200700 1 -- 172.21.15.110:0/3802330157 learned_addr learned my addr 172.21.15.110:0/3802330157 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.155+0000 7f6ce5800700 1 --2- 172.21.15.110:0/3802330157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c260ee0 0x55a15c269960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.156+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/3802330157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c261880 0x55a15c264eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.156+0000 7f6ce6200700 1 -- 172.21.15.110:0/3802330157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c261880 msgr2=0x55a15c264eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.156+0000 7f6ce6200700 1 --2- 172.21.15.110:0/3802330157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c261880 0x55a15c264eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.156+0000 7f6ce6200700 1 -- 172.21.15.110:0/3802330157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c260ee0 msgr2=0x55a15c269960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.156+0000 7f6ce6200700 1 --2- 172.21.15.110:0/3802330157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c260ee0 0x55a15c269960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.156+0000 7f6ce6200700 1 -- 172.21.15.110:0/3802330157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15c27d710 con 0x55a15c266bb0 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.156+0000 7f6ce6200700 1 --2- 172.21.15.110:0/3802330157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c276c70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8008860 tx=0x7f6cd801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddc9f58e754c36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cd2000700 1 -- 172.21.15.110:0/3802330157 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd801d070 con 0x55a15c266bb0 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cd2000700 1 -- 172.21.15.110:0/3802330157 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cd8019d20 con 0x55a15c266bb0 2024-04-26T11:32:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cd2000700 1 -- 172.21.15.110:0/3802330157 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8017da0 con 0x55a15c266bb0 2024-04-26T11:32:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3802330157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 msgr2=0x55a15c276c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3802330157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c276c70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8008860 tx=0x7f6cd801c000 comp rx=0 tx=0).stop 2024-04-26T11:32:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3802330157 shutdown_connections 2024-04-26T11:32:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3802330157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c266bb0 0x55a15c276c70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3802330157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c260ee0 0x55a15c269960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3802330157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c261880 0x55a15c264eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.157+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3802330157 >> 172.21.15.110:0/3802330157 conn(0x55a15c18e3f0 msgr2=0x55a15c26c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.158+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3802330157 shutdown_connections 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.158+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3802330157 wait complete. 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.158+0000 7f6cf2c6ab80 1 -- start start 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.158+0000 7f6cf2c6ab80 1 Processor -- start 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c273390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c262470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6cf2c6ab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c2629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce01ae840 con 0x55a15c260ee0 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce01afcb0 con 0x55a15c261880 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6cf2c6ab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce01aef10 con 0x55a15c266bb0 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6cf2c6ab80 10 client.0 _ll_register_callbacks cb 0x55a15c147480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:32:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6ce5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c273390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6ce5800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c273390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42722/0 (socket says 172.21.15.110:42722) 2024-04-26T11:32:55.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6ce5800700 1 -- 172.21.15.110:0/3464814665 learned_addr learned my addr 172.21.15.110:0/3464814665 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:55.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6ce6200700 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c2629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.159+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c262470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6ce5800700 1 -- 172.21.15.110:0/3464814665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 msgr2=0x55a15c2629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6ce5800700 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c2629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6ce5800700 1 -- 172.21.15.110:0/3464814665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 msgr2=0x55a15c262470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6ce5800700 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c262470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6ce5800700 1 -- 172.21.15.110:0/3464814665 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15c262ff0 con 0x55a15c260ee0 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6ce5800700 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c273390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4003890 tx=0x7f6cd4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d2235d60d8d3a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6cc7400700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6cc7400700 1 -- 172.21.15.110:0/3464814665 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4036060 con 0x55a15c260ee0 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6cc7400700 1 -- 172.21.15.110:0/3464814665 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6cd4003b30 con 0x55a15c260ee0 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.160+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3464814665 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cd8019d20 con 0x55a15c260ee0 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cc7400700 1 -- 172.21.15.110:0/3464814665 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6cd4027040 con 0x55a15c260ee0 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cf2c6ab80 10 client.15282 fetch_fsmap learned FSMap version 30 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3464814665 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a15c2e2220 con 0x55a15c260ee0 2024-04-26T11:32:55.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cc7400700 1 -- 172.21.15.110:0/3464814665 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cd8019d20 con 0x55a15c260ee0 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cc7400700 1 -- 172.21.15.110:0/3464814665 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f6cd4021070 con 0x55a15c260ee0 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cf2c6ab80 10 client.15282 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cf2c6ab80 10 client.15282 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cf2c6ab80 20 client.15282 populate_metadata read hostname 'smithi110' 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a15c2e23f0 0x55a15c2e47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cf2c6ab80 4 client.15282 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d509ee23", "release": true, "await": true}] 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.161+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3464814665 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d509ee23", "release": true, "await": true}) -- 0x55a15c1bb410 con 0x55a15c2e23f0 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.162+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a15c2e23f0 0x55a15c2e47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.162+0000 7f6ce4e00700 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a15c2e23f0 0x55a15c2e47e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58ed20f58c6a8947 server_cookie=6e2fd3c4d332bf37 in_seq=0 out_seq=0 2024-04-26T11:32:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.162+0000 7f6cc7400700 10 client.15282 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:55.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.188+0000 7f6cc7400700 1 -- 172.21.15.110:0/3464814665 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55a15c1bb410 con 0x55a15c2e23f0 2024-04-26T11:32:55.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.188+0000 7f6cc7400700 10 client.15282 handle_command_reply: tid=0 2024-04-26T11:32:55.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.188+0000 7f6cf2c6ab80 1 client.15282 shutdown 2024-04-26T11:32:55.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.189+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3464814665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 msgr2=0x55a15c273390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:55.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.189+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c273390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4003890 tx=0x7f6cd4009310 comp rx=0 tx=0).stop 2024-04-26T11:32:55.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.189+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3464814665 shutdown_connections 2024-04-26T11:32:55.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.189+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a15c2e23f0 0x55a15c2e47e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.189+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a15c266bb0 0x55a15c2629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.189+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a15c260ee0 0x55a15c273390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.189+0000 7f6cf2c6ab80 1 --2- 172.21.15.110:0/3464814665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a15c261880 0x55a15c262470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.189+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3464814665 >> 172.21.15.110:0/3464814665 conn(0x55a15c18e3f0 msgr2=0x55a15c260760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:55.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.189+0000 7f6cc7400700 0 client.15282 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:32:55.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.190+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3464814665 shutdown_connections 2024-04-26T11:32:55.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.190+0000 7f6cf2c6ab80 1 -- 172.21.15.110:0/3464814665 wait complete. 2024-04-26T11:32:55.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.190+0000 7f6cf2c6ab80 20 client.15282 trim_cache size 0 max 16384 2024-04-26T11:32:55.193 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:32:55.193 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 30, 2024-04-26T11:32:55.193 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:32:55.193 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 4, 2024-04-26T11:32:55.193 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:32:55.193 INFO:teuthology.orchestra.run.smithi110.stdout: "d509ee23": { 2024-04-26T11:32:55.193 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 4, 2024-04-26T11:32:55.193 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RELEASED", 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 78.0, 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": false, 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RELEASED", 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:32:55.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:55.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:55.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:55.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:55.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:32:55.195 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:32:55.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.195+0000 7f6ce8200700 1 -- 172.21.15.110:0/1106576581 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6cc80a3db0 msgr2=0x7f6cc80a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:55.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.195+0000 7f6ce8200700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6cc80a3db0 0x7f6cc80a6270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800f590 tx=0x7f6cd800b040 comp rx=0 tx=0).stop 2024-04-26T11:32:55.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.196+0000 7f6ce8200700 1 -- 172.21.15.110:0/1106576581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0103e30 msgr2=0x7f6ce019c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:55.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.196+0000 7f6ce8200700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0103e30 0x7f6ce019c390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00e9f0 tx=0x7f6ccc00ed00 comp rx=0 tx=0).stop 2024-04-26T11:32:55.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.198+0000 7f6ce8200700 1 -- 172.21.15.110:0/1106576581 shutdown_connections 2024-04-26T11:32:55.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.198+0000 7f6ce8200700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6cc80a3db0 0x7f6cc80a6270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.198+0000 7f6ce8200700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6ce01094c0 0x7f6ce01a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.198+0000 7f6ce8200700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ce0103470 0x7f6ce019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.198+0000 7f6ce8200700 1 --2- 172.21.15.110:0/1106576581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ce0103e30 0x7f6ce019c390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:55.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.198+0000 7f6ce8200700 1 -- 172.21.15.110:0/1106576581 >> 172.21.15.110:0/1106576581 conn(0x7f6ce007a580 msgr2=0x7f6ce010e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:55.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.199+0000 7f6ce8200700 1 -- 172.21.15.110:0/1106576581 shutdown_connections 2024-04-26T11:32:55.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:55.199+0000 7f6ce8200700 1 -- 172.21.15.110:0/1106576581 wait complete. 2024-04-26T11:32:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:55 smithi110 ceph-mon[28069]: pgmap v52: 97 pgs: 97 active+clean; 946 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 73 op/s 2024-04-26T11:32:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:55 smithi193 ceph-mon[32782]: pgmap v52: 97 pgs: 97 active+clean; 946 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 73 op/s 2024-04-26T11:32:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:55 smithi196 ceph-mon[32572]: pgmap v52: 97 pgs: 97 active+clean; 946 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 73 op/s 2024-04-26T11:32:56.198 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd509ee23', seconds elapsed: 37.0 2024-04-26T11:32:56.199 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.0 2024-04-26T11:32:56.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:32:56.809 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:32:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:57 smithi110 ceph-mon[28069]: pgmap v53: 97 pgs: 97 active+clean; 946 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 MiB/s wr, 63 op/s 2024-04-26T11:32:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:57 smithi193 ceph-mon[32782]: pgmap v53: 97 pgs: 97 active+clean; 946 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 MiB/s wr, 63 op/s 2024-04-26T11:32:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:57 smithi196 ceph-mon[32572]: pgmap v53: 97 pgs: 97 active+clean; 946 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.1 MiB/s wr, 63 op/s 2024-04-26T11:32:59.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.253+0000 7f6f64400700 1 -- 172.21.15.110:0/1674527017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075f70 msgr2=0x7f6f5c1140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:59.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.253+0000 7f6f64400700 1 --2- 172.21.15.110:0/1674527017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075f70 0x7f6f5c1140b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6f480098f0 tx=0x7f6f48009c00 comp rx=0 tx=0).stop 2024-04-26T11:32:59.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.253+0000 7f6f64400700 1 -- 172.21.15.110:0/1674527017 shutdown_connections 2024-04-26T11:32:59.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.253+0000 7f6f64400700 1 --2- 172.21.15.110:0/1674527017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f5c1145f0 0x7f6f5c1169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:59.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.253+0000 7f6f64400700 1 --2- 172.21.15.110:0/1674527017 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f5c075650 0x7f6f5c075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:59.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.253+0000 7f6f64400700 1 --2- 172.21.15.110:0/1674527017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075f70 0x7f6f5c1140b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:59.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.253+0000 7f6f64400700 1 -- 172.21.15.110:0/1674527017 >> 172.21.15.110:0/1674527017 conn(0x7f6f5c07a580 msgr2=0x7f6f5c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:59.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.254+0000 7f6f64400700 1 -- 172.21.15.110:0/1674527017 shutdown_connections 2024-04-26T11:32:59.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.254+0000 7f6f64400700 1 -- 172.21.15.110:0/1674527017 wait complete. 2024-04-26T11:32:59.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.256+0000 7f6f64400700 1 Processor -- start 2024-04-26T11:32:59.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.256+0000 7f6f64400700 1 -- start start 2024-04-26T11:32:59.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.256+0000 7f6f64400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075650 0x7f6f5c1a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:59.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.256+0000 7f6f64400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f5c075f70 0x7f6f5c1a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:59.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.257+0000 7f6f64400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f5c1145f0 0x7f6f5c1a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:59.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.257+0000 7f6f64400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c119c50 con 0x7f6f5c075f70 2024-04-26T11:32:59.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.257+0000 7f6f64400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c119ad0 con 0x7f6f5c075650 2024-04-26T11:32:59.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.257+0000 7f6f64400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c119dd0 con 0x7f6f5c1145f0 2024-04-26T11:32:59.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.258+0000 7f6f61a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075650 0x7f6f5c1a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:59.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.258+0000 7f6f61a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075650 0x7f6f5c1a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:43092/0 (socket says 172.21.15.110:43092) 2024-04-26T11:32:59.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.258+0000 7f6f61a00700 1 -- 172.21.15.110:0/3111634142 learned_addr learned my addr 172.21.15.110:0/3111634142 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:32:59.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.259+0000 7f6f61000700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f5c075f70 0x7f6f5c1a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:59.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.259+0000 7f6f62400700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f5c1145f0 0x7f6f5c1a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:59.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.259+0000 7f6f61a00700 1 -- 172.21.15.110:0/3111634142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f5c1145f0 msgr2=0x7f6f5c1a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:59.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.259+0000 7f6f61a00700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f5c1145f0 0x7f6f5c1a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:59.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.259+0000 7f6f61a00700 1 -- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f5c075f70 msgr2=0x7f6f5c1a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:59.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.259+0000 7f6f61a00700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f5c075f70 0x7f6f5c1a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:59.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.260+0000 7f6f61a00700 1 -- 172.21.15.110:0/3111634142 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c1a5210 con 0x7f6f5c075650 2024-04-26T11:32:59.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.260+0000 7f6f61000700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f5c075f70 0x7f6f5c1a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:32:59.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.260+0000 7f6f62400700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f5c1145f0 0x7f6f5c1a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:32:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.261+0000 7f6f61a00700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075650 0x7f6f5c1a0200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000e9c0 tx=0x7f6f5000ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.261+0000 7f6f5a000700 1 -- 172.21.15.110:0/3111634142 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000cbd0 con 0x7f6f5c075650 2024-04-26T11:32:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.261+0000 7f6f5a000700 1 -- 172.21.15.110:0/3111634142 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f5000cd70 con 0x7f6f5c075650 2024-04-26T11:32:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.261+0000 7f6f5a000700 1 -- 172.21.15.110:0/3111634142 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500056a0 con 0x7f6f5c075650 2024-04-26T11:32:59.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.262+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5c1a5500 con 0x7f6f5c075650 2024-04-26T11:32:59.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.262+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5c06ce40 con 0x7f6f5c075650 2024-04-26T11:32:59.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.265+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5c06a110 con 0x7f6f5c075650 2024-04-26T11:32:59.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.269+0000 7f6f5a000700 1 -- 172.21.15.110:0/3111634142 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6f50004750 con 0x7f6f5c075650 2024-04-26T11:32:59.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.271+0000 7f6f5a000700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6f440a3f80 0x7f6f440a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:32:59.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.271+0000 7f6f5a000700 1 -- 172.21.15.110:0/3111634142 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6f500d0a30 con 0x7f6f5c075650 2024-04-26T11:32:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.272+0000 7f6f61000700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6f440a3f80 0x7f6f440a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:32:59.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.273+0000 7f6f61000700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6f440a3f80 0x7f6f440a6440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f48005bf0 tx=0x7f6f48005b40 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:32:59.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.274+0000 7f6f5a000700 1 -- 172.21.15.110:0/3111634142 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6f5009cff0 con 0x7f6f5c075650 2024-04-26T11:32:59.276 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:32:59 smithi110 ceph-mon[28069]: pgmap v54: 97 pgs: 97 active+clean; 949 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.3 MiB/s wr, 190 op/s 2024-04-26T11:32:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:32:59 smithi193 ceph-mon[32782]: pgmap v54: 97 pgs: 97 active+clean; 949 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.3 MiB/s wr, 190 op/s 2024-04-26T11:32:59.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.744+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f5c06d160 con 0x7f6f5c075650 2024-04-26T11:32:59.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.746+0000 7f6f5a000700 1 -- 172.21.15.110:0/3111634142 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11896 (secure 0 0 0) 0x7f6f5009c8f0 con 0x7f6f5c075650 2024-04-26T11:32:59.747 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:32:59.747 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:32:17.630171+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24487,24502]},"id":1}]} 2024-04-26T11:32:59.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6f440a3f80 msgr2=0x7f6f440a6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:59.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6f440a3f80 0x7f6f440a6440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f48005bf0 tx=0x7f6f48005b40 comp rx=0 tx=0).stop 2024-04-26T11:32:59.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075650 msgr2=0x7f6f5c1a0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:32:59.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075650 0x7f6f5c1a0200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000e9c0 tx=0x7f6f5000ed80 comp rx=0 tx=0).stop 2024-04-26T11:32:59.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 shutdown_connections 2024-04-26T11:32:59.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6f440a3f80 0x7f6f440a6440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:59.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6f5c1145f0 0x7f6f5c1a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:59.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6f5c075650 0x7f6f5c1a0200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:59.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 --2- 172.21.15.110:0/3111634142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f5c075f70 0x7f6f5c1a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:32:59.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 >> 172.21.15.110:0/3111634142 conn(0x7f6f5c07a580 msgr2=0x7f6f5c110090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:32:59.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 shutdown_connections 2024-04-26T11:32:59.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:32:59.749+0000 7f6f64400700 1 -- 172.21.15.110:0/3111634142 wait complete. 2024-04-26T11:32:59.751 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2024-04-26T11:32:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:32:59 smithi196 ceph-mon[32572]: pgmap v54: 97 pgs: 97 active+clean; 949 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.3 MiB/s wr, 190 op/s 2024-04-26T11:32:59.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 45.0 s, 2680.7 tps, lat 235.233 ms stddev 2308.507 2024-04-26T11:33:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:00 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3111634142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:33:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:00 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3111634142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:33:00.695 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db / --timeout 60 --expiration 78.0 --await-for 42.0' 2024-04-26T11:33:00.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db / --timeout 60 --expiration 78.0 --await-for 42.0 2024-04-26T11:33:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:00 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3111634142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:33:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:33:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:01 smithi110 ceph-mon[28069]: pgmap v55: 97 pgs: 97 active+clean; 949 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-04-26T11:33:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:01 smithi193 ceph-mon[32782]: pgmap v55: 97 pgs: 97 active+clean; 949 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-04-26T11:33:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:01 smithi196 ceph-mon[32572]: pgmap v55: 97 pgs: 97 active+clean; 949 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-04-26T11:33:03.355 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:03 smithi110 ceph-mon[28069]: pgmap v56: 97 pgs: 97 active+clean; 949 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-04-26T11:33:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:03 smithi193 ceph-mon[32782]: pgmap v56: 97 pgs: 97 active+clean; 949 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-04-26T11:33:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:03 smithi196 ceph-mon[32572]: pgmap v56: 97 pgs: 97 active+clean; 949 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-04-26T11:33:03.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.846+0000 7fb865e00700 1 -- 172.21.15.110:0/2411982598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb860102f30 msgr2=0x7fb860106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:03.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.847+0000 7fb865e00700 1 --2- 172.21.15.110:0/2411982598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb860102f30 0x7fb860106f70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb848009990 tx=0x7fb848009ca0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.848+0000 7fb865e00700 1 -- 172.21.15.110:0/2411982598 shutdown_connections 2024-04-26T11:33:03.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.848+0000 7fb865e00700 1 --2- 172.21.15.110:0/2411982598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb860107650 0x7fb86010f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.848+0000 7fb865e00700 1 --2- 172.21.15.110:0/2411982598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb860102580 0x7fb860102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.848+0000 7fb865e00700 1 --2- 172.21.15.110:0/2411982598 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb860102f30 0x7fb860106f70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.848+0000 7fb865e00700 1 -- 172.21.15.110:0/2411982598 >> 172.21.15.110:0/2411982598 conn(0x7fb8600792c0 msgr2=0x7fb8600796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:03.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.849+0000 7fb865e00700 1 -- 172.21.15.110:0/2411982598 shutdown_connections 2024-04-26T11:33:03.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.849+0000 7fb865e00700 1 -- 172.21.15.110:0/2411982598 wait complete. 2024-04-26T11:33:03.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.853+0000 7fb865e00700 1 Processor -- start 2024-04-26T11:33:03.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.853+0000 7fb865e00700 1 -- start start 2024-04-26T11:33:03.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.854+0000 7fb865e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb860102580 0x7fb86010f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.855+0000 7fb865e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb860102f30 0x7fb86010c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.855+0000 7fb865e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb860107650 0x7fb86010c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.855+0000 7fb865e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601111e0 con 0x7fb860102f30 2024-04-26T11:33:03.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.855+0000 7fb85f400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb860107650 0x7fb86010c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.856+0000 7fb85f400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb860107650 0x7fb86010c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:33820/0 (socket says 172.21.15.110:33820) 2024-04-26T11:33:03.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.856+0000 7fb85f400700 1 -- 172.21.15.110:0/2293903420 learned_addr learned my addr 172.21.15.110:0/2293903420 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:03.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.856+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb860111060 con 0x7fb860107650 2024-04-26T11:33:03.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.856+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb860111360 con 0x7fb860102580 2024-04-26T11:33:03.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.856+0000 7fb85ea00700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb860102580 0x7fb86010f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.857+0000 7fb85f400700 1 -- 172.21.15.110:0/2293903420 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb860102580 msgr2=0x7fb86010f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:03.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.857+0000 7fb85f400700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb860102580 0x7fb86010f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.857+0000 7fb85e000700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb860102f30 0x7fb86010c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.857+0000 7fb85f400700 1 -- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb860102f30 msgr2=0x7fb86010c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:03.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.857+0000 7fb85f400700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb860102f30 0x7fb86010c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.857+0000 7fb85f400700 1 -- 172.21.15.110:0/2293903420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86010cfc0 con 0x7fb860107650 2024-04-26T11:33:03.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.857+0000 7fb85e000700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb860102f30 0x7fb86010c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:33:03.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.858+0000 7fb85f400700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb860107650 0x7fb86010c6c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c900 tx=0x7fb85800ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:03.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.858+0000 7fb864a00700 1 -- 172.21.15.110:0/2293903420 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858007b00 con 0x7fb860107650 2024-04-26T11:33:03.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.858+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8601ac580 con 0x7fb860107650 2024-04-26T11:33:03.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.858+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601acb10 con 0x7fb860107650 2024-04-26T11:33:03.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.858+0000 7fb864a00700 1 -- 172.21.15.110:0/2293903420 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb858007ca0 con 0x7fb860107650 2024-04-26T11:33:03.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.858+0000 7fb864a00700 1 -- 172.21.15.110:0/2293903420 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858018660 con 0x7fb860107650 2024-04-26T11:33:03.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.869+0000 7fb864a00700 1 -- 172.21.15.110:0/2293903420 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fb85800f450 con 0x7fb860107650 2024-04-26T11:33:03.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.870+0000 7fb870800b80 1 Processor -- start 2024-04-26T11:33:03.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.870+0000 7fb870800b80 1 -- start start 2024-04-26T11:33:03.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb870800b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001fcc40 0x5619001fd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb870800b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb870800b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001f7910 0x561900203990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb870800b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561900149a20 con 0x5619001f7910 2024-04-26T11:33:03.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb870800b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5619000e8340 con 0x5619001fcc40 2024-04-26T11:33:03.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb870800b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5619001459e0 con 0x5619001f6f70 2024-04-26T11:33:03.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb85e000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001fcc40 0x5619001fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb85e000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001fcc40 0x5619001fd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:33822/0 (socket says 172.21.15.110:33822) 2024-04-26T11:33:03.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb85e000700 1 -- 172.21.15.110:0/2232738295 learned_addr learned my addr 172.21.15.110:0/2232738295 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:03.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb864a00700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb8440a3ed0 0x7fb8440a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb85ea00700 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.871+0000 7fb864a00700 1 -- 172.21.15.110:0/2293903420 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fb8580d0640 con 0x7fb860107650 2024-04-26T11:33:03.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.872+0000 7fb85e000700 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001f7910 0x561900203990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.872+0000 7fb85e000700 1 -- 172.21.15.110:0/2232738295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 msgr2=0x5619001f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:03.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.872+0000 7fb85e000700 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.872+0000 7fb85f400700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb8440a3ed0 0x7fb8440a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.872+0000 7fb85e000700 1 -- 172.21.15.110:0/2232738295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001f7910 msgr2=0x561900203990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:03.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.872+0000 7fb85e000700 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001f7910 0x561900203990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.872+0000 7fb85e000700 1 -- 172.21.15.110:0/2232738295 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619000f07c0 con 0x5619001fcc40 2024-04-26T11:33:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.872+0000 7fb85ea00700 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:33:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.873+0000 7fb85e000700 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001fcc40 0x5619001fd020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb848006010 tx=0x7fb848009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd89b056ff0cf1e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.873+0000 7fb85f400700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb8440a3ed0 0x7fb8440a6390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb85809c260 tx=0x7fb858098140 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.873+0000 7fb854c00700 1 -- 172.21.15.110:0/2232738295 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848005030 con 0x5619001fcc40 2024-04-26T11:33:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.873+0000 7fb854c00700 1 -- 172.21.15.110:0/2232738295 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb84800b7d0 con 0x5619001fcc40 2024-04-26T11:33:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.873+0000 7fb854c00700 1 -- 172.21.15.110:0/2232738295 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848004970 con 0x5619001fcc40 2024-04-26T11:33:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.874+0000 7fb870800b80 1 -- 172.21.15.110:0/2232738295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001fcc40 msgr2=0x5619001fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.874+0000 7fb870800b80 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001fcc40 0x5619001fd020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb848006010 tx=0x7fb848009310 comp rx=0 tx=0).stop 2024-04-26T11:33:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.874+0000 7fb870800b80 1 -- 172.21.15.110:0/2232738295 shutdown_connections 2024-04-26T11:33:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.874+0000 7fb870800b80 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001f7910 0x561900203990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.874+0000 7fb870800b80 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001fcc40 0x5619001fd020 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.874+0000 7fb870800b80 1 --2- 172.21.15.110:0/2232738295 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.874+0000 7fb870800b80 1 -- 172.21.15.110:0/2232738295 >> 172.21.15.110:0/2232738295 conn(0x561900124480 msgr2=0x5619001f1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.875+0000 7fb870800b80 1 -- 172.21.15.110:0/2232738295 shutdown_connections 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.875+0000 7fb870800b80 1 -- 172.21.15.110:0/2232738295 wait complete. 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.876+0000 7fb870800b80 1 -- start start 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.876+0000 7fb870800b80 1 Processor -- start 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb870800b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 0x5619002035d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb870800b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619002008d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb870800b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x561900200e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb870800b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561900203ed0 con 0x5619001fcc40 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb870800b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5619000e4590 con 0x5619001f6f70 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb870800b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561900204050 con 0x5619001f7910 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb870800b80 10 client.0 _ll_register_callbacks cb 0x5619000dd510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb85ea00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619002008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb85ea00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619002008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:44354/0 (socket says 172.21.15.110:44354) 2024-04-26T11:33:03.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb85e000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 0x5619002035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.877+0000 7fb85ea00700 1 -- 172.21.15.110:0/3085041332 learned_addr learned my addr 172.21.15.110:0/3085041332 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:03.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.878+0000 7fb85e000700 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x561900200e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.878+0000 7fb85e000700 1 -- 172.21.15.110:0/3085041332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 msgr2=0x5619002008d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.878+0000 7fb85e000700 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619002008d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.878+0000 7fb85e000700 1 -- 172.21.15.110:0/3085041332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 msgr2=0x561900200e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.878+0000 7fb85e000700 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x561900200e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.878+0000 7fb85e000700 1 -- 172.21.15.110:0/3085041332 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561900096a60 con 0x5619001f6f70 2024-04-26T11:33:03.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.878+0000 7fb85e000700 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 0x5619002035d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb848006010 tx=0x7fb84801d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=766a1b8e06c762c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:03.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.878+0000 7fb84d600700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:33:03.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.878+0000 7fb84d600700 1 -- 172.21.15.110:0/3085041332 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84800f670 con 0x5619001f6f70 2024-04-26T11:33:03.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.879+0000 7fb84d600700 1 -- 172.21.15.110:0/3085041332 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fb848021070 con 0x5619001f6f70 2024-04-26T11:33:03.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.879+0000 7fb870800b80 1 -- 172.21.15.110:0/3085041332 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb84800b7d0 con 0x5619001f6f70 2024-04-26T11:33:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.879+0000 7fb84d600700 1 -- 172.21.15.110:0/3085041332 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb84800f810 con 0x5619001f6f70 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.879+0000 7fb870800b80 10 client.25397 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.879+0000 7fb870800b80 1 -- 172.21.15.110:0/3085041332 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561900203ed0 con 0x5619001f6f70 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.880+0000 7fb84d600700 1 -- 172.21.15.110:0/3085041332 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb84800b7d0 con 0x5619001f6f70 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.881+0000 7fb84d600700 1 -- 172.21.15.110:0/3085041332 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fb8480179c0 con 0x5619001f6f70 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.881+0000 7fb870800b80 10 client.25397 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.881+0000 7fb870800b80 10 client.25397 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.881+0000 7fb870800b80 20 client.25397 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.881+0000 7fb870800b80 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561900210990 0x561900212d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.881+0000 7fb870800b80 4 client.25397 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.881+0000 7fb870800b80 1 -- 172.21.15.110:0/3085041332 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561900157400 con 0x561900210990 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.881+0000 7fb85ea00700 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561900210990 0x561900212d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.882+0000 7fb84d600700 10 client.25397 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.882+0000 7fb85ea00700 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561900210990 0x561900212d80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=946aeb1a9d38e8f1 server_cookie=8fb30a1927ee152b in_seq=0 out_seq=0 2024-04-26T11:33:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb84d600700 1 -- 172.21.15.110:0/3085041332 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561900157400 con 0x561900210990 2024-04-26T11:33:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb84d600700 10 client.25397 handle_command_reply: tid=0 2024-04-26T11:33:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb870800b80 1 client.25397 shutdown 2024-04-26T11:33:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb870800b80 1 -- 172.21.15.110:0/3085041332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 msgr2=0x5619002035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb870800b80 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 0x5619002035d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb848006010 tx=0x7fb84801d040 comp rx=0 tx=0).stop 2024-04-26T11:33:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb870800b80 1 -- 172.21.15.110:0/3085041332 shutdown_connections 2024-04-26T11:33:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb870800b80 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561900210990 0x561900212d80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb870800b80 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x561900200e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb870800b80 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 0x5619002035d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb870800b80 1 --2- 172.21.15.110:0/3085041332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619002008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.883+0000 7fb870800b80 1 -- 172.21.15.110:0/3085041332 >> 172.21.15.110:0/3085041332 conn(0x561900124480 msgr2=0x5619001fbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:03.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.884+0000 7fb84d600700 0 client.25397 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:03.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.884+0000 7fb870800b80 1 -- 172.21.15.110:0/3085041332 shutdown_connections 2024-04-26T11:33:03.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.885+0000 7fb870800b80 1 -- 172.21.15.110:0/3085041332 wait complete. 2024-04-26T11:33:03.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.885+0000 7fb870800b80 20 client.25397 trim_cache size 0 max 16384 2024-04-26T11:33:03.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.921+0000 7fb870800b80 1 Processor -- start 2024-04-26T11:33:03.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.922+0000 7fb870800b80 1 -- start start 2024-04-26T11:33:03.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.922+0000 7fb870800b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.922+0000 7fb870800b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f7910 0x56190020cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.922+0000 7fb870800b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x561900202810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.922+0000 7fb870800b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c010160 con 0x5619001fcc40 2024-04-26T11:33:03.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.922+0000 7fb870800b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c00d960 con 0x5619001f7910 2024-04-26T11:33:03.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.922+0000 7fb870800b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c00b7b0 con 0x5619001f6f70 2024-04-26T11:33:03.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85e000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85e000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001ffa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:44362/0 (socket says 172.21.15.110:44362) 2024-04-26T11:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85e000700 1 -- 172.21.15.110:0/2302918438 learned_addr learned my addr 172.21.15.110:0/2302918438 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85ea00700 1 --2- 172.21.15.110:0/2302918438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f7910 0x56190020cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85e000700 1 -- 172.21.15.110:0/2302918438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f7910 msgr2=0x56190020cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85e000700 1 --2- 172.21.15.110:0/2302918438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f7910 0x56190020cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85e000700 1 -- 172.21.15.110:0/2302918438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 msgr2=0x561900202810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85e000700 1 --2- 172.21.15.110:0/2302918438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x561900202810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85e000700 1 -- 172.21.15.110:0/2302918438 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190020d2d0 con 0x5619001f6f70 2024-04-26T11:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.924+0000 7fb85e000700 1 --2- 172.21.15.110:0/2302918438 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001ffa50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb84800f020 tx=0x7fb84800bae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abaf2345bfaf7fe2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.925+0000 7fb84fe00700 1 -- 172.21.15.110:0/2302918438 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84800f670 con 0x5619001f6f70 2024-04-26T11:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.925+0000 7fb84fe00700 1 -- 172.21.15.110:0/2302918438 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb84800e3e0 con 0x5619001f6f70 2024-04-26T11:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.925+0000 7fb84fe00700 1 -- 172.21.15.110:0/2302918438 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84800e830 con 0x5619001f6f70 2024-04-26T11:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.927+0000 7fb870800b80 1 -- 172.21.15.110:0/2302918438 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 msgr2=0x5619001ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.927+0000 7fb870800b80 1 --2- 172.21.15.110:0/2302918438 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001ffa50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb84800f020 tx=0x7fb84800bae0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.927+0000 7fb870800b80 1 -- 172.21.15.110:0/2302918438 shutdown_connections 2024-04-26T11:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.927+0000 7fb870800b80 1 --2- 172.21.15.110:0/2302918438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x561900202810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.927+0000 7fb870800b80 1 --2- 172.21.15.110:0/2302918438 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f6f70 0x5619001ffa50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.927+0000 7fb870800b80 1 --2- 172.21.15.110:0/2302918438 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f7910 0x56190020cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.927+0000 7fb870800b80 1 -- 172.21.15.110:0/2302918438 >> 172.21.15.110:0/2302918438 conn(0x561900124480 msgr2=0x561900202100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:03.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.927+0000 7fb870800b80 1 -- 172.21.15.110:0/2302918438 shutdown_connections 2024-04-26T11:33:03.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.927+0000 7fb870800b80 1 -- 172.21.15.110:0/2302918438 wait complete. 2024-04-26T11:33:03.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.928+0000 7fb870800b80 1 -- start start 2024-04-26T11:33:03.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.928+0000 7fb870800b80 1 Processor -- start 2024-04-26T11:33:03.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.929+0000 7fb870800b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 0x561900209760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.929+0000 7fb870800b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619001f97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.929+0000 7fb870800b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x5619001f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.929+0000 7fb870800b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c00be20 con 0x5619001fcc40 2024-04-26T11:33:03.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.929+0000 7fb870800b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c00d290 con 0x5619001f6f70 2024-04-26T11:33:03.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.929+0000 7fb870800b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c00c4f0 con 0x5619001f7910 2024-04-26T11:33:03.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.929+0000 7fb870800b80 10 client.0 _ll_register_callbacks cb 0x5619000dd510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:03.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.930+0000 7fb85e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x5619001f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.930+0000 7fb85e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x5619001f9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42832/0 (socket says 172.21.15.110:42832) 2024-04-26T11:33:03.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.930+0000 7fb85e000700 1 -- 172.21.15.110:0/1870749318 learned_addr learned my addr 172.21.15.110:0/1870749318 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.930+0000 7fb85e000700 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 0x561900209760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.930+0000 7fb85ea00700 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619001f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.930+0000 7fb85e000700 1 -- 172.21.15.110:0/1870749318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 msgr2=0x5619001f97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.930+0000 7fb85e000700 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619001f97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.932+0000 7fb85e000700 1 -- 172.21.15.110:0/1870749318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 msgr2=0x561900209760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:03.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.932+0000 7fb85e000700 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 0x561900209760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:03.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.932+0000 7fb85e000700 1 -- 172.21.15.110:0/1870749318 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619001f8670 con 0x5619001fcc40 2024-04-26T11:33:03.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.932+0000 7fb85ea00700 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619001f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:03.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.932+0000 7fb85e000700 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x5619001f9db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb848006010 tx=0x7fb848003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64ef8d81c2e4539 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:03.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.932+0000 7fb84d600700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:33:03.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.933+0000 7fb84d600700 1 -- 172.21.15.110:0/1870749318 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848041040 con 0x5619001fcc40 2024-04-26T11:33:03.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.933+0000 7fb84d600700 1 -- 172.21.15.110:0/1870749318 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fb848030040 con 0x5619001fcc40 2024-04-26T11:33:03.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.933+0000 7fb870800b80 1 -- 172.21.15.110:0/1870749318 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb84800e3e0 con 0x5619001fcc40 2024-04-26T11:33:03.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.934+0000 7fb84d600700 1 -- 172.21.15.110:0/1870749318 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb84801d040 con 0x5619001fcc40 2024-04-26T11:33:03.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.934+0000 7fb870800b80 10 client.15291 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:03.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.934+0000 7fb870800b80 1 -- 172.21.15.110:0/1870749318 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561900278070 con 0x5619001fcc40 2024-04-26T11:33:03.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.935+0000 7fb84d600700 1 -- 172.21.15.110:0/1870749318 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb84800e3e0 con 0x5619001fcc40 2024-04-26T11:33:03.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.935+0000 7fb84d600700 1 -- 172.21.15.110:0/1870749318 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fb84800e790 con 0x5619001fcc40 2024-04-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.935+0000 7fb870800b80 10 client.15291 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.935+0000 7fb870800b80 10 client.15291 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.935+0000 7fb870800b80 20 client.15291 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.935+0000 7fb870800b80 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561900278480 0x56190027a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.935+0000 7fb870800b80 4 client.15291 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.0, "await_for": 42.0}] 2024-04-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.935+0000 7fb870800b80 1 -- 172.21.15.110:0/1870749318 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.0, "await_for": 42.0}) -- 0x5619001514a0 con 0x561900278480 2024-04-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.936+0000 7fb85ea00700 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561900278480 0x56190027a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:03.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.938+0000 7fb85ea00700 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561900278480 0x56190027a8a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6af2918c8a9aae0f server_cookie=f082b3bbe7c4f12f in_seq=0 out_seq=0 2024-04-26T11:33:03.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:03.938+0000 7fb84d600700 10 client.15291 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:04.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.155+0000 7fb84d600700 1 -- 172.21.15.110:0/1870749318 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5619001514a0 con 0x561900278480 2024-04-26T11:33:04.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.155+0000 7fb84d600700 10 client.15291 handle_command_reply: tid=0 2024-04-26T11:33:04.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.155+0000 7fb870800b80 1 client.15291 shutdown 2024-04-26T11:33:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb870800b80 1 -- 172.21.15.110:0/1870749318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 msgr2=0x5619001f9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb870800b80 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x5619001f9db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb848006010 tx=0x7fb848003680 comp rx=0 tx=0).stop 2024-04-26T11:33:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb870800b80 1 -- 172.21.15.110:0/1870749318 shutdown_connections 2024-04-26T11:33:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb870800b80 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561900278480 0x56190027a8a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb870800b80 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619001fcc40 0x5619001f9db0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb84d600700 0 client.15291 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb870800b80 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5619001f6f70 0x561900209760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb870800b80 1 --2- 172.21.15.110:0/1870749318 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5619001f7910 0x5619001f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb870800b80 1 -- 172.21.15.110:0/1870749318 >> 172.21.15.110:0/1870749318 conn(0x561900124480 msgr2=0x5619001f67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.158+0000 7fb870800b80 1 -- 172.21.15.110:0/1870749318 shutdown_connections 2024-04-26T11:33:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.159+0000 7fb870800b80 1 -- 172.21.15.110:0/1870749318 wait complete. 2024-04-26T11:33:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.159+0000 7fb870800b80 20 client.15291 trim_cache size 0 max 16384 2024-04-26T11:33:04.161 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:33:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 30, 2024-04-26T11:33:04.161 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 6, 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "d1ba88c5": { 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 6, 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "QUIESCED", 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 78.0, 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:33:04.162 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": false, 2024-04-26T11:33:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:33:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "QUIESCED", 2024-04-26T11:33:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:33:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:04.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:04.163 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:33:04.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb8440a3ed0 msgr2=0x7fb8440a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:04.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb8440a3ed0 0x7fb8440a6390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb85809c260 tx=0x7fb858098140 comp rx=0 tx=0).stop 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb860107650 msgr2=0x7fb86010c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb860107650 0x7fb86010c6c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c900 tx=0x7fb85800ccc0 comp rx=0 tx=0).stop 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 shutdown_connections 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb8440a3ed0 0x7fb8440a6390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb860107650 0x7fb86010c6c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb860102580 0x7fb86010f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 --2- 172.21.15.110:0/2293903420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb860102f30 0x7fb86010c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.169+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 >> 172.21.15.110:0/2293903420 conn(0x7fb8600792c0 msgr2=0x7fb860100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.171+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 shutdown_connections 2024-04-26T11:33:04.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:04.171+0000 7fb865e00700 1 -- 172.21.15.110:0/2293903420 wait complete. 2024-04-26T11:33:04.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 50.0 s, 439.6 tps, lat 111.831 ms stddev 145.424 2024-04-26T11:33:05.119 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd1ba88c5', quiesce took 8.9 seconds. Will release after: 18.0 2024-04-26T11:33:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:05 smithi110 ceph-mon[28069]: pgmap v57: 97 pgs: 97 active+clean; 950 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.8 MiB/s wr, 436 op/s 2024-04-26T11:33:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:05 smithi193 ceph-mon[32782]: pgmap v57: 97 pgs: 97 active+clean; 950 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.8 MiB/s wr, 436 op/s 2024-04-26T11:33:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:05 smithi196 ceph-mon[32572]: pgmap v57: 97 pgs: 97 active+clean; 950 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.8 MiB/s wr, 436 op/s 2024-04-26T11:33:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.258+0000 7fe24ac00640 1 -- 172.21.15.110:0/2764571942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe244074d00 msgr2=0x7fe2440750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.258+0000 7fe24ac00640 1 --2- 172.21.15.110:0/2764571942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe244074d00 0x7fe2440750e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe234009860 tx=0x7fe23402a3d0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.259+0000 7fe24ac00640 1 -- 172.21.15.110:0/2764571942 shutdown_connections 2024-04-26T11:33:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.259+0000 7fe24ac00640 1 --2- 172.21.15.110:0/2764571942 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe24410f1b0 0x7fe2441115c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.259+0000 7fe24ac00640 1 --2- 172.21.15.110:0/2764571942 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe244075620 0x7fe24410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.259+0000 7fe24ac00640 1 --2- 172.21.15.110:0/2764571942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe244074d00 0x7fe2440750e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.259+0000 7fe24ac00640 1 -- 172.21.15.110:0/2764571942 >> 172.21.15.110:0/2764571942 conn(0x7fe2440fe3e0 msgr2=0x7fe244100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.259+0000 7fe24ac00640 1 -- 172.21.15.110:0/2764571942 shutdown_connections 2024-04-26T11:33:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.259+0000 7fe24ac00640 1 -- 172.21.15.110:0/2764571942 wait complete. 2024-04-26T11:33:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.260+0000 7fe24ac00640 1 Processor -- start 2024-04-26T11:33:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.260+0000 7fe24ac00640 1 -- start start 2024-04-26T11:33:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.260+0000 7fe24ac00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe244074d00 0x7fe24419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.260+0000 7fe24ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe244075620 0x7fe24419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.260+0000 7fe24ac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe24410f1b0 0x7fe24419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.260+0000 7fe24ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe244114e10 con 0x7fe244075620 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.260+0000 7fe24ac00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe244114c90 con 0x7fe244074d00 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.260+0000 7fe24ac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe244114f90 con 0x7fe24410f1b0 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe244074d00 0x7fe24419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe244075620 0x7fe24419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe244074d00 0x7fe24419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:33878/0 (socket says 172.21.15.110:33878) 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243e00640 1 -- 172.21.15.110:0/3601376167 learned_addr learned my addr 172.21.15.110:0/3601376167 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe248c00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe24410f1b0 0x7fe24419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243400640 1 -- 172.21.15.110:0/3601376167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe24410f1b0 msgr2=0x7fe24419fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243400640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe24410f1b0 0x7fe24419fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243400640 1 -- 172.21.15.110:0/3601376167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe244074d00 msgr2=0x7fe24419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243400640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe244074d00 0x7fe24419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243400640 1 -- 172.21.15.110:0/3601376167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2441a02f0 con 0x7fe244075620 2024-04-26T11:33:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.261+0000 7fe243400640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe244075620 0x7fe24419b890 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009fd0 tx=0x7fe22c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.262+0000 7fe240c00640 1 -- 172.21.15.110:0/3601376167 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c003970 con 0x7fe244075620 2024-04-26T11:33:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.262+0000 7fe240c00640 1 -- 172.21.15.110:0/3601376167 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe22c004020 con 0x7fe244075620 2024-04-26T11:33:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.262+0000 7fe24ac00640 1 -- 172.21.15.110:0/3601376167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2441a05e0 con 0x7fe244075620 2024-04-26T11:33:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.262+0000 7fe240c00640 1 -- 172.21.15.110:0/3601376167 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00b9b0 con 0x7fe244075620 2024-04-26T11:33:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.262+0000 7fe24ac00640 1 -- 172.21.15.110:0/3601376167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2441a7e70 con 0x7fe244075620 2024-04-26T11:33:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.265+0000 7fe240c00640 1 -- 172.21.15.110:0/3601376167 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe22c0041d0 con 0x7fe244075620 2024-04-26T11:33:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.265+0000 7fe24dbc1740 1 Processor -- start 2024-04-26T11:33:06.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.265+0000 7fe24dbc1740 1 -- start start 2024-04-26T11:33:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d0b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0b6f0 0x562416d15a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d183a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562416c70380 con 0x562416d0add0 2024-04-26T11:33:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562416c0cc30 con 0x562416d0b6f0 2024-04-26T11:33:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562416c6c340 con 0x562416d15fb0 2024-04-26T11:33:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe243e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0b6f0 0x562416d15a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe248c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d0b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe243e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0b6f0 0x562416d15a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:33894/0 (socket says 172.21.15.110:33894) 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe248c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d0b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42854/0 (socket says 172.21.15.110:42854) 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe243e00640 1 -- 172.21.15.110:0/779296987 learned_addr learned my addr 172.21.15.110:0/779296987 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe243400640 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe248c00640 1 -- 172.21.15.110:0/779296987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 msgr2=0x562416d183a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe248c00640 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d183a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe248c00640 1 -- 172.21.15.110:0/779296987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0b6f0 msgr2=0x562416d15a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe248c00640 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0b6f0 0x562416d15a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe248c00640 1 -- 172.21.15.110:0/779296987 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562416c2e940 con 0x562416d0add0 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe243400640 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d183a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.266+0000 7fe243e00640 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0b6f0 0x562416d15a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.267+0000 7fe240c00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe2240a3dc0 0x7fe2240a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.267+0000 7fe248c00640 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d0b1b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe244075c50 tx=0x7fe23c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0eb444ae80de55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.267+0000 7fe240c00640 1 -- 172.21.15.110:0/3601376167 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fe22c0d0a90 con 0x7fe244075620 2024-04-26T11:33:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.267+0000 7fe239200640 1 -- 172.21.15.110:0/779296987 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c004050 con 0x562416d0add0 2024-04-26T11:33:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.267+0000 7fe243e00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe2240a3dc0 0x7fe2240a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.267+0000 7fe239200640 1 -- 172.21.15.110:0/779296987 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe23c0054d0 con 0x562416d0add0 2024-04-26T11:33:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.267+0000 7fe239200640 1 -- 172.21.15.110:0/779296987 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c004b80 con 0x562416d0add0 2024-04-26T11:33:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe24dbc1740 1 -- 172.21.15.110:0/779296987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 msgr2=0x562416d0b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d0b1b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe244075c50 tx=0x7fe23c005850 comp rx=0 tx=0).stop 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe243e00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe2240a3dc0 0x7fe2240a6280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe234032ff0 tx=0x7fe234005cb0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe24dbc1740 1 -- 172.21.15.110:0/779296987 shutdown_connections 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d183a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0b6f0 0x562416d15a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/779296987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d0b1b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe24dbc1740 1 -- 172.21.15.110:0/779296987 >> 172.21.15.110:0/779296987 conn(0x562416d072e0 msgr2=0x562416d076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe24dbc1740 1 -- 172.21.15.110:0/779296987 shutdown_connections 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.268+0000 7fe24dbc1740 1 -- 172.21.15.110:0/779296987 wait complete. 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.269+0000 7fe24dbc1740 1 -- start start 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.269+0000 7fe24dbc1740 1 Processor -- start 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.269+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d12f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.269+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d13440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.269+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d15fb0 0x562416d13980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562416d18be0 con 0x562416d0add0 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562416bf7c60 con 0x562416d15fb0 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562416d18d60 con 0x562416d0b6f0 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe24dbc1740 10 client.0 _ll_register_callbacks cb 0x562416c23e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d12f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d12f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42858/0 (socket says 172.21.15.110:42858) 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243e00640 1 -- 172.21.15.110:0/3036803213 learned_addr learned my addr 172.21.15.110:0/3036803213 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243400640 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d13440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe248c00640 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d15fb0 0x562416d13980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243e00640 1 -- 172.21.15.110:0/3036803213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 msgr2=0x562416d13440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243e00640 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d13440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243e00640 1 -- 172.21.15.110:0/3036803213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d15fb0 msgr2=0x562416d13980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243e00640 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d15fb0 0x562416d13980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243e00640 1 -- 172.21.15.110:0/3036803213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562416c06510 con 0x562416d0add0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe248c00640 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d15fb0 0x562416d13980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.270+0000 7fe243400640 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d13440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.271+0000 7fe243e00640 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d12f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe234000c00 tx=0x7fe23402a3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2511310483bcc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.271+0000 7fe231600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.271+0000 7fe231600640 1 -- 172.21.15.110:0/3036803213 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2340307b0 con 0x562416d0add0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.271+0000 7fe231600640 1 -- 172.21.15.110:0/3036803213 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fe234005040 con 0x562416d0add0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.271+0000 7fe24dbc1740 1 -- 172.21.15.110:0/3036803213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe23c0054d0 con 0x562416d0add0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.271+0000 7fe231600640 1 -- 172.21.15.110:0/3036803213 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe234005240 con 0x562416d0add0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.271+0000 7fe24dbc1740 10 client.15303 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.271+0000 7fe24dbc1740 1 -- 172.21.15.110:0/3036803213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562416982210 con 0x562416d0add0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.272+0000 7fe231600640 1 -- 172.21.15.110:0/3036803213 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe23c0054d0 con 0x562416d0add0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.272+0000 7fe231600640 1 -- 172.21.15.110:0/3036803213 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fe2340524c0 con 0x562416d0add0 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.272+0000 7fe24dbc1740 10 client.15303 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.272+0000 7fe24dbc1740 10 client.15303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.272+0000 7fe24dbc1740 20 client.15303 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.272+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562416d25dc0 0x562416d281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.272+0000 7fe24dbc1740 4 client.15303 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:33:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.272+0000 7fe24dbc1740 1 -- 172.21.15.110:0/3036803213 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562416c7df90 con 0x562416d25dc0 2024-04-26T11:33:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.272+0000 7fe243400640 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562416d25dc0 0x562416d281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.273+0000 7fe243400640 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562416d25dc0 0x562416d281b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bb36a9d716d20bf server_cookie=349e077b1382d3d3 in_seq=0 out_seq=0 2024-04-26T11:33:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.273+0000 7fe231600640 10 client.15303 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe231600640 1 -- 172.21.15.110:0/3036803213 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562416c7df90 con 0x562416d25dc0 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe231600640 10 client.15303 handle_command_reply: tid=0 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 client.15303 shutdown 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 -- 172.21.15.110:0/3036803213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 msgr2=0x562416d12f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d12f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe234000c00 tx=0x7fe23402a3d0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 -- 172.21.15.110:0/3036803213 shutdown_connections 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d15fb0 0x562416d13980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562416d25dc0 0x562416d281b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d13440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/3036803213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0add0 0x562416d12f00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe231600640 0 client.15303 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 -- 172.21.15.110:0/3036803213 >> 172.21.15.110:0/3036803213 conn(0x562416d072e0 msgr2=0x562416d0d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 -- 172.21.15.110:0/3036803213 shutdown_connections 2024-04-26T11:33:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 1 -- 172.21.15.110:0/3036803213 wait complete. 2024-04-26T11:33:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.274+0000 7fe24dbc1740 20 client.15303 trim_cache size 0 max 16384 2024-04-26T11:33:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.291+0000 7fe24dbc1740 1 Processor -- start 2024-04-26T11:33:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.291+0000 7fe24dbc1740 1 -- start start 2024-04-26T11:33:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.291+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d21aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.291+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d12060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.291+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d15fb0 0x562416d2daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.291+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe2441b3330 con 0x562416d15fb0 2024-04-26T11:33:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.291+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe2441b0b70 con 0x562416d0add0 2024-04-26T11:33:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.291+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe2441ae9c0 con 0x562416d0b6f0 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d21aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d12060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe248c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d15fb0 0x562416d2daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d21aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:33916/0 (socket says 172.21.15.110:33916) 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243e00640 1 -- 172.21.15.110:0/4010849377 learned_addr learned my addr 172.21.15.110:0/4010849377 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d12060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:44422/0 (socket says 172.21.15.110:44422) 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243e00640 1 -- 172.21.15.110:0/4010849377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 msgr2=0x562416d12060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243e00640 1 --2- 172.21.15.110:0/4010849377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d12060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243e00640 1 -- 172.21.15.110:0/4010849377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d15fb0 msgr2=0x562416d2daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243e00640 1 --2- 172.21.15.110:0/4010849377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d15fb0 0x562416d2daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243e00640 1 -- 172.21.15.110:0/4010849377 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562416a4e620 con 0x562416d0add0 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243400640 1 --2- 172.21.15.110:0/4010849377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d12060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.292+0000 7fe243e00640 1 --2- 172.21.15.110:0/4010849377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d21aa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe234009230 tx=0x7fe234005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ea889b5db31bac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe233e00640 1 -- 172.21.15.110:0/4010849377 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234030730 con 0x562416d0add0 2024-04-26T11:33:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe233e00640 1 -- 172.21.15.110:0/4010849377 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe234052b50 con 0x562416d0add0 2024-04-26T11:33:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe233e00640 1 -- 172.21.15.110:0/4010849377 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234004b70 con 0x562416d0add0 2024-04-26T11:33:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe24dbc1740 1 -- 172.21.15.110:0/4010849377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 msgr2=0x562416d21aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/4010849377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d21aa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe234009230 tx=0x7fe234005f10 comp rx=0 tx=0).stop 2024-04-26T11:33:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe24dbc1740 1 -- 172.21.15.110:0/4010849377 shutdown_connections 2024-04-26T11:33:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/4010849377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d15fb0 0x562416d2daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/4010849377 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d0b6f0 0x562416d12060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/4010849377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d21aa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.293+0000 7fe24dbc1740 1 -- 172.21.15.110:0/4010849377 >> 172.21.15.110:0/4010849377 conn(0x562416d072e0 msgr2=0x562416d076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.294+0000 7fe24dbc1740 1 -- 172.21.15.110:0/4010849377 shutdown_connections 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.294+0000 7fe24dbc1740 1 -- 172.21.15.110:0/4010849377 wait complete. 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.294+0000 7fe24dbc1740 1 -- start start 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.294+0000 7fe24dbc1740 1 Processor -- start 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d1e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0b6f0 0x562416d19570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe24dbc1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d19ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe2441af030 con 0x562416d0b6f0 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe2441b04a0 con 0x562416d0add0 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe24dbc1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe2441af700 con 0x562416d15fb0 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe24dbc1740 10 client.0 _ll_register_callbacks cb 0x7fe2340096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe243e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d1e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe243e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d1e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:33926/0 (socket says 172.21.15.110:33926) 2024-04-26T11:33:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe248c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d19ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe243e00640 1 -- 172.21.15.110:0/585452683 learned_addr learned my addr 172.21.15.110:0/585452683 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe243400640 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0b6f0 0x562416d19570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe248c00640 1 -- 172.21.15.110:0/585452683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 msgr2=0x562416d1e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe248c00640 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d1e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe248c00640 1 -- 172.21.15.110:0/585452683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0b6f0 msgr2=0x562416d19570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe248c00640 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0b6f0 0x562416d19570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe248c00640 1 -- 172.21.15.110:0/585452683 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562416c2acb0 con 0x562416d15fb0 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.295+0000 7fe243400640 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0b6f0 0x562416d19570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe248c00640 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d19ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe23c004530 tx=0x7fe23c0096b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22d28be7ce748e6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe231600640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe231600640 1 -- 172.21.15.110:0/585452683 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c028020 con 0x562416d15fb0 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe24dbc1740 1 -- 172.21.15.110:0/585452683 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe234052b50 con 0x562416d15fb0 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe231600640 1 -- 172.21.15.110:0/585452683 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fe23c003d10 con 0x562416d15fb0 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe231600640 1 -- 172.21.15.110:0/585452683 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe23c030050 con 0x562416d15fb0 2024-04-26T11:33:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe24dbc1740 10 client.25438 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe24dbc1740 1 -- 172.21.15.110:0/585452683 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562416d8be40 con 0x562416d15fb0 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe231600640 1 -- 172.21.15.110:0/585452683 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe234052b50 con 0x562416d15fb0 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.296+0000 7fe231600640 1 -- 172.21.15.110:0/585452683 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fe23c018070 con 0x562416d15fb0 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.297+0000 7fe24dbc1740 10 client.25438 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.297+0000 7fe24dbc1740 10 client.25438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.297+0000 7fe24dbc1740 20 client.25438 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.297+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562416d8c370 0x562416d8e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.297+0000 7fe24dbc1740 4 client.25438 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.297+0000 7fe24dbc1740 1 -- 172.21.15.110:0/585452683 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562416c77e00 con 0x562416d8c370 2024-04-26T11:33:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.297+0000 7fe243e00640 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562416d8c370 0x562416d8e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.298+0000 7fe243e00640 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562416d8c370 0x562416d8e760 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd015ba0544b738d server_cookie=8861aeb0e8a3699a in_seq=0 out_seq=0 2024-04-26T11:33:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.298+0000 7fe231600640 10 client.25438 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe231600640 1 -- 172.21.15.110:0/585452683 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562416c77e00 con 0x562416d8c370 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe231600640 10 client.25438 handle_command_reply: tid=0 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe24dbc1740 1 client.25438 shutdown 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe24dbc1740 1 -- 172.21.15.110:0/585452683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 msgr2=0x562416d19ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d19ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe23c004530 tx=0x7fe23c0096b0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe24dbc1740 1 -- 172.21.15.110:0/585452683 shutdown_connections 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562416d8c370 0x562416d8e760 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562416d15fb0 0x562416d19ab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562416d0b6f0 0x562416d19570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe24dbc1740 1 --2- 172.21.15.110:0/585452683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562416d0add0 0x562416d1e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe231600640 0 client.25438 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.309+0000 7fe24dbc1740 1 -- 172.21.15.110:0/585452683 >> 172.21.15.110:0/585452683 conn(0x562416d072e0 msgr2=0x562416d12060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.310+0000 7fe24dbc1740 1 -- 172.21.15.110:0/585452683 shutdown_connections 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.310+0000 7fe24dbc1740 1 -- 172.21.15.110:0/585452683 wait complete. 2024-04-26T11:33:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.310+0000 7fe24dbc1740 20 client.25438 trim_cache size 0 max 16384 2024-04-26T11:33:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:33:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:33:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:33:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.310+0000 7fe24ac00640 1 -- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe2240a3dc0 msgr2=0x7fe2240a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.310+0000 7fe24ac00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe2240a3dc0 0x7fe2240a6280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe234032ff0 tx=0x7fe234005cb0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.310+0000 7fe24ac00640 1 -- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe244075620 msgr2=0x7fe24419b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.310+0000 7fe24ac00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe244075620 0x7fe24419b890 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009fd0 tx=0x7fe22c00c880 comp rx=0 tx=0).stop 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.311+0000 7fe24ac00640 1 -- 172.21.15.110:0/3601376167 shutdown_connections 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.311+0000 7fe24ac00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe2240a3dc0 0x7fe2240a6280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.311+0000 7fe24ac00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe24410f1b0 0x7fe24419fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.311+0000 7fe24ac00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe244075620 0x7fe24419b890 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.311+0000 7fe24ac00640 1 --2- 172.21.15.110:0/3601376167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe244074d00 0x7fe24419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.311+0000 7fe24ac00640 1 -- 172.21.15.110:0/3601376167 >> 172.21.15.110:0/3601376167 conn(0x7fe2440fe3e0 msgr2=0x7fe2440ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.311+0000 7fe24ac00640 1 -- 172.21.15.110:0/3601376167 shutdown_connections 2024-04-26T11:33:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:06.311+0000 7fe24ac00640 1 -- 172.21.15.110:0/3601376167 wait complete. 2024-04-26T11:33:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:07 smithi193 ceph-mon[32782]: pgmap v58: 97 pgs: 97 active+clean; 950 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.5 MiB/s wr, 431 op/s 2024-04-26T11:33:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:07 smithi196 ceph-mon[32572]: pgmap v58: 97 pgs: 97 active+clean; 950 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.5 MiB/s wr, 431 op/s 2024-04-26T11:33:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:07 smithi110 ceph-mon[28069]: pgmap v58: 97 pgs: 97 active+clean; 950 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.5 MiB/s wr, 431 op/s 2024-04-26T11:33:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:09 smithi193 ceph-mon[32782]: pgmap v59: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 37 MiB/s wr, 1.14k op/s 2024-04-26T11:33:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:09 smithi196 ceph-mon[32572]: pgmap v59: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 37 MiB/s wr, 1.14k op/s 2024-04-26T11:33:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:09 smithi110 ceph-mon[28069]: pgmap v59: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 37 MiB/s wr, 1.14k op/s 2024-04-26T11:33:09.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 55.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:33:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:11 smithi193 ceph-mon[32782]: pgmap v60: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 36 MiB/s wr, 1.01k op/s 2024-04-26T11:33:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:11 smithi196 ceph-mon[32572]: pgmap v60: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 36 MiB/s wr, 1.01k op/s 2024-04-26T11:33:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:11 smithi110 ceph-mon[28069]: pgmap v60: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 36 MiB/s wr, 1.01k op/s 2024-04-26T11:33:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:13 smithi193 ceph-mon[32782]: pgmap v61: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 36 MiB/s wr, 1.01k op/s 2024-04-26T11:33:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:13 smithi196 ceph-mon[32572]: pgmap v61: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 36 MiB/s wr, 1.01k op/s 2024-04-26T11:33:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:13 smithi110 ceph-mon[28069]: pgmap v61: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 36 MiB/s wr, 1.01k op/s 2024-04-26T11:33:14.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 60.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:33:15.596 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:15 smithi110 ceph-mon[28069]: pgmap v62: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 36 MiB/s wr, 1.02k op/s 2024-04-26T11:33:15.625 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:15 smithi193 ceph-mon[32782]: pgmap v62: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 36 MiB/s wr, 1.02k op/s 2024-04-26T11:33:15.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:15 smithi196 ceph-mon[32572]: pgmap v62: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 36 MiB/s wr, 1.02k op/s 2024-04-26T11:33:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:17 smithi110 ceph-mon[28069]: pgmap v63: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 34 MiB/s wr, 712 op/s 2024-04-26T11:33:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:17 smithi193 ceph-mon[32782]: pgmap v63: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 34 MiB/s wr, 712 op/s 2024-04-26T11:33:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:17 smithi196 ceph-mon[32572]: pgmap v63: 97 pgs: 97 active+clean; 964 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 34 MiB/s wr, 712 op/s 2024-04-26T11:33:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.456+0000 7f8780200640 1 -- 172.21.15.110:0/709303034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778074c30 msgr2=0x7f8778075010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.456+0000 7f8780200640 1 --2- 172.21.15.110:0/709303034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778074c30 0x7f8778075010 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f876c009900 tx=0x7f876c02a480 comp rx=0 tx=0).stop 2024-04-26T11:33:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.456+0000 7f8780200640 1 -- 172.21.15.110:0/709303034 shutdown_connections 2024-04-26T11:33:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.456+0000 7f8780200640 1 --2- 172.21.15.110:0/709303034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f877810f220 0x7f8778111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.456+0000 7f8780200640 1 --2- 172.21.15.110:0/709303034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8778075550 0x7f877810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.456+0000 7f8780200640 1 --2- 172.21.15.110:0/709303034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778074c30 0x7f8778075010 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.456+0000 7f8780200640 1 -- 172.21.15.110:0/709303034 >> 172.21.15.110:0/709303034 conn(0x7f8778079dc0 msgr2=0x7f877807a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:19.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.456+0000 7f8780200640 1 -- 172.21.15.110:0/709303034 shutdown_connections 2024-04-26T11:33:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.456+0000 7f8780200640 1 -- 172.21.15.110:0/709303034 wait complete. 2024-04-26T11:33:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.457+0000 7f8780200640 1 Processor -- start 2024-04-26T11:33:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.457+0000 7f8780200640 1 -- start start 2024-04-26T11:33:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f8780200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8778074c30 0x7f877819b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f8780200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778075550 0x7f877819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f8780200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877810f220 0x7f877819fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f8780200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8778114e00 con 0x7f877810f220 2024-04-26T11:33:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f8780200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8778114c80 con 0x7f8778074c30 2024-04-26T11:33:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f8780200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8778114f80 con 0x7f8778075550 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f877e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877810f220 0x7f877819fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f877ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778075550 0x7f877819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f877e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877810f220 0x7f877819fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56188/0 (socket says 172.21.15.110:56188) 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f877ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778075550 0x7f877819b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:47008/0 (socket says 172.21.15.110:47008) 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f877d800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8778074c30 0x7f877819b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.458+0000 7f877e200640 1 -- 172.21.15.110:0/2111902833 learned_addr learned my addr 172.21.15.110:0/2111902833 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f877ce00640 1 -- 172.21.15.110:0/2111902833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8778074c30 msgr2=0x7f877819b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f877ce00640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8778074c30 0x7f877819b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f877ce00640 1 -- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877810f220 msgr2=0x7f877819fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f877ce00640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877810f220 0x7f877819fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f877ce00640 1 -- 172.21.15.110:0/2111902833 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87781a0210 con 0x7f8778075550 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f877e200640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877810f220 0x7f877819fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f877ce00640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778075550 0x7f877819b760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f876400e9f0 tx=0x7f876400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f8776000640 1 -- 172.21.15.110:0/2111902833 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876400ccc0 con 0x7f8778075550 2024-04-26T11:33:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f8776000640 1 -- 172.21.15.110:0/2111902833 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87640108e0 con 0x7f8778075550 2024-04-26T11:33:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f8776000640 1 -- 172.21.15.110:0/2111902833 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764018880 con 0x7f8778075550 2024-04-26T11:33:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.459+0000 7f8780200640 1 -- 172.21.15.110:0/2111902833 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87781a0500 con 0x7f8778075550 2024-04-26T11:33:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.460+0000 7f8780200640 1 -- 172.21.15.110:0/2111902833 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87781a7d40 con 0x7f8778075550 2024-04-26T11:33:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.463+0000 7f8783075740 1 Processor -- start 2024-04-26T11:33:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.463+0000 7f8783075740 1 -- start start 2024-04-26T11:33:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.463+0000 7f8783075740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.463+0000 7f8783075740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e26f0 0x55f8185eca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.463+0000 7f8783075740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.463+0000 7f8783075740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f818547380 con 0x55f8185ecfb0 2024-04-26T11:33:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.463+0000 7f8783075740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f8184e3c30 con 0x55f8185e1dd0 2024-04-26T11:33:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.463+0000 7f8783075740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f818543340 con 0x55f8185e26f0 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f8776000640 1 -- 172.21.15.110:0/2111902833 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f8764010430 con 0x7f8778075550 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877e200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877e200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:32970/0 (socket says 172.21.15.110:32970) 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877d800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e26f0 0x55f8185eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877e200640 1 -- 172.21.15.110:0/4189542488 learned_addr learned my addr 172.21.15.110:0/4189542488 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877ce00640 1 --2- 172.21.15.110:0/4189542488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877e200640 1 -- 172.21.15.110:0/4189542488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e26f0 msgr2=0x55f8185eca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877e200640 1 --2- 172.21.15.110:0/4189542488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e26f0 0x55f8185eca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877e200640 1 -- 172.21.15.110:0/4189542488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 msgr2=0x55f8185ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877e200640 1 --2- 172.21.15.110:0/4189542488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877e200640 1 -- 172.21.15.110:0/4189542488 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f818505940 con 0x55f8185e1dd0 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877ce00640 1 --2- 172.21.15.110:0/4189542488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.464+0000 7f877e200640 1 --2- 172.21.15.110:0/4189542488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e21b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8770011850 tx=0x7f8770011d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db9e19d262eda01c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.465+0000 7f876aa00640 1 -- 172.21.15.110:0/4189542488 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770011330 con 0x55f8185e1dd0 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.465+0000 7f876aa00640 1 -- 172.21.15.110:0/4189542488 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f877000fe50 con 0x55f8185e1dd0 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.465+0000 7f876aa00640 1 -- 172.21.15.110:0/4189542488 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700193e0 con 0x55f8185e1dd0 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.465+0000 7f8776000640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f87600a3e40 0x7f87600a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.465+0000 7f8783075740 1 -- 172.21.15.110:0/4189542488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 msgr2=0x55f8185e21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.465+0000 7f8783075740 1 --2- 172.21.15.110:0/4189542488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e21b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8770011850 tx=0x7f8770011d10 comp rx=0 tx=0).stop 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f8776000640 1 -- 172.21.15.110:0/2111902833 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f87640d0b60 con 0x7f8778075550 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f877d800640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f87600a3e40 0x7f87600a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f8783075740 1 -- 172.21.15.110:0/4189542488 shutdown_connections 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f8783075740 1 --2- 172.21.15.110:0/4189542488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f8783075740 1 --2- 172.21.15.110:0/4189542488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e26f0 0x55f8185eca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f8783075740 1 --2- 172.21.15.110:0/4189542488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e21b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f8783075740 1 -- 172.21.15.110:0/4189542488 >> 172.21.15.110:0/4189542488 conn(0x55f8185de2e0 msgr2=0x55f8185de6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f8783075740 1 -- 172.21.15.110:0/4189542488 shutdown_connections 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f8783075740 1 -- 172.21.15.110:0/4189542488 wait complete. 2024-04-26T11:33:19.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f8783075740 1 -- start start 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.466+0000 7f877d800640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f87600a3e40 0x7f87600a6300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f876c031440 tx=0x7f876c005b90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f8783075740 1 Processor -- start 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f8783075740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f8783075740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185ea3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f8783075740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185ecfb0 0x55f8185ea910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f8783075740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f8185efbe0 con 0x55f8185e26f0 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f8783075740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f8184cec60 con 0x55f8185e1dd0 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f8783075740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f8185efd60 con 0x55f8185ecfb0 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f8783075740 10 client.0 _ll_register_callbacks cb 0x55f8184fae50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f877ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185ea3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.467+0000 7f877d800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185ea3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56214/0 (socket says 172.21.15.110:56214) 2024-04-26T11:33:19.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877ce00640 1 -- 172.21.15.110:0/2341891523 learned_addr learned my addr 172.21.15.110:0/2341891523 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877d800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:32972/0 (socket says 172.21.15.110:32972) 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877e200640 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185ecfb0 0x55f8185ea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877ce00640 1 -- 172.21.15.110:0/2341891523 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185ecfb0 msgr2=0x55f8185ea910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877ce00640 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185ecfb0 0x55f8185ea910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877ce00640 1 -- 172.21.15.110:0/2341891523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 msgr2=0x55f8185e9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877ce00640 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877ce00640 1 -- 172.21.15.110:0/2341891523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8184dd510 con 0x55f8185e26f0 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f877ce00640 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185ea3d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f87640ce230 tx=0x7f8764010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56610e5ca268db70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f875f400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.468+0000 7f875f400640 1 -- 172.21.15.110:0/2341891523 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640a5690 con 0x55f8185e26f0 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f875f400640 1 -- 172.21.15.110:0/2341891523 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f87640ce450 con 0x55f8185e26f0 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f8783075740 1 -- 172.21.15.110:0/2341891523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f877000fe50 con 0x55f8185e26f0 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f875f400640 1 -- 172.21.15.110:0/2341891523 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f87640ce650 con 0x55f8185e26f0 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f8783075740 10 client.15318 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f8783075740 1 -- 172.21.15.110:0/2341891523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f818259210 con 0x55f8185e26f0 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f875f400640 1 -- 172.21.15.110:0/2341891523 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f877000fe50 con 0x55f8185e26f0 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f875f400640 1 -- 172.21.15.110:0/2341891523 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f87640989f0 con 0x55f8185e26f0 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f8783075740 10 client.15318 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f8783075740 10 client.15318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f8783075740 20 client.15318 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f8783075740 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f8185fcbc0 0x55f8185ff010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f8783075740 4 client.15318 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.469+0000 7f8783075740 1 -- 172.21.15.110:0/2341891523 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f818554f90 con 0x55f8185fcbc0 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.470+0000 7f877d800640 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f8185fcbc0 0x55f8185ff010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.470+0000 7f877d800640 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f8185fcbc0 0x55f8185ff010 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9317ee9fc43cc81 server_cookie=f642d3d361ba4460 in_seq=0 out_seq=0 2024-04-26T11:33:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.470+0000 7f875f400640 10 client.15318 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.471+0000 7f875f400640 1 -- 172.21.15.110:0/2341891523 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f818554f90 con 0x55f8185fcbc0 2024-04-26T11:33:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.471+0000 7f875f400640 10 client.15318 handle_command_reply: tid=0 2024-04-26T11:33:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.471+0000 7f8783075740 1 client.15318 shutdown 2024-04-26T11:33:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 -- 172.21.15.110:0/2341891523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 msgr2=0x55f8185ea3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185ea3d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f87640ce230 tx=0x7f8764010860 comp rx=0 tx=0).stop 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 -- 172.21.15.110:0/2341891523 shutdown_connections 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f8185fcbc0 0x55f8185ff010 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185ecfb0 0x55f8185ea910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185ea3d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f875f400640 0 client.15318 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 --2- 172.21.15.110:0/2341891523 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e1dd0 0x55f8185e9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 -- 172.21.15.110:0/2341891523 >> 172.21.15.110:0/2341891523 conn(0x55f8185de2e0 msgr2=0x55f8185e4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 -- 172.21.15.110:0/2341891523 shutdown_connections 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 1 -- 172.21.15.110:0/2341891523 wait complete. 2024-04-26T11:33:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.472+0000 7f8783075740 20 client.15318 trim_cache size 0 max 16384 2024-04-26T11:33:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.488+0000 7f8783075740 1 Processor -- start 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.488+0000 7f8783075740 1 -- start start 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.488+0000 7f8783075740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 0x55f8185f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.488+0000 7f8783075740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185e4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.488+0000 7f8783075740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185ecfb0 0x55f8185e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.488+0000 7f8783075740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f87781b32b0 con 0x55f8185e26f0 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.488+0000 7f8783075740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f87781b0af0 con 0x55f8185ecfb0 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.488+0000 7f8783075740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f87781ae940 con 0x55f8185e1dd0 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185e4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56222/0 (socket says 172.21.15.110:56222) 2024-04-26T11:33:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877ce00640 1 -- 172.21.15.110:0/3206181946 learned_addr learned my addr 172.21.15.110:0/3206181946 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:19.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877d800640 1 --2- 172.21.15.110:0/3206181946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 0x55f8185f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877e200640 1 --2- 172.21.15.110:0/3206181946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185ecfb0 0x55f8185e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877ce00640 1 -- 172.21.15.110:0/3206181946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 msgr2=0x55f8185f8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877ce00640 1 --2- 172.21.15.110:0/3206181946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 0x55f8185f8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877ce00640 1 -- 172.21.15.110:0/3206181946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185ecfb0 msgr2=0x55f8185e8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877ce00640 1 --2- 172.21.15.110:0/3206181946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185ecfb0 0x55f8185e8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877ce00640 1 -- 172.21.15.110:0/3206181946 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f818325620 con 0x55f8185e26f0 2024-04-26T11:33:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.489+0000 7f877ce00640 1 --2- 172.21.15.110:0/3206181946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185e4790 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8764098f30 tx=0x7f87640d0de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21308e28f0c8768c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f876a000640 1 -- 172.21.15.110:0/3206181946 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640ce450 con 0x55f8185e26f0 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f876a000640 1 -- 172.21.15.110:0/3206181946 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87640ce5f0 con 0x55f8185e26f0 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f876a000640 1 -- 172.21.15.110:0/3206181946 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640a2050 con 0x55f8185e26f0 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f8783075740 1 -- 172.21.15.110:0/3206181946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 msgr2=0x55f8185e4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f8783075740 1 --2- 172.21.15.110:0/3206181946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185e4790 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8764098f30 tx=0x7f87640d0de0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f8783075740 1 -- 172.21.15.110:0/3206181946 shutdown_connections 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f8783075740 1 --2- 172.21.15.110:0/3206181946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185ecfb0 0x55f8185e8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f8783075740 1 --2- 172.21.15.110:0/3206181946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185e26f0 0x55f8185e4790 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f8783075740 1 --2- 172.21.15.110:0/3206181946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 0x55f8185f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f8783075740 1 -- 172.21.15.110:0/3206181946 >> 172.21.15.110:0/3206181946 conn(0x55f8185de2e0 msgr2=0x55f8185dcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.490+0000 7f8783075740 1 -- 172.21.15.110:0/3206181946 shutdown_connections 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.491+0000 7f8783075740 1 -- 172.21.15.110:0/3206181946 wait complete. 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.491+0000 7f8783075740 1 -- start start 2024-04-26T11:33:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.491+0000 7f8783075740 1 Processor -- start 2024-04-26T11:33:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f8783075740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 0x55f8185e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f8783075740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e26f0 0x55f8185e7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f8783075740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185e7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f8783075740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f87781aefb0 con 0x55f8185ecfb0 2024-04-26T11:33:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f8783075740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f87781b0420 con 0x55f8185e26f0 2024-04-26T11:33:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f8783075740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f87781af680 con 0x55f8185e1dd0 2024-04-26T11:33:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f8783075740 10 client.0 _ll_register_callbacks cb 0x7f876409c500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877d800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 0x55f8185e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877ce00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e26f0 0x55f8185e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877d800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 0x55f8185e6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:47060/0 (socket says 172.21.15.110:47060) 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877d800640 1 -- 172.21.15.110:0/1743795346 learned_addr learned my addr 172.21.15.110:0/1743795346 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877ce00640 1 -- 172.21.15.110:0/1743795346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 msgr2=0x55f8185e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877ce00640 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 0x55f8185e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877ce00640 1 -- 172.21.15.110:0/1743795346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 msgr2=0x55f8185e7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877ce00640 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185e7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877ce00640 1 -- 172.21.15.110:0/1743795346 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f818501cb0 con 0x55f8185e26f0 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.492+0000 7f877e200640 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f877ce00640 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e26f0 0x55f8185e7300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55f8185eaed0 tx=0x7f87640d0ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad3bcd812d75292c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f875f400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f875f400640 1 -- 172.21.15.110:0/1743795346 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640ce450 con 0x55f8185e26f0 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f875f400640 1 -- 172.21.15.110:0/1743795346 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f87640a2050 con 0x55f8185e26f0 2024-04-26T11:33:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f8783075740 1 -- 172.21.15.110:0/1743795346 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87640ce5f0 con 0x55f8185e26f0 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f875f400640 1 -- 172.21.15.110:0/1743795346 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f87640a2290 con 0x55f8185e26f0 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f8783075740 10 client.25439 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f8783075740 1 -- 172.21.15.110:0/1743795346 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f818501cb0 con 0x55f8185e26f0 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f875f400640 1 -- 172.21.15.110:0/1743795346 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87640ce5f0 con 0x55f8185e26f0 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.493+0000 7f875f400640 1 -- 172.21.15.110:0/1743795346 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f8764018b20 con 0x55f8185e26f0 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.494+0000 7f8783075740 10 client.25439 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.494+0000 7f8783075740 10 client.25439 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.494+0000 7f8783075740 20 client.25439 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.494+0000 7f8783075740 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f818663840 0x55f818665c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.494+0000 7f8783075740 4 client.25439 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.494+0000 7f8783075740 1 -- 172.21.15.110:0/1743795346 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f81854ee00 con 0x55f818663840 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.494+0000 7f877d800640 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f818663840 0x55f818665c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.495+0000 7f877d800640 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f818663840 0x55f818665c30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd73bcd51d18f7cd server_cookie=2f2dddea1bd19755 in_seq=0 out_seq=0 2024-04-26T11:33:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.495+0000 7f875f400640 10 client.25439 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.508+0000 7f875f400640 1 -- 172.21.15.110:0/1743795346 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f81854ee00 con 0x55f818663840 2024-04-26T11:33:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.508+0000 7f875f400640 10 client.25439 handle_command_reply: tid=0 2024-04-26T11:33:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 client.25439 shutdown 2024-04-26T11:33:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 -- 172.21.15.110:0/1743795346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e26f0 msgr2=0x55f8185e7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e26f0 0x55f8185e7300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55f8185eaed0 tx=0x7f87640d0ec0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 -- 172.21.15.110:0/1743795346 shutdown_connections 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f8185ecfb0 0x55f8185e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8185e26f0 0x55f8185e7300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f818663840 0x55f818665c30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 --2- 172.21.15.110:0/1743795346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f8185e1dd0 0x55f8185e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 -- 172.21.15.110:0/1743795346 >> 172.21.15.110:0/1743795346 conn(0x55f8185de2e0 msgr2=0x55f8185dcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f875f400640 0 client.25439 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 -- 172.21.15.110:0/1743795346 shutdown_connections 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 1 -- 172.21.15.110:0/1743795346 wait complete. 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.509+0000 7f8783075740 20 client.25439 trim_cache size 0 max 16384 2024-04-26T11:33:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:33:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:33:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:33:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 -- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f87600a3e40 msgr2=0x7f87600a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f87600a3e40 0x7f87600a6300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f876c031440 tx=0x7f876c005b90 comp rx=0 tx=0).stop 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 -- 172.21.15.110:0/2111902833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778075550 msgr2=0x7f877819b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778075550 0x7f877819b760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f876400e9f0 tx=0x7f876400eeb0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 -- 172.21.15.110:0/2111902833 shutdown_connections 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f87600a3e40 0x7f87600a6300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f877810f220 0x7f877819fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8778075550 0x7f877819b760 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 --2- 172.21.15.110:0/2111902833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8778074c30 0x7f877819b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.510+0000 7f8780200640 1 -- 172.21.15.110:0/2111902833 >> 172.21.15.110:0/2111902833 conn(0x7f8778079dc0 msgr2=0x7f87780ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.511+0000 7f8780200640 1 -- 172.21.15.110:0/2111902833 shutdown_connections 2024-04-26T11:33:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:19.511+0000 7f8780200640 1 -- 172.21.15.110:0/2111902833 wait complete. 2024-04-26T11:33:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:19 smithi193 ceph-mon[32782]: pgmap v64: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 34 MiB/s wr, 734 op/s 2024-04-26T11:33:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:19 smithi196 ceph-mon[32572]: pgmap v64: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 34 MiB/s wr, 734 op/s 2024-04-26T11:33:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:19 smithi110 ceph-mon[28069]: pgmap v64: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 34 MiB/s wr, 734 op/s 2024-04-26T11:33:19.925 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 65.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:33:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:21 smithi193 ceph-mon[32782]: pgmap v65: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 157 KiB/s wr, 25 op/s 2024-04-26T11:33:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:21 smithi196 ceph-mon[32572]: pgmap v65: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 157 KiB/s wr, 25 op/s 2024-04-26T11:33:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:21 smithi110 ceph-mon[28069]: pgmap v65: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 157 KiB/s wr, 25 op/s 2024-04-26T11:33:23.120 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:33:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:23 smithi110 ceph-mon[28069]: pgmap v66: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 157 KiB/s wr, 25 op/s 2024-04-26T11:33:23.569 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:33:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:23 smithi193 ceph-mon[32782]: pgmap v66: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 157 KiB/s wr, 25 op/s 2024-04-26T11:33:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:23 smithi196 ceph-mon[32572]: pgmap v66: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 157 KiB/s wr, 25 op/s 2024-04-26T11:33:24.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 70.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:33:25.730 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:25 smithi110 ceph-mon[28069]: pgmap v67: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 223 KiB/s wr, 32 op/s 2024-04-26T11:33:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:25 smithi196 ceph-mon[32572]: pgmap v67: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 223 KiB/s wr, 32 op/s 2024-04-26T11:33:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:25 smithi193 ceph-mon[32782]: pgmap v67: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 223 KiB/s wr, 32 op/s 2024-04-26T11:33:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.069+0000 7fe39d800700 1 -- 172.21.15.110:0/3527376369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398108350 msgr2=0x7fe39806b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.069+0000 7fe39d800700 1 --2- 172.21.15.110:0/3527376369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398108350 0x7fe39806b130 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe38800b0a0 tx=0x7fe38800b3b0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.069+0000 7fe39d800700 1 -- 172.21.15.110:0/3527376369 shutdown_connections 2024-04-26T11:33:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.069+0000 7fe39d800700 1 --2- 172.21.15.110:0/3527376369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe398105e60 0x7fe3981062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.069+0000 7fe39d800700 1 --2- 172.21.15.110:0/3527376369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398108350 0x7fe39806b130 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.069+0000 7fe39d800700 1 --2- 172.21.15.110:0/3527376369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe39806b670 0x7fe39806bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.069+0000 7fe39d800700 1 -- 172.21.15.110:0/3527376369 >> 172.21.15.110:0/3527376369 conn(0x7fe3980792d0 msgr2=0x7fe3980796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.069+0000 7fe39d800700 1 -- 172.21.15.110:0/3527376369 shutdown_connections 2024-04-26T11:33:26.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.069+0000 7fe39d800700 1 -- 172.21.15.110:0/3527376369 wait complete. 2024-04-26T11:33:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.070+0000 7fe39d800700 1 Processor -- start 2024-04-26T11:33:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.070+0000 7fe39d800700 1 -- start start 2024-04-26T11:33:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe39d800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe39806b670 0x7fe3981a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe39d800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398105e60 0x7fe3981a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe39d800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe398108350 0x7fe3981a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe39d800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe398119be0 con 0x7fe398105e60 2024-04-26T11:33:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe39d800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe398119a60 con 0x7fe398108350 2024-04-26T11:33:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe39d800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe398119d60 con 0x7fe39806b670 2024-04-26T11:33:26.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe38e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398105e60 0x7fe3981a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe396a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe39806b670 0x7fe3981a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe38e000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398105e60 0x7fe3981a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54646/0 (socket says 172.21.15.110:54646) 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe38e000700 1 -- 172.21.15.110:0/3247326333 learned_addr learned my addr 172.21.15.110:0/3247326333 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.071+0000 7fe397400700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe398108350 0x7fe3981a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.072+0000 7fe396a00700 1 -- 172.21.15.110:0/3247326333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe398108350 msgr2=0x7fe3981a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.072+0000 7fe396a00700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe398108350 0x7fe3981a4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.072+0000 7fe396a00700 1 -- 172.21.15.110:0/3247326333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398105e60 msgr2=0x7fe3981a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.072+0000 7fe396a00700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398105e60 0x7fe3981a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.072+0000 7fe396a00700 1 -- 172.21.15.110:0/3247326333 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3981a5220 con 0x7fe39806b670 2024-04-26T11:33:26.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.072+0000 7fe396a00700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe39806b670 0x7fe3981a0210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe38800b070 tx=0x7fe388004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:26.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.072+0000 7fe38fe00700 1 -- 172.21.15.110:0/3247326333 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388021070 con 0x7fe39806b670 2024-04-26T11:33:26.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.073+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3981a54b0 con 0x7fe39806b670 2024-04-26T11:33:26.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.073+0000 7fe38fe00700 1 -- 172.21.15.110:0/3247326333 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe388007e30 con 0x7fe39806b670 2024-04-26T11:33:26.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.073+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3981acd90 con 0x7fe39806b670 2024-04-26T11:33:26.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.073+0000 7fe38fe00700 1 -- 172.21.15.110:0/3247326333 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388004710 con 0x7fe39806b670 2024-04-26T11:33:26.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.074+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39806a110 con 0x7fe39806b670 2024-04-26T11:33:26.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.076+0000 7fe38fe00700 1 -- 172.21.15.110:0/3247326333 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe388007980 con 0x7fe39806b670 2024-04-26T11:33:26.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.077+0000 7fe38fe00700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe37c0a3e30 0x7fe37c0a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:26.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.077+0000 7fe38fe00700 1 -- 172.21.15.110:0/3247326333 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fe38800f020 con 0x7fe39806b670 2024-04-26T11:33:26.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.077+0000 7fe38e000700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe37c0a3e30 0x7fe37c0a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:26.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.078+0000 7fe38e000700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe37c0a3e30 0x7fe37c0a62f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe398079c20 tx=0x7fe380009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:26.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.080+0000 7fe38fe00700 1 -- 172.21.15.110:0/3247326333 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe38802a020 con 0x7fe39806b670 2024-04-26T11:33:26.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.355+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3981acf60 con 0x7fe39806b670 2024-04-26T11:33:26.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.356+0000 7fe38fe00700 1 -- 172.21.15.110:0/3247326333 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11896 (secure 0 0 0) 0x7fe38809e5c0 con 0x7fe39806b670 2024-04-26T11:33:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:33:26.358 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:32:17.630171+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24487,24502]},"id":1}]} 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe37c0a3e30 msgr2=0x7fe37c0a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe37c0a3e30 0x7fe37c0a62f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe398079c20 tx=0x7fe380009260 comp rx=0 tx=0).stop 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe39806b670 msgr2=0x7fe3981a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe39806b670 0x7fe3981a0210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe38800b070 tx=0x7fe388004d00 comp rx=0 tx=0).stop 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 shutdown_connections 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe37c0a3e30 0x7fe37c0a62f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe398108350 0x7fe3981a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe39806b670 0x7fe3981a0210 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 --2- 172.21.15.110:0/3247326333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398105e60 0x7fe3981a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.359+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 >> 172.21.15.110:0/3247326333 conn(0x7fe3980792d0 msgr2=0x7fe398104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.360+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 shutdown_connections 2024-04-26T11:33:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:26.360+0000 7fe39d800700 1 -- 172.21.15.110:0/3247326333 wait complete. 2024-04-26T11:33:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 30 2024-04-26T11:33:26.702 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:26 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/3247326333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:33:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:26 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/3247326333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:33:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:26 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/3247326333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:33:27.319 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db --set-id d1ba88c5 --release --await' 2024-04-26T11:33:27.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db --set-id d1ba88c5 --release --await 2024-04-26T11:33:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:27 smithi110 ceph-mon[28069]: pgmap v68: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 221 KiB/s wr, 29 op/s 2024-04-26T11:33:27.745 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:33:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:27 smithi196 ceph-mon[32572]: pgmap v68: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 221 KiB/s wr, 29 op/s 2024-04-26T11:33:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:27 smithi193 ceph-mon[32782]: pgmap v68: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 221 KiB/s wr, 29 op/s 2024-04-26T11:33:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:33:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:33:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:33:29.716 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:29 smithi110 ceph-mon[28069]: pgmap v69: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 226 KiB/s wr, 32 op/s 2024-04-26T11:33:29.716 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:33:29.716 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:33:29.716 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:33:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:29 smithi196 ceph-mon[32572]: pgmap v69: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 226 KiB/s wr, 32 op/s 2024-04-26T11:33:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:33:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:33:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:33:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:29 smithi193 ceph-mon[32782]: pgmap v69: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 226 KiB/s wr, 32 op/s 2024-04-26T11:33:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:33:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:33:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:33:29.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 75.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:33:30.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.270+0000 7f27c6000700 1 -- 172.21.15.110:0/3532211165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c01094c0 msgr2=0x7f27c01098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:30.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.270+0000 7f27c6000700 1 --2- 172.21.15.110:0/3532211165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c01094c0 0x7f27c01098a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009990 tx=0x7f27b0009ca0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.270+0000 7f27c6000700 1 -- 172.21.15.110:0/3532211165 shutdown_connections 2024-04-26T11:33:30.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.270+0000 7f27c6000700 1 --2- 172.21.15.110:0/3532211165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c006c490 0x7f27c0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.270+0000 7f27c6000700 1 --2- 172.21.15.110:0/3532211165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c01094c0 0x7f27c01098a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.270+0000 7f27c6000700 1 --2- 172.21.15.110:0/3532211165 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27c006baf0 0x7f27c006bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.270+0000 7f27c6000700 1 -- 172.21.15.110:0/3532211165 >> 172.21.15.110:0/3532211165 conn(0x7f27c00792d0 msgr2=0x7f27c00796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:30.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.270+0000 7f27c6000700 1 -- 172.21.15.110:0/3532211165 shutdown_connections 2024-04-26T11:33:30.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.270+0000 7f27c6000700 1 -- 172.21.15.110:0/3532211165 wait complete. 2024-04-26T11:33:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.271+0000 7f27c6000700 1 Processor -- start 2024-04-26T11:33:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27c6000700 1 -- start start 2024-04-26T11:33:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27c6000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c006baf0 0x7f27c01027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27c6000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c006c490 0x7f27c0102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27c6000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27c01094c0 0x7f27c0103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27c6000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f27c01135d0 con 0x7f27c006c490 2024-04-26T11:33:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27c6000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f27c0113450 con 0x7f27c01094c0 2024-04-26T11:33:30.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27c6000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27c0113750 con 0x7f27c006baf0 2024-04-26T11:33:30.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27bea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c006c490 0x7f27c0102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27bf400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c006baf0 0x7f27c01027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27bea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c006c490 0x7f27c0102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54662/0 (socket says 172.21.15.110:54662) 2024-04-26T11:33:30.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27bea00700 1 -- 172.21.15.110:0/1792430412 learned_addr learned my addr 172.21.15.110:0/1792430412 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:30.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.272+0000 7f27bf400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c006baf0 0x7f27c01027d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:55362/0 (socket says 172.21.15.110:55362) 2024-04-26T11:33:30.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.273+0000 7f27bfe00700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27c01094c0 0x7f27c0103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.273+0000 7f27bf400700 1 -- 172.21.15.110:0/1792430412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27c01094c0 msgr2=0x7f27c0103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:30.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.273+0000 7f27bf400700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27c01094c0 0x7f27c0103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.273+0000 7f27bf400700 1 -- 172.21.15.110:0/1792430412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c006c490 msgr2=0x7f27c0102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:30.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.273+0000 7f27bf400700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c006c490 0x7f27c0102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.273+0000 7f27bf400700 1 -- 172.21.15.110:0/1792430412 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c01a8010 con 0x7f27c006baf0 2024-04-26T11:33:30.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.273+0000 7f27bf400700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c006baf0 0x7f27c01027d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f27b0006010 tx=0x7f27b00057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:30.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.274+0000 7f27b7e00700 1 -- 172.21.15.110:0/1792430412 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0027070 con 0x7f27c006baf0 2024-04-26T11:33:30.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.274+0000 7f27c6000700 1 -- 172.21.15.110:0/1792430412 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c01a82a0 con 0x7f27c006baf0 2024-04-26T11:33:30.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.274+0000 7f27b7e00700 1 -- 172.21.15.110:0/1792430412 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b0022470 con 0x7f27c006baf0 2024-04-26T11:33:30.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.274+0000 7f27b7e00700 1 -- 172.21.15.110:0/1792430412 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0017650 con 0x7f27c006baf0 2024-04-26T11:33:30.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.274+0000 7f27c6000700 1 -- 172.21.15.110:0/1792430412 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c01a8750 con 0x7f27c006baf0 2024-04-26T11:33:30.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.277+0000 7f27b7e00700 1 -- 172.21.15.110:0/1792430412 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f27b002a070 con 0x7f27c006baf0 2024-04-26T11:33:30.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.278+0000 7f27d08c9b80 1 Processor -- start 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.278+0000 7f27b7e00700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f27a40a3db0 0x7f27a40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27d08c9b80 1 -- start start 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27b7e00700 1 -- 172.21.15.110:0/1792430412 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f27b00d14f0 con 0x7f27c006baf0 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27bfe00700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f27a40a3db0 0x7f27a40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 0x55d874e7d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e876f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 0x55d874e8a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d874dd0ae0 con 0x55d874e7de80 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d874d6f340 con 0x55d874e7d560 2024-04-26T11:33:30.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d874dccaa0 con 0x55d874e87c30 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.279+0000 7f27bea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e876f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bf400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 0x55d874e7d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e876f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54668/0 (socket says 172.21.15.110:54668) 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bea00700 1 -- 172.21.15.110:0/989346384 learned_addr learned my addr 172.21.15.110:0/989346384 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bfe00700 1 --2- 172.21.15.110:0/989346384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 0x55d874e8a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bf400700 1 -- 172.21.15.110:0/989346384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 msgr2=0x55d874e8a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bf400700 1 --2- 172.21.15.110:0/989346384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 0x55d874e8a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bf400700 1 -- 172.21.15.110:0/989346384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 msgr2=0x55d874e876f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bf400700 1 --2- 172.21.15.110:0/989346384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e876f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bf400700 1 -- 172.21.15.110:0/989346384 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d874d77860 con 0x55d874e7d560 2024-04-26T11:33:30.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bfe00700 1 --2- 172.21.15.110:0/989346384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 0x55d874e8a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bfe00700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f27a40a3db0 0x7f27a40a6270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27b80093d0 tx=0x7f27b800b040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.280+0000 7f27bf400700 1 --2- 172.21.15.110:0/989346384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 0x55d874e7d940 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27b00ceb60 tx=0x7f27b009d210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb17ab0891608d3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27b4c00700 1 -- 172.21.15.110:0/989346384 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b009db40 con 0x55d874e7d560 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27b4c00700 1 -- 172.21.15.110:0/989346384 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b009d440 con 0x55d874e7d560 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27b4c00700 1 -- 172.21.15.110:0/989346384 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b009d6a0 con 0x55d874e7d560 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27d08c9b80 1 -- 172.21.15.110:0/989346384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 msgr2=0x55d874e7d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/989346384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 0x55d874e7d940 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27b00ceb60 tx=0x7f27b009d210 comp rx=0 tx=0).stop 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27d08c9b80 1 -- 172.21.15.110:0/989346384 shutdown_connections 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/989346384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 0x55d874e8a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/989346384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 0x55d874e7d940 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/989346384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e876f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.281+0000 7f27d08c9b80 1 -- 172.21.15.110:0/989346384 >> 172.21.15.110:0/989346384 conn(0x55d874dab540 msgr2=0x55d874e788a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.282+0000 7f27d08c9b80 1 -- 172.21.15.110:0/989346384 shutdown_connections 2024-04-26T11:33:30.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.282+0000 7f27d08c9b80 1 -- 172.21.15.110:0/989346384 wait complete. 2024-04-26T11:33:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.282+0000 7f27d08c9b80 1 -- start start 2024-04-26T11:33:30.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.282+0000 7f27d08c9b80 1 Processor -- start 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 0x55d874e874b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e847b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e84cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d874e8a560 con 0x55d874e87c30 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d874d6b590 con 0x55d874e7de80 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d874e8a6e0 con 0x55d874e7d560 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27d08c9b80 10 client.0 _ll_register_callbacks cb 0x55d874d64480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27bea00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27bea00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e847b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:49618/0 (socket says 172.21.15.110:49618) 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27bea00700 1 -- 172.21.15.110:0/2052079139 learned_addr learned my addr 172.21.15.110:0/2052079139 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.283+0000 7f27bf400700 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 0x55d874e874b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27bfe00700 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e84cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27bea00700 1 -- 172.21.15.110:0/2052079139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 msgr2=0x55d874e874b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27bea00700 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 0x55d874e874b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27bea00700 1 -- 172.21.15.110:0/2052079139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 msgr2=0x55d874e84cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27bea00700 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e84cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27bea00700 1 -- 172.21.15.110:0/2052079139 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d874d1d9d0 con 0x55d874e7de80 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27bfe00700 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e84cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27bea00700 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e847b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27ac012810 tx=0x7f27ac012bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c021109c785886 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27a9600700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27a9600700 1 -- 172.21.15.110:0/2052079139 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac00f640 con 0x55d874e7de80 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2052079139 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27b009d440 con 0x55d874e7de80 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.284+0000 7f27a9600700 1 -- 172.21.15.110:0/2052079139 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f27ac00f7e0 con 0x55d874e7de80 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27a9600700 1 -- 172.21.15.110:0/2052079139 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27ac00f9e0 con 0x55d874e7de80 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27d08c9b80 10 client.25457 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:30.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2052079139 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d874e94f10 con 0x55d874e7de80 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27a9600700 1 -- 172.21.15.110:0/2052079139 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27b009d440 con 0x55d874e7de80 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27a9600700 1 -- 172.21.15.110:0/2052079139 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f27ac010bb0 con 0x55d874e7de80 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27d08c9b80 10 client.25457 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27d08c9b80 10 client.25457 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27d08c9b80 20 client.25457 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d874e975f0 0x55d874e99a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27d08c9b80 4 client.25457 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.285+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2052079139 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d874e49c70 con 0x55d874e975f0 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.286+0000 7f27bf400700 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d874e975f0 0x55d874e99a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.286+0000 7f27a9600700 10 client.25457 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.286+0000 7f27bf400700 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d874e975f0 0x55d874e99a00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6a2806fd2b5ed70 server_cookie=359e19eae6f7793a in_seq=0 out_seq=0 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.287+0000 7f27a9600700 1 -- 172.21.15.110:0/2052079139 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d874e49c70 con 0x55d874e975f0 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.287+0000 7f27a9600700 10 client.25457 handle_command_reply: tid=0 2024-04-26T11:33:30.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.287+0000 7f27d08c9b80 1 client.25457 shutdown 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2052079139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 msgr2=0x55d874e847b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e847b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f27ac012810 tx=0x7f27ac012bd0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2052079139 shutdown_connections 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d874e975f0 0x55d874e99a00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e84cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 0x55d874e874b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27a9600700 0 client.25457 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2052079139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e847b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2052079139 >> 172.21.15.110:0/2052079139 conn(0x55d874dab540 msgr2=0x55d874e7a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2052079139 shutdown_connections 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2052079139 wait complete. 2024-04-26T11:33:30.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.288+0000 7f27d08c9b80 20 client.25457 trim_cache size 0 max 16384 2024-04-26T11:33:30.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.309+0000 7f27d08c9b80 1 Processor -- start 2024-04-26T11:33:30.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.309+0000 7f27d08c9b80 1 -- start start 2024-04-26T11:33:30.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 0x55d874e86ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e9f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 0x55d874e9f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f27c01b2930 con 0x55d874e7de80 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f27c01b0130 con 0x55d874e7d560 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27c01adf80 con 0x55d874e87c30 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e9f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bea00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e9f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54678/0 (socket says 172.21.15.110:54678) 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bea00700 1 -- 172.21.15.110:0/3660523580 learned_addr learned my addr 172.21.15.110:0/3660523580 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bfe00700 1 --2- 172.21.15.110:0/3660523580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 0x55d874e9f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bf400700 1 --2- 172.21.15.110:0/3660523580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 0x55d874e86ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bea00700 1 -- 172.21.15.110:0/3660523580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 msgr2=0x55d874e9f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bea00700 1 --2- 172.21.15.110:0/3660523580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 0x55d874e9f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bea00700 1 -- 172.21.15.110:0/3660523580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 msgr2=0x55d874e86ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:30.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bea00700 1 --2- 172.21.15.110:0/3660523580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 0x55d874e86ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.310+0000 7f27bea00700 1 -- 172.21.15.110:0/3660523580 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d874e78150 con 0x55d874e7de80 2024-04-26T11:33:30.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.311+0000 7f27bea00700 1 --2- 172.21.15.110:0/3660523580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e9f2d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0096b0 tx=0x7f27ac009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513ba5fd012fcc0e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.311+0000 7f27abe00700 1 -- 172.21.15.110:0/3660523580 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac00f640 con 0x55d874e7de80 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.311+0000 7f27abe00700 1 -- 172.21.15.110:0/3660523580 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27ac00f7e0 con 0x55d874e7de80 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.311+0000 7f27abe00700 1 -- 172.21.15.110:0/3660523580 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0038e0 con 0x55d874e7de80 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.312+0000 7f27d08c9b80 1 -- 172.21.15.110:0/3660523580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 msgr2=0x55d874e9f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.312+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/3660523580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e9f2d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0096b0 tx=0x7f27ac009970 comp rx=0 tx=0).stop 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.312+0000 7f27d08c9b80 1 -- 172.21.15.110:0/3660523580 shutdown_connections 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.312+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/3660523580 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e87c30 0x55d874e9f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.312+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/3660523580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7d560 0x55d874e86ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.312+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/3660523580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e7de80 0x55d874e9f2d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.312+0000 7f27d08c9b80 1 -- 172.21.15.110:0/3660523580 >> 172.21.15.110:0/3660523580 conn(0x55d874dab540 msgr2=0x55d874e7cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:30.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.312+0000 7f27d08c9b80 1 -- 172.21.15.110:0/3660523580 shutdown_connections 2024-04-26T11:33:30.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.312+0000 7f27d08c9b80 1 -- 172.21.15.110:0/3660523580 wait complete. 2024-04-26T11:33:30.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.313+0000 7f27d08c9b80 1 -- start start 2024-04-26T11:33:30.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.313+0000 7f27d08c9b80 1 Processor -- start 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.313+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 0x55d874e8c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.313+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e8c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.313+0000 7f27d08c9b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e8cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.313+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f27c01ae5f0 con 0x55d874e87c30 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.313+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f27c01afa60 con 0x55d874e7de80 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.313+0000 7f27d08c9b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27c01aecc0 con 0x55d874e7d560 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27d08c9b80 10 client.0 _ll_register_callbacks cb 0x55d874d64480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bf400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 0x55d874e8c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bea00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e8c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bf400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 0x55d874e8c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:55396/0 (socket says 172.21.15.110:55396) 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bf400700 1 -- 172.21.15.110:0/2198108247 learned_addr learned my addr 172.21.15.110:0/2198108247 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bfe00700 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e8cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bea00700 1 -- 172.21.15.110:0/2198108247 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 msgr2=0x55d874e8c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bea00700 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 0x55d874e8c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bea00700 1 -- 172.21.15.110:0/2198108247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 msgr2=0x55d874e8cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bea00700 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e8cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bea00700 1 -- 172.21.15.110:0/2198108247 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d874efdcc0 con 0x55d874e7de80 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.314+0000 7f27bfe00700 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e8cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.315+0000 7f27bea00700 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e8c9e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55d874e80120 tx=0x7f27ac01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=904518938f8ef4aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.315+0000 7f27a9600700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.315+0000 7f27a9600700 1 -- 172.21.15.110:0/2198108247 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0052e0 con 0x55d874e7de80 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.315+0000 7f27a9600700 1 -- 172.21.15.110:0/2198108247 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f27ac003680 con 0x55d874e7de80 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.315+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2198108247 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27ac00f7e0 con 0x55d874e7de80 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.315+0000 7f27a9600700 1 -- 172.21.15.110:0/2198108247 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27ac005480 con 0x55d874e7de80 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.315+0000 7f27d08c9b80 10 client.25463 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.315+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2198108247 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d874efefe0 con 0x55d874e7de80 2024-04-26T11:33:30.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.316+0000 7f27a9600700 1 -- 172.21.15.110:0/2198108247 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27ac00f7e0 con 0x55d874e7de80 2024-04-26T11:33:30.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.316+0000 7f27a9600700 1 -- 172.21.15.110:0/2198108247 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f27ac01cbb0 con 0x55d874e7de80 2024-04-26T11:33:30.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.316+0000 7f27d08c9b80 10 client.25463 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:30.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.316+0000 7f27d08c9b80 10 client.25463 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:33:30.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.316+0000 7f27d08c9b80 20 client.25463 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:30.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.316+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d874eff600 0x55d874f01a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:30.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.316+0000 7f27d08c9b80 4 client.25463 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d1ba88c5", "release": true, "await": true}] 2024-04-26T11:33:30.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.316+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2198108247 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d1ba88c5", "release": true, "await": true}) -- 0x55d874dde4c0 con 0x55d874eff600 2024-04-26T11:33:30.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.316+0000 7f27bf400700 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d874eff600 0x55d874f01a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:30.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.317+0000 7f27bf400700 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d874eff600 0x55d874f01a20 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bd77592ad744ed5 server_cookie=818daefdf3829e35 in_seq=0 out_seq=0 2024-04-26T11:33:30.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.317+0000 7f27a9600700 10 client.25463 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:30.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.342+0000 7f27a9600700 1 -- 172.21.15.110:0/2198108247 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55d874dde4c0 con 0x55d874eff600 2024-04-26T11:33:30.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.342+0000 7f27a9600700 10 client.25463 handle_command_reply: tid=0 2024-04-26T11:33:30.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.342+0000 7f27d08c9b80 1 client.25463 shutdown 2024-04-26T11:33:30.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.343+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2198108247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 msgr2=0x55d874e8c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:30.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.343+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e8c9e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55d874e80120 tx=0x7f27ac01c470 comp rx=0 tx=0).stop 2024-04-26T11:33:30.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.344+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2198108247 shutdown_connections 2024-04-26T11:33:30.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.344+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d874eff600 0x55d874f01a20 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.344+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d874e87c30 0x55d874e8cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.344+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d874e7d560 0x55d874e8c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.344+0000 7f27d08c9b80 1 --2- 172.21.15.110:0/2198108247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d874e7de80 0x55d874e8c9e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.344+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2198108247 >> 172.21.15.110:0/2198108247 conn(0x55d874dab540 msgr2=0x55d874e83d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:30.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.344+0000 7f27a9600700 0 client.25463 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:30.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.344+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2198108247 shutdown_connections 2024-04-26T11:33:30.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.344+0000 7f27d08c9b80 1 -- 172.21.15.110:0/2198108247 wait complete. 2024-04-26T11:33:30.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.345+0000 7f27d08c9b80 20 client.25463 trim_cache size 0 max 16384 2024-04-26T11:33:30.349 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:33:30.349 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 30, 2024-04-26T11:33:30.349 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:33:30.349 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 8, 2024-04-26T11:33:30.349 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "d1ba88c5": { 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 8, 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RELEASED", 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 78.0, 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": false, 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:33:30.350 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RELEASED", 2024-04-26T11:33:30.351 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:33:30.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:30.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:30.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:30.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:30.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:33:30.351 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.349+0000 7f27c6000700 1 -- 172.21.15.110:0/1792430412 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f27a40a3db0 msgr2=0x7f27a40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.349+0000 7f27c6000700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f27a40a3db0 0x7f27a40a6270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27b80093d0 tx=0x7f27b800b040 comp rx=0 tx=0).stop 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.349+0000 7f27c6000700 1 -- 172.21.15.110:0/1792430412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c006baf0 msgr2=0x7f27c01027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.349+0000 7f27c6000700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c006baf0 0x7f27c01027d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f27b0006010 tx=0x7f27b00057c0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.351+0000 7f27c6000700 1 -- 172.21.15.110:0/1792430412 shutdown_connections 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.351+0000 7f27c6000700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f27a40a3db0 0x7f27a40a6270 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.351+0000 7f27c6000700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27c01094c0 0x7f27c0103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.351+0000 7f27c6000700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27c006baf0 0x7f27c01027d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.351+0000 7f27c6000700 1 --2- 172.21.15.110:0/1792430412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27c006c490 0x7f27c0102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:30.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.351+0000 7f27c6000700 1 -- 172.21.15.110:0/1792430412 >> 172.21.15.110:0/1792430412 conn(0x7f27c00792d0 msgr2=0x7f27c01007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:30.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.352+0000 7f27c6000700 1 -- 172.21.15.110:0/1792430412 shutdown_connections 2024-04-26T11:33:30.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:33:30.353+0000 7f27c6000700 1 -- 172.21.15.110:0/1792430412 wait complete. 2024-04-26T11:33:31.340 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd1ba88c5', seconds elapsed: 35.1 2024-04-26T11:33:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:31 smithi110 ceph-mon[28069]: pgmap v70: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 10 op/s 2024-04-26T11:33:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:31 smithi196 ceph-mon[32572]: pgmap v70: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 10 op/s 2024-04-26T11:33:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:31 smithi193 ceph-mon[32782]: pgmap v70: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 10 op/s 2024-04-26T11:33:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.681+0000 7f887a200640 1 -- 172.21.15.110:0/2688408093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874108950 msgr2=0x7f8874108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.681+0000 7f887a200640 1 --2- 172.21.15.110:0/2688408093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874108950 0x7f8874108d30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f886c009ca0 tx=0x7f886c02a8e0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.682+0000 7f887a200640 1 -- 172.21.15.110:0/2688408093 shutdown_connections 2024-04-26T11:33:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.682+0000 7f887a200640 1 --2- 172.21.15.110:0/2688408093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874103300 0x7f887410f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.682+0000 7f887a200640 1 --2- 172.21.15.110:0/2688408093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874102940 0x7f8874102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.682+0000 7f887a200640 1 --2- 172.21.15.110:0/2688408093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874108950 0x7f8874108d30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.682+0000 7f887a200640 1 -- 172.21.15.110:0/2688408093 >> 172.21.15.110:0/2688408093 conn(0x7f8874079dc0 msgr2=0x7f887407a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.682+0000 7f887a200640 1 -- 172.21.15.110:0/2688408093 shutdown_connections 2024-04-26T11:33:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.682+0000 7f887a200640 1 -- 172.21.15.110:0/2688408093 wait complete. 2024-04-26T11:33:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.684+0000 7f887a200640 1 Processor -- start 2024-04-26T11:33:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.684+0000 7f887a200640 1 -- start start 2024-04-26T11:33:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.685+0000 7f887a200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874102940 0x7f887410f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.685+0000 7f887a200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874103300 0x7f887410c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.685+0000 7f887a200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874108950 0x7f887410cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.686+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874102940 0x7f887410f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.686+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874102940 0x7f887410f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:55384/0 (socket says 172.21.15.110:55384) 2024-04-26T11:33:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.686+0000 7f887a200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f88740766d0 con 0x7f8874108950 2024-04-26T11:33:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.686+0000 7f887a200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8874076550 con 0x7f8874102940 2024-04-26T11:33:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.686+0000 7f887a200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8874076850 con 0x7f8874103300 2024-04-26T11:33:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.686+0000 7f8872a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874103300 0x7f887410c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.687+0000 7f8873400640 1 -- 172.21.15.110:0/4228223555 learned_addr learned my addr 172.21.15.110:0/4228223555 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.687+0000 7f8873400640 1 -- 172.21.15.110:0/4228223555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874103300 msgr2=0x7f887410c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.687+0000 7f8873400640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874103300 0x7f887410c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.687+0000 7f8873400640 1 -- 172.21.15.110:0/4228223555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874108950 msgr2=0x7f887410cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.687+0000 7f8873400640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874108950 0x7f887410cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.688+0000 7f8873400640 1 -- 172.21.15.110:0/4228223555 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887410d5f0 con 0x7f8874102940 2024-04-26T11:33:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.688+0000 7f8872a00640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874103300 0x7f887410c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:33:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.688+0000 7f8873400640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874102940 0x7f887410f6e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f886c009bf0 tx=0x7f886c032c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.688+0000 7f886be00640 1 -- 172.21.15.110:0/4228223555 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c004040 con 0x7f8874102940 2024-04-26T11:33:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.689+0000 7f886be00640 1 -- 172.21.15.110:0/4228223555 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f886c004690 con 0x7f8874102940 2024-04-26T11:33:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.689+0000 7f886be00640 1 -- 172.21.15.110:0/4228223555 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c03a400 con 0x7f8874102940 2024-04-26T11:33:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.689+0000 7f887a200640 1 -- 172.21.15.110:0/4228223555 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88741abb40 con 0x7f8874102940 2024-04-26T11:33:32.690 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.689+0000 7f887a200640 1 -- 172.21.15.110:0/4228223555 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88741ac040 con 0x7f8874102940 2024-04-26T11:33:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.695+0000 7f886be00640 1 -- 172.21.15.110:0/4228223555 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f886c030700 con 0x7f8874102940 2024-04-26T11:33:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.698+0000 7f886be00640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f88540a3f10 0x7f88540a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.698+0000 7f886be00640 1 -- 172.21.15.110:0/4228223555 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f886c0f1ed0 con 0x7f8874102940 2024-04-26T11:33:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.698+0000 7f8872a00640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f88540a3f10 0x7f88540a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.700+0000 7f8872a00640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f88540a3f10 0x7f88540a63d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f887410df40 tx=0x7f886400a5c0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f887d1ab740 1 Processor -- start 2024-04-26T11:33:32.703 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f887d1ab740 1 -- start start 2024-04-26T11:33:32.703 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbc41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbc46f0 0x5621dfbcea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 0x5621dfbd13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f887d1ab740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5621dfb29380 con 0x5621dfbc46f0 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f887d1ab740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5621dfac5c30 con 0x5621dfbc3dd0 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f887d1ab740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5621dfb25340 con 0x5621dfbcefb0 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbc41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbc41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:55392/0 (socket says 172.21.15.110:55392) 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f8873400640 1 -- 172.21.15.110:0/4112108609 learned_addr learned my addr 172.21.15.110:0/4112108609 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.702+0000 7f8873e00640 1 --2- 172.21.15.110:0/4112108609 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 0x5621dfbd13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8872a00640 1 --2- 172.21.15.110:0/4112108609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbc46f0 0x5621dfbcea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8873400640 1 -- 172.21.15.110:0/4112108609 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 msgr2=0x5621dfbd13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8873400640 1 --2- 172.21.15.110:0/4112108609 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 0x5621dfbd13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8873400640 1 -- 172.21.15.110:0/4112108609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbc46f0 msgr2=0x5621dfbcea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8873400640 1 --2- 172.21.15.110:0/4112108609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbc46f0 0x5621dfbcea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8873400640 1 -- 172.21.15.110:0/4112108609 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621dfae7940 con 0x5621dfbc3dd0 2024-04-26T11:33:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8873400640 1 --2- 172.21.15.110:0/4112108609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbc41b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f886c0c65e0 tx=0x7f886c0bd800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff3a30d28e0e315 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8863e00640 1 -- 172.21.15.110:0/4112108609 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c0d6020 con 0x5621dfbc3dd0 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8863e00640 1 -- 172.21.15.110:0/4112108609 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f886c036030 con 0x5621dfbc3dd0 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.703+0000 7f8863e00640 1 -- 172.21.15.110:0/4112108609 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c0ba510 con 0x5621dfbc3dd0 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.705+0000 7f887d1ab740 1 -- 172.21.15.110:0/4112108609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 msgr2=0x5621dfbc41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.705+0000 7f887d1ab740 1 --2- 172.21.15.110:0/4112108609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbc41b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f886c0c65e0 tx=0x7f886c0bd800 comp rx=0 tx=0).stop 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.705+0000 7f887d1ab740 1 -- 172.21.15.110:0/4112108609 shutdown_connections 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.705+0000 7f887d1ab740 1 --2- 172.21.15.110:0/4112108609 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 0x5621dfbd13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.705+0000 7f887d1ab740 1 --2- 172.21.15.110:0/4112108609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbc46f0 0x5621dfbcea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.705+0000 7f887d1ab740 1 --2- 172.21.15.110:0/4112108609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbc41b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.705+0000 7f887d1ab740 1 -- 172.21.15.110:0/4112108609 >> 172.21.15.110:0/4112108609 conn(0x5621dfbc02e0 msgr2=0x5621dfbc06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.705+0000 7f887d1ab740 1 -- 172.21.15.110:0/4112108609 shutdown_connections 2024-04-26T11:33:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.705+0000 7f887d1ab740 1 -- 172.21.15.110:0/4112108609 wait complete. 2024-04-26T11:33:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.707+0000 7f887d1ab740 1 -- start start 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.708+0000 7f887d1ab740 1 Processor -- start 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.708+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbcbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.708+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbc46f0 0x5621dfbcc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.708+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 0x5621dfbcca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.708+0000 7f887d1ab740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5621dfbd19a0 con 0x5621dfbcefb0 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.708+0000 7f887d1ab740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5621dfab0c60 con 0x5621dfbc3dd0 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.708+0000 7f887d1ab740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5621dfbd1b20 con 0x5621dfbc46f0 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.708+0000 7f887d1ab740 10 client.0 _ll_register_callbacks cb 0x5621dfadce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.709+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbcbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.709+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbcbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:55402/0 (socket says 172.21.15.110:55402) 2024-04-26T11:33:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.709+0000 7f8873400640 1 -- 172.21.15.110:0/2967808706 learned_addr learned my addr 172.21.15.110:0/2967808706 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.709+0000 7f8872a00640 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbc46f0 0x5621dfbcc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8873e00640 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 0x5621dfbcca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8873400640 1 -- 172.21.15.110:0/2967808706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbc46f0 msgr2=0x5621dfbcc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8873400640 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbc46f0 0x5621dfbcc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8873400640 1 -- 172.21.15.110:0/2967808706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 msgr2=0x5621dfbcca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8873400640 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 0x5621dfbcca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8873400640 1 -- 172.21.15.110:0/2967808706 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621dfabf510 con 0x5621dfbc3dd0 2024-04-26T11:33:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8873e00640 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 0x5621dfbcca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:33:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8873400640 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbcbf80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f886c0306b0 tx=0x7f886c0bc3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdb2956458150009 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8860c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:33:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8860c00640 1 -- 172.21.15.110:0/2967808706 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c0a1060 con 0x5621dfbc3dd0 2024-04-26T11:33:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.710+0000 7f8860c00640 1 -- 172.21.15.110:0/2967808706 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f886c0d7220 con 0x5621dfbc3dd0 2024-04-26T11:33:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.711+0000 7f887d1ab740 1 -- 172.21.15.110:0/2967808706 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f886c036030 con 0x5621dfbc3dd0 2024-04-26T11:33:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.711+0000 7f8860c00640 1 -- 172.21.15.110:0/2967808706 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f886c0d6030 con 0x5621dfbc3dd0 2024-04-26T11:33:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.711+0000 7f887d1ab740 10 client.25475 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.711+0000 7f887d1ab740 1 -- 172.21.15.110:0/2967808706 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5621df83b210 con 0x5621dfbc3dd0 2024-04-26T11:33:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.711+0000 7f8860c00640 1 -- 172.21.15.110:0/2967808706 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f886c036030 con 0x5621dfbc3dd0 2024-04-26T11:33:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.712+0000 7f8860c00640 1 -- 172.21.15.110:0/2967808706 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f886c0bd2f0 con 0x5621dfbc3dd0 2024-04-26T11:33:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.713+0000 7f887d1ab740 10 client.25475 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.713+0000 7f887d1ab740 10 client.25475 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.713+0000 7f887d1ab740 20 client.25475 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.713+0000 7f887d1ab740 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5621dfbef8d0 0x5621dfbf1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.713+0000 7f887d1ab740 4 client.25475 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:33:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.713+0000 7f887d1ab740 1 -- 172.21.15.110:0/2967808706 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621dfb36f90 con 0x5621dfbef8d0 2024-04-26T11:33:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.714+0000 7f8872a00640 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5621dfbef8d0 0x5621dfbf1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.715+0000 7f8872a00640 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5621dfbef8d0 0x5621dfbf1cc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82b310e7696b6961 server_cookie=5a432c71772a507e in_seq=0 out_seq=0 2024-04-26T11:33:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.715+0000 7f8860c00640 10 client.25475 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.717+0000 7f8860c00640 1 -- 172.21.15.110:0/2967808706 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5621dfb36f90 con 0x5621dfbef8d0 2024-04-26T11:33:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.717+0000 7f8860c00640 10 client.25475 handle_command_reply: tid=0 2024-04-26T11:33:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.717+0000 7f887d1ab740 1 client.25475 shutdown 2024-04-26T11:33:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.717+0000 7f887d1ab740 1 -- 172.21.15.110:0/2967808706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 msgr2=0x5621dfbcbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.717+0000 7f887d1ab740 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbcbf80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f886c0306b0 tx=0x7f886c0bc3b0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.718+0000 7f887d1ab740 1 -- 172.21.15.110:0/2967808706 shutdown_connections 2024-04-26T11:33:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.718+0000 7f887d1ab740 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 0x5621dfbcca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.718+0000 7f887d1ab740 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5621dfbef8d0 0x5621dfbf1cc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.718+0000 7f887d1ab740 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbc46f0 0x5621dfbcc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.718+0000 7f887d1ab740 1 --2- 172.21.15.110:0/2967808706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc3dd0 0x5621dfbcbf80 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f886c0306b0 tx=0x7f886c0bc3b0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.718+0000 7f887d1ab740 1 -- 172.21.15.110:0/2967808706 >> 172.21.15.110:0/2967808706 conn(0x5621dfbc02e0 msgr2=0x5621dfbc6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.718+0000 7f8860c00640 0 client.25475 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.718+0000 7f887d1ab740 1 -- 172.21.15.110:0/2967808706 shutdown_connections 2024-04-26T11:33:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.718+0000 7f887d1ab740 1 -- 172.21.15.110:0/2967808706 wait complete. 2024-04-26T11:33:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.719+0000 7f887d1ab740 20 client.25475 trim_cache size 0 max 16384 2024-04-26T11:33:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.748+0000 7f887d1ab740 1 Processor -- start 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.748+0000 7f887d1ab740 1 -- start start 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.748+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbda7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.748+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 0x5621dfbf7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.748+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbf7a50 0x5621dfbcd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.748+0000 7f887d1ab740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f88741aef50 con 0x5621dfbcefb0 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.748+0000 7f887d1ab740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f88741ac790 con 0x5621dfbc46f0 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.748+0000 7f887d1ab740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f887410dcb0 con 0x5621dfbf7a50 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbda7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8872a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 0x5621dfbf7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbf7a50 0x5621dfbcd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbda7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:55408/0 (socket says 172.21.15.110:55408) 2024-04-26T11:33:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873400640 1 -- 172.21.15.110:0/1857794583 learned_addr learned my addr 172.21.15.110:0/1857794583 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873e00640 1 -- 172.21.15.110:0/1857794583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 msgr2=0x5621dfbda7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873e00640 1 --2- 172.21.15.110:0/1857794583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbda7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873e00640 1 -- 172.21.15.110:0/1857794583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 msgr2=0x5621dfbf7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873e00640 1 --2- 172.21.15.110:0/1857794583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 0x5621dfbf7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873e00640 1 -- 172.21.15.110:0/1857794583 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621df907620 con 0x5621dfbf7a50 2024-04-26T11:33:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873400640 1 --2- 172.21.15.110:0/1857794583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbda7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.749+0000 7f8873e00640 1 --2- 172.21.15.110:0/1857794583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbf7a50 0x5621dfbcd6a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5621dfbc1470 tx=0x7f885c009b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e06c485c485d199 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.750+0000 7f8863400640 1 -- 172.21.15.110:0/1857794583 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c017020 con 0x5621dfbf7a50 2024-04-26T11:33:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.750+0000 7f8863400640 1 -- 172.21.15.110:0/1857794583 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f885c00ec00 con 0x5621dfbf7a50 2024-04-26T11:33:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.750+0000 7f8863400640 1 -- 172.21.15.110:0/1857794583 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c00f040 con 0x5621dfbf7a50 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.751+0000 7f887d1ab740 1 -- 172.21.15.110:0/1857794583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbf7a50 msgr2=0x5621dfbcd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.751+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1857794583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbf7a50 0x5621dfbcd6a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5621dfbc1470 tx=0x7f885c009b40 comp rx=0 tx=0).stop 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.751+0000 7f887d1ab740 1 -- 172.21.15.110:0/1857794583 shutdown_connections 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.751+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1857794583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbf7a50 0x5621dfbcd6a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.751+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1857794583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbcefb0 0x5621dfbf7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.751+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1857794583 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbda7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.751+0000 7f887d1ab740 1 -- 172.21.15.110:0/1857794583 >> 172.21.15.110:0/1857794583 conn(0x5621dfbc02e0 msgr2=0x5621dfbc72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.751+0000 7f887d1ab740 1 -- 172.21.15.110:0/1857794583 shutdown_connections 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.751+0000 7f887d1ab740 1 -- 172.21.15.110:0/1857794583 wait complete. 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.752+0000 7f887d1ab740 1 -- start start 2024-04-26T11:33:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.752+0000 7f887d1ab740 1 Processor -- start 2024-04-26T11:33:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.752+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbc8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.752+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 0x5621dfbc91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.752+0000 7f887d1ab740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbf7a50 0x5621dfbc96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.752+0000 7f887d1ab740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f887411c660 con 0x5621dfbf7a50 2024-04-26T11:33:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.752+0000 7f887d1ab740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f887411dad0 con 0x5621dfbc46f0 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.752+0000 7f887d1ab740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f887411cd30 con 0x5621dfbcefb0 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.752+0000 7f887d1ab740 10 client.0 _ll_register_callbacks cb 0x7f886c0bdc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbc8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbc8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:55418/0 (socket says 172.21.15.110:55418) 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873400640 1 -- 172.21.15.110:0/1892851979 learned_addr learned my addr 172.21.15.110:0/1892851979 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8872a00640 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 0x5621dfbc91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873e00640 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbf7a50 0x5621dfbc96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873400640 1 -- 172.21.15.110:0/1892851979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 msgr2=0x5621dfbc91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873400640 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 0x5621dfbc91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873400640 1 -- 172.21.15.110:0/1892851979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbf7a50 msgr2=0x5621dfbc96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873400640 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbf7a50 0x5621dfbc96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873400640 1 -- 172.21.15.110:0/1892851979 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621dfae3cb0 con 0x5621dfbc46f0 2024-04-26T11:33:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8873400640 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbc8c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f886c000f80 tx=0x7f886c0bdd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c23307babfb80319 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8860c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:33:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.753+0000 7f8860c00640 1 -- 172.21.15.110:0/1892851979 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c0a1040 con 0x5621dfbc46f0 2024-04-26T11:33:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.754+0000 7f8860c00640 1 -- 172.21.15.110:0/1892851979 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f886c0d2b80 con 0x5621dfbc46f0 2024-04-26T11:33:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.754+0000 7f887d1ab740 1 -- 172.21.15.110:0/1892851979 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f885c00ec00 con 0x5621dfbc46f0 2024-04-26T11:33:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.754+0000 7f8860c00640 1 -- 172.21.15.110:0/1892851979 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f886c0cb080 con 0x5621dfbc46f0 2024-04-26T11:33:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.754+0000 7f887d1ab740 10 client.25481 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.754+0000 7f887d1ab740 1 -- 172.21.15.110:0/1892851979 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5621dfae3cb0 con 0x5621dfbc46f0 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.755+0000 7f8860c00640 1 -- 172.21.15.110:0/1892851979 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f885c00ec00 con 0x5621dfbc46f0 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.755+0000 7f8860c00640 1 -- 172.21.15.110:0/1892851979 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f886c0bcd60 con 0x5621dfbc46f0 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.755+0000 7f887d1ab740 10 client.25481 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.755+0000 7f887d1ab740 10 client.25481 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.755+0000 7f887d1ab740 20 client.25481 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.755+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5621dfc671e0 0x5621dfc69600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.755+0000 7f887d1ab740 4 client.25481 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.755+0000 7f887d1ab740 1 -- 172.21.15.110:0/1892851979 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5621dfb30e00 con 0x5621dfc671e0 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.756+0000 7f8872a00640 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5621dfc671e0 0x5621dfc69600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.756+0000 7f8872a00640 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5621dfc671e0 0x5621dfc69600 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be99049d65a5425 server_cookie=bf92af25f009e4ae in_seq=0 out_seq=0 2024-04-26T11:33:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.756+0000 7f8860c00640 10 client.25481 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f8860c00640 1 -- 172.21.15.110:0/1892851979 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5621dfb30e00 con 0x5621dfc671e0 2024-04-26T11:33:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f8860c00640 10 client.25481 handle_command_reply: tid=0 2024-04-26T11:33:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f887d1ab740 1 client.25481 shutdown 2024-04-26T11:33:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f887d1ab740 1 -- 172.21.15.110:0/1892851979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 msgr2=0x5621dfbc8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbc8c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f886c000f80 tx=0x7f886c0bdd20 comp rx=0 tx=0).stop 2024-04-26T11:33:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f887d1ab740 1 -- 172.21.15.110:0/1892851979 shutdown_connections 2024-04-26T11:33:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5621dfbf7a50 0x5621dfbc96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5621dfc671e0 0x5621dfc69600 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f8860c00640 0 client.25481 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5621dfbcefb0 0x5621dfbc91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f887d1ab740 1 --2- 172.21.15.110:0/1892851979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621dfbc46f0 0x5621dfbc8c60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.766+0000 7f887d1ab740 1 -- 172.21.15.110:0/1892851979 >> 172.21.15.110:0/1892851979 conn(0x5621dfbc02e0 msgr2=0x5621dfbc56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.767+0000 7f887d1ab740 1 -- 172.21.15.110:0/1892851979 shutdown_connections 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.767+0000 7f887d1ab740 1 -- 172.21.15.110:0/1892851979 wait complete. 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.767+0000 7f887d1ab740 20 client.25481 trim_cache size 0 max 16384 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:33:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:33:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.767+0000 7f887a200640 1 -- 172.21.15.110:0/4228223555 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f88540a3f10 msgr2=0x7f88540a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.767+0000 7f887a200640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f88540a3f10 0x7f88540a63d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f887410df40 tx=0x7f886400a5c0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 -- 172.21.15.110:0/4228223555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874102940 msgr2=0x7f887410f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874102940 0x7f887410f6e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f886c009bf0 tx=0x7f886c032c00 comp rx=0 tx=0).stop 2024-04-26T11:33:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 -- 172.21.15.110:0/4228223555 shutdown_connections 2024-04-26T11:33:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f88540a3f10 0x7f88540a63d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8874108950 0x7f887410cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8874103300 0x7f887410c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 --2- 172.21.15.110:0/4228223555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8874102940 0x7f887410f6e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 -- 172.21.15.110:0/4228223555 >> 172.21.15.110:0/4228223555 conn(0x7f8874079dc0 msgr2=0x7f88740fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 -- 172.21.15.110:0/4228223555 shutdown_connections 2024-04-26T11:33:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:32.768+0000 7f887a200640 1 -- 172.21.15.110:0/4228223555 wait complete. 2024-04-26T11:33:33.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:33 smithi193 ceph-mon[32782]: pgmap v71: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 10 op/s 2024-04-26T11:33:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:33 smithi196 ceph-mon[32572]: pgmap v71: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 10 op/s 2024-04-26T11:33:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:33 smithi110 ceph-mon[28069]: pgmap v71: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 72 KiB/s wr, 10 op/s 2024-04-26T11:33:34.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 80.0 s, 3146.6 tps, lat 207.061 ms stddev 2231.586 2024-04-26T11:33:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:35 smithi196 ceph-mon[32572]: pgmap v72: 97 pgs: 97 active+clean; 976 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-04-26T11:33:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:35 smithi110 ceph-mon[28069]: pgmap v72: 97 pgs: 97 active+clean; 976 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-04-26T11:33:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:35 smithi193 ceph-mon[32782]: pgmap v72: 97 pgs: 97 active+clean; 976 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-04-26T11:33:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:37 smithi196 ceph-mon[32572]: pgmap v73: 97 pgs: 97 active+clean; 976 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-04-26T11:33:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:37 smithi110 ceph-mon[28069]: pgmap v73: 97 pgs: 97 active+clean; 976 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-04-26T11:33:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:37 smithi193 ceph-mon[32782]: pgmap v73: 97 pgs: 97 active+clean; 976 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-04-26T11:33:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:39 smithi196 ceph-mon[32572]: pgmap v74: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 5.6 MiB/s wr, 443 op/s 2024-04-26T11:33:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:39 smithi110 ceph-mon[28069]: pgmap v74: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 5.6 MiB/s wr, 443 op/s 2024-04-26T11:33:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:39 smithi193 ceph-mon[32782]: pgmap v74: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 5.6 MiB/s wr, 443 op/s 2024-04-26T11:33:39.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 85.0 s, 3255.6 tps, lat 30.733 ms stddev 34.308 2024-04-26T11:33:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:41 smithi196 ceph-mon[32572]: pgmap v75: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.6 MiB/s wr, 440 op/s 2024-04-26T11:33:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:41 smithi110 ceph-mon[28069]: pgmap v75: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.6 MiB/s wr, 440 op/s 2024-04-26T11:33:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:41 smithi193 ceph-mon[32782]: pgmap v75: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.6 MiB/s wr, 440 op/s 2024-04-26T11:33:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:43 smithi196 ceph-mon[32572]: pgmap v76: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.6 MiB/s wr, 440 op/s 2024-04-26T11:33:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:43 smithi110 ceph-mon[28069]: pgmap v76: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.6 MiB/s wr, 440 op/s 2024-04-26T11:33:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:43 smithi193 ceph-mon[32782]: pgmap v76: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.6 MiB/s wr, 440 op/s 2024-04-26T11:33:44.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 90.0 s, 3375.2 tps, lat 29.518 ms stddev 32.027 2024-04-26T11:33:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:45 smithi196 ceph-mon[32572]: pgmap v77: 97 pgs: 97 active+clean; 1.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.7 MiB/s wr, 757 op/s 2024-04-26T11:33:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:45 smithi110 ceph-mon[28069]: pgmap v77: 97 pgs: 97 active+clean; 1.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.7 MiB/s wr, 757 op/s 2024-04-26T11:33:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:45 smithi193 ceph-mon[32782]: pgmap v77: 97 pgs: 97 active+clean; 1.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.7 MiB/s wr, 757 op/s 2024-04-26T11:33:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.942+0000 7fbdaca00640 1 -- 172.21.15.110:0/145672400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda810cf00 msgr2=0x7fbda810f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.942+0000 7fbdaca00640 1 --2- 172.21.15.110:0/145672400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda810cf00 0x7fbda810f3a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009be0 tx=0x7fbda002a7e0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.943+0000 7fbdaca00640 1 -- 172.21.15.110:0/145672400 shutdown_connections 2024-04-26T11:33:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.943+0000 7fbdaca00640 1 --2- 172.21.15.110:0/145672400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda810cf00 0x7fbda810f3a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.943+0000 7fbdaca00640 1 --2- 172.21.15.110:0/145672400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda81044e0 0x7fbda810c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.943+0000 7fbdaca00640 1 --2- 172.21.15.110:0/145672400 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbda8103bc0 0x7fbda8103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.943+0000 7fbdaca00640 1 -- 172.21.15.110:0/145672400 >> 172.21.15.110:0/145672400 conn(0x7fbda80789b0 msgr2=0x7fbda8078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.943+0000 7fbdaca00640 1 -- 172.21.15.110:0/145672400 shutdown_connections 2024-04-26T11:33:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.943+0000 7fbdaca00640 1 -- 172.21.15.110:0/145672400 wait complete. 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbdaca00640 1 Processor -- start 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbdaca00640 1 -- start start 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbdaca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda8103bc0 0x7fbda810c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbdaca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbda81044e0 0x7fbda8109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbdaca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda810cf00 0x7fbda810a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbdaca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81032b0 con 0x7fbda810cf00 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbdaca00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8103130 con 0x7fbda8103bc0 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbdaca00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8103430 con 0x7fbda81044e0 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbda5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda8103bc0 0x7fbda810c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbda5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda8103bc0 0x7fbda810c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54748/0 (socket says 172.21.15.110:54748) 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbda5e00640 1 -- 172.21.15.110:0/2107365296 learned_addr learned my addr 172.21.15.110:0/2107365296 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.944+0000 7fbda6800640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda810cf00 0x7fbda810a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.945+0000 7fbda5400640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbda81044e0 0x7fbda8109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.945+0000 7fbda5e00640 1 -- 172.21.15.110:0/2107365296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbda81044e0 msgr2=0x7fbda8109a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.945+0000 7fbda5e00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbda81044e0 0x7fbda8109a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.945+0000 7fbda5e00640 1 -- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda810cf00 msgr2=0x7fbda810a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.945+0000 7fbda5e00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda810cf00 0x7fbda810a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.945+0000 7fbda5e00640 1 -- 172.21.15.110:0/2107365296 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda81ab9d0 con 0x7fbda8103bc0 2024-04-26T11:33:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.945+0000 7fbda5e00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda8103bc0 0x7fbda810c960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800e9f0 tx=0x7fbd9800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.946+0000 7fbd9ea00640 1 -- 172.21.15.110:0/2107365296 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800cc60 con 0x7fbda8103bc0 2024-04-26T11:33:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.946+0000 7fbd9ea00640 1 -- 172.21.15.110:0/2107365296 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd9800ce00 con 0x7fbda8103bc0 2024-04-26T11:33:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.946+0000 7fbd9ea00640 1 -- 172.21.15.110:0/2107365296 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98010430 con 0x7fbda8103bc0 2024-04-26T11:33:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.946+0000 7fbdaca00640 1 -- 172.21.15.110:0/2107365296 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda81abc00 con 0x7fbda8103bc0 2024-04-26T11:33:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.946+0000 7fbdaca00640 1 -- 172.21.15.110:0/2107365296 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda81ac0d0 con 0x7fbda8103bc0 2024-04-26T11:33:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.951+0000 7fbdaf824740 1 Processor -- start 2024-04-26T11:33:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.952+0000 7fbdaf824740 1 -- start start 2024-04-26T11:33:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.952+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfb31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.952+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfb36f0 0x5605dcfbda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbd9ea00640 1 -- 172.21.15.110:0/2107365296 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fbd980105f0 con 0x7fbda8103bc0 2024-04-26T11:33:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbda6800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfb31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbda6800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfb31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54750/0 (socket says 172.21.15.110:54750) 2024-04-26T11:33:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfbdfb0 0x5605dcfc03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbdaf824740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5605dcf18380 con 0x5605dcfb36f0 2024-04-26T11:33:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbdaf824740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5605dceb4c30 con 0x5605dcfb2dd0 2024-04-26T11:33:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbdaf824740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5605dcf14340 con 0x5605dcfbdfb0 2024-04-26T11:33:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbda6800640 1 -- 172.21.15.110:0/2819806837 learned_addr learned my addr 172.21.15.110:0/2819806837 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbda5e00640 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfb36f0 0x5605dcfbda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.953+0000 7fbda5400640 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfbdfb0 0x5605dcfc03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.954+0000 7fbda6800640 1 -- 172.21.15.110:0/2819806837 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfbdfb0 msgr2=0x5605dcfc03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.954+0000 7fbda6800640 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfbdfb0 0x5605dcfc03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.954+0000 7fbda6800640 1 -- 172.21.15.110:0/2819806837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfb36f0 msgr2=0x5605dcfbda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.954+0000 7fbda6800640 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfb36f0 0x5605dcfbda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.954+0000 7fbda6800640 1 -- 172.21.15.110:0/2819806837 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605dced6940 con 0x5605dcfb2dd0 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.954+0000 7fbda5e00640 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfb36f0 0x5605dcfbda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.954+0000 7fbda6800640 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfb31b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009be0 tx=0x7fbda0030420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19ad039af4dbb7cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.955+0000 7fbd93000640 1 -- 172.21.15.110:0/2819806837 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0036070 con 0x5605dcfb2dd0 2024-04-26T11:33:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.955+0000 7fbd93000640 1 -- 172.21.15.110:0/2819806837 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda0041070 con 0x5605dcfb2dd0 2024-04-26T11:33:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.955+0000 7fbd93000640 1 -- 172.21.15.110:0/2819806837 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0036070 con 0x5605dcfb2dd0 2024-04-26T11:33:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.955+0000 7fbd9ea00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbd8c0a3e40 0x7fbd8c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.956+0000 7fbd9ea00640 1 -- 172.21.15.110:0/2107365296 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fbd980d0b10 con 0x7fbda8103bc0 2024-04-26T11:33:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.956+0000 7fbda5e00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbd8c0a3e40 0x7fbd8c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbdaf824740 1 -- 172.21.15.110:0/2819806837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 msgr2=0x5605dcfb31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfb31b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009be0 tx=0x7fbda0030420 comp rx=0 tx=0).stop 2024-04-26T11:33:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbdaf824740 1 -- 172.21.15.110:0/2819806837 shutdown_connections 2024-04-26T11:33:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfbdfb0 0x5605dcfc03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfb36f0 0x5605dcfbda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2819806837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfb31b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbdaf824740 1 -- 172.21.15.110:0/2819806837 >> 172.21.15.110:0/2819806837 conn(0x5605dcfaf2e0 msgr2=0x5605dcfaf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbdaf824740 1 -- 172.21.15.110:0/2819806837 shutdown_connections 2024-04-26T11:33:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbda5e00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbd8c0a3e40 0x7fbd8c0a6300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x5605dcfb4370 tx=0x7fbd980d45c0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.957+0000 7fbdaf824740 1 -- 172.21.15.110:0/2819806837 wait complete. 2024-04-26T11:33:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.958+0000 7fbdaf824740 1 -- start start 2024-04-26T11:33:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.958+0000 7fbdaf824740 1 Processor -- start 2024-04-26T11:33:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb36f0 0x5605dcfbb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfbb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbdaf824740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5605dcfc0b80 con 0x5605dcfbdfb0 2024-04-26T11:33:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbdaf824740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5605dce9fc60 con 0x5605dcfb2dd0 2024-04-26T11:33:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbdaf824740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5605dcfc0d00 con 0x5605dcfb36f0 2024-04-26T11:33:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbdaf824740 10 client.0 _ll_register_callbacks cb 0x5605dcecbe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbda6800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbda6800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54766/0 (socket says 172.21.15.110:54766) 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbda6800640 1 -- 172.21.15.110:0/2336315972 learned_addr learned my addr 172.21.15.110:0/2336315972 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.959+0000 7fbda5400640 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb36f0 0x5605dcfbb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.960+0000 7fbda6800640 1 -- 172.21.15.110:0/2336315972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb36f0 msgr2=0x5605dcfbb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.960+0000 7fbda6800640 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb36f0 0x5605dcfbb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.960+0000 7fbda6800640 1 -- 172.21.15.110:0/2336315972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 msgr2=0x5605dcfbb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.960+0000 7fbda6800640 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfbb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.960+0000 7fbda6800640 1 -- 172.21.15.110:0/2336315972 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605dceae510 con 0x5605dcfb2dd0 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.960+0000 7fbda6800640 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbaf20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbda0006010 tx=0x7fbda0009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1817544ae6e367f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.960+0000 7fbd87400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.960+0000 7fbd87400640 1 -- 172.21.15.110:0/2336315972 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0036070 con 0x5605dcfb2dd0 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.960+0000 7fbd87400640 1 -- 172.21.15.110:0/2336315972 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fbda0030930 con 0x5605dcfb2dd0 2024-04-26T11:33:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.961+0000 7fbdaf824740 1 -- 172.21.15.110:0/2336315972 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbda0041070 con 0x5605dcfb2dd0 2024-04-26T11:33:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.961+0000 7fbd87400640 1 -- 172.21.15.110:0/2336315972 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbda0030ec0 con 0x5605dcfb2dd0 2024-04-26T11:33:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.961+0000 7fbdaf824740 10 client.25493 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.961+0000 7fbdaf824740 1 -- 172.21.15.110:0/2336315972 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5605dcc2a210 con 0x5605dcfb2dd0 2024-04-26T11:33:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.961+0000 7fbd87400640 1 -- 172.21.15.110:0/2336315972 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda0041070 con 0x5605dcfb2dd0 2024-04-26T11:33:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.962+0000 7fbd87400640 1 -- 172.21.15.110:0/2336315972 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fbda0004270 con 0x5605dcfb2dd0 2024-04-26T11:33:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.962+0000 7fbdaf824740 10 client.25493 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.962+0000 7fbdaf824740 10 client.25493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.962+0000 7fbdaf824740 20 client.25493 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.962+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5605dcfcdb40 0x5605dcfcff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.962+0000 7fbdaf824740 4 client.25493 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:33:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.962+0000 7fbdaf824740 1 -- 172.21.15.110:0/2336315972 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605dcf25f90 con 0x5605dcfcdb40 2024-04-26T11:33:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.963+0000 7fbda5400640 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5605dcfcdb40 0x5605dcfcff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.963+0000 7fbda5400640 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5605dcfcdb40 0x5605dcfcff30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cd84bc8854fede2 server_cookie=38ce4f2efe28ae27 in_seq=0 out_seq=0 2024-04-26T11:33:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.963+0000 7fbd87400640 10 client.25493 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.964+0000 7fbd87400640 1 -- 172.21.15.110:0/2336315972 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5605dcf25f90 con 0x5605dcfcdb40 2024-04-26T11:33:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.964+0000 7fbd87400640 10 client.25493 handle_command_reply: tid=0 2024-04-26T11:33:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.964+0000 7fbdaf824740 1 client.25493 shutdown 2024-04-26T11:33:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.965+0000 7fbdaf824740 1 -- 172.21.15.110:0/2336315972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 msgr2=0x5605dcfbaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.965+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbaf20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbda0006010 tx=0x7fbda0009500 comp rx=0 tx=0).stop 2024-04-26T11:33:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.965+0000 7fbdaf824740 1 -- 172.21.15.110:0/2336315972 shutdown_connections 2024-04-26T11:33:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.965+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfbb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.965+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5605dcfcdb40 0x5605dcfcff30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.965+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb36f0 0x5605dcfbb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.965+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2336315972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbaf20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.965+0000 7fbdaf824740 1 -- 172.21.15.110:0/2336315972 >> 172.21.15.110:0/2336315972 conn(0x5605dcfaf2e0 msgr2=0x5605dcfb5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.965+0000 7fbd87400640 0 client.25493 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.966+0000 7fbdaf824740 1 -- 172.21.15.110:0/2336315972 shutdown_connections 2024-04-26T11:33:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.966+0000 7fbdaf824740 1 -- 172.21.15.110:0/2336315972 wait complete. 2024-04-26T11:33:45.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.966+0000 7fbdaf824740 20 client.25493 trim_cache size 0 max 16384 2024-04-26T11:33:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.994+0000 7fbdaf824740 1 Processor -- start 2024-04-26T11:33:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.994+0000 7fbdaf824740 1 -- start start 2024-04-26T11:33:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.994+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.994+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dcfc9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.994+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.994+0000 7fbdaf824740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81b7720 con 0x5605dcfbdfb0 2024-04-26T11:33:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.994+0000 7fbdaf824740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81b4f60 con 0x5605dcfb36f0 2024-04-26T11:33:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.994+0000 7fbdaf824740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81b2db0 con 0x5605dcfb2dd0 2024-04-26T11:33:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dcfc9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dcfc9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54774/0 (socket says 172.21.15.110:54774) 2024-04-26T11:33:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda5400640 1 -- 172.21.15.110:0/2564069100 learned_addr learned my addr 172.21.15.110:0/2564069100 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda6800640 1 --2- 172.21.15.110:0/2564069100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda6800640 1 --2- 172.21.15.110:0/2564069100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda5400640 1 -- 172.21.15.110:0/2564069100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 msgr2=0x5605dcfbd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda5400640 1 --2- 172.21.15.110:0/2564069100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda5400640 1 -- 172.21.15.110:0/2564069100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 msgr2=0x5605dcfae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda5400640 1 --2- 172.21.15.110:0/2564069100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.995+0000 7fbda5400640 1 -- 172.21.15.110:0/2564069100 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605dccf6620 con 0x5605dcfb36f0 2024-04-26T11:33:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.996+0000 7fbda5400640 1 --2- 172.21.15.110:0/2564069100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dcfc9a40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbd94000c00 tx=0x7fbd94011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a6a62c6b35859e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.996+0000 7fbd92600640 1 -- 172.21.15.110:0/2564069100 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9401d630 con 0x5605dcfb36f0 2024-04-26T11:33:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.996+0000 7fbd92600640 1 -- 172.21.15.110:0/2564069100 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd9401d7d0 con 0x5605dcfb36f0 2024-04-26T11:33:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.996+0000 7fbd92600640 1 -- 172.21.15.110:0/2564069100 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94004d40 con 0x5605dcfb36f0 2024-04-26T11:33:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.998+0000 7fbdaf824740 1 -- 172.21.15.110:0/2564069100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 msgr2=0x5605dcfc9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.998+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2564069100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dcfc9a40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbd94000c00 tx=0x7fbd94011810 comp rx=0 tx=0).stop 2024-04-26T11:33:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.998+0000 7fbdaf824740 1 -- 172.21.15.110:0/2564069100 shutdown_connections 2024-04-26T11:33:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.998+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2564069100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.998+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2564069100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dcfc9a40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.998+0000 7fbdaf824740 1 --2- 172.21.15.110:0/2564069100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 0x5605dcfbd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.998+0000 7fbdaf824740 1 -- 172.21.15.110:0/2564069100 >> 172.21.15.110:0/2564069100 conn(0x5605dcfaf2e0 msgr2=0x5605dcfadbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.998+0000 7fbdaf824740 1 -- 172.21.15.110:0/2564069100 shutdown_connections 2024-04-26T11:33:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.998+0000 7fbdaf824740 1 -- 172.21.15.110:0/2564069100 wait complete. 2024-04-26T11:33:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.999+0000 7fbdaf824740 1 -- start start 2024-04-26T11:33:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.999+0000 7fbdaf824740 1 Processor -- start 2024-04-26T11:33:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.999+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 0x5605dd02f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:45.999+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dd02f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.000+0000 7fbdaf824740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfc6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.000+0000 7fbdaf824740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81b3420 con 0x5605dcfbdfb0 2024-04-26T11:33:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.000+0000 7fbdaf824740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81b4890 con 0x5605dcfb36f0 2024-04-26T11:33:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.000+0000 7fbdaf824740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81b3af0 con 0x5605dcfb2dd0 2024-04-26T11:33:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.000+0000 7fbdaf824740 10 client.0 _ll_register_callbacks cb 0x7fbd980d4490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.000+0000 7fbda5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dd02f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.000+0000 7fbda5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dd02f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54786/0 (socket says 172.21.15.110:54786) 2024-04-26T11:33:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.000+0000 7fbda5400640 1 -- 172.21.15.110:0/362952454 learned_addr learned my addr 172.21.15.110:0/362952454 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.000+0000 7fbda6800640 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 0x5605dd02f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.001+0000 7fbda6800640 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfc6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.001+0000 7fbda6800640 1 -- 172.21.15.110:0/362952454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 msgr2=0x5605dd02f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.001+0000 7fbda6800640 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dd02f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.001+0000 7fbda6800640 1 -- 172.21.15.110:0/362952454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 msgr2=0x5605dcfc6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.001+0000 7fbda6800640 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfc6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.001+0000 7fbda6800640 1 -- 172.21.15.110:0/362952454 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605dced2cb0 con 0x5605dcfb2dd0 2024-04-26T11:33:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.001+0000 7fbda5400640 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dd02f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.002+0000 7fbda6800640 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 0x5605dd02f2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbda0004830 tx=0x7fbda0030ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8ee3327390a78be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:46.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.002+0000 7fbd87400640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:33:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.002+0000 7fbd87400640 1 -- 172.21.15.110:0/362952454 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0030e70 con 0x5605dcfb2dd0 2024-04-26T11:33:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.002+0000 7fbd87400640 1 -- 172.21.15.110:0/362952454 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fbda0004250 con 0x5605dcfb2dd0 2024-04-26T11:33:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.002+0000 7fbdaf824740 1 -- 172.21.15.110:0/362952454 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd9401d7d0 con 0x5605dcfb2dd0 2024-04-26T11:33:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.003+0000 7fbd87400640 1 -- 172.21.15.110:0/362952454 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbda0004450 con 0x5605dcfb2dd0 2024-04-26T11:33:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.003+0000 7fbdaf824740 10 client.25513 fetch_fsmap learned FSMap version 30 2024-04-26T11:33:46.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.003+0000 7fbdaf824740 1 -- 172.21.15.110:0/362952454 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5605dd044db0 con 0x5605dcfb2dd0 2024-04-26T11:33:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.003+0000 7fbd87400640 1 -- 172.21.15.110:0/362952454 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd9401d7d0 con 0x5605dcfb2dd0 2024-04-26T11:33:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.003+0000 7fbd87400640 1 -- 172.21.15.110:0/362952454 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fbda00466e0 con 0x5605dcfb2dd0 2024-04-26T11:33:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.003+0000 7fbdaf824740 10 client.25513 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T11:33:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.003+0000 7fbdaf824740 10 client.25513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.003+0000 7fbdaf824740 20 client.25513 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.004+0000 7fbdaf824740 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5605dd045270 0x5605dd047690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.004+0000 7fbdaf824740 4 client.25513 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:33:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.004+0000 7fbdaf824740 1 -- 172.21.15.110:0/362952454 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5605dcf1fe00 con 0x5605dd045270 2024-04-26T11:33:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.004+0000 7fbda5400640 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5605dd045270 0x5605dd047690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.005+0000 7fbd87400640 10 client.25513 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.005+0000 7fbda5400640 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5605dd045270 0x5605dd047690 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21b68765a60cb9b8 server_cookie=ca519eb8bfd3aad9 in_seq=0 out_seq=0 2024-04-26T11:33:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.016+0000 7fbd87400640 1 -- 172.21.15.110:0/362952454 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5605dcf1fe00 con 0x5605dd045270 2024-04-26T11:33:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.016+0000 7fbd87400640 10 client.25513 handle_command_reply: tid=0 2024-04-26T11:33:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.016+0000 7fbdaf824740 1 client.25513 shutdown 2024-04-26T11:33:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.017+0000 7fbdaf824740 1 -- 172.21.15.110:0/362952454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 msgr2=0x5605dd02f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.017+0000 7fbdaf824740 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 0x5605dd02f2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbda0004830 tx=0x7fbda0030ca0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.017+0000 7fbdaf824740 1 -- 172.21.15.110:0/362952454 shutdown_connections 2024-04-26T11:33:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.017+0000 7fbdaf824740 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5605dcfbdfb0 0x5605dcfc6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.017+0000 7fbdaf824740 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605dcfb36f0 0x5605dd02f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.017+0000 7fbdaf824740 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5605dd045270 0x5605dd047690 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.017+0000 7fbdaf824740 1 --2- 172.21.15.110:0/362952454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5605dcfb2dd0 0x5605dd02f2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.017+0000 7fbdaf824740 1 -- 172.21.15.110:0/362952454 >> 172.21.15.110:0/362952454 conn(0x5605dcfaf2e0 msgr2=0x5605dcfbb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.017+0000 7fbd87400640 0 client.25513 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.018+0000 7fbdaf824740 1 -- 172.21.15.110:0/362952454 shutdown_connections 2024-04-26T11:33:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.018+0000 7fbdaf824740 1 -- 172.21.15.110:0/362952454 wait complete. 2024-04-26T11:33:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.018+0000 7fbdaf824740 20 client.25513 trim_cache size 0 max 16384 2024-04-26T11:33:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:33:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:33:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:33:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:33:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.020+0000 7fbdaca00640 1 -- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbd8c0a3e40 msgr2=0x7fbd8c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.020+0000 7fbdaca00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbd8c0a3e40 0x7fbd8c0a6300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x5605dcfb4370 tx=0x7fbd980d45c0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.020+0000 7fbdaca00640 1 -- 172.21.15.110:0/2107365296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda8103bc0 msgr2=0x7fbda810c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.020+0000 7fbdaca00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda8103bc0 0x7fbda810c960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800e9f0 tx=0x7fbd9800eeb0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.021+0000 7fbdaca00640 1 -- 172.21.15.110:0/2107365296 shutdown_connections 2024-04-26T11:33:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.021+0000 7fbdaca00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbd8c0a3e40 0x7fbd8c0a6300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.021+0000 7fbdaca00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbda810cf00 0x7fbda810a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.021+0000 7fbdaca00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbda81044e0 0x7fbda8109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.021+0000 7fbdaca00640 1 --2- 172.21.15.110:0/2107365296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda8103bc0 0x7fbda810c960 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.021+0000 7fbdaca00640 1 -- 172.21.15.110:0/2107365296 >> 172.21.15.110:0/2107365296 conn(0x7fbda80789b0 msgr2=0x7fbda80fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.021+0000 7fbdaca00640 1 -- 172.21.15.110:0/2107365296 shutdown_connections 2024-04-26T11:33:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:46.022+0000 7fbdaca00640 1 -- 172.21.15.110:0/2107365296 wait complete. 2024-04-26T11:33:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:47 smithi196 ceph-mon[32572]: pgmap v78: 97 pgs: 97 active+clean; 1.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.6 MiB/s wr, 637 op/s 2024-04-26T11:33:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:47 smithi110 ceph-mon[28069]: pgmap v78: 97 pgs: 97 active+clean; 1.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.6 MiB/s wr, 637 op/s 2024-04-26T11:33:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:47 smithi193 ceph-mon[32782]: pgmap v78: 97 pgs: 97 active+clean; 1.0 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.6 MiB/s wr, 637 op/s 2024-04-26T11:33:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:49 smithi196 ceph-mon[32572]: pgmap v79: 97 pgs: 97 active+clean; 1.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 12 MiB/s wr, 945 op/s 2024-04-26T11:33:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:49 smithi110 ceph-mon[28069]: pgmap v79: 97 pgs: 97 active+clean; 1.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 12 MiB/s wr, 945 op/s 2024-04-26T11:33:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:49 smithi193 ceph-mon[32782]: pgmap v79: 97 pgs: 97 active+clean; 1.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 12 MiB/s wr, 945 op/s 2024-04-26T11:33:49.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 95.0 s, 3086.8 tps, lat 32.433 ms stddev 37.478 2024-04-26T11:33:51.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:51 smithi196 ceph-mon[32572]: pgmap v80: 97 pgs: 97 active+clean; 1.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.5 MiB/s wr, 626 op/s 2024-04-26T11:33:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:51 smithi110 ceph-mon[28069]: pgmap v80: 97 pgs: 97 active+clean; 1.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.5 MiB/s wr, 626 op/s 2024-04-26T11:33:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:51 smithi193 ceph-mon[32782]: pgmap v80: 97 pgs: 97 active+clean; 1.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.5 MiB/s wr, 626 op/s 2024-04-26T11:33:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:53 smithi196 ceph-mon[32572]: pgmap v81: 97 pgs: 97 active+clean; 1.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.5 MiB/s wr, 626 op/s 2024-04-26T11:33:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:53 smithi110 ceph-mon[28069]: pgmap v81: 97 pgs: 97 active+clean; 1.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.5 MiB/s wr, 626 op/s 2024-04-26T11:33:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:53 smithi193 ceph-mon[32782]: pgmap v81: 97 pgs: 97 active+clean; 1.0 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.5 MiB/s wr, 626 op/s 2024-04-26T11:33:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:54 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:33:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:54 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:33:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:54 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:33:54.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 100.0 s, 2951.0 tps, lat 33.638 ms stddev 41.991 2024-04-26T11:33:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:55 smithi196 ceph-mon[32572]: pgmap v82: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-04-26T11:33:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:55 smithi110 ceph-mon[28069]: pgmap v82: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-04-26T11:33:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:55 smithi193 ceph-mon[32782]: pgmap v82: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-04-26T11:33:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:57 smithi196 ceph-mon[32572]: pgmap v83: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.4 MiB/s wr, 625 op/s 2024-04-26T11:33:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:57 smithi110 ceph-mon[28069]: pgmap v83: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.4 MiB/s wr, 625 op/s 2024-04-26T11:33:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:57 smithi193 ceph-mon[32782]: pgmap v83: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.4 MiB/s wr, 625 op/s 2024-04-26T11:33:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.217+0000 7fabaf200640 1 -- 172.21.15.110:0/2111528188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faba81139f0 msgr2=0x7faba8115de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.217+0000 7fabaf200640 1 --2- 172.21.15.110:0/2111528188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faba81139f0 0x7faba8115de0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faba0009cd0 tx=0x7faba002a980 comp rx=0 tx=0).stop 2024-04-26T11:33:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.218+0000 7fabaf200640 1 -- 172.21.15.110:0/2111528188 shutdown_connections 2024-04-26T11:33:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.218+0000 7fabaf200640 1 --2- 172.21.15.110:0/2111528188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faba81139f0 0x7faba8115de0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.218+0000 7fabaf200640 1 --2- 172.21.15.110:0/2111528188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faba8075550 0x7faba81134b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.218+0000 7fabaf200640 1 --2- 172.21.15.110:0/2111528188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba8074c30 0x7faba8075010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.218+0000 7fabaf200640 1 -- 172.21.15.110:0/2111528188 >> 172.21.15.110:0/2111528188 conn(0x7faba8079dc0 msgr2=0x7faba807a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.218+0000 7fabaf200640 1 -- 172.21.15.110:0/2111528188 shutdown_connections 2024-04-26T11:33:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.218+0000 7fabaf200640 1 -- 172.21.15.110:0/2111528188 wait complete. 2024-04-26T11:33:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.219+0000 7fabaf200640 1 Processor -- start 2024-04-26T11:33:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7fabaf200640 1 -- start start 2024-04-26T11:33:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7fabaf200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba8074c30 0x7faba819f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7fabaf200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faba8075550 0x7faba819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7fabaf200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faba81139f0 0x7faba81a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7fabaf200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faba8119280 con 0x7faba8074c30 2024-04-26T11:33:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7fabaf200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faba8119100 con 0x7faba81139f0 2024-04-26T11:33:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7fabaf200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faba8119400 con 0x7faba8075550 2024-04-26T11:33:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7faba7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faba8075550 0x7faba819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7faba7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faba8075550 0x7faba819fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:54932/0 (socket says 172.21.15.110:54932) 2024-04-26T11:33:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.220+0000 7faba7400640 1 -- 172.21.15.110:0/1038426169 learned_addr learned my addr 172.21.15.110:0/1038426169 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.221+0000 7fabad200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faba81139f0 0x7faba81a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.221+0000 7faba7400640 1 -- 172.21.15.110:0/1038426169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faba81139f0 msgr2=0x7faba81a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.221+0000 7faba7400640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faba81139f0 0x7faba81a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.221+0000 7faba7400640 1 -- 172.21.15.110:0/1038426169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba8074c30 msgr2=0x7faba819f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.221+0000 7faba7400640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba8074c30 0x7faba819f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.221+0000 7faba7400640 1 -- 172.21.15.110:0/1038426169 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba81a4700 con 0x7faba8075550 2024-04-26T11:33:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.221+0000 7fabad200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faba81139f0 0x7faba81a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:33:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.222+0000 7faba7400640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faba8075550 0x7faba819fc80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fab9400ea20 tx=0x7fab9400eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.223+0000 7faba4c00640 1 -- 172.21.15.110:0/1038426169 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9400cd80 con 0x7faba8075550 2024-04-26T11:33:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.223+0000 7faba4c00640 1 -- 172.21.15.110:0/1038426169 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab940108e0 con 0x7faba8075550 2024-04-26T11:33:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.223+0000 7fabaf200640 1 -- 172.21.15.110:0/1038426169 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba81a49f0 con 0x7faba8075550 2024-04-26T11:33:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.223+0000 7faba4c00640 1 -- 172.21.15.110:0/1038426169 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94018840 con 0x7faba8075550 2024-04-26T11:33:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.223+0000 7fabaf200640 1 -- 172.21.15.110:0/1038426169 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba8106c80 con 0x7faba8075550 2024-04-26T11:33:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.230+0000 7faba4c00640 1 -- 172.21.15.110:0/1038426169 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fab940189e0 con 0x7faba8075550 2024-04-26T11:33:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.230+0000 7fabb1fce740 1 Processor -- start 2024-04-26T11:33:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.230+0000 7fabb1fce740 1 -- start start 2024-04-26T11:33:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.231+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f7710dd0 0x5560f77111b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.231+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f771ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.231+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f771bfb0 0x5560f771e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.231+0000 7fabb1fce740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5560f7676380 con 0x5560f771bfb0 2024-04-26T11:33:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.231+0000 7fabb1fce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5560f7612c30 con 0x5560f77116f0 2024-04-26T11:33:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.231+0000 7fabb1fce740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5560f7672340 con 0x5560f7710dd0 2024-04-26T11:33:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.231+0000 7fabad200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f7710dd0 0x5560f77111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.232+0000 7fabad200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f7710dd0 0x5560f77111b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:54940/0 (socket says 172.21.15.110:54940) 2024-04-26T11:33:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.232+0000 7fabad200640 1 -- 172.21.15.110:0/3161549221 learned_addr learned my addr 172.21.15.110:0/3161549221 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.232+0000 7faba7400640 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f771bfb0 0x5560f771e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.232+0000 7faba7e00640 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f771ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.232+0000 7faba4c00640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fab8c0a3f20 0x7fab8c0a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.233+0000 7faba7400640 1 -- 172.21.15.110:0/3161549221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f7710dd0 msgr2=0x5560f77111b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.233+0000 7faba7400640 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f7710dd0 0x5560f77111b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.233+0000 7faba7400640 1 -- 172.21.15.110:0/3161549221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 msgr2=0x5560f771ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.233+0000 7faba7400640 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f771ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.233+0000 7faba7400640 1 -- 172.21.15.110:0/3161549221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f7634940 con 0x5560f771bfb0 2024-04-26T11:33:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.233+0000 7fabad200640 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f7710dd0 0x5560f77111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.234+0000 7faba4c00640 1 -- 172.21.15.110:0/1038426169 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fab940d0c40 con 0x7faba8075550 2024-04-26T11:33:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.234+0000 7faba7400640 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f771bfb0 0x5560f771e3a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fab940ce310 tx=0x7fab940d4e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f21effc9db631e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.235+0000 7fabad200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fab8c0a3f20 0x7fab8c0a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.235+0000 7fab9d600640 1 -- 172.21.15.110:0/3161549221 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9409c930 con 0x5560f771bfb0 2024-04-26T11:33:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.236+0000 7fab9d600640 1 -- 172.21.15.110:0/3161549221 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab94098a50 con 0x5560f771bfb0 2024-04-26T11:33:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.236+0000 7fab9d600640 1 -- 172.21.15.110:0/3161549221 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab940a20a0 con 0x5560f771bfb0 2024-04-26T11:33:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabb1fce740 1 -- 172.21.15.110:0/3161549221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f771bfb0 msgr2=0x5560f771e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabad200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fab8c0a3f20 0x7fab8c0a63e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faba0009a60 tx=0x7faba00095c0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f771bfb0 0x5560f771e3a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fab940ce310 tx=0x7fab940d4e80 comp rx=0 tx=0).stop 2024-04-26T11:33:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabb1fce740 1 -- 172.21.15.110:0/3161549221 shutdown_connections 2024-04-26T11:33:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f771bfb0 0x5560f771e3a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f771ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3161549221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f7710dd0 0x5560f77111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabb1fce740 1 -- 172.21.15.110:0/3161549221 >> 172.21.15.110:0/3161549221 conn(0x5560f770d2e0 msgr2=0x5560f770d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabb1fce740 1 -- 172.21.15.110:0/3161549221 shutdown_connections 2024-04-26T11:33:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.237+0000 7fabb1fce740 1 -- 172.21.15.110:0/3161549221 wait complete. 2024-04-26T11:33:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.239+0000 7fabb1fce740 1 -- start start 2024-04-26T11:33:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.240+0000 7fabb1fce740 1 Processor -- start 2024-04-26T11:33:59.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.241+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f7718ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.241+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f7719420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f771bfb0 0x5560f7719960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7fabb1fce740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5560f771ebe0 con 0x5560f7710dd0 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7fabb1fce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5560f75fdc60 con 0x5560f77116f0 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7fabb1fce740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5560f771ed60 con 0x5560f771bfb0 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f7719420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f7719420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:37982/0 (socket says 172.21.15.110:37982) 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7400640 1 -- 172.21.15.110:0/3702946285 learned_addr learned my addr 172.21.15.110:0/3702946285 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7fabb1fce740 10 client.0 _ll_register_callbacks cb 0x5560f7629e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7fabad200640 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f771bfb0 0x5560f7719960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7400640 1 -- 172.21.15.110:0/3702946285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f771bfb0 msgr2=0x5560f7719960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7400640 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f771bfb0 0x5560f7719960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7e00640 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f7718ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7400640 1 -- 172.21.15.110:0/3702946285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 msgr2=0x5560f7718ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7400640 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f7718ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7400640 1 -- 172.21.15.110:0/3702946285 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f760c510 con 0x5560f77116f0 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.242+0000 7faba7e00640 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f7718ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.243+0000 7faba7400640 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f7719420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fab940ce910 tx=0x7fab940ce2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7e3e85ec7cf22d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.243+0000 7fab92000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.243+0000 7fab92000640 1 -- 172.21.15.110:0/3702946285 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab940b6060 con 0x5560f77116f0 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.243+0000 7fab92000640 1 -- 172.21.15.110:0/3702946285 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fab94010a90 con 0x5560f77116f0 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.243+0000 7fabb1fce740 1 -- 172.21.15.110:0/3702946285 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab94098a50 con 0x5560f77116f0 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.243+0000 7fab92000640 1 -- 172.21.15.110:0/3702946285 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fab9409c4c0 con 0x5560f77116f0 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.243+0000 7fabb1fce740 10 client.25508 fetch_fsmap learned FSMap version 31 2024-04-26T11:33:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.243+0000 7fabb1fce740 1 -- 172.21.15.110:0/3702946285 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5560f7388210 con 0x5560f77116f0 2024-04-26T11:33:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.243+0000 7fab92000640 1 -- 172.21.15.110:0/3702946285 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab94098a50 con 0x5560f77116f0 2024-04-26T11:33:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.244+0000 7fab92000640 1 -- 172.21.15.110:0/3702946285 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fab940991d0 con 0x5560f77116f0 2024-04-26T11:33:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.244+0000 7fabb1fce740 10 client.25508 fetch_fsmap finished waiting for FSMap version 31 2024-04-26T11:33:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.244+0000 7fabb1fce740 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.244+0000 7fabb1fce740 20 client.25508 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.244+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5560f772bb30 0x5560f772df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.244+0000 7fabb1fce740 4 client.25508 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.244+0000 7fabb1fce740 1 -- 172.21.15.110:0/3702946285 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560f7683f90 con 0x5560f772bb30 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.244+0000 7faba7e00640 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5560f772bb30 0x5560f772df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.245+0000 7faba7e00640 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5560f772bb30 0x5560f772df20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c89c5777fdffc70 server_cookie=b82ce990b8838106 in_seq=0 out_seq=0 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.245+0000 7fab92000640 10 client.25508 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.245+0000 7fab92000640 1 -- 172.21.15.110:0/3702946285 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5560f7683f90 con 0x5560f772bb30 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.246+0000 7fab92000640 10 client.25508 handle_command_reply: tid=0 2024-04-26T11:33:59.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.246+0000 7fabb1fce740 1 client.25508 shutdown 2024-04-26T11:33:59.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.248+0000 7fabb1fce740 1 -- 172.21.15.110:0/3702946285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 msgr2=0x5560f7719420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:59.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.248+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f7719420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fab940ce910 tx=0x7fab940ce2b0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.248+0000 7fabb1fce740 1 -- 172.21.15.110:0/3702946285 shutdown_connections 2024-04-26T11:33:59.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.248+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5560f772bb30 0x5560f772df20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.248+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f771bfb0 0x5560f7719960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.248+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f77116f0 0x5560f7719420 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.248+0000 7fabb1fce740 1 --2- 172.21.15.110:0/3702946285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f7718ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.248+0000 7fabb1fce740 1 -- 172.21.15.110:0/3702946285 >> 172.21.15.110:0/3702946285 conn(0x5560f770d2e0 msgr2=0x5560f7713060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:59.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.248+0000 7fab92000640 0 client.25508 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:59.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.249+0000 7fabb1fce740 1 -- 172.21.15.110:0/3702946285 shutdown_connections 2024-04-26T11:33:59.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.249+0000 7fabb1fce740 1 -- 172.21.15.110:0/3702946285 wait complete. 2024-04-26T11:33:59.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.250+0000 7fabb1fce740 20 client.25508 trim_cache size 0 max 16384 2024-04-26T11:33:59.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.275+0000 7fabb1fce740 1 Processor -- start 2024-04-26T11:33:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.275+0000 7fabb1fce740 1 -- start start 2024-04-26T11:33:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.276+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f7727aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.276+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f7718040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.276+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f7713790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.276+0000 7fabb1fce740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faba81bff30 con 0x5560f7710dd0 2024-04-26T11:33:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.276+0000 7fabb1fce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faba81bd7a0 con 0x5560f771bfb0 2024-04-26T11:33:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.276+0000 7fabb1fce740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faba810d7c0 con 0x5560f77116f0 2024-04-26T11:33:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.277+0000 7faba7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f7718040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.277+0000 7faba7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f7718040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:54958/0 (socket says 172.21.15.110:54958) 2024-04-26T11:33:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.277+0000 7faba7400640 1 -- 172.21.15.110:0/461052721 learned_addr learned my addr 172.21.15.110:0/461052721 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.277+0000 7faba7e00640 1 --2- 172.21.15.110:0/461052721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f7727aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.278+0000 7fabad200640 1 --2- 172.21.15.110:0/461052721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f7713790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.278+0000 7faba7400640 1 -- 172.21.15.110:0/461052721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 msgr2=0x5560f7713790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.278+0000 7faba7400640 1 --2- 172.21.15.110:0/461052721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f7713790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.278+0000 7faba7400640 1 -- 172.21.15.110:0/461052721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 msgr2=0x5560f7727aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.278+0000 7faba7400640 1 --2- 172.21.15.110:0/461052721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f7727aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.278+0000 7faba7400640 1 -- 172.21.15.110:0/461052721 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f7454620 con 0x5560f77116f0 2024-04-26T11:33:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.279+0000 7faba7400640 1 --2- 172.21.15.110:0/461052721 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f7718040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c6a0 tx=0x7fab940ce3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b8a9d5004921916 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.280+0000 7fab9cc00640 1 -- 172.21.15.110:0/461052721 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab940b6040 con 0x5560f77116f0 2024-04-26T11:33:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.280+0000 7fab9cc00640 1 -- 172.21.15.110:0/461052721 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab94098a50 con 0x5560f77116f0 2024-04-26T11:33:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.280+0000 7fab9cc00640 1 -- 172.21.15.110:0/461052721 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9409c6a0 con 0x5560f77116f0 2024-04-26T11:33:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.281+0000 7fabb1fce740 1 -- 172.21.15.110:0/461052721 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 msgr2=0x5560f7718040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.281+0000 7fabb1fce740 1 --2- 172.21.15.110:0/461052721 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f7718040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c6a0 tx=0x7fab940ce3c0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.282+0000 7fabb1fce740 1 -- 172.21.15.110:0/461052721 shutdown_connections 2024-04-26T11:33:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.282+0000 7fabb1fce740 1 --2- 172.21.15.110:0/461052721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f7713790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.282+0000 7fabb1fce740 1 --2- 172.21.15.110:0/461052721 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f7718040 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.282+0000 7fabb1fce740 1 --2- 172.21.15.110:0/461052721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f7727aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.282+0000 7fabb1fce740 1 -- 172.21.15.110:0/461052721 >> 172.21.15.110:0/461052721 conn(0x5560f770d2e0 msgr2=0x5560f771a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.282+0000 7fabb1fce740 1 -- 172.21.15.110:0/461052721 shutdown_connections 2024-04-26T11:33:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.282+0000 7fabb1fce740 1 -- 172.21.15.110:0/461052721 wait complete. 2024-04-26T11:33:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.282+0000 7fabb1fce740 1 -- start start 2024-04-26T11:33:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.283+0000 7fabb1fce740 1 Processor -- start 2024-04-26T11:33:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.283+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f77243f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.283+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f778cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.283+0000 7fabb1fce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f778d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.284+0000 7fabb1fce740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faba810de30 con 0x5560f7710dd0 2024-04-26T11:33:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.284+0000 7fabb1fce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faba810f2a0 con 0x5560f771bfb0 2024-04-26T11:33:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.284+0000 7fabb1fce740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faba810e500 con 0x5560f77116f0 2024-04-26T11:33:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.284+0000 7fabb1fce740 10 client.0 _ll_register_callbacks cb 0x7fab98006f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:33:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.284+0000 7fabad200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f778d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.284+0000 7faba7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f778cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.284+0000 7faba7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f778cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:54960/0 (socket says 172.21.15.110:54960) 2024-04-26T11:33:59.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.284+0000 7faba7400640 1 -- 172.21.15.110:0/2719723257 learned_addr learned my addr 172.21.15.110:0/2719723257 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:33:59.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.284+0000 7fabad200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f778d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38000/0 (socket says 172.21.15.110:38000) 2024-04-26T11:33:59.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.285+0000 7faba7e00640 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f77243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7faba7400640 1 -- 172.21.15.110:0/2719723257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 msgr2=0x5560f778d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7faba7400640 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f778d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7faba7400640 1 -- 172.21.15.110:0/2719723257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 msgr2=0x5560f77243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7faba7400640 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f77243f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7faba7400640 1 -- 172.21.15.110:0/2719723257 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f7630cb0 con 0x5560f77116f0 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7fabad200640 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f778d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7faba7400640 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f778cd40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fab9409caf0 tx=0x7fab940988b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a013fa6f7eefe279 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7fab92000640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7fab92000640 1 -- 172.21.15.110:0/2719723257 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab940b6040 con 0x5560f77116f0 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7fab92000640 1 -- 172.21.15.110:0/2719723257 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fab94010a90 con 0x5560f77116f0 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.286+0000 7fabb1fce740 1 -- 172.21.15.110:0/2719723257 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab94098a50 con 0x5560f77116f0 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fab92000640 1 -- 172.21.15.110:0/2719723257 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fab9409c6a0 con 0x5560f77116f0 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fabb1fce740 10 client.25531 fetch_fsmap learned FSMap version 31 2024-04-26T11:33:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fabb1fce740 1 -- 172.21.15.110:0/2719723257 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5560f7630cb0 con 0x5560f77116f0 2024-04-26T11:33:59.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fab92000640 1 -- 172.21.15.110:0/2719723257 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab94098a50 con 0x5560f77116f0 2024-04-26T11:33:59.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fab92000640 1 -- 172.21.15.110:0/2719723257 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fab940a5340 con 0x5560f77116f0 2024-04-26T11:33:59.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fabb1fce740 10 client.25531 fetch_fsmap finished waiting for FSMap version 31 2024-04-26T11:33:59.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fabb1fce740 10 client.25531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:33:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fabb1fce740 20 client.25531 populate_metadata read hostname 'smithi110' 2024-04-26T11:33:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fabb1fce740 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5560f77a2f70 0x5560f77a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:33:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fabb1fce740 4 client.25531 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:33:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.287+0000 7fabb1fce740 1 -- 172.21.15.110:0/2719723257 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5560f767de00 con 0x5560f77a2f70 2024-04-26T11:33:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.288+0000 7faba7e00640 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5560f77a2f70 0x5560f77a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:33:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.288+0000 7faba7e00640 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5560f77a2f70 0x5560f77a5390 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9df443d7a7904b8 server_cookie=4d6c85fbe9f004dc in_seq=0 out_seq=0 2024-04-26T11:33:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.288+0000 7fab92000640 10 client.25531 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:59.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.300+0000 7fab92000640 1 -- 172.21.15.110:0/2719723257 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5560f767de00 con 0x5560f77a2f70 2024-04-26T11:33:59.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.300+0000 7fab92000640 10 client.25531 handle_command_reply: tid=0 2024-04-26T11:33:59.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.300+0000 7fabb1fce740 1 client.25531 shutdown 2024-04-26T11:33:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.300+0000 7fabb1fce740 1 -- 172.21.15.110:0/2719723257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 msgr2=0x5560f778cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.301+0000 7fabb1fce740 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f778cd40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fab9409caf0 tx=0x7fab940988b0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.301+0000 7fabb1fce740 1 -- 172.21.15.110:0/2719723257 shutdown_connections 2024-04-26T11:33:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.301+0000 7fabb1fce740 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5560f771bfb0 0x5560f778d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.301+0000 7fabb1fce740 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5560f77a2f70 0x5560f77a5390 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.301+0000 7fabb1fce740 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5560f77116f0 0x5560f778cd40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.301+0000 7fabb1fce740 1 --2- 172.21.15.110:0/2719723257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560f7710dd0 0x5560f77243f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.301+0000 7fabb1fce740 1 -- 172.21.15.110:0/2719723257 >> 172.21.15.110:0/2719723257 conn(0x5560f770d2e0 msgr2=0x5560f7719710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.301+0000 7fab92000640 0 client.25531 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:33:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.302+0000 7fabb1fce740 1 -- 172.21.15.110:0/2719723257 shutdown_connections 2024-04-26T11:33:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.302+0000 7fabb1fce740 1 -- 172.21.15.110:0/2719723257 wait complete. 2024-04-26T11:33:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.302+0000 7fabb1fce740 20 client.25531 trim_cache size 0 max 16384 2024-04-26T11:33:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:33:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:33:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:33:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:33:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.304+0000 7fabaf200640 1 -- 172.21.15.110:0/1038426169 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fab8c0a3f20 msgr2=0x7fab8c0a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.304+0000 7fabaf200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fab8c0a3f20 0x7fab8c0a63e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faba0009a60 tx=0x7faba00095c0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.304+0000 7fabaf200640 1 -- 172.21.15.110:0/1038426169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faba8075550 msgr2=0x7faba819fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:33:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.304+0000 7fabaf200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faba8075550 0x7faba819fc80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fab9400ea20 tx=0x7fab9400eee0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.305+0000 7fabaf200640 1 -- 172.21.15.110:0/1038426169 shutdown_connections 2024-04-26T11:33:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.305+0000 7fabaf200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fab8c0a3f20 0x7fab8c0a63e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.305+0000 7fabaf200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faba81139f0 0x7faba81a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.305+0000 7fabaf200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faba8075550 0x7faba819fc80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.305+0000 7fabaf200640 1 --2- 172.21.15.110:0/1038426169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba8074c30 0x7faba819f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:33:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.305+0000 7fabaf200640 1 -- 172.21.15.110:0/1038426169 >> 172.21.15.110:0/1038426169 conn(0x7faba8079dc0 msgr2=0x7faba80ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:33:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.305+0000 7fabaf200640 1 -- 172.21.15.110:0/1038426169 shutdown_connections 2024-04-26T11:33:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:33:59.305+0000 7fabaf200640 1 -- 172.21.15.110:0/1038426169 wait complete. 2024-04-26T11:33:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:33:59 smithi110 ceph-mon[28069]: pgmap v84: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 920 op/s 2024-04-26T11:33:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:33:59 smithi193 ceph-mon[32782]: pgmap v84: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 920 op/s 2024-04-26T11:33:59.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 105.0 s, 2897.8 tps, lat 34.700 ms stddev 37.747 2024-04-26T11:34:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:33:59 smithi196 ceph-mon[32572]: pgmap v84: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 920 op/s 2024-04-26T11:34:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:01 smithi110 ceph-mon[28069]: pgmap v85: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 612 op/s 2024-04-26T11:34:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:01 smithi193 ceph-mon[32782]: pgmap v85: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 612 op/s 2024-04-26T11:34:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:01 smithi196 ceph-mon[32572]: pgmap v85: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 612 op/s 2024-04-26T11:34:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:03 smithi110 ceph-mon[28069]: pgmap v86: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 612 op/s 2024-04-26T11:34:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:03 smithi193 ceph-mon[32782]: pgmap v86: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 612 op/s 2024-04-26T11:34:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:03 smithi196 ceph-mon[32572]: pgmap v86: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 MiB/s wr, 612 op/s 2024-04-26T11:34:04.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 110.0 s, 621.0 tps, lat 160.604 ms stddev 273.956 2024-04-26T11:34:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:05 smithi110 ceph-mon[28069]: pgmap v87: 97 pgs: 97 active+clean; 1.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 932 op/s 2024-04-26T11:34:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:05 smithi193 ceph-mon[32782]: pgmap v87: 97 pgs: 97 active+clean; 1.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 932 op/s 2024-04-26T11:34:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:05 smithi196 ceph-mon[32572]: pgmap v87: 97 pgs: 97 active+clean; 1.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 932 op/s 2024-04-26T11:34:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:07 smithi193 ceph-mon[32782]: pgmap v88: 97 pgs: 97 active+clean; 1.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.6 MiB/s wr, 615 op/s 2024-04-26T11:34:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:07 smithi196 ceph-mon[32572]: pgmap v88: 97 pgs: 97 active+clean; 1.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.6 MiB/s wr, 615 op/s 2024-04-26T11:34:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:07 smithi110 ceph-mon[28069]: pgmap v88: 97 pgs: 97 active+clean; 1.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.6 MiB/s wr, 615 op/s 2024-04-26T11:34:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:09 smithi193 ceph-mon[32782]: pgmap v89: 97 pgs: 97 active+clean; 1.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 37 MiB/s wr, 1.87k op/s 2024-04-26T11:34:09.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 115.0 s, 3120.4 tps, lat 32.091 ms stddev 40.238 2024-04-26T11:34:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:09 smithi196 ceph-mon[32572]: pgmap v89: 97 pgs: 97 active+clean; 1.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 37 MiB/s wr, 1.87k op/s 2024-04-26T11:34:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:09 smithi110 ceph-mon[28069]: pgmap v89: 97 pgs: 97 active+clean; 1.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 37 MiB/s wr, 1.87k op/s 2024-04-26T11:34:11.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:11 smithi196 ceph-mon[32572]: pgmap v90: 97 pgs: 97 active+clean; 1.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 MiB/s wr, 1.58k op/s 2024-04-26T11:34:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:11 smithi193 ceph-mon[32782]: pgmap v90: 97 pgs: 97 active+clean; 1.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 MiB/s wr, 1.58k op/s 2024-04-26T11:34:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:11 smithi110 ceph-mon[28069]: pgmap v90: 97 pgs: 97 active+clean; 1.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 MiB/s wr, 1.58k op/s 2024-04-26T11:34:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.501+0000 7f31efe00640 1 -- 172.21.15.110:0/1876975578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31e81019b0 msgr2=0x7f31e8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.501+0000 7f31efe00640 1 --2- 172.21.15.110:0/1876975578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31e81019b0 0x7f31e8101d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009900 tx=0x7f31dc02a510 comp rx=0 tx=0).stop 2024-04-26T11:34:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.502+0000 7f31efe00640 1 -- 172.21.15.110:0/1876975578 shutdown_connections 2024-04-26T11:34:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.502+0000 7f31efe00640 1 --2- 172.21.15.110:0/1876975578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e8106cd0 0x7f31e8107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.502+0000 7f31efe00640 1 --2- 172.21.15.110:0/1876975578 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e81022d0 0x7f31e8106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.502+0000 7f31efe00640 1 --2- 172.21.15.110:0/1876975578 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31e81019b0 0x7f31e8101d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.502+0000 7f31efe00640 1 -- 172.21.15.110:0/1876975578 >> 172.21.15.110:0/1876975578 conn(0x7f31e80789b0 msgr2=0x7f31e8078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.502+0000 7f31efe00640 1 -- 172.21.15.110:0/1876975578 shutdown_connections 2024-04-26T11:34:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.503+0000 7f31efe00640 1 -- 172.21.15.110:0/1876975578 wait complete. 2024-04-26T11:34:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.506+0000 7f31efe00640 1 Processor -- start 2024-04-26T11:34:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.507+0000 7f31efe00640 1 -- start start 2024-04-26T11:34:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.507+0000 7f31efe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31e81019b0 0x7f31e819f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.507+0000 7f31efe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e81022d0 0x7f31e819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.507+0000 7f31efe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e8106cd0 0x7f31e81a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.507+0000 7f31efe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f31e8119250 con 0x7f31e8106cd0 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.507+0000 7f31efe00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81190d0 con 0x7f31e81022d0 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.507+0000 7f31efe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81193d0 con 0x7f31e81019b0 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31eca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e81022d0 0x7f31e819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31eca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e81022d0 0x7f31e819fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56106/0 (socket says 172.21.15.110:56106) 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31eca00640 1 -- 172.21.15.110:0/2543836383 learned_addr learned my addr 172.21.15.110:0/2543836383 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31ed400640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31e81019b0 0x7f31e819f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31ede00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e8106cd0 0x7f31e81a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31eca00640 1 -- 172.21.15.110:0/2543836383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31e81019b0 msgr2=0x7f31e819f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31eca00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31e81019b0 0x7f31e819f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31eca00640 1 -- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e8106cd0 msgr2=0x7f31e81a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31eca00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e8106cd0 0x7f31e81a4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.508+0000 7f31eca00640 1 -- 172.21.15.110:0/2543836383 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e81a4730 con 0x7f31e81022d0 2024-04-26T11:34:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.509+0000 7f31eca00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e81022d0 0x7f31e819fcd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f31d400d950 tx=0x7f31d400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.509+0000 7f31e6000640 1 -- 172.21.15.110:0/2543836383 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4017070 con 0x7f31e81022d0 2024-04-26T11:34:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.509+0000 7f31e6000640 1 -- 172.21.15.110:0/2543836383 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d4009c30 con 0x7f31e81022d0 2024-04-26T11:34:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.509+0000 7f31e6000640 1 -- 172.21.15.110:0/2543836383 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d400f620 con 0x7f31e81022d0 2024-04-26T11:34:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.510+0000 7f31efe00640 1 -- 172.21.15.110:0/2543836383 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e81a4a20 con 0x7f31e81022d0 2024-04-26T11:34:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.510+0000 7f31efe00640 1 -- 172.21.15.110:0/2543836383 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e81ac2b0 con 0x7f31e81022d0 2024-04-26T11:34:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.514+0000 7f31e6000640 1 -- 172.21.15.110:0/2543836383 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f31d4005030 con 0x7f31e81022d0 2024-04-26T11:34:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.516+0000 7f31e6000640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f31d00a3ec0 0x7f31d00a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.516+0000 7f31e6000640 1 -- 172.21.15.110:0/2543836383 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f31d40cfc70 con 0x7f31e81022d0 2024-04-26T11:34:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.517+0000 7f31ed400640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f31d00a3ec0 0x7f31d00a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.517+0000 7f31f2dca740 1 Processor -- start 2024-04-26T11:34:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.518+0000 7f31f2dca740 1 -- start start 2024-04-26T11:34:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.518+0000 7f31ed400640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f31d00a3ec0 0x7f31d00a6380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31dc000c00 tx=0x7f31dc031400 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.518+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x55696813a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x556968144a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x5569681473a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31f2dca740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55696809f380 con 0x556968139dd0 2024-04-26T11:34:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31f2dca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55696803bc30 con 0x556968144fb0 2024-04-26T11:34:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31f2dca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55696809b340 con 0x55696813a6f0 2024-04-26T11:34:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31ede00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x5569681473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31eca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x556968144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31eca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x556968144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:44566/0 (socket says 172.21.15.110:44566) 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31eca00640 1 -- 172.21.15.110:0/555933156 learned_addr learned my addr 172.21.15.110:0/555933156 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31ed400640 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x55696813a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31ede00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x5569681473a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56108/0 (socket says 172.21.15.110:56108) 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31eca00640 1 -- 172.21.15.110:0/555933156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 msgr2=0x5569681473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31eca00640 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x5569681473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31eca00640 1 -- 172.21.15.110:0/555933156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 msgr2=0x55696813a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31eca00640 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x55696813a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31eca00640 1 -- 172.21.15.110:0/555933156 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696805d940 con 0x55696813a6f0 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31ede00640 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x5569681473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:34:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.519+0000 7f31ed400640 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x55696813a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:34:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.520+0000 7f31eca00640 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x556968144a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31d40a4270 tx=0x7f31d409b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd18dcc8622e4135 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.520+0000 7f31da600640 1 -- 172.21.15.110:0/555933156 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d40b5070 con 0x55696813a6f0 2024-04-26T11:34:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.520+0000 7f31da600640 1 -- 172.21.15.110:0/555933156 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d40a47a0 con 0x55696813a6f0 2024-04-26T11:34:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.520+0000 7f31da600640 1 -- 172.21.15.110:0/555933156 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d409ce60 con 0x55696813a6f0 2024-04-26T11:34:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.521+0000 7f31f2dca740 1 -- 172.21.15.110:0/555933156 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 msgr2=0x556968144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.521+0000 7f31f2dca740 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x556968144a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31d40a4270 tx=0x7f31d409b780 comp rx=0 tx=0).stop 2024-04-26T11:34:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.522+0000 7f31f2dca740 1 -- 172.21.15.110:0/555933156 shutdown_connections 2024-04-26T11:34:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.522+0000 7f31f2dca740 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x5569681473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.522+0000 7f31f2dca740 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x556968144a70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.522+0000 7f31f2dca740 1 --2- 172.21.15.110:0/555933156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x55696813a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.522+0000 7f31f2dca740 1 -- 172.21.15.110:0/555933156 >> 172.21.15.110:0/555933156 conn(0x5569681362e0 msgr2=0x5569681366c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.522+0000 7f31f2dca740 1 -- 172.21.15.110:0/555933156 shutdown_connections 2024-04-26T11:34:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.522+0000 7f31f2dca740 1 -- 172.21.15.110:0/555933156 wait complete. 2024-04-26T11:34:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.523+0000 7f31f2dca740 1 -- start start 2024-04-26T11:34:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.523+0000 7f31f2dca740 1 Processor -- start 2024-04-26T11:34:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.524+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x556968141f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.524+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x5569681424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.524+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x556968142a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.524+0000 7f31eca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x5569681424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.524+0000 7f31f2dca740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556968147b80 con 0x556968139dd0 2024-04-26T11:34:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.524+0000 7f31eca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x5569681424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:44574/0 (socket says 172.21.15.110:44574) 2024-04-26T11:34:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.524+0000 7f31eca00640 1 -- 172.21.15.110:0/4036855135 learned_addr learned my addr 172.21.15.110:0/4036855135 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.524+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556968026c60 con 0x556968144fb0 2024-04-26T11:34:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.525+0000 7f31ede00640 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x556968142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.525+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556968147d00 con 0x55696813a6f0 2024-04-26T11:34:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.525+0000 7f31f2dca740 10 client.0 _ll_register_callbacks cb 0x556968052e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.525+0000 7f31ed400640 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x556968141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.525+0000 7f31ede00640 1 -- 172.21.15.110:0/4036855135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 msgr2=0x5569681424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.525+0000 7f31ede00640 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x5569681424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.525+0000 7f31ede00640 1 -- 172.21.15.110:0/4036855135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 msgr2=0x556968141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.525+0000 7f31ede00640 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x556968141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.525+0000 7f31ede00640 1 -- 172.21.15.110:0/4036855135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556968035510 con 0x556968144fb0 2024-04-26T11:34:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.526+0000 7f31ede00640 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x556968142a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31e000e880 tx=0x7f31e000ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b563edfe91c20a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.526+0000 7f31cea00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:34:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.526+0000 7f31cea00640 1 -- 172.21.15.110:0/4036855135 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0018020 con 0x556968144fb0 2024-04-26T11:34:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.526+0000 7f31cea00640 1 -- 172.21.15.110:0/4036855135 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f31e000cb80 con 0x556968144fb0 2024-04-26T11:34:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.526+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31d40a47a0 con 0x556968144fb0 2024-04-26T11:34:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.527+0000 7f31cea00640 1 -- 172.21.15.110:0/4036855135 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f31e0023050 con 0x556968144fb0 2024-04-26T11:34:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.527+0000 7f31f2dca740 10 client.25526 fetch_fsmap learned FSMap version 31 2024-04-26T11:34:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.527+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556967db1210 con 0x556968144fb0 2024-04-26T11:34:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.527+0000 7f31cea00640 1 -- 172.21.15.110:0/4036855135 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d40a47a0 con 0x556968144fb0 2024-04-26T11:34:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.527+0000 7f31cea00640 1 -- 172.21.15.110:0/4036855135 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f31e0011070 con 0x556968144fb0 2024-04-26T11:34:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.527+0000 7f31f2dca740 10 client.25526 fetch_fsmap finished waiting for FSMap version 31 2024-04-26T11:34:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.527+0000 7f31f2dca740 10 client.25526 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:34:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.528+0000 7f31f2dca740 20 client.25526 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.528+0000 7f31f2dca740 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556968154f00 0x5569681573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.528+0000 7f31f2dca740 4 client.25526 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:34:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.528+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569680acf90 con 0x556968154f00 2024-04-26T11:34:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.528+0000 7f31ed400640 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556968154f00 0x5569681573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.529+0000 7f31ed400640 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556968154f00 0x5569681573a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=443d8c8b38b70dc6 server_cookie=8e16ba7d34023c6c in_seq=0 out_seq=0 2024-04-26T11:34:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.529+0000 7f31cea00640 10 client.25526 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.530+0000 7f31cea00640 1 -- 172.21.15.110:0/4036855135 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5569680acf90 con 0x556968154f00 2024-04-26T11:34:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.530+0000 7f31cea00640 10 client.25526 handle_command_reply: tid=0 2024-04-26T11:34:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.530+0000 7f31f2dca740 1 client.25526 shutdown 2024-04-26T11:34:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.531+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 msgr2=0x556968142a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.531+0000 7f31f2dca740 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x556968142a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31e000e880 tx=0x7f31e000ed40 comp rx=0 tx=0).stop 2024-04-26T11:34:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.532+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 shutdown_connections 2024-04-26T11:34:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.532+0000 7f31f2dca740 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968144fb0 0x556968142a00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.532+0000 7f31f2dca740 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x556968154f00 0x5569681573a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.532+0000 7f31f2dca740 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55696813a6f0 0x5569681424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.532+0000 7f31f2dca740 1 --2- 172.21.15.110:0/4036855135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x556968141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.532+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 >> 172.21.15.110:0/4036855135 conn(0x5569681362e0 msgr2=0x55696813c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.532+0000 7f31cea00640 0 client.25526 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.533+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 shutdown_connections 2024-04-26T11:34:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.533+0000 7f31f2dca740 1 -- 172.21.15.110:0/4036855135 wait complete. 2024-04-26T11:34:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.533+0000 7f31f2dca740 20 client.25526 trim_cache size 0 max 16384 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.562+0000 7f31f2dca740 1 Processor -- start 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.562+0000 7f31f2dca740 1 -- start start 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.562+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x556968150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.562+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696813a6f0 0x55696813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.563+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 0x55696815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.563+0000 7f31f2dca740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81b7810 con 0x556968139dd0 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.563+0000 7f31f2dca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81b5080 con 0x55696813a6f0 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.563+0000 7f31f2dca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81b2ed0 con 0x556968144fb0 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.563+0000 7f31eca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696813a6f0 0x55696813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.563+0000 7f31eca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696813a6f0 0x55696813c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56130/0 (socket says 172.21.15.110:56130) 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.563+0000 7f31eca00640 1 -- 172.21.15.110:0/912978443 learned_addr learned my addr 172.21.15.110:0/912978443 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.563+0000 7f31ed400640 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x556968150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.564+0000 7f31ede00640 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 0x55696815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.564+0000 7f31eca00640 1 -- 172.21.15.110:0/912978443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 msgr2=0x55696815cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.564+0000 7f31eca00640 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 0x55696815cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.564+0000 7f31eca00640 1 -- 172.21.15.110:0/912978443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 msgr2=0x556968150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.564+0000 7f31eca00640 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x556968150ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.564+0000 7f31eca00640 1 -- 172.21.15.110:0/912978443 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556967e7d620 con 0x55696813a6f0 2024-04-26T11:34:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.564+0000 7f31ede00640 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 0x55696815cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:34:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.564+0000 7f31eca00640 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696813a6f0 0x55696813c7e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31d4098500 tx=0x7f31d4010cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2a19cd115f9aff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:12.568 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.565+0000 7f31d9c00640 1 -- 172.21.15.110:0/912978443 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d409ce60 con 0x55696813a6f0 2024-04-26T11:34:12.568 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.565+0000 7f31d9c00640 1 -- 172.21.15.110:0/912978443 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d40bc030 con 0x55696813a6f0 2024-04-26T11:34:12.568 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.565+0000 7f31d9c00640 1 -- 172.21.15.110:0/912978443 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d40b5040 con 0x55696813a6f0 2024-04-26T11:34:12.568 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.566+0000 7f31f2dca740 1 -- 172.21.15.110:0/912978443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696813a6f0 msgr2=0x55696813c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.567+0000 7f31f2dca740 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696813a6f0 0x55696813c7e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31d4098500 tx=0x7f31d4010cb0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.567+0000 7f31f2dca740 1 -- 172.21.15.110:0/912978443 shutdown_connections 2024-04-26T11:34:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.567+0000 7f31f2dca740 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 0x55696815cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.567+0000 7f31f2dca740 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696813a6f0 0x55696813c7e0 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31d4098500 tx=0x7f31d4010cb0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.567+0000 7f31f2dca740 1 --2- 172.21.15.110:0/912978443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556968139dd0 0x556968150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.567+0000 7f31f2dca740 1 -- 172.21.15.110:0/912978443 >> 172.21.15.110:0/912978443 conn(0x5569681362e0 msgr2=0x5569681427d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:12.570 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.567+0000 7f31f2dca740 1 -- 172.21.15.110:0/912978443 shutdown_connections 2024-04-26T11:34:12.570 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.567+0000 7f31f2dca740 1 -- 172.21.15.110:0/912978443 wait complete. 2024-04-26T11:34:12.570 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.568+0000 7f31f2dca740 1 -- start start 2024-04-26T11:34:12.570 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.568+0000 7f31f2dca740 1 Processor -- start 2024-04-26T11:34:12.570 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968139dd0 0x55696813ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 0x55696813f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31f2dca740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55696813faf0 0x5569681cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31f2dca740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81b3540 con 0x55696813faf0 2024-04-26T11:34:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31f2dca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81b49b0 con 0x556968139dd0 2024-04-26T11:34:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31f2dca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f31e81b3c10 con 0x556968144fb0 2024-04-26T11:34:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31f2dca740 10 client.0 _ll_register_callbacks cb 0x7f31e0008040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31ed400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968139dd0 0x55696813ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31ed400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968139dd0 0x55696813ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56134/0 (socket says 172.21.15.110:56134) 2024-04-26T11:34:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31ed400640 1 -- 172.21.15.110:0/2675882625 learned_addr learned my addr 172.21.15.110:0/2675882625 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.569+0000 7f31ede00640 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55696813faf0 0x5569681cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.570+0000 7f31eca00640 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 0x55696813f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.570+0000 7f31ede00640 1 -- 172.21.15.110:0/2675882625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 msgr2=0x55696813f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.570+0000 7f31ede00640 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 0x55696813f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.570+0000 7f31ede00640 1 -- 172.21.15.110:0/2675882625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968139dd0 msgr2=0x55696813ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.570+0000 7f31ede00640 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968139dd0 0x55696813ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.570+0000 7f31ede00640 1 -- 172.21.15.110:0/2675882625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556968059cb0 con 0x55696813faf0 2024-04-26T11:34:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.571+0000 7f31ede00640 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55696813faf0 0x5569681cb4f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31e0014df0 tx=0x7f31e0007230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb87b1ca85589ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.571+0000 7f31cea00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:34:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.572+0000 7f31cea00640 1 -- 172.21.15.110:0/2675882625 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e002d030 con 0x55696813faf0 2024-04-26T11:34:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.573+0000 7f31cea00640 1 -- 172.21.15.110:0/2675882625 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f31e000cb90 con 0x55696813faf0 2024-04-26T11:34:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.573+0000 7f31f2dca740 1 -- 172.21.15.110:0/2675882625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31d40bc030 con 0x55696813faf0 2024-04-26T11:34:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.574+0000 7f31cea00640 1 -- 172.21.15.110:0/2675882625 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f31e0018040 con 0x55696813faf0 2024-04-26T11:34:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.574+0000 7f31f2dca740 10 client.15390 fetch_fsmap learned FSMap version 31 2024-04-26T11:34:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.574+0000 7f31f2dca740 1 -- 172.21.15.110:0/2675882625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5569681ccd10 con 0x55696813faf0 2024-04-26T11:34:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.574+0000 7f31cea00640 1 -- 172.21.15.110:0/2675882625 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31d40bc030 con 0x55696813faf0 2024-04-26T11:34:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.574+0000 7f31cea00640 1 -- 172.21.15.110:0/2675882625 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f31e0011040 con 0x55696813faf0 2024-04-26T11:34:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.575+0000 7f31f2dca740 10 client.15390 fetch_fsmap finished waiting for FSMap version 31 2024-04-26T11:34:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.575+0000 7f31f2dca740 10 client.15390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:34:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.575+0000 7f31f2dca740 20 client.15390 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.575+0000 7f31f2dca740 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5569681cd4c0 0x5569681cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.575+0000 7f31f2dca740 4 client.15390 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:34:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.575+0000 7f31f2dca740 1 -- 172.21.15.110:0/2675882625 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5569680a6e00 con 0x5569681cd4c0 2024-04-26T11:34:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.576+0000 7f31ed400640 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5569681cd4c0 0x5569681cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.577+0000 7f31ed400640 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5569681cd4c0 0x5569681cf8e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8004fe688fa35291 server_cookie=e3cadd24a7d155d8 in_seq=0 out_seq=0 2024-04-26T11:34:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.577+0000 7f31cea00640 10 client.15390 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.589+0000 7f31cea00640 1 -- 172.21.15.110:0/2675882625 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5569680a6e00 con 0x5569681cd4c0 2024-04-26T11:34:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.589+0000 7f31cea00640 10 client.15390 handle_command_reply: tid=0 2024-04-26T11:34:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.589+0000 7f31f2dca740 1 client.15390 shutdown 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.589+0000 7f31f2dca740 1 -- 172.21.15.110:0/2675882625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55696813faf0 msgr2=0x5569681cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.589+0000 7f31f2dca740 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55696813faf0 0x5569681cb4f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31e0014df0 tx=0x7f31e0007230 comp rx=0 tx=0).stop 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31f2dca740 1 -- 172.21.15.110:0/2675882625 shutdown_connections 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31f2dca740 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55696813faf0 0x5569681cb4f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31f2dca740 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5569681cd4c0 0x5569681cf8e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31f2dca740 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556968144fb0 0x55696813f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31f2dca740 1 --2- 172.21.15.110:0/2675882625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556968139dd0 0x55696813ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31f2dca740 1 -- 172.21.15.110:0/2675882625 >> 172.21.15.110:0/2675882625 conn(0x5569681362e0 msgr2=0x556968134bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31cea00640 0 client.15390 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31f2dca740 1 -- 172.21.15.110:0/2675882625 shutdown_connections 2024-04-26T11:34:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31f2dca740 1 -- 172.21.15.110:0/2675882625 wait complete. 2024-04-26T11:34:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.590+0000 7f31f2dca740 20 client.15390 trim_cache size 0 max 16384 2024-04-26T11:34:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:34:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:34:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:34:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:34:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.591+0000 7f31efe00640 1 -- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f31d00a3ec0 msgr2=0x7f31d00a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.591+0000 7f31efe00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f31d00a3ec0 0x7f31d00a6380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31dc000c00 tx=0x7f31dc031400 comp rx=0 tx=0).stop 2024-04-26T11:34:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.592+0000 7f31efe00640 1 -- 172.21.15.110:0/2543836383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e81022d0 msgr2=0x7f31e819fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.592+0000 7f31efe00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e81022d0 0x7f31e819fcd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f31d400d950 tx=0x7f31d400de10 comp rx=0 tx=0).stop 2024-04-26T11:34:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.592+0000 7f31efe00640 1 -- 172.21.15.110:0/2543836383 shutdown_connections 2024-04-26T11:34:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.592+0000 7f31efe00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f31d00a3ec0 0x7f31d00a6380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.592+0000 7f31efe00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e8106cd0 0x7f31e81a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.592+0000 7f31efe00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e81022d0 0x7f31e819fcd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.592+0000 7f31efe00640 1 --2- 172.21.15.110:0/2543836383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31e81019b0 0x7f31e819f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.592+0000 7f31efe00640 1 -- 172.21.15.110:0/2543836383 >> 172.21.15.110:0/2543836383 conn(0x7f31e80789b0 msgr2=0x7f31e8104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.592+0000 7f31efe00640 1 -- 172.21.15.110:0/2543836383 shutdown_connections 2024-04-26T11:34:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:12.593+0000 7f31efe00640 1 -- 172.21.15.110:0/2543836383 wait complete. 2024-04-26T11:34:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:13 smithi193 ceph-mon[32782]: pgmap v91: 97 pgs: 97 active+clean; 1.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 MiB/s wr, 1.58k op/s 2024-04-26T11:34:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:13 smithi196 ceph-mon[32572]: pgmap v91: 97 pgs: 97 active+clean; 1.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 MiB/s wr, 1.58k op/s 2024-04-26T11:34:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:13 smithi110 ceph-mon[28069]: pgmap v91: 97 pgs: 97 active+clean; 1.4 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 33 MiB/s wr, 1.58k op/s 2024-04-26T11:34:14.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 120.0 s, 3288.4 tps, lat 30.382 ms stddev 34.195 2024-04-26T11:34:15.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:15 smithi110 ceph-mon[28069]: pgmap v92: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 38 MiB/s wr, 1.89k op/s 2024-04-26T11:34:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:15 smithi193 ceph-mon[32782]: pgmap v92: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 38 MiB/s wr, 1.89k op/s 2024-04-26T11:34:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:15 smithi196 ceph-mon[32572]: pgmap v92: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 38 MiB/s wr, 1.89k op/s 2024-04-26T11:34:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:17 smithi193 ceph-mon[32782]: pgmap v93: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 MiB/s wr, 1.57k op/s 2024-04-26T11:34:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:17 smithi196 ceph-mon[32572]: pgmap v93: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 MiB/s wr, 1.57k op/s 2024-04-26T11:34:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:17 smithi110 ceph-mon[28069]: pgmap v93: 97 pgs: 97 active+clean; 1.4 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 MiB/s wr, 1.57k op/s 2024-04-26T11:34:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:19 smithi193 ceph-mon[32782]: pgmap v94: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 37 MiB/s wr, 1.90k op/s 2024-04-26T11:34:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 125.0 s, 3246.4 tps, lat 30.739 ms stddev 34.804 2024-04-26T11:34:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:19 smithi196 ceph-mon[32572]: pgmap v94: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 37 MiB/s wr, 1.90k op/s 2024-04-26T11:34:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:19 smithi110 ceph-mon[28069]: pgmap v94: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 37 MiB/s wr, 1.90k op/s 2024-04-26T11:34:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:21 smithi193 ceph-mon[32782]: pgmap v95: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 637 op/s 2024-04-26T11:34:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:21 smithi196 ceph-mon[32572]: pgmap v95: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 637 op/s 2024-04-26T11:34:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:21 smithi110 ceph-mon[28069]: pgmap v95: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 637 op/s 2024-04-26T11:34:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:23 smithi193 ceph-mon[32782]: pgmap v96: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 637 op/s 2024-04-26T11:34:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:23 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:34:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:23 smithi196 ceph-mon[32572]: pgmap v96: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 637 op/s 2024-04-26T11:34:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:23 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:34:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:23 smithi110 ceph-mon[28069]: pgmap v96: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.5 MiB/s wr, 637 op/s 2024-04-26T11:34:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:23 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:34:24.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 130.0 s, 2963.2 tps, lat 33.740 ms stddev 37.526 2024-04-26T11:34:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.731+0000 7fe0af000640 1 -- 172.21.15.110:0/400051659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8111500 msgr2=0x7fe0a8109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.731+0000 7fe0af000640 1 --2- 172.21.15.110:0/400051659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8111500 0x7fe0a8109e70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe098009cd0 tx=0x7fe09802a980 comp rx=0 tx=0).stop 2024-04-26T11:34:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.731+0000 7fe0af000640 1 -- 172.21.15.110:0/400051659 shutdown_connections 2024-04-26T11:34:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.731+0000 7fe0af000640 1 --2- 172.21.15.110:0/400051659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a811c110 0x7fe0a811e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.731+0000 7fe0af000640 1 --2- 172.21.15.110:0/400051659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a8111500 0x7fe0a8109e70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.731+0000 7fe0af000640 1 --2- 172.21.15.110:0/400051659 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0a8111120 0x7fe0a8109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.731+0000 7fe0af000640 1 -- 172.21.15.110:0/400051659 >> 172.21.15.110:0/400051659 conn(0x7fe0a806da00 msgr2=0x7fe0a806de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.732+0000 7fe0af000640 1 -- 172.21.15.110:0/400051659 shutdown_connections 2024-04-26T11:34:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.732+0000 7fe0af000640 1 -- 172.21.15.110:0/400051659 wait complete. 2024-04-26T11:34:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.732+0000 7fe0af000640 1 Processor -- start 2024-04-26T11:34:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0af000640 1 -- start start 2024-04-26T11:34:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0af000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0a8111120 0x7fe0a81a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0af000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a811c110 0x7fe0a81a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0af000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81ac8b0 0x7fe0a81acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0af000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a8121a90 con 0x7fe0a81ac8b0 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0af000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a8121910 con 0x7fe0a811c110 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0af000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a8121c10 con 0x7fe0a8111120 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0ad000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81ac8b0 0x7fe0a81acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0a7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0a8111120 0x7fe0a81a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0ad000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81ac8b0 0x7fe0a81acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41768/0 (socket says 172.21.15.110:41768) 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.733+0000 7fe0ad000640 1 -- 172.21.15.110:0/771532317 learned_addr learned my addr 172.21.15.110:0/771532317 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0ad000640 1 -- 172.21.15.110:0/771532317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0a8111120 msgr2=0x7fe0a81a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0ad000640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0a8111120 0x7fe0a81a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0ad000640 1 -- 172.21.15.110:0/771532317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a811c110 msgr2=0x7fe0a81a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0ad000640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a811c110 0x7fe0a81a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0ad000640 1 -- 172.21.15.110:0/771532317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a81ad3a0 con 0x7fe0a81ac8b0 2024-04-26T11:34:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0ad000640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81ac8b0 0x7fe0a81acd60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000d720 tx=0x7fe0a000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0a4c00640 1 -- 172.21.15.110:0/771532317 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0017070 con 0x7fe0a81ac8b0 2024-04-26T11:34:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0a4c00640 1 -- 172.21.15.110:0/771532317 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a00097c0 con 0x7fe0a81ac8b0 2024-04-26T11:34:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0a4c00640 1 -- 172.21.15.110:0/771532317 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0004bc0 con 0x7fe0a81ac8b0 2024-04-26T11:34:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0af000640 1 -- 172.21.15.110:0/771532317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a81ad690 con 0x7fe0a81ac8b0 2024-04-26T11:34:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.734+0000 7fe0af000640 1 -- 172.21.15.110:0/771532317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a81b4e30 con 0x7fe0a81ac8b0 2024-04-26T11:34:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.739+0000 7fe0b1dc8740 1 Processor -- start 2024-04-26T11:34:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.739+0000 7fe0a4c00640 1 -- 172.21.15.110:0/771532317 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe0a0005220 con 0x7fe0a81ac8b0 2024-04-26T11:34:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.739+0000 7fe0b1dc8740 1 -- start start 2024-04-26T11:34:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488dc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559548841380 con 0x5595488dbdd0 2024-04-26T11:34:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5595487ddc30 con 0x5595488dc6f0 2024-04-26T11:34:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55954883d340 con 0x5595488e6fb0 2024-04-26T11:34:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0a7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488dc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0a7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488dc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41782/0 (socket says 172.21.15.110:41782) 2024-04-26T11:34:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0a7400640 1 -- 172.21.15.110:0/2568842801 learned_addr learned my addr 172.21.15.110:0/2568842801 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/2568842801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0a7400640 1 -- 172.21.15.110:0/2568842801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 msgr2=0x5595488e93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0a7400640 1 --2- 172.21.15.110:0/2568842801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0a7400640 1 -- 172.21.15.110:0/2568842801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 msgr2=0x5595488e6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0a7400640 1 --2- 172.21.15.110:0/2568842801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.740+0000 7fe0a7400640 1 -- 172.21.15.110:0/2568842801 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595487ff940 con 0x5595488dbdd0 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.741+0000 7fe0a7400640 1 --2- 172.21.15.110:0/2568842801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488dc1b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe098009430 tx=0x7fe098009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ae50d54bc26139 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.741+0000 7fe0a4c00640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe08c0a3dc0 0x7fe08c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.741+0000 7fe09d600640 1 -- 172.21.15.110:0/2568842801 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098040070 con 0x5595488dbdd0 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.741+0000 7fe09d600640 1 -- 172.21.15.110:0/2568842801 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe098003e20 con 0x5595488dbdd0 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.741+0000 7fe0a4c00640 1 -- 172.21.15.110:0/771532317 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fe0a00d0330 con 0x7fe0a81ac8b0 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.741+0000 7fe09d600640 1 -- 172.21.15.110:0/2568842801 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098034040 con 0x5595488dbdd0 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.741+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe08c0a3dc0 0x7fe08c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/2568842801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 msgr2=0x5595488dc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/2568842801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488dc1b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe098009430 tx=0x7fe098009940 comp rx=0 tx=0).stop 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe08c0a3dc0 0x7fe08c0a6280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5595488dd370 tx=0x7fe090009110 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/2568842801 shutdown_connections 2024-04-26T11:34:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/2568842801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/2568842801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/2568842801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488dc1b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/2568842801 >> 172.21.15.110:0/2568842801 conn(0x5595488d82e0 msgr2=0x5595488d86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/2568842801 shutdown_connections 2024-04-26T11:34:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.742+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/2568842801 wait complete. 2024-04-26T11:34:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.743+0000 7fe0b1dc8740 1 -- start start 2024-04-26T11:34:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.743+0000 7fe0b1dc8740 1 Processor -- start 2024-04-26T11:34:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.743+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488dbdd0 0x5595488e3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.743+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 0x5595488e4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.743+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488e6fb0 0x5595488e4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.743+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5595488e9b80 con 0x5595488dc6f0 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.743+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5595487c8c60 con 0x5595488e6fb0 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.743+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5595488e9d00 con 0x5595488dbdd0 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0b1dc8740 10 client.0 _ll_register_callbacks cb 0x5595487f4e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488dbdd0 0x5595488e3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488dbdd0 0x5595488e3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:53496/0 (socket says 172.21.15.110:53496) 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7e00640 1 -- 172.21.15.110:0/1588111654 learned_addr learned my addr 172.21.15.110:0/1588111654 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7400640 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 0x5595488e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0ad000640 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488e6fb0 0x5595488e4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7400640 1 -- 172.21.15.110:0/1588111654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488dbdd0 msgr2=0x5595488e3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7400640 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488dbdd0 0x5595488e3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7400640 1 -- 172.21.15.110:0/1588111654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488e6fb0 msgr2=0x5595488e4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7400640 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488e6fb0 0x5595488e4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7400640 1 -- 172.21.15.110:0/1588111654 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595487d7510 con 0x5595488dc6f0 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe0a7400640 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 0x5595488e4450 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe098009430 tx=0x7fe098003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524313d39a8a509d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.744+0000 7fe096000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe096000640 1 -- 172.21.15.110:0/1588111654 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098034070 con 0x5595488dc6f0 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe096000640 1 -- 172.21.15.110:0/1588111654 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fe098030640 con 0x5595488dc6f0 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/1588111654 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe098003e20 con 0x5595488dc6f0 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe096000640 1 -- 172.21.15.110:0/1588111654 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe098040040 con 0x5595488dc6f0 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe0b1dc8740 10 client.15402 fetch_fsmap learned FSMap version 32 2024-04-26T11:34:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/1588111654 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559548553210 con 0x5595488dc6f0 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe096000640 1 -- 172.21.15.110:0/1588111654 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe098003e20 con 0x5595488dc6f0 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe096000640 1 -- 172.21.15.110:0/1588111654 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fe098053070 con 0x5595488dc6f0 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe0b1dc8740 10 client.15402 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe0b1dc8740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe0b1dc8740 20 client.15402 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5595488f6b40 0x5595488f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe0b1dc8740 4 client.15402 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.745+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/1588111654 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55954884ef90 con 0x5595488f6b40 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.746+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5595488f6b40 0x5595488f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.746+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5595488f6b40 0x5595488f8f30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dcf368726cd79e6 server_cookie=28b2b61cb6d9e6c8 in_seq=0 out_seq=0 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.746+0000 7fe096000640 10 client.15402 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe096000640 1 -- 172.21.15.110:0/1588111654 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55954884ef90 con 0x5595488f6b40 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe096000640 10 client.15402 handle_command_reply: tid=0 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 client.15402 shutdown 2024-04-26T11:34:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/1588111654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 msgr2=0x5595488e4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 0x5595488e4450 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe098009430 tx=0x7fe098003c20 comp rx=0 tx=0).stop 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/1588111654 shutdown_connections 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488e6fb0 0x5595488e4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 0x5595488e4450 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5595488f6b40 0x5595488f8f30 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/1588111654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488dbdd0 0x5595488e3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/1588111654 >> 172.21.15.110:0/1588111654 conn(0x5595488d82e0 msgr2=0x5595488de060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe096000640 0 client.15402 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/1588111654 shutdown_connections 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.747+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/1588111654 wait complete. 2024-04-26T11:34:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.748+0000 7fe0b1dc8740 20 client.15402 trim_cache size 0 max 16384 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.763+0000 7fe0b1dc8740 1 Processor -- start 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.763+0000 7fe0b1dc8740 1 -- start start 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.763+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dbdd0 0x5595488e6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.763+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 0x5595488f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.763+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.763+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a81bfe90 con 0x5595488dc6f0 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.763+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a81bd6d0 con 0x5595488dbdd0 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.763+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a81bb520 con 0x5595488e6fb0 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dbdd0 0x5595488e6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dbdd0 0x5595488e6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:60110/0 (socket says 172.21.15.110:60110) 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 0x5595488f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7e00640 1 -- 172.21.15.110:0/958430343 learned_addr learned my addr 172.21.15.110:0/958430343 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0ad000640 1 --2- 172.21.15.110:0/958430343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7e00640 1 -- 172.21.15.110:0/958430343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 msgr2=0x5595488e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/958430343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7e00640 1 -- 172.21.15.110:0/958430343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 msgr2=0x5595488f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/958430343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 0x5595488f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7e00640 1 -- 172.21.15.110:0/958430343 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55954861f620 con 0x5595488dbdd0 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0ad000640 1 --2- 172.21.15.110:0/958430343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:34:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.764+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/958430343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dbdd0 0x5595488e6640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe090011690 tx=0x7fe090009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac0956d282238e01 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe09cc00640 1 -- 172.21.15.110:0/958430343 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09002ab50 con 0x5595488dbdd0 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe09cc00640 1 -- 172.21.15.110:0/958430343 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe09002f070 con 0x5595488dbdd0 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe09cc00640 1 -- 172.21.15.110:0/958430343 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09002a730 con 0x5595488dbdd0 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/958430343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dbdd0 msgr2=0x5595488e6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/958430343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dbdd0 0x5595488e6640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe090011690 tx=0x7fe090009f90 comp rx=0 tx=0).stop 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/958430343 shutdown_connections 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/958430343 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/958430343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dc6f0 0x5595488f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/958430343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dbdd0 0x5595488e6640 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/958430343 >> 172.21.15.110:0/958430343 conn(0x5595488d82e0 msgr2=0x5595488e2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/958430343 shutdown_connections 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.765+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/958430343 wait complete. 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.766+0000 7fe0b1dc8740 1 -- start start 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.766+0000 7fe0b1dc8740 1 Processor -- start 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.766+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.766+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.766+0000 7fe0b1dc8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.766+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a81bbb90 con 0x5595488dbdd0 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.766+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a81bd000 con 0x5595488dc6f0 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.766+0000 7fe0b1dc8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a81bc260 con 0x5595488e6fb0 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.766+0000 7fe0b1dc8740 10 client.0 _ll_register_callbacks cb 0x7fe0900093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:60126/0 (socket says 172.21.15.110:60126) 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7400640 1 -- 172.21.15.110:0/3348658319 learned_addr learned my addr 172.21.15.110:0/3348658319 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0ad000640 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7400640 1 -- 172.21.15.110:0/3348658319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 msgr2=0x5595488e1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7400640 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7400640 1 -- 172.21.15.110:0/3348658319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 msgr2=0x5595488ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7400640 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488ef3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7400640 1 -- 172.21.15.110:0/3348658319 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595487fbcb0 con 0x5595488dc6f0 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0a7400640 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e1300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe098005d70 tx=0x7fe0980095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcbc3e64a25b2b1b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe096000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe096000640 1 -- 172.21.15.110:0/3348658319 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098059030 con 0x5595488dc6f0 2024-04-26T11:34:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/3348658319 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe09002f070 con 0x5595488dc6f0 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.767+0000 7fe096000640 1 -- 172.21.15.110:0/3348658319 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fe098003c90 con 0x5595488dc6f0 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe096000640 1 -- 172.21.15.110:0/3348658319 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe098034040 con 0x5595488dc6f0 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe0b1dc8740 10 client.25547 fetch_fsmap learned FSMap version 32 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/3348658319 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55954895bf80 con 0x5595488dc6f0 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe096000640 1 -- 172.21.15.110:0/3348658319 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe09002f070 con 0x5595488dc6f0 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe096000640 1 -- 172.21.15.110:0/3348658319 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fe098064070 con 0x5595488dc6f0 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe0b1dc8740 10 client.25547 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe0b1dc8740 10 client.25547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe0b1dc8740 20 client.25547 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55954895c670 0x55954895ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe0b1dc8740 4 client.25547 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/3348658319 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559548848e00 con 0x55954895c670 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.768+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55954895c670 0x55954895ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.769+0000 7fe0a7e00640 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55954895c670 0x55954895ea90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76fc4fcc01c63743 server_cookie=efaf2005e6061bba in_seq=0 out_seq=0 2024-04-26T11:34:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:25.769+0000 7fe096000640 10 client.25547 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:25 smithi193 ceph-mon[32782]: pgmap v97: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 12 MiB/s wr, 944 op/s 2024-04-26T11:34:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:25 smithi196 ceph-mon[32572]: pgmap v97: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 12 MiB/s wr, 944 op/s 2024-04-26T11:34:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.021+0000 7fe096000640 1 -- 172.21.15.110:0/3348658319 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559548848e00 con 0x55954895c670 2024-04-26T11:34:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.021+0000 7fe096000640 10 client.25547 handle_command_reply: tid=0 2024-04-26T11:34:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.021+0000 7fe0b1dc8740 1 client.25547 shutdown 2024-04-26T11:34:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.022+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/3348658319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 msgr2=0x5595488e1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.022+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e1300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe098005d70 tx=0x7fe0980095b0 comp rx=0 tx=0).stop 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.022+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/3348658319 shutdown_connections 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.022+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55954895c670 0x55954895ea90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.022+0000 7fe096000640 0 client.25547 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.022+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5595488e6fb0 0x5595488e1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.022+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595488dc6f0 0x5595488e1300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.022+0000 7fe0b1dc8740 1 --2- 172.21.15.110:0/3348658319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595488dbdd0 0x5595488ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.022+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/3348658319 >> 172.21.15.110:0/3348658319 conn(0x5595488d82e0 msgr2=0x5595488d6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.023+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/3348658319 shutdown_connections 2024-04-26T11:34:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.023+0000 7fe0b1dc8740 1 -- 172.21.15.110:0/3348658319 wait complete. 2024-04-26T11:34:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.023+0000 7fe0b1dc8740 20 client.25547 trim_cache size 0 max 16384 2024-04-26T11:34:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:34:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:34:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:34:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:34:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.024+0000 7fe0af000640 1 -- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe08c0a3dc0 msgr2=0x7fe08c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.024+0000 7fe0af000640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe08c0a3dc0 0x7fe08c0a6280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5595488dd370 tx=0x7fe090009110 comp rx=0 tx=0).stop 2024-04-26T11:34:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.024+0000 7fe0af000640 1 -- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81ac8b0 msgr2=0x7fe0a81acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.024+0000 7fe0af000640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81ac8b0 0x7fe0a81acd60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000d720 tx=0x7fe0a000db20 comp rx=0 tx=0).stop 2024-04-26T11:34:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.025+0000 7fe0af000640 1 -- 172.21.15.110:0/771532317 shutdown_connections 2024-04-26T11:34:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.025+0000 7fe0af000640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fe08c0a3dc0 0x7fe08c0a6280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.025+0000 7fe0af000640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a81ac8b0 0x7fe0a81acd60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.025+0000 7fe0af000640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a811c110 0x7fe0a81a8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.025+0000 7fe0af000640 1 --2- 172.21.15.110:0/771532317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe0a8111120 0x7fe0a81a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.025+0000 7fe0af000640 1 -- 172.21.15.110:0/771532317 >> 172.21.15.110:0/771532317 conn(0x7fe0a806da00 msgr2=0x7fe0a810ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.026+0000 7fe0af000640 1 -- 172.21.15.110:0/771532317 shutdown_connections 2024-04-26T11:34:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:26.026+0000 7fe0af000640 1 -- 172.21.15.110:0/771532317 wait complete. 2024-04-26T11:34:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:25 smithi110 ceph-mon[28069]: pgmap v97: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 12 MiB/s wr, 944 op/s 2024-04-26T11:34:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:27 smithi193 ceph-mon[32782]: pgmap v98: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.5 MiB/s wr, 631 op/s 2024-04-26T11:34:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:27 smithi196 ceph-mon[32572]: pgmap v98: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.5 MiB/s wr, 631 op/s 2024-04-26T11:34:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:27 smithi110 ceph-mon[28069]: pgmap v98: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.5 MiB/s wr, 631 op/s 2024-04-26T11:34:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:29 smithi193 ceph-mon[32782]: pgmap v99: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 927 op/s 2024-04-26T11:34:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:34:29.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 135.0 s, 2729.6 tps, lat 36.546 ms stddev 52.478 2024-04-26T11:34:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:29 smithi196 ceph-mon[32572]: pgmap v99: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 927 op/s 2024-04-26T11:34:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:34:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:29 smithi110 ceph-mon[28069]: pgmap v99: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 927 op/s 2024-04-26T11:34:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:34:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:31 smithi193 ceph-mon[32782]: pgmap v100: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 602 op/s 2024-04-26T11:34:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:34:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:34:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:34:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:31 smithi196 ceph-mon[32572]: pgmap v100: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 602 op/s 2024-04-26T11:34:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:34:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:34:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:34:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:31 smithi110 ceph-mon[28069]: pgmap v100: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 602 op/s 2024-04-26T11:34:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:34:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:34:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:34:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:33 smithi193 ceph-mon[32782]: pgmap v101: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 602 op/s 2024-04-26T11:34:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:33 smithi196 ceph-mon[32572]: pgmap v101: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 602 op/s 2024-04-26T11:34:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:33 smithi110 ceph-mon[28069]: pgmap v101: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 602 op/s 2024-04-26T11:34:34.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 140.0 s, 2680.0 tps, lat 37.335 ms stddev 40.631 2024-04-26T11:34:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:35 smithi193 ceph-mon[32782]: pgmap v102: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.9 MiB/s wr, 896 op/s 2024-04-26T11:34:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:35 smithi196 ceph-mon[32572]: pgmap v102: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.9 MiB/s wr, 896 op/s 2024-04-26T11:34:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:35 smithi110 ceph-mon[28069]: pgmap v102: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.9 MiB/s wr, 896 op/s 2024-04-26T11:34:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:37 smithi196 ceph-mon[32572]: pgmap v103: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 589 op/s 2024-04-26T11:34:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:37 smithi110 ceph-mon[28069]: pgmap v103: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 589 op/s 2024-04-26T11:34:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:37 smithi193 ceph-mon[32782]: pgmap v103: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 589 op/s 2024-04-26T11:34:38.198 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 15.6 2024-04-26T11:34:38.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:34:38.847 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:34:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.230+0000 7fdad5c00640 1 -- 172.21.15.110:0/2805970032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad0109190 msgr2=0x7fdad0109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.230+0000 7fdad5c00640 1 --2- 172.21.15.110:0/2805970032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad0109190 0x7fdad0109570 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009900 tx=0x7fdac002a3f0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.230+0000 7fdad5c00640 1 -- 172.21.15.110:0/2805970032 shutdown_connections 2024-04-26T11:34:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.230+0000 7fdad5c00640 1 --2- 172.21.15.110:0/2805970032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad010e260 0x7fdad0115e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.230+0000 7fdad5c00640 1 --2- 172.21.15.110:0/2805970032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdad0109b40 0x7fdad010db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.230+0000 7fdad5c00640 1 --2- 172.21.15.110:0/2805970032 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad0109190 0x7fdad0109570 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.230+0000 7fdad5c00640 1 -- 172.21.15.110:0/2805970032 >> 172.21.15.110:0/2805970032 conn(0x7fdad0076ec0 msgr2=0x7fdad00792e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.230+0000 7fdad5c00640 1 -- 172.21.15.110:0/2805970032 shutdown_connections 2024-04-26T11:34:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.230+0000 7fdad5c00640 1 -- 172.21.15.110:0/2805970032 wait complete. 2024-04-26T11:34:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.231+0000 7fdad5c00640 1 Processor -- start 2024-04-26T11:34:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.232+0000 7fdad5c00640 1 -- start start 2024-04-26T11:34:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.233+0000 7fdad5c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdad0109190 0x7fdad019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.233+0000 7fdad5c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad010e260 0x7fdad019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.233+0000 7fdad5c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad01a3fb0 0x7fdad01a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.233+0000 7fdacea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdad0109190 0x7fdad019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.234+0000 7fdacea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdad0109190 0x7fdad019f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:50224/0 (socket says 172.21.15.110:50224) 2024-04-26T11:34:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.234+0000 7fdacf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad01a3fb0 0x7fdad01a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.234+0000 7fdacf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad01a3fb0 0x7fdad01a4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55124/0 (socket says 172.21.15.110:55124) 2024-04-26T11:34:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdace000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad010e260 0x7fdad019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdad5c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01191f0 con 0x7fdad01a3fb0 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdacea00640 1 -- 172.21.15.110:0/1738882883 learned_addr learned my addr 172.21.15.110:0/1738882883 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdad0119070 con 0x7fdad010e260 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdad0119370 con 0x7fdad0109190 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdace000640 1 -- 172.21.15.110:0/1738882883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdad0109190 msgr2=0x7fdad019f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdace000640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdad0109190 0x7fdad019f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdace000640 1 -- 172.21.15.110:0/1738882883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad01a3fb0 msgr2=0x7fdad01a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdace000640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad01a3fb0 0x7fdad01a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.235+0000 7fdace000640 1 -- 172.21.15.110:0/1738882883 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad01a4aa0 con 0x7fdad010e260 2024-04-26T11:34:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.236+0000 7fdace000640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad010e260 0x7fdad019fc30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdab800e9c0 tx=0x7fdab800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.237+0000 7fdac7400640 1 -- 172.21.15.110:0/1738882883 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab800cd80 con 0x7fdad010e260 2024-04-26T11:34:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.237+0000 7fdac7400640 1 -- 172.21.15.110:0/1738882883 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdab80035f0 con 0x7fdad010e260 2024-04-26T11:34:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.237+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad01a4d90 con 0x7fdad010e260 2024-04-26T11:34:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.237+0000 7fdac7400640 1 -- 172.21.15.110:0/1738882883 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab800cd80 con 0x7fdad010e260 2024-04-26T11:34:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.237+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad01ac5d0 con 0x7fdad010e260 2024-04-26T11:34:39.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.243+0000 7fdac7400640 1 -- 172.21.15.110:0/1738882883 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fdab8004020 con 0x7fdad010e260 2024-04-26T11:34:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.245+0000 7fdac7400640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdab40a40c0 0x7fdab40a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.245+0000 7fdac7400640 1 -- 172.21.15.110:0/1738882883 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fdab80d0700 con 0x7fdad010e260 2024-04-26T11:34:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.246+0000 7fdacea00640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdab40a40c0 0x7fdab40a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.247+0000 7fdacea00640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdab40a40c0 0x7fdab40a6580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdac00096c0 tx=0x7fdac0005a20 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.247+0000 7fdad8975740 1 Processor -- start 2024-04-26T11:34:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.247+0000 7fdad8975740 1 -- start start 2024-04-26T11:34:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.247+0000 7fdad8975740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.247+0000 7fdad8975740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a16f0 0x55b07a2aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.247+0000 7fdad8975740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2abfb0 0x55b07a2ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.247+0000 7fdad8975740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b07a206380 con 0x55b07a2abfb0 2024-04-26T11:34:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.247+0000 7fdad8975740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b07a1a2c30 con 0x55b07a2a0dd0 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.247+0000 7fdad8975740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b07a202340 con 0x55b07a2a16f0 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdace000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a16f0 0x55b07a2aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdacea00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdace000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a16f0 0x55b07a2aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:50234/0 (socket says 172.21.15.110:50234) 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdace000640 1 -- 172.21.15.110:0/3909098299 learned_addr learned my addr 172.21.15.110:0/3909098299 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdacf400640 1 --2- 172.21.15.110:0/3909098299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2abfb0 0x55b07a2ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdace000640 1 -- 172.21.15.110:0/3909098299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a0dd0 msgr2=0x55b07a2a11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdace000640 1 --2- 172.21.15.110:0/3909098299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdace000640 1 -- 172.21.15.110:0/3909098299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2abfb0 msgr2=0x55b07a2ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdace000640 1 --2- 172.21.15.110:0/3909098299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2abfb0 0x55b07a2ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdace000640 1 -- 172.21.15.110:0/3909098299 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b07a1c4940 con 0x55b07a2a16f0 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdacf400640 1 --2- 172.21.15.110:0/3909098299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2abfb0 0x55b07a2ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:34:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.248+0000 7fdace000640 1 --2- 172.21.15.110:0/3909098299 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a16f0 0x55b07a2aba70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdab8098f90 tx=0x7fdab809bfe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97405e29a8ce652 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.249+0000 7fdabfe00640 1 -- 172.21.15.110:0/3909098299 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80a0970 con 0x55b07a2a16f0 2024-04-26T11:34:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.249+0000 7fdabfe00640 1 -- 172.21.15.110:0/3909098299 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdab80a5230 con 0x55b07a2a16f0 2024-04-26T11:34:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.249+0000 7fdabfe00640 1 -- 172.21.15.110:0/3909098299 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8098c30 con 0x55b07a2a16f0 2024-04-26T11:34:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.249+0000 7fdad8975740 1 -- 172.21.15.110:0/3909098299 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a16f0 msgr2=0x55b07a2aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.249+0000 7fdad8975740 1 --2- 172.21.15.110:0/3909098299 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a16f0 0x55b07a2aba70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdab8098f90 tx=0x7fdab809bfe0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.250+0000 7fdad8975740 1 -- 172.21.15.110:0/3909098299 shutdown_connections 2024-04-26T11:34:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.250+0000 7fdad8975740 1 --2- 172.21.15.110:0/3909098299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2abfb0 0x55b07a2ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.250+0000 7fdad8975740 1 --2- 172.21.15.110:0/3909098299 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a16f0 0x55b07a2aba70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.250+0000 7fdad8975740 1 --2- 172.21.15.110:0/3909098299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.250+0000 7fdad8975740 1 -- 172.21.15.110:0/3909098299 >> 172.21.15.110:0/3909098299 conn(0x55b07a29d2e0 msgr2=0x55b07a29d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.255+0000 7fdad8975740 1 -- 172.21.15.110:0/3909098299 shutdown_connections 2024-04-26T11:34:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.255+0000 7fdad8975740 1 -- 172.21.15.110:0/3909098299 wait complete. 2024-04-26T11:34:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.256+0000 7fdad8975740 1 -- start start 2024-04-26T11:34:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.256+0000 7fdad8975740 1 Processor -- start 2024-04-26T11:34:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.261+0000 7fdad8975740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.261+0000 7fdad8975740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a16f0 0x55b07a2a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.261+0000 7fdad8975740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2abfb0 0x55b07a2a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.262+0000 7fdacea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.262+0000 7fdacea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:50240/0 (socket says 172.21.15.110:50240) 2024-04-26T11:34:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.263+0000 7fdacf400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2abfb0 0x55b07a2a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.263+0000 7fdacf400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2abfb0 0x55b07a2a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:57918/0 (socket says 172.21.15.110:57918) 2024-04-26T11:34:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.263+0000 7fdacf400640 1 -- 172.21.15.110:0/295564646 learned_addr learned my addr 172.21.15.110:0/295564646 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.263+0000 7fdace000640 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a16f0 0x55b07a2a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.263+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b07a2aebe0 con 0x55b07a2a16f0 2024-04-26T11:34:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.264+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b07a18dc60 con 0x55b07a2abfb0 2024-04-26T11:34:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.264+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b07a2aed60 con 0x55b07a2a0dd0 2024-04-26T11:34:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.265+0000 7fdacf400640 1 -- 172.21.15.110:0/295564646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a0dd0 msgr2=0x55b07a2a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.265+0000 7fdad8975740 10 client.0 _ll_register_callbacks cb 0x55b07a1b9e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.266+0000 7fdacf400640 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.266+0000 7fdacf400640 1 -- 172.21.15.110:0/295564646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a16f0 msgr2=0x55b07a2a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.266+0000 7fdacf400640 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a16f0 0x55b07a2a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.266+0000 7fdacf400640 1 -- 172.21.15.110:0/295564646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b07a19c510 con 0x55b07a2abfb0 2024-04-26T11:34:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.266+0000 7fdace000640 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a16f0 0x55b07a2a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:34:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.267+0000 7fdacea00640 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-26T11:34:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.267+0000 7fdacf400640 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2abfb0 0x55b07a2a99e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdac8011690 tx=0x7fdac8011b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4651e3eebb503d2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.267+0000 7fdabcc00640 10 client.25559 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:34:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.268+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdab80a5230 con 0x55b07a2abfb0 2024-04-26T11:34:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.269+0000 7fdabcc00640 1 -- 172.21.15.110:0/295564646 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac800fb40 con 0x55b07a2abfb0 2024-04-26T11:34:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.269+0000 7fdabcc00640 1 -- 172.21.15.110:0/295564646 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fdac800fce0 con 0x55b07a2abfb0 2024-04-26T11:34:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.269+0000 7fdabcc00640 1 -- 172.21.15.110:0/295564646 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdac8011e90 con 0x55b07a2abfb0 2024-04-26T11:34:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.270+0000 7fdad8975740 10 client.25559 fetch_fsmap learned FSMap version 32 2024-04-26T11:34:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.270+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55b079f18210 con 0x55b07a2abfb0 2024-04-26T11:34:39.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.270+0000 7fdabcc00640 1 -- 172.21.15.110:0/295564646 <== mon.2 v2:172.21.15.193:3300/0 4 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fdac801d480 con 0x55b07a2abfb0 2024-04-26T11:34:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.271+0000 7fdad8975740 10 client.25559 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T11:34:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.271+0000 7fdad8975740 10 client.25559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:34:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.271+0000 7fdad8975740 20 client.25559 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.271+0000 7fdad8975740 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b07a2bbb30 0x55b07a2bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.271+0000 7fdad8975740 4 client.25559 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:34:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.271+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b07a213f90 con 0x55b07a2bbb30 2024-04-26T11:34:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.272+0000 7fdacea00640 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b07a2bbb30 0x55b07a2bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.273+0000 7fdacea00640 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b07a2bbb30 0x55b07a2bdf60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8228698b4db2f43b server_cookie=c24dabcce960a668 in_seq=0 out_seq=0 2024-04-26T11:34:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.273+0000 7fdabcc00640 10 client.25559 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.274+0000 7fdabcc00640 1 -- 172.21.15.110:0/295564646 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b07a213f90 con 0x55b07a2bbb30 2024-04-26T11:34:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.274+0000 7fdabcc00640 10 client.25559 handle_command_reply: tid=0 2024-04-26T11:34:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.274+0000 7fdad8975740 1 client.25559 shutdown 2024-04-26T11:34:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2abfb0 msgr2=0x55b07a2a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdad8975740 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2abfb0 0x55b07a2a99e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdac8011690 tx=0x7fdac8011b50 comp rx=0 tx=0).stop 2024-04-26T11:34:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 shutdown_connections 2024-04-26T11:34:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdad8975740 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2abfb0 0x55b07a2a99e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdad8975740 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a16f0 0x55b07a2a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdad8975740 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b07a2bbb30 0x55b07a2bdf60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdad8975740 1 --2- 172.21.15.110:0/295564646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2a0dd0 0x55b07a2a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdabcc00640 0 client.25559 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 >> 172.21.15.110:0/295564646 conn(0x55b07a29d2e0 msgr2=0x55b07a2a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.275+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 shutdown_connections 2024-04-26T11:34:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.276+0000 7fdad8975740 1 -- 172.21.15.110:0/295564646 wait complete. 2024-04-26T11:34:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.276+0000 7fdad8975740 20 client.25559 trim_cache size 0 max 16384 2024-04-26T11:34:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.314+0000 7fdad8975740 1 Processor -- start 2024-04-26T11:34:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.315+0000 7fdad8975740 1 -- start start 2024-04-26T11:34:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.315+0000 7fdad8975740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.315+0000 7fdad8975740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.315+0000 7fdad8975740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a29c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.315+0000 7fdad8975740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01b77c0 con 0x55b07a2a0dd0 2024-04-26T11:34:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.315+0000 7fdad8975740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01b5000 con 0x55b07a2a16f0 2024-04-26T11:34:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.315+0000 7fdad8975740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01b2e50 con 0x55b07a2abfb0 2024-04-26T11:34:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.316+0000 7fdacf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a29c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.316+0000 7fdacf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a29c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:50244/0 (socket says 172.21.15.110:50244) 2024-04-26T11:34:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.316+0000 7fdacf400640 1 -- 172.21.15.110:0/3897007690 learned_addr learned my addr 172.21.15.110:0/3897007690 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.316+0000 7fdacea00640 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.316+0000 7fdacf400640 1 -- 172.21.15.110:0/3897007690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 msgr2=0x55b07a2a3790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T11:34:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.317+0000 7fdace000640 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.317+0000 7fdacf400640 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.317+0000 7fdacf400640 1 -- 172.21.15.110:0/3897007690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 msgr2=0x55b07a2b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.317+0000 7fdacf400640 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.317+0000 7fdacf400640 1 -- 172.21.15.110:0/3897007690 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b07a298940 con 0x55b07a2abfb0 2024-04-26T11:34:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.317+0000 7fdacea00640 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:34:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.317+0000 7fdace000640 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:34:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.318+0000 7fdacf400640 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a29c2c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdac8011660 tx=0x7fdac8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e11d8ec1b29c017b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.318+0000 7fdabf400640 1 -- 172.21.15.110:0/3897007690 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8011e90 con 0x55b07a2abfb0 2024-04-26T11:34:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.318+0000 7fdabf400640 1 -- 172.21.15.110:0/3897007690 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdac8011e90 con 0x55b07a2abfb0 2024-04-26T11:34:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.318+0000 7fdabf400640 1 -- 172.21.15.110:0/3897007690 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac800fd40 con 0x55b07a2abfb0 2024-04-26T11:34:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.319+0000 7fdad8975740 1 -- 172.21.15.110:0/3897007690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 msgr2=0x55b07a29c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.319+0000 7fdad8975740 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a29c2c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdac8011660 tx=0x7fdac8014000 comp rx=0 tx=0).stop 2024-04-26T11:34:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.320+0000 7fdad8975740 1 -- 172.21.15.110:0/3897007690 shutdown_connections 2024-04-26T11:34:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.320+0000 7fdad8975740 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a29c2c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.320+0000 7fdad8975740 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.320+0000 7fdad8975740 1 --2- 172.21.15.110:0/3897007690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.320+0000 7fdad8975740 1 -- 172.21.15.110:0/3897007690 >> 172.21.15.110:0/3897007690 conn(0x55b07a29d2e0 msgr2=0x55b07a29bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.320+0000 7fdad8975740 1 -- 172.21.15.110:0/3897007690 shutdown_connections 2024-04-26T11:34:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.320+0000 7fdad8975740 1 -- 172.21.15.110:0/3897007690 wait complete. 2024-04-26T11:34:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.321+0000 7fdad8975740 1 -- start start 2024-04-26T11:34:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.321+0000 7fdad8975740 1 Processor -- start 2024-04-26T11:34:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.322+0000 7fdad8975740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.323+0000 7fdad8975740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.323+0000 7fdad8975740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a2a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.323+0000 7fdad8975740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01b34c0 con 0x55b07a2a0dd0 2024-04-26T11:34:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.323+0000 7fdad8975740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01b4930 con 0x55b07a2a16f0 2024-04-26T11:34:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.323+0000 7fdad8975740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01b3b90 con 0x55b07a2abfb0 2024-04-26T11:34:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.323+0000 7fdad8975740 10 client.0 _ll_register_callbacks cb 0x7fdac80092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.323+0000 7fdacf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a2a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.323+0000 7fdacf400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a2a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:50246/0 (socket says 172.21.15.110:50246) 2024-04-26T11:34:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.323+0000 7fdacf400640 1 -- 172.21.15.110:0/2526623785 learned_addr learned my addr 172.21.15.110:0/2526623785 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.324+0000 7fdacea00640 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.325+0000 7fdace000640 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.325+0000 7fdacf400640 1 -- 172.21.15.110:0/2526623785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 msgr2=0x55b07a2a57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.325+0000 7fdacf400640 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.325+0000 7fdacf400640 1 -- 172.21.15.110:0/2526623785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 msgr2=0x55b07a2b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.325+0000 7fdacf400640 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.326+0000 7fdacf400640 1 -- 172.21.15.110:0/2526623785 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b079fe4620 con 0x55b07a2abfb0 2024-04-26T11:34:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.326+0000 7fdace000640 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:34:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.326+0000 7fdacea00640 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:34:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.326+0000 7fdacf400640 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a2a5cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdac800f7b0 tx=0x7fdac8009dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98a186d7c6b3ea8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.327+0000 7fdabcc00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:34:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.327+0000 7fdabcc00640 1 -- 172.21.15.110:0/2526623785 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac800f940 con 0x55b07a2abfb0 2024-04-26T11:34:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.327+0000 7fdabcc00640 1 -- 172.21.15.110:0/2526623785 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fdac8004c50 con 0x55b07a2abfb0 2024-04-26T11:34:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.327+0000 7fdad8975740 1 -- 172.21.15.110:0/2526623785 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdac8011e90 con 0x55b07a2abfb0 2024-04-26T11:34:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.327+0000 7fdabcc00640 1 -- 172.21.15.110:0/2526623785 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdac8004e50 con 0x55b07a2abfb0 2024-04-26T11:34:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.328+0000 7fdad8975740 10 client.25573 fetch_fsmap learned FSMap version 32 2024-04-26T11:34:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.328+0000 7fdad8975740 1 -- 172.21.15.110:0/2526623785 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b07a1c0cb0 con 0x55b07a2abfb0 2024-04-26T11:34:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.328+0000 7fdabcc00640 1 -- 172.21.15.110:0/2526623785 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdac8011e90 con 0x55b07a2abfb0 2024-04-26T11:34:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.328+0000 7fdabcc00640 1 -- 172.21.15.110:0/2526623785 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fdac8012550 con 0x55b07a2abfb0 2024-04-26T11:34:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.329+0000 7fdad8975740 10 client.25573 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T11:34:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.329+0000 7fdad8975740 10 client.25573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:34:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.329+0000 7fdad8975740 20 client.25573 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.329+0000 7fdad8975740 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b07a322150 0x55b07a324540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.330+0000 7fdad8975740 4 client.25573 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:34:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.330+0000 7fdad8975740 1 -- 172.21.15.110:0/2526623785 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b07a20de00 con 0x55b07a322150 2024-04-26T11:34:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.330+0000 7fdacea00640 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b07a322150 0x55b07a324540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.331+0000 7fdacea00640 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b07a322150 0x55b07a324540 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8263cc7bc27e9f7d server_cookie=58daf8de3ca72d8f in_seq=0 out_seq=0 2024-04-26T11:34:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.331+0000 7fdabcc00640 10 client.25573 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdabcc00640 1 -- 172.21.15.110:0/2526623785 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b07a20de00 con 0x55b07a322150 2024-04-26T11:34:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdabcc00640 10 client.25573 handle_command_reply: tid=0 2024-04-26T11:34:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdad8975740 1 client.25573 shutdown 2024-04-26T11:34:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdad8975740 1 -- 172.21.15.110:0/2526623785 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 msgr2=0x55b07a2a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdad8975740 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a2a5cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdac800f7b0 tx=0x7fdac8009dd0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdad8975740 1 -- 172.21.15.110:0/2526623785 shutdown_connections 2024-04-26T11:34:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdad8975740 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b07a322150 0x55b07a324540 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdad8975740 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b07a2abfb0 0x55b07a2a5cf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdad8975740 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b07a2a16f0 0x55b07a2a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdad8975740 1 --2- 172.21.15.110:0/2526623785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b07a2a0dd0 0x55b07a2b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdad8975740 1 -- 172.21.15.110:0/2526623785 >> 172.21.15.110:0/2526623785 conn(0x55b07a29d2e0 msgr2=0x55b07a29c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.343+0000 7fdabcc00640 0 client.25573 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.344+0000 7fdad8975740 1 -- 172.21.15.110:0/2526623785 shutdown_connections 2024-04-26T11:34:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.344+0000 7fdad8975740 1 -- 172.21.15.110:0/2526623785 wait complete. 2024-04-26T11:34:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.344+0000 7fdad8975740 20 client.25573 trim_cache size 0 max 16384 2024-04-26T11:34:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:34:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:34:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:34:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:34:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdab40a40c0 msgr2=0x7fdab40a6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdab40a40c0 0x7fdab40a6580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdac00096c0 tx=0x7fdac0005a20 comp rx=0 tx=0).stop 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad010e260 msgr2=0x7fdad019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad010e260 0x7fdad019fc30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdab800e9c0 tx=0x7fdab800ee80 comp rx=0 tx=0).stop 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 shutdown_connections 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdab40a40c0 0x7fdab40a6580 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad01a3fb0 0x7fdad01a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad010e260 0x7fdad019fc30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 --2- 172.21.15.110:0/1738882883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdad0109190 0x7fdad019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 >> 172.21.15.110:0/1738882883 conn(0x7fdad0076ec0 msgr2=0x7fdad00791b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.346+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 shutdown_connections 2024-04-26T11:34:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:39.347+0000 7fdad5c00640 1 -- 172.21.15.110:0/1738882883 wait complete. 2024-04-26T11:34:39.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 145.0 s, 3280.6 tps, lat 30.560 ms stddev 33.200 2024-04-26T11:34:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:39 smithi196 ceph-mon[32572]: pgmap v104: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 929 op/s 2024-04-26T11:34:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:39 smithi110 ceph-mon[28069]: pgmap v104: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 929 op/s 2024-04-26T11:34:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:39 smithi193 ceph-mon[32782]: pgmap v104: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 929 op/s 2024-04-26T11:34:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.555+0000 7f798f000700 1 -- 172.21.15.110:0/1965824919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79881094c0 msgr2=0x7f79881098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.555+0000 7f798f000700 1 --2- 172.21.15.110:0/1965824919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79881094c0 0x7f79881098a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7978009990 tx=0x7f7978009ca0 comp rx=0 tx=0).stop 2024-04-26T11:34:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.556+0000 7f798f000700 1 -- 172.21.15.110:0/1965824919 shutdown_connections 2024-04-26T11:34:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.556+0000 7f798f000700 1 --2- 172.21.15.110:0/1965824919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7988103e30 0x7f7988110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.556+0000 7f798f000700 1 --2- 172.21.15.110:0/1965824919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79881094c0 0x7f79881098a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:41.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.556+0000 7f798f000700 1 --2- 172.21.15.110:0/1965824919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7988103470 0x7f79881038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.556+0000 7f798f000700 1 -- 172.21.15.110:0/1965824919 >> 172.21.15.110:0/1965824919 conn(0x7f798807a580 msgr2=0x7f798807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.556+0000 7f798f000700 1 -- 172.21.15.110:0/1965824919 shutdown_connections 2024-04-26T11:34:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.556+0000 7f798f000700 1 -- 172.21.15.110:0/1965824919 wait complete. 2024-04-26T11:34:41.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.558+0000 7f798f000700 1 Processor -- start 2024-04-26T11:34:41.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.558+0000 7f798f000700 1 -- start start 2024-04-26T11:34:41.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.559+0000 7f798f000700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7988103470 0x7f79881101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.559+0000 7f798f000700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7988103e30 0x7f798810d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.559+0000 7f798f000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79881094c0 0x7f798810d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.559+0000 7f798f000700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7988115830 con 0x7f79881094c0 2024-04-26T11:34:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.559+0000 7f798f000700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79881156b0 con 0x7f7988103e30 2024-04-26T11:34:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.559+0000 7f798f000700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79881159b0 con 0x7f7988103470 2024-04-26T11:34:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.560+0000 7f7987400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7988103e30 0x7f798810d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.560+0000 7f7987400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7988103e30 0x7f798810d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:57958/0 (socket says 172.21.15.110:57958) 2024-04-26T11:34:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.560+0000 7f7987400700 1 -- 172.21.15.110:0/1693955413 learned_addr learned my addr 172.21.15.110:0/1693955413 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.560+0000 7f7987e00700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7988103470 0x7f79881101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:41.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.560+0000 7f798d000700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79881094c0 0x7f798810d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:41.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.560+0000 7f7987e00700 1 -- 172.21.15.110:0/1693955413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7988103e30 msgr2=0x7f798810d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:41.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.561+0000 7f7987e00700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7988103e30 0x7f798810d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:41.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.561+0000 7f7987e00700 1 -- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79881094c0 msgr2=0x7f798810d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:41.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.561+0000 7f7987e00700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79881094c0 0x7f798810d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.561+0000 7f7987e00700 1 -- 172.21.15.110:0/1693955413 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79881ac550 con 0x7f7988103470 2024-04-26T11:34:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.561+0000 7f7987400700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7988103e30 0x7f798810d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:34:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.561+0000 7f7987e00700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7988103470 0x7f79881101a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7978000c00 tx=0x7f79780047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.562+0000 7f7984c00700 1 -- 172.21.15.110:0/1693955413 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978026070 con 0x7f7988103470 2024-04-26T11:34:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.562+0000 7f7984c00700 1 -- 172.21.15.110:0/1693955413 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7978021410 con 0x7f7988103470 2024-04-26T11:34:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.562+0000 7f7984c00700 1 -- 172.21.15.110:0/1693955413 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978017650 con 0x7f7988103470 2024-04-26T11:34:41.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.563+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79881ac720 con 0x7f7988103470 2024-04-26T11:34:41.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.563+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79881acb20 con 0x7f7988103470 2024-04-26T11:34:41.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.565+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7988104b60 con 0x7f7988103470 2024-04-26T11:34:41.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.569+0000 7f7984c00700 1 -- 172.21.15.110:0/1693955413 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7978009d10 con 0x7f7988103470 2024-04-26T11:34:41.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.571+0000 7f7984c00700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f796c0a3eb0 0x7f796c0a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:41.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.572+0000 7f7984c00700 1 -- 172.21.15.110:0/1693955413 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f79780d1340 con 0x7f7988103470 2024-04-26T11:34:41.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.573+0000 7f7987400700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f796c0a3eb0 0x7f796c0a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:41.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.574+0000 7f7987400700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f796c0a3eb0 0x7f796c0a6370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f798810ea10 tx=0x7f7974005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:41.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:41.574+0000 7f7984c00700 1 -- 172.21.15.110:0/1693955413 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f797805cff0 con 0x7f7988103470 2024-04-26T11:34:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:41 smithi196 ceph-mon[32572]: pgmap v105: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 MiB/s wr, 633 op/s 2024-04-26T11:34:42.031 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:41 smithi110 ceph-mon[28069]: pgmap v105: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 MiB/s wr, 633 op/s 2024-04-26T11:34:42.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.029+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f798802e490 con 0x7f7988103470 2024-04-26T11:34:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:34:42.032 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:34:21.927287+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24487,24502,24518]},"id":1}]} 2024-04-26T11:34:42.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.030+0000 7f7984c00700 1 -- 172.21.15.110:0/1693955413 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11896 (secure 0 0 0) 0x7f7978013070 con 0x7f7988103470 2024-04-26T11:34:42.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.033+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f796c0a3eb0 msgr2=0x7f796c0a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:42.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.033+0000 7f798f000700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f796c0a3eb0 0x7f796c0a6370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f798810ea10 tx=0x7f7974005f90 comp rx=0 tx=0).stop 2024-04-26T11:34:42.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.033+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7988103470 msgr2=0x7f79881101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:42.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.033+0000 7f798f000700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7988103470 0x7f79881101a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7978000c00 tx=0x7f79780047b0 comp rx=0 tx=0).stop 2024-04-26T11:34:42.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.034+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 shutdown_connections 2024-04-26T11:34:42.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.034+0000 7f798f000700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f796c0a3eb0 0x7f796c0a6370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:42.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.034+0000 7f798f000700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79881094c0 0x7f798810d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:42.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.034+0000 7f798f000700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7988103470 0x7f79881101a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:42.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.034+0000 7f798f000700 1 --2- 172.21.15.110:0/1693955413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7988103e30 0x7f798810d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:42.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.034+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 >> 172.21.15.110:0/1693955413 conn(0x7f798807a580 msgr2=0x7f79881021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:42.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.034+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 shutdown_connections 2024-04-26T11:34:42.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:42.035+0000 7f798f000700 1 -- 172.21.15.110:0/1693955413 wait complete. 2024-04-26T11:34:42.039 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 32 2024-04-26T11:34:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:41 smithi193 ceph-mon[32782]: pgmap v105: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 MiB/s wr, 633 op/s 2024-04-26T11:34:42.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:42 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1693955413' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:34:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:42 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1693955413' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:34:43.008 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db / --timeout 60 --expiration 75.6 --await-for 42.0' 2024-04-26T11:34:43.008 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db / --timeout 60 --expiration 75.6 --await-for 42.0 2024-04-26T11:34:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:42 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1693955413' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:34:43.626 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:34:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:43 smithi110 ceph-mon[28069]: pgmap v106: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 668 op/s 2024-04-26T11:34:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:43 smithi196 ceph-mon[32572]: pgmap v106: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 668 op/s 2024-04-26T11:34:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:43 smithi193 ceph-mon[32782]: pgmap v106: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 668 op/s 2024-04-26T11:34:44.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 150.0 s, 2526.1 tps, lat 39.254 ms stddev 46.301 2024-04-26T11:34:45.906 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:45 smithi110 ceph-mon[28069]: pgmap v107: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 951 op/s 2024-04-26T11:34:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:45 smithi196 ceph-mon[32572]: pgmap v107: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 951 op/s 2024-04-26T11:34:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:45 smithi193 ceph-mon[32782]: pgmap v107: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 951 op/s 2024-04-26T11:34:46.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.410+0000 7fb29fc00700 1 -- 172.21.15.110:0/282461603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981083d0 msgr2=0x7fb298105e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:46.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.410+0000 7fb29fc00700 1 --2- 172.21.15.110:0/282461603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981083d0 0x7fb298105e80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009990 tx=0x7fb28c009ca0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.411+0000 7fb29fc00700 1 -- 172.21.15.110:0/282461603 shutdown_connections 2024-04-26T11:34:46.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.411+0000 7fb29fc00700 1 --2- 172.21.15.110:0/282461603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb29806b120 0x7fb29806b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.411+0000 7fb29fc00700 1 --2- 172.21.15.110:0/282461603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981083d0 0x7fb298105e80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.411+0000 7fb29fc00700 1 --2- 172.21.15.110:0/282461603 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2981063c0 0x7fb298106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.411+0000 7fb29fc00700 1 -- 172.21.15.110:0/282461603 >> 172.21.15.110:0/282461603 conn(0x7fb2980792c0 msgr2=0x7fb2980796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:46.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.411+0000 7fb29fc00700 1 -- 172.21.15.110:0/282461603 shutdown_connections 2024-04-26T11:34:46.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.412+0000 7fb29fc00700 1 -- 172.21.15.110:0/282461603 wait complete. 2024-04-26T11:34:46.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.413+0000 7fb29fc00700 1 Processor -- start 2024-04-26T11:34:46.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.413+0000 7fb29fc00700 1 -- start start 2024-04-26T11:34:46.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.413+0000 7fb29fc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb29806b120 0x7fb2981a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.413+0000 7fb29fc00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981063c0 0x7fb2981a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.413+0000 7fb29fc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2981083d0 0x7fb2981a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.413+0000 7fb29fc00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb298119c40 con 0x7fb2981083d0 2024-04-26T11:34:46.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.413+0000 7fb29fc00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb298119ac0 con 0x7fb29806b120 2024-04-26T11:34:46.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.414+0000 7fb29fc00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb298119dc0 con 0x7fb2981063c0 2024-04-26T11:34:46.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.414+0000 7fb297e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981063c0 0x7fb2981a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.414+0000 7fb29dc00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2981083d0 0x7fb2981a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.414+0000 7fb297e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981063c0 0x7fb2981a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:50566/0 (socket says 172.21.15.110:50566) 2024-04-26T11:34:46.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.414+0000 7fb297e00700 1 -- 172.21.15.110:0/3741115511 learned_addr learned my addr 172.21.15.110:0/3741115511 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:46.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.414+0000 7fb29d200700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb29806b120 0x7fb2981a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb29d200700 1 -- 172.21.15.110:0/3741115511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981063c0 msgr2=0x7fb2981a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb29d200700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981063c0 0x7fb2981a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb29d200700 1 -- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2981083d0 msgr2=0x7fb2981a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb29d200700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2981083d0 0x7fb2981a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb29d200700 1 -- 172.21.15.110:0/3741115511 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2981a50a0 con 0x7fb29806b120 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb297e00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981063c0 0x7fb2981a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb29dc00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2981083d0 0x7fb2981a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb29d200700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb29806b120 0x7fb2981a0090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0098e0 tx=0x7fb28c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb295600700 1 -- 172.21.15.110:0/3741115511 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c027070 con 0x7fb29806b120 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb295600700 1 -- 172.21.15.110:0/3741115511 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb28c022470 con 0x7fb29806b120 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb295600700 1 -- 172.21.15.110:0/3741115511 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c017650 con 0x7fb29806b120 2024-04-26T11:34:46.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.415+0000 7fb29fc00700 1 -- 172.21.15.110:0/3741115511 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2981a5330 con 0x7fb29806b120 2024-04-26T11:34:46.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.416+0000 7fb29fc00700 1 -- 172.21.15.110:0/3741115511 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb298108940 con 0x7fb29806b120 2024-04-26T11:34:46.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.423+0000 7fb295600700 1 -- 172.21.15.110:0/3741115511 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fb28c02a070 con 0x7fb29806b120 2024-04-26T11:34:46.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.425+0000 7fb2aa65cb80 1 Processor -- start 2024-04-26T11:34:46.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.425+0000 7fb2aa65cb80 1 -- start start 2024-04-26T11:34:46.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.426+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cee5f0 0x55dc95cee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.426+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 0x55dc95cf8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.426+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 0x55dc95cfb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.426+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dc95c41b70 con 0x55dc95cf8cc0 2024-04-26T11:34:46.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.426+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dc95be03d0 con 0x55dc95cee5f0 2024-04-26T11:34:46.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.426+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55dc95c3db30 con 0x55dc95ceef10 2024-04-26T11:34:46.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.426+0000 7fb29dc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cee5f0 0x55dc95cee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.426+0000 7fb29dc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cee5f0 0x55dc95cee9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38838/0 (socket says 172.21.15.110:38838) 2024-04-26T11:34:46.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.427+0000 7fb29dc00700 1 -- 172.21.15.110:0/1821293812 learned_addr learned my addr 172.21.15.110:0/1821293812 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:46.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.427+0000 7fb297e00700 1 --2- 172.21.15.110:0/1821293812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 0x55dc95cfb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.427+0000 7fb297e00700 1 -- 172.21.15.110:0/1821293812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 msgr2=0x55dc95cf8780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T11:34:46.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.427+0000 7fb297e00700 1 --2- 172.21.15.110:0/1821293812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 0x55dc95cf8780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.427+0000 7fb297e00700 1 -- 172.21.15.110:0/1821293812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cee5f0 msgr2=0x55dc95cee9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:46.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.427+0000 7fb297e00700 1 --2- 172.21.15.110:0/1821293812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cee5f0 0x55dc95cee9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.427+0000 7fb297e00700 1 -- 172.21.15.110:0/1821293812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc95be88f0 con 0x55dc95cf8cc0 2024-04-26T11:34:46.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.428+0000 7fb297e00700 1 --2- 172.21.15.110:0/1821293812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 0x55dc95cfb0b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb284011510 tx=0x7fb284011820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f466e0a94f31d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:46.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.428+0000 7fb295600700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb2800a3ed0 0x7fb2800a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.429+0000 7fb295600700 1 -- 172.21.15.110:0/3741115511 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fb28c0d1450 con 0x7fb29806b120 2024-04-26T11:34:46.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.429+0000 7fb28a000700 1 -- 172.21.15.110:0/1821293812 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28401e070 con 0x55dc95cf8cc0 2024-04-26T11:34:46.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.429+0000 7fb28a000700 1 -- 172.21.15.110:0/1821293812 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb28400fb30 con 0x55dc95cf8cc0 2024-04-26T11:34:46.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.429+0000 7fb28a000700 1 -- 172.21.15.110:0/1821293812 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284019c90 con 0x55dc95cf8cc0 2024-04-26T11:34:46.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.429+0000 7fb29dc00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb2800a3ed0 0x7fb2800a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.430+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1821293812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 msgr2=0x55dc95cfb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:46.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.430+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/1821293812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 0x55dc95cfb0b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb284011510 tx=0x7fb284011820 comp rx=0 tx=0).stop 2024-04-26T11:34:46.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.432+0000 7fb29dc00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb2800a3ed0 0x7fb2800a6390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb290009550 tx=0x7fb290009130 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:46.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.432+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1821293812 shutdown_connections 2024-04-26T11:34:46.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.432+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/1821293812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 0x55dc95cfb0b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.432+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/1821293812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cee5f0 0x55dc95cee9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.432+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/1821293812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 0x55dc95cf8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.432+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1821293812 >> 172.21.15.110:0/1821293812 conn(0x55dc95c1c5d0 msgr2=0x55dc95ce9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:46.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.433+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1821293812 shutdown_connections 2024-04-26T11:34:46.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.433+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1821293812 wait complete. 2024-04-26T11:34:46.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.433+0000 7fb2aa65cb80 1 -- start start 2024-04-26T11:34:46.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.434+0000 7fb2aa65cb80 1 Processor -- start 2024-04-26T11:34:46.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.434+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 0x55dc95cf8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.434+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 0x55dc95cf5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.434+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cf8cc0 0x55dc95cf5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.434+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dc95cfb830 con 0x55dc95cee5f0 2024-04-26T11:34:46.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.434+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dc95bdc620 con 0x55dc95cf8cc0 2024-04-26T11:34:46.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.434+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55dc95cfb9b0 con 0x55dc95ceef10 2024-04-26T11:34:46.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.434+0000 7fb2aa65cb80 10 client.0 _ll_register_callbacks cb 0x55dc95bd5510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:46.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.435+0000 7fb29dc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cf8cc0 0x55dc95cf5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.435+0000 7fb297e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 0x55dc95cf5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.435+0000 7fb29dc00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cf8cc0 0x55dc95cf5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38854/0 (socket says 172.21.15.110:38854) 2024-04-26T11:34:46.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.435+0000 7fb29dc00700 1 -- 172.21.15.110:0/2826994144 learned_addr learned my addr 172.21.15.110:0/2826994144 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:46.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.435+0000 7fb29d200700 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 0x55dc95cf8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.436+0000 7fb297e00700 1 -- 172.21.15.110:0/2826994144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cf8cc0 msgr2=0x55dc95cf5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:46.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.436+0000 7fb297e00700 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cf8cc0 0x55dc95cf5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.436+0000 7fb297e00700 1 -- 172.21.15.110:0/2826994144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 msgr2=0x55dc95cf8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:46.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.436+0000 7fb297e00700 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 0x55dc95cf8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.436+0000 7fb297e00700 1 -- 172.21.15.110:0/2826994144 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc95b8ea60 con 0x55dc95ceef10 2024-04-26T11:34:46.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.436+0000 7fb29dc00700 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cf8cc0 0x55dc95cf5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:34:46.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.436+0000 7fb297e00700 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 0x55dc95cf5700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb284009230 tx=0x7fb28400f530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c992a0c64cab2a7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:46.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.437+0000 7fb27ea00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.437+0000 7fb27ea00700 1 -- 172.21.15.110:0/2826994144 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28401e070 con 0x55dc95ceef10 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.437+0000 7fb27ea00700 1 -- 172.21.15.110:0/2826994144 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fb284019ad0 con 0x55dc95ceef10 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.438+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/2826994144 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb28400fb30 con 0x55dc95ceef10 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.438+0000 7fb27ea00700 1 -- 172.21.15.110:0/2826994144 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb28400f960 con 0x55dc95ceef10 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.438+0000 7fb2aa65cb80 10 client.25588 fetch_fsmap learned FSMap version 32 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.439+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/2826994144 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dc95d060d0 con 0x55dc95ceef10 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.439+0000 7fb27ea00700 1 -- 172.21.15.110:0/2826994144 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb28400fb30 con 0x55dc95ceef10 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.439+0000 7fb27ea00700 1 -- 172.21.15.110:0/2826994144 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fb284004ac0 con 0x55dc95ceef10 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.439+0000 7fb2aa65cb80 10 client.25588 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.439+0000 7fb2aa65cb80 10 client.25588 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.439+0000 7fb2aa65cb80 20 client.25588 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:46.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.439+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55dc95d08650 0x55dc95d0aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.439+0000 7fb2aa65cb80 4 client.25588 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:34:46.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.439+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/2826994144 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc95cbad00 con 0x55dc95d08650 2024-04-26T11:34:46.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.440+0000 7fb29d200700 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55dc95d08650 0x55dc95d0aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.440+0000 7fb27ea00700 10 client.25588 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:46.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.442+0000 7fb29d200700 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55dc95d08650 0x55dc95d0aa40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28abfcc0440dfc84 server_cookie=8c7307fd76596363 in_seq=0 out_seq=0 2024-04-26T11:34:46.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.443+0000 7fb27ea00700 1 -- 172.21.15.110:0/2826994144 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dc95cbad00 con 0x55dc95d08650 2024-04-26T11:34:46.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.443+0000 7fb27ea00700 10 client.25588 handle_command_reply: tid=0 2024-04-26T11:34:46.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.444+0000 7fb2aa65cb80 1 client.25588 shutdown 2024-04-26T11:34:46.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.444+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/2826994144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 msgr2=0x55dc95cf5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:46.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.444+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 0x55dc95cf5700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb284009230 tx=0x7fb28400f530 comp rx=0 tx=0).stop 2024-04-26T11:34:46.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.445+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/2826994144 shutdown_connections 2024-04-26T11:34:46.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.445+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55dc95d08650 0x55dc95d0aa40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.445+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95cf8cc0 0x55dc95cf5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.445+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 0x55dc95cf8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.445+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/2826994144 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95ceef10 0x55dc95cf5700 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.445+0000 7fb27ea00700 0 client.25588 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:46.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.445+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/2826994144 >> 172.21.15.110:0/2826994144 conn(0x55dc95c1c5d0 msgr2=0x55dc95ceb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:46.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.445+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/2826994144 shutdown_connections 2024-04-26T11:34:46.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.446+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/2826994144 wait complete. 2024-04-26T11:34:46.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.446+0000 7fb2aa65cb80 20 client.25588 trim_cache size 0 max 16384 2024-04-26T11:34:46.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.475+0000 7fb2aa65cb80 1 Processor -- start 2024-04-26T11:34:46.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.475+0000 7fb2aa65cb80 1 -- start start 2024-04-26T11:34:46.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 0x55dc95ce9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95d04760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cf8cc0 0x55dc95d10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb2981bf5b0 con 0x55dc95cee5f0 2024-04-26T11:34:46.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb298111460 con 0x55dc95ceef10 2024-04-26T11:34:46.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb298102960 con 0x55dc95cf8cc0 2024-04-26T11:34:46.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb297e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95d04760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb29dc00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cf8cc0 0x55dc95d10130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb297e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95d04760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38864/0 (socket says 172.21.15.110:38864) 2024-04-26T11:34:46.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.476+0000 7fb297e00700 1 -- 172.21.15.110:0/1570572707 learned_addr learned my addr 172.21.15.110:0/1570572707 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:46.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.477+0000 7fb29d200700 1 --2- 172.21.15.110:0/1570572707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 0x55dc95ce9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.477+0000 7fb297e00700 1 -- 172.21.15.110:0/1570572707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cf8cc0 msgr2=0x55dc95d10130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:46.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.477+0000 7fb297e00700 1 --2- 172.21.15.110:0/1570572707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cf8cc0 0x55dc95d10130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.477+0000 7fb297e00700 1 -- 172.21.15.110:0/1570572707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 msgr2=0x55dc95ce9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.477+0000 7fb297e00700 1 --2- 172.21.15.110:0/1570572707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 0x55dc95ce9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.477+0000 7fb297e00700 1 -- 172.21.15.110:0/1570572707 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc95cf3cb0 con 0x55dc95ceef10 2024-04-26T11:34:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.478+0000 7fb297e00700 1 --2- 172.21.15.110:0/1570572707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95d04760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb284004ec0 tx=0x7fb28400fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c5f5b2b3f385e4d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.478+0000 7fb289600700 1 -- 172.21.15.110:0/1570572707 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28401e070 con 0x55dc95ceef10 2024-04-26T11:34:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.478+0000 7fb289600700 1 -- 172.21.15.110:0/1570572707 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb284028070 con 0x55dc95ceef10 2024-04-26T11:34:46.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.478+0000 7fb289600700 1 -- 172.21.15.110:0/1570572707 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28401e070 con 0x55dc95ceef10 2024-04-26T11:34:46.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.479+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1570572707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 msgr2=0x55dc95d04760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:46.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.479+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/1570572707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95d04760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb284004ec0 tx=0x7fb28400fc90 comp rx=0 tx=0).stop 2024-04-26T11:34:46.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.480+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1570572707 shutdown_connections 2024-04-26T11:34:46.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.480+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/1570572707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cf8cc0 0x55dc95d10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.480+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/1570572707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cee5f0 0x55dc95ce9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.480+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/1570572707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95d04760 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.480+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1570572707 >> 172.21.15.110:0/1570572707 conn(0x55dc95c1c5d0 msgr2=0x55dc95ce9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:46.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.480+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1570572707 shutdown_connections 2024-04-26T11:34:46.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.480+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/1570572707 wait complete. 2024-04-26T11:34:46.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.481+0000 7fb2aa65cb80 1 -- start start 2024-04-26T11:34:46.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.481+0000 7fb2aa65cb80 1 Processor -- start 2024-04-26T11:34:46.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.482+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cee5f0 0x55dc95d01050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.482+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95cfdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.482+0000 7fb2aa65cb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 0x55dc95cfe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.482+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb29810f920 con 0x55dc95cf8cc0 2024-04-26T11:34:46.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.482+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb298110d90 con 0x55dc95ceef10 2024-04-26T11:34:46.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.482+0000 7fb2aa65cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb29810fff0 con 0x55dc95cee5f0 2024-04-26T11:34:46.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.482+0000 7fb2aa65cb80 10 client.0 _ll_register_callbacks cb 0x55dc95bd5510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:46.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.483+0000 7fb297e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95cfdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.483+0000 7fb297e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95cfdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38874/0 (socket says 172.21.15.110:38874) 2024-04-26T11:34:46.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.483+0000 7fb297e00700 1 -- 172.21.15.110:0/4277362174 learned_addr learned my addr 172.21.15.110:0/4277362174 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:46.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.483+0000 7fb29dc00700 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 0x55dc95cfe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.483+0000 7fb29d200700 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cee5f0 0x55dc95d01050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.484+0000 7fb297e00700 1 -- 172.21.15.110:0/4277362174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cee5f0 msgr2=0x55dc95d01050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:46.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.484+0000 7fb297e00700 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cee5f0 0x55dc95d01050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.484+0000 7fb297e00700 1 -- 172.21.15.110:0/4277362174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 msgr2=0x55dc95cfe180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:46.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.484+0000 7fb297e00700 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 0x55dc95cfe180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.484+0000 7fb297e00700 1 -- 172.21.15.110:0/4277362174 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc95cfe980 con 0x55dc95ceef10 2024-04-26T11:34:46.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.485+0000 7fb297e00700 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95cfdc40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb28400f570 tx=0x7fb284019e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb9b9f31bd761c9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:46.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.485+0000 7fb27ea00700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:34:46.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.486+0000 7fb27ea00700 1 -- 172.21.15.110:0/4277362174 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28403a070 con 0x55dc95ceef10 2024-04-26T11:34:46.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.487+0000 7fb27ea00700 1 -- 172.21.15.110:0/4277362174 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fb284004b20 con 0x55dc95ceef10 2024-04-26T11:34:46.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.487+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/4277362174 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb284028070 con 0x55dc95ceef10 2024-04-26T11:34:46.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.488+0000 7fb27ea00700 1 -- 172.21.15.110:0/4277362174 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb284046050 con 0x55dc95ceef10 2024-04-26T11:34:46.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.488+0000 7fb2aa65cb80 10 client.25583 fetch_fsmap learned FSMap version 32 2024-04-26T11:34:46.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.488+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/4277362174 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dc95d6f9c0 con 0x55dc95ceef10 2024-04-26T11:34:46.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.489+0000 7fb27ea00700 1 -- 172.21.15.110:0/4277362174 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb284028070 con 0x55dc95ceef10 2024-04-26T11:34:46.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.490+0000 7fb27ea00700 1 -- 172.21.15.110:0/4277362174 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7fb2840051d0 con 0x55dc95ceef10 2024-04-26T11:34:46.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.490+0000 7fb2aa65cb80 10 client.25583 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T11:34:46.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.490+0000 7fb2aa65cb80 10 client.25583 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:34:46.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.490+0000 7fb2aa65cb80 20 client.25583 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:46.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.490+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55dc95d70080 0x55dc95d724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:46.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.490+0000 7fb2aa65cb80 4 client.25583 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.6, "await_for": 42.0}] 2024-04-26T11:34:46.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.490+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/4277362174 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.6, "await_for": 42.0}) -- 0x55dc95c4f550 con 0x55dc95d70080 2024-04-26T11:34:46.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.491+0000 7fb29d200700 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55dc95d70080 0x55dc95d724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:46.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.492+0000 7fb27ea00700 10 client.25583 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:46.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.493+0000 7fb29d200700 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55dc95d70080 0x55dc95d724a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44d45f42924daaa server_cookie=99b944f3bdd933c2 in_seq=0 out_seq=0 2024-04-26T11:34:46.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb27ea00700 1 -- 172.21.15.110:0/4277362174 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55dc95c4f550 con 0x55dc95d70080 2024-04-26T11:34:46.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb27ea00700 10 client.25583 handle_command_reply: tid=0 2024-04-26T11:34:46.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb2aa65cb80 1 client.25583 shutdown 2024-04-26T11:34:46.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/4277362174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 msgr2=0x55dc95cfdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:46.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95cfdc40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb28400f570 tx=0x7fb284019e50 comp rx=0 tx=0).stop 2024-04-26T11:34:46.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/4277362174 shutdown_connections 2024-04-26T11:34:46.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55dc95d70080 0x55dc95d724a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dc95cf8cc0 0x55dc95cfe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55dc95cee5f0 0x55dc95d01050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb2aa65cb80 1 --2- 172.21.15.110:0/4277362174 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dc95ceef10 0x55dc95cfdc40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/4277362174 >> 172.21.15.110:0/4277362174 conn(0x55dc95c1c5d0 msgr2=0x55dc95cf06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:46.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.685+0000 7fb27ea00700 0 client.25583 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:46.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.686+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/4277362174 shutdown_connections 2024-04-26T11:34:46.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.686+0000 7fb2aa65cb80 1 -- 172.21.15.110:0/4277362174 wait complete. 2024-04-26T11:34:46.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.686+0000 7fb2aa65cb80 20 client.25583 trim_cache size 0 max 16384 2024-04-26T11:34:46.688 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:34:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 32, 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 10, 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "7ef1dec5": { 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 10, 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "QUIESCED", 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 75.6, 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:34:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": false, 2024-04-26T11:34:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:34:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "QUIESCED", 2024-04-26T11:34:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:34:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:34:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:34:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:34:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:34:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:34:46.690 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.687+0000 7fb29fc00700 1 -- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb2800a3ed0 msgr2=0x7fb2800a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.687+0000 7fb29fc00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb2800a3ed0 0x7fb2800a6390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb290009550 tx=0x7fb290009130 comp rx=0 tx=0).stop 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.687+0000 7fb29fc00700 1 -- 172.21.15.110:0/3741115511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb29806b120 msgr2=0x7fb2981a0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.687+0000 7fb29fc00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb29806b120 0x7fb2981a0090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0098e0 tx=0x7fb28c0057c0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.688+0000 7fb29fc00700 1 -- 172.21.15.110:0/3741115511 shutdown_connections 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.688+0000 7fb29fc00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fb2800a3ed0 0x7fb2800a6390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.688+0000 7fb29fc00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2981083d0 0x7fb2981a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.688+0000 7fb29fc00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb29806b120 0x7fb2981a0090 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.688+0000 7fb29fc00700 1 --2- 172.21.15.110:0/3741115511 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb2981063c0 0x7fb2981a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.688+0000 7fb29fc00700 1 -- 172.21.15.110:0/3741115511 >> 172.21.15.110:0/3741115511 conn(0x7fb2980792c0 msgr2=0x7fb298100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.688+0000 7fb29fc00700 1 -- 172.21.15.110:0/3741115511 shutdown_connections 2024-04-26T11:34:46.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:34:46.688+0000 7fb29fc00700 1 -- 172.21.15.110:0/3741115511 wait complete. 2024-04-26T11:34:47.625 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7ef1dec5', quiesce took 9.4 seconds. Will release after: 15.6 2024-04-26T11:34:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:47 smithi196 ceph-mon[32572]: pgmap v108: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 657 op/s 2024-04-26T11:34:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:47 smithi110 ceph-mon[28069]: pgmap v108: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 657 op/s 2024-04-26T11:34:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:47 smithi193 ceph-mon[32782]: pgmap v108: 97 pgs: 97 active+clean; 1.6 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 657 op/s 2024-04-26T11:34:49.925 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 155.0 s, 982.1 tps, lat 33.297 ms stddev 44.380 2024-04-26T11:34:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:49 smithi196 ceph-mon[32572]: pgmap v109: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 921 op/s 2024-04-26T11:34:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:49 smithi110 ceph-mon[28069]: pgmap v109: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 921 op/s 2024-04-26T11:34:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:49 smithi193 ceph-mon[32782]: pgmap v109: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 921 op/s 2024-04-26T11:34:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:51 smithi196 ceph-mon[32572]: pgmap v110: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.8 MiB/s wr, 582 op/s 2024-04-26T11:34:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:51 smithi110 ceph-mon[28069]: pgmap v110: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.8 MiB/s wr, 582 op/s 2024-04-26T11:34:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:51 smithi193 ceph-mon[32782]: pgmap v110: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.8 MiB/s wr, 582 op/s 2024-04-26T11:34:52.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.498+0000 7f6c76200640 1 -- 172.21.15.110:0/3722075367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70105500 msgr2=0x7f6c701119c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.498+0000 7f6c76200640 1 --2- 172.21.15.110:0/3722075367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70105500 0x7f6c701119c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009ca0 tx=0x7f6c6802a8c0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.498+0000 7f6c76200640 1 -- 172.21.15.110:0/3722075367 shutdown_connections 2024-04-26T11:34:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.498+0000 7f6c76200640 1 --2- 172.21.15.110:0/3722075367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70105500 0x7f6c701119c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.498+0000 7f6c76200640 1 --2- 172.21.15.110:0/3722075367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c70104b40 0x7f6c70104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.498+0000 7f6c76200640 1 --2- 172.21.15.110:0/3722075367 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c7010ac00 0x7f6c7010afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.498+0000 7f6c76200640 1 -- 172.21.15.110:0/3722075367 >> 172.21.15.110:0/3722075367 conn(0x7f6c70100630 msgr2=0x7f6c70102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.498+0000 7f6c76200640 1 -- 172.21.15.110:0/3722075367 shutdown_connections 2024-04-26T11:34:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.499+0000 7f6c76200640 1 -- 172.21.15.110:0/3722075367 wait complete. 2024-04-26T11:34:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.499+0000 7f6c76200640 1 Processor -- start 2024-04-26T11:34:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c76200640 1 -- start start 2024-04-26T11:34:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c76200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70104b40 0x7f6c7019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c76200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c70105500 0x7f6c7019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c76200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c7010ac00 0x7f6c7019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c76200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6c70114df0 con 0x7f6c70104b40 2024-04-26T11:34:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c76200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c70114c70 con 0x7f6c70105500 2024-04-26T11:34:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c76200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6c70114f70 con 0x7f6c7010ac00 2024-04-26T11:34:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c6f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70104b40 0x7f6c7019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c6f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70104b40 0x7f6c7019b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47064/0 (socket says 172.21.15.110:47064) 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c6f400640 1 -- 172.21.15.110:0/412746541 learned_addr learned my addr 172.21.15.110:0/412746541 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.500+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c70105500 0x7f6c7019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c7010ac00 0x7f6c7019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c6f400640 1 -- 172.21.15.110:0/412746541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c7010ac00 msgr2=0x7f6c7019fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c6f400640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c7010ac00 0x7f6c7019fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c6f400640 1 -- 172.21.15.110:0/412746541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c70105500 msgr2=0x7f6c7019b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c6f400640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c70105500 0x7f6c7019b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c6f400640 1 -- 172.21.15.110:0/412746541 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c701a01c0 con 0x7f6c70104b40 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c7010ac00 0x7f6c7019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c6f400640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70104b40 0x7f6c7019b1d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e9f0 tx=0x7f6c6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c67e00640 1 -- 172.21.15.110:0/412746541 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000cd80 con 0x7f6c70104b40 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c67e00640 1 -- 172.21.15.110:0/412746541 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c600108e0 con 0x7f6c70104b40 2024-04-26T11:34:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c67e00640 1 -- 172.21.15.110:0/412746541 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60018980 con 0x7f6c70104b40 2024-04-26T11:34:52.508 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.501+0000 7f6c76200640 1 -- 172.21.15.110:0/412746541 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c701a04b0 con 0x7f6c70104b40 2024-04-26T11:34:52.508 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.502+0000 7f6c76200640 1 -- 172.21.15.110:0/412746541 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c701a7d40 con 0x7f6c70104b40 2024-04-26T11:34:52.508 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.505+0000 7f6c79036740 1 Processor -- start 2024-04-26T11:34:52.508 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.505+0000 7f6c67e00640 1 -- 172.21.15.110:0/412746541 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6c60010430 con 0x7f6c70104b40 2024-04-26T11:34:52.508 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.505+0000 7f6c79036740 1 -- start start 2024-04-26T11:34:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c79036740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df96dd0 0x55b02df971b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c79036740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df976f0 0x55b02dfa1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c79036740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 0x55b02dfa43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c79036740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b02defc380 con 0x55b02df96dd0 2024-04-26T11:34:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c79036740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b02de98c30 con 0x55b02df976f0 2024-04-26T11:34:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c79036740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b02def8340 con 0x55b02dfa1fb0 2024-04-26T11:34:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df96dd0 0x55b02df971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 0x55b02dfa43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df96dd0 0x55b02df971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47066/0 (socket says 172.21.15.110:47066) 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6fe00640 1 -- 172.21.15.110:0/3027927929 learned_addr learned my addr 172.21.15.110:0/3027927929 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/3027927929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 0x55b02dfa43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:56496/0 (socket says 172.21.15.110:56496) 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6f400640 1 --2- 172.21.15.110:0/3027927929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df976f0 0x55b02dfa1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6fe00640 1 -- 172.21.15.110:0/3027927929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 msgr2=0x55b02dfa43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/3027927929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 0x55b02dfa43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6fe00640 1 -- 172.21.15.110:0/3027927929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df976f0 msgr2=0x55b02dfa1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/3027927929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df976f0 0x55b02dfa1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.506+0000 7f6c6fe00640 1 -- 172.21.15.110:0/3027927929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02deba940 con 0x55b02df96dd0 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.507+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/3027927929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df96dd0 0x55b02df971b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009390 tx=0x7f6c680093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd29aeb242a1a7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.507+0000 7f6c67e00640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6c540a3e40 0x7f6c540a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.507+0000 7f6c5be00640 1 -- 172.21.15.110:0/3027927929 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68031ce0 con 0x55b02df96dd0 2024-04-26T11:34:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.507+0000 7f6c5be00640 1 -- 172.21.15.110:0/3027927929 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c68036040 con 0x55b02df96dd0 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.507+0000 7f6c5be00640 1 -- 172.21.15.110:0/3027927929 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68004240 con 0x55b02df96dd0 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.507+0000 7f6c67e00640 1 -- 172.21.15.110:0/412746541 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6c600d0c00 con 0x7f6c70104b40 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.507+0000 7f6c6f400640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6c540a3e40 0x7f6c540a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c79036740 1 -- 172.21.15.110:0/3027927929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df96dd0 msgr2=0x55b02df971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c79036740 1 --2- 172.21.15.110:0/3027927929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df96dd0 0x55b02df971b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009390 tx=0x7f6c680093c0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c6f400640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6c540a3e40 0x7f6c540a6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55b02df98370 tx=0x7f6c600d46b0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c79036740 1 -- 172.21.15.110:0/3027927929 shutdown_connections 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c79036740 1 --2- 172.21.15.110:0/3027927929 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 0x55b02dfa43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c79036740 1 --2- 172.21.15.110:0/3027927929 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df976f0 0x55b02dfa1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c79036740 1 --2- 172.21.15.110:0/3027927929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df96dd0 0x55b02df971b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c79036740 1 -- 172.21.15.110:0/3027927929 >> 172.21.15.110:0/3027927929 conn(0x55b02df932e0 msgr2=0x55b02df936c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c79036740 1 -- 172.21.15.110:0/3027927929 shutdown_connections 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.508+0000 7f6c79036740 1 -- 172.21.15.110:0/3027927929 wait complete. 2024-04-26T11:34:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.509+0000 7f6c79036740 1 -- start start 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.509+0000 7f6c79036740 1 Processor -- start 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.509+0000 7f6c79036740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02df9ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.509+0000 7f6c79036740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02df9f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.509+0000 7f6c79036740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02df9f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.509+0000 7f6c79036740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b02dfa4b80 con 0x55b02dfa1fb0 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.509+0000 7f6c79036740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b02de83c60 con 0x55b02df96dd0 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.509+0000 7f6c79036740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b02dfa4d00 con 0x55b02df976f0 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.509+0000 7f6c79036740 10 client.0 _ll_register_callbacks cb 0x55b02deafe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02df9f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02df9f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02df9ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02df9f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:56506/0 (socket says 172.21.15.110:56506) 2024-04-26T11:34:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6ea00640 1 -- 172.21.15.110:0/1855799653 learned_addr learned my addr 172.21.15.110:0/1855799653 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6fe00640 1 -- 172.21.15.110:0/1855799653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 msgr2=0x55b02df9f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02df9f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6fe00640 1 -- 172.21.15.110:0/1855799653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 msgr2=0x55b02df9f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02df9f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6fe00640 1 -- 172.21.15.110:0/1855799653 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02de92510 con 0x55b02df96dd0 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.510+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02df9f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.511+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02df9ef00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009bf0 tx=0x7f6c6802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1eb53fada0381d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.511+0000 7f6c58c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.511+0000 7f6c58c00640 1 -- 172.21.15.110:0/1855799653 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6804a040 con 0x55b02df96dd0 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.511+0000 7f6c79036740 1 -- 172.21.15.110:0/1855799653 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c68036040 con 0x55b02df96dd0 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.511+0000 7f6c58c00640 1 -- 172.21.15.110:0/1855799653 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6c68031ae0 con 0x55b02df96dd0 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.511+0000 7f6c58c00640 1 -- 172.21.15.110:0/1855799653 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6c68031ce0 con 0x55b02df96dd0 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.511+0000 7f6c79036740 10 client.25595 fetch_fsmap learned FSMap version 32 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.511+0000 7f6c79036740 1 -- 172.21.15.110:0/1855799653 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b02dc0e210 con 0x55b02df96dd0 2024-04-26T11:34:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.511+0000 7f6c58c00640 1 -- 172.21.15.110:0/1855799653 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c68036040 con 0x55b02df96dd0 2024-04-26T11:34:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.512+0000 7f6c58c00640 1 -- 172.21.15.110:0/1855799653 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f6c68004410 con 0x55b02df96dd0 2024-04-26T11:34:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.512+0000 7f6c79036740 10 client.25595 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T11:34:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.512+0000 7f6c79036740 10 client.25595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:34:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.512+0000 7f6c79036740 20 client.25595 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.512+0000 7f6c79036740 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02dfb1b60 0x55b02dfb3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.512+0000 7f6c79036740 4 client.25595 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:34:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.512+0000 7f6c79036740 1 -- 172.21.15.110:0/1855799653 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b02df09f90 con 0x55b02dfb1b60 2024-04-26T11:34:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.512+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02dfb1b60 0x55b02dfb3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.513+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02dfb1b60 0x55b02dfb3f50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5220da7f8d4fc232 server_cookie=9975c9f722687100 in_seq=0 out_seq=0 2024-04-26T11:34:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.513+0000 7f6c58c00640 10 client.25595 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.513+0000 7f6c58c00640 1 -- 172.21.15.110:0/1855799653 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b02df09f90 con 0x55b02dfb1b60 2024-04-26T11:34:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.513+0000 7f6c58c00640 10 client.25595 handle_command_reply: tid=0 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 client.25595 shutdown 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 -- 172.21.15.110:0/1855799653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 msgr2=0x55b02df9ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02df9ef00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009bf0 tx=0x7f6c6802a8c0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 -- 172.21.15.110:0/1855799653 shutdown_connections 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02df9f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02dfb1b60 0x55b02dfb3f50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02df9f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 --2- 172.21.15.110:0/1855799653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02df9ef00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c58c00640 0 client.25595 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 -- 172.21.15.110:0/1855799653 >> 172.21.15.110:0/1855799653 conn(0x55b02df932e0 msgr2=0x55b02df99060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 -- 172.21.15.110:0/1855799653 shutdown_connections 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 1 -- 172.21.15.110:0/1855799653 wait complete. 2024-04-26T11:34:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.514+0000 7f6c79036740 20 client.25595 trim_cache size 0 max 16384 2024-04-26T11:34:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.530+0000 7f6c79036740 1 Processor -- start 2024-04-26T11:34:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c79036740 1 -- start start 2024-04-26T11:34:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c79036740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02dfa1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c79036740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df976f0 0x55b02dfada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c79036740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 0x55b02df92440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c79036740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701b3200 con 0x55b02df976f0 2024-04-26T11:34:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c79036740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701b0a40 con 0x55b02df96dd0 2024-04-26T11:34:52.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c79036740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701ae890 con 0x55b02dfa1fb0 2024-04-26T11:34:52.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c6ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df976f0 0x55b02dfada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02dfa1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c6ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df976f0 0x55b02dfada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47086/0 (socket says 172.21.15.110:47086) 2024-04-26T11:34:52.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c6ea00640 1 -- 172.21.15.110:0/1691652116 learned_addr learned my addr 172.21.15.110:0/1691652116 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.531+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/1691652116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 0x55b02df92440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.532+0000 7f6c6ea00640 1 -- 172.21.15.110:0/1691652116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 msgr2=0x55b02df92440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.532+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/1691652116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 0x55b02df92440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.532+0000 7f6c6ea00640 1 -- 172.21.15.110:0/1691652116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 msgr2=0x55b02dfa1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.532+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/1691652116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02dfa1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.532+0000 7f6c6ea00640 1 -- 172.21.15.110:0/1691652116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02dcda620 con 0x55b02df976f0 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.532+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/1691652116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df976f0 0x55b02dfada70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55b02dfb44f0 tx=0x7f6c5c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec191df319b535f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.532+0000 7f6c5b400640 1 -- 172.21.15.110:0/1691652116 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c027070 con 0x55b02df976f0 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.532+0000 7f6c5b400640 1 -- 172.21.15.110:0/1691652116 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c5c004230 con 0x55b02df976f0 2024-04-26T11:34:52.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.532+0000 7f6c5b400640 1 -- 172.21.15.110:0/1691652116 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c003e60 con 0x55b02df976f0 2024-04-26T11:34:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.533+0000 7f6c79036740 1 -- 172.21.15.110:0/1691652116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df976f0 msgr2=0x55b02dfada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.533+0000 7f6c79036740 1 --2- 172.21.15.110:0/1691652116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df976f0 0x55b02dfada70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55b02dfb44f0 tx=0x7f6c5c005f90 comp rx=0 tx=0).stop 2024-04-26T11:34:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.533+0000 7f6c79036740 1 -- 172.21.15.110:0/1691652116 shutdown_connections 2024-04-26T11:34:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.533+0000 7f6c79036740 1 --2- 172.21.15.110:0/1691652116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02dfa1fb0 0x55b02df92440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.533+0000 7f6c79036740 1 --2- 172.21.15.110:0/1691652116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02df976f0 0x55b02dfada70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.533+0000 7f6c79036740 1 --2- 172.21.15.110:0/1691652116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02dfa1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.533+0000 7f6c79036740 1 -- 172.21.15.110:0/1691652116 >> 172.21.15.110:0/1691652116 conn(0x55b02df932e0 msgr2=0x55b02df9d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.533+0000 7f6c79036740 1 -- 172.21.15.110:0/1691652116 shutdown_connections 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.533+0000 7f6c79036740 1 -- 172.21.15.110:0/1691652116 wait complete. 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.534+0000 7f6c79036740 1 -- start start 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.534+0000 7f6c79036740 1 Processor -- start 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.534+0000 7f6c79036740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02dfa5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.534+0000 7f6c79036740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02dfa56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.534+0000 7f6c79036740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02e015db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.534+0000 7f6c79036740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701aef00 con 0x55b02dfa1fb0 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.534+0000 7f6c79036740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701b0370 con 0x55b02df96dd0 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.534+0000 7f6c79036740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701af5d0 con 0x55b02df976f0 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.534+0000 7f6c79036740 10 client.0 _ll_register_callbacks cb 0x7f6c600d4580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02e015db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02e015db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47096/0 (socket says 172.21.15.110:47096) 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 -- 172.21.15.110:0/4000445227 learned_addr learned my addr 172.21.15.110:0/4000445227 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02dfa56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02dfa5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 -- 172.21.15.110:0/4000445227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 msgr2=0x55b02dfa56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02dfa56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 -- 172.21.15.110:0/4000445227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 msgr2=0x55b02dfa5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02dfa5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 -- 172.21.15.110:0/4000445227 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02deb6cb0 con 0x55b02dfa1fb0 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c6fe00640 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02e015db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6c68004850 tx=0x7f6c68009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9277b8eb9e7d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.535+0000 7f6c58c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c58c00640 1 -- 172.21.15.110:0/4000445227 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68005c30 con 0x55b02dfa1fb0 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c58c00640 1 -- 172.21.15.110:0/4000445227 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6c68004200 con 0x55b02dfa1fb0 2024-04-26T11:34:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c79036740 1 -- 172.21.15.110:0/4000445227 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c5c004230 con 0x55b02dfa1fb0 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c58c00640 1 -- 172.21.15.110:0/4000445227 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6c68004400 con 0x55b02dfa1fb0 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c79036740 10 client.15456 fetch_fsmap learned FSMap version 32 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c79036740 1 -- 172.21.15.110:0/4000445227 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b02e017500 con 0x55b02dfa1fb0 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c58c00640 1 -- 172.21.15.110:0/4000445227 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c5c004230 con 0x55b02dfa1fb0 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c58c00640 1 -- 172.21.15.110:0/4000445227 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 32) ==== 8358+0+0 (secure 0 0 0) 0x7f6c6806d070 con 0x55b02dfa1fb0 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c79036740 10 client.15456 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c79036740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c79036740 20 client.15456 populate_metadata read hostname 'smithi110' 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.536+0000 7f6c79036740 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02e017ae0 0x55b02e019f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.537+0000 7f6c79036740 4 client.15456 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:34:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.537+0000 7f6c79036740 1 -- 172.21.15.110:0/4000445227 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b02df03e00 con 0x55b02e017ae0 2024-04-26T11:34:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.537+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02e017ae0 0x55b02e019f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:34:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.537+0000 7f6c6ea00640 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02e017ae0 0x55b02e019f00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfc2cad95c1f6562 server_cookie=2eee66e00f8f1030 in_seq=0 out_seq=0 2024-04-26T11:34:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.537+0000 7f6c58c00640 10 client.15456 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c58c00640 1 -- 172.21.15.110:0/4000445227 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b02df03e00 con 0x55b02e017ae0 2024-04-26T11:34:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c58c00640 10 client.15456 handle_command_reply: tid=0 2024-04-26T11:34:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c79036740 1 client.15456 shutdown 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c79036740 1 -- 172.21.15.110:0/4000445227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 msgr2=0x55b02e015db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c79036740 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02e015db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6c68004850 tx=0x7f6c68009360 comp rx=0 tx=0).stop 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c79036740 1 -- 172.21.15.110:0/4000445227 shutdown_connections 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c79036740 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02dfa1fb0 0x55b02e015db0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c79036740 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02e017ae0 0x55b02e019f00 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c79036740 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02df976f0 0x55b02dfa56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c79036740 1 --2- 172.21.15.110:0/4000445227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02df96dd0 0x55b02dfa5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c79036740 1 -- 172.21.15.110:0/4000445227 >> 172.21.15.110:0/4000445227 conn(0x55b02df932e0 msgr2=0x55b02df9df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.550+0000 7f6c58c00640 0 client.15456 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:34:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.551+0000 7f6c79036740 1 -- 172.21.15.110:0/4000445227 shutdown_connections 2024-04-26T11:34:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.551+0000 7f6c79036740 1 -- 172.21.15.110:0/4000445227 wait complete. 2024-04-26T11:34:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.551+0000 7f6c79036740 20 client.15456 trim_cache size 0 max 16384 2024-04-26T11:34:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:34:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:34:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:34:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:34:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 -- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6c540a3e40 msgr2=0x7f6c540a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6c540a3e40 0x7f6c540a6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55b02df98370 tx=0x7f6c600d46b0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 -- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70104b40 msgr2=0x7f6c7019b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:34:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70104b40 0x7f6c7019b1d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000e9f0 tx=0x7f6c6000eeb0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 -- 172.21.15.110:0/412746541 shutdown_connections 2024-04-26T11:34:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f6c540a3e40 0x7f6c540a6300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c7010ac00 0x7f6c7019fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c70105500 0x7f6c7019b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 --2- 172.21.15.110:0/412746541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c70104b40 0x7f6c7019b1d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:34:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 -- 172.21.15.110:0/412746541 >> 172.21.15.110:0/412746541 conn(0x7f6c70100630 msgr2=0x7f6c70101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:34:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 -- 172.21.15.110:0/412746541 shutdown_connections 2024-04-26T11:34:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:34:52.552+0000 7f6c76200640 1 -- 172.21.15.110:0/412746541 wait complete. 2024-04-26T11:34:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:53 smithi196 ceph-mon[32572]: pgmap v111: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 583 op/s 2024-04-26T11:34:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:53 smithi110 ceph-mon[28069]: pgmap v111: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 583 op/s 2024-04-26T11:34:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:53 smithi193 ceph-mon[32782]: pgmap v111: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 583 op/s 2024-04-26T11:34:54.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 160.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:34:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:55 smithi196 ceph-mon[32572]: pgmap v112: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.6 MiB/s wr, 551 op/s 2024-04-26T11:34:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:55 smithi110 ceph-mon[28069]: pgmap v112: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.6 MiB/s wr, 551 op/s 2024-04-26T11:34:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:55 smithi193 ceph-mon[32782]: pgmap v112: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.6 MiB/s wr, 551 op/s 2024-04-26T11:34:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:57 smithi196 ceph-mon[32572]: pgmap v113: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.8 MiB/s wr, 267 op/s 2024-04-26T11:34:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:57 smithi110 ceph-mon[28069]: pgmap v113: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.8 MiB/s wr, 267 op/s 2024-04-26T11:34:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:57 smithi193 ceph-mon[32782]: pgmap v113: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.8 MiB/s wr, 267 op/s 2024-04-26T11:34:59.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 165.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:35:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:34:59 smithi196 ceph-mon[32572]: pgmap v114: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-04-26T11:35:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:34:59 smithi110 ceph-mon[28069]: pgmap v114: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-04-26T11:35:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:34:59 smithi193 ceph-mon[32782]: pgmap v114: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-04-26T11:35:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:01 smithi196 ceph-mon[32572]: pgmap v115: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-04-26T11:35:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:01 smithi110 ceph-mon[28069]: pgmap v115: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-04-26T11:35:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:01 smithi193 ceph-mon[32782]: pgmap v115: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-04-26T11:35:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:02 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:35:03.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:02 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:35:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:02 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:35:03.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:35:03.707 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:35:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:03 smithi196 ceph-mon[32572]: pgmap v116: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-04-26T11:35:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:03 smithi110 ceph-mon[28069]: pgmap v116: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-04-26T11:35:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:03 smithi193 ceph-mon[32782]: pgmap v116: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-04-26T11:35:04.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 170.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:35:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.695+0000 7f54a5e00640 1 -- 172.21.15.110:0/3689689973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54a0109190 msgr2=0x7f54a0109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.695+0000 7f54a5e00640 1 --2- 172.21.15.110:0/3689689973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54a0109190 0x7f54a0109570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5490009900 tx=0x7f549002a3f0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.695+0000 7f54a5e00640 1 -- 172.21.15.110:0/3689689973 shutdown_connections 2024-04-26T11:35:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.695+0000 7f54a5e00640 1 --2- 172.21.15.110:0/3689689973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a010e260 0x7f54a0115e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.695+0000 7f54a5e00640 1 --2- 172.21.15.110:0/3689689973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a0109b40 0x7f54a010db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.695+0000 7f54a5e00640 1 --2- 172.21.15.110:0/3689689973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54a0109190 0x7f54a0109570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.695+0000 7f54a5e00640 1 -- 172.21.15.110:0/3689689973 >> 172.21.15.110:0/3689689973 conn(0x7f54a0076ec0 msgr2=0x7f54a00792e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.695+0000 7f54a5e00640 1 -- 172.21.15.110:0/3689689973 shutdown_connections 2024-04-26T11:35:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.695+0000 7f54a5e00640 1 -- 172.21.15.110:0/3689689973 wait complete. 2024-04-26T11:35:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.696+0000 7f54a5e00640 1 Processor -- start 2024-04-26T11:35:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.696+0000 7f54a5e00640 1 -- start start 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f54a5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0109190 0x7f54a019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f54a5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a010e260 0x7f54a019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f54a5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54a01a3f60 0x7f54a01a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f54a5e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f54a0119210 con 0x7f54a0109190 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f54a5e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f54a0119090 con 0x7f54a01a3f60 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f54a5e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f54a0119390 con 0x7f54a010e260 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0109190 0x7f54a019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0109190 0x7f54a019f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54558/0 (socket says 172.21.15.110:54558) 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54a01a3f60 0x7f54a01a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549ea00640 1 -- 172.21.15.110:0/2788111185 learned_addr learned my addr 172.21.15.110:0/2788111185 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549e000640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a010e260 0x7f54a019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549f400640 1 -- 172.21.15.110:0/2788111185 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a010e260 msgr2=0x7f54a019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549f400640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a010e260 0x7f54a019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549f400640 1 -- 172.21.15.110:0/2788111185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0109190 msgr2=0x7f54a019f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549f400640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0109190 0x7f54a019f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.697+0000 7f549f400640 1 -- 172.21.15.110:0/2788111185 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a01a4a50 con 0x7f54a01a3f60 2024-04-26T11:35:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.698+0000 7f549f400640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54a01a3f60 0x7f54a01a4410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5498009fd0 tx=0x7f549800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.698+0000 7f54a4a00640 1 -- 172.21.15.110:0/2788111185 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549800ce20 con 0x7f54a01a3f60 2024-04-26T11:35:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.698+0000 7f54a4a00640 1 -- 172.21.15.110:0/2788111185 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5498005020 con 0x7f54a01a3f60 2024-04-26T11:35:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.698+0000 7f54a4a00640 1 -- 172.21.15.110:0/2788111185 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5498010690 con 0x7f54a01a3f60 2024-04-26T11:35:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.698+0000 7f54a5e00640 1 -- 172.21.15.110:0/2788111185 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a01a4d40 con 0x7f54a01a3f60 2024-04-26T11:35:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.698+0000 7f54a5e00640 1 -- 172.21.15.110:0/2788111185 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a01ac4e0 con 0x7f54a01a3f60 2024-04-26T11:35:05.703 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.701+0000 7f54a8b97740 1 Processor -- start 2024-04-26T11:35:05.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.702+0000 7f54a4a00640 1 -- 172.21.15.110:0/2788111185 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f54980054d0 con 0x7f54a01a3f60 2024-04-26T11:35:05.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.702+0000 7f54a8b97740 1 -- start start 2024-04-26T11:35:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.702+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561c9ff71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.702+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561ca001a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.702+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561ca0043a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.702+0000 7f54a8b97740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5561c9f5c380 con 0x5561c9ff76f0 2024-04-26T11:35:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.702+0000 7f54a8b97740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5561c9ef8c30 con 0x5561ca001fb0 2024-04-26T11:35:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.702+0000 7f54a8b97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5561c9f58340 con 0x5561c9ff6dd0 2024-04-26T11:35:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561ca001a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561ca001a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54570/0 (socket says 172.21.15.110:54570) 2024-04-26T11:35:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549ea00640 1 -- 172.21.15.110:0/4087530448 learned_addr learned my addr 172.21.15.110:0/4087530448 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549e000640 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561ca0043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549e000640 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561c9ff71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549ea00640 1 -- 172.21.15.110:0/4087530448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 msgr2=0x5561c9ff71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549ea00640 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561c9ff71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549ea00640 1 -- 172.21.15.110:0/4087530448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 msgr2=0x5561ca0043a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549ea00640 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561ca0043a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549ea00640 1 -- 172.21.15.110:0/4087530448 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c9f1a940 con 0x5561c9ff76f0 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f549e000640 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561ca0043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.703+0000 7f54a4a00640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f54840a3e40 0x7f54840a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.704+0000 7f549ea00640 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561ca001a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5490006010 tx=0x7f5490005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf2c43f449c05cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.704+0000 7f54a4a00640 1 -- 172.21.15.110:0/2788111185 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f54980d0ed0 con 0x7f54a01a3f60 2024-04-26T11:35:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.704+0000 7f549e000640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f54840a3e40 0x7f54840a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.704+0000 7f548fe00640 1 -- 172.21.15.110:0/4087530448 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490040070 con 0x5561c9ff76f0 2024-04-26T11:35:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.704+0000 7f548fe00640 1 -- 172.21.15.110:0/4087530448 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54900054d0 con 0x5561c9ff76f0 2024-04-26T11:35:05.708 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.704+0000 7f548fe00640 1 -- 172.21.15.110:0/4087530448 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490035040 con 0x5561c9ff76f0 2024-04-26T11:35:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 -- 172.21.15.110:0/4087530448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 msgr2=0x5561ca001a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561ca001a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5490006010 tx=0x7f5490005c00 comp rx=0 tx=0).stop 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f549e000640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f54840a3e40 0x7f54840a6300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5561c9ff4700 tx=0x7f5488004730 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 -- 172.21.15.110:0/4087530448 shutdown_connections 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561ca0043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561ca001a70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 --2- 172.21.15.110:0/4087530448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561c9ff71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 -- 172.21.15.110:0/4087530448 >> 172.21.15.110:0/4087530448 conn(0x5561c9ff32e0 msgr2=0x5561c9ff36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 -- 172.21.15.110:0/4087530448 shutdown_connections 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 -- 172.21.15.110:0/4087530448 wait complete. 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.705+0000 7f54a8b97740 1 -- start start 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f54a8b97740 1 Processor -- start 2024-04-26T11:35:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561c9ffee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff76f0 0x5561c9fff3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561c9fff910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f54a8b97740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5561ca004b80 con 0x5561ca001fb0 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f54a8b97740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5561c9ee3c60 con 0x5561c9ff76f0 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f54a8b97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5561ca004d00 con 0x5561c9ff6dd0 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f54a8b97740 10 client.0 _ll_register_callbacks cb 0x5561c9f0fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f549f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561c9fff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f549f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561c9fff910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54586/0 (socket says 172.21.15.110:54586) 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.706+0000 7f549f400640 1 -- 172.21.15.110:0/1308712141 learned_addr learned my addr 172.21.15.110:0/1308712141 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f549ea00640 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561c9ffee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f549e000640 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff76f0 0x5561c9fff3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f549f400640 1 -- 172.21.15.110:0/1308712141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 msgr2=0x5561c9ffee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f549f400640 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561c9ffee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f549f400640 1 -- 172.21.15.110:0/1308712141 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff76f0 msgr2=0x5561c9fff3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f549f400640 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff76f0 0x5561c9fff3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f549f400640 1 -- 172.21.15.110:0/1308712141 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561c9ef2510 con 0x5561ca001fb0 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f549e000640 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff76f0 0x5561c9fff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f549f400640 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561c9fff910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f54980a54d0 tx=0x7f549809ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6129d6547ec6ddd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f548cc00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f548cc00640 1 -- 172.21.15.110:0/1308712141 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54980a5570 con 0x5561ca001fb0 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f548cc00640 1 -- 172.21.15.110:0/1308712141 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f54980a5710 con 0x5561ca001fb0 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.707+0000 7f54a8b97740 1 -- 172.21.15.110:0/1308712141 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54900054d0 con 0x5561ca001fb0 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f548cc00640 1 -- 172.21.15.110:0/1308712141 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f54980b6200 con 0x5561ca001fb0 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f54a8b97740 10 client.15468 fetch_fsmap learned FSMap version 33 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f54a8b97740 1 -- 172.21.15.110:0/1308712141 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5561c9c6e210 con 0x5561ca001fb0 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f548cc00640 1 -- 172.21.15.110:0/1308712141 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54900054d0 con 0x5561ca001fb0 2024-04-26T11:35:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f548cc00640 1 -- 172.21.15.110:0/1308712141 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7f54980bd070 con 0x5561ca001fb0 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f54a8b97740 10 client.15468 fetch_fsmap finished waiting for FSMap version 33 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f54a8b97740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f54a8b97740 20 client.15468 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5561ca011ce0 0x5561ca014110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f54a8b97740 4 client.15468 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.708+0000 7f54a8b97740 1 -- 172.21.15.110:0/1308712141 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561c9f69f90 con 0x5561ca011ce0 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.709+0000 7f549ea00640 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5561ca011ce0 0x5561ca014110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.709+0000 7f549ea00640 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5561ca011ce0 0x5561ca014110 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad4eed907c645c3b server_cookie=3818618cb0f91d4 in_seq=0 out_seq=0 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.709+0000 7f548cc00640 10 client.15468 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.710+0000 7f548cc00640 1 -- 172.21.15.110:0/1308712141 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5561c9f69f90 con 0x5561ca011ce0 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.710+0000 7f548cc00640 10 client.15468 handle_command_reply: tid=0 2024-04-26T11:35:05.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.710+0000 7f54a8b97740 1 client.15468 shutdown 2024-04-26T11:35:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.711+0000 7f54a8b97740 1 -- 172.21.15.110:0/1308712141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 msgr2=0x5561c9fff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.711+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561c9fff910 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f54980a54d0 tx=0x7f549809ce50 comp rx=0 tx=0).stop 2024-04-26T11:35:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.711+0000 7f54a8b97740 1 -- 172.21.15.110:0/1308712141 shutdown_connections 2024-04-26T11:35:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.711+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561c9fff910 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.711+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff76f0 0x5561c9fff3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.711+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5561ca011ce0 0x5561ca014110 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.711+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1308712141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561c9ffee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.711+0000 7f54a8b97740 1 -- 172.21.15.110:0/1308712141 >> 172.21.15.110:0/1308712141 conn(0x5561c9ff32e0 msgr2=0x5561c9ff9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.711+0000 7f548cc00640 0 client.15468 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.712+0000 7f54a8b97740 1 -- 172.21.15.110:0/1308712141 shutdown_connections 2024-04-26T11:35:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.712+0000 7f54a8b97740 1 -- 172.21.15.110:0/1308712141 wait complete. 2024-04-26T11:35:05.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.712+0000 7f54a8b97740 20 client.15468 trim_cache size 0 max 16384 2024-04-26T11:35:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.732+0000 7f54a8b97740 1 Processor -- start 2024-04-26T11:35:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.732+0000 7f54a8b97740 1 -- start start 2024-04-26T11:35:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.732+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561ca00da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.732+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561c9ff9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.732+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561c9ff22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.732+0000 7f54a8b97740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f54a01b7670 con 0x5561c9ff76f0 2024-04-26T11:35:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.732+0000 7f54a8b97740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f54a01b4eb0 con 0x5561ca001fb0 2024-04-26T11:35:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.732+0000 7f54a8b97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f54a01b2d00 con 0x5561c9ff6dd0 2024-04-26T11:35:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561c9ff22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561c9ff22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54358/0 (socket says 172.21.15.110:54358) 2024-04-26T11:35:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549f400640 1 -- 172.21.15.110:0/1442291905 learned_addr learned my addr 172.21.15.110:0/1442291905 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549ea00640 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561ca00da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549e000640 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561c9ff9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549ea00640 1 -- 172.21.15.110:0/1442291905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 msgr2=0x5561c9ff22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549ea00640 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561c9ff22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549ea00640 1 -- 172.21.15.110:0/1442291905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 msgr2=0x5561c9ff9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549ea00640 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561c9ff9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549ea00640 1 -- 172.21.15.110:0/1442291905 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c9d3a620 con 0x5561c9ff6dd0 2024-04-26T11:35:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.733+0000 7f549e000640 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561c9ff9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.734+0000 7f549ea00640 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561ca00da40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f549002a9e0 tx=0x7f549002a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d927962d874e20e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.734+0000 7f548f400640 1 -- 172.21.15.110:0/1442291905 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490040040 con 0x5561c9ff6dd0 2024-04-26T11:35:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.734+0000 7f548f400640 1 -- 172.21.15.110:0/1442291905 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54900049a0 con 0x5561c9ff6dd0 2024-04-26T11:35:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.734+0000 7f548f400640 1 -- 172.21.15.110:0/1442291905 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490035040 con 0x5561c9ff6dd0 2024-04-26T11:35:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 -- 172.21.15.110:0/1442291905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 msgr2=0x5561ca00da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561ca00da40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f549002a9e0 tx=0x7f549002a3f0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 -- 172.21.15.110:0/1442291905 shutdown_connections 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561ca001fb0 0x5561c9ff22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561c9ff76f0 0x5561c9ff9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 --2- 172.21.15.110:0/1442291905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff6dd0 0x5561ca00da40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 -- 172.21.15.110:0/1442291905 >> 172.21.15.110:0/1442291905 conn(0x5561c9ff32e0 msgr2=0x5561c9ff1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 -- 172.21.15.110:0/1442291905 shutdown_connections 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 -- 172.21.15.110:0/1442291905 wait complete. 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 -- start start 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.735+0000 7f54a8b97740 1 Processor -- start 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff6dd0 0x5561ca00a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff76f0 0x5561ca005700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f54a8b97740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561ca005c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f54a8b97740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f54a01b3370 con 0x5561ca001fb0 2024-04-26T11:35:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f54a8b97740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f54a01b47e0 con 0x5561c9ff6dd0 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f54a8b97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f54a01b3a40 con 0x5561c9ff76f0 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f54a8b97740 10 client.0 _ll_register_callbacks cb 0x7f549809d490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f549f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561ca005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f549f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561ca005c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54604/0 (socket says 172.21.15.110:54604) 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f549f400640 1 -- 172.21.15.110:0/2143916142 learned_addr learned my addr 172.21.15.110:0/2143916142 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f549ea00640 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff6dd0 0x5561ca00a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.736+0000 7f549e000640 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff76f0 0x5561ca005700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f549f400640 1 -- 172.21.15.110:0/2143916142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff76f0 msgr2=0x5561ca005700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f549f400640 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff76f0 0x5561ca005700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f549f400640 1 -- 172.21.15.110:0/2143916142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff6dd0 msgr2=0x5561ca00a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f549f400640 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff6dd0 0x5561ca00a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f549f400640 1 -- 172.21.15.110:0/2143916142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561c9f16cb0 con 0x5561ca001fb0 2024-04-26T11:35:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f549f400640 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561ca005c60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f54980a1300 tx=0x7f5498005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce2c712c56d584f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f548cc00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f548cc00640 1 -- 172.21.15.110:0/2143916142 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549807f070 con 0x5561ca001fb0 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f548cc00640 1 -- 172.21.15.110:0/2143916142 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f54980a5770 con 0x5561ca001fb0 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f54a8b97740 1 -- 172.21.15.110:0/2143916142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54900049a0 con 0x5561ca001fb0 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f548cc00640 1 -- 172.21.15.110:0/2143916142 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f549809cb60 con 0x5561ca001fb0 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f54a8b97740 10 client.15474 fetch_fsmap learned FSMap version 33 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.737+0000 7f54a8b97740 1 -- 172.21.15.110:0/2143916142 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5561ca0781b0 con 0x5561ca001fb0 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.738+0000 7f548cc00640 1 -- 172.21.15.110:0/2143916142 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54900049a0 con 0x5561ca001fb0 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.738+0000 7f548cc00640 1 -- 172.21.15.110:0/2143916142 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7f5498082020 con 0x5561ca001fb0 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.738+0000 7f54a8b97740 10 client.15474 fetch_fsmap finished waiting for FSMap version 33 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.738+0000 7f54a8b97740 10 client.15474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.738+0000 7f54a8b97740 20 client.15474 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.738+0000 7f54a8b97740 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5561ca078950 0x5561ca07ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.738+0000 7f54a8b97740 4 client.15474 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:35:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.738+0000 7f54a8b97740 1 -- 172.21.15.110:0/2143916142 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5561c9f63e00 con 0x5561ca078950 2024-04-26T11:35:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.739+0000 7f549ea00640 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5561ca078950 0x5561ca07ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.739+0000 7f549ea00640 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5561ca078950 0x5561ca07ad70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f267748f02aa0c5 server_cookie=7d68a3a9cc011606 in_seq=0 out_seq=0 2024-04-26T11:35:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.739+0000 7f548cc00640 10 client.15474 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f548cc00640 1 -- 172.21.15.110:0/2143916142 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5561c9f63e00 con 0x5561ca078950 2024-04-26T11:35:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f548cc00640 10 client.15474 handle_command_reply: tid=0 2024-04-26T11:35:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 client.15474 shutdown 2024-04-26T11:35:05.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 -- 172.21.15.110:0/2143916142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 msgr2=0x5561ca005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561ca005c60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f54980a1300 tx=0x7f5498005be0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 -- 172.21.15.110:0/2143916142 shutdown_connections 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561ca001fb0 0x5561ca005c60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5561ca078950 0x5561ca07ad70 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5561c9ff76f0 0x5561ca005700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 --2- 172.21.15.110:0/2143916142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561c9ff6dd0 0x5561ca00a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f548cc00640 0 client.15474 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 -- 172.21.15.110:0/2143916142 >> 172.21.15.110:0/2143916142 conn(0x5561c9ff32e0 msgr2=0x5561c9ff2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 -- 172.21.15.110:0/2143916142 shutdown_connections 2024-04-26T11:35:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 1 -- 172.21.15.110:0/2143916142 wait complete. 2024-04-26T11:35:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.751+0000 7f54a8b97740 20 client.15474 trim_cache size 0 max 16384 2024-04-26T11:35:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:35:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:35:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:35:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:35:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 -- 172.21.15.110:0/2788111185 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f54840a3e40 msgr2=0x7f54840a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f54840a3e40 0x7f54840a6300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5561c9ff4700 tx=0x7f5488004730 comp rx=0 tx=0).stop 2024-04-26T11:35:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 -- 172.21.15.110:0/2788111185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54a01a3f60 msgr2=0x7f54a01a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54a01a3f60 0x7f54a01a4410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5498009fd0 tx=0x7f549800ef10 comp rx=0 tx=0).stop 2024-04-26T11:35:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 -- 172.21.15.110:0/2788111185 shutdown_connections 2024-04-26T11:35:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f54840a3e40 0x7f54840a6300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54a01a3f60 0x7f54a01a4410 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a010e260 0x7f54a019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 --2- 172.21.15.110:0/2788111185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a0109190 0x7f54a019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 -- 172.21.15.110:0/2788111185 >> 172.21.15.110:0/2788111185 conn(0x7f54a0076ec0 msgr2=0x7f54a0077a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 -- 172.21.15.110:0/2788111185 shutdown_connections 2024-04-26T11:35:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:05.752+0000 7f54a5e00640 1 -- 172.21.15.110:0/2788111185 wait complete. 2024-04-26T11:35:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:05 smithi110 ceph-mon[28069]: pgmap v117: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-26T11:35:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:05 smithi196 ceph-mon[32572]: pgmap v117: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-26T11:35:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:05 smithi193 ceph-mon[32782]: pgmap v117: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-26T11:35:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.338+0000 7faa11800700 1 -- 172.21.15.110:0/1854743004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa0c1094a0 msgr2=0x7faa0c109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.338+0000 7faa11800700 1 --2- 172.21.15.110:0/1854743004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa0c1094a0 0x7faa0c109880 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00b0a0 tx=0x7fa9fc00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.338+0000 7faa11800700 1 -- 172.21.15.110:0/1854743004 shutdown_connections 2024-04-26T11:35:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.338+0000 7faa11800700 1 --2- 172.21.15.110:0/1854743004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa0c06bad0 0x7faa0c1102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.338+0000 7faa11800700 1 --2- 172.21.15.110:0/1854743004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa0c1094a0 0x7faa0c109880 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.338+0000 7faa11800700 1 --2- 172.21.15.110:0/1854743004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa0c06b130 0x7faa0c06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.338+0000 7faa11800700 1 -- 172.21.15.110:0/1854743004 >> 172.21.15.110:0/1854743004 conn(0x7faa0c0792d0 msgr2=0x7faa0c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.339+0000 7faa11800700 1 -- 172.21.15.110:0/1854743004 shutdown_connections 2024-04-26T11:35:06.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.339+0000 7faa11800700 1 -- 172.21.15.110:0/1854743004 wait complete. 2024-04-26T11:35:06.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.340+0000 7faa11800700 1 Processor -- start 2024-04-26T11:35:06.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.340+0000 7faa11800700 1 -- start start 2024-04-26T11:35:06.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.340+0000 7faa11800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa0c06b130 0x7faa0c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:06.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.340+0000 7faa11800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa0c06bad0 0x7faa0c19c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:06.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.340+0000 7faa11800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa0c1094a0 0x7faa0c1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:06.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.340+0000 7faa11800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c113600 con 0x7faa0c06bad0 2024-04-26T11:35:06.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.340+0000 7faa11800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c113480 con 0x7faa0c06b130 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.340+0000 7faa11800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c113780 con 0x7faa0c1094a0 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa0aa00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa0c06b130 0x7faa0c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa02000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa0c06bad0 0x7faa0c19c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa0aa00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa0c06b130 0x7faa0c19bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54372/0 (socket says 172.21.15.110:54372) 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa0aa00700 1 -- 172.21.15.110:0/1176669197 learned_addr learned my addr 172.21.15.110:0/1176669197 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa0b400700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa0c1094a0 0x7faa0c1a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa0aa00700 1 -- 172.21.15.110:0/1176669197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa0c1094a0 msgr2=0x7faa0c1a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa0aa00700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa0c1094a0 0x7faa0c1a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa0aa00700 1 -- 172.21.15.110:0/1176669197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa0c06bad0 msgr2=0x7faa0c19c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa0aa00700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa0c06bad0 0x7faa0c19c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.341+0000 7faa0aa00700 1 -- 172.21.15.110:0/1176669197 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c1a0d40 con 0x7faa0c06b130 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.342+0000 7faa0aa00700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa0c06b130 0x7faa0c19bd30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00d010 tx=0x7fa9fc004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.342+0000 7faa03e00700 1 -- 172.21.15.110:0/1176669197 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc021070 con 0x7faa0c06b130 2024-04-26T11:35:06.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.342+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c1a0fd0 con 0x7faa0c06b130 2024-04-26T11:35:06.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.342+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c1a88b0 con 0x7faa0c06b130 2024-04-26T11:35:06.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.342+0000 7faa03e00700 1 -- 172.21.15.110:0/1176669197 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9fc007e30 con 0x7faa0c06b130 2024-04-26T11:35:06.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.342+0000 7faa03e00700 1 -- 172.21.15.110:0/1176669197 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc004430 con 0x7faa0c06b130 2024-04-26T11:35:06.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.344+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c06a110 con 0x7faa0c06b130 2024-04-26T11:35:06.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.345+0000 7faa03e00700 1 -- 172.21.15.110:0/1176669197 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fa9fc003d00 con 0x7faa0c06b130 2024-04-26T11:35:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.347+0000 7faa03e00700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa9f00a3e30 0x7fa9f00a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.347+0000 7faa03e00700 1 -- 172.21.15.110:0/1176669197 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fa9fc0d1510 con 0x7faa0c06b130 2024-04-26T11:35:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.347+0000 7faa02000700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa9f00a3e30 0x7fa9f00a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:06.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.348+0000 7faa02000700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa9f00a3e30 0x7fa9f00a62f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009680 tx=0x7fa9f4009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:06.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.351+0000 7faa03e00700 1 -- 172.21.15.110:0/1176669197 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa9fc02a030 con 0x7faa0c06b130 2024-04-26T11:35:06.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.629+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa0c02e490 con 0x7faa0c06b130 2024-04-26T11:35:06.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.630+0000 7faa03e00700 1 -- 172.21.15.110:0/1176669197 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11894 (secure 0 0 0) 0x7fa9fc09db60 con 0x7faa0c06b130 2024-04-26T11:35:06.633 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:35:06.633 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:35:01.023793+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,24487,24502]},"id":1}]} 2024-04-26T11:35:06.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.633+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa9f00a3e30 msgr2=0x7fa9f00a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:06.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.633+0000 7faa11800700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa9f00a3e30 0x7fa9f00a62f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009680 tx=0x7fa9f4009260 comp rx=0 tx=0).stop 2024-04-26T11:35:06.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.633+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa0c06b130 msgr2=0x7faa0c19bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:06.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.633+0000 7faa11800700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa0c06b130 0x7faa0c19bd30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00d010 tx=0x7fa9fc004d00 comp rx=0 tx=0).stop 2024-04-26T11:35:06.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.634+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 shutdown_connections 2024-04-26T11:35:06.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.634+0000 7faa11800700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa9f00a3e30 0x7fa9f00a62f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.634+0000 7faa11800700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa0c1094a0 0x7faa0c1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.634+0000 7faa11800700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa0c06b130 0x7faa0c19bd30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.634+0000 7faa11800700 1 --2- 172.21.15.110:0/1176669197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa0c06bad0 0x7faa0c19c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:06.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.634+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 >> 172.21.15.110:0/1176669197 conn(0x7faa0c0792d0 msgr2=0x7faa0c10e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:06.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.634+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 shutdown_connections 2024-04-26T11:35:06.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:06.634+0000 7faa11800700 1 -- 172.21.15.110:0/1176669197 wait complete. 2024-04-26T11:35:06.637 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 33 2024-04-26T11:35:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:06 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1176669197' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:35:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:06 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1176669197' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:35:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:06 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1176669197' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:35:07.977 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:07 smithi110 ceph-mon[28069]: pgmap v118: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-04-26T11:35:07.977 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:07 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:35:07.981 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db --set-id 7ef1dec5 --release --await' 2024-04-26T11:35:07.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db --set-id 7ef1dec5 --release --await 2024-04-26T11:35:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:07 smithi196 ceph-mon[32572]: pgmap v118: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-04-26T11:35:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:07 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:35:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:07 smithi193 ceph-mon[32782]: pgmap v118: 97 pgs: 97 active+clean; 1.6 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-04-26T11:35:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:07 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:35:08.435 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:35:09.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 175.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:35:09.979 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:09 smithi110 ceph-mon[28069]: pgmap v119: 97 pgs: 97 active+clean; 1.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.9 MiB/s wr, 94 op/s 2024-04-26T11:35:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:09 smithi196 ceph-mon[32572]: pgmap v119: 97 pgs: 97 active+clean; 1.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.9 MiB/s wr, 94 op/s 2024-04-26T11:35:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:09 smithi193 ceph-mon[32782]: pgmap v119: 97 pgs: 97 active+clean; 1.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.9 MiB/s wr, 94 op/s 2024-04-26T11:35:10.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.871+0000 7f1537400700 1 -- 172.21.15.110:0/1041748816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 msgr2=0x7f153010f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:10.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.871+0000 7f1537400700 1 --2- 172.21.15.110:0/1041748816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 0x7f153010f8e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1520009990 tx=0x7f1520009ca0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.871+0000 7f1537400700 1 -- 172.21.15.110:0/1041748816 shutdown_connections 2024-04-26T11:35:10.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.871+0000 7f1537400700 1 --2- 172.21.15.110:0/1041748816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f153010fe20 0x7f1530112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.871+0000 7f1537400700 1 --2- 172.21.15.110:0/1041748816 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1530075650 0x7f1530075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.871+0000 7f1537400700 1 --2- 172.21.15.110:0/1041748816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 0x7f153010f8e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.871+0000 7f1537400700 1 -- 172.21.15.110:0/1041748816 >> 172.21.15.110:0/1041748816 conn(0x7f153007a580 msgr2=0x7f153007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:10.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.871+0000 7f1537400700 1 -- 172.21.15.110:0/1041748816 shutdown_connections 2024-04-26T11:35:10.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.871+0000 7f1537400700 1 -- 172.21.15.110:0/1041748816 wait complete. 2024-04-26T11:35:10.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.872+0000 7f1537400700 1 Processor -- start 2024-04-26T11:35:10.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.872+0000 7f1537400700 1 -- start start 2024-04-26T11:35:10.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1537400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1530075650 0x7f153019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1537400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 0x7f153019c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1537400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f153010fe20 0x7f15301a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1537400700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1530115850 con 0x7f1530075f70 2024-04-26T11:35:10.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1537400700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15301156d0 con 0x7f1530075650 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1537400700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f15301159d0 con 0x7f153010fe20 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1527e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 0x7f153019c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1527e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 0x7f153019c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54648/0 (socket says 172.21.15.110:54648) 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1527e00700 1 -- 172.21.15.110:0/3206533303 learned_addr learned my addr 172.21.15.110:0/3206533303 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1534a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1530075650 0x7f153019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1535400700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f153010fe20 0x7f15301a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.873+0000 7f1527e00700 1 -- 172.21.15.110:0/3206533303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f153010fe20 msgr2=0x7f15301a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.874+0000 7f1527e00700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f153010fe20 0x7f15301a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.874+0000 7f1527e00700 1 -- 172.21.15.110:0/3206533303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1530075650 msgr2=0x7f153019bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.874+0000 7f1527e00700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1530075650 0x7f153019bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.874+0000 7f1527e00700 1 -- 172.21.15.110:0/3206533303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15301a0d50 con 0x7f1530075f70 2024-04-26T11:35:10.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.874+0000 7f1534a00700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1530075650 0x7f153019bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:35:10.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.874+0000 7f1527e00700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 0x7f153019c280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f15200057c0 tx=0x7f15200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:10.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.875+0000 7f152e000700 1 -- 172.21.15.110:0/3206533303 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152000fad0 con 0x7f1530075f70 2024-04-26T11:35:10.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.875+0000 7f152e000700 1 -- 172.21.15.110:0/3206533303 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f152000fc70 con 0x7f1530075f70 2024-04-26T11:35:10.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.875+0000 7f1537400700 1 -- 172.21.15.110:0/3206533303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15301a0fe0 con 0x7f1530075f70 2024-04-26T11:35:10.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.875+0000 7f152e000700 1 -- 172.21.15.110:0/3206533303 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520017650 con 0x7f1530075f70 2024-04-26T11:35:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.875+0000 7f1537400700 1 -- 172.21.15.110:0/3206533303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15301a88c0 con 0x7f1530075f70 2024-04-26T11:35:10.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.878+0000 7f152e000700 1 -- 172.21.15.110:0/3206533303 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f1520009d10 con 0x7f1530075f70 2024-04-26T11:35:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.880+0000 7f152e000700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f15100a3db0 0x7f15100a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.880+0000 7f152e000700 1 -- 172.21.15.110:0/3206533303 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f15200d1870 con 0x7f1530075f70 2024-04-26T11:35:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.880+0000 7f1541ca0b80 1 Processor -- start 2024-04-26T11:35:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.880+0000 7f1534a00700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f15100a3db0 0x7f15100a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.880+0000 7f1541ca0b80 1 -- start start 2024-04-26T11:35:10.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.880+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664c2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.880+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561266415ae0 con 0x5612664ccc30 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5612663b4340 con 0x5612664c2560 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561266411aa0 con 0x5612664c2e80 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1527e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1534a00700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f15100a3db0 0x7f15100a6270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1518011490 tx=0x7f1518009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1527e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:54828/0 (socket says 172.21.15.110:54828) 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1527e00700 1 -- 172.21.15.110:0/490889773 learned_addr learned my addr 172.21.15.110:0/490889773 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1534a00700 1 --2- 172.21.15.110:0/490889773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1535400700 1 --2- 172.21.15.110:0/490889773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1527e00700 1 -- 172.21.15.110:0/490889773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 msgr2=0x5612664c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1527e00700 1 --2- 172.21.15.110:0/490889773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1527e00700 1 -- 172.21.15.110:0/490889773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 msgr2=0x5612664cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:10.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1527e00700 1 --2- 172.21.15.110:0/490889773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.881+0000 7f1527e00700 1 -- 172.21.15.110:0/490889773 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612663bc860 con 0x5612664c2e80 2024-04-26T11:35:10.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.882+0000 7f1527e00700 1 --2- 172.21.15.110:0/490889773 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664cc6f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f152009a190 tx=0x7f152009d300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd52607c8163743 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:10.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.882+0000 7f1526000700 1 -- 172.21.15.110:0/490889773 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152009dec0 con 0x5612664c2e80 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.882+0000 7f1526000700 1 -- 172.21.15.110:0/490889773 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f152009d7c0 con 0x5612664c2e80 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.882+0000 7f1526000700 1 -- 172.21.15.110:0/490889773 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152009da20 con 0x5612664c2e80 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.883+0000 7f1541ca0b80 1 -- 172.21.15.110:0/490889773 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 msgr2=0x5612664cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.883+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/490889773 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664cc6f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f152009a190 tx=0x7f152009d300 comp rx=0 tx=0).stop 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.883+0000 7f1541ca0b80 1 -- 172.21.15.110:0/490889773 shutdown_connections 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.883+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/490889773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.883+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/490889773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.883+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/490889773 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664cc6f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.883+0000 7f1541ca0b80 1 -- 172.21.15.110:0/490889773 >> 172.21.15.110:0/490889773 conn(0x5612663f0540 msgr2=0x5612664bd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.883+0000 7f1541ca0b80 1 -- 172.21.15.110:0/490889773 shutdown_connections 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.883+0000 7f1541ca0b80 1 -- 172.21.15.110:0/490889773 wait complete. 2024-04-26T11:35:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.884+0000 7f1541ca0b80 1 -- start start 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.884+0000 7f1541ca0b80 1 Processor -- start 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664c2e80 0x5612664c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664ccc30 0x5612664c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5612664cf560 con 0x5612664c2e80 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5612663b0590 con 0x5612664c2560 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5612664cf6e0 con 0x5612664ccc30 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1541ca0b80 10 client.0 _ll_register_callbacks cb 0x5612663a9480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1527e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664c2e80 0x5612664c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1535400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664ccc30 0x5612664c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1534a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1535400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664ccc30 0x5612664c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:54844/0 (socket says 172.21.15.110:54844) 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1535400700 1 -- 172.21.15.110:0/3342085401 learned_addr learned my addr 172.21.15.110:0/3342085401 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:10.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1527e00700 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664c2e80 0x5612664c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54660/0 (socket says 172.21.15.110:54660) 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1535400700 1 -- 172.21.15.110:0/3342085401 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 msgr2=0x5612664cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1535400700 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1535400700 1 -- 172.21.15.110:0/3342085401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664c2e80 msgr2=0x5612664c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1535400700 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664c2e80 0x5612664c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.885+0000 7f1535400700 1 -- 172.21.15.110:0/3342085401 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612663629d0 con 0x5612664ccc30 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.886+0000 7f1535400700 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664ccc30 0x5612664c9d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1528007bc0 tx=0x7f1528009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a66a2e26705bc2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.886+0000 7f151ea00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.886+0000 7f151ea00700 1 -- 172.21.15.110:0/3342085401 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152801a030 con 0x5612664ccc30 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.886+0000 7f151ea00700 1 -- 172.21.15.110:0/3342085401 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f1528003a00 con 0x5612664ccc30 2024-04-26T11:35:10.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.886+0000 7f1541ca0b80 1 -- 172.21.15.110:0/3342085401 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f152009d7c0 con 0x5612664ccc30 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.886+0000 7f151ea00700 1 -- 172.21.15.110:0/3342085401 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1528026050 con 0x5612664ccc30 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.886+0000 7f1541ca0b80 10 client.25648 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.886+0000 7f1541ca0b80 1 -- 172.21.15.110:0/3342085401 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5612664d9ee0 con 0x5612664ccc30 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.887+0000 7f151ea00700 1 -- 172.21.15.110:0/3342085401 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f152009d7c0 con 0x5612664ccc30 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.887+0000 7f151ea00700 1 -- 172.21.15.110:0/3342085401 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f1528016820 con 0x5612664ccc30 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.887+0000 7f1541ca0b80 10 client.25648 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.887+0000 7f1541ca0b80 10 client.25648 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.887+0000 7f1541ca0b80 20 client.25648 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.887+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5612664dc470 0x5612664de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.887+0000 7f1541ca0b80 4 client.25648 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.887+0000 7f1541ca0b80 1 -- 172.21.15.110:0/3342085401 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56126648ec70 con 0x5612664dc470 2024-04-26T11:35:10.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.888+0000 7f1534a00700 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5612664dc470 0x5612664de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.888+0000 7f1534a00700 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5612664dc470 0x5612664de890 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95cfa2938e38de59 server_cookie=eabc92e659b22d0c in_seq=0 out_seq=0 2024-04-26T11:35:10.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.888+0000 7f151ea00700 10 client.25648 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:10.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.889+0000 7f151ea00700 1 -- 172.21.15.110:0/3342085401 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56126648ec70 con 0x5612664dc470 2024-04-26T11:35:10.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.889+0000 7f151ea00700 10 client.25648 handle_command_reply: tid=0 2024-04-26T11:35:10.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.889+0000 7f1541ca0b80 1 client.25648 shutdown 2024-04-26T11:35:10.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 -- 172.21.15.110:0/3342085401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664ccc30 msgr2=0x5612664c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:10.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664ccc30 0x5612664c9d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1528007bc0 tx=0x7f1528009510 comp rx=0 tx=0).stop 2024-04-26T11:35:10.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 -- 172.21.15.110:0/3342085401 shutdown_connections 2024-04-26T11:35:10.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5612664dc470 0x5612664de890 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664ccc30 0x5612664c9d10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f151ea00700 0 client.25648 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:10.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/3342085401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664c2e80 0x5612664c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 -- 172.21.15.110:0/3342085401 >> 172.21.15.110:0/3342085401 conn(0x5612663f0540 msgr2=0x5612664bf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:10.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 -- 172.21.15.110:0/3342085401 shutdown_connections 2024-04-26T11:35:10.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 1 -- 172.21.15.110:0/3342085401 wait complete. 2024-04-26T11:35:10.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.890+0000 7f1541ca0b80 20 client.25648 trim_cache size 0 max 16384 2024-04-26T11:35:10.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.911+0000 7f1541ca0b80 1 Processor -- start 2024-04-26T11:35:10.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.911+0000 7f1541ca0b80 1 -- start start 2024-04-26T11:35:10.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.911+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.911+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664e4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.911+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664e4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.911+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f15301b2a80 con 0x5612664ccc30 2024-04-26T11:35:10.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.911+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15301b0280 con 0x5612664c2560 2024-04-26T11:35:10.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.911+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f15301ae0d0 con 0x5612664c2e80 2024-04-26T11:35:10.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1534a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1527e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1535400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1527e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664e4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:54856/0 (socket says 172.21.15.110:54856) 2024-04-26T11:35:10.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1534a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54414/0 (socket says 172.21.15.110:54414) 2024-04-26T11:35:10.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1527e00700 1 -- 172.21.15.110:0/2059664154 learned_addr learned my addr 172.21.15.110:0/2059664154 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:10.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1527e00700 1 -- 172.21.15.110:0/2059664154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 msgr2=0x5612664cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:10.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1527e00700 1 --2- 172.21.15.110:0/2059664154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1527e00700 1 -- 172.21.15.110:0/2059664154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 msgr2=0x5612664e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1527e00700 1 --2- 172.21.15.110:0/2059664154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1527e00700 1 -- 172.21.15.110:0/2059664154 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612664ca040 con 0x5612664c2e80 2024-04-26T11:35:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.912+0000 7f1534a00700 1 --2- 172.21.15.110:0/2059664154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:35:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1527e00700 1 --2- 172.21.15.110:0/2059664154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664e4120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f152009d750 tx=0x7f1520005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c71e9dd83a0fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1525600700 1 -- 172.21.15.110:0/2059664154 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152009d7c0 con 0x5612664c2e80 2024-04-26T11:35:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1525600700 1 -- 172.21.15.110:0/2059664154 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15200a1b70 con 0x5612664c2e80 2024-04-26T11:35:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1525600700 1 -- 172.21.15.110:0/2059664154 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152009dc80 con 0x5612664c2e80 2024-04-26T11:35:10.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2059664154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 msgr2=0x5612664e4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2059664154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664e4120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f152009d750 tx=0x7f1520005040 comp rx=0 tx=0).stop 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2059664154 shutdown_connections 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2059664154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2059664154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.913+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2059664154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664e4120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.914+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2059664154 >> 172.21.15.110:0/2059664154 conn(0x5612663f0540 msgr2=0x5612664c4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.914+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2059664154 shutdown_connections 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.914+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2059664154 wait complete. 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.914+0000 7f1541ca0b80 1 -- start start 2024-04-26T11:35:10.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.914+0000 7f1541ca0b80 1 Processor -- start 2024-04-26T11:35:10.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1541ca0b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f15301ae740 con 0x5612664ccc30 2024-04-26T11:35:10.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15301afbb0 con 0x5612664c2560 2024-04-26T11:35:10.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1541ca0b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f15301aee10 con 0x5612664c2e80 2024-04-26T11:35:10.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1541ca0b80 10 client.0 _ll_register_callbacks cb 0x5612663a9480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1535400700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1527e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1527e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:54858/0 (socket says 172.21.15.110:54858) 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1527e00700 1 -- 172.21.15.110:0/2974419454 learned_addr learned my addr 172.21.15.110:0/2974419454 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.915+0000 7f1534a00700 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f1527e00700 1 -- 172.21.15.110:0/2974419454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 msgr2=0x5612664d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f1527e00700 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f1527e00700 1 -- 172.21.15.110:0/2974419454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 msgr2=0x5612664d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f1527e00700 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664d2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f1527e00700 1 -- 172.21.15.110:0/2974419454 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561266542b70 con 0x5612664c2e80 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f1527e00700 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664d1e40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f152009a190 tx=0x7f1520005860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6fed4e4ec9e15ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f151ea00700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:35:10.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f151ea00700 1 -- 172.21.15.110:0/2974419454 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152009dec0 con 0x5612664c2e80 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f151ea00700 1 -- 172.21.15.110:0/2974419454 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f152009dc30 con 0x5612664c2e80 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2974419454 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5612664234c0 con 0x5612664c2e80 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f151ea00700 1 -- 172.21.15.110:0/2974419454 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f152009d7c0 con 0x5612664c2e80 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f1541ca0b80 10 client.25654 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.916+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2974419454 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561266543e50 con 0x5612664c2e80 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.917+0000 7f151ea00700 1 -- 172.21.15.110:0/2974419454 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5612664234c0 con 0x5612664c2e80 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.917+0000 7f151ea00700 1 -- 172.21.15.110:0/2974419454 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f15200bc070 con 0x5612664c2e80 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.917+0000 7f1541ca0b80 10 client.25654 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.917+0000 7f1541ca0b80 10 client.25654 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.917+0000 7f1541ca0b80 20 client.25654 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.917+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561266544030 0x561266546420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.917+0000 7f1541ca0b80 4 client.25654 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7ef1dec5", "release": true, "await": true}] 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.917+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2974419454 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7ef1dec5", "release": true, "await": true}) -- 0x56126641d560 con 0x561266544030 2024-04-26T11:35:10.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.917+0000 7f1534a00700 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561266544030 0x561266546420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:10.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.918+0000 7f1534a00700 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561266544030 0x561266546420 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a67424258ea42 server_cookie=a4a15eceaa2bc940 in_seq=0 out_seq=0 2024-04-26T11:35:10.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.918+0000 7f151ea00700 10 client.25654 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:10.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.955+0000 7f151ea00700 1 -- 172.21.15.110:0/2974419454 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56126641d560 con 0x561266544030 2024-04-26T11:35:10.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.955+0000 7f151ea00700 10 client.25654 handle_command_reply: tid=0 2024-04-26T11:35:10.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.955+0000 7f1541ca0b80 1 client.25654 shutdown 2024-04-26T11:35:10.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.956+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2974419454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 msgr2=0x5612664d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:10.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.956+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664d1e40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f152009a190 tx=0x7f1520005860 comp rx=0 tx=0).stop 2024-04-26T11:35:10.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.956+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2974419454 shutdown_connections 2024-04-26T11:35:10.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.956+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561266544030 0x561266546420 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.956+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612664ccc30 0x5612664d2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.956+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5612664c2560 0x5612664d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.956+0000 7f1541ca0b80 1 --2- 172.21.15.110:0/2974419454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5612664c2e80 0x5612664d1e40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.956+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2974419454 >> 172.21.15.110:0/2974419454 conn(0x5612663f0540 msgr2=0x5612664c1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:10.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.956+0000 7f151ea00700 0 client.25654 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:10.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.957+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2974419454 shutdown_connections 2024-04-26T11:35:10.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.957+0000 7f1541ca0b80 1 -- 172.21.15.110:0/2974419454 wait complete. 2024-04-26T11:35:10.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.958+0000 7f1541ca0b80 20 client.25654 trim_cache size 0 max 16384 2024-04-26T11:35:10.962 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:35:10.962 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 34, 2024-04-26T11:35:10.962 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:35:10.962 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 12, 2024-04-26T11:35:10.962 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:35:10.962 INFO:teuthology.orchestra.run.smithi110.stdout: "7ef1dec5": { 2024-04-26T11:35:10.962 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 12, 2024-04-26T11:35:10.962 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RELEASED", 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 75.6, 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": false, 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RELEASED", 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:10.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:10.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:10.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:10.964 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:35:10.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 -- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f15100a3db0 msgr2=0x7f15100a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:10.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f15100a3db0 0x7f15100a6270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1518011490 tx=0x7f1518009260 comp rx=0 tx=0).stop 2024-04-26T11:35:10.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 -- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 msgr2=0x7f153019c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:10.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 0x7f153019c280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f15200057c0 tx=0x7f15200057f0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 -- 172.21.15.110:0/3206533303 shutdown_connections 2024-04-26T11:35:10.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f15100a3db0 0x7f15100a6270 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f153010fe20 0x7f15301a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1530075650 0x7f153019bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 --2- 172.21.15.110:0/3206533303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1530075f70 0x7f153019c280 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:10.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 -- 172.21.15.110:0/3206533303 >> 172.21.15.110:0/3206533303 conn(0x7f153007a580 msgr2=0x7f15301006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:10.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.963+0000 7f1537400700 1 -- 172.21.15.110:0/3206533303 shutdown_connections 2024-04-26T11:35:10.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:10.964+0000 7f1537400700 1 -- 172.21.15.110:0/3206533303 wait complete. 2024-04-26T11:35:11.950 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7ef1dec5', seconds elapsed: 33.8 2024-04-26T11:35:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:11 smithi196 ceph-mon[32572]: pgmap v120: 97 pgs: 97 active+clean; 1.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.9 MiB/s wr, 88 op/s 2024-04-26T11:35:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:11 smithi110 ceph-mon[28069]: pgmap v120: 97 pgs: 97 active+clean; 1.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.9 MiB/s wr, 88 op/s 2024-04-26T11:35:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:11 smithi193 ceph-mon[32782]: pgmap v120: 97 pgs: 97 active+clean; 1.6 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.9 MiB/s wr, 88 op/s 2024-04-26T11:35:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:13 smithi196 ceph-mon[32572]: pgmap v121: 97 pgs: 97 active+clean; 1.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.7 MiB/s wr, 299 op/s 2024-04-26T11:35:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:13 smithi110 ceph-mon[28069]: pgmap v121: 97 pgs: 97 active+clean; 1.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.7 MiB/s wr, 299 op/s 2024-04-26T11:35:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:13 smithi193 ceph-mon[32782]: pgmap v121: 97 pgs: 97 active+clean; 1.7 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.7 MiB/s wr, 299 op/s 2024-04-26T11:35:14.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 180.0 s, 239.4 tps, lat 2350.485 ms stddev 6688.851 2024-04-26T11:35:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:15 smithi196 ceph-mon[32572]: pgmap v122: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.3 MiB/s wr, 324 op/s 2024-04-26T11:35:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:15 smithi110 ceph-mon[28069]: pgmap v122: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.3 MiB/s wr, 324 op/s 2024-04-26T11:35:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:15 smithi193 ceph-mon[32782]: pgmap v122: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.3 MiB/s wr, 324 op/s 2024-04-26T11:35:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:17 smithi196 ceph-mon[32572]: pgmap v123: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.2 MiB/s wr, 311 op/s 2024-04-26T11:35:18.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:17 smithi110 ceph-mon[28069]: pgmap v123: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.2 MiB/s wr, 311 op/s 2024-04-26T11:35:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:17 smithi193 ceph-mon[32782]: pgmap v123: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.2 MiB/s wr, 311 op/s 2024-04-26T11:35:18.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.964+0000 7fd9ff000640 1 -- 172.21.15.110:0/3465992833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 msgr2=0x7fd9f8113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:18.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.964+0000 7fd9ff000640 1 --2- 172.21.15.110:0/3465992833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 0x7fd9f8113280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009890 tx=0x7fd9e002a380 comp rx=0 tx=0).stop 2024-04-26T11:35:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.966+0000 7fd9ff000640 1 -- 172.21.15.110:0/3465992833 shutdown_connections 2024-04-26T11:35:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.966+0000 7fd9ff000640 1 --2- 172.21.15.110:0/3465992833 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9f81137c0 0x7fd9f8115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.966+0000 7fd9ff000640 1 --2- 172.21.15.110:0/3465992833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 0x7fd9f8113280 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.966+0000 7fd9ff000640 1 --2- 172.21.15.110:0/3465992833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f8076e60 0x7fd9f8077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.966+0000 7fd9ff000640 1 -- 172.21.15.110:0/3465992833 >> 172.21.15.110:0/3465992833 conn(0x7fd9f8100630 msgr2=0x7fd9f8102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:18.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.966+0000 7fd9ff000640 1 -- 172.21.15.110:0/3465992833 shutdown_connections 2024-04-26T11:35:18.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.966+0000 7fd9ff000640 1 -- 172.21.15.110:0/3465992833 wait complete. 2024-04-26T11:35:18.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.969+0000 7fd9ff000640 1 Processor -- start 2024-04-26T11:35:18.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.969+0000 7fd9ff000640 1 -- start start 2024-04-26T11:35:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.969+0000 7fd9ff000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9f8076e60 0x7fd9f81a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.969+0000 7fd9ff000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 0x7fd9f81a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.969+0000 7fd9ff000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f81137c0 0x7fd9f819f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.969+0000 7fd9ff000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f81191d0 con 0x7fd9f81137c0 2024-04-26T11:35:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.969+0000 7fd9ff000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8119050 con 0x7fd9f8076e60 2024-04-26T11:35:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.969+0000 7fd9ff000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8119350 con 0x7fd9f8077780 2024-04-26T11:35:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.970+0000 7fd9f7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 0x7fd9f81a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.970+0000 7fd9f7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 0x7fd9f81a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:43922/0 (socket says 172.21.15.110:43922) 2024-04-26T11:35:18.971 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.970+0000 7fd9f7400640 1 -- 172.21.15.110:0/557912855 learned_addr learned my addr 172.21.15.110:0/557912855 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.970+0000 7fd9f7400640 1 -- 172.21.15.110:0/557912855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9f8076e60 msgr2=0x7fd9f81a5400 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T11:35:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.970+0000 7fd9f7400640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9f8076e60 0x7fd9f81a5400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.970+0000 7fd9f7400640 1 -- 172.21.15.110:0/557912855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f81137c0 msgr2=0x7fd9f819f5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T11:35:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.971+0000 7fd9f7400640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f81137c0 0x7fd9f819f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.971+0000 7fd9f7400640 1 -- 172.21.15.110:0/557912855 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f819fd00 con 0x7fd9f8077780 2024-04-26T11:35:18.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.971+0000 7fd9f7400640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 0x7fd9f81a5940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009780 tx=0x7fd9e0030640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.971+0000 7fd9f4c00640 1 -- 172.21.15.110:0/557912855 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0037040 con 0x7fd9f8077780 2024-04-26T11:35:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.971+0000 7fd9f4c00640 1 -- 172.21.15.110:0/557912855 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9e0040070 con 0x7fd9f8077780 2024-04-26T11:35:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.971+0000 7fd9f4c00640 1 -- 172.21.15.110:0/557912855 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00309e0 con 0x7fd9f8077780 2024-04-26T11:35:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.971+0000 7fd9ff000640 1 -- 172.21.15.110:0/557912855 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f819ff90 con 0x7fd9f8077780 2024-04-26T11:35:18.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.972+0000 7fd9ff000640 1 -- 172.21.15.110:0/557912855 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f806c350 con 0x7fd9f8077780 2024-04-26T11:35:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.978+0000 7fd9f4c00640 1 -- 172.21.15.110:0/557912855 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fd9e0005050 con 0x7fd9f8077780 2024-04-26T11:35:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.983+0000 7fd9f4c00640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd9dc0a3e40 0x7fd9dc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.983+0000 7fd9f4c00640 1 -- 172.21.15.110:0/557912855 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fd9e00f0390 con 0x7fd9f8077780 2024-04-26T11:35:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.984+0000 7fda01db8740 1 Processor -- start 2024-04-26T11:35:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.984+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd9dc0a3e40 0x7fd9dc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.985+0000 7fda01db8740 1 -- start start 2024-04-26T11:35:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.986+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd9dc0a3e40 0x7fd9dc0a6300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0005fd0 tx=0x7fd9f00095c0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.987+0000 7fda01db8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 0x557d99fb11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.987+0000 7fda01db8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb16f0 0x557d99fbba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.987+0000 7fda01db8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fbe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.987+0000 7fda01db8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557d99f16380 con 0x557d99fb0dd0 2024-04-26T11:35:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.987+0000 7fda01db8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557d99eb2c30 con 0x557d99fb16f0 2024-04-26T11:35:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.987+0000 7fda01db8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557d99f12340 con 0x557d99fbbfb0 2024-04-26T11:35:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.987+0000 7fd9fd000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fbe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.988+0000 7fd9fd000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fbe3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:43926/0 (socket says 172.21.15.110:43926) 2024-04-26T11:35:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.988+0000 7fd9fd000640 1 -- 172.21.15.110:0/2441299468 learned_addr learned my addr 172.21.15.110:0/2441299468 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.987+0000 7fd9f7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb16f0 0x557d99fbba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.989+0000 7fd9fd000640 1 -- 172.21.15.110:0/2441299468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb16f0 msgr2=0x557d99fbba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.990+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/2441299468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 0x557d99fb11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.990+0000 7fd9fd000640 1 --2- 172.21.15.110:0/2441299468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb16f0 0x557d99fbba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.990+0000 7fd9fd000640 1 -- 172.21.15.110:0/2441299468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 msgr2=0x557d99fb11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.990+0000 7fd9fd000640 1 --2- 172.21.15.110:0/2441299468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 0x557d99fb11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.990+0000 7fd9fd000640 1 -- 172.21.15.110:0/2441299468 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d99ed4940 con 0x557d99fbbfb0 2024-04-26T11:35:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.990+0000 7fd9f7400640 1 --2- 172.21.15.110:0/2441299468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb16f0 0x557d99fbba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.991+0000 7fd9fd000640 1 --2- 172.21.15.110:0/2441299468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fbe3a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800b9e0 tx=0x7fd9e800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffd1783223375d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.991+0000 7fd9ed600640 1 -- 172.21.15.110:0/2441299468 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8016070 con 0x557d99fbbfb0 2024-04-26T11:35:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.992+0000 7fd9ed600640 1 -- 172.21.15.110:0/2441299468 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9e80054d0 con 0x557d99fbbfb0 2024-04-26T11:35:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.992+0000 7fd9ed600640 1 -- 172.21.15.110:0/2441299468 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8004d00 con 0x557d99fbbfb0 2024-04-26T11:35:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.993+0000 7fda01db8740 1 -- 172.21.15.110:0/2441299468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 msgr2=0x557d99fbe3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:18.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.993+0000 7fda01db8740 1 --2- 172.21.15.110:0/2441299468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fbe3a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800b9e0 tx=0x7fd9e800bea0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.993+0000 7fda01db8740 1 -- 172.21.15.110:0/2441299468 shutdown_connections 2024-04-26T11:35:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.993+0000 7fda01db8740 1 --2- 172.21.15.110:0/2441299468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fbe3a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.993+0000 7fda01db8740 1 --2- 172.21.15.110:0/2441299468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb16f0 0x557d99fbba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.993+0000 7fda01db8740 1 --2- 172.21.15.110:0/2441299468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 0x557d99fb11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.993+0000 7fda01db8740 1 -- 172.21.15.110:0/2441299468 >> 172.21.15.110:0/2441299468 conn(0x557d99fad2e0 msgr2=0x557d99fad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.993+0000 7fda01db8740 1 -- 172.21.15.110:0/2441299468 shutdown_connections 2024-04-26T11:35:18.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.993+0000 7fda01db8740 1 -- 172.21.15.110:0/2441299468 wait complete. 2024-04-26T11:35:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.994+0000 7fda01db8740 1 -- start start 2024-04-26T11:35:18.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.994+0000 7fda01db8740 1 Processor -- start 2024-04-26T11:35:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.996+0000 7fda01db8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fb8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.996+0000 7fda01db8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb16f0 0x557d99fb9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.996+0000 7fda01db8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fb99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.997+0000 7fda01db8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557d99fbebe0 con 0x557d99fb16f0 2024-04-26T11:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.997+0000 7fda01db8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557d99e9dc60 con 0x557d99fb0dd0 2024-04-26T11:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.997+0000 7fda01db8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557d99fbed60 con 0x557d99fbbfb0 2024-04-26T11:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.997+0000 7fd9fd000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fb99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.997+0000 7fda01db8740 10 client.0 _ll_register_callbacks cb 0x557d99ec9e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.997+0000 7fd9fd000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fb99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:43938/0 (socket says 172.21.15.110:43938) 2024-04-26T11:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.997+0000 7fd9fd000640 1 -- 172.21.15.110:0/1629131306 learned_addr learned my addr 172.21.15.110:0/1629131306 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.996+0000 7fd9f7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fb8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.997+0000 7fd9f7400640 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb16f0 0x557d99fb9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.998+0000 7fd9fd000640 1 -- 172.21.15.110:0/1629131306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 msgr2=0x557d99fb8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.998+0000 7fd9fd000640 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fb8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.999+0000 7fd9fd000640 1 -- 172.21.15.110:0/1629131306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb16f0 msgr2=0x557d99fb9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.999+0000 7fd9fd000640 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb16f0 0x557d99fb9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:18.999+0000 7fd9fd000640 1 -- 172.21.15.110:0/1629131306 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d99eac510 con 0x557d99fbbfb0 2024-04-26T11:35:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.000+0000 7fd9fd000640 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fb99c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8005940 tx=0x7fd9e800b700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8a73c85b4537f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.000+0000 7fd9e6000640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:35:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.001+0000 7fd9e6000640 1 -- 172.21.15.110:0/1629131306 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8016070 con 0x557d99fbbfb0 2024-04-26T11:35:19.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.001+0000 7fd9e6000640 1 -- 172.21.15.110:0/1629131306 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fd9e8004c80 con 0x557d99fbbfb0 2024-04-26T11:35:19.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.001+0000 7fda01db8740 1 -- 172.21.15.110:0/1629131306 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9e80054d0 con 0x557d99fbbfb0 2024-04-26T11:35:19.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.002+0000 7fd9e6000640 1 -- 172.21.15.110:0/1629131306 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd9e8004040 con 0x557d99fbbfb0 2024-04-26T11:35:19.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.003+0000 7fda01db8740 10 client.25666 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:19.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.003+0000 7fda01db8740 1 -- 172.21.15.110:0/1629131306 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557d99c28210 con 0x557d99fbbfb0 2024-04-26T11:35:19.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.003+0000 7fd9e6000640 1 -- 172.21.15.110:0/1629131306 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9e80054d0 con 0x557d99fbbfb0 2024-04-26T11:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.003+0000 7fd9e6000640 1 -- 172.21.15.110:0/1629131306 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fd9e8022020 con 0x557d99fbbfb0 2024-04-26T11:35:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.004+0000 7fda01db8740 10 client.25666 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.004+0000 7fda01db8740 10 client.25666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.004+0000 7fda01db8740 20 client.25666 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.004+0000 7fda01db8740 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557d99fcbc50 0x557d99fce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.004+0000 7fda01db8740 4 client.25666 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:35:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.004+0000 7fda01db8740 1 -- 172.21.15.110:0/1629131306 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d99f23f90 con 0x557d99fcbc50 2024-04-26T11:35:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.005+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557d99fcbc50 0x557d99fce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.006+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557d99fcbc50 0x557d99fce040 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa7ac88f9c22240a server_cookie=6d5d928f7f0d8468 in_seq=0 out_seq=0 2024-04-26T11:35:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.006+0000 7fd9e6000640 10 client.25666 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.007+0000 7fd9e6000640 1 -- 172.21.15.110:0/1629131306 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557d99f23f90 con 0x557d99fcbc50 2024-04-26T11:35:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.007+0000 7fd9e6000640 10 client.25666 handle_command_reply: tid=0 2024-04-26T11:35:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.007+0000 7fda01db8740 1 client.25666 shutdown 2024-04-26T11:35:19.009 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.008+0000 7fda01db8740 1 -- 172.21.15.110:0/1629131306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 msgr2=0x557d99fb99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:19.009 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.008+0000 7fda01db8740 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fb99c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8005940 tx=0x7fd9e800b700 comp rx=0 tx=0).stop 2024-04-26T11:35:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.009+0000 7fda01db8740 1 -- 172.21.15.110:0/1629131306 shutdown_connections 2024-04-26T11:35:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.009+0000 7fda01db8740 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557d99fcbc50 0x557d99fce040 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.009+0000 7fda01db8740 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fbbfb0 0x557d99fb99c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.009+0000 7fda01db8740 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb16f0 0x557d99fb9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.009+0000 7fda01db8740 1 --2- 172.21.15.110:0/1629131306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fb8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.009+0000 7fda01db8740 1 -- 172.21.15.110:0/1629131306 >> 172.21.15.110:0/1629131306 conn(0x557d99fad2e0 msgr2=0x557d99fb3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.009+0000 7fd9e6000640 0 client.25666 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.010+0000 7fda01db8740 1 -- 172.21.15.110:0/1629131306 shutdown_connections 2024-04-26T11:35:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.010+0000 7fda01db8740 1 -- 172.21.15.110:0/1629131306 wait complete. 2024-04-26T11:35:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.010+0000 7fda01db8740 20 client.25666 trim_cache size 0 max 16384 2024-04-26T11:35:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.030+0000 7fda01db8740 1 Processor -- start 2024-04-26T11:35:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.030+0000 7fda01db8740 1 -- start start 2024-04-26T11:35:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.030+0000 7fda01db8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fbb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.030+0000 7fda01db8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 0x557d99fc7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.030+0000 7fda01db8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fbbfb0 0x557d99fd3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.030+0000 7fda01db8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f81c0040 con 0x557d99fbbfb0 2024-04-26T11:35:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.030+0000 7fda01db8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f81bd880 con 0x557d99fb0dd0 2024-04-26T11:35:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.030+0000 7fda01db8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8072f50 con 0x557d99fb16f0 2024-04-26T11:35:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.031+0000 7fd9f7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 0x557d99fc7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.031+0000 7fd9f7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fbb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.031+0000 7fd9f7e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fbb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:58446/0 (socket says 172.21.15.110:58446) 2024-04-26T11:35:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.031+0000 7fd9f7e00640 1 -- 172.21.15.110:0/1743954396 learned_addr learned my addr 172.21.15.110:0/1743954396 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.031+0000 7fd9fd000640 1 --2- 172.21.15.110:0/1743954396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fbbfb0 0x557d99fd3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.031+0000 7fd9f7e00640 1 -- 172.21.15.110:0/1743954396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 msgr2=0x557d99fc7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.031+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/1743954396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 0x557d99fc7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.032+0000 7fd9f7e00640 1 -- 172.21.15.110:0/1743954396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fbbfb0 msgr2=0x557d99fd3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.032+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/1743954396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fbbfb0 0x557d99fd3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.032+0000 7fd9f7e00640 1 -- 172.21.15.110:0/1743954396 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d99cf4620 con 0x557d99fb0dd0 2024-04-26T11:35:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.032+0000 7fd9fd000640 1 --2- 172.21.15.110:0/1743954396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fbbfb0 0x557d99fd3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:35:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.032+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/1743954396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fbb670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x557d99fce610 tx=0x7fd9f0015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39834b3fcf763ecb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.033+0000 7fd9ecc00640 1 -- 172.21.15.110:0/1743954396 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f002c070 con 0x557d99fb0dd0 2024-04-26T11:35:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.033+0000 7fd9ecc00640 1 -- 172.21.15.110:0/1743954396 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9f00278e0 con 0x557d99fb0dd0 2024-04-26T11:35:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.033+0000 7fd9ecc00640 1 -- 172.21.15.110:0/1743954396 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0005690 con 0x557d99fb0dd0 2024-04-26T11:35:19.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.035+0000 7fda01db8740 1 -- 172.21.15.110:0/1743954396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 msgr2=0x557d99fbb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:19.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.035+0000 7fda01db8740 1 --2- 172.21.15.110:0/1743954396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fbb670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x557d99fce610 tx=0x7fd9f0015000 comp rx=0 tx=0).stop 2024-04-26T11:35:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.035+0000 7fda01db8740 1 -- 172.21.15.110:0/1743954396 shutdown_connections 2024-04-26T11:35:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.035+0000 7fda01db8740 1 --2- 172.21.15.110:0/1743954396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fbbfb0 0x557d99fd3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.036+0000 7fda01db8740 1 --2- 172.21.15.110:0/1743954396 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 0x557d99fc7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.036+0000 7fda01db8740 1 --2- 172.21.15.110:0/1743954396 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fb0dd0 0x557d99fbb670 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.036+0000 7fda01db8740 1 -- 172.21.15.110:0/1743954396 >> 172.21.15.110:0/1743954396 conn(0x557d99fad2e0 msgr2=0x557d99fb9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.036+0000 7fda01db8740 1 -- 172.21.15.110:0/1743954396 shutdown_connections 2024-04-26T11:35:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.037+0000 7fda01db8740 1 -- 172.21.15.110:0/1743954396 wait complete. 2024-04-26T11:35:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.038+0000 7fda01db8740 1 -- start start 2024-04-26T11:35:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.039+0000 7fda01db8740 1 Processor -- start 2024-04-26T11:35:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fda01db8740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 0x557d99fb5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fda01db8740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 0x557d99fb6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fda01db8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fbbfb0 0x557d99fb69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fda01db8740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f80735c0 con 0x557d99fb0dd0 2024-04-26T11:35:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fda01db8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f81bd2d0 con 0x557d99fbbfb0 2024-04-26T11:35:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fda01db8740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8073c90 con 0x557d99fb16f0 2024-04-26T11:35:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fda01db8740 10 client.0 _ll_register_callbacks cb 0x7fd9e0005a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fd9fd000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fbbfb0 0x557d99fb69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fd9fd000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fbbfb0 0x557d99fb69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:58452/0 (socket says 172.21.15.110:58452) 2024-04-26T11:35:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fd9fd000640 1 -- 172.21.15.110:0/4281625660 learned_addr learned my addr 172.21.15.110:0/4281625660 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fd9f7400640 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 0x557d99fb6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.041+0000 7fd9fd000640 1 -- 172.21.15.110:0/4281625660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 msgr2=0x557d99fb6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.042+0000 7fd9fd000640 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 0x557d99fb6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.042+0000 7fd9fd000640 1 -- 172.21.15.110:0/4281625660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 msgr2=0x557d99fb5f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T11:35:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.042+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 0x557d99fb5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.042+0000 7fd9fd000640 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 0x557d99fb5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.042+0000 7fd9fd000640 1 -- 172.21.15.110:0/4281625660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d99ed0cb0 con 0x557d99fbbfb0 2024-04-26T11:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.042+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 0x557d99fb5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.043+0000 7fd9fd000640 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fbbfb0 0x557d99fb69d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80036c0 tx=0x7fd9e800b300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ae7d9fb2b9174ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.043+0000 7fd9e6000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.043+0000 7fd9e6000640 1 -- 172.21.15.110:0/4281625660 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8033060 con 0x557d99fbbfb0 2024-04-26T11:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.043+0000 7fd9e6000640 1 -- 172.21.15.110:0/4281625660 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7fd9e80043e0 con 0x557d99fbbfb0 2024-04-26T11:35:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.044+0000 7fda01db8740 1 -- 172.21.15.110:0/4281625660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9f00278e0 con 0x557d99fbbfb0 2024-04-26T11:35:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.044+0000 7fd9e6000640 1 -- 172.21.15.110:0/4281625660 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd9e8016040 con 0x557d99fbbfb0 2024-04-26T11:35:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.044+0000 7fda01db8740 10 client.25658 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.044+0000 7fda01db8740 1 -- 172.21.15.110:0/4281625660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557d9a032260 con 0x557d99fbbfb0 2024-04-26T11:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.045+0000 7fd9e6000640 1 -- 172.21.15.110:0/4281625660 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9f00278e0 con 0x557d99fbbfb0 2024-04-26T11:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.045+0000 7fd9e6000640 1 -- 172.21.15.110:0/4281625660 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7fd9e8022070 con 0x557d99fbbfb0 2024-04-26T11:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.045+0000 7fda01db8740 10 client.25658 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.046+0000 7fda01db8740 10 client.25658 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.046+0000 7fda01db8740 20 client.25658 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.046+0000 7fda01db8740 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557d9a032920 0x557d9a034d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.046+0000 7fda01db8740 4 client.25658 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.046+0000 7fda01db8740 1 -- 172.21.15.110:0/4281625660 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557d99f1de00 con 0x557d9a032920 2024-04-26T11:35:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.046+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557d9a032920 0x557d9a034d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.047+0000 7fd9e6000640 10 client.25658 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.047+0000 7fd9f7e00640 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557d9a032920 0x557d9a034d10 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc675e509b4a02a server_cookie=abcc7321c8062998 in_seq=0 out_seq=0 2024-04-26T11:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.062+0000 7fd9e6000640 1 -- 172.21.15.110:0/4281625660 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557d99f1de00 con 0x557d9a032920 2024-04-26T11:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.062+0000 7fd9e6000640 10 client.25658 handle_command_reply: tid=0 2024-04-26T11:35:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.062+0000 7fda01db8740 1 client.25658 shutdown 2024-04-26T11:35:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.063+0000 7fda01db8740 1 -- 172.21.15.110:0/4281625660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fbbfb0 msgr2=0x557d99fb69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.063+0000 7fda01db8740 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fbbfb0 0x557d99fb69d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80036c0 tx=0x7fd9e800b300 comp rx=0 tx=0).stop 2024-04-26T11:35:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.064+0000 7fda01db8740 1 -- 172.21.15.110:0/4281625660 shutdown_connections 2024-04-26T11:35:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.064+0000 7fda01db8740 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99fbbfb0 0x557d99fb69d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.064+0000 7fda01db8740 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557d9a032920 0x557d9a034d10 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.064+0000 7fda01db8740 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557d99fb16f0 0x557d99fb6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.064+0000 7fda01db8740 1 --2- 172.21.15.110:0/4281625660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557d99fb0dd0 0x557d99fb5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.064+0000 7fda01db8740 1 -- 172.21.15.110:0/4281625660 >> 172.21.15.110:0/4281625660 conn(0x557d99fad2e0 msgr2=0x557d99fb8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.064+0000 7fd9e6000640 0 client.25658 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.064+0000 7fda01db8740 1 -- 172.21.15.110:0/4281625660 shutdown_connections 2024-04-26T11:35:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.064+0000 7fda01db8740 1 -- 172.21.15.110:0/4281625660 wait complete. 2024-04-26T11:35:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.065+0000 7fda01db8740 20 client.25658 trim_cache size 0 max 16384 2024-04-26T11:35:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:35:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:35:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:35:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:35:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 -- 172.21.15.110:0/557912855 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd9dc0a3e40 msgr2=0x7fd9dc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd9dc0a3e40 0x7fd9dc0a6300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0005fd0 tx=0x7fd9f00095c0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 -- 172.21.15.110:0/557912855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 msgr2=0x7fd9f81a5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 0x7fd9f81a5940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009780 tx=0x7fd9e0030640 comp rx=0 tx=0).stop 2024-04-26T11:35:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 -- 172.21.15.110:0/557912855 shutdown_connections 2024-04-26T11:35:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd9dc0a3e40 0x7fd9dc0a6300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f81137c0 0x7fd9f819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd9f8077780 0x7fd9f81a5940 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009780 tx=0x7fd9e0030640 comp rx=0 tx=0).stop 2024-04-26T11:35:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 --2- 172.21.15.110:0/557912855 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9f8076e60 0x7fd9f81a5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 -- 172.21.15.110:0/557912855 >> 172.21.15.110:0/557912855 conn(0x7fd9f8100630 msgr2=0x7fd9f8115330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 -- 172.21.15.110:0/557912855 shutdown_connections 2024-04-26T11:35:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:19.066+0000 7fd9ff000640 1 -- 172.21.15.110:0/557912855 wait complete. 2024-04-26T11:35:19.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 185.0 s, 641.0 tps, lat 164.496 ms stddev 264.240 2024-04-26T11:35:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:19 smithi110 ceph-mon[28069]: pgmap v124: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.1 MiB/s wr, 474 op/s 2024-04-26T11:35:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:19 smithi193 ceph-mon[32782]: pgmap v124: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.1 MiB/s wr, 474 op/s 2024-04-26T11:35:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:19 smithi196 ceph-mon[32572]: pgmap v124: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.1 MiB/s wr, 474 op/s 2024-04-26T11:35:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:21 smithi110 ceph-mon[28069]: pgmap v125: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 404 op/s 2024-04-26T11:35:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:21 smithi193 ceph-mon[32782]: pgmap v125: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 404 op/s 2024-04-26T11:35:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:21 smithi196 ceph-mon[32572]: pgmap v125: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 404 op/s 2024-04-26T11:35:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:23 smithi110 ceph-mon[28069]: pgmap v126: 97 pgs: 97 active+clean; 1.8 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 15 MiB/s wr, 816 op/s 2024-04-26T11:35:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:23 smithi193 ceph-mon[32782]: pgmap v126: 97 pgs: 97 active+clean; 1.8 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 15 MiB/s wr, 816 op/s 2024-04-26T11:35:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:23 smithi196 ceph-mon[32572]: pgmap v126: 97 pgs: 97 active+clean; 1.8 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 15 MiB/s wr, 816 op/s 2024-04-26T11:35:24.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 190.0 s, 3126.6 tps, lat 31.995 ms stddev 34.777 2024-04-26T11:35:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:25 smithi110 ceph-mon[28069]: pgmap v127: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 25 MiB/s wr, 1.24k op/s 2024-04-26T11:35:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:25 smithi193 ceph-mon[32782]: pgmap v127: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 25 MiB/s wr, 1.24k op/s 2024-04-26T11:35:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:25 smithi196 ceph-mon[32572]: pgmap v127: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 25 MiB/s wr, 1.24k op/s 2024-04-26T11:35:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:27 smithi110 ceph-mon[28069]: pgmap v128: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 25 MiB/s wr, 1.21k op/s 2024-04-26T11:35:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:27 smithi193 ceph-mon[32782]: pgmap v128: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 25 MiB/s wr, 1.21k op/s 2024-04-26T11:35:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:27 smithi196 ceph-mon[32572]: pgmap v128: 97 pgs: 97 active+clean; 1.9 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 25 MiB/s wr, 1.21k op/s 2024-04-26T11:35:29.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 195.0 s, 3187.0 tps, lat 31.474 ms stddev 36.114 2024-04-26T11:35:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:29 smithi110 ceph-mon[28069]: pgmap v129: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 28 MiB/s wr, 1.51k op/s 2024-04-26T11:35:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:29 smithi193 ceph-mon[32782]: pgmap v129: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 28 MiB/s wr, 1.51k op/s 2024-04-26T11:35:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:29 smithi196 ceph-mon[32572]: pgmap v129: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 28 MiB/s wr, 1.51k op/s 2024-04-26T11:35:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:31 smithi193 ceph-mon[32782]: pgmap v130: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 1.35k op/s 2024-04-26T11:35:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:35:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:31 smithi196 ceph-mon[32572]: pgmap v130: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 1.35k op/s 2024-04-26T11:35:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:35:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.282+0000 7f1cfe200640 1 -- 172.21.15.110:0/2895813376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf811c110 msgr2=0x7f1cf811e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.282+0000 7f1cfe200640 1 --2- 172.21.15.110:0/2895813376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf811c110 0x7f1cf811e500 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009900 tx=0x7f1ce802a3f0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.282+0000 7f1cfe200640 1 -- 172.21.15.110:0/2895813376 shutdown_connections 2024-04-26T11:35:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.282+0000 7f1cfe200640 1 --2- 172.21.15.110:0/2895813376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf811c110 0x7f1cf811e500 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.282+0000 7f1cfe200640 1 --2- 172.21.15.110:0/2895813376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf8109e70 0x7f1cf810a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.282+0000 7f1cfe200640 1 --2- 172.21.15.110:0/2895813376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf8111170 0x7f1cf8109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.282+0000 7f1cfe200640 1 -- 172.21.15.110:0/2895813376 >> 172.21.15.110:0/2895813376 conn(0x7f1cf806dec0 msgr2=0x7f1cf8073850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.283+0000 7f1cfe200640 1 -- 172.21.15.110:0/2895813376 shutdown_connections 2024-04-26T11:35:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.283+0000 7f1cfe200640 1 -- 172.21.15.110:0/2895813376 wait complete. 2024-04-26T11:35:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.284+0000 7f1cfe200640 1 Processor -- start 2024-04-26T11:35:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.284+0000 7f1cfe200640 1 -- start start 2024-04-26T11:35:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.285+0000 7f1cfe200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf8109e70 0x7f1cf81a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.285+0000 7f1cfe200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf8111170 0x7f1cf81a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.285+0000 7f1cfe200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf811c110 0x7f1cf81ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.285+0000 7f1cfe200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8121a00 con 0x7f1cf811c110 2024-04-26T11:35:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.285+0000 7f1cfe200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8121880 con 0x7f1cf8109e70 2024-04-26T11:35:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.285+0000 7f1cfe200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8121b80 con 0x7f1cf8111170 2024-04-26T11:35:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.286+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf8111170 0x7f1cf81a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.286+0000 7f1cf7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf811c110 0x7f1cf81ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.286+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf8111170 0x7f1cf81a83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:47042/0 (socket says 172.21.15.110:47042) 2024-04-26T11:35:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.286+0000 7f1cf6a00640 1 -- 172.21.15.110:0/3173886905 learned_addr learned my addr 172.21.15.110:0/3173886905 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.287+0000 7f1cf7400640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf8109e70 0x7f1cf81a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.287+0000 7f1cf6a00640 1 -- 172.21.15.110:0/3173886905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf8109e70 msgr2=0x7f1cf81a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf8109e70 0x7f1cf81a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cf6a00640 1 -- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf811c110 msgr2=0x7f1cf81ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf811c110 0x7f1cf81ac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cf6a00640 1 -- 172.21.15.110:0/3173886905 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf81ace20 con 0x7f1cf8111170 2024-04-26T11:35:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cf7400640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf8109e70 0x7f1cf81a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:35:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cf7e00640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf811c110 0x7f1cf81ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf8111170 0x7f1cf81a83c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400e9f0 tx=0x7f1ce400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cefe00640 1 -- 172.21.15.110:0/3173886905 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400cd80 con 0x7f1cf8111170 2024-04-26T11:35:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cefe00640 1 -- 172.21.15.110:0/3173886905 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce40108e0 con 0x7f1cf8111170 2024-04-26T11:35:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.288+0000 7f1cefe00640 1 -- 172.21.15.110:0/3173886905 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4018860 con 0x7f1cf8111170 2024-04-26T11:35:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.289+0000 7f1cfe200640 1 -- 172.21.15.110:0/3173886905 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf81ad110 con 0x7f1cf8111170 2024-04-26T11:35:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.289+0000 7f1cfe200640 1 -- 172.21.15.110:0/3173886905 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf81118f0 con 0x7f1cf8111170 2024-04-26T11:35:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:31 smithi110 ceph-mon[28069]: pgmap v130: 97 pgs: 97 active+clean; 1.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 1.35k op/s 2024-04-26T11:35:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:35:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.295+0000 7f1cefe00640 1 -- 172.21.15.110:0/3173886905 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f1ce4010430 con 0x7f1cf8111170 2024-04-26T11:35:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.297+0000 7f1cefe00640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1cdc0a3f10 0x7f1cdc0a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.297+0000 7f1cefe00640 1 -- 172.21.15.110:0/3173886905 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f1ce40d0ce0 con 0x7f1cf8111170 2024-04-26T11:35:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.298+0000 7f1cf7400640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1cdc0a3f10 0x7f1cdc0a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.300+0000 7f1cf7400640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1cdc0a3f10 0x7f1cdc0a63d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1cf806a650 tx=0x7f1cf00073c0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.300+0000 7f1d0107d740 1 Processor -- start 2024-04-26T11:35:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.300+0000 7f1d0107d740 1 -- start start 2024-04-26T11:35:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9ced8dd0 0x560d9ced91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9cee3fb0 0x560d9cee63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1d0107d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560d9ce3e380 con 0x560d9ced8dd0 2024-04-26T11:35:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1d0107d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560d9cddac30 con 0x560d9cee3fb0 2024-04-26T11:35:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1d0107d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560d9ce3a340 con 0x560d9ced96f0 2024-04-26T11:35:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:53482/0 (socket says 172.21.15.110:53482) 2024-04-26T11:35:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1cf6a00640 1 -- 172.21.15.110:0/2310935812 learned_addr learned my addr 172.21.15.110:0/2310935812 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1cf6a00640 1 -- 172.21.15.110:0/2310935812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9cee3fb0 msgr2=0x560d9cee63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/2310935812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9cee3fb0 0x560d9cee63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1cf6a00640 1 -- 172.21.15.110:0/2310935812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9ced8dd0 msgr2=0x560d9ced91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/2310935812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9ced8dd0 0x560d9ced91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.301+0000 7f1cf6a00640 1 -- 172.21.15.110:0/2310935812 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d9cdfc940 con 0x560d9ced96f0 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.302+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/2310935812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee3a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40a52e0 tx=0x7f1ce4010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12e5de7c974c5a86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.302+0000 7f1ce3e00640 1 -- 172.21.15.110:0/2310935812 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40a5810 con 0x560d9ced96f0 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.302+0000 7f1ce3e00640 1 -- 172.21.15.110:0/2310935812 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ce4010a90 con 0x560d9ced96f0 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.302+0000 7f1ce3e00640 1 -- 172.21.15.110:0/2310935812 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40ce7d0 con 0x560d9ced96f0 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.303+0000 7f1d0107d740 1 -- 172.21.15.110:0/2310935812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 msgr2=0x560d9cee3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.303+0000 7f1d0107d740 1 --2- 172.21.15.110:0/2310935812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee3a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40a52e0 tx=0x7f1ce4010860 comp rx=0 tx=0).stop 2024-04-26T11:35:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.304+0000 7f1d0107d740 1 -- 172.21.15.110:0/2310935812 shutdown_connections 2024-04-26T11:35:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.304+0000 7f1d0107d740 1 --2- 172.21.15.110:0/2310935812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9cee3fb0 0x560d9cee63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.304+0000 7f1d0107d740 1 --2- 172.21.15.110:0/2310935812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee3a70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.304+0000 7f1d0107d740 1 --2- 172.21.15.110:0/2310935812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9ced8dd0 0x560d9ced91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.304+0000 7f1d0107d740 1 -- 172.21.15.110:0/2310935812 >> 172.21.15.110:0/2310935812 conn(0x560d9ced52e0 msgr2=0x560d9ced56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.304+0000 7f1d0107d740 1 -- 172.21.15.110:0/2310935812 shutdown_connections 2024-04-26T11:35:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.305+0000 7f1d0107d740 1 -- 172.21.15.110:0/2310935812 wait complete. 2024-04-26T11:35:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.305+0000 7f1d0107d740 1 -- start start 2024-04-26T11:35:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.306+0000 7f1d0107d740 1 Processor -- start 2024-04-26T11:35:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced8dd0 0x560d9cee0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced96f0 0x560d9cee1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 0x560d9cee1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced8dd0 0x560d9cee0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced8dd0 0x560d9cee0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:53492/0 (socket says 172.21.15.110:53492) 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced96f0 0x560d9cee1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced96f0 0x560d9cee1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:49962/0 (socket says 172.21.15.110:49962) 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1cf7400640 1 -- 172.21.15.110:0/3192539794 learned_addr learned my addr 172.21.15.110:0/3192539794 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560d9cee6b80 con 0x560d9cee3fb0 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560d9cdc5c60 con 0x560d9ced96f0 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560d9cee6d00 con 0x560d9ced8dd0 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.307+0000 7f1cf7e00640 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 0x560d9cee1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1cf6a00640 1 -- 172.21.15.110:0/3192539794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced8dd0 msgr2=0x560d9cee0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced8dd0 0x560d9cee0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1cf6a00640 1 -- 172.21.15.110:0/3192539794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 msgr2=0x560d9cee1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 0x560d9cee1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1cf6a00640 1 -- 172.21.15.110:0/3192539794 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d9cdd4510 con 0x560d9ced96f0 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1cf7400640 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced8dd0 0x560d9cee0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1d0107d740 10 client.0 _ll_register_callbacks cb 0x560d9cdf1e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ce4010a90 con 0x560d9ced96f0 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced96f0 0x560d9cee1510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ce409cb30 tx=0x7f1ce4009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb5bcb9321b82083 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1ce0c00640 10 client.25664 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1ce0c00640 1 -- 172.21.15.110:0/3192539794 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40b5030 con 0x560d9ced96f0 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1ce0c00640 1 -- 172.21.15.110:0/3192539794 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f1ce409bff0 con 0x560d9ced96f0 2024-04-26T11:35:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1ce0c00640 1 -- 172.21.15.110:0/3192539794 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1ce409c230 con 0x560d9ced96f0 2024-04-26T11:35:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1d0107d740 10 client.25664 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.308+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({fsmap=34}) -- 0x560d9cb50210 con 0x560d9ced96f0 2024-04-26T11:35:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.310+0000 7f1ce0c00640 1 -- 172.21.15.110:0/3192539794 <== mon.2 v2:172.21.15.193:3300/0 4 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f1ce40988f0 con 0x560d9ced96f0 2024-04-26T11:35:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.311+0000 7f1d0107d740 10 client.25664 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.311+0000 7f1d0107d740 10 client.25664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.311+0000 7f1d0107d740 20 client.25664 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.312+0000 7f1d0107d740 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560d9cef3880 0x560d9cef5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.312+0000 7f1d0107d740 4 client.25664 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:35:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.312+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d9ce4bf90 con 0x560d9cef3880 2024-04-26T11:35:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.312+0000 7f1cf7400640 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560d9cef3880 0x560d9cef5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.314+0000 7f1cf7400640 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560d9cef3880 0x560d9cef5c70 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de8cfed8fb2e2a7f server_cookie=5307fbed163af8a in_seq=0 out_seq=0 2024-04-26T11:35:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.314+0000 7f1ce0c00640 10 client.25664 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:32.316 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.315+0000 7f1ce0c00640 1 -- 172.21.15.110:0/3192539794 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560d9ce4bf90 con 0x560d9cef3880 2024-04-26T11:35:32.316 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.315+0000 7f1ce0c00640 10 client.25664 handle_command_reply: tid=0 2024-04-26T11:35:32.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.316+0000 7f1d0107d740 1 client.25664 shutdown 2024-04-26T11:35:32.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.316+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced96f0 msgr2=0x560d9cee1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:32.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.316+0000 7f1d0107d740 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced96f0 0x560d9cee1510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1ce409cb30 tx=0x7f1ce4009310 comp rx=0 tx=0).stop 2024-04-26T11:35:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.317+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 shutdown_connections 2024-04-26T11:35:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.317+0000 7f1d0107d740 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 0x560d9cee1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.317+0000 7f1d0107d740 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced96f0 0x560d9cee1510 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.317+0000 7f1d0107d740 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560d9cef3880 0x560d9cef5c70 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.317+0000 7f1d0107d740 1 --2- 172.21.15.110:0/3192539794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced8dd0 0x560d9cee0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.317+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 >> 172.21.15.110:0/3192539794 conn(0x560d9ced52e0 msgr2=0x560d9cedb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.317+0000 7f1ce0c00640 0 client.25664 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.317+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 shutdown_connections 2024-04-26T11:35:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.317+0000 7f1d0107d740 1 -- 172.21.15.110:0/3192539794 wait complete. 2024-04-26T11:35:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.318+0000 7f1d0107d740 20 client.25664 trim_cache size 0 max 16384 2024-04-26T11:35:32.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.348+0000 7f1d0107d740 1 Processor -- start 2024-04-26T11:35:32.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.348+0000 7f1d0107d740 1 -- start start 2024-04-26T11:35:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceefa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 0x560d9cefb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1d0107d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81c87f0 con 0x560d9cee3fb0 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1d0107d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81c6030 con 0x560d9ced8dd0 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1d0107d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81185d0 con 0x560d9ced96f0 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceefa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1cf6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:53498/0 (socket says 172.21.15.110:53498) 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1cf6a00640 1 -- 172.21.15.110:0/2512611998 learned_addr learned my addr 172.21.15.110:0/2512611998 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceefa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:49968/0 (socket says 172.21.15.110:49968) 2024-04-26T11:35:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.349+0000 7f1cf7e00640 1 --2- 172.21.15.110:0/2512611998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 0x560d9cefb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.350+0000 7f1cf7400640 1 -- 172.21.15.110:0/2512611998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 msgr2=0x560d9cee2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.350+0000 7f1cf7400640 1 --2- 172.21.15.110:0/2512611998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.350+0000 7f1cf7400640 1 -- 172.21.15.110:0/2512611998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 msgr2=0x560d9cefb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.350+0000 7f1cf7400640 1 --2- 172.21.15.110:0/2512611998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 0x560d9cefb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.350+0000 7f1cf7400640 1 -- 172.21.15.110:0/2512611998 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d9cc1c620 con 0x560d9ced8dd0 2024-04-26T11:35:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.351+0000 7f1cf7400640 1 --2- 172.21.15.110:0/2512611998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceefa40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x560d9cee6e50 tx=0x7f1cf000f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53ad5c9b6681b3e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.352+0000 7f1ce3400640 1 -- 172.21.15.110:0/2512611998 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf002a070 con 0x560d9ced8dd0 2024-04-26T11:35:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.353+0000 7f1ce3400640 1 -- 172.21.15.110:0/2512611998 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf0015050 con 0x560d9ced8dd0 2024-04-26T11:35:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.353+0000 7f1ce3400640 1 -- 172.21.15.110:0/2512611998 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf001da20 con 0x560d9ced8dd0 2024-04-26T11:35:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.354+0000 7f1d0107d740 1 -- 172.21.15.110:0/2512611998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 msgr2=0x560d9ceefa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.354+0000 7f1d0107d740 1 --2- 172.21.15.110:0/2512611998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceefa40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x560d9cee6e50 tx=0x7f1cf000f000 comp rx=0 tx=0).stop 2024-04-26T11:35:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.354+0000 7f1d0107d740 1 -- 172.21.15.110:0/2512611998 shutdown_connections 2024-04-26T11:35:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.354+0000 7f1d0107d740 1 --2- 172.21.15.110:0/2512611998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9cee3fb0 0x560d9cefb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.354+0000 7f1d0107d740 1 --2- 172.21.15.110:0/2512611998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9ced96f0 0x560d9cee2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.354+0000 7f1d0107d740 1 --2- 172.21.15.110:0/2512611998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceefa40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.354+0000 7f1d0107d740 1 -- 172.21.15.110:0/2512611998 >> 172.21.15.110:0/2512611998 conn(0x560d9ced52e0 msgr2=0x560d9cee26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.354+0000 7f1d0107d740 1 -- 172.21.15.110:0/2512611998 shutdown_connections 2024-04-26T11:35:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.354+0000 7f1d0107d740 1 -- 172.21.15.110:0/2512611998 wait complete. 2024-04-26T11:35:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.355+0000 7f1d0107d740 1 -- start start 2024-04-26T11:35:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.356+0000 7f1d0107d740 1 Processor -- start 2024-04-26T11:35:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceebf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9ced96f0 0x560d9ceec490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1d0107d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9cee3fb0 0x560d9cee8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1d0107d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8118c40 con 0x560d9ced96f0 2024-04-26T11:35:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1d0107d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf81c59b0 con 0x560d9ced8dd0 2024-04-26T11:35:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1d0107d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf8119310 con 0x560d9cee3fb0 2024-04-26T11:35:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1d0107d740 10 client.0 _ll_register_callbacks cb 0x7f1ce40a0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceebf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceebf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:49976/0 (socket says 172.21.15.110:49976) 2024-04-26T11:35:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.357+0000 7f1cf7400640 1 -- 172.21.15.110:0/868419911 learned_addr learned my addr 172.21.15.110:0/868419911 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.358+0000 7f1cf7400640 1 -- 172.21.15.110:0/868419911 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9cee3fb0 msgr2=0x560d9cee8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.358+0000 7f1cf7400640 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9cee3fb0 0x560d9cee8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.358+0000 7f1cf7400640 1 -- 172.21.15.110:0/868419911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9ced96f0 msgr2=0x560d9ceec490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.358+0000 7f1cf7400640 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9ced96f0 0x560d9ceec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.358+0000 7f1cf7400640 1 -- 172.21.15.110:0/868419911 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d9cdf8cb0 con 0x560d9ced8dd0 2024-04-26T11:35:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.361+0000 7f1cf7400640 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceebf50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0004b90 tx=0x7f1cf0024520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f851e16d2e0a0301 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:32.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.362+0000 7f1ce0c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:35:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.362+0000 7f1ce0c00640 1 -- 172.21.15.110:0/868419911 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf002a040 con 0x560d9ced8dd0 2024-04-26T11:35:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.362+0000 7f1d0107d740 1 -- 172.21.15.110:0/868419911 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf0015050 con 0x560d9ced8dd0 2024-04-26T11:35:32.363 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.363+0000 7f1ce0c00640 1 -- 172.21.15.110:0/868419911 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f1cf0024810 con 0x560d9ced8dd0 2024-04-26T11:35:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.363+0000 7f1ce0c00640 1 -- 172.21.15.110:0/868419911 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1cf003c050 con 0x560d9ced8dd0 2024-04-26T11:35:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.363+0000 7f1d0107d740 10 client.25670 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:32.364 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.363+0000 7f1d0107d740 1 -- 172.21.15.110:0/868419911 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560d9cf5a2d0 con 0x560d9ced8dd0 2024-04-26T11:35:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.364+0000 7f1ce0c00640 1 -- 172.21.15.110:0/868419911 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf0015050 con 0x560d9ced8dd0 2024-04-26T11:35:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.364+0000 7f1ce0c00640 1 -- 172.21.15.110:0/868419911 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f1cf002e420 con 0x560d9ced8dd0 2024-04-26T11:35:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.365+0000 7f1d0107d740 10 client.25670 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.365+0000 7f1d0107d740 10 client.25670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.365+0000 7f1d0107d740 20 client.25670 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.365+0000 7f1d0107d740 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560d9cf5a8e0 0x560d9cf5ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.366+0000 7f1d0107d740 4 client.25670 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:35:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.366+0000 7f1d0107d740 1 -- 172.21.15.110:0/868419911 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d9ce45e00 con 0x560d9cf5a8e0 2024-04-26T11:35:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.367+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560d9cf5a8e0 0x560d9cf5ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.368+0000 7f1cf6a00640 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560d9cf5a8e0 0x560d9cf5ccf0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ba92e6b71aac860 server_cookie=b1656f09af26b866 in_seq=0 out_seq=0 2024-04-26T11:35:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.368+0000 7f1ce0c00640 10 client.25670 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.382+0000 7f1ce0c00640 1 -- 172.21.15.110:0/868419911 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d9ce45e00 con 0x560d9cf5a8e0 2024-04-26T11:35:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.382+0000 7f1ce0c00640 10 client.25670 handle_command_reply: tid=0 2024-04-26T11:35:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.382+0000 7f1d0107d740 1 client.25670 shutdown 2024-04-26T11:35:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.383+0000 7f1d0107d740 1 -- 172.21.15.110:0/868419911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 msgr2=0x560d9ceebf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.383+0000 7f1d0107d740 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceebf50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0004b90 tx=0x7f1cf0024520 comp rx=0 tx=0).stop 2024-04-26T11:35:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.383+0000 7f1d0107d740 1 -- 172.21.15.110:0/868419911 shutdown_connections 2024-04-26T11:35:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.383+0000 7f1d0107d740 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560d9cf5a8e0 0x560d9cf5ccf0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.383+0000 7f1d0107d740 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560d9cee3fb0 0x560d9cee8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.383+0000 7f1d0107d740 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d9ced96f0 0x560d9ceec490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.384+0000 7f1ce0c00640 0 client.25670 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.384+0000 7f1d0107d740 1 --2- 172.21.15.110:0/868419911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560d9ced8dd0 0x560d9ceebf50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.384+0000 7f1d0107d740 1 -- 172.21.15.110:0/868419911 >> 172.21.15.110:0/868419911 conn(0x560d9ced52e0 msgr2=0x560d9cedb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.384+0000 7f1d0107d740 1 -- 172.21.15.110:0/868419911 shutdown_connections 2024-04-26T11:35:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.385+0000 7f1d0107d740 1 -- 172.21.15.110:0/868419911 wait complete. 2024-04-26T11:35:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.385+0000 7f1d0107d740 20 client.25670 trim_cache size 0 max 16384 2024-04-26T11:35:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:35:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:35:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:35:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:35:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.386+0000 7f1cfe200640 1 -- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1cdc0a3f10 msgr2=0x7f1cdc0a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:32.387 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.386+0000 7f1cfe200640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1cdc0a3f10 0x7f1cdc0a63d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1cf806a650 tx=0x7f1cf00073c0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.387+0000 7f1cfe200640 1 -- 172.21.15.110:0/3173886905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf8111170 msgr2=0x7f1cf81a83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.387+0000 7f1cfe200640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf8111170 0x7f1cf81a83c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400e9f0 tx=0x7f1ce400eeb0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.387+0000 7f1cfe200640 1 -- 172.21.15.110:0/3173886905 shutdown_connections 2024-04-26T11:35:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.387+0000 7f1cfe200640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1cdc0a3f10 0x7f1cdc0a63d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.387+0000 7f1cfe200640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1cf811c110 0x7f1cf81ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.387+0000 7f1cfe200640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cf8111170 0x7f1cf81a83c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.387+0000 7f1cfe200640 1 --2- 172.21.15.110:0/3173886905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cf8109e70 0x7f1cf81a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:32.388 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.387+0000 7f1cfe200640 1 -- 172.21.15.110:0/3173886905 >> 172.21.15.110:0/3173886905 conn(0x7f1cf806dec0 msgr2=0x7f1cf8110120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.387+0000 7f1cfe200640 1 -- 172.21.15.110:0/3173886905 shutdown_connections 2024-04-26T11:35:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:32.388+0000 7f1cfe200640 1 -- 172.21.15.110:0/3173886905 wait complete. 2024-04-26T11:35:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:33 smithi193 ceph-mon[32782]: pgmap v131: 97 pgs: 97 active+clean; 2.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 29 MiB/s wr, 1.50k op/s 2024-04-26T11:35:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:35:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:35:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:35:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:33 smithi196 ceph-mon[32572]: pgmap v131: 97 pgs: 97 active+clean; 2.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 29 MiB/s wr, 1.50k op/s 2024-04-26T11:35:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:35:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:35:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:35:34.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:33 smithi110 ceph-mon[28069]: pgmap v131: 97 pgs: 97 active+clean; 2.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 29 MiB/s wr, 1.50k op/s 2024-04-26T11:35:34.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:35:34.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:35:34.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:35:34.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 200.0 s, 2700.2 tps, lat 36.635 ms stddev 40.459 2024-04-26T11:35:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:35 smithi193 ceph-mon[32782]: pgmap v132: 97 pgs: 97 active+clean; 2.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 22 MiB/s wr, 1.24k op/s 2024-04-26T11:35:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:35 smithi196 ceph-mon[32572]: pgmap v132: 97 pgs: 97 active+clean; 2.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 22 MiB/s wr, 1.24k op/s 2024-04-26T11:35:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:35 smithi110 ceph-mon[28069]: pgmap v132: 97 pgs: 97 active+clean; 2.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 22 MiB/s wr, 1.24k op/s 2024-04-26T11:35:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:37 smithi193 ceph-mon[32782]: pgmap v133: 97 pgs: 97 active+clean; 2.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 MiB/s wr, 606 op/s 2024-04-26T11:35:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:37 smithi196 ceph-mon[32572]: pgmap v133: 97 pgs: 97 active+clean; 2.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 MiB/s wr, 606 op/s 2024-04-26T11:35:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:37 smithi110 ceph-mon[28069]: pgmap v133: 97 pgs: 97 active+clean; 2.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 MiB/s wr, 606 op/s 2024-04-26T11:35:39.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 205.0 s, 3099.2 tps, lat 32.496 ms stddev 38.087 2024-04-26T11:35:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:39 smithi193 ceph-mon[32782]: pgmap v134: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.02k op/s 2024-04-26T11:35:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:39 smithi196 ceph-mon[32572]: pgmap v134: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.02k op/s 2024-04-26T11:35:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:39 smithi110 ceph-mon[28069]: pgmap v134: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.02k op/s 2024-04-26T11:35:40.922 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.7 2024-04-26T11:35:40.923 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:35:41.543 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:35:42.012 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:41 smithi110 ceph-mon[28069]: pgmap v135: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.4 MiB/s wr, 714 op/s 2024-04-26T11:35:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:41 smithi193 ceph-mon[32782]: pgmap v135: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.4 MiB/s wr, 714 op/s 2024-04-26T11:35:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:41 smithi196 ceph-mon[32572]: pgmap v135: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.4 MiB/s wr, 714 op/s 2024-04-26T11:35:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:43 smithi193 ceph-mon[32782]: pgmap v136: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.6 MiB/s wr, 813 op/s 2024-04-26T11:35:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:43 smithi196 ceph-mon[32572]: pgmap v136: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.6 MiB/s wr, 813 op/s 2024-04-26T11:35:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:43 smithi110 ceph-mon[28069]: pgmap v136: 97 pgs: 97 active+clean; 2.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.6 MiB/s wr, 813 op/s 2024-04-26T11:35:44.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 210.0 s, 2715.2 tps, lat 36.665 ms stddev 50.696 2024-04-26T11:35:44.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.950+0000 7f4a66600700 1 -- 172.21.15.110:0/497978659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a6006b130 msgr2=0x7f4a6006b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:44.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.950+0000 7f4a66600700 1 --2- 172.21.15.110:0/497978659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a6006b130 0x7f4a6006b590 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009990 tx=0x7f4a4c009ca0 comp rx=0 tx=0).stop 2024-04-26T11:35:44.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.951+0000 7f4a66600700 1 -- 172.21.15.110:0/497978659 shutdown_connections 2024-04-26T11:35:44.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.951+0000 7f4a66600700 1 --2- 172.21.15.110:0/497978659 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a6006bad0 0x7f4a601102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:44.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.951+0000 7f4a66600700 1 --2- 172.21.15.110:0/497978659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a601094a0 0x7f4a60109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:44.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.951+0000 7f4a66600700 1 --2- 172.21.15.110:0/497978659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a6006b130 0x7f4a6006b590 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:44.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.951+0000 7f4a66600700 1 -- 172.21.15.110:0/497978659 >> 172.21.15.110:0/497978659 conn(0x7f4a600792d0 msgr2=0x7f4a600796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:44.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.951+0000 7f4a66600700 1 -- 172.21.15.110:0/497978659 shutdown_connections 2024-04-26T11:35:44.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.951+0000 7f4a66600700 1 -- 172.21.15.110:0/497978659 wait complete. 2024-04-26T11:35:44.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.953+0000 7f4a66600700 1 Processor -- start 2024-04-26T11:35:44.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.953+0000 7f4a66600700 1 -- start start 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.953+0000 7f4a66600700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a6006b130 0x7f4a6019f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.953+0000 7f4a66600700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a6006bad0 0x7f4a6019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.953+0000 7f4a66600700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a601094a0 0x7f4a60199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.953+0000 7f4a66600700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4a601135d0 con 0x7f4a6006bad0 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.953+0000 7f4a66600700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4a60113450 con 0x7f4a601094a0 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.953+0000 7f4a66600700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4a60113750 con 0x7f4a6006b130 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.954+0000 7f4a5f400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a6006b130 0x7f4a6019f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.954+0000 7f4a5f400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a6006b130 0x7f4a6019f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39230/0 (socket says 172.21.15.110:39230) 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.954+0000 7f4a5f400700 1 -- 172.21.15.110:0/534816274 learned_addr learned my addr 172.21.15.110:0/534816274 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:44.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.954+0000 7f4a5fe00700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a601094a0 0x7f4a60199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:44.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.954+0000 7f4a5ea00700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a6006bad0 0x7f4a6019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:44.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.954+0000 7f4a5f400700 1 -- 172.21.15.110:0/534816274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a601094a0 msgr2=0x7f4a60199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:44.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.955+0000 7f4a5f400700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a601094a0 0x7f4a60199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:44.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.955+0000 7f4a5f400700 1 -- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a6006bad0 msgr2=0x7f4a6019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:44.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.955+0000 7f4a5f400700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a6006bad0 0x7f4a6019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:44.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.955+0000 7f4a5f400700 1 -- 172.21.15.110:0/534816274 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6019a0d0 con 0x7f4a6006b130 2024-04-26T11:35:44.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.955+0000 7f4a5fe00700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a601094a0 0x7f4a60199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:35:44.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.955+0000 7f4a5ea00700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a6006bad0 0x7f4a6019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:35:44.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.955+0000 7f4a5f400700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a6006b130 0x7f4a6019f7b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000d980 tx=0x7f4a5000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:44.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.957+0000 7f4a57e00700 1 -- 172.21.15.110:0/534816274 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50016070 con 0x7f4a6006b130 2024-04-26T11:35:44.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.957+0000 7f4a57e00700 1 -- 172.21.15.110:0/534816274 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a50004830 con 0x7f4a6006b130 2024-04-26T11:35:44.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.957+0000 7f4a57e00700 1 -- 172.21.15.110:0/534816274 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a500054c0 con 0x7f4a6006b130 2024-04-26T11:35:44.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.957+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6019a3c0 con 0x7f4a6006b130 2024-04-26T11:35:44.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.958+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a601a6680 con 0x7f4a6006b130 2024-04-26T11:35:44.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.960+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a6006a110 con 0x7f4a6006b130 2024-04-26T11:35:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.961+0000 7f4a57e00700 1 -- 172.21.15.110:0/534816274 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f4a50004220 con 0x7f4a6006b130 2024-04-26T11:35:44.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.963+0000 7f4a57e00700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4a440a3f00 0x7f4a440a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:44.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.963+0000 7f4a57e00700 1 -- 172.21.15.110:0/534816274 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f4a500d0380 con 0x7f4a6006b130 2024-04-26T11:35:44.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.963+0000 7f4a5ea00700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4a440a3f00 0x7f4a440a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:44.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.965+0000 7f4a5ea00700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4a440a3f00 0x7f4a440a63c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00b2e0 tx=0x7f4a4c005e80 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:44.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:44.967+0000 7f4a57e00700 1 -- 172.21.15.110:0/534816274 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4a5001f030 con 0x7f4a6006b130 2024-04-26T11:35:45.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.428+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a6002e490 con 0x7f4a6006b130 2024-04-26T11:35:45.431 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:35:45.431 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:35:06.023389+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24502,24518,24487]},"id":1}]} 2024-04-26T11:35:45.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.429+0000 7f4a57e00700 1 -- 172.21.15.110:0/534816274 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11893 (secure 0 0 0) 0x7f4a5009c940 con 0x7f4a6006b130 2024-04-26T11:35:45.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.433+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4a440a3f00 msgr2=0x7f4a440a63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.433+0000 7f4a66600700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4a440a3f00 0x7f4a440a63c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00b2e0 tx=0x7f4a4c005e80 comp rx=0 tx=0).stop 2024-04-26T11:35:45.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.433+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a6006b130 msgr2=0x7f4a6019f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.433+0000 7f4a66600700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a6006b130 0x7f4a6019f7b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000d980 tx=0x7f4a5000dc90 comp rx=0 tx=0).stop 2024-04-26T11:35:45.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.434+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 shutdown_connections 2024-04-26T11:35:45.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.434+0000 7f4a66600700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4a440a3f00 0x7f4a440a63c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.434+0000 7f4a66600700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4a601094a0 0x7f4a60199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.434+0000 7f4a66600700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a6006b130 0x7f4a6019f7b0 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000d980 tx=0x7f4a5000dc90 comp rx=0 tx=0).stop 2024-04-26T11:35:45.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.434+0000 7f4a66600700 1 --2- 172.21.15.110:0/534816274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a6006bad0 0x7f4a6019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.434+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 >> 172.21.15.110:0/534816274 conn(0x7f4a600792d0 msgr2=0x7f4a601004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:45.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.435+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 shutdown_connections 2024-04-26T11:35:45.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:45.435+0000 7f4a66600700 1 -- 172.21.15.110:0/534816274 wait complete. 2024-04-26T11:35:45.438 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 34 2024-04-26T11:35:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.592+0000 7f1dda800640 1 -- 172.21.15.110:0/2867175585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd4108920 msgr2=0x7f1dd4108d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.592+0000 7f1dda800640 1 --2- 172.21.15.110:0/2867175585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd4108920 0x7f1dd4108d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009890 tx=0x7f1dc402a360 comp rx=0 tx=0).stop 2024-04-26T11:35:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.592+0000 7f1dda800640 1 -- 172.21.15.110:0/2867175585 shutdown_connections 2024-04-26T11:35:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.592+0000 7f1dda800640 1 --2- 172.21.15.110:0/2867175585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd41032d0 0x7f1dd410f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.592+0000 7f1dda800640 1 --2- 172.21.15.110:0/2867175585 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd4102910 0x7f1dd4102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.592+0000 7f1dda800640 1 --2- 172.21.15.110:0/2867175585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd4108920 0x7f1dd4108d00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.592+0000 7f1dda800640 1 -- 172.21.15.110:0/2867175585 >> 172.21.15.110:0/2867175585 conn(0x7f1dd4079dc0 msgr2=0x7f1dd407a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.593+0000 7f1dda800640 1 -- 172.21.15.110:0/2867175585 shutdown_connections 2024-04-26T11:35:45.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.593+0000 7f1dda800640 1 -- 172.21.15.110:0/2867175585 wait complete. 2024-04-26T11:35:45.595 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.595+0000 7f1dda800640 1 Processor -- start 2024-04-26T11:35:45.596 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.595+0000 7f1dda800640 1 -- start start 2024-04-26T11:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.596+0000 7f1dda800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4102910 0x7f1dd4199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.596+0000 7f1dda800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd41032d0 0x7f1dd4199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.596+0000 7f1dda800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd4108920 0x7f1dd419d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.596+0000 7f1dda800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd4112bb0 con 0x7f1dd4102910 2024-04-26T11:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.596+0000 7f1dda800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd4112a30 con 0x7f1dd41032d0 2024-04-26T11:35:45.597 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.596+0000 7f1dda800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd4112d30 con 0x7f1dd4108920 2024-04-26T11:35:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.597+0000 7f1dd3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4102910 0x7f1dd4199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.597+0000 7f1dd3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4102910 0x7f1dd4199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55142/0 (socket says 172.21.15.110:55142) 2024-04-26T11:35:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.597+0000 7f1dd2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd41032d0 0x7f1dd4199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.597+0000 7f1dd3400640 1 -- 172.21.15.110:0/3540803897 learned_addr learned my addr 172.21.15.110:0/3540803897 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:45.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.597+0000 7f1dd3e00640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd4108920 0x7f1dd419d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.598+0000 7f1dd2a00640 1 -- 172.21.15.110:0/3540803897 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd4108920 msgr2=0x7f1dd419d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.598+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd4108920 0x7f1dd419d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.598+0000 7f1dd2a00640 1 -- 172.21.15.110:0/3540803897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4102910 msgr2=0x7f1dd4199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.598+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4102910 0x7f1dd4199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.598+0000 7f1dd2a00640 1 -- 172.21.15.110:0/3540803897 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd419e100 con 0x7f1dd41032d0 2024-04-26T11:35:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.598+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd41032d0 0x7f1dd4199650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000e790 tx=0x7f1dc000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.598+0000 7f1dcbe00640 1 -- 172.21.15.110:0/3540803897 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0020070 con 0x7f1dd41032d0 2024-04-26T11:35:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.598+0000 7f1dcbe00640 1 -- 172.21.15.110:0/3540803897 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc000ccc0 con 0x7f1dd41032d0 2024-04-26T11:35:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.598+0000 7f1dda800640 1 -- 172.21.15.110:0/3540803897 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd419e3f0 con 0x7f1dd41032d0 2024-04-26T11:35:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.599+0000 7f1dcbe00640 1 -- 172.21.15.110:0/3540803897 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc001b8e0 con 0x7f1dd41032d0 2024-04-26T11:35:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.599+0000 7f1dda800640 1 -- 172.21.15.110:0/3540803897 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd4074b60 con 0x7f1dd41032d0 2024-04-26T11:35:45.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.604+0000 7f1ddd7c3740 1 Processor -- start 2024-04-26T11:35:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.605+0000 7f1ddd7c3740 1 -- start start 2024-04-26T11:35:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.605+0000 7f1dcbe00640 1 -- 172.21.15.110:0/3540803897 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f1dc0023070 con 0x7f1dd41032d0 2024-04-26T11:35:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.605+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55bdd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.606+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bf0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.606+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bf07c0 0x557f55bf2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.606+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557f55b42380 con 0x557f55bdcd10 2024-04-26T11:35:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.606+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557f55adec30 con 0x557f55bf07c0 2024-04-26T11:35:45.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.606+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557f55b3e340 con 0x557f55bdd630 2024-04-26T11:35:45.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.606+0000 7f1dd3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bf0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.606+0000 7f1dd3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bf0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39252/0 (socket says 172.21.15.110:39252) 2024-04-26T11:35:45.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.606+0000 7f1dd3400640 1 -- 172.21.15.110:0/1329391205 learned_addr learned my addr 172.21.15.110:0/1329391205 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:45.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.606+0000 7f1dd3e00640 1 --2- 172.21.15.110:0/1329391205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55bdd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.607+0000 7f1dd3400640 1 -- 172.21.15.110:0/1329391205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bf07c0 msgr2=0x557f55bf2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:45.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.607+0000 7f1dd3400640 1 --2- 172.21.15.110:0/1329391205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bf07c0 0x557f55bf2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.607+0000 7f1dd3400640 1 -- 172.21.15.110:0/1329391205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 msgr2=0x557f55bdd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:45.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.607+0000 7f1dd3400640 1 --2- 172.21.15.110:0/1329391205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55bdd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.607+0000 7f1dd3400640 1 -- 172.21.15.110:0/1329391205 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f55b00940 con 0x557f55bdd630 2024-04-26T11:35:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.607+0000 7f1dd3400640 1 --2- 172.21.15.110:0/1329391205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bf0280 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40099b0 tx=0x7f1dc402ac60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dda197b2c159e692 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.607+0000 7f1dc8c00640 1 -- 172.21.15.110:0/1329391205 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4041020 con 0x557f55bdd630 2024-04-26T11:35:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.607+0000 7f1dc8c00640 1 -- 172.21.15.110:0/1329391205 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc4030d20 con 0x557f55bdd630 2024-04-26T11:35:45.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.607+0000 7f1dc8c00640 1 -- 172.21.15.110:0/1329391205 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4037040 con 0x557f55bdd630 2024-04-26T11:35:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.608+0000 7f1dcbe00640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1db80a3e40 0x7f1db80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.608+0000 7f1dcbe00640 1 -- 172.21.15.110:0/3540803897 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f1dc00d4710 con 0x7f1dd41032d0 2024-04-26T11:35:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.608+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/1329391205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 msgr2=0x557f55bf0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.608+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/1329391205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bf0280 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40099b0 tx=0x7f1dc402ac60 comp rx=0 tx=0).stop 2024-04-26T11:35:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.609+0000 7f1dd3e00640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1db80a3e40 0x7f1db80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.609+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/1329391205 shutdown_connections 2024-04-26T11:35:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.609+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/1329391205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bf07c0 0x557f55bf2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.609+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/1329391205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bf0280 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.609+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/1329391205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55bdd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.609+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/1329391205 >> 172.21.15.110:0/1329391205 conn(0x557f55bd92e0 msgr2=0x557f55bd96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.610+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/1329391205 shutdown_connections 2024-04-26T11:35:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.610+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/1329391205 wait complete. 2024-04-26T11:35:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.611+0000 7f1dd3e00640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1db80a3e40 0x7f1db80a6300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00ad70 tx=0x7f1dcc00a420 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.611+0000 7f1ddd7c3740 1 -- start start 2024-04-26T11:35:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.611+0000 7f1ddd7c3740 1 Processor -- start 2024-04-26T11:35:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdcd10 0x557f55bed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bedc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bf07c0 0x557f55bee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557f55bf3330 con 0x557f55bf07c0 2024-04-26T11:35:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557f55ac9c60 con 0x557f55bdcd10 2024-04-26T11:35:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557f55bf34b0 con 0x557f55bdd630 2024-04-26T11:35:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1ddd7c3740 10 client.0 _ll_register_callbacks cb 0x557f55af5e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1dd3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdcd10 0x557f55bed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1dd3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdcd10 0x557f55bed6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:50788/0 (socket says 172.21.15.110:50788) 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1dd3400640 1 -- 172.21.15.110:0/951740349 learned_addr learned my addr 172.21.15.110:0/951740349 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.612+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bedc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.613+0000 7f1dd3400640 1 -- 172.21.15.110:0/951740349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 msgr2=0x557f55bedc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.613+0000 7f1dd3400640 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bedc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.613+0000 7f1dd3400640 1 -- 172.21.15.110:0/951740349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bf07c0 msgr2=0x557f55bee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.613+0000 7f1dd3400640 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bf07c0 0x557f55bee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.613+0000 7f1dd3400640 1 -- 172.21.15.110:0/951740349 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f55ad8510 con 0x557f55bdcd10 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.613+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bedc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.614+0000 7f1dd3400640 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdcd10 0x557f55bed6c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4035040 tx=0x7f1dc4004580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0486f4e65e8cebd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.614+0000 7f1dbd600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.614+0000 7f1dbd600640 1 -- 172.21.15.110:0/951740349 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4041030 con 0x557f55bdcd10 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.614+0000 7f1dbd600640 1 -- 172.21.15.110:0/951740349 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f1dc4030340 con 0x557f55bdcd10 2024-04-26T11:35:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.614+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/951740349 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc4030d20 con 0x557f55bdcd10 2024-04-26T11:35:45.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.614+0000 7f1dbd600640 1 -- 172.21.15.110:0/951740349 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1dc4037050 con 0x557f55bdcd10 2024-04-26T11:35:45.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.614+0000 7f1ddd7c3740 10 client.25685 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:45.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.614+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/951740349 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557f55854210 con 0x557f55bdcd10 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.615+0000 7f1dbd600640 1 -- 172.21.15.110:0/951740349 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc4030d20 con 0x557f55bdcd10 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.615+0000 7f1dbd600640 1 -- 172.21.15.110:0/951740349 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f1dc4067070 con 0x557f55bdcd10 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.615+0000 7f1ddd7c3740 10 client.25685 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.615+0000 7f1ddd7c3740 10 client.25685 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.615+0000 7f1ddd7c3740 20 client.25685 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.615+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557f55be0b70 0x557f55be2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.615+0000 7f1ddd7c3740 4 client.25685 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.615+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/951740349 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f55b4ff90 con 0x557f55be0b70 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.616+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557f55be0b70 0x557f55be2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.616+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557f55be0b70 0x557f55be2fc0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2182098aba794734 server_cookie=3e49564c885d1c73 in_seq=0 out_seq=0 2024-04-26T11:35:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.616+0000 7f1dbd600640 10 client.25685 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.617+0000 7f1dbd600640 1 -- 172.21.15.110:0/951740349 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557f55b4ff90 con 0x557f55be0b70 2024-04-26T11:35:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.617+0000 7f1dbd600640 10 client.25685 handle_command_reply: tid=0 2024-04-26T11:35:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.617+0000 7f1ddd7c3740 1 client.25685 shutdown 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.617+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/951740349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdcd10 msgr2=0x557f55bed6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.617+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdcd10 0x557f55bed6c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4035040 tx=0x7f1dc4004580 comp rx=0 tx=0).stop 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.618+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/951740349 shutdown_connections 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.618+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bf07c0 0x557f55bee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.618+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557f55be0b70 0x557f55be2fc0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.618+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bdd630 0x557f55bedc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.618+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/951740349 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdcd10 0x557f55bed6c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.618+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/951740349 >> 172.21.15.110:0/951740349 conn(0x557f55bd92e0 msgr2=0x557f55bdf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.618+0000 7f1dbd600640 0 client.25685 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.618+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/951740349 shutdown_connections 2024-04-26T11:35:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.619+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/951740349 wait complete. 2024-04-26T11:35:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.619+0000 7f1ddd7c3740 20 client.25685 trim_cache size 0 max 16384 2024-04-26T11:35:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.646+0000 7f1ddd7c3740 1 Processor -- start 2024-04-26T11:35:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.646+0000 7f1ddd7c3740 1 -- start start 2024-04-26T11:35:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.646+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55befdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.647+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdd630 0x557f55bee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.647+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55bfbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.648+0000 7f1dd3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55bfbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.648+0000 7f1dd3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55bfbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39260/0 (socket says 172.21.15.110:39260) 2024-04-26T11:35:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.648+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd41aeee0 con 0x557f55bdcd10 2024-04-26T11:35:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.648+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd41ac720 con 0x557f55bdd630 2024-04-26T11:35:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.648+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd41aa570 con 0x557f55bf07c0 2024-04-26T11:35:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.648+0000 7f1dd2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdd630 0x557f55bee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.648+0000 7f1dd2a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdd630 0x557f55bee1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:50792/0 (socket says 172.21.15.110:50792) 2024-04-26T11:35:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.648+0000 7f1dd2a00640 1 -- 172.21.15.110:0/588693475 learned_addr learned my addr 172.21.15.110:0/588693475 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:45.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.649+0000 7f1dd2a00640 1 -- 172.21.15.110:0/588693475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 msgr2=0x557f55bfbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:45.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.649+0000 7f1dd3400640 1 --2- 172.21.15.110:0/588693475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55befdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.649+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/588693475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55bfbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.649+0000 7f1dd2a00640 1 -- 172.21.15.110:0/588693475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 msgr2=0x557f55befdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.649+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/588693475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55befdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.649+0000 7f1dd2a00640 1 -- 172.21.15.110:0/588693475 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f55920620 con 0x557f55bdd630 2024-04-26T11:35:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.649+0000 7f1dd3e00640 1 --2- 172.21.15.110:0/588693475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55bfbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:35:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.649+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/588693475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdd630 0x557f55bee1d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00a0720 tx=0x7f1dc008b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ee43391145c7907 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.650+0000 7f1dbfe00640 1 -- 172.21.15.110:0/588693475 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00a4a90 con 0x557f55bdd630 2024-04-26T11:35:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.650+0000 7f1dbfe00640 1 -- 172.21.15.110:0/588693475 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc00b6020 con 0x557f55bdd630 2024-04-26T11:35:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.650+0000 7f1dbfe00640 1 -- 172.21.15.110:0/588693475 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00d2000 con 0x557f55bdd630 2024-04-26T11:35:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.652+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/588693475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdd630 msgr2=0x557f55bee1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.652+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/588693475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdd630 0x557f55bee1d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00a0720 tx=0x7f1dc008b040 comp rx=0 tx=0).stop 2024-04-26T11:35:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.652+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/588693475 shutdown_connections 2024-04-26T11:35:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.652+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/588693475 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55bfbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.652+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/588693475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55bdd630 0x557f55bee1d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.652+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/588693475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55befdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.652+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/588693475 >> 172.21.15.110:0/588693475 conn(0x557f55bd92e0 msgr2=0x557f55bfb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.653+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/588693475 shutdown_connections 2024-04-26T11:35:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.653+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/588693475 wait complete. 2024-04-26T11:35:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.654+0000 7f1ddd7c3740 1 -- start start 2024-04-26T11:35:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.655+0000 7f1ddd7c3740 1 Processor -- start 2024-04-26T11:35:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.656+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55c04590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.656+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55c02890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.656+0000 7f1ddd7c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55c02dd0 0x557f55c03250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.656+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd41aabe0 con 0x557f55bdcd10 2024-04-26T11:35:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.656+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd41ac050 con 0x557f55c02dd0 2024-04-26T11:35:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.656+0000 7f1ddd7c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd41ab2b0 con 0x557f55bf07c0 2024-04-26T11:35:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.656+0000 7f1ddd7c3740 10 client.0 _ll_register_callbacks cb 0x7f1dc40096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.656+0000 7f1dd2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55c02890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.657+0000 7f1dd2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55c02890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39276/0 (socket says 172.21.15.110:39276) 2024-04-26T11:35:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.657+0000 7f1dd2a00640 1 -- 172.21.15.110:0/682592304 learned_addr learned my addr 172.21.15.110:0/682592304 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.657+0000 7f1dd2a00640 1 -- 172.21.15.110:0/682592304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55c02dd0 msgr2=0x557f55c03250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T11:35:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.657+0000 7f1dd3e00640 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55c02dd0 0x557f55c03250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.657+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55c02dd0 0x557f55c03250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.657+0000 7f1dd2a00640 1 -- 172.21.15.110:0/682592304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 msgr2=0x557f55c04590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.658+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55c04590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.658+0000 7f1dd2a00640 1 -- 172.21.15.110:0/682592304 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f55afccb0 con 0x557f55bf07c0 2024-04-26T11:35:45.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.658+0000 7f1dd2a00640 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55c02890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00a0490 tx=0x7f1dc000eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48f95338ada94948 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:45.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.658+0000 7f1dbd600640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:35:45.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.659+0000 7f1dbd600640 1 -- 172.21.15.110:0/682592304 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00b9e60 con 0x557f55bf07c0 2024-04-26T11:35:45.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.659+0000 7f1dbd600640 1 -- 172.21.15.110:0/682592304 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f1dc00d2000 con 0x557f55bf07c0 2024-04-26T11:35:45.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.659+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/682592304 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc00b6020 con 0x557f55bf07c0 2024-04-26T11:35:45.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.659+0000 7f1dbd600640 1 -- 172.21.15.110:0/682592304 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1dc00d2200 con 0x557f55bf07c0 2024-04-26T11:35:45.661 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.660+0000 7f1ddd7c3740 10 client.25711 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:45.661 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.660+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/682592304 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557f55c6ec70 con 0x557f55bf07c0 2024-04-26T11:35:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.661+0000 7f1dbd600640 1 -- 172.21.15.110:0/682592304 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc00b6020 con 0x557f55bf07c0 2024-04-26T11:35:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.662+0000 7f1dbd600640 1 -- 172.21.15.110:0/682592304 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f1dc00a8ec0 con 0x557f55bf07c0 2024-04-26T11:35:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.663+0000 7f1ddd7c3740 10 client.25711 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.663+0000 7f1ddd7c3740 10 client.25711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.663+0000 7f1ddd7c3740 20 client.25711 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.663+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557f55c6f250 0x557f55c71670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.663+0000 7f1ddd7c3740 4 client.25711 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:35:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.663+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/682592304 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f55b49e00 con 0x557f55c6f250 2024-04-26T11:35:45.666 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.665+0000 7f1dd3400640 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557f55c6f250 0x557f55c71670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.668+0000 7f1dd3400640 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557f55c6f250 0x557f55c71670 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d65b21ad9896f104 server_cookie=72f8f1cb1fb283db in_seq=0 out_seq=0 2024-04-26T11:35:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.668+0000 7f1dbd600640 10 client.25711 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:45.703 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1dbd600640 1 -- 172.21.15.110:0/682592304 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f55b49e00 con 0x557f55c6f250 2024-04-26T11:35:45.703 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1dbd600640 10 client.25711 handle_command_reply: tid=0 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 client.25711 shutdown 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/682592304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 msgr2=0x557f55c02890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55c02890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00a0490 tx=0x7f1dc000eea0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/682592304 shutdown_connections 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557f55c02dd0 0x557f55c03250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557f55c6f250 0x557f55c71670 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557f55bf07c0 0x557f55c02890 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 --2- 172.21.15.110:0/682592304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557f55bdcd10 0x557f55c04590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1dbd600640 0 client.25711 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/682592304 >> 172.21.15.110:0/682592304 conn(0x557f55bd92e0 msgr2=0x557f55bdeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/682592304 shutdown_connections 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.702+0000 7f1ddd7c3740 1 -- 172.21.15.110:0/682592304 wait complete. 2024-04-26T11:35:45.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.703+0000 7f1ddd7c3740 20 client.25711 trim_cache size 0 max 16384 2024-04-26T11:35:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:35:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:35:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:35:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.704+0000 7f1dda800640 1 -- 172.21.15.110:0/3540803897 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1db80a3e40 msgr2=0x7f1db80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.704+0000 7f1dda800640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1db80a3e40 0x7f1db80a6300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00ad70 tx=0x7f1dcc00a420 comp rx=0 tx=0).stop 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.704+0000 7f1dda800640 1 -- 172.21.15.110:0/3540803897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd41032d0 msgr2=0x7f1dd4199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.704+0000 7f1dda800640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd41032d0 0x7f1dd4199650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000e790 tx=0x7f1dc000ec50 comp rx=0 tx=0).stop 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.705+0000 7f1dda800640 1 -- 172.21.15.110:0/3540803897 shutdown_connections 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.705+0000 7f1dda800640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1db80a3e40 0x7f1db80a6300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.705+0000 7f1dda800640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dd4108920 0x7f1dd419d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.705+0000 7f1dda800640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1dd41032d0 0x7f1dd4199650 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.705+0000 7f1dda800640 1 --2- 172.21.15.110:0/3540803897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4102910 0x7f1dd4199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.705+0000 7f1dda800640 1 -- 172.21.15.110:0/3540803897 >> 172.21.15.110:0/3540803897 conn(0x7f1dd4079dc0 msgr2=0x7f1dd41003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.705+0000 7f1dda800640 1 -- 172.21.15.110:0/3540803897 shutdown_connections 2024-04-26T11:35:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:45.705+0000 7f1dda800640 1 -- 172.21.15.110:0/3540803897 wait complete. 2024-04-26T11:35:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:45 smithi193 ceph-mon[32782]: pgmap v137: 97 pgs: 97 active+clean; 2.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 867 op/s 2024-04-26T11:35:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:45 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/534816274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:35:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:45 smithi196 ceph-mon[32572]: pgmap v137: 97 pgs: 97 active+clean; 2.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 867 op/s 2024-04-26T11:35:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:45 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/534816274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:35:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:45 smithi110 ceph-mon[28069]: pgmap v137: 97 pgs: 97 active+clean; 2.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 867 op/s 2024-04-26T11:35:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:45 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/534816274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:35:46.359 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db / --timeout 60 --expiration 78.7 --await-for 42.0' 2024-04-26T11:35:46.360 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db / --timeout 60 --expiration 78.7 --await-for 42.0 2024-04-26T11:35:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:35:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:47 smithi193 ceph-mon[32782]: pgmap v138: 97 pgs: 97 active+clean; 2.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.4 MiB/s wr, 714 op/s 2024-04-26T11:35:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:47 smithi196 ceph-mon[32572]: pgmap v138: 97 pgs: 97 active+clean; 2.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.4 MiB/s wr, 714 op/s 2024-04-26T11:35:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:47 smithi110 ceph-mon[28069]: pgmap v138: 97 pgs: 97 active+clean; 2.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.4 MiB/s wr, 714 op/s 2024-04-26T11:35:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 215.0 s, 1801.8 tps, lat 55.738 ms stddev 121.083 2024-04-26T11:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:49 smithi110 ceph-mon[28069]: pgmap v139: 97 pgs: 97 active+clean; 2.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 999 op/s 2024-04-26T11:35:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:49 smithi193 ceph-mon[32782]: pgmap v139: 97 pgs: 97 active+clean; 2.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 999 op/s 2024-04-26T11:35:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:49 smithi196 ceph-mon[32572]: pgmap v139: 97 pgs: 97 active+clean; 2.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 999 op/s 2024-04-26T11:35:50.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.308+0000 7f39d3e00700 1 -- 172.21.15.110:0/1949143033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc106020 msgr2=0x7f39cc112530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:50.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.308+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1949143033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc106020 0x7f39cc112530 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f39c400b0a0 tx=0x7f39c400b3b0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.308+0000 7f39d3e00700 1 -- 172.21.15.110:0/1949143033 shutdown_connections 2024-04-26T11:35:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.308+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1949143033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc106020 0x7f39cc112530 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.308+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1949143033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39cc10b660 0x7f39cc10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.308+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1949143033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39cc105660 0x7f39cc105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.308+0000 7f39d3e00700 1 -- 172.21.15.110:0/1949143033 >> 172.21.15.110:0/1949143033 conn(0x7f39cc101150 msgr2=0x7f39cc103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.309+0000 7f39d3e00700 1 -- 172.21.15.110:0/1949143033 shutdown_connections 2024-04-26T11:35:50.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.309+0000 7f39d3e00700 1 -- 172.21.15.110:0/1949143033 wait complete. 2024-04-26T11:35:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.310+0000 7f39d3e00700 1 Processor -- start 2024-04-26T11:35:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.310+0000 7f39d3e00700 1 -- start start 2024-04-26T11:35:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.310+0000 7f39d3e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39cc105660 0x7f39cc1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.310+0000 7f39d3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39cc106020 0x7f39cc1a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d3e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc10b660 0x7f39cc19ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d3e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc1158f0 con 0x7f39cc106020 2024-04-26T11:35:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d3e00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc115770 con 0x7f39cc105660 2024-04-26T11:35:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d3e00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc115a70 con 0x7f39cc10b660 2024-04-26T11:35:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d1400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39cc105660 0x7f39cc1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d1e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc10b660 0x7f39cc19ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d1e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc10b660 0x7f39cc19ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39296/0 (socket says 172.21.15.110:39296) 2024-04-26T11:35:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d1e00700 1 -- 172.21.15.110:0/1928689559 learned_addr learned my addr 172.21.15.110:0/1928689559 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:50.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d0a00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39cc106020 0x7f39cc1a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d1e00700 1 -- 172.21.15.110:0/1928689559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39cc105660 msgr2=0x7f39cc1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:50.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d1e00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39cc105660 0x7f39cc1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.311+0000 7f39d1e00700 1 -- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39cc106020 msgr2=0x7f39cc1a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:50.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.312+0000 7f39d1e00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39cc106020 0x7f39cc1a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.312+0000 7f39d1e00700 1 -- 172.21.15.110:0/1928689559 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc19c170 con 0x7f39cc10b660 2024-04-26T11:35:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.312+0000 7f39d0a00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39cc106020 0x7f39cc1a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.312+0000 7f39d1e00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc10b660 0x7f39cc19ba10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39c400b070 tx=0x7f39c400ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.313+0000 7f39ca000700 1 -- 172.21.15.110:0/1928689559 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4021070 con 0x7f39cc10b660 2024-04-26T11:35:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.313+0000 7f39ca000700 1 -- 172.21.15.110:0/1928689559 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39c4007c80 con 0x7f39cc10b660 2024-04-26T11:35:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.313+0000 7f39ca000700 1 -- 172.21.15.110:0/1928689559 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4005400 con 0x7f39cc10b660 2024-04-26T11:35:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.313+0000 7f39d3e00700 1 -- 172.21.15.110:0/1928689559 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc19c400 con 0x7f39cc10b660 2024-04-26T11:35:50.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.313+0000 7f39d3e00700 1 -- 172.21.15.110:0/1928689559 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc1a8720 con 0x7f39cc10b660 2024-04-26T11:35:50.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.318+0000 7f39ca000700 1 -- 172.21.15.110:0/1928689559 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f39c4024070 con 0x7f39cc10b660 2024-04-26T11:35:50.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.325+0000 7f39ca000700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f39b40a3fb0 0x7f39b40a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.325+0000 7f39ca000700 1 -- 172.21.15.110:0/1928689559 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f39c40d17b0 con 0x7f39cc10b660 2024-04-26T11:35:50.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.325+0000 7f39d1400700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f39b40a3fb0 0x7f39b40a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.326+0000 7f39de836b80 1 Processor -- start 2024-04-26T11:35:50.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.326+0000 7f39de836b80 1 -- start start 2024-04-26T11:35:50.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39de836b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 0x562bfd8a0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39de836b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd89a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39de836b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd8a6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39de836b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562bfd7eca20 con 0x562bfd89fc40 2024-04-26T11:35:50.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39de836b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562bfd78b340 con 0x562bfd899f70 2024-04-26T11:35:50.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39de836b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562bfd7e89e0 con 0x562bfd89a910 2024-04-26T11:35:50.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39d1400700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f39b40a3fb0 0x7f39b40a6470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39cc19cb50 tx=0x7f39c000a380 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:50.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39d1e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd8a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39d1e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd8a6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39302/0 (socket says 172.21.15.110:39302) 2024-04-26T11:35:50.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.327+0000 7f39d1e00700 1 -- 172.21.15.110:0/3768110916 learned_addr learned my addr 172.21.15.110:0/3768110916 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.328+0000 7f39d1e00700 1 -- 172.21.15.110:0/3768110916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 msgr2=0x562bfd89a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.328+0000 7f39d1e00700 1 --2- 172.21.15.110:0/3768110916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd89a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.328+0000 7f39d1400700 1 --2- 172.21.15.110:0/3768110916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 0x562bfd8a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.328+0000 7f39d1e00700 1 -- 172.21.15.110:0/3768110916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 msgr2=0x562bfd8a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.328+0000 7f39d1e00700 1 --2- 172.21.15.110:0/3768110916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 0x562bfd8a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.328+0000 7f39d1e00700 1 -- 172.21.15.110:0/3768110916 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bfd7937c0 con 0x562bfd89a910 2024-04-26T11:35:50.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.329+0000 7f39d1e00700 1 --2- 172.21.15.110:0/3768110916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd8a6990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f39c4099bc0 tx=0x7f39c4007e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e8e2bfdf59d0899 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:50.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.330+0000 7f39bea00700 1 -- 172.21.15.110:0/3768110916 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c402b030 con 0x562bfd89a910 2024-04-26T11:35:50.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.330+0000 7f39bea00700 1 -- 172.21.15.110:0/3768110916 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39c40a1b10 con 0x562bfd89a910 2024-04-26T11:35:50.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.330+0000 7f39bea00700 1 -- 172.21.15.110:0/3768110916 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c409d9c0 con 0x562bfd89a910 2024-04-26T11:35:50.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.332+0000 7f39de836b80 1 -- 172.21.15.110:0/3768110916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 msgr2=0x562bfd8a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:50.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.332+0000 7f39de836b80 1 --2- 172.21.15.110:0/3768110916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd8a6990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f39c4099bc0 tx=0x7f39c4007e30 comp rx=0 tx=0).stop 2024-04-26T11:35:50.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.333+0000 7f39de836b80 1 -- 172.21.15.110:0/3768110916 shutdown_connections 2024-04-26T11:35:50.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.333+0000 7f39de836b80 1 --2- 172.21.15.110:0/3768110916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd8a6990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.333+0000 7f39de836b80 1 --2- 172.21.15.110:0/3768110916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 0x562bfd8a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.333+0000 7f39de836b80 1 --2- 172.21.15.110:0/3768110916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd89a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.333+0000 7f39de836b80 1 -- 172.21.15.110:0/3768110916 >> 172.21.15.110:0/3768110916 conn(0x562bfd7c7480 msgr2=0x562bfd894b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:50.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.333+0000 7f39de836b80 1 -- 172.21.15.110:0/3768110916 shutdown_connections 2024-04-26T11:35:50.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.333+0000 7f39de836b80 1 -- 172.21.15.110:0/3768110916 wait complete. 2024-04-26T11:35:50.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.334+0000 7f39de836b80 1 -- start start 2024-04-26T11:35:50.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.335+0000 7f39de836b80 1 Processor -- start 2024-04-26T11:35:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.336+0000 7f39de836b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd899f70 0x562bfd8a6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.336+0000 7f39de836b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 0x562bfd8a3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.336+0000 7f39de836b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd89fc40 0x562bfd8a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.336+0000 7f39de836b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562bfd8a05b0 con 0x562bfd89a910 2024-04-26T11:35:50.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.336+0000 7f39de836b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562bfd787590 con 0x562bfd89fc40 2024-04-26T11:35:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.336+0000 7f39de836b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562bfd8a0730 con 0x562bfd899f70 2024-04-26T11:35:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.337+0000 7f39de836b80 10 client.0 _ll_register_callbacks cb 0x562bfd780510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:50.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.337+0000 7f39d1400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd899f70 0x562bfd8a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.337+0000 7f39d1400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd899f70 0x562bfd8a6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39308/0 (socket says 172.21.15.110:39308) 2024-04-26T11:35:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.337+0000 7f39d1400700 1 -- 172.21.15.110:0/3407523085 learned_addr learned my addr 172.21.15.110:0/3407523085 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:50.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.338+0000 7f39d1e00700 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd89fc40 0x562bfd8a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.338+0000 7f39d0a00700 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 0x562bfd8a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.339+0000 7f39d1400700 1 -- 172.21.15.110:0/3407523085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd89fc40 msgr2=0x562bfd8a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.339+0000 7f39d1400700 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd89fc40 0x562bfd8a3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.339+0000 7f39d1400700 1 -- 172.21.15.110:0/3407523085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 msgr2=0x562bfd8a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.339+0000 7f39d1400700 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 0x562bfd8a3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.339+0000 7f39d1400700 1 -- 172.21.15.110:0/3407523085 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bfd739a60 con 0x562bfd899f70 2024-04-26T11:35:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.339+0000 7f39d0a00700 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 0x562bfd8a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:35:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.340+0000 7f39d1400700 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd899f70 0x562bfd8a6620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39c0010010 tx=0x7f39c00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a36dd4ca71a59537 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:50.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.340+0000 7f39b3400700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:35:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.340+0000 7f39b3400700 1 -- 172.21.15.110:0/3407523085 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0016070 con 0x562bfd899f70 2024-04-26T11:35:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.341+0000 7f39b3400700 1 -- 172.21.15.110:0/3407523085 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f39c0026670 con 0x562bfd899f70 2024-04-26T11:35:50.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.341+0000 7f39de836b80 1 -- 172.21.15.110:0/3407523085 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39c40a1b10 con 0x562bfd899f70 2024-04-26T11:35:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.341+0000 7f39b3400700 1 -- 172.21.15.110:0/3407523085 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f39c0026870 con 0x562bfd899f70 2024-04-26T11:35:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.342+0000 7f39de836b80 10 client.25723 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:50.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.342+0000 7f39de836b80 1 -- 172.21.15.110:0/3407523085 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562bfd8b14a0 con 0x562bfd899f70 2024-04-26T11:35:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.342+0000 7f39b3400700 1 -- 172.21.15.110:0/3407523085 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39c40a1b10 con 0x562bfd899f70 2024-04-26T11:35:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.343+0000 7f39b3400700 1 -- 172.21.15.110:0/3407523085 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f39c0019030 con 0x562bfd899f70 2024-04-26T11:35:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.343+0000 7f39de836b80 10 client.25723 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.343+0000 7f39de836b80 10 client.25723 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:35:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.343+0000 7f39de836b80 20 client.25723 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.343+0000 7f39de836b80 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562bfd8b3b30 0x562bfd8b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.343+0000 7f39de836b80 4 client.25723 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:35:50.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.343+0000 7f39de836b80 1 -- 172.21.15.110:0/3407523085 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bfd7fa400 con 0x562bfd8b3b30 2024-04-26T11:35:50.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.344+0000 7f39d0a00700 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562bfd8b3b30 0x562bfd8b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.345+0000 7f39d0a00700 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562bfd8b3b30 0x562bfd8b5f20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3ecf2a582ac3e36 server_cookie=f84139afa3638da9 in_seq=0 out_seq=0 2024-04-26T11:35:50.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.345+0000 7f39b3400700 10 client.25723 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:50.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39b3400700 1 -- 172.21.15.110:0/3407523085 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562bfd7fa400 con 0x562bfd8b3b30 2024-04-26T11:35:50.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39b3400700 10 client.25723 handle_command_reply: tid=0 2024-04-26T11:35:50.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39de836b80 1 client.25723 shutdown 2024-04-26T11:35:50.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39de836b80 1 -- 172.21.15.110:0/3407523085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd899f70 msgr2=0x562bfd8a6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:50.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39de836b80 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd899f70 0x562bfd8a6620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39c0010010 tx=0x7f39c00047c0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39de836b80 1 -- 172.21.15.110:0/3407523085 shutdown_connections 2024-04-26T11:35:50.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39de836b80 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562bfd8b3b30 0x562bfd8b5f20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39de836b80 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd89fc40 0x562bfd8a3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39de836b80 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd899f70 0x562bfd8a6620 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39de836b80 1 --2- 172.21.15.110:0/3407523085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 0x562bfd8a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39b3400700 0 client.25723 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:50.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.346+0000 7f39de836b80 1 -- 172.21.15.110:0/3407523085 >> 172.21.15.110:0/3407523085 conn(0x562bfd7c7480 msgr2=0x562bfd89ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:50.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.347+0000 7f39de836b80 1 -- 172.21.15.110:0/3407523085 shutdown_connections 2024-04-26T11:35:50.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.347+0000 7f39de836b80 1 -- 172.21.15.110:0/3407523085 wait complete. 2024-04-26T11:35:50.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.347+0000 7f39de836b80 20 client.25723 trim_cache size 0 max 16384 2024-04-26T11:35:50.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.382+0000 7f39de836b80 1 Processor -- start 2024-04-26T11:35:50.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.382+0000 7f39de836b80 1 -- start start 2024-04-26T11:35:50.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.383+0000 7f39de836b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd8afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.383+0000 7f39de836b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd89edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.383+0000 7f39de836b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 0x562bfd8a6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.383+0000 7f39de836b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac010160 con 0x562bfd89fc40 2024-04-26T11:35:50.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.383+0000 7f39de836b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac00d960 con 0x562bfd899f70 2024-04-26T11:35:50.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.383+0000 7f39de836b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac00b7b0 con 0x562bfd89a910 2024-04-26T11:35:50.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.384+0000 7f39d0a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd89edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.384+0000 7f39d0a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd89edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39320/0 (socket says 172.21.15.110:39320) 2024-04-26T11:35:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.384+0000 7f39d0a00700 1 -- 172.21.15.110:0/2088181695 learned_addr learned my addr 172.21.15.110:0/2088181695 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.384+0000 7f39d1400700 1 --2- 172.21.15.110:0/2088181695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd8afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.384+0000 7f39d1e00700 1 --2- 172.21.15.110:0/2088181695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 0x562bfd8a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.385+0000 7f39d0a00700 1 -- 172.21.15.110:0/2088181695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 msgr2=0x562bfd8afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.385+0000 7f39d0a00700 1 --2- 172.21.15.110:0/2088181695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd8afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.385+0000 7f39d0a00700 1 -- 172.21.15.110:0/2088181695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 msgr2=0x562bfd8a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.385+0000 7f39d0a00700 1 --2- 172.21.15.110:0/2088181695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 0x562bfd8a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.385+0000 7f39d0a00700 1 -- 172.21.15.110:0/2088181695 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bfd891430 con 0x562bfd89a910 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.386+0000 7f39d0a00700 1 --2- 172.21.15.110:0/2088181695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd89edd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f39b8006fd0 tx=0x7f39b8015700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc28f4989904718c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.386+0000 7f39be000700 1 -- 172.21.15.110:0/2088181695 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8021070 con 0x562bfd89a910 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.386+0000 7f39be000700 1 -- 172.21.15.110:0/2088181695 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39b8024360 con 0x562bfd89a910 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.386+0000 7f39be000700 1 -- 172.21.15.110:0/2088181695 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8013600 con 0x562bfd89a910 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.387+0000 7f39de836b80 1 -- 172.21.15.110:0/2088181695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 msgr2=0x562bfd89edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.387+0000 7f39de836b80 1 --2- 172.21.15.110:0/2088181695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd89edd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f39b8006fd0 tx=0x7f39b8015700 comp rx=0 tx=0).stop 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.387+0000 7f39de836b80 1 -- 172.21.15.110:0/2088181695 shutdown_connections 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.387+0000 7f39de836b80 1 --2- 172.21.15.110:0/2088181695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89fc40 0x562bfd8a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.387+0000 7f39de836b80 1 --2- 172.21.15.110:0/2088181695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd8afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.387+0000 7f39de836b80 1 --2- 172.21.15.110:0/2088181695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89a910 0x562bfd89edd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.387+0000 7f39de836b80 1 -- 172.21.15.110:0/2088181695 >> 172.21.15.110:0/2088181695 conn(0x562bfd7c7480 msgr2=0x562bfd89e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:50.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.388+0000 7f39de836b80 1 -- 172.21.15.110:0/2088181695 shutdown_connections 2024-04-26T11:35:50.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.388+0000 7f39de836b80 1 -- 172.21.15.110:0/2088181695 wait complete. 2024-04-26T11:35:50.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.389+0000 7f39de836b80 1 -- start start 2024-04-26T11:35:50.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.389+0000 7f39de836b80 1 Processor -- start 2024-04-26T11:35:50.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.390+0000 7f39de836b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd8abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.390+0000 7f39de836b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 0x562bfd8ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.390+0000 7f39de836b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89fc40 0x562bfd89b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.390+0000 7f39de836b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac00be20 con 0x562bfd89a910 2024-04-26T11:35:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.390+0000 7f39de836b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac00d290 con 0x562bfd899f70 2024-04-26T11:35:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.390+0000 7f39de836b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac00c4f0 con 0x562bfd89fc40 2024-04-26T11:35:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.390+0000 7f39de836b80 10 client.0 _ll_register_callbacks cb 0x562bfd780510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d1e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89fc40 0x562bfd89b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d1400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd8abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d1e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89fc40 0x562bfd89b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:39330/0 (socket says 172.21.15.110:39330) 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d1e00700 1 -- 172.21.15.110:0/1142758871 learned_addr learned my addr 172.21.15.110:0/1142758871 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d0a00700 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 0x562bfd8ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d1e00700 1 -- 172.21.15.110:0/1142758871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 msgr2=0x562bfd8abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d1e00700 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd8abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d1e00700 1 -- 172.21.15.110:0/1142758871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 msgr2=0x562bfd8ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d1e00700 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 0x562bfd8ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.391+0000 7f39d1e00700 1 -- 172.21.15.110:0/1142758871 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bfd89ba40 con 0x562bfd89fc40 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.392+0000 7f39d1e00700 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89fc40 0x562bfd89b500 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f39c409d460 tx=0x7f39c400b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74aa6aea6dfaa733 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.392+0000 7f39b3400700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:35:50.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.392+0000 7f39b3400700 1 -- 172.21.15.110:0/1142758871 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c40b3030 con 0x562bfd89fc40 2024-04-26T11:35:50.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.392+0000 7f39b3400700 1 -- 172.21.15.110:0/1142758871 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f39c400f040 con 0x562bfd89fc40 2024-04-26T11:35:50.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39de836b80 1 -- 172.21.15.110:0/1142758871 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39b8024360 con 0x562bfd89fc40 2024-04-26T11:35:50.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39b3400700 1 -- 172.21.15.110:0/1142758871 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f39c402b040 con 0x562bfd89fc40 2024-04-26T11:35:50.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39de836b80 10 client.25729 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:50.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39de836b80 1 -- 172.21.15.110:0/1142758871 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562bfd924000 con 0x562bfd89fc40 2024-04-26T11:35:50.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39b3400700 1 -- 172.21.15.110:0/1142758871 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39b8024360 con 0x562bfd89fc40 2024-04-26T11:35:50.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39b3400700 1 -- 172.21.15.110:0/1142758871 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f39c4011070 con 0x562bfd89fc40 2024-04-26T11:35:50.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39de836b80 10 client.25729 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:50.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39de836b80 10 client.25729 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:35:50.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39de836b80 20 client.25729 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:50.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.393+0000 7f39de836b80 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562bfd924490 0x562bfd9268b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:50.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.394+0000 7f39de836b80 4 client.25729 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.7, "await_for": 42.0}] 2024-04-26T11:35:50.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.394+0000 7f39de836b80 1 -- 172.21.15.110:0/1142758871 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.7, "await_for": 42.0}) -- 0x562bfd7f44a0 con 0x562bfd924490 2024-04-26T11:35:50.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.394+0000 7f39d1400700 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562bfd924490 0x562bfd9268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:50.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.395+0000 7f39d1400700 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562bfd924490 0x562bfd9268b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=125ecdbe52b04910 server_cookie=ce63849995a24510 in_seq=0 out_seq=0 2024-04-26T11:35:50.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.395+0000 7f39b3400700 10 client.25729 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.600+0000 7f39b3400700 1 -- 172.21.15.110:0/1142758871 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562bfd7f44a0 con 0x562bfd924490 2024-04-26T11:35:50.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.600+0000 7f39b3400700 10 client.25729 handle_command_reply: tid=0 2024-04-26T11:35:50.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.600+0000 7f39de836b80 1 client.25729 shutdown 2024-04-26T11:35:50.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 -- 172.21.15.110:0/1142758871 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89fc40 msgr2=0x562bfd89b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89fc40 0x562bfd89b500 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f39c409d460 tx=0x7f39c400b3b0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 -- 172.21.15.110:0/1142758871 shutdown_connections 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x562bfd924490 0x562bfd9268b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562bfd89fc40 0x562bfd89b500 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562bfd899f70 0x562bfd8abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 --2- 172.21.15.110:0/1142758871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562bfd89a910 0x562bfd8ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 -- 172.21.15.110:0/1142758871 >> 172.21.15.110:0/1142758871 conn(0x562bfd7c7480 msgr2=0x562bfd89ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39b3400700 0 client.25729 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 -- 172.21.15.110:0/1142758871 shutdown_connections 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.601+0000 7f39de836b80 1 -- 172.21.15.110:0/1142758871 wait complete. 2024-04-26T11:35:50.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.602+0000 7f39de836b80 20 client.25729 trim_cache size 0 max 16384 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 34, 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 14, 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "55680a45": { 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 14, 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "QUIESCED", 2024-04-26T11:35:50.604 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 78.7, 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": false, 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "QUIESCED", 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:35:50.606 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:35:50.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.602+0000 7f39d3e00700 1 -- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f39b40a3fb0 msgr2=0x7f39b40a6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:50.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.602+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f39b40a3fb0 0x7f39b40a6470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39cc19cb50 tx=0x7f39c000a380 comp rx=0 tx=0).stop 2024-04-26T11:35:50.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.602+0000 7f39d3e00700 1 -- 172.21.15.110:0/1928689559 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc10b660 msgr2=0x7f39cc19ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:50.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.602+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc10b660 0x7f39cc19ba10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39c400b070 tx=0x7f39c400ce50 comp rx=0 tx=0).stop 2024-04-26T11:35:50.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.603+0000 7f39d3e00700 1 -- 172.21.15.110:0/1928689559 shutdown_connections 2024-04-26T11:35:50.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.603+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f39b40a3fb0 0x7f39b40a6470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.603+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39cc10b660 0x7f39cc19ba10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.603+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39cc105660 0x7f39cc1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.603+0000 7f39d3e00700 1 --2- 172.21.15.110:0/1928689559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39cc106020 0x7f39cc1a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:50.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.603+0000 7f39d3e00700 1 -- 172.21.15.110:0/1928689559 >> 172.21.15.110:0/1928689559 conn(0x7f39cc101150 msgr2=0x7f39cc101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:50.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.603+0000 7f39d3e00700 1 -- 172.21.15.110:0/1928689559 shutdown_connections 2024-04-26T11:35:50.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:35:50.603+0000 7f39d3e00700 1 -- 172.21.15.110:0/1928689559 wait complete. 2024-04-26T11:35:51.821 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '55680a45', quiesce took 10.9 seconds. Will release after: 18.7 2024-04-26T11:35:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:51 smithi110 ceph-mon[28069]: pgmap v140: 97 pgs: 97 active+clean; 2.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 585 op/s 2024-04-26T11:35:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:51 smithi193 ceph-mon[32782]: pgmap v140: 97 pgs: 97 active+clean; 2.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 585 op/s 2024-04-26T11:35:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:51 smithi196 ceph-mon[32572]: pgmap v140: 97 pgs: 97 active+clean; 2.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 585 op/s 2024-04-26T11:35:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:53 smithi193 ceph-mon[32782]: pgmap v141: 97 pgs: 97 active+clean; 2.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 23 MiB/s wr, 1.38k op/s 2024-04-26T11:35:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:53 smithi196 ceph-mon[32572]: pgmap v141: 97 pgs: 97 active+clean; 2.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 23 MiB/s wr, 1.38k op/s 2024-04-26T11:35:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:53 smithi110 ceph-mon[28069]: pgmap v141: 97 pgs: 97 active+clean; 2.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 23 MiB/s wr, 1.38k op/s 2024-04-26T11:35:54.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 220.0 s, 293.9 tps, lat 34.089 ms stddev 35.782 2024-04-26T11:35:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:55 smithi193 ceph-mon[32782]: pgmap v142: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 1.73k op/s 2024-04-26T11:35:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:55 smithi196 ceph-mon[32572]: pgmap v142: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 1.73k op/s 2024-04-26T11:35:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:55 smithi110 ceph-mon[28069]: pgmap v142: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 1.73k op/s 2024-04-26T11:35:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:57 smithi193 ceph-mon[32782]: pgmap v143: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 1.53k op/s 2024-04-26T11:35:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:57 smithi196 ceph-mon[32572]: pgmap v143: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 1.53k op/s 2024-04-26T11:35:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:57 smithi110 ceph-mon[28069]: pgmap v143: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 MiB/s wr, 1.53k op/s 2024-04-26T11:35:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.858+0000 7f3809e00640 1 -- 172.21.15.110:0/4282340283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f380410ac00 msgr2=0x7f380410afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.858+0000 7f3809e00640 1 --2- 172.21.15.110:0/4282340283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f380410ac00 0x7f380410afe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009890 tx=0x7f37f402a360 comp rx=0 tx=0).stop 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.858+0000 7f3809e00640 1 -- 172.21.15.110:0/4282340283 shutdown_connections 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.858+0000 7f3809e00640 1 --2- 172.21.15.110:0/4282340283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3804105500 0x7f38041119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.858+0000 7f3809e00640 1 --2- 172.21.15.110:0/4282340283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3804104b40 0x7f3804104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.858+0000 7f3809e00640 1 --2- 172.21.15.110:0/4282340283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f380410ac00 0x7f380410afe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.858+0000 7f3809e00640 1 -- 172.21.15.110:0/4282340283 >> 172.21.15.110:0/4282340283 conn(0x7f3804100630 msgr2=0x7f3804102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.858+0000 7f3809e00640 1 -- 172.21.15.110:0/4282340283 shutdown_connections 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.859+0000 7f3809e00640 1 -- 172.21.15.110:0/4282340283 wait complete. 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3809e00640 1 Processor -- start 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3809e00640 1 -- start start 2024-04-26T11:35:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3809e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3804104b40 0x7f380419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3809e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3804105500 0x7f380419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3809e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f380410ac00 0x7f380419faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3809e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3804114df0 con 0x7f3804105500 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3809e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3804114c70 con 0x7f3804104b40 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3809e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3804114f70 con 0x7f380410ac00 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3802000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3804105500 0x7f380419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3802a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3804104b40 0x7f380419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3802000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3804105500 0x7f380419b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45126/0 (socket says 172.21.15.110:45126) 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3802000640 1 -- 172.21.15.110:0/2138351509 learned_addr learned my addr 172.21.15.110:0/2138351509 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.860+0000 7f3803400640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f380410ac00 0x7f380419faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.861+0000 7f3802a00640 1 -- 172.21.15.110:0/2138351509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f380410ac00 msgr2=0x7f380419faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.861+0000 7f3802a00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f380410ac00 0x7f380419faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.861+0000 7f3802a00640 1 -- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3804105500 msgr2=0x7f380419b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:58.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.861+0000 7f3802a00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3804105500 0x7f380419b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.861+0000 7f3802a00640 1 -- 172.21.15.110:0/2138351509 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38041a0220 con 0x7f3804104b40 2024-04-26T11:35:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.861+0000 7f3802000640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3804105500 0x7f380419b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:35:58.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.861+0000 7f3802a00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3804104b40 0x7f380419b230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009780 tx=0x7f37f4032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.863+0000 7f3808a00640 1 -- 172.21.15.110:0/2138351509 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4037040 con 0x7f3804104b40 2024-04-26T11:35:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.863+0000 7f3808a00640 1 -- 172.21.15.110:0/2138351509 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f4030be0 con 0x7f3804104b40 2024-04-26T11:35:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.863+0000 7f3808a00640 1 -- 172.21.15.110:0/2138351509 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40035f0 con 0x7f3804104b40 2024-04-26T11:35:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.863+0000 7f3809e00640 1 -- 172.21.15.110:0/2138351509 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38041a04b0 con 0x7f3804104b40 2024-04-26T11:35:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.863+0000 7f3809e00640 1 -- 172.21.15.110:0/2138351509 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38041a08f0 con 0x7f3804104b40 2024-04-26T11:35:58.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.866+0000 7f3808a00640 1 -- 172.21.15.110:0/2138351509 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f37f4043020 con 0x7f3804104b40 2024-04-26T11:35:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.867+0000 7f380cc1c740 1 Processor -- start 2024-04-26T11:35:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.867+0000 7f380cc1c740 1 -- start start 2024-04-26T11:35:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.867+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19beedd0 0x561a19bef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.867+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bf9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.867+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19bfc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.867+0000 7f380cc1c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561a19b54380 con 0x561a19bef6f0 2024-04-26T11:35:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.867+0000 7f380cc1c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561a19af0c30 con 0x561a19bf9fb0 2024-04-26T11:35:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.867+0000 7f380cc1c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561a19b50340 con 0x561a19beedd0 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3803400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19beedd0 0x561a19bef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3802a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bf9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3803400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19beedd0 0x561a19bef1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:56094/0 (socket says 172.21.15.110:56094) 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3803400640 1 -- 172.21.15.110:0/3518637623 learned_addr learned my addr 172.21.15.110:0/3518637623 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3802000640 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19bfc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3803400640 1 -- 172.21.15.110:0/3518637623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 msgr2=0x561a19bfc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3803400640 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19bfc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3803400640 1 -- 172.21.15.110:0/3518637623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 msgr2=0x561a19bf9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3803400640 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bf9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3803400640 1 -- 172.21.15.110:0/3518637623 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a19b12940 con 0x561a19beedd0 2024-04-26T11:35:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3802a00640 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bf9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3802000640 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19bfc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3808a00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f37e80a3e40 0x7f37e80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3803400640 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19beedd0 0x561a19bef1b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00e580 tx=0x7f37fc0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80693258732de4b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3808a00640 1 -- 172.21.15.110:0/2138351509 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f37f40ef880 con 0x7f3804104b40 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.868+0000 7f3802a00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f37e80a3e40 0x7f37e80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f37efe00640 1 -- 172.21.15.110:0/3518637623 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc003970 con 0x561a19beedd0 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f37efe00640 1 -- 172.21.15.110:0/3518637623 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37fc00d830 con 0x561a19beedd0 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f37efe00640 1 -- 172.21.15.110:0/3518637623 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc004460 con 0x561a19beedd0 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f380cc1c740 1 -- 172.21.15.110:0/3518637623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19beedd0 msgr2=0x561a19bef1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f3802a00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f37e80a3e40 0x7f37e80a6300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x561a19bf0370 tx=0x7f37f4005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f380cc1c740 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19beedd0 0x561a19bef1b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00e580 tx=0x7f37fc0095c0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f380cc1c740 1 -- 172.21.15.110:0/3518637623 shutdown_connections 2024-04-26T11:35:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f380cc1c740 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19bfc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f380cc1c740 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bf9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f380cc1c740 1 --2- 172.21.15.110:0/3518637623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19beedd0 0x561a19bef1b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.869+0000 7f380cc1c740 1 -- 172.21.15.110:0/3518637623 >> 172.21.15.110:0/3518637623 conn(0x561a19beb2e0 msgr2=0x561a19beb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.870+0000 7f380cc1c740 1 -- 172.21.15.110:0/3518637623 shutdown_connections 2024-04-26T11:35:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.870+0000 7f380cc1c740 1 -- 172.21.15.110:0/3518637623 wait complete. 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.870+0000 7f380cc1c740 1 -- start start 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.870+0000 7f380cc1c740 1 Processor -- start 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19bf6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19bf73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19bf7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f380cc1c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561a19bfcbe0 con 0x561a19beedd0 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f380cc1c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561a19adbc60 con 0x561a19bf9fb0 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f380cc1c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561a19bfcd60 con 0x561a19bef6f0 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f380cc1c740 10 client.0 _ll_register_callbacks cb 0x561a19b07e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f3803400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19bf6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f3803400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19bf6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45152/0 (socket says 172.21.15.110:45152) 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f3803400640 1 -- 172.21.15.110:0/1079802695 learned_addr learned my addr 172.21.15.110:0/1079802695 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f3802000640 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19bf73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.871+0000 7f3803400640 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19bf7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f3802000640 1 -- 172.21.15.110:0/1079802695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 msgr2=0x561a19bf7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f3802000640 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19bf7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f3802000640 1 -- 172.21.15.110:0/1079802695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 msgr2=0x561a19bf6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f3802000640 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19bf6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f3802000640 1 -- 172.21.15.110:0/1079802695 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a19aea510 con 0x561a19bef6f0 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f3803400640 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19bf6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f3802000640 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19bf73e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x561a19bec470 tx=0x7f37f000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbc123379addaa90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f37ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:35:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f37ecc00640 1 -- 172.21.15.110:0/1079802695 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f00120d0 con 0x561a19bef6f0 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f380cc1c740 1 -- 172.21.15.110:0/1079802695 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37fc00d830 con 0x561a19bef6f0 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.872+0000 7f37ecc00640 1 -- 172.21.15.110:0/1079802695 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f37f0005020 con 0x561a19bef6f0 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f37ecc00640 1 -- 172.21.15.110:0/1079802695 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f37f0012270 con 0x561a19bef6f0 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f380cc1c740 10 client.25741 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f380cc1c740 1 -- 172.21.15.110:0/1079802695 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561a19866210 con 0x561a19bef6f0 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f37ecc00640 1 -- 172.21.15.110:0/1079802695 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37fc00d830 con 0x561a19bef6f0 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f37ecc00640 1 -- 172.21.15.110:0/1079802695 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f37f001c470 con 0x561a19bef6f0 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f380cc1c740 10 client.25741 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f380cc1c740 10 client.25741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f380cc1c740 20 client.25741 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561a19c09cf0 0x561a19c0c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f380cc1c740 4 client.25741 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:35:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.873+0000 7f380cc1c740 1 -- 172.21.15.110:0/1079802695 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a19b61f90 con 0x561a19c09cf0 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.874+0000 7f3803400640 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561a19c09cf0 0x561a19c0c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.874+0000 7f3803400640 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561a19c09cf0 0x561a19c0c0e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b35425e4e5b9e855 server_cookie=5ca22e6bc4a414d6 in_seq=0 out_seq=0 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.874+0000 7f37ecc00640 10 client.25741 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f37ecc00640 1 -- 172.21.15.110:0/1079802695 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561a19b61f90 con 0x561a19c09cf0 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f37ecc00640 10 client.25741 handle_command_reply: tid=0 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 client.25741 shutdown 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 -- 172.21.15.110:0/1079802695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 msgr2=0x561a19bf73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19bf73e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x561a19bec470 tx=0x7f37f000f790 comp rx=0 tx=0).stop 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 -- 172.21.15.110:0/1079802695 shutdown_connections 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19bf7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561a19c09cf0 0x561a19c0c0e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19bf73e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1079802695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19bf6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f37ecc00640 0 client.25741 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 -- 172.21.15.110:0/1079802695 >> 172.21.15.110:0/1079802695 conn(0x561a19beb2e0 msgr2=0x561a19bf1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 -- 172.21.15.110:0/1079802695 shutdown_connections 2024-04-26T11:35:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 1 -- 172.21.15.110:0/1079802695 wait complete. 2024-04-26T11:35:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.875+0000 7f380cc1c740 20 client.25741 trim_cache size 0 max 16384 2024-04-26T11:35:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.892+0000 7f380cc1c740 1 Processor -- start 2024-04-26T11:35:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.892+0000 7f380cc1c740 1 -- start start 2024-04-26T11:35:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.892+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19c05aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.892+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19c119f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.892+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19c11f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.892+0000 7f380cc1c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f38041b3280 con 0x561a19beedd0 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.892+0000 7f380cc1c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f38041b0ac0 con 0x561a19bf9fb0 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.892+0000 7f380cc1c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f38041ae910 con 0x561a19bef6f0 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3802000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19c119f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3803400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19c05aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3802000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19c119f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:56118/0 (socket says 172.21.15.110:56118) 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3802000640 1 -- 172.21.15.110:0/1088634357 learned_addr learned my addr 172.21.15.110:0/1088634357 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3802000640 1 -- 172.21.15.110:0/1088634357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 msgr2=0x561a19c11f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:58.896 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3802000640 1 --2- 172.21.15.110:0/1088634357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19c11f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.896 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3802000640 1 -- 172.21.15.110:0/1088634357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 msgr2=0x561a19c05aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:58.896 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3802000640 1 --2- 172.21.15.110:0/1088634357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19c05aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.896 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3802000640 1 -- 172.21.15.110:0/1088634357 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a19932620 con 0x561a19bef6f0 2024-04-26T11:35:58.896 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.893+0000 7f3802000640 1 --2- 172.21.15.110:0/1088634357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19c119f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37f001ca80 tx=0x7f37f0009320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b76a21cc540219e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:58.900 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f37ef400640 1 -- 172.21.15.110:0/1088634357 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f001c470 con 0x561a19bef6f0 2024-04-26T11:35:58.900 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f37ef400640 1 -- 172.21.15.110:0/1088634357 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f001c610 con 0x561a19bef6f0 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f37ef400640 1 -- 172.21.15.110:0/1088634357 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f00048e0 con 0x561a19bef6f0 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f380cc1c740 1 -- 172.21.15.110:0/1088634357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 msgr2=0x561a19c119f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1088634357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19c119f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37f001ca80 tx=0x7f37f0009320 comp rx=0 tx=0).stop 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f380cc1c740 1 -- 172.21.15.110:0/1088634357 shutdown_connections 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1088634357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19bf9fb0 0x561a19c11f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1088634357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bef6f0 0x561a19c119f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f380cc1c740 1 --2- 172.21.15.110:0/1088634357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19beedd0 0x561a19c05aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f380cc1c740 1 -- 172.21.15.110:0/1088634357 >> 172.21.15.110:0/1088634357 conn(0x561a19beb2e0 msgr2=0x561a19bf2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f380cc1c740 1 -- 172.21.15.110:0/1088634357 shutdown_connections 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.894+0000 7f380cc1c740 1 -- 172.21.15.110:0/1088634357 wait complete. 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.895+0000 7f380cc1c740 1 -- start start 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.895+0000 7f380cc1c740 1 Processor -- start 2024-04-26T11:35:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.895+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19beedd0 0x561a19c023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.895+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bfd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.895+0000 7f380cc1c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bf9fb0 0x561a19bfdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.895+0000 7f380cc1c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f38041aef80 con 0x561a19bef6f0 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.895+0000 7f380cc1c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f38041b03f0 con 0x561a19beedd0 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.895+0000 7f380cc1c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f38041af650 con 0x561a19bf9fb0 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f380cc1c740 10 client.0 _ll_register_callbacks cb 0x7f37f0009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3802000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bfd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3802000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bfd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45162/0 (socket says 172.21.15.110:45162) 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3802000640 1 -- 172.21.15.110:0/586520584 learned_addr learned my addr 172.21.15.110:0/586520584 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3803400640 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19beedd0 0x561a19c023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3803400640 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bf9fb0 0x561a19bfdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3802000640 1 -- 172.21.15.110:0/586520584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bf9fb0 msgr2=0x561a19bfdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3802000640 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bf9fb0 0x561a19bfdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3802000640 1 -- 172.21.15.110:0/586520584 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19beedd0 msgr2=0x561a19c023a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3802000640 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19beedd0 0x561a19c023a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3802000640 1 -- 172.21.15.110:0/586520584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a19b0ecb0 con 0x561a19bef6f0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.896+0000 7f3803400640 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bf9fb0 0x561a19bfdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.897+0000 7f3802000640 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bfd710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f37f001cc50 tx=0x7f37f0025670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af10d598383fbd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.897+0000 7f37ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.897+0000 7f37ecc00640 1 -- 172.21.15.110:0/586520584 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f001c470 con 0x561a19bef6f0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.897+0000 7f37ecc00640 1 -- 172.21.15.110:0/586520584 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f37f0005240 con 0x561a19bef6f0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.897+0000 7f380cc1c740 1 -- 172.21.15.110:0/586520584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37f001c610 con 0x561a19bef6f0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.897+0000 7f37ecc00640 1 -- 172.21.15.110:0/586520584 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f37f003b050 con 0x561a19bef6f0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.897+0000 7f380cc1c740 10 client.15552 fetch_fsmap learned FSMap version 34 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.897+0000 7f380cc1c740 1 -- 172.21.15.110:0/586520584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561a19c700d0 con 0x561a19bef6f0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.898+0000 7f37ecc00640 1 -- 172.21.15.110:0/586520584 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37f001c610 con 0x561a19bef6f0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.898+0000 7f37ecc00640 1 -- 172.21.15.110:0/586520584 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f37f002b020 con 0x561a19bef6f0 2024-04-26T11:35:58.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.898+0000 7f380cc1c740 10 client.15552 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:35:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.898+0000 7f380cc1c740 10 client.15552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:35:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.898+0000 7f380cc1c740 20 client.15552 populate_metadata read hostname 'smithi110' 2024-04-26T11:35:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.898+0000 7f380cc1c740 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561a19c70780 0x561a19c72b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:35:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.898+0000 7f380cc1c740 4 client.15552 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:35:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.898+0000 7f380cc1c740 1 -- 172.21.15.110:0/586520584 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561a19b5be00 con 0x561a19c70780 2024-04-26T11:35:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.898+0000 7f3803400640 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561a19c70780 0x561a19c72b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:35:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.899+0000 7f3803400640 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561a19c70780 0x561a19c72b70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=515831ef250d161f server_cookie=f34bd2ff20e74668 in_seq=0 out_seq=0 2024-04-26T11:35:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.899+0000 7f37ecc00640 10 client.15552 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.912+0000 7f37ecc00640 1 -- 172.21.15.110:0/586520584 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561a19b5be00 con 0x561a19c70780 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.912+0000 7f37ecc00640 10 client.15552 handle_command_reply: tid=0 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.912+0000 7f380cc1c740 1 client.15552 shutdown 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 -- 172.21.15.110:0/586520584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 msgr2=0x561a19bfd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bfd710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f37f001cc50 tx=0x7f37f0025670 comp rx=0 tx=0).stop 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 -- 172.21.15.110:0/586520584 shutdown_connections 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561a19c70780 0x561a19c72b70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a19bf9fb0 0x561a19bfdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561a19bef6f0 0x561a19bfd710 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 --2- 172.21.15.110:0/586520584 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561a19beedd0 0x561a19c023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f37ecc00640 0 client.15552 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:35:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 -- 172.21.15.110:0/586520584 >> 172.21.15.110:0/586520584 conn(0x561a19beb2e0 msgr2=0x561a19bf6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 -- 172.21.15.110:0/586520584 shutdown_connections 2024-04-26T11:35:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 1 -- 172.21.15.110:0/586520584 wait complete. 2024-04-26T11:35:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.913+0000 7f380cc1c740 20 client.15552 trim_cache size 0 max 16384 2024-04-26T11:35:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:35:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:35:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:35:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:35:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 -- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f37e80a3e40 msgr2=0x7f37e80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f37e80a3e40 0x7f37e80a6300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x561a19bf0370 tx=0x7f37f4005f90 comp rx=0 tx=0).stop 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 -- 172.21.15.110:0/2138351509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3804104b40 msgr2=0x7f380419b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3804104b40 0x7f380419b230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009780 tx=0x7f37f4032d50 comp rx=0 tx=0).stop 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 -- 172.21.15.110:0/2138351509 shutdown_connections 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f37e80a3e40 0x7f37e80a6300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f380410ac00 0x7f380419faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3804105500 0x7f380419b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 --2- 172.21.15.110:0/2138351509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3804104b40 0x7f380419b230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 -- 172.21.15.110:0/2138351509 >> 172.21.15.110:0/2138351509 conn(0x7f3804100630 msgr2=0x7f3804101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 -- 172.21.15.110:0/2138351509 shutdown_connections 2024-04-26T11:35:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:35:58.914+0000 7f3809e00640 1 -- 172.21.15.110:0/2138351509 wait complete. 2024-04-26T11:35:59.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 225.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:36:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:35:59 smithi193 ceph-mon[32782]: pgmap v144: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 1.53k op/s 2024-04-26T11:36:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:35:59 smithi196 ceph-mon[32572]: pgmap v144: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 1.53k op/s 2024-04-26T11:36:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:35:59 smithi110 ceph-mon[28069]: pgmap v144: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 1.53k op/s 2024-04-26T11:36:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:01 smithi193 ceph-mon[32782]: pgmap v145: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 1.25k op/s 2024-04-26T11:36:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:01 smithi196 ceph-mon[32572]: pgmap v145: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 1.25k op/s 2024-04-26T11:36:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:01 smithi110 ceph-mon[28069]: pgmap v145: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 1.25k op/s 2024-04-26T11:36:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:03 smithi196 ceph-mon[32572]: pgmap v146: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 25 MiB/s wr, 1.25k op/s 2024-04-26T11:36:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:03 smithi110 ceph-mon[28069]: pgmap v146: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 25 MiB/s wr, 1.25k op/s 2024-04-26T11:36:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:03 smithi193 ceph-mon[32782]: pgmap v146: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 25 MiB/s wr, 1.25k op/s 2024-04-26T11:36:04.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:36:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:05 smithi196 ceph-mon[32572]: pgmap v147: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 470 op/s 2024-04-26T11:36:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:05 smithi110 ceph-mon[28069]: pgmap v147: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 470 op/s 2024-04-26T11:36:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:05 smithi193 ceph-mon[32782]: pgmap v147: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 470 op/s 2024-04-26T11:36:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:07 smithi196 ceph-mon[32572]: pgmap v148: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T11:36:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:07 smithi110 ceph-mon[28069]: pgmap v148: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T11:36:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:07 smithi193 ceph-mon[32782]: pgmap v148: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-26T11:36:09.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:36:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:09 smithi196 ceph-mon[32572]: pgmap v149: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 200 op/s 2024-04-26T11:36:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:09 smithi110 ceph-mon[28069]: pgmap v149: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 200 op/s 2024-04-26T11:36:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:09 smithi193 ceph-mon[32782]: pgmap v149: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 200 op/s 2024-04-26T11:36:10.522 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:36:10.971 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:36:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.056+0000 7f64a8000640 1 -- 172.21.15.110:0/2629145554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64a0109e70 msgr2=0x7f64a010a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.056+0000 7f64a8000640 1 --2- 172.21.15.110:0/2629145554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64a0109e70 0x7f64a010a2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6498009ca0 tx=0x7f649802a8b0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.056+0000 7f64a8000640 1 -- 172.21.15.110:0/2629145554 shutdown_connections 2024-04-26T11:36:12.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.056+0000 7f64a8000640 1 --2- 172.21.15.110:0/2629145554 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64a0109e70 0x7f64a010a2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.056+0000 7f64a8000640 1 --2- 172.21.15.110:0/2629145554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a006a680 0x7f64a0109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.056+0000 7f64a8000640 1 --2- 172.21.15.110:0/2629145554 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64a010e390 0x7f64a010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.056+0000 7f64a8000640 1 -- 172.21.15.110:0/2629145554 >> 172.21.15.110:0/2629145554 conn(0x7f64a006de90 msgr2=0x7f64a006e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:12.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.056+0000 7f64a8000640 1 -- 172.21.15.110:0/2629145554 shutdown_connections 2024-04-26T11:36:12.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.056+0000 7f64a8000640 1 -- 172.21.15.110:0/2629145554 wait complete. 2024-04-26T11:36:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.057+0000 7f64a8000640 1 Processor -- start 2024-04-26T11:36:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.057+0000 7f64a8000640 1 -- start start 2024-04-26T11:36:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a8000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a006a680 0x7f64a01a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a8000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64a0109e70 0x7f64a01a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a8000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64a010e390 0x7f64a01a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a8000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f64a011a360 con 0x7f64a006a680 2024-04-26T11:36:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a8000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f64a011a1e0 con 0x7f64a010e390 2024-04-26T11:36:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a8000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f64a011a4e0 con 0x7f64a0109e70 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a5600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a006a680 0x7f64a01a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a5600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a006a680 0x7f64a01a96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44862/0 (socket says 172.21.15.110:44862) 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a5600640 1 -- 172.21.15.110:0/4115863913 learned_addr learned my addr 172.21.15.110:0/4115863913 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a4c00640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64a0109e70 0x7f64a01a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a6000640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64a010e390 0x7f64a01a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a5600640 1 -- 172.21.15.110:0/4115863913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64a0109e70 msgr2=0x7f64a01a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a5600640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64a0109e70 0x7f64a01a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a5600640 1 -- 172.21.15.110:0/4115863913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64a010e390 msgr2=0x7f64a01a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a5600640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64a010e390 0x7f64a01a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.058+0000 7f64a5600640 1 -- 172.21.15.110:0/4115863913 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a01a4080 con 0x7f64a006a680 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.059+0000 7f64a5600640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a006a680 0x7f64a01a96a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f649400e9f0 tx=0x7f649400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.059+0000 7f649e000640 1 -- 172.21.15.110:0/4115863913 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649400cd80 con 0x7f64a006a680 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.059+0000 7f649e000640 1 -- 172.21.15.110:0/4115863913 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64940054d0 con 0x7f64a006a680 2024-04-26T11:36:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.059+0000 7f649e000640 1 -- 172.21.15.110:0/4115863913 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494010690 con 0x7f64a006a680 2024-04-26T11:36:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.059+0000 7f64a8000640 1 -- 172.21.15.110:0/4115863913 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a01a4370 con 0x7f64a006a680 2024-04-26T11:36:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.059+0000 7f64a8000640 1 -- 172.21.15.110:0/4115863913 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a01b04f0 con 0x7f64a006a680 2024-04-26T11:36:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.063+0000 7f64aafb6740 1 Processor -- start 2024-04-26T11:36:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.063+0000 7f649e000640 1 -- 172.21.15.110:0/4115863913 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6494004e90 con 0x7f64a006a680 2024-04-26T11:36:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.063+0000 7f64aafb6740 1 -- start start 2024-04-26T11:36:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.063+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e0541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.063+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 0x55595e05ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.063+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 0x55595e0613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.063+0000 7f64aafb6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55595dfb9380 con 0x55595e0546f0 2024-04-26T11:36:12.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.063+0000 7f64aafb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55595df55c30 con 0x55595e053dd0 2024-04-26T11:36:12.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.063+0000 7f64aafb6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55595dfb5340 con 0x55595e05efb0 2024-04-26T11:36:12.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a5600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 0x55595e05ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e0541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e0541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:35650/0 (socket says 172.21.15.110:35650) 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a6000640 1 -- 172.21.15.110:0/2342122797 learned_addr learned my addr 172.21.15.110:0/2342122797 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a4c00640 1 --2- 172.21.15.110:0/2342122797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 0x55595e0613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a6000640 1 -- 172.21.15.110:0/2342122797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 msgr2=0x55595e0613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a6000640 1 --2- 172.21.15.110:0/2342122797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 0x55595e0613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a6000640 1 -- 172.21.15.110:0/2342122797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 msgr2=0x55595e05ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a6000640 1 --2- 172.21.15.110:0/2342122797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 0x55595e05ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f64a6000640 1 -- 172.21.15.110:0/2342122797 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595df77940 con 0x55595e053dd0 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.064+0000 7f649e000640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f64880a3dc0 0x7f64880a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.065+0000 7f64a6000640 1 --2- 172.21.15.110:0/2342122797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e0541b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6498005fb0 tx=0x7f6498030f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e13548bfdda4beff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.065+0000 7f649e000640 1 -- 172.21.15.110:0/4115863913 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f64940d0d90 con 0x7f64a006a680 2024-04-26T11:36:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.065+0000 7f64a5600640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f64880a3dc0 0x7f64880a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.065+0000 7f648e600640 1 -- 172.21.15.110:0/2342122797 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980305a0 con 0x55595e053dd0 2024-04-26T11:36:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.065+0000 7f648e600640 1 -- 172.21.15.110:0/2342122797 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6498036040 con 0x55595e053dd0 2024-04-26T11:36:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.065+0000 7f648e600640 1 -- 172.21.15.110:0/2342122797 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498004380 con 0x55595e053dd0 2024-04-26T11:36:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64aafb6740 1 -- 172.21.15.110:0/2342122797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 msgr2=0x55595e0541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2342122797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e0541b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6498005fb0 tx=0x7f6498030f00 comp rx=0 tx=0).stop 2024-04-26T11:36:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64a5600640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f64880a3dc0 0x7f64880a6280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55595e055370 tx=0x7f64940d4840 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64aafb6740 1 -- 172.21.15.110:0/2342122797 shutdown_connections 2024-04-26T11:36:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2342122797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 0x55595e0613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2342122797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 0x55595e05ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2342122797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e0541b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64aafb6740 1 -- 172.21.15.110:0/2342122797 >> 172.21.15.110:0/2342122797 conn(0x55595e0502e0 msgr2=0x55595e0506c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64aafb6740 1 -- 172.21.15.110:0/2342122797 shutdown_connections 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.066+0000 7f64aafb6740 1 -- 172.21.15.110:0/2342122797 wait complete. 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.067+0000 7f64aafb6740 1 -- start start 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.067+0000 7f64aafb6740 1 Processor -- start 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.067+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e05bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.067+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 0x55595e05c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.067+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 0x55595e05c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.067+0000 7f64aafb6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55595e061b80 con 0x55595e0546f0 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.067+0000 7f64aafb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55595df40c60 con 0x55595e053dd0 2024-04-26T11:36:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.067+0000 7f64aafb6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55595e061d00 con 0x55595e05efb0 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.067+0000 7f64aafb6740 10 client.0 _ll_register_callbacks cb 0x55595df6ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a4c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 0x55595e05c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e05bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e05bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:35658/0 (socket says 172.21.15.110:35658) 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a6000640 1 -- 172.21.15.110:0/2868735062 learned_addr learned my addr 172.21.15.110:0/2868735062 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a6000640 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 0x55595e05c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a4c00640 1 -- 172.21.15.110:0/2868735062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 msgr2=0x55595e05c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a4c00640 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 0x55595e05c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a4c00640 1 -- 172.21.15.110:0/2868735062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 msgr2=0x55595e05bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a4c00640 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e05bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a4c00640 1 -- 172.21.15.110:0/2868735062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595df4f510 con 0x55595e0546f0 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.068+0000 7f64a6000640 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e05bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.069+0000 7f64a4c00640 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 0x55595e05c470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f64a006e6b0 tx=0x7f6490012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676246772c78f5b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.069+0000 7f6482a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:36:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.069+0000 7f6482a00640 1 -- 172.21.15.110:0/2868735062 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649000f8f0 con 0x55595e0546f0 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.069+0000 7f6482a00640 1 -- 172.21.15.110:0/2868735062 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f649000fa90 con 0x55595e0546f0 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.069+0000 7f64aafb6740 1 -- 172.21.15.110:0/2868735062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6498036040 con 0x55595e0546f0 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.069+0000 7f6482a00640 1 -- 172.21.15.110:0/2868735062 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f649000fc90 con 0x55595e0546f0 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.069+0000 7f64aafb6740 10 client.15564 fetch_fsmap learned FSMap version 34 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.069+0000 7f64aafb6740 1 -- 172.21.15.110:0/2868735062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55595dccb210 con 0x55595e0546f0 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.069+0000 7f6482a00640 1 -- 172.21.15.110:0/2868735062 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6498036040 con 0x55595e0546f0 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.070+0000 7f6482a00640 1 -- 172.21.15.110:0/2868735062 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f6490010430 con 0x55595e0546f0 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.070+0000 7f64aafb6740 10 client.15564 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.070+0000 7f64aafb6740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.070+0000 7f64aafb6740 20 client.15564 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.070+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55595e06ed20 0x55595e071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.070+0000 7f64aafb6740 4 client.15564 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.070+0000 7f64aafb6740 1 -- 172.21.15.110:0/2868735062 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55595dfc6f90 con 0x55595e06ed20 2024-04-26T11:36:12.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.070+0000 7f64a6000640 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55595e06ed20 0x55595e071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.071+0000 7f64a6000640 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55595e06ed20 0x55595e071110 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d348e1bd5e98a27e server_cookie=2d1a620609ca194c in_seq=0 out_seq=0 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.071+0000 7f6482a00640 10 client.15564 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.071+0000 7f6482a00640 1 -- 172.21.15.110:0/2868735062 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55595dfc6f90 con 0x55595e06ed20 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.071+0000 7f6482a00640 10 client.15564 handle_command_reply: tid=0 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 client.15564 shutdown 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 -- 172.21.15.110:0/2868735062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 msgr2=0x55595e05c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 0x55595e05c470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f64a006e6b0 tx=0x7f6490012b60 comp rx=0 tx=0).stop 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 -- 172.21.15.110:0/2868735062 shutdown_connections 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55595e06ed20 0x55595e071110 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e05efb0 0x55595e05c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e0546f0 0x55595e05c470 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 --2- 172.21.15.110:0/2868735062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e05bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f6482a00640 0 client.15564 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 -- 172.21.15.110:0/2868735062 >> 172.21.15.110:0/2868735062 conn(0x55595e0502e0 msgr2=0x55595e056060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:12.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 -- 172.21.15.110:0/2868735062 shutdown_connections 2024-04-26T11:36:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 1 -- 172.21.15.110:0/2868735062 wait complete. 2024-04-26T11:36:12.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.072+0000 7f64aafb6740 20 client.15564 trim_cache size 0 max 16384 2024-04-26T11:36:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.089+0000 7f64aafb6740 1 Processor -- start 2024-04-26T11:36:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.089+0000 7f64aafb6740 1 -- start start 2024-04-26T11:36:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.089+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.089+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e05dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.089+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 0x55595e0769d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.089+0000 7f64aafb6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01bbaf0 con 0x55595e05efb0 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.089+0000 7f64aafb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01b9330 con 0x55595e053dd0 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.089+0000 7f64aafb6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01b7180 con 0x55595e0546f0 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.089+0000 7f64a6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e06aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:35666/0 (socket says 172.21.15.110:35666) 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a6000640 1 -- 172.21.15.110:0/1080270344 learned_addr learned my addr 172.21.15.110:0/1080270344 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a6000640 1 --2- 172.21.15.110:0/1080270344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 0x55595e0769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a4c00640 1 --2- 172.21.15.110:0/1080270344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e05dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a6000640 1 -- 172.21.15.110:0/1080270344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 msgr2=0x55595e05dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a6000640 1 --2- 172.21.15.110:0/1080270344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e05dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a6000640 1 -- 172.21.15.110:0/1080270344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 msgr2=0x55595e0769d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a6000640 1 --2- 172.21.15.110:0/1080270344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 0x55595e0769d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a6000640 1 -- 172.21.15.110:0/1080270344 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595e056d80 con 0x55595e053dd0 2024-04-26T11:36:12.094 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.090+0000 7f64a6000640 1 --2- 172.21.15.110:0/1080270344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e06aa40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6498009430 tx=0x7f6498009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7f59fdebdd2d1e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f648dc00640 1 -- 172.21.15.110:0/1080270344 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649805b070 con 0x55595e053dd0 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f648dc00640 1 -- 172.21.15.110:0/1080270344 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6498036070 con 0x55595e053dd0 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f648dc00640 1 -- 172.21.15.110:0/1080270344 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649804a040 con 0x55595e053dd0 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f64aafb6740 1 -- 172.21.15.110:0/1080270344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 msgr2=0x55595e06aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1080270344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e06aa40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6498009430 tx=0x7f6498009a20 comp rx=0 tx=0).stop 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f64aafb6740 1 -- 172.21.15.110:0/1080270344 shutdown_connections 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1080270344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 0x55595e0769d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1080270344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e05dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1080270344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e06aa40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f64aafb6740 1 -- 172.21.15.110:0/1080270344 >> 172.21.15.110:0/1080270344 conn(0x55595e0502e0 msgr2=0x55595e05d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f64aafb6740 1 -- 172.21.15.110:0/1080270344 shutdown_connections 2024-04-26T11:36:12.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.091+0000 7f64aafb6740 1 -- 172.21.15.110:0/1080270344 wait complete. 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.092+0000 7f64aafb6740 1 -- start start 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.092+0000 7f64aafb6740 1 Processor -- start 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.092+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e058cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e059210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64aafb6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 0x55595e059750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64aafb6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01b77f0 con 0x55595e05efb0 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64aafb6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01b8c60 con 0x55595e053dd0 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64aafb6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01b7ec0 con 0x55595e0546f0 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64aafb6740 10 client.0 _ll_register_callbacks cb 0x7f6490009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a4c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e059210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a4c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e059210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:40954/0 (socket says 172.21.15.110:40954) 2024-04-26T11:36:12.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a4c00640 1 -- 172.21.15.110:0/1197936754 learned_addr learned my addr 172.21.15.110:0/1197936754 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a6000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e058cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a6000640 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 0x55595e059750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a4c00640 1 -- 172.21.15.110:0/1197936754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 msgr2=0x55595e058cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a4c00640 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e058cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a4c00640 1 -- 172.21.15.110:0/1197936754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 msgr2=0x55595e059750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a4c00640 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 0x55595e059750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a4c00640 1 -- 172.21.15.110:0/1197936754 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595dd97620 con 0x55595e0546f0 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a6000640 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 0x55595e059750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f64a4c00640 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e059210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55595e05d500 tx=0x7f649000fb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31bf243030c5bc33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.093+0000 7f6482a00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f6482a00640 1 -- 172.21.15.110:0/1197936754 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490010a90 con 0x55595e0546f0 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f6482a00640 1 -- 172.21.15.110:0/1197936754 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6490010c30 con 0x55595e0546f0 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f64aafb6740 1 -- 172.21.15.110:0/1197936754 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6498036070 con 0x55595e0546f0 2024-04-26T11:36:12.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f6482a00640 1 -- 172.21.15.110:0/1197936754 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6490034050 con 0x55595e0546f0 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f64aafb6740 10 client.25765 fetch_fsmap learned FSMap version 34 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f64aafb6740 1 -- 172.21.15.110:0/1197936754 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55595df73cb0 con 0x55595e0546f0 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f6482a00640 1 -- 172.21.15.110:0/1197936754 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6498036070 con 0x55595e0546f0 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f6482a00640 1 -- 172.21.15.110:0/1197936754 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f649002b070 con 0x55595e0546f0 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f64aafb6740 10 client.25765 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.094+0000 7f64aafb6740 10 client.25765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.095+0000 7f64aafb6740 20 client.25765 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.095+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55595e0d5a00 0x55595e0d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.095+0000 7f64aafb6740 4 client.25765 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:36:12.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.095+0000 7f64aafb6740 1 -- 172.21.15.110:0/1197936754 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55595dfc0e00 con 0x55595e0d5a00 2024-04-26T11:36:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.095+0000 7f64a6000640 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55595e0d5a00 0x55595e0d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.095+0000 7f64a6000640 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55595e0d5a00 0x55595e0d7e20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42f39165fdd084d server_cookie=4a4f4e120fe11a06 in_seq=0 out_seq=0 2024-04-26T11:36:12.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.095+0000 7f6482a00640 10 client.25765 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.107+0000 7f6482a00640 1 -- 172.21.15.110:0/1197936754 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55595dfc0e00 con 0x55595e0d5a00 2024-04-26T11:36:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.107+0000 7f6482a00640 10 client.25765 handle_command_reply: tid=0 2024-04-26T11:36:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.107+0000 7f64aafb6740 1 client.25765 shutdown 2024-04-26T11:36:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 -- 172.21.15.110:0/1197936754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 msgr2=0x55595e059210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e059210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55595e05d500 tx=0x7f649000fb20 comp rx=0 tx=0).stop 2024-04-26T11:36:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 -- 172.21.15.110:0/1197936754 shutdown_connections 2024-04-26T11:36:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55595e05efb0 0x55595e059750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55595e0d5a00 0x55595e0d7e20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55595e0546f0 0x55595e059210 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 --2- 172.21.15.110:0/1197936754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55595e053dd0 0x55595e058cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 -- 172.21.15.110:0/1197936754 >> 172.21.15.110:0/1197936754 conn(0x55595e0502e0 msgr2=0x55595e05c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f6482a00640 0 client.25765 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 -- 172.21.15.110:0/1197936754 shutdown_connections 2024-04-26T11:36:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 1 -- 172.21.15.110:0/1197936754 wait complete. 2024-04-26T11:36:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.108+0000 7f64aafb6740 20 client.25765 trim_cache size 0 max 16384 2024-04-26T11:36:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:36:12.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:36:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:36:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:36:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 -- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f64880a3dc0 msgr2=0x7f64880a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f64880a3dc0 0x7f64880a6280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55595e055370 tx=0x7f64940d4840 comp rx=0 tx=0).stop 2024-04-26T11:36:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 -- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a006a680 msgr2=0x7f64a01a96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:12.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a006a680 0x7f64a01a96a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f649400e9f0 tx=0x7f649400edf0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 -- 172.21.15.110:0/4115863913 shutdown_connections 2024-04-26T11:36:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f64880a3dc0 0x7f64880a6280 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64a010e390 0x7f64a01a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f64a0109e70 0x7f64a01a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 --2- 172.21.15.110:0/4115863913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a006a680 0x7f64a01a96a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 -- 172.21.15.110:0/4115863913 >> 172.21.15.110:0/4115863913 conn(0x7f64a006de90 msgr2=0x7f64a0116610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 -- 172.21.15.110:0/4115863913 shutdown_connections 2024-04-26T11:36:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:12.109+0000 7f64a8000640 1 -- 172.21.15.110:0/4115863913 wait complete. 2024-04-26T11:36:12.175 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:11 smithi110 ceph-mon[28069]: pgmap v150: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-04-26T11:36:12.264 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:11 smithi196 ceph-mon[32572]: pgmap v150: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-04-26T11:36:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:11 smithi193 ceph-mon[32782]: pgmap v150: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-04-26T11:36:13.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.356+0000 7f5c4c800700 1 -- 172.21.15.110:0/2318017870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c4410fed0 msgr2=0x7f5c441122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:13.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.356+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2318017870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c4410fed0 0x7f5c441122c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009f90 tx=0x7f5c4000b330 comp rx=0 tx=0).stop 2024-04-26T11:36:13.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.356+0000 7f5c4c800700 1 -- 172.21.15.110:0/2318017870 shutdown_connections 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.356+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2318017870 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c4410fed0 0x7f5c441122c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.356+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2318017870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4406b130 0x7f5c4406b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.356+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2318017870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c4406ba50 0x7f5c4410f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.356+0000 7f5c4c800700 1 -- 172.21.15.110:0/2318017870 >> 172.21.15.110:0/2318017870 conn(0x7f5c440792d0 msgr2=0x7f5c440796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.356+0000 7f5c4c800700 1 -- 172.21.15.110:0/2318017870 shutdown_connections 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.356+0000 7f5c4c800700 1 -- 172.21.15.110:0/2318017870 wait complete. 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.358+0000 7f5c4c800700 1 Processor -- start 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.358+0000 7f5c4c800700 1 -- start start 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.358+0000 7f5c4c800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c4406b130 0x7f5c4419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.358+0000 7f5c4c800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c4406ba50 0x7f5c4419c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.358+0000 7f5c4c800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4410fed0 0x7f5c441a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.358+0000 7f5c4c800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5c441157f0 con 0x7f5c4410fed0 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.358+0000 7f5c4c800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c44115670 con 0x7f5c4406ba50 2024-04-26T11:36:13.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.358+0000 7f5c4c800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5c44115970 con 0x7f5c4406b130 2024-04-26T11:36:13.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c4a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4410fed0 0x7f5c441a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:13.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c4406b130 0x7f5c4419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c4a800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4410fed0 0x7f5c441a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56954/0 (socket says 172.21.15.110:56954) 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c4a800700 1 -- 172.21.15.110:0/2172182291 learned_addr learned my addr 172.21.15.110:0/2172182291 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c49400700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c4406ba50 0x7f5c4419c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c4a800700 1 -- 172.21.15.110:0/2172182291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c4406b130 msgr2=0x7f5c4419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c4a800700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c4406b130 0x7f5c4419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c4a800700 1 -- 172.21.15.110:0/2172182291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c4406ba50 msgr2=0x7f5c4419c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c4a800700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c4406ba50 0x7f5c4419c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c4a800700 1 -- 172.21.15.110:0/2172182291 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c441a0d20 con 0x7f5c4410fed0 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c49e00700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c4406b130 0x7f5c4419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.359+0000 7f5c4a800700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4410fed0 0x7f5c441a05e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009790 tx=0x7f5c4000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.360+0000 7f5c3ea00700 1 -- 172.21.15.110:0/2172182291 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40021070 con 0x7f5c4410fed0 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.360+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c441a0fb0 con 0x7f5c4410fed0 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.360+0000 7f5c3ea00700 1 -- 172.21.15.110:0/2172182291 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c40007d60 con 0x7f5c4410fed0 2024-04-26T11:36:13.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.360+0000 7f5c3ea00700 1 -- 172.21.15.110:0/2172182291 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40005040 con 0x7f5c4410fed0 2024-04-26T11:36:13.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.360+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c441a8890 con 0x7f5c4410fed0 2024-04-26T11:36:13.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.361+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4406a110 con 0x7f5c4410fed0 2024-04-26T11:36:13.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.363+0000 7f5c3ea00700 1 -- 172.21.15.110:0/2172182291 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f5c40024070 con 0x7f5c4410fed0 2024-04-26T11:36:13.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.364+0000 7f5c3ea00700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f5c2c0a3e30 0x7f5c2c0a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:13.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.364+0000 7f5c3ea00700 1 -- 172.21.15.110:0/2172182291 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f5c400d1920 con 0x7f5c4410fed0 2024-04-26T11:36:13.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.364+0000 7f5c49e00700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f5c2c0a3e30 0x7f5c2c0a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:13.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.365+0000 7f5c49e00700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f5c2c0a3e30 0x7f5c2c0a62f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009750 tx=0x7f5c38009310 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:13.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.369+0000 7f5c3ea00700 1 -- 172.21.15.110:0/2172182291 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5c4009df70 con 0x7f5c4410fed0 2024-04-26T11:36:13.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.650+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c4402e490 con 0x7f5c4410fed0 2024-04-26T11:36:13.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.651+0000 7f5c3ea00700 1 -- 172.21.15.110:0/2172182291 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11893 (secure 0 0 0) 0x7f5c4009d870 con 0x7f5c4410fed0 2024-04-26T11:36:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:36:13.655 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:35:06.023389+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.196:6839/1849808245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":1849808245},{"type":"v1","addr":"172.21.15.196:6839","nonce":1849808245}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24502,24518,24487]},"id":1}]} 2024-04-26T11:36:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f5c2c0a3e30 msgr2=0x7f5c2c0a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f5c2c0a3e30 0x7f5c2c0a62f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009750 tx=0x7f5c38009310 comp rx=0 tx=0).stop 2024-04-26T11:36:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4410fed0 msgr2=0x7f5c441a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:13.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4410fed0 0x7f5c441a05e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009790 tx=0x7f5c4000cc30 comp rx=0 tx=0).stop 2024-04-26T11:36:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 shutdown_connections 2024-04-26T11:36:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f5c2c0a3e30 0x7f5c2c0a62f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c4410fed0 0x7f5c441a05e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c4406b130 0x7f5c4419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 --2- 172.21.15.110:0/2172182291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c4406ba50 0x7f5c4419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.654+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 >> 172.21.15.110:0/2172182291 conn(0x7f5c440792d0 msgr2=0x7f5c441113c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.655+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 shutdown_connections 2024-04-26T11:36:13.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:13.655+0000 7f5c4c800700 1 -- 172.21.15.110:0/2172182291 wait complete. 2024-04-26T11:36:13.658 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 34 2024-04-26T11:36:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:13 smithi110 ceph-mon[28069]: pgmap v151: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 202 op/s 2024-04-26T11:36:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:13 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2172182291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:36:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:13 smithi196 ceph-mon[32572]: pgmap v151: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 202 op/s 2024-04-26T11:36:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:13 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2172182291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:36:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:13 smithi193 ceph-mon[32782]: pgmap v151: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 202 op/s 2024-04-26T11:36:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:13 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2172182291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:36:14.573 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db --set-id 55680a45 --release --await' 2024-04-26T11:36:14.573 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db --set-id 55680a45 --release --await 2024-04-26T11:36:14.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:36:15.019 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:36:16.071 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:15 smithi110 ceph-mon[28069]: pgmap v152: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-04-26T11:36:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:15 smithi196 ceph-mon[32572]: pgmap v152: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-04-26T11:36:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:15 smithi193 ceph-mon[32782]: pgmap v152: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 197 op/s 2024-04-26T11:36:17.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.288+0000 7f76b9a00700 1 -- 172.21.15.110:0/1393362283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b410e830 msgr2=0x7f76b410ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:17.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.288+0000 7f76b9a00700 1 --2- 172.21.15.110:0/1393362283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b410e830 0x7f76b410ec10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009990 tx=0x7f76a4009ca0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.288+0000 7f76b9a00700 1 -- 172.21.15.110:0/1393362283 shutdown_connections 2024-04-26T11:36:17.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.288+0000 7f76b9a00700 1 --2- 172.21.15.110:0/1393362283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76b410a320 0x7f76b41167c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.288+0000 7f76b9a00700 1 --2- 172.21.15.110:0/1393362283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b410e830 0x7f76b410ec10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.288+0000 7f76b9a00700 1 --2- 172.21.15.110:0/1393362283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76b4109960 0x7f76b4109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.288+0000 7f76b9a00700 1 -- 172.21.15.110:0/1393362283 >> 172.21.15.110:0/1393362283 conn(0x7f76b40791b0 msgr2=0x7f76b4108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:17.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.288+0000 7f76b9a00700 1 -- 172.21.15.110:0/1393362283 shutdown_connections 2024-04-26T11:36:17.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.288+0000 7f76b9a00700 1 -- 172.21.15.110:0/1393362283 wait complete. 2024-04-26T11:36:17.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.289+0000 7f76b9a00700 1 Processor -- start 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.289+0000 7f76b9a00700 1 -- start start 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b9a00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b4109960 0x7f76b41a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b9a00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76b410a320 0x7f76b41a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b9a00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76b410e830 0x7f76b41a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b9a00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4119b50 con 0x7f76b4109960 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b9a00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f76b41199d0 con 0x7f76b410a320 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b9a00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4119cd0 con 0x7f76b410e830 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b4109960 0x7f76b41a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b4109960 0x7f76b41a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56976/0 (socket says 172.21.15.110:56976) 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b3e00700 1 -- 172.21.15.110:0/482257928 learned_addr learned my addr 172.21.15.110:0/482257928 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b3400700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76b410a320 0x7f76b41a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b9000700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76b410e830 0x7f76b41a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b3e00700 1 -- 172.21.15.110:0/482257928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76b410e830 msgr2=0x7f76b41a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b3e00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76b410e830 0x7f76b41a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b3e00700 1 -- 172.21.15.110:0/482257928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76b410a320 msgr2=0x7f76b41a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:17.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b3e00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76b410a320 0x7f76b41a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.290+0000 7f76b3e00700 1 -- 172.21.15.110:0/482257928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b41a5070 con 0x7f76b4109960 2024-04-26T11:36:17.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.291+0000 7f76b3e00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b4109960 0x7f76b41a0060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f76a4000c00 tx=0x7f76a40057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:17.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.291+0000 7f76b0c00700 1 -- 172.21.15.110:0/482257928 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a4027070 con 0x7f76b4109960 2024-04-26T11:36:17.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.291+0000 7f76b0c00700 1 -- 172.21.15.110:0/482257928 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76a4003680 con 0x7f76b4109960 2024-04-26T11:36:17.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.291+0000 7f76b9a00700 1 -- 172.21.15.110:0/482257928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b41a5300 con 0x7f76b4109960 2024-04-26T11:36:17.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.291+0000 7f76b0c00700 1 -- 172.21.15.110:0/482257928 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a4022b80 con 0x7f76b4109960 2024-04-26T11:36:17.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.291+0000 7f76b9a00700 1 -- 172.21.15.110:0/482257928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b41acbe0 con 0x7f76b4109960 2024-04-26T11:36:17.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.295+0000 7f76b0c00700 1 -- 172.21.15.110:0/482257928 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f76a402a070 con 0x7f76b4109960 2024-04-26T11:36:17.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76c59c8b80 1 Processor -- start 2024-04-26T11:36:17.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76c59c8b80 1 -- start start 2024-04-26T11:36:17.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689471c60 0x558689472040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 0x55868946c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55868946c5d0 0x55868946ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5586893be990 con 0x558689471c60 2024-04-26T11:36:17.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55868935d2b0 con 0x55868946c5d0 2024-04-26T11:36:17.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5586893ba950 con 0x558689472580 2024-04-26T11:36:17.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76b0c00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f76980a3db0 0x7f76980a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.296+0000 7f76b9000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689471c60 0x558689472040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b3e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 0x55868946c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b3400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55868946c5d0 0x55868946ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b9000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689471c60 0x558689472040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56978/0 (socket says 172.21.15.110:56978) 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b9000700 1 -- 172.21.15.110:0/1550507922 learned_addr learned my addr 172.21.15.110:0/1550507922 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b0c00700 1 -- 172.21.15.110:0/482257928 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f76a40d1830 con 0x7f76b4109960 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b3400700 1 -- 172.21.15.110:0/1550507922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 msgr2=0x55868946c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b3400700 1 --2- 172.21.15.110:0/1550507922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 0x55868946c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b3400700 1 -- 172.21.15.110:0/1550507922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689471c60 msgr2=0x558689472040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:17.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b3400700 1 --2- 172.21.15.110:0/1550507922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689471c60 0x558689472040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b3400700 1 -- 172.21.15.110:0/1550507922 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558689365730 con 0x55868946c5d0 2024-04-26T11:36:17.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b9000700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f76980a3db0 0x7f76980a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.297+0000 7f76b3400700 1 --2- 172.21.15.110:0/1550507922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55868946c5d0 0x55868946ca60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005950 tx=0x7f76a000bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d150e94ae8cd58e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:17.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.298+0000 7f76a9600700 1 -- 172.21.15.110:0/1550507922 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0010c70 con 0x55868946c5d0 2024-04-26T11:36:17.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.298+0000 7f76a9600700 1 -- 172.21.15.110:0/1550507922 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76a00044e0 con 0x55868946c5d0 2024-04-26T11:36:17.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.298+0000 7f76a9600700 1 -- 172.21.15.110:0/1550507922 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0005280 con 0x55868946c5d0 2024-04-26T11:36:17.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.298+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1550507922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55868946c5d0 msgr2=0x55868946ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:17.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.298+0000 7f76b9000700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f76980a3db0 0x7f76980a6270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76ac003fd0 tx=0x7f76ac004b40 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.298+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1550507922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55868946c5d0 0x55868946ca60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005950 tx=0x7f76a000bf60 comp rx=0 tx=0).stop 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.299+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1550507922 shutdown_connections 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.299+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1550507922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55868946c5d0 0x55868946ca60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.299+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1550507922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689471c60 0x558689472040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.299+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1550507922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 0x55868946c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.299+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1550507922 >> 172.21.15.110:0/1550507922 conn(0x5586893993f0 msgr2=0x558689466d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.299+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1550507922 shutdown_connections 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.299+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1550507922 wait complete. 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.299+0000 7f76c59c8b80 1 -- start start 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76c59c8b80 1 Processor -- start 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55868946c5d0 0x558689478120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 0x558689475420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689472580 0x558689475960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558689478f40 con 0x558689472580 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558689359500 con 0x558689471c60 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5586894790c0 con 0x55868946c5d0 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76c59c8b80 10 client.0 _ll_register_callbacks cb 0x558689352480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76b9000700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689472580 0x558689475960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76b3e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55868946c5d0 0x558689478120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.300+0000 7f76b3400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 0x558689475420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76b3e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55868946c5d0 0x558689478120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:47726/0 (socket says 172.21.15.110:47726) 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76b3e00700 1 -- 172.21.15.110:0/2508934250 learned_addr learned my addr 172.21.15.110:0/2508934250 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:17.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76b3400700 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 0x558689475420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:52350/0 (socket says 172.21.15.110:52350) 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76b3e00700 1 -- 172.21.15.110:0/2508934250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 msgr2=0x558689475420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76b3e00700 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 0x558689475420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76b3e00700 1 -- 172.21.15.110:0/2508934250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689472580 msgr2=0x558689475960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76b3e00700 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689472580 0x558689475960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76b3e00700 1 -- 172.21.15.110:0/2508934250 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55868930b9d0 con 0x55868946c5d0 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76b3e00700 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55868946c5d0 0x558689478120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f76a409d480 tx=0x7f76a401fec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=685f3f4668eb112f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f769e000700 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f769e000700 1 -- 172.21.15.110:0/2508934250 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a409d550 con 0x55868946c5d0 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f769e000700 1 -- 172.21.15.110:0/2508934250 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f76a4015c70 con 0x55868946c5d0 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.301+0000 7f76c59c8b80 1 -- 172.21.15.110:0/2508934250 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76a00044e0 con 0x55868946c5d0 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f769e000700 1 -- 172.21.15.110:0/2508934250 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f76a409d0e0 con 0x55868946c5d0 2024-04-26T11:36:17.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f76c59c8b80 10 client.25783 fetch_fsmap learned FSMap version 34 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f76c59c8b80 1 -- 172.21.15.110:0/2508934250 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558689478fa0 con 0x55868946c5d0 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f769e000700 1 -- 172.21.15.110:0/2508934250 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76a00044e0 con 0x55868946c5d0 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f769e000700 1 -- 172.21.15.110:0/2508934250 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f76a4099040 con 0x55868946c5d0 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f76c59c8b80 10 client.25783 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f76c59c8b80 10 client.25783 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f76c59c8b80 20 client.25783 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558689485c20 0x558689488070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f76c59c8b80 4 client.25783 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.302+0000 7f76c59c8b80 1 -- 172.21.15.110:0/2508934250 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586893cc370 con 0x558689485c20 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.303+0000 7f76b3400700 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558689485c20 0x558689488070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.303+0000 7f76b3400700 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558689485c20 0x558689488070 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ebddda98b527f84 server_cookie=1680f086fc5af4c2 in_seq=0 out_seq=0 2024-04-26T11:36:17.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.303+0000 7f769e000700 10 client.25783 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:17.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.304+0000 7f769e000700 1 -- 172.21.15.110:0/2508934250 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5586893cc370 con 0x558689485c20 2024-04-26T11:36:17.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.304+0000 7f769e000700 10 client.25783 handle_command_reply: tid=0 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.304+0000 7f76c59c8b80 1 client.25783 shutdown 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 -- 172.21.15.110:0/2508934250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55868946c5d0 msgr2=0x558689478120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55868946c5d0 0x558689478120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f76a409d480 tx=0x7f76a401fec0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 -- 172.21.15.110:0/2508934250 shutdown_connections 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558689485c20 0x558689488070 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558689472580 0x558689475960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55868946c5d0 0x558689478120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f769e000700 0 client.25783 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/2508934250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 0x558689475420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 -- 172.21.15.110:0/2508934250 >> 172.21.15.110:0/2508934250 conn(0x5586893993f0 msgr2=0x558689461470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 -- 172.21.15.110:0/2508934250 shutdown_connections 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 1 -- 172.21.15.110:0/2508934250 wait complete. 2024-04-26T11:36:17.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.305+0000 7f76c59c8b80 20 client.25783 trim_cache size 0 max 16384 2024-04-26T11:36:17.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.326+0000 7f76c59c8b80 1 Processor -- start 2024-04-26T11:36:17.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.326+0000 7f76c59c8b80 1 -- start start 2024-04-26T11:36:17.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.326+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x5586894759b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.326+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689471c60 0x55868946c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.326+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689472580 0x558689472fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.326+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f76b41b6c80 con 0x55868946c5d0 2024-04-26T11:36:17.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.326+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f76b41b4480 con 0x558689472580 2024-04-26T11:36:17.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.326+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f76b41b22d0 con 0x558689471c60 2024-04-26T11:36:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.327+0000 7f76b3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x5586894759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.327+0000 7f76b3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x5586894759b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56998/0 (socket says 172.21.15.110:56998) 2024-04-26T11:36:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.327+0000 7f76b3e00700 1 -- 172.21.15.110:0/55288040 learned_addr learned my addr 172.21.15.110:0/55288040 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.327+0000 7f76b9000700 1 --2- 172.21.15.110:0/55288040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689472580 0x558689472fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.327+0000 7f76b3400700 1 --2- 172.21.15.110:0/55288040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689471c60 0x55868946c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.328+0000 7f76b3e00700 1 -- 172.21.15.110:0/55288040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689471c60 msgr2=0x55868946c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.328+0000 7f76b3e00700 1 --2- 172.21.15.110:0/55288040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689471c60 0x55868946c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.328+0000 7f76b3e00700 1 -- 172.21.15.110:0/55288040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689472580 msgr2=0x558689472fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.328+0000 7f76b3e00700 1 --2- 172.21.15.110:0/55288040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689472580 0x558689472fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.328+0000 7f76b3e00700 1 -- 172.21.15.110:0/55288040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586894686a0 con 0x55868946c5d0 2024-04-26T11:36:17.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.328+0000 7f76b3e00700 1 --2- 172.21.15.110:0/55288040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x5586894759b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f76a409a150 tx=0x7f76a4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74de07b8e623a699 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:17.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76a8c00700 1 -- 172.21.15.110:0/55288040 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a409d2c0 con 0x55868946c5d0 2024-04-26T11:36:17.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76a8c00700 1 -- 172.21.15.110:0/55288040 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76a40cf320 con 0x55868946c5d0 2024-04-26T11:36:17.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76a8c00700 1 -- 172.21.15.110:0/55288040 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a409dc20 con 0x55868946c5d0 2024-04-26T11:36:17.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76c59c8b80 1 -- 172.21.15.110:0/55288040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 msgr2=0x5586894759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:17.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/55288040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x5586894759b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f76a409a150 tx=0x7f76a4009310 comp rx=0 tx=0).stop 2024-04-26T11:36:17.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76c59c8b80 1 -- 172.21.15.110:0/55288040 shutdown_connections 2024-04-26T11:36:17.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/55288040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689472580 0x558689472fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/55288040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x5586894759b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/55288040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689471c60 0x55868946c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.329+0000 7f76c59c8b80 1 -- 172.21.15.110:0/55288040 >> 172.21.15.110:0/55288040 conn(0x5586893993f0 msgr2=0x558689461470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:17.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.330+0000 7f76c59c8b80 1 -- 172.21.15.110:0/55288040 shutdown_connections 2024-04-26T11:36:17.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.330+0000 7f76c59c8b80 1 -- 172.21.15.110:0/55288040 wait complete. 2024-04-26T11:36:17.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.330+0000 7f76c59c8b80 1 -- start start 2024-04-26T11:36:17.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.330+0000 7f76c59c8b80 1 Processor -- start 2024-04-26T11:36:17.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x55868947b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 0x55868947b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76c59c8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 0x55868947bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f76b41b2940 con 0x55868946c5d0 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f76b41b3db0 con 0x558689471c60 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76c59c8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f76b41b3010 con 0x558689472580 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76c59c8b80 10 client.0 _ll_register_callbacks cb 0x558689352480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76b3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x55868947b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76b3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x55868947b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57000/0 (socket says 172.21.15.110:57000) 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76b3e00700 1 -- 172.21.15.110:0/1121258265 learned_addr learned my addr 172.21.15.110:0/1121258265 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76b9000700 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 0x55868947bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.331+0000 7f76b3400700 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 0x55868947b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f76b3e00700 1 -- 172.21.15.110:0/1121258265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 msgr2=0x55868947bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f76b3e00700 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 0x55868947bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f76b3e00700 1 -- 172.21.15.110:0/1121258265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 msgr2=0x55868947b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:17.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f76b3e00700 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 0x55868947b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f76b3e00700 1 -- 172.21.15.110:0/1121258265 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586894ec1c0 con 0x55868946c5d0 2024-04-26T11:36:17.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f76b3e00700 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x55868947b320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76a409d710 tx=0x7f76a4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0789530174dfff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:17.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f769e000700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:36:17.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f769e000700 1 -- 172.21.15.110:0/1121258265 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a4097060 con 0x55868946c5d0 2024-04-26T11:36:17.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f769e000700 1 -- 172.21.15.110:0/1121258265 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f76a409cde0 con 0x55868946c5d0 2024-04-26T11:36:17.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.332+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1121258265 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76a40cf320 con 0x55868946c5d0 2024-04-26T11:36:17.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f769e000700 1 -- 172.21.15.110:0/1121258265 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f76a409d2c0 con 0x55868946c5d0 2024-04-26T11:36:17.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f76c59c8b80 10 client.15594 fetch_fsmap learned FSMap version 34 2024-04-26T11:36:17.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1121258265 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5586894ec1c0 con 0x55868946c5d0 2024-04-26T11:36:17.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f769e000700 1 -- 172.21.15.110:0/1121258265 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76a40cf320 con 0x55868946c5d0 2024-04-26T11:36:17.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f769e000700 1 -- 172.21.15.110:0/1121258265 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f76a4099040 con 0x55868946c5d0 2024-04-26T11:36:17.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f76c59c8b80 10 client.15594 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:36:17.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f76c59c8b80 10 client.15594 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:36:17.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f76c59c8b80 20 client.15594 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:17.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5586894ed600 0x5586894ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:17.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f76c59c8b80 4 client.15594 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "55680a45", "release": true, "await": true}] 2024-04-26T11:36:17.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.333+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1121258265 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "set_id": "55680a45", "release": true, "await": true}) -- 0x5586893c6410 con 0x5586894ed600 2024-04-26T11:36:17.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.334+0000 7f76b3400700 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5586894ed600 0x5586894ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:17.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.334+0000 7f76b3400700 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5586894ed600 0x5586894ef9f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7e986e3498a842a server_cookie=c6c46bf5f809737c in_seq=0 out_seq=0 2024-04-26T11:36:17.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.334+0000 7f769e000700 10 client.15594 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:17.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.360+0000 7f769e000700 1 -- 172.21.15.110:0/1121258265 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5586893c6410 con 0x5586894ed600 2024-04-26T11:36:17.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.360+0000 7f769e000700 10 client.15594 handle_command_reply: tid=0 2024-04-26T11:36:17.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.360+0000 7f76c59c8b80 1 client.15594 shutdown 2024-04-26T11:36:17.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.360+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1121258265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 msgr2=0x55868947b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:17.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.360+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x55868947b320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76a409d710 tx=0x7f76a4009ca0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1121258265 shutdown_connections 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5586894ed600 0x5586894ef9f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558689472580 0x55868947bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55868946c5d0 0x55868947b320 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f76c59c8b80 1 --2- 172.21.15.110:0/1121258265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558689471c60 0x55868947b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1121258265 >> 172.21.15.110:0/1121258265 conn(0x5586893993f0 msgr2=0x558689476c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f769e000700 0 client.15594 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1121258265 shutdown_connections 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f76c59c8b80 1 -- 172.21.15.110:0/1121258265 wait complete. 2024-04-26T11:36:17.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.361+0000 7f76c59c8b80 20 client.15594 trim_cache size 0 max 16384 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 34, 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 16, 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "55680a45": { 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 16, 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RELEASED", 2024-04-26T11:36:17.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 78.7, 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": false, 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RELEASED", 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:36:17.365 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.362+0000 7f76b9a00700 1 -- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f76980a3db0 msgr2=0x7f76980a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.362+0000 7f76b9a00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f76980a3db0 0x7f76980a6270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76ac003fd0 tx=0x7f76ac004b40 comp rx=0 tx=0).stop 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.362+0000 7f76b9a00700 1 -- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b4109960 msgr2=0x7f76b41a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.362+0000 7f76b9a00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b4109960 0x7f76b41a0060 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f76a4000c00 tx=0x7f76a40057a0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.363+0000 7f76b9a00700 1 -- 172.21.15.110:0/482257928 shutdown_connections 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.363+0000 7f76b9a00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f76980a3db0 0x7f76980a6270 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.363+0000 7f76b9a00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f76b410e830 0x7f76b41a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.363+0000 7f76b9a00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76b4109960 0x7f76b41a0060 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.363+0000 7f76b9a00700 1 --2- 172.21.15.110:0/482257928 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76b410a320 0x7f76b41a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.363+0000 7f76b9a00700 1 -- 172.21.15.110:0/482257928 >> 172.21.15.110:0/482257928 conn(0x7f76b40791b0 msgr2=0x7f76b4079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:17.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.363+0000 7f76b9a00700 1 -- 172.21.15.110:0/482257928 shutdown_connections 2024-04-26T11:36:17.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:17.363+0000 7f76b9a00700 1 -- 172.21.15.110:0/482257928 wait complete. 2024-04-26T11:36:18.217 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:17 smithi110 ceph-mon[28069]: pgmap v153: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.5 MiB/s wr, 183 op/s 2024-04-26T11:36:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:17 smithi196 ceph-mon[32572]: pgmap v153: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.5 MiB/s wr, 183 op/s 2024-04-26T11:36:18.287 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '55680a45', seconds elapsed: 37.4 2024-04-26T11:36:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:17 smithi193 ceph-mon[32782]: pgmap v153: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 1.5 MiB/s wr, 183 op/s 2024-04-26T11:36:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:18 smithi196 ceph-mon[32572]: pgmap v154: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.5 MiB/s wr, 186 op/s 2024-04-26T11:36:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:18 smithi110 ceph-mon[28069]: pgmap v154: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.5 MiB/s wr, 186 op/s 2024-04-26T11:36:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:18 smithi193 ceph-mon[32782]: pgmap v154: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.5 MiB/s wr, 186 op/s 2024-04-26T11:36:19.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 245.0 s, 1543.1 tps, lat 382.692 ms stddev 3061.001 2024-04-26T11:36:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:21 smithi110 ceph-mon[28069]: pgmap v155: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-04-26T11:36:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:21 smithi193 ceph-mon[32782]: pgmap v155: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-04-26T11:36:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:21 smithi196 ceph-mon[32572]: pgmap v155: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc1a6aab700 time 2024-04-26T11:36:22.531351+0000 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc1b10d43dd] 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1b10d45a3] 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5632ec750822] 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5632ec6c0598] 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5632ec6c2c17] 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5632ec5bbd0b] 2024-04-26T11:36:23.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5632ec5bc2ac] 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5632ec5a4fad] 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1b1368e20] 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 10: (DispatchQueue::entry()+0x51f) [0x7fc1b1365fdf] 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1b1438fc1] 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc1afe521ca] 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 13: clone() 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:22.532+0000 7fc1a6aab700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc1a6aab700 time 2024-04-26T11:36:22.531351+0000 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc1b10d43dd] 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1b10d45a3] 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5632ec750822] 2024-04-26T11:36:23.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5632ec6c0598] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5632ec6c2c17] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5632ec5bbd0b] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5632ec5bc2ac] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5632ec5a4fad] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1b1368e20] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 10: (DispatchQueue::entry()+0x51f) [0x7fc1b1365fdf] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1b1438fc1] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc1afe521ca] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 13: clone() 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: *** Caught signal (Aborted) ** 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: in thread 7fc1a6aab700 thread_name:ms_dispatch 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc1afe5cd20] 2024-04-26T11:36:23.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2: gsignal() 2024-04-26T11:36:23.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 3: abort() 2024-04-26T11:36:23.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc1b10d4437] 2024-04-26T11:36:23.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1b10d45a3] 2024-04-26T11:36:23.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5632ec750822] 2024-04-26T11:36:23.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5632ec6c0598] 2024-04-26T11:36:23.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5632ec6c2c17] 2024-04-26T11:36:23.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5632ec5bbd0b] 2024-04-26T11:36:23.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5632ec5bc2ac] 2024-04-26T11:36:23.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5632ec5a4fad] 2024-04-26T11:36:23.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1b1368e20] 2024-04-26T11:36:23.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 13: (DispatchQueue::entry()+0x51f) [0x7fc1b1365fdf] 2024-04-26T11:36:23.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1b1438fc1] 2024-04-26T11:36:23.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc1afe521ca] 2024-04-26T11:36:23.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 16: clone() 2024-04-26T11:36:23.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:22.533+0000 7fc1a6aab700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:36:23.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: in thread 7fc1a6aab700 thread_name:ms_dispatch 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc1afe5cd20] 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2: gsignal() 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 3: abort() 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc1b10d4437] 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1b10d45a3] 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5632ec750822] 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5632ec6c0598] 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5632ec6c2c17] 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5632ec5bbd0b] 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5632ec5bc2ac] 2024-04-26T11:36:23.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5632ec5a4fad] 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1b1368e20] 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 13: (DispatchQueue::entry()+0x51f) [0x7fc1b1365fdf] 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1b1438fc1] 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc1afe521ca] 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 16: clone() 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: -1> 2024-04-26T11:36:22.532+0000 7fc1a6aab700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc1a6aab700 time 2024-04-26T11:36:22.531351+0000 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc1b10d43dd] 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1b10d45a3] 2024-04-26T11:36:23.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5632ec750822] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5632ec6c0598] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5632ec6c2c17] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5632ec5bbd0b] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5632ec5bc2ac] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5632ec5a4fad] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1b1368e20] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 10: (DispatchQueue::entry()+0x51f) [0x7fc1b1365fdf] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1b1438fc1] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc1afe521ca] 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 13: clone() 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 0> 2024-04-26T11:36:22.533+0000 7fc1a6aab700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: in thread 7fc1a6aab700 thread_name:ms_dispatch 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc1afe5cd20] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2: gsignal() 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 3: abort() 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc1b10d4437] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1b10d45a3] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5632ec750822] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5632ec6c0598] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5632ec6c2c17] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5632ec5bbd0b] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5632ec5bc2ac] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5632ec5a4fad] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1b1368e20] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 13: (DispatchQueue::entry()+0x51f) [0x7fc1b1365fdf] 2024-04-26T11:36:23.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1b1438fc1] 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc1afe521ca] 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 16: clone() 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: -1> 2024-04-26T11:36:22.532+0000 7fc1a6aab700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc1a6aab700 time 2024-04-26T11:36:22.531351+0000 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc1b10d43dd] 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1b10d45a3] 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5632ec750822] 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5632ec6c0598] 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5632ec6c2c17] 2024-04-26T11:36:23.015 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5632ec5bbd0b] 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5632ec5bc2ac] 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5632ec5a4fad] 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1b1368e20] 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 10: (DispatchQueue::entry()+0x51f) [0x7fc1b1365fdf] 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1b1438fc1] 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc1afe521ca] 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 13: clone() 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 0> 2024-04-26T11:36:22.533+0000 7fc1a6aab700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: in thread 7fc1a6aab700 thread_name:ms_dispatch 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc1afe5cd20] 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2: gsignal() 2024-04-26T11:36:23.016 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 3: abort() 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc1b10d4437] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1b10d45a3] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5632ec750822] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5632ec6c0598] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5632ec6c2c17] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5632ec5bbd0b] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5632ec5bc2ac] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5632ec5a4fad] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1b1368e20] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 13: (DispatchQueue::entry()+0x51f) [0x7fc1b1365fdf] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1b1438fc1] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc1afe521ca] 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 16: clone() 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:36:23.017 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[63378]: 2024-04-26T11:36:23.018 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:22 smithi196 podman[67530]: 2024-04-26 11:36:22.597385105 +0000 UTC m=+0.020535784 container died d0b9c24b21c1481428eba191e98463ebe18903be9b9eb79497ab907b4c521dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T11:36:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:23 smithi196 ceph-mon[32572]: pgmap v156: 97 pgs: 97 active+clean; 2.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.3 MiB/s wr, 316 op/s 2024-04-26T11:36:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:23 smithi193 ceph-mon[32782]: pgmap v156: 97 pgs: 97 active+clean; 2.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.3 MiB/s wr, 316 op/s 2024-04-26T11:36:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:23 smithi110 ceph-mon[28069]: pgmap v156: 97 pgs: 97 active+clean; 2.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.3 MiB/s wr, 316 op/s 2024-04-26T11:36:23.867 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:23 smithi196 podman[67530]: 2024-04-26 11:36:23.608434231 +0000 UTC m=+1.031584949 container remove d0b9c24b21c1481428eba191e98463ebe18903be9b9eb79497ab907b4c521dd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T11:36:23.868 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:23 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:36:24.255 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:23 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T11:36:24.255 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:23 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Consumed 4.122s CPU time. 2024-04-26T11:36:24.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 250.0 s, 2300.8 tps, lat 37.196 ms stddev 46.650 2024-04-26T11:36:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.269+0000 7f606a800640 1 -- 172.21.15.110:0/1996565812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6064105500 msgr2=0x7f60641119c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.269+0000 7f606a800640 1 --2- 172.21.15.110:0/1996565812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6064105500 0x7f60641119c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f605c009cd0 tx=0x7f605c02a8f0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.269+0000 7f606a800640 1 -- 172.21.15.110:0/1996565812 shutdown_connections 2024-04-26T11:36:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.269+0000 7f606a800640 1 --2- 172.21.15.110:0/1996565812 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6064105500 0x7f60641119c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.269+0000 7f606a800640 1 --2- 172.21.15.110:0/1996565812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6064104b40 0x7f6064104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.269+0000 7f606a800640 1 --2- 172.21.15.110:0/1996565812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f606410ac00 0x7f606410afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.269+0000 7f606a800640 1 -- 172.21.15.110:0/1996565812 >> 172.21.15.110:0/1996565812 conn(0x7f6064100630 msgr2=0x7f6064102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.269+0000 7f606a800640 1 -- 172.21.15.110:0/1996565812 shutdown_connections 2024-04-26T11:36:25.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.269+0000 7f606a800640 1 -- 172.21.15.110:0/1996565812 wait complete. 2024-04-26T11:36:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.270+0000 7f606a800640 1 Processor -- start 2024-04-26T11:36:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.270+0000 7f606a800640 1 -- start start 2024-04-26T11:36:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.270+0000 7f606a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6064104b40 0x7f606419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.270+0000 7f606a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6064105500 0x7f606419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.270+0000 7f606a800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f606410ac00 0x7f606419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.270+0000 7f606a800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6064114df0 con 0x7f6064105500 2024-04-26T11:36:25.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.270+0000 7f606a800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6064114c70 con 0x7f606410ac00 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.270+0000 7f606a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6064114f70 con 0x7f6064104b40 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f606410ac00 0x7f606419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f606410ac00 0x7f606419fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:36714/0 (socket says 172.21.15.110:36714) 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063e00640 1 -- 172.21.15.110:0/795880810 learned_addr learned my addr 172.21.15.110:0/795880810 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063400640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6064104b40 0x7f606419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6062a00640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6064105500 0x7f606419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063e00640 1 -- 172.21.15.110:0/795880810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6064104b40 msgr2=0x7f606419b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063e00640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6064104b40 0x7f606419b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063e00640 1 -- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6064105500 msgr2=0x7f606419b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063e00640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6064105500 0x7f606419b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063e00640 1 -- 172.21.15.110:0/795880810 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60641a01a0 con 0x7f606410ac00 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063400640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6064104b40 0x7f606419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:36:25.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.271+0000 7f6063e00640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f606410ac00 0x7f606419fa70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f605c005e30 tx=0x7f605c030f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.272+0000 7f605be00640 1 -- 172.21.15.110:0/795880810 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c004040 con 0x7f606410ac00 2024-04-26T11:36:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.272+0000 7f606a800640 1 -- 172.21.15.110:0/795880810 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60641a0430 con 0x7f606410ac00 2024-04-26T11:36:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.272+0000 7f605be00640 1 -- 172.21.15.110:0/795880810 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f605c040070 con 0x7f606410ac00 2024-04-26T11:36:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.272+0000 7f605be00640 1 -- 172.21.15.110:0/795880810 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c045ac0 con 0x7f606410ac00 2024-04-26T11:36:25.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.272+0000 7f606a800640 1 -- 172.21.15.110:0/795880810 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641a7d20 con 0x7f606410ac00 2024-04-26T11:36:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.275+0000 7f606d7ca740 1 Processor -- start 2024-04-26T11:36:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.275+0000 7f605be00640 1 -- 172.21.15.110:0/795880810 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f605c045c60 con 0x7f606410ac00 2024-04-26T11:36:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.275+0000 7f606d7ca740 1 -- start start 2024-04-26T11:36:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.275+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f11821b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.275+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f118ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.275+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 0x5633f118f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.275+0000 7f606d7ca740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5633f10e7380 con 0x5633f11826f0 2024-04-26T11:36:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.275+0000 7f606d7ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5633f1083c30 con 0x5633f118cfb0 2024-04-26T11:36:25.279 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.275+0000 7f606d7ca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5633f10e3340 con 0x5633f1181dd0 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f11821b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6063400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f118ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f11821b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42828/0 (socket says 172.21.15.110:42828) 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 -- 172.21.15.110:0/3248633167 learned_addr learned my addr 172.21.15.110:0/3248633167 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 --2- 172.21.15.110:0/3248633167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 0x5633f118f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 -- 172.21.15.110:0/3248633167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 msgr2=0x5633f118f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 --2- 172.21.15.110:0/3248633167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 0x5633f118f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 -- 172.21.15.110:0/3248633167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 msgr2=0x5633f118ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 --2- 172.21.15.110:0/3248633167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f118ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 -- 172.21.15.110:0/3248633167 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f10a5940 con 0x5633f1181dd0 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6062a00640 1 --2- 172.21.15.110:0/3248633167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f11821b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6050009400 tx=0x7f6050009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=176c61db3b67f5a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:25.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f605be00640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f60480a3dc0 0x7f60480a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f605be00640 1 -- 172.21.15.110:0/795880810 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f605c0f1a00 con 0x7f606410ac00 2024-04-26T11:36:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.276+0000 7f6058c00640 1 -- 172.21.15.110:0/3248633167 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6050004250 con 0x5633f1181dd0 2024-04-26T11:36:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f6058c00640 1 -- 172.21.15.110:0/3248633167 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60500043f0 con 0x5633f1181dd0 2024-04-26T11:36:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f6058c00640 1 -- 172.21.15.110:0/3248633167 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500119f0 con 0x5633f1181dd0 2024-04-26T11:36:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f6063400640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f60480a3dc0 0x7f60480a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f606d7ca740 1 -- 172.21.15.110:0/3248633167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 msgr2=0x5633f11821b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3248633167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f11821b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6050009400 tx=0x7f6050009370 comp rx=0 tx=0).stop 2024-04-26T11:36:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f6063400640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f60480a3dc0 0x7f60480a6280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5633f1183370 tx=0x7f6054005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f606d7ca740 1 -- 172.21.15.110:0/3248633167 shutdown_connections 2024-04-26T11:36:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3248633167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 0x5633f118f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3248633167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f118ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3248633167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f11821b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f606d7ca740 1 -- 172.21.15.110:0/3248633167 >> 172.21.15.110:0/3248633167 conn(0x5633f117e2e0 msgr2=0x5633f117e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f606d7ca740 1 -- 172.21.15.110:0/3248633167 shutdown_connections 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.277+0000 7f606d7ca740 1 -- 172.21.15.110:0/3248633167 wait complete. 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.278+0000 7f606d7ca740 1 -- start start 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.278+0000 7f606d7ca740 1 Processor -- start 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1189f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 0x5633f118a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f118a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f606d7ca740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5633f118fbe0 con 0x5633f1181dd0 2024-04-26T11:36:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f606d7ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5633f106ec60 con 0x5633f11826f0 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f606d7ca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5633f118fd60 con 0x5633f118cfb0 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f606d7ca740 10 client.0 _ll_register_callbacks cb 0x5633f109ae50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1189f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f118a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1189f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40624/0 (socket says 172.21.15.110:40624) 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063400640 1 -- 172.21.15.110:0/571298684 learned_addr learned my addr 172.21.15.110:0/571298684 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f118a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42834/0 (socket says 172.21.15.110:42834) 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6062a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 0x5633f118a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063e00640 1 -- 172.21.15.110:0/571298684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 msgr2=0x5633f118a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063e00640 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 0x5633f118a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063e00640 1 -- 172.21.15.110:0/571298684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 msgr2=0x5633f1189f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063e00640 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1189f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063e00640 1 -- 172.21.15.110:0/571298684 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f107d510 con 0x5633f118cfb0 2024-04-26T11:36:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f6063e00640 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f118a9b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f605c0ef1c0 tx=0x7f605c0bd730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab747f532cd7040d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.279+0000 7f604d600640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f604d600640 1 -- 172.21.15.110:0/571298684 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c0bee60 con 0x5633f118cfb0 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f606d7ca740 1 -- 172.21.15.110:0/571298684 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60500043f0 con 0x5633f118cfb0 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f604d600640 1 -- 172.21.15.110:0/571298684 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f605c0bdf90 con 0x5633f118cfb0 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f604d600640 1 -- 172.21.15.110:0/571298684 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f605c0bdb30 con 0x5633f118cfb0 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f606d7ca740 10 client.25801 fetch_fsmap learned FSMap version 34 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f606d7ca740 1 -- 172.21.15.110:0/571298684 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5633f0df9210 con 0x5633f118cfb0 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f604d600640 1 -- 172.21.15.110:0/571298684 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60500043f0 con 0x5633f118cfb0 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f604d600640 1 -- 172.21.15.110:0/571298684 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f605c04d030 con 0x5633f118cfb0 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f606d7ca740 10 client.25801 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f606d7ca740 10 client.25801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f606d7ca740 20 client.25801 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f606d7ca740 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5633f119cc70 0x5633f119f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f606d7ca740 4 client.25801 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.280+0000 7f606d7ca740 1 -- 172.21.15.110:0/571298684 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633f10f4f90 con 0x5633f119cc70 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.281+0000 7f6063400640 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5633f119cc70 0x5633f119f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.281+0000 7f6063400640 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5633f119cc70 0x5633f119f0c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31d4e4ead8af2358 server_cookie=dba9b5f4d72e69a1 in_seq=0 out_seq=0 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.281+0000 7f604d600640 10 client.25801 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f604d600640 1 -- 172.21.15.110:0/571298684 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5633f10f4f90 con 0x5633f119cc70 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f604d600640 10 client.25801 handle_command_reply: tid=0 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 client.25801 shutdown 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 -- 172.21.15.110:0/571298684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 msgr2=0x5633f118a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f118a9b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f605c0ef1c0 tx=0x7f605c0bd730 comp rx=0 tx=0).stop 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 -- 172.21.15.110:0/571298684 shutdown_connections 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5633f119cc70 0x5633f119f0c0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f118a9b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 0x5633f118a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 --2- 172.21.15.110:0/571298684 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1189f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f604d600640 0 client.25801 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 -- 172.21.15.110:0/571298684 >> 172.21.15.110:0/571298684 conn(0x5633f117e2e0 msgr2=0x5633f1184060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 -- 172.21.15.110:0/571298684 shutdown_connections 2024-04-26T11:36:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 1 -- 172.21.15.110:0/571298684 wait complete. 2024-04-26T11:36:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.282+0000 7f606d7ca740 20 client.25801 trim_cache size 0 max 16384 2024-04-26T11:36:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f606d7ca740 1 Processor -- start 2024-04-26T11:36:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f606d7ca740 1 -- start start 2024-04-26T11:36:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 0x5633f11847e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f11a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f606d7ca740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b3120 con 0x5633f1181dd0 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f606d7ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b0960 con 0x5633f11826f0 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f606d7ca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f60641ae7b0 con 0x5633f118cfb0 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f6063400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f6063400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40628/0 (socket says 172.21.15.110:40628) 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.299+0000 7f6063400640 1 -- 172.21.15.110:0/3992899334 learned_addr learned my addr 172.21.15.110:0/3992899334 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f6062a00640 1 --2- 172.21.15.110:0/3992899334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 0x5633f11847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f6063e00640 1 --2- 172.21.15.110:0/3992899334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f11a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f6063400640 1 -- 172.21.15.110:0/3992899334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 msgr2=0x5633f11a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f6063400640 1 --2- 172.21.15.110:0/3992899334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f11a49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f6063400640 1 -- 172.21.15.110:0/3992899334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 msgr2=0x5633f11847e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f6063400640 1 --2- 172.21.15.110:0/3992899334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 0x5633f11847e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f6063400640 1 -- 172.21.15.110:0/3992899334 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f0ec5620 con 0x5633f1181dd0 2024-04-26T11:36:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f6063400640 1 --2- 172.21.15.110:0/3992899334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1198aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6054005b90 tx=0x7f605401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b50d97844c312c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f604fe00640 1 -- 172.21.15.110:0/3992899334 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605401d690 con 0x5633f1181dd0 2024-04-26T11:36:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f604fe00640 1 -- 172.21.15.110:0/3992899334 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f605401dce0 con 0x5633f1181dd0 2024-04-26T11:36:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.300+0000 7f604fe00640 1 -- 172.21.15.110:0/3992899334 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605402a420 con 0x5633f1181dd0 2024-04-26T11:36:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.301+0000 7f606d7ca740 1 -- 172.21.15.110:0/3992899334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 msgr2=0x5633f1198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.301+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3992899334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1198aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6054005b90 tx=0x7f605401b000 comp rx=0 tx=0).stop 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.301+0000 7f606d7ca740 1 -- 172.21.15.110:0/3992899334 shutdown_connections 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.301+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3992899334 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f118cfb0 0x5633f11a49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.301+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3992899334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f11826f0 0x5633f11847e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.301+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3992899334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f1181dd0 0x5633f1198aa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.301+0000 7f606d7ca740 1 -- 172.21.15.110:0/3992899334 >> 172.21.15.110:0/3992899334 conn(0x5633f117e2e0 msgr2=0x5633f1185230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.301+0000 7f606d7ca740 1 -- 172.21.15.110:0/3992899334 shutdown_connections 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.301+0000 7f606d7ca740 1 -- 172.21.15.110:0/3992899334 wait complete. 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.302+0000 7f606d7ca740 1 -- start start 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.302+0000 7f606d7ca740 1 Processor -- start 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.302+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f1195330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.302+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f11868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.302+0000 7f606d7ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 0x5633f1186df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.302+0000 7f606d7ca740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f60641aee20 con 0x5633f11826f0 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.302+0000 7f606d7ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b0290 con 0x5633f118cfb0 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.302+0000 7f606d7ca740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f60641af4f0 con 0x5633f1181dd0 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.302+0000 7f606d7ca740 10 client.0 _ll_register_callbacks cb 0x7f605c045470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6062a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f11868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6062a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f11868b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40634/0 (socket says 172.21.15.110:40634) 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6062a00640 1 -- 172.21.15.110:0/3681991754 learned_addr learned my addr 172.21.15.110:0/3681991754 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6063400640 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f1195330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6063e00640 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 0x5633f1186df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6062a00640 1 -- 172.21.15.110:0/3681991754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 msgr2=0x5633f1195330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6062a00640 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f1195330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6062a00640 1 -- 172.21.15.110:0/3681991754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 msgr2=0x5633f1186df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6062a00640 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 0x5633f1186df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6062a00640 1 -- 172.21.15.110:0/3681991754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f10a1cb0 con 0x5633f11826f0 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f6062a00640 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f11868b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6050016010 tx=0x7f6050009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a6ac87ea78d8d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f604d600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.303+0000 7f604d600640 1 -- 172.21.15.110:0/3681991754 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6050011ab0 con 0x5633f11826f0 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f604d600640 1 -- 172.21.15.110:0/3681991754 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8643+0+0 (secure 0 0 0) 0x7f6050009850 con 0x5633f11826f0 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f606d7ca740 1 -- 172.21.15.110:0/3681991754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f605401dce0 con 0x5633f11826f0 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f604d600640 1 -- 172.21.15.110:0/3681991754 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6050039050 con 0x5633f11826f0 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f606d7ca740 10 client.15612 fetch_fsmap learned FSMap version 34 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f606d7ca740 1 -- 172.21.15.110:0/3681991754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5633f12030e0 con 0x5633f11826f0 2024-04-26T11:36:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f604d600640 1 -- 172.21.15.110:0/3681991754 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f605401dce0 con 0x5633f11826f0 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f604d600640 1 -- 172.21.15.110:0/3681991754 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f6050034030 con 0x5633f11826f0 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f606d7ca740 10 client.15612 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f606d7ca740 10 client.15612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f606d7ca740 20 client.15612 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5633f1203640 0x5633f1205a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f606d7ca740 4 client.15612 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.304+0000 7f606d7ca740 1 -- 172.21.15.110:0/3681991754 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5633f10eee00 con 0x5633f1203640 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.305+0000 7f6063400640 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5633f1203640 0x5633f1205a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.305+0000 7f6063400640 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5633f1203640 0x5633f1205a60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5897619f12ecca1 server_cookie=b4cfb6a40e837e10 in_seq=0 out_seq=0 2024-04-26T11:36:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:25.305+0000 7f604d600640 10 client.15612 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:25 smithi193 ceph-mon[32782]: pgmap v157: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 4.9 MiB/s wr, 388 op/s 2024-04-26T11:36:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:25 smithi196 ceph-mon[32572]: pgmap v157: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 4.9 MiB/s wr, 388 op/s 2024-04-26T11:36:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:25 smithi110 ceph-mon[28069]: pgmap v157: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 4.9 MiB/s wr, 388 op/s 2024-04-26T11:36:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:27 smithi110 ceph-mon[28069]: pgmap v158: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 4.9 MiB/s wr, 387 op/s 2024-04-26T11:36:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:27 smithi193 ceph-mon[32782]: pgmap v158: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 4.9 MiB/s wr, 387 op/s 2024-04-26T11:36:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:27 smithi196 ceph-mon[32572]: pgmap v158: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 4.9 MiB/s wr, 387 op/s 2024-04-26T11:36:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:29 smithi193 ceph-mon[32782]: pgmap v159: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.6 MiB/s wr, 576 op/s 2024-04-26T11:36:29.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:36:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:29 smithi196 ceph-mon[32572]: pgmap v159: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.6 MiB/s wr, 576 op/s 2024-04-26T11:36:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:29 smithi110 ceph-mon[28069]: pgmap v159: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.6 MiB/s wr, 576 op/s 2024-04-26T11:36:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:31 smithi193 ceph-mon[32782]: pgmap v160: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.6 MiB/s wr, 573 op/s 2024-04-26T11:36:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:31 smithi196 ceph-mon[32572]: pgmap v160: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.6 MiB/s wr, 573 op/s 2024-04-26T11:36:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:31 smithi110 ceph-mon[28069]: pgmap v160: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.6 MiB/s wr, 573 op/s 2024-04-26T11:36:33.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:33 smithi193 ceph-mon[32782]: pgmap v161: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.8 MiB/s wr, 607 op/s 2024-04-26T11:36:33.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:33 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:36:33.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:36:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:33 smithi196 ceph-mon[32572]: pgmap v161: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.8 MiB/s wr, 607 op/s 2024-04-26T11:36:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:33 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:36:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:36:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:33 smithi110 ceph-mon[28069]: pgmap v161: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.8 MiB/s wr, 607 op/s 2024-04-26T11:36:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:33 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:36:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:36:34.300 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:36:34.301 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 systemd[1]: Stopped Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:36:34.301 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Consumed 4.122s CPU time. 2024-04-26T11:36:34.301 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 systemd[1]: Starting Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:36:34.301 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 podman[67729]: 2024-04-26 11:36:34.131325407 +0000 UTC m=+0.017747646 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:36:34.553 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 podman[67729]: 2024-04-26 11:36:34.300568253 +0000 UTC m=+0.186990479 container create bd2c0a7b0b5a77ee5dc379bde696e11e00895caac8c45e51cc04f4490eed9a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:36:34.831 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:36:34.832 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:36:34.832 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:36:34.832 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 podman[67729]: 2024-04-26 11:36:34.553379444 +0000 UTC m=+0.439801671 container init bd2c0a7b0b5a77ee5dc379bde696e11e00895caac8c45e51cc04f4490eed9a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:36:34.832 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 podman[67729]: 2024-04-26 11:36:34.556117127 +0000 UTC m=+0.442539363 container start bd2c0a7b0b5a77ee5dc379bde696e11e00895caac8c45e51cc04f4490eed9a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-04-26T11:36:34.832 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 ceph-mds[67748]: -- 172.21.15.196:0/2096367725 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562785b93a40 con 0x562785b66c00 2024-04-26T11:36:34.832 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: starting mds.i at 2024-04-26T11:36:34.832 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 bash[67729]: bd2c0a7b0b5a77ee5dc379bde696e11e00895caac8c45e51cc04f4490eed9a91 2024-04-26T11:36:34.832 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:36:34 smithi196 systemd[1]: Started Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:36:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:36:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:36:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:36:34.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:36:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:36:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:36:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:36:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:35 smithi193 ceph-mon[32782]: pgmap v162: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.6 MiB/s wr, 312 op/s 2024-04-26T11:36:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:35 smithi193 ceph-mon[32782]: daemon mds.i restarted 2024-04-26T11:36:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:35 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:36:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:35 smithi193 ceph-mon[32782]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T11:36:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:35 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:boot 2024-04-26T11:36:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:35 smithi193 ceph-mon[32782]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:36:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:35 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:36:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:36:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:35 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:35 smithi196 ceph-mon[32572]: pgmap v162: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.6 MiB/s wr, 312 op/s 2024-04-26T11:36:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:35 smithi196 ceph-mon[32572]: daemon mds.i restarted 2024-04-26T11:36:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:35 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:36:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:35 smithi196 ceph-mon[32572]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T11:36:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:35 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:boot 2024-04-26T11:36:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:35 smithi196 ceph-mon[32572]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:36:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:35 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:36:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:36:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:35 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:35 smithi110 ceph-mon[28069]: pgmap v162: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.6 MiB/s wr, 312 op/s 2024-04-26T11:36:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:35 smithi110 ceph-mon[28069]: daemon mds.i restarted 2024-04-26T11:36:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:35 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:36:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:35 smithi110 ceph-mon[28069]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T11:36:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:35 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:boot 2024-04-26T11:36:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:35 smithi110 ceph-mon[28069]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:36:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:35 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:36:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:36:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:35 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:36 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:resolve 2024-04-26T11:36:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:36 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:36.875 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:36 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:resolve 2024-04-26T11:36:36.875 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:36 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:36 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:resolve 2024-04-26T11:36:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:36 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:37.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.639+0000 7f604d600640 1 -- 172.21.15.110:0/3681991754 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5633f10eee00 con 0x5633f1203640 2024-04-26T11:36:37.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.639+0000 7f604d600640 10 client.15612 handle_command_reply: tid=0 2024-04-26T11:36:37.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.639+0000 7f606d7ca740 1 client.15612 shutdown 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.640+0000 7f606d7ca740 1 -- 172.21.15.110:0/3681991754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 msgr2=0x5633f11868b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.640+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f11868b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6050016010 tx=0x7f6050009d40 comp rx=0 tx=0).stop 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.640+0000 7f606d7ca740 1 -- 172.21.15.110:0/3681991754 shutdown_connections 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.640+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5633f118cfb0 0x5633f1186df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.640+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5633f11826f0 0x5633f11868b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.640+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5633f1203640 0x5633f1205a60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.640+0000 7f606d7ca740 1 --2- 172.21.15.110:0/3681991754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f1181dd0 0x5633f1195330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.640+0000 7f606d7ca740 1 -- 172.21.15.110:0/3681991754 >> 172.21.15.110:0/3681991754 conn(0x5633f117e2e0 msgr2=0x5633f1189ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.640+0000 7f604d600640 0 client.15612 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.641+0000 7f606d7ca740 1 -- 172.21.15.110:0/3681991754 shutdown_connections 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.641+0000 7f606d7ca740 1 -- 172.21.15.110:0/3681991754 wait complete. 2024-04-26T11:36:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.641+0000 7f606d7ca740 20 client.15612 trim_cache size 0 max 16384 2024-04-26T11:36:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:36:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:36:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:36:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 -- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f60480a3dc0 msgr2=0x7f60480a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f60480a3dc0 0x7f60480a6280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5633f1183370 tx=0x7f6054005f90 comp rx=0 tx=0).stop 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 -- 172.21.15.110:0/795880810 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f606410ac00 msgr2=0x7f606419fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f606410ac00 0x7f606419fa70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f605c005e30 tx=0x7f605c030f50 comp rx=0 tx=0).stop 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 -- 172.21.15.110:0/795880810 shutdown_connections 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f60480a3dc0 0x7f60480a6280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f606410ac00 0x7f606419fa70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6064105500 0x7f606419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 --2- 172.21.15.110:0/795880810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6064104b40 0x7f606419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 -- 172.21.15.110:0/795880810 >> 172.21.15.110:0/795880810 conn(0x7f6064100630 msgr2=0x7f6064101e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 -- 172.21.15.110:0/795880810 shutdown_connections 2024-04-26T11:36:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:37.642+0000 7f606a800640 1 -- 172.21.15.110:0/795880810 wait complete. 2024-04-26T11:36:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:37 smithi196 ceph-mon[32572]: pgmap v164: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.4 MiB/s wr, 282 op/s 2024-04-26T11:36:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:37 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:36:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:37 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:reconnect 2024-04-26T11:36:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:37 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:38.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:37 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0169996 2024-04-26T11:36:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:37 smithi110 ceph-mon[28069]: pgmap v164: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.4 MiB/s wr, 282 op/s 2024-04-26T11:36:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:37 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:36:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:37 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:reconnect 2024-04-26T11:36:38.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:37 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:38.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:37 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0169996 2024-04-26T11:36:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:37 smithi193 ceph-mon[32782]: pgmap v164: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.4 MiB/s wr, 282 op/s 2024-04-26T11:36:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:37 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:36:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:37 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:reconnect 2024-04-26T11:36:38.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:37 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:38.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:37 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0169996 2024-04-26T11:36:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:38 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:rejoin 2024-04-26T11:36:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:38 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:38 smithi196 ceph-mon[32572]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:36:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:38 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:36:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:38 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:36:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:38 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:active 2024-04-26T11:36:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:38 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:36:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:38 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:rejoin 2024-04-26T11:36:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:38 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:38 smithi110 ceph-mon[28069]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:36:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:38 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:36:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:38 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:36:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:38 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:active 2024-04-26T11:36:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:38 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:36:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:38 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:rejoin 2024-04-26T11:36:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:38 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:36:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:38 smithi193 ceph-mon[32782]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:36:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:38 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:36:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:38 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:36:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:38 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1499716677,v1:172.21.15.196:6835/1499716677] up:active 2024-04-26T11:36:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:38 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:36:39.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 265.0 s, 748.1 tps, lat 420.401 ms stddev 2328.971 2024-04-26T11:36:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:39 smithi196 ceph-mon[32572]: pgmap v165: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-04-26T11:36:40.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:39 smithi110 ceph-mon[28069]: pgmap v165: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-04-26T11:36:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:39 smithi193 ceph-mon[32782]: pgmap v165: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-04-26T11:36:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:40 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:36:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:40 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:36:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:40 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:36:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:41 smithi196 ceph-mon[32572]: pgmap v166: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-04-26T11:36:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:41 smithi110 ceph-mon[28069]: pgmap v166: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-04-26T11:36:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:41 smithi193 ceph-mon[32782]: pgmap v166: 97 pgs: 97 active+clean; 2.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-04-26T11:36:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:43 smithi196 ceph-mon[32572]: pgmap v167: 97 pgs: 97 active+clean; 2.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 3.2 MiB/s wr, 326 op/s 2024-04-26T11:36:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:43 smithi110 ceph-mon[28069]: pgmap v167: 97 pgs: 97 active+clean; 2.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 3.2 MiB/s wr, 326 op/s 2024-04-26T11:36:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:43 smithi193 ceph-mon[32782]: pgmap v167: 97 pgs: 97 active+clean; 2.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 3.2 MiB/s wr, 326 op/s 2024-04-26T11:36:44.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 270.0 s, 2954.0 tps, lat 33.755 ms stddev 36.607 2024-04-26T11:36:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:45 smithi196 ceph-mon[32572]: pgmap v168: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 3.5 MiB/s wr, 362 op/s 2024-04-26T11:36:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:45 smithi110 ceph-mon[28069]: pgmap v168: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 3.5 MiB/s wr, 362 op/s 2024-04-26T11:36:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:45 smithi193 ceph-mon[32782]: pgmap v168: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 3.5 MiB/s wr, 362 op/s 2024-04-26T11:36:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:47 smithi196 ceph-mon[32572]: pgmap v169: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 3.0 MiB/s wr, 311 op/s 2024-04-26T11:36:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:47 smithi110 ceph-mon[28069]: pgmap v169: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 3.0 MiB/s wr, 311 op/s 2024-04-26T11:36:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:47 smithi193 ceph-mon[32782]: pgmap v169: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 3.0 MiB/s wr, 311 op/s 2024-04-26T11:36:49.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 275.0 s, 2502.7 tps, lat 33.260 ms stddev 40.156 2024-04-26T11:36:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:49 smithi196 ceph-mon[32572]: pgmap v170: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 5.8 MiB/s wr, 600 op/s 2024-04-26T11:36:50.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:49 smithi110 ceph-mon[28069]: pgmap v170: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 5.8 MiB/s wr, 600 op/s 2024-04-26T11:36:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:49 smithi193 ceph-mon[32782]: pgmap v170: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 5.8 MiB/s wr, 600 op/s 2024-04-26T11:36:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.786+0000 7f7880a00640 1 -- 172.21.15.110:0/2153425489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 msgr2=0x7f787c115e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.786+0000 7f7880a00640 1 --2- 172.21.15.110:0/2153425489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 0x7f787c115e30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7874009ca0 tx=0x7f787402a8c0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.787+0000 7f7880a00640 1 -- 172.21.15.110:0/2153425489 shutdown_connections 2024-04-26T11:36:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.787+0000 7f7880a00640 1 --2- 172.21.15.110:0/2153425489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 0x7f787c115e30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.787+0000 7f7880a00640 1 --2- 172.21.15.110:0/2153425489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f787c109b40 0x7f787c10db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.787+0000 7f7880a00640 1 --2- 172.21.15.110:0/2153425489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c109190 0x7f787c109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.787+0000 7f7880a00640 1 -- 172.21.15.110:0/2153425489 >> 172.21.15.110:0/2153425489 conn(0x7f787c076ec0 msgr2=0x7f787c0792e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.787+0000 7f7880a00640 1 -- 172.21.15.110:0/2153425489 shutdown_connections 2024-04-26T11:36:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.787+0000 7f7880a00640 1 -- 172.21.15.110:0/2153425489 wait complete. 2024-04-26T11:36:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.788+0000 7f7880a00640 1 Processor -- start 2024-04-26T11:36:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.788+0000 7f7880a00640 1 -- start start 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7880a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c109190 0x7f787c19f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7880a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 0x7f787c19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7880a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f787c1a3f20 0x7f787c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7880a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1191d0 con 0x7f787c109190 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7880a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f787c119050 con 0x7f787c1a3f20 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7880a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f787c119350 con 0x7f787c10e260 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7879e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c109190 0x7f787c19f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7879400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 0x7f787c19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f787a800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f787c1a3f20 0x7f787c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7879400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 0x7f787c19fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42196/0 (socket says 172.21.15.110:42196) 2024-04-26T11:36:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7879400640 1 -- 172.21.15.110:0/369423062 learned_addr learned my addr 172.21.15.110:0/369423062 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7879400640 1 -- 172.21.15.110:0/369423062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f787c1a3f20 msgr2=0x7f787c1a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7879400640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f787c1a3f20 0x7f787c1a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7879400640 1 -- 172.21.15.110:0/369423062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c109190 msgr2=0x7f787c19f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7879400640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c109190 0x7f787c19f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.789+0000 7f7879400640 1 -- 172.21.15.110:0/369423062 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c1a4a10 con 0x7f787c10e260 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.790+0000 7f7879400640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 0x7f787c19fbf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f786800e9f0 tx=0x7f786800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.790+0000 7f7872a00640 1 -- 172.21.15.110:0/369423062 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786800ccc0 con 0x7f787c10e260 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.790+0000 7f7872a00640 1 -- 172.21.15.110:0/369423062 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78680054d0 con 0x7f787c10e260 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.790+0000 7f7872a00640 1 -- 172.21.15.110:0/369423062 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868010430 con 0x7f787c10e260 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.790+0000 7f7880a00640 1 -- 172.21.15.110:0/369423062 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c1a4d00 con 0x7f787c10e260 2024-04-26T11:36:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.790+0000 7f7880a00640 1 -- 172.21.15.110:0/369423062 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c1ac4a0 con 0x7f787c10e260 2024-04-26T11:36:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.793+0000 7f7872a00640 1 -- 172.21.15.110:0/369423062 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f78680046c0 con 0x7f787c10e260 2024-04-26T11:36:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.793+0000 7f78839bb740 1 Processor -- start 2024-04-26T11:36:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.793+0000 7f78839bb740 1 -- start start 2024-04-26T11:36:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f78839bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c451b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f78839bb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f78839bb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f78839bb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563602baa380 con 0x563602c4ffb0 2024-04-26T11:36:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f78839bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563602b46c30 con 0x563602c44dd0 2024-04-26T11:36:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f78839bb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563602ba6340 con 0x563602c456f0 2024-04-26T11:36:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f7879e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f7879e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42210/0 (socket says 172.21.15.110:42210) 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f7879e00640 1 -- 172.21.15.110:0/2072999316 learned_addr learned my addr 172.21.15.110:0/2072999316 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f7879400640 1 --2- 172.21.15.110:0/2072999316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f787a800640 1 --2- 172.21.15.110:0/2072999316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f7879e00640 1 -- 172.21.15.110:0/2072999316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 msgr2=0x563602c451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f7879e00640 1 --2- 172.21.15.110:0/2072999316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f7879e00640 1 -- 172.21.15.110:0/2072999316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 msgr2=0x563602c523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f7879e00640 1 --2- 172.21.15.110:0/2072999316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.794+0000 7f7879e00640 1 -- 172.21.15.110:0/2072999316 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563602b68940 con 0x563602c456f0 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.795+0000 7f7872a00640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78600a3dc0 0x7f78600a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.795+0000 7f7872a00640 1 -- 172.21.15.110:0/369423062 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f78680d0c60 con 0x7f787c10e260 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.795+0000 7f7879e00640 1 --2- 172.21.15.110:0/2072999316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4fa70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f786c009cf0 tx=0x7f786c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f02631a876775cad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.795+0000 7f787a800640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78600a3dc0 0x7f78600a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.795+0000 7f7867000640 1 -- 172.21.15.110:0/2072999316 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c004230 con 0x563602c456f0 2024-04-26T11:36:50.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.795+0000 7f7867000640 1 -- 172.21.15.110:0/2072999316 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f786c0043d0 con 0x563602c456f0 2024-04-26T11:36:50.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.795+0000 7f7867000640 1 -- 172.21.15.110:0/2072999316 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c019880 con 0x563602c456f0 2024-04-26T11:36:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 -- 172.21.15.110:0/2072999316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 msgr2=0x563602c4fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f787a800640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78600a3dc0 0x7f78600a6280 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7874006010 tx=0x7f78740099a0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 --2- 172.21.15.110:0/2072999316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4fa70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f786c009cf0 tx=0x7f786c011810 comp rx=0 tx=0).stop 2024-04-26T11:36:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 -- 172.21.15.110:0/2072999316 shutdown_connections 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 --2- 172.21.15.110:0/2072999316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 --2- 172.21.15.110:0/2072999316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4fa70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 --2- 172.21.15.110:0/2072999316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 -- 172.21.15.110:0/2072999316 >> 172.21.15.110:0/2072999316 conn(0x563602c412e0 msgr2=0x563602c416c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 -- 172.21.15.110:0/2072999316 shutdown_connections 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 -- 172.21.15.110:0/2072999316 wait complete. 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.796+0000 7f78839bb740 1 -- start start 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f78839bb740 1 Processor -- start 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f78839bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c4cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f78839bb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f78839bb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f78839bb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563602c52be0 con 0x563602c4ffb0 2024-04-26T11:36:50.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f78839bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563602b31c60 con 0x563602c44dd0 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f78839bb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x563602c52d60 con 0x563602c456f0 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f78839bb740 10 client.0 _ll_register_callbacks cb 0x563602b5de50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f787a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f787a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42614/0 (socket says 172.21.15.110:42614) 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f787a800640 1 -- 172.21.15.110:0/1641976651 learned_addr learned my addr 172.21.15.110:0/1641976651 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f7879e00640 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c4cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.797+0000 7f7879400640 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f7879e00640 1 -- 172.21.15.110:0/1641976651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 msgr2=0x563602c4d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f7879e00640 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f7879e00640 1 -- 172.21.15.110:0/1641976651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 msgr2=0x563602c4d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f7879e00640 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f7879e00640 1 -- 172.21.15.110:0/1641976651 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563602b40510 con 0x563602c44dd0 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f787a800640 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f7879e00640 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c4cf60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x563602c46370 tx=0x7f786c0045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e551c913238c95da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:50.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f785b400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f785b400640 1 -- 172.21.15.110:0/1641976651 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c027070 con 0x563602c44dd0 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f785b400640 1 -- 172.21.15.110:0/1641976651 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f786c005240 con 0x563602c44dd0 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.798+0000 7f78839bb740 1 -- 172.21.15.110:0/1641976651 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f786c0043d0 con 0x563602c44dd0 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f785b400640 1 -- 172.21.15.110:0/1641976651 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f786c033050 con 0x563602c44dd0 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f78839bb740 10 client.25793 fetch_fsmap learned FSMap version 42 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f78839bb740 1 -- 172.21.15.110:0/1641976651 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5636028bc210 con 0x563602c44dd0 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f785b400640 1 -- 172.21.15.110:0/1641976651 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f786c0043d0 con 0x563602c44dd0 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f785b400640 1 -- 172.21.15.110:0/1641976651 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f786c004b70 con 0x563602c44dd0 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f78839bb740 10 client.25793 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f78839bb740 10 client.25793 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f78839bb740 20 client.25793 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f78839bb740 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563602c5fc70 0x563602c62060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f78839bb740 4 client.25793 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:36:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.799+0000 7f78839bb740 1 -- 172.21.15.110:0/1641976651 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563602bb7f90 con 0x563602c5fc70 2024-04-26T11:36:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.800+0000 7f7879400640 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563602c5fc70 0x563602c62060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.800+0000 7f7879400640 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563602c5fc70 0x563602c62060 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b72d80253bc6817 server_cookie=6d81f284a6aba05f in_seq=0 out_seq=0 2024-04-26T11:36:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.800+0000 7f785b400640 10 client.25793 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f785b400640 1 -- 172.21.15.110:0/1641976651 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563602bb7f90 con 0x563602c5fc70 2024-04-26T11:36:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f785b400640 10 client.25793 handle_command_reply: tid=0 2024-04-26T11:36:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 client.25793 shutdown 2024-04-26T11:36:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 -- 172.21.15.110:0/1641976651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 msgr2=0x563602c4cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c4cf60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x563602c46370 tx=0x7f786c0045f0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 -- 172.21.15.110:0/1641976651 shutdown_connections 2024-04-26T11:36:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563602c5fc70 0x563602c62060 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 --2- 172.21.15.110:0/1641976651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c4cf60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f785b400640 0 client.25793 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 -- 172.21.15.110:0/1641976651 >> 172.21.15.110:0/1641976651 conn(0x563602c412e0 msgr2=0x563602c47010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 -- 172.21.15.110:0/1641976651 shutdown_connections 2024-04-26T11:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 1 -- 172.21.15.110:0/1641976651 wait complete. 2024-04-26T11:36:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.801+0000 7f78839bb740 20 client.25793 trim_cache size 0 max 16384 2024-04-26T11:36:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f78839bb740 1 Processor -- start 2024-04-26T11:36:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f78839bb740 1 -- start start 2024-04-26T11:36:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f78839bb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c44dd0 0x563602c5baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f78839bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c456f0 0x563602c47790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f78839bb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c4ffb0 0x563602c677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f78839bb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1b7720 con 0x563602c44dd0 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f78839bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1b4f90 con 0x563602c456f0 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f78839bb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1b2de0 con 0x563602c4ffb0 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f7879e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c44dd0 0x563602c5baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f7879e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c44dd0 0x563602c5baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42618/0 (socket says 172.21.15.110:42618) 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f7879e00640 1 -- 172.21.15.110:0/2699487809 learned_addr learned my addr 172.21.15.110:0/2699487809 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.817+0000 7f7879400640 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c456f0 0x563602c47790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f787a800640 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c4ffb0 0x563602c677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7879e00640 1 -- 172.21.15.110:0/2699487809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c4ffb0 msgr2=0x563602c677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7879e00640 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c4ffb0 0x563602c677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7879e00640 1 -- 172.21.15.110:0/2699487809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c456f0 msgr2=0x563602c47790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7879e00640 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c456f0 0x563602c47790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7879e00640 1 -- 172.21.15.110:0/2699487809 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563602c52710 con 0x563602c44dd0 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7879400640 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c456f0 0x563602c47790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:36:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7879e00640 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c44dd0 0x563602c5baa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f786c000c00 tx=0x7f786c005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ed23e7bbee8cc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7866600640 1 -- 172.21.15.110:0/2699487809 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c03c070 con 0x563602c44dd0 2024-04-26T11:36:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7866600640 1 -- 172.21.15.110:0/2699487809 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f786c015030 con 0x563602c44dd0 2024-04-26T11:36:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.818+0000 7f7866600640 1 -- 172.21.15.110:0/2699487809 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c027070 con 0x563602c44dd0 2024-04-26T11:36:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 -- 172.21.15.110:0/2699487809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c44dd0 msgr2=0x563602c5baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c44dd0 0x563602c5baa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f786c000c00 tx=0x7f786c005680 comp rx=0 tx=0).stop 2024-04-26T11:36:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 -- 172.21.15.110:0/2699487809 shutdown_connections 2024-04-26T11:36:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c4ffb0 0x563602c677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c456f0 0x563602c47790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 --2- 172.21.15.110:0/2699487809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c44dd0 0x563602c5baa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 -- 172.21.15.110:0/2699487809 >> 172.21.15.110:0/2699487809 conn(0x563602c412e0 msgr2=0x563602c4d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 -- 172.21.15.110:0/2699487809 shutdown_connections 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 -- 172.21.15.110:0/2699487809 wait complete. 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.819+0000 7f78839bb740 1 -- start start 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f78839bb740 1 Processor -- start 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f78839bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c49b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f78839bb740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f78839bb740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f78839bb740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1b3450 con 0x563602c4ffb0 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f78839bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1b48c0 con 0x563602c44dd0 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f78839bb740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1b3b20 con 0x563602c456f0 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f78839bb740 10 client.0 _ll_register_callbacks cb 0x7f78680d45e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:50.825 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f7879400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f787a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f7879400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42250/0 (socket says 172.21.15.110:42250) 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.820+0000 7f7879400640 1 -- 172.21.15.110:0/2367675478 learned_addr learned my addr 172.21.15.110:0/2367675478 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f7879e00640 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c49b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f7879400640 1 -- 172.21.15.110:0/2367675478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 msgr2=0x563602c49b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f7879400640 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c49b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f7879400640 1 -- 172.21.15.110:0/2367675478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 msgr2=0x563602c4a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f7879400640 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f7879400640 1 -- 172.21.15.110:0/2367675478 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563602988620 con 0x563602c456f0 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f7879400640 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4a040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f786800c6a0 tx=0x7f78680d4690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb2adaeee86f5972 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f785b400640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f785b400640 1 -- 172.21.15.110:0/2367675478 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786809c430 con 0x563602c456f0 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f785b400640 1 -- 172.21.15.110:0/2367675478 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f786809add0 con 0x563602c456f0 2024-04-26T11:36:50.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f78839bb740 1 -- 172.21.15.110:0/2367675478 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f786c015030 con 0x563602c456f0 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f785b400640 1 -- 172.21.15.110:0/2367675478 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7868005680 con 0x563602c456f0 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f78839bb740 10 client.25831 fetch_fsmap learned FSMap version 42 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.821+0000 7f78839bb740 1 -- 172.21.15.110:0/2367675478 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563602b64cb0 con 0x563602c456f0 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.822+0000 7f785b400640 1 -- 172.21.15.110:0/2367675478 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f786c015030 con 0x563602c456f0 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.822+0000 7f785b400640 1 -- 172.21.15.110:0/2367675478 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f7868099140 con 0x563602c456f0 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.822+0000 7f78839bb740 10 client.25831 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.822+0000 7f78839bb740 10 client.25831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.822+0000 7f78839bb740 20 client.25831 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.822+0000 7f78839bb740 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563602cc6550 0x563602cc8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.822+0000 7f78839bb740 4 client.25831 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.822+0000 7f78839bb740 1 -- 172.21.15.110:0/2367675478 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563602bb1e00 con 0x563602cc6550 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.822+0000 7f7879e00640 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563602cc6550 0x563602cc8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.823+0000 7f7879e00640 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563602cc6550 0x563602cc8970 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f444223b7944e9a server_cookie=3358e1fc53564075 in_seq=0 out_seq=0 2024-04-26T11:36:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.823+0000 7f785b400640 10 client.25831 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:50.836 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.834+0000 7f785b400640 1 -- 172.21.15.110:0/2367675478 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563602bb1e00 con 0x563602cc6550 2024-04-26T11:36:50.836 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.834+0000 7f785b400640 10 client.25831 handle_command_reply: tid=0 2024-04-26T11:36:50.836 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 client.25831 shutdown 2024-04-26T11:36:50.836 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 -- 172.21.15.110:0/2367675478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 msgr2=0x563602c4a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:50.836 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4a040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f786800c6a0 tx=0x7f78680d4690 comp rx=0 tx=0).stop 2024-04-26T11:36:50.836 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 -- 172.21.15.110:0/2367675478 shutdown_connections 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563602c4ffb0 0x563602c4a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x563602cc6550 0x563602cc8970 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x563602c456f0 0x563602c4a040 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f785b400640 0 client.25831 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 --2- 172.21.15.110:0/2367675478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563602c44dd0 0x563602c49b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 -- 172.21.15.110:0/2367675478 >> 172.21.15.110:0/2367675478 conn(0x563602c412e0 msgr2=0x563602c3fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 -- 172.21.15.110:0/2367675478 shutdown_connections 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 1 -- 172.21.15.110:0/2367675478 wait complete. 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.835+0000 7f78839bb740 20 client.25831 trim_cache size 0 max 16384 2024-04-26T11:36:50.837 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 -- 172.21.15.110:0/369423062 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78600a3dc0 msgr2=0x7f78600a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78600a3dc0 0x7f78600a6280 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7874006010 tx=0x7f78740099a0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 -- 172.21.15.110:0/369423062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 msgr2=0x7f787c19fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 0x7f787c19fbf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f786800e9f0 tx=0x7f786800eeb0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 -- 172.21.15.110:0/369423062 shutdown_connections 2024-04-26T11:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78600a3dc0 0x7f78600a6280 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f787c1a3f20 0x7f787c1a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f787c10e260 0x7f787c19fbf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 --2- 172.21.15.110:0/369423062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c109190 0x7f787c19f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 -- 172.21.15.110:0/369423062 >> 172.21.15.110:0/369423062 conn(0x7f787c076ec0 msgr2=0x7f787c077a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 -- 172.21.15.110:0/369423062 shutdown_connections 2024-04-26T11:36:50.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:36:50.836+0000 7f7880a00640 1 -- 172.21.15.110:0/369423062 wait complete. 2024-04-26T11:36:51.846 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:51 smithi110 ceph-mon[28069]: pgmap v171: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 5.1 MiB/s wr, 537 op/s 2024-04-26T11:36:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-mon[32572]: pgmap v171: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 5.1 MiB/s wr, 537 op/s 2024-04-26T11:36:52.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f275bb03700 time 2024-04-26T11:36:51.542259+0000 2024-04-26T11:36:52.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:36:52.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f276612c3dd] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f276612c5a3] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5559575f3822] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555957563598] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555957565c17] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55595745ed0b] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55595745f2ac] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555957447fad] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f27663c0e20] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 10: (DispatchQueue::entry()+0x51f) [0x7f27663bdfdf] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2766490fc1] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2764eaa1ca] 2024-04-26T11:36:52.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 13: clone() 2024-04-26T11:36:52.007 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:51.542+0000 7f275bb03700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f275bb03700 time 2024-04-26T11:36:51.542259+0000 2024-04-26T11:36:52.007 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:36:52.007 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:52.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f276612c3dd] 2024-04-26T11:36:52.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f276612c5a3] 2024-04-26T11:36:52.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5559575f3822] 2024-04-26T11:36:52.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555957563598] 2024-04-26T11:36:52.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555957565c17] 2024-04-26T11:36:52.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55595745ed0b] 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55595745f2ac] 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555957447fad] 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f27663c0e20] 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 10: (DispatchQueue::entry()+0x51f) [0x7f27663bdfdf] 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2766490fc1] 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2764eaa1ca] 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 13: clone() 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: *** Caught signal (Aborted) ** 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: in thread 7f275bb03700 thread_name:ms_dispatch 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2764eb4d20] 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2: gsignal() 2024-04-26T11:36:52.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 3: abort() 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f276612c437] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f276612c5a3] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5559575f3822] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555957563598] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555957565c17] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55595745ed0b] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55595745f2ac] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555957447fad] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f27663c0e20] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 13: (DispatchQueue::entry()+0x51f) [0x7f27663bdfdf] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2766490fc1] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2764eaa1ca] 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 16: clone() 2024-04-26T11:36:52.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:51.544+0000 7f275bb03700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: in thread 7f275bb03700 thread_name:ms_dispatch 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2764eb4d20] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2: gsignal() 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 3: abort() 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f276612c437] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f276612c5a3] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5559575f3822] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555957563598] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555957565c17] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55595745ed0b] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55595745f2ac] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555957447fad] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f27663c0e20] 2024-04-26T11:36:52.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 13: (DispatchQueue::entry()+0x51f) [0x7f27663bdfdf] 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2766490fc1] 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2764eaa1ca] 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 16: clone() 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: -1> 2024-04-26T11:36:51.542+0000 7f275bb03700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f275bb03700 time 2024-04-26T11:36:51.542259+0000 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f276612c3dd] 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f276612c5a3] 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5559575f3822] 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555957563598] 2024-04-26T11:36:52.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555957565c17] 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55595745ed0b] 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55595745f2ac] 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555957447fad] 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f27663c0e20] 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 10: (DispatchQueue::entry()+0x51f) [0x7f27663bdfdf] 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2766490fc1] 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2764eaa1ca] 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 13: clone() 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 0> 2024-04-26T11:36:51.544+0000 7f275bb03700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: in thread 7f275bb03700 thread_name:ms_dispatch 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:52.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2764eb4d20] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2: gsignal() 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 3: abort() 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f276612c437] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f276612c5a3] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5559575f3822] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555957563598] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555957565c17] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55595745ed0b] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55595745f2ac] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555957447fad] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f27663c0e20] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 13: (DispatchQueue::entry()+0x51f) [0x7f27663bdfdf] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2766490fc1] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2764eaa1ca] 2024-04-26T11:36:52.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 16: clone() 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: -1> 2024-04-26T11:36:51.542+0000 7f275bb03700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f275bb03700 time 2024-04-26T11:36:51.542259+0000 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f276612c3dd] 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f276612c5a3] 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5559575f3822] 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555957563598] 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555957565c17] 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55595745ed0b] 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55595745f2ac] 2024-04-26T11:36:52.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555957447fad] 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f27663c0e20] 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 10: (DispatchQueue::entry()+0x51f) [0x7f27663bdfdf] 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2766490fc1] 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2764eaa1ca] 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 13: clone() 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 0> 2024-04-26T11:36:51.544+0000 7f275bb03700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: in thread 7f275bb03700 thread_name:ms_dispatch 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2764eb4d20] 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2: gsignal() 2024-04-26T11:36:52.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 3: abort() 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f276612c437] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f276612c5a3] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5559575f3822] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555957563598] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555957565c17] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55595745ed0b] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55595745f2ac] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555957447fad] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f27663c0e20] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 13: (DispatchQueue::entry()+0x51f) [0x7f27663bdfdf] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2766490fc1] 2024-04-26T11:36:52.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2764eaa1ca] 2024-04-26T11:36:52.018 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 16: clone() 2024-04-26T11:36:52.018 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:36:52.018 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[62747]: 2024-04-26T11:36:52.018 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:51 smithi196 podman[67831]: 2024-04-26 11:36:51.600424628 +0000 UTC m=+0.019494137 container died bb0ef47b14bc45134dfe595ffecdd2135e5682ddbf07b0cfaa2a6b15306db1ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2) 2024-04-26T11:36:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:51 smithi193 ceph-mon[32782]: pgmap v171: 97 pgs: 97 active+clean; 2.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 5.1 MiB/s wr, 537 op/s 2024-04-26T11:36:53.017 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T11:36:53.018 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:36:53.454 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:36:53.795 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:53 smithi196 ceph-mon[32572]: pgmap v172: 97 pgs: 97 active+clean; 2.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 25 MiB/s wr, 1.39k op/s 2024-04-26T11:36:53.795 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:53 smithi196 podman[67831]: 2024-04-26 11:36:53.541719086 +0000 UTC m=+1.960788640 container remove bb0ef47b14bc45134dfe595ffecdd2135e5682ddbf07b0cfaa2a6b15306db1ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T11:36:53.795 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:53 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:36:53.925 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:53 smithi110 ceph-mon[28069]: pgmap v172: 97 pgs: 97 active+clean; 2.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 25 MiB/s wr, 1.39k op/s 2024-04-26T11:36:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:53 smithi193 ceph-mon[32782]: pgmap v172: 97 pgs: 97 active+clean; 2.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 25 MiB/s wr, 1.39k op/s 2024-04-26T11:36:54.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:53 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T11:36:54.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:36:53 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.679s CPU time. 2024-04-26T11:36:54.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:36:55.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.784+0000 7f7d96e00700 1 -- 172.21.15.110:0/2945336922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d90109a50 msgr2=0x7f7d90109ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:55.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.784+0000 7f7d96e00700 1 --2- 172.21.15.110:0/2945336922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d90109a50 0x7f7d90109ed0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009990 tx=0x7f7d78009ca0 comp rx=0 tx=0).stop 2024-04-26T11:36:55.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.784+0000 7f7d96e00700 1 -- 172.21.15.110:0/2945336922 shutdown_connections 2024-04-26T11:36:55.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.784+0000 7f7d96e00700 1 --2- 172.21.15.110:0/2945336922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d9010a410 0x7f7d90116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:55.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.785+0000 7f7d96e00700 1 --2- 172.21.15.110:0/2945336922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d9010fa50 0x7f7d9010fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:55.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.785+0000 7f7d96e00700 1 --2- 172.21.15.110:0/2945336922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d90109a50 0x7f7d90109ed0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:55.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.785+0000 7f7d96e00700 1 -- 172.21.15.110:0/2945336922 >> 172.21.15.110:0/2945336922 conn(0x7f7d90076bf0 msgr2=0x7f7d90108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:55.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.785+0000 7f7d96e00700 1 -- 172.21.15.110:0/2945336922 shutdown_connections 2024-04-26T11:36:55.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.785+0000 7f7d96e00700 1 -- 172.21.15.110:0/2945336922 wait complete. 2024-04-26T11:36:55.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.786+0000 7f7d96e00700 1 Processor -- start 2024-04-26T11:36:55.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.786+0000 7f7d96e00700 1 -- start start 2024-04-26T11:36:55.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.786+0000 7f7d96e00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d90109a50 0x7f7d901a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:55.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.786+0000 7f7d96e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d9010a410 0x7f7d901a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.786+0000 7f7d96e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9010fa50 0x7f7d901a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.786+0000 7f7d96e00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90119ce0 con 0x7f7d9010fa50 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.786+0000 7f7d96e00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90119b60 con 0x7f7d9010a410 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.786+0000 7f7d96e00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90119e60 con 0x7f7d90109a50 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d94e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9010fa50 0x7f7d901a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d8fe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d90109a50 0x7f7d901a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d8f400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d9010a410 0x7f7d901a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d94e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9010fa50 0x7f7d901a4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35188/0 (socket says 172.21.15.110:35188) 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d8fe00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d90109a50 0x7f7d901a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:40424/0 (socket says 172.21.15.110:40424) 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d94e00700 1 -- 172.21.15.110:0/1307987001 learned_addr learned my addr 172.21.15.110:0/1307987001 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d8fe00700 1 -- 172.21.15.110:0/1307987001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d9010a410 msgr2=0x7f7d901a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d8fe00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d9010a410 0x7f7d901a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:55.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d8fe00700 1 -- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9010fa50 msgr2=0x7f7d901a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d8fe00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9010fa50 0x7f7d901a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d8fe00700 1 -- 172.21.15.110:0/1307987001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d901a51e0 con 0x7f7d90109a50 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d94e00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9010fa50 0x7f7d901a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.787+0000 7f7d8fe00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d90109a50 0x7f7d901a01d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000e9f0 tx=0x7f7d8000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.788+0000 7f7d8cc00700 1 -- 172.21.15.110:0/1307987001 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000c9c0 con 0x7f7d90109a50 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.788+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d901a54d0 con 0x7f7d90109a50 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.788+0000 7f7d8cc00700 1 -- 172.21.15.110:0/1307987001 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d8000cb60 con 0x7f7d90109a50 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.788+0000 7f7d8cc00700 1 -- 172.21.15.110:0/1307987001 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80018680 con 0x7f7d90109a50 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.788+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d901acd50 con 0x7f7d90109a50 2024-04-26T11:36:55.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.789+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d9006a110 con 0x7f7d90109a50 2024-04-26T11:36:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.791+0000 7f7d8cc00700 1 -- 172.21.15.110:0/1307987001 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7d80010430 con 0x7f7d90109a50 2024-04-26T11:36:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.792+0000 7f7d8cc00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7d740a3db0 0x7f7d740a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.792+0000 7f7d8cc00700 1 -- 172.21.15.110:0/1307987001 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f7d800d09e0 con 0x7f7d90109a50 2024-04-26T11:36:55.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.792+0000 7f7d8f400700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7d740a3db0 0x7f7d740a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:55.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.793+0000 7f7d8f400700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7d740a3db0 0x7f7d740a6270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d9010f1f0 tx=0x7f7d78005fd0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:55.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:55.796+0000 7f7d8cc00700 1 -- 172.21.15.110:0/1307987001 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7d8009cf50 con 0x7f7d90109a50 2024-04-26T11:36:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:55 smithi196 ceph-mon[32572]: pgmap v173: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 1.48k op/s 2024-04-26T11:36:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:55 smithi110 ceph-mon[28069]: pgmap v173: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 1.48k op/s 2024-04-26T11:36:56.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.073+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d901a1530 con 0x7f7d90109a50 2024-04-26T11:36:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.074+0000 7f7d8cc00700 1 -- 172.21.15.110:0/1307987001 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11893 (secure 0 0 0) 0x7f7d8009c850 con 0x7f7d90109a50 2024-04-26T11:36:56.076 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:36:56.076 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:36:38.991903+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":24481,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":37,"state":"up:active","state_seq":155,"addr":"172.21.15.196:6835/1499716677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1499716677},{"type":"v1","addr":"172.21.15.196:6835","nonce":1499716677}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25813":{"gid":25813,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6839/2048299930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":2048299930},{"type":"v1","addr":"172.21.15.196:6839","nonce":2048299930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24481,24487,24518]},"id":1}]} 2024-04-26T11:36:56.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7d740a3db0 msgr2=0x7f7d740a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:56.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7d740a3db0 0x7f7d740a6270 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d9010f1f0 tx=0x7f7d78005fd0 comp rx=0 tx=0).stop 2024-04-26T11:36:56.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d90109a50 msgr2=0x7f7d901a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:56.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d90109a50 0x7f7d901a01d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000e9f0 tx=0x7f7d8000ed00 comp rx=0 tx=0).stop 2024-04-26T11:36:56.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 shutdown_connections 2024-04-26T11:36:56.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f7d740a3db0 0x7f7d740a6270 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:56.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9010fa50 0x7f7d901a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:56.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d90109a50 0x7f7d901a01d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:56.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 --2- 172.21.15.110:0/1307987001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d9010a410 0x7f7d901a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:56.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 >> 172.21.15.110:0/1307987001 conn(0x7f7d90076bf0 msgr2=0x7f7d90077310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:56.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 shutdown_connections 2024-04-26T11:36:56.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:56.078+0000 7f7d96e00700 1 -- 172.21.15.110:0/1307987001 wait complete. 2024-04-26T11:36:56.080 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 42 2024-04-26T11:36:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:55 smithi193 ceph-mon[32782]: pgmap v173: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 1.48k op/s 2024-04-26T11:36:57.003 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:56 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/1307987001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:36:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:56 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/1307987001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:36:57.007 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T11:36:57.007 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T11:36:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:56 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/1307987001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:36:57.446 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:36:57.983 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:57 smithi110 ceph-mon[28069]: pgmap v174: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 1.44k op/s 2024-04-26T11:36:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:57 smithi196 ceph-mon[32572]: pgmap v174: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 1.44k op/s 2024-04-26T11:36:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:57 smithi193 ceph-mon[32782]: pgmap v174: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 1.44k op/s 2024-04-26T11:36:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:36:59 smithi110 ceph-mon[28069]: pgmap v175: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 MiB/s wr, 1.44k op/s 2024-04-26T11:36:59.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.845+0000 7f2deae00700 1 -- 172.21.15.110:0/2069864131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2de406c4b0 msgr2=0x7f2de41102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:59.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.845+0000 7f2deae00700 1 --2- 172.21.15.110:0/2069864131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2de406c4b0 0x7f2de41102a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00b0a0 tx=0x7f2ddc00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.845+0000 7f2deae00700 1 -- 172.21.15.110:0/2069864131 shutdown_connections 2024-04-26T11:36:59.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.845+0000 7f2deae00700 1 --2- 172.21.15.110:0/2069864131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2de406c4b0 0x7f2de41102a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.845+0000 7f2deae00700 1 --2- 172.21.15.110:0/2069864131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2de41094d0 0x7f2de41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.845+0000 7f2deae00700 1 --2- 172.21.15.110:0/2069864131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de406baf0 0x7f2de406bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.845+0000 7f2deae00700 1 -- 172.21.15.110:0/2069864131 >> 172.21.15.110:0/2069864131 conn(0x7f2de40792d0 msgr2=0x7f2de40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:59.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.845+0000 7f2deae00700 1 -- 172.21.15.110:0/2069864131 shutdown_connections 2024-04-26T11:36:59.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.845+0000 7f2deae00700 1 -- 172.21.15.110:0/2069864131 wait complete. 2024-04-26T11:36:59.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.846+0000 7f2deae00700 1 Processor -- start 2024-04-26T11:36:59.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2deae00700 1 -- start start 2024-04-26T11:36:59.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2deae00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2de406baf0 0x7f2de41a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2deae00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2de406c4b0 0x7f2de41a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2deae00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de41094d0 0x7f2de419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2deae00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2de41135b0 con 0x7f2de406baf0 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2deae00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4113430 con 0x7f2de41094d0 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2deae00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4113730 con 0x7f2de406c4b0 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2de3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2de406baf0 0x7f2de41a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2de3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2de406c4b0 0x7f2de41a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2de3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2de406c4b0 0x7f2de41a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:40452/0 (socket says 172.21.15.110:40452) 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2de3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2de406baf0 0x7f2de41a1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35208/0 (socket says 172.21.15.110:35208) 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2de3400700 1 -- 172.21.15.110:0/2775706204 learned_addr learned my addr 172.21.15.110:0/2775706204 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:59.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.847+0000 7f2de8e00700 1 --2- 172.21.15.110:0/2775706204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de41094d0 0x7f2de419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.848+0000 7f2de3400700 1 -- 172.21.15.110:0/2775706204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de41094d0 msgr2=0x7f2de419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:59.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.848+0000 7f2de3400700 1 --2- 172.21.15.110:0/2775706204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2de41094d0 0x7f2de419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.848+0000 7f2de3400700 1 -- 172.21.15.110:0/2775706204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2de406baf0 msgr2=0x7f2de41a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:59.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.848+0000 7f2de3400700 1 --2- 172.21.15.110:0/2775706204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2de406baf0 0x7f2de41a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.848+0000 7f2de3400700 1 -- 172.21.15.110:0/2775706204 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de419c160 con 0x7f2de406c4b0 2024-04-26T11:36:59.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.848+0000 7f2de3400700 1 --2- 172.21.15.110:0/2775706204 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2de406c4b0 0x7f2de41a1d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000e9c0 tx=0x7f2dd000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:59.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.848+0000 7f2de0c00700 1 -- 172.21.15.110:0/2775706204 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000cbd0 con 0x7f2de406c4b0 2024-04-26T11:36:59.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.849+0000 7f2de0c00700 1 -- 172.21.15.110:0/2775706204 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd000ee60 con 0x7f2de406c4b0 2024-04-26T11:36:59.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.849+0000 7f2deae00700 1 -- 172.21.15.110:0/2775706204 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de419c450 con 0x7f2de406c4b0 2024-04-26T11:36:59.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.849+0000 7f2de0c00700 1 -- 172.21.15.110:0/2775706204 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00055c0 con 0x7f2de406c4b0 2024-04-26T11:36:59.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.849+0000 7f2deae00700 1 -- 172.21.15.110:0/2775706204 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de41a8710 con 0x7f2de406c4b0 2024-04-26T11:36:59.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.852+0000 7f2de0c00700 1 -- 172.21.15.110:0/2775706204 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f2dd0004750 con 0x7f2de406c4b0 2024-04-26T11:36:59.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.853+0000 7f2df57eab80 1 Processor -- start 2024-04-26T11:36:59.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2df57eab80 1 -- start start 2024-04-26T11:36:59.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2de0c00700 1 --2- 172.21.15.110:0/2775706204 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f2dc80a3e50 0x7f2dc80a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df15020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df0f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df1b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2df57eab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558e0de61a20 con 0x558e0df14c40 2024-04-26T11:36:59.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2df57eab80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558e0de00340 con 0x558e0df0ef70 2024-04-26T11:36:59.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2df57eab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558e0de5d9e0 con 0x558e0df0f910 2024-04-26T11:36:59.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2de0c00700 1 -- 172.21.15.110:0/2775706204 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f2dd00d0bf0 con 0x7f2de406c4b0 2024-04-26T11:36:59.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2de3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df15020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2de8e00700 1 --2- 172.21.15.110:0/2775706204 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f2dc80a3e50 0x7f2dc80a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2de3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df15020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35214/0 (socket says 172.21.15.110:35214) 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.854+0000 7f2de3e00700 1 -- 172.21.15.110:0/191479255 learned_addr learned my addr 172.21.15.110:0/191479255 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2de3400700 1 --2- 172.21.15.110:0/191479255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df0f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2de8e00700 1 --2- 172.21.15.110:0/191479255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df1b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2de3400700 1 -- 172.21.15.110:0/191479255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 msgr2=0x558e0df1b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2de3400700 1 --2- 172.21.15.110:0/191479255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df1b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2de3400700 1 -- 172.21.15.110:0/191479255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 msgr2=0x558e0df15020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2de3400700 1 --2- 172.21.15.110:0/191479255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df15020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2de3400700 1 -- 172.21.15.110:0/191479255 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0de087c0 con 0x558e0df0ef70 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2de3400700 1 --2- 172.21.15.110:0/191479255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df0f3d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00ce210 tx=0x7f2dd009c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a1702b4d10aca54 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:59.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2de8e00700 1 --2- 172.21.15.110:0/2775706204 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f2dc80a3e50 0x7f2dc80a6310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00b780 tx=0x7f2ddc006000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:59.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.855+0000 7f2dd9600700 1 -- 172.21.15.110:0/191479255 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00bd0d0 con 0x558e0df0ef70 2024-04-26T11:36:59.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.856+0000 7f2dd9600700 1 -- 172.21.15.110:0/191479255 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd009ca60 con 0x558e0df0ef70 2024-04-26T11:36:59.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.856+0000 7f2dd9600700 1 -- 172.21.15.110:0/191479255 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd009cee0 con 0x558e0df0ef70 2024-04-26T11:36:59.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.856+0000 7f2df57eab80 1 -- 172.21.15.110:0/191479255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 msgr2=0x558e0df0f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:59.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.856+0000 7f2df57eab80 1 --2- 172.21.15.110:0/191479255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df0f3d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00ce210 tx=0x7f2dd009c620 comp rx=0 tx=0).stop 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.857+0000 7f2df57eab80 1 -- 172.21.15.110:0/191479255 shutdown_connections 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.857+0000 7f2df57eab80 1 --2- 172.21.15.110:0/191479255 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df1b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.857+0000 7f2df57eab80 1 --2- 172.21.15.110:0/191479255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df15020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.857+0000 7f2df57eab80 1 --2- 172.21.15.110:0/191479255 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df0f3d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.857+0000 7f2df57eab80 1 -- 172.21.15.110:0/191479255 >> 172.21.15.110:0/191479255 conn(0x558e0de3c480 msgr2=0x558e0df09b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.857+0000 7f2df57eab80 1 -- 172.21.15.110:0/191479255 shutdown_connections 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.857+0000 7f2df57eab80 1 -- 172.21.15.110:0/191479255 wait complete. 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.857+0000 7f2df57eab80 1 -- start start 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.857+0000 7f2df57eab80 1 Processor -- start 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df1b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df189f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df18f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2df57eab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558e0df1bed0 con 0x558e0df14c40 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2df57eab80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558e0ddfc590 con 0x558e0df0ef70 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2df57eab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558e0df1c050 con 0x558e0df0f910 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2df57eab80 10 client.0 _ll_register_callbacks cb 0x558e0ddf5510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2de8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df18f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2de3e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df1b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2de3e00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df1b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:38804/0 (socket says 172.21.15.110:38804) 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2de3400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df189f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2de3e00700 1 -- 172.21.15.110:0/3413351003 learned_addr learned my addr 172.21.15.110:0/3413351003 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:59.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.858+0000 7f2de8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df18f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35222/0 (socket says 172.21.15.110:35222) 2024-04-26T11:36:59.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.859+0000 7f2de3e00700 1 -- 172.21.15.110:0/3413351003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 msgr2=0x558e0df189f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:59.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.859+0000 7f2de3e00700 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df189f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.859+0000 7f2de3e00700 1 -- 172.21.15.110:0/3413351003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 msgr2=0x558e0df18f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:59.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.859+0000 7f2de3e00700 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df18f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.859+0000 7f2de3e00700 1 -- 172.21.15.110:0/3413351003 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0ddaea60 con 0x558e0df0ef70 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.859+0000 7f2de3400700 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df189f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.859+0000 7f2de3e00700 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df1b6f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4011760 tx=0x7f2dd4011a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bebda6ce2f39adc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.859+0000 7f2dce000700 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.859+0000 7f2dce000700 1 -- 172.21.15.110:0/3413351003 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd401f060 con 0x558e0df0ef70 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.860+0000 7f2df57eab80 1 -- 172.21.15.110:0/3413351003 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dd009ca60 con 0x558e0df0ef70 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.860+0000 7f2dce000700 1 -- 172.21.15.110:0/3413351003 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f2dd4004320 con 0x558e0df0ef70 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.860+0000 7f2dce000700 1 -- 172.21.15.110:0/3413351003 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2dd4026050 con 0x558e0df0ef70 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.860+0000 7f2df57eab80 10 client.25817 fetch_fsmap learned FSMap version 42 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.860+0000 7f2df57eab80 1 -- 172.21.15.110:0/3413351003 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558e0df26810 con 0x558e0df0ef70 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.860+0000 7f2dce000700 1 -- 172.21.15.110:0/3413351003 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd009ca60 con 0x558e0df0ef70 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.860+0000 7f2dce000700 1 -- 172.21.15.110:0/3413351003 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2dd400f5a0 con 0x558e0df0ef70 2024-04-26T11:36:59.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.861+0000 7f2df57eab80 10 client.25817 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T11:36:59.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.861+0000 7f2df57eab80 10 client.25817 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:36:59.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.861+0000 7f2df57eab80 20 client.25817 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:59.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.861+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558e0df28da0 0x558e0df2b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.861+0000 7f2df57eab80 4 client.25817 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:36:59.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.861+0000 7f2df57eab80 1 -- 172.21.15.110:0/3413351003 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e0de6f400 con 0x558e0df28da0 2024-04-26T11:36:59.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.861+0000 7f2de3400700 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558e0df28da0 0x558e0df2b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.861+0000 7f2de3400700 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558e0df28da0 0x558e0df2b1b0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=224dd09f3c405172 server_cookie=130b9c94727d1f9 in_seq=0 out_seq=0 2024-04-26T11:36:59.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.861+0000 7f2dce000700 10 client.25817 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:59.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.862+0000 7f2dce000700 1 -- 172.21.15.110:0/3413351003 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558e0de6f400 con 0x558e0df28da0 2024-04-26T11:36:59.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.862+0000 7f2dce000700 10 client.25817 handle_command_reply: tid=0 2024-04-26T11:36:59.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.862+0000 7f2df57eab80 1 client.25817 shutdown 2024-04-26T11:36:59.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 -- 172.21.15.110:0/3413351003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 msgr2=0x558e0df1b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:59.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df1b6f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4011760 tx=0x7f2dd4011a70 comp rx=0 tx=0).stop 2024-04-26T11:36:59.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 -- 172.21.15.110:0/3413351003 shutdown_connections 2024-04-26T11:36:59.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558e0df28da0 0x558e0df2b1b0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df14c40 0x558e0df18f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df0ef70 0x558e0df1b6f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3413351003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df189f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 -- 172.21.15.110:0/3413351003 >> 172.21.15.110:0/3413351003 conn(0x558e0de3c480 msgr2=0x558e0df04330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:59.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2dce000700 0 client.25817 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:59.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 -- 172.21.15.110:0/3413351003 shutdown_connections 2024-04-26T11:36:59.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 1 -- 172.21.15.110:0/3413351003 wait complete. 2024-04-26T11:36:59.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.863+0000 7f2df57eab80 20 client.25817 trim_cache size 0 max 16384 2024-04-26T11:36:59.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.884+0000 7f2df57eab80 1 Processor -- start 2024-04-26T11:36:59.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.884+0000 7f2df57eab80 1 -- start start 2024-04-26T11:36:59.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.884+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df0ef70 0x558e0df179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.884+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df18f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.884+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 0x558e0df24d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.884+0000 7f2df57eab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2de41b2aa0 con 0x558e0df0ef70 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2df57eab80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2de41b02d0 con 0x558e0df14c40 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2df57eab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2de41ae120 con 0x558e0df0f910 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df0ef70 0x558e0df179d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df0ef70 0x558e0df179d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35238/0 (socket says 172.21.15.110:35238) 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3e00700 1 -- 172.21.15.110:0/3710047761 learned_addr learned my addr 172.21.15.110:0/3710047761 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3400700 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df18f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de8e00700 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 0x558e0df24d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3e00700 1 -- 172.21.15.110:0/3710047761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 msgr2=0x558e0df18f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3e00700 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df18f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3e00700 1 -- 172.21.15.110:0/3710047761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 msgr2=0x558e0df24d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3e00700 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 0x558e0df24d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3e00700 1 -- 172.21.15.110:0/3710047761 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0df2b4d0 con 0x558e0df0ef70 2024-04-26T11:36:59.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de3400700 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df18f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:36:59.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.885+0000 7f2de8e00700 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 0x558e0df24d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.886+0000 7f2de3e00700 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df0ef70 0x558e0df179d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400f970 tx=0x7f2dd4011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187643d816e77f2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.886+0000 7f2dd8c00700 1 -- 172.21.15.110:0/3710047761 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400fd60 con 0x558e0df0ef70 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.886+0000 7f2dd8c00700 1 -- 172.21.15.110:0/3710047761 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd402f070 con 0x558e0df0ef70 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.886+0000 7f2dd8c00700 1 -- 172.21.15.110:0/3710047761 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40057e0 con 0x558e0df0ef70 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 -- 172.21.15.110:0/3710047761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df0ef70 msgr2=0x558e0df179d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df0ef70 0x558e0df179d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400f970 tx=0x7f2dd4011440 comp rx=0 tx=0).stop 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 -- 172.21.15.110:0/3710047761 shutdown_connections 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 0x558e0df24d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df0ef70 0x558e0df179d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 --2- 172.21.15.110:0/3710047761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df18f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 -- 172.21.15.110:0/3710047761 >> 172.21.15.110:0/3710047761 conn(0x558e0de3c480 msgr2=0x558e0df04330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:36:59.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 -- 172.21.15.110:0/3710047761 shutdown_connections 2024-04-26T11:36:59.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 -- 172.21.15.110:0/3710047761 wait complete. 2024-04-26T11:36:59.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.887+0000 7f2df57eab80 1 -- start start 2024-04-26T11:36:59.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.888+0000 7f2df57eab80 1 Processor -- start 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.888+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df30220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.888+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 0x558e0df30760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.888+0000 7f2df57eab80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df30db0 0x558e0df1f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.888+0000 7f2df57eab80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2de41ae790 con 0x558e0df30db0 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.888+0000 7f2df57eab80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2de41afc00 con 0x558e0df14c40 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.888+0000 7f2df57eab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2de41aee60 con 0x558e0df0f910 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.888+0000 7f2df57eab80 10 client.0 _ll_register_callbacks cb 0x558e0ddf5510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df30db0 0x558e0df1f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de8e00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df30db0 0x558e0df1f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35254/0 (socket says 172.21.15.110:35254) 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de8e00700 1 -- 172.21.15.110:0/2793757459 learned_addr learned my addr 172.21.15.110:0/2793757459 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:36:59.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de3e00700 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df30220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de3400700 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 0x558e0df30760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de8e00700 1 -- 172.21.15.110:0/2793757459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 msgr2=0x558e0df30220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de8e00700 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df30220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de8e00700 1 -- 172.21.15.110:0/2793757459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 msgr2=0x558e0df30760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de8e00700 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 0x558e0df30760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de8e00700 1 -- 172.21.15.110:0/2793757459 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0df1ff80 con 0x558e0df30db0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2de8e00700 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df30db0 0x558e0df1f760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009390 tx=0x7f2ddc00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a10d2e284d89a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.889+0000 7f2dce000700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.890+0000 7f2dce000700 1 -- 172.21.15.110:0/2793757459 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc021670 con 0x558e0df30db0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.890+0000 7f2dce000700 1 -- 172.21.15.110:0/2793757459 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f2ddc021810 con 0x558e0df30db0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.890+0000 7f2df57eab80 1 -- 172.21.15.110:0/2793757459 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dd402f070 con 0x558e0df30db0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.890+0000 7f2dce000700 1 -- 172.21.15.110:0/2793757459 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2ddc021a10 con 0x558e0df30db0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.890+0000 7f2df57eab80 10 client.15657 fetch_fsmap learned FSMap version 42 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.890+0000 7f2df57eab80 1 -- 172.21.15.110:0/2793757459 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558e0df8fd30 con 0x558e0df30db0 2024-04-26T11:36:59.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.890+0000 7f2dce000700 1 -- 172.21.15.110:0/2793757459 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dd402f070 con 0x558e0df30db0 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.891+0000 7f2dce000700 1 -- 172.21.15.110:0/2793757459 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2ddc011070 con 0x558e0df30db0 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.891+0000 7f2df57eab80 10 client.15657 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.891+0000 7f2df57eab80 10 client.15657 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.891+0000 7f2df57eab80 20 client.15657 populate_metadata read hostname 'smithi110' 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.891+0000 7f2df57eab80 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558e0df90500 0x558e0df92920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.891+0000 7f2df57eab80 4 client.15657 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.891+0000 7f2df57eab80 1 -- 172.21.15.110:0/2793757459 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x558e0de694a0 con 0x558e0df90500 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.891+0000 7f2de3e00700 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558e0df90500 0x558e0df92920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.892+0000 7f2de3e00700 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558e0df90500 0x558e0df92920 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c998c555732b034 server_cookie=5f119e66ff27e6e3 in_seq=0 out_seq=0 2024-04-26T11:36:59.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:36:59.892+0000 7f2dce000700 10 client.15657 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:36:59.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 285.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:37:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:36:59 smithi196 ceph-mon[32572]: pgmap v175: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 MiB/s wr, 1.44k op/s 2024-04-26T11:37:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:36:59 smithi193 ceph-mon[32782]: pgmap v175: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 MiB/s wr, 1.44k op/s 2024-04-26T11:37:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:01 smithi196 ceph-mon[32572]: pgmap v176: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 1.15k op/s 2024-04-26T11:37:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:01 smithi110 ceph-mon[28069]: pgmap v176: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 1.15k op/s 2024-04-26T11:37:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:01 smithi193 ceph-mon[32782]: pgmap v176: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 MiB/s wr, 1.15k op/s 2024-04-26T11:37:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.976+0000 7f1d7b200640 1 -- 172.21.15.110:0/1288186100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d7c104970 msgr2=0x7f1d7c104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.976+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1288186100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d7c104970 0x7f1d7c104df0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009900 tx=0x7f1d6402a410 comp rx=0 tx=0).stop 2024-04-26T11:37:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.976+0000 7f1d7b200640 1 -- 172.21.15.110:0/1288186100 shutdown_connections 2024-04-26T11:37:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.976+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1288186100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7c105330 0x7f1d7c111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.976+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1288186100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d7c104970 0x7f1d7c104df0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.976+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1288186100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d7c10a980 0x7f1d7c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.976+0000 7f1d7b200640 1 -- 172.21.15.110:0/1288186100 >> 172.21.15.110:0/1288186100 conn(0x7f1d7c100440 msgr2=0x7f1d7c102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.976+0000 7f1d7b200640 1 -- 172.21.15.110:0/1288186100 shutdown_connections 2024-04-26T11:37:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.976+0000 7f1d7b200640 1 -- 172.21.15.110:0/1288186100 wait complete. 2024-04-26T11:37:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.977+0000 7f1d7b200640 1 Processor -- start 2024-04-26T11:37:03.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.977+0000 7f1d7b200640 1 -- start start 2024-04-26T11:37:03.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d7b200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d7c104970 0x7f1d7c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d7b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d7c105330 0x7f1d7c19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d7b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7c10a980 0x7f1d7c19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d7b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c114c10 con 0x7f1d7c10a980 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d7b200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c114a90 con 0x7f1d7c104970 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d7b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c114d90 con 0x7f1d7c105330 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d7a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7c10a980 0x7f1d7c19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d7a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7c10a980 0x7f1d7c19f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45912/0 (socket says 172.21.15.110:45912) 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d7a800640 1 -- 172.21.15.110:0/1248998116 learned_addr learned my addr 172.21.15.110:0/1248998116 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.978+0000 7f1d79e00640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d7c104970 0x7f1d7c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d73e00640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d7c105330 0x7f1d7c19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d7a800640 1 -- 172.21.15.110:0/1248998116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d7c105330 msgr2=0x7f1d7c19b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:03.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d7a800640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d7c105330 0x7f1d7c19b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d7a800640 1 -- 172.21.15.110:0/1248998116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d7c104970 msgr2=0x7f1d7c19b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d7a800640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d7c104970 0x7f1d7c19b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d7a800640 1 -- 172.21.15.110:0/1248998116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7c1a00c0 con 0x7f1d7c10a980 2024-04-26T11:37:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d73e00640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d7c105330 0x7f1d7c19b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:37:03.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d7a800640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7c10a980 0x7f1d7c19f990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400eb10 tx=0x7f1d7400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d72a00640 1 -- 172.21.15.110:0/1248998116 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400ce20 con 0x7f1d7c10a980 2024-04-26T11:37:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d7b200640 1 -- 172.21.15.110:0/1248998116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7c1a03b0 con 0x7f1d7c10a980 2024-04-26T11:37:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d72a00640 1 -- 172.21.15.110:0/1248998116 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d74005020 con 0x7f1d7c10a980 2024-04-26T11:37:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.979+0000 7f1d72a00640 1 -- 172.21.15.110:0/1248998116 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74010690 con 0x7f1d7c10a980 2024-04-26T11:37:03.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.980+0000 7f1d7b200640 1 -- 172.21.15.110:0/1248998116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7c1a7c40 con 0x7f1d7c10a980 2024-04-26T11:37:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.983+0000 7f1d83e0c740 1 Processor -- start 2024-04-26T11:37:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.983+0000 7f1d72a00640 1 -- 172.21.15.110:0/1248998116 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f1d74005510 con 0x7f1d7c10a980 2024-04-26T11:37:03.985 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.983+0000 7f1d83e0c740 1 -- start start 2024-04-26T11:37:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe3e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe48c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe4b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5624afda3380 con 0x5624afe3e900 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5624afd3fc30 con 0x5624afe3dfe0 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5624afd9f340 con 0x5624afe491c0 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d79e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe48c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d79e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe48c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45924/0 (socket says 172.21.15.110:45924) 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d79e00640 1 -- 172.21.15.110:0/3828034868 learned_addr learned my addr 172.21.15.110:0/3828034868 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d73e00640 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe3e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d73e00640 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe4b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d79e00640 1 -- 172.21.15.110:0/3828034868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 msgr2=0x5624afe4b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d79e00640 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe4b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d79e00640 1 -- 172.21.15.110:0/3828034868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 msgr2=0x5624afe3e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d79e00640 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe3e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d79e00640 1 -- 172.21.15.110:0/3828034868 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624afd61940 con 0x5624afe3e900 2024-04-26T11:37:03.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.984+0000 7f1d73e00640 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe4b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:37:03.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.985+0000 7f1d79e00640 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe48c80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00ac90 tx=0x7f1d6c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0e3a2a2fe3ade3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:03.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.985+0000 7f1d6b400640 1 -- 172.21.15.110:0/3828034868 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c01d070 con 0x5624afe3e900 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.985+0000 7f1d6b400640 1 -- 172.21.15.110:0/3828034868 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d6c018af0 con 0x5624afe3e900 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.985+0000 7f1d72a00640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1d600a3d10 0x7f1d600a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.985+0000 7f1d6b400640 1 -- 172.21.15.110:0/3828034868 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c010ac0 con 0x5624afe3e900 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.985+0000 7f1d72a00640 1 -- 172.21.15.110:0/1248998116 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f1d740d0f50 con 0x7f1d7c10a980 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.985+0000 7f1d73e00640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1d600a3d10 0x7f1d600a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d83e0c740 1 -- 172.21.15.110:0/3828034868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 msgr2=0x5624afe48c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe48c80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00ac90 tx=0x7f1d6c00f790 comp rx=0 tx=0).stop 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d83e0c740 1 -- 172.21.15.110:0/3828034868 shutdown_connections 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe4b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe48c80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/3828034868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe3e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d83e0c740 1 -- 172.21.15.110:0/3828034868 >> 172.21.15.110:0/3828034868 conn(0x5624afe3a4f0 msgr2=0x5624afe3a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d73e00640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1d600a3d10 0x7f1d600a61d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c102ae0 tx=0x7f1d6402a410 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:03.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d83e0c740 1 -- 172.21.15.110:0/3828034868 shutdown_connections 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.986+0000 7f1d83e0c740 1 -- 172.21.15.110:0/3828034868 wait complete. 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.987+0000 7f1d83e0c740 1 -- start start 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.987+0000 7f1d83e0c740 1 Processor -- start 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.987+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.987+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe465e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.987+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe46b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.987+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5624afe4bdf0 con 0x5624afe3e900 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.987+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5624afd2ac60 con 0x5624afe491c0 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.987+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5624afe4bf70 con 0x5624afe3dfe0 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.987+0000 7f1d83e0c740 10 client.0 _ll_register_callbacks cb 0x5624afd56e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d73e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d79e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d79e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:55418/0 (socket says 172.21.15.110:55418) 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d79e00640 1 -- 172.21.15.110:0/1640932884 learned_addr learned my addr 172.21.15.110:0/1640932884 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:03.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d7a800640 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe46b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d79e00640 1 -- 172.21.15.110:0/1640932884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 msgr2=0x5624afe46b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d79e00640 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe46b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d79e00640 1 -- 172.21.15.110:0/1640932884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 msgr2=0x5624afe465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d79e00640 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d79e00640 1 -- 172.21.15.110:0/1640932884 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624afd39510 con 0x5624afe3dfe0 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d7a800640 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe46b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d79e00640 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe460a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c010660 tx=0x7f1d6c0186d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6601697635618efc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.988+0000 7f1d5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.989+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1640932884 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c01d040 con 0x5624afe3dfe0 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.989+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1640932884 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d6c018af0 con 0x5624afe3dfe0 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.989+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1640932884 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f1d6c010860 con 0x5624afe3dfe0 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.989+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1640932884 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1d6c031050 con 0x5624afe3dfe0 2024-04-26T11:37:03.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.989+0000 7f1d83e0c740 10 client.25861 fetch_fsmap learned FSMap version 42 2024-04-26T11:37:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.989+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1640932884 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5624afab5210 con 0x5624afe3dfe0 2024-04-26T11:37:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.989+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1640932884 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d6c018af0 con 0x5624afe3dfe0 2024-04-26T11:37:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.989+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1640932884 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f1d6c020030 con 0x5624afe3dfe0 2024-04-26T11:37:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.990+0000 7f1d83e0c740 10 client.25861 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T11:37:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.990+0000 7f1d83e0c740 10 client.25861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:37:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.990+0000 7f1d83e0c740 20 client.25861 populate_metadata read hostname 'smithi110' 2024-04-26T11:37:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.990+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5624afe58d10 0x5624afe5b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.990+0000 7f1d83e0c740 4 client.25861 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:37:03.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.990+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1640932884 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624afdb0f90 con 0x5624afe58d10 2024-04-26T11:37:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.990+0000 7f1d73e00640 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5624afe58d10 0x5624afe5b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.991+0000 7f1d73e00640 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5624afe58d10 0x5624afe5b100 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=177a08b23bbcc56 server_cookie=ebc59ea947541bd4 in_seq=0 out_seq=0 2024-04-26T11:37:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.991+0000 7f1d5fe00640 10 client.25861 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.991+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1640932884 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5624afdb0f90 con 0x5624afe58d10 2024-04-26T11:37:03.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.991+0000 7f1d5fe00640 10 client.25861 handle_command_reply: tid=0 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.991+0000 7f1d83e0c740 1 client.25861 shutdown 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1640932884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 msgr2=0x5624afe460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe460a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c010660 tx=0x7f1d6c0186d0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1640932884 shutdown_connections 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe46b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5624afe58d10 0x5624afe5b100 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1640932884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe460a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1640932884 >> 172.21.15.110:0/1640932884 conn(0x5624afe3a4f0 msgr2=0x5624afe40270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d5fe00640 0 client.25861 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1640932884 shutdown_connections 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1640932884 wait complete. 2024-04-26T11:37:03.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:03.992+0000 7f1d83e0c740 20 client.25861 trim_cache size 0 max 16384 2024-04-26T11:37:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:03 smithi196 ceph-mon[32572]: pgmap v177: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 1.15k op/s 2024-04-26T11:37:04.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.008+0000 7f1d83e0c740 1 Processor -- start 2024-04-26T11:37:04.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.008+0000 7f1d83e0c740 1 -- start start 2024-04-26T11:37:04.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe54cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:04.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe45980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:04.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:04.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c1b3180 con 0x5624afe3e900 2024-04-26T11:37:04.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c1b09f0 con 0x5624afe491c0 2024-04-26T11:37:04.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c1ae840 con 0x5624afe3dfe0 2024-04-26T11:37:04.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d73e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe45980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:04.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d73e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe45980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45950/0 (socket says 172.21.15.110:45950) 2024-04-26T11:37:04.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d73e00640 1 -- 172.21.15.110:0/850306838 learned_addr learned my addr 172.21.15.110:0/850306838 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:04.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d7a800640 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:04.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d79e00640 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe54cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:04.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d73e00640 1 -- 172.21.15.110:0/850306838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 msgr2=0x5624afe54cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:04.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d73e00640 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe54cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:04.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d73e00640 1 -- 172.21.15.110:0/850306838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 msgr2=0x5624afe606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:04.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d73e00640 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:04.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d73e00640 1 -- 172.21.15.110:0/850306838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624afe3e730 con 0x5624afe3e900 2024-04-26T11:37:04.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d7a800640 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:37:04.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.009+0000 7f1d79e00640 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe54cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:37:04.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.010+0000 7f1d73e00640 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe45980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1d6402a930 tx=0x7f1d64042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c37737d8822835 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:04.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.010+0000 7f1d6aa00640 1 -- 172.21.15.110:0/850306838 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64058070 con 0x5624afe3e900 2024-04-26T11:37:04.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.010+0000 7f1d6aa00640 1 -- 172.21.15.110:0/850306838 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d64031ca0 con 0x5624afe3e900 2024-04-26T11:37:04.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.010+0000 7f1d6aa00640 1 -- 172.21.15.110:0/850306838 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64035040 con 0x5624afe3e900 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.010+0000 7f1d83e0c740 1 -- 172.21.15.110:0/850306838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 msgr2=0x5624afe45980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.010+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe45980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1d6402a930 tx=0x7f1d64042000 comp rx=0 tx=0).stop 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.011+0000 7f1d83e0c740 1 -- 172.21.15.110:0/850306838 shutdown_connections 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.011+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe491c0 0x5624afe606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.011+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe45980 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.011+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/850306838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe3dfe0 0x5624afe54cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.011+0000 7f1d83e0c740 1 -- 172.21.15.110:0/850306838 >> 172.21.15.110:0/850306838 conn(0x5624afe3a4f0 msgr2=0x5624afe48050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.011+0000 7f1d83e0c740 1 -- 172.21.15.110:0/850306838 shutdown_connections 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.011+0000 7f1d83e0c740 1 -- 172.21.15.110:0/850306838 wait complete. 2024-04-26T11:37:04.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.011+0000 7f1d83e0c740 1 -- start start 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.011+0000 7f1d83e0c740 1 Processor -- start 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe51700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d83e0c740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe42350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c1aeeb0 con 0x5624afe3e900 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c1b0320 con 0x5624afe3dfe0 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d83e0c740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c1af580 con 0x5624afe491c0 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d83e0c740 10 client.0 _ll_register_callbacks cb 0x7f1d6c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d79e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d73e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe51700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d7a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe42350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d79e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:53964/0 (socket says 172.21.15.110:53964) 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d79e00640 1 -- 172.21.15.110:0/1102954727 learned_addr learned my addr 172.21.15.110:0/1102954727 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.012+0000 7f1d79e00640 1 -- 172.21.15.110:0/1102954727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 msgr2=0x5624afe42350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d79e00640 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe42350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d79e00640 1 -- 172.21.15.110:0/1102954727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 msgr2=0x5624afe51700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d79e00640 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe51700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d79e00640 1 -- 172.21.15.110:0/1102954727 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624afb81620 con 0x5624afe3dfe0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d7a800640 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe42350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d79e00640 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe511c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c000c00 tx=0x7f1d6c005d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b25db68b83884da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1102954727 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c01d040 con 0x5624afe3dfe0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1102954727 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d64031ca0 con 0x5624afe3dfe0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1102954727 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8729+0+0 (secure 0 0 0) 0x7f1d6c004660 con 0x5624afe3dfe0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1102954727 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1d6c018740 con 0x5624afe3dfe0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d83e0c740 10 client.25838 fetch_fsmap learned FSMap version 42 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.013+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1102954727 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5624afd5dcb0 con 0x5624afe3dfe0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.014+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1102954727 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d64031ca0 con 0x5624afe3dfe0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.014+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1102954727 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f1d6c020070 con 0x5624afe3dfe0 2024-04-26T11:37:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.014+0000 7f1d83e0c740 10 client.25838 fetch_fsmap finished waiting for FSMap version 42 2024-04-26T11:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.014+0000 7f1d83e0c740 10 client.25838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.014+0000 7f1d83e0c740 20 client.25838 populate_metadata read hostname 'smithi110' 2024-04-26T11:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.014+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5624afebeb50 0x5624afec0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.014+0000 7f1d83e0c740 4 client.25838 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.014+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1102954727 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5624afdaae00 con 0x5624afebeb50 2024-04-26T11:37:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.014+0000 7f1d73e00640 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5624afebeb50 0x5624afec0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:04.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.015+0000 7f1d73e00640 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5624afebeb50 0x5624afec0f70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1ae1ba7947e0c13 server_cookie=f204c9d168ac5572 in_seq=0 out_seq=0 2024-04-26T11:37:04.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:04.015+0000 7f1d5fe00640 10 client.25838 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:03 smithi110 ceph-mon[28069]: pgmap v177: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 1.15k op/s 2024-04-26T11:37:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:03 smithi193 ceph-mon[32782]: pgmap v177: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 1.15k op/s 2024-04-26T11:37:04.258 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:37:04.258 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 systemd[1]: Stopped Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:37:04.259 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.679s CPU time. 2024-04-26T11:37:04.259 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 systemd[1]: Starting Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:37:04.259 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 podman[67929]: 2024-04-26 11:37:04.144274133 +0000 UTC m=+0.018502082 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:37:04.553 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 podman[67929]: 2024-04-26 11:37:04.258675708 +0000 UTC m=+0.132903652 container create a48358d66d2d7fd65e0113abd24e89eaabac230ab42c194ea6a95a10af0f56b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T11:37:04.909 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-mon[32572]: daemon mds.f restarted 2024-04-26T11:37:04.910 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:37:04.910 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-mon[32572]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T11:37:04.910 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:boot 2024-04-26T11:37:04.910 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-mon[32572]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:37:04.910 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:37:04.910 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:37:04.910 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:04.910 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 podman[67929]: 2024-04-26 11:37:04.553361498 +0000 UTC m=+0.427589441 container init a48358d66d2d7fd65e0113abd24e89eaabac230ab42c194ea6a95a10af0f56b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-26T11:37:04.910 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 podman[67929]: 2024-04-26 11:37:04.556007467 +0000 UTC m=+0.430235419 container start a48358d66d2d7fd65e0113abd24e89eaabac230ab42c194ea6a95a10af0f56b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T11:37:04.911 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-mds[67948]: -- 172.21.15.196:0/1833441687 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e159903a40 con 0x55e1598d6800 2024-04-26T11:37:04.911 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: starting mds.f at 2024-04-26T11:37:04.911 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 bash[67929]: a48358d66d2d7fd65e0113abd24e89eaabac230ab42c194ea6a95a10af0f56b2 2024-04-26T11:37:04.911 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:04 smithi196 systemd[1]: Started Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:37:04.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 290.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:37:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:04 smithi110 ceph-mon[28069]: daemon mds.f restarted 2024-04-26T11:37:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:04 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:37:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:04 smithi110 ceph-mon[28069]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T11:37:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:04 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:boot 2024-04-26T11:37:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:04 smithi110 ceph-mon[28069]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:37:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:04 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:37:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:37:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:04 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:04 smithi193 ceph-mon[32782]: daemon mds.f restarted 2024-04-26T11:37:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:04 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:37:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:04 smithi193 ceph-mon[32782]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T11:37:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:04 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:boot 2024-04-26T11:37:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:04 smithi193 ceph-mon[32782]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:37:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:04 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:37:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:37:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:04 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:05.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2dce000700 1 -- 172.21.15.110:0/2793757459 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: -125 ) ==== 8+0+590 (crc 0 0 0) 0x558e0de694a0 con 0x558e0df90500 2024-04-26T11:37:05.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2dce000700 10 client.15657 handle_command_reply: tid=0 2024-04-26T11:37:05.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2df57eab80 1 client.15657 shutdown 2024-04-26T11:37:05.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2df57eab80 1 -- 172.21.15.110:0/2793757459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df30db0 msgr2=0x558e0df1f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:05.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2df57eab80 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df30db0 0x558e0df1f760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009390 tx=0x7f2ddc00b3b0 comp rx=0 tx=0).stop 2024-04-26T11:37:05.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2df57eab80 1 -- 172.21.15.110:0/2793757459 shutdown_connections 2024-04-26T11:37:05.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2df57eab80 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558e0df90500 0x558e0df92920 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:05.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2df57eab80 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558e0df30db0 0x558e0df1f760 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:05.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2df57eab80 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558e0df0f910 0x558e0df30220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:05.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2df57eab80 1 --2- 172.21.15.110:0/2793757459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e0df14c40 0x558e0df30760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:05.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2df57eab80 1 -- 172.21.15.110:0/2793757459 >> 172.21.15.110:0/2793757459 conn(0x558e0de3c480 msgr2=0x558e0df12510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:05.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.590+0000 7f2dce000700 0 client.15657 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:05.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.591+0000 7f2df57eab80 1 -- 172.21.15.110:0/2793757459 shutdown_connections 2024-04-26T11:37:05.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.591+0000 7f2df57eab80 1 -- 172.21.15.110:0/2793757459 wait complete. 2024-04-26T11:37:05.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:37:05.591+0000 7f2df57eab80 20 client.15657 trim_cache size 0 max 16384 2024-04-26T11:37:05.594 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:37:05.594 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 44, 2024-04-26T11:37:05.594 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:37:05.594 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 18, 2024-04-26T11:37:05.594 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "f988b590": { 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 18, 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "CANCELED", 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 90.0, 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": true, 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:37:05.595 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "QUIESCING", 2024-04-26T11:37:05.596 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.7 2024-04-26T11:37:05.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:37:05.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:37:05.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:37:05.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:37:05.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:37:05.596 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:37:05.596 INFO:teuthology.orchestra.run.smithi110.stderr:Error ECANCELED: 2024-04-26T11:37:05.970 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:05 smithi110 ceph-mon[28069]: pgmap v178: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.2 MiB/s wr, 301 op/s 2024-04-26T11:37:05.970 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:05 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:resolve 2024-04-26T11:37:05.970 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:05 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:05 smithi196 ceph-mon[32572]: pgmap v178: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.2 MiB/s wr, 301 op/s 2024-04-26T11:37:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:05 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:resolve 2024-04-26T11:37:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:05 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:05 smithi193 ceph-mon[32782]: pgmap v178: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.2 MiB/s wr, 301 op/s 2024-04-26T11:37:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:05 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:resolve 2024-04-26T11:37:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:05 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:06.490 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-26T11:37:06.491 WARNING:tasks.quiescer.fs.[cephfs]:Quiesce set got cancelled (cap = 10).Won't raise an error since this could be a failover, will wait for the next quiesce attempt 2024-04-26T11:37:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.625+0000 7f1d5fe00640 1 -- 172.21.15.110:0/1102954727 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5624afdaae00 con 0x5624afebeb50 2024-04-26T11:37:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.625+0000 7f1d5fe00640 10 client.25838 handle_command_reply: tid=0 2024-04-26T11:37:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.625+0000 7f1d83e0c740 1 client.25838 shutdown 2024-04-26T11:37:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.625+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1102954727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 msgr2=0x5624afe511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.625+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe511c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c000c00 tx=0x7f1d6c005d80 comp rx=0 tx=0).stop 2024-04-26T11:37:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.626+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1102954727 shutdown_connections 2024-04-26T11:37:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.626+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5624afebeb50 0x5624afec0f70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.626+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5624afe491c0 0x5624afe42350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.626+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5624afe3e900 0x5624afe51700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.626+0000 7f1d5fe00640 0 client.25838 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.626+0000 7f1d83e0c740 1 --2- 172.21.15.110:0/1102954727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5624afe3dfe0 0x5624afe511c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.626+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1102954727 >> 172.21.15.110:0/1102954727 conn(0x5624afe3a4f0 msgr2=0x5624afe3f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:07.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.626+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1102954727 shutdown_connections 2024-04-26T11:37:07.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.626+0000 7f1d83e0c740 1 -- 172.21.15.110:0/1102954727 wait complete. 2024-04-26T11:37:07.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.627+0000 7f1d83e0c740 20 client.25838 trim_cache size 0 max 16384 2024-04-26T11:37:07.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:37:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:37:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:37:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 -- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1d600a3d10 msgr2=0x7f1d600a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1d600a3d10 0x7f1d600a61d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c102ae0 tx=0x7f1d6402a410 comp rx=0 tx=0).stop 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 -- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7c10a980 msgr2=0x7f1d7c19f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7c10a980 0x7f1d7c19f990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400eb10 tx=0x7f1d7400ef10 comp rx=0 tx=0).stop 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 -- 172.21.15.110:0/1248998116 shutdown_connections 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1d600a3d10 0x7f1d600a61d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7c10a980 0x7f1d7c19f990 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d7c105330 0x7f1d7c19b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 --2- 172.21.15.110:0/1248998116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d7c104970 0x7f1d7c19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.628+0000 7f1d7b200640 1 -- 172.21.15.110:0/1248998116 >> 172.21.15.110:0/1248998116 conn(0x7f1d7c100440 msgr2=0x7f1d7c100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.629+0000 7f1d7b200640 1 -- 172.21.15.110:0/1248998116 shutdown_connections 2024-04-26T11:37:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:07.629+0000 7f1d7b200640 1 -- 172.21.15.110:0/1248998116 wait complete. 2024-04-26T11:37:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:07 smithi193 ceph-mon[32782]: pgmap v180: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-04-26T11:37:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:07 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:37:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:07 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:reconnect 2024-04-26T11:37:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:07 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:07 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0119997 2024-04-26T11:37:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:07 smithi196 ceph-mon[32572]: pgmap v180: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-04-26T11:37:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:07 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:37:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:07 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:reconnect 2024-04-26T11:37:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:07 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:07 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0119997 2024-04-26T11:37:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:07 smithi110 ceph-mon[28069]: pgmap v180: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-04-26T11:37:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:07 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:37:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:07 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:reconnect 2024-04-26T11:37:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:07 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:07 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0119997 2024-04-26T11:37:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:08 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:rejoin 2024-04-26T11:37:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:08 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:09.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:08 smithi196 ceph-mon[32572]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:37:09.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:08 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:37:09.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:08 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:37:09.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:08 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:active 2024-04-26T11:37:09.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:08 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:08 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:rejoin 2024-04-26T11:37:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:08 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:08 smithi110 ceph-mon[28069]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:37:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:08 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:37:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:08 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:37:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:08 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:active 2024-04-26T11:37:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:08 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:08 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:rejoin 2024-04-26T11:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:08 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:08 smithi193 ceph-mon[32782]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:08 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:08 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:08 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/2048299930,v1:172.21.15.196:6839/2048299930] up:active 2024-04-26T11:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:08 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:09.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 295.0 s, 344.1 tps, lat 1206.386 ms stddev 4633.042 2024-04-26T11:37:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:09 smithi196 ceph-mon[32572]: pgmap v181: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-04-26T11:37:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:09 smithi110 ceph-mon[28069]: pgmap v181: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-04-26T11:37:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:09 smithi193 ceph-mon[32782]: pgmap v181: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-04-26T11:37:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:10 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:10 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:10 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:11 smithi196 ceph-mon[32572]: pgmap v182: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-04-26T11:37:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:11 smithi110 ceph-mon[28069]: pgmap v182: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-04-26T11:37:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:11 smithi193 ceph-mon[32782]: pgmap v182: 97 pgs: 97 active+clean; 2.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-04-26T11:37:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-mon[32572]: pgmap v183: 97 pgs: 97 active+clean; 2.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 8.7 MiB/s wr, 305 op/s 2024-04-26T11:37:14.005 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1ea5924700 time 2024-04-26T11:37:13.605228+0000 2024-04-26T11:37:14.005 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:37:14.005 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1eaff4d3dd] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1eaff4d5a3] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562783a52822] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627839c2598] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627839c4c17] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627838bdd0b] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627838be2ac] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627838a6fad] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1eb01e1e20] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 10: (DispatchQueue::entry()+0x51f) [0x7f1eb01defdf] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1eb02b1fc1] 2024-04-26T11:37:14.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1eaeccb1ca] 2024-04-26T11:37:14.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 13: clone() 2024-04-26T11:37:14.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: *** Caught signal (Aborted) ** 2024-04-26T11:37:14.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: in thread 7f1ea5924700 thread_name:ms_dispatch 2024-04-26T11:37:14.007 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:13.605+0000 7f1ea5924700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1ea5924700 time 2024-04-26T11:37:13.605228+0000 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1eaff4d3dd] 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1eaff4d5a3] 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562783a52822] 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627839c2598] 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627839c4c17] 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627838bdd0b] 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627838be2ac] 2024-04-26T11:37:14.008 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627838a6fad] 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1eb01e1e20] 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 10: (DispatchQueue::entry()+0x51f) [0x7f1eb01defdf] 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1eb02b1fc1] 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1eaeccb1ca] 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 13: clone() 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1eaecd5d20] 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2: gsignal() 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 3: abort() 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1eaff4d437] 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1eaff4d5a3] 2024-04-26T11:37:14.009 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562783a52822] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627839c2598] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627839c4c17] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627838bdd0b] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627838be2ac] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627838a6fad] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1eb01e1e20] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 13: (DispatchQueue::entry()+0x51f) [0x7f1eb01defdf] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1eb02b1fc1] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1eaeccb1ca] 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 16: clone() 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:13.607+0000 7f1ea5924700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: in thread 7f1ea5924700 thread_name:ms_dispatch 2024-04-26T11:37:14.010 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:14.011 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1eaecd5d20] 2024-04-26T11:37:14.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2: gsignal() 2024-04-26T11:37:14.012 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 3: abort() 2024-04-26T11:37:14.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1eaff4d437] 2024-04-26T11:37:14.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1eaff4d5a3] 2024-04-26T11:37:14.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562783a52822] 2024-04-26T11:37:14.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627839c2598] 2024-04-26T11:37:14.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627839c4c17] 2024-04-26T11:37:14.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627838bdd0b] 2024-04-26T11:37:14.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627838be2ac] 2024-04-26T11:37:14.013 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627838a6fad] 2024-04-26T11:37:14.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1eb01e1e20] 2024-04-26T11:37:14.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 13: (DispatchQueue::entry()+0x51f) [0x7f1eb01defdf] 2024-04-26T11:37:14.014 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1eb02b1fc1] 2024-04-26T11:37:14.052 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1eaeccb1ca] 2024-04-26T11:37:14.052 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 16: clone() 2024-04-26T11:37:14.052 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:37:14.052 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.052 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: -1> 2024-04-26T11:37:13.605+0000 7f1ea5924700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1ea5924700 time 2024-04-26T11:37:13.605228+0000 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1eaff4d3dd] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1eaff4d5a3] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562783a52822] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627839c2598] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627839c4c17] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627838bdd0b] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627838be2ac] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627838a6fad] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1eb01e1e20] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 10: (DispatchQueue::entry()+0x51f) [0x7f1eb01defdf] 2024-04-26T11:37:14.053 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1eb02b1fc1] 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1eaeccb1ca] 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 13: clone() 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 0> 2024-04-26T11:37:13.607+0000 7f1ea5924700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: in thread 7f1ea5924700 thread_name:ms_dispatch 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1eaecd5d20] 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2: gsignal() 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 3: abort() 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1eaff4d437] 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1eaff4d5a3] 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562783a52822] 2024-04-26T11:37:14.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627839c2598] 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627839c4c17] 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627838bdd0b] 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627838be2ac] 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627838a6fad] 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1eb01e1e20] 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 13: (DispatchQueue::entry()+0x51f) [0x7f1eb01defdf] 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1eb02b1fc1] 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1eaeccb1ca] 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 16: clone() 2024-04-26T11:37:14.055 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:37:14.056 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.056 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: -1> 2024-04-26T11:37:13.605+0000 7f1ea5924700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1ea5924700 time 2024-04-26T11:37:13.605228+0000 2024-04-26T11:37:14.056 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:37:14.056 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.056 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:14.056 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1eaff4d3dd] 2024-04-26T11:37:14.056 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1eaff4d5a3] 2024-04-26T11:37:14.056 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562783a52822] 2024-04-26T11:37:14.057 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:13 smithi110 ceph-mon[28069]: pgmap v183: 97 pgs: 97 active+clean; 2.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 8.7 MiB/s wr, 305 op/s 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627839c2598] 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627839c4c17] 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627838bdd0b] 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627838be2ac] 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627838a6fad] 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1eb01e1e20] 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 10: (DispatchQueue::entry()+0x51f) [0x7f1eb01defdf] 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1eb02b1fc1] 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1eaeccb1ca] 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 13: clone() 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 0> 2024-04-26T11:37:13.607+0000 7f1ea5924700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:37:14.058 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: in thread 7f1ea5924700 thread_name:ms_dispatch 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1eaecd5d20] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2: gsignal() 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 3: abort() 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1eaff4d437] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1eaff4d5a3] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562783a52822] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627839c2598] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627839c4c17] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627838bdd0b] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627838be2ac] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627838a6fad] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1eb01e1e20] 2024-04-26T11:37:14.059 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 13: (DispatchQueue::entry()+0x51f) [0x7f1eb01defdf] 2024-04-26T11:37:14.060 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1eb02b1fc1] 2024-04-26T11:37:14.060 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1eaeccb1ca] 2024-04-26T11:37:14.060 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 16: clone() 2024-04-26T11:37:14.060 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:37:14.060 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[67744]: 2024-04-26T11:37:14.060 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:13 smithi196 podman[67996]: 2024-04-26 11:37:13.668672719 +0000 UTC m=+0.020301541 container died bd2c0a7b0b5a77ee5dc379bde696e11e00895caac8c45e51cc04f4490eed9a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T11:37:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:13 smithi193 ceph-mon[32782]: pgmap v183: 97 pgs: 97 active+clean; 2.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 8.7 MiB/s wr, 305 op/s 2024-04-26T11:37:14.693 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:14 smithi196 podman[67996]: 2024-04-26 11:37:14.434232869 +0000 UTC m=+0.785861682 container remove bd2c0a7b0b5a77ee5dc379bde696e11e00895caac8c45e51cc04f4490eed9a91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-26T11:37:14.693 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:14 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:37:14.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 300.0 s, 2483.2 tps, lat 40.969 ms stddev 52.891 2024-04-26T11:37:15.005 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:14 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T11:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:15 smithi196 ceph-mon[32572]: pgmap v184: 97 pgs: 97 active+clean; 2.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 14 MiB/s wr, 432 op/s 2024-04-26T11:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:15 smithi110 ceph-mon[28069]: pgmap v184: 97 pgs: 97 active+clean; 2.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 14 MiB/s wr, 432 op/s 2024-04-26T11:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:15 smithi193 ceph-mon[32782]: pgmap v184: 97 pgs: 97 active+clean; 2.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 14 MiB/s wr, 432 op/s 2024-04-26T11:37:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:17 smithi196 ceph-mon[32572]: pgmap v185: 97 pgs: 97 active+clean; 2.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 12 MiB/s wr, 370 op/s 2024-04-26T11:37:18.015 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:17 smithi110 ceph-mon[28069]: pgmap v185: 97 pgs: 97 active+clean; 2.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 12 MiB/s wr, 370 op/s 2024-04-26T11:37:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:17 smithi193 ceph-mon[32782]: pgmap v185: 97 pgs: 97 active+clean; 2.8 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 12 MiB/s wr, 370 op/s 2024-04-26T11:37:19.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 305.0 s, 1187.0 tps, lat 41.609 ms stddev 50.164 2024-04-26T11:37:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:19 smithi196 ceph-mon[32572]: pgmap v186: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 27 MiB/s wr, 664 op/s 2024-04-26T11:37:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:19 smithi110 ceph-mon[28069]: pgmap v186: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 27 MiB/s wr, 664 op/s 2024-04-26T11:37:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:19 smithi193 ceph-mon[32782]: pgmap v186: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 27 MiB/s wr, 664 op/s 2024-04-26T11:37:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.778+0000 7f1f63000640 1 -- 172.21.15.110:0/2591681981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c105510 msgr2=0x7f1f5c1119d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.778+0000 7f1f63000640 1 --2- 172.21.15.110:0/2591681981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c105510 0x7f1f5c1119d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009ca0 tx=0x7f1f5402a8b0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.778+0000 7f1f63000640 1 -- 172.21.15.110:0/2591681981 shutdown_connections 2024-04-26T11:37:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.778+0000 7f1f63000640 1 --2- 172.21.15.110:0/2591681981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c105510 0x7f1f5c1119d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.778+0000 7f1f63000640 1 --2- 172.21.15.110:0/2591681981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c104b50 0x7f1f5c104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.778+0000 7f1f63000640 1 --2- 172.21.15.110:0/2591681981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f5c10ac10 0x7f1f5c10aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.778+0000 7f1f63000640 1 -- 172.21.15.110:0/2591681981 >> 172.21.15.110:0/2591681981 conn(0x7f1f5c100600 msgr2=0x7f1f5c102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.778+0000 7f1f63000640 1 -- 172.21.15.110:0/2591681981 shutdown_connections 2024-04-26T11:37:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.779+0000 7f1f63000640 1 -- 172.21.15.110:0/2591681981 wait complete. 2024-04-26T11:37:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.779+0000 7f1f63000640 1 Processor -- start 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f63000640 1 -- start start 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f63000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c104b50 0x7f1f5c19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f63000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f5c105510 0x7f1f5c19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f63000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c10ac10 0x7f1f5c19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f63000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c114e50 con 0x7f1f5c104b50 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f63000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c114cd0 con 0x7f1f5c105510 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f63000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c114fd0 con 0x7f1f5c10ac10 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f5be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c104b50 0x7f1f5c19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f5be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c104b50 0x7f1f5c19b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41456/0 (socket says 172.21.15.110:41456) 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f5be00640 1 -- 172.21.15.110:0/2605548615 learned_addr learned my addr 172.21.15.110:0/2605548615 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f5b400640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f5c105510 0x7f1f5c19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.780+0000 7f1f61000640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c10ac10 0x7f1f5c19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f5be00640 1 -- 172.21.15.110:0/2605548615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c10ac10 msgr2=0x7f1f5c19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f5be00640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c10ac10 0x7f1f5c19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f5be00640 1 -- 172.21.15.110:0/2605548615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f5c105510 msgr2=0x7f1f5c19b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f5be00640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f5c105510 0x7f1f5c19b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f5be00640 1 -- 172.21.15.110:0/2605548615 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c1a01c0 con 0x7f1f5c104b50 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f5be00640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c104b50 0x7f1f5c19b1d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00e9f0 tx=0x7f1f4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f58c00640 1 -- 172.21.15.110:0/2605548615 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00cd80 con 0x7f1f5c104b50 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f58c00640 1 -- 172.21.15.110:0/2605548615 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c0108e0 con 0x7f1f5c104b50 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f58c00640 1 -- 172.21.15.110:0/2605548615 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c018980 con 0x7f1f5c104b50 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.781+0000 7f1f63000640 1 -- 172.21.15.110:0/2605548615 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c1a04b0 con 0x7f1f5c104b50 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.782+0000 7f1f63000640 1 -- 172.21.15.110:0/2605548615 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c1a7d40 con 0x7f1f5c104b50 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.785+0000 7f1f58c00640 1 -- 172.21.15.110:0/2605548615 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f1f4c010430 con 0x7f1f5c104b50 2024-04-26T11:37:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.785+0000 7f1f65fee740 1 Processor -- start 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.785+0000 7f1f65fee740 1 -- start start 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b32a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 0x558a69b353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f65fee740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558a69a8d380 con 0x558a69b286f0 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f65fee740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558a69a29c30 con 0x558a69b27dd0 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f65fee740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558a69a89340 con 0x558a69b32fb0 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f5be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b32a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f5be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b32a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41472/0 (socket says 172.21.15.110:41472) 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f5be00640 1 -- 172.21.15.110:0/4124016454 learned_addr learned my addr 172.21.15.110:0/4124016454 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f61000640 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.786+0000 7f1f5b400640 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 0x558a69b353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f5be00640 1 -- 172.21.15.110:0/4124016454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 msgr2=0x558a69b353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f5be00640 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 0x558a69b353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f5be00640 1 -- 172.21.15.110:0/4124016454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 msgr2=0x558a69b281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f5be00640 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b281b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f5be00640 1 -- 172.21.15.110:0/4124016454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a69a4b940 con 0x558a69b286f0 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f61000640 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b281b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f58c00640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f400a3e40 0x7f1f400a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f5be00640 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b32a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0ce130 tx=0x7f1f4c0d96d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4930bb7f197109 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f61000640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f400a3e40 0x7f1f400a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f58c00640 1 -- 172.21.15.110:0/2605548615 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8815+0+0 (secure 0 0 0) 0x7f1f4c0d0b90 con 0x7f1f5c104b50 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f51600640 1 -- 172.21.15.110:0/4124016454 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c026030 con 0x558a69b286f0 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.787+0000 7f1f51600640 1 -- 172.21.15.110:0/4124016454 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4c010720 con 0x558a69b286f0 2024-04-26T11:37:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.788+0000 7f1f51600640 1 -- 172.21.15.110:0/4124016454 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c09c600 con 0x558a69b286f0 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.788+0000 7f1f65fee740 1 -- 172.21.15.110:0/4124016454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 msgr2=0x558a69b32a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.788+0000 7f1f61000640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f400a3e40 0x7f1f400a6300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f54006010 tx=0x7f1f54005d80 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.788+0000 7f1f65fee740 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b32a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0ce130 tx=0x7f1f4c0d96d0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.789+0000 7f1f65fee740 1 -- 172.21.15.110:0/4124016454 shutdown_connections 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.789+0000 7f1f65fee740 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 0x558a69b353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.789+0000 7f1f65fee740 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b32a70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.789+0000 7f1f65fee740 1 --2- 172.21.15.110:0/4124016454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b281b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.789+0000 7f1f65fee740 1 -- 172.21.15.110:0/4124016454 >> 172.21.15.110:0/4124016454 conn(0x558a69b242e0 msgr2=0x558a69b246c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.789+0000 7f1f65fee740 1 -- 172.21.15.110:0/4124016454 shutdown_connections 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.789+0000 7f1f65fee740 1 -- 172.21.15.110:0/4124016454 wait complete. 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.789+0000 7f1f65fee740 1 -- start start 2024-04-26T11:37:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.789+0000 7f1f65fee740 1 Processor -- start 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 0x558a69b2ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b30470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 0x558a69b309b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f65fee740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558a69b35be0 con 0x558a69b286f0 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f65fee740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558a69a14c60 con 0x558a69b32fb0 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f65fee740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558a69b35d60 con 0x558a69b27dd0 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f65fee740 10 client.0 _ll_register_callbacks cb 0x558a69a40e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b30470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b30470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41478/0 (socket says 172.21.15.110:41478) 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f5b400640 1 -- 172.21.15.110:0/896458146 learned_addr learned my addr 172.21.15.110:0/896458146 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f5be00640 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 0x558a69b2ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.790+0000 7f1f61000640 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 0x558a69b309b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f5b400640 1 -- 172.21.15.110:0/896458146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 msgr2=0x558a69b2ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f5b400640 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 0x558a69b2ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f5b400640 1 -- 172.21.15.110:0/896458146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 msgr2=0x558a69b309b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f5b400640 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 0x558a69b309b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f5b400640 1 -- 172.21.15.110:0/896458146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a69a23510 con 0x558a69b286f0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f5b400640 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b30470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1f48012700 tx=0x7f1f48012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22a263bf1c2333a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f46000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f46000640 1 -- 172.21.15.110:0/896458146 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800f8a0 con 0x558a69b286f0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f65fee740 1 -- 172.21.15.110:0/896458146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a69a9af90 con 0x558a69b286f0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.791+0000 7f1f46000640 1 -- 172.21.15.110:0/896458146 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8815+0+0 (secure 0 0 0) 0x7f1f4800fa40 con 0x558a69b286f0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f46000640 1 -- 172.21.15.110:0/896458146 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1f4800fc40 con 0x558a69b286f0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f65fee740 10 client.15687 fetch_fsmap learned FSMap version 49 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f65fee740 1 -- 172.21.15.110:0/896458146 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x558a6979f210 con 0x558a69b286f0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f46000640 1 -- 172.21.15.110:0/896458146 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558a69a9af90 con 0x558a69b286f0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f46000640 1 -- 172.21.15.110:0/896458146 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 49) ==== 8346+0+0 (secure 0 0 0) 0x7f1f4801c420 con 0x558a69b286f0 2024-04-26T11:37:20.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f65fee740 10 client.15687 fetch_fsmap finished waiting for FSMap version 49 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f65fee740 10 client.15687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f65fee740 20 client.15687 populate_metadata read hostname 'smithi110' 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f65fee740 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558a69b42db0 0x558a69b45220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f65fee740 4 client.15687 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.792+0000 7f1f65fee740 1 -- 172.21.15.110:0/896458146 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a69a94e00 con 0x558a69b42db0 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.793+0000 7f1f5be00640 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558a69b42db0 0x558a69b45220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.793+0000 7f1f5be00640 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558a69b42db0 0x558a69b45220 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77fd8ffdeffc5cbf server_cookie=9791dfec75c326e1 in_seq=0 out_seq=0 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.793+0000 7f1f46000640 10 client.15687 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f46000640 1 -- 172.21.15.110:0/896458146 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558a69a94e00 con 0x558a69b42db0 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f46000640 10 client.15687 handle_command_reply: tid=0 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 client.15687 shutdown 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 -- 172.21.15.110:0/896458146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 msgr2=0x558a69b30470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b30470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1f48012700 tx=0x7f1f48012bc0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 -- 172.21.15.110:0/896458146 shutdown_connections 2024-04-26T11:37:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 0x558a69b309b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b30470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558a69b42db0 0x558a69b45220 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 --2- 172.21.15.110:0/896458146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 0x558a69b2ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 -- 172.21.15.110:0/896458146 >> 172.21.15.110:0/896458146 conn(0x558a69b242e0 msgr2=0x558a69b2a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f46000640 0 client.15687 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 -- 172.21.15.110:0/896458146 shutdown_connections 2024-04-26T11:37:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.794+0000 7f1f65fee740 1 -- 172.21.15.110:0/896458146 wait complete. 2024-04-26T11:37:20.801 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.795+0000 7f1f65fee740 20 client.15687 trim_cache size 0 max 16384 2024-04-26T11:37:20.813 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.810+0000 7f1f65fee740 1 Processor -- start 2024-04-26T11:37:20.813 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f65fee740 1 -- start start 2024-04-26T11:37:20.813 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 0x558a69b3ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.813 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b4ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.813 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 0x558a69b4b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f65fee740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b3400 con 0x558a69b286f0 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f65fee740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b0ca0 con 0x558a69b32fb0 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f65fee740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1aeaf0 con 0x558a69b27dd0 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b4ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b4ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41480/0 (socket says 172.21.15.110:41480) 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f5b400640 1 -- 172.21.15.110:0/901562918 learned_addr learned my addr 172.21.15.110:0/901562918 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f5be00640 1 --2- 172.21.15.110:0/901562918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 0x558a69b3ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.811+0000 7f1f61000640 1 --2- 172.21.15.110:0/901562918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 0x558a69b4b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.812+0000 7f1f5b400640 1 -- 172.21.15.110:0/901562918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 msgr2=0x558a69b3ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.812+0000 7f1f5b400640 1 --2- 172.21.15.110:0/901562918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 0x558a69b3ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.812+0000 7f1f5b400640 1 -- 172.21.15.110:0/901562918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 msgr2=0x558a69b4b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.812+0000 7f1f5b400640 1 --2- 172.21.15.110:0/901562918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 0x558a69b4b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.812+0000 7f1f5b400640 1 -- 172.21.15.110:0/901562918 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6986b620 con 0x558a69b286f0 2024-04-26T11:37:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.812+0000 7f1f5b400640 1 --2- 172.21.15.110:0/901562918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b4ab30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009d00 tx=0x7f1f48009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5351dee6fd3568 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.812+0000 7f1f50c00640 1 -- 172.21.15.110:0/901562918 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48009da0 con 0x558a69b286f0 2024-04-26T11:37:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.812+0000 7f1f50c00640 1 -- 172.21.15.110:0/901562918 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4800f8a0 con 0x558a69b286f0 2024-04-26T11:37:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.812+0000 7f1f50c00640 1 -- 172.21.15.110:0/901562918 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4801c6a0 con 0x558a69b286f0 2024-04-26T11:37:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 -- 172.21.15.110:0/901562918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 msgr2=0x558a69b4ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 --2- 172.21.15.110:0/901562918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b4ab30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009d00 tx=0x7f1f48009370 comp rx=0 tx=0).stop 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 -- 172.21.15.110:0/901562918 shutdown_connections 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 --2- 172.21.15.110:0/901562918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b32fb0 0x558a69b4b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 --2- 172.21.15.110:0/901562918 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b4ab30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 --2- 172.21.15.110:0/901562918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b27dd0 0x558a69b3ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 -- 172.21.15.110:0/901562918 >> 172.21.15.110:0/901562918 conn(0x558a69b242e0 msgr2=0x558a69b2b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 -- 172.21.15.110:0/901562918 shutdown_connections 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 -- 172.21.15.110:0/901562918 wait complete. 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.813+0000 7f1f65fee740 1 -- start start 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f65fee740 1 Processor -- start 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b3b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b35fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f65fee740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 0x558a69b36500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f65fee740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1af160 con 0x558a69b286f0 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f65fee740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1b05d0 con 0x558a69b27dd0 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f65fee740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1af830 con 0x558a69b32fb0 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f65fee740 10 client.0 _ll_register_callbacks cb 0x7f1f48009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b35fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f5b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b35fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41492/0 (socket says 172.21.15.110:41492) 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f5b400640 1 -- 172.21.15.110:0/2961120109 learned_addr learned my addr 172.21.15.110:0/2961120109 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.814+0000 7f1f5be00640 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b3b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f61000640 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 0x558a69b36500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f5b400640 1 -- 172.21.15.110:0/2961120109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 msgr2=0x558a69b36500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f5b400640 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 0x558a69b36500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f5b400640 1 -- 172.21.15.110:0/2961120109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 msgr2=0x558a69b3b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f5b400640 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b3b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f5b400640 1 -- 172.21.15.110:0/2961120109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a69a47cb0 con 0x558a69b286f0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f61000640 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 0x558a69b36500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f5be00640 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b3b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f5b400640 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b35fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1f48012c00 tx=0x7f1f48009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cc8e5d97fdca46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f46000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f46000640 1 -- 172.21.15.110:0/2961120109 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48005730 con 0x558a69b286f0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f46000640 1 -- 172.21.15.110:0/2961120109 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8815+0+0 (secure 0 0 0) 0x7f1f48018070 con 0x558a69b286f0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.815+0000 7f1f65fee740 1 -- 172.21.15.110:0/2961120109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4800f8a0 con 0x558a69b286f0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f46000640 1 -- 172.21.15.110:0/2961120109 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1f4800fa50 con 0x558a69b286f0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f65fee740 10 client.15693 fetch_fsmap learned FSMap version 49 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f65fee740 1 -- 172.21.15.110:0/2961120109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x558a69ba8250 con 0x558a69b286f0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f46000640 1 -- 172.21.15.110:0/2961120109 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4800f8a0 con 0x558a69b286f0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f46000640 1 -- 172.21.15.110:0/2961120109 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 49) ==== 8346+0+0 (secure 0 0 0) 0x7f1f48003b80 con 0x558a69b286f0 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f65fee740 10 client.15693 fetch_fsmap finished waiting for FSMap version 49 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f65fee740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:37:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f65fee740 20 client.15693 populate_metadata read hostname 'smithi110' 2024-04-26T11:37:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f65fee740 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558a69ba8850 0x558a69baac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f65fee740 4 client.15693 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:37:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.816+0000 7f1f65fee740 1 -- 172.21.15.110:0/2961120109 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558a69a104b0 con 0x558a69ba8850 2024-04-26T11:37:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.817+0000 7f1f5be00640 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558a69ba8850 0x558a69baac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.817+0000 7f1f5be00640 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558a69ba8850 0x558a69baac70 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c89c0eebd92da4 server_cookie=432f99fcc790c90 in_seq=0 out_seq=0 2024-04-26T11:37:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:20.817+0000 7f1f46000640 10 client.15693 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:21 smithi196 ceph-mon[32572]: pgmap v187: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 27 MiB/s wr, 659 op/s 2024-04-26T11:37:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:21 smithi110 ceph-mon[28069]: pgmap v187: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 27 MiB/s wr, 659 op/s 2024-04-26T11:37:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:21 smithi193 ceph-mon[32782]: pgmap v187: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 27 MiB/s wr, 659 op/s 2024-04-26T11:37:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:23 smithi196 ceph-mon[32572]: pgmap v188: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 28 MiB/s wr, 717 op/s 2024-04-26T11:37:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:23 smithi110 ceph-mon[28069]: pgmap v188: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 28 MiB/s wr, 717 op/s 2024-04-26T11:37:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:23 smithi193 ceph-mon[32782]: pgmap v188: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 28 MiB/s wr, 717 op/s 2024-04-26T11:37:24.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:37:25.066 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:24 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:37:25.066 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:24 smithi196 systemd[1]: Stopped Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:37:25.066 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:24 smithi196 systemd[1]: Starting Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:37:25.066 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:24 smithi196 podman[68096]: 2024-04-26 11:37:24.98499524 +0000 UTC m=+0.112213011 container create 07356c677b35b6a30b1cbf95a5da5b8e8b692c98d630fc2df5e90ce1b87dc6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:37:25.066 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:24 smithi196 podman[68096]: 2024-04-26 11:37:24.890818034 +0000 UTC m=+0.018035776 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:37:25.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:25 smithi196 podman[68096]: 2024-04-26 11:37:25.203891587 +0000 UTC m=+0.331109319 container init 07356c677b35b6a30b1cbf95a5da5b8e8b692c98d630fc2df5e90ce1b87dc6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-26T11:37:25.506 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:25 smithi196 podman[68096]: 2024-04-26 11:37:25.206462291 +0000 UTC m=+0.333680025 container start 07356c677b35b6a30b1cbf95a5da5b8e8b692c98d630fc2df5e90ce1b87dc6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:37:25.506 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mds[68115]: -- 172.21.15.196:0/193849357 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c03f6ada40 con 0x55c03f681000 2024-04-26T11:37:25.506 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: starting mds.i at 2024-04-26T11:37:25.506 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:25 smithi196 bash[68096]: 07356c677b35b6a30b1cbf95a5da5b8e8b692c98d630fc2df5e90ce1b87dc6c5 2024-04-26T11:37:25.506 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:37:25 smithi196 systemd[1]: Started Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:37:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mon[32572]: pgmap v189: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 21 MiB/s wr, 476 op/s 2024-04-26T11:37:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mon[32572]: daemon mds.i restarted 2024-04-26T11:37:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:37:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mon[32572]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T11:37:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:boot 2024-04-26T11:37:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mon[32572]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:37:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:37:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:37:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:25 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:25 smithi110 ceph-mon[28069]: pgmap v189: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 21 MiB/s wr, 476 op/s 2024-04-26T11:37:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:25 smithi110 ceph-mon[28069]: daemon mds.i restarted 2024-04-26T11:37:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:25 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:37:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:25 smithi110 ceph-mon[28069]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T11:37:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:25 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:boot 2024-04-26T11:37:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:25 smithi110 ceph-mon[28069]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:37:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:25 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:37:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:37:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:25 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:25 smithi193 ceph-mon[32782]: pgmap v189: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 21 MiB/s wr, 476 op/s 2024-04-26T11:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:25 smithi193 ceph-mon[32782]: daemon mds.i restarted 2024-04-26T11:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:25 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:25 smithi193 ceph-mon[32782]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T11:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:25 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:boot 2024-04-26T11:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:25 smithi193 ceph-mon[32782]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:25 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:25 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:27.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:27 smithi110 ceph-mon[28069]: pgmap v191: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 MiB/s wr, 443 op/s 2024-04-26T11:37:27.954 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:27 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:resolve 2024-04-26T11:37:27.954 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:27 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:27 smithi196 ceph-mon[32572]: pgmap v191: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 MiB/s wr, 443 op/s 2024-04-26T11:37:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:27 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:resolve 2024-04-26T11:37:28.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:27 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:27 smithi193 ceph-mon[32782]: pgmap v191: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 20 MiB/s wr, 443 op/s 2024-04-26T11:37:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:27 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:resolve 2024-04-26T11:37:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:27 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.739+0000 7f1f46000640 1 -- 172.21.15.110:0/2961120109 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558a69a104b0 con 0x558a69ba8850 2024-04-26T11:37:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.739+0000 7f1f46000640 10 client.15693 handle_command_reply: tid=0 2024-04-26T11:37:28.740 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.739+0000 7f1f65fee740 1 client.15693 shutdown 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.739+0000 7f1f65fee740 1 -- 172.21.15.110:0/2961120109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 msgr2=0x558a69b35fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.739+0000 7f1f65fee740 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b35fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1f48012c00 tx=0x7f1f48009fb0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f65fee740 1 -- 172.21.15.110:0/2961120109 shutdown_connections 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f65fee740 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558a69ba8850 0x558a69baac70 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f65fee740 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a69b32fb0 0x558a69b36500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f65fee740 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558a69b286f0 0x558a69b35fa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f65fee740 1 --2- 172.21.15.110:0/2961120109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558a69b27dd0 0x558a69b3b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f65fee740 1 -- 172.21.15.110:0/2961120109 >> 172.21.15.110:0/2961120109 conn(0x558a69b242e0 msgr2=0x558a69b2fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f46000640 0 client.15693 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:28.741 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f65fee740 1 -- 172.21.15.110:0/2961120109 shutdown_connections 2024-04-26T11:37:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f65fee740 1 -- 172.21.15.110:0/2961120109 wait complete. 2024-04-26T11:37:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.740+0000 7f1f65fee740 20 client.15693 trim_cache size 0 max 16384 2024-04-26T11:37:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:37:28.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:37:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:37:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:37:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 -- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f400a3e40 msgr2=0x7f1f400a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f400a3e40 0x7f1f400a6300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f54006010 tx=0x7f1f54005d80 comp rx=0 tx=0).stop 2024-04-26T11:37:28.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 -- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c104b50 msgr2=0x7f1f5c19b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c104b50 0x7f1f5c19b1d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00e9f0 tx=0x7f1f4c00eeb0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 -- 172.21.15.110:0/2605548615 shutdown_connections 2024-04-26T11:37:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f1f400a3e40 0x7f1f400a6300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c10ac10 0x7f1f5c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f5c105510 0x7f1f5c19b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 --2- 172.21.15.110:0/2605548615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f5c104b50 0x7f1f5c19b1d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 -- 172.21.15.110:0/2605548615 >> 172.21.15.110:0/2605548615 conn(0x7f1f5c100600 msgr2=0x7f1f5c101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 -- 172.21.15.110:0/2605548615 shutdown_connections 2024-04-26T11:37:28.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:28.742+0000 7f1f63000640 1 -- 172.21.15.110:0/2605548615 wait complete. 2024-04-26T11:37:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:28 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:37:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:28 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:reconnect 2024-04-26T11:37:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:28 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:28 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0119997 2024-04-26T11:37:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:28 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:37:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:28 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:reconnect 2024-04-26T11:37:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:28 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:28 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0119997 2024-04-26T11:37:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:28 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:37:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:28 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:reconnect 2024-04-26T11:37:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:28 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:28 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0119997 2024-04-26T11:37:29.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 315.0 s, 233.8 tps, lat 1064.323 ms stddev 3234.535 2024-04-26T11:37:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:29 smithi196 ceph-mon[32572]: pgmap v192: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 899 KiB/s wr, 81 op/s 2024-04-26T11:37:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:29 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:rejoin 2024-04-26T11:37:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:29 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:29 smithi196 ceph-mon[32572]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:37:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:29 smithi110 ceph-mon[28069]: pgmap v192: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 899 KiB/s wr, 81 op/s 2024-04-26T11:37:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:29 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:rejoin 2024-04-26T11:37:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:29 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:29 smithi110 ceph-mon[28069]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:37:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:29 smithi193 ceph-mon[32782]: pgmap v192: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 899 KiB/s wr, 81 op/s 2024-04-26T11:37:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:29 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:rejoin 2024-04-26T11:37:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:29 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:29 smithi193 ceph-mon[32782]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:37:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:30 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:37:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:30 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:37:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:30 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:active 2024-04-26T11:37:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:30 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:30 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:30 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:37:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:30 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:37:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:30 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:active 2024-04-26T11:37:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:30 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:30 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:30 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:37:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:30 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:37:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:30 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/638576670,v1:172.21.15.196:6835/638576670] up:active 2024-04-26T11:37:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:30 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:30 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:31 smithi196 ceph-mon[32572]: pgmap v193: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 899 KiB/s wr, 81 op/s 2024-04-26T11:37:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:31 smithi110 ceph-mon[28069]: pgmap v193: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 899 KiB/s wr, 81 op/s 2024-04-26T11:37:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:31 smithi193 ceph-mon[32782]: pgmap v193: 97 pgs: 97 active+clean; 2.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 899 KiB/s wr, 81 op/s 2024-04-26T11:37:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:33 smithi196 ceph-mon[32572]: pgmap v194: 97 pgs: 97 active+clean; 2.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5.6 MiB/s wr, 119 op/s 2024-04-26T11:37:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:33 smithi110 ceph-mon[28069]: pgmap v194: 97 pgs: 97 active+clean; 2.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5.6 MiB/s wr, 119 op/s 2024-04-26T11:37:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:33 smithi193 ceph-mon[32782]: pgmap v194: 97 pgs: 97 active+clean; 2.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5.6 MiB/s wr, 119 op/s 2024-04-26T11:37:34.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 320.0 s, 2851.2 tps, lat 35.760 ms stddev 51.453 2024-04-26T11:37:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:35 smithi110 ceph-mon[28069]: pgmap v195: 97 pgs: 97 active+clean; 3.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 11 MiB/s wr, 204 op/s 2024-04-26T11:37:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:35 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:37:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:35 smithi193 ceph-mon[32782]: pgmap v195: 97 pgs: 97 active+clean; 3.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 11 MiB/s wr, 204 op/s 2024-04-26T11:37:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:35 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:37:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:35 smithi196 ceph-mon[32572]: pgmap v195: 97 pgs: 97 active+clean; 3.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 11 MiB/s wr, 204 op/s 2024-04-26T11:37:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:35 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:37:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:37:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:37:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:37:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:37:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:37:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:37:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:37:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:37:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:37:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:37 smithi110 ceph-mon[28069]: pgmap v196: 97 pgs: 97 active+clean; 3.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 9.7 MiB/s wr, 185 op/s 2024-04-26T11:37:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:37 smithi193 ceph-mon[32782]: pgmap v196: 97 pgs: 97 active+clean; 3.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 9.7 MiB/s wr, 185 op/s 2024-04-26T11:37:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:37 smithi196 ceph-mon[32572]: pgmap v196: 97 pgs: 97 active+clean; 3.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 9.7 MiB/s wr, 185 op/s 2024-04-26T11:37:39.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 325.0 s, 2558.6 tps, lat 39.044 ms stddev 50.549 2024-04-26T11:37:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-mon[32572]: pgmap v197: 97 pgs: 97 active+clean; 3.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 21 MiB/s wr, 464 op/s 2024-04-26T11:37:40.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe1dc87b700 time 2024-04-26T11:37:39.586458+0000 2024-04-26T11:37:40.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:37:40.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe1e6ea43dd] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe1e6ea45a3] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e157942822] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1578b2598] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1578b4c17] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1577add0b] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1577ae2ac] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e157796fad] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe1e7138e20] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 10: (DispatchQueue::entry()+0x51f) [0x7fe1e7135fdf] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe1e7208fc1] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe1e5c221ca] 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 13: clone() 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:39.587+0000 7fe1dc87b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe1dc87b700 time 2024-04-26T11:37:39.586458+0000 2024-04-26T11:37:40.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:37:40.007 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.007 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:40.007 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe1e6ea43dd] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe1e6ea45a3] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e157942822] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1578b2598] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1578b4c17] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1577add0b] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1577ae2ac] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e157796fad] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe1e7138e20] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 10: (DispatchQueue::entry()+0x51f) [0x7fe1e7135fdf] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe1e7208fc1] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe1e5c221ca] 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 13: clone() 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: *** Caught signal (Aborted) ** 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: in thread 7fe1dc87b700 thread_name:ms_dispatch 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe1e5c2cd20] 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2: gsignal() 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 3: abort() 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe1e6ea4437] 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe1e6ea45a3] 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e157942822] 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1578b2598] 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1578b4c17] 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1577add0b] 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1577ae2ac] 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e157796fad] 2024-04-26T11:37:40.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe1e7138e20] 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 13: (DispatchQueue::entry()+0x51f) [0x7fe1e7135fdf] 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe1e7208fc1] 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe1e5c221ca] 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 16: clone() 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:39.588+0000 7fe1dc87b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: in thread 7fe1dc87b700 thread_name:ms_dispatch 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe1e5c2cd20] 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2: gsignal() 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 3: abort() 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe1e6ea4437] 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe1e6ea45a3] 2024-04-26T11:37:40.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e157942822] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1578b2598] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1578b4c17] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1577add0b] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1577ae2ac] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e157796fad] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe1e7138e20] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 13: (DispatchQueue::entry()+0x51f) [0x7fe1e7135fdf] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe1e7208fc1] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe1e5c221ca] 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 16: clone() 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: -1> 2024-04-26T11:37:39.587+0000 7fe1dc87b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe1dc87b700 time 2024-04-26T11:37:39.586458+0000 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:37:40.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe1e6ea43dd] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe1e6ea45a3] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e157942822] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1578b2598] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1578b4c17] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1577add0b] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1577ae2ac] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e157796fad] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe1e7138e20] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 10: (DispatchQueue::entry()+0x51f) [0x7fe1e7135fdf] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe1e7208fc1] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe1e5c221ca] 2024-04-26T11:37:40.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 13: clone() 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 0> 2024-04-26T11:37:39.588+0000 7fe1dc87b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: in thread 7fe1dc87b700 thread_name:ms_dispatch 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe1e5c2cd20] 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2: gsignal() 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 3: abort() 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe1e6ea4437] 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe1e6ea45a3] 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e157942822] 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1578b2598] 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1578b4c17] 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1577add0b] 2024-04-26T11:37:40.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1577ae2ac] 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e157796fad] 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe1e7138e20] 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 13: (DispatchQueue::entry()+0x51f) [0x7fe1e7135fdf] 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe1e7208fc1] 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe1e5c221ca] 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 16: clone() 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: -4> 2024-04-26T11:37:39.587+0000 7fe1dc87b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe1dc87b700 time 2024-04-26T11:37:39.586458+0000 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe1e6ea43dd] 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe1e6ea45a3] 2024-04-26T11:37:40.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e157942822] 2024-04-26T11:37:40.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1578b2598] 2024-04-26T11:37:40.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1578b4c17] 2024-04-26T11:37:40.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1577add0b] 2024-04-26T11:37:40.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1577ae2ac] 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e157796fad] 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe1e7138e20] 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 10: (DispatchQueue::entry()+0x51f) [0x7fe1e7135fdf] 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe1e7208fc1] 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe1e5c221ca] 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 13: clone() 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: -3> 2024-04-26T11:37:39.588+0000 7fe1dc87b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: in thread 7fe1dc87b700 thread_name:ms_dispatch 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe1e5c2cd20] 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2: gsignal() 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 3: abort() 2024-04-26T11:37:40.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe1e6ea4437] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe1e6ea45a3] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e157942822] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1578b2598] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1578b4c17] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1577add0b] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1577ae2ac] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e157796fad] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe1e7138e20] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 13: (DispatchQueue::entry()+0x51f) [0x7fe1e7135fdf] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe1e7208fc1] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe1e5c221ca] 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 16: clone() 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[67944]: 2024-04-26T11:37:40.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:39 smithi196 podman[68280]: 2024-04-26 11:37:39.644029038 +0000 UTC m=+0.019567538 container died a48358d66d2d7fd65e0113abd24e89eaabac230ab42c194ea6a95a10af0f56b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True) 2024-04-26T11:37:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:39 smithi110 ceph-mon[28069]: pgmap v197: 97 pgs: 97 active+clean; 3.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 21 MiB/s wr, 464 op/s 2024-04-26T11:37:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:39 smithi193 ceph-mon[32782]: pgmap v197: 97 pgs: 97 active+clean; 3.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 21 MiB/s wr, 464 op/s 2024-04-26T11:37:40.688 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:40 smithi196 podman[68280]: 2024-04-26 11:37:40.409271296 +0000 UTC m=+0.784809795 container remove a48358d66d2d7fd65e0113abd24e89eaabac230ab42c194ea6a95a10af0f56b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:37:40.688 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:40 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:37:41.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:40 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T11:37:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.934+0000 7fa58de00640 1 -- 172.21.15.110:0/2194210525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa588102060 msgr2=0x7fa58810edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.934+0000 7fa58de00640 1 --2- 172.21.15.110:0/2194210525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa588102060 0x7fa58810edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa574009900 tx=0x7fa57402a3f0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.935+0000 7fa58de00640 1 -- 172.21.15.110:0/2194210525 shutdown_connections 2024-04-26T11:37:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.935+0000 7fa58de00640 1 --2- 172.21.15.110:0/2194210525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa58810f2f0 0x7fa5881116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.935+0000 7fa58de00640 1 --2- 172.21.15.110:0/2194210525 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa588102060 0x7fa58810edb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.935+0000 7fa58de00640 1 --2- 172.21.15.110:0/2194210525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa588101740 0x7fa588101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.935+0000 7fa58de00640 1 -- 172.21.15.110:0/2194210525 >> 172.21.15.110:0/2194210525 conn(0x7fa5880789e0 msgr2=0x7fa588078df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.935+0000 7fa58de00640 1 -- 172.21.15.110:0/2194210525 shutdown_connections 2024-04-26T11:37:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.935+0000 7fa58de00640 1 -- 172.21.15.110:0/2194210525 wait complete. 2024-04-26T11:37:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.936+0000 7fa58de00640 1 Processor -- start 2024-04-26T11:37:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.936+0000 7fa58de00640 1 -- start start 2024-04-26T11:37:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa58de00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa588101740 0x7fa58810dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa58de00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa588102060 0x7fa58810e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa58de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58810f2f0 0x7fa5881a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa58de00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa588104fa0 con 0x7fa58810f2f0 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa58de00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa588104e20 con 0x7fa588101740 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa58de00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa588105120 con 0x7fa588102060 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa586a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa588101740 0x7fa58810dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa586000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa588102060 0x7fa58810e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa586000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa588102060 0x7fa58810e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:49716/0 (socket says 172.21.15.110:49716) 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa586000640 1 -- 172.21.15.110:0/2946944954 learned_addr learned my addr 172.21.15.110:0/2946944954 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.937+0000 7fa587400640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58810f2f0 0x7fa5881a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.938+0000 7fa586000640 1 -- 172.21.15.110:0/2946944954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa588101740 msgr2=0x7fa58810dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.938+0000 7fa586000640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa588101740 0x7fa58810dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.938+0000 7fa586000640 1 -- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58810f2f0 msgr2=0x7fa5881a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.938+0000 7fa586000640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58810f2f0 0x7fa5881a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.938+0000 7fa586000640 1 -- 172.21.15.110:0/2946944954 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5881a4670 con 0x7fa588102060 2024-04-26T11:37:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.938+0000 7fa587400640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58810f2f0 0x7fa5881a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:37:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.938+0000 7fa586000640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa588102060 0x7fa58810e200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa574005ab0 tx=0x7fa574003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.939+0000 7fa58ca00640 1 -- 172.21.15.110:0/2946944954 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57403f070 con 0x7fa588102060 2024-04-26T11:37:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.939+0000 7fa58de00640 1 -- 172.21.15.110:0/2946944954 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5881a4900 con 0x7fa588102060 2024-04-26T11:37:41.940 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.939+0000 7fa58ca00640 1 -- 172.21.15.110:0/2946944954 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa574031b60 con 0x7fa588102060 2024-04-26T11:37:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.939+0000 7fa58ca00640 1 -- 172.21.15.110:0/2946944954 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa574035030 con 0x7fa588102060 2024-04-26T11:37:41.941 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.939+0000 7fa58de00640 1 -- 172.21.15.110:0/2946944954 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5881ac1f0 con 0x7fa588102060 2024-04-26T11:37:41.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.944+0000 7fa58ca00640 1 -- 172.21.15.110:0/2946944954 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fa574042070 con 0x7fa588102060 2024-04-26T11:37:41.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.945+0000 7fa590de2740 1 Processor -- start 2024-04-26T11:37:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.945+0000 7fa590de2740 1 -- start start 2024-04-26T11:37:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.945+0000 7fa590de2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4acdd0 0x557dae4ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.945+0000 7fa590de2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 0x557dae4b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.945+0000 7fa590de2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 0x557dae4ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.945+0000 7fa590de2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557dae412380 con 0x557dae4acdd0 2024-04-26T11:37:41.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.945+0000 7fa590de2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557dae3aec30 con 0x557dae4ad6f0 2024-04-26T11:37:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.945+0000 7fa590de2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557dae40e340 con 0x557dae4b7fb0 2024-04-26T11:37:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa586a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 0x557dae4b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa586000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 0x557dae4ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa586a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 0x557dae4b7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:53568/0 (socket says 172.21.15.110:53568) 2024-04-26T11:37:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa586a00640 1 -- 172.21.15.110:0/2943131112 learned_addr learned my addr 172.21.15.110:0/2943131112 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa587400640 1 --2- 172.21.15.110:0/2943131112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4acdd0 0x557dae4ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa586000640 1 -- 172.21.15.110:0/2943131112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 msgr2=0x557dae4b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa586000640 1 --2- 172.21.15.110:0/2943131112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 0x557dae4b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa586000640 1 -- 172.21.15.110:0/2943131112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4acdd0 msgr2=0x557dae4ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa586000640 1 --2- 172.21.15.110:0/2943131112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4acdd0 0x557dae4ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa586000640 1 -- 172.21.15.110:0/2943131112 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dae3d0940 con 0x557dae4b7fb0 2024-04-26T11:37:41.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.946+0000 7fa58ca00640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa56c0a3f20 0x7fa56c0a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.947+0000 7fa586000640 1 --2- 172.21.15.110:0/2943131112 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 0x557dae4ba3a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5740ee520 tx=0x7fa5740f9270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a05fe2c1ecc34220 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.947+0000 7fa587400640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa56c0a3f20 0x7fa56c0a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.947+0000 7fa573e00640 1 -- 172.21.15.110:0/2943131112 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5740b9010 con 0x557dae4b7fb0 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.947+0000 7fa573e00640 1 -- 172.21.15.110:0/2943131112 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5740bd470 con 0x557dae4b7fb0 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.947+0000 7fa573e00640 1 -- 172.21.15.110:0/2943131112 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5740bc6d0 con 0x557dae4b7fb0 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.947+0000 7fa58ca00640 1 -- 172.21.15.110:0/2946944954 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8901+0+0 (secure 0 0 0) 0x7fa5740f0f50 con 0x7fa588102060 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa590de2740 1 -- 172.21.15.110:0/2943131112 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 msgr2=0x557dae4ba3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa590de2740 1 --2- 172.21.15.110:0/2943131112 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 0x557dae4ba3a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa5740ee520 tx=0x7fa5740f9270 comp rx=0 tx=0).stop 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa587400640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa56c0a3f20 0x7fa56c0a63e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa58806b000 tx=0x7fa580009500 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:41.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa590de2740 1 -- 172.21.15.110:0/2943131112 shutdown_connections 2024-04-26T11:37:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa590de2740 1 --2- 172.21.15.110:0/2943131112 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 0x557dae4ba3a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa590de2740 1 --2- 172.21.15.110:0/2943131112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 0x557dae4b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa590de2740 1 --2- 172.21.15.110:0/2943131112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4acdd0 0x557dae4ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa590de2740 1 -- 172.21.15.110:0/2943131112 >> 172.21.15.110:0/2943131112 conn(0x557dae4a92e0 msgr2=0x557dae4a96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:41.950 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa590de2740 1 -- 172.21.15.110:0/2943131112 shutdown_connections 2024-04-26T11:37:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.948+0000 7fa590de2740 1 -- 172.21.15.110:0/2943131112 wait complete. 2024-04-26T11:37:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.949+0000 7fa590de2740 1 -- start start 2024-04-26T11:37:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.949+0000 7fa590de2740 1 Processor -- start 2024-04-26T11:37:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa590de2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa590de2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 0x557dae4b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.951 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa590de2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4b7fb0 0x557dae4b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa590de2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557dae4ba9a0 con 0x557dae4b7fb0 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa590de2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557dae399c60 con 0x557dae4ad6f0 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa590de2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557dae4bab20 con 0x557dae4acdd0 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa590de2740 10 client.0 _ll_register_callbacks cb 0x557dae3c5e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa586a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa586a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:49726/0 (socket says 172.21.15.110:49726) 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.950+0000 7fa586a00640 1 -- 172.21.15.110:0/3937041650 learned_addr learned my addr 172.21.15.110:0/3937041650 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa586000640 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 0x557dae4b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa587400640 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4b7fb0 0x557dae4b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa586a00640 1 -- 172.21.15.110:0/3937041650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 msgr2=0x557dae4b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:41.952 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa586a00640 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 0x557dae4b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa586a00640 1 -- 172.21.15.110:0/3937041650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4b7fb0 msgr2=0x557dae4b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa586a00640 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4b7fb0 0x557dae4b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa586a00640 1 -- 172.21.15.110:0/3937041650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dae3a8510 con 0x557dae4acdd0 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa587400640 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4b7fb0 0x557dae4b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa586a00640 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4b4ee0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa578012840 tx=0x7fa578012d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c95dd55d397589c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa570c00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa570c00640 1 -- 172.21.15.110:0/3937041650 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578004050 con 0x557dae4acdd0 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.951+0000 7fa570c00640 1 -- 172.21.15.110:0/3937041650 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8901+0+0 (secure 0 0 0) 0x7fa5780041f0 con 0x557dae4acdd0 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.952+0000 7fa590de2740 1 -- 172.21.15.110:0/3937041650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5740bd470 con 0x557dae4acdd0 2024-04-26T11:37:41.954 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.952+0000 7fa570c00640 1 -- 172.21.15.110:0/3937041650 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fa5780043f0 con 0x557dae4acdd0 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.952+0000 7fa590de2740 10 client.25906 fetch_fsmap learned FSMap version 57 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.952+0000 7fa590de2740 1 -- 172.21.15.110:0/3937041650 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x557dae124210 con 0x557dae4acdd0 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.952+0000 7fa570c00640 1 -- 172.21.15.110:0/3937041650 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5740bd470 con 0x557dae4acdd0 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.952+0000 7fa570c00640 1 -- 172.21.15.110:0/3937041650 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 57) ==== 8346+0+0 (secure 0 0 0) 0x7fa578003a90 con 0x557dae4acdd0 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.953+0000 7fa590de2740 10 client.25906 fetch_fsmap finished waiting for FSMap version 57 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.953+0000 7fa590de2740 10 client.25906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.953+0000 7fa590de2740 20 client.25906 populate_metadata read hostname 'smithi110' 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.953+0000 7fa590de2740 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557dae4c79e0 0x557dae4c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.953+0000 7fa590de2740 4 client.25906 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.953+0000 7fa590de2740 1 -- 172.21.15.110:0/3937041650 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dae41ff90 con 0x557dae4c79e0 2024-04-26T11:37:41.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.953+0000 7fa586000640 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557dae4c79e0 0x557dae4c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.954+0000 7fa586000640 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557dae4c79e0 0x557dae4c9e10 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c200771f511aa372 server_cookie=c3795a5e1a55922b in_seq=0 out_seq=0 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.954+0000 7fa570c00640 10 client.25906 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.954+0000 7fa570c00640 1 -- 172.21.15.110:0/3937041650 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557dae41ff90 con 0x557dae4c79e0 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa570c00640 10 client.25906 handle_command_reply: tid=0 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 client.25906 shutdown 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 -- 172.21.15.110:0/3937041650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 msgr2=0x557dae4b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4b4ee0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa578012840 tx=0x7fa578012d00 comp rx=0 tx=0).stop 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 -- 172.21.15.110:0/3937041650 shutdown_connections 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4b7fb0 0x557dae4b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4ad6f0 0x557dae4b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557dae4c79e0 0x557dae4c9e10 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 --2- 172.21.15.110:0/3937041650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4b4ee0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 -- 172.21.15.110:0/3937041650 >> 172.21.15.110:0/3937041650 conn(0x557dae4a92e0 msgr2=0x557dae4af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa570c00640 0 client.25906 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 -- 172.21.15.110:0/3937041650 shutdown_connections 2024-04-26T11:37:41.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.955+0000 7fa590de2740 1 -- 172.21.15.110:0/3937041650 wait complete. 2024-04-26T11:37:41.958 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.956+0000 7fa590de2740 20 client.25906 trim_cache size 0 max 16384 2024-04-26T11:37:41.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.976+0000 7fa590de2740 1 Processor -- start 2024-04-26T11:37:41.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.976+0000 7fa590de2740 1 -- start start 2024-04-26T11:37:41.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa590de2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa590de2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 0x557dae4b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa590de2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4b7fb0 0x557dae4b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa590de2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa5881b78a0 con 0x557dae4ad6f0 2024-04-26T11:37:41.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa590de2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa5881b5140 con 0x557dae4b7fb0 2024-04-26T11:37:41.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa590de2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa5881b2f90 con 0x557dae4acdd0 2024-04-26T11:37:41.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa586a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa586a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4c37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:49734/0 (socket says 172.21.15.110:49734) 2024-04-26T11:37:41.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa586a00640 1 -- 172.21.15.110:0/283160104 learned_addr learned my addr 172.21.15.110:0/283160104 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:41.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa587400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4b7fb0 0x557dae4b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa586a00640 1 -- 172.21.15.110:0/283160104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4b7fb0 msgr2=0x557dae4b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:41.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa586a00640 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4b7fb0 0x557dae4b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.977+0000 7fa586a00640 1 -- 172.21.15.110:0/283160104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 msgr2=0x557dae4b47c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.978+0000 7fa586000640 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 0x557dae4b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.978+0000 7fa586a00640 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 0x557dae4b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.978+0000 7fa586a00640 1 -- 172.21.15.110:0/283160104 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dae1f0620 con 0x557dae4acdd0 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.978+0000 7fa587400640 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4b7fb0 0x557dae4b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.978+0000 7fa586000640 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 0x557dae4b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.978+0000 7fa586a00640 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4c37a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa578009a50 tx=0x7fa5780096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2f98415eabb3bba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.978+0000 7fa573400640 1 -- 172.21.15.110:0/283160104 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578027080 con 0x557dae4acdd0 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.978+0000 7fa573400640 1 -- 172.21.15.110:0/283160104 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa57800fdd0 con 0x557dae4acdd0 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.978+0000 7fa573400640 1 -- 172.21.15.110:0/283160104 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578005040 con 0x557dae4acdd0 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.979+0000 7fa590de2740 1 -- 172.21.15.110:0/283160104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 msgr2=0x557dae4c37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.979+0000 7fa590de2740 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4c37a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa578009a50 tx=0x7fa5780096c0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.979+0000 7fa590de2740 1 -- 172.21.15.110:0/283160104 shutdown_connections 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.979+0000 7fa590de2740 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4b7fb0 0x557dae4b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.979+0000 7fa590de2740 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 0x557dae4b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.979+0000 7fa590de2740 1 --2- 172.21.15.110:0/283160104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4acdd0 0x557dae4c37a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.979+0000 7fa590de2740 1 -- 172.21.15.110:0/283160104 >> 172.21.15.110:0/283160104 conn(0x557dae4a92e0 msgr2=0x557dae4af010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.980+0000 7fa590de2740 1 -- 172.21.15.110:0/283160104 shutdown_connections 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.980+0000 7fa590de2740 1 -- 172.21.15.110:0/283160104 wait complete. 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.980+0000 7fa590de2740 1 -- start start 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.980+0000 7fa590de2740 1 Processor -- start 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa590de2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4acdd0 0x557dae4bb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa590de2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 0x557dae4bbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa590de2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 0x557dae4bc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa590de2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa5881b3600 con 0x557dae4ad6f0 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa590de2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa5881b4a70 con 0x557dae4acdd0 2024-04-26T11:37:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa590de2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa5881b3cd0 con 0x557dae4b7fb0 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa590de2740 10 client.0 _ll_register_callbacks cb 0x7fa578009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa586a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4acdd0 0x557dae4bb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa586a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4acdd0 0x557dae4bb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:53602/0 (socket says 172.21.15.110:53602) 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa586a00640 1 -- 172.21.15.110:0/1750738660 learned_addr learned my addr 172.21.15.110:0/1750738660 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.981+0000 7fa587400640 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 0x557dae4bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.982+0000 7fa586000640 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 0x557dae4bbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.982+0000 7fa586a00640 1 -- 172.21.15.110:0/1750738660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 msgr2=0x557dae4bc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.982+0000 7fa586a00640 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 0x557dae4bc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.982+0000 7fa586a00640 1 -- 172.21.15.110:0/1750738660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 msgr2=0x557dae4bbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.982+0000 7fa586a00640 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 0x557dae4bbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.982+0000 7fa586a00640 1 -- 172.21.15.110:0/1750738660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dae3cccb0 con 0x557dae4acdd0 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.982+0000 7fa586a00640 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4acdd0 0x557dae4bb700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa578012d40 tx=0x7fa5780038d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d47385e68700d18 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:37:41.984 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.982+0000 7fa570c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.982+0000 7fa570c00640 1 -- 172.21.15.110:0/1750738660 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578027030 con 0x557dae4acdd0 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa590de2740 1 -- 172.21.15.110:0/1750738660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa57800fdd0 con 0x557dae4acdd0 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa570c00640 1 -- 172.21.15.110:0/1750738660 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8901+0+0 (secure 0 0 0) 0x7fa57800f920 con 0x557dae4acdd0 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa570c00640 1 -- 172.21.15.110:0/1750738660 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fa57800fb40 con 0x557dae4acdd0 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa590de2740 10 client.25883 fetch_fsmap learned FSMap version 57 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa590de2740 1 -- 172.21.15.110:0/1750738660 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x557dae52e050 con 0x557dae4acdd0 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa570c00640 1 -- 172.21.15.110:0/1750738660 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa57800fdd0 con 0x557dae4acdd0 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa570c00640 1 -- 172.21.15.110:0/1750738660 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 57) ==== 8346+0+0 (secure 0 0 0) 0x7fa578004930 con 0x557dae4acdd0 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa590de2740 10 client.25883 fetch_fsmap finished waiting for FSMap version 57 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa590de2740 10 client.25883 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa590de2740 20 client.25883 populate_metadata read hostname 'smithi110' 2024-04-26T11:37:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa590de2740 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557dae52e660 0x557dae530a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:37:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa590de2740 4 client.25883 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:37:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.983+0000 7fa590de2740 1 -- 172.21.15.110:0/1750738660 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557dae419e00 con 0x557dae52e660 2024-04-26T11:37:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.984+0000 7fa586000640 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557dae52e660 0x557dae530a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:37:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.984+0000 7fa570c00640 10 client.25883 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:41.984+0000 7fa586000640 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557dae52e660 0x557dae530a80 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffc3e97c2f200bfa server_cookie=8b10a527b7554e1b in_seq=0 out_seq=0 2024-04-26T11:37:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:41 smithi110 ceph-mon[28069]: pgmap v198: 97 pgs: 97 active+clean; 3.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 21 MiB/s wr, 461 op/s 2024-04-26T11:37:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:41 smithi193 ceph-mon[32782]: pgmap v198: 97 pgs: 97 active+clean; 3.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 21 MiB/s wr, 461 op/s 2024-04-26T11:37:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:41 smithi196 ceph-mon[32572]: pgmap v198: 97 pgs: 97 active+clean; 3.0 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 21 MiB/s wr, 461 op/s 2024-04-26T11:37:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:43 smithi110 ceph-mon[28069]: pgmap v199: 97 pgs: 97 active+clean; 3.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 25 MiB/s wr, 595 op/s 2024-04-26T11:37:44.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:43 smithi196 ceph-mon[32572]: pgmap v199: 97 pgs: 97 active+clean; 3.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 25 MiB/s wr, 595 op/s 2024-04-26T11:37:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:43 smithi193 ceph-mon[32782]: pgmap v199: 97 pgs: 97 active+clean; 3.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 25 MiB/s wr, 595 op/s 2024-04-26T11:37:44.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 330.0 s, 1171.0 tps, lat 21.823 ms stddev 35.110 2024-04-26T11:37:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:45 smithi110 ceph-mon[28069]: pgmap v200: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 27 MiB/s wr, 687 op/s 2024-04-26T11:37:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:45 smithi193 ceph-mon[32782]: pgmap v200: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 27 MiB/s wr, 687 op/s 2024-04-26T11:37:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:45 smithi196 ceph-mon[32572]: pgmap v200: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 27 MiB/s wr, 687 op/s 2024-04-26T11:37:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:47 smithi193 ceph-mon[32782]: pgmap v201: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 610 op/s 2024-04-26T11:37:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:47 smithi196 ceph-mon[32572]: pgmap v201: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 610 op/s 2024-04-26T11:37:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:47 smithi110 ceph-mon[28069]: pgmap v201: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 610 op/s 2024-04-26T11:37:49.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 335.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:37:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:49 smithi193 ceph-mon[32782]: pgmap v202: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 MiB/s wr, 816 op/s 2024-04-26T11:37:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:49 smithi196 ceph-mon[32572]: pgmap v202: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 MiB/s wr, 816 op/s 2024-04-26T11:37:50.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:49 smithi110 ceph-mon[28069]: pgmap v202: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 26 MiB/s wr, 816 op/s 2024-04-26T11:37:51.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:50 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:37:51.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:50 smithi196 systemd[1]: Stopped Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:37:51.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:50 smithi196 systemd[1]: Starting Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:37:51.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:50 smithi196 podman[68375]: 2024-04-26 11:37:50.893313591 +0000 UTC m=+0.018187320 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:37:51.547 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:51 smithi196 podman[68375]: 2024-04-26 11:37:51.293595634 +0000 UTC m=+0.418469350 container create 2a4e8517b9f713aba30f32de1749ae7acfb6fe754ce14f1fb310c9e8ab887343 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-04-26T11:37:51.547 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:51 smithi196 podman[68375]: 2024-04-26 11:37:51.521444027 +0000 UTC m=+0.646317743 container init 2a4e8517b9f713aba30f32de1749ae7acfb6fe754ce14f1fb310c9e8ab887343 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:37:51.547 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:51 smithi196 podman[68375]: 2024-04-26 11:37:51.524013644 +0000 UTC m=+0.648887361 container start 2a4e8517b9f713aba30f32de1749ae7acfb6fe754ce14f1fb310c9e8ab887343 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:37:51.803 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mds[68394]: -- 172.21.15.196:0/1508405669 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55619e3a7a40 con 0x55619e37b000 2024-04-26T11:37:51.803 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: starting mds.f at 2024-04-26T11:37:51.803 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:51 smithi196 bash[68375]: 2a4e8517b9f713aba30f32de1749ae7acfb6fe754ce14f1fb310c9e8ab887343 2024-04-26T11:37:51.804 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:37:51 smithi196 systemd[1]: Started Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:37:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:51 smithi193 ceph-mon[32782]: pgmap v203: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 521 op/s 2024-04-26T11:37:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:51 smithi193 ceph-mon[32782]: daemon mds.f restarted 2024-04-26T11:37:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:51 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:37:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:51 smithi193 ceph-mon[32782]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T11:37:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:51 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:boot 2024-04-26T11:37:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:51 smithi193 ceph-mon[32782]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:37:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:51 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:37:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:37:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:51 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mon[32572]: pgmap v203: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 521 op/s 2024-04-26T11:37:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mon[32572]: daemon mds.f restarted 2024-04-26T11:37:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:37:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mon[32572]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T11:37:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:boot 2024-04-26T11:37:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mon[32572]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:37:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:37:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:37:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:51 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:51 smithi110 ceph-mon[28069]: pgmap v203: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 521 op/s 2024-04-26T11:37:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:51 smithi110 ceph-mon[28069]: daemon mds.f restarted 2024-04-26T11:37:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:51 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:37:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:51 smithi110 ceph-mon[28069]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T11:37:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:51 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:boot 2024-04-26T11:37:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:51 smithi110 ceph-mon[28069]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:37:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:51 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:37:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:37:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:51 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:54.088 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:53 smithi110 ceph-mon[28069]: pgmap v205: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 499 op/s 2024-04-26T11:37:54.088 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:53 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:resolve 2024-04-26T11:37:54.088 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:53 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:53 smithi193 ceph-mon[32782]: pgmap v205: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 499 op/s 2024-04-26T11:37:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:53 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:resolve 2024-04-26T11:37:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:53 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:53 smithi196 ceph-mon[32572]: pgmap v205: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 499 op/s 2024-04-26T11:37:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:53 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:resolve 2024-04-26T11:37:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:53 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa570c00640 1 -- 172.21.15.110:0/1750738660 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557dae419e00 con 0x557dae52e660 2024-04-26T11:37:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa570c00640 10 client.25883 handle_command_reply: tid=0 2024-04-26T11:37:54.869 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa590de2740 1 client.25883 shutdown 2024-04-26T11:37:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa590de2740 1 -- 172.21.15.110:0/1750738660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4acdd0 msgr2=0x557dae4bb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa590de2740 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4acdd0 0x557dae4bb700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa578012d40 tx=0x7fa5780038d0 comp rx=0 tx=0).stop 2024-04-26T11:37:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa590de2740 1 -- 172.21.15.110:0/1750738660 shutdown_connections 2024-04-26T11:37:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa590de2740 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x557dae52e660 0x557dae530a80 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa590de2740 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557dae4b7fb0 0x557dae4bc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa590de2740 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557dae4ad6f0 0x557dae4bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa590de2740 1 --2- 172.21.15.110:0/1750738660 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557dae4acdd0 0x557dae4bb700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa590de2740 1 -- 172.21.15.110:0/1750738660 >> 172.21.15.110:0/1750738660 conn(0x557dae4a92e0 msgr2=0x557dae4a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.868+0000 7fa570c00640 0 client.25883 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.869+0000 7fa590de2740 1 -- 172.21.15.110:0/1750738660 shutdown_connections 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.869+0000 7fa590de2740 1 -- 172.21.15.110:0/1750738660 wait complete. 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.869+0000 7fa590de2740 20 client.25883 trim_cache size 0 max 16384 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:37:54.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:37:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 -- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa56c0a3f20 msgr2=0x7fa56c0a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa56c0a3f20 0x7fa56c0a63e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa58806b000 tx=0x7fa580009500 comp rx=0 tx=0).stop 2024-04-26T11:37:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 -- 172.21.15.110:0/2946944954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa588102060 msgr2=0x7fa58810e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:37:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa588102060 0x7fa58810e200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa574005ab0 tx=0x7fa574003c10 comp rx=0 tx=0).stop 2024-04-26T11:37:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 -- 172.21.15.110:0/2946944954 shutdown_connections 2024-04-26T11:37:54.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fa56c0a3f20 0x7fa56c0a63e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa58810f2f0 0x7fa5881a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa588102060 0x7fa58810e200 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 --2- 172.21.15.110:0/2946944954 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa588101740 0x7fa58810dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:37:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.870+0000 7fa58de00640 1 -- 172.21.15.110:0/2946944954 >> 172.21.15.110:0/2946944954 conn(0x7fa5880789e0 msgr2=0x7fa588110770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:37:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.871+0000 7fa58de00640 1 -- 172.21.15.110:0/2946944954 shutdown_connections 2024-04-26T11:37:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:37:54.871+0000 7fa58de00640 1 -- 172.21.15.110:0/2946944954 wait complete. 2024-04-26T11:37:54.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:37:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:54 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:37:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:54 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:reconnect 2024-04-26T11:37:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:54 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:54 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199996 2024-04-26T11:37:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:54 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:37:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:54 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:reconnect 2024-04-26T11:37:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:54 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:54 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199996 2024-04-26T11:37:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:54 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:37:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:54 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:reconnect 2024-04-26T11:37:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:54 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:54 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199996 2024-04-26T11:37:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:55 smithi193 ceph-mon[32782]: pgmap v206: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.5 MiB/s wr, 302 op/s 2024-04-26T11:37:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:55 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:rejoin 2024-04-26T11:37:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:55 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:55 smithi193 ceph-mon[32782]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:37:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:55 smithi196 ceph-mon[32572]: pgmap v206: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.5 MiB/s wr, 302 op/s 2024-04-26T11:37:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:55 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:rejoin 2024-04-26T11:37:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:55 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:55 smithi196 ceph-mon[32572]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:37:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:55 smithi110 ceph-mon[28069]: pgmap v206: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.5 MiB/s wr, 302 op/s 2024-04-26T11:37:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:55 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:rejoin 2024-04-26T11:37:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:55 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:55 smithi110 ceph-mon[28069]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:37:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:56 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:37:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:56 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:37:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:56 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:active 2024-04-26T11:37:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:56 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:56 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:56 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:37:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:56 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:37:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:56 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:active 2024-04-26T11:37:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:56 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:56 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:56 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:37:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:56 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:37:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:56 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/65317503,v1:172.21.15.196:6839/65317503] up:active 2024-04-26T11:37:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:56 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:37:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:56 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:37:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:57 smithi196 ceph-mon[32572]: pgmap v207: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.5 MiB/s wr, 302 op/s 2024-04-26T11:37:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:57 smithi110 ceph-mon[28069]: pgmap v207: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.5 MiB/s wr, 302 op/s 2024-04-26T11:37:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:57 smithi193 ceph-mon[32782]: pgmap v207: 97 pgs: 97 active+clean; 3.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.5 MiB/s wr, 302 op/s 2024-04-26T11:37:59.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 345.0 s, 2335.0 tps, lat 160.581 ms stddev 1368.880 2024-04-26T11:38:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:37:59 smithi196 ceph-mon[32572]: pgmap v208: 97 pgs: 97 active+clean; 3.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 200 op/s 2024-04-26T11:38:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:37:59 smithi110 ceph-mon[28069]: pgmap v208: 97 pgs: 97 active+clean; 3.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 200 op/s 2024-04-26T11:38:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:37:59 smithi193 ceph-mon[32782]: pgmap v208: 97 pgs: 97 active+clean; 3.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 200 op/s 2024-04-26T11:38:02.206 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.8 2024-04-26T11:38:02.207 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T11:38:02.251 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:01 smithi196 ceph-mon[32572]: pgmap v209: 97 pgs: 97 active+clean; 3.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 200 op/s 2024-04-26T11:38:02.252 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:01 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:02.278 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:01 smithi110 ceph-mon[28069]: pgmap v209: 97 pgs: 97 active+clean; 3.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 200 op/s 2024-04-26T11:38:02.278 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:01 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:01 smithi193 ceph-mon[32782]: pgmap v209: 97 pgs: 97 active+clean; 3.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 200 op/s 2024-04-26T11:38:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:01 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:02.692 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:38:03.124 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:02 smithi110 ceph-mon[28069]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T11:38:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:02 smithi196 ceph-mon[32572]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T11:38:03.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:02 smithi193 ceph-mon[32782]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T11:38:04.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:03 smithi196 ceph-mon[32572]: pgmap v211: 97 pgs: 97 active+clean; 3.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 9.4 MiB/s wr, 350 op/s 2024-04-26T11:38:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:03 smithi110 ceph-mon[28069]: pgmap v211: 97 pgs: 97 active+clean; 3.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 9.4 MiB/s wr, 350 op/s 2024-04-26T11:38:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:03 smithi193 ceph-mon[32782]: pgmap v211: 97 pgs: 97 active+clean; 3.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 9.4 MiB/s wr, 350 op/s 2024-04-26T11:38:04.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 350.0 s, 466.0 tps, lat 202.966 ms stddev 202.300 2024-04-26T11:38:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.732+0000 7fc711800700 1 -- 172.21.15.110:0/1477177640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc70c1083b0 msgr2=0x7fc70c108790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.732+0000 7fc711800700 1 --2- 172.21.15.110:0/1477177640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc70c1083b0 0x7fc70c108790 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0099c0 tx=0x7fc6fc009cd0 comp rx=0 tx=0).stop 2024-04-26T11:38:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.733+0000 7fc711800700 1 -- 172.21.15.110:0/1477177640 shutdown_connections 2024-04-26T11:38:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.733+0000 7fc711800700 1 --2- 172.21.15.110:0/1477177640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc70c103e90 0x7fc70c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:05.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.733+0000 7fc711800700 1 --2- 172.21.15.110:0/1477177640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc70c1083b0 0x7fc70c108790 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.733+0000 7fc711800700 1 --2- 172.21.15.110:0/1477177640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc70c1034d0 0x7fc70c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.733+0000 7fc711800700 1 -- 172.21.15.110:0/1477177640 >> 172.21.15.110:0/1477177640 conn(0x7fc70c07a580 msgr2=0x7fc70c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.733+0000 7fc711800700 1 -- 172.21.15.110:0/1477177640 shutdown_connections 2024-04-26T11:38:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.733+0000 7fc711800700 1 -- 172.21.15.110:0/1477177640 wait complete. 2024-04-26T11:38:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.734+0000 7fc711800700 1 Processor -- start 2024-04-26T11:38:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.734+0000 7fc711800700 1 -- start start 2024-04-26T11:38:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.734+0000 7fc711800700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc70c1034d0 0x7fc70c19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.734+0000 7fc711800700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc70c103e90 0x7fc70c19c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.734+0000 7fc711800700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc70c1083b0 0x7fc70c1a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.734+0000 7fc711800700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c113660 con 0x7fc70c103e90 2024-04-26T11:38:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.734+0000 7fc711800700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c1134e0 con 0x7fc70c1034d0 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.734+0000 7fc711800700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c1137e0 con 0x7fc70c1083b0 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70b400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc70c1083b0 0x7fc70c1a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70b400700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc70c1083b0 0x7fc70c1a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:37956/0 (socket says 172.21.15.110:37956) 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70b400700 1 -- 172.21.15.110:0/2314701482 learned_addr learned my addr 172.21.15.110:0/2314701482 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70aa00700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc70c1034d0 0x7fc70c19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70a000700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc70c103e90 0x7fc70c19c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70aa00700 1 -- 172.21.15.110:0/2314701482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc70c1083b0 msgr2=0x7fc70c1a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70aa00700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc70c1083b0 0x7fc70c1a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70aa00700 1 -- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc70c103e90 msgr2=0x7fc70c19c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70aa00700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc70c103e90 0x7fc70c19c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.735+0000 7fc70aa00700 1 -- 172.21.15.110:0/2314701482 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70c1a0de0 con 0x7fc70c1034d0 2024-04-26T11:38:05.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.736+0000 7fc70aa00700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc70c1034d0 0x7fc70c19bdd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0098e0 tx=0x7fc6fc004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.736+0000 7fc703400700 1 -- 172.21.15.110:0/2314701482 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc026070 con 0x7fc70c1034d0 2024-04-26T11:38:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.736+0000 7fc703400700 1 -- 172.21.15.110:0/2314701482 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6fc003c70 con 0x7fc70c1034d0 2024-04-26T11:38:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.736+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc70c1a1070 con 0x7fc70c1034d0 2024-04-26T11:38:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.736+0000 7fc703400700 1 -- 172.21.15.110:0/2314701482 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc00fa00 con 0x7fc70c1034d0 2024-04-26T11:38:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.736+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc70c1a8950 con 0x7fc70c1034d0 2024-04-26T11:38:05.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.737+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc70c104b90 con 0x7fc70c1034d0 2024-04-26T11:38:05.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.743+0000 7fc703400700 1 -- 172.21.15.110:0/2314701482 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc6fc029070 con 0x7fc70c1034d0 2024-04-26T11:38:05.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.745+0000 7fc703400700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc6f00a3db0 0x7fc6f00a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:05.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.746+0000 7fc70a000700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc6f00a3db0 0x7fc6f00a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:05.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.746+0000 7fc703400700 1 -- 172.21.15.110:0/2314701482 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9075+0+0 (secure 0 0 0) 0x7fc6fc0d10d0 con 0x7fc70c1034d0 2024-04-26T11:38:05.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.747+0000 7fc70a000700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc6f00a3db0 0x7fc6f00a6270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc70c110670 tx=0x7fc6f8009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:05.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:05.751+0000 7fc703400700 1 -- 172.21.15.110:0/2314701482 <== mon.2 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc6fc013070 con 0x7fc70c1034d0 2024-04-26T11:38:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:05 smithi196 ceph-mon[32572]: pgmap v212: 97 pgs: 97 active+clean; 3.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 13 MiB/s wr, 559 op/s 2024-04-26T11:38:06.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.267+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc70c19d130 con 0x7fc70c1034d0 2024-04-26T11:38:06.269 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:05 smithi110 ceph-mon[28069]: pgmap v212: 97 pgs: 97 active+clean; 3.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 13 MiB/s wr, 559 op/s 2024-04-26T11:38:06.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.268+0000 7fc703400700 1 -- 172.21.15.110:0/2314701482 <== mon.2 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+11886 (secure 0 0 0) 0x7fc6fc09d5d0 con 0x7fc70c1034d0 2024-04-26T11:38:06.271 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-04-26T11:38:06.271 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":65,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14403,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3227547559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":3227547559},{"type":"v1","addr":"172.21.15.110:6839","nonce":3227547559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/1751495892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":1751495892},{"type":"v1","addr":"172.21.15.110:6841","nonce":1751495892}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6833/1015216555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":1015216555},{"type":"v1","addr":"172.21.15.193:6833","nonce":1015216555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/3280524135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3280524135},{"type":"v1","addr":"172.21.15.196:6833","nonce":3280524135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24454,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1499538548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1499538548},{"type":"v1","addr":"172.21.15.110:6835","nonce":1499538548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24461,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1767649513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1767649513},{"type":"v1","addr":"172.21.15.110:6837","nonce":1767649513}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":65,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T11:27:14.996270+0000","modified":"2024-04-26T11:38:00.234590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24518,"mds_1":25894,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24467":{"gid":24467,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6835/2038926783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2038926783},{"type":"v1","addr":"172.21.15.193:6835","nonce":2038926783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.193:6837/324089889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":324089889},{"type":"v1","addr":"172.21.15.193:6837","nonce":324089889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.196:6837/1521745566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1521745566},{"type":"v1","addr":"172.21.15.196:6837","nonce":1521745566}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6839/64494456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6838","nonce":64494456},{"type":"v1","addr":"172.21.15.193:6839","nonce":64494456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25894":{"gid":25894,"name":"i","rank":1,"incarnation":59,"state":"up:active","state_seq":11,"addr":"172.21.15.196:6839/65317503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":65317503},{"type":"v1","addr":"172.21.15.196:6839","nonce":65317503}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25918":{"gid":25918,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/2654982126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":2654982126},{"type":"v1","addr":"172.21.15.196:6835","nonce":2654982126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24518,"qdb_cluster":[24518,25894,24487]},"id":1}]} 2024-04-26T11:38:06.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.273+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc6f00a3db0 msgr2=0x7fc6f00a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:06.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.273+0000 7fc711800700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc6f00a3db0 0x7fc6f00a6270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc70c110670 tx=0x7fc6f8009260 comp rx=0 tx=0).stop 2024-04-26T11:38:06.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.273+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc70c1034d0 msgr2=0x7fc70c19bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:06.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.273+0000 7fc711800700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc70c1034d0 0x7fc70c19bdd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0098e0 tx=0x7fc6fc004270 comp rx=0 tx=0).stop 2024-04-26T11:38:06.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.274+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 shutdown_connections 2024-04-26T11:38:06.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.274+0000 7fc711800700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc6f00a3db0 0x7fc6f00a6270 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:06.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.274+0000 7fc711800700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc70c1083b0 0x7fc70c1a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:06.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.274+0000 7fc711800700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc70c1034d0 0x7fc70c19bdd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:06.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.274+0000 7fc711800700 1 --2- 172.21.15.110:0/2314701482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc70c103e90 0x7fc70c19c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:06.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.274+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 >> 172.21.15.110:0/2314701482 conn(0x7fc70c07a580 msgr2=0x7fc70c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:06.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.274+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 shutdown_connections 2024-04-26T11:38:06.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:06.275+0000 7fc711800700 1 -- 172.21.15.110:0/2314701482 wait complete. 2024-04-26T11:38:06.280 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 65 2024-04-26T11:38:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:05 smithi193 ceph-mon[32782]: pgmap v212: 97 pgs: 97 active+clean; 3.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 13 MiB/s wr, 559 op/s 2024-04-26T11:38:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-mon[32572]: from='client.? 172.21.15.110:0/2314701482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:38:07.255 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3c2b48f700 time 2024-04-26T11:38:06.861496+0000 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3c35ab83dd] 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c35ab85a3] 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c03d797822] 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c03d707598] 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c03d709c17] 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c03d602d0b] 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c03d6032ac] 2024-04-26T11:38:07.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c03d5ebfad] 2024-04-26T11:38:07.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c35d4ce20] 2024-04-26T11:38:07.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 10: (DispatchQueue::entry()+0x51f) [0x7f3c35d49fdf] 2024-04-26T11:38:07.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c35e1cfc1] 2024-04-26T11:38:07.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3c348361ca] 2024-04-26T11:38:07.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 13: clone() 2024-04-26T11:38:07.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: *** Caught signal (Aborted) ** 2024-04-26T11:38:07.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: in thread 7f3c2b48f700 thread_name:ms_dispatch 2024-04-26T11:38:07.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:06.863+0000 7f3c2b48f700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3c2b48f700 time 2024-04-26T11:38:06.861496+0000 2024-04-26T11:38:07.258 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3c35ab83dd] 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c35ab85a3] 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c03d797822] 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c03d707598] 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c03d709c17] 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c03d602d0b] 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c03d6032ac] 2024-04-26T11:38:07.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c03d5ebfad] 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c35d4ce20] 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 10: (DispatchQueue::entry()+0x51f) [0x7f3c35d49fdf] 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c35e1cfc1] 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3c348361ca] 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 13: clone() 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3c34840d20] 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2: gsignal() 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 3: abort() 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3c35ab8437] 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c35ab85a3] 2024-04-26T11:38:07.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c03d797822] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c03d707598] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c03d709c17] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c03d602d0b] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c03d6032ac] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c03d5ebfad] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c35d4ce20] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 13: (DispatchQueue::entry()+0x51f) [0x7f3c35d49fdf] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c35e1cfc1] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3c348361ca] 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 16: clone() 2024-04-26T11:38:07.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:06.867+0000 7f3c2b48f700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:07.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: in thread 7f3c2b48f700 thread_name:ms_dispatch 2024-04-26T11:38:07.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:07.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3c34840d20] 2024-04-26T11:38:07.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2: gsignal() 2024-04-26T11:38:07.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 3: abort() 2024-04-26T11:38:07.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3c35ab8437] 2024-04-26T11:38:07.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c35ab85a3] 2024-04-26T11:38:07.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c03d797822] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c03d707598] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c03d709c17] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c03d602d0b] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c03d6032ac] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c03d5ebfad] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c35d4ce20] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 13: (DispatchQueue::entry()+0x51f) [0x7f3c35d49fdf] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c35e1cfc1] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3c348361ca] 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 16: clone() 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: -1> 2024-04-26T11:38:06.863+0000 7f3c2b48f700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3c2b48f700 time 2024-04-26T11:38:06.861496+0000 2024-04-26T11:38:07.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:07.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:07.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3c35ab83dd] 2024-04-26T11:38:07.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c35ab85a3] 2024-04-26T11:38:07.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c03d797822] 2024-04-26T11:38:07.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c03d707598] 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c03d709c17] 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c03d602d0b] 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c03d6032ac] 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c03d5ebfad] 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c35d4ce20] 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 10: (DispatchQueue::entry()+0x51f) [0x7f3c35d49fdf] 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c35e1cfc1] 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3c348361ca] 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 13: clone() 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 0> 2024-04-26T11:38:06.867+0000 7f3c2b48f700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: in thread 7f3c2b48f700 thread_name:ms_dispatch 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3c34840d20] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2: gsignal() 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 3: abort() 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3c35ab8437] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c35ab85a3] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c03d797822] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c03d707598] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c03d709c17] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c03d602d0b] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c03d6032ac] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c03d5ebfad] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c35d4ce20] 2024-04-26T11:38:07.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 13: (DispatchQueue::entry()+0x51f) [0x7f3c35d49fdf] 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c35e1cfc1] 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3c348361ca] 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 16: clone() 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: -1> 2024-04-26T11:38:06.863+0000 7f3c2b48f700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3c2b48f700 time 2024-04-26T11:38:06.861496+0000 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3c35ab83dd] 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c35ab85a3] 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c03d797822] 2024-04-26T11:38:07.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c03d707598] 2024-04-26T11:38:07.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c03d709c17] 2024-04-26T11:38:07.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c03d602d0b] 2024-04-26T11:38:07.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c03d6032ac] 2024-04-26T11:38:07.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c03d5ebfad] 2024-04-26T11:38:07.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c35d4ce20] 2024-04-26T11:38:07.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 10: (DispatchQueue::entry()+0x51f) [0x7f3c35d49fdf] 2024-04-26T11:38:07.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c35e1cfc1] 2024-04-26T11:38:07.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3c348361ca] 2024-04-26T11:38:07.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 13: clone() 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 0> 2024-04-26T11:38:06.867+0000 7f3c2b48f700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: in thread 7f3c2b48f700 thread_name:ms_dispatch 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3c34840d20] 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2: gsignal() 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 3: abort() 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3c35ab8437] 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c35ab85a3] 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c03d797822] 2024-04-26T11:38:07.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c03d707598] 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c03d709c17] 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c03d602d0b] 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c03d6032ac] 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c03d5ebfad] 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c35d4ce20] 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 13: (DispatchQueue::entry()+0x51f) [0x7f3c35d49fdf] 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c35e1cfc1] 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3c348361ca] 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 16: clone() 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68111]: 2024-04-26T11:38:07.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:06 smithi196 podman[68444]: 2024-04-26 11:38:06.928993751 +0000 UTC m=+0.020794097 container died 07356c677b35b6a30b1cbf95a5da5b8e8b692c98d630fc2df5e90ce1b87dc6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T11:38:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:06 smithi110 ceph-mon[28069]: from='client.? 172.21.15.110:0/2314701482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:38:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:06 smithi193 ceph-mon[32782]: from='client.? 172.21.15.110:0/2314701482' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T11:38:07.527 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24518 quiesce db / --timeout 60 --expiration 88.8 --await-for 42.0' 2024-04-26T11:38:07.527 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid 6e439470-03be-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24518 quiesce db / --timeout 60 --expiration 88.8 --await-for 42.0 2024-04-26T11:38:07.970 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/6e439470-03be-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T11:38:08.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.000+0000 7fc11c800640 1 -- 172.21.15.110:0/524846623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114102940 msgr2=0x7fc114102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.000+0000 7fc11c800640 1 --2- 172.21.15.110:0/524846623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114102940 0x7fc114102dc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc104009930 tx=0x7fc10402a420 comp rx=0 tx=0).stop 2024-04-26T11:38:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.000+0000 7fc11c800640 1 -- 172.21.15.110:0/524846623 shutdown_connections 2024-04-26T11:38:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.000+0000 7fc11c800640 1 --2- 172.21.15.110:0/524846623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc114103300 0x7fc11410f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.000+0000 7fc11c800640 1 --2- 172.21.15.110:0/524846623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114102940 0x7fc114102dc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.000+0000 7fc11c800640 1 --2- 172.21.15.110:0/524846623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc114108950 0x7fc114108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.000+0000 7fc11c800640 1 -- 172.21.15.110:0/524846623 >> 172.21.15.110:0/524846623 conn(0x7fc114079dc0 msgr2=0x7fc11407a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.000+0000 7fc11c800640 1 -- 172.21.15.110:0/524846623 shutdown_connections 2024-04-26T11:38:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.000+0000 7fc11c800640 1 -- 172.21.15.110:0/524846623 wait complete. 2024-04-26T11:38:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.001+0000 7fc11c800640 1 Processor -- start 2024-04-26T11:38:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.001+0000 7fc11c800640 1 -- start start 2024-04-26T11:38:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc11c800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc114102940 0x7fc114074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc11c800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc114103300 0x7fc114075170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc11c800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114108950 0x7fc1140756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc11c800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc114112c60 con 0x7fc114108950 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc11c800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc114112ae0 con 0x7fc114103300 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc11c800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc114112de0 con 0x7fc114102940 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc11a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114108950 0x7fc1140756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc11a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114108950 0x7fc1140756b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51044/0 (socket says 172.21.15.110:51044) 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc11a800640 1 -- 172.21.15.110:0/2402683984 learned_addr learned my addr 172.21.15.110:0/2402683984 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc119400640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc114103300 0x7fc114075170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.002+0000 7fc119e00640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc114102940 0x7fc114074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc119400640 1 -- 172.21.15.110:0/2402683984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc114102940 msgr2=0x7fc114074c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc119400640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc114102940 0x7fc114074c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc119400640 1 -- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114108950 msgr2=0x7fc1140756b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc119400640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114108950 0x7fc1140756b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc119400640 1 -- 172.21.15.110:0/2402683984 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1141a75c0 con 0x7fc114103300 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc11a800640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114108950 0x7fc1140756b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc119400640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc114103300 0x7fc114075170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc10402a940 tx=0x7fc104003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc10ea00640 1 -- 172.21.15.110:0/2402683984 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10403f070 con 0x7fc114103300 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc10ea00640 1 -- 172.21.15.110:0/2402683984 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc104031b60 con 0x7fc114103300 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc10ea00640 1 -- 172.21.15.110:0/2402683984 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104035030 con 0x7fc114103300 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc11c800640 1 -- 172.21.15.110:0/2402683984 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1141a7850 con 0x7fc114103300 2024-04-26T11:38:08.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.003+0000 7fc11c800640 1 -- 172.21.15.110:0/2402683984 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1141a7d60 con 0x7fc114103300 2024-04-26T11:38:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.006+0000 7fc10ea00640 1 -- 172.21.15.110:0/2402683984 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc104042070 con 0x7fc114103300 2024-04-26T11:38:08.009 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.008+0000 7fc10ea00640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc0fc0a3e40 0x7fc0fc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.010 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.008+0000 7fc11f5b3740 1 Processor -- start 2024-04-26T11:38:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.008+0000 7fc11f5b3740 1 -- start start 2024-04-26T11:38:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.008+0000 7fc10ea00640 1 -- 172.21.15.110:0/2402683984 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9075+0+0 (secure 0 0 0) 0x7fc1040f0ea0 con 0x7fc114103300 2024-04-26T11:38:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.008+0000 7fc119e00640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc0fc0a3e40 0x7fc0fc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.008+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a13d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.008+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a13d610 0x55bc6a150280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.008+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a1507c0 0x55bc6a152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bc6a0a2380 con 0x55bc6a13d610 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bc6a03ec30 con 0x55bc6a13ccf0 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bc6a09e340 con 0x55bc6a1507c0 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a13d610 0x55bc6a150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a13d610 0x55bc6a150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51052/0 (socket says 172.21.15.110:51052) 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119400640 1 -- 172.21.15.110:0/918404021 learned_addr learned my addr 172.21.15.110:0/918404021 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc11a800640 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a1507c0 0x55bc6a152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119e00640 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a13d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119e00640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc0fc0a3e40 0x7fc0fc0a6300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc108009ba0 tx=0x7fc108005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119400640 1 -- 172.21.15.110:0/918404021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a1507c0 msgr2=0x55bc6a152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119400640 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a1507c0 0x55bc6a152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119400640 1 -- 172.21.15.110:0/918404021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 msgr2=0x55bc6a13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:08.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119400640 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a13d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119400640 1 -- 172.21.15.110:0/918404021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc6a060940 con 0x55bc6a13d610 2024-04-26T11:38:08.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc11a800640 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a1507c0 0x55bc6a152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:38:08.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.009+0000 7fc119e00640 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a13d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:38:08.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.010+0000 7fc119400640 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a13d610 0x55bc6a150280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc1040c52f0 tx=0x7fc1040bc5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105baf6d2545cef0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:08.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.010+0000 7fc103000640 1 -- 172.21.15.110:0/918404021 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104049070 con 0x55bc6a13d610 2024-04-26T11:38:08.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.010+0000 7fc103000640 1 -- 172.21.15.110:0/918404021 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1040c5820 con 0x55bc6a13d610 2024-04-26T11:38:08.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.010+0000 7fc103000640 1 -- 172.21.15.110:0/918404021 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1040b92d0 con 0x55bc6a13d610 2024-04-26T11:38:08.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.011+0000 7fc11f5b3740 1 -- 172.21.15.110:0/918404021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a13d610 msgr2=0x55bc6a150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.011+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a13d610 0x55bc6a150280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc1040c52f0 tx=0x7fc1040bc5c0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.011+0000 7fc11f5b3740 1 -- 172.21.15.110:0/918404021 shutdown_connections 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.011+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a1507c0 0x55bc6a152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.011+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a13d610 0x55bc6a150280 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.011+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/918404021 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a13d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.011+0000 7fc11f5b3740 1 -- 172.21.15.110:0/918404021 >> 172.21.15.110:0/918404021 conn(0x55bc6a1392e0 msgr2=0x55bc6a1396c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.011+0000 7fc11f5b3740 1 -- 172.21.15.110:0/918404021 shutdown_connections 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.011+0000 7fc11f5b3740 1 -- 172.21.15.110:0/918404021 wait complete. 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.012+0000 7fc11f5b3740 1 -- start start 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.012+0000 7fc11f5b3740 1 Processor -- start 2024-04-26T11:38:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.012+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13ccf0 0x55bc6a14d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.012+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13d610 0x55bc6a14dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.012+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a14e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.012+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bc6a0a2380 con 0x55bc6a1507c0 2024-04-26T11:38:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.012+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bc6a029c60 con 0x55bc6a13d610 2024-04-26T11:38:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.012+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bc6a1531b0 con 0x55bc6a13ccf0 2024-04-26T11:38:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc11f5b3740 10 client.0 _ll_register_callbacks cb 0x55bc6a055e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:38:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13ccf0 0x55bc6a14d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc11a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a14e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13d610 0x55bc6a14dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13ccf0 0x55bc6a14d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:37986/0 (socket says 172.21.15.110:37986) 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13d610 0x55bc6a14dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:46780/0 (socket says 172.21.15.110:46780) 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc11a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a14e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51066/0 (socket says 172.21.15.110:51066) 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119e00640 1 -- 172.21.15.110:0/3515142640 learned_addr learned my addr 172.21.15.110:0/3515142640 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119400640 1 -- 172.21.15.110:0/3515142640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13ccf0 msgr2=0x55bc6a14d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119400640 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13ccf0 0x55bc6a14d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119400640 1 -- 172.21.15.110:0/3515142640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 msgr2=0x55bc6a14e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119400640 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a14e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119400640 1 -- 172.21.15.110:0/3515142640 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc6a038510 con 0x55bc6a13d610 2024-04-26T11:38:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc11a800640 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a14e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:38:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc119400640 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13d610 0x55bc6a14dcf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc104009900 tx=0x7fc1040bc6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=352a3b2c7a7d9a32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc0f7400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:38:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.013+0000 7fc0f7400640 1 -- 172.21.15.110:0/3515142640 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1040d5020 con 0x55bc6a13d610 2024-04-26T11:38:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc0f7400640 1 -- 172.21.15.110:0/3515142640 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9075+0+0 (secure 0 0 0) 0x7fc1040b92d0 con 0x55bc6a13d610 2024-04-26T11:38:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc11f5b3740 1 -- 172.21.15.110:0/3515142640 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1040c5820 con 0x55bc6a13d610 2024-04-26T11:38:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc0f7400640 1 -- 172.21.15.110:0/3515142640 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fc104049050 con 0x55bc6a13d610 2024-04-26T11:38:08.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc11f5b3740 10 client.25904 fetch_fsmap learned FSMap version 65 2024-04-26T11:38:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc11f5b3740 1 -- 172.21.15.110:0/3515142640 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55bc69db4210 con 0x55bc6a13d610 2024-04-26T11:38:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc0f7400640 1 -- 172.21.15.110:0/3515142640 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1040c5820 con 0x55bc6a13d610 2024-04-26T11:38:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc0f7400640 1 -- 172.21.15.110:0/3515142640 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 65) ==== 8346+0+0 (secure 0 0 0) 0x7fc1040bc0b0 con 0x55bc6a13d610 2024-04-26T11:38:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc11f5b3740 10 client.25904 fetch_fsmap finished waiting for FSMap version 65 2024-04-26T11:38:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc11f5b3740 10 client.25904 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:38:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc11f5b3740 20 client.25904 populate_metadata read hostname 'smithi110' 2024-04-26T11:38:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55bc6a160030 0x55bc6a162420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc11f5b3740 4 client.25904 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:38:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.014+0000 7fc11f5b3740 1 -- 172.21.15.110:0/3515142640 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc6a0aff90 con 0x55bc6a160030 2024-04-26T11:38:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.015+0000 7fc119e00640 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55bc6a160030 0x55bc6a162420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.015+0000 7fc119e00640 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55bc6a160030 0x55bc6a162420 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bb0afbe6b01a69f server_cookie=c1f131707c083372 in_seq=0 out_seq=0 2024-04-26T11:38:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.015+0000 7fc0f7400640 10 client.25904 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc0f7400640 1 -- 172.21.15.110:0/3515142640 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bc6a0aff90 con 0x55bc6a160030 2024-04-26T11:38:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc0f7400640 10 client.25904 handle_command_reply: tid=0 2024-04-26T11:38:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 client.25904 shutdown 2024-04-26T11:38:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 -- 172.21.15.110:0/3515142640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13d610 msgr2=0x55bc6a14dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13d610 0x55bc6a14dcf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc104009900 tx=0x7fc1040bc6f0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 -- 172.21.15.110:0/3515142640 shutdown_connections 2024-04-26T11:38:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a14e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13d610 0x55bc6a14dcf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55bc6a160030 0x55bc6a162420 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/3515142640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13ccf0 0x55bc6a14d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc0f7400640 0 client.25904 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 -- 172.21.15.110:0/3515142640 >> 172.21.15.110:0/3515142640 conn(0x55bc6a1392e0 msgr2=0x55bc6a13f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 -- 172.21.15.110:0/3515142640 shutdown_connections 2024-04-26T11:38:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 1 -- 172.21.15.110:0/3515142640 wait complete. 2024-04-26T11:38:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.016+0000 7fc11f5b3740 20 client.25904 trim_cache size 0 max 16384 2024-04-26T11:38:08.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.038+0000 7fc11f5b3740 1 Processor -- start 2024-04-26T11:38:08.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.038+0000 7fc11f5b3740 1 -- start start 2024-04-26T11:38:08.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.038+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.038+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13d610 0x55bc6a14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.038+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a167a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.039+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141af250 con 0x55bc6a1507c0 2024-04-26T11:38:08.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.039+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141acaf0 con 0x55bc6a13ccf0 2024-04-26T11:38:08.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.039+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141aa960 con 0x55bc6a13d610 2024-04-26T11:38:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.039+0000 7fc11a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.040+0000 7fc119400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13d610 0x55bc6a14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.040+0000 7fc119e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.040+0000 7fc119e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a15bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:46794/0 (socket says 172.21.15.110:46794) 2024-04-26T11:38:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.040+0000 7fc119e00640 1 -- 172.21.15.110:0/2080942877 learned_addr learned my addr 172.21.15.110:0/2080942877 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.041+0000 7fc119e00640 1 -- 172.21.15.110:0/2080942877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13d610 msgr2=0x55bc6a14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.041+0000 7fc119e00640 1 --2- 172.21.15.110:0/2080942877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13d610 0x55bc6a14f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.041+0000 7fc119e00640 1 -- 172.21.15.110:0/2080942877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 msgr2=0x55bc6a167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.041+0000 7fc119e00640 1 --2- 172.21.15.110:0/2080942877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a167a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.041+0000 7fc119e00640 1 -- 172.21.15.110:0/2080942877 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc69e80620 con 0x55bc6a13ccf0 2024-04-26T11:38:08.044 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.042+0000 7fc119e00640 1 --2- 172.21.15.110:0/2080942877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a15bef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc10801c590 tx=0x7fc10801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222358d974af600a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.045+0000 7fc102600640 1 -- 172.21.15.110:0/2080942877 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10801cc90 con 0x55bc6a13ccf0 2024-04-26T11:38:08.049 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.045+0000 7fc102600640 1 -- 172.21.15.110:0/2080942877 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc10801ce30 con 0x55bc6a13ccf0 2024-04-26T11:38:08.049 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.047+0000 7fc102600640 1 -- 172.21.15.110:0/2080942877 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108004c10 con 0x55bc6a13ccf0 2024-04-26T11:38:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.048+0000 7fc11f5b3740 1 -- 172.21.15.110:0/2080942877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 msgr2=0x55bc6a15bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.048+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/2080942877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a15bef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc10801c590 tx=0x7fc10801c000 comp rx=0 tx=0).stop 2024-04-26T11:38:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.049+0000 7fc11f5b3740 1 -- 172.21.15.110:0/2080942877 shutdown_connections 2024-04-26T11:38:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.049+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/2080942877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.049+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/2080942877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13d610 0x55bc6a14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.049+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/2080942877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a15bef0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.049+0000 7fc11f5b3740 1 -- 172.21.15.110:0/2080942877 >> 172.21.15.110:0/2080942877 conn(0x55bc6a1392e0 msgr2=0x55bc6a14eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.050+0000 7fc11f5b3740 1 -- 172.21.15.110:0/2080942877 shutdown_connections 2024-04-26T11:38:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.050+0000 7fc11f5b3740 1 -- 172.21.15.110:0/2080942877 wait complete. 2024-04-26T11:38:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.050+0000 7fc11f5b3740 1 -- start start 2024-04-26T11:38:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.050+0000 7fc11f5b3740 1 Processor -- start 2024-04-26T11:38:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13d610 0x55bc6a1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc11f5b3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141aafb0 con 0x55bc6a1507c0 2024-04-26T11:38:08.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141ac420 con 0x55bc6a13ccf0 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc11f5b3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc1141ab680 con 0x55bc6a13d610 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc11f5b3740 10 client.0 _ll_register_callbacks cb 0x7fc1080098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc119e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc119e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:46806/0 (socket says 172.21.15.110:46806) 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.052+0000 7fc119e00640 1 -- 172.21.15.110:0/1671232846 learned_addr learned my addr 172.21.15.110:0/1671232846 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.053+0000 7fc119e00640 1 -- 172.21.15.110:0/1671232846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13d610 msgr2=0x55bc6a1553d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.053+0000 7fc119e00640 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13d610 0x55bc6a1553d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.053+0000 7fc119e00640 1 -- 172.21.15.110:0/1671232846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 msgr2=0x55bc6a155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.053+0000 7fc119e00640 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.053+0000 7fc119e00640 1 -- 172.21.15.110:0/1671232846 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc6a05ccb0 con 0x55bc6a13ccf0 2024-04-26T11:38:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.054+0000 7fc119e00640 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a1585f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc108014040 tx=0x7fc108004820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79dc9dbd9e7f982b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.054+0000 7fc0f7400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:38:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.054+0000 7fc0f7400640 1 -- 172.21.15.110:0/1671232846 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10802c1e0 con 0x55bc6a13ccf0 2024-04-26T11:38:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.054+0000 7fc0f7400640 1 -- 172.21.15.110:0/1671232846 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9075+0+0 (secure 0 0 0) 0x7fc108022040 con 0x55bc6a13ccf0 2024-04-26T11:38:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.054+0000 7fc11f5b3740 1 -- 172.21.15.110:0/1671232846 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc10801ce30 con 0x55bc6a13ccf0 2024-04-26T11:38:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.054+0000 7fc0f7400640 1 -- 172.21.15.110:0/1671232846 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fc10802c380 con 0x55bc6a13ccf0 2024-04-26T11:38:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.054+0000 7fc11f5b3740 10 client.25910 fetch_fsmap learned FSMap version 65 2024-04-26T11:38:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.054+0000 7fc11f5b3740 1 -- 172.21.15.110:0/1671232846 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55bc6a1c6e60 con 0x55bc6a13ccf0 2024-04-26T11:38:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.055+0000 7fc0f7400640 1 -- 172.21.15.110:0/1671232846 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc10801ce30 con 0x55bc6a13ccf0 2024-04-26T11:38:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.055+0000 7fc0f7400640 1 -- 172.21.15.110:0/1671232846 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 65) ==== 8346+0+0 (secure 0 0 0) 0x7fc10801a040 con 0x55bc6a13ccf0 2024-04-26T11:38:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.055+0000 7fc11f5b3740 10 client.25910 fetch_fsmap finished waiting for FSMap version 65 2024-04-26T11:38:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.055+0000 7fc11f5b3740 10 client.25910 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:38:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.055+0000 7fc11f5b3740 20 client.25910 populate_metadata read hostname 'smithi110' 2024-04-26T11:38:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.055+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55bc6a1c7540 0x55bc6a1c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.055+0000 7fc11f5b3740 4 client.25910 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:38:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.055+0000 7fc11f5b3740 1 -- 172.21.15.110:0/1671232846 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc6a0a9e00 con 0x55bc6a1c7540 2024-04-26T11:38:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.056+0000 7fc119400640 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55bc6a1c7540 0x55bc6a1c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.056+0000 7fc119400640 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55bc6a1c7540 0x55bc6a1c99a0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5c82966f90f7b05 server_cookie=3037906adef734b0 in_seq=0 out_seq=0 2024-04-26T11:38:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:08.056+0000 7fc0f7400640 10 client.25910 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:08.068 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:07 smithi196 ceph-mon[32572]: pgmap v213: 97 pgs: 97 active+clean; 3.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 13 MiB/s wr, 559 op/s 2024-04-26T11:38:08.116 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:07 smithi110 ceph-mon[28069]: pgmap v213: 97 pgs: 97 active+clean; 3.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 13 MiB/s wr, 559 op/s 2024-04-26T11:38:08.329 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:08 smithi196 podman[68444]: 2024-04-26 11:38:08.069071041 +0000 UTC m=+1.160871367 container remove 07356c677b35b6a30b1cbf95a5da5b8e8b692c98d630fc2df5e90ce1b87dc6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T11:38:08.329 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:08 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:38:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:07 smithi193 ceph-mon[32782]: pgmap v213: 97 pgs: 97 active+clean; 3.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 13 MiB/s wr, 559 op/s 2024-04-26T11:38:08.755 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:08 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T11:38:09.771 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:09 smithi110 ceph-mon[28069]: pgmap v214: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 31 MiB/s wr, 1.88k op/s 2024-04-26T11:38:09.771 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:09 smithi110 ceph-mon[28069]: osdmap e100: 12 total, 12 up, 12 in 2024-04-26T11:38:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:09 smithi193 ceph-mon[32782]: pgmap v214: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 31 MiB/s wr, 1.88k op/s 2024-04-26T11:38:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:09 smithi193 ceph-mon[32782]: osdmap e100: 12 total, 12 up, 12 in 2024-04-26T11:38:09.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 355.0 s, 910.0 tps, lat 63.653 ms stddev 166.500 2024-04-26T11:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:09 smithi196 ceph-mon[32572]: pgmap v214: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 31 MiB/s wr, 1.88k op/s 2024-04-26T11:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:09 smithi196 ceph-mon[32572]: osdmap e100: 12 total, 12 up, 12 in 2024-04-26T11:38:10.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.307+0000 7f6672c00700 1 -- 172.21.15.110:0/843868488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f666c1094a0 msgr2=0x7f666c109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:10.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.307+0000 7f6672c00700 1 --2- 172.21.15.110:0/843868488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f666c1094a0 0x7f666c109880 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f665c0099c0 tx=0x7f665c009cd0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.307+0000 7f6672c00700 1 -- 172.21.15.110:0/843868488 shutdown_connections 2024-04-26T11:38:10.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.307+0000 7f6672c00700 1 --2- 172.21.15.110:0/843868488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f666c103e90 0x7f666c1102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.307+0000 7f6672c00700 1 --2- 172.21.15.110:0/843868488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f666c1094a0 0x7f666c109880 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.307+0000 7f6672c00700 1 --2- 172.21.15.110:0/843868488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f666c1034d0 0x7f666c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.307+0000 7f6672c00700 1 -- 172.21.15.110:0/843868488 >> 172.21.15.110:0/843868488 conn(0x7f666c07a4f0 msgr2=0x7f666c07a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.308+0000 7f6672c00700 1 -- 172.21.15.110:0/843868488 shutdown_connections 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.308+0000 7f6672c00700 1 -- 172.21.15.110:0/843868488 wait complete. 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f6672c00700 1 Processor -- start 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f6672c00700 1 -- start start 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f6672c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f666c1034d0 0x7f666c075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f6672c00700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f666c103e90 0x7f666c075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f6672c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f666c1094a0 0x7f666c0761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f6672c00700 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f666c113600 con 0x7f666c1094a0 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f6672c00700 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f666c113480 con 0x7f666c103e90 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f6672c00700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f666c113780 con 0x7f666c1034d0 2024-04-26T11:38:10.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f6670c00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f666c1094a0 0x7f666c0761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.309+0000 7f666be00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f666c1034d0 0x7f666c075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f666be00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f666c1034d0 0x7f666c075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:38026/0 (socket says 172.21.15.110:38026) 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f666be00700 1 -- 172.21.15.110:0/2693513347 learned_addr learned my addr 172.21.15.110:0/2693513347 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f666b400700 1 --2- 172.21.15.110:0/2693513347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f666c103e90 0x7f666c075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f666be00700 1 -- 172.21.15.110:0/2693513347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f666c103e90 msgr2=0x7f666c075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f666be00700 1 --2- 172.21.15.110:0/2693513347 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f666c103e90 0x7f666c075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f666be00700 1 -- 172.21.15.110:0/2693513347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f666c1094a0 msgr2=0x7f666c0761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f666be00700 1 --2- 172.21.15.110:0/2693513347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f666c1094a0 0x7f666c0761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f666be00700 1 -- 172.21.15.110:0/2693513347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c1a7fa0 con 0x7f666c1034d0 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f666be00700 1 --2- 172.21.15.110:0/2693513347 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f666c1034d0 0x7f666c075720 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f665c006010 tx=0x7f665c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f6668c00700 1 -- 172.21.15.110:0/2693513347 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c026070 con 0x7f666c1034d0 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f6668c00700 1 -- 172.21.15.110:0/2693513347 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f665c00f460 con 0x7f666c1034d0 2024-04-26T11:38:10.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.310+0000 7f6672c00700 1 -- 172.21.15.110:0/2693513347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666c1a8230 con 0x7f666c1034d0 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.311+0000 7f6668c00700 1 -- 172.21.15.110:0/2693513347 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c009e60 con 0x7f666c1034d0 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.311+0000 7f6672c00700 1 -- 172.21.15.110:0/2693513347 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666c1a8680 con 0x7f666c1034d0 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.313+0000 7f6668c00700 1 -- 172.21.15.110:0/2693513347 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f665c029070 con 0x7f666c1034d0 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.315+0000 7f6668c00700 1 --2- 172.21.15.110:0/2693513347 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f66500a3e50 0x7f66500a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.315+0000 7f6668c00700 1 -- 172.21.15.110:0/2693513347 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9031+0+0 (secure 0 0 0) 0x7f665c0d1240 con 0x7f666c1034d0 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.315+0000 7f667d4cdb80 1 Processor -- start 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.315+0000 7f666b400700 1 --2- 172.21.15.110:0/2693513347 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f66500a3e50 0x7f66500a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.315+0000 7f667d4cdb80 1 -- start start 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9affc40 0x55a7b9b00020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9af9f70 0x55a7b9afa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 0x55a7b9b06990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a7b9a4ca20 con 0x55a7b9affc40 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a7b99eb340 con 0x55a7b9af9f70 2024-04-26T11:38:10.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a7b9a489e0 con 0x55a7b9afa910 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f666b400700 1 --2- 172.21.15.110:0/2693513347 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f66500a3e50 0x7f66500a6310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f666c07aaf0 tx=0x7f6658009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f666be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9affc40 0x55a7b9b00020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f6670c00700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 0x55a7b9b06990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f666be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9affc40 0x55a7b9b00020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51100/0 (socket says 172.21.15.110:51100) 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f666be00700 1 -- 172.21.15.110:0/2450058528 learned_addr learned my addr 172.21.15.110:0/2450058528 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f666b400700 1 --2- 172.21.15.110:0/2450058528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9af9f70 0x55a7b9afa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f6670c00700 1 -- 172.21.15.110:0/2450058528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9af9f70 msgr2=0x55a7b9afa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f6670c00700 1 --2- 172.21.15.110:0/2450058528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9af9f70 0x55a7b9afa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f6670c00700 1 -- 172.21.15.110:0/2450058528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9affc40 msgr2=0x55a7b9b00020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f6670c00700 1 --2- 172.21.15.110:0/2450058528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9affc40 0x55a7b9b00020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f6670c00700 1 -- 172.21.15.110:0/2450058528 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b99f37c0 con 0x55a7b9afa910 2024-04-26T11:38:10.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.316+0000 7f6670c00700 1 --2- 172.21.15.110:0/2450058528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 0x55a7b9b06990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6664003e30 tx=0x7f6664009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5621dc17b96b45e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.317+0000 7f6661600700 1 -- 172.21.15.110:0/2450058528 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664004bb0 con 0x55a7b9afa910 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.317+0000 7f6661600700 1 -- 172.21.15.110:0/2450058528 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6664004820 con 0x55a7b9afa910 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.317+0000 7f6661600700 1 -- 172.21.15.110:0/2450058528 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664007d60 con 0x55a7b9afa910 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.317+0000 7f667d4cdb80 1 -- 172.21.15.110:0/2450058528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 msgr2=0x55a7b9b06990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.317+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/2450058528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 0x55a7b9b06990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6664003e30 tx=0x7f6664009c20 comp rx=0 tx=0).stop 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.318+0000 7f667d4cdb80 1 -- 172.21.15.110:0/2450058528 shutdown_connections 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.318+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/2450058528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 0x55a7b9b06990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.318+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/2450058528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9affc40 0x55a7b9b00020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.318+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/2450058528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9af9f70 0x55a7b9afa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.318+0000 7f667d4cdb80 1 -- 172.21.15.110:0/2450058528 >> 172.21.15.110:0/2450058528 conn(0x55a7b9a27480 msgr2=0x55a7b9af4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.318+0000 7f667d4cdb80 1 -- 172.21.15.110:0/2450058528 shutdown_connections 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.318+0000 7f667d4cdb80 1 -- 172.21.15.110:0/2450058528 wait complete. 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.318+0000 7f667d4cdb80 1 -- start start 2024-04-26T11:38:10.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.318+0000 7f667d4cdb80 1 Processor -- start 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 0x55a7b9b037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9affc40 0x55a7b9b03cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a7b9b06ed0 con 0x55a7b9af9f70 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a7b99e7590 con 0x55a7b9affc40 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a7b9b07050 con 0x55a7b9afa910 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f667d4cdb80 10 client.0 _ll_register_callbacks cb 0x55a7b99e0510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f666be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f666be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51104/0 (socket says 172.21.15.110:51104) 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f666be00700 1 -- 172.21.15.110:0/909905033 learned_addr learned my addr 172.21.15.110:0/909905033 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f6670c00700 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9affc40 0x55a7b9b03cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f666b400700 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 0x55a7b9b037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f666be00700 1 -- 172.21.15.110:0/909905033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 msgr2=0x55a7b9b037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:10.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f666be00700 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 0x55a7b9b037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f666be00700 1 -- 172.21.15.110:0/909905033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9affc40 msgr2=0x55a7b9b03cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.319+0000 7f666be00700 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9affc40 0x55a7b9b03cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.320+0000 7f666be00700 1 -- 172.21.15.110:0/909905033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7b9999a60 con 0x55a7b9af9f70 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.320+0000 7f666be00700 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b064b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f665c099470 tx=0x7f665c09cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828d63f4170b6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.320+0000 7f6656000700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.320+0000 7f6656000700 1 -- 172.21.15.110:0/909905033 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c0b5020 con 0x55a7b9af9f70 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.320+0000 7f6656000700 1 -- 172.21.15.110:0/909905033 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9031+0+0 (secure 0 0 0) 0x7f665c09d270 con 0x55a7b9af9f70 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.320+0000 7f667d4cdb80 1 -- 172.21.15.110:0/909905033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6664004820 con 0x55a7b9af9f70 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.320+0000 7f6656000700 1 -- 172.21.15.110:0/909905033 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f665c09d710 con 0x55a7b9af9f70 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.320+0000 7f667d4cdb80 10 client.15738 fetch_fsmap learned FSMap version 65 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.320+0000 7f667d4cdb80 1 -- 172.21.15.110:0/909905033 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55a7b9b115b0 con 0x55a7b9af9f70 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.321+0000 7f6656000700 1 -- 172.21.15.110:0/909905033 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6664004820 con 0x55a7b9af9f70 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.321+0000 7f6656000700 1 -- 172.21.15.110:0/909905033 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 65) ==== 8346+0+0 (secure 0 0 0) 0x7f665c0a5760 con 0x55a7b9af9f70 2024-04-26T11:38:10.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.321+0000 7f667d4cdb80 10 client.15738 fetch_fsmap finished waiting for FSMap version 65 2024-04-26T11:38:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.321+0000 7f667d4cdb80 10 client.15738 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:38:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.321+0000 7f667d4cdb80 20 client.15738 populate_metadata read hostname 'smithi110' 2024-04-26T11:38:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.321+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a7b9b13bb0 0x55a7b9b15fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.321+0000 7f667d4cdb80 4 client.15738 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:38:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.321+0000 7f667d4cdb80 1 -- 172.21.15.110:0/909905033 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7b9a5a400 con 0x55a7b9b13bb0 2024-04-26T11:38:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.321+0000 7f666b400700 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a7b9b13bb0 0x55a7b9b15fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.322+0000 7f666b400700 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a7b9b13bb0 0x55a7b9b15fd0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=321037f5c553c5c3 server_cookie=b778195ffdb63f22 in_seq=0 out_seq=0 2024-04-26T11:38:10.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:10.322+0000 7f6656000700 10 client.15738 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:11 smithi193 ceph-mon[32782]: pgmap v216: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 37 MiB/s wr, 2.25k op/s 2024-04-26T11:38:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:11 smithi196 ceph-mon[32572]: pgmap v216: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 37 MiB/s wr, 2.25k op/s 2024-04-26T11:38:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:11 smithi110 ceph-mon[28069]: pgmap v216: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 37 MiB/s wr, 2.25k op/s 2024-04-26T11:38:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:13 smithi193 ceph-mon[32782]: pgmap v217: 97 pgs: 97 active+clean; 3.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 27 MiB/s wr, 1.78k op/s 2024-04-26T11:38:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:13 smithi196 ceph-mon[32572]: pgmap v217: 97 pgs: 97 active+clean; 3.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 27 MiB/s wr, 1.78k op/s 2024-04-26T11:38:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:13 smithi110 ceph-mon[28069]: pgmap v217: 97 pgs: 97 active+clean; 3.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 27 MiB/s wr, 1.78k op/s 2024-04-26T11:38:14.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:38:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:15 smithi196 ceph-mon[32572]: pgmap v218: 97 pgs: 97 active+clean; 3.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 1.65k op/s 2024-04-26T11:38:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:15 smithi110 ceph-mon[28069]: pgmap v218: 97 pgs: 97 active+clean; 3.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 1.65k op/s 2024-04-26T11:38:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:15 smithi193 ceph-mon[32782]: pgmap v218: 97 pgs: 97 active+clean; 3.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 1.65k op/s 2024-04-26T11:38:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:17 smithi196 ceph-mon[32572]: pgmap v219: 97 pgs: 97 active+clean; 3.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 1.65k op/s 2024-04-26T11:38:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:17 smithi110 ceph-mon[28069]: pgmap v219: 97 pgs: 97 active+clean; 3.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 1.65k op/s 2024-04-26T11:38:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:17 smithi193 ceph-mon[32782]: pgmap v219: 97 pgs: 97 active+clean; 3.4 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 1.65k op/s 2024-04-26T11:38:18.786 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:18 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:38:18.786 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:18 smithi196 systemd[1]: Stopped Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:38:18.786 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:18 smithi196 systemd[1]: Starting Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:38:18.786 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:18 smithi196 podman[68541]: 2024-04-26 11:38:18.638471609 +0000 UTC m=+0.017999671 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:38:19.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:18 smithi196 podman[68541]: 2024-04-26 11:38:18.786259614 +0000 UTC m=+0.165787641 container create 2cbc5e8008a020d6e94a892533f57d04351230d912c74f9ba0fd74dfb68237ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T11:38:19.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:19 smithi196 podman[68541]: 2024-04-26 11:38:19.022814799 +0000 UTC m=+0.402342839 container init 2cbc5e8008a020d6e94a892533f57d04351230d912c74f9ba0fd74dfb68237ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-04-26T11:38:19.054 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:19 smithi196 podman[68541]: 2024-04-26 11:38:19.02776539 +0000 UTC m=+0.407293427 container start 2cbc5e8008a020d6e94a892533f57d04351230d912c74f9ba0fd74dfb68237ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-26T11:38:19.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mds[68560]: -- 172.21.15.196:0/3488292514 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e246a0da40 con 0x55e2469e1000 2024-04-26T11:38:19.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: starting mds.i at 2024-04-26T11:38:19.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:19 smithi196 bash[68541]: 2cbc5e8008a020d6e94a892533f57d04351230d912c74f9ba0fd74dfb68237ab 2024-04-26T11:38:19.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:19 smithi196 systemd[1]: Started Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:38:19.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:38:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mon[32572]: pgmap v220: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 379 op/s 2024-04-26T11:38:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mon[32572]: daemon mds.i restarted 2024-04-26T11:38:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:38:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mon[32572]: osdmap e101: 12 total, 12 up, 12 in 2024-04-26T11:38:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:boot 2024-04-26T11:38:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mon[32572]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:38:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:38:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:38:20.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:19 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:19 smithi110 ceph-mon[28069]: pgmap v220: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 379 op/s 2024-04-26T11:38:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:19 smithi110 ceph-mon[28069]: daemon mds.i restarted 2024-04-26T11:38:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:19 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:38:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:19 smithi110 ceph-mon[28069]: osdmap e101: 12 total, 12 up, 12 in 2024-04-26T11:38:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:boot 2024-04-26T11:38:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:19 smithi110 ceph-mon[28069]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:38:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:38:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:38:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:19 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:19 smithi193 ceph-mon[32782]: pgmap v220: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 379 op/s 2024-04-26T11:38:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:19 smithi193 ceph-mon[32782]: daemon mds.i restarted 2024-04-26T11:38:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:19 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:38:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:19 smithi193 ceph-mon[32782]: osdmap e101: 12 total, 12 up, 12 in 2024-04-26T11:38:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:boot 2024-04-26T11:38:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:19 smithi193 ceph-mon[32782]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:38:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:38:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:38:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:19 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:21.922 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:21 smithi110 ceph-mon[28069]: pgmap v222: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 379 op/s 2024-04-26T11:38:21.923 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:21 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:resolve 2024-04-26T11:38:21.923 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:21 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:21 smithi196 ceph-mon[32572]: pgmap v222: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 379 op/s 2024-04-26T11:38:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:21 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:resolve 2024-04-26T11:38:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:21 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:21 smithi193 ceph-mon[32782]: pgmap v222: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 379 op/s 2024-04-26T11:38:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:21 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:resolve 2024-04-26T11:38:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:21 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:22.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.696+0000 7fc0f7400640 1 -- 172.21.15.110:0/1671232846 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc6a0a9e00 con 0x55bc6a1c7540 2024-04-26T11:38:22.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.696+0000 7fc0f7400640 10 client.25910 handle_command_reply: tid=0 2024-04-26T11:38:22.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.696+0000 7fc11f5b3740 1 client.25910 shutdown 2024-04-26T11:38:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 -- 172.21.15.110:0/1671232846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 msgr2=0x55bc6a1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a1585f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc108014040 tx=0x7fc108004820 comp rx=0 tx=0).stop 2024-04-26T11:38:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 -- 172.21.15.110:0/1671232846 shutdown_connections 2024-04-26T11:38:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bc6a1507c0 0x55bc6a155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55bc6a1c7540 0x55bc6a1c99a0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bc6a13d610 0x55bc6a1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 --2- 172.21.15.110:0/1671232846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bc6a13ccf0 0x55bc6a1585f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc0f7400640 0 client.25910 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:22.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 -- 172.21.15.110:0/1671232846 >> 172.21.15.110:0/1671232846 conn(0x55bc6a1392e0 msgr2=0x55bc6a14dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:22.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f6656000700 1 -- 172.21.15.110:0/909905033 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a7b9a5a400 con 0x55a7b9b13bb0 2024-04-26T11:38:22.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f6656000700 10 client.15738 handle_command_reply: tid=0 2024-04-26T11:38:22.700 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 -- 172.21.15.110:0/1671232846 shutdown_connections 2024-04-26T11:38:22.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f667d4cdb80 1 client.15738 shutdown 2024-04-26T11:38:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 1 -- 172.21.15.110:0/1671232846 wait complete. 2024-04-26T11:38:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.697+0000 7fc11f5b3740 20 client.25910 trim_cache size 0 max 16384 2024-04-26T11:38:22.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f667d4cdb80 1 -- 172.21.15.110:0/909905033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 msgr2=0x55a7b9b064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:22.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b064b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f665c099470 tx=0x7f665c09cb50 comp rx=0 tx=0).stop 2024-04-26T11:38:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:38:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:38:22.701 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:38:22.702 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:38:22.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f667d4cdb80 1 -- 172.21.15.110:0/909905033 shutdown_connections 2024-04-26T11:38:22.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a7b9b13bb0 0x55a7b9b15fd0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9affc40 0x55a7b9b03cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b064b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/909905033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9afa910 0x55a7b9b037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f6656000700 0 client.15738 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:22.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.697+0000 7f667d4cdb80 1 -- 172.21.15.110:0/909905033 >> 172.21.15.110:0/909905033 conn(0x55a7b9a27480 msgr2=0x55a7b9afef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:22.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.698+0000 7f667d4cdb80 1 -- 172.21.15.110:0/909905033 shutdown_connections 2024-04-26T11:38:22.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.698+0000 7f667d4cdb80 1 -- 172.21.15.110:0/909905033 wait complete. 2024-04-26T11:38:22.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.698+0000 7f667d4cdb80 20 client.15738 trim_cache size 0 max 16384 2024-04-26T11:38:22.703 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.698+0000 7fc11c800640 1 -- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc0fc0a3e40 msgr2=0x7fc0fc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.698+0000 7fc11c800640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc0fc0a3e40 0x7fc0fc0a6300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc108009ba0 tx=0x7fc108005f90 comp rx=0 tx=0).stop 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.698+0000 7fc11c800640 1 -- 172.21.15.110:0/2402683984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc114103300 msgr2=0x7fc114075170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.698+0000 7fc11c800640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc114103300 0x7fc114075170 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc10402a940 tx=0x7fc104003c10 comp rx=0 tx=0).stop 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.698+0000 7fc11c800640 1 -- 172.21.15.110:0/2402683984 shutdown_connections 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.698+0000 7fc11c800640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc0fc0a3e40 0x7fc0fc0a6300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.699+0000 7fc11c800640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc114108950 0x7fc1140756b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.699+0000 7fc11c800640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc114103300 0x7fc114075170 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.699+0000 7fc11c800640 1 --2- 172.21.15.110:0/2402683984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc114102940 0x7fc114074c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.699+0000 7fc11c800640 1 -- 172.21.15.110:0/2402683984 >> 172.21.15.110:0/2402683984 conn(0x7fc114079dc0 msgr2=0x7fc114100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.699+0000 7fc11c800640 1 -- 172.21.15.110:0/2402683984 shutdown_connections 2024-04-26T11:38:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:22.699+0000 7fc11c800640 1 -- 172.21.15.110:0/2402683984 wait complete. 2024-04-26T11:38:22.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f667d4cdb80 1 Processor -- start 2024-04-26T11:38:22.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f667d4cdb80 1 -- start start 2024-04-26T11:38:22.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9aef110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 0x55a7b9b0fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f666c1b2bf0 con 0x55a7b9af9f70 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f666c1b0450 con 0x55a7b9afa910 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f666c1ae2c0 con 0x55a7b9affc40 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f666b400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f666b400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afe0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:50124/0 (socket says 172.21.15.110:50124) 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f666b400700 1 -- 172.21.15.110:0/1870977995 learned_addr learned my addr 172.21.15.110:0/1870977995 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.721+0000 7f666be00700 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9aef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.722+0000 7f6670c00700 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 0x55a7b9b0fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:22.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.722+0000 7f666b400700 1 -- 172.21.15.110:0/1870977995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 msgr2=0x55a7b9b0fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:22.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.722+0000 7f666b400700 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 0x55a7b9b0fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.722+0000 7f666b400700 1 -- 172.21.15.110:0/1870977995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 msgr2=0x55a7b9aef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:22.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.722+0000 7f666b400700 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9aef110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.722+0000 7f666b400700 1 -- 172.21.15.110:0/1870977995 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7b9aef940 con 0x55a7b9afa910 2024-04-26T11:38:22.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.722+0000 7f6670c00700 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 0x55a7b9b0fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:38:22.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.722+0000 7f666b400700 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afe0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f66580097a0 tx=0x7f6658014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb144984157f2cf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:22.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.722+0000 7f6660c00700 1 -- 172.21.15.110:0/1870977995 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665802f070 con 0x55a7b9afa910 2024-04-26T11:38:22.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.723+0000 7f6660c00700 1 -- 172.21.15.110:0/1870977995 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6658029870 con 0x55a7b9afa910 2024-04-26T11:38:22.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.723+0000 7f6660c00700 1 -- 172.21.15.110:0/1870977995 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665801e420 con 0x55a7b9afa910 2024-04-26T11:38:22.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.723+0000 7f667d4cdb80 1 -- 172.21.15.110:0/1870977995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 msgr2=0x55a7b9afe0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.723+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afe0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f66580097a0 tx=0x7f6658014000 comp rx=0 tx=0).stop 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.723+0000 7f667d4cdb80 1 -- 172.21.15.110:0/1870977995 shutdown_connections 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.723+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 0x55a7b9b0fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.723+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9aef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.723+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/1870977995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afe0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.723+0000 7f667d4cdb80 1 -- 172.21.15.110:0/1870977995 >> 172.21.15.110:0/1870977995 conn(0x55a7b9a27480 msgr2=0x55a7b9af8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.724+0000 7f667d4cdb80 1 -- 172.21.15.110:0/1870977995 shutdown_connections 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.724+0000 7f667d4cdb80 1 -- 172.21.15.110:0/1870977995 wait complete. 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.724+0000 7f667d4cdb80 1 -- start start 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f667d4cdb80 1 Processor -- start 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b0c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:22.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f667d4cdb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 0x55a7b9afba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f666c1ae910 con 0x55a7b9af9f70 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f666c1afd80 con 0x55a7b9afa910 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f667d4cdb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f666c1aefe0 con 0x55a7b9affc40 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f667d4cdb80 10 client.0 _ll_register_callbacks cb 0x55a7b99e0510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f666be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b0c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f666b400700 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f666be00700 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b0c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55172/0 (socket says 172.21.15.110:55172) 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.725+0000 7f666be00700 1 -- 172.21.15.110:0/950379651 learned_addr learned my addr 172.21.15.110:0/950379651 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f6670c00700 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 0x55a7b9afba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f666be00700 1 -- 172.21.15.110:0/950379651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 msgr2=0x55a7b9afba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f666be00700 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 0x55a7b9afba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f666be00700 1 -- 172.21.15.110:0/950379651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 msgr2=0x55a7b9afb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f666be00700 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:22.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f666be00700 1 -- 172.21.15.110:0/950379651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7b9afc0f0 con 0x55a7b9af9f70 2024-04-26T11:38:22.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f666b400700 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:38:22.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f666be00700 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b0c4f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f665c0059d0 tx=0x7f665c061f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b16d6b2c47868a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:22.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f6656000700 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:38:22.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f6656000700 1 -- 172.21.15.110:0/950379651 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c07f020 con 0x55a7b9af9f70 2024-04-26T11:38:22.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f6656000700 1 -- 172.21.15.110:0/950379651 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9073+0+0 (secure 0 0 0) 0x7f665c0b6430 con 0x55a7b9af9f70 2024-04-26T11:38:22.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.726+0000 7f667d4cdb80 1 -- 172.21.15.110:0/950379651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6658029870 con 0x55a7b9af9f70 2024-04-26T11:38:22.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f6656000700 1 -- 172.21.15.110:0/950379651 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f665c0b5070 con 0x55a7b9af9f70 2024-04-26T11:38:22.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f667d4cdb80 10 client.15747 fetch_fsmap learned FSMap version 70 2024-04-26T11:38:22.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f667d4cdb80 1 -- 172.21.15.110:0/950379651 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x55a7b9afc0f0 con 0x55a7b9af9f70 2024-04-26T11:38:22.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f6656000700 1 -- 172.21.15.110:0/950379651 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6658029870 con 0x55a7b9af9f70 2024-04-26T11:38:22.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f6656000700 1 -- 172.21.15.110:0/950379651 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 70) ==== 8346+0+0 (secure 0 0 0) 0x7f665c0860c0 con 0x55a7b9af9f70 2024-04-26T11:38:22.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f667d4cdb80 10 client.15747 fetch_fsmap finished waiting for FSMap version 70 2024-04-26T11:38:22.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f667d4cdb80 10 client.15747 resolve_mds: validated gid 24518 aka daemon mds.b 2024-04-26T11:38:22.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f667d4cdb80 20 client.15747 populate_metadata read hostname 'smithi110' 2024-04-26T11:38:22.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a7b9b7b5b0 0x55a7b9b7d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:22.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f667d4cdb80 4 client.15747 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.8, "await_for": 42.0}] 2024-04-26T11:38:22.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.727+0000 7f667d4cdb80 1 -- 172.21.15.110:0/950379651 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.8, "await_for": 42.0}) -- 0x55a7b9a544a0 con 0x55a7b9b7b5b0 2024-04-26T11:38:22.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.728+0000 7f666b400700 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a7b9b7b5b0 0x55a7b9b7d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:22.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.728+0000 7f666b400700 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a7b9b7b5b0 0x55a7b9b7d9d0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10256d2cd1afe839 server_cookie=e2d0c9f067b3ea2a in_seq=0 out_seq=0 2024-04-26T11:38:22.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:22.728+0000 7f6656000700 10 client.15747 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:22 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:38:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:22 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:reconnect 2024-04-26T11:38:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:22 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:22 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0289994 2024-04-26T11:38:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:22 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:38:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:22 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:reconnect 2024-04-26T11:38:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:22 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:22 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0289994 2024-04-26T11:38:23.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.065+0000 7f6656000700 1 -- 172.21.15.110:0/950379651 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: -9 ) ==== 8+0+586 (crc 0 0 0) 0x55a7b9a544a0 con 0x55a7b9b7b5b0 2024-04-26T11:38:23.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.065+0000 7f6656000700 10 client.15747 handle_command_reply: tid=0 2024-04-26T11:38:23.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.065+0000 7f667d4cdb80 1 client.15747 shutdown 2024-04-26T11:38:23.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.066+0000 7f667d4cdb80 1 -- 172.21.15.110:0/950379651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 msgr2=0x55a7b9b0c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:23.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.066+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b0c4f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f665c0059d0 tx=0x7f665c061f90 comp rx=0 tx=0).stop 2024-04-26T11:38:23.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.066+0000 7f667d4cdb80 1 -- 172.21.15.110:0/950379651 shutdown_connections 2024-04-26T11:38:23.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.066+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55a7b9b7b5b0 0x55a7b9b7d9d0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:23.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.066+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a7b9affc40 0x55a7b9afba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:23.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.066+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a7b9af9f70 0x55a7b9b0c4f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:23.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.066+0000 7f667d4cdb80 1 --2- 172.21.15.110:0/950379651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7b9afa910 0x55a7b9afb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:23.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.066+0000 7f6656000700 0 client.15747 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:23.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.066+0000 7f667d4cdb80 1 -- 172.21.15.110:0/950379651 >> 172.21.15.110:0/950379651 conn(0x55a7b9a27480 msgr2=0x55a7b9af97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:23.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.067+0000 7f667d4cdb80 1 -- 172.21.15.110:0/950379651 shutdown_connections 2024-04-26T11:38:23.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.067+0000 7f667d4cdb80 1 -- 172.21.15.110:0/950379651 wait complete. 2024-04-26T11:38:23.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-04-26T11:38:23.067+0000 7f667d4cdb80 20 client.15747 trim_cache size 0 max 16384 2024-04-26T11:38:23.069 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-04-26T11:38:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 70, 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "leader": 24518, 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "set_version": 20, 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "sets": { 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "20d31edd": { 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "version": 20, 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "age_ref": 0.0, 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FAILED", 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "timeout": 60.0, 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "expiration": 88.8, 2024-04-26T11:38:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "members": { 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "file:/": { 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "excluded": false, 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "state": { 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FAILED", 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-04-26T11:38:23.071 INFO:teuthology.orchestra.run.smithi110.stderr:Error EBADF: 2024-04-26T11:38:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:22 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:38:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:22 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:reconnect 2024-04-26T11:38:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:22 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:22 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0289994 2024-04-26T11:38:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:23 smithi110 ceph-mon[28069]: pgmap v223: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 318 op/s 2024-04-26T11:38:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:rejoin 2024-04-26T11:38:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:23 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:23 smithi110 ceph-mon[28069]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:38:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:23 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:38:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:23 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:38:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:active 2024-04-26T11:38:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:23 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:23.966 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-04-26T11:38:23.968 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't quiesce root with rc: 9 (EBADF), stdout: { "epoch": 70, "leader": 24518, "set_version": 20, "sets": { "20d31edd": { "version": 20, "age_ref": 0.0, "state": { "name": "FAILED", "age": 0.0 }, "timeout": 60.0, "expiration": 88.8, "members": { "file:/": { "excluded": false, "state": { "name": "FAILED", "age": 0.0 } } } } } } 2024-04-26T11:38:23.968 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/quiescer.py", line 354, in _run self.do_quiesce(d) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/quiescer.py", line 310, in do_quiesce raise RuntimeError(f"Error quiescing set '{set_id}': {rcinfo(rc)}") RuntimeError: Error quiescing set '20d31edd': 9 (EBADF) 2024-04-26T11:38:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:23 smithi196 ceph-mon[32572]: pgmap v223: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 318 op/s 2024-04-26T11:38:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:rejoin 2024-04-26T11:38:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:23 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:23 smithi196 ceph-mon[32572]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:38:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:23 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:38:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:23 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:38:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:active 2024-04-26T11:38:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:23 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:23 smithi193 ceph-mon[32782]: pgmap v223: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 318 op/s 2024-04-26T11:38:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:rejoin 2024-04-26T11:38:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:23 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:23 smithi193 ceph-mon[32782]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:38:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:23 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:38:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:23 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:38:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/2654982126,v1:172.21.15.196:6835/2654982126] up:active 2024-04-26T11:38:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:23 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:24.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 370.0 s, 727.5 tps, lat 477.431 ms stddev 2691.434 2024-04-26T11:38:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:25 smithi196 ceph-mon[32572]: pgmap v224: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.1 MiB/s wr, 254 op/s 2024-04-26T11:38:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:25 smithi110 ceph-mon[28069]: pgmap v224: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.1 MiB/s wr, 254 op/s 2024-04-26T11:38:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:25 smithi193 ceph-mon[32782]: pgmap v224: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.1 MiB/s wr, 254 op/s 2024-04-26T11:38:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:27 smithi196 ceph-mon[32572]: pgmap v225: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.1 MiB/s wr, 254 op/s 2024-04-26T11:38:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:27 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:27 smithi110 ceph-mon[28069]: pgmap v225: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.1 MiB/s wr, 254 op/s 2024-04-26T11:38:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:27 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:27 smithi193 ceph-mon[32782]: pgmap v225: 97 pgs: 97 active+clean; 3.4 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.1 MiB/s wr, 254 op/s 2024-04-26T11:38:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:27 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:29.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7965be8700 time 2024-04-26T11:38:28.645526+0000 2024-04-26T11:38:29.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:29.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f79702113dd] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f79702115a3] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55619c7b6822] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55619c726598] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55619c728c17] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55619c621d0b] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55619c6222ac] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55619c60afad] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f79704a5e20] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 10: (DispatchQueue::entry()+0x51f) [0x7f79704a2fdf] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7970575fc1] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f796ef8f1ca] 2024-04-26T11:38:29.006 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 13: clone() 2024-04-26T11:38:29.007 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:28.645+0000 7f7965be8700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7965be8700 time 2024-04-26T11:38:28.645526+0000 2024-04-26T11:38:29.007 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:29.007 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:29.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f79702113dd] 2024-04-26T11:38:29.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f79702115a3] 2024-04-26T11:38:29.008 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55619c7b6822] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55619c726598] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55619c728c17] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55619c621d0b] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55619c6222ac] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55619c60afad] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f79704a5e20] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 10: (DispatchQueue::entry()+0x51f) [0x7f79704a2fdf] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7970575fc1] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f796ef8f1ca] 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 13: clone() 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: *** Caught signal (Aborted) ** 2024-04-26T11:38:29.009 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: in thread 7f7965be8700 thread_name:ms_dispatch 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f796ef99d20] 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2: gsignal() 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 3: abort() 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7970211437] 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f79702115a3] 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55619c7b6822] 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55619c726598] 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55619c728c17] 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55619c621d0b] 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55619c6222ac] 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55619c60afad] 2024-04-26T11:38:29.010 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f79704a5e20] 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 13: (DispatchQueue::entry()+0x51f) [0x7f79704a2fdf] 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7970575fc1] 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f796ef8f1ca] 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 16: clone() 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:28.647+0000 7f7965be8700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: in thread 7f7965be8700 thread_name:ms_dispatch 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f796ef99d20] 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2: gsignal() 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 3: abort() 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7970211437] 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f79702115a3] 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55619c7b6822] 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55619c726598] 2024-04-26T11:38:29.011 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55619c728c17] 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55619c621d0b] 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55619c6222ac] 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55619c60afad] 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f79704a5e20] 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 13: (DispatchQueue::entry()+0x51f) [0x7f79704a2fdf] 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7970575fc1] 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f796ef8f1ca] 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 16: clone() 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: -1> 2024-04-26T11:38:28.645+0000 7f7965be8700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7965be8700 time 2024-04-26T11:38:28.645526+0000 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.012 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f79702113dd] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f79702115a3] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55619c7b6822] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55619c726598] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55619c728c17] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55619c621d0b] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55619c6222ac] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55619c60afad] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f79704a5e20] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 10: (DispatchQueue::entry()+0x51f) [0x7f79704a2fdf] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7970575fc1] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f796ef8f1ca] 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 13: clone() 2024-04-26T11:38:29.013 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 0> 2024-04-26T11:38:28.647+0000 7f7965be8700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: in thread 7f7965be8700 thread_name:ms_dispatch 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f796ef99d20] 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2: gsignal() 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 3: abort() 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7970211437] 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f79702115a3] 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55619c7b6822] 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55619c726598] 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55619c728c17] 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55619c621d0b] 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55619c6222ac] 2024-04-26T11:38:29.014 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55619c60afad] 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f79704a5e20] 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 13: (DispatchQueue::entry()+0x51f) [0x7f79704a2fdf] 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7970575fc1] 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f796ef8f1ca] 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 16: clone() 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: -1> 2024-04-26T11:38:28.645+0000 7f7965be8700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7965be8700 time 2024-04-26T11:38:28.645526+0000 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f79702113dd] 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f79702115a3] 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55619c7b6822] 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55619c726598] 2024-04-26T11:38:29.015 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55619c728c17] 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55619c621d0b] 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55619c6222ac] 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55619c60afad] 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f79704a5e20] 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 10: (DispatchQueue::entry()+0x51f) [0x7f79704a2fdf] 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7970575fc1] 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f796ef8f1ca] 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 13: clone() 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 0> 2024-04-26T11:38:28.647+0000 7f7965be8700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: in thread 7f7965be8700 thread_name:ms_dispatch 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f796ef99d20] 2024-04-26T11:38:29.016 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2: gsignal() 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 3: abort() 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7970211437] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f79702115a3] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55619c7b6822] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55619c726598] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55619c728c17] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55619c621d0b] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55619c6222ac] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55619c60afad] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f79704a5e20] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 13: (DispatchQueue::entry()+0x51f) [0x7f79704a2fdf] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7970575fc1] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f796ef8f1ca] 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 16: clone() 2024-04-26T11:38:29.017 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:29.018 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68390]: 2024-04-26T11:38:29.018 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:28 smithi196 podman[68596]: 2024-04-26 11:38:28.737586068 +0000 UTC m=+0.027414621 container died 2a4e8517b9f713aba30f32de1749ae7acfb6fe754ce14f1fb310c9e8ab887343 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T11:38:29.710 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:29 smithi196 podman[68596]: 2024-04-26 11:38:29.436079519 +0000 UTC m=+0.725908049 container remove 2a4e8517b9f713aba30f32de1749ae7acfb6fe754ce14f1fb310c9e8ab887343 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-26T11:38:29.711 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:29 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:38:29.711 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:29 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T11:38:29.711 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:29 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.040s CPU time. 2024-04-26T11:38:29.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 375.0 s, 2702.9 tps, lat 30.636 ms stddev 35.369 2024-04-26T11:38:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:29 smithi196 ceph-mon[32572]: pgmap v226: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 9.1 MiB/s wr, 633 op/s 2024-04-26T11:38:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:29 smithi110 ceph-mon[28069]: pgmap v226: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 9.1 MiB/s wr, 633 op/s 2024-04-26T11:38:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:29 smithi193 ceph-mon[32782]: pgmap v226: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 9.1 MiB/s wr, 633 op/s 2024-04-26T11:38:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:31 smithi196 ceph-mon[32572]: pgmap v227: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 8.1 MiB/s wr, 564 op/s 2024-04-26T11:38:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:31 smithi110 ceph-mon[28069]: pgmap v227: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 8.1 MiB/s wr, 564 op/s 2024-04-26T11:38:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:31 smithi193 ceph-mon[32782]: pgmap v227: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 8.1 MiB/s wr, 564 op/s 2024-04-26T11:38:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:33 smithi196 ceph-mon[32572]: pgmap v228: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 8.5 MiB/s wr, 610 op/s 2024-04-26T11:38:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:33 smithi110 ceph-mon[28069]: pgmap v228: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 8.5 MiB/s wr, 610 op/s 2024-04-26T11:38:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:33 smithi193 ceph-mon[32782]: pgmap v228: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 8.5 MiB/s wr, 610 op/s 2024-04-26T11:38:34.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:38:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.842+0000 7fd426e00640 1 -- 172.21.15.110:0/2190477729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4201032d0 msgr2=0x7fd42010f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.842+0000 7fd426e00640 1 --2- 172.21.15.110:0/2190477729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4201032d0 0x7fd42010f7e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd418009ca0 tx=0x7fd41802a8c0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.842+0000 7fd426e00640 1 -- 172.21.15.110:0/2190477729 shutdown_connections 2024-04-26T11:38:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.842+0000 7fd426e00640 1 --2- 172.21.15.110:0/2190477729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4201032d0 0x7fd42010f7e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.842+0000 7fd426e00640 1 --2- 172.21.15.110:0/2190477729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd420102910 0x7fd420102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.842+0000 7fd426e00640 1 --2- 172.21.15.110:0/2190477729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd420108920 0x7fd420108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.842+0000 7fd426e00640 1 -- 172.21.15.110:0/2190477729 >> 172.21.15.110:0/2190477729 conn(0x7fd420079dc0 msgr2=0x7fd42007a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.842+0000 7fd426e00640 1 -- 172.21.15.110:0/2190477729 shutdown_connections 2024-04-26T11:38:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.842+0000 7fd426e00640 1 -- 172.21.15.110:0/2190477729 wait complete. 2024-04-26T11:38:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.843+0000 7fd426e00640 1 Processor -- start 2024-04-26T11:38:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.843+0000 7fd426e00640 1 -- start start 2024-04-26T11:38:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd426e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd420102910 0x7fd420199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd426e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4201032d0 0x7fd420199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd426e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd420108920 0x7fd42019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd426e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd420112c00 con 0x7fd4201032d0 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd426e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd420112a80 con 0x7fd420108920 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd426e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd420112d80 con 0x7fd420102910 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd41fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd420102910 0x7fd420199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd41f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4201032d0 0x7fd420199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd41fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd420102910 0x7fd420199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:48572/0 (socket says 172.21.15.110:48572) 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd41fe00640 1 -- 172.21.15.110:0/3443737363 learned_addr learned my addr 172.21.15.110:0/3443737363 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd424e00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd420108920 0x7fd42019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd41fe00640 1 -- 172.21.15.110:0/3443737363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd420108920 msgr2=0x7fd42019d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd41fe00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd420108920 0x7fd42019d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd41fe00640 1 -- 172.21.15.110:0/3443737363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4201032d0 msgr2=0x7fd420199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd41fe00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4201032d0 0x7fd420199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.844+0000 7fd41fe00640 1 -- 172.21.15.110:0/3443737363 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42019e010 con 0x7fd420102910 2024-04-26T11:38:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.845+0000 7fd41fe00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd420102910 0x7fd420199020 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd41000e9f0 tx=0x7fd41000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.845+0000 7fd41cc00640 1 -- 172.21.15.110:0/3443737363 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41000cd80 con 0x7fd420102910 2024-04-26T11:38:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.845+0000 7fd426e00640 1 -- 172.21.15.110:0/3443737363 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42019e300 con 0x7fd420102910 2024-04-26T11:38:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.845+0000 7fd41cc00640 1 -- 172.21.15.110:0/3443737363 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4100108e0 con 0x7fd420102910 2024-04-26T11:38:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.845+0000 7fd41cc00640 1 -- 172.21.15.110:0/3443737363 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410018980 con 0x7fd420102910 2024-04-26T11:38:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.845+0000 7fd426e00640 1 -- 172.21.15.110:0/3443737363 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4201a5b90 con 0x7fd420102910 2024-04-26T11:38:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.848+0000 7fd41cc00640 1 -- 172.21.15.110:0/3443737363 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fd410010430 con 0x7fd420102910 2024-04-26T11:38:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.848+0000 7fd429d73740 1 Processor -- start 2024-04-26T11:38:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.848+0000 7fd429d73740 1 -- start start 2024-04-26T11:38:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd429d73740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd429d73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc56f0 0x5562d8bcfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd429d73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bcffb0 0x5562d8bd23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd429d73740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5562d8b2a380 con 0x5562d8bc4dd0 2024-04-26T11:38:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd429d73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5562d8ac6c30 con 0x5562d8bcffb0 2024-04-26T11:38:35.852 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd429d73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5562d8b26340 con 0x5562d8bc56f0 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd424e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd424e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59354/0 (socket says 172.21.15.110:59354) 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd424e00640 1 -- 172.21.15.110:0/3102003682 learned_addr learned my addr 172.21.15.110:0/3102003682 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd41f400640 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bcffb0 0x5562d8bd23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.849+0000 7fd41fe00640 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc56f0 0x5562d8bcfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd424e00640 1 -- 172.21.15.110:0/3102003682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc56f0 msgr2=0x5562d8bcfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd424e00640 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc56f0 0x5562d8bcfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd424e00640 1 -- 172.21.15.110:0/3102003682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bcffb0 msgr2=0x5562d8bd23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd424e00640 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bcffb0 0x5562d8bd23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd424e00640 1 -- 172.21.15.110:0/3102003682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d8ae8940 con 0x5562d8bc4dd0 2024-04-26T11:38:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd41fe00640 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc56f0 0x5562d8bcfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd41cc00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd4040a3e40 0x7fd4040a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd424e00640 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc51b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd418009ca0 tx=0x7fd418005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31eed0b7a4122ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd41cc00640 1 -- 172.21.15.110:0/3443737363 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9073+0+0 (secure 0 0 0) 0x7fd4100d0c60 con 0x7fd420102910 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd41fe00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd4040a3e40 0x7fd4040a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd415600640 1 -- 172.21.15.110:0/3102003682 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418031ce0 con 0x5562d8bc4dd0 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd415600640 1 -- 172.21.15.110:0/3102003682 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd418036030 con 0x5562d8bc4dd0 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.850+0000 7fd415600640 1 -- 172.21.15.110:0/3102003682 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4180042a0 con 0x5562d8bc4dd0 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd429d73740 1 -- 172.21.15.110:0/3102003682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 msgr2=0x5562d8bc51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd41fe00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd4040a3e40 0x7fd4040a6300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5562d8bc6370 tx=0x7fd410000bc0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd429d73740 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc51b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd418009ca0 tx=0x7fd418005fa0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd429d73740 1 -- 172.21.15.110:0/3102003682 shutdown_connections 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd429d73740 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bcffb0 0x5562d8bd23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd429d73740 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc56f0 0x5562d8bcfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd429d73740 1 --2- 172.21.15.110:0/3102003682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc51b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd429d73740 1 -- 172.21.15.110:0/3102003682 >> 172.21.15.110:0/3102003682 conn(0x5562d8bc12e0 msgr2=0x5562d8bc16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd429d73740 1 -- 172.21.15.110:0/3102003682 shutdown_connections 2024-04-26T11:38:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.851+0000 7fd429d73740 1 -- 172.21.15.110:0/3102003682 wait complete. 2024-04-26T11:38:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.852+0000 7fd429d73740 1 -- start start 2024-04-26T11:38:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.852+0000 7fd429d73740 1 Processor -- start 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.852+0000 7fd429d73740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.852+0000 7fd429d73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bcd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.852+0000 7fd429d73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bcffb0 0x5562d8bcd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.852+0000 7fd429d73740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5562d8bd2a00 con 0x5562d8bc4dd0 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.852+0000 7fd429d73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5562d8ab1c60 con 0x5562d8bc56f0 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.852+0000 7fd429d73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5562d8bd2b80 con 0x5562d8bcffb0 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd429d73740 10 client.0 _ll_register_callbacks cb 0x5562d8adde50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd424e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd41f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bcd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd424e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59358/0 (socket says 172.21.15.110:59358) 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd424e00640 1 -- 172.21.15.110:0/3217154362 learned_addr learned my addr 172.21.15.110:0/3217154362 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd424e00640 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bcffb0 0x5562d8bcd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd424e00640 1 -- 172.21.15.110:0/3217154362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bcffb0 msgr2=0x5562d8bcd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd424e00640 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bcffb0 0x5562d8bcd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd424e00640 1 -- 172.21.15.110:0/3217154362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 msgr2=0x5562d8bcd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd424e00640 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bcd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd424e00640 1 -- 172.21.15.110:0/3217154362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d8ac0510 con 0x5562d8bc4dd0 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.853+0000 7fd41f400640 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bcd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.854+0000 7fd424e00640 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bccea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd418006010 tx=0x7fd418003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622a9cc7ae8d151b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.854+0000 7fd40a000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.854+0000 7fd40a000640 1 -- 172.21.15.110:0/3217154362 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418058060 con 0x5562d8bc4dd0 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.854+0000 7fd40a000640 1 -- 172.21.15.110:0/3217154362 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9073+0+0 (secure 0 0 0) 0x7fd418031860 con 0x5562d8bc4dd0 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.854+0000 7fd429d73740 1 -- 172.21.15.110:0/3217154362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd418036030 con 0x5562d8bc4dd0 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.854+0000 7fd40a000640 1 -- 172.21.15.110:0/3217154362 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fd41805f050 con 0x5562d8bc4dd0 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.854+0000 7fd429d73740 10 client.15759 fetch_fsmap learned FSMap version 72 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.854+0000 7fd429d73740 1 -- 172.21.15.110:0/3217154362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) -- 0x5562d883c210 con 0x5562d8bc4dd0 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.855+0000 7fd40a000640 1 -- 172.21.15.110:0/3217154362 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd418036030 con 0x5562d8bc4dd0 2024-04-26T11:38:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.855+0000 7fd40a000640 1 -- 172.21.15.110:0/3217154362 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 72) ==== 8346+0+0 (secure 0 0 0) 0x7fd418043070 con 0x5562d8bc4dd0 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.855+0000 7fd429d73740 10 client.15759 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.855+0000 7fd429d73740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.855+0000 7fd429d73740 20 client.15759 populate_metadata read hostname 'smithi110' 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.855+0000 7fd429d73740 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5562d8bdf970 0x5562d8be1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.855+0000 7fd429d73740 4 client.15759 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.855+0000 7fd429d73740 1 -- 172.21.15.110:0/3217154362 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562d8b37f90 con 0x5562d8bdf970 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.855+0000 7fd41f400640 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5562d8bdf970 0x5562d8be1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.856+0000 7fd41f400640 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5562d8bdf970 0x5562d8be1d60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb341e58289b90d5 server_cookie=a48cb357907453c5 in_seq=0 out_seq=0 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.856+0000 7fd40a000640 10 client.15759 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd40a000640 1 -- 172.21.15.110:0/3217154362 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5562d8b37f90 con 0x5562d8bdf970 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd40a000640 10 client.15759 handle_command_reply: tid=0 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 client.15759 shutdown 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 -- 172.21.15.110:0/3217154362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 msgr2=0x5562d8bccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bccea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd418006010 tx=0x7fd418003e50 comp rx=0 tx=0).stop 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 -- 172.21.15.110:0/3217154362 shutdown_connections 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5562d8bdf970 0x5562d8be1d60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bcffb0 0x5562d8bcd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bcd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 --2- 172.21.15.110:0/3217154362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bc4dd0 0x5562d8bccea0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd40a000640 0 client.15759 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 -- 172.21.15.110:0/3217154362 >> 172.21.15.110:0/3217154362 conn(0x5562d8bc12e0 msgr2=0x5562d8bc7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 -- 172.21.15.110:0/3217154362 shutdown_connections 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.857+0000 7fd429d73740 1 -- 172.21.15.110:0/3217154362 wait complete. 2024-04-26T11:38:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.858+0000 7fd429d73740 20 client.15759 trim_cache size 0 max 16384 2024-04-26T11:38:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.874+0000 7fd429d73740 1 Processor -- start 2024-04-26T11:38:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.874+0000 7fd429d73740 1 -- start start 2024-04-26T11:38:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.874+0000 7fd429d73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 0x5562d8bcf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.874+0000 7fd429d73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bdb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.874+0000 7fd429d73740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8be74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.874+0000 7fd429d73740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201b1230 con 0x5562d8bcffb0 2024-04-26T11:38:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.874+0000 7fd429d73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201aead0 con 0x5562d8bc56f0 2024-04-26T11:38:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.874+0000 7fd429d73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201ac920 con 0x5562d8bc4dd0 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.874+0000 7fd424e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8be74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd41f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bdb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd424e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8be74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59368/0 (socket says 172.21.15.110:59368) 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd41f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bdb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:53094/0 (socket says 172.21.15.110:53094) 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd424e00640 1 -- 172.21.15.110:0/3100058930 learned_addr learned my addr 172.21.15.110:0/3100058930 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd424e00640 1 --2- 172.21.15.110:0/3100058930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 0x5562d8bcf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd424e00640 1 -- 172.21.15.110:0/3100058930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 msgr2=0x5562d8bcf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd424e00640 1 --2- 172.21.15.110:0/3100058930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 0x5562d8bcf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd424e00640 1 -- 172.21.15.110:0/3100058930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 msgr2=0x5562d8bdb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd424e00640 1 --2- 172.21.15.110:0/3100058930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bdb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd424e00640 1 -- 172.21.15.110:0/3100058930 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d8908620 con 0x5562d8bcffb0 2024-04-26T11:38:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd41f400640 1 --2- 172.21.15.110:0/3100058930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bdb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:38:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.875+0000 7fd424e00640 1 --2- 172.21.15.110:0/3100058930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8be74f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd418004aa0 tx=0x7fd418047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365d41596f666b6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd414c00640 1 -- 172.21.15.110:0/3100058930 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418058070 con 0x5562d8bcffb0 2024-04-26T11:38:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd414c00640 1 -- 172.21.15.110:0/3100058930 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd418036030 con 0x5562d8bcffb0 2024-04-26T11:38:35.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd414c00640 1 -- 172.21.15.110:0/3100058930 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418031660 con 0x5562d8bcffb0 2024-04-26T11:38:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd429d73740 1 -- 172.21.15.110:0/3100058930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 msgr2=0x5562d8be74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd429d73740 1 --2- 172.21.15.110:0/3100058930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8be74f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd418004aa0 tx=0x7fd418047040 comp rx=0 tx=0).stop 2024-04-26T11:38:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd429d73740 1 -- 172.21.15.110:0/3100058930 shutdown_connections 2024-04-26T11:38:35.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd429d73740 1 --2- 172.21.15.110:0/3100058930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8be74f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd429d73740 1 --2- 172.21.15.110:0/3100058930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bdb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd429d73740 1 --2- 172.21.15.110:0/3100058930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 0x5562d8bcf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.876+0000 7fd429d73740 1 -- 172.21.15.110:0/3100058930 >> 172.21.15.110:0/3100058930 conn(0x5562d8bc12e0 msgr2=0x5562d8bc7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.877+0000 7fd429d73740 1 -- 172.21.15.110:0/3100058930 shutdown_connections 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.877+0000 7fd429d73740 1 -- 172.21.15.110:0/3100058930 wait complete. 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.877+0000 7fd429d73740 1 -- start start 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.877+0000 7fd429d73740 1 Processor -- start 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd429d73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd429d73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd429d73740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8bca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd429d73740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201acf90 con 0x5562d8bcffb0 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd429d73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201ae400 con 0x5562d8bc56f0 2024-04-26T11:38:35.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd429d73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd4201ad660 con 0x5562d8bc4dd0 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd429d73740 10 client.0 _ll_register_callbacks cb 0x7fd40c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd41f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd41f400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:53102/0 (socket says 172.21.15.110:53102) 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd41f400640 1 -- 172.21.15.110:0/2774892739 learned_addr learned my addr 172.21.15.110:0/2774892739 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd424e00640 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd424e00640 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8bca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd41f400640 1 -- 172.21.15.110:0/2774892739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 msgr2=0x5562d8bc9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd41f400640 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd41f400640 1 -- 172.21.15.110:0/2774892739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 msgr2=0x5562d8bca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd41f400640 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8bca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.878+0000 7fd41f400640 1 -- 172.21.15.110:0/2774892739 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d8ae4cb0 con 0x5562d8bc56f0 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.879+0000 7fd41f400640 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bca3b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x5562d8bc2700 tx=0x7fd40c012bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbbd7d24bbd2e976 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.879+0000 7fd40a000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:38:35.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.879+0000 7fd40a000640 1 -- 172.21.15.110:0/2774892739 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c004230 con 0x5562d8bc56f0 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.879+0000 7fd429d73740 1 -- 172.21.15.110:0/2774892739 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd418036030 con 0x5562d8bc56f0 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.879+0000 7fd40a000640 1 -- 172.21.15.110:0/2774892739 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9073+0+0 (secure 0 0 0) 0x7fd40c0043d0 con 0x5562d8bc56f0 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.879+0000 7fd40a000640 1 -- 172.21.15.110:0/2774892739 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fd40c031050 con 0x5562d8bc56f0 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.879+0000 7fd429d73740 10 client.25952 fetch_fsmap learned FSMap version 72 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.879+0000 7fd429d73740 1 -- 172.21.15.110:0/2774892739 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) -- 0x5562d8c4a650 con 0x5562d8bc56f0 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.880+0000 7fd40a000640 1 -- 172.21.15.110:0/2774892739 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd418036030 con 0x5562d8bc56f0 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.880+0000 7fd40a000640 1 -- 172.21.15.110:0/2774892739 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 72) ==== 8346+0+0 (secure 0 0 0) 0x7fd40c005380 con 0x5562d8bc56f0 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.880+0000 7fd429d73740 10 client.25952 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.880+0000 7fd429d73740 10 client.25952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.880+0000 7fd429d73740 20 client.25952 populate_metadata read hostname 'smithi110' 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.880+0000 7fd429d73740 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5562d8c4adb0 0x5562d8c4d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.880+0000 7fd429d73740 4 client.25952 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.880+0000 7fd429d73740 1 -- 172.21.15.110:0/2774892739 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5562d8b31e00 con 0x5562d8c4adb0 2024-04-26T11:38:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.880+0000 7fd424e00640 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5562d8c4adb0 0x5562d8c4d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.881+0000 7fd424e00640 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5562d8c4adb0 0x5562d8c4d1d0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb4cd58fd5822f1f server_cookie=683a8714140cbff in_seq=0 out_seq=0 2024-04-26T11:38:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:35.881+0000 7fd40a000640 10 client.25952 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:35 smithi196 ceph-mon[32572]: pgmap v229: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 9.8 MiB/s wr, 696 op/s 2024-04-26T11:38:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:35 smithi110 ceph-mon[28069]: pgmap v229: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 9.8 MiB/s wr, 696 op/s 2024-04-26T11:38:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:35 smithi193 ceph-mon[32782]: pgmap v229: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 9.8 MiB/s wr, 696 op/s 2024-04-26T11:38:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:38:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:38:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:38:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:37 smithi196 ceph-mon[32572]: pgmap v230: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 9.6 MiB/s wr, 671 op/s 2024-04-26T11:38:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:37 smithi110 ceph-mon[28069]: pgmap v230: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 9.6 MiB/s wr, 671 op/s 2024-04-26T11:38:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:37 smithi193 ceph-mon[32782]: pgmap v230: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 9.6 MiB/s wr, 671 op/s 2024-04-26T11:38:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:38:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:38:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:38:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:38:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:38:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:38:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:38:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:38:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:38:39.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:38:39.995 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:39 smithi196 ceph-mon[32572]: pgmap v231: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 9.9 MiB/s wr, 708 op/s 2024-04-26T11:38:39.995 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:39 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:38:39.995 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:39 smithi196 systemd[1]: Stopped Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:38:39.995 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:39 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.040s CPU time. 2024-04-26T11:38:39.995 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:39 smithi196 systemd[1]: Starting Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:38:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:39 smithi110 ceph-mon[28069]: pgmap v231: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 9.9 MiB/s wr, 708 op/s 2024-04-26T11:38:40.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:39 smithi193 ceph-mon[32782]: pgmap v231: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 9.9 MiB/s wr, 708 op/s 2024-04-26T11:38:40.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:39 smithi196 podman[68822]: 2024-04-26 11:38:39.897897546 +0000 UTC m=+0.018346264 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:38:40.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:40 smithi196 podman[68822]: 2024-04-26 11:38:40.012369192 +0000 UTC m=+0.132817904 container create 23463c538f678de847af600854a29a36b29f4ce2544c3bfc1adb3f53a2d609f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:38:40.513 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:40 smithi196 podman[68822]: 2024-04-26 11:38:40.324414074 +0000 UTC m=+0.444862786 container init 23463c538f678de847af600854a29a36b29f4ce2544c3bfc1adb3f53a2d609f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True) 2024-04-26T11:38:40.513 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:40 smithi196 podman[68822]: 2024-04-26 11:38:40.327332155 +0000 UTC m=+0.447780867 container start 23463c538f678de847af600854a29a36b29f4ce2544c3bfc1adb3f53a2d609f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T11:38:40.513 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-mds[68842]: -- 172.21.15.196:0/466516333 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56278bdb9a40 con 0x56278bd8c800 2024-04-26T11:38:40.513 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: starting mds.f at 2024-04-26T11:38:40.513 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:40 smithi196 bash[68822]: 23463c538f678de847af600854a29a36b29f4ce2544c3bfc1adb3f53a2d609f3 2024-04-26T11:38:40.513 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:38:40 smithi196 systemd[1]: Started Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:38:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-mon[32572]: daemon mds.f restarted 2024-04-26T11:38:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:38:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-mon[32572]: osdmap e102: 12 total, 12 up, 12 in 2024-04-26T11:38:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:boot 2024-04-26T11:38:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-mon[32572]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:38:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:38:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:38:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:40 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:40 smithi110 ceph-mon[28069]: daemon mds.f restarted 2024-04-26T11:38:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:40 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:38:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:40 smithi110 ceph-mon[28069]: osdmap e102: 12 total, 12 up, 12 in 2024-04-26T11:38:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:40 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:boot 2024-04-26T11:38:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:40 smithi110 ceph-mon[28069]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:38:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:40 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:38:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:38:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:40 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:40 smithi193 ceph-mon[32782]: daemon mds.f restarted 2024-04-26T11:38:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:40 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:38:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:40 smithi193 ceph-mon[32782]: osdmap e102: 12 total, 12 up, 12 in 2024-04-26T11:38:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:40 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:boot 2024-04-26T11:38:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:40 smithi193 ceph-mon[32782]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:38:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:40 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:38:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:38:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:40 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:41 smithi196 ceph-mon[32572]: pgmap v232: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.7 MiB/s wr, 225 op/s 2024-04-26T11:38:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:41 smithi110 ceph-mon[28069]: pgmap v232: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.7 MiB/s wr, 225 op/s 2024-04-26T11:38:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:41 smithi193 ceph-mon[32782]: pgmap v232: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.7 MiB/s wr, 225 op/s 2024-04-26T11:38:43.032 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:42 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:resolve 2024-04-26T11:38:43.032 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:42 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:42 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:resolve 2024-04-26T11:38:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:42 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:42 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:resolve 2024-04-26T11:38:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:42 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.807+0000 7fd40a000640 1 -- 172.21.15.110:0/2774892739 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5562d8b31e00 con 0x5562d8c4adb0 2024-04-26T11:38:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.807+0000 7fd40a000640 10 client.25952 handle_command_reply: tid=0 2024-04-26T11:38:43.808 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.807+0000 7fd429d73740 1 client.25952 shutdown 2024-04-26T11:38:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 -- 172.21.15.110:0/2774892739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 msgr2=0x5562d8bca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bca3b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x5562d8bc2700 tx=0x7fd40c012bd0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 -- 172.21.15.110:0/2774892739 shutdown_connections 2024-04-26T11:38:43.809 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5562d8bcffb0 0x5562d8bca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562d8bc56f0 0x5562d8bca3b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5562d8c4adb0 0x5562d8c4d1d0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 --2- 172.21.15.110:0/2774892739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5562d8bc4dd0 0x5562d8bc9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd40a000640 0 client.25952 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 -- 172.21.15.110:0/2774892739 >> 172.21.15.110:0/2774892739 conn(0x5562d8bc12e0 msgr2=0x5562d8bc6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 -- 172.21.15.110:0/2774892739 shutdown_connections 2024-04-26T11:38:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 1 -- 172.21.15.110:0/2774892739 wait complete. 2024-04-26T11:38:43.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.808+0000 7fd429d73740 20 client.25952 trim_cache size 0 max 16384 2024-04-26T11:38:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:38:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:38:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:38:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:38:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 -- 172.21.15.110:0/3443737363 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd4040a3e40 msgr2=0x7fd4040a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd4040a3e40 0x7fd4040a6300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5562d8bc6370 tx=0x7fd410000bc0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 -- 172.21.15.110:0/3443737363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd420102910 msgr2=0x7fd420199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd420102910 0x7fd420199020 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd41000e9f0 tx=0x7fd41000eeb0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 -- 172.21.15.110:0/3443737363 shutdown_connections 2024-04-26T11:38:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fd4040a3e40 0x7fd4040a6300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd420108920 0x7fd42019d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4201032d0 0x7fd420199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 --2- 172.21.15.110:0/3443737363 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd420102910 0x7fd420199020 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 -- 172.21.15.110:0/3443737363 >> 172.21.15.110:0/3443737363 conn(0x7fd420079dc0 msgr2=0x7fd4201000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 -- 172.21.15.110:0/3443737363 shutdown_connections 2024-04-26T11:38:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:43.810+0000 7fd426e00640 1 -- 172.21.15.110:0/3443737363 wait complete. 2024-04-26T11:38:44.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:43 smithi110 ceph-mon[28069]: pgmap v234: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 174 op/s 2024-04-26T11:38:44.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:43 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:38:44.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:43 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:reconnect 2024-04-26T11:38:44.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:43 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:44.045 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:43 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209995 2024-04-26T11:38:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:43 smithi193 ceph-mon[32782]: pgmap v234: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 174 op/s 2024-04-26T11:38:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:43 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:38:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:43 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:reconnect 2024-04-26T11:38:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:43 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:43 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209995 2024-04-26T11:38:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:43 smithi196 ceph-mon[32572]: pgmap v234: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 174 op/s 2024-04-26T11:38:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:43 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:38:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:43 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:reconnect 2024-04-26T11:38:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:43 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:43 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209995 2024-04-26T11:38:44.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 390.0 s, 37.6 tps, lat 7345.077 ms stddev 7885.950 2024-04-26T11:38:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:44 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:rejoin 2024-04-26T11:38:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:44 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:44 smithi193 ceph-mon[32782]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:38:45.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:44 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:rejoin 2024-04-26T11:38:45.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:44 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:45.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:44 smithi196 ceph-mon[32572]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:38:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:44 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:rejoin 2024-04-26T11:38:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:44 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:44 smithi110 ceph-mon[28069]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:38:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:45 smithi193 ceph-mon[32782]: pgmap v235: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 355 KiB/s wr, 48 op/s 2024-04-26T11:38:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:45 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:38:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:45 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:38:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:45 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:active 2024-04-26T11:38:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:45 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:45 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:46.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:45 smithi110 ceph-mon[28069]: pgmap v235: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 355 KiB/s wr, 48 op/s 2024-04-26T11:38:46.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:45 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:38:46.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:45 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:38:46.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:45 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:active 2024-04-26T11:38:46.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:45 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:46.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:45 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:45 smithi196 ceph-mon[32572]: pgmap v235: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 355 KiB/s wr, 48 op/s 2024-04-26T11:38:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:45 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:38:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:45 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:38:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:45 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/849199287,v1:172.21.15.196:6839/849199287] up:active 2024-04-26T11:38:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:45 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:45 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:47.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3627164700 time 2024-04-26T11:38:46.959510+0000 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f363178d3dd] 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f363178d5a3] 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555d3ea64822] 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555d3e9d4598] 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555d3e9d6c17] 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555d3e8cfd0b] 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555d3e8d02ac] 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555d3e8b8fad] 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3631a21e20] 2024-04-26T11:38:47.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 10: (DispatchQueue::entry()+0x51f) [0x7f3631a1efdf] 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3631af1fc1] 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f363050b1ca] 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 13: clone() 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: *** Caught signal (Aborted) ** 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: in thread 7f3627164700 thread_name:ms_dispatch 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3630515d20] 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2: gsignal() 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 3: abort() 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f363178d437] 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f363178d5a3] 2024-04-26T11:38:47.257 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555d3ea64822] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555d3e9d4598] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555d3e9d6c17] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555d3e8cfd0b] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555d3e8d02ac] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555d3e8b8fad] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3631a21e20] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 13: (DispatchQueue::entry()+0x51f) [0x7f3631a1efdf] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3631af1fc1] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f363050b1ca] 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 16: clone() 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:46.960+0000 7f3627164700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3627164700 time 2024-04-26T11:38:46.959510+0000 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:47.258 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.259 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:47.259 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f363178d3dd] 2024-04-26T11:38:47.259 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f363178d5a3] 2024-04-26T11:38:47.259 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555d3ea64822] 2024-04-26T11:38:47.259 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555d3e9d4598] 2024-04-26T11:38:47.259 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555d3e9d6c17] 2024-04-26T11:38:47.259 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555d3e8cfd0b] 2024-04-26T11:38:47.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555d3e8d02ac] 2024-04-26T11:38:47.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555d3e8b8fad] 2024-04-26T11:38:47.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3631a21e20] 2024-04-26T11:38:47.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 10: (DispatchQueue::entry()+0x51f) [0x7f3631a1efdf] 2024-04-26T11:38:47.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3631af1fc1] 2024-04-26T11:38:47.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f363050b1ca] 2024-04-26T11:38:47.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 13: clone() 2024-04-26T11:38:47.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:46.962+0000 7f3627164700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: in thread 7f3627164700 thread_name:ms_dispatch 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3630515d20] 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2: gsignal() 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 3: abort() 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f363178d437] 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f363178d5a3] 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555d3ea64822] 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555d3e9d4598] 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555d3e9d6c17] 2024-04-26T11:38:47.261 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555d3e8cfd0b] 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555d3e8d02ac] 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555d3e8b8fad] 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3631a21e20] 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 13: (DispatchQueue::entry()+0x51f) [0x7f3631a1efdf] 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3631af1fc1] 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f363050b1ca] 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 16: clone() 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: -1> 2024-04-26T11:38:46.960+0000 7f3627164700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3627164700 time 2024-04-26T11:38:46.959510+0000 2024-04-26T11:38:47.262 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:47.263 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.263 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:47.263 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f363178d3dd] 2024-04-26T11:38:47.263 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f363178d5a3] 2024-04-26T11:38:47.263 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555d3ea64822] 2024-04-26T11:38:47.263 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555d3e9d4598] 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555d3e9d6c17] 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555d3e8cfd0b] 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555d3e8d02ac] 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555d3e8b8fad] 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3631a21e20] 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 10: (DispatchQueue::entry()+0x51f) [0x7f3631a1efdf] 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3631af1fc1] 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f363050b1ca] 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 13: clone() 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 0> 2024-04-26T11:38:46.962+0000 7f3627164700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:47.264 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: in thread 7f3627164700 thread_name:ms_dispatch 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3630515d20] 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2: gsignal() 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 3: abort() 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f363178d437] 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f363178d5a3] 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555d3ea64822] 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555d3e9d4598] 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555d3e9d6c17] 2024-04-26T11:38:47.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555d3e8cfd0b] 2024-04-26T11:38:47.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555d3e8d02ac] 2024-04-26T11:38:47.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555d3e8b8fad] 2024-04-26T11:38:47.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3631a21e20] 2024-04-26T11:38:47.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 13: (DispatchQueue::entry()+0x51f) [0x7f3631a1efdf] 2024-04-26T11:38:47.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3631af1fc1] 2024-04-26T11:38:47.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f363050b1ca] 2024-04-26T11:38:47.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 16: clone() 2024-04-26T11:38:47.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:47.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: -1> 2024-04-26T11:38:46.960+0000 7f3627164700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3627164700 time 2024-04-26T11:38:46.959510+0000 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f363178d3dd] 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f363178d5a3] 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555d3ea64822] 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555d3e9d4598] 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555d3e9d6c17] 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555d3e8cfd0b] 2024-04-26T11:38:47.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555d3e8d02ac] 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555d3e8b8fad] 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3631a21e20] 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 10: (DispatchQueue::entry()+0x51f) [0x7f3631a1efdf] 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3631af1fc1] 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f363050b1ca] 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 13: clone() 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 0> 2024-04-26T11:38:46.962+0000 7f3627164700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: in thread 7f3627164700 thread_name:ms_dispatch 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:47.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3630515d20] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2: gsignal() 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 3: abort() 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f363178d437] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f363178d5a3] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555d3ea64822] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555d3e9d4598] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555d3e9d6c17] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555d3e8cfd0b] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555d3e8d02ac] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555d3e8b8fad] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3631a21e20] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 13: (DispatchQueue::entry()+0x51f) [0x7f3631a1efdf] 2024-04-26T11:38:47.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3631af1fc1] 2024-04-26T11:38:47.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f363050b1ca] 2024-04-26T11:38:47.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 16: clone() 2024-04-26T11:38:47.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:47.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:46 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[63058]: 2024-04-26T11:38:47.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:47 smithi196 podman[68888]: 2024-04-26 11:38:47.028056071 +0000 UTC m=+0.019877234 container died c6f8ada6b30dd44d2c88d7c7d5d6076d3c9db42af074bd3ca8def2a64ac8f92d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:38:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:47 smithi196 ceph-mon[32572]: pgmap v236: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 355 KiB/s wr, 48 op/s 2024-04-26T11:38:48.005 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:47 smithi196 podman[68888]: 2024-04-26 11:38:47.697749032 +0000 UTC m=+0.689570175 container remove c6f8ada6b30dd44d2c88d7c7d5d6076d3c9db42af074bd3ca8def2a64ac8f92d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:38:48.006 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:47 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:38:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:47 smithi193 ceph-mon[32782]: pgmap v236: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 355 KiB/s wr, 48 op/s 2024-04-26T11:38:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:47 smithi110 ceph-mon[28069]: pgmap v236: 97 pgs: 97 active+clean; 3.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 355 KiB/s wr, 48 op/s 2024-04-26T11:38:48.505 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:48 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T11:38:48.505 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:48 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Consumed 7.387s CPU time. 2024-04-26T11:38:49.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 395.0 s, 2770.9 tps, lat 50.926 ms stddev 490.570 2024-04-26T11:38:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:49 smithi193 ceph-mon[32782]: pgmap v237: 97 pgs: 97 active+clean; 3.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 3.6 MiB/s wr, 269 op/s 2024-04-26T11:38:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-mon[32572]: pgmap v237: 97 pgs: 97 active+clean; 3.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 3.6 MiB/s wr, 269 op/s 2024-04-26T11:38:50.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5500e9a700 time 2024-04-26T11:38:49.831159+0000 2024-04-26T11:38:50.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:50.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:50.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f550b4c33dd] 2024-04-26T11:38:50.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f550b4c35a3] 2024-04-26T11:38:50.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e245711822] 2024-04-26T11:38:50.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e245681598] 2024-04-26T11:38:50.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e245683c17] 2024-04-26T11:38:50.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e24557cd0b] 2024-04-26T11:38:50.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e24557d2ac] 2024-04-26T11:38:50.257 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e245565fad] 2024-04-26T11:38:50.258 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f550b757e20] 2024-04-26T11:38:50.258 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 10: (DispatchQueue::entry()+0x51f) [0x7f550b754fdf] 2024-04-26T11:38:50.258 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f550b827fc1] 2024-04-26T11:38:50.258 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f550a2411ca] 2024-04-26T11:38:50.258 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 13: clone() 2024-04-26T11:38:50.258 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:49.831+0000 7f5500e9a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5500e9a700 time 2024-04-26T11:38:49.831159+0000 2024-04-26T11:38:50.258 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:50.259 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.260 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:50.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f550b4c33dd] 2024-04-26T11:38:50.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f550b4c35a3] 2024-04-26T11:38:50.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e245711822] 2024-04-26T11:38:50.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e245681598] 2024-04-26T11:38:50.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e245683c17] 2024-04-26T11:38:50.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e24557cd0b] 2024-04-26T11:38:50.261 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e24557d2ac] 2024-04-26T11:38:50.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e245565fad] 2024-04-26T11:38:50.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f550b757e20] 2024-04-26T11:38:50.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 10: (DispatchQueue::entry()+0x51f) [0x7f550b754fdf] 2024-04-26T11:38:50.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f550b827fc1] 2024-04-26T11:38:50.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f550a2411ca] 2024-04-26T11:38:50.262 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 13: clone() 2024-04-26T11:38:50.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: *** Caught signal (Aborted) ** 2024-04-26T11:38:50.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: in thread 7f5500e9a700 thread_name:ms_dispatch 2024-04-26T11:38:50.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:50.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f550a24bd20] 2024-04-26T11:38:50.263 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2: gsignal() 2024-04-26T11:38:50.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 3: abort() 2024-04-26T11:38:50.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f550b4c3437] 2024-04-26T11:38:50.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f550b4c35a3] 2024-04-26T11:38:50.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e245711822] 2024-04-26T11:38:50.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e245681598] 2024-04-26T11:38:50.264 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e245683c17] 2024-04-26T11:38:50.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e24557cd0b] 2024-04-26T11:38:50.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e24557d2ac] 2024-04-26T11:38:50.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e245565fad] 2024-04-26T11:38:50.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f550b757e20] 2024-04-26T11:38:50.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 13: (DispatchQueue::entry()+0x51f) [0x7f550b754fdf] 2024-04-26T11:38:50.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f550b827fc1] 2024-04-26T11:38:50.265 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f550a2411ca] 2024-04-26T11:38:50.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 16: clone() 2024-04-26T11:38:50.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:49.833+0000 7f5500e9a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:50.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: in thread 7f5500e9a700 thread_name:ms_dispatch 2024-04-26T11:38:50.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:50.266 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f550a24bd20] 2024-04-26T11:38:50.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2: gsignal() 2024-04-26T11:38:50.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 3: abort() 2024-04-26T11:38:50.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f550b4c3437] 2024-04-26T11:38:50.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f550b4c35a3] 2024-04-26T11:38:50.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e245711822] 2024-04-26T11:38:50.267 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e245681598] 2024-04-26T11:38:50.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e245683c17] 2024-04-26T11:38:50.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e24557cd0b] 2024-04-26T11:38:50.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e24557d2ac] 2024-04-26T11:38:50.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e245565fad] 2024-04-26T11:38:50.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f550b757e20] 2024-04-26T11:38:50.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 13: (DispatchQueue::entry()+0x51f) [0x7f550b754fdf] 2024-04-26T11:38:50.268 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f550b827fc1] 2024-04-26T11:38:50.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f550a2411ca] 2024-04-26T11:38:50.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 16: clone() 2024-04-26T11:38:50.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:50.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: -1> 2024-04-26T11:38:49.831+0000 7f5500e9a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5500e9a700 time 2024-04-26T11:38:49.831159+0000 2024-04-26T11:38:50.269 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:50.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:50.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f550b4c33dd] 2024-04-26T11:38:50.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f550b4c35a3] 2024-04-26T11:38:50.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e245711822] 2024-04-26T11:38:50.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e245681598] 2024-04-26T11:38:50.270 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e245683c17] 2024-04-26T11:38:50.271 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e24557cd0b] 2024-04-26T11:38:50.271 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e24557d2ac] 2024-04-26T11:38:50.271 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e245565fad] 2024-04-26T11:38:50.271 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f550b757e20] 2024-04-26T11:38:50.271 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 10: (DispatchQueue::entry()+0x51f) [0x7f550b754fdf] 2024-04-26T11:38:50.271 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f550b827fc1] 2024-04-26T11:38:50.271 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f550a2411ca] 2024-04-26T11:38:50.272 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 13: clone() 2024-04-26T11:38:50.272 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.272 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 0> 2024-04-26T11:38:49.833+0000 7f5500e9a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:50.272 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: in thread 7f5500e9a700 thread_name:ms_dispatch 2024-04-26T11:38:50.272 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.272 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:50.272 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f550a24bd20] 2024-04-26T11:38:50.273 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2: gsignal() 2024-04-26T11:38:50.273 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 3: abort() 2024-04-26T11:38:50.273 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f550b4c3437] 2024-04-26T11:38:50.273 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f550b4c35a3] 2024-04-26T11:38:50.273 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e245711822] 2024-04-26T11:38:50.273 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e245681598] 2024-04-26T11:38:50.273 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e245683c17] 2024-04-26T11:38:50.274 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e24557cd0b] 2024-04-26T11:38:50.274 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e24557d2ac] 2024-04-26T11:38:50.274 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e245565fad] 2024-04-26T11:38:50.274 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f550b757e20] 2024-04-26T11:38:50.274 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 13: (DispatchQueue::entry()+0x51f) [0x7f550b754fdf] 2024-04-26T11:38:50.274 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f550b827fc1] 2024-04-26T11:38:50.274 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f550a2411ca] 2024-04-26T11:38:50.275 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 16: clone() 2024-04-26T11:38:50.275 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:50.275 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.275 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: -1> 2024-04-26T11:38:49.831+0000 7f5500e9a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5500e9a700 time 2024-04-26T11:38:49.831159+0000 2024-04-26T11:38:50.275 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:38:50.275 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.275 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:50.276 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f550b4c33dd] 2024-04-26T11:38:50.276 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f550b4c35a3] 2024-04-26T11:38:50.276 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e245711822] 2024-04-26T11:38:50.276 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e245681598] 2024-04-26T11:38:50.276 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e245683c17] 2024-04-26T11:38:50.276 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e24557cd0b] 2024-04-26T11:38:50.276 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e24557d2ac] 2024-04-26T11:38:50.276 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e245565fad] 2024-04-26T11:38:50.277 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f550b757e20] 2024-04-26T11:38:50.277 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 10: (DispatchQueue::entry()+0x51f) [0x7f550b754fdf] 2024-04-26T11:38:50.277 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f550b827fc1] 2024-04-26T11:38:50.277 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f550a2411ca] 2024-04-26T11:38:50.277 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 13: clone() 2024-04-26T11:38:50.277 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.277 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 0> 2024-04-26T11:38:49.833+0000 7f5500e9a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:38:50.277 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: in thread 7f5500e9a700 thread_name:ms_dispatch 2024-04-26T11:38:50.277 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.278 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:38:50.278 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f550a24bd20] 2024-04-26T11:38:50.278 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2: gsignal() 2024-04-26T11:38:50.278 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 3: abort() 2024-04-26T11:38:50.278 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f550b4c3437] 2024-04-26T11:38:50.278 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f550b4c35a3] 2024-04-26T11:38:50.278 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e245711822] 2024-04-26T11:38:50.279 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e245681598] 2024-04-26T11:38:50.279 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e245683c17] 2024-04-26T11:38:50.279 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e24557cd0b] 2024-04-26T11:38:50.279 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e24557d2ac] 2024-04-26T11:38:50.279 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e245565fad] 2024-04-26T11:38:50.279 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f550b757e20] 2024-04-26T11:38:50.279 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 13: (DispatchQueue::entry()+0x51f) [0x7f550b754fdf] 2024-04-26T11:38:50.280 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f550b827fc1] 2024-04-26T11:38:50.280 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f550a2411ca] 2024-04-26T11:38:50.280 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 16: clone() 2024-04-26T11:38:50.280 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:38:50.280 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[68556]: 2024-04-26T11:38:50.280 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:49 smithi196 podman[68931]: 2024-04-26 11:38:49.918322103 +0000 UTC m=+0.024035181 container died 2cbc5e8008a020d6e94a892533f57d04351230d912c74f9ba0fd74dfb68237ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T11:38:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:49 smithi110 ceph-mon[28069]: pgmap v237: 97 pgs: 97 active+clean; 3.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 3.6 MiB/s wr, 269 op/s 2024-04-26T11:38:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:50 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:51.203 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:50 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:50 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:38:51.460 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:51 smithi196 podman[68931]: 2024-04-26 11:38:51.203446096 +0000 UTC m=+1.309159156 container remove 2cbc5e8008a020d6e94a892533f57d04351230d912c74f9ba0fd74dfb68237ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T11:38:51.460 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:51 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:38:51.755 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:38:51 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T11:38:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:51 smithi196 ceph-mon[32572]: pgmap v238: 97 pgs: 97 active+clean; 3.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 3.6 MiB/s wr, 269 op/s 2024-04-26T11:38:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:51 smithi110 ceph-mon[28069]: pgmap v238: 97 pgs: 97 active+clean; 3.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 3.6 MiB/s wr, 269 op/s 2024-04-26T11:38:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:51 smithi193 ceph-mon[32782]: pgmap v238: 97 pgs: 97 active+clean; 3.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 3.6 MiB/s wr, 269 op/s 2024-04-26T11:38:54.027 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:53 smithi110 ceph-mon[28069]: pgmap v239: 97 pgs: 97 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 4.3 MiB/s wr, 342 op/s 2024-04-26T11:38:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:53 smithi196 ceph-mon[32572]: pgmap v239: 97 pgs: 97 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 4.3 MiB/s wr, 342 op/s 2024-04-26T11:38:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:53 smithi193 ceph-mon[32782]: pgmap v239: 97 pgs: 97 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 4.3 MiB/s wr, 342 op/s 2024-04-26T11:38:54.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 400.0 s, 247.6 tps, lat 24.025 ms stddev 23.520 2024-04-26T11:38:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:55 smithi196 ceph-mon[32572]: pgmap v240: 97 pgs: 97 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 6.1 MiB/s wr, 471 op/s 2024-04-26T11:38:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:55 smithi110 ceph-mon[28069]: pgmap v240: 97 pgs: 97 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 6.1 MiB/s wr, 471 op/s 2024-04-26T11:38:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:55 smithi193 ceph-mon[32782]: pgmap v240: 97 pgs: 97 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 6.1 MiB/s wr, 471 op/s 2024-04-26T11:38:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.962+0000 7f310b200640 1 -- 172.21.15.110:0/624357685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3104077780 msgr2=0x7f3104113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:56.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.962+0000 7f310b200640 1 --2- 172.21.15.110:0/624357685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3104077780 0x7f3104113280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009cd0 tx=0x7f30ec02a8e0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.962+0000 7f310b200640 1 -- 172.21.15.110:0/624357685 shutdown_connections 2024-04-26T11:38:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.962+0000 7f310b200640 1 --2- 172.21.15.110:0/624357685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31041137c0 0x7f3104115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.962+0000 7f310b200640 1 --2- 172.21.15.110:0/624357685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3104077780 0x7f3104113280 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.962+0000 7f310b200640 1 --2- 172.21.15.110:0/624357685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3104076e60 0x7f3104077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.962+0000 7f310b200640 1 -- 172.21.15.110:0/624357685 >> 172.21.15.110:0/624357685 conn(0x7f31041005f0 msgr2=0x7f3104102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.962+0000 7f310b200640 1 -- 172.21.15.110:0/624357685 shutdown_connections 2024-04-26T11:38:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.962+0000 7f310b200640 1 -- 172.21.15.110:0/624357685 wait complete. 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.963+0000 7f310b200640 1 Processor -- start 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.963+0000 7f310b200640 1 -- start start 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f310b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3104076e60 0x7f310419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f310b200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3104077780 0x7f310419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f310b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31041137c0 0x7f31041a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f310b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3104119210 con 0x7f3104076e60 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f310b200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3104119090 con 0x7f3104077780 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f310b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3104119390 con 0x7f31041137c0 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f3103e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3104076e60 0x7f310419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f3103e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3104076e60 0x7f310419f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53694/0 (socket says 172.21.15.110:53694) 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f3103e00640 1 -- 172.21.15.110:0/2637452276 learned_addr learned my addr 172.21.15.110:0/2637452276 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f3103400640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3104077780 0x7f310419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.964+0000 7f3109200640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31041137c0 0x7f31041a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3103e00640 1 -- 172.21.15.110:0/2637452276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31041137c0 msgr2=0x7f31041a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3103e00640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31041137c0 0x7f31041a3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3103e00640 1 -- 172.21.15.110:0/2637452276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3104077780 msgr2=0x7f310419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3103e00640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3104077780 0x7f310419fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3103e00640 1 -- 172.21.15.110:0/2637452276 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31041a46d0 con 0x7f3104076e60 2024-04-26T11:38:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3103400640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3104077780 0x7f310419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:38:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3103e00640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3104076e60 0x7f310419f730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f30f400e9f0 tx=0x7f30f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3100c00640 1 -- 172.21.15.110:0/2637452276 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f400cd80 con 0x7f3104076e60 2024-04-26T11:38:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3100c00640 1 -- 172.21.15.110:0/2637452276 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f40108e0 con 0x7f3104076e60 2024-04-26T11:38:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f3100c00640 1 -- 172.21.15.110:0/2637452276 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4018980 con 0x7f3104076e60 2024-04-26T11:38:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f310b200640 1 -- 172.21.15.110:0/2637452276 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31041a49c0 con 0x7f3104076e60 2024-04-26T11:38:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.965+0000 7f310b200640 1 -- 172.21.15.110:0/2637452276 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31041ac250 con 0x7f3104076e60 2024-04-26T11:38:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.969+0000 7f310e029740 1 Processor -- start 2024-04-26T11:38:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.969+0000 7f3100c00640 1 -- 172.21.15.110:0/2637452276 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f30f4010430 con 0x7f3104076e60 2024-04-26T11:38:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.969+0000 7f310e029740 1 -- start start 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.969+0000 7f310e029740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e844dd0 0x56042e8451b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.969+0000 7f310e029740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 0x56042e84fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.969+0000 7f310e029740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 0x56042e8523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.969+0000 7f310e029740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56042e7aa380 con 0x56042e84ffb0 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.969+0000 7f310e029740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56042e746c30 con 0x56042e844dd0 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.969+0000 7f310e029740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56042e7a6340 con 0x56042e8456f0 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3109200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e844dd0 0x56042e8451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3109200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e844dd0 0x56042e8451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54082/0 (socket says 172.21.15.110:54082) 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3109200640 1 -- 172.21.15.110:0/507156579 learned_addr learned my addr 172.21.15.110:0/507156579 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3103e00640 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 0x56042e84fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3103400640 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 0x56042e8523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3109200640 1 -- 172.21.15.110:0/507156579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 msgr2=0x56042e84fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3109200640 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 0x56042e84fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3109200640 1 -- 172.21.15.110:0/507156579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 msgr2=0x56042e8523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3109200640 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 0x56042e8523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3109200640 1 -- 172.21.15.110:0/507156579 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56042e768940 con 0x56042e844dd0 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3103e00640 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 0x56042e84fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3103400640 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 0x56042e8523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f3109200640 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e844dd0 0x56042e8451b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0045e0 tx=0x7f30fc004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e20a338c0f574477 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f30f9600640 1 -- 172.21.15.110:0/507156579 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc003af0 con 0x56042e844dd0 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f30f9600640 1 -- 172.21.15.110:0/507156579 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30fc015070 con 0x56042e844dd0 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.970+0000 7f30f9600640 1 -- 172.21.15.110:0/507156579 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc0116a0 con 0x56042e844dd0 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.971+0000 7f3100c00640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f30e40a3dc0 0x7f30e40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.971+0000 7f3100c00640 1 -- 172.21.15.110:0/2637452276 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9159+0+0 (secure 0 0 0) 0x7f30f40d0da0 con 0x7f3104076e60 2024-04-26T11:38:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.971+0000 7f3103e00640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f30e40a3dc0 0x7f30e40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.971+0000 7f310e029740 1 -- 172.21.15.110:0/507156579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e844dd0 msgr2=0x56042e8451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.971+0000 7f310e029740 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e844dd0 0x56042e8451b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0045e0 tx=0x7f30fc004610 comp rx=0 tx=0).stop 2024-04-26T11:38:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f310e029740 1 -- 172.21.15.110:0/507156579 shutdown_connections 2024-04-26T11:38:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f310e029740 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 0x56042e8523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f310e029740 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 0x56042e84fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f310e029740 1 --2- 172.21.15.110:0/507156579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e844dd0 0x56042e8451b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f310e029740 1 -- 172.21.15.110:0/507156579 >> 172.21.15.110:0/507156579 conn(0x56042e8412e0 msgr2=0x56042e8416c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f3103e00640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f30e40a3dc0 0x7f30e40a6280 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x56042e846370 tx=0x7f30f4000bc0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f310e029740 1 -- 172.21.15.110:0/507156579 shutdown_connections 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f310e029740 1 -- 172.21.15.110:0/507156579 wait complete. 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f310e029740 1 -- start start 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.972+0000 7f310e029740 1 Processor -- start 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f310e029740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 0x56042e84cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f310e029740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e8456f0 0x56042e84d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f310e029740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 0x56042e84d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f310e029740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56042e852be0 con 0x56042e84ffb0 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f310e029740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56042e731c60 con 0x56042e8456f0 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f310e029740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56042e852d60 con 0x56042e844dd0 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f310e029740 10 client.0 _ll_register_callbacks cb 0x56042e75de50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f3103400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e8456f0 0x56042e84d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f3109200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 0x56042e84cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f3103400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e8456f0 0x56042e84d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:54094/0 (socket says 172.21.15.110:54094) 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f3103400640 1 -- 172.21.15.110:0/3651047151 learned_addr learned my addr 172.21.15.110:0/3651047151 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.973+0000 7f3109200640 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 0x56042e84d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f3103400640 1 -- 172.21.15.110:0/3651047151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 msgr2=0x56042e84cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f3103400640 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 0x56042e84cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f3103400640 1 -- 172.21.15.110:0/3651047151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 msgr2=0x56042e84d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f3103400640 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 0x56042e84d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f3103400640 1 -- 172.21.15.110:0/3651047151 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56042e740510 con 0x56042e8456f0 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f3103400640 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e8456f0 0x56042e84d470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f30ec02ae00 tx=0x7f30ec031dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98c9903b4f464bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f30f2000640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f30f2000640 1 -- 172.21.15.110:0/3651047151 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec048020 con 0x56042e8456f0 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f30f2000640 1 -- 172.21.15.110:0/3651047151 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9159+0+0 (secure 0 0 0) 0x7f30ec003b80 con 0x56042e8456f0 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f310e029740 1 -- 172.21.15.110:0/3651047151 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30fc015070 con 0x56042e8456f0 2024-04-26T11:38:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f30f2000640 1 -- 172.21.15.110:0/3651047151 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f30ec003d80 con 0x56042e8456f0 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f310e029740 10 client.25964 fetch_fsmap learned FSMap version 80 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.974+0000 7f310e029740 1 -- 172.21.15.110:0/3651047151 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) -- 0x56042e4bc210 con 0x56042e8456f0 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.975+0000 7f30f2000640 1 -- 172.21.15.110:0/3651047151 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30fc015070 con 0x56042e8456f0 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.975+0000 7f30f2000640 1 -- 172.21.15.110:0/3651047151 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 80) ==== 8346+0+0 (secure 0 0 0) 0x7f30ec043070 con 0x56042e8456f0 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.975+0000 7f310e029740 10 client.25964 fetch_fsmap finished waiting for FSMap version 80 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.975+0000 7f310e029740 10 client.25964 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.975+0000 7f310e029740 20 client.25964 populate_metadata read hostname 'smithi110' 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.975+0000 7f310e029740 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56042e85fd30 0x56042e862140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.975+0000 7f310e029740 4 client.25964 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.975+0000 7f310e029740 1 -- 172.21.15.110:0/3651047151 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56042e7b7f90 con 0x56042e85fd30 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.975+0000 7f3109200640 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56042e85fd30 0x56042e862140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.976+0000 7f3109200640 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56042e85fd30 0x56042e862140 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c986c64a39ea8d server_cookie=b8d4a18bbc242140 in_seq=0 out_seq=0 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.976+0000 7f30f2000640 10 client.25964 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.976+0000 7f30f2000640 1 -- 172.21.15.110:0/3651047151 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56042e7b7f90 con 0x56042e85fd30 2024-04-26T11:38:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.976+0000 7f30f2000640 10 client.25964 handle_command_reply: tid=0 2024-04-26T11:38:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.976+0000 7f310e029740 1 client.25964 shutdown 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 -- 172.21.15.110:0/3651047151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e8456f0 msgr2=0x56042e84d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e8456f0 0x56042e84d470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f30ec02ae00 tx=0x7f30ec031dc0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 -- 172.21.15.110:0/3651047151 shutdown_connections 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e84ffb0 0x56042e84d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e8456f0 0x56042e84d470 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56042e85fd30 0x56042e862140 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 --2- 172.21.15.110:0/3651047151 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 0x56042e84cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 -- 172.21.15.110:0/3651047151 >> 172.21.15.110:0/3651047151 conn(0x56042e8412e0 msgr2=0x56042e847010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f30f2000640 0 client.25964 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 -- 172.21.15.110:0/3651047151 shutdown_connections 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 1 -- 172.21.15.110:0/3651047151 wait complete. 2024-04-26T11:38:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.977+0000 7f310e029740 20 client.25964 trim_cache size 0 max 16384 2024-04-26T11:38:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.993+0000 7f310e029740 1 Processor -- start 2024-04-26T11:38:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.993+0000 7f310e029740 1 -- start start 2024-04-26T11:38:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.993+0000 7f310e029740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e844dd0 0x56042e85baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.993+0000 7f310e029740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 0x56042e84d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.993+0000 7f310e029740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 0x56042e8402c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.993+0000 7f310e029740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f31041b7b20 con 0x56042e844dd0 2024-04-26T11:38:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.993+0000 7f310e029740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f31041b53c0 con 0x56042e84ffb0 2024-04-26T11:38:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.993+0000 7f310e029740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f31041b3210 con 0x56042e8456f0 2024-04-26T11:38:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e844dd0 0x56042e85baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e844dd0 0x56042e85baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53710/0 (socket says 172.21.15.110:53710) 2024-04-26T11:38:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 -- 172.21.15.110:0/3894137902 learned_addr learned my addr 172.21.15.110:0/3894137902 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3103400640 1 --2- 172.21.15.110:0/3894137902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 0x56042e84d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 --2- 172.21.15.110:0/3894137902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 0x56042e8402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 -- 172.21.15.110:0/3894137902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 msgr2=0x56042e84d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 --2- 172.21.15.110:0/3894137902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 0x56042e84d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 -- 172.21.15.110:0/3894137902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 msgr2=0x56042e8402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 --2- 172.21.15.110:0/3894137902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 0x56042e8402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 -- 172.21.15.110:0/3894137902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56042e847d80 con 0x56042e844dd0 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f3109200640 1 --2- 172.21.15.110:0/3894137902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e844dd0 0x56042e85baa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f30fc004370 tx=0x7f30fc005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16518d76aef721f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f30f8c00640 1 -- 172.21.15.110:0/3894137902 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc032070 con 0x56042e844dd0 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f30f8c00640 1 -- 172.21.15.110:0/3894137902 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30fc015040 con 0x56042e844dd0 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.994+0000 7f30f8c00640 1 -- 172.21.15.110:0/3894137902 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc023040 con 0x56042e844dd0 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.995+0000 7f310e029740 1 -- 172.21.15.110:0/3894137902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e844dd0 msgr2=0x56042e85baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.995+0000 7f310e029740 1 --2- 172.21.15.110:0/3894137902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e844dd0 0x56042e85baa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f30fc004370 tx=0x7f30fc005cc0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.995+0000 7f310e029740 1 -- 172.21.15.110:0/3894137902 shutdown_connections 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.995+0000 7f310e029740 1 --2- 172.21.15.110:0/3894137902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 0x56042e8402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.995+0000 7f310e029740 1 --2- 172.21.15.110:0/3894137902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e8456f0 0x56042e84d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.995+0000 7f310e029740 1 --2- 172.21.15.110:0/3894137902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e844dd0 0x56042e85baa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.995+0000 7f310e029740 1 -- 172.21.15.110:0/3894137902 >> 172.21.15.110:0/3894137902 conn(0x56042e8412e0 msgr2=0x56042e83fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:38:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.995+0000 7f310e029740 1 -- 172.21.15.110:0/3894137902 shutdown_connections 2024-04-26T11:38:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.995+0000 7f310e029740 1 -- 172.21.15.110:0/3894137902 wait complete. 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.996+0000 7f310e029740 1 -- start start 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.996+0000 7f310e029740 1 Processor -- start 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.996+0000 7f310e029740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 0x56042e849ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.996+0000 7f310e029740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e8456f0 0x56042e84a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.996+0000 7f310e029740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 0x56042e84a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.996+0000 7f310e029740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f31041b3880 con 0x56042e8456f0 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.996+0000 7f310e029740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f31041b4cf0 con 0x56042e84ffb0 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.996+0000 7f310e029740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f31041b3f50 con 0x56042e844dd0 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.996+0000 7f310e029740 10 client.0 _ll_register_callbacks cb 0x7f30ec031f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3109200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 0x56042e849ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3109200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 0x56042e849ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:32816/0 (socket says 172.21.15.110:32816) 2024-04-26T11:38:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3109200640 1 -- 172.21.15.110:0/3867493896 learned_addr learned my addr 172.21.15.110:0/3867493896 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3109200640 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 0x56042e84a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3103400640 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e8456f0 0x56042e84a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3103400640 1 -- 172.21.15.110:0/3867493896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 msgr2=0x56042e849ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3103400640 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 0x56042e849ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3103400640 1 -- 172.21.15.110:0/3867493896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 msgr2=0x56042e84a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3103400640 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 0x56042e84a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3103400640 1 -- 172.21.15.110:0/3867493896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56042e588620 con 0x56042e8456f0 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3109200640 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 0x56042e84a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f3103400640 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e8456f0 0x56042e84a3e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f30ec000f80 tx=0x7f30ec030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ade5010c73c9799 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.997+0000 7f30f2000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.998+0000 7f30f2000640 1 -- 172.21.15.110:0/3867493896 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec059060 con 0x56042e8456f0 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.998+0000 7f310e029740 1 -- 172.21.15.110:0/3867493896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30fc015040 con 0x56042e8456f0 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.998+0000 7f30f2000640 1 -- 172.21.15.110:0/3867493896 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9159+0+0 (secure 0 0 0) 0x7f30ec02e020 con 0x56042e8456f0 2024-04-26T11:38:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.998+0000 7f30f2000640 1 -- 172.21.15.110:0/3867493896 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f30ec060050 con 0x56042e8456f0 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.998+0000 7f310e029740 10 client.15783 fetch_fsmap learned FSMap version 80 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.998+0000 7f310e029740 1 -- 172.21.15.110:0/3867493896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) -- 0x56042e764cb0 con 0x56042e8456f0 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.998+0000 7f30f2000640 1 -- 172.21.15.110:0/3867493896 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30fc015040 con 0x56042e8456f0 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.998+0000 7f30f2000640 1 -- 172.21.15.110:0/3867493896 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 80) ==== 8346+0+0 (secure 0 0 0) 0x7f30ec043040 con 0x56042e8456f0 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.999+0000 7f310e029740 10 client.15783 fetch_fsmap finished waiting for FSMap version 80 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.999+0000 7f310e029740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.999+0000 7f310e029740 20 client.15783 populate_metadata read hostname 'smithi110' 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.999+0000 7f310e029740 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56042e8c6c30 0x56042e8c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.999+0000 7f310e029740 4 client.15783 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.999+0000 7f310e029740 1 -- 172.21.15.110:0/3867493896 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56042e7b1e00 con 0x56042e8c6c30 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.999+0000 7f3109200640 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56042e8c6c30 0x56042e8c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.999+0000 7f3109200640 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56042e8c6c30 0x56042e8c9050 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e28107f680632b3a server_cookie=526265d0aa8c7adf in_seq=0 out_seq=0 2024-04-26T11:38:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:38:56.999+0000 7f30f2000640 10 client.15783 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:38:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:57 smithi196 ceph-mon[32572]: pgmap v241: 97 pgs: 97 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 6.1 MiB/s wr, 469 op/s 2024-04-26T11:38:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:57 smithi110 ceph-mon[28069]: pgmap v241: 97 pgs: 97 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 6.1 MiB/s wr, 469 op/s 2024-04-26T11:38:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:57 smithi193 ceph-mon[32782]: pgmap v241: 97 pgs: 97 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 6.1 MiB/s wr, 469 op/s 2024-04-26T11:38:58.571 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:38:58.571 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 systemd[1]: Stopped Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:38:58.571 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Consumed 7.387s CPU time. 2024-04-26T11:38:58.571 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 systemd[1]: Starting Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:38:58.572 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 podman[69028]: 2024-04-26 11:38:58.394513302 +0000 UTC m=+0.018625834 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:38:58.572 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 podman[69028]: 2024-04-26 11:38:58.570941205 +0000 UTC m=+0.195053710 container create bf90020858bf21129914789487b5514ca608ab46b0d8e5704b67bad9df9ceba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:38:58.841 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 podman[69028]: 2024-04-26 11:38:58.815978002 +0000 UTC m=+0.440090507 container init bf90020858bf21129914789487b5514ca608ab46b0d8e5704b67bad9df9ceba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T11:38:58.841 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 podman[69028]: 2024-04-26 11:38:58.81856436 +0000 UTC m=+0.442676875 container start bf90020858bf21129914789487b5514ca608ab46b0d8e5704b67bad9df9ceba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:38:59.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-mds[69047]: -- 172.21.15.196:0/1521814280 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5589475b7a40 con 0x55894758a800 2024-04-26T11:38:59.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: starting mds.c at 2024-04-26T11:38:59.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 bash[69028]: bf90020858bf21129914789487b5514ca608ab46b0d8e5704b67bad9df9ceba2 2024-04-26T11:38:59.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:38:58 smithi196 systemd[1]: Started Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:38:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-mon[32572]: daemon mds.c restarted 2024-04-26T11:38:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:38:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-mon[32572]: osdmap e103: 12 total, 12 up, 12 in 2024-04-26T11:38:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:boot 2024-04-26T11:38:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-mon[32572]: Standby daemon mds.e assigned to filesystem cephfs as rank 2 2024-04-26T11:38:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:38:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:38:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:58 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:58 smithi110 ceph-mon[28069]: daemon mds.c restarted 2024-04-26T11:38:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:58 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:38:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:58 smithi110 ceph-mon[28069]: osdmap e103: 12 total, 12 up, 12 in 2024-04-26T11:38:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:58 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:boot 2024-04-26T11:38:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:58 smithi110 ceph-mon[28069]: Standby daemon mds.e assigned to filesystem cephfs as rank 2 2024-04-26T11:38:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:58 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:38:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:38:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:58 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:58 smithi193 ceph-mon[32782]: daemon mds.c restarted 2024-04-26T11:38:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:58 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:38:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:58 smithi193 ceph-mon[32782]: osdmap e103: 12 total, 12 up, 12 in 2024-04-26T11:38:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:58 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:boot 2024-04-26T11:38:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:58 smithi193 ceph-mon[32782]: Standby daemon mds.e assigned to filesystem cephfs as rank 2 2024-04-26T11:38:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:58 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:38:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:38:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:58 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:38:59.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:39:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:38:59 smithi196 ceph-mon[32572]: pgmap v242: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 6.5 MiB/s wr, 522 op/s 2024-04-26T11:39:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:38:59 smithi110 ceph-mon[28069]: pgmap v242: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 6.5 MiB/s wr, 522 op/s 2024-04-26T11:39:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:38:59 smithi193 ceph-mon[32782]: pgmap v242: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 6.5 MiB/s wr, 522 op/s 2024-04-26T11:39:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:00 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:resolve 2024-04-26T11:39:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:00 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:00 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:resolve 2024-04-26T11:39:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:00 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:00 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:resolve 2024-04-26T11:39:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:00 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:01.854 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:01 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 4. 2024-04-26T11:39:01.854 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:01 smithi196 systemd[1]: Stopped Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:39:01.854 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:01 smithi196 systemd[1]: Starting Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:39:01.854 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:01 smithi196 podman[69119]: 2024-04-26 11:39:01.63179413 +0000 UTC m=+0.017577131 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:39:01.855 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:01 smithi196 podman[69119]: 2024-04-26 11:39:01.734145413 +0000 UTC m=+0.119928467 container create a333b170f94386a1d9ce00cec735b4c1cfefa32d9dd02f91bf19a4bd5e7c2277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-26T11:39:01.999 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:01 smithi196 ceph-mon[32572]: pgmap v244: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 361 op/s 2024-04-26T11:39:01.999 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:01 smithi196 podman[69119]: 2024-04-26 11:39:01.995371398 +0000 UTC m=+0.381154385 container init a333b170f94386a1d9ce00cec735b4c1cfefa32d9dd02f91bf19a4bd5e7c2277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T11:39:02.255 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:01 smithi196 podman[69119]: 2024-04-26 11:39:01.998082202 +0000 UTC m=+0.383865193 container start a333b170f94386a1d9ce00cec735b4c1cfefa32d9dd02f91bf19a4bd5e7c2277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-26T11:39:02.255 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:02 smithi196 ceph-mds[69138]: -- 172.21.15.196:0/44886828 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0760f5a40 con 0x55e0760c8800 2024-04-26T11:39:02.255 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:02 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: starting mds.i at 2024-04-26T11:39:02.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:02 smithi196 bash[69119]: a333b170f94386a1d9ce00cec735b4c1cfefa32d9dd02f91bf19a4bd5e7c2277 2024-04-26T11:39:02.256 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:02 smithi196 systemd[1]: Started Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:39:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:01 smithi110 ceph-mon[28069]: pgmap v244: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 361 op/s 2024-04-26T11:39:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:01 smithi193 ceph-mon[32782]: pgmap v244: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 361 op/s 2024-04-26T11:39:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:02 smithi196 ceph-mon[32572]: daemon mds.i restarted 2024-04-26T11:39:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:02 smithi196 ceph-mon[32572]: osdmap e104: 12 total, 12 up, 12 in 2024-04-26T11:39:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:02 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:boot 2024-04-26T11:39:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:02 smithi196 ceph-mon[32572]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:39:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:02 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:resolve} 2 up:standby-replay 8 up:standby, 1 failed 2024-04-26T11:39:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:39:03.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:02 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:resolve} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:03.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:02 smithi193 ceph-mon[32782]: daemon mds.i restarted 2024-04-26T11:39:03.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:02 smithi193 ceph-mon[32782]: osdmap e104: 12 total, 12 up, 12 in 2024-04-26T11:39:03.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:02 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:boot 2024-04-26T11:39:03.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:02 smithi193 ceph-mon[32782]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:39:03.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:02 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:resolve} 2 up:standby-replay 8 up:standby, 1 failed 2024-04-26T11:39:03.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:39:03.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:02 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:resolve} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:02 smithi110 ceph-mon[28069]: daemon mds.i restarted 2024-04-26T11:39:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:02 smithi110 ceph-mon[28069]: osdmap e104: 12 total, 12 up, 12 in 2024-04-26T11:39:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:02 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:boot 2024-04-26T11:39:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:02 smithi110 ceph-mon[28069]: Standby daemon mds.f assigned to filesystem cephfs as rank 1 2024-04-26T11:39:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:02 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:resolve} 2 up:standby-replay 8 up:standby, 1 failed 2024-04-26T11:39:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T11:39:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:02 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=e=up:resolve} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:03 smithi196 ceph-mon[32572]: pgmap v246: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 867 KiB/s wr, 115 op/s 2024-04-26T11:39:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:03 smithi110 ceph-mon[28069]: pgmap v246: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 867 KiB/s wr, 115 op/s 2024-04-26T11:39:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:03 smithi193 ceph-mon[32782]: pgmap v246: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 867 KiB/s wr, 115 op/s 2024-04-26T11:39:04.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:39:05.207 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:04 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:resolve 2024-04-26T11:39:05.207 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:04 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:resolve} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:04 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:resolve 2024-04-26T11:39:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:04 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:resolve} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:04 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:resolve 2024-04-26T11:39:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:04 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=e=up:resolve} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.983+0000 7f30f2000640 1 -- 172.21.15.110:0/3867493896 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56042e7b1e00 con 0x56042e8c6c30 2024-04-26T11:39:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.983+0000 7f30f2000640 10 client.15783 handle_command_reply: tid=0 2024-04-26T11:39:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.983+0000 7f310e029740 1 client.15783 shutdown 2024-04-26T11:39:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 -- 172.21.15.110:0/3867493896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e8456f0 msgr2=0x56042e84a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e8456f0 0x56042e84a3e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f30ec000f80 tx=0x7f30ec030d50 comp rx=0 tx=0).stop 2024-04-26T11:39:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 -- 172.21.15.110:0/3867493896 shutdown_connections 2024-04-26T11:39:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56042e84ffb0 0x56042e84a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56042e8456f0 0x56042e84a3e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56042e8c6c30 0x56042e8c9050 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 --2- 172.21.15.110:0/3867493896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56042e844dd0 0x56042e849ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f30f2000640 0 client.15783 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:39:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 -- 172.21.15.110:0/3867493896 >> 172.21.15.110:0/3867493896 conn(0x56042e8412e0 msgr2=0x56042e847010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 -- 172.21.15.110:0/3867493896 shutdown_connections 2024-04-26T11:39:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 1 -- 172.21.15.110:0/3867493896 wait complete. 2024-04-26T11:39:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.984+0000 7f310e029740 20 client.15783 trim_cache size 0 max 16384 2024-04-26T11:39:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:39:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:39:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:39:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:39:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.985+0000 7f310b200640 1 -- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f30e40a3dc0 msgr2=0x7f30e40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.985+0000 7f310b200640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f30e40a3dc0 0x7f30e40a6280 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x56042e846370 tx=0x7f30f4000bc0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.985+0000 7f310b200640 1 -- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3104076e60 msgr2=0x7f310419f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.985+0000 7f310b200640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3104076e60 0x7f310419f730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f30f400e9f0 tx=0x7f30f400eeb0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.986+0000 7f310b200640 1 -- 172.21.15.110:0/2637452276 shutdown_connections 2024-04-26T11:39:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.986+0000 7f310b200640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f30e40a3dc0 0x7f30e40a6280 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.986+0000 7f310b200640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31041137c0 0x7f31041a3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.986+0000 7f310b200640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3104077780 0x7f310419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.986+0000 7f310b200640 1 --2- 172.21.15.110:0/2637452276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3104076e60 0x7f310419f730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.986+0000 7f310b200640 1 -- 172.21.15.110:0/2637452276 >> 172.21.15.110:0/2637452276 conn(0x7f31041005f0 msgr2=0x7f31041029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.986+0000 7f310b200640 1 -- 172.21.15.110:0/2637452276 shutdown_connections 2024-04-26T11:39:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:05.986+0000 7f310b200640 1 -- 172.21.15.110:0/2637452276 wait complete. 2024-04-26T11:39:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:05 smithi196 ceph-mon[32572]: pgmap v247: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 149 op/s 2024-04-26T11:39:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:05 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299993 2024-04-26T11:39:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:05 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:reconnect 2024-04-26T11:39:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:05 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:reconnect 2024-04-26T11:39:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:05 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:reconnect} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:05 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:39:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:05 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:39:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:05 smithi110 ceph-mon[28069]: pgmap v247: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 149 op/s 2024-04-26T11:39:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:05 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299993 2024-04-26T11:39:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:05 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:reconnect 2024-04-26T11:39:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:05 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:reconnect 2024-04-26T11:39:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:05 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:reconnect} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:05 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:39:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:05 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:39:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:05 smithi193 ceph-mon[32782]: pgmap v247: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 149 op/s 2024-04-26T11:39:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:05 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299993 2024-04-26T11:39:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:05 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:reconnect 2024-04-26T11:39:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:05 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:reconnect 2024-04-26T11:39:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:05 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=e=up:reconnect} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:05 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:39:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:05 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:39:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:06 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:rejoin 2024-04-26T11:39:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:06 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:rejoin 2024-04-26T11:39:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:06 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:rejoin} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:06 smithi196 ceph-mon[32572]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:39:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:06 smithi196 ceph-mon[32572]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:39:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:06 smithi196 ceph-mon[32572]: pgmap v248: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 526 KiB/s wr, 69 op/s 2024-04-26T11:39:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:06 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:rejoin 2024-04-26T11:39:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:06 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:rejoin 2024-04-26T11:39:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:06 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:rejoin} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:06 smithi110 ceph-mon[28069]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:39:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:06 smithi110 ceph-mon[28069]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:39:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:06 smithi110 ceph-mon[28069]: pgmap v248: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 526 KiB/s wr, 69 op/s 2024-04-26T11:39:07.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:39:07 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:39:07.203+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T11:39:07.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:39:07 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:39:07.203+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T11:39:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:06 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:rejoin 2024-04-26T11:39:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:06 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:rejoin 2024-04-26T11:39:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:06 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=e=up:rejoin} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:06 smithi193 ceph-mon[32782]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:39:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:06 smithi193 ceph-mon[32782]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:39:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:06 smithi193 ceph-mon[32782]: pgmap v248: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 526 KiB/s wr, 69 op/s 2024-04-26T11:39:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:07 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:39:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:07 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:39:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:07 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:active 2024-04-26T11:39:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:07 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:active 2024-04-26T11:39:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:07 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:07 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:07 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:39:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:07 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:39:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:07 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:active 2024-04-26T11:39:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:07 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:active 2024-04-26T11:39:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:07 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:07 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:07 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:39:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:07 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:39:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:07 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3022150215,v1:172.21.15.196:6835/3022150215] up:active 2024-04-26T11:39:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:07 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/2038926783,v1:172.21.15.193:6835/2038926783] up:active 2024-04-26T11:39:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:07 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:07 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:08 smithi196 ceph-mon[32572]: pgmap v249: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-04-26T11:39:09.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:08 smithi110 ceph-mon[28069]: pgmap v249: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-04-26T11:39:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:08 smithi193 ceph-mon[32782]: pgmap v249: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-04-26T11:39:09.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 415.0 s, 1089.1 tps, lat 362.015 ms stddev 2264.060 2024-04-26T11:39:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:11 smithi193 ceph-mon[32782]: pgmap v250: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1.0 MiB/s wr, 157 op/s 2024-04-26T11:39:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:11 smithi196 ceph-mon[32572]: pgmap v250: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1.0 MiB/s wr, 157 op/s 2024-04-26T11:39:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:11 smithi110 ceph-mon[28069]: pgmap v250: 97 pgs: 97 active+clean; 3.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 1.0 MiB/s wr, 157 op/s 2024-04-26T11:39:12.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff7aaa3b700 time 2024-04-26T11:39:12.005787+0000 2024-04-26T11:39:12.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff7b50643dd] 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7b50645a3] 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613462a1822] 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561346211598] 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561346213c17] 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56134610cd0b] 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56134610d2ac] 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613460f5fad] 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7b52f8e20] 2024-04-26T11:39:12.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 10: (DispatchQueue::entry()+0x51f) [0x7ff7b52f5fdf] 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7b53c8fc1] 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff7b3de21ca] 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 13: clone() 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.006+0000 7ff7aaa3b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff7aaa3b700 time 2024-04-26T11:39:12.005787+0000 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff7b50643dd] 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7b50645a3] 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613462a1822] 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561346211598] 2024-04-26T11:39:12.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561346213c17] 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56134610cd0b] 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56134610d2ac] 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613460f5fad] 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7b52f8e20] 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 10: (DispatchQueue::entry()+0x51f) [0x7ff7b52f5fdf] 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7b53c8fc1] 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff7b3de21ca] 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 13: clone() 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: *** Caught signal (Aborted) ** 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: in thread 7ff7aaa3b700 thread_name:ms_dispatch 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff7b3decd20] 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2: gsignal() 2024-04-26T11:39:12.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 3: abort() 2024-04-26T11:39:12.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff7b5064437] 2024-04-26T11:39:12.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7b50645a3] 2024-04-26T11:39:12.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613462a1822] 2024-04-26T11:39:12.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561346211598] 2024-04-26T11:39:12.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561346213c17] 2024-04-26T11:39:12.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56134610cd0b] 2024-04-26T11:39:12.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56134610d2ac] 2024-04-26T11:39:12.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613460f5fad] 2024-04-26T11:39:12.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7b52f8e20] 2024-04-26T11:39:12.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 13: (DispatchQueue::entry()+0x51f) [0x7ff7b52f5fdf] 2024-04-26T11:39:12.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7b53c8fc1] 2024-04-26T11:39:12.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff7b3de21ca] 2024-04-26T11:39:12.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 16: clone() 2024-04-26T11:39:12.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.007+0000 7ff7aaa3b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: in thread 7ff7aaa3b700 thread_name:ms_dispatch 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff7b3decd20] 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2: gsignal() 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 3: abort() 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff7b5064437] 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7b50645a3] 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613462a1822] 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561346211598] 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561346213c17] 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56134610cd0b] 2024-04-26T11:39:12.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56134610d2ac] 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613460f5fad] 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7b52f8e20] 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 13: (DispatchQueue::entry()+0x51f) [0x7ff7b52f5fdf] 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7b53c8fc1] 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff7b3de21ca] 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 16: clone() 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: -4> 2024-04-26T11:39:12.006+0000 7ff7aaa3b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff7aaa3b700 time 2024-04-26T11:39:12.005787+0000 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff7b50643dd] 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7b50645a3] 2024-04-26T11:39:12.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613462a1822] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561346211598] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561346213c17] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56134610cd0b] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56134610d2ac] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613460f5fad] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7b52f8e20] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 10: (DispatchQueue::entry()+0x51f) [0x7ff7b52f5fdf] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7b53c8fc1] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff7b3de21ca] 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 13: clone() 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 0> 2024-04-26T11:39:12.007+0000 7ff7aaa3b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: in thread 7ff7aaa3b700 thread_name:ms_dispatch 2024-04-26T11:39:12.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff7b3decd20] 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2: gsignal() 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 3: abort() 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff7b5064437] 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7b50645a3] 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613462a1822] 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561346211598] 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561346213c17] 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56134610cd0b] 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56134610d2ac] 2024-04-26T11:39:12.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613460f5fad] 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7b52f8e20] 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 13: (DispatchQueue::entry()+0x51f) [0x7ff7b52f5fdf] 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7b53c8fc1] 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff7b3de21ca] 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 16: clone() 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: -4> 2024-04-26T11:39:12.006+0000 7ff7aaa3b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff7aaa3b700 time 2024-04-26T11:39:12.005787+0000 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff7b50643dd] 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7b50645a3] 2024-04-26T11:39:12.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613462a1822] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561346211598] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561346213c17] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56134610cd0b] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56134610d2ac] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613460f5fad] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7b52f8e20] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 10: (DispatchQueue::entry()+0x51f) [0x7ff7b52f5fdf] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7b53c8fc1] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff7b3de21ca] 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 13: clone() 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 0> 2024-04-26T11:39:12.007+0000 7ff7aaa3b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: in thread 7ff7aaa3b700 thread_name:ms_dispatch 2024-04-26T11:39:12.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff7b3decd20] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2: gsignal() 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 3: abort() 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff7b5064437] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7b50645a3] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613462a1822] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561346211598] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561346213c17] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56134610cd0b] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56134610d2ac] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613460f5fad] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7b52f8e20] 2024-04-26T11:39:12.385 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 13: (DispatchQueue::entry()+0x51f) [0x7ff7b52f5fdf] 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7b53c8fc1] 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff7b3de21ca] 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 16: clone() 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[62181]: 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:12 smithi193 podman[67607]: 2024-04-26 11:39:12.109536889 +0000 UTC m=+0.037732943 container died 0dfb545f153766a0e15f2ef7941dbda06e4ca3e44867798ab7bef3c3e77855b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f811a629700 time 2024-04-26T11:39:12.079094+0000 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8124c523dd] 2024-04-26T11:39:12.386 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8124c525a3] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562789c2b822] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562789b9b598] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562789b9dc17] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562789a96d0b] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562789a972ac] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562789a7ffad] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8124ee6e20] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 10: (DispatchQueue::entry()+0x51f) [0x7f8124ee3fdf] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8124fb6fc1] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f81239d01ca] 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 13: clone() 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.079+0000 7f811a629700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f811a629700 time 2024-04-26T11:39:12.079094+0000 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:12.387 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.388 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.388 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8124c523dd] 2024-04-26T11:39:12.388 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8124c525a3] 2024-04-26T11:39:12.388 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562789c2b822] 2024-04-26T11:39:12.388 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562789b9b598] 2024-04-26T11:39:12.388 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562789b9dc17] 2024-04-26T11:39:12.388 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562789a96d0b] 2024-04-26T11:39:12.388 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562789a972ac] 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562789a7ffad] 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8124ee6e20] 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 10: (DispatchQueue::entry()+0x51f) [0x7f8124ee3fdf] 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8124fb6fc1] 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f81239d01ca] 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 13: clone() 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: *** Caught signal (Aborted) ** 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: in thread 7f811a629700 thread_name:ms_dispatch 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f81239dad20] 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2: gsignal() 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 3: abort() 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8124c52437] 2024-04-26T11:39:12.389 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8124c525a3] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562789c2b822] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562789b9b598] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562789b9dc17] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562789a96d0b] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562789a972ac] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562789a7ffad] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8124ee6e20] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 13: (DispatchQueue::entry()+0x51f) [0x7f8124ee3fdf] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8124fb6fc1] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f81239d01ca] 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 16: clone() 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.081+0000 7f811a629700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: in thread 7f811a629700 thread_name:ms_dispatch 2024-04-26T11:39:12.390 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f81239dad20] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2: gsignal() 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 3: abort() 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8124c52437] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8124c525a3] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562789c2b822] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562789b9b598] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562789b9dc17] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562789a96d0b] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562789a972ac] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562789a7ffad] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8124ee6e20] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 13: (DispatchQueue::entry()+0x51f) [0x7f8124ee3fdf] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8124fb6fc1] 2024-04-26T11:39:12.391 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f81239d01ca] 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 16: clone() 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: -1> 2024-04-26T11:39:12.079+0000 7f811a629700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f811a629700 time 2024-04-26T11:39:12.079094+0000 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8124c523dd] 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8124c525a3] 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562789c2b822] 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562789b9b598] 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562789b9dc17] 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562789a96d0b] 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562789a972ac] 2024-04-26T11:39:12.392 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562789a7ffad] 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8124ee6e20] 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 10: (DispatchQueue::entry()+0x51f) [0x7f8124ee3fdf] 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8124fb6fc1] 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f81239d01ca] 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 13: clone() 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 0> 2024-04-26T11:39:12.081+0000 7f811a629700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: in thread 7f811a629700 thread_name:ms_dispatch 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f81239dad20] 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2: gsignal() 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 3: abort() 2024-04-26T11:39:12.393 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8124c52437] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8124c525a3] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562789c2b822] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562789b9b598] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562789b9dc17] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562789a96d0b] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562789a972ac] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562789a7ffad] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8124ee6e20] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 13: (DispatchQueue::entry()+0x51f) [0x7f8124ee3fdf] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8124fb6fc1] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f81239d01ca] 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 16: clone() 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:12.394 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: -1> 2024-04-26T11:39:12.079+0000 7f811a629700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f811a629700 time 2024-04-26T11:39:12.079094+0000 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8124c523dd] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8124c525a3] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562789c2b822] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562789b9b598] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562789b9dc17] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562789a96d0b] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562789a972ac] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562789a7ffad] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8124ee6e20] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 10: (DispatchQueue::entry()+0x51f) [0x7f8124ee3fdf] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8124fb6fc1] 2024-04-26T11:39:12.395 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f81239d01ca] 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 13: clone() 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 0> 2024-04-26T11:39:12.081+0000 7f811a629700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: in thread 7f811a629700 thread_name:ms_dispatch 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f81239dad20] 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2: gsignal() 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 3: abort() 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8124c52437] 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8124c525a3] 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562789c2b822] 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562789b9b598] 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562789b9dc17] 2024-04-26T11:39:12.396 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562789a96d0b] 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562789a972ac] 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562789a7ffad] 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8124ee6e20] 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 13: (DispatchQueue::entry()+0x51f) [0x7f8124ee3fdf] 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8124fb6fc1] 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f81239d01ca] 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 16: clone() 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[68837]: 2024-04-26T11:39:12.397 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:12 smithi196 podman[69189]: 2024-04-26 11:39:12.141338088 +0000 UTC m=+0.019009436 container died 23463c538f678de847af600854a29a36b29f4ce2544c3bfc1adb3f53a2d609f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T11:39:12.738 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-mon[32782]: osdmap e105: 12 total, 12 up, 12 in 2024-04-26T11:39:12.738 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:12 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-mon[32572]: osdmap e105: 12 total, 12 up, 12 in 2024-04-26T11:39:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:12 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:12 smithi110 ceph-mon[28069]: osdmap e105: 12 total, 12 up, 12 in 2024-04-26T11:39:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:12 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:13.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:13 smithi193 podman[67607]: 2024-04-26 11:39:13.123070096 +0000 UTC m=+1.051266146 container remove 0dfb545f153766a0e15f2ef7941dbda06e4ca3e44867798ab7bef3c3e77855b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:39:13.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:13 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:39:13.647 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:13 smithi196 ceph-mon[32572]: pgmap v252: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 10 MiB/s wr, 881 op/s 2024-04-26T11:39:13.647 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:13 smithi196 podman[69189]: 2024-04-26 11:39:13.401632334 +0000 UTC m=+1.279303666 container remove 23463c538f678de847af600854a29a36b29f4ce2544c3bfc1adb3f53a2d609f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:39:13.647 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:13 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:39:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:13 smithi110 ceph-mon[28069]: pgmap v252: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 10 MiB/s wr, 881 op/s 2024-04-26T11:39:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:13 smithi193 ceph-mon[32782]: pgmap v252: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 10 MiB/s wr, 881 op/s 2024-04-26T11:39:13.872 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:13 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-04-26T11:39:13.872 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:13 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Consumed 2.300s CPU time. 2024-04-26T11:39:14.005 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:13 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T11:39:14.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 420.0 s, 1072.6 tps, lat 39.774 ms stddev 50.276 2024-04-26T11:39:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:15 smithi110 ceph-mon[28069]: pgmap v253: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 18 MiB/s wr, 1.53k op/s 2024-04-26T11:39:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:15 smithi196 ceph-mon[32572]: pgmap v253: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 18 MiB/s wr, 1.53k op/s 2024-04-26T11:39:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:15 smithi193 ceph-mon[32782]: pgmap v253: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 18 MiB/s wr, 1.53k op/s 2024-04-26T11:39:17.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:17 smithi110 ceph-mon[28069]: pgmap v254: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 18 MiB/s wr, 1.53k op/s 2024-04-26T11:39:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:17 smithi196 ceph-mon[32572]: pgmap v254: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 18 MiB/s wr, 1.53k op/s 2024-04-26T11:39:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:17 smithi193 ceph-mon[32782]: pgmap v254: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 18 MiB/s wr, 1.53k op/s 2024-04-26T11:39:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.130+0000 7faa23e00640 1 -- 172.21.15.110:0/3109222383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 msgr2=0x7faa24108b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.130+0000 7faa23e00640 1 --2- 172.21.15.110:0/3109222383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 0x7faa24108b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faa14009930 tx=0x7faa1402a440 comp rx=0 tx=0).stop 2024-04-26T11:39:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.130+0000 7faa23e00640 1 -- 172.21.15.110:0/3109222383 shutdown_connections 2024-04-26T11:39:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.130+0000 7faa23e00640 1 --2- 172.21.15.110:0/3109222383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa241030f0 0x7faa2410f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.130+0000 7faa23e00640 1 --2- 172.21.15.110:0/3109222383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa24102730 0x7faa24102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.130+0000 7faa23e00640 1 --2- 172.21.15.110:0/3109222383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 0x7faa24108b20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.130+0000 7faa23e00640 1 -- 172.21.15.110:0/3109222383 >> 172.21.15.110:0/3109222383 conn(0x7faa240fe280 msgr2=0x7faa241006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.130+0000 7faa23e00640 1 -- 172.21.15.110:0/3109222383 shutdown_connections 2024-04-26T11:39:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.130+0000 7faa23e00640 1 -- 172.21.15.110:0/3109222383 wait complete. 2024-04-26T11:39:19.134 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.131+0000 7faa23e00640 1 Processor -- start 2024-04-26T11:39:19.134 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.131+0000 7faa23e00640 1 -- start start 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa23e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa24102730 0x7faa2419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa23e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa241030f0 0x7faa2419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa23e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 0x7faa2419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa23e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faa24112a50 con 0x7faa24108740 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa23e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faa241128d0 con 0x7faa241030f0 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa23e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faa24112bd0 con 0x7faa24102730 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa23400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 0x7faa2419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa23400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 0x7faa2419fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38316/0 (socket says 172.21.15.110:38316) 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa23400640 1 -- 172.21.15.110:0/988492558 learned_addr learned my addr 172.21.15.110:0/988492558 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa22a00640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa24102730 0x7faa2419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.132+0000 7faa22000640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa241030f0 0x7faa2419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa23400640 1 -- 172.21.15.110:0/988492558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa24102730 msgr2=0x7faa2419b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa23400640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa24102730 0x7faa2419b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa23400640 1 -- 172.21.15.110:0/988492558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa241030f0 msgr2=0x7faa2419b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa23400640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa241030f0 0x7faa2419b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa23400640 1 -- 172.21.15.110:0/988492558 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa241a0190 con 0x7faa24108740 2024-04-26T11:39:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa23400640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 0x7faa2419fa60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00eb10 tx=0x7faa1c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa1b400640 1 -- 172.21.15.110:0/988492558 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c004b20 con 0x7faa24108740 2024-04-26T11:39:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa1b400640 1 -- 172.21.15.110:0/988492558 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa1c004cc0 con 0x7faa24108740 2024-04-26T11:39:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa1b400640 1 -- 172.21.15.110:0/988492558 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c010670 con 0x7faa24108740 2024-04-26T11:39:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa23e00640 1 -- 172.21.15.110:0/988492558 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa241a0480 con 0x7faa24108740 2024-04-26T11:39:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.133+0000 7faa23e00640 1 -- 172.21.15.110:0/988492558 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa241a7d10 con 0x7faa24108740 2024-04-26T11:39:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.138+0000 7faa2c765740 1 Processor -- start 2024-04-26T11:39:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.138+0000 7faa1b400640 1 -- 172.21.15.110:0/988492558 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7faa1c005020 con 0x7faa24108740 2024-04-26T11:39:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.138+0000 7faa2c765740 1 -- start start 2024-04-26T11:39:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.138+0000 7faa2c765740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a85fe0 0x560086a863c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.138+0000 7faa2c765740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a90c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa2c765740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a911c0 0x560086a935b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa2c765740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5600869eb380 con 0x560086a911c0 2024-04-26T11:39:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa2c765740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560086987c30 con 0x560086a86900 2024-04-26T11:39:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa2c765740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5600869e7340 con 0x560086a85fe0 2024-04-26T11:39:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a85fe0 0x560086a863c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a90c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a90c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:35230/0 (socket says 172.21.15.110:35230) 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22a00640 1 -- 172.21.15.110:0/1916140736 learned_addr learned my addr 172.21.15.110:0/1916140736 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22000640 1 --2- 172.21.15.110:0/1916140736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a911c0 0x560086a935b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22a00640 1 -- 172.21.15.110:0/1916140736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a85fe0 msgr2=0x560086a863c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22a00640 1 --2- 172.21.15.110:0/1916140736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a85fe0 0x560086a863c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22a00640 1 -- 172.21.15.110:0/1916140736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a911c0 msgr2=0x560086a935b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22a00640 1 --2- 172.21.15.110:0/1916140736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a911c0 0x560086a935b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22a00640 1 -- 172.21.15.110:0/1916140736 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600869a9940 con 0x560086a86900 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.139+0000 7faa22000640 1 --2- 172.21.15.110:0/1916140736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a911c0 0x560086a935b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.140+0000 7faa22a00640 1 --2- 172.21.15.110:0/1916140736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a90c80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa14006010 tx=0x7faa14004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a41602c6b23897 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.140+0000 7faa1b400640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7faa080a3d10 0x7faa080a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.140+0000 7faa0fe00640 1 -- 172.21.15.110:0/1916140736 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14035040 con 0x560086a86900 2024-04-26T11:39:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.140+0000 7faa0fe00640 1 -- 172.21.15.110:0/1916140736 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa140054f0 con 0x560086a86900 2024-04-26T11:39:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.140+0000 7faa0fe00640 1 -- 172.21.15.110:0/1916140736 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140035f0 con 0x560086a86900 2024-04-26T11:39:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.140+0000 7faa1b400640 1 -- 172.21.15.110:0/988492558 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9375+0+0 (secure 0 0 0) 0x7faa1c0d1090 con 0x7faa24108740 2024-04-26T11:39:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.140+0000 7faa22000640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7faa080a3d10 0x7faa080a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa2c765740 1 -- 172.21.15.110:0/1916140736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 msgr2=0x560086a90c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa22000640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7faa080a3d10 0x7faa080a61d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x560086a83910 tx=0x7faa10013040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa2c765740 1 --2- 172.21.15.110:0/1916140736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a90c80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faa14006010 tx=0x7faa14004040 comp rx=0 tx=0).stop 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa2c765740 1 -- 172.21.15.110:0/1916140736 shutdown_connections 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa2c765740 1 --2- 172.21.15.110:0/1916140736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a911c0 0x560086a935b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa2c765740 1 --2- 172.21.15.110:0/1916140736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a90c80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa2c765740 1 --2- 172.21.15.110:0/1916140736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a85fe0 0x560086a863c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa2c765740 1 -- 172.21.15.110:0/1916140736 >> 172.21.15.110:0/1916140736 conn(0x560086a824f0 msgr2=0x560086a828d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa2c765740 1 -- 172.21.15.110:0/1916140736 shutdown_connections 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.141+0000 7faa2c765740 1 -- 172.21.15.110:0/1916140736 wait complete. 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.142+0000 7faa2c765740 1 -- start start 2024-04-26T11:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.142+0000 7faa2c765740 1 Processor -- start 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.142+0000 7faa2c765740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.142+0000 7faa2c765740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a86900 0x560086a8e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.142+0000 7faa2c765740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a911c0 0x560086a8ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.142+0000 7faa2c765740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560086a93d90 con 0x560086a85fe0 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa2c765740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560086972c60 con 0x560086a911c0 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa2c765740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560086a93f10 con 0x560086a86900 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa2c765740 10 client.0 _ll_register_callbacks cb 0x56008699ee50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa22a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa22a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38344/0 (socket says 172.21.15.110:38344) 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa22a00640 1 -- 172.21.15.110:0/461788964 learned_addr learned my addr 172.21.15.110:0/461788964 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa23400640 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a911c0 0x560086a8ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa22000640 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a86900 0x560086a8e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa23400640 1 -- 172.21.15.110:0/461788964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a86900 msgr2=0x560086a8e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa23400640 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a86900 0x560086a8e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa23400640 1 -- 172.21.15.110:0/461788964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 msgr2=0x560086a8e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa23400640 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa23400640 1 -- 172.21.15.110:0/461788964 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560086981510 con 0x560086a911c0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.143+0000 7faa22a00640 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa23400640 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a911c0 0x560086a8ec00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0ce430 tx=0x7faa1c09c5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad113a08d7b02051 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa0cc00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa0cc00640 1 -- 172.21.15.110:0/461788964 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c09d0e0 con 0x560086a911c0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa0cc00640 1 -- 172.21.15.110:0/461788964 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9375+0+0 (secure 0 0 0) 0x7faa1c0bd070 con 0x560086a911c0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa2c765740 1 -- 172.21.15.110:0/461788964 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa140054f0 con 0x560086a911c0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa0cc00640 1 -- 172.21.15.110:0/461788964 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7faa1c0b6200 con 0x560086a911c0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa2c765740 10 client.25988 fetch_fsmap learned FSMap version 91 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa2c765740 1 -- 172.21.15.110:0/461788964 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) -- 0x5600866fd210 con 0x560086a911c0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa0cc00640 1 -- 172.21.15.110:0/461788964 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa140054f0 con 0x560086a911c0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa0cc00640 1 -- 172.21.15.110:0/461788964 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 91) ==== 8346+0+0 (secure 0 0 0) 0x7faa1c0ceb80 con 0x560086a911c0 2024-04-26T11:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa2c765740 10 client.25988 fetch_fsmap finished waiting for FSMap version 91 2024-04-26T11:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.144+0000 7faa2c765740 10 client.25988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.145+0000 7faa2c765740 20 client.25988 populate_metadata read hostname 'smithi110' 2024-04-26T11:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.145+0000 7faa2c765740 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560086aa0e90 0x560086aa32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.145+0000 7faa2c765740 4 client.25988 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.145+0000 7faa2c765740 1 -- 172.21.15.110:0/461788964 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600869f8f90 con 0x560086aa0e90 2024-04-26T11:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.145+0000 7faa22a00640 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560086aa0e90 0x560086aa32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.145+0000 7faa22a00640 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560086aa0e90 0x560086aa32a0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71017c9bed339541 server_cookie=e98b41b344e3586f in_seq=0 out_seq=0 2024-04-26T11:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.145+0000 7faa0cc00640 10 client.25988 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.146+0000 7faa0cc00640 1 -- 172.21.15.110:0/461788964 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5600869f8f90 con 0x560086aa0e90 2024-04-26T11:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.146+0000 7faa0cc00640 10 client.25988 handle_command_reply: tid=0 2024-04-26T11:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.146+0000 7faa2c765740 1 client.25988 shutdown 2024-04-26T11:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.146+0000 7faa2c765740 1 -- 172.21.15.110:0/461788964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a911c0 msgr2=0x560086a8ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.146+0000 7faa2c765740 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a911c0 0x560086a8ec00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0ce430 tx=0x7faa1c09c5e0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa2c765740 1 -- 172.21.15.110:0/461788964 shutdown_connections 2024-04-26T11:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa2c765740 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a911c0 0x560086a8ec00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa2c765740 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560086aa0e90 0x560086aa32a0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa2c765740 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a86900 0x560086a8e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa0cc00640 0 client.25988 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa2c765740 1 --2- 172.21.15.110:0/461788964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa2c765740 1 -- 172.21.15.110:0/461788964 >> 172.21.15.110:0/461788964 conn(0x560086a824f0 msgr2=0x560086a88220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa2c765740 1 -- 172.21.15.110:0/461788964 shutdown_connections 2024-04-26T11:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa2c765740 1 -- 172.21.15.110:0/461788964 wait complete. 2024-04-26T11:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.147+0000 7faa2c765740 20 client.25988 trim_cache size 0 max 16384 2024-04-26T11:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.163+0000 7faa2c765740 1 Processor -- start 2024-04-26T11:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.163+0000 7faa2c765740 1 -- start start 2024-04-26T11:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.163+0000 7faa2c765740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a85fe0 0x560086a9cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.163+0000 7faa2c765740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a86900 0x560086a889a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.163+0000 7faa2c765740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 0x560086aa8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.163+0000 7faa2c765740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faa241b38f0 con 0x560086a86900 2024-04-26T11:39:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.163+0000 7faa2c765740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faa241b1190 con 0x560086a85fe0 2024-04-26T11:39:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.163+0000 7faa2c765740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faa241af000 con 0x560086a911c0 2024-04-26T11:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa22a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a85fe0 0x560086a9cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa22a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a85fe0 0x560086a9cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:35246/0 (socket says 172.21.15.110:35246) 2024-04-26T11:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa22a00640 1 -- 172.21.15.110:0/324922856 learned_addr learned my addr 172.21.15.110:0/324922856 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa23400640 1 --2- 172.21.15.110:0/324922856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 0x560086aa8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa22a00640 1 -- 172.21.15.110:0/324922856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 msgr2=0x560086aa8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa22000640 1 --2- 172.21.15.110:0/324922856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a86900 0x560086a889a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa22a00640 1 --2- 172.21.15.110:0/324922856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 0x560086aa8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa22a00640 1 -- 172.21.15.110:0/324922856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a86900 msgr2=0x560086a889a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa22a00640 1 --2- 172.21.15.110:0/324922856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a86900 0x560086a889a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.164+0000 7faa22a00640 1 -- 172.21.15.110:0/324922856 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600867c9620 con 0x560086a85fe0 2024-04-26T11:39:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.165+0000 7faa22a00640 1 --2- 172.21.15.110:0/324922856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a85fe0 0x560086a9cc50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa14006010 tx=0x7faa14004b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7bdb54a909e4049 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.165+0000 7faa0f400640 1 -- 172.21.15.110:0/324922856 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14055020 con 0x560086a85fe0 2024-04-26T11:39:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.165+0000 7faa0f400640 1 -- 172.21.15.110:0/324922856 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa140048c0 con 0x560086a85fe0 2024-04-26T11:39:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.165+0000 7faa0f400640 1 -- 172.21.15.110:0/324922856 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14035040 con 0x560086a85fe0 2024-04-26T11:39:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 -- 172.21.15.110:0/324922856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a85fe0 msgr2=0x560086a9cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 --2- 172.21.15.110:0/324922856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a85fe0 0x560086a9cc50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7faa14006010 tx=0x7faa14004b20 comp rx=0 tx=0).stop 2024-04-26T11:39:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 -- 172.21.15.110:0/324922856 shutdown_connections 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 --2- 172.21.15.110:0/324922856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 0x560086aa8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 --2- 172.21.15.110:0/324922856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a86900 0x560086a889a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 --2- 172.21.15.110:0/324922856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a85fe0 0x560086a9cc50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 -- 172.21.15.110:0/324922856 >> 172.21.15.110:0/324922856 conn(0x560086a824f0 msgr2=0x560086a90130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 -- 172.21.15.110:0/324922856 shutdown_connections 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 -- 172.21.15.110:0/324922856 wait complete. 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 -- start start 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.166+0000 7faa2c765740 1 Processor -- start 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa2c765740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa2c765740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a8b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa2c765740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 0x560086a8b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa2c765740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faa241af650 con 0x560086a85fe0 2024-04-26T11:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa2c765740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faa241b0ac0 con 0x560086a86900 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa2c765740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faa241afd20 con 0x560086a911c0 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa2c765740 10 client.0 _ll_register_callbacks cb 0x7faa1c09ca50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa22a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa22000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a8b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa22a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38370/0 (socket says 172.21.15.110:38370) 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa22a00640 1 -- 172.21.15.110:0/1541755556 learned_addr learned my addr 172.21.15.110:0/1541755556 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.167+0000 7faa23400640 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 0x560086a8b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa23400640 1 -- 172.21.15.110:0/1541755556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 msgr2=0x560086a8b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa23400640 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a8b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa23400640 1 -- 172.21.15.110:0/1541755556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 msgr2=0x560086a8add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa23400640 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa23400640 1 -- 172.21.15.110:0/1541755556 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600869a5cb0 con 0x560086a911c0 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa22a00640 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa22000640 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a8b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa23400640 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 0x560086a8b850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x560086a8f5e0 tx=0x7faa1c09c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6311f600d4150b82 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa0cc00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa0cc00640 1 -- 172.21.15.110:0/1541755556 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c09d0e0 con 0x560086a911c0 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa2c765740 1 -- 172.21.15.110:0/1541755556 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa140048c0 con 0x560086a911c0 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa0cc00640 1 -- 172.21.15.110:0/1541755556 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9375+0+0 (secure 0 0 0) 0x7faa1c09c0d0 con 0x560086a911c0 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa0cc00640 1 -- 172.21.15.110:0/1541755556 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7faa1c09d380 con 0x560086a911c0 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa2c765740 10 client.26032 fetch_fsmap learned FSMap version 91 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.168+0000 7faa2c765740 1 -- 172.21.15.110:0/1541755556 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) -- 0x560086b074a0 con 0x560086a911c0 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.169+0000 7faa0cc00640 1 -- 172.21.15.110:0/1541755556 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa140048c0 con 0x560086a911c0 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.169+0000 7faa0cc00640 1 -- 172.21.15.110:0/1541755556 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 91) ==== 8346+0+0 (secure 0 0 0) 0x7faa1c0a5520 con 0x560086a911c0 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.169+0000 7faa2c765740 10 client.26032 fetch_fsmap finished waiting for FSMap version 91 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.169+0000 7faa2c765740 10 client.26032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.169+0000 7faa2c765740 20 client.26032 populate_metadata read hostname 'smithi110' 2024-04-26T11:39:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.169+0000 7faa2c765740 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560086b07c40 0x560086b0a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.169+0000 7faa2c765740 4 client.26032 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:39:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.169+0000 7faa2c765740 1 -- 172.21.15.110:0/1541755556 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5600869f2e00 con 0x560086b07c40 2024-04-26T11:39:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.169+0000 7faa22a00640 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560086b07c40 0x560086b0a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.170+0000 7faa22a00640 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560086b07c40 0x560086b0a060 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32bf9908b6e7e5e server_cookie=376f743c0eb30981 in_seq=0 out_seq=0 2024-04-26T11:39:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:19.170+0000 7faa0cc00640 10 client.26032 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:39:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:19 smithi110 ceph-mon[28069]: pgmap v255: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 19 MiB/s wr, 1.63k op/s 2024-04-26T11:39:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:19 smithi110 ceph-mon[28069]: osdmap e106: 12 total, 12 up, 12 in 2024-04-26T11:39:19.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 425.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:39:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:19 smithi196 ceph-mon[32572]: pgmap v255: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 19 MiB/s wr, 1.63k op/s 2024-04-26T11:39:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:19 smithi196 ceph-mon[32572]: osdmap e106: 12 total, 12 up, 12 in 2024-04-26T11:39:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:19 smithi193 ceph-mon[32782]: pgmap v255: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 19 MiB/s wr, 1.63k op/s 2024-04-26T11:39:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:19 smithi193 ceph-mon[32782]: osdmap e106: 12 total, 12 up, 12 in 2024-04-26T11:39:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:21 smithi196 ceph-mon[32572]: pgmap v257: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 1.82k op/s 2024-04-26T11:39:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:21 smithi110 ceph-mon[28069]: pgmap v257: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 1.82k op/s 2024-04-26T11:39:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:21 smithi193 ceph-mon[32782]: pgmap v257: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 1.82k op/s 2024-04-26T11:39:23.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:23 smithi193 ceph-mon[32782]: pgmap v258: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 923 op/s 2024-04-26T11:39:23.874 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:23 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:39:23.874 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:23 smithi193 systemd[1]: Stopped Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:39:23.874 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:23 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Consumed 2.300s CPU time. 2024-04-26T11:39:23.874 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:23 smithi193 systemd[1]: Starting Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:39:23.874 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:23 smithi193 podman[67707]: 2024-04-26 11:39:23.762037853 +0000 UTC m=+0.017945716 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:39:23.874 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:23 smithi193 podman[67707]: 2024-04-26 11:39:23.8740411 +0000 UTC m=+0.129948926 container create 4f297db6bbd96ae9b768569a19c7c74536fa3ff0ed54d4b1aa08eaad847e5916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-26T11:39:23.985 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:23 smithi196 ceph-mon[32572]: pgmap v258: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 923 op/s 2024-04-26T11:39:23.986 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:23 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 4. 2024-04-26T11:39:23.986 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:23 smithi196 systemd[1]: Stopped Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:39:23.986 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:23 smithi196 systemd[1]: Starting Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:39:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:23 smithi110 ceph-mon[28069]: pgmap v258: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 923 op/s 2024-04-26T11:39:24.145 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:24 smithi193 podman[67707]: 2024-04-26 11:39:24.119658383 +0000 UTC m=+0.375566208 container init 4f297db6bbd96ae9b768569a19c7c74536fa3ff0ed54d4b1aa08eaad847e5916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-04-26T11:39:24.145 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:24 smithi193 podman[67707]: 2024-04-26 11:39:24.122547482 +0000 UTC m=+0.378455316 container start 4f297db6bbd96ae9b768569a19c7c74536fa3ff0ed54d4b1aa08eaad847e5916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T11:39:24.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:23 smithi196 podman[69281]: 2024-04-26 11:39:23.985922047 +0000 UTC m=+0.098348223 container create 7c2f32f6be3d35221a90e905d84b8e6c99cf0382ac58cb8a9c1089b917d0526a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:39:24.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:24 smithi196 podman[69281]: 2024-04-26 11:39:23.906066733 +0000 UTC m=+0.018492923 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:39:24.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:24 smithi196 podman[69281]: 2024-04-26 11:39:24.205386229 +0000 UTC m=+0.317812404 container init 7c2f32f6be3d35221a90e905d84b8e6c99cf0382ac58cb8a9c1089b917d0526a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T11:39:24.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:24 smithi196 podman[69281]: 2024-04-26 11:39:24.208139566 +0000 UTC m=+0.320565745 container start 7c2f32f6be3d35221a90e905d84b8e6c99cf0382ac58cb8a9c1089b917d0526a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T11:39:24.256 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mds[69300]: -- 172.21.15.196:0/2062929023 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558623f47a40 con 0x558623f1a800 2024-04-26T11:39:24.256 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: starting mds.f at 2024-04-26T11:39:24.622 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mds[67727]: -- 172.21.15.193:0/3416370657 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e001ccba40 con 0x55e001c9ec00 2024-04-26T11:39:24.622 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: starting mds.e at 2024-04-26T11:39:24.622 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:24 smithi193 bash[67707]: 4f297db6bbd96ae9b768569a19c7c74536fa3ff0ed54d4b1aa08eaad847e5916 2024-04-26T11:39:24.622 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:24 smithi193 systemd[1]: Started Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:39:24.650 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:24 smithi196 bash[69281]: 7c2f32f6be3d35221a90e905d84b8e6c99cf0382ac58cb8a9c1089b917d0526a 2024-04-26T11:39:24.651 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:39:24 smithi196 systemd[1]: Started Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:39:24.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:39:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: daemon mds.e restarted 2024-04-26T11:39:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:39:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: osdmap e107: 12 total, 12 up, 12 in 2024-04-26T11:39:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:boot 2024-04-26T11:39:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T11:39:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=f=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:39:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:39:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:active,2=c=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: daemon mds.f restarted 2024-04-26T11:39:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: osdmap e108: 12 total, 12 up, 12 in 2024-04-26T11:39:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:boot 2024-04-26T11:39:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:39:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:replay} 2 up:standby-replay 8 up:standby, 1 failed 2024-04-26T11:39:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:39:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:24 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:replay} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: daemon mds.e restarted 2024-04-26T11:39:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:39:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: osdmap e107: 12 total, 12 up, 12 in 2024-04-26T11:39:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:boot 2024-04-26T11:39:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T11:39:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=f=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:39:25.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:39:25.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:active,2=c=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:25.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: daemon mds.f restarted 2024-04-26T11:39:25.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: osdmap e108: 12 total, 12 up, 12 in 2024-04-26T11:39:25.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:boot 2024-04-26T11:39:25.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:39:25.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:replay} 2 up:standby-replay 8 up:standby, 1 failed 2024-04-26T11:39:25.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:39:25.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:24 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:replay} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: daemon mds.e restarted 2024-04-26T11:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: osdmap e107: 12 total, 12 up, 12 in 2024-04-26T11:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:boot 2024-04-26T11:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T11:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=f=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:active,2=c=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: daemon mds.f restarted 2024-04-26T11:39:25.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: osdmap e108: 12 total, 12 up, 12 in 2024-04-26T11:39:25.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:boot 2024-04-26T11:39:25.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: Standby daemon mds.i assigned to filesystem cephfs as rank 1 2024-04-26T11:39:25.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:replay} 2 up:standby-replay 8 up:standby, 1 failed 2024-04-26T11:39:25.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:39:25.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:24 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:replay,2=c=up:replay} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:25 smithi196 ceph-mon[32572]: pgmap v261: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-04-26T11:39:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:25 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:resolve 2024-04-26T11:39:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:25 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:resolve 2024-04-26T11:39:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:25 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:resolve} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:25 smithi110 ceph-mon[28069]: pgmap v261: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-04-26T11:39:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:25 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:resolve 2024-04-26T11:39:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:25 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:resolve 2024-04-26T11:39:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:25 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:resolve} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:25 smithi193 ceph-mon[32782]: pgmap v261: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-04-26T11:39:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:25 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:resolve 2024-04-26T11:39:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:25 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:resolve 2024-04-26T11:39:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:25 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:resolve,2=c=up:resolve} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.294+0000 7faa0cc00640 1 -- 172.21.15.110:0/1541755556 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5600869f2e00 con 0x560086b07c40 2024-04-26T11:39:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.294+0000 7faa0cc00640 10 client.26032 handle_command_reply: tid=0 2024-04-26T11:39:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.294+0000 7faa2c765740 1 client.26032 shutdown 2024-04-26T11:39:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa2c765740 1 -- 172.21.15.110:0/1541755556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 msgr2=0x560086a8b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa2c765740 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 0x560086a8b850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x560086a8f5e0 tx=0x7faa1c09c710 comp rx=0 tx=0).stop 2024-04-26T11:39:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa2c765740 1 -- 172.21.15.110:0/1541755556 shutdown_connections 2024-04-26T11:39:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa2c765740 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x560086b07c40 0x560086b0a060 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa2c765740 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560086a911c0 0x560086a8b850 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa2c765740 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560086a86900 0x560086a8b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa2c765740 1 --2- 172.21.15.110:0/1541755556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560086a85fe0 0x560086a8add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa0cc00640 0 client.26032 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:39:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa2c765740 1 -- 172.21.15.110:0/1541755556 >> 172.21.15.110:0/1541755556 conn(0x560086a824f0 msgr2=0x560086a81650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.295+0000 7faa2c765740 1 -- 172.21.15.110:0/1541755556 shutdown_connections 2024-04-26T11:39:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.296+0000 7faa2c765740 1 -- 172.21.15.110:0/1541755556 wait complete. 2024-04-26T11:39:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.296+0000 7faa2c765740 20 client.26032 trim_cache size 0 max 16384 2024-04-26T11:39:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:39:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:39:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:39:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:39:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 -- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7faa080a3d10 msgr2=0x7faa080a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7faa080a3d10 0x7faa080a61d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x560086a83910 tx=0x7faa10013040 comp rx=0 tx=0).stop 2024-04-26T11:39:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 -- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 msgr2=0x7faa2419fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 0x7faa2419fa60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00eb10 tx=0x7faa1c00c2d0 comp rx=0 tx=0).stop 2024-04-26T11:39:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 -- 172.21.15.110:0/988492558 shutdown_connections 2024-04-26T11:39:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7faa080a3d10 0x7faa080a61d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa24108740 0x7faa2419fa60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faa241030f0 0x7faa2419b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 --2- 172.21.15.110:0/988492558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faa24102730 0x7faa2419b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 -- 172.21.15.110:0/988492558 >> 172.21.15.110:0/988492558 conn(0x7faa240fe280 msgr2=0x7faa240fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 -- 172.21.15.110:0/988492558 shutdown_connections 2024-04-26T11:39:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:27.297+0000 7faa23e00640 1 -- 172.21.15.110:0/988492558 wait complete. 2024-04-26T11:39:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:27 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:reconnect 2024-04-26T11:39:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:27 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:reconnect 2024-04-26T11:39:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:27 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:27 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.0169996 2024-04-26T11:39:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:27 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0169996 2024-04-26T11:39:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:27 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0169996 2024-04-26T11:39:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:27 smithi110 ceph-mon[28069]: pgmap v262: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 949 KiB/s wr, 104 op/s 2024-04-26T11:39:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:27 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:reconnect 2024-04-26T11:39:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:27 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:reconnect 2024-04-26T11:39:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:27 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:27 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.0169996 2024-04-26T11:39:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:27 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0169996 2024-04-26T11:39:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:27 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0169996 2024-04-26T11:39:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:27 smithi193 ceph-mon[32782]: pgmap v262: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 949 KiB/s wr, 104 op/s 2024-04-26T11:39:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:27 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:reconnect 2024-04-26T11:39:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:27 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:reconnect 2024-04-26T11:39:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:27 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:27 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.0169996 2024-04-26T11:39:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:27 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0169996 2024-04-26T11:39:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:27 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0169996 2024-04-26T11:39:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:27 smithi196 ceph-mon[32572]: pgmap v262: 97 pgs: 97 active+clean; 3.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 949 KiB/s wr, 104 op/s 2024-04-26T11:39:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:28 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:rejoin 2024-04-26T11:39:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:28 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:rejoin 2024-04-26T11:39:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:28 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:28 smithi110 ceph-mon[28069]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:39:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:28 smithi110 ceph-mon[28069]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T11:39:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:28 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:rejoin 2024-04-26T11:39:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:28 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:rejoin 2024-04-26T11:39:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:28 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:28 smithi193 ceph-mon[32782]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:39:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:28 smithi193 ceph-mon[32782]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T11:39:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:28 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:rejoin 2024-04-26T11:39:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:28 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:rejoin 2024-04-26T11:39:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:28 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:28 smithi196 ceph-mon[32572]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-26T11:39:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:28 smithi196 ceph-mon[32572]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T11:39:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:29 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:39:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:29 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:39:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:29 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:active 2024-04-26T11:39:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:29 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:active 2024-04-26T11:39:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:29 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:29 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:29.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:29 smithi110 ceph-mon[28069]: pgmap v263: 97 pgs: 97 active+clean; 3.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-04-26T11:39:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:29 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:39:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:29 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:39:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:29 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:active 2024-04-26T11:39:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:29 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:active 2024-04-26T11:39:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:29 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:29 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:29 smithi193 ceph-mon[32782]: pgmap v263: 97 pgs: 97 active+clean; 3.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-04-26T11:39:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:29 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:39:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:29 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:39:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:29 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6838/666544250,v1:172.21.15.196:6839/666544250] up:active 2024-04-26T11:39:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:29 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/1775476297,v1:172.21.15.196:6837/1775476297] up:active 2024-04-26T11:39:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:29 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 1 up:standby-replay 8 up:standby 2024-04-26T11:39:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:29 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:29 smithi196 ceph-mon[32572]: pgmap v263: 97 pgs: 97 active+clean; 3.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 168 op/s 2024-04-26T11:39:29.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 435.0 s, 714.1 tps, lat 500.975 ms stddev 2693.694 2024-04-26T11:39:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:31 smithi193 ceph-mon[32782]: pgmap v264: 97 pgs: 97 active+clean; 3.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1015 KiB/s wr, 114 op/s 2024-04-26T11:39:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:31 smithi196 ceph-mon[32572]: pgmap v264: 97 pgs: 97 active+clean; 3.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1015 KiB/s wr, 114 op/s 2024-04-26T11:39:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:31 smithi110 ceph-mon[28069]: pgmap v264: 97 pgs: 97 active+clean; 3.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1015 KiB/s wr, 114 op/s 2024-04-26T11:39:33.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-mon[32572]: pgmap v265: 97 pgs: 97 active+clean; 3.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.8 MiB/s wr, 254 op/s 2024-04-26T11:39:33.685 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3f29b8b700 time 2024-04-26T11:39:33.307518+0000 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3f341b43dd] 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f341b45a3] 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55894504c822] 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558944fbc598] 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558944fbec17] 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558944eb7d0b] 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558944eb82ac] 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558944ea0fad] 2024-04-26T11:39:33.686 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f34448e20] 2024-04-26T11:39:33.687 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 10: (DispatchQueue::entry()+0x51f) [0x7f3f34445fdf] 2024-04-26T11:39:33.687 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f34518fc1] 2024-04-26T11:39:33.687 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3f32f321ca] 2024-04-26T11:39:33.687 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 13: clone() 2024-04-26T11:39:33.687 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.307+0000 7f3f29b8b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3f29b8b700 time 2024-04-26T11:39:33.307518+0000 2024-04-26T11:39:33.687 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:33.687 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3f341b43dd] 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f341b45a3] 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55894504c822] 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558944fbc598] 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558944fbec17] 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558944eb7d0b] 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558944eb82ac] 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558944ea0fad] 2024-04-26T11:39:33.688 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f34448e20] 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 10: (DispatchQueue::entry()+0x51f) [0x7f3f34445fdf] 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f34518fc1] 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3f32f321ca] 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 13: clone() 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: *** Caught signal (Aborted) ** 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: in thread 7f3f29b8b700 thread_name:ms_dispatch 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3f32f3cd20] 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2: gsignal() 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 3: abort() 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3f341b4437] 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f341b45a3] 2024-04-26T11:39:33.689 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55894504c822] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558944fbc598] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558944fbec17] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558944eb7d0b] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558944eb82ac] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558944ea0fad] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f34448e20] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 13: (DispatchQueue::entry()+0x51f) [0x7f3f34445fdf] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f34518fc1] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3f32f321ca] 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 16: clone() 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.309+0000 7f3f29b8b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: in thread 7f3f29b8b700 thread_name:ms_dispatch 2024-04-26T11:39:33.690 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3f32f3cd20] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2: gsignal() 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 3: abort() 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3f341b4437] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f341b45a3] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55894504c822] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558944fbc598] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558944fbec17] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558944eb7d0b] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558944eb82ac] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558944ea0fad] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f34448e20] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 13: (DispatchQueue::entry()+0x51f) [0x7f3f34445fdf] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f34518fc1] 2024-04-26T11:39:33.691 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3f32f321ca] 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 16: clone() 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: -1> 2024-04-26T11:39:33.307+0000 7f3f29b8b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3f29b8b700 time 2024-04-26T11:39:33.307518+0000 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3f341b43dd] 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f341b45a3] 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55894504c822] 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558944fbc598] 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558944fbec17] 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558944eb7d0b] 2024-04-26T11:39:33.692 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558944eb82ac] 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558944ea0fad] 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f34448e20] 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 10: (DispatchQueue::entry()+0x51f) [0x7f3f34445fdf] 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f34518fc1] 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3f32f321ca] 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 13: clone() 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 0> 2024-04-26T11:39:33.309+0000 7f3f29b8b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: in thread 7f3f29b8b700 thread_name:ms_dispatch 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3f32f3cd20] 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2: gsignal() 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 3: abort() 2024-04-26T11:39:33.693 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3f341b4437] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f341b45a3] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55894504c822] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558944fbc598] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558944fbec17] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558944eb7d0b] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558944eb82ac] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558944ea0fad] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f34448e20] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 13: (DispatchQueue::entry()+0x51f) [0x7f3f34445fdf] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f34518fc1] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3f32f321ca] 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 16: clone() 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.694 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: -1> 2024-04-26T11:39:33.307+0000 7f3f29b8b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3f29b8b700 time 2024-04-26T11:39:33.307518+0000 2024-04-26T11:39:33.695 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:33.695 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.695 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:33.695 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3f341b43dd] 2024-04-26T11:39:33.695 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f341b45a3] 2024-04-26T11:39:33.695 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55894504c822] 2024-04-26T11:39:33.695 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558944fbc598] 2024-04-26T11:39:33.695 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558944fbec17] 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558944eb7d0b] 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558944eb82ac] 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558944ea0fad] 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f34448e20] 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 10: (DispatchQueue::entry()+0x51f) [0x7f3f34445fdf] 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f34518fc1] 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3f32f321ca] 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 13: clone() 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 0> 2024-04-26T11:39:33.309+0000 7f3f29b8b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: in thread 7f3f29b8b700 thread_name:ms_dispatch 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3f32f3cd20] 2024-04-26T11:39:33.696 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2: gsignal() 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 3: abort() 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3f341b4437] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f341b45a3] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55894504c822] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558944fbc598] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558944fbec17] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558944eb7d0b] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558944eb82ac] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558944ea0fad] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f34448e20] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 13: (DispatchQueue::entry()+0x51f) [0x7f3f34445fdf] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f34518fc1] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3f32f321ca] 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 16: clone() 2024-04-26T11:39:33.697 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:33.698 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69043]: 2024-04-26T11:39:33.698 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 podman[69339]: 2024-04-26 11:39:33.368623884 +0000 UTC m=+0.020345561 container died bf90020858bf21129914789487b5514ca608ab46b0d8e5704b67bad9df9ceba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T11:39:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:33 smithi110 ceph-mon[28069]: pgmap v265: 97 pgs: 97 active+clean; 3.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.8 MiB/s wr, 254 op/s 2024-04-26T11:39:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:33 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:33 smithi193 ceph-mon[32782]: pgmap v265: 97 pgs: 97 active+clean; 3.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.8 MiB/s wr, 254 op/s 2024-04-26T11:39:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:33 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:34.246 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 podman[69339]: 2024-04-26 11:39:33.98623564 +0000 UTC m=+0.637957319 container remove bf90020858bf21129914789487b5514ca608ab46b0d8e5704b67bad9df9ceba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2) 2024-04-26T11:39:34.247 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:33 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:39:34.755 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:34 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T11:39:34.755 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:34 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.129s CPU time. 2024-04-26T11:39:34.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 440.0 s, 2643.6 tps, lat 37.671 ms stddev 43.803 2024-04-26T11:39:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:35 smithi196 ceph-mon[32572]: pgmap v266: 97 pgs: 97 active+clean; 3.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 3.5 MiB/s wr, 318 op/s 2024-04-26T11:39:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:35 smithi110 ceph-mon[28069]: pgmap v266: 97 pgs: 97 active+clean; 3.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 3.5 MiB/s wr, 318 op/s 2024-04-26T11:39:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:35 smithi193 ceph-mon[32782]: pgmap v266: 97 pgs: 97 active+clean; 3.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 3.5 MiB/s wr, 318 op/s 2024-04-26T11:39:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:37 smithi110 ceph-mon[28069]: pgmap v267: 97 pgs: 97 active+clean; 3.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 2.9 MiB/s wr, 266 op/s 2024-04-26T11:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:37 smithi196 ceph-mon[32572]: pgmap v267: 97 pgs: 97 active+clean; 3.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 2.9 MiB/s wr, 266 op/s 2024-04-26T11:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:37 smithi193 ceph-mon[32782]: pgmap v267: 97 pgs: 97 active+clean; 3.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 2.9 MiB/s wr, 266 op/s 2024-04-26T11:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:39:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:39:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:39 smithi196 ceph-mon[32572]: pgmap v268: 97 pgs: 97 active+clean; 3.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 6.4 MiB/s wr, 552 op/s 2024-04-26T11:39:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:39:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:39:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:39 smithi110 ceph-mon[28069]: pgmap v268: 97 pgs: 97 active+clean; 3.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 6.4 MiB/s wr, 552 op/s 2024-04-26T11:39:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:39:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:39:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:39 smithi193 ceph-mon[32782]: pgmap v268: 97 pgs: 97 active+clean; 3.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 6.4 MiB/s wr, 552 op/s 2024-04-26T11:39:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:39:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:39:39.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 445.0 s, 949.2 tps, lat 32.735 ms stddev 36.250 2024-04-26T11:39:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.448+0000 7f1707800640 1 -- 172.21.15.110:0/1164283807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17001137b0 msgr2=0x7f1700115ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.448+0000 7f1707800640 1 --2- 172.21.15.110:0/1164283807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17001137b0 0x7f1700115ba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009cd0 tx=0x7f16f802a8e0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.448+0000 7f1707800640 1 -- 172.21.15.110:0/1164283807 shutdown_connections 2024-04-26T11:39:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.448+0000 7f1707800640 1 --2- 172.21.15.110:0/1164283807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17001137b0 0x7f1700115ba0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.448+0000 7f1707800640 1 --2- 172.21.15.110:0/1164283807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1700077780 0x7f1700113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.448+0000 7f1707800640 1 --2- 172.21.15.110:0/1164283807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1700076e60 0x7f1700077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.448+0000 7f1707800640 1 -- 172.21.15.110:0/1164283807 >> 172.21.15.110:0/1164283807 conn(0x7f1700100620 msgr2=0x7f1700102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.448+0000 7f1707800640 1 -- 172.21.15.110:0/1164283807 shutdown_connections 2024-04-26T11:39:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.448+0000 7f1707800640 1 -- 172.21.15.110:0/1164283807 wait complete. 2024-04-26T11:39:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.449+0000 7f1707800640 1 Processor -- start 2024-04-26T11:39:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.449+0000 7f1707800640 1 -- start start 2024-04-26T11:39:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1707800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1700076e60 0x7f170019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1707800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1700077780 0x7f170019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1707800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17001137b0 0x7f17001a3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1707800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f17001191d0 con 0x7f1700077780 2024-04-26T11:39:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1707800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1700119050 con 0x7f1700076e60 2024-04-26T11:39:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1707800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1700119350 con 0x7f17001137b0 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1700077780 0x7f170019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1704e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1700076e60 0x7f170019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1704e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1700076e60 0x7f170019f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:48776/0 (socket says 172.21.15.110:48776) 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1704e00640 1 -- 172.21.15.110:0/1151524485 learned_addr learned my addr 172.21.15.110:0/1151524485 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1705800640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17001137b0 0x7f17001a3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f16f7e00640 1 -- 172.21.15.110:0/1151524485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17001137b0 msgr2=0x7f17001a3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f16f7e00640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17001137b0 0x7f17001a3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f16f7e00640 1 -- 172.21.15.110:0/1151524485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1700076e60 msgr2=0x7f170019f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f16f7e00640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1700076e60 0x7f170019f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f16f7e00640 1 -- 172.21.15.110:0/1151524485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17001a46e0 con 0x7f1700077780 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.450+0000 7f1704e00640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1700076e60 0x7f170019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.451+0000 7f16f7e00640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1700077780 0x7f170019fc30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f16e800e9f0 tx=0x7f16e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.451+0000 7f16fe000640 1 -- 172.21.15.110:0/1151524485 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e800cd80 con 0x7f1700077780 2024-04-26T11:39:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.451+0000 7f16fe000640 1 -- 172.21.15.110:0/1151524485 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16e80035f0 con 0x7f1700077780 2024-04-26T11:39:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.451+0000 7f1707800640 1 -- 172.21.15.110:0/1151524485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17001a49d0 con 0x7f1700077780 2024-04-26T11:39:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.451+0000 7f16fe000640 1 -- 172.21.15.110:0/1151524485 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8010670 con 0x7f1700077780 2024-04-26T11:39:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.451+0000 7f1707800640 1 -- 172.21.15.110:0/1151524485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17001ac260 con 0x7f1700077780 2024-04-26T11:39:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.455+0000 7f170a67d740 1 Processor -- start 2024-04-26T11:39:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.455+0000 7f170a67d740 1 -- start start 2024-04-26T11:39:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f170a67d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f170a67d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af62a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f170a67d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f170a67d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e67aebd380 con 0x55e67af586f0 2024-04-26T11:39:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f170a67d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e67ae59c30 con 0x55e67af62fb0 2024-04-26T11:39:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f170a67d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e67aeb9340 con 0x55e67af57dd0 2024-04-26T11:39:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f16fe000640 1 -- 172.21.15.110:0/1151524485 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f16e80037a0 con 0x7f1700077780 2024-04-26T11:39:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f1705800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f1705800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:36596/0 (socket says 172.21.15.110:36596) 2024-04-26T11:39:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f1705800640 1 -- 172.21.15.110:0/2035411789 learned_addr learned my addr 172.21.15.110:0/2035411789 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f1704e00640 1 --2- 172.21.15.110:0/2035411789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af62a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.456+0000 7f16f7e00640 1 --2- 172.21.15.110:0/2035411789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f1705800640 1 -- 172.21.15.110:0/2035411789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 msgr2=0x55e67af653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f1705800640 1 --2- 172.21.15.110:0/2035411789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f1705800640 1 -- 172.21.15.110:0/2035411789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 msgr2=0x55e67af62a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f1705800640 1 --2- 172.21.15.110:0/2035411789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af62a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f1705800640 1 -- 172.21.15.110:0/2035411789 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67ae7b940 con 0x55e67af57dd0 2024-04-26T11:39:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f1705800640 1 --2- 172.21.15.110:0/2035411789 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af581b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f170006be10 tx=0x7f16f8005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f4f67f5cf28a988 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f16f6000640 1 -- 172.21.15.110:0/2035411789 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8048070 con 0x55e67af57dd0 2024-04-26T11:39:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f16f6000640 1 -- 172.21.15.110:0/2035411789 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16f8036070 con 0x55e67af57dd0 2024-04-26T11:39:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f16f6000640 1 -- 172.21.15.110:0/2035411789 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f80043c0 con 0x55e67af57dd0 2024-04-26T11:39:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.457+0000 7f16fe000640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16e40a3dc0 0x7f16e40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f16fe000640 1 -- 172.21.15.110:0/1151524485 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9503+0+0 (secure 0 0 0) 0x7f16e80d0dc0 con 0x7f1700077780 2024-04-26T11:39:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f1704e00640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16e40a3dc0 0x7f16e40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f170a67d740 1 -- 172.21.15.110:0/2035411789 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 msgr2=0x55e67af581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f170a67d740 1 --2- 172.21.15.110:0/2035411789 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af581b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f170006be10 tx=0x7f16f8005f80 comp rx=0 tx=0).stop 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f170a67d740 1 -- 172.21.15.110:0/2035411789 shutdown_connections 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f170a67d740 1 --2- 172.21.15.110:0/2035411789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f170a67d740 1 --2- 172.21.15.110:0/2035411789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af62a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f170a67d740 1 --2- 172.21.15.110:0/2035411789 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af581b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f170a67d740 1 -- 172.21.15.110:0/2035411789 >> 172.21.15.110:0/2035411789 conn(0x55e67af542e0 msgr2=0x55e67af546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f170a67d740 1 -- 172.21.15.110:0/2035411789 shutdown_connections 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.458+0000 7f170a67d740 1 -- 172.21.15.110:0/2035411789 wait complete. 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.459+0000 7f1704e00640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16e40a3dc0 0x7f16e40a6280 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009620 tx=0x7f16f0005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.459+0000 7f170a67d740 1 -- start start 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.459+0000 7f170a67d740 1 Processor -- start 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f170a67d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af5ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f170a67d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f170a67d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af60a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f170a67d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e67af65b80 con 0x55e67af586f0 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f170a67d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e67ae44c60 con 0x55e67af62fb0 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f170a67d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e67af65d00 con 0x55e67af57dd0 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f170a67d740 10 client.0 _ll_register_callbacks cb 0x55e67ae70e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f1705800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af60a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f1704e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af5ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f1705800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af60a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:48794/0 (socket says 172.21.15.110:48794) 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f1705800640 1 -- 172.21.15.110:0/2776340220 learned_addr learned my addr 172.21.15.110:0/2776340220 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f16f7e00640 1 -- 172.21.15.110:0/2776340220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 msgr2=0x55e67af5ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f16f7e00640 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af5ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f16f7e00640 1 -- 172.21.15.110:0/2776340220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 msgr2=0x55e67af60a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f16f7e00640 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af60a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.460+0000 7f16f7e00640 1 -- 172.21.15.110:0/2776340220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e67ae53510 con 0x55e67af586f0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f16f7e00640 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af604e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f16e80ce0e0 tx=0x7f16e8098bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67338977b43f9525 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f16eea00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f16eea00640 1 -- 172.21.15.110:0/2776340220 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e809c290 con 0x55e67af586f0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f16eea00640 1 -- 172.21.15.110:0/2776340220 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9503+0+0 (secure 0 0 0) 0x7f16e8098fa0 con 0x55e67af586f0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f170a67d740 1 -- 172.21.15.110:0/2776340220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16f8036070 con 0x55e67af586f0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f16eea00640 1 -- 172.21.15.110:0/2776340220 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f16e809d030 con 0x55e67af586f0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f170a67d740 10 client.15810 fetch_fsmap learned FSMap version 101 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f170a67d740 1 -- 172.21.15.110:0/2776340220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=4+}) -- 0x55e67abcf210 con 0x55e67af586f0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f16eea00640 1 -- 172.21.15.110:0/2776340220 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16f8036070 con 0x55e67af586f0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.461+0000 7f16eea00640 1 -- 172.21.15.110:0/2776340220 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 101) ==== 8346+0+0 (secure 0 0 0) 0x7f16e80d4030 con 0x55e67af586f0 2024-04-26T11:39:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.462+0000 7f170a67d740 10 client.15810 fetch_fsmap finished waiting for FSMap version 101 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.462+0000 7f170a67d740 10 client.15810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.462+0000 7f170a67d740 20 client.15810 populate_metadata read hostname 'smithi110' 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.462+0000 7f170a67d740 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55e67af72cf0 0x55e67af750e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.462+0000 7f170a67d740 4 client.15810 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.462+0000 7f170a67d740 1 -- 172.21.15.110:0/2776340220 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e67aecaf90 con 0x55e67af72cf0 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.462+0000 7f1704e00640 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55e67af72cf0 0x55e67af750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.462+0000 7f1704e00640 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55e67af72cf0 0x55e67af750e0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890c4a12677738f8 server_cookie=d70f250aea58c35 in_seq=0 out_seq=0 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.462+0000 7f16eea00640 10 client.15810 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.463+0000 7f16eea00640 1 -- 172.21.15.110:0/2776340220 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e67aecaf90 con 0x55e67af72cf0 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.463+0000 7f16eea00640 10 client.15810 handle_command_reply: tid=0 2024-04-26T11:39:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.463+0000 7f170a67d740 1 client.15810 shutdown 2024-04-26T11:39:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.463+0000 7f170a67d740 1 -- 172.21.15.110:0/2776340220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 msgr2=0x55e67af604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.463+0000 7f170a67d740 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af604e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f16e80ce0e0 tx=0x7f16e8098bd0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f170a67d740 1 -- 172.21.15.110:0/2776340220 shutdown_connections 2024-04-26T11:39:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f170a67d740 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af60a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f170a67d740 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af604e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f170a67d740 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55e67af72cf0 0x55e67af750e0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f170a67d740 1 --2- 172.21.15.110:0/2776340220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af5ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f170a67d740 1 -- 172.21.15.110:0/2776340220 >> 172.21.15.110:0/2776340220 conn(0x55e67af542e0 msgr2=0x55e67af5a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f16eea00640 0 client.15810 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:39:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f170a67d740 1 -- 172.21.15.110:0/2776340220 shutdown_connections 2024-04-26T11:39:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f170a67d740 1 -- 172.21.15.110:0/2776340220 wait complete. 2024-04-26T11:39:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.464+0000 7f170a67d740 20 client.15810 trim_cache size 0 max 16384 2024-04-26T11:39:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.480+0000 7f170a67d740 1 Processor -- start 2024-04-26T11:39:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.480+0000 7f170a67d740 1 -- start start 2024-04-26T11:39:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.480+0000 7f170a67d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af6ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.480+0000 7f170a67d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af5a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f170a67d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af7a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f170a67d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f17001b7e30 con 0x55e67af586f0 2024-04-26T11:39:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f170a67d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f17001b56a0 con 0x55e67af62fb0 2024-04-26T11:39:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f170a67d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f17001b34f0 con 0x55e67af57dd0 2024-04-26T11:39:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f1705800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af7a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f1705800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af7a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:48808/0 (socket says 172.21.15.110:48808) 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f1704e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af6ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f1705800640 1 -- 172.21.15.110:0/1884749599 learned_addr learned my addr 172.21.15.110:0/1884749599 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f16f7e00640 1 --2- 172.21.15.110:0/1884749599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af5a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f1705800640 1 -- 172.21.15.110:0/1884749599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 msgr2=0x55e67af6ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f1705800640 1 --2- 172.21.15.110:0/1884749599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af6ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f1705800640 1 -- 172.21.15.110:0/1884749599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 msgr2=0x55e67af5a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f1705800640 1 --2- 172.21.15.110:0/1884749599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af5a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f1705800640 1 -- 172.21.15.110:0/1884749599 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67ac9b620 con 0x55e67af62fb0 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.481+0000 7f16f7e00640 1 --2- 172.21.15.110:0/1884749599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af5a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.482+0000 7f1705800640 1 --2- 172.21.15.110:0/1884749599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af7a9a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009a10 tx=0x7f16f802a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d5d293cc90892d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.482+0000 7f16f5600640 1 -- 172.21.15.110:0/1884749599 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8048040 con 0x55e67af62fb0 2024-04-26T11:39:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.482+0000 7f16f5600640 1 -- 172.21.15.110:0/1884749599 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16f8053070 con 0x55e67af62fb0 2024-04-26T11:39:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.482+0000 7f16f5600640 1 -- 172.21.15.110:0/1884749599 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f80041d0 con 0x55e67af62fb0 2024-04-26T11:39:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 -- 172.21.15.110:0/1884749599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 msgr2=0x55e67af7a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 --2- 172.21.15.110:0/1884749599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af7a9a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009a10 tx=0x7f16f802a8e0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 -- 172.21.15.110:0/1884749599 shutdown_connections 2024-04-26T11:39:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 --2- 172.21.15.110:0/1884749599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af62fb0 0x55e67af7a9a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 --2- 172.21.15.110:0/1884749599 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af586f0 0x55e67af5a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 --2- 172.21.15.110:0/1884749599 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af57dd0 0x55e67af6ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 -- 172.21.15.110:0/1884749599 >> 172.21.15.110:0/1884749599 conn(0x55e67af542e0 msgr2=0x55e67af61f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 -- 172.21.15.110:0/1884749599 shutdown_connections 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 -- 172.21.15.110:0/1884749599 wait complete. 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.483+0000 7f170a67d740 1 -- start start 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f170a67d740 1 Processor -- start 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f170a67d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af57dd0 0x55e67af6af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f170a67d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af586f0 0x55e67af6b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f170a67d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af62fb0 0x55e67af67f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f170a67d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f17001b3b60 con 0x55e67af62fb0 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f170a67d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f17001b4fd0 con 0x55e67af57dd0 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f170a67d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f17001b4230 con 0x55e67af586f0 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f170a67d740 10 client.0 _ll_register_callbacks cb 0x7f16e80d4560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af586f0 0x55e67af6b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f1705800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af62fb0 0x55e67af67f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af586f0 0x55e67af6b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:36632/0 (socket says 172.21.15.110:36632) 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f16f7e00640 1 -- 172.21.15.110:0/3169090461 learned_addr learned my addr 172.21.15.110:0/3169090461 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.484+0000 7f1704e00640 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af57dd0 0x55e67af6af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16f7e00640 1 -- 172.21.15.110:0/3169090461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af57dd0 msgr2=0x55e67af6af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16f7e00640 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af57dd0 0x55e67af6af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16f7e00640 1 -- 172.21.15.110:0/3169090461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af62fb0 msgr2=0x55e67af67f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16f7e00640 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af62fb0 0x55e67af67f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16f7e00640 1 -- 172.21.15.110:0/3169090461 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e67ae77cb0 con 0x55e67af586f0 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16f7e00640 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af586f0 0x55e67af6b490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16e809c8c0 tx=0x7f16e80870b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaca182b48ccc066 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16eea00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16eea00640 1 -- 172.21.15.110:0/3169090461 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e809c290 con 0x55e67af586f0 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f170a67d740 1 -- 172.21.15.110:0/3169090461 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16f8053070 con 0x55e67af586f0 2024-04-26T11:39:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16eea00640 1 -- 172.21.15.110:0/3169090461 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9503+0+0 (secure 0 0 0) 0x7f16e80a5310 con 0x55e67af586f0 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f16eea00640 1 -- 172.21.15.110:0/3169090461 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f16e8082050 con 0x55e67af586f0 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f170a67d740 10 client.26062 fetch_fsmap learned FSMap version 101 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.485+0000 7f170a67d740 1 -- 172.21.15.110:0/3169090461 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=4+}) -- 0x55e67afd9bf0 con 0x55e67af586f0 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.486+0000 7f16eea00640 1 -- 172.21.15.110:0/3169090461 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16f8053070 con 0x55e67af586f0 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.486+0000 7f16eea00640 1 -- 172.21.15.110:0/3169090461 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 101) ==== 8346+0+0 (secure 0 0 0) 0x7f16e80bbaf0 con 0x55e67af586f0 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.486+0000 7f170a67d740 10 client.26062 fetch_fsmap finished waiting for FSMap version 101 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.486+0000 7f170a67d740 10 client.26062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.486+0000 7f170a67d740 20 client.26062 populate_metadata read hostname 'smithi110' 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.486+0000 7f170a67d740 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55e67afda2b0 0x55e67afdc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.486+0000 7f170a67d740 4 client.26062 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:39:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.486+0000 7f170a67d740 1 -- 172.21.15.110:0/3169090461 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e67aec4e00 con 0x55e67afda2b0 2024-04-26T11:39:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.486+0000 7f1704e00640 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55e67afda2b0 0x55e67afdc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:39:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.487+0000 7f1704e00640 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55e67afda2b0 0x55e67afdc6a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cc0f70e4e715e0 server_cookie=a99ad201c03a3418 in_seq=0 out_seq=0 2024-04-26T11:39:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:40.487+0000 7f16eea00640 10 client.26062 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:39:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:39:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:39:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:39:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:39:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:39:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:39:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:41 smithi196 ceph-mon[32572]: pgmap v269: 97 pgs: 97 active+clean; 3.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 6.0 MiB/s wr, 506 op/s 2024-04-26T11:39:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:41 smithi110 ceph-mon[28069]: pgmap v269: 97 pgs: 97 active+clean; 3.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 6.0 MiB/s wr, 506 op/s 2024-04-26T11:39:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:41 smithi193 ceph-mon[32782]: pgmap v269: 97 pgs: 97 active+clean; 3.4 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 6.0 MiB/s wr, 506 op/s 2024-04-26T11:39:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:43 smithi196 ceph-mon[32572]: pgmap v270: 97 pgs: 97 active+clean; 3.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 6.3 MiB/s wr, 530 op/s 2024-04-26T11:39:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:43 smithi110 ceph-mon[28069]: pgmap v270: 97 pgs: 97 active+clean; 3.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 6.3 MiB/s wr, 530 op/s 2024-04-26T11:39:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:43 smithi193 ceph-mon[32782]: pgmap v270: 97 pgs: 97 active+clean; 3.4 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 6.3 MiB/s wr, 530 op/s 2024-04-26T11:39:44.870 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:44 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:39:44.871 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:44 smithi196 systemd[1]: Stopped Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:39:44.871 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:44 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.129s CPU time. 2024-04-26T11:39:44.871 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:44 smithi196 systemd[1]: Starting Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:39:44.871 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:44 smithi196 podman[69566]: 2024-04-26 11:39:44.642589264 +0000 UTC m=+0.018534645 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:39:44.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:39:45.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:44 smithi196 podman[69566]: 2024-04-26 11:39:44.870564202 +0000 UTC m=+0.246509617 container create e4cd69da39147a88f48c7fcce3f71f7cdc733e40681ebbb5fc9f0c3c19d13033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:39:45.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:45 smithi196 podman[69566]: 2024-04-26 11:39:45.114966734 +0000 UTC m=+0.490912104 container init e4cd69da39147a88f48c7fcce3f71f7cdc733e40681ebbb5fc9f0c3c19d13033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:39:45.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:45 smithi196 podman[69566]: 2024-04-26 11:39:45.117683622 +0000 UTC m=+0.493629001 container start e4cd69da39147a88f48c7fcce3f71f7cdc733e40681ebbb5fc9f0c3c19d13033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:39:45.415 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mds[69585]: -- 172.21.15.196:0/1810147260 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556b8f683a40 con 0x556b8f657000 2024-04-26T11:39:45.415 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: starting mds.c at 2024-04-26T11:39:45.415 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:45 smithi196 bash[69566]: e4cd69da39147a88f48c7fcce3f71f7cdc733e40681ebbb5fc9f0c3c19d13033 2024-04-26T11:39:45.415 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:39:45 smithi196 systemd[1]: Started Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:39:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mon[32572]: pgmap v271: 97 pgs: 97 active+clean; 3.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2024-04-26T11:39:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mon[32572]: daemon mds.c restarted 2024-04-26T11:39:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:39:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mon[32572]: osdmap e109: 12 total, 12 up, 12 in 2024-04-26T11:39:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:boot 2024-04-26T11:39:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mon[32572]: Standby daemon mds.e assigned to filesystem cephfs as rank 2 2024-04-26T11:39:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:39:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:39:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:45 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:45 smithi110 ceph-mon[28069]: pgmap v271: 97 pgs: 97 active+clean; 3.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2024-04-26T11:39:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:45 smithi110 ceph-mon[28069]: daemon mds.c restarted 2024-04-26T11:39:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:45 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:39:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:45 smithi110 ceph-mon[28069]: osdmap e109: 12 total, 12 up, 12 in 2024-04-26T11:39:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:45 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:boot 2024-04-26T11:39:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:45 smithi110 ceph-mon[28069]: Standby daemon mds.e assigned to filesystem cephfs as rank 2 2024-04-26T11:39:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:45 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:39:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:39:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:45 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:45 smithi193 ceph-mon[32782]: pgmap v271: 97 pgs: 97 active+clean; 3.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2024-04-26T11:39:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:45 smithi193 ceph-mon[32782]: daemon mds.c restarted 2024-04-26T11:39:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:45 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:39:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:45 smithi193 ceph-mon[32782]: osdmap e109: 12 total, 12 up, 12 in 2024-04-26T11:39:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:45 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:boot 2024-04-26T11:39:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:45 smithi193 ceph-mon[32782]: Standby daemon mds.e assigned to filesystem cephfs as rank 2 2024-04-26T11:39:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:45 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:39:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:39:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:45 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:47.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:47 smithi110 ceph-mon[28069]: pgmap v273: 97 pgs: 97 active+clean; 3.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-04-26T11:39:47.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:47 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:resolve 2024-04-26T11:39:47.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:47 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:47 smithi196 ceph-mon[32572]: pgmap v273: 97 pgs: 97 active+clean; 3.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-04-26T11:39:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:47 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:resolve 2024-04-26T11:39:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:47 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:47 smithi193 ceph-mon[32782]: pgmap v273: 97 pgs: 97 active+clean; 3.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2024-04-26T11:39:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:47 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:resolve 2024-04-26T11:39:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:47 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.464+0000 7f16eea00640 1 -- 172.21.15.110:0/3169090461 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e67aec4e00 con 0x55e67afda2b0 2024-04-26T11:39:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f16eea00640 10 client.26062 handle_command_reply: tid=0 2024-04-26T11:39:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f170a67d740 1 client.26062 shutdown 2024-04-26T11:39:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f170a67d740 1 -- 172.21.15.110:0/3169090461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af586f0 msgr2=0x55e67af6b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f170a67d740 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af586f0 0x55e67af6b490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f16e809c8c0 tx=0x7f16e80870b0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f170a67d740 1 -- 172.21.15.110:0/3169090461 shutdown_connections 2024-04-26T11:39:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f170a67d740 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e67af62fb0 0x55e67af67f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f170a67d740 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55e67afda2b0 0x55e67afdc6a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f170a67d740 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e67af586f0 0x55e67af6b490 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f170a67d740 1 --2- 172.21.15.110:0/3169090461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e67af57dd0 0x55e67af6af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f16eea00640 0 client.26062 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:39:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.465+0000 7f170a67d740 1 -- 172.21.15.110:0/3169090461 >> 172.21.15.110:0/3169090461 conn(0x55e67af542e0 msgr2=0x55e67af5ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.466+0000 7f170a67d740 1 -- 172.21.15.110:0/3169090461 shutdown_connections 2024-04-26T11:39:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.466+0000 7f170a67d740 1 -- 172.21.15.110:0/3169090461 wait complete. 2024-04-26T11:39:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.466+0000 7f170a67d740 20 client.26062 trim_cache size 0 max 16384 2024-04-26T11:39:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:39:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:39:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:39:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:39:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 -- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16e40a3dc0 msgr2=0x7f16e40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16e40a3dc0 0x7f16e40a6280 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009620 tx=0x7f16f0005f90 comp rx=0 tx=0).stop 2024-04-26T11:39:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 -- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1700077780 msgr2=0x7f170019fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:39:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1700077780 0x7f170019fc30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f16e800e9f0 tx=0x7f16e800eeb0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 -- 172.21.15.110:0/1151524485 shutdown_connections 2024-04-26T11:39:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16e40a3dc0 0x7f16e40a6280 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f17001137b0 0x7f17001a3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1700077780 0x7f170019fc30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 --2- 172.21.15.110:0/1151524485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1700076e60 0x7f170019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:39:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.467+0000 7f1707800640 1 -- 172.21.15.110:0/1151524485 >> 172.21.15.110:0/1151524485 conn(0x7f1700100620 msgr2=0x7f1700102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:39:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.468+0000 7f1707800640 1 -- 172.21.15.110:0/1151524485 shutdown_connections 2024-04-26T11:39:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:39:48.468+0000 7f1707800640 1 -- 172.21.15.110:0/1151524485 wait complete. 2024-04-26T11:39:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:48 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:reconnect 2024-04-26T11:39:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:48 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:48 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0109998 2024-04-26T11:39:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:48 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:reconnect 2024-04-26T11:39:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:48 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:48 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0109998 2024-04-26T11:39:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:48 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:reconnect 2024-04-26T11:39:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:48 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:48 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0109998 2024-04-26T11:39:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:49 smithi196 ceph-mon[32572]: pgmap v274: 97 pgs: 97 active+clean; 3.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-04-26T11:39:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:49 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:rejoin 2024-04-26T11:39:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:49 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:49 smithi196 ceph-mon[32572]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:39:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:49 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:39:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:49 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:39:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:49 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:active 2024-04-26T11:39:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:49 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:49 smithi110 ceph-mon[28069]: pgmap v274: 97 pgs: 97 active+clean; 3.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-04-26T11:39:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:49 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:rejoin 2024-04-26T11:39:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:49 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:49.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:49 smithi110 ceph-mon[28069]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:39:49.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:49 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:39:49.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:49 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:39:49.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:49 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:active 2024-04-26T11:39:49.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:49 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:49 smithi193 ceph-mon[32782]: pgmap v274: 97 pgs: 97 active+clean; 3.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-04-26T11:39:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:49 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:rejoin 2024-04-26T11:39:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:49 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=e=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T11:39:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:49 smithi193 ceph-mon[32782]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:39:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:49 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:39:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:49 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:39:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:49 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4290073322,v1:172.21.15.193:6835/4290073322] up:active 2024-04-26T11:39:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:49 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T11:39:49.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 455.0 s, 779.8 tps, lat 345.700 ms stddev 1939.318 2024-04-26T11:39:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:51 smithi196 ceph-mon[32572]: pgmap v275: 97 pgs: 97 active+clean; 3.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-04-26T11:39:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:51 smithi110 ceph-mon[28069]: pgmap v275: 97 pgs: 97 active+clean; 3.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-04-26T11:39:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:51 smithi193 ceph-mon[32782]: pgmap v275: 97 pgs: 97 active+clean; 3.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-04-26T11:39:53.719 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-mon[32782]: pgmap v276: 97 pgs: 97 active+clean; 3.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-04-26T11:39:53.719 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0246814700 time 2024-04-26T11:39:53.688186+0000 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0250e3d3dd] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0250e3d5a3] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dfff883822] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dfff7f3598] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dfff7f5c17] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dfff6eed0b] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dfff6ef2ac] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dfff6d7fad] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f02510d1e20] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 10: (DispatchQueue::entry()+0x51f) [0x7f02510cefdf] 2024-04-26T11:39:53.720 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f02511a1fc1] 2024-04-26T11:39:53.721 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f024fbbb1ca] 2024-04-26T11:39:53.721 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 13: clone() 2024-04-26T11:39:53.721 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.689+0000 7f0246814700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0246814700 time 2024-04-26T11:39:53.688186+0000 2024-04-26T11:39:53.721 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:53.721 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.721 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:53.721 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0250e3d3dd] 2024-04-26T11:39:53.721 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0250e3d5a3] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dfff883822] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dfff7f3598] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dfff7f5c17] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dfff6eed0b] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dfff6ef2ac] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dfff6d7fad] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f02510d1e20] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 10: (DispatchQueue::entry()+0x51f) [0x7f02510cefdf] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f02511a1fc1] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f024fbbb1ca] 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 13: clone() 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.722 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: *** Caught signal (Aborted) ** 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: in thread 7f0246814700 thread_name:ms_dispatch 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f024fbc5d20] 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2: gsignal() 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 3: abort() 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0250e3d437] 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0250e3d5a3] 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dfff883822] 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dfff7f3598] 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dfff7f5c17] 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dfff6eed0b] 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dfff6ef2ac] 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dfff6d7fad] 2024-04-26T11:39:53.723 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f02510d1e20] 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 13: (DispatchQueue::entry()+0x51f) [0x7f02510cefdf] 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f02511a1fc1] 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f024fbbb1ca] 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 16: clone() 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.690+0000 7f0246814700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: in thread 7f0246814700 thread_name:ms_dispatch 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f024fbc5d20] 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2: gsignal() 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 3: abort() 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0250e3d437] 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0250e3d5a3] 2024-04-26T11:39:53.724 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dfff883822] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dfff7f3598] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dfff7f5c17] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dfff6eed0b] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dfff6ef2ac] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dfff6d7fad] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f02510d1e20] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 13: (DispatchQueue::entry()+0x51f) [0x7f02510cefdf] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f02511a1fc1] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f024fbbb1ca] 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 16: clone() 2024-04-26T11:39:53.725 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:53.726 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.726 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: -2> 2024-04-26T11:39:53.689+0000 7f0246814700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0246814700 time 2024-04-26T11:39:53.688186+0000 2024-04-26T11:39:53.726 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:53.726 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.726 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:53.726 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0250e3d3dd] 2024-04-26T11:39:53.726 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0250e3d5a3] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dfff883822] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dfff7f3598] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dfff7f5c17] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dfff6eed0b] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dfff6ef2ac] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dfff6d7fad] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f02510d1e20] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 10: (DispatchQueue::entry()+0x51f) [0x7f02510cefdf] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f02511a1fc1] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f024fbbb1ca] 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 13: clone() 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 0> 2024-04-26T11:39:53.690+0000 7f0246814700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: in thread 7f0246814700 thread_name:ms_dispatch 2024-04-26T11:39:53.727 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f024fbc5d20] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2: gsignal() 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 3: abort() 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0250e3d437] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0250e3d5a3] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dfff883822] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dfff7f3598] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dfff7f5c17] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dfff6eed0b] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dfff6ef2ac] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dfff6d7fad] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f02510d1e20] 2024-04-26T11:39:53.728 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 13: (DispatchQueue::entry()+0x51f) [0x7f02510cefdf] 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f02511a1fc1] 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f024fbbb1ca] 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 16: clone() 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: -2> 2024-04-26T11:39:53.689+0000 7f0246814700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0246814700 time 2024-04-26T11:39:53.688186+0000 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0250e3d3dd] 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0250e3d5a3] 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dfff883822] 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dfff7f3598] 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dfff7f5c17] 2024-04-26T11:39:53.729 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dfff6eed0b] 2024-04-26T11:39:53.730 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dfff6ef2ac] 2024-04-26T11:39:53.730 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dfff6d7fad] 2024-04-26T11:39:53.730 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f02510d1e20] 2024-04-26T11:39:53.730 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 10: (DispatchQueue::entry()+0x51f) [0x7f02510cefdf] 2024-04-26T11:39:53.730 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f02511a1fc1] 2024-04-26T11:39:53.730 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f024fbbb1ca] 2024-04-26T11:39:53.730 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 13: clone() 2024-04-26T11:39:53.731 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.731 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 0> 2024-04-26T11:39:53.690+0000 7f0246814700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:53.731 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: in thread 7f0246814700 thread_name:ms_dispatch 2024-04-26T11:39:53.731 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.731 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:53.731 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f024fbc5d20] 2024-04-26T11:39:53.732 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2: gsignal() 2024-04-26T11:39:53.732 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 3: abort() 2024-04-26T11:39:53.732 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0250e3d437] 2024-04-26T11:39:53.732 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0250e3d5a3] 2024-04-26T11:39:53.732 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dfff883822] 2024-04-26T11:39:53.732 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dfff7f3598] 2024-04-26T11:39:53.732 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dfff7f5c17] 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dfff6eed0b] 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dfff6ef2ac] 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dfff6d7fad] 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f02510d1e20] 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 13: (DispatchQueue::entry()+0x51f) [0x7f02510cefdf] 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f02511a1fc1] 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f024fbbb1ca] 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 16: clone() 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:53.733 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[67723]: 2024-04-26T11:39:53.734 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:53 smithi110 ceph-mon[28069]: pgmap v276: 97 pgs: 97 active+clean; 3.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-04-26T11:39:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:53 smithi196 ceph-mon[32572]: pgmap v276: 97 pgs: 97 active+clean; 3.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-04-26T11:39:54.121 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:53 smithi193 podman[67899]: 2024-04-26 11:39:53.770379378 +0000 UTC m=+0.040755973 container died 4f297db6bbd96ae9b768569a19c7c74536fa3ff0ed54d4b1aa08eaad847e5916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T11:39:54.760 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:54 smithi193 podman[67899]: 2024-04-26 11:39:54.491921761 +0000 UTC m=+0.762298336 container remove 4f297db6bbd96ae9b768569a19c7c74536fa3ff0ed54d4b1aa08eaad847e5916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux ) 2024-04-26T11:39:54.760 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:54 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:39:54.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 460.0 s, 2867.8 tps, lat 34.766 ms stddev 41.831 2024-04-26T11:39:55.121 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:54 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-04-26T11:39:55.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:39:54 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Consumed 1.054s CPU time. 2024-04-26T11:39:55.725 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:55 smithi110 ceph-mon[28069]: pgmap v277: 97 pgs: 97 active+clean; 3.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 8.1 MiB/s wr, 716 op/s 2024-04-26T11:39:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:55 smithi196 ceph-mon[32572]: pgmap v277: 97 pgs: 97 active+clean; 3.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 8.1 MiB/s wr, 716 op/s 2024-04-26T11:39:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:55 smithi193 ceph-mon[32782]: pgmap v277: 97 pgs: 97 active+clean; 3.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 8.1 MiB/s wr, 716 op/s 2024-04-26T11:39:57.395 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3495b7c700 time 2024-04-26T11:39:57.030927+0000 2024-04-26T11:39:57.395 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:57.395 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:57.395 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f34a01a53dd] 2024-04-26T11:39:57.395 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f34a01a55a3] 2024-04-26T11:39:57.395 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e073e16822] 2024-04-26T11:39:57.395 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e073d86598] 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e073d88c17] 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e073c81d0b] 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e073c822ac] 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e073c6afad] 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f34a0439e20] 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 10: (DispatchQueue::entry()+0x51f) [0x7f34a0436fdf] 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f34a0509fc1] 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f349ef231ca] 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 13: clone() 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.031+0000 7f3495b7c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3495b7c700 time 2024-04-26T11:39:57.030927+0000 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:57.396 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.397 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:57.397 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f34a01a53dd] 2024-04-26T11:39:57.397 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f34a01a55a3] 2024-04-26T11:39:57.397 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e073e16822] 2024-04-26T11:39:57.397 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e073d86598] 2024-04-26T11:39:57.397 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e073d88c17] 2024-04-26T11:39:57.397 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e073c81d0b] 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e073c822ac] 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e073c6afad] 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f34a0439e20] 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 10: (DispatchQueue::entry()+0x51f) [0x7f34a0436fdf] 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f34a0509fc1] 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f349ef231ca] 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 13: clone() 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: *** Caught signal (Aborted) ** 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: in thread 7f3495b7c700 thread_name:ms_dispatch 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f349ef2dd20] 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2: gsignal() 2024-04-26T11:39:57.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 3: abort() 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f34a01a5437] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f34a01a55a3] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e073e16822] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e073d86598] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e073d88c17] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e073c81d0b] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e073c822ac] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e073c6afad] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f34a0439e20] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 13: (DispatchQueue::entry()+0x51f) [0x7f34a0436fdf] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f34a0509fc1] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f349ef231ca] 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 16: clone() 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.032+0000 7f3495b7c700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:57.399 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: in thread 7f3495b7c700 thread_name:ms_dispatch 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f349ef2dd20] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2: gsignal() 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 3: abort() 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f34a01a5437] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f34a01a55a3] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e073e16822] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e073d86598] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e073d88c17] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e073c81d0b] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e073c822ac] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e073c6afad] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f34a0439e20] 2024-04-26T11:39:57.400 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 13: (DispatchQueue::entry()+0x51f) [0x7f34a0436fdf] 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f34a0509fc1] 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f349ef231ca] 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 16: clone() 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: -1> 2024-04-26T11:39:57.031+0000 7f3495b7c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3495b7c700 time 2024-04-26T11:39:57.030927+0000 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f34a01a53dd] 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f34a01a55a3] 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e073e16822] 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e073d86598] 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e073d88c17] 2024-04-26T11:39:57.401 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e073c81d0b] 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e073c822ac] 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e073c6afad] 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f34a0439e20] 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 10: (DispatchQueue::entry()+0x51f) [0x7f34a0436fdf] 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f34a0509fc1] 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f349ef231ca] 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 13: clone() 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 0> 2024-04-26T11:39:57.032+0000 7f3495b7c700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: in thread 7f3495b7c700 thread_name:ms_dispatch 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:57.402 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f349ef2dd20] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2: gsignal() 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 3: abort() 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f34a01a5437] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f34a01a55a3] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e073e16822] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e073d86598] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e073d88c17] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e073c81d0b] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e073c822ac] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e073c6afad] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f34a0439e20] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 13: (DispatchQueue::entry()+0x51f) [0x7f34a0436fdf] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f34a0509fc1] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f349ef231ca] 2024-04-26T11:39:57.403 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 16: clone() 2024-04-26T11:39:57.404 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:57.404 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.404 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: -4> 2024-04-26T11:39:57.031+0000 7f3495b7c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3495b7c700 time 2024-04-26T11:39:57.030927+0000 2024-04-26T11:39:57.404 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:39:57.404 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.404 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:57.404 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f34a01a53dd] 2024-04-26T11:39:57.404 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f34a01a55a3] 2024-04-26T11:39:57.404 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e073e16822] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e073d86598] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e073d88c17] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e073c81d0b] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e073c822ac] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e073c6afad] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f34a0439e20] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 10: (DispatchQueue::entry()+0x51f) [0x7f34a0436fdf] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f34a0509fc1] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f349ef231ca] 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 13: clone() 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: -3> 2024-04-26T11:39:57.032+0000 7f3495b7c700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: in thread 7f3495b7c700 thread_name:ms_dispatch 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.405 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f349ef2dd20] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2: gsignal() 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 3: abort() 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f34a01a5437] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f34a01a55a3] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e073e16822] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e073d86598] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e073d88c17] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e073c81d0b] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e073c822ac] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e073c6afad] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f34a0439e20] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 13: (DispatchQueue::entry()+0x51f) [0x7f34a0436fdf] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f34a0509fc1] 2024-04-26T11:39:57.406 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f349ef231ca] 2024-04-26T11:39:57.407 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 16: clone() 2024-04-26T11:39:57.407 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:39:57.407 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i[69134]: 2024-04-26T11:39:57.407 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 podman[69634]: 2024-04-26 11:39:57.090769985 +0000 UTC m=+0.020977885 container died a333b170f94386a1d9ce00cec735b4c1cfefa32d9dd02f91bf19a4bd5e7c2277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-26T11:39:57.703 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:57 smithi196 ceph-mon[32572]: pgmap v278: 97 pgs: 97 active+clean; 3.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 7.3 MiB/s wr, 642 op/s 2024-04-26T11:39:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:57 smithi110 ceph-mon[28069]: pgmap v278: 97 pgs: 97 active+clean; 3.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 7.3 MiB/s wr, 642 op/s 2024-04-26T11:39:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:57 smithi193 ceph-mon[32782]: pgmap v278: 97 pgs: 97 active+clean; 3.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 7.3 MiB/s wr, 642 op/s 2024-04-26T11:39:58.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 podman[69634]: 2024-04-26 11:39:57.703508932 +0000 UTC m=+0.633716815 container remove a333b170f94386a1d9ce00cec735b4c1cfefa32d9dd02f91bf19a4bd5e7c2277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-i, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T11:39:58.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:39:58.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T11:39:58.006 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:39:57 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.010s CPU time. 2024-04-26T11:39:59.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 465.0 s, 674.0 tps, lat 40.716 ms stddev 46.030 2024-04-26T11:40:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:39:59 smithi196 ceph-mon[32572]: pgmap v279: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 9.7 MiB/s wr, 869 op/s 2024-04-26T11:40:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:39:59 smithi110 ceph-mon[28069]: pgmap v279: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 9.7 MiB/s wr, 869 op/s 2024-04-26T11:40:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:39:59 smithi193 ceph-mon[32782]: pgmap v279: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 9.7 MiB/s wr, 869 op/s 2024-04-26T11:40:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:00 smithi196 ceph-mon[32572]: overall HEALTH_OK 2024-04-26T11:40:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:00 smithi110 ceph-mon[28069]: overall HEALTH_OK 2024-04-26T11:40:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:00 smithi193 ceph-mon[32782]: overall HEALTH_OK 2024-04-26T11:40:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.611+0000 7efed5a00640 1 -- 172.21.15.110:0/1879248137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed010a980 msgr2=0x7efed010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.611+0000 7efed5a00640 1 --2- 172.21.15.110:0/1879248137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed010a980 0x7efed010ad60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efec0009930 tx=0x7efec002a420 comp rx=0 tx=0).stop 2024-04-26T11:40:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.611+0000 7efed5a00640 1 -- 172.21.15.110:0/1879248137 shutdown_connections 2024-04-26T11:40:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.611+0000 7efed5a00640 1 --2- 172.21.15.110:0/1879248137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efed0105330 0x7efed0111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.611+0000 7efed5a00640 1 --2- 172.21.15.110:0/1879248137 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed0104970 0x7efed0104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.611+0000 7efed5a00640 1 --2- 172.21.15.110:0/1879248137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed010a980 0x7efed010ad60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.611+0000 7efed5a00640 1 -- 172.21.15.110:0/1879248137 >> 172.21.15.110:0/1879248137 conn(0x7efed0100440 msgr2=0x7efed0102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.611+0000 7efed5a00640 1 -- 172.21.15.110:0/1879248137 shutdown_connections 2024-04-26T11:40:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.611+0000 7efed5a00640 1 -- 172.21.15.110:0/1879248137 wait complete. 2024-04-26T11:40:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.612+0000 7efed5a00640 1 Processor -- start 2024-04-26T11:40:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.612+0000 7efed5a00640 1 -- start start 2024-04-26T11:40:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efed5a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed0104970 0x7efed019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efed5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed0105330 0x7efed019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efed5a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efed010a980 0x7efed019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efed5a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efed0114c60 con 0x7efed0105330 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efed5a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efed0114ae0 con 0x7efed010a980 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efed5a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efed0114de0 con 0x7efed0104970 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efec7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed0105330 0x7efed019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efec7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed0105330 0x7efed019b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57866/0 (socket says 172.21.15.110:57866) 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efec7e00640 1 -- 172.21.15.110:0/3239842043 learned_addr learned my addr 172.21.15.110:0/3239842043 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efed5000640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efed010a980 0x7efed019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efecfe00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed0104970 0x7efed019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efec7e00640 1 -- 172.21.15.110:0/3239842043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed0104970 msgr2=0x7efed019b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.613+0000 7efec7e00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed0104970 0x7efed019b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efec7e00640 1 -- 172.21.15.110:0/3239842043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efed010a980 msgr2=0x7efed019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efec7e00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efed010a980 0x7efed019fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efec7e00640 1 -- 172.21.15.110:0/3239842043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed01a0190 con 0x7efed0105330 2024-04-26T11:40:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efed5000640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efed010a980 0x7efed019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:40:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efec7e00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed0105330 0x7efed019b6e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e9f0 tx=0x7efeb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efecd600640 1 -- 172.21.15.110:0/3239842043 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb800cd80 con 0x7efed0105330 2024-04-26T11:40:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efecd600640 1 -- 172.21.15.110:0/3239842043 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb80108e0 con 0x7efed0105330 2024-04-26T11:40:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efecd600640 1 -- 172.21.15.110:0/3239842043 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8018980 con 0x7efed0105330 2024-04-26T11:40:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efed5a00640 1 -- 172.21.15.110:0/3239842043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed01a0480 con 0x7efed0105330 2024-04-26T11:40:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.614+0000 7efed5a00640 1 -- 172.21.15.110:0/3239842043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed01a7d10 con 0x7efed0105330 2024-04-26T11:40:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.617+0000 7efed9e1b740 1 Processor -- start 2024-04-26T11:40:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.617+0000 7efecd600640 1 -- 172.21.15.110:0/3239842043 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7efeb8010430 con 0x7efed0105330 2024-04-26T11:40:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed9e1b740 1 -- start start 2024-04-26T11:40:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c46243c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 0x5644c462ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 0x5644c46315b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed9e1b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5644c4589380 con 0x5644c4624900 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed9e1b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5644c4525c30 con 0x5644c462f1c0 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed9e1b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5644c4585340 con 0x5644c4623fe0 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed5000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c46243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed5000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c46243c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:36110/0 (socket says 172.21.15.110:36110) 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efecfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 0x5644c462ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efed5000640 1 -- 172.21.15.110:0/2625575614 learned_addr learned my addr 172.21.15.110:0/2625575614 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.618+0000 7efec7e00640 1 --2- 172.21.15.110:0/2625575614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 0x5644c46315b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efed5000640 1 -- 172.21.15.110:0/2625575614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 msgr2=0x5644c46315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efed5000640 1 --2- 172.21.15.110:0/2625575614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 0x5644c46315b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efed5000640 1 -- 172.21.15.110:0/2625575614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 msgr2=0x5644c462ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efed5000640 1 --2- 172.21.15.110:0/2625575614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 0x5644c462ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efed5000640 1 -- 172.21.15.110:0/2625575614 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c4547940 con 0x5644c4623fe0 2024-04-26T11:40:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efec7e00640 1 --2- 172.21.15.110:0/2625575614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 0x5644c46315b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:40:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efed5000640 1 --2- 172.21.15.110:0/2625575614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c46243c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efec8011790 tx=0x7efec8011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cecb3db7c75863cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efecd600640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeb40a3d90 0x7efeb40a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efec5600640 1 -- 172.21.15.110:0/2625575614 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8003c30 con 0x5644c4623fe0 2024-04-26T11:40:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efec5600640 1 -- 172.21.15.110:0/2625575614 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efec800fe50 con 0x5644c4623fe0 2024-04-26T11:40:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efec5600640 1 -- 172.21.15.110:0/2625575614 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8004840 con 0x5644c4623fe0 2024-04-26T11:40:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efecd600640 1 -- 172.21.15.110:0/3239842043 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9589+0+0 (secure 0 0 0) 0x7efeb80d0ea0 con 0x7efed0105330 2024-04-26T11:40:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.619+0000 7efecfe00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeb40a3d90 0x7efeb40a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efed9e1b740 1 -- 172.21.15.110:0/2625575614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 msgr2=0x5644c46243c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2625575614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c46243c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efec8011790 tx=0x7efec8011c50 comp rx=0 tx=0).stop 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efecfe00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeb40a3d90 0x7efeb40a6250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efec0031440 tx=0x7efec0005a20 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efed9e1b740 1 -- 172.21.15.110:0/2625575614 shutdown_connections 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2625575614 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 0x5644c46315b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2625575614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 0x5644c462ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2625575614 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c46243c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efed9e1b740 1 -- 172.21.15.110:0/2625575614 >> 172.21.15.110:0/2625575614 conn(0x5644c46204f0 msgr2=0x5644c46208d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efed9e1b740 1 -- 172.21.15.110:0/2625575614 shutdown_connections 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.620+0000 7efed9e1b740 1 -- 172.21.15.110:0/2625575614 wait complete. 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.621+0000 7efed9e1b740 1 -- start start 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.621+0000 7efed9e1b740 1 Processor -- start 2024-04-26T11:40:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.621+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c462c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 0x5644c462c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 0x5644c462cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efed9e1b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5644c4631df0 con 0x5644c4624900 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efed9e1b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5644c4510c60 con 0x5644c462f1c0 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efed9e1b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5644c4631f70 con 0x5644c4623fe0 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efed9e1b740 10 client.0 _ll_register_callbacks cb 0x5644c453ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efecfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c462c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efec7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 0x5644c462c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efecfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c462c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:36120/0 (socket says 172.21.15.110:36120) 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efec7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 0x5644c462c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57880/0 (socket says 172.21.15.110:57880) 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efecfe00640 1 -- 172.21.15.110:0/2641963792 learned_addr learned my addr 172.21.15.110:0/2641963792 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efed5000640 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 0x5644c462cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efecfe00640 1 -- 172.21.15.110:0/2641963792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 msgr2=0x5644c462cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efecfe00640 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 0x5644c462cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efecfe00640 1 -- 172.21.15.110:0/2641963792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 msgr2=0x5644c462c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efecfe00640 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 0x5644c462c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.622+0000 7efecfe00640 1 -- 172.21.15.110:0/2641963792 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c451f510 con 0x5644c4623fe0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.623+0000 7efecfe00640 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c462c0e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efec00096c0 tx=0x7efec0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78bb393434662ac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.623+0000 7efebe000640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.623+0000 7efebe000640 1 -- 172.21.15.110:0/2641963792 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec004e070 con 0x5644c4623fe0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.623+0000 7efebe000640 1 -- 172.21.15.110:0/2641963792 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9589+0+0 (secure 0 0 0) 0x7efec0004ce0 con 0x5644c4623fe0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.623+0000 7efed9e1b740 1 -- 172.21.15.110:0/2641963792 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efec800fe50 con 0x5644c4623fe0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.623+0000 7efebe000640 1 -- 172.21.15.110:0/2641963792 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7efec005a050 con 0x5644c4623fe0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.623+0000 7efed9e1b740 10 client.26080 fetch_fsmap learned FSMap version 107 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.623+0000 7efed9e1b740 1 -- 172.21.15.110:0/2641963792 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) -- 0x5644c429b210 con 0x5644c4623fe0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.624+0000 7efebe000640 1 -- 172.21.15.110:0/2641963792 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efec800fe50 con 0x5644c4623fe0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.624+0000 7efebe000640 1 -- 172.21.15.110:0/2641963792 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 107) ==== 8346+0+0 (secure 0 0 0) 0x7efec00325d0 con 0x5644c4623fe0 2024-04-26T11:40:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.624+0000 7efed9e1b740 10 client.26080 fetch_fsmap finished waiting for FSMap version 107 2024-04-26T11:40:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.624+0000 7efed9e1b740 10 client.26080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:40:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.624+0000 7efed9e1b740 20 client.26080 populate_metadata read hostname 'smithi110' 2024-04-26T11:40:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.624+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5644c463eea0 0x5644c46412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.624+0000 7efed9e1b740 4 client.26080 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:40:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.624+0000 7efed9e1b740 1 -- 172.21.15.110:0/2641963792 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644c4596f90 con 0x5644c463eea0 2024-04-26T11:40:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.624+0000 7efec7e00640 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5644c463eea0 0x5644c46412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.625+0000 7efec7e00640 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5644c463eea0 0x5644c46412d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6296b16d9c98849 server_cookie=902a3545c57897a8 in_seq=0 out_seq=0 2024-04-26T11:40:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.625+0000 7efebe000640 10 client.26080 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:01.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efebe000640 1 -- 172.21.15.110:0/2641963792 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5644c4596f90 con 0x5644c463eea0 2024-04-26T11:40:01.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efebe000640 10 client.26080 handle_command_reply: tid=0 2024-04-26T11:40:01.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 client.26080 shutdown 2024-04-26T11:40:01.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 -- 172.21.15.110:0/2641963792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 msgr2=0x5644c462c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c462c0e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efec00096c0 tx=0x7efec0009260 comp rx=0 tx=0).stop 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 -- 172.21.15.110:0/2641963792 shutdown_connections 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c462f1c0 0x5644c462cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c4624900 0x5644c462c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5644c463eea0 0x5644c46412d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 --2- 172.21.15.110:0/2641963792 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4623fe0 0x5644c462c0e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efebe000640 0 client.26080 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 -- 172.21.15.110:0/2641963792 >> 172.21.15.110:0/2641963792 conn(0x5644c46204f0 msgr2=0x5644c4626270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 -- 172.21.15.110:0/2641963792 shutdown_connections 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.626+0000 7efed9e1b740 1 -- 172.21.15.110:0/2641963792 wait complete. 2024-04-26T11:40:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.627+0000 7efed9e1b740 20 client.26080 trim_cache size 0 max 16384 2024-04-26T11:40:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.643+0000 7efed9e1b740 1 Processor -- start 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.643+0000 7efed9e1b740 1 -- start start 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.643+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 0x5644c462e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.643+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c463acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.643+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 0x5644c462c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.643+0000 7efed9e1b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efed01b3a90 con 0x5644c462f1c0 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efed9e1b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efed01b1300 con 0x5644c4623fe0 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efed9e1b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efed01af150 con 0x5644c4624900 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c463acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efed5000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 0x5644c462c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c463acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:36126/0 (socket says 172.21.15.110:36126) 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efec7e00640 1 -- 172.21.15.110:0/1591896111 learned_addr learned my addr 172.21.15.110:0/1591896111 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efecfe00640 1 --2- 172.21.15.110:0/1591896111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 0x5644c462e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efec7e00640 1 -- 172.21.15.110:0/1591896111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 msgr2=0x5644c462e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efec7e00640 1 --2- 172.21.15.110:0/1591896111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 0x5644c462e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efec7e00640 1 -- 172.21.15.110:0/1591896111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 msgr2=0x5644c462c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efec7e00640 1 --2- 172.21.15.110:0/1591896111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 0x5644c462c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efec7e00640 1 -- 172.21.15.110:0/1591896111 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c4367620 con 0x5644c4624900 2024-04-26T11:40:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.644+0000 7efec7e00640 1 --2- 172.21.15.110:0/1591896111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c463acb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efeb809ca50 tx=0x7efeb80d33b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec23315bc471db4d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efec4c00640 1 -- 172.21.15.110:0/1591896111 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb809cac0 con 0x5644c4624900 2024-04-26T11:40:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efec4c00640 1 -- 172.21.15.110:0/1591896111 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb80a0dc0 con 0x5644c4624900 2024-04-26T11:40:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efec4c00640 1 -- 172.21.15.110:0/1591896111 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8099130 con 0x5644c4624900 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efed9e1b740 1 -- 172.21.15.110:0/1591896111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 msgr2=0x5644c463acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efed9e1b740 1 --2- 172.21.15.110:0/1591896111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c463acb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efeb809ca50 tx=0x7efeb80d33b0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efed9e1b740 1 -- 172.21.15.110:0/1591896111 shutdown_connections 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efed9e1b740 1 --2- 172.21.15.110:0/1591896111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 0x5644c462c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efed9e1b740 1 --2- 172.21.15.110:0/1591896111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c463acb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efed9e1b740 1 --2- 172.21.15.110:0/1591896111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 0x5644c462e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efed9e1b740 1 -- 172.21.15.110:0/1591896111 >> 172.21.15.110:0/1591896111 conn(0x5644c46204f0 msgr2=0x5644c462c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efed9e1b740 1 -- 172.21.15.110:0/1591896111 shutdown_connections 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.645+0000 7efed9e1b740 1 -- 172.21.15.110:0/1591896111 wait complete. 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.646+0000 7efed9e1b740 1 -- start start 2024-04-26T11:40:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.646+0000 7efed9e1b740 1 Processor -- start 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.646+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 0x5644c4628f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.646+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c4629440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.646+0000 7efed9e1b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 0x5644c4629980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.646+0000 7efed9e1b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efed01af7c0 con 0x5644c462f1c0 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.646+0000 7efed9e1b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efed01b0c30 con 0x5644c4623fe0 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.646+0000 7efed9e1b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efed01afe90 con 0x5644c4624900 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efed9e1b740 10 client.0 _ll_register_callbacks cb 0x7efec0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c4629440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c4629440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:36142/0 (socket says 172.21.15.110:36142) 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efec7e00640 1 -- 172.21.15.110:0/589915625 learned_addr learned my addr 172.21.15.110:0/589915625 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efecfe00640 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 0x5644c4628f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efed5000640 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 0x5644c4629980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efec7e00640 1 -- 172.21.15.110:0/589915625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 msgr2=0x5644c4628f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efec7e00640 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 0x5644c4628f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efec7e00640 1 -- 172.21.15.110:0/589915625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 msgr2=0x5644c4629980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efec7e00640 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 0x5644c4629980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efec7e00640 1 -- 172.21.15.110:0/589915625 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c4543cb0 con 0x5644c4624900 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efecfe00640 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 0x5644c4628f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efec7e00640 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c4629440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efeb8098f20 tx=0x7efeb80d1270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6936ab19e35d77af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.647+0000 7efebe000640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efebe000640 1 -- 172.21.15.110:0/589915625 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb80a5680 con 0x5644c4624900 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efebe000640 1 -- 172.21.15.110:0/589915625 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9589+0+0 (secure 0 0 0) 0x7efeb80ce440 con 0x5644c4624900 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efed9e1b740 1 -- 172.21.15.110:0/589915625 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb80a0dc0 con 0x5644c4624900 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efebe000640 1 -- 172.21.15.110:0/589915625 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7efeb809cac0 con 0x5644c4624900 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efed9e1b740 10 client.26086 fetch_fsmap learned FSMap version 107 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efed9e1b740 1 -- 172.21.15.110:0/589915625 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) -- 0x5644c46a56d0 con 0x5644c4624900 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efebe000640 1 -- 172.21.15.110:0/589915625 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb80a0dc0 con 0x5644c4624900 2024-04-26T11:40:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efebe000640 1 -- 172.21.15.110:0/589915625 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 107) ==== 8346+0+0 (secure 0 0 0) 0x7efeb80d4040 con 0x5644c4624900 2024-04-26T11:40:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efed9e1b740 10 client.26086 fetch_fsmap finished waiting for FSMap version 107 2024-04-26T11:40:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efed9e1b740 10 client.26086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:40:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efed9e1b740 20 client.26086 populate_metadata read hostname 'smithi110' 2024-04-26T11:40:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.648+0000 7efed9e1b740 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5644c46a5d90 0x5644c46a81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.649+0000 7efed9e1b740 4 client.26086 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:40:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.649+0000 7efed9e1b740 1 -- 172.21.15.110:0/589915625 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5644c4590e00 con 0x5644c46a5d90 2024-04-26T11:40:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.649+0000 7efecfe00640 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5644c46a5d90 0x5644c46a81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.649+0000 7efecfe00640 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5644c46a5d90 0x5644c46a81b0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9299ca55132c376 server_cookie=228731e5a99d838e in_seq=0 out_seq=0 2024-04-26T11:40:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:01.649+0000 7efebe000640 10 client.26086 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:01 smithi196 ceph-mon[32572]: pgmap v280: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 5.7 MiB/s wr, 506 op/s 2024-04-26T11:40:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:01 smithi110 ceph-mon[28069]: pgmap v280: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 5.7 MiB/s wr, 506 op/s 2024-04-26T11:40:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:01 smithi193 ceph-mon[32782]: pgmap v280: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 5.7 MiB/s wr, 506 op/s 2024-04-26T11:40:03.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:03 smithi193 ceph-mon[32782]: pgmap v281: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 5.7 MiB/s wr, 511 op/s 2024-04-26T11:40:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:03 smithi196 ceph-mon[32572]: pgmap v281: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 5.7 MiB/s wr, 511 op/s 2024-04-26T11:40:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:03 smithi110 ceph-mon[28069]: pgmap v281: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 5.7 MiB/s wr, 511 op/s 2024-04-26T11:40:04.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 470.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:40:05.135 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:04 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:40:05.135 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:04 smithi193 systemd[1]: Stopped Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:05.136 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:04 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Consumed 1.054s CPU time. 2024-04-26T11:40:05.136 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:04 smithi193 systemd[1]: Starting Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:40:05.136 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:05 smithi193 podman[68010]: 2024-04-26 11:40:05.004560576 +0000 UTC m=+0.018307664 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:40:05.136 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:05 smithi193 podman[68010]: 2024-04-26 11:40:05.134908982 +0000 UTC m=+0.148656043 container create 6ef777bd69832ed46c7f50ad9ffbfcacda30c0b5de08922a611884dfe228a313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:40:05.676 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:05 smithi193 podman[68010]: 2024-04-26 11:40:05.397457117 +0000 UTC m=+0.411204187 container init 6ef777bd69832ed46c7f50ad9ffbfcacda30c0b5de08922a611884dfe228a313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-26T11:40:05.676 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:05 smithi193 podman[68010]: 2024-04-26 11:40:05.401934907 +0000 UTC m=+0.415681979 container start 6ef777bd69832ed46c7f50ad9ffbfcacda30c0b5de08922a611884dfe228a313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-26T11:40:05.677 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: starting mds.e at 2024-04-26T11:40:05.677 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:05 smithi193 bash[68010]: 6ef777bd69832ed46c7f50ad9ffbfcacda30c0b5de08922a611884dfe228a313 2024-04-26T11:40:05.677 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:05 smithi193 systemd[1]: Started Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:05 smithi196 ceph-mon[32572]: pgmap v282: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 542 op/s 2024-04-26T11:40:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:05 smithi196 ceph-mon[32572]: daemon mds.e restarted 2024-04-26T11:40:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:05 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:40:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:05 smithi196 ceph-mon[32572]: osdmap e110: 12 total, 12 up, 12 in 2024-04-26T11:40:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:05 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:boot 2024-04-26T11:40:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:05 smithi196 ceph-mon[32572]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T11:40:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:05 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:40:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:40:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:05 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=c=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:40:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:05 smithi110 ceph-mon[28069]: pgmap v282: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 542 op/s 2024-04-26T11:40:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:05 smithi110 ceph-mon[28069]: daemon mds.e restarted 2024-04-26T11:40:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:05 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:40:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:05 smithi110 ceph-mon[28069]: osdmap e110: 12 total, 12 up, 12 in 2024-04-26T11:40:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:05 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:boot 2024-04-26T11:40:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:05 smithi110 ceph-mon[28069]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T11:40:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:05 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:40:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:40:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:05 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=c=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:40:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-mon[32782]: pgmap v282: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.0 MiB/s wr, 542 op/s 2024-04-26T11:40:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-mon[32782]: daemon mds.e restarted 2024-04-26T11:40:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:40:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-mon[32782]: osdmap e110: 12 total, 12 up, 12 in 2024-04-26T11:40:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:boot 2024-04-26T11:40:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-mon[32782]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T11:40:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=i=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:40:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:40:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:05 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=c=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T11:40:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:07 smithi196 ceph-mon[32572]: pgmap v284: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 398 op/s 2024-04-26T11:40:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:07 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:resolve 2024-04-26T11:40:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:07 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=c=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T11:40:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:07 smithi110 ceph-mon[28069]: pgmap v284: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 398 op/s 2024-04-26T11:40:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:07 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:resolve 2024-04-26T11:40:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:07 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=c=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T11:40:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:07 smithi193 ceph-mon[32782]: pgmap v284: 97 pgs: 97 active+clean; 3.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 398 op/s 2024-04-26T11:40:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:07 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:resolve 2024-04-26T11:40:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:07 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=i=up:active,2=c=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T11:40:08.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:40:08 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 5. 2024-04-26T11:40:08.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:40:08 smithi196 systemd[1]: Stopped Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:08.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:40:08 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.010s CPU time. 2024-04-26T11:40:08.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:40:08 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Start request repeated too quickly. 2024-04-26T11:40:08.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:40:08 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T11:40:08.505 INFO:journalctl@ceph.mds.i.smithi196.stdout:Apr 26 11:40:08 smithi196 systemd[1]: Failed to start Ceph mds.i for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:09.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:40:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:09 smithi196 ceph-mon[32572]: pgmap v285: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-04-26T11:40:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:09 smithi110 ceph-mon[28069]: pgmap v285: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-04-26T11:40:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:09 smithi193 ceph-mon[32782]: pgmap v285: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-04-26T11:40:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:11 smithi196 ceph-mon[32572]: pgmap v286: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-04-26T11:40:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:11 smithi110 ceph-mon[28069]: pgmap v286: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-04-26T11:40:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:11 smithi193 ceph-mon[32782]: pgmap v286: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 128 op/s 2024-04-26T11:40:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:13 smithi196 ceph-mon[32572]: pgmap v287: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2024-04-26T11:40:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:13 smithi196 ceph-mon[32572]: Replacing daemon mds.i as rank 1 with standby daemon mds.f 2024-04-26T11:40:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:13 smithi196 ceph-mon[32572]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-04-26T11:40:14.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:13 smithi196 ceph-mon[32572]: osdmap e111: 12 total, 12 up, 12 in 2024-04-26T11:40:14.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:13 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:13 smithi110 ceph-mon[28069]: pgmap v287: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2024-04-26T11:40:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:13 smithi110 ceph-mon[28069]: Replacing daemon mds.i as rank 1 with standby daemon mds.f 2024-04-26T11:40:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:13 smithi110 ceph-mon[28069]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-04-26T11:40:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:13 smithi110 ceph-mon[28069]: osdmap e111: 12 total, 12 up, 12 in 2024-04-26T11:40:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:13 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:13 smithi193 ceph-mon[32782]: pgmap v287: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2024-04-26T11:40:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:13 smithi193 ceph-mon[32782]: Replacing daemon mds.i as rank 1 with standby daemon mds.f 2024-04-26T11:40:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:13 smithi193 ceph-mon[32782]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-04-26T11:40:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:13 smithi193 ceph-mon[32782]: osdmap e111: 12 total, 12 up, 12 in 2024-04-26T11:40:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:13 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:replay,2=c=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:14.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:40:15.979 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:15 smithi110 ceph-mon[28069]: pgmap v289: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 940 KiB/s wr, 123 op/s 2024-04-26T11:40:15.979 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:15 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:resolve 2024-04-26T11:40:15.980 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:15 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:15 smithi196 ceph-mon[32572]: pgmap v289: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 940 KiB/s wr, 123 op/s 2024-04-26T11:40:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:15 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:resolve 2024-04-26T11:40:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:15 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:15 smithi193 ceph-mon[32782]: pgmap v289: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 940 KiB/s wr, 123 op/s 2024-04-26T11:40:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:15 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:resolve 2024-04-26T11:40:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:15 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:resolve,2=c=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.740+0000 7efebe000640 1 -- 172.21.15.110:0/589915625 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5644c4590e00 con 0x5644c46a5d90 2024-04-26T11:40:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.740+0000 7efebe000640 10 client.26086 handle_command_reply: tid=0 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.740+0000 7efed9e1b740 1 client.26086 shutdown 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 -- 172.21.15.110:0/589915625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 msgr2=0x5644c4629440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c4629440 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efeb8098f20 tx=0x7efeb80d1270 comp rx=0 tx=0).stop 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 -- 172.21.15.110:0/589915625 shutdown_connections 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5644c462f1c0 0x5644c4629980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5644c46a5d90 0x5644c46a81b0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5644c4624900 0x5644c4629440 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 --2- 172.21.15.110:0/589915625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5644c4623fe0 0x5644c4628f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efebe000640 0 client.26086 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 -- 172.21.15.110:0/589915625 >> 172.21.15.110:0/589915625 conn(0x5644c46204f0 msgr2=0x5644c4626220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 -- 172.21.15.110:0/589915625 shutdown_connections 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 1 -- 172.21.15.110:0/589915625 wait complete. 2024-04-26T11:40:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.741+0000 7efed9e1b740 20 client.26086 trim_cache size 0 max 16384 2024-04-26T11:40:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:40:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:40:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:40:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:40:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 -- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeb40a3d90 msgr2=0x7efeb40a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeb40a3d90 0x7efeb40a6250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efec0031440 tx=0x7efec0005a20 comp rx=0 tx=0).stop 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 -- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed0105330 msgr2=0x7efed019b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed0105330 0x7efed019b6e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e9f0 tx=0x7efeb800eeb0 comp rx=0 tx=0).stop 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 -- 172.21.15.110:0/3239842043 shutdown_connections 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeb40a3d90 0x7efeb40a6250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efed010a980 0x7efed019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efed0105330 0x7efed019b6e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 --2- 172.21.15.110:0/3239842043 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efed0104970 0x7efed019b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 -- 172.21.15.110:0/3239842043 >> 172.21.15.110:0/3239842043 conn(0x7efed0100440 msgr2=0x7efed0100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 -- 172.21.15.110:0/3239842043 shutdown_connections 2024-04-26T11:40:16.745 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:16.742+0000 7efed5a00640 1 -- 172.21.15.110:0/3239842043 wait complete. 2024-04-26T11:40:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:16 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:reconnect 2024-04-26T11:40:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:16 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:reconnect 2024-04-26T11:40:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:16 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:16 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00999978 2024-04-26T11:40:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:16 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:40:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:16 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:40:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:16 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:reconnect 2024-04-26T11:40:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:16 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:reconnect 2024-04-26T11:40:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:16 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:16 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00999978 2024-04-26T11:40:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:16 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:40:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:16 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:40:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:16 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:reconnect 2024-04-26T11:40:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:16 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:reconnect 2024-04-26T11:40:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:16 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:16 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00999978 2024-04-26T11:40:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:16 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:40:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:16 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:17 smithi196 ceph-mon[32572]: pgmap v290: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 835 KiB/s wr, 109 op/s 2024-04-26T11:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:17 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:rejoin 2024-04-26T11:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:17 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:rejoin 2024-04-26T11:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:17 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:17 smithi196 ceph-mon[32572]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:17 smithi196 ceph-mon[32572]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T11:40:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:17 smithi110 ceph-mon[28069]: pgmap v290: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 835 KiB/s wr, 109 op/s 2024-04-26T11:40:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:17 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:rejoin 2024-04-26T11:40:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:17 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:rejoin 2024-04-26T11:40:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:17 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:17 smithi110 ceph-mon[28069]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:40:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:17 smithi110 ceph-mon[28069]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T11:40:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:17 smithi193 ceph-mon[32782]: pgmap v290: 97 pgs: 97 active+clean; 3.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 835 KiB/s wr, 109 op/s 2024-04-26T11:40:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:17 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:rejoin 2024-04-26T11:40:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:17 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:rejoin 2024-04-26T11:40:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:17 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=f=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:17 smithi193 ceph-mon[32782]: daemon mds.f is now active in filesystem cephfs as rank 1 2024-04-26T11:40:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:17 smithi193 ceph-mon[32782]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T11:40:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:18 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:40:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:18 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:40:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:18 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:active 2024-04-26T11:40:19.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:18 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:active 2024-04-26T11:40:19.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:18 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:19.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:18 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:18 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:40:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:18 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:40:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:18 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:active 2024-04-26T11:40:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:18 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:active 2024-04-26T11:40:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:18 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:18 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:18 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:40:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:18 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:40:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:18 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1670187306,v1:172.21.15.196:6835/1670187306] up:active 2024-04-26T11:40:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:18 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/2890385471,v1:172.21.15.196:6837/2890385471] up:active 2024-04-26T11:40:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:18 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:18 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:19.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 485.0 s, 890.5 tps, lat 531.224 ms stddev 3185.788 2024-04-26T11:40:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:19 smithi110 ceph-mon[28069]: pgmap v291: 97 pgs: 97 active+clean; 3.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-04-26T11:40:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:19 smithi193 ceph-mon[32782]: pgmap v291: 97 pgs: 97 active+clean; 3.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-04-26T11:40:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:19 smithi196 ceph-mon[32572]: pgmap v291: 97 pgs: 97 active+clean; 3.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-04-26T11:40:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:20 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:20 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:20 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:21 smithi110 ceph-mon[28069]: pgmap v292: 97 pgs: 97 active+clean; 3.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-04-26T11:40:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:21 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:21 smithi193 ceph-mon[32782]: pgmap v292: 97 pgs: 97 active+clean; 3.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-04-26T11:40:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:21 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:21 smithi196 ceph-mon[32572]: pgmap v292: 97 pgs: 97 active+clean; 3.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-04-26T11:40:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:21 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=f=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:22 smithi110 ceph-mon[28069]: osdmap e112: 12 total, 12 up, 12 in 2024-04-26T11:40:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:22 smithi193 ceph-mon[32782]: osdmap e112: 12 total, 12 up, 12 in 2024-04-26T11:40:23.125 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-mon[32572]: osdmap e112: 12 total, 12 up, 12 in 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f8d95373700 time 2024-04-26T11:40:22.768591+0000 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8d9f99c3dd] 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8d9f99c5a3] 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556b8e1bf822] 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556b8e12f598] 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556b8e131c17] 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556b8e02ad0b] 2024-04-26T11:40:23.126 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556b8e02b2ac] 2024-04-26T11:40:23.127 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556b8e013fad] 2024-04-26T11:40:23.127 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8d9fc30e20] 2024-04-26T11:40:23.127 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 10: (DispatchQueue::entry()+0x51f) [0x7f8d9fc2dfdf] 2024-04-26T11:40:23.127 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8d9fd00fc1] 2024-04-26T11:40:23.127 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f8d9e71a1ca] 2024-04-26T11:40:23.127 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 13: clone() 2024-04-26T11:40:23.127 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:22.769+0000 7f8d95373700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f8d95373700 time 2024-04-26T11:40:22.768591+0000 2024-04-26T11:40:23.127 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:23.127 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc84c49a700 time 2024-04-26T11:40:22.775175+0000 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc856ac33dd] 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc856ac35a3] 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586222eb822] 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55862225b598] 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55862225dc17] 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558622156d0b] 2024-04-26T11:40:23.128 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586221572ac] 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55862213ffad] 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc856d57e20] 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 10: (DispatchQueue::entry()+0x51f) [0x7fc856d54fdf] 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc856e27fc1] 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc8558411ca] 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 13: clone() 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:22.775+0000 7fc84c49a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc84c49a700 time 2024-04-26T11:40:22.775175+0000 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.129 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8d9f99c3dd] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8d9f99c5a3] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556b8e1bf822] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556b8e12f598] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556b8e131c17] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556b8e02ad0b] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556b8e02b2ac] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556b8e013fad] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8d9fc30e20] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 10: (DispatchQueue::entry()+0x51f) [0x7f8d9fc2dfdf] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8d9fd00fc1] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f8d9e71a1ca] 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 13: clone() 2024-04-26T11:40:23.130 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: *** Caught signal (Aborted) ** 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: in thread 7f8d95373700 thread_name:ms_dispatch 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8d9e724d20] 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2: gsignal() 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 3: abort() 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8d9f99c437] 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8d9f99c5a3] 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556b8e1bf822] 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556b8e12f598] 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556b8e131c17] 2024-04-26T11:40:23.131 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556b8e02ad0b] 2024-04-26T11:40:23.132 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.132 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc856ac33dd] 2024-04-26T11:40:23.132 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc856ac35a3] 2024-04-26T11:40:23.132 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586222eb822] 2024-04-26T11:40:23.132 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55862225b598] 2024-04-26T11:40:23.132 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55862225dc17] 2024-04-26T11:40:23.132 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558622156d0b] 2024-04-26T11:40:23.132 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586221572ac] 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55862213ffad] 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc856d57e20] 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 10: (DispatchQueue::entry()+0x51f) [0x7fc856d54fdf] 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc856e27fc1] 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc8558411ca] 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 13: clone() 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: *** Caught signal (Aborted) ** 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: in thread 7fc84c49a700 thread_name:ms_dispatch 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc85584bd20] 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2: gsignal() 2024-04-26T11:40:23.133 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 3: abort() 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc856ac3437] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc856ac35a3] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586222eb822] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55862225b598] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55862225dc17] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558622156d0b] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586221572ac] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55862213ffad] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc856d57e20] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 13: (DispatchQueue::entry()+0x51f) [0x7fc856d54fdf] 2024-04-26T11:40:23.134 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc856e27fc1] 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc8558411ca] 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 16: clone() 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:22.777+0000 7fc84c49a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: in thread 7fc84c49a700 thread_name:ms_dispatch 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc85584bd20] 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2: gsignal() 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 3: abort() 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc856ac3437] 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc856ac35a3] 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586222eb822] 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55862225b598] 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55862225dc17] 2024-04-26T11:40:23.135 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558622156d0b] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586221572ac] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55862213ffad] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc856d57e20] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 13: (DispatchQueue::entry()+0x51f) [0x7fc856d54fdf] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc856e27fc1] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc8558411ca] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 16: clone() 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556b8e02b2ac] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556b8e013fad] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8d9fc30e20] 2024-04-26T11:40:23.136 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 13: (DispatchQueue::entry()+0x51f) [0x7f8d9fc2dfdf] 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8d9fd00fc1] 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8d9e71a1ca] 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 16: clone() 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:22.770+0000 7f8d95373700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: in thread 7f8d95373700 thread_name:ms_dispatch 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8d9e724d20] 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2: gsignal() 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 3: abort() 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8d9f99c437] 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8d9f99c5a3] 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556b8e1bf822] 2024-04-26T11:40:23.137 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556b8e12f598] 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556b8e131c17] 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556b8e02ad0b] 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556b8e02b2ac] 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556b8e013fad] 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8d9fc30e20] 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 13: (DispatchQueue::entry()+0x51f) [0x7f8d9fc2dfdf] 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8d9fd00fc1] 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8d9e71a1ca] 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 16: clone() 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:23.138 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: -1> 2024-04-26T11:40:22.775+0000 7fc84c49a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc84c49a700 time 2024-04-26T11:40:22.775175+0000 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc856ac33dd] 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc856ac35a3] 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586222eb822] 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55862225b598] 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55862225dc17] 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558622156d0b] 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586221572ac] 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55862213ffad] 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc856d57e20] 2024-04-26T11:40:23.139 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 10: (DispatchQueue::entry()+0x51f) [0x7fc856d54fdf] 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc856e27fc1] 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc8558411ca] 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 13: clone() 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 0> 2024-04-26T11:40:22.777+0000 7fc84c49a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: in thread 7fc84c49a700 thread_name:ms_dispatch 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc85584bd20] 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.140 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: -1> 2024-04-26T11:40:22.769+0000 7f8d95373700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f8d95373700 time 2024-04-26T11:40:22.768591+0000 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8d9f99c3dd] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8d9f99c5a3] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556b8e1bf822] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556b8e12f598] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556b8e131c17] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556b8e02ad0b] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556b8e02b2ac] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556b8e013fad] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8d9fc30e20] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 10: (DispatchQueue::entry()+0x51f) [0x7f8d9fc2dfdf] 2024-04-26T11:40:23.141 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8d9fd00fc1] 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f8d9e71a1ca] 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 13: clone() 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 0> 2024-04-26T11:40:22.770+0000 7f8d95373700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: in thread 7f8d95373700 thread_name:ms_dispatch 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8d9e724d20] 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2: gsignal() 2024-04-26T11:40:23.142 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 3: abort() 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc856ac3437] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc856ac35a3] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586222eb822] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55862225b598] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55862225dc17] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558622156d0b] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586221572ac] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55862213ffad] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc856d57e20] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 13: (DispatchQueue::entry()+0x51f) [0x7fc856d54fdf] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc856e27fc1] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc8558411ca] 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 16: clone() 2024-04-26T11:40:23.143 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: -1> 2024-04-26T11:40:22.775+0000 7fc84c49a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc84c49a700 time 2024-04-26T11:40:22.775175+0000 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc856ac33dd] 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc856ac35a3] 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586222eb822] 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2: gsignal() 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 3: abort() 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8d9f99c437] 2024-04-26T11:40:23.144 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8d9f99c5a3] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556b8e1bf822] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556b8e12f598] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556b8e131c17] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556b8e02ad0b] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556b8e02b2ac] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556b8e013fad] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8d9fc30e20] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 13: (DispatchQueue::entry()+0x51f) [0x7f8d9fc2dfdf] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8d9fd00fc1] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8d9e71a1ca] 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 16: clone() 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.145 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: -1> 2024-04-26T11:40:22.769+0000 7f8d95373700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f8d95373700 time 2024-04-26T11:40:22.768591+0000 2024-04-26T11:40:23.146 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:23.146 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.146 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.146 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f8d9f99c3dd] 2024-04-26T11:40:23.146 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8d9f99c5a3] 2024-04-26T11:40:23.146 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556b8e1bf822] 2024-04-26T11:40:23.146 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55862225b598] 2024-04-26T11:40:23.146 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55862225dc17] 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558622156d0b] 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586221572ac] 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55862213ffad] 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc856d57e20] 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 10: (DispatchQueue::entry()+0x51f) [0x7fc856d54fdf] 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc856e27fc1] 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc8558411ca] 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 13: clone() 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 0> 2024-04-26T11:40:22.777+0000 7fc84c49a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: in thread 7fc84c49a700 thread_name:ms_dispatch 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc85584bd20] 2024-04-26T11:40:23.147 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2: gsignal() 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 3: abort() 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc856ac3437] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc856ac35a3] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586222eb822] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55862225b598] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55862225dc17] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558622156d0b] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586221572ac] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55862213ffad] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc856d57e20] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 13: (DispatchQueue::entry()+0x51f) [0x7fc856d54fdf] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc856e27fc1] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc8558411ca] 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 16: clone() 2024-04-26T11:40:23.148 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69296]: 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556b8e12f598] 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556b8e131c17] 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556b8e02ad0b] 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556b8e02b2ac] 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556b8e013fad] 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8d9fc30e20] 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 10: (DispatchQueue::entry()+0x51f) [0x7f8d9fc2dfdf] 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8d9fd00fc1] 2024-04-26T11:40:23.149 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f8d9e71a1ca] 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 13: clone() 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 0> 2024-04-26T11:40:22.770+0000 7f8d95373700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: in thread 7f8d95373700 thread_name:ms_dispatch 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8d9e724d20] 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2: gsignal() 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 3: abort() 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f8d9f99c437] 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f8d9f99c5a3] 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556b8e1bf822] 2024-04-26T11:40:23.150 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556b8e12f598] 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556b8e131c17] 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556b8e02ad0b] 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556b8e02b2ac] 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556b8e013fad] 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f8d9fc30e20] 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 13: (DispatchQueue::entry()+0x51f) [0x7f8d9fc2dfdf] 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f8d9fd00fc1] 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f8d9e71a1ca] 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 16: clone() 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69581]: 2024-04-26T11:40:23.151 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:22 smithi196 podman[69685]: 2024-04-26 11:40:22.838990561 +0000 UTC m=+0.023579021 container died e4cd69da39147a88f48c7fcce3f71f7cdc733e40681ebbb5fc9f0c3c19d13033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-04-26T11:40:23.797 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:23 smithi196 podman[69686]: 2024-04-26 11:40:23.671928154 +0000 UTC m=+0.852486224 container died 7c2f32f6be3d35221a90e905d84b8e6c99cf0382ac58cb8a9c1089b917d0526a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424) 2024-04-26T11:40:23.798 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:23 smithi196 podman[69685]: 2024-04-26 11:40:23.527008078 +0000 UTC m=+0.711596539 container remove e4cd69da39147a88f48c7fcce3f71f7cdc733e40681ebbb5fc9f0c3c19d13033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-26T11:40:23.798 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:23 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:40:23.950 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:23 smithi110 ceph-mon[28069]: pgmap v294: 97 pgs: 97 active+clean; 3.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.7 MiB/s wr, 192 op/s 2024-04-26T11:40:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:23 smithi193 ceph-mon[32782]: pgmap v294: 97 pgs: 97 active+clean; 3.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.7 MiB/s wr, 192 op/s 2024-04-26T11:40:24.232 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:23 smithi196 ceph-mon[32572]: pgmap v294: 97 pgs: 97 active+clean; 3.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.7 MiB/s wr, 192 op/s 2024-04-26T11:40:24.485 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:24 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T11:40:24.485 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:24 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.303s CPU time. 2024-04-26T11:40:24.485 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:24 smithi196 podman[69686]: 2024-04-26 11:40:24.232398318 +0000 UTC m=+1.412956382 container remove 7c2f32f6be3d35221a90e905d84b8e6c99cf0382ac58cb8a9c1089b917d0526a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-26T11:40:24.485 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:24 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:40:24.755 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:24 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T11:40:24.755 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:24 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.015s CPU time. 2024-04-26T11:40:24.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 490.0 s, 2160.3 tps, lat 35.030 ms stddev 41.532 2024-04-26T11:40:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:25 smithi193 ceph-mon[32782]: pgmap v295: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 14 MiB/s wr, 1.41k op/s 2024-04-26T11:40:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:25 smithi196 ceph-mon[32572]: pgmap v295: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 14 MiB/s wr, 1.41k op/s 2024-04-26T11:40:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:25 smithi110 ceph-mon[28069]: pgmap v295: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 14 MiB/s wr, 1.41k op/s 2024-04-26T11:40:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:27 smithi110 ceph-mon[28069]: pgmap v296: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 14 MiB/s wr, 1.41k op/s 2024-04-26T11:40:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:27 smithi193 ceph-mon[32782]: pgmap v296: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 14 MiB/s wr, 1.41k op/s 2024-04-26T11:40:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:27 smithi196 ceph-mon[32572]: pgmap v296: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 14 MiB/s wr, 1.41k op/s 2024-04-26T11:40:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.871+0000 7f42ac200640 1 -- 172.21.15.110:0/3027647637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42a4102940 msgr2=0x7f42a4102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.871+0000 7f42ac200640 1 --2- 172.21.15.110:0/3027647637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42a4102940 0x7f42a4102dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4290009890 tx=0x7f429002a360 comp rx=0 tx=0).stop 2024-04-26T11:40:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.871+0000 7f42ac200640 1 -- 172.21.15.110:0/3027647637 shutdown_connections 2024-04-26T11:40:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.871+0000 7f42ac200640 1 --2- 172.21.15.110:0/3027647637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4103300 0x7f42a410f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.871+0000 7f42ac200640 1 --2- 172.21.15.110:0/3027647637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42a4102940 0x7f42a4102dc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.871+0000 7f42ac200640 1 --2- 172.21.15.110:0/3027647637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a4108950 0x7f42a4108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.871+0000 7f42ac200640 1 -- 172.21.15.110:0/3027647637 >> 172.21.15.110:0/3027647637 conn(0x7f42a4079dc0 msgr2=0x7f42a407a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.871+0000 7f42ac200640 1 -- 172.21.15.110:0/3027647637 shutdown_connections 2024-04-26T11:40:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.871+0000 7f42ac200640 1 -- 172.21.15.110:0/3027647637 wait complete. 2024-04-26T11:40:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.872+0000 7f42ac200640 1 Processor -- start 2024-04-26T11:40:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.872+0000 7f42ac200640 1 -- start start 2024-04-26T11:40:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42ac200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4102940 0x7f42a4199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42ac200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42a4103300 0x7f42a4199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42ac200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a4108950 0x7f42a419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42ac200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4112c10 con 0x7f42a4108950 2024-04-26T11:40:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42ac200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4112a90 con 0x7f42a4102940 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42ac200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4112d90 con 0x7f42a4103300 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42aa200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a4108950 0x7f42a419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42aa200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a4108950 0x7f42a419d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56794/0 (socket says 172.21.15.110:56794) 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42a8e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42a4103300 0x7f42a4199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42aa200640 1 -- 172.21.15.110:0/4207304330 learned_addr learned my addr 172.21.15.110:0/4207304330 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42a9800640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4102940 0x7f42a4199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42a8e00640 1 -- 172.21.15.110:0/4207304330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4102940 msgr2=0x7f42a4199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42a8e00640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4102940 0x7f42a4199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42a8e00640 1 -- 172.21.15.110:0/4207304330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a4108950 msgr2=0x7f42a419d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42a8e00640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a4108950 0x7f42a419d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.873+0000 7f42a8e00640 1 -- 172.21.15.110:0/4207304330 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a419e120 con 0x7f42a4103300 2024-04-26T11:40:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.874+0000 7f42a8e00640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42a4103300 0x7f42a4199670 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f429002a950 tx=0x7f4290032d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.874+0000 7f42a2000640 1 -- 172.21.15.110:0/4207304330 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290040020 con 0x7f42a4103300 2024-04-26T11:40:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.874+0000 7f42a2000640 1 -- 172.21.15.110:0/4207304330 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4290030d20 con 0x7f42a4103300 2024-04-26T11:40:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.874+0000 7f42ac200640 1 -- 172.21.15.110:0/4207304330 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a419e3b0 con 0x7f42a4103300 2024-04-26T11:40:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.874+0000 7f42a2000640 1 -- 172.21.15.110:0/4207304330 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290037040 con 0x7f42a4103300 2024-04-26T11:40:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.874+0000 7f42ac200640 1 -- 172.21.15.110:0/4207304330 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a41a5ca0 con 0x7f42a4103300 2024-04-26T11:40:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.878+0000 7f42af173740 1 Processor -- start 2024-04-26T11:40:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.878+0000 7f42af173740 1 -- start start 2024-04-26T11:40:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42af173740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c951b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42af173740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42af173740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3ca23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42af173740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5635a3bfa380 con 0x5635a3c956f0 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42af173740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5635a3b96c30 con 0x5635a3c9ffb0 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42af173740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5635a3bf6340 con 0x5635a3c94dd0 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42a2000640 1 -- 172.21.15.110:0/4207304330 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f4290043020 con 0x7f42a4103300 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42aa200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42aa200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c951b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:46046/0 (socket says 172.21.15.110:46046) 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42a9800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42aa200640 1 -- 172.21.15.110:0/3940154560 learned_addr learned my addr 172.21.15.110:0/3940154560 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42a8e00640 1 --2- 172.21.15.110:0/3940154560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3ca23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42aa200640 1 -- 172.21.15.110:0/3940154560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 msgr2=0x5635a3ca23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42aa200640 1 --2- 172.21.15.110:0/3940154560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3ca23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42aa200640 1 -- 172.21.15.110:0/3940154560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 msgr2=0x5635a3c9fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42aa200640 1 --2- 172.21.15.110:0/3940154560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.879+0000 7f42aa200640 1 -- 172.21.15.110:0/3940154560 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635a3bb8940 con 0x5635a3c94dd0 2024-04-26T11:40:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.880+0000 7f42aa200640 1 --2- 172.21.15.110:0/3940154560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c951b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f429c011570 tx=0x7f429c011a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc9c1879a5a8f40c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.880+0000 7f4296a00640 1 -- 172.21.15.110:0/3940154560 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c004b20 con 0x5635a3c94dd0 2024-04-26T11:40:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.880+0000 7f4296a00640 1 -- 172.21.15.110:0/3940154560 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429c004cc0 con 0x5635a3c94dd0 2024-04-26T11:40:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.880+0000 7f4296a00640 1 -- 172.21.15.110:0/3940154560 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c005420 con 0x5635a3c94dd0 2024-04-26T11:40:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.880+0000 7f42a2000640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f428c0a3e40 0x7f428c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42a2000640 1 -- 172.21.15.110:0/4207304330 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9805+0+0 (secure 0 0 0) 0x7f42900f07c0 con 0x7f42a4103300 2024-04-26T11:40:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42af173740 1 -- 172.21.15.110:0/3940154560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 msgr2=0x5635a3c951b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42af173740 1 --2- 172.21.15.110:0/3940154560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c951b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f429c011570 tx=0x7f429c011a30 comp rx=0 tx=0).stop 2024-04-26T11:40:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42a9800640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f428c0a3e40 0x7f428c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42af173740 1 -- 172.21.15.110:0/3940154560 shutdown_connections 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42af173740 1 --2- 172.21.15.110:0/3940154560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3ca23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42af173740 1 --2- 172.21.15.110:0/3940154560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42af173740 1 --2- 172.21.15.110:0/3940154560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c951b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42af173740 1 -- 172.21.15.110:0/3940154560 >> 172.21.15.110:0/3940154560 conn(0x5635a3c912e0 msgr2=0x5635a3c916c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42af173740 1 -- 172.21.15.110:0/3940154560 shutdown_connections 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.881+0000 7f42af173740 1 -- 172.21.15.110:0/3940154560 wait complete. 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42a9800640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f428c0a3e40 0x7f428c0a6300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5635a3c96370 tx=0x7f4298009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42af173740 1 -- start start 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42af173740 1 Processor -- start 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42af173740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c9ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42af173740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42af173740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3c9d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42af173740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5635a3ca2be0 con 0x5635a3c956f0 2024-04-26T11:40:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42af173740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5635a3b81c60 con 0x5635a3c9ffb0 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42af173740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5635a3ca2d60 con 0x5635a3c94dd0 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.882+0000 7f42af173740 10 client.0 _ll_register_callbacks cb 0x5635a3bade50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a9800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c9ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56820/0 (socket says 172.21.15.110:56820) 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a8e00640 1 -- 172.21.15.110:0/1015651431 learned_addr learned my addr 172.21.15.110:0/1015651431 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42aa200640 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3c9d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a9800640 1 -- 172.21.15.110:0/1015651431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 msgr2=0x5635a3c9d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a9800640 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3c9d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a9800640 1 -- 172.21.15.110:0/1015651431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 msgr2=0x5635a3c9d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a9800640 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a9800640 1 -- 172.21.15.110:0/1015651431 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635a3b90510 con 0x5635a3c94dd0 2024-04-26T11:40:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a8e00640 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f42a9800640 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c9ce50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4298005fd0 tx=0x7f4298004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0a328ea0d1c5404 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.883+0000 7f428b400640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.884+0000 7f428b400640 1 -- 172.21.15.110:0/1015651431 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429802d060 con 0x5635a3c94dd0 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.884+0000 7f428b400640 1 -- 172.21.15.110:0/1015651431 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9805+0+0 (secure 0 0 0) 0x7f4298018030 con 0x5635a3c94dd0 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.884+0000 7f42af173740 1 -- 172.21.15.110:0/1015651431 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f429c004cc0 con 0x5635a3c94dd0 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.884+0000 7f428b400640 1 -- 172.21.15.110:0/1015651431 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f4298034050 con 0x5635a3c94dd0 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.884+0000 7f42af173740 10 client.26104 fetch_fsmap learned FSMap version 118 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.884+0000 7f42af173740 1 -- 172.21.15.110:0/1015651431 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=118,monmap=4+}) -- 0x5635a390c210 con 0x5635a3c94dd0 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.884+0000 7f428b400640 1 -- 172.21.15.110:0/1015651431 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429c004cc0 con 0x5635a3c94dd0 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f428b400640 1 -- 172.21.15.110:0/1015651431 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 118) ==== 7741+0+0 (secure 0 0 0) 0x7f429801c3a0 con 0x5635a3c94dd0 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f42af173740 10 client.26104 fetch_fsmap finished waiting for FSMap version 118 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f42af173740 10 client.26104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f42af173740 20 client.26104 populate_metadata read hostname 'smithi110' 2024-04-26T11:40:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f42af173740 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5635a3cafc70 0x5635a3cb2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f42af173740 4 client.26104 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f42af173740 1 -- 172.21.15.110:0/1015651431 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635a3c07f90 con 0x5635a3cafc70 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f42a8e00640 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5635a3cafc70 0x5635a3cb2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f42a8e00640 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5635a3cafc70 0x5635a3cb2060 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15fbb7b129c34603 server_cookie=ffc9bb862b4bee2 in_seq=0 out_seq=0 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.885+0000 7f428b400640 10 client.26104 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.886+0000 7f428b400640 1 -- 172.21.15.110:0/1015651431 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5635a3c07f90 con 0x5635a3cafc70 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.886+0000 7f428b400640 10 client.26104 handle_command_reply: tid=0 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.886+0000 7f42af173740 1 client.26104 shutdown 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.886+0000 7f42af173740 1 -- 172.21.15.110:0/1015651431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 msgr2=0x5635a3c9ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.886+0000 7f42af173740 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c9ce50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4298005fd0 tx=0x7f4298004730 comp rx=0 tx=0).stop 2024-04-26T11:40:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f42af173740 1 -- 172.21.15.110:0/1015651431 shutdown_connections 2024-04-26T11:40:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f42af173740 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3c9d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f42af173740 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c956f0 0x5635a3c9d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f42af173740 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5635a3cafc70 0x5635a3cb2060 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f42af173740 1 --2- 172.21.15.110:0/1015651431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3c9ce50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f42af173740 1 -- 172.21.15.110:0/1015651431 >> 172.21.15.110:0/1015651431 conn(0x5635a3c912e0 msgr2=0x5635a3c97060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f428b400640 0 client.26104 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f42af173740 1 -- 172.21.15.110:0/1015651431 shutdown_connections 2024-04-26T11:40:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f42af173740 1 -- 172.21.15.110:0/1015651431 wait complete. 2024-04-26T11:40:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.887+0000 7f42af173740 20 client.26104 trim_cache size 0 max 16384 2024-04-26T11:40:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42af173740 1 Processor -- start 2024-04-26T11:40:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42af173740 1 -- start start 2024-04-26T11:40:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42af173740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3cabaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42af173740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c956f0 0x5635a3c9ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42af173740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c9ffb0 0x5635a3cb7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42af173740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f42a41b0d00 con 0x5635a3c9ffb0 2024-04-26T11:40:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42af173740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42a41b13d0 con 0x5635a3c956f0 2024-04-26T11:40:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42af173740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f42a41aecb0 con 0x5635a3c94dd0 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42aa200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c9ffb0 0x5635a3cb7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42aa200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c9ffb0 0x5635a3cb7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56824/0 (socket says 172.21.15.110:56824) 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42aa200640 1 -- 172.21.15.110:0/1307484872 learned_addr learned my addr 172.21.15.110:0/1307484872 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.903+0000 7f42a9800640 1 --2- 172.21.15.110:0/1307484872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3cabaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f42a8e00640 1 --2- 172.21.15.110:0/1307484872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c956f0 0x5635a3c9ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f42a9800640 1 -- 172.21.15.110:0/1307484872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c956f0 msgr2=0x5635a3c9ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f42a9800640 1 --2- 172.21.15.110:0/1307484872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c956f0 0x5635a3c9ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f42a9800640 1 -- 172.21.15.110:0/1307484872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c9ffb0 msgr2=0x5635a3cb7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f42a9800640 1 --2- 172.21.15.110:0/1307484872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c9ffb0 0x5635a3cb7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f42a9800640 1 -- 172.21.15.110:0/1307484872 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635a3c95520 con 0x5635a3c94dd0 2024-04-26T11:40:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f42a9800640 1 --2- 172.21.15.110:0/1307484872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3cabaa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4298009530 tx=0x7f4298009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1493cc7394588aa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f4296000640 1 -- 172.21.15.110:0/1307484872 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429803d070 con 0x5635a3c94dd0 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f4296000640 1 -- 172.21.15.110:0/1307484872 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429801cdb0 con 0x5635a3c94dd0 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.904+0000 7f4296000640 1 -- 172.21.15.110:0/1307484872 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429801cbf0 con 0x5635a3c94dd0 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.905+0000 7f42af173740 1 -- 172.21.15.110:0/1307484872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 msgr2=0x5635a3cabaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.905+0000 7f42af173740 1 --2- 172.21.15.110:0/1307484872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3cabaa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4298009530 tx=0x7f4298009fd0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.905+0000 7f42af173740 1 -- 172.21.15.110:0/1307484872 shutdown_connections 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.905+0000 7f42af173740 1 --2- 172.21.15.110:0/1307484872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c9ffb0 0x5635a3cb7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.905+0000 7f42af173740 1 --2- 172.21.15.110:0/1307484872 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c956f0 0x5635a3c9ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.905+0000 7f42af173740 1 --2- 172.21.15.110:0/1307484872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c94dd0 0x5635a3cabaa0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.905+0000 7f42af173740 1 -- 172.21.15.110:0/1307484872 >> 172.21.15.110:0/1307484872 conn(0x5635a3c912e0 msgr2=0x5635a3c9e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.905+0000 7f42af173740 1 -- 172.21.15.110:0/1307484872 shutdown_connections 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.905+0000 7f42af173740 1 -- 172.21.15.110:0/1307484872 wait complete. 2024-04-26T11:40:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.906+0000 7f42af173740 1 -- start start 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.906+0000 7f42af173740 1 Processor -- start 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.906+0000 7f42af173740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c94dd0 0x5635a3c9a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.906+0000 7f42af173740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c956f0 0x5635a3c9a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.906+0000 7f42af173740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3d151e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.906+0000 7f42af173740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f42a41ae5e0 con 0x5635a3c94dd0 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.906+0000 7f42af173740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42a41ad1f0 con 0x5635a3c9ffb0 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.906+0000 7f42af173740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f42a41ad840 con 0x5635a3c956f0 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.906+0000 7f42af173740 10 client.0 _ll_register_callbacks cb 0x7f429801d880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42aa200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3d151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42a9800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c94dd0 0x5635a3c9a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42aa200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3d151e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:60512/0 (socket says 172.21.15.110:60512) 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42a8e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c956f0 0x5635a3c9a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42aa200640 1 -- 172.21.15.110:0/3518892359 learned_addr learned my addr 172.21.15.110:0/3518892359 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42aa200640 1 -- 172.21.15.110:0/3518892359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c956f0 msgr2=0x5635a3c9a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42aa200640 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c956f0 0x5635a3c9a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42aa200640 1 -- 172.21.15.110:0/3518892359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c94dd0 msgr2=0x5635a3c9a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42aa200640 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c94dd0 0x5635a3c9a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42aa200640 1 -- 172.21.15.110:0/3518892359 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635a39d8620 con 0x5635a3c9ffb0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42a9800640 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c94dd0 0x5635a3c9a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f42aa200640 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3d151e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f429c01b040 tx=0x7f429c004f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=881c7a4c6ad2d6c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.907+0000 7f428b400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f428b400640 1 -- 172.21.15.110:0/3518892359 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c00f640 con 0x5635a3c9ffb0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f42af173740 1 -- 172.21.15.110:0/3518892359 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f429801cdb0 con 0x5635a3c9ffb0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f428b400640 1 -- 172.21.15.110:0/3518892359 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9805+0+0 (secure 0 0 0) 0x7f429c00f7e0 con 0x5635a3c9ffb0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f428b400640 1 -- 172.21.15.110:0/3518892359 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f429c00f9e0 con 0x5635a3c9ffb0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f42af173740 10 client.26069 fetch_fsmap learned FSMap version 118 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f42af173740 1 -- 172.21.15.110:0/3518892359 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=118,monmap=4+}) -- 0x5635a3bb4cb0 con 0x5635a3c9ffb0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f428b400640 1 -- 172.21.15.110:0/3518892359 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f429801cdb0 con 0x5635a3c9ffb0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f428b400640 1 -- 172.21.15.110:0/3518892359 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 118) ==== 7741+0+0 (secure 0 0 0) 0x7f429c02c430 con 0x5635a3c9ffb0 2024-04-26T11:40:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f42af173740 10 client.26069 fetch_fsmap finished waiting for FSMap version 118 2024-04-26T11:40:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f42af173740 10 client.26069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:40:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f42af173740 20 client.26069 populate_metadata read hostname 'smithi110' 2024-04-26T11:40:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f42af173740 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5635a3d16b70 0x5635a3d18f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f42af173740 4 client.26069 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:40:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.908+0000 7f42af173740 1 -- 172.21.15.110:0/3518892359 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5635a3c01e00 con 0x5635a3d16b70 2024-04-26T11:40:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.909+0000 7f42a9800640 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5635a3d16b70 0x5635a3d18f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.909+0000 7f42a9800640 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5635a3d16b70 0x5635a3d18f90 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ecbf16f638192a0 server_cookie=313b1587771d1e4 in_seq=0 out_seq=0 2024-04-26T11:40:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:29.909+0000 7f428b400640 10 client.26069 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:29.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:40:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:29 smithi196 ceph-mon[32572]: pgmap v297: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 15 MiB/s wr, 1.50k op/s 2024-04-26T11:40:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:29 smithi196 ceph-mon[32572]: osdmap e113: 12 total, 12 up, 12 in 2024-04-26T11:40:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:29 smithi110 ceph-mon[28069]: pgmap v297: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 15 MiB/s wr, 1.50k op/s 2024-04-26T11:40:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:29 smithi110 ceph-mon[28069]: osdmap e113: 12 total, 12 up, 12 in 2024-04-26T11:40:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:29 smithi193 ceph-mon[32782]: pgmap v297: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 15 MiB/s wr, 1.50k op/s 2024-04-26T11:40:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:29 smithi193 ceph-mon[32782]: osdmap e113: 12 total, 12 up, 12 in 2024-04-26T11:40:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:31 smithi196 ceph-mon[32572]: pgmap v299: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 18 MiB/s wr, 1.75k op/s 2024-04-26T11:40:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:31 smithi110 ceph-mon[28069]: pgmap v299: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 18 MiB/s wr, 1.75k op/s 2024-04-26T11:40:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:31 smithi193 ceph-mon[32782]: pgmap v299: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 18 MiB/s wr, 1.75k op/s 2024-04-26T11:40:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:33 smithi196 ceph-mon[32572]: pgmap v300: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 14 MiB/s wr, 1.43k op/s 2024-04-26T11:40:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:33 smithi110 ceph-mon[28069]: pgmap v300: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 14 MiB/s wr, 1.43k op/s 2024-04-26T11:40:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:33 smithi193 ceph-mon[32782]: pgmap v300: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 14 MiB/s wr, 1.43k op/s 2024-04-26T11:40:34.757 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:34 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:40:34.757 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:34 smithi196 systemd[1]: Stopped Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:34.757 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:34 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.303s CPU time. 2024-04-26T11:40:34.757 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:34 smithi196 systemd[1]: Starting Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:40:34.757 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:34 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 5. 2024-04-26T11:40:34.757 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:34 smithi196 systemd[1]: Stopped Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:34.757 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:34 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.015s CPU time. 2024-04-26T11:40:34.757 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:34 smithi196 systemd[1]: Starting Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:40:34.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:40:35.108 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:34 smithi196 podman[69870]: 2024-04-26 11:40:34.661800151 +0000 UTC m=+0.022478875 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:40:35.108 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:34 smithi196 podman[69870]: 2024-04-26 11:40:34.99383847 +0000 UTC m=+0.354517219 container create 9a556c3f81603e04c98f3857f8ae0442f6e6708467fbe4c59f6734a11d95c346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-26T11:40:35.108 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:34 smithi196 podman[69869]: 2024-04-26 11:40:34.659762319 +0000 UTC m=+0.020620803 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:40:35.108 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:34 smithi196 podman[69869]: 2024-04-26 11:40:34.791279008 +0000 UTC m=+0.152137475 container create ad24ec4db9f9e1febec9de77a1553fe6fab9335e51ff8b785b8bbc7a08877728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-26T11:40:35.398 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:35 smithi196 podman[69870]: 2024-04-26 11:40:35.30579858 +0000 UTC m=+0.666477283 container init 9a556c3f81603e04c98f3857f8ae0442f6e6708467fbe4c59f6734a11d95c346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-26T11:40:35.398 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:35 smithi196 podman[69870]: 2024-04-26 11:40:35.308468443 +0000 UTC m=+0.669147153 container start 9a556c3f81603e04c98f3857f8ae0442f6e6708467fbe4c59f6734a11d95c346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True) 2024-04-26T11:40:35.398 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mds[69927]: -- 172.21.15.196:0/2201836367 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c2eb287a40 con 0x55c2eb25b000 2024-04-26T11:40:35.398 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: starting mds.c at 2024-04-26T11:40:35.398 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:35 smithi196 podman[69869]: 2024-04-26 11:40:35.205254503 +0000 UTC m=+0.566112970 container init ad24ec4db9f9e1febec9de77a1553fe6fab9335e51ff8b785b8bbc7a08877728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:40:35.399 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:35 smithi196 podman[69869]: 2024-04-26 11:40:35.207846179 +0000 UTC m=+0.568704647 container start ad24ec4db9f9e1febec9de77a1553fe6fab9335e51ff8b785b8bbc7a08877728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:40:35.399 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mds[69906]: -- 172.21.15.196:0/1880788724 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55904ff3da40 con 0x55904ff11000 2024-04-26T11:40:35.399 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: starting mds.f at 2024-04-26T11:40:35.683 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:35 smithi196 bash[69870]: 9a556c3f81603e04c98f3857f8ae0442f6e6708467fbe4c59f6734a11d95c346 2024-04-26T11:40:35.684 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:40:35 smithi196 systemd[1]: Started Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:35.684 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:35 smithi196 bash[69869]: ad24ec4db9f9e1febec9de77a1553fe6fab9335e51ff8b785b8bbc7a08877728 2024-04-26T11:40:35.684 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:40:35 smithi196 systemd[1]: Started Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: pgmap v301: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.2 MiB/s wr, 245 op/s 2024-04-26T11:40:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: daemon mds.f restarted 2024-04-26T11:40:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:40:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: osdmap e114: 12 total, 12 up, 12 in 2024-04-26T11:40:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:boot 2024-04-26T11:40:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:replay,2=c=up:active} 2 up:standby-replay 6 up:standby 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: daemon mds.c restarted 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: osdmap e115: 12 total, 12 up, 12 in 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:boot 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=e=up:replay} 2 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:40:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:35 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:replay,2=d=up:replay} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: pgmap v301: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.2 MiB/s wr, 245 op/s 2024-04-26T11:40:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: daemon mds.f restarted 2024-04-26T11:40:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:40:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: osdmap e114: 12 total, 12 up, 12 in 2024-04-26T11:40:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:boot 2024-04-26T11:40:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:replay,2=c=up:active} 2 up:standby-replay 6 up:standby 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: daemon mds.c restarted 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: osdmap e115: 12 total, 12 up, 12 in 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:boot 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=e=up:replay} 2 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:40:36.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:35 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:replay,2=d=up:replay} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: pgmap v301: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.2 MiB/s wr, 245 op/s 2024-04-26T11:40:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: daemon mds.f restarted 2024-04-26T11:40:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:40:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: osdmap e114: 12 total, 12 up, 12 in 2024-04-26T11:40:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:boot 2024-04-26T11:40:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-04-26T11:40:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:40:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T11:40:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:replay,2=c=up:active} 2 up:standby-replay 6 up:standby 2024-04-26T11:40:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: daemon mds.c restarted 2024-04-26T11:40:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: osdmap e115: 12 total, 12 up, 12 in 2024-04-26T11:40:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:boot 2024-04-26T11:40:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:40:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=e=up:replay} 2 up:standby-replay 7 up:standby, 1 failed 2024-04-26T11:40:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:40:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:35 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:replay,2=d=up:replay} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:37.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:37 smithi110 ceph-mon[28069]: pgmap v304: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 580 KiB/s wr, 77 op/s 2024-04-26T11:40:37.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:37 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:resolve 2024-04-26T11:40:37.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:37 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:resolve 2024-04-26T11:40:37.953 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:37 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:resolve,2=d=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:37 smithi196 ceph-mon[32572]: pgmap v304: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 580 KiB/s wr, 77 op/s 2024-04-26T11:40:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:37 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:resolve 2024-04-26T11:40:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:37 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:resolve 2024-04-26T11:40:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:37 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:resolve,2=d=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:37 smithi193 ceph-mon[32782]: pgmap v304: 97 pgs: 97 active+clean; 3.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 580 KiB/s wr, 77 op/s 2024-04-26T11:40:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:37 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:resolve 2024-04-26T11:40:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:37 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:resolve 2024-04-26T11:40:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:37 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:resolve,2=d=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:38.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.755+0000 7f428b400640 1 -- 172.21.15.110:0/3518892359 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5635a3c01e00 con 0x5635a3d16b70 2024-04-26T11:40:38.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.755+0000 7f428b400640 10 client.26069 handle_command_reply: tid=0 2024-04-26T11:40:38.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.755+0000 7f42af173740 1 client.26069 shutdown 2024-04-26T11:40:38.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 -- 172.21.15.110:0/3518892359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 msgr2=0x5635a3d151e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3d151e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f429c01b040 tx=0x7f429c004f60 comp rx=0 tx=0).stop 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 -- 172.21.15.110:0/3518892359 shutdown_connections 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5635a3c9ffb0 0x5635a3d151e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5635a3d16b70 0x5635a3d18f90 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5635a3c956f0 0x5635a3c9a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 --2- 172.21.15.110:0/3518892359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635a3c94dd0 0x5635a3c9a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 -- 172.21.15.110:0/3518892359 >> 172.21.15.110:0/3518892359 conn(0x5635a3c912e0 msgr2=0x5635a3c90440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f428b400640 0 client.26069 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 -- 172.21.15.110:0/3518892359 shutdown_connections 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.756+0000 7f42af173740 1 -- 172.21.15.110:0/3518892359 wait complete. 2024-04-26T11:40:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.757+0000 7f42af173740 20 client.26069 trim_cache size 0 max 16384 2024-04-26T11:40:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:40:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:40:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:40:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 -- 172.21.15.110:0/4207304330 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f428c0a3e40 msgr2=0x7f428c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f428c0a3e40 0x7f428c0a6300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5635a3c96370 tx=0x7f4298009260 comp rx=0 tx=0).stop 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 -- 172.21.15.110:0/4207304330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42a4103300 msgr2=0x7f42a4199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42a4103300 0x7f42a4199670 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f429002a950 tx=0x7f4290032d30 comp rx=0 tx=0).stop 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 -- 172.21.15.110:0/4207304330 shutdown_connections 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f428c0a3e40 0x7f428c0a6300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a4108950 0x7f42a419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42a4103300 0x7f42a4199670 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 --2- 172.21.15.110:0/4207304330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4102940 0x7f42a4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 -- 172.21.15.110:0/4207304330 >> 172.21.15.110:0/4207304330 conn(0x7f42a4079dc0 msgr2=0x7f42a4100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 -- 172.21.15.110:0/4207304330 shutdown_connections 2024-04-26T11:40:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:38.758+0000 7f42ac200640 1 -- 172.21.15.110:0/4207304330 wait complete. 2024-04-26T11:40:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:38 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:40:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:38 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:reconnect 2024-04-26T11:40:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:38 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:reconnect 2024-04-26T11:40:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:38 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:38 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:40:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:38 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:40:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:38 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:40:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:38 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:reconnect 2024-04-26T11:40:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:38 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:reconnect 2024-04-26T11:40:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:38 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:38 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:40:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:38 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:40:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:38 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:40:39.128 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:38 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:reconnect 2024-04-26T11:40:39.128 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:38 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:reconnect 2024-04-26T11:40:39.128 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:38 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:39.128 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:38 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:40:39.128 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:38 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:40:39.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 505.0 s, 117.1 tps, lat 2770.217 ms stddev 6053.670 2024-04-26T11:40:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:39 smithi196 ceph-mon[32572]: pgmap v305: 97 pgs: 97 active+clean; 3.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 678 KiB/s wr, 94 op/s 2024-04-26T11:40:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:39 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:rejoin 2024-04-26T11:40:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:39 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:rejoin 2024-04-26T11:40:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:39 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:39 smithi196 ceph-mon[32572]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-04-26T11:40:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:39 smithi196 ceph-mon[32572]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:40:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:39 smithi110 ceph-mon[28069]: pgmap v305: 97 pgs: 97 active+clean; 3.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 678 KiB/s wr, 94 op/s 2024-04-26T11:40:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:39 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:rejoin 2024-04-26T11:40:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:39 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:rejoin 2024-04-26T11:40:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:39 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:39 smithi110 ceph-mon[28069]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-04-26T11:40:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:39 smithi110 ceph-mon[28069]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:40:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:39 smithi193 ceph-mon[32782]: pgmap v305: 97 pgs: 97 active+clean; 3.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 678 KiB/s wr, 94 op/s 2024-04-26T11:40:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:39 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:rejoin 2024-04-26T11:40:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:39 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:rejoin 2024-04-26T11:40:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:39 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:39 smithi193 ceph-mon[32782]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-04-26T11:40:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:39 smithi193 ceph-mon[32782]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:40:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:40 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:40:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:40 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:40:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:40 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:active 2024-04-26T11:40:41.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:40 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:active 2024-04-26T11:40:41.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:40 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:41.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:40 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:41.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:40:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:40 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:40:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:40 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:40:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:40 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:active 2024-04-26T11:40:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:40 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:active 2024-04-26T11:40:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:40 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:41.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:40 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:41.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:40:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:40 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:40:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:40 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:40:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:40 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1313235465,v1:172.21.15.193:6835/1313235465] up:active 2024-04-26T11:40:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:40 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1767649513,v1:172.21.15.110:6837/1767649513] up:active 2024-04-26T11:40:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:40 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 1 up:standby-replay 7 up:standby 2024-04-26T11:40:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:40 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:40:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:41 smithi196 ceph-mon[32572]: pgmap v306: 97 pgs: 97 active+clean; 3.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 653 KiB/s wr, 90 op/s 2024-04-26T11:40:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:41 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:41 smithi110 ceph-mon[28069]: pgmap v306: 97 pgs: 97 active+clean; 3.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 653 KiB/s wr, 90 op/s 2024-04-26T11:40:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:41 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:41 smithi193 ceph-mon[32782]: pgmap v306: 97 pgs: 97 active+clean; 3.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 653 KiB/s wr, 90 op/s 2024-04-26T11:40:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:41 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:40:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:40:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:40:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:40:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:40:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:40:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:40:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:43 smithi110 ceph-mon[28069]: pgmap v307: 97 pgs: 97 active+clean; 3.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 193 KiB/s wr, 32 op/s 2024-04-26T11:40:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:43 smithi193 ceph-mon[32782]: pgmap v307: 97 pgs: 97 active+clean; 3.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 193 KiB/s wr, 32 op/s 2024-04-26T11:40:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:43 smithi196 ceph-mon[32572]: pgmap v307: 97 pgs: 97 active+clean; 3.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 193 KiB/s wr, 32 op/s 2024-04-26T11:40:44.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 510.0 s, 2728.6 tps, lat 36.613 ms stddev 42.406 2024-04-26T11:40:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:44 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:44 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:45.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:44 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:45.785 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f96e1cbc700 time 2024-04-26T11:40:45.441998+0000 2024-04-26T11:40:45.785 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:45.785 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:45.785 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f96ec2e53dd] 2024-04-26T11:40:45.785 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f96ec2e55a3] 2024-04-26T11:40:45.785 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d26d03c822] 2024-04-26T11:40:45.785 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d26cfac598] 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d26cfaec17] 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d26cea7d0b] 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d26cea82ac] 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d26ce90fad] 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f96ec579e20] 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 10: (DispatchQueue::entry()+0x51f) [0x7f96ec576fdf] 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f96ec649fc1] 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f96eb0631ca] 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 13: clone() 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.441+0000 7f96e1cbc700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f96e1cbc700 time 2024-04-26T11:40:45.441998+0000 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:45.786 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f96ec2e53dd] 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f96ec2e55a3] 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d26d03c822] 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d26cfac598] 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d26cfaec17] 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d26cea7d0b] 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d26cea82ac] 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d26ce90fad] 2024-04-26T11:40:45.787 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f96ec579e20] 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 10: (DispatchQueue::entry()+0x51f) [0x7f96ec576fdf] 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f96ec649fc1] 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f96eb0631ca] 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 13: clone() 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: *** Caught signal (Aborted) ** 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: in thread 7f96e1cbc700 thread_name:ms_dispatch 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f96eb06dd20] 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2: gsignal() 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 3: abort() 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f96ec2e5437] 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f96ec2e55a3] 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d26d03c822] 2024-04-26T11:40:45.788 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d26cfac598] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d26cfaec17] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d26cea7d0b] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d26cea82ac] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d26ce90fad] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f96ec579e20] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 13: (DispatchQueue::entry()+0x51f) [0x7f96ec576fdf] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f96ec649fc1] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f96eb0631ca] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 16: clone() 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.443+0000 7f96e1cbc700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: in thread 7f96e1cbc700 thread_name:ms_dispatch 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f96eb06dd20] 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2: gsignal() 2024-04-26T11:40:45.789 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 3: abort() 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f96ec2e5437] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f96ec2e55a3] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d26d03c822] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d26cfac598] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d26cfaec17] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d26cea7d0b] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d26cea82ac] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d26ce90fad] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f96ec579e20] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 13: (DispatchQueue::entry()+0x51f) [0x7f96ec576fdf] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f96ec649fc1] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f96eb0631ca] 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 16: clone() 2024-04-26T11:40:45.790 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:45.791 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.791 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: -3> 2024-04-26T11:40:45.441+0000 7f96e1cbc700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f96e1cbc700 time 2024-04-26T11:40:45.441998+0000 2024-04-26T11:40:45.791 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:45.791 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.791 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f96ec2e53dd] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f96ec2e55a3] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d26d03c822] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d26cfac598] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d26cfaec17] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d26cea7d0b] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d26cea82ac] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d26ce90fad] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f96ec579e20] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 10: (DispatchQueue::entry()+0x51f) [0x7f96ec576fdf] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f96ec649fc1] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f96eb0631ca] 2024-04-26T11:40:45.792 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 13: clone() 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 0> 2024-04-26T11:40:45.443+0000 7f96e1cbc700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: in thread 7f96e1cbc700 thread_name:ms_dispatch 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f96eb06dd20] 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2: gsignal() 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 3: abort() 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f96ec2e5437] 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f96ec2e55a3] 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d26d03c822] 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d26cfac598] 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d26cfaec17] 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d26cea7d0b] 2024-04-26T11:40:45.793 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d26cea82ac] 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d26ce90fad] 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f96ec579e20] 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 13: (DispatchQueue::entry()+0x51f) [0x7f96ec576fdf] 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f96ec649fc1] 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f96eb0631ca] 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 16: clone() 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: -4> 2024-04-26T11:40:45.441+0000 7f96e1cbc700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f96e1cbc700 time 2024-04-26T11:40:45.441998+0000 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f96ec2e53dd] 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f96ec2e55a3] 2024-04-26T11:40:45.794 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d26d03c822] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d26cfac598] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d26cfaec17] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d26cea7d0b] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d26cea82ac] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d26ce90fad] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f96ec579e20] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 10: (DispatchQueue::entry()+0x51f) [0x7f96ec576fdf] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f96ec649fc1] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f96eb0631ca] 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 13: clone() 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: -1> 2024-04-26T11:40:45.443+0000 7f96e1cbc700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: in thread 7f96e1cbc700 thread_name:ms_dispatch 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.795 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f96eb06dd20] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2: gsignal() 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 3: abort() 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f96ec2e5437] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f96ec2e55a3] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d26d03c822] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d26cfac598] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d26cfaec17] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d26cea7d0b] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d26cea82ac] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d26ce90fad] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f96ec579e20] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 13: (DispatchQueue::entry()+0x51f) [0x7f96ec576fdf] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f96ec649fc1] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f96eb0631ca] 2024-04-26T11:40:45.796 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 16: clone() 2024-04-26T11:40:45.797 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:45.797 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68026]: 2024-04-26T11:40:45.797 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:45 smithi193 podman[68293]: 2024-04-26 11:40:45.502938215 +0000 UTC m=+0.019646272 container died 6ef777bd69832ed46c7f50ad9ffbfcacda30c0b5de08922a611884dfe228a313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:40:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:45 smithi110 ceph-mon[28069]: pgmap v308: 97 pgs: 97 active+clean; 3.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 2.5 MiB/s wr, 254 op/s 2024-04-26T11:40:46.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fac0c200700 time 2024-04-26T11:40:46.014660+0000 2024-04-26T11:40:46.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:46.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:46.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fac17abb3dd] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fac17abb5a3] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586bc4a1822] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5586bc411598] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5586bc413c17] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5586bc30cd0b] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586bc30d2ac] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5586bc2f5fad] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fac17d4fe20] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 10: (DispatchQueue::entry()+0x51f) [0x7fac17d4cfdf] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fac17e1ffc1] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fac168391ca] 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 13: clone() 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: *** Caught signal (Aborted) ** 2024-04-26T11:40:46.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: in thread 7fac0c200700 thread_name:ms_dispatch 2024-04-26T11:40:46.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.018+0000 7fac0c200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fac0c200700 time 2024-04-26T11:40:46.014660+0000 2024-04-26T11:40:46.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:46.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fac17abb3dd] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fac17abb5a3] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586bc4a1822] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5586bc411598] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5586bc413c17] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5586bc30cd0b] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586bc30d2ac] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5586bc2f5fad] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fac17d4fe20] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 10: (DispatchQueue::entry()+0x51f) [0x7fac17d4cfdf] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fac17e1ffc1] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fac168391ca] 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 13: clone() 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:46.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fac16843d20] 2024-04-26T11:40:46.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2: gsignal() 2024-04-26T11:40:46.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 3: abort() 2024-04-26T11:40:46.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fac17abb437] 2024-04-26T11:40:46.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fac17abb5a3] 2024-04-26T11:40:46.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586bc4a1822] 2024-04-26T11:40:46.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5586bc411598] 2024-04-26T11:40:46.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5586bc413c17] 2024-04-26T11:40:46.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5586bc30cd0b] 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586bc30d2ac] 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5586bc2f5fad] 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fac17d4fe20] 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 13: (DispatchQueue::entry()+0x51f) [0x7fac17d4cfdf] 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fac17e1ffc1] 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fac168391ca] 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 16: clone() 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.026+0000 7fac0c200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: in thread 7fac0c200700 thread_name:ms_dispatch 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:46.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fac16843d20] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2: gsignal() 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 3: abort() 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fac17abb437] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fac17abb5a3] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586bc4a1822] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5586bc411598] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5586bc413c17] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5586bc30cd0b] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586bc30d2ac] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5586bc2f5fad] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fac17d4fe20] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 13: (DispatchQueue::entry()+0x51f) [0x7fac17d4cfdf] 2024-04-26T11:40:46.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fac17e1ffc1] 2024-04-26T11:40:46.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fac168391ca] 2024-04-26T11:40:46.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 16: clone() 2024-04-26T11:40:46.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:46.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:45 smithi193 ceph-mon[32782]: pgmap v308: 97 pgs: 97 active+clean; 3.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 2.5 MiB/s wr, 254 op/s 2024-04-26T11:40:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:45 smithi196 ceph-mon[32572]: pgmap v308: 97 pgs: 97 active+clean; 3.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 2.5 MiB/s wr, 254 op/s 2024-04-26T11:40:46.542 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: -1> 2024-04-26T11:40:46.018+0000 7fac0c200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fac0c200700 time 2024-04-26T11:40:46.014660+0000 2024-04-26T11:40:46.542 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:46.542 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.542 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fac17abb3dd] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fac17abb5a3] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586bc4a1822] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5586bc411598] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5586bc413c17] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5586bc30cd0b] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586bc30d2ac] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5586bc2f5fad] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fac17d4fe20] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 10: (DispatchQueue::entry()+0x51f) [0x7fac17d4cfdf] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fac17e1ffc1] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fac168391ca] 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 13: clone() 2024-04-26T11:40:46.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.544 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 0> 2024-04-26T11:40:46.026+0000 7fac0c200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:46.544 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: in thread 7fac0c200700 thread_name:ms_dispatch 2024-04-26T11:40:46.544 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.544 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:46.544 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fac16843d20] 2024-04-26T11:40:46.544 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2: gsignal() 2024-04-26T11:40:46.544 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 3: abort() 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fac17abb437] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fac17abb5a3] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586bc4a1822] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5586bc411598] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5586bc413c17] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5586bc30cd0b] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586bc30d2ac] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5586bc2f5fad] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fac17d4fe20] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 13: (DispatchQueue::entry()+0x51f) [0x7fac17d4cfdf] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fac17e1ffc1] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fac168391ca] 2024-04-26T11:40:46.545 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 16: clone() 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: -1> 2024-04-26T11:40:46.018+0000 7fac0c200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fac0c200700 time 2024-04-26T11:40:46.014660+0000 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fac17abb3dd] 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fac17abb5a3] 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586bc4a1822] 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5586bc411598] 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5586bc413c17] 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5586bc30cd0b] 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586bc30d2ac] 2024-04-26T11:40:46.546 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5586bc2f5fad] 2024-04-26T11:40:46.547 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fac17d4fe20] 2024-04-26T11:40:46.547 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 10: (DispatchQueue::entry()+0x51f) [0x7fac17d4cfdf] 2024-04-26T11:40:46.547 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fac17e1ffc1] 2024-04-26T11:40:46.547 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fac168391ca] 2024-04-26T11:40:46.547 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 13: clone() 2024-04-26T11:40:46.547 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.547 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 0> 2024-04-26T11:40:46.026+0000 7fac0c200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: in thread 7fac0c200700 thread_name:ms_dispatch 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fac16843d20] 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2: gsignal() 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 3: abort() 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fac17abb437] 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fac17abb5a3] 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5586bc4a1822] 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5586bc411598] 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5586bc413c17] 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5586bc30cd0b] 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5586bc30d2ac] 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5586bc2f5fad] 2024-04-26T11:40:46.548 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fac17d4fe20] 2024-04-26T11:40:46.549 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 13: (DispatchQueue::entry()+0x51f) [0x7fac17d4cfdf] 2024-04-26T11:40:46.549 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fac17e1ffc1] 2024-04-26T11:40:46.549 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fac168391ca] 2024-04-26T11:40:46.549 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 16: clone() 2024-04-26T11:40:46.549 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:40:46.549 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[66322]: 2024-04-26T11:40:46.549 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:46 smithi110 podman[92022]: 2024-04-26 11:40:46.180991052 +0000 UTC m=+0.048960990 container died adb439f3eb906b6a1f87fa3a8fe673a1f371c2ed24df099e328c17be0558f3f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424) 2024-04-26T11:40:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:46 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:47.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:46 smithi193 podman[68293]: 2024-04-26 11:40:46.887743525 +0000 UTC m=+1.404451572 container remove 6ef777bd69832ed46c7f50ad9ffbfcacda30c0b5de08922a611884dfe228a313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:40:47.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:46 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:40:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:46 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:46 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=d=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:40:47.542 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:47 smithi110 podman[92022]: 2024-04-26 11:40:47.282895793 +0000 UTC m=+1.150865719 container remove adb439f3eb906b6a1f87fa3a8fe673a1f371c2ed24df099e328c17be0558f3f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-26T11:40:47.542 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:47 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:40:47.621 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:47 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-04-26T11:40:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:47 smithi110 ceph-mon[28069]: pgmap v309: 97 pgs: 97 active+clean; 3.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-04-26T11:40:48.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:47 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T11:40:48.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:47 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 2.465s CPU time. 2024-04-26T11:40:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:47 smithi193 ceph-mon[32782]: pgmap v309: 97 pgs: 97 active+clean; 3.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-04-26T11:40:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:47 smithi196 ceph-mon[32572]: pgmap v309: 97 pgs: 97 active+clean; 3.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-04-26T11:40:49.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 515.0 s, 2118.7 tps, lat 41.875 ms stddev 50.603 2024-04-26T11:40:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:49 smithi110 ceph-mon[28069]: pgmap v310: 97 pgs: 97 active+clean; 3.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-04-26T11:40:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:49 smithi193 ceph-mon[32782]: pgmap v310: 97 pgs: 97 active+clean; 3.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-04-26T11:40:50.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:49 smithi196 ceph-mon[32572]: pgmap v310: 97 pgs: 97 active+clean; 3.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 5.3 MiB/s wr, 511 op/s 2024-04-26T11:40:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.905+0000 7efecd400640 1 -- 172.21.15.110:0/93993773 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efec8103100 msgr2=0x7efec810f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.905+0000 7efecd400640 1 --2- 172.21.15.110:0/93993773 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efec8103100 0x7efec810f610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efec0009cd0 tx=0x7efec002a8f0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.905+0000 7efecd400640 1 -- 172.21.15.110:0/93993773 shutdown_connections 2024-04-26T11:40:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.905+0000 7efecd400640 1 --2- 172.21.15.110:0/93993773 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efec8103100 0x7efec810f610 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.905+0000 7efecd400640 1 --2- 172.21.15.110:0/93993773 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efec8102740 0x7efec8102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.905+0000 7efecd400640 1 --2- 172.21.15.110:0/93993773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec8108750 0x7efec8108b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.905+0000 7efecd400640 1 -- 172.21.15.110:0/93993773 >> 172.21.15.110:0/93993773 conn(0x7efec80fe270 msgr2=0x7efec8100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.905+0000 7efecd400640 1 -- 172.21.15.110:0/93993773 shutdown_connections 2024-04-26T11:40:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.905+0000 7efecd400640 1 -- 172.21.15.110:0/93993773 wait complete. 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.906+0000 7efecd400640 1 Processor -- start 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.906+0000 7efecd400640 1 -- start start 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efecd400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec8102740 0x7efec8198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efecd400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efec8103100 0x7efec81994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efecd400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efec8108750 0x7efec819d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efecd400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efec8112a10 con 0x7efec8102740 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efecd400640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efec8112890 con 0x7efec8108750 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efecd400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efec8112b90 con 0x7efec8103100 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efec7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec8102740 0x7efec8198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efec7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec8102740 0x7efec8198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35806/0 (socket says 172.21.15.110:35806) 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efec7e00640 1 -- 172.21.15.110:0/663835799 learned_addr learned my addr 172.21.15.110:0/663835799 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efecca00640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efec8108750 0x7efec819d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.907+0000 7efec7400640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efec8103100 0x7efec81994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec7e00640 1 -- 172.21.15.110:0/663835799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efec8103100 msgr2=0x7efec81994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec7e00640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efec8103100 0x7efec81994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec7e00640 1 -- 172.21.15.110:0/663835799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efec8108750 msgr2=0x7efec819d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec7e00640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efec8108750 0x7efec819d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec7e00640 1 -- 172.21.15.110:0/663835799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec819df70 con 0x7efec8102740 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec7400640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efec8103100 0x7efec81994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efecca00640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efec8108750 0x7efec819d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec7e00640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec8102740 0x7efec8198f80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efeb800d950 tx=0x7efeb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec4c00640 1 -- 172.21.15.110:0/663835799 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8017070 con 0x7efec8102740 2024-04-26T11:40:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efecd400640 1 -- 172.21.15.110:0/663835799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec819e260 con 0x7efec8102740 2024-04-26T11:40:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec4c00640 1 -- 172.21.15.110:0/663835799 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb8009c30 con 0x7efec8102740 2024-04-26T11:40:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efec4c00640 1 -- 172.21.15.110:0/663835799 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb800f620 con 0x7efec8102740 2024-04-26T11:40:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.908+0000 7efecd400640 1 -- 172.21.15.110:0/663835799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec81a5af0 con 0x7efec8102740 2024-04-26T11:40:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.912+0000 7efed17c3740 1 Processor -- start 2024-04-26T11:40:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.912+0000 7efec4c00640 1 -- 172.21.15.110:0/663835799 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7efeb8010460 con 0x7efec8102740 2024-04-26T11:40:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.912+0000 7efed17c3740 1 -- start start 2024-04-26T11:40:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.912+0000 7efed17c3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 0x555870ce43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.912+0000 7efed17c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870ceec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.912+0000 7efed17c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cf15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.912+0000 7efed17c3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555870c49380 con 0x555870ce3fe0 2024-04-26T11:40:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.912+0000 7efed17c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555870be5c30 con 0x555870cef1c0 2024-04-26T11:40:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.912+0000 7efed17c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555870c45340 con 0x555870ce4900 2024-04-26T11:40:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870ceec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efecca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 0x555870ce43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cf15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870ceec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:37526/0 (socket says 172.21.15.110:37526) 2024-04-26T11:40:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7e00640 1 -- 172.21.15.110:0/463466979 learned_addr learned my addr 172.21.15.110:0/463466979 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7e00640 1 -- 172.21.15.110:0/463466979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 msgr2=0x555870cf15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7e00640 1 --2- 172.21.15.110:0/463466979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cf15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7e00640 1 -- 172.21.15.110:0/463466979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 msgr2=0x555870ce43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7e00640 1 --2- 172.21.15.110:0/463466979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 0x555870ce43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7e00640 1 -- 172.21.15.110:0/463466979 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555870c07940 con 0x555870ce4900 2024-04-26T11:40:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.913+0000 7efec7e00640 1 --2- 172.21.15.110:0/463466979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870ceec80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efeb80cd8f0 tx=0x7efeb80d8670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d62e18197fc1bf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.914+0000 7efec4c00640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeac0a3d90 0x7efeac0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.914+0000 7efebd200640 1 -- 172.21.15.110:0/463466979 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb80df070 con 0x555870ce4900 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.914+0000 7efecca00640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeac0a3d90 0x7efeac0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.914+0000 7efec4c00640 1 -- 172.21.15.110:0/663835799 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9933+0+0 (secure 0 0 0) 0x7efeb80d0840 con 0x7efec8102740 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.914+0000 7efebd200640 1 -- 172.21.15.110:0/463466979 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb8009de0 con 0x555870ce4900 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.914+0000 7efebd200640 1 -- 172.21.15.110:0/463466979 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8098550 con 0x555870ce4900 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efed17c3740 1 -- 172.21.15.110:0/463466979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 msgr2=0x555870ceec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efecca00640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeac0a3d90 0x7efeac0a6250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efec0009430 tx=0x7efec0009360 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efed17c3740 1 --2- 172.21.15.110:0/463466979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870ceec80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efeb80cd8f0 tx=0x7efeb80d8670 comp rx=0 tx=0).stop 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efed17c3740 1 -- 172.21.15.110:0/463466979 shutdown_connections 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efed17c3740 1 --2- 172.21.15.110:0/463466979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cf15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efed17c3740 1 --2- 172.21.15.110:0/463466979 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870ceec80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efed17c3740 1 --2- 172.21.15.110:0/463466979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 0x555870ce43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efed17c3740 1 -- 172.21.15.110:0/463466979 >> 172.21.15.110:0/463466979 conn(0x555870ce04f0 msgr2=0x555870ce08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efed17c3740 1 -- 172.21.15.110:0/463466979 shutdown_connections 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.915+0000 7efed17c3740 1 -- 172.21.15.110:0/463466979 wait complete. 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efed17c3740 1 -- start start 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efed17c3740 1 Processor -- start 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efed17c3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 0x555870cec080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efed17c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870cec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efed17c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efed17c3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555870cf1df0 con 0x555870ce3fe0 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efed17c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555870bd0c60 con 0x555870cef1c0 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efed17c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555870cf1f70 con 0x555870ce4900 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efed17c3740 10 client.0 _ll_register_callbacks cb 0x555870bfce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.916+0000 7efec7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 0x555870cec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efec7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870cec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efec7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 0x555870cec080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35814/0 (socket says 172.21.15.110:35814) 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efec7e00640 1 -- 172.21.15.110:0/2941532178 learned_addr learned my addr 172.21.15.110:0/2941532178 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efecca00640 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efec7400640 1 -- 172.21.15.110:0/2941532178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 msgr2=0x555870cecb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efec7400640 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cecb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efec7400640 1 -- 172.21.15.110:0/2941532178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 msgr2=0x555870cec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efec7400640 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 0x555870cec080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efec7400640 1 -- 172.21.15.110:0/2941532178 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555870bdf510 con 0x555870ce4900 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efec7400640 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870cec5c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x555870ce1680 tx=0x7efeb400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f530ca6ed7d7bd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efeb1600640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efeb1600640 1 -- 172.21.15.110:0/2941532178 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4009e30 con 0x555870ce4900 2024-04-26T11:40:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efed17c3740 1 -- 172.21.15.110:0/2941532178 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb8009de0 con 0x555870ce4900 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.917+0000 7efeb1600640 1 -- 172.21.15.110:0/2941532178 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9933+0+0 (secure 0 0 0) 0x7efeb4012110 con 0x555870ce4900 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efeb1600640 1 -- 172.21.15.110:0/2941532178 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7efeb4004050 con 0x555870ce4900 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efed17c3740 10 client.26134 fetch_fsmap learned FSMap version 130 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efed17c3740 1 -- 172.21.15.110:0/2941532178 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=4+}) -- 0x55587095b210 con 0x555870ce4900 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efeb1600640 1 -- 172.21.15.110:0/2941532178 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb8009de0 con 0x555870ce4900 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efeb1600640 1 -- 172.21.15.110:0/2941532178 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 130) ==== 7745+0+0 (secure 0 0 0) 0x7efeb4010430 con 0x555870ce4900 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efed17c3740 10 client.26134 fetch_fsmap finished waiting for FSMap version 130 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efed17c3740 10 client.26134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efed17c3740 20 client.26134 populate_metadata read hostname 'smithi110' 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efed17c3740 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x555870cfef30 0x555870d01340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efed17c3740 4 client.26134 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:40:51.924 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efed17c3740 1 -- 172.21.15.110:0/2941532178 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555870c56f90 con 0x555870cfef30 2024-04-26T11:40:51.924 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.918+0000 7efec7e00640 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x555870cfef30 0x555870d01340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.919+0000 7efec7e00640 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x555870cfef30 0x555870d01340 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d538b475a77d38 server_cookie=ffcb4fbb7a95d737 in_seq=0 out_seq=0 2024-04-26T11:40:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.919+0000 7efeb1600640 10 client.26134 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efeb1600640 1 -- 172.21.15.110:0/2941532178 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555870c56f90 con 0x555870cfef30 2024-04-26T11:40:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efeb1600640 10 client.26134 handle_command_reply: tid=0 2024-04-26T11:40:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 client.26134 shutdown 2024-04-26T11:40:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 -- 172.21.15.110:0/2941532178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 msgr2=0x555870cec5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870cec5c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x555870ce1680 tx=0x7efeb400f790 comp rx=0 tx=0).stop 2024-04-26T11:40:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 -- 172.21.15.110:0/2941532178 shutdown_connections 2024-04-26T11:40:51.925 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cecb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x555870cfef30 0x555870d01340 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce4900 0x555870cec5c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efeb1600640 0 client.26134 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 --2- 172.21.15.110:0/2941532178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce3fe0 0x555870cec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 -- 172.21.15.110:0/2941532178 >> 172.21.15.110:0/2941532178 conn(0x555870ce04f0 msgr2=0x555870ce6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 -- 172.21.15.110:0/2941532178 shutdown_connections 2024-04-26T11:40:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 1 -- 172.21.15.110:0/2941532178 wait complete. 2024-04-26T11:40:51.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.920+0000 7efed17c3740 20 client.26134 trim_cache size 0 max 16384 2024-04-26T11:40:51.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.936+0000 7efed17c3740 1 Processor -- start 2024-04-26T11:40:51.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.936+0000 7efed17c3740 1 -- start start 2024-04-26T11:40:51.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efed17c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870cfacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efed17c3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce4900 0x555870ce69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efed17c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cec750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efed17c3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efec81b0cf0 con 0x555870ce4900 2024-04-26T11:40:51.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efed17c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efec81b13c0 con 0x555870cef1c0 2024-04-26T11:40:51.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efed17c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efec81aec70 con 0x555870ce3fe0 2024-04-26T11:40:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870cfacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870cfacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:37530/0 (socket says 172.21.15.110:37530) 2024-04-26T11:40:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efec7e00640 1 -- 172.21.15.110:0/2324278549 learned_addr learned my addr 172.21.15.110:0/2324278549 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efecca00640 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.941 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efec7400640 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce4900 0x555870ce69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efec7e00640 1 -- 172.21.15.110:0/2324278549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 msgr2=0x555870cec750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efec7e00640 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cec750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efec7e00640 1 -- 172.21.15.110:0/2324278549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce4900 msgr2=0x555870ce69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.937+0000 7efec7e00640 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce4900 0x555870ce69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.938+0000 7efec7e00640 1 -- 172.21.15.110:0/2324278549 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555870a27620 con 0x555870ce3fe0 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.938+0000 7efec7400640 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce4900 0x555870ce69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.938+0000 7efec7e00640 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870cfacb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efeb8098c80 tx=0x7efeb80d0ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff218566e6f81c9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.938+0000 7efeb3e00640 1 -- 172.21.15.110:0/2324278549 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8020070 con 0x555870ce3fe0 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.938+0000 7efeb3e00640 1 -- 172.21.15.110:0/2324278549 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb8009de0 con 0x555870ce3fe0 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.938+0000 7efeb3e00640 1 -- 172.21.15.110:0/2324278549 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb80df070 con 0x555870ce3fe0 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 -- 172.21.15.110:0/2324278549 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 msgr2=0x555870cfacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870cfacb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efeb8098c80 tx=0x7efeb80d0ac0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 -- 172.21.15.110:0/2324278549 shutdown_connections 2024-04-26T11:40:51.942 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870cef1c0 0x555870cec750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870ce4900 0x555870ce69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 --2- 172.21.15.110:0/2324278549 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870cfacb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 -- 172.21.15.110:0/2324278549 >> 172.21.15.110:0/2324278549 conn(0x555870ce04f0 msgr2=0x555870cec040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 -- 172.21.15.110:0/2324278549 shutdown_connections 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 -- 172.21.15.110:0/2324278549 wait complete. 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 -- start start 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.939+0000 7efed17c3740 1 Processor -- start 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efed17c3740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870ce8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efed17c3740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870ce4900 0x555870ce8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efed17c3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870cef1c0 0x555870ce9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efed17c3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efec81ae5a0 con 0x555870cef1c0 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efed17c3740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efec81ad190 con 0x555870ce4900 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efed17c3740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efec81ad800 con 0x555870ce3fe0 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efed17c3740 10 client.0 _ll_register_callbacks cb 0x7efeb4009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:40:51.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870ce8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efecca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870cef1c0 0x555870ce9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efec7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870ce4900 0x555870ce8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efecca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870cef1c0 0x555870ce9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35826/0 (socket says 172.21.15.110:35826) 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efecca00640 1 -- 172.21.15.110:0/809469653 learned_addr learned my addr 172.21.15.110:0/809469653 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efec7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870ce8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:37540/0 (socket says 172.21.15.110:37540) 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efec7e00640 1 -- 172.21.15.110:0/809469653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870ce4900 msgr2=0x555870ce8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efec7e00640 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870ce4900 0x555870ce8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efec7e00640 1 -- 172.21.15.110:0/809469653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870cef1c0 msgr2=0x555870ce9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efec7e00640 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870cef1c0 0x555870ce9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:40:51.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.940+0000 7efec7e00640 1 -- 172.21.15.110:0/809469653 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555870c03cb0 con 0x555870ce3fe0 2024-04-26T11:40:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.941+0000 7efec7e00640 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870ce8910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x555870cdbb80 tx=0x7efeb80d8670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b34bdae3a503209 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:40:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.941+0000 7efeb1600640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:40:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.941+0000 7efeb1600640 1 -- 172.21.15.110:0/809469653 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8020070 con 0x555870ce3fe0 2024-04-26T11:40:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.941+0000 7efed17c3740 1 -- 172.21.15.110:0/809469653 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb8009de0 con 0x555870ce3fe0 2024-04-26T11:40:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.941+0000 7efeb1600640 1 -- 172.21.15.110:0/809469653 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9933+0+0 (secure 0 0 0) 0x7efeb80d66d0 con 0x555870ce3fe0 2024-04-26T11:40:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.941+0000 7efeb1600640 1 -- 172.21.15.110:0/809469653 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7efeb80df070 con 0x555870ce3fe0 2024-04-26T11:40:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.941+0000 7efed17c3740 10 client.26140 fetch_fsmap learned FSMap version 130 2024-04-26T11:40:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.941+0000 7efed17c3740 1 -- 172.21.15.110:0/809469653 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=4+}) -- 0x555870c03cb0 con 0x555870ce3fe0 2024-04-26T11:40:51.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.941+0000 7efeb1600640 1 -- 172.21.15.110:0/809469653 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeb8009de0 con 0x555870ce3fe0 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efeb1600640 1 -- 172.21.15.110:0/809469653 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 130) ==== 7745+0+0 (secure 0 0 0) 0x7efeb80cdc30 con 0x555870ce3fe0 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efed17c3740 10 client.26140 fetch_fsmap finished waiting for FSMap version 130 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efed17c3740 10 client.26140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efed17c3740 20 client.26140 populate_metadata read hostname 'smithi110' 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efed17c3740 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x555870cf74c0 0x555870d700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efed17c3740 4 client.26140 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efed17c3740 1 -- 172.21.15.110:0/809469653 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555870c50e00 con 0x555870cf74c0 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efec7400640 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x555870cf74c0 0x555870d700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efec7400640 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x555870cf74c0 0x555870d700d0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c30bedd0fc2809f9 server_cookie=4b79d3ec28aa5a3c in_seq=0 out_seq=0 2024-04-26T11:40:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:40:51.942+0000 7efeb1600640 10 client.26140 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:40:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:51 smithi193 ceph-mon[32782]: pgmap v311: 97 pgs: 97 active+clean; 3.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 5.2 MiB/s wr, 497 op/s 2024-04-26T11:40:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:51 smithi196 ceph-mon[32572]: pgmap v311: 97 pgs: 97 active+clean; 3.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 5.2 MiB/s wr, 497 op/s 2024-04-26T11:40:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:51 smithi110 ceph-mon[28069]: pgmap v311: 97 pgs: 97 active+clean; 3.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 5.2 MiB/s wr, 497 op/s 2024-04-26T11:40:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:53 smithi193 ceph-mon[32782]: pgmap v312: 97 pgs: 97 active+clean; 3.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 5.3 MiB/s wr, 509 op/s 2024-04-26T11:40:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:53 smithi196 ceph-mon[32572]: pgmap v312: 97 pgs: 97 active+clean; 3.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 5.3 MiB/s wr, 509 op/s 2024-04-26T11:40:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:53 smithi110 ceph-mon[28069]: pgmap v312: 97 pgs: 97 active+clean; 3.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 5.3 MiB/s wr, 509 op/s 2024-04-26T11:40:54.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:40:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:55 smithi193 ceph-mon[32782]: pgmap v313: 97 pgs: 97 active+clean; 3.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 7.5 MiB/s wr, 701 op/s 2024-04-26T11:40:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:55 smithi196 ceph-mon[32572]: pgmap v313: 97 pgs: 97 active+clean; 3.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 7.5 MiB/s wr, 701 op/s 2024-04-26T11:40:56.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:55 smithi110 ceph-mon[28069]: pgmap v313: 97 pgs: 97 active+clean; 3.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 7.5 MiB/s wr, 701 op/s 2024-04-26T11:40:57.628 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:57 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:40:57.628 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:57 smithi193 systemd[1]: Stopped Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:57.628 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:57 smithi193 systemd[1]: Starting Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:40:57.941 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:57 smithi193 ceph-mon[32782]: pgmap v314: 97 pgs: 97 active+clean; 3.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 530 op/s 2024-04-26T11:40:57.941 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:57 smithi193 podman[68387]: 2024-04-26 11:40:57.531271216 +0000 UTC m=+0.018480261 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:40:57.941 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:57 smithi193 podman[68387]: 2024-04-26 11:40:57.655207876 +0000 UTC m=+0.142416947 container create e6e9c5a607834fb47b1210b95284d7acb3732b52066e3794b742256b0bf02b4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:40:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:57 smithi196 ceph-mon[32572]: pgmap v314: 97 pgs: 97 active+clean; 3.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 530 op/s 2024-04-26T11:40:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:57 smithi110 ceph-mon[28069]: pgmap v314: 97 pgs: 97 active+clean; 3.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.7 MiB/s wr, 530 op/s 2024-04-26T11:40:58.291 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:40:58.291 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 systemd[1]: Stopped Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:58.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 2.465s CPU time. 2024-04-26T11:40:58.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 systemd[1]: Starting Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:40:58.321 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:57 smithi193 podman[68387]: 2024-04-26 11:40:57.941321968 +0000 UTC m=+0.428530997 container init e6e9c5a607834fb47b1210b95284d7acb3732b52066e3794b742256b0bf02b4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-26T11:40:58.322 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:57 smithi193 podman[68387]: 2024-04-26 11:40:57.944099255 +0000 UTC m=+0.431308285 container start e6e9c5a607834fb47b1210b95284d7acb3732b52066e3794b742256b0bf02b4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-26T11:40:58.322 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:57 smithi193 ceph-mds[68405]: -- 172.21.15.193:0/2390257996 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc7651fa40 con 0x55cc764f2800 2024-04-26T11:40:58.322 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: starting mds.e at 2024-04-26T11:40:58.322 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:58 smithi193 bash[68387]: e6e9c5a607834fb47b1210b95284d7acb3732b52066e3794b742256b0bf02b4d 2024-04-26T11:40:58.322 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:40:58 smithi193 systemd[1]: Started Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:58.666 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 podman[92153]: 2024-04-26 11:40:58.311676967 +0000 UTC m=+0.037133607 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:40:58.666 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 podman[92153]: 2024-04-26 11:40:58.480394811 +0000 UTC m=+0.205851486 container create 2afb7506f4e836354b096be840b5b4cef03b9396220944a284d4154dd24f3047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T11:40:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: daemon mds.e restarted 2024-04-26T11:40:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:40:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: osdmap e116: 12 total, 12 up, 12 in 2024-04-26T11:40:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:boot 2024-04-26T11:40:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: Replacing daemon mds.d as rank 2 with standby daemon mds.f 2024-04-26T11:40:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-04-26T11:40:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T11:40:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:40:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:40:59.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: osdmap e117: 12 total, 12 up, 12 in 2024-04-26T11:40:59.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=f=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:40:59.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 podman[92153]: 2024-04-26 11:40:58.789173439 +0000 UTC m=+0.514630124 container init 2afb7506f4e836354b096be840b5b4cef03b9396220944a284d4154dd24f3047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T11:40:59.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 podman[92153]: 2024-04-26 11:40:58.798214233 +0000 UTC m=+0.523670915 container start 2afb7506f4e836354b096be840b5b4cef03b9396220944a284d4154dd24f3047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, io.buildah.version=1.33.5) 2024-04-26T11:40:59.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: starting mds.d at 2024-04-26T11:40:59.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 bash[92153]: 2afb7506f4e836354b096be840b5b4cef03b9396220944a284d4154dd24f3047 2024-04-26T11:40:59.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:40:58 smithi110 systemd[1]: Started Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: daemon mds.e restarted 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: osdmap e116: 12 total, 12 up, 12 in 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:boot 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: Replacing daemon mds.d as rank 2 with standby daemon mds.f 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: osdmap e117: 12 total, 12 up, 12 in 2024-04-26T11:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:58 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=f=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:40:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: daemon mds.e restarted 2024-04-26T11:40:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:40:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: osdmap e116: 12 total, 12 up, 12 in 2024-04-26T11:40:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:boot 2024-04-26T11:40:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: Replacing daemon mds.d as rank 2 with standby daemon mds.f 2024-04-26T11:40:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-04-26T11:40:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T11:40:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:40:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:40:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: osdmap e117: 12 total, 12 up, 12 in 2024-04-26T11:40:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:58 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=f=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:40:59.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:41:00.105 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:59 smithi110 ceph-mon[28069]: pgmap v317: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.1 MiB/s wr, 389 op/s 2024-04-26T11:41:00.106 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:59 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:resolve 2024-04-26T11:41:00.106 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:59 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:boot 2024-04-26T11:41:00.106 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:59 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:resolve 2024-04-26T11:41:00.106 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:59 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=f=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:00.106 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:40:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:41:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:59 smithi193 ceph-mon[32782]: pgmap v317: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.1 MiB/s wr, 389 op/s 2024-04-26T11:41:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:59 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:resolve 2024-04-26T11:41:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:59 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:boot 2024-04-26T11:41:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:59 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:resolve 2024-04-26T11:41:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:59 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=f=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:40:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:41:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:59 smithi196 ceph-mon[32572]: pgmap v317: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.1 MiB/s wr, 389 op/s 2024-04-26T11:41:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:59 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:resolve 2024-04-26T11:41:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:59 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:boot 2024-04-26T11:41:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:59 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:resolve 2024-04-26T11:41:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:59 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=f=up:resolve} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:40:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:41:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.035+0000 7efeb1600640 1 -- 172.21.15.110:0/809469653 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555870c50e00 con 0x555870cf74c0 2024-04-26T11:41:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.035+0000 7efeb1600640 10 client.26140 handle_command_reply: tid=0 2024-04-26T11:41:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.035+0000 7efed17c3740 1 client.26140 shutdown 2024-04-26T11:41:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.035+0000 7efed17c3740 1 -- 172.21.15.110:0/809469653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 msgr2=0x555870ce8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.035+0000 7efed17c3740 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870ce8910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x555870cdbb80 tx=0x7efeb80d8670 comp rx=0 tx=0).stop 2024-04-26T11:41:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efed17c3740 1 -- 172.21.15.110:0/809469653 shutdown_connections 2024-04-26T11:41:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efed17c3740 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555870cef1c0 0x555870ce9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efed17c3740 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555870ce4900 0x555870ce8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efed17c3740 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x555870cf74c0 0x555870d700d0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efed17c3740 1 --2- 172.21.15.110:0/809469653 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555870ce3fe0 0x555870ce8910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efed17c3740 1 -- 172.21.15.110:0/809469653 >> 172.21.15.110:0/809469653 conn(0x555870ce04f0 msgr2=0x555870cec8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efeb1600640 0 client.26140 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efed17c3740 1 -- 172.21.15.110:0/809469653 shutdown_connections 2024-04-26T11:41:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efed17c3740 1 -- 172.21.15.110:0/809469653 wait complete. 2024-04-26T11:41:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.036+0000 7efed17c3740 20 client.26140 trim_cache size 0 max 16384 2024-04-26T11:41:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:41:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:41:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:41:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:41:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.037+0000 7efecd400640 1 -- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeac0a3d90 msgr2=0x7efeac0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.037+0000 7efecd400640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeac0a3d90 0x7efeac0a6250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efec0009430 tx=0x7efec0009360 comp rx=0 tx=0).stop 2024-04-26T11:41:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 -- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec8102740 msgr2=0x7efec8198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec8102740 0x7efec8198f80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efeb800d950 tx=0x7efeb800de10 comp rx=0 tx=0).stop 2024-04-26T11:41:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 -- 172.21.15.110:0/663835799 shutdown_connections 2024-04-26T11:41:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7efeac0a3d90 0x7efeac0a6250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efec8108750 0x7efec819d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efec8103100 0x7efec81994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 --2- 172.21.15.110:0/663835799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec8102740 0x7efec8198f80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 -- 172.21.15.110:0/663835799 >> 172.21.15.110:0/663835799 conn(0x7efec80fe270 msgr2=0x7efec80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 -- 172.21.15.110:0/663835799 shutdown_connections 2024-04-26T11:41:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:01.038+0000 7efecd400640 1 -- 172.21.15.110:0/663835799 wait complete. 2024-04-26T11:41:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:01 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:41:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:01 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:reconnect 2024-04-26T11:41:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:01 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:reconnect 2024-04-26T11:41:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:01 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=f=up:reconnect} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:01 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0239995 2024-04-26T11:41:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:01 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0249994 2024-04-26T11:41:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:01 smithi110 ceph-mon[28069]: pgmap v318: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.9 MiB/s wr, 372 op/s 2024-04-26T11:41:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:01 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:41:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:01 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:reconnect 2024-04-26T11:41:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:01 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:reconnect 2024-04-26T11:41:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:01 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=f=up:reconnect} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:01 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0239995 2024-04-26T11:41:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:01 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0249994 2024-04-26T11:41:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:01 smithi193 ceph-mon[32782]: pgmap v318: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.9 MiB/s wr, 372 op/s 2024-04-26T11:41:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:01 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:41:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:01 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:reconnect 2024-04-26T11:41:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:01 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:reconnect 2024-04-26T11:41:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:01 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=f=up:reconnect} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:01 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0239995 2024-04-26T11:41:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:01 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0249994 2024-04-26T11:41:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:01 smithi196 ceph-mon[32572]: pgmap v318: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.9 MiB/s wr, 372 op/s 2024-04-26T11:41:02.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:02 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:rejoin 2024-04-26T11:41:02.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:02 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:rejoin 2024-04-26T11:41:02.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:02 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=f=up:rejoin} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:02.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:02 smithi110 ceph-mon[28069]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T11:41:02.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:02 smithi110 ceph-mon[28069]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T11:41:02.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:41:02 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:41:02.213+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T11:41:02.372 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:41:02 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:41:02.213+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T11:41:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:02 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:rejoin 2024-04-26T11:41:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:02 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:rejoin 2024-04-26T11:41:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:02 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=f=up:rejoin} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:02 smithi193 ceph-mon[32782]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T11:41:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:02 smithi193 ceph-mon[32782]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T11:41:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:02 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:rejoin 2024-04-26T11:41:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:02 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:rejoin 2024-04-26T11:41:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:02 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=f=up:rejoin} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:02 smithi196 ceph-mon[32572]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T11:41:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:02 smithi196 ceph-mon[32572]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T11:41:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:03 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:41:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:03 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:41:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:03 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:active 2024-04-26T11:41:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:03 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:active 2024-04-26T11:41:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:03 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=f=up:active} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:03 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:41:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:03 smithi110 ceph-mon[28069]: pgmap v319: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 611 KiB/s wr, 82 op/s 2024-04-26T11:41:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:03 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:41:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:03 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:41:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:03 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:active 2024-04-26T11:41:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:03 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:active 2024-04-26T11:41:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:03 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=f=up:active} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:03 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:41:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:03 smithi193 ceph-mon[32782]: pgmap v319: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 611 KiB/s wr, 82 op/s 2024-04-26T11:41:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:03 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:41:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:03 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:41:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:03 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/4106135097,v1:172.21.15.196:6835/4106135097] up:active 2024-04-26T11:41:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:03 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6836/4287592378,v1:172.21.15.196:6837/4287592378] up:active 2024-04-26T11:41:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:03 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=f=up:active} 1 up:standby-replay 7 up:standby 2024-04-26T11:41:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:03 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:41:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:03 smithi196 ceph-mon[32572]: pgmap v319: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 611 KiB/s wr, 82 op/s 2024-04-26T11:41:04.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 530.0 s, 710.3 tps, lat 438.272 ms stddev 2120.809 2024-04-26T11:41:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:05 smithi196 ceph-mon[32572]: pgmap v320: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 8.2 MiB/s wr, 776 op/s 2024-04-26T11:41:05.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:05 smithi110 ceph-mon[28069]: pgmap v320: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 8.2 MiB/s wr, 776 op/s 2024-04-26T11:41:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:05 smithi193 ceph-mon[32782]: pgmap v320: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 8.2 MiB/s wr, 776 op/s 2024-04-26T11:41:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:06 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:41:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:06 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:41:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:06 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T11:41:07.420 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd75e88d700 time 2024-04-26T11:41:07.055000+0000 2024-04-26T11:41:07.420 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:07.420 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd768eb63dd] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd768eb65a3] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c2e9f16822] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c2e9e86598] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c2e9e88c17] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c2e9d81d0b] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2e9d822ac] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c2e9d6afad] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd76914ae20] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 10: (DispatchQueue::entry()+0x51f) [0x7fd769147fdf] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd76921afc1] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd767c341ca] 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 13: clone() 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.055+0000 7fd75e88d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd75e88d700 time 2024-04-26T11:41:07.055000+0000 2024-04-26T11:41:07.421 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:07.422 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.422 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6f329fd700 time 2024-04-26T11:41:07.051076+0000 2024-04-26T11:41:07.422 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:07.422 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.422 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6f3d0263dd] 2024-04-26T11:41:07.422 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6f3d0265a3] 2024-04-26T11:41:07.422 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55904e33b822] 2024-04-26T11:41:07.422 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55904e2ab598] 2024-04-26T11:41:07.422 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55904e2adc17] 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55904e1a6d0b] 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55904e1a72ac] 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55904e18ffad] 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6f3d2bae20] 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 10: (DispatchQueue::entry()+0x51f) [0x7f6f3d2b7fdf] 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f3d38afc1] 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6f3bda41ca] 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 13: clone() 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.052+0000 7f6f329fd700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6f329fd700 time 2024-04-26T11:41:07.051076+0000 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:07.423 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd768eb63dd] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd768eb65a3] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c2e9f16822] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c2e9e86598] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c2e9e88c17] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c2e9d81d0b] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2e9d822ac] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c2e9d6afad] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd76914ae20] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 10: (DispatchQueue::entry()+0x51f) [0x7fd769147fdf] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd76921afc1] 2024-04-26T11:41:07.424 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd767c341ca] 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 13: clone() 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: *** Caught signal (Aborted) ** 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: in thread 7fd75e88d700 thread_name:ms_dispatch 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd767c3ed20] 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2: gsignal() 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 3: abort() 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd768eb6437] 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd768eb65a3] 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c2e9f16822] 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c2e9e86598] 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c2e9e88c17] 2024-04-26T11:41:07.425 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c2e9d81d0b] 2024-04-26T11:41:07.426 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.426 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6f3d0263dd] 2024-04-26T11:41:07.426 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6f3d0265a3] 2024-04-26T11:41:07.426 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55904e33b822] 2024-04-26T11:41:07.426 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55904e2ab598] 2024-04-26T11:41:07.426 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55904e2adc17] 2024-04-26T11:41:07.426 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55904e1a6d0b] 2024-04-26T11:41:07.426 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55904e1a72ac] 2024-04-26T11:41:07.426 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55904e18ffad] 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6f3d2bae20] 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 10: (DispatchQueue::entry()+0x51f) [0x7f6f3d2b7fdf] 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f3d38afc1] 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6f3bda41ca] 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 13: clone() 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: *** Caught signal (Aborted) ** 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: in thread 7f6f329fd700 thread_name:ms_dispatch 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6f3bdaed20] 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2: gsignal() 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 3: abort() 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6f3d026437] 2024-04-26T11:41:07.427 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6f3d0265a3] 2024-04-26T11:41:07.428 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55904e33b822] 2024-04-26T11:41:07.428 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55904e2ab598] 2024-04-26T11:41:07.428 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55904e2adc17] 2024-04-26T11:41:07.428 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55904e1a6d0b] 2024-04-26T11:41:07.428 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55904e1a72ac] 2024-04-26T11:41:07.428 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55904e18ffad] 2024-04-26T11:41:07.428 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6f3d2bae20] 2024-04-26T11:41:07.428 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 13: (DispatchQueue::entry()+0x51f) [0x7f6f3d2b7fdf] 2024-04-26T11:41:07.428 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f3d38afc1] 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6f3bda41ca] 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 16: clone() 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.053+0000 7f6f329fd700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: in thread 7f6f329fd700 thread_name:ms_dispatch 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6f3bdaed20] 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2: gsignal() 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 3: abort() 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6f3d026437] 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6f3d0265a3] 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55904e33b822] 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55904e2ab598] 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55904e2adc17] 2024-04-26T11:41:07.429 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55904e1a6d0b] 2024-04-26T11:41:07.430 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55904e1a72ac] 2024-04-26T11:41:07.430 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55904e18ffad] 2024-04-26T11:41:07.430 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6f3d2bae20] 2024-04-26T11:41:07.430 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 13: (DispatchQueue::entry()+0x51f) [0x7f6f3d2b7fdf] 2024-04-26T11:41:07.430 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f3d38afc1] 2024-04-26T11:41:07.430 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6f3bda41ca] 2024-04-26T11:41:07.430 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 16: clone() 2024-04-26T11:41:07.430 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2e9d822ac] 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c2e9d6afad] 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd76914ae20] 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 13: (DispatchQueue::entry()+0x51f) [0x7fd769147fdf] 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd76921afc1] 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd767c341ca] 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 16: clone() 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.056+0000 7fd75e88d700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: in thread 7fd75e88d700 thread_name:ms_dispatch 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd767c3ed20] 2024-04-26T11:41:07.431 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2: gsignal() 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 3: abort() 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd768eb6437] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd768eb65a3] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c2e9f16822] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c2e9e86598] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c2e9e88c17] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c2e9d81d0b] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2e9d822ac] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c2e9d6afad] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd76914ae20] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 13: (DispatchQueue::entry()+0x51f) [0x7fd769147fdf] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd76921afc1] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd767c341ca] 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 16: clone() 2024-04-26T11:41:07.432 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: -1> 2024-04-26T11:41:07.055+0000 7fd75e88d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd75e88d700 time 2024-04-26T11:41:07.055000+0000 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd768eb63dd] 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd768eb65a3] 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c2e9f16822] 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c2e9e86598] 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c2e9e88c17] 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c2e9d81d0b] 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2e9d822ac] 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c2e9d6afad] 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd76914ae20] 2024-04-26T11:41:07.433 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 10: (DispatchQueue::entry()+0x51f) [0x7fd769147fdf] 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd76921afc1] 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd767c341ca] 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 13: clone() 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 0> 2024-04-26T11:41:07.056+0000 7fd75e88d700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: in thread 7fd75e88d700 thread_name:ms_dispatch 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd767c3ed20] 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2: gsignal() 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 3: abort() 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd768eb6437] 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd768eb65a3] 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c2e9f16822] 2024-04-26T11:41:07.434 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c2e9e86598] 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c2e9e88c17] 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c2e9d81d0b] 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2e9d822ac] 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c2e9d6afad] 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd76914ae20] 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 13: (DispatchQueue::entry()+0x51f) [0x7fd769147fdf] 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd76921afc1] 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd767c341ca] 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 16: clone() 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: -1> 2024-04-26T11:41:07.055+0000 7fd75e88d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd75e88d700 time 2024-04-26T11:41:07.055000+0000 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.435 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd768eb63dd] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd768eb65a3] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c2e9f16822] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c2e9e86598] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c2e9e88c17] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c2e9d81d0b] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2e9d822ac] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c2e9d6afad] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd76914ae20] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 10: (DispatchQueue::entry()+0x51f) [0x7fd769147fdf] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd76921afc1] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd767c341ca] 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 13: clone() 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.436 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 0> 2024-04-26T11:41:07.056+0000 7fd75e88d700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: in thread 7fd75e88d700 thread_name:ms_dispatch 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd767c3ed20] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2: gsignal() 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 3: abort() 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd768eb6437] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd768eb65a3] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c2e9f16822] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c2e9e86598] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c2e9e88c17] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c2e9d81d0b] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c2e9d822ac] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c2e9d6afad] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd76914ae20] 2024-04-26T11:41:07.437 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 13: (DispatchQueue::entry()+0x51f) [0x7fd769147fdf] 2024-04-26T11:41:07.438 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd76921afc1] 2024-04-26T11:41:07.438 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd767c341ca] 2024-04-26T11:41:07.438 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 16: clone() 2024-04-26T11:41:07.438 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:07.438 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[69902]: 2024-04-26T11:41:07.438 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:07 smithi196 podman[70198]: 2024-04-26 11:41:07.123630374 +0000 UTC m=+0.023594157 container died 9a556c3f81603e04c98f3857f8ae0442f6e6708467fbe4c59f6734a11d95c346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-26T11:41:07.438 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.438 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: -1> 2024-04-26T11:41:07.052+0000 7f6f329fd700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6f329fd700 time 2024-04-26T11:41:07.051076+0000 2024-04-26T11:41:07.439 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:07.439 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.439 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.439 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6f3d0263dd] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6f3d0265a3] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55904e33b822] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55904e2ab598] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55904e2adc17] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55904e1a6d0b] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55904e1a72ac] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55904e18ffad] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6f3d2bae20] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 10: (DispatchQueue::entry()+0x51f) [0x7f6f3d2b7fdf] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f3d38afc1] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6f3bda41ca] 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 13: clone() 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 0> 2024-04-26T11:41:07.053+0000 7f6f329fd700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:07.440 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: in thread 7f6f329fd700 thread_name:ms_dispatch 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6f3bdaed20] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2: gsignal() 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 3: abort() 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6f3d026437] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6f3d0265a3] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55904e33b822] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55904e2ab598] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55904e2adc17] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55904e1a6d0b] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55904e1a72ac] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55904e18ffad] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6f3d2bae20] 2024-04-26T11:41:07.441 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 13: (DispatchQueue::entry()+0x51f) [0x7f6f3d2b7fdf] 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f3d38afc1] 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6f3bda41ca] 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 16: clone() 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: -1> 2024-04-26T11:41:07.052+0000 7f6f329fd700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6f329fd700 time 2024-04-26T11:41:07.051076+0000 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6f3d0263dd] 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6f3d0265a3] 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55904e33b822] 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55904e2ab598] 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55904e2adc17] 2024-04-26T11:41:07.442 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55904e1a6d0b] 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55904e1a72ac] 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55904e18ffad] 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6f3d2bae20] 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 10: (DispatchQueue::entry()+0x51f) [0x7f6f3d2b7fdf] 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f3d38afc1] 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6f3bda41ca] 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 13: clone() 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 0> 2024-04-26T11:41:07.053+0000 7f6f329fd700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: in thread 7f6f329fd700 thread_name:ms_dispatch 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6f3bdaed20] 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2: gsignal() 2024-04-26T11:41:07.443 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 3: abort() 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6f3d026437] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6f3d0265a3] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55904e33b822] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55904e2ab598] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55904e2adc17] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55904e1a6d0b] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55904e1a72ac] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55904e18ffad] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6f3d2bae20] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 13: (DispatchQueue::entry()+0x51f) [0x7f6f3d2b7fdf] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6f3d38afc1] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6f3bda41ca] 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 16: clone() 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:07.444 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f[69897]: 2024-04-26T11:41:07.445 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:07 smithi196 podman[70199]: 2024-04-26 11:41:07.232154776 +0000 UTC m=+0.132042341 container died ad24ec4db9f9e1febec9de77a1553fe6fab9335e51ff8b785b8bbc7a08877728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T11:41:07.445 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:07 smithi110 ceph-mon[28069]: pgmap v321: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 7.3 MiB/s wr, 673 op/s 2024-04-26T11:41:07.445 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:07 smithi110 ceph-mon[28069]: osdmap e118: 12 total, 12 up, 12 in 2024-04-26T11:41:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-mon[32572]: pgmap v321: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 7.3 MiB/s wr, 673 op/s 2024-04-26T11:41:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:07 smithi196 ceph-mon[32572]: osdmap e118: 12 total, 12 up, 12 in 2024-04-26T11:41:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:07 smithi193 ceph-mon[32782]: pgmap v321: 97 pgs: 97 active+clean; 3.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 7.3 MiB/s wr, 673 op/s 2024-04-26T11:41:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:07 smithi193 ceph-mon[32782]: osdmap e118: 12 total, 12 up, 12 in 2024-04-26T11:41:08.457 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:08 smithi196 podman[70198]: 2024-04-26 11:41:08.063653237 +0000 UTC m=+0.963616999 container remove 9a556c3f81603e04c98f3857f8ae0442f6e6708467fbe4c59f6734a11d95c346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:41:08.457 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:08 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:41:09.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 535.0 s, 939.8 tps, lat 50.066 ms stddev 59.762 2024-04-26T11:41:09.931 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:09 smithi196 ceph-mon[32572]: pgmap v323: 97 pgs: 97 active+clean; 3.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 18 MiB/s wr, 1.60k op/s 2024-04-26T11:41:09.931 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:09 smithi196 ceph-mon[32572]: osdmap e119: 12 total, 12 up, 12 in 2024-04-26T11:41:09.931 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:09 smithi196 podman[70199]: 2024-04-26 11:41:09.751129083 +0000 UTC m=+2.651016634 container remove ad24ec4db9f9e1febec9de77a1553fe6fab9335e51ff8b785b8bbc7a08877728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:41:09.931 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:09 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:41:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:09 smithi110 ceph-mon[28069]: pgmap v323: 97 pgs: 97 active+clean; 3.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 18 MiB/s wr, 1.60k op/s 2024-04-26T11:41:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:09 smithi110 ceph-mon[28069]: osdmap e119: 12 total, 12 up, 12 in 2024-04-26T11:41:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:09 smithi193 ceph-mon[32782]: pgmap v323: 97 pgs: 97 active+clean; 3.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 18 MiB/s wr, 1.60k op/s 2024-04-26T11:41:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:09 smithi193 ceph-mon[32782]: osdmap e119: 12 total, 12 up, 12 in 2024-04-26T11:41:10.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:09 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T11:41:10.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:10 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T11:41:10.255 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:10 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.231s CPU time. 2024-04-26T11:41:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:11 smithi196 ceph-mon[32572]: pgmap v325: 97 pgs: 97 active+clean; 3.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 22 MiB/s wr, 1.99k op/s 2024-04-26T11:41:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:11 smithi110 ceph-mon[28069]: pgmap v325: 97 pgs: 97 active+clean; 3.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 22 MiB/s wr, 1.99k op/s 2024-04-26T11:41:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:11 smithi193 ceph-mon[32782]: pgmap v325: 97 pgs: 97 active+clean; 3.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 22 MiB/s wr, 1.99k op/s 2024-04-26T11:41:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:13 smithi196 ceph-mon[32572]: pgmap v326: 97 pgs: 97 active+clean; 3.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2024-04-26T11:41:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:13 smithi110 ceph-mon[28069]: pgmap v326: 97 pgs: 97 active+clean; 3.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2024-04-26T11:41:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:13 smithi193 ceph-mon[32782]: pgmap v326: 97 pgs: 97 active+clean; 3.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2024-04-26T11:41:14.202 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.201+0000 7f7909600640 1 -- 172.21.15.110:0/1815058981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7904104b30 msgr2=0x7f7904104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:14.202 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.201+0000 7f7909600640 1 --2- 172.21.15.110:0/1815058981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7904104b30 0x7f7904104fb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009900 tx=0x7f78ec02a3f0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.201+0000 7f7909600640 1 -- 172.21.15.110:0/1815058981 shutdown_connections 2024-04-26T11:41:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.201+0000 7f7909600640 1 --2- 172.21.15.110:0/1815058981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79041054f0 0x7f79041119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.201+0000 7f7909600640 1 --2- 172.21.15.110:0/1815058981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7904104b30 0x7f7904104fb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.201+0000 7f7909600640 1 --2- 172.21.15.110:0/1815058981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f790410abf0 0x7f790410afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.201+0000 7f7909600640 1 -- 172.21.15.110:0/1815058981 >> 172.21.15.110:0/1815058981 conn(0x7f7904100620 msgr2=0x7f7904102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.201+0000 7f7909600640 1 -- 172.21.15.110:0/1815058981 shutdown_connections 2024-04-26T11:41:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.201+0000 7f7909600640 1 -- 172.21.15.110:0/1815058981 wait complete. 2024-04-26T11:41:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.202+0000 7f7909600640 1 Processor -- start 2024-04-26T11:41:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.202+0000 7f7909600640 1 -- start start 2024-04-26T11:41:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.202+0000 7f7909600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7904104b30 0x7f790419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.202+0000 7f7909600640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79041054f0 0x7f790419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7909600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f790410abf0 0x7f790419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7909600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7904114e30 con 0x7f7904104b30 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7909600640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7904114cb0 con 0x7f79041054f0 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7909600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7904114fb0 con 0x7f790410abf0 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7903400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f790410abf0 0x7f790419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7902a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7904104b30 0x7f790419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7903400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f790410abf0 0x7f790419fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:58454/0 (socket says 172.21.15.110:58454) 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7903400640 1 -- 172.21.15.110:0/1545854450 learned_addr learned my addr 172.21.15.110:0/1545854450 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f78fbe00640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79041054f0 0x7f790419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7903400640 1 -- 172.21.15.110:0/1545854450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79041054f0 msgr2=0x7f790419b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7903400640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79041054f0 0x7f790419b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7903400640 1 -- 172.21.15.110:0/1545854450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7904104b30 msgr2=0x7f790419b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7903400640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7904104b30 0x7f790419b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.203+0000 7f7903400640 1 -- 172.21.15.110:0/1545854450 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79041a01a0 con 0x7f790410abf0 2024-04-26T11:41:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.204+0000 7f7903400640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f790410abf0 0x7f790419fa70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00eb10 tx=0x7f78fc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.204+0000 7f78fb400640 1 -- 172.21.15.110:0/1545854450 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc004b20 con 0x7f790410abf0 2024-04-26T11:41:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.204+0000 7f7909600640 1 -- 172.21.15.110:0/1545854450 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79041a0490 con 0x7f790410abf0 2024-04-26T11:41:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.204+0000 7f78fb400640 1 -- 172.21.15.110:0/1545854450 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc004cc0 con 0x7f790410abf0 2024-04-26T11:41:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.204+0000 7f78fb400640 1 -- 172.21.15.110:0/1545854450 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc010690 con 0x7f790410abf0 2024-04-26T11:41:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.204+0000 7f7909600640 1 -- 172.21.15.110:0/1545854450 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79041a7d20 con 0x7f790410abf0 2024-04-26T11:41:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.208+0000 7f790c5b1740 1 Processor -- start 2024-04-26T11:41:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.208+0000 7f78fb400640 1 -- 172.21.15.110:0/1545854450 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f78fc005020 con 0x7f790410abf0 2024-04-26T11:41:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.208+0000 7f790c5b1740 1 -- start start 2024-04-26T11:41:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdecd01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecdaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecdafb0 0x55afdecdd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f790c5b1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55afdec35380 con 0x55afdecd06f0 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f790c5b1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55afdebd1c30 con 0x55afdecdafb0 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f790c5b1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55afdec31340 con 0x55afdeccfdd0 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f7902a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecdaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f7902a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecdaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57976/0 (socket says 172.21.15.110:57976) 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f78fbe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdecd01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f7902a00640 1 -- 172.21.15.110:0/742701073 learned_addr learned my addr 172.21.15.110:0/742701073 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.209+0000 7f78fbe00640 1 --2- 172.21.15.110:0/742701073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecdafb0 0x55afdecdd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f7902a00640 1 -- 172.21.15.110:0/742701073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 msgr2=0x55afdecd01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f7902a00640 1 --2- 172.21.15.110:0/742701073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdecd01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f7902a00640 1 -- 172.21.15.110:0/742701073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecdafb0 msgr2=0x55afdecdd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f7902a00640 1 --2- 172.21.15.110:0/742701073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecdafb0 0x55afdecdd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f7902a00640 1 -- 172.21.15.110:0/742701073 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afdebf3940 con 0x55afdecd06f0 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f78fbe00640 1 --2- 172.21.15.110:0/742701073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecdafb0 0x55afdecdd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f7902a00640 1 --2- 172.21.15.110:0/742701073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecdaa70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009cf0 tx=0x7f78f4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeab1e8a8e42751 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f78fb400640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78e80a3dc0 0x7f78e80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f78fb400640 1 -- 172.21.15.110:0/1545854450 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 10149+0+0 (secure 0 0 0) 0x7f78fc0d1400 con 0x7f790410abf0 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f78f3400640 1 -- 172.21.15.110:0/742701073 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4004230 con 0x55afdecd06f0 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f78f3400640 1 -- 172.21.15.110:0/742701073 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f40043d0 con 0x55afdecd06f0 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f78f3400640 1 -- 172.21.15.110:0/742701073 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4019880 con 0x55afdecd06f0 2024-04-26T11:41:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.210+0000 7f78fbe00640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78e80a3dc0 0x7f78e80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f790c5b1740 1 -- 172.21.15.110:0/742701073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 msgr2=0x55afdecdaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f790c5b1740 1 --2- 172.21.15.110:0/742701073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecdaa70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009cf0 tx=0x7f78f4011810 comp rx=0 tx=0).stop 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f78fbe00640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78e80a3dc0 0x7f78e80a6280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f78ec000c00 tx=0x7f78ec02a3f0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f790c5b1740 1 -- 172.21.15.110:0/742701073 shutdown_connections 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f790c5b1740 1 --2- 172.21.15.110:0/742701073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecdafb0 0x55afdecdd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f790c5b1740 1 --2- 172.21.15.110:0/742701073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecdaa70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f790c5b1740 1 --2- 172.21.15.110:0/742701073 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdecd01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f790c5b1740 1 -- 172.21.15.110:0/742701073 >> 172.21.15.110:0/742701073 conn(0x55afdeccc2e0 msgr2=0x55afdeccc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f790c5b1740 1 -- 172.21.15.110:0/742701073 shutdown_connections 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.211+0000 7f790c5b1740 1 -- 172.21.15.110:0/742701073 wait complete. 2024-04-26T11:41:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.212+0000 7f790c5b1740 1 -- start start 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.212+0000 7f790c5b1740 1 Processor -- start 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.212+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdeccfdd0 0x55afdecd7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.212+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 0x55afdecd84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.212+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.212+0000 7f790c5b1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55afdecddbe0 con 0x55afdeccfdd0 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.212+0000 7f790c5b1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55afdebbcc60 con 0x55afdecd06f0 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.212+0000 7f790c5b1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55afdecddd60 con 0x55afdecdafb0 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.212+0000 7f790c5b1740 10 client.0 _ll_register_callbacks cb 0x55afdebe8e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7902a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdeccfdd0 0x55afdecd7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f78fbe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 0x55afdecd84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7902a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdeccfdd0 0x55afdecd7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57992/0 (socket says 172.21.15.110:57992) 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7902a00640 1 -- 172.21.15.110:0/3824099910 learned_addr learned my addr 172.21.15.110:0/3824099910 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7903400640 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7902a00640 1 -- 172.21.15.110:0/3824099910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 msgr2=0x55afdecd89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7902a00640 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7902a00640 1 -- 172.21.15.110:0/3824099910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 msgr2=0x55afdecd84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7902a00640 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 0x55afdecd84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7902a00640 1 -- 172.21.15.110:0/3824099910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afdebcb510 con 0x55afdeccfdd0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f7902a00640 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdeccfdd0 0x55afdecd7f60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f78f4004630 tx=0x7f78f4005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b61aa5d84863e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.213+0000 7f78e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.214+0000 7f78e7e00640 1 -- 172.21.15.110:0/3824099910 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4027070 con 0x55afdeccfdd0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.214+0000 7f78e7e00640 1 -- 172.21.15.110:0/3824099910 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 10149+0+0 (secure 0 0 0) 0x7f78f40037f0 con 0x55afdeccfdd0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.214+0000 7f790c5b1740 1 -- 172.21.15.110:0/3824099910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f40043d0 con 0x55afdeccfdd0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.214+0000 7f78e7e00640 1 -- 172.21.15.110:0/3824099910 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7f78f4033050 con 0x55afdeccfdd0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.214+0000 7f790c5b1740 10 client.15888 fetch_fsmap learned FSMap version 138 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.214+0000 7f790c5b1740 1 -- 172.21.15.110:0/3824099910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=4+}) -- 0x55afde947210 con 0x55afdeccfdd0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.214+0000 7f78e7e00640 1 -- 172.21.15.110:0/3824099910 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f40043d0 con 0x55afdeccfdd0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.214+0000 7f78e7e00640 1 -- 172.21.15.110:0/3824099910 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 138) ==== 7741+0+0 (secure 0 0 0) 0x7f78f4004850 con 0x55afdeccfdd0 2024-04-26T11:41:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.214+0000 7f790c5b1740 10 client.15888 fetch_fsmap finished waiting for FSMap version 138 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.215+0000 7f790c5b1740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.215+0000 7f790c5b1740 20 client.15888 populate_metadata read hostname 'smithi110' 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.215+0000 7f790c5b1740 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55afdeceabe0 0x55afdececfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.215+0000 7f790c5b1740 4 client.15888 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.215+0000 7f790c5b1740 1 -- 172.21.15.110:0/3824099910 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afdec42f90 con 0x55afdeceabe0 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.215+0000 7f78fbe00640 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55afdeceabe0 0x55afdececfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.215+0000 7f78e7e00640 10 client.15888 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.215+0000 7f78fbe00640 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55afdeceabe0 0x55afdececfd0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bc82c70b69c72e1 server_cookie=3d8bd1ba56bdd1d7 in_seq=0 out_seq=0 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.216+0000 7f78e7e00640 1 -- 172.21.15.110:0/3824099910 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55afdec42f90 con 0x55afdeceabe0 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.216+0000 7f78e7e00640 10 client.15888 handle_command_reply: tid=0 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.216+0000 7f790c5b1740 1 client.15888 shutdown 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.216+0000 7f790c5b1740 1 -- 172.21.15.110:0/3824099910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdeccfdd0 msgr2=0x55afdecd7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.216+0000 7f790c5b1740 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdeccfdd0 0x55afdecd7f60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f78f4004630 tx=0x7f78f4005270 comp rx=0 tx=0).stop 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.216+0000 7f790c5b1740 1 -- 172.21.15.110:0/3824099910 shutdown_connections 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.216+0000 7f790c5b1740 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55afdeceabe0 0x55afdececfd0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.216+0000 7f790c5b1740 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.217+0000 7f78e7e00640 0 client.15888 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.217+0000 7f790c5b1740 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 0x55afdecd84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.217+0000 7f790c5b1740 1 --2- 172.21.15.110:0/3824099910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdeccfdd0 0x55afdecd7f60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.217+0000 7f790c5b1740 1 -- 172.21.15.110:0/3824099910 >> 172.21.15.110:0/3824099910 conn(0x55afdeccc2e0 msgr2=0x55afdecd2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.217+0000 7f790c5b1740 1 -- 172.21.15.110:0/3824099910 shutdown_connections 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.217+0000 7f790c5b1740 1 -- 172.21.15.110:0/3824099910 wait complete. 2024-04-26T11:41:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.217+0000 7f790c5b1740 20 client.15888 trim_cache size 0 max 16384 2024-04-26T11:41:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f790c5b1740 1 Processor -- start 2024-04-26T11:41:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f790c5b1740 1 -- start start 2024-04-26T11:41:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdeccfdd0 0x55afdece6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecd2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f790c5b1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f79041b30d0 con 0x55afdecd06f0 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f790c5b1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79041b37d0 con 0x55afdeccfdd0 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f790c5b1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79041b10b0 con 0x55afdecdafb0 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f7903400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f78fbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecd2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f7903400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:58484/0 (socket says 172.21.15.110:58484) 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f7903400640 1 -- 172.21.15.110:0/2674944512 learned_addr learned my addr 172.21.15.110:0/2674944512 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.233+0000 7f7902a00640 1 --2- 172.21.15.110:0/2674944512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdeccfdd0 0x55afdece6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.234+0000 7f7903400640 1 -- 172.21.15.110:0/2674944512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdeccfdd0 msgr2=0x55afdece6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.234+0000 7f7903400640 1 --2- 172.21.15.110:0/2674944512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdeccfdd0 0x55afdece6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.234+0000 7f7903400640 1 -- 172.21.15.110:0/2674944512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 msgr2=0x55afdecd2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.234+0000 7f7903400640 1 --2- 172.21.15.110:0/2674944512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecd2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.234+0000 7f7903400640 1 -- 172.21.15.110:0/2674944512 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afdecdd710 con 0x55afdecdafb0 2024-04-26T11:41:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.234+0000 7f7903400640 1 --2- 172.21.15.110:0/2674944512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd8630 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0996b0 tx=0x7f78fc00cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c31d7564799f17d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.234+0000 7f78f2a00640 1 -- 172.21.15.110:0/2674944512 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0b5070 con 0x55afdecdafb0 2024-04-26T11:41:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.234+0000 7f78f2a00640 1 -- 172.21.15.110:0/2674944512 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc09cce0 con 0x55afdecdafb0 2024-04-26T11:41:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.234+0000 7f78f2a00640 1 -- 172.21.15.110:0/2674944512 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc099350 con 0x55afdecdafb0 2024-04-26T11:41:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 -- 172.21.15.110:0/2674944512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 msgr2=0x55afdecd8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 --2- 172.21.15.110:0/2674944512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd8630 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0996b0 tx=0x7f78fc00cee0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 -- 172.21.15.110:0/2674944512 shutdown_connections 2024-04-26T11:41:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 --2- 172.21.15.110:0/2674944512 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdecdafb0 0x55afdecd8630 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 --2- 172.21.15.110:0/2674944512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecd06f0 0x55afdecd2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 --2- 172.21.15.110:0/2674944512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdeccfdd0 0x55afdece6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 -- 172.21.15.110:0/2674944512 >> 172.21.15.110:0/2674944512 conn(0x55afdeccc2e0 msgr2=0x55afdecd7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 -- 172.21.15.110:0/2674944512 shutdown_connections 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 -- 172.21.15.110:0/2674944512 wait complete. 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.235+0000 7f790c5b1740 1 -- start start 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f790c5b1740 1 Processor -- start 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdece3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 0x55afdecd4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f790c5b1740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecdafb0 0x55afdecd5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f790c5b1740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f79041b09e0 con 0x55afdecdafb0 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f790c5b1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79041af5f0 con 0x55afdecd06f0 2024-04-26T11:41:14.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f790c5b1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79041afc40 con 0x55afdeccfdd0 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f790c5b1740 10 client.0 _ll_register_callbacks cb 0x7f78fc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f7902a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdece3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f7902a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdece3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:58486/0 (socket says 172.21.15.110:58486) 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f7903400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecdafb0 0x55afdecd5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f7902a00640 1 -- 172.21.15.110:0/1142326828 learned_addr learned my addr 172.21.15.110:0/1142326828 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.236+0000 7f78fbe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 0x55afdecd4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f7902a00640 1 -- 172.21.15.110:0/1142326828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 msgr2=0x55afdecd4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f7902a00640 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 0x55afdecd4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f7902a00640 1 -- 172.21.15.110:0/1142326828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecdafb0 msgr2=0x55afdecd5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f7902a00640 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecdafb0 0x55afdecd5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f7902a00640 1 -- 172.21.15.110:0/1142326828 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afdea13620 con 0x55afdeccfdd0 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f7902a00640 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdece3440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f78f4004dc0 tx=0x7f78f4004580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ecd6466a1fcf32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f78e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f78e7e00640 1 -- 172.21.15.110:0/1142326828 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4027040 con 0x55afdeccfdd0 2024-04-26T11:41:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f790c5b1740 1 -- 172.21.15.110:0/1142326828 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78fc09cce0 con 0x55afdeccfdd0 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f78e7e00640 1 -- 172.21.15.110:0/1142326828 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 10149+0+0 (secure 0 0 0) 0x7f78f4019690 con 0x55afdeccfdd0 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f78e7e00640 1 -- 172.21.15.110:0/1142326828 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=138) ==== 24+0+0 (secure 0 0 0) 0x7f78f4045050 con 0x55afdeccfdd0 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f790c5b1740 10 client.26167 fetch_fsmap learned FSMap version 138 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.237+0000 7f790c5b1740 1 -- 172.21.15.110:0/1142326828 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=138,monmap=4+}) -- 0x55afdebefcb0 con 0x55afdeccfdd0 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.238+0000 7f78e7e00640 1 -- 172.21.15.110:0/1142326828 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc09cce0 con 0x55afdeccfdd0 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.238+0000 7f78e7e00640 1 -- 172.21.15.110:0/1142326828 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 138) ==== 7741+0+0 (secure 0 0 0) 0x7f78f40198e0 con 0x55afdeccfdd0 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.238+0000 7f790c5b1740 10 client.26167 fetch_fsmap finished waiting for FSMap version 138 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.238+0000 7f790c5b1740 10 client.26167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.238+0000 7f790c5b1740 20 client.26167 populate_metadata read hostname 'smithi110' 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.238+0000 7f790c5b1740 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55afded514c0 0x55afded538e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.238+0000 7f790c5b1740 4 client.26167 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.238+0000 7f790c5b1740 1 -- 172.21.15.110:0/1142326828 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55afdec3ce00 con 0x55afded514c0 2024-04-26T11:41:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.238+0000 7f78fbe00640 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55afded514c0 0x55afded538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.239+0000 7f78fbe00640 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55afded514c0 0x55afded538e0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6469b4571dd85564 server_cookie=c7f87037ef4075cc in_seq=0 out_seq=0 2024-04-26T11:41:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:14.239+0000 7f78e7e00640 10 client.26167 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:14.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:41:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:15 smithi196 ceph-mon[32572]: pgmap v327: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 16 MiB/s wr, 1.41k op/s 2024-04-26T11:41:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:15 smithi110 ceph-mon[28069]: pgmap v327: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 16 MiB/s wr, 1.41k op/s 2024-04-26T11:41:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:15 smithi193 ceph-mon[32782]: pgmap v327: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 16 MiB/s wr, 1.41k op/s 2024-04-26T11:41:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:17 smithi196 ceph-mon[32572]: pgmap v328: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 1.13k op/s 2024-04-26T11:41:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:17 smithi110 ceph-mon[28069]: pgmap v328: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 1.13k op/s 2024-04-26T11:41:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:17 smithi193 ceph-mon[32782]: pgmap v328: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 1.13k op/s 2024-04-26T11:41:19.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:41:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:19 smithi196 ceph-mon[32572]: pgmap v329: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-04-26T11:41:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:19 smithi110 ceph-mon[28069]: pgmap v329: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-04-26T11:41:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:19 smithi193 ceph-mon[32782]: pgmap v329: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-04-26T11:41:20.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 4. 2024-04-26T11:41:20.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: Stopped Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:41:20.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: Starting Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:41:20.260 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 podman[70339]: 2024-04-26 11:41:20.153233851 +0000 UTC m=+0.018592385 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:41:20.260 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 6. 2024-04-26T11:41:20.261 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: Stopped Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:41:20.261 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.231s CPU time. 2024-04-26T11:41:20.261 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Start request repeated too quickly. 2024-04-26T11:41:20.261 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T11:41:20.261 INFO:journalctl@ceph.mds.f.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: Failed to start Ceph mds.f for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:41:20.571 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 podman[70339]: 2024-04-26 11:41:20.259986427 +0000 UTC m=+0.125344932 container create 741a766d8d7f5afb60aefd580f8ea5f6a83ed19d32980228e9e9afb4dad493db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T11:41:21.005 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 podman[70339]: 2024-04-26 11:41:20.571454673 +0000 UTC m=+0.436813178 container init 741a766d8d7f5afb60aefd580f8ea5f6a83ed19d32980228e9e9afb4dad493db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 podman[70339]: 2024-04-26 11:41:20.574059134 +0000 UTC m=+0.439417643 container start 741a766d8d7f5afb60aefd580f8ea5f6a83ed19d32980228e9e9afb4dad493db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mds[70358]: -- 172.21.15.196:0/2297872738 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591409d1a40 con 0x5591409a4800 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: starting mds.c at 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 bash[70339]: 741a766d8d7f5afb60aefd580f8ea5f6a83ed19d32980228e9e9afb4dad493db 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:20 smithi196 systemd[1]: Started Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: daemon mds.c restarted 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: osdmap e120: 12 total, 12 up, 12 in 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:boot 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: Replacing daemon mds.f as rank 2 with standby daemon mds.e 2024-04-26T11:41:21.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-04-26T11:41:21.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-04-26T11:41:21.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:41:21.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:41:21.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: osdmap e121: 12 total, 12 up, 12 in 2024-04-26T11:41:21.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:20 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: daemon mds.c restarted 2024-04-26T11:41:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:41:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: osdmap e120: 12 total, 12 up, 12 in 2024-04-26T11:41:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:boot 2024-04-26T11:41:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: Replacing daemon mds.f as rank 2 with standby daemon mds.e 2024-04-26T11:41:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-04-26T11:41:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-04-26T11:41:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:41:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:41:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: osdmap e121: 12 total, 12 up, 12 in 2024-04-26T11:41:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:20 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: daemon mds.c restarted 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: osdmap e120: 12 total, 12 up, 12 in 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:boot 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: Replacing daemon mds.f as rank 2 with standby daemon mds.e 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:41:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: osdmap e121: 12 total, 12 up, 12 in 2024-04-26T11:41:21.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:20 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=e=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:21 smithi196 ceph-mon[32572]: pgmap v330: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.2 MiB/s wr, 153 op/s 2024-04-26T11:41:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:21 smithi110 ceph-mon[28069]: pgmap v330: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.2 MiB/s wr, 153 op/s 2024-04-26T11:41:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:21 smithi193 ceph-mon[32782]: pgmap v330: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.2 MiB/s wr, 153 op/s 2024-04-26T11:41:22.993 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:22 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:resolve 2024-04-26T11:41:22.993 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:22 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:resolve 2024-04-26T11:41:22.993 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:22 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:22 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:resolve 2024-04-26T11:41:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:22 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:resolve 2024-04-26T11:41:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:22 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:22 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:resolve 2024-04-26T11:41:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:22 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:resolve 2024-04-26T11:41:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:22 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=e=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.774+0000 7f78e7e00640 1 -- 172.21.15.110:0/1142326828 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55afdec3ce00 con 0x55afded514c0 2024-04-26T11:41:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.774+0000 7f78e7e00640 10 client.26167 handle_command_reply: tid=0 2024-04-26T11:41:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.774+0000 7f790c5b1740 1 client.26167 shutdown 2024-04-26T11:41:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.775+0000 7f790c5b1740 1 -- 172.21.15.110:0/1142326828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 msgr2=0x55afdece3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.775+0000 7f790c5b1740 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdece3440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f78f4004dc0 tx=0x7f78f4004580 comp rx=0 tx=0).stop 2024-04-26T11:41:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.775+0000 7f790c5b1740 1 -- 172.21.15.110:0/1142326828 shutdown_connections 2024-04-26T11:41:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.775+0000 7f790c5b1740 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55afdecdafb0 0x55afdecd5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.775+0000 7f790c5b1740 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55afdecd06f0 0x55afdecd4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.775+0000 7f790c5b1740 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55afded514c0 0x55afded538e0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.775+0000 7f790c5b1740 1 --2- 172.21.15.110:0/1142326828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55afdeccfdd0 0x55afdece3440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.775+0000 7f790c5b1740 1 -- 172.21.15.110:0/1142326828 >> 172.21.15.110:0/1142326828 conn(0x55afdeccc2e0 msgr2=0x55afdecd8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.775+0000 7f78e7e00640 0 client.26167 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.776+0000 7f790c5b1740 1 -- 172.21.15.110:0/1142326828 shutdown_connections 2024-04-26T11:41:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.776+0000 7f790c5b1740 1 -- 172.21.15.110:0/1142326828 wait complete. 2024-04-26T11:41:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.776+0000 7f790c5b1740 20 client.26167 trim_cache size 0 max 16384 2024-04-26T11:41:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:41:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:41:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:41:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:41:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 -- 172.21.15.110:0/1545854450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78e80a3dc0 msgr2=0x7f78e80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78e80a3dc0 0x7f78e80a6280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f78ec000c00 tx=0x7f78ec02a3f0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 -- 172.21.15.110:0/1545854450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f790410abf0 msgr2=0x7f790419fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f790410abf0 0x7f790419fa70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00eb10 tx=0x7f78fc00c2d0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 -- 172.21.15.110:0/1545854450 shutdown_connections 2024-04-26T11:41:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78e80a3dc0 0x7f78e80a6280 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f790410abf0 0x7f790419fa70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79041054f0 0x7f790419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 --2- 172.21.15.110:0/1545854450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7904104b30 0x7f790419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.777+0000 7f7909600640 1 -- 172.21.15.110:0/1545854450 >> 172.21.15.110:0/1545854450 conn(0x7f7904100620 msgr2=0x7f7904101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.778+0000 7f7909600640 1 -- 172.21.15.110:0/1545854450 shutdown_connections 2024-04-26T11:41:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:23.778+0000 7f7909600640 1 -- 172.21.15.110:0/1545854450 wait complete. 2024-04-26T11:41:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:23 smithi196 ceph-mon[32572]: pgmap v333: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 956 KiB/s wr, 121 op/s 2024-04-26T11:41:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:23 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:41:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:23 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0269996 2024-04-26T11:41:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:reconnect 2024-04-26T11:41:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:reconnect 2024-04-26T11:41:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:23 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:24.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:23 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0309995 2024-04-26T11:41:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:23 smithi110 ceph-mon[28069]: pgmap v333: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 956 KiB/s wr, 121 op/s 2024-04-26T11:41:24.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:23 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:41:24.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:23 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0269996 2024-04-26T11:41:24.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:reconnect 2024-04-26T11:41:24.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:reconnect 2024-04-26T11:41:24.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:23 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:24.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:23 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0309995 2024-04-26T11:41:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:23 smithi193 ceph-mon[32782]: pgmap v333: 97 pgs: 97 active+clean; 3.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 956 KiB/s wr, 121 op/s 2024-04-26T11:41:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:23 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:41:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:23 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0269996 2024-04-26T11:41:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:reconnect 2024-04-26T11:41:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:reconnect 2024-04-26T11:41:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:23 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=e=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:23 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0309995 2024-04-26T11:41:24.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 550.0 s, 45.6 tps, lat 7737.377 ms stddev 8696.375 2024-04-26T11:41:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:24 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:rejoin 2024-04-26T11:41:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:24 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:rejoin 2024-04-26T11:41:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:24 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:24 smithi110 ceph-mon[28069]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:41:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:24 smithi110 ceph-mon[28069]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-04-26T11:41:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:24 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:rejoin 2024-04-26T11:41:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:24 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:rejoin 2024-04-26T11:41:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:24 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:24 smithi193 ceph-mon[32782]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:41:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:24 smithi193 ceph-mon[32782]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-04-26T11:41:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:24 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:rejoin 2024-04-26T11:41:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:24 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:rejoin 2024-04-26T11:41:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:24 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=e=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:24 smithi196 ceph-mon[32572]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:41:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:24 smithi196 ceph-mon[32572]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-04-26T11:41:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:25 smithi110 ceph-mon[28069]: pgmap v334: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 204 op/s 2024-04-26T11:41:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:25 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:41:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:25 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:41:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:25 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:active 2024-04-26T11:41:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:25 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:active 2024-04-26T11:41:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:25 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:25 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:25 smithi193 ceph-mon[32782]: pgmap v334: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 204 op/s 2024-04-26T11:41:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:25 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:41:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:25 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:41:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:25 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:active 2024-04-26T11:41:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:25 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:active 2024-04-26T11:41:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:25 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:25 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:25 smithi196 ceph-mon[32572]: pgmap v334: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 204 op/s 2024-04-26T11:41:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:25 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:41:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:25 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:41:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:25 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/4144683120,v1:172.21.15.193:6835/4144683120] up:active 2024-04-26T11:41:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:25 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1179476658,v1:172.21.15.110:6837/1179476658] up:active 2024-04-26T11:41:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:25 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:25 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:27 smithi110 ceph-mon[28069]: pgmap v335: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 710 KiB/s wr, 90 op/s 2024-04-26T11:41:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:27 smithi193 ceph-mon[32782]: pgmap v335: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 710 KiB/s wr, 90 op/s 2024-04-26T11:41:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:27 smithi196 ceph-mon[32572]: pgmap v335: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 710 KiB/s wr, 90 op/s 2024-04-26T11:41:29.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 555.0 s, 2501.3 tps, lat 39.622 ms stddev 43.859 2024-04-26T11:41:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-mon[32782]: pgmap v336: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 392 op/s 2024-04-26T11:41:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:30.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc4b56e6700 time 2024-04-26T11:41:29.792933+0000 2024-04-26T11:41:30.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:30.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc4bfd0f3dd] 2024-04-26T11:41:30.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc4bfd0f5a3] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55cc74694822] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55cc74604598] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cc74606c17] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cc744ffd0b] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cc745002ac] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55cc744e8fad] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc4bffa3e20] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 10: (DispatchQueue::entry()+0x51f) [0x7fc4bffa0fdf] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc4c0073fc1] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc4bea8d1ca] 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 13: clone() 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: *** Caught signal (Aborted) ** 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: in thread 7fc4b56e6700 thread_name:ms_dispatch 2024-04-26T11:41:30.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:29.793+0000 7fc4b56e6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc4b56e6700 time 2024-04-26T11:41:29.792933+0000 2024-04-26T11:41:30.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:30.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc4bfd0f3dd] 2024-04-26T11:41:30.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc4bfd0f5a3] 2024-04-26T11:41:30.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55cc74694822] 2024-04-26T11:41:30.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55cc74604598] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cc74606c17] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cc744ffd0b] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cc745002ac] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55cc744e8fad] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc4bffa3e20] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 10: (DispatchQueue::entry()+0x51f) [0x7fc4bffa0fdf] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc4c0073fc1] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc4bea8d1ca] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 13: clone() 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc4bea97d20] 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2: gsignal() 2024-04-26T11:41:30.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 3: abort() 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc4bfd0f437] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc4bfd0f5a3] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55cc74694822] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55cc74604598] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cc74606c17] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cc744ffd0b] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cc745002ac] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55cc744e8fad] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc4bffa3e20] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 13: (DispatchQueue::entry()+0x51f) [0x7fc4bffa0fdf] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc4c0073fc1] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc4bea8d1ca] 2024-04-26T11:41:30.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 16: clone() 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:29.794+0000 7fc4b56e6700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: in thread 7fc4b56e6700 thread_name:ms_dispatch 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc4bea97d20] 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2: gsignal() 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 3: abort() 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc4bfd0f437] 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc4bfd0f5a3] 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55cc74694822] 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55cc74604598] 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cc74606c17] 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cc744ffd0b] 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cc745002ac] 2024-04-26T11:41:30.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55cc744e8fad] 2024-04-26T11:41:30.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc4bffa3e20] 2024-04-26T11:41:30.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 13: (DispatchQueue::entry()+0x51f) [0x7fc4bffa0fdf] 2024-04-26T11:41:30.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc4c0073fc1] 2024-04-26T11:41:30.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc4bea8d1ca] 2024-04-26T11:41:30.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 16: clone() 2024-04-26T11:41:30.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: -1> 2024-04-26T11:41:29.793+0000 7fc4b56e6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc4b56e6700 time 2024-04-26T11:41:29.792933+0000 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc4bfd0f3dd] 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc4bfd0f5a3] 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55cc74694822] 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55cc74604598] 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cc74606c17] 2024-04-26T11:41:30.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cc744ffd0b] 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cc745002ac] 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55cc744e8fad] 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc4bffa3e20] 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 10: (DispatchQueue::entry()+0x51f) [0x7fc4bffa0fdf] 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc4c0073fc1] 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc4bea8d1ca] 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 13: clone() 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 0> 2024-04-26T11:41:29.794+0000 7fc4b56e6700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: in thread 7fc4b56e6700 thread_name:ms_dispatch 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc4bea97d20] 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2: gsignal() 2024-04-26T11:41:30.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 3: abort() 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc4bfd0f437] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc4bfd0f5a3] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55cc74694822] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55cc74604598] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cc74606c17] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cc744ffd0b] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cc745002ac] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55cc744e8fad] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc4bffa3e20] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 13: (DispatchQueue::entry()+0x51f) [0x7fc4bffa0fdf] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc4c0073fc1] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc4bea8d1ca] 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 16: clone() 2024-04-26T11:41:30.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: -1> 2024-04-26T11:41:29.793+0000 7fc4b56e6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc4b56e6700 time 2024-04-26T11:41:29.792933+0000 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc4bfd0f3dd] 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc4bfd0f5a3] 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55cc74694822] 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55cc74604598] 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cc74606c17] 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cc744ffd0b] 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cc745002ac] 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55cc744e8fad] 2024-04-26T11:41:30.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc4bffa3e20] 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 10: (DispatchQueue::entry()+0x51f) [0x7fc4bffa0fdf] 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc4c0073fc1] 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc4bea8d1ca] 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 13: clone() 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 0> 2024-04-26T11:41:29.794+0000 7fc4b56e6700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: in thread 7fc4b56e6700 thread_name:ms_dispatch 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc4bea97d20] 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2: gsignal() 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 3: abort() 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc4bfd0f437] 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc4bfd0f5a3] 2024-04-26T11:41:30.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55cc74694822] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55cc74604598] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55cc74606c17] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55cc744ffd0b] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55cc745002ac] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55cc744e8fad] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc4bffa3e20] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 13: (DispatchQueue::entry()+0x51f) [0x7fc4bffa0fdf] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc4c0073fc1] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc4bea8d1ca] 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 16: clone() 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68401]: 2024-04-26T11:41:30.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:29 smithi193 podman[68467]: 2024-04-26 11:41:29.854714811 +0000 UTC m=+0.020292116 container died e6e9c5a607834fb47b1210b95284d7acb3732b52066e3794b742256b0bf02b4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:41:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:29 smithi196 ceph-mon[32572]: pgmap v336: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 392 op/s 2024-04-26T11:41:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:29 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:30.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-mon[28069]: pgmap v336: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 392 op/s 2024-04-26T11:41:30.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:30.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa98d200700 time 2024-04-26T11:41:29.839501+0000 2024-04-26T11:41:30.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa998a9b3dd] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa998a9b5a3] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b024f1e822] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b024e8e598] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b024e90c17] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b024d89d0b] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b024d8a2ac] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b024d72fad] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa998d2fe20] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 10: (DispatchQueue::entry()+0x51f) [0x7fa998d2cfdf] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa998dfffc1] 2024-04-26T11:41:30.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa9978191ca] 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 13: clone() 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:29.840+0000 7fa98d200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa98d200700 time 2024-04-26T11:41:29.839501+0000 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa998a9b3dd] 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa998a9b5a3] 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b024f1e822] 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b024e8e598] 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b024e90c17] 2024-04-26T11:41:30.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b024d89d0b] 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b024d8a2ac] 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b024d72fad] 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa998d2fe20] 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 10: (DispatchQueue::entry()+0x51f) [0x7fa998d2cfdf] 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa998dfffc1] 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa9978191ca] 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 13: clone() 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: *** Caught signal (Aborted) ** 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: in thread 7fa98d200700 thread_name:ms_dispatch 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa997823d20] 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2: gsignal() 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 3: abort() 2024-04-26T11:41:30.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa998a9b437] 2024-04-26T11:41:30.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa998a9b5a3] 2024-04-26T11:41:30.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b024f1e822] 2024-04-26T11:41:30.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b024e8e598] 2024-04-26T11:41:30.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b024e90c17] 2024-04-26T11:41:30.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b024d89d0b] 2024-04-26T11:41:30.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b024d8a2ac] 2024-04-26T11:41:30.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b024d72fad] 2024-04-26T11:41:30.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa998d2fe20] 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 13: (DispatchQueue::entry()+0x51f) [0x7fa998d2cfdf] 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa998dfffc1] 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa9978191ca] 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 16: clone() 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:29.841+0000 7fa98d200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: in thread 7fa98d200700 thread_name:ms_dispatch 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa997823d20] 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2: gsignal() 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 3: abort() 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa998a9b437] 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa998a9b5a3] 2024-04-26T11:41:30.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b024f1e822] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b024e8e598] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b024e90c17] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b024d89d0b] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b024d8a2ac] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b024d72fad] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa998d2fe20] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 13: (DispatchQueue::entry()+0x51f) [0x7fa998d2cfdf] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa998dfffc1] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa9978191ca] 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 16: clone() 2024-04-26T11:41:30.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: -1> 2024-04-26T11:41:29.840+0000 7fa98d200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa98d200700 time 2024-04-26T11:41:29.839501+0000 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa998a9b3dd] 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa998a9b5a3] 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b024f1e822] 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b024e8e598] 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b024e90c17] 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b024d89d0b] 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b024d8a2ac] 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b024d72fad] 2024-04-26T11:41:30.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa998d2fe20] 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 10: (DispatchQueue::entry()+0x51f) [0x7fa998d2cfdf] 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa998dfffc1] 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa9978191ca] 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 13: clone() 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 0> 2024-04-26T11:41:29.841+0000 7fa98d200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: in thread 7fa98d200700 thread_name:ms_dispatch 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa997823d20] 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2: gsignal() 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 3: abort() 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa998a9b437] 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa998a9b5a3] 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b024f1e822] 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b024e8e598] 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b024e90c17] 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b024d89d0b] 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b024d8a2ac] 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b024d72fad] 2024-04-26T11:41:30.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa998d2fe20] 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 13: (DispatchQueue::entry()+0x51f) [0x7fa998d2cfdf] 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa998dfffc1] 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa9978191ca] 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 16: clone() 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: -4> 2024-04-26T11:41:29.840+0000 7fa98d200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa98d200700 time 2024-04-26T11:41:29.839501+0000 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa998a9b3dd] 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa998a9b5a3] 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b024f1e822] 2024-04-26T11:41:30.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b024e8e598] 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b024e90c17] 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b024d89d0b] 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b024d8a2ac] 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b024d72fad] 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa998d2fe20] 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 10: (DispatchQueue::entry()+0x51f) [0x7fa998d2cfdf] 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa998dfffc1] 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa9978191ca] 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 13: clone() 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: -3> 2024-04-26T11:41:29.841+0000 7fa98d200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: in thread 7fa98d200700 thread_name:ms_dispatch 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:30.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa997823d20] 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2: gsignal() 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 3: abort() 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa998a9b437] 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa998a9b5a3] 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b024f1e822] 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b024e8e598] 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b024e90c17] 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b024d89d0b] 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b024d8a2ac] 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b024d72fad] 2024-04-26T11:41:30.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa998d2fe20] 2024-04-26T11:41:30.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 13: (DispatchQueue::entry()+0x51f) [0x7fa998d2cfdf] 2024-04-26T11:41:30.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa998dfffc1] 2024-04-26T11:41:30.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa9978191ca] 2024-04-26T11:41:30.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 16: clone() 2024-04-26T11:41:30.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:30.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92167]: 2024-04-26T11:41:30.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:30 smithi110 podman[92286]: 2024-04-26 11:41:30.022066803 +0000 UTC m=+0.057680191 container died 2afb7506f4e836354b096be840b5b4cef03b9396220944a284d4154dd24f3047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T11:41:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:30 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:30.872 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:30 smithi193 podman[68467]: 2024-04-26 11:41:30.621127863 +0000 UTC m=+0.786705132 container remove e6e9c5a607834fb47b1210b95284d7acb3732b52066e3794b742256b0bf02b4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:41:30.872 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:30 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:41:31.121 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:30 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:31.122 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:30 smithi110 podman[92286]: 2024-04-26 11:41:30.836551923 +0000 UTC m=+0.872165293 container remove 2afb7506f4e836354b096be840b5b4cef03b9396220944a284d4154dd24f3047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-04-26T11:41:31.122 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:30 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:41:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:30 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:31.371 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:30 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-04-26T11:41:31.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:30 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Consumed 1.128s CPU time. 2024-04-26T11:41:31.387 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:31 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T11:41:31.387 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:31 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.976s CPU time. 2024-04-26T11:41:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:31 smithi193 ceph-mon[32782]: pgmap v337: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.1 MiB/s wr, 322 op/s 2024-04-26T11:41:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:31 smithi196 ceph-mon[32572]: pgmap v337: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.1 MiB/s wr, 322 op/s 2024-04-26T11:41:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:31 smithi110 ceph-mon[28069]: pgmap v337: 97 pgs: 97 active+clean; 3.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.1 MiB/s wr, 322 op/s 2024-04-26T11:41:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:33 smithi110 ceph-mon[28069]: pgmap v338: 97 pgs: 97 active+clean; 3.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-04-26T11:41:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:33 smithi193 ceph-mon[32782]: pgmap v338: 97 pgs: 97 active+clean; 3.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-04-26T11:41:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:33 smithi196 ceph-mon[32572]: pgmap v338: 97 pgs: 97 active+clean; 3.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 2.7 MiB/s wr, 280 op/s 2024-04-26T11:41:34.925 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 560.0 s, 524.4 tps, lat 47.119 ms stddev 64.374 2024-04-26T11:41:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:35 smithi193 ceph-mon[32782]: pgmap v339: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 4.7 MiB/s wr, 493 op/s 2024-04-26T11:41:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:35 smithi196 ceph-mon[32572]: pgmap v339: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 4.7 MiB/s wr, 493 op/s 2024-04-26T11:41:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:35 smithi110 ceph-mon[28069]: pgmap v339: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 4.7 MiB/s wr, 493 op/s 2024-04-26T11:41:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.925+0000 7f917ce00640 1 -- 172.21.15.110:0/3930192693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 msgr2=0x7f9178101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.925+0000 7f917ce00640 1 --2- 172.21.15.110:0/3930192693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 0x7f9178101aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9160009890 tx=0x7f916002a360 comp rx=0 tx=0).stop 2024-04-26T11:41:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.925+0000 7f917ce00640 1 -- 172.21.15.110:0/3930192693 shutdown_connections 2024-04-26T11:41:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.925+0000 7f917ce00640 1 --2- 172.21.15.110:0/3930192693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9178101fe0 0x7f917810e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.925+0000 7f917ce00640 1 --2- 172.21.15.110:0/3930192693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 0x7f9178101aa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.925+0000 7f917ce00640 1 --2- 172.21.15.110:0/3930192693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9178107630 0x7f9178107a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.925+0000 7f917ce00640 1 -- 172.21.15.110:0/3930192693 >> 172.21.15.110:0/3930192693 conn(0x7f91780fd150 msgr2=0x7f91780ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.925+0000 7f917ce00640 1 -- 172.21.15.110:0/3930192693 shutdown_connections 2024-04-26T11:41:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.925+0000 7f917ce00640 1 -- 172.21.15.110:0/3930192693 wait complete. 2024-04-26T11:41:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.927+0000 7f917ce00640 1 Processor -- start 2024-04-26T11:41:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.927+0000 7f917ce00640 1 -- start start 2024-04-26T11:41:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.927+0000 7f917ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 0x7f9178198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.927+0000 7f917ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9178101fe0 0x7f91781994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.927+0000 7f917ce00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9178107630 0x7f917819d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.927+0000 7f917ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f91781118b0 con 0x7f9178101fe0 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.927+0000 7f917ce00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9178111730 con 0x7f9178107630 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.927+0000 7f917ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9178111a30 con 0x7f9178101620 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 0x7f9178198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9176a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9178101fe0 0x7f91781994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 0x7f9178198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42086/0 (socket says 172.21.15.110:42086) 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177400640 1 -- 172.21.15.110:0/81578045 learned_addr learned my addr 172.21.15.110:0/81578045 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177e00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9178107630 0x7f917819d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177400640 1 -- 172.21.15.110:0/81578045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9178107630 msgr2=0x7f917819d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177400640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9178107630 0x7f917819d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177400640 1 -- 172.21.15.110:0/81578045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9178101fe0 msgr2=0x7f91781994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177400640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9178101fe0 0x7f91781994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177400640 1 -- 172.21.15.110:0/81578045 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917819df70 con 0x7f9178101620 2024-04-26T11:41:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.928+0000 7f9177400640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 0x7f9178198f80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f917000ebc0 tx=0x7f917000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.929+0000 7f916fe00640 1 -- 172.21.15.110:0/81578045 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170010430 con 0x7f9178101620 2024-04-26T11:41:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.929+0000 7f916fe00640 1 -- 172.21.15.110:0/81578045 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9170010a80 con 0x7f9178101620 2024-04-26T11:41:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.929+0000 7f917ce00640 1 -- 172.21.15.110:0/81578045 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917819e260 con 0x7f9178101620 2024-04-26T11:41:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.929+0000 7f916fe00640 1 -- 172.21.15.110:0/81578045 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170018a50 con 0x7f9178101620 2024-04-26T11:41:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.929+0000 7f917ce00640 1 -- 172.21.15.110:0/81578045 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91781a5af0 con 0x7f9178101620 2024-04-26T11:41:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.932+0000 7f916fe00640 1 -- 172.21.15.110:0/81578045 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9170010c30 con 0x7f9178101620 2024-04-26T11:41:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.932+0000 7f918120b740 1 Processor -- start 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.932+0000 7f918120b740 1 -- start start 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.932+0000 7f918120b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.932+0000 7f918120b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b17090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.932+0000 7f918120b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 0x55d190b199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f918120b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d190a6d380 con 0x55d190b175d0 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f918120b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d190a09c30 con 0x55d190b07f00 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f918120b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d190a69340 con 0x55d190b08820 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9176a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 0x55d190b199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9177400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b17090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9177e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9177400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b17090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42100/0 (socket says 172.21.15.110:42100) 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9177400640 1 -- 172.21.15.110:0/2707035209 learned_addr learned my addr 172.21.15.110:0/2707035209 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9176a00640 1 -- 172.21.15.110:0/2707035209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 msgr2=0x55d190b17090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9176a00640 1 --2- 172.21.15.110:0/2707035209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b17090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9176a00640 1 -- 172.21.15.110:0/2707035209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 msgr2=0x55d190b082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9176a00640 1 --2- 172.21.15.110:0/2707035209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9176a00640 1 -- 172.21.15.110:0/2707035209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d190a2b940 con 0x55d190b175d0 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.933+0000 7f9177e00640 1 --2- 172.21.15.110:0/2707035209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.934+0000 7f916fe00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f915c0a3d90 0x7f915c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.934+0000 7f916fe00640 1 -- 172.21.15.110:0/81578045 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 10277+0+0 (secure 0 0 0) 0x7f91700d14f0 con 0x7f9178101620 2024-04-26T11:41:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.934+0000 7f9176a00640 1 --2- 172.21.15.110:0/2707035209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 0x55d190b199c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f91600057c0 tx=0x7f9160005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104954913b78f745 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.934+0000 7f9177e00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f915c0a3d90 0x7f915c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.934+0000 7f916cc00640 1 -- 172.21.15.110:0/2707035209 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160041020 con 0x55d190b175d0 2024-04-26T11:41:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.934+0000 7f916cc00640 1 -- 172.21.15.110:0/2707035209 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9160004040 con 0x55d190b175d0 2024-04-26T11:41:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.934+0000 7f916cc00640 1 -- 172.21.15.110:0/2707035209 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160037040 con 0x55d190b175d0 2024-04-26T11:41:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f918120b740 1 -- 172.21.15.110:0/2707035209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 msgr2=0x55d190b199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f9177e00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f915c0a3d90 0x7f915c0a6250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9168005fd0 tx=0x7f9168009260 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f918120b740 1 --2- 172.21.15.110:0/2707035209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 0x55d190b199c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f91600057c0 tx=0x7f9160005b20 comp rx=0 tx=0).stop 2024-04-26T11:41:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f918120b740 1 -- 172.21.15.110:0/2707035209 shutdown_connections 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f918120b740 1 --2- 172.21.15.110:0/2707035209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 0x55d190b199c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f918120b740 1 --2- 172.21.15.110:0/2707035209 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b17090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f918120b740 1 --2- 172.21.15.110:0/2707035209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f918120b740 1 -- 172.21.15.110:0/2707035209 >> 172.21.15.110:0/2707035209 conn(0x55d190b044f0 msgr2=0x55d190b048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f918120b740 1 -- 172.21.15.110:0/2707035209 shutdown_connections 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.935+0000 7f918120b740 1 -- 172.21.15.110:0/2707035209 wait complete. 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.936+0000 7f918120b740 1 -- start start 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.936+0000 7f918120b740 1 Processor -- start 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.936+0000 7f918120b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 0x55d190b14550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.936+0000 7f918120b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b14a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.936+0000 7f918120b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 0x55d190b14fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.936+0000 7f918120b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d190b1a1a0 con 0x55d190b08820 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.936+0000 7f918120b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d1909f4c60 con 0x55d190b175d0 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.936+0000 7f918120b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55d190b1a320 con 0x55d190b07f00 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.936+0000 7f918120b740 10 client.0 _ll_register_callbacks cb 0x55d190a20e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9176a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b14a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9176a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b14a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40566/0 (socket says 172.21.15.110:40566) 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9176a00640 1 -- 172.21.15.110:0/4247906411 learned_addr learned my addr 172.21.15.110:0/4247906411 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9177400640 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 0x55d190b14550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9177e00640 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 0x55d190b14fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9176a00640 1 -- 172.21.15.110:0/4247906411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 msgr2=0x55d190b14550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9176a00640 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 0x55d190b14550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9176a00640 1 -- 172.21.15.110:0/4247906411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 msgr2=0x55d190b14fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9176a00640 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 0x55d190b14fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9176a00640 1 -- 172.21.15.110:0/4247906411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d190a03510 con 0x55d190b08820 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9176a00640 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b14a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9160035040 tx=0x7f9160030340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4fc0dc0ac21613 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.937+0000 7f9165600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.938+0000 7f9165600640 1 -- 172.21.15.110:0/4247906411 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160041030 con 0x55d190b08820 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.938+0000 7f9165600640 1 -- 172.21.15.110:0/4247906411 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 10277+0+0 (secure 0 0 0) 0x7f9160030b20 con 0x55d190b08820 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.938+0000 7f918120b740 1 -- 172.21.15.110:0/4247906411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9160004040 con 0x55d190b08820 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.938+0000 7f9165600640 1 -- 172.21.15.110:0/4247906411 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7f9160058050 con 0x55d190b08820 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.938+0000 7f918120b740 10 client.15906 fetch_fsmap learned FSMap version 147 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.938+0000 7f918120b740 1 -- 172.21.15.110:0/4247906411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=147,monmap=4+}) -- 0x55d19077f210 con 0x55d190b08820 2024-04-26T11:41:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.938+0000 7f9165600640 1 -- 172.21.15.110:0/4247906411 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9160004040 con 0x55d190b08820 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.939+0000 7f9165600640 1 -- 172.21.15.110:0/4247906411 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 147) ==== 7136+0+0 (secure 0 0 0) 0x7f916003d480 con 0x55d190b08820 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.939+0000 7f918120b740 10 client.15906 fetch_fsmap finished waiting for FSMap version 147 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.939+0000 7f918120b740 10 client.15906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.939+0000 7f918120b740 20 client.15906 populate_metadata read hostname 'smithi110' 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.939+0000 7f918120b740 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d190b27130 0x55d190b29520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.939+0000 7f918120b740 4 client.15906 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.939+0000 7f918120b740 1 -- 172.21.15.110:0/4247906411 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d190a7af90 con 0x55d190b27130 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.939+0000 7f9177400640 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d190b27130 0x55d190b29520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.940+0000 7f9177400640 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d190b27130 0x55d190b29520 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97f8381872772802 server_cookie=1fb4671c7ae9c5e9 in_seq=0 out_seq=0 2024-04-26T11:41:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.940+0000 7f9165600640 10 client.15906 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.940+0000 7f9165600640 1 -- 172.21.15.110:0/4247906411 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d190a7af90 con 0x55d190b27130 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.940+0000 7f9165600640 10 client.15906 handle_command_reply: tid=0 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 client.15906 shutdown 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 -- 172.21.15.110:0/4247906411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 msgr2=0x55d190b14a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b14a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9160035040 tx=0x7f9160030340 comp rx=0 tx=0).stop 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 -- 172.21.15.110:0/4247906411 shutdown_connections 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 0x55d190b14fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b14a90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d190b27130 0x55d190b29520 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 --2- 172.21.15.110:0/4247906411 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 0x55d190b14550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 -- 172.21.15.110:0/4247906411 >> 172.21.15.110:0/4247906411 conn(0x55d190b044f0 msgr2=0x55d190b0a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f9165600640 0 client.15906 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 -- 172.21.15.110:0/4247906411 shutdown_connections 2024-04-26T11:41:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 1 -- 172.21.15.110:0/4247906411 wait complete. 2024-04-26T11:41:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.941+0000 7f918120b740 20 client.15906 trim_cache size 0 max 16384 2024-04-26T11:41:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.957+0000 7f918120b740 1 Processor -- start 2024-04-26T11:41:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.957+0000 7f918120b740 1 -- start start 2024-04-26T11:41:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f918120b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 0x55d190b16c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f918120b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b23060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f918120b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 0x55d190b2ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f918120b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ade40 con 0x55d190b08820 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f918120b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ae540 con 0x55d190b175d0 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f918120b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f91781aec40 con 0x55d190b07f00 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f9176a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b23060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f9176a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b23060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:40574/0 (socket says 172.21.15.110:40574) 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f9176a00640 1 -- 172.21.15.110:0/677704934 learned_addr learned my addr 172.21.15.110:0/677704934 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f9177400640 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 0x55d190b16c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f9177e00640 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 0x55d190b2ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.958+0000 7f9177400640 1 -- 172.21.15.110:0/677704934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 msgr2=0x55d190b2ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.959+0000 7f9177400640 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 0x55d190b2ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.959+0000 7f9177400640 1 -- 172.21.15.110:0/677704934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 msgr2=0x55d190b23060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.959+0000 7f9177400640 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b23060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.959+0000 7f9177400640 1 -- 172.21.15.110:0/677704934 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d190b08650 con 0x55d190b07f00 2024-04-26T11:41:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.959+0000 7f9176a00640 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b23060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:41:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.959+0000 7f9177400640 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 0x55d190b16c80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f917000c7d0 tx=0x7f91700d3940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ba21d8471f9c0fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.959+0000 7f9167e00640 1 -- 172.21.15.110:0/677704934 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917009c890 con 0x55d190b07f00 2024-04-26T11:41:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.959+0000 7f9167e00640 1 -- 172.21.15.110:0/677704934 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f917009d450 con 0x55d190b07f00 2024-04-26T11:41:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.959+0000 7f9167e00640 1 -- 172.21.15.110:0/677704934 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917009c6b0 con 0x55d190b07f00 2024-04-26T11:41:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 -- 172.21.15.110:0/677704934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 msgr2=0x55d190b16c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 0x55d190b16c80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f917000c7d0 tx=0x7f91700d3940 comp rx=0 tx=0).stop 2024-04-26T11:41:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 -- 172.21.15.110:0/677704934 shutdown_connections 2024-04-26T11:41:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b175d0 0x55d190b2ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b08820 0x55d190b23060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 --2- 172.21.15.110:0/677704934 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b07f00 0x55d190b16c80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 -- 172.21.15.110:0/677704934 >> 172.21.15.110:0/677704934 conn(0x55d190b044f0 msgr2=0x55d190b0a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 -- 172.21.15.110:0/677704934 shutdown_connections 2024-04-26T11:41:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 -- 172.21.15.110:0/677704934 wait complete. 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.960+0000 7f918120b740 1 -- start start 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f918120b740 1 Processor -- start 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f918120b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b11360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f918120b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b118a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f918120b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 0x55d190b11de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f918120b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ab120 con 0x55d190b175d0 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f918120b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ac530 con 0x55d190b07f00 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f918120b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ab790 con 0x55d190b08820 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f918120b740 10 client.0 _ll_register_callbacks cb 0x7f91680097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f9177e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 0x55d190b11de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f9177400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b11360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f9177400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b11360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:34732/0 (socket says 172.21.15.110:34732) 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.961+0000 7f9177400640 1 -- 172.21.15.110:0/1019199601 learned_addr learned my addr 172.21.15.110:0/1019199601 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9176a00640 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9177400640 1 -- 172.21.15.110:0/1019199601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 msgr2=0x55d190b118a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9177400640 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b118a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9177400640 1 -- 172.21.15.110:0/1019199601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 msgr2=0x55d190b11de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9177400640 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 0x55d190b11de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9177400640 1 -- 172.21.15.110:0/1019199601 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19084b620 con 0x55d190b07f00 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9176a00640 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:41:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9177400640 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b11360 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f917000cf50 tx=0x7f91700a59c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1710ae51b406b304 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9165600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9165600640 1 -- 172.21.15.110:0/1019199601 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917009c890 con 0x55d190b07f00 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f918120b740 1 -- 172.21.15.110:0/1019199601 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f917009d450 con 0x55d190b07f00 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9165600640 1 -- 172.21.15.110:0/1019199601 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 10277+0+0 (secure 0 0 0) 0x7f91700d11b0 con 0x55d190b07f00 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.962+0000 7f9165600640 1 -- 172.21.15.110:0/1019199601 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=147) ==== 24+0+0 (secure 0 0 0) 0x7f91700a1100 con 0x55d190b07f00 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f918120b740 10 client.26138 fetch_fsmap learned FSMap version 147 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f918120b740 1 -- 172.21.15.110:0/1019199601 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=147,monmap=4+}) -- 0x55d190a27cb0 con 0x55d190b07f00 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f9165600640 1 -- 172.21.15.110:0/1019199601 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f917009d450 con 0x55d190b07f00 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f9165600640 1 -- 172.21.15.110:0/1019199601 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 147) ==== 7136+0+0 (secure 0 0 0) 0x7f91700bd0b0 con 0x55d190b07f00 2024-04-26T11:41:36.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f918120b740 10 client.26138 fetch_fsmap finished waiting for FSMap version 147 2024-04-26T11:41:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f918120b740 10 client.26138 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:41:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f918120b740 20 client.26138 populate_metadata read hostname 'smithi110' 2024-04-26T11:41:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f918120b740 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d190b8dc90 0x55d190b900b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f918120b740 4 client.26138 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:41:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f918120b740 1 -- 172.21.15.110:0/1019199601 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d190a74e00 con 0x55d190b8dc90 2024-04-26T11:41:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.963+0000 7f9176a00640 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d190b8dc90 0x55d190b900b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.964+0000 7f9176a00640 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d190b8dc90 0x55d190b900b0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b25b595a4d3a374 server_cookie=d0c33efe41afd7b2 in_seq=0 out_seq=0 2024-04-26T11:41:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:36.964+0000 7f9165600640 10 client.26138 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:37 smithi193 ceph-mon[32782]: pgmap v340: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 4.2 MiB/s wr, 438 op/s 2024-04-26T11:41:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:37 smithi196 ceph-mon[32572]: pgmap v340: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 4.2 MiB/s wr, 438 op/s 2024-04-26T11:41:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:37 smithi110 ceph-mon[28069]: pgmap v340: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 4.2 MiB/s wr, 438 op/s 2024-04-26T11:41:39.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:41:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:39 smithi193 ceph-mon[32782]: pgmap v341: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 4.6 MiB/s wr, 489 op/s 2024-04-26T11:41:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:39 smithi196 ceph-mon[32572]: pgmap v341: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 4.6 MiB/s wr, 489 op/s 2024-04-26T11:41:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:39 smithi110 ceph-mon[28069]: pgmap v341: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 4.6 MiB/s wr, 489 op/s 2024-04-26T11:41:41.485 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 4. 2024-04-26T11:41:41.485 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 systemd[1]: Stopped Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:41:41.485 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Consumed 1.128s CPU time. 2024-04-26T11:41:41.485 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 systemd[1]: Starting Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:41:41.485 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 podman[68563]: 2024-04-26 11:41:41.255460186 +0000 UTC m=+0.018141866 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:41:41.485 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 podman[68563]: 2024-04-26 11:41:41.372154596 +0000 UTC m=+0.134836276 container create ae1e247e9ae41ac136bbec128d0d01c4f20c1fcffe3592d9d35d2db5568277f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:41:41.566 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:41 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:41:41.566 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:41 smithi110 systemd[1]: Stopped Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:41:41.566 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:41 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.976s CPU time. 2024-04-26T11:41:41.857 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:41 smithi110 systemd[1]: Starting Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:41:41.857 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 podman[68563]: 2024-04-26 11:41:41.608421005 +0000 UTC m=+0.371102685 container init ae1e247e9ae41ac136bbec128d0d01c4f20c1fcffe3592d9d35d2db5568277f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-26T11:41:41.857 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 podman[68563]: 2024-04-26 11:41:41.611015451 +0000 UTC m=+0.373697132 container start ae1e247e9ae41ac136bbec128d0d01c4f20c1fcffe3592d9d35d2db5568277f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-26T11:41:41.858 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mds[68582]: -- 172.21.15.193:0/1115689466 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5613e5f75a40 con 0x5613e5f49000 2024-04-26T11:41:41.858 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: starting mds.e at 2024-04-26T11:41:41.858 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 bash[68563]: ae1e247e9ae41ac136bbec128d0d01c4f20c1fcffe3592d9d35d2db5568277f1 2024-04-26T11:41:41.858 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:41:41 smithi193 systemd[1]: Started Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:41:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mon[32782]: pgmap v342: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.6 MiB/s wr, 288 op/s 2024-04-26T11:41:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mon[32782]: daemon mds.e restarted 2024-04-26T11:41:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:41:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mon[32782]: osdmap e122: 12 total, 12 up, 12 in 2024-04-26T11:41:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:boot 2024-04-26T11:41:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mon[32782]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T11:41:42.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=d=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:41:42.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:41:42.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:41 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:active,2=j=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T11:41:42.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:41 smithi110 ceph-mon[28069]: pgmap v342: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.6 MiB/s wr, 288 op/s 2024-04-26T11:41:42.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:41 smithi110 ceph-mon[28069]: daemon mds.e restarted 2024-04-26T11:41:42.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:41 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:41:42.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:41 smithi110 ceph-mon[28069]: osdmap e122: 12 total, 12 up, 12 in 2024-04-26T11:41:42.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:41 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:boot 2024-04-26T11:41:42.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:41 smithi110 ceph-mon[28069]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T11:41:42.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:41 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=d=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:41:42.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:41:42.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:41 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:active,2=j=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T11:41:42.181 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:41 smithi110 podman[92420]: 2024-04-26 11:41:41.877867131 +0000 UTC m=+0.068546947 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:41:42.181 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:42 smithi110 podman[92420]: 2024-04-26 11:41:42.004777955 +0000 UTC m=+0.195457799 container create b111ce950d91af298974da06b9c66f9239e04dc05a0a1a071efb5c576dc4bdc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-26T11:41:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:41 smithi196 ceph-mon[32572]: pgmap v342: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.6 MiB/s wr, 288 op/s 2024-04-26T11:41:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:41 smithi196 ceph-mon[32572]: daemon mds.e restarted 2024-04-26T11:41:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:41 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:41:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:41 smithi196 ceph-mon[32572]: osdmap e122: 12 total, 12 up, 12 in 2024-04-26T11:41:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:41 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:boot 2024-04-26T11:41:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:41 smithi196 ceph-mon[32572]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T11:41:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:41 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=d=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:41:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:41:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:41 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:active,2=j=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T11:41:42.360 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:42 smithi110 podman[92420]: 2024-04-26 11:41:42.292789931 +0000 UTC m=+0.483469791 container init b111ce950d91af298974da06b9c66f9239e04dc05a0a1a071efb5c576dc4bdc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:41:42.360 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:42 smithi110 podman[92420]: 2024-04-26 11:41:42.303030467 +0000 UTC m=+0.493710327 container start b111ce950d91af298974da06b9c66f9239e04dc05a0a1a071efb5c576dc4bdc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T11:41:42.360 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mds[92438]: -- 172.21.15.110:0/3323780759 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557c35ca9a40 con 0x557c35c7cc00 2024-04-26T11:41:42.360 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: starting mds.d at 2024-04-26T11:41:42.792 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:42 smithi110 bash[92420]: b111ce950d91af298974da06b9c66f9239e04dc05a0a1a071efb5c576dc4bdc2 2024-04-26T11:41:42.792 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:41:42 smithi110 systemd[1]: Started Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:41:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:42 smithi193 ceph-mon[32782]: daemon mds.d restarted 2024-04-26T11:41:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:42 smithi193 ceph-mon[32782]: osdmap e123: 12 total, 12 up, 12 in 2024-04-26T11:41:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:42 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:resolve 2024-04-26T11:41:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:42 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:boot 2024-04-26T11:41:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:42 smithi193 ceph-mon[32782]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T11:41:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:42 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:41:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:41:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:42 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=j=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:41:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:42 smithi196 ceph-mon[32572]: daemon mds.d restarted 2024-04-26T11:41:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:42 smithi196 ceph-mon[32572]: osdmap e123: 12 total, 12 up, 12 in 2024-04-26T11:41:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:42 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:resolve 2024-04-26T11:41:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:42 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:boot 2024-04-26T11:41:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:42 smithi196 ceph-mon[32572]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T11:41:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:42 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:41:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:41:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:42 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=j=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:41:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mon[28069]: daemon mds.d restarted 2024-04-26T11:41:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mon[28069]: osdmap e123: 12 total, 12 up, 12 in 2024-04-26T11:41:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:resolve 2024-04-26T11:41:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:boot 2024-04-26T11:41:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mon[28069]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T11:41:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:41:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:41:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=j=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:41:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:43 smithi196 ceph-mon[32572]: pgmap v344: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 333 op/s 2024-04-26T11:41:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:43 smithi110 ceph-mon[28069]: pgmap v344: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 333 op/s 2024-04-26T11:41:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:43 smithi193 ceph-mon[32782]: pgmap v344: 97 pgs: 97 active+clean; 3.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 333 op/s 2024-04-26T11:41:44.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 570.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:41:45.143 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:44 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:resolve 2024-04-26T11:41:45.143 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:44 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=j=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:45.143 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.143 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.143 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.143 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:44 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:resolve 2024-04-26T11:41:45.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:44 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=j=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:45.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:44 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:resolve 2024-04-26T11:41:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:44 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=j=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.913+0000 7f9165600640 1 -- 172.21.15.110:0/1019199601 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d190a74e00 con 0x55d190b8dc90 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.913+0000 7f9165600640 10 client.26138 handle_command_reply: tid=0 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.913+0000 7f918120b740 1 client.26138 shutdown 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 -- 172.21.15.110:0/1019199601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 msgr2=0x55d190b11360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b11360 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f917000cf50 tx=0x7f91700a59c0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 -- 172.21.15.110:0/1019199601 shutdown_connections 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d190b175d0 0x55d190b11de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55d190b8dc90 0x55d190b900b0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55d190b08820 0x55d190b118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 --2- 172.21.15.110:0/1019199601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d190b07f00 0x55d190b11360 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f9165600640 0 client.26138 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 -- 172.21.15.110:0/1019199601 >> 172.21.15.110:0/1019199601 conn(0x55d190b044f0 msgr2=0x55d190b099c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 -- 172.21.15.110:0/1019199601 shutdown_connections 2024-04-26T11:41:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 1 -- 172.21.15.110:0/1019199601 wait complete. 2024-04-26T11:41:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.914+0000 7f918120b740 20 client.26138 trim_cache size 0 max 16384 2024-04-26T11:41:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:41:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:41:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:41:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.915+0000 7f917ce00640 1 -- 172.21.15.110:0/81578045 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f915c0a3d90 msgr2=0x7f915c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.915+0000 7f917ce00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f915c0a3d90 0x7f915c0a6250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9168005fd0 tx=0x7f9168009260 comp rx=0 tx=0).stop 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.915+0000 7f917ce00640 1 -- 172.21.15.110:0/81578045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 msgr2=0x7f9178198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.915+0000 7f917ce00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 0x7f9178198f80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f917000ebc0 tx=0x7f917000c2d0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.915+0000 7f917ce00640 1 -- 172.21.15.110:0/81578045 shutdown_connections 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.915+0000 7f917ce00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f915c0a3d90 0x7f915c0a6250 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.915+0000 7f917ce00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9178107630 0x7f917819d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.915+0000 7f917ce00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9178101fe0 0x7f91781994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.916+0000 7f917ce00640 1 --2- 172.21.15.110:0/81578045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9178101620 0x7f9178198f80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.916+0000 7f917ce00640 1 -- 172.21.15.110:0/81578045 >> 172.21.15.110:0/81578045 conn(0x7f91780fd150 msgr2=0x7f917806a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.916+0000 7f917ce00640 1 -- 172.21.15.110:0/81578045 shutdown_connections 2024-04-26T11:41:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:45.916+0000 7f917ce00640 1 -- 172.21.15.110:0/81578045 wait complete. 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: pgmap v346: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:reconnect 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:reconnect 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T11:41:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179996 2024-04-26T11:41:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209996 2024-04-26T11:41:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:46.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: pgmap v346: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-04-26T11:41:46.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:41:46.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:reconnect 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:reconnect 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179996 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209996 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:46.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: pgmap v346: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:reconnect 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:reconnect 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T11:41:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T11:41:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179996 2024-04-26T11:41:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209996 2024-04-26T11:41:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:47.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:rejoin 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:rejoin 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:41:47.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:47.218 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:rejoin 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:rejoin 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:41:47.219 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T11:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T11:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:rejoin 2024-04-26T11:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:rejoin 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:41:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:41:47.622 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:41:47.216+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T11:41:47.622 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:41:47.216+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T11:41:48.213 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: pgmap v347: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 511 KiB/s wr, 68 op/s 2024-04-26T11:41:48.213 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T11:41:48.213 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T11:41:48.213 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: pgmap v348: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 661 KiB/s wr, 88 op/s 2024-04-26T11:41:48.213 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T11:41:48.213 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:41:48.213 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: Cluster is now healthy 2024-04-26T11:41:48.213 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:active 2024-04-26T11:41:48.214 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:active 2024-04-26T11:41:48.214 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:48.214 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:47 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: pgmap v347: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 511 KiB/s wr, 68 op/s 2024-04-26T11:41:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T11:41:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T11:41:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: pgmap v348: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 661 KiB/s wr, 88 op/s 2024-04-26T11:41:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T11:41:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:41:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: Cluster is now healthy 2024-04-26T11:41:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:active 2024-04-26T11:41:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:active 2024-04-26T11:41:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:47 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: pgmap v347: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 511 KiB/s wr, 68 op/s 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: pgmap v348: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 661 KiB/s wr, 88 op/s 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: Cluster is now healthy 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/1184229123,v1:172.21.15.196:6835/1184229123] up:active 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1499538548,v1:172.21.15.110:6835/1499538548] up:active 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T11:41:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:47 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:49.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 575.0 s, 1223.8 tps, lat 307.364 ms stddev 2011.622 2024-04-26T11:41:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:49 smithi196 ceph-mon[32572]: pgmap v349: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 226 op/s 2024-04-26T11:41:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:49 smithi110 ceph-mon[28069]: pgmap v349: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 226 op/s 2024-04-26T11:41:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:49 smithi193 ceph-mon[32782]: pgmap v349: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 226 op/s 2024-04-26T11:41:52.190 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:51 smithi110 ceph-mon[28069]: pgmap v350: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 1.5 MiB/s wr, 188 op/s 2024-04-26T11:41:52.190 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:51 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:51 smithi196 ceph-mon[32572]: pgmap v350: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 1.5 MiB/s wr, 188 op/s 2024-04-26T11:41:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:51 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:51 smithi193 ceph-mon[32782]: pgmap v350: 97 pgs: 97 active+clean; 3.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 1.5 MiB/s wr, 188 op/s 2024-04-26T11:41:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:51 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:41:52.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f9eefe00700 time 2024-04-26T11:41:52.188537+0000 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9efb65e3dd] 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f9efb65e5a3] 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556bb7dd7822] 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556bb7d47598] 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556bb7d49c17] 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556bb7c42d0b] 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556bb7c432ac] 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556bb7c2bfad] 2024-04-26T11:41:52.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f9efb8f2e20] 2024-04-26T11:41:52.544 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 10: (DispatchQueue::entry()+0x51f) [0x7f9efb8effdf] 2024-04-26T11:41:52.544 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9efb9c2fc1] 2024-04-26T11:41:52.544 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f9efa3dc1ca] 2024-04-26T11:41:52.544 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 13: clone() 2024-04-26T11:41:52.544 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.190+0000 7f9eefe00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f9eefe00700 time 2024-04-26T11:41:52.188537+0000 2024-04-26T11:41:52.544 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:52.544 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.544 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.544 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9efb65e3dd] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f9efb65e5a3] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556bb7dd7822] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556bb7d47598] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556bb7d49c17] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556bb7c42d0b] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556bb7c432ac] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556bb7c2bfad] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f9efb8f2e20] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 10: (DispatchQueue::entry()+0x51f) [0x7f9efb8effdf] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9efb9c2fc1] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f9efa3dc1ca] 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 13: clone() 2024-04-26T11:41:52.545 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: *** Caught signal (Aborted) ** 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: in thread 7f9eefe00700 thread_name:ms_dispatch 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9efa3e6d20] 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2: gsignal() 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 3: abort() 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9efb65e437] 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f9efb65e5a3] 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556bb7dd7822] 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556bb7d47598] 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556bb7d49c17] 2024-04-26T11:41:52.546 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556bb7c42d0b] 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556bb7c432ac] 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556bb7c2bfad] 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f9efb8f2e20] 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 13: (DispatchQueue::entry()+0x51f) [0x7f9efb8effdf] 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9efb9c2fc1] 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f9efa3dc1ca] 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 16: clone() 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.193+0000 7f9eefe00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: in thread 7f9eefe00700 thread_name:ms_dispatch 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9efa3e6d20] 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2: gsignal() 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 3: abort() 2024-04-26T11:41:52.547 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9efb65e437] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f9efb65e5a3] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556bb7dd7822] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556bb7d47598] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556bb7d49c17] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556bb7c42d0b] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556bb7c432ac] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556bb7c2bfad] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f9efb8f2e20] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 13: (DispatchQueue::entry()+0x51f) [0x7f9efb8effdf] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9efb9c2fc1] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f9efa3dc1ca] 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 16: clone() 2024-04-26T11:41:52.548 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:52.549 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.549 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: -1> 2024-04-26T11:41:52.190+0000 7f9eefe00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f9eefe00700 time 2024-04-26T11:41:52.188537+0000 2024-04-26T11:41:52.549 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:52.549 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.549 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.549 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9efb65e3dd] 2024-04-26T11:41:52.549 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f9efb65e5a3] 2024-04-26T11:41:52.549 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556bb7dd7822] 2024-04-26T11:41:52.549 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556bb7d47598] 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556bb7d49c17] 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556bb7c42d0b] 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556bb7c432ac] 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556bb7c2bfad] 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f9efb8f2e20] 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 10: (DispatchQueue::entry()+0x51f) [0x7f9efb8effdf] 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9efb9c2fc1] 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f9efa3dc1ca] 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 13: clone() 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 0> 2024-04-26T11:41:52.193+0000 7f9eefe00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: in thread 7f9eefe00700 thread_name:ms_dispatch 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.550 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9efa3e6d20] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2: gsignal() 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 3: abort() 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9efb65e437] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f9efb65e5a3] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556bb7dd7822] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556bb7d47598] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556bb7d49c17] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556bb7c42d0b] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556bb7c432ac] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556bb7c2bfad] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f9efb8f2e20] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 13: (DispatchQueue::entry()+0x51f) [0x7f9efb8effdf] 2024-04-26T11:41:52.551 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9efb9c2fc1] 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f9efa3dc1ca] 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 16: clone() 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: -2> 2024-04-26T11:41:52.190+0000 7f9eefe00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f9eefe00700 time 2024-04-26T11:41:52.188537+0000 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f9efb65e3dd] 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f9efb65e5a3] 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556bb7dd7822] 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556bb7d47598] 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556bb7d49c17] 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556bb7c42d0b] 2024-04-26T11:41:52.552 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556bb7c432ac] 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556bb7c2bfad] 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f9efb8f2e20] 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 10: (DispatchQueue::entry()+0x51f) [0x7f9efb8effdf] 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9efb9c2fc1] 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f9efa3dc1ca] 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 13: clone() 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: -1> 2024-04-26T11:41:52.193+0000 7f9eefe00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: in thread 7f9eefe00700 thread_name:ms_dispatch 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f9efa3e6d20] 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2: gsignal() 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 3: abort() 2024-04-26T11:41:52.553 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f9efb65e437] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f9efb65e5a3] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556bb7dd7822] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556bb7d47598] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556bb7d49c17] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x556bb7c42d0b] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x556bb7c432ac] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556bb7c2bfad] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f9efb8f2e20] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 13: (DispatchQueue::entry()+0x51f) [0x7f9efb8effdf] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f9efb9c2fc1] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f9efa3dc1ca] 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 16: clone() 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:52.554 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[65854]: 2024-04-26T11:41:52.555 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:52 smithi110 podman[92934]: 2024-04-26 11:41:52.350807722 +0000 UTC m=+0.053702627 container died 55d77a14f363fcfdf29ddcbc0710ede6e270fd74ac75ac01d2a5d9490d443d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:41:52.654 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc1d3215700 time 2024-04-26T11:41:52.282303+0000 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc1dd83e3dd] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1dd83e5a3] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55913f2f8822] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55913f268598] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55913f26ac17] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55913f163d0b] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55913f1642ac] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55913f14cfad] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1ddad2e20] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 10: (DispatchQueue::entry()+0x51f) [0x7fc1ddacffdf] 2024-04-26T11:41:52.655 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1ddba2fc1] 2024-04-26T11:41:52.656 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc1dc5bc1ca] 2024-04-26T11:41:52.656 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 13: clone() 2024-04-26T11:41:52.656 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.283+0000 7fc1d3215700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc1d3215700 time 2024-04-26T11:41:52.282303+0000 2024-04-26T11:41:52.656 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:52.656 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.657 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.657 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc1dd83e3dd] 2024-04-26T11:41:52.657 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1dd83e5a3] 2024-04-26T11:41:52.657 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55913f2f8822] 2024-04-26T11:41:52.657 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55913f268598] 2024-04-26T11:41:52.657 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55913f26ac17] 2024-04-26T11:41:52.657 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55913f163d0b] 2024-04-26T11:41:52.657 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55913f1642ac] 2024-04-26T11:41:52.657 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55913f14cfad] 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1ddad2e20] 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 10: (DispatchQueue::entry()+0x51f) [0x7fc1ddacffdf] 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1ddba2fc1] 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc1dc5bc1ca] 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 13: clone() 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: *** Caught signal (Aborted) ** 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: in thread 7fc1d3215700 thread_name:ms_dispatch 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc1dc5c6d20] 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2: gsignal() 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 3: abort() 2024-04-26T11:41:52.658 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc1dd83e437] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1dd83e5a3] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55913f2f8822] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55913f268598] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55913f26ac17] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55913f163d0b] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55913f1642ac] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55913f14cfad] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1ddad2e20] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 13: (DispatchQueue::entry()+0x51f) [0x7fc1ddacffdf] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1ddba2fc1] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc1dc5bc1ca] 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 16: clone() 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.284+0000 7fc1d3215700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:52.659 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: in thread 7fc1d3215700 thread_name:ms_dispatch 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc1dc5c6d20] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2: gsignal() 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 3: abort() 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc1dd83e437] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1dd83e5a3] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55913f2f8822] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55913f268598] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55913f26ac17] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55913f163d0b] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55913f1642ac] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55913f14cfad] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1ddad2e20] 2024-04-26T11:41:52.660 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 13: (DispatchQueue::entry()+0x51f) [0x7fc1ddacffdf] 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1ddba2fc1] 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc1dc5bc1ca] 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 16: clone() 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: -1> 2024-04-26T11:41:52.283+0000 7fc1d3215700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc1d3215700 time 2024-04-26T11:41:52.282303+0000 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc1dd83e3dd] 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1dd83e5a3] 2024-04-26T11:41:52.661 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55913f2f8822] 2024-04-26T11:41:52.663 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55913f268598] 2024-04-26T11:41:52.663 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55913f26ac17] 2024-04-26T11:41:52.663 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55913f163d0b] 2024-04-26T11:41:52.663 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55913f1642ac] 2024-04-26T11:41:52.663 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55913f14cfad] 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1ddad2e20] 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 10: (DispatchQueue::entry()+0x51f) [0x7fc1ddacffdf] 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1ddba2fc1] 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc1dc5bc1ca] 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 13: clone() 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 0> 2024-04-26T11:41:52.284+0000 7fc1d3215700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: in thread 7fc1d3215700 thread_name:ms_dispatch 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc1dc5c6d20] 2024-04-26T11:41:52.664 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2: gsignal() 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 3: abort() 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc1dd83e437] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1dd83e5a3] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55913f2f8822] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55913f268598] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55913f26ac17] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55913f163d0b] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55913f1642ac] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55913f14cfad] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1ddad2e20] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 13: (DispatchQueue::entry()+0x51f) [0x7fc1ddacffdf] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1ddba2fc1] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc1dc5bc1ca] 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 16: clone() 2024-04-26T11:41:52.665 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: -1> 2024-04-26T11:41:52.283+0000 7fc1d3215700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc1d3215700 time 2024-04-26T11:41:52.282303+0000 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc1dd83e3dd] 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1dd83e5a3] 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55913f2f8822] 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55913f268598] 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55913f26ac17] 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55913f163d0b] 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55913f1642ac] 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55913f14cfad] 2024-04-26T11:41:52.666 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1ddad2e20] 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 10: (DispatchQueue::entry()+0x51f) [0x7fc1ddacffdf] 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1ddba2fc1] 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc1dc5bc1ca] 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 13: clone() 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 0> 2024-04-26T11:41:52.284+0000 7fc1d3215700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: in thread 7fc1d3215700 thread_name:ms_dispatch 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc1dc5c6d20] 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2: gsignal() 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 3: abort() 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc1dd83e437] 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc1dd83e5a3] 2024-04-26T11:41:52.667 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55913f2f8822] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55913f268598] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55913f26ac17] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55913f163d0b] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55913f1642ac] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55913f14cfad] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc1ddad2e20] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 13: (DispatchQueue::entry()+0x51f) [0x7fc1ddacffdf] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc1ddba2fc1] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc1dc5bc1ca] 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 16: clone() 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[70354]: 2024-04-26T11:41:52.668 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:52 smithi196 podman[70916]: 2024-04-26 11:41:52.345025994 +0000 UTC m=+0.020458711 container died 741a766d8d7f5afb60aefd580f8ea5f6a83ed19d32980228e9e9afb4dad493db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T11:41:53.292 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:53 smithi196 podman[70916]: 2024-04-26 11:41:53.041186443 +0000 UTC m=+0.716619164 container remove 741a766d8d7f5afb60aefd580f8ea5f6a83ed19d32980228e9e9afb4dad493db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS) 2024-04-26T11:41:53.292 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:53 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:41:53.495 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:53 smithi110 podman[92934]: 2024-04-26 11:41:53.04577811 +0000 UTC m=+0.748672999 container remove 55d77a14f363fcfdf29ddcbc0710ede6e270fd74ac75ac01d2a5d9490d443d9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-26T11:41:53.495 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:53 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:41:53.755 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:41:53 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T11:41:53.756 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:53 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T11:41:53.756 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:41:53 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 2.468s CPU time. 2024-04-26T11:41:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:53 smithi196 ceph-mon[32572]: pgmap v351: 97 pgs: 97 active+clean; 3.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 3.0 MiB/s wr, 339 op/s 2024-04-26T11:41:54.267 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:53 smithi110 ceph-mon[28069]: pgmap v351: 97 pgs: 97 active+clean; 3.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 3.0 MiB/s wr, 339 op/s 2024-04-26T11:41:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:53 smithi193 ceph-mon[32782]: pgmap v351: 97 pgs: 97 active+clean; 3.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 3.0 MiB/s wr, 339 op/s 2024-04-26T11:41:54.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 580.0 s, 2196.9 tps, lat 40.830 ms stddev 46.729 2024-04-26T11:41:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:55 smithi196 ceph-mon[32572]: pgmap v352: 97 pgs: 97 active+clean; 3.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 4.2 MiB/s wr, 455 op/s 2024-04-26T11:41:56.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:55 smithi110 ceph-mon[28069]: pgmap v352: 97 pgs: 97 active+clean; 3.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 4.2 MiB/s wr, 455 op/s 2024-04-26T11:41:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:55 smithi193 ceph-mon[32782]: pgmap v352: 97 pgs: 97 active+clean; 3.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 4.2 MiB/s wr, 455 op/s 2024-04-26T11:41:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:57 smithi196 ceph-mon[32572]: pgmap v353: 97 pgs: 97 active+clean; 3.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 4.2 MiB/s wr, 455 op/s 2024-04-26T11:41:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:57 smithi110 ceph-mon[28069]: pgmap v353: 97 pgs: 97 active+clean; 3.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 4.2 MiB/s wr, 455 op/s 2024-04-26T11:41:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:57 smithi193 ceph-mon[32782]: pgmap v353: 97 pgs: 97 active+clean; 3.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 4.2 MiB/s wr, 455 op/s 2024-04-26T11:41:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.065+0000 7f66c4200640 1 -- 172.21.15.110:0/2371912291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc107910 msgr2=0x7f66bc107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.065+0000 7f66c4200640 1 --2- 172.21.15.110:0/2371912291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc107910 0x7f66bc107cf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009930 tx=0x7f66b002a440 comp rx=0 tx=0).stop 2024-04-26T11:41:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.065+0000 7f66c4200640 1 -- 172.21.15.110:0/2371912291 shutdown_connections 2024-04-26T11:41:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.065+0000 7f66c4200640 1 --2- 172.21.15.110:0/2371912291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66bc1017f0 0x7f66bc10f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.065+0000 7f66c4200640 1 --2- 172.21.15.110:0/2371912291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66bc100e30 0x7f66bc1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.065+0000 7f66c4200640 1 --2- 172.21.15.110:0/2371912291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc107910 0x7f66bc107cf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.065+0000 7f66c4200640 1 -- 172.21.15.110:0/2371912291 >> 172.21.15.110:0/2371912291 conn(0x7f66bc077db0 msgr2=0x7f66bc0ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.065+0000 7f66c4200640 1 -- 172.21.15.110:0/2371912291 shutdown_connections 2024-04-26T11:41:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.065+0000 7f66c4200640 1 -- 172.21.15.110:0/2371912291 wait complete. 2024-04-26T11:41:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.066+0000 7f66c4200640 1 Processor -- start 2024-04-26T11:41:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.066+0000 7f66c4200640 1 -- start start 2024-04-26T11:41:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c4200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66bc100e30 0x7f66bc1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c4200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc1017f0 0x7f66bc1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c4200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66bc107910 0x7f66bc19da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c4200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc112c90 con 0x7f66bc1017f0 2024-04-26T11:41:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c4200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc112b10 con 0x7f66bc100e30 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c4200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc112e10 con 0x7f66bc107910 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c0e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc1017f0 0x7f66bc1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c1800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66bc100e30 0x7f66bc1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c0e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc1017f0 0x7f66bc1996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56220/0 (socket says 172.21.15.110:56220) 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c0e00640 1 -- 172.21.15.110:0/2847096201 learned_addr learned my addr 172.21.15.110:0/2847096201 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c2200640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66bc107910 0x7f66bc19da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c0e00640 1 -- 172.21.15.110:0/2847096201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66bc107910 msgr2=0x7f66bc19da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c0e00640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66bc107910 0x7f66bc19da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c0e00640 1 -- 172.21.15.110:0/2847096201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66bc100e30 msgr2=0x7f66bc1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c0e00640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66bc100e30 0x7f66bc1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.067+0000 7f66c0e00640 1 -- 172.21.15.110:0/2847096201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66bc19e1a0 con 0x7f66bc1017f0 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.068+0000 7f66c0e00640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc1017f0 0x7f66bc1996f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f66a800e9f0 tx=0x7f66a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.068+0000 7f66ba000640 1 -- 172.21.15.110:0/2847096201 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a800ccc0 con 0x7f66bc1017f0 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.068+0000 7f66ba000640 1 -- 172.21.15.110:0/2847096201 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a80108e0 con 0x7f66bc1017f0 2024-04-26T11:41:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.068+0000 7f66ba000640 1 -- 172.21.15.110:0/2847096201 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8018880 con 0x7f66bc1017f0 2024-04-26T11:41:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.068+0000 7f66c4200640 1 -- 172.21.15.110:0/2847096201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66bc19e490 con 0x7f66bc1017f0 2024-04-26T11:41:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.068+0000 7f66c4200640 1 -- 172.21.15.110:0/2847096201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66bc1a5d20 con 0x7f66bc1017f0 2024-04-26T11:41:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.071+0000 7f66c7049740 1 Processor -- start 2024-04-26T11:41:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.071+0000 7f66ba000640 1 -- 172.21.15.110:0/2847096201 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f66a8010430 con 0x7f66bc1017f0 2024-04-26T11:41:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.071+0000 7f66c7049740 1 -- start start 2024-04-26T11:41:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.072+0000 7f66c7049740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b6c90 0x558d471b7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.072+0000 7f66c7049740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.072+0000 7f66c7049740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471c63c0 0x558d471c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.072+0000 7f66c7049740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558d4711c380 con 0x558d471b75b0 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.072+0000 7f66c7049740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558d470b8c30 con 0x558d471b6c90 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.072+0000 7f66c7049740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558d47118340 con 0x558d471c63c0 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.072+0000 7f66c1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.072+0000 7f66c1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56234/0 (socket says 172.21.15.110:56234) 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.072+0000 7f66c1800640 1 -- 172.21.15.110:0/2539572263 learned_addr learned my addr 172.21.15.110:0/2539572263 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.073+0000 7f66c1800640 1 -- 172.21.15.110:0/2539572263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471c63c0 msgr2=0x558d471c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.073+0000 7f66c1800640 1 --2- 172.21.15.110:0/2539572263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471c63c0 0x558d471c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.073+0000 7f66c1800640 1 -- 172.21.15.110:0/2539572263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b6c90 msgr2=0x558d471b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.073+0000 7f66c1800640 1 --2- 172.21.15.110:0/2539572263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b6c90 0x558d471b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.073+0000 7f66c1800640 1 -- 172.21.15.110:0/2539572263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d470da940 con 0x558d471b75b0 2024-04-26T11:41:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.073+0000 7f66c1800640 1 --2- 172.21.15.110:0/2539572263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c5e80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f66b002a960 tx=0x7f66b0005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c519d75932c5bd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.073+0000 7f66ba000640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f66a40a3dc0 0x7f66a40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.073+0000 7f66ba000640 1 -- 172.21.15.110:0/2847096201 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 10449+0+0 (secure 0 0 0) 0x7f66a80d13a0 con 0x7f66bc1017f0 2024-04-26T11:41:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.074+0000 7f66c2200640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f66a40a3dc0 0x7f66a40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.074+0000 7f66aea00640 1 -- 172.21.15.110:0/2539572263 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0040070 con 0x558d471b75b0 2024-04-26T11:41:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.074+0000 7f66aea00640 1 -- 172.21.15.110:0/2539572263 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66b0004030 con 0x558d471b75b0 2024-04-26T11:41:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.074+0000 7f66aea00640 1 -- 172.21.15.110:0/2539572263 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0035040 con 0x558d471b75b0 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.074+0000 7f66c7049740 1 -- 172.21.15.110:0/2539572263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 msgr2=0x558d471c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.074+0000 7f66c2200640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f66a40a3dc0 0x7f66a40a6280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f66b4005fd0 tx=0x7f66b4009880 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.074+0000 7f66c7049740 1 --2- 172.21.15.110:0/2539572263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c5e80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f66b002a960 tx=0x7f66b0005be0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.075+0000 7f66c7049740 1 -- 172.21.15.110:0/2539572263 shutdown_connections 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.075+0000 7f66c7049740 1 --2- 172.21.15.110:0/2539572263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471c63c0 0x558d471c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.075+0000 7f66c7049740 1 --2- 172.21.15.110:0/2539572263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c5e80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.075+0000 7f66c7049740 1 --2- 172.21.15.110:0/2539572263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b6c90 0x558d471b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.075+0000 7f66c7049740 1 -- 172.21.15.110:0/2539572263 >> 172.21.15.110:0/2539572263 conn(0x558d471b32e0 msgr2=0x558d471b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.075+0000 7f66c7049740 1 -- 172.21.15.110:0/2539572263 shutdown_connections 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.075+0000 7f66c7049740 1 -- 172.21.15.110:0/2539572263 wait complete. 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.075+0000 7f66c7049740 1 -- start start 2024-04-26T11:41:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.075+0000 7f66c7049740 1 Processor -- start 2024-04-26T11:41:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c7049740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b6c90 0x558d471c3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c7049740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b75b0 0x558d471c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c7049740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c7049740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558d471c8f30 con 0x558d471c63c0 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c7049740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558d470a3c60 con 0x558d471b6c90 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c7049740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558d471c90b0 con 0x558d471b75b0 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c7049740 10 client.0 _ll_register_callbacks cb 0x558d470cfe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c1800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b6c90 0x558d471c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56250/0 (socket says 172.21.15.110:56250) 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c2200640 1 -- 172.21.15.110:0/4148937359 learned_addr learned my addr 172.21.15.110:0/4148937359 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.076+0000 7f66c0e00640 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b75b0 0x558d471c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66c2200640 1 -- 172.21.15.110:0/4148937359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b75b0 msgr2=0x558d471c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66c2200640 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b75b0 0x558d471c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66c2200640 1 -- 172.21.15.110:0/4148937359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b6c90 msgr2=0x558d471c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66c2200640 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b6c90 0x558d471c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66c2200640 1 -- 172.21.15.110:0/4148937359 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d470b2510 con 0x558d471c63c0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66c2200640 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471c3e00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f66b401cbe0 tx=0x7f66b4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31a27b6c7e536de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66a3400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66a3400640 1 -- 172.21.15.110:0/4148937359 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b400fb40 con 0x558d471c63c0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66c7049740 1 -- 172.21.15.110:0/4148937359 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66b0004030 con 0x558d471c63c0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.077+0000 7f66a3400640 1 -- 172.21.15.110:0/4148937359 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 10449+0+0 (secure 0 0 0) 0x7f66b400fce0 con 0x558d471c63c0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66a3400640 1 -- 172.21.15.110:0/4148937359 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7f66b402c9a0 con 0x558d471c63c0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66c7049740 10 client.15930 fetch_fsmap learned FSMap version 157 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66c7049740 1 -- 172.21.15.110:0/4148937359 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=4+}) -- 0x558d46e2e210 con 0x558d471c63c0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66a3400640 1 -- 172.21.15.110:0/4148937359 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66b0004030 con 0x558d471c63c0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66a3400640 1 -- 172.21.15.110:0/4148937359 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 157) ==== 7132+0+0 (secure 0 0 0) 0x7f66b40288b0 con 0x558d471c63c0 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66c7049740 10 client.15930 fetch_fsmap finished waiting for FSMap version 157 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66c7049740 10 client.15930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:41:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66c7049740 20 client.15930 populate_metadata read hostname 'smithi110' 2024-04-26T11:41:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66c7049740 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558d471d61a0 0x558d471d8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66c7049740 4 client.15930 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:41:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.078+0000 7f66c7049740 1 -- 172.21.15.110:0/4148937359 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d47129f90 con 0x558d471d61a0 2024-04-26T11:41:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.079+0000 7f66c1800640 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558d471d61a0 0x558d471d8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.079+0000 7f66c1800640 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558d471d61a0 0x558d471d8590 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4862dd2783c074c4 server_cookie=1d154446ca167102 in_seq=0 out_seq=0 2024-04-26T11:41:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.079+0000 7f66a3400640 10 client.15930 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.080+0000 7f66a3400640 1 -- 172.21.15.110:0/4148937359 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558d47129f90 con 0x558d471d61a0 2024-04-26T11:41:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.080+0000 7f66a3400640 10 client.15930 handle_command_reply: tid=0 2024-04-26T11:41:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.080+0000 7f66c7049740 1 client.15930 shutdown 2024-04-26T11:41:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 -- 172.21.15.110:0/4148937359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 msgr2=0x558d471c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471c3e00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f66b401cbe0 tx=0x7f66b4009500 comp rx=0 tx=0).stop 2024-04-26T11:41:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 -- 172.21.15.110:0/4148937359 shutdown_connections 2024-04-26T11:41:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471c3e00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558d471d61a0 0x558d471d8590 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b75b0 0x558d471c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 --2- 172.21.15.110:0/4148937359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b6c90 0x558d471c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66a3400640 0 client.15930 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 -- 172.21.15.110:0/4148937359 >> 172.21.15.110:0/4148937359 conn(0x558d471b32e0 msgr2=0x558d471b9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 -- 172.21.15.110:0/4148937359 shutdown_connections 2024-04-26T11:41:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 1 -- 172.21.15.110:0/4148937359 wait complete. 2024-04-26T11:41:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.081+0000 7f66c7049740 20 client.15930 trim_cache size 0 max 16384 2024-04-26T11:41:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.098+0000 7f66c7049740 1 Processor -- start 2024-04-26T11:41:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.098+0000 7f66c7049740 1 -- start start 2024-04-26T11:41:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.098+0000 7f66c7049740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.098+0000 7f66c7049740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b75b0 0x558d471dde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.098+0000 7f66c7049740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471de370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.098+0000 7f66c7049740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc1ae130 con 0x558d471c63c0 2024-04-26T11:41:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.098+0000 7f66c7049740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc1ae800 con 0x558d471b75b0 2024-04-26T11:41:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.098+0000 7f66c7049740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc1aeed0 con 0x558d471b6c90 2024-04-26T11:41:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c1800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c1800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471d1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:35228/0 (socket says 172.21.15.110:35228) 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c1800640 1 -- 172.21.15.110:0/915462751 learned_addr learned my addr 172.21.15.110:0/915462751 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471de370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56264/0 (socket says 172.21.15.110:56264) 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c0e00640 1 --2- 172.21.15.110:0/915462751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b75b0 0x558d471dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c1800640 1 -- 172.21.15.110:0/915462751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b75b0 msgr2=0x558d471dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c1800640 1 --2- 172.21.15.110:0/915462751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b75b0 0x558d471dde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c1800640 1 -- 172.21.15.110:0/915462751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 msgr2=0x558d471de370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c1800640 1 --2- 172.21.15.110:0/915462751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471de370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c1800640 1 -- 172.21.15.110:0/915462751 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d471be190 con 0x558d471b6c90 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c2200640 1 --2- 172.21.15.110:0/915462751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471de370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:41:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.099+0000 7f66c1800640 1 --2- 172.21.15.110:0/915462751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471d1e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009930 tx=0x7f66b002a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c664a022d70b4d76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.100+0000 7f66ae000640 1 -- 172.21.15.110:0/915462751 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0040030 con 0x558d471b6c90 2024-04-26T11:41:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.100+0000 7f66ae000640 1 -- 172.21.15.110:0/915462751 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66b0005130 con 0x558d471b6c90 2024-04-26T11:41:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.100+0000 7f66ae000640 1 -- 172.21.15.110:0/915462751 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0035040 con 0x558d471b6c90 2024-04-26T11:41:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.100+0000 7f66c7049740 1 -- 172.21.15.110:0/915462751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 msgr2=0x558d471d1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:41:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.100+0000 7f66c7049740 1 --2- 172.21.15.110:0/915462751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471d1e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009930 tx=0x7f66b002a440 comp rx=0 tx=0).stop 2024-04-26T11:41:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.100+0000 7f66c7049740 1 -- 172.21.15.110:0/915462751 shutdown_connections 2024-04-26T11:41:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.100+0000 7f66c7049740 1 --2- 172.21.15.110:0/915462751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471c63c0 0x558d471de370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.100+0000 7f66c7049740 1 --2- 172.21.15.110:0/915462751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471b75b0 0x558d471dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.100+0000 7f66c7049740 1 --2- 172.21.15.110:0/915462751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471d1e60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.101+0000 7f66c7049740 1 -- 172.21.15.110:0/915462751 >> 172.21.15.110:0/915462751 conn(0x558d471b32e0 msgr2=0x558d471b9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.101+0000 7f66c7049740 1 -- 172.21.15.110:0/915462751 shutdown_connections 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.101+0000 7f66c7049740 1 -- 172.21.15.110:0/915462751 wait complete. 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.101+0000 7f66c7049740 1 -- start start 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.101+0000 7f66c7049740 1 Processor -- start 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c7049740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c7049740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c7049740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471c63c0 0x558d471c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c7049740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc1ab410 con 0x558d471b75b0 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c7049740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc1ac820 con 0x558d471c63c0 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c7049740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc1aba80 con 0x558d471b6c90 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c7049740 10 client.0 _ll_register_callbacks cb 0x7f66b4009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:41:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c0e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c0e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56278/0 (socket says 172.21.15.110:56278) 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c0e00640 1 -- 172.21.15.110:0/3565017226 learned_addr learned my addr 172.21.15.110:0/3565017226 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c2200640 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471c63c0 0x558d471c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.102+0000 7f66c1800640 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66c0e00640 1 -- 172.21.15.110:0/3565017226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 msgr2=0x558d471bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66c0e00640 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471bffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66c0e00640 1 -- 172.21.15.110:0/3565017226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471c63c0 msgr2=0x558d471c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66c0e00640 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471c63c0 0x558d471c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66c0e00640 1 -- 172.21.15.110:0/3565017226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d46efa620 con 0x558d471b75b0 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66c2200640 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471c63c0 0x558d471c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66c0e00640 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c0510 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f66a8098f60 tx=0x7f66a8009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21878b8c0d97a029 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66a3400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66a3400640 1 -- 172.21.15.110:0/3565017226 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a809cb50 con 0x558d471b75b0 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66a3400640 1 -- 172.21.15.110:0/3565017226 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 10449+0+0 (secure 0 0 0) 0x7f66a8010a90 con 0x558d471b75b0 2024-04-26T11:41:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.103+0000 7f66c7049740 1 -- 172.21.15.110:0/3565017226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66b0005130 con 0x558d471b75b0 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66a3400640 1 -- 172.21.15.110:0/3565017226 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7f66a80a0f00 con 0x558d471b75b0 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66c7049740 10 client.15936 fetch_fsmap learned FSMap version 157 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66c7049740 1 -- 172.21.15.110:0/3565017226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=4+}) -- 0x558d470d6cb0 con 0x558d471b75b0 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66a3400640 1 -- 172.21.15.110:0/3565017226 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66b0005130 con 0x558d471b75b0 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66a3400640 1 -- 172.21.15.110:0/3565017226 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 157) ==== 7132+0+0 (secure 0 0 0) 0x7f66a80988a0 con 0x558d471b75b0 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66c7049740 10 client.15936 fetch_fsmap finished waiting for FSMap version 157 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66c7049740 10 client.15936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66c7049740 20 client.15936 populate_metadata read hostname 'smithi110' 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66c7049740 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558d4723ccd0 0x558d4723f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66c7049740 4 client.15936 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:41:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66c7049740 1 -- 172.21.15.110:0/3565017226 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d47123e00 con 0x558d4723ccd0 2024-04-26T11:41:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.104+0000 7f66c1800640 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558d4723ccd0 0x558d4723f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:41:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.105+0000 7f66c1800640 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558d4723ccd0 0x558d4723f0f0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=707c65ccac0ece3d server_cookie=25fd197d7f35410b in_seq=0 out_seq=0 2024-04-26T11:41:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:41:59.105+0000 7f66a3400640 10 client.15936 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:41:59.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:42:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:41:59 smithi196 ceph-mon[32572]: pgmap v354: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-04-26T11:42:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:41:59 smithi110 ceph-mon[28069]: pgmap v354: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-04-26T11:42:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:41:59 smithi193 ceph-mon[32782]: pgmap v354: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-04-26T11:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:01 smithi196 ceph-mon[32572]: pgmap v355: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 459 op/s 2024-04-26T11:42:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:01 smithi110 ceph-mon[28069]: pgmap v355: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 459 op/s 2024-04-26T11:42:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:01 smithi193 ceph-mon[32782]: pgmap v355: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.4 MiB/s wr, 459 op/s 2024-04-26T11:42:03.758 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:03 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 5. 2024-04-26T11:42:03.759 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:03 smithi196 systemd[1]: Stopped Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:03.759 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:03 smithi196 systemd[1]: Starting Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:42:03.759 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:03 smithi196 podman[71011]: 2024-04-26 11:42:03.642949055 +0000 UTC m=+0.018577351 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:42:03.759 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:03 smithi196 podman[71011]: 2024-04-26 11:42:03.758566981 +0000 UTC m=+0.134195307 container create 2f4cf1a385d00edd0500737ee8a62f5dd3ddb82705a36a452f76765811950dbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424) 2024-04-26T11:42:04.028 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:03 smithi196 ceph-mon[32572]: pgmap v356: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.5 MiB/s wr, 466 op/s 2024-04-26T11:42:04.028 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:04 smithi196 podman[71011]: 2024-04-26 11:42:04.003176174 +0000 UTC m=+0.378804457 container init 2f4cf1a385d00edd0500737ee8a62f5dd3ddb82705a36a452f76765811950dbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T11:42:04.028 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:04 smithi196 podman[71011]: 2024-04-26 11:42:04.00600721 +0000 UTC m=+0.381635496 container start 2f4cf1a385d00edd0500737ee8a62f5dd3ddb82705a36a452f76765811950dbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:42:04.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:03 smithi110 ceph-mon[28069]: pgmap v356: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.5 MiB/s wr, 466 op/s 2024-04-26T11:42:04.193 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:03 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:42:04.193 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:03 smithi110 systemd[1]: Stopped Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:04.193 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:03 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 2.468s CPU time. 2024-04-26T11:42:04.193 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:03 smithi110 systemd[1]: Starting Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:42:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:03 smithi193 ceph-mon[32782]: pgmap v356: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.5 MiB/s wr, 466 op/s 2024-04-26T11:42:04.505 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mds[71030]: -- 172.21.15.196:0/869312834 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d9d0bafa40 con 0x55d9d0b82c00 2024-04-26T11:42:04.505 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: starting mds.c at 2024-04-26T11:42:04.505 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:04 smithi196 bash[71011]: 2f4cf1a385d00edd0500737ee8a62f5dd3ddb82705a36a452f76765811950dbe 2024-04-26T11:42:04.505 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:04 smithi196 systemd[1]: Started Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:04.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:04 smithi110 podman[93066]: 2024-04-26 11:42:04.097525139 +0000 UTC m=+0.036044077 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:42:04.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:04 smithi110 podman[93066]: 2024-04-26 11:42:04.281076346 +0000 UTC m=+0.219595321 container create 6aebaa86b8cc8a67e11843e11e09420eb793c4e9f69fb1c2e496dbbeecee906d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:42:04.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:42:04.970 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:04 smithi110 podman[93066]: 2024-04-26 11:42:04.560916692 +0000 UTC m=+0.499435707 container init 6aebaa86b8cc8a67e11843e11e09420eb793c4e9f69fb1c2e496dbbeecee906d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:42:04.970 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:04 smithi110 podman[93066]: 2024-04-26 11:42:04.571062849 +0000 UTC m=+0.509581854 container start 6aebaa86b8cc8a67e11843e11e09420eb793c4e9f69fb1c2e496dbbeecee906d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T11:42:04.970 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mds[93084]: -- 172.21.15.110:0/3215404314 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56078b229a40 con 0x56078b1fd000 2024-04-26T11:42:04.970 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: starting mds.j at 2024-04-26T11:42:04.970 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:04 smithi110 bash[93066]: 6aebaa86b8cc8a67e11843e11e09420eb793c4e9f69fb1c2e496dbbeecee906d 2024-04-26T11:42:04.970 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:04 smithi110 systemd[1]: Started Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: daemon mds.c restarted 2024-04-26T11:42:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:42:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: osdmap e124: 12 total, 12 up, 12 in 2024-04-26T11:42:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:boot 2024-04-26T11:42:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:replay,2=j=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: daemon mds.j restarted 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: osdmap e125: 12 total, 12 up, 12 in 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:resolve 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:boot 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=e=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:42:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:04 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:resolve,2=l=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: daemon mds.c restarted 2024-04-26T11:42:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: osdmap e124: 12 total, 12 up, 12 in 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:boot 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:replay,2=j=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: daemon mds.j restarted 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: osdmap e125: 12 total, 12 up, 12 in 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:resolve 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:boot 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=e=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:42:05.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:04 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:resolve,2=l=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: daemon mds.c restarted 2024-04-26T11:42:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:42:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: osdmap e124: 12 total, 12 up, 12 in 2024-04-26T11:42:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:boot 2024-04-26T11:42:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: Standby daemon mds.e assigned to filesystem cephfs as rank 1 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:replay,2=j=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: daemon mds.j restarted 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: osdmap e125: 12 total, 12 up, 12 in 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:resolve 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:boot 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=e=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:42:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:04 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:resolve,2=l=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:05 smithi196 ceph-mon[32572]: pgmap v358: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.0 MiB/s wr, 198 op/s 2024-04-26T11:42:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:05 smithi110 ceph-mon[28069]: pgmap v358: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.0 MiB/s wr, 198 op/s 2024-04-26T11:42:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:05 smithi193 ceph-mon[32782]: pgmap v358: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.0 MiB/s wr, 198 op/s 2024-04-26T11:42:07.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:07 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:resolve 2024-04-26T11:42:07.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:07 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:07.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:07 smithi110 ceph-mon[28069]: pgmap v360: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-04-26T11:42:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:07 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:resolve 2024-04-26T11:42:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:07 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:07 smithi193 ceph-mon[32782]: pgmap v360: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-04-26T11:42:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:07 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:resolve 2024-04-26T11:42:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:07 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:07 smithi196 ceph-mon[32572]: pgmap v360: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 341 KiB/s wr, 11 op/s 2024-04-26T11:42:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.087+0000 7f66a3400640 1 -- 172.21.15.110:0/3565017226 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d47123e00 con 0x558d4723ccd0 2024-04-26T11:42:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.087+0000 7f66a3400640 10 client.15936 handle_command_reply: tid=0 2024-04-26T11:42:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.087+0000 7f66c7049740 1 client.15936 shutdown 2024-04-26T11:42:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.088+0000 7f66c7049740 1 -- 172.21.15.110:0/3565017226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 msgr2=0x558d471c0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.088+0000 7f66c7049740 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c0510 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f66a8098f60 tx=0x7f66a8009770 comp rx=0 tx=0).stop 2024-04-26T11:42:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.088+0000 7f66c7049740 1 -- 172.21.15.110:0/3565017226 shutdown_connections 2024-04-26T11:42:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.088+0000 7f66c7049740 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558d471c63c0 0x558d471c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.088+0000 7f66c7049740 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558d471b75b0 0x558d471c0510 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.088+0000 7f66c7049740 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558d4723ccd0 0x558d4723f0f0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.088+0000 7f66c7049740 1 --2- 172.21.15.110:0/3565017226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558d471b6c90 0x558d471bffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.088+0000 7f66a3400640 0 client.15936 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:42:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.088+0000 7f66c7049740 1 -- 172.21.15.110:0/3565017226 >> 172.21.15.110:0/3565017226 conn(0x558d471b32e0 msgr2=0x558d471b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.089+0000 7f66c7049740 1 -- 172.21.15.110:0/3565017226 shutdown_connections 2024-04-26T11:42:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.089+0000 7f66c7049740 1 -- 172.21.15.110:0/3565017226 wait complete. 2024-04-26T11:42:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.089+0000 7f66c7049740 20 client.15936 trim_cache size 0 max 16384 2024-04-26T11:42:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:42:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:42:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:42:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:42:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.090+0000 7f66c4200640 1 -- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f66a40a3dc0 msgr2=0x7f66a40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.090+0000 7f66c4200640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f66a40a3dc0 0x7f66a40a6280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f66b4005fd0 tx=0x7f66b4009880 comp rx=0 tx=0).stop 2024-04-26T11:42:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.090+0000 7f66c4200640 1 -- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc1017f0 msgr2=0x7f66bc1996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.090+0000 7f66c4200640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc1017f0 0x7f66bc1996f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f66a800e9f0 tx=0x7f66a800edf0 comp rx=0 tx=0).stop 2024-04-26T11:42:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.091+0000 7f66c4200640 1 -- 172.21.15.110:0/2847096201 shutdown_connections 2024-04-26T11:42:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.091+0000 7f66c4200640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f66a40a3dc0 0x7f66a40a6280 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.091+0000 7f66c4200640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66bc107910 0x7f66bc19da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.091+0000 7f66c4200640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66bc1017f0 0x7f66bc1996f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.091+0000 7f66c4200640 1 --2- 172.21.15.110:0/2847096201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66bc100e30 0x7f66bc1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.091+0000 7f66c4200640 1 -- 172.21.15.110:0/2847096201 >> 172.21.15.110:0/2847096201 conn(0x7f66bc077db0 msgr2=0x7f66bc105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.091+0000 7f66c4200640 1 -- 172.21.15.110:0/2847096201 shutdown_connections 2024-04-26T11:42:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:08.091+0000 7f66c4200640 1 -- 172.21.15.110:0/2847096201 wait complete. 2024-04-26T11:42:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:08 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999984 2024-04-26T11:42:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:08 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:reconnect 2024-04-26T11:42:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:08 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:reconnect 2024-04-26T11:42:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:08 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:08 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:42:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:08 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:42:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:08 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999984 2024-04-26T11:42:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:08 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:reconnect 2024-04-26T11:42:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:08 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:reconnect 2024-04-26T11:42:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:08 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:08 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:42:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:08 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:42:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:08 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999984 2024-04-26T11:42:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:08 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:reconnect 2024-04-26T11:42:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:08 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:reconnect 2024-04-26T11:42:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:08 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:08 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:42:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:08 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:rejoin 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:rejoin 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: pgmap v361: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 341 KiB/s wr, 16 op/s 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:active 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:active 2024-04-26T11:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:09 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:rejoin 2024-04-26T11:42:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:rejoin 2024-04-26T11:42:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T11:42:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-04-26T11:42:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: pgmap v361: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 341 KiB/s wr, 16 op/s 2024-04-26T11:42:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:42:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:active 2024-04-26T11:42:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:active 2024-04-26T11:42:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:09 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:rejoin 2024-04-26T11:42:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:rejoin 2024-04-26T11:42:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=e=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T11:42:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: daemon mds.e is now active in filesystem cephfs as rank 1 2024-04-26T11:42:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: pgmap v361: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 341 KiB/s wr, 16 op/s 2024-04-26T11:42:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:42:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/3280524135,v1:172.21.15.196:6833/3280524135] up:active 2024-04-26T11:42:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/1821195118,v1:172.21.15.193:6835/1821195118] up:active 2024-04-26T11:42:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:09 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:09.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 595.0 s, 172.6 tps, lat 1795.836 ms stddev 4579.861 2024-04-26T11:42:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:11 smithi196 ceph-mon[32572]: pgmap v362: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 KiB/s wr, 5 op/s 2024-04-26T11:42:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:11 smithi110 ceph-mon[28069]: pgmap v362: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 KiB/s wr, 5 op/s 2024-04-26T11:42:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:11 smithi193 ceph-mon[32782]: pgmap v362: 97 pgs: 97 active+clean; 3.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 KiB/s wr, 5 op/s 2024-04-26T11:42:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-mon[32572]: pgmap v363: 97 pgs: 97 active+clean; 3.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 9.2 MiB/s wr, 779 op/s 2024-04-26T11:42:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:14.011 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff7f524b700 time 2024-04-26T11:42:13.716125+0000 2024-04-26T11:42:14.011 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:14.011 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.011 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff7ff8743dd] 2024-04-26T11:42:14.011 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7ff8745a3] 2024-04-26T11:42:14.011 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564762a63822] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5647629d3598] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5647629d5c17] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5647628ced0b] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5647628cf2ac] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5647628b7fad] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7ffb08e20] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 10: (DispatchQueue::entry()+0x51f) [0x7ff7ffb05fdf] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7ffbd8fc1] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff7fe5f21ca] 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 13: clone() 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:13.716+0000 7ff7f524b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff7f524b700 time 2024-04-26T11:42:13.716125+0000 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.012 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.013 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff7ff8743dd] 2024-04-26T11:42:14.013 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7ff8745a3] 2024-04-26T11:42:14.013 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564762a63822] 2024-04-26T11:42:14.013 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5647629d3598] 2024-04-26T11:42:14.013 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5647629d5c17] 2024-04-26T11:42:14.013 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5647628ced0b] 2024-04-26T11:42:14.013 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5647628cf2ac] 2024-04-26T11:42:14.013 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5647628b7fad] 2024-04-26T11:42:14.014 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7ffb08e20] 2024-04-26T11:42:14.014 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 10: (DispatchQueue::entry()+0x51f) [0x7ff7ffb05fdf] 2024-04-26T11:42:14.014 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7ffbd8fc1] 2024-04-26T11:42:14.014 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff7fe5f21ca] 2024-04-26T11:42:14.014 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 13: clone() 2024-04-26T11:42:14.014 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.014 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: *** Caught signal (Aborted) ** 2024-04-26T11:42:14.014 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: in thread 7ff7f524b700 thread_name:ms_dispatch 2024-04-26T11:42:14.014 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff7fe5fcd20] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2: gsignal() 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 3: abort() 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff7ff874437] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7ff8745a3] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564762a63822] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5647629d3598] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5647629d5c17] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5647628ced0b] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5647628cf2ac] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5647628b7fad] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7ffb08e20] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 13: (DispatchQueue::entry()+0x51f) [0x7ff7ffb05fdf] 2024-04-26T11:42:14.015 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7ffbd8fc1] 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff7fe5f21ca] 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 16: clone() 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:13.717+0000 7ff7f524b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: in thread 7ff7f524b700 thread_name:ms_dispatch 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff7fe5fcd20] 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2: gsignal() 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 3: abort() 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff7ff874437] 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7ff8745a3] 2024-04-26T11:42:14.016 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564762a63822] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5647629d3598] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5647629d5c17] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5647628ced0b] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5647628cf2ac] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5647628b7fad] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7ffb08e20] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 13: (DispatchQueue::entry()+0x51f) [0x7ff7ffb05fdf] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7ffbd8fc1] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff7fe5f21ca] 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 16: clone() 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.017 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: -1> 2024-04-26T11:42:13.716+0000 7ff7f524b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff7f524b700 time 2024-04-26T11:42:13.716125+0000 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff7ff8743dd] 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7ff8745a3] 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564762a63822] 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5647629d3598] 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5647629d5c17] 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5647628ced0b] 2024-04-26T11:42:14.018 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5647628cf2ac] 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5647628b7fad] 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7ffb08e20] 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 10: (DispatchQueue::entry()+0x51f) [0x7ff7ffb05fdf] 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7ffbd8fc1] 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff7fe5f21ca] 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 13: clone() 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 0> 2024-04-26T11:42:13.717+0000 7ff7f524b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: in thread 7ff7f524b700 thread_name:ms_dispatch 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff7fe5fcd20] 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2: gsignal() 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 3: abort() 2024-04-26T11:42:14.019 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff7ff874437] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7ff8745a3] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564762a63822] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5647629d3598] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5647629d5c17] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5647628ced0b] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5647628cf2ac] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5647628b7fad] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7ffb08e20] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 13: (DispatchQueue::entry()+0x51f) [0x7ff7ffb05fdf] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7ffbd8fc1] 2024-04-26T11:42:14.020 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff7fe5f21ca] 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 16: clone() 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: -1> 2024-04-26T11:42:13.716+0000 7ff7f524b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff7f524b700 time 2024-04-26T11:42:13.716125+0000 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff7ff8743dd] 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7ff8745a3] 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564762a63822] 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5647629d3598] 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5647629d5c17] 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5647628ced0b] 2024-04-26T11:42:14.021 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5647628cf2ac] 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5647628b7fad] 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7ffb08e20] 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 10: (DispatchQueue::entry()+0x51f) [0x7ff7ffb05fdf] 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7ffbd8fc1] 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff7fe5f21ca] 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 13: clone() 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 0> 2024-04-26T11:42:13.717+0000 7ff7f524b700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: in thread 7ff7f524b700 thread_name:ms_dispatch 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.022 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff7fe5fcd20] 2024-04-26T11:42:14.023 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2: gsignal() 2024-04-26T11:42:14.023 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 3: abort() 2024-04-26T11:42:14.023 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff7ff874437] 2024-04-26T11:42:14.023 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff7ff8745a3] 2024-04-26T11:42:14.023 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564762a63822] 2024-04-26T11:42:14.023 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5647629d3598] 2024-04-26T11:42:14.023 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5647629d5c17] 2024-04-26T11:42:14.023 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5647628ced0b] 2024-04-26T11:42:14.024 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5647628cf2ac] 2024-04-26T11:42:14.024 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5647628b7fad] 2024-04-26T11:42:14.024 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff7ffb08e20] 2024-04-26T11:42:14.024 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 13: (DispatchQueue::entry()+0x51f) [0x7ff7ffb05fdf] 2024-04-26T11:42:14.024 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff7ffbd8fc1] 2024-04-26T11:42:14.024 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff7fe5f21ca] 2024-04-26T11:42:14.024 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 16: clone() 2024-04-26T11:42:14.024 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:14.025 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[62436]: 2024-04-26T11:42:14.025 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:13 smithi196 podman[71067]: 2024-04-26 11:42:13.807717362 +0000 UTC m=+0.044995789 container died 22b6143e99ba6b37c310f1a8e3c70dab1fe8fcf669788592fe131ed871943f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T11:42:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:13 smithi110 ceph-mon[28069]: pgmap v363: 97 pgs: 97 active+clean; 3.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 9.2 MiB/s wr, 779 op/s 2024-04-26T11:42:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:13 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-mon[32782]: pgmap v363: 97 pgs: 97 active+clean; 3.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 9.2 MiB/s wr, 779 op/s 2024-04-26T11:42:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=e=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:14.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f086934e700 time 2024-04-26T11:42:13.751877+0000 2024-04-26T11:42:14.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:14.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f08739773dd] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f08739775a3] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613e33c4822] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5613e3334598] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5613e3336c17] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5613e322fd0b] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5613e32302ac] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613e3218fad] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0873c0be20] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 10: (DispatchQueue::entry()+0x51f) [0x7f0873c08fdf] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0873cdbfc1] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f08726f51ca] 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 13: clone() 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:13.752+0000 7f086934e700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f086934e700 time 2024-04-26T11:42:13.751877+0000 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:14.123 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f08739773dd] 2024-04-26T11:42:14.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f08739775a3] 2024-04-26T11:42:14.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613e33c4822] 2024-04-26T11:42:14.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5613e3334598] 2024-04-26T11:42:14.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5613e3336c17] 2024-04-26T11:42:14.124 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5613e322fd0b] 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5613e32302ac] 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613e3218fad] 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0873c0be20] 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 10: (DispatchQueue::entry()+0x51f) [0x7f0873c08fdf] 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0873cdbfc1] 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f08726f51ca] 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 13: clone() 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: *** Caught signal (Aborted) ** 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: in thread 7f086934e700 thread_name:ms_dispatch 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f08726ffd20] 2024-04-26T11:42:14.125 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2: gsignal() 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 3: abort() 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0873977437] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f08739775a3] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613e33c4822] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5613e3334598] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5613e3336c17] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5613e322fd0b] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5613e32302ac] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613e3218fad] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0873c0be20] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 13: (DispatchQueue::entry()+0x51f) [0x7f0873c08fdf] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0873cdbfc1] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f08726f51ca] 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 16: clone() 2024-04-26T11:42:14.126 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:13.754+0000 7f086934e700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: in thread 7f086934e700 thread_name:ms_dispatch 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f08726ffd20] 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2: gsignal() 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 3: abort() 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0873977437] 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f08739775a3] 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613e33c4822] 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5613e3334598] 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5613e3336c17] 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5613e322fd0b] 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5613e32302ac] 2024-04-26T11:42:14.127 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613e3218fad] 2024-04-26T11:42:14.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0873c0be20] 2024-04-26T11:42:14.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 13: (DispatchQueue::entry()+0x51f) [0x7f0873c08fdf] 2024-04-26T11:42:14.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0873cdbfc1] 2024-04-26T11:42:14.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f08726f51ca] 2024-04-26T11:42:14.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 16: clone() 2024-04-26T11:42:14.128 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: -1> 2024-04-26T11:42:13.752+0000 7f086934e700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f086934e700 time 2024-04-26T11:42:13.751877+0000 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f08739773dd] 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f08739775a3] 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613e33c4822] 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5613e3334598] 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5613e3336c17] 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5613e322fd0b] 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5613e32302ac] 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613e3218fad] 2024-04-26T11:42:14.129 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0873c0be20] 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 10: (DispatchQueue::entry()+0x51f) [0x7f0873c08fdf] 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0873cdbfc1] 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f08726f51ca] 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 13: clone() 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 0> 2024-04-26T11:42:13.754+0000 7f086934e700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: in thread 7f086934e700 thread_name:ms_dispatch 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f08726ffd20] 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2: gsignal() 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 3: abort() 2024-04-26T11:42:14.130 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0873977437] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f08739775a3] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613e33c4822] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5613e3334598] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5613e3336c17] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5613e322fd0b] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5613e32302ac] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613e3218fad] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0873c0be20] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 13: (DispatchQueue::entry()+0x51f) [0x7f0873c08fdf] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0873cdbfc1] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f08726f51ca] 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 16: clone() 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:14.131 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: -5> 2024-04-26T11:42:13.752+0000 7f086934e700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f086934e700 time 2024-04-26T11:42:13.751877+0000 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f08739773dd] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f08739775a3] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613e33c4822] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5613e3334598] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5613e3336c17] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5613e322fd0b] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5613e32302ac] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613e3218fad] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0873c0be20] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 10: (DispatchQueue::entry()+0x51f) [0x7f0873c08fdf] 2024-04-26T11:42:14.132 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0873cdbfc1] 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f08726f51ca] 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 13: clone() 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: -4> 2024-04-26T11:42:13.754+0000 7f086934e700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: in thread 7f086934e700 thread_name:ms_dispatch 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f08726ffd20] 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2: gsignal() 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 3: abort() 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0873977437] 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f08739775a3] 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5613e33c4822] 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5613e3334598] 2024-04-26T11:42:14.133 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5613e3336c17] 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5613e322fd0b] 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5613e32302ac] 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5613e3218fad] 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0873c0be20] 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 13: (DispatchQueue::entry()+0x51f) [0x7f0873c08fdf] 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0873cdbfc1] 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f08726f51ca] 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 16: clone() 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[68578]: 2024-04-26T11:42:14.134 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:13 smithi193 podman[69105]: 2024-04-26 11:42:13.850191956 +0000 UTC m=+0.035463847 container died ae1e247e9ae41ac136bbec128d0d01c4f20c1fcffe3592d9d35d2db5568277f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-04-26T11:42:14.800 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:14 smithi196 podman[71067]: 2024-04-26 11:42:14.543478372 +0000 UTC m=+0.780756791 container remove 22b6143e99ba6b37c310f1a8e3c70dab1fe8fcf669788592fe131ed871943f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T11:42:14.800 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:14 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:42:14.800 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:14 smithi193 podman[69105]: 2024-04-26 11:42:14.542419966 +0000 UTC m=+0.727691842 container remove ae1e247e9ae41ac136bbec128d0d01c4f20c1fcffe3592d9d35d2db5568277f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-04-26T11:42:14.801 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:14 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:42:14.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 600.0 s, 1186.7 tps, lat 78.505 ms stddev 139.527 2024-04-26T11:42:15.122 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:14 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-04-26T11:42:15.255 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:14 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T11:42:15.255 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:14 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.390s CPU time. 2024-04-26T11:42:15.644 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:15 smithi110 ceph-mon[28069]: pgmap v364: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 18 MiB/s wr, 1.42k op/s 2024-04-26T11:42:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:15 smithi193 ceph-mon[32782]: pgmap v364: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 18 MiB/s wr, 1.42k op/s 2024-04-26T11:42:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:15 smithi196 ceph-mon[32572]: pgmap v364: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 18 MiB/s wr, 1.42k op/s 2024-04-26T11:42:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:17 smithi110 ceph-mon[28069]: pgmap v365: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 15 MiB/s wr, 1.19k op/s 2024-04-26T11:42:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:17 smithi110 ceph-mon[28069]: osdmap e126: 12 total, 12 up, 12 in 2024-04-26T11:42:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:17 smithi196 ceph-mon[32572]: pgmap v365: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 15 MiB/s wr, 1.19k op/s 2024-04-26T11:42:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:17 smithi196 ceph-mon[32572]: osdmap e126: 12 total, 12 up, 12 in 2024-04-26T11:42:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:17 smithi193 ceph-mon[32782]: pgmap v365: 97 pgs: 97 active+clean; 3.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 15 MiB/s wr, 1.19k op/s 2024-04-26T11:42:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:17 smithi193 ceph-mon[32782]: osdmap e126: 12 total, 12 up, 12 in 2024-04-26T11:42:19.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:42:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:19 smithi196 ceph-mon[32572]: pgmap v367: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 22 MiB/s wr, 1.64k op/s 2024-04-26T11:42:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:19 smithi196 ceph-mon[32572]: osdmap e127: 12 total, 12 up, 12 in 2024-04-26T11:42:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:19 smithi110 ceph-mon[28069]: pgmap v367: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 22 MiB/s wr, 1.64k op/s 2024-04-26T11:42:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:19 smithi110 ceph-mon[28069]: osdmap e127: 12 total, 12 up, 12 in 2024-04-26T11:42:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:19 smithi193 ceph-mon[32782]: pgmap v367: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 22 MiB/s wr, 1.64k op/s 2024-04-26T11:42:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:19 smithi193 ceph-mon[32782]: osdmap e127: 12 total, 12 up, 12 in 2024-04-26T11:42:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.252+0000 7f8cb3a00640 1 -- 172.21.15.110:0/349403025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cac077780 msgr2=0x7f8cac113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.252+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/349403025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cac077780 0x7f8cac113280 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009900 tx=0x7f8c9802a3f0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.252+0000 7f8cb3a00640 1 -- 172.21.15.110:0/349403025 shutdown_connections 2024-04-26T11:42:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.252+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/349403025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac1137c0 0x7f8cac115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.252+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/349403025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cac077780 0x7f8cac113280 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.252+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/349403025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac076e60 0x7f8cac077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.252+0000 7f8cb3a00640 1 -- 172.21.15.110:0/349403025 >> 172.21.15.110:0/349403025 conn(0x7f8cac100630 msgr2=0x7f8cac102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.252+0000 7f8cb3a00640 1 -- 172.21.15.110:0/349403025 shutdown_connections 2024-04-26T11:42:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.252+0000 7f8cb3a00640 1 -- 172.21.15.110:0/349403025 wait complete. 2024-04-26T11:42:21.257 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.254+0000 7f8cb3a00640 1 Processor -- start 2024-04-26T11:42:21.257 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.254+0000 7f8cb3a00640 1 -- start start 2024-04-26T11:42:21.257 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.254+0000 7f8cb3a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac076e60 0x7f8cac19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.257 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.254+0000 7f8cb3a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cac077780 0x7f8cac19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.257 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.254+0000 7f8cb3a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac1137c0 0x7f8cac1a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.257 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.254+0000 7f8cb3a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac119230 con 0x7f8cac077780 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.254+0000 7f8cb3a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1190b0 con 0x7f8cac1137c0 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.254+0000 7f8cb3a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1193b0 con 0x7f8cac076e60 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cabe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cac077780 0x7f8cac19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cb1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac076e60 0x7f8cac19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cb1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac076e60 0x7f8cac19f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:38692/0 (socket says 172.21.15.110:38692) 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cb1000640 1 -- 172.21.15.110:0/378175478 learned_addr learned my addr 172.21.15.110:0/378175478 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cb1a00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac1137c0 0x7f8cac1a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cb1000640 1 -- 172.21.15.110:0/378175478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac1137c0 msgr2=0x7f8cac1a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cb1000640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac1137c0 0x7f8cac1a3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cb1000640 1 -- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cac077780 msgr2=0x7f8cac19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cb1000640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cac077780 0x7f8cac19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cb1000640 1 -- 172.21.15.110:0/378175478 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac1a46d0 con 0x7f8cac076e60 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.255+0000 7f8cabe00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cac077780 0x7f8cac19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:42:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.256+0000 7f8cb1000640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac076e60 0x7f8cac19f730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e9f0 tx=0x7f8ca000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.256+0000 7f8ca9600640 1 -- 172.21.15.110:0/378175478 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000cd80 con 0x7f8cac076e60 2024-04-26T11:42:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.256+0000 7f8cb3a00640 1 -- 172.21.15.110:0/378175478 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cac1a49c0 con 0x7f8cac076e60 2024-04-26T11:42:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.256+0000 7f8ca9600640 1 -- 172.21.15.110:0/378175478 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca00054d0 con 0x7f8cac076e60 2024-04-26T11:42:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.256+0000 7f8ca9600640 1 -- 172.21.15.110:0/378175478 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0010690 con 0x7f8cac076e60 2024-04-26T11:42:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.256+0000 7f8cb3a00640 1 -- 172.21.15.110:0/378175478 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cac1ac250 con 0x7f8cac076e60 2024-04-26T11:42:21.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.259+0000 7f8cb67ba740 1 Processor -- start 2024-04-26T11:42:21.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.259+0000 7f8cb67ba740 1 -- start start 2024-04-26T11:42:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.259+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e400dd0 0x55da7e4011b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.259+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e40ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e40e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55da7e366380 con 0x55da7e4016f0 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55da7e302c30 con 0x55da7e400dd0 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55da7e362340 con 0x55da7e40bfb0 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cabe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e40e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cb1a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e400dd0 0x55da7e4011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cabe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e40e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:38706/0 (socket says 172.21.15.110:38706) 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cabe00640 1 -- 172.21.15.110:0/990930572 learned_addr learned my addr 172.21.15.110:0/990930572 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cabe00640 1 -- 172.21.15.110:0/990930572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e400dd0 msgr2=0x55da7e4011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cabe00640 1 --2- 172.21.15.110:0/990930572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e400dd0 0x55da7e4011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cabe00640 1 -- 172.21.15.110:0/990930572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 msgr2=0x55da7e40ba70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cabe00640 1 --2- 172.21.15.110:0/990930572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e40ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8cabe00640 1 -- 172.21.15.110:0/990930572 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da7e324940 con 0x55da7e40bfb0 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.260+0000 7f8ca9600640 1 -- 172.21.15.110:0/378175478 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f8ca0004e90 con 0x7f8cac076e60 2024-04-26T11:42:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.261+0000 7f8cabe00640 1 --2- 172.21.15.110:0/990930572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e40e3a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009900 tx=0x7f8c98004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d48af7e88d0b0d36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.261+0000 7f8c9e000640 1 -- 172.21.15.110:0/990930572 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98035040 con 0x55da7e40bfb0 2024-04-26T11:42:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.261+0000 7f8c9e000640 1 -- 172.21.15.110:0/990930572 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c98004760 con 0x55da7e40bfb0 2024-04-26T11:42:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.261+0000 7f8c9e000640 1 -- 172.21.15.110:0/990930572 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98003ab0 con 0x55da7e40bfb0 2024-04-26T11:42:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 -- 172.21.15.110:0/990930572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 msgr2=0x55da7e40e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/990930572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e40e3a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009900 tx=0x7f8c98004530 comp rx=0 tx=0).stop 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 -- 172.21.15.110:0/990930572 shutdown_connections 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/990930572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e40e3a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/990930572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e40ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/990930572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e400dd0 0x55da7e4011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 -- 172.21.15.110:0/990930572 >> 172.21.15.110:0/990930572 conn(0x55da7e3fd2e0 msgr2=0x55da7e3fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 -- 172.21.15.110:0/990930572 shutdown_connections 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 -- 172.21.15.110:0/990930572 wait complete. 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8ca9600640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8c940a3ce0 0x7f8c940a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8cb67ba740 1 -- start start 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.262+0000 7f8ca9600640 1 -- 172.21.15.110:0/378175478 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 10665+0+0 (secure 0 0 0) 0x7f8ca00d14b0 con 0x7f8cac076e60 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb1a00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8c940a3ce0 0x7f8c940a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb67ba740 1 Processor -- start 2024-04-26T11:42:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e408f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e409490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e4099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55da7e40eb80 con 0x55da7e4016f0 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55da7e2edc60 con 0x55da7e40bfb0 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55da7e40ed00 con 0x55da7e400dd0 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb1a00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8c940a3ce0 0x7f8c940a61a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8cac06be30 tx=0x7f8ca40096a0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb67ba740 10 client.0 _ll_register_callbacks cb 0x55da7e319e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb1a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e4099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.263+0000 7f8cb1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e408f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cabe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e409490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e4099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:36538/0 (socket says 172.21.15.110:36538) 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e408f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:38716/0 (socket says 172.21.15.110:38716) 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1a00640 1 -- 172.21.15.110:0/1230326359 learned_addr learned my addr 172.21.15.110:0/1230326359 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1000640 1 -- 172.21.15.110:0/1230326359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 msgr2=0x55da7e4099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1000640 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e4099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1000640 1 -- 172.21.15.110:0/1230326359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 msgr2=0x55da7e409490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1000640 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e409490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1000640 1 -- 172.21.15.110:0/1230326359 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da7e2fc510 con 0x55da7e400dd0 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1a00640 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e4099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8cb1000640 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e408f50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00ce340 tx=0x7f8ca009c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f2b1b3db168128d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8c92a00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.264+0000 7f8c92a00640 1 -- 172.21.15.110:0/1230326359 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00b6060 con 0x55da7e400dd0 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8c92a00640 1 -- 172.21.15.110:0/1230326359 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 10665+0+0 (secure 0 0 0) 0x7f8ca00d1160 con 0x55da7e400dd0 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1230326359 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c98004760 con 0x55da7e400dd0 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8c92a00640 1 -- 172.21.15.110:0/1230326359 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7f8ca009cb90 con 0x55da7e400dd0 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8cb67ba740 10 client.26239 fetch_fsmap learned FSMap version 166 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1230326359 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=166,monmap=4+}) -- 0x55da7e078210 con 0x55da7e400dd0 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8c92a00640 1 -- 172.21.15.110:0/1230326359 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c98004760 con 0x55da7e400dd0 2024-04-26T11:42:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8c92a00640 1 -- 172.21.15.110:0/1230326359 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 166) ==== 7132+0+0 (secure 0 0 0) 0x7f8ca00a5370 con 0x55da7e400dd0 2024-04-26T11:42:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8cb67ba740 10 client.26239 fetch_fsmap finished waiting for FSMap version 166 2024-04-26T11:42:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8cb67ba740 10 client.26239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:42:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8cb67ba740 20 client.26239 populate_metadata read hostname 'smithi110' 2024-04-26T11:42:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55da7e41bdb0 0x55da7e41e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8cb67ba740 4 client.26239 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:42:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.265+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1230326359 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da7e373f90 con 0x55da7e41bdb0 2024-04-26T11:42:21.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.266+0000 7f8cabe00640 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55da7e41bdb0 0x55da7e41e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.271 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.266+0000 7f8cabe00640 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55da7e41bdb0 0x55da7e41e1a0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bccb893cba174f3 server_cookie=46cd707e17f44da5 in_seq=0 out_seq=0 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.266+0000 7f8c92a00640 10 client.26239 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.267+0000 7f8c92a00640 1 -- 172.21.15.110:0/1230326359 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55da7e373f90 con 0x55da7e41bdb0 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.267+0000 7f8c92a00640 10 client.26239 handle_command_reply: tid=0 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.267+0000 7f8cb67ba740 1 client.26239 shutdown 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.267+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1230326359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 msgr2=0x55da7e408f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.267+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e408f50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00ce340 tx=0x7f8ca009c4f0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.267+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1230326359 shutdown_connections 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.267+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e4099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.267+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e409490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.267+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55da7e41bdb0 0x55da7e41e1a0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.268+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1230326359 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e408f50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.268+0000 7f8c92a00640 0 client.26239 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.268+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1230326359 >> 172.21.15.110:0/1230326359 conn(0x55da7e3fd2e0 msgr2=0x55da7e403060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.268+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1230326359 shutdown_connections 2024-04-26T11:42:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.268+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1230326359 wait complete. 2024-04-26T11:42:21.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.268+0000 7f8cb67ba740 20 client.26239 trim_cache size 0 max 16384 2024-04-26T11:42:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.284+0000 7f8cb67ba740 1 Processor -- start 2024-04-26T11:42:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.284+0000 7f8cb67ba740 1 -- start start 2024-04-26T11:42:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.284+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e400dd0 0x55da7e40b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.284+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e4016f0 0x55da7e417a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.284+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e409620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.284+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1b6eb0 con 0x55da7e400dd0 2024-04-26T11:42:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.284+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1b75b0 con 0x55da7e4016f0 2024-04-26T11:42:21.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.284+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1b7c80 con 0x55da7e40bfb0 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e400dd0 0x55da7e40b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e400dd0 0x55da7e40b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35054/0 (socket says 172.21.15.110:35054) 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1000640 1 -- 172.21.15.110:0/1209371067 learned_addr learned my addr 172.21.15.110:0/1209371067 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1a00640 1 --2- 172.21.15.110:0/1209371067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e409620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cabe00640 1 --2- 172.21.15.110:0/1209371067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e4016f0 0x55da7e417a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1000640 1 -- 172.21.15.110:0/1209371067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 msgr2=0x55da7e409620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1000640 1 --2- 172.21.15.110:0/1209371067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e409620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1000640 1 -- 172.21.15.110:0/1209371067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e4016f0 msgr2=0x55da7e417a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1000640 1 --2- 172.21.15.110:0/1209371067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e4016f0 0x55da7e417a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1000640 1 -- 172.21.15.110:0/1209371067 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da7e403d80 con 0x55da7e400dd0 2024-04-26T11:42:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.285+0000 7f8cb1000640 1 --2- 172.21.15.110:0/1209371067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e400dd0 0x55da7e40b680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c6a0 tx=0x7f8ca0009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c722b9a65516b76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.286+0000 7f8c9d600640 1 -- 172.21.15.110:0/1209371067 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00b6040 con 0x55da7e400dd0 2024-04-26T11:42:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.286+0000 7f8c9d600640 1 -- 172.21.15.110:0/1209371067 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca0098c20 con 0x55da7e400dd0 2024-04-26T11:42:21.288 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.286+0000 7f8c9d600640 1 -- 172.21.15.110:0/1209371067 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00a0f40 con 0x55da7e400dd0 2024-04-26T11:42:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.286+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1209371067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e400dd0 msgr2=0x55da7e40b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:21.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.286+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1209371067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e400dd0 0x55da7e40b680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c6a0 tx=0x7f8ca0009790 comp rx=0 tx=0).stop 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.286+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1209371067 shutdown_connections 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.287+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1209371067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e40bfb0 0x55da7e409620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.287+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1209371067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e4016f0 0x55da7e417a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.287+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/1209371067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e400dd0 0x55da7e40b680 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.287+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1209371067 >> 172.21.15.110:0/1209371067 conn(0x55da7e3fd2e0 msgr2=0x55da7e408f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.287+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1209371067 shutdown_connections 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.287+0000 7f8cb67ba740 1 -- 172.21.15.110:0/1209371067 wait complete. 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.287+0000 7f8cb67ba740 1 -- start start 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.287+0000 7f8cb67ba740 1 Processor -- start 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e405d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e4062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb67ba740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e406800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1b41b0 con 0x55da7e4016f0 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1b55a0 con 0x55da7e40bfb0 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb67ba740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1b4800 con 0x55da7e400dd0 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb67ba740 10 client.0 _ll_register_callbacks cb 0x7f8ca000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cabe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e4062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cabe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e4062c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35066/0 (socket says 172.21.15.110:35066) 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cabe00640 1 -- 172.21.15.110:0/376226222 learned_addr learned my addr 172.21.15.110:0/376226222 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb1000640 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e405d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb1a00640 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e406800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cabe00640 1 -- 172.21.15.110:0/376226222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 msgr2=0x55da7e405d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cabe00640 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e405d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cabe00640 1 -- 172.21.15.110:0/376226222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 msgr2=0x55da7e406800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:21.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cabe00640 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e406800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cabe00640 1 -- 172.21.15.110:0/376226222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da7e401520 con 0x55da7e4016f0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.288+0000 7f8cb1000640 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e405d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.289+0000 7f8cabe00640 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e4062c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8c98003660 tx=0x7f8c98003690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874f6f4742e9d5dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.289+0000 7f8c92a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.289+0000 7f8c92a00640 1 -- 172.21.15.110:0/376226222 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98035040 con 0x55da7e4016f0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.289+0000 7f8cb67ba740 1 -- 172.21.15.110:0/376226222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca0098c20 con 0x55da7e4016f0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.289+0000 7f8c92a00640 1 -- 172.21.15.110:0/376226222 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 10665+0+0 (secure 0 0 0) 0x7f8c980050c0 con 0x55da7e4016f0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.289+0000 7f8c92a00640 1 -- 172.21.15.110:0/376226222 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7f8c980052c0 con 0x55da7e4016f0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.289+0000 7f8cb67ba740 10 client.15960 fetch_fsmap learned FSMap version 166 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.289+0000 7f8cb67ba740 1 -- 172.21.15.110:0/376226222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=166,monmap=4+}) -- 0x55da7e144620 con 0x55da7e4016f0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.289+0000 7f8c92a00640 1 -- 172.21.15.110:0/376226222 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca0098c20 con 0x55da7e4016f0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8c92a00640 1 -- 172.21.15.110:0/376226222 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 166) ==== 7132+0+0 (secure 0 0 0) 0x7f8c98003820 con 0x55da7e4016f0 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8cb67ba740 10 client.15960 fetch_fsmap finished waiting for FSMap version 166 2024-04-26T11:42:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8cb67ba740 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:42:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8cb67ba740 20 client.15960 populate_metadata read hostname 'smithi110' 2024-04-26T11:42:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55da7e4828b0 0x55da7e484cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8cb67ba740 4 client.15960 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:42:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8cb67ba740 1 -- 172.21.15.110:0/376226222 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da7e36de00 con 0x55da7e4828b0 2024-04-26T11:42:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8cb1000640 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55da7e4828b0 0x55da7e484cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8cb1000640 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55da7e4828b0 0x55da7e484cd0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64f21a0c91519ce7 server_cookie=2cba0a3220ff39a1 in_seq=0 out_seq=0 2024-04-26T11:42:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:21.290+0000 7f8c92a00640 10 client.15960 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:42:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:21 smithi196 ceph-mon[32572]: pgmap v369: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 18 MiB/s wr, 1.22k op/s 2024-04-26T11:42:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:21 smithi110 ceph-mon[28069]: pgmap v369: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 18 MiB/s wr, 1.22k op/s 2024-04-26T11:42:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:21 smithi193 ceph-mon[32782]: pgmap v369: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 18 MiB/s wr, 1.22k op/s 2024-04-26T11:42:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:23 smithi196 ceph-mon[32572]: pgmap v370: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 386 op/s 2024-04-26T11:42:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:23 smithi110 ceph-mon[28069]: pgmap v370: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 386 op/s 2024-04-26T11:42:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:23 smithi193 ceph-mon[32782]: pgmap v370: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 386 op/s 2024-04-26T11:42:24.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:42:25.143 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:24 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 5. 2024-04-26T11:42:25.143 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:24 smithi193 systemd[1]: Stopped Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:25.143 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:24 smithi193 systemd[1]: Starting Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:42:25.143 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:25 smithi193 podman[69201]: 2024-04-26 11:42:25.01297277 +0000 UTC m=+0.018454281 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:42:25.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:42:25.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 systemd[1]: Stopped Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:25.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.390s CPU time. 2024-04-26T11:42:25.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 systemd[1]: Starting Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:42:25.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 podman[71159]: 2024-04-26 11:42:25.144678531 +0000 UTC m=+0.018296729 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:42:25.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 podman[71159]: 2024-04-26 11:42:25.268813293 +0000 UTC m=+0.142431481 container create 632b6e6a56e6963d931c5eb9003c73e7e050d1af6703d0b09d54aff07aa55d28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-04-26T11:42:25.405 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:25 smithi193 podman[69201]: 2024-04-26 11:42:25.143362629 +0000 UTC m=+0.148844125 container create ce600fa6e529c15d2317a364f66e6ee4e3468b5768eb8c1ab76c510fd03ab0e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-26T11:42:25.405 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:25 smithi193 podman[69201]: 2024-04-26 11:42:25.379660308 +0000 UTC m=+0.385141802 container init ce600fa6e529c15d2317a364f66e6ee4e3468b5768eb8c1ab76c510fd03ab0e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-26T11:42:25.406 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:25 smithi193 podman[69201]: 2024-04-26 11:42:25.382513539 +0000 UTC m=+0.387995037 container start ce600fa6e529c15d2317a364f66e6ee4e3468b5768eb8c1ab76c510fd03ab0e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-26T11:42:25.673 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mds[69219]: -- 172.21.15.193:0/894129847 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d5e7245a40 con 0x55d5e7219000 2024-04-26T11:42:25.674 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: starting mds.e at 2024-04-26T11:42:25.674 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:25 smithi193 bash[69201]: ce600fa6e529c15d2317a364f66e6ee4e3468b5768eb8c1ab76c510fd03ab0e8 2024-04-26T11:42:25.674 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:25 smithi193 systemd[1]: Started Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:26.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 podman[71159]: 2024-04-26 11:42:25.529955983 +0000 UTC m=+0.403574171 container init 632b6e6a56e6963d931c5eb9003c73e7e050d1af6703d0b09d54aff07aa55d28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-26T11:42:26.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 podman[71159]: 2024-04-26 11:42:25.532677066 +0000 UTC m=+0.406295263 container start 632b6e6a56e6963d931c5eb9003c73e7e050d1af6703d0b09d54aff07aa55d28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T11:42:26.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mds[71178]: -- 172.21.15.196:0/2358387784 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56158327ba40 con 0x56158324e800 2024-04-26T11:42:26.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: starting mds.l at 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 bash[71159]: 632b6e6a56e6963d931c5eb9003c73e7e050d1af6703d0b09d54aff07aa55d28 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:25 smithi196 systemd[1]: Started Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: pgmap v371: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 470 op/s 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: daemon mds.e restarted 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: osdmap e128: 12 total, 12 up, 12 in 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:boot 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=l=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T11:42:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: daemon mds.l restarted 2024-04-26T11:42:26.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: osdmap e129: 12 total, 12 up, 12 in 2024-04-26T11:42:26.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:boot 2024-04-26T11:42:26.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T11:42:26.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=c=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:42:26.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:42:26.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:25 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=j=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: pgmap v371: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 470 op/s 2024-04-26T11:42:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: daemon mds.e restarted 2024-04-26T11:42:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: osdmap e128: 12 total, 12 up, 12 in 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:boot 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=l=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: daemon mds.l restarted 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: osdmap e129: 12 total, 12 up, 12 in 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:boot 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=c=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:42:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:25 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=j=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: pgmap v371: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 470 op/s 2024-04-26T11:42:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: daemon mds.e restarted 2024-04-26T11:42:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:42:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: osdmap e128: 12 total, 12 up, 12 in 2024-04-26T11:42:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:boot 2024-04-26T11:42:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T11:42:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:42:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T11:42:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=l=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T11:42:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: daemon mds.l restarted 2024-04-26T11:42:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: osdmap e129: 12 total, 12 up, 12 in 2024-04-26T11:42:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:boot 2024-04-26T11:42:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T11:42:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=c=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T11:42:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:42:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:25 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=j=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:28.021 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:27 smithi110 ceph-mon[28069]: pgmap v374: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.5 MiB/s wr, 189 op/s 2024-04-26T11:42:28.021 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:27 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:resolve 2024-04-26T11:42:28.021 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:27 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:resolve 2024-04-26T11:42:28.021 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:27 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=j=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:27 smithi193 ceph-mon[32782]: pgmap v374: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.5 MiB/s wr, 189 op/s 2024-04-26T11:42:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:27 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:resolve 2024-04-26T11:42:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:27 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:resolve 2024-04-26T11:42:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:27 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=j=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:27 smithi196 ceph-mon[32572]: pgmap v374: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.5 MiB/s wr, 189 op/s 2024-04-26T11:42:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:27 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:resolve 2024-04-26T11:42:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:27 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:resolve 2024-04-26T11:42:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:27 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=j=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.818+0000 7f8c92a00640 1 -- 172.21.15.110:0/376226222 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da7e36de00 con 0x55da7e4828b0 2024-04-26T11:42:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.818+0000 7f8c92a00640 10 client.15960 handle_command_reply: tid=0 2024-04-26T11:42:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.818+0000 7f8cb67ba740 1 client.15960 shutdown 2024-04-26T11:42:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.818+0000 7f8cb67ba740 1 -- 172.21.15.110:0/376226222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 msgr2=0x55da7e4062c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.818+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e4062c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8c98003660 tx=0x7f8c98003690 comp rx=0 tx=0).stop 2024-04-26T11:42:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.819+0000 7f8cb67ba740 1 -- 172.21.15.110:0/376226222 shutdown_connections 2024-04-26T11:42:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.819+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da7e40bfb0 0x55da7e406800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.819+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55da7e4016f0 0x55da7e4062c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.819+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55da7e4828b0 0x55da7e484cd0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.819+0000 7f8cb67ba740 1 --2- 172.21.15.110:0/376226222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55da7e400dd0 0x55da7e405d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.819+0000 7f8cb67ba740 1 -- 172.21.15.110:0/376226222 >> 172.21.15.110:0/376226222 conn(0x55da7e3fd2e0 msgr2=0x55da7e409780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.819+0000 7f8c92a00640 0 client.15960 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:42:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.819+0000 7f8cb67ba740 1 -- 172.21.15.110:0/376226222 shutdown_connections 2024-04-26T11:42:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.819+0000 7f8cb67ba740 1 -- 172.21.15.110:0/376226222 wait complete. 2024-04-26T11:42:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.820+0000 7f8cb67ba740 20 client.15960 trim_cache size 0 max 16384 2024-04-26T11:42:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:42:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:42:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:42:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:42:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 -- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8c940a3ce0 msgr2=0x7f8c940a61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8c940a3ce0 0x7f8c940a61a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8cac06be30 tx=0x7f8ca40096a0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 -- 172.21.15.110:0/378175478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac076e60 msgr2=0x7f8cac19f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac076e60 0x7f8cac19f730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e9f0 tx=0x7f8ca000edf0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 -- 172.21.15.110:0/378175478 shutdown_connections 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8c940a3ce0 0x7f8c940a61a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac1137c0 0x7f8cac1a3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cac077780 0x7f8cac19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 --2- 172.21.15.110:0/378175478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8cac076e60 0x7f8cac19f730 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 -- 172.21.15.110:0/378175478 >> 172.21.15.110:0/378175478 conn(0x7f8cac100630 msgr2=0x7f8cac114e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 -- 172.21.15.110:0/378175478 shutdown_connections 2024-04-26T11:42:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:28.821+0000 7f8cb3a00640 1 -- 172.21.15.110:0/378175478 wait complete. 2024-04-26T11:42:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:28 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00499989 2024-04-26T11:42:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:28 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:reconnect 2024-04-26T11:42:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:28 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:reconnect 2024-04-26T11:42:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:28 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:28 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219995 2024-04-26T11:42:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:28 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0119998 2024-04-26T11:42:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:28 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00499989 2024-04-26T11:42:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:28 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:reconnect 2024-04-26T11:42:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:28 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:reconnect 2024-04-26T11:42:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:28 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:28 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219995 2024-04-26T11:42:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:28 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0119998 2024-04-26T11:42:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:28 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00499989 2024-04-26T11:42:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:28 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:reconnect 2024-04-26T11:42:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:28 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:reconnect 2024-04-26T11:42:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:28 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:28 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219995 2024-04-26T11:42:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:28 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0119998 2024-04-26T11:42:29.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 615.0 s, 34.0 tps, lat 8150.041 ms stddev 7653.247 2024-04-26T11:42:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:29 smithi110 ceph-mon[28069]: pgmap v375: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-04-26T11:42:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:29 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:rejoin 2024-04-26T11:42:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:29 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:rejoin 2024-04-26T11:42:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:29 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:29 smithi110 ceph-mon[28069]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T11:42:30.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:29 smithi110 ceph-mon[28069]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T11:42:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:29 smithi193 ceph-mon[32782]: pgmap v375: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-04-26T11:42:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:29 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:rejoin 2024-04-26T11:42:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:29 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:rejoin 2024-04-26T11:42:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:29 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:29 smithi193 ceph-mon[32782]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T11:42:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:29 smithi193 ceph-mon[32782]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T11:42:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:29 smithi196 ceph-mon[32572]: pgmap v375: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-04-26T11:42:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:29 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:rejoin 2024-04-26T11:42:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:29 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:rejoin 2024-04-26T11:42:30.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:29 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:30.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:29 smithi196 ceph-mon[32572]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T11:42:30.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:29 smithi196 ceph-mon[32572]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T11:42:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:30 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:42:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:30 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:active 2024-04-26T11:42:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:30 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:active 2024-04-26T11:42:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:30 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:30 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:30 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:42:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:30 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:active 2024-04-26T11:42:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:30 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:active 2024-04-26T11:42:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:30 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:30 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:30 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:42:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:30 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6834/3246215292,v1:172.21.15.196:6835/3246215292] up:active 2024-04-26T11:42:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:30 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3387837204,v1:172.21.15.110:6835/3387837204] up:active 2024-04-26T11:42:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:30 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T11:42:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:30 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:31 smithi193 ceph-mon[32782]: pgmap v376: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 157 op/s 2024-04-26T11:42:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:31 smithi196 ceph-mon[32572]: pgmap v376: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 157 op/s 2024-04-26T11:42:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:31 smithi110 ceph-mon[28069]: pgmap v376: 97 pgs: 97 active+clean; 3.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 MiB/s wr, 157 op/s 2024-04-26T11:42:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:33 smithi193 ceph-mon[32782]: pgmap v377: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 6.0 MiB/s wr, 222 op/s 2024-04-26T11:42:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:33 smithi196 ceph-mon[32572]: pgmap v377: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 6.0 MiB/s wr, 222 op/s 2024-04-26T11:42:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:33 smithi110 ceph-mon[28069]: pgmap v377: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 6.0 MiB/s wr, 222 op/s 2024-04-26T11:42:34.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 620.0 s, 2323.9 tps, lat 55.928 ms stddev 455.275 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3f1fa00700 time 2024-04-26T11:42:34.839832+0000 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3f2b2483dd] 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f2b2485a3] 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560762c40822] 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560762bb0598] 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560762bb2c17] 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560762aabd0b] 2024-04-26T11:42:35.251 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560762aac2ac] 2024-04-26T11:42:35.252 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560762a94fad] 2024-04-26T11:42:35.252 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f2b4dce20] 2024-04-26T11:42:35.252 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 10: (DispatchQueue::entry()+0x51f) [0x7f3f2b4d9fdf] 2024-04-26T11:42:35.252 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f2b5acfc1] 2024-04-26T11:42:35.252 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3f29fc61ca] 2024-04-26T11:42:35.252 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 13: clone() 2024-04-26T11:42:35.252 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: *** Caught signal (Aborted) ** 2024-04-26T11:42:35.252 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: in thread 7f3f1fa00700 thread_name:ms_dispatch 2024-04-26T11:42:35.252 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:34.840+0000 7f3f1fa00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3f1fa00700 time 2024-04-26T11:42:34.839832+0000 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3f2b2483dd] 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f2b2485a3] 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560762c40822] 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560762bb0598] 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560762bb2c17] 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560762aabd0b] 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560762aac2ac] 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560762a94fad] 2024-04-26T11:42:35.253 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f2b4dce20] 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 10: (DispatchQueue::entry()+0x51f) [0x7f3f2b4d9fdf] 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f2b5acfc1] 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3f29fc61ca] 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 13: clone() 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3f29fd0d20] 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2: gsignal() 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 3: abort() 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3f2b248437] 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f2b2485a3] 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560762c40822] 2024-04-26T11:42:35.254 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560762bb0598] 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560762bb2c17] 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560762aabd0b] 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560762aac2ac] 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560762a94fad] 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f2b4dce20] 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 13: (DispatchQueue::entry()+0x51f) [0x7f3f2b4d9fdf] 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f2b5acfc1] 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3f29fc61ca] 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 16: clone() 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:34.843+0000 7f3f1fa00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: in thread 7f3f1fa00700 thread_name:ms_dispatch 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.255 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3f29fd0d20] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2: gsignal() 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 3: abort() 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3f2b248437] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f2b2485a3] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560762c40822] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560762bb0598] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560762bb2c17] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560762aabd0b] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560762aac2ac] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560762a94fad] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f2b4dce20] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 13: (DispatchQueue::entry()+0x51f) [0x7f3f2b4d9fdf] 2024-04-26T11:42:35.256 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f2b5acfc1] 2024-04-26T11:42:35.257 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3f29fc61ca] 2024-04-26T11:42:35.257 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 16: clone() 2024-04-26T11:42:35.257 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:35.258 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.258 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: -1> 2024-04-26T11:42:34.840+0000 7f3f1fa00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3f1fa00700 time 2024-04-26T11:42:34.839832+0000 2024-04-26T11:42:35.258 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:35.258 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.258 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.258 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3f2b2483dd] 2024-04-26T11:42:35.259 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f2b2485a3] 2024-04-26T11:42:35.259 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560762c40822] 2024-04-26T11:42:35.259 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560762bb0598] 2024-04-26T11:42:35.259 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560762bb2c17] 2024-04-26T11:42:35.259 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560762aabd0b] 2024-04-26T11:42:35.259 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560762aac2ac] 2024-04-26T11:42:35.259 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560762a94fad] 2024-04-26T11:42:35.259 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f2b4dce20] 2024-04-26T11:42:35.259 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 10: (DispatchQueue::entry()+0x51f) [0x7f3f2b4d9fdf] 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f2b5acfc1] 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3f29fc61ca] 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 13: clone() 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 0> 2024-04-26T11:42:34.843+0000 7f3f1fa00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: in thread 7f3f1fa00700 thread_name:ms_dispatch 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3f29fd0d20] 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2: gsignal() 2024-04-26T11:42:35.260 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 3: abort() 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3f2b248437] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f2b2485a3] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560762c40822] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560762bb0598] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560762bb2c17] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560762aabd0b] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560762aac2ac] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560762a94fad] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f2b4dce20] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 13: (DispatchQueue::entry()+0x51f) [0x7f3f2b4d9fdf] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f2b5acfc1] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3f29fc61ca] 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 16: clone() 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.261 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: -5> 2024-04-26T11:42:34.840+0000 7f3f1fa00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3f1fa00700 time 2024-04-26T11:42:34.839832+0000 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3f2b2483dd] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f2b2485a3] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560762c40822] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560762bb0598] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560762bb2c17] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560762aabd0b] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560762aac2ac] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560762a94fad] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f2b4dce20] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 10: (DispatchQueue::entry()+0x51f) [0x7f3f2b4d9fdf] 2024-04-26T11:42:35.262 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f2b5acfc1] 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3f29fc61ca] 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 13: clone() 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: -4> 2024-04-26T11:42:34.843+0000 7f3f1fa00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: in thread 7f3f1fa00700 thread_name:ms_dispatch 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3f29fd0d20] 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2: gsignal() 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 3: abort() 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3f2b248437] 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3f2b2485a3] 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560762c40822] 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560762bb0598] 2024-04-26T11:42:35.263 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560762bb2c17] 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560762aabd0b] 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560762aac2ac] 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560762a94fad] 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3f2b4dce20] 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 13: (DispatchQueue::entry()+0x51f) [0x7f3f2b4d9fdf] 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3f2b5acfc1] 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3f29fc61ca] 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 16: clone() 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:34 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93080]: 2024-04-26T11:42:35.264 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:35 smithi110 podman[93184]: 2024-04-26 11:42:35.035272834 +0000 UTC m=+0.050527651 container died 6aebaa86b8cc8a67e11843e11e09420eb793c4e9f69fb1c2e496dbbeecee906d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3e344a7700 time 2024-04-26T11:42:34.853608+0000 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3e3ead03dd] 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3e3ead05a3] 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d9cf509822] 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d9cf479598] 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d9cf47bc17] 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d9cf374d0b] 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d9cf3752ac] 2024-04-26T11:42:35.265 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d9cf35dfad] 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3e3ed64e20] 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 10: (DispatchQueue::entry()+0x51f) [0x7f3e3ed61fdf] 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3e3ee34fc1] 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3e3d84e1ca] 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 13: clone() 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:34.854+0000 7f3e344a7700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3e344a7700 time 2024-04-26T11:42:34.853608+0000 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3e3ead03dd] 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3e3ead05a3] 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d9cf509822] 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d9cf479598] 2024-04-26T11:42:35.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d9cf47bc17] 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d9cf374d0b] 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d9cf3752ac] 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d9cf35dfad] 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3e3ed64e20] 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 10: (DispatchQueue::entry()+0x51f) [0x7f3e3ed61fdf] 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3e3ee34fc1] 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3e3d84e1ca] 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 13: clone() 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: *** Caught signal (Aborted) ** 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: in thread 7f3e344a7700 thread_name:ms_dispatch 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3e3d858d20] 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2: gsignal() 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 3: abort() 2024-04-26T11:42:35.267 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3e3ead0437] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3e3ead05a3] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d9cf509822] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d9cf479598] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d9cf47bc17] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d9cf374d0b] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d9cf3752ac] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d9cf35dfad] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3e3ed64e20] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 13: (DispatchQueue::entry()+0x51f) [0x7f3e3ed61fdf] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3e3ee34fc1] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3e3d84e1ca] 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 16: clone() 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:34.855+0000 7f3e344a7700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:35.268 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: in thread 7f3e344a7700 thread_name:ms_dispatch 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3e3d858d20] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2: gsignal() 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 3: abort() 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3e3ead0437] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3e3ead05a3] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d9cf509822] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d9cf479598] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d9cf47bc17] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d9cf374d0b] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d9cf3752ac] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d9cf35dfad] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3e3ed64e20] 2024-04-26T11:42:35.269 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 13: (DispatchQueue::entry()+0x51f) [0x7f3e3ed61fdf] 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3e3ee34fc1] 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3e3d84e1ca] 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 16: clone() 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: -1> 2024-04-26T11:42:34.854+0000 7f3e344a7700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3e344a7700 time 2024-04-26T11:42:34.853608+0000 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3e3ead03dd] 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3e3ead05a3] 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d9cf509822] 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d9cf479598] 2024-04-26T11:42:35.270 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d9cf47bc17] 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d9cf374d0b] 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d9cf3752ac] 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d9cf35dfad] 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3e3ed64e20] 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 10: (DispatchQueue::entry()+0x51f) [0x7f3e3ed61fdf] 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3e3ee34fc1] 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3e3d84e1ca] 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 13: clone() 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 0> 2024-04-26T11:42:34.855+0000 7f3e344a7700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: in thread 7f3e344a7700 thread_name:ms_dispatch 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3e3d858d20] 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2: gsignal() 2024-04-26T11:42:35.271 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 3: abort() 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3e3ead0437] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3e3ead05a3] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d9cf509822] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d9cf479598] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d9cf47bc17] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d9cf374d0b] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d9cf3752ac] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d9cf35dfad] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3e3ed64e20] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 13: (DispatchQueue::entry()+0x51f) [0x7f3e3ed61fdf] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3e3ee34fc1] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3e3d84e1ca] 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 16: clone() 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:35.272 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: -1> 2024-04-26T11:42:34.854+0000 7f3e344a7700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3e344a7700 time 2024-04-26T11:42:34.853608+0000 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3e3ead03dd] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3e3ead05a3] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d9cf509822] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d9cf479598] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d9cf47bc17] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d9cf374d0b] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d9cf3752ac] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d9cf35dfad] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3e3ed64e20] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 10: (DispatchQueue::entry()+0x51f) [0x7f3e3ed61fdf] 2024-04-26T11:42:35.273 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3e3ee34fc1] 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3e3d84e1ca] 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 13: clone() 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 0> 2024-04-26T11:42:34.855+0000 7f3e344a7700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: in thread 7f3e344a7700 thread_name:ms_dispatch 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3e3d858d20] 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2: gsignal() 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 3: abort() 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3e3ead0437] 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3e3ead05a3] 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d9cf509822] 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d9cf479598] 2024-04-26T11:42:35.274 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d9cf47bc17] 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d9cf374d0b] 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d9cf3752ac] 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d9cf35dfad] 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3e3ed64e20] 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 13: (DispatchQueue::entry()+0x51f) [0x7f3e3ed61fdf] 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3e3ee34fc1] 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3e3d84e1ca] 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 16: clone() 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c[71026]: 2024-04-26T11:42:35.275 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:34 smithi196 podman[71213]: 2024-04-26 11:42:34.95765378 +0000 UTC m=+0.056661534 container died 2f4cf1a385d00edd0500737ee8a62f5dd3ddb82705a36a452f76765811950dbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T11:42:35.923 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:35 smithi196 ceph-mon[32572]: pgmap v378: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 7.9 MiB/s wr, 308 op/s 2024-04-26T11:42:35.923 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:35 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:35.923 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:35 smithi196 podman[71213]: 2024-04-26 11:42:35.668344937 +0000 UTC m=+0.767352672 container remove 2f4cf1a385d00edd0500737ee8a62f5dd3ddb82705a36a452f76765811950dbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-26T11:42:35.923 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:35 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:42:36.106 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:35 smithi193 ceph-mon[32782]: pgmap v378: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 7.9 MiB/s wr, 308 op/s 2024-04-26T11:42:36.106 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:35 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:36.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:35 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T11:42:36.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:35 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.095s CPU time. 2024-04-26T11:42:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:35 smithi110 ceph-mon[28069]: pgmap v378: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 7.9 MiB/s wr, 308 op/s 2024-04-26T11:42:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:35 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=j=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T11:42:36.703 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:36 smithi110 podman[93184]: 2024-04-26 11:42:36.357513705 +0000 UTC m=+1.372768566 container remove 6aebaa86b8cc8a67e11843e11e09420eb793c4e9f69fb1c2e496dbbeecee906d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:42:36.703 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:36 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:42:37.041 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:36 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T11:42:37.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:36 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 2.129s CPU time. 2024-04-26T11:42:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:37 smithi193 ceph-mon[32782]: pgmap v379: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 6.5 MiB/s wr, 256 op/s 2024-04-26T11:42:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:37 smithi196 ceph-mon[32572]: pgmap v379: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 6.5 MiB/s wr, 256 op/s 2024-04-26T11:42:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:37 smithi110 ceph-mon[28069]: pgmap v379: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 6.5 MiB/s wr, 256 op/s 2024-04-26T11:42:39.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 625.0 s, 44.8 tps, lat 73.311 ms stddev 70.982 2024-04-26T11:42:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:39 smithi110 ceph-mon[28069]: pgmap v380: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 9.9 MiB/s wr, 433 op/s 2024-04-26T11:42:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:39 smithi193 ceph-mon[32782]: pgmap v380: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 9.9 MiB/s wr, 433 op/s 2024-04-26T11:42:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:39 smithi196 ceph-mon[32572]: pgmap v380: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 9.9 MiB/s wr, 433 op/s 2024-04-26T11:42:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.971+0000 7f4e36800640 1 -- 172.21.15.110:0/1007933242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e301135e0 msgr2=0x7f4e301159d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.971+0000 7f4e36800640 1 --2- 172.21.15.110:0/1007933242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e301135e0 0x7f4e301159d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009cd0 tx=0x7f4e2802a8f0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.971+0000 7f4e36800640 1 -- 172.21.15.110:0/1007933242 shutdown_connections 2024-04-26T11:42:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.971+0000 7f4e36800640 1 --2- 172.21.15.110:0/1007933242 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e301135e0 0x7f4e301159d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.971+0000 7f4e36800640 1 --2- 172.21.15.110:0/1007933242 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e30077780 0x7f4e301130a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.971+0000 7f4e36800640 1 --2- 172.21.15.110:0/1007933242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e30076e60 0x7f4e30077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.971+0000 7f4e36800640 1 -- 172.21.15.110:0/1007933242 >> 172.21.15.110:0/1007933242 conn(0x7f4e30100450 msgr2=0x7f4e30102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.971+0000 7f4e36800640 1 -- 172.21.15.110:0/1007933242 shutdown_connections 2024-04-26T11:42:41.973 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.972+0000 7f4e36800640 1 -- 172.21.15.110:0/1007933242 wait complete. 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.973+0000 7f4e36800640 1 Processor -- start 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.973+0000 7f4e36800640 1 -- start start 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.973+0000 7f4e36800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e30076e60 0x7f4e3019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.973+0000 7f4e36800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e30077780 0x7f4e3019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.973+0000 7f4e36800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e301135e0 0x7f4e301a3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.973+0000 7f4e36800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4e30118fd0 con 0x7f4e30077780 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.973+0000 7f4e36800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4e30118e50 con 0x7f4e30076e60 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.973+0000 7f4e36800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4e30119150 con 0x7f4e301135e0 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e34a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e30077780 0x7f4e3019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e34a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e30077780 0x7f4e3019fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51806/0 (socket says 172.21.15.110:51806) 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e34a00640 1 -- 172.21.15.110:0/3304681990 learned_addr learned my addr 172.21.15.110:0/3304681990 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e35e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e301135e0 0x7f4e301a3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e35400640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e30076e60 0x7f4e3019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.976 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e35e00640 1 -- 172.21.15.110:0/3304681990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e30076e60 msgr2=0x7f4e3019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e35e00640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e30076e60 0x7f4e3019f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e35e00640 1 -- 172.21.15.110:0/3304681990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e30077780 msgr2=0x7f4e3019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e35e00640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e30077780 0x7f4e3019fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e35e00640 1 -- 172.21.15.110:0/3304681990 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e301a4580 con 0x7f4e301135e0 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.974+0000 7f4e35e00640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e301135e0 0x7f4e301a3e50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009ca0 tx=0x7f4e28030d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.975+0000 7f4e2e000640 1 -- 172.21.15.110:0/3304681990 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28003e40 con 0x7f4e301135e0 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.975+0000 7f4e2e000640 1 -- 172.21.15.110:0/3304681990 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e28040070 con 0x7f4e301135e0 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.975+0000 7f4e36800640 1 -- 172.21.15.110:0/3304681990 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e301a4810 con 0x7f4e301135e0 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.975+0000 7f4e2e000640 1 -- 172.21.15.110:0/3304681990 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28045970 con 0x7f4e301135e0 2024-04-26T11:42:41.977 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.975+0000 7f4e36800640 1 -- 172.21.15.110:0/3304681990 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e301ac100 con 0x7f4e301135e0 2024-04-26T11:42:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.978+0000 7f4e3adb2740 1 Processor -- start 2024-04-26T11:42:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.978+0000 7f4e2e000640 1 -- 172.21.15.110:0/3304681990 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f4e28004680 con 0x7f4e301135e0 2024-04-26T11:42:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.978+0000 7f4e3adb2740 1 -- start start 2024-04-26T11:42:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba7891e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78928c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba789291c0 0x55ba7892b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ba78883380 con 0x55ba7891dfe0 2024-04-26T11:42:41.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ba7881fc30 con 0x55ba789291c0 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ba7887f340 con 0x55ba7891e900 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e34a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba7891e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e34a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba7891e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51816/0 (socket says 172.21.15.110:51816) 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e34a00640 1 -- 172.21.15.110:0/2852672024 learned_addr learned my addr 172.21.15.110:0/2852672024 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e35400640 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78928c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e34a00640 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba789291c0 0x55ba7892b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e35400640 1 -- 172.21.15.110:0/2852672024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba789291c0 msgr2=0x55ba7892b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e35400640 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba789291c0 0x55ba7892b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e35400640 1 -- 172.21.15.110:0/2852672024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 msgr2=0x55ba7891e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e35400640 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba7891e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e35400640 1 -- 172.21.15.110:0/2852672024 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba78841940 con 0x55ba7891e900 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.979+0000 7f4e34a00640 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba7891e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:42:41.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.980+0000 7f4e35400640 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78928c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009c20 tx=0x7f4e24011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d140e8f633fca03d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.980+0000 7f4e2e000640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4e180a3d90 0x7f4e180a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.980+0000 7f4e22600640 1 -- 172.21.15.110:0/2852672024 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24004050 con 0x55ba7891e900 2024-04-26T11:42:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.980+0000 7f4e22600640 1 -- 172.21.15.110:0/2852672024 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e240054d0 con 0x55ba7891e900 2024-04-26T11:42:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.980+0000 7f4e22600640 1 -- 172.21.15.110:0/2852672024 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24004be0 con 0x55ba7891e900 2024-04-26T11:42:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.980+0000 7f4e2e000640 1 -- 172.21.15.110:0/3304681990 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 10793+0+0 (secure 0 0 0) 0x7f4e280f1f30 con 0x7f4e301135e0 2024-04-26T11:42:41.983 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.980+0000 7f4e34a00640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4e180a3d90 0x7f4e180a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2852672024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 msgr2=0x55ba78928c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78928c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009c20 tx=0x7f4e24011810 comp rx=0 tx=0).stop 2024-04-26T11:42:41.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2852672024 shutdown_connections 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba789291c0 0x55ba7892b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78928c80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2852672024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba7891e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2852672024 >> 172.21.15.110:0/2852672024 conn(0x55ba7891a4f0 msgr2=0x55ba7891a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e34a00640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4e180a3d90 0x7f4e180a6250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009fd0 tx=0x7f4e1c0098c0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2852672024 shutdown_connections 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2852672024 wait complete. 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.981+0000 7f4e3adb2740 1 -- start start 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e3adb2740 1 Processor -- start 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 0x55ba78926090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.987 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba789265d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78926b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ba7892bdf0 con 0x55ba789291c0 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ba7880ac60 con 0x55ba7891dfe0 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ba7892bf70 con 0x55ba7891e900 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e3adb2740 10 client.0 _ll_register_callbacks cb 0x55ba78836e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e35e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78926b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e35400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 0x55ba78926090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e35e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78926b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51832/0 (socket says 172.21.15.110:51832) 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e35e00640 1 -- 172.21.15.110:0/548090104 learned_addr learned my addr 172.21.15.110:0/548090104 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.982+0000 7f4e34a00640 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba789265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e35e00640 1 -- 172.21.15.110:0/548090104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 msgr2=0x55ba789265d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e35e00640 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba789265d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e35e00640 1 -- 172.21.15.110:0/548090104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 msgr2=0x55ba78926090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e35e00640 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 0x55ba78926090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e35e00640 1 -- 172.21.15.110:0/548090104 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba78819510 con 0x55ba789291c0 2024-04-26T11:42:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e35e00640 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78926b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4e280c5f00 tx=0x7f4e280bd690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e077603df8c502a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e16a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:42:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e16a00640 1 -- 172.21.15.110:0/548090104 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e280bd850 con 0x55ba789291c0 2024-04-26T11:42:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e16a00640 1 -- 172.21.15.110:0/548090104 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 10793+0+0 (secure 0 0 0) 0x7f4e280bdab0 con 0x55ba789291c0 2024-04-26T11:42:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e3adb2740 1 -- 172.21.15.110:0/548090104 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e240054d0 con 0x55ba789291c0 2024-04-26T11:42:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.983+0000 7f4e16a00640 1 -- 172.21.15.110:0/548090104 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f4e280c1c00 con 0x55ba789291c0 2024-04-26T11:42:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e3adb2740 10 client.15972 fetch_fsmap learned FSMap version 176 2024-04-26T11:42:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e3adb2740 1 -- 172.21.15.110:0/548090104 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=4+}) -- 0x55ba78595210 con 0x55ba789291c0 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e16a00640 1 -- 172.21.15.110:0/548090104 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e240054d0 con 0x55ba789291c0 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e16a00640 1 -- 172.21.15.110:0/548090104 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 176) ==== 7136+0+0 (secure 0 0 0) 0x7f4e2804d030 con 0x55ba789291c0 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e3adb2740 10 client.15972 fetch_fsmap finished waiting for FSMap version 176 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e3adb2740 10 client.15972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e3adb2740 20 client.15972 populate_metadata read hostname 'smithi110' 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ba78938e70 0x55ba7893b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e3adb2740 4 client.15972 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e3adb2740 1 -- 172.21.15.110:0/548090104 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba78890f90 con 0x55ba78938e70 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.984+0000 7f4e35400640 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ba78938e70 0x55ba7893b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.985+0000 7f4e35400640 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ba78938e70 0x55ba7893b2c0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98cf29beae413680 server_cookie=cb5ad7a2449d9be8 in_seq=0 out_seq=0 2024-04-26T11:42:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.985+0000 7f4e16a00640 10 client.15972 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:42:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e16a00640 1 -- 172.21.15.110:0/548090104 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ba78890f90 con 0x55ba78938e70 2024-04-26T11:42:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e16a00640 10 client.15972 handle_command_reply: tid=0 2024-04-26T11:42:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 client.15972 shutdown 2024-04-26T11:42:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 -- 172.21.15.110:0/548090104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 msgr2=0x55ba78926b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78926b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4e280c5f00 tx=0x7f4e280bd690 comp rx=0 tx=0).stop 2024-04-26T11:42:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 -- 172.21.15.110:0/548090104 shutdown_connections 2024-04-26T11:42:41.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78926b10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ba78938e70 0x55ba7893b2c0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba789265d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/548090104 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 0x55ba78926090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e16a00640 0 client.15972 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:42:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 -- 172.21.15.110:0/548090104 >> 172.21.15.110:0/548090104 conn(0x55ba7891a4f0 msgr2=0x55ba78920270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 -- 172.21.15.110:0/548090104 shutdown_connections 2024-04-26T11:42:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 1 -- 172.21.15.110:0/548090104 wait complete. 2024-04-26T11:42:41.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:41.986+0000 7f4e3adb2740 20 client.15972 trim_cache size 0 max 16384 2024-04-26T11:42:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e3adb2740 1 Processor -- start 2024-04-26T11:42:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e3adb2740 1 -- start start 2024-04-26T11:42:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba789287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891e900 0x55ba78934cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba789291c0 0x55ba78919650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4e301b6cd0 con 0x55ba7891dfe0 2024-04-26T11:42:42.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4e301b73a0 con 0x55ba7891e900 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4e301b7aa0 con 0x55ba789291c0 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e35400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba789287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e35400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba789287c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51844/0 (socket says 172.21.15.110:51844) 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e34a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891e900 0x55ba78934cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e35400640 1 -- 172.21.15.110:0/99546096 learned_addr learned my addr 172.21.15.110:0/99546096 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.003+0000 7f4e35e00640 1 --2- 172.21.15.110:0/99546096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba789291c0 0x55ba78919650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.004+0000 7f4e35400640 1 -- 172.21.15.110:0/99546096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba789291c0 msgr2=0x55ba78919650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.004+0000 7f4e35400640 1 --2- 172.21.15.110:0/99546096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba789291c0 0x55ba78919650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.004+0000 7f4e35400640 1 -- 172.21.15.110:0/99546096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891e900 msgr2=0x55ba78934cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.004+0000 7f4e35400640 1 --2- 172.21.15.110:0/99546096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891e900 0x55ba78934cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.004+0000 7f4e35400640 1 -- 172.21.15.110:0/99546096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba78925040 con 0x55ba7891dfe0 2024-04-26T11:42:42.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.004+0000 7f4e35400640 1 --2- 172.21.15.110:0/99546096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba789287c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4e24014040 tx=0x7f4e24005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6cc0f54830eb7e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:42.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.004+0000 7f4e21c00640 1 -- 172.21.15.110:0/99546096 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2402edd0 con 0x55ba7891dfe0 2024-04-26T11:42:42.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.004+0000 7f4e21c00640 1 -- 172.21.15.110:0/99546096 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e240035f0 con 0x55ba7891dfe0 2024-04-26T11:42:42.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.004+0000 7f4e21c00640 1 -- 172.21.15.110:0/99546096 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24019690 con 0x55ba7891dfe0 2024-04-26T11:42:42.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.005+0000 7f4e3adb2740 1 -- 172.21.15.110:0/99546096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 msgr2=0x55ba789287c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:42.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.005+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/99546096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba789287c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4e24014040 tx=0x7f4e24005f90 comp rx=0 tx=0).stop 2024-04-26T11:42:42.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.005+0000 7f4e3adb2740 1 -- 172.21.15.110:0/99546096 shutdown_connections 2024-04-26T11:42:42.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.005+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/99546096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba789291c0 0x55ba78919650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.005+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/99546096 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891e900 0x55ba78934cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.005+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/99546096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba7891dfe0 0x55ba789287c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.005+0000 7f4e3adb2740 1 -- 172.21.15.110:0/99546096 >> 172.21.15.110:0/99546096 conn(0x55ba7891a4f0 msgr2=0x55ba7891a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.005+0000 7f4e3adb2740 1 -- 172.21.15.110:0/99546096 shutdown_connections 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.005+0000 7f4e3adb2740 1 -- 172.21.15.110:0/99546096 wait complete. 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e3adb2740 1 -- start start 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e3adb2740 1 Processor -- start 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 0x55ba78931730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78922c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e3adb2740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78923390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4e301b3fb0 con 0x55ba789291c0 2024-04-26T11:42:42.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4e301b53c0 con 0x55ba7891dfe0 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e3adb2740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4e301b4620 con 0x55ba7891e900 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e3adb2740 10 client.0 _ll_register_callbacks cb 0x7f4e280b9ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.006+0000 7f4e35e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78923390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e35400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 0x55ba78931730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e35e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78923390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51860/0 (socket says 172.21.15.110:51860) 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e35e00640 1 -- 172.21.15.110:0/2450042214 learned_addr learned my addr 172.21.15.110:0/2450042214 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e34a00640 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78922c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e34a00640 1 -- 172.21.15.110:0/2450042214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 msgr2=0x55ba78931730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e34a00640 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 0x55ba78931730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e34a00640 1 -- 172.21.15.110:0/2450042214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 msgr2=0x55ba78923390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:42:42.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e34a00640 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78923390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e34a00640 1 -- 172.21.15.110:0/2450042214 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba78661620 con 0x55ba7891e900 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e35e00640 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78923390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e34a00640 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78922c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55ba78927660 tx=0x7f4e1c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84e872e35dfdb27d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.007+0000 7f4e16a00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.008+0000 7f4e16a00640 1 -- 172.21.15.110:0/2450042214 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c022a70 con 0x55ba7891e900 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.008+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2450042214 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e240035f0 con 0x55ba7891e900 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.008+0000 7f4e16a00640 1 -- 172.21.15.110:0/2450042214 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 10793+0+0 (secure 0 0 0) 0x7f4e1c022c10 con 0x55ba7891e900 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.008+0000 7f4e16a00640 1 -- 172.21.15.110:0/2450042214 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=176) ==== 24+0+0 (secure 0 0 0) 0x7f4e1c022e10 con 0x55ba7891e900 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.008+0000 7f4e3adb2740 10 client.26272 fetch_fsmap learned FSMap version 176 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.008+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2450042214 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=176,monmap=4+}) -- 0x55ba7883dcb0 con 0x55ba7891e900 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.008+0000 7f4e16a00640 1 -- 172.21.15.110:0/2450042214 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e240035f0 con 0x55ba7891e900 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.008+0000 7f4e16a00640 1 -- 172.21.15.110:0/2450042214 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 176) ==== 7136+0+0 (secure 0 0 0) 0x7f4e1c004bf0 con 0x55ba7891e900 2024-04-26T11:42:42.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.009+0000 7f4e3adb2740 10 client.26272 fetch_fsmap finished waiting for FSMap version 176 2024-04-26T11:42:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.009+0000 7f4e3adb2740 10 client.26272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:42:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.009+0000 7f4e3adb2740 20 client.26272 populate_metadata read hostname 'smithi110' 2024-04-26T11:42:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.009+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ba7899fa50 0x55ba789a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:42:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.009+0000 7f4e3adb2740 4 client.26272 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:42:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.009+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2450042214 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ba7888ae00 con 0x55ba7899fa50 2024-04-26T11:42:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.009+0000 7f4e35400640 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ba7899fa50 0x55ba789a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:42:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.009+0000 7f4e35400640 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ba7899fa50 0x55ba789a1e70 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cf2afcbee1d8a7f server_cookie=4aedf0c5eafe3eb1 in_seq=0 out_seq=0 2024-04-26T11:42:42.015 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:42.009+0000 7f4e16a00640 10 client.26272 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:42:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:41 smithi193 ceph-mon[32782]: pgmap v381: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 9.6 MiB/s wr, 385 op/s 2024-04-26T11:42:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:41 smithi196 ceph-mon[32572]: pgmap v381: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 9.6 MiB/s wr, 385 op/s 2024-04-26T11:42:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:41 smithi110 ceph-mon[28069]: pgmap v381: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 9.6 MiB/s wr, 385 op/s 2024-04-26T11:42:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:43 smithi193 ceph-mon[32782]: pgmap v382: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 10 MiB/s wr, 412 op/s 2024-04-26T11:42:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:43 smithi196 ceph-mon[32572]: pgmap v382: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 10 MiB/s wr, 412 op/s 2024-04-26T11:42:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:43 smithi110 ceph-mon[28069]: pgmap v382: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 10 MiB/s wr, 412 op/s 2024-04-26T11:42:44.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:42:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:45 smithi193 ceph-mon[32782]: pgmap v383: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 7.0 MiB/s wr, 335 op/s 2024-04-26T11:42:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:45 smithi196 ceph-mon[32572]: pgmap v383: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 7.0 MiB/s wr, 335 op/s 2024-04-26T11:42:46.255 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:46 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 6. 2024-04-26T11:42:46.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:46 smithi196 systemd[1]: Stopped Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:46.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:46 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.095s CPU time. 2024-04-26T11:42:46.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:46 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Start request repeated too quickly. 2024-04-26T11:42:46.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:46 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T11:42:46.256 INFO:journalctl@ceph.mds.c.smithi196.stdout:Apr 26 11:42:46 smithi196 systemd[1]: Failed to start Ceph mds.c for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:45 smithi110 ceph-mon[28069]: pgmap v383: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 7.0 MiB/s wr, 335 op/s 2024-04-26T11:42:47.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:42:47.193 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:46 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:42:47.193 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:46 smithi110 systemd[1]: Stopped Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:47.193 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:46 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 2.129s CPU time. 2024-04-26T11:42:47.194 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:46 smithi110 systemd[1]: Starting Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:42:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:42:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:42:47.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:47 smithi110 podman[93382]: 2024-04-26 11:42:47.124177854 +0000 UTC m=+0.037095038 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:42:47.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:47 smithi110 podman[93382]: 2024-04-26 11:42:47.267626325 +0000 UTC m=+0.180543535 container create 98048601f4981d9ad732b53683864fa211a139493c7a5d2e2bd28275c45704ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:42:47.901 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:47 smithi110 podman[93382]: 2024-04-26 11:42:47.545446103 +0000 UTC m=+0.458363288 container init 98048601f4981d9ad732b53683864fa211a139493c7a5d2e2bd28275c45704ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:42:47.901 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:47 smithi110 podman[93382]: 2024-04-26 11:42:47.552271748 +0000 UTC m=+0.465188930 container start 98048601f4981d9ad732b53683864fa211a139493c7a5d2e2bd28275c45704ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD) 2024-04-26T11:42:47.901 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mds[93412]: -- 172.21.15.110:0/749012891 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d080497a40 con 0x55d08046a800 2024-04-26T11:42:47.901 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: starting mds.j at 2024-04-26T11:42:47.901 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:47 smithi110 bash[93382]: 98048601f4981d9ad732b53683864fa211a139493c7a5d2e2bd28275c45704ae 2024-04-26T11:42:47.902 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:42:47 smithi110 systemd[1]: Started Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:42:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:47 smithi196 ceph-mon[32572]: pgmap v384: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 248 op/s 2024-04-26T11:42:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:47 smithi196 ceph-mon[32572]: daemon mds.j restarted 2024-04-26T11:42:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:47 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:42:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:47 smithi196 ceph-mon[32572]: osdmap e130: 12 total, 12 up, 12 in 2024-04-26T11:42:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:47 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:boot 2024-04-26T11:42:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:47 smithi196 ceph-mon[32572]: Standby daemon mds.e assigned to filesystem cephfs as rank 2 2024-04-26T11:42:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:47 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=c=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:42:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:42:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:47 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:active,2=e=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T11:42:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mon[28069]: pgmap v384: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 248 op/s 2024-04-26T11:42:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mon[28069]: daemon mds.j restarted 2024-04-26T11:42:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:42:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mon[28069]: osdmap e130: 12 total, 12 up, 12 in 2024-04-26T11:42:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:boot 2024-04-26T11:42:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mon[28069]: Standby daemon mds.e assigned to filesystem cephfs as rank 2 2024-04-26T11:42:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=c=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:42:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:42:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:47 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:active,2=e=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T11:42:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:47 smithi193 ceph-mon[32782]: pgmap v384: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 248 op/s 2024-04-26T11:42:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:47 smithi193 ceph-mon[32782]: daemon mds.j restarted 2024-04-26T11:42:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:47 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:42:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:47 smithi193 ceph-mon[32782]: osdmap e130: 12 total, 12 up, 12 in 2024-04-26T11:42:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:47 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:boot 2024-04-26T11:42:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:47 smithi193 ceph-mon[32782]: Standby daemon mds.e assigned to filesystem cephfs as rank 2 2024-04-26T11:42:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:47 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=c=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T11:42:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:42:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:47 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:active,2=e=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T11:42:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:42:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:42:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:42:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:48 smithi196 ceph-mon[32572]: Replacing daemon mds.c as rank 1 with standby daemon mds.l 2024-04-26T11:42:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:48 smithi196 ceph-mon[32572]: MDS daemon mds.c is removed because it is dead or otherwise unavailable. 2024-04-26T11:42:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:48 smithi196 ceph-mon[32572]: osdmap e131: 12 total, 12 up, 12 in 2024-04-26T11:42:49.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:48 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:resolve 2024-04-26T11:42:49.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:48 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:42:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:42:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:42:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:48 smithi110 ceph-mon[28069]: Replacing daemon mds.c as rank 1 with standby daemon mds.l 2024-04-26T11:42:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:48 smithi110 ceph-mon[28069]: MDS daemon mds.c is removed because it is dead or otherwise unavailable. 2024-04-26T11:42:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:48 smithi110 ceph-mon[28069]: osdmap e131: 12 total, 12 up, 12 in 2024-04-26T11:42:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:48 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:resolve 2024-04-26T11:42:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:48 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:42:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:42:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' 2024-04-26T11:42:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:48 smithi193 ceph-mon[32782]: Replacing daemon mds.c as rank 1 with standby daemon mds.l 2024-04-26T11:42:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:48 smithi193 ceph-mon[32782]: MDS daemon mds.c is removed because it is dead or otherwise unavailable. 2024-04-26T11:42:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:48 smithi193 ceph-mon[32782]: osdmap e131: 12 total, 12 up, 12 in 2024-04-26T11:42:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:48 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:resolve 2024-04-26T11:42:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:48 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=e=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:49.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:42:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:49 smithi196 ceph-mon[32572]: pgmap v386: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-04-26T11:42:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:49 smithi110 ceph-mon[28069]: pgmap v386: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-04-26T11:42:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:49 smithi193 ceph-mon[32782]: pgmap v386: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 117 op/s 2024-04-26T11:42:51.185 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:50 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:resolve 2024-04-26T11:42:51.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:50 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:50 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:resolve 2024-04-26T11:42:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:50 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:50 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:resolve 2024-04-26T11:42:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:50 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=e=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.962+0000 7f4e16a00640 1 -- 172.21.15.110:0/2450042214 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ba7888ae00 con 0x55ba7899fa50 2024-04-26T11:42:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.962+0000 7f4e16a00640 10 client.26272 handle_command_reply: tid=0 2024-04-26T11:42:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.962+0000 7f4e3adb2740 1 client.26272 shutdown 2024-04-26T11:42:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2450042214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 msgr2=0x55ba78922c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78922c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55ba78927660 tx=0x7f4e1c004730 comp rx=0 tx=0).stop 2024-04-26T11:42:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2450042214 shutdown_connections 2024-04-26T11:42:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ba789291c0 0x55ba78923390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55ba7899fa50 0x55ba789a1e70 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ba7891e900 0x55ba78922c50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e16a00640 0 client.26272 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:42:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 --2- 172.21.15.110:0/2450042214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba7891dfe0 0x55ba78931730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2450042214 >> 172.21.15.110:0/2450042214 conn(0x55ba7891a4f0 msgr2=0x55ba789268e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2450042214 shutdown_connections 2024-04-26T11:42:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 1 -- 172.21.15.110:0/2450042214 wait complete. 2024-04-26T11:42:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.963+0000 7f4e3adb2740 20 client.26272 trim_cache size 0 max 16384 2024-04-26T11:42:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:42:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:42:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:42:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:42:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.964+0000 7f4e36800640 1 -- 172.21.15.110:0/3304681990 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4e180a3d90 msgr2=0x7f4e180a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.964+0000 7f4e36800640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4e180a3d90 0x7f4e180a6250 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009fd0 tx=0x7f4e1c0098c0 comp rx=0 tx=0).stop 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.964+0000 7f4e36800640 1 -- 172.21.15.110:0/3304681990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e301135e0 msgr2=0x7f4e301a3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.964+0000 7f4e36800640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e301135e0 0x7f4e301a3e50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009ca0 tx=0x7f4e28030d80 comp rx=0 tx=0).stop 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.965+0000 7f4e36800640 1 -- 172.21.15.110:0/3304681990 shutdown_connections 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.965+0000 7f4e36800640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f4e180a3d90 0x7f4e180a6250 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.965+0000 7f4e36800640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e301135e0 0x7f4e301a3e50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.965+0000 7f4e36800640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e30077780 0x7f4e3019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.965+0000 7f4e36800640 1 --2- 172.21.15.110:0/3304681990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e30076e60 0x7f4e3019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.965+0000 7f4e36800640 1 -- 172.21.15.110:0/3304681990 >> 172.21.15.110:0/3304681990 conn(0x7f4e30100450 msgr2=0x7f4e30102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.965+0000 7f4e36800640 1 -- 172.21.15.110:0/3304681990 shutdown_connections 2024-04-26T11:42:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:42:51.965+0000 7f4e36800640 1 -- 172.21.15.110:0/3304681990 wait complete. 2024-04-26T11:42:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:51 smithi196 ceph-mon[32572]: pgmap v388: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-04-26T11:42:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:51 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:42:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:51 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:reconnect 2024-04-26T11:42:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:51 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:reconnect 2024-04-26T11:42:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:51 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:51 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179996 2024-04-26T11:42:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:51 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:42:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:51 smithi110 ceph-mon[28069]: pgmap v388: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-04-26T11:42:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:51 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:42:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:51 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:reconnect 2024-04-26T11:42:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:51 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:reconnect 2024-04-26T11:42:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:51 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:51 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179996 2024-04-26T11:42:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:51 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:42:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:51 smithi193 ceph-mon[32782]: pgmap v388: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-04-26T11:42:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:51 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:42:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:51 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:reconnect 2024-04-26T11:42:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:51 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:reconnect 2024-04-26T11:42:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:51 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=e=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:51 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179996 2024-04-26T11:42:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:51 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:42:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:52 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:rejoin 2024-04-26T11:42:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:52 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:rejoin 2024-04-26T11:42:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:52 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:52 smithi196 ceph-mon[32572]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:42:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:52 smithi196 ceph-mon[32572]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:42:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:52 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:rejoin 2024-04-26T11:42:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:52 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:rejoin 2024-04-26T11:42:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:52 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:52 smithi110 ceph-mon[28069]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:42:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:52 smithi110 ceph-mon[28069]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:42:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:52 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:rejoin 2024-04-26T11:42:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:52 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:rejoin 2024-04-26T11:42:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:52 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=e=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:52 smithi193 ceph-mon[32782]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:42:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:52 smithi193 ceph-mon[32782]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-26T11:42:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:53 smithi196 ceph-mon[32572]: pgmap v389: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 582 KiB/s wr, 77 op/s 2024-04-26T11:42:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:53 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:42:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:53 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:active 2024-04-26T11:42:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:53 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:active 2024-04-26T11:42:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:53 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:53 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T11:42:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:53 smithi110 ceph-mon[28069]: pgmap v389: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 582 KiB/s wr, 77 op/s 2024-04-26T11:42:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:53 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:42:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:53 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:active 2024-04-26T11:42:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:53 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:active 2024-04-26T11:42:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:53 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:53 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T11:42:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:53 smithi193 ceph-mon[32782]: pgmap v389: 97 pgs: 97 active+clean; 3.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 582 KiB/s wr, 77 op/s 2024-04-26T11:42:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:53 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:42:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:53 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/1791210121,v1:172.21.15.196:6833/1791210121] up:active 2024-04-26T11:42:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:53 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6834/32672289,v1:172.21.15.193:6835/32672289] up:active 2024-04-26T11:42:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:53 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T11:42:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:53 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T11:42:54.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 640.0 s, 1011.4 tps, lat 393.118 ms stddev 2505.537 2024-04-26T11:42:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:55 smithi196 ceph-mon[32572]: pgmap v390: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.6 MiB/s wr, 208 op/s 2024-04-26T11:42:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:55 smithi110 ceph-mon[28069]: pgmap v390: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.6 MiB/s wr, 208 op/s 2024-04-26T11:42:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:55 smithi193 ceph-mon[32782]: pgmap v390: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.6 MiB/s wr, 208 op/s 2024-04-26T11:42:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:57 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T11:42:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:56 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T11:42:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=e=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T11:42:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-mon[32572]: pgmap v391: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-04-26T11:42:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:42:58 smithi110 ceph-mon[28069]: pgmap v391: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-04-26T11:42:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-mon[32782]: pgmap v391: 97 pgs: 97 active+clean; 3.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 1.2 MiB/s wr, 147 op/s 2024-04-26T11:42:58.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc54c946700 time 2024-04-26T11:42:57.982238+0000 2024-04-26T11:42:58.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:58.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc556f6f3dd] 2024-04-26T11:42:58.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc556f6f5a3] 2024-04-26T11:42:58.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d5e4909822] 2024-04-26T11:42:58.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d5e4879598] 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5e487bc17] 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5e4774d0b] 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5e47752ac] 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d5e475dfad] 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc557203e20] 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 10: (DispatchQueue::entry()+0x51f) [0x7fc557200fdf] 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc5572d3fc1] 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc555ced1ca] 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 13: clone() 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: *** Caught signal (Aborted) ** 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: in thread 7fc54c946700 thread_name:ms_dispatch 2024-04-26T11:42:58.373 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:57.982+0000 7fc54c946700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc54c946700 time 2024-04-26T11:42:57.982238+0000 2024-04-26T11:42:58.374 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc556f6f3dd] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc556f6f5a3] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d5e4909822] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d5e4879598] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5e487bc17] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5e4774d0b] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5e47752ac] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d5e475dfad] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc557203e20] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 10: (DispatchQueue::entry()+0x51f) [0x7fc557200fdf] 2024-04-26T11:42:58.375 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc5572d3fc1] 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc555ced1ca] 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 13: clone() 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc555cf7d20] 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2: gsignal() 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 3: abort() 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc556f6f437] 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc556f6f5a3] 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d5e4909822] 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d5e4879598] 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5e487bc17] 2024-04-26T11:42:58.376 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5e4774d0b] 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5e47752ac] 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d5e475dfad] 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc557203e20] 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 13: (DispatchQueue::entry()+0x51f) [0x7fc557200fdf] 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc5572d3fc1] 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc555ced1ca] 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 16: clone() 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:57.984+0000 7fc54c946700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: in thread 7fc54c946700 thread_name:ms_dispatch 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.377 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc555cf7d20] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2: gsignal() 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 3: abort() 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc556f6f437] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc556f6f5a3] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d5e4909822] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d5e4879598] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5e487bc17] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5e4774d0b] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5e47752ac] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d5e475dfad] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc557203e20] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 13: (DispatchQueue::entry()+0x51f) [0x7fc557200fdf] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc5572d3fc1] 2024-04-26T11:42:58.378 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc555ced1ca] 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 16: clone() 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:57 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: -1> 2024-04-26T11:42:57.982+0000 7fc54c946700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc54c946700 time 2024-04-26T11:42:57.982238+0000 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc556f6f3dd] 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc556f6f5a3] 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d5e4909822] 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d5e4879598] 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5e487bc17] 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5e4774d0b] 2024-04-26T11:42:58.379 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5e47752ac] 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d5e475dfad] 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc557203e20] 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 10: (DispatchQueue::entry()+0x51f) [0x7fc557200fdf] 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc5572d3fc1] 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc555ced1ca] 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 13: clone() 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 0> 2024-04-26T11:42:57.984+0000 7fc54c946700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: in thread 7fc54c946700 thread_name:ms_dispatch 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc555cf7d20] 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2: gsignal() 2024-04-26T11:42:58.380 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 3: abort() 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc556f6f437] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc556f6f5a3] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d5e4909822] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d5e4879598] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5e487bc17] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5e4774d0b] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5e47752ac] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d5e475dfad] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc557203e20] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 13: (DispatchQueue::entry()+0x51f) [0x7fc557200fdf] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc5572d3fc1] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc555ced1ca] 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 16: clone() 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:58.381 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: -1> 2024-04-26T11:42:57.982+0000 7fc54c946700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc54c946700 time 2024-04-26T11:42:57.982238+0000 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc556f6f3dd] 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc556f6f5a3] 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d5e4909822] 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d5e4879598] 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5e487bc17] 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5e4774d0b] 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5e47752ac] 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d5e475dfad] 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc557203e20] 2024-04-26T11:42:58.382 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 10: (DispatchQueue::entry()+0x51f) [0x7fc557200fdf] 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc5572d3fc1] 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc555ced1ca] 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 13: clone() 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 0> 2024-04-26T11:42:57.984+0000 7fc54c946700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: in thread 7fc54c946700 thread_name:ms_dispatch 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc555cf7d20] 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2: gsignal() 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 3: abort() 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc556f6f437] 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc556f6f5a3] 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d5e4909822] 2024-04-26T11:42:58.383 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d5e4879598] 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d5e487bc17] 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d5e4774d0b] 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d5e47752ac] 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d5e475dfad] 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc557203e20] 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 13: (DispatchQueue::entry()+0x51f) [0x7fc557200fdf] 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc5572d3fc1] 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc555ced1ca] 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 16: clone() 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e[69215]: 2024-04-26T11:42:58.384 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 podman[69420]: 2024-04-26 11:42:58.068288023 +0000 UTC m=+0.042146818 container died ce600fa6e529c15d2317a364f66e6ee4e3468b5768eb8c1ab76c510fd03ab0e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb5d0351700 time 2024-04-26T11:42:58.365193+0000 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb5da97a3dd] 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb5da97a5a3] 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561581857822] 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5615817c7598] 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5615817c9c17] 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5615816c2d0b] 2024-04-26T11:42:58.686 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5615816c32ac] 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5615816abfad] 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb5dac0ee20] 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 10: (DispatchQueue::entry()+0x51f) [0x7fb5dac0bfdf] 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5dacdefc1] 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb5d96f81ca] 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 13: clone() 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.365+0000 7fb5d0351700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb5d0351700 time 2024-04-26T11:42:58.365193+0000 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb5da97a3dd] 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb5da97a5a3] 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561581857822] 2024-04-26T11:42:58.687 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5615817c7598] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5615817c9c17] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5615816c2d0b] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5615816c32ac] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5615816abfad] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb5dac0ee20] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 10: (DispatchQueue::entry()+0x51f) [0x7fb5dac0bfdf] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5dacdefc1] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb5d96f81ca] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 13: clone() 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: *** Caught signal (Aborted) ** 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: in thread 7fb5d0351700 thread_name:ms_dispatch 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb5d9702d20] 2024-04-26T11:42:58.688 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2: gsignal() 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 3: abort() 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb5da97a437] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb5da97a5a3] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561581857822] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5615817c7598] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5615817c9c17] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5615816c2d0b] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5615816c32ac] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5615816abfad] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb5dac0ee20] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 13: (DispatchQueue::entry()+0x51f) [0x7fb5dac0bfdf] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5dacdefc1] 2024-04-26T11:42:58.689 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb5d96f81ca] 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 16: clone() 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.367+0000 7fb5d0351700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: in thread 7fb5d0351700 thread_name:ms_dispatch 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb5d9702d20] 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2: gsignal() 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 3: abort() 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb5da97a437] 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb5da97a5a3] 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561581857822] 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5615817c7598] 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5615817c9c17] 2024-04-26T11:42:58.690 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5615816c2d0b] 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5615816c32ac] 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5615816abfad] 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb5dac0ee20] 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 13: (DispatchQueue::entry()+0x51f) [0x7fb5dac0bfdf] 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5dacdefc1] 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb5d96f81ca] 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 16: clone() 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: -1> 2024-04-26T11:42:58.365+0000 7fb5d0351700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb5d0351700 time 2024-04-26T11:42:58.365193+0000 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb5da97a3dd] 2024-04-26T11:42:58.691 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb5da97a5a3] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561581857822] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5615817c7598] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5615817c9c17] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5615816c2d0b] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5615816c32ac] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5615816abfad] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb5dac0ee20] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 10: (DispatchQueue::entry()+0x51f) [0x7fb5dac0bfdf] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5dacdefc1] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb5d96f81ca] 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 13: clone() 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 0> 2024-04-26T11:42:58.367+0000 7fb5d0351700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: in thread 7fb5d0351700 thread_name:ms_dispatch 2024-04-26T11:42:58.692 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb5d9702d20] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2: gsignal() 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 3: abort() 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb5da97a437] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb5da97a5a3] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561581857822] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5615817c7598] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5615817c9c17] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5615816c2d0b] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5615816c32ac] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5615816abfad] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb5dac0ee20] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 13: (DispatchQueue::entry()+0x51f) [0x7fb5dac0bfdf] 2024-04-26T11:42:58.693 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5dacdefc1] 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb5d96f81ca] 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 16: clone() 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: -1> 2024-04-26T11:42:58.365+0000 7fb5d0351700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb5d0351700 time 2024-04-26T11:42:58.365193+0000 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb5da97a3dd] 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb5da97a5a3] 2024-04-26T11:42:58.694 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561581857822] 2024-04-26T11:42:58.695 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5615817c7598] 2024-04-26T11:42:58.695 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5615817c9c17] 2024-04-26T11:42:58.695 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5615816c2d0b] 2024-04-26T11:42:58.695 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5615816c32ac] 2024-04-26T11:42:58.695 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5615816abfad] 2024-04-26T11:42:58.695 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb5dac0ee20] 2024-04-26T11:42:58.695 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 10: (DispatchQueue::entry()+0x51f) [0x7fb5dac0bfdf] 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5dacdefc1] 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb5d96f81ca] 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 13: clone() 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 0> 2024-04-26T11:42:58.367+0000 7fb5d0351700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: in thread 7fb5d0351700 thread_name:ms_dispatch 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb5d9702d20] 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2: gsignal() 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 3: abort() 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb5da97a437] 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb5da97a5a3] 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561581857822] 2024-04-26T11:42:58.696 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5615817c7598] 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5615817c9c17] 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5615816c2d0b] 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5615816c32ac] 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5615816abfad] 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb5dac0ee20] 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 13: (DispatchQueue::entry()+0x51f) [0x7fb5dac0bfdf] 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb5dacdefc1] 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb5d96f81ca] 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 16: clone() 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71174]: 2024-04-26T11:42:58.697 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:58 smithi196 podman[71391]: 2024-04-26 11:42:58.426125499 +0000 UTC m=+0.019632472 container died 632b6e6a56e6963d931c5eb9003c73e7e050d1af6703d0b09d54aff07aa55d28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:42:58.985 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 podman[69420]: 2024-04-26 11:42:58.700935406 +0000 UTC m=+0.674794230 container remove ce600fa6e529c15d2317a364f66e6ee4e3468b5768eb8c1ab76c510fd03ab0e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:42:58.985 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:42:59.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-04-26T11:42:59.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:42:58 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Consumed 1.200s CPU time. 2024-04-26T11:42:59.420 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:59 smithi196 podman[71391]: 2024-04-26 11:42:59.149063144 +0000 UTC m=+0.742570116 container remove 632b6e6a56e6963d931c5eb9003c73e7e050d1af6703d0b09d54aff07aa55d28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:42:59.420 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:59 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:42:59.755 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:42:59 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T11:42:59.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 645.0 s, 2020.1 tps, lat 41.834 ms stddev 49.418 2024-04-26T11:43:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:00 smithi110 ceph-mon[28069]: pgmap v392: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 9.8 MiB/s wr, 455 op/s 2024-04-26T11:43:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:00 smithi193 ceph-mon[32782]: pgmap v392: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 9.8 MiB/s wr, 455 op/s 2024-04-26T11:43:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:00 smithi196 ceph-mon[32572]: pgmap v392: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 9.8 MiB/s wr, 455 op/s 2024-04-26T11:43:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:02 smithi110 ceph-mon[28069]: pgmap v393: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 8.5 MiB/s wr, 392 op/s 2024-04-26T11:43:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:02 smithi193 ceph-mon[32782]: pgmap v393: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 8.5 MiB/s wr, 392 op/s 2024-04-26T11:43:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:02 smithi196 ceph-mon[32572]: pgmap v393: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 8.5 MiB/s wr, 392 op/s 2024-04-26T11:43:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:04 smithi110 ceph-mon[28069]: pgmap v394: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 8.2 MiB/s wr, 375 op/s 2024-04-26T11:43:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:04 smithi193 ceph-mon[32782]: pgmap v394: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 8.2 MiB/s wr, 375 op/s 2024-04-26T11:43:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:04 smithi196 ceph-mon[32572]: pgmap v394: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 8.2 MiB/s wr, 375 op/s 2024-04-26T11:43:04.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:43:05.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.108+0000 7faebb200640 1 -- 172.21.15.110:0/3668467731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc108e70 msgr2=0x7faebc1092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:05.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.108+0000 7faebb200640 1 --2- 172.21.15.110:0/3668467731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc108e70 0x7faebc1092b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faea4009930 tx=0x7faea402a420 comp rx=0 tx=0).stop 2024-04-26T11:43:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.108+0000 7faebb200640 1 -- 172.21.15.110:0/3668467731 shutdown_connections 2024-04-26T11:43:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.108+0000 7faebb200640 1 --2- 172.21.15.110:0/3668467731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faebc1097f0 0x7faebc115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.108+0000 7faebb200640 1 --2- 172.21.15.110:0/3668467731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc108e70 0x7faebc1092b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.108+0000 7faebb200640 1 --2- 172.21.15.110:0/3668467731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faebc10ee00 0x7faebc10f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.108+0000 7faebb200640 1 -- 172.21.15.110:0/3668467731 >> 172.21.15.110:0/3668467731 conn(0x7faebc078710 msgr2=0x7faebc107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.108+0000 7faebb200640 1 -- 172.21.15.110:0/3668467731 shutdown_connections 2024-04-26T11:43:05.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.108+0000 7faebb200640 1 -- 172.21.15.110:0/3668467731 wait complete. 2024-04-26T11:43:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.109+0000 7faebb200640 1 Processor -- start 2024-04-26T11:43:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.109+0000 7faebb200640 1 -- start start 2024-04-26T11:43:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faebb200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faebc108e70 0x7faebc19f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faebb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc1097f0 0x7faebc19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faebb200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faebc10ee00 0x7faebc1a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faebb200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faebc118fd0 con 0x7faebc1097f0 2024-04-26T11:43:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faebb200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faebc118e50 con 0x7faebc10ee00 2024-04-26T11:43:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faebb200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faebc119150 con 0x7faebc108e70 2024-04-26T11:43:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faeb3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc1097f0 0x7faebc19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faeb3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc1097f0 0x7faebc19fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47222/0 (socket says 172.21.15.110:47222) 2024-04-26T11:43:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faeb3e00640 1 -- 172.21.15.110:0/3243253608 learned_addr learned my addr 172.21.15.110:0/3243253608 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faeba800640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faebc10ee00 0x7faebc1a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.113 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.110+0000 7faeb9e00640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faebc108e70 0x7faebc19f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeb3e00640 1 -- 172.21.15.110:0/3243253608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faebc108e70 msgr2=0x7faebc19f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeb3e00640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faebc108e70 0x7faebc19f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeb3e00640 1 -- 172.21.15.110:0/3243253608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faebc10ee00 msgr2=0x7faebc1a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeb3e00640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faebc10ee00 0x7faebc1a3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeb3e00640 1 -- 172.21.15.110:0/3243253608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc1a4520 con 0x7faebc1097f0 2024-04-26T11:43:05.114 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeba800640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faebc10ee00 0x7faebc1a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:43:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeb3e00640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc1097f0 0x7faebc19fa70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faea4005940 tx=0x7faea40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeb2a00640 1 -- 172.21.15.110:0/3243253608 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea403f030 con 0x7faebc1097f0 2024-04-26T11:43:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeb2a00640 1 -- 172.21.15.110:0/3243253608 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea40044c0 con 0x7faebc1097f0 2024-04-26T11:43:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faebb200640 1 -- 172.21.15.110:0/3243253608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faebc1a47b0 con 0x7faebc1097f0 2024-04-26T11:43:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.111+0000 7faeb2a00640 1 -- 172.21.15.110:0/3243253608 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4035070 con 0x7faebc1097f0 2024-04-26T11:43:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.112+0000 7faebb200640 1 -- 172.21.15.110:0/3243253608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faebc1ac0a0 con 0x7faebc1097f0 2024-04-26T11:43:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.115+0000 7faeb2a00640 1 -- 172.21.15.110:0/3243253608 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7faea4042030 con 0x7faebc1097f0 2024-04-26T11:43:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.115+0000 7faec3c7d740 1 Processor -- start 2024-04-26T11:43:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.115+0000 7faec3c7d740 1 -- start start 2024-04-26T11:43:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x5596930413c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x55969304bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x55969304e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faec3c7d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559692fa6380 con 0x559693041900 2024-04-26T11:43:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faec3c7d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559692f42c30 con 0x55969304c1c0 2024-04-26T11:43:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faec3c7d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559692fa2340 con 0x559693040fe0 2024-04-26T11:43:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeba800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x5596930413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeb9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x55969304bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeba800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x5596930413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:36380/0 (socket says 172.21.15.110:36380) 2024-04-26T11:43:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeba800640 1 -- 172.21.15.110:0/320870231 learned_addr learned my addr 172.21.15.110:0/320870231 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeb3e00640 1 --2- 172.21.15.110:0/320870231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x55969304e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeba800640 1 -- 172.21.15.110:0/320870231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 msgr2=0x55969304e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeba800640 1 --2- 172.21.15.110:0/320870231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x55969304e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeba800640 1 -- 172.21.15.110:0/320870231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 msgr2=0x55969304bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeba800640 1 --2- 172.21.15.110:0/320870231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x55969304bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.116+0000 7faeba800640 1 -- 172.21.15.110:0/320870231 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559692f64940 con 0x559693040fe0 2024-04-26T11:43:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.117+0000 7faeb2a00640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d10 0x7fae9c0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.125 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.117+0000 7faeba800640 1 --2- 172.21.15.110:0/320870231 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x5596930413c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faeb40117e0 tx=0x7faeb4011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f36139a39a9d1f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.117+0000 7faeb2a00640 1 -- 172.21.15.110:0/3243253608 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 10965+0+0 (secure 0 0 0) 0x7faea40f1510 con 0x7faebc1097f0 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.117+0000 7faeab400640 1 -- 172.21.15.110:0/320870231 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4011310 con 0x559693040fe0 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.117+0000 7faeb9e00640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d10 0x7fae9c0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.117+0000 7faeab400640 1 -- 172.21.15.110:0/320870231 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faeb4003e20 con 0x559693040fe0 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.117+0000 7faeab400640 1 -- 172.21.15.110:0/320870231 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb40044f0 con 0x559693040fe0 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faeb9e00640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d10 0x7fae9c0a61d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x559693042580 tx=0x7faeac005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faec3c7d740 1 -- 172.21.15.110:0/320870231 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 msgr2=0x5596930413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faec3c7d740 1 --2- 172.21.15.110:0/320870231 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x5596930413c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faeb40117e0 tx=0x7faeb4011ca0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faec3c7d740 1 -- 172.21.15.110:0/320870231 shutdown_connections 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faec3c7d740 1 --2- 172.21.15.110:0/320870231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x55969304e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faec3c7d740 1 --2- 172.21.15.110:0/320870231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x55969304bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faec3c7d740 1 --2- 172.21.15.110:0/320870231 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x5596930413c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faec3c7d740 1 -- 172.21.15.110:0/320870231 >> 172.21.15.110:0/320870231 conn(0x55969303d4f0 msgr2=0x55969303d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faec3c7d740 1 -- 172.21.15.110:0/320870231 shutdown_connections 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.118+0000 7faec3c7d740 1 -- 172.21.15.110:0/320870231 wait complete. 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.119+0000 7faec3c7d740 1 -- start start 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.119+0000 7faec3c7d740 1 Processor -- start 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.119+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693040fe0 0x559693049140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.119+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693041900 0x559693049680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.119+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x559693049bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.119+0000 7faec3c7d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55969304edf0 con 0x559693040fe0 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.119+0000 7faec3c7d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559692f2dc60 con 0x55969304c1c0 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.119+0000 7faec3c7d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55969304ef70 con 0x559693041900 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.119+0000 7faec3c7d740 10 client.0 _ll_register_callbacks cb 0x559692f59e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:43:05.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693041900 0x559693049680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693040fe0 0x559693049140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693041900 0x559693049680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:36386/0 (socket says 172.21.15.110:36386) 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb3e00640 1 -- 172.21.15.110:0/2122384902 learned_addr learned my addr 172.21.15.110:0/2122384902 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeba800640 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x559693049bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb3e00640 1 -- 172.21.15.110:0/2122384902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 msgr2=0x559693049bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb3e00640 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x559693049bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb3e00640 1 -- 172.21.15.110:0/2122384902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693040fe0 msgr2=0x559693049140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb3e00640 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693040fe0 0x559693049140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb3e00640 1 -- 172.21.15.110:0/2122384902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559692f3c510 con 0x559693041900 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb9e00640 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693040fe0 0x559693049140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faeb3e00640 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693041900 0x559693049680 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faea4009900 tx=0x7faea40b8e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cda554fc8c4b29eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.120+0000 7faea3e00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:43:05.128 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faea3e00640 1 -- 172.21.15.110:0/2122384902 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4049050 con 0x559693041900 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faea3e00640 1 -- 172.21.15.110:0/2122384902 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 10965+0+0 (secure 0 0 0) 0x7faea40b91e0 con 0x559693041900 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faec3c7d740 1 -- 172.21.15.110:0/2122384902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faeb4003e20 con 0x559693041900 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faea3e00640 1 -- 172.21.15.110:0/2122384902 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=185) ==== 24+0+0 (secure 0 0 0) 0x7faea40bc4d0 con 0x559693041900 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faec3c7d740 10 client.26290 fetch_fsmap learned FSMap version 185 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faec3c7d740 1 -- 172.21.15.110:0/2122384902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=185,monmap=4+}) -- 0x559692cb8210 con 0x559693041900 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faea3e00640 1 -- 172.21.15.110:0/2122384902 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faeb4003e20 con 0x559693041900 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faea3e00640 1 -- 172.21.15.110:0/2122384902 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 185) ==== 6531+0+0 (secure 0 0 0) 0x7faea40ee4f0 con 0x559693041900 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faec3c7d740 10 client.26290 fetch_fsmap finished waiting for FSMap version 185 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faec3c7d740 10 client.26290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faec3c7d740 20 client.26290 populate_metadata read hostname 'smithi110' 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.121+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55969305be90 0x55969305e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.122+0000 7faec3c7d740 4 client.26290 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.122+0000 7faec3c7d740 1 -- 172.21.15.110:0/2122384902 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559692fb3f90 con 0x55969305be90 2024-04-26T11:43:05.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.122+0000 7faeb9e00640 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55969305be90 0x55969305e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.122+0000 7faeb9e00640 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55969305be90 0x55969305e2c0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=195eb774cd42427f server_cookie=390d7379dffb8d16 in_seq=0 out_seq=0 2024-04-26T11:43:05.130 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.122+0000 7faea3e00640 10 client.26290 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:05.131 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.123+0000 7faea3e00640 1 -- 172.21.15.110:0/2122384902 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559692fb3f90 con 0x55969305be90 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.123+0000 7faea3e00640 10 client.26290 handle_command_reply: tid=0 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 client.26290 shutdown 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 -- 172.21.15.110:0/2122384902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693041900 msgr2=0x559693049680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693041900 0x559693049680 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faea4009900 tx=0x7faea40b8e10 comp rx=0 tx=0).stop 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 -- 172.21.15.110:0/2122384902 shutdown_connections 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x559693049bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55969305be90 0x55969305e2c0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693041900 0x559693049680 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2122384902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693040fe0 0x559693049140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faea3e00640 0 client.26290 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 -- 172.21.15.110:0/2122384902 >> 172.21.15.110:0/2122384902 conn(0x55969303d4f0 msgr2=0x559693043270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 -- 172.21.15.110:0/2122384902 shutdown_connections 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 1 -- 172.21.15.110:0/2122384902 wait complete. 2024-04-26T11:43:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.124+0000 7faec3c7d740 20 client.26290 trim_cache size 0 max 16384 2024-04-26T11:43:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faec3c7d740 1 Processor -- start 2024-04-26T11:43:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faec3c7d740 1 -- start start 2024-04-26T11:43:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559693040fe0 0x559693057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x5596930439f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55969304c1c0 0x559693063bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faec3c7d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faebc1b7c80 con 0x559693041900 2024-04-26T11:43:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faec3c7d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faebc1b67b0 con 0x559693040fe0 2024-04-26T11:43:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faec3c7d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faebc1b6e80 con 0x55969304c1c0 2024-04-26T11:43:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faeb3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x5596930439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faeb3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x5596930439f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47256/0 (socket says 172.21.15.110:47256) 2024-04-26T11:43:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faeb3e00640 1 -- 172.21.15.110:0/2499568088 learned_addr learned my addr 172.21.15.110:0/2499568088 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.141+0000 7faeb9e00640 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559693040fe0 0x559693057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeba800640 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55969304c1c0 0x559693063bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeb3e00640 1 -- 172.21.15.110:0/2499568088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55969304c1c0 msgr2=0x559693063bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeb3e00640 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55969304c1c0 0x559693063bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeb3e00640 1 -- 172.21.15.110:0/2499568088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559693040fe0 msgr2=0x559693057cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeb3e00640 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559693040fe0 0x559693057cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeb3e00640 1 -- 172.21.15.110:0/2499568088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559692d84620 con 0x559693041900 2024-04-26T11:43:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeba800640 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55969304c1c0 0x559693063bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:43:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeb9e00640 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559693040fe0 0x559693057cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:43:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeb3e00640 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x5596930439f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faea40b9540 tx=0x7faea403b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bbcf337754ad2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.142+0000 7faeaaa00640 1 -- 172.21.15.110:0/2499568088 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4049070 con 0x559693041900 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faeaaa00640 1 -- 172.21.15.110:0/2499568088 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea40c0e70 con 0x559693041900 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faeaaa00640 1 -- 172.21.15.110:0/2499568088 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea40ee4f0 con 0x559693041900 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faec3c7d740 1 -- 172.21.15.110:0/2499568088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 msgr2=0x5596930439f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x5596930439f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faea40b9540 tx=0x7faea403b4f0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faec3c7d740 1 -- 172.21.15.110:0/2499568088 shutdown_connections 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55969304c1c0 0x559693063bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x5596930439f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faec3c7d740 1 --2- 172.21.15.110:0/2499568088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559693040fe0 0x559693057cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faec3c7d740 1 -- 172.21.15.110:0/2499568088 >> 172.21.15.110:0/2499568088 conn(0x55969303d4f0 msgr2=0x55969304b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faec3c7d740 1 -- 172.21.15.110:0/2499568088 shutdown_connections 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.143+0000 7faec3c7d740 1 -- 172.21.15.110:0/2499568088 wait complete. 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.144+0000 7faec3c7d740 1 -- start start 2024-04-26T11:43:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.144+0000 7faec3c7d740 1 Processor -- start 2024-04-26T11:43:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x559693045ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x559693046420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faec3c7d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x559693046960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faec3c7d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faebc1b4ee0 con 0x559693041900 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faec3c7d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faebc1b7580 con 0x55969304c1c0 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faec3c7d740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faebc1b41a0 con 0x559693040fe0 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faec3c7d740 10 client.0 _ll_register_callbacks cb 0x7faea40f4cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeb9e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x559693045ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeb9e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x559693045ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:36398/0 (socket says 172.21.15.110:36398) 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeb9e00640 1 -- 172.21.15.110:0/1939582875 learned_addr learned my addr 172.21.15.110:0/1939582875 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeba800640 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x559693046960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeb3e00640 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x559693046420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeba800640 1 -- 172.21.15.110:0/1939582875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 msgr2=0x559693045ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeba800640 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x559693045ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeba800640 1 -- 172.21.15.110:0/1939582875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 msgr2=0x559693046420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeba800640 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x559693046420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.145+0000 7faeba800640 1 -- 172.21.15.110:0/1939582875 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559692f60cb0 con 0x55969304c1c0 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.146+0000 7faeb3e00640 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x559693046420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.146+0000 7faeba800640 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x559693046960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faeb4006010 tx=0x7faeb400fbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2c6d564ecaf22c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.146+0000 7faea3e00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.146+0000 7faea3e00640 1 -- 172.21.15.110:0/1939582875 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb402d060 con 0x55969304c1c0 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.146+0000 7faec3c7d740 1 -- 172.21.15.110:0/1939582875 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faea40c0e70 con 0x55969304c1c0 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.146+0000 7faea3e00640 1 -- 172.21.15.110:0/1939582875 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 10965+0+0 (secure 0 0 0) 0x7faeb400fdc0 con 0x55969304c1c0 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.146+0000 7faea3e00640 1 -- 172.21.15.110:0/1939582875 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=185) ==== 24+0+0 (secure 0 0 0) 0x7faeb4003970 con 0x55969304c1c0 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.146+0000 7faec3c7d740 10 client.26246 fetch_fsmap learned FSMap version 185 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.146+0000 7faec3c7d740 1 -- 172.21.15.110:0/1939582875 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=185,monmap=4+}) -- 0x5596930c2670 con 0x55969304c1c0 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.147+0000 7faea3e00640 1 -- 172.21.15.110:0/1939582875 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea40c0e70 con 0x55969304c1c0 2024-04-26T11:43:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.147+0000 7faea3e00640 1 -- 172.21.15.110:0/1939582875 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 185) ==== 6531+0+0 (secure 0 0 0) 0x7faeb4018020 con 0x55969304c1c0 2024-04-26T11:43:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.147+0000 7faec3c7d740 10 client.26246 fetch_fsmap finished waiting for FSMap version 185 2024-04-26T11:43:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.147+0000 7faec3c7d740 10 client.26246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:43:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.147+0000 7faec3c7d740 20 client.26246 populate_metadata read hostname 'smithi110' 2024-04-26T11:43:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.147+0000 7faec3c7d740 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5596930c2d30 0x5596930c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.147+0000 7faec3c7d740 4 client.26246 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:43:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.147+0000 7faec3c7d740 1 -- 172.21.15.110:0/1939582875 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559692fade00 con 0x5596930c2d30 2024-04-26T11:43:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.147+0000 7faeb9e00640 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5596930c2d30 0x5596930c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.148+0000 7faeb9e00640 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5596930c2d30 0x5596930c5150 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cb665db42da3a0f server_cookie=3e067c23bf671154 in_seq=0 out_seq=0 2024-04-26T11:43:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:05.148+0000 7faea3e00640 10 client.26246 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:06 smithi110 ceph-mon[28069]: pgmap v395: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 11 MiB/s wr, 535 op/s 2024-04-26T11:43:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:06 smithi193 ceph-mon[32782]: pgmap v395: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 11 MiB/s wr, 535 op/s 2024-04-26T11:43:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:06 smithi196 ceph-mon[32572]: pgmap v395: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 11 MiB/s wr, 535 op/s 2024-04-26T11:43:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:08 smithi110 ceph-mon[28069]: pgmap v396: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 10 MiB/s wr, 451 op/s 2024-04-26T11:43:08.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:08 smithi193 ceph-mon[32782]: pgmap v396: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 10 MiB/s wr, 451 op/s 2024-04-26T11:43:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:08 smithi196 ceph-mon[32572]: pgmap v396: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 10 MiB/s wr, 451 op/s 2024-04-26T11:43:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:09 smithi193 ceph-mon[32782]: pgmap v397: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 10 MiB/s wr, 499 op/s 2024-04-26T11:43:09.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:43:09 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 6. 2024-04-26T11:43:09.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:43:09 smithi193 systemd[1]: Stopped Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:09.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:43:09 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Consumed 1.200s CPU time. 2024-04-26T11:43:09.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:43:09 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Start request repeated too quickly. 2024-04-26T11:43:09.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:43:09 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-04-26T11:43:09.372 INFO:journalctl@ceph.mds.e.smithi193.stdout:Apr 26 11:43:09 smithi193 systemd[1]: Failed to start Ceph mds.e for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:09 smithi196 ceph-mon[32572]: pgmap v397: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 10 MiB/s wr, 499 op/s 2024-04-26T11:43:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:09 smithi110 ceph-mon[28069]: pgmap v397: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 10 MiB/s wr, 499 op/s 2024-04-26T11:43:09.863 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:09 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:43:09.863 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:09 smithi196 systemd[1]: Stopped Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:09.863 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:09 smithi196 systemd[1]: Starting Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:43:09.863 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:09 smithi196 podman[71487]: 2024-04-26 11:43:09.641869669 +0000 UTC m=+0.017549775 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:43:09.863 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:09 smithi196 podman[71487]: 2024-04-26 11:43:09.740749106 +0000 UTC m=+0.116429212 container create 89451a4af310ebb63ce4108045d2239420d74335bcfdf4c1ec54ca408863350d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:43:09.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:43:10.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:09 smithi196 podman[71487]: 2024-04-26 11:43:09.985322743 +0000 UTC m=+0.361002853 container init 89451a4af310ebb63ce4108045d2239420d74335bcfdf4c1ec54ca408863350d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:43:10.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:09 smithi196 podman[71487]: 2024-04-26 11:43:09.988428462 +0000 UTC m=+0.364108571 container start 89451a4af310ebb63ce4108045d2239420d74335bcfdf4c1ec54ca408863350d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-26T11:43:10.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-mds[71507]: -- 172.21.15.196:0/3696779768 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fb9965da40 con 0x55fb99631000 2024-04-26T11:43:10.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: starting mds.l at 2024-04-26T11:43:10.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:10 smithi196 bash[71487]: 89451a4af310ebb63ce4108045d2239420d74335bcfdf4c1ec54ca408863350d 2024-04-26T11:43:10.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:10 smithi196 systemd[1]: Started Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:10.140 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-mon[32572]: daemon mds.l restarted 2024-04-26T11:43:10.140 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:43:10.140 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-mon[32572]: osdmap e132: 12 total, 12 up, 12 in 2024-04-26T11:43:10.140 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:boot 2024-04-26T11:43:10.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-mon[32572]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T11:43:10.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:43:10.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:43:10.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:10 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-04-26T11:43:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:10 smithi193 ceph-mon[32782]: daemon mds.l restarted 2024-04-26T11:43:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:10 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:43:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:10 smithi193 ceph-mon[32782]: osdmap e132: 12 total, 12 up, 12 in 2024-04-26T11:43:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:10 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:boot 2024-04-26T11:43:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:10 smithi193 ceph-mon[32782]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T11:43:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:10 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:43:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:43:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:10 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-04-26T11:43:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:10 smithi110 ceph-mon[28069]: daemon mds.l restarted 2024-04-26T11:43:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:10 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:43:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:10 smithi110 ceph-mon[28069]: osdmap e132: 12 total, 12 up, 12 in 2024-04-26T11:43:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:10 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:boot 2024-04-26T11:43:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:10 smithi110 ceph-mon[28069]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T11:43:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:10 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=e=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:43:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:43:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:10 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-04-26T11:43:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:11 smithi193 ceph-mon[32782]: pgmap v399: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.5 MiB/s wr, 249 op/s 2024-04-26T11:43:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:11 smithi196 ceph-mon[32572]: pgmap v399: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.5 MiB/s wr, 249 op/s 2024-04-26T11:43:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:11 smithi110 ceph-mon[28069]: pgmap v399: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.5 MiB/s wr, 249 op/s 2024-04-26T11:43:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:12 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:resolve 2024-04-26T11:43:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:12 smithi193 ceph-mon[32782]: Replacing daemon mds.e as rank 2 with standby daemon mds.j 2024-04-26T11:43:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:12 smithi193 ceph-mon[32782]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-04-26T11:43:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:12 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-04-26T11:43:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:12 smithi193 ceph-mon[32782]: osdmap e133: 12 total, 12 up, 12 in 2024-04-26T11:43:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:12 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=j=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:12 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:resolve 2024-04-26T11:43:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:12 smithi196 ceph-mon[32572]: Replacing daemon mds.e as rank 2 with standby daemon mds.j 2024-04-26T11:43:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:12 smithi196 ceph-mon[32572]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-04-26T11:43:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:12 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-04-26T11:43:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:12 smithi196 ceph-mon[32572]: osdmap e133: 12 total, 12 up, 12 in 2024-04-26T11:43:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:12 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=j=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:12 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:resolve 2024-04-26T11:43:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:12 smithi110 ceph-mon[28069]: Replacing daemon mds.e as rank 2 with standby daemon mds.j 2024-04-26T11:43:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:12 smithi110 ceph-mon[28069]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-04-26T11:43:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:12 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=e=up:active} 2 up:standby-replay 4 up:standby 2024-04-26T11:43:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:12 smithi110 ceph-mon[28069]: osdmap e133: 12 total, 12 up, 12 in 2024-04-26T11:43:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:12 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=j=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:13 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:resolve 2024-04-26T11:43:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:13 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=j=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:13 smithi193 ceph-mon[32782]: pgmap v401: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 564 KiB/s wr, 71 op/s 2024-04-26T11:43:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:13 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:resolve 2024-04-26T11:43:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:13 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=j=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:13 smithi196 ceph-mon[32572]: pgmap v401: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 564 KiB/s wr, 71 op/s 2024-04-26T11:43:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:13 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:resolve 2024-04-26T11:43:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:13 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=j=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:13 smithi110 ceph-mon[28069]: pgmap v401: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 564 KiB/s wr, 71 op/s 2024-04-26T11:43:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.140+0000 7faea3e00640 1 -- 172.21.15.110:0/1939582875 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559692fade00 con 0x5596930c2d30 2024-04-26T11:43:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.140+0000 7faea3e00640 10 client.26246 handle_command_reply: tid=0 2024-04-26T11:43:14.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.140+0000 7faec3c7d740 1 client.26246 shutdown 2024-04-26T11:43:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.140+0000 7faec3c7d740 1 -- 172.21.15.110:0/1939582875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 msgr2=0x559693046960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.140+0000 7faec3c7d740 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x559693046960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faeb4006010 tx=0x7faeb400fbd0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.141+0000 7faec3c7d740 1 -- 172.21.15.110:0/1939582875 shutdown_connections 2024-04-26T11:43:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.141+0000 7faec3c7d740 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55969304c1c0 0x559693046960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.141+0000 7faec3c7d740 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559693041900 0x559693046420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.141+0000 7faec3c7d740 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5596930c2d30 0x5596930c5150 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.141+0000 7faec3c7d740 1 --2- 172.21.15.110:0/1939582875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559693040fe0 0x559693045ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.141+0000 7faec3c7d740 1 -- 172.21.15.110:0/1939582875 >> 172.21.15.110:0/1939582875 conn(0x55969303d4f0 msgr2=0x55969304a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:14.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.141+0000 7faea3e00640 0 client.26246 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:14.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.142+0000 7faec3c7d740 1 -- 172.21.15.110:0/1939582875 shutdown_connections 2024-04-26T11:43:14.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.142+0000 7faec3c7d740 1 -- 172.21.15.110:0/1939582875 wait complete. 2024-04-26T11:43:14.143 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.142+0000 7faec3c7d740 20 client.26246 trim_cache size 0 max 16384 2024-04-26T11:43:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:43:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:43:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:43:14.144 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:43:14.145 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 -- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d10 msgr2=0x7fae9c0a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d10 0x7fae9c0a61d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x559693042580 tx=0x7faeac005f90 comp rx=0 tx=0).stop 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 -- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc1097f0 msgr2=0x7faebc19fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc1097f0 0x7faebc19fa70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faea4005940 tx=0x7faea40040c0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 -- 172.21.15.110:0/3243253608 shutdown_connections 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d10 0x7fae9c0a61d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faebc10ee00 0x7faebc1a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faebc1097f0 0x7faebc19fa70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 --2- 172.21.15.110:0/3243253608 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faebc108e70 0x7faebc19f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 -- 172.21.15.110:0/3243253608 >> 172.21.15.110:0/3243253608 conn(0x7faebc078710 msgr2=0x7faebc079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 -- 172.21.15.110:0/3243253608 shutdown_connections 2024-04-26T11:43:14.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:14.144+0000 7faebb200640 1 -- 172.21.15.110:0/3243253608 wait complete. 2024-04-26T11:43:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:14 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:reconnect 2024-04-26T11:43:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:14 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:reconnect 2024-04-26T11:43:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:14 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:14 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.0179997 2024-04-26T11:43:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:14 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179997 2024-04-26T11:43:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:14 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:43:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:14 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:reconnect 2024-04-26T11:43:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:14 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:reconnect 2024-04-26T11:43:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:14 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:14 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.0179997 2024-04-26T11:43:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:14 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179997 2024-04-26T11:43:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:14 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:43:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:14 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:reconnect 2024-04-26T11:43:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:14 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:reconnect 2024-04-26T11:43:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:14 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:14 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.0179997 2024-04-26T11:43:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:14 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179997 2024-04-26T11:43:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:14 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:43:14.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:43:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:15 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:rejoin 2024-04-26T11:43:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:15 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:rejoin 2024-04-26T11:43:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:15 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:15 smithi196 ceph-mon[32572]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T11:43:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:15 smithi196 ceph-mon[32572]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T11:43:15.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:15 smithi196 ceph-mon[32572]: pgmap v402: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.0 MiB/s wr, 137 op/s 2024-04-26T11:43:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:15 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:rejoin 2024-04-26T11:43:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:15 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:rejoin 2024-04-26T11:43:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:15 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:15 smithi110 ceph-mon[28069]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T11:43:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:15 smithi110 ceph-mon[28069]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T11:43:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:15 smithi110 ceph-mon[28069]: pgmap v402: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.0 MiB/s wr, 137 op/s 2024-04-26T11:43:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:15 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:rejoin 2024-04-26T11:43:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:15 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:rejoin 2024-04-26T11:43:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:15 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:15 smithi193 ceph-mon[32782]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T11:43:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:15 smithi193 ceph-mon[32782]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T11:43:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:15 smithi193 ceph-mon[32782]: pgmap v402: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.0 MiB/s wr, 137 op/s 2024-04-26T11:43:16.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:16 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:43:16.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:16 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:active 2024-04-26T11:43:16.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:16 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:active 2024-04-26T11:43:16.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:16 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:16.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:16 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:16 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:43:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:16 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:active 2024-04-26T11:43:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:16 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:active 2024-04-26T11:43:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:16 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:16 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:16 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:43:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:16 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1015216555,v1:172.21.15.193:6833/1015216555] up:active 2024-04-26T11:43:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:16 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/545060975,v1:172.21.15.110:6835/545060975] up:active 2024-04-26T11:43:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:16 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:16 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:17.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:17 smithi110 ceph-mon[28069]: pgmap v403: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 492 KiB/s wr, 65 op/s 2024-04-26T11:43:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:17 smithi196 ceph-mon[32572]: pgmap v403: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 492 KiB/s wr, 65 op/s 2024-04-26T11:43:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:17 smithi193 ceph-mon[32782]: pgmap v403: 97 pgs: 97 active+clean; 3.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 492 KiB/s wr, 65 op/s 2024-04-26T11:43:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:18 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:18 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:18 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:19 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:19 smithi196 ceph-mon[32572]: pgmap v404: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 17 MiB/s wr, 1.51k op/s 2024-04-26T11:43:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:19 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:19 smithi110 ceph-mon[28069]: pgmap v404: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 17 MiB/s wr, 1.51k op/s 2024-04-26T11:43:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:19 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=j=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:19 smithi193 ceph-mon[32782]: pgmap v404: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 17 MiB/s wr, 1.51k op/s 2024-04-26T11:43:19.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 665.0 s, 1715.0 tps, lat 242.568 ms stddev 1730.688 2024-04-26T11:43:20.519 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fccb0000700 time 2024-04-26T11:43:20.160753+0000 2024-04-26T11:43:20.519 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:20.519 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.519 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fccbb83e3dd] 2024-04-26T11:43:20.519 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fccbb83e5a3] 2024-04-26T11:43:20.519 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d0401be822] 2024-04-26T11:43:20.519 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d04012e598] 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d040130c17] 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d040029d0b] 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d04002a2ac] 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d040012fad] 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fccbbad2e20] 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 10: (DispatchQueue::entry()+0x51f) [0x7fccbbacffdf] 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fccbbba2fc1] 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fccba5bc1ca] 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 13: clone() 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: *** Caught signal (Aborted) ** 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: in thread 7fccb0000700 thread_name:ms_dispatch 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.161+0000 7fccb0000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fccb0000700 time 2024-04-26T11:43:20.160753+0000 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:20.520 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fccbb83e3dd] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fccbb83e5a3] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d0401be822] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d04012e598] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d040130c17] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d040029d0b] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d04002a2ac] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d040012fad] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fccbbad2e20] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 10: (DispatchQueue::entry()+0x51f) [0x7fccbbacffdf] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fccbbba2fc1] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fccba5bc1ca] 2024-04-26T11:43:20.521 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 13: clone() 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fccba5c6d20] 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2: gsignal() 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 3: abort() 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fccbb83e437] 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fccbb83e5a3] 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d0401be822] 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d04012e598] 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d040130c17] 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d040029d0b] 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d04002a2ac] 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d040012fad] 2024-04-26T11:43:20.522 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fccbbad2e20] 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 13: (DispatchQueue::entry()+0x51f) [0x7fccbbacffdf] 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fccbbba2fc1] 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fccba5bc1ca] 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 16: clone() 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.165+0000 7fccb0000700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: in thread 7fccb0000700 thread_name:ms_dispatch 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fccba5c6d20] 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2: gsignal() 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 3: abort() 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fccbb83e437] 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fccbb83e5a3] 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d0401be822] 2024-04-26T11:43:20.523 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d04012e598] 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d040130c17] 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d040029d0b] 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d04002a2ac] 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d040012fad] 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fccbbad2e20] 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 13: (DispatchQueue::entry()+0x51f) [0x7fccbbacffdf] 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fccbbba2fc1] 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fccba5bc1ca] 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 16: clone() 2024-04-26T11:43:20.524 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:20.525 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.526 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: -1> 2024-04-26T11:43:20.161+0000 7fccb0000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fccb0000700 time 2024-04-26T11:43:20.160753+0000 2024-04-26T11:43:20.526 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:20.526 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.526 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.526 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fccbb83e3dd] 2024-04-26T11:43:20.526 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fccbb83e5a3] 2024-04-26T11:43:20.526 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d0401be822] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d04012e598] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d040130c17] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d040029d0b] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d04002a2ac] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d040012fad] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fccbbad2e20] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 10: (DispatchQueue::entry()+0x51f) [0x7fccbbacffdf] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fccbbba2fc1] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fccba5bc1ca] 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 13: clone() 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 0> 2024-04-26T11:43:20.165+0000 7fccb0000700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: in thread 7fccb0000700 thread_name:ms_dispatch 2024-04-26T11:43:20.527 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fccba5c6d20] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2: gsignal() 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 3: abort() 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fccbb83e437] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fccbb83e5a3] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d0401be822] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d04012e598] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d040130c17] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d040029d0b] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d04002a2ac] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d040012fad] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fccbbad2e20] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 13: (DispatchQueue::entry()+0x51f) [0x7fccbbacffdf] 2024-04-26T11:43:20.528 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fccbbba2fc1] 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fccba5bc1ca] 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 16: clone() 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: -1> 2024-04-26T11:43:20.161+0000 7fccb0000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fccb0000700 time 2024-04-26T11:43:20.160753+0000 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fccbb83e3dd] 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fccbb83e5a3] 2024-04-26T11:43:20.529 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d0401be822] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d04012e598] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d040130c17] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d040029d0b] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d04002a2ac] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d040012fad] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fccbbad2e20] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 10: (DispatchQueue::entry()+0x51f) [0x7fccbbacffdf] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fccbbba2fc1] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fccba5bc1ca] 2024-04-26T11:43:20.530 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 13: clone() 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 0> 2024-04-26T11:43:20.165+0000 7fccb0000700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: in thread 7fccb0000700 thread_name:ms_dispatch 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fccba5c6d20] 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2: gsignal() 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 3: abort() 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fccbb83e437] 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fccbb83e5a3] 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d0401be822] 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d04012e598] 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d040130c17] 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d040029d0b] 2024-04-26T11:43:20.531 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d04002a2ac] 2024-04-26T11:43:20.532 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d040012fad] 2024-04-26T11:43:20.532 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fccbbad2e20] 2024-04-26T11:43:20.532 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 13: (DispatchQueue::entry()+0x51f) [0x7fccbbacffdf] 2024-04-26T11:43:20.532 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fccbbba2fc1] 2024-04-26T11:43:20.532 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fccba5bc1ca] 2024-04-26T11:43:20.532 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 16: clone() 2024-04-26T11:43:20.532 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:20.532 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93397]: 2024-04-26T11:43:20.532 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:20 smithi110 podman[93575]: 2024-04-26 11:43:20.354900321 +0000 UTC m=+0.057493708 container died 98048601f4981d9ad732b53683864fa211a139493c7a5d2e2bd28275c45704ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:43:20.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f18b535a700 time 2024-04-26T11:43:20.268218+0000 2024-04-26T11:43:20.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f18bf9833dd] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f18bf9835a3] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a0f37eb822] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a0f375b598] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a0f375dc17] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a0f3656d0b] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a0f36572ac] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a0f363ffad] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f18bfc17e20] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 10: (DispatchQueue::entry()+0x51f) [0x7f18bfc14fdf] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f18bfce7fc1] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f18be7011ca] 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 13: clone() 2024-04-26T11:43:20.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.268+0000 7f18b535a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f18b535a700 time 2024-04-26T11:43:20.268218+0000 2024-04-26T11:43:20.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:20.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f18bf9833dd] 2024-04-26T11:43:20.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f18bf9835a3] 2024-04-26T11:43:20.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a0f37eb822] 2024-04-26T11:43:20.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a0f375b598] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a0f375dc17] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a0f3656d0b] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a0f36572ac] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a0f363ffad] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f18bfc17e20] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 10: (DispatchQueue::entry()+0x51f) [0x7f18bfc14fdf] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f18bfce7fc1] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f18be7011ca] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 13: clone() 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: *** Caught signal (Aborted) ** 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: in thread 7f18b535a700 thread_name:ms_dispatch 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f18be70bd20] 2024-04-26T11:43:20.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2: gsignal() 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 3: abort() 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f18bf983437] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f18bf9835a3] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a0f37eb822] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a0f375b598] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a0f375dc17] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a0f3656d0b] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a0f36572ac] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a0f363ffad] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f18bfc17e20] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 13: (DispatchQueue::entry()+0x51f) [0x7f18bfc14fdf] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f18bfce7fc1] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f18be7011ca] 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 16: clone() 2024-04-26T11:43:20.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.270+0000 7f18b535a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: in thread 7f18b535a700 thread_name:ms_dispatch 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f18be70bd20] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2: gsignal() 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 3: abort() 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f18bf983437] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f18bf9835a3] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a0f37eb822] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a0f375b598] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a0f375dc17] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a0f3656d0b] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a0f36572ac] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a0f363ffad] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f18bfc17e20] 2024-04-26T11:43:20.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 13: (DispatchQueue::entry()+0x51f) [0x7f18bfc14fdf] 2024-04-26T11:43:20.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f18bfce7fc1] 2024-04-26T11:43:20.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f18be7011ca] 2024-04-26T11:43:20.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 16: clone() 2024-04-26T11:43:20.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: -1> 2024-04-26T11:43:20.268+0000 7f18b535a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f18b535a700 time 2024-04-26T11:43:20.268218+0000 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f18bf9833dd] 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f18bf9835a3] 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a0f37eb822] 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a0f375b598] 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a0f375dc17] 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a0f3656d0b] 2024-04-26T11:43:20.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a0f36572ac] 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a0f363ffad] 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f18bfc17e20] 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 10: (DispatchQueue::entry()+0x51f) [0x7f18bfc14fdf] 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f18bfce7fc1] 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f18be7011ca] 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 13: clone() 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 0> 2024-04-26T11:43:20.270+0000 7f18b535a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: in thread 7f18b535a700 thread_name:ms_dispatch 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f18be70bd20] 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2: gsignal() 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 3: abort() 2024-04-26T11:43:20.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f18bf983437] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f18bf9835a3] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a0f37eb822] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a0f375b598] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a0f375dc17] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a0f3656d0b] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a0f36572ac] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a0f363ffad] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f18bfc17e20] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 13: (DispatchQueue::entry()+0x51f) [0x7f18bfc14fdf] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f18bfce7fc1] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f18be7011ca] 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 16: clone() 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: -1> 2024-04-26T11:43:20.268+0000 7f18b535a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f18b535a700 time 2024-04-26T11:43:20.268218+0000 2024-04-26T11:43:20.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f18bf9833dd] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f18bf9835a3] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a0f37eb822] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a0f375b598] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a0f375dc17] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a0f3656d0b] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a0f36572ac] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a0f363ffad] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f18bfc17e20] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 10: (DispatchQueue::entry()+0x51f) [0x7f18bfc14fdf] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f18bfce7fc1] 2024-04-26T11:43:20.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f18be7011ca] 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 13: clone() 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 0> 2024-04-26T11:43:20.270+0000 7f18b535a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: in thread 7f18b535a700 thread_name:ms_dispatch 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f18be70bd20] 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2: gsignal() 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 3: abort() 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f18bf983437] 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f18bf9835a3] 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a0f37eb822] 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a0f375b598] 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a0f375dc17] 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a0f3656d0b] 2024-04-26T11:43:20.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a0f36572ac] 2024-04-26T11:43:20.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a0f363ffad] 2024-04-26T11:43:20.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f18bfc17e20] 2024-04-26T11:43:20.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 13: (DispatchQueue::entry()+0x51f) [0x7f18bfc14fdf] 2024-04-26T11:43:20.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f18bfce7fc1] 2024-04-26T11:43:20.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f18be7011ca] 2024-04-26T11:43:20.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 16: clone() 2024-04-26T11:43:20.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:20.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[61863]: 2024-04-26T11:43:20.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:20 smithi193 podman[69472]: 2024-04-26 11:43:20.329230589 +0000 UTC m=+0.019673709 container died 6e428d9e2c928e135332120b189aa6aab37a7f640dba94cb69a293976a111fb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T11:43:21.301 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:21 smithi110 ceph-mon[28069]: pgmap v405: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T11:43:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:21 smithi196 ceph-mon[32572]: pgmap v405: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T11:43:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:21 smithi193 ceph-mon[32782]: pgmap v405: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T11:43:21.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:21 smithi193 podman[69472]: 2024-04-26 11:43:21.439426399 +0000 UTC m=+1.129869502 container remove 6e428d9e2c928e135332120b189aa6aab37a7f640dba94cb69a293976a111fb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-26T11:43:21.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:21 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:43:21.791 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:21 smithi110 podman[93575]: 2024-04-26 11:43:21.520427196 +0000 UTC m=+1.223020575 container remove 98048601f4981d9ad732b53683864fa211a139493c7a5d2e2bd28275c45704ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-26T11:43:21.791 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:21 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:43:22.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:21 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T11:43:22.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:21 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.262s CPU time. 2024-04-26T11:43:22.286 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:21 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T11:43:22.286 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:21 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 2.186s CPU time. 2024-04-26T11:43:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:22 smithi110 ceph-mon[28069]: osdmap e134: 12 total, 12 up, 12 in 2024-04-26T11:43:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:22 smithi193 ceph-mon[32782]: osdmap e134: 12 total, 12 up, 12 in 2024-04-26T11:43:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:22 smithi196 ceph-mon[32572]: osdmap e134: 12 total, 12 up, 12 in 2024-04-26T11:43:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:23 smithi193 ceph-mon[32782]: pgmap v407: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T11:43:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:23 smithi196 ceph-mon[32572]: pgmap v407: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T11:43:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:23 smithi110 ceph-mon[28069]: pgmap v407: 97 pgs: 97 active+clean; 3.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T11:43:24.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 670.0 s, 248.6 tps, lat 53.164 ms stddev 69.116 2024-04-26T11:43:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:25 smithi193 ceph-mon[32782]: pgmap v408: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 19 MiB/s wr, 1.55k op/s 2024-04-26T11:43:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:25 smithi196 ceph-mon[32572]: pgmap v408: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 19 MiB/s wr, 1.55k op/s 2024-04-26T11:43:25.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:25 smithi110 ceph-mon[28069]: pgmap v408: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 19 MiB/s wr, 1.55k op/s 2024-04-26T11:43:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.289+0000 7f1681000640 1 -- 172.21.15.110:0/3544697410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f167c108750 msgr2=0x7f167c108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.289+0000 7f1681000640 1 --2- 172.21.15.110:0/3544697410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f167c108750 0x7f167c108b30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1668009930 tx=0x7f166802a420 comp rx=0 tx=0).stop 2024-04-26T11:43:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.289+0000 7f1681000640 1 -- 172.21.15.110:0/3544697410 shutdown_connections 2024-04-26T11:43:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.289+0000 7f1681000640 1 --2- 172.21.15.110:0/3544697410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c103100 0x7f167c10f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.289+0000 7f1681000640 1 --2- 172.21.15.110:0/3544697410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f167c102740 0x7f167c102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.289+0000 7f1681000640 1 --2- 172.21.15.110:0/3544697410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f167c108750 0x7f167c108b30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.289+0000 7f1681000640 1 -- 172.21.15.110:0/3544697410 >> 172.21.15.110:0/3544697410 conn(0x7f167c0fe270 msgr2=0x7f167c100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.289+0000 7f1681000640 1 -- 172.21.15.110:0/3544697410 shutdown_connections 2024-04-26T11:43:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.289+0000 7f1681000640 1 -- 172.21.15.110:0/3544697410 wait complete. 2024-04-26T11:43:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.290+0000 7f1681000640 1 Processor -- start 2024-04-26T11:43:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.290+0000 7f1681000640 1 -- start start 2024-04-26T11:43:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.290+0000 7f1681000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c102740 0x7f167c19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.290+0000 7f1681000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f167c103100 0x7f167c19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.290+0000 7f1681000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f167c108750 0x7f167c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.290+0000 7f1681000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f167c112a60 con 0x7f167c102740 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.290+0000 7f1681000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f167c1128e0 con 0x7f167c108750 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.290+0000 7f1681000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f167c112be0 con 0x7f167c103100 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c102740 0x7f167c19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c102740 0x7f167c19b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46390/0 (socket says 172.21.15.110:46390) 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167b400640 1 -- 172.21.15.110:0/23400226 learned_addr learned my addr 172.21.15.110:0/23400226 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167be00640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f167c108750 0x7f167c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167aa00640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f167c103100 0x7f167c19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167b400640 1 -- 172.21.15.110:0/23400226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f167c103100 msgr2=0x7f167c19b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167b400640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f167c103100 0x7f167c19b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167b400640 1 -- 172.21.15.110:0/23400226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f167c108750 msgr2=0x7f167c19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167b400640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f167c108750 0x7f167c19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167b400640 1 -- 172.21.15.110:0/23400226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c1a01b0 con 0x7f167c102740 2024-04-26T11:43:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.291+0000 7f167be00640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f167c108750 0x7f167c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:43:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.292+0000 7f167b400640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c102740 0x7f167c19b210 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1668005ab0 tx=0x7f1668003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.292+0000 7f1673e00640 1 -- 172.21.15.110:0/23400226 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166803f070 con 0x7f167c102740 2024-04-26T11:43:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.292+0000 7f1673e00640 1 -- 172.21.15.110:0/23400226 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1668031b50 con 0x7f167c102740 2024-04-26T11:43:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.292+0000 7f1681000640 1 -- 172.21.15.110:0/23400226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f167c1a0440 con 0x7f167c102740 2024-04-26T11:43:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.292+0000 7f1673e00640 1 -- 172.21.15.110:0/23400226 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668035030 con 0x7f167c102740 2024-04-26T11:43:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.292+0000 7f1681000640 1 -- 172.21.15.110:0/23400226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f167c1a7d30 con 0x7f167c102740 2024-04-26T11:43:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.295+0000 7f16853c9740 1 Processor -- start 2024-04-26T11:43:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.295+0000 7f1673e00640 1 -- 172.21.15.110:0/23400226 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f1668042070 con 0x7f167c102740 2024-04-26T11:43:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.295+0000 7f16853c9740 1 -- start start 2024-04-26T11:43:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f16853c9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd1fe0 0x55b02ecd23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f16853c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 0x55b02ecdcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f16853c9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f16853c9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b02ec37380 con 0x55b02ecdd1c0 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f16853c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b02ebd3c30 con 0x55b02ecd2900 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f16853c9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b02ec33340 con 0x55b02ecd1fe0 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f167aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f167aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46406/0 (socket says 172.21.15.110:46406) 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f167aa00640 1 -- 172.21.15.110:0/1716791626 learned_addr learned my addr 172.21.15.110:0/1716791626 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f167b400640 1 --2- 172.21.15.110:0/1716791626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 0x55b02ecdcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.296+0000 7f167be00640 1 --2- 172.21.15.110:0/1716791626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd1fe0 0x55b02ecd23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f167aa00640 1 -- 172.21.15.110:0/1716791626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd1fe0 msgr2=0x55b02ecd23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f167aa00640 1 --2- 172.21.15.110:0/1716791626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd1fe0 0x55b02ecd23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f167aa00640 1 -- 172.21.15.110:0/1716791626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 msgr2=0x55b02ecdcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f167aa00640 1 --2- 172.21.15.110:0/1716791626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 0x55b02ecdcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f167aa00640 1 -- 172.21.15.110:0/1716791626 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02ebf5940 con 0x55b02ecdd1c0 2024-04-26T11:43:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f167aa00640 1 --2- 172.21.15.110:0/1716791626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdf5b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f166c009ca0 tx=0x7f166c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714cd41b10c0dd44 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f1673e00640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16600a3d10 0x7f16600a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f1670c00640 1 -- 172.21.15.110:0/1716791626 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c01e070 con 0x55b02ecdd1c0 2024-04-26T11:43:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f1670c00640 1 -- 172.21.15.110:0/1716791626 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f166c019ae0 con 0x55b02ecdd1c0 2024-04-26T11:43:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f1670c00640 1 -- 172.21.15.110:0/1716791626 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c00e9b0 con 0x55b02ecdd1c0 2024-04-26T11:43:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f1673e00640 1 -- 172.21.15.110:0/23400226 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 11225+0+0 (secure 0 0 0) 0x7f16680f1840 con 0x7f167c102740 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.297+0000 7f167be00640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16600a3d10 0x7f16600a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f16853c9740 1 -- 172.21.15.110:0/1716791626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 msgr2=0x55b02ecdf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f16853c9740 1 --2- 172.21.15.110:0/1716791626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdf5b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f166c009ca0 tx=0x7f166c011810 comp rx=0 tx=0).stop 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f167be00640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16600a3d10 0x7f16600a61d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1674005fd0 tx=0x7f1674009500 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f16853c9740 1 -- 172.21.15.110:0/1716791626 shutdown_connections 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f16853c9740 1 --2- 172.21.15.110:0/1716791626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdf5b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f16853c9740 1 --2- 172.21.15.110:0/1716791626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 0x55b02ecdcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f16853c9740 1 --2- 172.21.15.110:0/1716791626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd1fe0 0x55b02ecd23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f16853c9740 1 -- 172.21.15.110:0/1716791626 >> 172.21.15.110:0/1716791626 conn(0x55b02ecce4f0 msgr2=0x55b02ecce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f16853c9740 1 -- 172.21.15.110:0/1716791626 shutdown_connections 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.298+0000 7f16853c9740 1 -- 172.21.15.110:0/1716791626 wait complete. 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.299+0000 7f16853c9740 1 -- start start 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.299+0000 7f16853c9740 1 Processor -- start 2024-04-26T11:43:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.299+0000 7f16853c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ecda060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.299+0000 7f16853c9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 0x55b02ecda5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.299+0000 7f16853c9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.299+0000 7f16853c9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b02ecdfdf0 con 0x55b02ecdd1c0 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.299+0000 7f16853c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b02ebbec60 con 0x55b02ecd1fe0 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f16853c9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55b02ecdff70 con 0x55b02ecd2900 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f16853c9740 10 client.0 _ll_register_callbacks cb 0x55b02ebeae50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ecda060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46414/0 (socket says 172.21.15.110:46414) 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ecda060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:53534/0 (socket says 172.21.15.110:53534) 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167be00640 1 -- 172.21.15.110:0/1287980398 learned_addr learned my addr 172.21.15.110:0/1287980398 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167aa00640 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 0x55b02ecda5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167be00640 1 -- 172.21.15.110:0/1287980398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 msgr2=0x55b02ecda5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167be00640 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 0x55b02ecda5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167be00640 1 -- 172.21.15.110:0/1287980398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 msgr2=0x55b02ecda060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167be00640 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ecda060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167be00640 1 -- 172.21.15.110:0/1287980398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02ebcd510 con 0x55b02ecdd1c0 2024-04-26T11:43:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.300+0000 7f167aa00640 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 0x55b02ecda5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:43:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.301+0000 7f167be00640 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdaae0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f167400ff20 tx=0x7f1674004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b9df84511cc648 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.301+0000 7f1665600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:43:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.301+0000 7f1665600640 1 -- 172.21.15.110:0/1287980398 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167402e060 con 0x55b02ecdd1c0 2024-04-26T11:43:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.301+0000 7f1665600640 1 -- 172.21.15.110:0/1287980398 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 11225+0+0 (secure 0 0 0) 0x7f1674018030 con 0x55b02ecdd1c0 2024-04-26T11:43:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.301+0000 7f16853c9740 1 -- 172.21.15.110:0/1287980398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f166c019ae0 con 0x55b02ecdd1c0 2024-04-26T11:43:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.301+0000 7f1665600640 1 -- 172.21.15.110:0/1287980398 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=196) ==== 24+0+0 (secure 0 0 0) 0x7f1674035050 con 0x55b02ecdd1c0 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.301+0000 7f16853c9740 10 client.16014 fetch_fsmap learned FSMap version 196 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.301+0000 7f16853c9740 1 -- 172.21.15.110:0/1287980398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=196,monmap=4+}) -- 0x55b02e949210 con 0x55b02ecdd1c0 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.301+0000 7f1665600640 1 -- 172.21.15.110:0/1287980398 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f166c019ae0 con 0x55b02ecdd1c0 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.302+0000 7f1665600640 1 -- 172.21.15.110:0/1287980398 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 196) ==== 5926+0+0 (secure 0 0 0) 0x7f1674030900 con 0x55b02ecdd1c0 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.302+0000 7f16853c9740 10 client.16014 fetch_fsmap finished waiting for FSMap version 196 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.302+0000 7f16853c9740 10 client.16014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.302+0000 7f16853c9740 20 client.16014 populate_metadata read hostname 'smithi110' 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.302+0000 7f16853c9740 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02eced160 0x55b02ecef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.302+0000 7f16853c9740 4 client.16014 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:43:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.302+0000 7f16853c9740 1 -- 172.21.15.110:0/1287980398 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b02ec44f90 con 0x55b02eced160 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.302+0000 7f167b400640 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02eced160 0x55b02ecef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.303+0000 7f167b400640 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02eced160 0x55b02ecef5e0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a93391164c3c6a7 server_cookie=dbbe7b47fe28ecb4 in_seq=0 out_seq=0 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.303+0000 7f1665600640 10 client.16014 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.303+0000 7f1665600640 1 -- 172.21.15.110:0/1287980398 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b02ec44f90 con 0x55b02eced160 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.303+0000 7f1665600640 10 client.16014 handle_command_reply: tid=0 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.303+0000 7f16853c9740 1 client.16014 shutdown 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 -- 172.21.15.110:0/1287980398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 msgr2=0x55b02ecdaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdaae0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f167400ff20 tx=0x7f1674004ab0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 -- 172.21.15.110:0/1287980398 shutdown_connections 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecdaae0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02eced160 0x55b02ecef5e0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 0x55b02ecda5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 --2- 172.21.15.110:0/1287980398 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ecda060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 -- 172.21.15.110:0/1287980398 >> 172.21.15.110:0/1287980398 conn(0x55b02ecce4f0 msgr2=0x55b02ecd4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f1665600640 0 client.16014 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 -- 172.21.15.110:0/1287980398 shutdown_connections 2024-04-26T11:43:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 1 -- 172.21.15.110:0/1287980398 wait complete. 2024-04-26T11:43:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.304+0000 7f16853c9740 20 client.16014 trim_cache size 0 max 16384 2024-04-26T11:43:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.321+0000 7f16853c9740 1 Processor -- start 2024-04-26T11:43:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.321+0000 7f16853c9740 1 -- start start 2024-04-26T11:43:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f16853c9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecd1fe0 0x55b02ece8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f16853c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 0x55b02ecd91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f16853c9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecdd1c0 0x55b02ecf4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f16853c9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f167c1b1860 con 0x55b02ecd1fe0 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f16853c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f167c1b33d0 con 0x55b02ecd2900 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f16853c9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f167c1b1f60 con 0x55b02ecdd1c0 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f167b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecd1fe0 0x55b02ece8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f167be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecdd1c0 0x55b02ecf4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f167aa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 0x55b02ecd91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f167be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecdd1c0 0x55b02ecf4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:50098/0 (socket says 172.21.15.110:50098) 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f167b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecd1fe0 0x55b02ece8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46430/0 (socket says 172.21.15.110:46430) 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.322+0000 7f167be00640 1 -- 172.21.15.110:0/2218785742 learned_addr learned my addr 172.21.15.110:0/2218785742 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.323+0000 7f167be00640 1 -- 172.21.15.110:0/2218785742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 msgr2=0x55b02ecd91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.323+0000 7f167be00640 1 --2- 172.21.15.110:0/2218785742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 0x55b02ecd91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.323+0000 7f167be00640 1 -- 172.21.15.110:0/2218785742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecd1fe0 msgr2=0x55b02ece8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.323+0000 7f167be00640 1 --2- 172.21.15.110:0/2218785742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecd1fe0 0x55b02ece8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.323+0000 7f167be00640 1 -- 172.21.15.110:0/2218785742 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02ecd2730 con 0x55b02ecdd1c0 2024-04-26T11:43:27.325 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.323+0000 7f167be00640 1 --2- 172.21.15.110:0/2218785742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecdd1c0 0x55b02ecf4ef0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f16740125e0 tx=0x7f167400f810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=366eb53362ba7685 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.323+0000 7f1667e00640 1 -- 172.21.15.110:0/2218785742 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167403e070 con 0x55b02ecdd1c0 2024-04-26T11:43:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.323+0000 7f1667e00640 1 -- 172.21.15.110:0/2218785742 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1674003970 con 0x55b02ecdd1c0 2024-04-26T11:43:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.323+0000 7f1667e00640 1 -- 172.21.15.110:0/2218785742 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674030650 con 0x55b02ecdd1c0 2024-04-26T11:43:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 -- 172.21.15.110:0/2218785742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecdd1c0 msgr2=0x55b02ecf4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 --2- 172.21.15.110:0/2218785742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecdd1c0 0x55b02ecf4ef0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f16740125e0 tx=0x7f167400f810 comp rx=0 tx=0).stop 2024-04-26T11:43:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 -- 172.21.15.110:0/2218785742 shutdown_connections 2024-04-26T11:43:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 --2- 172.21.15.110:0/2218785742 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecdd1c0 0x55b02ecf4ef0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 --2- 172.21.15.110:0/2218785742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd2900 0x55b02ecd91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 --2- 172.21.15.110:0/2218785742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecd1fe0 0x55b02ece8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 -- 172.21.15.110:0/2218785742 >> 172.21.15.110:0/2218785742 conn(0x55b02ecce4f0 msgr2=0x55b02ecce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:27.329 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 -- 172.21.15.110:0/2218785742 shutdown_connections 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 -- 172.21.15.110:0/2218785742 wait complete. 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.324+0000 7f16853c9740 1 -- start start 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f16853c9740 1 Processor -- start 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f16853c9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ece5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f16853c9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 0x55b02ecd68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f16853c9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecd6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f16853c9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f167c1b2d00 con 0x55b02ecdd1c0 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f16853c9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f167c1b2630 con 0x55b02ecd1fe0 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f16853c9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f167c1b0050 con 0x55b02ecd2900 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f16853c9740 10 client.0 _ll_register_callbacks cb 0x7f1674012f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f167b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ece5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f167be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecd6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.330 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f167b400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ece5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:53564/0 (socket says 172.21.15.110:53564) 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f167b400640 1 -- 172.21.15.110:0/4052691106 learned_addr learned my addr 172.21.15.110:0/4052691106 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.325+0000 7f167aa00640 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 0x55b02ecd68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f167b400640 1 -- 172.21.15.110:0/4052691106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 msgr2=0x55b02ecd68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f167b400640 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 0x55b02ecd68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f167b400640 1 -- 172.21.15.110:0/4052691106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 msgr2=0x55b02ecd6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f167b400640 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecd6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f167b400640 1 -- 172.21.15.110:0/4052691106 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02ea15620 con 0x55b02ecd1fe0 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f167be00640 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecd6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f167b400640 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ece5420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f16680b96c0 tx=0x7f16680dd040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b113fd9d6a91aadb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f1665600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f1665600640 1 -- 172.21.15.110:0/4052691106 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668049040 con 0x55b02ecd1fe0 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f16853c9740 1 -- 172.21.15.110:0/4052691106 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1674003970 con 0x55b02ecd1fe0 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.326+0000 7f1665600640 1 -- 172.21.15.110:0/4052691106 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(134..134 src has 1..134) ==== 11225+0+0 (secure 0 0 0) 0x7f16680b9360 con 0x55b02ecd1fe0 2024-04-26T11:43:27.331 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f1665600640 1 -- 172.21.15.110:0/4052691106 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=196) ==== 24+0+0 (secure 0 0 0) 0x7f16680bc830 con 0x55b02ecd1fe0 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f16853c9740 10 client.26264 fetch_fsmap learned FSMap version 196 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f16853c9740 1 -- 172.21.15.110:0/4052691106 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=196,monmap=4+}) -- 0x55b02ebf1cb0 con 0x55b02ecd1fe0 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f1665600640 1 -- 172.21.15.110:0/4052691106 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1674003970 con 0x55b02ecd1fe0 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f1665600640 1 -- 172.21.15.110:0/4052691106 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 196) ==== 5926+0+0 (secure 0 0 0) 0x7f16680ee720 con 0x55b02ecd1fe0 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f16853c9740 10 client.26264 fetch_fsmap finished waiting for FSMap version 196 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f16853c9740 10 client.26264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f16853c9740 20 client.26264 populate_metadata read hostname 'smithi110' 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f16853c9740 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02ed53950 0x55b02ed55d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f16853c9740 4 client.26264 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f16853c9740 1 -- 172.21.15.110:0/4052691106 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b02ec3ee00 con 0x55b02ed53950 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.327+0000 7f167aa00640 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02ed53950 0x55b02ed55d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.328+0000 7f167aa00640 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02ed53950 0x55b02ed55d70 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f45cecf830237620 server_cookie=29636fcfd8f62e3b in_seq=0 out_seq=0 2024-04-26T11:43:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:27.328+0000 7f1665600640 10 client.26264 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:27 smithi193 ceph-mon[32782]: pgmap v409: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 19 MiB/s wr, 1.55k op/s 2024-04-26T11:43:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:27 smithi196 ceph-mon[32572]: pgmap v409: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 19 MiB/s wr, 1.55k op/s 2024-04-26T11:43:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:27 smithi110 ceph-mon[28069]: pgmap v409: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 19 MiB/s wr, 1.55k op/s 2024-04-26T11:43:29.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:43:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:29 smithi196 ceph-mon[32572]: pgmap v410: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.2 MiB/s wr, 444 op/s 2024-04-26T11:43:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:29 smithi196 ceph-mon[32572]: osdmap e135: 12 total, 12 up, 12 in 2024-04-26T11:43:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:29 smithi110 ceph-mon[28069]: pgmap v410: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.2 MiB/s wr, 444 op/s 2024-04-26T11:43:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:29 smithi110 ceph-mon[28069]: osdmap e135: 12 total, 12 up, 12 in 2024-04-26T11:43:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:29 smithi193 ceph-mon[32782]: pgmap v410: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.2 MiB/s wr, 444 op/s 2024-04-26T11:43:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:29 smithi193 ceph-mon[32782]: osdmap e135: 12 total, 12 up, 12 in 2024-04-26T11:43:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:31 smithi196 ceph-mon[32572]: pgmap v412: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 496 op/s 2024-04-26T11:43:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:31 smithi110 ceph-mon[28069]: pgmap v412: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 496 op/s 2024-04-26T11:43:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:31 smithi193 ceph-mon[32782]: pgmap v412: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 496 op/s 2024-04-26T11:43:32.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:31 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:43:32.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:31 smithi193 systemd[1]: Stopped Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:32.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:31 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.262s CPU time. 2024-04-26T11:43:32.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:31 smithi193 systemd[1]: Starting Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:43:32.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:32 smithi193 podman[69567]: 2024-04-26 11:43:32.026011493 +0000 UTC m=+0.018075868 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:43:32.377 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:32 smithi193 podman[69567]: 2024-04-26 11:43:32.131877982 +0000 UTC m=+0.123942345 container create d191ab4e2875b341bd0b91af3f33b517ae784e100715587e116cf874ef564083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T11:43:32.377 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:32 smithi193 podman[69567]: 2024-04-26 11:43:32.376336426 +0000 UTC m=+0.368400790 container init d191ab4e2875b341bd0b91af3f33b517ae784e100715587e116cf874ef564083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-26T11:43:32.414 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:43:32.414 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 systemd[1]: Stopped Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:32.414 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 2.186s CPU time. 2024-04-26T11:43:32.414 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 systemd[1]: Starting Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:43:32.761 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:32 smithi193 podman[69567]: 2024-04-26 11:43:32.379196636 +0000 UTC m=+0.371261006 container start d191ab4e2875b341bd0b91af3f33b517ae784e100715587e116cf874ef564083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True) 2024-04-26T11:43:32.762 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-mds[69586]: -- 172.21.15.193:0/657900747 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649c800ba40 con 0x5649c7fdf000 2024-04-26T11:43:32.762 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: starting mds.k at 2024-04-26T11:43:32.762 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:32 smithi193 bash[69567]: d191ab4e2875b341bd0b91af3f33b517ae784e100715587e116cf874ef564083 2024-04-26T11:43:32.762 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:43:32 smithi193 systemd[1]: Started Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:32.762 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 podman[93709]: 2024-04-26 11:43:32.32011963 +0000 UTC m=+0.039189541 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:43:32.762 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 podman[93709]: 2024-04-26 11:43:32.454003621 +0000 UTC m=+0.173073544 container create 9074554902d5fb84c26dbe118e1330eedc2d83f284752d95099765eb08adf0d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:43:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-mon[28069]: daemon mds.k restarted 2024-04-26T11:43:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:43:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-mon[28069]: osdmap e136: 12 total, 12 up, 12 in 2024-04-26T11:43:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:boot 2024-04-26T11:43:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-mon[28069]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T11:43:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:43:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:43:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=j=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:43:33.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 podman[93709]: 2024-04-26 11:43:32.766185968 +0000 UTC m=+0.485255918 container init 9074554902d5fb84c26dbe118e1330eedc2d83f284752d95099765eb08adf0d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-26T11:43:33.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 podman[93709]: 2024-04-26 11:43:32.778606284 +0000 UTC m=+0.497676253 container start 9074554902d5fb84c26dbe118e1330eedc2d83f284752d95099765eb08adf0d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-26T11:43:33.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-mds[93727]: -- 172.21.15.110:0/3048994583 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56386012ba40 con 0x5638600ff000 2024-04-26T11:43:33.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: starting mds.j at 2024-04-26T11:43:33.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 bash[93709]: 9074554902d5fb84c26dbe118e1330eedc2d83f284752d95099765eb08adf0d6 2024-04-26T11:43:33.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:43:32 smithi110 systemd[1]: Started Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-mon[32782]: daemon mds.k restarted 2024-04-26T11:43:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:43:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-mon[32782]: osdmap e136: 12 total, 12 up, 12 in 2024-04-26T11:43:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:boot 2024-04-26T11:43:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-mon[32782]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T11:43:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:43:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:43:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:32 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=j=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:43:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:32 smithi196 ceph-mon[32572]: daemon mds.k restarted 2024-04-26T11:43:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:32 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:43:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:32 smithi196 ceph-mon[32572]: osdmap e136: 12 total, 12 up, 12 in 2024-04-26T11:43:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:32 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:boot 2024-04-26T11:43:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:32 smithi196 ceph-mon[32572]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T11:43:33.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:32 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:43:33.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:43:33.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:32 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=j=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:43:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:33 smithi110 ceph-mon[28069]: pgmap v413: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.2 MiB/s wr, 444 op/s 2024-04-26T11:43:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:33 smithi110 ceph-mon[28069]: daemon mds.j restarted 2024-04-26T11:43:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:33 smithi110 ceph-mon[28069]: osdmap e137: 12 total, 12 up, 12 in 2024-04-26T11:43:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:33 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:boot 2024-04-26T11:43:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:33 smithi110 ceph-mon[28069]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:43:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:33 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:replay} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:43:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:43:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:33 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=d=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:33 smithi193 ceph-mon[32782]: pgmap v413: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.2 MiB/s wr, 444 op/s 2024-04-26T11:43:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:33 smithi193 ceph-mon[32782]: daemon mds.j restarted 2024-04-26T11:43:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:33 smithi193 ceph-mon[32782]: osdmap e137: 12 total, 12 up, 12 in 2024-04-26T11:43:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:33 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:boot 2024-04-26T11:43:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:33 smithi193 ceph-mon[32782]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:43:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:33 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:replay} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:43:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:43:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:33 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=d=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:33 smithi196 ceph-mon[32572]: pgmap v413: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.2 MiB/s wr, 444 op/s 2024-04-26T11:43:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:33 smithi196 ceph-mon[32572]: daemon mds.j restarted 2024-04-26T11:43:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:33 smithi196 ceph-mon[32572]: osdmap e137: 12 total, 12 up, 12 in 2024-04-26T11:43:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:33 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:boot 2024-04-26T11:43:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:33 smithi196 ceph-mon[32572]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:43:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:33 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:replay} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:43:34.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:43:34.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:33 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=d=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:34.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:43:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:34 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:resolve 2024-04-26T11:43:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:34 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:resolve 2024-04-26T11:43:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:34 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=d=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:35.124 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:34 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:resolve 2024-04-26T11:43:35.125 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:34 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:resolve 2024-04-26T11:43:35.125 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:34 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=d=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:34 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:resolve 2024-04-26T11:43:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:34 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:resolve 2024-04-26T11:43:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:34 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=d=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.872+0000 7f1665600640 1 -- 172.21.15.110:0/4052691106 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b02ec3ee00 con 0x55b02ed53950 2024-04-26T11:43:35.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.872+0000 7f1665600640 10 client.26264 handle_command_reply: tid=0 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.872+0000 7f16853c9740 1 client.26264 shutdown 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 -- 172.21.15.110:0/4052691106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 msgr2=0x55b02ece5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ece5420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f16680b96c0 tx=0x7f16680dd040 comp rx=0 tx=0).stop 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 -- 172.21.15.110:0/4052691106 shutdown_connections 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b02ecdd1c0 0x55b02ecd6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55b02ed53950 0x55b02ed55d70 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55b02ecd2900 0x55b02ecd68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 --2- 172.21.15.110:0/4052691106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b02ecd1fe0 0x55b02ece5420 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 -- 172.21.15.110:0/4052691106 >> 172.21.15.110:0/4052691106 conn(0x55b02ecce4f0 msgr2=0x55b02ecd4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f1665600640 0 client.26264 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 -- 172.21.15.110:0/4052691106 shutdown_connections 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 1 -- 172.21.15.110:0/4052691106 wait complete. 2024-04-26T11:43:35.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.873+0000 7f16853c9740 20 client.26264 trim_cache size 0 max 16384 2024-04-26T11:43:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:43:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:43:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:43:35.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 -- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16600a3d10 msgr2=0x7f16600a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16600a3d10 0x7f16600a61d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1674005fd0 tx=0x7f1674009500 comp rx=0 tx=0).stop 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 -- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c102740 msgr2=0x7f167c19b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c102740 0x7f167c19b210 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1668005ab0 tx=0x7f1668003b90 comp rx=0 tx=0).stop 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 -- 172.21.15.110:0/23400226 shutdown_connections 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f16600a3d10 0x7f16600a61d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f167c108750 0x7f167c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f167c103100 0x7f167c19b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 --2- 172.21.15.110:0/23400226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c102740 0x7f167c19b210 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.874+0000 7f1681000640 1 -- 172.21.15.110:0/23400226 >> 172.21.15.110:0/23400226 conn(0x7f167c0fe270 msgr2=0x7f167c0fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.875+0000 7f1681000640 1 -- 172.21.15.110:0/23400226 shutdown_connections 2024-04-26T11:43:35.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:35.875+0000 7f1681000640 1 -- 172.21.15.110:0/23400226 wait complete. 2024-04-26T11:43:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:35 smithi193 ceph-mon[32782]: pgmap v416: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 701 KiB/s wr, 93 op/s 2024-04-26T11:43:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:35 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:43:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:35 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:reconnect 2024-04-26T11:43:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:35 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:reconnect 2024-04-26T11:43:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:35 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:35 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199996 2024-04-26T11:43:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:35 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209997 2024-04-26T11:43:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:35 smithi196 ceph-mon[32572]: pgmap v416: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 701 KiB/s wr, 93 op/s 2024-04-26T11:43:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:35 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:43:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:35 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:reconnect 2024-04-26T11:43:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:35 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:reconnect 2024-04-26T11:43:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:35 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:35 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199996 2024-04-26T11:43:36.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:35 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209997 2024-04-26T11:43:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:35 smithi110 ceph-mon[28069]: pgmap v416: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 701 KiB/s wr, 93 op/s 2024-04-26T11:43:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:35 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:43:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:35 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:reconnect 2024-04-26T11:43:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:35 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:reconnect 2024-04-26T11:43:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:35 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:35 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199996 2024-04-26T11:43:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:35 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209997 2024-04-26T11:43:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:36 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:rejoin 2024-04-26T11:43:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:36 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:rejoin 2024-04-26T11:43:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:36 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:36 smithi193 ceph-mon[32782]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:43:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:36 smithi193 ceph-mon[32782]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:43:37.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:36 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:rejoin 2024-04-26T11:43:37.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:36 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:rejoin 2024-04-26T11:43:37.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:36 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:37.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:36 smithi110 ceph-mon[28069]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:43:37.195 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:36 smithi110 ceph-mon[28069]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:43:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:36 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:rejoin 2024-04-26T11:43:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:36 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:rejoin 2024-04-26T11:43:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:36 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:36 smithi196 ceph-mon[32572]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:43:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:36 smithi196 ceph-mon[32572]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:43:37.622 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:43:37 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:43:37.227+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T11:43:37.622 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:43:37 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:43:37.227+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T11:43:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:37 smithi193 ceph-mon[32782]: pgmap v417: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 562 KiB/s wr, 74 op/s 2024-04-26T11:43:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:37 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:43:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:37 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:active 2024-04-26T11:43:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:37 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:active 2024-04-26T11:43:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:37 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:37 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:38.216 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:37 smithi110 ceph-mon[28069]: pgmap v417: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 562 KiB/s wr, 74 op/s 2024-04-26T11:43:38.217 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:37 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:43:38.217 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:37 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:active 2024-04-26T11:43:38.217 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:37 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:active 2024-04-26T11:43:38.217 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:37 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:38.217 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:37 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:37 smithi196 ceph-mon[32572]: pgmap v417: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 562 KiB/s wr, 74 op/s 2024-04-26T11:43:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:37 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:43:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:37 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/847145652,v1:172.21.15.196:6833/847145652] up:active 2024-04-26T11:43:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:37 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1618760010,v1:172.21.15.110:6837/1618760010] up:active 2024-04-26T11:43:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:37 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:37 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:38 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:38 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:38 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:39.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 685.0 s, 1549.7 tps, lat 249.644 ms stddev 1851.016 2024-04-26T11:43:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:39 smithi196 ceph-mon[32572]: pgmap v418: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 197 op/s 2024-04-26T11:43:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:39 smithi110 ceph-mon[28069]: pgmap v418: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 197 op/s 2024-04-26T11:43:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:39 smithi193 ceph-mon[32782]: pgmap v418: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 197 op/s 2024-04-26T11:43:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:43:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:43:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:43:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:43:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:43:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:43:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:43:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:43:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:43:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:43:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:43:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:43:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:43:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:43:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T11:43:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T11:43:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T11:43:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:43:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:43:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:43:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:43:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:42.255 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efcd05ae700 time 2024-04-26T11:43:41.909044+0000 2024-04-26T11:43:42.255 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:42.255 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efcdabd73dd] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efcdabd75a3] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fb9754f822] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fb974bf598] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fb974c1c17] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fb973bad0b] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fb973bb2ac] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fb973a3fad] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efcdae6be20] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 10: (DispatchQueue::entry()+0x51f) [0x7efcdae68fdf] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efcdaf3bfc1] 2024-04-26T11:43:42.256 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efcd99551ca] 2024-04-26T11:43:42.257 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 13: clone() 2024-04-26T11:43:42.257 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:41.909+0000 7efcd05ae700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efcd05ae700 time 2024-04-26T11:43:41.909044+0000 2024-04-26T11:43:42.257 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:42.257 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.258 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.258 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efcdabd73dd] 2024-04-26T11:43:42.258 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efcdabd75a3] 2024-04-26T11:43:42.258 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fb9754f822] 2024-04-26T11:43:42.258 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fb974bf598] 2024-04-26T11:43:42.258 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fb974c1c17] 2024-04-26T11:43:42.258 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fb973bad0b] 2024-04-26T11:43:42.259 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fb973bb2ac] 2024-04-26T11:43:42.259 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fb973a3fad] 2024-04-26T11:43:42.259 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efcdae6be20] 2024-04-26T11:43:42.259 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 10: (DispatchQueue::entry()+0x51f) [0x7efcdae68fdf] 2024-04-26T11:43:42.259 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efcdaf3bfc1] 2024-04-26T11:43:42.259 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efcd99551ca] 2024-04-26T11:43:42.259 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 13: clone() 2024-04-26T11:43:42.259 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: *** Caught signal (Aborted) ** 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: in thread 7efcd05ae700 thread_name:ms_dispatch 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efcd995fd20] 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2: gsignal() 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 3: abort() 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efcdabd7437] 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efcdabd75a3] 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fb9754f822] 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fb974bf598] 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fb974c1c17] 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fb973bad0b] 2024-04-26T11:43:42.260 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fb973bb2ac] 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fb973a3fad] 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efcdae6be20] 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 13: (DispatchQueue::entry()+0x51f) [0x7efcdae68fdf] 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efcdaf3bfc1] 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efcd99551ca] 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 16: clone() 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:41.911+0000 7efcd05ae700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: in thread 7efcd05ae700 thread_name:ms_dispatch 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.261 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efcd995fd20] 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2: gsignal() 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 3: abort() 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efcdabd7437] 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efcdabd75a3] 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fb9754f822] 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fb974bf598] 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fb974c1c17] 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fb973bad0b] 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fb973bb2ac] 2024-04-26T11:43:42.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fb973a3fad] 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efcdae6be20] 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 13: (DispatchQueue::entry()+0x51f) [0x7efcdae68fdf] 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efcdaf3bfc1] 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efcd99551ca] 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 16: clone() 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: -1> 2024-04-26T11:43:41.909+0000 7efcd05ae700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efcd05ae700 time 2024-04-26T11:43:41.909044+0000 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.264 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efcdabd73dd] 2024-04-26T11:43:42.264 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efcdabd75a3] 2024-04-26T11:43:42.264 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fb9754f822] 2024-04-26T11:43:42.264 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fb974bf598] 2024-04-26T11:43:42.264 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fb974c1c17] 2024-04-26T11:43:42.264 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fb973bad0b] 2024-04-26T11:43:42.264 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fb973bb2ac] 2024-04-26T11:43:42.264 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fb973a3fad] 2024-04-26T11:43:42.264 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efcdae6be20] 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 10: (DispatchQueue::entry()+0x51f) [0x7efcdae68fdf] 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efcdaf3bfc1] 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efcd99551ca] 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 13: clone() 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 0> 2024-04-26T11:43:41.911+0000 7efcd05ae700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: in thread 7efcd05ae700 thread_name:ms_dispatch 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efcd995fd20] 2024-04-26T11:43:42.265 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2: gsignal() 2024-04-26T11:43:42.266 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 3: abort() 2024-04-26T11:43:42.266 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efcdabd7437] 2024-04-26T11:43:42.266 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efcdabd75a3] 2024-04-26T11:43:42.266 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fb9754f822] 2024-04-26T11:43:42.266 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fb974bf598] 2024-04-26T11:43:42.266 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fb974c1c17] 2024-04-26T11:43:42.266 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fb973bad0b] 2024-04-26T11:43:42.266 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fb973bb2ac] 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fb973a3fad] 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efcdae6be20] 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 13: (DispatchQueue::entry()+0x51f) [0x7efcdae68fdf] 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efcdaf3bfc1] 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efcd99551ca] 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 16: clone() 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: -1> 2024-04-26T11:43:41.909+0000 7efcd05ae700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efcd05ae700 time 2024-04-26T11:43:41.909044+0000 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:42.267 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.268 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.268 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efcdabd73dd] 2024-04-26T11:43:42.268 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efcdabd75a3] 2024-04-26T11:43:42.268 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fb9754f822] 2024-04-26T11:43:42.268 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fb974bf598] 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fb974c1c17] 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fb973bad0b] 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fb973bb2ac] 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fb973a3fad] 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efcdae6be20] 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 10: (DispatchQueue::entry()+0x51f) [0x7efcdae68fdf] 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efcdaf3bfc1] 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efcd99551ca] 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 13: clone() 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 0> 2024-04-26T11:43:41.911+0000 7efcd05ae700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: in thread 7efcd05ae700 thread_name:ms_dispatch 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.269 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efcd995fd20] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2: gsignal() 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 3: abort() 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efcdabd7437] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efcdabd75a3] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fb9754f822] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fb974bf598] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fb974c1c17] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fb973bad0b] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fb973bb2ac] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fb973a3fad] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efcdae6be20] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 13: (DispatchQueue::entry()+0x51f) [0x7efcdae68fdf] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efcdaf3bfc1] 2024-04-26T11:43:42.270 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efcd99551ca] 2024-04-26T11:43:42.271 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 16: clone() 2024-04-26T11:43:42.271 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:42.271 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71502]: 2024-04-26T11:43:42.271 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:41 smithi196 podman[71588]: 2024-04-26 11:43:41.969955231 +0000 UTC m=+0.019846188 container died 89451a4af310ebb63ce4108045d2239420d74335bcfdf4c1ec54ca408863350d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:43:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7feb86000700 time 2024-04-26T11:43:41.907075+0000 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7feb919e53dd] 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7feb919e55a3] 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557bf4fba822] 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557bf4f2a598] 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557bf4f2cc17] 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557bf4e25d0b] 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557bf4e262ac] 2024-04-26T11:43:42.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557bf4e0efad] 2024-04-26T11:43:42.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7feb91c79e20] 2024-04-26T11:43:42.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 10: (DispatchQueue::entry()+0x51f) [0x7feb91c76fdf] 2024-04-26T11:43:42.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7feb91d49fc1] 2024-04-26T11:43:42.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7feb907631ca] 2024-04-26T11:43:42.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 13: clone() 2024-04-26T11:43:42.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:41.910+0000 7feb86000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7feb86000700 time 2024-04-26T11:43:41.907075+0000 2024-04-26T11:43:42.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:42.293 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7feb919e53dd] 2024-04-26T11:43:42.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7feb919e55a3] 2024-04-26T11:43:42.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557bf4fba822] 2024-04-26T11:43:42.294 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557bf4f2a598] 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557bf4f2cc17] 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557bf4e25d0b] 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557bf4e262ac] 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557bf4e0efad] 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7feb91c79e20] 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 10: (DispatchQueue::entry()+0x51f) [0x7feb91c76fdf] 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7feb91d49fc1] 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7feb907631ca] 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 13: clone() 2024-04-26T11:43:42.295 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: *** Caught signal (Aborted) ** 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: in thread 7feb86000700 thread_name:ms_dispatch 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7feb9076dd20] 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2: gsignal() 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 3: abort() 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7feb919e5437] 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7feb919e55a3] 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557bf4fba822] 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557bf4f2a598] 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557bf4f2cc17] 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557bf4e25d0b] 2024-04-26T11:43:42.296 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557bf4e262ac] 2024-04-26T11:43:42.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557bf4e0efad] 2024-04-26T11:43:42.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7feb91c79e20] 2024-04-26T11:43:42.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 13: (DispatchQueue::entry()+0x51f) [0x7feb91c76fdf] 2024-04-26T11:43:42.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7feb91d49fc1] 2024-04-26T11:43:42.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7feb907631ca] 2024-04-26T11:43:42.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 16: clone() 2024-04-26T11:43:42.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:41.913+0000 7feb86000700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:42.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: in thread 7feb86000700 thread_name:ms_dispatch 2024-04-26T11:43:42.297 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7feb9076dd20] 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2: gsignal() 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 3: abort() 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7feb919e5437] 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7feb919e55a3] 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557bf4fba822] 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557bf4f2a598] 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557bf4f2cc17] 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557bf4e25d0b] 2024-04-26T11:43:42.298 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557bf4e262ac] 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557bf4e0efad] 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7feb91c79e20] 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 13: (DispatchQueue::entry()+0x51f) [0x7feb91c76fdf] 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7feb91d49fc1] 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7feb907631ca] 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 16: clone() 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: -1> 2024-04-26T11:43:41.910+0000 7feb86000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7feb86000700 time 2024-04-26T11:43:41.907075+0000 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.299 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7feb919e53dd] 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7feb919e55a3] 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557bf4fba822] 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557bf4f2a598] 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557bf4f2cc17] 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557bf4e25d0b] 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557bf4e262ac] 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557bf4e0efad] 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7feb91c79e20] 2024-04-26T11:43:42.300 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 10: (DispatchQueue::entry()+0x51f) [0x7feb91c76fdf] 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7feb91d49fc1] 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7feb907631ca] 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 13: clone() 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 0> 2024-04-26T11:43:41.913+0000 7feb86000700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: in thread 7feb86000700 thread_name:ms_dispatch 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7feb9076dd20] 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2: gsignal() 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 3: abort() 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7feb919e5437] 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7feb919e55a3] 2024-04-26T11:43:42.301 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557bf4fba822] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557bf4f2a598] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557bf4f2cc17] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557bf4e25d0b] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557bf4e262ac] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557bf4e0efad] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7feb91c79e20] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 13: (DispatchQueue::entry()+0x51f) [0x7feb91c76fdf] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7feb91d49fc1] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7feb907631ca] 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 16: clone() 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: -5> 2024-04-26T11:43:41.910+0000 7feb86000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7feb86000700 time 2024-04-26T11:43:41.907075+0000 2024-04-26T11:43:42.302 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:43:42.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.303 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7feb919e53dd] 2024-04-26T11:43:42.304 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7feb919e55a3] 2024-04-26T11:43:42.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557bf4fba822] 2024-04-26T11:43:42.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557bf4f2a598] 2024-04-26T11:43:42.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557bf4f2cc17] 2024-04-26T11:43:42.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557bf4e25d0b] 2024-04-26T11:43:42.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557bf4e262ac] 2024-04-26T11:43:42.305 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557bf4e0efad] 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7feb91c79e20] 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 10: (DispatchQueue::entry()+0x51f) [0x7feb91c76fdf] 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7feb91d49fc1] 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7feb907631ca] 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 13: clone() 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: -4> 2024-04-26T11:43:41.913+0000 7feb86000700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: in thread 7feb86000700 thread_name:ms_dispatch 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7feb9076dd20] 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2: gsignal() 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 3: abort() 2024-04-26T11:43:42.306 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7feb919e5437] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7feb919e55a3] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557bf4fba822] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557bf4f2a598] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557bf4f2cc17] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557bf4e25d0b] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557bf4e262ac] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557bf4e0efad] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7feb91c79e20] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 13: (DispatchQueue::entry()+0x51f) [0x7feb91c76fdf] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7feb91d49fc1] 2024-04-26T11:43:42.307 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7feb907631ca] 2024-04-26T11:43:42.308 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 16: clone() 2024-04-26T11:43:42.308 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:43:42.308 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[92434]: 2024-04-26T11:43:42.308 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:42 smithi110 podman[93809]: 2024-04-26 11:43:42.107799223 +0000 UTC m=+0.062906065 container died b111ce950d91af298974da06b9c66f9239e04dc05a0a1a071efb5c576dc4bdc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-26T11:43:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:41 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:43.209 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:42 smithi196 podman[71588]: 2024-04-26 11:43:42.911941768 +0000 UTC m=+0.961832705 container remove 89451a4af310ebb63ce4108045d2239420d74335bcfdf4c1ec54ca408863350d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T11:43:43.209 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:42 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:43:43.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:43 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T11:43:43.541 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:43 smithi110 podman[93809]: 2024-04-26 11:43:43.18045133 +0000 UTC m=+1.135558166 container remove b111ce950d91af298974da06b9c66f9239e04dc05a0a1a071efb5c576dc4bdc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:43:43.542 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:43 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:43:43.930 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:43 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T11:43:43.930 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:43 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 2.211s CPU time. 2024-04-26T11:43:44.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 690.0 s, 1628.2 tps, lat 45.835 ms stddev 56.251 2024-04-26T11:43:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:45 smithi196 ceph-mon[32572]: pgmap v419: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 212 op/s 2024-04-26T11:43:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:45 smithi196 ceph-mon[32572]: pgmap v420: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 212 op/s 2024-04-26T11:43:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:45 smithi196 ceph-mon[32572]: pgmap v421: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 150 op/s 2024-04-26T11:43:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:45 smithi196 ceph-mon[32572]: pgmap v422: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.6 MiB/s wr, 458 op/s 2024-04-26T11:43:45.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:45 smithi110 ceph-mon[28069]: pgmap v419: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 212 op/s 2024-04-26T11:43:45.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:45 smithi110 ceph-mon[28069]: pgmap v420: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 212 op/s 2024-04-26T11:43:45.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:45 smithi110 ceph-mon[28069]: pgmap v421: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 150 op/s 2024-04-26T11:43:45.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:45 smithi110 ceph-mon[28069]: pgmap v422: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.6 MiB/s wr, 458 op/s 2024-04-26T11:43:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:45 smithi193 ceph-mon[32782]: pgmap v419: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 212 op/s 2024-04-26T11:43:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:45 smithi193 ceph-mon[32782]: pgmap v420: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 212 op/s 2024-04-26T11:43:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:45 smithi193 ceph-mon[32782]: pgmap v421: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 150 op/s 2024-04-26T11:43:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:45 smithi193 ceph-mon[32782]: pgmap v422: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.6 MiB/s wr, 458 op/s 2024-04-26T11:43:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:47 smithi196 ceph-mon[32572]: pgmap v423: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.6 MiB/s wr, 458 op/s 2024-04-26T11:43:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:47 smithi110 ceph-mon[28069]: pgmap v423: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.6 MiB/s wr, 458 op/s 2024-04-26T11:43:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:47 smithi193 ceph-mon[32782]: pgmap v423: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.6 MiB/s wr, 458 op/s 2024-04-26T11:43:49.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.019+0000 7f412e200640 1 -- 172.21.15.110:0/31602100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4128109190 msgr2=0x7f4128109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:49.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.019+0000 7f412e200640 1 --2- 172.21.15.110:0/31602100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4128109190 0x7f4128109570 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4118009900 tx=0x7f411802a410 comp rx=0 tx=0).stop 2024-04-26T11:43:49.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.019+0000 7f412e200640 1 -- 172.21.15.110:0/31602100 shutdown_connections 2024-04-26T11:43:49.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.019+0000 7f412e200640 1 --2- 172.21.15.110:0/31602100 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f412810e260 0x7f4128115e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.019+0000 7f412e200640 1 --2- 172.21.15.110:0/31602100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4128109b40 0x7f412810db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.019+0000 7f412e200640 1 --2- 172.21.15.110:0/31602100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4128109190 0x7f4128109570 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.019+0000 7f412e200640 1 -- 172.21.15.110:0/31602100 >> 172.21.15.110:0/31602100 conn(0x7f4128076ec0 msgr2=0x7f41280792e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:49.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.019+0000 7f412e200640 1 -- 172.21.15.110:0/31602100 shutdown_connections 2024-04-26T11:43:49.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.019+0000 7f412e200640 1 -- 172.21.15.110:0/31602100 wait complete. 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.020+0000 7f412e200640 1 Processor -- start 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.020+0000 7f412e200640 1 -- start start 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f412e200640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4128109190 0x7f412819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f412e200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f412810e260 0x7f412819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f412e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41281a3fe0 0x7f41281a4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f412e200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f41281191f0 con 0x7f41281a3fe0 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f412e200640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4128119070 con 0x7f4128109190 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f412e200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4128119370 con 0x7f412810e260 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f4127e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41281a3fe0 0x7f41281a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f4127400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4128109190 0x7f412819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f4127400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4128109190 0x7f412819f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:41264/0 (socket says 172.21.15.110:41264) 2024-04-26T11:43:49.024 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f4127400640 1 -- 172.21.15.110:0/2474098229 learned_addr learned my addr 172.21.15.110:0/2474098229 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f4127e00640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41281a3fe0 0x7f41281a4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:47984/0 (socket says 172.21.15.110:47984) 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.021+0000 7f411fe00640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f412810e260 0x7f412819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4127400640 1 -- 172.21.15.110:0/2474098229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f412810e260 msgr2=0x7f412819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4127400640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f412810e260 0x7f412819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4127400640 1 -- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41281a3fe0 msgr2=0x7f41281a4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4127400640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41281a3fe0 0x7f41281a4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4127400640 1 -- 172.21.15.110:0/2474098229 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41281a4ad0 con 0x7f4128109190 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4127e00640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41281a3fe0 0x7f41281a4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4127400640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4128109190 0x7f412819f770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4118005ab0 tx=0x7f4118003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4124c00640 1 -- 172.21.15.110:0/2474098229 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411803f070 con 0x7f4128109190 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f412e200640 1 -- 172.21.15.110:0/2474098229 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41281a4d60 con 0x7f4128109190 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4124c00640 1 -- 172.21.15.110:0/2474098229 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4118031b60 con 0x7f4128109190 2024-04-26T11:43:49.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f4124c00640 1 -- 172.21.15.110:0/2474098229 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118035030 con 0x7f4128109190 2024-04-26T11:43:49.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.022+0000 7f412e200640 1 -- 172.21.15.110:0/2474098229 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41281ac580 con 0x7f4128109190 2024-04-26T11:43:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4131044740 1 Processor -- start 2024-04-26T11:43:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4131044740 1 -- start start 2024-04-26T11:43:49.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4124c00640 1 -- 172.21.15.110:0/2474098229 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f4118042070 con 0x7f4128109190 2024-04-26T11:43:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4131044740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e8a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4131044740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653e94a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4131044740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e973a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4131044740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559653def380 con 0x559653e8a6f0 2024-04-26T11:43:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4131044740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559653d8bc30 con 0x559653e94fb0 2024-04-26T11:43:49.029 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4131044740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559653deb340 con 0x559653e89dd0 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.026+0000 7f4127400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653e94a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f4127e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e8a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f4127e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e8a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:59932/0 (socket says 172.21.15.110:59932) 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f4127e00640 1 -- 172.21.15.110:0/3188098344 learned_addr learned my addr 172.21.15.110:0/3188098344 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f411fe00640 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f411fe00640 1 -- 172.21.15.110:0/3188098344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 msgr2=0x559653e8a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f411fe00640 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e8a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f411fe00640 1 -- 172.21.15.110:0/3188098344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 msgr2=0x559653e94a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f411fe00640 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653e94a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f411fe00640 1 -- 172.21.15.110:0/3188098344 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559653dad940 con 0x559653e94fb0 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f4127400640 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653e94a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f4127e00640 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e8a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.027+0000 7f411fe00640 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e973a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f412806c040 tx=0x7f4110011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf6e7ac47ec56f90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:49.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.028+0000 7f4124c00640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f410c0a3e40 0x7f410c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.028+0000 7f4117e00640 1 -- 172.21.15.110:0/3188098344 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110004050 con 0x559653e94fb0 2024-04-26T11:43:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.028+0000 7f4117e00640 1 -- 172.21.15.110:0/3188098344 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41100054d0 con 0x559653e94fb0 2024-04-26T11:43:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.028+0000 7f4117e00640 1 -- 172.21.15.110:0/3188098344 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110004c80 con 0x559653e94fb0 2024-04-26T11:43:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.028+0000 7f4124c00640 1 -- 172.21.15.110:0/2474098229 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 11309+0+0 (secure 0 0 0) 0x7f41180f1990 con 0x7f4128109190 2024-04-26T11:43:49.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.028+0000 7f4127e00640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f410c0a3e40 0x7f410c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 -- 172.21.15.110:0/3188098344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 msgr2=0x559653e973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:49.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e973a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f412806c040 tx=0x7f4110011810 comp rx=0 tx=0).stop 2024-04-26T11:43:49.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 -- 172.21.15.110:0/3188098344 shutdown_connections 2024-04-26T11:43:49.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e973a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653e94a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 --2- 172.21.15.110:0/3188098344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e8a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4127e00640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f410c0a3e40 0x7f410c0a6300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4120009fd0 tx=0x7f4120009500 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 -- 172.21.15.110:0/3188098344 >> 172.21.15.110:0/3188098344 conn(0x559653e862e0 msgr2=0x559653e866c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 -- 172.21.15.110:0/3188098344 shutdown_connections 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 -- 172.21.15.110:0/3188098344 wait complete. 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 -- start start 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.029+0000 7f4131044740 1 Processor -- start 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4131044740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e91ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4131044740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e923e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4131044740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e94fb0 0x559653e92920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4131044740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559653e97be0 con 0x559653e94fb0 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4131044740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559653d76c60 con 0x559653e8a6f0 2024-04-26T11:43:49.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4131044740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559653e97d60 con 0x559653e89dd0 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4131044740 10 client.0 _ll_register_callbacks cb 0x559653da2e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4127e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e94fb0 0x559653e92920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4127e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e94fb0 0x559653e92920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48004/0 (socket says 172.21.15.110:48004) 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4127e00640 1 -- 172.21.15.110:0/2014306794 learned_addr learned my addr 172.21.15.110:0/2014306794 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f411fe00640 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e923e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.030+0000 7f4127400640 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e91ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f411fe00640 1 -- 172.21.15.110:0/2014306794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 msgr2=0x559653e91ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f411fe00640 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e91ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f411fe00640 1 -- 172.21.15.110:0/2014306794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e94fb0 msgr2=0x559653e92920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f411fe00640 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e94fb0 0x559653e92920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f411fe00640 1 -- 172.21.15.110:0/2014306794 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559653d85510 con 0x559653e8a6f0 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f411fe00640 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e923e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f411001b040 tx=0x7f4110009fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b03cb00fffaf11f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:49.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f4114c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f4114c00640 1 -- 172.21.15.110:0/2014306794 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110029070 con 0x559653e8a6f0 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f4114c00640 1 -- 172.21.15.110:0/2014306794 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 11309+0+0 (secure 0 0 0) 0x7f4110003a00 con 0x559653e8a6f0 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.031+0000 7f4131044740 1 -- 172.21.15.110:0/2014306794 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41100054d0 con 0x559653e8a6f0 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4114c00640 1 -- 172.21.15.110:0/2014306794 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7f41100044c0 con 0x559653e8a6f0 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4131044740 10 client.26288 fetch_fsmap learned FSMap version 207 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4131044740 1 -- 172.21.15.110:0/2014306794 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=207,monmap=4+}) -- 0x559653b01210 con 0x559653e8a6f0 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4114c00640 1 -- 172.21.15.110:0/2014306794 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41100054d0 con 0x559653e8a6f0 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4114c00640 1 -- 172.21.15.110:0/2014306794 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 207) ==== 5926+0+0 (secure 0 0 0) 0x7f4110038080 con 0x559653e8a6f0 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4131044740 10 client.26288 fetch_fsmap finished waiting for FSMap version 207 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4131044740 10 client.26288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4131044740 20 client.26288 populate_metadata read hostname 'smithi110' 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4131044740 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559653ea4e50 0x559653ea72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4131044740 4 client.26288 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:43:49.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.032+0000 7f4131044740 1 -- 172.21.15.110:0/2014306794 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559653dfcf90 con 0x559653ea4e50 2024-04-26T11:43:49.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.033+0000 7f4127400640 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559653ea4e50 0x559653ea72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.033+0000 7f4127400640 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559653ea4e50 0x559653ea72a0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2afa807d1c29ca84 server_cookie=b09ee192db5e2fda in_seq=0 out_seq=0 2024-04-26T11:43:49.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.033+0000 7f4114c00640 10 client.26288 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4114c00640 1 -- 172.21.15.110:0/2014306794 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559653dfcf90 con 0x559653ea4e50 2024-04-26T11:43:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4114c00640 10 client.26288 handle_command_reply: tid=0 2024-04-26T11:43:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4131044740 1 client.26288 shutdown 2024-04-26T11:43:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4131044740 1 -- 172.21.15.110:0/2014306794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 msgr2=0x559653e923e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4131044740 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e923e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f411001b040 tx=0x7f4110009fa0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4131044740 1 -- 172.21.15.110:0/2014306794 shutdown_connections 2024-04-26T11:43:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4131044740 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e94fb0 0x559653e92920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4131044740 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e923e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4131044740 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559653ea4e50 0x559653ea72a0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4131044740 1 --2- 172.21.15.110:0/2014306794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653e91ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4114c00640 0 client.26288 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.034+0000 7f4131044740 1 -- 172.21.15.110:0/2014306794 >> 172.21.15.110:0/2014306794 conn(0x559653e862e0 msgr2=0x559653e8c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.035+0000 7f4131044740 1 -- 172.21.15.110:0/2014306794 shutdown_connections 2024-04-26T11:43:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.035+0000 7f4131044740 1 -- 172.21.15.110:0/2014306794 wait complete. 2024-04-26T11:43:49.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.035+0000 7f4131044740 20 client.26288 trim_cache size 0 max 16384 2024-04-26T11:43:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.051+0000 7f4131044740 1 Processor -- start 2024-04-26T11:43:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.051+0000 7f4131044740 1 -- start start 2024-04-26T11:43:49.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.051+0000 7f4131044740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e89dd0 0x559653ea0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.051+0000 7f4131044740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e8c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.051+0000 7f4131044740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e94fb0 0x559653e93cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.051+0000 7f4131044740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b5d80 con 0x559653e89dd0 2024-04-26T11:43:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.051+0000 7f4131044740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b78f0 con 0x559653e8a6f0 2024-04-26T11:43:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.051+0000 7f4131044740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b6450 con 0x559653e94fb0 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f411fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e8c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f4127e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e94fb0 0x559653e93cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f411fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e8c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:41308/0 (socket says 172.21.15.110:41308) 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f4127400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e89dd0 0x559653ea0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f411fe00640 1 -- 172.21.15.110:0/3224532410 learned_addr learned my addr 172.21.15.110:0/3224532410 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f411fe00640 1 -- 172.21.15.110:0/3224532410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e94fb0 msgr2=0x559653e93cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f411fe00640 1 --2- 172.21.15.110:0/3224532410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e94fb0 0x559653e93cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f411fe00640 1 -- 172.21.15.110:0/3224532410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e89dd0 msgr2=0x559653ea0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f411fe00640 1 --2- 172.21.15.110:0/3224532410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e89dd0 0x559653ea0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f411fe00640 1 -- 172.21.15.110:0/3224532410 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559653bcd620 con 0x559653e8a6f0 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f4127400640 1 --2- 172.21.15.110:0/3224532410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e89dd0 0x559653ea0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:43:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f411fe00640 1 --2- 172.21.15.110:0/3224532410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e8c790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4110009380 tx=0x7f4110009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcce4afde4051a67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.052+0000 7f4117400640 1 -- 172.21.15.110:0/3224532410 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110029070 con 0x559653e8a6f0 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4117400640 1 -- 172.21.15.110:0/3224532410 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f411002fc20 con 0x559653e8a6f0 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4117400640 1 -- 172.21.15.110:0/3224532410 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110004860 con 0x559653e8a6f0 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4131044740 1 -- 172.21.15.110:0/3224532410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 msgr2=0x559653e8c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4131044740 1 --2- 172.21.15.110:0/3224532410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e8c790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4110009380 tx=0x7f4110009310 comp rx=0 tx=0).stop 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4131044740 1 -- 172.21.15.110:0/3224532410 shutdown_connections 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4131044740 1 --2- 172.21.15.110:0/3224532410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e94fb0 0x559653e93cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4131044740 1 --2- 172.21.15.110:0/3224532410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e8a6f0 0x559653e8c790 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4131044740 1 --2- 172.21.15.110:0/3224532410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e89dd0 0x559653ea0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4131044740 1 -- 172.21.15.110:0/3224532410 >> 172.21.15.110:0/3224532410 conn(0x559653e862e0 msgr2=0x559653e935c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4131044740 1 -- 172.21.15.110:0/3224532410 shutdown_connections 2024-04-26T11:43:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.053+0000 7f4131044740 1 -- 172.21.15.110:0/3224532410 wait complete. 2024-04-26T11:43:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.054+0000 7f4131044740 1 -- start start 2024-04-26T11:43:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.054+0000 7f4131044740 1 Processor -- start 2024-04-26T11:43:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.054+0000 7f4131044740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653f03800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.054+0000 7f4131044740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653f03d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.054+0000 7f4131044740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.054+0000 7f4131044740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b71f0 con 0x559653e8a6f0 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.054+0000 7f4131044740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b6b20 con 0x559653e94fb0 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.054+0000 7f4131044740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f41281b4550 con 0x559653e89dd0 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.054+0000 7f4131044740 10 client.0 _ll_register_callbacks cb 0x7f41180f7400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f411fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653f03d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f411fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653f03d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48036/0 (socket says 172.21.15.110:48036) 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f411fe00640 1 -- 172.21.15.110:0/3358569287 learned_addr learned my addr 172.21.15.110:0/3358569287 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f4127400640 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653f03800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f4127e00640 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f411fe00640 1 -- 172.21.15.110:0/3358569287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 msgr2=0x559653f03800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f411fe00640 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653f03800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f411fe00640 1 -- 172.21.15.110:0/3358569287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 msgr2=0x559653e983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:43:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f411fe00640 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f411fe00640 1 -- 172.21.15.110:0/3358569287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559653da9cb0 con 0x559653e8a6f0 2024-04-26T11:43:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f4127e00640 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:43:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f411fe00640 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653f03d40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4110004020 tx=0x7f4110003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e63cadcf9ba1f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:43:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.055+0000 7f4114c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:43:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4114c00640 1 -- 172.21.15.110:0/3358569287 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110044060 con 0x559653e8a6f0 2024-04-26T11:43:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4114c00640 1 -- 172.21.15.110:0/3358569287 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 11309+0+0 (secure 0 0 0) 0x7f4110035040 con 0x559653e8a6f0 2024-04-26T11:43:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4131044740 1 -- 172.21.15.110:0/3358569287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f411002fc20 con 0x559653e8a6f0 2024-04-26T11:43:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4114c00640 1 -- 172.21.15.110:0/3358569287 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7f411004b050 con 0x559653e8a6f0 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4131044740 10 client.16041 fetch_fsmap learned FSMap version 207 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4131044740 1 -- 172.21.15.110:0/3358569287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=207,monmap=4+}) -- 0x559653f0ada0 con 0x559653e8a6f0 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4114c00640 1 -- 172.21.15.110:0/3358569287 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f411002fc20 con 0x559653e8a6f0 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4114c00640 1 -- 172.21.15.110:0/3358569287 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 207) ==== 5926+0+0 (secure 0 0 0) 0x7f4110038040 con 0x559653e8a6f0 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4131044740 10 client.16041 fetch_fsmap finished waiting for FSMap version 207 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4131044740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4131044740 20 client.16041 populate_metadata read hostname 'smithi110' 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4131044740 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559653f0b460 0x559653f0d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4131044740 4 client.16041 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.056+0000 7f4131044740 1 -- 172.21.15.110:0/3358569287 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559653df6e00 con 0x559653f0b460 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.057+0000 7f4127400640 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559653f0b460 0x559653f0d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.057+0000 7f4127400640 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559653f0b460 0x559653f0d880 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65f2b8ba2cb24495 server_cookie=9ea447d3ec40ad8d in_seq=0 out_seq=0 2024-04-26T11:43:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:49.057+0000 7f4114c00640 10 client.16041 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:49 smithi196 ceph-mon[32572]: pgmap v424: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.2 MiB/s wr, 474 op/s 2024-04-26T11:43:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:49 smithi110 ceph-mon[28069]: pgmap v424: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.2 MiB/s wr, 474 op/s 2024-04-26T11:43:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:49 smithi193 ceph-mon[32782]: pgmap v424: 97 pgs: 97 active+clean; 3.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.2 MiB/s wr, 474 op/s 2024-04-26T11:43:49.925 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:43:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:51 smithi196 ceph-mon[32572]: pgmap v425: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.3 MiB/s wr, 488 op/s 2024-04-26T11:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:51 smithi110 ceph-mon[28069]: pgmap v425: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.3 MiB/s wr, 488 op/s 2024-04-26T11:43:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:51 smithi193 ceph-mon[32782]: pgmap v425: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.3 MiB/s wr, 488 op/s 2024-04-26T11:43:53.487 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:53 smithi196 ceph-mon[32572]: pgmap v426: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.9 MiB/s wr, 407 op/s 2024-04-26T11:43:53.487 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:43:53.487 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 systemd[1]: Stopped Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:53.487 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 systemd[1]: Starting Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:43:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:53 smithi110 ceph-mon[28069]: pgmap v426: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.9 MiB/s wr, 407 op/s 2024-04-26T11:43:53.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:53 smithi193 ceph-mon[32782]: pgmap v426: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.9 MiB/s wr, 407 op/s 2024-04-26T11:43:53.737 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 podman[71676]: 2024-04-26 11:43:53.389389155 +0000 UTC m=+0.017692322 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:43:53.737 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 podman[71676]: 2024-04-26 11:43:53.50659211 +0000 UTC m=+0.134895270 container create a95319c3e3553e172cf153e80e582ad22f09dbde2d96c77a3daed26ea77d8e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T11:43:53.737 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 podman[71676]: 2024-04-26 11:43:53.734740857 +0000 UTC m=+0.363044020 container init a95319c3e3553e172cf153e80e582ad22f09dbde2d96c77a3daed26ea77d8e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T11:43:53.738 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 podman[71676]: 2024-04-26 11:43:53.737344314 +0000 UTC m=+0.365647482 container start a95319c3e3553e172cf153e80e582ad22f09dbde2d96c77a3daed26ea77d8e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T11:43:54.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 ceph-mds[71695]: -- 172.21.15.196:0/1981651728 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5568ff2c7a40 con 0x5568ff29b000 2024-04-26T11:43:54.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: starting mds.l at 2024-04-26T11:43:54.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 bash[71676]: a95319c3e3553e172cf153e80e582ad22f09dbde2d96c77a3daed26ea77d8e2e 2024-04-26T11:43:54.006 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:43:53 smithi196 systemd[1]: Started Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:54.205 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:53 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:43:54.205 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:53 smithi110 systemd[1]: Stopped Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:54.205 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:53 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 2.211s CPU time. 2024-04-26T11:43:54.205 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:53 smithi110 systemd[1]: Starting Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:43:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:54 smithi196 ceph-mon[32572]: daemon mds.l restarted 2024-04-26T11:43:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:54 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:43:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:54 smithi196 ceph-mon[32572]: osdmap e138: 12 total, 12 up, 12 in 2024-04-26T11:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:54 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:boot 2024-04-26T11:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:54 smithi196 ceph-mon[32572]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-04-26T11:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:54 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:54 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=d=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-mon[28069]: daemon mds.l restarted 2024-04-26T11:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-mon[28069]: osdmap e138: 12 total, 12 up, 12 in 2024-04-26T11:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:boot 2024-04-26T11:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-mon[28069]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-04-26T11:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=d=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:43:54.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:54 smithi110 podman[93947]: 2024-04-26 11:43:54.119520061 +0000 UTC m=+0.032205971 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:43:54.543 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:54 smithi110 podman[93947]: 2024-04-26 11:43:54.240515455 +0000 UTC m=+0.153201389 container create 0cba203fbaaf422721ddb26d77c09078c7bad5ab38f0853c30177c4801aaf2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:54 smithi193 ceph-mon[32782]: daemon mds.l restarted 2024-04-26T11:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:54 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:54 smithi193 ceph-mon[32782]: osdmap e138: 12 total, 12 up, 12 in 2024-04-26T11:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:54 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:boot 2024-04-26T11:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:54 smithi193 ceph-mon[32782]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-04-26T11:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:54 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:54 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=d=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:43:54.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:43:55.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:54 smithi110 podman[93947]: 2024-04-26 11:43:54.554065607 +0000 UTC m=+0.466751585 container init 0cba203fbaaf422721ddb26d77c09078c7bad5ab38f0853c30177c4801aaf2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True) 2024-04-26T11:43:55.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:54 smithi110 podman[93947]: 2024-04-26 11:43:54.564048781 +0000 UTC m=+0.476734718 container start 0cba203fbaaf422721ddb26d77c09078c7bad5ab38f0853c30177c4801aaf2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T11:43:55.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-mds[93965]: -- 172.21.15.110:0/3497391668 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56181856ba40 con 0x56181853f000 2024-04-26T11:43:55.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:54 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: starting mds.d at 2024-04-26T11:43:55.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:54 smithi110 bash[93947]: 0cba203fbaaf422721ddb26d77c09078c7bad5ab38f0853c30177c4801aaf2f6 2024-04-26T11:43:55.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:43:54 smithi110 systemd[1]: Started Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:43:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:55 smithi196 ceph-mon[32572]: pgmap v428: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-04-26T11:43:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:55 smithi196 ceph-mon[32572]: daemon mds.d restarted 2024-04-26T11:43:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:55 smithi196 ceph-mon[32572]: osdmap e139: 12 total, 12 up, 12 in 2024-04-26T11:43:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:55 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:resolve 2024-04-26T11:43:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:55 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:boot 2024-04-26T11:43:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:55 smithi196 ceph-mon[32572]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T11:43:55.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:43:55.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:55 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:43:55.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:55 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:55 smithi110 ceph-mon[28069]: pgmap v428: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-04-26T11:43:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:55 smithi110 ceph-mon[28069]: daemon mds.d restarted 2024-04-26T11:43:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:55 smithi110 ceph-mon[28069]: osdmap e139: 12 total, 12 up, 12 in 2024-04-26T11:43:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:55 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:resolve 2024-04-26T11:43:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:55 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:boot 2024-04-26T11:43:55.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:55 smithi110 ceph-mon[28069]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T11:43:55.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:43:55.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:55 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:43:55.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:55 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:55 smithi193 ceph-mon[32782]: pgmap v428: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-04-26T11:43:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:55 smithi193 ceph-mon[32782]: daemon mds.d restarted 2024-04-26T11:43:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:55 smithi193 ceph-mon[32782]: osdmap e139: 12 total, 12 up, 12 in 2024-04-26T11:43:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:55 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:resolve 2024-04-26T11:43:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:55 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:boot 2024-04-26T11:43:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:55 smithi193 ceph-mon[32782]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T11:43:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:43:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:55 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:43:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:55 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:57.478 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:57 smithi110 ceph-mon[28069]: pgmap v430: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-04-26T11:43:57.478 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:57 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:resolve 2024-04-26T11:43:57.478 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:57 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:57 smithi196 ceph-mon[32572]: pgmap v430: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-04-26T11:43:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:57 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:resolve 2024-04-26T11:43:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:57 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:57 smithi193 ceph-mon[32782]: pgmap v430: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-04-26T11:43:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:57 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:resolve 2024-04-26T11:43:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:57 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:58.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.254+0000 7f4114c00640 1 -- 172.21.15.110:0/3358569287 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559653df6e00 con 0x559653f0b460 2024-04-26T11:43:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.254+0000 7f4114c00640 10 client.16041 handle_command_reply: tid=0 2024-04-26T11:43:58.256 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.254+0000 7f4131044740 1 client.16041 shutdown 2024-04-26T11:43:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.256+0000 7f4131044740 1 -- 172.21.15.110:0/3358569287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 msgr2=0x559653f03d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:58.257 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.256+0000 7f4131044740 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653f03d40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4110004020 tx=0x7f4110003a30 comp rx=0 tx=0).stop 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.256+0000 7f4131044740 1 -- 172.21.15.110:0/3358569287 shutdown_connections 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.256+0000 7f4131044740 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559653e94fb0 0x559653e983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.256+0000 7f4131044740 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559653e8a6f0 0x559653f03d40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.256+0000 7f4131044740 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x559653f0b460 0x559653f0d880 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.256+0000 7f4131044740 1 --2- 172.21.15.110:0/3358569287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559653e89dd0 0x559653f03800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.256+0000 7f4131044740 1 -- 172.21.15.110:0/3358569287 >> 172.21.15.110:0/3358569287 conn(0x559653e862e0 msgr2=0x559653e926d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.256+0000 7f4114c00640 0 client.16041 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.257+0000 7f4131044740 1 -- 172.21.15.110:0/3358569287 shutdown_connections 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.257+0000 7f4131044740 1 -- 172.21.15.110:0/3358569287 wait complete. 2024-04-26T11:43:58.258 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.257+0000 7f4131044740 20 client.16041 trim_cache size 0 max 16384 2024-04-26T11:43:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:43:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:43:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:43:58.259 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.258+0000 7f412e200640 1 -- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f410c0a3e40 msgr2=0x7f410c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.258+0000 7f412e200640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f410c0a3e40 0x7f410c0a6300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4120009fd0 tx=0x7f4120009500 comp rx=0 tx=0).stop 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.258+0000 7f412e200640 1 -- 172.21.15.110:0/2474098229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4128109190 msgr2=0x7f412819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.258+0000 7f412e200640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4128109190 0x7f412819f770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4118005ab0 tx=0x7f4118003c10 comp rx=0 tx=0).stop 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.259+0000 7f412e200640 1 -- 172.21.15.110:0/2474098229 shutdown_connections 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.259+0000 7f412e200640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f410c0a3e40 0x7f410c0a6300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.259+0000 7f412e200640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41281a3fe0 0x7f41281a4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.259+0000 7f412e200640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f412810e260 0x7f412819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.259+0000 7f412e200640 1 --2- 172.21.15.110:0/2474098229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4128109190 0x7f412819f770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.259+0000 7f412e200640 1 -- 172.21.15.110:0/2474098229 >> 172.21.15.110:0/2474098229 conn(0x7f4128076ec0 msgr2=0x7f41280791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.259+0000 7f412e200640 1 -- 172.21.15.110:0/2474098229 shutdown_connections 2024-04-26T11:43:58.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:43:58.259+0000 7f412e200640 1 -- 172.21.15.110:0/2474098229 wait complete. 2024-04-26T11:43:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:58 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:43:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:58 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:reconnect 2024-04-26T11:43:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:58 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:reconnect 2024-04-26T11:43:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:58 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:58 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:43:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:58 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:43:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:58 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:43:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:58 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:reconnect 2024-04-26T11:43:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:58 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:reconnect 2024-04-26T11:43:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:58 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:58 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:43:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:58 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:43:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:58 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:43:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:58 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:reconnect 2024-04-26T11:43:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:58 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:reconnect 2024-04-26T11:43:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:58 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:58 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:43:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:58 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:43:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: pgmap v431: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 206 op/s 2024-04-26T11:43:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:rejoin 2024-04-26T11:43:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:rejoin 2024-04-26T11:43:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T11:43:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-04-26T11:43:59.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:43:59.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:active 2024-04-26T11:43:59.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:active 2024-04-26T11:43:59.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:43:59 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: pgmap v431: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 206 op/s 2024-04-26T11:43:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:rejoin 2024-04-26T11:43:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:rejoin 2024-04-26T11:43:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T11:43:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-04-26T11:43:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:43:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:active 2024-04-26T11:43:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:active 2024-04-26T11:43:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:43:59 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: pgmap v431: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 206 op/s 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:rejoin 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:rejoin 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3002348356,v1:172.21.15.193:6833/3002348356] up:active 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556912868,v1:172.21.15.110:6835/1556912868] up:active 2024-04-26T11:43:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:43:59 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:43:59.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 705.0 s, 573.8 tps, lat 566.479 ms stddev 2785.994 2024-04-26T11:44:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:01 smithi196 ceph-mon[32572]: pgmap v432: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.9 MiB/s wr, 225 op/s 2024-04-26T11:44:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:01 smithi110 ceph-mon[28069]: pgmap v432: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.9 MiB/s wr, 225 op/s 2024-04-26T11:44:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:01 smithi193 ceph-mon[32782]: pgmap v432: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.9 MiB/s wr, 225 op/s 2024-04-26T11:44:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:03 smithi196 ceph-mon[32572]: pgmap v433: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 766 KiB/s wr, 96 op/s 2024-04-26T11:44:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:03 smithi110 ceph-mon[28069]: pgmap v433: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 766 KiB/s wr, 96 op/s 2024-04-26T11:44:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-mon[32782]: pgmap v433: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 766 KiB/s wr, 96 op/s 2024-04-26T11:44:04.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe5636dd700 time 2024-04-26T11:44:03.771129+0000 2024-04-26T11:44:04.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:04.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe56dd063dd] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe56dd065a3] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5649c67fb822] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5649c676b598] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5649c676dc17] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5649c6666d0b] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5649c66672ac] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5649c664ffad] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe56df9ae20] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 10: (DispatchQueue::entry()+0x51f) [0x7fe56df97fdf] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe56e06afc1] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe56ca841ca] 2024-04-26T11:44:04.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 13: clone() 2024-04-26T11:44:04.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:03.771+0000 7fe5636dd700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe5636dd700 time 2024-04-26T11:44:03.771129+0000 2024-04-26T11:44:04.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:04.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:04.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe56dd063dd] 2024-04-26T11:44:04.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe56dd065a3] 2024-04-26T11:44:04.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5649c67fb822] 2024-04-26T11:44:04.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5649c676b598] 2024-04-26T11:44:04.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5649c676dc17] 2024-04-26T11:44:04.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5649c6666d0b] 2024-04-26T11:44:04.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5649c66672ac] 2024-04-26T11:44:04.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5649c664ffad] 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe56df9ae20] 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 10: (DispatchQueue::entry()+0x51f) [0x7fe56df97fdf] 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe56e06afc1] 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe56ca841ca] 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 13: clone() 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: *** Caught signal (Aborted) ** 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: in thread 7fe5636dd700 thread_name:ms_dispatch 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe56ca8ed20] 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2: gsignal() 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 3: abort() 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe56dd06437] 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe56dd065a3] 2024-04-26T11:44:04.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5649c67fb822] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5649c676b598] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5649c676dc17] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5649c6666d0b] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5649c66672ac] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5649c664ffad] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe56df9ae20] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 13: (DispatchQueue::entry()+0x51f) [0x7fe56df97fdf] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe56e06afc1] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe56ca841ca] 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 16: clone() 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:03.773+0000 7fe5636dd700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: in thread 7fe5636dd700 thread_name:ms_dispatch 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe56ca8ed20] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2: gsignal() 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 3: abort() 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe56dd06437] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe56dd065a3] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5649c67fb822] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5649c676b598] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5649c676dc17] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5649c6666d0b] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5649c66672ac] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5649c664ffad] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe56df9ae20] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 13: (DispatchQueue::entry()+0x51f) [0x7fe56df97fdf] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe56e06afc1] 2024-04-26T11:44:04.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe56ca841ca] 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 16: clone() 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: -1> 2024-04-26T11:44:03.771+0000 7fe5636dd700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe5636dd700 time 2024-04-26T11:44:03.771129+0000 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe56dd063dd] 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe56dd065a3] 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5649c67fb822] 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5649c676b598] 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5649c676dc17] 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5649c6666d0b] 2024-04-26T11:44:04.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5649c66672ac] 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5649c664ffad] 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe56df9ae20] 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 10: (DispatchQueue::entry()+0x51f) [0x7fe56df97fdf] 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe56e06afc1] 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe56ca841ca] 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 13: clone() 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 0> 2024-04-26T11:44:03.773+0000 7fe5636dd700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: in thread 7fe5636dd700 thread_name:ms_dispatch 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe56ca8ed20] 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2: gsignal() 2024-04-26T11:44:04.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 3: abort() 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe56dd06437] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe56dd065a3] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5649c67fb822] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5649c676b598] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5649c676dc17] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5649c6666d0b] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5649c66672ac] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5649c664ffad] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe56df9ae20] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 13: (DispatchQueue::entry()+0x51f) [0x7fe56df97fdf] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe56e06afc1] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe56ca841ca] 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 16: clone() 2024-04-26T11:44:04.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: -1> 2024-04-26T11:44:03.771+0000 7fe5636dd700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe5636dd700 time 2024-04-26T11:44:03.771129+0000 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe56dd063dd] 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe56dd065a3] 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5649c67fb822] 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5649c676b598] 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5649c676dc17] 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5649c6666d0b] 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5649c66672ac] 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5649c664ffad] 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe56df9ae20] 2024-04-26T11:44:04.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 10: (DispatchQueue::entry()+0x51f) [0x7fe56df97fdf] 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe56e06afc1] 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe56ca841ca] 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 13: clone() 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 0> 2024-04-26T11:44:03.773+0000 7fe5636dd700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: in thread 7fe5636dd700 thread_name:ms_dispatch 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe56ca8ed20] 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2: gsignal() 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 3: abort() 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe56dd06437] 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe56dd065a3] 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5649c67fb822] 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5649c676b598] 2024-04-26T11:44:04.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5649c676dc17] 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5649c6666d0b] 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5649c66672ac] 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5649c664ffad] 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe56df9ae20] 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 13: (DispatchQueue::entry()+0x51f) [0x7fe56df97fdf] 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe56e06afc1] 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe56ca841ca] 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 16: clone() 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69582]: 2024-04-26T11:44:04.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:03 smithi193 podman[69666]: 2024-04-26 11:44:03.871489168 +0000 UTC m=+0.055879728 container died d191ab4e2875b341bd0b91af3f33b517ae784e100715587e116cf874ef564083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-26T11:44:04.508 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:04 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:04.547 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:04 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:04 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:04.799 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:04 smithi193 podman[69666]: 2024-04-26 11:44:04.547530785 +0000 UTC m=+0.731921375 container remove d191ab4e2875b341bd0b91af3f33b517ae784e100715587e116cf874ef564083 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:44:04.799 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:04 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:44:04.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 710.0 s, 1442.2 tps, lat 69.442 ms stddev 111.858 2024-04-26T11:44:05.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:04 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T11:44:05.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:04 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.335s CPU time. 2024-04-26T11:44:05.274 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6cca200700 time 2024-04-26T11:44:05.196068+0000 2024-04-26T11:44:05.274 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:05.274 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:05.274 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6cd5aad3dd] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6cd5aad5a3] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56385a0e7822] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56385a057598] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56385a059c17] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x563859f52d0b] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563859f532ac] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x563859f3bfad] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6cd5d41e20] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 10: (DispatchQueue::entry()+0x51f) [0x7f6cd5d3efdf] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cd5e11fc1] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6cd482b1ca] 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 13: clone() 2024-04-26T11:44:05.275 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.196+0000 7f6cca200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6cca200700 time 2024-04-26T11:44:05.196068+0000 2024-04-26T11:44:05.276 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:05.276 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.276 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:05.276 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6cd5aad3dd] 2024-04-26T11:44:05.276 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6cd5aad5a3] 2024-04-26T11:44:05.276 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56385a0e7822] 2024-04-26T11:44:05.276 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56385a057598] 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56385a059c17] 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x563859f52d0b] 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563859f532ac] 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x563859f3bfad] 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6cd5d41e20] 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 10: (DispatchQueue::entry()+0x51f) [0x7f6cd5d3efdf] 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cd5e11fc1] 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6cd482b1ca] 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 13: clone() 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: *** Caught signal (Aborted) ** 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: in thread 7f6cca200700 thread_name:ms_dispatch 2024-04-26T11:44:05.277 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6cd4835d20] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2: gsignal() 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 3: abort() 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6cd5aad437] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6cd5aad5a3] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56385a0e7822] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56385a057598] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56385a059c17] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x563859f52d0b] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563859f532ac] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x563859f3bfad] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6cd5d41e20] 2024-04-26T11:44:05.278 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 13: (DispatchQueue::entry()+0x51f) [0x7f6cd5d3efdf] 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cd5e11fc1] 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6cd482b1ca] 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 16: clone() 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.198+0000 7f6cca200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: in thread 7f6cca200700 thread_name:ms_dispatch 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6cd4835d20] 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2: gsignal() 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 3: abort() 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6cd5aad437] 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6cd5aad5a3] 2024-04-26T11:44:05.279 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56385a0e7822] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56385a057598] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56385a059c17] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x563859f52d0b] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563859f532ac] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x563859f3bfad] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6cd5d41e20] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 13: (DispatchQueue::entry()+0x51f) [0x7f6cd5d3efdf] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cd5e11fc1] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6cd482b1ca] 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 16: clone() 2024-04-26T11:44:05.280 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:05.281 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.281 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: -1> 2024-04-26T11:44:05.196+0000 7f6cca200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6cca200700 time 2024-04-26T11:44:05.196068+0000 2024-04-26T11:44:05.281 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:05.281 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.281 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:05.281 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6cd5aad3dd] 2024-04-26T11:44:05.281 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6cd5aad5a3] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56385a0e7822] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56385a057598] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56385a059c17] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x563859f52d0b] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563859f532ac] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x563859f3bfad] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6cd5d41e20] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 10: (DispatchQueue::entry()+0x51f) [0x7f6cd5d3efdf] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cd5e11fc1] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6cd482b1ca] 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 13: clone() 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 0> 2024-04-26T11:44:05.198+0000 7f6cca200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:05.282 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: in thread 7f6cca200700 thread_name:ms_dispatch 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6cd4835d20] 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2: gsignal() 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 3: abort() 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6cd5aad437] 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6cd5aad5a3] 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56385a0e7822] 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56385a057598] 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56385a059c17] 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x563859f52d0b] 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563859f532ac] 2024-04-26T11:44:05.283 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x563859f3bfad] 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6cd5d41e20] 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 13: (DispatchQueue::entry()+0x51f) [0x7f6cd5d3efdf] 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cd5e11fc1] 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6cd482b1ca] 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 16: clone() 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: -1> 2024-04-26T11:44:05.196+0000 7f6cca200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6cca200700 time 2024-04-26T11:44:05.196068+0000 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.284 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6cd5aad3dd] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6cd5aad5a3] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56385a0e7822] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56385a057598] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56385a059c17] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x563859f52d0b] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563859f532ac] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x563859f3bfad] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6cd5d41e20] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 10: (DispatchQueue::entry()+0x51f) [0x7f6cd5d3efdf] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cd5e11fc1] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6cd482b1ca] 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 13: clone() 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.285 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 0> 2024-04-26T11:44:05.198+0000 7f6cca200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:05.286 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: in thread 7f6cca200700 thread_name:ms_dispatch 2024-04-26T11:44:05.286 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.286 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-mon[28069]: pgmap v434: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6cd4835d20] 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2: gsignal() 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 3: abort() 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6cd5aad437] 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6cd5aad5a3] 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56385a0e7822] 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56385a057598] 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56385a059c17] 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x563859f52d0b] 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x563859f532ac] 2024-04-26T11:44:05.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x563859f3bfad] 2024-04-26T11:44:05.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6cd5d41e20] 2024-04-26T11:44:05.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 13: (DispatchQueue::entry()+0x51f) [0x7f6cd5d3efdf] 2024-04-26T11:44:05.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6cd5e11fc1] 2024-04-26T11:44:05.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6cd482b1ca] 2024-04-26T11:44:05.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 16: clone() 2024-04-26T11:44:05.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:05.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[93723]: 2024-04-26T11:44:05.543 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:05 smithi110 podman[94004]: 2024-04-26 11:44:05.382365495 +0000 UTC m=+0.045367238 container died 9074554902d5fb84c26dbe118e1330eedc2d83f284752d95099765eb08adf0d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T11:44:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:05 smithi193 ceph-mon[32782]: pgmap v434: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-04-26T11:44:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:05 smithi196 ceph-mon[32572]: pgmap v434: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-04-26T11:44:06.346 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:06 smithi110 podman[94004]: 2024-04-26 11:44:06.065113985 +0000 UTC m=+0.728115719 container remove 9074554902d5fb84c26dbe118e1330eedc2d83f284752d95099765eb08adf0d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T11:44:06.347 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:06 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:44:06.791 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:06 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T11:44:06.791 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:06 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.818s CPU time. 2024-04-26T11:44:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:07 smithi193 ceph-mon[32782]: pgmap v435: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-04-26T11:44:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:07 smithi193 ceph-mon[32782]: osdmap e140: 12 total, 12 up, 12 in 2024-04-26T11:44:07.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:07 smithi196 ceph-mon[32572]: pgmap v435: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-04-26T11:44:07.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:07 smithi196 ceph-mon[32572]: osdmap e140: 12 total, 12 up, 12 in 2024-04-26T11:44:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:07 smithi110 ceph-mon[28069]: pgmap v435: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 11 MiB/s wr, 1.03k op/s 2024-04-26T11:44:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:07 smithi110 ceph-mon[28069]: osdmap e140: 12 total, 12 up, 12 in 2024-04-26T11:44:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:09 smithi193 ceph-mon[32782]: pgmap v437: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 14 MiB/s wr, 1.29k op/s 2024-04-26T11:44:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:09 smithi196 ceph-mon[32572]: pgmap v437: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 14 MiB/s wr, 1.29k op/s 2024-04-26T11:44:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:09 smithi110 ceph-mon[28069]: pgmap v437: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 14 MiB/s wr, 1.29k op/s 2024-04-26T11:44:09.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 715.0 s, 151.1 tps, lat 67.865 ms stddev 69.989 2024-04-26T11:44:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.411+0000 7faebb000640 1 -- 172.21.15.110:0/3154613752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faeb4104230 msgr2=0x7faeb410c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.411+0000 7faebb000640 1 --2- 172.21.15.110:0/3154613752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faeb4104230 0x7faeb410c710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faea0009900 tx=0x7faea002a490 comp rx=0 tx=0).stop 2024-04-26T11:44:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.411+0000 7faebb000640 1 -- 172.21.15.110:0/3154613752 shutdown_connections 2024-04-26T11:44:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.411+0000 7faebb000640 1 --2- 172.21.15.110:0/3154613752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faeb410cd30 0x7faeb410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.411+0000 7faebb000640 1 --2- 172.21.15.110:0/3154613752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faeb4104230 0x7faeb410c710 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.411+0000 7faebb000640 1 --2- 172.21.15.110:0/3154613752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb4103910 0x7faeb4103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.411+0000 7faebb000640 1 -- 172.21.15.110:0/3154613752 >> 172.21.15.110:0/3154613752 conn(0x7faeb40fd110 msgr2=0x7faeb40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.411+0000 7faebb000640 1 -- 172.21.15.110:0/3154613752 shutdown_connections 2024-04-26T11:44:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.411+0000 7faebb000640 1 -- 172.21.15.110:0/3154613752 wait complete. 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.412+0000 7faebb000640 1 Processor -- start 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.412+0000 7faebb000640 1 -- start start 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faebb000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faeb4103910 0x7faeb419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faebb000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb4104230 0x7faeb419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faebb000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faeb410cd30 0x7faeb419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faebb000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4112a30 con 0x7faeb4104230 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faebb000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41128b0 con 0x7faeb4103910 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faebb000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4112bb0 con 0x7faeb410cd30 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faeb4103910 0x7faeb419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faeb9200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb4104230 0x7faeb419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faeb4103910 0x7faeb419b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:59494/0 (socket says 172.21.15.110:59494) 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faeb9c00640 1 -- 172.21.15.110:0/2607102450 learned_addr learned my addr 172.21.15.110:0/2607102450 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.413+0000 7faeba600640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faeb410cd30 0x7faeb419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeb9c00640 1 -- 172.21.15.110:0/2607102450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faeb410cd30 msgr2=0x7faeb419fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeb9c00640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faeb410cd30 0x7faeb419fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeb9c00640 1 -- 172.21.15.110:0/2607102450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb4104230 msgr2=0x7faeb419b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeb9c00640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb4104230 0x7faeb419b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeb9c00640 1 -- 172.21.15.110:0/2607102450 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb41a0180 con 0x7faeb4103910 2024-04-26T11:44:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeba600640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faeb410cd30 0x7faeb419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:44:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeb9c00640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faeb4103910 0x7faeb419b190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faea800e9f0 tx=0x7faea800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeb2000640 1 -- 172.21.15.110:0/2607102450 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea800cd80 con 0x7faeb4103910 2024-04-26T11:44:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faebb000640 1 -- 172.21.15.110:0/2607102450 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb41a0470 con 0x7faeb4103910 2024-04-26T11:44:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeb2000640 1 -- 172.21.15.110:0/2607102450 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea80108e0 con 0x7faeb4103910 2024-04-26T11:44:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faeb2000640 1 -- 172.21.15.110:0/2607102450 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8018980 con 0x7faeb4103910 2024-04-26T11:44:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.414+0000 7faebb000640 1 -- 172.21.15.110:0/2607102450 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb41a7d00 con 0x7faeb4103910 2024-04-26T11:44:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.418+0000 7faeb2000640 1 -- 172.21.15.110:0/2607102450 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7faea8010430 con 0x7faeb4103910 2024-04-26T11:44:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.418+0000 7faebf3fd740 1 Processor -- start 2024-04-26T11:44:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.418+0000 7faebf3fd740 1 -- start start 2024-04-26T11:44:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.418+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.418+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fcbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.418+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.418+0000 7faebf3fd740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561aa0f26380 con 0x561aa0fc0fe0 2024-04-26T11:44:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.418+0000 7faebf3fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561aa0ec2c30 con 0x561aa0fc1900 2024-04-26T11:44:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.418+0000 7faebf3fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561aa0f22340 con 0x561aa0fcc1c0 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeba600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeb9200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fcbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeba600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34974/0 (socket says 172.21.15.110:34974) 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeba600640 1 -- 172.21.15.110:0/267031111 learned_addr learned my addr 172.21.15.110:0/267031111 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeb9200640 1 -- 172.21.15.110:0/267031111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 msgr2=0x561aa0fcbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeb9200640 1 --2- 172.21.15.110:0/267031111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fcbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeb9200640 1 -- 172.21.15.110:0/267031111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 msgr2=0x561aa0fc13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeb9200640 1 --2- 172.21.15.110:0/267031111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeb9200640 1 -- 172.21.15.110:0/267031111 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561aa0ee4940 con 0x561aa0fcc1c0 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.419+0000 7faeba600640 1 --2- 172.21.15.110:0/267031111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.420+0000 7faeb9200640 1 --2- 172.21.15.110:0/267031111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fce5b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faea002aa80 tx=0x7faea00040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf6768dade8fc58a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.420+0000 7faeb2000640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d60 0x7fae9c0a6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.420+0000 7faea6a00640 1 -- 172.21.15.110:0/267031111 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0035040 con 0x561aa0fcc1c0 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.420+0000 7faea6a00640 1 -- 172.21.15.110:0/267031111 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea0004480 con 0x561aa0fcc1c0 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.420+0000 7faea6a00640 1 -- 172.21.15.110:0/267031111 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea00035f0 con 0x561aa0fcc1c0 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.420+0000 7faeb2000640 1 -- 172.21.15.110:0/2607102450 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 11569+0+0 (secure 0 0 0) 0x7faea80d16b0 con 0x7faeb4103910 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.420+0000 7faeba600640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d60 0x7fae9c0a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 -- 172.21.15.110:0/267031111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 msgr2=0x561aa0fce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 --2- 172.21.15.110:0/267031111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fce5b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7faea002aa80 tx=0x7faea00040d0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faeba600640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d60 0x7fae9c0a6220 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faeac009fd0 tx=0x7faeac009500 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 -- 172.21.15.110:0/267031111 shutdown_connections 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 --2- 172.21.15.110:0/267031111 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fce5b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 --2- 172.21.15.110:0/267031111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fcbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 --2- 172.21.15.110:0/267031111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 -- 172.21.15.110:0/267031111 >> 172.21.15.110:0/267031111 conn(0x561aa0fbd4f0 msgr2=0x561aa0fbd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 -- 172.21.15.110:0/267031111 shutdown_connections 2024-04-26T11:44:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 -- 172.21.15.110:0/267031111 wait complete. 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.421+0000 7faebf3fd740 1 -- start start 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faebf3fd740 1 Processor -- start 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fc9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faebf3fd740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561aa0fced90 con 0x561aa0fc0fe0 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faebf3fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561aa0eadc60 con 0x561aa0fc1900 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faebf3fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561aa0fcef10 con 0x561aa0fcc1c0 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faebf3fd740 10 client.0 _ll_register_callbacks cb 0x561aa0ed9e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34982/0 (socket says 172.21.15.110:34982) 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faeb9c00640 1 -- 172.21.15.110:0/2233884686 learned_addr learned my addr 172.21.15.110:0/2233884686 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.422+0000 7faeb9200640 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7faeba600640 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fc9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7faeb9c00640 1 -- 172.21.15.110:0/2233884686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 msgr2=0x561aa0fc9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7faeb9c00640 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fc9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7faeb9c00640 1 -- 172.21.15.110:0/2233884686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 msgr2=0x561aa0fc9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7faeb9c00640 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7faeb9c00640 1 -- 172.21.15.110:0/2233884686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561aa0ebc510 con 0x561aa0fc0fe0 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7faeb9200640 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7faeb9c00640 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc9100 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faea800c6a0 tx=0x7faea8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d971be348f394835 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7fae9b400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7fae9b400640 1 -- 172.21.15.110:0/2233884686 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea809c650 con 0x561aa0fc0fe0 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7faebf3fd740 1 -- 172.21.15.110:0/2233884686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faea0004480 con 0x561aa0fc0fe0 2024-04-26T11:44:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.423+0000 7fae9b400640 1 -- 172.21.15.110:0/2233884686 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 11569+0+0 (secure 0 0 0) 0x7faea80a0ae0 con 0x561aa0fc0fe0 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7fae9b400640 1 -- 172.21.15.110:0/2233884686 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=216) ==== 24+0+0 (secure 0 0 0) 0x7faea809c470 con 0x561aa0fc0fe0 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7faebf3fd740 10 client.16059 fetch_fsmap learned FSMap version 216 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7faebf3fd740 1 -- 172.21.15.110:0/2233884686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=216,monmap=4+}) -- 0x561aa0c38210 con 0x561aa0fc0fe0 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7fae9b400640 1 -- 172.21.15.110:0/2233884686 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea0004480 con 0x561aa0fc0fe0 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7fae9b400640 1 -- 172.21.15.110:0/2233884686 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 216) ==== 5926+0+0 (secure 0 0 0) 0x7faea80d1b60 con 0x561aa0fc0fe0 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7faebf3fd740 10 client.16059 fetch_fsmap finished waiting for FSMap version 216 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7faebf3fd740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7faebf3fd740 20 client.16059 populate_metadata read hostname 'smithi110' 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7faebf3fd740 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561aa0fdc110 0x561aa0fde520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7faebf3fd740 4 client.16059 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.424+0000 7faebf3fd740 1 -- 172.21.15.110:0/2233884686 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561aa0f33f90 con 0x561aa0fdc110 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.425+0000 7faeb9200640 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561aa0fdc110 0x561aa0fde520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.425+0000 7faeb9200640 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561aa0fdc110 0x561aa0fde520 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c87687e399d01060 server_cookie=3660bfdbba25c4ac in_seq=0 out_seq=0 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.425+0000 7fae9b400640 10 client.16059 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:44:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7fae9b400640 1 -- 172.21.15.110:0/2233884686 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561aa0f33f90 con 0x561aa0fdc110 2024-04-26T11:44:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7fae9b400640 10 client.16059 handle_command_reply: tid=0 2024-04-26T11:44:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7faebf3fd740 1 client.16059 shutdown 2024-04-26T11:44:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7faebf3fd740 1 -- 172.21.15.110:0/2233884686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 msgr2=0x561aa0fc9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7faebf3fd740 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc9100 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faea800c6a0 tx=0x7faea8009310 comp rx=0 tx=0).stop 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7faebf3fd740 1 -- 172.21.15.110:0/2233884686 shutdown_connections 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7faebf3fd740 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561aa0fdc110 0x561aa0fde520 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7faebf3fd740 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fc9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7faebf3fd740 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7fae9b400640 0 client.16059 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7faebf3fd740 1 --2- 172.21.15.110:0/2233884686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc9100 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.426+0000 7faebf3fd740 1 -- 172.21.15.110:0/2233884686 >> 172.21.15.110:0/2233884686 conn(0x561aa0fbd4f0 msgr2=0x561aa0fc3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.427+0000 7faebf3fd740 1 -- 172.21.15.110:0/2233884686 shutdown_connections 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.427+0000 7faebf3fd740 1 -- 172.21.15.110:0/2233884686 wait complete. 2024-04-26T11:44:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.427+0000 7faebf3fd740 20 client.16059 trim_cache size 0 max 16384 2024-04-26T11:44:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faebf3fd740 1 Processor -- start 2024-04-26T11:44:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faebf3fd740 1 -- start start 2024-04-26T11:44:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fd7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fe3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faebf3fd740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b1bb0 con 0x561aa0fc0fe0 2024-04-26T11:44:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faebf3fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b3720 con 0x561aa0fc1900 2024-04-26T11:44:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faebf3fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b2280 con 0x561aa0fcc1c0 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fd7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.443+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fd7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34998/0 (socket says 172.21.15.110:34998) 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeb9c00640 1 -- 172.21.15.110:0/1859855136 learned_addr learned my addr 172.21.15.110:0/1859855136 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeba600640 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fe3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeb9200640 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeb9c00640 1 -- 172.21.15.110:0/1859855136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 msgr2=0x561aa0fe3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeb9c00640 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fe3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeb9c00640 1 -- 172.21.15.110:0/1859855136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 msgr2=0x561aa0fc80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeb9c00640 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeb9c00640 1 -- 172.21.15.110:0/1859855136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561aa0d04620 con 0x561aa0fc0fe0 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeb9200640 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:44:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faeb9c00640 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fd7c50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faea80ce810 tx=0x7faea8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcf1a822470ed00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faea6000640 1 -- 172.21.15.110:0/1859855136 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea809c650 con 0x561aa0fc0fe0 2024-04-26T11:44:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faea6000640 1 -- 172.21.15.110:0/1859855136 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea8010720 con 0x561aa0fc0fe0 2024-04-26T11:44:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.444+0000 7faea6000640 1 -- 172.21.15.110:0/1859855136 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea80a0970 con 0x561aa0fc0fe0 2024-04-26T11:44:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.445+0000 7faebf3fd740 1 -- 172.21.15.110:0/1859855136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 msgr2=0x561aa0fd7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.445+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fd7c50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faea80ce810 tx=0x7faea8000bc0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.445+0000 7faebf3fd740 1 -- 172.21.15.110:0/1859855136 shutdown_connections 2024-04-26T11:44:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.445+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fcc1c0 0x561aa0fe3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.445+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc1900 0x561aa0fc80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.445+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1859855136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fc0fe0 0x561aa0fd7c50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.445+0000 7faebf3fd740 1 -- 172.21.15.110:0/1859855136 >> 172.21.15.110:0/1859855136 conn(0x561aa0fbd4f0 msgr2=0x561aa0fc79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.445+0000 7faebf3fd740 1 -- 172.21.15.110:0/1859855136 shutdown_connections 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.445+0000 7faebf3fd740 1 -- 172.21.15.110:0/1859855136 wait complete. 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.446+0000 7faebf3fd740 1 -- start start 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.446+0000 7faebf3fd740 1 Processor -- start 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.446+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.446+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fc1900 0x561aa0fd4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.446+0000 7faebf3fd740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fcc1c0 0x561aa0fc5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.446+0000 7faebf3fd740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b3050 con 0x561aa0fcc1c0 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.446+0000 7faebf3fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b2980 con 0x561aa0fc0fe0 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.446+0000 7faebf3fd740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b03a0 con 0x561aa0fc1900 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.446+0000 7faebf3fd740 10 client.0 _ll_register_callbacks cb 0x7faea800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:44:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeba600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fcc1c0 0x561aa0fc5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeb9c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeb9200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fc1900 0x561aa0fd4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeba600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fcc1c0 0x561aa0fc5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35002/0 (socket says 172.21.15.110:35002) 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeba600640 1 -- 172.21.15.110:0/1492271001 learned_addr learned my addr 172.21.15.110:0/1492271001 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeb9c00640 1 -- 172.21.15.110:0/1492271001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fc1900 msgr2=0x561aa0fd4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeb9c00640 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fc1900 0x561aa0fd4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeb9c00640 1 -- 172.21.15.110:0/1492271001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fcc1c0 msgr2=0x561aa0fc5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeb9c00640 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fcc1c0 0x561aa0fc5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeb9c00640 1 -- 172.21.15.110:0/1492271001 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561aa0ee0cb0 con 0x561aa0fc0fe0 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7faeb9c00640 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc6de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faea800c6a0 tx=0x7faea8009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=432555d983ba68d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.447+0000 7fae9b400640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7fae9b400640 1 -- 172.21.15.110:0/1492271001 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea809c650 con 0x561aa0fc0fe0 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7fae9b400640 1 -- 172.21.15.110:0/1492271001 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 11569+0+0 (secure 0 0 0) 0x7faea80a0b70 con 0x561aa0fc0fe0 2024-04-26T11:44:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7faebf3fd740 1 -- 172.21.15.110:0/1492271001 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561aa0f2de00 con 0x561aa0fc0fe0 2024-04-26T11:44:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7fae9b400640 1 -- 172.21.15.110:0/1492271001 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=216) ==== 24+0+0 (secure 0 0 0) 0x7faea80a56d0 con 0x561aa0fc0fe0 2024-04-26T11:44:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7faebf3fd740 10 client.26318 fetch_fsmap learned FSMap version 216 2024-04-26T11:44:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7faebf3fd740 1 -- 172.21.15.110:0/1492271001 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=216,monmap=4+}) -- 0x561aa1041b90 con 0x561aa0fc0fe0 2024-04-26T11:44:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7fae9b400640 1 -- 172.21.15.110:0/1492271001 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561aa0f2de00 con 0x561aa0fc0fe0 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7fae9b400640 1 -- 172.21.15.110:0/1492271001 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 216) ==== 5926+0+0 (secure 0 0 0) 0x7faea80b2c90 con 0x561aa0fc0fe0 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7faebf3fd740 10 client.26318 fetch_fsmap finished waiting for FSMap version 216 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7faebf3fd740 10 client.26318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.448+0000 7faebf3fd740 20 client.26318 populate_metadata read hostname 'smithi110' 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.449+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561aa1041fc0 0x561aa10443b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.449+0000 7faebf3fd740 4 client.26318 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.449+0000 7faebf3fd740 1 -- 172.21.15.110:0/1492271001 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561aa0ea94b0 con 0x561aa1041fc0 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.449+0000 7faeb9200640 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561aa1041fc0 0x561aa10443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.449+0000 7faeb9200640 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561aa1041fc0 0x561aa10443b0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672dc3523e30e96 server_cookie=48fcb5f8ea2c5671 in_seq=0 out_seq=0 2024-04-26T11:44:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:11.449+0000 7fae9b400640 10 client.26318 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:44:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:11 smithi193 ceph-mon[32782]: pgmap v438: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2024-04-26T11:44:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:11 smithi196 ceph-mon[32572]: pgmap v438: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2024-04-26T11:44:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:11 smithi110 ceph-mon[28069]: pgmap v438: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2024-04-26T11:44:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:13 smithi193 ceph-mon[32782]: pgmap v439: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2024-04-26T11:44:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:13 smithi196 ceph-mon[32572]: pgmap v439: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2024-04-26T11:44:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:13 smithi110 ceph-mon[28069]: pgmap v439: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2024-04-26T11:44:14.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:44:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:14 smithi110 ceph-mon[28069]: osdmap e141: 12 total, 12 up, 12 in 2024-04-26T11:44:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:14 smithi110 ceph-mon[28069]: pgmap v441: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 4.7 MiB/s wr, 364 op/s 2024-04-26T11:44:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:14 smithi193 ceph-mon[32782]: osdmap e141: 12 total, 12 up, 12 in 2024-04-26T11:44:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:14 smithi193 ceph-mon[32782]: pgmap v441: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 4.7 MiB/s wr, 364 op/s 2024-04-26T11:44:15.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:14 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:44:15.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:14 smithi193 systemd[1]: Stopped Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:44:15.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:14 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.335s CPU time. 2024-04-26T11:44:15.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:14 smithi193 systemd[1]: Starting Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:44:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:14 smithi196 ceph-mon[32572]: osdmap e141: 12 total, 12 up, 12 in 2024-04-26T11:44:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:14 smithi196 ceph-mon[32572]: pgmap v441: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 4.7 MiB/s wr, 364 op/s 2024-04-26T11:44:15.410 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:15 smithi193 podman[69772]: 2024-04-26 11:44:15.037991863 +0000 UTC m=+0.021720594 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:44:15.411 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:15 smithi193 podman[69772]: 2024-04-26 11:44:15.165591904 +0000 UTC m=+0.149320677 container create 7334f29e9becd2f3d1cacacad12aee6ee8eac5826e687ae1b5959f7f8b0d69f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-26T11:44:15.411 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:15 smithi193 podman[69772]: 2024-04-26 11:44:15.410382909 +0000 UTC m=+0.394111644 container init 7334f29e9becd2f3d1cacacad12aee6ee8eac5826e687ae1b5959f7f8b0d69f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-04-26T11:44:15.776 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:15 smithi193 podman[69772]: 2024-04-26 11:44:15.41348855 +0000 UTC m=+0.397217285 container start 7334f29e9becd2f3d1cacacad12aee6ee8eac5826e687ae1b5959f7f8b0d69f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T11:44:15.776 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-mds[69790]: -- 172.21.15.193:0/2784998001 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56335f3e1a40 con 0x56335f3b5000 2024-04-26T11:44:15.776 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: starting mds.k at 2024-04-26T11:44:15.777 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:15 smithi193 bash[69772]: 7334f29e9becd2f3d1cacacad12aee6ee8eac5826e687ae1b5959f7f8b0d69f7 2024-04-26T11:44:15.777 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:44:15 smithi193 systemd[1]: Started Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:44:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:15 smithi110 ceph-mon[28069]: daemon mds.k restarted 2024-04-26T11:44:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:15 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:44:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:44:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:15 smithi110 ceph-mon[28069]: osdmap e142: 12 total, 12 up, 12 in 2024-04-26T11:44:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:15 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:boot 2024-04-26T11:44:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:15 smithi110 ceph-mon[28069]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T11:44:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:15 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:44:16.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:15 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=l=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-mon[32782]: daemon mds.k restarted 2024-04-26T11:44:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:44:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:44:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-mon[32782]: osdmap e142: 12 total, 12 up, 12 in 2024-04-26T11:44:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:boot 2024-04-26T11:44:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-mon[32782]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T11:44:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:44:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:15 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=l=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:15 smithi196 ceph-mon[32572]: daemon mds.k restarted 2024-04-26T11:44:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:15 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:44:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:44:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:15 smithi196 ceph-mon[32572]: osdmap e142: 12 total, 12 up, 12 in 2024-04-26T11:44:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:15 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:boot 2024-04-26T11:44:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:15 smithi196 ceph-mon[32572]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T11:44:16.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:15 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:44:16.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:15 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=l=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:16 smithi110 ceph-mon[28069]: pgmap v443: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.5 MiB/s wr, 150 op/s 2024-04-26T11:44:17.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:16 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 4. 2024-04-26T11:44:17.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:16 smithi110 systemd[1]: Stopped Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:44:17.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:16 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.818s CPU time. 2024-04-26T11:44:17.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:16 smithi110 systemd[1]: Starting Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:44:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:16 smithi193 ceph-mon[32782]: pgmap v443: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.5 MiB/s wr, 150 op/s 2024-04-26T11:44:17.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:16 smithi196 ceph-mon[32572]: pgmap v443: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.5 MiB/s wr, 150 op/s 2024-04-26T11:44:17.479 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:17 smithi110 podman[94141]: 2024-04-26 11:44:17.106411109 +0000 UTC m=+0.032534248 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:44:17.479 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:17 smithi110 podman[94141]: 2024-04-26 11:44:17.267222984 +0000 UTC m=+0.193346160 container create b54738a28911f76e6f9de9b38f7fdcd48396a6d27e4b0c4927bc6229666da6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T11:44:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:resolve 2024-04-26T11:44:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=l=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mon[28069]: daemon mds.j restarted 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mon[28069]: osdmap e143: 12 total, 12 up, 12 in 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:boot 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mon[28069]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=l=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:17 smithi110 podman[94141]: 2024-04-26 11:44:17.587886814 +0000 UTC m=+0.514010060 container init b54738a28911f76e6f9de9b38f7fdcd48396a6d27e4b0c4927bc6229666da6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:17 smithi110 podman[94141]: 2024-04-26 11:44:17.599086399 +0000 UTC m=+0.525209608 container start b54738a28911f76e6f9de9b38f7fdcd48396a6d27e4b0c4927bc6229666da6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-mds[94160]: -- 172.21.15.110:0/1081574245 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560a8e59da40 con 0x560a8e570c00 2024-04-26T11:44:18.043 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: starting mds.j at 2024-04-26T11:44:18.044 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:17 smithi110 bash[94141]: b54738a28911f76e6f9de9b38f7fdcd48396a6d27e4b0c4927bc6229666da6ab 2024-04-26T11:44:18.044 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:44:17 smithi110 systemd[1]: Started Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:44:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:17 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:resolve 2024-04-26T11:44:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:17 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=l=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:18.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:17 smithi193 ceph-mon[32782]: daemon mds.j restarted 2024-04-26T11:44:18.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:17 smithi193 ceph-mon[32782]: osdmap e143: 12 total, 12 up, 12 in 2024-04-26T11:44:18.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:17 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:boot 2024-04-26T11:44:18.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:17 smithi193 ceph-mon[32782]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-04-26T11:44:18.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:44:18.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:17 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:44:18.124 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:17 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=l=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:17 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:resolve 2024-04-26T11:44:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:17 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=l=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:17 smithi196 ceph-mon[32572]: daemon mds.j restarted 2024-04-26T11:44:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:17 smithi196 ceph-mon[32572]: osdmap e143: 12 total, 12 up, 12 in 2024-04-26T11:44:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:17 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:boot 2024-04-26T11:44:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:17 smithi196 ceph-mon[32572]: Standby daemon mds.d assigned to filesystem cephfs as rank 1 2024-04-26T11:44:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:44:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:17 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:44:18.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:17 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:replay,2=l=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:18 smithi193 ceph-mon[32782]: pgmap v445: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.8 MiB/s wr, 157 op/s 2024-04-26T11:44:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:18 smithi196 ceph-mon[32572]: pgmap v445: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.8 MiB/s wr, 157 op/s 2024-04-26T11:44:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:18 smithi110 ceph-mon[28069]: pgmap v445: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.8 MiB/s wr, 157 op/s 2024-04-26T11:44:19.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:44:20.063 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:resolve 2024-04-26T11:44:20.063 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:19 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=l=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:resolve 2024-04-26T11:44:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:19 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=l=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:resolve 2024-04-26T11:44:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:19 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:resolve,2=l=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.845+0000 7fae9b400640 1 -- 172.21.15.110:0/1492271001 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561aa0ea94b0 con 0x561aa1041fc0 2024-04-26T11:44:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.845+0000 7fae9b400640 10 client.26318 handle_command_reply: tid=0 2024-04-26T11:44:20.846 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.845+0000 7faebf3fd740 1 client.26318 shutdown 2024-04-26T11:44:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.846+0000 7faebf3fd740 1 -- 172.21.15.110:0/1492271001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc0fe0 msgr2=0x561aa0fc6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.846+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc6de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faea800c6a0 tx=0x7faea8009330 comp rx=0 tx=0).stop 2024-04-26T11:44:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.846+0000 7faebf3fd740 1 -- 172.21.15.110:0/1492271001 shutdown_connections 2024-04-26T11:44:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.846+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561aa0fcc1c0 0x561aa0fc5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:20.847 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.846+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x561aa1041fc0 0x561aa10443b0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.846+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561aa0fc1900 0x561aa0fd4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.846+0000 7faebf3fd740 1 --2- 172.21.15.110:0/1492271001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561aa0fc0fe0 0x561aa0fc6de0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.846+0000 7fae9b400640 0 client.26318 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:44:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.846+0000 7faebf3fd740 1 -- 172.21.15.110:0/1492271001 >> 172.21.15.110:0/1492271001 conn(0x561aa0fbd4f0 msgr2=0x561aa0fc9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:20.848 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.847+0000 7faebf3fd740 1 -- 172.21.15.110:0/1492271001 shutdown_connections 2024-04-26T11:44:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.847+0000 7faebf3fd740 1 -- 172.21.15.110:0/1492271001 wait complete. 2024-04-26T11:44:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.847+0000 7faebf3fd740 20 client.26318 trim_cache size 0 max 16384 2024-04-26T11:44:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:44:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:44:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:44:20.849 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:44:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.848+0000 7faebb000640 1 -- 172.21.15.110:0/2607102450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d60 msgr2=0x7fae9c0a6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.848+0000 7faebb000640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d60 0x7fae9c0a6220 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faeac009fd0 tx=0x7faeac009500 comp rx=0 tx=0).stop 2024-04-26T11:44:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.848+0000 7faebb000640 1 -- 172.21.15.110:0/2607102450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faeb4103910 msgr2=0x7faeb419b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.848+0000 7faebb000640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faeb4103910 0x7faeb419b190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faea800e9f0 tx=0x7faea800eeb0 comp rx=0 tx=0).stop 2024-04-26T11:44:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.849+0000 7faebb000640 1 -- 172.21.15.110:0/2607102450 shutdown_connections 2024-04-26T11:44:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.849+0000 7faebb000640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fae9c0a3d60 0x7fae9c0a6220 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.849+0000 7faebb000640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faeb410cd30 0x7faeb419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.849+0000 7faebb000640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeb4104230 0x7faeb419b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:20.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.849+0000 7faebb000640 1 --2- 172.21.15.110:0/2607102450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faeb4103910 0x7faeb419b190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.849+0000 7faebb000640 1 -- 172.21.15.110:0/2607102450 >> 172.21.15.110:0/2607102450 conn(0x7faeb40fd110 msgr2=0x7faeb410e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.849+0000 7faebb000640 1 -- 172.21.15.110:0/2607102450 shutdown_connections 2024-04-26T11:44:20.851 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:20.849+0000 7faebb000640 1 -- 172.21.15.110:0/2607102450 wait complete. 2024-04-26T11:44:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:20 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:44:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:20 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:reconnect 2024-04-26T11:44:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:20 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:reconnect 2024-04-26T11:44:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:20 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:20 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179997 2024-04-26T11:44:21.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:20 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.226995 2024-04-26T11:44:21.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:20 smithi193 ceph-mon[32782]: pgmap v446: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 604 KiB/s wr, 81 op/s 2024-04-26T11:44:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:20 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:44:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:20 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:reconnect 2024-04-26T11:44:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:20 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:reconnect 2024-04-26T11:44:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:20 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:20 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179997 2024-04-26T11:44:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:20 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.226995 2024-04-26T11:44:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:20 smithi196 ceph-mon[32572]: pgmap v446: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 604 KiB/s wr, 81 op/s 2024-04-26T11:44:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:20 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:44:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:20 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:reconnect 2024-04-26T11:44:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:20 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:reconnect 2024-04-26T11:44:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:20 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:21.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:20 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179997 2024-04-26T11:44:21.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:20 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.226995 2024-04-26T11:44:21.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:20 smithi110 ceph-mon[28069]: pgmap v446: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 604 KiB/s wr, 81 op/s 2024-04-26T11:44:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:21 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:rejoin 2024-04-26T11:44:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:21 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:rejoin 2024-04-26T11:44:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:21 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:21 smithi193 ceph-mon[32782]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T11:44:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:21 smithi193 ceph-mon[32782]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-04-26T11:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:21 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:rejoin 2024-04-26T11:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:21 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:rejoin 2024-04-26T11:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:21 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:21 smithi196 ceph-mon[32572]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T11:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:21 smithi196 ceph-mon[32572]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-04-26T11:44:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:21 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:rejoin 2024-04-26T11:44:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:21 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:rejoin 2024-04-26T11:44:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:21 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=d=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:21 smithi110 ceph-mon[28069]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T11:44:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:21 smithi110 ceph-mon[28069]: daemon mds.d is now active in filesystem cephfs as rank 1 2024-04-26T11:44:22.622 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:44:22 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:44:22.231+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T11:44:22.622 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:44:22 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:44:22.231+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T11:44:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:22 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:44:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:22 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:active 2024-04-26T11:44:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:22 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:active 2024-04-26T11:44:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:22 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:22 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:22 smithi193 ceph-mon[32782]: pgmap v447: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 480 KiB/s wr, 64 op/s 2024-04-26T11:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:22 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:22 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:active 2024-04-26T11:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:22 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:active 2024-04-26T11:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:22 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:22 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:22 smithi196 ceph-mon[32572]: pgmap v447: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 480 KiB/s wr, 64 op/s 2024-04-26T11:44:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:22 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:44:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:22 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/2463095858,v1:172.21.15.196:6833/2463095858] up:active 2024-04-26T11:44:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:22 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3929264013,v1:172.21.15.110:6837/3929264013] up:active 2024-04-26T11:44:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:22 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:22 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:22 smithi110 ceph-mon[28069]: pgmap v447: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 480 KiB/s wr, 64 op/s 2024-04-26T11:44:24.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 730.0 s, 812.3 tps, lat 480.198 ms stddev 2569.386 2024-04-26T11:44:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:24 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:24 smithi196 ceph-mon[32572]: pgmap v448: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 19 MiB/s wr, 1.32k op/s 2024-04-26T11:44:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:24 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:24 smithi110 ceph-mon[28069]: pgmap v448: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 19 MiB/s wr, 1.32k op/s 2024-04-26T11:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:24 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:24 smithi193 ceph-mon[32782]: pgmap v448: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 19 MiB/s wr, 1.32k op/s 2024-04-26T11:44:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:25 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:25 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:25 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=d=up:active,2=l=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:26 smithi196 ceph-mon[32572]: pgmap v449: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 17 MiB/s wr, 1.15k op/s 2024-04-26T11:44:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:26 smithi110 ceph-mon[28069]: pgmap v449: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 17 MiB/s wr, 1.15k op/s 2024-04-26T11:44:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:26 smithi193 ceph-mon[32782]: pgmap v449: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 17 MiB/s wr, 1.15k op/s 2024-04-26T11:44:29.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f210d200700 time 2024-04-26T11:44:28.622769+0000 2024-04-26T11:44:29.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:29.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f2118afd3dd] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2118afd5a3] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5617d9295822] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5617d9205598] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5617d9207c17] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5617d9100d0b] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5617d91012ac] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5617d90e9fad] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2118d91e20] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 10: (DispatchQueue::entry()+0x51f) [0x7f2118d8efdf] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2118e61fc1] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f211787b1ca] 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 13: clone() 2024-04-26T11:44:29.044 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: *** Caught signal (Aborted) ** 2024-04-26T11:44:29.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: in thread 7f210d200700 thread_name:ms_dispatch 2024-04-26T11:44:29.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:28.625+0000 7f210d200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f210d200700 time 2024-04-26T11:44:28.622769+0000 2024-04-26T11:44:29.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:29.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:29.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f2118afd3dd] 2024-04-26T11:44:29.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2118afd5a3] 2024-04-26T11:44:29.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5617d9295822] 2024-04-26T11:44:29.045 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5617d9205598] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5617d9207c17] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5617d9100d0b] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5617d91012ac] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5617d90e9fad] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2118d91e20] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 10: (DispatchQueue::entry()+0x51f) [0x7f2118d8efdf] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2118e61fc1] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f211787b1ca] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 13: clone() 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2117885d20] 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2: gsignal() 2024-04-26T11:44:29.046 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 3: abort() 2024-04-26T11:44:29.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2118afd437] 2024-04-26T11:44:29.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2118afd5a3] 2024-04-26T11:44:29.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5617d9295822] 2024-04-26T11:44:29.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5617d9205598] 2024-04-26T11:44:29.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5617d9207c17] 2024-04-26T11:44:29.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5617d9100d0b] 2024-04-26T11:44:29.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5617d91012ac] 2024-04-26T11:44:29.047 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5617d90e9fad] 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2118d91e20] 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 13: (DispatchQueue::entry()+0x51f) [0x7f2118d8efdf] 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2118e61fc1] 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f211787b1ca] 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 16: clone() 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:28.630+0000 7f210d200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: in thread 7f210d200700 thread_name:ms_dispatch 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2117885d20] 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2: gsignal() 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 3: abort() 2024-04-26T11:44:29.048 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2118afd437] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2118afd5a3] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5617d9295822] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5617d9205598] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5617d9207c17] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5617d9100d0b] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5617d91012ac] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5617d90e9fad] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2118d91e20] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 13: (DispatchQueue::entry()+0x51f) [0x7f2118d8efdf] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2118e61fc1] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f211787b1ca] 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 16: clone() 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:29.049 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: -1> 2024-04-26T11:44:28.625+0000 7f210d200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f210d200700 time 2024-04-26T11:44:28.622769+0000 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f2118afd3dd] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2118afd5a3] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5617d9295822] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5617d9205598] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5617d9207c17] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5617d9100d0b] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5617d91012ac] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5617d90e9fad] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2118d91e20] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 10: (DispatchQueue::entry()+0x51f) [0x7f2118d8efdf] 2024-04-26T11:44:29.050 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2118e61fc1] 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f211787b1ca] 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 13: clone() 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 0> 2024-04-26T11:44:28.630+0000 7f210d200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: in thread 7f210d200700 thread_name:ms_dispatch 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2117885d20] 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2: gsignal() 2024-04-26T11:44:29.051 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 3: abort() 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2118afd437] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2118afd5a3] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5617d9295822] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5617d9205598] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5617d9207c17] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5617d9100d0b] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5617d91012ac] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5617d90e9fad] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2118d91e20] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 13: (DispatchQueue::entry()+0x51f) [0x7f2118d8efdf] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2118e61fc1] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f211787b1ca] 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 16: clone() 2024-04-26T11:44:29.052 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:29.053 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.053 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: -4> 2024-04-26T11:44:28.625+0000 7f210d200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f210d200700 time 2024-04-26T11:44:28.622769+0000 2024-04-26T11:44:29.053 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:29.053 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.053 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:29.053 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f2118afd3dd] 2024-04-26T11:44:29.053 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2118afd5a3] 2024-04-26T11:44:29.053 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5617d9295822] 2024-04-26T11:44:29.055 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5617d9205598] 2024-04-26T11:44:29.055 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5617d9207c17] 2024-04-26T11:44:29.055 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5617d9100d0b] 2024-04-26T11:44:29.055 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5617d91012ac] 2024-04-26T11:44:29.055 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5617d90e9fad] 2024-04-26T11:44:29.055 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2118d91e20] 2024-04-26T11:44:29.055 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 10: (DispatchQueue::entry()+0x51f) [0x7f2118d8efdf] 2024-04-26T11:44:29.055 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2118e61fc1] 2024-04-26T11:44:29.055 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f211787b1ca] 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 13: clone() 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: -3> 2024-04-26T11:44:28.630+0000 7f210d200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: in thread 7f210d200700 thread_name:ms_dispatch 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2117885d20] 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2: gsignal() 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 3: abort() 2024-04-26T11:44:29.056 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2118afd437] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2118afd5a3] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5617d9295822] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5617d9205598] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5617d9207c17] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5617d9100d0b] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5617d91012ac] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5617d90e9fad] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2118d91e20] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 13: (DispatchQueue::entry()+0x51f) [0x7f2118d8efdf] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2118e61fc1] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f211787b1ca] 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 16: clone() 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[93961]: 2024-04-26T11:44:29.057 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:28 smithi110 podman[94200]: 2024-04-26 11:44:28.776285054 +0000 UTC m=+0.037241922 container died 0cba203fbaaf422721ddb26d77c09078c7bad5ab38f0853c30177c4801aaf2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-26T11:44:29.459 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:29 smithi110 ceph-mon[28069]: pgmap v450: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 23 MiB/s wr, 1.55k op/s 2024-04-26T11:44:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:29 smithi196 ceph-mon[32572]: pgmap v450: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 23 MiB/s wr, 1.55k op/s 2024-04-26T11:44:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:29 smithi193 ceph-mon[32782]: pgmap v450: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 916 KiB/s rd, 23 MiB/s wr, 1.55k op/s 2024-04-26T11:44:29.791 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:29 smithi110 podman[94200]: 2024-04-26 11:44:29.458531688 +0000 UTC m=+0.719488587 container remove 0cba203fbaaf422721ddb26d77c09078c7bad5ab38f0853c30177c4801aaf2f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-26T11:44:29.791 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:29 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:44:29.925 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 735.0 s, 503.3 tps, lat 49.440 ms stddev 62.561 2024-04-26T11:44:30.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:29 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T11:44:30.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:29 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.988s CPU time. 2024-04-26T11:44:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:31 smithi196 ceph-mon[32572]: pgmap v451: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 21 MiB/s wr, 1.42k op/s 2024-04-26T11:44:31.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:31 smithi110 ceph-mon[28069]: pgmap v451: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 21 MiB/s wr, 1.42k op/s 2024-04-26T11:44:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:31 smithi193 ceph-mon[32782]: pgmap v451: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 21 MiB/s wr, 1.42k op/s 2024-04-26T11:44:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:33 smithi110 ceph-mon[28069]: pgmap v452: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 21 MiB/s wr, 1.41k op/s 2024-04-26T11:44:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:33 smithi196 ceph-mon[32572]: pgmap v452: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 21 MiB/s wr, 1.41k op/s 2024-04-26T11:44:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:33 smithi193 ceph-mon[32782]: pgmap v452: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 21 MiB/s wr, 1.41k op/s 2024-04-26T11:44:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.998+0000 7fc7d9a00640 1 -- 172.21.15.110:0/1712301648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4105500 msgr2=0x7fc7d41119c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.998+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/1712301648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4105500 0x7fc7d41119c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009ca0 tx=0x7fc7cc02a8c0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.998+0000 7fc7d9a00640 1 -- 172.21.15.110:0/1712301648 shutdown_connections 2024-04-26T11:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.998+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/1712301648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4105500 0x7fc7d41119c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.998+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/1712301648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d4104b40 0x7fc7d4104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.998+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/1712301648 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d410ac00 0x7fc7d410afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.998+0000 7fc7d9a00640 1 -- 172.21.15.110:0/1712301648 >> 172.21.15.110:0/1712301648 conn(0x7fc7d4100630 msgr2=0x7fc7d4102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.998+0000 7fc7d9a00640 1 -- 172.21.15.110:0/1712301648 shutdown_connections 2024-04-26T11:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.998+0000 7fc7d9a00640 1 -- 172.21.15.110:0/1712301648 wait complete. 2024-04-26T11:44:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.999+0000 7fc7d9a00640 1 Processor -- start 2024-04-26T11:44:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:33.999+0000 7fc7d9a00640 1 -- start start 2024-04-26T11:44:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4104b40 0x7fc7d419b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d9a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d4105500 0x7fc7d419b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d9a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d410ac00 0x7fc7d419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d9a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4114ec0 con 0x7fc7d4104b40 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d9a00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4114d40 con 0x7fc7d410ac00 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d9a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4115040 con 0x7fc7d4105500 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4104b40 0x7fc7d419b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4104b40 0x7fc7d419b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46864/0 (socket says 172.21.15.110:46864) 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d2a00640 1 -- 172.21.15.110:0/306852052 learned_addr learned my addr 172.21.15.110:0/306852052 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d4105500 0x7fc7d419b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d3400640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d410ac00 0x7fc7d419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d2a00640 1 -- 172.21.15.110:0/306852052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d4105500 msgr2=0x7fc7d419b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.000+0000 7fc7d2a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d4105500 0x7fc7d419b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.001+0000 7fc7d2a00640 1 -- 172.21.15.110:0/306852052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d410ac00 msgr2=0x7fc7d419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.001+0000 7fc7d2a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d410ac00 0x7fc7d419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.001+0000 7fc7d2a00640 1 -- 172.21.15.110:0/306852052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d41a02e0 con 0x7fc7d4104b40 2024-04-26T11:44:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.001+0000 7fc7d2a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4104b40 0x7fc7d419b340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400b4a0 tx=0x7fc7c400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.001+0000 7fc7cb400640 1 -- 172.21.15.110:0/306852052 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4015020 con 0x7fc7d4104b40 2024-04-26T11:44:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.001+0000 7fc7cb400640 1 -- 172.21.15.110:0/306852052 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7c4011ce0 con 0x7fc7d4104b40 2024-04-26T11:44:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.001+0000 7fc7d9a00640 1 -- 172.21.15.110:0/306852052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d41a05d0 con 0x7fc7d4104b40 2024-04-26T11:44:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.001+0000 7fc7cb400640 1 -- 172.21.15.110:0/306852052 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4010dc0 con 0x7fc7d4104b40 2024-04-26T11:44:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.001+0000 7fc7d9a00640 1 -- 172.21.15.110:0/306852052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d41a7e60 con 0x7fc7d4104b40 2024-04-26T11:44:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.005+0000 7fc7cb400640 1 -- 172.21.15.110:0/306852052 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc7c4018020 con 0x7fc7d4104b40 2024-04-26T11:44:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.005+0000 7fc7dc856740 1 Processor -- start 2024-04-26T11:44:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.005+0000 7fc7dc856740 1 -- start start 2024-04-26T11:44:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954039dd0 0x55895403a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 0x558954044a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x5589540473a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7dc856740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558953f9f380 con 0x558954044fb0 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7dc856740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558953f3bc30 con 0x55895403a6f0 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7dc856740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558953f9b340 con 0x558954039dd0 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x5589540473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954039dd0 0x55895403a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954039dd0 0x55895403a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:46502/0 (socket says 172.21.15.110:46502) 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x5589540473a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46870/0 (socket says 172.21.15.110:46870) 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7d3400640 1 -- 172.21.15.110:0/1079506770 learned_addr learned my addr 172.21.15.110:0/1079506770 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7d2a00640 1 --2- 172.21.15.110:0/1079506770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 0x558954044a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7d3400640 1 -- 172.21.15.110:0/1079506770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 msgr2=0x558954044a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7d3400640 1 --2- 172.21.15.110:0/1079506770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 0x558954044a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7d3400640 1 -- 172.21.15.110:0/1079506770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 msgr2=0x5589540473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7d3400640 1 --2- 172.21.15.110:0/1079506770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x5589540473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7d3400640 1 -- 172.21.15.110:0/1079506770 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558953f5d940 con 0x558954039dd0 2024-04-26T11:44:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.006+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/1079506770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x5589540473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:44:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.007+0000 7fc7cb400640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc7b80a3dc0 0x7fc7b80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.007+0000 7fc7d3400640 1 --2- 172.21.15.110:0/1079506770 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954039dd0 0x55895403a1b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009ca0 tx=0x7fc7cc0099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b57350dc75d46cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.007+0000 7fc7cb400640 1 -- 172.21.15.110:0/306852052 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 11653+0+0 (secure 0 0 0) 0x7fc7c40d0bb0 con 0x7fc7d4104b40 2024-04-26T11:44:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.007+0000 7fc7d2a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc7b80a3dc0 0x7fc7b80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.007+0000 7fc7c3e00640 1 -- 172.21.15.110:0/1079506770 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc031450 con 0x558954039dd0 2024-04-26T11:44:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.007+0000 7fc7c3e00640 1 -- 172.21.15.110:0/1079506770 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7cc036030 con 0x558954039dd0 2024-04-26T11:44:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.007+0000 7fc7c3e00640 1 -- 172.21.15.110:0/1079506770 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0044a0 con 0x558954039dd0 2024-04-26T11:44:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7dc856740 1 -- 172.21.15.110:0/1079506770 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954039dd0 msgr2=0x55895403a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1079506770 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954039dd0 0x55895403a1b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009ca0 tx=0x7fc7cc0099f0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7d2a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc7b80a3dc0 0x7fc7b80a6280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55895403b370 tx=0x7fc7c40046c0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7dc856740 1 -- 172.21.15.110:0/1079506770 shutdown_connections 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1079506770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x5589540473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1079506770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 0x558954044a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1079506770 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954039dd0 0x55895403a1b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7dc856740 1 -- 172.21.15.110:0/1079506770 >> 172.21.15.110:0/1079506770 conn(0x5589540362e0 msgr2=0x5589540366c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7dc856740 1 -- 172.21.15.110:0/1079506770 shutdown_connections 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.008+0000 7fc7dc856740 1 -- 172.21.15.110:0/1079506770 wait complete. 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.009+0000 7fc7dc856740 1 -- start start 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.009+0000 7fc7dc856740 1 Processor -- start 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.009+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x558954041ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.009+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 0x558954042430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.009+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954044fb0 0x558954042970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.009+0000 7fc7dc856740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558954047a00 con 0x558954039dd0 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.009+0000 7fc7dc856740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558953f26c60 con 0x558954044fb0 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.009+0000 7fc7dc856740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558954047b80 con 0x55895403a6f0 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.009+0000 7fc7dc856740 10 client.0 _ll_register_callbacks cb 0x558953f52e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x558954041ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x558954041ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46874/0 (socket says 172.21.15.110:46874) 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 -- 172.21.15.110:0/2495145425 learned_addr learned my addr 172.21.15.110:0/2495145425 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 0x558954042430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954044fb0 0x558954042970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 -- 172.21.15.110:0/2495145425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 msgr2=0x558954042430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 0x558954042430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 -- 172.21.15.110:0/2495145425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954044fb0 msgr2=0x558954042970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954044fb0 0x558954042970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.013 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 -- 172.21.15.110:0/2495145425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558953f35510 con 0x558954039dd0 2024-04-26T11:44:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7d3400640 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x558954041ef0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009910 tx=0x7fc7cc005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b630672b6efb4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.010+0000 7fc7c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:44:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.011+0000 7fc7c0c00640 1 -- 172.21.15.110:0/2495145425 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc004280 con 0x558954039dd0 2024-04-26T11:44:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.011+0000 7fc7c0c00640 1 -- 172.21.15.110:0/2495145425 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 11653+0+0 (secure 0 0 0) 0x7fc7cc004420 con 0x558954039dd0 2024-04-26T11:44:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.011+0000 7fc7dc856740 1 -- 172.21.15.110:0/2495145425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7cc036030 con 0x558954039dd0 2024-04-26T11:44:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.011+0000 7fc7c0c00640 1 -- 172.21.15.110:0/2495145425 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=228) ==== 24+0+0 (secure 0 0 0) 0x7fc7cc004620 con 0x558954039dd0 2024-04-26T11:44:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.011+0000 7fc7dc856740 10 client.16083 fetch_fsmap learned FSMap version 228 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.011+0000 7fc7dc856740 1 -- 172.21.15.110:0/2495145425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=228,monmap=4+}) -- 0x558953cb1210 con 0x558954039dd0 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.011+0000 7fc7c0c00640 1 -- 172.21.15.110:0/2495145425 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7cc036030 con 0x558954039dd0 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.012+0000 7fc7c0c00640 1 -- 172.21.15.110:0/2495145425 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 228) ==== 5926+0+0 (secure 0 0 0) 0x7fc7cc05b030 con 0x558954039dd0 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.012+0000 7fc7dc856740 10 client.16083 fetch_fsmap finished waiting for FSMap version 228 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.012+0000 7fc7dc856740 10 client.16083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.012+0000 7fc7dc856740 20 client.16083 populate_metadata read hostname 'smithi110' 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.012+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558954054ac0 0x558954056eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.012+0000 7fc7dc856740 4 client.16083 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.012+0000 7fc7dc856740 1 -- 172.21.15.110:0/2495145425 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558953facf90 con 0x558954054ac0 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.012+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558954054ac0 0x558954056eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.013+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558954054ac0 0x558954056eb0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8bb66b02bba7924 server_cookie=560e2a189fa41373 in_seq=0 out_seq=0 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.013+0000 7fc7c0c00640 10 client.16083 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7c0c00640 1 -- 172.21.15.110:0/2495145425 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558953facf90 con 0x558954054ac0 2024-04-26T11:44:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7c0c00640 10 client.16083 handle_command_reply: tid=0 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 client.16083 shutdown 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 -- 172.21.15.110:0/2495145425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 msgr2=0x558954041ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x558954041ef0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009910 tx=0x7fc7cc005bd0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 -- 172.21.15.110:0/2495145425 shutdown_connections 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954044fb0 0x558954042970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x558954054ac0 0x558954056eb0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 0x558954042430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7c0c00640 0 client.16083 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2495145425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x558954041ef0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 -- 172.21.15.110:0/2495145425 >> 172.21.15.110:0/2495145425 conn(0x5589540362e0 msgr2=0x55895403c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 -- 172.21.15.110:0/2495145425 shutdown_connections 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 1 -- 172.21.15.110:0/2495145425 wait complete. 2024-04-26T11:44:34.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.014+0000 7fc7dc856740 20 client.16083 trim_cache size 0 max 16384 2024-04-26T11:44:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.030+0000 7fc7dc856740 1 Processor -- start 2024-04-26T11:44:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.030+0000 7fc7dc856740 1 -- start start 2024-04-26T11:44:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954039dd0 0x5589540508c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 0x558954043d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x55895405c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7dc856740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41b1c70 con 0x558954044fb0 2024-04-26T11:44:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7dc856740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41b3810 con 0x558954039dd0 2024-04-26T11:44:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7dc856740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41b2340 con 0x55895403a6f0 2024-04-26T11:44:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954039dd0 0x5589540508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954039dd0 0x5589540508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:50290/0 (socket says 172.21.15.110:50290) 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7d3400640 1 -- 172.21.15.110:0/2725967373 learned_addr learned my addr 172.21.15.110:0/2725967373 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/2725967373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 0x558954043d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.031+0000 7fc7d3400640 1 --2- 172.21.15.110:0/2725967373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x55895405c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.032+0000 7fc7cbe00640 1 -- 172.21.15.110:0/2725967373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954039dd0 msgr2=0x5589540508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.032+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/2725967373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954039dd0 0x5589540508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.032+0000 7fc7cbe00640 1 -- 172.21.15.110:0/2725967373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 msgr2=0x55895405c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.032+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/2725967373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x55895405c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.032+0000 7fc7cbe00640 1 -- 172.21.15.110:0/2725967373 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558954047710 con 0x55895403a6f0 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.032+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/2725967373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 0x558954043d20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x558954057720 tx=0x7fc7bc009110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a1c100948529037 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.032+0000 7fc7c3400640 1 -- 172.21.15.110:0/2725967373 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc015a10 con 0x55895403a6f0 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.032+0000 7fc7c3400640 1 -- 172.21.15.110:0/2725967373 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7bc01f860 con 0x55895403a6f0 2024-04-26T11:44:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.032+0000 7fc7c3400640 1 -- 172.21.15.110:0/2725967373 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc014820 con 0x55895403a6f0 2024-04-26T11:44:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 -- 172.21.15.110:0/2725967373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 msgr2=0x558954043d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2725967373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 0x558954043d20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x558954057720 tx=0x7fc7bc009110 comp rx=0 tx=0).stop 2024-04-26T11:44:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 -- 172.21.15.110:0/2725967373 shutdown_connections 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2725967373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954044fb0 0x55895405c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2725967373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55895403a6f0 0x558954043d20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 --2- 172.21.15.110:0/2725967373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558954039dd0 0x5589540508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 -- 172.21.15.110:0/2725967373 >> 172.21.15.110:0/2725967373 conn(0x5589540362e0 msgr2=0x558954043610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 -- 172.21.15.110:0/2725967373 shutdown_connections 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 -- 172.21.15.110:0/2725967373 wait complete. 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.033+0000 7fc7dc856740 1 -- start start 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7dc856740 1 Processor -- start 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x55895403ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 0x55895403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7dc856740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954044fb0 0x5589540b9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7dc856740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41b3140 con 0x558954039dd0 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7dc856740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41b2a40 con 0x55895403a6f0 2024-04-26T11:44:34.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7dc856740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41b0440 con 0x558954044fb0 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7dc856740 10 client.0 _ll_register_callbacks cb 0x7fc7bc0093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x55895403ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x55895403ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46890/0 (socket says 172.21.15.110:46890) 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.034+0000 7fc7d3400640 1 -- 172.21.15.110:0/1267742945 learned_addr learned my addr 172.21.15.110:0/1267742945 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 0x55895403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7d3400640 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954044fb0 0x5589540b9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7d3400640 1 -- 172.21.15.110:0/1267742945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954044fb0 msgr2=0x5589540b9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7d3400640 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954044fb0 0x5589540b9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7d3400640 1 -- 172.21.15.110:0/1267742945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 msgr2=0x55895403f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7d3400640 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 0x55895403f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7d3400640 1 -- 172.21.15.110:0/1267742945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558953d7d620 con 0x558954039dd0 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7d3400640 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x55895403ef80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc02ade0 tx=0x7fc7cc031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c1e9cca4b2eb3c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7c0c00640 1 -- 172.21.15.110:0/1267742945 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0317d0 con 0x558954039dd0 2024-04-26T11:44:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7c0c00640 1 -- 172.21.15.110:0/1267742945 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 11653+0+0 (secure 0 0 0) 0x7fc7cc0047c0 con 0x558954039dd0 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.035+0000 7fc7dc856740 1 -- 172.21.15.110:0/1267742945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7bc01f860 con 0x558954039dd0 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7c0c00640 1 -- 172.21.15.110:0/1267742945 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=228) ==== 24+0+0 (secure 0 0 0) 0x7fc7cc06de60 con 0x558954039dd0 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7dc856740 10 client.16089 fetch_fsmap learned FSMap version 228 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7dc856740 1 -- 172.21.15.110:0/1267742945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=228,monmap=4+}) -- 0x558953f59cb0 con 0x558954039dd0 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7c0c00640 1 -- 172.21.15.110:0/1267742945 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7bc01f860 con 0x558954039dd0 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7c0c00640 1 -- 172.21.15.110:0/1267742945 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 228) ==== 5926+0+0 (secure 0 0 0) 0x7fc7cc05b040 con 0x558954039dd0 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7dc856740 10 client.16089 fetch_fsmap finished waiting for FSMap version 228 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7dc856740 10 client.16089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7dc856740 20 client.16089 populate_metadata read hostname 'smithi110' 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5589540bb940 0x5589540bdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7dc856740 4 client.16089 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.036+0000 7fc7dc856740 1 -- 172.21.15.110:0/1267742945 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558953fa6e00 con 0x5589540bb940 2024-04-26T11:44:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.037+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5589540bb940 0x5589540bdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:44:34.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.037+0000 7fc7cbe00640 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5589540bb940 0x5589540bdd60 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=701202139c464f56 server_cookie=80431a7be9f5294e in_seq=0 out_seq=0 2024-04-26T11:44:34.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:34.037+0000 7fc7c0c00640 10 client.16089 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:44:34.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:44:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:35 smithi196 ceph-mon[32572]: pgmap v453: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 21 MiB/s wr, 1.46k op/s 2024-04-26T11:44:35.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:35 smithi110 ceph-mon[28069]: pgmap v453: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 21 MiB/s wr, 1.46k op/s 2024-04-26T11:44:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:35 smithi193 ceph-mon[32782]: pgmap v453: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 21 MiB/s wr, 1.46k op/s 2024-04-26T11:44:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:37 smithi196 ceph-mon[32572]: pgmap v454: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.6 MiB/s wr, 545 op/s 2024-04-26T11:44:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:37 smithi110 ceph-mon[28069]: pgmap v454: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.6 MiB/s wr, 545 op/s 2024-04-26T11:44:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:37 smithi193 ceph-mon[32782]: pgmap v454: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.6 MiB/s wr, 545 op/s 2024-04-26T11:44:39.135 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0e41bd7700 time 2024-04-26T11:44:38.787374+0000 2024-04-26T11:44:39.135 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:39.135 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:39.135 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0e4c2003dd] 2024-04-26T11:44:39.135 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0e4c2005a3] 2024-04-26T11:44:39.135 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5568fd9ba822] 2024-04-26T11:44:39.135 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5568fd92a598] 2024-04-26T11:44:39.135 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5568fd92cc17] 2024-04-26T11:44:39.135 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5568fd825d0b] 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5568fd8262ac] 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5568fd80efad] 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0e4c494e20] 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 10: (DispatchQueue::entry()+0x51f) [0x7f0e4c491fdf] 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0e4c564fc1] 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f0e4af7e1ca] 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 13: clone() 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:38.786+0000 7f0e41bd7700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0e41bd7700 time 2024-04-26T11:44:38.787374+0000 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:39.136 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.137 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:39.137 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0e4c2003dd] 2024-04-26T11:44:39.137 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0e4c2005a3] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5568fd9ba822] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5568fd92a598] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5568fd92cc17] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5568fd825d0b] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5568fd8262ac] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5568fd80efad] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0e4c494e20] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 10: (DispatchQueue::entry()+0x51f) [0x7f0e4c491fdf] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0e4c564fc1] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f0e4af7e1ca] 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 13: clone() 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.138 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: *** Caught signal (Aborted) ** 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: in thread 7f0e41bd7700 thread_name:ms_dispatch 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0e4af88d20] 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2: gsignal() 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 3: abort() 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0e4c200437] 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0e4c2005a3] 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5568fd9ba822] 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5568fd92a598] 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5568fd92cc17] 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5568fd825d0b] 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5568fd8262ac] 2024-04-26T11:44:39.139 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5568fd80efad] 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0e4c494e20] 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 13: (DispatchQueue::entry()+0x51f) [0x7f0e4c491fdf] 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0e4c564fc1] 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0e4af7e1ca] 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 16: clone() 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:38.788+0000 7f0e41bd7700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: in thread 7f0e41bd7700 thread_name:ms_dispatch 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0e4af88d20] 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2: gsignal() 2024-04-26T11:44:39.140 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 3: abort() 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0e4c200437] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0e4c2005a3] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5568fd9ba822] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5568fd92a598] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5568fd92cc17] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5568fd825d0b] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5568fd8262ac] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5568fd80efad] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0e4c494e20] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 13: (DispatchQueue::entry()+0x51f) [0x7f0e4c491fdf] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0e4c564fc1] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0e4af7e1ca] 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 16: clone() 2024-04-26T11:44:39.141 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: -1> 2024-04-26T11:44:38.786+0000 7f0e41bd7700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0e41bd7700 time 2024-04-26T11:44:38.787374+0000 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0e4c2003dd] 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0e4c2005a3] 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5568fd9ba822] 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5568fd92a598] 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5568fd92cc17] 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5568fd825d0b] 2024-04-26T11:44:39.142 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5568fd8262ac] 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5568fd80efad] 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0e4c494e20] 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 10: (DispatchQueue::entry()+0x51f) [0x7f0e4c491fdf] 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0e4c564fc1] 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f0e4af7e1ca] 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 13: clone() 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 0> 2024-04-26T11:44:38.788+0000 7f0e41bd7700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: in thread 7f0e41bd7700 thread_name:ms_dispatch 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0e4af88d20] 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2: gsignal() 2024-04-26T11:44:39.143 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 3: abort() 2024-04-26T11:44:39.144 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0e4c200437] 2024-04-26T11:44:39.144 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0e4c2005a3] 2024-04-26T11:44:39.144 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5568fd9ba822] 2024-04-26T11:44:39.144 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5568fd92a598] 2024-04-26T11:44:39.144 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5568fd92cc17] 2024-04-26T11:44:39.144 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5568fd825d0b] 2024-04-26T11:44:39.144 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5568fd8262ac] 2024-04-26T11:44:39.144 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5568fd80efad] 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0e4c494e20] 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 13: (DispatchQueue::entry()+0x51f) [0x7f0e4c491fdf] 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0e4c564fc1] 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0e4af7e1ca] 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 16: clone() 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: -1> 2024-04-26T11:44:38.786+0000 7f0e41bd7700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0e41bd7700 time 2024-04-26T11:44:38.787374+0000 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.145 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f0e4c2003dd] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0e4c2005a3] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5568fd9ba822] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5568fd92a598] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5568fd92cc17] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5568fd825d0b] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5568fd8262ac] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5568fd80efad] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0e4c494e20] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 10: (DispatchQueue::entry()+0x51f) [0x7f0e4c491fdf] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0e4c564fc1] 2024-04-26T11:44:39.146 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f0e4af7e1ca] 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 13: clone() 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 0> 2024-04-26T11:44:38.788+0000 7f0e41bd7700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: in thread 7f0e41bd7700 thread_name:ms_dispatch 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f0e4af88d20] 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2: gsignal() 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 3: abort() 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f0e4c200437] 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f0e4c2005a3] 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5568fd9ba822] 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5568fd92a598] 2024-04-26T11:44:39.147 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5568fd92cc17] 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5568fd825d0b] 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5568fd8262ac] 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5568fd80efad] 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f0e4c494e20] 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 13: (DispatchQueue::entry()+0x51f) [0x7f0e4c491fdf] 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f0e4c564fc1] 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f0e4af7e1ca] 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 16: clone() 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71691]: 2024-04-26T11:44:39.148 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:38 smithi196 podman[71732]: 2024-04-26 11:44:38.848647341 +0000 UTC m=+0.018992676 container died a95319c3e3553e172cf153e80e582ad22f09dbde2d96c77a3daed26ea77d8e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-26T11:44:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:39 smithi196 ceph-mon[32572]: pgmap v455: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.9 MiB/s wr, 580 op/s 2024-04-26T11:44:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:39 smithi110 ceph-mon[28069]: pgmap v455: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.9 MiB/s wr, 580 op/s 2024-04-26T11:44:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:39 smithi193 ceph-mon[32782]: pgmap v455: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.9 MiB/s wr, 580 op/s 2024-04-26T11:44:39.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:44:40.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:39 smithi196 podman[71732]: 2024-04-26 11:44:39.694885296 +0000 UTC m=+0.865230615 container remove a95319c3e3553e172cf153e80e582ad22f09dbde2d96c77a3daed26ea77d8e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True) 2024-04-26T11:44:40.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:39 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:44:40.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:39 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T11:44:40.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:39 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.642s CPU time. 2024-04-26T11:44:40.322 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 4. 2024-04-26T11:44:40.322 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 systemd[1]: Stopped Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:44:40.322 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.988s CPU time. 2024-04-26T11:44:40.323 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 systemd[1]: Starting Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:44:40.668 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 podman[94336]: 2024-04-26 11:44:40.331841339 +0000 UTC m=+0.033693807 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:44:40.668 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 podman[94336]: 2024-04-26 11:44:40.459901648 +0000 UTC m=+0.161754128 container create 35d0dbe49e2f247562654490ed9898b52b223ff9a36da10456a6bba979337525 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:44:41.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 podman[94336]: 2024-04-26 11:44:40.77245273 +0000 UTC m=+0.474305278 container init 35d0dbe49e2f247562654490ed9898b52b223ff9a36da10456a6bba979337525 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-26T11:44:41.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 podman[94336]: 2024-04-26 11:44:40.780238107 +0000 UTC m=+0.482090582 container start 35d0dbe49e2f247562654490ed9898b52b223ff9a36da10456a6bba979337525 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True) 2024-04-26T11:44:41.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 ceph-mds[94421]: -- 172.21.15.110:0/3861108671 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56161ab8ba40 con 0x56161ab5f000 2024-04-26T11:44:41.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: starting mds.d at 2024-04-26T11:44:41.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 bash[94336]: 35d0dbe49e2f247562654490ed9898b52b223ff9a36da10456a6bba979337525 2024-04-26T11:44:41.043 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:44:40 smithi110 systemd[1]: Started Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:44:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: pgmap v456: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 2.0 MiB/s wr, 180 op/s 2024-04-26T11:44:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:44:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: daemon mds.d restarted 2024-04-26T11:44:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:44:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: osdmap e144: 12 total, 12 up, 12 in 2024-04-26T11:44:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:44:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:boot 2024-04-26T11:44:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-04-26T11:44:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:44:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:41 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=l=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: pgmap v456: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 2.0 MiB/s wr, 180 op/s 2024-04-26T11:44:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:44:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: daemon mds.d restarted 2024-04-26T11:44:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:44:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: osdmap e144: 12 total, 12 up, 12 in 2024-04-26T11:44:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:44:41.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:boot 2024-04-26T11:44:41.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-04-26T11:44:41.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:44:41.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:41 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=l=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: pgmap v456: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 2.0 MiB/s wr, 180 op/s 2024-04-26T11:44:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:44:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: daemon mds.d restarted 2024-04-26T11:44:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:44:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: osdmap e144: 12 total, 12 up, 12 in 2024-04-26T11:44:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:44:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:boot 2024-04-26T11:44:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-04-26T11:44:41.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:44:41.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:41 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=l=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:44:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:44:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:44:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:44:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:44:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:44:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:44:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:44:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:44:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:43 smithi196 ceph-mon[32572]: pgmap v458: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 872 KiB/s wr, 116 op/s 2024-04-26T11:44:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:43 smithi196 ceph-mon[32572]: pgmap v459: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 569 KiB/s wr, 77 op/s 2024-04-26T11:44:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:43 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:resolve 2024-04-26T11:44:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:43 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=l=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:43 smithi110 ceph-mon[28069]: pgmap v458: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 872 KiB/s wr, 116 op/s 2024-04-26T11:44:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:43 smithi110 ceph-mon[28069]: pgmap v459: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 569 KiB/s wr, 77 op/s 2024-04-26T11:44:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:43 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:resolve 2024-04-26T11:44:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:43 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=l=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:43 smithi193 ceph-mon[32782]: pgmap v458: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 872 KiB/s wr, 116 op/s 2024-04-26T11:44:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:43 smithi193 ceph-mon[32782]: pgmap v459: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 569 KiB/s wr, 77 op/s 2024-04-26T11:44:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:43 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:resolve 2024-04-26T11:44:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:43 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=l=up:active} 2 up:standby-replay 3 up:standby 2024-04-26T11:44:44.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:44:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:45 smithi196 ceph-mon[32572]: pgmap v460: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 1.1 MiB/s wr, 149 op/s 2024-04-26T11:44:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:45 smithi110 ceph-mon[28069]: pgmap v460: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 1.1 MiB/s wr, 149 op/s 2024-04-26T11:44:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:45 smithi193 ceph-mon[32782]: pgmap v460: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 1.1 MiB/s wr, 149 op/s 2024-04-26T11:44:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:47 smithi196 ceph-mon[32572]: pgmap v461: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 701 KiB/s wr, 92 op/s 2024-04-26T11:44:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:47 smithi110 ceph-mon[28069]: pgmap v461: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 701 KiB/s wr, 92 op/s 2024-04-26T11:44:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:47 smithi193 ceph-mon[32782]: pgmap v461: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 701 KiB/s wr, 92 op/s 2024-04-26T11:44:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:49 smithi196 ceph-mon[32572]: pgmap v462: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 775 KiB/s wr, 100 op/s 2024-04-26T11:44:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:49 smithi110 ceph-mon[28069]: pgmap v462: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 775 KiB/s wr, 100 op/s 2024-04-26T11:44:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:49 smithi193 ceph-mon[32782]: pgmap v462: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 775 KiB/s wr, 100 op/s 2024-04-26T11:44:49.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:44:50.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 4. 2024-04-26T11:44:50.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 systemd[1]: Stopped Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:44:50.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.642s CPU time. 2024-04-26T11:44:50.262 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 systemd[1]: Starting Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:44:50.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 podman[71973]: 2024-04-26 11:44:50.13427114 +0000 UTC m=+0.018048226 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:44:50.263 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 podman[71973]: 2024-04-26 11:44:50.262018901 +0000 UTC m=+0.145795983 container create c3f46afaeab4d81622c2886efd65c5b1e773919753a4d0c4dbcdac1e174f0571 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-26T11:44:50.524 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 podman[71973]: 2024-04-26 11:44:50.498377463 +0000 UTC m=+0.382154541 container init c3f46afaeab4d81622c2886efd65c5b1e773919753a4d0c4dbcdac1e174f0571 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T11:44:50.524 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 podman[71973]: 2024-04-26 11:44:50.501061558 +0000 UTC m=+0.384838642 container start c3f46afaeab4d81622c2886efd65c5b1e773919753a4d0c4dbcdac1e174f0571 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:44:51.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 ceph-mds[71992]: -- 172.21.15.196:0/342987886 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c600273a40 con 0x55c600246800 2024-04-26T11:44:51.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: starting mds.l at 2024-04-26T11:44:51.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 bash[71973]: c3f46afaeab4d81622c2886efd65c5b1e773919753a4d0c4dbcdac1e174f0571 2024-04-26T11:44:51.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:44:50 smithi196 systemd[1]: Started Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:44:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:51 smithi196 ceph-mon[32572]: pgmap v463: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 925 KiB/s wr, 121 op/s 2024-04-26T11:44:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:51 smithi196 ceph-mon[32572]: daemon mds.l restarted 2024-04-26T11:44:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:44:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:51 smithi196 ceph-mon[32572]: osdmap e145: 12 total, 12 up, 12 in 2024-04-26T11:44:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:51 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:boot 2024-04-26T11:44:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:51 smithi196 ceph-mon[32572]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T11:44:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:51 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:44:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:51 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:51 smithi110 ceph-mon[28069]: pgmap v463: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 925 KiB/s wr, 121 op/s 2024-04-26T11:44:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:51 smithi110 ceph-mon[28069]: daemon mds.l restarted 2024-04-26T11:44:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:44:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:51 smithi110 ceph-mon[28069]: osdmap e145: 12 total, 12 up, 12 in 2024-04-26T11:44:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:51 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:boot 2024-04-26T11:44:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:51 smithi110 ceph-mon[28069]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T11:44:51.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:51 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:44:51.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:51 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:51 smithi193 ceph-mon[32782]: pgmap v463: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 925 KiB/s wr, 121 op/s 2024-04-26T11:44:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:51 smithi193 ceph-mon[32782]: daemon mds.l restarted 2024-04-26T11:44:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:44:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:51 smithi193 ceph-mon[32782]: osdmap e145: 12 total, 12 up, 12 in 2024-04-26T11:44:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:51 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:boot 2024-04-26T11:44:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:51 smithi193 ceph-mon[32782]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T11:44:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:51 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:44:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:51 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:replay} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:53.525 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:53 smithi110 ceph-mon[28069]: pgmap v465: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 817 KiB/s wr, 107 op/s 2024-04-26T11:44:53.525 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:53 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:resolve 2024-04-26T11:44:53.525 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:53 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:53 smithi193 ceph-mon[32782]: pgmap v465: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 817 KiB/s wr, 107 op/s 2024-04-26T11:44:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:53 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:resolve 2024-04-26T11:44:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:53 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:53 smithi196 ceph-mon[32572]: pgmap v465: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 817 KiB/s wr, 107 op/s 2024-04-26T11:44:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:53 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:resolve 2024-04-26T11:44:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:53 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.300+0000 7fc7c0c00640 1 -- 172.21.15.110:0/1267742945 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558953fa6e00 con 0x5589540bb940 2024-04-26T11:44:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.300+0000 7fc7c0c00640 10 client.16089 handle_command_reply: tid=0 2024-04-26T11:44:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.300+0000 7fc7dc856740 1 client.16089 shutdown 2024-04-26T11:44:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.300+0000 7fc7dc856740 1 -- 172.21.15.110:0/1267742945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 msgr2=0x55895403ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.300+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x55895403ef80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc02ade0 tx=0x7fc7cc031760 comp rx=0 tx=0).stop 2024-04-26T11:44:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7dc856740 1 -- 172.21.15.110:0/1267742945 shutdown_connections 2024-04-26T11:44:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5589540bb940 0x5589540bdd60 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558954044fb0 0x5589540b9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55895403a6f0 0x55895403f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7c0c00640 0 client.16089 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:44:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7dc856740 1 --2- 172.21.15.110:0/1267742945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558954039dd0 0x55895403ef80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7dc856740 1 -- 172.21.15.110:0/1267742945 >> 172.21.15.110:0/1267742945 conn(0x5589540362e0 msgr2=0x55895403c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7dc856740 1 -- 172.21.15.110:0/1267742945 shutdown_connections 2024-04-26T11:44:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7dc856740 1 -- 172.21.15.110:0/1267742945 wait complete. 2024-04-26T11:44:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.301+0000 7fc7dc856740 20 client.16089 trim_cache size 0 max 16384 2024-04-26T11:44:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:44:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:44:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:44:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:44:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.302+0000 7fc7d9a00640 1 -- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc7b80a3dc0 msgr2=0x7fc7b80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.302+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc7b80a3dc0 0x7fc7b80a6280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55895403b370 tx=0x7fc7c40046c0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 -- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4104b40 msgr2=0x7fc7d419b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:44:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4104b40 0x7fc7d419b340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400b4a0 tx=0x7fc7c400b8a0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 -- 172.21.15.110:0/306852052 shutdown_connections 2024-04-26T11:44:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fc7b80a3dc0 0x7fc7b80a6280 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d410ac00 0x7fc7d419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7d4105500 0x7fc7d419b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 --2- 172.21.15.110:0/306852052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7d4104b40 0x7fc7d419b340 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:44:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 -- 172.21.15.110:0/306852052 >> 172.21.15.110:0/306852052 conn(0x7fc7d4100630 msgr2=0x7fc7d4101d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:44:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 -- 172.21.15.110:0/306852052 shutdown_connections 2024-04-26T11:44:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:44:54.303+0000 7fc7d9a00640 1 -- 172.21.15.110:0/306852052 wait complete. 2024-04-26T11:44:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:54 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299995 2024-04-26T11:44:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:54 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:reconnect 2024-04-26T11:44:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:54 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:reconnect 2024-04-26T11:44:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:54 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:54 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:44:54.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:54 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209997 2024-04-26T11:44:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:54 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299995 2024-04-26T11:44:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:54 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:reconnect 2024-04-26T11:44:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:54 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:reconnect 2024-04-26T11:44:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:54 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:54 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:44:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:54 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209997 2024-04-26T11:44:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:54 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299995 2024-04-26T11:44:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:54 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:reconnect 2024-04-26T11:44:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:54 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:reconnect 2024-04-26T11:44:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:54 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:54 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:44:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:54 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0209997 2024-04-26T11:44:54.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:44:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:55 smithi110 ceph-mon[28069]: pgmap v466: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 803 KiB/s wr, 103 op/s 2024-04-26T11:44:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:55 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:rejoin 2024-04-26T11:44:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:55 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:rejoin 2024-04-26T11:44:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:55 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:55 smithi110 ceph-mon[28069]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T11:44:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:55 smithi110 ceph-mon[28069]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-04-26T11:44:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:55 smithi193 ceph-mon[32782]: pgmap v466: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 803 KiB/s wr, 103 op/s 2024-04-26T11:44:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:55 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:rejoin 2024-04-26T11:44:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:55 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:rejoin 2024-04-26T11:44:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:55 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:55 smithi193 ceph-mon[32782]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T11:44:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:55 smithi193 ceph-mon[32782]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-04-26T11:44:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:55 smithi196 ceph-mon[32572]: pgmap v466: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 803 KiB/s wr, 103 op/s 2024-04-26T11:44:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:55 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:rejoin 2024-04-26T11:44:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:55 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:rejoin 2024-04-26T11:44:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:55 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:55 smithi196 ceph-mon[32572]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T11:44:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:55 smithi196 ceph-mon[32572]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-04-26T11:44:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:56 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:44:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:56 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:active 2024-04-26T11:44:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:56 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:active 2024-04-26T11:44:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:56 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:56 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:56 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:56 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:active 2024-04-26T11:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:56 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:active 2024-04-26T11:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:56 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:56 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:56 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:56 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2417313290,v1:172.21.15.193:6833/2417313290] up:active 2024-04-26T11:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:56 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/3445119625,v1:172.21.15.110:6835/3445119625] up:active 2024-04-26T11:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:56 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:56 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:57 smithi193 ceph-mon[32782]: pgmap v467: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 803 KiB/s wr, 103 op/s 2024-04-26T11:44:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:57 smithi196 ceph-mon[32572]: pgmap v467: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 803 KiB/s wr, 103 op/s 2024-04-26T11:44:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:57 smithi110 ceph-mon[28069]: pgmap v467: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 803 KiB/s wr, 103 op/s 2024-04-26T11:44:59.593 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:59 smithi196 ceph-mon[32572]: pgmap v468: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 1.6 MiB/s wr, 162 op/s 2024-04-26T11:44:59.593 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:44:59 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:59.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:59 smithi193 ceph-mon[32782]: pgmap v468: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 1.6 MiB/s wr, 162 op/s 2024-04-26T11:44:59.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:44:59 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:59 smithi110 ceph-mon[28069]: pgmap v468: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 1.6 MiB/s wr, 162 op/s 2024-04-26T11:44:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:44:59 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:44:59.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 765.0 s, 1473.4 tps, lat 434.635 ms stddev 3383.776 2024-04-26T11:45:00.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd1cb7d6700 time 2024-04-26T11:45:00.356946+0000 2024-04-26T11:45:00.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:00.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd1d5dff3dd] 2024-04-26T11:45:00.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1d5dff5a3] 2024-04-26T11:45:00.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56335d35f822] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56335d2cf598] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56335d2d1c17] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56335d1cad0b] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56335d1cb2ac] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56335d1b3fad] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1d6093e20] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 10: (DispatchQueue::entry()+0x51f) [0x7fd1d6090fdf] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1d6163fc1] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd1d4b7d1ca] 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 13: clone() 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: *** Caught signal (Aborted) ** 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: in thread 7fd1cb7d6700 thread_name:ms_dispatch 2024-04-26T11:45:00.623 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.357+0000 7fd1cb7d6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd1cb7d6700 time 2024-04-26T11:45:00.356946+0000 2024-04-26T11:45:00.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:00.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd1d5dff3dd] 2024-04-26T11:45:00.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1d5dff5a3] 2024-04-26T11:45:00.624 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56335d35f822] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56335d2cf598] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56335d2d1c17] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56335d1cad0b] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56335d1cb2ac] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56335d1b3fad] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1d6093e20] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 10: (DispatchQueue::entry()+0x51f) [0x7fd1d6090fdf] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1d6163fc1] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd1d4b7d1ca] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 13: clone() 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd1d4b87d20] 2024-04-26T11:45:00.625 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2: gsignal() 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 3: abort() 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd1d5dff437] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1d5dff5a3] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56335d35f822] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56335d2cf598] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56335d2d1c17] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56335d1cad0b] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56335d1cb2ac] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56335d1b3fad] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1d6093e20] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 13: (DispatchQueue::entry()+0x51f) [0x7fd1d6090fdf] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1d6163fc1] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd1d4b7d1ca] 2024-04-26T11:45:00.626 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 16: clone() 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.358+0000 7fd1cb7d6700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: in thread 7fd1cb7d6700 thread_name:ms_dispatch 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd1d4b87d20] 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2: gsignal() 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 3: abort() 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd1d5dff437] 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1d5dff5a3] 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56335d35f822] 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56335d2cf598] 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56335d2d1c17] 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56335d1cad0b] 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56335d1cb2ac] 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56335d1b3fad] 2024-04-26T11:45:00.627 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1d6093e20] 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 13: (DispatchQueue::entry()+0x51f) [0x7fd1d6090fdf] 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1d6163fc1] 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd1d4b7d1ca] 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 16: clone() 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: -1> 2024-04-26T11:45:00.357+0000 7fd1cb7d6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd1cb7d6700 time 2024-04-26T11:45:00.356946+0000 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd1d5dff3dd] 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1d5dff5a3] 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56335d35f822] 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56335d2cf598] 2024-04-26T11:45:00.628 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56335d2d1c17] 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56335d1cad0b] 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56335d1cb2ac] 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56335d1b3fad] 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1d6093e20] 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 10: (DispatchQueue::entry()+0x51f) [0x7fd1d6090fdf] 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1d6163fc1] 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd1d4b7d1ca] 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 13: clone() 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 0> 2024-04-26T11:45:00.358+0000 7fd1cb7d6700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: in thread 7fd1cb7d6700 thread_name:ms_dispatch 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.629 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd1d4b87d20] 2024-04-26T11:45:00.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2: gsignal() 2024-04-26T11:45:00.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 3: abort() 2024-04-26T11:45:00.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd1d5dff437] 2024-04-26T11:45:00.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1d5dff5a3] 2024-04-26T11:45:00.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56335d35f822] 2024-04-26T11:45:00.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56335d2cf598] 2024-04-26T11:45:00.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56335d2d1c17] 2024-04-26T11:45:00.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56335d1cad0b] 2024-04-26T11:45:00.630 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56335d1cb2ac] 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56335d1b3fad] 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1d6093e20] 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 13: (DispatchQueue::entry()+0x51f) [0x7fd1d6090fdf] 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1d6163fc1] 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd1d4b7d1ca] 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 16: clone() 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: -1> 2024-04-26T11:45:00.357+0000 7fd1cb7d6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd1cb7d6700 time 2024-04-26T11:45:00.356946+0000 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd1d5dff3dd] 2024-04-26T11:45:00.631 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1d5dff5a3] 2024-04-26T11:45:00.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56335d35f822] 2024-04-26T11:45:00.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56335d2cf598] 2024-04-26T11:45:00.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56335d2d1c17] 2024-04-26T11:45:00.632 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56335d1cad0b] 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56335d1cb2ac] 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56335d1b3fad] 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1d6093e20] 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 10: (DispatchQueue::entry()+0x51f) [0x7fd1d6090fdf] 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1d6163fc1] 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd1d4b7d1ca] 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 13: clone() 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 0> 2024-04-26T11:45:00.358+0000 7fd1cb7d6700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: in thread 7fd1cb7d6700 thread_name:ms_dispatch 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd1d4b87d20] 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2: gsignal() 2024-04-26T11:45:00.633 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 3: abort() 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd1d5dff437] 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1d5dff5a3] 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56335d35f822] 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56335d2cf598] 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56335d2d1c17] 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56335d1cad0b] 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56335d1cb2ac] 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56335d1b3fad] 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1d6093e20] 2024-04-26T11:45:00.634 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 13: (DispatchQueue::entry()+0x51f) [0x7fd1d6090fdf] 2024-04-26T11:45:00.635 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1d6163fc1] 2024-04-26T11:45:00.635 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd1d4b7d1ca] 2024-04-26T11:45:00.635 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 16: clone() 2024-04-26T11:45:00.635 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:00.635 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[69786]: 2024-04-26T11:45:00.635 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:00 smithi193 podman[69968]: 2024-04-26 11:45:00.431595143 +0000 UTC m=+0.020535106 container died 7334f29e9becd2f3d1cacacad12aee6ee8eac5826e687ae1b5959f7f8b0d69f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-04-26T11:45:00.793 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3b4da00700 time 2024-04-26T11:45:00.380595+0000 2024-04-26T11:45:00.793 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:00.793 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.793 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3b593c93dd] 2024-04-26T11:45:00.793 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3b593c95a3] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560a7b5a2822] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560a7b512598] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a7b514c17] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a7b40dd0b] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a7b40e2ac] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560a7b3f6fad] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3b5965de20] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 10: (DispatchQueue::entry()+0x51f) [0x7f3b5965afdf] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3b5972dfc1] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3b581471ca] 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 13: clone() 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.383+0000 7f3b4da00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3b4da00700 time 2024-04-26T11:45:00.380595+0000 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:00.794 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3b593c93dd] 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3b593c95a3] 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560a7b5a2822] 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560a7b512598] 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a7b514c17] 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a7b40dd0b] 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a7b40e2ac] 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560a7b3f6fad] 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3b5965de20] 2024-04-26T11:45:00.795 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 10: (DispatchQueue::entry()+0x51f) [0x7f3b5965afdf] 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3b5972dfc1] 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3b581471ca] 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 13: clone() 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: *** Caught signal (Aborted) ** 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: in thread 7f3b4da00700 thread_name:ms_dispatch 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3b58151d20] 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2: gsignal() 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 3: abort() 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3b593c9437] 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3b593c95a3] 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560a7b5a2822] 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560a7b512598] 2024-04-26T11:45:00.796 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a7b514c17] 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a7b40dd0b] 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a7b40e2ac] 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560a7b3f6fad] 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3b5965de20] 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 13: (DispatchQueue::entry()+0x51f) [0x7f3b5965afdf] 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3b5972dfc1] 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3b581471ca] 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 16: clone() 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.388+0000 7f3b4da00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:00.797 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: in thread 7f3b4da00700 thread_name:ms_dispatch 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3b58151d20] 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2: gsignal() 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 3: abort() 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3b593c9437] 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3b593c95a3] 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560a7b5a2822] 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560a7b512598] 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a7b514c17] 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a7b40dd0b] 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a7b40e2ac] 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560a7b3f6fad] 2024-04-26T11:45:00.798 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3b5965de20] 2024-04-26T11:45:00.799 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 13: (DispatchQueue::entry()+0x51f) [0x7f3b5965afdf] 2024-04-26T11:45:00.799 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3b5972dfc1] 2024-04-26T11:45:00.799 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3b581471ca] 2024-04-26T11:45:00.799 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 16: clone() 2024-04-26T11:45:00.799 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:00.799 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.799 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: -1> 2024-04-26T11:45:00.383+0000 7f3b4da00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3b4da00700 time 2024-04-26T11:45:00.380595+0000 2024-04-26T11:45:00.799 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3b593c93dd] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3b593c95a3] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560a7b5a2822] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560a7b512598] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a7b514c17] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a7b40dd0b] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a7b40e2ac] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560a7b3f6fad] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3b5965de20] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 10: (DispatchQueue::entry()+0x51f) [0x7f3b5965afdf] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3b5972dfc1] 2024-04-26T11:45:00.800 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3b581471ca] 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 13: clone() 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 0> 2024-04-26T11:45:00.388+0000 7f3b4da00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: in thread 7f3b4da00700 thread_name:ms_dispatch 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3b58151d20] 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2: gsignal() 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 3: abort() 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3b593c9437] 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3b593c95a3] 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560a7b5a2822] 2024-04-26T11:45:00.801 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560a7b512598] 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a7b514c17] 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a7b40dd0b] 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a7b40e2ac] 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560a7b3f6fad] 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3b5965de20] 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 13: (DispatchQueue::entry()+0x51f) [0x7f3b5965afdf] 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3b5972dfc1] 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3b581471ca] 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 16: clone() 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: -8> 2024-04-26T11:45:00.383+0000 7f3b4da00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3b4da00700 time 2024-04-26T11:45:00.380595+0000 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.802 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.803 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3b593c93dd] 2024-04-26T11:45:00.803 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3b593c95a3] 2024-04-26T11:45:00.803 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560a7b5a2822] 2024-04-26T11:45:00.803 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560a7b512598] 2024-04-26T11:45:00.803 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a7b514c17] 2024-04-26T11:45:00.803 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a7b40dd0b] 2024-04-26T11:45:00.803 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a7b40e2ac] 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560a7b3f6fad] 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3b5965de20] 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 10: (DispatchQueue::entry()+0x51f) [0x7f3b5965afdf] 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3b5972dfc1] 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3b581471ca] 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 13: clone() 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: -7> 2024-04-26T11:45:00.388+0000 7f3b4da00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: in thread 7f3b4da00700 thread_name:ms_dispatch 2024-04-26T11:45:00.804 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3b58151d20] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2: gsignal() 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 3: abort() 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3b593c9437] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3b593c95a3] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560a7b5a2822] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560a7b512598] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560a7b514c17] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560a7b40dd0b] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560a7b40e2ac] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560a7b3f6fad] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3b5965de20] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 13: (DispatchQueue::entry()+0x51f) [0x7f3b5965afdf] 2024-04-26T11:45:00.805 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3b5972dfc1] 2024-04-26T11:45:00.806 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3b581471ca] 2024-04-26T11:45:00.806 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 16: clone() 2024-04-26T11:45:00.806 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:00.806 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94156]: 2024-04-26T11:45:00.806 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:00 smithi110 podman[94533]: 2024-04-26 11:45:00.514187758 +0000 UTC m=+0.032961435 container died b54738a28911f76e6f9de9b38f7fdcd48396a6d27e4b0c4927bc6229666da6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-26T11:45:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:01 smithi193 ceph-mon[32782]: pgmap v469: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 254 op/s 2024-04-26T11:45:01.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:01 smithi193 podman[69968]: 2024-04-26 11:45:01.297460201 +0000 UTC m=+0.886400219 container remove 7334f29e9becd2f3d1cacacad12aee6ee8eac5826e687ae1b5959f7f8b0d69f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T11:45:01.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:01 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:45:01.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:01 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T11:45:01.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:01 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.530s CPU time. 2024-04-26T11:45:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:01 smithi196 ceph-mon[32572]: pgmap v469: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 254 op/s 2024-04-26T11:45:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:01 smithi110 ceph-mon[28069]: pgmap v469: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 254 op/s 2024-04-26T11:45:01.792 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:01 smithi110 podman[94533]: 2024-04-26 11:45:01.410343671 +0000 UTC m=+0.929117393 container remove b54738a28911f76e6f9de9b38f7fdcd48396a6d27e4b0c4927bc6229666da6ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0) 2024-04-26T11:45:01.792 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:01 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:45:02.133 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:01 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T11:45:02.133 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:01 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 2.034s CPU time. 2024-04-26T11:45:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:03 smithi193 ceph-mon[32782]: pgmap v470: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 3.1 MiB/s wr, 228 op/s 2024-04-26T11:45:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:03 smithi196 ceph-mon[32572]: pgmap v470: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 3.1 MiB/s wr, 228 op/s 2024-04-26T11:45:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:03 smithi110 ceph-mon[28069]: pgmap v470: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 3.1 MiB/s wr, 228 op/s 2024-04-26T11:45:04.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:45:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:05 smithi193 ceph-mon[32782]: pgmap v471: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 3.8 MiB/s wr, 333 op/s 2024-04-26T11:45:05.737 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:05 smithi110 ceph-mon[28069]: pgmap v471: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 3.8 MiB/s wr, 333 op/s 2024-04-26T11:45:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:05 smithi196 ceph-mon[32572]: pgmap v471: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 3.8 MiB/s wr, 333 op/s 2024-04-26T11:45:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.452+0000 7f94d8e00640 1 -- 172.21.15.110:0/357021973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d4101620 msgr2=0x7f94d410aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.452+0000 7f94d8e00640 1 --2- 172.21.15.110:0/357021973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d4101620 0x7f94d410aa50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009930 tx=0x7f94c002a420 comp rx=0 tx=0).stop 2024-04-26T11:45:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.452+0000 7f94d8e00640 1 -- 172.21.15.110:0/357021973 shutdown_connections 2024-04-26T11:45:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.452+0000 7f94d8e00640 1 --2- 172.21.15.110:0/357021973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94d410b180 0x7f94d4111b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.452+0000 7f94d8e00640 1 --2- 172.21.15.110:0/357021973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d4101620 0x7f94d410aa50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.452+0000 7f94d8e00640 1 --2- 172.21.15.110:0/357021973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94d4100c70 0x7f94d4101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.452+0000 7f94d8e00640 1 -- 172.21.15.110:0/357021973 >> 172.21.15.110:0/357021973 conn(0x7f94d4077930 msgr2=0x7f94d40fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.452+0000 7f94d8e00640 1 -- 172.21.15.110:0/357021973 shutdown_connections 2024-04-26T11:45:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.452+0000 7f94d8e00640 1 -- 172.21.15.110:0/357021973 wait complete. 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.453+0000 7f94d8e00640 1 Processor -- start 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d8e00640 1 -- start start 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d8e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94d4100c70 0x7f94d419b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d410b180 0x7f94d419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d8e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94d419fb20 0x7f94d419ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d8e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4114e60 con 0x7f94d410b180 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d8e00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4114ce0 con 0x7f94d4100c70 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d8e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4114fe0 con 0x7f94d419fb20 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d410b180 0x7f94d419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d410b180 0x7f94d419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46028/0 (socket says 172.21.15.110:46028) 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d1400640 1 -- 172.21.15.110:0/3591785565 learned_addr learned my addr 172.21.15.110:0/3591785565 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d2800640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94d419fb20 0x7f94d419ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.454+0000 7f94d1e00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94d4100c70 0x7f94d419b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94d1400640 1 -- 172.21.15.110:0/3591785565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94d419fb20 msgr2=0x7f94d419ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94d1400640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94d419fb20 0x7f94d419ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94d1400640 1 -- 172.21.15.110:0/3591785565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94d4100c70 msgr2=0x7f94d419b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94d1400640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94d4100c70 0x7f94d419b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94d1400640 1 -- 172.21.15.110:0/3591785565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d41a0610 con 0x7f94d410b180 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94d1400640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d410b180 0x7f94d419b7a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f94c0031440 tx=0x7f94c0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94caa00640 1 -- 172.21.15.110:0/3591785565 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c003f070 con 0x7f94d410b180 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94caa00640 1 -- 172.21.15.110:0/3591785565 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94c0031b50 con 0x7f94d410b180 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94caa00640 1 -- 172.21.15.110:0/3591785565 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0035030 con 0x7f94d410b180 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.455+0000 7f94d8e00640 1 -- 172.21.15.110:0/3591785565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d41a08a0 con 0x7f94d410b180 2024-04-26T11:45:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.456+0000 7f94d8e00640 1 -- 172.21.15.110:0/3591785565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d41a7fb0 con 0x7f94d410b180 2024-04-26T11:45:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.459+0000 7f94dbc73740 1 Processor -- start 2024-04-26T11:45:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.459+0000 7f94caa00640 1 -- 172.21.15.110:0/3591785565 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f94c0042070 con 0x7f94d410b180 2024-04-26T11:45:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.459+0000 7f94dbc73740 1 -- start start 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.459+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead371b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.459+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 0x5576ead41a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.459+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead41fb0 0x5576ead443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.459+0000 7f94dbc73740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5576eac9c380 con 0x5576ead41fb0 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.459+0000 7f94dbc73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5576eac38c30 con 0x5576ead376f0 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.459+0000 7f94dbc73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5576eac98340 con 0x5576ead36dd0 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d2800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d2800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead371b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:37538/0 (socket says 172.21.15.110:37538) 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d2800640 1 -- 172.21.15.110:0/4032482039 learned_addr learned my addr 172.21.15.110:0/4032482039 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d1400640 1 --2- 172.21.15.110:0/4032482039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead41fb0 0x5576ead443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d1e00640 1 --2- 172.21.15.110:0/4032482039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 0x5576ead41a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d2800640 1 -- 172.21.15.110:0/4032482039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 msgr2=0x5576ead41a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d2800640 1 --2- 172.21.15.110:0/4032482039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 0x5576ead41a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d2800640 1 -- 172.21.15.110:0/4032482039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead41fb0 msgr2=0x5576ead443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d2800640 1 --2- 172.21.15.110:0/4032482039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead41fb0 0x5576ead443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.460+0000 7f94d2800640 1 -- 172.21.15.110:0/4032482039 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576eac5a940 con 0x5576ead36dd0 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.461+0000 7f94d2800640 1 --2- 172.21.15.110:0/4032482039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead371b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009fd0 tx=0x7f94cc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4b54976010164a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.461+0000 7f94caa00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f94b80a3dc0 0x7f94b80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.461+0000 7f94bf400640 1 -- 172.21.15.110:0/4032482039 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc004d20 con 0x5576ead36dd0 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.461+0000 7f94bf400640 1 -- 172.21.15.110:0/4032482039 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94cc004050 con 0x5576ead36dd0 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.461+0000 7f94bf400640 1 -- 172.21.15.110:0/4032482039 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc005220 con 0x5576ead36dd0 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.461+0000 7f94caa00640 1 -- 172.21.15.110:0/3591785565 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 11825+0+0 (secure 0 0 0) 0x7f94c00f1a50 con 0x7f94d410b180 2024-04-26T11:45:07.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.461+0000 7f94d1e00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f94b80a3dc0 0x7f94b80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 -- 172.21.15.110:0/4032482039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 msgr2=0x5576ead371b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:07.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94d1e00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f94b80a3dc0 0x7f94b80a6280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5576ead38370 tx=0x7f94c4005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:07.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 --2- 172.21.15.110:0/4032482039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead371b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009fd0 tx=0x7f94cc0118d0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 -- 172.21.15.110:0/4032482039 shutdown_connections 2024-04-26T11:45:07.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 --2- 172.21.15.110:0/4032482039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead41fb0 0x5576ead443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 --2- 172.21.15.110:0/4032482039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 0x5576ead41a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 --2- 172.21.15.110:0/4032482039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead371b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 -- 172.21.15.110:0/4032482039 >> 172.21.15.110:0/4032482039 conn(0x5576ead332e0 msgr2=0x5576ead336c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 -- 172.21.15.110:0/4032482039 shutdown_connections 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 -- 172.21.15.110:0/4032482039 wait complete. 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.462+0000 7f94dbc73740 1 -- start start 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94dbc73740 1 Processor -- start 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead36dd0 0x5576ead3ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead3f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 0x5576ead3f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94dbc73740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5576ead44be0 con 0x5576ead376f0 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94dbc73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5576eac23c60 con 0x5576ead36dd0 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94dbc73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5576ead44d60 con 0x5576ead41fb0 2024-04-26T11:45:07.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94dbc73740 10 client.0 _ll_register_callbacks cb 0x5576eac4fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94d1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead3f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94d1e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead36dd0 0x5576ead3ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94d2800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 0x5576ead3f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94d1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead3f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46052/0 (socket says 172.21.15.110:46052) 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.463+0000 7f94d1400640 1 -- 172.21.15.110:0/551936974 learned_addr learned my addr 172.21.15.110:0/551936974 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94d1400640 1 -- 172.21.15.110:0/551936974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 msgr2=0x5576ead3f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94d1400640 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 0x5576ead3f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94d1400640 1 -- 172.21.15.110:0/551936974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead36dd0 msgr2=0x5576ead3ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94d1400640 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead36dd0 0x5576ead3ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94d1400640 1 -- 172.21.15.110:0/551936974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576eac32510 con 0x5576ead376f0 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94d1400640 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead3f4a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f94c00096c0 tx=0x7f94c0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c766bc4fb6127a81 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:07.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94b3e00640 1 -- 172.21.15.110:0/551936974 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0049070 con 0x5576ead376f0 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94b3e00640 1 -- 172.21.15.110:0/551936974 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(145..145 src has 1..145) ==== 11825+0+0 (secure 0 0 0) 0x7f94c00ee730 con 0x5576ead376f0 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.464+0000 7f94dbc73740 1 -- 172.21.15.110:0/551936974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94cc004050 con 0x5576ead376f0 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94b3e00640 1 -- 172.21.15.110:0/551936974 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=239) ==== 24+0+0 (secure 0 0 0) 0x7f94c00bc8f0 con 0x5576ead376f0 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94dbc73740 10 client.16107 fetch_fsmap learned FSMap version 239 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94dbc73740 1 -- 172.21.15.110:0/551936974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=239,monmap=4+}) -- 0x5576ea9ae210 con 0x5576ead376f0 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94b3e00640 1 -- 172.21.15.110:0/551936974 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94cc004050 con 0x5576ead376f0 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94b3e00640 1 -- 172.21.15.110:0/551936974 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 239) ==== 5922+0+0 (secure 0 0 0) 0x7f94c00a7070 con 0x5576ead376f0 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94dbc73740 10 client.16107 fetch_fsmap finished waiting for FSMap version 239 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94dbc73740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94dbc73740 20 client.16107 populate_metadata read hostname 'smithi110' 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94dbc73740 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5576ead51cf0 0x5576ead54170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94dbc73740 4 client.16107 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:45:07.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.465+0000 7f94dbc73740 1 -- 172.21.15.110:0/551936974 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576eaca9f90 con 0x5576ead51cf0 2024-04-26T11:45:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.466+0000 7f94d1e00640 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5576ead51cf0 0x5576ead54170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.466+0000 7f94d1e00640 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5576ead51cf0 0x5576ead54170 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7225e07c610b37a server_cookie=80622aa658359537 in_seq=0 out_seq=0 2024-04-26T11:45:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.466+0000 7f94b3e00640 10 client.16107 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:07.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94b3e00640 1 -- 172.21.15.110:0/551936974 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5576eaca9f90 con 0x5576ead51cf0 2024-04-26T11:45:07.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94b3e00640 10 client.16107 handle_command_reply: tid=0 2024-04-26T11:45:07.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94dbc73740 1 client.16107 shutdown 2024-04-26T11:45:07.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94dbc73740 1 -- 172.21.15.110:0/551936974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 msgr2=0x5576ead3f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:07.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94dbc73740 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead3f4a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f94c00096c0 tx=0x7f94c0003f90 comp rx=0 tx=0).stop 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94dbc73740 1 -- 172.21.15.110:0/551936974 shutdown_connections 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94dbc73740 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5576ead51cf0 0x5576ead54170 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94dbc73740 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 0x5576ead3f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94dbc73740 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead3f4a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94dbc73740 1 --2- 172.21.15.110:0/551936974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead36dd0 0x5576ead3ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94b3e00640 0 client.16107 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.467+0000 7f94dbc73740 1 -- 172.21.15.110:0/551936974 >> 172.21.15.110:0/551936974 conn(0x5576ead332e0 msgr2=0x5576ead39010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.468+0000 7f94dbc73740 1 -- 172.21.15.110:0/551936974 shutdown_connections 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.468+0000 7f94dbc73740 1 -- 172.21.15.110:0/551936974 wait complete. 2024-04-26T11:45:07.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.468+0000 7f94dbc73740 20 client.16107 trim_cache size 0 max 16384 2024-04-26T11:45:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.484+0000 7f94dbc73740 1 Processor -- start 2024-04-26T11:45:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.484+0000 7f94dbc73740 1 -- start start 2024-04-26T11:45:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.484+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead4daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.484+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead40d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead41fb0 0x5576ead59a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94dbc73740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41b1cf0 con 0x5576ead376f0 2024-04-26T11:45:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94dbc73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41b3860 con 0x5576ead41fb0 2024-04-26T11:45:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94dbc73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41b23c0 con 0x5576ead36dd0 2024-04-26T11:45:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead40d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead40d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46066/0 (socket says 172.21.15.110:46066) 2024-04-26T11:45:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d1400640 1 -- 172.21.15.110:0/3298405826 learned_addr learned my addr 172.21.15.110:0/3298405826 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:07.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d1e00640 1 --2- 172.21.15.110:0/3298405826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead4daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d2800640 1 --2- 172.21.15.110:0/3298405826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead41fb0 0x5576ead59a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d1400640 1 -- 172.21.15.110:0/3298405826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 msgr2=0x5576ead4daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d1400640 1 --2- 172.21.15.110:0/3298405826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead4daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d1400640 1 -- 172.21.15.110:0/3298405826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead41fb0 msgr2=0x5576ead59a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d1400640 1 --2- 172.21.15.110:0/3298405826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead41fb0 0x5576ead59a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.485+0000 7f94d1400640 1 -- 172.21.15.110:0/3298405826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576ead39d80 con 0x5576ead376f0 2024-04-26T11:45:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.486+0000 7f94d1400640 1 --2- 172.21.15.110:0/3298405826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead40d90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f94c00f1ed0 tx=0x7f94c00bb2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98473dd5793e87f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.486+0000 7f94bea00640 1 -- 172.21.15.110:0/3298405826 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0049070 con 0x5576ead376f0 2024-04-26T11:45:07.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.486+0000 7f94bea00640 1 -- 172.21.15.110:0/3298405826 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94c00d6240 con 0x5576ead376f0 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.486+0000 7f94bea00640 1 -- 172.21.15.110:0/3298405826 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c00f8080 con 0x5576ead376f0 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.486+0000 7f94dbc73740 1 -- 172.21.15.110:0/3298405826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 msgr2=0x5576ead40d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.486+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3298405826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead40d90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f94c00f1ed0 tx=0x7f94c00bb2c0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.487+0000 7f94dbc73740 1 -- 172.21.15.110:0/3298405826 shutdown_connections 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.487+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3298405826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead41fb0 0x5576ead59a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.487+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3298405826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead376f0 0x5576ead40d90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.487+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3298405826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead36dd0 0x5576ead4daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.487+0000 7f94dbc73740 1 -- 172.21.15.110:0/3298405826 >> 172.21.15.110:0/3298405826 conn(0x5576ead332e0 msgr2=0x5576ead40680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.487+0000 7f94dbc73740 1 -- 172.21.15.110:0/3298405826 shutdown_connections 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.487+0000 7f94dbc73740 1 -- 172.21.15.110:0/3298405826 wait complete. 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.487+0000 7f94dbc73740 1 -- start start 2024-04-26T11:45:07.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.487+0000 7f94dbc73740 1 Processor -- start 2024-04-26T11:45:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead36dd0 0x5576ead49fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 0x5576ead4a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94dbc73740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 0x5576ead47110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94dbc73740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41b3190 con 0x5576ead36dd0 2024-04-26T11:45:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94dbc73740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41b2ac0 con 0x5576ead376f0 2024-04-26T11:45:07.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94dbc73740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41b04c0 con 0x5576ead41fb0 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94dbc73740 10 client.0 _ll_register_callbacks cb 0x7f94c00f5290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead36dd0 0x5576ead49fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead36dd0 0x5576ead49fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46078/0 (socket says 172.21.15.110:46078) 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d1e00640 1 -- 172.21.15.110:0/3854775133 learned_addr learned my addr 172.21.15.110:0/3854775133 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d1400640 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 0x5576ead4a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d2800640 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 0x5576ead47110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d1e00640 1 -- 172.21.15.110:0/3854775133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 msgr2=0x5576ead47110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d1e00640 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 0x5576ead47110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d1e00640 1 -- 172.21.15.110:0/3854775133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 msgr2=0x5576ead4a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d1e00640 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 0x5576ead4a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.488+0000 7f94d1e00640 1 -- 172.21.15.110:0/3854775133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576eaa7a620 con 0x5576ead36dd0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.489+0000 7f94d1e00640 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead36dd0 0x5576ead49fb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009460 tx=0x7f94c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48deb2178582d2a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.489+0000 7f94b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.489+0000 7f94b3e00640 1 -- 172.21.15.110:0/3854775133 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c402b750 con 0x5576ead36dd0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.489+0000 7f94b3e00640 1 -- 172.21.15.110:0/3854775133 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(145..145 src has 1..145) ==== 11825+0+0 (secure 0 0 0) 0x7f94c4005020 con 0x5576ead36dd0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.489+0000 7f94dbc73740 1 -- 172.21.15.110:0/3854775133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94c00d6240 con 0x5576ead36dd0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.489+0000 7f94b3e00640 1 -- 172.21.15.110:0/3854775133 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=239) ==== 24+0+0 (secure 0 0 0) 0x7f94c403c050 con 0x5576ead36dd0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.489+0000 7f94dbc73740 10 client.16113 fetch_fsmap learned FSMap version 239 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.489+0000 7f94dbc73740 1 -- 172.21.15.110:0/3854775133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=239,monmap=4+}) -- 0x5576eac56cb0 con 0x5576ead36dd0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.490+0000 7f94b3e00640 1 -- 172.21.15.110:0/3854775133 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94c00d6240 con 0x5576ead36dd0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.490+0000 7f94b3e00640 1 -- 172.21.15.110:0/3854775133 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 239) ==== 5922+0+0 (secure 0 0 0) 0x7f94c40035f0 con 0x5576ead36dd0 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.490+0000 7f94dbc73740 10 client.16113 fetch_fsmap finished waiting for FSMap version 239 2024-04-26T11:45:07.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.490+0000 7f94dbc73740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:45:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.490+0000 7f94dbc73740 20 client.16113 populate_metadata read hostname 'smithi110' 2024-04-26T11:45:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.490+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5576eadb92d0 0x5576eadbb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.490+0000 7f94dbc73740 4 client.16113 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:45:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.490+0000 7f94dbc73740 1 -- 172.21.15.110:0/3854775133 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5576eaca3e00 con 0x5576eadb92d0 2024-04-26T11:45:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.490+0000 7f94d1400640 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5576eadb92d0 0x5576eadbb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.491+0000 7f94d1400640 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5576eadb92d0 0x5576eadbb6f0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72c0d8aa5a9f9ebd server_cookie=f80c655c8b7772cf in_seq=0 out_seq=0 2024-04-26T11:45:07.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:07.491+0000 7f94b3e00640 10 client.16113 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:07 smithi193 ceph-mon[32782]: pgmap v472: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.5 MiB/s wr, 291 op/s 2024-04-26T11:45:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:07 smithi196 ceph-mon[32572]: pgmap v472: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.5 MiB/s wr, 291 op/s 2024-04-26T11:45:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:07 smithi110 ceph-mon[28069]: pgmap v472: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.5 MiB/s wr, 291 op/s 2024-04-26T11:45:09.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:09 smithi110 ceph-mon[28069]: pgmap v473: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.6 MiB/s wr, 312 op/s 2024-04-26T11:45:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:09 smithi193 ceph-mon[32782]: pgmap v473: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.6 MiB/s wr, 312 op/s 2024-04-26T11:45:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:09 smithi196 ceph-mon[32572]: pgmap v473: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.6 MiB/s wr, 312 op/s 2024-04-26T11:45:09.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:45:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:11 smithi193 ceph-mon[32782]: pgmap v474: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 3.0 MiB/s wr, 274 op/s 2024-04-26T11:45:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:11 smithi196 ceph-mon[32572]: pgmap v474: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 3.0 MiB/s wr, 274 op/s 2024-04-26T11:45:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:11 smithi110 ceph-mon[28069]: pgmap v474: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 3.0 MiB/s wr, 274 op/s 2024-04-26T11:45:11.980 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:11 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:45:11.980 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:11 smithi193 systemd[1]: Stopped Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:11.980 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:11 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.530s CPU time. 2024-04-26T11:45:11.980 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:11 smithi193 systemd[1]: Starting Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:45:11.980 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:11 smithi193 podman[70068]: 2024-04-26 11:45:11.75186175 +0000 UTC m=+0.017857529 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:45:11.980 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:11 smithi193 podman[70068]: 2024-04-26 11:45:11.856664422 +0000 UTC m=+0.122660176 container create 3691090a6364287d7b0cccb7abf5dbf9b74b7c8e8b65eb76968cb46e5b179c2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:45:12.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:12 smithi193 podman[70068]: 2024-04-26 11:45:12.093229117 +0000 UTC m=+0.359224885 container init 3691090a6364287d7b0cccb7abf5dbf9b74b7c8e8b65eb76968cb46e5b179c2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T11:45:12.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:12 smithi193 podman[70068]: 2024-04-26 11:45:12.096909412 +0000 UTC m=+0.362905167 container start 3691090a6364287d7b0cccb7abf5dbf9b74b7c8e8b65eb76968cb46e5b179c2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-26T11:45:12.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-mds[70088]: -- 172.21.15.193:0/3408605479 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a63103da40 con 0x55a631011000 2024-04-26T11:45:12.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: starting mds.k at 2024-04-26T11:45:12.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:12 smithi193 bash[70068]: 3691090a6364287d7b0cccb7abf5dbf9b74b7c8e8b65eb76968cb46e5b179c2d 2024-04-26T11:45:12.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:12 smithi193 systemd[1]: Started Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:12.373 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 5. 2024-04-26T11:45:12.373 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 systemd[1]: Stopped Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:12.373 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 2.034s CPU time. 2024-04-26T11:45:12.373 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 systemd[1]: Starting Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:45:12.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-mon[28069]: daemon mds.k restarted 2024-04-26T11:45:12.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:45:12.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:45:12.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-mon[28069]: osdmap e146: 12 total, 12 up, 12 in 2024-04-26T11:45:12.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:boot 2024-04-26T11:45:12.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-mon[28069]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:45:12.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:45:12.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=d=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:12.705 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 podman[94675]: 2024-04-26 11:45:12.346545647 +0000 UTC m=+0.033122594 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:45:12.705 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 podman[94675]: 2024-04-26 11:45:12.511635224 +0000 UTC m=+0.198212228 container create 0b117229e6623b1a98256776423741f3cb7d2f09e8183a7ff769bc4f9aeb327a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-26T11:45:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:12 smithi196 ceph-mon[32572]: daemon mds.k restarted 2024-04-26T11:45:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:12 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:45:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:45:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:12 smithi196 ceph-mon[32572]: osdmap e146: 12 total, 12 up, 12 in 2024-04-26T11:45:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:12 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:boot 2024-04-26T11:45:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:12 smithi196 ceph-mon[32572]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:45:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:12 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:45:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:12 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=d=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-mon[32782]: daemon mds.k restarted 2024-04-26T11:45:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:45:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:45:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-mon[32782]: osdmap e146: 12 total, 12 up, 12 in 2024-04-26T11:45:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:boot 2024-04-26T11:45:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-mon[32782]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:45:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:45:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:12 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=d=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:13.294 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 podman[94675]: 2024-04-26 11:45:12.807765028 +0000 UTC m=+0.494342019 container init 0b117229e6623b1a98256776423741f3cb7d2f09e8183a7ff769bc4f9aeb327a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-04-26T11:45:13.294 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 podman[94675]: 2024-04-26 11:45:12.815840764 +0000 UTC m=+0.502417778 container start 0b117229e6623b1a98256776423741f3cb7d2f09e8183a7ff769bc4f9aeb327a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-04-26T11:45:13.294 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-mds[94693]: -- 172.21.15.110:0/1721220592 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ecb1911a40 con 0x55ecb18e5000 2024-04-26T11:45:13.294 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: starting mds.j at 2024-04-26T11:45:13.294 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 bash[94675]: 0b117229e6623b1a98256776423741f3cb7d2f09e8183a7ff769bc4f9aeb327a 2024-04-26T11:45:13.295 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:12 smithi110 systemd[1]: Started Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:13 smithi196 ceph-mon[32572]: pgmap v475: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 171 op/s 2024-04-26T11:45:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:13 smithi196 ceph-mon[32572]: daemon mds.j restarted 2024-04-26T11:45:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:45:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:13 smithi196 ceph-mon[32572]: osdmap e147: 12 total, 12 up, 12 in 2024-04-26T11:45:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:13 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:resolve 2024-04-26T11:45:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:13 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:boot 2024-04-26T11:45:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:13 smithi196 ceph-mon[32572]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T11:45:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:13 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:45:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:13 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=d=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:13 smithi110 ceph-mon[28069]: pgmap v475: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 171 op/s 2024-04-26T11:45:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:13 smithi110 ceph-mon[28069]: daemon mds.j restarted 2024-04-26T11:45:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:45:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:13 smithi110 ceph-mon[28069]: osdmap e147: 12 total, 12 up, 12 in 2024-04-26T11:45:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:13 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:resolve 2024-04-26T11:45:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:13 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:boot 2024-04-26T11:45:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:13 smithi110 ceph-mon[28069]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T11:45:13.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:13 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:45:13.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:13 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=d=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:13 smithi193 ceph-mon[32782]: pgmap v475: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 171 op/s 2024-04-26T11:45:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:13 smithi193 ceph-mon[32782]: daemon mds.j restarted 2024-04-26T11:45:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T11:45:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:13 smithi193 ceph-mon[32782]: osdmap e147: 12 total, 12 up, 12 in 2024-04-26T11:45:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:13 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:resolve 2024-04-26T11:45:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:13 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:boot 2024-04-26T11:45:13.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:13 smithi193 ceph-mon[32782]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T11:45:13.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:13 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:45:13.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:13 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=d=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:14.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:45:15.649 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:15 smithi110 ceph-mon[28069]: pgmap v478: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2024-04-26T11:45:15.649 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:15 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:resolve 2024-04-26T11:45:15.649 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:15 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=d=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:15 smithi196 ceph-mon[32572]: pgmap v478: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2024-04-26T11:45:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:15 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:resolve 2024-04-26T11:45:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:15 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=d=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:15.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:15 smithi193 ceph-mon[32782]: pgmap v478: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2024-04-26T11:45:15.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:15 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:resolve 2024-04-26T11:45:15.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:15 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=d=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.435+0000 7f94b3e00640 1 -- 172.21.15.110:0/3854775133 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5576eaca3e00 con 0x5576eadb92d0 2024-04-26T11:45:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.435+0000 7f94b3e00640 10 client.16113 handle_command_reply: tid=0 2024-04-26T11:45:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.435+0000 7f94dbc73740 1 client.16113 shutdown 2024-04-26T11:45:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.436+0000 7f94dbc73740 1 -- 172.21.15.110:0/3854775133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead36dd0 msgr2=0x5576ead49fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.436+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead36dd0 0x5576ead49fb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009460 tx=0x7f94c40046c0 comp rx=0 tx=0).stop 2024-04-26T11:45:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.437+0000 7f94dbc73740 1 -- 172.21.15.110:0/3854775133 shutdown_connections 2024-04-26T11:45:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.437+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5576eadb92d0 0x5576eadbb6f0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.437+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5576ead41fb0 0x5576ead47110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.437+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5576ead376f0 0x5576ead4a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.437+0000 7f94dbc73740 1 --2- 172.21.15.110:0/3854775133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5576ead36dd0 0x5576ead49fb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.437+0000 7f94dbc73740 1 -- 172.21.15.110:0/3854775133 >> 172.21.15.110:0/3854775133 conn(0x5576ead332e0 msgr2=0x5576ead3f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.437+0000 7f94b3e00640 0 client.16113 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.437+0000 7f94dbc73740 1 -- 172.21.15.110:0/3854775133 shutdown_connections 2024-04-26T11:45:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.437+0000 7f94dbc73740 1 -- 172.21.15.110:0/3854775133 wait complete. 2024-04-26T11:45:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.438+0000 7f94dbc73740 20 client.16113 trim_cache size 0 max 16384 2024-04-26T11:45:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:45:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:45:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:45:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:45:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.439+0000 7f94d8e00640 1 -- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f94b80a3dc0 msgr2=0x7f94b80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.439+0000 7f94d8e00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f94b80a3dc0 0x7f94b80a6280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5576ead38370 tx=0x7f94c4005f90 comp rx=0 tx=0).stop 2024-04-26T11:45:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.439+0000 7f94d8e00640 1 -- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d410b180 msgr2=0x7f94d419b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.439+0000 7f94d8e00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d410b180 0x7f94d419b7a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f94c0031440 tx=0x7f94c0003b90 comp rx=0 tx=0).stop 2024-04-26T11:45:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.439+0000 7f94d8e00640 1 -- 172.21.15.110:0/3591785565 shutdown_connections 2024-04-26T11:45:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.439+0000 7f94d8e00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f94b80a3dc0 0x7f94b80a6280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.439+0000 7f94d8e00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f94d419fb20 0x7f94d419ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.439+0000 7f94d8e00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d410b180 0x7f94d419b7a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.439+0000 7f94d8e00640 1 --2- 172.21.15.110:0/3591785565 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94d4100c70 0x7f94d419b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.440+0000 7f94d8e00640 1 -- 172.21.15.110:0/3591785565 >> 172.21.15.110:0/3591785565 conn(0x7f94d4077930 msgr2=0x7f94d40fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.440+0000 7f94d8e00640 1 -- 172.21.15.110:0/3591785565 shutdown_connections 2024-04-26T11:45:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:16.440+0000 7f94d8e00640 1 -- 172.21.15.110:0/3591785565 wait complete. 2024-04-26T11:45:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:16 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:45:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:16 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:reconnect 2024-04-26T11:45:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:16 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:reconnect 2024-04-26T11:45:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:16 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:16 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:45:16.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:16 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:45:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:16 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:45:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:16 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:reconnect 2024-04-26T11:45:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:16 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:reconnect 2024-04-26T11:45:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:16 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:16 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:45:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:16 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:45:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:16 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199996 2024-04-26T11:45:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:16 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:reconnect 2024-04-26T11:45:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:16 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:reconnect 2024-04-26T11:45:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:16 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:16 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189996 2024-04-26T11:45:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:16 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:45:17.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-mon[28069]: pgmap v479: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 827 KiB/s wr, 109 op/s 2024-04-26T11:45:17.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:rejoin 2024-04-26T11:45:17.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:rejoin 2024-04-26T11:45:17.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:17.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-mon[28069]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:45:17.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-mon[28069]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f17ac800700 time 2024-04-26T11:45:17.513406+0000 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f17b80343dd] 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f17b80345a3] 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561602ef2822] 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561602e62598] 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561602e64c17] 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561602d5dd0b] 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561602d5e2ac] 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561602d46fad] 2024-04-26T11:45:17.697 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f17b82c8e20] 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 10: (DispatchQueue::entry()+0x51f) [0x7f17b82c5fdf] 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f17b8398fc1] 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f17b6db21ca] 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 13: clone() 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: *** Caught signal (Aborted) ** 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: in thread 7f17ac800700 thread_name:ms_dispatch 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.514+0000 7f17ac800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f17ac800700 time 2024-04-26T11:45:17.513406+0000 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f17b80343dd] 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f17b80345a3] 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561602ef2822] 2024-04-26T11:45:17.698 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561602e62598] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561602e64c17] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561602d5dd0b] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561602d5e2ac] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561602d46fad] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f17b82c8e20] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 10: (DispatchQueue::entry()+0x51f) [0x7f17b82c5fdf] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f17b8398fc1] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f17b6db21ca] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 13: clone() 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f17b6dbcd20] 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2: gsignal() 2024-04-26T11:45:17.699 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 3: abort() 2024-04-26T11:45:17.700 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f17b8034437] 2024-04-26T11:45:17.700 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f17b80345a3] 2024-04-26T11:45:17.700 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561602ef2822] 2024-04-26T11:45:17.700 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561602e62598] 2024-04-26T11:45:17.700 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561602e64c17] 2024-04-26T11:45:17.700 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561602d5dd0b] 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561602d5e2ac] 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561602d46fad] 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f17b82c8e20] 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 13: (DispatchQueue::entry()+0x51f) [0x7f17b82c5fdf] 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f17b8398fc1] 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f17b6db21ca] 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 16: clone() 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.518+0000 7f17ac800700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: in thread 7f17ac800700 thread_name:ms_dispatch 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:17.701 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f17b6dbcd20] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2: gsignal() 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 3: abort() 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f17b8034437] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f17b80345a3] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561602ef2822] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561602e62598] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561602e64c17] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561602d5dd0b] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561602d5e2ac] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561602d46fad] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f17b82c8e20] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 13: (DispatchQueue::entry()+0x51f) [0x7f17b82c5fdf] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f17b8398fc1] 2024-04-26T11:45:17.702 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f17b6db21ca] 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 16: clone() 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: -1> 2024-04-26T11:45:17.514+0000 7f17ac800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f17ac800700 time 2024-04-26T11:45:17.513406+0000 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f17b80343dd] 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f17b80345a3] 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561602ef2822] 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561602e62598] 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561602e64c17] 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561602d5dd0b] 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561602d5e2ac] 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561602d46fad] 2024-04-26T11:45:17.703 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f17b82c8e20] 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 10: (DispatchQueue::entry()+0x51f) [0x7f17b82c5fdf] 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f17b8398fc1] 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f17b6db21ca] 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 13: clone() 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 0> 2024-04-26T11:45:17.518+0000 7f17ac800700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: in thread 7f17ac800700 thread_name:ms_dispatch 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f17b6dbcd20] 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2: gsignal() 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 3: abort() 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f17b8034437] 2024-04-26T11:45:17.704 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f17b80345a3] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561602ef2822] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561602e62598] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561602e64c17] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561602d5dd0b] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561602d5e2ac] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561602d46fad] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f17b82c8e20] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 13: (DispatchQueue::entry()+0x51f) [0x7f17b82c5fdf] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f17b8398fc1] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f17b6db21ca] 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 16: clone() 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: -1> 2024-04-26T11:45:17.514+0000 7f17ac800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f17ac800700 time 2024-04-26T11:45:17.513406+0000 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:17.705 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f17b80343dd] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f17b80345a3] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561602ef2822] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561602e62598] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561602e64c17] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561602d5dd0b] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561602d5e2ac] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561602d46fad] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f17b82c8e20] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 10: (DispatchQueue::entry()+0x51f) [0x7f17b82c5fdf] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f17b8398fc1] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f17b6db21ca] 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 13: clone() 2024-04-26T11:45:17.706 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 0> 2024-04-26T11:45:17.518+0000 7f17ac800700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: in thread 7f17ac800700 thread_name:ms_dispatch 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f17b6dbcd20] 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2: gsignal() 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 3: abort() 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f17b8034437] 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f17b80345a3] 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561602ef2822] 2024-04-26T11:45:17.707 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561602e62598] 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561602e64c17] 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561602d5dd0b] 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561602d5e2ac] 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561602d46fad] 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f17b82c8e20] 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 13: (DispatchQueue::entry()+0x51f) [0x7f17b82c5fdf] 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f17b8398fc1] 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f17b6db21ca] 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 16: clone() 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:17.708 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94417]: 2024-04-26T11:45:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:17 smithi196 ceph-mon[32572]: pgmap v479: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 827 KiB/s wr, 109 op/s 2024-04-26T11:45:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:17 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:rejoin 2024-04-26T11:45:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:17 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:rejoin 2024-04-26T11:45:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:17 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:17 smithi196 ceph-mon[32572]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:45:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:17 smithi196 ceph-mon[32572]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:45:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:17 smithi193 ceph-mon[32782]: pgmap v479: 97 pgs: 97 active+clean; 3.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 827 KiB/s wr, 109 op/s 2024-04-26T11:45:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:17 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:rejoin 2024-04-26T11:45:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:17 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:rejoin 2024-04-26T11:45:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:17 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:17 smithi193 ceph-mon[32782]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:45:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:17 smithi193 ceph-mon[32782]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:45:18.041 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:17 smithi110 podman[94731]: 2024-04-26 11:45:17.702754051 +0000 UTC m=+0.053409920 container died 35d0dbe49e2f247562654490ed9898b52b223ff9a36da10456a6bba979337525 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-26T11:45:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:18 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:45:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:18 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:active 2024-04-26T11:45:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:18 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:active 2024-04-26T11:45:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:18 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:18 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:18 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:45:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:18 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:active 2024-04-26T11:45:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:18 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:active 2024-04-26T11:45:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:18 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:18 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:18.792 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:18 smithi110 podman[94731]: 2024-04-26 11:45:18.570182215 +0000 UTC m=+0.920838131 container remove 35d0dbe49e2f247562654490ed9898b52b223ff9a36da10456a6bba979337525 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:45:18.792 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:18 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:45:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:18 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:45:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:18 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/664808179,v1:172.21.15.196:6833/664808179] up:active 2024-04-26T11:45:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:18 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/1723392217,v1:172.21.15.110:6837/1723392217] up:active 2024-04-26T11:45:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:18 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:18 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:19.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:19 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T11:45:19.292 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:19 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 2.155s CPU time. 2024-04-26T11:45:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:19 smithi196 ceph-mon[32572]: pgmap v480: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 750 KiB/s wr, 121 op/s 2024-04-26T11:45:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:19 smithi110 ceph-mon[28069]: pgmap v480: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 750 KiB/s wr, 121 op/s 2024-04-26T11:45:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:19 smithi193 ceph-mon[32782]: pgmap v480: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 750 KiB/s wr, 121 op/s 2024-04-26T11:45:19.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 785.0 s, 303.8 tps, lat 1312.753 ms stddev 4811.882 2024-04-26T11:45:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:21 smithi196 ceph-mon[32572]: pgmap v481: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.5 MiB/s wr, 289 op/s 2024-04-26T11:45:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:21 smithi110 ceph-mon[28069]: pgmap v481: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.5 MiB/s wr, 289 op/s 2024-04-26T11:45:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:21 smithi193 ceph-mon[32782]: pgmap v481: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.5 MiB/s wr, 289 op/s 2024-04-26T11:45:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:22.755 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7effa2f36700 time 2024-04-26T11:45:22.457048+0000 2024-04-26T11:45:22.755 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7effad55f3dd] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7effad55f5a3] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c5fdf06822] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c5fde76598] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c5fde78c17] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c5fdd71d0b] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c5fdd722ac] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c5fdd5afad] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7effad7f3e20] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 10: (DispatchQueue::entry()+0x51f) [0x7effad7f0fdf] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7effad8c3fc1] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7effac2dd1ca] 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 13: clone() 2024-04-26T11:45:22.756 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.456+0000 7effa2f36700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7effa2f36700 time 2024-04-26T11:45:22.457048+0000 2024-04-26T11:45:22.757 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:22.757 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.757 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:22.757 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7effad55f3dd] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7effad55f5a3] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c5fdf06822] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c5fde76598] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c5fde78c17] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c5fdd71d0b] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c5fdd722ac] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c5fdd5afad] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7effad7f3e20] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 10: (DispatchQueue::entry()+0x51f) [0x7effad7f0fdf] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7effad8c3fc1] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7effac2dd1ca] 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 13: clone() 2024-04-26T11:45:22.758 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.759 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: *** Caught signal (Aborted) ** 2024-04-26T11:45:22.759 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: in thread 7effa2f36700 thread_name:ms_dispatch 2024-04-26T11:45:22.759 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:22.759 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7effac2e7d20] 2024-04-26T11:45:22.759 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2: gsignal() 2024-04-26T11:45:22.759 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 3: abort() 2024-04-26T11:45:22.759 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7effad55f437] 2024-04-26T11:45:22.759 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7effad55f5a3] 2024-04-26T11:45:22.759 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c5fdf06822] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c5fde76598] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c5fde78c17] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c5fdd71d0b] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c5fdd722ac] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c5fdd5afad] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7effad7f3e20] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 13: (DispatchQueue::entry()+0x51f) [0x7effad7f0fdf] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7effad8c3fc1] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7effac2dd1ca] 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 16: clone() 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.458+0000 7effa2f36700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: in thread 7effa2f36700 thread_name:ms_dispatch 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:22.760 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7effac2e7d20] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2: gsignal() 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 3: abort() 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7effad55f437] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7effad55f5a3] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c5fdf06822] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c5fde76598] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c5fde78c17] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c5fdd71d0b] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c5fdd722ac] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c5fdd5afad] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7effad7f3e20] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 13: (DispatchQueue::entry()+0x51f) [0x7effad7f0fdf] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7effad8c3fc1] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7effac2dd1ca] 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 16: clone() 2024-04-26T11:45:22.761 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: -1> 2024-04-26T11:45:22.456+0000 7effa2f36700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7effa2f36700 time 2024-04-26T11:45:22.457048+0000 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7effad55f3dd] 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7effad55f5a3] 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c5fdf06822] 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c5fde76598] 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c5fde78c17] 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c5fdd71d0b] 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c5fdd722ac] 2024-04-26T11:45:22.762 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c5fdd5afad] 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7effad7f3e20] 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 10: (DispatchQueue::entry()+0x51f) [0x7effad7f0fdf] 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7effad8c3fc1] 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7effac2dd1ca] 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 13: clone() 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 0> 2024-04-26T11:45:22.458+0000 7effa2f36700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: in thread 7effa2f36700 thread_name:ms_dispatch 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7effac2e7d20] 2024-04-26T11:45:22.763 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2: gsignal() 2024-04-26T11:45:22.764 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 3: abort() 2024-04-26T11:45:22.764 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7effad55f437] 2024-04-26T11:45:22.764 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7effad55f5a3] 2024-04-26T11:45:22.764 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c5fdf06822] 2024-04-26T11:45:22.764 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c5fde76598] 2024-04-26T11:45:22.764 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c5fde78c17] 2024-04-26T11:45:22.764 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c5fdd71d0b] 2024-04-26T11:45:22.765 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c5fdd722ac] 2024-04-26T11:45:22.765 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c5fdd5afad] 2024-04-26T11:45:22.765 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7effad7f3e20] 2024-04-26T11:45:22.765 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 13: (DispatchQueue::entry()+0x51f) [0x7effad7f0fdf] 2024-04-26T11:45:22.765 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7effad8c3fc1] 2024-04-26T11:45:22.765 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7effac2dd1ca] 2024-04-26T11:45:22.765 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 16: clone() 2024-04-26T11:45:22.766 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:22.766 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.766 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: -1> 2024-04-26T11:45:22.456+0000 7effa2f36700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7effa2f36700 time 2024-04-26T11:45:22.457048+0000 2024-04-26T11:45:22.766 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:22.766 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.766 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:22.766 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7effad55f3dd] 2024-04-26T11:45:22.767 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7effad55f5a3] 2024-04-26T11:45:22.767 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c5fdf06822] 2024-04-26T11:45:22.768 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c5fde76598] 2024-04-26T11:45:22.768 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c5fde78c17] 2024-04-26T11:45:22.768 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c5fdd71d0b] 2024-04-26T11:45:22.768 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c5fdd722ac] 2024-04-26T11:45:22.768 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c5fdd5afad] 2024-04-26T11:45:22.768 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7effad7f3e20] 2024-04-26T11:45:22.769 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 10: (DispatchQueue::entry()+0x51f) [0x7effad7f0fdf] 2024-04-26T11:45:22.769 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7effad8c3fc1] 2024-04-26T11:45:22.769 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7effac2dd1ca] 2024-04-26T11:45:22.769 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 13: clone() 2024-04-26T11:45:22.769 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.769 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 0> 2024-04-26T11:45:22.458+0000 7effa2f36700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:22.769 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: in thread 7effa2f36700 thread_name:ms_dispatch 2024-04-26T11:45:22.770 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.770 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:22.770 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7effac2e7d20] 2024-04-26T11:45:22.770 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2: gsignal() 2024-04-26T11:45:22.770 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 3: abort() 2024-04-26T11:45:22.770 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7effad55f437] 2024-04-26T11:45:22.771 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7effad55f5a3] 2024-04-26T11:45:22.771 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c5fdf06822] 2024-04-26T11:45:22.771 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c5fde76598] 2024-04-26T11:45:22.771 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c5fde78c17] 2024-04-26T11:45:22.771 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c5fdd71d0b] 2024-04-26T11:45:22.771 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c5fdd722ac] 2024-04-26T11:45:22.771 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c5fdd5afad] 2024-04-26T11:45:22.772 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7effad7f3e20] 2024-04-26T11:45:22.772 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 13: (DispatchQueue::entry()+0x51f) [0x7effad7f0fdf] 2024-04-26T11:45:22.772 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7effad8c3fc1] 2024-04-26T11:45:22.772 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7effac2dd1ca] 2024-04-26T11:45:22.772 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 16: clone() 2024-04-26T11:45:22.772 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:22.773 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[71988]: 2024-04-26T11:45:22.773 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:22 smithi196 podman[72029]: 2024-04-26 11:45:22.520131363 +0000 UTC m=+0.019683131 container died c3f46afaeab4d81622c2886efd65c5b1e773919753a4d0c4dbcdac1e174f0571 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T11:45:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:22 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:22 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:23.604 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:23 smithi196 ceph-mon[32572]: pgmap v482: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 2.1 MiB/s wr, 242 op/s 2024-04-26T11:45:23.604 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:23 smithi196 podman[72029]: 2024-04-26 11:45:23.335322258 +0000 UTC m=+0.834874024 container remove c3f46afaeab4d81622c2886efd65c5b1e773919753a4d0c4dbcdac1e174f0571 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T11:45:23.604 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:23 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:45:23.715 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:23 smithi110 ceph-mon[28069]: pgmap v482: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 2.1 MiB/s wr, 242 op/s 2024-04-26T11:45:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:23 smithi193 ceph-mon[32782]: pgmap v482: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 2.1 MiB/s wr, 242 op/s 2024-04-26T11:45:24.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:23 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T11:45:24.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:45:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:25 smithi196 ceph-mon[32572]: pgmap v483: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 533 op/s 2024-04-26T11:45:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:25 smithi110 ceph-mon[28069]: pgmap v483: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 533 op/s 2024-04-26T11:45:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:25 smithi193 ceph-mon[32782]: pgmap v483: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 533 op/s 2024-04-26T11:45:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:27 smithi196 ceph-mon[32572]: pgmap v484: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 3.9 MiB/s wr, 457 op/s 2024-04-26T11:45:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:27 smithi110 ceph-mon[28069]: pgmap v484: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 3.9 MiB/s wr, 457 op/s 2024-04-26T11:45:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:27 smithi193 ceph-mon[32782]: pgmap v484: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 3.9 MiB/s wr, 457 op/s 2024-04-26T11:45:29.428 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 5. 2024-04-26T11:45:29.428 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 systemd[1]: Stopped Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:29.428 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 2.155s CPU time. 2024-04-26T11:45:29.428 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 systemd[1]: Starting Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:45:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.588+0000 7f93b8800640 1 -- 172.21.15.110:0/3421430045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93b0102060 msgr2=0x7f93b010edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.588+0000 7f93b8800640 1 --2- 172.21.15.110:0/3421430045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93b0102060 0x7f93b010edb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009860 tx=0x7f93a002a340 comp rx=0 tx=0).stop 2024-04-26T11:45:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.588+0000 7f93b8800640 1 -- 172.21.15.110:0/3421430045 shutdown_connections 2024-04-26T11:45:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.588+0000 7f93b8800640 1 --2- 172.21.15.110:0/3421430045 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b010f2f0 0x7f93b01116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.588+0000 7f93b8800640 1 --2- 172.21.15.110:0/3421430045 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93b0102060 0x7f93b010edb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.588+0000 7f93b8800640 1 --2- 172.21.15.110:0/3421430045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b0101740 0x7f93b0101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.588+0000 7f93b8800640 1 -- 172.21.15.110:0/3421430045 >> 172.21.15.110:0/3421430045 conn(0x7f93b0078940 msgr2=0x7f93b0078d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.588+0000 7f93b8800640 1 -- 172.21.15.110:0/3421430045 shutdown_connections 2024-04-26T11:45:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.588+0000 7f93b8800640 1 -- 172.21.15.110:0/3421430045 wait complete. 2024-04-26T11:45:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.589+0000 7f93b8800640 1 Processor -- start 2024-04-26T11:45:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b8800640 1 -- start start 2024-04-26T11:45:29.592 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b8800640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b0101740 0x7f93b019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b8800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b0102060 0x7f93b019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b8800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93b010f2f0 0x7f93b019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b8800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0114e00 con 0x7f93b0102060 2024-04-26T11:45:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b8800640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0114c80 con 0x7f93b0101740 2024-04-26T11:45:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b8800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0114f80 con 0x7f93b010f2f0 2024-04-26T11:45:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b0101740 0x7f93b019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b0101740 0x7f93b019b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:35750/0 (socket says 172.21.15.110:35750) 2024-04-26T11:45:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b5e00640 1 -- 172.21.15.110:0/1601961495 learned_addr learned my addr 172.21.15.110:0/1601961495 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:29.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b6800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93b010f2f0 0x7f93b019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.590+0000 7f93b5400640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b0102060 0x7f93b019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.591+0000 7f93b6800640 1 -- 172.21.15.110:0/1601961495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b0101740 msgr2=0x7f93b019b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.591+0000 7f93b6800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b0101740 0x7f93b019b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.591+0000 7f93b6800640 1 -- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b0102060 msgr2=0x7f93b019b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.591+0000 7f93b6800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b0102060 0x7f93b019b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.591+0000 7f93b6800640 1 -- 172.21.15.110:0/1601961495 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b01a0320 con 0x7f93b010f2f0 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.591+0000 7f93b6800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93b010f2f0 0x7f93b019fbf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f93b0103920 tx=0x7f93a800edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.591+0000 7f93a6a00640 1 -- 172.21.15.110:0/1601961495 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a800ccc0 con 0x7f93b010f2f0 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.591+0000 7f93b8800640 1 -- 172.21.15.110:0/1601961495 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b01a0610 con 0x7f93b010f2f0 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.591+0000 7f93a6a00640 1 -- 172.21.15.110:0/1601961495 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93a8005020 con 0x7f93b010f2f0 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.592+0000 7f93a6a00640 1 -- 172.21.15.110:0/1601961495 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a800ce60 con 0x7f93b010f2f0 2024-04-26T11:45:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.592+0000 7f93b8800640 1 -- 172.21.15.110:0/1601961495 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b01a7ea0 con 0x7f93b010f2f0 2024-04-26T11:45:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.595+0000 7f93bb5fa740 1 Processor -- start 2024-04-26T11:45:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.595+0000 7f93a6a00640 1 -- 172.21.15.110:0/1601961495 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f93a8004a00 con 0x7f93b010f2f0 2024-04-26T11:45:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.595+0000 7f93bb5fa740 1 -- start start 2024-04-26T11:45:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.595+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.595+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a53a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5620e79ae380 con 0x5620e7a53fb0 2024-04-26T11:45:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5620e794ac30 con 0x5620e7a48dd0 2024-04-26T11:45:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5620e79aa340 con 0x5620e7a496f0 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a53a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a53a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42442/0 (socket says 172.21.15.110:42442) 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5e00640 1 -- 172.21.15.110:0/4198477408 learned_addr learned my addr 172.21.15.110:0/4198477408 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5400640 1 --2- 172.21.15.110:0/4198477408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5e00640 1 -- 172.21.15.110:0/4198477408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 msgr2=0x5620e7a491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5e00640 1 --2- 172.21.15.110:0/4198477408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5e00640 1 -- 172.21.15.110:0/4198477408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 msgr2=0x5620e7a563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5e00640 1 --2- 172.21.15.110:0/4198477408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.596+0000 7f93b5e00640 1 -- 172.21.15.110:0/4198477408 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620e796c940 con 0x5620e7a496f0 2024-04-26T11:45:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.597+0000 7f93b5e00640 1 --2- 172.21.15.110:0/4198477408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a53a70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00e600 tx=0x7f93ac0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=958a0e3d5f33fb36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.597+0000 7f93a6a00640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f939c0a3dc0 0x7f939c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.597+0000 7f93a6a00640 1 -- 172.21.15.110:0/1601961495 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 11997+0+0 (secure 0 0 0) 0x7f93a80d13a0 con 0x7f93b010f2f0 2024-04-26T11:45:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.597+0000 7f939b000640 1 -- 172.21.15.110:0/4198477408 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac004b20 con 0x5620e7a496f0 2024-04-26T11:45:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.597+0000 7f939b000640 1 -- 172.21.15.110:0/4198477408 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93ac004cc0 con 0x5620e7a496f0 2024-04-26T11:45:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.597+0000 7f939b000640 1 -- 172.21.15.110:0/4198477408 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac0056e0 con 0x5620e7a496f0 2024-04-26T11:45:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.597+0000 7f93b5400640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f939c0a3dc0 0x7f939c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 -- 172.21.15.110:0/4198477408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 msgr2=0x5620e7a53a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/4198477408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a53a70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00e600 tx=0x7f93ac0095c0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93b5400640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f939c0a3dc0 0x7f939c0a6280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009830 tx=0x7f93a0030340 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 -- 172.21.15.110:0/4198477408 shutdown_connections 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/4198477408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/4198477408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a53a70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/4198477408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 -- 172.21.15.110:0/4198477408 >> 172.21.15.110:0/4198477408 conn(0x5620e7a452e0 msgr2=0x5620e7a456c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 -- 172.21.15.110:0/4198477408 shutdown_connections 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 -- 172.21.15.110:0/4198477408 wait complete. 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 -- start start 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.598+0000 7f93bb5fa740 1 Processor -- start 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a50f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a51450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a51990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5620e7a56be0 con 0x5620e7a53fb0 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5620e7935c60 con 0x5620e7a48dd0 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5620e7a56d60 con 0x5620e7a496f0 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93bb5fa740 10 client.0 _ll_register_callbacks cb 0x5620e7961e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93b6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a51990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93b5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a50f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93b5e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a50f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:35774/0 (socket says 172.21.15.110:35774) 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93b5e00640 1 -- 172.21.15.110:0/3292401915 learned_addr learned my addr 172.21.15.110:0/3292401915 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.599+0000 7f93b5400640 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a51450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f93b6800640 1 -- 172.21.15.110:0/3292401915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 msgr2=0x5620e7a51450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f93b6800640 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a51450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f93b6800640 1 -- 172.21.15.110:0/3292401915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 msgr2=0x5620e7a50f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f93b6800640 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a50f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f93b6800640 1 -- 172.21.15.110:0/3292401915 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620e7944510 con 0x5620e7a53fb0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f93b6800640 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a51990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f93a80cdd00 tx=0x7f93a809cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2a5f6af3140688 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f938f400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f938f400640 1 -- 172.21.15.110:0/3292401915 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a801c040 con 0x5620e7a53fb0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f938f400640 1 -- 172.21.15.110:0/3292401915 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 11997+0+0 (secure 0 0 0) 0x7f93a80cdf80 con 0x5620e7a53fb0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.600+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3292401915 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93ac004cc0 con 0x5620e7a53fb0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f938f400640 1 -- 172.21.15.110:0/3292401915 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=249) ==== 24+0+0 (secure 0 0 0) 0x7f93a80b5030 con 0x5620e7a53fb0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f93bb5fa740 10 client.16134 fetch_fsmap learned FSMap version 249 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3292401915 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=249,monmap=4+}) -- 0x5620e76c0210 con 0x5620e7a53fb0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f938f400640 1 -- 172.21.15.110:0/3292401915 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93ac004cc0 con 0x5620e7a53fb0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f938f400640 1 -- 172.21.15.110:0/3292401915 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 249) ==== 5922+0+0 (secure 0 0 0) 0x7f93a801f030 con 0x5620e7a53fb0 2024-04-26T11:45:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f93bb5fa740 10 client.16134 fetch_fsmap finished waiting for FSMap version 249 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f93bb5fa740 10 client.16134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f93bb5fa740 20 client.16134 populate_metadata read hostname 'smithi110' 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5620e7a63fc0 0x5620e7a66440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f93bb5fa740 4 client.16134 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.601+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3292401915 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620e79bbf90 con 0x5620e7a63fc0 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.602+0000 7f93b5e00640 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5620e7a63fc0 0x5620e7a66440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.602+0000 7f93b5e00640 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5620e7a63fc0 0x5620e7a66440 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f642b1f050594fc2 server_cookie=4b1b04c889434f18 in_seq=0 out_seq=0 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.602+0000 7f938f400640 10 client.16134 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f938f400640 1 -- 172.21.15.110:0/3292401915 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5620e79bbf90 con 0x5620e7a63fc0 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f938f400640 10 client.16134 handle_command_reply: tid=0 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 client.16134 shutdown 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3292401915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 msgr2=0x5620e7a51990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a51990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f93a80cdd00 tx=0x7f93a809cd90 comp rx=0 tx=0).stop 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3292401915 shutdown_connections 2024-04-26T11:45:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a51990 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5620e7a63fc0 0x5620e7a66440 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a51450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3292401915 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a50f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f938f400640 0 client.16134 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3292401915 >> 172.21.15.110:0/3292401915 conn(0x5620e7a452e0 msgr2=0x5620e7a4b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.603+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3292401915 shutdown_connections 2024-04-26T11:45:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.604+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3292401915 wait complete. 2024-04-26T11:45:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.604+0000 7f93bb5fa740 20 client.16134 trim_cache size 0 max 16384 2024-04-26T11:45:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93bb5fa740 1 Processor -- start 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93bb5fa740 1 -- start start 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a5faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a4b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f93b01b1ff0 con 0x5620e7a53fb0 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f93b01b3b60 con 0x5620e7a48dd0 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93b01b26c0 con 0x5620e7a496f0 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93b6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93b6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39894/0 (socket says 172.21.15.110:39894) 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.621+0000 7f93b6800640 1 -- 172.21.15.110:0/3103198857 learned_addr learned my addr 172.21.15.110:0/3103198857 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f93b5e00640 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a5faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f93b5400640 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a4b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f93b6800640 1 -- 172.21.15.110:0/3103198857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 msgr2=0x5620e7a4b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f93b6800640 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a4b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f93b6800640 1 -- 172.21.15.110:0/3103198857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 msgr2=0x5620e7a5faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f93b6800640 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a5faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f93b6800640 1 -- 172.21.15.110:0/3103198857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620e778c620 con 0x5620e7a53fb0 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f93b5e00640 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a5faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f93b6800640 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a442c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f93a8004610 tx=0x7f93a8098920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b45ff561401951 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.622+0000 7f939a600640 1 -- 172.21.15.110:0/3103198857 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a801c030 con 0x5620e7a53fb0 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.623+0000 7f939a600640 1 -- 172.21.15.110:0/3103198857 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93a80051d0 con 0x5620e7a53fb0 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.623+0000 7f939a600640 1 -- 172.21.15.110:0/3103198857 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a80cdf80 con 0x5620e7a53fb0 2024-04-26T11:45:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.623+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3103198857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 msgr2=0x5620e7a442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.623+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a442c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f93a8004610 tx=0x7f93a8098920 comp rx=0 tx=0).stop 2024-04-26T11:45:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.624+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3103198857 shutdown_connections 2024-04-26T11:45:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.624+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a53fb0 0x5620e7a442c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.624+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a496f0 0x5620e7a4b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.624+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/3103198857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a48dd0 0x5620e7a5faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.624+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3103198857 >> 172.21.15.110:0/3103198857 conn(0x5620e7a452e0 msgr2=0x5620e7a43bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.624+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3103198857 shutdown_connections 2024-04-26T11:45:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.624+0000 7f93bb5fa740 1 -- 172.21.15.110:0/3103198857 wait complete. 2024-04-26T11:45:29.626 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.624+0000 7f93bb5fa740 1 -- start start 2024-04-26T11:45:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.624+0000 7f93bb5fa740 1 Processor -- start 2024-04-26T11:45:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a48dd0 0x5620e7a5c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a496f0 0x5620e7a57780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93bb5fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a53fb0 0x5620e7a57d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f93b01b3460 con 0x5620e7a496f0 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f93b01b2d90 con 0x5620e7a53fb0 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93bb5fa740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93b01b07c0 con 0x5620e7a48dd0 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93bb5fa740 10 client.0 _ll_register_callbacks cb 0x7f93a8098130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93b5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a496f0 0x5620e7a57780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93b5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a48dd0 0x5620e7a5c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93b5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a496f0 0x5620e7a57780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39910/0 (socket says 172.21.15.110:39910) 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93b5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a48dd0 0x5620e7a5c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:42460/0 (socket says 172.21.15.110:42460) 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93b5400640 1 -- 172.21.15.110:0/2338735731 learned_addr learned my addr 172.21.15.110:0/2338735731 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93b6800640 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a53fb0 0x5620e7a57d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.625+0000 7f93b5e00640 1 -- 172.21.15.110:0/2338735731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a53fb0 msgr2=0x5620e7a57d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f93b5e00640 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a53fb0 0x5620e7a57d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f93b5e00640 1 -- 172.21.15.110:0/2338735731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a496f0 msgr2=0x5620e7a57780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f93b5e00640 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a496f0 0x5620e7a57780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f93b5e00640 1 -- 172.21.15.110:0/2338735731 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620e7968cb0 con 0x5620e7a48dd0 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f93b6800640 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a53fb0 0x5620e7a57d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f93b5e00640 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a48dd0 0x5620e7a5c410 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f93ac004f90 tx=0x7f93ac009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d8bb3646756160 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f938f400640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f938f400640 1 -- 172.21.15.110:0/2338735731 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac003b80 con 0x5620e7a48dd0 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f938f400640 1 -- 172.21.15.110:0/2338735731 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 11997+0+0 (secure 0 0 0) 0x7f93ac003d20 con 0x5620e7a48dd0 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.626+0000 7f93bb5fa740 1 -- 172.21.15.110:0/2338735731 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93a80051d0 con 0x5620e7a48dd0 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f938f400640 1 -- 172.21.15.110:0/2338735731 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=249) ==== 24+0+0 (secure 0 0 0) 0x7f93ac03d050 con 0x5620e7a48dd0 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f93bb5fa740 10 client.26461 fetch_fsmap learned FSMap version 249 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f93bb5fa740 1 -- 172.21.15.110:0/2338735731 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=249,monmap=4+}) -- 0x5620e7aca4a0 con 0x5620e7a48dd0 2024-04-26T11:45:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f938f400640 1 -- 172.21.15.110:0/2338735731 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93a80051d0 con 0x5620e7a48dd0 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f938f400640 1 -- 172.21.15.110:0/2338735731 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 249) ==== 5922+0+0 (secure 0 0 0) 0x7f93ac00b040 con 0x5620e7a48dd0 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f93bb5fa740 10 client.26461 fetch_fsmap finished waiting for FSMap version 249 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f93bb5fa740 10 client.26461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f93bb5fa740 20 client.26461 populate_metadata read hostname 'smithi110' 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5620e7acab70 0x5620e7accf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f93bb5fa740 4 client.26461 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.627+0000 7f93bb5fa740 1 -- 172.21.15.110:0/2338735731 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620e79b5e00 con 0x5620e7acab70 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.628+0000 7f93b5400640 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5620e7acab70 0x5620e7accf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.628+0000 7f93b5400640 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5620e7acab70 0x5620e7accf90 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a423c5fdc0be685 server_cookie=26a0a74a600be44f in_seq=0 out_seq=0 2024-04-26T11:45:29.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:29.628+0000 7f938f400640 10 client.26461 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:29 smithi196 ceph-mon[32572]: pgmap v485: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 4.0 MiB/s wr, 472 op/s 2024-04-26T11:45:29.777 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:29 smithi110 ceph-mon[28069]: pgmap v485: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 4.0 MiB/s wr, 472 op/s 2024-04-26T11:45:29.777 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 podman[94827]: 2024-04-26 11:45:29.333523274 +0000 UTC m=+0.035220364 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:45:29.777 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 podman[94827]: 2024-04-26 11:45:29.49677102 +0000 UTC m=+0.198468141 container create 34c3b2a03ba2b6ae73ab68c2d93b656d780384e2dbb4dc934cac86d1a043ab9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-26T11:45:29.777 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 podman[94827]: 2024-04-26 11:45:29.776345716 +0000 UTC m=+0.478042844 container init 34c3b2a03ba2b6ae73ab68c2d93b656d780384e2dbb4dc934cac86d1a043ab9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T11:45:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:29 smithi193 ceph-mon[32782]: pgmap v485: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 4.0 MiB/s wr, 472 op/s 2024-04-26T11:45:29.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:45:30.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 podman[94827]: 2024-04-26 11:45:29.785646336 +0000 UTC m=+0.487343464 container start 34c3b2a03ba2b6ae73ab68c2d93b656d780384e2dbb4dc934cac86d1a043ab9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5) 2024-04-26T11:45:30.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 ceph-mds[94891]: -- 172.21.15.110:0/3029149170 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f5337d7a40 con 0x55f5337ab000 2024-04-26T11:45:30.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: starting mds.d at 2024-04-26T11:45:30.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 bash[94827]: 34c3b2a03ba2b6ae73ab68c2d93b656d780384e2dbb4dc934cac86d1a043ab9b 2024-04-26T11:45:30.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:45:29 smithi110 systemd[1]: Started Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:30 smithi196 ceph-mon[32572]: daemon mds.d restarted 2024-04-26T11:45:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:30 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:45:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:30 smithi196 ceph-mon[32572]: osdmap e148: 12 total, 12 up, 12 in 2024-04-26T11:45:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:30 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:boot 2024-04-26T11:45:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:30 smithi196 ceph-mon[32572]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T11:45:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:30 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:45:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:45:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:30 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=k=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:30 smithi110 ceph-mon[28069]: daemon mds.d restarted 2024-04-26T11:45:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:30 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:45:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:30 smithi110 ceph-mon[28069]: osdmap e148: 12 total, 12 up, 12 in 2024-04-26T11:45:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:30 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:boot 2024-04-26T11:45:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:30 smithi110 ceph-mon[28069]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T11:45:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:30 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:45:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:45:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:30 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=k=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:30 smithi193 ceph-mon[32782]: daemon mds.d restarted 2024-04-26T11:45:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:30 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:45:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:30 smithi193 ceph-mon[32782]: osdmap e148: 12 total, 12 up, 12 in 2024-04-26T11:45:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:30 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:boot 2024-04-26T11:45:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:30 smithi193 ceph-mon[32782]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T11:45:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:30 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:45:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T11:45:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:30 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=k=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:31 smithi196 ceph-mon[32572]: pgmap v486: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 4.0 MiB/s wr, 452 op/s 2024-04-26T11:45:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:31 smithi110 ceph-mon[28069]: pgmap v486: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 4.0 MiB/s wr, 452 op/s 2024-04-26T11:45:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:31 smithi193 ceph-mon[32782]: pgmap v486: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 4.0 MiB/s wr, 452 op/s 2024-04-26T11:45:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:32 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:resolve 2024-04-26T11:45:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:32 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=k=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:32 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:resolve 2024-04-26T11:45:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:32 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=k=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:32 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:resolve 2024-04-26T11:45:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:32 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=k=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:33 smithi110 ceph-mon[28069]: pgmap v488: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 3.4 MiB/s wr, 407 op/s 2024-04-26T11:45:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:33 smithi193 ceph-mon[32782]: pgmap v488: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 3.4 MiB/s wr, 407 op/s 2024-04-26T11:45:33.987 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:33 smithi196 ceph-mon[32572]: pgmap v488: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 3.4 MiB/s wr, 407 op/s 2024-04-26T11:45:33.988 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:33 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 5. 2024-04-26T11:45:33.988 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:33 smithi196 systemd[1]: Stopped Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:33.988 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:33 smithi196 systemd[1]: Starting Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:45:34.255 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:33 smithi196 podman[72121]: 2024-04-26 11:45:33.890087396 +0000 UTC m=+0.018203523 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:45:34.255 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:34 smithi196 podman[72121]: 2024-04-26 11:45:34.027403263 +0000 UTC m=+0.155519416 container create 99c5c2bca896dbbb22ebb4a290e9f582bdea8f5f3523e96dd77130f704892607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-26T11:45:34.534 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:34 smithi196 podman[72121]: 2024-04-26 11:45:34.263306361 +0000 UTC m=+0.391422471 container init 99c5c2bca896dbbb22ebb4a290e9f582bdea8f5f3523e96dd77130f704892607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T11:45:34.534 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:34 smithi196 podman[72121]: 2024-04-26 11:45:34.265893649 +0000 UTC m=+0.394009767 container start 99c5c2bca896dbbb22ebb4a290e9f582bdea8f5f3523e96dd77130f704892607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T11:45:34.534 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:34 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: starting mds.l at 2024-04-26T11:45:34.534 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:34 smithi196 bash[72121]: 99c5c2bca896dbbb22ebb4a290e9f582bdea8f5f3523e96dd77130f704892607 2024-04-26T11:45:34.534 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:45:34 smithi196 systemd[1]: Started Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:34.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:34 smithi110 ceph-mon[28069]: daemon mds.l restarted 2024-04-26T11:45:34.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:45:34.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:34 smithi110 ceph-mon[28069]: osdmap e149: 12 total, 12 up, 12 in 2024-04-26T11:45:34.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:34 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:boot 2024-04-26T11:45:34.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:34 smithi110 ceph-mon[28069]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-04-26T11:45:34.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:34 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=k=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:45:34.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:34 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:34 smithi193 ceph-mon[32782]: daemon mds.l restarted 2024-04-26T11:45:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:45:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:34 smithi193 ceph-mon[32782]: osdmap e149: 12 total, 12 up, 12 in 2024-04-26T11:45:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:34 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:boot 2024-04-26T11:45:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:34 smithi193 ceph-mon[32782]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-04-26T11:45:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:34 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=k=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:45:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:34 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:34.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:45:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:34 smithi196 ceph-mon[32572]: daemon mds.l restarted 2024-04-26T11:45:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T11:45:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:34 smithi196 ceph-mon[32572]: osdmap e149: 12 total, 12 up, 12 in 2024-04-26T11:45:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:34 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:boot 2024-04-26T11:45:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:34 smithi196 ceph-mon[32572]: Standby daemon mds.j assigned to filesystem cephfs as rank 1 2024-04-26T11:45:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:34 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=k=up:resolve} 2 up:standby-replay 4 up:standby, 1 failed 2024-04-26T11:45:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:34 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:replay,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:35 smithi110 ceph-mon[28069]: pgmap v489: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 294 KiB/s wr, 43 op/s 2024-04-26T11:45:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:35 smithi193 ceph-mon[32782]: pgmap v489: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 294 KiB/s wr, 43 op/s 2024-04-26T11:45:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:35 smithi196 ceph-mon[32572]: pgmap v489: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 294 KiB/s wr, 43 op/s 2024-04-26T11:45:36.817 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:36 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:resolve 2024-04-26T11:45:36.818 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:36 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:36 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:resolve 2024-04-26T11:45:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:36 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:36 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:resolve 2024-04-26T11:45:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:36 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:resolve,2=k=up:resolve} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.598+0000 7f938f400640 1 -- 172.21.15.110:0/2338735731 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620e79b5e00 con 0x5620e7acab70 2024-04-26T11:45:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.598+0000 7f938f400640 10 client.26461 handle_command_reply: tid=0 2024-04-26T11:45:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.598+0000 7f93bb5fa740 1 client.26461 shutdown 2024-04-26T11:45:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.599+0000 7f93bb5fa740 1 -- 172.21.15.110:0/2338735731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a48dd0 msgr2=0x5620e7a5c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.599+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a48dd0 0x5620e7a5c410 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f93ac004f90 tx=0x7f93ac009820 comp rx=0 tx=0).stop 2024-04-26T11:45:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.599+0000 7f93bb5fa740 1 -- 172.21.15.110:0/2338735731 shutdown_connections 2024-04-26T11:45:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.599+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5620e7a53fb0 0x5620e7a57d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.599+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5620e7a496f0 0x5620e7a57780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.599+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5620e7acab70 0x5620e7accf90 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.599+0000 7f93bb5fa740 1 --2- 172.21.15.110:0/2338735731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5620e7a48dd0 0x5620e7a5c410 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.599+0000 7f938f400640 0 client.26461 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.599+0000 7f93bb5fa740 1 -- 172.21.15.110:0/2338735731 >> 172.21.15.110:0/2338735731 conn(0x5620e7a452e0 msgr2=0x5620e7a43bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.600+0000 7f93bb5fa740 1 -- 172.21.15.110:0/2338735731 shutdown_connections 2024-04-26T11:45:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.600+0000 7f93bb5fa740 1 -- 172.21.15.110:0/2338735731 wait complete. 2024-04-26T11:45:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.600+0000 7f93bb5fa740 20 client.26461 trim_cache size 0 max 16384 2024-04-26T11:45:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:45:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:45:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:45:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 -- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f939c0a3dc0 msgr2=0x7f939c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f939c0a3dc0 0x7f939c0a6280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009830 tx=0x7f93a0030340 comp rx=0 tx=0).stop 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 -- 172.21.15.110:0/1601961495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93b010f2f0 msgr2=0x7f93b019fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93b010f2f0 0x7f93b019fbf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f93b0103920 tx=0x7f93a800edd0 comp rx=0 tx=0).stop 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 -- 172.21.15.110:0/1601961495 shutdown_connections 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f939c0a3dc0 0x7f939c0a6280 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93b010f2f0 0x7f93b019fbf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93b0102060 0x7f93b019b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 --2- 172.21.15.110:0/1601961495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93b0101740 0x7f93b019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 -- 172.21.15.110:0/1601961495 >> 172.21.15.110:0/1601961495 conn(0x7f93b0078940 msgr2=0x7f93b01108a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:37.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 -- 172.21.15.110:0/1601961495 shutdown_connections 2024-04-26T11:45:37.604 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:37.601+0000 7f93b8800640 1 -- 172.21.15.110:0/1601961495 wait complete. 2024-04-26T11:45:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:37 smithi193 ceph-mon[32782]: pgmap v491: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 193 KiB/s wr, 31 op/s 2024-04-26T11:45:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:37 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:45:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:37 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:reconnect 2024-04-26T11:45:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:37 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:reconnect 2024-04-26T11:45:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:37 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:37 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:45:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:37 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:45:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:37 smithi196 ceph-mon[32572]: pgmap v491: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 193 KiB/s wr, 31 op/s 2024-04-26T11:45:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:37 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:45:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:37 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:reconnect 2024-04-26T11:45:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:37 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:reconnect 2024-04-26T11:45:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:37 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:37 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:45:38.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:37 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:45:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:37 smithi110 ceph-mon[28069]: pgmap v491: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 193 KiB/s wr, 31 op/s 2024-04-26T11:45:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:37 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:45:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:37 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:reconnect 2024-04-26T11:45:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:37 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:reconnect 2024-04-26T11:45:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:37 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:37 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:45:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:37 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:45:38.864 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:rejoin 2024-04-26T11:45:38.864 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:rejoin 2024-04-26T11:45:38.864 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:38.864 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-mon[32782]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-04-26T11:45:38.908 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:38 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:rejoin 2024-04-26T11:45:38.908 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:38 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:rejoin 2024-04-26T11:45:38.908 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:38 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:38.908 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:38 smithi110 ceph-mon[28069]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-04-26T11:45:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:38 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:rejoin 2024-04-26T11:45:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:38 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:rejoin 2024-04-26T11:45:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:38 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:38 smithi196 ceph-mon[32572]: daemon mds.j is now active in filesystem cephfs as rank 1 2024-04-26T11:45:39.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f45dc334700 time 2024-04-26T11:45:38.864003+0000 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f45e695d3dd] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45e695d5a3] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a62ed53822] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a62ecc3598] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a62ecc5c17] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a62ebbed0b] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a62ebbf2ac] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a62eba7fad] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45e6bf1e20] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 10: (DispatchQueue::entry()+0x51f) [0x7f45e6beefdf] 2024-04-26T11:45:39.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45e6cc1fc1] 2024-04-26T11:45:39.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f45e56db1ca] 2024-04-26T11:45:39.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 13: clone() 2024-04-26T11:45:39.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:38.864+0000 7f45dc334700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f45dc334700 time 2024-04-26T11:45:38.864003+0000 2024-04-26T11:45:39.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:39.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f45e695d3dd] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45e695d5a3] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a62ed53822] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a62ecc3598] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a62ecc5c17] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a62ebbed0b] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a62ebbf2ac] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a62eba7fad] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45e6bf1e20] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 10: (DispatchQueue::entry()+0x51f) [0x7f45e6beefdf] 2024-04-26T11:45:39.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45e6cc1fc1] 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f45e56db1ca] 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 13: clone() 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: *** Caught signal (Aborted) ** 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: in thread 7f45dc334700 thread_name:ms_dispatch 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f45e56e5d20] 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2: gsignal() 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 3: abort() 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f45e695d437] 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45e695d5a3] 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a62ed53822] 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a62ecc3598] 2024-04-26T11:45:39.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a62ecc5c17] 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a62ebbed0b] 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a62ebbf2ac] 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a62eba7fad] 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45e6bf1e20] 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 13: (DispatchQueue::entry()+0x51f) [0x7f45e6beefdf] 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45e6cc1fc1] 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f45e56db1ca] 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 16: clone() 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:38.865+0000 7f45dc334700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: in thread 7f45dc334700 thread_name:ms_dispatch 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f45e56e5d20] 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2: gsignal() 2024-04-26T11:45:39.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 3: abort() 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f45e695d437] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45e695d5a3] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a62ed53822] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a62ecc3598] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a62ecc5c17] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a62ebbed0b] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a62ebbf2ac] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a62eba7fad] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45e6bf1e20] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 13: (DispatchQueue::entry()+0x51f) [0x7f45e6beefdf] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45e6cc1fc1] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f45e56db1ca] 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 16: clone() 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:39.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: -1> 2024-04-26T11:45:38.864+0000 7f45dc334700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f45dc334700 time 2024-04-26T11:45:38.864003+0000 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f45e695d3dd] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45e695d5a3] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a62ed53822] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a62ecc3598] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a62ecc5c17] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a62ebbed0b] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a62ebbf2ac] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a62eba7fad] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45e6bf1e20] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 10: (DispatchQueue::entry()+0x51f) [0x7f45e6beefdf] 2024-04-26T11:45:39.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45e6cc1fc1] 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f45e56db1ca] 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 13: clone() 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 0> 2024-04-26T11:45:38.865+0000 7f45dc334700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: in thread 7f45dc334700 thread_name:ms_dispatch 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f45e56e5d20] 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2: gsignal() 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 3: abort() 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f45e695d437] 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45e695d5a3] 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a62ed53822] 2024-04-26T11:45:39.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a62ecc3598] 2024-04-26T11:45:39.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a62ecc5c17] 2024-04-26T11:45:39.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a62ebbed0b] 2024-04-26T11:45:39.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a62ebbf2ac] 2024-04-26T11:45:39.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a62eba7fad] 2024-04-26T11:45:39.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45e6bf1e20] 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 13: (DispatchQueue::entry()+0x51f) [0x7f45e6beefdf] 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45e6cc1fc1] 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f45e56db1ca] 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 16: clone() 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: -1> 2024-04-26T11:45:38.864+0000 7f45dc334700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f45dc334700 time 2024-04-26T11:45:38.864003+0000 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:39.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f45e695d3dd] 2024-04-26T11:45:39.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45e695d5a3] 2024-04-26T11:45:39.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a62ed53822] 2024-04-26T11:45:39.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a62ecc3598] 2024-04-26T11:45:39.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a62ecc5c17] 2024-04-26T11:45:39.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a62ebbed0b] 2024-04-26T11:45:39.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a62ebbf2ac] 2024-04-26T11:45:39.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a62eba7fad] 2024-04-26T11:45:39.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45e6bf1e20] 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 10: (DispatchQueue::entry()+0x51f) [0x7f45e6beefdf] 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45e6cc1fc1] 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f45e56db1ca] 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 13: clone() 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 0> 2024-04-26T11:45:38.865+0000 7f45dc334700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: in thread 7f45dc334700 thread_name:ms_dispatch 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f45e56e5d20] 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2: gsignal() 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 3: abort() 2024-04-26T11:45:39.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f45e695d437] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45e695d5a3] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a62ed53822] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a62ecc3598] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a62ecc5c17] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a62ebbed0b] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a62ebbf2ac] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a62eba7fad] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45e6bf1e20] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 13: (DispatchQueue::entry()+0x51f) [0x7f45e6beefdf] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45e6cc1fc1] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f45e56db1ca] 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 16: clone() 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70084]: 2024-04-26T11:45:39.135 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:38 smithi193 podman[70128]: 2024-04-26 11:45:38.925251008 +0000 UTC m=+0.019075209 container died 3691090a6364287d7b0cccb7abf5dbf9b74b7c8e8b65eb76968cb46e5b179c2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-26T11:45:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:39 smithi193 ceph-mon[32782]: pgmap v492: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-04-26T11:45:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:39 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:clientreplay 2024-04-26T11:45:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:39 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:active 2024-04-26T11:45:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:39 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=k=up:clientreplay} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:39 smithi193 ceph-mon[32782]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T11:45:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:39 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:45:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:39 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:active 2024-04-26T11:45:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:39 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:39.921 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 805.0 s, 568.4 tps, lat 767.375 ms stddev 3842.129 2024-04-26T11:45:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:39 smithi196 ceph-mon[32572]: pgmap v492: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-04-26T11:45:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:39 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:clientreplay 2024-04-26T11:45:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:39 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:active 2024-04-26T11:45:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:39 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=k=up:clientreplay} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:39 smithi196 ceph-mon[32572]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T11:45:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:39 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:45:40.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:39 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:active 2024-04-26T11:45:40.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:39 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:39 smithi110 ceph-mon[28069]: pgmap v492: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-04-26T11:45:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:39 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:clientreplay 2024-04-26T11:45:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:39 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2108556895,v1:172.21.15.110:6835/2108556895] up:active 2024-04-26T11:45:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:39 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=k=up:clientreplay} 1 up:standby-replay 4 up:standby 2024-04-26T11:45:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:39 smithi110 ceph-mon[28069]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T11:45:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:39 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:45:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:39 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/3185373727,v1:172.21.15.193:6833/3185373727] up:active 2024-04-26T11:45:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:39 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:40.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:40 smithi193 podman[70128]: 2024-04-26 11:45:40.11787485 +0000 UTC m=+1.211699049 container remove 3691090a6364287d7b0cccb7abf5dbf9b74b7c8e8b65eb76968cb46e5b179c2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5) 2024-04-26T11:45:40.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:40 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:45:40.872 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:40 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T11:45:40.872 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:40 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.185s CPU time. 2024-04-26T11:45:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:40 smithi193 ceph-mon[32782]: pgmap v493: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-04-26T11:45:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:40 smithi196 ceph-mon[32572]: pgmap v493: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-04-26T11:45:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:40 smithi110 ceph-mon[28069]: pgmap v493: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-04-26T11:45:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:42 smithi196 ceph-mon[32572]: pgmap v494: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-04-26T11:45:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:45:43.045 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:42 smithi110 ceph-mon[28069]: pgmap v494: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-04-26T11:45:43.045 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:45:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:42 smithi193 ceph-mon[32782]: pgmap v494: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-04-26T11:45:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:45:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:45:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:45:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-mon[28069]: pgmap v495: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 2.2 MiB/s wr, 188 op/s 2024-04-26T11:45:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-mon[28069]: pgmap v496: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.3 MiB/s wr, 201 op/s 2024-04-26T11:45:44.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:45:44.044 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6663600700 time 2024-04-26T11:45:43.605733+0000 2024-04-26T11:45:44.044 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:44.044 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:44.044 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f666ee8a3dd] 2024-04-26T11:45:44.045 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f666ee8a5a3] 2024-04-26T11:45:44.045 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ec93ff7822] 2024-04-26T11:45:44.045 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ec93f67598] 2024-04-26T11:45:44.045 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ec93f69c17] 2024-04-26T11:45:44.048 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ec93e62d0b] 2024-04-26T11:45:44.048 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ec93e632ac] 2024-04-26T11:45:44.048 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ec93e4bfad] 2024-04-26T11:45:44.048 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f666f11ee20] 2024-04-26T11:45:44.048 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 10: (DispatchQueue::entry()+0x51f) [0x7f666f11bfdf] 2024-04-26T11:45:44.048 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f666f1eefc1] 2024-04-26T11:45:44.049 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f666dc081ca] 2024-04-26T11:45:44.049 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 13: clone() 2024-04-26T11:45:44.049 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:43.609+0000 7f6663600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6663600700 time 2024-04-26T11:45:43.605733+0000 2024-04-26T11:45:44.049 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:44.049 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.050 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:44.050 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f666ee8a3dd] 2024-04-26T11:45:44.050 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f666ee8a5a3] 2024-04-26T11:45:44.050 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ec93ff7822] 2024-04-26T11:45:44.050 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ec93f67598] 2024-04-26T11:45:44.050 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ec93f69c17] 2024-04-26T11:45:44.051 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ec93e62d0b] 2024-04-26T11:45:44.051 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ec93e632ac] 2024-04-26T11:45:44.051 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ec93e4bfad] 2024-04-26T11:45:44.051 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f666f11ee20] 2024-04-26T11:45:44.051 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 10: (DispatchQueue::entry()+0x51f) [0x7f666f11bfdf] 2024-04-26T11:45:44.051 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f666f1eefc1] 2024-04-26T11:45:44.052 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f666dc081ca] 2024-04-26T11:45:44.052 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 13: clone() 2024-04-26T11:45:44.052 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.052 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: *** Caught signal (Aborted) ** 2024-04-26T11:45:44.052 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: in thread 7f6663600700 thread_name:ms_dispatch 2024-04-26T11:45:44.052 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:44.053 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f666dc12d20] 2024-04-26T11:45:44.053 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2: gsignal() 2024-04-26T11:45:44.053 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 3: abort() 2024-04-26T11:45:44.053 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f666ee8a437] 2024-04-26T11:45:44.053 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f666ee8a5a3] 2024-04-26T11:45:44.053 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ec93ff7822] 2024-04-26T11:45:44.053 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ec93f67598] 2024-04-26T11:45:44.054 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ec93f69c17] 2024-04-26T11:45:44.054 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ec93e62d0b] 2024-04-26T11:45:44.054 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ec93e632ac] 2024-04-26T11:45:44.054 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ec93e4bfad] 2024-04-26T11:45:44.054 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f666f11ee20] 2024-04-26T11:45:44.054 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 13: (DispatchQueue::entry()+0x51f) [0x7f666f11bfdf] 2024-04-26T11:45:44.055 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f666f1eefc1] 2024-04-26T11:45:44.055 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f666dc081ca] 2024-04-26T11:45:44.055 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 16: clone() 2024-04-26T11:45:44.055 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:43.614+0000 7f6663600700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:44.055 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: in thread 7f6663600700 thread_name:ms_dispatch 2024-04-26T11:45:44.055 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.056 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:44.056 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f666dc12d20] 2024-04-26T11:45:44.056 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2: gsignal() 2024-04-26T11:45:44.056 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 3: abort() 2024-04-26T11:45:44.056 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f666ee8a437] 2024-04-26T11:45:44.056 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f666ee8a5a3] 2024-04-26T11:45:44.057 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ec93ff7822] 2024-04-26T11:45:44.057 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ec93f67598] 2024-04-26T11:45:44.059 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ec93f69c17] 2024-04-26T11:45:44.059 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ec93e62d0b] 2024-04-26T11:45:44.059 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ec93e632ac] 2024-04-26T11:45:44.059 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ec93e4bfad] 2024-04-26T11:45:44.059 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f666f11ee20] 2024-04-26T11:45:44.060 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 13: (DispatchQueue::entry()+0x51f) [0x7f666f11bfdf] 2024-04-26T11:45:44.060 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f666f1eefc1] 2024-04-26T11:45:44.060 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f666dc081ca] 2024-04-26T11:45:44.060 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 16: clone() 2024-04-26T11:45:44.060 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:44.060 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.061 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: -1> 2024-04-26T11:45:43.609+0000 7f6663600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6663600700 time 2024-04-26T11:45:43.605733+0000 2024-04-26T11:45:44.061 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:44.061 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.061 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:44.061 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f666ee8a3dd] 2024-04-26T11:45:44.062 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f666ee8a5a3] 2024-04-26T11:45:44.062 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ec93ff7822] 2024-04-26T11:45:44.062 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ec93f67598] 2024-04-26T11:45:44.062 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ec93f69c17] 2024-04-26T11:45:44.062 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ec93e62d0b] 2024-04-26T11:45:44.062 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ec93e632ac] 2024-04-26T11:45:44.063 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ec93e4bfad] 2024-04-26T11:45:44.063 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f666f11ee20] 2024-04-26T11:45:44.063 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 10: (DispatchQueue::entry()+0x51f) [0x7f666f11bfdf] 2024-04-26T11:45:44.063 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f666f1eefc1] 2024-04-26T11:45:44.063 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f666dc081ca] 2024-04-26T11:45:44.063 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 13: clone() 2024-04-26T11:45:44.064 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.064 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 0> 2024-04-26T11:45:43.614+0000 7f6663600700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:44.064 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: in thread 7f6663600700 thread_name:ms_dispatch 2024-04-26T11:45:44.064 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.064 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:44.064 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f666dc12d20] 2024-04-26T11:45:44.066 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2: gsignal() 2024-04-26T11:45:44.066 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 3: abort() 2024-04-26T11:45:44.066 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f666ee8a437] 2024-04-26T11:45:44.066 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f666ee8a5a3] 2024-04-26T11:45:44.067 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ec93ff7822] 2024-04-26T11:45:44.067 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ec93f67598] 2024-04-26T11:45:44.067 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ec93f69c17] 2024-04-26T11:45:44.067 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ec93e62d0b] 2024-04-26T11:45:44.067 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ec93e632ac] 2024-04-26T11:45:44.067 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ec93e4bfad] 2024-04-26T11:45:44.067 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f666f11ee20] 2024-04-26T11:45:44.067 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 13: (DispatchQueue::entry()+0x51f) [0x7f666f11bfdf] 2024-04-26T11:45:44.067 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f666f1eefc1] 2024-04-26T11:45:44.068 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f666dc081ca] 2024-04-26T11:45:44.068 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 16: clone() 2024-04-26T11:45:44.068 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:44.069 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.070 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: -1> 2024-04-26T11:45:43.609+0000 7f6663600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6663600700 time 2024-04-26T11:45:43.605733+0000 2024-04-26T11:45:44.070 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:45:44.071 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.071 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:44.071 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f666ee8a3dd] 2024-04-26T11:45:44.071 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f666ee8a5a3] 2024-04-26T11:45:44.071 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ec93ff7822] 2024-04-26T11:45:44.071 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ec93f67598] 2024-04-26T11:45:44.071 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ec93f69c17] 2024-04-26T11:45:44.071 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ec93e62d0b] 2024-04-26T11:45:44.072 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ec93e632ac] 2024-04-26T11:45:44.072 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ec93e4bfad] 2024-04-26T11:45:44.072 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f666f11ee20] 2024-04-26T11:45:44.072 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 10: (DispatchQueue::entry()+0x51f) [0x7f666f11bfdf] 2024-04-26T11:45:44.073 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f666f1eefc1] 2024-04-26T11:45:44.073 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f666dc081ca] 2024-04-26T11:45:44.073 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 13: clone() 2024-04-26T11:45:44.073 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.073 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 0> 2024-04-26T11:45:43.614+0000 7f6663600700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:45:44.073 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: in thread 7f6663600700 thread_name:ms_dispatch 2024-04-26T11:45:44.073 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.073 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:45:44.074 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f666dc12d20] 2024-04-26T11:45:44.074 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2: gsignal() 2024-04-26T11:45:44.074 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 3: abort() 2024-04-26T11:45:44.074 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f666ee8a437] 2024-04-26T11:45:44.074 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f666ee8a5a3] 2024-04-26T11:45:44.075 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ec93ff7822] 2024-04-26T11:45:44.075 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ec93f67598] 2024-04-26T11:45:44.075 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ec93f69c17] 2024-04-26T11:45:44.075 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ec93e62d0b] 2024-04-26T11:45:44.075 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ec93e632ac] 2024-04-26T11:45:44.075 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ec93e4bfad] 2024-04-26T11:45:44.076 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f666f11ee20] 2024-04-26T11:45:44.076 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 13: (DispatchQueue::entry()+0x51f) [0x7f666f11bfdf] 2024-04-26T11:45:44.076 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f666f1eefc1] 2024-04-26T11:45:44.076 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f666dc081ca] 2024-04-26T11:45:44.076 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 16: clone() 2024-04-26T11:45:44.076 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:45:44.076 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j[94689]: 2024-04-26T11:45:44.076 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:43 smithi110 podman[95054]: 2024-04-26 11:45:43.782162027 +0000 UTC m=+0.041539036 container died 0b117229e6623b1a98256776423741f3cb7d2f09e8183a7ff769bc4f9aeb327a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2) 2024-04-26T11:45:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:45:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:45:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:43 smithi193 ceph-mon[32782]: pgmap v495: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 2.2 MiB/s wr, 188 op/s 2024-04-26T11:45:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:43 smithi193 ceph-mon[32782]: pgmap v496: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.3 MiB/s wr, 201 op/s 2024-04-26T11:45:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:45:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:45:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:45:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:43 smithi196 ceph-mon[32572]: pgmap v495: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 2.2 MiB/s wr, 188 op/s 2024-04-26T11:45:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:43 smithi196 ceph-mon[32572]: pgmap v496: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.3 MiB/s wr, 201 op/s 2024-04-26T11:45:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:45:44.762 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:44 smithi110 podman[95054]: 2024-04-26 11:45:44.480447652 +0000 UTC m=+0.739824666 container remove 0b117229e6623b1a98256776423741f3cb7d2f09e8183a7ff769bc4f9aeb327a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-j, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T11:45:44.762 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:44 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:45:44.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 810.0 s, 712.6 tps, lat 60.886 ms stddev 64.275 2024-04-26T11:45:45.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:44 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:45.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:44 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T11:45:45.042 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:44 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.911s CPU time. 2024-04-26T11:45:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:44 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:44 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=j=up:active,2=k=up:active} 3 up:standby-replay 2 up:standby 2024-04-26T11:45:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:45 smithi110 ceph-mon[28069]: pgmap v497: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 260 op/s 2024-04-26T11:45:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:45 smithi193 ceph-mon[32782]: pgmap v497: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 260 op/s 2024-04-26T11:45:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:45 smithi196 ceph-mon[32572]: pgmap v497: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 260 op/s 2024-04-26T11:45:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:47 smithi110 ceph-mon[28069]: osdmap e150: 12 total, 12 up, 12 in 2024-04-26T11:45:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:47 smithi110 ceph-mon[28069]: pgmap v499: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 325 op/s 2024-04-26T11:45:48.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:47 smithi196 ceph-mon[32572]: osdmap e150: 12 total, 12 up, 12 in 2024-04-26T11:45:48.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:47 smithi196 ceph-mon[32572]: pgmap v499: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 325 op/s 2024-04-26T11:45:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:47 smithi193 ceph-mon[32782]: osdmap e150: 12 total, 12 up, 12 in 2024-04-26T11:45:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:47 smithi193 ceph-mon[32782]: pgmap v499: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 325 op/s 2024-04-26T11:45:49.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:45:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:50 smithi196 ceph-mon[32572]: pgmap v500: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 423 op/s 2024-04-26T11:45:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:50 smithi110 ceph-mon[28069]: pgmap v500: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 423 op/s 2024-04-26T11:45:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:50 smithi193 ceph-mon[32782]: pgmap v500: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 423 op/s 2024-04-26T11:45:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.751+0000 7f790fe00640 1 -- 172.21.15.110:0/3650618303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7908077780 msgr2=0x7f7908113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.751+0000 7f790fe00640 1 --2- 172.21.15.110:0/3650618303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7908077780 0x7f7908113270 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009930 tx=0x7f78f802a420 comp rx=0 tx=0).stop 2024-04-26T11:45:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.751+0000 7f790fe00640 1 -- 172.21.15.110:0/3650618303 shutdown_connections 2024-04-26T11:45:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.751+0000 7f790fe00640 1 --2- 172.21.15.110:0/3650618303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79081137b0 0x7f7908115ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.751+0000 7f790fe00640 1 --2- 172.21.15.110:0/3650618303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7908077780 0x7f7908113270 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.751+0000 7f790fe00640 1 --2- 172.21.15.110:0/3650618303 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7908076e60 0x7f7908077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.751+0000 7f790fe00640 1 -- 172.21.15.110:0/3650618303 >> 172.21.15.110:0/3650618303 conn(0x7f7908100620 msgr2=0x7f7908102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.751+0000 7f790fe00640 1 -- 172.21.15.110:0/3650618303 shutdown_connections 2024-04-26T11:45:50.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.752+0000 7f790fe00640 1 -- 172.21.15.110:0/3650618303 wait complete. 2024-04-26T11:45:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790fe00640 1 Processor -- start 2024-04-26T11:45:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790fe00640 1 -- start start 2024-04-26T11:45:50.755 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7908076e60 0x7f790819f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7908077780 0x7f790819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790fe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79081137b0 0x7f79081a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7908119220 con 0x7f7908077780 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790fe00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79081190a0 con 0x7f79081137b0 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790fe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79081193a0 con 0x7f7908076e60 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790de00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79081137b0 0x7f79081a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7908077780 0x7f790819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790de00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79081137b0 0x7f79081a3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56862/0 (socket says 172.21.15.110:56862) 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790de00640 1 -- 172.21.15.110:0/3255088080 learned_addr learned my addr 172.21.15.110:0/3255088080 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.753+0000 7f790d400640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7908076e60 0x7f790819f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f790de00640 1 -- 172.21.15.110:0/3255088080 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7908076e60 msgr2=0x7f790819f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f790de00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7908076e60 0x7f790819f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f790de00640 1 -- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7908077780 msgr2=0x7f790819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:50.756 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f790de00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7908077780 0x7f790819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f790de00640 1 -- 172.21.15.110:0/3255088080 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79081a46c0 con 0x7f79081137b0 2024-04-26T11:45:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f790ca00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7908077780 0x7f790819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:45:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f790de00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79081137b0 0x7f79081a3f90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00e970 tx=0x7f78fc00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f7906000640 1 -- 172.21.15.110:0/3255088080 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc00ccc0 con 0x7f79081137b0 2024-04-26T11:45:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f7906000640 1 -- 172.21.15.110:0/3255088080 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc0054d0 con 0x7f79081137b0 2024-04-26T11:45:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f7906000640 1 -- 172.21.15.110:0/3255088080 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc010430 con 0x7f79081137b0 2024-04-26T11:45:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f790fe00640 1 -- 172.21.15.110:0/3255088080 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79081a49b0 con 0x7f79081137b0 2024-04-26T11:45:50.757 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.754+0000 7f790fe00640 1 -- 172.21.15.110:0/3255088080 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79081ac240 con 0x7f79081137b0 2024-04-26T11:45:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.757+0000 7f7912b65740 1 Processor -- start 2024-04-26T11:45:50.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.757+0000 7f7906000640 1 -- 172.21.15.110:0/3255088080 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f78fc005020 con 0x7f79081137b0 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f7912b65740 1 -- start start 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f7912b65740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0e91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f7912b65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f7912b65740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f7912b65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cdaf04e380 con 0x55cdaf0e96f0 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f7912b65740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cdaefeac30 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f7912b65740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55cdaf04a340 con 0x55cdaf0f3fb0 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f790d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f790d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58228/0 (socket says 172.21.15.110:58228) 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.758+0000 7f790d400640 1 -- 172.21.15.110:0/1112646201 learned_addr learned my addr 172.21.15.110:0/1112646201 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f790ca00640 1 --2- 172.21.15.110:0/1112646201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0e91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.760 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f790ca00640 1 --2- 172.21.15.110:0/1112646201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.763 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f790d400640 1 -- 172.21.15.110:0/1112646201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 msgr2=0x55cdaf0f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f790d400640 1 --2- 172.21.15.110:0/1112646201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f790d400640 1 -- 172.21.15.110:0/1112646201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 msgr2=0x55cdaf0e91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f790d400640 1 --2- 172.21.15.110:0/1112646201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0e91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f790d400640 1 -- 172.21.15.110:0/1112646201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdaf00c940 con 0x55cdaf0e96f0 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f790d400640 1 --2- 172.21.15.110:0/1112646201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f3a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79000114f0 tx=0x7f79000119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5fe4cafbcd6801 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f7906000640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78f00a3e40 0x7f78f00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.759+0000 7f78f6600640 1 -- 172.21.15.110:0/1112646201 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900004d20 con 0x55cdaf0e96f0 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f78f6600640 1 -- 172.21.15.110:0/1112646201 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7900004050 con 0x55cdaf0e96f0 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f78f6600640 1 -- 172.21.15.110:0/1112646201 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900005220 con 0x55cdaf0e96f0 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f7906000640 1 -- 172.21.15.110:0/3255088080 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 12257+0+0 (secure 0 0 0) 0x7f78fc0d1930 con 0x7f79081137b0 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f790ca00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78f00a3e40 0x7f78f00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f7912b65740 1 -- 172.21.15.110:0/1112646201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 msgr2=0x55cdaf0f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:50.764 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f7912b65740 1 --2- 172.21.15.110:0/1112646201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f3a70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79000114f0 tx=0x7f79000119b0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f7912b65740 1 -- 172.21.15.110:0/1112646201 shutdown_connections 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f7912b65740 1 --2- 172.21.15.110:0/1112646201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f7912b65740 1 --2- 172.21.15.110:0/1112646201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f3a70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f7912b65740 1 --2- 172.21.15.110:0/1112646201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f7912b65740 1 -- 172.21.15.110:0/1112646201 >> 172.21.15.110:0/1112646201 conn(0x55cdaf0e52e0 msgr2=0x55cdaf0e56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.760+0000 7f790ca00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78f00a3e40 0x7f78f00a6300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f78f8031440 tx=0x7f78f8005e50 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.761+0000 7f7912b65740 1 -- 172.21.15.110:0/1112646201 shutdown_connections 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.761+0000 7f7912b65740 1 -- 172.21.15.110:0/1112646201 wait complete. 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.761+0000 7f7912b65740 1 -- start start 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.761+0000 7f7912b65740 1 Processor -- start 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.761+0000 7f7912b65740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f7912b65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f7912b65740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f7912b65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cdaf0f6be0 con 0x55cdaf0e96f0 2024-04-26T11:45:50.765 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f7912b65740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cdaefd5c60 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f7912b65740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55cdaf0f6d60 con 0x55cdaf0f3fb0 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f7912b65740 10 client.0 _ll_register_callbacks cb 0x55cdaf001e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790d400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790d400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56874/0 (socket says 172.21.15.110:56874) 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790d400640 1 -- 172.21.15.110:0/3472932444 learned_addr learned my addr 172.21.15.110:0/3472932444 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790ca00640 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58232/0 (socket says 172.21.15.110:58232) 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790de00640 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790d400640 1 -- 172.21.15.110:0/3472932444 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 msgr2=0x55cdaf0f1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790d400640 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790d400640 1 -- 172.21.15.110:0/3472932444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 msgr2=0x55cdaf0f0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790d400640 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.766 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.762+0000 7f790d400640 1 -- 172.21.15.110:0/3472932444 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdaefe4510 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.767 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.763+0000 7f790d400640 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f3a70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7900006010 tx=0x7f79000092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a89130dc85fbaf56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:50.767 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.763+0000 7f78eaa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:45:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.763+0000 7f78eaa00640 1 -- 172.21.15.110:0/3472932444 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900028020 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.763+0000 7f78eaa00640 1 -- 172.21.15.110:0/3472932444 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 12257+0+0 (secure 0 0 0) 0x7f7900004490 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.763+0000 7f7912b65740 1 -- 172.21.15.110:0/3472932444 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7900004050 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.763+0000 7f78eaa00640 1 -- 172.21.15.110:0/3472932444 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=260) ==== 24+0+0 (secure 0 0 0) 0x7f7900004a40 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.763+0000 7f7912b65740 10 client.26417 fetch_fsmap learned FSMap version 260 2024-04-26T11:45:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.763+0000 7f7912b65740 1 -- 172.21.15.110:0/3472932444 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=260,monmap=4+}) -- 0x55cdaed60210 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.764+0000 7f78eaa00640 1 -- 172.21.15.110:0/3472932444 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7900004050 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.764+0000 7f78eaa00640 1 -- 172.21.15.110:0/3472932444 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 260) ==== 5922+0+0 (secure 0 0 0) 0x7f7900005820 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.764+0000 7f7912b65740 10 client.26417 fetch_fsmap finished waiting for FSMap version 260 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.764+0000 7f7912b65740 10 client.26417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.764+0000 7f7912b65740 20 client.26417 populate_metadata read hostname 'smithi110' 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.764+0000 7f7912b65740 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55cdaf103df0 0x55cdaf106280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.764+0000 7f7912b65740 4 client.26417 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.764+0000 7f7912b65740 1 -- 172.21.15.110:0/3472932444 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdaf05bf90 con 0x55cdaf103df0 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.764+0000 7f790ca00640 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55cdaf103df0 0x55cdaf106280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.765+0000 7f790ca00640 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55cdaf103df0 0x55cdaf106280 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2d101b9e4501680 server_cookie=42611de1e25e525e in_seq=0 out_seq=0 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.765+0000 7f78eaa00640 10 client.26417 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f78eaa00640 1 -- 172.21.15.110:0/3472932444 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cdaf05bf90 con 0x55cdaf103df0 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f78eaa00640 10 client.26417 handle_command_reply: tid=0 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 client.26417 shutdown 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 -- 172.21.15.110:0/3472932444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 msgr2=0x55cdaf0f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:50.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f3a70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7900006010 tx=0x7f79000092d0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 -- 172.21.15.110:0/3472932444 shutdown_connections 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55cdaf103df0 0x55cdaf106280 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f78eaa00640 0 client.26417 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 --2- 172.21.15.110:0/3472932444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f3a70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 -- 172.21.15.110:0/3472932444 >> 172.21.15.110:0/3472932444 conn(0x55cdaf0e52e0 msgr2=0x55cdaf0eb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 -- 172.21.15.110:0/3472932444 shutdown_connections 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 1 -- 172.21.15.110:0/3472932444 wait complete. 2024-04-26T11:45:50.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.766+0000 7f7912b65740 20 client.26417 trim_cache size 0 max 16384 2024-04-26T11:45:50.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.782+0000 7f7912b65740 1 Processor -- start 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.782+0000 7f7912b65740 1 -- start start 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.782+0000 7f7912b65740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf10bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.782+0000 7f7912b65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf10c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.782+0000 7f7912b65740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.782+0000 7f7912b65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f79081b65b0 con 0x55cdaf0e96f0 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.782+0000 7f7912b65740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79081b8120 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.782+0000 7f7912b65740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79081b6c80 con 0x55cdaf0f3fb0 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf10c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf10c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58242/0 (socket says 172.21.15.110:58242) 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790ca00640 1 -- 172.21.15.110:0/3815159886 learned_addr learned my addr 172.21.15.110:0/3815159886 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790de00640 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790d400640 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf10bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790ca00640 1 -- 172.21.15.110:0/3815159886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 msgr2=0x55cdaf0ec0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790ca00640 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0ec0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790ca00640 1 -- 172.21.15.110:0/3815159886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 msgr2=0x55cdaf10bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790ca00640 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf10bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790ca00640 1 -- 172.21.15.110:0/3815159886 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdaee2c620 con 0x55cdaf0e96f0 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790d400640 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.783+0000 7f790ca00640 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf10c0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f78f802aa10 tx=0x7f78f8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d681a0d256e8b59 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f78f5c00640 1 -- 172.21.15.110:0/3815159886 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f805d070 con 0x55cdaf0e96f0 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f78f5c00640 1 -- 172.21.15.110:0/3815159886 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f8003d30 con 0x55cdaf0e96f0 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f78f5c00640 1 -- 172.21.15.110:0/3815159886 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f80587d0 con 0x55cdaf0e96f0 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f7912b65740 1 -- 172.21.15.110:0/3815159886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 msgr2=0x55cdaf10c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f7912b65740 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf10c0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f78f802aa10 tx=0x7f78f8009260 comp rx=0 tx=0).stop 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f7912b65740 1 -- 172.21.15.110:0/3815159886 shutdown_connections 2024-04-26T11:45:50.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f7912b65740 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f7912b65740 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e96f0 0x55cdaf10c0a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f7912b65740 1 --2- 172.21.15.110:0/3815159886 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f7912b65740 1 -- 172.21.15.110:0/3815159886 >> 172.21.15.110:0/3815159886 conn(0x55cdaf0e52e0 msgr2=0x55cdaf0f0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:45:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f7912b65740 1 -- 172.21.15.110:0/3815159886 shutdown_connections 2024-04-26T11:45:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.784+0000 7f7912b65740 1 -- 172.21.15.110:0/3815159886 wait complete. 2024-04-26T11:45:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f7912b65740 1 -- start start 2024-04-26T11:45:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f7912b65740 1 Processor -- start 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f7912b65740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f7912b65740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f7912b65740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f7912b65740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f79081b7a50 con 0x55cdaf0e8dd0 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f7912b65740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79081b7350 con 0x55cdaf0e96f0 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f7912b65740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79081b4da0 con 0x55cdaf0f3fb0 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f7912b65740 10 client.0 _ll_register_callbacks cb 0x7f79000093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.785+0000 7f790d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790ca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790ca00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56900/0 (socket says 172.21.15.110:56900) 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58254/0 (socket says 172.21.15.110:58254) 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790ca00640 1 -- 172.21.15.110:0/1711353527 learned_addr learned my addr 172.21.15.110:0/1711353527 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:45:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790de00640 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790ca00640 1 -- 172.21.15.110:0/1711353527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 msgr2=0x55cdaf0f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790ca00640 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790ca00640 1 -- 172.21.15.110:0/1711353527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e8dd0 msgr2=0x55cdaf0f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790ca00640 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790ca00640 1 -- 172.21.15.110:0/1711353527 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdaf008cb0 con 0x55cdaf0e96f0 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790d400640 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f790ca00640 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f4390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009230 tx=0x7f78f8005890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8dfc226510a4b65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f78eaa00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.786+0000 7f78eaa00640 1 -- 172.21.15.110:0/1711353527 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f805d070 con 0x55cdaf0e96f0 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f7912b65740 1 -- 172.21.15.110:0/1711353527 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f8003d30 con 0x55cdaf0e96f0 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f78eaa00640 1 -- 172.21.15.110:0/1711353527 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(150..150 src has 1..150) ==== 12257+0+0 (secure 0 0 0) 0x7f78f8003a90 con 0x55cdaf0e96f0 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f78eaa00640 1 -- 172.21.15.110:0/1711353527 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=260) ==== 24+0+0 (secure 0 0 0) 0x7f78f8058040 con 0x55cdaf0e96f0 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f7912b65740 10 client.26420 fetch_fsmap learned FSMap version 260 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f7912b65740 1 -- 172.21.15.110:0/1711353527 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=260,monmap=4+}) -- 0x55cdaf0fbe40 con 0x55cdaf0e96f0 2024-04-26T11:45:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f78eaa00640 1 -- 172.21.15.110:0/1711353527 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f8003d30 con 0x55cdaf0e96f0 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f78eaa00640 1 -- 172.21.15.110:0/1711353527 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 260) ==== 5922+0+0 (secure 0 0 0) 0x7f78f8062b90 con 0x55cdaf0e96f0 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f7912b65740 10 client.26420 fetch_fsmap finished waiting for FSMap version 260 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f7912b65740 10 client.26420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f7912b65740 20 client.26420 populate_metadata read hostname 'smithi110' 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f7912b65740 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55cdaf0fc5f0 0x55cdaf16c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f7912b65740 4 client.26420 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f7912b65740 1 -- 172.21.15.110:0/1711353527 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cdaf055e00 con 0x55cdaf0fc5f0 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.787+0000 7f790d400640 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55cdaf0fc5f0 0x55cdaf16c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.788+0000 7f790d400640 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55cdaf0fc5f0 0x55cdaf16c3e0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=310810ff4d085df3 server_cookie=ce165833019afba0 in_seq=0 out_seq=0 2024-04-26T11:45:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:45:50.788+0000 7f78eaa00640 10 client.26420 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:45:50.955 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:50 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 4. 2024-04-26T11:45:50.955 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:50 smithi193 systemd[1]: Stopped Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:50.955 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:50 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.185s CPU time. 2024-04-26T11:45:50.955 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:50 smithi193 systemd[1]: Starting Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:45:51.213 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:50 smithi193 podman[70355]: 2024-04-26 11:45:50.858093101 +0000 UTC m=+0.018428566 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:45:51.213 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:50 smithi193 podman[70355]: 2024-04-26 11:45:50.960372879 +0000 UTC m=+0.120708380 container create fd3ce811f3a64710525752316ed18b942937be3a50d14cf96f08a6967ead9d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-26T11:45:51.494 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:51 smithi193 podman[70355]: 2024-04-26 11:45:51.213374432 +0000 UTC m=+0.373709887 container init fd3ce811f3a64710525752316ed18b942937be3a50d14cf96f08a6967ead9d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, ceph=True) 2024-04-26T11:45:51.494 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:51 smithi193 podman[70355]: 2024-04-26 11:45:51.216217573 +0000 UTC m=+0.376553029 container start fd3ce811f3a64710525752316ed18b942937be3a50d14cf96f08a6967ead9d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T11:45:51.494 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:51 smithi193 ceph-mds[70374]: -- 172.21.15.193:0/1079319816 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f52b487a40 con 0x55f52b45ac00 2024-04-26T11:45:51.494 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:51 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: starting mds.k at 2024-04-26T11:45:51.494 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:51 smithi193 bash[70355]: fd3ce811f3a64710525752316ed18b942937be3a50d14cf96f08a6967ead9d6d 2024-04-26T11:45:51.494 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:45:51 smithi193 systemd[1]: Started Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:52.454 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:52 smithi193 ceph-mon[32782]: pgmap v501: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 1.9 MiB/s wr, 175 op/s 2024-04-26T11:45:52.455 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:52 smithi193 ceph-mon[32782]: daemon mds.k restarted 2024-04-26T11:45:52.455 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:52 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:45:52.455 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:45:52.455 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:52 smithi193 ceph-mon[32782]: osdmap e151: 12 total, 12 up, 12 in 2024-04-26T11:45:52.455 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:52 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:boot 2024-04-26T11:45:52.455 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:52 smithi193 ceph-mon[32782]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:45:52.455 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:52 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:45:52.455 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:52 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=d=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:52 smithi196 ceph-mon[32572]: pgmap v501: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 1.9 MiB/s wr, 175 op/s 2024-04-26T11:45:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:52 smithi196 ceph-mon[32572]: daemon mds.k restarted 2024-04-26T11:45:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:52 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:45:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:45:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:52 smithi196 ceph-mon[32572]: osdmap e151: 12 total, 12 up, 12 in 2024-04-26T11:45:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:52 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:boot 2024-04-26T11:45:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:52 smithi196 ceph-mon[32572]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:45:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:52 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:45:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:52 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=d=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:52 smithi110 ceph-mon[28069]: pgmap v501: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 1.9 MiB/s wr, 175 op/s 2024-04-26T11:45:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:52 smithi110 ceph-mon[28069]: daemon mds.k restarted 2024-04-26T11:45:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:52 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:45:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:45:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:52 smithi110 ceph-mon[28069]: osdmap e151: 12 total, 12 up, 12 in 2024-04-26T11:45:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:52 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:boot 2024-04-26T11:45:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:52 smithi110 ceph-mon[28069]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T11:45:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:52 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=j=up:active} 3 up:standby-replay 3 up:standby, 1 failed 2024-04-26T11:45:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:52 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=d=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:54 smithi196 ceph-mon[32572]: pgmap v503: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 150 op/s 2024-04-26T11:45:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:54 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:resolve 2024-04-26T11:45:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:54 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=d=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:54 smithi196 ceph-mon[32572]: osdmap e152: 12 total, 12 up, 12 in 2024-04-26T11:45:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:54 smithi110 ceph-mon[28069]: pgmap v503: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 150 op/s 2024-04-26T11:45:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:54 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:resolve 2024-04-26T11:45:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:54 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=d=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:54 smithi110 ceph-mon[28069]: osdmap e152: 12 total, 12 up, 12 in 2024-04-26T11:45:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:54 smithi193 ceph-mon[32782]: pgmap v503: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 150 op/s 2024-04-26T11:45:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:54 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:resolve 2024-04-26T11:45:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:54 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=j=up:active,2=d=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T11:45:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:54 smithi193 ceph-mon[32782]: osdmap e152: 12 total, 12 up, 12 in 2024-04-26T11:45:54.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:45:55.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:55 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 6. 2024-04-26T11:45:55.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:55 smithi110 systemd[1]: Stopped Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:55.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:55 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.911s CPU time. 2024-04-26T11:45:55.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:55 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Start request repeated too quickly. 2024-04-26T11:45:55.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:55 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T11:45:55.542 INFO:journalctl@ceph.mds.j.smithi110.stdout:Apr 26 11:45:55 smithi110 systemd[1]: Failed to start Ceph mds.j for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:45:56.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:56 smithi196 ceph-mon[32572]: pgmap v505: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-26T11:45:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:56 smithi110 ceph-mon[28069]: pgmap v505: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-26T11:45:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:56 smithi193 ceph-mon[32782]: pgmap v505: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-26T11:45:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:58 smithi196 ceph-mon[32572]: pgmap v506: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 554 KiB/s wr, 75 op/s 2024-04-26T11:45:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:58 smithi110 ceph-mon[28069]: pgmap v506: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 554 KiB/s wr, 75 op/s 2024-04-26T11:45:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:58 smithi193 ceph-mon[32782]: pgmap v506: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 554 KiB/s wr, 75 op/s 2024-04-26T11:45:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:59 smithi196 ceph-mon[32572]: Replacing daemon mds.j as rank 1 with standby daemon mds.l 2024-04-26T11:45:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:59 smithi196 ceph-mon[32572]: MDS daemon mds.j is removed because it is dead or otherwise unavailable. 2024-04-26T11:45:59.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:59 smithi196 ceph-mon[32572]: osdmap e153: 12 total, 12 up, 12 in 2024-04-26T11:45:59.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:45:59 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=d=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T11:45:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:59 smithi110 ceph-mon[28069]: Replacing daemon mds.j as rank 1 with standby daemon mds.l 2024-04-26T11:45:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:59 smithi110 ceph-mon[28069]: MDS daemon mds.j is removed because it is dead or otherwise unavailable. 2024-04-26T11:45:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:59 smithi110 ceph-mon[28069]: osdmap e153: 12 total, 12 up, 12 in 2024-04-26T11:45:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:45:59 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=d=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T11:45:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:59 smithi193 ceph-mon[32782]: Replacing daemon mds.j as rank 1 with standby daemon mds.l 2024-04-26T11:45:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:59 smithi193 ceph-mon[32782]: MDS daemon mds.j is removed because it is dead or otherwise unavailable. 2024-04-26T11:45:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:59 smithi193 ceph-mon[32782]: osdmap e153: 12 total, 12 up, 12 in 2024-04-26T11:45:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:45:59 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=d=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T11:45:59.925 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:46:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:00 smithi196 ceph-mon[32572]: pgmap v508: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 211 op/s 2024-04-26T11:46:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:00 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:resolve 2024-04-26T11:46:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:00 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=d=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:00 smithi110 ceph-mon[28069]: pgmap v508: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 211 op/s 2024-04-26T11:46:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:00 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:resolve 2024-04-26T11:46:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:00 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=d=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:00 smithi193 ceph-mon[32782]: pgmap v508: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 211 op/s 2024-04-26T11:46:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:00 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:resolve 2024-04-26T11:46:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:00 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=d=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.880+0000 7f78eaa00640 1 -- 172.21.15.110:0/1711353527 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cdaf055e00 con 0x55cdaf0fc5f0 2024-04-26T11:46:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.880+0000 7f78eaa00640 10 client.26420 handle_command_reply: tid=0 2024-04-26T11:46:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.880+0000 7f7912b65740 1 client.26420 shutdown 2024-04-26T11:46:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.881+0000 7f7912b65740 1 -- 172.21.15.110:0/1711353527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e96f0 msgr2=0x55cdaf0f4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.881+0000 7f7912b65740 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f4390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009230 tx=0x7f78f8005890 comp rx=0 tx=0).stop 2024-04-26T11:46:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.881+0000 7f7912b65740 1 -- 172.21.15.110:0/1711353527 shutdown_connections 2024-04-26T11:46:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.881+0000 7f7912b65740 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55cdaf0fc5f0 0x55cdaf16c3e0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.881+0000 7f7912b65740 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55cdaf0f3fb0 0x55cdaf0f49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.881+0000 7f7912b65740 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cdaf0e96f0 0x55cdaf0f4390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.881+0000 7f7912b65740 1 --2- 172.21.15.110:0/1711353527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cdaf0e8dd0 0x55cdaf0f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.881+0000 7f7912b65740 1 -- 172.21.15.110:0/1711353527 >> 172.21.15.110:0/1711353527 conn(0x55cdaf0e52e0 msgr2=0x55cdaf0ec0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.881+0000 7f78eaa00640 0 client.26420 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:46:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.882+0000 7f7912b65740 1 -- 172.21.15.110:0/1711353527 shutdown_connections 2024-04-26T11:46:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.882+0000 7f7912b65740 1 -- 172.21.15.110:0/1711353527 wait complete. 2024-04-26T11:46:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.882+0000 7f7912b65740 20 client.26420 trim_cache size 0 max 16384 2024-04-26T11:46:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:46:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:46:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:46:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:46:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.883+0000 7f790fe00640 1 -- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78f00a3e40 msgr2=0x7f78f00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78f00a3e40 0x7f78f00a6300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f78f8031440 tx=0x7f78f8005e50 comp rx=0 tx=0).stop 2024-04-26T11:46:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 -- 172.21.15.110:0/3255088080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79081137b0 msgr2=0x7f79081a3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79081137b0 0x7f79081a3f90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00e970 tx=0x7f78fc00ee30 comp rx=0 tx=0).stop 2024-04-26T11:46:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 -- 172.21.15.110:0/3255088080 shutdown_connections 2024-04-26T11:46:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f78f00a3e40 0x7f78f00a6300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79081137b0 0x7f79081a3f90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7908077780 0x7f790819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 --2- 172.21.15.110:0/3255088080 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7908076e60 0x7f790819f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 -- 172.21.15.110:0/3255088080 >> 172.21.15.110:0/3255088080 conn(0x7f7908100620 msgr2=0x7f7908102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 -- 172.21.15.110:0/3255088080 shutdown_connections 2024-04-26T11:46:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:01.884+0000 7f790fe00640 1 -- 172.21.15.110:0/3255088080 wait complete. 2024-04-26T11:46:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:01 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:46:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:01 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:reconnect 2024-04-26T11:46:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:01 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:reconnect 2024-04-26T11:46:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:01 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:01 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179996 2024-04-26T11:46:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:01 smithi110 ceph-mon[28069]: pgmap v509: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.2 MiB/s wr, 148 op/s 2024-04-26T11:46:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:01 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:46:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:01 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:reconnect 2024-04-26T11:46:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:01 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:reconnect 2024-04-26T11:46:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:01 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:01 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179996 2024-04-26T11:46:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:01 smithi193 ceph-mon[32782]: pgmap v509: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.2 MiB/s wr, 148 op/s 2024-04-26T11:46:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:01 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999978 2024-04-26T11:46:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:01 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:reconnect 2024-04-26T11:46:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:01 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:reconnect 2024-04-26T11:46:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:01 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:01 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179996 2024-04-26T11:46:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:01 smithi196 ceph-mon[32572]: pgmap v509: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.2 MiB/s wr, 148 op/s 2024-04-26T11:46:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:02 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179997 2024-04-26T11:46:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:02 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:rejoin 2024-04-26T11:46:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:02 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:rejoin 2024-04-26T11:46:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:02 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:02 smithi193 ceph-mon[32782]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:46:03.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:02 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179997 2024-04-26T11:46:03.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:02 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:rejoin 2024-04-26T11:46:03.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:02 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:rejoin 2024-04-26T11:46:03.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:02 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:03.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:02 smithi196 ceph-mon[32572]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:46:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:02 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0179997 2024-04-26T11:46:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:02 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:rejoin 2024-04-26T11:46:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:02 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:rejoin 2024-04-26T11:46:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:02 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:02 smithi110 ceph-mon[28069]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T11:46:04.081 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:active 2024-04-26T11:46:04.081 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:clientreplay 2024-04-26T11:46:04.081 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=d=up:clientreplay} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:04.081 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-mon[28069]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:46:04.081 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-mon[28069]: pgmap v510: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2024-04-26T11:46:04.081 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:46:04.081 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:active 2024-04-26T11:46:04.082 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 1 up:standby 2024-04-26T11:46:04.082 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7febc9400700 time 2024-04-26T11:46:03.911711+0000 2024-04-26T11:46:04.086 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:04.086 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:04.086 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7febd4c1c3dd] 2024-04-26T11:46:04.086 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7febd4c1c5a3] 2024-04-26T11:46:04.086 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f509f40822] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f509eb0598] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f509eb2c17] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f509dabd0b] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f509dac2ac] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f509d94fad] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7febd4eb0e20] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 10: (DispatchQueue::entry()+0x51f) [0x7febd4eadfdf] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7febd4f80fc1] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7febd399a1ca] 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 13: clone() 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:03.913+0000 7febc9400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7febc9400700 time 2024-04-26T11:46:03.911711+0000 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:04.087 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.089 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:04.089 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7febd4c1c3dd] 2024-04-26T11:46:04.089 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7febd4c1c5a3] 2024-04-26T11:46:04.089 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f509f40822] 2024-04-26T11:46:04.089 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f509eb0598] 2024-04-26T11:46:04.089 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f509eb2c17] 2024-04-26T11:46:04.089 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f509dabd0b] 2024-04-26T11:46:04.089 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f509dac2ac] 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f509d94fad] 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7febd4eb0e20] 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 10: (DispatchQueue::entry()+0x51f) [0x7febd4eadfdf] 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7febd4f80fc1] 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7febd399a1ca] 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 13: clone() 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: *** Caught signal (Aborted) ** 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: in thread 7febc9400700 thread_name:ms_dispatch 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7febd39a4d20] 2024-04-26T11:46:04.090 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2: gsignal() 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 3: abort() 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7febd4c1c437] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7febd4c1c5a3] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f509f40822] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f509eb0598] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f509eb2c17] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f509dabd0b] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f509dac2ac] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f509d94fad] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7febd4eb0e20] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 13: (DispatchQueue::entry()+0x51f) [0x7febd4eadfdf] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7febd4f80fc1] 2024-04-26T11:46:04.091 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7febd399a1ca] 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 16: clone() 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:03.916+0000 7febc9400700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: in thread 7febc9400700 thread_name:ms_dispatch 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7febd39a4d20] 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2: gsignal() 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 3: abort() 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7febd4c1c437] 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7febd4c1c5a3] 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f509f40822] 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f509eb0598] 2024-04-26T11:46:04.092 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f509eb2c17] 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f509dabd0b] 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f509dac2ac] 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f509d94fad] 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7febd4eb0e20] 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 13: (DispatchQueue::entry()+0x51f) [0x7febd4eadfdf] 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7febd4f80fc1] 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7febd399a1ca] 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 16: clone() 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: -1> 2024-04-26T11:46:03.913+0000 7febc9400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7febc9400700 time 2024-04-26T11:46:03.911711+0000 2024-04-26T11:46:04.093 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7febd4c1c3dd] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7febd4c1c5a3] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f509f40822] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f509eb0598] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f509eb2c17] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f509dabd0b] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f509dac2ac] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f509d94fad] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7febd4eb0e20] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 10: (DispatchQueue::entry()+0x51f) [0x7febd4eadfdf] 2024-04-26T11:46:04.094 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7febd4f80fc1] 2024-04-26T11:46:04.095 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7febd399a1ca] 2024-04-26T11:46:04.095 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 13: clone() 2024-04-26T11:46:04.095 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.095 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 0> 2024-04-26T11:46:03.916+0000 7febc9400700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:04.095 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: in thread 7febc9400700 thread_name:ms_dispatch 2024-04-26T11:46:04.095 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.095 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:04.095 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7febd39a4d20] 2024-04-26T11:46:04.096 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2: gsignal() 2024-04-26T11:46:04.096 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 3: abort() 2024-04-26T11:46:04.096 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7febd4c1c437] 2024-04-26T11:46:04.096 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7febd4c1c5a3] 2024-04-26T11:46:04.097 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f509f40822] 2024-04-26T11:46:04.097 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f509eb0598] 2024-04-26T11:46:04.097 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f509eb2c17] 2024-04-26T11:46:04.097 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f509dabd0b] 2024-04-26T11:46:04.097 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f509dac2ac] 2024-04-26T11:46:04.097 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f509d94fad] 2024-04-26T11:46:04.097 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7febd4eb0e20] 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 13: (DispatchQueue::entry()+0x51f) [0x7febd4eadfdf] 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7febd4f80fc1] 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7febd399a1ca] 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 16: clone() 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: -1> 2024-04-26T11:46:03.913+0000 7febc9400700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7febc9400700 time 2024-04-26T11:46:03.911711+0000 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7febd4c1c3dd] 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7febd4c1c5a3] 2024-04-26T11:46:04.098 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f509f40822] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f509eb0598] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f509eb2c17] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f509dabd0b] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f509dac2ac] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f509d94fad] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7febd4eb0e20] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 10: (DispatchQueue::entry()+0x51f) [0x7febd4eadfdf] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7febd4f80fc1] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7febd399a1ca] 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 13: clone() 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 0> 2024-04-26T11:46:03.916+0000 7febc9400700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: in thread 7febc9400700 thread_name:ms_dispatch 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.099 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7febd39a4d20] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2: gsignal() 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 3: abort() 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7febd4c1c437] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7febd4c1c5a3] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f509f40822] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f509eb0598] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f509eb2c17] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f509dabd0b] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f509dac2ac] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f509d94fad] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7febd4eb0e20] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 13: (DispatchQueue::entry()+0x51f) [0x7febd4eadfdf] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7febd4f80fc1] 2024-04-26T11:46:04.100 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7febd399a1ca] 2024-04-26T11:46:04.101 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 16: clone() 2024-04-26T11:46:04.101 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:04.101 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d[94887]: 2024-04-26T11:46:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:03 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:active 2024-04-26T11:46:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:03 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:clientreplay 2024-04-26T11:46:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:03 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=d=up:clientreplay} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:03 smithi193 ceph-mon[32782]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:46:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:03 smithi193 ceph-mon[32782]: pgmap v510: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2024-04-26T11:46:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:03 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:46:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:03 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:active 2024-04-26T11:46:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:03 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 1 up:standby 2024-04-26T11:46:04.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:03 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.196:6832/4229525631,v1:172.21.15.196:6833/4229525631] up:active 2024-04-26T11:46:04.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:03 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:clientreplay 2024-04-26T11:46:04.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:03 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=d=up:clientreplay} 1 up:standby-replay 3 up:standby 2024-04-26T11:46:04.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:03 smithi196 ceph-mon[32572]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T11:46:04.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:03 smithi196 ceph-mon[32572]: pgmap v510: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2024-04-26T11:46:04.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:03 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:46:04.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:03 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/603216747,v1:172.21.15.110:6837/603216747] up:active 2024-04-26T11:46:04.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:03 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=d=up:active} 3 up:standby-replay 1 up:standby 2024-04-26T11:46:04.453 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:04 smithi110 podman[95170]: 2024-04-26 11:46:04.115110416 +0000 UTC m=+0.058782452 container died 34c3b2a03ba2b6ae73ab68c2d93b656d780384e2dbb4dc934cac86d1a043ab9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T11:46:04.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 830.0 s, 368.2 tps, lat 1223.365 ms stddev 4945.307 2024-04-26T11:46:05.291 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:05 smithi110 podman[95170]: 2024-04-26 11:46:05.02775124 +0000 UTC m=+0.971423305 container remove 34c3b2a03ba2b6ae73ab68c2d93b656d780384e2dbb4dc934cac86d1a043ab9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:46:05.291 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:05 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:46:05.792 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:05 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T11:46:05.792 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:05 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 2.328s CPU time. 2024-04-26T11:46:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:06 smithi196 ceph-mon[32572]: pgmap v511: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-26T11:46:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:06 smithi110 ceph-mon[28069]: pgmap v511: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-26T11:46:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:06 smithi193 ceph-mon[32782]: pgmap v511: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-26T11:46:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-mon[32572]: pgmap v512: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f26a6a6a700 time 2024-04-26T11:46:08.330504+0000 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f26b10933dd] 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26b10935a3] 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c8cf7f8822] 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c8cf768598] 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c8cf76ac17] 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c8cf663d0b] 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c8cf6642ac] 2024-04-26T11:46:08.506 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c8cf64cfad] 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f26b1327e20] 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 10: (DispatchQueue::entry()+0x51f) [0x7f26b1324fdf] 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f26b13f7fc1] 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f26afe111ca] 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 13: clone() 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: *** Caught signal (Aborted) ** 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: in thread 7f26a6a6a700 thread_name:ms_dispatch 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.330+0000 7f26a6a6a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f26a6a6a700 time 2024-04-26T11:46:08.330504+0000 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f26b10933dd] 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26b10935a3] 2024-04-26T11:46:08.507 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c8cf7f8822] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c8cf768598] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c8cf76ac17] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c8cf663d0b] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c8cf6642ac] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c8cf64cfad] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f26b1327e20] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 10: (DispatchQueue::entry()+0x51f) [0x7f26b1324fdf] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f26b13f7fc1] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f26afe111ca] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 13: clone() 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f26afe1bd20] 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2: gsignal() 2024-04-26T11:46:08.508 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 3: abort() 2024-04-26T11:46:08.509 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f26b1093437] 2024-04-26T11:46:08.509 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26b10935a3] 2024-04-26T11:46:08.509 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c8cf7f8822] 2024-04-26T11:46:08.509 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c8cf768598] 2024-04-26T11:46:08.509 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c8cf76ac17] 2024-04-26T11:46:08.509 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c8cf663d0b] 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c8cf6642ac] 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c8cf64cfad] 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f26b1327e20] 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 13: (DispatchQueue::entry()+0x51f) [0x7f26b1324fdf] 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f26b13f7fc1] 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f26afe111ca] 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 16: clone() 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.332+0000 7f26a6a6a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: in thread 7f26a6a6a700 thread_name:ms_dispatch 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.510 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:08.511 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f26afe1bd20] 2024-04-26T11:46:08.511 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2: gsignal() 2024-04-26T11:46:08.511 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 3: abort() 2024-04-26T11:46:08.511 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f26b1093437] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26b10935a3] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c8cf7f8822] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c8cf768598] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c8cf76ac17] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c8cf663d0b] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c8cf6642ac] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c8cf64cfad] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f26b1327e20] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 13: (DispatchQueue::entry()+0x51f) [0x7f26b1324fdf] 2024-04-26T11:46:08.512 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f26b13f7fc1] 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f26afe111ca] 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 16: clone() 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: -1> 2024-04-26T11:46:08.330+0000 7f26a6a6a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f26a6a6a700 time 2024-04-26T11:46:08.330504+0000 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f26b10933dd] 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26b10935a3] 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c8cf7f8822] 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c8cf768598] 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c8cf76ac17] 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c8cf663d0b] 2024-04-26T11:46:08.513 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c8cf6642ac] 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c8cf64cfad] 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f26b1327e20] 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 10: (DispatchQueue::entry()+0x51f) [0x7f26b1324fdf] 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f26b13f7fc1] 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f26afe111ca] 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 13: clone() 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 0> 2024-04-26T11:46:08.332+0000 7f26a6a6a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: in thread 7f26a6a6a700 thread_name:ms_dispatch 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f26afe1bd20] 2024-04-26T11:46:08.514 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2: gsignal() 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 3: abort() 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f26b1093437] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26b10935a3] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c8cf7f8822] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c8cf768598] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c8cf76ac17] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c8cf663d0b] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c8cf6642ac] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c8cf64cfad] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f26b1327e20] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 13: (DispatchQueue::entry()+0x51f) [0x7f26b1324fdf] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f26b13f7fc1] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f26afe111ca] 2024-04-26T11:46:08.515 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 16: clone() 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: -1> 2024-04-26T11:46:08.330+0000 7f26a6a6a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f26a6a6a700 time 2024-04-26T11:46:08.330504+0000 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f26b10933dd] 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26b10935a3] 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c8cf7f8822] 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c8cf768598] 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c8cf76ac17] 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c8cf663d0b] 2024-04-26T11:46:08.516 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c8cf6642ac] 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c8cf64cfad] 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f26b1327e20] 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 10: (DispatchQueue::entry()+0x51f) [0x7f26b1324fdf] 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f26b13f7fc1] 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f26afe111ca] 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 13: clone() 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 0> 2024-04-26T11:46:08.332+0000 7f26a6a6a700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: in thread 7f26a6a6a700 thread_name:ms_dispatch 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f26afe1bd20] 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2: gsignal() 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 3: abort() 2024-04-26T11:46:08.517 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f26b1093437] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26b10935a3] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c8cf7f8822] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c8cf768598] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c8cf76ac17] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c8cf663d0b] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c8cf6642ac] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c8cf64cfad] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f26b1327e20] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 13: (DispatchQueue::entry()+0x51f) [0x7f26b1324fdf] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f26b13f7fc1] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f26afe111ca] 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 16: clone() 2024-04-26T11:46:08.518 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:08.519 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l[72136]: 2024-04-26T11:46:08.519 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:08 smithi196 podman[72320]: 2024-04-26 11:46:08.401611946 +0000 UTC m=+0.021226520 container died 99c5c2bca896dbbb22ebb4a290e9f582bdea8f5f3523e96dd77130f704892607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2) 2024-04-26T11:46:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:08 smithi110 ceph-mon[28069]: pgmap v512: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-26T11:46:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:08 smithi193 ceph-mon[32782]: pgmap v512: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-04-26T11:46:09.505 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:09 smithi196 podman[72320]: 2024-04-26 11:46:09.108379525 +0000 UTC m=+0.727994144 container remove 99c5c2bca896dbbb22ebb4a290e9f582bdea8f5f3523e96dd77130f704892607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:46:09.505 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:09 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:46:09.505 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:09 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T11:46:09.505 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:09 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.001s CPU time. 2024-04-26T11:46:09.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:46:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:10 smithi196 ceph-mon[32572]: pgmap v513: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 309 op/s 2024-04-26T11:46:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:10 smithi110 ceph-mon[28069]: pgmap v513: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 309 op/s 2024-04-26T11:46:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:10 smithi193 ceph-mon[32782]: pgmap v513: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 309 op/s 2024-04-26T11:46:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:12 smithi196 ceph-mon[32572]: pgmap v514: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 2.2 MiB/s wr, 266 op/s 2024-04-26T11:46:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:12 smithi110 ceph-mon[28069]: pgmap v514: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 2.2 MiB/s wr, 266 op/s 2024-04-26T11:46:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:12 smithi193 ceph-mon[32782]: pgmap v514: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 2.2 MiB/s wr, 266 op/s 2024-04-26T11:46:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:14 smithi196 ceph-mon[32572]: pgmap v515: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 2.4 MiB/s wr, 292 op/s 2024-04-26T11:46:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:14 smithi110 ceph-mon[28069]: pgmap v515: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 2.4 MiB/s wr, 292 op/s 2024-04-26T11:46:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:14 smithi193 ceph-mon[32782]: pgmap v515: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 2.4 MiB/s wr, 292 op/s 2024-04-26T11:46:14.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:46:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.035+0000 7fcdb1c00640 1 -- 172.21.15.110:0/3001205815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 msgr2=0x7fcdac10c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.035+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/3001205815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 0x7fcdac10c9c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009900 tx=0x7fcd9802a510 comp rx=0 tx=0).stop 2024-04-26T11:46:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.035+0000 7fcdb1c00640 1 -- 172.21.15.110:0/3001205815 shutdown_connections 2024-04-26T11:46:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.035+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/3001205815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac10cf00 0x7fcdac10f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.035+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/3001205815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 0x7fcdac10c9c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.035+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/3001205815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdac103bc0 0x7fcdac103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.035+0000 7fcdb1c00640 1 -- 172.21.15.110:0/3001205815 >> 172.21.15.110:0/3001205815 conn(0x7fcdac0789b0 msgr2=0x7fcdac078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.035+0000 7fcdb1c00640 1 -- 172.21.15.110:0/3001205815 shutdown_connections 2024-04-26T11:46:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.035+0000 7fcdb1c00640 1 -- 172.21.15.110:0/3001205815 wait complete. 2024-04-26T11:46:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.036+0000 7fcdb1c00640 1 Processor -- start 2024-04-26T11:46:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.036+0000 7fcdb1c00640 1 -- start start 2024-04-26T11:46:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.036+0000 7fcdb1c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdac103bc0 0x7fcdac199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.036+0000 7fcdb1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 0x7fcdac1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.036+0000 7fcdb1c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac10cf00 0x7fcdac19d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdb1c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac112c00 con 0x7fcdac1044e0 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdb1c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac112a80 con 0x7fcdac103bc0 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdb1c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac112d80 con 0x7fcdac10cf00 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 0x7fcdac1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 0x7fcdac1995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58276/0 (socket says 172.21.15.110:58276) 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaaa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdac103bc0 0x7fcdac199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaa000640 1 -- 172.21.15.110:0/1705662509 learned_addr learned my addr 172.21.15.110:0/1705662509 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdab400640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac10cf00 0x7fcdac19d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaa000640 1 -- 172.21.15.110:0/1705662509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac10cf00 msgr2=0x7fcdac19d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaa000640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac10cf00 0x7fcdac19d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaa000640 1 -- 172.21.15.110:0/1705662509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdac103bc0 msgr2=0x7fcdac199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaa000640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdac103bc0 0x7fcdac199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaa000640 1 -- 172.21.15.110:0/1705662509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac19e050 con 0x7fcdac1044e0 2024-04-26T11:46:15.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.037+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdac103bc0 0x7fcdac199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:46:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.038+0000 7fcdaa000640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 0x7fcdac1995a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcd98005ab0 tx=0x7fcd98003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.038+0000 7fcda3400640 1 -- 172.21.15.110:0/1705662509 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9803f070 con 0x7fcdac1044e0 2024-04-26T11:46:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.038+0000 7fcda3400640 1 -- 172.21.15.110:0/1705662509 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd98031b60 con 0x7fcdac1044e0 2024-04-26T11:46:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.038+0000 7fcda3400640 1 -- 172.21.15.110:0/1705662509 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98035030 con 0x7fcdac1044e0 2024-04-26T11:46:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.038+0000 7fcdb1c00640 1 -- 172.21.15.110:0/1705662509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdac19e2e0 con 0x7fcdac1044e0 2024-04-26T11:46:15.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.038+0000 7fcdb1c00640 1 -- 172.21.15.110:0/1705662509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdac1a5bd0 con 0x7fcdac1044e0 2024-04-26T11:46:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.041+0000 7fcda3400640 1 -- 172.21.15.110:0/1705662509 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fcd98042070 con 0x7fcdac1044e0 2024-04-26T11:46:15.044 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.041+0000 7fcdb4bd9740 1 Processor -- start 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.041+0000 7fcdb4bd9740 1 -- start start 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba013e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba0167b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55deb9f6a380 con 0x55deba0055b0 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55deb9f06c30 con 0x55deba004c90 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55deb9f66340 con 0x55deba0143c0 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdaaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba013e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdaaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba013e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58288/0 (socket says 172.21.15.110:58288) 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdaaa00640 1 -- 172.21.15.110:0/192242472 learned_addr learned my addr 172.21.15.110:0/192242472 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdab400640 1 --2- 172.21.15.110:0/192242472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.042+0000 7fcdaa000640 1 --2- 172.21.15.110:0/192242472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba0167b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcdaaa00640 1 -- 172.21.15.110:0/192242472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 msgr2=0x55deba0167b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:15.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/192242472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba0167b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcdaaa00640 1 -- 172.21.15.110:0/192242472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 msgr2=0x55deba005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/192242472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcdaaa00640 1 -- 172.21.15.110:0/192242472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb9f28940 con 0x55deba0055b0 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcda3400640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fcd900a3e40 0x7fcd900a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/192242472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba013e80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0115f0 tx=0x7fcd9c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bd7886497210b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcda3400640 1 -- 172.21.15.110:0/1705662509 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 12341+0+0 (secure 0 0 0) 0x7fcd980f1c90 con 0x7fcdac1044e0 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcdab400640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fcd900a3e40 0x7fcd900a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.043+0000 7fcd97e00640 1 -- 172.21.15.110:0/192242472 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c01e070 con 0x55deba0055b0 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcd97e00640 1 -- 172.21.15.110:0/192242472 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9c00faf0 con 0x55deba0055b0 2024-04-26T11:46:15.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcd97e00640 1 -- 172.21.15.110:0/192242472 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c019b60 con 0x55deba0055b0 2024-04-26T11:46:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/192242472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 msgr2=0x55deba013e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/192242472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba013e80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0115f0 tx=0x7fcd9c011ab0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.049 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcdab400640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fcd900a3e40 0x7fcd900a6300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcda4005fd0 tx=0x7fcda4009500 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/192242472 shutdown_connections 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/192242472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba0167b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/192242472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba013e80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/192242472 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba005070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.044+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/192242472 >> 172.21.15.110:0/192242472 conn(0x55deba0012e0 msgr2=0x55deba0016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.045+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/192242472 shutdown_connections 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.045+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/192242472 wait complete. 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.045+0000 7fcdb4bd9740 1 -- start start 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.045+0000 7fcdb4bd9740 1 Processor -- start 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba0112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba011810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba011d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55deba016f90 con 0x55deba0055b0 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55deb9ef1c60 con 0x55deba004c90 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55deba017110 con 0x55deba0143c0 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdb4bd9740 10 client.0 _ll_register_callbacks cb 0x55deb9f1de50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba011810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba011810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58290/0 (socket says 172.21.15.110:58290) 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdaa000640 1 -- 172.21.15.110:0/991058823 learned_addr learned my addr 172.21.15.110:0/991058823 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba0112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdab400640 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba011d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdaa000640 1 -- 172.21.15.110:0/991058823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 msgr2=0x55deba011d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdaa000640 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba011d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdaa000640 1 -- 172.21.15.110:0/991058823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 msgr2=0x55deba0112d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdaa000640 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba0112d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.046+0000 7fcdaa000640 1 -- 172.21.15.110:0/991058823 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deb9f00510 con 0x55deba0055b0 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcdaa000640 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba011810 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcd98031440 tx=0x7fcd9803b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da87612e71e8ca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:15.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcd94c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcd94c00640 1 -- 172.21.15.110:0/991058823 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98049070 con 0x55deba0055b0 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcd94c00640 1 -- 172.21.15.110:0/991058823 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 12341+0+0 (secure 0 0 0) 0x7fcd980b9460 con 0x55deba0055b0 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/991058823 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd9c00faf0 con 0x55deba0055b0 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcd94c00640 1 -- 172.21.15.110:0/991058823 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=269) ==== 24+0+0 (secure 0 0 0) 0x7fcd980bc930 con 0x55deba0055b0 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcdb4bd9740 10 client.16176 fetch_fsmap learned FSMap version 269 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/991058823 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=269,monmap=4+}) -- 0x55deb9c7c210 con 0x55deba0055b0 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcd94c00640 1 -- 172.21.15.110:0/991058823 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9c00faf0 con 0x55deba0055b0 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.047+0000 7fcd94c00640 1 -- 172.21.15.110:0/991058823 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 269) ==== 5313+0+0 (secure 0 0 0) 0x7fcd980f6040 con 0x55deba0055b0 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.048+0000 7fcdb4bd9740 10 client.16176 fetch_fsmap finished waiting for FSMap version 269 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.048+0000 7fcdb4bd9740 10 client.16176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.048+0000 7fcdb4bd9740 20 client.16176 populate_metadata read hostname 'smithi110' 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.048+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55deba024260 0x55deba026720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.048+0000 7fcdb4bd9740 4 client.16176 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.048+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/991058823 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55deb9f77f90 con 0x55deba024260 2024-04-26T11:46:15.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.048+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55deba024260 0x55deba026720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.049+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55deba024260 0x55deba026720 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a67bca7f7a167f server_cookie=dff6e3d993f9e13d in_seq=0 out_seq=0 2024-04-26T11:46:15.053 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.049+0000 7fcd94c00640 10 client.16176 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.049+0000 7fcd94c00640 1 -- 172.21.15.110:0/991058823 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55deb9f77f90 con 0x55deba024260 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.049+0000 7fcd94c00640 10 client.16176 handle_command_reply: tid=0 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.049+0000 7fcdb4bd9740 1 client.16176 shutdown 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/991058823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 msgr2=0x55deba011810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba011810 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcd98031440 tx=0x7fcd9803b800 comp rx=0 tx=0).stop 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/991058823 shutdown_connections 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55deba024260 0x55deba026720 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba011d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba011810 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcd94c00640 0 client.16176 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:46:15.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/991058823 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba0112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/991058823 >> 172.21.15.110:0/991058823 conn(0x55deba0012e0 msgr2=0x55deba007080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:15.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/991058823 shutdown_connections 2024-04-26T11:46:15.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/991058823 wait complete. 2024-04-26T11:46:15.055 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.050+0000 7fcdb4bd9740 20 client.16176 trim_cache size 0 max 16384 2024-04-26T11:46:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.066+0000 7fcdb4bd9740 1 Processor -- start 2024-04-26T11:46:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.066+0000 7fcdb4bd9740 1 -- start start 2024-04-26T11:46:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.066+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba004c90 0x55deba013a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.066+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0055b0 0x55deba01fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.066+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba0143c0 0x55deba02bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac1af800 con 0x55deba004c90 2024-04-26T11:46:15.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac1ad5f0 con 0x55deba0143c0 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac1af130 con 0x55deba0055b0 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdaaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba004c90 0x55deba013a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdaaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba004c90 0x55deba013a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58294/0 (socket says 172.21.15.110:58294) 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdaaa00640 1 -- 172.21.15.110:0/2003743067 learned_addr learned my addr 172.21.15.110:0/2003743067 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdab400640 1 --2- 172.21.15.110:0/2003743067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba0143c0 0x55deba02bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdaa000640 1 --2- 172.21.15.110:0/2003743067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0055b0 0x55deba01fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdaaa00640 1 -- 172.21.15.110:0/2003743067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0055b0 msgr2=0x55deba01fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/2003743067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0055b0 0x55deba01fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdaaa00640 1 -- 172.21.15.110:0/2003743067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba0143c0 msgr2=0x55deba02bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/2003743067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba0143c0 0x55deba02bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.069 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.067+0000 7fcdaaa00640 1 -- 172.21.15.110:0/2003743067 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb9d48620 con 0x55deba004c90 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.068+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/2003743067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba004c90 0x55deba013a00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0115f0 tx=0x7fcd9c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d990352e2ee99a99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.068+0000 7fcd97400640 1 -- 172.21.15.110:0/2003743067 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c01e040 con 0x55deba004c90 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.068+0000 7fcd97400640 1 -- 172.21.15.110:0/2003743067 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9c02f070 con 0x55deba004c90 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.068+0000 7fcd97400640 1 -- 172.21.15.110:0/2003743067 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c019e10 con 0x55deba004c90 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.068+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2003743067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba004c90 msgr2=0x55deba013a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.068+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2003743067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba004c90 0x55deba013a00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0115f0 tx=0x7fcd9c019700 comp rx=0 tx=0).stop 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.069+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2003743067 shutdown_connections 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.069+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2003743067 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba0143c0 0x55deba02bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.069+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2003743067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0055b0 0x55deba01fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.069+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2003743067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba004c90 0x55deba013a00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.069+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2003743067 >> 172.21.15.110:0/2003743067 conn(0x55deba0012e0 msgr2=0x55deba000440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.069+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2003743067 shutdown_connections 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.069+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2003743067 wait complete. 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.069+0000 7fcdb4bd9740 1 -- start start 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.069+0000 7fcdb4bd9740 1 Processor -- start 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba01c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdb4bd9740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba00e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac1ae390 con 0x55deba0055b0 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac1adcc0 con 0x55deba004c90 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdb4bd9740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac1aea60 con 0x55deba0143c0 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdb4bd9740 10 client.0 _ll_register_callbacks cb 0x7fcd980f54d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba00dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58306/0 (socket says 172.21.15.110:58306) 2024-04-26T11:46:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdaa000640 1 -- 172.21.15.110:0/2583352220 learned_addr learned my addr 172.21.15.110:0/2583352220 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba01c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdab400640 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba00e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdaa000640 1 -- 172.21.15.110:0/2583352220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 msgr2=0x55deba00e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdaa000640 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba00e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdaa000640 1 -- 172.21.15.110:0/2583352220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 msgr2=0x55deba01c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdaa000640 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba01c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.070+0000 7fcdaa000640 1 -- 172.21.15.110:0/2583352220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deb9f24cb0 con 0x55deba0055b0 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.071+0000 7fcdaa000640 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba00dc40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcd98005ec0 tx=0x7fcd9802a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc481373eefe16d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.071+0000 7fcd94c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.071+0000 7fcd94c00640 1 -- 172.21.15.110:0/2583352220 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98049070 con 0x55deba0055b0 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.071+0000 7fcd94c00640 1 -- 172.21.15.110:0/2583352220 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 12341+0+0 (secure 0 0 0) 0x7fcd980dd0b0 con 0x55deba0055b0 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.071+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2583352220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd9c02f070 con 0x55deba0055b0 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.071+0000 7fcd94c00640 1 -- 172.21.15.110:0/2583352220 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=269) ==== 24+0+0 (secure 0 0 0) 0x7fcd980bc750 con 0x55deba0055b0 2024-04-26T11:46:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.071+0000 7fcdb4bd9740 10 client.16182 fetch_fsmap learned FSMap version 269 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.071+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2583352220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=269,monmap=4+}) -- 0x55deba08a620 con 0x55deba0055b0 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.071+0000 7fcd94c00640 1 -- 172.21.15.110:0/2583352220 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd9c02f070 con 0x55deba0055b0 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.072+0000 7fcd94c00640 1 -- 172.21.15.110:0/2583352220 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 269) ==== 5313+0+0 (secure 0 0 0) 0x7fcd980d6020 con 0x55deba0055b0 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.072+0000 7fcdb4bd9740 10 client.16182 fetch_fsmap finished waiting for FSMap version 269 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.072+0000 7fcdb4bd9740 10 client.16182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.072+0000 7fcdb4bd9740 20 client.16182 populate_metadata read hostname 'smithi110' 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.072+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55deba08ab00 0x55deba08cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.072+0000 7fcdb4bd9740 4 client.16182 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.072+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2583352220 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55deb9f71e00 con 0x55deba08ab00 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.072+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55deba08ab00 0x55deba08cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.073+0000 7fcdaaa00640 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55deba08ab00 0x55deba08cef0 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96cf9d7ad59bdccb server_cookie=670488559914db21 in_seq=0 out_seq=0 2024-04-26T11:46:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:15.073+0000 7fcd94c00640 10 client.16182 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:46:16.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:15 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 6. 2024-04-26T11:46:16.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:15 smithi110 systemd[1]: Stopped Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:46:16.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:15 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Consumed 2.328s CPU time. 2024-04-26T11:46:16.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:15 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Start request repeated too quickly. 2024-04-26T11:46:16.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:15 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T11:46:16.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Apr 26 11:46:15 smithi110 systemd[1]: Failed to start Ceph mds.d for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:46:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:16 smithi196 ceph-mon[32572]: pgmap v516: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.2 MiB/s wr, 259 op/s 2024-04-26T11:46:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:16 smithi110 ceph-mon[28069]: pgmap v516: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.2 MiB/s wr, 259 op/s 2024-04-26T11:46:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:16 smithi193 ceph-mon[32782]: pgmap v516: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.2 MiB/s wr, 259 op/s 2024-04-26T11:46:18.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:18 smithi196 ceph-mon[32572]: pgmap v517: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-04-26T11:46:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:18 smithi110 ceph-mon[28069]: pgmap v517: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-04-26T11:46:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:18 smithi193 ceph-mon[32782]: pgmap v517: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-04-26T11:46:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:19 smithi196 ceph-mon[32572]: Replacing daemon mds.d as rank 2 with standby daemon mds.a 2024-04-26T11:46:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:19 smithi196 ceph-mon[32572]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-04-26T11:46:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:19 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:46:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:19 smithi196 ceph-mon[32572]: osdmap e154: 12 total, 12 up, 12 in 2024-04-26T11:46:19.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:19 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=a=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T11:46:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:19 smithi110 ceph-mon[28069]: Replacing daemon mds.d as rank 2 with standby daemon mds.a 2024-04-26T11:46:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:19 smithi110 ceph-mon[28069]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-04-26T11:46:19.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:19 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:46:19.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:19 smithi110 ceph-mon[28069]: osdmap e154: 12 total, 12 up, 12 in 2024-04-26T11:46:19.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:19 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=a=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T11:46:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:19 smithi193 ceph-mon[32782]: Replacing daemon mds.d as rank 2 with standby daemon mds.a 2024-04-26T11:46:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:19 smithi193 ceph-mon[32782]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-04-26T11:46:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:19 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:46:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:19 smithi193 ceph-mon[32782]: osdmap e154: 12 total, 12 up, 12 in 2024-04-26T11:46:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:19 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=a=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T11:46:19.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:46:20.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:19 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 6. 2024-04-26T11:46:20.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:19 smithi196 systemd[1]: Stopped Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:46:20.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:19 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.001s CPU time. 2024-04-26T11:46:20.005 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:19 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Start request repeated too quickly. 2024-04-26T11:46:20.006 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:19 smithi196 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T11:46:20.006 INFO:journalctl@ceph.mds.l.smithi196.stdout:Apr 26 11:46:19 smithi196 systemd[1]: Failed to start Ceph mds.l for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:46:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:20 smithi196 ceph-mon[32572]: pgmap v519: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 308 KiB/s wr, 43 op/s 2024-04-26T11:46:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:20 smithi110 ceph-mon[28069]: pgmap v519: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 308 KiB/s wr, 43 op/s 2024-04-26T11:46:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:20 smithi193 ceph-mon[32782]: pgmap v519: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 308 KiB/s wr, 43 op/s 2024-04-26T11:46:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:21 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:resolve 2024-04-26T11:46:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:21 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=a=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T11:46:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:21 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:resolve 2024-04-26T11:46:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:21 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=a=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T11:46:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:21 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:resolve 2024-04-26T11:46:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:21 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=a=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T11:46:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:22 smithi110 ceph-mon[28069]: pgmap v520: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 308 KiB/s wr, 43 op/s 2024-04-26T11:46:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:22 smithi193 ceph-mon[32782]: pgmap v520: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 308 KiB/s wr, 43 op/s 2024-04-26T11:46:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:22 smithi196 ceph-mon[32572]: pgmap v520: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 308 KiB/s wr, 43 op/s 2024-04-26T11:46:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:24 smithi110 ceph-mon[28069]: pgmap v521: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 63 KiB/s wr, 14 op/s 2024-04-26T11:46:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:24 smithi110 ceph-mon[28069]: Replacing daemon mds.l as rank 1 with standby daemon mds.k 2024-04-26T11:46:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:24 smithi110 ceph-mon[28069]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-04-26T11:46:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:24 smithi110 ceph-mon[28069]: osdmap e155: 12 total, 12 up, 12 in 2024-04-26T11:46:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:24 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:24 smithi193 ceph-mon[32782]: pgmap v521: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 63 KiB/s wr, 14 op/s 2024-04-26T11:46:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:24 smithi193 ceph-mon[32782]: Replacing daemon mds.l as rank 1 with standby daemon mds.k 2024-04-26T11:46:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:24 smithi193 ceph-mon[32782]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-04-26T11:46:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:24 smithi193 ceph-mon[32782]: osdmap e155: 12 total, 12 up, 12 in 2024-04-26T11:46:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:24 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:24 smithi196 ceph-mon[32572]: pgmap v521: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 63 KiB/s wr, 14 op/s 2024-04-26T11:46:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:24 smithi196 ceph-mon[32572]: Replacing daemon mds.l as rank 1 with standby daemon mds.k 2024-04-26T11:46:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:24 smithi196 ceph-mon[32572]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-04-26T11:46:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:24 smithi196 ceph-mon[32572]: osdmap e155: 12 total, 12 up, 12 in 2024-04-26T11:46:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:24 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:24.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:46:26.099 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:25 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:resolve 2024-04-26T11:46:26.099 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:25 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:26.099 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:25 smithi110 ceph-mon[28069]: pgmap v523: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-04-26T11:46:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:25 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:resolve 2024-04-26T11:46:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:25 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:25 smithi193 ceph-mon[32782]: pgmap v523: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-04-26T11:46:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:25 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:resolve 2024-04-26T11:46:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:25 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:25 smithi196 ceph-mon[32572]: pgmap v523: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-04-26T11:46:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.876+0000 7fcd94c00640 1 -- 172.21.15.110:0/2583352220 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55deb9f71e00 con 0x55deba08ab00 2024-04-26T11:46:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.876+0000 7fcd94c00640 10 client.16182 handle_command_reply: tid=0 2024-04-26T11:46:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.876+0000 7fcdb4bd9740 1 client.16182 shutdown 2024-04-26T11:46:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.876+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2583352220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 msgr2=0x55deba00dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.876+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba00dc40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcd98005ec0 tx=0x7fcd9802a510 comp rx=0 tx=0).stop 2024-04-26T11:46:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.877+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2583352220 shutdown_connections 2024-04-26T11:46:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.877+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55deba08ab00 0x55deba08cef0 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.877+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55deba0143c0 0x55deba00e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.877+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55deba0055b0 0x55deba00dc40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.877+0000 7fcdb4bd9740 1 --2- 172.21.15.110:0/2583352220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55deba004c90 0x55deba01c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.877+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2583352220 >> 172.21.15.110:0/2583352220 conn(0x55deba0012e0 msgr2=0x55deba011290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.877+0000 7fcd94c00640 0 client.16182 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:46:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.877+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2583352220 shutdown_connections 2024-04-26T11:46:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.877+0000 7fcdb4bd9740 1 -- 172.21.15.110:0/2583352220 wait complete. 2024-04-26T11:46:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.878+0000 7fcdb4bd9740 20 client.16182 trim_cache size 0 max 16384 2024-04-26T11:46:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:46:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:46:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:46:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:46:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 -- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fcd900a3e40 msgr2=0x7fcd900a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fcd900a3e40 0x7fcd900a6300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcda4005fd0 tx=0x7fcda4009500 comp rx=0 tx=0).stop 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 -- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 msgr2=0x7fcdac1995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 0x7fcdac1995a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcd98005ab0 tx=0x7fcd98003c10 comp rx=0 tx=0).stop 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 -- 172.21.15.110:0/1705662509 shutdown_connections 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fcd900a3e40 0x7fcd900a6300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcdac10cf00 0x7fcdac19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdac1044e0 0x7fcdac1995a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 --2- 172.21.15.110:0/1705662509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdac103bc0 0x7fcdac199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 -- 172.21.15.110:0/1705662509 >> 172.21.15.110:0/1705662509 conn(0x7fcdac0789b0 msgr2=0x7fcdac0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 -- 172.21.15.110:0/1705662509 shutdown_connections 2024-04-26T11:46:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:26.879+0000 7fcdb1c00640 1 -- 172.21.15.110:0/1705662509 wait complete. 2024-04-26T11:46:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:26 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299995 2024-04-26T11:46:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:26 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:reconnect 2024-04-26T11:46:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:26 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:reconnect 2024-04-26T11:46:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:26 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:26 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:46:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:26 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:46:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:26 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299995 2024-04-26T11:46:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:26 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:reconnect 2024-04-26T11:46:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:26 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:reconnect 2024-04-26T11:46:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:26 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:26 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:46:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:26 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:46:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:26 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299995 2024-04-26T11:46:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:26 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:reconnect 2024-04-26T11:46:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:26 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:reconnect 2024-04-26T11:46:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:26 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:26 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:46:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:26 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:46:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:27 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:rejoin 2024-04-26T11:46:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:27 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:rejoin 2024-04-26T11:46:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:27 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:27 smithi193 ceph-mon[32782]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T11:46:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:27 smithi193 ceph-mon[32782]: pgmap v524: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 245 B/s wr, 3 op/s 2024-04-26T11:46:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:27 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:rejoin 2024-04-26T11:46:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:27 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:rejoin 2024-04-26T11:46:28.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:27 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:28.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:27 smithi196 ceph-mon[32572]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T11:46:28.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:27 smithi196 ceph-mon[32572]: pgmap v524: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 245 B/s wr, 3 op/s 2024-04-26T11:46:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:27 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:rejoin 2024-04-26T11:46:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:27 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:rejoin 2024-04-26T11:46:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:27 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:27 smithi110 ceph-mon[28069]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T11:46:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:27 smithi110 ceph-mon[28069]: pgmap v524: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 245 B/s wr, 3 op/s 2024-04-26T11:46:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:28 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:active 2024-04-26T11:46:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:28 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:clientreplay 2024-04-26T11:46:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:28 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:clientreplay} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:28 smithi196 ceph-mon[32572]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:46:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:28 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:46:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:28 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:active 2024-04-26T11:46:29.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:28 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:active 2024-04-26T11:46:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:clientreplay 2024-04-26T11:46:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:clientreplay} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-mon[28069]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:46:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:46:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:active 2024-04-26T11:46:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:29.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1741000700 time 2024-04-26T11:46:28.870590+0000 2024-04-26T11:46:29.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:29.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:29.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f174c8f93dd] 2024-04-26T11:46:29.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f174c8f95a3] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bcb6b58822] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bcb6ac8598] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bcb6acac17] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bcb69c3d0b] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bcb69c42ac] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bcb69acfad] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f174cb8de20] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 10: (DispatchQueue::entry()+0x51f) [0x7f174cb8afdf] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f174cc5dfc1] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f174b6771ca] 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 13: clone() 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: *** Caught signal (Aborted) ** 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: in thread 7f1741000700 thread_name:ms_dispatch 2024-04-26T11:46:29.294 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:28.872+0000 7f1741000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1741000700 time 2024-04-26T11:46:28.870590+0000 2024-04-26T11:46:29.296 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:29.296 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.296 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:29.296 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f174c8f93dd] 2024-04-26T11:46:29.296 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f174c8f95a3] 2024-04-26T11:46:29.296 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bcb6b58822] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bcb6ac8598] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bcb6acac17] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bcb69c3d0b] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bcb69c42ac] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bcb69acfad] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f174cb8de20] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 10: (DispatchQueue::entry()+0x51f) [0x7f174cb8afdf] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f174cc5dfc1] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f174b6771ca] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 13: clone() 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f174b681d20] 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2: gsignal() 2024-04-26T11:46:29.297 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 3: abort() 2024-04-26T11:46:29.298 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f174c8f9437] 2024-04-26T11:46:29.298 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f174c8f95a3] 2024-04-26T11:46:29.298 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bcb6b58822] 2024-04-26T11:46:29.298 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bcb6ac8598] 2024-04-26T11:46:29.298 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bcb6acac17] 2024-04-26T11:46:29.298 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bcb69c3d0b] 2024-04-26T11:46:29.298 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bcb69c42ac] 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bcb69acfad] 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f174cb8de20] 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 13: (DispatchQueue::entry()+0x51f) [0x7f174cb8afdf] 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f174cc5dfc1] 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f174b6771ca] 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 16: clone() 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:28.876+0000 7f1741000700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: in thread 7f1741000700 thread_name:ms_dispatch 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f174b681d20] 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2: gsignal() 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 3: abort() 2024-04-26T11:46:29.299 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f174c8f9437] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f174c8f95a3] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bcb6b58822] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bcb6ac8598] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bcb6acac17] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bcb69c3d0b] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bcb69c42ac] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bcb69acfad] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f174cb8de20] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 13: (DispatchQueue::entry()+0x51f) [0x7f174cb8afdf] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f174cc5dfc1] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f174b6771ca] 2024-04-26T11:46:29.300 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 16: clone() 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: -1> 2024-04-26T11:46:28.872+0000 7f1741000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1741000700 time 2024-04-26T11:46:28.870590+0000 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f174c8f93dd] 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f174c8f95a3] 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bcb6b58822] 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bcb6ac8598] 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bcb6acac17] 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bcb69c3d0b] 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bcb69c42ac] 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bcb69acfad] 2024-04-26T11:46:29.301 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f174cb8de20] 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 10: (DispatchQueue::entry()+0x51f) [0x7f174cb8afdf] 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f174cc5dfc1] 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f174b6771ca] 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 13: clone() 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 0> 2024-04-26T11:46:28.876+0000 7f1741000700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: in thread 7f1741000700 thread_name:ms_dispatch 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:29.302 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f174b681d20] 2024-04-26T11:46:29.303 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2: gsignal() 2024-04-26T11:46:29.303 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 3: abort() 2024-04-26T11:46:29.303 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f174c8f9437] 2024-04-26T11:46:29.303 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f174c8f95a3] 2024-04-26T11:46:29.303 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bcb6b58822] 2024-04-26T11:46:29.303 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bcb6ac8598] 2024-04-26T11:46:29.303 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bcb6acac17] 2024-04-26T11:46:29.303 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bcb69c3d0b] 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bcb69c42ac] 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bcb69acfad] 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f174cb8de20] 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 13: (DispatchQueue::entry()+0x51f) [0x7f174cb8afdf] 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f174cc5dfc1] 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f174b6771ca] 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 16: clone() 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: -1> 2024-04-26T11:46:28.872+0000 7f1741000700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1741000700 time 2024-04-26T11:46:28.870590+0000 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.304 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f174c8f93dd] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f174c8f95a3] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bcb6b58822] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bcb6ac8598] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bcb6acac17] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bcb69c3d0b] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bcb69c42ac] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bcb69acfad] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f174cb8de20] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 10: (DispatchQueue::entry()+0x51f) [0x7f174cb8afdf] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f174cc5dfc1] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f174b6771ca] 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 13: clone() 2024-04-26T11:46:29.305 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 0> 2024-04-26T11:46:28.876+0000 7f1741000700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: in thread 7f1741000700 thread_name:ms_dispatch 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f174b681d20] 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2: gsignal() 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 3: abort() 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f174c8f9437] 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f174c8f95a3] 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bcb6b58822] 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bcb6ac8598] 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bcb6acac17] 2024-04-26T11:46:29.306 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bcb69c3d0b] 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bcb69c42ac] 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bcb69acfad] 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f174cb8de20] 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 13: (DispatchQueue::entry()+0x51f) [0x7f174cb8afdf] 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f174cc5dfc1] 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f174b6771ca] 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 16: clone() 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:28 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[67575]: 2024-04-26T11:46:29.307 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:29 smithi110 podman[95273]: 2024-04-26 11:46:29.049223697 +0000 UTC m=+0.052276306 container died 50045bb5acf7c128ca6be51c2e3eaa9ae822d346dc22825442ec687634ffc64b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-26T11:46:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:28 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/1689064721,v1:172.21.15.193:6833/1689064721] up:active 2024-04-26T11:46:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:28 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:clientreplay 2024-04-26T11:46:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:28 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:clientreplay} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:28 smithi193 ceph-mon[32782]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:46:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:28 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:46:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:28 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6840/1751495892,v1:172.21.15.110:6841/1751495892] up:active 2024-04-26T11:46:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:28 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:29.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 855.0 s, 509.1 tps, lat 997.390 ms stddev 4728.718 2024-04-26T11:46:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:29 smithi110 ceph-mon[28069]: pgmap v525: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 88 KiB/s wr, 19 op/s 2024-04-26T11:46:30.042 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:29 smithi110 podman[95273]: 2024-04-26 11:46:29.757631629 +0000 UTC m=+0.760684214 container remove 50045bb5acf7c128ca6be51c2e3eaa9ae822d346dc22825442ec687634ffc64b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T11:46:30.042 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:29 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:46:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:29 smithi196 ceph-mon[32572]: pgmap v525: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 88 KiB/s wr, 19 op/s 2024-04-26T11:46:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:29 smithi193 ceph-mon[32782]: pgmap v525: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 88 KiB/s wr, 19 op/s 2024-04-26T11:46:30.541 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:30 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-04-26T11:46:30.541 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:30 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 2.850s CPU time. 2024-04-26T11:46:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:32 smithi196 ceph-mon[32572]: pgmap v526: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 88 KiB/s wr, 19 op/s 2024-04-26T11:46:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:32 smithi110 ceph-mon[28069]: pgmap v526: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 88 KiB/s wr, 19 op/s 2024-04-26T11:46:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:32 smithi193 ceph-mon[32782]: pgmap v526: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 88 KiB/s wr, 19 op/s 2024-04-26T11:46:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:33 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:33 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:33 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-mon[32782]: pgmap v527: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 2.7 MiB/s wr, 205 op/s 2024-04-26T11:46:34.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff057513700 time 2024-04-26T11:46:34.081520+0000 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff061b3c3dd] 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff061b3c5a3] 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f5295be822] 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f52952e598] 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f529530c17] 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f529429d0b] 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f52942a2ac] 2024-04-26T11:46:34.373 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f529412fad] 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff061dd0e20] 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 10: (DispatchQueue::entry()+0x51f) [0x7ff061dcdfdf] 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff061ea0fc1] 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff0608ba1ca] 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 13: clone() 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.081+0000 7ff057513700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff057513700 time 2024-04-26T11:46:34.081520+0000 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff061b3c3dd] 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff061b3c5a3] 2024-04-26T11:46:34.374 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f5295be822] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f52952e598] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f529530c17] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f529429d0b] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f52942a2ac] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f529412fad] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff061dd0e20] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 10: (DispatchQueue::entry()+0x51f) [0x7ff061dcdfdf] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff061ea0fc1] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff0608ba1ca] 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 13: clone() 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.375 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: *** Caught signal (Aborted) ** 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: in thread 7ff057513700 thread_name:ms_dispatch 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff0608c4d20] 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2: gsignal() 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 3: abort() 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff061b3c437] 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff061b3c5a3] 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f5295be822] 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f52952e598] 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f529530c17] 2024-04-26T11:46:34.376 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f529429d0b] 2024-04-26T11:46:34.377 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f52942a2ac] 2024-04-26T11:46:34.377 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f529412fad] 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff061dd0e20] 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 13: (DispatchQueue::entry()+0x51f) [0x7ff061dcdfdf] 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff061ea0fc1] 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff0608ba1ca] 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 16: clone() 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.083+0000 7ff057513700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: in thread 7ff057513700 thread_name:ms_dispatch 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff0608c4d20] 2024-04-26T11:46:34.378 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2: gsignal() 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 3: abort() 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff061b3c437] 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff061b3c5a3] 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f5295be822] 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f52952e598] 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f529530c17] 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f529429d0b] 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f52942a2ac] 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f529412fad] 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff061dd0e20] 2024-04-26T11:46:34.379 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 13: (DispatchQueue::entry()+0x51f) [0x7ff061dcdfdf] 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff061ea0fc1] 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff0608ba1ca] 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 16: clone() 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: -1> 2024-04-26T11:46:34.081+0000 7ff057513700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff057513700 time 2024-04-26T11:46:34.081520+0000 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff061b3c3dd] 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff061b3c5a3] 2024-04-26T11:46:34.380 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f5295be822] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f52952e598] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f529530c17] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f529429d0b] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f52942a2ac] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f529412fad] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff061dd0e20] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 10: (DispatchQueue::entry()+0x51f) [0x7ff061dcdfdf] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff061ea0fc1] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff0608ba1ca] 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 13: clone() 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.381 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 0> 2024-04-26T11:46:34.083+0000 7ff057513700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: in thread 7ff057513700 thread_name:ms_dispatch 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff0608c4d20] 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2: gsignal() 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 3: abort() 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff061b3c437] 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff061b3c5a3] 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f5295be822] 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f52952e598] 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f529530c17] 2024-04-26T11:46:34.382 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f529429d0b] 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f52942a2ac] 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f529412fad] 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff061dd0e20] 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 13: (DispatchQueue::entry()+0x51f) [0x7ff061dcdfdf] 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff061ea0fc1] 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff0608ba1ca] 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 16: clone() 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: -2> 2024-04-26T11:46:34.081+0000 7ff057513700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff057513700 time 2024-04-26T11:46:34.081520+0000 2024-04-26T11:46:34.383 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff061b3c3dd] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff061b3c5a3] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f5295be822] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f52952e598] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f529530c17] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f529429d0b] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f52942a2ac] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f529412fad] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff061dd0e20] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 10: (DispatchQueue::entry()+0x51f) [0x7ff061dcdfdf] 2024-04-26T11:46:34.384 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff061ea0fc1] 2024-04-26T11:46:34.385 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff0608ba1ca] 2024-04-26T11:46:34.385 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 13: clone() 2024-04-26T11:46:34.385 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.385 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: -1> 2024-04-26T11:46:34.083+0000 7ff057513700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:34.385 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: in thread 7ff057513700 thread_name:ms_dispatch 2024-04-26T11:46:34.385 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.385 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:34.385 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff0608c4d20] 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2: gsignal() 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 3: abort() 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff061b3c437] 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff061b3c5a3] 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f5295be822] 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f52952e598] 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f529530c17] 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f529429d0b] 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f52942a2ac] 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f529412fad] 2024-04-26T11:46:34.386 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff061dd0e20] 2024-04-26T11:46:34.387 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 13: (DispatchQueue::entry()+0x51f) [0x7ff061dcdfdf] 2024-04-26T11:46:34.387 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff061ea0fc1] 2024-04-26T11:46:34.387 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff0608ba1ca] 2024-04-26T11:46:34.387 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 16: clone() 2024-04-26T11:46:34.387 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:34.387 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70370]: 2024-04-26T11:46:34.387 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 podman[70431]: 2024-04-26 11:46:34.139608912 +0000 UTC m=+0.019892704 container died fd3ce811f3a64710525752316ed18b942937be3a50d14cf96f08a6967ead9d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS) 2024-04-26T11:46:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:34 smithi196 ceph-mon[32572]: pgmap v527: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 2.7 MiB/s wr, 205 op/s 2024-04-26T11:46:34.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:34 smithi110 ceph-mon[28069]: pgmap v527: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 2.7 MiB/s wr, 205 op/s 2024-04-26T11:46:34.925 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 860.0 s, 717.9 tps, lat 33.950 ms stddev 43.444 2024-04-26T11:46:35.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 podman[70431]: 2024-04-26 11:46:34.93532975 +0000 UTC m=+0.815613526 container remove fd3ce811f3a64710525752316ed18b942937be3a50d14cf96f08a6967ead9d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T11:46:35.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:34 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:46:35.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:35 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T11:46:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:36 smithi196 ceph-mon[32572]: pgmap v528: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-04-26T11:46:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:36 smithi110 ceph-mon[28069]: pgmap v528: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-04-26T11:46:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:36 smithi193 ceph-mon[32782]: pgmap v528: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-04-26T11:46:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:37 smithi196 ceph-mon[32572]: osdmap e156: 12 total, 12 up, 12 in 2024-04-26T11:46:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:37 smithi110 ceph-mon[28069]: osdmap e156: 12 total, 12 up, 12 in 2024-04-26T11:46:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:37 smithi193 ceph-mon[32782]: osdmap e156: 12 total, 12 up, 12 in 2024-04-26T11:46:38.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:38 smithi193 ceph-mon[32782]: pgmap v530: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 3.1 MiB/s wr, 248 op/s 2024-04-26T11:46:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:38 smithi110 ceph-mon[28069]: pgmap v530: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 3.1 MiB/s wr, 248 op/s 2024-04-26T11:46:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:38 smithi196 ceph-mon[32572]: pgmap v530: 97 pgs: 97 active+clean; 3.1 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 3.1 MiB/s wr, 248 op/s 2024-04-26T11:46:39.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:46:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.021+0000 7f8dcde00640 1 -- 172.21.15.110:0/2831287778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dc810e260 msgr2=0x7f8dc8115e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.021+0000 7f8dcde00640 1 --2- 172.21.15.110:0/2831287778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dc810e260 0x7f8dc8115e30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009be0 tx=0x7f8dc002a6c0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.021+0000 7f8dcde00640 1 -- 172.21.15.110:0/2831287778 shutdown_connections 2024-04-26T11:46:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.021+0000 7f8dcde00640 1 --2- 172.21.15.110:0/2831287778 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dc810e260 0x7f8dc8115e30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.021+0000 7f8dcde00640 1 --2- 172.21.15.110:0/2831287778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8109b40 0x7f8dc810db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.021+0000 7f8dcde00640 1 --2- 172.21.15.110:0/2831287778 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dc8109190 0x7f8dc8109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.021+0000 7f8dcde00640 1 -- 172.21.15.110:0/2831287778 >> 172.21.15.110:0/2831287778 conn(0x7f8dc8076ec0 msgr2=0x7f8dc80792e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.021+0000 7f8dcde00640 1 -- 172.21.15.110:0/2831287778 shutdown_connections 2024-04-26T11:46:40.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.021+0000 7f8dcde00640 1 -- 172.21.15.110:0/2831287778 wait complete. 2024-04-26T11:46:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.022+0000 7f8dcde00640 1 Processor -- start 2024-04-26T11:46:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dcde00640 1 -- start start 2024-04-26T11:46:40.025 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dcde00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dc8109190 0x7f8dc819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dcde00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dc810e260 0x7f8dc819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dcde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81a3f60 0x7f8dc81a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dcde00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc81191d0 con 0x7f8dc81a3f60 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dcde00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8119050 con 0x7f8dc810e260 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dcde00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8119350 con 0x7f8dc8109190 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dc7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81a3f60 0x7f8dc81a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dbfe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dc810e260 0x7f8dc819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dc7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81a3f60 0x7f8dc81a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58600/0 (socket says 172.21.15.110:58600) 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dc7400640 1 -- 172.21.15.110:0/3554699285 learned_addr learned my addr 172.21.15.110:0/3554699285 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dbfe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dc810e260 0x7f8dc819fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:41866/0 (socket says 172.21.15.110:41866) 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.023+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dc8109190 0x7f8dc819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dc7400640 1 -- 172.21.15.110:0/3554699285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dc8109190 msgr2=0x7f8dc819f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:40.026 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dc7400640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dc8109190 0x7f8dc819f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dc7400640 1 -- 172.21.15.110:0/3554699285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dc810e260 msgr2=0x7f8dc819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dc7400640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dc810e260 0x7f8dc819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dc7400640 1 -- 172.21.15.110:0/3554699285 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc81a4a50 con 0x7f8dc81a3f60 2024-04-26T11:46:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dc7400640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81a3f60 0x7f8dc81a4410 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009b30 tx=0x7f8dc0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dcca00640 1 -- 172.21.15.110:0/3554699285 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0040020 con 0x7f8dc81a3f60 2024-04-26T11:46:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dcca00640 1 -- 172.21.15.110:0/3554699285 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dc00318f0 con 0x7f8dc81a3f60 2024-04-26T11:46:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dcca00640 1 -- 172.21.15.110:0/3554699285 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0036040 con 0x7f8dc81a3f60 2024-04-26T11:46:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dcde00640 1 -- 172.21.15.110:0/3554699285 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc81a4ce0 con 0x7f8dc81a3f60 2024-04-26T11:46:40.027 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.024+0000 7f8dcde00640 1 -- 172.21.15.110:0/3554699285 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc81ac500 con 0x7f8dc81a3f60 2024-04-26T11:46:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dd0b7b740 1 Processor -- start 2024-04-26T11:46:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dcca00640 1 -- 172.21.15.110:0/3554699285 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f8dc0043020 con 0x7f8dc81a3f60 2024-04-26T11:46:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dd0b7b740 1 -- start start 2024-04-26T11:46:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de006013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55de00559380 con 0x55de005f3dd0 2024-04-26T11:46:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55de004f5c30 con 0x55de005fefb0 2024-04-26T11:46:40.030 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55de00555340 con 0x55de005f46f0 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.028+0000 7f8dbfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:49192/0 (socket says 172.21.15.110:49192) 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dc6a00640 1 -- 172.21.15.110:0/2322242558 learned_addr learned my addr 172.21.15.110:0/2322242558 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/2322242558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de006013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dc6a00640 1 -- 172.21.15.110:0/2322242558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 msgr2=0x55de006013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/2322242558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de006013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dc6a00640 1 -- 172.21.15.110:0/2322242558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 msgr2=0x55de005f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/2322242558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dc6a00640 1 -- 172.21.15.110:0/2322242558 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de00517940 con 0x55de005f46f0 2024-04-26T11:46:40.031 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/2322242558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/2322242558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fea70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009d20 tx=0x7f8db8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f460d5a1315331fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.029+0000 7f8dcca00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8dac0a3e40 0x7f8dac0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.030+0000 7f8db7e00640 1 -- 172.21.15.110:0/2322242558 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db801e070 con 0x55de005f46f0 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.030+0000 7f8dcca00640 1 -- 172.21.15.110:0/3554699285 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 12601+0+0 (secure 0 0 0) 0x7f8dc00f2340 con 0x7f8dc81a3f60 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.030+0000 7f8db7e00640 1 -- 172.21.15.110:0/2322242558 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8db8019ae0 con 0x55de005f46f0 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.030+0000 7f8db7e00640 1 -- 172.21.15.110:0/2322242558 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db800ea80 con 0x55de005f46f0 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.030+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8dac0a3e40 0x7f8dac0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.030+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2322242558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 msgr2=0x55de005fea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.030+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8dac0a3e40 0x7f8dac0a6300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009fd0 tx=0x7f8db0009620 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.030+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2322242558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fea70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009d20 tx=0x7f8db8011810 comp rx=0 tx=0).stop 2024-04-26T11:46:40.035 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.031+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2322242558 shutdown_connections 2024-04-26T11:46:40.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.031+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2322242558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de006013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.031+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2322242558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fea70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.031+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2322242558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.031+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2322242558 >> 172.21.15.110:0/2322242558 conn(0x55de005f02e0 msgr2=0x55de005f06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.031+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2322242558 shutdown_connections 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.031+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2322242558 wait complete. 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.031+0000 7f8dd0b7b740 1 -- start start 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.031+0000 7f8dd0b7b740 1 Processor -- start 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55de00601be0 con 0x55de005f3dd0 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55de004e0c60 con 0x55de005fefb0 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55de00601d60 con 0x55de005f46f0 2024-04-26T11:46:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dd0b7b740 10 client.0 _ll_register_callbacks cb 0x55de0050ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dbfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58622/0 (socket says 172.21.15.110:58622) 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dc6a00640 1 -- 172.21.15.110:0/2068823219 learned_addr learned my addr 172.21.15.110:0/2068823219 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.032+0000 7f8dc7400640 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8dc6a00640 1 -- 172.21.15.110:0/2068823219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 msgr2=0x55de005fc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8dc6a00640 1 -- 172.21.15.110:0/2068823219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 msgr2=0x55de005fc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005fc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8dc6a00640 1 -- 172.21.15.110:0/2068823219 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de004ef510 con 0x55de005f3dd0 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8dc7400640 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fbf40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8db800e600 tx=0x7f8db800e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d03656e9fe48518 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8db4c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:46:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8db4c00640 1 -- 172.21.15.110:0/2068823219 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db801e040 con 0x55de005f3dd0 2024-04-26T11:46:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8db4c00640 1 -- 172.21.15.110:0/2068823219 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 12601+0+0 (secure 0 0 0) 0x7f8db8004440 con 0x55de005f3dd0 2024-04-26T11:46:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.033+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2068823219 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8db8019ae0 con 0x55de005f3dd0 2024-04-26T11:46:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8db4c00640 1 -- 172.21.15.110:0/2068823219 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=278) ==== 24+0+0 (secure 0 0 0) 0x7f8db8031050 con 0x55de005f3dd0 2024-04-26T11:46:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8dd0b7b740 10 client.16194 fetch_fsmap learned FSMap version 278 2024-04-26T11:46:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2068823219 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=278,monmap=4+}) -- 0x55de0026b210 con 0x55de005f3dd0 2024-04-26T11:46:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8db4c00640 1 -- 172.21.15.110:0/2068823219 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8db8019ae0 con 0x55de005f3dd0 2024-04-26T11:46:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8db4c00640 1 -- 172.21.15.110:0/2068823219 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 278) ==== 4119+0+0 (secure 0 0 0) 0x7f8db800e800 con 0x55de005f3dd0 2024-04-26T11:46:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8dd0b7b740 10 client.16194 fetch_fsmap finished waiting for FSMap version 278 2024-04-26T11:46:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8dd0b7b740 10 client.16194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:46:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8dd0b7b740 20 client.16194 populate_metadata read hostname 'smithi110' 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55de0060f060 0x55de006114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8dd0b7b740 4 client.16194 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.034+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2068823219 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de00566f90 con 0x55de0060f060 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.035+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55de0060f060 0x55de006114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.035+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55de0060f060 0x55de006114b0 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9105d94069df2e72 server_cookie=2331ec71386cd310 in_seq=0 out_seq=0 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.035+0000 7f8db4c00640 10 client.16194 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8db4c00640 1 -- 172.21.15.110:0/2068823219 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55de00566f90 con 0x55de0060f060 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8db4c00640 10 client.16194 handle_command_reply: tid=0 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 client.16194 shutdown 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2068823219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 msgr2=0x55de005fbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fbf40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8db800e600 tx=0x7f8db800e4f0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2068823219 shutdown_connections 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55de0060f060 0x55de006114b0 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de005fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/2068823219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fbf40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8db4c00640 0 client.16194 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2068823219 >> 172.21.15.110:0/2068823219 conn(0x55de005f02e0 msgr2=0x55de005f6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.036+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2068823219 shutdown_connections 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.037+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/2068823219 wait complete. 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.037+0000 7f8dd0b7b740 20 client.16194 trim_cache size 0 max 16384 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.053+0000 7f8dd0b7b740 1 Processor -- start 2024-04-26T11:46:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.053+0000 7f8dd0b7b740 1 -- start start 2024-04-26T11:46:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.053+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.053+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de0060aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.053+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.053+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc81b7410 con 0x55de005f3dd0 2024-04-26T11:46:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.053+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc81b58a0 con 0x55de005fefb0 2024-04-26T11:46:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.053+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc81b6d40 con 0x55de005f46f0 2024-04-26T11:46:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc7400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005f5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:41884/0 (socket says 172.21.15.110:41884) 2024-04-26T11:46:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fe670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58630/0 (socket says 172.21.15.110:58630) 2024-04-26T11:46:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc7400640 1 -- 172.21.15.110:0/4085054966 learned_addr learned my addr 172.21.15.110:0/4085054966 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/4085054966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de0060aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc7400640 1 -- 172.21.15.110:0/4085054966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 msgr2=0x55de0060aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc7400640 1 --2- 172.21.15.110:0/4085054966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de0060aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc7400640 1 -- 172.21.15.110:0/4085054966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 msgr2=0x55de005fe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc7400640 1 --2- 172.21.15.110:0/4085054966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fe670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc7400640 1 -- 172.21.15.110:0/4085054966 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de00337620 con 0x55de005fefb0 2024-04-26T11:46:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/4085054966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:46:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.054+0000 7f8dc7400640 1 --2- 172.21.15.110:0/4085054966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005f5e90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00bd220 tx=0x7f8dc00bda50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10460f988e3f751 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8db7400640 1 -- 172.21.15.110:0/4085054966 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00d6070 con 0x55de005fefb0 2024-04-26T11:46:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8db7400640 1 -- 172.21.15.110:0/4085054966 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dc00c5f00 con 0x55de005fefb0 2024-04-26T11:46:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8db7400640 1 -- 172.21.15.110:0/4085054966 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00b9900 con 0x55de005fefb0 2024-04-26T11:46:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/4085054966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 msgr2=0x55de005f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/4085054966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005f5e90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00bd220 tx=0x7f8dc00bda50 comp rx=0 tx=0).stop 2024-04-26T11:46:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/4085054966 shutdown_connections 2024-04-26T11:46:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/4085054966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005fefb0 0x55de005f5e90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/4085054966 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005f46f0 0x55de0060aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/4085054966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.055+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/4085054966 >> 172.21.15.110:0/4085054966 conn(0x55de005f02e0 msgr2=0x55de005f5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.056+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/4085054966 shutdown_connections 2024-04-26T11:46:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.056+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/4085054966 wait complete. 2024-04-26T11:46:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.056+0000 7f8dd0b7b740 1 -- start start 2024-04-26T11:46:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.056+0000 7f8dd0b7b740 1 Processor -- start 2024-04-26T11:46:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005f46f0 0x55de005f9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dd0b7b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005fefb0 0x55de005f9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc81b6640 con 0x55de005f3dd0 2024-04-26T11:46:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc81b5f70 con 0x55de005f46f0 2024-04-26T11:46:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dd0b7b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55de00566f90 con 0x55de005fefb0 2024-04-26T11:46:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dd0b7b740 10 client.0 _ll_register_callbacks cb 0x7f8db801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:46:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58646/0 (socket says 172.21.15.110:58646) 2024-04-26T11:46:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc6a00640 1 -- 172.21.15.110:0/3750428191 learned_addr learned my addr 172.21.15.110:0/3750428191 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:46:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005f46f0 0x55de005f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc7400640 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005fefb0 0x55de005f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc6a00640 1 -- 172.21.15.110:0/3750428191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005fefb0 msgr2=0x55de005f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005fefb0 0x55de005f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc6a00640 1 -- 172.21.15.110:0/3750428191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005f46f0 msgr2=0x55de005f9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:46:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005f46f0 0x55de005f9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc6a00640 1 -- 172.21.15.110:0/3750428191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de00513cb0 con 0x55de005f3dd0 2024-04-26T11:46:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.057+0000 7f8dc7400640 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005fefb0 0x55de005f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:46:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.058+0000 7f8dc6a00640 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f8cd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8db800eba0 tx=0x7f8db800efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa10b5fdb623660 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:46:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.058+0000 7f8db4c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:46:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.058+0000 7f8db4c00640 1 -- 172.21.15.110:0/3750428191 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db801e040 con 0x55de005f3dd0 2024-04-26T11:46:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.058+0000 7f8db4c00640 1 -- 172.21.15.110:0/3750428191 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 12601+0+0 (secure 0 0 0) 0x7f8db80054b0 con 0x55de005f3dd0 2024-04-26T11:46:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.058+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/3750428191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dc00c5f00 con 0x55de005f3dd0 2024-04-26T11:46:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.058+0000 7f8db4c00640 1 -- 172.21.15.110:0/3750428191 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=278) ==== 24+0+0 (secure 0 0 0) 0x7f8db8005c50 con 0x55de005f3dd0 2024-04-26T11:46:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.058+0000 7f8dd0b7b740 10 client.16200 fetch_fsmap learned FSMap version 278 2024-04-26T11:46:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.058+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/3750428191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=278,monmap=4+}) -- 0x55de006757d0 con 0x55de005f3dd0 2024-04-26T11:46:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.058+0000 7f8db4c00640 1 -- 172.21.15.110:0/3750428191 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dc00c5f00 con 0x55de005f3dd0 2024-04-26T11:46:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.059+0000 7f8db4c00640 1 -- 172.21.15.110:0/3750428191 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 278) ==== 4119+0+0 (secure 0 0 0) 0x7f8db8034030 con 0x55de005f3dd0 2024-04-26T11:46:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.059+0000 7f8dd0b7b740 10 client.16200 fetch_fsmap finished waiting for FSMap version 278 2024-04-26T11:46:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.059+0000 7f8dd0b7b740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:46:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.059+0000 7f8dd0b7b740 20 client.16200 populate_metadata read hostname 'smithi110' 2024-04-26T11:46:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.059+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55de00675ee0 0x55de00678300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:46:40.083 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.059+0000 7f8dd0b7b740 4 client.16200 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:46:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.059+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/3750428191 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de00560e00 con 0x55de00675ee0 2024-04-26T11:46:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.059+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55de00675ee0 0x55de00678300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:46:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.060+0000 7f8dbfe00640 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55de00675ee0 0x55de00678300 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd7acd651c9e25fc server_cookie=ebf1c10ae9ae3256 in_seq=0 out_seq=0 2024-04-26T11:46:40.084 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:40.060+0000 7f8db4c00640 10 client.16200 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:46:40.546 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:40 smithi110 ceph-mon[28069]: pgmap v531: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 3.4 MiB/s wr, 291 op/s 2024-04-26T11:46:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:40 smithi193 ceph-mon[32782]: pgmap v531: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 3.4 MiB/s wr, 291 op/s 2024-04-26T11:46:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:40 smithi196 ceph-mon[32572]: pgmap v531: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 3.4 MiB/s wr, 291 op/s 2024-04-26T11:46:40.917 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:40 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:46:40.917 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:40 smithi110 systemd[1]: Stopped Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:46:40.917 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:40 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 2.850s CPU time. 2024-04-26T11:46:40.917 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:40 smithi110 systemd[1]: Starting Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:46:41.196 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:40 smithi110 podman[95410]: 2024-04-26 11:46:40.823455998 +0000 UTC m=+0.035836168 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:46:41.196 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:40 smithi110 podman[95410]: 2024-04-26 11:46:40.950750568 +0000 UTC m=+0.163130773 container create d3d2198715f95dbdb51ea32f269022f05ac6d775e1c6189138e78f27837d6a31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-26T11:46:41.196 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:41 smithi110 podman[95410]: 2024-04-26 11:46:41.195170189 +0000 UTC m=+0.407550369 container init d3d2198715f95dbdb51ea32f269022f05ac6d775e1c6189138e78f27837d6a31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:46:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-mon[28069]: daemon mds.a restarted 2024-04-26T11:46:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:46:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-mon[28069]: osdmap e157: 12 total, 12 up, 12 in 2024-04-26T11:46:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:boot 2024-04-26T11:46:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-mon[28069]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:46:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:46:41.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:46:41.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:replay} 2 up:standby-replay 2024-04-26T11:46:41.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:41 smithi110 podman[95410]: 2024-04-26 11:46:41.202566106 +0000 UTC m=+0.414946274 container start d3d2198715f95dbdb51ea32f269022f05ac6d775e1c6189138e78f27837d6a31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T11:46:41.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-mds[95428]: -- 172.21.15.110:0/1473950006 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ebae35a40 con 0x560ebae09000 2024-04-26T11:46:41.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:41 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: starting mds.a at 2024-04-26T11:46:41.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:41 smithi110 bash[95410]: d3d2198715f95dbdb51ea32f269022f05ac6d775e1c6189138e78f27837d6a31 2024-04-26T11:46:41.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:41 smithi110 systemd[1]: Started Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:46:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:41 smithi193 ceph-mon[32782]: daemon mds.a restarted 2024-04-26T11:46:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:41 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:46:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:41 smithi193 ceph-mon[32782]: osdmap e157: 12 total, 12 up, 12 in 2024-04-26T11:46:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:41 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:boot 2024-04-26T11:46:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:41 smithi193 ceph-mon[32782]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:46:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:46:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:41 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:46:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:41 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:replay} 2 up:standby-replay 2024-04-26T11:46:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:41 smithi196 ceph-mon[32572]: daemon mds.a restarted 2024-04-26T11:46:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:41 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:46:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:41 smithi196 ceph-mon[32572]: osdmap e157: 12 total, 12 up, 12 in 2024-04-26T11:46:41.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:41 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:boot 2024-04-26T11:46:41.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:41 smithi196 ceph-mon[32572]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:46:41.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:46:41.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:41 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:46:41.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:41 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:replay} 2 up:standby-replay 2024-04-26T11:46:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:42 smithi110 ceph-mon[28069]: pgmap v532: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 3.4 MiB/s wr, 291 op/s 2024-04-26T11:46:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:42 smithi193 ceph-mon[32782]: pgmap v532: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 3.4 MiB/s wr, 291 op/s 2024-04-26T11:46:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:42 smithi196 ceph-mon[32572]: pgmap v532: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 3.4 MiB/s wr, 291 op/s 2024-04-26T11:46:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:43 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:resolve 2024-04-26T11:46:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:43 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:resolve} 2 up:standby-replay 2024-04-26T11:46:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:43 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:resolve 2024-04-26T11:46:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:43 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:resolve} 2 up:standby-replay 2024-04-26T11:46:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:43 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:resolve 2024-04-26T11:46:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:43 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:resolve} 2 up:standby-replay 2024-04-26T11:46:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:44 smithi193 ceph-mon[32782]: pgmap v534: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-04-26T11:46:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:46:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:44 smithi193 ceph-mon[32782]: osdmap e158: 12 total, 12 up, 12 in 2024-04-26T11:46:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:44 smithi196 ceph-mon[32572]: pgmap v534: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-04-26T11:46:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:46:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:44 smithi196 ceph-mon[32572]: osdmap e158: 12 total, 12 up, 12 in 2024-04-26T11:46:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:44 smithi110 ceph-mon[28069]: pgmap v534: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.1 MiB/s wr, 140 op/s 2024-04-26T11:46:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:46:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:44 smithi110 ceph-mon[28069]: osdmap e158: 12 total, 12 up, 12 in 2024-04-26T11:46:44.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 870.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:46:45.597 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 5. 2024-04-26T11:46:45.597 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 systemd[1]: Stopped Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:46:45.597 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 systemd[1]: Starting Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:46:45.597 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:46:45.597 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:46:45.597 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:46:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:46:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:46:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:46:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:46:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:46:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:46:45.872 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 podman[70658]: 2024-04-26 11:46:45.499059199 +0000 UTC m=+0.017870048 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:46:45.872 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 podman[70658]: 2024-04-26 11:46:45.6367327 +0000 UTC m=+0.155543540 container create 061e96f206980fda0750981d1aeecbc66ab5d8887bbf4f64c203253d57ed0a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T11:46:46.169 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 podman[70658]: 2024-04-26 11:46:45.881502127 +0000 UTC m=+0.400312967 container init 061e96f206980fda0750981d1aeecbc66ab5d8887bbf4f64c203253d57ed0a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T11:46:46.169 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 podman[70658]: 2024-04-26 11:46:45.88412876 +0000 UTC m=+0.402939601 container start 061e96f206980fda0750981d1aeecbc66ab5d8887bbf4f64c203253d57ed0a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-26T11:46:46.170 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 ceph-mds[70679]: -- 172.21.15.193:0/892038468 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1c34fda40 con 0x55e1c34d0c00 2024-04-26T11:46:46.170 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: starting mds.k at 2024-04-26T11:46:46.170 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 bash[70658]: 061e96f206980fda0750981d1aeecbc66ab5d8887bbf4f64c203253d57ed0a33 2024-04-26T11:46:46.170 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:46:45 smithi193 systemd[1]: Started Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:46:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:46 smithi193 ceph-mon[32782]: pgmap v536: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 164 op/s 2024-04-26T11:46:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:46 smithi193 ceph-mon[32782]: pgmap v537: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 878 KiB/s wr, 116 op/s 2024-04-26T11:46:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:46 smithi193 ceph-mon[32782]: daemon mds.k restarted 2024-04-26T11:46:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:46:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:46 smithi193 ceph-mon[32782]: osdmap e159: 12 total, 12 up, 12 in 2024-04-26T11:46:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:46 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:boot 2024-04-26T11:46:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:46 smithi193 ceph-mon[32782]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-04-26T11:46:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:46 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:46:46.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:46 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:46 smithi196 ceph-mon[32572]: pgmap v536: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 164 op/s 2024-04-26T11:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:46 smithi196 ceph-mon[32572]: pgmap v537: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 878 KiB/s wr, 116 op/s 2024-04-26T11:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:46 smithi196 ceph-mon[32572]: daemon mds.k restarted 2024-04-26T11:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:46 smithi196 ceph-mon[32572]: osdmap e159: 12 total, 12 up, 12 in 2024-04-26T11:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:46 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:boot 2024-04-26T11:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:46 smithi196 ceph-mon[32572]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-04-26T11:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:46 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:46 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:46 smithi110 ceph-mon[28069]: pgmap v536: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 164 op/s 2024-04-26T11:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:46 smithi110 ceph-mon[28069]: pgmap v537: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 878 KiB/s wr, 116 op/s 2024-04-26T11:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:46 smithi110 ceph-mon[28069]: daemon mds.k restarted 2024-04-26T11:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T11:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:46 smithi110 ceph-mon[28069]: osdmap e159: 12 total, 12 up, 12 in 2024-04-26T11:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:46 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:boot 2024-04-26T11:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:46 smithi110 ceph-mon[28069]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-04-26T11:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:46 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:46 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:48.196 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:47 smithi110 ceph-mon[28069]: pgmap v539: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 893 KiB/s wr, 118 op/s 2024-04-26T11:46:48.197 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:47 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:resolve 2024-04-26T11:46:48.197 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:47 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:47 smithi196 ceph-mon[32572]: pgmap v539: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 893 KiB/s wr, 118 op/s 2024-04-26T11:46:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:47 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:resolve 2024-04-26T11:46:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:47 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:47 smithi193 ceph-mon[32782]: pgmap v539: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 893 KiB/s wr, 118 op/s 2024-04-26T11:46:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:47 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:resolve 2024-04-26T11:46:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:47 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.993+0000 7f8db4c00640 1 -- 172.21.15.110:0/3750428191 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de00560e00 con 0x55de00675ee0 2024-04-26T11:46:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.993+0000 7f8db4c00640 10 client.16200 handle_command_reply: tid=0 2024-04-26T11:46:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.993+0000 7f8dd0b7b740 1 client.16200 shutdown 2024-04-26T11:46:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.994+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/3750428191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 msgr2=0x55de005f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.994+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f8cd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8db800eba0 tx=0x7f8db800efa0 comp rx=0 tx=0).stop 2024-04-26T11:46:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.994+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/3750428191 shutdown_connections 2024-04-26T11:46:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.994+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55de00675ee0 0x55de00678300 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.994+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55de005fefb0 0x55de005f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.994+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55de005f46f0 0x55de005f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:48.995 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.994+0000 7f8dd0b7b740 1 --2- 172.21.15.110:0/3750428191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55de005f3dd0 0x55de005f8cd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.994+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/3750428191 >> 172.21.15.110:0/3750428191 conn(0x55de005f02e0 msgr2=0x55de005fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.994+0000 7f8db4c00640 0 client.16200 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:46:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.995+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/3750428191 shutdown_connections 2024-04-26T11:46:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.995+0000 7f8dd0b7b740 1 -- 172.21.15.110:0/3750428191 wait complete. 2024-04-26T11:46:48.996 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.995+0000 7f8dd0b7b740 20 client.16200 trim_cache size 0 max 16384 2024-04-26T11:46:48.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:46:48.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:46:48.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:46:48.997 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:46:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 -- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8dac0a3e40 msgr2=0x7f8dac0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8dac0a3e40 0x7f8dac0a6300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009fd0 tx=0x7f8db0009620 comp rx=0 tx=0).stop 2024-04-26T11:46:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 -- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81a3f60 msgr2=0x7f8dc81a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:46:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81a3f60 0x7f8dc81a4410 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009b30 tx=0x7f8dc0003c10 comp rx=0 tx=0).stop 2024-04-26T11:46:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 -- 172.21.15.110:0/3554699285 shutdown_connections 2024-04-26T11:46:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f8dac0a3e40 0x7f8dac0a6300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:48.998 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc81a3f60 0x7f8dc81a4410 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:48.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dc810e260 0x7f8dc819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:48.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 --2- 172.21.15.110:0/3554699285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dc8109190 0x7f8dc819f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:46:48.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.996+0000 7f8dcde00640 1 -- 172.21.15.110:0/3554699285 >> 172.21.15.110:0/3554699285 conn(0x7f8dc8076ec0 msgr2=0x7f8dc8079200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:46:48.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.997+0000 7f8dcde00640 1 -- 172.21.15.110:0/3554699285 shutdown_connections 2024-04-26T11:46:48.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:46:48.997+0000 7f8dcde00640 1 -- 172.21.15.110:0/3554699285 wait complete. 2024-04-26T11:46:49.227 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:48 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:46:49.228 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:48 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:reconnect 2024-04-26T11:46:49.228 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:48 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:reconnect 2024-04-26T11:46:49.228 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:48 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:49.228 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:48 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:46:49.229 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:48 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0289995 2024-04-26T11:46:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:48 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:46:49.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:48 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:reconnect 2024-04-26T11:46:49.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:48 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:reconnect 2024-04-26T11:46:49.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:48 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:49.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:48 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:46:49.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:48 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0289995 2024-04-26T11:46:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:48 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:46:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:48 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:reconnect 2024-04-26T11:46:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:48 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:reconnect 2024-04-26T11:46:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:48 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:48 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:46:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:48 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0289995 2024-04-26T11:46:49.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:46:50.123 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:49 smithi110 ceph-mon[28069]: pgmap v540: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 924 KiB/s wr, 120 op/s 2024-04-26T11:46:50.123 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:49 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:rejoin 2024-04-26T11:46:50.123 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:49 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:rejoin 2024-04-26T11:46:50.124 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:49 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:50.124 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:49 smithi110 ceph-mon[28069]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:46:50.124 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:49 smithi110 ceph-mon[28069]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T11:46:50.127 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ffab0600700 time 2024-04-26T11:46:50.032263+0000 2024-04-26T11:46:50.127 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:50.127 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:50.127 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ffabbfe73dd] 2024-04-26T11:46:50.127 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ffabbfe75a3] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e94bd7822] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e94b47598] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e94b49c17] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e94a42d0b] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e94a432ac] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e94a2bfad] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ffabc27be20] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 10: (DispatchQueue::entry()+0x51f) [0x7ffabc278fdf] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffabc34bfc1] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ffabad651ca] 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 13: clone() 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.033+0000 7ffab0600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ffab0600700 time 2024-04-26T11:46:50.032263+0000 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.128 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ffabbfe73dd] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ffabbfe75a3] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e94bd7822] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e94b47598] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e94b49c17] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e94a42d0b] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e94a432ac] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e94a2bfad] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ffabc27be20] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 10: (DispatchQueue::entry()+0x51f) [0x7ffabc278fdf] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffabc34bfc1] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ffabad651ca] 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 13: clone() 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: *** Caught signal (Aborted) ** 2024-04-26T11:46:50.129 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: in thread 7ffab0600700 thread_name:ms_dispatch 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ffabad6fd20] 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2: gsignal() 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 3: abort() 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ffabbfe7437] 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ffabbfe75a3] 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e94bd7822] 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e94b47598] 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e94b49c17] 2024-04-26T11:46:50.130 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e94a42d0b] 2024-04-26T11:46:50.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e94a432ac] 2024-04-26T11:46:50.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e94a2bfad] 2024-04-26T11:46:50.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ffabc27be20] 2024-04-26T11:46:50.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 13: (DispatchQueue::entry()+0x51f) [0x7ffabc278fdf] 2024-04-26T11:46:50.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffabc34bfc1] 2024-04-26T11:46:50.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ffabad651ca] 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 16: clone() 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.036+0000 7ffab0600700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: in thread 7ffab0600700 thread_name:ms_dispatch 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ffabad6fd20] 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2: gsignal() 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 3: abort() 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ffabbfe7437] 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ffabbfe75a3] 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e94bd7822] 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e94b47598] 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e94b49c17] 2024-04-26T11:46:50.132 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e94a42d0b] 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e94a432ac] 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e94a2bfad] 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ffabc27be20] 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 13: (DispatchQueue::entry()+0x51f) [0x7ffabc278fdf] 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffabc34bfc1] 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ffabad651ca] 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 16: clone() 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: -1> 2024-04-26T11:46:50.033+0000 7ffab0600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ffab0600700 time 2024-04-26T11:46:50.032263+0000 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:50.133 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ffabbfe73dd] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ffabbfe75a3] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e94bd7822] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e94b47598] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e94b49c17] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e94a42d0b] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e94a432ac] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e94a2bfad] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ffabc27be20] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 10: (DispatchQueue::entry()+0x51f) [0x7ffabc278fdf] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffabc34bfc1] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ffabad651ca] 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 13: clone() 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.134 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 0> 2024-04-26T11:46:50.036+0000 7ffab0600700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: in thread 7ffab0600700 thread_name:ms_dispatch 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ffabad6fd20] 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2: gsignal() 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 3: abort() 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ffabbfe7437] 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ffabbfe75a3] 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e94bd7822] 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e94b47598] 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e94b49c17] 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e94a42d0b] 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e94a432ac] 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e94a2bfad] 2024-04-26T11:46:50.135 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ffabc27be20] 2024-04-26T11:46:50.136 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 13: (DispatchQueue::entry()+0x51f) [0x7ffabc278fdf] 2024-04-26T11:46:50.136 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffabc34bfc1] 2024-04-26T11:46:50.136 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ffabad651ca] 2024-04-26T11:46:50.136 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 16: clone() 2024-04-26T11:46:50.136 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:50.136 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.136 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: -1> 2024-04-26T11:46:50.033+0000 7ffab0600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ffab0600700 time 2024-04-26T11:46:50.032263+0000 2024-04-26T11:46:50.136 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:50.136 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ffabbfe73dd] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ffabbfe75a3] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e94bd7822] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e94b47598] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e94b49c17] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e94a42d0b] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e94a432ac] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e94a2bfad] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ffabc27be20] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 10: (DispatchQueue::entry()+0x51f) [0x7ffabc278fdf] 2024-04-26T11:46:50.137 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffabc34bfc1] 2024-04-26T11:46:50.138 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ffabad651ca] 2024-04-26T11:46:50.138 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 13: clone() 2024-04-26T11:46:50.138 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.138 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 0> 2024-04-26T11:46:50.036+0000 7ffab0600700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:50.138 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: in thread 7ffab0600700 thread_name:ms_dispatch 2024-04-26T11:46:50.138 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ffabad6fd20] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2: gsignal() 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 3: abort() 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ffabbfe7437] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ffabbfe75a3] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e94bd7822] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e94b47598] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e94b49c17] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e94a42d0b] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e94a432ac] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e94a2bfad] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ffabc27be20] 2024-04-26T11:46:50.139 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 13: (DispatchQueue::entry()+0x51f) [0x7ffabc278fdf] 2024-04-26T11:46:50.140 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ffabc34bfc1] 2024-04-26T11:46:50.140 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ffabad651ca] 2024-04-26T11:46:50.140 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 16: clone() 2024-04-26T11:46:50.140 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:50.140 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95424]: 2024-04-26T11:46:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:49 smithi196 ceph-mon[32572]: pgmap v540: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 924 KiB/s wr, 120 op/s 2024-04-26T11:46:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:49 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:rejoin 2024-04-26T11:46:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:49 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:rejoin 2024-04-26T11:46:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:49 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:49 smithi196 ceph-mon[32572]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:46:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:49 smithi196 ceph-mon[32572]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T11:46:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:49 smithi193 ceph-mon[32782]: pgmap v540: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 924 KiB/s wr, 120 op/s 2024-04-26T11:46:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:49 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:rejoin 2024-04-26T11:46:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:49 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:rejoin 2024-04-26T11:46:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:49 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:49 smithi193 ceph-mon[32782]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:46:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:49 smithi193 ceph-mon[32782]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T11:46:50.443 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:50 smithi110 podman[95605]: 2024-04-26 11:46:50.191704673 +0000 UTC m=+0.053367241 container died d3d2198715f95dbdb51ea32f269022f05ac6d775e1c6189138e78f27837d6a31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:46:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:50 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:46:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:50 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:active 2024-04-26T11:46:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:50 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:active 2024-04-26T11:46:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:50 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:50 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:46:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:active 2024-04-26T11:46:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:active 2024-04-26T11:46:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:50 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:51.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:51 smithi110 podman[95605]: 2024-04-26 11:46:51.035332358 +0000 UTC m=+0.896994949 container remove d3d2198715f95dbdb51ea32f269022f05ac6d775e1c6189138e78f27837d6a31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS) 2024-04-26T11:46:51.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:51 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:46:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:50 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:46:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:50 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2538258107,v1:172.21.15.110:6835/2538258107] up:active 2024-04-26T11:46:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:50 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6838/3227547559,v1:172.21.15.110:6839/3227547559] up:active 2024-04-26T11:46:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:50 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 1 up:standby 2024-04-26T11:46:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:50 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:51.791 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:51 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-04-26T11:46:51.792 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:46:51 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 1.820s CPU time. 2024-04-26T11:46:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:51 smithi196 ceph-mon[32572]: pgmap v541: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 613 KiB/s wr, 80 op/s 2024-04-26T11:46:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:51 smithi110 ceph-mon[28069]: pgmap v541: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 613 KiB/s wr, 80 op/s 2024-04-26T11:46:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:51 smithi193 ceph-mon[32782]: pgmap v541: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 613 KiB/s wr, 80 op/s 2024-04-26T11:46:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:54 smithi196 ceph-mon[32572]: pgmap v542: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 779 KiB/s wr, 110 op/s 2024-04-26T11:46:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:54 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:54 smithi110 ceph-mon[28069]: pgmap v542: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 779 KiB/s wr, 110 op/s 2024-04-26T11:46:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:54 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:54 smithi193 ceph-mon[32782]: pgmap v542: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 779 KiB/s wr, 110 op/s 2024-04-26T11:46:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:54 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:46:54.925 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 880.0 s, 411.7 tps, lat 960.362 ms stddev 4075.250 2024-04-26T11:46:55.293 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4747800700 time 2024-04-26T11:46:55.017581+0000 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f47531043dd] 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47531045a3] 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561e8e375822] 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561e8e2e5598] 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561e8e2e7c17] 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561e8e1e0d0b] 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561e8e1e12ac] 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561e8e1c9fad] 2024-04-26T11:46:55.294 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f4753398e20] 2024-04-26T11:46:55.295 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 10: (DispatchQueue::entry()+0x51f) [0x7f4753395fdf] 2024-04-26T11:46:55.295 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4753468fc1] 2024-04-26T11:46:55.295 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f4751e821ca] 2024-04-26T11:46:55.295 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 13: clone() 2024-04-26T11:46:55.295 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.020+0000 7f4747800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4747800700 time 2024-04-26T11:46:55.017581+0000 2024-04-26T11:46:55.295 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:55.295 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.295 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:55.295 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f47531043dd] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47531045a3] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561e8e375822] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561e8e2e5598] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561e8e2e7c17] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561e8e1e0d0b] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561e8e1e12ac] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561e8e1c9fad] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f4753398e20] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 10: (DispatchQueue::entry()+0x51f) [0x7f4753395fdf] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4753468fc1] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f4751e821ca] 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 13: clone() 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: *** Caught signal (Aborted) ** 2024-04-26T11:46:55.296 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: in thread 7f4747800700 thread_name:ms_dispatch 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4751e8cd20] 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2: gsignal() 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 3: abort() 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4753104437] 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47531045a3] 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561e8e375822] 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561e8e2e5598] 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561e8e2e7c17] 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561e8e1e0d0b] 2024-04-26T11:46:55.297 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561e8e1e12ac] 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561e8e1c9fad] 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f4753398e20] 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 13: (DispatchQueue::entry()+0x51f) [0x7f4753395fdf] 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4753468fc1] 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4751e821ca] 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 16: clone() 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.025+0000 7f4747800700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: in thread 7f4747800700 thread_name:ms_dispatch 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4751e8cd20] 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2: gsignal() 2024-04-26T11:46:55.298 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 3: abort() 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4753104437] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47531045a3] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561e8e375822] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561e8e2e5598] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561e8e2e7c17] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561e8e1e0d0b] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561e8e1e12ac] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561e8e1c9fad] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f4753398e20] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 13: (DispatchQueue::entry()+0x51f) [0x7f4753395fdf] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4753468fc1] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4751e821ca] 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 16: clone() 2024-04-26T11:46:55.299 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:55.300 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.300 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: -1> 2024-04-26T11:46:55.020+0000 7f4747800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4747800700 time 2024-04-26T11:46:55.017581+0000 2024-04-26T11:46:55.300 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:55.300 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.300 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:55.300 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f47531043dd] 2024-04-26T11:46:55.300 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47531045a3] 2024-04-26T11:46:55.300 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561e8e375822] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561e8e2e5598] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561e8e2e7c17] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561e8e1e0d0b] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561e8e1e12ac] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561e8e1c9fad] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f4753398e20] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 10: (DispatchQueue::entry()+0x51f) [0x7f4753395fdf] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4753468fc1] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f4751e821ca] 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 13: clone() 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 0> 2024-04-26T11:46:55.025+0000 7f4747800700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: in thread 7f4747800700 thread_name:ms_dispatch 2024-04-26T11:46:55.301 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4751e8cd20] 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2: gsignal() 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 3: abort() 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4753104437] 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47531045a3] 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561e8e375822] 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561e8e2e5598] 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561e8e2e7c17] 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561e8e1e0d0b] 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561e8e1e12ac] 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561e8e1c9fad] 2024-04-26T11:46:55.302 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f4753398e20] 2024-04-26T11:46:55.303 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 13: (DispatchQueue::entry()+0x51f) [0x7f4753395fdf] 2024-04-26T11:46:55.303 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4753468fc1] 2024-04-26T11:46:55.303 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4751e821ca] 2024-04-26T11:46:55.303 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 16: clone() 2024-04-26T11:46:55.303 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:55.303 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.303 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: -1> 2024-04-26T11:46:55.020+0000 7f4747800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4747800700 time 2024-04-26T11:46:55.017581+0000 2024-04-26T11:46:55.303 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:46:55.304 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.304 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:55.304 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f47531043dd] 2024-04-26T11:46:55.304 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47531045a3] 2024-04-26T11:46:55.304 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561e8e375822] 2024-04-26T11:46:55.304 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561e8e2e5598] 2024-04-26T11:46:55.304 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561e8e2e7c17] 2024-04-26T11:46:55.304 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561e8e1e0d0b] 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561e8e1e12ac] 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561e8e1c9fad] 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f4753398e20] 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 10: (DispatchQueue::entry()+0x51f) [0x7f4753395fdf] 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4753468fc1] 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f4751e821ca] 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 13: clone() 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 0> 2024-04-26T11:46:55.025+0000 7f4747800700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: in thread 7f4747800700 thread_name:ms_dispatch 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f4751e8cd20] 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2: gsignal() 2024-04-26T11:46:55.305 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 3: abort() 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4753104437] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47531045a3] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561e8e375822] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561e8e2e5598] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561e8e2e7c17] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561e8e1e0d0b] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561e8e1e12ac] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561e8e1c9fad] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f4753398e20] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 13: (DispatchQueue::entry()+0x51f) [0x7f4753395fdf] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4753468fc1] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f4751e821ca] 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 16: clone() 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:46:55.306 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[67114]: 2024-04-26T11:46:55.307 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:55 smithi110 podman[95649]: 2024-04-26 11:46:55.186840525 +0000 UTC m=+0.032139969 container died ced00513fd2dc5a2b1a8c395019e217cbacec2bed242fcb703559046e714f685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:46:56.267 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:56 smithi110 ceph-mon[28069]: pgmap v543: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-04-26T11:46:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:56 smithi193 ceph-mon[32782]: pgmap v543: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-04-26T11:46:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:56 smithi196 ceph-mon[32572]: pgmap v543: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-04-26T11:46:56.541 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:56 smithi110 podman[95649]: 2024-04-26 11:46:56.266201013 +0000 UTC m=+1.111500527 container remove ced00513fd2dc5a2b1a8c395019e217cbacec2bed242fcb703559046e714f685 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-26T11:46:56.542 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:56 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:46:57.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:56 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-04-26T11:46:57.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:46:56 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Consumed 2.535s CPU time. 2024-04-26T11:46:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:46:58 smithi110 ceph-mon[28069]: pgmap v544: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-04-26T11:46:58.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:46:58 smithi193 ceph-mon[32782]: pgmap v544: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-04-26T11:46:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:46:58 smithi196 ceph-mon[32572]: pgmap v544: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-04-26T11:46:59.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:47:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:00 smithi110 ceph-mon[28069]: pgmap v545: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2024-04-26T11:47:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:00 smithi193 ceph-mon[32782]: pgmap v545: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2024-04-26T11:47:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:00 smithi196 ceph-mon[32572]: pgmap v545: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.6 MiB/s wr, 172 op/s 2024-04-26T11:47:01.955 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:01 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:47:01.955 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:01 smithi110 systemd[1]: Stopped Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:01.955 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:01 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 1.820s CPU time. 2024-04-26T11:47:01.955 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:01 smithi110 systemd[1]: Starting Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:47:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.155+0000 7f908ac00640 1 -- 172.21.15.110:0/569766285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 msgr2=0x7f9084111a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.155+0000 7f908ac00640 1 --2- 172.21.15.110:0/569766285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 0x7f9084111a60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f907c009ca0 tx=0x7f907c02a8c0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.156+0000 7f908ac00640 1 -- 172.21.15.110:0/569766285 shutdown_connections 2024-04-26T11:47:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.156+0000 7f908ac00640 1 --2- 172.21.15.110:0/569766285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 0x7f9084111a60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.156+0000 7f908ac00640 1 --2- 172.21.15.110:0/569766285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9084105770 0x7f90841097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.156+0000 7f908ac00640 1 --2- 172.21.15.110:0/569766285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9084104dc0 0x7f90841051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.156+0000 7f908ac00640 1 -- 172.21.15.110:0/569766285 >> 172.21.15.110:0/569766285 conn(0x7f9084100640 msgr2=0x7f9084102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:02.159 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.156+0000 7f908ac00640 1 -- 172.21.15.110:0/569766285 shutdown_connections 2024-04-26T11:47:02.159 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.156+0000 7f908ac00640 1 -- 172.21.15.110:0/569766285 wait complete. 2024-04-26T11:47:02.160 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.157+0000 7f908ac00640 1 Processor -- start 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.157+0000 7f908ac00640 1 -- start start 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.157+0000 7f908ac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9084104dc0 0x7f908419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.157+0000 7f908ac00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 0x7f908419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.157+0000 7f908ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f908419fbd0 0x7f90841a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.157+0000 7f908ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9084114e40 con 0x7f908419fbd0 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.157+0000 7f908ac00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9084114cc0 con 0x7f9084109e90 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.157+0000 7f908ac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9084114fc0 con 0x7f9084104dc0 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 0x7f908419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9084104dc0 0x7f908419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9088c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f908419fbd0 0x7f90841a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 0x7f908419b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56938/0 (socket says 172.21.15.110:56938) 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083400640 1 -- 172.21.15.110:0/2333189799 learned_addr learned my addr 172.21.15.110:0/2333189799 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083400640 1 -- 172.21.15.110:0/2333189799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9084104dc0 msgr2=0x7f908419b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083400640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9084104dc0 0x7f908419b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083400640 1 -- 172.21.15.110:0/2333189799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f908419fbd0 msgr2=0x7f90841a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083400640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f908419fbd0 0x7f90841a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083400640 1 -- 172.21.15.110:0/2333189799 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90841a06c0 con 0x7f9084109e90 2024-04-26T11:47:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9083400640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 0x7f908419b8a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f907000e9c0 tx=0x7f907000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9080c00640 1 -- 172.21.15.110:0/2333189799 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907000cd80 con 0x7f9084109e90 2024-04-26T11:47:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9080c00640 1 -- 172.21.15.110:0/2333189799 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90700054d0 con 0x7f9084109e90 2024-04-26T11:47:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f9080c00640 1 -- 172.21.15.110:0/2333189799 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070010430 con 0x7f9084109e90 2024-04-26T11:47:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.158+0000 7f908ac00640 1 -- 172.21.15.110:0/2333189799 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90841a09b0 con 0x7f9084109e90 2024-04-26T11:47:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.159+0000 7f908ac00640 1 -- 172.21.15.110:0/2333189799 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90841a81a0 con 0x7f9084109e90 2024-04-26T11:47:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.162+0000 7f908db97740 1 Processor -- start 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.162+0000 7f908db97740 1 -- start start 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.162+0000 7f9080c00640 1 -- 172.21.15.110:0/2333189799 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9070004fd0 con 0x7f9084109e90 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.162+0000 7f908db97740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6941b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.162+0000 7f908db97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 0x55f56b69ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.162+0000 7f908db97740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b69efb0 0x55f56b6a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.162+0000 7f908db97740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f56b5f9380 con 0x55f56b693dd0 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.162+0000 7f908db97740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f56b595c30 con 0x55f56b69efb0 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.162+0000 7f908db97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f56b5f5340 con 0x55f56b6946f0 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9088c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6941b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9083400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b69efb0 0x55f56b6a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9088c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6941b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35004/0 (socket says 172.21.15.110:35004) 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9088c00640 1 -- 172.21.15.110:0/1761826249 learned_addr learned my addr 172.21.15.110:0/1761826249 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9083e00640 1 --2- 172.21.15.110:0/1761826249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 0x55f56b69ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9088c00640 1 -- 172.21.15.110:0/1761826249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 msgr2=0x55f56b69ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9088c00640 1 --2- 172.21.15.110:0/1761826249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 0x55f56b69ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9088c00640 1 -- 172.21.15.110:0/1761826249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b69efb0 msgr2=0x55f56b6a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9088c00640 1 --2- 172.21.15.110:0/1761826249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b69efb0 0x55f56b6a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9088c00640 1 -- 172.21.15.110:0/1761826249 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56b5b7940 con 0x55f56b693dd0 2024-04-26T11:47:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9083e00640 1 --2- 172.21.15.110:0/1761826249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 0x55f56b69ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:47:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.163+0000 7f9088c00640 1 --2- 172.21.15.110:0/1761826249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6941b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f907c009ca0 tx=0x7f907c0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6689d3d92b40f926 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.164+0000 7f9079200640 1 -- 172.21.15.110:0/1761826249 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c031cf0 con 0x55f56b693dd0 2024-04-26T11:47:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.164+0000 7f9079200640 1 -- 172.21.15.110:0/1761826249 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907c036030 con 0x55f56b693dd0 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.164+0000 7f9079200640 1 -- 172.21.15.110:0/1761826249 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c0042a0 con 0x55f56b693dd0 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.164+0000 7f9080c00640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f90680a3dc0 0x7f90680a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.164+0000 7f9080c00640 1 -- 172.21.15.110:0/2333189799 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 12685+0+0 (secure 0 0 0) 0x7f90700d1c10 con 0x7f9084109e90 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.164+0000 7f9083e00640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f90680a3dc0 0x7f90680a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 -- 172.21.15.110:0/1761826249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 msgr2=0x55f56b6941b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 --2- 172.21.15.110:0/1761826249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6941b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f907c009ca0 tx=0x7f907c0093e0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 -- 172.21.15.110:0/1761826249 shutdown_connections 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 --2- 172.21.15.110:0/1761826249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b69efb0 0x55f56b6a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 --2- 172.21.15.110:0/1761826249 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 0x55f56b69ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 --2- 172.21.15.110:0/1761826249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6941b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 -- 172.21.15.110:0/1761826249 >> 172.21.15.110:0/1761826249 conn(0x55f56b6902e0 msgr2=0x55f56b6906c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 -- 172.21.15.110:0/1761826249 shutdown_connections 2024-04-26T11:47:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 -- 172.21.15.110:0/1761826249 wait complete. 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f9083e00640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f90680a3dc0 0x7f90680a6280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55f56b695370 tx=0x7f9074005f90 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.165+0000 7f908db97740 1 -- start start 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f908db97740 1 Processor -- start 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f908db97740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b693dd0 0x55f56b69bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f908db97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 0x55f56b69c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f908db97740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b69c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f908db97740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f56b6a1a00 con 0x55f56b69efb0 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f908db97740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f56b580c60 con 0x55f56b693dd0 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f908db97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f56b6a1b80 con 0x55f56b6946f0 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f908db97740 10 client.0 _ll_register_callbacks cb 0x55f56b5ace50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f9083e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b693dd0 0x55f56b69bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f9083e00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b693dd0 0x55f56b69bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56962/0 (socket says 172.21.15.110:56962) 2024-04-26T11:47:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f9083e00640 1 -- 172.21.15.110:0/1609077780 learned_addr learned my addr 172.21.15.110:0/1609077780 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f9088c00640 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b69c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.166+0000 7f9083400640 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 0x55f56b69c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f9083e00640 1 -- 172.21.15.110:0/1609077780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 msgr2=0x55f56b69c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f9083e00640 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 0x55f56b69c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f9083e00640 1 -- 172.21.15.110:0/1609077780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 msgr2=0x55f56b69c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f9083e00640 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b69c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f9083e00640 1 -- 172.21.15.110:0/1609077780 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56b58f510 con 0x55f56b693dd0 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f9083e00640 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b693dd0 0x55f56b69bf50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f907401e9d0 tx=0x7f9074004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86b1de7bf4465b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f906d600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f906d600640 1 -- 172.21.15.110:0/1609077780 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90740098f0 con 0x55f56b693dd0 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f908db97740 1 -- 172.21.15.110:0/1609077780 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f907c036030 con 0x55f56b693dd0 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.167+0000 7f906d600640 1 -- 172.21.15.110:0/1609077780 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(159..159 src has 1..159) ==== 12685+0+0 (secure 0 0 0) 0x7f9074018030 con 0x55f56b693dd0 2024-04-26T11:47:02.175 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f906d600640 1 -- 172.21.15.110:0/1609077780 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=289) ==== 24+0+0 (secure 0 0 0) 0x7f9074004020 con 0x55f56b693dd0 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f908db97740 10 client.26486 fetch_fsmap learned FSMap version 289 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f908db97740 1 -- 172.21.15.110:0/1609077780 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=289,monmap=4+}) -- 0x55f56b30b210 con 0x55f56b693dd0 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f906d600640 1 -- 172.21.15.110:0/1609077780 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907c036030 con 0x55f56b693dd0 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f906d600640 1 -- 172.21.15.110:0/1609077780 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 289) ==== 4119+0+0 (secure 0 0 0) 0x7f9074033480 con 0x55f56b693dd0 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f908db97740 10 client.26486 fetch_fsmap finished waiting for FSMap version 289 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f908db97740 10 client.26486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f908db97740 20 client.26486 populate_metadata read hostname 'smithi110' 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f908db97740 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f56b6aefb0 0x55f56b6b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f908db97740 4 client.26486 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f908db97740 1 -- 172.21.15.110:0/1609077780 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f56b606f90 con 0x55f56b6aefb0 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.168+0000 7f9083400640 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f56b6aefb0 0x55f56b6b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.169+0000 7f9083400640 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f56b6aefb0 0x55f56b6b1420 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e46522f0c620e76e server_cookie=d2b720029e53f0da in_seq=0 out_seq=0 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.169+0000 7f906d600640 10 client.26486 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.169+0000 7f906d600640 1 -- 172.21.15.110:0/1609077780 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f56b606f90 con 0x55f56b6aefb0 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.169+0000 7f906d600640 10 client.26486 handle_command_reply: tid=0 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.169+0000 7f908db97740 1 client.26486 shutdown 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 -- 172.21.15.110:0/1609077780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b693dd0 msgr2=0x55f56b69bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b693dd0 0x55f56b69bf50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f907401e9d0 tx=0x7f9074004730 comp rx=0 tx=0).stop 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 -- 172.21.15.110:0/1609077780 shutdown_connections 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b69c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f56b6aefb0 0x55f56b6b1420 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b6946f0 0x55f56b69c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 --2- 172.21.15.110:0/1609077780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b693dd0 0x55f56b69bf50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 -- 172.21.15.110:0/1609077780 >> 172.21.15.110:0/1609077780 conn(0x55f56b6902e0 msgr2=0x55f56b696010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f906d600640 0 client.26486 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:02.178 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 -- 172.21.15.110:0/1609077780 shutdown_connections 2024-04-26T11:47:02.178 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 1 -- 172.21.15.110:0/1609077780 wait complete. 2024-04-26T11:47:02.178 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.170+0000 7f908db97740 20 client.26486 trim_cache size 0 max 16384 2024-04-26T11:47:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f908db97740 1 Processor -- start 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f908db97740 1 -- start start 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f908db97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b693dd0 0x55f56b6aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f908db97740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b696790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f908db97740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b6b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f908db97740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f90841b3040 con 0x55f56b69efb0 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f908db97740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90841b1500 con 0x55f56b6946f0 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f908db97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f90841b2970 con 0x55f56b693dd0 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f9088c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b6b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f9088c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b6b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35024/0 (socket says 172.21.15.110:35024) 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f9088c00640 1 -- 172.21.15.110:0/1798980502 learned_addr learned my addr 172.21.15.110:0/1798980502 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f9083400640 1 --2- 172.21.15.110:0/1798980502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b696790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.187+0000 7f9083e00640 1 --2- 172.21.15.110:0/1798980502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b693dd0 0x55f56b6aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.188+0000 7f9088c00640 1 -- 172.21.15.110:0/1798980502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b693dd0 msgr2=0x55f56b6aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.188+0000 7f9088c00640 1 --2- 172.21.15.110:0/1798980502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b693dd0 0x55f56b6aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.188+0000 7f9088c00640 1 -- 172.21.15.110:0/1798980502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 msgr2=0x55f56b696790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.188+0000 7f9088c00640 1 --2- 172.21.15.110:0/1798980502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b696790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.188+0000 7f9088c00640 1 -- 172.21.15.110:0/1798980502 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56b3d7620 con 0x55f56b69efb0 2024-04-26T11:47:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.188+0000 7f9088c00640 1 --2- 172.21.15.110:0/1798980502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b6b6d30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f907c02f540 tx=0x7f907c003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff9a8c93f8cb8db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.188+0000 7f906fe00640 1 -- 172.21.15.110:0/1798980502 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c04a040 con 0x55f56b69efb0 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.188+0000 7f906fe00640 1 -- 172.21.15.110:0/1798980502 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907c036040 con 0x55f56b69efb0 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f906fe00640 1 -- 172.21.15.110:0/1798980502 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c02f870 con 0x55f56b69efb0 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f908db97740 1 -- 172.21.15.110:0/1798980502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 msgr2=0x55f56b6b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f908db97740 1 --2- 172.21.15.110:0/1798980502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b6b6d30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f907c02f540 tx=0x7f907c003c40 comp rx=0 tx=0).stop 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f908db97740 1 -- 172.21.15.110:0/1798980502 shutdown_connections 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f908db97740 1 --2- 172.21.15.110:0/1798980502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b69efb0 0x55f56b6b6d30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f908db97740 1 --2- 172.21.15.110:0/1798980502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b696790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f908db97740 1 --2- 172.21.15.110:0/1798980502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b693dd0 0x55f56b6aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f908db97740 1 -- 172.21.15.110:0/1798980502 >> 172.21.15.110:0/1798980502 conn(0x55f56b6902e0 msgr2=0x55f56b69c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f908db97740 1 -- 172.21.15.110:0/1798980502 shutdown_connections 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.189+0000 7f908db97740 1 -- 172.21.15.110:0/1798980502 wait complete. 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f908db97740 1 -- start start 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f908db97740 1 Processor -- start 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f908db97740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6a2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f908db97740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b6a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f908db97740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b69efb0 0x55f56b6a31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f908db97740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f90841b22a0 con 0x55f56b693dd0 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f908db97740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90841b1bd0 con 0x55f56b6946f0 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f908db97740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f56b606f90 con 0x55f56b69efb0 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f908db97740 10 client.0 _ll_register_callbacks cb 0x7f9074009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.190+0000 7f9083e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b6a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083400640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b6a2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:56982/0 (socket says 172.21.15.110:56982) 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083400640 1 -- 172.21.15.110:0/553660176 learned_addr learned my addr 172.21.15.110:0/553660176 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9088c00640 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b69efb0 0x55f56b6a31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083400640 1 -- 172.21.15.110:0/553660176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b69efb0 msgr2=0x55f56b6a31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083400640 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b69efb0 0x55f56b6a31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083400640 1 -- 172.21.15.110:0/553660176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 msgr2=0x55f56b6a2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:02.196 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083400640 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6a2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083400640 1 -- 172.21.15.110:0/553660176 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56b5b3cb0 con 0x55f56b6946f0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083e00640 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6a2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f9083400640 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b6a2c90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f907009c810 tx=0x7f90700d56c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68b302f1de756bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f906d600640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f906d600640 1 -- 172.21.15.110:0/553660176 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907009c470 con 0x55f56b6946f0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f906d600640 1 -- 172.21.15.110:0/553660176 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(159..159 src has 1..159) ==== 12685+0+0 (secure 0 0 0) 0x7f90700bd0b0 con 0x55f56b6946f0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f908db97740 1 -- 172.21.15.110:0/553660176 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f907c036040 con 0x55f56b6946f0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.191+0000 7f906d600640 1 -- 172.21.15.110:0/553660176 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=289) ==== 24+0+0 (secure 0 0 0) 0x7f90700046c0 con 0x55f56b6946f0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f908db97740 10 client.26492 fetch_fsmap learned FSMap version 289 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f908db97740 1 -- 172.21.15.110:0/553660176 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=289,monmap=4+}) -- 0x55f56b715680 con 0x55f56b6946f0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f906d600640 1 -- 172.21.15.110:0/553660176 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f907c036040 con 0x55f56b6946f0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f906d600640 1 -- 172.21.15.110:0/553660176 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 289) ==== 4119+0+0 (secure 0 0 0) 0x7f90700da040 con 0x55f56b6946f0 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f908db97740 10 client.26492 fetch_fsmap finished waiting for FSMap version 289 2024-04-26T11:47:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f908db97740 10 client.26492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:47:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f908db97740 20 client.26492 populate_metadata read hostname 'smithi110' 2024-04-26T11:47:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f908db97740 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f56b715db0 0x55f56b7181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f908db97740 4 client.26492 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:47:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f908db97740 1 -- 172.21.15.110:0/553660176 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f56b600e00 con 0x55f56b715db0 2024-04-26T11:47:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.192+0000 7f9083e00640 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f56b715db0 0x55f56b7181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.193+0000 7f9083e00640 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f56b715db0 0x55f56b7181d0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65f54084f8ea6646 server_cookie=b89641803ef67b2d in_seq=0 out_seq=0 2024-04-26T11:47:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:02.193+0000 7f906d600640 10 client.26492 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:02 smithi110 ceph-mon[28069]: pgmap v546: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2024-04-26T11:47:02.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:01 smithi110 podman[95741]: 2024-04-26 11:47:01.859434258 +0000 UTC m=+0.033784473 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:47:02.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:02 smithi110 podman[95741]: 2024-04-26 11:47:02.000273301 +0000 UTC m=+0.174623585 container create d97809c0c67bbb98a1ca7041e6220ccb7a76affe3b2fed7c30965d03e30189f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:47:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:02 smithi193 ceph-mon[32782]: pgmap v546: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2024-04-26T11:47:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:02 smithi196 ceph-mon[32572]: pgmap v546: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2024-04-26T11:47:02.792 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:02 smithi110 podman[95741]: 2024-04-26 11:47:02.304929972 +0000 UTC m=+0.479280228 container init d97809c0c67bbb98a1ca7041e6220ccb7a76affe3b2fed7c30965d03e30189f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T11:47:02.793 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:02 smithi110 podman[95741]: 2024-04-26 11:47:02.314188195 +0000 UTC m=+0.488538451 container start d97809c0c67bbb98a1ca7041e6220ccb7a76affe3b2fed7c30965d03e30189f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-26T11:47:02.793 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:02 smithi110 ceph-mds[95804]: -- 172.21.15.110:0/1025311406 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d66a649a40 con 0x55d66a61cc00 2024-04-26T11:47:02.793 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: starting mds.a at 2024-04-26T11:47:02.793 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:02 smithi110 bash[95741]: d97809c0c67bbb98a1ca7041e6220ccb7a76affe3b2fed7c30965d03e30189f9 2024-04-26T11:47:02.793 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:02 smithi110 systemd[1]: Started Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:03 smithi110 ceph-mon[28069]: daemon mds.a restarted 2024-04-26T11:47:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:03 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:47:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:03 smithi110 ceph-mon[28069]: osdmap e160: 12 total, 12 up, 12 in 2024-04-26T11:47:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:03 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:boot 2024-04-26T11:47:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:03 smithi110 ceph-mon[28069]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:47:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:03 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:47:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:03 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:replay} 2 up:standby-replay 2024-04-26T11:47:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:03 smithi193 ceph-mon[32782]: daemon mds.a restarted 2024-04-26T11:47:03.411 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:03 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:47:03.411 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:03 smithi193 ceph-mon[32782]: osdmap e160: 12 total, 12 up, 12 in 2024-04-26T11:47:03.411 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:03 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:boot 2024-04-26T11:47:03.411 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:03 smithi193 ceph-mon[32782]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:47:03.411 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:03 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:03.411 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:47:03.411 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:03 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:replay} 2 up:standby-replay 2024-04-26T11:47:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:03 smithi196 ceph-mon[32572]: daemon mds.a restarted 2024-04-26T11:47:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:03 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:47:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:03 smithi196 ceph-mon[32572]: osdmap e160: 12 total, 12 up, 12 in 2024-04-26T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:03 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:boot 2024-04-26T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:03 smithi196 ceph-mon[32572]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:03 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:47:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:03 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:replay} 2 up:standby-replay 2024-04-26T11:47:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:04 smithi196 ceph-mon[32572]: pgmap v548: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 1.6 MiB/s wr, 154 op/s 2024-04-26T11:47:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:04 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:resolve 2024-04-26T11:47:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:04 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:resolve} 2 up:standby-replay 2024-04-26T11:47:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:04 smithi110 ceph-mon[28069]: pgmap v548: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 1.6 MiB/s wr, 154 op/s 2024-04-26T11:47:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:04 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:resolve 2024-04-26T11:47:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:04 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:resolve} 2 up:standby-replay 2024-04-26T11:47:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:04 smithi193 ceph-mon[32782]: pgmap v548: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 1.6 MiB/s wr, 154 op/s 2024-04-26T11:47:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:04 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:resolve 2024-04-26T11:47:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:04 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:resolve} 2 up:standby-replay 2024-04-26T11:47:04.924 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:47:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:06 smithi196 ceph-mon[32572]: pgmap v549: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1000 KiB/s wr, 125 op/s 2024-04-26T11:47:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:06 smithi110 ceph-mon[28069]: pgmap v549: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1000 KiB/s wr, 125 op/s 2024-04-26T11:47:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:06 smithi193 ceph-mon[32782]: pgmap v549: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1000 KiB/s wr, 125 op/s 2024-04-26T11:47:07.187 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:06 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 1. 2024-04-26T11:47:07.187 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:06 smithi110 systemd[1]: Stopped Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:07.188 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:06 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Consumed 2.535s CPU time. 2024-04-26T11:47:07.188 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:06 smithi110 systemd[1]: Starting Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:47:07.443 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:07 smithi110 podman[95882]: 2024-04-26 11:47:07.092015233 +0000 UTC m=+0.033331148 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:47:07.443 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:07 smithi110 podman[95882]: 2024-04-26 11:47:07.246777292 +0000 UTC m=+0.188093238 container create d09a69e37edf593a9684b0dc6256eb1cb7489d14988920ba08c51354209e5412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-26T11:47:08.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:07 smithi110 podman[95882]: 2024-04-26 11:47:07.593253915 +0000 UTC m=+0.534569867 container init d09a69e37edf593a9684b0dc6256eb1cb7489d14988920ba08c51354209e5412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T11:47:08.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:07 smithi110 podman[95882]: 2024-04-26 11:47:07.603787345 +0000 UTC m=+0.545103261 container start d09a69e37edf593a9684b0dc6256eb1cb7489d14988920ba08c51354209e5412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-26T11:47:08.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:07 smithi110 ceph-mds[95901]: -- 172.21.15.110:0/3303694040 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623d3597a40 con 0x5623d356ac00 2024-04-26T11:47:08.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: starting mds.g at 2024-04-26T11:47:08.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:07 smithi110 bash[95882]: d09a69e37edf593a9684b0dc6256eb1cb7489d14988920ba08c51354209e5412 2024-04-26T11:47:08.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:07 smithi110 systemd[1]: Started Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:08.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:08 smithi193 ceph-mon[32782]: pgmap v550: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1000 KiB/s wr, 125 op/s 2024-04-26T11:47:08.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:08 smithi193 ceph-mon[32782]: daemon mds.g restarted 2024-04-26T11:47:08.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:08 smithi193 ceph-mon[32782]: osdmap e161: 12 total, 12 up, 12 in 2024-04-26T11:47:08.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:08 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:boot 2024-04-26T11:47:08.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:08 smithi193 ceph-mon[32782]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T11:47:08.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:47:08.675 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:08 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:08.675 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:08 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:08 smithi196 ceph-mon[32572]: pgmap v550: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1000 KiB/s wr, 125 op/s 2024-04-26T11:47:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:08 smithi196 ceph-mon[32572]: daemon mds.g restarted 2024-04-26T11:47:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:08 smithi196 ceph-mon[32572]: osdmap e161: 12 total, 12 up, 12 in 2024-04-26T11:47:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:08 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:boot 2024-04-26T11:47:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:08 smithi196 ceph-mon[32572]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T11:47:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:47:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:08 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:08 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:08 smithi110 ceph-mon[28069]: pgmap v550: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 1000 KiB/s wr, 125 op/s 2024-04-26T11:47:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:08 smithi110 ceph-mon[28069]: daemon mds.g restarted 2024-04-26T11:47:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:08 smithi110 ceph-mon[28069]: osdmap e161: 12 total, 12 up, 12 in 2024-04-26T11:47:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:08 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:boot 2024-04-26T11:47:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:08 smithi110 ceph-mon[28069]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T11:47:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:47:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:08 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:08 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:09.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 895.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:47:09.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:resolve 2024-04-26T11:47:09.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:09 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:09.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:09 smithi110 ceph-mon[28069]: pgmap v552: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 732 KiB/s wr, 94 op/s 2024-04-26T11:47:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:resolve 2024-04-26T11:47:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:09 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:09 smithi196 ceph-mon[32572]: pgmap v552: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 732 KiB/s wr, 94 op/s 2024-04-26T11:47:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:resolve 2024-04-26T11:47:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:09 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=a=up:resolve} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:09 smithi193 ceph-mon[32782]: pgmap v552: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 732 KiB/s wr, 94 op/s 2024-04-26T11:47:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.711+0000 7f906d600640 1 -- 172.21.15.110:0/553660176 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f56b600e00 con 0x55f56b715db0 2024-04-26T11:47:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.711+0000 7f906d600640 10 client.26492 handle_command_reply: tid=0 2024-04-26T11:47:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.711+0000 7f908db97740 1 client.26492 shutdown 2024-04-26T11:47:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f908db97740 1 -- 172.21.15.110:0/553660176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 msgr2=0x55f56b6a2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f908db97740 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b6a2c90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f907009c810 tx=0x7f90700d56c0 comp rx=0 tx=0).stop 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f908db97740 1 -- 172.21.15.110:0/553660176 shutdown_connections 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f908db97740 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55f56b715db0 0x55f56b7181d0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f908db97740 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f56b69efb0 0x55f56b6a31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f908db97740 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f56b6946f0 0x55f56b6a2c90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f908db97740 1 --2- 172.21.15.110:0/553660176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f56b693dd0 0x55f56b6a2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f906d600640 0 client.26492 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f908db97740 1 -- 172.21.15.110:0/553660176 >> 172.21.15.110:0/553660176 conn(0x55f56b6902e0 msgr2=0x55f56b68f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.712+0000 7f908db97740 1 -- 172.21.15.110:0/553660176 shutdown_connections 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.713+0000 7f908db97740 1 -- 172.21.15.110:0/553660176 wait complete. 2024-04-26T11:47:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.713+0000 7f908db97740 20 client.26492 trim_cache size 0 max 16384 2024-04-26T11:47:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:47:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:47:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:47:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 -- 172.21.15.110:0/2333189799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f90680a3dc0 msgr2=0x7f90680a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f90680a3dc0 0x7f90680a6280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55f56b695370 tx=0x7f9074005f90 comp rx=0 tx=0).stop 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 -- 172.21.15.110:0/2333189799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 msgr2=0x7f908419b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 0x7f908419b8a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f907000e9c0 tx=0x7f907000ee80 comp rx=0 tx=0).stop 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 -- 172.21.15.110:0/2333189799 shutdown_connections 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f90680a3dc0 0x7f90680a6280 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f908419fbd0 0x7f90841a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9084109e90 0x7f908419b8a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 --2- 172.21.15.110:0/2333189799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9084104dc0 0x7f908419b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 -- 172.21.15.110:0/2333189799 >> 172.21.15.110:0/2333189799 conn(0x7f9084100640 msgr2=0x7f9084102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 -- 172.21.15.110:0/2333189799 shutdown_connections 2024-04-26T11:47:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:10.714+0000 7f908ac00640 1 -- 172.21.15.110:0/2333189799 wait complete. 2024-04-26T11:47:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:10 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999984 2024-04-26T11:47:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:10 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:reconnect 2024-04-26T11:47:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:10 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:reconnect 2024-04-26T11:47:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:10 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:10 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:47:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:10 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219996 2024-04-26T11:47:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:10 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999984 2024-04-26T11:47:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:10 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:reconnect 2024-04-26T11:47:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:10 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:reconnect 2024-04-26T11:47:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:10 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:10 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:47:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:10 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219996 2024-04-26T11:47:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:10 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.000999984 2024-04-26T11:47:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:10 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:reconnect 2024-04-26T11:47:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:10 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:reconnect 2024-04-26T11:47:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:10 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:10 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:47:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:10 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219996 2024-04-26T11:47:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:11 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:rejoin 2024-04-26T11:47:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:11 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:rejoin 2024-04-26T11:47:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:11 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:11 smithi196 ceph-mon[32572]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T11:47:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:11 smithi196 ceph-mon[32572]: pgmap v553: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 675 KiB/s wr, 86 op/s 2024-04-26T11:47:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:11 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:rejoin 2024-04-26T11:47:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:11 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:rejoin 2024-04-26T11:47:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:11 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:11 smithi110 ceph-mon[28069]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T11:47:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:11 smithi110 ceph-mon[28069]: pgmap v553: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 675 KiB/s wr, 86 op/s 2024-04-26T11:47:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:11 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:rejoin 2024-04-26T11:47:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:11 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:rejoin 2024-04-26T11:47:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:11 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:11 smithi193 ceph-mon[32782]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T11:47:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:11 smithi193 ceph-mon[32782]: pgmap v553: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 675 KiB/s wr, 86 op/s 2024-04-26T11:47:12.622 INFO:journalctl@ceph.mds.b.smithi193.stdout:Apr 26 11:47:12 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-b[62816]: 2024-04-26T11:47:12.251+0000 7f157975e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T11:47:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:12 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:active 2024-04-26T11:47:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:12 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:clientreplay 2024-04-26T11:47:13.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:12 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:clientreplay} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:13.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:12 smithi196 ceph-mon[32572]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:47:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:active 2024-04-26T11:47:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:clientreplay 2024-04-26T11:47:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:clientreplay} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-mon[28069]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:47:13.046 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6769c00700 time 2024-04-26T11:47:12.783945+0000 2024-04-26T11:47:13.046 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f67755cf3dd] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f67755cf5a3] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d641596822] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d641506598] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d641508c17] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d641401d0b] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6414022ac] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6413eafad] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6775863e20] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 10: (DispatchQueue::entry()+0x51f) [0x7f6775860fdf] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6775933fc1] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f677434d1ca] 2024-04-26T11:47:13.047 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 13: clone() 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: *** Caught signal (Aborted) ** 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: in thread 7f6769c00700 thread_name:ms_dispatch 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:12.784+0000 7f6769c00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6769c00700 time 2024-04-26T11:47:12.783945+0000 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f67755cf3dd] 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f67755cf5a3] 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d641596822] 2024-04-26T11:47:13.048 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d641506598] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d641508c17] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d641401d0b] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6414022ac] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6413eafad] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6775863e20] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 10: (DispatchQueue::entry()+0x51f) [0x7f6775860fdf] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6775933fc1] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f677434d1ca] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 13: clone() 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6774357d20] 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2: gsignal() 2024-04-26T11:47:13.049 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 3: abort() 2024-04-26T11:47:13.050 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f67755cf437] 2024-04-26T11:47:13.050 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f67755cf5a3] 2024-04-26T11:47:13.050 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d641596822] 2024-04-26T11:47:13.050 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d641506598] 2024-04-26T11:47:13.050 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d641508c17] 2024-04-26T11:47:13.050 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d641401d0b] 2024-04-26T11:47:13.050 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6414022ac] 2024-04-26T11:47:13.051 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6413eafad] 2024-04-26T11:47:13.051 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6775863e20] 2024-04-26T11:47:13.051 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 13: (DispatchQueue::entry()+0x51f) [0x7f6775860fdf] 2024-04-26T11:47:13.051 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6775933fc1] 2024-04-26T11:47:13.051 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f677434d1ca] 2024-04-26T11:47:13.051 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 16: clone() 2024-04-26T11:47:13.052 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:12.787+0000 7f6769c00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:13.052 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: in thread 7f6769c00700 thread_name:ms_dispatch 2024-04-26T11:47:13.052 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.052 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:13.052 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6774357d20] 2024-04-26T11:47:13.052 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2: gsignal() 2024-04-26T11:47:13.052 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 3: abort() 2024-04-26T11:47:13.052 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f67755cf437] 2024-04-26T11:47:13.052 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f67755cf5a3] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d641596822] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d641506598] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d641508c17] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d641401d0b] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6414022ac] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6413eafad] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6775863e20] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 13: (DispatchQueue::entry()+0x51f) [0x7f6775860fdf] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6775933fc1] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f677434d1ca] 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 16: clone() 2024-04-26T11:47:13.053 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: -1> 2024-04-26T11:47:12.784+0000 7f6769c00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6769c00700 time 2024-04-26T11:47:12.783945+0000 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f67755cf3dd] 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f67755cf5a3] 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d641596822] 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d641506598] 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d641508c17] 2024-04-26T11:47:13.054 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d641401d0b] 2024-04-26T11:47:13.055 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6414022ac] 2024-04-26T11:47:13.055 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6413eafad] 2024-04-26T11:47:13.055 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6775863e20] 2024-04-26T11:47:13.055 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 10: (DispatchQueue::entry()+0x51f) [0x7f6775860fdf] 2024-04-26T11:47:13.055 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6775933fc1] 2024-04-26T11:47:13.055 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f677434d1ca] 2024-04-26T11:47:13.055 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 13: clone() 2024-04-26T11:47:13.055 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.056 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 0> 2024-04-26T11:47:12.787+0000 7f6769c00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:13.056 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: in thread 7f6769c00700 thread_name:ms_dispatch 2024-04-26T11:47:13.056 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.056 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:13.056 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6774357d20] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2: gsignal() 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 3: abort() 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f67755cf437] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f67755cf5a3] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d641596822] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d641506598] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d641508c17] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d641401d0b] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6414022ac] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6413eafad] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6775863e20] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 13: (DispatchQueue::entry()+0x51f) [0x7f6775860fdf] 2024-04-26T11:47:13.057 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6775933fc1] 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f677434d1ca] 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 16: clone() 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: -1> 2024-04-26T11:47:12.784+0000 7f6769c00700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6769c00700 time 2024-04-26T11:47:12.783945+0000 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f67755cf3dd] 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f67755cf5a3] 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d641596822] 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d641506598] 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d641508c17] 2024-04-26T11:47:13.058 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d641401d0b] 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6414022ac] 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6413eafad] 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6775863e20] 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 10: (DispatchQueue::entry()+0x51f) [0x7f6775860fdf] 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6775933fc1] 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f677434d1ca] 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 13: clone() 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 0> 2024-04-26T11:47:12.787+0000 7f6769c00700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: in thread 7f6769c00700 thread_name:ms_dispatch 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6774357d20] 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2: gsignal() 2024-04-26T11:47:13.059 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 3: abort() 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f67755cf437] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f67755cf5a3] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d641596822] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d641506598] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d641508c17] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d641401d0b] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6414022ac] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6413eafad] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6775863e20] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 13: (DispatchQueue::entry()+0x51f) [0x7f6775860fdf] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6775933fc1] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f677434d1ca] 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 16: clone() 2024-04-26T11:47:13.060 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:13.061 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[95756]: 2024-04-26T11:47:13.061 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:12 smithi110 podman[95938]: 2024-04-26 11:47:12.916141003 +0000 UTC m=+0.032865279 container died d97809c0c67bbb98a1ca7041e6220ccb7a76affe3b2fed7c30965d03e30189f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-26T11:47:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:12 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6832/2626492636,v1:172.21.15.193:6833/2626492636] up:active 2024-04-26T11:47:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:12 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:clientreplay 2024-04-26T11:47:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:12 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:clientreplay} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:12 smithi193 ceph-mon[32782]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:47:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:13 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:47:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:13 smithi196 ceph-mon[32572]: pgmap v554: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 309 KiB/s wr, 47 op/s 2024-04-26T11:47:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:13 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:active 2024-04-26T11:47:14.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:13 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:14.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:13 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:47:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:13 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:47:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:13 smithi110 ceph-mon[28069]: pgmap v554: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 309 KiB/s wr, 47 op/s 2024-04-26T11:47:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:13 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:active 2024-04-26T11:47:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:13 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:13 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:47:14.043 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:13 smithi110 podman[95938]: 2024-04-26 11:47:13.680385944 +0000 UTC m=+0.797110226 container remove d97809c0c67bbb98a1ca7041e6220ccb7a76affe3b2fed7c30965d03e30189f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-26T11:47:14.043 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:13 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:47:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:13 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:47:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:13 smithi193 ceph-mon[32782]: pgmap v554: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 309 KiB/s wr, 47 op/s 2024-04-26T11:47:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:13 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1556537606,v1:172.21.15.110:6835/1556537606] up:active 2024-04-26T11:47:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:13 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 1 up:standby-replay 1 up:standby 2024-04-26T11:47:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:13 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:47:14.542 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:14 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-04-26T11:47:14.542 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:14 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 2.004s CPU time. 2024-04-26T11:47:14.922 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 900.0 s, 6.2 tps, lat 21916.940 ms stddev 15.224 2024-04-26T11:47:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:15 smithi196 ceph-mon[32572]: pgmap v555: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 565 KiB/s wr, 78 op/s 2024-04-26T11:47:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:15 smithi110 ceph-mon[28069]: pgmap v555: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 565 KiB/s wr, 78 op/s 2024-04-26T11:47:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:15 smithi193 ceph-mon[32782]: pgmap v555: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 565 KiB/s wr, 78 op/s 2024-04-26T11:47:17.833 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:17 smithi110 ceph-mon[28069]: pgmap v556: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 565 KiB/s wr, 78 op/s 2024-04-26T11:47:17.834 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:17 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:47:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:17 smithi196 ceph-mon[32572]: pgmap v556: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 565 KiB/s wr, 78 op/s 2024-04-26T11:47:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:17 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:47:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-mon[32782]: pgmap v556: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 565 KiB/s wr, 78 op/s 2024-04-26T11:47:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=a=up:active} 2 up:standby-replay 2024-04-26T11:47:18.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb4f0e5d700 time 2024-04-26T11:47:17.751969+0000 2024-04-26T11:47:18.122 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb4fb4863dd] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb4fb4865a3] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e1c176c822] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1c16dc598] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1c16dec17] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1c15d7d0b] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1c15d82ac] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e1c15c0fad] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb4fb71ae20] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 10: (DispatchQueue::entry()+0x51f) [0x7fb4fb717fdf] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb4fb7eafc1] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb4fa2041ca] 2024-04-26T11:47:18.123 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 13: clone() 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: *** Caught signal (Aborted) ** 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: in thread 7fb4f0e5d700 thread_name:ms_dispatch 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:17.752+0000 7fb4f0e5d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb4f0e5d700 time 2024-04-26T11:47:17.751969+0000 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb4fb4863dd] 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb4fb4865a3] 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e1c176c822] 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1c16dc598] 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1c16dec17] 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1c15d7d0b] 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1c15d82ac] 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e1c15c0fad] 2024-04-26T11:47:18.124 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb4fb71ae20] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 10: (DispatchQueue::entry()+0x51f) [0x7fb4fb717fdf] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb4fb7eafc1] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb4fa2041ca] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 13: clone() 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb4fa20ed20] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2: gsignal() 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 3: abort() 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb4fb486437] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb4fb4865a3] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e1c176c822] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1c16dc598] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1c16dec17] 2024-04-26T11:47:18.125 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1c15d7d0b] 2024-04-26T11:47:18.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1c15d82ac] 2024-04-26T11:47:18.126 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e1c15c0fad] 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb4fb71ae20] 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 13: (DispatchQueue::entry()+0x51f) [0x7fb4fb717fdf] 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb4fb7eafc1] 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb4fa2041ca] 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 16: clone() 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:17.753+0000 7fb4f0e5d700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: in thread 7fb4f0e5d700 thread_name:ms_dispatch 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb4fa20ed20] 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2: gsignal() 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 3: abort() 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb4fb486437] 2024-04-26T11:47:18.127 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb4fb4865a3] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e1c176c822] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1c16dc598] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1c16dec17] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1c15d7d0b] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1c15d82ac] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e1c15c0fad] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb4fb71ae20] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 13: (DispatchQueue::entry()+0x51f) [0x7fb4fb717fdf] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb4fb7eafc1] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb4fa2041ca] 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 16: clone() 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.128 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: -1> 2024-04-26T11:47:17.752+0000 7fb4f0e5d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb4f0e5d700 time 2024-04-26T11:47:17.751969+0000 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb4fb4863dd] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb4fb4865a3] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e1c176c822] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1c16dc598] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1c16dec17] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1c15d7d0b] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1c15d82ac] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e1c15c0fad] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb4fb71ae20] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 10: (DispatchQueue::entry()+0x51f) [0x7fb4fb717fdf] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb4fb7eafc1] 2024-04-26T11:47:18.129 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb4fa2041ca] 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 13: clone() 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 0> 2024-04-26T11:47:17.753+0000 7fb4f0e5d700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: in thread 7fb4f0e5d700 thread_name:ms_dispatch 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb4fa20ed20] 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2: gsignal() 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 3: abort() 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb4fb486437] 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb4fb4865a3] 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e1c176c822] 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1c16dc598] 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1c16dec17] 2024-04-26T11:47:18.130 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1c15d7d0b] 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1c15d82ac] 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e1c15c0fad] 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb4fb71ae20] 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 13: (DispatchQueue::entry()+0x51f) [0x7fb4fb717fdf] 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb4fb7eafc1] 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb4fa2041ca] 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 16: clone() 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: -1> 2024-04-26T11:47:17.752+0000 7fb4f0e5d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb4f0e5d700 time 2024-04-26T11:47:17.751969+0000 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:18.131 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb4fb4863dd] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb4fb4865a3] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e1c176c822] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1c16dc598] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1c16dec17] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1c15d7d0b] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1c15d82ac] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e1c15c0fad] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb4fb71ae20] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 10: (DispatchQueue::entry()+0x51f) [0x7fb4fb717fdf] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb4fb7eafc1] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb4fa2041ca] 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 13: clone() 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.132 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 0> 2024-04-26T11:47:17.753+0000 7fb4f0e5d700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: in thread 7fb4f0e5d700 thread_name:ms_dispatch 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb4fa20ed20] 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2: gsignal() 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 3: abort() 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb4fb486437] 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb4fb4865a3] 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e1c176c822] 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e1c16dc598] 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e1c16dec17] 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e1c15d7d0b] 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e1c15d82ac] 2024-04-26T11:47:18.133 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e1c15c0fad] 2024-04-26T11:47:18.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb4fb71ae20] 2024-04-26T11:47:18.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 13: (DispatchQueue::entry()+0x51f) [0x7fb4fb717fdf] 2024-04-26T11:47:18.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb4fb7eafc1] 2024-04-26T11:47:18.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb4fa2041ca] 2024-04-26T11:47:18.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 16: clone() 2024-04-26T11:47:18.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:18.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k[70674]: 2024-04-26T11:47:18.134 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:17 smithi193 podman[70735]: 2024-04-26 11:47:17.811601982 +0000 UTC m=+0.020278814 container died 061e96f206980fda0750981d1aeecbc66ab5d8887bbf4f64c203253d57ed0a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True) 2024-04-26T11:47:18.918 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:18 smithi193 podman[70735]: 2024-04-26 11:47:18.628955879 +0000 UTC m=+0.837632720 container remove 061e96f206980fda0750981d1aeecbc66ab5d8887bbf4f64c203253d57ed0a33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-26T11:47:18.918 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:18 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:47:19.372 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:18 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T11:47:19.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:47:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:19 smithi196 ceph-mon[32572]: pgmap v557: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 2.0 MiB/s wr, 264 op/s 2024-04-26T11:47:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:19 smithi110 ceph-mon[28069]: pgmap v557: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 2.0 MiB/s wr, 264 op/s 2024-04-26T11:47:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:19 smithi193 ceph-mon[32782]: pgmap v557: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 2.0 MiB/s wr, 264 op/s 2024-04-26T11:47:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:21 smithi196 ceph-mon[32572]: pgmap v558: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 1.8 MiB/s wr, 242 op/s 2024-04-26T11:47:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:21 smithi110 ceph-mon[28069]: pgmap v558: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 1.8 MiB/s wr, 242 op/s 2024-04-26T11:47:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:21 smithi193 ceph-mon[32782]: pgmap v558: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 1.8 MiB/s wr, 242 op/s 2024-04-26T11:47:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.853+0000 7fbbc3c00640 1 -- 172.21.15.110:0/359166030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbbc10f170 msgr2=0x7fbbbc1115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.853+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/359166030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbbc10f170 0x7fbbbc1115c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009900 tx=0x7fbbb402a480 comp rx=0 tx=0).stop 2024-04-26T11:47:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.853+0000 7fbbc3c00640 1 -- 172.21.15.110:0/359166030 shutdown_connections 2024-04-26T11:47:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.853+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/359166030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbbc10f170 0x7fbbbc1115c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.853+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/359166030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc075680 0x7fbbbc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.853+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/359166030 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbbc074d60 0x7fbbbc075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.853+0000 7fbbc3c00640 1 -- 172.21.15.110:0/359166030 >> 172.21.15.110:0/359166030 conn(0x7fbbbc0fe3c0 msgr2=0x7fbbbc1007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.853+0000 7fbbc3c00640 1 -- 172.21.15.110:0/359166030 shutdown_connections 2024-04-26T11:47:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.853+0000 7fbbc3c00640 1 -- 172.21.15.110:0/359166030 wait complete. 2024-04-26T11:47:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.854+0000 7fbbc3c00640 1 Processor -- start 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.854+0000 7fbbc3c00640 1 -- start start 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc3c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc074d60 0x7fbbbc19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc3c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbbc075680 0x7fbbbc19b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc3c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbbc10f170 0x7fbbbc19fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc3c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc114e10 con 0x7fbbbc074d60 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc3c00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc114c90 con 0x7fbbbc10f170 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc3c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc114f90 con 0x7fbbbc075680 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc074d60 0x7fbbbc19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc074d60 0x7fbbbc19b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54496/0 (socket says 172.21.15.110:54496) 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1200640 1 -- 172.21.15.110:0/517943987 learned_addr learned my addr 172.21.15.110:0/517943987 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbbc10f170 0x7fbbbc19fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbbbe00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbbc075680 0x7fbbbc19b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1200640 1 -- 172.21.15.110:0/517943987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbbc075680 msgr2=0x7fbbbc19b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1200640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbbc075680 0x7fbbbc19b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1200640 1 -- 172.21.15.110:0/517943987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbbc10f170 msgr2=0x7fbbbc19fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1200640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbbc10f170 0x7fbbbc19fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1200640 1 -- 172.21.15.110:0/517943987 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbbc1a0280 con 0x7fbbbc074d60 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbbbe00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbbc075680 0x7fbbbc19b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.855+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbbc10f170 0x7fbbbc19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.856+0000 7fbbc1200640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc074d60 0x7fbbbc19b290 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000eb90 tx=0x7fbbb000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.856+0000 7fbbb9600640 1 -- 172.21.15.110:0/517943987 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0004d20 con 0x7fbbbc074d60 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.856+0000 7fbbb9600640 1 -- 172.21.15.110:0/517943987 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbb000ee90 con 0x7fbbbc074d60 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.856+0000 7fbbc3c00640 1 -- 172.21.15.110:0/517943987 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbbc1a0570 con 0x7fbbbc074d60 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.856+0000 7fbbb9600640 1 -- 172.21.15.110:0/517943987 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0010670 con 0x7fbbbc074d60 2024-04-26T11:47:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.856+0000 7fbbc3c00640 1 -- 172.21.15.110:0/517943987 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbbc1a7e00 con 0x7fbbbc074d60 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.859+0000 7fbbc69fe740 1 Processor -- start 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.859+0000 7fbbb9600640 1 -- 172.21.15.110:0/517943987 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fbbb0005020 con 0x7fbbbc074d60 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc69fe740 1 -- start start 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d74f7dd0 0x5638d74f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d7502a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d7502fb0 0x5638d75053a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5638d745d380 con 0x5638d74f86f0 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5638d73f9c30 con 0x5638d7502fb0 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5638d7459340 con 0x5638d74f7dd0 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d7502a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc1c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d74f7dd0 0x5638d74f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc1c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d74f7dd0 0x5638d74f81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:58418/0 (socket says 172.21.15.110:58418) 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc1c00640 1 -- 172.21.15.110:0/3335856536 learned_addr learned my addr 172.21.15.110:0/3335856536 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbbbe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d7502fb0 0x5638d75053a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.860+0000 7fbbc1200640 1 --2- 172.21.15.110:0/3335856536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d7502a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54502/0 (socket says 172.21.15.110:54502) 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbc1c00640 1 -- 172.21.15.110:0/3335856536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d7502fb0 msgr2=0x5638d75053a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/3335856536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d7502fb0 0x5638d75053a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbc1c00640 1 -- 172.21.15.110:0/3335856536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 msgr2=0x5638d7502a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/3335856536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d7502a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbc1c00640 1 -- 172.21.15.110:0/3335856536 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d741b940 con 0x5638d74f7dd0 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/3335856536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d74f7dd0 0x5638d74f81b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbbb402aa70 tx=0x7fbbb40044e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9862b24f0dc85fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbb9600640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbba40a3dc0 0x7fbba40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbae000640 1 -- 172.21.15.110:0/3335856536 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4040070 con 0x5638d74f7dd0 2024-04-26T11:47:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbb9600640 1 -- 172.21.15.110:0/517943987 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 12857+0+0 (secure 0 0 0) 0x7fbbb00d1f50 con 0x7fbbbc074d60 2024-04-26T11:47:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbae000640 1 -- 172.21.15.110:0/3335856536 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbb40047a0 con 0x5638d74f7dd0 2024-04-26T11:47:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.861+0000 7fbbae000640 1 -- 172.21.15.110:0/3335856536 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4035040 con 0x5638d74f7dd0 2024-04-26T11:47:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc1200640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbba40a3dc0 0x7fbba40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc69fe740 1 -- 172.21.15.110:0/3335856536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d74f7dd0 msgr2=0x5638d74f81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/3335856536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d74f7dd0 0x5638d74f81b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbbb402aa70 tx=0x7fbbb40044e0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc1200640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbba40a3dc0 0x7fbba40a6280 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5638d74f9370 tx=0x7fbbb00d5a00 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc69fe740 1 -- 172.21.15.110:0/3335856536 shutdown_connections 2024-04-26T11:47:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/3335856536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d7502fb0 0x5638d75053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/3335856536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d7502a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/3335856536 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d74f7dd0 0x5638d74f81b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc69fe740 1 -- 172.21.15.110:0/3335856536 >> 172.21.15.110:0/3335856536 conn(0x5638d74f42e0 msgr2=0x5638d74f46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc69fe740 1 -- 172.21.15.110:0/3335856536 shutdown_connections 2024-04-26T11:47:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.862+0000 7fbbc69fe740 1 -- 172.21.15.110:0/3335856536 wait complete. 2024-04-26T11:47:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.863+0000 7fbbc69fe740 1 -- start start 2024-04-26T11:47:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.863+0000 7fbbc69fe740 1 Processor -- start 2024-04-26T11:47:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.863+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d74fff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.863+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d7500470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.863+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d75009b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.863+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5638d7505b80 con 0x5638d74f86f0 2024-04-26T11:47:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5638d73e4c60 con 0x5638d74f7dd0 2024-04-26T11:47:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5638d7505d00 con 0x5638d7502fb0 2024-04-26T11:47:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc69fe740 10 client.0 _ll_register_callbacks cb 0x5638d7410e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:47:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d74fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbbbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d7500470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d74fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:60452/0 (socket says 172.21.15.110:60452) 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 -- 172.21.15.110:0/1269167789 learned_addr learned my addr 172.21.15.110:0/1269167789 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d75009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 -- 172.21.15.110:0/1269167789 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 msgr2=0x5638d75009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d75009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 -- 172.21.15.110:0/1269167789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 msgr2=0x5638d7500470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d7500470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 -- 172.21.15.110:0/1269167789 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d73f3510 con 0x5638d74f7dd0 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d74fff30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbbb402ac70 tx=0x7fbbb402ac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e42518b4ee6a793 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.864+0000 7fbba2a00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbba2a00640 1 -- 172.21.15.110:0/1269167789 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4040030 con 0x5638d74f7dd0 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbba2a00640 1 -- 172.21.15.110:0/1269167789 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(161..161 src has 1..161) ==== 12857+0+0 (secure 0 0 0) 0x7fbbb40318b0 con 0x5638d74f7dd0 2024-04-26T11:47:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1269167789 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb40047a0 con 0x5638d74f7dd0 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbba2a00640 1 -- 172.21.15.110:0/1269167789 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=301) ==== 24+0+0 (secure 0 0 0) 0x7fbbb4059050 con 0x5638d74f7dd0 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbbc69fe740 10 client.26516 fetch_fsmap learned FSMap version 301 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1269167789 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=301,monmap=4+}) -- 0x5638d716f210 con 0x5638d74f7dd0 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbba2a00640 1 -- 172.21.15.110:0/1269167789 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbb40047a0 con 0x5638d74f7dd0 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbba2a00640 1 -- 172.21.15.110:0/1269167789 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 301) ==== 4119+0+0 (secure 0 0 0) 0x7fbbb403cb10 con 0x5638d74f7dd0 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbbc69fe740 10 client.26516 fetch_fsmap finished waiting for FSMap version 301 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbbc69fe740 10 client.26516 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbbc69fe740 20 client.26516 populate_metadata read hostname 'smithi110' 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5638d7512d00 0x5638d7515110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbbc69fe740 4 client.26516 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.865+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1269167789 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d746af90 con 0x5638d7512d00 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.866+0000 7fbbbbe00640 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5638d7512d00 0x5638d7515110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.866+0000 7fbbbbe00640 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5638d7512d00 0x5638d7515110 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74775c32beb1c7c server_cookie=3d701bf220b83cd in_seq=0 out_seq=0 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.866+0000 7fbba2a00640 10 client.26516 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbba2a00640 1 -- 172.21.15.110:0/1269167789 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5638d746af90 con 0x5638d7512d00 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbba2a00640 10 client.26516 handle_command_reply: tid=0 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbbc69fe740 1 client.26516 shutdown 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1269167789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 msgr2=0x5638d74fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d74fff30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbbb402ac70 tx=0x7fbbb402ac00 comp rx=0 tx=0).stop 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1269167789 shutdown_connections 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5638d7512d00 0x5638d7515110 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d75009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d7500470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbba2a00640 0 client.26516 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1269167789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d74fff30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.867+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1269167789 >> 172.21.15.110:0/1269167789 conn(0x5638d74f42e0 msgr2=0x5638d74fa060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.868+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1269167789 shutdown_connections 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.868+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1269167789 wait complete. 2024-04-26T11:47:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.868+0000 7fbbc69fe740 20 client.26516 trim_cache size 0 max 16384 2024-04-26T11:47:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc69fe740 1 Processor -- start 2024-04-26T11:47:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc69fe740 1 -- start start 2024-04-26T11:47:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d750ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d751aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d751af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1b31a0 con 0x5638d74f86f0 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1b1630 con 0x5638d74f7dd0 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1b2aa0 con 0x5638d7502fb0 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc1c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d750ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbbbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d751aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc1c00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d750ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:60460/0 (socket says 172.21.15.110:60460) 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.884+0000 7fbbc1c00640 1 -- 172.21.15.110:0/701056882 learned_addr learned my addr 172.21.15.110:0/701056882 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/701056882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d751af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbc1c00640 1 -- 172.21.15.110:0/701056882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 msgr2=0x5638d751af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/701056882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d751af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbc1c00640 1 -- 172.21.15.110:0/701056882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 msgr2=0x5638d751aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/701056882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d751aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbc1c00640 1 -- 172.21.15.110:0/701056882 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d74f8520 con 0x5638d74f7dd0 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/701056882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d750ea40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbbb403f040 tx=0x7fbbb402a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eead56c0b1835c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbad600640 1 -- 172.21.15.110:0/701056882 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4040070 con 0x5638d74f7dd0 2024-04-26T11:47:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbad600640 1 -- 172.21.15.110:0/701056882 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbb4009780 con 0x5638d74f7dd0 2024-04-26T11:47:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.885+0000 7fbbad600640 1 -- 172.21.15.110:0/701056882 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb404c040 con 0x5638d74f7dd0 2024-04-26T11:47:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.886+0000 7fbbc69fe740 1 -- 172.21.15.110:0/701056882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 msgr2=0x5638d750ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.886+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/701056882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d750ea40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbbb403f040 tx=0x7fbbb402a480 comp rx=0 tx=0).stop 2024-04-26T11:47:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.886+0000 7fbbc69fe740 1 -- 172.21.15.110:0/701056882 shutdown_connections 2024-04-26T11:47:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.886+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/701056882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d751af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.886+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/701056882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f86f0 0x5638d751aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.886+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/701056882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f7dd0 0x5638d750ea40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.886+0000 7fbbc69fe740 1 -- 172.21.15.110:0/701056882 >> 172.21.15.110:0/701056882 conn(0x5638d74f42e0 msgr2=0x5638d74fb290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.886+0000 7fbbc69fe740 1 -- 172.21.15.110:0/701056882 shutdown_connections 2024-04-26T11:47:23.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.886+0000 7fbbc69fe740 1 -- 172.21.15.110:0/701056882 wait complete. 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc69fe740 1 -- start start 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc69fe740 1 Processor -- start 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f7dd0 0x5638d74fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f86f0 0x5638d74fd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc69fe740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d74fd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1b23d0 con 0x5638d74f7dd0 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc1b1d00 con 0x5638d74f86f0 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc69fe740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5638d7459340 con 0x5638d7502fb0 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc69fe740 10 client.0 _ll_register_callbacks cb 0x7fbbb00d58d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.887+0000 7fbbc1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f7dd0 0x5638d74fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f7dd0 0x5638d74fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54524/0 (socket says 172.21.15.110:54524) 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc1c00640 1 -- 172.21.15.110:0/1348819279 learned_addr learned my addr 172.21.15.110:0/1348819279 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d74fd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbbbe00640 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f86f0 0x5638d74fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc1c00640 1 -- 172.21.15.110:0/1348819279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 msgr2=0x5638d74fd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d74fd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc1c00640 1 -- 172.21.15.110:0/1348819279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f86f0 msgr2=0x5638d74fd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f86f0 0x5638d74fd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc1c00640 1 -- 172.21.15.110:0/1348819279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d723b620 con 0x5638d74f7dd0 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc1c00640 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f7dd0 0x5638d74fccd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4005c40 tx=0x7fbbb4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2e9979e80590b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbba2a00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbba2a00640 1 -- 172.21.15.110:0/1348819279 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4040040 con 0x5638d74f7dd0 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbba2a00640 1 -- 172.21.15.110:0/1348819279 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(161..161 src has 1..161) ==== 12857+0+0 (secure 0 0 0) 0x7fbbb403c780 con 0x5638d74f7dd0 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.888+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1348819279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb4009780 con 0x5638d74f7dd0 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbba2a00640 1 -- 172.21.15.110:0/1348819279 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=301) ==== 24+0+0 (secure 0 0 0) 0x7fbbb4035040 con 0x5638d74f7dd0 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbbc69fe740 10 client.16254 fetch_fsmap learned FSMap version 301 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1348819279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=301,monmap=4+}) -- 0x5638d7417cb0 con 0x5638d74f7dd0 2024-04-26T11:47:23.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbba2a00640 1 -- 172.21.15.110:0/1348819279 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbb4009780 con 0x5638d74f7dd0 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbba2a00640 1 -- 172.21.15.110:0/1348819279 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 301) ==== 4119+0+0 (secure 0 0 0) 0x7fbbb405c070 con 0x5638d74f7dd0 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbbc69fe740 10 client.16254 fetch_fsmap finished waiting for FSMap version 301 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbbc69fe740 10 client.16254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbbc69fe740 20 client.16254 populate_metadata read hostname 'smithi110' 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5638d75798c0 0x5638d757bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbbc69fe740 4 client.16254 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1348819279 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5638d7464e00 con 0x5638d75798c0 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.889+0000 7fbbbbe00640 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5638d75798c0 0x5638d757bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.890+0000 7fbbbbe00640 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5638d75798c0 0x5638d757bce0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5dd40fbea39184b server_cookie=93869368825985d in_seq=0 out_seq=0 2024-04-26T11:47:23.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:23.890+0000 7fbba2a00640 10 client.16254 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:23.987 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:23 smithi110 ceph-mon[28069]: pgmap v559: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 1.9 MiB/s wr, 260 op/s 2024-04-26T11:47:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:23 smithi196 ceph-mon[32572]: pgmap v559: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 1.9 MiB/s wr, 260 op/s 2024-04-26T11:47:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:23 smithi193 ceph-mon[32782]: pgmap v559: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 1.9 MiB/s wr, 260 op/s 2024-04-26T11:47:24.684 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:24 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:47:24.684 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:24 smithi110 systemd[1]: Stopped Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:24.684 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:24 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 2.004s CPU time. 2024-04-26T11:47:24.684 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:24 smithi110 systemd[1]: Starting Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:47:24.926 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 910.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:47:24.977 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:24 smithi110 podman[96074]: 2024-04-26 11:47:24.588458892 +0000 UTC m=+0.035488220 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:47:24.977 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:24 smithi110 podman[96074]: 2024-04-26 11:47:24.707033017 +0000 UTC m=+0.154062380 container create d0600be4afdc9583f57b53f5300ce40e577431f1b210612c3ccffd0e44d408f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-26T11:47:24.977 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:24 smithi110 podman[96074]: 2024-04-26 11:47:24.976449501 +0000 UTC m=+0.423478837 container init d0600be4afdc9583f57b53f5300ce40e577431f1b210612c3ccffd0e44d408f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-26T11:47:25.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:24 smithi110 podman[96074]: 2024-04-26 11:47:24.983539061 +0000 UTC m=+0.430568384 container start d0600be4afdc9583f57b53f5300ce40e577431f1b210612c3ccffd0e44d408f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-26T11:47:25.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mds[96093]: -- 172.21.15.110:0/2580866495 <== mon.2 v2:172.21.15.193:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e70af07a40 con 0x55e70aeda800 2024-04-26T11:47:25.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: starting mds.a at 2024-04-26T11:47:25.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:25 smithi110 bash[96074]: d0600be4afdc9583f57b53f5300ce40e577431f1b210612c3ccffd0e44d408f3 2024-04-26T11:47:25.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:25 smithi110 systemd[1]: Started Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mon[28069]: pgmap v560: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 2.1 MiB/s wr, 278 op/s 2024-04-26T11:47:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mon[28069]: daemon mds.a restarted 2024-04-26T11:47:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:47:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mon[28069]: osdmap e162: 12 total, 12 up, 12 in 2024-04-26T11:47:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:boot 2024-04-26T11:47:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mon[28069]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:47:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:47:26.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:25 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:replay} 2 up:standby-replay 2024-04-26T11:47:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:25 smithi193 ceph-mon[32782]: pgmap v560: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 2.1 MiB/s wr, 278 op/s 2024-04-26T11:47:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:25 smithi193 ceph-mon[32782]: daemon mds.a restarted 2024-04-26T11:47:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:25 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:47:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:25 smithi193 ceph-mon[32782]: osdmap e162: 12 total, 12 up, 12 in 2024-04-26T11:47:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:25 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:boot 2024-04-26T11:47:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:25 smithi193 ceph-mon[32782]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:47:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:25 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:47:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:25 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:replay} 2 up:standby-replay 2024-04-26T11:47:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:25 smithi196 ceph-mon[32572]: pgmap v560: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 2.1 MiB/s wr, 278 op/s 2024-04-26T11:47:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:25 smithi196 ceph-mon[32572]: daemon mds.a restarted 2024-04-26T11:47:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:25 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:47:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:25 smithi196 ceph-mon[32572]: osdmap e162: 12 total, 12 up, 12 in 2024-04-26T11:47:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:25 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:boot 2024-04-26T11:47:26.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:25 smithi196 ceph-mon[32572]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:47:26.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:25 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 2 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:26.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:47:26.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:25 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:replay} 2 up:standby-replay 2024-04-26T11:47:27.365 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:27 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:resolve 2024-04-26T11:47:27.365 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:27 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:resolve} 2 up:standby-replay 2024-04-26T11:47:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:27 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:resolve 2024-04-26T11:47:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:27 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:resolve} 2 up:standby-replay 2024-04-26T11:47:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:27 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:resolve 2024-04-26T11:47:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:27 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=a=up:resolve} 2 up:standby-replay 2024-04-26T11:47:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:28 smithi193 ceph-mon[32782]: pgmap v562: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2024-04-26T11:47:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:28 smithi196 ceph-mon[32572]: pgmap v562: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2024-04-26T11:47:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:28 smithi110 ceph-mon[28069]: pgmap v562: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2024-04-26T11:47:29.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:29 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 6. 2024-04-26T11:47:29.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:29 smithi193 systemd[1]: Stopped Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:29.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:29 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Start request repeated too quickly. 2024-04-26T11:47:29.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:29 smithi193 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T11:47:29.622 INFO:journalctl@ceph.mds.k.smithi193.stdout:Apr 26 11:47:29 smithi193 systemd[1]: Failed to start Ceph mds.k for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:29.927 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:47:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:30 smithi193 ceph-mon[32782]: pgmap v563: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 809 KiB/s wr, 107 op/s 2024-04-26T11:47:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:30 smithi196 ceph-mon[32572]: pgmap v563: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 809 KiB/s wr, 107 op/s 2024-04-26T11:47:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:30 smithi110 ceph-mon[28069]: pgmap v563: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 809 KiB/s wr, 107 op/s 2024-04-26T11:47:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:32 smithi193 ceph-mon[32782]: pgmap v564: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 809 KiB/s wr, 107 op/s 2024-04-26T11:47:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:32 smithi196 ceph-mon[32572]: pgmap v564: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 809 KiB/s wr, 107 op/s 2024-04-26T11:47:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:32 smithi110 ceph-mon[28069]: pgmap v564: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 809 KiB/s wr, 107 op/s 2024-04-26T11:47:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:34 smithi193 ceph-mon[32782]: pgmap v565: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 658 KiB/s wr, 88 op/s 2024-04-26T11:47:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:34 smithi193 ceph-mon[32782]: Replacing daemon mds.k as rank 1 with standby daemon mds.g 2024-04-26T11:47:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:34 smithi193 ceph-mon[32782]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-04-26T11:47:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:34 smithi193 ceph-mon[32782]: osdmap e163: 12 total, 12 up, 12 in 2024-04-26T11:47:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:34 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:47:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:34 smithi196 ceph-mon[32572]: pgmap v565: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 658 KiB/s wr, 88 op/s 2024-04-26T11:47:34.545 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:34 smithi196 ceph-mon[32572]: Replacing daemon mds.k as rank 1 with standby daemon mds.g 2024-04-26T11:47:34.545 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:34 smithi196 ceph-mon[32572]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-04-26T11:47:34.545 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:34 smithi196 ceph-mon[32572]: osdmap e163: 12 total, 12 up, 12 in 2024-04-26T11:47:34.545 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:34 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:47:34.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:34 smithi110 ceph-mon[28069]: pgmap v565: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 658 KiB/s wr, 88 op/s 2024-04-26T11:47:34.546 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:34 smithi110 ceph-mon[28069]: Replacing daemon mds.k as rank 1 with standby daemon mds.g 2024-04-26T11:47:34.546 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:34 smithi110 ceph-mon[28069]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-04-26T11:47:34.546 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:34 smithi110 ceph-mon[28069]: osdmap e163: 12 total, 12 up, 12 in 2024-04-26T11:47:34.546 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:34 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:47:34.923 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T11:47:36.111 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:35 smithi110 ceph-mon[28069]: pgmap v567: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 454 KiB/s wr, 62 op/s 2024-04-26T11:47:36.111 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:35 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:resolve 2024-04-26T11:47:36.111 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:35 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:47:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:35 smithi193 ceph-mon[32782]: pgmap v567: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 454 KiB/s wr, 62 op/s 2024-04-26T11:47:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:35 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:resolve 2024-04-26T11:47:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:35 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:47:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:35 smithi196 ceph-mon[32572]: pgmap v567: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 454 KiB/s wr, 62 op/s 2024-04-26T11:47:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:35 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:resolve 2024-04-26T11:47:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:35 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:47:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.905+0000 7fbba2a00640 1 -- 172.21.15.110:0/1348819279 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5638d7464e00 con 0x5638d75798c0 2024-04-26T11:47:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.905+0000 7fbba2a00640 10 client.16254 handle_command_reply: tid=0 2024-04-26T11:47:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.905+0000 7fbbc69fe740 1 client.16254 shutdown 2024-04-26T11:47:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.906+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1348819279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f7dd0 msgr2=0x5638d74fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.906+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f7dd0 0x5638d74fccd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4005c40 tx=0x7fbbb4005850 comp rx=0 tx=0).stop 2024-04-26T11:47:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.906+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1348819279 shutdown_connections 2024-04-26T11:47:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.906+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x5638d75798c0 0x5638d757bce0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.906+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5638d7502fb0 0x5638d74fd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.906+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5638d74f86f0 0x5638d74fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.906+0000 7fbbc69fe740 1 --2- 172.21.15.110:0/1348819279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5638d74f7dd0 0x5638d74fccd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.906+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1348819279 >> 172.21.15.110:0/1348819279 conn(0x5638d74f42e0 msgr2=0x5638d74ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.907+0000 7fbba2a00640 0 client.16254 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.907+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1348819279 shutdown_connections 2024-04-26T11:47:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.907+0000 7fbbc69fe740 1 -- 172.21.15.110:0/1348819279 wait complete. 2024-04-26T11:47:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.907+0000 7fbbc69fe740 20 client.16254 trim_cache size 0 max 16384 2024-04-26T11:47:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:47:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:47:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:47:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:47:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 -- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbba40a3dc0 msgr2=0x7fbba40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbba40a3dc0 0x7fbba40a6280 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5638d74f9370 tx=0x7fbbb00d5a00 comp rx=0 tx=0).stop 2024-04-26T11:47:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 -- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc074d60 msgr2=0x7fbbbc19b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc074d60 0x7fbbbc19b290 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000eb90 tx=0x7fbbb000c6a0 comp rx=0 tx=0).stop 2024-04-26T11:47:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 -- 172.21.15.110:0/517943987 shutdown_connections 2024-04-26T11:47:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fbba40a3dc0 0x7fbba40a6280 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbbc10f170 0x7fbbbc19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbbc075680 0x7fbbbc19b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 --2- 172.21.15.110:0/517943987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbbc074d60 0x7fbbbc19b290 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.908+0000 7fbbc3c00640 1 -- 172.21.15.110:0/517943987 >> 172.21.15.110:0/517943987 conn(0x7fbbbc0fe3c0 msgr2=0x7fbbbc0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.909+0000 7fbbc3c00640 1 -- 172.21.15.110:0/517943987 shutdown_connections 2024-04-26T11:47:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:36.909+0000 7fbbc3c00640 1 -- 172.21.15.110:0/517943987 wait complete. 2024-04-26T11:47:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:36 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:47:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:36 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:reconnect 2024-04-26T11:47:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:36 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:reconnect 2024-04-26T11:47:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:36 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 2024-04-26T11:47:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:36 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:47:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:36 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:47:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:36 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:47:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:36 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:reconnect 2024-04-26T11:47:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:36 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:reconnect 2024-04-26T11:47:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:36 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 2024-04-26T11:47:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:36 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:47:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:36 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:47:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:36 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00199997 2024-04-26T11:47:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:36 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:reconnect 2024-04-26T11:47:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:36 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:reconnect 2024-04-26T11:47:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:36 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 2024-04-26T11:47:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:36 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0189997 2024-04-26T11:47:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:36 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0199997 2024-04-26T11:47:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:37 smithi196 ceph-mon[32572]: pgmap v568: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 440 KiB/s wr, 60 op/s 2024-04-26T11:47:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:37 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:rejoin 2024-04-26T11:47:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:37 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:rejoin 2024-04-26T11:47:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:37 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 2024-04-26T11:47:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:37 smithi196 ceph-mon[32572]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T11:47:38.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:37 smithi193 ceph-mon[32782]: pgmap v568: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 440 KiB/s wr, 60 op/s 2024-04-26T11:47:38.274 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:37 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:rejoin 2024-04-26T11:47:38.274 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:37 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:rejoin 2024-04-26T11:47:38.274 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:37 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 2024-04-26T11:47:38.274 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:37 smithi193 ceph-mon[32782]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T11:47:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:37 smithi110 ceph-mon[28069]: pgmap v568: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 440 KiB/s wr, 60 op/s 2024-04-26T11:47:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:37 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:rejoin 2024-04-26T11:47:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:37 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:rejoin 2024-04-26T11:47:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:37 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 2024-04-26T11:47:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:37 smithi110 ceph-mon[28069]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T11:47:39.106 INFO:teuthology.orchestra.run.smithi110.stdout:transaction type: 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:scaling factor: 32 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:query mode: simple 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:number of clients: 100 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:number of threads: 4 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:duration: 900 s 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:number of transactions actually processed: 757352 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:latency average = 121.976 ms 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:latency stddev = 1324.190 ms 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:tps = 819.481054 (including connections establishing) 2024-04-26T11:47:39.107 INFO:teuthology.orchestra.run.smithi110.stdout:tps = 819.486814 (excluding connections establishing) 2024-04-26T11:47:39.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-04-26T11:47:39.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:active 2024-04-26T11:47:39.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:clientreplay 2024-04-26T11:47:39.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:clientreplay} 1 up:standby-replay 2024-04-26T11:47:39.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-mon[28069]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:47:39.193 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb317800700 time 2024-04-26T11:47:38.947598+0000 2024-04-26T11:47:39.193 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:39.193 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:39.193 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb32312e3dd] 2024-04-26T11:47:39.193 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb32312e5a3] 2024-04-26T11:47:39.193 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e6d7398822] 2024-04-26T11:47:39.193 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e6d7308598] 2024-04-26T11:47:39.193 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e6d730ac17] 2024-04-26T11:47:39.194 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e6d7203d0b] 2024-04-26T11:47:39.194 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e6d72042ac] 2024-04-26T11:47:39.194 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e6d71ecfad] 2024-04-26T11:47:39.194 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb3233c2e20] 2024-04-26T11:47:39.194 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 10: (DispatchQueue::entry()+0x51f) [0x7fb3233bffdf] 2024-04-26T11:47:39.194 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb323492fc1] 2024-04-26T11:47:39.194 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb321eac1ca] 2024-04-26T11:47:39.194 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 13: clone() 2024-04-26T11:47:39.194 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:38.948+0000 7fb317800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb317800700 time 2024-04-26T11:47:38.947598+0000 2024-04-26T11:47:39.195 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:39.195 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.196 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:39.196 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb32312e3dd] 2024-04-26T11:47:39.196 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb32312e5a3] 2024-04-26T11:47:39.196 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e6d7398822] 2024-04-26T11:47:39.196 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e6d7308598] 2024-04-26T11:47:39.196 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e6d730ac17] 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e6d7203d0b] 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e6d72042ac] 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e6d71ecfad] 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb3233c2e20] 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 10: (DispatchQueue::entry()+0x51f) [0x7fb3233bffdf] 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb323492fc1] 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb321eac1ca] 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 13: clone() 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: *** Caught signal (Aborted) ** 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: in thread 7fb317800700 thread_name:ms_dispatch 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:39.197 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb321eb6d20] 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2: gsignal() 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 3: abort() 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb32312e437] 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb32312e5a3] 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e6d7398822] 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e6d7308598] 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e6d730ac17] 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e6d7203d0b] 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e6d72042ac] 2024-04-26T11:47:39.198 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e6d71ecfad] 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb3233c2e20] 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 13: (DispatchQueue::entry()+0x51f) [0x7fb3233bffdf] 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb323492fc1] 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb321eac1ca] 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 16: clone() 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:38.950+0000 7fb317800700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: in thread 7fb317800700 thread_name:ms_dispatch 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb321eb6d20] 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2: gsignal() 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 3: abort() 2024-04-26T11:47:39.199 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb32312e437] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb32312e5a3] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e6d7398822] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e6d7308598] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e6d730ac17] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e6d7203d0b] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e6d72042ac] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e6d71ecfad] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb3233c2e20] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 13: (DispatchQueue::entry()+0x51f) [0x7fb3233bffdf] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb323492fc1] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb321eac1ca] 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 16: clone() 2024-04-26T11:47:39.200 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:38 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: -1> 2024-04-26T11:47:38.948+0000 7fb317800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb317800700 time 2024-04-26T11:47:38.947598+0000 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb32312e3dd] 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb32312e5a3] 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e6d7398822] 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e6d7308598] 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e6d730ac17] 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e6d7203d0b] 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e6d72042ac] 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e6d71ecfad] 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb3233c2e20] 2024-04-26T11:47:39.201 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 10: (DispatchQueue::entry()+0x51f) [0x7fb3233bffdf] 2024-04-26T11:47:39.202 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb323492fc1] 2024-04-26T11:47:39.202 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb321eac1ca] 2024-04-26T11:47:39.202 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 13: clone() 2024-04-26T11:47:39.202 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.203 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 0> 2024-04-26T11:47:38.950+0000 7fb317800700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:39.203 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: in thread 7fb317800700 thread_name:ms_dispatch 2024-04-26T11:47:39.203 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.203 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:39.203 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb321eb6d20] 2024-04-26T11:47:39.203 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2: gsignal() 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 3: abort() 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb32312e437] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb32312e5a3] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e6d7398822] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e6d7308598] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e6d730ac17] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e6d7203d0b] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e6d72042ac] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e6d71ecfad] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb3233c2e20] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 13: (DispatchQueue::entry()+0x51f) [0x7fb3233bffdf] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb323492fc1] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb321eac1ca] 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 16: clone() 2024-04-26T11:47:39.204 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:39.205 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.205 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: -1> 2024-04-26T11:47:38.948+0000 7fb317800700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fb317800700 time 2024-04-26T11:47:38.947598+0000 2024-04-26T11:47:39.205 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:39.205 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.205 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:39.205 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fb32312e3dd] 2024-04-26T11:47:39.205 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb32312e5a3] 2024-04-26T11:47:39.205 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e6d7398822] 2024-04-26T11:47:39.206 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e6d7308598] 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e6d730ac17] 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e6d7203d0b] 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e6d72042ac] 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e6d71ecfad] 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb3233c2e20] 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 10: (DispatchQueue::entry()+0x51f) [0x7fb3233bffdf] 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb323492fc1] 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fb321eac1ca] 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 13: clone() 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 0> 2024-04-26T11:47:38.950+0000 7fb317800700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: in thread 7fb317800700 thread_name:ms_dispatch 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:39.207 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb321eb6d20] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2: gsignal() 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 3: abort() 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fb32312e437] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fb32312e5a3] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e6d7398822] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e6d7308598] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e6d730ac17] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e6d7203d0b] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e6d72042ac] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e6d71ecfad] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fb3233c2e20] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 13: (DispatchQueue::entry()+0x51f) [0x7fb3233bffdf] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fb323492fc1] 2024-04-26T11:47:39.208 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fb321eac1ca] 2024-04-26T11:47:39.209 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 16: clone() 2024-04-26T11:47:39.209 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:39.209 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96089]: 2024-04-26T11:47:39.209 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:39 smithi110 podman[96132]: 2024-04-26 11:47:39.121240655 +0000 UTC m=+0.039024099 container died d0600be4afdc9583f57b53f5300ce40e577431f1b210612c3ccffd0e44d408f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-26T11:47:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:38 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:active 2024-04-26T11:47:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:38 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:clientreplay 2024-04-26T11:47:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:38 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:clientreplay} 1 up:standby-replay 2024-04-26T11:47:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:38 smithi196 ceph-mon[32572]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:47:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:38 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3136930564,v1:172.21.15.110:6837/3136930564] up:active 2024-04-26T11:47:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:38 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:clientreplay 2024-04-26T11:47:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:38 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:clientreplay} 1 up:standby-replay 2024-04-26T11:47:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:38 smithi193 ceph-mon[32782]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:47:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:39 smithi196 ceph-mon[32572]: pgmap v569: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-04-26T11:47:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:39 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:47:40.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:39 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:active 2024-04-26T11:47:40.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:39 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 2024-04-26T11:47:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-mon[28069]: pgmap v569: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-04-26T11:47:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:47:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:active 2024-04-26T11:47:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:39 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 2024-04-26T11:47:40.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:40 smithi110 podman[96132]: 2024-04-26 11:47:40.016062359 +0000 UTC m=+0.933845847 container remove d0600be4afdc9583f57b53f5300ce40e577431f1b210612c3ccffd0e44d408f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , ceph=True) 2024-04-26T11:47:40.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:40 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:47:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:39 smithi193 ceph-mon[32782]: pgmap v569: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-04-26T11:47:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:39 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:47:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:39 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/2116625321,v1:172.21.15.110:6835/2116625321] up:active 2024-04-26T11:47:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:39 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 2024-04-26T11:47:40.791 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:40 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-04-26T11:47:40.792 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:40 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 2.104s CPU time. 2024-04-26T11:47:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:41 smithi196 ceph-mon[32572]: pgmap v570: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-04-26T11:47:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:41 smithi110 ceph-mon[28069]: pgmap v570: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-04-26T11:47:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:41 smithi193 ceph-mon[32782]: pgmap v570: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-04-26T11:47:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:43 smithi196 ceph-mon[32572]: pgmap v571: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 KiB/s wr, 16 op/s 2024-04-26T11:47:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:43 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 2024-04-26T11:47:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:43 smithi110 ceph-mon[28069]: pgmap v571: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 KiB/s wr, 16 op/s 2024-04-26T11:47:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:43 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 2024-04-26T11:47:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:43 smithi193 ceph-mon[32782]: pgmap v571: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 KiB/s wr, 16 op/s 2024-04-26T11:47:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:43 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 2024-04-26T11:47:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:45 smithi196 ceph-mon[32572]: pgmap v572: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-04-26T11:47:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:47:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:45 smithi110 ceph-mon[28069]: pgmap v572: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-04-26T11:47:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:47:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:45 smithi193 ceph-mon[32782]: pgmap v572: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-04-26T11:47:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:47:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:47:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:47:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:46 smithi196 ceph-mon[32572]: pgmap v573: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-04-26T11:47:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:46 smithi196 ceph-mon[32572]: pgmap v574: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 52 KiB/s wr, 20 op/s 2024-04-26T11:47:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:47:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:47:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:47:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:46 smithi110 ceph-mon[28069]: pgmap v573: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-04-26T11:47:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:46 smithi110 ceph-mon[28069]: pgmap v574: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 52 KiB/s wr, 20 op/s 2024-04-26T11:47:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:47:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:47:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:47:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:46 smithi193 ceph-mon[32782]: pgmap v573: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-04-26T11:47:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:46 smithi193 ceph-mon[32782]: pgmap v574: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 52 KiB/s wr, 20 op/s 2024-04-26T11:47:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:47:48.044 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5034600700 time 2024-04-26T11:47:47.669026+0000 2024-04-26T11:47:48.044 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:48.044 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:48.044 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f503ffda3dd] 2024-04-26T11:47:48.044 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f503ffda5a3] 2024-04-26T11:47:48.044 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5623c1700822] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5623c1670598] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5623c1672c17] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5623c156bd0b] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5623c156c2ac] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5623c1554fad] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f504026ee20] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 10: (DispatchQueue::entry()+0x51f) [0x7f504026bfdf] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f504033efc1] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f503ed581ca] 2024-04-26T11:47:48.045 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 13: clone() 2024-04-26T11:47:48.046 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:47.672+0000 7f5034600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5034600700 time 2024-04-26T11:47:47.669026+0000 2024-04-26T11:47:48.046 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:48.046 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f503ffda3dd] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f503ffda5a3] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5623c1700822] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5623c1670598] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5623c1672c17] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5623c156bd0b] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5623c156c2ac] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5623c1554fad] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f504026ee20] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 10: (DispatchQueue::entry()+0x51f) [0x7f504026bfdf] 2024-04-26T11:47:48.047 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f504033efc1] 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f503ed581ca] 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 13: clone() 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: *** Caught signal (Aborted) ** 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: in thread 7f5034600700 thread_name:ms_dispatch 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f503ed62d20] 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2: gsignal() 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 3: abort() 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f503ffda437] 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f503ffda5a3] 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5623c1700822] 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5623c1670598] 2024-04-26T11:47:48.048 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5623c1672c17] 2024-04-26T11:47:48.049 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5623c156bd0b] 2024-04-26T11:47:48.049 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5623c156c2ac] 2024-04-26T11:47:48.049 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5623c1554fad] 2024-04-26T11:47:48.049 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f504026ee20] 2024-04-26T11:47:48.049 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 13: (DispatchQueue::entry()+0x51f) [0x7f504026bfdf] 2024-04-26T11:47:48.049 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f504033efc1] 2024-04-26T11:47:48.049 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f503ed581ca] 2024-04-26T11:47:48.049 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 16: clone() 2024-04-26T11:47:48.049 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:47.677+0000 7f5034600700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: in thread 7f5034600700 thread_name:ms_dispatch 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f503ed62d20] 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2: gsignal() 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 3: abort() 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f503ffda437] 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f503ffda5a3] 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5623c1700822] 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5623c1670598] 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5623c1672c17] 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5623c156bd0b] 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5623c156c2ac] 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5623c1554fad] 2024-04-26T11:47:48.050 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f504026ee20] 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 13: (DispatchQueue::entry()+0x51f) [0x7f504026bfdf] 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f504033efc1] 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f503ed581ca] 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 16: clone() 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: -1> 2024-04-26T11:47:47.672+0000 7f5034600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5034600700 time 2024-04-26T11:47:47.669026+0000 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.051 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f503ffda3dd] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f503ffda5a3] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5623c1700822] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5623c1670598] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5623c1672c17] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5623c156bd0b] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5623c156c2ac] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5623c1554fad] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f504026ee20] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 10: (DispatchQueue::entry()+0x51f) [0x7f504026bfdf] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f504033efc1] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f503ed581ca] 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 13: clone() 2024-04-26T11:47:48.052 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 0> 2024-04-26T11:47:47.677+0000 7f5034600700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: in thread 7f5034600700 thread_name:ms_dispatch 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f503ed62d20] 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2: gsignal() 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 3: abort() 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f503ffda437] 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f503ffda5a3] 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5623c1700822] 2024-04-26T11:47:48.053 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5623c1670598] 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5623c1672c17] 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5623c156bd0b] 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5623c156c2ac] 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5623c1554fad] 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f504026ee20] 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 13: (DispatchQueue::entry()+0x51f) [0x7f504026bfdf] 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f504033efc1] 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f503ed581ca] 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 16: clone() 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: -2> 2024-04-26T11:47:47.672+0000 7f5034600700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5034600700 time 2024-04-26T11:47:47.669026+0000 2024-04-26T11:47:48.054 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:47:48.055 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.055 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:48.055 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f503ffda3dd] 2024-04-26T11:47:48.055 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f503ffda5a3] 2024-04-26T11:47:48.055 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5623c1700822] 2024-04-26T11:47:48.055 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5623c1670598] 2024-04-26T11:47:48.055 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5623c1672c17] 2024-04-26T11:47:48.055 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5623c156bd0b] 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5623c156c2ac] 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5623c1554fad] 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f504026ee20] 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 10: (DispatchQueue::entry()+0x51f) [0x7f504026bfdf] 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f504033efc1] 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f503ed581ca] 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 13: clone() 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: -1> 2024-04-26T11:47:47.677+0000 7f5034600700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: in thread 7f5034600700 thread_name:ms_dispatch 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:47:48.056 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f503ed62d20] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2: gsignal() 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 3: abort() 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f503ffda437] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f503ffda5a3] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5623c1700822] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5623c1670598] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5623c1672c17] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5623c156bd0b] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5623c156c2ac] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5623c1554fad] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f504026ee20] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 13: (DispatchQueue::entry()+0x51f) [0x7f504026bfdf] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f504033efc1] 2024-04-26T11:47:48.057 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f503ed581ca] 2024-04-26T11:47:48.058 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 16: clone() 2024-04-26T11:47:48.058 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:47:48.058 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[95897]: 2024-04-26T11:47:48.058 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:47 smithi110 podman[96326]: 2024-04-26 11:47:47.850801471 +0000 UTC m=+0.037713819 container died d09a69e37edf593a9684b0dc6256eb1cb7489d14988920ba08c51354209e5412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T11:47:49.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:48 smithi110 podman[96326]: 2024-04-26 11:47:48.563233584 +0000 UTC m=+0.750145964 container remove d09a69e37edf593a9684b0dc6256eb1cb7489d14988920ba08c51354209e5412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:47:49.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:48 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:47:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:49 smithi110 ceph-mon[28069]: pgmap v575: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-04-26T11:47:49.542 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:49 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-04-26T11:47:49.542 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:49 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Consumed 2.116s CPU time. 2024-04-26T11:47:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:49 smithi193 ceph-mon[32782]: pgmap v575: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-04-26T11:47:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:49 smithi196 ceph-mon[32572]: pgmap v575: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-04-26T11:47:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.056+0000 7fddabe00640 1 -- 172.21.15.110:0/836665488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac105330 msgr2=0x7fddac111840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.056+0000 7fddabe00640 1 --2- 172.21.15.110:0/836665488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac105330 0x7fddac111840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009c10 tx=0x7fdda402a6f0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.056+0000 7fddabe00640 1 -- 172.21.15.110:0/836665488 shutdown_connections 2024-04-26T11:47:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.056+0000 7fddabe00640 1 --2- 172.21.15.110:0/836665488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac105330 0x7fddac111840 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.056+0000 7fddabe00640 1 --2- 172.21.15.110:0/836665488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac104970 0x7fddac104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.056+0000 7fddabe00640 1 --2- 172.21.15.110:0/836665488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddac10a980 0x7fddac10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.056+0000 7fddabe00640 1 -- 172.21.15.110:0/836665488 >> 172.21.15.110:0/836665488 conn(0x7fddac100440 msgr2=0x7fddac102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.056+0000 7fddabe00640 1 -- 172.21.15.110:0/836665488 shutdown_connections 2024-04-26T11:47:50.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.056+0000 7fddabe00640 1 -- 172.21.15.110:0/836665488 wait complete. 2024-04-26T11:47:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.057+0000 7fddabe00640 1 Processor -- start 2024-04-26T11:47:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.057+0000 7fddabe00640 1 -- start start 2024-04-26T11:47:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddabe00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddac104970 0x7fddac19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddabe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac105330 0x7fddac19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddabe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac10a980 0x7fddac19fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddabe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fddac114c40 con 0x7fddac10a980 2024-04-26T11:47:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddabe00640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fddac114ac0 con 0x7fddac104970 2024-04-26T11:47:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddabe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fddac114dc0 con 0x7fddac105330 2024-04-26T11:47:50.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddaaa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddac104970 0x7fddac19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddaaa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddac104970 0x7fddac19b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:50406/0 (socket says 172.21.15.110:50406) 2024-04-26T11:47:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddaaa00640 1 -- 172.21.15.110:0/254464074 learned_addr learned my addr 172.21.15.110:0/254464074 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddab400640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac10a980 0x7fddac19fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.061 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.058+0000 7fddaa000640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac105330 0x7fddac19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fddaaa00640 1 -- 172.21.15.110:0/254464074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac105330 msgr2=0x7fddac19b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fddaaa00640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac105330 0x7fddac19b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fddaaa00640 1 -- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac10a980 msgr2=0x7fddac19fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fddaaa00640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac10a980 0x7fddac19fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.062 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fddaaa00640 1 -- 172.21.15.110:0/254464074 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac1a0130 con 0x7fddac104970 2024-04-26T11:47:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fddaa000640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac105330 0x7fddac19b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:47:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fddaaa00640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddac104970 0x7fddac19b140 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00e9f0 tx=0x7fdd9c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fdda3400640 1 -- 172.21.15.110:0/254464074 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00cd80 con 0x7fddac104970 2024-04-26T11:47:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fddabe00640 1 -- 172.21.15.110:0/254464074 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddac1a0420 con 0x7fddac104970 2024-04-26T11:47:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fdda3400640 1 -- 172.21.15.110:0/254464074 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd9c0108e0 con 0x7fddac104970 2024-04-26T11:47:50.063 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.059+0000 7fdda3400640 1 -- 172.21.15.110:0/254464074 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c018980 con 0x7fddac104970 2024-04-26T11:47:50.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.060+0000 7fddabe00640 1 -- 172.21.15.110:0/254464074 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddac1a7cb0 con 0x7fddac104970 2024-04-26T11:47:50.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.063+0000 7fdda3400640 1 -- 172.21.15.110:0/254464074 <== mon.2 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fdd9c010430 con 0x7fddac104970 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.063+0000 7fddb498a740 1 Processor -- start 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.063+0000 7fddb498a740 1 -- start start 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.063+0000 7fddb498a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c3283c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.063+0000 7fddb498a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c328900 0x56452c332c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.063+0000 7fddb498a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c3355b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.063+0000 7fddb498a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56452c28d380 con 0x56452c3331c0 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.063+0000 7fddb498a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56452c229c30 con 0x56452c328900 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.063+0000 7fddb498a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56452c289340 con 0x56452c327fe0 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c3355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaaa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c328900 0x56452c332c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddab400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c3283c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaaa00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c328900 0x56452c332c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.110:50408/0 (socket says 172.21.15.110:50408) 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaaa00640 1 -- 172.21.15.110:0/4086421479 learned_addr learned my addr 172.21.15.110:0/4086421479 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c3355b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35612/0 (socket says 172.21.15.110:35612) 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaaa00640 1 -- 172.21.15.110:0/4086421479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 msgr2=0x56452c3283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaaa00640 1 --2- 172.21.15.110:0/4086421479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c3283c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaaa00640 1 -- 172.21.15.110:0/4086421479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 msgr2=0x56452c3355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaaa00640 1 --2- 172.21.15.110:0/4086421479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c3355b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaaa00640 1 -- 172.21.15.110:0/4086421479 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452c24b940 con 0x56452c328900 2024-04-26T11:47:50.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaa000640 1 --2- 172.21.15.110:0/4086421479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c3355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:47:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.064+0000 7fddaaa00640 1 --2- 172.21.15.110:0/4086421479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c328900 0x56452c332c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0ce1a0 tx=0x7fdd9c0da7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aa79efc9ad0e022 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.065+0000 7fdda3400640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdd900a3d10 0x7fdd900a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.065+0000 7fdd97e00640 1 -- 172.21.15.110:0/4086421479 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c098d50 con 0x56452c328900 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.065+0000 7fddab400640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdd900a3d10 0x7fdd900a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.065+0000 7fdd97e00640 1 -- 172.21.15.110:0/4086421479 <== mon.2 v2:172.21.15.193:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd9c010720 con 0x56452c328900 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.065+0000 7fdd97e00640 1 -- 172.21.15.110:0/4086421479 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c09bf00 con 0x56452c328900 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.065+0000 7fdda3400640 1 -- 172.21.15.110:0/254464074 <== mon.2 v2:172.21.15.193:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 13029+0+0 (secure 0 0 0) 0x7fdd9c0d1d10 con 0x7fddac104970 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 -- 172.21.15.110:0/4086421479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c328900 msgr2=0x56452c332c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddab400640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdd900a3d10 0x7fdd900a61d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdda4004af0 tx=0x7fdda4004a40 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 --2- 172.21.15.110:0/4086421479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c328900 0x56452c332c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0ce1a0 tx=0x7fdd9c0da7d0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 -- 172.21.15.110:0/4086421479 shutdown_connections 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 --2- 172.21.15.110:0/4086421479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c3355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 --2- 172.21.15.110:0/4086421479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c328900 0x56452c332c80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 --2- 172.21.15.110:0/4086421479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c3283c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 -- 172.21.15.110:0/4086421479 >> 172.21.15.110:0/4086421479 conn(0x56452c3244f0 msgr2=0x56452c3248d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 -- 172.21.15.110:0/4086421479 shutdown_connections 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 -- 172.21.15.110:0/4086421479 wait complete. 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.066+0000 7fddb498a740 1 -- start start 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddb498a740 1 Processor -- start 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddb498a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c327fe0 0x56452c330070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddb498a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c3305b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddb498a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c3331c0 0x56452c330af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddb498a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56452c335df0 con 0x56452c328900 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddb498a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56452c214c60 con 0x56452c327fe0 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddb498a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56452c335f70 con 0x56452c3331c0 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddb498a740 10 client.0 _ll_register_callbacks cb 0x56452c240e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c3305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c3305b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35626/0 (socket says 172.21.15.110:35626) 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddaa000640 1 -- 172.21.15.110:0/4193693404 learned_addr learned my addr 172.21.15.110:0/4193693404 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddaaa00640 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c327fe0 0x56452c330070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.067+0000 7fddab400640 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c3331c0 0x56452c330af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fddaa000640 1 -- 172.21.15.110:0/4193693404 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c3331c0 msgr2=0x56452c330af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fddaa000640 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c3331c0 0x56452c330af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fddaa000640 1 -- 172.21.15.110:0/4193693404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c327fe0 msgr2=0x56452c330070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fddaa000640 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c327fe0 0x56452c330070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fddaa000640 1 -- 172.21.15.110:0/4193693404 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452c223510 con 0x56452c328900 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fddaaa00640 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c327fe0 0x56452c330070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fddab400640 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c3331c0 0x56452c330af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fddaa000640 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c3305b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd98013710 tx=0x7fdd98013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d83b0ee4bcd3fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fdd94c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:47:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fdd94c00640 1 -- 172.21.15.110:0/4193693404 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98011e30 con 0x56452c328900 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fdd94c00640 1 -- 172.21.15.110:0/4193693404 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 13029+0+0 (secure 0 0 0) 0x7fdd98005020 con 0x56452c328900 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.068+0000 7fddb498a740 1 -- 172.21.15.110:0/4193693404 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56452c29af90 con 0x56452c328900 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fdd94c00640 1 -- 172.21.15.110:0/4193693404 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fdd98027050 con 0x56452c328900 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fddb498a740 10 client.16272 fetch_fsmap learned FSMap version 311 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fddb498a740 1 -- 172.21.15.110:0/4193693404 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=311,monmap=4+}) -- 0x56452bf9f210 con 0x56452c328900 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fdd94c00640 1 -- 172.21.15.110:0/4193693404 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56452c29af90 con 0x56452c328900 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fdd94c00640 1 -- 172.21.15.110:0/4193693404 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 311) ==== 3526+0+0 (secure 0 0 0) 0x7fdd9801a030 con 0x56452c328900 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fddb498a740 10 client.16272 fetch_fsmap finished waiting for FSMap version 311 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fddb498a740 10 client.16272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fddb498a740 20 client.16272 populate_metadata read hostname 'smithi110' 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fddb498a740 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56452c343290 0x56452c345750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fddb498a740 4 client.16272 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:47:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.069+0000 7fddb498a740 1 -- 172.21.15.110:0/4193693404 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56452c294e00 con 0x56452c343290 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.070+0000 7fddaaa00640 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56452c343290 0x56452c345750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.070+0000 7fddaaa00640 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56452c343290 0x56452c345750 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85adbe230c8733c8 server_cookie=94caad9d39702c32 in_seq=0 out_seq=0 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.070+0000 7fdd94c00640 10 client.16272 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fdd94c00640 1 -- 172.21.15.110:0/4193693404 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56452c294e00 con 0x56452c343290 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fdd94c00640 10 client.16272 handle_command_reply: tid=0 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fddb498a740 1 client.16272 shutdown 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fddb498a740 1 -- 172.21.15.110:0/4193693404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 msgr2=0x56452c3305b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fddb498a740 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c3305b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd98013710 tx=0x7fdd98013bd0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fddb498a740 1 -- 172.21.15.110:0/4193693404 shutdown_connections 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fddb498a740 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56452c343290 0x56452c345750 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fddb498a740 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c3331c0 0x56452c330af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fddb498a740 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c3305b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fddb498a740 1 --2- 172.21.15.110:0/4193693404 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c327fe0 0x56452c330070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.071+0000 7fdd94c00640 0 client.16272 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.072+0000 7fddb498a740 1 -- 172.21.15.110:0/4193693404 >> 172.21.15.110:0/4193693404 conn(0x56452c3244f0 msgr2=0x56452c32a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.072+0000 7fddb498a740 1 -- 172.21.15.110:0/4193693404 shutdown_connections 2024-04-26T11:47:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.072+0000 7fddb498a740 1 -- 172.21.15.110:0/4193693404 wait complete. 2024-04-26T11:47:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.072+0000 7fddb498a740 20 client.16272 trim_cache size 0 max 16384 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.088+0000 7fddb498a740 1 Processor -- start 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.088+0000 7fddb498a740 1 -- start start 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.088+0000 7fddb498a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c3327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.088+0000 7fddb498a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c33ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.088+0000 7fddb498a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c3331c0 0x56452c34b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.088+0000 7fddb498a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fddac1b2b30 con 0x56452c328900 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.088+0000 7fddb498a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fddac1b1690 con 0x56452c3331c0 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.088+0000 7fddb498a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fddac1b1d60 con 0x56452c327fe0 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c33ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c3327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c33ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35634/0 (socket says 172.21.15.110:35634) 2024-04-26T11:47:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaa000640 1 -- 172.21.15.110:0/3493785154 learned_addr learned my addr 172.21.15.110:0/3493785154 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddab400640 1 --2- 172.21.15.110:0/3493785154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c3331c0 0x56452c34b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaa000640 1 -- 172.21.15.110:0/3493785154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 msgr2=0x56452c3327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaa000640 1 --2- 172.21.15.110:0/3493785154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c3327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaa000640 1 -- 172.21.15.110:0/3493785154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c3331c0 msgr2=0x56452c34b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaa000640 1 --2- 172.21.15.110:0/3493785154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c3331c0 0x56452c34b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaa000640 1 -- 172.21.15.110:0/3493785154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452c06b620 con 0x56452c328900 2024-04-26T11:47:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaaa00640 1 --2- 172.21.15.110:0/3493785154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c3327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:47:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.089+0000 7fddaa000640 1 --2- 172.21.15.110:0/3493785154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c33ecb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005c40 tx=0x7fdd98000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fa2671b9fbce3a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fdd97400640 1 -- 172.21.15.110:0/3493785154 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800fc30 con 0x56452c328900 2024-04-26T11:47:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fdd97400640 1 -- 172.21.15.110:0/3493785154 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd98030070 con 0x56452c328900 2024-04-26T11:47:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fdd97400640 1 -- 172.21.15.110:0/3493785154 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd980043b0 con 0x56452c328900 2024-04-26T11:47:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fddb498a740 1 -- 172.21.15.110:0/3493785154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 msgr2=0x56452c33ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:47:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fddb498a740 1 --2- 172.21.15.110:0/3493785154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c33ecb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005c40 tx=0x7fdd98000bc0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fddb498a740 1 -- 172.21.15.110:0/3493785154 shutdown_connections 2024-04-26T11:47:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fddb498a740 1 --2- 172.21.15.110:0/3493785154 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c3331c0 0x56452c34b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fddb498a740 1 --2- 172.21.15.110:0/3493785154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c328900 0x56452c33ecb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fddb498a740 1 --2- 172.21.15.110:0/3493785154 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c3327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.097 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fddb498a740 1 -- 172.21.15.110:0/3493785154 >> 172.21.15.110:0/3493785154 conn(0x56452c3244f0 msgr2=0x56452c32e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fddb498a740 1 -- 172.21.15.110:0/3493785154 shutdown_connections 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.090+0000 7fddb498a740 1 -- 172.21.15.110:0/3493785154 wait complete. 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.091+0000 7fddb498a740 1 -- start start 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.091+0000 7fddb498a740 1 Processor -- start 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.091+0000 7fddb498a740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c33b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.091+0000 7fddb498a740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c32c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.091+0000 7fddb498a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c32ce40 0x56452c32d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.091+0000 7fddb498a740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56452c31fb80 con 0x56452c3331c0 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.091+0000 7fddb498a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fddac1b2430 con 0x56452c32ce40 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.091+0000 7fddb498a740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56452c333020 con 0x56452c327fe0 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddb498a740 10 client.0 _ll_register_callbacks cb 0x7fdd98005b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c33b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaa000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c32c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaaa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c33b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:41442/0 (socket says 172.21.15.110:41442) 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaaa00640 1 -- 172.21.15.110:0/3259065946 learned_addr learned my addr 172.21.15.110:0/3259065946 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddab400640 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c32ce40 0x56452c32d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaaa00640 1 -- 172.21.15.110:0/3259065946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c32ce40 msgr2=0x56452c32d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaaa00640 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c32ce40 0x56452c32d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaaa00640 1 -- 172.21.15.110:0/3259065946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 msgr2=0x56452c32c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaaa00640 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c32c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaaa00640 1 -- 172.21.15.110:0/3259065946 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452c247cb0 con 0x56452c327fe0 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddab400640 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c32ce40 0x56452c32d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fddaaa00640 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c33b420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0d5260 tx=0x7fdd9c01c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b122dedb8c2180d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fdd94c00640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.092+0000 7fdd94c00640 1 -- 172.21.15.110:0/3259065946 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c09c230 con 0x56452c327fe0 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fddb498a740 1 -- 172.21.15.110:0/3259065946 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd98030070 con 0x56452c327fe0 2024-04-26T11:47:50.099 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fdd94c00640 1 -- 172.21.15.110:0/3259065946 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 13029+0+0 (secure 0 0 0) 0x7fdd9c09ab50 con 0x56452c327fe0 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fdd94c00640 1 -- 172.21.15.110:0/3259065946 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=311) ==== 24+0+0 (secure 0 0 0) 0x7fdd9c09c410 con 0x56452c327fe0 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fddb498a740 10 client.26611 fetch_fsmap learned FSMap version 311 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fddb498a740 1 -- 172.21.15.110:0/3259065946 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=311,monmap=4+}) -- 0x56452c3a9970 con 0x56452c327fe0 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fdd94c00640 1 -- 172.21.15.110:0/3259065946 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd98030070 con 0x56452c327fe0 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fdd94c00640 1 -- 172.21.15.110:0/3259065946 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 311) ==== 3526+0+0 (secure 0 0 0) 0x7fdd9c0e1070 con 0x56452c327fe0 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fddb498a740 10 client.26611 fetch_fsmap finished waiting for FSMap version 311 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fddb498a740 10 client.26611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fddb498a740 20 client.26611 populate_metadata read hostname 'smithi110' 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fddb498a740 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56452c3a9d70 0x56452c3ac190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fddb498a740 4 client.26611 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.093+0000 7fddb498a740 1 -- 172.21.15.110:0/3259065946 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56452c2104b0 con 0x56452c3a9d70 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.094+0000 7fddaa000640 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56452c3a9d70 0x56452c3ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.094+0000 7fddaa000640 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56452c3a9d70 0x56452c3ac190 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a0ebec8d3e5c68c server_cookie=3af9de61e9072e1f in_seq=0 out_seq=0 2024-04-26T11:47:50.100 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:47:50.094+0000 7fdd94c00640 10 client.26611 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:47:50.947 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:50 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 4. 2024-04-26T11:47:50.947 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:50 smithi110 systemd[1]: Stopped Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:50.947 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:50 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 2.104s CPU time. 2024-04-26T11:47:50.947 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:50 smithi110 systemd[1]: Starting Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:47:51.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:50 smithi110 podman[96463]: 2024-04-26 11:47:50.850001516 +0000 UTC m=+0.033556779 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:47:51.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:50 smithi110 podman[96463]: 2024-04-26 11:47:50.967791953 +0000 UTC m=+0.151347248 container create e206b2e611f3a6f63d187911e00f5fe6b14155b6a5f2ef3f4c66b2515066ef8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T11:47:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:51 smithi193 ceph-mon[32782]: pgmap v576: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-04-26T11:47:51.626 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:51 smithi110 ceph-mon[28069]: pgmap v576: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-04-26T11:47:51.626 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:51 smithi110 podman[96463]: 2024-04-26 11:47:51.306307735 +0000 UTC m=+0.489863073 container init e206b2e611f3a6f63d187911e00f5fe6b14155b6a5f2ef3f4c66b2515066ef8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T11:47:51.626 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:51 smithi110 podman[96463]: 2024-04-26 11:47:51.316627568 +0000 UTC m=+0.500182847 container start e206b2e611f3a6f63d187911e00f5fe6b14155b6a5f2ef3f4c66b2515066ef8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=) 2024-04-26T11:47:51.626 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:51 smithi110 ceph-mds[96482]: -- 172.21.15.110:0/4133138245 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a9a225a40 con 0x559a9a1f8800 2024-04-26T11:47:51.627 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:51 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: starting mds.a at 2024-04-26T11:47:51.627 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:51 smithi110 bash[96463]: e206b2e611f3a6f63d187911e00f5fe6b14155b6a5f2ef3f4c66b2515066ef8c 2024-04-26T11:47:51.627 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:47:51 smithi110 systemd[1]: Started Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:51.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:51 smithi196 ceph-mon[32572]: pgmap v576: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-04-26T11:47:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:52 smithi110 ceph-mon[28069]: daemon mds.a restarted 2024-04-26T11:47:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:52 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:47:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:52 smithi110 ceph-mon[28069]: osdmap e164: 12 total, 12 up, 12 in 2024-04-26T11:47:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:52 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:boot 2024-04-26T11:47:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:52 smithi110 ceph-mon[28069]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:47:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:52 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 1 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:47:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:52 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:replay} 1 up:standby-replay 2024-04-26T11:47:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:52 smithi193 ceph-mon[32782]: daemon mds.a restarted 2024-04-26T11:47:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:52 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:47:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:52 smithi193 ceph-mon[32782]: osdmap e164: 12 total, 12 up, 12 in 2024-04-26T11:47:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:52 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:boot 2024-04-26T11:47:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:52 smithi193 ceph-mon[32782]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:47:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:52 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 1 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:47:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:52 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:replay} 1 up:standby-replay 2024-04-26T11:47:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:52 smithi196 ceph-mon[32572]: daemon mds.a restarted 2024-04-26T11:47:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:52 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:47:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:52 smithi196 ceph-mon[32572]: osdmap e164: 12 total, 12 up, 12 in 2024-04-26T11:47:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:52 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:boot 2024-04-26T11:47:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:52 smithi196 ceph-mon[32572]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T11:47:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:52 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 1 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:47:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T11:47:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:52 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:replay} 1 up:standby-replay 2024-04-26T11:47:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:53 smithi196 ceph-mon[32572]: pgmap v578: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 14 KiB/s wr, 3 op/s 2024-04-26T11:47:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:53 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:resolve 2024-04-26T11:47:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:53 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:47:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:53 smithi110 ceph-mon[28069]: pgmap v578: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 14 KiB/s wr, 3 op/s 2024-04-26T11:47:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:53 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:resolve 2024-04-26T11:47:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:53 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:47:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:53 smithi193 ceph-mon[32782]: pgmap v578: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 14 KiB/s wr, 3 op/s 2024-04-26T11:47:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:53 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:resolve 2024-04-26T11:47:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:53 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:47:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:55 smithi196 ceph-mon[32572]: pgmap v579: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 68 KiB/s wr, 13 op/s 2024-04-26T11:47:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:55 smithi110 ceph-mon[28069]: pgmap v579: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 68 KiB/s wr, 13 op/s 2024-04-26T11:47:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:55 smithi193 ceph-mon[32782]: pgmap v579: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 68 KiB/s wr, 13 op/s 2024-04-26T11:47:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:57 smithi196 ceph-mon[32572]: pgmap v580: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 54 KiB/s wr, 10 op/s 2024-04-26T11:47:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:57 smithi196 ceph-mon[32572]: osdmap e165: 12 total, 12 up, 12 in 2024-04-26T11:47:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:57 smithi110 ceph-mon[28069]: pgmap v580: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 54 KiB/s wr, 10 op/s 2024-04-26T11:47:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:57 smithi110 ceph-mon[28069]: osdmap e165: 12 total, 12 up, 12 in 2024-04-26T11:47:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:57 smithi193 ceph-mon[32782]: pgmap v580: 97 pgs: 97 active+clean; 2.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 54 KiB/s wr, 10 op/s 2024-04-26T11:47:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:57 smithi193 ceph-mon[32782]: osdmap e165: 12 total, 12 up, 12 in 2024-04-26T11:47:59.708 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:47:59 smithi110 ceph-mon[28069]: pgmap v582: 97 pgs: 97 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-04-26T11:47:59.708 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:59 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 2. 2024-04-26T11:47:59.708 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:59 smithi110 systemd[1]: Stopped Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:47:59.708 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:59 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Consumed 2.116s CPU time. 2024-04-26T11:47:59.709 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:59 smithi110 systemd[1]: Starting Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:47:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:47:59 smithi196 ceph-mon[32572]: pgmap v582: 97 pgs: 97 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-04-26T11:47:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:47:59 smithi193 ceph-mon[32782]: pgmap v582: 97 pgs: 97 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-04-26T11:48:00.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:59 smithi110 podman[96573]: 2024-04-26 11:47:59.612372048 +0000 UTC m=+0.037183511 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:48:00.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:47:59 smithi110 podman[96573]: 2024-04-26 11:47:59.777037674 +0000 UTC m=+0.201849181 container create fd71bee8e8db4899319833b3f81e1afa65bdeaded9af03e1ba82622f5f7012c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T11:48:00.412 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:00 smithi110 podman[96573]: 2024-04-26 11:48:00.05588534 +0000 UTC m=+0.480696883 container init fd71bee8e8db4899319833b3f81e1afa65bdeaded9af03e1ba82622f5f7012c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T11:48:00.412 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:00 smithi110 podman[96573]: 2024-04-26 11:48:00.066268123 +0000 UTC m=+0.491079656 container start fd71bee8e8db4899319833b3f81e1afa65bdeaded9af03e1ba82622f5f7012c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-04-26T11:48:00.412 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:00 smithi110 ceph-mds[96592]: -- 172.21.15.110:0/2806265174 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557063bafa40 con 0x557063b83000 2024-04-26T11:48:00.412 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: starting mds.g at 2024-04-26T11:48:00.412 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:00 smithi110 bash[96573]: fd71bee8e8db4899319833b3f81e1afa65bdeaded9af03e1ba82622f5f7012c9 2024-04-26T11:48:00.412 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:00 smithi110 systemd[1]: Started Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:48:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:00 smithi196 ceph-mon[32572]: daemon mds.g restarted 2024-04-26T11:48:00.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:00 smithi196 ceph-mon[32572]: osdmap e166: 12 total, 12 up, 12 in 2024-04-26T11:48:00.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:00 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:boot 2024-04-26T11:48:00.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:00 smithi196 ceph-mon[32572]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-04-26T11:48:00.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:00 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 1 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:48:00.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:48:00.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:00 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:48:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:00 smithi110 ceph-mon[28069]: daemon mds.g restarted 2024-04-26T11:48:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:00 smithi110 ceph-mon[28069]: osdmap e166: 12 total, 12 up, 12 in 2024-04-26T11:48:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:00 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:boot 2024-04-26T11:48:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:00 smithi110 ceph-mon[28069]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-04-26T11:48:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:00 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 1 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:48:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:48:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:00 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:48:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:00 smithi193 ceph-mon[32782]: daemon mds.g restarted 2024-04-26T11:48:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:00 smithi193 ceph-mon[32782]: osdmap e166: 12 total, 12 up, 12 in 2024-04-26T11:48:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:00 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:boot 2024-04-26T11:48:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:00 smithi193 ceph-mon[32782]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-04-26T11:48:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:00 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 1 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:48:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:48:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:00 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:48:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:01 smithi196 ceph-mon[32572]: pgmap v584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-04-26T11:48:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:01 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:resolve 2024-04-26T11:48:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:01 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:48:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:01 smithi110 ceph-mon[28069]: pgmap v584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-04-26T11:48:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:01 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:resolve 2024-04-26T11:48:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:01 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:48:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:01 smithi193 ceph-mon[32782]: pgmap v584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-04-26T11:48:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:01 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:resolve 2024-04-26T11:48:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:01 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=a=up:resolve} 1 up:standby-replay 2024-04-26T11:48:03.184 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.181+0000 7fdd94c00640 1 -- 172.21.15.110:0/3259065946 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56452c2104b0 con 0x56452c3a9d70 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fdd94c00640 10 client.26611 handle_command_reply: tid=0 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fddb498a740 1 client.26611 shutdown 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fddb498a740 1 -- 172.21.15.110:0/3259065946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 msgr2=0x56452c33b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fddb498a740 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c33b420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0d5260 tx=0x7fdd9c01c1c0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fddb498a740 1 -- 172.21.15.110:0/3259065946 shutdown_connections 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fddb498a740 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56452c32ce40 0x56452c32d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fddb498a740 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56452c3331c0 0x56452c32c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fddb498a740 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x56452c3a9d70 0x56452c3ac190 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fddb498a740 1 --2- 172.21.15.110:0/3259065946 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56452c327fe0 0x56452c33b420 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.185 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fddb498a740 1 -- 172.21.15.110:0/3259065946 >> 172.21.15.110:0/3259065946 conn(0x56452c3244f0 msgr2=0x56452c322dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.182+0000 7fdd94c00640 0 client.26611 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.183+0000 7fddb498a740 1 -- 172.21.15.110:0/3259065946 shutdown_connections 2024-04-26T11:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.183+0000 7fddb498a740 1 -- 172.21.15.110:0/3259065946 wait complete. 2024-04-26T11:48:03.186 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.183+0000 7fddb498a740 20 client.26611 trim_cache size 0 max 16384 2024-04-26T11:48:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:{ 2024-04-26T11:48:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "message": "", 2024-04-26T11:48:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout: "return_code": 0 2024-04-26T11:48:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stdout:} 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 -- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdd900a3d10 msgr2=0x7fdd900a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdd900a3d10 0x7fdd900a61d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdda4004af0 tx=0x7fdda4004a40 comp rx=0 tx=0).stop 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 -- 172.21.15.110:0/254464074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddac104970 msgr2=0x7fddac19b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddac104970 0x7fddac19b140 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00e9f0 tx=0x7fdd9c00eeb0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 -- 172.21.15.110:0/254464074 shutdown_connections 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7fdd900a3d10 0x7fdd900a61d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac10a980 0x7fddac19fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fddac105330 0x7fddac19b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 --2- 172.21.15.110:0/254464074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddac104970 0x7fddac19b140 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.185+0000 7fddabe00640 1 -- 172.21.15.110:0/254464074 >> 172.21.15.110:0/254464074 conn(0x7fddac100440 msgr2=0x7fddac100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.186+0000 7fddabe00640 1 -- 172.21.15.110:0/254464074 shutdown_connections 2024-04-26T11:48:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:03.186+0000 7fddabe00640 1 -- 172.21.15.110:0/254464074 wait complete. 2024-04-26T11:48:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:03 smithi196 ceph-mon[32572]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299995 2024-04-26T11:48:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:03 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:reconnect 2024-04-26T11:48:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:03 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:reconnect 2024-04-26T11:48:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:03 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 2024-04-26T11:48:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:03 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219996 2024-04-26T11:48:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:03 smithi196 ceph-mon[32572]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219996 2024-04-26T11:48:03.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:03 smithi196 ceph-mon[32572]: pgmap v585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T11:48:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:03 smithi110 ceph-mon[28069]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299995 2024-04-26T11:48:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:03 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:reconnect 2024-04-26T11:48:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:03 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:reconnect 2024-04-26T11:48:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:03 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 2024-04-26T11:48:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:03 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219996 2024-04-26T11:48:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:03 smithi110 ceph-mon[28069]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219996 2024-04-26T11:48:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:03 smithi110 ceph-mon[28069]: pgmap v585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T11:48:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:03 smithi193 ceph-mon[32782]: reconnect by client.15165 172.21.15.110:0/16385256 after 0.00299995 2024-04-26T11:48:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:03 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:reconnect 2024-04-26T11:48:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:03 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:reconnect 2024-04-26T11:48:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:03 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 2024-04-26T11:48:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:03 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219996 2024-04-26T11:48:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:03 smithi193 ceph-mon[32782]: reconnect by client.25049 172.21.15.110:0/3240209317 after 0.0219996 2024-04-26T11:48:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:03 smithi193 ceph-mon[32782]: pgmap v585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T11:48:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:04 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:rejoin 2024-04-26T11:48:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:04 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:rejoin 2024-04-26T11:48:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:04 smithi196 ceph-mon[32572]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 2024-04-26T11:48:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:04 smithi196 ceph-mon[32572]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T11:48:04.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:04 smithi196 ceph-mon[32572]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:48:04.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:04 smithi196 ceph-mon[32572]: osdmap e167: 12 total, 12 up, 12 in 2024-04-26T11:48:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:rejoin 2024-04-26T11:48:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:rejoin 2024-04-26T11:48:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-mon[28069]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 2024-04-26T11:48:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-mon[28069]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T11:48:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-mon[28069]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:48:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-mon[28069]: osdmap e167: 12 total, 12 up, 12 in 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd02b200700 time 2024-04-26T11:48:04.235246+0000 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd036a153dd] 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd036a155a3] 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x559a5bd90822] 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559a5bd00598] 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559a5bd02c17] 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559a5bbfbd0b] 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a5bbfc2ac] 2024-04-26T11:48:04.543 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559a5bbe4fad] 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd036ca9e20] 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 10: (DispatchQueue::entry()+0x51f) [0x7fd036ca6fdf] 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd036d79fc1] 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd0357931ca] 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 13: clone() 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.234+0000 7fd02b200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd02b200700 time 2024-04-26T11:48:04.235246+0000 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:04.544 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd036a153dd] 2024-04-26T11:48:04.545 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd036a155a3] 2024-04-26T11:48:04.545 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x559a5bd90822] 2024-04-26T11:48:04.545 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559a5bd00598] 2024-04-26T11:48:04.545 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559a5bd02c17] 2024-04-26T11:48:04.545 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559a5bbfbd0b] 2024-04-26T11:48:04.545 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a5bbfc2ac] 2024-04-26T11:48:04.545 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559a5bbe4fad] 2024-04-26T11:48:04.545 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd036ca9e20] 2024-04-26T11:48:04.545 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 10: (DispatchQueue::entry()+0x51f) [0x7fd036ca6fdf] 2024-04-26T11:48:04.546 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd036d79fc1] 2024-04-26T11:48:04.546 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd0357931ca] 2024-04-26T11:48:04.546 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 13: clone() 2024-04-26T11:48:04.546 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.546 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: *** Caught signal (Aborted) ** 2024-04-26T11:48:04.546 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: in thread 7fd02b200700 thread_name:ms_dispatch 2024-04-26T11:48:04.546 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:04.546 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd03579dd20] 2024-04-26T11:48:04.547 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2: gsignal() 2024-04-26T11:48:04.547 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 3: abort() 2024-04-26T11:48:04.547 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd036a15437] 2024-04-26T11:48:04.547 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd036a155a3] 2024-04-26T11:48:04.547 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x559a5bd90822] 2024-04-26T11:48:04.547 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559a5bd00598] 2024-04-26T11:48:04.547 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559a5bd02c17] 2024-04-26T11:48:04.547 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559a5bbfbd0b] 2024-04-26T11:48:04.548 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a5bbfc2ac] 2024-04-26T11:48:04.548 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559a5bbe4fad] 2024-04-26T11:48:04.548 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd036ca9e20] 2024-04-26T11:48:04.548 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 13: (DispatchQueue::entry()+0x51f) [0x7fd036ca6fdf] 2024-04-26T11:48:04.548 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd036d79fc1] 2024-04-26T11:48:04.548 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd0357931ca] 2024-04-26T11:48:04.548 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 16: clone() 2024-04-26T11:48:04.548 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.236+0000 7fd02b200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:48:04.548 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: in thread 7fd02b200700 thread_name:ms_dispatch 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd03579dd20] 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2: gsignal() 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 3: abort() 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd036a15437] 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd036a155a3] 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x559a5bd90822] 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559a5bd00598] 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559a5bd02c17] 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559a5bbfbd0b] 2024-04-26T11:48:04.549 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a5bbfc2ac] 2024-04-26T11:48:04.550 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559a5bbe4fad] 2024-04-26T11:48:04.550 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd036ca9e20] 2024-04-26T11:48:04.550 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 13: (DispatchQueue::entry()+0x51f) [0x7fd036ca6fdf] 2024-04-26T11:48:04.550 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd036d79fc1] 2024-04-26T11:48:04.550 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd0357931ca] 2024-04-26T11:48:04.550 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 16: clone() 2024-04-26T11:48:04.550 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:48:04.550 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: -1> 2024-04-26T11:48:04.234+0000 7fd02b200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd02b200700 time 2024-04-26T11:48:04.235246+0000 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd036a153dd] 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd036a155a3] 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x559a5bd90822] 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559a5bd00598] 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559a5bd02c17] 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559a5bbfbd0b] 2024-04-26T11:48:04.551 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a5bbfc2ac] 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559a5bbe4fad] 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd036ca9e20] 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 10: (DispatchQueue::entry()+0x51f) [0x7fd036ca6fdf] 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd036d79fc1] 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd0357931ca] 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 13: clone() 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 0> 2024-04-26T11:48:04.236+0000 7fd02b200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: in thread 7fd02b200700 thread_name:ms_dispatch 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:04.552 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd03579dd20] 2024-04-26T11:48:04.553 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2: gsignal() 2024-04-26T11:48:04.553 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 3: abort() 2024-04-26T11:48:04.553 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd036a15437] 2024-04-26T11:48:04.553 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd036a155a3] 2024-04-26T11:48:04.553 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x559a5bd90822] 2024-04-26T11:48:04.553 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559a5bd00598] 2024-04-26T11:48:04.553 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559a5bd02c17] 2024-04-26T11:48:04.553 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559a5bbfbd0b] 2024-04-26T11:48:04.553 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a5bbfc2ac] 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559a5bbe4fad] 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd036ca9e20] 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 13: (DispatchQueue::entry()+0x51f) [0x7fd036ca6fdf] 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd036d79fc1] 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd0357931ca] 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 16: clone() 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: -1> 2024-04-26T11:48:04.234+0000 7fd02b200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd02b200700 time 2024-04-26T11:48:04.235246+0000 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:04.554 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd036a153dd] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd036a155a3] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x559a5bd90822] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559a5bd00598] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559a5bd02c17] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559a5bbfbd0b] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a5bbfc2ac] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559a5bbe4fad] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd036ca9e20] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 10: (DispatchQueue::entry()+0x51f) [0x7fd036ca6fdf] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd036d79fc1] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd0357931ca] 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 13: clone() 2024-04-26T11:48:04.555 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 0> 2024-04-26T11:48:04.236+0000 7fd02b200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: in thread 7fd02b200700 thread_name:ms_dispatch 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd03579dd20] 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2: gsignal() 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 3: abort() 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd036a15437] 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd036a155a3] 2024-04-26T11:48:04.556 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x559a5bd90822] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559a5bd00598] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559a5bd02c17] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559a5bbfbd0b] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a5bbfc2ac] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559a5bbe4fad] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd036ca9e20] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 13: (DispatchQueue::entry()+0x51f) [0x7fd036ca6fdf] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd036d79fc1] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd0357931ca] 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 16: clone() 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a[96478]: 2024-04-26T11:48:04.557 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:04 smithi110 podman[96632]: 2024-04-26 11:48:04.358433111 +0000 UTC m=+0.035681590 container died e206b2e611f3a6f63d187911e00f5fe6b14155b6a5f2ef3f4c66b2515066ef8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True) 2024-04-26T11:48:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:04 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:rejoin 2024-04-26T11:48:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:04 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:rejoin 2024-04-26T11:48:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:04 smithi193 ceph-mon[32782]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 2024-04-26T11:48:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:04 smithi193 ceph-mon[32782]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T11:48:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:04 smithi193 ceph-mon[32782]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T11:48:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:04 smithi193 ceph-mon[32782]: osdmap e167: 12 total, 12 up, 12 in 2024-04-26T11:48:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:05 smithi196 ceph-mon[32572]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:48:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:05 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:active 2024-04-26T11:48:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:05 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:active 2024-04-26T11:48:05.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:05 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 2024-04-26T11:48:05.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:05 smithi196 ceph-mon[32572]: pgmap v587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 520 B/s wr, 6 op/s 2024-04-26T11:48:05.542 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:05 smithi110 podman[96632]: 2024-04-26 11:48:05.135220688 +0000 UTC m=+0.812469200 container remove e206b2e611f3a6f63d187911e00f5fe6b14155b6a5f2ef3f4c66b2515066ef8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T11:48:05.542 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:05 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:48:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:05 smithi110 ceph-mon[28069]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:48:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:05 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:active 2024-04-26T11:48:05.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:05 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:active 2024-04-26T11:48:05.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:05 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 2024-04-26T11:48:05.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:05 smithi110 ceph-mon[28069]: pgmap v587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 520 B/s wr, 6 op/s 2024-04-26T11:48:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:05 smithi193 ceph-mon[32782]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T11:48:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:05 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6836/3550461438,v1:172.21.15.110:6837/3550461438] up:active 2024-04-26T11:48:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:05 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1655262836,v1:172.21.15.110:6835/1655262836] up:active 2024-04-26T11:48:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:05 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active} 1 up:standby-replay 2024-04-26T11:48:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:05 smithi193 ceph-mon[32782]: pgmap v587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 520 B/s wr, 6 op/s 2024-04-26T11:48:06.041 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:05 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-04-26T11:48:06.042 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:05 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 2.133s CPU time. 2024-04-26T11:48:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:07 smithi193 ceph-mon[32782]: pgmap v588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-26T11:48:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:07 smithi196 ceph-mon[32572]: pgmap v588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-26T11:48:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:07 smithi110 ceph-mon[28069]: pgmap v588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-26T11:48:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-mon[28069]: pgmap v589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 66 KiB/s wr, 42 op/s 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f9800200700 time 2024-04-26T11:48:09.207854+0000 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f980ba3a3dd] 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f980ba3a5a3] 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55703b85e822] 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55703b7ce598] 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55703b7d0c17] 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55703b6c9d0b] 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55703b6ca2ac] 2024-04-26T11:48:09.544 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55703b6b2fad] 2024-04-26T11:48:09.545 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f980bccee20] 2024-04-26T11:48:09.545 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 10: (DispatchQueue::entry()+0x51f) [0x7f980bccbfdf] 2024-04-26T11:48:09.545 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f980bd9efc1] 2024-04-26T11:48:09.545 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f980a7b81ca] 2024-04-26T11:48:09.545 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 13: clone() 2024-04-26T11:48:09.545 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.210+0000 7f9800200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f9800200700 time 2024-04-26T11:48:09.207854+0000 2024-04-26T11:48:09.545 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:48:09.545 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.546 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:09.546 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f980ba3a3dd] 2024-04-26T11:48:09.546 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f980ba3a5a3] 2024-04-26T11:48:09.546 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55703b85e822] 2024-04-26T11:48:09.546 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55703b7ce598] 2024-04-26T11:48:09.546 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55703b7d0c17] 2024-04-26T11:48:09.546 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55703b6c9d0b] 2024-04-26T11:48:09.546 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55703b6ca2ac] 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55703b6b2fad] 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f980bccee20] 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 10: (DispatchQueue::entry()+0x51f) [0x7f980bccbfdf] 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f980bd9efc1] 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f980a7b81ca] 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 13: clone() 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: *** Caught signal (Aborted) ** 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: in thread 7f9800200700 thread_name:ms_dispatch 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:09.547 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f980a7c2d20] 2024-04-26T11:48:09.548 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2: gsignal() 2024-04-26T11:48:09.548 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 3: abort() 2024-04-26T11:48:09.548 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f980ba3a437] 2024-04-26T11:48:09.548 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f980ba3a5a3] 2024-04-26T11:48:09.548 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55703b85e822] 2024-04-26T11:48:09.548 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55703b7ce598] 2024-04-26T11:48:09.548 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55703b7d0c17] 2024-04-26T11:48:09.548 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55703b6c9d0b] 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55703b6ca2ac] 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55703b6b2fad] 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f980bccee20] 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 13: (DispatchQueue::entry()+0x51f) [0x7f980bccbfdf] 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f980bd9efc1] 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f980a7b81ca] 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 16: clone() 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.215+0000 7f9800200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: in thread 7f9800200700 thread_name:ms_dispatch 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.549 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:09.550 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f980a7c2d20] 2024-04-26T11:48:09.550 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2: gsignal() 2024-04-26T11:48:09.550 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 3: abort() 2024-04-26T11:48:09.550 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f980ba3a437] 2024-04-26T11:48:09.550 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f980ba3a5a3] 2024-04-26T11:48:09.550 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55703b85e822] 2024-04-26T11:48:09.550 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55703b7ce598] 2024-04-26T11:48:09.550 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55703b7d0c17] 2024-04-26T11:48:09.551 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55703b6c9d0b] 2024-04-26T11:48:09.551 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55703b6ca2ac] 2024-04-26T11:48:09.551 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55703b6b2fad] 2024-04-26T11:48:09.551 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f980bccee20] 2024-04-26T11:48:09.551 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 13: (DispatchQueue::entry()+0x51f) [0x7f980bccbfdf] 2024-04-26T11:48:09.551 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f980bd9efc1] 2024-04-26T11:48:09.551 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f980a7b81ca] 2024-04-26T11:48:09.551 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 16: clone() 2024-04-26T11:48:09.551 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:48:09.552 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.552 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: -1> 2024-04-26T11:48:09.210+0000 7f9800200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f9800200700 time 2024-04-26T11:48:09.207854+0000 2024-04-26T11:48:09.552 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:48:09.552 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.552 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:09.552 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f980ba3a3dd] 2024-04-26T11:48:09.552 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f980ba3a5a3] 2024-04-26T11:48:09.552 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55703b85e822] 2024-04-26T11:48:09.552 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55703b7ce598] 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55703b7d0c17] 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55703b6c9d0b] 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55703b6ca2ac] 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55703b6b2fad] 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f980bccee20] 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 10: (DispatchQueue::entry()+0x51f) [0x7f980bccbfdf] 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f980bd9efc1] 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f980a7b81ca] 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 13: clone() 2024-04-26T11:48:09.553 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.554 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 0> 2024-04-26T11:48:09.215+0000 7f9800200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:48:09.554 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: in thread 7f9800200700 thread_name:ms_dispatch 2024-04-26T11:48:09.554 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.554 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:09.554 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f980a7c2d20] 2024-04-26T11:48:09.554 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2: gsignal() 2024-04-26T11:48:09.554 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 3: abort() 2024-04-26T11:48:09.554 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f980ba3a437] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f980ba3a5a3] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55703b85e822] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55703b7ce598] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55703b7d0c17] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55703b6c9d0b] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55703b6ca2ac] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55703b6b2fad] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f980bccee20] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 13: (DispatchQueue::entry()+0x51f) [0x7f980bccbfdf] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f980bd9efc1] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f980a7b81ca] 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 16: clone() 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.555 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: -1> 2024-04-26T11:48:09.210+0000 7f9800200700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f9800200700 time 2024-04-26T11:48:09.207854+0000 2024-04-26T11:48:09.556 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T11:48:09.556 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.556 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:09.556 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f980ba3a3dd] 2024-04-26T11:48:09.556 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f980ba3a5a3] 2024-04-26T11:48:09.556 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55703b85e822] 2024-04-26T11:48:09.556 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55703b7ce598] 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55703b7d0c17] 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55703b6c9d0b] 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55703b6ca2ac] 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55703b6b2fad] 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f980bccee20] 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 10: (DispatchQueue::entry()+0x51f) [0x7f980bccbfdf] 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f980bd9efc1] 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f980a7b81ca] 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 13: clone() 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 0> 2024-04-26T11:48:09.215+0000 7f9800200700 -1 *** Caught signal (Aborted) ** 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: in thread 7f9800200700 thread_name:ms_dispatch 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.557 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f980a7c2d20] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2: gsignal() 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 3: abort() 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f980ba3a437] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f980ba3a5a3] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55703b85e822] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55703b7ce598] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55703b7d0c17] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55703b6c9d0b] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55703b6ca2ac] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55703b6b2fad] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f980bccee20] 2024-04-26T11:48:09.558 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 13: (DispatchQueue::entry()+0x51f) [0x7f980bccbfdf] 2024-04-26T11:48:09.559 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f980bd9efc1] 2024-04-26T11:48:09.559 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f980a7b81ca] 2024-04-26T11:48:09.559 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 16: clone() 2024-04-26T11:48:09.559 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T11:48:09.559 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96588]: 2024-04-26T11:48:09.559 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:09 smithi110 podman[96675]: 2024-04-26 11:48:09.376301044 +0000 UTC m=+0.035698160 container died fd71bee8e8db4899319833b3f81e1afa65bdeaded9af03e1ba82622f5f7012c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T11:48:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:09 smithi193 ceph-mon[32782]: pgmap v589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 66 KiB/s wr, 42 op/s 2024-04-26T11:48:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:09 smithi196 ceph-mon[32572]: pgmap v589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 66 KiB/s wr, 42 op/s 2024-04-26T11:48:10.541 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:10 smithi110 podman[96675]: 2024-04-26 11:48:10.240734961 +0000 UTC m=+0.900132118 container remove fd71bee8e8db4899319833b3f81e1afa65bdeaded9af03e1ba82622f5f7012c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T11:48:10.541 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:10 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-04-26T11:48:11.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:10 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-04-26T11:48:11.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:10 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Consumed 1.886s CPU time. 2024-04-26T11:48:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:11 smithi193 ceph-mon[32782]: pgmap v590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 61 KiB/s wr, 36 op/s 2024-04-26T11:48:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:11 smithi196 ceph-mon[32572]: pgmap v590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 61 KiB/s wr, 36 op/s 2024-04-26T11:48:11.782 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:11 smithi110 ceph-mon[28069]: pgmap v590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 61 KiB/s wr, 36 op/s 2024-04-26T11:48:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:13 smithi193 ceph-mon[32782]: pgmap v591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 61 KiB/s wr, 36 op/s 2024-04-26T11:48:13.641 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:13 smithi110 ceph-mon[28069]: pgmap v591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 61 KiB/s wr, 36 op/s 2024-04-26T11:48:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:13 smithi196 ceph-mon[32572]: pgmap v591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 61 KiB/s wr, 36 op/s 2024-04-26T11:48:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:15 smithi193 ceph-mon[32782]: pgmap v592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 63 KiB/s wr, 33 op/s 2024-04-26T11:48:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:15 smithi196 ceph-mon[32572]: pgmap v592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 63 KiB/s wr, 33 op/s 2024-04-26T11:48:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:15 smithi110 ceph-mon[28069]: pgmap v592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 63 KiB/s wr, 33 op/s 2024-04-26T11:48:16.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:15 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 5. 2024-04-26T11:48:16.292 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:15 smithi110 systemd[1]: Stopped Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:48:16.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:15 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Consumed 2.133s CPU time. 2024-04-26T11:48:16.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:15 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Start request repeated too quickly. 2024-04-26T11:48:16.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:15 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-04-26T11:48:16.293 INFO:journalctl@ceph.mds.a.smithi110.stdout:Apr 26 11:48:15 smithi110 systemd[1]: Failed to start Ceph mds.a for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:48:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.337+0000 7f2622000640 1 -- 172.21.15.110:0/1569680357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c10ac10 msgr2=0x7f261c10aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:48:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.337+0000 7f2622000640 1 --2- 172.21.15.110:0/1569680357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c10ac10 0x7f261c10aff0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f260c009900 tx=0x7f260c02a410 comp rx=0 tx=0).stop 2024-04-26T11:48:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.337+0000 7f2622000640 1 -- 172.21.15.110:0/1569680357 shutdown_connections 2024-04-26T11:48:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.337+0000 7f2622000640 1 --2- 172.21.15.110:0/1569680357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f261c105510 0x7f261c1119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.337+0000 7f2622000640 1 --2- 172.21.15.110:0/1569680357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f261c104b50 0x7f261c104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.337+0000 7f2622000640 1 --2- 172.21.15.110:0/1569680357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c10ac10 0x7f261c10aff0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.337+0000 7f2622000640 1 -- 172.21.15.110:0/1569680357 >> 172.21.15.110:0/1569680357 conn(0x7f261c100600 msgr2=0x7f261c102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.337+0000 7f2622000640 1 -- 172.21.15.110:0/1569680357 shutdown_connections 2024-04-26T11:48:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.337+0000 7f2622000640 1 -- 172.21.15.110:0/1569680357 wait complete. 2024-04-26T11:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.338+0000 7f2622000640 1 Processor -- start 2024-04-26T11:48:16.340 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.338+0000 7f2622000640 1 -- start start 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.338+0000 7f2622000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c104b50 0x7f261c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.338+0000 7f2622000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f261c105510 0x7f261c19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.338+0000 7f2622000640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f261c10ac10 0x7f261c19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f2622000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f261c114e10 con 0x7f261c104b50 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f2622000640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f261c114c90 con 0x7f261c10ac10 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f2622000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f261c114f90 con 0x7f261c105510 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c104b50 0x7f261c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c104b50 0x7f261c19b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50552/0 (socket says 172.21.15.110:50552) 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261b400640 1 -- 172.21.15.110:0/3398481431 learned_addr learned my addr 172.21.15.110:0/3398481431 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f261c10ac10 0x7f261c19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f2612a00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f261c105510 0x7f261c19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261b400640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f261c105510 msgr2=0x7f261c19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261b400640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f261c105510 0x7f261c19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261b400640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f261c10ac10 msgr2=0x7f261c19fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:48:16.342 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261b400640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f261c10ac10 0x7f261c19fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.342 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261b400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261c1a01e0 con 0x7f261c104b50 2024-04-26T11:48:16.342 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.339+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f261c10ac10 0x7f261c19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:48:16.342 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.340+0000 7f261b400640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f261c104b50 0x7f261c19b1f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f260c02aa00 tx=0x7f260c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:48:16.342 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.340+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c03f070 con 0x7f261c104b50 2024-04-26T11:48:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.340+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f260c03bb20 con 0x7f261c104b50 2024-04-26T11:48:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.340+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c035030 con 0x7f261c104b50 2024-04-26T11:48:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.340+0000 7f2622000640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f261c1a0470 con 0x7f261c104b50 2024-04-26T11:48:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.340+0000 7f2622000640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f261c1a7d60 con 0x7f261c104b50 2024-04-26T11:48:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.343+0000 7f2624e0f740 1 Processor -- start 2024-04-26T11:48:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.343+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f260c042070 con 0x7f261c104b50 2024-04-26T11:48:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.343+0000 7f2624e0f740 1 -- start start 2024-04-26T11:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 0x55db1be5aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be5afb0 0x55db1be5d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f2624e0f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55db1bdb5380 con 0x55db1be4fdd0 2024-04-26T11:48:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f2624e0f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55db1bd51c30 con 0x55db1be506f0 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f2624e0f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55db1bdb1340 con 0x55db1be5afb0 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f261be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f261be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50568/0 (socket says 172.21.15.110:50568) 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f261be00640 1 -- 172.21.15.110:0/1608932993 learned_addr learned my addr 172.21.15.110:0/1608932993 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f261b400640 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 0x55db1be5aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.344+0000 7f2612a00640 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be5afb0 0x55db1be5d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f2612a00640 1 -- 172.21.15.110:0/1608932993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 msgr2=0x55db1be5aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f2612a00640 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 0x55db1be5aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f2612a00640 1 -- 172.21.15.110:0/1608932993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 msgr2=0x55db1be501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f2612a00640 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f2612a00640 1 -- 172.21.15.110:0/1608932993 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1bd73940 con 0x55db1be5afb0 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f261be00640 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f2612a00640 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be5afb0 0x55db1be5d3a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2604009bf0 tx=0x7f2604011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2e18ed0616e847 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:48:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f260be00640 1 -- 172.21.15.110:0/1608932993 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604004050 con 0x55db1be5afb0 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f260be00640 1 -- 172.21.15.110:0/1608932993 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26040054d0 con 0x55db1be5afb0 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f260be00640 1 -- 172.21.15.110:0/1608932993 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604004d10 con 0x55db1be5afb0 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 13245+0+0 (secure 0 0 0) 0x7f260c0f2120 con 0x7f261c104b50 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.345+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f2624e0f740 1 -- 172.21.15.110:0/1608932993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be5afb0 msgr2=0x55db1be5d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f2624e0f740 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be5afb0 0x55db1be5d3a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2604009bf0 tx=0x7f2604011810 comp rx=0 tx=0).stop 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000a6280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2614009fd0 tx=0x7f2614009500 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f2624e0f740 1 -- 172.21.15.110:0/1608932993 shutdown_connections 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f2624e0f740 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be5afb0 0x55db1be5d3a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f2624e0f740 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 0x55db1be5aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f2624e0f740 1 --2- 172.21.15.110:0/1608932993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f2624e0f740 1 -- 172.21.15.110:0/1608932993 >> 172.21.15.110:0/1608932993 conn(0x55db1be4c2e0 msgr2=0x55db1be4c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f2624e0f740 1 -- 172.21.15.110:0/1608932993 shutdown_connections 2024-04-26T11:48:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.346+0000 7f2624e0f740 1 -- 172.21.15.110:0/1608932993 wait complete. 2024-04-26T11:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.347+0000 7f2624e0f740 1 -- start start 2024-04-26T11:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.347+0000 7f2624e0f740 1 Processor -- start 2024-04-26T11:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.347+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be4fdd0 0x55db1be57eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.347+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 0x55db1be583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.347+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be5afb0 0x55db1be58930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.347+0000 7f2624e0f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55db1be5dbe0 con 0x55db1be5afb0 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.347+0000 7f2624e0f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55db1bd3cc60 con 0x55db1be506f0 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.347+0000 7f2624e0f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55db1be5dd60 con 0x55db1be4fdd0 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.347+0000 7f2624e0f740 10 client.0 _ll_register_callbacks cb 0x55db1bd68e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f261b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be4fdd0 0x55db1be57eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f2612a00640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 0x55db1be583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f261be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be5afb0 0x55db1be58930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f261b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be4fdd0 0x55db1be57eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.110:48904/0 (socket says 172.21.15.110:48904) 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f261b400640 1 -- 172.21.15.110:0/642458761 learned_addr learned my addr 172.21.15.110:0/642458761 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f2612a00640 1 -- 172.21.15.110:0/642458761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be4fdd0 msgr2=0x55db1be57eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f2612a00640 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be4fdd0 0x55db1be57eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f2612a00640 1 -- 172.21.15.110:0/642458761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be5afb0 msgr2=0x55db1be58930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f2612a00640 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be5afb0 0x55db1be58930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f2612a00640 1 -- 172.21.15.110:0/642458761 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1bd4b510 con 0x55db1be506f0 2024-04-26T11:48:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f261b400640 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be4fdd0 0x55db1be57eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f2612a00640 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 0x55db1be583f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f260401b040 tx=0x7f2604009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134dc929626cb7f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.348+0000 7f2608c00640 10 client.0 ms_handle_connect on v2:172.21.15.193:3300/0 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.349+0000 7f2608c00640 1 -- 172.21.15.110:0/642458761 <== mon.2 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604029070 con 0x55db1be506f0 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.349+0000 7f2624e0f740 1 -- 172.21.15.110:0/642458761 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26040054d0 con 0x55db1be506f0 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.349+0000 7f2608c00640 1 -- 172.21.15.110:0/642458761 <== mon.2 v2:172.21.15.193:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 13245+0+0 (secure 0 0 0) 0x7f2604003a00 con 0x55db1be506f0 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.349+0000 7f2608c00640 1 -- 172.21.15.110:0/642458761 <== mon.2 v2:172.21.15.193:3300/0 3 ==== mon_get_version_reply(handle=1 version=320) ==== 24+0+0 (secure 0 0 0) 0x7f2604036050 con 0x55db1be506f0 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.349+0000 7f2624e0f740 10 client.26564 fetch_fsmap learned FSMap version 320 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.349+0000 7f2624e0f740 1 -- 172.21.15.110:0/642458761 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,fsmap=320,monmap=4+}) -- 0x55db1bac7210 con 0x55db1be506f0 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.350+0000 7f2608c00640 1 -- 172.21.15.110:0/642458761 <== mon.2 v2:172.21.15.193:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26040054d0 con 0x55db1be506f0 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.350+0000 7f2608c00640 1 -- 172.21.15.110:0/642458761 <== mon.2 v2:172.21.15.193:3300/0 5 ==== fsmap(e 320) ==== 3522+0+0 (secure 0 0 0) 0x7f2604004f00 con 0x55db1be506f0 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.350+0000 7f2624e0f740 10 client.26564 fetch_fsmap finished waiting for FSMap version 320 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.350+0000 7f2624e0f740 10 client.26564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.350+0000 7f2624e0f740 20 client.26564 populate_metadata read hostname 'smithi110' 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.350+0000 7f2624e0f740 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1be6afe0 0x55db1be6d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.350+0000 7f2624e0f740 4 client.26564 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.350+0000 7f2624e0f740 1 -- 172.21.15.110:0/642458761 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db1bdc2f90 con 0x55db1be6afe0 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.351+0000 7f261b400640 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1be6afe0 0x55db1be6d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.351+0000 7f261b400640 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1be6afe0 0x55db1be6d460 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4e0984a56dd3dd3 server_cookie=248d0d943eb95192 in_seq=0 out_seq=0 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.351+0000 7f2608c00640 10 client.26564 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2608c00640 1 -- 172.21.15.110:0/642458761 <== mds.0 v2:172.21.15.193:6838/64494456 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55db1bdc2f90 con 0x55db1be6afe0 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2608c00640 10 client.26564 handle_command_reply: tid=0 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 client.26564 shutdown 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 -- 172.21.15.110:0/642458761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 msgr2=0x55db1be583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 0x55db1be583f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f260401b040 tx=0x7f2604009fd0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 -- 172.21.15.110:0/642458761 shutdown_connections 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be5afb0 0x55db1be58930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be506f0 0x55db1be583f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1be6afe0 0x55db1be6d460 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 --2- 172.21.15.110:0/642458761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be4fdd0 0x55db1be57eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2608c00640 0 client.26564 ms_handle_reset on v2:172.21.15.193:6838/64494456 2024-04-26T11:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 -- 172.21.15.110:0/642458761 >> 172.21.15.110:0/642458761 conn(0x55db1be4c2e0 msgr2=0x55db1be52060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 -- 172.21.15.110:0/642458761 shutdown_connections 2024-04-26T11:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 1 -- 172.21.15.110:0/642458761 wait complete. 2024-04-26T11:48:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.352+0000 7f2624e0f740 20 client.26564 trim_cache size 0 max 16384 2024-04-26T11:48:16.371 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.369+0000 7f2624e0f740 1 Processor -- start 2024-04-26T11:48:16.371 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f2624e0f740 1 -- start start 2024-04-26T11:48:16.371 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be66aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be506f0 0x55db1be57050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be5afb0 0x55db1be52790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f2624e0f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f261c1b2cd0 con 0x55db1be4fdd0 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f2624e0f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f261c1b1860 con 0x55db1be5afb0 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f2624e0f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f261c1b1f30 con 0x55db1be506f0 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f261b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be66aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f261b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be66aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50594/0 (socket says 172.21.15.110:50594) 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f261b400640 1 -- 172.21.15.110:0/744793556 learned_addr learned my addr 172.21.15.110:0/744793556 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f2612a00640 1 --2- 172.21.15.110:0/744793556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be506f0 0x55db1be57050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.370+0000 7f261be00640 1 --2- 172.21.15.110:0/744793556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be5afb0 0x55db1be52790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.373 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.371+0000 7f261b400640 1 -- 172.21.15.110:0/744793556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be506f0 msgr2=0x55db1be57050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.371+0000 7f261b400640 1 --2- 172.21.15.110:0/744793556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be506f0 0x55db1be57050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.371+0000 7f261b400640 1 -- 172.21.15.110:0/744793556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be5afb0 msgr2=0x55db1be52790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.371+0000 7f261b400640 1 --2- 172.21.15.110:0/744793556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be5afb0 0x55db1be52790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.371+0000 7f261b400640 1 -- 172.21.15.110:0/744793556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1bb93620 con 0x55db1be4fdd0 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.371+0000 7f261b400640 1 --2- 172.21.15.110:0/744793556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be66aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f260c0bce30 tx=0x7f260c0dd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721ff00f5515104a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.372+0000 7f260b400640 1 -- 172.21.15.110:0/744793556 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c049040 con 0x55db1be4fdd0 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.372+0000 7f260b400640 1 -- 172.21.15.110:0/744793556 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f260c031430 con 0x55db1be4fdd0 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.372+0000 7f260b400640 1 -- 172.21.15.110:0/744793556 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c0c5a60 con 0x55db1be4fdd0 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.372+0000 7f2624e0f740 1 -- 172.21.15.110:0/744793556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 msgr2=0x55db1be66aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 --2- 172.21.15.110:0/744793556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be66aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f260c0bce30 tx=0x7f260c0dd040 comp rx=0 tx=0).stop 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 -- 172.21.15.110:0/744793556 shutdown_connections 2024-04-26T11:48:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 --2- 172.21.15.110:0/744793556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be5afb0 0x55db1be52790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 --2- 172.21.15.110:0/744793556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be506f0 0x55db1be57050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 --2- 172.21.15.110:0/744793556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be66aa0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 -- 172.21.15.110:0/744793556 >> 172.21.15.110:0/744793556 conn(0x55db1be4c2e0 msgr2=0x55db1be4abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T11:48:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 -- 172.21.15.110:0/744793556 shutdown_connections 2024-04-26T11:48:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 -- 172.21.15.110:0/744793556 wait complete. 2024-04-26T11:48:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 -- start start 2024-04-26T11:48:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.373+0000 7f2624e0f740 1 Processor -- start 2024-04-26T11:48:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be63490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be506f0 0x55db1be54930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f2624e0f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be5afb0 0x55db1be54ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f2624e0f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55db1be6ade0 con 0x55db1be4fdd0 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f2624e0f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f261c1b2600 con 0x55db1be5afb0 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f2624e0f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55db1be4d2e0 con 0x55db1be506f0 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f2624e0f740 10 client.0 _ll_register_callbacks cb 0x7f2614009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f261b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be63490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f261b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be63490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50610/0 (socket says 172.21.15.110:50610) 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f261b400640 1 -- 172.21.15.110:0/2875381562 learned_addr learned my addr 172.21.15.110:0/2875381562 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be506f0 0x55db1be54930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.374+0000 7f261be00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be5afb0 0x55db1be54ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f261b400640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be506f0 msgr2=0x55db1be54930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:48:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f261b400640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db1be506f0 0x55db1be54930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f261b400640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be5afb0 msgr2=0x55db1be54ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f261b400640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55db1be5afb0 0x55db1be54ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f261b400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1bd6fcb0 con 0x55db1be4fdd0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f261b400640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55db1be4fdd0 0x55db1be63490 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f260c02a9d0 tx=0x7f260c0092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbfb23947a118a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f2608c00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c0d5070 con 0x55db1be4fdd0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 13245+0+0 (secure 0 0 0) 0x7f260c03bcd0 con 0x55db1be4fdd0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f2624e0f740 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55db1bdbce00 con 0x55db1be4fdd0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=320) ==== 24+0+0 (secure 0 0 0) 0x7f260c049050 con 0x55db1be4fdd0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f2624e0f740 10 client.16308 fetch_fsmap learned FSMap version 320 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.375+0000 7f2624e0f740 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=320,monmap=4+}) -- 0x55db1bed1480 con 0x55db1be4fdd0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.376+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55db1bdbce00 con 0x55db1be4fdd0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.376+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 320) ==== 3522+0+0 (secure 0 0 0) 0x7f260c0ee820 con 0x55db1be4fdd0 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.376+0000 7f2624e0f740 10 client.16308 fetch_fsmap finished waiting for FSMap version 320 2024-04-26T11:48:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.376+0000 7f2624e0f740 10 client.16308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T11:48:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.376+0000 7f2624e0f740 20 client.16308 populate_metadata read hostname 'smithi110' 2024-04-26T11:48:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.376+0000 7f2624e0f740 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T11:48:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.376+0000 7f2624e0f740 4 client.16308 mds_command: new command op to 24518 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T11:48:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.376+0000 7f2624e0f740 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db1bd384b0 con 0x55db1bed1920 2024-04-26T11:48:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.376+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T11:48:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.377+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T11:48:16.380 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:48:16.377+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cefb6ad87c5d10e2 server_cookie=71d1dc7e4a803510 in_seq=0 out_seq=0 2024-04-26T11:48:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:17 smithi193 ceph-mon[32782]: pgmap v593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-26T11:48:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:17 smithi196 ceph-mon[32572]: pgmap v593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-26T11:48:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:17 smithi110 ceph-mon[28069]: pgmap v593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-04-26T11:48:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:19 smithi193 ceph-mon[32782]: pgmap v594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-26T11:48:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:19 smithi193 ceph-mon[32782]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active(laggy or crashed)} 1 up:standby-replay 2024-04-26T11:48:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:19 smithi196 ceph-mon[32572]: pgmap v594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-26T11:48:19.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:19 smithi196 ceph-mon[32572]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active(laggy or crashed)} 1 up:standby-replay 2024-04-26T11:48:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:19 smithi110 ceph-mon[28069]: pgmap v594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 63 KiB/s wr, 31 op/s 2024-04-26T11:48:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:19 smithi110 ceph-mon[28069]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=a=up:active(laggy or crashed)} 1 up:standby-replay 2024-04-26T11:48:21.198 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:20 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 3. 2024-04-26T11:48:21.198 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:20 smithi110 systemd[1]: Stopped Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:48:21.198 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:20 smithi110 systemd[1]: ceph-6e439470-03be-11ef-bc93-c7b262605968@mds.g.service: Consumed 1.886s CPU time. 2024-04-26T11:48:21.199 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:20 smithi110 systemd[1]: Starting Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968... 2024-04-26T11:48:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:21 smithi110 ceph-mon[28069]: pgmap v595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-04-26T11:48:21.542 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:21 smithi110 podman[96828]: 2024-04-26 11:48:21.10673199 +0000 UTC m=+0.040764736 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T11:48:21.542 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:21 smithi110 podman[96828]: 2024-04-26 11:48:21.233223167 +0000 UTC m=+0.167255923 container create c9d5679f359b81cc2bf9ef246c99b4d3a2ba8956173132508e4e931a61452ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-26T11:48:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:21 smithi193 ceph-mon[32782]: pgmap v595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-04-26T11:48:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:21 smithi196 ceph-mon[32572]: pgmap v595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-04-26T11:48:22.042 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:21 smithi110 podman[96828]: 2024-04-26 11:48:21.587003312 +0000 UTC m=+0.521036125 container init c9d5679f359b81cc2bf9ef246c99b4d3a2ba8956173132508e4e931a61452ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T11:48:22.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:21 smithi110 podman[96828]: 2024-04-26 11:48:21.597755615 +0000 UTC m=+0.531788341 container start c9d5679f359b81cc2bf9ef246c99b4d3a2ba8956173132508e4e931a61452ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T11:48:22.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:21 smithi110 ceph-mds[96847]: -- 172.21.15.110:0/3327293172 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c661525a40 con 0x55c6614f8800 2024-04-26T11:48:22.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:21 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mds-g[96843]: starting mds.g at 2024-04-26T11:48:22.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:21 smithi110 bash[96828]: c9d5679f359b81cc2bf9ef246c99b4d3a2ba8956173132508e4e931a61452ce0 2024-04-26T11:48:22.043 INFO:journalctl@ceph.mds.g.smithi110.stdout:Apr 26 11:48:21 smithi110 systemd[1]: Started Ceph mds.g for 6e439470-03be-11ef-bc93-c7b262605968. 2024-04-26T11:48:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: daemon mds.g restarted 2024-04-26T11:48:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:48:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: osdmap e168: 12 total, 12 up, 12 in 2024-04-26T11:48:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1521517698,v1:172.21.15.110:6835/1521517698] up:boot 2024-04-26T11:48:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: Replacing daemon mds.a as rank 2 with standby daemon mds.g 2024-04-26T11:48:22.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: MDS daemon mds.a is removed because it is dead or otherwise unavailable. 2024-04-26T11:48:22.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2024-04-26T11:48:22.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:active(laggy or crashed)} 1 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:48:22.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:48:22.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: osdmap e169: 12 total, 12 up, 12 in 2024-04-26T11:48:22.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:22 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:replay} 1 up:standby-replay, 1 failed 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: daemon mds.g restarted 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: osdmap e168: 12 total, 12 up, 12 in 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1521517698,v1:172.21.15.110:6835/1521517698] up:boot 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: Replacing daemon mds.a as rank 2 with standby daemon mds.g 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: MDS daemon mds.a is removed because it is dead or otherwise unavailable. 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:active(laggy or crashed)} 1 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: osdmap e169: 12 total, 12 up, 12 in 2024-04-26T11:48:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:22 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:replay} 1 up:standby-replay, 1 failed 2024-04-26T11:48:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: daemon mds.g restarted 2024-04-26T11:48:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T11:48:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: osdmap e168: 12 total, 12 up, 12 in 2024-04-26T11:48:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1521517698,v1:172.21.15.110:6835/1521517698] up:boot 2024-04-26T11:48:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: Replacing daemon mds.a as rank 2 with standby daemon mds.g 2024-04-26T11:48:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: MDS daemon mds.a is removed because it is dead or otherwise unavailable. 2024-04-26T11:48:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2024-04-26T11:48:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:active(laggy or crashed)} 1 up:standby-replay 1 up:standby, 1 failed 2024-04-26T11:48:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T11:48:22.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: osdmap e169: 12 total, 12 up, 12 in 2024-04-26T11:48:22.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:22 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:replay} 1 up:standby-replay, 1 failed 2024-04-26T11:48:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:23 smithi196 ceph-mon[32572]: pgmap v598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 KiB/s wr, 5 op/s 2024-04-26T11:48:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.110:6834/1521517698,v1:172.21.15.110:6835/1521517698] up:resolve 2024-04-26T11:48:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:23 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:48:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:23 smithi110 ceph-mon[28069]: pgmap v598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 KiB/s wr, 5 op/s 2024-04-26T11:48:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.110:6834/1521517698,v1:172.21.15.110:6835/1521517698] up:resolve 2024-04-26T11:48:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:23 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:48:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:23 smithi193 ceph-mon[32782]: pgmap v598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 KiB/s wr, 5 op/s 2024-04-26T11:48:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.110:6834/1521517698,v1:172.21.15.110:6835/1521517698] up:resolve 2024-04-26T11:48:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:23 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:48:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:25 smithi196 ceph-mon[32572]: pgmap v599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 21 KiB/s wr, 8 op/s 2024-04-26T11:48:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:25 smithi110 ceph-mon[28069]: pgmap v599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 21 KiB/s wr, 8 op/s 2024-04-26T11:48:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:25 smithi193 ceph-mon[32782]: pgmap v599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 21 KiB/s wr, 8 op/s 2024-04-26T11:48:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:27 smithi196 ceph-mon[32572]: pgmap v600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 9.2 KiB/s wr, 4 op/s 2024-04-26T11:48:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:27 smithi110 ceph-mon[28069]: pgmap v600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 9.2 KiB/s wr, 4 op/s 2024-04-26T11:48:27.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:27 smithi193 ceph-mon[32782]: pgmap v600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 9.2 KiB/s wr, 4 op/s 2024-04-26T11:48:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:29 smithi196 ceph-mon[32572]: pgmap v601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 4 op/s 2024-04-26T11:48:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:29 smithi110 ceph-mon[28069]: pgmap v601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 4 op/s 2024-04-26T11:48:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:29 smithi193 ceph-mon[32782]: pgmap v601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 4 op/s 2024-04-26T11:48:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:31 smithi196 ceph-mon[32572]: pgmap v602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 4 op/s 2024-04-26T11:48:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:31 smithi110 ceph-mon[28069]: pgmap v602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 4 op/s 2024-04-26T11:48:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:31 smithi193 ceph-mon[32782]: pgmap v602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 4 op/s 2024-04-26T11:48:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:33 smithi196 ceph-mon[32572]: pgmap v603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 4 op/s 2024-04-26T11:48:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:33 smithi110 ceph-mon[28069]: pgmap v603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 4 op/s 2024-04-26T11:48:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:33 smithi193 ceph-mon[32782]: pgmap v603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 4 op/s 2024-04-26T11:48:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:35 smithi196 ceph-mon[32572]: pgmap v604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 4 op/s 2024-04-26T11:48:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:35 smithi110 ceph-mon[28069]: pgmap v604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 4 op/s 2024-04-26T11:48:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:35 smithi193 ceph-mon[32782]: pgmap v604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 4 op/s 2024-04-26T11:48:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:37 smithi196 ceph-mon[32572]: pgmap v605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:37 smithi110 ceph-mon[28069]: pgmap v605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:37 smithi193 ceph-mon[32782]: pgmap v605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:39.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:39 smithi193 ceph-mon[32782]: pgmap v606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-26T11:48:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:39 smithi196 ceph-mon[32572]: pgmap v606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-26T11:48:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:39 smithi110 ceph-mon[28069]: pgmap v606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-26T11:48:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:41 smithi196 ceph-mon[32572]: pgmap v607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:41 smithi110 ceph-mon[28069]: pgmap v607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:41 smithi193 ceph-mon[32782]: pgmap v607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:43 smithi196 ceph-mon[32572]: pgmap v608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:43 smithi110 ceph-mon[28069]: pgmap v608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:43 smithi193 ceph-mon[32782]: pgmap v608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:45 smithi196 ceph-mon[32572]: pgmap v609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-26T11:48:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:45 smithi110 ceph-mon[28069]: pgmap v609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-26T11:48:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:45 smithi193 ceph-mon[32782]: pgmap v609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-26T11:48:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:47 smithi196 ceph-mon[32572]: pgmap v610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:48:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:47 smithi110 ceph-mon[28069]: pgmap v610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:48:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:47 smithi193 ceph-mon[32782]: pgmap v610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:48:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:48:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:48:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:48:48.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:48:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:48:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:48:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:48:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:48:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:48:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:48:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:49 smithi196 ceph-mon[32572]: pgmap v611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3 op/s 2024-04-26T11:48:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:49 smithi196 ceph-mon[32572]: pgmap v612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:49 smithi110 ceph-mon[28069]: pgmap v611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3 op/s 2024-04-26T11:48:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:49 smithi110 ceph-mon[28069]: pgmap v612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:49 smithi193 ceph-mon[32782]: pgmap v611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3 op/s 2024-04-26T11:48:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:49 smithi193 ceph-mon[32782]: pgmap v612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:51 smithi196 ceph-mon[32572]: pgmap v613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:51 smithi110 ceph-mon[28069]: pgmap v613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:51 smithi193 ceph-mon[32782]: pgmap v613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:53 smithi196 ceph-mon[32572]: pgmap v614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:53 smithi110 ceph-mon[28069]: pgmap v614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:53 smithi193 ceph-mon[32782]: pgmap v614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:55 smithi196 ceph-mon[32572]: pgmap v615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:55 smithi110 ceph-mon[28069]: pgmap v615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:55 smithi193 ceph-mon[32782]: pgmap v615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:57 smithi196 ceph-mon[32572]: pgmap v616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:57 smithi110 ceph-mon[28069]: pgmap v616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:57 smithi193 ceph-mon[32782]: pgmap v616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 3 op/s 2024-04-26T11:48:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:48:59 smithi196 ceph-mon[32572]: pgmap v617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2 op/s 2024-04-26T11:48:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:48:59 smithi110 ceph-mon[28069]: pgmap v617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2 op/s 2024-04-26T11:48:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:48:59 smithi193 ceph-mon[32782]: pgmap v617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2 op/s 2024-04-26T11:49:00.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:49:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:49:00.312+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:49:00.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:49:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:49:00.312+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:49:00.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:49:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:49:00.312+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:49:00.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:49:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:49:00.312+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:49:00.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:49:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:49:00.312+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:49:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:01 smithi196 ceph-mon[32572]: pgmap v618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:01 smithi110 ceph-mon[28069]: pgmap v618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:01 smithi193 ceph-mon[32782]: pgmap v618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:03 smithi196 ceph-mon[32572]: pgmap v619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:03 smithi110 ceph-mon[28069]: pgmap v619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:03 smithi193 ceph-mon[32782]: pgmap v619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:05 smithi196 ceph-mon[32572]: pgmap v620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T11:49:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:05 smithi110 ceph-mon[28069]: pgmap v620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T11:49:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:05 smithi193 ceph-mon[32782]: pgmap v620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T11:49:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:07 smithi196 ceph-mon[32572]: pgmap v621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T11:49:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:07 smithi110 ceph-mon[28069]: pgmap v621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T11:49:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:07 smithi193 ceph-mon[32782]: pgmap v621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T11:49:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:09 smithi196 ceph-mon[32572]: pgmap v622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-26T11:49:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:09 smithi110 ceph-mon[28069]: pgmap v622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-26T11:49:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:09 smithi193 ceph-mon[32782]: pgmap v622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-26T11:49:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:11 smithi196 ceph-mon[32572]: pgmap v623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T11:49:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:11 smithi110 ceph-mon[28069]: pgmap v623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T11:49:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:11 smithi193 ceph-mon[32782]: pgmap v623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T11:49:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:13 smithi110 ceph-mon[28069]: pgmap v624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T11:49:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:13 smithi193 ceph-mon[32782]: pgmap v624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T11:49:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:13 smithi196 ceph-mon[32572]: pgmap v624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T11:49:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:15 smithi110 ceph-mon[28069]: pgmap v625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-26T11:49:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:15 smithi193 ceph-mon[32782]: pgmap v625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-26T11:49:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:15 smithi196 ceph-mon[32572]: pgmap v625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-26T11:49:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:17 smithi110 ceph-mon[28069]: pgmap v626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:17 smithi193 ceph-mon[32782]: pgmap v626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:17 smithi196 ceph-mon[32572]: pgmap v626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:19 smithi110 ceph-mon[28069]: pgmap v627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:19.810 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:19 smithi196 ceph-mon[32572]: pgmap v627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:19 smithi193 ceph-mon[32782]: pgmap v627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:21 smithi110 ceph-mon[28069]: pgmap v628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:21 smithi193 ceph-mon[32782]: pgmap v628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:21 smithi196 ceph-mon[32572]: pgmap v628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:23 smithi110 ceph-mon[28069]: pgmap v629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:23 smithi193 ceph-mon[32782]: pgmap v629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:23 smithi196 ceph-mon[32572]: pgmap v629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:25 smithi110 ceph-mon[28069]: pgmap v630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:25 smithi193 ceph-mon[32782]: pgmap v630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:25 smithi196 ceph-mon[32572]: pgmap v630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:27 smithi193 ceph-mon[32782]: pgmap v631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:27 smithi196 ceph-mon[32572]: pgmap v631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:27 smithi110 ceph-mon[28069]: pgmap v631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:29 smithi193 ceph-mon[32782]: pgmap v632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:29 smithi196 ceph-mon[32572]: pgmap v632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:29 smithi110 ceph-mon[28069]: pgmap v632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:31 smithi193 ceph-mon[32782]: pgmap v633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:31 smithi196 ceph-mon[32572]: pgmap v633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:31 smithi110 ceph-mon[28069]: pgmap v633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:33 smithi193 ceph-mon[32782]: pgmap v634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:33 smithi196 ceph-mon[32572]: pgmap v634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:33 smithi110 ceph-mon[28069]: pgmap v634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:35 smithi193 ceph-mon[32782]: pgmap v635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:35 smithi196 ceph-mon[32572]: pgmap v635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:35 smithi110 ceph-mon[28069]: pgmap v635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:37 smithi193 ceph-mon[32782]: pgmap v636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:37 smithi196 ceph-mon[32572]: pgmap v636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:37 smithi110 ceph-mon[28069]: pgmap v636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:39 smithi193 ceph-mon[32782]: pgmap v637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:39 smithi196 ceph-mon[32572]: pgmap v637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:39 smithi110 ceph-mon[28069]: pgmap v637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:41 smithi193 ceph-mon[32782]: pgmap v638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:41 smithi196 ceph-mon[32572]: pgmap v638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:41 smithi110 ceph-mon[28069]: pgmap v638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:43 smithi193 ceph-mon[32782]: pgmap v639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:44.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:43 smithi196 ceph-mon[32572]: pgmap v639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:43 smithi110 ceph-mon[28069]: pgmap v639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:45 smithi193 ceph-mon[32782]: pgmap v640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:45 smithi196 ceph-mon[32572]: pgmap v640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:45 smithi110 ceph-mon[28069]: pgmap v640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:47 smithi193 ceph-mon[32782]: pgmap v641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:47 smithi196 ceph-mon[32572]: pgmap v641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:47 smithi110 ceph-mon[28069]: pgmap v641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:49:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:49:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:49:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:49:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:49 smithi193 ceph-mon[32782]: pgmap v642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:49:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:49:49.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:49 smithi196 ceph-mon[32572]: pgmap v642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:49.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:49:49.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:49:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:49 smithi110 ceph-mon[28069]: pgmap v642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:49:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:49:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:49:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:49:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:49:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:49:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:49:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:49:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:49:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:49:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:49:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:51 smithi193 ceph-mon[32782]: pgmap v643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:51 smithi193 ceph-mon[32782]: pgmap v644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T11:49:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:51 smithi193 ceph-mon[32782]: pgmap v645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:51.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:51 smithi110 ceph-mon[28069]: pgmap v643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:51.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:51 smithi110 ceph-mon[28069]: pgmap v644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T11:49:51.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:51 smithi110 ceph-mon[28069]: pgmap v645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:51 smithi196 ceph-mon[32572]: pgmap v643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:49:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:51 smithi196 ceph-mon[32572]: pgmap v644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T11:49:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:51 smithi196 ceph-mon[32572]: pgmap v645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:53 smithi196 ceph-mon[32572]: pgmap v646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T11:49:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:53 smithi110 ceph-mon[28069]: pgmap v646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T11:49:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:53 smithi193 ceph-mon[32782]: pgmap v646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T11:49:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:55 smithi196 ceph-mon[32572]: pgmap v647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:55 smithi110 ceph-mon[28069]: pgmap v647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:55 smithi193 ceph-mon[32782]: pgmap v647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:49:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:57 smithi196 ceph-mon[32572]: pgmap v648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T11:49:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:57 smithi110 ceph-mon[28069]: pgmap v648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T11:49:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:57 smithi193 ceph-mon[32782]: pgmap v648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T11:50:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:49:59 smithi196 ceph-mon[32572]: pgmap v649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T11:50:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:49:59 smithi110 ceph-mon[28069]: pgmap v649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T11:50:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:49:59 smithi193 ceph-mon[32782]: pgmap v649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T11:50:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:00 smithi196 ceph-mon[32572]: Health detail: HEALTH_WARN 2 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon 2024-04-26T11:50:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:00 smithi196 ceph-mon[32572]: [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-04-26T11:50:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:00 smithi196 ceph-mon[32572]: daemon mds.f on smithi196 is in error state 2024-04-26T11:50:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:00 smithi196 ceph-mon[32572]: daemon mds.i on smithi196 is in error state 2024-04-26T11:50:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:00 smithi196 ceph-mon[32572]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T11:50:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:00 smithi196 ceph-mon[32572]: fs cephfs is degraded 2024-04-26T11:50:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:00 smithi196 ceph-mon[32572]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2024-04-26T11:50:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:00 smithi196 ceph-mon[32572]: fs cephfs has 1 failed mds 2024-04-26T11:50:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:00 smithi110 ceph-mon[28069]: Health detail: HEALTH_WARN 2 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon 2024-04-26T11:50:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:00 smithi110 ceph-mon[28069]: [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-04-26T11:50:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:00 smithi110 ceph-mon[28069]: daemon mds.f on smithi196 is in error state 2024-04-26T11:50:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:00 smithi110 ceph-mon[28069]: daemon mds.i on smithi196 is in error state 2024-04-26T11:50:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:00 smithi110 ceph-mon[28069]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T11:50:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:00 smithi110 ceph-mon[28069]: fs cephfs is degraded 2024-04-26T11:50:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:00 smithi110 ceph-mon[28069]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2024-04-26T11:50:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:00 smithi110 ceph-mon[28069]: fs cephfs has 1 failed mds 2024-04-26T11:50:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:00 smithi193 ceph-mon[32782]: Health detail: HEALTH_WARN 2 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon 2024-04-26T11:50:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:00 smithi193 ceph-mon[32782]: [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-04-26T11:50:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:00 smithi193 ceph-mon[32782]: daemon mds.f on smithi196 is in error state 2024-04-26T11:50:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:00 smithi193 ceph-mon[32782]: daemon mds.i on smithi196 is in error state 2024-04-26T11:50:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:00 smithi193 ceph-mon[32782]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T11:50:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:00 smithi193 ceph-mon[32782]: fs cephfs is degraded 2024-04-26T11:50:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:00 smithi193 ceph-mon[32782]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2024-04-26T11:50:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:00 smithi193 ceph-mon[32782]: fs cephfs has 1 failed mds 2024-04-26T11:50:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:01 smithi196 ceph-mon[32572]: pgmap v650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:50:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:01 smithi110 ceph-mon[28069]: pgmap v650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:50:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:01 smithi193 ceph-mon[32782]: pgmap v650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:50:03.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:02 smithi196 ceph-mon[32572]: pgmap v651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:02 smithi110 ceph-mon[28069]: pgmap v651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:02 smithi193 ceph-mon[32782]: pgmap v651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:05 smithi196 ceph-mon[32572]: pgmap v652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:05 smithi110 ceph-mon[28069]: pgmap v652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:05 smithi193 ceph-mon[32782]: pgmap v652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:07 smithi196 ceph-mon[32572]: pgmap v653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:07 smithi110 ceph-mon[28069]: pgmap v653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:07 smithi193 ceph-mon[32782]: pgmap v653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:09.675 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:09 smithi193 ceph-mon[32782]: pgmap v654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:09 smithi196 ceph-mon[32572]: pgmap v654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:09 smithi110 ceph-mon[28069]: pgmap v654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:11 smithi196 ceph-mon[32572]: pgmap v655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:11 smithi110 ceph-mon[28069]: pgmap v655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:11 smithi193 ceph-mon[32782]: pgmap v655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:13 smithi196 ceph-mon[32572]: pgmap v656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:13 smithi110 ceph-mon[28069]: pgmap v656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:13 smithi193 ceph-mon[32782]: pgmap v656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:15 smithi196 ceph-mon[32572]: pgmap v657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:15 smithi110 ceph-mon[28069]: pgmap v657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:15 smithi193 ceph-mon[32782]: pgmap v657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:17 smithi196 ceph-mon[32572]: pgmap v658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:17 smithi110 ceph-mon[28069]: pgmap v658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:17 smithi193 ceph-mon[32782]: pgmap v658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:19 smithi196 ceph-mon[32572]: pgmap v659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:19 smithi110 ceph-mon[28069]: pgmap v659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:19 smithi193 ceph-mon[32782]: pgmap v659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:21 smithi196 ceph-mon[32572]: pgmap v660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:21 smithi110 ceph-mon[28069]: pgmap v660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:21 smithi193 ceph-mon[32782]: pgmap v660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:23 smithi196 ceph-mon[32572]: pgmap v661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:23 smithi110 ceph-mon[28069]: pgmap v661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:23 smithi193 ceph-mon[32782]: pgmap v661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:25 smithi196 ceph-mon[32572]: pgmap v662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:25 smithi110 ceph-mon[28069]: pgmap v662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:25 smithi193 ceph-mon[32782]: pgmap v662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:27 smithi196 ceph-mon[32572]: pgmap v663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:27 smithi110 ceph-mon[28069]: pgmap v663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:27 smithi193 ceph-mon[32782]: pgmap v663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:29 smithi196 ceph-mon[32572]: pgmap v664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:29 smithi110 ceph-mon[28069]: pgmap v664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:29 smithi193 ceph-mon[32782]: pgmap v664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:31 smithi196 ceph-mon[32572]: pgmap v665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:31 smithi110 ceph-mon[28069]: pgmap v665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:31 smithi193 ceph-mon[32782]: pgmap v665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:33 smithi196 ceph-mon[32572]: pgmap v666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:33 smithi110 ceph-mon[28069]: pgmap v666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:33 smithi193 ceph-mon[32782]: pgmap v666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:35 smithi196 ceph-mon[32572]: pgmap v667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:35 smithi110 ceph-mon[28069]: pgmap v667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:35 smithi193 ceph-mon[32782]: pgmap v667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:37 smithi196 ceph-mon[32572]: pgmap v668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:37 smithi110 ceph-mon[28069]: pgmap v668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:37 smithi193 ceph-mon[32782]: pgmap v668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:39 smithi196 ceph-mon[32572]: pgmap v669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:39 smithi110 ceph-mon[28069]: pgmap v669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:39 smithi193 ceph-mon[32782]: pgmap v669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:41 smithi196 ceph-mon[32572]: pgmap v670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:41 smithi110 ceph-mon[28069]: pgmap v670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:41.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:41 smithi193 ceph-mon[32782]: pgmap v670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:43 smithi196 ceph-mon[32572]: pgmap v671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:43 smithi110 ceph-mon[28069]: pgmap v671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:43 smithi193 ceph-mon[32782]: pgmap v671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:45 smithi196 ceph-mon[32572]: pgmap v672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:45 smithi110 ceph-mon[28069]: pgmap v672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:45 smithi193 ceph-mon[32782]: pgmap v672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:47 smithi196 ceph-mon[32572]: pgmap v673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:47 smithi110 ceph-mon[28069]: pgmap v673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:47 smithi193 ceph-mon[32782]: pgmap v673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:50:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:49 smithi196 ceph-mon[32572]: pgmap v674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:49 smithi110 ceph-mon[28069]: pgmap v674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:49 smithi193 ceph-mon[32782]: pgmap v674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:50:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:51 smithi196 ceph-mon[32572]: pgmap v675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:50:51.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:51 smithi110 ceph-mon[28069]: pgmap v675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:50:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:51 smithi193 ceph-mon[32782]: pgmap v675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:50:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:50:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:52.661 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:50:52.662 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:50:52.662 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:50:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:50:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:50:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:50:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:50:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:53 smithi196 ceph-mon[32572]: pgmap v676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T11:50:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:53 smithi196 ceph-mon[32572]: pgmap v677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:53 smithi110 ceph-mon[28069]: pgmap v676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T11:50:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:53 smithi110 ceph-mon[28069]: pgmap v677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:53 smithi193 ceph-mon[32782]: pgmap v676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T11:50:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:53 smithi193 ceph-mon[32782]: pgmap v677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:54 smithi196 ceph-mon[32572]: pgmap v678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:54 smithi110 ceph-mon[28069]: pgmap v678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:54 smithi193 ceph-mon[32782]: pgmap v678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:57 smithi193 ceph-mon[32782]: pgmap v679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:57 smithi196 ceph-mon[32572]: pgmap v679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:57 smithi110 ceph-mon[28069]: pgmap v679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:50:59 smithi193 ceph-mon[32782]: pgmap v680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:50:59 smithi196 ceph-mon[32572]: pgmap v680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:50:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:50:59 smithi110 ceph-mon[28069]: pgmap v680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:51:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:01 smithi193 ceph-mon[32782]: pgmap v681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:51:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:01 smithi196 ceph-mon[32572]: pgmap v681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:51:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:01 smithi110 ceph-mon[28069]: pgmap v681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:51:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:03 smithi110 ceph-mon[28069]: pgmap v682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:51:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:03 smithi193 ceph-mon[32782]: pgmap v682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:51:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:03 smithi196 ceph-mon[32572]: pgmap v682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:51:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:05 smithi193 ceph-mon[32782]: pgmap v683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:05 smithi196 ceph-mon[32572]: pgmap v683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:05 smithi110 ceph-mon[28069]: pgmap v683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:07 smithi193 ceph-mon[32782]: pgmap v684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:07 smithi193 ceph-mon[32782]: 1 slow requests, 1 included below; oldest blocked for > 181.743673 secs 2024-04-26T11:51:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:07 smithi193 ceph-mon[32782]: slow request 181.743672 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T11:51:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:07 smithi196 ceph-mon[32572]: pgmap v684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:07 smithi196 ceph-mon[32572]: 1 slow requests, 1 included below; oldest blocked for > 181.743673 secs 2024-04-26T11:51:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:07 smithi196 ceph-mon[32572]: slow request 181.743672 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T11:51:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:07 smithi110 ceph-mon[28069]: pgmap v684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:07 smithi110 ceph-mon[28069]: 1 slow requests, 1 included below; oldest blocked for > 181.743673 secs 2024-04-26T11:51:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:07 smithi110 ceph-mon[28069]: slow request 181.743672 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T11:51:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:08 smithi196 ceph-mon[32572]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T11:51:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:08 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:51:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:08 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:51:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:08 smithi110 ceph-mon[28069]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T11:51:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:08 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:51:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:08 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:51:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:08 smithi193 ceph-mon[32782]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T11:51:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:08 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:51:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:08 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:51:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:09 smithi196 ceph-mon[32572]: pgmap v685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:09.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:09 smithi193 ceph-mon[32782]: pgmap v685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:09 smithi110 ceph-mon[28069]: pgmap v685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:11 smithi196 ceph-mon[32572]: pgmap v686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:11 smithi110 ceph-mon[28069]: pgmap v686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:11 smithi193 ceph-mon[32782]: pgmap v686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:12 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 186.743740 secs 2024-04-26T11:51:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:12 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 186.743740 secs 2024-04-26T11:51:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:12 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 186.743740 secs 2024-04-26T11:51:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:13 smithi196 ceph-mon[32572]: pgmap v687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:13 smithi110 ceph-mon[28069]: pgmap v687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:13 smithi193 ceph-mon[32782]: pgmap v687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:15 smithi196 ceph-mon[32572]: pgmap v688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:15 smithi110 ceph-mon[28069]: pgmap v688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:15 smithi193 ceph-mon[32782]: pgmap v688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:51:16.368+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034f0 con 0x7f261c104b50 2024-04-26T11:51:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:51:16.369+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x55db1bed1480 con 0x7f261c104b50 2024-04-26T11:51:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:51:16.398+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80034c0 con 0x55db1be4fdd0 2024-04-26T11:51:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:51:16.399+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e80034c0 con 0x55db1be4fdd0 2024-04-26T11:51:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:17 smithi196 ceph-mon[32572]: pgmap v689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:17 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 191.743881 secs 2024-04-26T11:51:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:17 smithi110 ceph-mon[28069]: pgmap v689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:17 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 191.743881 secs 2024-04-26T11:51:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:17 smithi193 ceph-mon[32782]: pgmap v689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:17 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 191.743881 secs 2024-04-26T11:51:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:19 smithi196 ceph-mon[32572]: pgmap v690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:19 smithi110 ceph-mon[28069]: pgmap v690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:19 smithi193 ceph-mon[32782]: pgmap v690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:21.501 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:21 smithi196 ceph-mon[32572]: pgmap v691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:21 smithi110 ceph-mon[28069]: pgmap v691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:21 smithi193 ceph-mon[32782]: pgmap v691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:22 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 196.744017 secs 2024-04-26T11:51:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:22 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 196.744017 secs 2024-04-26T11:51:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:22 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 196.744017 secs 2024-04-26T11:51:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:23 smithi196 ceph-mon[32572]: pgmap v692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:23 smithi110 ceph-mon[28069]: pgmap v692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:23 smithi193 ceph-mon[32782]: pgmap v692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:25 smithi196 ceph-mon[32572]: pgmap v693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:25 smithi110 ceph-mon[28069]: pgmap v693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:25 smithi193 ceph-mon[32782]: pgmap v693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:27 smithi196 ceph-mon[32572]: pgmap v694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:27 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 201.744091 secs 2024-04-26T11:51:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:27 smithi110 ceph-mon[28069]: pgmap v694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:27 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 201.744091 secs 2024-04-26T11:51:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:27 smithi193 ceph-mon[32782]: pgmap v694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:27 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 201.744091 secs 2024-04-26T11:51:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:29 smithi196 ceph-mon[32572]: pgmap v695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:29 smithi110 ceph-mon[28069]: pgmap v695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:29 smithi193 ceph-mon[32782]: pgmap v695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:31 smithi196 ceph-mon[32572]: pgmap v696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:31 smithi110 ceph-mon[28069]: pgmap v696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:31 smithi193 ceph-mon[32782]: pgmap v696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:32 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 206.744200 secs 2024-04-26T11:51:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:32 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 206.744200 secs 2024-04-26T11:51:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:32 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 206.744200 secs 2024-04-26T11:51:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:33 smithi196 ceph-mon[32572]: pgmap v697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:33 smithi110 ceph-mon[28069]: pgmap v697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:33 smithi193 ceph-mon[32782]: pgmap v697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:35 smithi196 ceph-mon[32572]: pgmap v698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:35 smithi110 ceph-mon[28069]: pgmap v698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:35 smithi193 ceph-mon[32782]: pgmap v698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:37 smithi196 ceph-mon[32572]: pgmap v699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:37 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 211.744343 secs 2024-04-26T11:51:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:37 smithi110 ceph-mon[28069]: pgmap v699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:37 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 211.744343 secs 2024-04-26T11:51:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:37 smithi193 ceph-mon[32782]: pgmap v699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:37 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 211.744343 secs 2024-04-26T11:51:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:39 smithi196 ceph-mon[32572]: pgmap v700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:39 smithi110 ceph-mon[28069]: pgmap v700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:39 smithi193 ceph-mon[32782]: pgmap v700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:41 smithi196 ceph-mon[32572]: pgmap v701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:41 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 216.744480 secs 2024-04-26T11:51:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:41 smithi110 ceph-mon[28069]: pgmap v701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:41 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 216.744480 secs 2024-04-26T11:51:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:41 smithi193 ceph-mon[32782]: pgmap v701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:41 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 216.744480 secs 2024-04-26T11:51:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:43 smithi196 ceph-mon[32572]: pgmap v702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:43 smithi110 ceph-mon[28069]: pgmap v702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:43 smithi193 ceph-mon[32782]: pgmap v702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:45 smithi196 ceph-mon[32572]: pgmap v703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:45 smithi110 ceph-mon[28069]: pgmap v703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:45 smithi193 ceph-mon[32782]: pgmap v703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:46 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 221.744616 secs 2024-04-26T11:51:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:46 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 221.744616 secs 2024-04-26T11:51:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:46 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 221.744616 secs 2024-04-26T11:51:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:47 smithi196 ceph-mon[32572]: pgmap v704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:47 smithi110 ceph-mon[28069]: pgmap v704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:47 smithi193 ceph-mon[32782]: pgmap v704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:49 smithi110 ceph-mon[28069]: pgmap v705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:49 smithi193 ceph-mon[32782]: pgmap v705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:49 smithi196 ceph-mon[32572]: pgmap v705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:51 smithi110 ceph-mon[28069]: pgmap v706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:51 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 226.744758 secs 2024-04-26T11:51:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:51 smithi193 ceph-mon[32782]: pgmap v706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:51 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 226.744758 secs 2024-04-26T11:51:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:51 smithi196 ceph-mon[32572]: pgmap v706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:51:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:51 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 226.744758 secs 2024-04-26T11:51:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:51:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:51:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:51:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:53 smithi193 ceph-mon[32782]: pgmap v707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:53 smithi196 ceph-mon[32572]: pgmap v707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:53.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:53 smithi110 ceph-mon[28069]: pgmap v707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: pgmap v708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: pgmap v708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: pgmap v708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:51:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T11:51:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T11:51:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 231.744823 secs 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:56.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T11:51:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T11:51:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T11:51:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T11:51:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 231.744823 secs 2024-04-26T11:51:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T11:51:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T11:51:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 231.744823 secs 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:57 smithi193 ceph-mon[32782]: pgmap v709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:57 smithi196 ceph-mon[32572]: pgmap v709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:57 smithi110 ceph-mon[28069]: pgmap v709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:51:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: pgmap v710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 896 B/s rd, 1 op/s 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: pgmap v711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 543 B/s rd, 1 op/s 2024-04-26T11:51:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: pgmap v710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 896 B/s rd, 1 op/s 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: pgmap v711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 543 B/s rd, 1 op/s 2024-04-26T11:51:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T11:51:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T11:51:58.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T11:51:58.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:51:58.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:51:58.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: pgmap v710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 896 B/s rd, 1 op/s 2024-04-26T11:51:58.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: pgmap v711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 543 B/s rd, 1 op/s 2024-04-26T11:51:58.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:51:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:51:59 smithi193 ceph-mon[32782]: Health check update: 9 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T11:51:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:51:59 smithi196 ceph-mon[32572]: Health check update: 9 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T11:51:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:51:59 smithi110 ceph-mon[28069]: Health check update: 9 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T11:52:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:00 smithi193 ceph-mon[32782]: pgmap v712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:52:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:00 smithi196 ceph-mon[32572]: pgmap v712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:52:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:00 smithi110 ceph-mon[28069]: pgmap v712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:52:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:01 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 236.744960 secs 2024-04-26T11:52:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:01 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 236.744960 secs 2024-04-26T11:52:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:01 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 236.744960 secs 2024-04-26T11:52:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:02 smithi193 ceph-mon[32782]: pgmap v713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:52:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:02 smithi196 ceph-mon[32572]: pgmap v713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:52:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:02 smithi110 ceph-mon[28069]: pgmap v713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:52:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:04 smithi196 ceph-mon[32572]: pgmap v714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T11:52:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:04 smithi110 ceph-mon[28069]: pgmap v714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T11:52:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:04 smithi193 ceph-mon[32782]: pgmap v714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T11:52:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:06 smithi196 ceph-mon[32572]: pgmap v715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:52:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:06 smithi196 ceph-mon[32572]: 2 slow requests, 1 included below; oldest blocked for > 241.745040 secs 2024-04-26T11:52:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:06 smithi196 ceph-mon[32572]: slow request 181.767502 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T11:52:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:06 smithi110 ceph-mon[28069]: pgmap v715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:52:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:06 smithi110 ceph-mon[28069]: 2 slow requests, 1 included below; oldest blocked for > 241.745040 secs 2024-04-26T11:52:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:06 smithi110 ceph-mon[28069]: slow request 181.767502 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T11:52:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:06 smithi193 ceph-mon[32782]: pgmap v715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:52:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:06 smithi193 ceph-mon[32782]: 2 slow requests, 1 included below; oldest blocked for > 241.745040 secs 2024-04-26T11:52:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:06 smithi193 ceph-mon[32782]: slow request 181.767502 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T11:52:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:08 smithi110 ceph-mon[28069]: pgmap v716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:52:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:08 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:52:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:08 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:52:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:08 smithi193 ceph-mon[32782]: pgmap v716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:52:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:08 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:52:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:08 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:52:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:08 smithi196 ceph-mon[32572]: pgmap v716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:52:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:08 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:52:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:08 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:52:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:10 smithi110 ceph-mon[28069]: pgmap v717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:10 smithi193 ceph-mon[32782]: pgmap v717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:10 smithi196 ceph-mon[32572]: pgmap v717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:11 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 246.745174 secs 2024-04-26T11:52:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:11 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 246.745174 secs 2024-04-26T11:52:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:11 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 246.745174 secs 2024-04-26T11:52:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:12 smithi110 ceph-mon[28069]: pgmap v718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:12 smithi193 ceph-mon[32782]: pgmap v718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:12 smithi196 ceph-mon[32572]: pgmap v718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:14 smithi110 ceph-mon[28069]: pgmap v719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:14 smithi193 ceph-mon[32782]: pgmap v719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:14 smithi196 ceph-mon[32572]: pgmap v719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:16 smithi110 ceph-mon[28069]: pgmap v720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:16 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 251.745292 secs 2024-04-26T11:52:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:16 smithi193 ceph-mon[32782]: pgmap v720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:16 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 251.745292 secs 2024-04-26T11:52:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:16 smithi196 ceph-mon[32572]: pgmap v720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:16 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 251.745292 secs 2024-04-26T11:52:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:18 smithi193 ceph-mon[32782]: pgmap v721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:18 smithi196 ceph-mon[32572]: pgmap v721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:18 smithi110 ceph-mon[28069]: pgmap v721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:20.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:20 smithi196 ceph-mon[32572]: pgmap v722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:20 smithi193 ceph-mon[32782]: pgmap v722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:20 smithi110 ceph-mon[28069]: pgmap v722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:21 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 256.745435 secs 2024-04-26T11:52:21.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:21 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 256.745435 secs 2024-04-26T11:52:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:21 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 256.745435 secs 2024-04-26T11:52:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:22 smithi193 ceph-mon[32782]: pgmap v723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:22 smithi196 ceph-mon[32572]: pgmap v723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:22 smithi110 ceph-mon[28069]: pgmap v723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:24 smithi193 ceph-mon[32782]: pgmap v724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:24 smithi196 ceph-mon[32572]: pgmap v724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:24 smithi110 ceph-mon[28069]: pgmap v724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:26 smithi193 ceph-mon[32782]: pgmap v725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:26 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 261.745549 secs 2024-04-26T11:52:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:26 smithi196 ceph-mon[32572]: pgmap v725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:26 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 261.745549 secs 2024-04-26T11:52:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:26 smithi110 ceph-mon[28069]: pgmap v725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:26 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 261.745549 secs 2024-04-26T11:52:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:28 smithi193 ceph-mon[32782]: pgmap v726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:28 smithi196 ceph-mon[32572]: pgmap v726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:28 smithi110 ceph-mon[28069]: pgmap v726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:30 smithi193 ceph-mon[32782]: pgmap v727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:30 smithi196 ceph-mon[32572]: pgmap v727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:30 smithi110 ceph-mon[28069]: pgmap v727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:31 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 266.745669 secs 2024-04-26T11:52:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:31 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 266.745669 secs 2024-04-26T11:52:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:31 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 266.745669 secs 2024-04-26T11:52:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:32 smithi193 ceph-mon[32782]: pgmap v728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:32 smithi196 ceph-mon[32572]: pgmap v728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:32 smithi110 ceph-mon[28069]: pgmap v728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:34 smithi193 ceph-mon[32782]: pgmap v729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:34 smithi196 ceph-mon[32572]: pgmap v729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:34 smithi110 ceph-mon[28069]: pgmap v729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:36 smithi193 ceph-mon[32782]: pgmap v730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:36 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 271.745784 secs 2024-04-26T11:52:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:36 smithi196 ceph-mon[32572]: pgmap v730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:36 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 271.745784 secs 2024-04-26T11:52:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:36 smithi110 ceph-mon[28069]: pgmap v730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:36 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 271.745784 secs 2024-04-26T11:52:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:38 smithi193 ceph-mon[32782]: pgmap v731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:38 smithi196 ceph-mon[32572]: pgmap v731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:38 smithi110 ceph-mon[28069]: pgmap v731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:40 smithi193 ceph-mon[32782]: pgmap v732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:40 smithi196 ceph-mon[32572]: pgmap v732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:40 smithi110 ceph-mon[28069]: pgmap v732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:41 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 276.745900 secs 2024-04-26T11:52:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:41 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 276.745900 secs 2024-04-26T11:52:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:41 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 276.745900 secs 2024-04-26T11:52:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:42 smithi196 ceph-mon[32572]: pgmap v733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:42 smithi110 ceph-mon[28069]: pgmap v733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:42 smithi193 ceph-mon[32782]: pgmap v733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:44 smithi196 ceph-mon[32572]: pgmap v734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:44 smithi110 ceph-mon[28069]: pgmap v734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:44 smithi193 ceph-mon[32782]: pgmap v734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:46 smithi196 ceph-mon[32572]: pgmap v735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:46 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 281.746053 secs 2024-04-26T11:52:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:46 smithi110 ceph-mon[28069]: pgmap v735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:46 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 281.746053 secs 2024-04-26T11:52:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:46 smithi193 ceph-mon[32782]: pgmap v735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:52:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:46 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 281.746053 secs 2024-04-26T11:52:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:48 smithi196 ceph-mon[32572]: pgmap v736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:48 smithi110 ceph-mon[28069]: pgmap v736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:48 smithi193 ceph-mon[32782]: pgmap v736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:50 smithi196 ceph-mon[32572]: pgmap v737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:50 smithi110 ceph-mon[28069]: pgmap v737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:50 smithi193 ceph-mon[32782]: pgmap v737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:52:51.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:51 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 286.746170 secs 2024-04-26T11:52:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:51 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 286.746170 secs 2024-04-26T11:52:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:51 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 286.746170 secs 2024-04-26T11:52:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:52 smithi196 ceph-mon[32572]: pgmap v738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:52 smithi110 ceph-mon[28069]: pgmap v738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:52 smithi193 ceph-mon[32782]: pgmap v738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:54 smithi196 ceph-mon[32572]: pgmap v739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T11:52:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:54 smithi110 ceph-mon[28069]: pgmap v739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T11:52:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:54 smithi193 ceph-mon[32782]: pgmap v739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T11:52:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:56 smithi196 ceph-mon[32572]: pgmap v740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:56 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 291.746285 secs 2024-04-26T11:52:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:56 smithi110 ceph-mon[28069]: pgmap v740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:56 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 291.746285 secs 2024-04-26T11:52:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:56 smithi193 ceph-mon[32782]: pgmap v740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:56 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 291.746285 secs 2024-04-26T11:52:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:58 smithi196 ceph-mon[32572]: pgmap v741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:52:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:58 smithi110 ceph-mon[28069]: pgmap v741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:52:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:58 smithi193 ceph-mon[32782]: pgmap v741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:52:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:53:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:53:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:53:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:52:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:53:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:53:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:53:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:52:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:53:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:53:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:53:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:52:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:53:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:00 smithi196 ceph-mon[32572]: pgmap v742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T11:53:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:00 smithi196 ceph-mon[32572]: pgmap v743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:00 smithi110 ceph-mon[28069]: pgmap v742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T11:53:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:00 smithi110 ceph-mon[28069]: pgmap v743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:00 smithi193 ceph-mon[32782]: pgmap v742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T11:53:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:00 smithi193 ceph-mon[32782]: pgmap v743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:01 smithi196 ceph-mon[32572]: pgmap v744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:01 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 296.746407 secs 2024-04-26T11:53:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:01 smithi110 ceph-mon[28069]: pgmap v744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:01 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 296.746407 secs 2024-04-26T11:53:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:01 smithi193 ceph-mon[32782]: pgmap v744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:01 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 296.746407 secs 2024-04-26T11:53:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:04 smithi193 ceph-mon[32782]: pgmap v745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:04 smithi196 ceph-mon[32572]: pgmap v745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:04 smithi110 ceph-mon[28069]: pgmap v745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:06 smithi193 ceph-mon[32782]: pgmap v746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:06 smithi196 ceph-mon[32572]: pgmap v746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:06 smithi110 ceph-mon[28069]: pgmap v746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:07 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 301.746538 secs 2024-04-26T11:53:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:07 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 301.746538 secs 2024-04-26T11:53:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:07 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 301.746538 secs 2024-04-26T11:53:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:08 smithi193 ceph-mon[32782]: pgmap v747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:08 smithi196 ceph-mon[32572]: pgmap v747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:08 smithi110 ceph-mon[28069]: pgmap v747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:53:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:09 smithi196 ceph-mon[32572]: pgmap v748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:53:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:09 smithi110 ceph-mon[28069]: pgmap v748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:53:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:09 smithi193 ceph-mon[32782]: pgmap v748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:53:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:12 smithi193 ceph-mon[32782]: pgmap v749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:12 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 306.746666 secs 2024-04-26T11:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:12 smithi196 ceph-mon[32572]: pgmap v749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:12 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 306.746666 secs 2024-04-26T11:53:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:12 smithi110 ceph-mon[28069]: pgmap v749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:12 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 306.746666 secs 2024-04-26T11:53:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:14 smithi193 ceph-mon[32782]: pgmap v750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:14 smithi196 ceph-mon[32572]: pgmap v750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:14 smithi110 ceph-mon[28069]: pgmap v750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:16 smithi193 ceph-mon[32782]: pgmap v751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:16 smithi196 ceph-mon[32572]: pgmap v751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:16 smithi110 ceph-mon[28069]: pgmap v751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:17 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 311.746785 secs 2024-04-26T11:53:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:17 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 311.746785 secs 2024-04-26T11:53:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:17 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 311.746785 secs 2024-04-26T11:53:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:18 smithi193 ceph-mon[32782]: pgmap v752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:18 smithi196 ceph-mon[32572]: pgmap v752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:18 smithi110 ceph-mon[28069]: pgmap v752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:20 smithi193 ceph-mon[32782]: pgmap v753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:20 smithi196 ceph-mon[32572]: pgmap v753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:20 smithi110 ceph-mon[28069]: pgmap v753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:22.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:22 smithi110 ceph-mon[28069]: pgmap v754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:22.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:22 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 316.746903 secs 2024-04-26T11:53:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:22 smithi193 ceph-mon[32782]: pgmap v754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:22 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 316.746903 secs 2024-04-26T11:53:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:22 smithi196 ceph-mon[32572]: pgmap v754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:22 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 316.746903 secs 2024-04-26T11:53:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:24 smithi193 ceph-mon[32782]: pgmap v755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:24 smithi196 ceph-mon[32572]: pgmap v755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:24 smithi110 ceph-mon[28069]: pgmap v755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:26 smithi193 ceph-mon[32782]: pgmap v756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:26 smithi196 ceph-mon[32572]: pgmap v756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:26 smithi110 ceph-mon[28069]: pgmap v756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:27 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 321.747012 secs 2024-04-26T11:53:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:27 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 321.747012 secs 2024-04-26T11:53:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:27 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 321.747012 secs 2024-04-26T11:53:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:28 smithi193 ceph-mon[32782]: pgmap v757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:28 smithi196 ceph-mon[32572]: pgmap v757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:28 smithi110 ceph-mon[28069]: pgmap v757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:30 smithi193 ceph-mon[32782]: pgmap v758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:30 smithi196 ceph-mon[32572]: pgmap v758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:30 smithi110 ceph-mon[28069]: pgmap v758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:32 smithi196 ceph-mon[32572]: pgmap v759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:32 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 326.747124 secs 2024-04-26T11:53:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:32 smithi110 ceph-mon[28069]: pgmap v759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:32 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 326.747124 secs 2024-04-26T11:53:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:32 smithi193 ceph-mon[32782]: pgmap v759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:32 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 326.747124 secs 2024-04-26T11:53:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:34 smithi196 ceph-mon[32572]: pgmap v760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:34 smithi110 ceph-mon[28069]: pgmap v760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:34 smithi193 ceph-mon[32782]: pgmap v760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:36 smithi196 ceph-mon[32572]: pgmap v761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:36 smithi110 ceph-mon[28069]: pgmap v761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:36 smithi193 ceph-mon[32782]: pgmap v761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:37 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 331.747197 secs 2024-04-26T11:53:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:37 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 331.747197 secs 2024-04-26T11:53:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:37 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 331.747197 secs 2024-04-26T11:53:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:38 smithi196 ceph-mon[32572]: pgmap v762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:38 smithi110 ceph-mon[28069]: pgmap v762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:38 smithi193 ceph-mon[32782]: pgmap v762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:40.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:40 smithi193 ceph-mon[32782]: pgmap v763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:40 smithi196 ceph-mon[32572]: pgmap v763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:40 smithi110 ceph-mon[28069]: pgmap v763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:42 smithi196 ceph-mon[32572]: pgmap v764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:42 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 336.747289 secs 2024-04-26T11:53:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:42 smithi110 ceph-mon[28069]: pgmap v764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:42 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 336.747289 secs 2024-04-26T11:53:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:42 smithi193 ceph-mon[32782]: pgmap v764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:42 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 336.747289 secs 2024-04-26T11:53:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:44 smithi196 ceph-mon[32572]: pgmap v765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:44 smithi110 ceph-mon[28069]: pgmap v765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:44 smithi193 ceph-mon[32782]: pgmap v765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:46 smithi196 ceph-mon[32572]: pgmap v766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:46 smithi110 ceph-mon[28069]: pgmap v766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:46 smithi193 ceph-mon[32782]: pgmap v766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:47 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 341.747404 secs 2024-04-26T11:53:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:47 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 341.747404 secs 2024-04-26T11:53:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:47 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 341.747404 secs 2024-04-26T11:53:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:48 smithi196 ceph-mon[32572]: pgmap v767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:48 smithi110 ceph-mon[28069]: pgmap v767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:48 smithi193 ceph-mon[32782]: pgmap v767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:50 smithi196 ceph-mon[32572]: pgmap v768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:50 smithi110 ceph-mon[28069]: pgmap v768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:50 smithi193 ceph-mon[32782]: pgmap v768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:52 smithi196 ceph-mon[32572]: pgmap v769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:52 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 346.747516 secs 2024-04-26T11:53:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:52 smithi110 ceph-mon[28069]: pgmap v769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:52 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 346.747516 secs 2024-04-26T11:53:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:52 smithi193 ceph-mon[32782]: pgmap v769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:52 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 346.747516 secs 2024-04-26T11:53:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:54 smithi196 ceph-mon[32572]: pgmap v770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:54 smithi110 ceph-mon[28069]: pgmap v770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:54 smithi193 ceph-mon[32782]: pgmap v770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:53:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:56 smithi196 ceph-mon[32572]: pgmap v771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:56 smithi110 ceph-mon[28069]: pgmap v771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:56 smithi193 ceph-mon[32782]: pgmap v771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:53:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:57 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 351.747628 secs 2024-04-26T11:53:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:57 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 351.747628 secs 2024-04-26T11:53:57.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:57 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 351.747628 secs 2024-04-26T11:53:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:53:58 smithi196 ceph-mon[32572]: pgmap v772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:53:58 smithi110 ceph-mon[28069]: pgmap v772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:53:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:53:58 smithi193 ceph-mon[32782]: pgmap v772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:00 smithi110 ceph-mon[28069]: pgmap v773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:00.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:54:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:00 smithi193 ceph-mon[32782]: pgmap v773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:54:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:00 smithi196 ceph-mon[32572]: pgmap v773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:54:00.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:54:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:54:00.530+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:54:00.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:54:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:54:00.530+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:54:00.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:54:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:54:00.530+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:54:00.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:54:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:54:00.530+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:54:00.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:54:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:54:00.531+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:54:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:54:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:54:01.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:01 smithi110 ceph-mon[28069]: pgmap v774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T11:54:01.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:01 smithi110 ceph-mon[28069]: pgmap v775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:54:01.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:54:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:54:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:54:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:01 smithi193 ceph-mon[32782]: pgmap v774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T11:54:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:01 smithi193 ceph-mon[32782]: pgmap v775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:54:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:54:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:54:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:54:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:01 smithi196 ceph-mon[32572]: pgmap v774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T11:54:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:01 smithi196 ceph-mon[32572]: pgmap v775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:54:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:54:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:02 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 356.747736 secs 2024-04-26T11:54:02.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:02 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 356.747736 secs 2024-04-26T11:54:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:02 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 356.747736 secs 2024-04-26T11:54:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:03 smithi110 ceph-mon[28069]: pgmap v776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T11:54:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:03 smithi193 ceph-mon[32782]: pgmap v776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T11:54:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:03 smithi196 ceph-mon[32572]: pgmap v776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T11:54:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:05 smithi196 ceph-mon[32572]: pgmap v777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 320 B/s wr, 16 op/s 2024-04-26T11:54:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:05 smithi110 ceph-mon[28069]: pgmap v777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 320 B/s wr, 16 op/s 2024-04-26T11:54:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:05 smithi193 ceph-mon[32782]: pgmap v777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 320 B/s wr, 16 op/s 2024-04-26T11:54:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:06 smithi196 ceph-mon[32572]: 2 slow requests, 1 included below; oldest blocked for > 361.747850 secs 2024-04-26T11:54:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:06 smithi196 ceph-mon[32572]: slow request 361.747849 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T11:54:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:06 smithi110 ceph-mon[28069]: 2 slow requests, 1 included below; oldest blocked for > 361.747850 secs 2024-04-26T11:54:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:06 smithi110 ceph-mon[28069]: slow request 361.747849 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T11:54:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:06 smithi193 ceph-mon[32782]: 2 slow requests, 1 included below; oldest blocked for > 361.747850 secs 2024-04-26T11:54:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:06 smithi193 ceph-mon[32782]: slow request 361.747849 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T11:54:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:07 smithi196 ceph-mon[32572]: pgmap v778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 320 B/s wr, 16 op/s 2024-04-26T11:54:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:07 smithi110 ceph-mon[28069]: pgmap v778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 320 B/s wr, 16 op/s 2024-04-26T11:54:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:07 smithi193 ceph-mon[32782]: pgmap v778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 320 B/s wr, 16 op/s 2024-04-26T11:54:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:09 smithi196 ceph-mon[32572]: pgmap v779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 320 B/s wr, 16 op/s 2024-04-26T11:54:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:09 smithi110 ceph-mon[28069]: pgmap v779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 320 B/s wr, 16 op/s 2024-04-26T11:54:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:09 smithi193 ceph-mon[32782]: pgmap v779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 320 B/s wr, 16 op/s 2024-04-26T11:54:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:11 smithi196 ceph-mon[32572]: pgmap v780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T11:54:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:11 smithi196 ceph-mon[32572]: 3 slow requests, 1 included below; oldest blocked for > 366.747962 secs 2024-04-26T11:54:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:11 smithi196 ceph-mon[32572]: slow request 182.963101 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T11:54:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:11 smithi110 ceph-mon[28069]: pgmap v780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T11:54:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:11 smithi110 ceph-mon[28069]: 3 slow requests, 1 included below; oldest blocked for > 366.747962 secs 2024-04-26T11:54:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:11 smithi110 ceph-mon[28069]: slow request 182.963101 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T11:54:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:11 smithi193 ceph-mon[32782]: pgmap v780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T11:54:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:11 smithi193 ceph-mon[32782]: 3 slow requests, 1 included below; oldest blocked for > 366.747962 secs 2024-04-26T11:54:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:11 smithi193 ceph-mon[32782]: slow request 182.963101 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T11:54:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:12 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:54:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:12 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:54:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:12 smithi196 ceph-mon[32572]: pgmap v781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T11:54:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:12 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:54:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:12 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:54:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:12 smithi110 ceph-mon[28069]: pgmap v781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T11:54:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:12 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:54:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:12 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:54:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:12 smithi193 ceph-mon[32782]: pgmap v781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T11:54:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:15 smithi196 ceph-mon[32572]: pgmap v782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T11:54:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:15 smithi110 ceph-mon[28069]: pgmap v782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T11:54:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:15 smithi193 ceph-mon[32782]: pgmap v782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T11:54:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:54:16.397+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec005880 con 0x7f261c104b50 2024-04-26T11:54:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:54:16.398+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f260c078070 con 0x7f261c104b50 2024-04-26T11:54:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:54:16.425+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8005820 con 0x55db1be4fdd0 2024-04-26T11:54:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:54:16.426+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8005820 con 0x55db1be4fdd0 2024-04-26T11:54:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:16 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 371.748072 secs 2024-04-26T11:54:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:16 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 371.748072 secs 2024-04-26T11:54:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:16 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 371.748072 secs 2024-04-26T11:54:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:17 smithi196 ceph-mon[32572]: pgmap v783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:17 smithi110 ceph-mon[28069]: pgmap v783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:17 smithi193 ceph-mon[32782]: pgmap v783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:19 smithi196 ceph-mon[32572]: pgmap v784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:19 smithi110 ceph-mon[28069]: pgmap v784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:19 smithi193 ceph-mon[32782]: pgmap v784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:21 smithi196 ceph-mon[32572]: pgmap v785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:21 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 376.748185 secs 2024-04-26T11:54:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:21 smithi110 ceph-mon[28069]: pgmap v785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:21 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 376.748185 secs 2024-04-26T11:54:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:21 smithi193 ceph-mon[32782]: pgmap v785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:21 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 376.748185 secs 2024-04-26T11:54:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:22 smithi196 ceph-mon[32572]: pgmap v786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:22 smithi110 ceph-mon[28069]: pgmap v786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:22 smithi193 ceph-mon[32782]: pgmap v786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:25 smithi196 ceph-mon[32572]: pgmap v787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:25 smithi110 ceph-mon[28069]: pgmap v787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:25 smithi193 ceph-mon[32782]: pgmap v787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:26 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 381.748311 secs 2024-04-26T11:54:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:26 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 381.748311 secs 2024-04-26T11:54:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:26 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 381.748311 secs 2024-04-26T11:54:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:27 smithi196 ceph-mon[32572]: pgmap v788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:27 smithi110 ceph-mon[28069]: pgmap v788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:27 smithi193 ceph-mon[32782]: pgmap v788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:29 smithi196 ceph-mon[32572]: pgmap v789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:29 smithi110 ceph-mon[28069]: pgmap v789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:29 smithi193 ceph-mon[32782]: pgmap v789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:30 smithi110 ceph-mon[28069]: pgmap v790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:30 smithi193 ceph-mon[32782]: pgmap v790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:30 smithi196 ceph-mon[32572]: pgmap v790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:31 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 386.748430 secs 2024-04-26T11:54:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:31 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 386.748430 secs 2024-04-26T11:54:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:31 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 386.748430 secs 2024-04-26T11:54:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:32 smithi110 ceph-mon[28069]: pgmap v791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:32 smithi193 ceph-mon[32782]: pgmap v791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:32 smithi196 ceph-mon[32572]: pgmap v791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:35 smithi196 ceph-mon[32572]: pgmap v792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:35 smithi110 ceph-mon[28069]: pgmap v792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:35 smithi193 ceph-mon[32782]: pgmap v792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:36 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 391.748556 secs 2024-04-26T11:54:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:36 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 391.748556 secs 2024-04-26T11:54:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:36 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 391.748556 secs 2024-04-26T11:54:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:37 smithi196 ceph-mon[32572]: pgmap v793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:37 smithi110 ceph-mon[28069]: pgmap v793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:37 smithi193 ceph-mon[32782]: pgmap v793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:39 smithi196 ceph-mon[32572]: pgmap v794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:39 smithi110 ceph-mon[28069]: pgmap v794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:39 smithi193 ceph-mon[32782]: pgmap v794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:40 smithi196 ceph-mon[32572]: pgmap v795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:41.024 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:40 smithi193 ceph-mon[32782]: pgmap v795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:40 smithi110 ceph-mon[28069]: pgmap v795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:41 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 396.748673 secs 2024-04-26T11:54:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:41 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 396.748673 secs 2024-04-26T11:54:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:41 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 396.748673 secs 2024-04-26T11:54:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:42 smithi196 ceph-mon[32572]: pgmap v796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:42 smithi110 ceph-mon[28069]: pgmap v796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:42 smithi193 ceph-mon[32782]: pgmap v796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:45 smithi196 ceph-mon[32572]: pgmap v797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:45 smithi110 ceph-mon[28069]: pgmap v797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:45 smithi193 ceph-mon[32782]: pgmap v797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:46 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 401.748795 secs 2024-04-26T11:54:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:46 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 401.748795 secs 2024-04-26T11:54:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:46 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 401.748795 secs 2024-04-26T11:54:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:47 smithi196 ceph-mon[32572]: pgmap v798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:47 smithi110 ceph-mon[28069]: pgmap v798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:47 smithi193 ceph-mon[32782]: pgmap v798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:48 smithi110 ceph-mon[28069]: pgmap v799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:48 smithi193 ceph-mon[32782]: pgmap v799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:48 smithi196 ceph-mon[32572]: pgmap v799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:51.959 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:51 smithi196 ceph-mon[32572]: pgmap v800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:51.959 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:51 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 406.748862 secs 2024-04-26T11:54:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:51 smithi110 ceph-mon[28069]: pgmap v800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:51 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 406.748862 secs 2024-04-26T11:54:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:51 smithi193 ceph-mon[32782]: pgmap v800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:51 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 406.748862 secs 2024-04-26T11:54:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:53 smithi196 ceph-mon[32572]: pgmap v801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:53 smithi110 ceph-mon[28069]: pgmap v801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:53 smithi193 ceph-mon[32782]: pgmap v801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:55 smithi196 ceph-mon[32572]: pgmap v802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:55 smithi110 ceph-mon[28069]: pgmap v802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:55 smithi193 ceph-mon[32782]: pgmap v802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:56 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 411.749000 secs 2024-04-26T11:54:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:56 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 411.749000 secs 2024-04-26T11:54:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:56 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 411.749000 secs 2024-04-26T11:54:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:57 smithi196 ceph-mon[32572]: pgmap v803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:57 smithi110 ceph-mon[28069]: pgmap v803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:57 smithi193 ceph-mon[32782]: pgmap v803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:54:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:54:58 smithi196 ceph-mon[32572]: pgmap v804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:54:58 smithi110 ceph-mon[28069]: pgmap v804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:54:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:54:58 smithi193 ceph-mon[32782]: pgmap v804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:01 smithi196 ceph-mon[32572]: pgmap v805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:55:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:01 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 416.749096 secs 2024-04-26T11:55:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:01 smithi110 ceph-mon[28069]: pgmap v805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:55:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:01 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 416.749096 secs 2024-04-26T11:55:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:01 smithi193 ceph-mon[32782]: pgmap v805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:55:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:01 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 416.749096 secs 2024-04-26T11:55:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:55:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:55:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:55:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:55:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:55:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:55:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:55:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:55:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:55:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:03 smithi196 ceph-mon[32572]: pgmap v806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T11:55:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:03 smithi196 ceph-mon[32572]: pgmap v807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:55:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:03 smithi110 ceph-mon[28069]: pgmap v806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T11:55:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:03 smithi110 ceph-mon[28069]: pgmap v807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:55:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:03 smithi193 ceph-mon[32782]: pgmap v806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T11:55:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:03 smithi193 ceph-mon[32782]: pgmap v807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:55:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:04 smithi196 ceph-mon[32572]: pgmap v808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:04 smithi110 ceph-mon[28069]: pgmap v808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:04 smithi193 ceph-mon[32782]: pgmap v808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:07 smithi196 ceph-mon[32572]: 3 slow requests, 1 included below; oldest blocked for > 421.749234 secs 2024-04-26T11:55:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:07 smithi196 ceph-mon[32572]: slow request 361.771696 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T11:55:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:07 smithi196 ceph-mon[32572]: pgmap v809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:07 smithi110 ceph-mon[28069]: 3 slow requests, 1 included below; oldest blocked for > 421.749234 secs 2024-04-26T11:55:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:07 smithi110 ceph-mon[28069]: slow request 361.771696 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T11:55:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:07 smithi110 ceph-mon[28069]: pgmap v809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:07 smithi193 ceph-mon[32782]: 3 slow requests, 1 included below; oldest blocked for > 421.749234 secs 2024-04-26T11:55:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:07 smithi193 ceph-mon[32782]: slow request 361.771696 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T11:55:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:07 smithi193 ceph-mon[32782]: pgmap v809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:09 smithi196 ceph-mon[32572]: pgmap v810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:09 smithi110 ceph-mon[28069]: pgmap v810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:09 smithi193 ceph-mon[32782]: pgmap v810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:11 smithi196 ceph-mon[32572]: pgmap v811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:11 smithi110 ceph-mon[28069]: pgmap v811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:11 smithi193 ceph-mon[32782]: pgmap v811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:12 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 426.749376 secs 2024-04-26T11:55:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:12 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 426.749376 secs 2024-04-26T11:55:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:12 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 426.749376 secs 2024-04-26T11:55:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:13 smithi110 ceph-mon[28069]: pgmap v812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:13 smithi193 ceph-mon[32782]: pgmap v812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:13 smithi196 ceph-mon[32572]: pgmap v812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:15 smithi110 ceph-mon[28069]: pgmap v813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:15 smithi193 ceph-mon[32782]: pgmap v813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:15 smithi196 ceph-mon[32572]: pgmap v813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T11:55:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:16 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 431.749501 secs 2024-04-26T11:55:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:16 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 431.749501 secs 2024-04-26T11:55:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:16 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 431.749501 secs 2024-04-26T11:55:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:17 smithi110 ceph-mon[28069]: pgmap v814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:17 smithi193 ceph-mon[32782]: pgmap v814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:17 smithi196 ceph-mon[32572]: pgmap v814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:19 smithi110 ceph-mon[28069]: pgmap v815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:19 smithi193 ceph-mon[32782]: pgmap v815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:19 smithi196 ceph-mon[32572]: pgmap v815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:21.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:21 smithi196 ceph-mon[32572]: pgmap v816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:21.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:21 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 436.749624 secs 2024-04-26T11:55:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:21 smithi193 ceph-mon[32782]: pgmap v816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:21 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 436.749624 secs 2024-04-26T11:55:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:21 smithi110 ceph-mon[28069]: pgmap v816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:21 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 436.749624 secs 2024-04-26T11:55:23.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:23 smithi110 ceph-mon[28069]: pgmap v817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:23 smithi193 ceph-mon[32782]: pgmap v817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:23 smithi196 ceph-mon[32572]: pgmap v817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:25 smithi193 ceph-mon[32782]: pgmap v818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:25 smithi196 ceph-mon[32572]: pgmap v818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:25 smithi110 ceph-mon[28069]: pgmap v818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:26 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 441.749755 secs 2024-04-26T11:55:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:26 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 441.749755 secs 2024-04-26T11:55:26.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:26 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 441.749755 secs 2024-04-26T11:55:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:27 smithi193 ceph-mon[32782]: pgmap v819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:27.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:27 smithi196 ceph-mon[32572]: pgmap v819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:27 smithi110 ceph-mon[28069]: pgmap v819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:29 smithi193 ceph-mon[32782]: pgmap v820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:29 smithi196 ceph-mon[32572]: pgmap v820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:29 smithi110 ceph-mon[28069]: pgmap v820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:31 smithi193 ceph-mon[32782]: pgmap v821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:31 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 446.749874 secs 2024-04-26T11:55:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:31 smithi196 ceph-mon[32572]: pgmap v821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:31 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 446.749874 secs 2024-04-26T11:55:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:31 smithi110 ceph-mon[28069]: pgmap v821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:31 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 446.749874 secs 2024-04-26T11:55:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:33 smithi193 ceph-mon[32782]: pgmap v822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:33 smithi196 ceph-mon[32572]: pgmap v822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:33 smithi110 ceph-mon[28069]: pgmap v822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:35 smithi193 ceph-mon[32782]: pgmap v823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:35 smithi196 ceph-mon[32572]: pgmap v823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:35 smithi110 ceph-mon[28069]: pgmap v823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:36 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 451.749991 secs 2024-04-26T11:55:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:36 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 451.749991 secs 2024-04-26T11:55:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:36 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 451.749991 secs 2024-04-26T11:55:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:37 smithi193 ceph-mon[32782]: pgmap v824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:37 smithi196 ceph-mon[32572]: pgmap v824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:37 smithi110 ceph-mon[28069]: pgmap v824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:39 smithi193 ceph-mon[32782]: pgmap v825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:39 smithi196 ceph-mon[32572]: pgmap v825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:39 smithi110 ceph-mon[28069]: pgmap v825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:41 smithi193 ceph-mon[32782]: pgmap v826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:41 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 456.750111 secs 2024-04-26T11:55:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:41 smithi196 ceph-mon[32572]: pgmap v826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:41 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 456.750111 secs 2024-04-26T11:55:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:41 smithi110 ceph-mon[28069]: pgmap v826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:41 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 456.750111 secs 2024-04-26T11:55:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:43 smithi193 ceph-mon[32782]: pgmap v827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:43 smithi196 ceph-mon[32572]: pgmap v827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:43 smithi110 ceph-mon[28069]: pgmap v827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:45 smithi193 ceph-mon[32782]: pgmap v828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:45 smithi196 ceph-mon[32572]: pgmap v828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:45 smithi110 ceph-mon[28069]: pgmap v828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:46 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 461.750237 secs 2024-04-26T11:55:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:46 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 461.750237 secs 2024-04-26T11:55:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:46 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 461.750237 secs 2024-04-26T11:55:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:47 smithi196 ceph-mon[32572]: pgmap v829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:47 smithi110 ceph-mon[28069]: pgmap v829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:47 smithi193 ceph-mon[32782]: pgmap v829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:49 smithi196 ceph-mon[32572]: pgmap v830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:49 smithi110 ceph-mon[28069]: pgmap v830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:49 smithi193 ceph-mon[32782]: pgmap v830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:51 smithi196 ceph-mon[32572]: pgmap v831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:51 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 466.750365 secs 2024-04-26T11:55:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:51 smithi110 ceph-mon[28069]: pgmap v831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:51 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 466.750365 secs 2024-04-26T11:55:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:51 smithi193 ceph-mon[32782]: pgmap v831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:55:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:51 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 466.750365 secs 2024-04-26T11:55:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:53 smithi196 ceph-mon[32572]: pgmap v832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:53 smithi110 ceph-mon[28069]: pgmap v832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:53 smithi193 ceph-mon[32782]: pgmap v832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:55 smithi196 ceph-mon[32572]: pgmap v833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:55 smithi110 ceph-mon[28069]: pgmap v833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:55 smithi193 ceph-mon[32782]: pgmap v833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:56 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 471.750492 secs 2024-04-26T11:55:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:56 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 471.750492 secs 2024-04-26T11:55:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:56 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 471.750492 secs 2024-04-26T11:55:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:57 smithi196 ceph-mon[32572]: pgmap v834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:57 smithi110 ceph-mon[28069]: pgmap v834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:57 smithi193 ceph-mon[32782]: pgmap v834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:55:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:55:59 smithi196 ceph-mon[32572]: pgmap v835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:55:59 smithi110 ceph-mon[28069]: pgmap v835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:55:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:55:59 smithi193 ceph-mon[32782]: pgmap v835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:01 smithi196 ceph-mon[32572]: pgmap v836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:01 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 476.750622 secs 2024-04-26T11:56:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:01 smithi110 ceph-mon[28069]: pgmap v836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:01 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 476.750622 secs 2024-04-26T11:56:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:01 smithi193 ceph-mon[32782]: pgmap v836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:01 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 476.750622 secs 2024-04-26T11:56:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:03 smithi196 ceph-mon[32572]: pgmap v837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:56:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:03 smithi110 ceph-mon[28069]: pgmap v837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:56:03.811 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:03 smithi193 ceph-mon[32782]: pgmap v837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:03.811 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:56:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:05 smithi196 ceph-mon[32572]: pgmap v838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:05 smithi110 ceph-mon[28069]: pgmap v838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:05 smithi193 ceph-mon[32782]: pgmap v838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:06.554 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:06 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 481.750689 secs 2024-04-26T11:56:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:06 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 481.750689 secs 2024-04-26T11:56:06.646 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:06 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 481.750689 secs 2024-04-26T11:56:07.982 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:07 smithi110 ceph-mon[28069]: pgmap v839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:07.982 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:07.982 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:07.982 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:07.982 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:07 smithi196 ceph-mon[32572]: pgmap v839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:07 smithi193 ceph-mon[32782]: pgmap v839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:08.990 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:08 smithi110 ceph-mon[28069]: pgmap v840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:08 smithi193 ceph-mon[32782]: pgmap v840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:08 smithi196 ceph-mon[32572]: pgmap v840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:56:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:56:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:10 smithi193 ceph-mon[32782]: pgmap v841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 940 B/s rd, 2 op/s 2024-04-26T11:56:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:10 smithi193 ceph-mon[32782]: pgmap v842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:56:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:56:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:56:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:10 smithi196 ceph-mon[32572]: pgmap v841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 940 B/s rd, 2 op/s 2024-04-26T11:56:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:10 smithi196 ceph-mon[32572]: pgmap v842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:56:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:56:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:56:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:10 smithi110 ceph-mon[28069]: pgmap v841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 940 B/s rd, 2 op/s 2024-04-26T11:56:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:10 smithi110 ceph-mon[28069]: pgmap v842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:56:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:56:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:12 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 486.750803 secs 2024-04-26T11:56:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:12 smithi196 ceph-mon[32572]: pgmap v843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:56:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:12 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 486.750803 secs 2024-04-26T11:56:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:12 smithi110 ceph-mon[28069]: pgmap v843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:56:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:12 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 486.750803 secs 2024-04-26T11:56:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:12 smithi193 ceph-mon[32782]: pgmap v843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:56:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:14 smithi196 ceph-mon[32572]: pgmap v844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T11:56:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:14 smithi110 ceph-mon[28069]: pgmap v844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T11:56:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:14 smithi193 ceph-mon[32782]: pgmap v844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T11:56:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:16 smithi196 ceph-mon[32572]: pgmap v845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:56:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:16 smithi110 ceph-mon[28069]: pgmap v845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:56:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:16 smithi193 ceph-mon[32782]: pgmap v845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:56:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:17 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 491.750917 secs 2024-04-26T11:56:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:17 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 491.750917 secs 2024-04-26T11:56:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:17 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 491.750917 secs 2024-04-26T11:56:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:18 smithi196 ceph-mon[32572]: pgmap v846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 575 B/s rd, 1 op/s 2024-04-26T11:56:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:18 smithi110 ceph-mon[28069]: pgmap v846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 575 B/s rd, 1 op/s 2024-04-26T11:56:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:18 smithi193 ceph-mon[32782]: pgmap v846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 575 B/s rd, 1 op/s 2024-04-26T11:56:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:20 smithi196 ceph-mon[32572]: pgmap v847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:56:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:20 smithi110 ceph-mon[28069]: pgmap v847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:56:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:20 smithi193 ceph-mon[32782]: pgmap v847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:56:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:22 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 496.751043 secs 2024-04-26T11:56:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:22 smithi196 ceph-mon[32572]: pgmap v848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:22 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 496.751043 secs 2024-04-26T11:56:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:22 smithi110 ceph-mon[28069]: pgmap v848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:22 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 496.751043 secs 2024-04-26T11:56:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:22 smithi193 ceph-mon[32782]: pgmap v848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:24 smithi196 ceph-mon[32572]: pgmap v849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:24 smithi110 ceph-mon[28069]: pgmap v849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:24 smithi193 ceph-mon[32782]: pgmap v849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:26 smithi196 ceph-mon[32572]: pgmap v850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:26 smithi110 ceph-mon[28069]: pgmap v850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:26 smithi193 ceph-mon[32782]: pgmap v850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:27 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 501.751156 secs 2024-04-26T11:56:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:27 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 501.751156 secs 2024-04-26T11:56:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:27 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 501.751156 secs 2024-04-26T11:56:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:28 smithi196 ceph-mon[32572]: pgmap v851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:28 smithi110 ceph-mon[28069]: pgmap v851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:28 smithi193 ceph-mon[32782]: pgmap v851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:30 smithi196 ceph-mon[32572]: pgmap v852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:30 smithi110 ceph-mon[28069]: pgmap v852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:30 smithi193 ceph-mon[32782]: pgmap v852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:56:31.419+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec005880 con 0x7f261c104b50 2024-04-26T11:56:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:56:31.420+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec005880 con 0x7f261c104b50 2024-04-26T11:56:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:56:31.445+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8005b00 con 0x55db1be4fdd0 2024-04-26T11:56:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:56:31.446+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8005b00 con 0x55db1be4fdd0 2024-04-26T11:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:32 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 506.751277 secs 2024-04-26T11:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:32 smithi196 ceph-mon[32572]: pgmap v853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:32 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 506.751277 secs 2024-04-26T11:56:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:32 smithi110 ceph-mon[28069]: pgmap v853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:32 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 506.751277 secs 2024-04-26T11:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:32 smithi193 ceph-mon[32782]: pgmap v853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:34 smithi196 ceph-mon[32572]: pgmap v854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:34 smithi110 ceph-mon[28069]: pgmap v854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:34 smithi193 ceph-mon[32782]: pgmap v854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:36 smithi196 ceph-mon[32572]: pgmap v855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:36 smithi110 ceph-mon[28069]: pgmap v855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:36 smithi193 ceph-mon[32782]: pgmap v855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:37 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 511.751394 secs 2024-04-26T11:56:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:37 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 511.751394 secs 2024-04-26T11:56:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:37 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 511.751394 secs 2024-04-26T11:56:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:38 smithi196 ceph-mon[32572]: pgmap v856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:38 smithi110 ceph-mon[28069]: pgmap v856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:38 smithi193 ceph-mon[32782]: pgmap v856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:40.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:40 smithi110 ceph-mon[28069]: pgmap v857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:40 smithi193 ceph-mon[32782]: pgmap v857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:40 smithi196 ceph-mon[32572]: pgmap v857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:42 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 516.751544 secs 2024-04-26T11:56:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:42 smithi110 ceph-mon[28069]: pgmap v858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:42 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 516.751544 secs 2024-04-26T11:56:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:42 smithi193 ceph-mon[32782]: pgmap v858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:42 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 516.751544 secs 2024-04-26T11:56:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:42 smithi196 ceph-mon[32572]: pgmap v858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:44 smithi110 ceph-mon[28069]: pgmap v859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:44 smithi193 ceph-mon[32782]: pgmap v859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:44 smithi196 ceph-mon[32572]: pgmap v859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:46 smithi110 ceph-mon[28069]: pgmap v860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:46 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 521.751686 secs 2024-04-26T11:56:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:46 smithi193 ceph-mon[32782]: pgmap v860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:46 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 521.751686 secs 2024-04-26T11:56:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:46 smithi196 ceph-mon[32572]: pgmap v860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:46 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 521.751686 secs 2024-04-26T11:56:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:48 smithi110 ceph-mon[28069]: pgmap v861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:48 smithi193 ceph-mon[32782]: pgmap v861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:48 smithi196 ceph-mon[32572]: pgmap v861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:50 smithi110 ceph-mon[28069]: pgmap v862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:50 smithi193 ceph-mon[32782]: pgmap v862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:50 smithi196 ceph-mon[32572]: pgmap v862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:51 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 526.751817 secs 2024-04-26T11:56:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:51 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 526.751817 secs 2024-04-26T11:56:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:51 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 526.751817 secs 2024-04-26T11:56:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:52 smithi193 ceph-mon[32782]: pgmap v863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:52.657 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:52 smithi196 ceph-mon[32572]: pgmap v863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:52 smithi110 ceph-mon[28069]: pgmap v863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:54.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:54 smithi110 ceph-mon[28069]: pgmap v864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:54 smithi193 ceph-mon[32782]: pgmap v864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:54 smithi196 ceph-mon[32572]: pgmap v864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:56:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:56 smithi193 ceph-mon[32782]: pgmap v865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:56 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 531.751914 secs 2024-04-26T11:56:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:56 smithi196 ceph-mon[32572]: pgmap v865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:56 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 531.751914 secs 2024-04-26T11:56:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:56 smithi110 ceph-mon[28069]: pgmap v865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:56:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:56 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 531.751914 secs 2024-04-26T11:56:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:56:58 smithi193 ceph-mon[32782]: pgmap v866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:56:58 smithi196 ceph-mon[32572]: pgmap v866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:56:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:56:58 smithi110 ceph-mon[28069]: pgmap v866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:00 smithi193 ceph-mon[32782]: pgmap v867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:00 smithi196 ceph-mon[32572]: pgmap v867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:00 smithi110 ceph-mon[28069]: pgmap v867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:01 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 536.751994 secs 2024-04-26T11:57:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:01 smithi193 ceph-mon[32782]: slow request 180.509942 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T11:57:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:01 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 536.751994 secs 2024-04-26T11:57:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:01 smithi196 ceph-mon[32572]: slow request 180.509942 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T11:57:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:01 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 536.751994 secs 2024-04-26T11:57:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:01 smithi110 ceph-mon[28069]: slow request 180.509942 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T11:57:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:02 smithi193 ceph-mon[32782]: pgmap v868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:02.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:02 smithi196 ceph-mon[32572]: pgmap v868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:02 smithi110 ceph-mon[28069]: pgmap v868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:04 smithi193 ceph-mon[32782]: pgmap v869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:04 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:57:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:04 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:57:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:04 smithi196 ceph-mon[32572]: pgmap v869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:04 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:57:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:04 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:57:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:04 smithi110 ceph-mon[28069]: pgmap v869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:04 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T11:57:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:04 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T11:57:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:06 smithi193 ceph-mon[32782]: pgmap v870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:57:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 541.752153 secs 2024-04-26T11:57:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:06 smithi196 ceph-mon[32572]: pgmap v870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:57:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 541.752153 secs 2024-04-26T11:57:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:06 smithi110 ceph-mon[28069]: pgmap v870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:57:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 541.752153 secs 2024-04-26T11:57:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:08 smithi193 ceph-mon[32782]: pgmap v871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:08 smithi196 ceph-mon[32572]: pgmap v871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:08 smithi110 ceph-mon[28069]: pgmap v871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:10 smithi193 ceph-mon[32782]: pgmap v872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:57:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:10 smithi196 ceph-mon[32572]: pgmap v872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:10.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:57:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:10 smithi110 ceph-mon[28069]: pgmap v872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:57:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:57:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:57:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:11 smithi193 ceph-mon[32782]: pgmap v873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T11:57:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:11 smithi193 ceph-mon[32782]: pgmap v874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:57:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:11 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 546.752271 secs 2024-04-26T11:57:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:11 smithi193 ceph-mon[32782]: slow request 362.967410 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T11:57:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:57:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:57:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:11 smithi196 ceph-mon[32572]: pgmap v873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T11:57:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:11 smithi196 ceph-mon[32572]: pgmap v874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:57:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:11 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 546.752271 secs 2024-04-26T11:57:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:11 smithi196 ceph-mon[32572]: slow request 362.967410 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T11:57:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:57:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:57:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:11 smithi110 ceph-mon[28069]: pgmap v873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T11:57:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:11 smithi110 ceph-mon[28069]: pgmap v874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:57:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:11 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 546.752271 secs 2024-04-26T11:57:11.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:11 smithi110 ceph-mon[28069]: slow request 362.967410 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T11:57:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:13 smithi196 ceph-mon[32572]: pgmap v875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T11:57:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:13 smithi110 ceph-mon[28069]: pgmap v875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T11:57:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:13 smithi193 ceph-mon[32782]: pgmap v875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T11:57:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:15 smithi196 ceph-mon[32572]: pgmap v876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:15 smithi110 ceph-mon[28069]: pgmap v876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:15 smithi193 ceph-mon[32782]: pgmap v876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:57:16.427+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec005b30 con 0x7f261c104b50 2024-04-26T11:57:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:57:16.428+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec005b30 con 0x7f261c104b50 2024-04-26T11:57:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:57:16.452+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8005d20 con 0x55db1be4fdd0 2024-04-26T11:57:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T11:57:16.453+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8005d20 con 0x55db1be4fdd0 2024-04-26T11:57:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 551.752416 secs 2024-04-26T11:57:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 551.752416 secs 2024-04-26T11:57:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 551.752416 secs 2024-04-26T11:57:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:17 smithi196 ceph-mon[32572]: pgmap v877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:17 smithi110 ceph-mon[28069]: pgmap v877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:17 smithi193 ceph-mon[32782]: pgmap v877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:18 smithi193 ceph-mon[32782]: pgmap v878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:18 smithi196 ceph-mon[32572]: pgmap v878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:18 smithi110 ceph-mon[28069]: pgmap v878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:57:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:21 smithi196 ceph-mon[32572]: pgmap v879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:57:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 556.752502 secs 2024-04-26T11:57:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:21 smithi110 ceph-mon[28069]: pgmap v879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:57:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 556.752502 secs 2024-04-26T11:57:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:21 smithi193 ceph-mon[32782]: pgmap v879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:57:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 556.752502 secs 2024-04-26T11:57:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:23 smithi196 ceph-mon[32572]: pgmap v880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:23 smithi110 ceph-mon[28069]: pgmap v880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:23 smithi193 ceph-mon[32782]: pgmap v880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:25 smithi196 ceph-mon[32572]: pgmap v881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:25 smithi110 ceph-mon[28069]: pgmap v881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:25 smithi193 ceph-mon[32782]: pgmap v881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 561.752644 secs 2024-04-26T11:57:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 561.752644 secs 2024-04-26T11:57:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 561.752644 secs 2024-04-26T11:57:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:27 smithi196 ceph-mon[32572]: pgmap v882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:27 smithi110 ceph-mon[28069]: pgmap v882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:27 smithi193 ceph-mon[32782]: pgmap v882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:28 smithi110 ceph-mon[28069]: pgmap v883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:28 smithi193 ceph-mon[32782]: pgmap v883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:28 smithi196 ceph-mon[32572]: pgmap v883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:31 smithi196 ceph-mon[32572]: pgmap v884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 566.752772 secs 2024-04-26T11:57:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:31 smithi110 ceph-mon[28069]: pgmap v884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 566.752772 secs 2024-04-26T11:57:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:31 smithi193 ceph-mon[32782]: pgmap v884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 566.752772 secs 2024-04-26T11:57:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:33 smithi196 ceph-mon[32572]: pgmap v885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:33 smithi110 ceph-mon[28069]: pgmap v885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:33 smithi193 ceph-mon[32782]: pgmap v885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:35 smithi196 ceph-mon[32572]: pgmap v886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:35 smithi110 ceph-mon[28069]: pgmap v886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:35 smithi193 ceph-mon[32782]: pgmap v886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 571.752896 secs 2024-04-26T11:57:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 571.752896 secs 2024-04-26T11:57:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 571.752896 secs 2024-04-26T11:57:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:37 smithi110 ceph-mon[28069]: pgmap v887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:37 smithi193 ceph-mon[32782]: pgmap v887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:37 smithi196 ceph-mon[32572]: pgmap v887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:38 smithi110 ceph-mon[28069]: pgmap v888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:38 smithi193 ceph-mon[32782]: pgmap v888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:38 smithi196 ceph-mon[32572]: pgmap v888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:41 smithi196 ceph-mon[32572]: pgmap v889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 576.753053 secs 2024-04-26T11:57:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:41 smithi110 ceph-mon[28069]: pgmap v889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 576.753053 secs 2024-04-26T11:57:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:41 smithi193 ceph-mon[32782]: pgmap v889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 576.753053 secs 2024-04-26T11:57:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:43 smithi196 ceph-mon[32572]: pgmap v890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:43 smithi110 ceph-mon[28069]: pgmap v890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:43 smithi193 ceph-mon[32782]: pgmap v890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:45 smithi196 ceph-mon[32572]: pgmap v891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:45 smithi110 ceph-mon[28069]: pgmap v891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:45 smithi193 ceph-mon[32782]: pgmap v891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 581.753118 secs 2024-04-26T11:57:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:46 smithi110 ceph-mon[28069]: pgmap v892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 581.753118 secs 2024-04-26T11:57:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:46 smithi193 ceph-mon[32782]: pgmap v892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 581.753118 secs 2024-04-26T11:57:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:46 smithi196 ceph-mon[32572]: pgmap v892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:49 smithi196 ceph-mon[32572]: pgmap v893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:49 smithi110 ceph-mon[28069]: pgmap v893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:49 smithi193 ceph-mon[32782]: pgmap v893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:51 smithi196 ceph-mon[32572]: pgmap v894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 586.753243 secs 2024-04-26T11:57:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:51 smithi110 ceph-mon[28069]: pgmap v894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 586.753243 secs 2024-04-26T11:57:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:51 smithi193 ceph-mon[32782]: pgmap v894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 586.753243 secs 2024-04-26T11:57:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:52 smithi193 ceph-mon[32782]: pgmap v895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:52 smithi196 ceph-mon[32572]: pgmap v895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:52 smithi110 ceph-mon[28069]: pgmap v895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:55.995 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:55 smithi110 ceph-mon[28069]: pgmap v896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:55 smithi196 ceph-mon[32572]: pgmap v896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:55 smithi193 ceph-mon[32782]: pgmap v896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 591.753363 secs 2024-04-26T11:57:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 591.753363 secs 2024-04-26T11:57:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 591.753363 secs 2024-04-26T11:57:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:57 smithi110 ceph-mon[28069]: pgmap v897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:57 smithi193 ceph-mon[32782]: pgmap v897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:57 smithi196 ceph-mon[32572]: pgmap v897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:57:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:57:58 smithi110 ceph-mon[28069]: pgmap v898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:57:58 smithi193 ceph-mon[32782]: pgmap v898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:57:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:57:58 smithi196 ceph-mon[32572]: pgmap v898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:01 smithi196 ceph-mon[32572]: pgmap v899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 596.753484 secs 2024-04-26T11:58:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:01 smithi110 ceph-mon[28069]: pgmap v899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 596.753484 secs 2024-04-26T11:58:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:01 smithi193 ceph-mon[32782]: pgmap v899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 596.753484 secs 2024-04-26T11:58:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:03 smithi196 ceph-mon[32572]: pgmap v900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:04.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:03 smithi110 ceph-mon[28069]: pgmap v900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:03 smithi193 ceph-mon[32782]: pgmap v900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:04 smithi110 ceph-mon[28069]: pgmap v901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:04 smithi193 ceph-mon[32782]: pgmap v901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:04 smithi196 ceph-mon[32572]: pgmap v901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 601.753635 secs 2024-04-26T11:58:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 601.753635 secs 2024-04-26T11:58:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 601.753635 secs 2024-04-26T11:58:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:07 smithi193 ceph-mon[32782]: pgmap v902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:07 smithi196 ceph-mon[32572]: pgmap v902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:07 smithi110 ceph-mon[28069]: pgmap v902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:09 smithi196 ceph-mon[32572]: pgmap v903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:09 smithi110 ceph-mon[28069]: pgmap v903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:09 smithi193 ceph-mon[32782]: pgmap v903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:10 smithi193 ceph-mon[32782]: pgmap v904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:10 smithi196 ceph-mon[32572]: pgmap v904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:10 smithi110 ceph-mon[28069]: pgmap v904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:58:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 606.753707 secs 2024-04-26T11:58:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:58:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 606.753707 secs 2024-04-26T11:58:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:58:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 606.753707 secs 2024-04-26T11:58:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:58:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:58:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:12 smithi193 ceph-mon[32782]: pgmap v905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T11:58:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:12 smithi193 ceph-mon[32782]: pgmap v906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:58:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:58:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:58:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:12 smithi196 ceph-mon[32572]: pgmap v905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T11:58:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:12 smithi196 ceph-mon[32572]: pgmap v906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:58:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:58:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:58:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:12 smithi110 ceph-mon[28069]: pgmap v905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T11:58:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:12 smithi110 ceph-mon[28069]: pgmap v906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:58:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:15 smithi193 ceph-mon[32782]: pgmap v907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:15 smithi196 ceph-mon[32572]: pgmap v907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:15 smithi110 ceph-mon[28069]: pgmap v907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 611.753843 secs 2024-04-26T11:58:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 611.753843 secs 2024-04-26T11:58:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 611.753843 secs 2024-04-26T11:58:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:17 smithi193 ceph-mon[32782]: pgmap v908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:17 smithi196 ceph-mon[32572]: pgmap v908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:17 smithi110 ceph-mon[28069]: pgmap v908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:19 smithi193 ceph-mon[32782]: pgmap v909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T11:58:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:19 smithi196 ceph-mon[32572]: pgmap v909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T11:58:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:19 smithi110 ceph-mon[28069]: pgmap v909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T11:58:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:21 smithi193 ceph-mon[32782]: pgmap v910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 616.754000 secs 2024-04-26T11:58:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:21 smithi196 ceph-mon[32572]: pgmap v910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:21.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 616.754000 secs 2024-04-26T11:58:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:21 smithi110 ceph-mon[28069]: pgmap v910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T11:58:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 616.754000 secs 2024-04-26T11:58:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:23 smithi196 ceph-mon[32572]: pgmap v911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:58:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:23 smithi110 ceph-mon[28069]: pgmap v911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:58:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:23 smithi193 ceph-mon[32782]: pgmap v911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:58:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:25 smithi196 ceph-mon[32572]: pgmap v912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:25 smithi110 ceph-mon[28069]: pgmap v912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:25 smithi193 ceph-mon[32782]: pgmap v912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 621.754074 secs 2024-04-26T11:58:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 621.754074 secs 2024-04-26T11:58:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 621.754074 secs 2024-04-26T11:58:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:27 smithi196 ceph-mon[32572]: pgmap v913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:27 smithi110 ceph-mon[28069]: pgmap v913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:27 smithi193 ceph-mon[32782]: pgmap v913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:29 smithi196 ceph-mon[32572]: pgmap v914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:29 smithi110 ceph-mon[28069]: pgmap v914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:29 smithi193 ceph-mon[32782]: pgmap v914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:31 smithi196 ceph-mon[32572]: pgmap v915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:58:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 626.754198 secs 2024-04-26T11:58:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:31 smithi110 ceph-mon[28069]: pgmap v915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:58:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 626.754198 secs 2024-04-26T11:58:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:31 smithi193 ceph-mon[32782]: pgmap v915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:58:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 626.754198 secs 2024-04-26T11:58:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:33 smithi196 ceph-mon[32572]: pgmap v916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:33 smithi110 ceph-mon[28069]: pgmap v916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:33 smithi193 ceph-mon[32782]: pgmap v916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:35 smithi196 ceph-mon[32572]: pgmap v917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:35 smithi110 ceph-mon[28069]: pgmap v917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:35 smithi193 ceph-mon[32782]: pgmap v917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 631.754322 secs 2024-04-26T11:58:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 631.754322 secs 2024-04-26T11:58:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 631.754322 secs 2024-04-26T11:58:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:37 smithi196 ceph-mon[32572]: pgmap v918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:37 smithi110 ceph-mon[28069]: pgmap v918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:37 smithi193 ceph-mon[32782]: pgmap v918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:39 smithi196 ceph-mon[32572]: pgmap v919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:39 smithi110 ceph-mon[28069]: pgmap v919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:39 smithi193 ceph-mon[32782]: pgmap v919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:41 smithi196 ceph-mon[32572]: pgmap v920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:58:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 636.754442 secs 2024-04-26T11:58:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:41 smithi110 ceph-mon[28069]: pgmap v920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:58:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 636.754442 secs 2024-04-26T11:58:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:41 smithi193 ceph-mon[32782]: pgmap v920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:58:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 636.754442 secs 2024-04-26T11:58:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:43 smithi196 ceph-mon[32572]: pgmap v921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:43 smithi110 ceph-mon[28069]: pgmap v921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:43 smithi193 ceph-mon[32782]: pgmap v921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:45 smithi196 ceph-mon[32572]: pgmap v922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:45 smithi110 ceph-mon[28069]: pgmap v922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:45 smithi193 ceph-mon[32782]: pgmap v922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 641.754540 secs 2024-04-26T11:58:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 641.754540 secs 2024-04-26T11:58:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 641.754540 secs 2024-04-26T11:58:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:47 smithi196 ceph-mon[32572]: pgmap v923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:47.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:47 smithi110 ceph-mon[28069]: pgmap v923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:47 smithi193 ceph-mon[32782]: pgmap v923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:49 smithi196 ceph-mon[32572]: pgmap v924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:49 smithi110 ceph-mon[28069]: pgmap v924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:49 smithi193 ceph-mon[32782]: pgmap v924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:51 smithi196 ceph-mon[32572]: pgmap v925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:58:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 646.754635 secs 2024-04-26T11:58:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:51 smithi110 ceph-mon[28069]: pgmap v925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:58:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 646.754635 secs 2024-04-26T11:58:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:51 smithi193 ceph-mon[32782]: pgmap v925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:58:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 646.754635 secs 2024-04-26T11:58:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:53 smithi196 ceph-mon[32572]: pgmap v926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:53 smithi110 ceph-mon[28069]: pgmap v926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:53 smithi193 ceph-mon[32782]: pgmap v926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:55 smithi196 ceph-mon[32572]: pgmap v927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:55 smithi110 ceph-mon[28069]: pgmap v927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:55 smithi193 ceph-mon[32782]: pgmap v927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 651.754768 secs 2024-04-26T11:58:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 651.754768 secs 2024-04-26T11:58:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 651.754768 secs 2024-04-26T11:58:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:57 smithi196 ceph-mon[32572]: pgmap v928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:57 smithi110 ceph-mon[28069]: pgmap v928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:57 smithi193 ceph-mon[32782]: pgmap v928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:58:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:58:59 smithi196 ceph-mon[32572]: pgmap v929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:58:59 smithi110 ceph-mon[28069]: pgmap v929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:58:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:58:59 smithi193 ceph-mon[32782]: pgmap v929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:01.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:59:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:59:00.627+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:59:01.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:59:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:59:00.627+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:59:01.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:59:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:59:00.627+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:59:01.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:59:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:59:00.627+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:59:01.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 11:59:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T11:59:00.627+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T11:59:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:01 smithi196 ceph-mon[32572]: pgmap v930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 656.754880 secs 2024-04-26T11:59:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:01 smithi110 ceph-mon[28069]: pgmap v930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 656.754880 secs 2024-04-26T11:59:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:01 smithi193 ceph-mon[32782]: pgmap v930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 656.754880 secs 2024-04-26T11:59:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:03 smithi196 ceph-mon[32572]: pgmap v931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:03 smithi110 ceph-mon[28069]: pgmap v931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:03 smithi193 ceph-mon[32782]: pgmap v931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:05 smithi110 ceph-mon[28069]: pgmap v932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T11:59:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:05 smithi193 ceph-mon[32782]: pgmap v932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T11:59:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:05 smithi196 ceph-mon[32572]: pgmap v932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T11:59:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 661.754992 secs 2024-04-26T11:59:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 661.754992 secs 2024-04-26T11:59:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 661.754992 secs 2024-04-26T11:59:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:07 smithi110 ceph-mon[28069]: pgmap v933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T11:59:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:07 smithi193 ceph-mon[32782]: pgmap v933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T11:59:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:07 smithi196 ceph-mon[32572]: pgmap v933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T11:59:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:09 smithi110 ceph-mon[28069]: pgmap v934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T11:59:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:09 smithi193 ceph-mon[32782]: pgmap v934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T11:59:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:09 smithi196 ceph-mon[32572]: pgmap v934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T11:59:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:11 smithi110 ceph-mon[28069]: pgmap v935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T11:59:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 666.755108 secs 2024-04-26T11:59:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:11 smithi193 ceph-mon[32782]: pgmap v935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T11:59:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 666.755108 secs 2024-04-26T11:59:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:11 smithi196 ceph-mon[32572]: pgmap v935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T11:59:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 666.755108 secs 2024-04-26T11:59:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:13 smithi110 ceph-mon[28069]: pgmap v936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T11:59:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:59:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:13 smithi193 ceph-mon[32782]: pgmap v936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T11:59:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:59:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:13 smithi196 ceph-mon[32572]: pgmap v936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T11:59:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T11:59:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:59:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:59:14.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:59:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:59:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:59:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:59:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T11:59:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T11:59:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T11:59:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:15 smithi193 ceph-mon[32782]: pgmap v937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 178 B/s wr, 2 op/s 2024-04-26T11:59:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:15 smithi193 ceph-mon[32782]: pgmap v938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:15 smithi196 ceph-mon[32572]: pgmap v937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 178 B/s wr, 2 op/s 2024-04-26T11:59:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:15 smithi196 ceph-mon[32572]: pgmap v938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:15 smithi110 ceph-mon[28069]: pgmap v937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 178 B/s wr, 2 op/s 2024-04-26T11:59:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:15 smithi110 ceph-mon[28069]: pgmap v938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 671.755221 secs 2024-04-26T11:59:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 671.755221 secs 2024-04-26T11:59:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 671.755221 secs 2024-04-26T11:59:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:17 smithi193 ceph-mon[32782]: pgmap v939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:17 smithi196 ceph-mon[32572]: pgmap v939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:17 smithi110 ceph-mon[28069]: pgmap v939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:19 smithi193 ceph-mon[32782]: pgmap v940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:19 smithi196 ceph-mon[32572]: pgmap v940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:19 smithi110 ceph-mon[28069]: pgmap v940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:21 smithi193 ceph-mon[32782]: pgmap v941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 676.755357 secs 2024-04-26T11:59:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:21 smithi196 ceph-mon[32572]: pgmap v941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 676.755357 secs 2024-04-26T11:59:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:21 smithi110 ceph-mon[28069]: pgmap v941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 676.755357 secs 2024-04-26T11:59:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:23 smithi193 ceph-mon[32782]: pgmap v942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:23 smithi196 ceph-mon[32572]: pgmap v942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:23 smithi110 ceph-mon[28069]: pgmap v942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T11:59:25.845 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:25 smithi110 ceph-mon[28069]: pgmap v943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:59:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:25 smithi193 ceph-mon[32782]: pgmap v943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:59:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:25 smithi196 ceph-mon[32572]: pgmap v943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T11:59:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 681.755473 secs 2024-04-26T11:59:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 681.755473 secs 2024-04-26T11:59:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 681.755473 secs 2024-04-26T11:59:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:27 smithi193 ceph-mon[32782]: pgmap v944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:27 smithi196 ceph-mon[32572]: pgmap v944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:27 smithi110 ceph-mon[28069]: pgmap v944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:29 smithi193 ceph-mon[32782]: pgmap v945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:29 smithi196 ceph-mon[32572]: pgmap v945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:29 smithi110 ceph-mon[28069]: pgmap v945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:31 smithi193 ceph-mon[32782]: pgmap v946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 686.755591 secs 2024-04-26T11:59:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:31 smithi196 ceph-mon[32572]: pgmap v946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 686.755591 secs 2024-04-26T11:59:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:31 smithi110 ceph-mon[28069]: pgmap v946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 686.755591 secs 2024-04-26T11:59:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:33 smithi193 ceph-mon[32782]: pgmap v947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:33 smithi196 ceph-mon[32572]: pgmap v947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:33 smithi110 ceph-mon[28069]: pgmap v947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:35 smithi193 ceph-mon[32782]: pgmap v948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:35 smithi196 ceph-mon[32572]: pgmap v948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:35 smithi110 ceph-mon[28069]: pgmap v948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 691.755702 secs 2024-04-26T11:59:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 691.755702 secs 2024-04-26T11:59:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 691.755702 secs 2024-04-26T11:59:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:37 smithi196 ceph-mon[32572]: pgmap v949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:37 smithi110 ceph-mon[28069]: pgmap v949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:37 smithi193 ceph-mon[32782]: pgmap v949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:39 smithi196 ceph-mon[32572]: pgmap v950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:39 smithi110 ceph-mon[28069]: pgmap v950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:39 smithi193 ceph-mon[32782]: pgmap v950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:41 smithi196 ceph-mon[32572]: pgmap v951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 696.755850 secs 2024-04-26T11:59:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:41 smithi110 ceph-mon[28069]: pgmap v951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 696.755850 secs 2024-04-26T11:59:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:41 smithi193 ceph-mon[32782]: pgmap v951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 696.755850 secs 2024-04-26T11:59:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:43 smithi196 ceph-mon[32572]: pgmap v952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:43 smithi110 ceph-mon[28069]: pgmap v952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:43 smithi193 ceph-mon[32782]: pgmap v952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:45.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:45 smithi193 ceph-mon[32782]: pgmap v953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:45 smithi196 ceph-mon[32572]: pgmap v953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:45 smithi110 ceph-mon[28069]: pgmap v953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 701.755963 secs 2024-04-26T11:59:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 701.755963 secs 2024-04-26T11:59:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 701.755963 secs 2024-04-26T11:59:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:47 smithi196 ceph-mon[32572]: pgmap v954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:47 smithi110 ceph-mon[28069]: pgmap v954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:47 smithi193 ceph-mon[32782]: pgmap v954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:49 smithi196 ceph-mon[32572]: pgmap v955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:49 smithi110 ceph-mon[28069]: pgmap v955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:49 smithi193 ceph-mon[32782]: pgmap v955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:51 smithi196 ceph-mon[32572]: pgmap v956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 706.756093 secs 2024-04-26T11:59:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:51 smithi110 ceph-mon[28069]: pgmap v956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 706.756093 secs 2024-04-26T11:59:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:51 smithi193 ceph-mon[32782]: pgmap v956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T11:59:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 706.756093 secs 2024-04-26T11:59:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:53 smithi196 ceph-mon[32572]: pgmap v957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:53 smithi110 ceph-mon[28069]: pgmap v957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:53 smithi193 ceph-mon[32782]: pgmap v957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:55 smithi196 ceph-mon[32572]: pgmap v958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:56.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:55 smithi110 ceph-mon[28069]: pgmap v958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:55 smithi193 ceph-mon[32782]: pgmap v958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T11:59:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 711.756220 secs 2024-04-26T11:59:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 711.756220 secs 2024-04-26T11:59:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 711.756220 secs 2024-04-26T11:59:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:57 smithi196 ceph-mon[32572]: pgmap v959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:57 smithi110 ceph-mon[28069]: pgmap v959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T11:59:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:57 smithi193 ceph-mon[32782]: pgmap v959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 11:59:59 smithi196 ceph-mon[32572]: pgmap v960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 11:59:59 smithi110 ceph-mon[28069]: pgmap v960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 11:59:59 smithi193 ceph-mon[32782]: pgmap v960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: Health detail: HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: [WRN] CEPHADM_FAILED_DAEMON: 9 failed cephadm daemon(s) 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: daemon mds.j on smithi110 is in error state 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: daemon mds.d on smithi110 is in error state 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: daemon mds.a on smithi110 is in error state 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: daemon mds.k on smithi193 is in error state 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: daemon mds.e on smithi193 is in error state 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: daemon mds.l on smithi196 is in error state 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: daemon mds.f on smithi196 is in error state 2024-04-26T12:00:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: daemon mds.c on smithi196 is in error state 2024-04-26T12:00:01.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: daemon mds.i on smithi196 is in error state 2024-04-26T12:00:01.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T12:00:01.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: fs cephfs is degraded 2024-04-26T12:00:01.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2024-04-26T12:00:01.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: fs cephfs has 1 failed mds 2024-04-26T12:00:01.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-26T12:00:01.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:00 smithi196 ceph-mon[32572]: mds.b(mds.0): 4 slow requests are blocked > 180 secs 2024-04-26T12:00:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: Health detail: HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:00:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: [WRN] CEPHADM_FAILED_DAEMON: 9 failed cephadm daemon(s) 2024-04-26T12:00:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: daemon mds.j on smithi110 is in error state 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: daemon mds.d on smithi110 is in error state 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: daemon mds.a on smithi110 is in error state 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: daemon mds.k on smithi193 is in error state 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: daemon mds.e on smithi193 is in error state 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: daemon mds.l on smithi196 is in error state 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: daemon mds.f on smithi196 is in error state 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: daemon mds.c on smithi196 is in error state 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: daemon mds.i on smithi196 is in error state 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: fs cephfs is degraded 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: fs cephfs has 1 failed mds 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-26T12:00:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:00 smithi110 ceph-mon[28069]: mds.b(mds.0): 4 slow requests are blocked > 180 secs 2024-04-26T12:00:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: Health detail: HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:00:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: [WRN] CEPHADM_FAILED_DAEMON: 9 failed cephadm daemon(s) 2024-04-26T12:00:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: daemon mds.j on smithi110 is in error state 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: daemon mds.d on smithi110 is in error state 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: daemon mds.a on smithi110 is in error state 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: daemon mds.k on smithi193 is in error state 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: daemon mds.e on smithi193 is in error state 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: daemon mds.l on smithi196 is in error state 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: daemon mds.f on smithi196 is in error state 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: daemon mds.c on smithi196 is in error state 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: daemon mds.i on smithi196 is in error state 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: fs cephfs is degraded 2024-04-26T12:00:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2024-04-26T12:00:01.124 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: fs cephfs has 1 failed mds 2024-04-26T12:00:01.124 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-26T12:00:01.124 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:00 smithi193 ceph-mon[32782]: mds.b(mds.0): 4 slow requests are blocked > 180 secs 2024-04-26T12:00:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:01 smithi196 ceph-mon[32572]: pgmap v961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:01 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 716.756342 secs 2024-04-26T12:00:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:01 smithi196 ceph-mon[32572]: slow request 360.514290 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:00:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:01 smithi110 ceph-mon[28069]: pgmap v961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:01 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 716.756342 secs 2024-04-26T12:00:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:01 smithi110 ceph-mon[28069]: slow request 360.514290 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:00:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:01 smithi193 ceph-mon[32782]: pgmap v961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:01 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 716.756342 secs 2024-04-26T12:00:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:01 smithi193 ceph-mon[32782]: slow request 360.514290 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:00:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:03 smithi196 ceph-mon[32572]: pgmap v962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:03 smithi110 ceph-mon[28069]: pgmap v962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:03 smithi193 ceph-mon[32782]: pgmap v962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:05 smithi196 ceph-mon[32572]: pgmap v963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:05 smithi110 ceph-mon[28069]: pgmap v963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:05 smithi193 ceph-mon[32782]: pgmap v963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:06 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 721.756454 secs 2024-04-26T12:00:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:06 smithi196 ceph-mon[32572]: slow request 721.756453 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T12:00:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:06 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 721.756454 secs 2024-04-26T12:00:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:06 smithi110 ceph-mon[28069]: slow request 721.756453 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T12:00:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:06 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 721.756454 secs 2024-04-26T12:00:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:06 smithi193 ceph-mon[32782]: slow request 721.756453 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T12:00:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:07 smithi196 ceph-mon[32572]: pgmap v964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:07 smithi110 ceph-mon[28069]: pgmap v964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:07 smithi193 ceph-mon[32782]: pgmap v964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:09 smithi196 ceph-mon[32572]: pgmap v965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:09 smithi110 ceph-mon[28069]: pgmap v965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:09 smithi193 ceph-mon[32782]: pgmap v965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:11 smithi196 ceph-mon[32572]: pgmap v966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 726.756593 secs 2024-04-26T12:00:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:11 smithi110 ceph-mon[28069]: pgmap v966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 726.756593 secs 2024-04-26T12:00:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:11 smithi193 ceph-mon[32782]: pgmap v966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 726.756593 secs 2024-04-26T12:00:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:13 smithi196 ceph-mon[32572]: pgmap v967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:13 smithi110 ceph-mon[28069]: pgmap v967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:13 smithi193 ceph-mon[32782]: pgmap v967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:15.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:00:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:00:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:00:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:15 smithi110 ceph-mon[28069]: pgmap v968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:00:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:00:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:15 smithi193 ceph-mon[32782]: pgmap v968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:00:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:00:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:15 smithi196 ceph-mon[32572]: pgmap v968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:00:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:00:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:00:16.457+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec005d90 con 0x7f261c104b50 2024-04-26T12:00:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:00:16.457+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec005d90 con 0x7f261c104b50 2024-04-26T12:00:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:00:16.478+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8005fe0 con 0x55db1be4fdd0 2024-04-26T12:00:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:00:16.479+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8005fe0 con 0x55db1be4fdd0 2024-04-26T12:00:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 731.756721 secs 2024-04-26T12:00:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:00:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:00:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:00:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 731.756721 secs 2024-04-26T12:00:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:00:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:00:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:00:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 731.756721 secs 2024-04-26T12:00:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:00:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:00:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:00:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:17 smithi110 ceph-mon[28069]: pgmap v969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:17 smithi110 ceph-mon[28069]: pgmap v970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s rd, 1 op/s 2024-04-26T12:00:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:17 smithi110 ceph-mon[28069]: pgmap v971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:00:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:17 smithi193 ceph-mon[32782]: pgmap v969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:17 smithi193 ceph-mon[32782]: pgmap v970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s rd, 1 op/s 2024-04-26T12:00:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:17 smithi193 ceph-mon[32782]: pgmap v971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:00:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:17 smithi196 ceph-mon[32572]: pgmap v969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:17 smithi196 ceph-mon[32572]: pgmap v970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s rd, 1 op/s 2024-04-26T12:00:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:17 smithi196 ceph-mon[32572]: pgmap v971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:00:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:19 smithi110 ceph-mon[28069]: pgmap v972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T12:00:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:19 smithi193 ceph-mon[32782]: pgmap v972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T12:00:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:19 smithi196 ceph-mon[32572]: pgmap v972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T12:00:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:20 smithi110 ceph-mon[28069]: pgmap v973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:20 smithi193 ceph-mon[32782]: pgmap v973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:20 smithi196 ceph-mon[32572]: pgmap v973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 736.756812 secs 2024-04-26T12:00:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 736.756812 secs 2024-04-26T12:00:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 736.756812 secs 2024-04-26T12:00:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:22 smithi196 ceph-mon[32572]: pgmap v974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:00:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:22 smithi193 ceph-mon[32782]: pgmap v974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:00:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:22 smithi110 ceph-mon[28069]: pgmap v974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:00:25.708 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:25 smithi196 ceph-mon[32572]: pgmap v975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:25.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:25 smithi110 ceph-mon[28069]: pgmap v975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:25 smithi193 ceph-mon[32782]: pgmap v975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 741.756941 secs 2024-04-26T12:00:26.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 741.756941 secs 2024-04-26T12:00:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 741.756941 secs 2024-04-26T12:00:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:27 smithi196 ceph-mon[32572]: pgmap v976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:00:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:27 smithi110 ceph-mon[28069]: pgmap v976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:00:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:27 smithi193 ceph-mon[32782]: pgmap v976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:00:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:29 smithi196 ceph-mon[32572]: pgmap v977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:29 smithi110 ceph-mon[28069]: pgmap v977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:29 smithi193 ceph-mon[32782]: pgmap v977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:31 smithi196 ceph-mon[32572]: pgmap v978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 746.757054 secs 2024-04-26T12:00:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:31 smithi110 ceph-mon[28069]: pgmap v978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 746.757054 secs 2024-04-26T12:00:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:31 smithi193 ceph-mon[32782]: pgmap v978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 746.757054 secs 2024-04-26T12:00:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:33 smithi196 ceph-mon[32572]: pgmap v979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:33 smithi110 ceph-mon[28069]: pgmap v979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:33 smithi193 ceph-mon[32782]: pgmap v979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:35 smithi196 ceph-mon[32572]: pgmap v980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:35 smithi110 ceph-mon[28069]: pgmap v980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:35.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:35 smithi193 ceph-mon[32782]: pgmap v980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 751.757137 secs 2024-04-26T12:00:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 751.757137 secs 2024-04-26T12:00:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 751.757137 secs 2024-04-26T12:00:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:37 smithi196 ceph-mon[32572]: pgmap v981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:37 smithi110 ceph-mon[28069]: pgmap v981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:37 smithi193 ceph-mon[32782]: pgmap v981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:39 smithi196 ceph-mon[32572]: pgmap v982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:39 smithi110 ceph-mon[28069]: pgmap v982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:39 smithi193 ceph-mon[32782]: pgmap v982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:41 smithi196 ceph-mon[32572]: pgmap v983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:41.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 756.757270 secs 2024-04-26T12:00:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:41 smithi110 ceph-mon[28069]: pgmap v983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 756.757270 secs 2024-04-26T12:00:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:41 smithi193 ceph-mon[32782]: pgmap v983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 756.757270 secs 2024-04-26T12:00:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:43 smithi196 ceph-mon[32572]: pgmap v984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:43 smithi110 ceph-mon[28069]: pgmap v984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:43 smithi193 ceph-mon[32782]: pgmap v984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:45 smithi196 ceph-mon[32572]: pgmap v985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:45 smithi110 ceph-mon[28069]: pgmap v985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:45 smithi193 ceph-mon[32782]: pgmap v985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 761.757406 secs 2024-04-26T12:00:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 761.757406 secs 2024-04-26T12:00:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 761.757406 secs 2024-04-26T12:00:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:47 smithi196 ceph-mon[32572]: pgmap v986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:47 smithi110 ceph-mon[28069]: pgmap v986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:47 smithi193 ceph-mon[32782]: pgmap v986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:49 smithi196 ceph-mon[32572]: pgmap v987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:49 smithi110 ceph-mon[28069]: pgmap v987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:49 smithi193 ceph-mon[32782]: pgmap v987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:51 smithi196 ceph-mon[32572]: pgmap v988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 766.757548 secs 2024-04-26T12:00:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:51 smithi110 ceph-mon[28069]: pgmap v988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 766.757548 secs 2024-04-26T12:00:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:51 smithi193 ceph-mon[32782]: pgmap v988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:00:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 766.757548 secs 2024-04-26T12:00:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:53 smithi196 ceph-mon[32572]: pgmap v989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:53 smithi110 ceph-mon[28069]: pgmap v989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:53 smithi193 ceph-mon[32782]: pgmap v989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:55 smithi196 ceph-mon[32572]: pgmap v990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:55 smithi110 ceph-mon[28069]: pgmap v990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:55 smithi193 ceph-mon[32782]: pgmap v990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 771.757689 secs 2024-04-26T12:00:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 771.757689 secs 2024-04-26T12:00:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 771.757689 secs 2024-04-26T12:00:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:57 smithi110 ceph-mon[28069]: pgmap v991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:57 smithi193 ceph-mon[32782]: pgmap v991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:57 smithi196 ceph-mon[32572]: pgmap v991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:00:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:00:59 smithi110 ceph-mon[28069]: pgmap v992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:00:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:00:59 smithi193 ceph-mon[32782]: pgmap v992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:00:59 smithi196 ceph-mon[32572]: pgmap v992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:01 smithi110 ceph-mon[28069]: pgmap v993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:01:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 776.757775 secs 2024-04-26T12:01:01.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:01 smithi193 ceph-mon[32782]: pgmap v993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:01:01.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 776.757775 secs 2024-04-26T12:01:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:01 smithi196 ceph-mon[32572]: pgmap v993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:01:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 776.757775 secs 2024-04-26T12:01:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:03 smithi110 ceph-mon[28069]: pgmap v994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:03 smithi193 ceph-mon[32782]: pgmap v994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:03 smithi196 ceph-mon[32572]: pgmap v994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:05 smithi110 ceph-mon[28069]: pgmap v995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:05 smithi193 ceph-mon[32782]: pgmap v995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:05 smithi196 ceph-mon[32572]: pgmap v995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:06 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 781.757906 secs 2024-04-26T12:01:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:06 smithi193 ceph-mon[32782]: slow request 721.780368 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T12:01:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:06 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 781.757906 secs 2024-04-26T12:01:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:06 smithi196 ceph-mon[32572]: slow request 721.780368 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T12:01:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:06 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 781.757906 secs 2024-04-26T12:01:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:06 smithi110 ceph-mon[28069]: slow request 721.780368 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T12:01:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:07 smithi193 ceph-mon[32782]: pgmap v996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:07 smithi196 ceph-mon[32572]: pgmap v996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:07 smithi110 ceph-mon[28069]: pgmap v996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:09 smithi193 ceph-mon[32782]: pgmap v997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:09 smithi196 ceph-mon[32572]: pgmap v997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:09 smithi110 ceph-mon[28069]: pgmap v997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:11 smithi193 ceph-mon[32782]: pgmap v998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:01:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 786.758020 secs 2024-04-26T12:01:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:11 smithi196 ceph-mon[32572]: pgmap v998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:01:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 786.758020 secs 2024-04-26T12:01:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:11 smithi110 ceph-mon[28069]: pgmap v998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:01:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 786.758020 secs 2024-04-26T12:01:13.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:13 smithi193 ceph-mon[32782]: pgmap v999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:13 smithi196 ceph-mon[32572]: pgmap v999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:13 smithi110 ceph-mon[28069]: pgmap v999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:15 smithi193 ceph-mon[32782]: pgmap v1000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:15 smithi196 ceph-mon[32572]: pgmap v1000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:15 smithi110 ceph-mon[28069]: pgmap v1000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 791.758144 secs 2024-04-26T12:01:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 791.758144 secs 2024-04-26T12:01:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 791.758144 secs 2024-04-26T12:01:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:17 smithi193 ceph-mon[32782]: pgmap v1001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:01:17.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:17.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:17.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:17.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:17 smithi196 ceph-mon[32572]: pgmap v1001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:01:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:17 smithi110 ceph-mon[28069]: pgmap v1001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:01:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:01:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:01:18.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:01:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:01:19.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:01:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:01:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:01:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:19 smithi193 ceph-mon[32782]: pgmap v1002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:19 smithi193 ceph-mon[32782]: pgmap v1003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 2 op/s 2024-04-26T12:01:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:19 smithi196 ceph-mon[32572]: pgmap v1002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:19 smithi196 ceph-mon[32572]: pgmap v1003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 2 op/s 2024-04-26T12:01:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:19 smithi110 ceph-mon[28069]: pgmap v1002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:19 smithi110 ceph-mon[28069]: pgmap v1003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 2 op/s 2024-04-26T12:01:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:21 smithi193 ceph-mon[32782]: pgmap v1004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 1 op/s 2024-04-26T12:01:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 796.758236 secs 2024-04-26T12:01:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:21 smithi196 ceph-mon[32572]: pgmap v1004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 1 op/s 2024-04-26T12:01:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 796.758236 secs 2024-04-26T12:01:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:21 smithi110 ceph-mon[28069]: pgmap v1004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 1 op/s 2024-04-26T12:01:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 796.758236 secs 2024-04-26T12:01:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:23 smithi193 ceph-mon[32782]: pgmap v1005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T12:01:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:23 smithi196 ceph-mon[32572]: pgmap v1005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T12:01:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:23 smithi110 ceph-mon[28069]: pgmap v1005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T12:01:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:25 smithi193 ceph-mon[32782]: pgmap v1006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 1 op/s 2024-04-26T12:01:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:25 smithi196 ceph-mon[32572]: pgmap v1006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 1 op/s 2024-04-26T12:01:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:25 smithi110 ceph-mon[28069]: pgmap v1006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 1 op/s 2024-04-26T12:01:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 801.758366 secs 2024-04-26T12:01:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 801.758366 secs 2024-04-26T12:01:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 801.758366 secs 2024-04-26T12:01:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:27 smithi193 ceph-mon[32782]: pgmap v1007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 1 op/s 2024-04-26T12:01:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:27 smithi196 ceph-mon[32572]: pgmap v1007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 1 op/s 2024-04-26T12:01:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:27 smithi110 ceph-mon[28069]: pgmap v1007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 936 B/s rd, 1 op/s 2024-04-26T12:01:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:29 smithi196 ceph-mon[32572]: pgmap v1008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:01:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:29 smithi110 ceph-mon[28069]: pgmap v1008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:01:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:29 smithi193 ceph-mon[32782]: pgmap v1008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:01:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:31 smithi196 ceph-mon[32572]: pgmap v1009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 806.758488 secs 2024-04-26T12:01:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:31 smithi110 ceph-mon[28069]: pgmap v1009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 806.758488 secs 2024-04-26T12:01:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:31 smithi193 ceph-mon[32782]: pgmap v1009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 806.758488 secs 2024-04-26T12:01:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:33 smithi196 ceph-mon[32572]: pgmap v1010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:33 smithi110 ceph-mon[28069]: pgmap v1010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:33 smithi193 ceph-mon[32782]: pgmap v1010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:35 smithi196 ceph-mon[32572]: pgmap v1011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:35 smithi110 ceph-mon[28069]: pgmap v1011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:35 smithi193 ceph-mon[32782]: pgmap v1011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 811.758601 secs 2024-04-26T12:01:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 811.758601 secs 2024-04-26T12:01:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 811.758601 secs 2024-04-26T12:01:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:37 smithi196 ceph-mon[32572]: pgmap v1012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:37 smithi110 ceph-mon[28069]: pgmap v1012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:37 smithi193 ceph-mon[32782]: pgmap v1012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:39 smithi196 ceph-mon[32572]: pgmap v1013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:39 smithi110 ceph-mon[28069]: pgmap v1013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:39 smithi193 ceph-mon[32782]: pgmap v1013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:41 smithi196 ceph-mon[32572]: pgmap v1014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 816.758722 secs 2024-04-26T12:01:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:41 smithi110 ceph-mon[28069]: pgmap v1014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 816.758722 secs 2024-04-26T12:01:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:41 smithi193 ceph-mon[32782]: pgmap v1014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 816.758722 secs 2024-04-26T12:01:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:43 smithi196 ceph-mon[32572]: pgmap v1015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:43 smithi110 ceph-mon[28069]: pgmap v1015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:43 smithi193 ceph-mon[32782]: pgmap v1015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:45 smithi196 ceph-mon[32572]: pgmap v1016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:45 smithi110 ceph-mon[28069]: pgmap v1016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:45 smithi193 ceph-mon[32782]: pgmap v1016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 821.758820 secs 2024-04-26T12:01:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 821.758820 secs 2024-04-26T12:01:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 821.758820 secs 2024-04-26T12:01:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:47 smithi196 ceph-mon[32572]: pgmap v1017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:47 smithi110 ceph-mon[28069]: pgmap v1017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:47 smithi193 ceph-mon[32782]: pgmap v1017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:49 smithi196 ceph-mon[32572]: pgmap v1018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:49 smithi110 ceph-mon[28069]: pgmap v1018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:49 smithi193 ceph-mon[32782]: pgmap v1018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:51 smithi196 ceph-mon[32572]: pgmap v1019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 826.758947 secs 2024-04-26T12:01:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:51 smithi110 ceph-mon[28069]: pgmap v1019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 826.758947 secs 2024-04-26T12:01:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:51 smithi193 ceph-mon[32782]: pgmap v1019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 826.758947 secs 2024-04-26T12:01:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:53 smithi196 ceph-mon[32572]: pgmap v1020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:53 smithi110 ceph-mon[28069]: pgmap v1020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:53 smithi193 ceph-mon[32782]: pgmap v1020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:01:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:55 smithi196 ceph-mon[32572]: pgmap v1021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:55 smithi110 ceph-mon[28069]: pgmap v1021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:55 smithi193 ceph-mon[32782]: pgmap v1021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 831.759096 secs 2024-04-26T12:01:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 831.759096 secs 2024-04-26T12:01:57.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 831.759096 secs 2024-04-26T12:01:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:57 smithi196 ceph-mon[32572]: pgmap v1022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:57 smithi110 ceph-mon[28069]: pgmap v1022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:01:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:57 smithi193 ceph-mon[32782]: pgmap v1022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:01:59 smithi196 ceph-mon[32572]: pgmap v1023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:01:59 smithi110 ceph-mon[28069]: pgmap v1023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:01:59 smithi193 ceph-mon[32782]: pgmap v1023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:01 smithi196 ceph-mon[32572]: pgmap v1024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 836.759161 secs 2024-04-26T12:02:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:01 smithi110 ceph-mon[28069]: pgmap v1024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 836.759161 secs 2024-04-26T12:02:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:01 smithi193 ceph-mon[32782]: pgmap v1024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 836.759161 secs 2024-04-26T12:02:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:03 smithi196 ceph-mon[32572]: pgmap v1025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:03 smithi110 ceph-mon[28069]: pgmap v1025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:03 smithi193 ceph-mon[32782]: pgmap v1025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:05 smithi196 ceph-mon[32572]: pgmap v1026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:05 smithi110 ceph-mon[28069]: pgmap v1026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:05 smithi193 ceph-mon[32782]: pgmap v1026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 841.759316 secs 2024-04-26T12:02:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 841.759316 secs 2024-04-26T12:02:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 841.759316 secs 2024-04-26T12:02:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:07 smithi110 ceph-mon[28069]: pgmap v1027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:07 smithi193 ceph-mon[32782]: pgmap v1027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:07 smithi196 ceph-mon[32572]: pgmap v1027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:09 smithi110 ceph-mon[28069]: pgmap v1028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:09 smithi193 ceph-mon[32782]: pgmap v1028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:09 smithi196 ceph-mon[32572]: pgmap v1028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:11 smithi110 ceph-mon[28069]: pgmap v1029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 846.759457 secs 2024-04-26T12:02:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:11 smithi193 ceph-mon[32782]: pgmap v1029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 846.759457 secs 2024-04-26T12:02:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:11 smithi196 ceph-mon[32572]: pgmap v1029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 846.759457 secs 2024-04-26T12:02:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:13 smithi110 ceph-mon[28069]: pgmap v1030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:13 smithi193 ceph-mon[32782]: pgmap v1030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:13 smithi196 ceph-mon[32572]: pgmap v1030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:15 smithi110 ceph-mon[28069]: pgmap v1031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:15 smithi193 ceph-mon[32782]: pgmap v1031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:15 smithi196 ceph-mon[32572]: pgmap v1031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 851.759606 secs 2024-04-26T12:02:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 851.759606 secs 2024-04-26T12:02:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 851.759606 secs 2024-04-26T12:02:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:17 smithi193 ceph-mon[32782]: pgmap v1032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:17 smithi196 ceph-mon[32572]: pgmap v1032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:17 smithi110 ceph-mon[28069]: pgmap v1032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:02:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:02:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:02:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:19 smithi110 ceph-mon[28069]: pgmap v1033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:19 smithi193 ceph-mon[32782]: pgmap v1033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:19 smithi196 ceph-mon[32572]: pgmap v1033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:21 smithi193 ceph-mon[32782]: pgmap v1034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 856.759671 secs 2024-04-26T12:02:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:21 smithi196 ceph-mon[32572]: pgmap v1034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 856.759671 secs 2024-04-26T12:02:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:21 smithi110 ceph-mon[28069]: pgmap v1034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 856.759671 secs 2024-04-26T12:02:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:02:23.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:02:23.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: pgmap v1035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:23.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:02:23.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:02:23.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: pgmap v1035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:23.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: pgmap v1035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:23.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:25.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: pgmap v1036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:25.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:25.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:25.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:02:25.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:02:25.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:02:25.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:02:25.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: pgmap v1037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 993 B/s rd, 1 op/s 2024-04-26T12:02:25.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: pgmap v1038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:25.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:25.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: pgmap v1036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:25.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:25.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:25.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: pgmap v1037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 993 B/s rd, 1 op/s 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: pgmap v1038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: pgmap v1036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:25.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:25.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:25.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:02:25.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:02:25.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:02:25.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:02:25.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:02:25.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: pgmap v1037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 993 B/s rd, 1 op/s 2024-04-26T12:02:25.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: pgmap v1038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:25.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:02:26.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 861.759803 secs 2024-04-26T12:02:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 861.759803 secs 2024-04-26T12:02:26.954 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 861.759803 secs 2024-04-26T12:02:27.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:27 smithi110 ceph-mon[28069]: pgmap v1039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T12:02:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:27 smithi193 ceph-mon[32782]: pgmap v1039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T12:02:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:27 smithi196 ceph-mon[32572]: pgmap v1039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T12:02:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:29 smithi193 ceph-mon[32782]: pgmap v1040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:29 smithi196 ceph-mon[32572]: pgmap v1040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:29 smithi110 ceph-mon[28069]: pgmap v1040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:31 smithi193 ceph-mon[32782]: pgmap v1041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T12:02:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 866.759939 secs 2024-04-26T12:02:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:31 smithi196 ceph-mon[32572]: pgmap v1041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T12:02:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 866.759939 secs 2024-04-26T12:02:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:31 smithi110 ceph-mon[28069]: pgmap v1041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T12:02:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 866.759939 secs 2024-04-26T12:02:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:33 smithi193 ceph-mon[32782]: pgmap v1042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:33 smithi196 ceph-mon[32572]: pgmap v1042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:33 smithi110 ceph-mon[28069]: pgmap v1042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:35 smithi193 ceph-mon[32782]: pgmap v1043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:02:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:35 smithi196 ceph-mon[32572]: pgmap v1043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:02:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:35 smithi110 ceph-mon[28069]: pgmap v1043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:02:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 871.760071 secs 2024-04-26T12:02:36.868 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 871.760071 secs 2024-04-26T12:02:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 871.760071 secs 2024-04-26T12:02:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:37 smithi110 ceph-mon[28069]: pgmap v1044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:37 smithi196 ceph-mon[32572]: pgmap v1044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:37 smithi193 ceph-mon[32782]: pgmap v1044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:39 smithi196 ceph-mon[32572]: pgmap v1045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:39 smithi110 ceph-mon[28069]: pgmap v1045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:39 smithi193 ceph-mon[32782]: pgmap v1045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:41 smithi196 ceph-mon[32572]: pgmap v1046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 876.760201 secs 2024-04-26T12:02:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:41 smithi110 ceph-mon[28069]: pgmap v1046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 876.760201 secs 2024-04-26T12:02:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:41 smithi193 ceph-mon[32782]: pgmap v1046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 876.760201 secs 2024-04-26T12:02:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:43 smithi196 ceph-mon[32572]: pgmap v1047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:43 smithi110 ceph-mon[28069]: pgmap v1047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:43 smithi193 ceph-mon[32782]: pgmap v1047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:45.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:45 smithi193 ceph-mon[32782]: pgmap v1048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:45 smithi196 ceph-mon[32572]: pgmap v1048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:45 smithi110 ceph-mon[28069]: pgmap v1048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 881.760271 secs 2024-04-26T12:02:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 881.760271 secs 2024-04-26T12:02:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 881.760271 secs 2024-04-26T12:02:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:47 smithi196 ceph-mon[32572]: pgmap v1049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:48.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:47 smithi110 ceph-mon[28069]: pgmap v1049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:47 smithi193 ceph-mon[32782]: pgmap v1049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:49 smithi196 ceph-mon[32572]: pgmap v1050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:49 smithi110 ceph-mon[28069]: pgmap v1050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:49 smithi193 ceph-mon[32782]: pgmap v1050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:51 smithi196 ceph-mon[32572]: pgmap v1051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 886.760396 secs 2024-04-26T12:02:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:51 smithi110 ceph-mon[28069]: pgmap v1051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 886.760396 secs 2024-04-26T12:02:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:51 smithi193 ceph-mon[32782]: pgmap v1051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 886.760396 secs 2024-04-26T12:02:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:53 smithi196 ceph-mon[32572]: pgmap v1052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:53 smithi110 ceph-mon[28069]: pgmap v1052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:53 smithi193 ceph-mon[32782]: pgmap v1052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:02:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:55 smithi196 ceph-mon[32572]: pgmap v1053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:56.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:55 smithi110 ceph-mon[28069]: pgmap v1053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:55 smithi193 ceph-mon[32782]: pgmap v1053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 891.760517 secs 2024-04-26T12:02:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 891.760517 secs 2024-04-26T12:02:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 891.760517 secs 2024-04-26T12:02:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:57 smithi196 ceph-mon[32572]: pgmap v1054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:57 smithi110 ceph-mon[28069]: pgmap v1054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:02:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:57 smithi193 ceph-mon[32782]: pgmap v1054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:02:59 smithi196 ceph-mon[32572]: pgmap v1055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:02:59 smithi110 ceph-mon[28069]: pgmap v1055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:02:59 smithi193 ceph-mon[32782]: pgmap v1055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:01 smithi196 ceph-mon[32572]: pgmap v1056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 896.760636 secs 2024-04-26T12:03:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:01 smithi110 ceph-mon[28069]: pgmap v1056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 896.760636 secs 2024-04-26T12:03:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:01 smithi193 ceph-mon[32782]: pgmap v1056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 896.760636 secs 2024-04-26T12:03:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:03 smithi196 ceph-mon[32572]: pgmap v1057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:03 smithi110 ceph-mon[28069]: pgmap v1057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:03 smithi193 ceph-mon[32782]: pgmap v1057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:05 smithi196 ceph-mon[32572]: pgmap v1058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:05 smithi110 ceph-mon[28069]: pgmap v1058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:05 smithi193 ceph-mon[32782]: pgmap v1058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 901.760775 secs 2024-04-26T12:03:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 901.760775 secs 2024-04-26T12:03:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 901.760775 secs 2024-04-26T12:03:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:07 smithi196 ceph-mon[32572]: pgmap v1059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:07 smithi110 ceph-mon[28069]: pgmap v1059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:07 smithi193 ceph-mon[32782]: pgmap v1059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:09 smithi196 ceph-mon[32572]: pgmap v1060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:09 smithi110 ceph-mon[28069]: pgmap v1060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:09 smithi193 ceph-mon[32782]: pgmap v1060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:11 smithi196 ceph-mon[32572]: pgmap v1061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:11 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 906.760914 secs 2024-04-26T12:03:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:11 smithi196 ceph-mon[32572]: slow request 722.976053 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:03:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:11 smithi110 ceph-mon[28069]: pgmap v1061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:11 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 906.760914 secs 2024-04-26T12:03:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:11 smithi110 ceph-mon[28069]: slow request 722.976053 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:03:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:11 smithi193 ceph-mon[32782]: pgmap v1061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:11 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 906.760914 secs 2024-04-26T12:03:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:11 smithi193 ceph-mon[32782]: slow request 722.976053 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:03:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:13 smithi196 ceph-mon[32572]: pgmap v1062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:13 smithi110 ceph-mon[28069]: pgmap v1062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:13 smithi193 ceph-mon[32782]: pgmap v1062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:15 smithi196 ceph-mon[32572]: pgmap v1063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:15 smithi110 ceph-mon[28069]: pgmap v1063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:15 smithi193 ceph-mon[32782]: pgmap v1063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.348+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 msgr2=0x7f26000a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T12:03:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.348+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 msgr2=0x7f26000a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T12:03:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.348+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000a6280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2614009fd0 tx=0x7f2614009500 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:03:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.348+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000a6280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2614009fd0 tx=0x7f2614009500 comp rx=0 tx=0).stop 2024-04-26T12:03:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.348+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 msgr2=0x7f26000a6280 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T12:03:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.348+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 msgr2=0x7f26000a6280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T12:03:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.348+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000a6280 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:03:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.348+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 0x7f26000b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:03:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.349+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 0x7f26000b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:03:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.350+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 0x7f26000b2c30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f261401b000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:03:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.381+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T12:03:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.381+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T12:03:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.381+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:03:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.381+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T12:03:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.382+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=520 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:03:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.383+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=SESSION_RECONNECTING pgs=520 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2024-04-26T12:03:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.383+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=SESSION_RECONNECTING pgs=520 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2024-04-26T12:03:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.383+0000 7f2608c00640 0 client.16308 ms_handle_remote_reset on v2:172.21.15.193:6838/64494456 2024-04-26T12:03:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.383+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T12:03:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.383+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T12:03:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.486+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec005f60 con 0x7f261c104b50 2024-04-26T12:03:16.487 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.486+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec005f60 con 0x7f261c104b50 2024-04-26T12:03:16.506 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.505+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80061b0 con 0x55db1be4fdd0 2024-04-26T12:03:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:03:16.506+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e80061b0 con 0x55db1be4fdd0 2024-04-26T12:03:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 911.761035 secs 2024-04-26T12:03:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 911.761035 secs 2024-04-26T12:03:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 911.761035 secs 2024-04-26T12:03:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:17 smithi110 ceph-mon[28069]: pgmap v1064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:17 smithi193 ceph-mon[32782]: pgmap v1064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:17 smithi196 ceph-mon[32572]: pgmap v1064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:19 smithi110 ceph-mon[28069]: pgmap v1065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:19 smithi193 ceph-mon[32782]: pgmap v1065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:19 smithi196 ceph-mon[32572]: pgmap v1065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:21 smithi110 ceph-mon[28069]: pgmap v1066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 916.761112 secs 2024-04-26T12:03:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:21 smithi193 ceph-mon[32782]: pgmap v1066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 916.761112 secs 2024-04-26T12:03:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:21 smithi196 ceph-mon[32572]: pgmap v1066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 916.761112 secs 2024-04-26T12:03:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:23 smithi110 ceph-mon[28069]: pgmap v1067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:23 smithi193 ceph-mon[32782]: pgmap v1067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:23 smithi196 ceph-mon[32572]: pgmap v1067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:25 smithi110 ceph-mon[28069]: pgmap v1068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:03:26.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:25 smithi196 ceph-mon[32572]: pgmap v1068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:26.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:03:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:25 smithi193 ceph-mon[32782]: pgmap v1068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:03:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:03:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:03:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:03:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 921.761212 secs 2024-04-26T12:03:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:03:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:03:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:03:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 921.761212 secs 2024-04-26T12:03:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:03:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:03:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:03:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 921.761212 secs 2024-04-26T12:03:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:27 smithi193 ceph-mon[32782]: pgmap v1069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T12:03:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:27 smithi193 ceph-mon[32782]: pgmap v1070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:27 smithi196 ceph-mon[32572]: pgmap v1069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T12:03:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:27 smithi196 ceph-mon[32572]: pgmap v1070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:27 smithi110 ceph-mon[28069]: pgmap v1069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T12:03:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:27 smithi110 ceph-mon[28069]: pgmap v1070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:29 smithi193 ceph-mon[32782]: pgmap v1071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:30.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:29 smithi196 ceph-mon[32572]: pgmap v1071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:29 smithi110 ceph-mon[28069]: pgmap v1071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:31 smithi193 ceph-mon[32782]: pgmap v1072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 926.761278 secs 2024-04-26T12:03:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:31 smithi196 ceph-mon[32572]: pgmap v1072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 926.761278 secs 2024-04-26T12:03:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:31 smithi110 ceph-mon[28069]: pgmap v1072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 926.761278 secs 2024-04-26T12:03:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:33 smithi193 ceph-mon[32782]: pgmap v1073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T12:03:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:33 smithi196 ceph-mon[32572]: pgmap v1073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T12:03:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:33 smithi110 ceph-mon[28069]: pgmap v1073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T12:03:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:35 smithi193 ceph-mon[32782]: pgmap v1074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:35 smithi196 ceph-mon[32572]: pgmap v1074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:35 smithi110 ceph-mon[28069]: pgmap v1074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:03:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 931.761385 secs 2024-04-26T12:03:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 931.761385 secs 2024-04-26T12:03:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 931.761385 secs 2024-04-26T12:03:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:37 smithi193 ceph-mon[32782]: pgmap v1075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:03:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:37 smithi196 ceph-mon[32572]: pgmap v1075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:03:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:37 smithi110 ceph-mon[28069]: pgmap v1075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:03:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:38 smithi193 ceph-mon[32782]: pgmap v1076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:38 smithi196 ceph-mon[32572]: pgmap v1076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:38 smithi110 ceph-mon[28069]: pgmap v1076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:41 smithi193 ceph-mon[32782]: pgmap v1077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:41 smithi196 ceph-mon[32572]: pgmap v1077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:41 smithi110 ceph-mon[28069]: pgmap v1077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 936.761511 secs 2024-04-26T12:03:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 936.761511 secs 2024-04-26T12:03:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 936.761511 secs 2024-04-26T12:03:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:43 smithi196 ceph-mon[32572]: pgmap v1078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:43 smithi110 ceph-mon[28069]: pgmap v1078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:43 smithi193 ceph-mon[32782]: pgmap v1078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:45.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:45 smithi193 ceph-mon[32782]: pgmap v1079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:45 smithi196 ceph-mon[32572]: pgmap v1079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:45.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:45 smithi110 ceph-mon[28069]: pgmap v1079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:47 smithi196 ceph-mon[32572]: pgmap v1080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 941.761630 secs 2024-04-26T12:03:47.546 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:47 smithi110 ceph-mon[28069]: pgmap v1080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:47.546 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 941.761630 secs 2024-04-26T12:03:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:47 smithi193 ceph-mon[32782]: pgmap v1080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 941.761630 secs 2024-04-26T12:03:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:49 smithi196 ceph-mon[32572]: pgmap v1081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:49 smithi110 ceph-mon[28069]: pgmap v1081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:49 smithi193 ceph-mon[32782]: pgmap v1081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:51 smithi196 ceph-mon[32572]: pgmap v1082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:51 smithi110 ceph-mon[28069]: pgmap v1082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:51 smithi193 ceph-mon[32782]: pgmap v1082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 946.761695 secs 2024-04-26T12:03:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 946.761695 secs 2024-04-26T12:03:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 946.761695 secs 2024-04-26T12:03:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:53 smithi196 ceph-mon[32572]: pgmap v1083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:53.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:53 smithi110 ceph-mon[28069]: pgmap v1083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:53 smithi193 ceph-mon[32782]: pgmap v1083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:55 smithi196 ceph-mon[32572]: pgmap v1084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:55 smithi110 ceph-mon[28069]: pgmap v1084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:55 smithi193 ceph-mon[32782]: pgmap v1084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 951.761812 secs 2024-04-26T12:03:57.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:57 smithi196 ceph-mon[32572]: pgmap v1085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 951.761812 secs 2024-04-26T12:03:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:57 smithi110 ceph-mon[28069]: pgmap v1085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 951.761812 secs 2024-04-26T12:03:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:57 smithi193 ceph-mon[32782]: pgmap v1085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:03:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:03:59 smithi196 ceph-mon[32572]: pgmap v1086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:03:59 smithi110 ceph-mon[28069]: pgmap v1086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:03:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:03:59 smithi193 ceph-mon[32782]: pgmap v1086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:01.181 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:04:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:04:00.821+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:04:01.181 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:04:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:04:00.821+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:04:01.181 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:04:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:04:00.821+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:04:01.182 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:04:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:04:00.821+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:04:01.182 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:04:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:04:00.821+0000 7f1b53c00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:04:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:01 smithi196 ceph-mon[32572]: pgmap v1087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:01 smithi110 ceph-mon[28069]: pgmap v1087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:01 smithi193 ceph-mon[32782]: pgmap v1087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 956.761921 secs 2024-04-26T12:04:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 956.761921 secs 2024-04-26T12:04:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 956.761921 secs 2024-04-26T12:04:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:03 smithi196 ceph-mon[32572]: pgmap v1088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:03 smithi110 ceph-mon[28069]: pgmap v1088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:03 smithi193 ceph-mon[32782]: pgmap v1088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:05 smithi196 ceph-mon[32572]: pgmap v1089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:05 smithi110 ceph-mon[28069]: pgmap v1089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:05 smithi193 ceph-mon[32782]: pgmap v1089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 961.762048 secs 2024-04-26T12:04:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:07 smithi196 ceph-mon[32572]: pgmap v1090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 961.762048 secs 2024-04-26T12:04:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:07 smithi110 ceph-mon[28069]: pgmap v1090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 961.762048 secs 2024-04-26T12:04:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:07 smithi193 ceph-mon[32782]: pgmap v1090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:09 smithi196 ceph-mon[32572]: pgmap v1091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:09 smithi110 ceph-mon[28069]: pgmap v1091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:09 smithi193 ceph-mon[32782]: pgmap v1091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:11 smithi196 ceph-mon[32572]: pgmap v1092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:11 smithi110 ceph-mon[28069]: pgmap v1092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:11 smithi193 ceph-mon[32782]: pgmap v1092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 966.762167 secs 2024-04-26T12:04:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 966.762167 secs 2024-04-26T12:04:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 966.762167 secs 2024-04-26T12:04:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:13 smithi196 ceph-mon[32572]: pgmap v1093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:13 smithi110 ceph-mon[28069]: pgmap v1093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:13 smithi193 ceph-mon[32782]: pgmap v1093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:15 smithi196 ceph-mon[32572]: pgmap v1094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:15 smithi110 ceph-mon[28069]: pgmap v1094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:15 smithi193 ceph-mon[32782]: pgmap v1094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:04:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 971.762300 secs 2024-04-26T12:04:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:17 smithi196 ceph-mon[32572]: pgmap v1095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 971.762300 secs 2024-04-26T12:04:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:17 smithi110 ceph-mon[28069]: pgmap v1095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 971.762300 secs 2024-04-26T12:04:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:17 smithi193 ceph-mon[32782]: pgmap v1095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:19 smithi196 ceph-mon[32572]: pgmap v1096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:19 smithi110 ceph-mon[28069]: pgmap v1096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:19 smithi193 ceph-mon[32782]: pgmap v1096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:21 smithi196 ceph-mon[32572]: pgmap v1097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:21 smithi110 ceph-mon[28069]: pgmap v1097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:21 smithi193 ceph-mon[32782]: pgmap v1097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 976.762377 secs 2024-04-26T12:04:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 976.762377 secs 2024-04-26T12:04:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 976.762377 secs 2024-04-26T12:04:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:23 smithi110 ceph-mon[28069]: pgmap v1098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:23 smithi193 ceph-mon[32782]: pgmap v1098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:23 smithi196 ceph-mon[32572]: pgmap v1098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:25 smithi110 ceph-mon[28069]: pgmap v1099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:25 smithi193 ceph-mon[32782]: pgmap v1099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:25 smithi196 ceph-mon[32572]: pgmap v1099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 981.762516 secs 2024-04-26T12:04:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:27 smithi110 ceph-mon[28069]: pgmap v1100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:04:27.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 981.762516 secs 2024-04-26T12:04:27.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:27 smithi196 ceph-mon[32572]: pgmap v1100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:27.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:04:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 981.762516 secs 2024-04-26T12:04:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:27 smithi193 ceph-mon[32782]: pgmap v1100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:04:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:04:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:04:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:28 smithi110 ceph-mon[28069]: pgmap v1101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:04:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:28 smithi110 ceph-mon[28069]: pgmap v1102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:04:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:04:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:04:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:28 smithi193 ceph-mon[32782]: pgmap v1101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:04:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:28 smithi193 ceph-mon[32782]: pgmap v1102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:04:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:04:28.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:04:28.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:28 smithi196 ceph-mon[32572]: pgmap v1101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:04:28.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:28 smithi196 ceph-mon[32572]: pgmap v1102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:28.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:04:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:30 smithi196 ceph-mon[32572]: pgmap v1103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:30.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:30 smithi110 ceph-mon[28069]: pgmap v1103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:30 smithi193 ceph-mon[32782]: pgmap v1103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 986.762612 secs 2024-04-26T12:04:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 986.762612 secs 2024-04-26T12:04:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 986.762612 secs 2024-04-26T12:04:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:32 smithi196 ceph-mon[32572]: pgmap v1104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:32 smithi110 ceph-mon[28069]: pgmap v1104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:32 smithi193 ceph-mon[32782]: pgmap v1104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:34 smithi193 ceph-mon[32782]: pgmap v1105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:34 smithi196 ceph-mon[32572]: pgmap v1105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:34 smithi110 ceph-mon[28069]: pgmap v1105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:37.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:36 smithi196 ceph-mon[32572]: pgmap v1106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:37.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 991.762753 secs 2024-04-26T12:04:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:36 smithi110 ceph-mon[28069]: pgmap v1106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 991.762753 secs 2024-04-26T12:04:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:36 smithi193 ceph-mon[32782]: pgmap v1106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:04:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 991.762753 secs 2024-04-26T12:04:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:38 smithi196 ceph-mon[32572]: pgmap v1107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:04:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:38 smithi110 ceph-mon[28069]: pgmap v1107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:04:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:38 smithi193 ceph-mon[32782]: pgmap v1107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:04:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:40 smithi196 ceph-mon[32572]: pgmap v1108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:40 smithi110 ceph-mon[28069]: pgmap v1108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:41.126 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:40 smithi193 ceph-mon[32782]: pgmap v1108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 996.762891 secs 2024-04-26T12:04:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 996.762891 secs 2024-04-26T12:04:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 996.762891 secs 2024-04-26T12:04:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:42 smithi196 ceph-mon[32572]: pgmap v1109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:42 smithi110 ceph-mon[28069]: pgmap v1109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:42 smithi193 ceph-mon[32782]: pgmap v1109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:44 smithi196 ceph-mon[32572]: pgmap v1110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:45.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:44 smithi110 ceph-mon[28069]: pgmap v1110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:44 smithi193 ceph-mon[32782]: pgmap v1110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:04:46.500+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006180 con 0x7f261c104b50 2024-04-26T12:04:46.502 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:04:46.500+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006180 con 0x7f261c104b50 2024-04-26T12:04:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:04:46.519+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:04:46.520 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:04:46.519+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:04:46.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:46 smithi193 ceph-mon[32782]: pgmap v1111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:46.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1001.762996 secs 2024-04-26T12:04:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:46 smithi196 ceph-mon[32572]: pgmap v1111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1001.762996 secs 2024-04-26T12:04:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:46 smithi110 ceph-mon[28069]: pgmap v1111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1001.762996 secs 2024-04-26T12:04:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:48 smithi196 ceph-mon[32572]: pgmap v1112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:48 smithi110 ceph-mon[28069]: pgmap v1112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:48 smithi193 ceph-mon[32782]: pgmap v1112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:50 smithi196 ceph-mon[32572]: pgmap v1113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:50 smithi110 ceph-mon[28069]: pgmap v1113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:50 smithi193 ceph-mon[32782]: pgmap v1113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1006.763078 secs 2024-04-26T12:04:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1006.763078 secs 2024-04-26T12:04:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1006.763078 secs 2024-04-26T12:04:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:52 smithi196 ceph-mon[32572]: pgmap v1114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:53.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:52 smithi110 ceph-mon[28069]: pgmap v1114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:52 smithi193 ceph-mon[32782]: pgmap v1114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:55.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:54 smithi196 ceph-mon[32572]: pgmap v1115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:54 smithi110 ceph-mon[28069]: pgmap v1115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:54 smithi193 ceph-mon[32782]: pgmap v1115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:56 smithi196 ceph-mon[32572]: pgmap v1116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1011.763229 secs 2024-04-26T12:04:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:56 smithi110 ceph-mon[28069]: pgmap v1116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1011.763229 secs 2024-04-26T12:04:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:56 smithi193 ceph-mon[32782]: pgmap v1116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:04:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1011.763229 secs 2024-04-26T12:04:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:04:58 smithi196 ceph-mon[32572]: pgmap v1117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:04:58 smithi110 ceph-mon[28069]: pgmap v1117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:04:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:04:58 smithi193 ceph-mon[32782]: pgmap v1117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:00 smithi196 ceph-mon[32572]: pgmap v1118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:00 smithi110 ceph-mon[28069]: pgmap v1118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:00 smithi193 ceph-mon[32782]: pgmap v1118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1016.763366 secs 2024-04-26T12:05:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1016.763366 secs 2024-04-26T12:05:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1016.763366 secs 2024-04-26T12:05:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:02 smithi196 ceph-mon[32572]: pgmap v1119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:02 smithi110 ceph-mon[28069]: pgmap v1119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:02 smithi193 ceph-mon[32782]: pgmap v1119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:04 smithi196 ceph-mon[32572]: pgmap v1120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:05:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:04 smithi110 ceph-mon[28069]: pgmap v1120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:05:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:04 smithi193 ceph-mon[32782]: pgmap v1120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:05:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:06 smithi196 ceph-mon[32572]: pgmap v1121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:05:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1021.763503 secs 2024-04-26T12:05:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:06 smithi110 ceph-mon[28069]: pgmap v1121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:05:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1021.763503 secs 2024-04-26T12:05:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:06 smithi193 ceph-mon[32782]: pgmap v1121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:05:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1021.763503 secs 2024-04-26T12:05:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:08 smithi196 ceph-mon[32572]: pgmap v1122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:05:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:08 smithi110 ceph-mon[28069]: pgmap v1122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:05:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:08 smithi193 ceph-mon[32782]: pgmap v1122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:05:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:10 smithi196 ceph-mon[32572]: pgmap v1123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:05:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:10 smithi110 ceph-mon[28069]: pgmap v1123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:05:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:10 smithi193 ceph-mon[32782]: pgmap v1123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:05:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1026.763622 secs 2024-04-26T12:05:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1026.763622 secs 2024-04-26T12:05:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1026.763622 secs 2024-04-26T12:05:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:12 smithi196 ceph-mon[32572]: pgmap v1124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:05:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:12 smithi110 ceph-mon[28069]: pgmap v1124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:05:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:12 smithi193 ceph-mon[32782]: pgmap v1124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:05:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:14 smithi110 ceph-mon[28069]: pgmap v1125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:05:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:14 smithi193 ceph-mon[32782]: pgmap v1125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:05:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:14 smithi196 ceph-mon[32572]: pgmap v1125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:05:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:16 smithi110 ceph-mon[28069]: pgmap v1126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1031.763740 secs 2024-04-26T12:05:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:16 smithi193 ceph-mon[32782]: pgmap v1126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1031.763740 secs 2024-04-26T12:05:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:16 smithi196 ceph-mon[32572]: pgmap v1126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1031.763740 secs 2024-04-26T12:05:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:18 smithi110 ceph-mon[28069]: pgmap v1127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:18 smithi193 ceph-mon[32782]: pgmap v1127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:18 smithi196 ceph-mon[32572]: pgmap v1127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:20 smithi110 ceph-mon[28069]: pgmap v1128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:20 smithi193 ceph-mon[32782]: pgmap v1128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:20 smithi196 ceph-mon[32572]: pgmap v1128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1036.763862 secs 2024-04-26T12:05:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1036.763862 secs 2024-04-26T12:05:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1036.763862 secs 2024-04-26T12:05:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:22 smithi110 ceph-mon[28069]: pgmap v1129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:22 smithi193 ceph-mon[32782]: pgmap v1129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:22 smithi196 ceph-mon[32572]: pgmap v1129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:24 smithi193 ceph-mon[32782]: pgmap v1130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:24 smithi196 ceph-mon[32572]: pgmap v1130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:24 smithi110 ceph-mon[28069]: pgmap v1130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:27.095 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:26 smithi110 ceph-mon[28069]: pgmap v1131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:27.095 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1041.763973 secs 2024-04-26T12:05:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:26 smithi193 ceph-mon[32782]: pgmap v1131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1041.763973 secs 2024-04-26T12:05:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:26 smithi196 ceph-mon[32572]: pgmap v1131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1041.763973 secs 2024-04-26T12:05:29.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:28 smithi196 ceph-mon[32572]: pgmap v1132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:29.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:05:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:28 smithi193 ceph-mon[32782]: pgmap v1132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:05:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:28 smithi110 ceph-mon[28069]: pgmap v1132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:05:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:05:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:05:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:05:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:05:30.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:05:30.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:05:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:05:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:05:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:05:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:30 smithi193 ceph-mon[32782]: pgmap v1133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T12:05:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:30 smithi193 ceph-mon[32782]: pgmap v1134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:31.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:30 smithi196 ceph-mon[32572]: pgmap v1133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T12:05:31.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:30 smithi196 ceph-mon[32572]: pgmap v1134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:31.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:30 smithi110 ceph-mon[28069]: pgmap v1133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T12:05:31.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:30 smithi110 ceph-mon[28069]: pgmap v1134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1046.764100 secs 2024-04-26T12:05:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1046.764100 secs 2024-04-26T12:05:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1046.764100 secs 2024-04-26T12:05:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:32 smithi193 ceph-mon[32782]: pgmap v1135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:33.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:32 smithi196 ceph-mon[32572]: pgmap v1135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:32 smithi110 ceph-mon[28069]: pgmap v1135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:34 smithi193 ceph-mon[32782]: pgmap v1136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:34 smithi196 ceph-mon[32572]: pgmap v1136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:35.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:34 smithi110 ceph-mon[28069]: pgmap v1136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:36 smithi193 ceph-mon[32782]: pgmap v1137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1051.764217 secs 2024-04-26T12:05:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:36 smithi196 ceph-mon[32572]: pgmap v1137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:37.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1051.764217 secs 2024-04-26T12:05:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:36 smithi110 ceph-mon[28069]: pgmap v1137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:05:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1051.764217 secs 2024-04-26T12:05:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:38 smithi193 ceph-mon[32782]: pgmap v1138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T12:05:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:38 smithi196 ceph-mon[32572]: pgmap v1138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T12:05:39.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:38 smithi110 ceph-mon[28069]: pgmap v1138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T12:05:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:40 smithi193 ceph-mon[32782]: pgmap v1139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:05:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:40 smithi196 ceph-mon[32572]: pgmap v1139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:05:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:40 smithi110 ceph-mon[28069]: pgmap v1139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:05:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1056.764334 secs 2024-04-26T12:05:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:41 smithi193 ceph-mon[32782]: pgmap v1140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1056.764334 secs 2024-04-26T12:05:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:41 smithi196 ceph-mon[32572]: pgmap v1140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1056.764334 secs 2024-04-26T12:05:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:41 smithi110 ceph-mon[28069]: pgmap v1140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:44 smithi196 ceph-mon[32572]: pgmap v1141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:44.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:44 smithi110 ceph-mon[28069]: pgmap v1141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:44.625 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:44 smithi193 ceph-mon[32782]: pgmap v1141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:46 smithi110 ceph-mon[28069]: pgmap v1142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:46 smithi193 ceph-mon[32782]: pgmap v1142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:46 smithi196 ceph-mon[32572]: pgmap v1142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1061.764466 secs 2024-04-26T12:05:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1061.764466 secs 2024-04-26T12:05:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1061.764466 secs 2024-04-26T12:05:48.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:48 smithi110 ceph-mon[28069]: pgmap v1143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:48 smithi193 ceph-mon[32782]: pgmap v1143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:48 smithi196 ceph-mon[32572]: pgmap v1143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:50 smithi110 ceph-mon[28069]: pgmap v1144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:50 smithi193 ceph-mon[32782]: pgmap v1144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:50 smithi196 ceph-mon[32572]: pgmap v1144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1066.764573 secs 2024-04-26T12:05:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:52 smithi110 ceph-mon[28069]: pgmap v1145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1066.764573 secs 2024-04-26T12:05:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:52 smithi193 ceph-mon[32782]: pgmap v1145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1066.764573 secs 2024-04-26T12:05:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:52 smithi196 ceph-mon[32572]: pgmap v1145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:54 smithi110 ceph-mon[28069]: pgmap v1146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:54 smithi193 ceph-mon[32782]: pgmap v1146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:54 smithi196 ceph-mon[32572]: pgmap v1146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:05:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:56 smithi110 ceph-mon[28069]: pgmap v1147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:56 smithi193 ceph-mon[32782]: pgmap v1147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:56 smithi196 ceph-mon[32572]: pgmap v1147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1071.764689 secs 2024-04-26T12:05:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1071.764689 secs 2024-04-26T12:05:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1071.764689 secs 2024-04-26T12:05:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:05:58 smithi193 ceph-mon[32782]: pgmap v1148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:05:58 smithi196 ceph-mon[32572]: pgmap v1148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:05:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:05:58 smithi110 ceph-mon[28069]: pgmap v1148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:00 smithi193 ceph-mon[32782]: pgmap v1149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:00 smithi196 ceph-mon[32572]: pgmap v1149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:00 smithi110 ceph-mon[28069]: pgmap v1149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:02 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 1076.764786 secs 2024-04-26T12:06:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:02 smithi193 ceph-mon[32782]: slow request 720.522734 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:06:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:02 smithi193 ceph-mon[32782]: pgmap v1150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:02 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 1076.764786 secs 2024-04-26T12:06:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:02 smithi196 ceph-mon[32572]: slow request 720.522734 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:06:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:02 smithi196 ceph-mon[32572]: pgmap v1150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:02 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 1076.764786 secs 2024-04-26T12:06:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:02 smithi110 ceph-mon[28069]: slow request 720.522734 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:06:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:02 smithi110 ceph-mon[28069]: pgmap v1150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:04 smithi193 ceph-mon[32782]: pgmap v1151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:04 smithi196 ceph-mon[32572]: pgmap v1151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:04 smithi110 ceph-mon[28069]: pgmap v1151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:06 smithi193 ceph-mon[32782]: pgmap v1152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:06 smithi196 ceph-mon[32572]: pgmap v1152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:06 smithi110 ceph-mon[28069]: pgmap v1152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1081.764885 secs 2024-04-26T12:06:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1081.764885 secs 2024-04-26T12:06:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1081.764885 secs 2024-04-26T12:06:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:08 smithi193 ceph-mon[32782]: pgmap v1153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:08 smithi196 ceph-mon[32572]: pgmap v1153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:08 smithi110 ceph-mon[28069]: pgmap v1153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:10 smithi193 ceph-mon[32782]: pgmap v1154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:10 smithi196 ceph-mon[32572]: pgmap v1154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:10 smithi110 ceph-mon[28069]: pgmap v1154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1086.764999 secs 2024-04-26T12:06:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:12 smithi193 ceph-mon[32782]: pgmap v1155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1086.764999 secs 2024-04-26T12:06:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:12 smithi196 ceph-mon[32572]: pgmap v1155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1086.764999 secs 2024-04-26T12:06:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:12 smithi110 ceph-mon[28069]: pgmap v1155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:14.626 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:14 smithi193 ceph-mon[32782]: pgmap v1156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:14 smithi196 ceph-mon[32572]: pgmap v1156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:14 smithi110 ceph-mon[28069]: pgmap v1156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:06:16.516+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:06:16.518 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:06:16.517+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 13 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:06:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:06:16.533+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:06:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:06:16.533+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 13 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:06:16.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:16 smithi193 ceph-mon[32782]: pgmap v1157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:16.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1091.765118 secs 2024-04-26T12:06:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:16 smithi196 ceph-mon[32572]: pgmap v1157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:16.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1091.765118 secs 2024-04-26T12:06:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:16 smithi110 ceph-mon[28069]: pgmap v1157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1091.765118 secs 2024-04-26T12:06:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:18 smithi193 ceph-mon[32782]: pgmap v1158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:18 smithi196 ceph-mon[32572]: pgmap v1158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:18 smithi110 ceph-mon[28069]: pgmap v1158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:20 smithi193 ceph-mon[32782]: pgmap v1159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:20 smithi196 ceph-mon[32572]: pgmap v1159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:20.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:20 smithi110 ceph-mon[28069]: pgmap v1159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1096.765238 secs 2024-04-26T12:06:21.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1096.765238 secs 2024-04-26T12:06:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1096.765238 secs 2024-04-26T12:06:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:22 smithi196 ceph-mon[32572]: pgmap v1160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:22 smithi110 ceph-mon[28069]: pgmap v1160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:22 smithi193 ceph-mon[32782]: pgmap v1160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:24 smithi196 ceph-mon[32572]: pgmap v1161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:24.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:24 smithi110 ceph-mon[28069]: pgmap v1161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:24 smithi193 ceph-mon[32782]: pgmap v1161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:26.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:26 smithi196 ceph-mon[32572]: pgmap v1162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:26.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1101.765355 secs 2024-04-26T12:06:26.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:26 smithi110 ceph-mon[28069]: pgmap v1162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:26.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1101.765355 secs 2024-04-26T12:06:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:26 smithi193 ceph-mon[32782]: pgmap v1162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1101.765355 secs 2024-04-26T12:06:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:28 smithi196 ceph-mon[32572]: pgmap v1163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:28.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:28 smithi110 ceph-mon[28069]: pgmap v1163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:28 smithi193 ceph-mon[32782]: pgmap v1163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:30 smithi196 ceph-mon[32572]: pgmap v1164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:06:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:30 smithi110 ceph-mon[28069]: pgmap v1164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:06:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:30 smithi193 ceph-mon[32782]: pgmap v1164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:06:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:06:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:06:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:31 smithi196 ceph-mon[32572]: pgmap v1165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:06:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:31 smithi196 ceph-mon[32572]: pgmap v1166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:06:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1106.765477 secs 2024-04-26T12:06:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:06:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:06:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:31 smithi110 ceph-mon[28069]: pgmap v1165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:06:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:31 smithi110 ceph-mon[28069]: pgmap v1166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:06:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1106.765477 secs 2024-04-26T12:06:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:06:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:06:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:31 smithi193 ceph-mon[32782]: pgmap v1165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:06:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:31 smithi193 ceph-mon[32782]: pgmap v1166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:06:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1106.765477 secs 2024-04-26T12:06:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:33 smithi193 ceph-mon[32782]: pgmap v1167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:33 smithi196 ceph-mon[32572]: pgmap v1167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:33 smithi110 ceph-mon[28069]: pgmap v1167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:35 smithi193 ceph-mon[32782]: pgmap v1168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:36.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:35 smithi196 ceph-mon[32572]: pgmap v1168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:35 smithi110 ceph-mon[28069]: pgmap v1168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1111.765589 secs 2024-04-26T12:06:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1111.765589 secs 2024-04-26T12:06:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1111.765589 secs 2024-04-26T12:06:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:37 smithi193 ceph-mon[32782]: pgmap v1169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:06:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:37 smithi196 ceph-mon[32572]: pgmap v1169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:06:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:37 smithi110 ceph-mon[28069]: pgmap v1169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:06:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:39 smithi193 ceph-mon[32782]: pgmap v1170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:39 smithi196 ceph-mon[32572]: pgmap v1170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:39 smithi110 ceph-mon[28069]: pgmap v1170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:06:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:41 smithi193 ceph-mon[32782]: pgmap v1171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:06:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1116.765728 secs 2024-04-26T12:06:42.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:41 smithi196 ceph-mon[32572]: pgmap v1171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:06:42.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1116.765728 secs 2024-04-26T12:06:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:41 smithi110 ceph-mon[28069]: pgmap v1171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:06:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1116.765728 secs 2024-04-26T12:06:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:43 smithi193 ceph-mon[32782]: pgmap v1172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:43 smithi196 ceph-mon[32572]: pgmap v1172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:43 smithi110 ceph-mon[28069]: pgmap v1172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:45 smithi193 ceph-mon[32782]: pgmap v1173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:45 smithi196 ceph-mon[32572]: pgmap v1173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:45 smithi110 ceph-mon[28069]: pgmap v1173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1121.765747 secs 2024-04-26T12:06:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1121.765747 secs 2024-04-26T12:06:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1121.765747 secs 2024-04-26T12:06:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:47 smithi193 ceph-mon[32782]: pgmap v1174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:47 smithi196 ceph-mon[32572]: pgmap v1174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:47 smithi110 ceph-mon[28069]: pgmap v1174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:49.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:48 smithi196 ceph-mon[32572]: pgmap v1175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:48 smithi110 ceph-mon[28069]: pgmap v1175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:48 smithi193 ceph-mon[32782]: pgmap v1175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:52.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:51 smithi193 ceph-mon[32782]: pgmap v1176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:52.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1126.765868 secs 2024-04-26T12:06:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:51 smithi196 ceph-mon[32572]: pgmap v1176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1126.765868 secs 2024-04-26T12:06:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:51 smithi110 ceph-mon[28069]: pgmap v1176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1126.765868 secs 2024-04-26T12:06:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:53 smithi193 ceph-mon[32782]: pgmap v1177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:53 smithi196 ceph-mon[32572]: pgmap v1177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:53 smithi110 ceph-mon[28069]: pgmap v1177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:06:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:55 smithi193 ceph-mon[32782]: pgmap v1178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:55 smithi196 ceph-mon[32572]: pgmap v1178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:55 smithi110 ceph-mon[28069]: pgmap v1178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1131.765930 secs 2024-04-26T12:06:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1131.765930 secs 2024-04-26T12:06:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1131.765930 secs 2024-04-26T12:06:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:57 smithi193 ceph-mon[32782]: pgmap v1179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:58.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:57 smithi110 ceph-mon[28069]: pgmap v1179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:06:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:57 smithi196 ceph-mon[32572]: pgmap v1179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:06:59 smithi193 ceph-mon[32782]: pgmap v1180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:06:59 smithi196 ceph-mon[32572]: pgmap v1180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:00.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:06:59 smithi110 ceph-mon[28069]: pgmap v1180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:01 smithi193 ceph-mon[32782]: pgmap v1181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1136.766044 secs 2024-04-26T12:07:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:01 smithi196 ceph-mon[32572]: pgmap v1181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1136.766044 secs 2024-04-26T12:07:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:01 smithi110 ceph-mon[28069]: pgmap v1181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1136.766044 secs 2024-04-26T12:07:03.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:02 smithi196 ceph-mon[32572]: pgmap v1182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:02 smithi110 ceph-mon[28069]: pgmap v1182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:02 smithi193 ceph-mon[32782]: pgmap v1182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:05 smithi193 ceph-mon[32782]: pgmap v1183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:05 smithi196 ceph-mon[32572]: pgmap v1183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:05 smithi110 ceph-mon[28069]: pgmap v1183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1141.766180 secs 2024-04-26T12:07:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1141.766180 secs 2024-04-26T12:07:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1141.766180 secs 2024-04-26T12:07:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:07 smithi193 ceph-mon[32782]: pgmap v1184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:07 smithi196 ceph-mon[32572]: pgmap v1184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:07 smithi110 ceph-mon[28069]: pgmap v1184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:09 smithi193 ceph-mon[32782]: pgmap v1185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:10.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:09 smithi196 ceph-mon[32572]: pgmap v1185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:10.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:09 smithi110 ceph-mon[28069]: pgmap v1185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:11 smithi193 ceph-mon[32782]: pgmap v1186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1146.766272 secs 2024-04-26T12:07:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:11 smithi196 ceph-mon[32572]: pgmap v1186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:12.621 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1146.766272 secs 2024-04-26T12:07:12.621 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:11 smithi110 ceph-mon[28069]: pgmap v1186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:12.622 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1146.766272 secs 2024-04-26T12:07:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:13 smithi193 ceph-mon[32782]: pgmap v1187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:13 smithi196 ceph-mon[32572]: pgmap v1187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:13 smithi110 ceph-mon[28069]: pgmap v1187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:15 smithi193 ceph-mon[32782]: pgmap v1188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:07:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:15 smithi196 ceph-mon[32572]: pgmap v1188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:07:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:15 smithi110 ceph-mon[28069]: pgmap v1188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:07:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1151.766389 secs 2024-04-26T12:07:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:16 smithi196 ceph-mon[32572]: pgmap v1189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:07:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1151.766389 secs 2024-04-26T12:07:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:16 smithi110 ceph-mon[28069]: pgmap v1189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:07:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1151.766389 secs 2024-04-26T12:07:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:16 smithi193 ceph-mon[32782]: pgmap v1189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:07:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:19 smithi193 ceph-mon[32782]: pgmap v1190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:19 smithi196 ceph-mon[32572]: pgmap v1190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:19 smithi110 ceph-mon[28069]: pgmap v1190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:21 smithi193 ceph-mon[32782]: pgmap v1191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:07:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1156.766511 secs 2024-04-26T12:07:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:21 smithi196 ceph-mon[32572]: pgmap v1191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:07:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1156.766511 secs 2024-04-26T12:07:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:21 smithi110 ceph-mon[28069]: pgmap v1191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:07:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1156.766511 secs 2024-04-26T12:07:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:23 smithi193 ceph-mon[32782]: pgmap v1192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:24.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:23 smithi196 ceph-mon[32572]: pgmap v1192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:23 smithi110 ceph-mon[28069]: pgmap v1192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:25 smithi193 ceph-mon[32782]: pgmap v1193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:25 smithi196 ceph-mon[32572]: pgmap v1193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:25 smithi110 ceph-mon[28069]: pgmap v1193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1161.766666 secs 2024-04-26T12:07:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1161.766666 secs 2024-04-26T12:07:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1161.766666 secs 2024-04-26T12:07:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:27 smithi193 ceph-mon[32782]: pgmap v1194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:28.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:27 smithi110 ceph-mon[28069]: pgmap v1194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:27 smithi196 ceph-mon[32572]: pgmap v1194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:28 smithi196 ceph-mon[32572]: pgmap v1195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:28 smithi110 ceph-mon[28069]: pgmap v1195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:28 smithi193 ceph-mon[32782]: pgmap v1195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:31 smithi193 ceph-mon[32782]: pgmap v1196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:07:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1166.766731 secs 2024-04-26T12:07:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:31 smithi196 ceph-mon[32572]: pgmap v1196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:07:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1166.766731 secs 2024-04-26T12:07:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:31 smithi110 ceph-mon[28069]: pgmap v1196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:07:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1166.766731 secs 2024-04-26T12:07:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:07:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:07:33.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:07:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:07:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:07:33.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:07:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:07:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:07:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:07:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:33 smithi193 ceph-mon[32782]: pgmap v1197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:07:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:33 smithi193 ceph-mon[32782]: pgmap v1198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:33 smithi196 ceph-mon[32572]: pgmap v1197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:07:34.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:33 smithi196 ceph-mon[32572]: pgmap v1198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:33 smithi110 ceph-mon[28069]: pgmap v1197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:07:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:33 smithi110 ceph-mon[28069]: pgmap v1198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:35 smithi193 ceph-mon[32782]: pgmap v1199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:36.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:35 smithi196 ceph-mon[32572]: pgmap v1199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:35 smithi110 ceph-mon[28069]: pgmap v1199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1171.766884 secs 2024-04-26T12:07:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1171.766884 secs 2024-04-26T12:07:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1171.766884 secs 2024-04-26T12:07:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:37 smithi196 ceph-mon[32572]: pgmap v1200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:37 smithi110 ceph-mon[28069]: pgmap v1200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:37 smithi193 ceph-mon[32782]: pgmap v1200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:38 smithi196 ceph-mon[32572]: pgmap v1201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:38 smithi110 ceph-mon[28069]: pgmap v1201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:38 smithi193 ceph-mon[32782]: pgmap v1201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:41 smithi196 ceph-mon[32572]: pgmap v1202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:41.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1176.766998 secs 2024-04-26T12:07:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:41 smithi110 ceph-mon[28069]: pgmap v1202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1176.766998 secs 2024-04-26T12:07:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:41 smithi193 ceph-mon[32782]: pgmap v1202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:07:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1176.766998 secs 2024-04-26T12:07:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:43 smithi196 ceph-mon[32572]: pgmap v1203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:07:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:43 smithi110 ceph-mon[28069]: pgmap v1203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:07:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:43 smithi193 ceph-mon[32782]: pgmap v1203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:07:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:45 smithi196 ceph-mon[32572]: pgmap v1204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:45 smithi110 ceph-mon[28069]: pgmap v1204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:45 smithi193 ceph-mon[32782]: pgmap v1204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1181.767145 secs 2024-04-26T12:07:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1181.767145 secs 2024-04-26T12:07:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1181.767145 secs 2024-04-26T12:07:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:47 smithi196 ceph-mon[32572]: pgmap v1205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:47.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:47 smithi193 ceph-mon[32782]: pgmap v1205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:47.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:47 smithi110 ceph-mon[28069]: pgmap v1205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:49.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:49 smithi196 ceph-mon[32572]: pgmap v1206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:49 smithi110 ceph-mon[28069]: pgmap v1206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:49 smithi193 ceph-mon[32782]: pgmap v1206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:51 smithi196 ceph-mon[32572]: pgmap v1207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:51.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1186.767262 secs 2024-04-26T12:07:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:51 smithi110 ceph-mon[28069]: pgmap v1207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1186.767262 secs 2024-04-26T12:07:51.876 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:51 smithi193 ceph-mon[32782]: pgmap v1207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:51.876 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1186.767262 secs 2024-04-26T12:07:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:53 smithi196 ceph-mon[32572]: pgmap v1208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:53 smithi110 ceph-mon[28069]: pgmap v1208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:53 smithi193 ceph-mon[32782]: pgmap v1208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:55 smithi196 ceph-mon[32572]: pgmap v1209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:55 smithi110 ceph-mon[28069]: pgmap v1209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:55 smithi193 ceph-mon[32782]: pgmap v1209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:56.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1191.767399 secs 2024-04-26T12:07:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1191.767399 secs 2024-04-26T12:07:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1191.767399 secs 2024-04-26T12:07:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:57 smithi196 ceph-mon[32572]: pgmap v1210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:57 smithi110 ceph-mon[28069]: pgmap v1210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:57 smithi193 ceph-mon[32782]: pgmap v1210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:07:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:07:59 smithi196 ceph-mon[32572]: pgmap v1211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:07:59 smithi110 ceph-mon[28069]: pgmap v1211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:07:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:07:59 smithi193 ceph-mon[32782]: pgmap v1211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:01 smithi196 ceph-mon[32572]: pgmap v1212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:01.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1196.767517 secs 2024-04-26T12:08:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:01 smithi110 ceph-mon[28069]: pgmap v1212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1196.767517 secs 2024-04-26T12:08:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:01 smithi193 ceph-mon[32782]: pgmap v1212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:01.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1196.767517 secs 2024-04-26T12:08:03.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:03 smithi196 ceph-mon[32572]: pgmap v1213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:03 smithi110 ceph-mon[28069]: pgmap v1213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:03 smithi193 ceph-mon[32782]: pgmap v1213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:05 smithi196 ceph-mon[32572]: pgmap v1214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:05 smithi110 ceph-mon[28069]: pgmap v1214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:05 smithi193 ceph-mon[32782]: pgmap v1214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1201.767631 secs 2024-04-26T12:08:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1201.767631 secs 2024-04-26T12:08:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1201.767631 secs 2024-04-26T12:08:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:07 smithi196 ceph-mon[32572]: pgmap v1215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:07 smithi110 ceph-mon[28069]: pgmap v1215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:07 smithi193 ceph-mon[32782]: pgmap v1215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:09 smithi196 ceph-mon[32572]: pgmap v1216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:09 smithi110 ceph-mon[28069]: pgmap v1216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:09 smithi193 ceph-mon[32782]: pgmap v1216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:11 smithi196 ceph-mon[32572]: pgmap v1217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1206.767697 secs 2024-04-26T12:08:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:11 smithi110 ceph-mon[28069]: pgmap v1217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1206.767697 secs 2024-04-26T12:08:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:11 smithi193 ceph-mon[32782]: pgmap v1217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1206.767697 secs 2024-04-26T12:08:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:13 smithi196 ceph-mon[32572]: pgmap v1218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:13.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:13 smithi110 ceph-mon[28069]: pgmap v1218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:13 smithi193 ceph-mon[32782]: pgmap v1218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:15 smithi196 ceph-mon[32572]: pgmap v1219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:15 smithi110 ceph-mon[28069]: pgmap v1219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:15 smithi193 ceph-mon[32782]: pgmap v1219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1211.767816 secs 2024-04-26T12:08:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1211.767816 secs 2024-04-26T12:08:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1211.767816 secs 2024-04-26T12:08:17.774 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:17 smithi193 ceph-mon[32782]: pgmap v1220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:17 smithi110 ceph-mon[28069]: pgmap v1220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:17 smithi196 ceph-mon[32572]: pgmap v1220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:19 smithi110 ceph-mon[28069]: pgmap v1221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:19 smithi193 ceph-mon[32782]: pgmap v1221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:20.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:19 smithi196 ceph-mon[32572]: pgmap v1221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:21 smithi110 ceph-mon[28069]: pgmap v1222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1216.767927 secs 2024-04-26T12:08:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:21 smithi193 ceph-mon[32782]: pgmap v1222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1216.767927 secs 2024-04-26T12:08:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:21 smithi196 ceph-mon[32572]: pgmap v1222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1216.767927 secs 2024-04-26T12:08:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:23 smithi110 ceph-mon[28069]: pgmap v1223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:23 smithi193 ceph-mon[32782]: pgmap v1223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:23 smithi196 ceph-mon[32572]: pgmap v1223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:25.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:25 smithi110 ceph-mon[28069]: pgmap v1224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:25 smithi193 ceph-mon[32782]: pgmap v1224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:25 smithi196 ceph-mon[32572]: pgmap v1224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1221.768043 secs 2024-04-26T12:08:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1221.768043 secs 2024-04-26T12:08:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1221.768043 secs 2024-04-26T12:08:27.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:27 smithi193 ceph-mon[32782]: pgmap v1225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:27 smithi196 ceph-mon[32572]: pgmap v1225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:27 smithi110 ceph-mon[28069]: pgmap v1225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:29.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:29 smithi110 ceph-mon[28069]: pgmap v1226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:29 smithi193 ceph-mon[32782]: pgmap v1226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:29 smithi196 ceph-mon[32572]: pgmap v1226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:31 smithi193 ceph-mon[32782]: pgmap v1227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1226.768159 secs 2024-04-26T12:08:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:31 smithi196 ceph-mon[32572]: pgmap v1227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1226.768159 secs 2024-04-26T12:08:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:31 smithi110 ceph-mon[28069]: pgmap v1227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1226.768159 secs 2024-04-26T12:08:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:33 smithi193 ceph-mon[32782]: pgmap v1228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:08:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:33 smithi196 ceph-mon[32572]: pgmap v1228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:08:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:33 smithi110 ceph-mon[28069]: pgmap v1228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:08:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:08:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:08:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:08:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:08:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:08:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:08:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:08:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:08:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:08:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:35 smithi193 ceph-mon[32782]: pgmap v1229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T12:08:35.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:35 smithi193 ceph-mon[32782]: pgmap v1230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:35 smithi196 ceph-mon[32572]: pgmap v1229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T12:08:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:35 smithi196 ceph-mon[32572]: pgmap v1230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:35 smithi110 ceph-mon[28069]: pgmap v1229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T12:08:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:35 smithi110 ceph-mon[28069]: pgmap v1230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:36.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1231.768293 secs 2024-04-26T12:08:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1231.768293 secs 2024-04-26T12:08:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1231.768293 secs 2024-04-26T12:08:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:37 smithi193 ceph-mon[32782]: pgmap v1231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:37 smithi196 ceph-mon[32572]: pgmap v1231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:37 smithi110 ceph-mon[28069]: pgmap v1231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:39 smithi193 ceph-mon[32782]: pgmap v1232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:39 smithi196 ceph-mon[32572]: pgmap v1232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:39 smithi110 ceph-mon[28069]: pgmap v1232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:41 smithi193 ceph-mon[32782]: pgmap v1233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:41.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1236.768411 secs 2024-04-26T12:08:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:41 smithi196 ceph-mon[32572]: pgmap v1233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1236.768411 secs 2024-04-26T12:08:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:41 smithi110 ceph-mon[28069]: pgmap v1233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:08:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1236.768411 secs 2024-04-26T12:08:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:43 smithi193 ceph-mon[32782]: pgmap v1234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T12:08:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:43 smithi196 ceph-mon[32572]: pgmap v1234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T12:08:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:43 smithi110 ceph-mon[28069]: pgmap v1234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T12:08:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:45 smithi193 ceph-mon[32782]: pgmap v1235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:08:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:45 smithi196 ceph-mon[32572]: pgmap v1235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:08:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:45 smithi110 ceph-mon[28069]: pgmap v1235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:08:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1241.768529 secs 2024-04-26T12:08:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1241.768529 secs 2024-04-26T12:08:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1241.768529 secs 2024-04-26T12:08:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:47 smithi193 ceph-mon[32782]: pgmap v1236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:47 smithi196 ceph-mon[32572]: pgmap v1236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:47 smithi110 ceph-mon[28069]: pgmap v1236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:49 smithi196 ceph-mon[32572]: pgmap v1237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:49 smithi110 ceph-mon[28069]: pgmap v1237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:49 smithi193 ceph-mon[32782]: pgmap v1237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:51 smithi196 ceph-mon[32572]: pgmap v1238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1246.768646 secs 2024-04-26T12:08:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:51 smithi110 ceph-mon[28069]: pgmap v1238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1246.768646 secs 2024-04-26T12:08:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:51 smithi193 ceph-mon[32782]: pgmap v1238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1246.768646 secs 2024-04-26T12:08:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:53 smithi196 ceph-mon[32572]: pgmap v1239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:53 smithi110 ceph-mon[28069]: pgmap v1239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:53 smithi193 ceph-mon[32782]: pgmap v1239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:55 smithi196 ceph-mon[32572]: pgmap v1240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:56.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:55 smithi110 ceph-mon[28069]: pgmap v1240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:55 smithi193 ceph-mon[32782]: pgmap v1240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:08:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1251.768765 secs 2024-04-26T12:08:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1251.768765 secs 2024-04-26T12:08:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1251.768765 secs 2024-04-26T12:08:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:57 smithi196 ceph-mon[32572]: pgmap v1241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:57 smithi110 ceph-mon[28069]: pgmap v1241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:08:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:57 smithi193 ceph-mon[32782]: pgmap v1241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:08:59 smithi196 ceph-mon[32572]: pgmap v1242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:08:59 smithi110 ceph-mon[28069]: pgmap v1242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:08:59 smithi193 ceph-mon[32782]: pgmap v1242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:01.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:09:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:09:00.912+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:09:01.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:09:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:09:00.912+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:09:01.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:09:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:09:00.912+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:09:01.293 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:09:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:09:00.912+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:09:01.293 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:09:00 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:09:00.912+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:09:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:01 smithi196 ceph-mon[32572]: pgmap v1243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1256.768874 secs 2024-04-26T12:09:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:01 smithi110 ceph-mon[28069]: pgmap v1243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1256.768874 secs 2024-04-26T12:09:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:01 smithi193 ceph-mon[32782]: pgmap v1243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1256.768874 secs 2024-04-26T12:09:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:03 smithi196 ceph-mon[32572]: pgmap v1244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:03 smithi110 ceph-mon[28069]: pgmap v1244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:03 smithi193 ceph-mon[32782]: pgmap v1244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:05 smithi196 ceph-mon[32572]: pgmap v1245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:09:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:05 smithi110 ceph-mon[28069]: pgmap v1245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:09:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:05 smithi193 ceph-mon[32782]: pgmap v1245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:09:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1261.769026 secs 2024-04-26T12:09:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1261.769026 secs 2024-04-26T12:09:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1261.769026 secs 2024-04-26T12:09:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:07 smithi196 ceph-mon[32572]: pgmap v1246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:09:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:07 smithi110 ceph-mon[28069]: pgmap v1246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:09:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:07 smithi193 ceph-mon[32782]: pgmap v1246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:09:10.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:09 smithi196 ceph-mon[32572]: pgmap v1247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:09:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:09 smithi110 ceph-mon[28069]: pgmap v1247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:09:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:09 smithi193 ceph-mon[32782]: pgmap v1247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:09:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:11 smithi196 ceph-mon[32572]: pgmap v1248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:09:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1266.769150 secs 2024-04-26T12:09:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:11 smithi110 ceph-mon[28069]: pgmap v1248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:09:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1266.769150 secs 2024-04-26T12:09:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:11 smithi193 ceph-mon[32782]: pgmap v1248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:09:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1266.769150 secs 2024-04-26T12:09:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:13 smithi196 ceph-mon[32572]: pgmap v1249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:09:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:13 smithi110 ceph-mon[28069]: pgmap v1249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:09:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:13 smithi193 ceph-mon[32782]: pgmap v1249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:09:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:15 smithi196 ceph-mon[32572]: pgmap v1250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:09:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:15 smithi110 ceph-mon[28069]: pgmap v1250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:09:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:15 smithi193 ceph-mon[32782]: pgmap v1250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:09:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:09:16.545+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:09:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:09:16.546+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 14 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:09:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:09:16.559+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:09:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:09:16.560+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 14 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:09:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1271.769266 secs 2024-04-26T12:09:17.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1271.769266 secs 2024-04-26T12:09:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1271.769266 secs 2024-04-26T12:09:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:17 smithi196 ceph-mon[32572]: pgmap v1251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:17 smithi110 ceph-mon[28069]: pgmap v1251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:17 smithi193 ceph-mon[32782]: pgmap v1251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:19 smithi196 ceph-mon[32572]: pgmap v1252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:19 smithi110 ceph-mon[28069]: pgmap v1252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:19 smithi193 ceph-mon[32782]: pgmap v1252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:21 smithi196 ceph-mon[32572]: pgmap v1253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1276.769391 secs 2024-04-26T12:09:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:21 smithi110 ceph-mon[28069]: pgmap v1253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1276.769391 secs 2024-04-26T12:09:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:21 smithi193 ceph-mon[32782]: pgmap v1253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1276.769391 secs 2024-04-26T12:09:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:23 smithi196 ceph-mon[32572]: pgmap v1254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:23 smithi110 ceph-mon[28069]: pgmap v1254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:23 smithi193 ceph-mon[32782]: pgmap v1254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:25 smithi196 ceph-mon[32572]: pgmap v1255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:25 smithi110 ceph-mon[28069]: pgmap v1255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:25 smithi193 ceph-mon[32782]: pgmap v1255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1281.769541 secs 2024-04-26T12:09:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1281.769541 secs 2024-04-26T12:09:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1281.769541 secs 2024-04-26T12:09:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:27 smithi110 ceph-mon[28069]: pgmap v1256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:27 smithi193 ceph-mon[32782]: pgmap v1256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:27 smithi196 ceph-mon[32572]: pgmap v1256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:29 smithi110 ceph-mon[28069]: pgmap v1257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:29 smithi193 ceph-mon[32782]: pgmap v1257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:29 smithi196 ceph-mon[32572]: pgmap v1257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:31 smithi110 ceph-mon[28069]: pgmap v1258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1286.769683 secs 2024-04-26T12:09:32.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:31 smithi196 ceph-mon[32572]: pgmap v1258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:32.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1286.769683 secs 2024-04-26T12:09:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:31 smithi193 ceph-mon[32782]: pgmap v1258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1286.769683 secs 2024-04-26T12:09:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:33 smithi110 ceph-mon[28069]: pgmap v1259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:33 smithi193 ceph-mon[32782]: pgmap v1259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:33 smithi196 ceph-mon[32572]: pgmap v1259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:09:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:09:35.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:09:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:35 smithi193 ceph-mon[32782]: pgmap v1260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:09:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:09:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:09:36.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:35 smithi196 ceph-mon[32572]: pgmap v1260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:36.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:09:36.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:09:36.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:09:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:35 smithi110 ceph-mon[28069]: pgmap v1260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:09:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:09:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:09:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:36 smithi193 ceph-mon[32782]: pgmap v1261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:09:37.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:36 smithi193 ceph-mon[32782]: pgmap v1262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:37.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1291.769801 secs 2024-04-26T12:09:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:36 smithi196 ceph-mon[32572]: pgmap v1261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:09:37.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:36 smithi196 ceph-mon[32572]: pgmap v1262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:37.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1291.769801 secs 2024-04-26T12:09:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:36 smithi110 ceph-mon[28069]: pgmap v1261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:09:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:36 smithi110 ceph-mon[28069]: pgmap v1262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1291.769801 secs 2024-04-26T12:09:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:38 smithi193 ceph-mon[32782]: pgmap v1263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:38 smithi196 ceph-mon[32572]: pgmap v1263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:38 smithi110 ceph-mon[28069]: pgmap v1263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:40 smithi193 ceph-mon[32782]: pgmap v1264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:41.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:40 smithi196 ceph-mon[32572]: pgmap v1264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:40 smithi110 ceph-mon[28069]: pgmap v1264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1296.769921 secs 2024-04-26T12:09:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1296.769921 secs 2024-04-26T12:09:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1296.769921 secs 2024-04-26T12:09:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:42 smithi193 ceph-mon[32782]: pgmap v1265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:42 smithi196 ceph-mon[32572]: pgmap v1265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:42 smithi110 ceph-mon[28069]: pgmap v1265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:44 smithi193 ceph-mon[32782]: pgmap v1266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:44 smithi196 ceph-mon[32572]: pgmap v1266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:44 smithi110 ceph-mon[28069]: pgmap v1266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:09:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:46 smithi193 ceph-mon[32782]: pgmap v1267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:09:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1301.770068 secs 2024-04-26T12:09:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:46 smithi196 ceph-mon[32572]: pgmap v1267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:09:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1301.770068 secs 2024-04-26T12:09:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:46 smithi110 ceph-mon[28069]: pgmap v1267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:09:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1301.770068 secs 2024-04-26T12:09:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:48 smithi193 ceph-mon[32782]: pgmap v1268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:48 smithi196 ceph-mon[32572]: pgmap v1268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:48 smithi110 ceph-mon[28069]: pgmap v1268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:50 smithi193 ceph-mon[32782]: pgmap v1269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:50 smithi196 ceph-mon[32572]: pgmap v1269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:50 smithi110 ceph-mon[28069]: pgmap v1269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1306.770185 secs 2024-04-26T12:09:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1306.770185 secs 2024-04-26T12:09:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1306.770185 secs 2024-04-26T12:09:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:52 smithi193 ceph-mon[32782]: pgmap v1270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:52 smithi196 ceph-mon[32572]: pgmap v1270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:52 smithi110 ceph-mon[28069]: pgmap v1270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:54 smithi193 ceph-mon[32782]: pgmap v1271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:54 smithi196 ceph-mon[32572]: pgmap v1271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:54 smithi110 ceph-mon[28069]: pgmap v1271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:56 smithi196 ceph-mon[32572]: pgmap v1272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1311.770304 secs 2024-04-26T12:09:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:56 smithi110 ceph-mon[28069]: pgmap v1272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1311.770304 secs 2024-04-26T12:09:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:56 smithi193 ceph-mon[32782]: pgmap v1272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:09:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1311.770304 secs 2024-04-26T12:09:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:09:58 smithi196 ceph-mon[32572]: pgmap v1273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:09:58 smithi110 ceph-mon[28069]: pgmap v1273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:09:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:09:58 smithi193 ceph-mon[32782]: pgmap v1273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:00 smithi193 ceph-mon[32782]: pgmap v1274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:10:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:00 smithi196 ceph-mon[32572]: pgmap v1274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:00.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:10:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:00 smithi110 ceph-mon[28069]: pgmap v1274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:10:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1316.770448 secs 2024-04-26T12:10:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1316.770448 secs 2024-04-26T12:10:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1316.770448 secs 2024-04-26T12:10:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:02 smithi196 ceph-mon[32572]: pgmap v1275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:02 smithi110 ceph-mon[28069]: pgmap v1275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:02 smithi193 ceph-mon[32782]: pgmap v1275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:04 smithi193 ceph-mon[32782]: pgmap v1276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:04 smithi196 ceph-mon[32572]: pgmap v1276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:04 smithi110 ceph-mon[28069]: pgmap v1276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:06 smithi193 ceph-mon[32782]: pgmap v1277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1321.770586 secs 2024-04-26T12:10:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:06 smithi196 ceph-mon[32572]: pgmap v1277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1321.770586 secs 2024-04-26T12:10:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:06 smithi110 ceph-mon[28069]: pgmap v1277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1321.770586 secs 2024-04-26T12:10:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:08 smithi193 ceph-mon[32782]: pgmap v1278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:08 smithi196 ceph-mon[32572]: pgmap v1278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:08 smithi110 ceph-mon[28069]: pgmap v1278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:10 smithi193 ceph-mon[32782]: pgmap v1279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:10 smithi196 ceph-mon[32572]: pgmap v1279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:10 smithi110 ceph-mon[28069]: pgmap v1279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1326.770727 secs 2024-04-26T12:10:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1326.770727 secs 2024-04-26T12:10:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1326.770727 secs 2024-04-26T12:10:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:12 smithi193 ceph-mon[32782]: pgmap v1280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:12 smithi196 ceph-mon[32572]: pgmap v1280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:12 smithi110 ceph-mon[28069]: pgmap v1280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:14 smithi193 ceph-mon[32782]: pgmap v1281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:14 smithi196 ceph-mon[32572]: pgmap v1281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:14 smithi110 ceph-mon[28069]: pgmap v1281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:16 smithi196 ceph-mon[32572]: pgmap v1282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1331.770853 secs 2024-04-26T12:10:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:16 smithi110 ceph-mon[28069]: pgmap v1282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1331.770853 secs 2024-04-26T12:10:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:16 smithi193 ceph-mon[32782]: pgmap v1282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1331.770853 secs 2024-04-26T12:10:18.925 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:18 smithi193 ceph-mon[32782]: pgmap v1283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:18 smithi196 ceph-mon[32572]: pgmap v1283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:18 smithi110 ceph-mon[28069]: pgmap v1283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:21.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:20 smithi196 ceph-mon[32572]: pgmap v1284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:20 smithi110 ceph-mon[28069]: pgmap v1284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:20 smithi193 ceph-mon[32782]: pgmap v1284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1336.770974 secs 2024-04-26T12:10:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1336.770974 secs 2024-04-26T12:10:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1336.770974 secs 2024-04-26T12:10:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:22 smithi196 ceph-mon[32572]: pgmap v1285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:22 smithi110 ceph-mon[28069]: pgmap v1285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:22 smithi193 ceph-mon[32782]: pgmap v1285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:24 smithi196 ceph-mon[32572]: pgmap v1286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:24 smithi110 ceph-mon[28069]: pgmap v1286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:24 smithi193 ceph-mon[32782]: pgmap v1286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:26 smithi196 ceph-mon[32572]: pgmap v1287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:27.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1341.771110 secs 2024-04-26T12:10:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:26 smithi110 ceph-mon[28069]: pgmap v1287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1341.771110 secs 2024-04-26T12:10:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:26 smithi193 ceph-mon[32782]: pgmap v1287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1341.771110 secs 2024-04-26T12:10:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:28 smithi196 ceph-mon[32572]: pgmap v1288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:28 smithi110 ceph-mon[28069]: pgmap v1288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:28 smithi193 ceph-mon[32782]: pgmap v1288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:31.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:30 smithi196 ceph-mon[32572]: pgmap v1289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:30 smithi110 ceph-mon[28069]: pgmap v1289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:30 smithi193 ceph-mon[32782]: pgmap v1289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1346.771232 secs 2024-04-26T12:10:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1346.771232 secs 2024-04-26T12:10:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1346.771232 secs 2024-04-26T12:10:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:32 smithi196 ceph-mon[32572]: pgmap v1290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:32 smithi110 ceph-mon[28069]: pgmap v1290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:32 smithi193 ceph-mon[32782]: pgmap v1290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:34 smithi196 ceph-mon[32572]: pgmap v1291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:34 smithi110 ceph-mon[28069]: pgmap v1291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:34 smithi193 ceph-mon[32782]: pgmap v1291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:36 smithi196 ceph-mon[32572]: pgmap v1292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:37.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:10:37.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1351.771305 secs 2024-04-26T12:10:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:36 smithi110 ceph-mon[28069]: pgmap v1292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:10:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1351.771305 secs 2024-04-26T12:10:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:36 smithi193 ceph-mon[32782]: pgmap v1292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:10:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1351.771305 secs 2024-04-26T12:10:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:10:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:10:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:10:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:10:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:10:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:10:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:38 smithi196 ceph-mon[32572]: pgmap v1293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:10:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:10:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:10:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:38 smithi110 ceph-mon[28069]: pgmap v1293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:10:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:10:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:10:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:38 smithi193 ceph-mon[32782]: pgmap v1293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:10:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:10:39.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:10:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:39 smithi196 ceph-mon[32572]: pgmap v1294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 979 B/s rd, 1 op/s 2024-04-26T12:10:40.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:39 smithi196 ceph-mon[32572]: pgmap v1295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:39 smithi110 ceph-mon[28069]: pgmap v1294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 979 B/s rd, 1 op/s 2024-04-26T12:10:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:39 smithi110 ceph-mon[28069]: pgmap v1295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:39 smithi193 ceph-mon[32782]: pgmap v1294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 979 B/s rd, 1 op/s 2024-04-26T12:10:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:39 smithi193 ceph-mon[32782]: pgmap v1295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:41 smithi196 ceph-mon[32572]: pgmap v1296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1356.771424 secs 2024-04-26T12:10:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:41 smithi110 ceph-mon[28069]: pgmap v1296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1356.771424 secs 2024-04-26T12:10:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:41 smithi193 ceph-mon[32782]: pgmap v1296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1356.771424 secs 2024-04-26T12:10:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:43 smithi196 ceph-mon[32572]: pgmap v1297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 605 B/s rd, 1 op/s 2024-04-26T12:10:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:43 smithi110 ceph-mon[28069]: pgmap v1297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 605 B/s rd, 1 op/s 2024-04-26T12:10:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:43 smithi193 ceph-mon[32782]: pgmap v1297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 605 B/s rd, 1 op/s 2024-04-26T12:10:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:45 smithi196 ceph-mon[32572]: pgmap v1298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:45 smithi110 ceph-mon[28069]: pgmap v1298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:45 smithi193 ceph-mon[32782]: pgmap v1298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1361.771539 secs 2024-04-26T12:10:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1361.771539 secs 2024-04-26T12:10:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1361.771539 secs 2024-04-26T12:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:47 smithi196 ceph-mon[32572]: pgmap v1299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 605 B/s rd, 1 op/s 2024-04-26T12:10:48.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:47 smithi193 ceph-mon[32782]: pgmap v1299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 605 B/s rd, 1 op/s 2024-04-26T12:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:47 smithi110 ceph-mon[28069]: pgmap v1299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 605 B/s rd, 1 op/s 2024-04-26T12:10:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:49 smithi196 ceph-mon[32572]: pgmap v1300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:10:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:49 smithi110 ceph-mon[28069]: pgmap v1300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:10:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:49 smithi193 ceph-mon[32782]: pgmap v1300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:10:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:51 smithi110 ceph-mon[28069]: pgmap v1301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1366.771656 secs 2024-04-26T12:10:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:51 smithi193 ceph-mon[32782]: pgmap v1301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1366.771656 secs 2024-04-26T12:10:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:51 smithi196 ceph-mon[32572]: pgmap v1301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1366.771656 secs 2024-04-26T12:10:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:53 smithi110 ceph-mon[28069]: pgmap v1302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:54.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:53 smithi193 ceph-mon[32782]: pgmap v1302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:54.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:53 smithi196 ceph-mon[32572]: pgmap v1302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:56.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:55 smithi110 ceph-mon[28069]: pgmap v1303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:55 smithi193 ceph-mon[32782]: pgmap v1303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:55 smithi196 ceph-mon[32572]: pgmap v1303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:10:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1371.771773 secs 2024-04-26T12:10:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1371.771773 secs 2024-04-26T12:10:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1371.771773 secs 2024-04-26T12:10:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:57 smithi110 ceph-mon[28069]: pgmap v1304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:57 smithi193 ceph-mon[32782]: pgmap v1304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:10:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:57 smithi196 ceph-mon[32572]: pgmap v1304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:10:59 smithi110 ceph-mon[28069]: pgmap v1305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:10:59 smithi193 ceph-mon[32782]: pgmap v1305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:10:59 smithi196 ceph-mon[32572]: pgmap v1305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:01 smithi110 ceph-mon[28069]: pgmap v1306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1376.771898 secs 2024-04-26T12:11:02.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:01 smithi196 ceph-mon[32572]: pgmap v1306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:02.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1376.771898 secs 2024-04-26T12:11:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:01 smithi193 ceph-mon[32782]: pgmap v1306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1376.771898 secs 2024-04-26T12:11:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:03 smithi193 ceph-mon[32782]: pgmap v1307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:03 smithi196 ceph-mon[32572]: pgmap v1307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:03 smithi110 ceph-mon[28069]: pgmap v1307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:05 smithi193 ceph-mon[32782]: pgmap v1308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:05 smithi196 ceph-mon[32572]: pgmap v1308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:05 smithi110 ceph-mon[28069]: pgmap v1308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1381.772017 secs 2024-04-26T12:11:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1381.772017 secs 2024-04-26T12:11:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1381.772017 secs 2024-04-26T12:11:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:07 smithi193 ceph-mon[32782]: pgmap v1309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:07 smithi196 ceph-mon[32572]: pgmap v1309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:07 smithi110 ceph-mon[28069]: pgmap v1309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:09 smithi193 ceph-mon[32782]: pgmap v1310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:09 smithi196 ceph-mon[32572]: pgmap v1310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:10.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:09 smithi110 ceph-mon[28069]: pgmap v1310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:11 smithi193 ceph-mon[32782]: pgmap v1311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1386.772153 secs 2024-04-26T12:11:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:11 smithi196 ceph-mon[32572]: pgmap v1311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1386.772153 secs 2024-04-26T12:11:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:11 smithi110 ceph-mon[28069]: pgmap v1311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1386.772153 secs 2024-04-26T12:11:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:13 smithi193 ceph-mon[32782]: pgmap v1312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:13 smithi196 ceph-mon[32572]: pgmap v1312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:13 smithi110 ceph-mon[28069]: pgmap v1312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:16.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:15 smithi193 ceph-mon[32782]: pgmap v1313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:15 smithi196 ceph-mon[32572]: pgmap v1313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:15 smithi110 ceph-mon[28069]: pgmap v1313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1391.772273 secs 2024-04-26T12:11:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1391.772273 secs 2024-04-26T12:11:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1391.772273 secs 2024-04-26T12:11:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:17 smithi193 ceph-mon[32782]: pgmap v1314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:17 smithi196 ceph-mon[32572]: pgmap v1314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:17 smithi110 ceph-mon[28069]: pgmap v1314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:19 smithi193 ceph-mon[32782]: pgmap v1315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:19 smithi196 ceph-mon[32572]: pgmap v1315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:20.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:19 smithi110 ceph-mon[28069]: pgmap v1315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:21 smithi193 ceph-mon[32782]: pgmap v1316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1396.772415 secs 2024-04-26T12:11:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:21 smithi196 ceph-mon[32572]: pgmap v1316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1396.772415 secs 2024-04-26T12:11:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:21 smithi110 ceph-mon[28069]: pgmap v1316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1396.772415 secs 2024-04-26T12:11:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:23 smithi193 ceph-mon[32782]: pgmap v1317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:24.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:23 smithi196 ceph-mon[32572]: pgmap v1317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:23 smithi110 ceph-mon[28069]: pgmap v1317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:25 smithi193 ceph-mon[32782]: pgmap v1318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:26.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:25 smithi196 ceph-mon[32572]: pgmap v1318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:25 smithi110 ceph-mon[28069]: pgmap v1318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1401.772543 secs 2024-04-26T12:11:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1401.772543 secs 2024-04-26T12:11:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1401.772543 secs 2024-04-26T12:11:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:27 smithi196 ceph-mon[32572]: pgmap v1319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:27 smithi110 ceph-mon[28069]: pgmap v1319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:27 smithi193 ceph-mon[32782]: pgmap v1319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:29 smithi196 ceph-mon[32572]: pgmap v1320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:29 smithi110 ceph-mon[28069]: pgmap v1320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:29 smithi193 ceph-mon[32782]: pgmap v1320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:31 smithi196 ceph-mon[32572]: pgmap v1321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1406.772656 secs 2024-04-26T12:11:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:31 smithi110 ceph-mon[28069]: pgmap v1321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1406.772656 secs 2024-04-26T12:11:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:31 smithi193 ceph-mon[32782]: pgmap v1321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1406.772656 secs 2024-04-26T12:11:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:33 smithi196 ceph-mon[32572]: pgmap v1322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:33 smithi110 ceph-mon[28069]: pgmap v1322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:34.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:33 smithi193 ceph-mon[32782]: pgmap v1322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:35 smithi196 ceph-mon[32572]: pgmap v1323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:35 smithi110 ceph-mon[28069]: pgmap v1323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:36.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:35 smithi193 ceph-mon[32782]: pgmap v1323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1411.772733 secs 2024-04-26T12:11:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1411.772733 secs 2024-04-26T12:11:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1411.772733 secs 2024-04-26T12:11:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:37 smithi196 ceph-mon[32572]: pgmap v1324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:37 smithi110 ceph-mon[28069]: pgmap v1324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:37 smithi193 ceph-mon[32782]: pgmap v1324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:39.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:11:39.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.260 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:11:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:11:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:40.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:39 smithi196 ceph-mon[32572]: pgmap v1325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:40.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:11:40.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:11:40.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:39 smithi196 ceph-mon[32572]: pgmap v1326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T12:11:40.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:39 smithi196 ceph-mon[32572]: pgmap v1327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:40.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:39 smithi110 ceph-mon[28069]: pgmap v1325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:11:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:11:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:39 smithi110 ceph-mon[28069]: pgmap v1326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T12:11:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:39 smithi110 ceph-mon[28069]: pgmap v1327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:39 smithi193 ceph-mon[32782]: pgmap v1325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:11:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:11:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:39 smithi193 ceph-mon[32782]: pgmap v1326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T12:11:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:39 smithi193 ceph-mon[32782]: pgmap v1327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:11:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1416.772850 secs 2024-04-26T12:11:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1416.772850 secs 2024-04-26T12:11:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1416.772850 secs 2024-04-26T12:11:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:42 smithi196 ceph-mon[32572]: pgmap v1328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:42 smithi110 ceph-mon[28069]: pgmap v1328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:42 smithi193 ceph-mon[32782]: pgmap v1328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:44 smithi196 ceph-mon[32572]: pgmap v1329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:45.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:44 smithi110 ceph-mon[28069]: pgmap v1329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:44 smithi193 ceph-mon[32782]: pgmap v1329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:46 smithi196 ceph-mon[32572]: pgmap v1330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1421.772969 secs 2024-04-26T12:11:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:46 smithi110 ceph-mon[28069]: pgmap v1330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1421.772969 secs 2024-04-26T12:11:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:46 smithi193 ceph-mon[32782]: pgmap v1330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1421.772969 secs 2024-04-26T12:11:49.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:48 smithi196 ceph-mon[32572]: pgmap v1331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:48 smithi110 ceph-mon[28069]: pgmap v1331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:48 smithi193 ceph-mon[32782]: pgmap v1331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:11:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:50 smithi196 ceph-mon[32572]: pgmap v1332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:11:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:50 smithi110 ceph-mon[28069]: pgmap v1332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:11:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:50 smithi193 ceph-mon[32782]: pgmap v1332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:11:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1426.773086 secs 2024-04-26T12:11:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1426.773086 secs 2024-04-26T12:11:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1426.773086 secs 2024-04-26T12:11:53.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:52 smithi196 ceph-mon[32572]: pgmap v1333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:53.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:52 smithi110 ceph-mon[28069]: pgmap v1333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:52 smithi193 ceph-mon[32782]: pgmap v1333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:54 smithi110 ceph-mon[28069]: pgmap v1334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:54 smithi193 ceph-mon[32782]: pgmap v1334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:54 smithi196 ceph-mon[32572]: pgmap v1334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:56 smithi110 ceph-mon[28069]: pgmap v1335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1431.773184 secs 2024-04-26T12:11:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:56 smithi193 ceph-mon[32782]: pgmap v1335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1431.773184 secs 2024-04-26T12:11:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:56 smithi196 ceph-mon[32572]: pgmap v1335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:11:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1431.773184 secs 2024-04-26T12:11:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:11:58 smithi110 ceph-mon[28069]: pgmap v1336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:11:58 smithi193 ceph-mon[32782]: pgmap v1336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:11:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:11:58 smithi196 ceph-mon[32572]: pgmap v1336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:00 smithi110 ceph-mon[28069]: pgmap v1337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:00 smithi193 ceph-mon[32782]: pgmap v1337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:00 smithi196 ceph-mon[32572]: pgmap v1337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1436.773304 secs 2024-04-26T12:12:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1436.773304 secs 2024-04-26T12:12:02.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1436.773304 secs 2024-04-26T12:12:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:02 smithi110 ceph-mon[28069]: pgmap v1338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:02 smithi193 ceph-mon[32782]: pgmap v1338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:02 smithi196 ceph-mon[32572]: pgmap v1338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:04 smithi110 ceph-mon[28069]: pgmap v1339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:04 smithi193 ceph-mon[32782]: pgmap v1339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:04 smithi196 ceph-mon[32572]: pgmap v1339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:06 smithi193 ceph-mon[32782]: pgmap v1340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:06 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 1441.773422 secs 2024-04-26T12:12:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:06 smithi193 ceph-mon[32782]: slow request 1441.773421 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T12:12:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:06 smithi196 ceph-mon[32572]: pgmap v1340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:06 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 1441.773422 secs 2024-04-26T12:12:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:06 smithi196 ceph-mon[32572]: slow request 1441.773421 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T12:12:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:06 smithi110 ceph-mon[28069]: pgmap v1340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:06 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 1441.773422 secs 2024-04-26T12:12:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:06 smithi110 ceph-mon[28069]: slow request 1441.773421 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T12:12:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:08 smithi193 ceph-mon[32782]: pgmap v1341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:08 smithi196 ceph-mon[32572]: pgmap v1341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:09.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:08 smithi110 ceph-mon[28069]: pgmap v1341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:10 smithi193 ceph-mon[32782]: pgmap v1342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:10 smithi196 ceph-mon[32572]: pgmap v1342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:10 smithi110 ceph-mon[28069]: pgmap v1342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1446.773591 secs 2024-04-26T12:12:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1446.773591 secs 2024-04-26T12:12:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1446.773591 secs 2024-04-26T12:12:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:12 smithi193 ceph-mon[32782]: pgmap v1343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:12 smithi196 ceph-mon[32572]: pgmap v1343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:12 smithi110 ceph-mon[28069]: pgmap v1343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:14 smithi193 ceph-mon[32782]: pgmap v1344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:14 smithi196 ceph-mon[32572]: pgmap v1344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:14 smithi110 ceph-mon[28069]: pgmap v1344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:12:16.575+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:12:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:12:16.576+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 15 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:12:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:12:16.587+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:12:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:12:16.588+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 15 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:12:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:16 smithi193 ceph-mon[32782]: pgmap v1345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:17.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1451.773710 secs 2024-04-26T12:12:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:16 smithi196 ceph-mon[32572]: pgmap v1345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1451.773710 secs 2024-04-26T12:12:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:16 smithi110 ceph-mon[28069]: pgmap v1345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1451.773710 secs 2024-04-26T12:12:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:18 smithi193 ceph-mon[32782]: pgmap v1346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:18 smithi196 ceph-mon[32572]: pgmap v1346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:18 smithi110 ceph-mon[28069]: pgmap v1346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:20 smithi193 ceph-mon[32782]: pgmap v1347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:20 smithi196 ceph-mon[32572]: pgmap v1347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:20 smithi110 ceph-mon[28069]: pgmap v1347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1456.773787 secs 2024-04-26T12:12:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1456.773787 secs 2024-04-26T12:12:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1456.773787 secs 2024-04-26T12:12:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:22 smithi193 ceph-mon[32782]: pgmap v1348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:22 smithi196 ceph-mon[32572]: pgmap v1348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:22 smithi110 ceph-mon[28069]: pgmap v1348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:24 smithi193 ceph-mon[32782]: pgmap v1349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:25.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:24 smithi196 ceph-mon[32572]: pgmap v1349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:24 smithi110 ceph-mon[28069]: pgmap v1349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:26 smithi193 ceph-mon[32782]: pgmap v1350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1461.773857 secs 2024-04-26T12:12:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:26 smithi196 ceph-mon[32572]: pgmap v1350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1461.773857 secs 2024-04-26T12:12:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:26 smithi110 ceph-mon[28069]: pgmap v1350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1461.773857 secs 2024-04-26T12:12:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:28 smithi196 ceph-mon[32572]: pgmap v1351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:28 smithi110 ceph-mon[28069]: pgmap v1351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:28 smithi193 ceph-mon[32782]: pgmap v1351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:31.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:30 smithi196 ceph-mon[32572]: pgmap v1352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:31.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:30 smithi110 ceph-mon[28069]: pgmap v1352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:30 smithi193 ceph-mon[32782]: pgmap v1352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:32.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1466.773938 secs 2024-04-26T12:12:32.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1466.773938 secs 2024-04-26T12:12:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1466.773938 secs 2024-04-26T12:12:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:32 smithi196 ceph-mon[32572]: pgmap v1353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:32 smithi110 ceph-mon[28069]: pgmap v1353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:32 smithi193 ceph-mon[32782]: pgmap v1353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:35.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:34 smithi196 ceph-mon[32572]: pgmap v1354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:35.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:34 smithi110 ceph-mon[28069]: pgmap v1354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:34 smithi193 ceph-mon[32782]: pgmap v1354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:37.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:36 smithi196 ceph-mon[32572]: pgmap v1355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:37.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1471.774070 secs 2024-04-26T12:12:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:36 smithi110 ceph-mon[28069]: pgmap v1355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1471.774070 secs 2024-04-26T12:12:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:36 smithi193 ceph-mon[32782]: pgmap v1355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1471.774070 secs 2024-04-26T12:12:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:38 smithi196 ceph-mon[32572]: pgmap v1356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:38 smithi110 ceph-mon[28069]: pgmap v1356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:38 smithi193 ceph-mon[32782]: pgmap v1356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:40 smithi193 ceph-mon[32782]: pgmap v1357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:12:41.238 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:40 smithi110 ceph-mon[28069]: pgmap v1357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:41.238 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:12:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:40 smithi196 ceph-mon[32572]: pgmap v1357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:12:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1476.774156 secs 2024-04-26T12:12:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1476.774156 secs 2024-04-26T12:12:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1476.774156 secs 2024-04-26T12:12:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: pgmap v1358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: pgmap v1358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: pgmap v1358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:12:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:12:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:12:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:12:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:12:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:44 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:12:45.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:44 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:12:45.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:44 smithi196 ceph-mon[32572]: pgmap v1359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:45.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:45.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:44 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:12:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:44 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:12:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:44 smithi110 ceph-mon[28069]: pgmap v1359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:44 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:12:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:44 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:12:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:44 smithi193 ceph-mon[32782]: pgmap v1359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:45.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:45.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:12:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:12:46.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:12:46.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:12:46.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:12:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:12:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:12:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:12:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:46 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:12:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:46 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:12:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:46 smithi196 ceph-mon[32572]: pgmap v1360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T12:12:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:46 smithi196 ceph-mon[32572]: pgmap v1361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1481.774287 secs 2024-04-26T12:12:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:46 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:12:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:46 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:12:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:46 smithi110 ceph-mon[28069]: pgmap v1360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T12:12:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:46 smithi110 ceph-mon[28069]: pgmap v1361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1481.774287 secs 2024-04-26T12:12:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:46 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:12:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:46 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:12:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:46 smithi193 ceph-mon[32782]: pgmap v1360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T12:12:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:46 smithi193 ceph-mon[32782]: pgmap v1361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1481.774287 secs 2024-04-26T12:12:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:47 smithi196 ceph-mon[32572]: pgmap v1362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:48.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:47 smithi193 ceph-mon[32782]: pgmap v1362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:47 smithi110 ceph-mon[28069]: pgmap v1362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:50 smithi196 ceph-mon[32572]: pgmap v1363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:50 smithi110 ceph-mon[28069]: pgmap v1363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:50.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:50 smithi193 ceph-mon[32782]: pgmap v1363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1486.774406 secs 2024-04-26T12:12:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:52 smithi196 ceph-mon[32572]: pgmap v1364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1486.774406 secs 2024-04-26T12:12:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:52 smithi110 ceph-mon[28069]: pgmap v1364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1486.774406 secs 2024-04-26T12:12:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:52 smithi193 ceph-mon[32782]: pgmap v1364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:54.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:54 smithi196 ceph-mon[32572]: pgmap v1365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:54.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:54 smithi110 ceph-mon[28069]: pgmap v1365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:54 smithi193 ceph-mon[32782]: pgmap v1365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:12:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:56 smithi196 ceph-mon[32572]: pgmap v1366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:12:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1491.774528 secs 2024-04-26T12:12:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:56 smithi110 ceph-mon[28069]: pgmap v1366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:12:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1491.774528 secs 2024-04-26T12:12:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:56 smithi193 ceph-mon[32782]: pgmap v1366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:12:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1491.774528 secs 2024-04-26T12:12:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:12:58 smithi196 ceph-mon[32572]: pgmap v1367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:12:58 smithi110 ceph-mon[28069]: pgmap v1367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:12:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:12:58 smithi193 ceph-mon[32782]: pgmap v1367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:00 smithi196 ceph-mon[32572]: pgmap v1368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:00 smithi110 ceph-mon[28069]: pgmap v1368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:00 smithi193 ceph-mon[32782]: pgmap v1368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:01.584 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:13:01.583+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:13:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:13:01.584+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 16 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:13:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:13:01.594+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:13:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:13:01.594+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 16 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:13:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1496.774651 secs 2024-04-26T12:13:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1496.774651 secs 2024-04-26T12:13:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1496.774651 secs 2024-04-26T12:13:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:02 smithi196 ceph-mon[32572]: pgmap v1369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:02 smithi110 ceph-mon[28069]: pgmap v1369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:02 smithi193 ceph-mon[32782]: pgmap v1369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:04 smithi196 ceph-mon[32572]: pgmap v1370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:04 smithi110 ceph-mon[28069]: pgmap v1370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:04.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:04 smithi193 ceph-mon[32782]: pgmap v1370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:06 smithi196 ceph-mon[32572]: pgmap v1371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:06.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:06 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 1501.774754 secs 2024-04-26T12:13:06.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:06 smithi196 ceph-mon[32572]: slow request 1441.797217 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T12:13:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:06 smithi110 ceph-mon[28069]: pgmap v1371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:06 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 1501.774754 secs 2024-04-26T12:13:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:06 smithi110 ceph-mon[28069]: slow request 1441.797217 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T12:13:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:06 smithi193 ceph-mon[32782]: pgmap v1371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:06 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 1501.774754 secs 2024-04-26T12:13:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:06 smithi193 ceph-mon[32782]: slow request 1441.797217 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T12:13:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:08 smithi196 ceph-mon[32572]: pgmap v1372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:08 smithi110 ceph-mon[28069]: pgmap v1372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:08 smithi193 ceph-mon[32782]: pgmap v1372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:10 smithi196 ceph-mon[32572]: pgmap v1373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:10.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:10 smithi110 ceph-mon[28069]: pgmap v1373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:10 smithi193 ceph-mon[32782]: pgmap v1373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1506.774866 secs 2024-04-26T12:13:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1506.774866 secs 2024-04-26T12:13:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1506.774866 secs 2024-04-26T12:13:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:12 smithi196 ceph-mon[32572]: pgmap v1374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:12 smithi110 ceph-mon[28069]: pgmap v1374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:12 smithi193 ceph-mon[32782]: pgmap v1374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:14 smithi196 ceph-mon[32572]: pgmap v1375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:14 smithi110 ceph-mon[28069]: pgmap v1375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:14 smithi193 ceph-mon[32782]: pgmap v1375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:16.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:16 smithi196 ceph-mon[32572]: pgmap v1376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:16.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1511.774976 secs 2024-04-26T12:13:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:16 smithi110 ceph-mon[28069]: pgmap v1376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1511.774976 secs 2024-04-26T12:13:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:16 smithi193 ceph-mon[32782]: pgmap v1376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1511.774976 secs 2024-04-26T12:13:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:18 smithi196 ceph-mon[32572]: pgmap v1377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:18.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:18 smithi110 ceph-mon[28069]: pgmap v1377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:18 smithi193 ceph-mon[32782]: pgmap v1377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:20 smithi196 ceph-mon[32572]: pgmap v1378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:20.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:20 smithi110 ceph-mon[28069]: pgmap v1378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:20 smithi193 ceph-mon[32782]: pgmap v1378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:21.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1516.775100 secs 2024-04-26T12:13:21.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1516.775100 secs 2024-04-26T12:13:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1516.775100 secs 2024-04-26T12:13:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:22 smithi110 ceph-mon[28069]: pgmap v1379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:22 smithi193 ceph-mon[32782]: pgmap v1379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:22 smithi196 ceph-mon[32572]: pgmap v1379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:24.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:24 smithi110 ceph-mon[28069]: pgmap v1380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:24 smithi193 ceph-mon[32782]: pgmap v1380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:24 smithi196 ceph-mon[32572]: pgmap v1380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:26.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:26 smithi110 ceph-mon[28069]: pgmap v1381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:26.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1521.775224 secs 2024-04-26T12:13:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:26 smithi193 ceph-mon[32782]: pgmap v1381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1521.775224 secs 2024-04-26T12:13:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:26 smithi196 ceph-mon[32572]: pgmap v1381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:27.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1521.775224 secs 2024-04-26T12:13:28.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:28 smithi110 ceph-mon[28069]: pgmap v1382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:28 smithi193 ceph-mon[32782]: pgmap v1382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:28 smithi196 ceph-mon[32572]: pgmap v1382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:30 smithi110 ceph-mon[28069]: pgmap v1383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:30 smithi193 ceph-mon[32782]: pgmap v1383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:31.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:30 smithi196 ceph-mon[32572]: pgmap v1383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1526.775366 secs 2024-04-26T12:13:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1526.775366 secs 2024-04-26T12:13:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1526.775366 secs 2024-04-26T12:13:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:32 smithi193 ceph-mon[32782]: pgmap v1384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:32 smithi196 ceph-mon[32572]: pgmap v1384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:32.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:32 smithi110 ceph-mon[28069]: pgmap v1384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:34 smithi193 ceph-mon[32782]: pgmap v1385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:34 smithi196 ceph-mon[32572]: pgmap v1385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:34 smithi110 ceph-mon[28069]: pgmap v1385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:36 smithi193 ceph-mon[32782]: pgmap v1386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:36.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1531.775504 secs 2024-04-26T12:13:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:36 smithi196 ceph-mon[32572]: pgmap v1386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:37.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1531.775504 secs 2024-04-26T12:13:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:36 smithi110 ceph-mon[28069]: pgmap v1386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1531.775504 secs 2024-04-26T12:13:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:38 smithi193 ceph-mon[32782]: pgmap v1387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:38 smithi196 ceph-mon[32572]: pgmap v1387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:38 smithi110 ceph-mon[28069]: pgmap v1387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:40 smithi193 ceph-mon[32782]: pgmap v1388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:41.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:40 smithi196 ceph-mon[32572]: pgmap v1388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:40 smithi110 ceph-mon[28069]: pgmap v1388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1536.775655 secs 2024-04-26T12:13:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1536.775655 secs 2024-04-26T12:13:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1536.775655 secs 2024-04-26T12:13:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:42 smithi193 ceph-mon[32782]: pgmap v1389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:42 smithi196 ceph-mon[32572]: pgmap v1389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:42 smithi110 ceph-mon[28069]: pgmap v1389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:44 smithi193 ceph-mon[32782]: pgmap v1390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:44 smithi196 ceph-mon[32572]: pgmap v1390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:45.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:44 smithi110 ceph-mon[28069]: pgmap v1390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:46 smithi193 ceph-mon[32782]: pgmap v1391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:13:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1541.775727 secs 2024-04-26T12:13:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:46 smithi196 ceph-mon[32572]: pgmap v1391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:13:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1541.775727 secs 2024-04-26T12:13:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:46 smithi110 ceph-mon[28069]: pgmap v1391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:13:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:13:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1541.775727 secs 2024-04-26T12:13:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:13:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:13:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:47 smithi193 ceph-mon[32782]: pgmap v1392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:13:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:47 smithi193 ceph-mon[32782]: pgmap v1393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:13:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:13:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:13:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:13:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:47 smithi196 ceph-mon[32572]: pgmap v1392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:13:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:47 smithi196 ceph-mon[32572]: pgmap v1393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:13:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:13:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:13:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:13:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:47 smithi110 ceph-mon[28069]: pgmap v1392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:13:48.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:47 smithi110 ceph-mon[28069]: pgmap v1393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:13:48.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:13:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:48 smithi196 ceph-mon[32572]: pgmap v1394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:48 smithi110 ceph-mon[28069]: pgmap v1394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:49 smithi193 ceph-mon[32782]: pgmap v1394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:51.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:51 smithi196 ceph-mon[32572]: pgmap v1395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:50 smithi110 ceph-mon[28069]: pgmap v1395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:51 smithi193 ceph-mon[32782]: pgmap v1395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1546.775843 secs 2024-04-26T12:13:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1546.775843 secs 2024-04-26T12:13:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1546.775843 secs 2024-04-26T12:13:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:53 smithi110 ceph-mon[28069]: pgmap v1396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:53 smithi193 ceph-mon[32782]: pgmap v1396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:53 smithi196 ceph-mon[32572]: pgmap v1396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:55 smithi196 ceph-mon[32572]: pgmap v1397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:55 smithi110 ceph-mon[28069]: pgmap v1397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:55 smithi193 ceph-mon[32782]: pgmap v1397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:13:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1551.775967 secs 2024-04-26T12:13:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1551.775967 secs 2024-04-26T12:13:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1551.775967 secs 2024-04-26T12:13:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:57 smithi196 ceph-mon[32572]: pgmap v1398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:13:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:57 smithi110 ceph-mon[28069]: pgmap v1398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:13:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:57 smithi193 ceph-mon[32782]: pgmap v1398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:13:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:13:59 smithi196 ceph-mon[32572]: pgmap v1399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:13:59 smithi110 ceph-mon[28069]: pgmap v1399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:13:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:13:59 smithi193 ceph-mon[32782]: pgmap v1399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:01 smithi196 ceph-mon[32572]: pgmap v1400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:01 smithi110 ceph-mon[28069]: pgmap v1400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:01.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:14:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:14:01.109+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:14:01.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:14:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:14:01.109+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:14:01.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:14:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:14:01.109+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:14:01.293 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:14:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:14:01.109+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:14:01.293 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:14:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:14:01.109+0000 7f1b4b000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:14:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:01 smithi193 ceph-mon[32782]: pgmap v1400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1556.776092 secs 2024-04-26T12:14:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1556.776092 secs 2024-04-26T12:14:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1556.776092 secs 2024-04-26T12:14:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:03 smithi110 ceph-mon[28069]: pgmap v1401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:14:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:03 smithi193 ceph-mon[32782]: pgmap v1401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:14:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:03 smithi196 ceph-mon[32572]: pgmap v1401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:14:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:05 smithi196 ceph-mon[32572]: pgmap v1402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:14:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:05 smithi110 ceph-mon[28069]: pgmap v1402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:14:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:05 smithi193 ceph-mon[32782]: pgmap v1402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:14:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1561.776177 secs 2024-04-26T12:14:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1561.776177 secs 2024-04-26T12:14:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1561.776177 secs 2024-04-26T12:14:07.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:07 smithi196 ceph-mon[32572]: pgmap v1403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:14:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:07 smithi110 ceph-mon[28069]: pgmap v1403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:14:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:07 smithi193 ceph-mon[32782]: pgmap v1403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:14:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:09 smithi196 ceph-mon[32572]: pgmap v1404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:14:09.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:09 smithi110 ceph-mon[28069]: pgmap v1404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:14:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:09 smithi193 ceph-mon[32782]: pgmap v1404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:14:11.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:11 smithi196 ceph-mon[32572]: pgmap v1405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:14:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:11 smithi110 ceph-mon[28069]: pgmap v1405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:14:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:11 smithi193 ceph-mon[32782]: pgmap v1405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:14:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1566.776319 secs 2024-04-26T12:14:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1566.776319 secs 2024-04-26T12:14:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1566.776319 secs 2024-04-26T12:14:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:13 smithi110 ceph-mon[28069]: pgmap v1406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:14:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:13 smithi193 ceph-mon[32782]: pgmap v1406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:14:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:13 smithi196 ceph-mon[32572]: pgmap v1406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:14:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:15 smithi110 ceph-mon[28069]: pgmap v1407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:15 smithi193 ceph-mon[32782]: pgmap v1407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:15.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:15 smithi196 ceph-mon[32572]: pgmap v1407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1571.776435 secs 2024-04-26T12:14:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1571.776435 secs 2024-04-26T12:14:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1571.776435 secs 2024-04-26T12:14:17.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:17 smithi196 ceph-mon[32572]: pgmap v1408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:17 smithi110 ceph-mon[28069]: pgmap v1408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:17 smithi193 ceph-mon[32782]: pgmap v1408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:19 smithi110 ceph-mon[28069]: pgmap v1409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:19 smithi193 ceph-mon[32782]: pgmap v1409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:19 smithi196 ceph-mon[32572]: pgmap v1409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:21 smithi110 ceph-mon[28069]: pgmap v1410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:21 smithi193 ceph-mon[32782]: pgmap v1410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:21 smithi196 ceph-mon[32572]: pgmap v1410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1576.776547 secs 2024-04-26T12:14:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1576.776547 secs 2024-04-26T12:14:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1576.776547 secs 2024-04-26T12:14:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:23 smithi110 ceph-mon[28069]: pgmap v1411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:23 smithi193 ceph-mon[32782]: pgmap v1411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:23 smithi196 ceph-mon[32572]: pgmap v1411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:25 smithi110 ceph-mon[28069]: pgmap v1412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:25 smithi193 ceph-mon[32782]: pgmap v1412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:25 smithi196 ceph-mon[32572]: pgmap v1412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:26.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1581.776662 secs 2024-04-26T12:14:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1581.776662 secs 2024-04-26T12:14:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1581.776662 secs 2024-04-26T12:14:27.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:27 smithi196 ceph-mon[32572]: pgmap v1413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:27 smithi110 ceph-mon[28069]: pgmap v1413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:27 smithi193 ceph-mon[32782]: pgmap v1413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:29 smithi110 ceph-mon[28069]: pgmap v1414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:29 smithi193 ceph-mon[32782]: pgmap v1414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:29 smithi196 ceph-mon[32572]: pgmap v1414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:31.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:31 smithi110 ceph-mon[28069]: pgmap v1415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:31 smithi193 ceph-mon[32782]: pgmap v1415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:31 smithi196 ceph-mon[32572]: pgmap v1415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1586.776781 secs 2024-04-26T12:14:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1586.776781 secs 2024-04-26T12:14:32.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1586.776781 secs 2024-04-26T12:14:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:33 smithi110 ceph-mon[28069]: pgmap v1416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:33 smithi193 ceph-mon[32782]: pgmap v1416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:33 smithi196 ceph-mon[32572]: pgmap v1416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:35.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:35 smithi110 ceph-mon[28069]: pgmap v1417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:35.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:35 smithi193 ceph-mon[32782]: pgmap v1417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:35 smithi196 ceph-mon[32572]: pgmap v1417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:36.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1591.776900 secs 2024-04-26T12:14:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1591.776900 secs 2024-04-26T12:14:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1591.776900 secs 2024-04-26T12:14:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:37 smithi196 ceph-mon[32572]: pgmap v1418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:37 smithi110 ceph-mon[28069]: pgmap v1418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:37 smithi193 ceph-mon[32782]: pgmap v1418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:39 smithi110 ceph-mon[28069]: pgmap v1419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:39 smithi193 ceph-mon[32782]: pgmap v1419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:39 smithi196 ceph-mon[32572]: pgmap v1419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:41 smithi110 ceph-mon[28069]: pgmap v1420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:41 smithi193 ceph-mon[32782]: pgmap v1420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:41 smithi196 ceph-mon[32572]: pgmap v1420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1596.777044 secs 2024-04-26T12:14:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1596.777044 secs 2024-04-26T12:14:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1596.777044 secs 2024-04-26T12:14:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:43 smithi110 ceph-mon[28069]: pgmap v1421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:43 smithi193 ceph-mon[32782]: pgmap v1421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:43.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:43 smithi196 ceph-mon[32572]: pgmap v1421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:14:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:45 smithi110 ceph-mon[28069]: pgmap v1422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:45 smithi193 ceph-mon[32782]: pgmap v1422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:45 smithi196 ceph-mon[32572]: pgmap v1422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1601.777179 secs 2024-04-26T12:14:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1601.777179 secs 2024-04-26T12:14:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1601.777179 secs 2024-04-26T12:14:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:47 smithi196 ceph-mon[32572]: pgmap v1423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:14:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:47 smithi110 ceph-mon[28069]: pgmap v1423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:14:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:47 smithi193 ceph-mon[32782]: pgmap v1423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:14:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:14:48.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:14:48.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:14:48.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:14:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:14:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:14:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:14:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:14:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:14:48.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:14:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:49 smithi196 ceph-mon[32572]: pgmap v1424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:14:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:49 smithi196 ceph-mon[32572]: pgmap v1425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:49.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:49 smithi193 ceph-mon[32782]: pgmap v1424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:14:49.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:49 smithi193 ceph-mon[32782]: pgmap v1425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:49 smithi110 ceph-mon[28069]: pgmap v1424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:14:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:49 smithi110 ceph-mon[28069]: pgmap v1425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:51 smithi110 ceph-mon[28069]: pgmap v1426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1606.777317 secs 2024-04-26T12:14:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:51 smithi193 ceph-mon[32782]: pgmap v1426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1606.777317 secs 2024-04-26T12:14:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:51 smithi196 ceph-mon[32572]: pgmap v1426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1606.777317 secs 2024-04-26T12:14:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:53 smithi110 ceph-mon[28069]: pgmap v1427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:53 smithi193 ceph-mon[32782]: pgmap v1427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:53 smithi196 ceph-mon[32572]: pgmap v1427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:55 smithi110 ceph-mon[28069]: pgmap v1428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:55 smithi193 ceph-mon[32782]: pgmap v1428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:56.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:55 smithi196 ceph-mon[32572]: pgmap v1428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1611.777455 secs 2024-04-26T12:14:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1611.777455 secs 2024-04-26T12:14:57.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1611.777455 secs 2024-04-26T12:14:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:57 smithi110 ceph-mon[28069]: pgmap v1429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:57 smithi193 ceph-mon[32782]: pgmap v1429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:57 smithi196 ceph-mon[32572]: pgmap v1429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:14:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:14:59 smithi110 ceph-mon[28069]: pgmap v1430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:14:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:14:59 smithi193 ceph-mon[32782]: pgmap v1430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:15:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:14:59 smithi196 ceph-mon[32572]: pgmap v1430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:15:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:01 smithi193 ceph-mon[32782]: pgmap v1431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1616.777587 secs 2024-04-26T12:15:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:01 smithi196 ceph-mon[32572]: pgmap v1431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1616.777587 secs 2024-04-26T12:15:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:01 smithi110 ceph-mon[28069]: pgmap v1431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1616.777587 secs 2024-04-26T12:15:03.808 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:03 smithi196 ceph-mon[32572]: pgmap v1432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:15:03.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:03 smithi110 ceph-mon[28069]: pgmap v1432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:15:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:03 smithi193 ceph-mon[32782]: pgmap v1432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:15:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:05 smithi193 ceph-mon[32782]: pgmap v1433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:15:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:05 smithi196 ceph-mon[32572]: pgmap v1433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:15:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:05 smithi110 ceph-mon[28069]: pgmap v1433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:15:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1621.777739 secs 2024-04-26T12:15:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1621.777739 secs 2024-04-26T12:15:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1621.777739 secs 2024-04-26T12:15:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:07 smithi193 ceph-mon[32782]: pgmap v1434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:15:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:07 smithi196 ceph-mon[32572]: pgmap v1434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:15:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:07 smithi110 ceph-mon[28069]: pgmap v1434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:15:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:09 smithi193 ceph-mon[32782]: pgmap v1435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:15:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:09 smithi196 ceph-mon[32572]: pgmap v1435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:15:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:09 smithi110 ceph-mon[28069]: pgmap v1435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:15:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:11 smithi193 ceph-mon[32782]: pgmap v1436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:15:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:11 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 1626.777834 secs 2024-04-26T12:15:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:11 smithi193 ceph-mon[32782]: slow request 1442.992973 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:15:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:11 smithi196 ceph-mon[32572]: pgmap v1436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:15:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:11 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 1626.777834 secs 2024-04-26T12:15:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:11 smithi196 ceph-mon[32572]: slow request 1442.992973 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:15:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:11 smithi110 ceph-mon[28069]: pgmap v1436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:15:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:11 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 1626.777834 secs 2024-04-26T12:15:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:11 smithi110 ceph-mon[28069]: slow request 1442.992973 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:15:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:13 smithi193 ceph-mon[32782]: pgmap v1437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:15:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:13 smithi196 ceph-mon[32572]: pgmap v1437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:15:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:13 smithi110 ceph-mon[28069]: pgmap v1437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:15:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:15 smithi193 ceph-mon[32782]: pgmap v1438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:15 smithi196 ceph-mon[32572]: pgmap v1438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:15 smithi110 ceph-mon[28069]: pgmap v1438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:15:16.604+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:15:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:15:16.605+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 17 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:15:16.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:15:16.613+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:15:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:15:16.614+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 17 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:15:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1631.777958 secs 2024-04-26T12:15:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1631.777958 secs 2024-04-26T12:15:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1631.777958 secs 2024-04-26T12:15:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:17 smithi193 ceph-mon[32782]: pgmap v1439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:18.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:17 smithi196 ceph-mon[32572]: pgmap v1439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:17 smithi110 ceph-mon[28069]: pgmap v1439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:19 smithi193 ceph-mon[32782]: pgmap v1440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:20.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:19 smithi196 ceph-mon[32572]: pgmap v1440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:19 smithi110 ceph-mon[28069]: pgmap v1440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:21 smithi193 ceph-mon[32782]: pgmap v1441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:21.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1636.778050 secs 2024-04-26T12:15:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:21 smithi196 ceph-mon[32572]: pgmap v1441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1636.778050 secs 2024-04-26T12:15:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:21 smithi110 ceph-mon[28069]: pgmap v1441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1636.778050 secs 2024-04-26T12:15:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:23 smithi193 ceph-mon[32782]: pgmap v1442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:23 smithi196 ceph-mon[32572]: pgmap v1442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:23 smithi110 ceph-mon[28069]: pgmap v1442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:25 smithi196 ceph-mon[32572]: pgmap v1443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:25 smithi110 ceph-mon[28069]: pgmap v1443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:25 smithi193 ceph-mon[32782]: pgmap v1443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1641.778190 secs 2024-04-26T12:15:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1641.778190 secs 2024-04-26T12:15:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1641.778190 secs 2024-04-26T12:15:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:27 smithi196 ceph-mon[32572]: pgmap v1444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:27 smithi110 ceph-mon[28069]: pgmap v1444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:27 smithi193 ceph-mon[32782]: pgmap v1444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:29 smithi196 ceph-mon[32572]: pgmap v1445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:29 smithi110 ceph-mon[28069]: pgmap v1445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:29 smithi193 ceph-mon[32782]: pgmap v1445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:31 smithi196 ceph-mon[32572]: pgmap v1446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1646.778277 secs 2024-04-26T12:15:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:31 smithi110 ceph-mon[28069]: pgmap v1446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1646.778277 secs 2024-04-26T12:15:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:31 smithi193 ceph-mon[32782]: pgmap v1446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1646.778277 secs 2024-04-26T12:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:33 smithi196 ceph-mon[32572]: pgmap v1447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:33 smithi110 ceph-mon[28069]: pgmap v1447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:33 smithi193 ceph-mon[32782]: pgmap v1447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:35 smithi196 ceph-mon[32572]: pgmap v1448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:35 smithi110 ceph-mon[28069]: pgmap v1448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:35 smithi193 ceph-mon[32782]: pgmap v1448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1651.778394 secs 2024-04-26T12:15:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1651.778394 secs 2024-04-26T12:15:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1651.778394 secs 2024-04-26T12:15:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:37 smithi196 ceph-mon[32572]: pgmap v1449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:37 smithi110 ceph-mon[28069]: pgmap v1449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:37 smithi193 ceph-mon[32782]: pgmap v1449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:39 smithi196 ceph-mon[32572]: pgmap v1450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:39 smithi110 ceph-mon[28069]: pgmap v1450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:39 smithi193 ceph-mon[32782]: pgmap v1450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:41 smithi196 ceph-mon[32572]: pgmap v1451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1656.778511 secs 2024-04-26T12:15:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:41 smithi110 ceph-mon[28069]: pgmap v1451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1656.778511 secs 2024-04-26T12:15:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:41 smithi193 ceph-mon[32782]: pgmap v1451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1656.778511 secs 2024-04-26T12:15:44.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:43 smithi196 ceph-mon[32572]: pgmap v1452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:43 smithi110 ceph-mon[28069]: pgmap v1452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:43 smithi193 ceph-mon[32782]: pgmap v1452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:45 smithi196 ceph-mon[32572]: pgmap v1453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:45 smithi110 ceph-mon[28069]: pgmap v1453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:45 smithi193 ceph-mon[32782]: pgmap v1453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1661.778647 secs 2024-04-26T12:15:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1661.778647 secs 2024-04-26T12:15:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1661.778647 secs 2024-04-26T12:15:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:47 smithi196 ceph-mon[32572]: pgmap v1454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:47 smithi110 ceph-mon[28069]: pgmap v1454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:47 smithi193 ceph-mon[32782]: pgmap v1454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:15:50.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:49 smithi196 ceph-mon[32572]: pgmap v1455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:50.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:15:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:49 smithi110 ceph-mon[28069]: pgmap v1455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:15:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:49 smithi193 ceph-mon[32782]: pgmap v1455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:15:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:15:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:15:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:15:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:15:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:15:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:15:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:15:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:15:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:15:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:15:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:51 smithi196 ceph-mon[32572]: pgmap v1456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:15:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:51 smithi196 ceph-mon[32572]: pgmap v1457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:15:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1666.778768 secs 2024-04-26T12:15:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:51 smithi110 ceph-mon[28069]: pgmap v1456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:15:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:51 smithi110 ceph-mon[28069]: pgmap v1457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:15:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1666.778768 secs 2024-04-26T12:15:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:51 smithi193 ceph-mon[32782]: pgmap v1456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:15:52.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:51 smithi193 ceph-mon[32782]: pgmap v1457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:15:52.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1666.778768 secs 2024-04-26T12:15:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:53 smithi196 ceph-mon[32572]: pgmap v1458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:15:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:53 smithi110 ceph-mon[28069]: pgmap v1458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:15:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:53 smithi193 ceph-mon[32782]: pgmap v1458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:15:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:55 smithi196 ceph-mon[32572]: pgmap v1459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:15:56.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:55 smithi110 ceph-mon[28069]: pgmap v1459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:15:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:55 smithi193 ceph-mon[32782]: pgmap v1459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:15:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1671.778905 secs 2024-04-26T12:15:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1671.778905 secs 2024-04-26T12:15:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1671.778905 secs 2024-04-26T12:15:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:57 smithi196 ceph-mon[32572]: pgmap v1460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:15:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:57 smithi110 ceph-mon[28069]: pgmap v1460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:15:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:57 smithi193 ceph-mon[32782]: pgmap v1460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:15:59 smithi110 ceph-mon[28069]: pgmap v1461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:15:59 smithi193 ceph-mon[32782]: pgmap v1461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:15:59 smithi196 ceph-mon[32572]: pgmap v1461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:01 smithi110 ceph-mon[28069]: pgmap v1462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:16:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1676.779002 secs 2024-04-26T12:16:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:01 smithi193 ceph-mon[32782]: pgmap v1462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:16:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1676.779002 secs 2024-04-26T12:16:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:01 smithi196 ceph-mon[32572]: pgmap v1462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:16:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1676.779002 secs 2024-04-26T12:16:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:03 smithi110 ceph-mon[28069]: pgmap v1463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:04.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:03 smithi196 ceph-mon[32572]: pgmap v1463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:03 smithi193 ceph-mon[32782]: pgmap v1463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:05 smithi110 ceph-mon[28069]: pgmap v1464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:06.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:05 smithi193 ceph-mon[32782]: pgmap v1464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:05 smithi196 ceph-mon[32572]: pgmap v1464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1681.779120 secs 2024-04-26T12:16:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1681.779120 secs 2024-04-26T12:16:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1681.779120 secs 2024-04-26T12:16:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:07 smithi110 ceph-mon[28069]: pgmap v1465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:07 smithi193 ceph-mon[32782]: pgmap v1465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:07 smithi196 ceph-mon[32572]: pgmap v1465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:09 smithi110 ceph-mon[28069]: pgmap v1466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:09 smithi193 ceph-mon[32782]: pgmap v1466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:09 smithi196 ceph-mon[32572]: pgmap v1466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:11 smithi193 ceph-mon[32782]: pgmap v1467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:16:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1686.779253 secs 2024-04-26T12:16:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:11 smithi196 ceph-mon[32572]: pgmap v1467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:16:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1686.779253 secs 2024-04-26T12:16:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:11 smithi110 ceph-mon[28069]: pgmap v1467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:16:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1686.779253 secs 2024-04-26T12:16:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:13 smithi193 ceph-mon[32782]: pgmap v1468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:16:14.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:13 smithi196 ceph-mon[32572]: pgmap v1468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:16:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:13 smithi110 ceph-mon[28069]: pgmap v1468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:16:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:15 smithi193 ceph-mon[32782]: pgmap v1469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:15 smithi196 ceph-mon[32572]: pgmap v1469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:15 smithi110 ceph-mon[28069]: pgmap v1469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1691.779372 secs 2024-04-26T12:16:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1691.779372 secs 2024-04-26T12:16:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1691.779372 secs 2024-04-26T12:16:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:17 smithi193 ceph-mon[32782]: pgmap v1470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:16:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:17 smithi196 ceph-mon[32572]: pgmap v1470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:16:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:17 smithi110 ceph-mon[28069]: pgmap v1470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:16:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:19 smithi193 ceph-mon[32782]: pgmap v1471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:19 smithi196 ceph-mon[32572]: pgmap v1471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:20.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:19 smithi110 ceph-mon[28069]: pgmap v1471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:21 smithi193 ceph-mon[32782]: pgmap v1472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1696.779508 secs 2024-04-26T12:16:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:21 smithi196 ceph-mon[32572]: pgmap v1472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1696.779508 secs 2024-04-26T12:16:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:21 smithi110 ceph-mon[28069]: pgmap v1472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1696.779508 secs 2024-04-26T12:16:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:23 smithi193 ceph-mon[32782]: pgmap v1473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:23 smithi196 ceph-mon[32572]: pgmap v1473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:23 smithi110 ceph-mon[28069]: pgmap v1473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:25 smithi193 ceph-mon[32782]: pgmap v1474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:25 smithi196 ceph-mon[32572]: pgmap v1474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:25 smithi110 ceph-mon[28069]: pgmap v1474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1701.779631 secs 2024-04-26T12:16:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1701.779631 secs 2024-04-26T12:16:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1701.779631 secs 2024-04-26T12:16:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:27 smithi193 ceph-mon[32782]: pgmap v1475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:27 smithi196 ceph-mon[32572]: pgmap v1475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:27 smithi110 ceph-mon[28069]: pgmap v1475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:29 smithi193 ceph-mon[32782]: pgmap v1476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:29 smithi196 ceph-mon[32572]: pgmap v1476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:29 smithi110 ceph-mon[28069]: pgmap v1476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:31 smithi193 ceph-mon[32782]: pgmap v1477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1706.779725 secs 2024-04-26T12:16:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:31 smithi196 ceph-mon[32572]: pgmap v1477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1706.779725 secs 2024-04-26T12:16:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:31 smithi110 ceph-mon[28069]: pgmap v1477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1706.779725 secs 2024-04-26T12:16:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:33 smithi193 ceph-mon[32782]: pgmap v1478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:34.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:33 smithi196 ceph-mon[32572]: pgmap v1478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:33 smithi110 ceph-mon[28069]: pgmap v1478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:35 smithi193 ceph-mon[32782]: pgmap v1479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:35 smithi196 ceph-mon[32572]: pgmap v1479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:35 smithi110 ceph-mon[28069]: pgmap v1479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:37.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1711.779850 secs 2024-04-26T12:16:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1711.779850 secs 2024-04-26T12:16:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1711.779850 secs 2024-04-26T12:16:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:37 smithi196 ceph-mon[32572]: pgmap v1480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:37 smithi110 ceph-mon[28069]: pgmap v1480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:37 smithi193 ceph-mon[32782]: pgmap v1480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:39 smithi196 ceph-mon[32572]: pgmap v1481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:39 smithi110 ceph-mon[28069]: pgmap v1481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:39 smithi193 ceph-mon[32782]: pgmap v1481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:41 smithi196 ceph-mon[32572]: pgmap v1482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1716.779968 secs 2024-04-26T12:16:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:41 smithi110 ceph-mon[28069]: pgmap v1482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1716.779968 secs 2024-04-26T12:16:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:41 smithi193 ceph-mon[32782]: pgmap v1482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1716.779968 secs 2024-04-26T12:16:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:43 smithi196 ceph-mon[32572]: pgmap v1483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:43 smithi110 ceph-mon[28069]: pgmap v1483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:43 smithi193 ceph-mon[32782]: pgmap v1483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:45 smithi196 ceph-mon[32572]: pgmap v1484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:45 smithi110 ceph-mon[28069]: pgmap v1484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:45 smithi193 ceph-mon[32782]: pgmap v1484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1721.780084 secs 2024-04-26T12:16:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1721.780084 secs 2024-04-26T12:16:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1721.780084 secs 2024-04-26T12:16:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:47 smithi196 ceph-mon[32572]: pgmap v1485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:47 smithi110 ceph-mon[28069]: pgmap v1485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:47 smithi193 ceph-mon[32782]: pgmap v1485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:50.175 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:49 smithi193 ceph-mon[32782]: pgmap v1486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:49 smithi196 ceph-mon[32572]: pgmap v1486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:50.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:49 smithi110 ceph-mon[28069]: pgmap v1486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:16:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:16:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:16:51.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:16:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:51 smithi196 ceph-mon[32572]: pgmap v1487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1726.780199 secs 2024-04-26T12:16:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:16:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:16:52.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:16:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:51 smithi110 ceph-mon[28069]: pgmap v1487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1726.780199 secs 2024-04-26T12:16:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:16:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:16:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:16:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:51 smithi193 ceph-mon[32782]: pgmap v1487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:16:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1726.780199 secs 2024-04-26T12:16:52.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:16:52.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:16:52.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:16:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:52 smithi196 ceph-mon[32572]: pgmap v1488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T12:16:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:52 smithi196 ceph-mon[32572]: pgmap v1489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:52 smithi110 ceph-mon[28069]: pgmap v1488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T12:16:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:52 smithi110 ceph-mon[28069]: pgmap v1489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:52 smithi193 ceph-mon[32782]: pgmap v1488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T12:16:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:52 smithi193 ceph-mon[32782]: pgmap v1489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:54 smithi196 ceph-mon[32572]: pgmap v1490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:54 smithi110 ceph-mon[28069]: pgmap v1490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:54 smithi193 ceph-mon[32782]: pgmap v1490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:56 smithi196 ceph-mon[32572]: pgmap v1491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1731.780315 secs 2024-04-26T12:16:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:56 smithi110 ceph-mon[28069]: pgmap v1491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1731.780315 secs 2024-04-26T12:16:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:56 smithi193 ceph-mon[32782]: pgmap v1491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:57.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1731.780315 secs 2024-04-26T12:16:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:16:58 smithi196 ceph-mon[32572]: pgmap v1492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:16:58 smithi110 ceph-mon[28069]: pgmap v1492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:16:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:16:58 smithi193 ceph-mon[32782]: pgmap v1492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:17:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:00 smithi196 ceph-mon[32572]: pgmap v1493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:17:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:00 smithi110 ceph-mon[28069]: pgmap v1493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:17:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:00 smithi193 ceph-mon[32782]: pgmap v1493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:17:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1736.780453 secs 2024-04-26T12:17:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1736.780453 secs 2024-04-26T12:17:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1736.780453 secs 2024-04-26T12:17:03.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:02 smithi196 ceph-mon[32572]: pgmap v1494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:17:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:02 smithi110 ceph-mon[28069]: pgmap v1494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:17:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:02 smithi193 ceph-mon[32782]: pgmap v1494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:17:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:04 smithi196 ceph-mon[32572]: pgmap v1495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:04 smithi110 ceph-mon[28069]: pgmap v1495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:04 smithi193 ceph-mon[32782]: pgmap v1495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:06 smithi196 ceph-mon[32572]: pgmap v1496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1741.780583 secs 2024-04-26T12:17:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:06 smithi110 ceph-mon[28069]: pgmap v1496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1741.780583 secs 2024-04-26T12:17:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:06 smithi193 ceph-mon[32782]: pgmap v1496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1741.780583 secs 2024-04-26T12:17:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:08 smithi193 ceph-mon[32782]: pgmap v1497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:08 smithi196 ceph-mon[32572]: pgmap v1497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:08 smithi110 ceph-mon[28069]: pgmap v1497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:10 smithi196 ceph-mon[32572]: pgmap v1498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:10 smithi110 ceph-mon[28069]: pgmap v1498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:10 smithi193 ceph-mon[32782]: pgmap v1498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1746.780704 secs 2024-04-26T12:17:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1746.780704 secs 2024-04-26T12:17:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1746.780704 secs 2024-04-26T12:17:13.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:12 smithi196 ceph-mon[32572]: pgmap v1499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:12 smithi110 ceph-mon[28069]: pgmap v1499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:12 smithi193 ceph-mon[32782]: pgmap v1499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:14 smithi196 ceph-mon[32572]: pgmap v1500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:14 smithi110 ceph-mon[28069]: pgmap v1500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:14 smithi193 ceph-mon[32782]: pgmap v1500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:16 smithi196 ceph-mon[32572]: pgmap v1501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1751.780821 secs 2024-04-26T12:17:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:16 smithi110 ceph-mon[28069]: pgmap v1501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1751.780821 secs 2024-04-26T12:17:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:16 smithi193 ceph-mon[32782]: pgmap v1501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1751.780821 secs 2024-04-26T12:17:19.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:18 smithi196 ceph-mon[32572]: pgmap v1502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:18 smithi110 ceph-mon[28069]: pgmap v1502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:19.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:18 smithi193 ceph-mon[32782]: pgmap v1502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:20 smithi196 ceph-mon[32572]: pgmap v1503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:20 smithi110 ceph-mon[28069]: pgmap v1503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:20 smithi193 ceph-mon[32782]: pgmap v1503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1756.780940 secs 2024-04-26T12:17:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1756.780940 secs 2024-04-26T12:17:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1756.780940 secs 2024-04-26T12:17:23.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:22 smithi196 ceph-mon[32572]: pgmap v1504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:22 smithi110 ceph-mon[28069]: pgmap v1504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:22 smithi193 ceph-mon[32782]: pgmap v1504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:24 smithi196 ceph-mon[32572]: pgmap v1505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:24 smithi110 ceph-mon[28069]: pgmap v1505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:24 smithi193 ceph-mon[32782]: pgmap v1505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:27.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:26 smithi196 ceph-mon[32572]: pgmap v1506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:27.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1761.781062 secs 2024-04-26T12:17:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:26 smithi110 ceph-mon[28069]: pgmap v1506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1761.781062 secs 2024-04-26T12:17:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:26 smithi193 ceph-mon[32782]: pgmap v1506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1761.781062 secs 2024-04-26T12:17:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:28 smithi196 ceph-mon[32572]: pgmap v1507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:28 smithi110 ceph-mon[28069]: pgmap v1507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:29.125 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:28 smithi193 ceph-mon[32782]: pgmap v1507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:30 smithi110 ceph-mon[28069]: pgmap v1508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:30 smithi193 ceph-mon[32782]: pgmap v1508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:31.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:30 smithi196 ceph-mon[32572]: pgmap v1508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1766.781180 secs 2024-04-26T12:17:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1766.781180 secs 2024-04-26T12:17:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1766.781180 secs 2024-04-26T12:17:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:32 smithi110 ceph-mon[28069]: pgmap v1509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:32 smithi193 ceph-mon[32782]: pgmap v1509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:32 smithi196 ceph-mon[32572]: pgmap v1509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:34 smithi110 ceph-mon[28069]: pgmap v1510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:35.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:34 smithi196 ceph-mon[32572]: pgmap v1510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:34 smithi193 ceph-mon[32782]: pgmap v1510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:36 smithi110 ceph-mon[28069]: pgmap v1511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1771.781312 secs 2024-04-26T12:17:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:36 smithi193 ceph-mon[32782]: pgmap v1511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:37.125 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1771.781312 secs 2024-04-26T12:17:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:36 smithi196 ceph-mon[32572]: pgmap v1511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:37.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1771.781312 secs 2024-04-26T12:17:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:38 smithi110 ceph-mon[28069]: pgmap v1512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:38 smithi193 ceph-mon[32782]: pgmap v1512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:39.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:38 smithi196 ceph-mon[32572]: pgmap v1512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:40 smithi110 ceph-mon[28069]: pgmap v1513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:40 smithi193 ceph-mon[32782]: pgmap v1513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:40 smithi196 ceph-mon[32572]: pgmap v1513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1776.781435 secs 2024-04-26T12:17:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1776.781435 secs 2024-04-26T12:17:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1776.781435 secs 2024-04-26T12:17:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:42 smithi193 ceph-mon[32782]: pgmap v1514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:43.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:42 smithi196 ceph-mon[32572]: pgmap v1514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:42 smithi110 ceph-mon[28069]: pgmap v1514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:45.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:44 smithi193 ceph-mon[32782]: pgmap v1515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:45.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:44 smithi196 ceph-mon[32572]: pgmap v1515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:44 smithi110 ceph-mon[28069]: pgmap v1515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:46 smithi193 ceph-mon[32782]: pgmap v1516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1781.781588 secs 2024-04-26T12:17:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:46 smithi196 ceph-mon[32572]: pgmap v1516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1781.781588 secs 2024-04-26T12:17:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:46 smithi110 ceph-mon[28069]: pgmap v1516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1781.781588 secs 2024-04-26T12:17:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:48 smithi193 ceph-mon[32782]: pgmap v1517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:48 smithi196 ceph-mon[32572]: pgmap v1517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:48 smithi110 ceph-mon[28069]: pgmap v1517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:17:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:50 smithi193 ceph-mon[32782]: pgmap v1518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:51.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:50 smithi196 ceph-mon[32572]: pgmap v1518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:50 smithi110 ceph-mon[28069]: pgmap v1518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1786.781724 secs 2024-04-26T12:17:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1786.781724 secs 2024-04-26T12:17:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1786.781724 secs 2024-04-26T12:17:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:52 smithi193 ceph-mon[32782]: pgmap v1519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:17:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:52 smithi196 ceph-mon[32572]: pgmap v1519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:17:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:52 smithi110 ceph-mon[28069]: pgmap v1519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:17:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:17:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:17:54.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:17:54.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:17:54.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:17:54.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:17:54.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:17:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:17:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:17:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:17:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:54 smithi193 ceph-mon[32782]: pgmap v1520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:17:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:54 smithi196 ceph-mon[32572]: pgmap v1520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:17:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:54 smithi110 ceph-mon[28069]: pgmap v1520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:17:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:56 smithi193 ceph-mon[32782]: pgmap v1521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:17:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1791.781801 secs 2024-04-26T12:17:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:56 smithi196 ceph-mon[32572]: pgmap v1521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:17:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1791.781801 secs 2024-04-26T12:17:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:56 smithi110 ceph-mon[28069]: pgmap v1521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:17:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1791.781801 secs 2024-04-26T12:17:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:17:58 smithi193 ceph-mon[32782]: pgmap v1522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:17:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:17:58 smithi196 ceph-mon[32572]: pgmap v1522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:17:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:17:58 smithi110 ceph-mon[28069]: pgmap v1522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:18:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:00 smithi193 ceph-mon[32782]: pgmap v1523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:18:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:00 smithi196 ceph-mon[32572]: pgmap v1523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:18:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:00 smithi110 ceph-mon[28069]: pgmap v1523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:18:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:01 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 1796.781923 secs 2024-04-26T12:18:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:01 smithi196 ceph-mon[32572]: slow request 1440.539871 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:18:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:01 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 1796.781923 secs 2024-04-26T12:18:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:01 smithi110 ceph-mon[28069]: slow request 1440.539871 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:18:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:01 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 1796.781923 secs 2024-04-26T12:18:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:01 smithi193 ceph-mon[32782]: slow request 1440.539871 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:18:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:02 smithi196 ceph-mon[32572]: pgmap v1524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:18:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:02 smithi110 ceph-mon[28069]: pgmap v1524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:18:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:02 smithi193 ceph-mon[32782]: pgmap v1524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:18:05.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:04 smithi196 ceph-mon[32572]: pgmap v1525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:18:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:04 smithi110 ceph-mon[28069]: pgmap v1525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:18:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:04 smithi193 ceph-mon[32782]: pgmap v1525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:18:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:06 smithi196 ceph-mon[32572]: pgmap v1526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1801.782047 secs 2024-04-26T12:18:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:06 smithi110 ceph-mon[28069]: pgmap v1526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1801.782047 secs 2024-04-26T12:18:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:06 smithi193 ceph-mon[32782]: pgmap v1526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:07.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1801.782047 secs 2024-04-26T12:18:09.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:08 smithi196 ceph-mon[32572]: pgmap v1527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:09.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:08 smithi110 ceph-mon[28069]: pgmap v1527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:08 smithi193 ceph-mon[32782]: pgmap v1527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:10 smithi196 ceph-mon[32572]: pgmap v1528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:10 smithi110 ceph-mon[28069]: pgmap v1528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:10 smithi193 ceph-mon[32782]: pgmap v1528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1806.782164 secs 2024-04-26T12:18:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1806.782164 secs 2024-04-26T12:18:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1806.782164 secs 2024-04-26T12:18:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:12 smithi196 ceph-mon[32572]: pgmap v1529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:12 smithi110 ceph-mon[28069]: pgmap v1529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:12 smithi193 ceph-mon[32782]: pgmap v1529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:15.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:14 smithi196 ceph-mon[32572]: pgmap v1530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:14 smithi110 ceph-mon[28069]: pgmap v1530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:14 smithi193 ceph-mon[32782]: pgmap v1530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.352+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 msgr2=0x7f26000b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T12:18:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.352+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 msgr2=0x7f26000b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T12:18:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.352+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 0x7f26000b2c30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f261401b000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:18:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.352+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 0x7f26000b2c30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f261401b000 comp rx=0 tx=0).stop 2024-04-26T12:18:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.352+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 msgr2=0x7f26000b2c30 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T12:18:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.352+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 msgr2=0x7f26000b2c30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T12:18:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.352+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0840 0x7f26000b2c30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:18:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.352+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:18:16.356 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.353+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:18:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.355+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000b3170 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2614029000 tx=0x7f261401e040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.387+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T12:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.387+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T12:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.387+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.387+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T12:18:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.387+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:18:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.389+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T12:18:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.389+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T12:18:16.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.635+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:18:16.637 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.635+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 18 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:18:16.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.640+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:18:16.642 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:18:16.640+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 18 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:18:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:16 smithi196 ceph-mon[32572]: pgmap v1531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1811.782301 secs 2024-04-26T12:18:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:16 smithi110 ceph-mon[28069]: pgmap v1531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1811.782301 secs 2024-04-26T12:18:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:16 smithi193 ceph-mon[32782]: pgmap v1531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1811.782301 secs 2024-04-26T12:18:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:18 smithi196 ceph-mon[32572]: pgmap v1532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:18 smithi110 ceph-mon[28069]: pgmap v1532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:18 smithi193 ceph-mon[32782]: pgmap v1532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:21.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:20 smithi196 ceph-mon[32572]: pgmap v1533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:20 smithi110 ceph-mon[28069]: pgmap v1533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:20 smithi193 ceph-mon[32782]: pgmap v1533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1816.782399 secs 2024-04-26T12:18:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1816.782399 secs 2024-04-26T12:18:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1816.782399 secs 2024-04-26T12:18:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:22 smithi196 ceph-mon[32572]: pgmap v1534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:22 smithi110 ceph-mon[28069]: pgmap v1534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:22 smithi193 ceph-mon[32782]: pgmap v1534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:25.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:24 smithi196 ceph-mon[32572]: pgmap v1535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:24 smithi110 ceph-mon[28069]: pgmap v1535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:24 smithi193 ceph-mon[32782]: pgmap v1535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:26 smithi196 ceph-mon[32572]: pgmap v1536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1821.782514 secs 2024-04-26T12:18:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:26 smithi110 ceph-mon[28069]: pgmap v1536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1821.782514 secs 2024-04-26T12:18:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:26 smithi193 ceph-mon[32782]: pgmap v1536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1821.782514 secs 2024-04-26T12:18:29.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:28 smithi196 ceph-mon[32572]: pgmap v1537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:28 smithi110 ceph-mon[28069]: pgmap v1537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:28 smithi193 ceph-mon[32782]: pgmap v1537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:31.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:30 smithi196 ceph-mon[32572]: pgmap v1538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:31.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:30 smithi110 ceph-mon[28069]: pgmap v1538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:30 smithi193 ceph-mon[32782]: pgmap v1538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1826.782639 secs 2024-04-26T12:18:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1826.782639 secs 2024-04-26T12:18:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1826.782639 secs 2024-04-26T12:18:33.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:32 smithi196 ceph-mon[32572]: pgmap v1539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:32 smithi110 ceph-mon[28069]: pgmap v1539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:32 smithi193 ceph-mon[32782]: pgmap v1539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:35.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:34 smithi196 ceph-mon[32572]: pgmap v1540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:35.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:34 smithi110 ceph-mon[28069]: pgmap v1540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:34 smithi193 ceph-mon[32782]: pgmap v1540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:36 smithi196 ceph-mon[32572]: pgmap v1541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:37.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1831.782730 secs 2024-04-26T12:18:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:36 smithi110 ceph-mon[28069]: pgmap v1541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1831.782730 secs 2024-04-26T12:18:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:36 smithi193 ceph-mon[32782]: pgmap v1541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1831.782730 secs 2024-04-26T12:18:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:38 smithi196 ceph-mon[32572]: pgmap v1542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:38 smithi110 ceph-mon[28069]: pgmap v1542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:38 smithi193 ceph-mon[32782]: pgmap v1542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:41.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:40 smithi196 ceph-mon[32572]: pgmap v1543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:40 smithi110 ceph-mon[28069]: pgmap v1543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:40 smithi193 ceph-mon[32782]: pgmap v1543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1836.782844 secs 2024-04-26T12:18:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1836.782844 secs 2024-04-26T12:18:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1836.782844 secs 2024-04-26T12:18:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:43 smithi110 ceph-mon[28069]: pgmap v1544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:43 smithi193 ceph-mon[32782]: pgmap v1544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:43 smithi196 ceph-mon[32572]: pgmap v1544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:45 smithi110 ceph-mon[28069]: pgmap v1545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:45 smithi193 ceph-mon[32782]: pgmap v1545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:45 smithi196 ceph-mon[32572]: pgmap v1545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:46 smithi110 ceph-mon[28069]: pgmap v1546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:46 smithi193 ceph-mon[32782]: pgmap v1546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:46 smithi196 ceph-mon[32572]: pgmap v1546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1841.782941 secs 2024-04-26T12:18:47.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1841.782941 secs 2024-04-26T12:18:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1841.782941 secs 2024-04-26T12:18:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:48 smithi110 ceph-mon[28069]: pgmap v1547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:48 smithi193 ceph-mon[32782]: pgmap v1547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:48 smithi196 ceph-mon[32572]: pgmap v1547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:50 smithi110 ceph-mon[28069]: pgmap v1548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:50 smithi193 ceph-mon[32782]: pgmap v1548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:50 smithi196 ceph-mon[32572]: pgmap v1548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1846.783059 secs 2024-04-26T12:18:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:52 smithi110 ceph-mon[28069]: pgmap v1549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1846.783059 secs 2024-04-26T12:18:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:52 smithi193 ceph-mon[32782]: pgmap v1549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1846.783059 secs 2024-04-26T12:18:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:52 smithi196 ceph-mon[32572]: pgmap v1549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:18:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:54 smithi110 ceph-mon[28069]: pgmap v1550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:18:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:54 smithi193 ceph-mon[32782]: pgmap v1550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:18:54.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:54 smithi196 ceph-mon[32572]: pgmap v1550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:18:54.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:18:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:18:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:18:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:55 smithi110 ceph-mon[28069]: pgmap v1551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 892 B/s rd, 1 op/s 2024-04-26T12:18:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:55 smithi110 ceph-mon[28069]: pgmap v1552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:18:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:18:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:18:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:18:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:55 smithi193 ceph-mon[32782]: pgmap v1551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 892 B/s rd, 1 op/s 2024-04-26T12:18:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:55 smithi193 ceph-mon[32782]: pgmap v1552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:18:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:18:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:18:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:18:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:55 smithi196 ceph-mon[32572]: pgmap v1551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 892 B/s rd, 1 op/s 2024-04-26T12:18:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:55 smithi196 ceph-mon[32572]: pgmap v1552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:18:55.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:18:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1851.783177 secs 2024-04-26T12:18:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1851.783177 secs 2024-04-26T12:18:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1851.783177 secs 2024-04-26T12:18:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:57 smithi110 ceph-mon[28069]: pgmap v1553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:18:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:57 smithi193 ceph-mon[32782]: pgmap v1553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:18:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:57 smithi196 ceph-mon[32572]: pgmap v1553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:18:59 smithi196 ceph-mon[32572]: pgmap v1554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:18:59 smithi110 ceph-mon[28069]: pgmap v1554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:18:59 smithi193 ceph-mon[32782]: pgmap v1554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:01.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:19:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:19:01.174+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:19:01.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:19:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:19:01.174+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:19:01.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:19:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:19:01.174+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:19:01.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:19:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:19:01.174+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:19:01.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:19:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:19:01.174+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:19:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:01 smithi196 ceph-mon[32572]: pgmap v1555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1856.783318 secs 2024-04-26T12:19:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:01 smithi110 ceph-mon[28069]: pgmap v1555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1856.783318 secs 2024-04-26T12:19:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:01 smithi193 ceph-mon[32782]: pgmap v1555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1856.783318 secs 2024-04-26T12:19:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:03 smithi110 ceph-mon[28069]: pgmap v1556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:03 smithi193 ceph-mon[32782]: pgmap v1556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:03 smithi196 ceph-mon[32572]: pgmap v1556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:19:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:05 smithi110 ceph-mon[28069]: pgmap v1557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:19:06.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:05 smithi196 ceph-mon[32572]: pgmap v1557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:19:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:05 smithi193 ceph-mon[32782]: pgmap v1557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:19:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1861.783444 secs 2024-04-26T12:19:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1861.783444 secs 2024-04-26T12:19:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1861.783444 secs 2024-04-26T12:19:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:07 smithi110 ceph-mon[28069]: pgmap v1558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:07 smithi193 ceph-mon[32782]: pgmap v1558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:07 smithi196 ceph-mon[32572]: pgmap v1558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:10.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:09 smithi110 ceph-mon[28069]: pgmap v1559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:09 smithi193 ceph-mon[32782]: pgmap v1559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:10.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:09 smithi196 ceph-mon[32572]: pgmap v1559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:11 smithi110 ceph-mon[28069]: pgmap v1560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1866.783586 secs 2024-04-26T12:19:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:11 smithi193 ceph-mon[32782]: pgmap v1560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:12.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1866.783586 secs 2024-04-26T12:19:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:11 smithi196 ceph-mon[32572]: pgmap v1560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1866.783586 secs 2024-04-26T12:19:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:13 smithi110 ceph-mon[28069]: pgmap v1561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:13 smithi193 ceph-mon[32782]: pgmap v1561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:14.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:13 smithi196 ceph-mon[32572]: pgmap v1561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:15 smithi193 ceph-mon[32782]: pgmap v1562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:16.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:15 smithi196 ceph-mon[32572]: pgmap v1562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:15 smithi110 ceph-mon[28069]: pgmap v1562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1871.783612 secs 2024-04-26T12:19:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1871.783612 secs 2024-04-26T12:19:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1871.783612 secs 2024-04-26T12:19:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:17 smithi193 ceph-mon[32782]: pgmap v1563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:17 smithi196 ceph-mon[32572]: pgmap v1563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:17 smithi110 ceph-mon[28069]: pgmap v1563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:19 smithi193 ceph-mon[32782]: pgmap v1564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:19 smithi196 ceph-mon[32572]: pgmap v1564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:20.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:19 smithi110 ceph-mon[28069]: pgmap v1564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:21 smithi193 ceph-mon[32782]: pgmap v1565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1876.783690 secs 2024-04-26T12:19:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:21 smithi196 ceph-mon[32572]: pgmap v1565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1876.783690 secs 2024-04-26T12:19:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:21 smithi110 ceph-mon[28069]: pgmap v1565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1876.783690 secs 2024-04-26T12:19:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:23 smithi193 ceph-mon[32782]: pgmap v1566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:24.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:23 smithi196 ceph-mon[32572]: pgmap v1566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:23 smithi110 ceph-mon[28069]: pgmap v1566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:25 smithi193 ceph-mon[32782]: pgmap v1567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:25 smithi196 ceph-mon[32572]: pgmap v1567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:25 smithi110 ceph-mon[28069]: pgmap v1567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1881.783769 secs 2024-04-26T12:19:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1881.783769 secs 2024-04-26T12:19:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1881.783769 secs 2024-04-26T12:19:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:27 smithi193 ceph-mon[32782]: pgmap v1568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:27 smithi196 ceph-mon[32572]: pgmap v1568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:27 smithi110 ceph-mon[28069]: pgmap v1568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:29 smithi193 ceph-mon[32782]: pgmap v1569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:30.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:29 smithi196 ceph-mon[32572]: pgmap v1569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:29 smithi110 ceph-mon[28069]: pgmap v1569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:31 smithi193 ceph-mon[32782]: pgmap v1570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1886.783886 secs 2024-04-26T12:19:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:31 smithi196 ceph-mon[32572]: pgmap v1570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1886.783886 secs 2024-04-26T12:19:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:31 smithi110 ceph-mon[28069]: pgmap v1570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1886.783886 secs 2024-04-26T12:19:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:33 smithi193 ceph-mon[32782]: pgmap v1571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:34.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:33 smithi196 ceph-mon[32572]: pgmap v1571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:33 smithi110 ceph-mon[28069]: pgmap v1571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:35 smithi196 ceph-mon[32572]: pgmap v1572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:35 smithi110 ceph-mon[28069]: pgmap v1572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:35 smithi193 ceph-mon[32782]: pgmap v1572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:37.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1891.784003 secs 2024-04-26T12:19:37.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1891.784003 secs 2024-04-26T12:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1891.784003 secs 2024-04-26T12:19:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:37 smithi196 ceph-mon[32572]: pgmap v1573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:37 smithi110 ceph-mon[28069]: pgmap v1573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:37 smithi193 ceph-mon[32782]: pgmap v1573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:39 smithi196 ceph-mon[32572]: pgmap v1574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:39 smithi110 ceph-mon[28069]: pgmap v1574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:39 smithi193 ceph-mon[32782]: pgmap v1574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:41 smithi196 ceph-mon[32572]: pgmap v1575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1896.784121 secs 2024-04-26T12:19:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:41 smithi110 ceph-mon[28069]: pgmap v1575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1896.784121 secs 2024-04-26T12:19:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:41 smithi193 ceph-mon[32782]: pgmap v1575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1896.784121 secs 2024-04-26T12:19:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:43 smithi196 ceph-mon[32572]: pgmap v1576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:43 smithi110 ceph-mon[28069]: pgmap v1576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:43 smithi193 ceph-mon[32782]: pgmap v1576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:45 smithi196 ceph-mon[32572]: pgmap v1577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:45 smithi110 ceph-mon[28069]: pgmap v1577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:45 smithi193 ceph-mon[32782]: pgmap v1577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:47.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1901.784237 secs 2024-04-26T12:19:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1901.784237 secs 2024-04-26T12:19:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1901.784237 secs 2024-04-26T12:19:48.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:47 smithi196 ceph-mon[32572]: pgmap v1578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:47 smithi110 ceph-mon[28069]: pgmap v1578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:47 smithi193 ceph-mon[32782]: pgmap v1578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:50.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:49 smithi196 ceph-mon[32572]: pgmap v1579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:50.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:49 smithi110 ceph-mon[28069]: pgmap v1579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:49 smithi193 ceph-mon[32782]: pgmap v1579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:51 smithi196 ceph-mon[32572]: pgmap v1580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1906.784372 secs 2024-04-26T12:19:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:51 smithi110 ceph-mon[28069]: pgmap v1580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1906.784372 secs 2024-04-26T12:19:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:51 smithi193 ceph-mon[32782]: pgmap v1580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1906.784372 secs 2024-04-26T12:19:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:53 smithi196 ceph-mon[32572]: pgmap v1581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:53 smithi110 ceph-mon[28069]: pgmap v1581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:53 smithi193 ceph-mon[32782]: pgmap v1581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:19:56.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:55 smithi196 ceph-mon[32572]: pgmap v1582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:56.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:19:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:55 smithi110 ceph-mon[28069]: pgmap v1582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:19:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:55 smithi193 ceph-mon[32782]: pgmap v1582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:19:56.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:19:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1911.784522 secs 2024-04-26T12:19:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:19:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:19:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:19:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1911.784522 secs 2024-04-26T12:19:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:19:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:19:57.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:19:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1911.784522 secs 2024-04-26T12:19:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:19:57.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:19:57.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:19:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:57 smithi196 ceph-mon[32572]: pgmap v1583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:19:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:57 smithi196 ceph-mon[32572]: pgmap v1584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:19:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:57 smithi110 ceph-mon[28069]: pgmap v1583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:19:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:57 smithi110 ceph-mon[28069]: pgmap v1584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:19:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:57 smithi193 ceph-mon[32782]: pgmap v1583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:19:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:57 smithi193 ceph-mon[32782]: pgmap v1584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:19:59 smithi196 ceph-mon[32572]: pgmap v1585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:00.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:19:59 smithi110 ceph-mon[28069]: pgmap v1585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:19:59 smithi193 ceph-mon[32782]: pgmap v1585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:20:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:20:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:20:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:01 smithi196 ceph-mon[32572]: pgmap v1586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1916.784641 secs 2024-04-26T12:20:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:01 smithi110 ceph-mon[28069]: pgmap v1586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1916.784641 secs 2024-04-26T12:20:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:01 smithi193 ceph-mon[32782]: pgmap v1586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1916.784641 secs 2024-04-26T12:20:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:03 smithi196 ceph-mon[32572]: pgmap v1587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:20:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:03 smithi110 ceph-mon[28069]: pgmap v1587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:20:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:03 smithi193 ceph-mon[32782]: pgmap v1587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:20:06.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:05 smithi196 ceph-mon[32572]: pgmap v1588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:05 smithi110 ceph-mon[28069]: pgmap v1588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:05 smithi193 ceph-mon[32782]: pgmap v1588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:20:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1921.784759 secs 2024-04-26T12:20:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1921.784759 secs 2024-04-26T12:20:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1921.784759 secs 2024-04-26T12:20:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:07 smithi196 ceph-mon[32572]: pgmap v1589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:20:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:07 smithi110 ceph-mon[28069]: pgmap v1589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:20:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:07 smithi193 ceph-mon[32782]: pgmap v1589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:20:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:09 smithi196 ceph-mon[32572]: pgmap v1590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:10.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:09 smithi110 ceph-mon[28069]: pgmap v1590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:09 smithi193 ceph-mon[32782]: pgmap v1590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:12 smithi196 ceph-mon[32572]: pgmap v1591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1926.784887 secs 2024-04-26T12:20:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:12 smithi110 ceph-mon[28069]: pgmap v1591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1926.784887 secs 2024-04-26T12:20:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:12 smithi193 ceph-mon[32782]: pgmap v1591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1926.784887 secs 2024-04-26T12:20:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:14 smithi110 ceph-mon[28069]: pgmap v1592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:14 smithi193 ceph-mon[32782]: pgmap v1592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:14 smithi196 ceph-mon[32572]: pgmap v1592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:16 smithi110 ceph-mon[28069]: pgmap v1593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:16 smithi193 ceph-mon[32782]: pgmap v1593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:16 smithi196 ceph-mon[32572]: pgmap v1593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1931.784988 secs 2024-04-26T12:20:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1931.784988 secs 2024-04-26T12:20:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1931.784988 secs 2024-04-26T12:20:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:18 smithi110 ceph-mon[28069]: pgmap v1594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:18 smithi193 ceph-mon[32782]: pgmap v1594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:18.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:18 smithi196 ceph-mon[32572]: pgmap v1594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:20.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:20 smithi110 ceph-mon[28069]: pgmap v1595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:20 smithi193 ceph-mon[32782]: pgmap v1595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:20 smithi196 ceph-mon[32572]: pgmap v1595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:21 smithi110 ceph-mon[28069]: pgmap v1596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:21 smithi193 ceph-mon[32782]: pgmap v1596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:21 smithi196 ceph-mon[32572]: pgmap v1596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1936.785089 secs 2024-04-26T12:20:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1936.785089 secs 2024-04-26T12:20:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1936.785089 secs 2024-04-26T12:20:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:23 smithi193 ceph-mon[32782]: pgmap v1597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:23 smithi196 ceph-mon[32572]: pgmap v1597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:23 smithi110 ceph-mon[28069]: pgmap v1597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:25 smithi193 ceph-mon[32782]: pgmap v1598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:25 smithi196 ceph-mon[32572]: pgmap v1598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:25.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:25 smithi110 ceph-mon[28069]: pgmap v1598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1941.785206 secs 2024-04-26T12:20:27.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:27 smithi193 ceph-mon[32782]: pgmap v1599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1941.785206 secs 2024-04-26T12:20:27.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:27 smithi196 ceph-mon[32572]: pgmap v1599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1941.785206 secs 2024-04-26T12:20:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:27 smithi110 ceph-mon[28069]: pgmap v1599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:29 smithi193 ceph-mon[32782]: pgmap v1600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:29.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:29 smithi196 ceph-mon[32572]: pgmap v1600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:29 smithi110 ceph-mon[28069]: pgmap v1600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:31 smithi193 ceph-mon[32782]: pgmap v1601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:31 smithi196 ceph-mon[32572]: pgmap v1601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:31 smithi110 ceph-mon[28069]: pgmap v1601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1946.785340 secs 2024-04-26T12:20:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1946.785340 secs 2024-04-26T12:20:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1946.785340 secs 2024-04-26T12:20:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:33 smithi193 ceph-mon[32782]: pgmap v1602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:33.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:33 smithi196 ceph-mon[32572]: pgmap v1602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:33 smithi110 ceph-mon[28069]: pgmap v1602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:35 smithi193 ceph-mon[32782]: pgmap v1603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:35.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:35 smithi196 ceph-mon[32572]: pgmap v1603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:35 smithi110 ceph-mon[28069]: pgmap v1603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1951.785410 secs 2024-04-26T12:20:37.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:37 smithi193 ceph-mon[32782]: pgmap v1604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1951.785410 secs 2024-04-26T12:20:37.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:37 smithi196 ceph-mon[32572]: pgmap v1604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1951.785410 secs 2024-04-26T12:20:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:37 smithi110 ceph-mon[28069]: pgmap v1604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:39 smithi193 ceph-mon[32782]: pgmap v1605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:39 smithi196 ceph-mon[32572]: pgmap v1605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:39 smithi110 ceph-mon[28069]: pgmap v1605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:41.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:41 smithi193 ceph-mon[32782]: pgmap v1606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:41 smithi196 ceph-mon[32572]: pgmap v1606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:41 smithi110 ceph-mon[28069]: pgmap v1606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1956.785528 secs 2024-04-26T12:20:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1956.785528 secs 2024-04-26T12:20:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1956.785528 secs 2024-04-26T12:20:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:43 smithi196 ceph-mon[32572]: pgmap v1607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:43.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:43 smithi110 ceph-mon[28069]: pgmap v1607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:43 smithi193 ceph-mon[32782]: pgmap v1607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:45 smithi196 ceph-mon[32572]: pgmap v1608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:45 smithi110 ceph-mon[28069]: pgmap v1608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:45 smithi193 ceph-mon[32782]: pgmap v1608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1961.785650 secs 2024-04-26T12:20:47.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:47 smithi196 ceph-mon[32572]: pgmap v1609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1961.785650 secs 2024-04-26T12:20:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:47 smithi110 ceph-mon[28069]: pgmap v1609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1961.785650 secs 2024-04-26T12:20:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:47 smithi193 ceph-mon[32782]: pgmap v1609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:49 smithi196 ceph-mon[32572]: pgmap v1610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:49 smithi110 ceph-mon[28069]: pgmap v1610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:49.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:49 smithi193 ceph-mon[32782]: pgmap v1610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:51.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:51 smithi196 ceph-mon[32572]: pgmap v1611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:51.796 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:51 smithi110 ceph-mon[28069]: pgmap v1611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:51 smithi193 ceph-mon[32782]: pgmap v1611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1966.785766 secs 2024-04-26T12:20:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1966.785766 secs 2024-04-26T12:20:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1966.785766 secs 2024-04-26T12:20:53.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:53 smithi196 ceph-mon[32572]: pgmap v1612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:53 smithi110 ceph-mon[28069]: pgmap v1612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:53 smithi193 ceph-mon[32782]: pgmap v1612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:55.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:55 smithi193 ceph-mon[32782]: pgmap v1613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:55 smithi196 ceph-mon[32572]: pgmap v1613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:55 smithi110 ceph-mon[28069]: pgmap v1613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1971.785884 secs 2024-04-26T12:20:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:57 smithi196 ceph-mon[32572]: pgmap v1614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:20:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:20:57.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:20:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1971.785884 secs 2024-04-26T12:20:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:57 smithi110 ceph-mon[28069]: pgmap v1614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:20:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:20:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:20:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1971.785884 secs 2024-04-26T12:20:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:57 smithi193 ceph-mon[32782]: pgmap v1614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:20:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:20:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:20:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:20:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:59 smithi196 ceph-mon[32572]: pgmap v1615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:20:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:20:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:59 smithi196 ceph-mon[32572]: pgmap v1616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 B/s rd, 1 op/s 2024-04-26T12:20:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:59 smithi196 ceph-mon[32572]: pgmap v1617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:59.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:20:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:20:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:59 smithi110 ceph-mon[28069]: pgmap v1615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:20:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:20:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:59 smithi110 ceph-mon[28069]: pgmap v1616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 B/s rd, 1 op/s 2024-04-26T12:20:59.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:59 smithi110 ceph-mon[28069]: pgmap v1617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:59.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:20:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:20:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:59 smithi193 ceph-mon[32782]: pgmap v1615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:20:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:20:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:59 smithi193 ceph-mon[32782]: pgmap v1616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 B/s rd, 1 op/s 2024-04-26T12:20:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:59 smithi193 ceph-mon[32782]: pgmap v1617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:20:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:20:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:21:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:01 smithi110 ceph-mon[28069]: pgmap v1618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1976.785949 secs 2024-04-26T12:21:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:01 smithi193 ceph-mon[32782]: pgmap v1618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1976.785949 secs 2024-04-26T12:21:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:01 smithi196 ceph-mon[32572]: pgmap v1618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1976.785949 secs 2024-04-26T12:21:03.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:03 smithi110 ceph-mon[28069]: pgmap v1619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:03 smithi193 ceph-mon[32782]: pgmap v1619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:03 smithi196 ceph-mon[32572]: pgmap v1619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:05 smithi110 ceph-mon[28069]: pgmap v1620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:05 smithi193 ceph-mon[32782]: pgmap v1620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:05 smithi196 ceph-mon[32572]: pgmap v1620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1981.786072 secs 2024-04-26T12:21:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1981.786072 secs 2024-04-26T12:21:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1981.786072 secs 2024-04-26T12:21:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:07 smithi110 ceph-mon[28069]: pgmap v1621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 625 B/s rd, 1 op/s 2024-04-26T12:21:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:07 smithi193 ceph-mon[32782]: pgmap v1621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 625 B/s rd, 1 op/s 2024-04-26T12:21:07.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:07 smithi196 ceph-mon[32572]: pgmap v1621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 625 B/s rd, 1 op/s 2024-04-26T12:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:09 smithi193 ceph-mon[32782]: pgmap v1622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:21:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:09 smithi196 ceph-mon[32572]: pgmap v1622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:21:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:09 smithi110 ceph-mon[28069]: pgmap v1622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:11 smithi193 ceph-mon[32782]: pgmap v1623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1986.786191 secs 2024-04-26T12:21:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:11 smithi196 ceph-mon[32572]: pgmap v1623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1986.786191 secs 2024-04-26T12:21:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:11 smithi110 ceph-mon[28069]: pgmap v1623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1986.786191 secs 2024-04-26T12:21:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:13 smithi193 ceph-mon[32782]: pgmap v1624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:14.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:13 smithi196 ceph-mon[32572]: pgmap v1624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:13 smithi110 ceph-mon[28069]: pgmap v1624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:15 smithi193 ceph-mon[32782]: pgmap v1625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:16.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:15 smithi196 ceph-mon[32572]: pgmap v1625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:15 smithi110 ceph-mon[28069]: pgmap v1625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:21:16.664+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:21:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:21:16.666+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 19 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:21:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:21:16.666+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006180 con 0x7f261c104b50 2024-04-26T12:21:16.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:21:16.667+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 20 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006180 con 0x7f261c104b50 2024-04-26T12:21:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:21:16.668+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:21:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:21:16.668+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 19 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:21:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:21:16.669+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:21:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:21:16.669+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 20 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:21:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1991.786309 secs 2024-04-26T12:21:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1991.786309 secs 2024-04-26T12:21:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1991.786309 secs 2024-04-26T12:21:17.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:17 smithi193 ceph-mon[32782]: pgmap v1626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:17 smithi196 ceph-mon[32572]: pgmap v1626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:17 smithi110 ceph-mon[28069]: pgmap v1626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:19.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:19 smithi193 ceph-mon[32782]: pgmap v1627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:20.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:19 smithi196 ceph-mon[32572]: pgmap v1627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:19 smithi110 ceph-mon[28069]: pgmap v1627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:21 smithi193 ceph-mon[32782]: pgmap v1628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 1996.786425 secs 2024-04-26T12:21:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:21 smithi196 ceph-mon[32572]: pgmap v1628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 1996.786425 secs 2024-04-26T12:21:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:21 smithi110 ceph-mon[28069]: pgmap v1628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 1996.786425 secs 2024-04-26T12:21:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:23 smithi193 ceph-mon[32782]: pgmap v1629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:23 smithi196 ceph-mon[32572]: pgmap v1629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:23 smithi110 ceph-mon[28069]: pgmap v1629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:25 smithi193 ceph-mon[32782]: pgmap v1630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:25 smithi196 ceph-mon[32572]: pgmap v1630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:25 smithi110 ceph-mon[28069]: pgmap v1630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:26.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2001.786522 secs 2024-04-26T12:21:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2001.786522 secs 2024-04-26T12:21:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2001.786522 secs 2024-04-26T12:21:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:27 smithi193 ceph-mon[32782]: pgmap v1631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:28.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:27 smithi196 ceph-mon[32572]: pgmap v1631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:27 smithi110 ceph-mon[28069]: pgmap v1631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:29 smithi193 ceph-mon[32782]: pgmap v1632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:29 smithi196 ceph-mon[32572]: pgmap v1632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:29 smithi110 ceph-mon[28069]: pgmap v1632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:31 smithi193 ceph-mon[32782]: pgmap v1633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2006.786618 secs 2024-04-26T12:21:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:31 smithi196 ceph-mon[32572]: pgmap v1633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2006.786618 secs 2024-04-26T12:21:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:31 smithi110 ceph-mon[28069]: pgmap v1633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2006.786618 secs 2024-04-26T12:21:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:33 smithi193 ceph-mon[32782]: pgmap v1634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:33 smithi196 ceph-mon[32572]: pgmap v1634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:33 smithi110 ceph-mon[28069]: pgmap v1634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:35 smithi196 ceph-mon[32572]: pgmap v1635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:35 smithi110 ceph-mon[28069]: pgmap v1635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:35 smithi193 ceph-mon[32782]: pgmap v1635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:37.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2011.786737 secs 2024-04-26T12:21:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2011.786737 secs 2024-04-26T12:21:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2011.786737 secs 2024-04-26T12:21:37.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:37 smithi196 ceph-mon[32572]: pgmap v1636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:37.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:37 smithi110 ceph-mon[28069]: pgmap v1636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:37 smithi193 ceph-mon[32782]: pgmap v1636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:40.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:39 smithi196 ceph-mon[32572]: pgmap v1637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:39 smithi110 ceph-mon[28069]: pgmap v1637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:39 smithi193 ceph-mon[32782]: pgmap v1637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:41 smithi196 ceph-mon[32572]: pgmap v1638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2016.786855 secs 2024-04-26T12:21:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:41 smithi110 ceph-mon[28069]: pgmap v1638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2016.786855 secs 2024-04-26T12:21:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:41 smithi193 ceph-mon[32782]: pgmap v1638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2016.786855 secs 2024-04-26T12:21:44.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:43 smithi196 ceph-mon[32572]: pgmap v1639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:43 smithi110 ceph-mon[28069]: pgmap v1639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:43 smithi193 ceph-mon[32782]: pgmap v1639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:45 smithi196 ceph-mon[32572]: pgmap v1640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:45 smithi110 ceph-mon[28069]: pgmap v1640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:45 smithi193 ceph-mon[32782]: pgmap v1640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2021.786988 secs 2024-04-26T12:21:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2021.786988 secs 2024-04-26T12:21:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2021.786988 secs 2024-04-26T12:21:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:47 smithi196 ceph-mon[32572]: pgmap v1641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:47 smithi110 ceph-mon[28069]: pgmap v1641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:47 smithi193 ceph-mon[32782]: pgmap v1641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:50.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:49 smithi196 ceph-mon[32572]: pgmap v1642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:49 smithi110 ceph-mon[28069]: pgmap v1642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:49 smithi193 ceph-mon[32782]: pgmap v1642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:51 smithi196 ceph-mon[32572]: pgmap v1643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2026.787108 secs 2024-04-26T12:21:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:51 smithi110 ceph-mon[28069]: pgmap v1643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2026.787108 secs 2024-04-26T12:21:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:51 smithi193 ceph-mon[32782]: pgmap v1643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2026.787108 secs 2024-04-26T12:21:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:53 smithi196 ceph-mon[32572]: pgmap v1644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:53 smithi110 ceph-mon[28069]: pgmap v1644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:53 smithi193 ceph-mon[32782]: pgmap v1644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:21:56.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:55 smithi196 ceph-mon[32572]: pgmap v1645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:56.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:55 smithi110 ceph-mon[28069]: pgmap v1645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:56.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:55 smithi193 ceph-mon[32782]: pgmap v1645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2031.787230 secs 2024-04-26T12:21:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2031.787230 secs 2024-04-26T12:21:57.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2031.787230 secs 2024-04-26T12:21:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:57 smithi196 ceph-mon[32572]: pgmap v1646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:57 smithi110 ceph-mon[28069]: pgmap v1646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:21:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:57 smithi193 ceph-mon[32782]: pgmap v1646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:59 smithi196 ceph-mon[32572]: pgmap v1647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:59 smithi110 ceph-mon[28069]: pgmap v1647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:59 smithi193 ceph-mon[32782]: pgmap v1647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:22:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:22:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:22:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:22:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:22:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:22:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:22:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:01 smithi196 ceph-mon[32572]: pgmap v1648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T12:22:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:01 smithi196 ceph-mon[32572]: pgmap v1649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2036.787349 secs 2024-04-26T12:22:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:01 smithi110 ceph-mon[28069]: pgmap v1648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T12:22:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:01 smithi110 ceph-mon[28069]: pgmap v1649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2036.787349 secs 2024-04-26T12:22:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:01 smithi193 ceph-mon[32782]: pgmap v1648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T12:22:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:01 smithi193 ceph-mon[32782]: pgmap v1649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2036.787349 secs 2024-04-26T12:22:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:03 smithi196 ceph-mon[32572]: pgmap v1650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T12:22:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:03 smithi110 ceph-mon[28069]: pgmap v1650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T12:22:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:03 smithi193 ceph-mon[32782]: pgmap v1650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T12:22:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:05 smithi196 ceph-mon[32572]: pgmap v1651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:05 smithi110 ceph-mon[28069]: pgmap v1651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:05 smithi193 ceph-mon[32782]: pgmap v1651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2041.787413 secs 2024-04-26T12:22:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2041.787413 secs 2024-04-26T12:22:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2041.787413 secs 2024-04-26T12:22:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:07 smithi196 ceph-mon[32572]: pgmap v1652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:07 smithi110 ceph-mon[28069]: pgmap v1652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:07 smithi193 ceph-mon[32782]: pgmap v1652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:10.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:09 smithi196 ceph-mon[32572]: pgmap v1653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:09 smithi110 ceph-mon[28069]: pgmap v1653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:09 smithi193 ceph-mon[32782]: pgmap v1653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:22:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:11 smithi196 ceph-mon[32572]: pgmap v1654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:22:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2046.787541 secs 2024-04-26T12:22:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:11 smithi110 ceph-mon[28069]: pgmap v1654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:22:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2046.787541 secs 2024-04-26T12:22:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:11 smithi193 ceph-mon[32782]: pgmap v1654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:22:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2046.787541 secs 2024-04-26T12:22:14.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:13 smithi110 ceph-mon[28069]: pgmap v1655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:13 smithi193 ceph-mon[32782]: pgmap v1655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:13 smithi196 ceph-mon[32572]: pgmap v1655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:15 smithi110 ceph-mon[28069]: pgmap v1656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:15 smithi193 ceph-mon[32782]: pgmap v1656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:15 smithi196 ceph-mon[32572]: pgmap v1656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2051.787658 secs 2024-04-26T12:22:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2051.787658 secs 2024-04-26T12:22:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2051.787658 secs 2024-04-26T12:22:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:17 smithi110 ceph-mon[28069]: pgmap v1657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:17 smithi193 ceph-mon[32782]: pgmap v1657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:18.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:17 smithi196 ceph-mon[32572]: pgmap v1657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:19 smithi110 ceph-mon[28069]: pgmap v1658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:19 smithi193 ceph-mon[32782]: pgmap v1658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:19 smithi196 ceph-mon[32572]: pgmap v1658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:21 smithi110 ceph-mon[28069]: pgmap v1659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2056.787777 secs 2024-04-26T12:22:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:21 smithi193 ceph-mon[32782]: pgmap v1659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2056.787777 secs 2024-04-26T12:22:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:21 smithi196 ceph-mon[32572]: pgmap v1659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2056.787777 secs 2024-04-26T12:22:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:23 smithi110 ceph-mon[28069]: pgmap v1660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:23 smithi193 ceph-mon[32782]: pgmap v1660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:24.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:23 smithi196 ceph-mon[32572]: pgmap v1660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:25 smithi193 ceph-mon[32782]: pgmap v1661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:26.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:25 smithi196 ceph-mon[32572]: pgmap v1661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:25 smithi110 ceph-mon[28069]: pgmap v1661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2061.787907 secs 2024-04-26T12:22:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2061.787907 secs 2024-04-26T12:22:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2061.787907 secs 2024-04-26T12:22:28.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:27 smithi193 ceph-mon[32782]: pgmap v1662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:27 smithi196 ceph-mon[32572]: pgmap v1662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:27 smithi110 ceph-mon[28069]: pgmap v1662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:29 smithi193 ceph-mon[32782]: pgmap v1663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:29 smithi196 ceph-mon[32572]: pgmap v1663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:29 smithi110 ceph-mon[28069]: pgmap v1663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:31 smithi193 ceph-mon[32782]: pgmap v1664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2066.788019 secs 2024-04-26T12:22:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:31 smithi196 ceph-mon[32572]: pgmap v1664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2066.788019 secs 2024-04-26T12:22:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:31 smithi110 ceph-mon[28069]: pgmap v1664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2066.788019 secs 2024-04-26T12:22:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:33 smithi193 ceph-mon[32782]: pgmap v1665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:34.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:33 smithi196 ceph-mon[32572]: pgmap v1665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:33 smithi110 ceph-mon[28069]: pgmap v1665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:35 smithi193 ceph-mon[32782]: pgmap v1666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:36.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:35 smithi196 ceph-mon[32572]: pgmap v1666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:36.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:35 smithi110 ceph-mon[28069]: pgmap v1666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2071.788136 secs 2024-04-26T12:22:37.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2071.788136 secs 2024-04-26T12:22:37.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2071.788136 secs 2024-04-26T12:22:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:37 smithi193 ceph-mon[32782]: pgmap v1667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:37 smithi196 ceph-mon[32572]: pgmap v1667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:37 smithi110 ceph-mon[28069]: pgmap v1667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:39 smithi193 ceph-mon[32782]: pgmap v1668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:39 smithi196 ceph-mon[32572]: pgmap v1668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:39 smithi110 ceph-mon[28069]: pgmap v1668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:41 smithi193 ceph-mon[32782]: pgmap v1669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2076.788254 secs 2024-04-26T12:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:41 smithi196 ceph-mon[32572]: pgmap v1669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2076.788254 secs 2024-04-26T12:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:41 smithi110 ceph-mon[28069]: pgmap v1669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2076.788254 secs 2024-04-26T12:22:44.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:43 smithi193 ceph-mon[32782]: pgmap v1670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:43 smithi196 ceph-mon[32572]: pgmap v1670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:43 smithi110 ceph-mon[28069]: pgmap v1670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:45 smithi193 ceph-mon[32782]: pgmap v1671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:45 smithi196 ceph-mon[32572]: pgmap v1671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:45 smithi110 ceph-mon[28069]: pgmap v1671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2081.788393 secs 2024-04-26T12:22:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2081.788393 secs 2024-04-26T12:22:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2081.788393 secs 2024-04-26T12:22:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:47 smithi196 ceph-mon[32572]: pgmap v1672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:47 smithi110 ceph-mon[28069]: pgmap v1672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:47 smithi193 ceph-mon[32782]: pgmap v1672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:49 smithi196 ceph-mon[32572]: pgmap v1673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:50.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:49 smithi110 ceph-mon[28069]: pgmap v1673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:50.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:49 smithi193 ceph-mon[32782]: pgmap v1673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:51 smithi196 ceph-mon[32572]: pgmap v1674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2086.788521 secs 2024-04-26T12:22:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:51 smithi110 ceph-mon[28069]: pgmap v1674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2086.788521 secs 2024-04-26T12:22:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:51 smithi193 ceph-mon[32782]: pgmap v1674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2086.788521 secs 2024-04-26T12:22:54.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:53 smithi196 ceph-mon[32572]: pgmap v1675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:53 smithi110 ceph-mon[28069]: pgmap v1675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:53 smithi193 ceph-mon[32782]: pgmap v1675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:56.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:55 smithi193 ceph-mon[32782]: pgmap v1676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:56.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:55 smithi196 ceph-mon[32572]: pgmap v1676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:55 smithi110 ceph-mon[28069]: pgmap v1676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:22:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2091.788649 secs 2024-04-26T12:22:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2091.788649 secs 2024-04-26T12:22:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2091.788649 secs 2024-04-26T12:22:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:57 smithi196 ceph-mon[32572]: pgmap v1677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:57 smithi110 ceph-mon[28069]: pgmap v1677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:22:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:57 smithi193 ceph-mon[32782]: pgmap v1677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:22:59 smithi196 ceph-mon[32572]: pgmap v1678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:00.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:22:59 smithi110 ceph-mon[28069]: pgmap v1678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:22:59 smithi193 ceph-mon[32782]: pgmap v1678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:01.244 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:23:01.258 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:23:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:23:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:01 smithi110 ceph-mon[28069]: pgmap v1679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2096.788798 secs 2024-04-26T12:23:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:01 smithi196 ceph-mon[32572]: pgmap v1679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2096.788798 secs 2024-04-26T12:23:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:01 smithi193 ceph-mon[32782]: pgmap v1679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2096.788798 secs 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: pgmap v1680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:03.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: pgmap v1680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.008 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: pgmap v1680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:04.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:04.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:04.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:04.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.045 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.045 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:04 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:23:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:04 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:23:04.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:04 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:23:04.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:04 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:23:04.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:04.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:05.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:04 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:23:05.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:04 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:23:05.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:04 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:23:05.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:04 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:23:05.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:05.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:04 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:23:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:04 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:23:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:04 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:23:05.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:04 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:23:05.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:05.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:05 smithi193 ceph-mon[32782]: pgmap v1681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:05 smithi196 ceph-mon[32572]: pgmap v1681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:05 smithi110 ceph-mon[28069]: pgmap v1681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:06.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:06.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:06.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:06.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:06.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:06.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:06.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:06.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:06.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:23:06.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:23:06.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:23:06.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:23:06.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: pgmap v1682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s rd, 1 op/s 2024-04-26T12:23:06.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: pgmap v1683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:06.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:06.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2101.788945 secs 2024-04-26T12:23:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:23:07.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:23:07.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:23:07.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:23:07.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: pgmap v1682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s rd, 1 op/s 2024-04-26T12:23:07.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: pgmap v1683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:07.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:07.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2101.788945 secs 2024-04-26T12:23:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: pgmap v1682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s rd, 1 op/s 2024-04-26T12:23:07.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: pgmap v1683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:07.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:23:07.044 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2101.788945 secs 2024-04-26T12:23:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:08 smithi196 ceph-mon[32572]: pgmap v1684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:09.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:08 smithi110 ceph-mon[28069]: pgmap v1684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:08 smithi193 ceph-mon[32782]: pgmap v1684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:11.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:10 smithi196 ceph-mon[32572]: pgmap v1685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:10 smithi110 ceph-mon[28069]: pgmap v1685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:10 smithi193 ceph-mon[32782]: pgmap v1685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2106.789014 secs 2024-04-26T12:23:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2106.789014 secs 2024-04-26T12:23:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2106.789014 secs 2024-04-26T12:23:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:12 smithi196 ceph-mon[32572]: pgmap v1686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:12 smithi110 ceph-mon[28069]: pgmap v1686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:12 smithi193 ceph-mon[32782]: pgmap v1686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:15.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:14 smithi196 ceph-mon[32572]: pgmap v1687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:14 smithi110 ceph-mon[28069]: pgmap v1687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:14 smithi193 ceph-mon[32782]: pgmap v1687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:23:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:16 smithi196 ceph-mon[32572]: pgmap v1688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:23:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2111.789138 secs 2024-04-26T12:23:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:16 smithi110 ceph-mon[28069]: pgmap v1688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:23:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2111.789138 secs 2024-04-26T12:23:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:16 smithi193 ceph-mon[32782]: pgmap v1688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:23:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2111.789138 secs 2024-04-26T12:23:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:18 smithi196 ceph-mon[32572]: pgmap v1689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:18 smithi110 ceph-mon[28069]: pgmap v1689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:18 smithi193 ceph-mon[32782]: pgmap v1689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:21.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:20 smithi196 ceph-mon[32572]: pgmap v1690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:20 smithi110 ceph-mon[28069]: pgmap v1690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:20 smithi193 ceph-mon[32782]: pgmap v1690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2116.789262 secs 2024-04-26T12:23:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2116.789262 secs 2024-04-26T12:23:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2116.789262 secs 2024-04-26T12:23:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:22 smithi196 ceph-mon[32572]: pgmap v1691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:22 smithi110 ceph-mon[28069]: pgmap v1691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:22 smithi193 ceph-mon[32782]: pgmap v1691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:25.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:24 smithi196 ceph-mon[32572]: pgmap v1692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:24 smithi110 ceph-mon[28069]: pgmap v1692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:24 smithi193 ceph-mon[32782]: pgmap v1692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:26 smithi196 ceph-mon[32572]: pgmap v1693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2121.789385 secs 2024-04-26T12:23:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:26 smithi110 ceph-mon[28069]: pgmap v1693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2121.789385 secs 2024-04-26T12:23:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:26 smithi193 ceph-mon[32782]: pgmap v1693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2121.789385 secs 2024-04-26T12:23:29.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:28 smithi196 ceph-mon[32572]: pgmap v1694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:28 smithi110 ceph-mon[28069]: pgmap v1694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:28 smithi193 ceph-mon[32782]: pgmap v1694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:30 smithi196 ceph-mon[32572]: pgmap v1695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:31.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:30 smithi110 ceph-mon[28069]: pgmap v1695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:30 smithi193 ceph-mon[32782]: pgmap v1695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2126.789526 secs 2024-04-26T12:23:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2126.789526 secs 2024-04-26T12:23:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2126.789526 secs 2024-04-26T12:23:33.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:32 smithi196 ceph-mon[32572]: pgmap v1696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:32 smithi110 ceph-mon[28069]: pgmap v1696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:32 smithi193 ceph-mon[32782]: pgmap v1696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:34 smithi196 ceph-mon[32572]: pgmap v1697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:35.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:34 smithi110 ceph-mon[28069]: pgmap v1697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:34 smithi193 ceph-mon[32782]: pgmap v1697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:36 smithi196 ceph-mon[32572]: pgmap v1698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:37.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2131.789658 secs 2024-04-26T12:23:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:36 smithi110 ceph-mon[28069]: pgmap v1698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2131.789658 secs 2024-04-26T12:23:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:36 smithi193 ceph-mon[32782]: pgmap v1698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2131.789658 secs 2024-04-26T12:23:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:38 smithi196 ceph-mon[32572]: pgmap v1699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:38 smithi110 ceph-mon[28069]: pgmap v1699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:38 smithi193 ceph-mon[32782]: pgmap v1699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:40 smithi196 ceph-mon[32572]: pgmap v1700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:40 smithi110 ceph-mon[28069]: pgmap v1700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:40 smithi193 ceph-mon[32782]: pgmap v1700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2136.789790 secs 2024-04-26T12:23:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2136.789790 secs 2024-04-26T12:23:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2136.789790 secs 2024-04-26T12:23:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:43 smithi110 ceph-mon[28069]: pgmap v1701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:43 smithi193 ceph-mon[32782]: pgmap v1701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:43.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:43 smithi196 ceph-mon[32572]: pgmap v1701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:45 smithi110 ceph-mon[28069]: pgmap v1702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:45 smithi193 ceph-mon[32782]: pgmap v1702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:45 smithi196 ceph-mon[32572]: pgmap v1702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:47 smithi110 ceph-mon[28069]: pgmap v1703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2141.789901 secs 2024-04-26T12:23:47.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:47 smithi193 ceph-mon[32782]: pgmap v1703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:47.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2141.789901 secs 2024-04-26T12:23:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:47 smithi196 ceph-mon[32572]: pgmap v1703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2141.789901 secs 2024-04-26T12:23:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:49 smithi110 ceph-mon[28069]: pgmap v1704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:49 smithi193 ceph-mon[32782]: pgmap v1704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:49.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:49 smithi196 ceph-mon[32572]: pgmap v1704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:51 smithi110 ceph-mon[28069]: pgmap v1705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:51 smithi193 ceph-mon[32782]: pgmap v1705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:51 smithi196 ceph-mon[32572]: pgmap v1705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:52.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2146.790026 secs 2024-04-26T12:23:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2146.790026 secs 2024-04-26T12:23:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2146.790026 secs 2024-04-26T12:23:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:53 smithi193 ceph-mon[32782]: pgmap v1706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:53 smithi196 ceph-mon[32572]: pgmap v1706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:53.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:53 smithi110 ceph-mon[28069]: pgmap v1706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:55 smithi193 ceph-mon[32782]: pgmap v1707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:55.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:55 smithi196 ceph-mon[32572]: pgmap v1707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:55 smithi110 ceph-mon[28069]: pgmap v1707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:57 smithi193 ceph-mon[32782]: pgmap v1708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:57.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2151.790147 secs 2024-04-26T12:23:57.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:57 smithi196 ceph-mon[32572]: pgmap v1708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:57.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2151.790147 secs 2024-04-26T12:23:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:57 smithi110 ceph-mon[28069]: pgmap v1708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:23:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2151.790147 secs 2024-04-26T12:23:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:23:59 smithi193 ceph-mon[32782]: pgmap v1709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:23:59 smithi196 ceph-mon[32572]: pgmap v1709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:23:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:23:59 smithi110 ceph-mon[28069]: pgmap v1709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:00 smithi196 ceph-mon[32572]: pgmap v1710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:00 smithi110 ceph-mon[28069]: pgmap v1710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:00 smithi193 ceph-mon[32782]: pgmap v1710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:01.671 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:24:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:24:01.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:24:01.671 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:24:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:24:01.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:24:01.671 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:24:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:24:01.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:24:01.671 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:24:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:24:01.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:24:01.672 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:24:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:24:01.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:24:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2156.790291 secs 2024-04-26T12:24:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2156.790291 secs 2024-04-26T12:24:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2156.790291 secs 2024-04-26T12:24:03.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:02 smithi196 ceph-mon[32572]: pgmap v1711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:02 smithi110 ceph-mon[28069]: pgmap v1711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:02 smithi193 ceph-mon[32782]: pgmap v1711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:04 smithi196 ceph-mon[32572]: pgmap v1712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:24:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:04 smithi110 ceph-mon[28069]: pgmap v1712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:24:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:04 smithi193 ceph-mon[32782]: pgmap v1712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:24:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:06 smithi196 ceph-mon[32572]: pgmap v1713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:24:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2161.790446 secs 2024-04-26T12:24:07.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:24:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:06 smithi110 ceph-mon[28069]: pgmap v1713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:24:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2161.790446 secs 2024-04-26T12:24:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:24:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:06 smithi193 ceph-mon[32782]: pgmap v1713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:24:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2161.790446 secs 2024-04-26T12:24:07.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:24:08.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:24:08.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:24:08.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:24:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:24:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:24:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:24:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:24:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:24:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:24:09.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:08 smithi110 ceph-mon[28069]: pgmap v1714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 177 B/s wr, 14 op/s 2024-04-26T12:24:09.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:08 smithi110 ceph-mon[28069]: pgmap v1715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T12:24:09.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:08 smithi196 ceph-mon[32572]: pgmap v1714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 177 B/s wr, 14 op/s 2024-04-26T12:24:09.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:08 smithi196 ceph-mon[32572]: pgmap v1715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T12:24:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:08 smithi193 ceph-mon[32782]: pgmap v1714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 177 B/s wr, 14 op/s 2024-04-26T12:24:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:08 smithi193 ceph-mon[32782]: pgmap v1715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T12:24:11.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:10 smithi196 ceph-mon[32572]: pgmap v1716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T12:24:11.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:10 smithi110 ceph-mon[28069]: pgmap v1716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T12:24:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:10 smithi193 ceph-mon[32782]: pgmap v1716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T12:24:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2166.790585 secs 2024-04-26T12:24:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2166.790585 secs 2024-04-26T12:24:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2166.790585 secs 2024-04-26T12:24:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:12 smithi196 ceph-mon[32572]: pgmap v1717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T12:24:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:12 smithi110 ceph-mon[28069]: pgmap v1717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T12:24:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:12 smithi193 ceph-mon[32782]: pgmap v1717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T12:24:15.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:14 smithi196 ceph-mon[32572]: pgmap v1718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:24:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:14 smithi110 ceph-mon[28069]: pgmap v1718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:24:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:14 smithi193 ceph-mon[32782]: pgmap v1718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:24:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:24:16.693+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:24:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:24:16.694+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 21 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:24:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:24:16.694+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:24:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:24:16.695+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 21 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:24:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:16 smithi196 ceph-mon[32572]: pgmap v1719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:24:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2171.790712 secs 2024-04-26T12:24:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:16 smithi110 ceph-mon[28069]: pgmap v1719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:24:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2171.790712 secs 2024-04-26T12:24:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:16 smithi193 ceph-mon[32782]: pgmap v1719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:24:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2171.790712 secs 2024-04-26T12:24:19.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:18 smithi196 ceph-mon[32572]: pgmap v1720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2 op/s 2024-04-26T12:24:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:18 smithi110 ceph-mon[28069]: pgmap v1720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2 op/s 2024-04-26T12:24:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:18 smithi193 ceph-mon[32782]: pgmap v1720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2 op/s 2024-04-26T12:24:21.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:20 smithi196 ceph-mon[32572]: pgmap v1721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:24:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:20 smithi110 ceph-mon[28069]: pgmap v1721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:24:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:20 smithi193 ceph-mon[32782]: pgmap v1721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:24:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2176.790838 secs 2024-04-26T12:24:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2176.790838 secs 2024-04-26T12:24:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2176.790838 secs 2024-04-26T12:24:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:22 smithi196 ceph-mon[32572]: pgmap v1722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:22 smithi110 ceph-mon[28069]: pgmap v1722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:22 smithi193 ceph-mon[32782]: pgmap v1722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:24 smithi196 ceph-mon[32572]: pgmap v1723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:24 smithi110 ceph-mon[28069]: pgmap v1723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:24 smithi193 ceph-mon[32782]: pgmap v1723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:27 smithi196 ceph-mon[32572]: pgmap v1724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2181.790953 secs 2024-04-26T12:24:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:26 smithi110 ceph-mon[28069]: pgmap v1724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2181.790953 secs 2024-04-26T12:24:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:27 smithi193 ceph-mon[32782]: pgmap v1724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2181.790953 secs 2024-04-26T12:24:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:29 smithi110 ceph-mon[28069]: pgmap v1725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:29 smithi193 ceph-mon[32782]: pgmap v1725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:29 smithi196 ceph-mon[32572]: pgmap v1725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:31.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:31 smithi110 ceph-mon[28069]: pgmap v1726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:31 smithi193 ceph-mon[32782]: pgmap v1726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:31.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:31 smithi196 ceph-mon[32572]: pgmap v1726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2186.791064 secs 2024-04-26T12:24:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2186.791064 secs 2024-04-26T12:24:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2186.791064 secs 2024-04-26T12:24:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:33 smithi110 ceph-mon[28069]: pgmap v1727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:33 smithi193 ceph-mon[32782]: pgmap v1727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:33 smithi196 ceph-mon[32572]: pgmap v1727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:35.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:35 smithi110 ceph-mon[28069]: pgmap v1728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:35 smithi193 ceph-mon[32782]: pgmap v1728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:35 smithi196 ceph-mon[32572]: pgmap v1728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:37 smithi110 ceph-mon[28069]: pgmap v1729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2191.791212 secs 2024-04-26T12:24:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:37 smithi193 ceph-mon[32782]: pgmap v1729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2191.791212 secs 2024-04-26T12:24:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:37 smithi196 ceph-mon[32572]: pgmap v1729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2191.791212 secs 2024-04-26T12:24:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:39 smithi110 ceph-mon[28069]: pgmap v1730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:39.308 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:39 smithi196 ceph-mon[32572]: pgmap v1730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:39 smithi193 ceph-mon[32782]: pgmap v1730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:41 smithi193 ceph-mon[32782]: pgmap v1731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:41 smithi196 ceph-mon[32572]: pgmap v1731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:41 smithi110 ceph-mon[28069]: pgmap v1731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2196.791333 secs 2024-04-26T12:24:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2196.791333 secs 2024-04-26T12:24:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2196.791333 secs 2024-04-26T12:24:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:43 smithi193 ceph-mon[32782]: pgmap v1732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:43.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:43 smithi196 ceph-mon[32572]: pgmap v1732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:43 smithi110 ceph-mon[28069]: pgmap v1732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:45.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:45 smithi193 ceph-mon[32782]: pgmap v1733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:45.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:45 smithi196 ceph-mon[32572]: pgmap v1733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:45.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:45 smithi110 ceph-mon[28069]: pgmap v1733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:47 smithi193 ceph-mon[32782]: pgmap v1734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:47.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2201.791474 secs 2024-04-26T12:24:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:47 smithi196 ceph-mon[32572]: pgmap v1734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2201.791474 secs 2024-04-26T12:24:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:47 smithi110 ceph-mon[28069]: pgmap v1734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2201.791474 secs 2024-04-26T12:24:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:49 smithi193 ceph-mon[32782]: pgmap v1735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:49.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:49 smithi196 ceph-mon[32572]: pgmap v1735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:49 smithi110 ceph-mon[28069]: pgmap v1735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:51 smithi193 ceph-mon[32782]: pgmap v1736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:51 smithi196 ceph-mon[32572]: pgmap v1736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:51 smithi110 ceph-mon[28069]: pgmap v1736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:52.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2206.791623 secs 2024-04-26T12:24:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2206.791623 secs 2024-04-26T12:24:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2206.791623 secs 2024-04-26T12:24:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:53 smithi193 ceph-mon[32782]: pgmap v1737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:53.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:53 smithi196 ceph-mon[32572]: pgmap v1737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:53.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:53 smithi110 ceph-mon[28069]: pgmap v1737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:54 smithi193 ceph-mon[32782]: pgmap v1738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:54 smithi196 ceph-mon[32572]: pgmap v1738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:54 smithi110 ceph-mon[28069]: pgmap v1738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:57.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:56 smithi196 ceph-mon[32572]: pgmap v1739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:57.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2211.791701 secs 2024-04-26T12:24:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:56 smithi110 ceph-mon[28069]: pgmap v1739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2211.791701 secs 2024-04-26T12:24:57.076 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:56 smithi193 ceph-mon[32782]: pgmap v1739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:24:57.076 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2211.791701 secs 2024-04-26T12:24:59.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:24:58 smithi196 ceph-mon[32572]: pgmap v1740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:24:58 smithi110 ceph-mon[28069]: pgmap v1740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:24:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:24:58 smithi193 ceph-mon[32782]: pgmap v1740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:00 smithi196 ceph-mon[32572]: pgmap v1741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:00 smithi110 ceph-mon[28069]: pgmap v1741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:00 smithi193 ceph-mon[32782]: pgmap v1741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2216.791763 secs 2024-04-26T12:25:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2216.791763 secs 2024-04-26T12:25:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2216.791763 secs 2024-04-26T12:25:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:02 smithi196 ceph-mon[32572]: pgmap v1742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:02 smithi110 ceph-mon[28069]: pgmap v1742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:02 smithi193 ceph-mon[32782]: pgmap v1742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:05.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:04 smithi196 ceph-mon[32572]: pgmap v1743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:04 smithi110 ceph-mon[28069]: pgmap v1743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:04 smithi193 ceph-mon[32782]: pgmap v1743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:06 smithi196 ceph-mon[32572]: pgmap v1744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:25:07.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2221.791881 secs 2024-04-26T12:25:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:06 smithi110 ceph-mon[28069]: pgmap v1744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:25:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2221.791881 secs 2024-04-26T12:25:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:06 smithi193 ceph-mon[32782]: pgmap v1744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:25:07.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2221.791881 secs 2024-04-26T12:25:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:25:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:25:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:25:09.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:08 smithi196 ceph-mon[32572]: pgmap v1745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:08 smithi110 ceph-mon[28069]: pgmap v1745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:08 smithi193 ceph-mon[32782]: pgmap v1745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:10.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:25:10.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:25:10.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:09 smithi196 ceph-mon[32572]: pgmap v1746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:25:10.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:09 smithi196 ceph-mon[32572]: pgmap v1747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:10.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:25:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:25:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:25:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:09 smithi110 ceph-mon[28069]: pgmap v1746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:25:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:09 smithi110 ceph-mon[28069]: pgmap v1747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:25:10.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:25:10.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:25:10.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:09 smithi193 ceph-mon[32782]: pgmap v1746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:25:10.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:09 smithi193 ceph-mon[32782]: pgmap v1747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:10.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:25:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:12 smithi110 ceph-mon[28069]: pgmap v1748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:12.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2226.792007 secs 2024-04-26T12:25:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:12 smithi193 ceph-mon[32782]: pgmap v1748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2226.792007 secs 2024-04-26T12:25:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:12 smithi196 ceph-mon[32572]: pgmap v1748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:25:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2226.792007 secs 2024-04-26T12:25:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:14 smithi193 ceph-mon[32782]: pgmap v1749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:25:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:14 smithi196 ceph-mon[32572]: pgmap v1749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:25:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:14 smithi110 ceph-mon[28069]: pgmap v1749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:25:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:16 smithi193 ceph-mon[32782]: pgmap v1750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:25:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:16 smithi196 ceph-mon[32572]: pgmap v1750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:25:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:16 smithi110 ceph-mon[28069]: pgmap v1750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:25:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2231.792127 secs 2024-04-26T12:25:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2231.792127 secs 2024-04-26T12:25:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2231.792127 secs 2024-04-26T12:25:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:18 smithi193 ceph-mon[32782]: pgmap v1751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:25:18.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:18 smithi196 ceph-mon[32572]: pgmap v1751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:25:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:18 smithi110 ceph-mon[28069]: pgmap v1751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:25:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:20 smithi193 ceph-mon[32782]: pgmap v1752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:25:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:20 smithi196 ceph-mon[32572]: pgmap v1752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:25:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:20 smithi110 ceph-mon[28069]: pgmap v1752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:25:22.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:22 smithi193 ceph-mon[32782]: pgmap v1753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:22.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2236.792246 secs 2024-04-26T12:25:22.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:22 smithi196 ceph-mon[32572]: pgmap v1753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:22.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2236.792246 secs 2024-04-26T12:25:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:22 smithi110 ceph-mon[28069]: pgmap v1753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2236.792246 secs 2024-04-26T12:25:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:24 smithi193 ceph-mon[32782]: pgmap v1754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:24.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:24 smithi196 ceph-mon[32572]: pgmap v1754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:24 smithi110 ceph-mon[28069]: pgmap v1754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:26 smithi193 ceph-mon[32782]: pgmap v1755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:26.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:26 smithi196 ceph-mon[32572]: pgmap v1755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:26 smithi110 ceph-mon[28069]: pgmap v1755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2241.792363 secs 2024-04-26T12:25:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2241.792363 secs 2024-04-26T12:25:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2241.792363 secs 2024-04-26T12:25:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:28 smithi193 ceph-mon[32782]: pgmap v1756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:28 smithi196 ceph-mon[32572]: pgmap v1756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:28 smithi110 ceph-mon[28069]: pgmap v1756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:30 smithi193 ceph-mon[32782]: pgmap v1757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:30.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:30 smithi196 ceph-mon[32572]: pgmap v1757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:30.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:30 smithi110 ceph-mon[28069]: pgmap v1757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:31 smithi193 ceph-mon[32782]: pgmap v1758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:31 smithi196 ceph-mon[32572]: pgmap v1758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:31.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:31 smithi110 ceph-mon[28069]: pgmap v1758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2246.792497 secs 2024-04-26T12:25:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2246.792497 secs 2024-04-26T12:25:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2246.792497 secs 2024-04-26T12:25:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:33 smithi193 ceph-mon[32782]: pgmap v1759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:33.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:33 smithi196 ceph-mon[32572]: pgmap v1759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:33.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:33 smithi110 ceph-mon[28069]: pgmap v1759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:36 smithi193 ceph-mon[32782]: pgmap v1760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:36.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:36 smithi196 ceph-mon[32572]: pgmap v1760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:36.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:36 smithi110 ceph-mon[28069]: pgmap v1760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2251.792652 secs 2024-04-26T12:25:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2251.792652 secs 2024-04-26T12:25:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2251.792652 secs 2024-04-26T12:25:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:38 smithi193 ceph-mon[32782]: pgmap v1761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:38 smithi196 ceph-mon[32572]: pgmap v1761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:38 smithi110 ceph-mon[28069]: pgmap v1761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:40.345 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:40 smithi110 ceph-mon[28069]: pgmap v1762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:40 smithi193 ceph-mon[32782]: pgmap v1762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:40 smithi196 ceph-mon[32572]: pgmap v1762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:42 smithi193 ceph-mon[32782]: pgmap v1763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2256.792772 secs 2024-04-26T12:25:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:42 smithi196 ceph-mon[32572]: pgmap v1763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2256.792772 secs 2024-04-26T12:25:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:42 smithi110 ceph-mon[28069]: pgmap v1763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2256.792772 secs 2024-04-26T12:25:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:44 smithi193 ceph-mon[32782]: pgmap v1764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:44 smithi196 ceph-mon[32572]: pgmap v1764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:44.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:44 smithi110 ceph-mon[28069]: pgmap v1764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:46 smithi193 ceph-mon[32782]: pgmap v1765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:46.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:46 smithi196 ceph-mon[32572]: pgmap v1765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:46 smithi110 ceph-mon[28069]: pgmap v1765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2261.792897 secs 2024-04-26T12:25:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2261.792897 secs 2024-04-26T12:25:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2261.792897 secs 2024-04-26T12:25:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:48 smithi193 ceph-mon[32782]: pgmap v1766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:48 smithi196 ceph-mon[32572]: pgmap v1766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:48.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:48 smithi110 ceph-mon[28069]: pgmap v1766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:50.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:50 smithi193 ceph-mon[32782]: pgmap v1767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:50 smithi196 ceph-mon[32572]: pgmap v1767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:50 smithi110 ceph-mon[28069]: pgmap v1767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:51 smithi196 ceph-mon[32572]: pgmap v1768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:51 smithi110 ceph-mon[28069]: pgmap v1768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:51 smithi193 ceph-mon[32782]: pgmap v1768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2266.792982 secs 2024-04-26T12:25:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2266.792982 secs 2024-04-26T12:25:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2266.792982 secs 2024-04-26T12:25:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:53 smithi196 ceph-mon[32572]: pgmap v1769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:53.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:53 smithi110 ceph-mon[28069]: pgmap v1769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:53 smithi193 ceph-mon[32782]: pgmap v1769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:25:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:56 smithi193 ceph-mon[32782]: pgmap v1770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:56 smithi196 ceph-mon[32572]: pgmap v1770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:56 smithi110 ceph-mon[28069]: pgmap v1770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2271.793141 secs 2024-04-26T12:25:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2271.793141 secs 2024-04-26T12:25:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2271.793141 secs 2024-04-26T12:25:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:25:58 smithi193 ceph-mon[32782]: pgmap v1771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:25:58 smithi196 ceph-mon[32572]: pgmap v1771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:25:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:25:58 smithi110 ceph-mon[28069]: pgmap v1771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:00 smithi193 ceph-mon[32782]: pgmap v1772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:00.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:00 smithi196 ceph-mon[32572]: pgmap v1772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:00 smithi110 ceph-mon[28069]: pgmap v1772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:02 smithi193 ceph-mon[32782]: pgmap v1773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2276.793261 secs 2024-04-26T12:26:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:02 smithi196 ceph-mon[32572]: pgmap v1773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:02.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2276.793261 secs 2024-04-26T12:26:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:02 smithi110 ceph-mon[28069]: pgmap v1773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2276.793261 secs 2024-04-26T12:26:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:04 smithi193 ceph-mon[32782]: pgmap v1774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:04 smithi196 ceph-mon[32572]: pgmap v1774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:04 smithi110 ceph-mon[28069]: pgmap v1774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:06 smithi193 ceph-mon[32782]: pgmap v1775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:06 smithi196 ceph-mon[32572]: pgmap v1775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:06.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:06 smithi110 ceph-mon[28069]: pgmap v1775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2281.793337 secs 2024-04-26T12:26:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2281.793337 secs 2024-04-26T12:26:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2281.793337 secs 2024-04-26T12:26:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:08 smithi193 ceph-mon[32782]: pgmap v1776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:08 smithi196 ceph-mon[32572]: pgmap v1776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:08 smithi110 ceph-mon[28069]: pgmap v1776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:09 smithi193 ceph-mon[32782]: pgmap v1777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:09 smithi196 ceph-mon[32572]: pgmap v1777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:09 smithi110 ceph-mon[28069]: pgmap v1777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:26:10.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:26:10.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:26:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:11 smithi196 ceph-mon[32572]: pgmap v1778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:11 smithi193 ceph-mon[32782]: pgmap v1778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:11 smithi110 ceph-mon[28069]: pgmap v1778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:12.230 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2286.793483 secs 2024-04-26T12:26:12.407 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2286.793483 secs 2024-04-26T12:26:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2286.793483 secs 2024-04-26T12:26:13.219 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:13 smithi110 ceph-mon[28069]: pgmap v1779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:13.333 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:13 smithi193 ceph-mon[32782]: pgmap v1779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:13 smithi196 ceph-mon[32572]: pgmap v1779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:14.959 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:14.959 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:14.959 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:14.959 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:15.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:15.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:15.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:16.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:15 smithi196 ceph-mon[32572]: pgmap v1780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:15 smithi110 ceph-mon[28069]: pgmap v1780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:15 smithi193 ceph-mon[32782]: pgmap v1780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:26:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:26:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:16 smithi196 ceph-mon[32572]: pgmap v1781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 939 B/s rd, 1 op/s 2024-04-26T12:26:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:16 smithi196 ceph-mon[32572]: pgmap v1782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:17.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2291.793643 secs 2024-04-26T12:26:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:26:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:26:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:16 smithi110 ceph-mon[28069]: pgmap v1781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 939 B/s rd, 1 op/s 2024-04-26T12:26:17.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:16 smithi110 ceph-mon[28069]: pgmap v1782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:17.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:17.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2291.793643 secs 2024-04-26T12:26:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:26:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:26:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:16 smithi193 ceph-mon[32782]: pgmap v1781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 939 B/s rd, 1 op/s 2024-04-26T12:26:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:16 smithi193 ceph-mon[32782]: pgmap v1782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:26:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2291.793643 secs 2024-04-26T12:26:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:18 smithi196 ceph-mon[32572]: pgmap v1783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:18 smithi110 ceph-mon[28069]: pgmap v1783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:18 smithi193 ceph-mon[32782]: pgmap v1783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:21.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:20 smithi196 ceph-mon[32572]: pgmap v1784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:20 smithi110 ceph-mon[28069]: pgmap v1784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:20 smithi193 ceph-mon[32782]: pgmap v1784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2296.793764 secs 2024-04-26T12:26:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2296.793764 secs 2024-04-26T12:26:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2296.793764 secs 2024-04-26T12:26:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:22 smithi196 ceph-mon[32572]: pgmap v1785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 575 B/s rd, 1 op/s 2024-04-26T12:26:23.027 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:22 smithi193 ceph-mon[32782]: pgmap v1785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 575 B/s rd, 1 op/s 2024-04-26T12:26:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:22 smithi110 ceph-mon[28069]: pgmap v1785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 575 B/s rd, 1 op/s 2024-04-26T12:26:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:24 smithi196 ceph-mon[32572]: pgmap v1786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:24 smithi110 ceph-mon[28069]: pgmap v1786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:24 smithi193 ceph-mon[32782]: pgmap v1786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:26:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:26 smithi196 ceph-mon[32572]: pgmap v1787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:26:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2301.793860 secs 2024-04-26T12:26:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:26 smithi110 ceph-mon[28069]: pgmap v1787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:26:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2301.793860 secs 2024-04-26T12:26:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:26 smithi193 ceph-mon[32782]: pgmap v1787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:26:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2301.793860 secs 2024-04-26T12:26:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:28 smithi196 ceph-mon[32572]: pgmap v1788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:28 smithi110 ceph-mon[28069]: pgmap v1788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:28 smithi193 ceph-mon[32782]: pgmap v1788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:30 smithi196 ceph-mon[32572]: pgmap v1789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:31.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:30 smithi110 ceph-mon[28069]: pgmap v1789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:30 smithi193 ceph-mon[32782]: pgmap v1789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2306.793997 secs 2024-04-26T12:26:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2306.793997 secs 2024-04-26T12:26:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2306.793997 secs 2024-04-26T12:26:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:33 smithi110 ceph-mon[28069]: pgmap v1790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:33 smithi193 ceph-mon[32782]: pgmap v1790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:33 smithi196 ceph-mon[32572]: pgmap v1790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:35.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:35 smithi110 ceph-mon[28069]: pgmap v1791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:35 smithi193 ceph-mon[32782]: pgmap v1791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:35 smithi196 ceph-mon[32572]: pgmap v1791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:37 smithi110 ceph-mon[28069]: pgmap v1792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2311.794133 secs 2024-04-26T12:26:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:37 smithi193 ceph-mon[32782]: pgmap v1792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2311.794133 secs 2024-04-26T12:26:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:37 smithi196 ceph-mon[32572]: pgmap v1792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2311.794133 secs 2024-04-26T12:26:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:39 smithi110 ceph-mon[28069]: pgmap v1793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:39 smithi193 ceph-mon[32782]: pgmap v1793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:39.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:39 smithi196 ceph-mon[32572]: pgmap v1793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:41 smithi110 ceph-mon[28069]: pgmap v1794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:41.308 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:41 smithi196 ceph-mon[32572]: pgmap v1794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:41 smithi193 ceph-mon[32782]: pgmap v1794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:42.324 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2316.794269 secs 2024-04-26T12:26:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2316.794269 secs 2024-04-26T12:26:42.476 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2316.794269 secs 2024-04-26T12:26:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:43 smithi110 ceph-mon[28069]: pgmap v1795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:43 smithi193 ceph-mon[32782]: pgmap v1795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:43 smithi196 ceph-mon[32572]: pgmap v1795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:45 smithi193 ceph-mon[32782]: pgmap v1796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:45 smithi196 ceph-mon[32572]: pgmap v1796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:45.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:45 smithi110 ceph-mon[28069]: pgmap v1796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:47.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:47 smithi193 ceph-mon[32782]: pgmap v1797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:47.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2321.794411 secs 2024-04-26T12:26:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:47 smithi196 ceph-mon[32572]: pgmap v1797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2321.794411 secs 2024-04-26T12:26:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:47 smithi110 ceph-mon[28069]: pgmap v1797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2321.794411 secs 2024-04-26T12:26:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:49 smithi193 ceph-mon[32782]: pgmap v1798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:49 smithi196 ceph-mon[32572]: pgmap v1798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:49 smithi110 ceph-mon[28069]: pgmap v1798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:51 smithi193 ceph-mon[32782]: pgmap v1799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:51 smithi196 ceph-mon[32572]: pgmap v1799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:51 smithi110 ceph-mon[28069]: pgmap v1799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2326.794551 secs 2024-04-26T12:26:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2326.794551 secs 2024-04-26T12:26:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2326.794551 secs 2024-04-26T12:26:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:53 smithi193 ceph-mon[32782]: pgmap v1800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:53 smithi196 ceph-mon[32572]: pgmap v1800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:53.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:53 smithi110 ceph-mon[28069]: pgmap v1800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:55 smithi193 ceph-mon[32782]: pgmap v1801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:55 smithi196 ceph-mon[32572]: pgmap v1801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:55 smithi110 ceph-mon[28069]: pgmap v1801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:57 smithi193 ceph-mon[32782]: pgmap v1802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2331.794618 secs 2024-04-26T12:26:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:57 smithi196 ceph-mon[32572]: pgmap v1802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:57.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2331.794618 secs 2024-04-26T12:26:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:57 smithi110 ceph-mon[28069]: pgmap v1802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:26:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2331.794618 secs 2024-04-26T12:26:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:26:59 smithi193 ceph-mon[32782]: pgmap v1803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:26:59 smithi196 ceph-mon[32572]: pgmap v1803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:26:59.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:26:59 smithi110 ceph-mon[28069]: pgmap v1803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:01 smithi193 ceph-mon[32782]: pgmap v1804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:01 smithi196 ceph-mon[32572]: pgmap v1804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:01 smithi110 ceph-mon[28069]: pgmap v1804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2336.794735 secs 2024-04-26T12:27:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2336.794735 secs 2024-04-26T12:27:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2336.794735 secs 2024-04-26T12:27:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:03 smithi193 ceph-mon[32782]: pgmap v1805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:03 smithi196 ceph-mon[32572]: pgmap v1805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:03 smithi110 ceph-mon[28069]: pgmap v1805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:05 smithi193 ceph-mon[32782]: pgmap v1806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:05.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:05 smithi196 ceph-mon[32572]: pgmap v1806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:05 smithi110 ceph-mon[28069]: pgmap v1806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:06 smithi196 ceph-mon[32572]: pgmap v1807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:06.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:06 smithi110 ceph-mon[28069]: pgmap v1807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:06 smithi193 ceph-mon[32782]: pgmap v1807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2341.794858 secs 2024-04-26T12:27:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2341.794858 secs 2024-04-26T12:27:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2341.794858 secs 2024-04-26T12:27:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:08 smithi196 ceph-mon[32572]: pgmap v1808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:08 smithi110 ceph-mon[28069]: pgmap v1808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:08 smithi193 ceph-mon[32782]: pgmap v1808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:11.245 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:10 smithi110 ceph-mon[28069]: pgmap v1809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:10 smithi196 ceph-mon[32572]: pgmap v1809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:10 smithi193 ceph-mon[32782]: pgmap v1809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2346.794981 secs 2024-04-26T12:27:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2346.794981 secs 2024-04-26T12:27:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2346.794981 secs 2024-04-26T12:27:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:13 smithi196 ceph-mon[32572]: pgmap v1810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:13 smithi110 ceph-mon[28069]: pgmap v1810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:13 smithi193 ceph-mon[32782]: pgmap v1810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:15.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:15 smithi110 ceph-mon[28069]: pgmap v1811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:15 smithi193 ceph-mon[32782]: pgmap v1811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:15 smithi196 ceph-mon[32572]: pgmap v1811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:27:16.723+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:27:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:27:16.723+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:27:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:27:16.723+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 22 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:27:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:27:16.723+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 22 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x55db1bd6fcb0 con 0x55db1be4fdd0 2024-04-26T12:27:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:17 smithi110 ceph-mon[28069]: pgmap v1812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2351.795099 secs 2024-04-26T12:27:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:27:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:17 smithi193 ceph-mon[32782]: pgmap v1812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2351.795099 secs 2024-04-26T12:27:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:27:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:17 smithi196 ceph-mon[32572]: pgmap v1812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2351.795099 secs 2024-04-26T12:27:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:27:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:27:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:27:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:27:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:27:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:27:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:27:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:27:18.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:27:18.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:27:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:19 smithi110 ceph-mon[28069]: pgmap v1813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:27:19.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:19 smithi110 ceph-mon[28069]: pgmap v1814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T12:27:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:19 smithi193 ceph-mon[32782]: pgmap v1813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:27:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:19 smithi193 ceph-mon[32782]: pgmap v1814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T12:27:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:19 smithi196 ceph-mon[32572]: pgmap v1813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:27:19.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:19 smithi196 ceph-mon[32572]: pgmap v1814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T12:27:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:21 smithi110 ceph-mon[28069]: pgmap v1815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:21 smithi193 ceph-mon[32782]: pgmap v1815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:21 smithi196 ceph-mon[32572]: pgmap v1815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2356.795231 secs 2024-04-26T12:27:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2356.795231 secs 2024-04-26T12:27:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2356.795231 secs 2024-04-26T12:27:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:23 smithi193 ceph-mon[32782]: pgmap v1816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:23 smithi196 ceph-mon[32572]: pgmap v1816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:23 smithi110 ceph-mon[28069]: pgmap v1816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:25 smithi193 ceph-mon[32782]: pgmap v1817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:25 smithi196 ceph-mon[32572]: pgmap v1817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:25 smithi110 ceph-mon[28069]: pgmap v1817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:27 smithi193 ceph-mon[32782]: pgmap v1818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:27.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2361.795379 secs 2024-04-26T12:27:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:27 smithi196 ceph-mon[32572]: pgmap v1818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2361.795379 secs 2024-04-26T12:27:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:27 smithi110 ceph-mon[28069]: pgmap v1818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:27:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2361.795379 secs 2024-04-26T12:27:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:29 smithi193 ceph-mon[32782]: pgmap v1819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:27:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:29 smithi196 ceph-mon[32572]: pgmap v1819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:27:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:29 smithi110 ceph-mon[28069]: pgmap v1819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:27:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:31 smithi193 ceph-mon[32782]: pgmap v1820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:27:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:31 smithi196 ceph-mon[32572]: pgmap v1820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:27:31.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:31 smithi110 ceph-mon[28069]: pgmap v1820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:27:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2366.795518 secs 2024-04-26T12:27:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2366.795518 secs 2024-04-26T12:27:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2366.795518 secs 2024-04-26T12:27:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:33 smithi193 ceph-mon[32782]: pgmap v1821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:33 smithi196 ceph-mon[32572]: pgmap v1821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:33.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:33 smithi110 ceph-mon[28069]: pgmap v1821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:35 smithi193 ceph-mon[32782]: pgmap v1822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:35 smithi196 ceph-mon[32572]: pgmap v1822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:35 smithi110 ceph-mon[28069]: pgmap v1822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:37 smithi193 ceph-mon[32782]: pgmap v1823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2371.795642 secs 2024-04-26T12:27:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:37 smithi196 ceph-mon[32572]: pgmap v1823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2371.795642 secs 2024-04-26T12:27:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:37 smithi110 ceph-mon[28069]: pgmap v1823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2371.795642 secs 2024-04-26T12:27:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:39 smithi193 ceph-mon[32782]: pgmap v1824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:39 smithi196 ceph-mon[32572]: pgmap v1824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:39.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:39 smithi110 ceph-mon[28069]: pgmap v1824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:41.346 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:41 smithi110 ceph-mon[28069]: pgmap v1825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:27:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:41 smithi193 ceph-mon[32782]: pgmap v1825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:27:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:41 smithi196 ceph-mon[32572]: pgmap v1825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:27:42.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2376.795708 secs 2024-04-26T12:27:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2376.795708 secs 2024-04-26T12:27:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2376.795708 secs 2024-04-26T12:27:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:43 smithi193 ceph-mon[32782]: pgmap v1826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:43.509 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:43 smithi196 ceph-mon[32572]: pgmap v1826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:43 smithi110 ceph-mon[28069]: pgmap v1826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:45 smithi193 ceph-mon[32782]: pgmap v1827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:45 smithi196 ceph-mon[32572]: pgmap v1827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:45.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:45 smithi110 ceph-mon[28069]: pgmap v1827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:47 smithi193 ceph-mon[32782]: pgmap v1828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2381.795826 secs 2024-04-26T12:27:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:47 smithi196 ceph-mon[32572]: pgmap v1828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2381.795826 secs 2024-04-26T12:27:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:47 smithi110 ceph-mon[28069]: pgmap v1828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2381.795826 secs 2024-04-26T12:27:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:49 smithi196 ceph-mon[32572]: pgmap v1829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:49 smithi110 ceph-mon[28069]: pgmap v1829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:49 smithi193 ceph-mon[32782]: pgmap v1829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:50 smithi196 ceph-mon[32572]: pgmap v1830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:27:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:50 smithi110 ceph-mon[28069]: pgmap v1830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:27:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:50 smithi193 ceph-mon[32782]: pgmap v1830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:27:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2386.795890 secs 2024-04-26T12:27:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:52 smithi196 ceph-mon[32572]: pgmap v1831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2386.795890 secs 2024-04-26T12:27:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:52 smithi110 ceph-mon[28069]: pgmap v1831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2386.795890 secs 2024-04-26T12:27:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:52 smithi193 ceph-mon[32782]: pgmap v1831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:54.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:54 smithi110 ceph-mon[28069]: pgmap v1832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:54 smithi193 ceph-mon[32782]: pgmap v1832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:54 smithi196 ceph-mon[32572]: pgmap v1832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:56 smithi110 ceph-mon[28069]: pgmap v1833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:56 smithi193 ceph-mon[32782]: pgmap v1833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:56 smithi196 ceph-mon[32572]: pgmap v1833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:27:57.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2391.795985 secs 2024-04-26T12:27:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2391.795985 secs 2024-04-26T12:27:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2391.795985 secs 2024-04-26T12:27:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:27:58 smithi110 ceph-mon[28069]: pgmap v1834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:27:58 smithi193 ceph-mon[32782]: pgmap v1834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:27:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:27:58 smithi196 ceph-mon[32572]: pgmap v1834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:00 smithi110 ceph-mon[28069]: pgmap v1835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:28:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:00 smithi193 ceph-mon[32782]: pgmap v1835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:28:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:00 smithi196 ceph-mon[32572]: pgmap v1835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:28:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2396.796123 secs 2024-04-26T12:28:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:02 smithi110 ceph-mon[28069]: pgmap v1836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2396.796123 secs 2024-04-26T12:28:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:02 smithi193 ceph-mon[32782]: pgmap v1836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2396.796123 secs 2024-04-26T12:28:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:02 smithi196 ceph-mon[32572]: pgmap v1836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:04.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:04 smithi110 ceph-mon[28069]: pgmap v1837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:04 smithi193 ceph-mon[32782]: pgmap v1837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:04 smithi196 ceph-mon[32572]: pgmap v1837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:06 smithi193 ceph-mon[32782]: pgmap v1838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:06 smithi196 ceph-mon[32572]: pgmap v1838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:06 smithi110 ceph-mon[28069]: pgmap v1838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2401.796260 secs 2024-04-26T12:28:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2401.796260 secs 2024-04-26T12:28:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2401.796260 secs 2024-04-26T12:28:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:08 smithi193 ceph-mon[32782]: pgmap v1839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:09.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:08 smithi196 ceph-mon[32572]: pgmap v1839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:08 smithi110 ceph-mon[28069]: pgmap v1839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:10 smithi193 ceph-mon[32782]: pgmap v1840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:28:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:10 smithi196 ceph-mon[32572]: pgmap v1840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:28:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:10 smithi110 ceph-mon[28069]: pgmap v1840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:28:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2406.796377 secs 2024-04-26T12:28:11.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2406.796377 secs 2024-04-26T12:28:11.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2406.796377 secs 2024-04-26T12:28:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:12 smithi193 ceph-mon[32782]: pgmap v1841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:12 smithi196 ceph-mon[32572]: pgmap v1841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:12 smithi110 ceph-mon[28069]: pgmap v1841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:14 smithi193 ceph-mon[32782]: pgmap v1842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:14 smithi196 ceph-mon[32572]: pgmap v1842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:14 smithi110 ceph-mon[28069]: pgmap v1842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:16 smithi193 ceph-mon[32782]: pgmap v1843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2411.796497 secs 2024-04-26T12:28:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:16 smithi196 ceph-mon[32572]: pgmap v1843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2411.796497 secs 2024-04-26T12:28:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:16 smithi110 ceph-mon[28069]: pgmap v1843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2411.796497 secs 2024-04-26T12:28:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:18 smithi193 ceph-mon[32782]: pgmap v1844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:18.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:28:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:18 smithi196 ceph-mon[32572]: pgmap v1844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:28:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:18 smithi110 ceph-mon[28069]: pgmap v1844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:28:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:28:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:28:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:19 smithi193 ceph-mon[32782]: pgmap v1845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:28:19.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:19 smithi193 ceph-mon[32782]: pgmap v1846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:19.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:28:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:28:20.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:28:20.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:19 smithi196 ceph-mon[32572]: pgmap v1845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:28:20.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:19 smithi196 ceph-mon[32572]: pgmap v1846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:20.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:28:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:28:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:28:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:19 smithi110 ceph-mon[28069]: pgmap v1845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:28:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:19 smithi110 ceph-mon[28069]: pgmap v1846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:28:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:22 smithi193 ceph-mon[32782]: pgmap v1847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2416.796616 secs 2024-04-26T12:28:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:22 smithi196 ceph-mon[32572]: pgmap v1847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:22.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2416.796616 secs 2024-04-26T12:28:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:22 smithi110 ceph-mon[28069]: pgmap v1847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2416.796616 secs 2024-04-26T12:28:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:24 smithi193 ceph-mon[32782]: pgmap v1848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:24 smithi196 ceph-mon[32572]: pgmap v1848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:24 smithi110 ceph-mon[28069]: pgmap v1848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:26 smithi193 ceph-mon[32782]: pgmap v1849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:26 smithi196 ceph-mon[32572]: pgmap v1849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:26 smithi110 ceph-mon[28069]: pgmap v1849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:28:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2421.796736 secs 2024-04-26T12:28:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2421.796736 secs 2024-04-26T12:28:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2421.796736 secs 2024-04-26T12:28:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:28 smithi193 ceph-mon[32782]: pgmap v1850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:28:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:28 smithi196 ceph-mon[32572]: pgmap v1850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:28:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:28 smithi110 ceph-mon[28069]: pgmap v1850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:28:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:30 smithi193 ceph-mon[32782]: pgmap v1851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:28:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:30 smithi196 ceph-mon[32572]: pgmap v1851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:28:30.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:30 smithi110 ceph-mon[28069]: pgmap v1851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:28:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:32 smithi193 ceph-mon[32782]: pgmap v1852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2426.796878 secs 2024-04-26T12:28:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:32 smithi196 ceph-mon[32572]: pgmap v1852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2426.796878 secs 2024-04-26T12:28:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:32 smithi110 ceph-mon[28069]: pgmap v1852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2426.796878 secs 2024-04-26T12:28:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:34 smithi193 ceph-mon[32782]: pgmap v1853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:34 smithi196 ceph-mon[32572]: pgmap v1853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:34.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:34 smithi110 ceph-mon[28069]: pgmap v1853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:36 smithi193 ceph-mon[32782]: pgmap v1854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:36 smithi196 ceph-mon[32572]: pgmap v1854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:36.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:36 smithi110 ceph-mon[28069]: pgmap v1854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2431.796971 secs 2024-04-26T12:28:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2431.796971 secs 2024-04-26T12:28:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2431.796971 secs 2024-04-26T12:28:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:38 smithi193 ceph-mon[32782]: pgmap v1855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:38 smithi196 ceph-mon[32572]: pgmap v1855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:38 smithi110 ceph-mon[28069]: pgmap v1855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:40 smithi193 ceph-mon[32782]: pgmap v1856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:40 smithi196 ceph-mon[32572]: pgmap v1856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:40.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:40 smithi110 ceph-mon[28069]: pgmap v1856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:42 smithi193 ceph-mon[32782]: pgmap v1857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2436.797090 secs 2024-04-26T12:28:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:42 smithi196 ceph-mon[32572]: pgmap v1857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2436.797090 secs 2024-04-26T12:28:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:42 smithi110 ceph-mon[28069]: pgmap v1857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2436.797090 secs 2024-04-26T12:28:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:44 smithi193 ceph-mon[32782]: pgmap v1858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:44 smithi196 ceph-mon[32572]: pgmap v1858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:44.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:44 smithi110 ceph-mon[28069]: pgmap v1858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:46 smithi193 ceph-mon[32782]: pgmap v1859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:46 smithi196 ceph-mon[32572]: pgmap v1859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:46 smithi110 ceph-mon[28069]: pgmap v1859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2441.797185 secs 2024-04-26T12:28:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2441.797185 secs 2024-04-26T12:28:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2441.797185 secs 2024-04-26T12:28:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:48 smithi196 ceph-mon[32572]: pgmap v1860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:48.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:48 smithi110 ceph-mon[28069]: pgmap v1860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:48 smithi193 ceph-mon[32782]: pgmap v1860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:49 smithi196 ceph-mon[32572]: pgmap v1861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:49.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:49 smithi110 ceph-mon[28069]: pgmap v1861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:49 smithi193 ceph-mon[32782]: pgmap v1861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:52 smithi193 ceph-mon[32782]: pgmap v1862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2446.797308 secs 2024-04-26T12:28:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:52 smithi196 ceph-mon[32572]: pgmap v1862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2446.797308 secs 2024-04-26T12:28:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:52 smithi110 ceph-mon[28069]: pgmap v1862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2446.797308 secs 2024-04-26T12:28:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:54 smithi193 ceph-mon[32782]: pgmap v1863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:54 smithi196 ceph-mon[32572]: pgmap v1863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:54 smithi110 ceph-mon[28069]: pgmap v1863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:28:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:56 smithi193 ceph-mon[32782]: pgmap v1864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:56 smithi196 ceph-mon[32572]: pgmap v1864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:56 smithi110 ceph-mon[28069]: pgmap v1864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2451.797435 secs 2024-04-26T12:28:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2451.797435 secs 2024-04-26T12:28:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2451.797435 secs 2024-04-26T12:28:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:28:58 smithi193 ceph-mon[32782]: pgmap v1865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:28:58 smithi196 ceph-mon[32572]: pgmap v1865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:28:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:28:58 smithi110 ceph-mon[28069]: pgmap v1865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:00 smithi193 ceph-mon[32782]: pgmap v1866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:00 smithi196 ceph-mon[32572]: pgmap v1866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:00 smithi110 ceph-mon[28069]: pgmap v1866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:01.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:29:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:29:01.461+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:29:01.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:29:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:29:01.461+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:29:01.793 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:29:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:29:01.461+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:29:01.794 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:29:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:29:01.461+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:29:01.794 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:29:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:29:01.461+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:29:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:02 smithi193 ceph-mon[32782]: pgmap v1867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2456.797527 secs 2024-04-26T12:29:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:02 smithi196 ceph-mon[32572]: pgmap v1867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:02.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2456.797527 secs 2024-04-26T12:29:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:02 smithi110 ceph-mon[28069]: pgmap v1867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2456.797527 secs 2024-04-26T12:29:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:04 smithi193 ceph-mon[32782]: pgmap v1868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:29:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:04 smithi196 ceph-mon[32572]: pgmap v1868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:29:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:04 smithi110 ceph-mon[28069]: pgmap v1868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:29:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:06 smithi193 ceph-mon[32782]: pgmap v1869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:29:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:06 smithi196 ceph-mon[32572]: pgmap v1869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:29:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:06 smithi110 ceph-mon[28069]: pgmap v1869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:29:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2461.797657 secs 2024-04-26T12:29:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2461.797657 secs 2024-04-26T12:29:07.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2461.797657 secs 2024-04-26T12:29:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:08 smithi193 ceph-mon[32782]: pgmap v1870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:29:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:08 smithi196 ceph-mon[32572]: pgmap v1870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:29:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:08 smithi110 ceph-mon[28069]: pgmap v1870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:29:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:10 smithi196 ceph-mon[32572]: pgmap v1871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:10 smithi110 ceph-mon[28069]: pgmap v1871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:29:10.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:10 smithi193 ceph-mon[32782]: pgmap v1871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:29:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:12 smithi196 ceph-mon[32572]: pgmap v1872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:29:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2466.797803 secs 2024-04-26T12:29:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:12 smithi110 ceph-mon[28069]: pgmap v1872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:29:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2466.797803 secs 2024-04-26T12:29:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:12 smithi193 ceph-mon[32782]: pgmap v1872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:29:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2466.797803 secs 2024-04-26T12:29:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:14 smithi196 ceph-mon[32572]: pgmap v1873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:29:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:14 smithi110 ceph-mon[28069]: pgmap v1873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:29:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:14 smithi193 ceph-mon[32782]: pgmap v1873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:29:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:16 smithi196 ceph-mon[32572]: pgmap v1874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:16 smithi110 ceph-mon[28069]: pgmap v1874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:16 smithi193 ceph-mon[32782]: pgmap v1874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2471.797920 secs 2024-04-26T12:29:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2471.797920 secs 2024-04-26T12:29:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2471.797920 secs 2024-04-26T12:29:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:18 smithi196 ceph-mon[32572]: pgmap v1875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:18 smithi110 ceph-mon[28069]: pgmap v1875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:18 smithi193 ceph-mon[32782]: pgmap v1875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:19 smithi196 ceph-mon[32572]: pgmap v1876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:19 smithi110 ceph-mon[28069]: pgmap v1876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:19 smithi193 ceph-mon[32782]: pgmap v1876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:29:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:29:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:29:21.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:29:21.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:29:21.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:21 smithi196 ceph-mon[32572]: pgmap v1877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T12:29:21.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:21 smithi196 ceph-mon[32572]: pgmap v1878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:21.509 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:29:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:29:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:29:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:21 smithi110 ceph-mon[28069]: pgmap v1877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T12:29:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:21 smithi110 ceph-mon[28069]: pgmap v1878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:29:21.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:29:21.624 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:29:21.624 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:21 smithi193 ceph-mon[32782]: pgmap v1877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T12:29:21.624 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:21 smithi193 ceph-mon[32782]: pgmap v1878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:21.624 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:29:22.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2476.798044 secs 2024-04-26T12:29:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2476.798044 secs 2024-04-26T12:29:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2476.798044 secs 2024-04-26T12:29:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:23 smithi196 ceph-mon[32572]: pgmap v1879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:23 smithi110 ceph-mon[28069]: pgmap v1879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:23 smithi193 ceph-mon[32782]: pgmap v1879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:25 smithi196 ceph-mon[32572]: pgmap v1880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:25 smithi110 ceph-mon[28069]: pgmap v1880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:25 smithi193 ceph-mon[32782]: pgmap v1880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2481.798168 secs 2024-04-26T12:29:27.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2481.798168 secs 2024-04-26T12:29:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2481.798168 secs 2024-04-26T12:29:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:27 smithi196 ceph-mon[32572]: pgmap v1881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:27 smithi110 ceph-mon[28069]: pgmap v1881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:27 smithi193 ceph-mon[32782]: pgmap v1881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:29 smithi196 ceph-mon[32572]: pgmap v1882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:29 smithi110 ceph-mon[28069]: pgmap v1882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:29 smithi193 ceph-mon[32782]: pgmap v1882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:29:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:29:31.744+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:29:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:29:31.744+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:29:31.748 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:29:31.747+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 23 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:29:31.748 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:29:31.747+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 23 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:29:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:31 smithi196 ceph-mon[32572]: pgmap v1883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:29:32.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2486.798304 secs 2024-04-26T12:29:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:31 smithi110 ceph-mon[28069]: pgmap v1883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:29:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2486.798304 secs 2024-04-26T12:29:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:31 smithi193 ceph-mon[32782]: pgmap v1883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:29:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2486.798304 secs 2024-04-26T12:29:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:33 smithi196 ceph-mon[32572]: pgmap v1884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:33 smithi110 ceph-mon[28069]: pgmap v1884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:33 smithi193 ceph-mon[32782]: pgmap v1884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:35 smithi196 ceph-mon[32572]: pgmap v1885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:35 smithi110 ceph-mon[28069]: pgmap v1885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:35 smithi193 ceph-mon[32782]: pgmap v1885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2491.798421 secs 2024-04-26T12:29:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2491.798421 secs 2024-04-26T12:29:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2491.798421 secs 2024-04-26T12:29:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:37 smithi110 ceph-mon[28069]: pgmap v1886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:37 smithi193 ceph-mon[32782]: pgmap v1886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:37 smithi196 ceph-mon[32572]: pgmap v1886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:39 smithi110 ceph-mon[28069]: pgmap v1887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:39 smithi193 ceph-mon[32782]: pgmap v1887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:39 smithi196 ceph-mon[32572]: pgmap v1887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:41 smithi110 ceph-mon[28069]: pgmap v1888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2496.798543 secs 2024-04-26T12:29:42.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:41 smithi196 ceph-mon[32572]: pgmap v1888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:42.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2496.798543 secs 2024-04-26T12:29:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:41 smithi193 ceph-mon[32782]: pgmap v1888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2496.798543 secs 2024-04-26T12:29:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:43 smithi110 ceph-mon[28069]: pgmap v1889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:43 smithi193 ceph-mon[32782]: pgmap v1889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:43 smithi196 ceph-mon[32572]: pgmap v1889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:45 smithi110 ceph-mon[28069]: pgmap v1890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:45 smithi193 ceph-mon[32782]: pgmap v1890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:45 smithi196 ceph-mon[32572]: pgmap v1890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2501.798670 secs 2024-04-26T12:29:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2501.798670 secs 2024-04-26T12:29:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2501.798670 secs 2024-04-26T12:29:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:47 smithi193 ceph-mon[32782]: pgmap v1891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:47 smithi196 ceph-mon[32572]: pgmap v1891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:47 smithi110 ceph-mon[28069]: pgmap v1891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:49 smithi193 ceph-mon[32782]: pgmap v1892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:49 smithi196 ceph-mon[32572]: pgmap v1892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:50.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:49 smithi110 ceph-mon[28069]: pgmap v1892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:52.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:51 smithi193 ceph-mon[32782]: pgmap v1893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:52.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2506.798782 secs 2024-04-26T12:29:52.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:51 smithi196 ceph-mon[32572]: pgmap v1893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:52.261 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2506.798782 secs 2024-04-26T12:29:52.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:51 smithi110 ceph-mon[28069]: pgmap v1893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:52.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2506.798782 secs 2024-04-26T12:29:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:53 smithi193 ceph-mon[32782]: pgmap v1894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:53 smithi196 ceph-mon[32572]: pgmap v1894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:53 smithi110 ceph-mon[28069]: pgmap v1894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:29:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:55 smithi193 ceph-mon[32782]: pgmap v1895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:55 smithi196 ceph-mon[32572]: pgmap v1895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:55 smithi110 ceph-mon[28069]: pgmap v1895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2511.798880 secs 2024-04-26T12:29:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2511.798880 secs 2024-04-26T12:29:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2511.798880 secs 2024-04-26T12:29:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:57 smithi193 ceph-mon[32782]: pgmap v1896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:57 smithi196 ceph-mon[32572]: pgmap v1896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:29:58.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:57 smithi110 ceph-mon[28069]: pgmap v1896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:00.084 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:29:59 smithi110 ceph-mon[28069]: pgmap v1897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:29:59 smithi193 ceph-mon[32782]: pgmap v1897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:29:59 smithi196 ceph-mon[32572]: pgmap v1897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:30:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:30:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:30:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:01 smithi193 ceph-mon[32782]: pgmap v1898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2516.798954 secs 2024-04-26T12:30:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:01 smithi196 ceph-mon[32572]: pgmap v1898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2516.798954 secs 2024-04-26T12:30:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:01 smithi110 ceph-mon[28069]: pgmap v1898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2516.798954 secs 2024-04-26T12:30:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:03 smithi193 ceph-mon[32782]: pgmap v1899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:03 smithi196 ceph-mon[32572]: pgmap v1899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:03 smithi110 ceph-mon[28069]: pgmap v1899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:05 smithi193 ceph-mon[32782]: pgmap v1900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:05 smithi196 ceph-mon[32572]: pgmap v1900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:05 smithi110 ceph-mon[28069]: pgmap v1900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2521.799030 secs 2024-04-26T12:30:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2521.799030 secs 2024-04-26T12:30:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2521.799030 secs 2024-04-26T12:30:08.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:07 smithi196 ceph-mon[32572]: pgmap v1901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:08.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:07 smithi110 ceph-mon[28069]: pgmap v1901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:07 smithi193 ceph-mon[32782]: pgmap v1901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:09 smithi196 ceph-mon[32572]: pgmap v1902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:09 smithi110 ceph-mon[28069]: pgmap v1902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:09 smithi193 ceph-mon[32782]: pgmap v1902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:11 smithi196 ceph-mon[32572]: pgmap v1903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2526.799152 secs 2024-04-26T12:30:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:11 smithi110 ceph-mon[28069]: pgmap v1903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2526.799152 secs 2024-04-26T12:30:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:11 smithi193 ceph-mon[32782]: pgmap v1903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2526.799152 secs 2024-04-26T12:30:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:13 smithi196 ceph-mon[32572]: pgmap v1904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:13 smithi110 ceph-mon[28069]: pgmap v1904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:13 smithi193 ceph-mon[32782]: pgmap v1904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:15 smithi196 ceph-mon[32572]: pgmap v1905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:15 smithi110 ceph-mon[28069]: pgmap v1905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:15 smithi193 ceph-mon[32782]: pgmap v1905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:16.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:30:16.752+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:30:16.753 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:30:16.752+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:30:16.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:30:16.753+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 24 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:30:16.754 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:30:16.753+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 24 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:30:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2531.799306 secs 2024-04-26T12:30:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2531.799306 secs 2024-04-26T12:30:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2531.799306 secs 2024-04-26T12:30:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:17 smithi196 ceph-mon[32572]: pgmap v1906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:17 smithi110 ceph-mon[28069]: pgmap v1906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:18.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:17 smithi193 ceph-mon[32782]: pgmap v1906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:19 smithi196 ceph-mon[32572]: pgmap v1907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:19 smithi110 ceph-mon[28069]: pgmap v1907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:19 smithi193 ceph-mon[32782]: pgmap v1907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:21 smithi196 ceph-mon[32572]: pgmap v1908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:30:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2536.799396 secs 2024-04-26T12:30:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:21 smithi110 ceph-mon[28069]: pgmap v1908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:30:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2536.799396 secs 2024-04-26T12:30:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:21 smithi193 ceph-mon[32782]: pgmap v1908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:30:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2536.799396 secs 2024-04-26T12:30:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:30:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:30:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:30:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:30:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:30:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:30:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:30:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:30:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:30:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:23 smithi196 ceph-mon[32572]: pgmap v1909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T12:30:24.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:23 smithi196 ceph-mon[32572]: pgmap v1910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T12:30:24.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:23 smithi110 ceph-mon[28069]: pgmap v1909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T12:30:24.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:23 smithi110 ceph-mon[28069]: pgmap v1910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T12:30:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:23 smithi193 ceph-mon[32782]: pgmap v1909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T12:30:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:23 smithi193 ceph-mon[32782]: pgmap v1910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T12:30:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:25 smithi196 ceph-mon[32572]: pgmap v1911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:25 smithi110 ceph-mon[28069]: pgmap v1911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:26.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:25 smithi193 ceph-mon[32782]: pgmap v1911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2541.799516 secs 2024-04-26T12:30:27.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2541.799516 secs 2024-04-26T12:30:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2541.799516 secs 2024-04-26T12:30:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:27 smithi196 ceph-mon[32572]: pgmap v1912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:27 smithi110 ceph-mon[28069]: pgmap v1912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:27 smithi193 ceph-mon[32782]: pgmap v1912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:29 smithi196 ceph-mon[32572]: pgmap v1913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:29 smithi110 ceph-mon[28069]: pgmap v1913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:29 smithi193 ceph-mon[32782]: pgmap v1913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:31 smithi196 ceph-mon[32572]: pgmap v1914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:32.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2546.799618 secs 2024-04-26T12:30:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:31 smithi110 ceph-mon[28069]: pgmap v1914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2546.799618 secs 2024-04-26T12:30:32.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:31 smithi193 ceph-mon[32782]: pgmap v1914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:30:32.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2546.799618 secs 2024-04-26T12:30:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:33 smithi196 ceph-mon[32572]: pgmap v1915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:30:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:33 smithi110 ceph-mon[28069]: pgmap v1915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:30:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:33 smithi193 ceph-mon[32782]: pgmap v1915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:30:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:35 smithi196 ceph-mon[32572]: pgmap v1916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:35 smithi110 ceph-mon[28069]: pgmap v1916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:35 smithi193 ceph-mon[32782]: pgmap v1916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2551.799750 secs 2024-04-26T12:30:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2551.799750 secs 2024-04-26T12:30:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2551.799750 secs 2024-04-26T12:30:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:37 smithi196 ceph-mon[32572]: pgmap v1917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:37 smithi110 ceph-mon[28069]: pgmap v1917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:37 smithi193 ceph-mon[32782]: pgmap v1917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:39 smithi196 ceph-mon[32572]: pgmap v1918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:39 smithi110 ceph-mon[28069]: pgmap v1918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:39 smithi193 ceph-mon[32782]: pgmap v1918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:41 smithi196 ceph-mon[32572]: pgmap v1919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2556.799832 secs 2024-04-26T12:30:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:41 smithi110 ceph-mon[28069]: pgmap v1919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2556.799832 secs 2024-04-26T12:30:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:41 smithi193 ceph-mon[32782]: pgmap v1919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2556.799832 secs 2024-04-26T12:30:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:44 smithi196 ceph-mon[32572]: pgmap v1920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:44.296 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:44 smithi110 ceph-mon[28069]: pgmap v1920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:44 smithi193 ceph-mon[32782]: pgmap v1920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:46 smithi110 ceph-mon[28069]: pgmap v1921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:46 smithi193 ceph-mon[32782]: pgmap v1921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:46 smithi196 ceph-mon[32572]: pgmap v1921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:47.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2561.799943 secs 2024-04-26T12:30:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2561.799943 secs 2024-04-26T12:30:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2561.799943 secs 2024-04-26T12:30:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:48 smithi110 ceph-mon[28069]: pgmap v1922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:48 smithi193 ceph-mon[32782]: pgmap v1922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:48 smithi196 ceph-mon[32572]: pgmap v1922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:50.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:50 smithi110 ceph-mon[28069]: pgmap v1923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:50 smithi193 ceph-mon[32782]: pgmap v1923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:50 smithi196 ceph-mon[32572]: pgmap v1923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:52 smithi110 ceph-mon[28069]: pgmap v1924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2566.800062 secs 2024-04-26T12:30:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:52 smithi193 ceph-mon[32782]: pgmap v1924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2566.800062 secs 2024-04-26T12:30:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:52 smithi196 ceph-mon[32572]: pgmap v1924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2566.800062 secs 2024-04-26T12:30:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:54 smithi110 ceph-mon[28069]: pgmap v1925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:54 smithi193 ceph-mon[32782]: pgmap v1925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:54 smithi196 ceph-mon[32572]: pgmap v1925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:56 smithi110 ceph-mon[28069]: pgmap v1926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:56 smithi193 ceph-mon[32782]: pgmap v1926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:56 smithi196 ceph-mon[32572]: pgmap v1926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:30:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2571.800199 secs 2024-04-26T12:30:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2571.800199 secs 2024-04-26T12:30:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2571.800199 secs 2024-04-26T12:30:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:30:58 smithi193 ceph-mon[32782]: pgmap v1927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:30:58 smithi196 ceph-mon[32572]: pgmap v1927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:30:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:30:58 smithi110 ceph-mon[28069]: pgmap v1927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:00 smithi193 ceph-mon[32782]: pgmap v1928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:00 smithi196 ceph-mon[32572]: pgmap v1928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:00 smithi110 ceph-mon[28069]: pgmap v1928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:02 smithi193 ceph-mon[32782]: pgmap v1929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2576.800296 secs 2024-04-26T12:31:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:02 smithi196 ceph-mon[32572]: pgmap v1929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:02.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2576.800296 secs 2024-04-26T12:31:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:02 smithi110 ceph-mon[28069]: pgmap v1929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2576.800296 secs 2024-04-26T12:31:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:04 smithi193 ceph-mon[32782]: pgmap v1930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:04 smithi196 ceph-mon[32572]: pgmap v1930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:04 smithi110 ceph-mon[28069]: pgmap v1930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:06 smithi193 ceph-mon[32782]: pgmap v1931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:06 smithi196 ceph-mon[32572]: pgmap v1931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:06 smithi110 ceph-mon[28069]: pgmap v1931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2581.800410 secs 2024-04-26T12:31:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2581.800410 secs 2024-04-26T12:31:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2581.800410 secs 2024-04-26T12:31:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:08 smithi193 ceph-mon[32782]: pgmap v1932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:08 smithi196 ceph-mon[32572]: pgmap v1932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:08 smithi110 ceph-mon[28069]: pgmap v1932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:10 smithi193 ceph-mon[32782]: pgmap v1933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:10 smithi196 ceph-mon[32572]: pgmap v1933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:10 smithi110 ceph-mon[28069]: pgmap v1933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:12 smithi193 ceph-mon[32782]: pgmap v1934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2586.800543 secs 2024-04-26T12:31:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:12 smithi196 ceph-mon[32572]: pgmap v1934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2586.800543 secs 2024-04-26T12:31:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:12 smithi110 ceph-mon[28069]: pgmap v1934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2586.800543 secs 2024-04-26T12:31:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:14 smithi193 ceph-mon[32782]: pgmap v1935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:14 smithi196 ceph-mon[32572]: pgmap v1935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:14 smithi110 ceph-mon[28069]: pgmap v1935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:16 smithi193 ceph-mon[32782]: pgmap v1936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:16 smithi196 ceph-mon[32572]: pgmap v1936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:16 smithi110 ceph-mon[28069]: pgmap v1936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:17.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2591.800662 secs 2024-04-26T12:31:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2591.800662 secs 2024-04-26T12:31:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2591.800662 secs 2024-04-26T12:31:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:18 smithi193 ceph-mon[32782]: pgmap v1937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:18 smithi196 ceph-mon[32572]: pgmap v1937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:18 smithi110 ceph-mon[28069]: pgmap v1937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:20 smithi196 ceph-mon[32572]: pgmap v1938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:20 smithi110 ceph-mon[28069]: pgmap v1938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:20 smithi193 ceph-mon[32782]: pgmap v1938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:22 smithi196 ceph-mon[32572]: pgmap v1939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2596.800755 secs 2024-04-26T12:31:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:22 smithi110 ceph-mon[28069]: pgmap v1939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2596.800755 secs 2024-04-26T12:31:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:22 smithi193 ceph-mon[32782]: pgmap v1939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2596.800755 secs 2024-04-26T12:31:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:31:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:31:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:31:24.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:24 smithi196 ceph-mon[32572]: pgmap v1940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:24.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:31:24.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:31:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:24 smithi110 ceph-mon[28069]: pgmap v1940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:31:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:31:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:24 smithi193 ceph-mon[32782]: pgmap v1940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:31:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:31:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:31:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:31:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:31:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:31:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:31:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:31:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:31:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:31:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:31:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:26 smithi196 ceph-mon[32572]: pgmap v1941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:26.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:26 smithi196 ceph-mon[32572]: pgmap v1942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T12:31:26.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:26 smithi196 ceph-mon[32572]: pgmap v1943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:26 smithi110 ceph-mon[28069]: pgmap v1941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:26 smithi110 ceph-mon[28069]: pgmap v1942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T12:31:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:26 smithi110 ceph-mon[28069]: pgmap v1943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:26 smithi193 ceph-mon[32782]: pgmap v1941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:26 smithi193 ceph-mon[32782]: pgmap v1942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T12:31:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:26 smithi193 ceph-mon[32782]: pgmap v1943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2601.800873 secs 2024-04-26T12:31:27.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2601.800873 secs 2024-04-26T12:31:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2601.800873 secs 2024-04-26T12:31:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:28 smithi196 ceph-mon[32572]: pgmap v1944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T12:31:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:28 smithi110 ceph-mon[28069]: pgmap v1944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T12:31:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:28 smithi193 ceph-mon[32782]: pgmap v1944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T12:31:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:30 smithi196 ceph-mon[32572]: pgmap v1945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:30.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:30 smithi110 ceph-mon[28069]: pgmap v1945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:30 smithi193 ceph-mon[32782]: pgmap v1945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:31 smithi196 ceph-mon[32572]: pgmap v1946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T12:31:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:31 smithi110 ceph-mon[28069]: pgmap v1946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T12:31:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:31 smithi193 ceph-mon[32782]: pgmap v1946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T12:31:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2606.800982 secs 2024-04-26T12:31:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2606.800982 secs 2024-04-26T12:31:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2606.800982 secs 2024-04-26T12:31:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:33 smithi196 ceph-mon[32572]: pgmap v1947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:33 smithi110 ceph-mon[28069]: pgmap v1947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:33 smithi193 ceph-mon[32782]: pgmap v1947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:35 smithi196 ceph-mon[32572]: pgmap v1948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:31:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:35 smithi110 ceph-mon[28069]: pgmap v1948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:31:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:35 smithi193 ceph-mon[32782]: pgmap v1948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:31:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2611.801095 secs 2024-04-26T12:31:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2611.801095 secs 2024-04-26T12:31:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2611.801095 secs 2024-04-26T12:31:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:37 smithi196 ceph-mon[32572]: pgmap v1949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:37 smithi110 ceph-mon[28069]: pgmap v1949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:37 smithi193 ceph-mon[32782]: pgmap v1949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:39 smithi196 ceph-mon[32572]: pgmap v1950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:39 smithi110 ceph-mon[28069]: pgmap v1950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:39 smithi193 ceph-mon[32782]: pgmap v1950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:41 smithi196 ceph-mon[32572]: pgmap v1951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2616.801216 secs 2024-04-26T12:31:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:41 smithi110 ceph-mon[28069]: pgmap v1951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2616.801216 secs 2024-04-26T12:31:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:41 smithi193 ceph-mon[32782]: pgmap v1951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2616.801216 secs 2024-04-26T12:31:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:43 smithi196 ceph-mon[32572]: pgmap v1952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:43 smithi110 ceph-mon[28069]: pgmap v1952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:43 smithi193 ceph-mon[32782]: pgmap v1952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:45 smithi196 ceph-mon[32572]: pgmap v1953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:45 smithi110 ceph-mon[28069]: pgmap v1953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:45 smithi193 ceph-mon[32782]: pgmap v1953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2621.801334 secs 2024-04-26T12:31:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2621.801334 secs 2024-04-26T12:31:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2621.801334 secs 2024-04-26T12:31:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:47 smithi196 ceph-mon[32572]: pgmap v1954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:47 smithi110 ceph-mon[28069]: pgmap v1954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:47 smithi193 ceph-mon[32782]: pgmap v1954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:49 smithi196 ceph-mon[32572]: pgmap v1955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:49 smithi110 ceph-mon[28069]: pgmap v1955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:49 smithi193 ceph-mon[32782]: pgmap v1955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:51 smithi196 ceph-mon[32572]: pgmap v1956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2626.801455 secs 2024-04-26T12:31:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:51 smithi110 ceph-mon[28069]: pgmap v1956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2626.801455 secs 2024-04-26T12:31:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:51 smithi193 ceph-mon[32782]: pgmap v1956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2626.801455 secs 2024-04-26T12:31:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:53 smithi196 ceph-mon[32572]: pgmap v1957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:53 smithi110 ceph-mon[28069]: pgmap v1957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:53 smithi193 ceph-mon[32782]: pgmap v1957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:31:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:55 smithi196 ceph-mon[32572]: pgmap v1958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:55 smithi110 ceph-mon[28069]: pgmap v1958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:55 smithi193 ceph-mon[32782]: pgmap v1958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:57.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2631.801593 secs 2024-04-26T12:31:57.024 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2631.801593 secs 2024-04-26T12:31:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2631.801593 secs 2024-04-26T12:31:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:57 smithi196 ceph-mon[32572]: pgmap v1959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:57 smithi110 ceph-mon[28069]: pgmap v1959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:31:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:57 smithi193 ceph-mon[32782]: pgmap v1959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:31:59 smithi196 ceph-mon[32572]: pgmap v1960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:31:59 smithi110 ceph-mon[28069]: pgmap v1960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:31:59 smithi193 ceph-mon[32782]: pgmap v1960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:01 smithi196 ceph-mon[32572]: pgmap v1961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2636.801734 secs 2024-04-26T12:32:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:01 smithi110 ceph-mon[28069]: pgmap v1961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2636.801734 secs 2024-04-26T12:32:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:01 smithi193 ceph-mon[32782]: pgmap v1961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2636.801734 secs 2024-04-26T12:32:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:03 smithi196 ceph-mon[32572]: pgmap v1962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:03 smithi110 ceph-mon[28069]: pgmap v1962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:03 smithi193 ceph-mon[32782]: pgmap v1962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:05 smithi196 ceph-mon[32572]: pgmap v1963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:05 smithi110 ceph-mon[28069]: pgmap v1963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:05 smithi193 ceph-mon[32782]: pgmap v1963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2641.801800 secs 2024-04-26T12:32:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2641.801800 secs 2024-04-26T12:32:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2641.801800 secs 2024-04-26T12:32:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:07 smithi110 ceph-mon[28069]: pgmap v1964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:07 smithi193 ceph-mon[32782]: pgmap v1964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:07 smithi196 ceph-mon[32572]: pgmap v1964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:09 smithi110 ceph-mon[28069]: pgmap v1965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:09 smithi193 ceph-mon[32782]: pgmap v1965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:09 smithi196 ceph-mon[32572]: pgmap v1965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:11 smithi110 ceph-mon[28069]: pgmap v1966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2646.801928 secs 2024-04-26T12:32:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:11 smithi193 ceph-mon[32782]: pgmap v1966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2646.801928 secs 2024-04-26T12:32:12.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:11 smithi196 ceph-mon[32572]: pgmap v1966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:12.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2646.801928 secs 2024-04-26T12:32:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:13 smithi110 ceph-mon[28069]: pgmap v1967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:14.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:13 smithi196 ceph-mon[32572]: pgmap v1967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:13 smithi193 ceph-mon[32782]: pgmap v1967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:15 smithi110 ceph-mon[28069]: pgmap v1968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:32:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:15 smithi193 ceph-mon[32782]: pgmap v1968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:32:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:15 smithi196 ceph-mon[32572]: pgmap v1968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:32:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2651.802043 secs 2024-04-26T12:32:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2651.802043 secs 2024-04-26T12:32:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2651.802043 secs 2024-04-26T12:32:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:17 smithi110 ceph-mon[28069]: pgmap v1969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:32:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:17 smithi193 ceph-mon[32782]: pgmap v1969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:32:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:17 smithi196 ceph-mon[32572]: pgmap v1969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:32:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:19 smithi193 ceph-mon[32782]: pgmap v1970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:19 smithi196 ceph-mon[32572]: pgmap v1970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:20.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:19 smithi110 ceph-mon[28069]: pgmap v1970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:21 smithi193 ceph-mon[32782]: pgmap v1971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:32:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2656.802148 secs 2024-04-26T12:32:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:21 smithi196 ceph-mon[32572]: pgmap v1971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:32:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2656.802148 secs 2024-04-26T12:32:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:21 smithi110 ceph-mon[28069]: pgmap v1971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:32:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2656.802148 secs 2024-04-26T12:32:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:23 smithi193 ceph-mon[32782]: pgmap v1972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:23 smithi196 ceph-mon[32572]: pgmap v1972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:23 smithi110 ceph-mon[28069]: pgmap v1972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:25 smithi193 ceph-mon[32782]: pgmap v1973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:32:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:25 smithi196 ceph-mon[32572]: pgmap v1973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:32:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:25 smithi110 ceph-mon[28069]: pgmap v1973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:32:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2661.802248 secs 2024-04-26T12:32:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2661.802248 secs 2024-04-26T12:32:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2661.802248 secs 2024-04-26T12:32:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:27 smithi193 ceph-mon[32782]: pgmap v1974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:32:28.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:32:28.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:27 smithi193 ceph-mon[32782]: pgmap v1975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s rd, 1 op/s 2024-04-26T12:32:28.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:27 smithi193 ceph-mon[32782]: pgmap v1976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:32:28.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:27 smithi196 ceph-mon[32572]: pgmap v1974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:32:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:32:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:27 smithi196 ceph-mon[32572]: pgmap v1975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s rd, 1 op/s 2024-04-26T12:32:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:27 smithi196 ceph-mon[32572]: pgmap v1976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:32:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:27 smithi110 ceph-mon[28069]: pgmap v1974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:32:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:32:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:27 smithi110 ceph-mon[28069]: pgmap v1975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s rd, 1 op/s 2024-04-26T12:32:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:27 smithi110 ceph-mon[28069]: pgmap v1976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:32:28.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:32:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:30 smithi196 ceph-mon[32572]: pgmap v1977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:30.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:30 smithi110 ceph-mon[28069]: pgmap v1977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:30 smithi193 ceph-mon[32782]: pgmap v1977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:32 smithi196 ceph-mon[32572]: pgmap v1978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2666.802402 secs 2024-04-26T12:32:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:32 smithi110 ceph-mon[28069]: pgmap v1978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:32:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2666.802402 secs 2024-04-26T12:32:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:32 smithi193 ceph-mon[32782]: pgmap v1978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T12:32:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2666.802402 secs 2024-04-26T12:32:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:34 smithi196 ceph-mon[32572]: pgmap v1979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:34 smithi110 ceph-mon[28069]: pgmap v1979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:34 smithi193 ceph-mon[32782]: pgmap v1979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:36 smithi196 ceph-mon[32572]: pgmap v1980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:36 smithi110 ceph-mon[28069]: pgmap v1980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:36 smithi193 ceph-mon[32782]: pgmap v1980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2671.802518 secs 2024-04-26T12:32:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2671.802518 secs 2024-04-26T12:32:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2671.802518 secs 2024-04-26T12:32:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:38 smithi196 ceph-mon[32572]: pgmap v1981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:32:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:38 smithi110 ceph-mon[28069]: pgmap v1981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:32:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:38 smithi193 ceph-mon[32782]: pgmap v1981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:32:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:39 smithi196 ceph-mon[32572]: pgmap v1982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:39 smithi110 ceph-mon[28069]: pgmap v1982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:39 smithi193 ceph-mon[32782]: pgmap v1982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:42 smithi196 ceph-mon[32572]: pgmap v1983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2676.802671 secs 2024-04-26T12:32:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:42 smithi110 ceph-mon[28069]: pgmap v1983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2676.802671 secs 2024-04-26T12:32:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:42 smithi193 ceph-mon[32782]: pgmap v1983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2676.802671 secs 2024-04-26T12:32:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:44 smithi196 ceph-mon[32572]: pgmap v1984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:44 smithi110 ceph-mon[28069]: pgmap v1984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:44 smithi193 ceph-mon[32782]: pgmap v1984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:46 smithi196 ceph-mon[32572]: pgmap v1985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:46 smithi110 ceph-mon[28069]: pgmap v1985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:46 smithi193 ceph-mon[32782]: pgmap v1985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2681.802791 secs 2024-04-26T12:32:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2681.802791 secs 2024-04-26T12:32:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2681.802791 secs 2024-04-26T12:32:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:48 smithi196 ceph-mon[32572]: pgmap v1986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:48 smithi110 ceph-mon[28069]: pgmap v1986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:48 smithi193 ceph-mon[32782]: pgmap v1986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:50 smithi196 ceph-mon[32572]: pgmap v1987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:50 smithi110 ceph-mon[28069]: pgmap v1987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:50 smithi193 ceph-mon[32782]: pgmap v1987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:51 smithi196 ceph-mon[32572]: pgmap v1988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:51 smithi110 ceph-mon[28069]: pgmap v1988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:51 smithi193 ceph-mon[32782]: pgmap v1988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2686.802909 secs 2024-04-26T12:32:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2686.802909 secs 2024-04-26T12:32:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2686.802909 secs 2024-04-26T12:32:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:53 smithi196 ceph-mon[32572]: pgmap v1989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:53 smithi110 ceph-mon[28069]: pgmap v1989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:53 smithi193 ceph-mon[32782]: pgmap v1989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:32:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:56 smithi196 ceph-mon[32572]: pgmap v1990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:56 smithi110 ceph-mon[28069]: pgmap v1990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:56 smithi193 ceph-mon[32782]: pgmap v1990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2691.803022 secs 2024-04-26T12:32:57.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2691.803022 secs 2024-04-26T12:32:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2691.803022 secs 2024-04-26T12:32:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:32:58 smithi196 ceph-mon[32572]: pgmap v1991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:32:58 smithi110 ceph-mon[28069]: pgmap v1991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:32:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:32:58 smithi193 ceph-mon[32782]: pgmap v1991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:00 smithi196 ceph-mon[32572]: pgmap v1992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:00 smithi110 ceph-mon[28069]: pgmap v1992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:00 smithi193 ceph-mon[32782]: pgmap v1992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2696.803143 secs 2024-04-26T12:33:02.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:02 smithi196 ceph-mon[32572]: pgmap v1993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2696.803143 secs 2024-04-26T12:33:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:02 smithi110 ceph-mon[28069]: pgmap v1993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2696.803143 secs 2024-04-26T12:33:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:02 smithi193 ceph-mon[32782]: pgmap v1993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:03 smithi196 ceph-mon[32572]: pgmap v1994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:03 smithi110 ceph-mon[28069]: pgmap v1994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:03 smithi193 ceph-mon[32782]: pgmap v1994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:06 smithi196 ceph-mon[32572]: pgmap v1995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:06 smithi110 ceph-mon[28069]: pgmap v1995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:06 smithi193 ceph-mon[32782]: pgmap v1995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2701.803239 secs 2024-04-26T12:33:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2701.803239 secs 2024-04-26T12:33:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2701.803239 secs 2024-04-26T12:33:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:08 smithi196 ceph-mon[32572]: pgmap v1996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:08 smithi110 ceph-mon[28069]: pgmap v1996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:08 smithi193 ceph-mon[32782]: pgmap v1996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:10 smithi196 ceph-mon[32572]: pgmap v1997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:10 smithi110 ceph-mon[28069]: pgmap v1997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:10 smithi193 ceph-mon[32782]: pgmap v1997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:11 smithi196 ceph-mon[32572]: pgmap v1998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:11 smithi110 ceph-mon[28069]: pgmap v1998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:11 smithi193 ceph-mon[32782]: pgmap v1998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2706.803350 secs 2024-04-26T12:33:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2706.803350 secs 2024-04-26T12:33:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2706.803350 secs 2024-04-26T12:33:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:13 smithi196 ceph-mon[32572]: pgmap v1999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:13 smithi110 ceph-mon[28069]: pgmap v1999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:13 smithi193 ceph-mon[32782]: pgmap v1999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.360+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 msgr2=0x7f26000b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T12:33:16.361 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.360+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 msgr2=0x7f26000b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T12:33:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.360+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000b3170 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2614029000 tx=0x7f261401e040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:33:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.360+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000b3170 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2614029000 tx=0x7f261401e040 comp rx=0 tx=0).stop 2024-04-26T12:33:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.360+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 msgr2=0x7f26000b3170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T12:33:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.360+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 msgr2=0x7f26000b3170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T12:33:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.360+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a3dc0 0x7f26000b3170 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.360+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 0x7f26000b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:16.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.361+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 0x7f26000b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:16.363 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.362+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 0x7f26000b1210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f260c0038f0 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.391+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T12:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.391+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T12:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.391+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.391+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T12:33:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.392+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.393+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T12:33:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.393+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T12:33:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:16 smithi196 ceph-mon[32572]: pgmap v2000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:16 smithi110 ceph-mon[28069]: pgmap v2000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:16 smithi193 ceph-mon[32782]: pgmap v2000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.782+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:33:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.782+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:33:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.783+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 25 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:33:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:33:16.783+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 25 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:33:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2711.803467 secs 2024-04-26T12:33:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2711.803467 secs 2024-04-26T12:33:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2711.803467 secs 2024-04-26T12:33:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:18 smithi196 ceph-mon[32572]: pgmap v2001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:18 smithi110 ceph-mon[28069]: pgmap v2001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:18 smithi193 ceph-mon[32782]: pgmap v2001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:19 smithi196 ceph-mon[32572]: pgmap v2002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:19 smithi110 ceph-mon[28069]: pgmap v2002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:19 smithi193 ceph-mon[32782]: pgmap v2002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2716.803599 secs 2024-04-26T12:33:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:22 smithi196 ceph-mon[32572]: pgmap v2003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2716.803599 secs 2024-04-26T12:33:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:22 smithi110 ceph-mon[28069]: pgmap v2003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2716.803599 secs 2024-04-26T12:33:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:22 smithi193 ceph-mon[32782]: pgmap v2003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:24 smithi196 ceph-mon[32572]: pgmap v2004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:24 smithi110 ceph-mon[28069]: pgmap v2004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:24 smithi193 ceph-mon[32782]: pgmap v2004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:26 smithi196 ceph-mon[32572]: pgmap v2005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:26 smithi110 ceph-mon[28069]: pgmap v2005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:26 smithi193 ceph-mon[32782]: pgmap v2005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2721.803702 secs 2024-04-26T12:33:27.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2721.803702 secs 2024-04-26T12:33:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2721.803702 secs 2024-04-26T12:33:28.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:28 smithi196 ceph-mon[32572]: pgmap v2006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:28.453 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:33:28.506 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:28 smithi193 ceph-mon[32782]: pgmap v2006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:28.506 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:33:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:28 smithi110 ceph-mon[28069]: pgmap v2006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:33:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:29 smithi196 ceph-mon[32572]: pgmap v2007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:29 smithi110 ceph-mon[28069]: pgmap v2007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:29 smithi193 ceph-mon[32782]: pgmap v2007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:33:30.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:30.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:31 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:33:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:31 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:33:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:31 smithi196 ceph-mon[32572]: pgmap v2008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:31 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:33:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:31 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:33:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:31 smithi110 ceph-mon[28069]: pgmap v2008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:31 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:33:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:31 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:33:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:31 smithi193 ceph-mon[32782]: pgmap v2008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2726.803830 secs 2024-04-26T12:33:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2726.803830 secs 2024-04-26T12:33:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2726.803830 secs 2024-04-26T12:33:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: pgmap v2009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: pgmap v2010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:33.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:33:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:33:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:33:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:33:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: pgmap v2009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:33:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: pgmap v2010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: pgmap v2009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: pgmap v2010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:33:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:35 smithi110 ceph-mon[28069]: pgmap v2011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:35 smithi193 ceph-mon[32782]: pgmap v2011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:36.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:35 smithi196 ceph-mon[32572]: pgmap v2011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2731.803961 secs 2024-04-26T12:33:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2731.803961 secs 2024-04-26T12:33:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2731.803961 secs 2024-04-26T12:33:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:37 smithi193 ceph-mon[32782]: pgmap v2012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:37 smithi196 ceph-mon[32572]: pgmap v2012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:37 smithi110 ceph-mon[28069]: pgmap v2012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:39 smithi193 ceph-mon[32782]: pgmap v2013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:39 smithi196 ceph-mon[32572]: pgmap v2013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:39 smithi110 ceph-mon[28069]: pgmap v2013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:41 smithi193 ceph-mon[32782]: pgmap v2014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2736.804073 secs 2024-04-26T12:33:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:41 smithi196 ceph-mon[32572]: pgmap v2014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2736.804073 secs 2024-04-26T12:33:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:41 smithi110 ceph-mon[28069]: pgmap v2014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:33:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2736.804073 secs 2024-04-26T12:33:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:43 smithi193 ceph-mon[32782]: pgmap v2015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:33:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:43 smithi196 ceph-mon[32572]: pgmap v2015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:33:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:43 smithi110 ceph-mon[28069]: pgmap v2015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:33:46.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:45 smithi110 ceph-mon[28069]: pgmap v2016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:45 smithi193 ceph-mon[32782]: pgmap v2016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:45 smithi196 ceph-mon[32572]: pgmap v2016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:47.120 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2741.804194 secs 2024-04-26T12:33:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2741.804194 secs 2024-04-26T12:33:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2741.804194 secs 2024-04-26T12:33:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:47 smithi193 ceph-mon[32782]: pgmap v2017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:47 smithi196 ceph-mon[32572]: pgmap v2017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:48.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:47 smithi110 ceph-mon[28069]: pgmap v2017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:49 smithi193 ceph-mon[32782]: pgmap v2018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:49 smithi196 ceph-mon[32572]: pgmap v2018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:50.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:49 smithi110 ceph-mon[28069]: pgmap v2018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:51 smithi193 ceph-mon[32782]: pgmap v2019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2746.804333 secs 2024-04-26T12:33:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:51 smithi196 ceph-mon[32572]: pgmap v2019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:52.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2746.804333 secs 2024-04-26T12:33:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:51 smithi110 ceph-mon[28069]: pgmap v2019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2746.804333 secs 2024-04-26T12:33:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:53 smithi193 ceph-mon[32782]: pgmap v2020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:53 smithi196 ceph-mon[32572]: pgmap v2020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:53 smithi110 ceph-mon[28069]: pgmap v2020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:33:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:55 smithi193 ceph-mon[32782]: pgmap v2021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:55 smithi196 ceph-mon[32572]: pgmap v2021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:55 smithi110 ceph-mon[28069]: pgmap v2021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2751.804451 secs 2024-04-26T12:33:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2751.804451 secs 2024-04-26T12:33:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2751.804451 secs 2024-04-26T12:33:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:57 smithi193 ceph-mon[32782]: pgmap v2022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:58.146 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:57 smithi110 ceph-mon[28069]: pgmap v2022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:33:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:57 smithi196 ceph-mon[32572]: pgmap v2022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:33:59 smithi196 ceph-mon[32572]: pgmap v2023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:33:59 smithi110 ceph-mon[28069]: pgmap v2023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:33:59 smithi193 ceph-mon[32782]: pgmap v2023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:01 smithi110 ceph-mon[28069]: pgmap v2024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2756.804588 secs 2024-04-26T12:34:02.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:34:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:34:01.655+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:34:02.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:34:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:34:01.655+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:34:02.043 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:34:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:34:01.655+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:34:02.043 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:34:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:34:01.655+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:34:02.043 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:34:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:34:01.655+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:34:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:01 smithi196 ceph-mon[32572]: pgmap v2024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2756.804588 secs 2024-04-26T12:34:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:01 smithi193 ceph-mon[32782]: pgmap v2024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2756.804588 secs 2024-04-26T12:34:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:03 smithi196 ceph-mon[32572]: pgmap v2025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:03 smithi110 ceph-mon[28069]: pgmap v2025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:03 smithi193 ceph-mon[32782]: pgmap v2025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:05 smithi196 ceph-mon[32572]: pgmap v2026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:05 smithi110 ceph-mon[28069]: pgmap v2026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:05 smithi193 ceph-mon[32782]: pgmap v2026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2761.804687 secs 2024-04-26T12:34:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2761.804687 secs 2024-04-26T12:34:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2761.804687 secs 2024-04-26T12:34:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:07 smithi196 ceph-mon[32572]: pgmap v2027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:07 smithi110 ceph-mon[28069]: pgmap v2027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:07 smithi193 ceph-mon[32782]: pgmap v2027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:09 smithi196 ceph-mon[32572]: pgmap v2028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:10.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:09 smithi110 ceph-mon[28069]: pgmap v2028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:09 smithi193 ceph-mon[32782]: pgmap v2028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:11 smithi196 ceph-mon[32572]: pgmap v2029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2766.804804 secs 2024-04-26T12:34:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:11 smithi110 ceph-mon[28069]: pgmap v2029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2766.804804 secs 2024-04-26T12:34:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:11 smithi193 ceph-mon[32782]: pgmap v2029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2766.804804 secs 2024-04-26T12:34:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:13 smithi196 ceph-mon[32572]: pgmap v2030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:13 smithi110 ceph-mon[28069]: pgmap v2030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:13 smithi193 ceph-mon[32782]: pgmap v2030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T12:34:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:15 smithi196 ceph-mon[32572]: pgmap v2031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T12:34:16.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:15 smithi110 ceph-mon[28069]: pgmap v2031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T12:34:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:15 smithi193 ceph-mon[32782]: pgmap v2031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T12:34:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2771.804915 secs 2024-04-26T12:34:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2771.804915 secs 2024-04-26T12:34:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2771.804915 secs 2024-04-26T12:34:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:17 smithi196 ceph-mon[32572]: pgmap v2032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T12:34:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:17 smithi110 ceph-mon[28069]: pgmap v2032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T12:34:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:17 smithi193 ceph-mon[32782]: pgmap v2032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T12:34:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:19 smithi196 ceph-mon[32572]: pgmap v2033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:34:20.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:19 smithi110 ceph-mon[28069]: pgmap v2033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:34:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:19 smithi193 ceph-mon[32782]: pgmap v2033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:34:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:21 smithi196 ceph-mon[32572]: pgmap v2034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2776.805026 secs 2024-04-26T12:34:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:21 smithi110 ceph-mon[28069]: pgmap v2034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2776.805026 secs 2024-04-26T12:34:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:21 smithi193 ceph-mon[32782]: pgmap v2034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2776.805026 secs 2024-04-26T12:34:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:23 smithi196 ceph-mon[32572]: pgmap v2035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:23 smithi110 ceph-mon[28069]: pgmap v2035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:23 smithi193 ceph-mon[32782]: pgmap v2035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:25 smithi196 ceph-mon[32572]: pgmap v2036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:26.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:25 smithi110 ceph-mon[28069]: pgmap v2036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:25 smithi193 ceph-mon[32782]: pgmap v2036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2781.805163 secs 2024-04-26T12:34:27.274 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2781.805163 secs 2024-04-26T12:34:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2781.805163 secs 2024-04-26T12:34:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:27 smithi196 ceph-mon[32572]: pgmap v2037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:27 smithi110 ceph-mon[28069]: pgmap v2037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:27 smithi193 ceph-mon[32782]: pgmap v2037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:30.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:29 smithi196 ceph-mon[32572]: pgmap v2038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:29 smithi110 ceph-mon[28069]: pgmap v2038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:29 smithi193 ceph-mon[32782]: pgmap v2038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:31 smithi196 ceph-mon[32572]: pgmap v2039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2786.805304 secs 2024-04-26T12:34:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:31 smithi110 ceph-mon[28069]: pgmap v2039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2786.805304 secs 2024-04-26T12:34:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:31 smithi193 ceph-mon[32782]: pgmap v2039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2786.805304 secs 2024-04-26T12:34:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:33 smithi196 ceph-mon[32572]: pgmap v2040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:34.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:34:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:33 smithi110 ceph-mon[28069]: pgmap v2040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:34:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:33 smithi193 ceph-mon[32782]: pgmap v2040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:34:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:34:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:34:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:34:35.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:34:35.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:34:35.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:34:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:34:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:34:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:34:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:36 smithi110 ceph-mon[28069]: pgmap v2041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T12:34:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:36 smithi110 ceph-mon[28069]: pgmap v2042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:36 smithi193 ceph-mon[32782]: pgmap v2041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T12:34:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:36 smithi193 ceph-mon[32782]: pgmap v2042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:36 smithi196 ceph-mon[32572]: pgmap v2041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T12:34:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:36 smithi196 ceph-mon[32572]: pgmap v2042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2791.805418 secs 2024-04-26T12:34:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2791.805418 secs 2024-04-26T12:34:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2791.805418 secs 2024-04-26T12:34:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:38 smithi110 ceph-mon[28069]: pgmap v2043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:38 smithi193 ceph-mon[32782]: pgmap v2043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:38 smithi196 ceph-mon[32572]: pgmap v2043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:40 smithi110 ceph-mon[28069]: pgmap v2044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:40 smithi193 ceph-mon[32782]: pgmap v2044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:40 smithi196 ceph-mon[32572]: pgmap v2044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:42 smithi110 ceph-mon[28069]: pgmap v2045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2796.805555 secs 2024-04-26T12:34:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:42 smithi193 ceph-mon[32782]: pgmap v2045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2796.805555 secs 2024-04-26T12:34:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:42 smithi196 ceph-mon[32572]: pgmap v2045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2796.805555 secs 2024-04-26T12:34:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:44 smithi110 ceph-mon[28069]: pgmap v2046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:44 smithi193 ceph-mon[32782]: pgmap v2046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:44 smithi196 ceph-mon[32572]: pgmap v2046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:34:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:46 smithi110 ceph-mon[28069]: pgmap v2047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:34:46.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:46 smithi196 ceph-mon[32572]: pgmap v2047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:34:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:46 smithi193 ceph-mon[32782]: pgmap v2047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:34:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2801.805670 secs 2024-04-26T12:34:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2801.805670 secs 2024-04-26T12:34:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2801.805670 secs 2024-04-26T12:34:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:48 smithi193 ceph-mon[32782]: pgmap v2048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:48 smithi196 ceph-mon[32572]: pgmap v2048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:48 smithi110 ceph-mon[28069]: pgmap v2048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:50 smithi193 ceph-mon[32782]: pgmap v2049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:50 smithi196 ceph-mon[32572]: pgmap v2049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:50 smithi110 ceph-mon[28069]: pgmap v2049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:52 smithi193 ceph-mon[32782]: pgmap v2050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2806.805783 secs 2024-04-26T12:34:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:52 smithi196 ceph-mon[32572]: pgmap v2050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2806.805783 secs 2024-04-26T12:34:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:52 smithi110 ceph-mon[28069]: pgmap v2050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2806.805783 secs 2024-04-26T12:34:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:54 smithi193 ceph-mon[32782]: pgmap v2051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:54 smithi196 ceph-mon[32572]: pgmap v2051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:54 smithi110 ceph-mon[28069]: pgmap v2051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:34:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:56 smithi193 ceph-mon[32782]: pgmap v2052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:56 smithi196 ceph-mon[32572]: pgmap v2052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:56 smithi110 ceph-mon[28069]: pgmap v2052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2811.805862 secs 2024-04-26T12:34:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2811.805862 secs 2024-04-26T12:34:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2811.805862 secs 2024-04-26T12:34:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:34:58 smithi193 ceph-mon[32782]: pgmap v2053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:34:58 smithi196 ceph-mon[32572]: pgmap v2053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:34:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:34:58 smithi110 ceph-mon[28069]: pgmap v2053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:00 smithi193 ceph-mon[32782]: pgmap v2054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:00 smithi196 ceph-mon[32572]: pgmap v2054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:00 smithi110 ceph-mon[28069]: pgmap v2054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:02 smithi193 ceph-mon[32782]: pgmap v2055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2816.805959 secs 2024-04-26T12:35:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:02 smithi196 ceph-mon[32572]: pgmap v2055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2816.805959 secs 2024-04-26T12:35:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:02 smithi110 ceph-mon[28069]: pgmap v2055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2816.805959 secs 2024-04-26T12:35:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:04 smithi193 ceph-mon[32782]: pgmap v2056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:35:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:04 smithi196 ceph-mon[32572]: pgmap v2056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:35:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:04 smithi110 ceph-mon[28069]: pgmap v2056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:35:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:06 smithi193 ceph-mon[32782]: pgmap v2057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:35:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:06 smithi196 ceph-mon[32572]: pgmap v2057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:35:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:06 smithi110 ceph-mon[28069]: pgmap v2057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:35:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2821.806024 secs 2024-04-26T12:35:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2821.806024 secs 2024-04-26T12:35:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2821.806024 secs 2024-04-26T12:35:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:08 smithi193 ceph-mon[32782]: pgmap v2058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:35:08.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:08 smithi196 ceph-mon[32572]: pgmap v2058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:35:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:08 smithi110 ceph-mon[28069]: pgmap v2058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:35:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:10 smithi193 ceph-mon[32782]: pgmap v2059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:35:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:10 smithi196 ceph-mon[32572]: pgmap v2059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:35:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:10 smithi110 ceph-mon[28069]: pgmap v2059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:35:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:12 smithi196 ceph-mon[32572]: pgmap v2060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:35:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2826.806159 secs 2024-04-26T12:35:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:12 smithi110 ceph-mon[28069]: pgmap v2060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:35:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2826.806159 secs 2024-04-26T12:35:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:12 smithi193 ceph-mon[32782]: pgmap v2060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:35:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2826.806159 secs 2024-04-26T12:35:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:14 smithi196 ceph-mon[32572]: pgmap v2061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:35:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:14 smithi110 ceph-mon[28069]: pgmap v2061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:35:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:14 smithi193 ceph-mon[32782]: pgmap v2061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:35:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:16 smithi196 ceph-mon[32572]: pgmap v2062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:16 smithi110 ceph-mon[28069]: pgmap v2062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:16 smithi193 ceph-mon[32782]: pgmap v2062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2831.806273 secs 2024-04-26T12:35:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2831.806273 secs 2024-04-26T12:35:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2831.806273 secs 2024-04-26T12:35:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:18 smithi196 ceph-mon[32572]: pgmap v2063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:18 smithi110 ceph-mon[28069]: pgmap v2063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:18 smithi193 ceph-mon[32782]: pgmap v2063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:20 smithi196 ceph-mon[32572]: pgmap v2064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:20 smithi110 ceph-mon[28069]: pgmap v2064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:20 smithi193 ceph-mon[32782]: pgmap v2064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:22 smithi196 ceph-mon[32572]: pgmap v2065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2836.806389 secs 2024-04-26T12:35:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:22 smithi110 ceph-mon[28069]: pgmap v2065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2836.806389 secs 2024-04-26T12:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:22 smithi193 ceph-mon[32782]: pgmap v2065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2836.806389 secs 2024-04-26T12:35:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:24 smithi196 ceph-mon[32572]: pgmap v2066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:24 smithi110 ceph-mon[28069]: pgmap v2066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:24 smithi193 ceph-mon[32782]: pgmap v2066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:26 smithi196 ceph-mon[32572]: pgmap v2067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:26 smithi110 ceph-mon[28069]: pgmap v2067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:26 smithi193 ceph-mon[32782]: pgmap v2067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2841.806518 secs 2024-04-26T12:35:27.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2841.806518 secs 2024-04-26T12:35:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2841.806518 secs 2024-04-26T12:35:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:28 smithi196 ceph-mon[32572]: pgmap v2068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:28 smithi110 ceph-mon[28069]: pgmap v2068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:28 smithi193 ceph-mon[32782]: pgmap v2068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:30 smithi196 ceph-mon[32572]: pgmap v2069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:30 smithi110 ceph-mon[28069]: pgmap v2069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:30 smithi193 ceph-mon[32782]: pgmap v2069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:32 smithi196 ceph-mon[32572]: pgmap v2070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2846.806637 secs 2024-04-26T12:35:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:32 smithi110 ceph-mon[28069]: pgmap v2070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2846.806637 secs 2024-04-26T12:35:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:32 smithi193 ceph-mon[32782]: pgmap v2070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2846.806637 secs 2024-04-26T12:35:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:34 smithi196 ceph-mon[32572]: pgmap v2071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:34.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:34 smithi110 ceph-mon[28069]: pgmap v2071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:34 smithi193 ceph-mon[32782]: pgmap v2071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:35:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:35:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:35:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:36 smithi196 ceph-mon[32572]: pgmap v2072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:36.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:35:36.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:35:36.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:35:36.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:36 smithi110 ceph-mon[28069]: pgmap v2072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:36.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:35:36.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:35:36.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:35:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:36 smithi193 ceph-mon[32782]: pgmap v2072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:35:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:35:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:35:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:37 smithi196 ceph-mon[32572]: pgmap v2073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T12:35:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:37 smithi196 ceph-mon[32572]: pgmap v2074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2851.806789 secs 2024-04-26T12:35:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:37 smithi110 ceph-mon[28069]: pgmap v2073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T12:35:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:37 smithi110 ceph-mon[28069]: pgmap v2074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2851.806789 secs 2024-04-26T12:35:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:37 smithi193 ceph-mon[32782]: pgmap v2073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T12:35:37.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:37 smithi193 ceph-mon[32782]: pgmap v2074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:37.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2851.806789 secs 2024-04-26T12:35:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:39 smithi196 ceph-mon[32572]: pgmap v2075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:39 smithi110 ceph-mon[28069]: pgmap v2075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:39 smithi193 ceph-mon[32782]: pgmap v2075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:40 smithi196 ceph-mon[32572]: pgmap v2076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:40 smithi110 ceph-mon[28069]: pgmap v2076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:40 smithi193 ceph-mon[32782]: pgmap v2076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2856.806902 secs 2024-04-26T12:35:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2856.806902 secs 2024-04-26T12:35:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2856.806902 secs 2024-04-26T12:35:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:42 smithi196 ceph-mon[32572]: pgmap v2077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T12:35:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:42 smithi110 ceph-mon[28069]: pgmap v2077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T12:35:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:42 smithi193 ceph-mon[32782]: pgmap v2077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T12:35:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:44 smithi196 ceph-mon[32572]: pgmap v2078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:44 smithi110 ceph-mon[28069]: pgmap v2078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:44 smithi193 ceph-mon[32782]: pgmap v2078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:35:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:46 smithi196 ceph-mon[32572]: pgmap v2079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:35:47.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2861.807033 secs 2024-04-26T12:35:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:46 smithi110 ceph-mon[28069]: pgmap v2079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:35:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2861.807033 secs 2024-04-26T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:46 smithi193 ceph-mon[32782]: pgmap v2079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:35:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2861.807033 secs 2024-04-26T12:35:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:48 smithi196 ceph-mon[32572]: pgmap v2080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:48 smithi110 ceph-mon[28069]: pgmap v2080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:48 smithi193 ceph-mon[32782]: pgmap v2080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:50 smithi196 ceph-mon[32572]: pgmap v2081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:50 smithi110 ceph-mon[28069]: pgmap v2081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:50 smithi193 ceph-mon[32782]: pgmap v2081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2866.807139 secs 2024-04-26T12:35:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2866.807139 secs 2024-04-26T12:35:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2866.807139 secs 2024-04-26T12:35:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:52 smithi196 ceph-mon[32572]: pgmap v2082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:52 smithi110 ceph-mon[28069]: pgmap v2082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:52 smithi193 ceph-mon[32782]: pgmap v2082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:54 smithi196 ceph-mon[32572]: pgmap v2083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:54 smithi110 ceph-mon[28069]: pgmap v2083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:54 smithi193 ceph-mon[32782]: pgmap v2083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:56 smithi196 ceph-mon[32572]: pgmap v2084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2871.807264 secs 2024-04-26T12:35:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:56 smithi110 ceph-mon[28069]: pgmap v2084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2871.807264 secs 2024-04-26T12:35:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:56 smithi193 ceph-mon[32782]: pgmap v2084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:35:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2871.807264 secs 2024-04-26T12:35:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:35:58 smithi196 ceph-mon[32572]: pgmap v2085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:35:58 smithi110 ceph-mon[28069]: pgmap v2085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:35:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:35:58 smithi193 ceph-mon[32782]: pgmap v2085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:00 smithi196 ceph-mon[32572]: pgmap v2086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:00 smithi110 ceph-mon[28069]: pgmap v2086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:00 smithi193 ceph-mon[32782]: pgmap v2086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2876.807384 secs 2024-04-26T12:36:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2876.807384 secs 2024-04-26T12:36:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2876.807384 secs 2024-04-26T12:36:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:03 smithi196 ceph-mon[32572]: pgmap v2087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:03 smithi110 ceph-mon[28069]: pgmap v2087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:03 smithi193 ceph-mon[32782]: pgmap v2087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:05 smithi110 ceph-mon[28069]: pgmap v2088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:05 smithi193 ceph-mon[32782]: pgmap v2088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:05.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:05 smithi196 ceph-mon[32572]: pgmap v2088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:07 smithi110 ceph-mon[28069]: pgmap v2089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:07 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 2881.807510 secs 2024-04-26T12:36:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:07 smithi110 ceph-mon[28069]: slow request 2881.807509 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T12:36:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:07 smithi193 ceph-mon[32782]: pgmap v2089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:07 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 2881.807510 secs 2024-04-26T12:36:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:07 smithi193 ceph-mon[32782]: slow request 2881.807509 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T12:36:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:07 smithi196 ceph-mon[32572]: pgmap v2089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:07 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 2881.807510 secs 2024-04-26T12:36:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:07 smithi196 ceph-mon[32572]: slow request 2881.807509 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T12:36:09.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:09 smithi110 ceph-mon[28069]: pgmap v2090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:09 smithi193 ceph-mon[32782]: pgmap v2090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:09 smithi196 ceph-mon[32572]: pgmap v2090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:11 smithi110 ceph-mon[28069]: pgmap v2091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:11 smithi193 ceph-mon[32782]: pgmap v2091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:11 smithi196 ceph-mon[32572]: pgmap v2091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2886.807635 secs 2024-04-26T12:36:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2886.807635 secs 2024-04-26T12:36:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2886.807635 secs 2024-04-26T12:36:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:13 smithi110 ceph-mon[28069]: pgmap v2092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:13 smithi193 ceph-mon[32782]: pgmap v2092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:13 smithi196 ceph-mon[32572]: pgmap v2092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:15 smithi110 ceph-mon[28069]: pgmap v2093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:15 smithi193 ceph-mon[32782]: pgmap v2093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:15 smithi196 ceph-mon[32572]: pgmap v2093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:16.812 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:36:16.811+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:36:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:36:16.811+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:36:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:36:16.812+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 26 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:36:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:36:16.812+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 26 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:36:17.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:17 smithi196 ceph-mon[32572]: pgmap v2094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:17.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2891.807737 secs 2024-04-26T12:36:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:17 smithi193 ceph-mon[32782]: pgmap v2094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2891.807737 secs 2024-04-26T12:36:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:17 smithi110 ceph-mon[28069]: pgmap v2094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2891.807737 secs 2024-04-26T12:36:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:19 smithi193 ceph-mon[32782]: pgmap v2095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:19 smithi196 ceph-mon[32572]: pgmap v2095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:19 smithi110 ceph-mon[28069]: pgmap v2095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:21 smithi193 ceph-mon[32782]: pgmap v2096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:21 smithi196 ceph-mon[32572]: pgmap v2096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:21 smithi110 ceph-mon[28069]: pgmap v2096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2896.807864 secs 2024-04-26T12:36:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2896.807864 secs 2024-04-26T12:36:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2896.807864 secs 2024-04-26T12:36:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:23 smithi193 ceph-mon[32782]: pgmap v2097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:23.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:23 smithi196 ceph-mon[32572]: pgmap v2097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:23 smithi110 ceph-mon[28069]: pgmap v2097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:25 smithi193 ceph-mon[32782]: pgmap v2098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:25 smithi196 ceph-mon[32572]: pgmap v2098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:25 smithi110 ceph-mon[28069]: pgmap v2098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:27 smithi193 ceph-mon[32782]: pgmap v2099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2901.808005 secs 2024-04-26T12:36:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:27 smithi196 ceph-mon[32572]: pgmap v2099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2901.808005 secs 2024-04-26T12:36:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:27 smithi110 ceph-mon[28069]: pgmap v2099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2901.808005 secs 2024-04-26T12:36:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:29 smithi193 ceph-mon[32782]: pgmap v2100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:29 smithi196 ceph-mon[32572]: pgmap v2100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:29 smithi110 ceph-mon[28069]: pgmap v2100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:31 smithi193 ceph-mon[32782]: pgmap v2101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:31 smithi196 ceph-mon[32572]: pgmap v2101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:31 smithi110 ceph-mon[28069]: pgmap v2101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2906.808084 secs 2024-04-26T12:36:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2906.808084 secs 2024-04-26T12:36:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2906.808084 secs 2024-04-26T12:36:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:33 smithi193 ceph-mon[32782]: pgmap v2102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:33 smithi196 ceph-mon[32572]: pgmap v2102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:33 smithi110 ceph-mon[28069]: pgmap v2102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:35 smithi193 ceph-mon[32782]: pgmap v2103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:35 smithi196 ceph-mon[32572]: pgmap v2103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:35 smithi110 ceph-mon[28069]: pgmap v2103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:37 smithi193 ceph-mon[32782]: pgmap v2104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2911.808159 secs 2024-04-26T12:36:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:36:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:37 smithi196 ceph-mon[32572]: pgmap v2104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2911.808159 secs 2024-04-26T12:36:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:36:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:37 smithi110 ceph-mon[28069]: pgmap v2104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2911.808159 secs 2024-04-26T12:36:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:36:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:36:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:36:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:36:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:36:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:36:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:36:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:36:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:36:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:36:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:39 smithi196 ceph-mon[32572]: pgmap v2105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:36:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:39 smithi196 ceph-mon[32572]: pgmap v2106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:39 smithi110 ceph-mon[28069]: pgmap v2105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:36:39.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:39 smithi110 ceph-mon[28069]: pgmap v2106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:39 smithi193 ceph-mon[32782]: pgmap v2105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:36:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:39 smithi193 ceph-mon[32782]: pgmap v2106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:41 smithi196 ceph-mon[32572]: pgmap v2107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:41 smithi110 ceph-mon[28069]: pgmap v2107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:41 smithi193 ceph-mon[32782]: pgmap v2107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2916.808278 secs 2024-04-26T12:36:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2916.808278 secs 2024-04-26T12:36:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2916.808278 secs 2024-04-26T12:36:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:43 smithi196 ceph-mon[32572]: pgmap v2108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:43 smithi110 ceph-mon[28069]: pgmap v2108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:43 smithi193 ceph-mon[32782]: pgmap v2108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:45 smithi196 ceph-mon[32572]: pgmap v2109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:45 smithi110 ceph-mon[28069]: pgmap v2109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:45 smithi193 ceph-mon[32782]: pgmap v2109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:47 smithi196 ceph-mon[32572]: pgmap v2110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2921.808402 secs 2024-04-26T12:36:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:47 smithi110 ceph-mon[28069]: pgmap v2110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2921.808402 secs 2024-04-26T12:36:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:47 smithi193 ceph-mon[32782]: pgmap v2110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:36:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2921.808402 secs 2024-04-26T12:36:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:49 smithi196 ceph-mon[32572]: pgmap v2111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:36:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:49 smithi110 ceph-mon[28069]: pgmap v2111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:36:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:49 smithi193 ceph-mon[32782]: pgmap v2111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:36:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:51 smithi196 ceph-mon[32572]: pgmap v2112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:51 smithi110 ceph-mon[28069]: pgmap v2112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:51 smithi193 ceph-mon[32782]: pgmap v2112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2926.808559 secs 2024-04-26T12:36:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2926.808559 secs 2024-04-26T12:36:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2926.808559 secs 2024-04-26T12:36:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:53 smithi196 ceph-mon[32572]: pgmap v2113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:53 smithi110 ceph-mon[28069]: pgmap v2113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:53 smithi193 ceph-mon[32782]: pgmap v2113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:55 smithi196 ceph-mon[32572]: pgmap v2114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:55 smithi110 ceph-mon[28069]: pgmap v2114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:55 smithi193 ceph-mon[32782]: pgmap v2114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:57 smithi196 ceph-mon[32572]: pgmap v2115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:57.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2931.808657 secs 2024-04-26T12:36:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:57 smithi110 ceph-mon[28069]: pgmap v2115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2931.808657 secs 2024-04-26T12:36:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:57 smithi193 ceph-mon[32782]: pgmap v2115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:36:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2931.808657 secs 2024-04-26T12:36:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:36:59 smithi196 ceph-mon[32572]: pgmap v2116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:36:59 smithi110 ceph-mon[28069]: pgmap v2116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:36:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:36:59 smithi193 ceph-mon[32782]: pgmap v2116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:01 smithi196 ceph-mon[32572]: pgmap v2117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:01 smithi110 ceph-mon[28069]: pgmap v2117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:01 smithi193 ceph-mon[32782]: pgmap v2117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2936.808781 secs 2024-04-26T12:37:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2936.808781 secs 2024-04-26T12:37:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2936.808781 secs 2024-04-26T12:37:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:03 smithi196 ceph-mon[32572]: pgmap v2118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:03 smithi110 ceph-mon[28069]: pgmap v2118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:03 smithi193 ceph-mon[32782]: pgmap v2118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:05 smithi196 ceph-mon[32572]: pgmap v2119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:05 smithi110 ceph-mon[28069]: pgmap v2119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:05 smithi193 ceph-mon[32782]: pgmap v2119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:07 smithi196 ceph-mon[32572]: pgmap v2120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:07 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 2941.808905 secs 2024-04-26T12:37:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:07 smithi196 ceph-mon[32572]: slow request 2881.831367 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T12:37:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:07 smithi110 ceph-mon[28069]: pgmap v2120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:07 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 2941.808905 secs 2024-04-26T12:37:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:07 smithi110 ceph-mon[28069]: slow request 2881.831367 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T12:37:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:07 smithi193 ceph-mon[32782]: pgmap v2120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:07 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 2941.808905 secs 2024-04-26T12:37:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:07 smithi193 ceph-mon[32782]: slow request 2881.831367 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T12:37:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:09 smithi196 ceph-mon[32572]: pgmap v2121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:09 smithi110 ceph-mon[28069]: pgmap v2121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:09 smithi193 ceph-mon[32782]: pgmap v2121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:11 smithi196 ceph-mon[32572]: pgmap v2122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:11 smithi110 ceph-mon[28069]: pgmap v2122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:11 smithi193 ceph-mon[32782]: pgmap v2122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2946.808978 secs 2024-04-26T12:37:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:12 smithi196 ceph-mon[32572]: pgmap v2123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2946.808978 secs 2024-04-26T12:37:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:12 smithi110 ceph-mon[28069]: pgmap v2123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2946.808978 secs 2024-04-26T12:37:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:12 smithi193 ceph-mon[32782]: pgmap v2123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:14 smithi110 ceph-mon[28069]: pgmap v2124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:14 smithi193 ceph-mon[32782]: pgmap v2124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:14 smithi196 ceph-mon[32572]: pgmap v2124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:16 smithi110 ceph-mon[28069]: pgmap v2125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:16 smithi193 ceph-mon[32782]: pgmap v2125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:16 smithi196 ceph-mon[32572]: pgmap v2125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2951.809100 secs 2024-04-26T12:37:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2951.809100 secs 2024-04-26T12:37:17.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2951.809100 secs 2024-04-26T12:37:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:18 smithi110 ceph-mon[28069]: pgmap v2126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:18 smithi193 ceph-mon[32782]: pgmap v2126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:18 smithi196 ceph-mon[32572]: pgmap v2126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:20 smithi193 ceph-mon[32782]: pgmap v2127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:20 smithi196 ceph-mon[32572]: pgmap v2127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:20 smithi110 ceph-mon[28069]: pgmap v2127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2956.809172 secs 2024-04-26T12:37:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:22 smithi193 ceph-mon[32782]: pgmap v2128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2956.809172 secs 2024-04-26T12:37:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:22 smithi196 ceph-mon[32572]: pgmap v2128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2956.809172 secs 2024-04-26T12:37:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:22 smithi110 ceph-mon[28069]: pgmap v2128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:24 smithi193 ceph-mon[32782]: pgmap v2129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:24 smithi196 ceph-mon[32572]: pgmap v2129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:24 smithi110 ceph-mon[28069]: pgmap v2129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:26 smithi193 ceph-mon[32782]: pgmap v2130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:26 smithi196 ceph-mon[32572]: pgmap v2130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:26 smithi110 ceph-mon[28069]: pgmap v2130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2961.809296 secs 2024-04-26T12:37:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2961.809296 secs 2024-04-26T12:37:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2961.809296 secs 2024-04-26T12:37:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:28 smithi193 ceph-mon[32782]: pgmap v2131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:29.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:28 smithi196 ceph-mon[32572]: pgmap v2131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:28 smithi110 ceph-mon[28069]: pgmap v2131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:30 smithi193 ceph-mon[32782]: pgmap v2132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:30 smithi196 ceph-mon[32572]: pgmap v2132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:30 smithi110 ceph-mon[28069]: pgmap v2132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2966.809439 secs 2024-04-26T12:37:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:32 smithi193 ceph-mon[32782]: pgmap v2133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2966.809439 secs 2024-04-26T12:37:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:32 smithi196 ceph-mon[32572]: pgmap v2133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2966.809439 secs 2024-04-26T12:37:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:32 smithi110 ceph-mon[28069]: pgmap v2133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:34 smithi193 ceph-mon[32782]: pgmap v2134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:34 smithi196 ceph-mon[32572]: pgmap v2134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:34 smithi110 ceph-mon[28069]: pgmap v2134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:36 smithi193 ceph-mon[32782]: pgmap v2135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:36 smithi196 ceph-mon[32572]: pgmap v2135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:36 smithi110 ceph-mon[28069]: pgmap v2135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2971.809581 secs 2024-04-26T12:37:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2971.809581 secs 2024-04-26T12:37:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2971.809581 secs 2024-04-26T12:37:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:38 smithi193 ceph-mon[32782]: pgmap v2136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:37:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:38 smithi196 ceph-mon[32572]: pgmap v2136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:37:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:38 smithi110 ceph-mon[28069]: pgmap v2136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:39.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:37:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:37:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:37:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:39 smithi193 ceph-mon[32782]: pgmap v2137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:37:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:39 smithi193 ceph-mon[32782]: pgmap v2138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:37:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:37:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:37:40.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:39 smithi196 ceph-mon[32572]: pgmap v2137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:37:40.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:39 smithi196 ceph-mon[32572]: pgmap v2138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:40.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:37:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:37:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:37:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:39 smithi110 ceph-mon[28069]: pgmap v2137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:37:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:39 smithi110 ceph-mon[28069]: pgmap v2138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:37:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:42 smithi193 ceph-mon[32782]: pgmap v2139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2976.809667 secs 2024-04-26T12:37:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:42 smithi196 ceph-mon[32572]: pgmap v2139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2976.809667 secs 2024-04-26T12:37:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:42 smithi110 ceph-mon[28069]: pgmap v2139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2976.809667 secs 2024-04-26T12:37:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:44 smithi193 ceph-mon[32782]: pgmap v2140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:44 smithi196 ceph-mon[32572]: pgmap v2140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:44.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:44 smithi110 ceph-mon[28069]: pgmap v2140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:46 smithi193 ceph-mon[32782]: pgmap v2141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:46 smithi196 ceph-mon[32572]: pgmap v2141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:46 smithi110 ceph-mon[28069]: pgmap v2141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:37:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:37:46.825+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:37:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:37:46.825+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:37:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:37:46.826+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 27 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:37:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:37:46.826+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 27 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:37:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2981.809791 secs 2024-04-26T12:37:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2981.809791 secs 2024-04-26T12:37:47.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2981.809791 secs 2024-04-26T12:37:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:48 smithi193 ceph-mon[32782]: pgmap v2142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:37:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:48 smithi196 ceph-mon[32572]: pgmap v2142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:37:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:48 smithi110 ceph-mon[28069]: pgmap v2142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:37:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:50 smithi193 ceph-mon[32782]: pgmap v2143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:37:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:50 smithi196 ceph-mon[32572]: pgmap v2143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:37:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:50 smithi110 ceph-mon[28069]: pgmap v2143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:37:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:52 smithi193 ceph-mon[32782]: pgmap v2144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2986.809854 secs 2024-04-26T12:37:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:52 smithi196 ceph-mon[32572]: pgmap v2144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2986.809854 secs 2024-04-26T12:37:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:52 smithi110 ceph-mon[28069]: pgmap v2144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2986.809854 secs 2024-04-26T12:37:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:54 smithi193 ceph-mon[32782]: pgmap v2145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:54 smithi196 ceph-mon[32572]: pgmap v2145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:54 smithi110 ceph-mon[28069]: pgmap v2145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:37:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:56 smithi193 ceph-mon[32782]: pgmap v2146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:56 smithi196 ceph-mon[32572]: pgmap v2146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:56 smithi110 ceph-mon[28069]: pgmap v2146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2991.810003 secs 2024-04-26T12:37:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2991.810003 secs 2024-04-26T12:37:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2991.810003 secs 2024-04-26T12:37:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:37:58 smithi196 ceph-mon[32572]: pgmap v2147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:37:58 smithi110 ceph-mon[28069]: pgmap v2147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:37:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:37:58 smithi193 ceph-mon[32782]: pgmap v2147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:00 smithi196 ceph-mon[32572]: pgmap v2148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:00 smithi110 ceph-mon[28069]: pgmap v2148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:00 smithi193 ceph-mon[32782]: pgmap v2148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:02 smithi196 ceph-mon[32572]: pgmap v2149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:02.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 2996.810142 secs 2024-04-26T12:38:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:02 smithi110 ceph-mon[28069]: pgmap v2149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 2996.810142 secs 2024-04-26T12:38:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:02 smithi193 ceph-mon[32782]: pgmap v2149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 2996.810142 secs 2024-04-26T12:38:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:04 smithi196 ceph-mon[32572]: pgmap v2150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:04 smithi110 ceph-mon[28069]: pgmap v2150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:04 smithi193 ceph-mon[32782]: pgmap v2150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:06 smithi196 ceph-mon[32572]: pgmap v2151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:06 smithi110 ceph-mon[28069]: pgmap v2151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:06 smithi193 ceph-mon[32782]: pgmap v2151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3001.810282 secs 2024-04-26T12:38:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3001.810282 secs 2024-04-26T12:38:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3001.810282 secs 2024-04-26T12:38:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:08 smithi196 ceph-mon[32572]: pgmap v2152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:08 smithi110 ceph-mon[28069]: pgmap v2152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:08 smithi193 ceph-mon[32782]: pgmap v2152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:10 smithi196 ceph-mon[32572]: pgmap v2153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:10 smithi110 ceph-mon[28069]: pgmap v2153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:10 smithi193 ceph-mon[32782]: pgmap v2153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:12 smithi196 ceph-mon[32572]: pgmap v2154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3006.810427 secs 2024-04-26T12:38:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:12 smithi110 ceph-mon[28069]: pgmap v2154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3006.810427 secs 2024-04-26T12:38:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:12 smithi193 ceph-mon[32782]: pgmap v2154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3006.810427 secs 2024-04-26T12:38:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:14 smithi196 ceph-mon[32572]: pgmap v2155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:14 smithi110 ceph-mon[28069]: pgmap v2155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:14 smithi193 ceph-mon[32782]: pgmap v2155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:15 smithi196 ceph-mon[32572]: pgmap v2156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:15 smithi110 ceph-mon[28069]: pgmap v2156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:16 smithi193 ceph-mon[32782]: pgmap v2156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3011.810592 secs 2024-04-26T12:38:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3011.810592 secs 2024-04-26T12:38:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3011.810592 secs 2024-04-26T12:38:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:18 smithi110 ceph-mon[28069]: pgmap v2157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:18 smithi193 ceph-mon[32782]: pgmap v2157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:18 smithi196 ceph-mon[32572]: pgmap v2157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:20 smithi193 ceph-mon[32782]: pgmap v2158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:20 smithi196 ceph-mon[32572]: pgmap v2158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:20 smithi110 ceph-mon[28069]: pgmap v2158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:22 smithi193 ceph-mon[32782]: pgmap v2159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3016.810711 secs 2024-04-26T12:38:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:22 smithi196 ceph-mon[32572]: pgmap v2159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3016.810711 secs 2024-04-26T12:38:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:22 smithi110 ceph-mon[28069]: pgmap v2159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3016.810711 secs 2024-04-26T12:38:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:24 smithi193 ceph-mon[32782]: pgmap v2160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:24 smithi196 ceph-mon[32572]: pgmap v2160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:24 smithi110 ceph-mon[28069]: pgmap v2160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:26 smithi193 ceph-mon[32782]: pgmap v2161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:26 smithi196 ceph-mon[32572]: pgmap v2161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:26 smithi110 ceph-mon[28069]: pgmap v2161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3021.810777 secs 2024-04-26T12:38:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3021.810777 secs 2024-04-26T12:38:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3021.810777 secs 2024-04-26T12:38:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:28 smithi193 ceph-mon[32782]: pgmap v2162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:28 smithi196 ceph-mon[32572]: pgmap v2162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:28 smithi110 ceph-mon[28069]: pgmap v2162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:30 smithi196 ceph-mon[32572]: pgmap v2163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:30 smithi110 ceph-mon[28069]: pgmap v2163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:30 smithi193 ceph-mon[32782]: pgmap v2163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:32 smithi196 ceph-mon[32572]: pgmap v2164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3026.810843 secs 2024-04-26T12:38:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:32 smithi110 ceph-mon[28069]: pgmap v2164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3026.810843 secs 2024-04-26T12:38:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:32 smithi193 ceph-mon[32782]: pgmap v2164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3026.810843 secs 2024-04-26T12:38:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:34 smithi196 ceph-mon[32572]: pgmap v2165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:34 smithi110 ceph-mon[28069]: pgmap v2165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:34 smithi193 ceph-mon[32782]: pgmap v2165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:36 smithi196 ceph-mon[32572]: pgmap v2166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:36 smithi110 ceph-mon[28069]: pgmap v2166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:36 smithi193 ceph-mon[32782]: pgmap v2166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3031.810967 secs 2024-04-26T12:38:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3031.810967 secs 2024-04-26T12:38:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3031.810967 secs 2024-04-26T12:38:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:38 smithi196 ceph-mon[32572]: pgmap v2167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:38 smithi110 ceph-mon[28069]: pgmap v2167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:38 smithi193 ceph-mon[32782]: pgmap v2167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:40 smithi196 ceph-mon[32572]: pgmap v2168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:38:40.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:40 smithi110 ceph-mon[28069]: pgmap v2168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:40.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:38:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:40 smithi193 ceph-mon[32782]: pgmap v2168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:38:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:38:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:38:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:38:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:38:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:38:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:38:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:38:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:38:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:38:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:42 smithi196 ceph-mon[32572]: pgmap v2169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:38:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:42 smithi196 ceph-mon[32572]: pgmap v2170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3036.811104 secs 2024-04-26T12:38:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:42 smithi110 ceph-mon[28069]: pgmap v2169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:38:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:42 smithi110 ceph-mon[28069]: pgmap v2170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3036.811104 secs 2024-04-26T12:38:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:42 smithi193 ceph-mon[32782]: pgmap v2169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:38:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:42 smithi193 ceph-mon[32782]: pgmap v2170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3036.811104 secs 2024-04-26T12:38:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:44 smithi196 ceph-mon[32572]: pgmap v2171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:44 smithi110 ceph-mon[28069]: pgmap v2171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:44 smithi193 ceph-mon[32782]: pgmap v2171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:46 smithi196 ceph-mon[32572]: pgmap v2172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:46 smithi110 ceph-mon[28069]: pgmap v2172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:46 smithi193 ceph-mon[32782]: pgmap v2172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:47.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3041.811229 secs 2024-04-26T12:38:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3041.811229 secs 2024-04-26T12:38:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3041.811229 secs 2024-04-26T12:38:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:48 smithi196 ceph-mon[32572]: pgmap v2173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:48 smithi110 ceph-mon[28069]: pgmap v2173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:48 smithi193 ceph-mon[32782]: pgmap v2173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:50 smithi196 ceph-mon[32572]: pgmap v2174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:50 smithi110 ceph-mon[28069]: pgmap v2174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:50 smithi193 ceph-mon[32782]: pgmap v2174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:38:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:52 smithi196 ceph-mon[32572]: pgmap v2175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:38:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3046.811361 secs 2024-04-26T12:38:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:52 smithi110 ceph-mon[28069]: pgmap v2175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:38:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3046.811361 secs 2024-04-26T12:38:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:52 smithi193 ceph-mon[32782]: pgmap v2175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:38:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3046.811361 secs 2024-04-26T12:38:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:54 smithi196 ceph-mon[32572]: pgmap v2176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:54 smithi110 ceph-mon[28069]: pgmap v2176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:54 smithi193 ceph-mon[32782]: pgmap v2176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:38:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:56 smithi196 ceph-mon[32572]: pgmap v2177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:56 smithi110 ceph-mon[28069]: pgmap v2177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:56 smithi193 ceph-mon[32782]: pgmap v2177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3051.811447 secs 2024-04-26T12:38:57.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3051.811447 secs 2024-04-26T12:38:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3051.811447 secs 2024-04-26T12:38:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:38:58 smithi196 ceph-mon[32572]: pgmap v2178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:38:58 smithi110 ceph-mon[28069]: pgmap v2178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:38:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:38:58 smithi193 ceph-mon[32782]: pgmap v2178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:00 smithi196 ceph-mon[32572]: pgmap v2179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:00 smithi110 ceph-mon[28069]: pgmap v2179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:00 smithi193 ceph-mon[32782]: pgmap v2179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:02.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:39:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:39:01.752+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:39:02.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:39:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:39:01.752+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:39:02.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:39:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:39:01.752+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:39:02.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:39:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:39:01.752+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:39:02.043 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:39:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:39:01.752+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:39:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:02 smithi196 ceph-mon[32572]: pgmap v2180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3056.811593 secs 2024-04-26T12:39:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:02 smithi110 ceph-mon[28069]: pgmap v2180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3056.811593 secs 2024-04-26T12:39:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:02 smithi193 ceph-mon[32782]: pgmap v2180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3056.811593 secs 2024-04-26T12:39:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:04 smithi196 ceph-mon[32572]: pgmap v2181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:39:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:04 smithi110 ceph-mon[28069]: pgmap v2181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:39:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:04 smithi193 ceph-mon[32782]: pgmap v2181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:39:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:06 smithi196 ceph-mon[32572]: pgmap v2182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:39:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:06 smithi110 ceph-mon[28069]: pgmap v2182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:39:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:06 smithi193 ceph-mon[32782]: pgmap v2182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:39:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3061.811735 secs 2024-04-26T12:39:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3061.811735 secs 2024-04-26T12:39:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3061.811735 secs 2024-04-26T12:39:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:08 smithi110 ceph-mon[28069]: pgmap v2183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:39:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:08 smithi193 ceph-mon[32782]: pgmap v2183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:39:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:08 smithi196 ceph-mon[32572]: pgmap v2183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:39:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:09 smithi193 ceph-mon[32782]: pgmap v2184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:39:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:09 smithi196 ceph-mon[32572]: pgmap v2184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:39:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:09 smithi110 ceph-mon[28069]: pgmap v2184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:39:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:11 smithi196 ceph-mon[32572]: pgmap v2185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:39:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:11 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 3066.811851 secs 2024-04-26T12:39:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:11 smithi196 ceph-mon[32572]: slow request 2883.026988 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:39:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:11 smithi110 ceph-mon[28069]: pgmap v2185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:39:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:11 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 3066.811851 secs 2024-04-26T12:39:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:11 smithi110 ceph-mon[28069]: slow request 2883.026988 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:39:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:11 smithi193 ceph-mon[32782]: pgmap v2185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T12:39:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:11 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 3066.811851 secs 2024-04-26T12:39:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:11 smithi193 ceph-mon[32782]: slow request 2883.026988 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:39:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:13 smithi196 ceph-mon[32572]: pgmap v2186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:39:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:13 smithi110 ceph-mon[28069]: pgmap v2186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:39:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:13 smithi193 ceph-mon[32782]: pgmap v2186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T12:39:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:15 smithi196 ceph-mon[32572]: pgmap v2187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:15 smithi110 ceph-mon[28069]: pgmap v2187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:15 smithi193 ceph-mon[32782]: pgmap v2187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:39:16.840+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:39:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:39:16.840+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:39:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:39:16.841+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 28 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:39:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:39:16.841+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 28 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:39:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3071.811974 secs 2024-04-26T12:39:17.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3071.811974 secs 2024-04-26T12:39:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3071.811974 secs 2024-04-26T12:39:17.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:17 smithi110 ceph-mon[28069]: pgmap v2188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:17 smithi196 ceph-mon[32572]: pgmap v2188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:17 smithi193 ceph-mon[32782]: pgmap v2188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:19 smithi196 ceph-mon[32572]: pgmap v2189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:19 smithi110 ceph-mon[28069]: pgmap v2189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:19 smithi193 ceph-mon[32782]: pgmap v2189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:21 smithi196 ceph-mon[32572]: pgmap v2190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3076.812097 secs 2024-04-26T12:39:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:21 smithi110 ceph-mon[28069]: pgmap v2190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3076.812097 secs 2024-04-26T12:39:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:21 smithi193 ceph-mon[32782]: pgmap v2190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3076.812097 secs 2024-04-26T12:39:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:23 smithi196 ceph-mon[32572]: pgmap v2191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:23 smithi110 ceph-mon[28069]: pgmap v2191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:23 smithi193 ceph-mon[32782]: pgmap v2191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:25 smithi196 ceph-mon[32572]: pgmap v2192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:25 smithi110 ceph-mon[28069]: pgmap v2192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:25 smithi193 ceph-mon[32782]: pgmap v2192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3081.812198 secs 2024-04-26T12:39:27.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3081.812198 secs 2024-04-26T12:39:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3081.812198 secs 2024-04-26T12:39:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:27 smithi196 ceph-mon[32572]: pgmap v2193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:27 smithi110 ceph-mon[28069]: pgmap v2193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:27 smithi193 ceph-mon[32782]: pgmap v2193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:29 smithi196 ceph-mon[32572]: pgmap v2194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:29 smithi110 ceph-mon[28069]: pgmap v2194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:29 smithi193 ceph-mon[32782]: pgmap v2194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:31 smithi196 ceph-mon[32572]: pgmap v2195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3086.812326 secs 2024-04-26T12:39:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:31 smithi110 ceph-mon[28069]: pgmap v2195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3086.812326 secs 2024-04-26T12:39:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:31 smithi193 ceph-mon[32782]: pgmap v2195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3086.812326 secs 2024-04-26T12:39:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:33 smithi196 ceph-mon[32572]: pgmap v2196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:33 smithi110 ceph-mon[28069]: pgmap v2196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:33 smithi193 ceph-mon[32782]: pgmap v2196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:35 smithi196 ceph-mon[32572]: pgmap v2197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:35 smithi110 ceph-mon[28069]: pgmap v2197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:35 smithi193 ceph-mon[32782]: pgmap v2197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3091.812409 secs 2024-04-26T12:39:37.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3091.812409 secs 2024-04-26T12:39:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3091.812409 secs 2024-04-26T12:39:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:37 smithi196 ceph-mon[32572]: pgmap v2198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:37 smithi110 ceph-mon[28069]: pgmap v2198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:37 smithi193 ceph-mon[32782]: pgmap v2198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:39 smithi110 ceph-mon[28069]: pgmap v2199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:39 smithi193 ceph-mon[32782]: pgmap v2199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:39 smithi196 ceph-mon[32572]: pgmap v2199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:41 smithi110 ceph-mon[28069]: pgmap v2200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:39:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3096.812496 secs 2024-04-26T12:39:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:41 smithi193 ceph-mon[32782]: pgmap v2200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:39:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3096.812496 secs 2024-04-26T12:39:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:41 smithi196 ceph-mon[32572]: pgmap v2200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:39:42.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3096.812496 secs 2024-04-26T12:39:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:39:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:39:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:42 smithi110 ceph-mon[28069]: pgmap v2201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T12:39:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:42 smithi110 ceph-mon[28069]: pgmap v2202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T12:39:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:39:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:39:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:39:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:42 smithi193 ceph-mon[32782]: pgmap v2201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T12:39:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:42 smithi193 ceph-mon[32782]: pgmap v2202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T12:39:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:39:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:39:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:39:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:42 smithi196 ceph-mon[32572]: pgmap v2201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T12:39:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:42 smithi196 ceph-mon[32572]: pgmap v2202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T12:39:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:39:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:44 smithi193 ceph-mon[32782]: pgmap v2203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:44 smithi196 ceph-mon[32572]: pgmap v2203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:44 smithi110 ceph-mon[28069]: pgmap v2203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:46 smithi193 ceph-mon[32782]: pgmap v2204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:46 smithi196 ceph-mon[32572]: pgmap v2204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:46 smithi110 ceph-mon[28069]: pgmap v2204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3101.812624 secs 2024-04-26T12:39:47.657 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3101.812624 secs 2024-04-26T12:39:47.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3101.812624 secs 2024-04-26T12:39:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:48 smithi193 ceph-mon[32782]: pgmap v2205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:48 smithi196 ceph-mon[32572]: pgmap v2205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:48 smithi110 ceph-mon[28069]: pgmap v2205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:50 smithi193 ceph-mon[32782]: pgmap v2206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:50 smithi196 ceph-mon[32572]: pgmap v2206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:50 smithi110 ceph-mon[28069]: pgmap v2206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:39:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3106.812753 secs 2024-04-26T12:39:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3106.812753 secs 2024-04-26T12:39:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3106.812753 secs 2024-04-26T12:39:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:52 smithi196 ceph-mon[32572]: pgmap v2207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:39:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:52 smithi110 ceph-mon[28069]: pgmap v2207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:39:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:52 smithi193 ceph-mon[32782]: pgmap v2207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:39:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:54 smithi193 ceph-mon[32782]: pgmap v2208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:54 smithi196 ceph-mon[32572]: pgmap v2208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:54 smithi110 ceph-mon[28069]: pgmap v2208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:56 smithi193 ceph-mon[32782]: pgmap v2209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:56 smithi196 ceph-mon[32572]: pgmap v2209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:56 smithi110 ceph-mon[28069]: pgmap v2209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:39:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3111.812845 secs 2024-04-26T12:39:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3111.812845 secs 2024-04-26T12:39:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3111.812845 secs 2024-04-26T12:39:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:39:58 smithi193 ceph-mon[32782]: pgmap v2210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:39:58 smithi196 ceph-mon[32572]: pgmap v2210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:39:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:39:58 smithi110 ceph-mon[28069]: pgmap v2210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:40:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:40:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:40:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:01 smithi193 ceph-mon[32782]: pgmap v2211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:01 smithi196 ceph-mon[32572]: pgmap v2211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:01 smithi110 ceph-mon[28069]: pgmap v2211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3116.812958 secs 2024-04-26T12:40:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3116.812958 secs 2024-04-26T12:40:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3116.812958 secs 2024-04-26T12:40:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:03 smithi193 ceph-mon[32782]: pgmap v2212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:03 smithi196 ceph-mon[32572]: pgmap v2212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:03 smithi110 ceph-mon[28069]: pgmap v2212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:04 smithi193 ceph-mon[32782]: pgmap v2213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:04 smithi196 ceph-mon[32572]: pgmap v2213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:04 smithi110 ceph-mon[28069]: pgmap v2213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:06 smithi193 ceph-mon[32782]: pgmap v2214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:06 smithi196 ceph-mon[32572]: pgmap v2214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:06 smithi110 ceph-mon[28069]: pgmap v2214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3121.813079 secs 2024-04-26T12:40:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3121.813079 secs 2024-04-26T12:40:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3121.813079 secs 2024-04-26T12:40:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:08 smithi193 ceph-mon[32782]: pgmap v2215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:08 smithi196 ceph-mon[32572]: pgmap v2215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:08 smithi110 ceph-mon[28069]: pgmap v2215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:10 smithi193 ceph-mon[32782]: pgmap v2216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:10 smithi196 ceph-mon[32572]: pgmap v2216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:10 smithi110 ceph-mon[28069]: pgmap v2216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3126.813177 secs 2024-04-26T12:40:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3126.813177 secs 2024-04-26T12:40:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3126.813177 secs 2024-04-26T12:40:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:12 smithi196 ceph-mon[32572]: pgmap v2217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:12 smithi110 ceph-mon[28069]: pgmap v2217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:12 smithi193 ceph-mon[32782]: pgmap v2217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:14 smithi193 ceph-mon[32782]: pgmap v2218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:14 smithi196 ceph-mon[32572]: pgmap v2218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:14 smithi110 ceph-mon[28069]: pgmap v2218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:16 smithi193 ceph-mon[32782]: pgmap v2219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:16 smithi196 ceph-mon[32572]: pgmap v2219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:16 smithi110 ceph-mon[28069]: pgmap v2219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3131.813307 secs 2024-04-26T12:40:17.657 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3131.813307 secs 2024-04-26T12:40:17.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3131.813307 secs 2024-04-26T12:40:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:18 smithi193 ceph-mon[32782]: pgmap v2220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:18 smithi196 ceph-mon[32572]: pgmap v2220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:18 smithi110 ceph-mon[28069]: pgmap v2220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:20 smithi193 ceph-mon[32782]: pgmap v2221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:20 smithi196 ceph-mon[32572]: pgmap v2221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:20 smithi110 ceph-mon[28069]: pgmap v2221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3136.813443 secs 2024-04-26T12:40:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3136.813443 secs 2024-04-26T12:40:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3136.813443 secs 2024-04-26T12:40:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:22 smithi196 ceph-mon[32572]: pgmap v2222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:22 smithi110 ceph-mon[28069]: pgmap v2222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:22 smithi193 ceph-mon[32782]: pgmap v2222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:24 smithi193 ceph-mon[32782]: pgmap v2223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:24 smithi196 ceph-mon[32572]: pgmap v2223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:24 smithi110 ceph-mon[28069]: pgmap v2223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:26 smithi193 ceph-mon[32782]: pgmap v2224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:26 smithi196 ceph-mon[32572]: pgmap v2224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:26 smithi110 ceph-mon[28069]: pgmap v2224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3141.813602 secs 2024-04-26T12:40:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3141.813602 secs 2024-04-26T12:40:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3141.813602 secs 2024-04-26T12:40:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:28 smithi193 ceph-mon[32782]: pgmap v2225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:28 smithi196 ceph-mon[32572]: pgmap v2225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:28 smithi110 ceph-mon[28069]: pgmap v2225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:30 smithi193 ceph-mon[32782]: pgmap v2226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:30 smithi196 ceph-mon[32572]: pgmap v2226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:30 smithi110 ceph-mon[28069]: pgmap v2226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3146.813699 secs 2024-04-26T12:40:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3146.813699 secs 2024-04-26T12:40:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3146.813699 secs 2024-04-26T12:40:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:32 smithi196 ceph-mon[32572]: pgmap v2227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:32 smithi110 ceph-mon[28069]: pgmap v2227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:32 smithi193 ceph-mon[32782]: pgmap v2227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:34 smithi193 ceph-mon[32782]: pgmap v2228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:34 smithi196 ceph-mon[32572]: pgmap v2228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:34.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:34 smithi110 ceph-mon[28069]: pgmap v2228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:36 smithi193 ceph-mon[32782]: pgmap v2229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:36 smithi196 ceph-mon[32572]: pgmap v2229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:36 smithi110 ceph-mon[28069]: pgmap v2229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3151.813773 secs 2024-04-26T12:40:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3151.813773 secs 2024-04-26T12:40:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3151.813773 secs 2024-04-26T12:40:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:38 smithi193 ceph-mon[32782]: pgmap v2230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:38 smithi196 ceph-mon[32572]: pgmap v2230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:38 smithi110 ceph-mon[28069]: pgmap v2230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:40 smithi193 ceph-mon[32782]: pgmap v2231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:40 smithi196 ceph-mon[32572]: pgmap v2231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:40 smithi110 ceph-mon[28069]: pgmap v2231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3156.813892 secs 2024-04-26T12:40:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3156.813892 secs 2024-04-26T12:40:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3156.813892 secs 2024-04-26T12:40:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:42 smithi196 ceph-mon[32572]: pgmap v2232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:40:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:42 smithi110 ceph-mon[28069]: pgmap v2232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:40:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:42 smithi193 ceph-mon[32782]: pgmap v2232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:40:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:40:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:40:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:40:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:40:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:40:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:40:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:40:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:40:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:40:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:44 smithi193 ceph-mon[32782]: pgmap v2233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:40:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:44 smithi193 ceph-mon[32782]: pgmap v2234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:44 smithi196 ceph-mon[32572]: pgmap v2233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:40:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:44 smithi196 ceph-mon[32572]: pgmap v2234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:44 smithi110 ceph-mon[28069]: pgmap v2233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:40:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:44 smithi110 ceph-mon[28069]: pgmap v2234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:46 smithi193 ceph-mon[32782]: pgmap v2235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3161.813958 secs 2024-04-26T12:40:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:46 smithi196 ceph-mon[32572]: pgmap v2235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3161.813958 secs 2024-04-26T12:40:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:46 smithi110 ceph-mon[28069]: pgmap v2235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3161.813958 secs 2024-04-26T12:40:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:48 smithi193 ceph-mon[32782]: pgmap v2236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:48 smithi196 ceph-mon[32572]: pgmap v2236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:48 smithi110 ceph-mon[28069]: pgmap v2236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:50 smithi193 ceph-mon[32782]: pgmap v2237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:50 smithi196 ceph-mon[32572]: pgmap v2237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:51.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:50 smithi110 ceph-mon[28069]: pgmap v2237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3166.814024 secs 2024-04-26T12:40:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3166.814024 secs 2024-04-26T12:40:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3166.814024 secs 2024-04-26T12:40:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:52 smithi193 ceph-mon[32782]: pgmap v2238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:52 smithi196 ceph-mon[32572]: pgmap v2238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:52 smithi110 ceph-mon[28069]: pgmap v2238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:40:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:54 smithi196 ceph-mon[32572]: pgmap v2239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:40:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:54 smithi110 ceph-mon[28069]: pgmap v2239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:40:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:54 smithi193 ceph-mon[32782]: pgmap v2239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:40:57.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:56 smithi193 ceph-mon[32782]: pgmap v2240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:57.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3171.814141 secs 2024-04-26T12:40:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:56 smithi196 ceph-mon[32572]: pgmap v2240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3171.814141 secs 2024-04-26T12:40:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:56 smithi110 ceph-mon[28069]: pgmap v2240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:40:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3171.814141 secs 2024-04-26T12:40:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:40:58 smithi196 ceph-mon[32572]: pgmap v2241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:40:58 smithi110 ceph-mon[28069]: pgmap v2241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:40:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:40:58 smithi193 ceph-mon[32782]: pgmap v2241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:00 smithi196 ceph-mon[32572]: pgmap v2242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:41:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:00 smithi110 ceph-mon[28069]: pgmap v2242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:41:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:00 smithi193 ceph-mon[32782]: pgmap v2242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:41:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3176.814261 secs 2024-04-26T12:41:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3176.814261 secs 2024-04-26T12:41:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3176.814261 secs 2024-04-26T12:41:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:02 smithi196 ceph-mon[32572]: pgmap v2243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:41:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:02 smithi110 ceph-mon[28069]: pgmap v2243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:41:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:02 smithi193 ceph-mon[32782]: pgmap v2243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:41:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:04 smithi196 ceph-mon[32572]: pgmap v2244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:04 smithi110 ceph-mon[28069]: pgmap v2244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:04 smithi193 ceph-mon[32782]: pgmap v2244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:06 smithi196 ceph-mon[32572]: pgmap v2245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:41:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3181.814402 secs 2024-04-26T12:41:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:06 smithi110 ceph-mon[28069]: pgmap v2245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:41:07.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3181.814402 secs 2024-04-26T12:41:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:06 smithi193 ceph-mon[32782]: pgmap v2245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:41:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3181.814402 secs 2024-04-26T12:41:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:08 smithi196 ceph-mon[32572]: pgmap v2246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:08 smithi110 ceph-mon[28069]: pgmap v2246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:08 smithi193 ceph-mon[32782]: pgmap v2246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:10 smithi196 ceph-mon[32572]: pgmap v2247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:10 smithi110 ceph-mon[28069]: pgmap v2247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:10 smithi193 ceph-mon[32782]: pgmap v2247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3186.814521 secs 2024-04-26T12:41:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3186.814521 secs 2024-04-26T12:41:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3186.814521 secs 2024-04-26T12:41:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:12 smithi196 ceph-mon[32572]: pgmap v2248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:12 smithi110 ceph-mon[28069]: pgmap v2248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:12 smithi193 ceph-mon[32782]: pgmap v2248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:14 smithi196 ceph-mon[32572]: pgmap v2249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:14 smithi110 ceph-mon[28069]: pgmap v2249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:14 smithi193 ceph-mon[32782]: pgmap v2249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:16 smithi196 ceph-mon[32572]: pgmap v2250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3191.814648 secs 2024-04-26T12:41:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:16 smithi110 ceph-mon[28069]: pgmap v2250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3191.814648 secs 2024-04-26T12:41:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:16 smithi193 ceph-mon[32782]: pgmap v2250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3191.814648 secs 2024-04-26T12:41:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:18 smithi196 ceph-mon[32572]: pgmap v2251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:18 smithi110 ceph-mon[28069]: pgmap v2251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:18 smithi193 ceph-mon[32782]: pgmap v2251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:20 smithi196 ceph-mon[32572]: pgmap v2252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:20 smithi110 ceph-mon[28069]: pgmap v2252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:20 smithi193 ceph-mon[32782]: pgmap v2252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3196.814770 secs 2024-04-26T12:41:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3196.814770 secs 2024-04-26T12:41:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3196.814770 secs 2024-04-26T12:41:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:22 smithi196 ceph-mon[32572]: pgmap v2253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:22 smithi110 ceph-mon[28069]: pgmap v2253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:22 smithi193 ceph-mon[32782]: pgmap v2253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:24 smithi196 ceph-mon[32572]: pgmap v2254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:24 smithi110 ceph-mon[28069]: pgmap v2254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:24 smithi193 ceph-mon[32782]: pgmap v2254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:26 smithi196 ceph-mon[32572]: pgmap v2255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3201.814881 secs 2024-04-26T12:41:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:26 smithi110 ceph-mon[28069]: pgmap v2255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3201.814881 secs 2024-04-26T12:41:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:26 smithi193 ceph-mon[32782]: pgmap v2255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3201.814881 secs 2024-04-26T12:41:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:28 smithi196 ceph-mon[32572]: pgmap v2256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:28 smithi110 ceph-mon[28069]: pgmap v2256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:28 smithi193 ceph-mon[32782]: pgmap v2256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:30 smithi196 ceph-mon[32572]: pgmap v2257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:30 smithi110 ceph-mon[28069]: pgmap v2257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:30 smithi193 ceph-mon[32782]: pgmap v2257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3206.815001 secs 2024-04-26T12:41:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3206.815001 secs 2024-04-26T12:41:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3206.815001 secs 2024-04-26T12:41:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:33 smithi196 ceph-mon[32572]: pgmap v2258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:33 smithi110 ceph-mon[28069]: pgmap v2258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:33 smithi193 ceph-mon[32782]: pgmap v2258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:35 smithi110 ceph-mon[28069]: pgmap v2259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:35 smithi193 ceph-mon[32782]: pgmap v2259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:35 smithi196 ceph-mon[32572]: pgmap v2259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:37 smithi110 ceph-mon[28069]: pgmap v2260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3211.815140 secs 2024-04-26T12:41:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:37 smithi193 ceph-mon[32782]: pgmap v2260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3211.815140 secs 2024-04-26T12:41:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:37 smithi196 ceph-mon[32572]: pgmap v2260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3211.815140 secs 2024-04-26T12:41:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:39 smithi110 ceph-mon[28069]: pgmap v2261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:39 smithi193 ceph-mon[32782]: pgmap v2261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:39 smithi196 ceph-mon[32572]: pgmap v2261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:41 smithi110 ceph-mon[28069]: pgmap v2262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:41 smithi193 ceph-mon[32782]: pgmap v2262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:41 smithi196 ceph-mon[32572]: pgmap v2262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3216.815264 secs 2024-04-26T12:41:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3216.815264 secs 2024-04-26T12:41:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3216.815264 secs 2024-04-26T12:41:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:43 smithi110 ceph-mon[28069]: pgmap v2263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:43 smithi193 ceph-mon[32782]: pgmap v2263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:43 smithi196 ceph-mon[32572]: pgmap v2263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:45 smithi110 ceph-mon[28069]: pgmap v2264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:41:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:41:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:41:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:45 smithi193 ceph-mon[32782]: pgmap v2264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:41:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:41:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:41:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:45 smithi196 ceph-mon[32572]: pgmap v2264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:41:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:41:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:41:47.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:47 smithi196 ceph-mon[32572]: pgmap v2265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:47.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:41:47.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:41:47.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:47 smithi196 ceph-mon[32572]: pgmap v2266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 995 B/s rd, 1 op/s 2024-04-26T12:41:47.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:47 smithi196 ceph-mon[32572]: pgmap v2267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 618 B/s rd, 1 op/s 2024-04-26T12:41:47.308 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:41:47.308 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3221.815367 secs 2024-04-26T12:41:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:47 smithi193 ceph-mon[32782]: pgmap v2265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:41:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:41:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:47 smithi193 ceph-mon[32782]: pgmap v2266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 995 B/s rd, 1 op/s 2024-04-26T12:41:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:47 smithi193 ceph-mon[32782]: pgmap v2267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 618 B/s rd, 1 op/s 2024-04-26T12:41:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:41:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3221.815367 secs 2024-04-26T12:41:47.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:47 smithi110 ceph-mon[28069]: pgmap v2265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:41:47.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:41:47.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:41:47.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:47 smithi110 ceph-mon[28069]: pgmap v2266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 995 B/s rd, 1 op/s 2024-04-26T12:41:47.465 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:47 smithi110 ceph-mon[28069]: pgmap v2267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 618 B/s rd, 1 op/s 2024-04-26T12:41:47.466 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:41:47.466 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3221.815367 secs 2024-04-26T12:41:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:49 smithi196 ceph-mon[32572]: pgmap v2268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:49 smithi110 ceph-mon[28069]: pgmap v2268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:49 smithi193 ceph-mon[32782]: pgmap v2268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:51 smithi196 ceph-mon[32572]: pgmap v2269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:51 smithi110 ceph-mon[28069]: pgmap v2269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:51 smithi193 ceph-mon[32782]: pgmap v2269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3226.815441 secs 2024-04-26T12:41:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3226.815441 secs 2024-04-26T12:41:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3226.815441 secs 2024-04-26T12:41:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:53 smithi196 ceph-mon[32572]: pgmap v2270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 618 B/s rd, 1 op/s 2024-04-26T12:41:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:53 smithi110 ceph-mon[28069]: pgmap v2270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 618 B/s rd, 1 op/s 2024-04-26T12:41:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:53 smithi193 ceph-mon[32782]: pgmap v2270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 618 B/s rd, 1 op/s 2024-04-26T12:41:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:55 smithi196 ceph-mon[32572]: pgmap v2271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:55 smithi110 ceph-mon[28069]: pgmap v2271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:55 smithi193 ceph-mon[32782]: pgmap v2271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:57 smithi196 ceph-mon[32572]: pgmap v2272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:41:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3231.815572 secs 2024-04-26T12:41:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:57 smithi110 ceph-mon[28069]: pgmap v2272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:41:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3231.815572 secs 2024-04-26T12:41:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:57 smithi193 ceph-mon[32782]: pgmap v2272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:41:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3231.815572 secs 2024-04-26T12:41:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:41:59 smithi196 ceph-mon[32572]: pgmap v2273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:41:59 smithi110 ceph-mon[28069]: pgmap v2273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:41:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:41:59 smithi193 ceph-mon[32782]: pgmap v2273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:01 smithi193 ceph-mon[32782]: pgmap v2274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:01 smithi196 ceph-mon[32572]: pgmap v2274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:01 smithi110 ceph-mon[28069]: pgmap v2274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:02 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 3236.815694 secs 2024-04-26T12:42:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:02 smithi193 ceph-mon[32782]: slow request 2880.573642 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:42:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:02 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 3236.815694 secs 2024-04-26T12:42:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:02 smithi196 ceph-mon[32572]: slow request 2880.573642 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:42:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:02 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 3236.815694 secs 2024-04-26T12:42:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:02 smithi110 ceph-mon[28069]: slow request 2880.573642 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T12:42:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:03 smithi193 ceph-mon[32782]: pgmap v2275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:03 smithi196 ceph-mon[32572]: pgmap v2275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:03 smithi110 ceph-mon[28069]: pgmap v2275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:05 smithi196 ceph-mon[32572]: pgmap v2276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:05 smithi110 ceph-mon[28069]: pgmap v2276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:05 smithi193 ceph-mon[32782]: pgmap v2276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:07 smithi196 ceph-mon[32572]: pgmap v2277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3241.815839 secs 2024-04-26T12:42:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:07 smithi110 ceph-mon[28069]: pgmap v2277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3241.815839 secs 2024-04-26T12:42:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:07 smithi193 ceph-mon[32782]: pgmap v2277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3241.815839 secs 2024-04-26T12:42:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:09 smithi196 ceph-mon[32572]: pgmap v2278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:09 smithi110 ceph-mon[28069]: pgmap v2278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:09 smithi193 ceph-mon[32782]: pgmap v2278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:11 smithi196 ceph-mon[32572]: pgmap v2279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:11 smithi110 ceph-mon[28069]: pgmap v2279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:11 smithi193 ceph-mon[32782]: pgmap v2279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3246.815956 secs 2024-04-26T12:42:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3246.815956 secs 2024-04-26T12:42:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3246.815956 secs 2024-04-26T12:42:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:13 smithi196 ceph-mon[32572]: pgmap v2280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:13 smithi110 ceph-mon[28069]: pgmap v2280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:13 smithi193 ceph-mon[32782]: pgmap v2280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:15 smithi196 ceph-mon[32572]: pgmap v2281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:15 smithi110 ceph-mon[28069]: pgmap v2281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:15 smithi193 ceph-mon[32782]: pgmap v2281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:42:16.870+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:42:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:42:16.870+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:42:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:42:16.871+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 29 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:42:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:42:16.871+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 29 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:42:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:17 smithi196 ceph-mon[32572]: pgmap v2282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3251.816070 secs 2024-04-26T12:42:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:17 smithi110 ceph-mon[28069]: pgmap v2282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3251.816070 secs 2024-04-26T12:42:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:17 smithi193 ceph-mon[32782]: pgmap v2282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3251.816070 secs 2024-04-26T12:42:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:19 smithi196 ceph-mon[32572]: pgmap v2283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:19 smithi110 ceph-mon[28069]: pgmap v2283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:19 smithi193 ceph-mon[32782]: pgmap v2283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:21 smithi196 ceph-mon[32572]: pgmap v2284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:21 smithi110 ceph-mon[28069]: pgmap v2284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:21 smithi193 ceph-mon[32782]: pgmap v2284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3256.816222 secs 2024-04-26T12:42:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3256.816222 secs 2024-04-26T12:42:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3256.816222 secs 2024-04-26T12:42:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:23 smithi196 ceph-mon[32572]: pgmap v2285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:23 smithi110 ceph-mon[28069]: pgmap v2285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:23 smithi193 ceph-mon[32782]: pgmap v2285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:25 smithi196 ceph-mon[32572]: pgmap v2286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:25 smithi110 ceph-mon[28069]: pgmap v2286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:25 smithi193 ceph-mon[32782]: pgmap v2286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:27 smithi196 ceph-mon[32572]: pgmap v2287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3261.816339 secs 2024-04-26T12:42:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:27 smithi110 ceph-mon[28069]: pgmap v2287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3261.816339 secs 2024-04-26T12:42:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:27 smithi193 ceph-mon[32782]: pgmap v2287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3261.816339 secs 2024-04-26T12:42:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:29 smithi196 ceph-mon[32572]: pgmap v2288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:29 smithi110 ceph-mon[28069]: pgmap v2288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:29 smithi193 ceph-mon[32782]: pgmap v2288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:31 smithi196 ceph-mon[32572]: pgmap v2289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:31 smithi110 ceph-mon[28069]: pgmap v2289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:31 smithi193 ceph-mon[32782]: pgmap v2289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3266.816458 secs 2024-04-26T12:42:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3266.816458 secs 2024-04-26T12:42:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3266.816458 secs 2024-04-26T12:42:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:33 smithi110 ceph-mon[28069]: pgmap v2290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:33 smithi193 ceph-mon[32782]: pgmap v2290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:33 smithi196 ceph-mon[32572]: pgmap v2290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:35 smithi110 ceph-mon[28069]: pgmap v2291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:35 smithi193 ceph-mon[32782]: pgmap v2291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:35 smithi196 ceph-mon[32572]: pgmap v2291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3271.816593 secs 2024-04-26T12:42:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:37 smithi110 ceph-mon[28069]: pgmap v2292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3271.816593 secs 2024-04-26T12:42:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:37 smithi193 ceph-mon[32782]: pgmap v2292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3271.816593 secs 2024-04-26T12:42:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:37 smithi196 ceph-mon[32572]: pgmap v2292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:39 smithi110 ceph-mon[28069]: pgmap v2293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:39 smithi193 ceph-mon[32782]: pgmap v2293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:39 smithi196 ceph-mon[32572]: pgmap v2293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:41 smithi110 ceph-mon[28069]: pgmap v2294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:41 smithi193 ceph-mon[32782]: pgmap v2294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:41 smithi196 ceph-mon[32572]: pgmap v2294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3276.816711 secs 2024-04-26T12:42:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3276.816711 secs 2024-04-26T12:42:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3276.816711 secs 2024-04-26T12:42:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:43 smithi110 ceph-mon[28069]: pgmap v2295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:43 smithi193 ceph-mon[32782]: pgmap v2295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:43 smithi196 ceph-mon[32572]: pgmap v2295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:45 smithi193 ceph-mon[32782]: pgmap v2296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:45 smithi196 ceph-mon[32572]: pgmap v2296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:45 smithi110 ceph-mon[28069]: pgmap v2296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:42:47.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3281.816806 secs 2024-04-26T12:42:47.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:47 smithi196 ceph-mon[32572]: pgmap v2297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:47.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:42:47.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3281.816806 secs 2024-04-26T12:42:47.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:47 smithi110 ceph-mon[28069]: pgmap v2297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:47.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:42:47.595 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.595 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.595 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.595 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3281.816806 secs 2024-04-26T12:42:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:47 smithi193 ceph-mon[32782]: pgmap v2297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:42:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:42:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:42:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:42:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:42:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:42:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:42:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:42:48.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:42:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:49 smithi193 ceph-mon[32782]: pgmap v2298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:42:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:49 smithi193 ceph-mon[32782]: pgmap v2299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:49 smithi196 ceph-mon[32572]: pgmap v2298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:42:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:49 smithi196 ceph-mon[32572]: pgmap v2299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:49 smithi110 ceph-mon[28069]: pgmap v2298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:42:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:49 smithi110 ceph-mon[28069]: pgmap v2299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:50 smithi193 ceph-mon[32782]: pgmap v2300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:50 smithi196 ceph-mon[32572]: pgmap v2300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:50 smithi110 ceph-mon[28069]: pgmap v2300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3286.816923 secs 2024-04-26T12:42:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3286.816923 secs 2024-04-26T12:42:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3286.816923 secs 2024-04-26T12:42:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:52 smithi196 ceph-mon[32572]: pgmap v2301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:52 smithi110 ceph-mon[28069]: pgmap v2301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:52 smithi193 ceph-mon[32782]: pgmap v2301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:54 smithi193 ceph-mon[32782]: pgmap v2302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:54 smithi196 ceph-mon[32572]: pgmap v2302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:54 smithi110 ceph-mon[28069]: pgmap v2302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:57 smithi193 ceph-mon[32782]: pgmap v2303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3291.817047 secs 2024-04-26T12:42:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:57 smithi196 ceph-mon[32572]: pgmap v2303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3291.817047 secs 2024-04-26T12:42:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:57 smithi110 ceph-mon[28069]: pgmap v2303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:42:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3291.817047 secs 2024-04-26T12:42:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:42:59 smithi193 ceph-mon[32782]: pgmap v2304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:42:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:42:59 smithi196 ceph-mon[32572]: pgmap v2304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:42:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:42:59 smithi110 ceph-mon[28069]: pgmap v2304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:43:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:01 smithi193 ceph-mon[32782]: pgmap v2305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:01 smithi196 ceph-mon[32572]: pgmap v2305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:01 smithi110 ceph-mon[28069]: pgmap v2305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3296.817127 secs 2024-04-26T12:43:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3296.817127 secs 2024-04-26T12:43:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3296.817127 secs 2024-04-26T12:43:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:03 smithi193 ceph-mon[32782]: pgmap v2306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:03 smithi196 ceph-mon[32572]: pgmap v2306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:03 smithi110 ceph-mon[28069]: pgmap v2306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:05 smithi196 ceph-mon[32572]: pgmap v2307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:05 smithi110 ceph-mon[28069]: pgmap v2307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:05 smithi193 ceph-mon[32782]: pgmap v2307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:07 smithi196 ceph-mon[32572]: pgmap v2308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3301.817241 secs 2024-04-26T12:43:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:07 smithi110 ceph-mon[28069]: pgmap v2308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3301.817241 secs 2024-04-26T12:43:07.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:07 smithi193 ceph-mon[32782]: pgmap v2308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:07.624 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3301.817241 secs 2024-04-26T12:43:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:09 smithi196 ceph-mon[32572]: pgmap v2309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:09 smithi110 ceph-mon[28069]: pgmap v2309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:09 smithi193 ceph-mon[32782]: pgmap v2309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:11 smithi196 ceph-mon[32572]: pgmap v2310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:11 smithi110 ceph-mon[28069]: pgmap v2310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:11 smithi193 ceph-mon[32782]: pgmap v2310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3306.817365 secs 2024-04-26T12:43:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3306.817365 secs 2024-04-26T12:43:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3306.817365 secs 2024-04-26T12:43:13.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:13 smithi196 ceph-mon[32572]: pgmap v2311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:13 smithi110 ceph-mon[28069]: pgmap v2311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:13 smithi193 ceph-mon[32782]: pgmap v2311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:15 smithi196 ceph-mon[32572]: pgmap v2312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:15 smithi110 ceph-mon[28069]: pgmap v2312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:15 smithi193 ceph-mon[32782]: pgmap v2312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:17 smithi196 ceph-mon[32572]: pgmap v2313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3311.817480 secs 2024-04-26T12:43:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:17 smithi110 ceph-mon[28069]: pgmap v2313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3311.817480 secs 2024-04-26T12:43:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:17 smithi193 ceph-mon[32782]: pgmap v2313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3311.817480 secs 2024-04-26T12:43:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:19 smithi196 ceph-mon[32572]: pgmap v2314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:19 smithi110 ceph-mon[28069]: pgmap v2314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:19 smithi193 ceph-mon[32782]: pgmap v2314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:21 smithi196 ceph-mon[32572]: pgmap v2315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:21 smithi110 ceph-mon[28069]: pgmap v2315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:21 smithi193 ceph-mon[32782]: pgmap v2315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3316.817602 secs 2024-04-26T12:43:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3316.817602 secs 2024-04-26T12:43:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3316.817602 secs 2024-04-26T12:43:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:23 smithi196 ceph-mon[32572]: pgmap v2316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:23 smithi110 ceph-mon[28069]: pgmap v2316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:23 smithi193 ceph-mon[32782]: pgmap v2316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:25 smithi196 ceph-mon[32572]: pgmap v2317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:25 smithi110 ceph-mon[28069]: pgmap v2317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:25 smithi193 ceph-mon[32782]: pgmap v2317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:27 smithi196 ceph-mon[32572]: pgmap v2318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3321.817718 secs 2024-04-26T12:43:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:27 smithi110 ceph-mon[28069]: pgmap v2318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3321.817718 secs 2024-04-26T12:43:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:27 smithi193 ceph-mon[32782]: pgmap v2318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3321.817718 secs 2024-04-26T12:43:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:29 smithi196 ceph-mon[32572]: pgmap v2319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:29 smithi110 ceph-mon[28069]: pgmap v2319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:29 smithi193 ceph-mon[32782]: pgmap v2319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:31 smithi196 ceph-mon[32572]: pgmap v2320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:31 smithi110 ceph-mon[28069]: pgmap v2320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:31 smithi193 ceph-mon[32782]: pgmap v2320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3326.817828 secs 2024-04-26T12:43:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3326.817828 secs 2024-04-26T12:43:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3326.817828 secs 2024-04-26T12:43:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:33 smithi196 ceph-mon[32572]: pgmap v2321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:33 smithi110 ceph-mon[28069]: pgmap v2321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:33 smithi193 ceph-mon[32782]: pgmap v2321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:35 smithi196 ceph-mon[32572]: pgmap v2322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:35 smithi110 ceph-mon[28069]: pgmap v2322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:35 smithi193 ceph-mon[32782]: pgmap v2322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:37 smithi196 ceph-mon[32572]: pgmap v2323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3331.817922 secs 2024-04-26T12:43:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:37 smithi110 ceph-mon[28069]: pgmap v2323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3331.817922 secs 2024-04-26T12:43:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:37 smithi193 ceph-mon[32782]: pgmap v2323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3331.817922 secs 2024-04-26T12:43:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:39 smithi196 ceph-mon[32572]: pgmap v2324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:39 smithi110 ceph-mon[28069]: pgmap v2324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:39 smithi193 ceph-mon[32782]: pgmap v2324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:41 smithi196 ceph-mon[32572]: pgmap v2325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:41 smithi110 ceph-mon[28069]: pgmap v2325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:41 smithi193 ceph-mon[32782]: pgmap v2325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3336.818034 secs 2024-04-26T12:43:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3336.818034 secs 2024-04-26T12:43:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3336.818034 secs 2024-04-26T12:43:43.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:43 smithi196 ceph-mon[32572]: pgmap v2326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:43 smithi110 ceph-mon[28069]: pgmap v2326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:43 smithi193 ceph-mon[32782]: pgmap v2326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:45 smithi196 ceph-mon[32572]: pgmap v2327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:45 smithi110 ceph-mon[28069]: pgmap v2327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:45 smithi193 ceph-mon[32782]: pgmap v2327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:47 smithi110 ceph-mon[28069]: pgmap v2328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3341.818149 secs 2024-04-26T12:43:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:47 smithi193 ceph-mon[32782]: pgmap v2328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3341.818149 secs 2024-04-26T12:43:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:47 smithi196 ceph-mon[32572]: pgmap v2328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3341.818149 secs 2024-04-26T12:43:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:43:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:43:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:43:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:49 smithi110 ceph-mon[28069]: pgmap v2329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:49 smithi193 ceph-mon[32782]: pgmap v2329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:49 smithi196 ceph-mon[32572]: pgmap v2329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:43:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: pgmap v2330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: pgmap v2330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: pgmap v2330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:51.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3346.818261 secs 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:43:52.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:52.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:43:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:43:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3346.818261 secs 2024-04-26T12:43:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:43:52.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:43:52.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:52.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:43:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:43:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3346.818261 secs 2024-04-26T12:43:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:52.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:53 smithi196 ceph-mon[32572]: pgmap v2331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:53 smithi110 ceph-mon[28069]: pgmap v2331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:53 smithi193 ceph-mon[32782]: pgmap v2331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:43:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: pgmap v2332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:43:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: pgmap v2333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:43:54.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:43:54.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:43:54.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:43:54.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: pgmap v2332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:43:54.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: pgmap v2333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:43:54.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:43:54.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:43:54.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:43:54.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:43:54.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:43:54.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: pgmap v2332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:43:54.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: pgmap v2333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:43:54.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:43:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:56 smithi110 ceph-mon[28069]: pgmap v2334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:43:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:56 smithi193 ceph-mon[32782]: pgmap v2334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:43:56.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:56 smithi196 ceph-mon[32572]: pgmap v2334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:43:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3351.818385 secs 2024-04-26T12:43:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3351.818385 secs 2024-04-26T12:43:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3351.818385 secs 2024-04-26T12:43:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:43:58 smithi110 ceph-mon[28069]: pgmap v2335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 543 B/s rd, 1 op/s 2024-04-26T12:43:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:43:58 smithi193 ceph-mon[32782]: pgmap v2335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 543 B/s rd, 1 op/s 2024-04-26T12:43:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:43:58 smithi196 ceph-mon[32572]: pgmap v2335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 543 B/s rd, 1 op/s 2024-04-26T12:44:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:00 smithi193 ceph-mon[32782]: pgmap v2336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:44:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:00 smithi196 ceph-mon[32572]: pgmap v2336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:44:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:00 smithi110 ceph-mon[28069]: pgmap v2336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:44:02.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:44:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:44:01.942+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:44:02.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:44:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:44:01.942+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:44:02.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:44:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:44:01.942+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:44:02.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:44:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:44:01.943+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:44:02.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:44:01 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:44:01.943+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:44:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3356.818503 secs 2024-04-26T12:44:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:02 smithi193 ceph-mon[32782]: pgmap v2337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:44:02.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3356.818503 secs 2024-04-26T12:44:02.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:02 smithi196 ceph-mon[32572]: pgmap v2337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:44:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3356.818503 secs 2024-04-26T12:44:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:02 smithi110 ceph-mon[28069]: pgmap v2337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:44:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:04 smithi193 ceph-mon[32782]: pgmap v2338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T12:44:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:04 smithi196 ceph-mon[32572]: pgmap v2338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T12:44:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:04 smithi110 ceph-mon[28069]: pgmap v2338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T12:44:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:06 smithi193 ceph-mon[32782]: pgmap v2339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:44:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:06 smithi196 ceph-mon[32572]: pgmap v2339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:44:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:06 smithi110 ceph-mon[28069]: pgmap v2339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:44:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3361.818623 secs 2024-04-26T12:44:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3361.818623 secs 2024-04-26T12:44:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3361.818623 secs 2024-04-26T12:44:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:08 smithi193 ceph-mon[32782]: pgmap v2340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:44:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:08 smithi196 ceph-mon[32572]: pgmap v2340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:44:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:08 smithi110 ceph-mon[28069]: pgmap v2340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:44:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:09 smithi193 ceph-mon[32782]: pgmap v2341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:44:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:09 smithi196 ceph-mon[32572]: pgmap v2341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:44:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:09 smithi110 ceph-mon[28069]: pgmap v2341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:44:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3366.818740 secs 2024-04-26T12:44:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:12 smithi110 ceph-mon[28069]: pgmap v2342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:44:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3366.818740 secs 2024-04-26T12:44:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:12 smithi193 ceph-mon[32782]: pgmap v2342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:44:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3366.818740 secs 2024-04-26T12:44:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:12 smithi196 ceph-mon[32572]: pgmap v2342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:44:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:14 smithi110 ceph-mon[28069]: pgmap v2343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:44:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:14 smithi193 ceph-mon[32782]: pgmap v2343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:44:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:14 smithi196 ceph-mon[32572]: pgmap v2343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:44:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:16 smithi193 ceph-mon[32782]: pgmap v2344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:16 smithi196 ceph-mon[32572]: pgmap v2344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:16 smithi110 ceph-mon[28069]: pgmap v2344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3371.818857 secs 2024-04-26T12:44:17.657 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3371.818857 secs 2024-04-26T12:44:17.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3371.818857 secs 2024-04-26T12:44:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:18 smithi193 ceph-mon[32782]: pgmap v2345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:18 smithi196 ceph-mon[32572]: pgmap v2345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:18 smithi110 ceph-mon[28069]: pgmap v2345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:20 smithi193 ceph-mon[32782]: pgmap v2346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:20 smithi196 ceph-mon[32572]: pgmap v2346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:20 smithi110 ceph-mon[28069]: pgmap v2346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3376.818969 secs 2024-04-26T12:44:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:22 smithi193 ceph-mon[32782]: pgmap v2347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3376.818969 secs 2024-04-26T12:44:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:22 smithi196 ceph-mon[32572]: pgmap v2347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3376.818969 secs 2024-04-26T12:44:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:22 smithi110 ceph-mon[28069]: pgmap v2347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:24 smithi193 ceph-mon[32782]: pgmap v2348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:24 smithi196 ceph-mon[32572]: pgmap v2348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:24.810 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:24 smithi110 ceph-mon[28069]: pgmap v2348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:26 smithi193 ceph-mon[32782]: pgmap v2349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:26 smithi196 ceph-mon[32572]: pgmap v2349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:26 smithi110 ceph-mon[28069]: pgmap v2349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3381.819085 secs 2024-04-26T12:44:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:27 smithi193 ceph-mon[32782]: pgmap v2350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3381.819085 secs 2024-04-26T12:44:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:27 smithi196 ceph-mon[32572]: pgmap v2350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3381.819085 secs 2024-04-26T12:44:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:27 smithi110 ceph-mon[28069]: pgmap v2350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:30 smithi110 ceph-mon[28069]: pgmap v2351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:30 smithi193 ceph-mon[32782]: pgmap v2351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:30 smithi196 ceph-mon[32572]: pgmap v2351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3386.819208 secs 2024-04-26T12:44:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:32 smithi193 ceph-mon[32782]: pgmap v2352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3386.819208 secs 2024-04-26T12:44:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:32 smithi196 ceph-mon[32572]: pgmap v2352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3386.819208 secs 2024-04-26T12:44:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:32 smithi110 ceph-mon[28069]: pgmap v2352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:34 smithi193 ceph-mon[32782]: pgmap v2353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:34.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:34 smithi196 ceph-mon[32572]: pgmap v2353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:34 smithi110 ceph-mon[28069]: pgmap v2353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:36 smithi193 ceph-mon[32782]: pgmap v2354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:36 smithi196 ceph-mon[32572]: pgmap v2354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:36 smithi110 ceph-mon[28069]: pgmap v2354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3391.819325 secs 2024-04-26T12:44:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3391.819325 secs 2024-04-26T12:44:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3391.819325 secs 2024-04-26T12:44:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:38 smithi193 ceph-mon[32782]: pgmap v2355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:38 smithi196 ceph-mon[32572]: pgmap v2355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:38 smithi110 ceph-mon[28069]: pgmap v2355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:40 smithi193 ceph-mon[32782]: pgmap v2356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:40 smithi196 ceph-mon[32572]: pgmap v2356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:40 smithi110 ceph-mon[28069]: pgmap v2356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3396.819449 secs 2024-04-26T12:44:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:42 smithi193 ceph-mon[32782]: pgmap v2357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3396.819449 secs 2024-04-26T12:44:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:42 smithi196 ceph-mon[32572]: pgmap v2357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3396.819449 secs 2024-04-26T12:44:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:42 smithi110 ceph-mon[28069]: pgmap v2357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:43 smithi193 ceph-mon[32782]: pgmap v2358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:43 smithi196 ceph-mon[32572]: pgmap v2358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:43 smithi110 ceph-mon[28069]: pgmap v2358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:46 smithi193 ceph-mon[32782]: pgmap v2359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:46 smithi196 ceph-mon[32572]: pgmap v2359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:46 smithi110 ceph-mon[28069]: pgmap v2359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3401.819579 secs 2024-04-26T12:44:47.657 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3401.819579 secs 2024-04-26T12:44:47.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3401.819579 secs 2024-04-26T12:44:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:48 smithi193 ceph-mon[32782]: pgmap v2360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:48 smithi196 ceph-mon[32572]: pgmap v2360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:48 smithi110 ceph-mon[28069]: pgmap v2360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:50 smithi193 ceph-mon[32782]: pgmap v2361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:50 smithi196 ceph-mon[32572]: pgmap v2361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:50 smithi110 ceph-mon[28069]: pgmap v2361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3406.819666 secs 2024-04-26T12:44:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:52 smithi193 ceph-mon[32782]: pgmap v2362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3406.819666 secs 2024-04-26T12:44:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:52 smithi196 ceph-mon[32572]: pgmap v2362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3406.819666 secs 2024-04-26T12:44:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:52 smithi110 ceph-mon[28069]: pgmap v2362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:44:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:54 smithi193 ceph-mon[32782]: pgmap v2363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:44:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:54 smithi196 ceph-mon[32572]: pgmap v2363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:44:54.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:54 smithi110 ceph-mon[28069]: pgmap v2363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:44:54.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:44:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:44:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:44:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:44:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:44:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:44:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:44:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:44:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:44:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:56 smithi193 ceph-mon[32782]: pgmap v2364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:56 smithi193 ceph-mon[32782]: pgmap v2365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:56 smithi196 ceph-mon[32572]: pgmap v2364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:56 smithi196 ceph-mon[32572]: pgmap v2365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:44:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:56 smithi110 ceph-mon[28069]: pgmap v2364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:44:56.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:56 smithi110 ceph-mon[28069]: pgmap v2365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:44:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3411.819764 secs 2024-04-26T12:44:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:57 smithi193 ceph-mon[32782]: pgmap v2366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:44:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3411.819764 secs 2024-04-26T12:44:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:57 smithi196 ceph-mon[32572]: pgmap v2366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:44:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3411.819764 secs 2024-04-26T12:44:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:57 smithi110 ceph-mon[28069]: pgmap v2366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:45:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:44:59 smithi193 ceph-mon[32782]: pgmap v2367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:45:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:44:59 smithi196 ceph-mon[32572]: pgmap v2367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:45:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:44:59 smithi110 ceph-mon[28069]: pgmap v2367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:45:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:01 smithi193 ceph-mon[32782]: pgmap v2368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:45:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3416.819907 secs 2024-04-26T12:45:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:01 smithi196 ceph-mon[32572]: pgmap v2368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:45:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3416.819907 secs 2024-04-26T12:45:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:01 smithi110 ceph-mon[28069]: pgmap v2368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:45:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3416.819907 secs 2024-04-26T12:45:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:03 smithi193 ceph-mon[32782]: pgmap v2369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:03 smithi196 ceph-mon[32572]: pgmap v2369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:03 smithi110 ceph-mon[28069]: pgmap v2369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:05 smithi193 ceph-mon[32782]: pgmap v2370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:05 smithi196 ceph-mon[32572]: pgmap v2370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:05 smithi110 ceph-mon[28069]: pgmap v2370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3421.820055 secs 2024-04-26T12:45:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3421.820055 secs 2024-04-26T12:45:07.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3421.820055 secs 2024-04-26T12:45:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:07 smithi193 ceph-mon[32782]: pgmap v2371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:45:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:07 smithi196 ceph-mon[32572]: pgmap v2371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:45:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:07 smithi110 ceph-mon[28069]: pgmap v2371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:45:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:09 smithi193 ceph-mon[32782]: pgmap v2372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:09 smithi196 ceph-mon[32572]: pgmap v2372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:09 smithi110 ceph-mon[28069]: pgmap v2372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:11 smithi196 ceph-mon[32572]: pgmap v2373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:45:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3426.820196 secs 2024-04-26T12:45:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:11 smithi110 ceph-mon[28069]: pgmap v2373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:45:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3426.820196 secs 2024-04-26T12:45:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:11 smithi193 ceph-mon[32782]: pgmap v2373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:45:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3426.820196 secs 2024-04-26T12:45:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:13 smithi196 ceph-mon[32572]: pgmap v2374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:13 smithi110 ceph-mon[28069]: pgmap v2374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:13 smithi193 ceph-mon[32782]: pgmap v2374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:45:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:15 smithi196 ceph-mon[32572]: pgmap v2375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:16.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:15 smithi110 ceph-mon[28069]: pgmap v2375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:15 smithi193 ceph-mon[32782]: pgmap v2375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:45:16.899+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:45:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:45:16.899+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:45:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:45:16.902+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 30 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:45:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:45:16.902+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 30 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:45:17.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3431.820317 secs 2024-04-26T12:45:17.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3431.820317 secs 2024-04-26T12:45:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3431.820317 secs 2024-04-26T12:45:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:17 smithi196 ceph-mon[32572]: pgmap v2376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:17 smithi110 ceph-mon[28069]: pgmap v2376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:17 smithi193 ceph-mon[32782]: pgmap v2376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:19 smithi196 ceph-mon[32572]: pgmap v2377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:19 smithi110 ceph-mon[28069]: pgmap v2377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:19 smithi193 ceph-mon[32782]: pgmap v2377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:21 smithi196 ceph-mon[32572]: pgmap v2378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3436.820459 secs 2024-04-26T12:45:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:21 smithi110 ceph-mon[28069]: pgmap v2378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3436.820459 secs 2024-04-26T12:45:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:21 smithi193 ceph-mon[32782]: pgmap v2378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3436.820459 secs 2024-04-26T12:45:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:23 smithi196 ceph-mon[32572]: pgmap v2379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:23 smithi110 ceph-mon[28069]: pgmap v2379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:23 smithi193 ceph-mon[32782]: pgmap v2379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:25 smithi196 ceph-mon[32572]: pgmap v2380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:25 smithi110 ceph-mon[28069]: pgmap v2380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:25 smithi193 ceph-mon[32782]: pgmap v2380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3441.820596 secs 2024-04-26T12:45:27.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3441.820596 secs 2024-04-26T12:45:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3441.820596 secs 2024-04-26T12:45:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:27 smithi196 ceph-mon[32572]: pgmap v2381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:27 smithi110 ceph-mon[28069]: pgmap v2381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:28.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:27 smithi193 ceph-mon[32782]: pgmap v2381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:29 smithi196 ceph-mon[32572]: pgmap v2382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:29 smithi110 ceph-mon[28069]: pgmap v2382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:29 smithi193 ceph-mon[32782]: pgmap v2382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:31 smithi196 ceph-mon[32572]: pgmap v2383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3446.820670 secs 2024-04-26T12:45:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:31 smithi110 ceph-mon[28069]: pgmap v2383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3446.820670 secs 2024-04-26T12:45:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:31 smithi193 ceph-mon[32782]: pgmap v2383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3446.820670 secs 2024-04-26T12:45:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:33 smithi196 ceph-mon[32572]: pgmap v2384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:33 smithi110 ceph-mon[28069]: pgmap v2384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:33 smithi193 ceph-mon[32782]: pgmap v2384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:35 smithi196 ceph-mon[32572]: pgmap v2385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:35 smithi110 ceph-mon[28069]: pgmap v2385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:35 smithi193 ceph-mon[32782]: pgmap v2385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:36 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3451.820782 secs 2024-04-26T12:45:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:36 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3451.820782 secs 2024-04-26T12:45:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:36 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3451.820782 secs 2024-04-26T12:45:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:37 smithi196 ceph-mon[32572]: pgmap v2386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:37 smithi110 ceph-mon[28069]: pgmap v2386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:37 smithi193 ceph-mon[32782]: pgmap v2386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:39 smithi196 ceph-mon[32572]: pgmap v2387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:39 smithi110 ceph-mon[28069]: pgmap v2387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:39 smithi193 ceph-mon[32782]: pgmap v2387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:41 smithi196 ceph-mon[32572]: pgmap v2388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3456.820896 secs 2024-04-26T12:45:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:41 smithi110 ceph-mon[28069]: pgmap v2388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3456.820896 secs 2024-04-26T12:45:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:41 smithi193 ceph-mon[32782]: pgmap v2388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3456.820896 secs 2024-04-26T12:45:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:43 smithi196 ceph-mon[32572]: pgmap v2389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:43 smithi110 ceph-mon[28069]: pgmap v2389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:43 smithi193 ceph-mon[32782]: pgmap v2389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:45 smithi196 ceph-mon[32572]: pgmap v2390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:45 smithi110 ceph-mon[28069]: pgmap v2390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:45 smithi193 ceph-mon[32782]: pgmap v2390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3461.821024 secs 2024-04-26T12:45:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3461.821024 secs 2024-04-26T12:45:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3461.821024 secs 2024-04-26T12:45:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:47 smithi196 ceph-mon[32572]: pgmap v2391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:47 smithi110 ceph-mon[28069]: pgmap v2391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:47 smithi193 ceph-mon[32782]: pgmap v2391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:50 smithi196 ceph-mon[32572]: pgmap v2392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:50 smithi110 ceph-mon[28069]: pgmap v2392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:50 smithi193 ceph-mon[32782]: pgmap v2392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:52 smithi110 ceph-mon[28069]: pgmap v2393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3466.821146 secs 2024-04-26T12:45:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:52 smithi193 ceph-mon[32782]: pgmap v2393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3466.821146 secs 2024-04-26T12:45:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:52 smithi196 ceph-mon[32572]: pgmap v2393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3466.821146 secs 2024-04-26T12:45:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:54 smithi110 ceph-mon[28069]: pgmap v2394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:54 smithi193 ceph-mon[32782]: pgmap v2394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:54 smithi196 ceph-mon[32572]: pgmap v2394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:45:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:56 smithi110 ceph-mon[28069]: pgmap v2395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:45:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:56 smithi193 ceph-mon[32782]: pgmap v2395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:45:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:56 smithi196 ceph-mon[32572]: pgmap v2395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:45:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:45:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3471.821259 secs 2024-04-26T12:45:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:45:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:45:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:57 smithi110 ceph-mon[28069]: pgmap v2396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T12:45:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:57 smithi110 ceph-mon[28069]: pgmap v2397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:45:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:45:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3471.821259 secs 2024-04-26T12:45:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:45:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:45:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:57 smithi193 ceph-mon[32782]: pgmap v2396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T12:45:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:57 smithi193 ceph-mon[32782]: pgmap v2397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:45:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:45:57.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3471.821259 secs 2024-04-26T12:45:57.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:45:57.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:45:57.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:57 smithi196 ceph-mon[32572]: pgmap v2396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T12:45:57.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:57 smithi196 ceph-mon[32572]: pgmap v2397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:45:57.508 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:45:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:45:58 smithi196 ceph-mon[32572]: pgmap v2398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:45:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:45:58 smithi110 ceph-mon[28069]: pgmap v2398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:45:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:45:58 smithi193 ceph-mon[32782]: pgmap v2398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:46:01.427 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:01 smithi110 ceph-mon[28069]: pgmap v2399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:46:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:01 smithi196 ceph-mon[32572]: pgmap v2399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:46:01.552 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:01 smithi193 ceph-mon[32782]: pgmap v2399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:46:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:46:01.907+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:46:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:46:01.907+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:46:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:46:01.908+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 31 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:46:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:46:01.908+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 31 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:46:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3476.821375 secs 2024-04-26T12:46:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3476.821375 secs 2024-04-26T12:46:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3476.821375 secs 2024-04-26T12:46:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:03 smithi196 ceph-mon[32572]: pgmap v2400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T12:46:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:03 smithi110 ceph-mon[28069]: pgmap v2400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T12:46:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:03 smithi193 ceph-mon[32782]: pgmap v2400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T12:46:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:04 smithi196 ceph-mon[32572]: pgmap v2401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:46:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:04 smithi110 ceph-mon[28069]: pgmap v2401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:46:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:04 smithi193 ceph-mon[32782]: pgmap v2401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:46:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:06 smithi196 ceph-mon[32572]: pgmap v2402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:46:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:06 smithi110 ceph-mon[28069]: pgmap v2402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:46:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:06 smithi193 ceph-mon[32782]: pgmap v2402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:46:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3481.821438 secs 2024-04-26T12:46:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3481.821438 secs 2024-04-26T12:46:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3481.821438 secs 2024-04-26T12:46:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:08 smithi196 ceph-mon[32572]: pgmap v2403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:08 smithi110 ceph-mon[28069]: pgmap v2403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:08 smithi193 ceph-mon[32782]: pgmap v2403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:10 smithi196 ceph-mon[32572]: pgmap v2404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:10 smithi110 ceph-mon[28069]: pgmap v2404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:10 smithi193 ceph-mon[32782]: pgmap v2404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3486.821585 secs 2024-04-26T12:46:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3486.821585 secs 2024-04-26T12:46:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3486.821585 secs 2024-04-26T12:46:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:12 smithi110 ceph-mon[28069]: pgmap v2405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:12 smithi193 ceph-mon[32782]: pgmap v2405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:12 smithi196 ceph-mon[32572]: pgmap v2405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:14 smithi196 ceph-mon[32572]: pgmap v2406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:14 smithi110 ceph-mon[28069]: pgmap v2406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:14 smithi193 ceph-mon[32782]: pgmap v2406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:16 smithi196 ceph-mon[32572]: pgmap v2407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:16 smithi110 ceph-mon[28069]: pgmap v2407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:16 smithi193 ceph-mon[32782]: pgmap v2407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:17.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3491.821702 secs 2024-04-26T12:46:17.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3491.821702 secs 2024-04-26T12:46:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3491.821702 secs 2024-04-26T12:46:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:18 smithi196 ceph-mon[32572]: pgmap v2408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:18 smithi110 ceph-mon[28069]: pgmap v2408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:18 smithi193 ceph-mon[32782]: pgmap v2408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:20 smithi196 ceph-mon[32572]: pgmap v2409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:20 smithi110 ceph-mon[28069]: pgmap v2409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:20 smithi193 ceph-mon[32782]: pgmap v2409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3496.821821 secs 2024-04-26T12:46:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3496.821821 secs 2024-04-26T12:46:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3496.821821 secs 2024-04-26T12:46:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:22 smithi110 ceph-mon[28069]: pgmap v2410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:22 smithi193 ceph-mon[32782]: pgmap v2410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:22 smithi196 ceph-mon[32572]: pgmap v2410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:24 smithi196 ceph-mon[32572]: pgmap v2411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:24 smithi110 ceph-mon[28069]: pgmap v2411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:24 smithi193 ceph-mon[32782]: pgmap v2411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:26 smithi196 ceph-mon[32572]: pgmap v2412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:26 smithi110 ceph-mon[28069]: pgmap v2412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:26 smithi193 ceph-mon[32782]: pgmap v2412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3501.821922 secs 2024-04-26T12:46:27.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3501.821922 secs 2024-04-26T12:46:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3501.821922 secs 2024-04-26T12:46:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:28 smithi196 ceph-mon[32572]: pgmap v2413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:28 smithi110 ceph-mon[28069]: pgmap v2413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:28 smithi193 ceph-mon[32782]: pgmap v2413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:30 smithi196 ceph-mon[32572]: pgmap v2414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:30 smithi110 ceph-mon[28069]: pgmap v2414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:30 smithi193 ceph-mon[32782]: pgmap v2414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:31 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3506.822021 secs 2024-04-26T12:46:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:31 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3506.822021 secs 2024-04-26T12:46:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:31 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3506.822021 secs 2024-04-26T12:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:32 smithi110 ceph-mon[28069]: pgmap v2415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:32 smithi193 ceph-mon[32782]: pgmap v2415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:32 smithi196 ceph-mon[32572]: pgmap v2415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:34 smithi196 ceph-mon[32572]: pgmap v2416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:34 smithi110 ceph-mon[28069]: pgmap v2416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:34 smithi193 ceph-mon[32782]: pgmap v2416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:36 smithi196 ceph-mon[32572]: pgmap v2417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:36 smithi110 ceph-mon[28069]: pgmap v2417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:36 smithi193 ceph-mon[32782]: pgmap v2417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3511.822097 secs 2024-04-26T12:46:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3511.822097 secs 2024-04-26T12:46:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3511.822097 secs 2024-04-26T12:46:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:38 smithi196 ceph-mon[32572]: pgmap v2418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:38 smithi110 ceph-mon[28069]: pgmap v2418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:38 smithi193 ceph-mon[32782]: pgmap v2418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:40 smithi196 ceph-mon[32572]: pgmap v2419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:40 smithi110 ceph-mon[28069]: pgmap v2419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:40 smithi193 ceph-mon[32782]: pgmap v2419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3516.822161 secs 2024-04-26T12:46:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3516.822161 secs 2024-04-26T12:46:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3516.822161 secs 2024-04-26T12:46:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:42 smithi110 ceph-mon[28069]: pgmap v2420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:42 smithi193 ceph-mon[32782]: pgmap v2420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:42 smithi196 ceph-mon[32572]: pgmap v2420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:44 smithi196 ceph-mon[32572]: pgmap v2421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:44.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:44 smithi110 ceph-mon[28069]: pgmap v2421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:44 smithi193 ceph-mon[32782]: pgmap v2421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:46 smithi196 ceph-mon[32572]: pgmap v2422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:46 smithi110 ceph-mon[28069]: pgmap v2422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:46 smithi193 ceph-mon[32782]: pgmap v2422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:47.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3521.822257 secs 2024-04-26T12:46:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3521.822257 secs 2024-04-26T12:46:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3521.822257 secs 2024-04-26T12:46:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:48 smithi196 ceph-mon[32572]: pgmap v2423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:48 smithi110 ceph-mon[28069]: pgmap v2423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:48.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:48 smithi193 ceph-mon[32782]: pgmap v2423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:50 smithi196 ceph-mon[32572]: pgmap v2424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:50 smithi110 ceph-mon[28069]: pgmap v2424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:50 smithi193 ceph-mon[32782]: pgmap v2424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3526.822379 secs 2024-04-26T12:46:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3526.822379 secs 2024-04-26T12:46:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3526.822379 secs 2024-04-26T12:46:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:52 smithi110 ceph-mon[28069]: pgmap v2425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:52 smithi193 ceph-mon[32782]: pgmap v2425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:52 smithi196 ceph-mon[32572]: pgmap v2425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:46:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:54 smithi196 ceph-mon[32572]: pgmap v2426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:54 smithi110 ceph-mon[28069]: pgmap v2426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:54 smithi193 ceph-mon[32782]: pgmap v2426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T12:46:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:56 smithi196 ceph-mon[32572]: pgmap v2427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:56 smithi110 ceph-mon[28069]: pgmap v2427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:56 smithi193 ceph-mon[32782]: pgmap v2427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:46:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3531.822494 secs 2024-04-26T12:46:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:46:57.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3531.822494 secs 2024-04-26T12:46:57.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:46:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3531.822494 secs 2024-04-26T12:46:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:46:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:46:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:46:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:58 smithi196 ceph-mon[32572]: pgmap v2428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:46:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:58 smithi196 ceph-mon[32572]: pgmap v2429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:46:58.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:46:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:46:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:46:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:46:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:58 smithi110 ceph-mon[28069]: pgmap v2428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:46:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:58 smithi110 ceph-mon[28069]: pgmap v2429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:46:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:46:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:46:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:46:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:46:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:58 smithi193 ceph-mon[32782]: pgmap v2428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:46:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:58 smithi193 ceph-mon[32782]: pgmap v2429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:46:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:46:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:47:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:00 smithi196 ceph-mon[32572]: pgmap v2430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:47:01.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:00 smithi110 ceph-mon[28069]: pgmap v2430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:47:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:00 smithi193 ceph-mon[32782]: pgmap v2430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:47:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3536.822631 secs 2024-04-26T12:47:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3536.822631 secs 2024-04-26T12:47:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3536.822631 secs 2024-04-26T12:47:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:02 smithi196 ceph-mon[32572]: pgmap v2431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:47:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:02 smithi110 ceph-mon[28069]: pgmap v2431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:47:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:02 smithi193 ceph-mon[32782]: pgmap v2431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:47:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:04 smithi196 ceph-mon[32572]: pgmap v2432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:47:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:04 smithi110 ceph-mon[28069]: pgmap v2432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:47:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:04 smithi193 ceph-mon[32782]: pgmap v2432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:47:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:06 smithi196 ceph-mon[32572]: pgmap v2433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:47:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3541.822748 secs 2024-04-26T12:47:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:06 smithi110 ceph-mon[28069]: pgmap v2433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:47:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3541.822748 secs 2024-04-26T12:47:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:06 smithi193 ceph-mon[32782]: pgmap v2433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:47:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3541.822748 secs 2024-04-26T12:47:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:08 smithi196 ceph-mon[32572]: pgmap v2434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:47:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:08 smithi110 ceph-mon[28069]: pgmap v2434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:47:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:08 smithi193 ceph-mon[32782]: pgmap v2434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:47:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:10 smithi196 ceph-mon[32572]: pgmap v2435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:10 smithi110 ceph-mon[28069]: pgmap v2435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:10 smithi193 ceph-mon[32782]: pgmap v2435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3546.822859 secs 2024-04-26T12:47:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3546.822859 secs 2024-04-26T12:47:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3546.822859 secs 2024-04-26T12:47:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:12 smithi196 ceph-mon[32572]: pgmap v2436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:12 smithi110 ceph-mon[28069]: pgmap v2436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:12 smithi193 ceph-mon[32782]: pgmap v2436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:14 smithi196 ceph-mon[32572]: pgmap v2437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:14 smithi110 ceph-mon[28069]: pgmap v2437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:14 smithi193 ceph-mon[32782]: pgmap v2437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:16 smithi196 ceph-mon[32572]: pgmap v2438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3551.822967 secs 2024-04-26T12:47:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:16 smithi110 ceph-mon[28069]: pgmap v2438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:17.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3551.822967 secs 2024-04-26T12:47:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:16 smithi193 ceph-mon[32782]: pgmap v2438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3551.822967 secs 2024-04-26T12:47:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:18 smithi196 ceph-mon[32572]: pgmap v2439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:18 smithi110 ceph-mon[28069]: pgmap v2439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:18 smithi193 ceph-mon[32782]: pgmap v2439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:20 smithi196 ceph-mon[32572]: pgmap v2440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:20 smithi110 ceph-mon[28069]: pgmap v2440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:20 smithi193 ceph-mon[32782]: pgmap v2440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3556.823103 secs 2024-04-26T12:47:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3556.823103 secs 2024-04-26T12:47:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3556.823103 secs 2024-04-26T12:47:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:22 smithi196 ceph-mon[32572]: pgmap v2441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:22 smithi110 ceph-mon[28069]: pgmap v2441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:22 smithi193 ceph-mon[32782]: pgmap v2441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:25 smithi196 ceph-mon[32572]: pgmap v2442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:25 smithi110 ceph-mon[28069]: pgmap v2442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:25 smithi193 ceph-mon[32782]: pgmap v2442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:27 smithi110 ceph-mon[28069]: pgmap v2443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3561.823241 secs 2024-04-26T12:47:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:27 smithi193 ceph-mon[32782]: pgmap v2443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3561.823241 secs 2024-04-26T12:47:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:27 smithi196 ceph-mon[32572]: pgmap v2443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3561.823241 secs 2024-04-26T12:47:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:29 smithi110 ceph-mon[28069]: pgmap v2444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:29 smithi193 ceph-mon[32782]: pgmap v2444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:29 smithi196 ceph-mon[32572]: pgmap v2444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:31.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:31 smithi110 ceph-mon[28069]: pgmap v2445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:31 smithi193 ceph-mon[32782]: pgmap v2445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:31 smithi196 ceph-mon[32572]: pgmap v2445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3566.823361 secs 2024-04-26T12:47:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3566.823361 secs 2024-04-26T12:47:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3566.823361 secs 2024-04-26T12:47:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:33 smithi110 ceph-mon[28069]: pgmap v2446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:33 smithi193 ceph-mon[32782]: pgmap v2446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:33 smithi196 ceph-mon[32572]: pgmap v2446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:35.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:35 smithi110 ceph-mon[28069]: pgmap v2447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:35 smithi193 ceph-mon[32782]: pgmap v2447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:35 smithi196 ceph-mon[32572]: pgmap v2447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:37 smithi193 ceph-mon[32782]: pgmap v2448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3571.823458 secs 2024-04-26T12:47:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:37 smithi196 ceph-mon[32572]: pgmap v2448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3571.823458 secs 2024-04-26T12:47:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:37 smithi110 ceph-mon[28069]: pgmap v2448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3571.823458 secs 2024-04-26T12:47:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:39 smithi193 ceph-mon[32782]: pgmap v2449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:39 smithi196 ceph-mon[32572]: pgmap v2449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:39 smithi110 ceph-mon[28069]: pgmap v2449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:41 smithi193 ceph-mon[32782]: pgmap v2450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:41 smithi196 ceph-mon[32572]: pgmap v2450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:41 smithi110 ceph-mon[28069]: pgmap v2450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:42.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3576.823600 secs 2024-04-26T12:47:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3576.823600 secs 2024-04-26T12:47:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3576.823600 secs 2024-04-26T12:47:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:43 smithi193 ceph-mon[32782]: pgmap v2451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:43 smithi196 ceph-mon[32572]: pgmap v2451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:43 smithi110 ceph-mon[28069]: pgmap v2451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:45 smithi193 ceph-mon[32782]: pgmap v2452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:45 smithi196 ceph-mon[32572]: pgmap v2452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:45 smithi110 ceph-mon[28069]: pgmap v2452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:47.345 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:47 smithi110 ceph-mon[28069]: pgmap v2453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:47.345 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3581.823725 secs 2024-04-26T12:47:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:47 smithi193 ceph-mon[32782]: pgmap v2453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3581.823725 secs 2024-04-26T12:47:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:47 smithi196 ceph-mon[32572]: pgmap v2453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3581.823725 secs 2024-04-26T12:47:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:49 smithi193 ceph-mon[32782]: pgmap v2454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:49 smithi196 ceph-mon[32572]: pgmap v2454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:49 smithi110 ceph-mon[28069]: pgmap v2454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:51 smithi193 ceph-mon[32782]: pgmap v2455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:51 smithi196 ceph-mon[32572]: pgmap v2455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:51 smithi110 ceph-mon[28069]: pgmap v2455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3586.823844 secs 2024-04-26T12:47:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3586.823844 secs 2024-04-26T12:47:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3586.823844 secs 2024-04-26T12:47:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:53 smithi193 ceph-mon[32782]: pgmap v2456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:53 smithi196 ceph-mon[32572]: pgmap v2456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:53 smithi110 ceph-mon[28069]: pgmap v2456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:55 smithi193 ceph-mon[32782]: pgmap v2457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:55 smithi196 ceph-mon[32572]: pgmap v2457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:55 smithi110 ceph-mon[28069]: pgmap v2457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:57 smithi193 ceph-mon[32782]: pgmap v2458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3591.823936 secs 2024-04-26T12:47:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:57 smithi196 ceph-mon[32572]: pgmap v2458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3591.823936 secs 2024-04-26T12:47:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:57 smithi110 ceph-mon[28069]: pgmap v2458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:47:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3591.823936 secs 2024-04-26T12:47:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:59 smithi196 ceph-mon[32572]: pgmap v2459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:47:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:47:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:59 smithi110 ceph-mon[28069]: pgmap v2459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:47:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:47:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:59 smithi193 ceph-mon[32782]: pgmap v2459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:47:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:47:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:48:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:48:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:48:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:48:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:48:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:48:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:48:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:48:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:48:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:48:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:01 smithi196 ceph-mon[32572]: pgmap v2460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:48:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:01 smithi196 ceph-mon[32572]: pgmap v2461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:01 smithi110 ceph-mon[28069]: pgmap v2460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:48:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:01 smithi110 ceph-mon[28069]: pgmap v2461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:01 smithi193 ceph-mon[32782]: pgmap v2460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:48:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:01 smithi193 ceph-mon[32782]: pgmap v2461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3596.824074 secs 2024-04-26T12:48:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3596.824074 secs 2024-04-26T12:48:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3596.824074 secs 2024-04-26T12:48:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:03 smithi196 ceph-mon[32572]: pgmap v2462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:03 smithi110 ceph-mon[28069]: pgmap v2462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:03 smithi193 ceph-mon[32782]: pgmap v2462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:05 smithi196 ceph-mon[32572]: pgmap v2463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:05 smithi110 ceph-mon[28069]: pgmap v2463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:05 smithi193 ceph-mon[32782]: pgmap v2463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:07 smithi196 ceph-mon[32572]: pgmap v2464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3601.824192 secs 2024-04-26T12:48:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:07 smithi110 ceph-mon[28069]: pgmap v2464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3601.824192 secs 2024-04-26T12:48:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:07 smithi193 ceph-mon[32782]: pgmap v2464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3601.824192 secs 2024-04-26T12:48:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:09 smithi196 ceph-mon[32572]: pgmap v2465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:09 smithi110 ceph-mon[28069]: pgmap v2465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:09 smithi193 ceph-mon[32782]: pgmap v2465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:48:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:11 smithi196 ceph-mon[32572]: pgmap v2466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:48:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:11 smithi110 ceph-mon[28069]: pgmap v2466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:48:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:11 smithi193 ceph-mon[32782]: pgmap v2466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:48:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3606.824342 secs 2024-04-26T12:48:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3606.824342 secs 2024-04-26T12:48:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3606.824342 secs 2024-04-26T12:48:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:13 smithi196 ceph-mon[32572]: pgmap v2467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:13 smithi110 ceph-mon[28069]: pgmap v2467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:13 smithi193 ceph-mon[32782]: pgmap v2467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:15 smithi196 ceph-mon[32572]: pgmap v2468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:15 smithi110 ceph-mon[28069]: pgmap v2468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:15 smithi193 ceph-mon[32782]: pgmap v2468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.362+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 msgr2=0x7f26000b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T12:48:16.364 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.362+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 msgr2=0x7f26000b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T12:48:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.362+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 0x7f26000b1210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f260c0038f0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:48:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.362+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 0x7f26000b1210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f260c0038f0 comp rx=0 tx=0).stop 2024-04-26T12:48:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.362+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 msgr2=0x7f26000b1210 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T12:48:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.362+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 msgr2=0x7f26000b1210 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T12:48:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.362+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b0e30 0x7f26000b1210 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:48:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.362+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 0x7f26000b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:48:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.363+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 0x7f26000b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:48:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.365+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 0x7f26000b1d40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2614029000 tx=0x7f2614018000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:48:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.392+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T12:48:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.392+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T12:48:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.392+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:48:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.392+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T12:48:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.392+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:48:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.393+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T12:48:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.394+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T12:48:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.928+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:48:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.928+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:48:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.929+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 32 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:48:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:48:16.929+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 32 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:48:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:17 smithi196 ceph-mon[32572]: pgmap v2469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3611.824461 secs 2024-04-26T12:48:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:17 smithi110 ceph-mon[28069]: pgmap v2469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3611.824461 secs 2024-04-26T12:48:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:17 smithi193 ceph-mon[32782]: pgmap v2469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3611.824461 secs 2024-04-26T12:48:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:19 smithi196 ceph-mon[32572]: pgmap v2470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:19 smithi110 ceph-mon[28069]: pgmap v2470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:19 smithi193 ceph-mon[32782]: pgmap v2470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:21 smithi196 ceph-mon[32572]: pgmap v2471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:21 smithi110 ceph-mon[28069]: pgmap v2471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:21 smithi193 ceph-mon[32782]: pgmap v2471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3616.824597 secs 2024-04-26T12:48:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3616.824597 secs 2024-04-26T12:48:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3616.824597 secs 2024-04-26T12:48:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:23 smithi196 ceph-mon[32572]: pgmap v2472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:23 smithi110 ceph-mon[28069]: pgmap v2472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:23 smithi193 ceph-mon[32782]: pgmap v2472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:25 smithi196 ceph-mon[32572]: pgmap v2473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:25 smithi110 ceph-mon[28069]: pgmap v2473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:25 smithi193 ceph-mon[32782]: pgmap v2473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:27 smithi196 ceph-mon[32572]: pgmap v2474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3621.824716 secs 2024-04-26T12:48:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:27 smithi110 ceph-mon[28069]: pgmap v2474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3621.824716 secs 2024-04-26T12:48:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:27 smithi193 ceph-mon[32782]: pgmap v2474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3621.824716 secs 2024-04-26T12:48:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:29 smithi196 ceph-mon[32572]: pgmap v2475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:29 smithi110 ceph-mon[28069]: pgmap v2475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:29 smithi193 ceph-mon[32782]: pgmap v2475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:31 smithi196 ceph-mon[32572]: pgmap v2476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:31 smithi110 ceph-mon[28069]: pgmap v2476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:31 smithi193 ceph-mon[32782]: pgmap v2476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3626.824855 secs 2024-04-26T12:48:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3626.824855 secs 2024-04-26T12:48:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3626.824855 secs 2024-04-26T12:48:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:33 smithi196 ceph-mon[32572]: pgmap v2477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:33.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:33 smithi110 ceph-mon[28069]: pgmap v2477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:33 smithi193 ceph-mon[32782]: pgmap v2477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:35 smithi110 ceph-mon[28069]: pgmap v2478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:35 smithi193 ceph-mon[32782]: pgmap v2478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:35 smithi196 ceph-mon[32572]: pgmap v2478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:37 smithi110 ceph-mon[28069]: pgmap v2479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3631.824997 secs 2024-04-26T12:48:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:37 smithi193 ceph-mon[32782]: pgmap v2479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3631.824997 secs 2024-04-26T12:48:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:37 smithi196 ceph-mon[32572]: pgmap v2479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3631.824997 secs 2024-04-26T12:48:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:39 smithi110 ceph-mon[28069]: pgmap v2480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:39 smithi193 ceph-mon[32782]: pgmap v2480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:39 smithi196 ceph-mon[32572]: pgmap v2480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:41 smithi110 ceph-mon[28069]: pgmap v2481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:41 smithi193 ceph-mon[32782]: pgmap v2481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:41 smithi196 ceph-mon[32572]: pgmap v2481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3636.825122 secs 2024-04-26T12:48:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3636.825122 secs 2024-04-26T12:48:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3636.825122 secs 2024-04-26T12:48:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:43 smithi110 ceph-mon[28069]: pgmap v2482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:43 smithi193 ceph-mon[32782]: pgmap v2482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:43 smithi196 ceph-mon[32572]: pgmap v2482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:45 smithi110 ceph-mon[28069]: pgmap v2483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:45 smithi193 ceph-mon[32782]: pgmap v2483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:45 smithi196 ceph-mon[32572]: pgmap v2483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:47.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:47 smithi196 ceph-mon[32572]: pgmap v2484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:47.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3641.825255 secs 2024-04-26T12:48:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:47 smithi193 ceph-mon[32782]: pgmap v2484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3641.825255 secs 2024-04-26T12:48:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:47 smithi110 ceph-mon[28069]: pgmap v2484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3641.825255 secs 2024-04-26T12:48:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:49 smithi193 ceph-mon[32782]: pgmap v2485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:49 smithi196 ceph-mon[32572]: pgmap v2485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:49 smithi110 ceph-mon[28069]: pgmap v2485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:51 smithi193 ceph-mon[32782]: pgmap v2486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:51 smithi196 ceph-mon[32572]: pgmap v2486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:51 smithi110 ceph-mon[28069]: pgmap v2486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3646.825376 secs 2024-04-26T12:48:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3646.825376 secs 2024-04-26T12:48:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3646.825376 secs 2024-04-26T12:48:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:53 smithi193 ceph-mon[32782]: pgmap v2487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:53 smithi196 ceph-mon[32572]: pgmap v2487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:53 smithi110 ceph-mon[28069]: pgmap v2487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:55 smithi193 ceph-mon[32782]: pgmap v2488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:55 smithi196 ceph-mon[32572]: pgmap v2488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:55 smithi110 ceph-mon[28069]: pgmap v2488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:57 smithi193 ceph-mon[32782]: pgmap v2489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3651.825494 secs 2024-04-26T12:48:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:57 smithi196 ceph-mon[32572]: pgmap v2489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3651.825494 secs 2024-04-26T12:48:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:57 smithi110 ceph-mon[28069]: pgmap v2489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:48:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3651.825494 secs 2024-04-26T12:48:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:48:59 smithi193 ceph-mon[32782]: pgmap v2490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:48:59 smithi196 ceph-mon[32572]: pgmap v2490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:48:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:48:59 smithi110 ceph-mon[28069]: pgmap v2490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:49:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:49:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:49:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:01 smithi193 ceph-mon[32782]: pgmap v2491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:49:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:49:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:49:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:01 smithi196 ceph-mon[32572]: pgmap v2491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:49:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:49:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:49:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:01 smithi110 ceph-mon[28069]: pgmap v2491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:49:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:49:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:49:02.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:49:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:49:02.011+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:49:02.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:49:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:49:02.011+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:49:02.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:49:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:49:02.011+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:49:02.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:49:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:49:02.011+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:49:02.293 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:49:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:49:02.011+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:49:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:02 smithi193 ceph-mon[32782]: pgmap v2492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:49:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:02 smithi193 ceph-mon[32782]: pgmap v2493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3656.825591 secs 2024-04-26T12:49:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:02 smithi196 ceph-mon[32572]: pgmap v2492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:49:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:02 smithi196 ceph-mon[32572]: pgmap v2493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3656.825591 secs 2024-04-26T12:49:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:02 smithi110 ceph-mon[28069]: pgmap v2492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:49:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:02 smithi110 ceph-mon[28069]: pgmap v2493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3656.825591 secs 2024-04-26T12:49:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:04 smithi193 ceph-mon[32782]: pgmap v2494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:04 smithi196 ceph-mon[32572]: pgmap v2494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:04 smithi110 ceph-mon[28069]: pgmap v2494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:06 smithi193 ceph-mon[32782]: pgmap v2495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:06 smithi196 ceph-mon[32572]: pgmap v2495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:06 smithi110 ceph-mon[28069]: pgmap v2495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3661.825718 secs 2024-04-26T12:49:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3661.825718 secs 2024-04-26T12:49:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3661.825718 secs 2024-04-26T12:49:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:08 smithi196 ceph-mon[32572]: pgmap v2496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:49:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:08 smithi110 ceph-mon[28069]: pgmap v2496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:49:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:08 smithi193 ceph-mon[32782]: pgmap v2496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:49:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:09 smithi196 ceph-mon[32572]: pgmap v2497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:09 smithi110 ceph-mon[28069]: pgmap v2497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:09 smithi193 ceph-mon[32782]: pgmap v2497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:49:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:12 smithi193 ceph-mon[32782]: pgmap v2498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:49:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3666.825840 secs 2024-04-26T12:49:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:12 smithi196 ceph-mon[32572]: pgmap v2498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:49:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3666.825840 secs 2024-04-26T12:49:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:12 smithi110 ceph-mon[28069]: pgmap v2498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:49:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3666.825840 secs 2024-04-26T12:49:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:14 smithi193 ceph-mon[32782]: pgmap v2499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:14 smithi196 ceph-mon[32572]: pgmap v2499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:14 smithi110 ceph-mon[28069]: pgmap v2499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:16 smithi193 ceph-mon[32782]: pgmap v2500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:16 smithi196 ceph-mon[32572]: pgmap v2500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:16 smithi110 ceph-mon[28069]: pgmap v2500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3671.825959 secs 2024-04-26T12:49:17.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3671.825959 secs 2024-04-26T12:49:17.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3671.825959 secs 2024-04-26T12:49:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:18 smithi193 ceph-mon[32782]: pgmap v2501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:18 smithi196 ceph-mon[32572]: pgmap v2501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:18 smithi110 ceph-mon[28069]: pgmap v2501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:20 smithi193 ceph-mon[32782]: pgmap v2502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:20 smithi196 ceph-mon[32572]: pgmap v2502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:20 smithi110 ceph-mon[28069]: pgmap v2502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:22 smithi193 ceph-mon[32782]: pgmap v2503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3676.826077 secs 2024-04-26T12:49:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:22 smithi196 ceph-mon[32572]: pgmap v2503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3676.826077 secs 2024-04-26T12:49:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:22 smithi110 ceph-mon[28069]: pgmap v2503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3676.826077 secs 2024-04-26T12:49:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:24 smithi193 ceph-mon[32782]: pgmap v2504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:24 smithi196 ceph-mon[32572]: pgmap v2504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:24 smithi110 ceph-mon[28069]: pgmap v2504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:26 smithi193 ceph-mon[32782]: pgmap v2505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:26 smithi196 ceph-mon[32572]: pgmap v2505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:26 smithi110 ceph-mon[28069]: pgmap v2505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3681.826188 secs 2024-04-26T12:49:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3681.826188 secs 2024-04-26T12:49:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3681.826188 secs 2024-04-26T12:49:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:28 smithi193 ceph-mon[32782]: pgmap v2506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:28 smithi196 ceph-mon[32572]: pgmap v2506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:28 smithi110 ceph-mon[28069]: pgmap v2506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:30 smithi193 ceph-mon[32782]: pgmap v2507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:30 smithi196 ceph-mon[32572]: pgmap v2507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:30 smithi110 ceph-mon[28069]: pgmap v2507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:32 smithi193 ceph-mon[32782]: pgmap v2508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3686.826263 secs 2024-04-26T12:49:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:32 smithi196 ceph-mon[32572]: pgmap v2508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3686.826263 secs 2024-04-26T12:49:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:32 smithi110 ceph-mon[28069]: pgmap v2508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3686.826263 secs 2024-04-26T12:49:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:34 smithi196 ceph-mon[32572]: pgmap v2509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:34 smithi110 ceph-mon[28069]: pgmap v2509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:34 smithi193 ceph-mon[32782]: pgmap v2509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:36 smithi196 ceph-mon[32572]: pgmap v2510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:36.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:36 smithi110 ceph-mon[28069]: pgmap v2510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:36 smithi193 ceph-mon[32782]: pgmap v2510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3691.826383 secs 2024-04-26T12:49:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3691.826383 secs 2024-04-26T12:49:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3691.826383 secs 2024-04-26T12:49:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:38 smithi196 ceph-mon[32572]: pgmap v2511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:38 smithi110 ceph-mon[28069]: pgmap v2511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:38 smithi193 ceph-mon[32782]: pgmap v2511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:40 smithi196 ceph-mon[32572]: pgmap v2512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:40.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:40 smithi110 ceph-mon[28069]: pgmap v2512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:40 smithi193 ceph-mon[32782]: pgmap v2512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:42 smithi196 ceph-mon[32572]: pgmap v2513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3696.826529 secs 2024-04-26T12:49:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:42 smithi110 ceph-mon[28069]: pgmap v2513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3696.826529 secs 2024-04-26T12:49:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:42 smithi193 ceph-mon[32782]: pgmap v2513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3696.826529 secs 2024-04-26T12:49:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:44 smithi196 ceph-mon[32572]: pgmap v2514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:44 smithi110 ceph-mon[28069]: pgmap v2514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:44 smithi193 ceph-mon[32782]: pgmap v2514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:46 smithi196 ceph-mon[32572]: pgmap v2515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:46 smithi110 ceph-mon[28069]: pgmap v2515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:46 smithi193 ceph-mon[32782]: pgmap v2515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:47.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3701.826646 secs 2024-04-26T12:49:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3701.826646 secs 2024-04-26T12:49:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3701.826646 secs 2024-04-26T12:49:48.509 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:48 smithi196 ceph-mon[32572]: pgmap v2516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:48.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:48 smithi110 ceph-mon[28069]: pgmap v2516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:48 smithi193 ceph-mon[32782]: pgmap v2516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:50 smithi196 ceph-mon[32572]: pgmap v2517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:50 smithi110 ceph-mon[28069]: pgmap v2517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:50 smithi193 ceph-mon[32782]: pgmap v2517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:52 smithi196 ceph-mon[32572]: pgmap v2518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3706.826765 secs 2024-04-26T12:49:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:52 smithi110 ceph-mon[28069]: pgmap v2518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3706.826765 secs 2024-04-26T12:49:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:52 smithi193 ceph-mon[32782]: pgmap v2518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:49:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3706.826765 secs 2024-04-26T12:49:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:54 smithi196 ceph-mon[32572]: pgmap v2519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:54 smithi110 ceph-mon[28069]: pgmap v2519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:54 smithi193 ceph-mon[32782]: pgmap v2519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:49:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:56 smithi196 ceph-mon[32572]: pgmap v2520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:49:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:56 smithi110 ceph-mon[28069]: pgmap v2520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:49:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:56 smithi193 ceph-mon[32782]: pgmap v2520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:49:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3711.826886 secs 2024-04-26T12:49:57.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3711.826886 secs 2024-04-26T12:49:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3711.826886 secs 2024-04-26T12:49:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:49:58 smithi196 ceph-mon[32572]: pgmap v2521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:49:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:49:58 smithi110 ceph-mon[28069]: pgmap v2521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:49:58 smithi193 ceph-mon[32782]: pgmap v2521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:50:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:00 smithi196 ceph-mon[32572]: pgmap v2522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:50:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:00 smithi110 ceph-mon[28069]: pgmap v2522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:50:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:00 smithi193 ceph-mon[32782]: pgmap v2522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T12:50:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:02 smithi196 ceph-mon[32572]: pgmap v2523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:50:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3716.827007 secs 2024-04-26T12:50:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:50:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:02 smithi110 ceph-mon[28069]: pgmap v2523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:50:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3716.827007 secs 2024-04-26T12:50:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:50:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:02 smithi193 ceph-mon[32782]: pgmap v2523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:50:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3716.827007 secs 2024-04-26T12:50:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:50:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:50:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:50:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:50:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:50:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:50:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:50:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:50:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:50:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:50:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:04 smithi110 ceph-mon[28069]: pgmap v2524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:04 smithi110 ceph-mon[28069]: pgmap v2525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:04 smithi193 ceph-mon[32782]: pgmap v2524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:04 smithi193 ceph-mon[32782]: pgmap v2525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:04 smithi196 ceph-mon[32572]: pgmap v2524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:04 smithi196 ceph-mon[32572]: pgmap v2525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:06.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:06 smithi110 ceph-mon[28069]: pgmap v2526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:06 smithi193 ceph-mon[32782]: pgmap v2526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:06 smithi196 ceph-mon[32572]: pgmap v2526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3721.827125 secs 2024-04-26T12:50:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3721.827125 secs 2024-04-26T12:50:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3721.827125 secs 2024-04-26T12:50:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:08 smithi110 ceph-mon[28069]: pgmap v2527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:08 smithi193 ceph-mon[32782]: pgmap v2527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:08 smithi196 ceph-mon[32572]: pgmap v2527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:10 smithi110 ceph-mon[28069]: pgmap v2528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:10 smithi193 ceph-mon[32782]: pgmap v2528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:10 smithi196 ceph-mon[32572]: pgmap v2528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:12 smithi110 ceph-mon[28069]: pgmap v2529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3726.827243 secs 2024-04-26T12:50:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:12 smithi193 ceph-mon[32782]: pgmap v2529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3726.827243 secs 2024-04-26T12:50:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:12 smithi196 ceph-mon[32572]: pgmap v2529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:50:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3726.827243 secs 2024-04-26T12:50:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:14 smithi193 ceph-mon[32782]: pgmap v2530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:50:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:14 smithi196 ceph-mon[32572]: pgmap v2530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:50:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:14 smithi110 ceph-mon[28069]: pgmap v2530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:50:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:16 smithi193 ceph-mon[32782]: pgmap v2531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:16 smithi196 ceph-mon[32572]: pgmap v2531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:16 smithi110 ceph-mon[28069]: pgmap v2531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3731.827359 secs 2024-04-26T12:50:17.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3731.827359 secs 2024-04-26T12:50:17.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3731.827359 secs 2024-04-26T12:50:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:18 smithi193 ceph-mon[32782]: pgmap v2532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:18.728 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:18 smithi110 ceph-mon[28069]: pgmap v2532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:18 smithi196 ceph-mon[32572]: pgmap v2532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:20 smithi193 ceph-mon[32782]: pgmap v2533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:20 smithi196 ceph-mon[32572]: pgmap v2533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:20 smithi110 ceph-mon[28069]: pgmap v2533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:22 smithi193 ceph-mon[32782]: pgmap v2534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3736.827479 secs 2024-04-26T12:50:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:22 smithi196 ceph-mon[32572]: pgmap v2534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3736.827479 secs 2024-04-26T12:50:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:22 smithi110 ceph-mon[28069]: pgmap v2534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3736.827479 secs 2024-04-26T12:50:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:24 smithi193 ceph-mon[32782]: pgmap v2535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:24 smithi196 ceph-mon[32572]: pgmap v2535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:24 smithi110 ceph-mon[28069]: pgmap v2535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:26 smithi193 ceph-mon[32782]: pgmap v2536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:26 smithi196 ceph-mon[32572]: pgmap v2536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:26 smithi110 ceph-mon[28069]: pgmap v2536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3741.827599 secs 2024-04-26T12:50:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3741.827599 secs 2024-04-26T12:50:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3741.827599 secs 2024-04-26T12:50:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:28 smithi193 ceph-mon[32782]: pgmap v2537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:28 smithi196 ceph-mon[32572]: pgmap v2537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:28 smithi110 ceph-mon[28069]: pgmap v2537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:30 smithi193 ceph-mon[32782]: pgmap v2538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:30 smithi196 ceph-mon[32572]: pgmap v2538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:30 smithi110 ceph-mon[28069]: pgmap v2538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:32 smithi193 ceph-mon[32782]: pgmap v2539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3746.827717 secs 2024-04-26T12:50:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:32 smithi196 ceph-mon[32572]: pgmap v2539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3746.827717 secs 2024-04-26T12:50:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:32 smithi110 ceph-mon[28069]: pgmap v2539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3746.827717 secs 2024-04-26T12:50:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:34 smithi193 ceph-mon[32782]: pgmap v2540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:34 smithi196 ceph-mon[32572]: pgmap v2540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:34 smithi110 ceph-mon[28069]: pgmap v2540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:36 smithi193 ceph-mon[32782]: pgmap v2541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:36 smithi196 ceph-mon[32572]: pgmap v2541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:36 smithi110 ceph-mon[28069]: pgmap v2541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3751.827832 secs 2024-04-26T12:50:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3751.827832 secs 2024-04-26T12:50:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3751.827832 secs 2024-04-26T12:50:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:38 smithi196 ceph-mon[32572]: pgmap v2542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:38 smithi110 ceph-mon[28069]: pgmap v2542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:38 smithi193 ceph-mon[32782]: pgmap v2542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:40 smithi196 ceph-mon[32572]: pgmap v2543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:40 smithi110 ceph-mon[28069]: pgmap v2543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:40 smithi193 ceph-mon[32782]: pgmap v2543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:42 smithi196 ceph-mon[32572]: pgmap v2544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3756.827956 secs 2024-04-26T12:50:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:42 smithi110 ceph-mon[28069]: pgmap v2544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3756.827956 secs 2024-04-26T12:50:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:42 smithi193 ceph-mon[32782]: pgmap v2544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3756.827956 secs 2024-04-26T12:50:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:44 smithi196 ceph-mon[32572]: pgmap v2545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:44 smithi110 ceph-mon[28069]: pgmap v2545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:44 smithi193 ceph-mon[32782]: pgmap v2545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:46 smithi196 ceph-mon[32572]: pgmap v2546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:46 smithi110 ceph-mon[28069]: pgmap v2546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:46 smithi193 ceph-mon[32782]: pgmap v2546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:47.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3761.828074 secs 2024-04-26T12:50:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3761.828074 secs 2024-04-26T12:50:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3761.828074 secs 2024-04-26T12:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:48 smithi196 ceph-mon[32572]: pgmap v2547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:48 smithi110 ceph-mon[28069]: pgmap v2547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:48 smithi193 ceph-mon[32782]: pgmap v2547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:49 smithi196 ceph-mon[32572]: pgmap v2548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:49 smithi110 ceph-mon[28069]: pgmap v2548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:49 smithi193 ceph-mon[32782]: pgmap v2548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:51 smithi193 ceph-mon[32782]: pgmap v2549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:51 smithi196 ceph-mon[32572]: pgmap v2549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:51 smithi110 ceph-mon[28069]: pgmap v2549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3766.828167 secs 2024-04-26T12:50:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3766.828167 secs 2024-04-26T12:50:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3766.828167 secs 2024-04-26T12:50:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:53 smithi193 ceph-mon[32782]: pgmap v2550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:53 smithi196 ceph-mon[32572]: pgmap v2550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:53 smithi110 ceph-mon[28069]: pgmap v2550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:50:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:55 smithi193 ceph-mon[32782]: pgmap v2551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:55 smithi196 ceph-mon[32572]: pgmap v2551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:55 smithi110 ceph-mon[28069]: pgmap v2551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3771.828284 secs 2024-04-26T12:50:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:57 smithi193 ceph-mon[32782]: pgmap v2552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3771.828284 secs 2024-04-26T12:50:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:57 smithi196 ceph-mon[32572]: pgmap v2552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3771.828284 secs 2024-04-26T12:50:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:57 smithi110 ceph-mon[28069]: pgmap v2552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:50:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:50:59 smithi193 ceph-mon[32782]: pgmap v2553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:50:59 smithi196 ceph-mon[32572]: pgmap v2553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:50:59 smithi110 ceph-mon[28069]: pgmap v2553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:01 smithi193 ceph-mon[32782]: pgmap v2554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:01 smithi196 ceph-mon[32572]: pgmap v2554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:01 smithi110 ceph-mon[28069]: pgmap v2554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3776.828403 secs 2024-04-26T12:51:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3776.828403 secs 2024-04-26T12:51:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3776.828403 secs 2024-04-26T12:51:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:03 smithi193 ceph-mon[32782]: pgmap v2555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:51:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:03 smithi196 ceph-mon[32572]: pgmap v2555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:51:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:03 smithi110 ceph-mon[28069]: pgmap v2555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:04.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:51:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:51:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:51:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:04 smithi193 ceph-mon[32782]: pgmap v2556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:51:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:04 smithi193 ceph-mon[32782]: pgmap v2557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:51:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:51:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:51:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:04 smithi196 ceph-mon[32572]: pgmap v2556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:51:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:04 smithi196 ceph-mon[32572]: pgmap v2557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:51:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:51:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:51:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:04 smithi110 ceph-mon[28069]: pgmap v2556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T12:51:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:04 smithi110 ceph-mon[28069]: pgmap v2557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:51:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:07 smithi193 ceph-mon[32782]: pgmap v2558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3781.828529 secs 2024-04-26T12:51:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:07 smithi196 ceph-mon[32572]: pgmap v2558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3781.828529 secs 2024-04-26T12:51:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:07 smithi110 ceph-mon[28069]: pgmap v2558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3781.828529 secs 2024-04-26T12:51:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:09 smithi193 ceph-mon[32782]: pgmap v2559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:09 smithi196 ceph-mon[32572]: pgmap v2559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:09 smithi110 ceph-mon[28069]: pgmap v2559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:11 smithi110 ceph-mon[28069]: pgmap v2560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:11 smithi193 ceph-mon[32782]: pgmap v2560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:11 smithi196 ceph-mon[32572]: pgmap v2560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:51:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3786.828653 secs 2024-04-26T12:51:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3786.828653 secs 2024-04-26T12:51:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3786.828653 secs 2024-04-26T12:51:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:13 smithi110 ceph-mon[28069]: pgmap v2561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:51:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:13 smithi193 ceph-mon[32782]: pgmap v2561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:51:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:13 smithi196 ceph-mon[32572]: pgmap v2561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:51:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:15 smithi193 ceph-mon[32782]: pgmap v2562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:51:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:15 smithi196 ceph-mon[32572]: pgmap v2562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:51:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:15 smithi110 ceph-mon[28069]: pgmap v2562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:51:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:51:16.959+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:51:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:51:16.959+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:51:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:51:16.960+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 33 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:51:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:51:16.960+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 33 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:51:17.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:17 smithi196 ceph-mon[32572]: pgmap v2563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:17.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3791.828764 secs 2024-04-26T12:51:17.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:17 smithi110 ceph-mon[28069]: pgmap v2563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:17.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3791.828764 secs 2024-04-26T12:51:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:17 smithi193 ceph-mon[32782]: pgmap v2563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3791.828764 secs 2024-04-26T12:51:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:19 smithi193 ceph-mon[32782]: pgmap v2564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:19 smithi196 ceph-mon[32572]: pgmap v2564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:19 smithi110 ceph-mon[28069]: pgmap v2564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:21 smithi193 ceph-mon[32782]: pgmap v2565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:21 smithi196 ceph-mon[32572]: pgmap v2565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:21 smithi110 ceph-mon[28069]: pgmap v2565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3796.828828 secs 2024-04-26T12:51:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3796.828828 secs 2024-04-26T12:51:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3796.828828 secs 2024-04-26T12:51:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:23 smithi193 ceph-mon[32782]: pgmap v2566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:23 smithi196 ceph-mon[32572]: pgmap v2566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:23 smithi110 ceph-mon[28069]: pgmap v2566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:25 smithi193 ceph-mon[32782]: pgmap v2567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:25 smithi196 ceph-mon[32572]: pgmap v2567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:25 smithi110 ceph-mon[28069]: pgmap v2567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:27 smithi193 ceph-mon[32782]: pgmap v2568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3801.828945 secs 2024-04-26T12:51:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:27 smithi196 ceph-mon[32572]: pgmap v2568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3801.828945 secs 2024-04-26T12:51:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:27 smithi110 ceph-mon[28069]: pgmap v2568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3801.828945 secs 2024-04-26T12:51:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:29 smithi193 ceph-mon[32782]: pgmap v2569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:29 smithi196 ceph-mon[32572]: pgmap v2569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:29 smithi110 ceph-mon[28069]: pgmap v2569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:31.624 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:31 smithi193 ceph-mon[32782]: pgmap v2570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:31 smithi196 ceph-mon[32572]: pgmap v2570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:31 smithi110 ceph-mon[28069]: pgmap v2570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3806.829063 secs 2024-04-26T12:51:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3806.829063 secs 2024-04-26T12:51:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3806.829063 secs 2024-04-26T12:51:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:33 smithi193 ceph-mon[32782]: pgmap v2571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:33 smithi196 ceph-mon[32572]: pgmap v2571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:33 smithi110 ceph-mon[28069]: pgmap v2571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:35 smithi193 ceph-mon[32782]: pgmap v2572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:35 smithi196 ceph-mon[32572]: pgmap v2572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:35 smithi110 ceph-mon[28069]: pgmap v2572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:37 smithi196 ceph-mon[32572]: pgmap v2573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3811.829129 secs 2024-04-26T12:51:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:37 smithi110 ceph-mon[28069]: pgmap v2573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3811.829129 secs 2024-04-26T12:51:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:37 smithi193 ceph-mon[32782]: pgmap v2573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3811.829129 secs 2024-04-26T12:51:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:39 smithi196 ceph-mon[32572]: pgmap v2574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:39 smithi110 ceph-mon[28069]: pgmap v2574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:39 smithi193 ceph-mon[32782]: pgmap v2574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:41 smithi196 ceph-mon[32572]: pgmap v2575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:41 smithi110 ceph-mon[28069]: pgmap v2575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:41 smithi193 ceph-mon[32782]: pgmap v2575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:42.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3816.829249 secs 2024-04-26T12:51:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3816.829249 secs 2024-04-26T12:51:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3816.829249 secs 2024-04-26T12:51:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:43 smithi196 ceph-mon[32572]: pgmap v2576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:43 smithi110 ceph-mon[28069]: pgmap v2576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:43 smithi193 ceph-mon[32782]: pgmap v2576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:45 smithi196 ceph-mon[32572]: pgmap v2577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:45 smithi110 ceph-mon[28069]: pgmap v2577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:45 smithi193 ceph-mon[32782]: pgmap v2577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:47 smithi196 ceph-mon[32572]: pgmap v2578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3821.829376 secs 2024-04-26T12:51:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:47 smithi110 ceph-mon[28069]: pgmap v2578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3821.829376 secs 2024-04-26T12:51:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:47 smithi193 ceph-mon[32782]: pgmap v2578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3821.829376 secs 2024-04-26T12:51:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:49 smithi196 ceph-mon[32572]: pgmap v2579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:49 smithi110 ceph-mon[28069]: pgmap v2579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:49 smithi193 ceph-mon[32782]: pgmap v2579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:50 smithi196 ceph-mon[32572]: pgmap v2580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:50 smithi110 ceph-mon[28069]: pgmap v2580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:50 smithi193 ceph-mon[32782]: pgmap v2580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3826.829493 secs 2024-04-26T12:51:52.550 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3826.829493 secs 2024-04-26T12:51:52.550 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3826.829493 secs 2024-04-26T12:51:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:52 smithi193 ceph-mon[32782]: pgmap v2581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:52 smithi196 ceph-mon[32572]: pgmap v2581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:52 smithi110 ceph-mon[28069]: pgmap v2581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:55 smithi193 ceph-mon[32782]: pgmap v2582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:55 smithi196 ceph-mon[32572]: pgmap v2582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:55 smithi110 ceph-mon[28069]: pgmap v2582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:57 smithi193 ceph-mon[32782]: pgmap v2583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3831.829591 secs 2024-04-26T12:51:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:57 smithi196 ceph-mon[32572]: pgmap v2583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3831.829591 secs 2024-04-26T12:51:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:57 smithi110 ceph-mon[28069]: pgmap v2583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:51:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3831.829591 secs 2024-04-26T12:51:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:51:59 smithi196 ceph-mon[32572]: pgmap v2584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:51:59 smithi110 ceph-mon[28069]: pgmap v2584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:51:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:51:59 smithi193 ceph-mon[32782]: pgmap v2584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:01 smithi196 ceph-mon[32572]: pgmap v2585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:01 smithi110 ceph-mon[28069]: pgmap v2585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:01 smithi193 ceph-mon[32782]: pgmap v2585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3836.829658 secs 2024-04-26T12:52:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3836.829658 secs 2024-04-26T12:52:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3836.829658 secs 2024-04-26T12:52:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:03 smithi196 ceph-mon[32572]: pgmap v2586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:03 smithi110 ceph-mon[28069]: pgmap v2586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:03 smithi193 ceph-mon[32782]: pgmap v2586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:05 smithi196 ceph-mon[32572]: pgmap v2587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:52:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:05 smithi110 ceph-mon[28069]: pgmap v2587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:52:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:05 smithi193 ceph-mon[32782]: pgmap v2587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:52:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:52:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:52:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:52:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:52:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:52:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:52:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:07 smithi196 ceph-mon[32572]: pgmap v2588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3841.829750 secs 2024-04-26T12:52:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:52:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:52:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:52:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:07 smithi110 ceph-mon[28069]: pgmap v2588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3841.829750 secs 2024-04-26T12:52:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:52:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:52:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:52:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:07 smithi193 ceph-mon[32782]: pgmap v2588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3841.829750 secs 2024-04-26T12:52:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:52:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:52:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:52:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:08 smithi196 ceph-mon[32572]: pgmap v2589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T12:52:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:08 smithi196 ceph-mon[32572]: pgmap v2590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T12:52:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:08 smithi110 ceph-mon[28069]: pgmap v2589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T12:52:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:08 smithi110 ceph-mon[28069]: pgmap v2590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T12:52:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:08 smithi193 ceph-mon[32782]: pgmap v2589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T12:52:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:08 smithi193 ceph-mon[32782]: pgmap v2590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T12:52:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:10 smithi196 ceph-mon[32572]: pgmap v2591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:10 smithi110 ceph-mon[28069]: pgmap v2591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:10 smithi193 ceph-mon[32782]: pgmap v2591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:12 smithi196 ceph-mon[32572]: pgmap v2592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3846.829819 secs 2024-04-26T12:52:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:12 smithi110 ceph-mon[28069]: pgmap v2592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3846.829819 secs 2024-04-26T12:52:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:12 smithi193 ceph-mon[32782]: pgmap v2592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3846.829819 secs 2024-04-26T12:52:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:14 smithi196 ceph-mon[32572]: pgmap v2593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:14 smithi110 ceph-mon[28069]: pgmap v2593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:14 smithi193 ceph-mon[32782]: pgmap v2593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:16 smithi196 ceph-mon[32572]: pgmap v2594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:16 smithi110 ceph-mon[28069]: pgmap v2594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:16 smithi193 ceph-mon[32782]: pgmap v2594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3851.829913 secs 2024-04-26T12:52:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3851.829913 secs 2024-04-26T12:52:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3851.829913 secs 2024-04-26T12:52:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:18 smithi196 ceph-mon[32572]: pgmap v2595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:52:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:18 smithi110 ceph-mon[28069]: pgmap v2595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:52:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:18 smithi193 ceph-mon[32782]: pgmap v2595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:52:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:20 smithi110 ceph-mon[28069]: pgmap v2596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:20 smithi193 ceph-mon[32782]: pgmap v2596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:20 smithi196 ceph-mon[32572]: pgmap v2596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:22 smithi110 ceph-mon[28069]: pgmap v2597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3856.830029 secs 2024-04-26T12:52:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:22 smithi193 ceph-mon[32782]: pgmap v2597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3856.830029 secs 2024-04-26T12:52:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:22 smithi196 ceph-mon[32572]: pgmap v2597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3856.830029 secs 2024-04-26T12:52:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:24 smithi110 ceph-mon[28069]: pgmap v2598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:24 smithi193 ceph-mon[32782]: pgmap v2598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:24 smithi196 ceph-mon[32572]: pgmap v2598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:26 smithi110 ceph-mon[28069]: pgmap v2599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:26 smithi193 ceph-mon[32782]: pgmap v2599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:26 smithi196 ceph-mon[32572]: pgmap v2599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3861.830137 secs 2024-04-26T12:52:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3861.830137 secs 2024-04-26T12:52:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3861.830137 secs 2024-04-26T12:52:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:28 smithi110 ceph-mon[28069]: pgmap v2600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:28 smithi193 ceph-mon[32782]: pgmap v2600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:28 smithi196 ceph-mon[32572]: pgmap v2600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:30 smithi110 ceph-mon[28069]: pgmap v2601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:30 smithi193 ceph-mon[32782]: pgmap v2601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:30 smithi196 ceph-mon[32572]: pgmap v2601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:32 smithi193 ceph-mon[32782]: pgmap v2602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3866.830260 secs 2024-04-26T12:52:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:32 smithi196 ceph-mon[32572]: pgmap v2602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3866.830260 secs 2024-04-26T12:52:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:32 smithi110 ceph-mon[28069]: pgmap v2602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3866.830260 secs 2024-04-26T12:52:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:34 smithi193 ceph-mon[32782]: pgmap v2603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:34 smithi196 ceph-mon[32572]: pgmap v2603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:34 smithi110 ceph-mon[28069]: pgmap v2603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:36 smithi193 ceph-mon[32782]: pgmap v2604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:36 smithi196 ceph-mon[32572]: pgmap v2604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:36 smithi110 ceph-mon[28069]: pgmap v2604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3871.830374 secs 2024-04-26T12:52:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3871.830374 secs 2024-04-26T12:52:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3871.830374 secs 2024-04-26T12:52:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:38 smithi193 ceph-mon[32782]: pgmap v2605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:38 smithi196 ceph-mon[32572]: pgmap v2605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:38 smithi110 ceph-mon[28069]: pgmap v2605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:40 smithi193 ceph-mon[32782]: pgmap v2606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:40 smithi196 ceph-mon[32572]: pgmap v2606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:40 smithi110 ceph-mon[28069]: pgmap v2606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:42 smithi193 ceph-mon[32782]: pgmap v2607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3876.830477 secs 2024-04-26T12:52:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:42 smithi196 ceph-mon[32572]: pgmap v2607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3876.830477 secs 2024-04-26T12:52:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:42 smithi110 ceph-mon[28069]: pgmap v2607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3876.830477 secs 2024-04-26T12:52:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:44 smithi193 ceph-mon[32782]: pgmap v2608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:44 smithi196 ceph-mon[32572]: pgmap v2608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:44 smithi110 ceph-mon[28069]: pgmap v2608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:46 smithi193 ceph-mon[32782]: pgmap v2609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:46 smithi196 ceph-mon[32572]: pgmap v2609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:46 smithi110 ceph-mon[28069]: pgmap v2609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3881.830615 secs 2024-04-26T12:52:47.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3881.830615 secs 2024-04-26T12:52:47.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3881.830615 secs 2024-04-26T12:52:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:48 smithi193 ceph-mon[32782]: pgmap v2610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:48 smithi196 ceph-mon[32572]: pgmap v2610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:48 smithi110 ceph-mon[28069]: pgmap v2610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:50 smithi193 ceph-mon[32782]: pgmap v2611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:50 smithi196 ceph-mon[32572]: pgmap v2611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:50 smithi110 ceph-mon[28069]: pgmap v2611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:52 smithi193 ceph-mon[32782]: pgmap v2612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3886.830732 secs 2024-04-26T12:52:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:52 smithi196 ceph-mon[32572]: pgmap v2612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3886.830732 secs 2024-04-26T12:52:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:52 smithi110 ceph-mon[28069]: pgmap v2612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3886.830732 secs 2024-04-26T12:52:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:54 smithi193 ceph-mon[32782]: pgmap v2613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:54 smithi196 ceph-mon[32572]: pgmap v2613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:54 smithi110 ceph-mon[28069]: pgmap v2613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:52:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:56 smithi196 ceph-mon[32572]: pgmap v2614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:56 smithi110 ceph-mon[28069]: pgmap v2614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:56 smithi193 ceph-mon[32782]: pgmap v2614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3891.830869 secs 2024-04-26T12:52:57.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3891.830869 secs 2024-04-26T12:52:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3891.830869 secs 2024-04-26T12:52:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:52:58 smithi196 ceph-mon[32572]: pgmap v2615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:52:58 smithi110 ceph-mon[28069]: pgmap v2615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:52:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:52:58 smithi193 ceph-mon[32782]: pgmap v2615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:00 smithi196 ceph-mon[32572]: pgmap v2616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:00 smithi110 ceph-mon[28069]: pgmap v2616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:00 smithi193 ceph-mon[32782]: pgmap v2616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:02 smithi196 ceph-mon[32572]: pgmap v2617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3896.830965 secs 2024-04-26T12:53:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:02 smithi110 ceph-mon[28069]: pgmap v2617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3896.830965 secs 2024-04-26T12:53:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:02 smithi193 ceph-mon[32782]: pgmap v2617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3896.830965 secs 2024-04-26T12:53:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:04 smithi196 ceph-mon[32572]: pgmap v2618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:04 smithi110 ceph-mon[28069]: pgmap v2618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:04 smithi193 ceph-mon[32782]: pgmap v2618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:06 smithi196 ceph-mon[32572]: pgmap v2619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:06 smithi110 ceph-mon[28069]: pgmap v2619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:06 smithi193 ceph-mon[32782]: pgmap v2619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3901.831089 secs 2024-04-26T12:53:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:53:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3901.831089 secs 2024-04-26T12:53:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:53:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3901.831089 secs 2024-04-26T12:53:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:53:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:08 smithi196 ceph-mon[32572]: pgmap v2620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:53:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:53:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:08 smithi110 ceph-mon[28069]: pgmap v2620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:53:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:53:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:08 smithi193 ceph-mon[32782]: pgmap v2620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:53:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:53:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:53:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:09 smithi196 ceph-mon[32572]: pgmap v2621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:53:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:09 smithi196 ceph-mon[32572]: pgmap v2622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:09 smithi110 ceph-mon[28069]: pgmap v2621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:53:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:09 smithi110 ceph-mon[28069]: pgmap v2622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:09 smithi193 ceph-mon[32782]: pgmap v2621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:53:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:09 smithi193 ceph-mon[32782]: pgmap v2622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:11 smithi196 ceph-mon[32572]: pgmap v2623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:11 smithi110 ceph-mon[28069]: pgmap v2623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:11 smithi193 ceph-mon[32782]: pgmap v2623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3906.831181 secs 2024-04-26T12:53:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3906.831181 secs 2024-04-26T12:53:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3906.831181 secs 2024-04-26T12:53:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:13 smithi196 ceph-mon[32572]: pgmap v2624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T12:53:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:13 smithi110 ceph-mon[28069]: pgmap v2624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T12:53:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:13 smithi193 ceph-mon[32782]: pgmap v2624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T12:53:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:14 smithi196 ceph-mon[32572]: pgmap v2625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:14 smithi110 ceph-mon[28069]: pgmap v2625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:14 smithi193 ceph-mon[32782]: pgmap v2625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:17.457 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:17 smithi196 ceph-mon[32572]: pgmap v2626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:17.457 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3911.831330 secs 2024-04-26T12:53:17.495 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:17 smithi110 ceph-mon[28069]: pgmap v2626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:17.495 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3911.831330 secs 2024-04-26T12:53:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:17 smithi193 ceph-mon[32782]: pgmap v2626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:53:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3911.831330 secs 2024-04-26T12:53:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:19 smithi196 ceph-mon[32572]: pgmap v2627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:53:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:19 smithi110 ceph-mon[28069]: pgmap v2627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:53:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:19 smithi193 ceph-mon[32782]: pgmap v2627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:53:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:21 smithi196 ceph-mon[32572]: pgmap v2628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:21 smithi110 ceph-mon[28069]: pgmap v2628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:21 smithi193 ceph-mon[32782]: pgmap v2628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3916.831466 secs 2024-04-26T12:53:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3916.831466 secs 2024-04-26T12:53:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3916.831466 secs 2024-04-26T12:53:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:23 smithi196 ceph-mon[32572]: pgmap v2629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:23 smithi110 ceph-mon[28069]: pgmap v2629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:23 smithi193 ceph-mon[32782]: pgmap v2629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:25 smithi196 ceph-mon[32572]: pgmap v2630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:25 smithi110 ceph-mon[28069]: pgmap v2630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:25 smithi193 ceph-mon[32782]: pgmap v2630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:27 smithi196 ceph-mon[32572]: pgmap v2631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3921.831601 secs 2024-04-26T12:53:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:27 smithi110 ceph-mon[28069]: pgmap v2631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3921.831601 secs 2024-04-26T12:53:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:27 smithi193 ceph-mon[32782]: pgmap v2631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3921.831601 secs 2024-04-26T12:53:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:29 smithi196 ceph-mon[32572]: pgmap v2632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:29 smithi110 ceph-mon[28069]: pgmap v2632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:29 smithi193 ceph-mon[32782]: pgmap v2632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:31 smithi196 ceph-mon[32572]: pgmap v2633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:31 smithi110 ceph-mon[28069]: pgmap v2633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:31 smithi193 ceph-mon[32782]: pgmap v2633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3926.831719 secs 2024-04-26T12:53:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3926.831719 secs 2024-04-26T12:53:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3926.831719 secs 2024-04-26T12:53:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:33 smithi196 ceph-mon[32572]: pgmap v2634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:33 smithi110 ceph-mon[28069]: pgmap v2634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:33 smithi193 ceph-mon[32782]: pgmap v2634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:35 smithi196 ceph-mon[32572]: pgmap v2635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:35 smithi110 ceph-mon[28069]: pgmap v2635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:35 smithi193 ceph-mon[32782]: pgmap v2635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3931.831798 secs 2024-04-26T12:53:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:37 smithi196 ceph-mon[32572]: pgmap v2636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3931.831798 secs 2024-04-26T12:53:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:37 smithi110 ceph-mon[28069]: pgmap v2636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3931.831798 secs 2024-04-26T12:53:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:37 smithi193 ceph-mon[32782]: pgmap v2636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:39 smithi196 ceph-mon[32572]: pgmap v2637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:39 smithi110 ceph-mon[28069]: pgmap v2637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:39 smithi193 ceph-mon[32782]: pgmap v2637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:41 smithi110 ceph-mon[28069]: pgmap v2638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:41 smithi193 ceph-mon[32782]: pgmap v2638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:41 smithi196 ceph-mon[32572]: pgmap v2638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3936.831934 secs 2024-04-26T12:53:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3936.831934 secs 2024-04-26T12:53:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3936.831934 secs 2024-04-26T12:53:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:43 smithi110 ceph-mon[28069]: pgmap v2639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:43 smithi193 ceph-mon[32782]: pgmap v2639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:43 smithi196 ceph-mon[32572]: pgmap v2639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:45 smithi110 ceph-mon[28069]: pgmap v2640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:45 smithi193 ceph-mon[32782]: pgmap v2640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:45 smithi196 ceph-mon[32572]: pgmap v2640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3941.832049 secs 2024-04-26T12:53:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:47 smithi110 ceph-mon[28069]: pgmap v2641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:47.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3941.832049 secs 2024-04-26T12:53:47.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:47 smithi196 ceph-mon[32572]: pgmap v2641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3941.832049 secs 2024-04-26T12:53:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:47 smithi193 ceph-mon[32782]: pgmap v2641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:49 smithi110 ceph-mon[28069]: pgmap v2642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:49 smithi193 ceph-mon[32782]: pgmap v2642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:49 smithi196 ceph-mon[32572]: pgmap v2642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:51 smithi110 ceph-mon[28069]: pgmap v2643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:51 smithi193 ceph-mon[32782]: pgmap v2643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:51 smithi196 ceph-mon[32572]: pgmap v2643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3946.832202 secs 2024-04-26T12:53:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3946.832202 secs 2024-04-26T12:53:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3946.832202 secs 2024-04-26T12:53:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:53 smithi193 ceph-mon[32782]: pgmap v2644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:53 smithi196 ceph-mon[32572]: pgmap v2644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:53 smithi110 ceph-mon[28069]: pgmap v2644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:55 smithi193 ceph-mon[32782]: pgmap v2645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:55 smithi196 ceph-mon[32572]: pgmap v2645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:55 smithi110 ceph-mon[28069]: pgmap v2645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3951.832326 secs 2024-04-26T12:53:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:57 smithi193 ceph-mon[32782]: pgmap v2646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3951.832326 secs 2024-04-26T12:53:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:57 smithi196 ceph-mon[32572]: pgmap v2646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3951.832326 secs 2024-04-26T12:53:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:57 smithi110 ceph-mon[28069]: pgmap v2646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:53:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:53:59 smithi193 ceph-mon[32782]: pgmap v2647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:53:59 smithi196 ceph-mon[32572]: pgmap v2647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:53:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:53:59 smithi110 ceph-mon[28069]: pgmap v2647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:01 smithi193 ceph-mon[32782]: pgmap v2648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:01 smithi196 ceph-mon[32572]: pgmap v2648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:01 smithi110 ceph-mon[28069]: pgmap v2648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3956.832445 secs 2024-04-26T12:54:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:54:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:54:02.200+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:54:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:54:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:54:02.200+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:54:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:54:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:54:02.200+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:54:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:54:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:54:02.200+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:54:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:54:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:54:02.200+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:54:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3956.832445 secs 2024-04-26T12:54:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3956.832445 secs 2024-04-26T12:54:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:03 smithi193 ceph-mon[32782]: pgmap v2649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:03 smithi196 ceph-mon[32572]: pgmap v2649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:03 smithi110 ceph-mon[28069]: pgmap v2649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:05 smithi193 ceph-mon[32782]: pgmap v2650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:54:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:05 smithi196 ceph-mon[32572]: pgmap v2650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:54:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:05 smithi110 ceph-mon[28069]: pgmap v2650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:54:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3961.832560 secs 2024-04-26T12:54:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:07 smithi193 ceph-mon[32782]: pgmap v2651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:54:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3961.832560 secs 2024-04-26T12:54:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:07 smithi196 ceph-mon[32572]: pgmap v2651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:54:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3961.832560 secs 2024-04-26T12:54:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:07 smithi110 ceph-mon[28069]: pgmap v2651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:54:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:09 smithi196 ceph-mon[32572]: pgmap v2652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:54:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:54:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:09 smithi193 ceph-mon[32782]: pgmap v2652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:54:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:54:09.715 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:09 smithi110 ceph-mon[28069]: pgmap v2652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T12:54:09.715 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: pgmap v2653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: pgmap v2653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:54:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: pgmap v2653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:54:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3966.832661 secs 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:12.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3966.832661 secs 2024-04-26T12:54:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:54:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:54:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:12.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3966.832661 secs 2024-04-26T12:54:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:13 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:54:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:13 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:54:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:13 smithi196 ceph-mon[32572]: pgmap v2654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:54:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:13 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:54:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:13 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:54:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:13 smithi110 ceph-mon[28069]: pgmap v2654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:54:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:13 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T12:54:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:13 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T12:54:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:13 smithi193 ceph-mon[32782]: pgmap v2654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T12:54:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:54:14.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:54:14.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:54:14.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:54:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:54:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:15 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:54:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:15 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:54:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:15 smithi196 ceph-mon[32572]: pgmap v2655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T12:54:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:15 smithi196 ceph-mon[32572]: pgmap v2656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:15 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:54:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:15 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:54:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:15 smithi110 ceph-mon[28069]: pgmap v2655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T12:54:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:15 smithi110 ceph-mon[28069]: pgmap v2656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:15 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T12:54:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:15 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T12:54:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:15 smithi193 ceph-mon[32782]: pgmap v2655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T12:54:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:15 smithi193 ceph-mon[32782]: pgmap v2656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:16.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:54:16.989+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T12:54:16.990 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:54:16.989+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T12:54:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:54:16.989+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 34 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T12:54:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:54:16.989+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 34 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T12:54:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:54:16.989+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006350 con 0x7f261c104b50 2024-04-26T12:54:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:54:16.989+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:54:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:54:16.990+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 35 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T12:54:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:54:16.990+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 35 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006350 con 0x55db1be4fdd0 2024-04-26T12:54:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:17 smithi196 ceph-mon[32572]: pgmap v2657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3971.832798 secs 2024-04-26T12:54:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:17 smithi110 ceph-mon[28069]: pgmap v2657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3971.832798 secs 2024-04-26T12:54:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:17 smithi193 ceph-mon[32782]: pgmap v2657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3971.832798 secs 2024-04-26T12:54:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:19 smithi196 ceph-mon[32572]: pgmap v2658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:19 smithi110 ceph-mon[28069]: pgmap v2658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:19 smithi193 ceph-mon[32782]: pgmap v2658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:21 smithi196 ceph-mon[32572]: pgmap v2659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:21 smithi110 ceph-mon[28069]: pgmap v2659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:21 smithi193 ceph-mon[32782]: pgmap v2659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3976.832866 secs 2024-04-26T12:54:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3976.832866 secs 2024-04-26T12:54:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3976.832866 secs 2024-04-26T12:54:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:23 smithi196 ceph-mon[32572]: pgmap v2660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:23 smithi110 ceph-mon[28069]: pgmap v2660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:23 smithi193 ceph-mon[32782]: pgmap v2660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:54:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:25 smithi196 ceph-mon[32572]: pgmap v2661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:54:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:25 smithi110 ceph-mon[28069]: pgmap v2661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:54:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:25 smithi193 ceph-mon[32782]: pgmap v2661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:54:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:27 smithi196 ceph-mon[32572]: pgmap v2662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3981.832984 secs 2024-04-26T12:54:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:27 smithi110 ceph-mon[28069]: pgmap v2662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3981.832984 secs 2024-04-26T12:54:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:27 smithi193 ceph-mon[32782]: pgmap v2662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3981.832984 secs 2024-04-26T12:54:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:29 smithi196 ceph-mon[32572]: pgmap v2663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:29 smithi110 ceph-mon[28069]: pgmap v2663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:29 smithi193 ceph-mon[32782]: pgmap v2663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:30 smithi196 ceph-mon[32572]: pgmap v2664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:30 smithi110 ceph-mon[28069]: pgmap v2664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:30 smithi193 ceph-mon[32782]: pgmap v2664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3986.833048 secs 2024-04-26T12:54:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:32 smithi196 ceph-mon[32572]: pgmap v2665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3986.833048 secs 2024-04-26T12:54:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:32 smithi110 ceph-mon[28069]: pgmap v2665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3986.833048 secs 2024-04-26T12:54:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:32 smithi193 ceph-mon[32782]: pgmap v2665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:34 smithi196 ceph-mon[32572]: pgmap v2666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:34 smithi110 ceph-mon[28069]: pgmap v2666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:34 smithi193 ceph-mon[32782]: pgmap v2666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:36 smithi196 ceph-mon[32572]: pgmap v2667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:36 smithi110 ceph-mon[28069]: pgmap v2667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:36 smithi193 ceph-mon[32782]: pgmap v2667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3991.833166 secs 2024-04-26T12:54:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3991.833166 secs 2024-04-26T12:54:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3991.833166 secs 2024-04-26T12:54:38.941 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:38 smithi193 ceph-mon[32782]: pgmap v2668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:38 smithi196 ceph-mon[32572]: pgmap v2668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:38 smithi110 ceph-mon[28069]: pgmap v2668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:40 smithi196 ceph-mon[32572]: pgmap v2669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:40 smithi110 ceph-mon[28069]: pgmap v2669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:40 smithi193 ceph-mon[32782]: pgmap v2669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 3996.833300 secs 2024-04-26T12:54:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:42 smithi196 ceph-mon[32572]: pgmap v2670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 3996.833300 secs 2024-04-26T12:54:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:42 smithi110 ceph-mon[28069]: pgmap v2670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 3996.833300 secs 2024-04-26T12:54:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:42 smithi193 ceph-mon[32782]: pgmap v2670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:44 smithi196 ceph-mon[32572]: pgmap v2671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:44 smithi110 ceph-mon[28069]: pgmap v2671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:44 smithi193 ceph-mon[32782]: pgmap v2671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:46 smithi196 ceph-mon[32572]: pgmap v2672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:46 smithi110 ceph-mon[28069]: pgmap v2672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:46 smithi193 ceph-mon[32782]: pgmap v2672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4001.833421 secs 2024-04-26T12:54:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4001.833421 secs 2024-04-26T12:54:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4001.833421 secs 2024-04-26T12:54:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:48 smithi196 ceph-mon[32572]: pgmap v2673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:48 smithi110 ceph-mon[28069]: pgmap v2673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:48 smithi193 ceph-mon[32782]: pgmap v2673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:50 smithi196 ceph-mon[32572]: pgmap v2674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:50 smithi110 ceph-mon[28069]: pgmap v2674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:50 smithi193 ceph-mon[32782]: pgmap v2674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4006.833484 secs 2024-04-26T12:54:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:52 smithi196 ceph-mon[32572]: pgmap v2675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4006.833484 secs 2024-04-26T12:54:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:52 smithi110 ceph-mon[28069]: pgmap v2675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4006.833484 secs 2024-04-26T12:54:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:52 smithi193 ceph-mon[32782]: pgmap v2675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:54 smithi196 ceph-mon[32572]: pgmap v2676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:54 smithi110 ceph-mon[28069]: pgmap v2676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:54 smithi193 ceph-mon[32782]: pgmap v2676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:56 smithi196 ceph-mon[32572]: pgmap v2677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:56 smithi110 ceph-mon[28069]: pgmap v2677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:56 smithi193 ceph-mon[32782]: pgmap v2677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:54:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4011.833633 secs 2024-04-26T12:54:58.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4011.833633 secs 2024-04-26T12:54:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4011.833633 secs 2024-04-26T12:54:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:54:58 smithi196 ceph-mon[32572]: pgmap v2678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:54:58 smithi110 ceph-mon[28069]: pgmap v2678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:54:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:54:58 smithi193 ceph-mon[32782]: pgmap v2678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:00 smithi196 ceph-mon[32572]: pgmap v2679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:00 smithi110 ceph-mon[28069]: pgmap v2679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:00 smithi193 ceph-mon[32782]: pgmap v2679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4016.833713 secs 2024-04-26T12:55:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:02 smithi196 ceph-mon[32572]: pgmap v2680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4016.833713 secs 2024-04-26T12:55:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:02 smithi110 ceph-mon[28069]: pgmap v2680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4016.833713 secs 2024-04-26T12:55:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:02 smithi193 ceph-mon[32782]: pgmap v2680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:04 smithi196 ceph-mon[32572]: pgmap v2681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:55:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:04 smithi110 ceph-mon[28069]: pgmap v2681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:55:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:04 smithi193 ceph-mon[32782]: pgmap v2681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:55:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:06 smithi196 ceph-mon[32572]: pgmap v2682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:55:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:06 smithi110 ceph-mon[28069]: pgmap v2682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:55:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:06 smithi193 ceph-mon[32782]: pgmap v2682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:55:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4021.833812 secs 2024-04-26T12:55:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4021.833812 secs 2024-04-26T12:55:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4021.833812 secs 2024-04-26T12:55:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:08 smithi110 ceph-mon[28069]: pgmap v2683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:55:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:08 smithi193 ceph-mon[32782]: pgmap v2683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:55:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:08 smithi196 ceph-mon[32572]: pgmap v2683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:55:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:10 smithi110 ceph-mon[28069]: pgmap v2684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:55:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:10 smithi193 ceph-mon[32782]: pgmap v2684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:55:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:10 smithi196 ceph-mon[32572]: pgmap v2684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:55:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4026.833917 secs 2024-04-26T12:55:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:12 smithi110 ceph-mon[28069]: pgmap v2685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:55:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4026.833917 secs 2024-04-26T12:55:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:12 smithi193 ceph-mon[32782]: pgmap v2685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:55:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4026.833917 secs 2024-04-26T12:55:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:12 smithi196 ceph-mon[32572]: pgmap v2685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T12:55:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:14 smithi110 ceph-mon[28069]: pgmap v2686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:55:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:55:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:14 smithi193 ceph-mon[32782]: pgmap v2686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:55:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:55:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:14 smithi196 ceph-mon[32572]: pgmap v2686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T12:55:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:55:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:55:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:55:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:15 smithi110 ceph-mon[28069]: pgmap v2687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:55:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:15 smithi110 ceph-mon[28069]: pgmap v2688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:55:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:55:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:55:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:15 smithi193 ceph-mon[32782]: pgmap v2687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:55:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:15 smithi193 ceph-mon[32782]: pgmap v2688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:55:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:55:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:55:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:15 smithi196 ceph-mon[32572]: pgmap v2687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:55:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:15 smithi196 ceph-mon[32572]: pgmap v2688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:55:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4031.834013 secs 2024-04-26T12:55:17.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4031.834013 secs 2024-04-26T12:55:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4031.834013 secs 2024-04-26T12:55:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:17 smithi193 ceph-mon[32782]: pgmap v2689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:55:18.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:17 smithi110 ceph-mon[28069]: pgmap v2689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:55:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:17 smithi196 ceph-mon[32572]: pgmap v2689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T12:55:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:20 smithi196 ceph-mon[32572]: pgmap v2690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:20 smithi110 ceph-mon[28069]: pgmap v2690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:20 smithi193 ceph-mon[32782]: pgmap v2690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4036.834137 secs 2024-04-26T12:55:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:22 smithi196 ceph-mon[32572]: pgmap v2691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4036.834137 secs 2024-04-26T12:55:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:22 smithi110 ceph-mon[28069]: pgmap v2691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4036.834137 secs 2024-04-26T12:55:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:22 smithi193 ceph-mon[32782]: pgmap v2691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:24 smithi196 ceph-mon[32572]: pgmap v2692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:24 smithi110 ceph-mon[28069]: pgmap v2692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:24 smithi193 ceph-mon[32782]: pgmap v2692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:55:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:26 smithi196 ceph-mon[32572]: pgmap v2693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:55:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:26 smithi110 ceph-mon[28069]: pgmap v2693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:55:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:26 smithi193 ceph-mon[32782]: pgmap v2693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:55:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4041.834210 secs 2024-04-26T12:55:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4041.834210 secs 2024-04-26T12:55:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4041.834210 secs 2024-04-26T12:55:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:28 smithi196 ceph-mon[32572]: pgmap v2694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:28.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:28 smithi193 ceph-mon[32782]: pgmap v2694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:28 smithi110 ceph-mon[28069]: pgmap v2694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:30 smithi196 ceph-mon[32572]: pgmap v2695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:30 smithi110 ceph-mon[28069]: pgmap v2695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:30 smithi193 ceph-mon[32782]: pgmap v2695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4046.834327 secs 2024-04-26T12:55:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:32 smithi196 ceph-mon[32572]: pgmap v2696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4046.834327 secs 2024-04-26T12:55:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:32 smithi110 ceph-mon[28069]: pgmap v2696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4046.834327 secs 2024-04-26T12:55:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:32 smithi193 ceph-mon[32782]: pgmap v2696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:34 smithi196 ceph-mon[32572]: pgmap v2697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:34 smithi110 ceph-mon[28069]: pgmap v2697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:34 smithi193 ceph-mon[32782]: pgmap v2697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:36 smithi196 ceph-mon[32572]: pgmap v2698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:36 smithi110 ceph-mon[28069]: pgmap v2698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:36 smithi193 ceph-mon[32782]: pgmap v2698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4051.834429 secs 2024-04-26T12:55:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4051.834429 secs 2024-04-26T12:55:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4051.834429 secs 2024-04-26T12:55:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:38 smithi110 ceph-mon[28069]: pgmap v2699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:38 smithi193 ceph-mon[32782]: pgmap v2699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:38 smithi196 ceph-mon[32572]: pgmap v2699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:40 smithi110 ceph-mon[28069]: pgmap v2700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:40 smithi193 ceph-mon[32782]: pgmap v2700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:40 smithi196 ceph-mon[32572]: pgmap v2700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4056.834552 secs 2024-04-26T12:55:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:42 smithi110 ceph-mon[28069]: pgmap v2701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4056.834552 secs 2024-04-26T12:55:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:42 smithi193 ceph-mon[32782]: pgmap v2701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4056.834552 secs 2024-04-26T12:55:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:42 smithi196 ceph-mon[32572]: pgmap v2701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:44 smithi110 ceph-mon[28069]: pgmap v2702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:44 smithi193 ceph-mon[32782]: pgmap v2702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:44 smithi196 ceph-mon[32572]: pgmap v2702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:46 smithi110 ceph-mon[28069]: pgmap v2703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:46 smithi193 ceph-mon[32782]: pgmap v2703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:46 smithi196 ceph-mon[32572]: pgmap v2703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4061.834684 secs 2024-04-26T12:55:47.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4061.834684 secs 2024-04-26T12:55:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4061.834684 secs 2024-04-26T12:55:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:48 smithi193 ceph-mon[32782]: pgmap v2704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:48.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:48 smithi110 ceph-mon[28069]: pgmap v2704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:48 smithi196 ceph-mon[32572]: pgmap v2704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:50 smithi193 ceph-mon[32782]: pgmap v2705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:50 smithi196 ceph-mon[32572]: pgmap v2705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:50 smithi110 ceph-mon[28069]: pgmap v2705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4066.834821 secs 2024-04-26T12:55:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:52 smithi193 ceph-mon[32782]: pgmap v2706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4066.834821 secs 2024-04-26T12:55:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:52 smithi196 ceph-mon[32572]: pgmap v2706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4066.834821 secs 2024-04-26T12:55:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:52 smithi110 ceph-mon[28069]: pgmap v2706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:54 smithi193 ceph-mon[32782]: pgmap v2707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:54 smithi196 ceph-mon[32572]: pgmap v2707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:54 smithi110 ceph-mon[28069]: pgmap v2707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:55:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:56 smithi193 ceph-mon[32782]: pgmap v2708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:56 smithi196 ceph-mon[32572]: pgmap v2708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:56 smithi110 ceph-mon[28069]: pgmap v2708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4071.834881 secs 2024-04-26T12:55:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4071.834881 secs 2024-04-26T12:55:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4071.834881 secs 2024-04-26T12:55:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:55:58 smithi193 ceph-mon[32782]: pgmap v2709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:55:58 smithi196 ceph-mon[32572]: pgmap v2709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:55:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:55:58 smithi110 ceph-mon[28069]: pgmap v2709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:00 smithi193 ceph-mon[32782]: pgmap v2710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:00 smithi196 ceph-mon[32572]: pgmap v2710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:00 smithi110 ceph-mon[28069]: pgmap v2710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4076.834996 secs 2024-04-26T12:56:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:02 smithi193 ceph-mon[32782]: pgmap v2711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4076.834996 secs 2024-04-26T12:56:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:02 smithi196 ceph-mon[32572]: pgmap v2711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4076.834996 secs 2024-04-26T12:56:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:02 smithi110 ceph-mon[28069]: pgmap v2711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:04 smithi193 ceph-mon[32782]: pgmap v2712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:04 smithi196 ceph-mon[32572]: pgmap v2712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:04 smithi110 ceph-mon[28069]: pgmap v2712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:06 smithi193 ceph-mon[32782]: pgmap v2713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:06 smithi196 ceph-mon[32572]: pgmap v2713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:06 smithi110 ceph-mon[28069]: pgmap v2713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4081.835114 secs 2024-04-26T12:56:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4081.835114 secs 2024-04-26T12:56:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4081.835114 secs 2024-04-26T12:56:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:08 smithi193 ceph-mon[32782]: pgmap v2714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:08 smithi196 ceph-mon[32572]: pgmap v2714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:08 smithi110 ceph-mon[28069]: pgmap v2714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:10 smithi193 ceph-mon[32782]: pgmap v2715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:10 smithi196 ceph-mon[32572]: pgmap v2715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:10 smithi110 ceph-mon[28069]: pgmap v2715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4086.835247 secs 2024-04-26T12:56:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:12 smithi193 ceph-mon[32782]: pgmap v2716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4086.835247 secs 2024-04-26T12:56:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:12 smithi196 ceph-mon[32572]: pgmap v2716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4086.835247 secs 2024-04-26T12:56:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:12 smithi110 ceph-mon[28069]: pgmap v2716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:14 smithi196 ceph-mon[32572]: pgmap v2717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:14 smithi110 ceph-mon[28069]: pgmap v2717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:14 smithi193 ceph-mon[32782]: pgmap v2717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:16 smithi196 ceph-mon[32572]: pgmap v2718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:56:16.767 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:16 smithi193 ceph-mon[32782]: pgmap v2718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:16.767 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:56:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:16 smithi110 ceph-mon[28069]: pgmap v2718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:56:17.715 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4091.835389 secs 2024-04-26T12:56:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4091.835389 secs 2024-04-26T12:56:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4091.835389 secs 2024-04-26T12:56:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:18 smithi110 ceph-mon[28069]: pgmap v2719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:18.599 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:18 smithi193 ceph-mon[32782]: pgmap v2719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:18.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:18 smithi196 ceph-mon[32572]: pgmap v2719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:20.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:20 smithi110 ceph-mon[28069]: pgmap v2720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:20.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.704 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.705 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:20 smithi196 ceph-mon[32572]: pgmap v2720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:20 smithi193 ceph-mon[32782]: pgmap v2720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4096.835501 secs 2024-04-26T12:56:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:22 smithi196 ceph-mon[32572]: pgmap v2721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:56:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:56:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4096.835501 secs 2024-04-26T12:56:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:22 smithi110 ceph-mon[28069]: pgmap v2721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:56:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:56:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4096.835501 secs 2024-04-26T12:56:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:22 smithi193 ceph-mon[32782]: pgmap v2721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:56:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:56:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:56:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:23 smithi196 ceph-mon[32572]: pgmap v2722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 929 B/s rd, 1 op/s 2024-04-26T12:56:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:23 smithi196 ceph-mon[32572]: pgmap v2723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 568 B/s rd, 1 op/s 2024-04-26T12:56:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:23 smithi110 ceph-mon[28069]: pgmap v2722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 929 B/s rd, 1 op/s 2024-04-26T12:56:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:23 smithi110 ceph-mon[28069]: pgmap v2723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 568 B/s rd, 1 op/s 2024-04-26T12:56:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:23 smithi193 ceph-mon[32782]: pgmap v2722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 929 B/s rd, 1 op/s 2024-04-26T12:56:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:23 smithi193 ceph-mon[32782]: pgmap v2723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 568 B/s rd, 1 op/s 2024-04-26T12:56:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:25 smithi196 ceph-mon[32572]: pgmap v2724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:25 smithi110 ceph-mon[28069]: pgmap v2724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:25 smithi193 ceph-mon[32782]: pgmap v2724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4101.835621 secs 2024-04-26T12:56:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:27 smithi196 ceph-mon[32572]: pgmap v2725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4101.835621 secs 2024-04-26T12:56:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:27 smithi110 ceph-mon[28069]: pgmap v2725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4101.835621 secs 2024-04-26T12:56:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:27 smithi193 ceph-mon[32782]: pgmap v2725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:29.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:29 smithi193 ceph-mon[32782]: pgmap v2726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:29 smithi196 ceph-mon[32572]: pgmap v2726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:29 smithi110 ceph-mon[28069]: pgmap v2726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:31.747 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:31 smithi110 ceph-mon[28069]: pgmap v2727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:31 smithi196 ceph-mon[32572]: pgmap v2727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:31 smithi193 ceph-mon[32782]: pgmap v2727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:56:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4106.835747 secs 2024-04-26T12:56:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4106.835747 secs 2024-04-26T12:56:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4106.835747 secs 2024-04-26T12:56:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:33 smithi196 ceph-mon[32572]: pgmap v2728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:56:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:33 smithi110 ceph-mon[28069]: pgmap v2728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:56:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:33 smithi193 ceph-mon[32782]: pgmap v2728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:56:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:35 smithi196 ceph-mon[32572]: pgmap v2729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:35 smithi110 ceph-mon[28069]: pgmap v2729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:35 smithi193 ceph-mon[32782]: pgmap v2729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4111.835840 secs 2024-04-26T12:56:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:37 smithi196 ceph-mon[32572]: pgmap v2730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4111.835840 secs 2024-04-26T12:56:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:37 smithi110 ceph-mon[28069]: pgmap v2730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4111.835840 secs 2024-04-26T12:56:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:37 smithi193 ceph-mon[32782]: pgmap v2730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:39 smithi196 ceph-mon[32572]: pgmap v2731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:39 smithi110 ceph-mon[28069]: pgmap v2731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:39 smithi193 ceph-mon[32782]: pgmap v2731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:41 smithi196 ceph-mon[32572]: pgmap v2732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:41 smithi110 ceph-mon[28069]: pgmap v2732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:41 smithi193 ceph-mon[32782]: pgmap v2732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4116.835955 secs 2024-04-26T12:56:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4116.835955 secs 2024-04-26T12:56:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4116.835955 secs 2024-04-26T12:56:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:43 smithi196 ceph-mon[32572]: pgmap v2733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:43 smithi110 ceph-mon[28069]: pgmap v2733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:43 smithi193 ceph-mon[32782]: pgmap v2733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:45 smithi196 ceph-mon[32572]: pgmap v2734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:45 smithi110 ceph-mon[28069]: pgmap v2734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:45 smithi193 ceph-mon[32782]: pgmap v2734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4121.836074 secs 2024-04-26T12:56:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:47 smithi196 ceph-mon[32572]: pgmap v2735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4121.836074 secs 2024-04-26T12:56:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:47 smithi110 ceph-mon[28069]: pgmap v2735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4121.836074 secs 2024-04-26T12:56:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:47 smithi193 ceph-mon[32782]: pgmap v2735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:49 smithi196 ceph-mon[32572]: pgmap v2736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:49 smithi110 ceph-mon[28069]: pgmap v2736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:49 smithi193 ceph-mon[32782]: pgmap v2736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:50 smithi110 ceph-mon[28069]: pgmap v2737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:50 smithi196 ceph-mon[32572]: pgmap v2737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:50 smithi193 ceph-mon[32782]: pgmap v2737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4126.836229 secs 2024-04-26T12:56:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4126.836229 secs 2024-04-26T12:56:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4126.836229 secs 2024-04-26T12:56:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:52 smithi196 ceph-mon[32572]: pgmap v2738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:52 smithi110 ceph-mon[28069]: pgmap v2738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:52 smithi193 ceph-mon[32782]: pgmap v2738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:55 smithi196 ceph-mon[32572]: pgmap v2739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:55 smithi110 ceph-mon[28069]: pgmap v2739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:55 smithi193 ceph-mon[32782]: pgmap v2739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4131.836336 secs 2024-04-26T12:56:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:57 smithi110 ceph-mon[28069]: pgmap v2740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4131.836336 secs 2024-04-26T12:56:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:57 smithi193 ceph-mon[32782]: pgmap v2740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4131.836336 secs 2024-04-26T12:56:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:57 smithi196 ceph-mon[32572]: pgmap v2740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:56:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:56:59 smithi110 ceph-mon[28069]: pgmap v2741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:56:59 smithi193 ceph-mon[32782]: pgmap v2741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:56:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:56:59 smithi196 ceph-mon[32572]: pgmap v2741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:01 smithi196 ceph-mon[32572]: pgmap v2742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:01 smithi110 ceph-mon[28069]: pgmap v2742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:01 smithi193 ceph-mon[32782]: pgmap v2742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4136.836434 secs 2024-04-26T12:57:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4136.836434 secs 2024-04-26T12:57:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4136.836434 secs 2024-04-26T12:57:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:03 smithi196 ceph-mon[32572]: pgmap v2743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:03 smithi110 ceph-mon[28069]: pgmap v2743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:03 smithi193 ceph-mon[32782]: pgmap v2743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:05 smithi196 ceph-mon[32572]: pgmap v2744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:05 smithi110 ceph-mon[28069]: pgmap v2744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:05 smithi193 ceph-mon[32782]: pgmap v2744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4141.836594 secs 2024-04-26T12:57:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:07 smithi196 ceph-mon[32572]: pgmap v2745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4141.836594 secs 2024-04-26T12:57:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:07 smithi110 ceph-mon[28069]: pgmap v2745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4141.836594 secs 2024-04-26T12:57:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:07 smithi193 ceph-mon[32782]: pgmap v2745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:09 smithi196 ceph-mon[32572]: pgmap v2746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:09 smithi110 ceph-mon[28069]: pgmap v2746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:09 smithi193 ceph-mon[32782]: pgmap v2746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:11 smithi196 ceph-mon[32572]: pgmap v2747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:11 smithi110 ceph-mon[28069]: pgmap v2747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:11 smithi193 ceph-mon[32782]: pgmap v2747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4146.836713 secs 2024-04-26T12:57:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4146.836713 secs 2024-04-26T12:57:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4146.836713 secs 2024-04-26T12:57:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:13 smithi196 ceph-mon[32572]: pgmap v2748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:13 smithi110 ceph-mon[28069]: pgmap v2748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:13 smithi193 ceph-mon[32782]: pgmap v2748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:15 smithi196 ceph-mon[32572]: pgmap v2749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:15 smithi110 ceph-mon[28069]: pgmap v2749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:15 smithi193 ceph-mon[32782]: pgmap v2749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:57:17.019+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T12:57:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:57:17.019+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006320 con 0x7f261c104b50 2024-04-26T12:57:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:57:17.020+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 36 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006320 con 0x55db1be4fdd0 2024-04-26T12:57:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T12:57:17.020+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 36 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T12:57:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4151.836831 secs 2024-04-26T12:57:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:17 smithi196 ceph-mon[32572]: pgmap v2750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4151.836831 secs 2024-04-26T12:57:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:17 smithi110 ceph-mon[28069]: pgmap v2750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4151.836831 secs 2024-04-26T12:57:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:17 smithi193 ceph-mon[32782]: pgmap v2750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:19 smithi196 ceph-mon[32572]: pgmap v2751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:19 smithi110 ceph-mon[28069]: pgmap v2751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:19 smithi193 ceph-mon[32782]: pgmap v2751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:21 smithi196 ceph-mon[32572]: pgmap v2752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:21 smithi110 ceph-mon[28069]: pgmap v2752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:21 smithi193 ceph-mon[32782]: pgmap v2752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4156.836918 secs 2024-04-26T12:57:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:57:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4156.836918 secs 2024-04-26T12:57:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:57:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4156.836918 secs 2024-04-26T12:57:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:23 smithi196 ceph-mon[32572]: pgmap v2753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:23 smithi110 ceph-mon[28069]: pgmap v2753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:23 smithi193 ceph-mon[32782]: pgmap v2753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:57:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:57:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:57:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:57:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:57:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:57:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:57:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:57:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:57:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:25 smithi196 ceph-mon[32572]: pgmap v2754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:57:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:25 smithi196 ceph-mon[32572]: pgmap v2755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:25 smithi110 ceph-mon[28069]: pgmap v2754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:57:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:25 smithi110 ceph-mon[28069]: pgmap v2755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:25 smithi193 ceph-mon[32782]: pgmap v2754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T12:57:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:25 smithi193 ceph-mon[32782]: pgmap v2755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:26 smithi110 ceph-mon[28069]: pgmap v2756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:26 smithi193 ceph-mon[32782]: pgmap v2756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:26 smithi196 ceph-mon[32572]: pgmap v2756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4161.837034 secs 2024-04-26T12:57:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4161.837034 secs 2024-04-26T12:57:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4161.837034 secs 2024-04-26T12:57:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:28 smithi110 ceph-mon[28069]: pgmap v2757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:28 smithi193 ceph-mon[32782]: pgmap v2757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:28 smithi196 ceph-mon[32572]: pgmap v2757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:30 smithi110 ceph-mon[28069]: pgmap v2758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:30 smithi193 ceph-mon[32782]: pgmap v2758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:30 smithi196 ceph-mon[32572]: pgmap v2758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4166.837166 secs 2024-04-26T12:57:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:32 smithi110 ceph-mon[28069]: pgmap v2759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4166.837166 secs 2024-04-26T12:57:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:32 smithi193 ceph-mon[32782]: pgmap v2759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4166.837166 secs 2024-04-26T12:57:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:32 smithi196 ceph-mon[32572]: pgmap v2759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:57:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:34 smithi110 ceph-mon[28069]: pgmap v2760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:57:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:34 smithi193 ceph-mon[32782]: pgmap v2760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:57:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:34 smithi196 ceph-mon[32572]: pgmap v2760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:57:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:36 smithi110 ceph-mon[28069]: pgmap v2761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:36 smithi193 ceph-mon[32782]: pgmap v2761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:36 smithi196 ceph-mon[32572]: pgmap v2761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4171.837304 secs 2024-04-26T12:57:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4171.837304 secs 2024-04-26T12:57:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4171.837304 secs 2024-04-26T12:57:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:38 smithi110 ceph-mon[28069]: pgmap v2762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:38 smithi193 ceph-mon[32782]: pgmap v2762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:38 smithi196 ceph-mon[32572]: pgmap v2762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:40 smithi110 ceph-mon[28069]: pgmap v2763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:40 smithi193 ceph-mon[32782]: pgmap v2763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:40 smithi196 ceph-mon[32572]: pgmap v2763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4176.837441 secs 2024-04-26T12:57:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:42 smithi193 ceph-mon[32782]: pgmap v2764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4176.837441 secs 2024-04-26T12:57:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:42 smithi196 ceph-mon[32572]: pgmap v2764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4176.837441 secs 2024-04-26T12:57:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:42 smithi110 ceph-mon[28069]: pgmap v2764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:44 smithi193 ceph-mon[32782]: pgmap v2765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:44 smithi196 ceph-mon[32572]: pgmap v2765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:44 smithi110 ceph-mon[28069]: pgmap v2765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:47.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:46 smithi196 ceph-mon[32572]: pgmap v2766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:46 smithi193 ceph-mon[32782]: pgmap v2766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:46 smithi110 ceph-mon[28069]: pgmap v2766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4181.837593 secs 2024-04-26T12:57:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4181.837593 secs 2024-04-26T12:57:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4181.837593 secs 2024-04-26T12:57:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:48 smithi193 ceph-mon[32782]: pgmap v2767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:49.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:48 smithi110 ceph-mon[28069]: pgmap v2767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:48 smithi196 ceph-mon[32572]: pgmap v2767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:50 smithi193 ceph-mon[32782]: pgmap v2768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:50 smithi196 ceph-mon[32572]: pgmap v2768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:50 smithi110 ceph-mon[28069]: pgmap v2768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4186.837658 secs 2024-04-26T12:57:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4186.837658 secs 2024-04-26T12:57:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4186.837658 secs 2024-04-26T12:57:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:52 smithi196 ceph-mon[32572]: pgmap v2769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:52 smithi110 ceph-mon[28069]: pgmap v2769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:52 smithi193 ceph-mon[32782]: pgmap v2769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:54 smithi196 ceph-mon[32572]: pgmap v2770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:54 smithi110 ceph-mon[28069]: pgmap v2770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:54 smithi193 ceph-mon[32782]: pgmap v2770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:56 smithi196 ceph-mon[32572]: pgmap v2771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4191.837776 secs 2024-04-26T12:57:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:56 smithi110 ceph-mon[28069]: pgmap v2771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4191.837776 secs 2024-04-26T12:57:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:56 smithi193 ceph-mon[32782]: pgmap v2771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:57:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4191.837776 secs 2024-04-26T12:57:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:57:58 smithi196 ceph-mon[32572]: pgmap v2772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:57:58 smithi110 ceph-mon[28069]: pgmap v2772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:57:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:57:58 smithi193 ceph-mon[32782]: pgmap v2772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:01 smithi196 ceph-mon[32572]: pgmap v2773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:01 smithi110 ceph-mon[28069]: pgmap v2773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:01 smithi193 ceph-mon[32782]: pgmap v2773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4196.837894 secs 2024-04-26T12:58:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4196.837894 secs 2024-04-26T12:58:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4196.837894 secs 2024-04-26T12:58:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:03 smithi196 ceph-mon[32572]: pgmap v2774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:03 smithi110 ceph-mon[28069]: pgmap v2774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:03 smithi193 ceph-mon[32782]: pgmap v2774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:05 smithi196 ceph-mon[32572]: pgmap v2775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:05 smithi110 ceph-mon[28069]: pgmap v2775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:05 smithi193 ceph-mon[32782]: pgmap v2775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:07 smithi196 ceph-mon[32572]: pgmap v2776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4201.837972 secs 2024-04-26T12:58:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:07 smithi110 ceph-mon[28069]: pgmap v2776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4201.837972 secs 2024-04-26T12:58:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:07 smithi193 ceph-mon[32782]: pgmap v2776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4201.837972 secs 2024-04-26T12:58:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:09 smithi196 ceph-mon[32572]: pgmap v2777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:09 smithi110 ceph-mon[28069]: pgmap v2777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:09 smithi193 ceph-mon[32782]: pgmap v2777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:11 smithi196 ceph-mon[32572]: pgmap v2778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:11 smithi110 ceph-mon[28069]: pgmap v2778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:11 smithi193 ceph-mon[32782]: pgmap v2778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4206.838091 secs 2024-04-26T12:58:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4206.838091 secs 2024-04-26T12:58:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4206.838091 secs 2024-04-26T12:58:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:13 smithi196 ceph-mon[32572]: pgmap v2779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:13 smithi110 ceph-mon[28069]: pgmap v2779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:13 smithi193 ceph-mon[32782]: pgmap v2779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:15 smithi196 ceph-mon[32572]: pgmap v2780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:15 smithi110 ceph-mon[28069]: pgmap v2780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:15 smithi193 ceph-mon[32782]: pgmap v2780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:17 smithi196 ceph-mon[32572]: pgmap v2781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4211.838214 secs 2024-04-26T12:58:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:17 smithi110 ceph-mon[28069]: pgmap v2781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4211.838214 secs 2024-04-26T12:58:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:17 smithi193 ceph-mon[32782]: pgmap v2781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4211.838214 secs 2024-04-26T12:58:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:19 smithi196 ceph-mon[32572]: pgmap v2782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:19 smithi110 ceph-mon[28069]: pgmap v2782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:19 smithi193 ceph-mon[32782]: pgmap v2782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:21 smithi196 ceph-mon[32572]: pgmap v2783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:21 smithi110 ceph-mon[28069]: pgmap v2783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:21 smithi193 ceph-mon[32782]: pgmap v2783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4216.838339 secs 2024-04-26T12:58:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4216.838339 secs 2024-04-26T12:58:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4216.838339 secs 2024-04-26T12:58:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:23 smithi196 ceph-mon[32572]: pgmap v2784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:23 smithi110 ceph-mon[28069]: pgmap v2784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:23 smithi193 ceph-mon[32782]: pgmap v2784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:24 smithi110 ceph-mon[28069]: pgmap v2785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:58:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:24 smithi193 ceph-mon[32782]: pgmap v2785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:58:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:24 smithi196 ceph-mon[32572]: pgmap v2785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:58:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:58:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:58:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:25 smithi110 ceph-mon[28069]: pgmap v2786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T12:58:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:25 smithi110 ceph-mon[28069]: pgmap v2787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:25.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:58:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:58:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:58:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:25 smithi193 ceph-mon[32782]: pgmap v2786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T12:58:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:25 smithi193 ceph-mon[32782]: pgmap v2787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:58:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:58:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:58:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:25 smithi196 ceph-mon[32572]: pgmap v2786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T12:58:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:25 smithi196 ceph-mon[32572]: pgmap v2787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:58:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:26 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4221.838463 secs 2024-04-26T12:58:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:26 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4221.838463 secs 2024-04-26T12:58:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:26 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4221.838463 secs 2024-04-26T12:58:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:27 smithi196 ceph-mon[32572]: pgmap v2788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T12:58:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:27 smithi110 ceph-mon[28069]: pgmap v2788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T12:58:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:27 smithi193 ceph-mon[32782]: pgmap v2788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T12:58:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:30 smithi110 ceph-mon[28069]: pgmap v2789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:30 smithi193 ceph-mon[32782]: pgmap v2789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:30 smithi196 ceph-mon[32572]: pgmap v2789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4226.838601 secs 2024-04-26T12:58:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:32 smithi110 ceph-mon[28069]: pgmap v2790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4226.838601 secs 2024-04-26T12:58:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:32 smithi193 ceph-mon[32782]: pgmap v2790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4226.838601 secs 2024-04-26T12:58:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:32 smithi196 ceph-mon[32572]: pgmap v2790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:34 smithi110 ceph-mon[28069]: pgmap v2791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:34 smithi193 ceph-mon[32782]: pgmap v2791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:34 smithi196 ceph-mon[32572]: pgmap v2791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T12:58:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:36 smithi110 ceph-mon[28069]: pgmap v2792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:58:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:36 smithi193 ceph-mon[32782]: pgmap v2792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:58:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:36 smithi196 ceph-mon[32572]: pgmap v2792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:58:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4231.838723 secs 2024-04-26T12:58:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4231.838723 secs 2024-04-26T12:58:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4231.838723 secs 2024-04-26T12:58:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:38 smithi193 ceph-mon[32782]: pgmap v2793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:38 smithi196 ceph-mon[32572]: pgmap v2793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:38 smithi110 ceph-mon[28069]: pgmap v2793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:40 smithi193 ceph-mon[32782]: pgmap v2794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:40 smithi196 ceph-mon[32572]: pgmap v2794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:40 smithi110 ceph-mon[28069]: pgmap v2794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4236.838797 secs 2024-04-26T12:58:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:42 smithi193 ceph-mon[32782]: pgmap v2795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4236.838797 secs 2024-04-26T12:58:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:42 smithi196 ceph-mon[32572]: pgmap v2795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4236.838797 secs 2024-04-26T12:58:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:42 smithi110 ceph-mon[28069]: pgmap v2795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:44 smithi193 ceph-mon[32782]: pgmap v2796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:44 smithi196 ceph-mon[32572]: pgmap v2796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:44 smithi110 ceph-mon[28069]: pgmap v2796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:46 smithi193 ceph-mon[32782]: pgmap v2797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:46 smithi196 ceph-mon[32572]: pgmap v2797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:46 smithi110 ceph-mon[28069]: pgmap v2797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4241.838888 secs 2024-04-26T12:58:47.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4241.838888 secs 2024-04-26T12:58:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4241.838888 secs 2024-04-26T12:58:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:48 smithi193 ceph-mon[32782]: pgmap v2798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:48 smithi196 ceph-mon[32572]: pgmap v2798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:48 smithi110 ceph-mon[28069]: pgmap v2798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:50.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:50 smithi110 ceph-mon[28069]: pgmap v2799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:50 smithi193 ceph-mon[32782]: pgmap v2799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:50 smithi196 ceph-mon[32572]: pgmap v2799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4246.839010 secs 2024-04-26T12:58:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:52 smithi193 ceph-mon[32782]: pgmap v2800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4246.839010 secs 2024-04-26T12:58:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:52 smithi196 ceph-mon[32572]: pgmap v2800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4246.839010 secs 2024-04-26T12:58:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:52 smithi110 ceph-mon[28069]: pgmap v2800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:58:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:54 smithi193 ceph-mon[32782]: pgmap v2801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:54 smithi196 ceph-mon[32572]: pgmap v2801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:54 smithi110 ceph-mon[28069]: pgmap v2801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:58:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:56 smithi193 ceph-mon[32782]: pgmap v2802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:58:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:56 smithi196 ceph-mon[32572]: pgmap v2802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:58:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:56 smithi110 ceph-mon[28069]: pgmap v2802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:58:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4251.839130 secs 2024-04-26T12:58:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4251.839130 secs 2024-04-26T12:58:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4251.839130 secs 2024-04-26T12:58:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:58:58 smithi193 ceph-mon[32782]: pgmap v2803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:58:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:58:58 smithi196 ceph-mon[32572]: pgmap v2803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:58:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:58:58 smithi110 ceph-mon[28069]: pgmap v2803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:59:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:00 smithi193 ceph-mon[32782]: pgmap v2804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:00 smithi196 ceph-mon[32572]: pgmap v2804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:00 smithi110 ceph-mon[28069]: pgmap v2804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4256.839263 secs 2024-04-26T12:59:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:02 smithi110 ceph-mon[28069]: pgmap v2805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:59:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:59:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:59:02.266+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:59:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:59:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:59:02.266+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:59:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:59:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:59:02.266+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:59:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:59:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:59:02.266+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:59:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 12:59:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T12:59:02.266+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T12:59:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4256.839263 secs 2024-04-26T12:59:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:02 smithi196 ceph-mon[32572]: pgmap v2805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:59:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4256.839263 secs 2024-04-26T12:59:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:02 smithi193 ceph-mon[32782]: pgmap v2805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T12:59:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:04 smithi196 ceph-mon[32572]: pgmap v2806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:04 smithi110 ceph-mon[28069]: pgmap v2806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:04 smithi193 ceph-mon[32782]: pgmap v2806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:06 smithi196 ceph-mon[32572]: pgmap v2807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:06 smithi110 ceph-mon[28069]: pgmap v2807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:06 smithi193 ceph-mon[32782]: pgmap v2807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4261.839403 secs 2024-04-26T12:59:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4261.839403 secs 2024-04-26T12:59:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4261.839403 secs 2024-04-26T12:59:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:08 smithi196 ceph-mon[32572]: pgmap v2808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:08 smithi110 ceph-mon[28069]: pgmap v2808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:08 smithi193 ceph-mon[32782]: pgmap v2808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:10 smithi196 ceph-mon[32572]: pgmap v2809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:10 smithi110 ceph-mon[28069]: pgmap v2809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:10 smithi193 ceph-mon[32782]: pgmap v2809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4266.839533 secs 2024-04-26T12:59:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:12 smithi196 ceph-mon[32572]: pgmap v2810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4266.839533 secs 2024-04-26T12:59:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:12 smithi110 ceph-mon[28069]: pgmap v2810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4266.839533 secs 2024-04-26T12:59:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:12 smithi193 ceph-mon[32782]: pgmap v2810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:14 smithi196 ceph-mon[32572]: pgmap v2811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:14 smithi110 ceph-mon[28069]: pgmap v2811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:14 smithi193 ceph-mon[32782]: pgmap v2811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:16 smithi196 ceph-mon[32572]: pgmap v2812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:16 smithi110 ceph-mon[28069]: pgmap v2812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:16 smithi193 ceph-mon[32782]: pgmap v2812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4271.839660 secs 2024-04-26T12:59:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4271.839660 secs 2024-04-26T12:59:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4271.839660 secs 2024-04-26T12:59:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:18 smithi196 ceph-mon[32572]: pgmap v2813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:18 smithi110 ceph-mon[28069]: pgmap v2813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:18 smithi193 ceph-mon[32782]: pgmap v2813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:20 smithi196 ceph-mon[32572]: pgmap v2814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:20 smithi110 ceph-mon[28069]: pgmap v2814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:20 smithi193 ceph-mon[32782]: pgmap v2814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4276.839813 secs 2024-04-26T12:59:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:22 smithi196 ceph-mon[32572]: pgmap v2815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4276.839813 secs 2024-04-26T12:59:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:22 smithi110 ceph-mon[28069]: pgmap v2815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4276.839813 secs 2024-04-26T12:59:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:22 smithi193 ceph-mon[32782]: pgmap v2815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:24 smithi196 ceph-mon[32572]: pgmap v2816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:24 smithi110 ceph-mon[28069]: pgmap v2816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:24 smithi193 ceph-mon[32782]: pgmap v2816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:26 smithi196 ceph-mon[32572]: pgmap v2817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:59:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:26 smithi110 ceph-mon[28069]: pgmap v2817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:59:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:26 smithi193 ceph-mon[32782]: pgmap v2817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T12:59:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4281.839901 secs 2024-04-26T12:59:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:59:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:59:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:59:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4281.839901 secs 2024-04-26T12:59:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:59:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:59:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:59:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4281.839901 secs 2024-04-26T12:59:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T12:59:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T12:59:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T12:59:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:28 smithi196 ceph-mon[32572]: pgmap v2818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:59:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:28 smithi196 ceph-mon[32572]: pgmap v2819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:28 smithi110 ceph-mon[28069]: pgmap v2818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:59:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:28 smithi110 ceph-mon[28069]: pgmap v2819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:28 smithi193 ceph-mon[32782]: pgmap v2818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T12:59:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:28 smithi193 ceph-mon[32782]: pgmap v2819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:30 smithi196 ceph-mon[32572]: pgmap v2820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:30 smithi110 ceph-mon[28069]: pgmap v2820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:30 smithi193 ceph-mon[32782]: pgmap v2820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:32 smithi196 ceph-mon[32572]: pgmap v2821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4286.839994 secs 2024-04-26T12:59:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:32 smithi110 ceph-mon[28069]: pgmap v2821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4286.839994 secs 2024-04-26T12:59:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:32 smithi193 ceph-mon[32782]: pgmap v2821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4286.839994 secs 2024-04-26T12:59:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:34 smithi196 ceph-mon[32572]: pgmap v2822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:34 smithi110 ceph-mon[28069]: pgmap v2822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:34 smithi193 ceph-mon[32782]: pgmap v2822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:36 smithi196 ceph-mon[32572]: pgmap v2823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:36 smithi110 ceph-mon[28069]: pgmap v2823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:36 smithi193 ceph-mon[32782]: pgmap v2823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T12:59:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4291.840082 secs 2024-04-26T12:59:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4291.840082 secs 2024-04-26T12:59:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4291.840082 secs 2024-04-26T12:59:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:38 smithi110 ceph-mon[28069]: pgmap v2824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:59:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:38 smithi193 ceph-mon[32782]: pgmap v2824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:59:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:38 smithi196 ceph-mon[32572]: pgmap v2824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T12:59:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:39 smithi110 ceph-mon[28069]: pgmap v2825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:39 smithi193 ceph-mon[32782]: pgmap v2825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:39 smithi196 ceph-mon[32572]: pgmap v2825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:41 smithi193 ceph-mon[32782]: pgmap v2826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4296.840224 secs 2024-04-26T12:59:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:41 smithi196 ceph-mon[32572]: pgmap v2826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4296.840224 secs 2024-04-26T12:59:42.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:41 smithi110 ceph-mon[28069]: pgmap v2826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:42.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4296.840224 secs 2024-04-26T12:59:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:43 smithi193 ceph-mon[32782]: pgmap v2827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:43 smithi196 ceph-mon[32572]: pgmap v2827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:43 smithi110 ceph-mon[28069]: pgmap v2827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:45 smithi193 ceph-mon[32782]: pgmap v2828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:45 smithi196 ceph-mon[32572]: pgmap v2828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:45 smithi110 ceph-mon[28069]: pgmap v2828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:47.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4301.840365 secs 2024-04-26T12:59:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4301.840365 secs 2024-04-26T12:59:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4301.840365 secs 2024-04-26T12:59:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:47 smithi196 ceph-mon[32572]: pgmap v2829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:47 smithi110 ceph-mon[28069]: pgmap v2829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:47 smithi193 ceph-mon[32782]: pgmap v2829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:49 smithi196 ceph-mon[32572]: pgmap v2830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:49 smithi110 ceph-mon[28069]: pgmap v2830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:49 smithi193 ceph-mon[32782]: pgmap v2830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:51 smithi196 ceph-mon[32572]: pgmap v2831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4306.840488 secs 2024-04-26T12:59:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:51 smithi110 ceph-mon[28069]: pgmap v2831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4306.840488 secs 2024-04-26T12:59:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:51 smithi193 ceph-mon[32782]: pgmap v2831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4306.840488 secs 2024-04-26T12:59:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:53 smithi196 ceph-mon[32572]: pgmap v2832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:53 smithi110 ceph-mon[28069]: pgmap v2832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:53 smithi193 ceph-mon[32782]: pgmap v2832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T12:59:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:55 smithi196 ceph-mon[32572]: pgmap v2833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:55 smithi110 ceph-mon[28069]: pgmap v2833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:55 smithi193 ceph-mon[32782]: pgmap v2833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4311.840614 secs 2024-04-26T12:59:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4311.840614 secs 2024-04-26T12:59:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4311.840614 secs 2024-04-26T12:59:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:57 smithi196 ceph-mon[32572]: pgmap v2834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:57 smithi110 ceph-mon[28069]: pgmap v2834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T12:59:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:57 smithi193 ceph-mon[32782]: pgmap v2834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 12:59:59 smithi196 ceph-mon[32572]: pgmap v2835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 12:59:59 smithi110 ceph-mon[28069]: pgmap v2835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 12:59:59 smithi193 ceph-mon[32782]: pgmap v2835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:00:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:00:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:00:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:01 smithi196 ceph-mon[32572]: pgmap v2836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4316.840704 secs 2024-04-26T13:00:02.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:01 smithi193 ceph-mon[32782]: pgmap v2836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:02.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4316.840704 secs 2024-04-26T13:00:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:01 smithi110 ceph-mon[28069]: pgmap v2836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4316.840704 secs 2024-04-26T13:00:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:03 smithi196 ceph-mon[32572]: pgmap v2837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:03 smithi110 ceph-mon[28069]: pgmap v2837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:03 smithi193 ceph-mon[32782]: pgmap v2837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:05 smithi196 ceph-mon[32572]: pgmap v2838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:05 smithi110 ceph-mon[28069]: pgmap v2838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:05 smithi193 ceph-mon[32782]: pgmap v2838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4321.840769 secs 2024-04-26T13:00:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4321.840769 secs 2024-04-26T13:00:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4321.840769 secs 2024-04-26T13:00:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:07 smithi196 ceph-mon[32572]: pgmap v2839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:07 smithi110 ceph-mon[28069]: pgmap v2839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:07 smithi193 ceph-mon[32782]: pgmap v2839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:09 smithi196 ceph-mon[32572]: pgmap v2840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:09 smithi110 ceph-mon[28069]: pgmap v2840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:09 smithi193 ceph-mon[32782]: pgmap v2840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:11 smithi196 ceph-mon[32572]: pgmap v2841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4326.840837 secs 2024-04-26T13:00:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:11 smithi110 ceph-mon[28069]: pgmap v2841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4326.840837 secs 2024-04-26T13:00:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:11 smithi193 ceph-mon[32782]: pgmap v2841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4326.840837 secs 2024-04-26T13:00:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:13 smithi196 ceph-mon[32572]: pgmap v2842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:13 smithi110 ceph-mon[28069]: pgmap v2842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:13 smithi193 ceph-mon[32782]: pgmap v2842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:15 smithi196 ceph-mon[32572]: pgmap v2843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:15 smithi110 ceph-mon[28069]: pgmap v2843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:15 smithi193 ceph-mon[32782]: pgmap v2843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:00:17.049+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006320 con 0x7f261c104b50 2024-04-26T13:00:17.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:00:17.049+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:00:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:00:17.050+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 37 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:00:17.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:00:17.050+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 37 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006320 con 0x55db1be4fdd0 2024-04-26T13:00:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4331.840957 secs 2024-04-26T13:00:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4331.840957 secs 2024-04-26T13:00:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4331.840957 secs 2024-04-26T13:00:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:17 smithi196 ceph-mon[32572]: pgmap v2844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:17 smithi110 ceph-mon[28069]: pgmap v2844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:17 smithi193 ceph-mon[32782]: pgmap v2844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:19 smithi196 ceph-mon[32572]: pgmap v2845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:19 smithi110 ceph-mon[28069]: pgmap v2845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:19 smithi193 ceph-mon[32782]: pgmap v2845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:21 smithi196 ceph-mon[32572]: pgmap v2846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:21 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4336.841096 secs 2024-04-26T13:00:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:21 smithi110 ceph-mon[28069]: pgmap v2846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:21 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4336.841096 secs 2024-04-26T13:00:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:21 smithi193 ceph-mon[32782]: pgmap v2846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:21 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4336.841096 secs 2024-04-26T13:00:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:23 smithi196 ceph-mon[32572]: pgmap v2847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:23 smithi110 ceph-mon[28069]: pgmap v2847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:23 smithi193 ceph-mon[32782]: pgmap v2847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:26 smithi196 ceph-mon[32572]: pgmap v2848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:26 smithi110 ceph-mon[28069]: pgmap v2848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:26 smithi193 ceph-mon[32782]: pgmap v2848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4341.841257 secs 2024-04-26T13:00:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4341.841257 secs 2024-04-26T13:00:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4341.841257 secs 2024-04-26T13:00:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:28 smithi110 ceph-mon[28069]: pgmap v2849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:00:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:28 smithi193 ceph-mon[32782]: pgmap v2849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:00:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:28 smithi196 ceph-mon[32572]: pgmap v2849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:00:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:00:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:00:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:29 smithi110 ceph-mon[28069]: pgmap v2850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:00:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:29 smithi110 ceph-mon[28069]: pgmap v2851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:00:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:00:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:00:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:29 smithi193 ceph-mon[32782]: pgmap v2850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:00:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:29 smithi193 ceph-mon[32782]: pgmap v2851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:00:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:00:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:00:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:29 smithi196 ceph-mon[32572]: pgmap v2850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:00:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:29 smithi196 ceph-mon[32572]: pgmap v2851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:00:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:31 smithi196 ceph-mon[32572]: pgmap v2852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:31 smithi110 ceph-mon[28069]: pgmap v2852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:31 smithi193 ceph-mon[32782]: pgmap v2852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4346.841403 secs 2024-04-26T13:00:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4346.841403 secs 2024-04-26T13:00:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4346.841403 secs 2024-04-26T13:00:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:33 smithi196 ceph-mon[32572]: pgmap v2853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:00:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:33 smithi110 ceph-mon[28069]: pgmap v2853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:00:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:33 smithi193 ceph-mon[32782]: pgmap v2853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:00:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:35 smithi196 ceph-mon[32572]: pgmap v2854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:35 smithi110 ceph-mon[28069]: pgmap v2854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:35 smithi193 ceph-mon[32782]: pgmap v2854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4351.841518 secs 2024-04-26T13:00:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:37 smithi196 ceph-mon[32572]: pgmap v2855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:37.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4351.841518 secs 2024-04-26T13:00:37.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:37 smithi110 ceph-mon[28069]: pgmap v2855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4351.841518 secs 2024-04-26T13:00:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:37 smithi193 ceph-mon[32782]: pgmap v2855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:00:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:39 smithi196 ceph-mon[32572]: pgmap v2856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:00:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:39 smithi110 ceph-mon[28069]: pgmap v2856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:00:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:39 smithi193 ceph-mon[32782]: pgmap v2856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:00:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:41 smithi196 ceph-mon[32572]: pgmap v2857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:41 smithi110 ceph-mon[28069]: pgmap v2857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:41 smithi193 ceph-mon[32782]: pgmap v2857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4356.841640 secs 2024-04-26T13:00:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4356.841640 secs 2024-04-26T13:00:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4356.841640 secs 2024-04-26T13:00:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:43 smithi196 ceph-mon[32572]: pgmap v2858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:43 smithi110 ceph-mon[28069]: pgmap v2858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:43 smithi193 ceph-mon[32782]: pgmap v2858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:45 smithi196 ceph-mon[32572]: pgmap v2859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:45 smithi110 ceph-mon[28069]: pgmap v2859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:45 smithi193 ceph-mon[32782]: pgmap v2859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4361.841763 secs 2024-04-26T13:00:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:47 smithi196 ceph-mon[32572]: pgmap v2860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4361.841763 secs 2024-04-26T13:00:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:47 smithi110 ceph-mon[28069]: pgmap v2860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4361.841763 secs 2024-04-26T13:00:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:47 smithi193 ceph-mon[32782]: pgmap v2860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:49 smithi196 ceph-mon[32572]: pgmap v2861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:49 smithi110 ceph-mon[28069]: pgmap v2861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:49 smithi193 ceph-mon[32782]: pgmap v2861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:51 smithi196 ceph-mon[32572]: pgmap v2862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:51 smithi110 ceph-mon[28069]: pgmap v2862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:51 smithi193 ceph-mon[32782]: pgmap v2862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4366.841859 secs 2024-04-26T13:00:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4366.841859 secs 2024-04-26T13:00:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4366.841859 secs 2024-04-26T13:00:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:53 smithi196 ceph-mon[32572]: pgmap v2863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:53 smithi110 ceph-mon[28069]: pgmap v2863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:53 smithi193 ceph-mon[32782]: pgmap v2863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:55 smithi196 ceph-mon[32572]: pgmap v2864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:55 smithi110 ceph-mon[28069]: pgmap v2864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:55 smithi193 ceph-mon[32782]: pgmap v2864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4371.841975 secs 2024-04-26T13:00:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:57 smithi110 ceph-mon[28069]: pgmap v2865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4371.841975 secs 2024-04-26T13:00:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:57 smithi193 ceph-mon[32782]: pgmap v2865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4371.841975 secs 2024-04-26T13:00:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:57 smithi196 ceph-mon[32572]: pgmap v2865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:00:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:00:59 smithi110 ceph-mon[28069]: pgmap v2866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:00:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:00:59 smithi193 ceph-mon[32782]: pgmap v2866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:00:59 smithi196 ceph-mon[32572]: pgmap v2866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:01.781 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:01 smithi196 ceph-mon[32572]: pgmap v2867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:01 smithi110 ceph-mon[28069]: pgmap v2867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:01 smithi193 ceph-mon[32782]: pgmap v2867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4376.842059 secs 2024-04-26T13:01:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4376.842059 secs 2024-04-26T13:01:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4376.842059 secs 2024-04-26T13:01:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:03 smithi110 ceph-mon[28069]: pgmap v2868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:03 smithi193 ceph-mon[32782]: pgmap v2868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:03 smithi196 ceph-mon[32572]: pgmap v2868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:04 smithi110 ceph-mon[28069]: pgmap v2869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:04 smithi193 ceph-mon[32782]: pgmap v2869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:04 smithi196 ceph-mon[32572]: pgmap v2869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4381.842175 secs 2024-04-26T13:01:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:07 smithi196 ceph-mon[32572]: pgmap v2870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4381.842175 secs 2024-04-26T13:01:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:07 smithi110 ceph-mon[28069]: pgmap v2870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4381.842175 secs 2024-04-26T13:01:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:07 smithi193 ceph-mon[32782]: pgmap v2870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:09 smithi196 ceph-mon[32572]: pgmap v2871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:09 smithi110 ceph-mon[28069]: pgmap v2871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:09 smithi193 ceph-mon[32782]: pgmap v2871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:11 smithi196 ceph-mon[32572]: pgmap v2872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:11 smithi110 ceph-mon[28069]: pgmap v2872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:11 smithi193 ceph-mon[32782]: pgmap v2872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4386.842298 secs 2024-04-26T13:01:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4386.842298 secs 2024-04-26T13:01:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4386.842298 secs 2024-04-26T13:01:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:13 smithi196 ceph-mon[32572]: pgmap v2873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:13 smithi110 ceph-mon[28069]: pgmap v2873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:13 smithi193 ceph-mon[32782]: pgmap v2873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:15 smithi196 ceph-mon[32572]: pgmap v2874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:15 smithi110 ceph-mon[28069]: pgmap v2874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:15 smithi193 ceph-mon[32782]: pgmap v2874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4391.842440 secs 2024-04-26T13:01:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:17 smithi196 ceph-mon[32572]: pgmap v2875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4391.842440 secs 2024-04-26T13:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:17 smithi110 ceph-mon[28069]: pgmap v2875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4391.842440 secs 2024-04-26T13:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:17 smithi193 ceph-mon[32782]: pgmap v2875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:19 smithi196 ceph-mon[32572]: pgmap v2876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:19 smithi110 ceph-mon[28069]: pgmap v2876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:19 smithi193 ceph-mon[32782]: pgmap v2876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:21 smithi196 ceph-mon[32572]: pgmap v2877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:21 smithi110 ceph-mon[28069]: pgmap v2877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:21 smithi193 ceph-mon[32782]: pgmap v2877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:22.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4396.842539 secs 2024-04-26T13:01:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4396.842539 secs 2024-04-26T13:01:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4396.842539 secs 2024-04-26T13:01:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:23 smithi196 ceph-mon[32572]: pgmap v2878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:23 smithi110 ceph-mon[28069]: pgmap v2878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:23 smithi193 ceph-mon[32782]: pgmap v2878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:25 smithi196 ceph-mon[32572]: pgmap v2879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:01:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:25 smithi110 ceph-mon[28069]: pgmap v2879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:01:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:25 smithi193 ceph-mon[32782]: pgmap v2879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:01:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4401.842616 secs 2024-04-26T13:01:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:27 smithi196 ceph-mon[32572]: pgmap v2880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4401.842616 secs 2024-04-26T13:01:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:27 smithi110 ceph-mon[28069]: pgmap v2880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4401.842616 secs 2024-04-26T13:01:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:27 smithi193 ceph-mon[32782]: pgmap v2880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:29 smithi196 ceph-mon[32572]: pgmap v2881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:01:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:29 smithi110 ceph-mon[28069]: pgmap v2881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:01:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:29 smithi193 ceph-mon[32782]: pgmap v2881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:01:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:01:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:01:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:01:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:01:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:01:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:01:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:01:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:01:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:01:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:31 smithi110 ceph-mon[28069]: pgmap v2882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:01:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:31 smithi110 ceph-mon[28069]: pgmap v2883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:31 smithi193 ceph-mon[32782]: pgmap v2882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:01:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:31 smithi193 ceph-mon[32782]: pgmap v2883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:31 smithi196 ceph-mon[32572]: pgmap v2882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:01:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:31 smithi196 ceph-mon[32572]: pgmap v2883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4406.842733 secs 2024-04-26T13:01:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4406.842733 secs 2024-04-26T13:01:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4406.842733 secs 2024-04-26T13:01:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:33 smithi110 ceph-mon[28069]: pgmap v2884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:01:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:33 smithi193 ceph-mon[32782]: pgmap v2884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:01:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:33 smithi196 ceph-mon[32572]: pgmap v2884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:01:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:35 smithi110 ceph-mon[28069]: pgmap v2885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:35 smithi193 ceph-mon[32782]: pgmap v2885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:35 smithi196 ceph-mon[32572]: pgmap v2885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:36 smithi193 ceph-mon[32782]: pgmap v2886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:36 smithi196 ceph-mon[32572]: pgmap v2886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:36 smithi110 ceph-mon[28069]: pgmap v2886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4411.842849 secs 2024-04-26T13:01:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4411.842849 secs 2024-04-26T13:01:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4411.842849 secs 2024-04-26T13:01:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:38 smithi193 ceph-mon[32782]: pgmap v2887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:38 smithi196 ceph-mon[32572]: pgmap v2887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:38 smithi110 ceph-mon[28069]: pgmap v2887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:01:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:40 smithi196 ceph-mon[32572]: pgmap v2888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:01:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:40 smithi110 ceph-mon[28069]: pgmap v2888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:01:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:40 smithi193 ceph-mon[32782]: pgmap v2888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:01:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4416.842966 secs 2024-04-26T13:01:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4416.842966 secs 2024-04-26T13:01:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4416.842966 secs 2024-04-26T13:01:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:42 smithi196 ceph-mon[32572]: pgmap v2889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:42 smithi110 ceph-mon[28069]: pgmap v2889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:42 smithi193 ceph-mon[32782]: pgmap v2889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:44 smithi196 ceph-mon[32572]: pgmap v2890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:45.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:44 smithi110 ceph-mon[28069]: pgmap v2890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:44 smithi193 ceph-mon[32782]: pgmap v2890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:46 smithi196 ceph-mon[32572]: pgmap v2891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4421.843104 secs 2024-04-26T13:01:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:46 smithi110 ceph-mon[28069]: pgmap v2891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4421.843104 secs 2024-04-26T13:01:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:46 smithi193 ceph-mon[32782]: pgmap v2891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4421.843104 secs 2024-04-26T13:01:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:48 smithi196 ceph-mon[32572]: pgmap v2892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:48 smithi110 ceph-mon[28069]: pgmap v2892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:48 smithi193 ceph-mon[32782]: pgmap v2892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:50 smithi196 ceph-mon[32572]: pgmap v2893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:50 smithi110 ceph-mon[28069]: pgmap v2893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:50 smithi193 ceph-mon[32782]: pgmap v2893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:51 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4426.843225 secs 2024-04-26T13:01:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:51 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4426.843225 secs 2024-04-26T13:01:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:51 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4426.843225 secs 2024-04-26T13:01:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:52 smithi196 ceph-mon[32572]: pgmap v2894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:52 smithi110 ceph-mon[28069]: pgmap v2894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:52 smithi193 ceph-mon[32782]: pgmap v2894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:54 smithi196 ceph-mon[32572]: pgmap v2895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:54 smithi110 ceph-mon[28069]: pgmap v2895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:54 smithi193 ceph-mon[32782]: pgmap v2895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:57 smithi196 ceph-mon[32572]: pgmap v2896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4431.843348 secs 2024-04-26T13:01:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:57 smithi110 ceph-mon[28069]: pgmap v2896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4431.843348 secs 2024-04-26T13:01:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:57 smithi193 ceph-mon[32782]: pgmap v2896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:01:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4431.843348 secs 2024-04-26T13:01:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:01:59 smithi110 ceph-mon[28069]: pgmap v2897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:01:59 smithi193 ceph-mon[32782]: pgmap v2897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:01:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:01:59 smithi196 ceph-mon[32572]: pgmap v2897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:01 smithi110 ceph-mon[28069]: pgmap v2898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:01 smithi193 ceph-mon[32782]: pgmap v2898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:01 smithi196 ceph-mon[32572]: pgmap v2898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4436.843471 secs 2024-04-26T13:02:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4436.843471 secs 2024-04-26T13:02:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4436.843471 secs 2024-04-26T13:02:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:03 smithi193 ceph-mon[32782]: pgmap v2899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:03 smithi196 ceph-mon[32572]: pgmap v2899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:03 smithi110 ceph-mon[28069]: pgmap v2899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:04 smithi193 ceph-mon[32782]: pgmap v2900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:04 smithi196 ceph-mon[32572]: pgmap v2900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:04 smithi110 ceph-mon[28069]: pgmap v2900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:06 smithi196 ceph-mon[32572]: pgmap v2901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:06 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4441.843636 secs 2024-04-26T13:02:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:06 smithi110 ceph-mon[28069]: pgmap v2901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:06 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4441.843636 secs 2024-04-26T13:02:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:06 smithi193 ceph-mon[32782]: pgmap v2901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:06 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4441.843636 secs 2024-04-26T13:02:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:08 smithi196 ceph-mon[32572]: pgmap v2902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:08 smithi110 ceph-mon[28069]: pgmap v2902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:08 smithi193 ceph-mon[32782]: pgmap v2902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:10 smithi196 ceph-mon[32572]: pgmap v2903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:10 smithi110 ceph-mon[28069]: pgmap v2903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:10 smithi193 ceph-mon[32782]: pgmap v2903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:11 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4446.843762 secs 2024-04-26T13:02:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:11 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4446.843762 secs 2024-04-26T13:02:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:11 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4446.843762 secs 2024-04-26T13:02:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:12 smithi196 ceph-mon[32572]: pgmap v2904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:12 smithi110 ceph-mon[28069]: pgmap v2904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:12 smithi193 ceph-mon[32782]: pgmap v2904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:14 smithi196 ceph-mon[32572]: pgmap v2905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:14 smithi110 ceph-mon[28069]: pgmap v2905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:14 smithi193 ceph-mon[32782]: pgmap v2905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:16 smithi196 ceph-mon[32572]: pgmap v2906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:16 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4451.843882 secs 2024-04-26T13:02:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:16 smithi110 ceph-mon[28069]: pgmap v2906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:16 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4451.843882 secs 2024-04-26T13:02:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:16 smithi193 ceph-mon[32782]: pgmap v2906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:16 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4451.843882 secs 2024-04-26T13:02:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:18 smithi196 ceph-mon[32572]: pgmap v2907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:18 smithi110 ceph-mon[28069]: pgmap v2907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:18 smithi193 ceph-mon[32782]: pgmap v2907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:20 smithi196 ceph-mon[32572]: pgmap v2908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:20 smithi110 ceph-mon[28069]: pgmap v2908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:20 smithi193 ceph-mon[32782]: pgmap v2908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4456.844001 secs 2024-04-26T13:02:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4456.844001 secs 2024-04-26T13:02:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4456.844001 secs 2024-04-26T13:02:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:23 smithi196 ceph-mon[32572]: pgmap v2909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:23 smithi110 ceph-mon[28069]: pgmap v2909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:23 smithi193 ceph-mon[32782]: pgmap v2909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:25 smithi110 ceph-mon[28069]: pgmap v2910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:25 smithi193 ceph-mon[32782]: pgmap v2910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:25 smithi196 ceph-mon[32572]: pgmap v2910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:27 smithi110 ceph-mon[28069]: pgmap v2911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4461.844081 secs 2024-04-26T13:02:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:27 smithi193 ceph-mon[32782]: pgmap v2911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4461.844081 secs 2024-04-26T13:02:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:27 smithi196 ceph-mon[32572]: pgmap v2911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4461.844081 secs 2024-04-26T13:02:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:29 smithi110 ceph-mon[28069]: pgmap v2912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:29 smithi193 ceph-mon[32782]: pgmap v2912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:29 smithi196 ceph-mon[32572]: pgmap v2912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:31 smithi110 ceph-mon[28069]: pgmap v2913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:02:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:31 smithi193 ceph-mon[32782]: pgmap v2913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:02:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:31 smithi196 ceph-mon[32572]: pgmap v2913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:02:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:02:32.071+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:02:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:02:32.071+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006320 con 0x7f261c104b50 2024-04-26T13:02:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:02:32.072+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 38 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006320 con 0x55db1be4fdd0 2024-04-26T13:02:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:02:32.072+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 38 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:02:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4466.844169 secs 2024-04-26T13:02:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4466.844169 secs 2024-04-26T13:02:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4466.844169 secs 2024-04-26T13:02:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:33 smithi196 ceph-mon[32572]: pgmap v2914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:02:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:02:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:33 smithi110 ceph-mon[28069]: pgmap v2914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:02:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:02:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:33 smithi193 ceph-mon[32782]: pgmap v2914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:02:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:02:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:02:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:34 smithi196 ceph-mon[32572]: pgmap v2915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:02:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:34 smithi196 ceph-mon[32572]: pgmap v2916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:34 smithi110 ceph-mon[28069]: pgmap v2915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:02:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:34 smithi110 ceph-mon[28069]: pgmap v2916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:34 smithi193 ceph-mon[32782]: pgmap v2915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:02:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:34 smithi193 ceph-mon[32782]: pgmap v2916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:36 smithi196 ceph-mon[32572]: pgmap v2917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:36 smithi110 ceph-mon[28069]: pgmap v2917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:36 smithi193 ceph-mon[32782]: pgmap v2917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4471.844286 secs 2024-04-26T13:02:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4471.844286 secs 2024-04-26T13:02:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4471.844286 secs 2024-04-26T13:02:38.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:38 smithi196 ceph-mon[32572]: pgmap v2918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 561 B/s rd, 1 op/s 2024-04-26T13:02:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:38 smithi110 ceph-mon[28069]: pgmap v2918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 561 B/s rd, 1 op/s 2024-04-26T13:02:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:38 smithi193 ceph-mon[32782]: pgmap v2918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 561 B/s rd, 1 op/s 2024-04-26T13:02:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:40 smithi196 ceph-mon[32572]: pgmap v2919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:40 smithi110 ceph-mon[28069]: pgmap v2919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:40 smithi193 ceph-mon[32782]: pgmap v2919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:42 smithi196 ceph-mon[32572]: pgmap v2920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4476.844408 secs 2024-04-26T13:02:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:42 smithi110 ceph-mon[28069]: pgmap v2920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4476.844408 secs 2024-04-26T13:02:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:42 smithi193 ceph-mon[32782]: pgmap v2920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:02:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4476.844408 secs 2024-04-26T13:02:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:44 smithi196 ceph-mon[32572]: pgmap v2921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:02:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:44 smithi110 ceph-mon[28069]: pgmap v2921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:02:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:44 smithi193 ceph-mon[32782]: pgmap v2921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:02:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:46 smithi196 ceph-mon[32572]: pgmap v2922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:46 smithi110 ceph-mon[28069]: pgmap v2922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:46 smithi193 ceph-mon[32782]: pgmap v2922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4481.844523 secs 2024-04-26T13:02:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4481.844523 secs 2024-04-26T13:02:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4481.844523 secs 2024-04-26T13:02:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:48 smithi196 ceph-mon[32572]: pgmap v2923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:48 smithi110 ceph-mon[28069]: pgmap v2923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:48 smithi193 ceph-mon[32782]: pgmap v2923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:50 smithi196 ceph-mon[32572]: pgmap v2924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:50 smithi110 ceph-mon[28069]: pgmap v2924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:50 smithi193 ceph-mon[32782]: pgmap v2924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:52 smithi196 ceph-mon[32572]: pgmap v2925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4486.844641 secs 2024-04-26T13:02:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:52 smithi110 ceph-mon[28069]: pgmap v2925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4486.844641 secs 2024-04-26T13:02:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:52 smithi193 ceph-mon[32782]: pgmap v2925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4486.844641 secs 2024-04-26T13:02:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:54 smithi196 ceph-mon[32572]: pgmap v2926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:54 smithi110 ceph-mon[28069]: pgmap v2926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:54 smithi193 ceph-mon[32782]: pgmap v2926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:02:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:56 smithi110 ceph-mon[28069]: pgmap v2927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:56 smithi193 ceph-mon[32782]: pgmap v2927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:56 smithi196 ceph-mon[32572]: pgmap v2927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4491.844752 secs 2024-04-26T13:02:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4491.844752 secs 2024-04-26T13:02:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4491.844752 secs 2024-04-26T13:02:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:02:58 smithi110 ceph-mon[28069]: pgmap v2928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:02:58 smithi193 ceph-mon[32782]: pgmap v2928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:02:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:02:58 smithi196 ceph-mon[32572]: pgmap v2928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:00 smithi110 ceph-mon[28069]: pgmap v2929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:00 smithi193 ceph-mon[32782]: pgmap v2929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:00 smithi196 ceph-mon[32572]: pgmap v2929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:02 smithi110 ceph-mon[28069]: pgmap v2930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4496.844866 secs 2024-04-26T13:03:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:02 smithi193 ceph-mon[32782]: pgmap v2930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4496.844866 secs 2024-04-26T13:03:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:02 smithi196 ceph-mon[32572]: pgmap v2930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4496.844866 secs 2024-04-26T13:03:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:04 smithi110 ceph-mon[28069]: pgmap v2931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:04 smithi193 ceph-mon[32782]: pgmap v2931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:04 smithi196 ceph-mon[32572]: pgmap v2931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:06 smithi110 ceph-mon[28069]: pgmap v2932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:06 smithi193 ceph-mon[32782]: pgmap v2932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:06 smithi196 ceph-mon[32572]: pgmap v2932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4501.844999 secs 2024-04-26T13:03:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4501.844999 secs 2024-04-26T13:03:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4501.844999 secs 2024-04-26T13:03:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:08 smithi193 ceph-mon[32782]: pgmap v2933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:08 smithi196 ceph-mon[32572]: pgmap v2933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:08 smithi110 ceph-mon[28069]: pgmap v2933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:10 smithi193 ceph-mon[32782]: pgmap v2934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:10 smithi196 ceph-mon[32572]: pgmap v2934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:10 smithi110 ceph-mon[28069]: pgmap v2934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:11 smithi193 ceph-mon[32782]: pgmap v2935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:11 smithi196 ceph-mon[32572]: pgmap v2935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:11 smithi110 ceph-mon[28069]: pgmap v2935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4506.845097 secs 2024-04-26T13:03:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4506.845097 secs 2024-04-26T13:03:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4506.845097 secs 2024-04-26T13:03:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:13 smithi196 ceph-mon[32572]: pgmap v2936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:13 smithi110 ceph-mon[28069]: pgmap v2936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:13 smithi193 ceph-mon[32782]: pgmap v2936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.369+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 msgr2=0x7f26000b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T13:03:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.369+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 msgr2=0x7f26000b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T13:03:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.369+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 0x7f26000b1d40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2614029000 tx=0x7f2614018000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T13:03:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.369+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 0x7f26000b1d40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2614029000 tx=0x7f2614018000 comp rx=0 tx=0).stop 2024-04-26T13:03:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.369+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 msgr2=0x7f26000b1d40 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T13:03:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.369+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 msgr2=0x7f26000b1d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T13:03:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.369+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b1960 0x7f26000b1d40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T13:03:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.369+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T13:03:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:16 smithi193 ceph-mon[32782]: pgmap v2937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:16.371 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.370+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T13:03:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.372+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 0x7f26000b4670 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f261402d040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T13:03:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.394+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T13:03:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.394+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T13:03:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.394+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T13:03:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.394+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T13:03:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.395+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T13:03:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.396+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T13:03:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:16.396+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T13:03:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:16 smithi196 ceph-mon[32572]: pgmap v2937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:16 smithi110 ceph-mon[28069]: pgmap v2937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:17.080+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:03:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:17.080+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006320 con 0x7f261c104b50 2024-04-26T13:03:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:17.081+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 39 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006320 con 0x55db1be4fdd0 2024-04-26T13:03:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:03:17.081+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 39 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:03:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4511.845210 secs 2024-04-26T13:03:17.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4511.845210 secs 2024-04-26T13:03:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4511.845210 secs 2024-04-26T13:03:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:18 smithi193 ceph-mon[32782]: pgmap v2938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:18 smithi196 ceph-mon[32572]: pgmap v2938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:18 smithi110 ceph-mon[28069]: pgmap v2938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:20 smithi193 ceph-mon[32782]: pgmap v2939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:20 smithi196 ceph-mon[32572]: pgmap v2939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:20 smithi110 ceph-mon[28069]: pgmap v2939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:22 smithi193 ceph-mon[32782]: pgmap v2940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4516.845334 secs 2024-04-26T13:03:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:22 smithi196 ceph-mon[32572]: pgmap v2940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4516.845334 secs 2024-04-26T13:03:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:22 smithi110 ceph-mon[28069]: pgmap v2940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4516.845334 secs 2024-04-26T13:03:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:24 smithi196 ceph-mon[32572]: pgmap v2941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:24 smithi110 ceph-mon[28069]: pgmap v2941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:24 smithi193 ceph-mon[32782]: pgmap v2941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:26 smithi196 ceph-mon[32572]: pgmap v2942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:26 smithi110 ceph-mon[28069]: pgmap v2942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:26 smithi193 ceph-mon[32782]: pgmap v2942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4521.845475 secs 2024-04-26T13:03:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4521.845475 secs 2024-04-26T13:03:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4521.845475 secs 2024-04-26T13:03:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:28 smithi196 ceph-mon[32572]: pgmap v2943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:28 smithi110 ceph-mon[28069]: pgmap v2943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:28 smithi193 ceph-mon[32782]: pgmap v2943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:30 smithi196 ceph-mon[32572]: pgmap v2944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:30 smithi110 ceph-mon[28069]: pgmap v2944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:30 smithi193 ceph-mon[32782]: pgmap v2944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:32.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:32 smithi193 ceph-mon[32782]: pgmap v2945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:32.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4526.845594 secs 2024-04-26T13:03:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:32 smithi196 ceph-mon[32572]: pgmap v2945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4526.845594 secs 2024-04-26T13:03:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:32 smithi110 ceph-mon[28069]: pgmap v2945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4526.845594 secs 2024-04-26T13:03:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:34 smithi196 ceph-mon[32572]: pgmap v2946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:03:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:34 smithi110 ceph-mon[28069]: pgmap v2946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:34.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:03:34.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:34 smithi193 ceph-mon[32782]: pgmap v2946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:03:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:03:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:03:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:03:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:03:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:03:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:03:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:03:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:36 smithi196 ceph-mon[32572]: pgmap v2947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:03:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:36 smithi196 ceph-mon[32572]: pgmap v2948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:36 smithi110 ceph-mon[28069]: pgmap v2947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:03:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:36 smithi110 ceph-mon[28069]: pgmap v2948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:36 smithi193 ceph-mon[32782]: pgmap v2947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:03:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:36 smithi193 ceph-mon[32782]: pgmap v2948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4531.845675 secs 2024-04-26T13:03:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4531.845675 secs 2024-04-26T13:03:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4531.845675 secs 2024-04-26T13:03:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:38 smithi196 ceph-mon[32572]: pgmap v2949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:38 smithi110 ceph-mon[28069]: pgmap v2949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:38 smithi193 ceph-mon[32782]: pgmap v2949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:40 smithi196 ceph-mon[32572]: pgmap v2950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:40 smithi110 ceph-mon[28069]: pgmap v2950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:40 smithi193 ceph-mon[32782]: pgmap v2950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:42 smithi196 ceph-mon[32572]: pgmap v2951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4536.845802 secs 2024-04-26T13:03:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:42 smithi110 ceph-mon[28069]: pgmap v2951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4536.845802 secs 2024-04-26T13:03:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:42 smithi193 ceph-mon[32782]: pgmap v2951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4536.845802 secs 2024-04-26T13:03:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:44 smithi196 ceph-mon[32572]: pgmap v2952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:44 smithi110 ceph-mon[28069]: pgmap v2952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:44 smithi193 ceph-mon[32782]: pgmap v2952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:03:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:46 smithi196 ceph-mon[32572]: pgmap v2953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:03:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:46 smithi110 ceph-mon[28069]: pgmap v2953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:03:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:46 smithi193 ceph-mon[32782]: pgmap v2953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:03:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4541.845917 secs 2024-04-26T13:03:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4541.845917 secs 2024-04-26T13:03:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4541.845917 secs 2024-04-26T13:03:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:48 smithi196 ceph-mon[32572]: pgmap v2954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:48 smithi110 ceph-mon[28069]: pgmap v2954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:48 smithi193 ceph-mon[32782]: pgmap v2954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:50 smithi196 ceph-mon[32572]: pgmap v2955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:50 smithi110 ceph-mon[28069]: pgmap v2955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:50 smithi193 ceph-mon[32782]: pgmap v2955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:52 smithi196 ceph-mon[32572]: pgmap v2956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4546.846009 secs 2024-04-26T13:03:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:52 smithi110 ceph-mon[28069]: pgmap v2956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4546.846009 secs 2024-04-26T13:03:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:52 smithi193 ceph-mon[32782]: pgmap v2956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4546.846009 secs 2024-04-26T13:03:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:54 smithi196 ceph-mon[32572]: pgmap v2957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:54 smithi110 ceph-mon[28069]: pgmap v2957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:54 smithi193 ceph-mon[32782]: pgmap v2957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:03:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:56 smithi196 ceph-mon[32572]: pgmap v2958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:56 smithi110 ceph-mon[28069]: pgmap v2958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:56 smithi193 ceph-mon[32782]: pgmap v2958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4551.846125 secs 2024-04-26T13:03:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4551.846125 secs 2024-04-26T13:03:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4551.846125 secs 2024-04-26T13:03:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:03:58 smithi196 ceph-mon[32572]: pgmap v2959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:03:58 smithi110 ceph-mon[28069]: pgmap v2959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:03:58 smithi193 ceph-mon[32782]: pgmap v2959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:00 smithi196 ceph-mon[32572]: pgmap v2960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:00 smithi110 ceph-mon[28069]: pgmap v2960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:00 smithi193 ceph-mon[32782]: pgmap v2960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:02 smithi110 ceph-mon[28069]: pgmap v2961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4556.846245 secs 2024-04-26T13:04:02.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:04:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:04:02.462+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:04:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:04:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:04:02.462+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:04:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:04:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:04:02.462+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:04:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:04:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:04:02.462+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:04:02.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:04:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:04:02.462+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:04:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:02 smithi193 ceph-mon[32782]: pgmap v2961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4556.846245 secs 2024-04-26T13:04:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:02 smithi196 ceph-mon[32572]: pgmap v2961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4556.846245 secs 2024-04-26T13:04:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:04 smithi110 ceph-mon[28069]: pgmap v2962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:04 smithi193 ceph-mon[32782]: pgmap v2962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:04 smithi196 ceph-mon[32572]: pgmap v2962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:06 smithi110 ceph-mon[28069]: pgmap v2963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:06 smithi193 ceph-mon[32782]: pgmap v2963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:06 smithi196 ceph-mon[32572]: pgmap v2963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4561.846363 secs 2024-04-26T13:04:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4561.846363 secs 2024-04-26T13:04:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4561.846363 secs 2024-04-26T13:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:08 smithi110 ceph-mon[28069]: pgmap v2964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:08 smithi193 ceph-mon[32782]: pgmap v2964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:08 smithi196 ceph-mon[32572]: pgmap v2964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:10 smithi110 ceph-mon[28069]: pgmap v2965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:10 smithi193 ceph-mon[32782]: pgmap v2965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:10 smithi196 ceph-mon[32572]: pgmap v2965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:12 smithi110 ceph-mon[28069]: pgmap v2966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4566.846439 secs 2024-04-26T13:04:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:12 smithi193 ceph-mon[32782]: pgmap v2966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4566.846439 secs 2024-04-26T13:04:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:12 smithi196 ceph-mon[32572]: pgmap v2966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4566.846439 secs 2024-04-26T13:04:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:14 smithi193 ceph-mon[32782]: pgmap v2967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:14 smithi196 ceph-mon[32572]: pgmap v2967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:14 smithi110 ceph-mon[28069]: pgmap v2967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:16 smithi193 ceph-mon[32782]: pgmap v2968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:16 smithi196 ceph-mon[32572]: pgmap v2968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:16 smithi110 ceph-mon[28069]: pgmap v2968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4571.846592 secs 2024-04-26T13:04:17.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4571.846592 secs 2024-04-26T13:04:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4571.846592 secs 2024-04-26T13:04:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:18 smithi193 ceph-mon[32782]: pgmap v2969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:18 smithi196 ceph-mon[32572]: pgmap v2969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:18 smithi110 ceph-mon[28069]: pgmap v2969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:20 smithi193 ceph-mon[32782]: pgmap v2970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:20 smithi196 ceph-mon[32572]: pgmap v2970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:20 smithi110 ceph-mon[28069]: pgmap v2970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:04:22.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:22 smithi110 ceph-mon[28069]: pgmap v2971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:22.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4576.846711 secs 2024-04-26T13:04:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:22 smithi193 ceph-mon[32782]: pgmap v2971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4576.846711 secs 2024-04-26T13:04:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:22 smithi196 ceph-mon[32572]: pgmap v2971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4576.846711 secs 2024-04-26T13:04:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:24 smithi193 ceph-mon[32782]: pgmap v2972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:24 smithi196 ceph-mon[32572]: pgmap v2972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:24 smithi110 ceph-mon[28069]: pgmap v2972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:26 smithi193 ceph-mon[32782]: pgmap v2973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:26 smithi196 ceph-mon[32572]: pgmap v2973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:26 smithi110 ceph-mon[28069]: pgmap v2973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4581.846822 secs 2024-04-26T13:04:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4581.846822 secs 2024-04-26T13:04:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4581.846822 secs 2024-04-26T13:04:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:28 smithi193 ceph-mon[32782]: pgmap v2974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:28 smithi196 ceph-mon[32572]: pgmap v2974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:28 smithi110 ceph-mon[28069]: pgmap v2974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:30 smithi193 ceph-mon[32782]: pgmap v2975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:30 smithi196 ceph-mon[32572]: pgmap v2975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:30 smithi110 ceph-mon[28069]: pgmap v2975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:32 smithi193 ceph-mon[32782]: pgmap v2976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4586.846937 secs 2024-04-26T13:04:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:32 smithi196 ceph-mon[32572]: pgmap v2976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4586.846937 secs 2024-04-26T13:04:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:32 smithi110 ceph-mon[28069]: pgmap v2976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4586.846937 secs 2024-04-26T13:04:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:34 smithi193 ceph-mon[32782]: pgmap v2977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:34 smithi196 ceph-mon[32572]: pgmap v2977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:34 smithi110 ceph-mon[28069]: pgmap v2977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:04:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:04:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:04:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:36 smithi110 ceph-mon[28069]: pgmap v2978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:36 smithi196 ceph-mon[32572]: pgmap v2978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:36 smithi193 ceph-mon[32782]: pgmap v2978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4591.847054 secs 2024-04-26T13:04:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4591.847054 secs 2024-04-26T13:04:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4591.847054 secs 2024-04-26T13:04:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: pgmap v2979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: pgmap v2979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: pgmap v2979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:38.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:39 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:04:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:39 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:04:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:39 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:04:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:39 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:04:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:39 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:04:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:39 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:04:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:39 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:04:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:39 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:04:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:39 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:04:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:39 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:04:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:39 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:04:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:39 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:04:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: pgmap v2980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:04:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: pgmap v2980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:04:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: pgmap v2980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:04:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:04:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:41 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:04:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:41 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:04:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:41 smithi196 ceph-mon[32572]: pgmap v2981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T13:04:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:41 smithi196 ceph-mon[32572]: pgmap v2982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:04:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:41 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:04:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:41 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:04:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:41 smithi110 ceph-mon[28069]: pgmap v2981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T13:04:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:41 smithi110 ceph-mon[28069]: pgmap v2982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:04:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:41 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:04:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:41 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:04:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:41 smithi193 ceph-mon[32782]: pgmap v2981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T13:04:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:41 smithi193 ceph-mon[32782]: pgmap v2982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:04:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4596.847189 secs 2024-04-26T13:04:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4596.847189 secs 2024-04-26T13:04:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4596.847189 secs 2024-04-26T13:04:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:43 smithi196 ceph-mon[32572]: pgmap v2983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:43 smithi110 ceph-mon[28069]: pgmap v2983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:43 smithi193 ceph-mon[32782]: pgmap v2983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:45 smithi196 ceph-mon[32572]: pgmap v2984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:45 smithi110 ceph-mon[28069]: pgmap v2984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:45 smithi193 ceph-mon[32782]: pgmap v2984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4601.847313 secs 2024-04-26T13:04:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:47 smithi196 ceph-mon[32572]: pgmap v2985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4601.847313 secs 2024-04-26T13:04:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:47 smithi110 ceph-mon[28069]: pgmap v2985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4601.847313 secs 2024-04-26T13:04:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:47 smithi193 ceph-mon[32782]: pgmap v2985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:49.746 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:49 smithi196 ceph-mon[32572]: pgmap v2986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:49 smithi110 ceph-mon[28069]: pgmap v2986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:49 smithi193 ceph-mon[32782]: pgmap v2986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:04:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:51 smithi196 ceph-mon[32572]: pgmap v2987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:04:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:51 smithi110 ceph-mon[28069]: pgmap v2987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:04:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:51 smithi193 ceph-mon[32782]: pgmap v2987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:04:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4606.847430 secs 2024-04-26T13:04:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4606.847430 secs 2024-04-26T13:04:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4606.847430 secs 2024-04-26T13:04:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:53 smithi196 ceph-mon[32572]: pgmap v2988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:53 smithi110 ceph-mon[28069]: pgmap v2988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:53 smithi193 ceph-mon[32782]: pgmap v2988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:55 smithi196 ceph-mon[32572]: pgmap v2989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:55 smithi110 ceph-mon[28069]: pgmap v2989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:55 smithi193 ceph-mon[32782]: pgmap v2989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4611.847548 secs 2024-04-26T13:04:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:57 smithi196 ceph-mon[32572]: pgmap v2990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4611.847548 secs 2024-04-26T13:04:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:57 smithi110 ceph-mon[28069]: pgmap v2990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4611.847548 secs 2024-04-26T13:04:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:57 smithi193 ceph-mon[32782]: pgmap v2990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:04:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:04:59 smithi196 ceph-mon[32572]: pgmap v2991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:04:59 smithi110 ceph-mon[28069]: pgmap v2991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:04:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:04:59 smithi193 ceph-mon[32782]: pgmap v2991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:01 smithi196 ceph-mon[32572]: pgmap v2992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:01 smithi110 ceph-mon[28069]: pgmap v2992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:01 smithi193 ceph-mon[32782]: pgmap v2992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4616.847651 secs 2024-04-26T13:05:02.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4616.847651 secs 2024-04-26T13:05:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4616.847651 secs 2024-04-26T13:05:03.788 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:03 smithi193 ceph-mon[32782]: pgmap v2993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:05:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:03 smithi110 ceph-mon[28069]: pgmap v2993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:05:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:03 smithi196 ceph-mon[32572]: pgmap v2993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:05:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:05 smithi110 ceph-mon[28069]: pgmap v2994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:05:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:05 smithi193 ceph-mon[32782]: pgmap v2994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:05:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:05 smithi196 ceph-mon[32572]: pgmap v2994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:05:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:06 smithi193 ceph-mon[32782]: pgmap v2995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:05:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:06 smithi196 ceph-mon[32572]: pgmap v2995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:05:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:06 smithi110 ceph-mon[28069]: pgmap v2995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:05:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4621.847761 secs 2024-04-26T13:05:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4621.847761 secs 2024-04-26T13:05:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4621.847761 secs 2024-04-26T13:05:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:08 smithi193 ceph-mon[32782]: pgmap v2996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:05:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:08 smithi196 ceph-mon[32572]: pgmap v2996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:05:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:08 smithi110 ceph-mon[28069]: pgmap v2996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:05:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:11 smithi193 ceph-mon[32782]: pgmap v2997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:05:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:11 smithi196 ceph-mon[32572]: pgmap v2997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:05:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:11 smithi110 ceph-mon[28069]: pgmap v2997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4626.847871 secs 2024-04-26T13:05:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4626.847871 secs 2024-04-26T13:05:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4626.847871 secs 2024-04-26T13:05:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:13 smithi193 ceph-mon[32782]: pgmap v2998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:13 smithi196 ceph-mon[32572]: pgmap v2998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:05:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:13 smithi110 ceph-mon[28069]: pgmap v2998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:05:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:15 smithi193 ceph-mon[32782]: pgmap v2999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:15 smithi196 ceph-mon[32572]: pgmap v2999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:15 smithi110 ceph-mon[28069]: pgmap v2999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4631.847981 secs 2024-04-26T13:05:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:17 smithi193 ceph-mon[32782]: pgmap v3000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4631.847981 secs 2024-04-26T13:05:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:17 smithi196 ceph-mon[32572]: pgmap v3000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4631.847981 secs 2024-04-26T13:05:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:17 smithi110 ceph-mon[28069]: pgmap v3000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:19 smithi193 ceph-mon[32782]: pgmap v3001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:19 smithi196 ceph-mon[32572]: pgmap v3001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:19 smithi110 ceph-mon[28069]: pgmap v3001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:21 smithi193 ceph-mon[32782]: pgmap v3002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:21 smithi196 ceph-mon[32572]: pgmap v3002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:21 smithi110 ceph-mon[28069]: pgmap v3002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4636.848055 secs 2024-04-26T13:05:22.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4636.848055 secs 2024-04-26T13:05:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4636.848055 secs 2024-04-26T13:05:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:23 smithi193 ceph-mon[32782]: pgmap v3003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:23 smithi196 ceph-mon[32572]: pgmap v3003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:23.901 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:23 smithi110 ceph-mon[28069]: pgmap v3003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:25 smithi193 ceph-mon[32782]: pgmap v3004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:25 smithi196 ceph-mon[32572]: pgmap v3004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:25 smithi110 ceph-mon[28069]: pgmap v3004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4641.848126 secs 2024-04-26T13:05:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:27 smithi193 ceph-mon[32782]: pgmap v3005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4641.848126 secs 2024-04-26T13:05:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:27 smithi196 ceph-mon[32572]: pgmap v3005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4641.848126 secs 2024-04-26T13:05:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:27 smithi110 ceph-mon[28069]: pgmap v3005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:29 smithi196 ceph-mon[32572]: pgmap v3006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:29 smithi110 ceph-mon[28069]: pgmap v3006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:29 smithi193 ceph-mon[32782]: pgmap v3006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:31 smithi196 ceph-mon[32572]: pgmap v3007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:31 smithi110 ceph-mon[28069]: pgmap v3007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:31 smithi193 ceph-mon[32782]: pgmap v3007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4646.848236 secs 2024-04-26T13:05:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4646.848236 secs 2024-04-26T13:05:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4646.848236 secs 2024-04-26T13:05:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:33 smithi196 ceph-mon[32572]: pgmap v3008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:33 smithi110 ceph-mon[28069]: pgmap v3008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:33 smithi193 ceph-mon[32782]: pgmap v3008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:35 smithi196 ceph-mon[32572]: pgmap v3009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:35 smithi110 ceph-mon[28069]: pgmap v3009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:35 smithi193 ceph-mon[32782]: pgmap v3009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4651.848349 secs 2024-04-26T13:05:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:37 smithi196 ceph-mon[32572]: pgmap v3010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4651.848349 secs 2024-04-26T13:05:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:37 smithi110 ceph-mon[28069]: pgmap v3010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4651.848349 secs 2024-04-26T13:05:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:37 smithi193 ceph-mon[32782]: pgmap v3010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:39 smithi196 ceph-mon[32572]: pgmap v3011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:39 smithi110 ceph-mon[28069]: pgmap v3011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:39 smithi193 ceph-mon[32782]: pgmap v3011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:41 smithi196 ceph-mon[32572]: pgmap v3012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:05:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:41 smithi110 ceph-mon[28069]: pgmap v3012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:05:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:41 smithi193 ceph-mon[32782]: pgmap v3012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:05:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4656.848451 secs 2024-04-26T13:05:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:05:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:05:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:05:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4656.848451 secs 2024-04-26T13:05:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:05:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:05:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:05:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4656.848451 secs 2024-04-26T13:05:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:05:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:05:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:05:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:43 smithi196 ceph-mon[32572]: pgmap v3013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:05:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:43 smithi196 ceph-mon[32572]: pgmap v3014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T13:05:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:43 smithi110 ceph-mon[28069]: pgmap v3013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:05:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:43 smithi110 ceph-mon[28069]: pgmap v3014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T13:05:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:43 smithi193 ceph-mon[32782]: pgmap v3013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:05:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:43 smithi193 ceph-mon[32782]: pgmap v3014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T13:05:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:45 smithi196 ceph-mon[32572]: pgmap v3015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:45 smithi110 ceph-mon[28069]: pgmap v3015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:45 smithi193 ceph-mon[32782]: pgmap v3015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:47 smithi196 ceph-mon[32572]: pgmap v3016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4661.848575 secs 2024-04-26T13:05:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:47 smithi110 ceph-mon[28069]: pgmap v3016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4661.848575 secs 2024-04-26T13:05:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:47 smithi193 ceph-mon[32782]: pgmap v3016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4661.848575 secs 2024-04-26T13:05:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:49 smithi196 ceph-mon[32572]: pgmap v3017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:49 smithi110 ceph-mon[28069]: pgmap v3017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:49 smithi193 ceph-mon[32782]: pgmap v3017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:51 smithi196 ceph-mon[32572]: pgmap v3018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:51 smithi110 ceph-mon[28069]: pgmap v3018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:51 smithi193 ceph-mon[32782]: pgmap v3018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:05:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4666.848707 secs 2024-04-26T13:05:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4666.848707 secs 2024-04-26T13:05:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4666.848707 secs 2024-04-26T13:05:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:53 smithi196 ceph-mon[32572]: pgmap v3019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:05:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:53 smithi110 ceph-mon[28069]: pgmap v3019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:05:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:53 smithi193 ceph-mon[32782]: pgmap v3019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:05:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:55 smithi196 ceph-mon[32572]: pgmap v3020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:55 smithi110 ceph-mon[28069]: pgmap v3020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:55 smithi193 ceph-mon[32782]: pgmap v3020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:57 smithi196 ceph-mon[32572]: pgmap v3021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4671.848824 secs 2024-04-26T13:05:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:57 smithi110 ceph-mon[28069]: pgmap v3021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4671.848824 secs 2024-04-26T13:05:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:57 smithi193 ceph-mon[32782]: pgmap v3021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:05:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4671.848824 secs 2024-04-26T13:05:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:05:59 smithi196 ceph-mon[32572]: pgmap v3022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:05:59 smithi110 ceph-mon[28069]: pgmap v3022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:05:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:05:59 smithi193 ceph-mon[32782]: pgmap v3022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:01 smithi196 ceph-mon[32572]: pgmap v3023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:01 smithi110 ceph-mon[28069]: pgmap v3023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:01 smithi193 ceph-mon[32782]: pgmap v3023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4676.848943 secs 2024-04-26T13:06:02.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4676.848943 secs 2024-04-26T13:06:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4676.848943 secs 2024-04-26T13:06:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:03 smithi196 ceph-mon[32572]: pgmap v3024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:03 smithi110 ceph-mon[28069]: pgmap v3024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:03 smithi193 ceph-mon[32782]: pgmap v3024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:05 smithi196 ceph-mon[32572]: pgmap v3025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:05 smithi110 ceph-mon[28069]: pgmap v3025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:05 smithi193 ceph-mon[32782]: pgmap v3025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:07 smithi196 ceph-mon[32572]: pgmap v3026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4681.849063 secs 2024-04-26T13:06:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:07 smithi110 ceph-mon[28069]: pgmap v3026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4681.849063 secs 2024-04-26T13:06:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:07 smithi193 ceph-mon[32782]: pgmap v3026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4681.849063 secs 2024-04-26T13:06:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:09 smithi196 ceph-mon[32572]: pgmap v3027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:09 smithi110 ceph-mon[28069]: pgmap v3027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:09 smithi193 ceph-mon[32782]: pgmap v3027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:11 smithi110 ceph-mon[28069]: pgmap v3028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:06:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:11 smithi193 ceph-mon[32782]: pgmap v3028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:06:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:11 smithi196 ceph-mon[32572]: pgmap v3028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:06:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4686.849181 secs 2024-04-26T13:06:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4686.849181 secs 2024-04-26T13:06:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4686.849181 secs 2024-04-26T13:06:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:13 smithi110 ceph-mon[28069]: pgmap v3029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:06:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:13 smithi193 ceph-mon[32782]: pgmap v3029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:06:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:13 smithi196 ceph-mon[32572]: pgmap v3029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:06:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:15 smithi110 ceph-mon[28069]: pgmap v3030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:15 smithi193 ceph-mon[32782]: pgmap v3030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:15 smithi196 ceph-mon[32572]: pgmap v3030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:06:17.110+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:06:17.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:06:17.110+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006320 con 0x7f261c104b50 2024-04-26T13:06:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:06:17.111+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 40 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:06:17.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:06:17.111+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 40 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006320 con 0x55db1be4fdd0 2024-04-26T13:06:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:17 smithi110 ceph-mon[28069]: pgmap v3031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:06:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4691.849301 secs 2024-04-26T13:06:17.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:17 smithi196 ceph-mon[32572]: pgmap v3031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:06:17.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4691.849301 secs 2024-04-26T13:06:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:17 smithi193 ceph-mon[32782]: pgmap v3031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:06:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4691.849301 secs 2024-04-26T13:06:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:19 smithi110 ceph-mon[28069]: pgmap v3032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:19 smithi193 ceph-mon[32782]: pgmap v3032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:19 smithi196 ceph-mon[32572]: pgmap v3032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:21 smithi193 ceph-mon[32782]: pgmap v3033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:21 smithi196 ceph-mon[32572]: pgmap v3033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:21 smithi110 ceph-mon[28069]: pgmap v3033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4696.849417 secs 2024-04-26T13:06:22.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4696.849417 secs 2024-04-26T13:06:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4696.849417 secs 2024-04-26T13:06:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:23 smithi193 ceph-mon[32782]: pgmap v3034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:23 smithi196 ceph-mon[32572]: pgmap v3034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:23 smithi110 ceph-mon[28069]: pgmap v3034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:25 smithi193 ceph-mon[32782]: pgmap v3035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:25 smithi196 ceph-mon[32572]: pgmap v3035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:25 smithi110 ceph-mon[28069]: pgmap v3035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:27 smithi193 ceph-mon[32782]: pgmap v3036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4701.849535 secs 2024-04-26T13:06:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:27 smithi196 ceph-mon[32572]: pgmap v3036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4701.849535 secs 2024-04-26T13:06:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:27 smithi110 ceph-mon[28069]: pgmap v3036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4701.849535 secs 2024-04-26T13:06:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:29 smithi193 ceph-mon[32782]: pgmap v3037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:29 smithi196 ceph-mon[32572]: pgmap v3037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:29 smithi110 ceph-mon[28069]: pgmap v3037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:31 smithi193 ceph-mon[32782]: pgmap v3038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:31 smithi196 ceph-mon[32572]: pgmap v3038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:31 smithi110 ceph-mon[28069]: pgmap v3038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4706.849651 secs 2024-04-26T13:06:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4706.849651 secs 2024-04-26T13:06:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4706.849651 secs 2024-04-26T13:06:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:33 smithi193 ceph-mon[32782]: pgmap v3039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:33 smithi196 ceph-mon[32572]: pgmap v3039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:33 smithi110 ceph-mon[28069]: pgmap v3039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:35 smithi193 ceph-mon[32782]: pgmap v3040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:35 smithi196 ceph-mon[32572]: pgmap v3040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:35 smithi110 ceph-mon[28069]: pgmap v3040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:37 smithi193 ceph-mon[32782]: pgmap v3041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4711.849786 secs 2024-04-26T13:06:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:37 smithi196 ceph-mon[32572]: pgmap v3041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4711.849786 secs 2024-04-26T13:06:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:37 smithi110 ceph-mon[28069]: pgmap v3041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4711.849786 secs 2024-04-26T13:06:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:38 smithi196 ceph-mon[32572]: pgmap v3042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:38 smithi110 ceph-mon[28069]: pgmap v3042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:38 smithi193 ceph-mon[32782]: pgmap v3042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:40 smithi196 ceph-mon[32572]: pgmap v3043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:40 smithi110 ceph-mon[28069]: pgmap v3043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:40 smithi193 ceph-mon[32782]: pgmap v3043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4716.849865 secs 2024-04-26T13:06:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4716.849865 secs 2024-04-26T13:06:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4716.849865 secs 2024-04-26T13:06:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:42 smithi196 ceph-mon[32572]: pgmap v3044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:06:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:42 smithi110 ceph-mon[28069]: pgmap v3044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:06:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:42 smithi193 ceph-mon[32782]: pgmap v3044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:06:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:06:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:06:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:44 smithi110 ceph-mon[28069]: pgmap v3045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:06:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:44 smithi110 ceph-mon[28069]: pgmap v3046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:06:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:06:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:06:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:44 smithi193 ceph-mon[32782]: pgmap v3045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:06:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:44 smithi193 ceph-mon[32782]: pgmap v3046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:06:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:06:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:06:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:44 smithi196 ceph-mon[32572]: pgmap v3045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:06:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:44 smithi196 ceph-mon[32572]: pgmap v3046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:06:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:46 smithi196 ceph-mon[32572]: pgmap v3047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:46 smithi110 ceph-mon[28069]: pgmap v3047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:46 smithi193 ceph-mon[32782]: pgmap v3047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4721.849944 secs 2024-04-26T13:06:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4721.849944 secs 2024-04-26T13:06:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4721.849944 secs 2024-04-26T13:06:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:48 smithi196 ceph-mon[32572]: pgmap v3048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:48 smithi110 ceph-mon[28069]: pgmap v3048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:48 smithi193 ceph-mon[32782]: pgmap v3048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:50 smithi196 ceph-mon[32572]: pgmap v3049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:50 smithi110 ceph-mon[28069]: pgmap v3049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:50 smithi193 ceph-mon[32782]: pgmap v3049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4726.850062 secs 2024-04-26T13:06:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:52 smithi196 ceph-mon[32572]: pgmap v3050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4726.850062 secs 2024-04-26T13:06:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:52 smithi110 ceph-mon[28069]: pgmap v3050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4726.850062 secs 2024-04-26T13:06:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:52 smithi193 ceph-mon[32782]: pgmap v3050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:06:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:54 smithi110 ceph-mon[28069]: pgmap v3051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:06:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:54 smithi196 ceph-mon[32572]: pgmap v3051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:06:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:54 smithi193 ceph-mon[32782]: pgmap v3051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:06:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:56 smithi110 ceph-mon[28069]: pgmap v3052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:56 smithi193 ceph-mon[32782]: pgmap v3052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:56 smithi196 ceph-mon[32572]: pgmap v3052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:06:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4731.850196 secs 2024-04-26T13:06:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4731.850196 secs 2024-04-26T13:06:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4731.850196 secs 2024-04-26T13:06:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:06:58 smithi110 ceph-mon[28069]: pgmap v3053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:06:58 smithi193 ceph-mon[32782]: pgmap v3053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:06:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:06:58 smithi196 ceph-mon[32572]: pgmap v3053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:00 smithi110 ceph-mon[28069]: pgmap v3054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:00 smithi193 ceph-mon[32782]: pgmap v3054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:00 smithi196 ceph-mon[32572]: pgmap v3054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 4736.850293 secs 2024-04-26T13:07:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:02 smithi110 ceph-mon[28069]: pgmap v3055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 4736.850293 secs 2024-04-26T13:07:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:02 smithi193 ceph-mon[32782]: pgmap v3055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:03.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 4736.850293 secs 2024-04-26T13:07:03.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:02 smithi196 ceph-mon[32572]: pgmap v3055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:04 smithi110 ceph-mon[28069]: pgmap v3056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:04 smithi193 ceph-mon[32782]: pgmap v3056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:04 smithi196 ceph-mon[32572]: pgmap v3056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:06 smithi193 ceph-mon[32782]: pgmap v3057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:06 smithi196 ceph-mon[32572]: pgmap v3057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:06 smithi110 ceph-mon[28069]: pgmap v3057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:07 smithi193 ceph-mon[32782]: 5 slow requests, 1 included below; oldest blocked for > 4741.850410 secs 2024-04-26T13:07:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:07 smithi193 ceph-mon[32782]: slow request 183.678009 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T13:07:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:07 smithi196 ceph-mon[32572]: 5 slow requests, 1 included below; oldest blocked for > 4741.850410 secs 2024-04-26T13:07:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:07 smithi196 ceph-mon[32572]: slow request 183.678009 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T13:07:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:07 smithi110 ceph-mon[28069]: 5 slow requests, 1 included below; oldest blocked for > 4741.850410 secs 2024-04-26T13:07:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:07 smithi110 ceph-mon[28069]: slow request 183.678009 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T13:07:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:08 smithi193 ceph-mon[32782]: pgmap v3058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:08 smithi196 ceph-mon[32572]: pgmap v3058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:08 smithi110 ceph-mon[28069]: pgmap v3058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T13:07:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:09 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T13:07:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T13:07:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:09 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T13:07:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T13:07:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:09 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T13:07:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:10 smithi193 ceph-mon[32782]: pgmap v3059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:10 smithi196 ceph-mon[32572]: pgmap v3059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:10 smithi110 ceph-mon[28069]: pgmap v3059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4746.850520 secs 2024-04-26T13:07:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:12 smithi193 ceph-mon[32782]: pgmap v3060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4746.850520 secs 2024-04-26T13:07:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:12 smithi196 ceph-mon[32572]: pgmap v3060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4746.850520 secs 2024-04-26T13:07:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:12 smithi110 ceph-mon[28069]: pgmap v3060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:14 smithi193 ceph-mon[32782]: pgmap v3061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:14 smithi196 ceph-mon[32572]: pgmap v3061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:14 smithi110 ceph-mon[28069]: pgmap v3061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:16 smithi193 ceph-mon[32782]: pgmap v3062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:16 smithi196 ceph-mon[32572]: pgmap v3062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:16 smithi110 ceph-mon[28069]: pgmap v3062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4751.850634 secs 2024-04-26T13:07:17.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4751.850634 secs 2024-04-26T13:07:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4751.850634 secs 2024-04-26T13:07:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:18 smithi193 ceph-mon[32782]: pgmap v3063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:18 smithi196 ceph-mon[32572]: pgmap v3063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:18 smithi110 ceph-mon[28069]: pgmap v3063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:20 smithi193 ceph-mon[32782]: pgmap v3064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:20 smithi196 ceph-mon[32572]: pgmap v3064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:20 smithi110 ceph-mon[28069]: pgmap v3064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:21 smithi193 ceph-mon[32782]: pgmap v3065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:21 smithi196 ceph-mon[32572]: pgmap v3065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:21 smithi110 ceph-mon[28069]: pgmap v3065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4756.850734 secs 2024-04-26T13:07:22.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4756.850734 secs 2024-04-26T13:07:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4756.850734 secs 2024-04-26T13:07:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:23 smithi196 ceph-mon[32572]: pgmap v3066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:23 smithi110 ceph-mon[28069]: pgmap v3066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:23 smithi193 ceph-mon[32782]: pgmap v3066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:26 smithi196 ceph-mon[32572]: pgmap v3067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:26 smithi110 ceph-mon[28069]: pgmap v3067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:26 smithi193 ceph-mon[32782]: pgmap v3067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4761.850824 secs 2024-04-26T13:07:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4761.850824 secs 2024-04-26T13:07:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4761.850824 secs 2024-04-26T13:07:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:28 smithi110 ceph-mon[28069]: pgmap v3068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:28 smithi193 ceph-mon[32782]: pgmap v3068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:28 smithi196 ceph-mon[32572]: pgmap v3068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:30 smithi110 ceph-mon[28069]: pgmap v3069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:30 smithi193 ceph-mon[32782]: pgmap v3069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:30 smithi196 ceph-mon[32572]: pgmap v3069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4766.850936 secs 2024-04-26T13:07:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:32 smithi110 ceph-mon[28069]: pgmap v3070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4766.850936 secs 2024-04-26T13:07:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:32 smithi193 ceph-mon[32782]: pgmap v3070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4766.850936 secs 2024-04-26T13:07:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:32 smithi196 ceph-mon[32572]: pgmap v3070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:34 smithi110 ceph-mon[28069]: pgmap v3071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:34 smithi193 ceph-mon[32782]: pgmap v3071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:34 smithi196 ceph-mon[32572]: pgmap v3071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:36 smithi110 ceph-mon[28069]: pgmap v3072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:36 smithi193 ceph-mon[32782]: pgmap v3072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:36 smithi196 ceph-mon[32572]: pgmap v3072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4771.851031 secs 2024-04-26T13:07:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4771.851031 secs 2024-04-26T13:07:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4771.851031 secs 2024-04-26T13:07:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:38 smithi193 ceph-mon[32782]: pgmap v3073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:38 smithi196 ceph-mon[32572]: pgmap v3073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:38 smithi110 ceph-mon[28069]: pgmap v3073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:40 smithi193 ceph-mon[32782]: pgmap v3074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:40 smithi196 ceph-mon[32572]: pgmap v3074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:40 smithi110 ceph-mon[28069]: pgmap v3074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4776.851169 secs 2024-04-26T13:07:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:42 smithi193 ceph-mon[32782]: pgmap v3075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4776.851169 secs 2024-04-26T13:07:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:42 smithi196 ceph-mon[32572]: pgmap v3075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4776.851169 secs 2024-04-26T13:07:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:42 smithi110 ceph-mon[28069]: pgmap v3075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:44 smithi193 ceph-mon[32782]: pgmap v3076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:07:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:44 smithi196 ceph-mon[32572]: pgmap v3076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:07:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:44 smithi110 ceph-mon[28069]: pgmap v3076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:07:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:07:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:07:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:07:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:07:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:07:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:07:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:07:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:07:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:07:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:07:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:46 smithi193 ceph-mon[32782]: pgmap v3077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:07:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:46 smithi193 ceph-mon[32782]: pgmap v3078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:46 smithi196 ceph-mon[32572]: pgmap v3077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:07:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:46 smithi196 ceph-mon[32572]: pgmap v3078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:46 smithi110 ceph-mon[28069]: pgmap v3077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:07:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:46 smithi110 ceph-mon[28069]: pgmap v3078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4781.851288 secs 2024-04-26T13:07:47.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4781.851288 secs 2024-04-26T13:07:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4781.851288 secs 2024-04-26T13:07:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:48 smithi193 ceph-mon[32782]: pgmap v3079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:07:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:48 smithi196 ceph-mon[32572]: pgmap v3079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:07:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:48 smithi110 ceph-mon[28069]: pgmap v3079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:07:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:50 smithi193 ceph-mon[32782]: pgmap v3080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:50 smithi196 ceph-mon[32572]: pgmap v3080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:51.077 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:50 smithi110 ceph-mon[28069]: pgmap v3080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:52.845 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:52 smithi110 ceph-mon[28069]: pgmap v3081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:52.845 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4786.851425 secs 2024-04-26T13:07:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:52 smithi193 ceph-mon[32782]: pgmap v3081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4786.851425 secs 2024-04-26T13:07:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:52 smithi196 ceph-mon[32572]: pgmap v3081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4786.851425 secs 2024-04-26T13:07:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:54 smithi193 ceph-mon[32782]: pgmap v3082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:54 smithi196 ceph-mon[32572]: pgmap v3082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:54 smithi110 ceph-mon[28069]: pgmap v3082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:07:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:56 smithi193 ceph-mon[32782]: pgmap v3083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:07:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:56 smithi196 ceph-mon[32572]: pgmap v3083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:07:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:56 smithi110 ceph-mon[28069]: pgmap v3083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:07:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4791.851557 secs 2024-04-26T13:07:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4791.851557 secs 2024-04-26T13:07:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4791.851557 secs 2024-04-26T13:07:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:58 smithi193 ceph-mon[32782]: pgmap v3084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:58 smithi196 ceph-mon[32572]: pgmap v3084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:07:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:58 smithi110 ceph-mon[28069]: pgmap v3084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:07:59 smithi196 ceph-mon[32572]: pgmap v3085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:07:59 smithi110 ceph-mon[28069]: pgmap v3085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:07:59 smithi193 ceph-mon[32782]: pgmap v3085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:01 smithi196 ceph-mon[32572]: pgmap v3086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:01 smithi110 ceph-mon[28069]: pgmap v3086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:01 smithi193 ceph-mon[32782]: pgmap v3086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4796.851683 secs 2024-04-26T13:08:03.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4796.851683 secs 2024-04-26T13:08:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4796.851683 secs 2024-04-26T13:08:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:03 smithi196 ceph-mon[32572]: pgmap v3087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:03 smithi110 ceph-mon[28069]: pgmap v3087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:03 smithi193 ceph-mon[32782]: pgmap v3087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:05 smithi196 ceph-mon[32572]: pgmap v3088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:05 smithi110 ceph-mon[28069]: pgmap v3088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:05 smithi193 ceph-mon[32782]: pgmap v3088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4801.851802 secs 2024-04-26T13:08:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4801.851802 secs 2024-04-26T13:08:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4801.851802 secs 2024-04-26T13:08:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:08 smithi110 ceph-mon[28069]: pgmap v3089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:08 smithi193 ceph-mon[32782]: pgmap v3089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:08 smithi196 ceph-mon[32572]: pgmap v3089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:10 smithi110 ceph-mon[28069]: pgmap v3090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:10 smithi193 ceph-mon[32782]: pgmap v3090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:10 smithi196 ceph-mon[32572]: pgmap v3090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:12 smithi110 ceph-mon[28069]: pgmap v3091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4806.851924 secs 2024-04-26T13:08:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:12 smithi193 ceph-mon[32782]: pgmap v3091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4806.851924 secs 2024-04-26T13:08:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:12 smithi196 ceph-mon[32572]: pgmap v3091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4806.851924 secs 2024-04-26T13:08:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:14 smithi110 ceph-mon[28069]: pgmap v3092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:14 smithi193 ceph-mon[32782]: pgmap v3092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:14 smithi196 ceph-mon[32572]: pgmap v3092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:16 smithi110 ceph-mon[28069]: pgmap v3093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:16 smithi193 ceph-mon[32782]: pgmap v3093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:16 smithi196 ceph-mon[32572]: pgmap v3093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4811.851998 secs 2024-04-26T13:08:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4811.851998 secs 2024-04-26T13:08:17.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4811.851998 secs 2024-04-26T13:08:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:18 smithi110 ceph-mon[28069]: pgmap v3094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:18 smithi193 ceph-mon[32782]: pgmap v3094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:18 smithi196 ceph-mon[32572]: pgmap v3094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:20 smithi193 ceph-mon[32782]: pgmap v3095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:20 smithi196 ceph-mon[32572]: pgmap v3095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:20 smithi110 ceph-mon[28069]: pgmap v3095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:22.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:22 smithi110 ceph-mon[28069]: pgmap v3096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:22.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4816.852121 secs 2024-04-26T13:08:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:22 smithi193 ceph-mon[32782]: pgmap v3096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4816.852121 secs 2024-04-26T13:08:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:22 smithi196 ceph-mon[32572]: pgmap v3096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4816.852121 secs 2024-04-26T13:08:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:24 smithi193 ceph-mon[32782]: pgmap v3097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:24 smithi196 ceph-mon[32572]: pgmap v3097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:24 smithi110 ceph-mon[28069]: pgmap v3097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:26 smithi193 ceph-mon[32782]: pgmap v3098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:26 smithi196 ceph-mon[32572]: pgmap v3098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:26 smithi110 ceph-mon[28069]: pgmap v3098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4821.852260 secs 2024-04-26T13:08:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4821.852260 secs 2024-04-26T13:08:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4821.852260 secs 2024-04-26T13:08:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:28 smithi193 ceph-mon[32782]: pgmap v3099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:28 smithi196 ceph-mon[32572]: pgmap v3099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:28 smithi110 ceph-mon[28069]: pgmap v3099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:30 smithi193 ceph-mon[32782]: pgmap v3100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:30 smithi196 ceph-mon[32572]: pgmap v3100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:30 smithi110 ceph-mon[28069]: pgmap v3100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:32 smithi193 ceph-mon[32782]: pgmap v3101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4826.852384 secs 2024-04-26T13:08:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:32 smithi196 ceph-mon[32572]: pgmap v3101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4826.852384 secs 2024-04-26T13:08:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:32 smithi110 ceph-mon[28069]: pgmap v3101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4826.852384 secs 2024-04-26T13:08:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:34 smithi193 ceph-mon[32782]: pgmap v3102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:34 smithi196 ceph-mon[32572]: pgmap v3102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:34 smithi110 ceph-mon[28069]: pgmap v3102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:36 smithi193 ceph-mon[32782]: pgmap v3103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:36 smithi196 ceph-mon[32572]: pgmap v3103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:36 smithi110 ceph-mon[28069]: pgmap v3103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4831.852518 secs 2024-04-26T13:08:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4831.852518 secs 2024-04-26T13:08:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4831.852518 secs 2024-04-26T13:08:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:38 smithi193 ceph-mon[32782]: pgmap v3104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:38 smithi196 ceph-mon[32572]: pgmap v3104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:38 smithi110 ceph-mon[28069]: pgmap v3104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:40 smithi193 ceph-mon[32782]: pgmap v3105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:40 smithi196 ceph-mon[32572]: pgmap v3105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:40 smithi110 ceph-mon[28069]: pgmap v3105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:42 smithi193 ceph-mon[32782]: pgmap v3106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4836.852635 secs 2024-04-26T13:08:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:42 smithi196 ceph-mon[32572]: pgmap v3106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4836.852635 secs 2024-04-26T13:08:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:42 smithi110 ceph-mon[28069]: pgmap v3106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4836.852635 secs 2024-04-26T13:08:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:44 smithi193 ceph-mon[32782]: pgmap v3107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:44 smithi196 ceph-mon[32572]: pgmap v3107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:44 smithi110 ceph-mon[28069]: pgmap v3107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:08:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:46 smithi196 ceph-mon[32572]: pgmap v3108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:08:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:46 smithi110 ceph-mon[28069]: pgmap v3108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:08:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:46 smithi193 ceph-mon[32782]: pgmap v3108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:08:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:08:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4841.852771 secs 2024-04-26T13:08:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:08:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:08:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:47 smithi196 ceph-mon[32572]: pgmap v3109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T13:08:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:47 smithi196 ceph-mon[32572]: pgmap v3110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:08:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4841.852771 secs 2024-04-26T13:08:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:08:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:08:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:47 smithi110 ceph-mon[28069]: pgmap v3109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T13:08:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:47 smithi110 ceph-mon[28069]: pgmap v3110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:08:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4841.852771 secs 2024-04-26T13:08:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:08:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:08:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:47 smithi193 ceph-mon[32782]: pgmap v3109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T13:08:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:47 smithi193 ceph-mon[32782]: pgmap v3110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:08:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:49 smithi196 ceph-mon[32572]: pgmap v3111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:49 smithi110 ceph-mon[28069]: pgmap v3111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:49 smithi193 ceph-mon[32782]: pgmap v3111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:51 smithi110 ceph-mon[28069]: pgmap v3112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:51 smithi193 ceph-mon[32782]: pgmap v3112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:51 smithi196 ceph-mon[32572]: pgmap v3112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4846.852863 secs 2024-04-26T13:08:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4846.852863 secs 2024-04-26T13:08:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4846.852863 secs 2024-04-26T13:08:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:53 smithi110 ceph-mon[28069]: pgmap v3113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:53 smithi193 ceph-mon[32782]: pgmap v3113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:53 smithi196 ceph-mon[32572]: pgmap v3113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:55 smithi110 ceph-mon[28069]: pgmap v3114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:55 smithi193 ceph-mon[32782]: pgmap v3114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:55 smithi196 ceph-mon[32572]: pgmap v3114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:08:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4851.852986 secs 2024-04-26T13:08:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:57 smithi193 ceph-mon[32782]: pgmap v3115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:08:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4851.852986 secs 2024-04-26T13:08:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:57 smithi196 ceph-mon[32572]: pgmap v3115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:08:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4851.852986 secs 2024-04-26T13:08:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:57 smithi110 ceph-mon[28069]: pgmap v3115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:08:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:08:59 smithi193 ceph-mon[32782]: pgmap v3116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:08:59 smithi196 ceph-mon[32572]: pgmap v3116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:08:59 smithi110 ceph-mon[28069]: pgmap v3116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:01 smithi193 ceph-mon[32782]: pgmap v3117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:01 smithi196 ceph-mon[32572]: pgmap v3117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:01 smithi110 ceph-mon[28069]: pgmap v3117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4856.853055 secs 2024-04-26T13:09:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4856.853055 secs 2024-04-26T13:09:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4856.853055 secs 2024-04-26T13:09:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:09:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:09:02.557+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:09:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:09:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:09:02.557+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:09:03.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:09:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:09:02.557+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:09:03.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:09:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:09:02.557+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:09:03.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:09:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:09:02.557+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:09:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:03 smithi193 ceph-mon[32782]: pgmap v3118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:03 smithi196 ceph-mon[32572]: pgmap v3118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:03 smithi110 ceph-mon[28069]: pgmap v3118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:05 smithi193 ceph-mon[32782]: pgmap v3119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:05 smithi196 ceph-mon[32572]: pgmap v3119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:05 smithi110 ceph-mon[28069]: pgmap v3119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4861.853173 secs 2024-04-26T13:09:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:07 smithi193 ceph-mon[32782]: pgmap v3120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4861.853173 secs 2024-04-26T13:09:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:07 smithi196 ceph-mon[32572]: pgmap v3120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4861.853173 secs 2024-04-26T13:09:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:07 smithi110 ceph-mon[28069]: pgmap v3120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:09 smithi193 ceph-mon[32782]: pgmap v3121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:09:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:09 smithi196 ceph-mon[32572]: pgmap v3121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:09:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:09 smithi110 ceph-mon[28069]: pgmap v3121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:09:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:11 smithi193 ceph-mon[32782]: pgmap v3122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:09:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:11 smithi196 ceph-mon[32572]: pgmap v3122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:09:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:11 smithi110 ceph-mon[28069]: pgmap v3122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:09:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4866.853293 secs 2024-04-26T13:09:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4866.853293 secs 2024-04-26T13:09:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4866.853293 secs 2024-04-26T13:09:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:13 smithi193 ceph-mon[32782]: pgmap v3123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:09:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:13 smithi196 ceph-mon[32572]: pgmap v3123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:09:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:13 smithi110 ceph-mon[28069]: pgmap v3123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:09:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:15 smithi193 ceph-mon[32782]: pgmap v3124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:09:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:15 smithi196 ceph-mon[32572]: pgmap v3124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:09:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:15 smithi110 ceph-mon[28069]: pgmap v3124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:09:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:09:17.141+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006320 con 0x7f261c104b50 2024-04-26T13:09:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:09:17.141+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:09:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:09:17.141+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 41 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:09:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:09:17.141+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 41 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006320 con 0x55db1be4fdd0 2024-04-26T13:09:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4871.853409 secs 2024-04-26T13:09:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:17 smithi193 ceph-mon[32782]: pgmap v3125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:09:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4871.853409 secs 2024-04-26T13:09:18.028 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:17 smithi196 ceph-mon[32572]: pgmap v3125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:09:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4871.853409 secs 2024-04-26T13:09:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:17 smithi110 ceph-mon[28069]: pgmap v3125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:09:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:19 smithi193 ceph-mon[32782]: pgmap v3126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:09:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:19 smithi196 ceph-mon[32572]: pgmap v3126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:09:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:19 smithi110 ceph-mon[28069]: pgmap v3126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:09:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:21 smithi193 ceph-mon[32782]: pgmap v3127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:21 smithi196 ceph-mon[32572]: pgmap v3127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:21 smithi110 ceph-mon[28069]: pgmap v3127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4876.853532 secs 2024-04-26T13:09:22.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4876.853532 secs 2024-04-26T13:09:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4876.853532 secs 2024-04-26T13:09:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:23 smithi196 ceph-mon[32572]: pgmap v3128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:23 smithi110 ceph-mon[28069]: pgmap v3128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:23 smithi193 ceph-mon[32782]: pgmap v3128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:24 smithi196 ceph-mon[32572]: pgmap v3129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:24 smithi110 ceph-mon[28069]: pgmap v3129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:24 smithi193 ceph-mon[32782]: pgmap v3129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4881.853582 secs 2024-04-26T13:09:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:27 smithi110 ceph-mon[28069]: pgmap v3130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4881.853582 secs 2024-04-26T13:09:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:27 smithi193 ceph-mon[32782]: pgmap v3130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4881.853582 secs 2024-04-26T13:09:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:27 smithi196 ceph-mon[32572]: pgmap v3130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:29 smithi110 ceph-mon[28069]: pgmap v3131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:29 smithi193 ceph-mon[32782]: pgmap v3131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:29 smithi196 ceph-mon[32572]: pgmap v3131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:31 smithi110 ceph-mon[28069]: pgmap v3132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:31 smithi193 ceph-mon[32782]: pgmap v3132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:31 smithi196 ceph-mon[32572]: pgmap v3132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4886.853663 secs 2024-04-26T13:09:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4886.853663 secs 2024-04-26T13:09:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4886.853663 secs 2024-04-26T13:09:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:33 smithi193 ceph-mon[32782]: pgmap v3133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:33 smithi196 ceph-mon[32572]: pgmap v3133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:33 smithi110 ceph-mon[28069]: pgmap v3133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:35 smithi193 ceph-mon[32782]: pgmap v3134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:35 smithi196 ceph-mon[32572]: pgmap v3134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:35 smithi110 ceph-mon[28069]: pgmap v3134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4891.853755 secs 2024-04-26T13:09:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:37 smithi193 ceph-mon[32782]: pgmap v3135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4891.853755 secs 2024-04-26T13:09:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:37 smithi196 ceph-mon[32572]: pgmap v3135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4891.853755 secs 2024-04-26T13:09:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:37 smithi110 ceph-mon[28069]: pgmap v3135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:39 smithi193 ceph-mon[32782]: pgmap v3136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:39 smithi196 ceph-mon[32572]: pgmap v3136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:39 smithi110 ceph-mon[28069]: pgmap v3136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:41 smithi193 ceph-mon[32782]: pgmap v3137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:41 smithi196 ceph-mon[32572]: pgmap v3137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:41 smithi110 ceph-mon[28069]: pgmap v3137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4896.853885 secs 2024-04-26T13:09:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4896.853885 secs 2024-04-26T13:09:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4896.853885 secs 2024-04-26T13:09:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:43 smithi193 ceph-mon[32782]: pgmap v3138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:43 smithi196 ceph-mon[32572]: pgmap v3138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:43 smithi110 ceph-mon[28069]: pgmap v3138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:09:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:45 smithi193 ceph-mon[32782]: pgmap v3139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:45 smithi196 ceph-mon[32572]: pgmap v3139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:45 smithi110 ceph-mon[28069]: pgmap v3139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4901.853985 secs 2024-04-26T13:09:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:47 smithi193 ceph-mon[32782]: pgmap v3140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:09:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4901.853985 secs 2024-04-26T13:09:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:47 smithi196 ceph-mon[32572]: pgmap v3140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:09:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4901.853985 secs 2024-04-26T13:09:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:47 smithi110 ceph-mon[28069]: pgmap v3140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:09:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:09:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:09:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:09:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:09:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:09:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:09:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:09:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:09:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:09:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:09:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:49 smithi193 ceph-mon[32782]: pgmap v3141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:09:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:49 smithi193 ceph-mon[32782]: pgmap v3142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:50.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:49 smithi196 ceph-mon[32572]: pgmap v3141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:09:50.008 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:49 smithi196 ceph-mon[32572]: pgmap v3142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:49 smithi110 ceph-mon[28069]: pgmap v3141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:09:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:49 smithi110 ceph-mon[28069]: pgmap v3142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:51 smithi193 ceph-mon[32782]: pgmap v3143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:51 smithi196 ceph-mon[32572]: pgmap v3143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:51 smithi110 ceph-mon[28069]: pgmap v3143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4906.854104 secs 2024-04-26T13:09:52.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4906.854104 secs 2024-04-26T13:09:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4906.854104 secs 2024-04-26T13:09:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:53 smithi193 ceph-mon[32782]: pgmap v3144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:09:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:53 smithi196 ceph-mon[32572]: pgmap v3144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:09:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:53 smithi110 ceph-mon[28069]: pgmap v3144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:09:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:55 smithi196 ceph-mon[32572]: pgmap v3145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:55 smithi110 ceph-mon[28069]: pgmap v3145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:55 smithi193 ceph-mon[32782]: pgmap v3145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:57 smithi196 ceph-mon[32572]: pgmap v3146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4911.854221 secs 2024-04-26T13:09:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:57 smithi110 ceph-mon[28069]: pgmap v3146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4911.854221 secs 2024-04-26T13:09:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:57 smithi193 ceph-mon[32782]: pgmap v3146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:09:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4911.854221 secs 2024-04-26T13:10:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:09:59 smithi196 ceph-mon[32572]: pgmap v3147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:10:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:09:59 smithi110 ceph-mon[28069]: pgmap v3147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:10:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:09:59 smithi193 ceph-mon[32782]: pgmap v3147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:10:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:10:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:10:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:10:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:01 smithi196 ceph-mon[32572]: pgmap v3148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:01 smithi110 ceph-mon[28069]: pgmap v3148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:01 smithi193 ceph-mon[32782]: pgmap v3148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4916.854357 secs 2024-04-26T13:10:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:02 smithi196 ceph-mon[32572]: pgmap v3149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4916.854357 secs 2024-04-26T13:10:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:02 smithi110 ceph-mon[28069]: pgmap v3149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4916.854357 secs 2024-04-26T13:10:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:02 smithi193 ceph-mon[32782]: pgmap v3149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:05 smithi193 ceph-mon[32782]: pgmap v3150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:05 smithi196 ceph-mon[32572]: pgmap v3150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:05 smithi110 ceph-mon[28069]: pgmap v3150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:07 smithi193 ceph-mon[32782]: pgmap v3151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:07 smithi193 ceph-mon[32782]: 5 slow requests, 1 included below; oldest blocked for > 4921.854476 secs 2024-04-26T13:10:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:07 smithi193 ceph-mon[32782]: slow request 363.682076 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:10:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:07 smithi196 ceph-mon[32572]: pgmap v3151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:07 smithi196 ceph-mon[32572]: 5 slow requests, 1 included below; oldest blocked for > 4921.854476 secs 2024-04-26T13:10:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:07 smithi196 ceph-mon[32572]: slow request 363.682076 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:10:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:07 smithi110 ceph-mon[28069]: pgmap v3151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:07 smithi110 ceph-mon[28069]: 5 slow requests, 1 included below; oldest blocked for > 4921.854476 secs 2024-04-26T13:10:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:07 smithi110 ceph-mon[28069]: slow request 363.682076 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:10:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:09 smithi193 ceph-mon[32782]: pgmap v3152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:09 smithi196 ceph-mon[32572]: pgmap v3152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:09 smithi110 ceph-mon[28069]: pgmap v3152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:11 smithi193 ceph-mon[32782]: pgmap v3153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:11 smithi196 ceph-mon[32572]: pgmap v3153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:11 smithi110 ceph-mon[28069]: pgmap v3153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4926.854645 secs 2024-04-26T13:10:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4926.854645 secs 2024-04-26T13:10:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4926.854645 secs 2024-04-26T13:10:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:13 smithi193 ceph-mon[32782]: pgmap v3154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:13 smithi196 ceph-mon[32572]: pgmap v3154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:13 smithi110 ceph-mon[28069]: pgmap v3154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:15 smithi193 ceph-mon[32782]: pgmap v3155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:15 smithi196 ceph-mon[32572]: pgmap v3155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:15 smithi110 ceph-mon[28069]: pgmap v3155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:17 smithi193 ceph-mon[32782]: pgmap v3156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4931.854720 secs 2024-04-26T13:10:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:17 smithi196 ceph-mon[32572]: pgmap v3156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4931.854720 secs 2024-04-26T13:10:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:17 smithi110 ceph-mon[28069]: pgmap v3156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4931.854720 secs 2024-04-26T13:10:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:19 smithi193 ceph-mon[32782]: pgmap v3157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:19 smithi196 ceph-mon[32572]: pgmap v3157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:19 smithi110 ceph-mon[28069]: pgmap v3157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:21 smithi196 ceph-mon[32572]: pgmap v3158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:21.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:21 smithi110 ceph-mon[28069]: pgmap v3158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:21 smithi193 ceph-mon[32782]: pgmap v3158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:22.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4936.854863 secs 2024-04-26T13:10:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4936.854863 secs 2024-04-26T13:10:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4936.854863 secs 2024-04-26T13:10:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:23 smithi196 ceph-mon[32572]: pgmap v3159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:23 smithi110 ceph-mon[28069]: pgmap v3159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:23 smithi193 ceph-mon[32782]: pgmap v3159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:25 smithi196 ceph-mon[32572]: pgmap v3160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:25 smithi110 ceph-mon[28069]: pgmap v3160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:25 smithi193 ceph-mon[32782]: pgmap v3160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:27 smithi196 ceph-mon[32572]: pgmap v3161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4941.854987 secs 2024-04-26T13:10:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:27 smithi110 ceph-mon[28069]: pgmap v3161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4941.854987 secs 2024-04-26T13:10:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:27 smithi193 ceph-mon[32782]: pgmap v3161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4941.854987 secs 2024-04-26T13:10:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:29 smithi196 ceph-mon[32572]: pgmap v3162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:29 smithi110 ceph-mon[28069]: pgmap v3162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:29 smithi193 ceph-mon[32782]: pgmap v3162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:31 smithi196 ceph-mon[32572]: pgmap v3163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:31 smithi110 ceph-mon[28069]: pgmap v3163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:31 smithi193 ceph-mon[32782]: pgmap v3163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4946.855127 secs 2024-04-26T13:10:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4946.855127 secs 2024-04-26T13:10:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4946.855127 secs 2024-04-26T13:10:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:33 smithi196 ceph-mon[32572]: pgmap v3164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:33 smithi110 ceph-mon[28069]: pgmap v3164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:33 smithi193 ceph-mon[32782]: pgmap v3164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:35.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:35 smithi193 ceph-mon[32782]: pgmap v3165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:35 smithi196 ceph-mon[32572]: pgmap v3165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:35 smithi110 ceph-mon[28069]: pgmap v3165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:37 smithi196 ceph-mon[32572]: pgmap v3166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4951.855220 secs 2024-04-26T13:10:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:37 smithi110 ceph-mon[28069]: pgmap v3166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4951.855220 secs 2024-04-26T13:10:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:37 smithi193 ceph-mon[32782]: pgmap v3166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4951.855220 secs 2024-04-26T13:10:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:39 smithi196 ceph-mon[32572]: pgmap v3167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:39 smithi110 ceph-mon[28069]: pgmap v3167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:39 smithi193 ceph-mon[32782]: pgmap v3167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:41 smithi196 ceph-mon[32572]: pgmap v3168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:41 smithi110 ceph-mon[28069]: pgmap v3168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:41 smithi193 ceph-mon[32782]: pgmap v3168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4956.855343 secs 2024-04-26T13:10:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4956.855343 secs 2024-04-26T13:10:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4956.855343 secs 2024-04-26T13:10:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:43 smithi196 ceph-mon[32572]: pgmap v3169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:43 smithi110 ceph-mon[28069]: pgmap v3169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:43 smithi193 ceph-mon[32782]: pgmap v3169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:45 smithi196 ceph-mon[32572]: pgmap v3170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:45 smithi110 ceph-mon[28069]: pgmap v3170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:45 smithi193 ceph-mon[32782]: pgmap v3170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:10:47.155+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:10:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:10:47.155+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006660 con 0x7f261c104b50 2024-04-26T13:10:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:10:47.156+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 42 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006660 con 0x55db1be4fdd0 2024-04-26T13:10:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:10:47.156+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 42 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:10:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:47 smithi196 ceph-mon[32572]: pgmap v3171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4961.855481 secs 2024-04-26T13:10:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:47 smithi110 ceph-mon[28069]: pgmap v3171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4961.855481 secs 2024-04-26T13:10:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:47 smithi193 ceph-mon[32782]: pgmap v3171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:10:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4961.855481 secs 2024-04-26T13:10:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:49 smithi196 ceph-mon[32572]: pgmap v3172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:10:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:49 smithi110 ceph-mon[28069]: pgmap v3172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:49.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:10:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:49 smithi193 ceph-mon[32782]: pgmap v3172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:10:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:10:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:10:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:10:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:10:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:10:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:10:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:10:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:10:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:10:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:10:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:51 smithi196 ceph-mon[32572]: pgmap v3173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:10:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:51 smithi196 ceph-mon[32572]: pgmap v3174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:51 smithi110 ceph-mon[28069]: pgmap v3173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:10:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:51 smithi110 ceph-mon[28069]: pgmap v3174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:51 smithi193 ceph-mon[32782]: pgmap v3173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:10:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:51 smithi193 ceph-mon[32782]: pgmap v3174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4966.855598 secs 2024-04-26T13:10:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4966.855598 secs 2024-04-26T13:10:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4966.855598 secs 2024-04-26T13:10:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:53 smithi196 ceph-mon[32572]: pgmap v3175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:53 smithi110 ceph-mon[28069]: pgmap v3175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:53 smithi193 ceph-mon[32782]: pgmap v3175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:55 smithi196 ceph-mon[32572]: pgmap v3176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:55 smithi110 ceph-mon[28069]: pgmap v3176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:55 smithi193 ceph-mon[32782]: pgmap v3176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:57 smithi196 ceph-mon[32572]: pgmap v3177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4971.855715 secs 2024-04-26T13:10:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:57 smithi110 ceph-mon[28069]: pgmap v3177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4971.855715 secs 2024-04-26T13:10:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:57 smithi193 ceph-mon[32782]: pgmap v3177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4971.855715 secs 2024-04-26T13:10:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:10:59 smithi110 ceph-mon[28069]: pgmap v3178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:10:59 smithi193 ceph-mon[32782]: pgmap v3178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:10:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:10:59 smithi196 ceph-mon[32572]: pgmap v3178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:01 smithi110 ceph-mon[28069]: pgmap v3179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:11:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:01 smithi193 ceph-mon[32782]: pgmap v3179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:11:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:01 smithi196 ceph-mon[32572]: pgmap v3179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:11:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4976.855808 secs 2024-04-26T13:11:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4976.855808 secs 2024-04-26T13:11:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4976.855808 secs 2024-04-26T13:11:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:03 smithi110 ceph-mon[28069]: pgmap v3180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:03 smithi193 ceph-mon[32782]: pgmap v3180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:03 smithi196 ceph-mon[32572]: pgmap v3180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:05 smithi110 ceph-mon[28069]: pgmap v3181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:05 smithi193 ceph-mon[32782]: pgmap v3181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:05 smithi196 ceph-mon[32572]: pgmap v3181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:07 smithi110 ceph-mon[28069]: pgmap v3182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4981.855881 secs 2024-04-26T13:11:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:07 smithi193 ceph-mon[32782]: pgmap v3182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4981.855881 secs 2024-04-26T13:11:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:07 smithi196 ceph-mon[32572]: pgmap v3182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4981.855881 secs 2024-04-26T13:11:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:09 smithi193 ceph-mon[32782]: pgmap v3183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:09 smithi196 ceph-mon[32572]: pgmap v3183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:09 smithi110 ceph-mon[28069]: pgmap v3183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:11 smithi193 ceph-mon[32782]: pgmap v3184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:11 smithi196 ceph-mon[32572]: pgmap v3184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:11 smithi110 ceph-mon[28069]: pgmap v3184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4986.856001 secs 2024-04-26T13:11:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4986.856001 secs 2024-04-26T13:11:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4986.856001 secs 2024-04-26T13:11:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:13 smithi193 ceph-mon[32782]: pgmap v3185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:13 smithi196 ceph-mon[32572]: pgmap v3185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:13 smithi110 ceph-mon[28069]: pgmap v3185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:15 smithi193 ceph-mon[32782]: pgmap v3186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:15 smithi196 ceph-mon[32572]: pgmap v3186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:15 smithi110 ceph-mon[28069]: pgmap v3186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:17 smithi193 ceph-mon[32782]: pgmap v3187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4991.856142 secs 2024-04-26T13:11:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:17 smithi196 ceph-mon[32572]: pgmap v3187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4991.856142 secs 2024-04-26T13:11:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:17 smithi110 ceph-mon[28069]: pgmap v3187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4991.856142 secs 2024-04-26T13:11:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:19 smithi193 ceph-mon[32782]: pgmap v3188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:19 smithi196 ceph-mon[32572]: pgmap v3188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:19 smithi110 ceph-mon[28069]: pgmap v3188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:21 smithi193 ceph-mon[32782]: pgmap v3189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:21 smithi196 ceph-mon[32572]: pgmap v3189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:21 smithi110 ceph-mon[28069]: pgmap v3189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 4996.856259 secs 2024-04-26T13:11:22.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 4996.856259 secs 2024-04-26T13:11:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 4996.856259 secs 2024-04-26T13:11:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:23 smithi193 ceph-mon[32782]: pgmap v3190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:23 smithi196 ceph-mon[32572]: pgmap v3190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:23 smithi110 ceph-mon[28069]: pgmap v3190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:25 smithi193 ceph-mon[32782]: pgmap v3191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:25 smithi196 ceph-mon[32572]: pgmap v3191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:25.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:25 smithi110 ceph-mon[28069]: pgmap v3191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:27 smithi193 ceph-mon[32782]: pgmap v3192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5001.856376 secs 2024-04-26T13:11:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:27 smithi196 ceph-mon[32572]: pgmap v3192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5001.856376 secs 2024-04-26T13:11:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:27 smithi110 ceph-mon[28069]: pgmap v3192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5001.856376 secs 2024-04-26T13:11:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:29 smithi193 ceph-mon[32782]: pgmap v3193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:29 smithi196 ceph-mon[32572]: pgmap v3193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:29 smithi110 ceph-mon[28069]: pgmap v3193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:31 smithi193 ceph-mon[32782]: pgmap v3194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:31 smithi196 ceph-mon[32572]: pgmap v3194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:31 smithi110 ceph-mon[28069]: pgmap v3194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5006.856493 secs 2024-04-26T13:11:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5006.856493 secs 2024-04-26T13:11:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5006.856493 secs 2024-04-26T13:11:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:33 smithi196 ceph-mon[32572]: pgmap v3195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:33 smithi110 ceph-mon[28069]: pgmap v3195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:33 smithi193 ceph-mon[32782]: pgmap v3195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:35.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:35 smithi193 ceph-mon[32782]: pgmap v3196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:35 smithi196 ceph-mon[32572]: pgmap v3196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:35 smithi110 ceph-mon[28069]: pgmap v3196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:37 smithi196 ceph-mon[32572]: pgmap v3197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5011.856623 secs 2024-04-26T13:11:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:37 smithi110 ceph-mon[28069]: pgmap v3197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5011.856623 secs 2024-04-26T13:11:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:37 smithi193 ceph-mon[32782]: pgmap v3197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5011.856623 secs 2024-04-26T13:11:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:39 smithi196 ceph-mon[32572]: pgmap v3198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:39 smithi110 ceph-mon[28069]: pgmap v3198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:39 smithi193 ceph-mon[32782]: pgmap v3198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:41 smithi196 ceph-mon[32572]: pgmap v3199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:41 smithi110 ceph-mon[28069]: pgmap v3199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:41 smithi193 ceph-mon[32782]: pgmap v3199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5016.856725 secs 2024-04-26T13:11:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5016.856725 secs 2024-04-26T13:11:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5016.856725 secs 2024-04-26T13:11:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:43 smithi196 ceph-mon[32572]: pgmap v3200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:43 smithi110 ceph-mon[28069]: pgmap v3200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:43 smithi193 ceph-mon[32782]: pgmap v3200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:45 smithi196 ceph-mon[32572]: pgmap v3201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:45 smithi110 ceph-mon[28069]: pgmap v3201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:45 smithi193 ceph-mon[32782]: pgmap v3201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:47 smithi196 ceph-mon[32572]: pgmap v3202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5021.856785 secs 2024-04-26T13:11:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:47 smithi110 ceph-mon[28069]: pgmap v3202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5021.856785 secs 2024-04-26T13:11:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:47 smithi193 ceph-mon[32782]: pgmap v3202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5021.856785 secs 2024-04-26T13:11:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:49 smithi196 ceph-mon[32572]: pgmap v3203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:49 smithi110 ceph-mon[28069]: pgmap v3203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:49 smithi193 ceph-mon[32782]: pgmap v3203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:11:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:11:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:11:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:11:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:51 smithi196 ceph-mon[32572]: pgmap v3204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:11:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:11:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:11:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:51 smithi110 ceph-mon[28069]: pgmap v3204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:11:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:11:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:11:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:51 smithi193 ceph-mon[32782]: pgmap v3204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:11:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:11:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:11:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:11:52.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5026.856905 secs 2024-04-26T13:11:52.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:52 smithi110 ceph-mon[28069]: pgmap v3205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T13:11:52.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:52 smithi110 ceph-mon[28069]: pgmap v3206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5026.856905 secs 2024-04-26T13:11:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:52 smithi196 ceph-mon[32572]: pgmap v3205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T13:11:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:52 smithi196 ceph-mon[32572]: pgmap v3206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5026.856905 secs 2024-04-26T13:11:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:52 smithi193 ceph-mon[32782]: pgmap v3205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T13:11:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:52 smithi193 ceph-mon[32782]: pgmap v3206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:54 smithi196 ceph-mon[32572]: pgmap v3207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:54 smithi110 ceph-mon[28069]: pgmap v3207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:54 smithi193 ceph-mon[32782]: pgmap v3207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:56 smithi196 ceph-mon[32572]: pgmap v3208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:56 smithi110 ceph-mon[28069]: pgmap v3208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:56 smithi193 ceph-mon[32782]: pgmap v3208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5031.857015 secs 2024-04-26T13:11:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5031.857015 secs 2024-04-26T13:11:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5031.857015 secs 2024-04-26T13:11:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:11:58 smithi196 ceph-mon[32572]: pgmap v3209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:11:58 smithi110 ceph-mon[28069]: pgmap v3209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:11:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:11:58 smithi193 ceph-mon[32782]: pgmap v3209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:12:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:00 smithi196 ceph-mon[32572]: pgmap v3210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:12:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:00 smithi110 ceph-mon[28069]: pgmap v3210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:12:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:00 smithi193 ceph-mon[32782]: pgmap v3210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:12:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5036.857148 secs 2024-04-26T13:12:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:02 smithi196 ceph-mon[32572]: pgmap v3211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:12:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5036.857148 secs 2024-04-26T13:12:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:02 smithi110 ceph-mon[28069]: pgmap v3211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:12:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5036.857148 secs 2024-04-26T13:12:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:02 smithi193 ceph-mon[32782]: pgmap v3211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:12:04.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:04 smithi196 ceph-mon[32572]: pgmap v3212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:04 smithi110 ceph-mon[28069]: pgmap v3212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:04 smithi193 ceph-mon[32782]: pgmap v3212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:06 smithi196 ceph-mon[32572]: pgmap v3213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:06 smithi110 ceph-mon[28069]: pgmap v3213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:06 smithi193 ceph-mon[32782]: pgmap v3213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5041.857280 secs 2024-04-26T13:12:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5041.857280 secs 2024-04-26T13:12:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5041.857280 secs 2024-04-26T13:12:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:08 smithi196 ceph-mon[32572]: pgmap v3214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:08 smithi110 ceph-mon[28069]: pgmap v3214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:08 smithi193 ceph-mon[32782]: pgmap v3214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:10 smithi196 ceph-mon[32572]: pgmap v3215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:10 smithi110 ceph-mon[28069]: pgmap v3215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:10 smithi193 ceph-mon[32782]: pgmap v3215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5046.857346 secs 2024-04-26T13:12:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:12 smithi110 ceph-mon[28069]: pgmap v3216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5046.857346 secs 2024-04-26T13:12:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:12 smithi193 ceph-mon[32782]: pgmap v3216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5046.857346 secs 2024-04-26T13:12:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:12 smithi196 ceph-mon[32572]: pgmap v3216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:14 smithi110 ceph-mon[28069]: pgmap v3217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:14 smithi193 ceph-mon[32782]: pgmap v3217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:14 smithi196 ceph-mon[32572]: pgmap v3217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:16 smithi110 ceph-mon[28069]: pgmap v3218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:16 smithi193 ceph-mon[32782]: pgmap v3218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:16 smithi196 ceph-mon[32572]: pgmap v3218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:17.170 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:12:17.171+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:12:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:12:17.171+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006660 con 0x7f261c104b50 2024-04-26T13:12:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:12:17.171+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 43 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006660 con 0x55db1be4fdd0 2024-04-26T13:12:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:12:17.171+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 43 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:12:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5051.857464 secs 2024-04-26T13:12:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5051.857464 secs 2024-04-26T13:12:17.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5051.857464 secs 2024-04-26T13:12:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:18 smithi110 ceph-mon[28069]: pgmap v3219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:18 smithi193 ceph-mon[32782]: pgmap v3219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:18 smithi196 ceph-mon[32572]: pgmap v3219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:20 smithi110 ceph-mon[28069]: pgmap v3220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:20 smithi193 ceph-mon[32782]: pgmap v3220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:20 smithi196 ceph-mon[32572]: pgmap v3220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5056.857599 secs 2024-04-26T13:12:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:22 smithi193 ceph-mon[32782]: pgmap v3221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5056.857599 secs 2024-04-26T13:12:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:22 smithi196 ceph-mon[32572]: pgmap v3221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5056.857599 secs 2024-04-26T13:12:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:22 smithi110 ceph-mon[28069]: pgmap v3221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:24 smithi193 ceph-mon[32782]: pgmap v3222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:24 smithi196 ceph-mon[32572]: pgmap v3222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:24 smithi110 ceph-mon[28069]: pgmap v3222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:26 smithi193 ceph-mon[32782]: pgmap v3223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:26 smithi196 ceph-mon[32572]: pgmap v3223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:26 smithi110 ceph-mon[28069]: pgmap v3223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5061.857733 secs 2024-04-26T13:12:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5061.857733 secs 2024-04-26T13:12:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5061.857733 secs 2024-04-26T13:12:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:28 smithi193 ceph-mon[32782]: pgmap v3224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:28 smithi196 ceph-mon[32572]: pgmap v3224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:28 smithi110 ceph-mon[28069]: pgmap v3224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:30 smithi193 ceph-mon[32782]: pgmap v3225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:30 smithi196 ceph-mon[32572]: pgmap v3225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:30 smithi110 ceph-mon[28069]: pgmap v3225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5066.857823 secs 2024-04-26T13:12:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:32 smithi193 ceph-mon[32782]: pgmap v3226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5066.857823 secs 2024-04-26T13:12:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:32 smithi196 ceph-mon[32572]: pgmap v3226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5066.857823 secs 2024-04-26T13:12:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:32 smithi110 ceph-mon[28069]: pgmap v3226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:34 smithi193 ceph-mon[32782]: pgmap v3227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:34 smithi196 ceph-mon[32572]: pgmap v3227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:34 smithi110 ceph-mon[28069]: pgmap v3227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:36 smithi193 ceph-mon[32782]: pgmap v3228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:36 smithi196 ceph-mon[32572]: pgmap v3228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:36 smithi110 ceph-mon[28069]: pgmap v3228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5071.857950 secs 2024-04-26T13:12:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5071.857950 secs 2024-04-26T13:12:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5071.857950 secs 2024-04-26T13:12:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:38 smithi193 ceph-mon[32782]: pgmap v3229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:38 smithi196 ceph-mon[32572]: pgmap v3229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:38 smithi110 ceph-mon[28069]: pgmap v3229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:40 smithi193 ceph-mon[32782]: pgmap v3230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:40 smithi196 ceph-mon[32572]: pgmap v3230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:40 smithi110 ceph-mon[28069]: pgmap v3230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5076.858074 secs 2024-04-26T13:12:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:42 smithi193 ceph-mon[32782]: pgmap v3231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5076.858074 secs 2024-04-26T13:12:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:42 smithi196 ceph-mon[32572]: pgmap v3231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5076.858074 secs 2024-04-26T13:12:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:42 smithi110 ceph-mon[28069]: pgmap v3231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:44 smithi196 ceph-mon[32572]: pgmap v3232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:44 smithi110 ceph-mon[28069]: pgmap v3232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:44 smithi193 ceph-mon[32782]: pgmap v3232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:46 smithi196 ceph-mon[32572]: pgmap v3233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:46 smithi110 ceph-mon[28069]: pgmap v3233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:46 smithi193 ceph-mon[32782]: pgmap v3233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:47.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5081.858193 secs 2024-04-26T13:12:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5081.858193 secs 2024-04-26T13:12:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5081.858193 secs 2024-04-26T13:12:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:48 smithi196 ceph-mon[32572]: pgmap v3234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:48 smithi110 ceph-mon[28069]: pgmap v3234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:48 smithi193 ceph-mon[32782]: pgmap v3234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:50 smithi196 ceph-mon[32572]: pgmap v3235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:50 smithi110 ceph-mon[28069]: pgmap v3235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:50 smithi193 ceph-mon[32782]: pgmap v3235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5086.858318 secs 2024-04-26T13:12:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:52 smithi196 ceph-mon[32572]: pgmap v3236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:12:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:12:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:12:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5086.858318 secs 2024-04-26T13:12:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:52 smithi110 ceph-mon[28069]: pgmap v3236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:12:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:12:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:12:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5086.858318 secs 2024-04-26T13:12:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:52 smithi193 ceph-mon[32782]: pgmap v3236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:12:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:12:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:12:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:12:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:54 smithi196 ceph-mon[32572]: pgmap v3237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:12:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:12:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:12:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:54 smithi110 ceph-mon[28069]: pgmap v3237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:12:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:12:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:12:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:54 smithi193 ceph-mon[32782]: pgmap v3237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:12:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:12:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:12:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:55 smithi196 ceph-mon[32572]: pgmap v3238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T13:12:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:55 smithi196 ceph-mon[32572]: pgmap v3239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:55 smithi110 ceph-mon[28069]: pgmap v3238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T13:12:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:55 smithi110 ceph-mon[28069]: pgmap v3239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:55 smithi193 ceph-mon[32782]: pgmap v3238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T13:12:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:55 smithi193 ceph-mon[32782]: pgmap v3239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:12:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:57 smithi196 ceph-mon[32572]: pgmap v3240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:12:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5091.858441 secs 2024-04-26T13:12:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:57 smithi110 ceph-mon[28069]: pgmap v3240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:12:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5091.858441 secs 2024-04-26T13:12:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:57 smithi193 ceph-mon[32782]: pgmap v3240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:12:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5091.858441 secs 2024-04-26T13:13:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:12:59 smithi196 ceph-mon[32572]: pgmap v3241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:12:59 smithi110 ceph-mon[28069]: pgmap v3241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:12:59 smithi193 ceph-mon[32782]: pgmap v3241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:00 smithi196 ceph-mon[32572]: pgmap v3242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:00 smithi110 ceph-mon[28069]: pgmap v3242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:00 smithi193 ceph-mon[32782]: pgmap v3242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5096.858610 secs 2024-04-26T13:13:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:02 smithi196 ceph-mon[32572]: pgmap v3243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:13:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5096.858610 secs 2024-04-26T13:13:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:02 smithi110 ceph-mon[28069]: pgmap v3243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:13:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5096.858610 secs 2024-04-26T13:13:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:02 smithi193 ceph-mon[32782]: pgmap v3243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:13:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:04 smithi196 ceph-mon[32572]: pgmap v3244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:13:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:04 smithi110 ceph-mon[28069]: pgmap v3244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:13:05.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:04 smithi193 ceph-mon[32782]: pgmap v3244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:13:07.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:06 smithi193 ceph-mon[32782]: pgmap v3245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:06 smithi196 ceph-mon[32572]: pgmap v3245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:06 smithi110 ceph-mon[28069]: pgmap v3245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5101.858733 secs 2024-04-26T13:13:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5101.858733 secs 2024-04-26T13:13:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5101.858733 secs 2024-04-26T13:13:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:08 smithi196 ceph-mon[32572]: pgmap v3246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:08 smithi110 ceph-mon[28069]: pgmap v3246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:08 smithi193 ceph-mon[32782]: pgmap v3246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:10 smithi196 ceph-mon[32572]: pgmap v3247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:10 smithi110 ceph-mon[28069]: pgmap v3247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:10 smithi193 ceph-mon[32782]: pgmap v3247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5106.858847 secs 2024-04-26T13:13:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:12 smithi196 ceph-mon[32572]: pgmap v3248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5106.858847 secs 2024-04-26T13:13:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:12 smithi110 ceph-mon[28069]: pgmap v3248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5106.858847 secs 2024-04-26T13:13:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:12 smithi193 ceph-mon[32782]: pgmap v3248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:14 smithi196 ceph-mon[32572]: pgmap v3249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:14 smithi110 ceph-mon[28069]: pgmap v3249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:14 smithi193 ceph-mon[32782]: pgmap v3249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:16 smithi196 ceph-mon[32572]: pgmap v3250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:16 smithi110 ceph-mon[28069]: pgmap v3250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:16 smithi193 ceph-mon[32782]: pgmap v3250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5111.858972 secs 2024-04-26T13:13:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5111.858972 secs 2024-04-26T13:13:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5111.858972 secs 2024-04-26T13:13:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:18 smithi196 ceph-mon[32572]: pgmap v3251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:18 smithi110 ceph-mon[28069]: pgmap v3251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:18 smithi193 ceph-mon[32782]: pgmap v3251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:20 smithi196 ceph-mon[32572]: pgmap v3252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:20 smithi110 ceph-mon[28069]: pgmap v3252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:20 smithi193 ceph-mon[32782]: pgmap v3252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5116.859076 secs 2024-04-26T13:13:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:22 smithi196 ceph-mon[32572]: pgmap v3253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5116.859076 secs 2024-04-26T13:13:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:22 smithi110 ceph-mon[28069]: pgmap v3253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5116.859076 secs 2024-04-26T13:13:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:22 smithi193 ceph-mon[32782]: pgmap v3253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:24 smithi196 ceph-mon[32572]: pgmap v3254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:24 smithi110 ceph-mon[28069]: pgmap v3254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:24 smithi193 ceph-mon[32782]: pgmap v3254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:26 smithi196 ceph-mon[32572]: pgmap v3255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:26 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5121.859196 secs 2024-04-26T13:13:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:26 smithi110 ceph-mon[28069]: pgmap v3255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:26 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5121.859196 secs 2024-04-26T13:13:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:26 smithi193 ceph-mon[32782]: pgmap v3255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:26 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5121.859196 secs 2024-04-26T13:13:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:28 smithi196 ceph-mon[32572]: pgmap v3256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:28 smithi110 ceph-mon[28069]: pgmap v3256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:28 smithi193 ceph-mon[32782]: pgmap v3256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:30 smithi196 ceph-mon[32572]: pgmap v3257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:30 smithi110 ceph-mon[28069]: pgmap v3257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:30 smithi193 ceph-mon[32782]: pgmap v3257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:31 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5126.859313 secs 2024-04-26T13:13:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:31 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5126.859313 secs 2024-04-26T13:13:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:31 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5126.859313 secs 2024-04-26T13:13:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:32 smithi196 ceph-mon[32572]: pgmap v3258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:32 smithi110 ceph-mon[28069]: pgmap v3258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:32 smithi193 ceph-mon[32782]: pgmap v3258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:34 smithi196 ceph-mon[32572]: pgmap v3259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:34 smithi110 ceph-mon[28069]: pgmap v3259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:34 smithi193 ceph-mon[32782]: pgmap v3259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:37 smithi196 ceph-mon[32572]: pgmap v3260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5131.859414 secs 2024-04-26T13:13:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:37 smithi110 ceph-mon[28069]: pgmap v3260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5131.859414 secs 2024-04-26T13:13:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:37 smithi193 ceph-mon[32782]: pgmap v3260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5131.859414 secs 2024-04-26T13:13:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:39 smithi110 ceph-mon[28069]: pgmap v3261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:39 smithi193 ceph-mon[32782]: pgmap v3261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:39 smithi196 ceph-mon[32572]: pgmap v3261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:41 smithi110 ceph-mon[28069]: pgmap v3262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:41 smithi193 ceph-mon[32782]: pgmap v3262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:41 smithi196 ceph-mon[32572]: pgmap v3262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5136.859537 secs 2024-04-26T13:13:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5136.859537 secs 2024-04-26T13:13:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5136.859537 secs 2024-04-26T13:13:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:43 smithi110 ceph-mon[28069]: pgmap v3263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:43 smithi193 ceph-mon[32782]: pgmap v3263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:43 smithi196 ceph-mon[32572]: pgmap v3263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:45 smithi110 ceph-mon[28069]: pgmap v3264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:45 smithi193 ceph-mon[32782]: pgmap v3264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:45 smithi196 ceph-mon[32572]: pgmap v3264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:47 smithi110 ceph-mon[28069]: pgmap v3265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5141.859673 secs 2024-04-26T13:13:47.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:47 smithi196 ceph-mon[32572]: pgmap v3265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:47.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5141.859673 secs 2024-04-26T13:13:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:47 smithi193 ceph-mon[32782]: pgmap v3265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5141.859673 secs 2024-04-26T13:13:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:49 smithi110 ceph-mon[28069]: pgmap v3266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:49 smithi193 ceph-mon[32782]: pgmap v3266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:49 smithi196 ceph-mon[32572]: pgmap v3266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:51 smithi193 ceph-mon[32782]: pgmap v3267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:51 smithi196 ceph-mon[32572]: pgmap v3267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:51 smithi110 ceph-mon[28069]: pgmap v3267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5146.859811 secs 2024-04-26T13:13:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5146.859811 secs 2024-04-26T13:13:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5146.859811 secs 2024-04-26T13:13:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:53 smithi193 ceph-mon[32782]: pgmap v3268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:53.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:53 smithi110 ceph-mon[28069]: pgmap v3268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:53 smithi196 ceph-mon[32572]: pgmap v3268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:13:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:55 smithi193 ceph-mon[32782]: pgmap v3269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:13:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:55 smithi196 ceph-mon[32572]: pgmap v3269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:13:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:55 smithi110 ceph-mon[28069]: pgmap v3269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:13:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:13:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:13:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:13:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:56 smithi193 ceph-mon[32782]: pgmap v3270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s rd, 1 op/s 2024-04-26T13:13:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:56 smithi193 ceph-mon[32782]: pgmap v3271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:13:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:13:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:13:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:56 smithi196 ceph-mon[32572]: pgmap v3270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s rd, 1 op/s 2024-04-26T13:13:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:56 smithi196 ceph-mon[32572]: pgmap v3271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:13:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:13:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:13:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:56 smithi110 ceph-mon[28069]: pgmap v3270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s rd, 1 op/s 2024-04-26T13:13:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:56 smithi110 ceph-mon[28069]: pgmap v3271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:13:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:13:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5151.859970 secs 2024-04-26T13:13:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5151.859970 secs 2024-04-26T13:13:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5151.859970 secs 2024-04-26T13:13:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:13:58 smithi193 ceph-mon[32782]: pgmap v3272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:13:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:13:58 smithi196 ceph-mon[32572]: pgmap v3272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:13:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:13:58 smithi110 ceph-mon[28069]: pgmap v3272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:00 smithi193 ceph-mon[32782]: pgmap v3273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:00 smithi196 ceph-mon[32572]: pgmap v3273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:00 smithi110 ceph-mon[28069]: pgmap v3273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:01 smithi193 ceph-mon[32782]: pgmap v3274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:01 smithi196 ceph-mon[32572]: pgmap v3274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:01 smithi110 ceph-mon[28069]: pgmap v3274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5156.860098 secs 2024-04-26T13:14:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:14:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:14:02.752+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:14:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:14:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:14:02.752+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:14:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:14:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:14:02.752+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:14:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:14:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:14:02.752+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:14:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:14:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:14:02.752+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:14:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5156.860098 secs 2024-04-26T13:14:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5156.860098 secs 2024-04-26T13:14:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:03 smithi193 ceph-mon[32782]: pgmap v3275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:03 smithi196 ceph-mon[32572]: pgmap v3275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:03 smithi110 ceph-mon[28069]: pgmap v3275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:14:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:06 smithi193 ceph-mon[32782]: pgmap v3276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:14:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:06 smithi196 ceph-mon[32572]: pgmap v3276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:14:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:06 smithi110 ceph-mon[28069]: pgmap v3276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:14:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5161.860227 secs 2024-04-26T13:14:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5161.860227 secs 2024-04-26T13:14:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5161.860227 secs 2024-04-26T13:14:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:08 smithi196 ceph-mon[32572]: pgmap v3277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:14:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:08 smithi110 ceph-mon[28069]: pgmap v3277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:14:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:08 smithi193 ceph-mon[32782]: pgmap v3277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:14:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:10 smithi196 ceph-mon[32572]: pgmap v3278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:14:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:10 smithi110 ceph-mon[28069]: pgmap v3278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:14:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:10 smithi193 ceph-mon[32782]: pgmap v3278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:14:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5166.860359 secs 2024-04-26T13:14:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:12 smithi196 ceph-mon[32572]: pgmap v3279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:14:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5166.860359 secs 2024-04-26T13:14:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:12 smithi110 ceph-mon[28069]: pgmap v3279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:14:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5166.860359 secs 2024-04-26T13:14:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:12 smithi193 ceph-mon[32782]: pgmap v3279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:14:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:14 smithi196 ceph-mon[32572]: pgmap v3280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:14:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:14 smithi110 ceph-mon[28069]: pgmap v3280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:14:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:14 smithi193 ceph-mon[32782]: pgmap v3280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:14:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:16 smithi196 ceph-mon[32572]: pgmap v3281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:14:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:16 smithi110 ceph-mon[28069]: pgmap v3281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:14:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:16 smithi193 ceph-mon[32782]: pgmap v3281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:14:17.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5171.860500 secs 2024-04-26T13:14:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5171.860500 secs 2024-04-26T13:14:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5171.860500 secs 2024-04-26T13:14:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:18 smithi196 ceph-mon[32572]: pgmap v3282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:14:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:18 smithi110 ceph-mon[28069]: pgmap v3282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:14:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:18 smithi193 ceph-mon[32782]: pgmap v3282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:14:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:20 smithi196 ceph-mon[32572]: pgmap v3283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:20 smithi110 ceph-mon[28069]: pgmap v3283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:20 smithi193 ceph-mon[32782]: pgmap v3283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5176.860653 secs 2024-04-26T13:14:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:22 smithi196 ceph-mon[32572]: pgmap v3284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5176.860653 secs 2024-04-26T13:14:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:22 smithi110 ceph-mon[28069]: pgmap v3284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5176.860653 secs 2024-04-26T13:14:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:22 smithi193 ceph-mon[32782]: pgmap v3284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:24 smithi196 ceph-mon[32572]: pgmap v3285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:24 smithi110 ceph-mon[28069]: pgmap v3285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:24 smithi193 ceph-mon[32782]: pgmap v3285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:26 smithi196 ceph-mon[32572]: pgmap v3286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:26 smithi110 ceph-mon[28069]: pgmap v3286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:26 smithi193 ceph-mon[32782]: pgmap v3286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5181.860773 secs 2024-04-26T13:14:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5181.860773 secs 2024-04-26T13:14:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5181.860773 secs 2024-04-26T13:14:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:28 smithi196 ceph-mon[32572]: pgmap v3287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:28 smithi110 ceph-mon[28069]: pgmap v3287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:28 smithi193 ceph-mon[32782]: pgmap v3287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:29 smithi196 ceph-mon[32572]: pgmap v3288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:29 smithi110 ceph-mon[28069]: pgmap v3288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:29 smithi193 ceph-mon[32782]: pgmap v3288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5186.860901 secs 2024-04-26T13:14:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:32 smithi196 ceph-mon[32572]: pgmap v3289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5186.860901 secs 2024-04-26T13:14:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:32 smithi110 ceph-mon[28069]: pgmap v3289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5186.860901 secs 2024-04-26T13:14:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:32 smithi193 ceph-mon[32782]: pgmap v3289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:34 smithi196 ceph-mon[32572]: pgmap v3290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:34 smithi110 ceph-mon[28069]: pgmap v3290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:34 smithi193 ceph-mon[32782]: pgmap v3290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:36 smithi196 ceph-mon[32572]: pgmap v3291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:36 smithi110 ceph-mon[28069]: pgmap v3291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:36 smithi193 ceph-mon[32782]: pgmap v3291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5191.861031 secs 2024-04-26T13:14:38.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5191.861031 secs 2024-04-26T13:14:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5191.861031 secs 2024-04-26T13:14:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:38 smithi196 ceph-mon[32572]: pgmap v3292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:38 smithi110 ceph-mon[28069]: pgmap v3292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:38 smithi193 ceph-mon[32782]: pgmap v3292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:40 smithi196 ceph-mon[32572]: pgmap v3293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:40 smithi110 ceph-mon[28069]: pgmap v3293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:40 smithi193 ceph-mon[32782]: pgmap v3293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5196.861168 secs 2024-04-26T13:14:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:42 smithi196 ceph-mon[32572]: pgmap v3294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5196.861168 secs 2024-04-26T13:14:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:42 smithi110 ceph-mon[28069]: pgmap v3294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5196.861168 secs 2024-04-26T13:14:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:42 smithi193 ceph-mon[32782]: pgmap v3294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:44 smithi196 ceph-mon[32572]: pgmap v3295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:44 smithi110 ceph-mon[28069]: pgmap v3295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:44 smithi193 ceph-mon[32782]: pgmap v3295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:46 smithi196 ceph-mon[32572]: pgmap v3296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:46 smithi110 ceph-mon[28069]: pgmap v3296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:46 smithi193 ceph-mon[32782]: pgmap v3296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5201.861292 secs 2024-04-26T13:14:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5201.861292 secs 2024-04-26T13:14:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5201.861292 secs 2024-04-26T13:14:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:48 smithi196 ceph-mon[32572]: pgmap v3297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:48 smithi110 ceph-mon[28069]: pgmap v3297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:48 smithi193 ceph-mon[32782]: pgmap v3297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:50 smithi196 ceph-mon[32572]: pgmap v3298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:50 smithi110 ceph-mon[28069]: pgmap v3298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:50 smithi193 ceph-mon[32782]: pgmap v3298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5206.861415 secs 2024-04-26T13:14:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:52 smithi196 ceph-mon[32572]: pgmap v3299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5206.861415 secs 2024-04-26T13:14:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:52 smithi110 ceph-mon[28069]: pgmap v3299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5206.861415 secs 2024-04-26T13:14:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:52 smithi193 ceph-mon[32782]: pgmap v3299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:54 smithi196 ceph-mon[32572]: pgmap v3300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:54 smithi110 ceph-mon[28069]: pgmap v3300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:54 smithi193 ceph-mon[32782]: pgmap v3300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:56 smithi196 ceph-mon[32572]: pgmap v3301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:14:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:56 smithi110 ceph-mon[28069]: pgmap v3301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:14:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:56 smithi193 ceph-mon[32782]: pgmap v3301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:14:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:14:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5211.861518 secs 2024-04-26T13:14:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:57 smithi196 ceph-mon[32572]: pgmap v3302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5211.861518 secs 2024-04-26T13:14:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:57 smithi110 ceph-mon[28069]: pgmap v3302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5211.861518 secs 2024-04-26T13:14:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:57 smithi193 ceph-mon[32782]: pgmap v3302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:14:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:14:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:14:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:14:59.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:14:59.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:14:59.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:59 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:15:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:59 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:15:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:14:59 smithi196 ceph-mon[32572]: pgmap v3303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:15:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:59 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:15:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:59 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:15:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:14:59 smithi110 ceph-mon[28069]: pgmap v3303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:15:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:59 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:15:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:59 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:15:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:14:59 smithi193 ceph-mon[32782]: pgmap v3303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:15:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:15:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:15:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:15:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:15:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:15:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:15:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5216.861653 secs 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:15:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: pgmap v3304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 770 B/s rd, 1 op/s 2024-04-26T13:15:02.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: pgmap v3305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 924 B/s rd, 1 op/s 2024-04-26T13:15:02.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:15:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5216.861653 secs 2024-04-26T13:15:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: pgmap v3304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 770 B/s rd, 1 op/s 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: pgmap v3305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 924 B/s rd, 1 op/s 2024-04-26T13:15:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:15:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5216.861653 secs 2024-04-26T13:15:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: pgmap v3304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 770 B/s rd, 1 op/s 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: pgmap v3305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 924 B/s rd, 1 op/s 2024-04-26T13:15:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:15:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:04 smithi193 ceph-mon[32782]: pgmap v3306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:04 smithi196 ceph-mon[32572]: pgmap v3306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:04 smithi110 ceph-mon[28069]: pgmap v3306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:06 smithi193 ceph-mon[32782]: pgmap v3307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:06 smithi196 ceph-mon[32572]: pgmap v3307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:06 smithi110 ceph-mon[28069]: pgmap v3307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5221.861746 secs 2024-04-26T13:15:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5221.861746 secs 2024-04-26T13:15:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5221.861746 secs 2024-04-26T13:15:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:08 smithi196 ceph-mon[32572]: pgmap v3308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:08 smithi110 ceph-mon[28069]: pgmap v3308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:08 smithi193 ceph-mon[32782]: pgmap v3308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:10.973 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:10 smithi193 ceph-mon[32782]: pgmap v3309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:10 smithi196 ceph-mon[32572]: pgmap v3309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:10 smithi110 ceph-mon[28069]: pgmap v3309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5226.861834 secs 2024-04-26T13:15:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:12 smithi196 ceph-mon[32572]: pgmap v3310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5226.861834 secs 2024-04-26T13:15:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:12 smithi110 ceph-mon[28069]: pgmap v3310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5226.861834 secs 2024-04-26T13:15:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:12 smithi193 ceph-mon[32782]: pgmap v3310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:14 smithi196 ceph-mon[32572]: pgmap v3311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:14 smithi110 ceph-mon[28069]: pgmap v3311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:14 smithi193 ceph-mon[32782]: pgmap v3311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:15:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:16 smithi196 ceph-mon[32572]: pgmap v3312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:16 smithi110 ceph-mon[28069]: pgmap v3312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:16 smithi193 ceph-mon[32782]: pgmap v3312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:15:17.201+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:15:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:15:17.201+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006320 con 0x7f261c104b50 2024-04-26T13:15:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:15:17.201+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 44 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006320 con 0x55db1be4fdd0 2024-04-26T13:15:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:15:17.201+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 44 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:15:17.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5231.861900 secs 2024-04-26T13:15:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5231.861900 secs 2024-04-26T13:15:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5231.861900 secs 2024-04-26T13:15:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:18 smithi196 ceph-mon[32572]: pgmap v3313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:18 smithi110 ceph-mon[28069]: pgmap v3313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:18 smithi193 ceph-mon[32782]: pgmap v3313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:20 smithi193 ceph-mon[32782]: pgmap v3314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:20 smithi196 ceph-mon[32572]: pgmap v3314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:20 smithi110 ceph-mon[28069]: pgmap v3314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5236.862025 secs 2024-04-26T13:15:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:22 smithi196 ceph-mon[32572]: pgmap v3315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5236.862025 secs 2024-04-26T13:15:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:22 smithi110 ceph-mon[28069]: pgmap v3315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5236.862025 secs 2024-04-26T13:15:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:22 smithi193 ceph-mon[32782]: pgmap v3315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:24 smithi196 ceph-mon[32572]: pgmap v3316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:24 smithi110 ceph-mon[28069]: pgmap v3316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:24 smithi193 ceph-mon[32782]: pgmap v3316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:26 smithi196 ceph-mon[32572]: pgmap v3317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:26 smithi110 ceph-mon[28069]: pgmap v3317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:26 smithi193 ceph-mon[32782]: pgmap v3317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5241.862149 secs 2024-04-26T13:15:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5241.862149 secs 2024-04-26T13:15:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5241.862149 secs 2024-04-26T13:15:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:28 smithi196 ceph-mon[32572]: pgmap v3318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:28 smithi110 ceph-mon[28069]: pgmap v3318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:28 smithi193 ceph-mon[32782]: pgmap v3318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:30 smithi196 ceph-mon[32572]: pgmap v3319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:30 smithi110 ceph-mon[28069]: pgmap v3319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:30 smithi193 ceph-mon[32782]: pgmap v3319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5246.862278 secs 2024-04-26T13:15:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:32 smithi196 ceph-mon[32572]: pgmap v3320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5246.862278 secs 2024-04-26T13:15:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:32 smithi110 ceph-mon[28069]: pgmap v3320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5246.862278 secs 2024-04-26T13:15:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:32 smithi193 ceph-mon[32782]: pgmap v3320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:34 smithi196 ceph-mon[32572]: pgmap v3321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:34 smithi110 ceph-mon[28069]: pgmap v3321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:34 smithi193 ceph-mon[32782]: pgmap v3321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:36 smithi196 ceph-mon[32572]: pgmap v3322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:36 smithi110 ceph-mon[28069]: pgmap v3322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:36 smithi193 ceph-mon[32782]: pgmap v3322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5251.862405 secs 2024-04-26T13:15:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:37 smithi196 ceph-mon[32572]: pgmap v3323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:38.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5251.862405 secs 2024-04-26T13:15:38.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:37 smithi193 ceph-mon[32782]: pgmap v3323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5251.862405 secs 2024-04-26T13:15:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:37 smithi110 ceph-mon[28069]: pgmap v3323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:40 smithi193 ceph-mon[32782]: pgmap v3324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:40 smithi196 ceph-mon[32572]: pgmap v3324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:40 smithi110 ceph-mon[28069]: pgmap v3324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5256.862505 secs 2024-04-26T13:15:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:42 smithi196 ceph-mon[32572]: pgmap v3325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5256.862505 secs 2024-04-26T13:15:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:42 smithi110 ceph-mon[28069]: pgmap v3325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5256.862505 secs 2024-04-26T13:15:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:42 smithi193 ceph-mon[32782]: pgmap v3325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:44 smithi196 ceph-mon[32572]: pgmap v3326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:44 smithi110 ceph-mon[28069]: pgmap v3326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:44 smithi193 ceph-mon[32782]: pgmap v3326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:46 smithi196 ceph-mon[32572]: pgmap v3327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:46 smithi110 ceph-mon[28069]: pgmap v3327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:46 smithi193 ceph-mon[32782]: pgmap v3327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:47.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5261.862634 secs 2024-04-26T13:15:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5261.862634 secs 2024-04-26T13:15:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5261.862634 secs 2024-04-26T13:15:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:48 smithi196 ceph-mon[32572]: pgmap v3328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:48 smithi110 ceph-mon[28069]: pgmap v3328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:48 smithi193 ceph-mon[32782]: pgmap v3328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:50 smithi196 ceph-mon[32572]: pgmap v3329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:50 smithi110 ceph-mon[28069]: pgmap v3329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:50 smithi193 ceph-mon[32782]: pgmap v3329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5266.862729 secs 2024-04-26T13:15:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:52 smithi196 ceph-mon[32572]: pgmap v3330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5266.862729 secs 2024-04-26T13:15:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:52 smithi110 ceph-mon[28069]: pgmap v3330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5266.862729 secs 2024-04-26T13:15:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:52 smithi193 ceph-mon[32782]: pgmap v3330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:54 smithi196 ceph-mon[32572]: pgmap v3331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:54 smithi110 ceph-mon[28069]: pgmap v3331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:54 smithi193 ceph-mon[32782]: pgmap v3331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:56 smithi196 ceph-mon[32572]: pgmap v3332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:56 smithi110 ceph-mon[28069]: pgmap v3332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:56 smithi193 ceph-mon[32782]: pgmap v3332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:15:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5271.862850 secs 2024-04-26T13:15:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5271.862850 secs 2024-04-26T13:15:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5271.862850 secs 2024-04-26T13:15:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:15:58 smithi196 ceph-mon[32572]: pgmap v3333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:15:58 smithi110 ceph-mon[28069]: pgmap v3333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:15:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:15:58 smithi193 ceph-mon[32782]: pgmap v3333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:00 smithi196 ceph-mon[32572]: pgmap v3334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:00 smithi110 ceph-mon[28069]: pgmap v3334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:00 smithi193 ceph-mon[32782]: pgmap v3334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5276.862950 secs 2024-04-26T13:16:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:02 smithi196 ceph-mon[32572]: pgmap v3335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:16:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5276.862950 secs 2024-04-26T13:16:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:02 smithi110 ceph-mon[28069]: pgmap v3335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:16:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5276.862950 secs 2024-04-26T13:16:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:02 smithi193 ceph-mon[32782]: pgmap v3335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:16:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:16:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:16:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:16:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:16:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:16:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:16:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:16:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:16:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:16:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:04 smithi196 ceph-mon[32572]: pgmap v3336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:16:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:04 smithi196 ceph-mon[32572]: pgmap v3337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:04 smithi110 ceph-mon[28069]: pgmap v3336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:16:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:04 smithi110 ceph-mon[28069]: pgmap v3337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:04 smithi193 ceph-mon[32782]: pgmap v3336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:16:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:04 smithi193 ceph-mon[32782]: pgmap v3337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:05 smithi196 ceph-mon[32572]: pgmap v3338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:05 smithi110 ceph-mon[28069]: pgmap v3338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:05 smithi193 ceph-mon[32782]: pgmap v3338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:07 smithi110 ceph-mon[28069]: 5 slow requests, 1 included below; oldest blocked for > 5281.863070 secs 2024-04-26T13:16:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:07 smithi110 ceph-mon[28069]: slow request 723.690669 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:16:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:07 smithi193 ceph-mon[32782]: 5 slow requests, 1 included below; oldest blocked for > 5281.863070 secs 2024-04-26T13:16:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:07 smithi193 ceph-mon[32782]: slow request 723.690669 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:16:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:07 smithi196 ceph-mon[32572]: 5 slow requests, 1 included below; oldest blocked for > 5281.863070 secs 2024-04-26T13:16:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:07 smithi196 ceph-mon[32572]: slow request 723.690669 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:16:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:08 smithi193 ceph-mon[32782]: pgmap v3339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T13:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:08 smithi196 ceph-mon[32572]: pgmap v3339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T13:16:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:08 smithi110 ceph-mon[28069]: pgmap v3339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T13:16:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:10 smithi110 ceph-mon[28069]: pgmap v3340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:10 smithi193 ceph-mon[32782]: pgmap v3340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:10 smithi196 ceph-mon[32572]: pgmap v3340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5286.863186 secs 2024-04-26T13:16:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:12 smithi110 ceph-mon[28069]: pgmap v3341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5286.863186 secs 2024-04-26T13:16:12.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:12 smithi193 ceph-mon[32782]: pgmap v3341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5286.863186 secs 2024-04-26T13:16:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:12 smithi196 ceph-mon[32572]: pgmap v3341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:16:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:14 smithi110 ceph-mon[28069]: pgmap v3342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:16:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:14 smithi193 ceph-mon[32782]: pgmap v3342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:16:14.762 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:14 smithi196 ceph-mon[32572]: pgmap v3342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:16:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:16 smithi193 ceph-mon[32782]: pgmap v3343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:16 smithi196 ceph-mon[32572]: pgmap v3343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:16 smithi110 ceph-mon[28069]: pgmap v3343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5291.863308 secs 2024-04-26T13:16:17.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5291.863308 secs 2024-04-26T13:16:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5291.863308 secs 2024-04-26T13:16:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:18 smithi193 ceph-mon[32782]: pgmap v3344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:18 smithi196 ceph-mon[32572]: pgmap v3344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:18 smithi110 ceph-mon[28069]: pgmap v3344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:20 smithi193 ceph-mon[32782]: pgmap v3345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:20 smithi196 ceph-mon[32572]: pgmap v3345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:20 smithi110 ceph-mon[28069]: pgmap v3345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5296.863440 secs 2024-04-26T13:16:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:22 smithi193 ceph-mon[32782]: pgmap v3346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5296.863440 secs 2024-04-26T13:16:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:22 smithi196 ceph-mon[32572]: pgmap v3346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5296.863440 secs 2024-04-26T13:16:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:22 smithi110 ceph-mon[28069]: pgmap v3346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:24.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:24 smithi110 ceph-mon[28069]: pgmap v3347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:24 smithi193 ceph-mon[32782]: pgmap v3347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:24 smithi196 ceph-mon[32572]: pgmap v3347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:26 smithi193 ceph-mon[32782]: pgmap v3348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:26 smithi196 ceph-mon[32572]: pgmap v3348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:26 smithi110 ceph-mon[28069]: pgmap v3348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5301.863557 secs 2024-04-26T13:16:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5301.863557 secs 2024-04-26T13:16:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5301.863557 secs 2024-04-26T13:16:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:28 smithi193 ceph-mon[32782]: pgmap v3349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:28 smithi196 ceph-mon[32572]: pgmap v3349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:28 smithi110 ceph-mon[28069]: pgmap v3349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:30 smithi193 ceph-mon[32782]: pgmap v3350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:30 smithi196 ceph-mon[32572]: pgmap v3350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:30 smithi110 ceph-mon[28069]: pgmap v3350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5306.863679 secs 2024-04-26T13:16:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:32 smithi193 ceph-mon[32782]: pgmap v3351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5306.863679 secs 2024-04-26T13:16:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:32 smithi196 ceph-mon[32572]: pgmap v3351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5306.863679 secs 2024-04-26T13:16:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:32 smithi110 ceph-mon[28069]: pgmap v3351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:34 smithi193 ceph-mon[32782]: pgmap v3352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:34 smithi196 ceph-mon[32572]: pgmap v3352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:34 smithi110 ceph-mon[28069]: pgmap v3352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:36 smithi193 ceph-mon[32782]: pgmap v3353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:36 smithi196 ceph-mon[32572]: pgmap v3353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:36 smithi110 ceph-mon[28069]: pgmap v3353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5311.863775 secs 2024-04-26T13:16:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5311.863775 secs 2024-04-26T13:16:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5311.863775 secs 2024-04-26T13:16:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:38 smithi196 ceph-mon[32572]: pgmap v3354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:38.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:38 smithi193 ceph-mon[32782]: pgmap v3354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:38 smithi110 ceph-mon[28069]: pgmap v3354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:40 smithi196 ceph-mon[32572]: pgmap v3355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:40 smithi110 ceph-mon[28069]: pgmap v3355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:40 smithi193 ceph-mon[32782]: pgmap v3355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5316.863853 secs 2024-04-26T13:16:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:42 smithi196 ceph-mon[32572]: pgmap v3356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5316.863853 secs 2024-04-26T13:16:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:42 smithi110 ceph-mon[28069]: pgmap v3356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5316.863853 secs 2024-04-26T13:16:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:42 smithi193 ceph-mon[32782]: pgmap v3356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:44 smithi196 ceph-mon[32572]: pgmap v3357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:44 smithi110 ceph-mon[28069]: pgmap v3357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:44 smithi193 ceph-mon[32782]: pgmap v3357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:46 smithi196 ceph-mon[32572]: pgmap v3358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:46 smithi110 ceph-mon[28069]: pgmap v3358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:46 smithi193 ceph-mon[32782]: pgmap v3358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5321.863968 secs 2024-04-26T13:16:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5321.863968 secs 2024-04-26T13:16:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5321.863968 secs 2024-04-26T13:16:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:48 smithi196 ceph-mon[32572]: pgmap v3359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:48 smithi110 ceph-mon[28069]: pgmap v3359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:48 smithi193 ceph-mon[32782]: pgmap v3359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:50 smithi196 ceph-mon[32572]: pgmap v3360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:50 smithi110 ceph-mon[28069]: pgmap v3360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:50 smithi193 ceph-mon[32782]: pgmap v3360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5326.864088 secs 2024-04-26T13:16:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:52 smithi196 ceph-mon[32572]: pgmap v3361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5326.864088 secs 2024-04-26T13:16:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:52 smithi110 ceph-mon[28069]: pgmap v3361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5326.864088 secs 2024-04-26T13:16:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:52 smithi193 ceph-mon[32782]: pgmap v3361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:54 smithi196 ceph-mon[32572]: pgmap v3362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:54 smithi110 ceph-mon[28069]: pgmap v3362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:54 smithi193 ceph-mon[32782]: pgmap v3362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:16:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:56 smithi196 ceph-mon[32572]: pgmap v3363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:56 smithi110 ceph-mon[28069]: pgmap v3363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:56 smithi193 ceph-mon[32782]: pgmap v3363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5331.864190 secs 2024-04-26T13:16:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5331.864190 secs 2024-04-26T13:16:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5331.864190 secs 2024-04-26T13:16:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:16:58 smithi196 ceph-mon[32572]: pgmap v3364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:16:58 smithi110 ceph-mon[28069]: pgmap v3364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:16:58.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:16:58 smithi193 ceph-mon[32782]: pgmap v3364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:00 smithi196 ceph-mon[32572]: pgmap v3365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:00 smithi110 ceph-mon[28069]: pgmap v3365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:00 smithi193 ceph-mon[32782]: pgmap v3365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5336.864314 secs 2024-04-26T13:17:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:02 smithi196 ceph-mon[32572]: pgmap v3366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5336.864314 secs 2024-04-26T13:17:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:02 smithi110 ceph-mon[28069]: pgmap v3366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5336.864314 secs 2024-04-26T13:17:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:02 smithi193 ceph-mon[32782]: pgmap v3366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:04 smithi196 ceph-mon[32572]: pgmap v3367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:17:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:04 smithi110 ceph-mon[28069]: pgmap v3367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:17:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:04 smithi193 ceph-mon[32782]: pgmap v3367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:17:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:17:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:17:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:17:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:17:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:17:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:17:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:17:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:17:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:17:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:06 smithi196 ceph-mon[32572]: pgmap v3368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T13:17:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:06 smithi196 ceph-mon[32572]: pgmap v3369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:06 smithi110 ceph-mon[28069]: pgmap v3368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T13:17:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:06 smithi110 ceph-mon[28069]: pgmap v3369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:06 smithi193 ceph-mon[32782]: pgmap v3368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T13:17:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:06 smithi193 ceph-mon[32782]: pgmap v3369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5341.864435 secs 2024-04-26T13:17:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5341.864435 secs 2024-04-26T13:17:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5341.864435 secs 2024-04-26T13:17:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:08 smithi196 ceph-mon[32572]: pgmap v3370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:08.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:08 smithi193 ceph-mon[32782]: pgmap v3370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:08 smithi110 ceph-mon[28069]: pgmap v3370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:10 smithi196 ceph-mon[32572]: pgmap v3371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:10 smithi110 ceph-mon[28069]: pgmap v3371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:10 smithi193 ceph-mon[32782]: pgmap v3371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:12 smithi196 ceph-mon[32572]: pgmap v3372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5346.864552 secs 2024-04-26T13:17:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:12 smithi110 ceph-mon[28069]: pgmap v3372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5346.864552 secs 2024-04-26T13:17:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:12 smithi193 ceph-mon[32782]: pgmap v3372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5346.864552 secs 2024-04-26T13:17:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:14 smithi196 ceph-mon[32572]: pgmap v3373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:14 smithi110 ceph-mon[28069]: pgmap v3373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:14 smithi193 ceph-mon[32782]: pgmap v3373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:17:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:16 smithi196 ceph-mon[32572]: pgmap v3374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:17:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:16 smithi110 ceph-mon[28069]: pgmap v3374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:17:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:16 smithi193 ceph-mon[32782]: pgmap v3374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:17:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5351.864650 secs 2024-04-26T13:17:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5351.864650 secs 2024-04-26T13:17:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5351.864650 secs 2024-04-26T13:17:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:18 smithi110 ceph-mon[28069]: pgmap v3375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:18 smithi193 ceph-mon[32782]: pgmap v3375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:18 smithi196 ceph-mon[32572]: pgmap v3375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:20 smithi110 ceph-mon[28069]: pgmap v3376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:20 smithi193 ceph-mon[32782]: pgmap v3376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:20 smithi196 ceph-mon[32572]: pgmap v3376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:22 smithi110 ceph-mon[28069]: pgmap v3377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5356.864791 secs 2024-04-26T13:17:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:22 smithi193 ceph-mon[32782]: pgmap v3377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5356.864791 secs 2024-04-26T13:17:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:22 smithi196 ceph-mon[32572]: pgmap v3377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5356.864791 secs 2024-04-26T13:17:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:24 smithi110 ceph-mon[28069]: pgmap v3378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:24 smithi193 ceph-mon[32782]: pgmap v3378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:24 smithi196 ceph-mon[32572]: pgmap v3378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:26 smithi110 ceph-mon[28069]: pgmap v3379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:26 smithi193 ceph-mon[32782]: pgmap v3379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:26 smithi196 ceph-mon[32572]: pgmap v3379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5361.864926 secs 2024-04-26T13:17:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5361.864926 secs 2024-04-26T13:17:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5361.864926 secs 2024-04-26T13:17:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:28 smithi193 ceph-mon[32782]: pgmap v3380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:28 smithi196 ceph-mon[32572]: pgmap v3380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:28 smithi110 ceph-mon[28069]: pgmap v3380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:30 smithi193 ceph-mon[32782]: pgmap v3381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:30 smithi196 ceph-mon[32572]: pgmap v3381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:30 smithi110 ceph-mon[28069]: pgmap v3381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:32.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:32 smithi193 ceph-mon[32782]: pgmap v3382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:32.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5366.865002 secs 2024-04-26T13:17:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:32 smithi196 ceph-mon[32572]: pgmap v3382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5366.865002 secs 2024-04-26T13:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:32 smithi110 ceph-mon[28069]: pgmap v3382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5366.865002 secs 2024-04-26T13:17:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:34 smithi193 ceph-mon[32782]: pgmap v3383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:34 smithi196 ceph-mon[32572]: pgmap v3383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:34 smithi110 ceph-mon[28069]: pgmap v3383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:36 smithi193 ceph-mon[32782]: pgmap v3384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:36 smithi196 ceph-mon[32572]: pgmap v3384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:36 smithi110 ceph-mon[28069]: pgmap v3384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5371.865120 secs 2024-04-26T13:17:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5371.865120 secs 2024-04-26T13:17:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5371.865120 secs 2024-04-26T13:17:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:38 smithi193 ceph-mon[32782]: pgmap v3385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:38 smithi196 ceph-mon[32572]: pgmap v3385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:38 smithi110 ceph-mon[28069]: pgmap v3385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:40 smithi193 ceph-mon[32782]: pgmap v3386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:40 smithi196 ceph-mon[32572]: pgmap v3386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:40 smithi110 ceph-mon[28069]: pgmap v3386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:42 smithi193 ceph-mon[32782]: pgmap v3387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5376.865217 secs 2024-04-26T13:17:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:42 smithi196 ceph-mon[32572]: pgmap v3387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5376.865217 secs 2024-04-26T13:17:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:42 smithi110 ceph-mon[28069]: pgmap v3387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5376.865217 secs 2024-04-26T13:17:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:44 smithi193 ceph-mon[32782]: pgmap v3388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:44 smithi196 ceph-mon[32572]: pgmap v3388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:44 smithi110 ceph-mon[28069]: pgmap v3388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:46 smithi193 ceph-mon[32782]: pgmap v3389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:46 smithi196 ceph-mon[32572]: pgmap v3389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:46 smithi110 ceph-mon[28069]: pgmap v3389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5381.865339 secs 2024-04-26T13:17:47.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5381.865339 secs 2024-04-26T13:17:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5381.865339 secs 2024-04-26T13:17:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:48 smithi193 ceph-mon[32782]: pgmap v3390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:48 smithi196 ceph-mon[32572]: pgmap v3390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:48 smithi110 ceph-mon[28069]: pgmap v3390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:50 smithi193 ceph-mon[32782]: pgmap v3391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:50 smithi196 ceph-mon[32572]: pgmap v3391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:50 smithi110 ceph-mon[28069]: pgmap v3391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:52 smithi196 ceph-mon[32572]: pgmap v3392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5386.865493 secs 2024-04-26T13:17:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:52 smithi110 ceph-mon[28069]: pgmap v3392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5386.865493 secs 2024-04-26T13:17:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:52 smithi193 ceph-mon[32782]: pgmap v3392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5386.865493 secs 2024-04-26T13:17:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:54 smithi196 ceph-mon[32572]: pgmap v3393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:54 smithi110 ceph-mon[28069]: pgmap v3393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:54 smithi193 ceph-mon[32782]: pgmap v3393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:17:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:56 smithi196 ceph-mon[32572]: pgmap v3394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:56 smithi110 ceph-mon[28069]: pgmap v3394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:56 smithi193 ceph-mon[32782]: pgmap v3394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5391.865591 secs 2024-04-26T13:17:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5391.865591 secs 2024-04-26T13:17:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5391.865591 secs 2024-04-26T13:17:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:17:58 smithi196 ceph-mon[32572]: pgmap v3395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:17:58 smithi110 ceph-mon[28069]: pgmap v3395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:17:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:17:58 smithi193 ceph-mon[32782]: pgmap v3395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:00 smithi196 ceph-mon[32572]: pgmap v3396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:00 smithi110 ceph-mon[28069]: pgmap v3396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:00 smithi193 ceph-mon[32782]: pgmap v3396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:02 smithi196 ceph-mon[32572]: pgmap v3397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5396.865706 secs 2024-04-26T13:18:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:02 smithi110 ceph-mon[28069]: pgmap v3397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5396.865706 secs 2024-04-26T13:18:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:02 smithi193 ceph-mon[32782]: pgmap v3397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5396.865706 secs 2024-04-26T13:18:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:04 smithi196 ceph-mon[32572]: pgmap v3398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:04 smithi110 ceph-mon[28069]: pgmap v3398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:04 smithi193 ceph-mon[32782]: pgmap v3398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:18:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:18:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:18:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:06 smithi196 ceph-mon[32572]: pgmap v3399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:18:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:18:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:18:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:06 smithi110 ceph-mon[28069]: pgmap v3399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:18:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:18:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:18:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:06 smithi193 ceph-mon[32782]: pgmap v3399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:18:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:18:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:18:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5401.865796 secs 2024-04-26T13:18:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:07 smithi196 ceph-mon[32572]: pgmap v3400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T13:18:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:07 smithi196 ceph-mon[32572]: pgmap v3401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:08.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5401.865796 secs 2024-04-26T13:18:08.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:07 smithi193 ceph-mon[32782]: pgmap v3400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T13:18:08.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:07 smithi193 ceph-mon[32782]: pgmap v3401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5401.865796 secs 2024-04-26T13:18:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:07 smithi110 ceph-mon[28069]: pgmap v3400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T13:18:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:07 smithi110 ceph-mon[28069]: pgmap v3401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:09 smithi196 ceph-mon[32572]: pgmap v3402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:09 smithi110 ceph-mon[28069]: pgmap v3402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:09 smithi193 ceph-mon[32782]: pgmap v3402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:11 smithi196 ceph-mon[32572]: pgmap v3403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:11 smithi110 ceph-mon[28069]: pgmap v3403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:11 smithi193 ceph-mon[32782]: pgmap v3403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5406.865909 secs 2024-04-26T13:18:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5406.865909 secs 2024-04-26T13:18:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5406.865909 secs 2024-04-26T13:18:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:13 smithi196 ceph-mon[32572]: pgmap v3404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:13 smithi110 ceph-mon[28069]: pgmap v3404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:13 smithi193 ceph-mon[32782]: pgmap v3404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:15 smithi196 ceph-mon[32572]: pgmap v3405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:15 smithi110 ceph-mon[28069]: pgmap v3405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:15 smithi193 ceph-mon[32782]: pgmap v3405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:18:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.373+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T13:18:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.373+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T13:18:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.373+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 0x7f26000b4670 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f261402d040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T13:18:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.373+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 0x7f26000b4670 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f261402d040 comp rx=0 tx=0).stop 2024-04-26T13:18:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.373+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T13:18:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.373+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T13:18:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.373+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000b2280 0x7f26000b4670 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T13:18:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.373+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 0x7f26000a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T13:18:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.374+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 0x7f26000a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T13:18:16.376 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.376+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 0x7f26000a49b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2614029000 tx=0x7f2614042040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T13:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.396+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T13:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.396+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T13:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.396+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T13:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.396+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T13:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.397+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T13:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.398+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T13:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:16.398+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T13:18:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:17.230+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:18:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:17.230+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006660 con 0x7f261c104b50 2024-04-26T13:18:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:17.231+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 45 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006660 con 0x55db1be4fdd0 2024-04-26T13:18:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:18:17.231+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 45 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:18:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5411.866027 secs 2024-04-26T13:18:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:17 smithi196 ceph-mon[32572]: pgmap v3406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:18:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5411.866027 secs 2024-04-26T13:18:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:17 smithi110 ceph-mon[28069]: pgmap v3406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:18:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5411.866027 secs 2024-04-26T13:18:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:17 smithi193 ceph-mon[32782]: pgmap v3406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:18:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:19 smithi196 ceph-mon[32572]: pgmap v3407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:19 smithi110 ceph-mon[28069]: pgmap v3407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:19 smithi193 ceph-mon[32782]: pgmap v3407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:21 smithi196 ceph-mon[32572]: pgmap v3408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:21 smithi110 ceph-mon[28069]: pgmap v3408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:21 smithi193 ceph-mon[32782]: pgmap v3408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5416.866148 secs 2024-04-26T13:18:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5416.866148 secs 2024-04-26T13:18:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5416.866148 secs 2024-04-26T13:18:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:23 smithi196 ceph-mon[32572]: pgmap v3409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:23 smithi110 ceph-mon[28069]: pgmap v3409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:23 smithi193 ceph-mon[32782]: pgmap v3409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:24 smithi193 ceph-mon[32782]: pgmap v3410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:24 smithi196 ceph-mon[32572]: pgmap v3410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:24 smithi110 ceph-mon[28069]: pgmap v3410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5421.866266 secs 2024-04-26T13:18:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:27 smithi196 ceph-mon[32572]: pgmap v3411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5421.866266 secs 2024-04-26T13:18:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:27 smithi110 ceph-mon[28069]: pgmap v3411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5421.866266 secs 2024-04-26T13:18:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:27 smithi193 ceph-mon[32782]: pgmap v3411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:29 smithi196 ceph-mon[32572]: pgmap v3412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:29 smithi110 ceph-mon[28069]: pgmap v3412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:29 smithi193 ceph-mon[32782]: pgmap v3412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:31 smithi196 ceph-mon[32572]: pgmap v3413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:31 smithi110 ceph-mon[28069]: pgmap v3413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:31 smithi193 ceph-mon[32782]: pgmap v3413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5426.866364 secs 2024-04-26T13:18:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5426.866364 secs 2024-04-26T13:18:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5426.866364 secs 2024-04-26T13:18:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:33 smithi196 ceph-mon[32572]: pgmap v3414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:33 smithi110 ceph-mon[28069]: pgmap v3414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:33 smithi193 ceph-mon[32782]: pgmap v3414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:35 smithi110 ceph-mon[28069]: pgmap v3415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:35 smithi193 ceph-mon[32782]: pgmap v3415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:35 smithi196 ceph-mon[32572]: pgmap v3415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5431.866444 secs 2024-04-26T13:18:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:37 smithi110 ceph-mon[28069]: pgmap v3416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5431.866444 secs 2024-04-26T13:18:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:37 smithi193 ceph-mon[32782]: pgmap v3416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5431.866444 secs 2024-04-26T13:18:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:37 smithi196 ceph-mon[32572]: pgmap v3416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:39 smithi110 ceph-mon[28069]: pgmap v3417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:39 smithi193 ceph-mon[32782]: pgmap v3417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:39 smithi196 ceph-mon[32572]: pgmap v3417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:41 smithi110 ceph-mon[28069]: pgmap v3418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:41 smithi193 ceph-mon[32782]: pgmap v3418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:41 smithi196 ceph-mon[32572]: pgmap v3418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5436.866579 secs 2024-04-26T13:18:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5436.866579 secs 2024-04-26T13:18:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5436.866579 secs 2024-04-26T13:18:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:43 smithi110 ceph-mon[28069]: pgmap v3419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:43 smithi193 ceph-mon[32782]: pgmap v3419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:43 smithi196 ceph-mon[32572]: pgmap v3419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:45 smithi110 ceph-mon[28069]: pgmap v3420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:45 smithi193 ceph-mon[32782]: pgmap v3420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:45 smithi196 ceph-mon[32572]: pgmap v3420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:47.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5441.866663 secs 2024-04-26T13:18:47.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:47 smithi196 ceph-mon[32572]: pgmap v3421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5441.866663 secs 2024-04-26T13:18:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:47 smithi193 ceph-mon[32782]: pgmap v3421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5441.866663 secs 2024-04-26T13:18:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:47 smithi110 ceph-mon[28069]: pgmap v3421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:49 smithi193 ceph-mon[32782]: pgmap v3422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:49 smithi196 ceph-mon[32572]: pgmap v3422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:49 smithi110 ceph-mon[28069]: pgmap v3422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:51 smithi193 ceph-mon[32782]: pgmap v3423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:51 smithi196 ceph-mon[32572]: pgmap v3423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:51 smithi110 ceph-mon[28069]: pgmap v3423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5446.866783 secs 2024-04-26T13:18:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5446.866783 secs 2024-04-26T13:18:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5446.866783 secs 2024-04-26T13:18:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:53 smithi193 ceph-mon[32782]: pgmap v3424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:53 smithi196 ceph-mon[32572]: pgmap v3424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:53 smithi110 ceph-mon[28069]: pgmap v3424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:18:55.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:55 smithi110 ceph-mon[28069]: pgmap v3425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:55 smithi193 ceph-mon[32782]: pgmap v3425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:55 smithi196 ceph-mon[32572]: pgmap v3425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5451.866905 secs 2024-04-26T13:18:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:57 smithi193 ceph-mon[32782]: pgmap v3426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5451.866905 secs 2024-04-26T13:18:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:57 smithi196 ceph-mon[32572]: pgmap v3426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5451.866905 secs 2024-04-26T13:18:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:57 smithi110 ceph-mon[28069]: pgmap v3426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:18:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:18:59 smithi193 ceph-mon[32782]: pgmap v3427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:18:59 smithi196 ceph-mon[32572]: pgmap v3427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:18:59 smithi110 ceph-mon[28069]: pgmap v3427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:01 smithi193 ceph-mon[32782]: pgmap v3428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:01 smithi196 ceph-mon[32572]: pgmap v3428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:01 smithi110 ceph-mon[28069]: pgmap v3428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:19:02.238+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006660 con 0x7f261c104b50 2024-04-26T13:19:02.238 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:19:02.238+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:19:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:19:02.239+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 46 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:19:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:19:02.239+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 46 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006660 con 0x55db1be4fdd0 2024-04-26T13:19:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5456.867024 secs 2024-04-26T13:19:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5456.867024 secs 2024-04-26T13:19:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5456.867024 secs 2024-04-26T13:19:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:19:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:19:02.818+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:19:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:19:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:19:02.818+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:19:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:19:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:19:02.818+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:19:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:19:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:19:02.818+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:19:03.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:19:02 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:19:02.818+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:19:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:03 smithi193 ceph-mon[32782]: pgmap v3429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:03 smithi196 ceph-mon[32572]: pgmap v3429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:03 smithi110 ceph-mon[28069]: pgmap v3429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:05 smithi193 ceph-mon[32782]: pgmap v3430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:05 smithi196 ceph-mon[32572]: pgmap v3430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:05 smithi110 ceph-mon[28069]: pgmap v3430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5461.867105 secs 2024-04-26T13:19:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:07 smithi193 ceph-mon[32782]: pgmap v3431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:19:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5461.867105 secs 2024-04-26T13:19:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:07 smithi196 ceph-mon[32572]: pgmap v3431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:19:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5461.867105 secs 2024-04-26T13:19:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:07 smithi110 ceph-mon[28069]: pgmap v3431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:19:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:19:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:19:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:19:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:19:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:19:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:19:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:19:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:19:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:19:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:09 smithi196 ceph-mon[32572]: pgmap v3432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 177 B/s wr, 2 op/s 2024-04-26T13:19:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:09 smithi196 ceph-mon[32572]: pgmap v3433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:09 smithi110 ceph-mon[28069]: pgmap v3432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 177 B/s wr, 2 op/s 2024-04-26T13:19:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:09 smithi110 ceph-mon[28069]: pgmap v3433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:09 smithi193 ceph-mon[32782]: pgmap v3432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 177 B/s wr, 2 op/s 2024-04-26T13:19:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:09 smithi193 ceph-mon[32782]: pgmap v3433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:11 smithi196 ceph-mon[32572]: pgmap v3434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:11 smithi110 ceph-mon[28069]: pgmap v3434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:11 smithi193 ceph-mon[32782]: pgmap v3434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5466.867175 secs 2024-04-26T13:19:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5466.867175 secs 2024-04-26T13:19:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5466.867175 secs 2024-04-26T13:19:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:13 smithi196 ceph-mon[32572]: pgmap v3435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 643 B/s rd, 214 B/s wr, 1 op/s 2024-04-26T13:19:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:13 smithi110 ceph-mon[28069]: pgmap v3435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 643 B/s rd, 214 B/s wr, 1 op/s 2024-04-26T13:19:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:13 smithi193 ceph-mon[32782]: pgmap v3435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 643 B/s rd, 214 B/s wr, 1 op/s 2024-04-26T13:19:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:15 smithi196 ceph-mon[32572]: pgmap v3436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:15 smithi110 ceph-mon[28069]: pgmap v3436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:15 smithi193 ceph-mon[32782]: pgmap v3436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:17 smithi196 ceph-mon[32572]: pgmap v3437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5471.867275 secs 2024-04-26T13:19:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:17 smithi110 ceph-mon[28069]: pgmap v3437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5471.867275 secs 2024-04-26T13:19:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:17 smithi193 ceph-mon[32782]: pgmap v3437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:19:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5471.867275 secs 2024-04-26T13:19:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:19 smithi196 ceph-mon[32572]: pgmap v3438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:19:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:19 smithi110 ceph-mon[28069]: pgmap v3438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:19:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:19 smithi193 ceph-mon[32782]: pgmap v3438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:19:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:21 smithi196 ceph-mon[32572]: pgmap v3439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:21 smithi110 ceph-mon[28069]: pgmap v3439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:21 smithi193 ceph-mon[32782]: pgmap v3439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5476.867393 secs 2024-04-26T13:19:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5476.867393 secs 2024-04-26T13:19:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5476.867393 secs 2024-04-26T13:19:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:23 smithi196 ceph-mon[32572]: pgmap v3440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:23 smithi110 ceph-mon[28069]: pgmap v3440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:23 smithi193 ceph-mon[32782]: pgmap v3440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:25 smithi196 ceph-mon[32572]: pgmap v3441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:25 smithi110 ceph-mon[28069]: pgmap v3441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:25 smithi193 ceph-mon[32782]: pgmap v3441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:27 smithi196 ceph-mon[32572]: pgmap v3442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5481.867509 secs 2024-04-26T13:19:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:27 smithi110 ceph-mon[28069]: pgmap v3442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5481.867509 secs 2024-04-26T13:19:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:27 smithi193 ceph-mon[32782]: pgmap v3442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5481.867509 secs 2024-04-26T13:19:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:29 smithi196 ceph-mon[32572]: pgmap v3443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:29 smithi110 ceph-mon[28069]: pgmap v3443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:29 smithi193 ceph-mon[32782]: pgmap v3443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:31 smithi196 ceph-mon[32572]: pgmap v3444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:31 smithi110 ceph-mon[28069]: pgmap v3444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:31 smithi193 ceph-mon[32782]: pgmap v3444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5486.867634 secs 2024-04-26T13:19:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5486.867634 secs 2024-04-26T13:19:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5486.867634 secs 2024-04-26T13:19:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:33 smithi196 ceph-mon[32572]: pgmap v3445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:33 smithi110 ceph-mon[28069]: pgmap v3445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:33 smithi193 ceph-mon[32782]: pgmap v3445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:35 smithi196 ceph-mon[32572]: pgmap v3446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:35 smithi110 ceph-mon[28069]: pgmap v3446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:35 smithi193 ceph-mon[32782]: pgmap v3446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:37 smithi196 ceph-mon[32572]: pgmap v3447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5491.867749 secs 2024-04-26T13:19:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:37 smithi110 ceph-mon[28069]: pgmap v3447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5491.867749 secs 2024-04-26T13:19:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:37 smithi193 ceph-mon[32782]: pgmap v3447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5491.867749 secs 2024-04-26T13:19:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:39 smithi196 ceph-mon[32572]: pgmap v3448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:39 smithi110 ceph-mon[28069]: pgmap v3448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:39 smithi193 ceph-mon[32782]: pgmap v3448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:41 smithi196 ceph-mon[32572]: pgmap v3449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:41 smithi110 ceph-mon[28069]: pgmap v3449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:41 smithi193 ceph-mon[32782]: pgmap v3449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5496.867897 secs 2024-04-26T13:19:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5496.867897 secs 2024-04-26T13:19:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5496.867897 secs 2024-04-26T13:19:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:43 smithi196 ceph-mon[32572]: pgmap v3450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:43 smithi110 ceph-mon[28069]: pgmap v3450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:43 smithi193 ceph-mon[32782]: pgmap v3450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:45 smithi196 ceph-mon[32572]: pgmap v3451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:45 smithi110 ceph-mon[28069]: pgmap v3451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:45 smithi193 ceph-mon[32782]: pgmap v3451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:47 smithi110 ceph-mon[28069]: pgmap v3452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5501.867993 secs 2024-04-26T13:19:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:47 smithi193 ceph-mon[32782]: pgmap v3452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5501.867993 secs 2024-04-26T13:19:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:47 smithi196 ceph-mon[32572]: pgmap v3452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5501.867993 secs 2024-04-26T13:19:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:49 smithi110 ceph-mon[28069]: pgmap v3453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:49 smithi193 ceph-mon[32782]: pgmap v3453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:49 smithi196 ceph-mon[32572]: pgmap v3453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:50 smithi110 ceph-mon[28069]: pgmap v3454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:50 smithi193 ceph-mon[32782]: pgmap v3454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:50 smithi196 ceph-mon[32572]: pgmap v3454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5506.868092 secs 2024-04-26T13:19:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5506.868092 secs 2024-04-26T13:19:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5506.868092 secs 2024-04-26T13:19:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:53 smithi193 ceph-mon[32782]: pgmap v3455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:53 smithi196 ceph-mon[32572]: pgmap v3455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:53 smithi110 ceph-mon[28069]: pgmap v3455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:55.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:55 smithi110 ceph-mon[28069]: pgmap v3456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:55 smithi193 ceph-mon[32782]: pgmap v3456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:55 smithi196 ceph-mon[32572]: pgmap v3456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:57 smithi193 ceph-mon[32782]: pgmap v3457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5511.868210 secs 2024-04-26T13:19:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:57 smithi196 ceph-mon[32572]: pgmap v3457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5511.868210 secs 2024-04-26T13:19:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:57 smithi110 ceph-mon[28069]: pgmap v3457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:19:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5511.868210 secs 2024-04-26T13:19:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:19:59 smithi193 ceph-mon[32782]: pgmap v3458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:19:59 smithi196 ceph-mon[32572]: pgmap v3458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:19:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:19:59 smithi110 ceph-mon[28069]: pgmap v3458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:20:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:20:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:20:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:01 smithi193 ceph-mon[32782]: pgmap v3459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:01 smithi196 ceph-mon[32572]: pgmap v3459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:01 smithi110 ceph-mon[28069]: pgmap v3459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5516.868277 secs 2024-04-26T13:20:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5516.868277 secs 2024-04-26T13:20:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5516.868277 secs 2024-04-26T13:20:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:03 smithi193 ceph-mon[32782]: pgmap v3460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:03 smithi196 ceph-mon[32572]: pgmap v3460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:03 smithi110 ceph-mon[28069]: pgmap v3460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:05 smithi193 ceph-mon[32782]: pgmap v3461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:05 smithi196 ceph-mon[32572]: pgmap v3461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:05 smithi110 ceph-mon[28069]: pgmap v3461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:07 smithi193 ceph-mon[32782]: pgmap v3462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5521.868383 secs 2024-04-26T13:20:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:07 smithi196 ceph-mon[32572]: pgmap v3462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5521.868383 secs 2024-04-26T13:20:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:07 smithi110 ceph-mon[28069]: pgmap v3462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5521.868383 secs 2024-04-26T13:20:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:09 smithi196 ceph-mon[32572]: pgmap v3463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:20:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:09 smithi110 ceph-mon[28069]: pgmap v3463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:20:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:09 smithi193 ceph-mon[32782]: pgmap v3463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:20:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:20:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:20:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:10 smithi196 ceph-mon[32572]: pgmap v3464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:20:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:10 smithi196 ceph-mon[32572]: pgmap v3465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:20:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:20:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:20:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:10 smithi110 ceph-mon[28069]: pgmap v3464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:20:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:10 smithi110 ceph-mon[28069]: pgmap v3465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:20:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:20:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:20:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:10 smithi193 ceph-mon[32782]: pgmap v3464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:20:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:10 smithi193 ceph-mon[32782]: pgmap v3465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:20:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5526.868485 secs 2024-04-26T13:20:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:12 smithi193 ceph-mon[32782]: pgmap v3466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5526.868485 secs 2024-04-26T13:20:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:12 smithi196 ceph-mon[32572]: pgmap v3466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5526.868485 secs 2024-04-26T13:20:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:12 smithi110 ceph-mon[28069]: pgmap v3466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:14 smithi193 ceph-mon[32782]: pgmap v3467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:14 smithi196 ceph-mon[32572]: pgmap v3467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:14 smithi110 ceph-mon[28069]: pgmap v3467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:16 smithi193 ceph-mon[32782]: pgmap v3468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:16 smithi196 ceph-mon[32572]: pgmap v3468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:16 smithi110 ceph-mon[28069]: pgmap v3468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5531.868584 secs 2024-04-26T13:20:17.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5531.868584 secs 2024-04-26T13:20:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5531.868584 secs 2024-04-26T13:20:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:18 smithi193 ceph-mon[32782]: pgmap v3469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:18 smithi196 ceph-mon[32572]: pgmap v3469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:18 smithi110 ceph-mon[28069]: pgmap v3469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:20:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:20 smithi193 ceph-mon[32782]: pgmap v3470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:20:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:20 smithi196 ceph-mon[32572]: pgmap v3470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:20:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:20 smithi110 ceph-mon[28069]: pgmap v3470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:20:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5536.868709 secs 2024-04-26T13:20:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:22 smithi193 ceph-mon[32782]: pgmap v3471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5536.868709 secs 2024-04-26T13:20:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:22 smithi196 ceph-mon[32572]: pgmap v3471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5536.868709 secs 2024-04-26T13:20:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:22 smithi110 ceph-mon[28069]: pgmap v3471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:24 smithi193 ceph-mon[32782]: pgmap v3472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:24 smithi196 ceph-mon[32572]: pgmap v3472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:24 smithi110 ceph-mon[28069]: pgmap v3472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:26.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:26 smithi110 ceph-mon[28069]: pgmap v3473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:26 smithi193 ceph-mon[32782]: pgmap v3473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:26 smithi196 ceph-mon[32572]: pgmap v3473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5541.868827 secs 2024-04-26T13:20:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5541.868827 secs 2024-04-26T13:20:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5541.868827 secs 2024-04-26T13:20:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:28 smithi193 ceph-mon[32782]: pgmap v3474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:28 smithi196 ceph-mon[32572]: pgmap v3474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:28 smithi110 ceph-mon[28069]: pgmap v3474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:30 smithi193 ceph-mon[32782]: pgmap v3475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:30 smithi196 ceph-mon[32572]: pgmap v3475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:30 smithi110 ceph-mon[28069]: pgmap v3475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5546.868947 secs 2024-04-26T13:20:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:32 smithi193 ceph-mon[32782]: pgmap v3476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5546.868947 secs 2024-04-26T13:20:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:32 smithi196 ceph-mon[32572]: pgmap v3476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5546.868947 secs 2024-04-26T13:20:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:32 smithi110 ceph-mon[28069]: pgmap v3476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:34 smithi193 ceph-mon[32782]: pgmap v3477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:34 smithi196 ceph-mon[32572]: pgmap v3477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:34 smithi110 ceph-mon[28069]: pgmap v3477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:36 smithi196 ceph-mon[32572]: pgmap v3478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:36 smithi110 ceph-mon[28069]: pgmap v3478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:36 smithi193 ceph-mon[32782]: pgmap v3478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5551.869064 secs 2024-04-26T13:20:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5551.869064 secs 2024-04-26T13:20:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5551.869064 secs 2024-04-26T13:20:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:38 smithi196 ceph-mon[32572]: pgmap v3479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:39.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:38 smithi193 ceph-mon[32782]: pgmap v3479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:38 smithi110 ceph-mon[28069]: pgmap v3479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:40 smithi196 ceph-mon[32572]: pgmap v3480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:40 smithi110 ceph-mon[28069]: pgmap v3480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:40 smithi193 ceph-mon[32782]: pgmap v3480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5556.869190 secs 2024-04-26T13:20:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:42 smithi196 ceph-mon[32572]: pgmap v3481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5556.869190 secs 2024-04-26T13:20:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:42 smithi110 ceph-mon[28069]: pgmap v3481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5556.869190 secs 2024-04-26T13:20:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:42 smithi193 ceph-mon[32782]: pgmap v3481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:44 smithi196 ceph-mon[32572]: pgmap v3482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:44 smithi110 ceph-mon[28069]: pgmap v3482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:44 smithi193 ceph-mon[32782]: pgmap v3482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:46 smithi196 ceph-mon[32572]: pgmap v3483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:46 smithi110 ceph-mon[28069]: pgmap v3483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:46 smithi193 ceph-mon[32782]: pgmap v3483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5561.869309 secs 2024-04-26T13:20:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5561.869309 secs 2024-04-26T13:20:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5561.869309 secs 2024-04-26T13:20:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:48 smithi196 ceph-mon[32572]: pgmap v3484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:48 smithi110 ceph-mon[28069]: pgmap v3484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:48 smithi193 ceph-mon[32782]: pgmap v3484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:50 smithi196 ceph-mon[32572]: pgmap v3485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:50 smithi110 ceph-mon[28069]: pgmap v3485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:50 smithi193 ceph-mon[32782]: pgmap v3485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5566.869404 secs 2024-04-26T13:20:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:52 smithi196 ceph-mon[32572]: pgmap v3486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5566.869404 secs 2024-04-26T13:20:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:52 smithi110 ceph-mon[28069]: pgmap v3486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5566.869404 secs 2024-04-26T13:20:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:52 smithi193 ceph-mon[32782]: pgmap v3486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:54 smithi196 ceph-mon[32572]: pgmap v3487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:54 smithi110 ceph-mon[28069]: pgmap v3487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:54 smithi193 ceph-mon[32782]: pgmap v3487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:56 smithi196 ceph-mon[32572]: pgmap v3488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:56 smithi110 ceph-mon[28069]: pgmap v3488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:56 smithi193 ceph-mon[32782]: pgmap v3488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:20:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5571.869542 secs 2024-04-26T13:20:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5571.869542 secs 2024-04-26T13:20:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5571.869542 secs 2024-04-26T13:20:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:20:58 smithi196 ceph-mon[32572]: pgmap v3489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:20:58 smithi110 ceph-mon[28069]: pgmap v3489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:20:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:20:58 smithi193 ceph-mon[32782]: pgmap v3489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:00 smithi196 ceph-mon[32572]: pgmap v3490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:00 smithi110 ceph-mon[28069]: pgmap v3490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:00 smithi193 ceph-mon[32782]: pgmap v3490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5576.869683 secs 2024-04-26T13:21:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:02 smithi196 ceph-mon[32572]: pgmap v3491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5576.869683 secs 2024-04-26T13:21:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:02 smithi110 ceph-mon[28069]: pgmap v3491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5576.869683 secs 2024-04-26T13:21:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:02 smithi193 ceph-mon[32782]: pgmap v3491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:04 smithi196 ceph-mon[32572]: pgmap v3492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:04 smithi110 ceph-mon[28069]: pgmap v3492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:04 smithi193 ceph-mon[32782]: pgmap v3492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:06 smithi196 ceph-mon[32572]: pgmap v3493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:06 smithi110 ceph-mon[28069]: pgmap v3493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:06 smithi193 ceph-mon[32782]: pgmap v3493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5581.869819 secs 2024-04-26T13:21:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5581.869819 secs 2024-04-26T13:21:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5581.869819 secs 2024-04-26T13:21:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:08 smithi196 ceph-mon[32572]: pgmap v3494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:09.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:08 smithi193 ceph-mon[32782]: pgmap v3494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:08 smithi110 ceph-mon[28069]: pgmap v3494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:10 smithi196 ceph-mon[32572]: pgmap v3495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:21:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:10 smithi110 ceph-mon[28069]: pgmap v3495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:21:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:10 smithi193 ceph-mon[32782]: pgmap v3495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:21:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:21:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:21:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:21:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:21:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:21:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:21:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:21:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:21:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:21:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:12 smithi196 ceph-mon[32572]: pgmap v3496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T13:21:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:12 smithi196 ceph-mon[32572]: pgmap v3497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5586.869943 secs 2024-04-26T13:21:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:12 smithi110 ceph-mon[28069]: pgmap v3496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T13:21:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:12 smithi110 ceph-mon[28069]: pgmap v3497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5586.869943 secs 2024-04-26T13:21:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:12 smithi193 ceph-mon[32782]: pgmap v3496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T13:21:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:12 smithi193 ceph-mon[32782]: pgmap v3497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5586.869943 secs 2024-04-26T13:21:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:14 smithi110 ceph-mon[28069]: pgmap v3498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:14 smithi193 ceph-mon[32782]: pgmap v3498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:14 smithi196 ceph-mon[32572]: pgmap v3498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:16 smithi110 ceph-mon[28069]: pgmap v3499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:17.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:16 smithi196 ceph-mon[32572]: pgmap v3499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:16 smithi193 ceph-mon[32782]: pgmap v3499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:17.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:21:17.261+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e80065d0 con 0x55db1be4fdd0 2024-04-26T13:21:17.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:21:17.261+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006660 con 0x7f261c104b50 2024-04-26T13:21:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:21:17.262+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 47 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006660 con 0x55db1be4fdd0 2024-04-26T13:21:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:21:17.262+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 47 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e80065d0 con 0x7f261c104b50 2024-04-26T13:21:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5591.870061 secs 2024-04-26T13:21:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5591.870061 secs 2024-04-26T13:21:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5591.870061 secs 2024-04-26T13:21:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:18 smithi110 ceph-mon[28069]: pgmap v3500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T13:21:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:18 smithi193 ceph-mon[32782]: pgmap v3500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T13:21:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:18 smithi196 ceph-mon[32572]: pgmap v3500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T13:21:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:20 smithi110 ceph-mon[28069]: pgmap v3501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:20 smithi193 ceph-mon[32782]: pgmap v3501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:20 smithi196 ceph-mon[32572]: pgmap v3501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:21:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:22 smithi110 ceph-mon[28069]: pgmap v3502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:21:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5596.870178 secs 2024-04-26T13:21:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:22 smithi193 ceph-mon[32782]: pgmap v3502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:21:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5596.870178 secs 2024-04-26T13:21:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:22 smithi196 ceph-mon[32572]: pgmap v3502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:21:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5596.870178 secs 2024-04-26T13:21:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:23 smithi110 ceph-mon[28069]: pgmap v3503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:23 smithi193 ceph-mon[32782]: pgmap v3503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:23 smithi196 ceph-mon[32572]: pgmap v3503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:26 smithi110 ceph-mon[28069]: pgmap v3504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:26 smithi193 ceph-mon[32782]: pgmap v3504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:26 smithi196 ceph-mon[32572]: pgmap v3504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:28 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5601.870301 secs 2024-04-26T13:21:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:28 smithi110 ceph-mon[28069]: pgmap v3505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:28 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5601.870301 secs 2024-04-26T13:21:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:28 smithi193 ceph-mon[32782]: pgmap v3505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:28 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5601.870301 secs 2024-04-26T13:21:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:28 smithi196 ceph-mon[32572]: pgmap v3505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:30 smithi110 ceph-mon[28069]: pgmap v3506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:30 smithi193 ceph-mon[32782]: pgmap v3506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:30 smithi196 ceph-mon[32572]: pgmap v3506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:32 smithi110 ceph-mon[28069]: pgmap v3507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:32 smithi193 ceph-mon[32782]: pgmap v3507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:32 smithi196 ceph-mon[32572]: pgmap v3507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:33 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5606.870419 secs 2024-04-26T13:21:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:33 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5606.870419 secs 2024-04-26T13:21:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:33 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5606.870419 secs 2024-04-26T13:21:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:34 smithi193 ceph-mon[32782]: pgmap v3508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:34 smithi196 ceph-mon[32572]: pgmap v3508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:34 smithi110 ceph-mon[28069]: pgmap v3508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:36 smithi193 ceph-mon[32782]: pgmap v3509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:36 smithi196 ceph-mon[32572]: pgmap v3509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:36 smithi110 ceph-mon[28069]: pgmap v3509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5611.870555 secs 2024-04-26T13:21:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5611.870555 secs 2024-04-26T13:21:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5611.870555 secs 2024-04-26T13:21:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:38 smithi193 ceph-mon[32782]: pgmap v3510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:38 smithi196 ceph-mon[32572]: pgmap v3510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:38 smithi110 ceph-mon[28069]: pgmap v3510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:40 smithi193 ceph-mon[32782]: pgmap v3511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:40 smithi196 ceph-mon[32572]: pgmap v3511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:40 smithi110 ceph-mon[28069]: pgmap v3511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:42 smithi193 ceph-mon[32782]: pgmap v3512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5616.870632 secs 2024-04-26T13:21:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:42 smithi196 ceph-mon[32572]: pgmap v3512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5616.870632 secs 2024-04-26T13:21:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:42 smithi110 ceph-mon[28069]: pgmap v3512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5616.870632 secs 2024-04-26T13:21:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:44 smithi193 ceph-mon[32782]: pgmap v3513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:44 smithi196 ceph-mon[32572]: pgmap v3513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:44 smithi110 ceph-mon[28069]: pgmap v3513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:46 smithi193 ceph-mon[32782]: pgmap v3514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:46 smithi196 ceph-mon[32572]: pgmap v3514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:46 smithi110 ceph-mon[28069]: pgmap v3514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5621.870754 secs 2024-04-26T13:21:47.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5621.870754 secs 2024-04-26T13:21:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5621.870754 secs 2024-04-26T13:21:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:48 smithi193 ceph-mon[32782]: pgmap v3515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:48 smithi196 ceph-mon[32572]: pgmap v3515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:48 smithi110 ceph-mon[28069]: pgmap v3515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:50 smithi193 ceph-mon[32782]: pgmap v3516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:50 smithi196 ceph-mon[32572]: pgmap v3516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:50 smithi110 ceph-mon[28069]: pgmap v3516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:52 smithi193 ceph-mon[32782]: pgmap v3517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5626.870872 secs 2024-04-26T13:21:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:52 smithi196 ceph-mon[32572]: pgmap v3517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5626.870872 secs 2024-04-26T13:21:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:52 smithi110 ceph-mon[28069]: pgmap v3517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5626.870872 secs 2024-04-26T13:21:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:54 smithi193 ceph-mon[32782]: pgmap v3518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:54 smithi196 ceph-mon[32572]: pgmap v3518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:54 smithi110 ceph-mon[28069]: pgmap v3518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:21:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:56 smithi193 ceph-mon[32782]: pgmap v3519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:56 smithi196 ceph-mon[32572]: pgmap v3519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:56 smithi110 ceph-mon[28069]: pgmap v3519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5631.870991 secs 2024-04-26T13:21:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5631.870991 secs 2024-04-26T13:21:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5631.870991 secs 2024-04-26T13:21:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:21:58 smithi196 ceph-mon[32572]: pgmap v3520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:21:58 smithi110 ceph-mon[28069]: pgmap v3520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:21:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:21:58 smithi193 ceph-mon[32782]: pgmap v3520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:00 smithi196 ceph-mon[32572]: pgmap v3521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:00 smithi110 ceph-mon[28069]: pgmap v3521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:00 smithi193 ceph-mon[32782]: pgmap v3521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:01 smithi196 ceph-mon[32572]: pgmap v3522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:01 smithi110 ceph-mon[28069]: pgmap v3522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:01 smithi193 ceph-mon[32782]: pgmap v3522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5636.871124 secs 2024-04-26T13:22:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5636.871124 secs 2024-04-26T13:22:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5636.871124 secs 2024-04-26T13:22:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:03 smithi196 ceph-mon[32572]: pgmap v3523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:03 smithi110 ceph-mon[28069]: pgmap v3523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:03 smithi193 ceph-mon[32782]: pgmap v3523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:05 smithi196 ceph-mon[32572]: pgmap v3524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:05 smithi110 ceph-mon[28069]: pgmap v3524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:05 smithi193 ceph-mon[32782]: pgmap v3524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5641.871260 secs 2024-04-26T13:22:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:07 smithi196 ceph-mon[32572]: pgmap v3525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5641.871260 secs 2024-04-26T13:22:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:07 smithi110 ceph-mon[28069]: pgmap v3525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5641.871260 secs 2024-04-26T13:22:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:07 smithi193 ceph-mon[32782]: pgmap v3525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:09 smithi196 ceph-mon[32572]: pgmap v3526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:09 smithi110 ceph-mon[28069]: pgmap v3526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:09 smithi193 ceph-mon[32782]: pgmap v3526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:12 smithi196 ceph-mon[32572]: pgmap v3527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:22:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:12 smithi110 ceph-mon[28069]: pgmap v3527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:22:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:12 smithi193 ceph-mon[32782]: pgmap v3527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:22:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:13 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5646.871378 secs 2024-04-26T13:22:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:22:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:22:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:13 smithi110 ceph-mon[28069]: pgmap v3528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:22:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:13 smithi110 ceph-mon[28069]: pgmap v3529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:22:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:13 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5646.871378 secs 2024-04-26T13:22:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:22:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:22:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:13 smithi193 ceph-mon[32782]: pgmap v3528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:22:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:13 smithi193 ceph-mon[32782]: pgmap v3529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:22:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:13 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5646.871378 secs 2024-04-26T13:22:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:22:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:22:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:13 smithi196 ceph-mon[32572]: pgmap v3528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:22:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:13 smithi196 ceph-mon[32572]: pgmap v3529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:22:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:15 smithi193 ceph-mon[32782]: pgmap v3530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:15 smithi196 ceph-mon[32572]: pgmap v3530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:15 smithi110 ceph-mon[28069]: pgmap v3530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5651.871494 secs 2024-04-26T13:22:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:17 smithi193 ceph-mon[32782]: pgmap v3531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5651.871494 secs 2024-04-26T13:22:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:17 smithi196 ceph-mon[32572]: pgmap v3531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5651.871494 secs 2024-04-26T13:22:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:17 smithi110 ceph-mon[28069]: pgmap v3531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:19 smithi193 ceph-mon[32782]: pgmap v3532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:19 smithi196 ceph-mon[32572]: pgmap v3532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:19 smithi110 ceph-mon[28069]: pgmap v3532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:21 smithi193 ceph-mon[32782]: pgmap v3533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:21 smithi196 ceph-mon[32572]: pgmap v3533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:21 smithi110 ceph-mon[28069]: pgmap v3533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:22:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5656.871632 secs 2024-04-26T13:22:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5656.871632 secs 2024-04-26T13:22:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5656.871632 secs 2024-04-26T13:22:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:23 smithi193 ceph-mon[32782]: pgmap v3534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:22:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:23 smithi196 ceph-mon[32572]: pgmap v3534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:22:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:23 smithi110 ceph-mon[28069]: pgmap v3534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:22:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:25 smithi193 ceph-mon[32782]: pgmap v3535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:25 smithi196 ceph-mon[32572]: pgmap v3535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:25 smithi110 ceph-mon[28069]: pgmap v3535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5661.871695 secs 2024-04-26T13:22:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:27 smithi193 ceph-mon[32782]: pgmap v3536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5661.871695 secs 2024-04-26T13:22:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:27 smithi196 ceph-mon[32572]: pgmap v3536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5661.871695 secs 2024-04-26T13:22:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:27 smithi110 ceph-mon[28069]: pgmap v3536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:29 smithi193 ceph-mon[32782]: pgmap v3537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:29 smithi196 ceph-mon[32572]: pgmap v3537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:29 smithi110 ceph-mon[28069]: pgmap v3537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:31 smithi193 ceph-mon[32782]: pgmap v3538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:31 smithi196 ceph-mon[32572]: pgmap v3538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:31 smithi110 ceph-mon[28069]: pgmap v3538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5666.871773 secs 2024-04-26T13:22:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5666.871773 secs 2024-04-26T13:22:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5666.871773 secs 2024-04-26T13:22:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:33 smithi196 ceph-mon[32572]: pgmap v3539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:33 smithi110 ceph-mon[28069]: pgmap v3539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:33 smithi193 ceph-mon[32782]: pgmap v3539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:35 smithi196 ceph-mon[32572]: pgmap v3540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:35 smithi110 ceph-mon[28069]: pgmap v3540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:35 smithi193 ceph-mon[32782]: pgmap v3540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5671.871890 secs 2024-04-26T13:22:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:37 smithi196 ceph-mon[32572]: pgmap v3541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5671.871890 secs 2024-04-26T13:22:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:37 smithi110 ceph-mon[28069]: pgmap v3541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5671.871890 secs 2024-04-26T13:22:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:37 smithi193 ceph-mon[32782]: pgmap v3541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:39 smithi196 ceph-mon[32572]: pgmap v3542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:39 smithi110 ceph-mon[28069]: pgmap v3542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:39 smithi193 ceph-mon[32782]: pgmap v3542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:41.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:41 smithi193 ceph-mon[32782]: pgmap v3543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:41 smithi196 ceph-mon[32572]: pgmap v3543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:41 smithi110 ceph-mon[28069]: pgmap v3543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5676.871988 secs 2024-04-26T13:22:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5676.871988 secs 2024-04-26T13:22:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5676.871988 secs 2024-04-26T13:22:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:43 smithi196 ceph-mon[32572]: pgmap v3544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:43 smithi110 ceph-mon[28069]: pgmap v3544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:43 smithi193 ceph-mon[32782]: pgmap v3544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:45 smithi196 ceph-mon[32572]: pgmap v3545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:45 smithi110 ceph-mon[28069]: pgmap v3545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:45 smithi193 ceph-mon[32782]: pgmap v3545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5681.872106 secs 2024-04-26T13:22:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:47 smithi196 ceph-mon[32572]: pgmap v3546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5681.872106 secs 2024-04-26T13:22:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:47 smithi110 ceph-mon[28069]: pgmap v3546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5681.872106 secs 2024-04-26T13:22:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:47 smithi193 ceph-mon[32782]: pgmap v3546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:49 smithi196 ceph-mon[32572]: pgmap v3547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:49 smithi110 ceph-mon[28069]: pgmap v3547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:49 smithi193 ceph-mon[32782]: pgmap v3547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:51 smithi196 ceph-mon[32572]: pgmap v3548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:51 smithi110 ceph-mon[28069]: pgmap v3548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:51 smithi193 ceph-mon[32782]: pgmap v3548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5686.872237 secs 2024-04-26T13:22:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5686.872237 secs 2024-04-26T13:22:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5686.872237 secs 2024-04-26T13:22:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:53 smithi196 ceph-mon[32572]: pgmap v3549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:53 smithi110 ceph-mon[28069]: pgmap v3549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:53 smithi193 ceph-mon[32782]: pgmap v3549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:22:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:55 smithi196 ceph-mon[32572]: pgmap v3550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:55 smithi110 ceph-mon[28069]: pgmap v3550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:55 smithi193 ceph-mon[32782]: pgmap v3550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5691.872353 secs 2024-04-26T13:22:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:57 smithi196 ceph-mon[32572]: pgmap v3551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5691.872353 secs 2024-04-26T13:22:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:57 smithi110 ceph-mon[28069]: pgmap v3551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:22:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5691.872353 secs 2024-04-26T13:22:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:57 smithi193 ceph-mon[32782]: pgmap v3551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:22:59 smithi196 ceph-mon[32572]: pgmap v3552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:22:59 smithi110 ceph-mon[28069]: pgmap v3552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:22:59 smithi193 ceph-mon[32782]: pgmap v3552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:01 smithi196 ceph-mon[32572]: pgmap v3553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:01 smithi110 ceph-mon[28069]: pgmap v3553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:01 smithi193 ceph-mon[32782]: pgmap v3553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5696.872492 secs 2024-04-26T13:23:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5696.872492 secs 2024-04-26T13:23:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5696.872492 secs 2024-04-26T13:23:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:03 smithi196 ceph-mon[32572]: pgmap v3554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:03 smithi110 ceph-mon[28069]: pgmap v3554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:03 smithi193 ceph-mon[32782]: pgmap v3554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:05 smithi196 ceph-mon[32572]: pgmap v3555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:05 smithi110 ceph-mon[28069]: pgmap v3555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:05 smithi193 ceph-mon[32782]: pgmap v3555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5701.872613 secs 2024-04-26T13:23:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:07 smithi196 ceph-mon[32572]: pgmap v3556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5701.872613 secs 2024-04-26T13:23:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:07 smithi110 ceph-mon[28069]: pgmap v3556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5701.872613 secs 2024-04-26T13:23:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:07 smithi193 ceph-mon[32782]: pgmap v3556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:09 smithi196 ceph-mon[32572]: pgmap v3557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:09 smithi110 ceph-mon[28069]: pgmap v3557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:09 smithi193 ceph-mon[32782]: pgmap v3557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:11 smithi196 ceph-mon[32572]: pgmap v3558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:11 smithi110 ceph-mon[28069]: pgmap v3558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:11 smithi193 ceph-mon[32782]: pgmap v3558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5706.872715 secs 2024-04-26T13:23:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5706.872715 secs 2024-04-26T13:23:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5706.872715 secs 2024-04-26T13:23:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:13 smithi196 ceph-mon[32572]: pgmap v3559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:23:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:23:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:23:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:13 smithi110 ceph-mon[28069]: pgmap v3559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:23:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:23:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:23:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:13 smithi193 ceph-mon[32782]: pgmap v3559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:23:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:23:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:23:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:15 smithi110 ceph-mon[28069]: pgmap v3560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:23:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:23:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:23:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:15 smithi193 ceph-mon[32782]: pgmap v3560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:23:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:23:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:23:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:15 smithi196 ceph-mon[32572]: pgmap v3560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:23:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:23:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:23:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:16 smithi110 ceph-mon[28069]: pgmap v3561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T13:23:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:16 smithi110 ceph-mon[28069]: pgmap v3562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:16 smithi193 ceph-mon[32782]: pgmap v3561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T13:23:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:16 smithi193 ceph-mon[32782]: pgmap v3562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:17.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:16 smithi196 ceph-mon[32572]: pgmap v3561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T13:23:17.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:16 smithi196 ceph-mon[32572]: pgmap v3562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5711.872837 secs 2024-04-26T13:23:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5711.872837 secs 2024-04-26T13:23:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5711.872837 secs 2024-04-26T13:23:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:18 smithi110 ceph-mon[28069]: pgmap v3563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:23:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:18 smithi193 ceph-mon[32782]: pgmap v3563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:23:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:18 smithi196 ceph-mon[32572]: pgmap v3563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:23:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:20 smithi110 ceph-mon[28069]: pgmap v3564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:20 smithi193 ceph-mon[32782]: pgmap v3564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:20 smithi196 ceph-mon[32572]: pgmap v3564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:22 smithi193 ceph-mon[32782]: pgmap v3565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:23:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5716.872955 secs 2024-04-26T13:23:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:22 smithi196 ceph-mon[32572]: pgmap v3565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:23:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5716.872955 secs 2024-04-26T13:23:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:22 smithi110 ceph-mon[28069]: pgmap v3565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T13:23:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5716.872955 secs 2024-04-26T13:23:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:24 smithi193 ceph-mon[32782]: pgmap v3566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:24 smithi196 ceph-mon[32572]: pgmap v3566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:24 smithi110 ceph-mon[28069]: pgmap v3566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:27.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:26 smithi110 ceph-mon[28069]: pgmap v3567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:23:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:26 smithi193 ceph-mon[32782]: pgmap v3567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:23:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:26 smithi196 ceph-mon[32572]: pgmap v3567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:23:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5721.873033 secs 2024-04-26T13:23:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5721.873033 secs 2024-04-26T13:23:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5721.873033 secs 2024-04-26T13:23:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:28 smithi193 ceph-mon[32782]: pgmap v3568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:28 smithi196 ceph-mon[32572]: pgmap v3568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:28 smithi110 ceph-mon[28069]: pgmap v3568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:29 smithi193 ceph-mon[32782]: pgmap v3569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:29 smithi196 ceph-mon[32572]: pgmap v3569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:29 smithi110 ceph-mon[28069]: pgmap v3569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:32 smithi110 ceph-mon[28069]: pgmap v3570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:32 smithi193 ceph-mon[32782]: pgmap v3570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:32 smithi196 ceph-mon[32572]: pgmap v3570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:33 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5726.873152 secs 2024-04-26T13:23:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:33 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5726.873152 secs 2024-04-26T13:23:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:33 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5726.873152 secs 2024-04-26T13:23:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:34 smithi193 ceph-mon[32782]: pgmap v3571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:34 smithi196 ceph-mon[32572]: pgmap v3571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:34 smithi110 ceph-mon[28069]: pgmap v3571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:36 smithi193 ceph-mon[32782]: pgmap v3572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:36 smithi196 ceph-mon[32572]: pgmap v3572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:36 smithi110 ceph-mon[28069]: pgmap v3572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5731.873260 secs 2024-04-26T13:23:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5731.873260 secs 2024-04-26T13:23:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5731.873260 secs 2024-04-26T13:23:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:38 smithi193 ceph-mon[32782]: pgmap v3573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:38 smithi196 ceph-mon[32572]: pgmap v3573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:38 smithi110 ceph-mon[28069]: pgmap v3573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:40 smithi193 ceph-mon[32782]: pgmap v3574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:40 smithi196 ceph-mon[32572]: pgmap v3574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:40 smithi110 ceph-mon[28069]: pgmap v3574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:42 smithi193 ceph-mon[32782]: pgmap v3575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5736.873397 secs 2024-04-26T13:23:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:42 smithi196 ceph-mon[32572]: pgmap v3575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5736.873397 secs 2024-04-26T13:23:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:42 smithi110 ceph-mon[28069]: pgmap v3575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5736.873397 secs 2024-04-26T13:23:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:44 smithi193 ceph-mon[32782]: pgmap v3576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:44 smithi196 ceph-mon[32572]: pgmap v3576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:44 smithi110 ceph-mon[28069]: pgmap v3576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:46 smithi193 ceph-mon[32782]: pgmap v3577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:46 smithi196 ceph-mon[32572]: pgmap v3577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:46 smithi110 ceph-mon[28069]: pgmap v3577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5741.873495 secs 2024-04-26T13:23:47.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5741.873495 secs 2024-04-26T13:23:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5741.873495 secs 2024-04-26T13:23:48.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:48 smithi193 ceph-mon[32782]: pgmap v3578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:48 smithi196 ceph-mon[32572]: pgmap v3578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:48 smithi110 ceph-mon[28069]: pgmap v3578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:23:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:50 smithi193 ceph-mon[32782]: pgmap v3579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:50 smithi196 ceph-mon[32572]: pgmap v3579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:50 smithi110 ceph-mon[28069]: pgmap v3579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:52 smithi193 ceph-mon[32782]: pgmap v3580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:23:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5746.873559 secs 2024-04-26T13:23:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:52 smithi196 ceph-mon[32572]: pgmap v3580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:23:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5746.873559 secs 2024-04-26T13:23:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:52 smithi110 ceph-mon[28069]: pgmap v3580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:23:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5746.873559 secs 2024-04-26T13:23:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:54 smithi193 ceph-mon[32782]: pgmap v3581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:54 smithi196 ceph-mon[32572]: pgmap v3581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:54 smithi110 ceph-mon[28069]: pgmap v3581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:23:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:56 smithi193 ceph-mon[32782]: pgmap v3582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:23:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:56 smithi196 ceph-mon[32572]: pgmap v3582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:23:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:56 smithi110 ceph-mon[28069]: pgmap v3582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:23:57.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5751.873686 secs 2024-04-26T13:23:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5751.873686 secs 2024-04-26T13:23:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5751.873686 secs 2024-04-26T13:23:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:23:58 smithi196 ceph-mon[32572]: pgmap v3583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:23:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:23:58 smithi110 ceph-mon[28069]: pgmap v3583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:23:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:23:58 smithi193 ceph-mon[32782]: pgmap v3583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:24:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:00 smithi196 ceph-mon[32572]: pgmap v3584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:00 smithi110 ceph-mon[28069]: pgmap v3584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:00 smithi193 ceph-mon[32782]: pgmap v3584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:02 smithi196 ceph-mon[32572]: pgmap v3585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5756.873810 secs 2024-04-26T13:24:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:02 smithi110 ceph-mon[28069]: pgmap v3585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5756.873810 secs 2024-04-26T13:24:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:02 smithi193 ceph-mon[32782]: pgmap v3585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5756.873810 secs 2024-04-26T13:24:03.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:24:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:24:03.034+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:24:03.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:24:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:24:03.034+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:24:03.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:24:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:24:03.034+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:24:03.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:24:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:24:03.034+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:24:03.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:24:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:24:03.034+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:24:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:04 smithi196 ceph-mon[32572]: pgmap v3586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:04 smithi110 ceph-mon[28069]: pgmap v3586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:04 smithi193 ceph-mon[32782]: pgmap v3586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:06 smithi196 ceph-mon[32572]: pgmap v3587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:06 smithi110 ceph-mon[28069]: pgmap v3587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:06 smithi193 ceph-mon[32782]: pgmap v3587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:07 smithi196 ceph-mon[32572]: 5 slow requests, 1 included below; oldest blocked for > 5761.873912 secs 2024-04-26T13:24:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:07 smithi196 ceph-mon[32572]: slow request 5761.873911 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T13:24:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:07 smithi110 ceph-mon[28069]: 5 slow requests, 1 included below; oldest blocked for > 5761.873912 secs 2024-04-26T13:24:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:07 smithi110 ceph-mon[28069]: slow request 5761.873911 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T13:24:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:07 smithi193 ceph-mon[32782]: 5 slow requests, 1 included below; oldest blocked for > 5761.873912 secs 2024-04-26T13:24:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:07 smithi193 ceph-mon[32782]: slow request 5761.873911 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T13:24:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:08 smithi196 ceph-mon[32572]: pgmap v3588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:08 smithi110 ceph-mon[28069]: pgmap v3588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:08 smithi193 ceph-mon[32782]: pgmap v3588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:10 smithi196 ceph-mon[32572]: pgmap v3589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:24:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:10 smithi110 ceph-mon[28069]: pgmap v3589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:24:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:10 smithi193 ceph-mon[32782]: pgmap v3589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:24:12.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:12 smithi193 ceph-mon[32782]: pgmap v3590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:24:12.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5766.873980 secs 2024-04-26T13:24:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:12 smithi196 ceph-mon[32572]: pgmap v3590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:24:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5766.873980 secs 2024-04-26T13:24:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:12 smithi110 ceph-mon[28069]: pgmap v3590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:24:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5766.873980 secs 2024-04-26T13:24:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:14 smithi196 ceph-mon[32572]: pgmap v3591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:24:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:14 smithi110 ceph-mon[28069]: pgmap v3591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:24:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:14 smithi193 ceph-mon[32782]: pgmap v3591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:24:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:16 smithi196 ceph-mon[32572]: pgmap v3592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:24:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:24:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:16 smithi110 ceph-mon[28069]: pgmap v3592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:24:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:24:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:16 smithi193 ceph-mon[32782]: pgmap v3592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:24:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:24:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:17.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:24:17.291+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T13:24:17.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:24:17.291+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006660 con 0x7f261c104b50 2024-04-26T13:24:17.291 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:24:17.292+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 48 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T13:24:17.292 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:24:17.291+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 48 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006660 con 0x55db1be4fdd0 2024-04-26T13:24:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5771.874070 secs 2024-04-26T13:24:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:24:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:24:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:17 smithi196 ceph-mon[32572]: pgmap v3593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 263 B/s wr, 13 op/s 2024-04-26T13:24:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:17 smithi196 ceph-mon[32572]: pgmap v3594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 318 B/s wr, 16 op/s 2024-04-26T13:24:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5771.874070 secs 2024-04-26T13:24:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:24:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:24:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:17 smithi110 ceph-mon[28069]: pgmap v3593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 263 B/s wr, 13 op/s 2024-04-26T13:24:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:17 smithi110 ceph-mon[28069]: pgmap v3594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 318 B/s wr, 16 op/s 2024-04-26T13:24:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5771.874070 secs 2024-04-26T13:24:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:24:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:24:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:17 smithi193 ceph-mon[32782]: pgmap v3593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 263 B/s wr, 13 op/s 2024-04-26T13:24:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:17 smithi193 ceph-mon[32782]: pgmap v3594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 318 B/s wr, 16 op/s 2024-04-26T13:24:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:24:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:19 smithi196 ceph-mon[32572]: pgmap v3595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:19 smithi110 ceph-mon[28069]: pgmap v3595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:19 smithi193 ceph-mon[32782]: pgmap v3595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:21 smithi196 ceph-mon[32572]: pgmap v3596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:21 smithi110 ceph-mon[28069]: pgmap v3596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:21 smithi193 ceph-mon[32782]: pgmap v3596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5776.874174 secs 2024-04-26T13:24:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5776.874174 secs 2024-04-26T13:24:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5776.874174 secs 2024-04-26T13:24:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:23 smithi196 ceph-mon[32572]: pgmap v3597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:23 smithi110 ceph-mon[28069]: pgmap v3597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:23 smithi193 ceph-mon[32782]: pgmap v3597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:25 smithi196 ceph-mon[32572]: pgmap v3598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:25 smithi110 ceph-mon[28069]: pgmap v3598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:25 smithi193 ceph-mon[32782]: pgmap v3598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:24:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5781.874301 secs 2024-04-26T13:24:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:27 smithi196 ceph-mon[32572]: pgmap v3599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:24:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5781.874301 secs 2024-04-26T13:24:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:27 smithi110 ceph-mon[28069]: pgmap v3599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:24:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5781.874301 secs 2024-04-26T13:24:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:27 smithi193 ceph-mon[32782]: pgmap v3599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:24:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:29 smithi196 ceph-mon[32572]: pgmap v3600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:29 smithi110 ceph-mon[28069]: pgmap v3600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:29 smithi193 ceph-mon[32782]: pgmap v3600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:31 smithi196 ceph-mon[32572]: pgmap v3601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:31 smithi110 ceph-mon[28069]: pgmap v3601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:31 smithi193 ceph-mon[32782]: pgmap v3601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5786.874444 secs 2024-04-26T13:24:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5786.874444 secs 2024-04-26T13:24:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5786.874444 secs 2024-04-26T13:24:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:33 smithi196 ceph-mon[32572]: pgmap v3602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:33 smithi110 ceph-mon[28069]: pgmap v3602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:33 smithi193 ceph-mon[32782]: pgmap v3602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:35 smithi110 ceph-mon[28069]: pgmap v3603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:35 smithi193 ceph-mon[32782]: pgmap v3603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:35 smithi196 ceph-mon[32572]: pgmap v3603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5791.874598 secs 2024-04-26T13:24:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:37 smithi110 ceph-mon[28069]: pgmap v3604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5791.874598 secs 2024-04-26T13:24:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:37 smithi193 ceph-mon[32782]: pgmap v3604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5791.874598 secs 2024-04-26T13:24:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:37 smithi196 ceph-mon[32572]: pgmap v3604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:39 smithi110 ceph-mon[28069]: pgmap v3605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:39 smithi193 ceph-mon[32782]: pgmap v3605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:39 smithi196 ceph-mon[32572]: pgmap v3605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:41 smithi110 ceph-mon[28069]: pgmap v3606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:41 smithi193 ceph-mon[32782]: pgmap v3606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:41 smithi196 ceph-mon[32572]: pgmap v3606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5796.874754 secs 2024-04-26T13:24:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5796.874754 secs 2024-04-26T13:24:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5796.874754 secs 2024-04-26T13:24:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:43 smithi110 ceph-mon[28069]: pgmap v3607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:43 smithi193 ceph-mon[32782]: pgmap v3607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:43 smithi196 ceph-mon[32572]: pgmap v3607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:45 smithi110 ceph-mon[28069]: pgmap v3608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:45 smithi193 ceph-mon[32782]: pgmap v3608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:45 smithi196 ceph-mon[32572]: pgmap v3608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:48.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5801.874884 secs 2024-04-26T13:24:48.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:47 smithi196 ceph-mon[32572]: pgmap v3609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5801.874884 secs 2024-04-26T13:24:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:47 smithi193 ceph-mon[32782]: pgmap v3609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5801.874884 secs 2024-04-26T13:24:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:47 smithi110 ceph-mon[28069]: pgmap v3609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:49 smithi193 ceph-mon[32782]: pgmap v3610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:49 smithi196 ceph-mon[32572]: pgmap v3610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:49 smithi110 ceph-mon[28069]: pgmap v3610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:51 smithi193 ceph-mon[32782]: pgmap v3611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:51 smithi196 ceph-mon[32572]: pgmap v3611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:51 smithi110 ceph-mon[28069]: pgmap v3611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5806.875015 secs 2024-04-26T13:24:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5806.875015 secs 2024-04-26T13:24:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5806.875015 secs 2024-04-26T13:24:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:53 smithi193 ceph-mon[32782]: pgmap v3612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:53 smithi196 ceph-mon[32572]: pgmap v3612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:53 smithi110 ceph-mon[28069]: pgmap v3612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:24:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:55 smithi193 ceph-mon[32782]: pgmap v3613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:55 smithi196 ceph-mon[32572]: pgmap v3613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:55 smithi110 ceph-mon[28069]: pgmap v3613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:58.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5811.875133 secs 2024-04-26T13:24:58.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:57 smithi110 ceph-mon[28069]: pgmap v3614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5811.875133 secs 2024-04-26T13:24:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:57 smithi193 ceph-mon[32782]: pgmap v3614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:24:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5811.875133 secs 2024-04-26T13:24:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:57 smithi196 ceph-mon[32572]: pgmap v3614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:24:59 smithi193 ceph-mon[32782]: pgmap v3615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:24:59 smithi196 ceph-mon[32572]: pgmap v3615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:24:59 smithi110 ceph-mon[28069]: pgmap v3615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:00 smithi193 ceph-mon[32782]: pgmap v3616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:00 smithi196 ceph-mon[32572]: pgmap v3616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:00 smithi110 ceph-mon[28069]: pgmap v3616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5816.875208 secs 2024-04-26T13:25:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5816.875208 secs 2024-04-26T13:25:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5816.875208 secs 2024-04-26T13:25:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:03 smithi196 ceph-mon[32572]: pgmap v3617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:25:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:03 smithi110 ceph-mon[28069]: pgmap v3617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:25:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:03 smithi193 ceph-mon[32782]: pgmap v3617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:25:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:05 smithi196 ceph-mon[32572]: pgmap v3618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:25:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:05 smithi110 ceph-mon[28069]: pgmap v3618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:25:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:05 smithi193 ceph-mon[32782]: pgmap v3618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:25:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:07 smithi196 ceph-mon[32572]: 5 slow requests, 1 included below; oldest blocked for > 5821.875346 secs 2024-04-26T13:25:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:07 smithi196 ceph-mon[32572]: slow request 5761.897808 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T13:25:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:07 smithi196 ceph-mon[32572]: pgmap v3619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:25:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:07 smithi110 ceph-mon[28069]: 5 slow requests, 1 included below; oldest blocked for > 5821.875346 secs 2024-04-26T13:25:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:07 smithi110 ceph-mon[28069]: slow request 5761.897808 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T13:25:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:07 smithi110 ceph-mon[28069]: pgmap v3619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:25:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:07 smithi193 ceph-mon[32782]: 5 slow requests, 1 included below; oldest blocked for > 5821.875346 secs 2024-04-26T13:25:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:07 smithi193 ceph-mon[32782]: slow request 5761.897808 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T13:25:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:07 smithi193 ceph-mon[32782]: pgmap v3619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:25:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:09 smithi196 ceph-mon[32572]: pgmap v3620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:25:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:09 smithi110 ceph-mon[28069]: pgmap v3620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:25:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:09 smithi193 ceph-mon[32782]: pgmap v3620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:25:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:11 smithi196 ceph-mon[32572]: pgmap v3621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:25:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:11 smithi110 ceph-mon[28069]: pgmap v3621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:25:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:11 smithi193 ceph-mon[32782]: pgmap v3621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:25:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5826.875482 secs 2024-04-26T13:25:13.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5826.875482 secs 2024-04-26T13:25:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5826.875482 secs 2024-04-26T13:25:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:13 smithi196 ceph-mon[32572]: pgmap v3622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:25:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:13 smithi110 ceph-mon[28069]: pgmap v3622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:25:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:13 smithi193 ceph-mon[32782]: pgmap v3622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:25:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:15 smithi110 ceph-mon[28069]: pgmap v3623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:15 smithi193 ceph-mon[32782]: pgmap v3623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:15 smithi196 ceph-mon[32572]: pgmap v3623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:18.024 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5831.875579 secs 2024-04-26T13:25:18.024 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:17 smithi193 ceph-mon[32782]: pgmap v3624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:18.024 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:25:18.029 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5831.875579 secs 2024-04-26T13:25:18.029 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:17 smithi196 ceph-mon[32572]: pgmap v3624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:18.029 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:25:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5831.875579 secs 2024-04-26T13:25:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:17 smithi110 ceph-mon[28069]: pgmap v3624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:25:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: pgmap v3625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: pgmap v3625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: pgmap v3625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:25:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:25:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:25:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:25:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:21 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:25:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:21 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:25:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:21 smithi110 ceph-mon[28069]: pgmap v3626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:21 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:25:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:21 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:25:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:21 smithi193 ceph-mon[32782]: pgmap v3626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:21 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:25:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:21 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:25:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:21 smithi196 ceph-mon[32572]: pgmap v3626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:22.788 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5836.875708 secs 2024-04-26T13:25:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5836.875708 secs 2024-04-26T13:25:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:25:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:25:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5836.875708 secs 2024-04-26T13:25:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:25:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:25:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:25:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:25:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:25:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:25:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:23 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:25:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:23 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:25:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:23 smithi110 ceph-mon[28069]: pgmap v3627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T13:25:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:23 smithi110 ceph-mon[28069]: pgmap v3628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T13:25:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:23 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:25:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:23 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:25:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:23 smithi193 ceph-mon[32782]: pgmap v3627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T13:25:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:23 smithi193 ceph-mon[32782]: pgmap v3628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T13:25:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:23 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:25:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:23 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:25:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:23 smithi196 ceph-mon[32572]: pgmap v3627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T13:25:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:23 smithi196 ceph-mon[32572]: pgmap v3628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T13:25:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:25 smithi193 ceph-mon[32782]: pgmap v3629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:25 smithi196 ceph-mon[32572]: pgmap v3629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:25 smithi110 ceph-mon[28069]: pgmap v3629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:27 smithi193 ceph-mon[32782]: pgmap v3630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:27 smithi196 ceph-mon[32572]: pgmap v3630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:27 smithi110 ceph-mon[28069]: pgmap v3630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:28 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5841.875824 secs 2024-04-26T13:25:28.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:28 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5841.875824 secs 2024-04-26T13:25:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:28 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5841.875824 secs 2024-04-26T13:25:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:29 smithi193 ceph-mon[32782]: pgmap v3631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:29.472 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:29 smithi110 ceph-mon[28069]: pgmap v3631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:29 smithi196 ceph-mon[32572]: pgmap v3631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:31 smithi193 ceph-mon[32782]: pgmap v3632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:31 smithi196 ceph-mon[32572]: pgmap v3632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:31 smithi110 ceph-mon[28069]: pgmap v3632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:25:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5846.875920 secs 2024-04-26T13:25:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5846.875920 secs 2024-04-26T13:25:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5846.875920 secs 2024-04-26T13:25:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:33 smithi193 ceph-mon[32782]: pgmap v3633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:25:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:33 smithi196 ceph-mon[32572]: pgmap v3633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:25:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:33 smithi110 ceph-mon[28069]: pgmap v3633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:25:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:35 smithi193 ceph-mon[32782]: pgmap v3634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:35 smithi196 ceph-mon[32572]: pgmap v3634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:35 smithi110 ceph-mon[28069]: pgmap v3634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5851.875998 secs 2024-04-26T13:25:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:37 smithi193 ceph-mon[32782]: pgmap v3635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5851.875998 secs 2024-04-26T13:25:37.808 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:37 smithi196 ceph-mon[32572]: pgmap v3635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:37.809 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5851.875998 secs 2024-04-26T13:25:37.809 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:37 smithi110 ceph-mon[28069]: pgmap v3635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:39 smithi193 ceph-mon[32782]: pgmap v3636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:39 smithi196 ceph-mon[32572]: pgmap v3636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:39 smithi110 ceph-mon[28069]: pgmap v3636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:41 smithi110 ceph-mon[28069]: pgmap v3637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:41 smithi193 ceph-mon[32782]: pgmap v3637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:41 smithi196 ceph-mon[32572]: pgmap v3637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5856.876072 secs 2024-04-26T13:25:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5856.876072 secs 2024-04-26T13:25:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5856.876072 secs 2024-04-26T13:25:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:43 smithi193 ceph-mon[32782]: pgmap v3638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:43 smithi196 ceph-mon[32572]: pgmap v3638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:43 smithi110 ceph-mon[28069]: pgmap v3638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:45 smithi193 ceph-mon[32782]: pgmap v3639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:45 smithi196 ceph-mon[32572]: pgmap v3639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:45 smithi110 ceph-mon[28069]: pgmap v3639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5861.876183 secs 2024-04-26T13:25:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:47 smithi193 ceph-mon[32782]: pgmap v3640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5861.876183 secs 2024-04-26T13:25:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:47 smithi196 ceph-mon[32572]: pgmap v3640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5861.876183 secs 2024-04-26T13:25:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:47 smithi110 ceph-mon[28069]: pgmap v3640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:49 smithi193 ceph-mon[32782]: pgmap v3641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:49 smithi196 ceph-mon[32572]: pgmap v3641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:49 smithi110 ceph-mon[28069]: pgmap v3641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:51 smithi193 ceph-mon[32782]: pgmap v3642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:51 smithi196 ceph-mon[32572]: pgmap v3642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:51 smithi110 ceph-mon[28069]: pgmap v3642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5866.876325 secs 2024-04-26T13:25:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5866.876325 secs 2024-04-26T13:25:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5866.876325 secs 2024-04-26T13:25:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:53 smithi193 ceph-mon[32782]: pgmap v3643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:53 smithi196 ceph-mon[32572]: pgmap v3643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:53 smithi110 ceph-mon[28069]: pgmap v3643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:55 smithi196 ceph-mon[32572]: pgmap v3644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:55 smithi110 ceph-mon[28069]: pgmap v3644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:55 smithi193 ceph-mon[32782]: pgmap v3644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5871.876444 secs 2024-04-26T13:25:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:57 smithi196 ceph-mon[32572]: pgmap v3645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5871.876444 secs 2024-04-26T13:25:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:57 smithi110 ceph-mon[28069]: pgmap v3645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5871.876444 secs 2024-04-26T13:25:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:57 smithi193 ceph-mon[32782]: pgmap v3645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:25:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:25:59 smithi196 ceph-mon[32572]: pgmap v3646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:25:59 smithi110 ceph-mon[28069]: pgmap v3646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:25:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:25:59 smithi193 ceph-mon[32782]: pgmap v3646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:01.715 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:01 smithi110 ceph-mon[28069]: pgmap v3647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:01 smithi196 ceph-mon[32572]: pgmap v3647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:01 smithi193 ceph-mon[32782]: pgmap v3647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5876.876582 secs 2024-04-26T13:26:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5876.876582 secs 2024-04-26T13:26:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5876.876582 secs 2024-04-26T13:26:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:03 smithi196 ceph-mon[32572]: pgmap v3648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:03 smithi110 ceph-mon[28069]: pgmap v3648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:03 smithi193 ceph-mon[32782]: pgmap v3648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:05 smithi196 ceph-mon[32572]: pgmap v3649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:05 smithi110 ceph-mon[28069]: pgmap v3649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:05 smithi193 ceph-mon[32782]: pgmap v3649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5881.876700 secs 2024-04-26T13:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:07 smithi196 ceph-mon[32572]: pgmap v3650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5881.876700 secs 2024-04-26T13:26:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:07 smithi110 ceph-mon[28069]: pgmap v3650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5881.876700 secs 2024-04-26T13:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:07 smithi193 ceph-mon[32782]: pgmap v3650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:09 smithi196 ceph-mon[32572]: pgmap v3651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:09 smithi110 ceph-mon[28069]: pgmap v3651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:09 smithi193 ceph-mon[32782]: pgmap v3651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:11 smithi196 ceph-mon[32572]: pgmap v3652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:11 smithi110 ceph-mon[28069]: pgmap v3652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:11 smithi193 ceph-mon[32782]: pgmap v3652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5886.876778 secs 2024-04-26T13:26:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5886.876778 secs 2024-04-26T13:26:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5886.876778 secs 2024-04-26T13:26:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:13 smithi196 ceph-mon[32572]: pgmap v3653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:13.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:13 smithi193 ceph-mon[32782]: pgmap v3653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:13 smithi110 ceph-mon[28069]: pgmap v3653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:15 smithi196 ceph-mon[32572]: pgmap v3654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:15 smithi110 ceph-mon[28069]: pgmap v3654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:15 smithi193 ceph-mon[32782]: pgmap v3654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5891.876903 secs 2024-04-26T13:26:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:17 smithi196 ceph-mon[32572]: pgmap v3655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5891.876903 secs 2024-04-26T13:26:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:17 smithi110 ceph-mon[28069]: pgmap v3655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5891.876903 secs 2024-04-26T13:26:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:17 smithi193 ceph-mon[32782]: pgmap v3655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:19 smithi196 ceph-mon[32572]: pgmap v3656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:19 smithi110 ceph-mon[28069]: pgmap v3656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:19 smithi193 ceph-mon[32782]: pgmap v3656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:21 smithi196 ceph-mon[32572]: pgmap v3657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:21 smithi110 ceph-mon[28069]: pgmap v3657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:21 smithi193 ceph-mon[32782]: pgmap v3657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5896.877021 secs 2024-04-26T13:26:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5896.877021 secs 2024-04-26T13:26:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5896.877021 secs 2024-04-26T13:26:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:23 smithi196 ceph-mon[32572]: pgmap v3658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:26:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:23 smithi110 ceph-mon[28069]: pgmap v3658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:26:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:23 smithi193 ceph-mon[32782]: pgmap v3658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:26:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:25 smithi196 ceph-mon[32572]: pgmap v3659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:25.761 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:25 smithi110 ceph-mon[28069]: pgmap v3659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:25 smithi193 ceph-mon[32782]: pgmap v3659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5901.877108 secs 2024-04-26T13:26:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:27 smithi110 ceph-mon[28069]: pgmap v3660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5901.877108 secs 2024-04-26T13:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:27 smithi193 ceph-mon[32782]: pgmap v3660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5901.877108 secs 2024-04-26T13:26:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:27 smithi196 ceph-mon[32572]: pgmap v3660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:29 smithi110 ceph-mon[28069]: pgmap v3661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:26:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:26:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:29 smithi193 ceph-mon[32782]: pgmap v3661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:26:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:26:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:29 smithi196 ceph-mon[32572]: pgmap v3661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:26:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:26:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:26:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:30 smithi110 ceph-mon[28069]: pgmap v3662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 1 op/s 2024-04-26T13:26:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:30 smithi110 ceph-mon[28069]: pgmap v3663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:30 smithi193 ceph-mon[32782]: pgmap v3662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 1 op/s 2024-04-26T13:26:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:30 smithi193 ceph-mon[32782]: pgmap v3663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:30 smithi196 ceph-mon[32572]: pgmap v3662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 925 B/s rd, 1 op/s 2024-04-26T13:26:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:30 smithi196 ceph-mon[32572]: pgmap v3663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5906.877242 secs 2024-04-26T13:26:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:32 smithi110 ceph-mon[28069]: pgmap v3664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5906.877242 secs 2024-04-26T13:26:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:32 smithi193 ceph-mon[32782]: pgmap v3664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5906.877242 secs 2024-04-26T13:26:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:32 smithi196 ceph-mon[32572]: pgmap v3664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:34 smithi110 ceph-mon[28069]: pgmap v3665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:34 smithi193 ceph-mon[32782]: pgmap v3665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:34 smithi196 ceph-mon[32572]: pgmap v3665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:36 smithi193 ceph-mon[32782]: pgmap v3666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:36 smithi196 ceph-mon[32572]: pgmap v3666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:36 smithi110 ceph-mon[28069]: pgmap v3666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:26:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5911.877360 secs 2024-04-26T13:26:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5911.877360 secs 2024-04-26T13:26:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5911.877360 secs 2024-04-26T13:26:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:38 smithi193 ceph-mon[32782]: pgmap v3667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 564 B/s rd, 1 op/s 2024-04-26T13:26:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:38 smithi196 ceph-mon[32572]: pgmap v3667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 564 B/s rd, 1 op/s 2024-04-26T13:26:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:38 smithi110 ceph-mon[28069]: pgmap v3667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 564 B/s rd, 1 op/s 2024-04-26T13:26:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:40 smithi193 ceph-mon[32782]: pgmap v3668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:26:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:40 smithi196 ceph-mon[32572]: pgmap v3668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:26:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:40 smithi110 ceph-mon[28069]: pgmap v3668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:26:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5916.877488 secs 2024-04-26T13:26:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:42 smithi193 ceph-mon[32782]: pgmap v3669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5916.877488 secs 2024-04-26T13:26:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:42 smithi196 ceph-mon[32572]: pgmap v3669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5916.877488 secs 2024-04-26T13:26:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:42 smithi110 ceph-mon[28069]: pgmap v3669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:44 smithi193 ceph-mon[32782]: pgmap v3670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:44 smithi196 ceph-mon[32572]: pgmap v3670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:44 smithi110 ceph-mon[28069]: pgmap v3670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:46 smithi193 ceph-mon[32782]: pgmap v3671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:46 smithi196 ceph-mon[32572]: pgmap v3671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:46 smithi110 ceph-mon[28069]: pgmap v3671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5921.877581 secs 2024-04-26T13:26:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5921.877581 secs 2024-04-26T13:26:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5921.877581 secs 2024-04-26T13:26:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:48 smithi193 ceph-mon[32782]: pgmap v3672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:49.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:48 smithi196 ceph-mon[32572]: pgmap v3672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:48 smithi110 ceph-mon[28069]: pgmap v3672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:50 smithi193 ceph-mon[32782]: pgmap v3673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:50 smithi196 ceph-mon[32572]: pgmap v3673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:50 smithi110 ceph-mon[28069]: pgmap v3673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5926.877702 secs 2024-04-26T13:26:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:52 smithi193 ceph-mon[32782]: pgmap v3674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5926.877702 secs 2024-04-26T13:26:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:52 smithi196 ceph-mon[32572]: pgmap v3674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5926.877702 secs 2024-04-26T13:26:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:52 smithi110 ceph-mon[28069]: pgmap v3674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:54 smithi193 ceph-mon[32782]: pgmap v3675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:54 smithi196 ceph-mon[32572]: pgmap v3675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:54 smithi110 ceph-mon[28069]: pgmap v3675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:26:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:55 smithi193 ceph-mon[32782]: pgmap v3676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:55 smithi196 ceph-mon[32572]: pgmap v3676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:55 smithi110 ceph-mon[28069]: pgmap v3676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5931.877807 secs 2024-04-26T13:26:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5931.877807 secs 2024-04-26T13:26:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5931.877807 secs 2024-04-26T13:26:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:26:58 smithi196 ceph-mon[32572]: pgmap v3677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:26:58 smithi110 ceph-mon[28069]: pgmap v3677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:26:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:26:58 smithi193 ceph-mon[32782]: pgmap v3677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:00 smithi196 ceph-mon[32572]: pgmap v3678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:00 smithi110 ceph-mon[28069]: pgmap v3678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:00 smithi193 ceph-mon[32782]: pgmap v3678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 5936.877925 secs 2024-04-26T13:27:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:02 smithi196 ceph-mon[32572]: pgmap v3679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 5936.877925 secs 2024-04-26T13:27:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:02 smithi110 ceph-mon[28069]: pgmap v3679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 5936.877925 secs 2024-04-26T13:27:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:02 smithi193 ceph-mon[32782]: pgmap v3679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:04 smithi196 ceph-mon[32572]: pgmap v3680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:04 smithi110 ceph-mon[28069]: pgmap v3680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:04 smithi193 ceph-mon[32782]: pgmap v3680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:06 smithi196 ceph-mon[32572]: pgmap v3681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:06 smithi110 ceph-mon[28069]: pgmap v3681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:06 smithi193 ceph-mon[32782]: pgmap v3681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:07 smithi196 ceph-mon[32572]: 6 slow requests, 1 included below; oldest blocked for > 5941.878040 secs 2024-04-26T13:27:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:07 smithi196 ceph-mon[32572]: slow request 183.133334 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T13:27:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:07 smithi110 ceph-mon[28069]: 6 slow requests, 1 included below; oldest blocked for > 5941.878040 secs 2024-04-26T13:27:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:07 smithi110 ceph-mon[28069]: slow request 183.133334 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T13:27:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:07 smithi193 ceph-mon[32782]: 6 slow requests, 1 included below; oldest blocked for > 5941.878040 secs 2024-04-26T13:27:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:07 smithi193 ceph-mon[32782]: slow request 183.133334 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T13:27:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:08 smithi196 ceph-mon[32572]: pgmap v3682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:08 smithi110 ceph-mon[28069]: pgmap v3682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:08 smithi193 ceph-mon[32782]: pgmap v3682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T13:27:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:09 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T13:27:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T13:27:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:09 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T13:27:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T13:27:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:09 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T13:27:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:10 smithi196 ceph-mon[32572]: pgmap v3683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:10 smithi110 ceph-mon[28069]: pgmap v3683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:10 smithi193 ceph-mon[32782]: pgmap v3683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:12 smithi196 ceph-mon[32572]: 6 slow requests, 1 included below; oldest blocked for > 5946.878162 secs 2024-04-26T13:27:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:12 smithi196 ceph-mon[32572]: slow request 5763.093301 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:27:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:12 smithi196 ceph-mon[32572]: pgmap v3684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:12 smithi110 ceph-mon[28069]: 6 slow requests, 1 included below; oldest blocked for > 5946.878162 secs 2024-04-26T13:27:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:12 smithi110 ceph-mon[28069]: slow request 5763.093301 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:27:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:12 smithi110 ceph-mon[28069]: pgmap v3684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:12 smithi193 ceph-mon[32782]: 6 slow requests, 1 included below; oldest blocked for > 5946.878162 secs 2024-04-26T13:27:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:12 smithi193 ceph-mon[32782]: slow request 5763.093301 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:27:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:12 smithi193 ceph-mon[32782]: pgmap v3684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:14 smithi196 ceph-mon[32572]: pgmap v3685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:14 smithi110 ceph-mon[28069]: pgmap v3685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:14 smithi193 ceph-mon[32782]: pgmap v3685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:16 smithi196 ceph-mon[32572]: pgmap v3686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:16 smithi110 ceph-mon[28069]: pgmap v3686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:16 smithi193 ceph-mon[32782]: pgmap v3686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:27:17.321+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006660 con 0x7f261c104b50 2024-04-26T13:27:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:27:17.321+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T13:27:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:27:17.321+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 49 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T13:27:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:27:17.321+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 49 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006660 con 0x55db1be4fdd0 2024-04-26T13:27:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:27:17.321+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:27:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:27:17.321+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:27:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:27:17.322+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 50 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:27:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:27:17.322+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 50 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:27:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5951.878295 secs 2024-04-26T13:27:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5951.878295 secs 2024-04-26T13:27:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5951.878295 secs 2024-04-26T13:27:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:18 smithi196 ceph-mon[32572]: pgmap v3687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:18 smithi110 ceph-mon[28069]: pgmap v3687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:18 smithi193 ceph-mon[32782]: pgmap v3687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:20 smithi196 ceph-mon[32572]: pgmap v3688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:20 smithi110 ceph-mon[28069]: pgmap v3688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:20 smithi193 ceph-mon[32782]: pgmap v3688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5956.878437 secs 2024-04-26T13:27:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:22 smithi196 ceph-mon[32572]: pgmap v3689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5956.878437 secs 2024-04-26T13:27:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:22 smithi110 ceph-mon[28069]: pgmap v3689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5956.878437 secs 2024-04-26T13:27:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:22 smithi193 ceph-mon[32782]: pgmap v3689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:24 smithi196 ceph-mon[32572]: pgmap v3690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:24 smithi110 ceph-mon[28069]: pgmap v3690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:24 smithi193 ceph-mon[32782]: pgmap v3690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:26 smithi196 ceph-mon[32572]: pgmap v3691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:26 smithi110 ceph-mon[28069]: pgmap v3691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:26 smithi193 ceph-mon[32782]: pgmap v3691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5961.878596 secs 2024-04-26T13:27:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5961.878596 secs 2024-04-26T13:27:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5961.878596 secs 2024-04-26T13:27:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:28 smithi196 ceph-mon[32572]: pgmap v3692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:28 smithi110 ceph-mon[28069]: pgmap v3692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:28 smithi193 ceph-mon[32782]: pgmap v3692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:30 smithi110 ceph-mon[28069]: pgmap v3693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:27:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:30 smithi193 ceph-mon[32782]: pgmap v3693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:27:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:30 smithi196 ceph-mon[32572]: pgmap v3693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:27:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:27:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:27:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:31 smithi110 ceph-mon[28069]: pgmap v3694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T13:27:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:31 smithi110 ceph-mon[28069]: pgmap v3695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:27:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:27:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:27:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:31 smithi193 ceph-mon[32782]: pgmap v3694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T13:27:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:31 smithi193 ceph-mon[32782]: pgmap v3695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:27:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:27:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:27:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:31 smithi196 ceph-mon[32572]: pgmap v3694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T13:27:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:31 smithi196 ceph-mon[32572]: pgmap v3695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:27:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5966.878755 secs 2024-04-26T13:27:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5966.878755 secs 2024-04-26T13:27:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5966.878755 secs 2024-04-26T13:27:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:33 smithi110 ceph-mon[28069]: pgmap v3696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:33 smithi193 ceph-mon[32782]: pgmap v3696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:33 smithi196 ceph-mon[32572]: pgmap v3696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:35 smithi193 ceph-mon[32782]: pgmap v3697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:35 smithi196 ceph-mon[32572]: pgmap v3697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:35 smithi110 ceph-mon[28069]: pgmap v3697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5971.878869 secs 2024-04-26T13:27:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:37 smithi193 ceph-mon[32782]: pgmap v3698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5971.878869 secs 2024-04-26T13:27:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:37 smithi196 ceph-mon[32572]: pgmap v3698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5971.878869 secs 2024-04-26T13:27:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:37 smithi110 ceph-mon[28069]: pgmap v3698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:39 smithi193 ceph-mon[32782]: pgmap v3699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:39 smithi196 ceph-mon[32572]: pgmap v3699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:39 smithi110 ceph-mon[28069]: pgmap v3699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:27:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:41 smithi193 ceph-mon[32782]: pgmap v3700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:27:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:41 smithi196 ceph-mon[32572]: pgmap v3700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:27:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:41 smithi110 ceph-mon[28069]: pgmap v3700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:27:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5976.879006 secs 2024-04-26T13:27:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:42 smithi196 ceph-mon[32572]: pgmap v3701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5976.879006 secs 2024-04-26T13:27:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:42 smithi110 ceph-mon[28069]: pgmap v3701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5976.879006 secs 2024-04-26T13:27:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:42 smithi193 ceph-mon[32782]: pgmap v3701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:45 smithi193 ceph-mon[32782]: pgmap v3702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:45 smithi196 ceph-mon[32572]: pgmap v3702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:45 smithi110 ceph-mon[28069]: pgmap v3702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5981.879071 secs 2024-04-26T13:27:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:47 smithi193 ceph-mon[32782]: pgmap v3703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5981.879071 secs 2024-04-26T13:27:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:47 smithi196 ceph-mon[32572]: pgmap v3703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5981.879071 secs 2024-04-26T13:27:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:47 smithi110 ceph-mon[28069]: pgmap v3703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:49 smithi193 ceph-mon[32782]: pgmap v3704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:49 smithi196 ceph-mon[32572]: pgmap v3704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:49 smithi110 ceph-mon[28069]: pgmap v3704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:50 smithi196 ceph-mon[32572]: pgmap v3705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:50 smithi110 ceph-mon[28069]: pgmap v3705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:50 smithi193 ceph-mon[32782]: pgmap v3705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5986.879199 secs 2024-04-26T13:27:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5986.879199 secs 2024-04-26T13:27:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5986.879199 secs 2024-04-26T13:27:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:53 smithi196 ceph-mon[32572]: pgmap v3706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:53 smithi110 ceph-mon[28069]: pgmap v3706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:53 smithi193 ceph-mon[32782]: pgmap v3706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:27:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:55 smithi193 ceph-mon[32782]: pgmap v3707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:55 smithi196 ceph-mon[32572]: pgmap v3707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:55 smithi110 ceph-mon[28069]: pgmap v3707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5991.879269 secs 2024-04-26T13:27:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:57 smithi193 ceph-mon[32782]: pgmap v3708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5991.879269 secs 2024-04-26T13:27:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:57 smithi196 ceph-mon[32572]: pgmap v3708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:27:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5991.879269 secs 2024-04-26T13:27:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:57 smithi110 ceph-mon[28069]: pgmap v3708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:27:59 smithi193 ceph-mon[32782]: pgmap v3709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:27:59 smithi196 ceph-mon[32572]: pgmap v3709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:27:59 smithi110 ceph-mon[28069]: pgmap v3709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:00 smithi196 ceph-mon[32572]: pgmap v3710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:00 smithi110 ceph-mon[28069]: pgmap v3710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:00 smithi193 ceph-mon[32782]: pgmap v3710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 5996.879394 secs 2024-04-26T13:28:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 5996.879394 secs 2024-04-26T13:28:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 5996.879394 secs 2024-04-26T13:28:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:03 smithi196 ceph-mon[32572]: pgmap v3711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:03 smithi110 ceph-mon[28069]: pgmap v3711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:03 smithi193 ceph-mon[32782]: pgmap v3711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:05 smithi193 ceph-mon[32782]: pgmap v3712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:05 smithi196 ceph-mon[32572]: pgmap v3712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:05 smithi110 ceph-mon[28069]: pgmap v3712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:07 smithi193 ceph-mon[32782]: 6 slow requests, 1 included below; oldest blocked for > 6001.879513 secs 2024-04-26T13:28:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:07 smithi193 ceph-mon[32782]: slow request 1443.707112 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:28:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:07 smithi193 ceph-mon[32782]: pgmap v3713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:07 smithi196 ceph-mon[32572]: 6 slow requests, 1 included below; oldest blocked for > 6001.879513 secs 2024-04-26T13:28:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:07 smithi196 ceph-mon[32572]: slow request 1443.707112 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:28:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:07 smithi196 ceph-mon[32572]: pgmap v3713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:07 smithi110 ceph-mon[28069]: 6 slow requests, 1 included below; oldest blocked for > 6001.879513 secs 2024-04-26T13:28:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:07 smithi110 ceph-mon[28069]: slow request 1443.707112 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:28:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:07 smithi110 ceph-mon[28069]: pgmap v3713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:08 smithi196 ceph-mon[32572]: pgmap v3714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:08 smithi110 ceph-mon[28069]: pgmap v3714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:08 smithi193 ceph-mon[32782]: pgmap v3714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:11 smithi193 ceph-mon[32782]: pgmap v3715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:11 smithi196 ceph-mon[32572]: pgmap v3715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:11 smithi110 ceph-mon[28069]: pgmap v3715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6006.879657 secs 2024-04-26T13:28:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6006.879657 secs 2024-04-26T13:28:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6006.879657 secs 2024-04-26T13:28:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:13 smithi196 ceph-mon[32572]: pgmap v3716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:13 smithi110 ceph-mon[28069]: pgmap v3716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:13 smithi193 ceph-mon[32782]: pgmap v3716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:14 smithi196 ceph-mon[32572]: pgmap v3717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:14 smithi110 ceph-mon[28069]: pgmap v3717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:14 smithi193 ceph-mon[32782]: pgmap v3717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6011.879782 secs 2024-04-26T13:28:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:17 smithi193 ceph-mon[32782]: pgmap v3718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6011.879782 secs 2024-04-26T13:28:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:17 smithi196 ceph-mon[32572]: pgmap v3718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6011.879782 secs 2024-04-26T13:28:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:17 smithi110 ceph-mon[28069]: pgmap v3718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:18 smithi196 ceph-mon[32572]: pgmap v3719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:18 smithi110 ceph-mon[28069]: pgmap v3719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:18 smithi193 ceph-mon[32782]: pgmap v3719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:21 smithi193 ceph-mon[32782]: pgmap v3720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:21 smithi196 ceph-mon[32572]: pgmap v3720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:21 smithi110 ceph-mon[28069]: pgmap v3720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6016.879908 secs 2024-04-26T13:28:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:22 smithi196 ceph-mon[32572]: pgmap v3721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6016.879908 secs 2024-04-26T13:28:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:22 smithi110 ceph-mon[28069]: pgmap v3721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6016.879908 secs 2024-04-26T13:28:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:22 smithi193 ceph-mon[32782]: pgmap v3721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:25 smithi196 ceph-mon[32572]: pgmap v3722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:25 smithi110 ceph-mon[28069]: pgmap v3722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:25 smithi193 ceph-mon[32782]: pgmap v3722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:26 smithi196 ceph-mon[32572]: pgmap v3723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:26 smithi110 ceph-mon[28069]: pgmap v3723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:26 smithi193 ceph-mon[32782]: pgmap v3723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6021.880004 secs 2024-04-26T13:28:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6021.880004 secs 2024-04-26T13:28:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6021.880004 secs 2024-04-26T13:28:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:28 smithi196 ceph-mon[32572]: pgmap v3724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:28 smithi110 ceph-mon[28069]: pgmap v3724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:28 smithi193 ceph-mon[32782]: pgmap v3724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:31 smithi196 ceph-mon[32572]: pgmap v3725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:28:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:31 smithi110 ceph-mon[28069]: pgmap v3725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:28:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:31 smithi193 ceph-mon[32782]: pgmap v3725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:28:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6026.880080 secs 2024-04-26T13:28:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:28:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:28:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:32 smithi196 ceph-mon[32572]: pgmap v3726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T13:28:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:32 smithi196 ceph-mon[32572]: pgmap v3727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:28:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:28:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6026.880080 secs 2024-04-26T13:28:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:28:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:28:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:32 smithi110 ceph-mon[28069]: pgmap v3726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T13:28:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:32 smithi110 ceph-mon[28069]: pgmap v3727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:28:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:28:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6026.880080 secs 2024-04-26T13:28:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:28:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:28:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:32 smithi193 ceph-mon[32782]: pgmap v3726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T13:28:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:32 smithi193 ceph-mon[32782]: pgmap v3727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:28:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:28:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:35 smithi196 ceph-mon[32572]: pgmap v3728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:35 smithi110 ceph-mon[28069]: pgmap v3728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:35 smithi193 ceph-mon[32782]: pgmap v3728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6031.880211 secs 2024-04-26T13:28:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:37 smithi196 ceph-mon[32572]: pgmap v3729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6031.880211 secs 2024-04-26T13:28:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:37 smithi110 ceph-mon[28069]: pgmap v3729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6031.880211 secs 2024-04-26T13:28:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:37 smithi193 ceph-mon[32782]: pgmap v3729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:39 smithi196 ceph-mon[32572]: pgmap v3730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:39 smithi110 ceph-mon[28069]: pgmap v3730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:39 smithi193 ceph-mon[32782]: pgmap v3730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:41 smithi196 ceph-mon[32572]: pgmap v3731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:41 smithi110 ceph-mon[28069]: pgmap v3731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:41 smithi193 ceph-mon[32782]: pgmap v3731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:28:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6036.880335 secs 2024-04-26T13:28:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6036.880335 secs 2024-04-26T13:28:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6036.880335 secs 2024-04-26T13:28:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:43 smithi196 ceph-mon[32572]: pgmap v3732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:28:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:43 smithi110 ceph-mon[28069]: pgmap v3732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:28:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:43 smithi193 ceph-mon[32782]: pgmap v3732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:28:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:45 smithi196 ceph-mon[32572]: pgmap v3733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:45 smithi110 ceph-mon[28069]: pgmap v3733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:45 smithi193 ceph-mon[32782]: pgmap v3733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6041.880459 secs 2024-04-26T13:28:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:47 smithi196 ceph-mon[32572]: pgmap v3734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6041.880459 secs 2024-04-26T13:28:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:47 smithi110 ceph-mon[28069]: pgmap v3734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6041.880459 secs 2024-04-26T13:28:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:47 smithi193 ceph-mon[32782]: pgmap v3734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:49 smithi196 ceph-mon[32572]: pgmap v3735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:49 smithi110 ceph-mon[28069]: pgmap v3735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:49 smithi193 ceph-mon[32782]: pgmap v3735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:51 smithi196 ceph-mon[32572]: pgmap v3736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:51 smithi110 ceph-mon[28069]: pgmap v3736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:51 smithi193 ceph-mon[32782]: pgmap v3736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6046.880600 secs 2024-04-26T13:28:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6046.880600 secs 2024-04-26T13:28:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6046.880600 secs 2024-04-26T13:28:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:53 smithi196 ceph-mon[32572]: pgmap v3737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:53 smithi110 ceph-mon[28069]: pgmap v3737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:53 smithi193 ceph-mon[32782]: pgmap v3737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:55 smithi196 ceph-mon[32572]: pgmap v3738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:55 smithi110 ceph-mon[28069]: pgmap v3738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:55 smithi193 ceph-mon[32782]: pgmap v3738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6051.880729 secs 2024-04-26T13:28:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:57 smithi196 ceph-mon[32572]: pgmap v3739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6051.880729 secs 2024-04-26T13:28:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:57 smithi110 ceph-mon[28069]: pgmap v3739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6051.880729 secs 2024-04-26T13:28:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:57 smithi193 ceph-mon[32782]: pgmap v3739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:28:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:28:59 smithi196 ceph-mon[32572]: pgmap v3740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:28:59 smithi110 ceph-mon[28069]: pgmap v3740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:28:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:28:59 smithi193 ceph-mon[32782]: pgmap v3740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:01 smithi196 ceph-mon[32572]: pgmap v3741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:01 smithi110 ceph-mon[28069]: pgmap v3741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:01 smithi193 ceph-mon[32782]: pgmap v3741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6056.880860 secs 2024-04-26T13:29:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6056.880860 secs 2024-04-26T13:29:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6056.880860 secs 2024-04-26T13:29:03.513 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:29:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:29:03.127+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:29:03.513 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:29:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:29:03.127+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:29:03.514 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:29:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:29:03.128+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:29:03.514 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:29:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:29:03.128+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:29:03.514 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:29:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:29:03.128+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:29:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:03 smithi110 ceph-mon[28069]: pgmap v3742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:03 smithi193 ceph-mon[32782]: pgmap v3742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:03 smithi196 ceph-mon[32572]: pgmap v3742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:05 smithi110 ceph-mon[28069]: pgmap v3743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:29:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:05 smithi193 ceph-mon[32782]: pgmap v3743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:29:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:05 smithi196 ceph-mon[32572]: pgmap v3743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:29:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6061.880939 secs 2024-04-26T13:29:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:07 smithi110 ceph-mon[28069]: pgmap v3744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6061.880939 secs 2024-04-26T13:29:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:07 smithi193 ceph-mon[32782]: pgmap v3744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6061.880939 secs 2024-04-26T13:29:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:07 smithi196 ceph-mon[32572]: pgmap v3744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:09 smithi110 ceph-mon[28069]: pgmap v3745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:09 smithi193 ceph-mon[32782]: pgmap v3745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:09 smithi196 ceph-mon[32572]: pgmap v3745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:11 smithi110 ceph-mon[28069]: pgmap v3746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:29:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:11 smithi193 ceph-mon[32782]: pgmap v3746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:29:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:11 smithi196 ceph-mon[32572]: pgmap v3746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:29:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6066.881069 secs 2024-04-26T13:29:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6066.881069 secs 2024-04-26T13:29:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6066.881069 secs 2024-04-26T13:29:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:13 smithi193 ceph-mon[32782]: pgmap v3747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:13 smithi196 ceph-mon[32572]: pgmap v3747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:13 smithi110 ceph-mon[28069]: pgmap v3747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:15 smithi193 ceph-mon[32782]: pgmap v3748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:15 smithi196 ceph-mon[32572]: pgmap v3748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:15 smithi110 ceph-mon[28069]: pgmap v3748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6071.881209 secs 2024-04-26T13:29:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:17 smithi193 ceph-mon[32782]: pgmap v3749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:29:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6071.881209 secs 2024-04-26T13:29:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:17 smithi196 ceph-mon[32572]: pgmap v3749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:29:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6071.881209 secs 2024-04-26T13:29:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:17 smithi110 ceph-mon[28069]: pgmap v3749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:29:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:19 smithi193 ceph-mon[32782]: pgmap v3750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:19 smithi196 ceph-mon[32572]: pgmap v3750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:19 smithi110 ceph-mon[28069]: pgmap v3750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:29:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:21 smithi193 ceph-mon[32782]: pgmap v3751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:21 smithi196 ceph-mon[32572]: pgmap v3751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:21 smithi110 ceph-mon[28069]: pgmap v3751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6076.881340 secs 2024-04-26T13:29:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6076.881340 secs 2024-04-26T13:29:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6076.881340 secs 2024-04-26T13:29:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:23 smithi193 ceph-mon[32782]: pgmap v3752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:23 smithi196 ceph-mon[32572]: pgmap v3752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:23 smithi110 ceph-mon[28069]: pgmap v3752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:25 smithi193 ceph-mon[32782]: pgmap v3753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:29:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:25 smithi196 ceph-mon[32572]: pgmap v3753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:29:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:25 smithi110 ceph-mon[28069]: pgmap v3753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:29:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6081.881471 secs 2024-04-26T13:29:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:27 smithi193 ceph-mon[32782]: pgmap v3754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6081.881471 secs 2024-04-26T13:29:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:27 smithi196 ceph-mon[32572]: pgmap v3754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6081.881471 secs 2024-04-26T13:29:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:27 smithi110 ceph-mon[28069]: pgmap v3754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:29 smithi193 ceph-mon[32782]: pgmap v3755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:30.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:29 smithi196 ceph-mon[32572]: pgmap v3755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:29 smithi110 ceph-mon[28069]: pgmap v3755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:31 smithi193 ceph-mon[32782]: pgmap v3756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:31 smithi196 ceph-mon[32572]: pgmap v3756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:31 smithi110 ceph-mon[28069]: pgmap v3756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6086.881600 secs 2024-04-26T13:29:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6086.881600 secs 2024-04-26T13:29:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6086.881600 secs 2024-04-26T13:29:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:33 smithi193 ceph-mon[32782]: pgmap v3757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:29:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:33 smithi196 ceph-mon[32572]: pgmap v3757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:29:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:33 smithi110 ceph-mon[28069]: pgmap v3757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:29:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:29:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:29:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:29:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:29:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:29:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:29:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:29:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:29:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:29:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:35 smithi196 ceph-mon[32572]: pgmap v3758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 2 op/s 2024-04-26T13:29:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:35 smithi196 ceph-mon[32572]: pgmap v3759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:35 smithi110 ceph-mon[28069]: pgmap v3758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 2 op/s 2024-04-26T13:29:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:35 smithi110 ceph-mon[28069]: pgmap v3759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:35 smithi193 ceph-mon[32782]: pgmap v3758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 2 op/s 2024-04-26T13:29:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:35 smithi193 ceph-mon[32782]: pgmap v3759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:37 smithi196 ceph-mon[32572]: pgmap v3760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6091.881719 secs 2024-04-26T13:29:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:37 smithi110 ceph-mon[28069]: pgmap v3760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6091.881719 secs 2024-04-26T13:29:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:37 smithi193 ceph-mon[32782]: pgmap v3760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6091.881719 secs 2024-04-26T13:29:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:39 smithi196 ceph-mon[32572]: pgmap v3761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:39 smithi110 ceph-mon[28069]: pgmap v3761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:39 smithi193 ceph-mon[32782]: pgmap v3761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:41 smithi196 ceph-mon[32572]: pgmap v3762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:41 smithi110 ceph-mon[28069]: pgmap v3762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:41 smithi193 ceph-mon[32782]: pgmap v3762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:29:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6096.881810 secs 2024-04-26T13:29:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6096.881810 secs 2024-04-26T13:29:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6096.881810 secs 2024-04-26T13:29:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:43 smithi196 ceph-mon[32572]: pgmap v3763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:29:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:43 smithi110 ceph-mon[28069]: pgmap v3763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:29:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:43 smithi193 ceph-mon[32782]: pgmap v3763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:29:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:45 smithi196 ceph-mon[32572]: pgmap v3764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:29:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:45 smithi110 ceph-mon[28069]: pgmap v3764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:29:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:45 smithi193 ceph-mon[32782]: pgmap v3764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:29:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:47 smithi196 ceph-mon[32572]: pgmap v3765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6101.881887 secs 2024-04-26T13:29:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:47 smithi110 ceph-mon[28069]: pgmap v3765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6101.881887 secs 2024-04-26T13:29:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:47 smithi193 ceph-mon[32782]: pgmap v3765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6101.881887 secs 2024-04-26T13:29:49.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:49 smithi193 ceph-mon[32782]: pgmap v3766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:49 smithi196 ceph-mon[32572]: pgmap v3766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:49 smithi110 ceph-mon[28069]: pgmap v3766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:51 smithi196 ceph-mon[32572]: pgmap v3767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:51 smithi110 ceph-mon[28069]: pgmap v3767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:51 smithi193 ceph-mon[32782]: pgmap v3767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6106.881985 secs 2024-04-26T13:29:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6106.881985 secs 2024-04-26T13:29:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6106.881985 secs 2024-04-26T13:29:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:53 smithi196 ceph-mon[32572]: pgmap v3768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:53 smithi110 ceph-mon[28069]: pgmap v3768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:53 smithi193 ceph-mon[32782]: pgmap v3768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:55 smithi196 ceph-mon[32572]: pgmap v3769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:55 smithi110 ceph-mon[28069]: pgmap v3769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:55 smithi193 ceph-mon[32782]: pgmap v3769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:29:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:57 smithi196 ceph-mon[32572]: pgmap v3770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6111.882123 secs 2024-04-26T13:29:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:57 smithi110 ceph-mon[28069]: pgmap v3770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6111.882123 secs 2024-04-26T13:29:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:57 smithi193 ceph-mon[32782]: pgmap v3770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:29:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6111.882123 secs 2024-04-26T13:30:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:29:59 smithi196 ceph-mon[32572]: pgmap v3771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:29:59 smithi110 ceph-mon[28069]: pgmap v3771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:29:59 smithi193 ceph-mon[32782]: pgmap v3771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:30:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:30:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:30:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:01 smithi196 ceph-mon[32572]: pgmap v3772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:01 smithi110 ceph-mon[28069]: pgmap v3772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:01 smithi193 ceph-mon[32782]: pgmap v3772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:02 smithi196 ceph-mon[32572]: 6 slow requests, 1 included below; oldest blocked for > 6116.882245 secs 2024-04-26T13:30:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:02 smithi196 ceph-mon[32572]: slow request 5760.640193 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:30:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:02 smithi110 ceph-mon[28069]: 6 slow requests, 1 included below; oldest blocked for > 6116.882245 secs 2024-04-26T13:30:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:02 smithi110 ceph-mon[28069]: slow request 5760.640193 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:30:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:02 smithi193 ceph-mon[32782]: 6 slow requests, 1 included below; oldest blocked for > 6116.882245 secs 2024-04-26T13:30:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:02 smithi193 ceph-mon[32782]: slow request 5760.640193 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:30:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:03 smithi196 ceph-mon[32572]: pgmap v3773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:03 smithi110 ceph-mon[28069]: pgmap v3773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:03 smithi193 ceph-mon[32782]: pgmap v3773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:05 smithi196 ceph-mon[32572]: pgmap v3774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:05 smithi110 ceph-mon[28069]: pgmap v3774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:05 smithi193 ceph-mon[32782]: pgmap v3774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:07 smithi196 ceph-mon[32572]: pgmap v3775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:07 smithi196 ceph-mon[32572]: 6 slow requests, 1 included below; oldest blocked for > 6121.882386 secs 2024-04-26T13:30:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:07 smithi196 ceph-mon[32572]: slow request 363.137680 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:30:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:07 smithi110 ceph-mon[28069]: pgmap v3775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:07 smithi110 ceph-mon[28069]: 6 slow requests, 1 included below; oldest blocked for > 6121.882386 secs 2024-04-26T13:30:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:07 smithi110 ceph-mon[28069]: slow request 363.137680 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:30:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:07 smithi193 ceph-mon[32782]: pgmap v3775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:07 smithi193 ceph-mon[32782]: 6 slow requests, 1 included below; oldest blocked for > 6121.882386 secs 2024-04-26T13:30:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:07 smithi193 ceph-mon[32782]: slow request 363.137680 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:30:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:09 smithi196 ceph-mon[32572]: pgmap v3776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:09 smithi110 ceph-mon[28069]: pgmap v3776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:09 smithi193 ceph-mon[32782]: pgmap v3776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:11 smithi196 ceph-mon[32572]: pgmap v3777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:11 smithi110 ceph-mon[28069]: pgmap v3777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:11 smithi193 ceph-mon[32782]: pgmap v3777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6126.882506 secs 2024-04-26T13:30:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6126.882506 secs 2024-04-26T13:30:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6126.882506 secs 2024-04-26T13:30:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:13 smithi110 ceph-mon[28069]: pgmap v3778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:13 smithi193 ceph-mon[32782]: pgmap v3778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:13 smithi196 ceph-mon[32572]: pgmap v3778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:15 smithi110 ceph-mon[28069]: pgmap v3779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:15 smithi193 ceph-mon[32782]: pgmap v3779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:15 smithi196 ceph-mon[32572]: pgmap v3779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:30:17.350+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:30:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:30:17.350+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:30:17.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:30:17.350+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 51 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:30:17.351 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:30:17.350+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 51 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:30:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:17 smithi110 ceph-mon[28069]: pgmap v3780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6131.882624 secs 2024-04-26T13:30:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:17 smithi193 ceph-mon[32782]: pgmap v3780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6131.882624 secs 2024-04-26T13:30:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:17 smithi196 ceph-mon[32572]: pgmap v3780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6131.882624 secs 2024-04-26T13:30:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:19 smithi110 ceph-mon[28069]: pgmap v3781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:19 smithi193 ceph-mon[32782]: pgmap v3781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:19 smithi196 ceph-mon[32572]: pgmap v3781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:22.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:21 smithi196 ceph-mon[32572]: pgmap v3782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:21 smithi193 ceph-mon[32782]: pgmap v3782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:21 smithi110 ceph-mon[28069]: pgmap v3782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6136.882742 secs 2024-04-26T13:30:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6136.882742 secs 2024-04-26T13:30:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6136.882742 secs 2024-04-26T13:30:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:23 smithi193 ceph-mon[32782]: pgmap v3783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:23 smithi196 ceph-mon[32572]: pgmap v3783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:23 smithi110 ceph-mon[28069]: pgmap v3783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:25 smithi193 ceph-mon[32782]: pgmap v3784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:25 smithi196 ceph-mon[32572]: pgmap v3784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:25 smithi110 ceph-mon[28069]: pgmap v3784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:27 smithi193 ceph-mon[32782]: pgmap v3785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6141.882860 secs 2024-04-26T13:30:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:27 smithi196 ceph-mon[32572]: pgmap v3785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6141.882860 secs 2024-04-26T13:30:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:27 smithi110 ceph-mon[28069]: pgmap v3785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6141.882860 secs 2024-04-26T13:30:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:29 smithi193 ceph-mon[32782]: pgmap v3786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:29 smithi196 ceph-mon[32572]: pgmap v3786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:29 smithi110 ceph-mon[28069]: pgmap v3786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:32.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:31 smithi110 ceph-mon[28069]: pgmap v3787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:31 smithi193 ceph-mon[32782]: pgmap v3787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:31 smithi196 ceph-mon[32572]: pgmap v3787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6146.882938 secs 2024-04-26T13:30:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6146.882938 secs 2024-04-26T13:30:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6146.882938 secs 2024-04-26T13:30:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:33 smithi193 ceph-mon[32782]: pgmap v3788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:33 smithi196 ceph-mon[32572]: pgmap v3788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:33 smithi110 ceph-mon[28069]: pgmap v3788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:30:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:30:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:30:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:35 smithi193 ceph-mon[32782]: pgmap v3789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:30:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:30:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:30:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:35 smithi196 ceph-mon[32572]: pgmap v3789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:30:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:30:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:30:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:35 smithi110 ceph-mon[28069]: pgmap v3789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:30:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:30:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:30:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:36 smithi193 ceph-mon[32782]: pgmap v3790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T13:30:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:36 smithi193 ceph-mon[32782]: pgmap v3791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:36 smithi196 ceph-mon[32572]: pgmap v3790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T13:30:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:36 smithi196 ceph-mon[32572]: pgmap v3791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:36 smithi110 ceph-mon[28069]: pgmap v3790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T13:30:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:36 smithi110 ceph-mon[28069]: pgmap v3791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6151.883079 secs 2024-04-26T13:30:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6151.883079 secs 2024-04-26T13:30:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6151.883079 secs 2024-04-26T13:30:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:38 smithi196 ceph-mon[32572]: pgmap v3792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T13:30:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:38 smithi110 ceph-mon[28069]: pgmap v3792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T13:30:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:38 smithi193 ceph-mon[32782]: pgmap v3792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T13:30:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:40 smithi196 ceph-mon[32572]: pgmap v3793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:40 smithi110 ceph-mon[28069]: pgmap v3793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:40 smithi193 ceph-mon[32782]: pgmap v3793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6156.883200 secs 2024-04-26T13:30:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:42 smithi196 ceph-mon[32572]: pgmap v3794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6156.883200 secs 2024-04-26T13:30:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:42 smithi110 ceph-mon[28069]: pgmap v3794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6156.883200 secs 2024-04-26T13:30:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:42 smithi193 ceph-mon[32782]: pgmap v3794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:44 smithi196 ceph-mon[32572]: pgmap v3795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:44 smithi110 ceph-mon[28069]: pgmap v3795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:44 smithi193 ceph-mon[32782]: pgmap v3795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:30:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:46 smithi196 ceph-mon[32572]: pgmap v3796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:30:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:46 smithi110 ceph-mon[28069]: pgmap v3796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:30:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:46 smithi193 ceph-mon[32782]: pgmap v3796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:30:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6161.883324 secs 2024-04-26T13:30:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6161.883324 secs 2024-04-26T13:30:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6161.883324 secs 2024-04-26T13:30:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:48 smithi196 ceph-mon[32572]: pgmap v3797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:49.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:48 smithi193 ceph-mon[32782]: pgmap v3797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:48 smithi110 ceph-mon[28069]: pgmap v3797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:49 smithi196 ceph-mon[32572]: pgmap v3798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:30:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:49 smithi110 ceph-mon[28069]: pgmap v3798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:30:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:49 smithi193 ceph-mon[32782]: pgmap v3798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:30:52.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6166.883442 secs 2024-04-26T13:30:52.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:52 smithi110 ceph-mon[28069]: pgmap v3799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6166.883442 secs 2024-04-26T13:30:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:52 smithi193 ceph-mon[32782]: pgmap v3799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:52.957 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6166.883442 secs 2024-04-26T13:30:52.957 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:52 smithi196 ceph-mon[32572]: pgmap v3799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:54 smithi110 ceph-mon[28069]: pgmap v3800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:54 smithi193 ceph-mon[32782]: pgmap v3800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:54 smithi196 ceph-mon[32572]: pgmap v3800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:56 smithi110 ceph-mon[28069]: pgmap v3801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:56 smithi193 ceph-mon[32782]: pgmap v3801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:56 smithi196 ceph-mon[32572]: pgmap v3801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:30:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6171.883585 secs 2024-04-26T13:30:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6171.883585 secs 2024-04-26T13:30:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6171.883585 secs 2024-04-26T13:30:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:30:58 smithi110 ceph-mon[28069]: pgmap v3802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:30:58 smithi193 ceph-mon[32782]: pgmap v3802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:30:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:30:58 smithi196 ceph-mon[32572]: pgmap v3802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:00 smithi193 ceph-mon[32782]: pgmap v3803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:31:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:00 smithi196 ceph-mon[32572]: pgmap v3803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:31:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:00 smithi110 ceph-mon[28069]: pgmap v3803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:31:02.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6176.883685 secs 2024-04-26T13:31:02.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:02 smithi110 ceph-mon[28069]: pgmap v3804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6176.883685 secs 2024-04-26T13:31:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:02 smithi193 ceph-mon[32782]: pgmap v3804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6176.883685 secs 2024-04-26T13:31:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:02 smithi196 ceph-mon[32572]: pgmap v3804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:04 smithi193 ceph-mon[32782]: pgmap v3805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:04 smithi196 ceph-mon[32572]: pgmap v3805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:04 smithi110 ceph-mon[28069]: pgmap v3805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:06 smithi193 ceph-mon[32782]: pgmap v3806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:06 smithi196 ceph-mon[32572]: pgmap v3806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:06 smithi110 ceph-mon[28069]: pgmap v3806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6181.883773 secs 2024-04-26T13:31:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6181.883773 secs 2024-04-26T13:31:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6181.883773 secs 2024-04-26T13:31:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:08 smithi193 ceph-mon[32782]: pgmap v3807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:08 smithi196 ceph-mon[32572]: pgmap v3807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:08 smithi110 ceph-mon[28069]: pgmap v3807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:10 smithi193 ceph-mon[32782]: pgmap v3808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:31:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:10 smithi196 ceph-mon[32572]: pgmap v3808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:31:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:10 smithi110 ceph-mon[28069]: pgmap v3808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:31:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6186.883892 secs 2024-04-26T13:31:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:12 smithi193 ceph-mon[32782]: pgmap v3809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6186.883892 secs 2024-04-26T13:31:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:12 smithi196 ceph-mon[32572]: pgmap v3809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6186.883892 secs 2024-04-26T13:31:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:12 smithi110 ceph-mon[28069]: pgmap v3809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:14 smithi193 ceph-mon[32782]: pgmap v3810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:14 smithi196 ceph-mon[32572]: pgmap v3810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:14 smithi110 ceph-mon[28069]: pgmap v3810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:16 smithi193 ceph-mon[32782]: pgmap v3811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:16 smithi196 ceph-mon[32572]: pgmap v3811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:16 smithi110 ceph-mon[28069]: pgmap v3811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6191.884014 secs 2024-04-26T13:31:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6191.884014 secs 2024-04-26T13:31:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6191.884014 secs 2024-04-26T13:31:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:18 smithi193 ceph-mon[32782]: pgmap v3812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:18 smithi196 ceph-mon[32572]: pgmap v3812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:18 smithi110 ceph-mon[28069]: pgmap v3812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:20 smithi193 ceph-mon[32782]: pgmap v3813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:31:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:20 smithi196 ceph-mon[32572]: pgmap v3813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:31:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:20 smithi110 ceph-mon[28069]: pgmap v3813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:31:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6196.884079 secs 2024-04-26T13:31:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:22 smithi193 ceph-mon[32782]: pgmap v3814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:31:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6196.884079 secs 2024-04-26T13:31:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:22 smithi196 ceph-mon[32572]: pgmap v3814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:31:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6196.884079 secs 2024-04-26T13:31:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:22 smithi110 ceph-mon[28069]: pgmap v3814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:31:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:24 smithi193 ceph-mon[32782]: pgmap v3815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:24 smithi196 ceph-mon[32572]: pgmap v3815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:24 smithi110 ceph-mon[28069]: pgmap v3815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:26 smithi196 ceph-mon[32572]: pgmap v3816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:31:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:26 smithi110 ceph-mon[28069]: pgmap v3816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:31:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:26 smithi193 ceph-mon[32782]: pgmap v3816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:31:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6201.884194 secs 2024-04-26T13:31:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6201.884194 secs 2024-04-26T13:31:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6201.884194 secs 2024-04-26T13:31:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:28 smithi196 ceph-mon[32572]: pgmap v3817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:28 smithi110 ceph-mon[28069]: pgmap v3817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:28 smithi193 ceph-mon[32782]: pgmap v3817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:30 smithi196 ceph-mon[32572]: pgmap v3818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:30 smithi110 ceph-mon[28069]: pgmap v3818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:30 smithi193 ceph-mon[32782]: pgmap v3818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6206.884317 secs 2024-04-26T13:31:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:32 smithi196 ceph-mon[32572]: pgmap v3819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6206.884317 secs 2024-04-26T13:31:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:32 smithi110 ceph-mon[28069]: pgmap v3819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6206.884317 secs 2024-04-26T13:31:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:32 smithi193 ceph-mon[32782]: pgmap v3819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:34 smithi196 ceph-mon[32572]: pgmap v3820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:34 smithi110 ceph-mon[28069]: pgmap v3820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:34 smithi193 ceph-mon[32782]: pgmap v3820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:36 smithi196 ceph-mon[32572]: pgmap v3821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:31:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:36 smithi110 ceph-mon[28069]: pgmap v3821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:31:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:36 smithi193 ceph-mon[32782]: pgmap v3821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:31:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6211.884404 secs 2024-04-26T13:31:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:31:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:31:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:31:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6211.884404 secs 2024-04-26T13:31:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:31:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:31:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:31:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6211.884404 secs 2024-04-26T13:31:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:31:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:31:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:31:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:38 smithi196 ceph-mon[32572]: pgmap v3822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T13:31:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:38 smithi196 ceph-mon[32572]: pgmap v3823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T13:31:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:38 smithi110 ceph-mon[28069]: pgmap v3822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T13:31:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:38 smithi110 ceph-mon[28069]: pgmap v3823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T13:31:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:38 smithi193 ceph-mon[32782]: pgmap v3822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T13:31:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:38 smithi193 ceph-mon[32782]: pgmap v3823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T13:31:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:40 smithi196 ceph-mon[32572]: pgmap v3824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:40 smithi110 ceph-mon[28069]: pgmap v3824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:40 smithi193 ceph-mon[32782]: pgmap v3824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:42 smithi196 ceph-mon[32572]: pgmap v3825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6216.884546 secs 2024-04-26T13:31:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:42 smithi110 ceph-mon[28069]: pgmap v3825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6216.884546 secs 2024-04-26T13:31:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:42 smithi193 ceph-mon[32782]: pgmap v3825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6216.884546 secs 2024-04-26T13:31:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:44 smithi196 ceph-mon[32572]: pgmap v3826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:44 smithi110 ceph-mon[28069]: pgmap v3826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:44 smithi193 ceph-mon[32782]: pgmap v3826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:46 smithi196 ceph-mon[32572]: pgmap v3827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:46 smithi110 ceph-mon[28069]: pgmap v3827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:46 smithi193 ceph-mon[32782]: pgmap v3827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:31:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6221.884687 secs 2024-04-26T13:31:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6221.884687 secs 2024-04-26T13:31:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6221.884687 secs 2024-04-26T13:31:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:48 smithi196 ceph-mon[32572]: pgmap v3828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:31:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:48 smithi110 ceph-mon[28069]: pgmap v3828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:31:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:48 smithi193 ceph-mon[32782]: pgmap v3828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:31:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:50 smithi196 ceph-mon[32572]: pgmap v3829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:50 smithi110 ceph-mon[28069]: pgmap v3829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:50 smithi193 ceph-mon[32782]: pgmap v3829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:52 smithi196 ceph-mon[32572]: pgmap v3830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6226.884806 secs 2024-04-26T13:31:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:52 smithi110 ceph-mon[28069]: pgmap v3830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6226.884806 secs 2024-04-26T13:31:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:52 smithi193 ceph-mon[32782]: pgmap v3830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6226.884806 secs 2024-04-26T13:31:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:54 smithi196 ceph-mon[32572]: pgmap v3831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:54 smithi110 ceph-mon[28069]: pgmap v3831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:54 smithi193 ceph-mon[32782]: pgmap v3831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:31:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:56 smithi196 ceph-mon[32572]: pgmap v3832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:56 smithi110 ceph-mon[28069]: pgmap v3832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:56 smithi193 ceph-mon[32782]: pgmap v3832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6231.884924 secs 2024-04-26T13:31:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6231.884924 secs 2024-04-26T13:31:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6231.884924 secs 2024-04-26T13:31:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:31:58 smithi196 ceph-mon[32572]: pgmap v3833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:31:58 smithi110 ceph-mon[28069]: pgmap v3833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:31:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:31:58 smithi193 ceph-mon[32782]: pgmap v3833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:00 smithi196 ceph-mon[32572]: pgmap v3834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:00 smithi110 ceph-mon[28069]: pgmap v3834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:00 smithi193 ceph-mon[32782]: pgmap v3834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:02 smithi196 ceph-mon[32572]: pgmap v3835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6236.884996 secs 2024-04-26T13:32:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:02 smithi110 ceph-mon[28069]: pgmap v3835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6236.884996 secs 2024-04-26T13:32:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:02 smithi193 ceph-mon[32782]: pgmap v3835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6236.884996 secs 2024-04-26T13:32:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:04 smithi196 ceph-mon[32572]: pgmap v3836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:04 smithi110 ceph-mon[28069]: pgmap v3836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:04 smithi193 ceph-mon[32782]: pgmap v3836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:06 smithi110 ceph-mon[28069]: pgmap v3837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:06 smithi193 ceph-mon[32782]: pgmap v3837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:06 smithi196 ceph-mon[32572]: pgmap v3837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6241.885120 secs 2024-04-26T13:32:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6241.885120 secs 2024-04-26T13:32:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6241.885120 secs 2024-04-26T13:32:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:08 smithi110 ceph-mon[28069]: pgmap v3838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:08 smithi193 ceph-mon[32782]: pgmap v3838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:08 smithi196 ceph-mon[32572]: pgmap v3838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:10 smithi110 ceph-mon[28069]: pgmap v3839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:10 smithi193 ceph-mon[32782]: pgmap v3839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:10 smithi196 ceph-mon[32572]: pgmap v3839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:12 smithi110 ceph-mon[28069]: pgmap v3840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6246.885241 secs 2024-04-26T13:32:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:12 smithi193 ceph-mon[32782]: pgmap v3840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6246.885241 secs 2024-04-26T13:32:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:12 smithi196 ceph-mon[32572]: pgmap v3840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6246.885241 secs 2024-04-26T13:32:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:14 smithi110 ceph-mon[28069]: pgmap v3841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:14 smithi193 ceph-mon[32782]: pgmap v3841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:14 smithi196 ceph-mon[32572]: pgmap v3841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:16 smithi110 ceph-mon[28069]: pgmap v3842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:16 smithi193 ceph-mon[32782]: pgmap v3842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:16 smithi196 ceph-mon[32572]: pgmap v3842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6251.885356 secs 2024-04-26T13:32:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6251.885356 secs 2024-04-26T13:32:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6251.885356 secs 2024-04-26T13:32:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:18 smithi193 ceph-mon[32782]: pgmap v3843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:18 smithi196 ceph-mon[32572]: pgmap v3843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:18 smithi110 ceph-mon[28069]: pgmap v3843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:20 smithi193 ceph-mon[32782]: pgmap v3844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:20 smithi196 ceph-mon[32572]: pgmap v3844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:20 smithi110 ceph-mon[28069]: pgmap v3844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:22 smithi193 ceph-mon[32782]: pgmap v3845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6256.885483 secs 2024-04-26T13:32:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:22 smithi196 ceph-mon[32572]: pgmap v3845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6256.885483 secs 2024-04-26T13:32:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:22 smithi110 ceph-mon[28069]: pgmap v3845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6256.885483 secs 2024-04-26T13:32:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:24 smithi193 ceph-mon[32782]: pgmap v3846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:24 smithi196 ceph-mon[32572]: pgmap v3846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:24 smithi110 ceph-mon[28069]: pgmap v3846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:26 smithi193 ceph-mon[32782]: pgmap v3847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:26 smithi196 ceph-mon[32572]: pgmap v3847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:26 smithi110 ceph-mon[28069]: pgmap v3847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6261.885636 secs 2024-04-26T13:32:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6261.885636 secs 2024-04-26T13:32:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6261.885636 secs 2024-04-26T13:32:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:28 smithi193 ceph-mon[32782]: pgmap v3848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:28 smithi196 ceph-mon[32572]: pgmap v3848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:28 smithi110 ceph-mon[28069]: pgmap v3848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:30 smithi193 ceph-mon[32782]: pgmap v3849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:30 smithi196 ceph-mon[32572]: pgmap v3849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:30 smithi110 ceph-mon[28069]: pgmap v3849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:33.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:32 smithi110 ceph-mon[28069]: pgmap v3850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:33.095 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6266.885756 secs 2024-04-26T13:32:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:32 smithi193 ceph-mon[32782]: pgmap v3850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6266.885756 secs 2024-04-26T13:32:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:32 smithi196 ceph-mon[32572]: pgmap v3850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6266.885756 secs 2024-04-26T13:32:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:34 smithi193 ceph-mon[32782]: pgmap v3851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:34 smithi196 ceph-mon[32572]: pgmap v3851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:34 smithi110 ceph-mon[28069]: pgmap v3851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:36 smithi193 ceph-mon[32782]: pgmap v3852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:36 smithi196 ceph-mon[32572]: pgmap v3852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:36 smithi110 ceph-mon[28069]: pgmap v3852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6271.885880 secs 2024-04-26T13:32:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:32:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6271.885880 secs 2024-04-26T13:32:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:32:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6271.885880 secs 2024-04-26T13:32:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:32:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:38 smithi193 ceph-mon[32782]: pgmap v3853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:38 smithi196 ceph-mon[32572]: pgmap v3853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:38 smithi110 ceph-mon[28069]: pgmap v3853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:40 smithi193 ceph-mon[32782]: pgmap v3854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:32:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:32:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:40 smithi193 ceph-mon[32782]: pgmap v3855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 994 B/s rd, 1 op/s 2024-04-26T13:32:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:40 smithi193 ceph-mon[32782]: pgmap v3856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:40 smithi196 ceph-mon[32572]: pgmap v3854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:32:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:32:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:40 smithi196 ceph-mon[32572]: pgmap v3855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 994 B/s rd, 1 op/s 2024-04-26T13:32:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:40 smithi196 ceph-mon[32572]: pgmap v3856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:40 smithi110 ceph-mon[28069]: pgmap v3854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:40 smithi110 ceph-mon[28069]: pgmap v3855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 994 B/s rd, 1 op/s 2024-04-26T13:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:40 smithi110 ceph-mon[28069]: pgmap v3856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:32:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6276.886003 secs 2024-04-26T13:32:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:42 smithi196 ceph-mon[32572]: pgmap v3857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T13:32:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6276.886003 secs 2024-04-26T13:32:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:42 smithi110 ceph-mon[28069]: pgmap v3857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T13:32:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6276.886003 secs 2024-04-26T13:32:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:42 smithi193 ceph-mon[32782]: pgmap v3857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T13:32:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:44 smithi196 ceph-mon[32572]: pgmap v3858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:44 smithi110 ceph-mon[28069]: pgmap v3858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:44 smithi193 ceph-mon[32782]: pgmap v3858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:46 smithi196 ceph-mon[32572]: pgmap v3859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:46 smithi110 ceph-mon[28069]: pgmap v3859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:46 smithi193 ceph-mon[32782]: pgmap v3859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6281.886142 secs 2024-04-26T13:32:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6281.886142 secs 2024-04-26T13:32:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6281.886142 secs 2024-04-26T13:32:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:48 smithi196 ceph-mon[32572]: pgmap v3860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:48 smithi110 ceph-mon[28069]: pgmap v3860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:48 smithi193 ceph-mon[32782]: pgmap v3860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:50.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:50 smithi193 ceph-mon[32782]: pgmap v3861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:32:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:50 smithi196 ceph-mon[32572]: pgmap v3861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:32:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:50 smithi110 ceph-mon[28069]: pgmap v3861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:32:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6286.886301 secs 2024-04-26T13:32:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:52 smithi196 ceph-mon[32572]: pgmap v3862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6286.886301 secs 2024-04-26T13:32:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:52 smithi110 ceph-mon[28069]: pgmap v3862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6286.886301 secs 2024-04-26T13:32:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:52 smithi193 ceph-mon[32782]: pgmap v3862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:54 smithi196 ceph-mon[32572]: pgmap v3863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:54 smithi110 ceph-mon[28069]: pgmap v3863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:54.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:54 smithi193 ceph-mon[32782]: pgmap v3863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:56 smithi196 ceph-mon[32572]: pgmap v3864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:56 smithi110 ceph-mon[28069]: pgmap v3864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:56 smithi193 ceph-mon[32782]: pgmap v3864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:32:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6291.886426 secs 2024-04-26T13:32:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6291.886426 secs 2024-04-26T13:32:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6291.886426 secs 2024-04-26T13:32:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:32:58 smithi196 ceph-mon[32572]: pgmap v3865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:32:58 smithi110 ceph-mon[28069]: pgmap v3865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:32:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:32:58 smithi193 ceph-mon[32782]: pgmap v3865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:00 smithi196 ceph-mon[32572]: pgmap v3866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:00 smithi110 ceph-mon[28069]: pgmap v3866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:00 smithi193 ceph-mon[32782]: pgmap v3866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6296.886546 secs 2024-04-26T13:33:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:02 smithi196 ceph-mon[32572]: pgmap v3867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6296.886546 secs 2024-04-26T13:33:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:02 smithi110 ceph-mon[28069]: pgmap v3867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6296.886546 secs 2024-04-26T13:33:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:02 smithi193 ceph-mon[32782]: pgmap v3867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:04 smithi196 ceph-mon[32572]: pgmap v3868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:04 smithi110 ceph-mon[28069]: pgmap v3868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:04 smithi193 ceph-mon[32782]: pgmap v3868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:06 smithi196 ceph-mon[32572]: pgmap v3869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:06 smithi110 ceph-mon[28069]: pgmap v3869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:06 smithi193 ceph-mon[32782]: pgmap v3869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6301.886672 secs 2024-04-26T13:33:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6301.886672 secs 2024-04-26T13:33:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6301.886672 secs 2024-04-26T13:33:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:08 smithi196 ceph-mon[32572]: pgmap v3870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:08 smithi110 ceph-mon[28069]: pgmap v3870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:08 smithi193 ceph-mon[32782]: pgmap v3870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:10 smithi196 ceph-mon[32572]: pgmap v3871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:10 smithi110 ceph-mon[28069]: pgmap v3871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:10 smithi193 ceph-mon[32782]: pgmap v3871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6306.886796 secs 2024-04-26T13:33:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:12 smithi196 ceph-mon[32572]: pgmap v3872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6306.886796 secs 2024-04-26T13:33:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:12 smithi110 ceph-mon[28069]: pgmap v3872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6306.886796 secs 2024-04-26T13:33:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:12 smithi193 ceph-mon[32782]: pgmap v3872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:14 smithi196 ceph-mon[32572]: pgmap v3873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:14 smithi110 ceph-mon[28069]: pgmap v3873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:14 smithi193 ceph-mon[32782]: pgmap v3873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.377+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 msgr2=0x7f26000a49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T13:33:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.377+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 msgr2=0x7f26000a49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T13:33:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.377+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 0x7f26000a49b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2614029000 tx=0x7f2614042040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T13:33:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.377+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 0x7f26000a49b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2614029000 tx=0x7f2614042040 comp rx=0 tx=0).stop 2024-04-26T13:33:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.377+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 msgr2=0x7f26000a49b0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T13:33:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.377+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 msgr2=0x7f26000a49b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T13:33:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.377+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a45d0 0x7f26000a49b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T13:33:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.377+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T13:33:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.377+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T13:33:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.379+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 0x7f26000b4670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f2614036000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T13:33:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.398+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T13:33:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.398+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T13:33:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.398+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T13:33:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.398+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T13:33:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.398+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T13:33:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.399+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T13:33:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:16.399+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T13:33:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:16 smithi196 ceph-mon[32572]: pgmap v3874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:16 smithi110 ceph-mon[28069]: pgmap v3874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:16 smithi193 ceph-mon[32782]: pgmap v3874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:17.378+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:33:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:17.378+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:33:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:17.379+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 52 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:33:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:33:17.379+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 52 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6311.886917 secs 2024-04-26T13:33:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6311.886917 secs 2024-04-26T13:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6311.886917 secs 2024-04-26T13:33:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:18 smithi196 ceph-mon[32572]: pgmap v3875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:18 smithi110 ceph-mon[28069]: pgmap v3875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:18 smithi193 ceph-mon[32782]: pgmap v3875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:20 smithi196 ceph-mon[32572]: pgmap v3876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:20 smithi110 ceph-mon[28069]: pgmap v3876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:20 smithi193 ceph-mon[32782]: pgmap v3876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6316.887000 secs 2024-04-26T13:33:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:22 smithi110 ceph-mon[28069]: pgmap v3877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6316.887000 secs 2024-04-26T13:33:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:22 smithi193 ceph-mon[32782]: pgmap v3877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6316.887000 secs 2024-04-26T13:33:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:22 smithi196 ceph-mon[32572]: pgmap v3877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:24 smithi110 ceph-mon[28069]: pgmap v3878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:24.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:24 smithi196 ceph-mon[32572]: pgmap v3878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:24 smithi193 ceph-mon[32782]: pgmap v3878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:26 smithi110 ceph-mon[28069]: pgmap v3879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:26 smithi193 ceph-mon[32782]: pgmap v3879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:26 smithi196 ceph-mon[32572]: pgmap v3879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6321.887100 secs 2024-04-26T13:33:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6321.887100 secs 2024-04-26T13:33:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6321.887100 secs 2024-04-26T13:33:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:28 smithi110 ceph-mon[28069]: pgmap v3880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:28 smithi193 ceph-mon[32782]: pgmap v3880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:28 smithi196 ceph-mon[32572]: pgmap v3880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:30 smithi110 ceph-mon[28069]: pgmap v3881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:30 smithi193 ceph-mon[32782]: pgmap v3881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:30 smithi196 ceph-mon[32572]: pgmap v3881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6326.887245 secs 2024-04-26T13:33:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:32 smithi193 ceph-mon[32782]: pgmap v3882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6326.887245 secs 2024-04-26T13:33:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:32 smithi196 ceph-mon[32572]: pgmap v3882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6326.887245 secs 2024-04-26T13:33:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:32 smithi110 ceph-mon[28069]: pgmap v3882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:34.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:34 smithi110 ceph-mon[28069]: pgmap v3883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:34 smithi193 ceph-mon[32782]: pgmap v3883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:34 smithi196 ceph-mon[32572]: pgmap v3883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:36 smithi193 ceph-mon[32782]: pgmap v3884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:36 smithi196 ceph-mon[32572]: pgmap v3884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:36 smithi110 ceph-mon[28069]: pgmap v3884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6331.887387 secs 2024-04-26T13:33:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6331.887387 secs 2024-04-26T13:33:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6331.887387 secs 2024-04-26T13:33:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:38 smithi193 ceph-mon[32782]: pgmap v3885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:38 smithi196 ceph-mon[32572]: pgmap v3885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:38 smithi110 ceph-mon[28069]: pgmap v3885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:40 smithi193 ceph-mon[32782]: pgmap v3886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:33:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:33:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:33:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:40 smithi196 ceph-mon[32572]: pgmap v3886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:33:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:33:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:33:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:40 smithi110 ceph-mon[28069]: pgmap v3886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:33:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:33:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6336.887503 secs 2024-04-26T13:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:42 smithi193 ceph-mon[32782]: pgmap v3887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:42 smithi193 ceph-mon[32782]: pgmap v3888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s rd, 1 op/s 2024-04-26T13:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:42 smithi193 ceph-mon[32782]: pgmap v3889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T13:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:33:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6336.887503 secs 2024-04-26T13:33:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:42 smithi196 ceph-mon[32572]: pgmap v3887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:33:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:33:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:42 smithi196 ceph-mon[32572]: pgmap v3888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s rd, 1 op/s 2024-04-26T13:33:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:42 smithi196 ceph-mon[32572]: pgmap v3889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T13:33:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:33:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6336.887503 secs 2024-04-26T13:33:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:42 smithi110 ceph-mon[28069]: pgmap v3887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:33:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:33:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:42 smithi110 ceph-mon[28069]: pgmap v3888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s rd, 1 op/s 2024-04-26T13:33:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:42 smithi110 ceph-mon[28069]: pgmap v3889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T13:33:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:33:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:44 smithi196 ceph-mon[32572]: pgmap v3890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:44 smithi110 ceph-mon[28069]: pgmap v3890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:44 smithi193 ceph-mon[32782]: pgmap v3890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:46 smithi110 ceph-mon[28069]: pgmap v3891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T13:33:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:46 smithi193 ceph-mon[32782]: pgmap v3891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T13:33:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:46 smithi196 ceph-mon[32572]: pgmap v3891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T13:33:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6341.887625 secs 2024-04-26T13:33:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6341.887625 secs 2024-04-26T13:33:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6341.887625 secs 2024-04-26T13:33:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:48 smithi110 ceph-mon[28069]: pgmap v3892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:48 smithi193 ceph-mon[32782]: pgmap v3892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:48 smithi196 ceph-mon[32572]: pgmap v3892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:50 smithi110 ceph-mon[28069]: pgmap v3893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:50 smithi193 ceph-mon[32782]: pgmap v3893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:50 smithi196 ceph-mon[32572]: pgmap v3893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6346.887693 secs 2024-04-26T13:33:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:52 smithi110 ceph-mon[28069]: pgmap v3894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:33:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6346.887693 secs 2024-04-26T13:33:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:52 smithi193 ceph-mon[32782]: pgmap v3894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:33:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6346.887693 secs 2024-04-26T13:33:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:52 smithi196 ceph-mon[32572]: pgmap v3894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:33:55.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:54 smithi196 ceph-mon[32572]: pgmap v3895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:54 smithi193 ceph-mon[32782]: pgmap v3895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:54 smithi110 ceph-mon[28069]: pgmap v3895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:56 smithi193 ceph-mon[32782]: pgmap v3896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:56 smithi196 ceph-mon[32572]: pgmap v3896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:56 smithi110 ceph-mon[28069]: pgmap v3896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:33:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6351.887799 secs 2024-04-26T13:33:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6351.887799 secs 2024-04-26T13:33:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6351.887799 secs 2024-04-26T13:33:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:33:58 smithi193 ceph-mon[32782]: pgmap v3897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:33:58 smithi196 ceph-mon[32572]: pgmap v3897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:33:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:33:58 smithi110 ceph-mon[28069]: pgmap v3897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:00 smithi193 ceph-mon[32782]: pgmap v3898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:00 smithi196 ceph-mon[32572]: pgmap v3898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:00 smithi110 ceph-mon[28069]: pgmap v3898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6356.887927 secs 2024-04-26T13:34:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:02 smithi196 ceph-mon[32572]: pgmap v3899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6356.887927 secs 2024-04-26T13:34:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:02 smithi110 ceph-mon[28069]: pgmap v3899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6356.887927 secs 2024-04-26T13:34:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:02 smithi193 ceph-mon[32782]: pgmap v3899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:34:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:34:03.323+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:34:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:34:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:34:03.323+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:34:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:34:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:34:03.323+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:34:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:34:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:34:03.323+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:34:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:34:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:34:03.323+0000 7f1b29400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:34:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:04 smithi110 ceph-mon[28069]: pgmap v3900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:04 smithi193 ceph-mon[32782]: pgmap v3900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:04 smithi196 ceph-mon[32572]: pgmap v3900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:06 smithi110 ceph-mon[28069]: pgmap v3901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:06 smithi193 ceph-mon[32782]: pgmap v3901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:06 smithi196 ceph-mon[32572]: pgmap v3901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6361.888060 secs 2024-04-26T13:34:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6361.888060 secs 2024-04-26T13:34:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6361.888060 secs 2024-04-26T13:34:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:08 smithi110 ceph-mon[28069]: pgmap v3902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:34:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:08 smithi193 ceph-mon[32782]: pgmap v3902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:34:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:08 smithi196 ceph-mon[32572]: pgmap v3902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:34:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:10 smithi110 ceph-mon[28069]: pgmap v3903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:34:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:10 smithi193 ceph-mon[32782]: pgmap v3903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:34:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:10 smithi196 ceph-mon[32572]: pgmap v3903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:34:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6366.888184 secs 2024-04-26T13:34:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:12 smithi110 ceph-mon[28069]: pgmap v3904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:34:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6366.888184 secs 2024-04-26T13:34:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:12 smithi193 ceph-mon[32782]: pgmap v3904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:34:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6366.888184 secs 2024-04-26T13:34:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:12 smithi196 ceph-mon[32572]: pgmap v3904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:34:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:14 smithi193 ceph-mon[32782]: pgmap v3905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:34:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:14 smithi196 ceph-mon[32572]: pgmap v3905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:34:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:14 smithi110 ceph-mon[28069]: pgmap v3905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:34:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:16 smithi193 ceph-mon[32782]: pgmap v3906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:34:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:16 smithi196 ceph-mon[32572]: pgmap v3906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:34:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:16 smithi110 ceph-mon[28069]: pgmap v3906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T13:34:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6371.888309 secs 2024-04-26T13:34:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6371.888309 secs 2024-04-26T13:34:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6371.888309 secs 2024-04-26T13:34:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:18 smithi193 ceph-mon[32782]: pgmap v3907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:34:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:18 smithi196 ceph-mon[32572]: pgmap v3907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:34:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:18 smithi110 ceph-mon[28069]: pgmap v3907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T13:34:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:20 smithi193 ceph-mon[32782]: pgmap v3908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:20 smithi196 ceph-mon[32572]: pgmap v3908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:20 smithi110 ceph-mon[28069]: pgmap v3908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6376.888408 secs 2024-04-26T13:34:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:22 smithi193 ceph-mon[32782]: pgmap v3909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6376.888408 secs 2024-04-26T13:34:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:22 smithi196 ceph-mon[32572]: pgmap v3909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6376.888408 secs 2024-04-26T13:34:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:22 smithi110 ceph-mon[28069]: pgmap v3909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:24 smithi193 ceph-mon[32782]: pgmap v3910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:24 smithi196 ceph-mon[32572]: pgmap v3910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:24 smithi110 ceph-mon[28069]: pgmap v3910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:26 smithi193 ceph-mon[32782]: pgmap v3911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:26 smithi196 ceph-mon[32572]: pgmap v3911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:26 smithi110 ceph-mon[28069]: pgmap v3911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6381.888553 secs 2024-04-26T13:34:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6381.888553 secs 2024-04-26T13:34:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6381.888553 secs 2024-04-26T13:34:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:28 smithi193 ceph-mon[32782]: pgmap v3912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:28 smithi196 ceph-mon[32572]: pgmap v3912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:28 smithi110 ceph-mon[28069]: pgmap v3912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:30 smithi193 ceph-mon[32782]: pgmap v3913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:30 smithi196 ceph-mon[32572]: pgmap v3913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:30 smithi110 ceph-mon[28069]: pgmap v3913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6386.888677 secs 2024-04-26T13:34:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:32 smithi193 ceph-mon[32782]: pgmap v3914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6386.888677 secs 2024-04-26T13:34:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:32 smithi196 ceph-mon[32572]: pgmap v3914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6386.888677 secs 2024-04-26T13:34:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:32 smithi110 ceph-mon[28069]: pgmap v3914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:34 smithi193 ceph-mon[32782]: pgmap v3915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:34 smithi196 ceph-mon[32572]: pgmap v3915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:34 smithi110 ceph-mon[28069]: pgmap v3915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:36 smithi193 ceph-mon[32782]: pgmap v3916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:36 smithi196 ceph-mon[32572]: pgmap v3916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:36 smithi110 ceph-mon[28069]: pgmap v3916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6391.888805 secs 2024-04-26T13:34:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6391.888805 secs 2024-04-26T13:34:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6391.888805 secs 2024-04-26T13:34:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:38 smithi196 ceph-mon[32572]: pgmap v3917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:38 smithi110 ceph-mon[28069]: pgmap v3917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:38 smithi193 ceph-mon[32782]: pgmap v3917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:40 smithi196 ceph-mon[32572]: pgmap v3918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:40 smithi110 ceph-mon[28069]: pgmap v3918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:40 smithi193 ceph-mon[32782]: pgmap v3918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6396.888928 secs 2024-04-26T13:34:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:42 smithi196 ceph-mon[32572]: pgmap v3919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:34:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6396.888928 secs 2024-04-26T13:34:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:42 smithi110 ceph-mon[28069]: pgmap v3919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:34:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6396.888928 secs 2024-04-26T13:34:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:42 smithi193 ceph-mon[32782]: pgmap v3919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:34:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:34:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:34:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:34:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:34:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:34:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:34:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:34:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:44 smithi196 ceph-mon[32572]: pgmap v3920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:34:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:44 smithi196 ceph-mon[32572]: pgmap v3921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:44 smithi110 ceph-mon[28069]: pgmap v3920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:34:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:44 smithi110 ceph-mon[28069]: pgmap v3921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:44 smithi193 ceph-mon[32782]: pgmap v3920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:34:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:44 smithi193 ceph-mon[32782]: pgmap v3921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:46 smithi196 ceph-mon[32572]: pgmap v3922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:46 smithi110 ceph-mon[28069]: pgmap v3922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:46 smithi193 ceph-mon[32782]: pgmap v3922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6401.889002 secs 2024-04-26T13:34:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6401.889002 secs 2024-04-26T13:34:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6401.889002 secs 2024-04-26T13:34:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:48 smithi196 ceph-mon[32572]: pgmap v3923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:48 smithi110 ceph-mon[28069]: pgmap v3923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:48 smithi193 ceph-mon[32782]: pgmap v3923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:50 smithi196 ceph-mon[32572]: pgmap v3924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:50 smithi110 ceph-mon[28069]: pgmap v3924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:50 smithi193 ceph-mon[32782]: pgmap v3924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6406.889124 secs 2024-04-26T13:34:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:52 smithi196 ceph-mon[32572]: pgmap v3925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6406.889124 secs 2024-04-26T13:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:52 smithi110 ceph-mon[28069]: pgmap v3925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6406.889124 secs 2024-04-26T13:34:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:52 smithi193 ceph-mon[32782]: pgmap v3925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:34:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:54 smithi196 ceph-mon[32572]: pgmap v3926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:34:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:54 smithi110 ceph-mon[28069]: pgmap v3926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:34:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:54 smithi193 ceph-mon[32782]: pgmap v3926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:34:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:56 smithi196 ceph-mon[32572]: pgmap v3927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:56 smithi110 ceph-mon[28069]: pgmap v3927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:56 smithi193 ceph-mon[32782]: pgmap v3927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:34:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6411.889242 secs 2024-04-26T13:34:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6411.889242 secs 2024-04-26T13:34:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6411.889242 secs 2024-04-26T13:34:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:58 smithi196 ceph-mon[32572]: pgmap v3928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:58 smithi110 ceph-mon[28069]: pgmap v3928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:34:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:58 smithi193 ceph-mon[32782]: pgmap v3928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:34:59 smithi196 ceph-mon[32572]: pgmap v3929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:34:59 smithi110 ceph-mon[28069]: pgmap v3929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:34:59 smithi193 ceph-mon[32782]: pgmap v3929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6416.889368 secs 2024-04-26T13:35:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:02 smithi196 ceph-mon[32572]: pgmap v3930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6416.889368 secs 2024-04-26T13:35:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:02 smithi110 ceph-mon[28069]: pgmap v3930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6416.889368 secs 2024-04-26T13:35:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:02 smithi193 ceph-mon[32782]: pgmap v3930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:04 smithi196 ceph-mon[32572]: pgmap v3931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:35:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:04 smithi110 ceph-mon[28069]: pgmap v3931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:35:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:04 smithi193 ceph-mon[32782]: pgmap v3931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:35:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:06 smithi196 ceph-mon[32572]: pgmap v3932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:35:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:06 smithi110 ceph-mon[28069]: pgmap v3932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:35:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:06 smithi193 ceph-mon[32782]: pgmap v3932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:35:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6421.889487 secs 2024-04-26T13:35:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6421.889487 secs 2024-04-26T13:35:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6421.889487 secs 2024-04-26T13:35:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:08 smithi196 ceph-mon[32572]: pgmap v3933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:35:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:08 smithi110 ceph-mon[28069]: pgmap v3933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:35:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:08 smithi193 ceph-mon[32782]: pgmap v3933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:35:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:10 smithi196 ceph-mon[32572]: pgmap v3934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:35:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:10 smithi110 ceph-mon[28069]: pgmap v3934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:35:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:10 smithi193 ceph-mon[32782]: pgmap v3934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:35:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6426.889634 secs 2024-04-26T13:35:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:12 smithi196 ceph-mon[32572]: pgmap v3935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:35:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6426.889634 secs 2024-04-26T13:35:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:12 smithi110 ceph-mon[28069]: pgmap v3935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:35:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6426.889634 secs 2024-04-26T13:35:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:12 smithi193 ceph-mon[32782]: pgmap v3935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:35:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:14 smithi196 ceph-mon[32572]: pgmap v3936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:35:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:14 smithi110 ceph-mon[28069]: pgmap v3936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:35:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:14 smithi193 ceph-mon[32782]: pgmap v3936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:35:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:16 smithi196 ceph-mon[32572]: pgmap v3937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:16 smithi110 ceph-mon[28069]: pgmap v3937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:16 smithi193 ceph-mon[32782]: pgmap v3937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6431.889750 secs 2024-04-26T13:35:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6431.889750 secs 2024-04-26T13:35:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6431.889750 secs 2024-04-26T13:35:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:18 smithi196 ceph-mon[32572]: pgmap v3938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:18 smithi110 ceph-mon[28069]: pgmap v3938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:18 smithi193 ceph-mon[32782]: pgmap v3938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:20 smithi196 ceph-mon[32572]: pgmap v3939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:20 smithi110 ceph-mon[28069]: pgmap v3939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:20 smithi193 ceph-mon[32782]: pgmap v3939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6436.889872 secs 2024-04-26T13:35:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:22 smithi196 ceph-mon[32572]: pgmap v3940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6436.889872 secs 2024-04-26T13:35:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:22 smithi110 ceph-mon[28069]: pgmap v3940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6436.889872 secs 2024-04-26T13:35:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:22 smithi193 ceph-mon[32782]: pgmap v3940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:24 smithi196 ceph-mon[32572]: pgmap v3941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:24 smithi110 ceph-mon[28069]: pgmap v3941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:24 smithi193 ceph-mon[32782]: pgmap v3941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:26 smithi110 ceph-mon[28069]: pgmap v3942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:26 smithi193 ceph-mon[32782]: pgmap v3942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:26 smithi196 ceph-mon[32572]: pgmap v3942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6441.889989 secs 2024-04-26T13:35:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6441.889989 secs 2024-04-26T13:35:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6441.889989 secs 2024-04-26T13:35:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:28 smithi110 ceph-mon[28069]: pgmap v3943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:28 smithi193 ceph-mon[32782]: pgmap v3943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:28 smithi196 ceph-mon[32572]: pgmap v3943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:30 smithi110 ceph-mon[28069]: pgmap v3944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:30 smithi193 ceph-mon[32782]: pgmap v3944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:30 smithi196 ceph-mon[32572]: pgmap v3944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:35:32.401+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:35:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:35:32.401+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:35:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:35:32.402+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 53 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:35:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:35:32.402+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 53 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:35:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6446.890133 secs 2024-04-26T13:35:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:32 smithi110 ceph-mon[28069]: pgmap v3945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6446.890133 secs 2024-04-26T13:35:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:32 smithi193 ceph-mon[32782]: pgmap v3945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6446.890133 secs 2024-04-26T13:35:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:32 smithi196 ceph-mon[32572]: pgmap v3945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:34 smithi110 ceph-mon[28069]: pgmap v3946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:34 smithi193 ceph-mon[32782]: pgmap v3946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:34 smithi196 ceph-mon[32572]: pgmap v3946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:36 smithi193 ceph-mon[32782]: pgmap v3947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:36 smithi196 ceph-mon[32572]: pgmap v3947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:36 smithi110 ceph-mon[28069]: pgmap v3947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6451.890253 secs 2024-04-26T13:35:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6451.890253 secs 2024-04-26T13:35:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6451.890253 secs 2024-04-26T13:35:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:38 smithi193 ceph-mon[32782]: pgmap v3948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:38 smithi196 ceph-mon[32572]: pgmap v3948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:38 smithi110 ceph-mon[28069]: pgmap v3948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:40 smithi193 ceph-mon[32782]: pgmap v3949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:40 smithi196 ceph-mon[32572]: pgmap v3949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:40 smithi110 ceph-mon[28069]: pgmap v3949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6456.890349 secs 2024-04-26T13:35:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:42 smithi193 ceph-mon[32782]: pgmap v3950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6456.890349 secs 2024-04-26T13:35:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:42 smithi196 ceph-mon[32572]: pgmap v3950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6456.890349 secs 2024-04-26T13:35:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:42 smithi110 ceph-mon[28069]: pgmap v3950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:44 smithi193 ceph-mon[32782]: pgmap v3951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:35:44.984 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:44 smithi110 ceph-mon[28069]: pgmap v3951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:44.984 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:35:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:44 smithi196 ceph-mon[32572]: pgmap v3951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:35:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:46 smithi193 ceph-mon[32782]: pgmap v3952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:46 smithi196 ceph-mon[32572]: pgmap v3952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:46 smithi110 ceph-mon[28069]: pgmap v3952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:35:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6461.890426 secs 2024-04-26T13:35:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:35:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:47 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:35:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6461.890426 secs 2024-04-26T13:35:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:35:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:47 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6461.890426 secs 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:35:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:35:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:47 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:35:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:48 smithi196 ceph-mon[32572]: pgmap v3953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:48 smithi110 ceph-mon[28069]: pgmap v3953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:48 smithi193 ceph-mon[32782]: pgmap v3953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:35:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:35:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:35:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:35:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:35:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:35:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:35:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:35:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:50 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:35:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:50 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:35:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:50 smithi196 ceph-mon[32572]: pgmap v3954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s rd, 1 op/s 2024-04-26T13:35:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:50 smithi196 ceph-mon[32572]: pgmap v3955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:50 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:35:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:50 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:35:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:50 smithi110 ceph-mon[28069]: pgmap v3954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s rd, 1 op/s 2024-04-26T13:35:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:50 smithi110 ceph-mon[28069]: pgmap v3955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:50 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:35:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:50 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:35:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:50 smithi193 ceph-mon[32782]: pgmap v3954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s rd, 1 op/s 2024-04-26T13:35:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:50 smithi193 ceph-mon[32782]: pgmap v3955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:52 smithi196 ceph-mon[32572]: pgmap v3956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6466.890581 secs 2024-04-26T13:35:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:52 smithi110 ceph-mon[28069]: pgmap v3956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6466.890581 secs 2024-04-26T13:35:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:52 smithi193 ceph-mon[32782]: pgmap v3956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6466.890581 secs 2024-04-26T13:35:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:54 smithi196 ceph-mon[32572]: pgmap v3957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:54 smithi110 ceph-mon[28069]: pgmap v3957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:54 smithi193 ceph-mon[32782]: pgmap v3957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:56 smithi196 ceph-mon[32572]: pgmap v3958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:56 smithi110 ceph-mon[28069]: pgmap v3958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:56 smithi193 ceph-mon[32782]: pgmap v3958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:35:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6471.890694 secs 2024-04-26T13:35:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6471.890694 secs 2024-04-26T13:35:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6471.890694 secs 2024-04-26T13:35:58.989 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:35:58 smithi196 ceph-mon[32572]: pgmap v3959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 529 B/s rd, 1 op/s 2024-04-26T13:35:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:35:58 smithi110 ceph-mon[28069]: pgmap v3959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 529 B/s rd, 1 op/s 2024-04-26T13:35:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:35:58 smithi193 ceph-mon[32782]: pgmap v3959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 529 B/s rd, 1 op/s 2024-04-26T13:36:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:00 smithi196 ceph-mon[32572]: pgmap v3960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:36:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:00 smithi110 ceph-mon[28069]: pgmap v3960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:36:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:00 smithi193 ceph-mon[32782]: pgmap v3960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:36:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:02 smithi196 ceph-mon[32572]: pgmap v3961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6476.890790 secs 2024-04-26T13:36:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:02 smithi110 ceph-mon[28069]: pgmap v3961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6476.890790 secs 2024-04-26T13:36:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:02 smithi193 ceph-mon[32782]: pgmap v3961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6476.890790 secs 2024-04-26T13:36:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:04 smithi196 ceph-mon[32572]: pgmap v3962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:04 smithi110 ceph-mon[28069]: pgmap v3962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:04 smithi193 ceph-mon[32782]: pgmap v3962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:06 smithi196 ceph-mon[32572]: pgmap v3963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:06 smithi110 ceph-mon[28069]: pgmap v3963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:06 smithi193 ceph-mon[32782]: pgmap v3963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:07 smithi196 ceph-mon[32572]: 6 slow requests, 1 included below; oldest blocked for > 6481.890890 secs 2024-04-26T13:36:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:07 smithi196 ceph-mon[32572]: slow request 723.146185 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:36:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:07 smithi110 ceph-mon[28069]: 6 slow requests, 1 included below; oldest blocked for > 6481.890890 secs 2024-04-26T13:36:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:07 smithi110 ceph-mon[28069]: slow request 723.146185 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:36:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:07 smithi193 ceph-mon[32782]: 6 slow requests, 1 included below; oldest blocked for > 6481.890890 secs 2024-04-26T13:36:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:07 smithi193 ceph-mon[32782]: slow request 723.146185 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:36:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:08 smithi110 ceph-mon[28069]: pgmap v3964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:09.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:08 smithi196 ceph-mon[32572]: pgmap v3964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:08 smithi193 ceph-mon[32782]: pgmap v3964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:10 smithi110 ceph-mon[28069]: pgmap v3965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:10 smithi193 ceph-mon[32782]: pgmap v3965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:10 smithi196 ceph-mon[32572]: pgmap v3965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:12 smithi110 ceph-mon[28069]: pgmap v3966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6486.890983 secs 2024-04-26T13:36:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:12 smithi193 ceph-mon[32782]: pgmap v3966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6486.890983 secs 2024-04-26T13:36:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:12 smithi196 ceph-mon[32572]: pgmap v3966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6486.890983 secs 2024-04-26T13:36:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:14 smithi110 ceph-mon[28069]: pgmap v3967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:14 smithi193 ceph-mon[32782]: pgmap v3967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:14 smithi196 ceph-mon[32572]: pgmap v3967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:16 smithi110 ceph-mon[28069]: pgmap v3968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:16 smithi193 ceph-mon[32782]: pgmap v3968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:16 smithi196 ceph-mon[32572]: pgmap v3968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:17.408 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:36:17.408+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:36:17.408 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:36:17.408+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:36:17.409 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:36:17.408+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 54 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:36:17.409 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:36:17.408+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 54 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:36:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6491.891100 secs 2024-04-26T13:36:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6491.891100 secs 2024-04-26T13:36:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6491.891100 secs 2024-04-26T13:36:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:18 smithi110 ceph-mon[28069]: pgmap v3969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:18 smithi193 ceph-mon[32782]: pgmap v3969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:18 smithi196 ceph-mon[32572]: pgmap v3969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:20 smithi193 ceph-mon[32782]: pgmap v3970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:20 smithi196 ceph-mon[32572]: pgmap v3970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:20 smithi110 ceph-mon[28069]: pgmap v3970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:22 smithi193 ceph-mon[32782]: pgmap v3971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6496.891215 secs 2024-04-26T13:36:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:22 smithi196 ceph-mon[32572]: pgmap v3971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6496.891215 secs 2024-04-26T13:36:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:22 smithi110 ceph-mon[28069]: pgmap v3971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6496.891215 secs 2024-04-26T13:36:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:24 smithi193 ceph-mon[32782]: pgmap v3972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:24 smithi196 ceph-mon[32572]: pgmap v3972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:24 smithi110 ceph-mon[28069]: pgmap v3972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:26 smithi193 ceph-mon[32782]: pgmap v3973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:26 smithi196 ceph-mon[32572]: pgmap v3973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:26 smithi110 ceph-mon[28069]: pgmap v3973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6501.891336 secs 2024-04-26T13:36:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6501.891336 secs 2024-04-26T13:36:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6501.891336 secs 2024-04-26T13:36:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:28 smithi193 ceph-mon[32782]: pgmap v3974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:28 smithi196 ceph-mon[32572]: pgmap v3974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:28 smithi110 ceph-mon[28069]: pgmap v3974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:30 smithi193 ceph-mon[32782]: pgmap v3975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:30 smithi196 ceph-mon[32572]: pgmap v3975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:30 smithi110 ceph-mon[28069]: pgmap v3975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:32 smithi193 ceph-mon[32782]: pgmap v3976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6506.891475 secs 2024-04-26T13:36:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:32 smithi196 ceph-mon[32572]: pgmap v3976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6506.891475 secs 2024-04-26T13:36:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:32 smithi110 ceph-mon[28069]: pgmap v3976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6506.891475 secs 2024-04-26T13:36:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:34 smithi193 ceph-mon[32782]: pgmap v3977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:34 smithi196 ceph-mon[32572]: pgmap v3977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:34 smithi110 ceph-mon[28069]: pgmap v3977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:37.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:36 smithi110 ceph-mon[28069]: pgmap v3978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:36 smithi193 ceph-mon[32782]: pgmap v3978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:36 smithi196 ceph-mon[32572]: pgmap v3978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6511.891591 secs 2024-04-26T13:36:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6511.891591 secs 2024-04-26T13:36:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6511.891591 secs 2024-04-26T13:36:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:38 smithi193 ceph-mon[32782]: pgmap v3979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:38 smithi196 ceph-mon[32572]: pgmap v3979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:38 smithi110 ceph-mon[28069]: pgmap v3979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:40 smithi193 ceph-mon[32782]: pgmap v3980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:40 smithi196 ceph-mon[32572]: pgmap v3980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:40 smithi110 ceph-mon[28069]: pgmap v3980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:42 smithi193 ceph-mon[32782]: pgmap v3981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6516.891711 secs 2024-04-26T13:36:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:42 smithi196 ceph-mon[32572]: pgmap v3981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6516.891711 secs 2024-04-26T13:36:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:42 smithi110 ceph-mon[28069]: pgmap v3981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6516.891711 secs 2024-04-26T13:36:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:44 smithi193 ceph-mon[32782]: pgmap v3982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:44 smithi196 ceph-mon[32572]: pgmap v3982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:44 smithi110 ceph-mon[28069]: pgmap v3982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:46 smithi196 ceph-mon[32572]: pgmap v3983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:46 smithi110 ceph-mon[28069]: pgmap v3983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:46 smithi193 ceph-mon[32782]: pgmap v3983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6521.891862 secs 2024-04-26T13:36:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6521.891862 secs 2024-04-26T13:36:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6521.891862 secs 2024-04-26T13:36:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:48 smithi196 ceph-mon[32572]: pgmap v3984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:48 smithi110 ceph-mon[28069]: pgmap v3984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:48 smithi193 ceph-mon[32782]: pgmap v3984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:36:50.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:36:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:36:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:36:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:50 smithi196 ceph-mon[32572]: pgmap v3985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:36:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:36:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:36:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:50 smithi110 ceph-mon[28069]: pgmap v3985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:36:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:36:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:36:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:50 smithi193 ceph-mon[32782]: pgmap v3985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:36:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:36:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:36:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:36:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:51 smithi196 ceph-mon[32572]: pgmap v3986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T13:36:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:51 smithi196 ceph-mon[32572]: pgmap v3987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:52.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:51 smithi193 ceph-mon[32782]: pgmap v3986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T13:36:52.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:51 smithi193 ceph-mon[32782]: pgmap v3987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:51 smithi110 ceph-mon[28069]: pgmap v3986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T13:36:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:51 smithi110 ceph-mon[28069]: pgmap v3987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6526.891987 secs 2024-04-26T13:36:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6526.891987 secs 2024-04-26T13:36:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6526.891987 secs 2024-04-26T13:36:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:53 smithi196 ceph-mon[32572]: pgmap v3988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:53 smithi110 ceph-mon[28069]: pgmap v3988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:53 smithi193 ceph-mon[32782]: pgmap v3988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:55 smithi196 ceph-mon[32572]: pgmap v3989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:55 smithi110 ceph-mon[28069]: pgmap v3989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:55 smithi193 ceph-mon[32782]: pgmap v3989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6531.892114 secs 2024-04-26T13:36:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:57 smithi196 ceph-mon[32572]: pgmap v3990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6531.892114 secs 2024-04-26T13:36:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:57 smithi110 ceph-mon[28069]: pgmap v3990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:36:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6531.892114 secs 2024-04-26T13:36:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:57 smithi193 ceph-mon[32782]: pgmap v3990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:36:59 smithi196 ceph-mon[32572]: pgmap v3991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:36:59 smithi110 ceph-mon[28069]: pgmap v3991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:36:59 smithi193 ceph-mon[32782]: pgmap v3991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:01 smithi196 ceph-mon[32572]: pgmap v3992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:37:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:01 smithi110 ceph-mon[28069]: pgmap v3992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:37:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:01 smithi193 ceph-mon[32782]: pgmap v3992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:37:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6536.892238 secs 2024-04-26T13:37:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6536.892238 secs 2024-04-26T13:37:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6536.892238 secs 2024-04-26T13:37:04.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:03 smithi196 ceph-mon[32572]: pgmap v3993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:03 smithi110 ceph-mon[28069]: pgmap v3993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:03 smithi193 ceph-mon[32782]: pgmap v3993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:05 smithi196 ceph-mon[32572]: pgmap v3994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:05 smithi110 ceph-mon[28069]: pgmap v3994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:05 smithi193 ceph-mon[32782]: pgmap v3994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6541.892359 secs 2024-04-26T13:37:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:07 smithi196 ceph-mon[32572]: pgmap v3995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6541.892359 secs 2024-04-26T13:37:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:07 smithi110 ceph-mon[28069]: pgmap v3995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6541.892359 secs 2024-04-26T13:37:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:07 smithi193 ceph-mon[32782]: pgmap v3995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:09 smithi196 ceph-mon[32572]: pgmap v3996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:09 smithi110 ceph-mon[28069]: pgmap v3996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:09 smithi193 ceph-mon[32782]: pgmap v3996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:11 smithi196 ceph-mon[32572]: pgmap v3997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:11 smithi110 ceph-mon[28069]: pgmap v3997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:11 smithi193 ceph-mon[32782]: pgmap v3997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6546.892487 secs 2024-04-26T13:37:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:12 smithi196 ceph-mon[32572]: pgmap v3998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6546.892487 secs 2024-04-26T13:37:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:12 smithi110 ceph-mon[28069]: pgmap v3998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6546.892487 secs 2024-04-26T13:37:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:12 smithi193 ceph-mon[32782]: pgmap v3998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:16.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:15 smithi196 ceph-mon[32572]: pgmap v3999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:15 smithi110 ceph-mon[28069]: pgmap v3999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:15 smithi193 ceph-mon[32782]: pgmap v3999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6551.892629 secs 2024-04-26T13:37:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:17 smithi196 ceph-mon[32572]: pgmap v4000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6551.892629 secs 2024-04-26T13:37:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:17 smithi110 ceph-mon[28069]: pgmap v4000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6551.892629 secs 2024-04-26T13:37:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:17 smithi193 ceph-mon[32782]: pgmap v4000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:19 smithi196 ceph-mon[32572]: pgmap v4001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:19 smithi110 ceph-mon[28069]: pgmap v4001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:19 smithi193 ceph-mon[32782]: pgmap v4001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:21 smithi196 ceph-mon[32572]: pgmap v4002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:21 smithi110 ceph-mon[28069]: pgmap v4002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:21 smithi193 ceph-mon[32782]: pgmap v4002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6556.892703 secs 2024-04-26T13:37:23.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6556.892703 secs 2024-04-26T13:37:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6556.892703 secs 2024-04-26T13:37:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:23 smithi196 ceph-mon[32572]: pgmap v4003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:23 smithi110 ceph-mon[28069]: pgmap v4003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:23 smithi193 ceph-mon[32782]: pgmap v4003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:25 smithi196 ceph-mon[32572]: pgmap v4004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:25 smithi110 ceph-mon[28069]: pgmap v4004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:25 smithi193 ceph-mon[32782]: pgmap v4004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6561.892827 secs 2024-04-26T13:37:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:27 smithi196 ceph-mon[32572]: pgmap v4005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6561.892827 secs 2024-04-26T13:37:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:27 smithi110 ceph-mon[28069]: pgmap v4005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6561.892827 secs 2024-04-26T13:37:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:27 smithi193 ceph-mon[32782]: pgmap v4005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:29 smithi196 ceph-mon[32572]: pgmap v4006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:29 smithi110 ceph-mon[28069]: pgmap v4006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:29 smithi193 ceph-mon[32782]: pgmap v4006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:31 smithi196 ceph-mon[32572]: pgmap v4007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:31 smithi110 ceph-mon[28069]: pgmap v4007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:31 smithi193 ceph-mon[32782]: pgmap v4007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6566.892951 secs 2024-04-26T13:37:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6566.892951 secs 2024-04-26T13:37:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6566.892951 secs 2024-04-26T13:37:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:33 smithi196 ceph-mon[32572]: pgmap v4008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:33 smithi110 ceph-mon[28069]: pgmap v4008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:33 smithi193 ceph-mon[32782]: pgmap v4008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:35 smithi110 ceph-mon[28069]: pgmap v4009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:35 smithi193 ceph-mon[32782]: pgmap v4009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:35 smithi196 ceph-mon[32572]: pgmap v4009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6571.893014 secs 2024-04-26T13:37:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:37 smithi110 ceph-mon[28069]: pgmap v4010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6571.893014 secs 2024-04-26T13:37:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:37 smithi193 ceph-mon[32782]: pgmap v4010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6571.893014 secs 2024-04-26T13:37:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:37 smithi196 ceph-mon[32572]: pgmap v4010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:39 smithi110 ceph-mon[28069]: pgmap v4011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:39 smithi193 ceph-mon[32782]: pgmap v4011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:39 smithi196 ceph-mon[32572]: pgmap v4011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:41 smithi110 ceph-mon[28069]: pgmap v4012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:41 smithi193 ceph-mon[32782]: pgmap v4012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:41 smithi196 ceph-mon[32572]: pgmap v4012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6576.893082 secs 2024-04-26T13:37:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6576.893082 secs 2024-04-26T13:37:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6576.893082 secs 2024-04-26T13:37:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:43 smithi110 ceph-mon[28069]: pgmap v4013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:43 smithi193 ceph-mon[32782]: pgmap v4013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:44.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:43 smithi196 ceph-mon[32572]: pgmap v4013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:45 smithi193 ceph-mon[32782]: pgmap v4014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:46.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:45 smithi196 ceph-mon[32572]: pgmap v4014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:45 smithi110 ceph-mon[28069]: pgmap v4014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6581.893232 secs 2024-04-26T13:37:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:47 smithi193 ceph-mon[32782]: pgmap v4015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6581.893232 secs 2024-04-26T13:37:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:47 smithi196 ceph-mon[32572]: pgmap v4015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6581.893232 secs 2024-04-26T13:37:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:47 smithi110 ceph-mon[28069]: pgmap v4015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:49 smithi193 ceph-mon[32782]: pgmap v4016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:49 smithi196 ceph-mon[32572]: pgmap v4016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:49 smithi110 ceph-mon[28069]: pgmap v4016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:37:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:51 smithi193 ceph-mon[32782]: pgmap v4017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:37:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:51 smithi196 ceph-mon[32572]: pgmap v4017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:37:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:51 smithi110 ceph-mon[28069]: pgmap v4017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:37:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:37:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6586.893333 secs 2024-04-26T13:37:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:37:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:37:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:37:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6586.893333 secs 2024-04-26T13:37:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:37:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:37:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:37:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6586.893333 secs 2024-04-26T13:37:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:37:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:37:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:37:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:53 smithi193 ceph-mon[32782]: pgmap v4018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:37:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:53 smithi193 ceph-mon[32782]: pgmap v4019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:37:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:53 smithi196 ceph-mon[32572]: pgmap v4018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:37:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:53 smithi196 ceph-mon[32572]: pgmap v4019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:37:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:53 smithi110 ceph-mon[28069]: pgmap v4018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:37:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:53 smithi110 ceph-mon[28069]: pgmap v4019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:37:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:55 smithi193 ceph-mon[32782]: pgmap v4020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:55 smithi196 ceph-mon[32572]: pgmap v4020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:55 smithi110 ceph-mon[28069]: pgmap v4020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:57 smithi193 ceph-mon[32782]: pgmap v4021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6591.893466 secs 2024-04-26T13:37:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:57 smithi196 ceph-mon[32572]: pgmap v4021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6591.893466 secs 2024-04-26T13:37:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:57 smithi110 ceph-mon[28069]: pgmap v4021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:37:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6591.893466 secs 2024-04-26T13:38:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:37:59 smithi193 ceph-mon[32782]: pgmap v4022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:00.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:37:59 smithi196 ceph-mon[32572]: pgmap v4022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:37:59 smithi110 ceph-mon[28069]: pgmap v4022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:01 smithi193 ceph-mon[32782]: pgmap v4023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:01 smithi196 ceph-mon[32572]: pgmap v4023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:01 smithi110 ceph-mon[28069]: pgmap v4023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6596.893629 secs 2024-04-26T13:38:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6596.893629 secs 2024-04-26T13:38:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6596.893629 secs 2024-04-26T13:38:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:03 smithi193 ceph-mon[32782]: pgmap v4024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:38:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:03 smithi196 ceph-mon[32572]: pgmap v4024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:38:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:03 smithi110 ceph-mon[28069]: pgmap v4024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:38:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:05 smithi193 ceph-mon[32782]: pgmap v4025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:05 smithi196 ceph-mon[32572]: pgmap v4025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:05 smithi110 ceph-mon[28069]: pgmap v4025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:07 smithi193 ceph-mon[32782]: pgmap v4026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:38:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6601.893747 secs 2024-04-26T13:38:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:07 smithi196 ceph-mon[32572]: pgmap v4026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:38:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6601.893747 secs 2024-04-26T13:38:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:07 smithi110 ceph-mon[28069]: pgmap v4026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:38:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6601.893747 secs 2024-04-26T13:38:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:09 smithi193 ceph-mon[32782]: pgmap v4027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:10.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:09 smithi196 ceph-mon[32572]: pgmap v4027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:09 smithi110 ceph-mon[28069]: pgmap v4027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:11 smithi196 ceph-mon[32572]: pgmap v4028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:38:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:11 smithi110 ceph-mon[28069]: pgmap v4028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:38:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:11 smithi193 ceph-mon[32782]: pgmap v4028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:38:13.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6606.893864 secs 2024-04-26T13:38:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6606.893864 secs 2024-04-26T13:38:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6606.893864 secs 2024-04-26T13:38:14.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:13 smithi196 ceph-mon[32572]: pgmap v4029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:38:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:13 smithi110 ceph-mon[28069]: pgmap v4029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:38:14.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:13 smithi193 ceph-mon[32782]: pgmap v4029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:38:16.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:15 smithi196 ceph-mon[32572]: pgmap v4030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:15 smithi110 ceph-mon[28069]: pgmap v4030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:16.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:15 smithi193 ceph-mon[32782]: pgmap v4030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:17 smithi196 ceph-mon[32572]: pgmap v4031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6611.893947 secs 2024-04-26T13:38:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:17 smithi110 ceph-mon[28069]: pgmap v4031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6611.893947 secs 2024-04-26T13:38:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:17 smithi193 ceph-mon[32782]: pgmap v4031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6611.893947 secs 2024-04-26T13:38:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:19 smithi196 ceph-mon[32572]: pgmap v4032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:19 smithi110 ceph-mon[28069]: pgmap v4032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:19 smithi193 ceph-mon[32782]: pgmap v4032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:22.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:21 smithi196 ceph-mon[32572]: pgmap v4033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:21 smithi110 ceph-mon[28069]: pgmap v4033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:21 smithi193 ceph-mon[32782]: pgmap v4033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6616.894025 secs 2024-04-26T13:38:23.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6616.894025 secs 2024-04-26T13:38:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6616.894025 secs 2024-04-26T13:38:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:23 smithi196 ceph-mon[32572]: pgmap v4034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:23 smithi110 ceph-mon[28069]: pgmap v4034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:23 smithi193 ceph-mon[32782]: pgmap v4034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:25 smithi196 ceph-mon[32572]: pgmap v4035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:25 smithi110 ceph-mon[28069]: pgmap v4035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:25 smithi193 ceph-mon[32782]: pgmap v4035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:27 smithi196 ceph-mon[32572]: pgmap v4036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6621.894091 secs 2024-04-26T13:38:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:27 smithi110 ceph-mon[28069]: pgmap v4036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6621.894091 secs 2024-04-26T13:38:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:27 smithi193 ceph-mon[32782]: pgmap v4036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6621.894091 secs 2024-04-26T13:38:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:29 smithi196 ceph-mon[32572]: pgmap v4037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:29 smithi110 ceph-mon[28069]: pgmap v4037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:30.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:29 smithi193 ceph-mon[32782]: pgmap v4037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:31 smithi196 ceph-mon[32572]: pgmap v4038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:31 smithi110 ceph-mon[28069]: pgmap v4038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:31 smithi193 ceph-mon[32782]: pgmap v4038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6626.894156 secs 2024-04-26T13:38:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6626.894156 secs 2024-04-26T13:38:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6626.894156 secs 2024-04-26T13:38:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:33 smithi196 ceph-mon[32572]: pgmap v4039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:33 smithi110 ceph-mon[28069]: pgmap v4039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:34.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:33 smithi193 ceph-mon[32782]: pgmap v4039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:35 smithi196 ceph-mon[32572]: pgmap v4040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:35 smithi110 ceph-mon[28069]: pgmap v4040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:35 smithi193 ceph-mon[32782]: pgmap v4040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6631.894254 secs 2024-04-26T13:38:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:37 smithi196 ceph-mon[32572]: pgmap v4041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6631.894254 secs 2024-04-26T13:38:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:37 smithi110 ceph-mon[28069]: pgmap v4041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6631.894254 secs 2024-04-26T13:38:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:37 smithi193 ceph-mon[32782]: pgmap v4041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:39 smithi196 ceph-mon[32572]: pgmap v4042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:39 smithi110 ceph-mon[28069]: pgmap v4042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:39 smithi193 ceph-mon[32782]: pgmap v4042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:41 smithi196 ceph-mon[32572]: pgmap v4043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:41 smithi110 ceph-mon[28069]: pgmap v4043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:41 smithi193 ceph-mon[32782]: pgmap v4043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:43.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6636.894393 secs 2024-04-26T13:38:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6636.894393 secs 2024-04-26T13:38:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6636.894393 secs 2024-04-26T13:38:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:43 smithi196 ceph-mon[32572]: pgmap v4044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:43 smithi110 ceph-mon[28069]: pgmap v4044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:43 smithi193 ceph-mon[32782]: pgmap v4044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:45 smithi196 ceph-mon[32572]: pgmap v4045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:45 smithi110 ceph-mon[28069]: pgmap v4045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:45 smithi193 ceph-mon[32782]: pgmap v4045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6641.894534 secs 2024-04-26T13:38:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:47 smithi196 ceph-mon[32572]: pgmap v4046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6641.894534 secs 2024-04-26T13:38:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:47 smithi110 ceph-mon[28069]: pgmap v4046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6641.894534 secs 2024-04-26T13:38:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:47 smithi193 ceph-mon[32782]: pgmap v4046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:50 smithi196 ceph-mon[32572]: pgmap v4047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:50 smithi110 ceph-mon[28069]: pgmap v4047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:50 smithi193 ceph-mon[32782]: pgmap v4047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:38:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:51 smithi193 ceph-mon[32782]: pgmap v4048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:51 smithi196 ceph-mon[32572]: pgmap v4048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:51 smithi110 ceph-mon[28069]: pgmap v4048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:52.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6646.894631 secs 2024-04-26T13:38:52.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6646.894631 secs 2024-04-26T13:38:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6646.894631 secs 2024-04-26T13:38:53.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:53 smithi193 ceph-mon[32782]: pgmap v4049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:53.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:38:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:53 smithi110 ceph-mon[28069]: pgmap v4049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:38:53.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:53 smithi196 ceph-mon[32572]: pgmap v4049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:38:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:38:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:38:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:38:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:54 smithi110 ceph-mon[28069]: pgmap v4050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:38:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:54 smithi110 ceph-mon[28069]: pgmap v4051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:38:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:38:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:38:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:54 smithi193 ceph-mon[32782]: pgmap v4050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:38:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:54 smithi193 ceph-mon[32782]: pgmap v4051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:38:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:38:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:38:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:54 smithi196 ceph-mon[32572]: pgmap v4050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:38:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:54 smithi196 ceph-mon[32572]: pgmap v4051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:38:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:56 smithi193 ceph-mon[32782]: pgmap v4052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:56 smithi196 ceph-mon[32572]: pgmap v4052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:56 smithi110 ceph-mon[28069]: pgmap v4052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6651.894752 secs 2024-04-26T13:38:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6651.894752 secs 2024-04-26T13:38:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6651.894752 secs 2024-04-26T13:38:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:38:58 smithi193 ceph-mon[32782]: pgmap v4053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:38:58 smithi196 ceph-mon[32572]: pgmap v4053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:38:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:38:58 smithi110 ceph-mon[28069]: pgmap v4053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:00 smithi193 ceph-mon[32782]: pgmap v4054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:00 smithi196 ceph-mon[32572]: pgmap v4054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:00 smithi110 ceph-mon[28069]: pgmap v4054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6656.894834 secs 2024-04-26T13:39:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:02 smithi193 ceph-mon[32782]: pgmap v4055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6656.894834 secs 2024-04-26T13:39:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:02 smithi196 ceph-mon[32572]: pgmap v4055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6656.894834 secs 2024-04-26T13:39:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:02 smithi110 ceph-mon[28069]: pgmap v4055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:39:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:39:03.388+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:39:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:39:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:39:03.388+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:39:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:39:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:39:03.388+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:39:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:39:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:39:03.388+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:39:03.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:39:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:39:03.388+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:39:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:04 smithi193 ceph-mon[32782]: pgmap v4056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:39:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:04 smithi196 ceph-mon[32572]: pgmap v4056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:39:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:04 smithi110 ceph-mon[28069]: pgmap v4056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:39:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:06 smithi193 ceph-mon[32782]: pgmap v4057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:06 smithi196 ceph-mon[32572]: pgmap v4057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:06 smithi110 ceph-mon[28069]: pgmap v4057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6661.894950 secs 2024-04-26T13:39:08.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6661.894950 secs 2024-04-26T13:39:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6661.894950 secs 2024-04-26T13:39:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:08 smithi193 ceph-mon[32782]: pgmap v4058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:39:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:08 smithi196 ceph-mon[32572]: pgmap v4058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:39:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:08 smithi110 ceph-mon[28069]: pgmap v4058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:39:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:10 smithi193 ceph-mon[32782]: pgmap v4059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:39:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:10 smithi196 ceph-mon[32572]: pgmap v4059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:39:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:10 smithi110 ceph-mon[28069]: pgmap v4059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:39:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6666.895071 secs 2024-04-26T13:39:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:12 smithi193 ceph-mon[32782]: pgmap v4060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:39:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6666.895071 secs 2024-04-26T13:39:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:12 smithi196 ceph-mon[32572]: pgmap v4060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:39:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6666.895071 secs 2024-04-26T13:39:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:12 smithi110 ceph-mon[28069]: pgmap v4060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:39:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:14 smithi193 ceph-mon[32782]: pgmap v4061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:39:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:14 smithi196 ceph-mon[32572]: pgmap v4061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:39:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:14 smithi110 ceph-mon[28069]: pgmap v4061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:39:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:16 smithi193 ceph-mon[32782]: pgmap v4062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:39:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:16 smithi196 ceph-mon[32572]: pgmap v4062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:39:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:16 smithi110 ceph-mon[28069]: pgmap v4062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:39:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:39:17.438+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:39:17.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:39:17.438+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:39:17.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:39:17.438+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 55 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:39:17.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:39:17.438+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 55 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:39:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6671.895188 secs 2024-04-26T13:39:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6671.895188 secs 2024-04-26T13:39:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6671.895188 secs 2024-04-26T13:39:19.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:18 smithi196 ceph-mon[32572]: pgmap v4063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:39:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:18 smithi110 ceph-mon[28069]: pgmap v4063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:39:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:18 smithi193 ceph-mon[32782]: pgmap v4063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:39:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:20 smithi196 ceph-mon[32572]: pgmap v4064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:20 smithi110 ceph-mon[28069]: pgmap v4064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:20 smithi193 ceph-mon[32782]: pgmap v4064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:23.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6676.895305 secs 2024-04-26T13:39:23.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:22 smithi193 ceph-mon[32782]: pgmap v4065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6676.895305 secs 2024-04-26T13:39:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:22 smithi196 ceph-mon[32572]: pgmap v4065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6676.895305 secs 2024-04-26T13:39:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:22 smithi110 ceph-mon[28069]: pgmap v4065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:25.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:24 smithi196 ceph-mon[32572]: pgmap v4066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:24 smithi110 ceph-mon[28069]: pgmap v4066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:24 smithi193 ceph-mon[32782]: pgmap v4066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:26 smithi196 ceph-mon[32572]: pgmap v4067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:26 smithi110 ceph-mon[28069]: pgmap v4067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:26 smithi193 ceph-mon[32782]: pgmap v4067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6681.895434 secs 2024-04-26T13:39:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6681.895434 secs 2024-04-26T13:39:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6681.895434 secs 2024-04-26T13:39:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:28 smithi196 ceph-mon[32572]: pgmap v4068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:28 smithi110 ceph-mon[28069]: pgmap v4068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:28 smithi193 ceph-mon[32782]: pgmap v4068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:30 smithi196 ceph-mon[32572]: pgmap v4069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:30 smithi110 ceph-mon[28069]: pgmap v4069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:30 smithi193 ceph-mon[32782]: pgmap v4069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6686.895550 secs 2024-04-26T13:39:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:32 smithi196 ceph-mon[32572]: pgmap v4070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6686.895550 secs 2024-04-26T13:39:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:32 smithi110 ceph-mon[28069]: pgmap v4070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6686.895550 secs 2024-04-26T13:39:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:32 smithi193 ceph-mon[32782]: pgmap v4070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:35.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:34 smithi196 ceph-mon[32572]: pgmap v4071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:34 smithi110 ceph-mon[28069]: pgmap v4071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:34 smithi193 ceph-mon[32782]: pgmap v4071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:36 smithi196 ceph-mon[32572]: pgmap v4072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:36 smithi110 ceph-mon[28069]: pgmap v4072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:36 smithi193 ceph-mon[32782]: pgmap v4072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6691.895667 secs 2024-04-26T13:39:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6691.895667 secs 2024-04-26T13:39:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6691.895667 secs 2024-04-26T13:39:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:38 smithi196 ceph-mon[32572]: pgmap v4073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:38 smithi110 ceph-mon[28069]: pgmap v4073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:38 smithi193 ceph-mon[32782]: pgmap v4073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:40 smithi196 ceph-mon[32572]: pgmap v4074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:40 smithi110 ceph-mon[28069]: pgmap v4074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:40 smithi193 ceph-mon[32782]: pgmap v4074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:43.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6696.895764 secs 2024-04-26T13:39:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:42 smithi196 ceph-mon[32572]: pgmap v4075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6696.895764 secs 2024-04-26T13:39:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:42 smithi110 ceph-mon[28069]: pgmap v4075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6696.895764 secs 2024-04-26T13:39:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:42 smithi193 ceph-mon[32782]: pgmap v4075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:44 smithi196 ceph-mon[32572]: pgmap v4076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:44 smithi110 ceph-mon[28069]: pgmap v4076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:44 smithi193 ceph-mon[32782]: pgmap v4076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:46 smithi196 ceph-mon[32572]: pgmap v4077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:46 smithi110 ceph-mon[28069]: pgmap v4077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:46 smithi193 ceph-mon[32782]: pgmap v4077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6701.895849 secs 2024-04-26T13:39:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6701.895849 secs 2024-04-26T13:39:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6701.895849 secs 2024-04-26T13:39:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:48 smithi196 ceph-mon[32572]: pgmap v4078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:48 smithi110 ceph-mon[28069]: pgmap v4078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:48 smithi193 ceph-mon[32782]: pgmap v4078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:50 smithi196 ceph-mon[32572]: pgmap v4079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:50 smithi110 ceph-mon[28069]: pgmap v4079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:50 smithi193 ceph-mon[32782]: pgmap v4079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6706.895988 secs 2024-04-26T13:39:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:52 smithi196 ceph-mon[32572]: pgmap v4080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6706.895988 secs 2024-04-26T13:39:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:52 smithi110 ceph-mon[28069]: pgmap v4080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6706.895988 secs 2024-04-26T13:39:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:52 smithi193 ceph-mon[32782]: pgmap v4080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:39:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:54 smithi196 ceph-mon[32572]: pgmap v4081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:39:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:54 smithi110 ceph-mon[28069]: pgmap v4081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:39:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:54 smithi193 ceph-mon[32782]: pgmap v4081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:39:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:39:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:39:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:39:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:39:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:39:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:39:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:39:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:39:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:39:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:39:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:57 smithi110 ceph-mon[28069]: pgmap v4082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:39:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:57 smithi110 ceph-mon[28069]: pgmap v4083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:57 smithi193 ceph-mon[32782]: pgmap v4082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:39:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:57 smithi193 ceph-mon[32782]: pgmap v4083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:57 smithi196 ceph-mon[32572]: pgmap v4082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:39:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:57 smithi196 ceph-mon[32572]: pgmap v4083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:58.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:58 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6711.896065 secs 2024-04-26T13:39:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:58 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6711.896065 secs 2024-04-26T13:39:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:58 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6711.896065 secs 2024-04-26T13:39:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:39:59 smithi110 ceph-mon[28069]: pgmap v4084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:39:59 smithi193 ceph-mon[32782]: pgmap v4084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:39:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:39:59 smithi196 ceph-mon[32572]: pgmap v4084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:00 smithi110 ceph-mon[28069]: pgmap v4085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:40:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:00 smithi193 ceph-mon[32782]: pgmap v4085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:40:00.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:00 smithi196 ceph-mon[32572]: pgmap v4085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:40:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6716.896187 secs 2024-04-26T13:40:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6716.896187 secs 2024-04-26T13:40:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6716.896187 secs 2024-04-26T13:40:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:02 smithi110 ceph-mon[28069]: pgmap v4086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:02 smithi193 ceph-mon[32782]: pgmap v4086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:02 smithi196 ceph-mon[32572]: pgmap v4086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:04 smithi193 ceph-mon[32782]: pgmap v4087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:04 smithi196 ceph-mon[32572]: pgmap v4087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:04 smithi110 ceph-mon[28069]: pgmap v4087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:40:06.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:06 smithi196 ceph-mon[32572]: pgmap v4088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:40:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6721.896305 secs 2024-04-26T13:40:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:06 smithi110 ceph-mon[28069]: pgmap v4088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:40:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6721.896305 secs 2024-04-26T13:40:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:06 smithi193 ceph-mon[32782]: pgmap v4088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:40:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6721.896305 secs 2024-04-26T13:40:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:08 smithi196 ceph-mon[32572]: pgmap v4089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:08 smithi110 ceph-mon[28069]: pgmap v4089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:08 smithi193 ceph-mon[32782]: pgmap v4089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:10 smithi196 ceph-mon[32572]: pgmap v4090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:10 smithi110 ceph-mon[28069]: pgmap v4090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:10 smithi193 ceph-mon[32782]: pgmap v4090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:11.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6726.896425 secs 2024-04-26T13:40:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6726.896425 secs 2024-04-26T13:40:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6726.896425 secs 2024-04-26T13:40:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:12 smithi196 ceph-mon[32572]: pgmap v4091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:12 smithi110 ceph-mon[28069]: pgmap v4091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:12 smithi193 ceph-mon[32782]: pgmap v4091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:14 smithi196 ceph-mon[32572]: pgmap v4092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:14 smithi110 ceph-mon[28069]: pgmap v4092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:14 smithi193 ceph-mon[32782]: pgmap v4092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:16 smithi196 ceph-mon[32572]: pgmap v4093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6731.896528 secs 2024-04-26T13:40:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:16 smithi110 ceph-mon[28069]: pgmap v4093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6731.896528 secs 2024-04-26T13:40:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:16 smithi193 ceph-mon[32782]: pgmap v4093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6731.896528 secs 2024-04-26T13:40:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:18 smithi196 ceph-mon[32572]: pgmap v4094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:18 smithi110 ceph-mon[28069]: pgmap v4094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:18 smithi193 ceph-mon[32782]: pgmap v4094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:20 smithi196 ceph-mon[32572]: pgmap v4095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:20 smithi110 ceph-mon[28069]: pgmap v4095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:20 smithi193 ceph-mon[32782]: pgmap v4095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:21.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6736.896647 secs 2024-04-26T13:40:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6736.896647 secs 2024-04-26T13:40:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6736.896647 secs 2024-04-26T13:40:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:22 smithi196 ceph-mon[32572]: pgmap v4096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:22 smithi110 ceph-mon[28069]: pgmap v4096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:22 smithi193 ceph-mon[32782]: pgmap v4096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:24.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:24 smithi196 ceph-mon[32572]: pgmap v4097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:24 smithi110 ceph-mon[28069]: pgmap v4097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:24 smithi193 ceph-mon[32782]: pgmap v4097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:26 smithi196 ceph-mon[32572]: pgmap v4098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6741.896763 secs 2024-04-26T13:40:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:26 smithi110 ceph-mon[28069]: pgmap v4098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6741.896763 secs 2024-04-26T13:40:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:26 smithi193 ceph-mon[32782]: pgmap v4098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6741.896763 secs 2024-04-26T13:40:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:28 smithi196 ceph-mon[32572]: pgmap v4099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:28 smithi110 ceph-mon[28069]: pgmap v4099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:28 smithi193 ceph-mon[32782]: pgmap v4099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:30 smithi196 ceph-mon[32572]: pgmap v4100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:30 smithi110 ceph-mon[28069]: pgmap v4100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:30 smithi193 ceph-mon[32782]: pgmap v4100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:31.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:31 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6746.896829 secs 2024-04-26T13:40:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:31 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6746.896829 secs 2024-04-26T13:40:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:31 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6746.896829 secs 2024-04-26T13:40:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:32 smithi196 ceph-mon[32572]: pgmap v4101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:32 smithi110 ceph-mon[28069]: pgmap v4101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:32 smithi193 ceph-mon[32782]: pgmap v4101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:34.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:34 smithi196 ceph-mon[32572]: pgmap v4102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:34 smithi110 ceph-mon[28069]: pgmap v4102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:34 smithi193 ceph-mon[32782]: pgmap v4102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:36 smithi196 ceph-mon[32572]: pgmap v4103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:36 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6751.896946 secs 2024-04-26T13:40:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:36 smithi110 ceph-mon[28069]: pgmap v4103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:36 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6751.896946 secs 2024-04-26T13:40:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:36 smithi193 ceph-mon[32782]: pgmap v4103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:36 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6751.896946 secs 2024-04-26T13:40:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:38 smithi196 ceph-mon[32572]: pgmap v4104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:38 smithi110 ceph-mon[28069]: pgmap v4104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:38 smithi193 ceph-mon[32782]: pgmap v4104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:40.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:40 smithi196 ceph-mon[32572]: pgmap v4105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:40 smithi110 ceph-mon[28069]: pgmap v4105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:40 smithi193 ceph-mon[32782]: pgmap v4105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:41.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:41 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6756.897065 secs 2024-04-26T13:40:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:41 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6756.897065 secs 2024-04-26T13:40:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:41 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6756.897065 secs 2024-04-26T13:40:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:42 smithi196 ceph-mon[32572]: pgmap v4106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:42 smithi110 ceph-mon[28069]: pgmap v4106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:42 smithi193 ceph-mon[32782]: pgmap v4106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:44 smithi196 ceph-mon[32572]: pgmap v4107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:44 smithi110 ceph-mon[28069]: pgmap v4107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:44 smithi193 ceph-mon[32782]: pgmap v4107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:46 smithi110 ceph-mon[28069]: pgmap v4108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6761.897187 secs 2024-04-26T13:40:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:46 smithi193 ceph-mon[32782]: pgmap v4108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6761.897187 secs 2024-04-26T13:40:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:46 smithi196 ceph-mon[32572]: pgmap v4108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6761.897187 secs 2024-04-26T13:40:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:48 smithi110 ceph-mon[28069]: pgmap v4109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:48 smithi193 ceph-mon[32782]: pgmap v4109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:48 smithi196 ceph-mon[32572]: pgmap v4109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:50 smithi110 ceph-mon[28069]: pgmap v4110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:50 smithi193 ceph-mon[32782]: pgmap v4110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:50 smithi196 ceph-mon[32572]: pgmap v4110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6766.897325 secs 2024-04-26T13:40:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6766.897325 secs 2024-04-26T13:40:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6766.897325 secs 2024-04-26T13:40:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:52 smithi110 ceph-mon[28069]: pgmap v4111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:52 smithi193 ceph-mon[32782]: pgmap v4111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:52 smithi196 ceph-mon[32572]: pgmap v4111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:54 smithi110 ceph-mon[28069]: pgmap v4112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:54 smithi193 ceph-mon[32782]: pgmap v4112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:55.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:54 smithi196 ceph-mon[32572]: pgmap v4112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:40:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:56 smithi110 ceph-mon[28069]: pgmap v4113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:40:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6771.897456 secs 2024-04-26T13:40:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:56 smithi193 ceph-mon[32782]: pgmap v4113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:40:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6771.897456 secs 2024-04-26T13:40:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:56 smithi196 ceph-mon[32572]: pgmap v4113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:40:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:40:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6771.897456 secs 2024-04-26T13:40:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:40:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:40:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:57 smithi193 ceph-mon[32782]: pgmap v4114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T13:40:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:57 smithi193 ceph-mon[32782]: pgmap v4115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T13:40:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:40:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:57 smithi196 ceph-mon[32572]: pgmap v4114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T13:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:57 smithi196 ceph-mon[32572]: pgmap v4115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T13:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:40:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:40:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:40:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:40:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:57 smithi110 ceph-mon[28069]: pgmap v4114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T13:40:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:57 smithi110 ceph-mon[28069]: pgmap v4115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T13:40:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:40:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:41:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:00 smithi196 ceph-mon[32572]: pgmap v4116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:00 smithi110 ceph-mon[28069]: pgmap v4116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:00 smithi193 ceph-mon[32782]: pgmap v4116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:02 smithi110 ceph-mon[28069]: pgmap v4117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6776.897604 secs 2024-04-26T13:41:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:02 smithi193 ceph-mon[32782]: pgmap v4117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6776.897604 secs 2024-04-26T13:41:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:02 smithi196 ceph-mon[32572]: pgmap v4117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6776.897604 secs 2024-04-26T13:41:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:04 smithi110 ceph-mon[28069]: pgmap v4118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:04 smithi193 ceph-mon[32782]: pgmap v4118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:04 smithi196 ceph-mon[32572]: pgmap v4118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:06 smithi110 ceph-mon[28069]: pgmap v4119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:06 smithi193 ceph-mon[32782]: pgmap v4119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:06 smithi196 ceph-mon[32572]: pgmap v4119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:41:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6781.897735 secs 2024-04-26T13:41:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6781.897735 secs 2024-04-26T13:41:07.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6781.897735 secs 2024-04-26T13:41:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:08 smithi110 ceph-mon[28069]: pgmap v4120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:41:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:08 smithi193 ceph-mon[32782]: pgmap v4120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:41:08.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:08 smithi196 ceph-mon[32572]: pgmap v4120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:41:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:09 smithi193 ceph-mon[32782]: pgmap v4121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:09.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:09 smithi196 ceph-mon[32572]: pgmap v4121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:09 smithi110 ceph-mon[28069]: pgmap v4121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:11 smithi196 ceph-mon[32572]: pgmap v4122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6786.897852 secs 2024-04-26T13:41:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:11 smithi110 ceph-mon[28069]: pgmap v4122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6786.897852 secs 2024-04-26T13:41:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:11 smithi193 ceph-mon[32782]: pgmap v4122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6786.897852 secs 2024-04-26T13:41:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:14 smithi196 ceph-mon[32572]: pgmap v4123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:14 smithi110 ceph-mon[28069]: pgmap v4123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:14.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:14 smithi193 ceph-mon[32782]: pgmap v4123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:16 smithi110 ceph-mon[28069]: pgmap v4124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:16.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:16 smithi193 ceph-mon[32782]: pgmap v4124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:16 smithi196 ceph-mon[32572]: pgmap v4124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6791.897954 secs 2024-04-26T13:41:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6791.897954 secs 2024-04-26T13:41:17.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6791.897954 secs 2024-04-26T13:41:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:18 smithi110 ceph-mon[28069]: pgmap v4125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:18 smithi193 ceph-mon[32782]: pgmap v4125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:18.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:18 smithi196 ceph-mon[32572]: pgmap v4125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:20 smithi110 ceph-mon[28069]: pgmap v4126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:20 smithi193 ceph-mon[32782]: pgmap v4126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:20 smithi196 ceph-mon[32572]: pgmap v4126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:22 smithi110 ceph-mon[28069]: pgmap v4127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6796.898085 secs 2024-04-26T13:41:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:22 smithi193 ceph-mon[32782]: pgmap v4127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6796.898085 secs 2024-04-26T13:41:22.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:22 smithi196 ceph-mon[32572]: pgmap v4127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6796.898085 secs 2024-04-26T13:41:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:24 smithi110 ceph-mon[28069]: pgmap v4128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:24 smithi193 ceph-mon[32782]: pgmap v4128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:24.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:24 smithi196 ceph-mon[32572]: pgmap v4128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:25 smithi193 ceph-mon[32782]: pgmap v4129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:25.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:25 smithi196 ceph-mon[32572]: pgmap v4129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:25 smithi110 ceph-mon[28069]: pgmap v4129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6801.898204 secs 2024-04-26T13:41:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6801.898204 secs 2024-04-26T13:41:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6801.898204 secs 2024-04-26T13:41:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:27 smithi110 ceph-mon[28069]: pgmap v4130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:27 smithi193 ceph-mon[32782]: pgmap v4130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:27 smithi196 ceph-mon[32572]: pgmap v4130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:30 smithi110 ceph-mon[28069]: pgmap v4131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:30.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:30 smithi193 ceph-mon[32782]: pgmap v4131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:30.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:30 smithi196 ceph-mon[32572]: pgmap v4131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:32 smithi110 ceph-mon[28069]: pgmap v4132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6806.898325 secs 2024-04-26T13:41:32.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:32 smithi196 ceph-mon[32572]: pgmap v4132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:32.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6806.898325 secs 2024-04-26T13:41:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:32 smithi193 ceph-mon[32782]: pgmap v4132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6806.898325 secs 2024-04-26T13:41:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:34 smithi110 ceph-mon[28069]: pgmap v4133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:34.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:34 smithi193 ceph-mon[32782]: pgmap v4133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:34 smithi196 ceph-mon[32572]: pgmap v4133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:36 smithi110 ceph-mon[28069]: pgmap v4134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:36 smithi193 ceph-mon[32782]: pgmap v4134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:36 smithi196 ceph-mon[32572]: pgmap v4134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6811.898451 secs 2024-04-26T13:41:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6811.898451 secs 2024-04-26T13:41:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6811.898451 secs 2024-04-26T13:41:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:38 smithi110 ceph-mon[28069]: pgmap v4135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:38 smithi193 ceph-mon[32782]: pgmap v4135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:38.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:38 smithi196 ceph-mon[32572]: pgmap v4135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:39 smithi193 ceph-mon[32782]: pgmap v4136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:39 smithi196 ceph-mon[32572]: pgmap v4136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:39 smithi110 ceph-mon[28069]: pgmap v4136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:42 smithi110 ceph-mon[28069]: pgmap v4137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6816.898584 secs 2024-04-26T13:41:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:42 smithi193 ceph-mon[32782]: pgmap v4137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6816.898584 secs 2024-04-26T13:41:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:42 smithi196 ceph-mon[32572]: pgmap v4137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6816.898584 secs 2024-04-26T13:41:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:44 smithi110 ceph-mon[28069]: pgmap v4138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:44 smithi193 ceph-mon[32782]: pgmap v4138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:44 smithi196 ceph-mon[32572]: pgmap v4138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:46 smithi110 ceph-mon[28069]: pgmap v4139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:46 smithi193 ceph-mon[32782]: pgmap v4139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:46 smithi196 ceph-mon[32572]: pgmap v4139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6821.898712 secs 2024-04-26T13:41:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6821.898712 secs 2024-04-26T13:41:47.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6821.898712 secs 2024-04-26T13:41:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:48 smithi110 ceph-mon[28069]: pgmap v4140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:48 smithi193 ceph-mon[32782]: pgmap v4140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:48.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:48 smithi196 ceph-mon[32572]: pgmap v4140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:50 smithi110 ceph-mon[28069]: pgmap v4141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:50 smithi193 ceph-mon[32782]: pgmap v4141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:50.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:50 smithi196 ceph-mon[32572]: pgmap v4141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:51 smithi193 ceph-mon[32782]: pgmap v4142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:51.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:51 smithi196 ceph-mon[32572]: pgmap v4142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:51 smithi110 ceph-mon[28069]: pgmap v4142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6826.898837 secs 2024-04-26T13:41:52.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6826.898837 secs 2024-04-26T13:41:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6826.898837 secs 2024-04-26T13:41:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:53 smithi193 ceph-mon[32782]: pgmap v4143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:53.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:53 smithi196 ceph-mon[32572]: pgmap v4143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:53 smithi110 ceph-mon[28069]: pgmap v4143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:41:56.075 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:56 smithi193 ceph-mon[32782]: pgmap v4144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:56 smithi110 ceph-mon[28069]: pgmap v4144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:56 smithi196 ceph-mon[32572]: pgmap v4144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6831.898963 secs 2024-04-26T13:41:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6831.898963 secs 2024-04-26T13:41:57.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6831.898963 secs 2024-04-26T13:41:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:58 smithi110 ceph-mon[28069]: pgmap v4145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:41:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:58 smithi193 ceph-mon[32782]: pgmap v4145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:41:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:58 smithi196 ceph-mon[32572]: pgmap v4145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:41:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:41:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:41:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:41:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:41:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:41:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:41:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:41:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:41:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:41:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:42:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:00 smithi193 ceph-mon[32782]: pgmap v4146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:42:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:00 smithi193 ceph-mon[32782]: pgmap v4147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:00.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:00 smithi196 ceph-mon[32572]: pgmap v4146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:42:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:00 smithi196 ceph-mon[32572]: pgmap v4147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:00 smithi110 ceph-mon[28069]: pgmap v4146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:42:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:00 smithi110 ceph-mon[28069]: pgmap v4147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:01 smithi193 ceph-mon[32782]: pgmap v4148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:01 smithi196 ceph-mon[32572]: pgmap v4148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:01 smithi110 ceph-mon[28069]: pgmap v4148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6836.899087 secs 2024-04-26T13:42:02.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6836.899087 secs 2024-04-26T13:42:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6836.899087 secs 2024-04-26T13:42:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:03 smithi193 ceph-mon[32782]: pgmap v4149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:03 smithi196 ceph-mon[32572]: pgmap v4149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:03 smithi110 ceph-mon[28069]: pgmap v4149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:05 smithi193 ceph-mon[32782]: pgmap v4150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:06.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:05 smithi196 ceph-mon[32572]: pgmap v4150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:05 smithi110 ceph-mon[28069]: pgmap v4150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6841.899203 secs 2024-04-26T13:42:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6841.899203 secs 2024-04-26T13:42:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6841.899203 secs 2024-04-26T13:42:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:07 smithi193 ceph-mon[32782]: pgmap v4151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:08.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:07 smithi196 ceph-mon[32572]: pgmap v4151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:07 smithi110 ceph-mon[28069]: pgmap v4151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:42:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:09 smithi193 ceph-mon[32782]: pgmap v4152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:42:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:09 smithi196 ceph-mon[32572]: pgmap v4152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:42:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:09 smithi110 ceph-mon[28069]: pgmap v4152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:42:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:11 smithi193 ceph-mon[32782]: pgmap v4153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6846.899344 secs 2024-04-26T13:42:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:11 smithi196 ceph-mon[32572]: pgmap v4153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6846.899344 secs 2024-04-26T13:42:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:11 smithi110 ceph-mon[28069]: pgmap v4153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6846.899344 secs 2024-04-26T13:42:13.842 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:13 smithi110 ceph-mon[28069]: pgmap v4154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:13 smithi193 ceph-mon[32782]: pgmap v4154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:13 smithi196 ceph-mon[32572]: pgmap v4154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:15 smithi193 ceph-mon[32782]: pgmap v4155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:15 smithi196 ceph-mon[32572]: pgmap v4155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:15 smithi110 ceph-mon[28069]: pgmap v4155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6851.899478 secs 2024-04-26T13:42:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6851.899478 secs 2024-04-26T13:42:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6851.899478 secs 2024-04-26T13:42:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:42:17.468+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:42:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:42:17.468+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:42:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:42:17.469+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 56 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:42:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:42:17.469+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 56 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:42:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:17 smithi193 ceph-mon[32782]: pgmap v4156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:17 smithi196 ceph-mon[32572]: pgmap v4156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:17 smithi110 ceph-mon[28069]: pgmap v4156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:19 smithi193 ceph-mon[32782]: pgmap v4157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:20.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:19 smithi196 ceph-mon[32572]: pgmap v4157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:19 smithi110 ceph-mon[28069]: pgmap v4157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:21 smithi193 ceph-mon[32782]: pgmap v4158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6856.899635 secs 2024-04-26T13:42:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:21 smithi196 ceph-mon[32572]: pgmap v4158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6856.899635 secs 2024-04-26T13:42:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:21 smithi110 ceph-mon[28069]: pgmap v4158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6856.899635 secs 2024-04-26T13:42:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:23 smithi193 ceph-mon[32782]: pgmap v4159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:24.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:23 smithi196 ceph-mon[32572]: pgmap v4159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:23 smithi110 ceph-mon[28069]: pgmap v4159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:25 smithi196 ceph-mon[32572]: pgmap v4160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:25 smithi110 ceph-mon[28069]: pgmap v4160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:25 smithi193 ceph-mon[32782]: pgmap v4160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6861.899765 secs 2024-04-26T13:42:27.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6861.899765 secs 2024-04-26T13:42:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6861.899765 secs 2024-04-26T13:42:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:27 smithi196 ceph-mon[32572]: pgmap v4161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:27 smithi110 ceph-mon[28069]: pgmap v4161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:27 smithi193 ceph-mon[32782]: pgmap v4161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:30.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:29 smithi196 ceph-mon[32572]: pgmap v4162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:29 smithi110 ceph-mon[28069]: pgmap v4162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:29 smithi193 ceph-mon[32782]: pgmap v4162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:31 smithi196 ceph-mon[32572]: pgmap v4163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:31 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6866.899852 secs 2024-04-26T13:42:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:31 smithi110 ceph-mon[28069]: pgmap v4163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:31 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6866.899852 secs 2024-04-26T13:42:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:31 smithi193 ceph-mon[32782]: pgmap v4163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:31 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6866.899852 secs 2024-04-26T13:42:34.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:33 smithi196 ceph-mon[32572]: pgmap v4164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:33 smithi110 ceph-mon[28069]: pgmap v4164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:33 smithi193 ceph-mon[32782]: pgmap v4164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:35 smithi196 ceph-mon[32572]: pgmap v4165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:35 smithi110 ceph-mon[28069]: pgmap v4165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:35 smithi193 ceph-mon[32782]: pgmap v4165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:36 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6871.899984 secs 2024-04-26T13:42:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:36 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6871.899984 secs 2024-04-26T13:42:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:36 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6871.899984 secs 2024-04-26T13:42:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:37 smithi196 ceph-mon[32572]: pgmap v4166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:37 smithi110 ceph-mon[28069]: pgmap v4166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:37 smithi193 ceph-mon[32782]: pgmap v4166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:40.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:39 smithi196 ceph-mon[32572]: pgmap v4167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:39 smithi110 ceph-mon[28069]: pgmap v4167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:39 smithi193 ceph-mon[32782]: pgmap v4167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:41 smithi196 ceph-mon[32572]: pgmap v4168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:41 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6876.900137 secs 2024-04-26T13:42:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:41 smithi110 ceph-mon[28069]: pgmap v4168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:41 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6876.900137 secs 2024-04-26T13:42:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:41 smithi193 ceph-mon[32782]: pgmap v4168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:41 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6876.900137 secs 2024-04-26T13:42:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:43 smithi196 ceph-mon[32572]: pgmap v4169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:43 smithi110 ceph-mon[28069]: pgmap v4169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:43 smithi193 ceph-mon[32782]: pgmap v4169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:45 smithi196 ceph-mon[32572]: pgmap v4170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:45 smithi110 ceph-mon[28069]: pgmap v4170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:45 smithi193 ceph-mon[32782]: pgmap v4170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6881.900282 secs 2024-04-26T13:42:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6881.900282 secs 2024-04-26T13:42:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6881.900282 secs 2024-04-26T13:42:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:47 smithi196 ceph-mon[32572]: pgmap v4171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:47 smithi110 ceph-mon[28069]: pgmap v4171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:47 smithi193 ceph-mon[32782]: pgmap v4171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:49 smithi196 ceph-mon[32572]: pgmap v4172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:49 smithi110 ceph-mon[28069]: pgmap v4172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:49 smithi193 ceph-mon[32782]: pgmap v4172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:51 smithi196 ceph-mon[32572]: pgmap v4173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6886.900432 secs 2024-04-26T13:42:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:51 smithi110 ceph-mon[28069]: pgmap v4173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6886.900432 secs 2024-04-26T13:42:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:51 smithi193 ceph-mon[32782]: pgmap v4173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6886.900432 secs 2024-04-26T13:42:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:53 smithi196 ceph-mon[32572]: pgmap v4174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:53 smithi110 ceph-mon[28069]: pgmap v4174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:53 smithi193 ceph-mon[32782]: pgmap v4174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:42:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:55 smithi196 ceph-mon[32572]: pgmap v4175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:55 smithi110 ceph-mon[28069]: pgmap v4175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:55 smithi193 ceph-mon[32782]: pgmap v4175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6891.900583 secs 2024-04-26T13:42:57.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6891.900583 secs 2024-04-26T13:42:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6891.900583 secs 2024-04-26T13:42:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:57 smithi196 ceph-mon[32572]: pgmap v4176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:57 smithi110 ceph-mon[28069]: pgmap v4176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:42:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:57 smithi193 ceph-mon[32782]: pgmap v4176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:59 smithi196 ceph-mon[32572]: pgmap v4177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:42:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:43:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:59 smithi110 ceph-mon[28069]: pgmap v4177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:42:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:43:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:59 smithi193 ceph-mon[32782]: pgmap v4177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:42:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:43:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:43:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:43:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:00 smithi196 ceph-mon[32572]: pgmap v4178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T13:43:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:00 smithi196 ceph-mon[32572]: pgmap v4179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:43:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:43:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:43:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:00 smithi110 ceph-mon[28069]: pgmap v4178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T13:43:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:00 smithi110 ceph-mon[28069]: pgmap v4179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:43:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:43:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:43:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:00 smithi193 ceph-mon[32782]: pgmap v4178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T13:43:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:00 smithi193 ceph-mon[32782]: pgmap v4179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:43:02.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6896.900684 secs 2024-04-26T13:43:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6896.900684 secs 2024-04-26T13:43:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6896.900684 secs 2024-04-26T13:43:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:02 smithi110 ceph-mon[28069]: pgmap v4180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T13:43:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:02 smithi193 ceph-mon[32782]: pgmap v4180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T13:43:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:02 smithi196 ceph-mon[32572]: pgmap v4180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T13:43:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:04 smithi193 ceph-mon[32782]: pgmap v4181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:04 smithi196 ceph-mon[32572]: pgmap v4181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:04 smithi110 ceph-mon[28069]: pgmap v4181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:06 smithi193 ceph-mon[32782]: pgmap v4182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:06 smithi196 ceph-mon[32572]: pgmap v4182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:06 smithi110 ceph-mon[28069]: pgmap v4182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6901.900749 secs 2024-04-26T13:43:07.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6901.900749 secs 2024-04-26T13:43:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6901.900749 secs 2024-04-26T13:43:08.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:08 smithi196 ceph-mon[32572]: pgmap v4183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:08 smithi110 ceph-mon[28069]: pgmap v4183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:08 smithi193 ceph-mon[32782]: pgmap v4183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:43:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:10 smithi193 ceph-mon[32782]: pgmap v4184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:43:10.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:10 smithi196 ceph-mon[32572]: pgmap v4184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:43:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:10 smithi110 ceph-mon[28069]: pgmap v4184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:43:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6906.900875 secs 2024-04-26T13:43:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6906.900875 secs 2024-04-26T13:43:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6906.900875 secs 2024-04-26T13:43:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:12 smithi110 ceph-mon[28069]: pgmap v4185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:12 smithi193 ceph-mon[32782]: pgmap v4185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:12 smithi196 ceph-mon[32572]: pgmap v4185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:14.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:14 smithi193 ceph-mon[32782]: pgmap v4186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:14.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:14 smithi196 ceph-mon[32572]: pgmap v4186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:14 smithi110 ceph-mon[28069]: pgmap v4186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:16.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:16 smithi193 ceph-mon[32782]: pgmap v4187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:16.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:16 smithi196 ceph-mon[32572]: pgmap v4187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:16 smithi110 ceph-mon[28069]: pgmap v4187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6911.900959 secs 2024-04-26T13:43:17.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6911.900959 secs 2024-04-26T13:43:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6911.900959 secs 2024-04-26T13:43:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:18 smithi196 ceph-mon[32572]: pgmap v4188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:18 smithi110 ceph-mon[28069]: pgmap v4188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:18 smithi193 ceph-mon[32782]: pgmap v4188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:20 smithi193 ceph-mon[32782]: pgmap v4189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:20 smithi196 ceph-mon[32572]: pgmap v4189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:20 smithi110 ceph-mon[28069]: pgmap v4189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6916.901112 secs 2024-04-26T13:43:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6916.901112 secs 2024-04-26T13:43:21.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6916.901112 secs 2024-04-26T13:43:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:22 smithi110 ceph-mon[28069]: pgmap v4190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:22 smithi193 ceph-mon[32782]: pgmap v4190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:22 smithi196 ceph-mon[32572]: pgmap v4190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:24 smithi193 ceph-mon[32782]: pgmap v4191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:24.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:24 smithi196 ceph-mon[32572]: pgmap v4191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:24 smithi110 ceph-mon[28069]: pgmap v4191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:26 smithi193 ceph-mon[32782]: pgmap v4192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:26.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:26 smithi196 ceph-mon[32572]: pgmap v4192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:26 smithi110 ceph-mon[28069]: pgmap v4192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:27.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6921.901193 secs 2024-04-26T13:43:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6921.901193 secs 2024-04-26T13:43:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6921.901193 secs 2024-04-26T13:43:28.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:28 smithi196 ceph-mon[32572]: pgmap v4193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:28 smithi110 ceph-mon[28069]: pgmap v4193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:28 smithi193 ceph-mon[32782]: pgmap v4193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:30.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:30 smithi193 ceph-mon[32782]: pgmap v4194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:30 smithi196 ceph-mon[32572]: pgmap v4194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:30 smithi110 ceph-mon[28069]: pgmap v4194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:31 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6926.901316 secs 2024-04-26T13:43:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:31 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6926.901316 secs 2024-04-26T13:43:31.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:31 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6926.901316 secs 2024-04-26T13:43:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:32 smithi110 ceph-mon[28069]: pgmap v4195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:32 smithi193 ceph-mon[32782]: pgmap v4195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:32 smithi196 ceph-mon[32572]: pgmap v4195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:35 smithi193 ceph-mon[32782]: pgmap v4196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:35.457 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:35 smithi196 ceph-mon[32572]: pgmap v4196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:35 smithi110 ceph-mon[28069]: pgmap v4196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:37 smithi193 ceph-mon[32782]: pgmap v4197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6931.901440 secs 2024-04-26T13:43:37.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:37 smithi196 ceph-mon[32572]: pgmap v4197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6931.901440 secs 2024-04-26T13:43:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:37 smithi110 ceph-mon[28069]: pgmap v4197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6931.901440 secs 2024-04-26T13:43:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:39 smithi196 ceph-mon[32572]: pgmap v4198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:39 smithi110 ceph-mon[28069]: pgmap v4198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:39.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:39 smithi193 ceph-mon[32782]: pgmap v4198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:41 smithi196 ceph-mon[32572]: pgmap v4199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:41 smithi110 ceph-mon[28069]: pgmap v4199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:41 smithi193 ceph-mon[32782]: pgmap v4199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6936.901599 secs 2024-04-26T13:43:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6936.901599 secs 2024-04-26T13:43:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6936.901599 secs 2024-04-26T13:43:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:43 smithi196 ceph-mon[32572]: pgmap v4200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:43 smithi110 ceph-mon[28069]: pgmap v4200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:43 smithi193 ceph-mon[32782]: pgmap v4200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:45.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:45 smithi196 ceph-mon[32572]: pgmap v4201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:45 smithi110 ceph-mon[28069]: pgmap v4201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:45 smithi193 ceph-mon[32782]: pgmap v4201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:43:47.483+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:43:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:43:47.483+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:43:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:43:47.484+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 57 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:43:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:43:47.484+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 57 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:43:47.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:47 smithi196 ceph-mon[32572]: pgmap v4202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:47.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6941.901743 secs 2024-04-26T13:43:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:47 smithi110 ceph-mon[28069]: pgmap v4202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6941.901743 secs 2024-04-26T13:43:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:47 smithi193 ceph-mon[32782]: pgmap v4202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6941.901743 secs 2024-04-26T13:43:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:49 smithi196 ceph-mon[32572]: pgmap v4203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:49 smithi110 ceph-mon[28069]: pgmap v4203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:49.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:49 smithi193 ceph-mon[32782]: pgmap v4203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:51 smithi196 ceph-mon[32572]: pgmap v4204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:51 smithi110 ceph-mon[28069]: pgmap v4204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:51.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:51 smithi193 ceph-mon[32782]: pgmap v4204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:52.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6946.901866 secs 2024-04-26T13:43:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6946.901866 secs 2024-04-26T13:43:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6946.901866 secs 2024-04-26T13:43:53.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:53 smithi196 ceph-mon[32572]: pgmap v4205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:53 smithi110 ceph-mon[28069]: pgmap v4205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:53 smithi193 ceph-mon[32782]: pgmap v4205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:55 smithi196 ceph-mon[32572]: pgmap v4206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:55 smithi110 ceph-mon[28069]: pgmap v4206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:55.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:55 smithi193 ceph-mon[32782]: pgmap v4206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:57 smithi196 ceph-mon[32572]: pgmap v4207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6951.902000 secs 2024-04-26T13:43:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:57 smithi110 ceph-mon[28069]: pgmap v4207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6951.902000 secs 2024-04-26T13:43:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:57 smithi193 ceph-mon[32782]: pgmap v4207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:43:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6951.902000 secs 2024-04-26T13:43:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:43:59 smithi196 ceph-mon[32572]: pgmap v4208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:43:59 smithi110 ceph-mon[28069]: pgmap v4208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:43:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:43:59 smithi193 ceph-mon[32782]: pgmap v4208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:01.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:01 smithi196 ceph-mon[32572]: pgmap v4209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:44:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:01 smithi110 ceph-mon[28069]: pgmap v4209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:44:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:01 smithi193 ceph-mon[32782]: pgmap v4209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:44:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6956.902091 secs 2024-04-26T13:44:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:44:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:44:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6956.902091 secs 2024-04-26T13:44:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:44:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:44:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6956.902091 secs 2024-04-26T13:44:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:44:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:44:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:03 smithi196 ceph-mon[32572]: pgmap v4210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:44:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:44:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:03 smithi196 ceph-mon[32572]: pgmap v4211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T13:44:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:03 smithi196 ceph-mon[32572]: pgmap v4212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:44:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-mon[28069]: pgmap v4210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:44:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:44:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-mon[28069]: pgmap v4211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T13:44:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-mon[28069]: pgmap v4212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:44:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:03 smithi193 ceph-mon[32782]: pgmap v4210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:44:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:44:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:03 smithi193 ceph-mon[32782]: pgmap v4211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T13:44:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:03 smithi193 ceph-mon[32782]: pgmap v4212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:44:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:44:03.603+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:44:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:44:03.603+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:44:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:44:03.603+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:44:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:44:03.603+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:44:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:44:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:44:03.603+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:44:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:05 smithi110 ceph-mon[28069]: pgmap v4213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:05 smithi193 ceph-mon[32782]: pgmap v4213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:06.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:05 smithi196 ceph-mon[32572]: pgmap v4213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6961.902234 secs 2024-04-26T13:44:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6961.902234 secs 2024-04-26T13:44:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6961.902234 secs 2024-04-26T13:44:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:07 smithi110 ceph-mon[28069]: pgmap v4214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T13:44:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:07 smithi193 ceph-mon[32782]: pgmap v4214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T13:44:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:07 smithi196 ceph-mon[32572]: pgmap v4214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T13:44:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:09 smithi110 ceph-mon[28069]: pgmap v4215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 B/s wr, 18 op/s 2024-04-26T13:44:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:09 smithi193 ceph-mon[32782]: pgmap v4215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 B/s wr, 18 op/s 2024-04-26T13:44:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:09 smithi196 ceph-mon[32572]: pgmap v4215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 B/s wr, 18 op/s 2024-04-26T13:44:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:11 smithi193 ceph-mon[32782]: pgmap v4216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 B/s wr, 18 op/s 2024-04-26T13:44:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6966.902314 secs 2024-04-26T13:44:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:11 smithi196 ceph-mon[32572]: pgmap v4216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 B/s wr, 18 op/s 2024-04-26T13:44:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6966.902314 secs 2024-04-26T13:44:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:11 smithi110 ceph-mon[28069]: pgmap v4216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 B/s wr, 18 op/s 2024-04-26T13:44:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6966.902314 secs 2024-04-26T13:44:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:13 smithi193 ceph-mon[32782]: pgmap v4217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T13:44:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:13 smithi196 ceph-mon[32572]: pgmap v4217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T13:44:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:13 smithi110 ceph-mon[28069]: pgmap v4217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T13:44:15.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:15 smithi110 ceph-mon[28069]: pgmap v4218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:44:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:15 smithi193 ceph-mon[32782]: pgmap v4218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:44:16.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:15 smithi196 ceph-mon[32572]: pgmap v4218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:44:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6971.902413 secs 2024-04-26T13:44:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6971.902413 secs 2024-04-26T13:44:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6971.902413 secs 2024-04-26T13:44:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:17 smithi193 ceph-mon[32782]: pgmap v4219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:44:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:17 smithi196 ceph-mon[32572]: pgmap v4219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:44:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:17 smithi110 ceph-mon[28069]: pgmap v4219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:44:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:19 smithi193 ceph-mon[32782]: pgmap v4220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:44:20.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:19 smithi196 ceph-mon[32572]: pgmap v4220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:44:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:19 smithi110 ceph-mon[28069]: pgmap v4220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T13:44:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:21 smithi193 ceph-mon[32782]: pgmap v4221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6976.902533 secs 2024-04-26T13:44:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:21 smithi196 ceph-mon[32572]: pgmap v4221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6976.902533 secs 2024-04-26T13:44:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:21 smithi110 ceph-mon[28069]: pgmap v4221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6976.902533 secs 2024-04-26T13:44:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:23 smithi193 ceph-mon[32782]: pgmap v4222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:23 smithi196 ceph-mon[32572]: pgmap v4222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:23 smithi110 ceph-mon[28069]: pgmap v4222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:25 smithi193 ceph-mon[32782]: pgmap v4223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:25 smithi196 ceph-mon[32572]: pgmap v4223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:25 smithi110 ceph-mon[28069]: pgmap v4223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6981.902642 secs 2024-04-26T13:44:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6981.902642 secs 2024-04-26T13:44:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6981.902642 secs 2024-04-26T13:44:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:27 smithi193 ceph-mon[32782]: pgmap v4224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:27 smithi196 ceph-mon[32572]: pgmap v4224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:27 smithi110 ceph-mon[28069]: pgmap v4224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:29 smithi193 ceph-mon[32782]: pgmap v4225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:30.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:29 smithi196 ceph-mon[32572]: pgmap v4225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:29 smithi110 ceph-mon[28069]: pgmap v4225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:31 smithi193 ceph-mon[32782]: pgmap v4226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:31 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6986.902765 secs 2024-04-26T13:44:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:31 smithi196 ceph-mon[32572]: pgmap v4226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:31 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6986.902765 secs 2024-04-26T13:44:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:31 smithi110 ceph-mon[28069]: pgmap v4226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:31 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6986.902765 secs 2024-04-26T13:44:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:33 smithi196 ceph-mon[32572]: pgmap v4227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:33 smithi110 ceph-mon[28069]: pgmap v4227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:33 smithi193 ceph-mon[32782]: pgmap v4227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:35 smithi196 ceph-mon[32572]: pgmap v4228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:35 smithi110 ceph-mon[28069]: pgmap v4228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:35 smithi193 ceph-mon[32782]: pgmap v4228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:36.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:36 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6991.902917 secs 2024-04-26T13:44:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:36 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6991.902917 secs 2024-04-26T13:44:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:36 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6991.902917 secs 2024-04-26T13:44:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:37 smithi196 ceph-mon[32572]: pgmap v4229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:37 smithi110 ceph-mon[28069]: pgmap v4229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:37 smithi193 ceph-mon[32782]: pgmap v4229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:39 smithi196 ceph-mon[32572]: pgmap v4230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:39 smithi110 ceph-mon[28069]: pgmap v4230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:39 smithi193 ceph-mon[32782]: pgmap v4230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:41 smithi196 ceph-mon[32572]: pgmap v4231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:41 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 6996.903013 secs 2024-04-26T13:44:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:41 smithi110 ceph-mon[28069]: pgmap v4231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:41 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 6996.903013 secs 2024-04-26T13:44:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:41 smithi193 ceph-mon[32782]: pgmap v4231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:41 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 6996.903013 secs 2024-04-26T13:44:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:43 smithi196 ceph-mon[32572]: pgmap v4232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:43 smithi110 ceph-mon[28069]: pgmap v4232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:43 smithi193 ceph-mon[32782]: pgmap v4232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:45 smithi196 ceph-mon[32572]: pgmap v4233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:45 smithi110 ceph-mon[28069]: pgmap v4233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:45 smithi193 ceph-mon[32782]: pgmap v4233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7001.903102 secs 2024-04-26T13:44:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7001.903102 secs 2024-04-26T13:44:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7001.903102 secs 2024-04-26T13:44:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:47 smithi196 ceph-mon[32572]: pgmap v4234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:47 smithi110 ceph-mon[28069]: pgmap v4234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:47 smithi193 ceph-mon[32782]: pgmap v4234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:49 smithi196 ceph-mon[32572]: pgmap v4235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:49 smithi110 ceph-mon[28069]: pgmap v4235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:49 smithi193 ceph-mon[32782]: pgmap v4235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:51 smithi196 ceph-mon[32572]: pgmap v4236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7006.903244 secs 2024-04-26T13:44:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:51 smithi110 ceph-mon[28069]: pgmap v4236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7006.903244 secs 2024-04-26T13:44:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:51 smithi193 ceph-mon[32782]: pgmap v4236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7006.903244 secs 2024-04-26T13:44:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:53 smithi196 ceph-mon[32572]: pgmap v4237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:53 smithi110 ceph-mon[28069]: pgmap v4237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:53 smithi193 ceph-mon[32782]: pgmap v4237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:44:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:55 smithi196 ceph-mon[32572]: pgmap v4238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:55 smithi110 ceph-mon[28069]: pgmap v4238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:55 smithi193 ceph-mon[32782]: pgmap v4238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7011.903384 secs 2024-04-26T13:44:57.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7011.903384 secs 2024-04-26T13:44:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7011.903384 secs 2024-04-26T13:44:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:57 smithi196 ceph-mon[32572]: pgmap v4239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:57 smithi110 ceph-mon[28069]: pgmap v4239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:44:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:57 smithi193 ceph-mon[32782]: pgmap v4239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:00.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:44:59 smithi196 ceph-mon[32572]: pgmap v4240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:44:59 smithi110 ceph-mon[28069]: pgmap v4240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:44:59 smithi193 ceph-mon[32782]: pgmap v4240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:01 smithi196 ceph-mon[32572]: pgmap v4241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7016.903512 secs 2024-04-26T13:45:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:01 smithi110 ceph-mon[28069]: pgmap v4241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7016.903512 secs 2024-04-26T13:45:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:01 smithi193 ceph-mon[32782]: pgmap v4241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7016.903512 secs 2024-04-26T13:45:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:03 smithi196 ceph-mon[32572]: pgmap v4242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:45:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:03 smithi110 ceph-mon[28069]: pgmap v4242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:45:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:03 smithi193 ceph-mon[32782]: pgmap v4242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:45:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:05.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:45:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:45:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:45:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:45:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:45:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:45:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:45:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:05 smithi196 ceph-mon[32572]: pgmap v4243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:05 smithi196 ceph-mon[32572]: pgmap v4244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:05 smithi110 ceph-mon[28069]: pgmap v4243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:05 smithi110 ceph-mon[28069]: pgmap v4244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:05 smithi193 ceph-mon[32782]: pgmap v4243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:05 smithi193 ceph-mon[32782]: pgmap v4244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7021.903632 secs 2024-04-26T13:45:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7021.903632 secs 2024-04-26T13:45:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7021.903632 secs 2024-04-26T13:45:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:07 smithi196 ceph-mon[32572]: pgmap v4245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:07 smithi110 ceph-mon[28069]: pgmap v4245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:07 smithi193 ceph-mon[32782]: pgmap v4245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:09 smithi196 ceph-mon[32572]: pgmap v4246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:09 smithi110 ceph-mon[28069]: pgmap v4246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:09 smithi193 ceph-mon[32782]: pgmap v4246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:11 smithi110 ceph-mon[28069]: pgmap v4247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7026.903763 secs 2024-04-26T13:45:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:11 smithi193 ceph-mon[32782]: pgmap v4247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7026.903763 secs 2024-04-26T13:45:12.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:11 smithi196 ceph-mon[32572]: pgmap v4247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:45:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7026.903763 secs 2024-04-26T13:45:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:13 smithi110 ceph-mon[28069]: pgmap v4248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T13:45:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:13 smithi193 ceph-mon[32782]: pgmap v4248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T13:45:14.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:13 smithi196 ceph-mon[32572]: pgmap v4248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T13:45:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:15 smithi110 ceph-mon[28069]: pgmap v4249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:45:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:15 smithi193 ceph-mon[32782]: pgmap v4249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:45:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:15 smithi196 ceph-mon[32572]: pgmap v4249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:45:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7031.903891 secs 2024-04-26T13:45:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7031.903891 secs 2024-04-26T13:45:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7031.903891 secs 2024-04-26T13:45:17.498 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:45:17.499+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006490 con 0x7f261c104b50 2024-04-26T13:45:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:45:17.499+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:45:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:45:17.500+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 58 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:45:17.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:45:17.500+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 58 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006490 con 0x55db1be4fdd0 2024-04-26T13:45:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:17 smithi110 ceph-mon[28069]: pgmap v4250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:17 smithi193 ceph-mon[32782]: pgmap v4250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:17 smithi196 ceph-mon[32572]: pgmap v4250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:19 smithi110 ceph-mon[28069]: pgmap v4251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:19 smithi193 ceph-mon[32782]: pgmap v4251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:20.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:19 smithi196 ceph-mon[32572]: pgmap v4251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:21 smithi110 ceph-mon[28069]: pgmap v4252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7036.904018 secs 2024-04-26T13:45:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:21 smithi193 ceph-mon[32782]: pgmap v4252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7036.904018 secs 2024-04-26T13:45:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:21 smithi196 ceph-mon[32572]: pgmap v4252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7036.904018 secs 2024-04-26T13:45:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:23 smithi193 ceph-mon[32782]: pgmap v4253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:24.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:23 smithi196 ceph-mon[32572]: pgmap v4253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:23 smithi110 ceph-mon[28069]: pgmap v4253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:25 smithi193 ceph-mon[32782]: pgmap v4254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:25 smithi196 ceph-mon[32572]: pgmap v4254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:25 smithi110 ceph-mon[28069]: pgmap v4254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7041.904142 secs 2024-04-26T13:45:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7041.904142 secs 2024-04-26T13:45:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7041.904142 secs 2024-04-26T13:45:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:27 smithi193 ceph-mon[32782]: pgmap v4255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:27 smithi196 ceph-mon[32572]: pgmap v4255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:27 smithi110 ceph-mon[28069]: pgmap v4255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:29 smithi193 ceph-mon[32782]: pgmap v4256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:30.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:29 smithi196 ceph-mon[32572]: pgmap v4256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:29 smithi110 ceph-mon[28069]: pgmap v4256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:31 smithi193 ceph-mon[32782]: pgmap v4257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:31 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7046.904264 secs 2024-04-26T13:45:32.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:31 smithi196 ceph-mon[32572]: pgmap v4257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:31 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7046.904264 secs 2024-04-26T13:45:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:31 smithi110 ceph-mon[28069]: pgmap v4257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:31 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7046.904264 secs 2024-04-26T13:45:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:33 smithi193 ceph-mon[32782]: pgmap v4258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:33 smithi196 ceph-mon[32572]: pgmap v4258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:33 smithi110 ceph-mon[28069]: pgmap v4258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:35 smithi193 ceph-mon[32782]: pgmap v4259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:35 smithi196 ceph-mon[32572]: pgmap v4259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:35 smithi110 ceph-mon[28069]: pgmap v4259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:36 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7051.904424 secs 2024-04-26T13:45:37.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:36 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7051.904424 secs 2024-04-26T13:45:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:36 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7051.904424 secs 2024-04-26T13:45:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:37 smithi193 ceph-mon[32782]: pgmap v4260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:37 smithi196 ceph-mon[32572]: pgmap v4260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:37 smithi110 ceph-mon[28069]: pgmap v4260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:39 smithi193 ceph-mon[32782]: pgmap v4261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:39 smithi196 ceph-mon[32572]: pgmap v4261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:39 smithi110 ceph-mon[28069]: pgmap v4261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:41 smithi193 ceph-mon[32782]: pgmap v4262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:41 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7056.904591 secs 2024-04-26T13:45:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:41 smithi196 ceph-mon[32572]: pgmap v4262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:41 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7056.904591 secs 2024-04-26T13:45:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:41 smithi110 ceph-mon[28069]: pgmap v4262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:41 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7056.904591 secs 2024-04-26T13:45:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:43 smithi193 ceph-mon[32782]: pgmap v4263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:43 smithi196 ceph-mon[32572]: pgmap v4263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:43 smithi110 ceph-mon[28069]: pgmap v4263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:45 smithi193 ceph-mon[32782]: pgmap v4264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:45 smithi196 ceph-mon[32572]: pgmap v4264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:45 smithi110 ceph-mon[28069]: pgmap v4264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7061.904722 secs 2024-04-26T13:45:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7061.904722 secs 2024-04-26T13:45:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7061.904722 secs 2024-04-26T13:45:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:47 smithi196 ceph-mon[32572]: pgmap v4265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:47 smithi110 ceph-mon[28069]: pgmap v4265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:47 smithi193 ceph-mon[32782]: pgmap v4265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:50.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:49 smithi196 ceph-mon[32572]: pgmap v4266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:49 smithi110 ceph-mon[28069]: pgmap v4266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:49 smithi193 ceph-mon[32782]: pgmap v4266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:51 smithi196 ceph-mon[32572]: pgmap v4267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7066.904850 secs 2024-04-26T13:45:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:51 smithi110 ceph-mon[28069]: pgmap v4267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7066.904850 secs 2024-04-26T13:45:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:51 smithi193 ceph-mon[32782]: pgmap v4267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7066.904850 secs 2024-04-26T13:45:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:53 smithi196 ceph-mon[32572]: pgmap v4268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:53 smithi110 ceph-mon[28069]: pgmap v4268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:53 smithi193 ceph-mon[32782]: pgmap v4268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:56.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:55 smithi196 ceph-mon[32572]: pgmap v4269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:55 smithi110 ceph-mon[28069]: pgmap v4269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:55 smithi193 ceph-mon[32782]: pgmap v4269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:45:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7071.904974 secs 2024-04-26T13:45:57.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7071.904974 secs 2024-04-26T13:45:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7071.904974 secs 2024-04-26T13:45:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:57 smithi196 ceph-mon[32572]: pgmap v4270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:57 smithi110 ceph-mon[28069]: pgmap v4270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:45:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:57 smithi193 ceph-mon[32782]: pgmap v4270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:00.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:45:59 smithi196 ceph-mon[32572]: pgmap v4271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:45:59 smithi110 ceph-mon[28069]: pgmap v4271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:45:59 smithi193 ceph-mon[32782]: pgmap v4271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:01 smithi196 ceph-mon[32572]: pgmap v4272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7076.905060 secs 2024-04-26T13:46:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:01 smithi110 ceph-mon[28069]: pgmap v4272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7076.905060 secs 2024-04-26T13:46:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:01 smithi193 ceph-mon[32782]: pgmap v4272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7076.905060 secs 2024-04-26T13:46:04.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:03 smithi196 ceph-mon[32572]: pgmap v4273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:03 smithi110 ceph-mon[28069]: pgmap v4273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:03 smithi193 ceph-mon[32782]: pgmap v4273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:05.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:46:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:46:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:46:06.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:05 smithi196 ceph-mon[32572]: pgmap v4274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:05 smithi110 ceph-mon[28069]: pgmap v4274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:05 smithi193 ceph-mon[32782]: pgmap v4274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:07.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7081.905150 secs 2024-04-26T13:46:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7081.905150 secs 2024-04-26T13:46:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7081.905150 secs 2024-04-26T13:46:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: pgmap v4275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: pgmap v4275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: pgmap v4275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:08 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:46:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:08 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:46:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:08 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:46:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:08 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:46:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:08 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:46:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:08 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:46:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:08 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:46:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:08 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:46:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:08 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:46:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:08 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:46:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:08 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:46:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:08 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:46:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: pgmap v4276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:46:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:46:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: pgmap v4276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:46:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: pgmap v4276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:46:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:46:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:46:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:46:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:10 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:46:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:10 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:46:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:10 smithi196 ceph-mon[32572]: pgmap v4277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s rd, 1 op/s 2024-04-26T13:46:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:10 smithi196 ceph-mon[32572]: pgmap v4278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:10 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:46:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:10 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:46:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:10 smithi110 ceph-mon[28069]: pgmap v4277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s rd, 1 op/s 2024-04-26T13:46:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:10 smithi110 ceph-mon[28069]: pgmap v4278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:10 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:46:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:10 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:46:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:10 smithi193 ceph-mon[32782]: pgmap v4277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 877 B/s rd, 1 op/s 2024-04-26T13:46:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:10 smithi193 ceph-mon[32782]: pgmap v4278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7086.905313 secs 2024-04-26T13:46:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7086.905313 secs 2024-04-26T13:46:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7086.905313 secs 2024-04-26T13:46:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:12 smithi196 ceph-mon[32572]: pgmap v4279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:12 smithi110 ceph-mon[28069]: pgmap v4279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:12 smithi193 ceph-mon[32782]: pgmap v4279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:14 smithi196 ceph-mon[32572]: pgmap v4280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:14 smithi110 ceph-mon[28069]: pgmap v4280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:14 smithi193 ceph-mon[32782]: pgmap v4280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:16 smithi196 ceph-mon[32572]: pgmap v4281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7091.905441 secs 2024-04-26T13:46:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:16 smithi110 ceph-mon[28069]: pgmap v4281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7091.905441 secs 2024-04-26T13:46:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:16 smithi193 ceph-mon[32782]: pgmap v4281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7091.905441 secs 2024-04-26T13:46:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:19 smithi196 ceph-mon[32572]: pgmap v4282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:19 smithi110 ceph-mon[28069]: pgmap v4282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:19 smithi193 ceph-mon[32782]: pgmap v4282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:46:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:21 smithi110 ceph-mon[28069]: pgmap v4283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:46:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:21 smithi193 ceph-mon[32782]: pgmap v4283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:46:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:21 smithi196 ceph-mon[32572]: pgmap v4283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:46:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7096.905573 secs 2024-04-26T13:46:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7096.905573 secs 2024-04-26T13:46:22.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7096.905573 secs 2024-04-26T13:46:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:23 smithi110 ceph-mon[28069]: pgmap v4284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:23 smithi193 ceph-mon[32782]: pgmap v4284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:23.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:23 smithi196 ceph-mon[32572]: pgmap v4284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:25 smithi110 ceph-mon[28069]: pgmap v4285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:25 smithi193 ceph-mon[32782]: pgmap v4285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:25.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:25 smithi196 ceph-mon[32572]: pgmap v4285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:27 smithi110 ceph-mon[28069]: pgmap v4286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7101.905684 secs 2024-04-26T13:46:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:27 smithi193 ceph-mon[32782]: pgmap v4286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7101.905684 secs 2024-04-26T13:46:27.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:27 smithi196 ceph-mon[32572]: pgmap v4286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7101.905684 secs 2024-04-26T13:46:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:29 smithi110 ceph-mon[28069]: pgmap v4287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:29 smithi193 ceph-mon[32782]: pgmap v4287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:29 smithi196 ceph-mon[32572]: pgmap v4287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:31 smithi110 ceph-mon[28069]: pgmap v4288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:31 smithi193 ceph-mon[32782]: pgmap v4288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:31 smithi196 ceph-mon[32572]: pgmap v4288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7106.905806 secs 2024-04-26T13:46:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7106.905806 secs 2024-04-26T13:46:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7106.905806 secs 2024-04-26T13:46:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:33 smithi193 ceph-mon[32782]: pgmap v4289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:33.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:33 smithi196 ceph-mon[32572]: pgmap v4289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:33 smithi110 ceph-mon[28069]: pgmap v4289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:35 smithi193 ceph-mon[32782]: pgmap v4290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:35.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:35 smithi196 ceph-mon[32572]: pgmap v4290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:35 smithi110 ceph-mon[28069]: pgmap v4290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:37 smithi193 ceph-mon[32782]: pgmap v4291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7111.905936 secs 2024-04-26T13:46:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:37 smithi196 ceph-mon[32572]: pgmap v4291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7111.905936 secs 2024-04-26T13:46:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:37 smithi110 ceph-mon[28069]: pgmap v4291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7111.905936 secs 2024-04-26T13:46:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:39 smithi193 ceph-mon[32782]: pgmap v4292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:39.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:39 smithi196 ceph-mon[32572]: pgmap v4292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:39 smithi110 ceph-mon[28069]: pgmap v4292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:41 smithi193 ceph-mon[32782]: pgmap v4293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:41 smithi196 ceph-mon[32572]: pgmap v4293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:41 smithi110 ceph-mon[28069]: pgmap v4293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7116.906061 secs 2024-04-26T13:46:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7116.906061 secs 2024-04-26T13:46:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7116.906061 secs 2024-04-26T13:46:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:43 smithi193 ceph-mon[32782]: pgmap v4294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:43.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:43 smithi196 ceph-mon[32572]: pgmap v4294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:43 smithi110 ceph-mon[28069]: pgmap v4294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:45 smithi193 ceph-mon[32782]: pgmap v4295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:45 smithi196 ceph-mon[32572]: pgmap v4295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:45 smithi110 ceph-mon[28069]: pgmap v4295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:47.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:47 smithi110 ceph-mon[28069]: pgmap v4296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:47.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7121.906210 secs 2024-04-26T13:46:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:47 smithi193 ceph-mon[32782]: pgmap v4296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7121.906210 secs 2024-04-26T13:46:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:47 smithi196 ceph-mon[32572]: pgmap v4296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7121.906210 secs 2024-04-26T13:46:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:49 smithi193 ceph-mon[32782]: pgmap v4297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:49.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:49 smithi196 ceph-mon[32572]: pgmap v4297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:49 smithi110 ceph-mon[28069]: pgmap v4297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:51 smithi193 ceph-mon[32782]: pgmap v4298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:51 smithi196 ceph-mon[32572]: pgmap v4298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:51 smithi110 ceph-mon[28069]: pgmap v4298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7126.906335 secs 2024-04-26T13:46:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:52 smithi193 ceph-mon[32782]: pgmap v4299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7126.906335 secs 2024-04-26T13:46:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:52 smithi196 ceph-mon[32572]: pgmap v4299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7126.906335 secs 2024-04-26T13:46:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:52 smithi110 ceph-mon[28069]: pgmap v4299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:54 smithi196 ceph-mon[32572]: pgmap v4300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:54 smithi110 ceph-mon[28069]: pgmap v4300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:54 smithi193 ceph-mon[32782]: pgmap v4300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:57.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:56 smithi193 ceph-mon[32782]: pgmap v4301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:57.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7131.906458 secs 2024-04-26T13:46:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:56 smithi196 ceph-mon[32572]: pgmap v4301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7131.906458 secs 2024-04-26T13:46:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:56 smithi110 ceph-mon[28069]: pgmap v4301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:46:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7131.906458 secs 2024-04-26T13:46:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:46:58 smithi196 ceph-mon[32572]: pgmap v4302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:46:58 smithi110 ceph-mon[28069]: pgmap v4302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:46:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:46:58 smithi193 ceph-mon[32782]: pgmap v4302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:00 smithi196 ceph-mon[32572]: pgmap v4303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:47:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:00 smithi110 ceph-mon[28069]: pgmap v4303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:47:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:00 smithi193 ceph-mon[32782]: pgmap v4303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:47:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7136.906595 secs 2024-04-26T13:47:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7136.906595 secs 2024-04-26T13:47:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7136.906595 secs 2024-04-26T13:47:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:02 smithi196 ceph-mon[32572]: pgmap v4304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:47:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:02 smithi110 ceph-mon[28069]: pgmap v4304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:47:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:02 smithi193 ceph-mon[32782]: pgmap v4304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:47:05.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:04 smithi196 ceph-mon[32572]: pgmap v4305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:04 smithi110 ceph-mon[28069]: pgmap v4305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:04 smithi193 ceph-mon[32782]: pgmap v4305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:06 smithi196 ceph-mon[32572]: pgmap v4306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:47:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7141.906665 secs 2024-04-26T13:47:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:06 smithi110 ceph-mon[28069]: pgmap v4306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:47:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7141.906665 secs 2024-04-26T13:47:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:06 smithi193 ceph-mon[32782]: pgmap v4306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:47:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7141.906665 secs 2024-04-26T13:47:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:08 smithi196 ceph-mon[32572]: pgmap v4307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:08 smithi110 ceph-mon[28069]: pgmap v4307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:08 smithi193 ceph-mon[32782]: pgmap v4307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:10 smithi196 ceph-mon[32572]: pgmap v4308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:47:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:10 smithi110 ceph-mon[28069]: pgmap v4308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:47:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:10 smithi193 ceph-mon[32782]: pgmap v4308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:47:12.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7146.906763 secs 2024-04-26T13:47:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:47:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:47:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:47:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7146.906763 secs 2024-04-26T13:47:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:47:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:47:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:47:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7146.906763 secs 2024-04-26T13:47:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:47:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:47:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:47:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:12 smithi196 ceph-mon[32572]: pgmap v4309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T13:47:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:12 smithi196 ceph-mon[32572]: pgmap v4310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:12 smithi110 ceph-mon[28069]: pgmap v4309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T13:47:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:12 smithi110 ceph-mon[28069]: pgmap v4310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:12 smithi193 ceph-mon[32782]: pgmap v4309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T13:47:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:12 smithi193 ceph-mon[32782]: pgmap v4310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:14 smithi196 ceph-mon[32572]: pgmap v4311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:14 smithi110 ceph-mon[28069]: pgmap v4311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:14 smithi193 ceph-mon[32782]: pgmap v4311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:16 smithi196 ceph-mon[32572]: pgmap v4312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7151.906890 secs 2024-04-26T13:47:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:16 smithi110 ceph-mon[28069]: pgmap v4312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7151.906890 secs 2024-04-26T13:47:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:16 smithi193 ceph-mon[32782]: pgmap v4312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7151.906890 secs 2024-04-26T13:47:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:18 smithi196 ceph-mon[32572]: pgmap v4313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T13:47:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:18 smithi110 ceph-mon[28069]: pgmap v4313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T13:47:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:18 smithi193 ceph-mon[32782]: pgmap v4313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T13:47:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:20 smithi196 ceph-mon[32572]: pgmap v4314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:20 smithi110 ceph-mon[28069]: pgmap v4314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:20 smithi193 ceph-mon[32782]: pgmap v4314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:47:22.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7156.906997 secs 2024-04-26T13:47:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7156.906997 secs 2024-04-26T13:47:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7156.906997 secs 2024-04-26T13:47:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:22 smithi196 ceph-mon[32572]: pgmap v4315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:47:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:22 smithi110 ceph-mon[28069]: pgmap v4315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:47:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:22 smithi193 ceph-mon[32782]: pgmap v4315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:47:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:24 smithi196 ceph-mon[32572]: pgmap v4316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:24 smithi110 ceph-mon[28069]: pgmap v4316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:24 smithi193 ceph-mon[32782]: pgmap v4316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:26 smithi196 ceph-mon[32572]: pgmap v4317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7161.907116 secs 2024-04-26T13:47:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:26 smithi110 ceph-mon[28069]: pgmap v4317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7161.907116 secs 2024-04-26T13:47:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:26 smithi193 ceph-mon[32782]: pgmap v4317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7161.907116 secs 2024-04-26T13:47:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:28 smithi196 ceph-mon[32572]: pgmap v4318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:28 smithi110 ceph-mon[28069]: pgmap v4318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:28 smithi193 ceph-mon[32782]: pgmap v4318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:31.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:31 smithi196 ceph-mon[32572]: pgmap v4319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:47:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:31 smithi110 ceph-mon[28069]: pgmap v4319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:47:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:31 smithi193 ceph-mon[32782]: pgmap v4319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:47:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7166.907239 secs 2024-04-26T13:47:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7166.907239 secs 2024-04-26T13:47:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7166.907239 secs 2024-04-26T13:47:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:33 smithi110 ceph-mon[28069]: pgmap v4320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:33 smithi193 ceph-mon[32782]: pgmap v4320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:33 smithi196 ceph-mon[32572]: pgmap v4320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:35 smithi110 ceph-mon[28069]: pgmap v4321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:35 smithi193 ceph-mon[32782]: pgmap v4321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:35.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:35 smithi196 ceph-mon[32572]: pgmap v4321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:37 smithi110 ceph-mon[28069]: pgmap v4322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7171.907364 secs 2024-04-26T13:47:37.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:37 smithi196 ceph-mon[32572]: pgmap v4322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:37.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7171.907364 secs 2024-04-26T13:47:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:37 smithi193 ceph-mon[32782]: pgmap v4322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7171.907364 secs 2024-04-26T13:47:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:39 smithi110 ceph-mon[28069]: pgmap v4323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:39 smithi193 ceph-mon[32782]: pgmap v4323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:39 smithi196 ceph-mon[32572]: pgmap v4323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:41 smithi110 ceph-mon[28069]: pgmap v4324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:41 smithi193 ceph-mon[32782]: pgmap v4324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:41.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:41 smithi196 ceph-mon[32572]: pgmap v4324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7176.907493 secs 2024-04-26T13:47:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7176.907493 secs 2024-04-26T13:47:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7176.907493 secs 2024-04-26T13:47:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:43 smithi193 ceph-mon[32782]: pgmap v4325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:43 smithi196 ceph-mon[32572]: pgmap v4325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:43 smithi110 ceph-mon[28069]: pgmap v4325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:45 smithi193 ceph-mon[32782]: pgmap v4326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:45 smithi196 ceph-mon[32572]: pgmap v4326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:45 smithi110 ceph-mon[28069]: pgmap v4326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:47.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:47 smithi110 ceph-mon[28069]: pgmap v4327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:47.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7181.907645 secs 2024-04-26T13:47:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:47 smithi193 ceph-mon[32782]: pgmap v4327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7181.907645 secs 2024-04-26T13:47:47.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:47 smithi196 ceph-mon[32572]: pgmap v4327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7181.907645 secs 2024-04-26T13:47:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:49 smithi193 ceph-mon[32782]: pgmap v4328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:49.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:49 smithi196 ceph-mon[32572]: pgmap v4328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:49 smithi110 ceph-mon[28069]: pgmap v4328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:51 smithi193 ceph-mon[32782]: pgmap v4329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:51.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:51 smithi196 ceph-mon[32572]: pgmap v4329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:51 smithi110 ceph-mon[28069]: pgmap v4329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7186.907777 secs 2024-04-26T13:47:52.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7186.907777 secs 2024-04-26T13:47:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7186.907777 secs 2024-04-26T13:47:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:53 smithi193 ceph-mon[32782]: pgmap v4330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:53.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:53 smithi196 ceph-mon[32572]: pgmap v4330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:53 smithi110 ceph-mon[28069]: pgmap v4330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:55 smithi193 ceph-mon[32782]: pgmap v4331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:55 smithi196 ceph-mon[32572]: pgmap v4331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:55 smithi110 ceph-mon[28069]: pgmap v4331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:57 smithi193 ceph-mon[32782]: pgmap v4332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7191.907924 secs 2024-04-26T13:47:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:57 smithi196 ceph-mon[32572]: pgmap v4332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7191.907924 secs 2024-04-26T13:47:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:57 smithi110 ceph-mon[28069]: pgmap v4332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:47:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7191.907924 secs 2024-04-26T13:47:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:47:59 smithi193 ceph-mon[32782]: pgmap v4333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:47:59 smithi196 ceph-mon[32572]: pgmap v4333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:47:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:47:59 smithi110 ceph-mon[28069]: pgmap v4333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:01 smithi193 ceph-mon[32782]: pgmap v4334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:01 smithi196 ceph-mon[32572]: pgmap v4334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:01 smithi110 ceph-mon[28069]: pgmap v4334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7196.908062 secs 2024-04-26T13:48:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7196.908062 secs 2024-04-26T13:48:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7196.908062 secs 2024-04-26T13:48:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:03 smithi193 ceph-mon[32782]: pgmap v4335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:03 smithi196 ceph-mon[32572]: pgmap v4335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:03 smithi110 ceph-mon[28069]: pgmap v4335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:04 smithi196 ceph-mon[32572]: pgmap v4336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:04 smithi110 ceph-mon[28069]: pgmap v4336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:04 smithi193 ceph-mon[32782]: pgmap v4336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:06 smithi196 ceph-mon[32572]: pgmap v4337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:06 smithi196 ceph-mon[32572]: 6 slow requests, 1 included below; oldest blocked for > 7201.908180 secs 2024-04-26T13:48:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:06 smithi196 ceph-mon[32572]: slow request 1443.163474 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:48:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:06 smithi110 ceph-mon[28069]: pgmap v4337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:06 smithi110 ceph-mon[28069]: 6 slow requests, 1 included below; oldest blocked for > 7201.908180 secs 2024-04-26T13:48:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:06 smithi110 ceph-mon[28069]: slow request 1443.163474 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:48:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:06 smithi193 ceph-mon[32782]: pgmap v4337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:06 smithi193 ceph-mon[32782]: 6 slow requests, 1 included below; oldest blocked for > 7201.908180 secs 2024-04-26T13:48:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:06 smithi193 ceph-mon[32782]: slow request 1443.163474 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:48:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:08 smithi196 ceph-mon[32572]: pgmap v4338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:08 smithi110 ceph-mon[28069]: pgmap v4338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:08 smithi193 ceph-mon[32782]: pgmap v4338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:10 smithi196 ceph-mon[32572]: pgmap v4339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:10 smithi110 ceph-mon[28069]: pgmap v4339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:10 smithi193 ceph-mon[32782]: pgmap v4339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7206.908299 secs 2024-04-26T13:48:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7206.908299 secs 2024-04-26T13:48:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7206.908299 secs 2024-04-26T13:48:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:12 smithi196 ceph-mon[32572]: pgmap v4340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:48:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:12 smithi110 ceph-mon[28069]: pgmap v4340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:48:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:12 smithi193 ceph-mon[32782]: pgmap v4340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:48:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:48:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:48:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:13 smithi196 ceph-mon[32572]: pgmap v4341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:48:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:13 smithi196 ceph-mon[32572]: pgmap v4342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:48:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:48:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:48:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:13 smithi110 ceph-mon[28069]: pgmap v4341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:48:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:13 smithi110 ceph-mon[28069]: pgmap v4342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:48:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:48:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:48:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:13 smithi193 ceph-mon[32782]: pgmap v4341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:48:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:13 smithi193 ceph-mon[32782]: pgmap v4342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:48:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:15 smithi196 ceph-mon[32572]: pgmap v4343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:15 smithi110 ceph-mon[28069]: pgmap v4343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:16.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:15 smithi193 ceph-mon[32782]: pgmap v4343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.382+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T13:48:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.382+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T13:48:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.382+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 0x7f26000b4670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f2614036000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T13:48:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.382+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 0x7f26000b4670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f2614036000 comp rx=0 tx=0).stop 2024-04-26T13:48:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.382+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T13:48:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.383+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T13:48:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.383+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4ef0 0x7f26000b4670 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T13:48:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.383+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T13:48:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.383+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T13:48:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.385+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a52d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614014040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T13:48:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.400+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T13:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.400+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T13:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.400+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T13:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.400+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T13:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.401+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T13:48:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.402+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T13:48:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:16.402+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T13:48:17.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7211.908371 secs 2024-04-26T13:48:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7211.908371 secs 2024-04-26T13:48:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7211.908371 secs 2024-04-26T13:48:17.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:17.528+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:48:17.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:17.528+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:48:17.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:17.529+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 59 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:48:17.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:48:17.529+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 59 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:48:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:17 smithi196 ceph-mon[32572]: pgmap v4344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:48:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:17 smithi110 ceph-mon[28069]: pgmap v4344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:48:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:17 smithi193 ceph-mon[32782]: pgmap v4344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:48:20.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:19 smithi196 ceph-mon[32572]: pgmap v4345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:19 smithi110 ceph-mon[28069]: pgmap v4345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:19 smithi193 ceph-mon[32782]: pgmap v4345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:21 smithi196 ceph-mon[32572]: pgmap v4346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7216.908488 secs 2024-04-26T13:48:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:21 smithi110 ceph-mon[28069]: pgmap v4346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7216.908488 secs 2024-04-26T13:48:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:21 smithi193 ceph-mon[32782]: pgmap v4346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:48:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7216.908488 secs 2024-04-26T13:48:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:23 smithi196 ceph-mon[32572]: pgmap v4347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:48:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:23 smithi110 ceph-mon[28069]: pgmap v4347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:48:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:23 smithi193 ceph-mon[32782]: pgmap v4347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:48:26.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:25 smithi196 ceph-mon[32572]: pgmap v4348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:25 smithi110 ceph-mon[28069]: pgmap v4348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:25 smithi193 ceph-mon[32782]: pgmap v4348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7221.908636 secs 2024-04-26T13:48:27.271 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7221.908636 secs 2024-04-26T13:48:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7221.908636 secs 2024-04-26T13:48:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:27 smithi196 ceph-mon[32572]: pgmap v4349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:27 smithi110 ceph-mon[28069]: pgmap v4349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:27 smithi193 ceph-mon[32782]: pgmap v4349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:30.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:29 smithi196 ceph-mon[32572]: pgmap v4350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:29 smithi110 ceph-mon[28069]: pgmap v4350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:30.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:29 smithi193 ceph-mon[32782]: pgmap v4350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:31 smithi196 ceph-mon[32572]: pgmap v4351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:31 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7226.908755 secs 2024-04-26T13:48:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:31 smithi110 ceph-mon[28069]: pgmap v4351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:31 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7226.908755 secs 2024-04-26T13:48:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:31 smithi193 ceph-mon[32782]: pgmap v4351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:31 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7226.908755 secs 2024-04-26T13:48:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:33 smithi196 ceph-mon[32572]: pgmap v4352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:33 smithi110 ceph-mon[28069]: pgmap v4352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:34.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:33 smithi193 ceph-mon[32782]: pgmap v4352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:35 smithi196 ceph-mon[32572]: pgmap v4353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:35 smithi110 ceph-mon[28069]: pgmap v4353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:35 smithi193 ceph-mon[32782]: pgmap v4353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:36 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7231.908886 secs 2024-04-26T13:48:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:36 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7231.908886 secs 2024-04-26T13:48:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:36 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7231.908886 secs 2024-04-26T13:48:38.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:37 smithi196 ceph-mon[32572]: pgmap v4354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:37 smithi110 ceph-mon[28069]: pgmap v4354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:37 smithi193 ceph-mon[32782]: pgmap v4354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:40 smithi196 ceph-mon[32572]: pgmap v4355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:40 smithi110 ceph-mon[28069]: pgmap v4355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:40 smithi193 ceph-mon[32782]: pgmap v4355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:42 smithi110 ceph-mon[28069]: pgmap v4356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7236.909000 secs 2024-04-26T13:48:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:42 smithi193 ceph-mon[32782]: pgmap v4356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7236.909000 secs 2024-04-26T13:48:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:42 smithi196 ceph-mon[32572]: pgmap v4356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7236.909000 secs 2024-04-26T13:48:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:44 smithi110 ceph-mon[28069]: pgmap v4357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:44 smithi193 ceph-mon[32782]: pgmap v4357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:44 smithi196 ceph-mon[32572]: pgmap v4357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:46 smithi110 ceph-mon[28069]: pgmap v4358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:46 smithi193 ceph-mon[32782]: pgmap v4358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:46.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:46 smithi196 ceph-mon[32572]: pgmap v4358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7241.909120 secs 2024-04-26T13:48:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7241.909120 secs 2024-04-26T13:48:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7241.909120 secs 2024-04-26T13:48:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:48 smithi110 ceph-mon[28069]: pgmap v4359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:48 smithi193 ceph-mon[32782]: pgmap v4359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:48 smithi196 ceph-mon[32572]: pgmap v4359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:50 smithi110 ceph-mon[28069]: pgmap v4360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:50 smithi193 ceph-mon[32782]: pgmap v4360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:50.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:50 smithi196 ceph-mon[32572]: pgmap v4360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:52 smithi193 ceph-mon[32782]: pgmap v4361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7246.909252 secs 2024-04-26T13:48:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:52 smithi196 ceph-mon[32572]: pgmap v4361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7246.909252 secs 2024-04-26T13:48:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:52 smithi110 ceph-mon[28069]: pgmap v4361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7246.909252 secs 2024-04-26T13:48:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:54 smithi193 ceph-mon[32782]: pgmap v4362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:54 smithi196 ceph-mon[32572]: pgmap v4362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:54 smithi110 ceph-mon[28069]: pgmap v4362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:48:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:56 smithi193 ceph-mon[32782]: pgmap v4363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:56.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:56 smithi196 ceph-mon[32572]: pgmap v4363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:56 smithi110 ceph-mon[28069]: pgmap v4363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7251.909385 secs 2024-04-26T13:48:57.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7251.909385 secs 2024-04-26T13:48:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7251.909385 secs 2024-04-26T13:48:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:48:58 smithi193 ceph-mon[32782]: pgmap v4364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:48:58 smithi196 ceph-mon[32572]: pgmap v4364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:48:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:48:58 smithi110 ceph-mon[28069]: pgmap v4364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:00 smithi193 ceph-mon[32782]: pgmap v4365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:00.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:00 smithi196 ceph-mon[32572]: pgmap v4365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:00 smithi110 ceph-mon[28069]: pgmap v4365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:02 smithi193 ceph-mon[32782]: pgmap v4366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7256.909524 secs 2024-04-26T13:49:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:02 smithi196 ceph-mon[32572]: pgmap v4366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7256.909524 secs 2024-04-26T13:49:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:02 smithi110 ceph-mon[28069]: pgmap v4366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7256.909524 secs 2024-04-26T13:49:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:49:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:49:03.670+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:49:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:49:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:49:03.670+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:49:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:49:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:49:03.670+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:49:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:49:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:49:03.670+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:49:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:49:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:49:03.670+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:49:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:04 smithi193 ceph-mon[32782]: pgmap v4367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:04 smithi196 ceph-mon[32572]: pgmap v4367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:04 smithi110 ceph-mon[28069]: pgmap v4367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:06 smithi193 ceph-mon[32782]: pgmap v4368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:06 smithi196 ceph-mon[32572]: pgmap v4368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:06 smithi110 ceph-mon[28069]: pgmap v4368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7261.909613 secs 2024-04-26T13:49:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7261.909613 secs 2024-04-26T13:49:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7261.909613 secs 2024-04-26T13:49:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:08 smithi193 ceph-mon[32782]: pgmap v4369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:08.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:08 smithi196 ceph-mon[32572]: pgmap v4369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:08 smithi110 ceph-mon[28069]: pgmap v4369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:10 smithi193 ceph-mon[32782]: pgmap v4370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:49:10.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:10 smithi196 ceph-mon[32572]: pgmap v4370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:49:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:10 smithi110 ceph-mon[28069]: pgmap v4370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:49:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:12 smithi193 ceph-mon[32782]: pgmap v4371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:49:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7266.909730 secs 2024-04-26T13:49:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:12 smithi196 ceph-mon[32572]: pgmap v4371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:49:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7266.909730 secs 2024-04-26T13:49:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:12 smithi110 ceph-mon[28069]: pgmap v4371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T13:49:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7266.909730 secs 2024-04-26T13:49:14.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:14 smithi193 ceph-mon[32782]: pgmap v4372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:49:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:49:14.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:14 smithi196 ceph-mon[32572]: pgmap v4372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:49:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:49:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:14 smithi110 ceph-mon[28069]: pgmap v4372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T13:49:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:49:15.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:49:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:49:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:49:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:49:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:49:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:49:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:49:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:49:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:49:16.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:16 smithi196 ceph-mon[32572]: pgmap v4373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 177 B/s wr, 1 op/s 2024-04-26T13:49:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:16 smithi196 ceph-mon[32572]: pgmap v4374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:49:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:16 smithi110 ceph-mon[28069]: pgmap v4373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 177 B/s wr, 1 op/s 2024-04-26T13:49:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:16 smithi110 ceph-mon[28069]: pgmap v4374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:49:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:16 smithi193 ceph-mon[32782]: pgmap v4373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 177 B/s wr, 1 op/s 2024-04-26T13:49:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:16 smithi193 ceph-mon[32782]: pgmap v4374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:49:17.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7271.909843 secs 2024-04-26T13:49:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7271.909843 secs 2024-04-26T13:49:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7271.909843 secs 2024-04-26T13:49:18.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:18 smithi196 ceph-mon[32572]: pgmap v4375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:49:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:18 smithi110 ceph-mon[28069]: pgmap v4375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:49:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:18 smithi193 ceph-mon[32782]: pgmap v4375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T13:49:19.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:19 smithi196 ceph-mon[32572]: pgmap v4376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:49:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:19 smithi110 ceph-mon[28069]: pgmap v4376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:49:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:19 smithi193 ceph-mon[32782]: pgmap v4376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:49:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:21 smithi196 ceph-mon[32572]: pgmap v4377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:49:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7276.909940 secs 2024-04-26T13:49:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:21 smithi110 ceph-mon[28069]: pgmap v4377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:49:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7276.909940 secs 2024-04-26T13:49:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:21 smithi193 ceph-mon[32782]: pgmap v4377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:49:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7276.909940 secs 2024-04-26T13:49:23.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:23 smithi196 ceph-mon[32572]: pgmap v4378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:49:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:23 smithi110 ceph-mon[28069]: pgmap v4378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:49:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:23 smithi193 ceph-mon[32782]: pgmap v4378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:49:25.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:25 smithi196 ceph-mon[32572]: pgmap v4379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:49:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:25 smithi110 ceph-mon[28069]: pgmap v4379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:49:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:25 smithi193 ceph-mon[32782]: pgmap v4379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:49:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7281.910059 secs 2024-04-26T13:49:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7281.910059 secs 2024-04-26T13:49:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7281.910059 secs 2024-04-26T13:49:27.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:27 smithi193 ceph-mon[32782]: pgmap v4380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:27 smithi110 ceph-mon[28069]: pgmap v4380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:27 smithi196 ceph-mon[32572]: pgmap v4380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:29 smithi110 ceph-mon[28069]: pgmap v4381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:29 smithi193 ceph-mon[32782]: pgmap v4381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:29 smithi196 ceph-mon[32572]: pgmap v4381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:31 smithi110 ceph-mon[28069]: pgmap v4382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:31 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7286.910197 secs 2024-04-26T13:49:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:31 smithi193 ceph-mon[32782]: pgmap v4382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:31 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7286.910197 secs 2024-04-26T13:49:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:31 smithi196 ceph-mon[32572]: pgmap v4382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:31 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7286.910197 secs 2024-04-26T13:49:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:33 smithi110 ceph-mon[28069]: pgmap v4383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:33 smithi193 ceph-mon[32782]: pgmap v4383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:33 smithi196 ceph-mon[32572]: pgmap v4383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:35 smithi110 ceph-mon[28069]: pgmap v4384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:35 smithi193 ceph-mon[32782]: pgmap v4384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:36.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:35 smithi196 ceph-mon[32572]: pgmap v4384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:36 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7291.910311 secs 2024-04-26T13:49:37.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:36 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7291.910311 secs 2024-04-26T13:49:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:36 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7291.910311 secs 2024-04-26T13:49:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:37 smithi193 ceph-mon[32782]: pgmap v4385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:37 smithi196 ceph-mon[32572]: pgmap v4385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:37 smithi110 ceph-mon[28069]: pgmap v4385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:39.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:39 smithi196 ceph-mon[32572]: pgmap v4386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:39 smithi193 ceph-mon[32782]: pgmap v4386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:39 smithi110 ceph-mon[28069]: pgmap v4386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:41 smithi193 ceph-mon[32782]: pgmap v4387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:41 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7296.910431 secs 2024-04-26T13:49:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:41 smithi196 ceph-mon[32572]: pgmap v4387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:41 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7296.910431 secs 2024-04-26T13:49:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:41 smithi110 ceph-mon[28069]: pgmap v4387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:41 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7296.910431 secs 2024-04-26T13:49:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:43 smithi193 ceph-mon[32782]: pgmap v4388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:43 smithi196 ceph-mon[32572]: pgmap v4388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:43 smithi110 ceph-mon[28069]: pgmap v4388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:45 smithi193 ceph-mon[32782]: pgmap v4389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:45 smithi196 ceph-mon[32572]: pgmap v4389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:45 smithi110 ceph-mon[28069]: pgmap v4389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7301.910553 secs 2024-04-26T13:49:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7301.910553 secs 2024-04-26T13:49:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7301.910553 secs 2024-04-26T13:49:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:47 smithi193 ceph-mon[32782]: pgmap v4390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:47.941 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:47 smithi110 ceph-mon[28069]: pgmap v4390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:47 smithi196 ceph-mon[32572]: pgmap v4390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:49 smithi193 ceph-mon[32782]: pgmap v4391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:49 smithi196 ceph-mon[32572]: pgmap v4391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:49 smithi110 ceph-mon[28069]: pgmap v4391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:51 smithi193 ceph-mon[32782]: pgmap v4392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7306.910675 secs 2024-04-26T13:49:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:51 smithi196 ceph-mon[32572]: pgmap v4392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7306.910675 secs 2024-04-26T13:49:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:51 smithi110 ceph-mon[28069]: pgmap v4392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7306.910675 secs 2024-04-26T13:49:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:53 smithi193 ceph-mon[32782]: pgmap v4393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:53 smithi196 ceph-mon[32572]: pgmap v4393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:53 smithi110 ceph-mon[28069]: pgmap v4393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:49:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:55 smithi193 ceph-mon[32782]: pgmap v4394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:55 smithi196 ceph-mon[32572]: pgmap v4394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:55 smithi110 ceph-mon[28069]: pgmap v4394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7311.910799 secs 2024-04-26T13:49:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7311.910799 secs 2024-04-26T13:49:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7311.910799 secs 2024-04-26T13:49:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:57 smithi193 ceph-mon[32782]: pgmap v4395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:57 smithi196 ceph-mon[32572]: pgmap v4395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:57 smithi110 ceph-mon[28069]: pgmap v4395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:49:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:49:59 smithi193 ceph-mon[32782]: pgmap v4396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:49:59 smithi196 ceph-mon[32572]: pgmap v4396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:49:59 smithi110 ceph-mon[28069]: pgmap v4396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:50:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:50:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T13:50:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:01 smithi196 ceph-mon[32572]: pgmap v4397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7316.910923 secs 2024-04-26T13:50:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:01 smithi110 ceph-mon[28069]: pgmap v4397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7316.910923 secs 2024-04-26T13:50:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:01 smithi193 ceph-mon[32782]: pgmap v4397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7316.910923 secs 2024-04-26T13:50:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:03 smithi196 ceph-mon[32572]: pgmap v4398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:03 smithi110 ceph-mon[28069]: pgmap v4398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:03 smithi193 ceph-mon[32782]: pgmap v4398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:05 smithi196 ceph-mon[32572]: pgmap v4399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:05 smithi110 ceph-mon[28069]: pgmap v4399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:05 smithi193 ceph-mon[32782]: pgmap v4399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7321.911018 secs 2024-04-26T13:50:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7321.911018 secs 2024-04-26T13:50:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7321.911018 secs 2024-04-26T13:50:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:07 smithi196 ceph-mon[32572]: pgmap v4400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:07 smithi110 ceph-mon[28069]: pgmap v4400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:07 smithi193 ceph-mon[32782]: pgmap v4400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:09 smithi196 ceph-mon[32572]: pgmap v4401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:09 smithi110 ceph-mon[28069]: pgmap v4401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:09 smithi193 ceph-mon[32782]: pgmap v4401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:11 smithi196 ceph-mon[32572]: pgmap v4402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7326.911161 secs 2024-04-26T13:50:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:11 smithi110 ceph-mon[28069]: pgmap v4402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7326.911161 secs 2024-04-26T13:50:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:11 smithi193 ceph-mon[32782]: pgmap v4402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7326.911161 secs 2024-04-26T13:50:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:13 smithi196 ceph-mon[32572]: pgmap v4403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:13 smithi110 ceph-mon[28069]: pgmap v4403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:13 smithi193 ceph-mon[32782]: pgmap v4403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:16.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:15 smithi196 ceph-mon[32572]: pgmap v4404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:50:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:15 smithi110 ceph-mon[28069]: pgmap v4404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:50:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:15 smithi193 ceph-mon[32782]: pgmap v4404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:50:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:50:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:50:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:16 smithi196 ceph-mon[32572]: pgmap v4405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:50:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:16 smithi196 ceph-mon[32572]: pgmap v4406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:50:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7331.911273 secs 2024-04-26T13:50:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:50:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:50:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:16 smithi110 ceph-mon[28069]: pgmap v4405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:50:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:16 smithi110 ceph-mon[28069]: pgmap v4406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:50:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7331.911273 secs 2024-04-26T13:50:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:50:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:50:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:16 smithi193 ceph-mon[32782]: pgmap v4405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:50:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:16 smithi193 ceph-mon[32782]: pgmap v4406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:50:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7331.911273 secs 2024-04-26T13:50:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:19 smithi193 ceph-mon[32782]: pgmap v4407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:19.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:19 smithi196 ceph-mon[32572]: pgmap v4407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:19 smithi110 ceph-mon[28069]: pgmap v4407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:21 smithi193 ceph-mon[32782]: pgmap v4408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:21.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:21 smithi196 ceph-mon[32572]: pgmap v4408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:21 smithi110 ceph-mon[28069]: pgmap v4408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7336.911372 secs 2024-04-26T13:50:22.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7336.911372 secs 2024-04-26T13:50:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7336.911372 secs 2024-04-26T13:50:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:23 smithi193 ceph-mon[32782]: pgmap v4409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:50:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:23 smithi196 ceph-mon[32572]: pgmap v4409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:50:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:23 smithi110 ceph-mon[28069]: pgmap v4409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:50:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:25 smithi193 ceph-mon[32782]: pgmap v4410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:25.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:25 smithi196 ceph-mon[32572]: pgmap v4410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:25 smithi110 ceph-mon[28069]: pgmap v4410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:50:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:27 smithi193 ceph-mon[32782]: pgmap v4411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:50:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7341.911517 secs 2024-04-26T13:50:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:27 smithi196 ceph-mon[32572]: pgmap v4411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:50:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7341.911517 secs 2024-04-26T13:50:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:27 smithi110 ceph-mon[28069]: pgmap v4411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:50:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7341.911517 secs 2024-04-26T13:50:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:29 smithi193 ceph-mon[32782]: pgmap v4412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:29 smithi196 ceph-mon[32572]: pgmap v4412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:29 smithi110 ceph-mon[28069]: pgmap v4412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:31 smithi193 ceph-mon[32782]: pgmap v4413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:31.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:31 smithi196 ceph-mon[32572]: pgmap v4413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:31 smithi110 ceph-mon[28069]: pgmap v4413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7346.911642 secs 2024-04-26T13:50:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7346.911642 secs 2024-04-26T13:50:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7346.911642 secs 2024-04-26T13:50:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:33 smithi193 ceph-mon[32782]: pgmap v4414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:33.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:33 smithi196 ceph-mon[32572]: pgmap v4414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:33 smithi110 ceph-mon[28069]: pgmap v4414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:35 smithi193 ceph-mon[32782]: pgmap v4415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:35 smithi196 ceph-mon[32572]: pgmap v4415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:35 smithi110 ceph-mon[28069]: pgmap v4415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:37 smithi193 ceph-mon[32782]: pgmap v4416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7351.911781 secs 2024-04-26T13:50:37.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:37 smithi196 ceph-mon[32572]: pgmap v4416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7351.911781 secs 2024-04-26T13:50:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:37 smithi110 ceph-mon[28069]: pgmap v4416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7351.911781 secs 2024-04-26T13:50:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:39 smithi193 ceph-mon[32782]: pgmap v4417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:39 smithi196 ceph-mon[32572]: pgmap v4417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:39 smithi110 ceph-mon[28069]: pgmap v4417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:41 smithi196 ceph-mon[32572]: pgmap v4418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:41 smithi110 ceph-mon[28069]: pgmap v4418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:41 smithi193 ceph-mon[32782]: pgmap v4418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7356.911914 secs 2024-04-26T13:50:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7356.911914 secs 2024-04-26T13:50:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7356.911914 secs 2024-04-26T13:50:43.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:43 smithi196 ceph-mon[32572]: pgmap v4419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:43 smithi110 ceph-mon[28069]: pgmap v4419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:43 smithi193 ceph-mon[32782]: pgmap v4419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:45 smithi196 ceph-mon[32572]: pgmap v4420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:45 smithi110 ceph-mon[28069]: pgmap v4420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:45 smithi193 ceph-mon[32782]: pgmap v4420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:47 smithi196 ceph-mon[32572]: pgmap v4421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7361.912031 secs 2024-04-26T13:50:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:47 smithi110 ceph-mon[28069]: pgmap v4421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7361.912031 secs 2024-04-26T13:50:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:47 smithi193 ceph-mon[32782]: pgmap v4421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7361.912031 secs 2024-04-26T13:50:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:49 smithi196 ceph-mon[32572]: pgmap v4422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:49 smithi110 ceph-mon[28069]: pgmap v4422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:49.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:49 smithi193 ceph-mon[32782]: pgmap v4422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:50 smithi196 ceph-mon[32572]: pgmap v4423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:50 smithi110 ceph-mon[28069]: pgmap v4423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:50 smithi193 ceph-mon[32782]: pgmap v4423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:51.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7366.912152 secs 2024-04-26T13:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7366.912152 secs 2024-04-26T13:50:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7366.912152 secs 2024-04-26T13:50:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:52 smithi193 ceph-mon[32782]: pgmap v4424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:52 smithi196 ceph-mon[32572]: pgmap v4424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:52 smithi110 ceph-mon[28069]: pgmap v4424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:55 smithi193 ceph-mon[32782]: pgmap v4425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:55.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:55 smithi196 ceph-mon[32572]: pgmap v4425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:55 smithi110 ceph-mon[28069]: pgmap v4425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:57 smithi193 ceph-mon[32782]: pgmap v4426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7371.912266 secs 2024-04-26T13:50:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:57 smithi196 ceph-mon[32572]: pgmap v4426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7371.912266 secs 2024-04-26T13:50:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:57 smithi110 ceph-mon[28069]: pgmap v4426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:50:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7371.912266 secs 2024-04-26T13:50:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:50:59 smithi193 ceph-mon[32782]: pgmap v4427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:50:59 smithi196 ceph-mon[32572]: pgmap v4427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:50:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:50:59 smithi110 ceph-mon[28069]: pgmap v4427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:01 smithi193 ceph-mon[32782]: pgmap v4428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:01 smithi196 ceph-mon[32572]: pgmap v4428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:01 smithi110 ceph-mon[28069]: pgmap v4428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7376.912425 secs 2024-04-26T13:51:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7376.912425 secs 2024-04-26T13:51:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7376.912425 secs 2024-04-26T13:51:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:03 smithi193 ceph-mon[32782]: pgmap v4429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:03 smithi196 ceph-mon[32572]: pgmap v4429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:03 smithi110 ceph-mon[28069]: pgmap v4429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:05 smithi193 ceph-mon[32782]: pgmap v4430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:05 smithi196 ceph-mon[32572]: pgmap v4430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:05 smithi110 ceph-mon[28069]: pgmap v4430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:07 smithi193 ceph-mon[32782]: pgmap v4431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7381.912532 secs 2024-04-26T13:51:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:07 smithi196 ceph-mon[32572]: pgmap v4431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7381.912532 secs 2024-04-26T13:51:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:07 smithi110 ceph-mon[28069]: pgmap v4431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7381.912532 secs 2024-04-26T13:51:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:09 smithi193 ceph-mon[32782]: pgmap v4432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:09.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:09 smithi196 ceph-mon[32572]: pgmap v4432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:09 smithi110 ceph-mon[28069]: pgmap v4432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:11 smithi193 ceph-mon[32782]: pgmap v4433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:11 smithi196 ceph-mon[32572]: pgmap v4433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:11 smithi110 ceph-mon[28069]: pgmap v4433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:12.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7386.912652 secs 2024-04-26T13:51:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7386.912652 secs 2024-04-26T13:51:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7386.912652 secs 2024-04-26T13:51:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:13 smithi196 ceph-mon[32572]: pgmap v4434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:13 smithi110 ceph-mon[28069]: pgmap v4434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:13 smithi193 ceph-mon[32782]: pgmap v4434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:15 smithi196 ceph-mon[32572]: pgmap v4435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:15 smithi110 ceph-mon[28069]: pgmap v4435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:15 smithi193 ceph-mon[32782]: pgmap v4435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:17 smithi196 ceph-mon[32572]: pgmap v4436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7391.912805 secs 2024-04-26T13:51:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:51:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:17 smithi110 ceph-mon[28069]: pgmap v4436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7391.912805 secs 2024-04-26T13:51:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:51:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:51:17.558+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:51:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:51:17.558+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:51:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:51:17.560+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 60 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:51:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:51:17.560+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 60 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:51:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:17 smithi193 ceph-mon[32782]: pgmap v4436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7391.912805 secs 2024-04-26T13:51:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:51:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:51:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:51:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:51:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:51:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:51:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:51:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:51:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:51:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:51:19.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:19 smithi110 ceph-mon[28069]: pgmap v4437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:51:19.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:19 smithi110 ceph-mon[28069]: pgmap v4438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:19.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:19 smithi196 ceph-mon[32572]: pgmap v4437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:51:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:19 smithi196 ceph-mon[32572]: pgmap v4438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:19 smithi193 ceph-mon[32782]: pgmap v4437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:51:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:19 smithi193 ceph-mon[32782]: pgmap v4438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:20 smithi196 ceph-mon[32572]: pgmap v4439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:20 smithi110 ceph-mon[28069]: pgmap v4439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:20 smithi193 ceph-mon[32782]: pgmap v4439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7396.912928 secs 2024-04-26T13:51:21.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7396.912928 secs 2024-04-26T13:51:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7396.912928 secs 2024-04-26T13:51:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:22 smithi193 ceph-mon[32782]: pgmap v4440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:22 smithi196 ceph-mon[32572]: pgmap v4440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:22 smithi110 ceph-mon[28069]: pgmap v4440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:24 smithi196 ceph-mon[32572]: pgmap v4441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:24 smithi110 ceph-mon[28069]: pgmap v4441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:24 smithi193 ceph-mon[32782]: pgmap v4441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:26 smithi196 ceph-mon[32572]: pgmap v4442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7401.913070 secs 2024-04-26T13:51:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:26 smithi110 ceph-mon[28069]: pgmap v4442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7401.913070 secs 2024-04-26T13:51:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:26 smithi193 ceph-mon[32782]: pgmap v4442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:51:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7401.913070 secs 2024-04-26T13:51:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:28 smithi196 ceph-mon[32572]: pgmap v4443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:51:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:28 smithi110 ceph-mon[28069]: pgmap v4443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:51:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:28 smithi193 ceph-mon[32782]: pgmap v4443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:51:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:30 smithi196 ceph-mon[32572]: pgmap v4444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:30 smithi110 ceph-mon[28069]: pgmap v4444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:30 smithi193 ceph-mon[32782]: pgmap v4444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:31 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7406.913196 secs 2024-04-26T13:51:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:31 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7406.913196 secs 2024-04-26T13:51:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:31 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7406.913196 secs 2024-04-26T13:51:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:32 smithi196 ceph-mon[32572]: pgmap v4445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:32 smithi110 ceph-mon[28069]: pgmap v4445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:32 smithi193 ceph-mon[32782]: pgmap v4445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:34 smithi196 ceph-mon[32572]: pgmap v4446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:34 smithi110 ceph-mon[28069]: pgmap v4446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:34 smithi193 ceph-mon[32782]: pgmap v4446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:36 smithi196 ceph-mon[32572]: pgmap v4447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:36 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7411.913315 secs 2024-04-26T13:51:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:36 smithi110 ceph-mon[28069]: pgmap v4447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:36 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7411.913315 secs 2024-04-26T13:51:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:36 smithi193 ceph-mon[32782]: pgmap v4447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:36 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7411.913315 secs 2024-04-26T13:51:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:38 smithi196 ceph-mon[32572]: pgmap v4448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:38 smithi110 ceph-mon[28069]: pgmap v4448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:38 smithi193 ceph-mon[32782]: pgmap v4448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:40 smithi196 ceph-mon[32572]: pgmap v4449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:40 smithi110 ceph-mon[28069]: pgmap v4449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:40 smithi193 ceph-mon[32782]: pgmap v4449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:41 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7416.913446 secs 2024-04-26T13:51:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:41 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7416.913446 secs 2024-04-26T13:51:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:41 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7416.913446 secs 2024-04-26T13:51:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:42 smithi196 ceph-mon[32572]: pgmap v4450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:42 smithi110 ceph-mon[28069]: pgmap v4450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:42 smithi193 ceph-mon[32782]: pgmap v4450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:44 smithi110 ceph-mon[28069]: pgmap v4451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:44 smithi193 ceph-mon[32782]: pgmap v4451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:44 smithi196 ceph-mon[32572]: pgmap v4451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:46 smithi110 ceph-mon[28069]: pgmap v4452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7421.913615 secs 2024-04-26T13:51:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:46 smithi193 ceph-mon[32782]: pgmap v4452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7421.913615 secs 2024-04-26T13:51:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:46 smithi196 ceph-mon[32572]: pgmap v4452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7421.913615 secs 2024-04-26T13:51:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:48 smithi110 ceph-mon[28069]: pgmap v4453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:48 smithi193 ceph-mon[32782]: pgmap v4453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:48 smithi196 ceph-mon[32572]: pgmap v4453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:50 smithi110 ceph-mon[28069]: pgmap v4454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:50 smithi193 ceph-mon[32782]: pgmap v4454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:51.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:50 smithi196 ceph-mon[32572]: pgmap v4454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7426.913712 secs 2024-04-26T13:51:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7426.913712 secs 2024-04-26T13:51:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7426.913712 secs 2024-04-26T13:51:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:52 smithi110 ceph-mon[28069]: pgmap v4455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:52 smithi193 ceph-mon[32782]: pgmap v4455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:53.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:52 smithi196 ceph-mon[32572]: pgmap v4455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:54 smithi110 ceph-mon[28069]: pgmap v4456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:54 smithi193 ceph-mon[32782]: pgmap v4456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:54 smithi196 ceph-mon[32572]: pgmap v4456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:56 smithi193 ceph-mon[32782]: pgmap v4457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7431.913836 secs 2024-04-26T13:51:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:56 smithi196 ceph-mon[32572]: pgmap v4457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7431.913836 secs 2024-04-26T13:51:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:56 smithi110 ceph-mon[28069]: pgmap v4457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:51:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7431.913836 secs 2024-04-26T13:51:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:51:58 smithi193 ceph-mon[32782]: pgmap v4458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:51:58 smithi196 ceph-mon[32572]: pgmap v4458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:51:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:51:58 smithi110 ceph-mon[28069]: pgmap v4458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:00 smithi193 ceph-mon[32782]: pgmap v4459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:00 smithi196 ceph-mon[32572]: pgmap v4459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:00 smithi110 ceph-mon[28069]: pgmap v4459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7436.913965 secs 2024-04-26T13:52:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7436.913965 secs 2024-04-26T13:52:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7436.913965 secs 2024-04-26T13:52:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:52:02.566+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:52:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:52:02.566+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:52:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:52:02.566+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 61 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:52:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:52:02.567+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 61 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:52:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:02 smithi193 ceph-mon[32782]: pgmap v4460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:02 smithi196 ceph-mon[32572]: pgmap v4460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:02 smithi110 ceph-mon[28069]: pgmap v4460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:04 smithi193 ceph-mon[32782]: pgmap v4461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:04 smithi196 ceph-mon[32572]: pgmap v4461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:04 smithi110 ceph-mon[28069]: pgmap v4461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:06 smithi193 ceph-mon[32782]: pgmap v4462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:06 smithi193 ceph-mon[32782]: 6 slow requests, 1 included below; oldest blocked for > 7441.914055 secs 2024-04-26T13:52:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:06 smithi193 ceph-mon[32782]: slow request 2883.741654 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:52:07.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:06 smithi196 ceph-mon[32572]: pgmap v4462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:06 smithi196 ceph-mon[32572]: 6 slow requests, 1 included below; oldest blocked for > 7441.914055 secs 2024-04-26T13:52:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:06 smithi196 ceph-mon[32572]: slow request 2883.741654 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:52:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:06 smithi110 ceph-mon[28069]: pgmap v4462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:06 smithi110 ceph-mon[28069]: 6 slow requests, 1 included below; oldest blocked for > 7441.914055 secs 2024-04-26T13:52:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:06 smithi110 ceph-mon[28069]: slow request 2883.741654 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T13:52:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:08 smithi193 ceph-mon[32782]: pgmap v4463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:08 smithi196 ceph-mon[32572]: pgmap v4463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:08 smithi110 ceph-mon[28069]: pgmap v4463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:10 smithi193 ceph-mon[32782]: pgmap v4464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:11.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:10 smithi196 ceph-mon[32572]: pgmap v4464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:10 smithi110 ceph-mon[28069]: pgmap v4464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7446.914173 secs 2024-04-26T13:52:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7446.914173 secs 2024-04-26T13:52:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7446.914173 secs 2024-04-26T13:52:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:12 smithi193 ceph-mon[32782]: pgmap v4465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:12 smithi196 ceph-mon[32572]: pgmap v4465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:12 smithi110 ceph-mon[28069]: pgmap v4465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:14 smithi193 ceph-mon[32782]: pgmap v4466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:14 smithi196 ceph-mon[32572]: pgmap v4466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:14 smithi110 ceph-mon[28069]: pgmap v4466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:16 smithi193 ceph-mon[32782]: pgmap v4467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7451.914317 secs 2024-04-26T13:52:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:16 smithi196 ceph-mon[32572]: pgmap v4467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7451.914317 secs 2024-04-26T13:52:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:16 smithi110 ceph-mon[28069]: pgmap v4467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7451.914317 secs 2024-04-26T13:52:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:18 smithi193 ceph-mon[32782]: pgmap v4468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:52:19.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:18 smithi196 ceph-mon[32572]: pgmap v4468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:52:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:18 smithi110 ceph-mon[28069]: pgmap v4468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:52:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:52:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:52:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:19 smithi193 ceph-mon[32782]: pgmap v4469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:52:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:19 smithi193 ceph-mon[32782]: pgmap v4470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:52:20.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:52:20.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:52:20.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:19 smithi110 ceph-mon[28069]: pgmap v4469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:52:20.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:19 smithi110 ceph-mon[28069]: pgmap v4470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:20.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:52:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:52:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:52:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:19 smithi196 ceph-mon[32572]: pgmap v4469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T13:52:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:19 smithi196 ceph-mon[32572]: pgmap v4470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:52:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:21 smithi196 ceph-mon[32572]: pgmap v4471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:21 smithi110 ceph-mon[28069]: pgmap v4471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:21 smithi193 ceph-mon[32782]: pgmap v4471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7456.914456 secs 2024-04-26T13:52:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7456.914456 secs 2024-04-26T13:52:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7456.914456 secs 2024-04-26T13:52:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:23 smithi196 ceph-mon[32572]: pgmap v4472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:23 smithi110 ceph-mon[28069]: pgmap v4472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:23 smithi193 ceph-mon[32782]: pgmap v4472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:25 smithi196 ceph-mon[32572]: pgmap v4473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:25 smithi110 ceph-mon[28069]: pgmap v4473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:25 smithi193 ceph-mon[32782]: pgmap v4473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T13:52:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7461.914600 secs 2024-04-26T13:52:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7461.914600 secs 2024-04-26T13:52:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7461.914600 secs 2024-04-26T13:52:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:27 smithi196 ceph-mon[32572]: pgmap v4474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:52:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:27 smithi110 ceph-mon[28069]: pgmap v4474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:52:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:27 smithi193 ceph-mon[32782]: pgmap v4474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T13:52:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:29 smithi196 ceph-mon[32572]: pgmap v4475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:52:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:29 smithi110 ceph-mon[28069]: pgmap v4475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:52:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:29 smithi193 ceph-mon[32782]: pgmap v4475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:52:31.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:31 smithi196 ceph-mon[32572]: pgmap v4476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:31 smithi110 ceph-mon[28069]: pgmap v4476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:31 smithi193 ceph-mon[32782]: pgmap v4476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7466.914720 secs 2024-04-26T13:52:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7466.914720 secs 2024-04-26T13:52:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7466.914720 secs 2024-04-26T13:52:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:33 smithi196 ceph-mon[32572]: pgmap v4477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:33 smithi110 ceph-mon[28069]: pgmap v4477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:33 smithi193 ceph-mon[32782]: pgmap v4477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:35 smithi196 ceph-mon[32572]: pgmap v4478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:35 smithi110 ceph-mon[28069]: pgmap v4478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:35.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:35 smithi193 ceph-mon[32782]: pgmap v4478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:36 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7471.914815 secs 2024-04-26T13:52:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:36 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7471.914815 secs 2024-04-26T13:52:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:36 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7471.914815 secs 2024-04-26T13:52:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:37 smithi193 ceph-mon[32782]: pgmap v4479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:37 smithi196 ceph-mon[32572]: pgmap v4479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:37 smithi110 ceph-mon[28069]: pgmap v4479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:39.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:39 smithi196 ceph-mon[32572]: pgmap v4480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:39 smithi110 ceph-mon[28069]: pgmap v4480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:39.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:39 smithi193 ceph-mon[32782]: pgmap v4480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:41 smithi196 ceph-mon[32572]: pgmap v4481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:41 smithi110 ceph-mon[28069]: pgmap v4481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:41 smithi193 ceph-mon[32782]: pgmap v4481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7476.914902 secs 2024-04-26T13:52:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7476.914902 secs 2024-04-26T13:52:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7476.914902 secs 2024-04-26T13:52:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:43 smithi196 ceph-mon[32572]: pgmap v4482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:43 smithi110 ceph-mon[28069]: pgmap v4482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:43 smithi193 ceph-mon[32782]: pgmap v4482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:45 smithi196 ceph-mon[32572]: pgmap v4483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:45 smithi110 ceph-mon[28069]: pgmap v4483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:45 smithi193 ceph-mon[32782]: pgmap v4483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7481.914982 secs 2024-04-26T13:52:46.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7481.914982 secs 2024-04-26T13:52:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7481.914982 secs 2024-04-26T13:52:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:47 smithi196 ceph-mon[32572]: pgmap v4484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:47 smithi110 ceph-mon[28069]: pgmap v4484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:47 smithi193 ceph-mon[32782]: pgmap v4484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:49 smithi196 ceph-mon[32572]: pgmap v4485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:49 smithi110 ceph-mon[28069]: pgmap v4485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:49.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:49 smithi193 ceph-mon[32782]: pgmap v4485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:51 smithi196 ceph-mon[32572]: pgmap v4486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:51 smithi110 ceph-mon[28069]: pgmap v4486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:51.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:51 smithi193 ceph-mon[32782]: pgmap v4486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7486.915079 secs 2024-04-26T13:52:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7486.915079 secs 2024-04-26T13:52:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7486.915079 secs 2024-04-26T13:52:53.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:53 smithi196 ceph-mon[32572]: pgmap v4487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:53 smithi110 ceph-mon[28069]: pgmap v4487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:53 smithi193 ceph-mon[32782]: pgmap v4487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:55 smithi196 ceph-mon[32572]: pgmap v4488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:55 smithi110 ceph-mon[28069]: pgmap v4488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:55.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:55 smithi193 ceph-mon[32782]: pgmap v4488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7491.915218 secs 2024-04-26T13:52:56.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7491.915218 secs 2024-04-26T13:52:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7491.915218 secs 2024-04-26T13:52:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:57 smithi196 ceph-mon[32572]: pgmap v4489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:57 smithi110 ceph-mon[28069]: pgmap v4489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:57 smithi193 ceph-mon[32782]: pgmap v4489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:52:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:52:59 smithi196 ceph-mon[32572]: pgmap v4490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:52:59 smithi110 ceph-mon[28069]: pgmap v4490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:52:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:52:59 smithi193 ceph-mon[32782]: pgmap v4490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:01.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:01 smithi196 ceph-mon[32572]: pgmap v4491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:01 smithi110 ceph-mon[28069]: pgmap v4491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:01 smithi193 ceph-mon[32782]: pgmap v4491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7496.915345 secs 2024-04-26T13:53:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7496.915345 secs 2024-04-26T13:53:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7496.915345 secs 2024-04-26T13:53:03.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:03 smithi196 ceph-mon[32572]: pgmap v4492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:03 smithi110 ceph-mon[28069]: pgmap v4492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:03 smithi193 ceph-mon[32782]: pgmap v4492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:05.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:05 smithi196 ceph-mon[32572]: pgmap v4493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:05 smithi110 ceph-mon[28069]: pgmap v4493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:05 smithi193 ceph-mon[32782]: pgmap v4493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7501.915457 secs 2024-04-26T13:53:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7501.915457 secs 2024-04-26T13:53:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7501.915457 secs 2024-04-26T13:53:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:07 smithi196 ceph-mon[32572]: pgmap v4494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:07 smithi110 ceph-mon[28069]: pgmap v4494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:07 smithi193 ceph-mon[32782]: pgmap v4494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:09 smithi196 ceph-mon[32572]: pgmap v4495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:09 smithi110 ceph-mon[28069]: pgmap v4495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:09 smithi193 ceph-mon[32782]: pgmap v4495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:11 smithi196 ceph-mon[32572]: pgmap v4496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:11 smithi110 ceph-mon[28069]: pgmap v4496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:11 smithi193 ceph-mon[32782]: pgmap v4496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7506.915567 secs 2024-04-26T13:53:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7506.915567 secs 2024-04-26T13:53:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7506.915567 secs 2024-04-26T13:53:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:13 smithi196 ceph-mon[32572]: pgmap v4497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:13 smithi110 ceph-mon[28069]: pgmap v4497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:13 smithi193 ceph-mon[32782]: pgmap v4497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:15 smithi196 ceph-mon[32572]: pgmap v4498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:15 smithi110 ceph-mon[28069]: pgmap v4498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:15 smithi193 ceph-mon[32782]: pgmap v4498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7511.915648 secs 2024-04-26T13:53:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7511.915648 secs 2024-04-26T13:53:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7511.915648 secs 2024-04-26T13:53:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:17 smithi196 ceph-mon[32572]: pgmap v4499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:17 smithi110 ceph-mon[28069]: pgmap v4499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:17 smithi193 ceph-mon[32782]: pgmap v4499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:19.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:19 smithi196 ceph-mon[32572]: pgmap v4500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:19 smithi110 ceph-mon[28069]: pgmap v4500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:19 smithi193 ceph-mon[32782]: pgmap v4500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:53:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:53:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:53:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:53:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:53:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:21 smithi196 ceph-mon[32572]: pgmap v4501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:53:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:21 smithi196 ceph-mon[32572]: pgmap v4502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:53:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:53:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:53:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:21 smithi110 ceph-mon[28069]: pgmap v4501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:53:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:21 smithi110 ceph-mon[28069]: pgmap v4502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:53:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:53:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:53:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:21 smithi193 ceph-mon[32782]: pgmap v4501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T13:53:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:21 smithi193 ceph-mon[32782]: pgmap v4502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:53:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7516.915764 secs 2024-04-26T13:53:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7516.915764 secs 2024-04-26T13:53:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7516.915764 secs 2024-04-26T13:53:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:23 smithi110 ceph-mon[28069]: pgmap v4503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:23 smithi193 ceph-mon[32782]: pgmap v4503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:23.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:23 smithi196 ceph-mon[32572]: pgmap v4503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:25 smithi110 ceph-mon[28069]: pgmap v4504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:25 smithi193 ceph-mon[32782]: pgmap v4504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:25 smithi196 ceph-mon[32572]: pgmap v4504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7521.915888 secs 2024-04-26T13:53:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7521.915888 secs 2024-04-26T13:53:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7521.915888 secs 2024-04-26T13:53:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:27 smithi110 ceph-mon[28069]: pgmap v4505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:27 smithi193 ceph-mon[32782]: pgmap v4505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:27 smithi196 ceph-mon[32572]: pgmap v4505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:29 smithi110 ceph-mon[28069]: pgmap v4506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:29 smithi193 ceph-mon[32782]: pgmap v4506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:30.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:29 smithi196 ceph-mon[32572]: pgmap v4506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:53:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:31 smithi110 ceph-mon[28069]: pgmap v4507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:53:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:31 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7526.916015 secs 2024-04-26T13:53:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:31 smithi193 ceph-mon[32782]: pgmap v4507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:53:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:31 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7526.916015 secs 2024-04-26T13:53:32.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:31 smithi196 ceph-mon[32572]: pgmap v4507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:53:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:31 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7526.916015 secs 2024-04-26T13:53:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:33 smithi110 ceph-mon[28069]: pgmap v4508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:33 smithi193 ceph-mon[32782]: pgmap v4508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:33 smithi196 ceph-mon[32572]: pgmap v4508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:35 smithi193 ceph-mon[32782]: pgmap v4509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:35 smithi196 ceph-mon[32572]: pgmap v4509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:35 smithi110 ceph-mon[28069]: pgmap v4509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:36 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7531.916138 secs 2024-04-26T13:53:37.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:36 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7531.916138 secs 2024-04-26T13:53:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:36 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7531.916138 secs 2024-04-26T13:53:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:37 smithi193 ceph-mon[32782]: pgmap v4510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:37 smithi196 ceph-mon[32572]: pgmap v4510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:37 smithi110 ceph-mon[28069]: pgmap v4510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:39 smithi193 ceph-mon[32782]: pgmap v4511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:39 smithi196 ceph-mon[32572]: pgmap v4511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:39 smithi110 ceph-mon[28069]: pgmap v4511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:41 smithi193 ceph-mon[32782]: pgmap v4512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:41 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7536.916269 secs 2024-04-26T13:53:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:41 smithi196 ceph-mon[32572]: pgmap v4512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:41 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7536.916269 secs 2024-04-26T13:53:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:41 smithi110 ceph-mon[28069]: pgmap v4512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:41 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7536.916269 secs 2024-04-26T13:53:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:43 smithi193 ceph-mon[32782]: pgmap v4513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:43 smithi196 ceph-mon[32572]: pgmap v4513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:43 smithi110 ceph-mon[28069]: pgmap v4513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:45 smithi193 ceph-mon[32782]: pgmap v4514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:45 smithi196 ceph-mon[32572]: pgmap v4514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:45 smithi110 ceph-mon[28069]: pgmap v4514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7541.916413 secs 2024-04-26T13:53:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7541.916413 secs 2024-04-26T13:53:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7541.916413 secs 2024-04-26T13:53:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:47 smithi193 ceph-mon[32782]: pgmap v4515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:47 smithi196 ceph-mon[32572]: pgmap v4515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:47 smithi110 ceph-mon[28069]: pgmap v4515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:49 smithi193 ceph-mon[32782]: pgmap v4516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:50.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:49 smithi196 ceph-mon[32572]: pgmap v4516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:49 smithi110 ceph-mon[28069]: pgmap v4516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:51 smithi193 ceph-mon[32782]: pgmap v4517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7546.916545 secs 2024-04-26T13:53:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:51 smithi196 ceph-mon[32572]: pgmap v4517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7546.916545 secs 2024-04-26T13:53:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:51 smithi110 ceph-mon[28069]: pgmap v4517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7546.916545 secs 2024-04-26T13:53:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:53 smithi193 ceph-mon[32782]: pgmap v4518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:54.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:53 smithi196 ceph-mon[32572]: pgmap v4518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:53 smithi110 ceph-mon[28069]: pgmap v4518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:53:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:55 smithi193 ceph-mon[32782]: pgmap v4519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:56.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:55 smithi196 ceph-mon[32572]: pgmap v4519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:55 smithi110 ceph-mon[28069]: pgmap v4519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7551.916681 secs 2024-04-26T13:53:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7551.916681 secs 2024-04-26T13:53:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7551.916681 secs 2024-04-26T13:53:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:57 smithi193 ceph-mon[32782]: pgmap v4520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:57 smithi196 ceph-mon[32572]: pgmap v4520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:53:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:57 smithi110 ceph-mon[28069]: pgmap v4520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:53:59 smithi196 ceph-mon[32572]: pgmap v4521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:53:59 smithi110 ceph-mon[28069]: pgmap v4521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:53:59 smithi193 ceph-mon[32782]: pgmap v4521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:01 smithi196 ceph-mon[32572]: pgmap v4522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7556.916813 secs 2024-04-26T13:54:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:01 smithi110 ceph-mon[28069]: pgmap v4522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7556.916813 secs 2024-04-26T13:54:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:01 smithi193 ceph-mon[32782]: pgmap v4522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7556.916813 secs 2024-04-26T13:54:04.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:03 smithi196 ceph-mon[32572]: pgmap v4523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:03 smithi110 ceph-mon[28069]: pgmap v4523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:04.290 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:54:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:54:03.896+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:54:04.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:54:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:54:03.896+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:54:04.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:54:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:54:03.896+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:54:04.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:54:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:54:03.896+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:54:04.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:54:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:54:03.896+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:54:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:03 smithi193 ceph-mon[32782]: pgmap v4523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:05 smithi196 ceph-mon[32572]: pgmap v4524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:05 smithi110 ceph-mon[28069]: pgmap v4524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:05 smithi193 ceph-mon[32782]: pgmap v4524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7561.916940 secs 2024-04-26T13:54:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7561.916940 secs 2024-04-26T13:54:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7561.916940 secs 2024-04-26T13:54:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:07 smithi196 ceph-mon[32572]: pgmap v4525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:07 smithi110 ceph-mon[28069]: pgmap v4525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:07 smithi193 ceph-mon[32782]: pgmap v4525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:09 smithi196 ceph-mon[32572]: pgmap v4526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:54:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:09 smithi110 ceph-mon[28069]: pgmap v4526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:54:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:09 smithi193 ceph-mon[32782]: pgmap v4526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:54:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:11 smithi196 ceph-mon[32572]: pgmap v4527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:54:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7566.917048 secs 2024-04-26T13:54:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:11 smithi110 ceph-mon[28069]: pgmap v4527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:54:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7566.917048 secs 2024-04-26T13:54:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:11 smithi193 ceph-mon[32782]: pgmap v4527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:54:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7566.917048 secs 2024-04-26T13:54:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:13 smithi196 ceph-mon[32572]: pgmap v4528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:54:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:13 smithi110 ceph-mon[28069]: pgmap v4528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:54:14.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:13 smithi193 ceph-mon[32782]: pgmap v4528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:54:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:15 smithi196 ceph-mon[32572]: pgmap v4529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:54:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:15 smithi110 ceph-mon[28069]: pgmap v4529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:54:16.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:15 smithi193 ceph-mon[32782]: pgmap v4529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:54:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7571.917175 secs 2024-04-26T13:54:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7571.917175 secs 2024-04-26T13:54:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7571.917175 secs 2024-04-26T13:54:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:54:17.587+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:54:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:54:17.587+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:54:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:54:17.588+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 62 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:54:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:54:17.588+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 62 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:54:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:17 smithi196 ceph-mon[32572]: pgmap v4530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:54:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:17 smithi110 ceph-mon[28069]: pgmap v4530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:54:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:17 smithi193 ceph-mon[32782]: pgmap v4530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T13:54:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:19 smithi196 ceph-mon[32572]: pgmap v4531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:54:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:19 smithi110 ceph-mon[28069]: pgmap v4531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:54:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:19 smithi193 ceph-mon[32782]: pgmap v4531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T13:54:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:21 smithi196 ceph-mon[32572]: pgmap v4532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:54:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7576.917272 secs 2024-04-26T13:54:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:54:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:54:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:21 smithi110 ceph-mon[28069]: pgmap v4532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:54:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7576.917272 secs 2024-04-26T13:54:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:54:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:54:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:21 smithi193 ceph-mon[32782]: pgmap v4532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:54:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7576.917272 secs 2024-04-26T13:54:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:54:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:54:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:23 smithi196 ceph-mon[32572]: pgmap v4533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:54:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:54:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:23 smithi196 ceph-mon[32572]: pgmap v4534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 995 B/s rd, 1 op/s 2024-04-26T13:54:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:23 smithi196 ceph-mon[32572]: pgmap v4535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:54:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:23 smithi110 ceph-mon[28069]: pgmap v4533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:54:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:54:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:23 smithi110 ceph-mon[28069]: pgmap v4534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 995 B/s rd, 1 op/s 2024-04-26T13:54:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:23 smithi110 ceph-mon[28069]: pgmap v4535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:54:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:23 smithi193 ceph-mon[32782]: pgmap v4533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:54:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:54:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:23 smithi193 ceph-mon[32782]: pgmap v4534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 995 B/s rd, 1 op/s 2024-04-26T13:54:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:23 smithi193 ceph-mon[32782]: pgmap v4535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:54:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:26 smithi193 ceph-mon[32782]: pgmap v4536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:26.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:26 smithi196 ceph-mon[32572]: pgmap v4536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:26 smithi110 ceph-mon[28069]: pgmap v4536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7581.917401 secs 2024-04-26T13:54:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7581.917401 secs 2024-04-26T13:54:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7581.917401 secs 2024-04-26T13:54:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:28 smithi193 ceph-mon[32782]: pgmap v4537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T13:54:28.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:28 smithi196 ceph-mon[32572]: pgmap v4537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T13:54:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:28 smithi110 ceph-mon[28069]: pgmap v4537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T13:54:30.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:30 smithi193 ceph-mon[32782]: pgmap v4538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:30 smithi196 ceph-mon[32572]: pgmap v4538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:30 smithi110 ceph-mon[28069]: pgmap v4538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:32 smithi193 ceph-mon[32782]: pgmap v4539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T13:54:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7586.917539 secs 2024-04-26T13:54:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:32 smithi196 ceph-mon[32572]: pgmap v4539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T13:54:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7586.917539 secs 2024-04-26T13:54:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:32 smithi110 ceph-mon[28069]: pgmap v4539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T13:54:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7586.917539 secs 2024-04-26T13:54:34.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:34 smithi193 ceph-mon[32782]: pgmap v4540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:54:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:34 smithi196 ceph-mon[32572]: pgmap v4540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:54:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:34 smithi110 ceph-mon[28069]: pgmap v4540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:54:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:36 smithi193 ceph-mon[32782]: pgmap v4541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:36 smithi196 ceph-mon[32572]: pgmap v4541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:36 smithi110 ceph-mon[28069]: pgmap v4541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7591.917675 secs 2024-04-26T13:54:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7591.917675 secs 2024-04-26T13:54:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7591.917675 secs 2024-04-26T13:54:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:38 smithi193 ceph-mon[32782]: pgmap v4542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:38 smithi196 ceph-mon[32572]: pgmap v4542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:38 smithi110 ceph-mon[28069]: pgmap v4542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:40 smithi196 ceph-mon[32572]: pgmap v4543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:40 smithi110 ceph-mon[28069]: pgmap v4543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:40 smithi193 ceph-mon[32782]: pgmap v4543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:42 smithi196 ceph-mon[32572]: pgmap v4544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7596.917780 secs 2024-04-26T13:54:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:42 smithi110 ceph-mon[28069]: pgmap v4544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7596.917780 secs 2024-04-26T13:54:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:42 smithi193 ceph-mon[32782]: pgmap v4544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7596.917780 secs 2024-04-26T13:54:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:44 smithi196 ceph-mon[32572]: pgmap v4545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:44 smithi110 ceph-mon[28069]: pgmap v4545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:44 smithi193 ceph-mon[32782]: pgmap v4545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:46 smithi196 ceph-mon[32572]: pgmap v4546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:46 smithi110 ceph-mon[28069]: pgmap v4546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:46 smithi193 ceph-mon[32782]: pgmap v4546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7601.917913 secs 2024-04-26T13:54:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7601.917913 secs 2024-04-26T13:54:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7601.917913 secs 2024-04-26T13:54:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:48 smithi196 ceph-mon[32572]: pgmap v4547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:48 smithi110 ceph-mon[28069]: pgmap v4547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:48 smithi193 ceph-mon[32782]: pgmap v4547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:50.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:50 smithi196 ceph-mon[32572]: pgmap v4548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:50 smithi110 ceph-mon[28069]: pgmap v4548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:50 smithi193 ceph-mon[32782]: pgmap v4548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:52 smithi196 ceph-mon[32572]: pgmap v4549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7606.918071 secs 2024-04-26T13:54:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:52 smithi110 ceph-mon[28069]: pgmap v4549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7606.918071 secs 2024-04-26T13:54:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:52 smithi193 ceph-mon[32782]: pgmap v4549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7606.918071 secs 2024-04-26T13:54:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:54 smithi196 ceph-mon[32572]: pgmap v4550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:54 smithi110 ceph-mon[28069]: pgmap v4550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:54 smithi193 ceph-mon[32782]: pgmap v4550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:54:56.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:56 smithi196 ceph-mon[32572]: pgmap v4551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:56 smithi110 ceph-mon[28069]: pgmap v4551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:56 smithi193 ceph-mon[32782]: pgmap v4551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7611.918202 secs 2024-04-26T13:54:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7611.918202 secs 2024-04-26T13:54:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7611.918202 secs 2024-04-26T13:54:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:54:58 smithi196 ceph-mon[32572]: pgmap v4552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:54:58 smithi110 ceph-mon[28069]: pgmap v4552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:54:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:54:58 smithi193 ceph-mon[32782]: pgmap v4552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:00 smithi196 ceph-mon[32572]: pgmap v4553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:00 smithi110 ceph-mon[28069]: pgmap v4553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:00 smithi193 ceph-mon[32782]: pgmap v4553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:02 smithi196 ceph-mon[32572]: pgmap v4554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7616.918337 secs 2024-04-26T13:55:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:02 smithi110 ceph-mon[28069]: pgmap v4554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7616.918337 secs 2024-04-26T13:55:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:02 smithi193 ceph-mon[32782]: pgmap v4554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7616.918337 secs 2024-04-26T13:55:04.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:04 smithi196 ceph-mon[32572]: pgmap v4555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:55:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:04 smithi110 ceph-mon[28069]: pgmap v4555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:55:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:04 smithi193 ceph-mon[32782]: pgmap v4555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:55:05.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:05 smithi196 ceph-mon[32572]: pgmap v4556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:55:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:05 smithi110 ceph-mon[28069]: pgmap v4556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:55:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:05 smithi193 ceph-mon[32782]: pgmap v4556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:55:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7621.918411 secs 2024-04-26T13:55:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7621.918411 secs 2024-04-26T13:55:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7621.918411 secs 2024-04-26T13:55:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:07 smithi196 ceph-mon[32572]: pgmap v4557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:55:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:07 smithi110 ceph-mon[28069]: pgmap v4557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:55:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:07 smithi193 ceph-mon[32782]: pgmap v4557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:55:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:10 smithi193 ceph-mon[32782]: pgmap v4558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:55:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:10 smithi196 ceph-mon[32572]: pgmap v4558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:55:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:10 smithi110 ceph-mon[28069]: pgmap v4558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:55:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:12 smithi193 ceph-mon[32782]: pgmap v4559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:55:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7626.918540 secs 2024-04-26T13:55:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:12 smithi196 ceph-mon[32572]: pgmap v4559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:55:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7626.918540 secs 2024-04-26T13:55:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:12 smithi110 ceph-mon[28069]: pgmap v4559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T13:55:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7626.918540 secs 2024-04-26T13:55:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:14 smithi193 ceph-mon[32782]: pgmap v4560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:55:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:14 smithi196 ceph-mon[32572]: pgmap v4560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:55:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:14 smithi110 ceph-mon[28069]: pgmap v4560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T13:55:16.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:16 smithi193 ceph-mon[32782]: pgmap v4561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:16.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:16 smithi196 ceph-mon[32572]: pgmap v4561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:16 smithi110 ceph-mon[28069]: pgmap v4561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7631.918624 secs 2024-04-26T13:55:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7631.918624 secs 2024-04-26T13:55:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7631.918624 secs 2024-04-26T13:55:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:18 smithi196 ceph-mon[32572]: pgmap v4562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:18 smithi110 ceph-mon[28069]: pgmap v4562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:18 smithi193 ceph-mon[32782]: pgmap v4562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:20 smithi196 ceph-mon[32572]: pgmap v4563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:20 smithi110 ceph-mon[28069]: pgmap v4563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:20 smithi193 ceph-mon[32782]: pgmap v4563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:22 smithi196 ceph-mon[32572]: pgmap v4564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7636.918718 secs 2024-04-26T13:55:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:22 smithi110 ceph-mon[28069]: pgmap v4564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7636.918718 secs 2024-04-26T13:55:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:22 smithi193 ceph-mon[32782]: pgmap v4564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7636.918718 secs 2024-04-26T13:55:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:24 smithi196 ceph-mon[32572]: pgmap v4565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:55:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:24 smithi110 ceph-mon[28069]: pgmap v4565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:55:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:24 smithi193 ceph-mon[32782]: pgmap v4565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:55:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:25.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:55:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:55:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:55:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:55:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:55:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:55:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:55:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:26 smithi196 ceph-mon[32572]: pgmap v4566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:55:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:26 smithi196 ceph-mon[32572]: pgmap v4567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:26 smithi110 ceph-mon[28069]: pgmap v4566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:55:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:26 smithi110 ceph-mon[28069]: pgmap v4567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:26 smithi193 ceph-mon[32782]: pgmap v4566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T13:55:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:26 smithi193 ceph-mon[32782]: pgmap v4567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:27.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7641.918791 secs 2024-04-26T13:55:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7641.918791 secs 2024-04-26T13:55:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7641.918791 secs 2024-04-26T13:55:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:28 smithi196 ceph-mon[32572]: pgmap v4568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:28 smithi110 ceph-mon[28069]: pgmap v4568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:28 smithi193 ceph-mon[32782]: pgmap v4568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:30 smithi196 ceph-mon[32572]: pgmap v4569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:30 smithi110 ceph-mon[28069]: pgmap v4569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:30 smithi193 ceph-mon[32782]: pgmap v4569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:32 smithi196 ceph-mon[32572]: pgmap v4570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7646.918888 secs 2024-04-26T13:55:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:32 smithi110 ceph-mon[28069]: pgmap v4570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7646.918888 secs 2024-04-26T13:55:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:32 smithi193 ceph-mon[32782]: pgmap v4570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7646.918888 secs 2024-04-26T13:55:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:34 smithi196 ceph-mon[32572]: pgmap v4571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:34 smithi110 ceph-mon[28069]: pgmap v4571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:34 smithi193 ceph-mon[32782]: pgmap v4571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:55:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:36 smithi196 ceph-mon[32572]: pgmap v4572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:55:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:36 smithi110 ceph-mon[28069]: pgmap v4572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:55:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:36 smithi193 ceph-mon[32782]: pgmap v4572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:55:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7651.918954 secs 2024-04-26T13:55:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7651.918954 secs 2024-04-26T13:55:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7651.918954 secs 2024-04-26T13:55:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:38 smithi196 ceph-mon[32572]: pgmap v4573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:38 smithi110 ceph-mon[28069]: pgmap v4573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:38 smithi193 ceph-mon[32782]: pgmap v4573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:40 smithi196 ceph-mon[32572]: pgmap v4574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:40 smithi110 ceph-mon[28069]: pgmap v4574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:40 smithi193 ceph-mon[32782]: pgmap v4574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:41 smithi196 ceph-mon[32572]: pgmap v4575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:41 smithi110 ceph-mon[28069]: pgmap v4575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:41 smithi193 ceph-mon[32782]: pgmap v4575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7656.919015 secs 2024-04-26T13:55:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7656.919015 secs 2024-04-26T13:55:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7656.919015 secs 2024-04-26T13:55:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:43 smithi196 ceph-mon[32572]: pgmap v4576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:43 smithi110 ceph-mon[28069]: pgmap v4576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:43 smithi193 ceph-mon[32782]: pgmap v4576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:45 smithi196 ceph-mon[32572]: pgmap v4577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:45 smithi110 ceph-mon[28069]: pgmap v4577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:45 smithi193 ceph-mon[32782]: pgmap v4577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7661.919147 secs 2024-04-26T13:55:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7661.919147 secs 2024-04-26T13:55:47.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7661.919147 secs 2024-04-26T13:55:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:47 smithi110 ceph-mon[28069]: pgmap v4578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:47 smithi193 ceph-mon[32782]: pgmap v4578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:47 smithi196 ceph-mon[32572]: pgmap v4578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:55:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:49 smithi110 ceph-mon[28069]: pgmap v4579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:49 smithi193 ceph-mon[32782]: pgmap v4579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:50.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:49 smithi196 ceph-mon[32572]: pgmap v4579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:51 smithi110 ceph-mon[28069]: pgmap v4580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:55:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7666.919220 secs 2024-04-26T13:55:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:51 smithi193 ceph-mon[32782]: pgmap v4580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:55:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7666.919220 secs 2024-04-26T13:55:52.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:51 smithi196 ceph-mon[32572]: pgmap v4580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:55:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7666.919220 secs 2024-04-26T13:55:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:53 smithi110 ceph-mon[28069]: pgmap v4581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:53 smithi193 ceph-mon[32782]: pgmap v4581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:54.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:53 smithi196 ceph-mon[32572]: pgmap v4581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:55:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:55 smithi110 ceph-mon[28069]: pgmap v4582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:55:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:55 smithi193 ceph-mon[32782]: pgmap v4582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:55:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:55 smithi196 ceph-mon[32572]: pgmap v4582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:55:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7671.919365 secs 2024-04-26T13:55:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7671.919365 secs 2024-04-26T13:55:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7671.919365 secs 2024-04-26T13:55:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:57 smithi193 ceph-mon[32782]: pgmap v4583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:55:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:57 smithi196 ceph-mon[32572]: pgmap v4583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:55:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:57 smithi110 ceph-mon[28069]: pgmap v4583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T13:56:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:55:59 smithi193 ceph-mon[32782]: pgmap v4584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:55:59 smithi196 ceph-mon[32572]: pgmap v4584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:55:59 smithi110 ceph-mon[28069]: pgmap v4584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:01 smithi193 ceph-mon[32782]: pgmap v4585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7676.919495 secs 2024-04-26T13:56:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:01 smithi196 ceph-mon[32572]: pgmap v4585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7676.919495 secs 2024-04-26T13:56:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:01 smithi110 ceph-mon[28069]: pgmap v4585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7676.919495 secs 2024-04-26T13:56:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:03 smithi193 ceph-mon[32782]: pgmap v4586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:03 smithi196 ceph-mon[32572]: pgmap v4586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:03 smithi110 ceph-mon[28069]: pgmap v4586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:05 smithi193 ceph-mon[32782]: pgmap v4587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:05 smithi196 ceph-mon[32572]: pgmap v4587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:05 smithi110 ceph-mon[28069]: pgmap v4587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:06 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7681.919626 secs 2024-04-26T13:56:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:06 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7681.919626 secs 2024-04-26T13:56:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:06 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7681.919626 secs 2024-04-26T13:56:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:07 smithi193 ceph-mon[32782]: pgmap v4588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:07 smithi196 ceph-mon[32572]: pgmap v4588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:07 smithi110 ceph-mon[28069]: pgmap v4588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:09 smithi193 ceph-mon[32782]: pgmap v4589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:10.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:09 smithi196 ceph-mon[32572]: pgmap v4589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:09 smithi110 ceph-mon[28069]: pgmap v4589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:11 smithi193 ceph-mon[32782]: pgmap v4590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:11 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7686.919726 secs 2024-04-26T13:56:12.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:11 smithi196 ceph-mon[32572]: pgmap v4590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:11 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7686.919726 secs 2024-04-26T13:56:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:11 smithi110 ceph-mon[28069]: pgmap v4590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:11 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7686.919726 secs 2024-04-26T13:56:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:13 smithi193 ceph-mon[32782]: pgmap v4591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:13 smithi196 ceph-mon[32572]: pgmap v4591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:13 smithi110 ceph-mon[28069]: pgmap v4591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:15 smithi193 ceph-mon[32782]: pgmap v4592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:15 smithi196 ceph-mon[32572]: pgmap v4592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:15 smithi110 ceph-mon[28069]: pgmap v4592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:16 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7691.919852 secs 2024-04-26T13:56:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:16 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7691.919852 secs 2024-04-26T13:56:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:16 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7691.919852 secs 2024-04-26T13:56:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:17 smithi193 ceph-mon[32782]: pgmap v4593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:17 smithi196 ceph-mon[32572]: pgmap v4593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:17 smithi110 ceph-mon[28069]: pgmap v4593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:19 smithi193 ceph-mon[32782]: pgmap v4594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:19 smithi196 ceph-mon[32572]: pgmap v4594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:19 smithi110 ceph-mon[28069]: pgmap v4594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:21 smithi196 ceph-mon[32572]: pgmap v4595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:21 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7696.919918 secs 2024-04-26T13:56:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:21 smithi110 ceph-mon[28069]: pgmap v4595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:21 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7696.919918 secs 2024-04-26T13:56:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:21 smithi193 ceph-mon[32782]: pgmap v4595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:21 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7696.919918 secs 2024-04-26T13:56:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:23 smithi196 ceph-mon[32572]: pgmap v4596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:23 smithi110 ceph-mon[28069]: pgmap v4596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:23 smithi193 ceph-mon[32782]: pgmap v4596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:26.031 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:25 smithi193 ceph-mon[32782]: pgmap v4597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:26.031 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:56:26.220 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:25 smithi110 ceph-mon[28069]: pgmap v4597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:26.221 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:56:26.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:25 smithi196 ceph-mon[32572]: pgmap v4597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:26.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:56:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:26 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7701.919981 secs 2024-04-26T13:56:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:26 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7701.919981 secs 2024-04-26T13:56:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:26 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7701.919981 secs 2024-04-26T13:56:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:28 smithi110 ceph-mon[28069]: pgmap v4598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.331 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:28 smithi193 ceph-mon[32782]: pgmap v4598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:28.332 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.332 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.332 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.332 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:28 smithi196 ceph-mon[32572]: pgmap v4598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:29 smithi196 ceph-mon[32572]: pgmap v4599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:29 smithi110 ceph-mon[28069]: pgmap v4599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:29 smithi193 ceph-mon[32782]: pgmap v4599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: pgmap v4600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7706.920046 secs 2024-04-26T13:56:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: pgmap v4600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7706.920046 secs 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.530 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.531 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: pgmap v4600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7706.920046 secs 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:33 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:56:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:33 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:56:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:33 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:56:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:33 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:56:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:33 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:56:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:33 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:56:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:33 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:56:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:33 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:56:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:33 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T13:56:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:33 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T13:56:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:33 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T13:56:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:33 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T13:56:34.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:34 smithi196 ceph-mon[32572]: pgmap v4601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:34.516 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:34 smithi110 ceph-mon[28069]: pgmap v4601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:34 smithi193 ceph-mon[32782]: pgmap v4601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:35 smithi196 ceph-mon[32572]: pgmap v4602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:35 smithi110 ceph-mon[28069]: pgmap v4602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:35.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:35 smithi193 ceph-mon[32782]: pgmap v4602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:56:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:56:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:56:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:56:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: pgmap v4603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 959 B/s rd, 1 op/s 2024-04-26T13:56:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: pgmap v4604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:56:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:56:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:56:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:56:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: pgmap v4603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 959 B/s rd, 1 op/s 2024-04-26T13:56:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: pgmap v4604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T13:56:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:56:36.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:56:36.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: pgmap v4603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 959 B/s rd, 1 op/s 2024-04-26T13:56:36.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: pgmap v4604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:36.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:56:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7711.920169 secs 2024-04-26T13:56:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7711.920169 secs 2024-04-26T13:56:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7711.920169 secs 2024-04-26T13:56:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:38 smithi193 ceph-mon[32782]: pgmap v4605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T13:56:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:38 smithi196 ceph-mon[32572]: pgmap v4605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T13:56:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:38 smithi110 ceph-mon[28069]: pgmap v4605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T13:56:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:40 smithi196 ceph-mon[32572]: pgmap v4606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:40 smithi110 ceph-mon[28069]: pgmap v4606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:40 smithi193 ceph-mon[32782]: pgmap v4606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:41 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7716.920284 secs 2024-04-26T13:56:41.777 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:41 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7716.920284 secs 2024-04-26T13:56:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:41 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7716.920284 secs 2024-04-26T13:56:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:42 smithi196 ceph-mon[32572]: pgmap v4607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 590 B/s rd, 1 op/s 2024-04-26T13:56:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:42 smithi110 ceph-mon[28069]: pgmap v4607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 590 B/s rd, 1 op/s 2024-04-26T13:56:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:42 smithi193 ceph-mon[32782]: pgmap v4607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 590 B/s rd, 1 op/s 2024-04-26T13:56:44.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:44 smithi196 ceph-mon[32572]: pgmap v4608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:44 smithi110 ceph-mon[28069]: pgmap v4608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:44 smithi193 ceph-mon[32782]: pgmap v4608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:46 smithi196 ceph-mon[32572]: pgmap v4609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:56:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:46 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7721.920425 secs 2024-04-26T13:56:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:46 smithi110 ceph-mon[28069]: pgmap v4609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:56:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:46 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7721.920425 secs 2024-04-26T13:56:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:46 smithi193 ceph-mon[32782]: pgmap v4609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:56:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:46 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7721.920425 secs 2024-04-26T13:56:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:48 smithi196 ceph-mon[32572]: pgmap v4610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T13:56:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:48 smithi110 ceph-mon[28069]: pgmap v4610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T13:56:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:48 smithi193 ceph-mon[32782]: pgmap v4610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T13:56:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:50 smithi196 ceph-mon[32572]: pgmap v4611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:50 smithi110 ceph-mon[28069]: pgmap v4611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:50 smithi193 ceph-mon[32782]: pgmap v4611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:51 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7726.920544 secs 2024-04-26T13:56:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:51 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7726.920544 secs 2024-04-26T13:56:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:51 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7726.920544 secs 2024-04-26T13:56:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:52 smithi196 ceph-mon[32572]: pgmap v4612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:52 smithi110 ceph-mon[28069]: pgmap v4612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:52 smithi193 ceph-mon[32782]: pgmap v4612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:54 smithi196 ceph-mon[32572]: pgmap v4613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:54 smithi110 ceph-mon[28069]: pgmap v4613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:54 smithi193 ceph-mon[32782]: pgmap v4613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:56 smithi110 ceph-mon[28069]: pgmap v4614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:56 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7731.920661 secs 2024-04-26T13:56:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:56 smithi196 ceph-mon[32572]: pgmap v4614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:56 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7731.920661 secs 2024-04-26T13:56:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:56 smithi193 ceph-mon[32782]: pgmap v4614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:56:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:56 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7731.920661 secs 2024-04-26T13:56:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:56:58 smithi110 ceph-mon[28069]: pgmap v4615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:56:58 smithi193 ceph-mon[32782]: pgmap v4615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:56:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:56:58 smithi196 ceph-mon[32572]: pgmap v4615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:00 smithi110 ceph-mon[28069]: pgmap v4616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:00 smithi193 ceph-mon[32782]: pgmap v4616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:00 smithi196 ceph-mon[32572]: pgmap v4616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:01.786 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:01 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 7736.920781 secs 2024-04-26T13:57:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:01 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 7736.920781 secs 2024-04-26T13:57:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:01 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 7736.920781 secs 2024-04-26T13:57:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:02 smithi110 ceph-mon[28069]: pgmap v4617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:02 smithi193 ceph-mon[32782]: pgmap v4617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:02 smithi196 ceph-mon[32572]: pgmap v4617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:04 smithi110 ceph-mon[28069]: pgmap v4618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:04 smithi193 ceph-mon[32782]: pgmap v4618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:04 smithi196 ceph-mon[32572]: pgmap v4618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:06 smithi110 ceph-mon[28069]: pgmap v4619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:06 smithi110 ceph-mon[28069]: 7 slow requests, 1 included below; oldest blocked for > 7741.920917 secs 2024-04-26T13:57:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:06 smithi110 ceph-mon[28069]: slow request 182.314487 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T13:57:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:06 smithi193 ceph-mon[32782]: pgmap v4619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:06 smithi193 ceph-mon[32782]: 7 slow requests, 1 included below; oldest blocked for > 7741.920917 secs 2024-04-26T13:57:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:06 smithi193 ceph-mon[32782]: slow request 182.314487 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T13:57:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:06 smithi196 ceph-mon[32572]: pgmap v4619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:06 smithi196 ceph-mon[32572]: 7 slow requests, 1 included below; oldest blocked for > 7741.920917 secs 2024-04-26T13:57:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:06 smithi196 ceph-mon[32572]: slow request 182.314487 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T13:57:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:08 smithi193 ceph-mon[32782]: pgmap v4620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:08 smithi196 ceph-mon[32572]: pgmap v4620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:08 smithi110 ceph-mon[28069]: pgmap v4620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T13:57:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:09 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T13:57:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T13:57:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:09 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T13:57:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T13:57:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:09 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T13:57:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:10 smithi193 ceph-mon[32782]: pgmap v4621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:11.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:10 smithi196 ceph-mon[32572]: pgmap v4621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:10 smithi110 ceph-mon[28069]: pgmap v4621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:11 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7746.921030 secs 2024-04-26T13:57:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:11 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7746.921030 secs 2024-04-26T13:57:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:11 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7746.921030 secs 2024-04-26T13:57:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:12 smithi193 ceph-mon[32782]: pgmap v4622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:12.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:12 smithi196 ceph-mon[32572]: pgmap v4622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:12 smithi110 ceph-mon[28069]: pgmap v4622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:14 smithi193 ceph-mon[32782]: pgmap v4623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:14 smithi196 ceph-mon[32572]: pgmap v4623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:14 smithi110 ceph-mon[28069]: pgmap v4623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:16 smithi193 ceph-mon[32782]: pgmap v4624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:16 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7751.921147 secs 2024-04-26T13:57:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:16 smithi196 ceph-mon[32572]: pgmap v4624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:16 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7751.921147 secs 2024-04-26T13:57:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:16 smithi110 ceph-mon[28069]: pgmap v4624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:16 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7751.921147 secs 2024-04-26T13:57:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:57:17.617+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T13:57:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:57:17.617+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T13:57:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:57:17.618+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 63 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T13:57:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T13:57:17.618+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 63 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T13:57:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:18 smithi193 ceph-mon[32782]: pgmap v4625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:19.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:18 smithi196 ceph-mon[32572]: pgmap v4625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:18 smithi110 ceph-mon[28069]: pgmap v4625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:20 smithi193 ceph-mon[32782]: pgmap v4626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:20 smithi196 ceph-mon[32572]: pgmap v4626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:20 smithi110 ceph-mon[28069]: pgmap v4626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:21 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7756.921212 secs 2024-04-26T13:57:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:21 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7756.921212 secs 2024-04-26T13:57:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:21 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7756.921212 secs 2024-04-26T13:57:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:22 smithi193 ceph-mon[32782]: pgmap v4627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:22 smithi196 ceph-mon[32572]: pgmap v4627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:22 smithi110 ceph-mon[28069]: pgmap v4627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:24 smithi193 ceph-mon[32782]: pgmap v4628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:24 smithi196 ceph-mon[32572]: pgmap v4628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:24 smithi110 ceph-mon[28069]: pgmap v4628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:26 smithi196 ceph-mon[32572]: pgmap v4629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:26 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7761.921332 secs 2024-04-26T13:57:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:26 smithi110 ceph-mon[28069]: pgmap v4629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:26 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7761.921332 secs 2024-04-26T13:57:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:26 smithi193 ceph-mon[32782]: pgmap v4629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:26 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7761.921332 secs 2024-04-26T13:57:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:28 smithi110 ceph-mon[28069]: pgmap v4630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:28 smithi193 ceph-mon[32782]: pgmap v4630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:28 smithi196 ceph-mon[32572]: pgmap v4630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:30 smithi110 ceph-mon[28069]: pgmap v4631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:30 smithi193 ceph-mon[32782]: pgmap v4631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:30 smithi196 ceph-mon[32572]: pgmap v4631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T13:57:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:31 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7766.921477 secs 2024-04-26T13:57:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:31 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7766.921477 secs 2024-04-26T13:57:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:31 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7766.921477 secs 2024-04-26T13:57:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:32 smithi110 ceph-mon[28069]: pgmap v4632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:32 smithi193 ceph-mon[32782]: pgmap v4632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:33.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:32 smithi196 ceph-mon[32572]: pgmap v4632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:34 smithi110 ceph-mon[28069]: pgmap v4633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:34 smithi193 ceph-mon[32782]: pgmap v4633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:35.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:34 smithi196 ceph-mon[32572]: pgmap v4633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:57:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:57:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:57:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:36 smithi193 ceph-mon[32782]: pgmap v4634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:36 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7771.921546 secs 2024-04-26T13:57:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:36 smithi196 ceph-mon[32572]: pgmap v4634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:36 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7771.921546 secs 2024-04-26T13:57:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:36 smithi110 ceph-mon[28069]: pgmap v4634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:36 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7771.921546 secs 2024-04-26T13:57:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:57:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:57:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:37 smithi193 ceph-mon[32782]: pgmap v4635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T13:57:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:37 smithi193 ceph-mon[32782]: pgmap v4636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T13:57:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:57:38.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:57:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:57:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:37 smithi196 ceph-mon[32572]: pgmap v4635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T13:57:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:37 smithi196 ceph-mon[32572]: pgmap v4636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T13:57:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:57:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:57:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:57:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:37 smithi110 ceph-mon[28069]: pgmap v4635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T13:57:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:37 smithi110 ceph-mon[28069]: pgmap v4636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T13:57:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:57:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:40 smithi193 ceph-mon[32782]: pgmap v4637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:40 smithi196 ceph-mon[32572]: pgmap v4637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:40 smithi110 ceph-mon[28069]: pgmap v4637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:42 smithi193 ceph-mon[32782]: pgmap v4638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:42 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7776.921670 secs 2024-04-26T13:57:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:42 smithi196 ceph-mon[32572]: pgmap v4638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:42 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7776.921670 secs 2024-04-26T13:57:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:42 smithi110 ceph-mon[28069]: pgmap v4638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:42 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7776.921670 secs 2024-04-26T13:57:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:44 smithi193 ceph-mon[32782]: pgmap v4639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:44 smithi196 ceph-mon[32572]: pgmap v4639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:44 smithi110 ceph-mon[28069]: pgmap v4639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:46 smithi193 ceph-mon[32782]: pgmap v4640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:46.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:46 smithi196 ceph-mon[32572]: pgmap v4640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:46 smithi110 ceph-mon[28069]: pgmap v4640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:57:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:47 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7781.921792 secs 2024-04-26T13:57:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:47 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7781.921792 secs 2024-04-26T13:57:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:47 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7781.921792 secs 2024-04-26T13:57:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:48 smithi193 ceph-mon[32782]: pgmap v4641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:57:48.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:48 smithi196 ceph-mon[32572]: pgmap v4641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:57:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:48 smithi110 ceph-mon[28069]: pgmap v4641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:57:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:50 smithi193 ceph-mon[32782]: pgmap v4642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:50.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:50 smithi196 ceph-mon[32572]: pgmap v4642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:50 smithi110 ceph-mon[28069]: pgmap v4642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:52 smithi193 ceph-mon[32782]: pgmap v4643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:52 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7786.921912 secs 2024-04-26T13:57:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:52 smithi196 ceph-mon[32572]: pgmap v4643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:52 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7786.921912 secs 2024-04-26T13:57:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:52 smithi110 ceph-mon[28069]: pgmap v4643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:52 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7786.921912 secs 2024-04-26T13:57:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:54 smithi193 ceph-mon[32782]: pgmap v4644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:54.373 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:54 smithi110 ceph-mon[28069]: pgmap v4644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:54.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:54 smithi196 ceph-mon[32572]: pgmap v4644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:57:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:56 smithi110 ceph-mon[28069]: pgmap v4645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:56 smithi193 ceph-mon[32782]: pgmap v4645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:56.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:56 smithi196 ceph-mon[32572]: pgmap v4645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:57 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7791.921992 secs 2024-04-26T13:57:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:57 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7791.921992 secs 2024-04-26T13:57:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:57 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7791.921992 secs 2024-04-26T13:57:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:57:58 smithi196 ceph-mon[32572]: pgmap v4646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:57:58 smithi110 ceph-mon[28069]: pgmap v4646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:57:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:57:58 smithi193 ceph-mon[32782]: pgmap v4646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:00.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:00 smithi196 ceph-mon[32572]: pgmap v4647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:00 smithi110 ceph-mon[28069]: pgmap v4647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:00 smithi193 ceph-mon[32782]: pgmap v4647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:02.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:02 smithi193 ceph-mon[32782]: pgmap v4648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:02.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:02 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7796.922111 secs 2024-04-26T13:58:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:02 smithi196 ceph-mon[32572]: pgmap v4648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:02 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7796.922111 secs 2024-04-26T13:58:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:02 smithi110 ceph-mon[28069]: pgmap v4648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:02 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7796.922111 secs 2024-04-26T13:58:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:04 smithi196 ceph-mon[32572]: pgmap v4649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:04 smithi110 ceph-mon[28069]: pgmap v4649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:04 smithi193 ceph-mon[32782]: pgmap v4649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:06 smithi196 ceph-mon[32572]: pgmap v4650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:06 smithi110 ceph-mon[28069]: pgmap v4650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:06 smithi193 ceph-mon[32782]: pgmap v4650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:07.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:07 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7801.922252 secs 2024-04-26T13:58:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:07 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7801.922252 secs 2024-04-26T13:58:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:07 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7801.922252 secs 2024-04-26T13:58:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:08 smithi196 ceph-mon[32572]: pgmap v4651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:08 smithi110 ceph-mon[28069]: pgmap v4651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:08 smithi193 ceph-mon[32782]: pgmap v4651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:10 smithi196 ceph-mon[32572]: pgmap v4652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:10 smithi110 ceph-mon[28069]: pgmap v4652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:10 smithi193 ceph-mon[32782]: pgmap v4652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:12 smithi196 ceph-mon[32572]: pgmap v4653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:12 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7806.922394 secs 2024-04-26T13:58:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:12 smithi110 ceph-mon[28069]: pgmap v4653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:12 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7806.922394 secs 2024-04-26T13:58:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:12 smithi193 ceph-mon[32782]: pgmap v4653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:12 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7806.922394 secs 2024-04-26T13:58:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:14 smithi196 ceph-mon[32572]: pgmap v4654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:14 smithi110 ceph-mon[28069]: pgmap v4654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:14 smithi193 ceph-mon[32782]: pgmap v4654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:16 smithi196 ceph-mon[32572]: pgmap v4655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:16 smithi110 ceph-mon[28069]: pgmap v4655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:16 smithi193 ceph-mon[32782]: pgmap v4655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:17 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7811.922512 secs 2024-04-26T13:58:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:17 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7811.922512 secs 2024-04-26T13:58:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:17 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7811.922512 secs 2024-04-26T13:58:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:18 smithi196 ceph-mon[32572]: pgmap v4656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:18 smithi110 ceph-mon[28069]: pgmap v4656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:18 smithi193 ceph-mon[32782]: pgmap v4656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:20 smithi196 ceph-mon[32572]: pgmap v4657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:20 smithi110 ceph-mon[28069]: pgmap v4657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:20 smithi193 ceph-mon[32782]: pgmap v4657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:22 smithi196 ceph-mon[32572]: pgmap v4658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:22 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7816.922636 secs 2024-04-26T13:58:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:22 smithi110 ceph-mon[28069]: pgmap v4658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:22 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7816.922636 secs 2024-04-26T13:58:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:22 smithi193 ceph-mon[32782]: pgmap v4658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:22 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7816.922636 secs 2024-04-26T13:58:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:24 smithi196 ceph-mon[32572]: pgmap v4659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:24 smithi110 ceph-mon[28069]: pgmap v4659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:24 smithi193 ceph-mon[32782]: pgmap v4659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:26 smithi196 ceph-mon[32572]: pgmap v4660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:26 smithi110 ceph-mon[28069]: pgmap v4660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:26 smithi193 ceph-mon[32782]: pgmap v4660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:27 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7821.922727 secs 2024-04-26T13:58:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:27 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7821.922727 secs 2024-04-26T13:58:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:27 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7821.922727 secs 2024-04-26T13:58:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:28 smithi196 ceph-mon[32572]: pgmap v4661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:28 smithi110 ceph-mon[28069]: pgmap v4661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:28 smithi193 ceph-mon[32782]: pgmap v4661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:30 smithi196 ceph-mon[32572]: pgmap v4662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:30 smithi110 ceph-mon[28069]: pgmap v4662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:30 smithi193 ceph-mon[32782]: pgmap v4662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:32 smithi196 ceph-mon[32572]: pgmap v4663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:32 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7826.922846 secs 2024-04-26T13:58:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:32 smithi110 ceph-mon[28069]: pgmap v4663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:32 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7826.922846 secs 2024-04-26T13:58:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:32 smithi193 ceph-mon[32782]: pgmap v4663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:32 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7826.922846 secs 2024-04-26T13:58:34.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:34 smithi196 ceph-mon[32572]: pgmap v4664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:34 smithi110 ceph-mon[28069]: pgmap v4664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:34 smithi193 ceph-mon[32782]: pgmap v4664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:35 smithi110 ceph-mon[28069]: pgmap v4665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:35.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:35 smithi193 ceph-mon[32782]: pgmap v4665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:35.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:35 smithi196 ceph-mon[32572]: pgmap v4665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:36 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7831.922969 secs 2024-04-26T13:58:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:36 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7831.922969 secs 2024-04-26T13:58:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:36 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7831.922969 secs 2024-04-26T13:58:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:37 smithi196 ceph-mon[32572]: pgmap v4666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:58:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:37 smithi110 ceph-mon[28069]: pgmap v4666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:58:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:37 smithi193 ceph-mon[32782]: pgmap v4666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:58:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:58:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:58:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:58:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:58:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:58:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:58:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:58:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:58:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:58:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:39 smithi196 ceph-mon[32572]: pgmap v4667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:58:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:39 smithi196 ceph-mon[32572]: pgmap v4668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:39 smithi110 ceph-mon[28069]: pgmap v4667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:58:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:39 smithi110 ceph-mon[28069]: pgmap v4668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:39 smithi193 ceph-mon[32782]: pgmap v4667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T13:58:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:39 smithi193 ceph-mon[32782]: pgmap v4668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:41 smithi196 ceph-mon[32572]: pgmap v4669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:41 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7836.923087 secs 2024-04-26T13:58:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:41 smithi110 ceph-mon[28069]: pgmap v4669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:41 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7836.923087 secs 2024-04-26T13:58:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:41 smithi193 ceph-mon[32782]: pgmap v4669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:41 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7836.923087 secs 2024-04-26T13:58:44.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:43 smithi196 ceph-mon[32572]: pgmap v4670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:43 smithi110 ceph-mon[28069]: pgmap v4670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:43 smithi193 ceph-mon[32782]: pgmap v4670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:45 smithi196 ceph-mon[32572]: pgmap v4671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:45 smithi110 ceph-mon[28069]: pgmap v4671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:45 smithi193 ceph-mon[32782]: pgmap v4671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:46 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7841.923166 secs 2024-04-26T13:58:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:46 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7841.923166 secs 2024-04-26T13:58:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:46 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7841.923166 secs 2024-04-26T13:58:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:47 smithi196 ceph-mon[32572]: pgmap v4672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:47 smithi110 ceph-mon[28069]: pgmap v4672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:47 smithi193 ceph-mon[32782]: pgmap v4672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:58:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:49 smithi196 ceph-mon[32572]: pgmap v4673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:58:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:49 smithi110 ceph-mon[28069]: pgmap v4673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:58:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:49 smithi193 ceph-mon[32782]: pgmap v4673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:58:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:51 smithi196 ceph-mon[32572]: pgmap v4674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:51 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7846.923282 secs 2024-04-26T13:58:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:51 smithi110 ceph-mon[28069]: pgmap v4674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:51 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7846.923282 secs 2024-04-26T13:58:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:51 smithi193 ceph-mon[32782]: pgmap v4674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:51 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7846.923282 secs 2024-04-26T13:58:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:53 smithi196 ceph-mon[32572]: pgmap v4675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:53 smithi110 ceph-mon[28069]: pgmap v4675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:53 smithi193 ceph-mon[32782]: pgmap v4675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:58:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:55 smithi196 ceph-mon[32572]: pgmap v4676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:55 smithi110 ceph-mon[28069]: pgmap v4676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:55 smithi193 ceph-mon[32782]: pgmap v4676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:56 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7851.923420 secs 2024-04-26T13:58:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:56 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7851.923420 secs 2024-04-26T13:58:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:56 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7851.923420 secs 2024-04-26T13:58:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:57 smithi196 ceph-mon[32572]: pgmap v4677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:57 smithi110 ceph-mon[28069]: pgmap v4677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:58:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:57 smithi193 ceph-mon[32782]: pgmap v4677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:58:59 smithi196 ceph-mon[32572]: pgmap v4678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:58:59 smithi110 ceph-mon[28069]: pgmap v4678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:58:59 smithi193 ceph-mon[32782]: pgmap v4678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:01 smithi196 ceph-mon[32572]: pgmap v4679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:01 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7856.923537 secs 2024-04-26T13:59:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:01 smithi110 ceph-mon[28069]: pgmap v4679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:01 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7856.923537 secs 2024-04-26T13:59:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:01 smithi193 ceph-mon[32782]: pgmap v4679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:01 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7856.923537 secs 2024-04-26T13:59:04.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:03 smithi196 ceph-mon[32572]: pgmap v4680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:03 smithi110 ceph-mon[28069]: pgmap v4680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:04.040 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:59:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:59:03.991+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:59:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:59:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:59:03.991+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:59:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:59:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:59:03.991+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:59:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:59:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:59:03.991+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:59:04.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 13:59:03 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T13:59:03.991+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T13:59:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:03 smithi193 ceph-mon[32782]: pgmap v4680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:05 smithi110 ceph-mon[28069]: pgmap v4681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:05 smithi193 ceph-mon[32782]: pgmap v4681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:05 smithi196 ceph-mon[32572]: pgmap v4681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:06 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7861.923670 secs 2024-04-26T13:59:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:06 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7861.923670 secs 2024-04-26T13:59:07.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:06 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7861.923670 secs 2024-04-26T13:59:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:07 smithi193 ceph-mon[32782]: pgmap v4682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:08.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:07 smithi196 ceph-mon[32572]: pgmap v4682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:07 smithi110 ceph-mon[28069]: pgmap v4682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:09 smithi193 ceph-mon[32782]: pgmap v4683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T13:59:10.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:09 smithi196 ceph-mon[32572]: pgmap v4683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T13:59:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:09 smithi110 ceph-mon[28069]: pgmap v4683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T13:59:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:11 smithi193 ceph-mon[32782]: pgmap v4684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T13:59:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:11 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7866.923767 secs 2024-04-26T13:59:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:11 smithi196 ceph-mon[32572]: pgmap v4684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T13:59:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:11 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7866.923767 secs 2024-04-26T13:59:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:11 smithi110 ceph-mon[28069]: pgmap v4684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T13:59:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:11 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7866.923767 secs 2024-04-26T13:59:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:13 smithi193 ceph-mon[32782]: pgmap v4685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T13:59:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:13 smithi196 ceph-mon[32572]: pgmap v4685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T13:59:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:13 smithi110 ceph-mon[28069]: pgmap v4685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T13:59:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:15 smithi193 ceph-mon[32782]: pgmap v4686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T13:59:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:15 smithi196 ceph-mon[32572]: pgmap v4686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T13:59:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:15 smithi110 ceph-mon[28069]: pgmap v4686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T13:59:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:16 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7871.923889 secs 2024-04-26T13:59:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:16 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7871.923889 secs 2024-04-26T13:59:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:16 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7871.923889 secs 2024-04-26T13:59:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:17 smithi193 ceph-mon[32782]: pgmap v4687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T13:59:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:17 smithi196 ceph-mon[32572]: pgmap v4687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T13:59:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:17 smithi110 ceph-mon[28069]: pgmap v4687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T13:59:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:19 smithi193 ceph-mon[32782]: pgmap v4688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T13:59:20.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:19 smithi196 ceph-mon[32572]: pgmap v4688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T13:59:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:19 smithi110 ceph-mon[28069]: pgmap v4688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T13:59:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:21 smithi193 ceph-mon[32782]: pgmap v4689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:21 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7876.924028 secs 2024-04-26T13:59:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:21 smithi196 ceph-mon[32572]: pgmap v4689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:21 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7876.924028 secs 2024-04-26T13:59:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:21 smithi110 ceph-mon[28069]: pgmap v4689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:21 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7876.924028 secs 2024-04-26T13:59:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:23 smithi193 ceph-mon[32782]: pgmap v4690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:24.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:23 smithi196 ceph-mon[32572]: pgmap v4690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:23 smithi110 ceph-mon[28069]: pgmap v4690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:25 smithi193 ceph-mon[32782]: pgmap v4691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:25 smithi196 ceph-mon[32572]: pgmap v4691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:25 smithi110 ceph-mon[28069]: pgmap v4691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:26 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7881.924171 secs 2024-04-26T13:59:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:26 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7881.924171 secs 2024-04-26T13:59:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:26 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7881.924171 secs 2024-04-26T13:59:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:27 smithi193 ceph-mon[32782]: pgmap v4692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:27 smithi196 ceph-mon[32572]: pgmap v4692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:27 smithi110 ceph-mon[28069]: pgmap v4692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:29 smithi196 ceph-mon[32572]: pgmap v4693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:29 smithi110 ceph-mon[28069]: pgmap v4693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:30.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:29 smithi193 ceph-mon[32782]: pgmap v4693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:31 smithi196 ceph-mon[32572]: pgmap v4694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:31 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7886.924310 secs 2024-04-26T13:59:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:31 smithi110 ceph-mon[28069]: pgmap v4694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:31 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7886.924310 secs 2024-04-26T13:59:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:31 smithi193 ceph-mon[32782]: pgmap v4694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:31 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7886.924310 secs 2024-04-26T13:59:34.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:33 smithi193 ceph-mon[32782]: pgmap v4695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:33 smithi196 ceph-mon[32572]: pgmap v4695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:33 smithi110 ceph-mon[28069]: pgmap v4695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:35 smithi196 ceph-mon[32572]: pgmap v4696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:35 smithi110 ceph-mon[28069]: pgmap v4696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:35 smithi193 ceph-mon[32782]: pgmap v4696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:36 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7891.924422 secs 2024-04-26T13:59:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:36 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7891.924422 secs 2024-04-26T13:59:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:36 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7891.924422 secs 2024-04-26T13:59:38.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:37 smithi196 ceph-mon[32572]: pgmap v4697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:37 smithi110 ceph-mon[28069]: pgmap v4697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:37 smithi193 ceph-mon[32782]: pgmap v4697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:39.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:59:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:59:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T13:59:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:39 smithi196 ceph-mon[32572]: pgmap v4698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:39 smithi110 ceph-mon[28069]: pgmap v4698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:39 smithi193 ceph-mon[32782]: pgmap v4698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:59:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:59:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:40 smithi196 ceph-mon[32572]: pgmap v4699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T13:59:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:40 smithi196 ceph-mon[32572]: pgmap v4700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:59:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:59:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:59:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:40 smithi110 ceph-mon[28069]: pgmap v4699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T13:59:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:40 smithi110 ceph-mon[28069]: pgmap v4700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:59:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T13:59:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T13:59:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:40 smithi193 ceph-mon[32782]: pgmap v4699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T13:59:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:40 smithi193 ceph-mon[32782]: pgmap v4700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T13:59:42.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:41 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7896.924560 secs 2024-04-26T13:59:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:41 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7896.924560 secs 2024-04-26T13:59:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:41 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7896.924560 secs 2024-04-26T13:59:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:42 smithi196 ceph-mon[32572]: pgmap v4701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:59:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:42 smithi110 ceph-mon[28069]: pgmap v4701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:59:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:42 smithi193 ceph-mon[32782]: pgmap v4701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T13:59:45.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:45 smithi196 ceph-mon[32572]: pgmap v4702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:45 smithi110 ceph-mon[28069]: pgmap v4702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:45 smithi193 ceph-mon[32782]: pgmap v4702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:47 smithi110 ceph-mon[28069]: pgmap v4703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:47 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7901.924697 secs 2024-04-26T13:59:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:47 smithi193 ceph-mon[32782]: pgmap v4703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:47 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7901.924697 secs 2024-04-26T13:59:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:47 smithi196 ceph-mon[32572]: pgmap v4703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:47 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7901.924697 secs 2024-04-26T13:59:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:48 smithi193 ceph-mon[32782]: pgmap v4704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:48.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:48 smithi196 ceph-mon[32572]: pgmap v4704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:48 smithi110 ceph-mon[28069]: pgmap v4704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T13:59:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:51 smithi110 ceph-mon[28069]: pgmap v4705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:59:51.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:51 smithi193 ceph-mon[32782]: pgmap v4705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:59:51.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:51 smithi196 ceph-mon[32572]: pgmap v4705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T13:59:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:52 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7906.924819 secs 2024-04-26T13:59:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:52 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7906.924819 secs 2024-04-26T13:59:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:52 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7906.924819 secs 2024-04-26T13:59:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:53 smithi110 ceph-mon[28069]: pgmap v4706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:53 smithi193 ceph-mon[32782]: pgmap v4706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:53.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:53 smithi196 ceph-mon[32572]: pgmap v4706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:54 smithi110 ceph-mon[28069]: pgmap v4707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:54 smithi193 ceph-mon[32782]: pgmap v4707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:54 smithi196 ceph-mon[32572]: pgmap v4707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:57 smithi110 ceph-mon[28069]: pgmap v4708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:57 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7911.924942 secs 2024-04-26T13:59:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:57 smithi193 ceph-mon[32782]: pgmap v4708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:57 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7911.924942 secs 2024-04-26T13:59:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:57 smithi196 ceph-mon[32572]: pgmap v4708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T13:59:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:57 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7911.924942 secs 2024-04-26T13:59:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 13:59:59 smithi110 ceph-mon[28069]: pgmap v4709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 13:59:59 smithi193 ceph-mon[32782]: pgmap v4709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T13:59:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 13:59:59 smithi196 ceph-mon[32572]: pgmap v4709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:00:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:00 smithi110 ceph-mon[28069]: pgmap v4710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:00:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:00 smithi193 ceph-mon[32782]: pgmap v4710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:00.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:00:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:00 smithi196 ceph-mon[32572]: pgmap v4710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:01 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7916.925039 secs 2024-04-26T14:00:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:01 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7916.925039 secs 2024-04-26T14:00:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:01 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7916.925039 secs 2024-04-26T14:00:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:02 smithi196 ceph-mon[32572]: pgmap v4711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:02 smithi110 ceph-mon[28069]: pgmap v4711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:02 smithi193 ceph-mon[32782]: pgmap v4711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:05 smithi110 ceph-mon[28069]: pgmap v4712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:05.573 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:05 smithi193 ceph-mon[32782]: pgmap v4712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:05.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:05 smithi196 ceph-mon[32572]: pgmap v4712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:06 smithi110 ceph-mon[28069]: pgmap v4713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:06 smithi193 ceph-mon[32782]: pgmap v4713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:06.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:06 smithi196 ceph-mon[32572]: pgmap v4713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:07 smithi110 ceph-mon[28069]: 7 slow requests, 1 included below; oldest blocked for > 7921.925157 secs 2024-04-26T14:00:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:07 smithi110 ceph-mon[28069]: slow request 362.318727 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:00:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:07 smithi193 ceph-mon[32782]: 7 slow requests, 1 included below; oldest blocked for > 7921.925157 secs 2024-04-26T14:00:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:07 smithi193 ceph-mon[32782]: slow request 362.318727 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:00:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:07 smithi196 ceph-mon[32572]: 7 slow requests, 1 included below; oldest blocked for > 7921.925157 secs 2024-04-26T14:00:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:07 smithi196 ceph-mon[32572]: slow request 362.318727 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:00:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:08 smithi110 ceph-mon[28069]: pgmap v4714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:08 smithi193 ceph-mon[32782]: pgmap v4714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:08 smithi196 ceph-mon[32572]: pgmap v4714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:11 smithi110 ceph-mon[28069]: pgmap v4715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:11 smithi193 ceph-mon[32782]: pgmap v4715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:11 smithi196 ceph-mon[32572]: pgmap v4715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:12 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7926.925274 secs 2024-04-26T14:00:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:12 smithi110 ceph-mon[28069]: pgmap v4716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:12 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7926.925274 secs 2024-04-26T14:00:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:12 smithi193 ceph-mon[32782]: pgmap v4716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:12 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7926.925274 secs 2024-04-26T14:00:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:12 smithi196 ceph-mon[32572]: pgmap v4716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:14 smithi193 ceph-mon[32782]: pgmap v4717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:14 smithi196 ceph-mon[32572]: pgmap v4717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:14 smithi110 ceph-mon[28069]: pgmap v4717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:16 smithi193 ceph-mon[32782]: pgmap v4718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:16.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:16 smithi196 ceph-mon[32572]: pgmap v4718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:16 smithi110 ceph-mon[28069]: pgmap v4718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:17 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7931.925396 secs 2024-04-26T14:00:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:00:17.646+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:00:17.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:00:17.646+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:00:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:00:17.647+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 64 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:00:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:00:17.647+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 64 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:00:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:00:17.647+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006660 con 0x55db1be4fdd0 2024-04-26T14:00:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:00:17.647+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:00:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:00:17.648+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 65 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:00:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:00:17.648+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 65 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006660 con 0x7f261c104b50 2024-04-26T14:00:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:17 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7931.925396 secs 2024-04-26T14:00:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:17 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7931.925396 secs 2024-04-26T14:00:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:18 smithi193 ceph-mon[32782]: pgmap v4719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:18 smithi196 ceph-mon[32572]: pgmap v4719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:18 smithi110 ceph-mon[28069]: pgmap v4719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:20 smithi193 ceph-mon[32782]: pgmap v4720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:20 smithi196 ceph-mon[32572]: pgmap v4720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:20 smithi110 ceph-mon[28069]: pgmap v4720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:21 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7936.925516 secs 2024-04-26T14:00:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:21 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7936.925516 secs 2024-04-26T14:00:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:21 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7936.925516 secs 2024-04-26T14:00:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:22 smithi196 ceph-mon[32572]: pgmap v4721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:22 smithi110 ceph-mon[28069]: pgmap v4721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:22 smithi193 ceph-mon[32782]: pgmap v4721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:24 smithi193 ceph-mon[32782]: pgmap v4722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:24.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:24 smithi196 ceph-mon[32572]: pgmap v4722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:24 smithi110 ceph-mon[28069]: pgmap v4722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:26 smithi193 ceph-mon[32782]: pgmap v4723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:26 smithi196 ceph-mon[32572]: pgmap v4723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:26 smithi110 ceph-mon[28069]: pgmap v4723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:27 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7941.925632 secs 2024-04-26T14:00:27.691 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:27 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7941.925632 secs 2024-04-26T14:00:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:27 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7941.925632 secs 2024-04-26T14:00:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:28 smithi193 ceph-mon[32782]: pgmap v4724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:28 smithi196 ceph-mon[32572]: pgmap v4724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:28 smithi110 ceph-mon[28069]: pgmap v4724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:30 smithi193 ceph-mon[32782]: pgmap v4725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:30 smithi196 ceph-mon[32572]: pgmap v4725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:30 smithi110 ceph-mon[28069]: pgmap v4725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:31 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7946.925744 secs 2024-04-26T14:00:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:31 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7946.925744 secs 2024-04-26T14:00:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:31 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7946.925744 secs 2024-04-26T14:00:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:32 smithi196 ceph-mon[32572]: pgmap v4726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:32 smithi110 ceph-mon[28069]: pgmap v4726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:32 smithi193 ceph-mon[32782]: pgmap v4726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:34 smithi193 ceph-mon[32782]: pgmap v4727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:34.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:34 smithi196 ceph-mon[32572]: pgmap v4727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:34 smithi110 ceph-mon[28069]: pgmap v4727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:36 smithi193 ceph-mon[32782]: pgmap v4728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:36 smithi196 ceph-mon[32572]: pgmap v4728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:36 smithi110 ceph-mon[28069]: pgmap v4728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:37 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7951.925838 secs 2024-04-26T14:00:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:37 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7951.925838 secs 2024-04-26T14:00:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:37 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7951.925838 secs 2024-04-26T14:00:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:38 smithi193 ceph-mon[32782]: pgmap v4729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:38 smithi196 ceph-mon[32572]: pgmap v4729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:38 smithi110 ceph-mon[28069]: pgmap v4729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:40 smithi193 ceph-mon[32782]: pgmap v4730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:40.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:40 smithi196 ceph-mon[32572]: pgmap v4730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:40 smithi110 ceph-mon[28069]: pgmap v4730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:00:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:00:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:00:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:42 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7956.925930 secs 2024-04-26T14:00:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:00:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:00:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:42 smithi193 ceph-mon[32782]: pgmap v4731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:00:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:42 smithi193 ceph-mon[32782]: pgmap v4732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:00:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:42 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7956.925930 secs 2024-04-26T14:00:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:00:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:00:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:42 smithi196 ceph-mon[32572]: pgmap v4731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:00:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:42 smithi196 ceph-mon[32572]: pgmap v4732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:00:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:42 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7956.925930 secs 2024-04-26T14:00:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:00:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:00:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:42 smithi110 ceph-mon[28069]: pgmap v4731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:00:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:42 smithi110 ceph-mon[28069]: pgmap v4732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:00:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:44 smithi193 ceph-mon[32782]: pgmap v4733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:45.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:44 smithi196 ceph-mon[32572]: pgmap v4733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:44 smithi110 ceph-mon[28069]: pgmap v4733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:46 smithi193 ceph-mon[32782]: pgmap v4734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:46 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7961.926052 secs 2024-04-26T14:00:47.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:46 smithi196 ceph-mon[32572]: pgmap v4734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:46 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7961.926052 secs 2024-04-26T14:00:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:46 smithi110 ceph-mon[28069]: pgmap v4734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:46 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7961.926052 secs 2024-04-26T14:00:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:48 smithi193 ceph-mon[32782]: pgmap v4735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:48 smithi196 ceph-mon[32572]: pgmap v4735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:48 smithi110 ceph-mon[28069]: pgmap v4735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:50 smithi193 ceph-mon[32782]: pgmap v4736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:50 smithi196 ceph-mon[32572]: pgmap v4736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:50 smithi110 ceph-mon[28069]: pgmap v4736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:00:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:51 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7966.926173 secs 2024-04-26T14:00:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:51 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7966.926173 secs 2024-04-26T14:00:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:51 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7966.926173 secs 2024-04-26T14:00:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:52 smithi193 ceph-mon[32782]: pgmap v4737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:00:53.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:52 smithi196 ceph-mon[32572]: pgmap v4737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:00:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:52 smithi110 ceph-mon[28069]: pgmap v4737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:00:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:54 smithi193 ceph-mon[32782]: pgmap v4738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:54 smithi196 ceph-mon[32572]: pgmap v4738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:54 smithi110 ceph-mon[28069]: pgmap v4738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:56 smithi193 ceph-mon[32782]: pgmap v4739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:56 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7971.926295 secs 2024-04-26T14:00:57.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:56 smithi196 ceph-mon[32572]: pgmap v4739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:56 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7971.926295 secs 2024-04-26T14:00:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:56 smithi110 ceph-mon[28069]: pgmap v4739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:00:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:56 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7971.926295 secs 2024-04-26T14:00:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:00:58 smithi193 ceph-mon[32782]: pgmap v4740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:00:58 smithi196 ceph-mon[32572]: pgmap v4740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:00:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:00:58 smithi110 ceph-mon[28069]: pgmap v4740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:00 smithi193 ceph-mon[32782]: pgmap v4741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:00 smithi196 ceph-mon[32572]: pgmap v4741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:00 smithi110 ceph-mon[28069]: pgmap v4741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:01 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7976.926427 secs 2024-04-26T14:01:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:01 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7976.926427 secs 2024-04-26T14:01:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:01 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7976.926427 secs 2024-04-26T14:01:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:02 smithi196 ceph-mon[32572]: pgmap v4742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:02 smithi110 ceph-mon[28069]: pgmap v4742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:02 smithi193 ceph-mon[32782]: pgmap v4742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:04 smithi196 ceph-mon[32572]: pgmap v4743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:04 smithi110 ceph-mon[28069]: pgmap v4743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:04 smithi193 ceph-mon[32782]: pgmap v4743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:07.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:06 smithi193 ceph-mon[32782]: pgmap v4744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:07.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:06 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7981.926528 secs 2024-04-26T14:01:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:06 smithi196 ceph-mon[32572]: pgmap v4744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:06 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7981.926528 secs 2024-04-26T14:01:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:06 smithi110 ceph-mon[28069]: pgmap v4744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:06 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7981.926528 secs 2024-04-26T14:01:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:08 smithi196 ceph-mon[32572]: pgmap v4745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:08 smithi110 ceph-mon[28069]: pgmap v4745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:08 smithi193 ceph-mon[32782]: pgmap v4745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:10 smithi196 ceph-mon[32572]: pgmap v4746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:10 smithi110 ceph-mon[28069]: pgmap v4746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:10 smithi193 ceph-mon[32782]: pgmap v4746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:12.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:11 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7986.926688 secs 2024-04-26T14:01:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:11 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7986.926688 secs 2024-04-26T14:01:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:11 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7986.926688 secs 2024-04-26T14:01:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:12 smithi196 ceph-mon[32572]: pgmap v4747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:12 smithi110 ceph-mon[28069]: pgmap v4747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:12 smithi193 ceph-mon[32782]: pgmap v4747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:15.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:14 smithi196 ceph-mon[32572]: pgmap v4748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:14 smithi110 ceph-mon[28069]: pgmap v4748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:14 smithi193 ceph-mon[32782]: pgmap v4748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:16 smithi196 ceph-mon[32572]: pgmap v4749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:16 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7991.926811 secs 2024-04-26T14:01:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:16 smithi110 ceph-mon[28069]: pgmap v4749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:16 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7991.926811 secs 2024-04-26T14:01:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:16 smithi193 ceph-mon[32782]: pgmap v4749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:16 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7991.926811 secs 2024-04-26T14:01:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:18 smithi196 ceph-mon[32572]: pgmap v4750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:18 smithi110 ceph-mon[28069]: pgmap v4750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:18 smithi193 ceph-mon[32782]: pgmap v4750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:21.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:20 smithi196 ceph-mon[32572]: pgmap v4751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:20 smithi110 ceph-mon[28069]: pgmap v4751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:20 smithi193 ceph-mon[32782]: pgmap v4751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:21 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 7996.926928 secs 2024-04-26T14:01:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:21 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 7996.926928 secs 2024-04-26T14:01:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:21 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 7996.926928 secs 2024-04-26T14:01:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:22 smithi196 ceph-mon[32572]: pgmap v4752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:22 smithi110 ceph-mon[28069]: pgmap v4752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:22 smithi193 ceph-mon[32782]: pgmap v4752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:25.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:24 smithi196 ceph-mon[32572]: pgmap v4753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:24 smithi110 ceph-mon[28069]: pgmap v4753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:24 smithi193 ceph-mon[32782]: pgmap v4753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:26 smithi196 ceph-mon[32572]: pgmap v4754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:26 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 8001.927011 secs 2024-04-26T14:01:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:26 smithi110 ceph-mon[28069]: pgmap v4754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:26 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 8001.927011 secs 2024-04-26T14:01:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:26 smithi193 ceph-mon[32782]: pgmap v4754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:26 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 8001.927011 secs 2024-04-26T14:01:29.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:28 smithi196 ceph-mon[32572]: pgmap v4755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:28 smithi110 ceph-mon[28069]: pgmap v4755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:28 smithi193 ceph-mon[32782]: pgmap v4755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:31.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:30 smithi196 ceph-mon[32572]: pgmap v4756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:30 smithi110 ceph-mon[28069]: pgmap v4756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:30 smithi193 ceph-mon[32782]: pgmap v4756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:31 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 8006.927133 secs 2024-04-26T14:01:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:31 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 8006.927133 secs 2024-04-26T14:01:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:31 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 8006.927133 secs 2024-04-26T14:01:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:32 smithi196 ceph-mon[32572]: pgmap v4757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:32 smithi110 ceph-mon[28069]: pgmap v4757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:32 smithi193 ceph-mon[32782]: pgmap v4757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:35.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:34 smithi196 ceph-mon[32572]: pgmap v4758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:34 smithi110 ceph-mon[28069]: pgmap v4758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:34 smithi193 ceph-mon[32782]: pgmap v4758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:36 smithi196 ceph-mon[32572]: pgmap v4759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:36 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 8011.927286 secs 2024-04-26T14:01:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:36 smithi110 ceph-mon[28069]: pgmap v4759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:36 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 8011.927286 secs 2024-04-26T14:01:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:36 smithi193 ceph-mon[32782]: pgmap v4759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:36 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 8011.927286 secs 2024-04-26T14:01:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:38 smithi196 ceph-mon[32572]: pgmap v4760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:38 smithi110 ceph-mon[28069]: pgmap v4760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:38 smithi193 ceph-mon[32782]: pgmap v4760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:41.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:40 smithi196 ceph-mon[32572]: pgmap v4761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:40 smithi110 ceph-mon[28069]: pgmap v4761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:40 smithi193 ceph-mon[32782]: pgmap v4761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:42.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:42 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 8016.927426 secs 2024-04-26T14:01:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:41 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 8016.927426 secs 2024-04-26T14:01:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:42 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 8016.927426 secs 2024-04-26T14:01:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:43 smithi196 ceph-mon[32572]: pgmap v4762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:01:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:43 smithi110 ceph-mon[28069]: pgmap v4762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:01:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:43 smithi193 ceph-mon[32782]: pgmap v4762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:01:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:01:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:01:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:01:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:01:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:01:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:01:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:01:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:01:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:01:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:45 smithi110 ceph-mon[28069]: pgmap v4763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:01:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:45 smithi110 ceph-mon[28069]: pgmap v4764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:45 smithi193 ceph-mon[32782]: pgmap v4763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:01:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:45 smithi193 ceph-mon[32782]: pgmap v4764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:45 smithi196 ceph-mon[32572]: pgmap v4763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:01:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:45 smithi196 ceph-mon[32572]: pgmap v4764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:47 smithi110 ceph-mon[28069]: pgmap v4765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:47 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 8021.927590 secs 2024-04-26T14:01:47.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:47 smithi196 ceph-mon[32572]: pgmap v4765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:47.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:47 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 8021.927590 secs 2024-04-26T14:01:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:47 smithi193 ceph-mon[32782]: pgmap v4765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:47 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 8021.927590 secs 2024-04-26T14:01:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:49 smithi110 ceph-mon[28069]: pgmap v4766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:49 smithi193 ceph-mon[32782]: pgmap v4766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:49.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:49 smithi196 ceph-mon[32572]: pgmap v4766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:51 smithi110 ceph-mon[28069]: pgmap v4767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:51 smithi193 ceph-mon[32782]: pgmap v4767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:51.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:51 smithi196 ceph-mon[32572]: pgmap v4767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:52 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 8026.927653 secs 2024-04-26T14:01:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:52 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 8026.927653 secs 2024-04-26T14:01:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:52 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 8026.927653 secs 2024-04-26T14:01:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:53 smithi193 ceph-mon[32782]: pgmap v4768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:53.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:53 smithi196 ceph-mon[32572]: pgmap v4768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:53 smithi110 ceph-mon[28069]: pgmap v4768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:01:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:55 smithi193 ceph-mon[32782]: pgmap v4769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:01:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:55 smithi196 ceph-mon[32572]: pgmap v4769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:01:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:55 smithi110 ceph-mon[28069]: pgmap v4769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:01:57.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:57 smithi110 ceph-mon[28069]: pgmap v4770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:57.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:57 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 8031.927739 secs 2024-04-26T14:01:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:57 smithi193 ceph-mon[32782]: pgmap v4770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:57 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 8031.927739 secs 2024-04-26T14:01:57.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:57 smithi196 ceph-mon[32572]: pgmap v4770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:01:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:57 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 8031.927739 secs 2024-04-26T14:01:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:01:59 smithi193 ceph-mon[32782]: pgmap v4771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:01:59 smithi196 ceph-mon[32572]: pgmap v4771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:01:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:01:59 smithi110 ceph-mon[28069]: pgmap v4771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:01 smithi193 ceph-mon[32782]: pgmap v4772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:01 smithi196 ceph-mon[32572]: pgmap v4772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:01 smithi110 ceph-mon[28069]: pgmap v4772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:02 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 8036.927858 secs 2024-04-26T14:02:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:02 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 8036.927858 secs 2024-04-26T14:02:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:02 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 8036.927858 secs 2024-04-26T14:02:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:03 smithi193 ceph-mon[32782]: pgmap v4773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:03.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:03 smithi196 ceph-mon[32572]: pgmap v4773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:03 smithi110 ceph-mon[28069]: pgmap v4773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:05 smithi193 ceph-mon[32782]: pgmap v4774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:05.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:05 smithi196 ceph-mon[32572]: pgmap v4774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:05 smithi110 ceph-mon[28069]: pgmap v4774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:07 smithi193 ceph-mon[32782]: pgmap v4775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:07 smithi193 ceph-mon[32782]: 8 slow requests, 1 included below; oldest blocked for > 8041.927991 secs 2024-04-26T14:02:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:07 smithi193 ceph-mon[32782]: slow request 182.225514 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:02:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:07 smithi196 ceph-mon[32572]: pgmap v4775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:07 smithi196 ceph-mon[32572]: 8 slow requests, 1 included below; oldest blocked for > 8041.927991 secs 2024-04-26T14:02:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:07 smithi196 ceph-mon[32572]: slow request 182.225514 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:02:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:07 smithi110 ceph-mon[28069]: pgmap v4775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:07 smithi110 ceph-mon[28069]: 8 slow requests, 1 included below; oldest blocked for > 8041.927991 secs 2024-04-26T14:02:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:07 smithi110 ceph-mon[28069]: slow request 182.225514 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:02:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:09 smithi193 ceph-mon[32782]: pgmap v4776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:02:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:09 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:02:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:09 smithi196 ceph-mon[32572]: pgmap v4776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:02:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:09 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:02:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:09 smithi110 ceph-mon[28069]: pgmap v4776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:02:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:09 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:02:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:11 smithi193 ceph-mon[32782]: pgmap v4777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:11 smithi196 ceph-mon[32572]: pgmap v4777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:11 smithi110 ceph-mon[28069]: pgmap v4777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8046.928093 secs 2024-04-26T14:02:12.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8046.928093 secs 2024-04-26T14:02:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8046.928093 secs 2024-04-26T14:02:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:13 smithi193 ceph-mon[32782]: pgmap v4778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:13.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:13 smithi196 ceph-mon[32572]: pgmap v4778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:13 smithi110 ceph-mon[28069]: pgmap v4778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:15 smithi196 ceph-mon[32572]: pgmap v4779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:15 smithi110 ceph-mon[28069]: pgmap v4779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:15 smithi193 ceph-mon[32782]: pgmap v4779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:17 smithi196 ceph-mon[32572]: pgmap v4780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8051.928193 secs 2024-04-26T14:02:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:17 smithi110 ceph-mon[28069]: pgmap v4780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8051.928193 secs 2024-04-26T14:02:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:17 smithi193 ceph-mon[32782]: pgmap v4780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8051.928193 secs 2024-04-26T14:02:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:19 smithi196 ceph-mon[32572]: pgmap v4781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:19 smithi110 ceph-mon[28069]: pgmap v4781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:19 smithi193 ceph-mon[32782]: pgmap v4781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:21 smithi196 ceph-mon[32572]: pgmap v4782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:21 smithi110 ceph-mon[28069]: pgmap v4782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:21 smithi193 ceph-mon[32782]: pgmap v4782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8056.928313 secs 2024-04-26T14:02:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8056.928313 secs 2024-04-26T14:02:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8056.928313 secs 2024-04-26T14:02:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:23 smithi196 ceph-mon[32572]: pgmap v4783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:23 smithi110 ceph-mon[28069]: pgmap v4783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:23 smithi193 ceph-mon[32782]: pgmap v4783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:25.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:25 smithi196 ceph-mon[32572]: pgmap v4784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:25 smithi110 ceph-mon[28069]: pgmap v4784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:25 smithi193 ceph-mon[32782]: pgmap v4784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:27 smithi196 ceph-mon[32572]: pgmap v4785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8061.928434 secs 2024-04-26T14:02:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:27 smithi110 ceph-mon[28069]: pgmap v4785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8061.928434 secs 2024-04-26T14:02:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:27 smithi193 ceph-mon[32782]: pgmap v4785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8061.928434 secs 2024-04-26T14:02:29.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:29 smithi196 ceph-mon[32572]: pgmap v4786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:29 smithi110 ceph-mon[28069]: pgmap v4786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:29 smithi193 ceph-mon[32782]: pgmap v4786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:31 smithi196 ceph-mon[32572]: pgmap v4787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:31 smithi110 ceph-mon[28069]: pgmap v4787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:31 smithi193 ceph-mon[32782]: pgmap v4787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8066.928552 secs 2024-04-26T14:02:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8066.928552 secs 2024-04-26T14:02:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8066.928552 secs 2024-04-26T14:02:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:33 smithi196 ceph-mon[32572]: pgmap v4788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:33 smithi110 ceph-mon[28069]: pgmap v4788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:33 smithi193 ceph-mon[32782]: pgmap v4788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:35.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:35 smithi196 ceph-mon[32572]: pgmap v4789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:35 smithi110 ceph-mon[28069]: pgmap v4789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:35.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:35 smithi193 ceph-mon[32782]: pgmap v4789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:37 smithi196 ceph-mon[32572]: pgmap v4790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8071.928670 secs 2024-04-26T14:02:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:37 smithi110 ceph-mon[28069]: pgmap v4790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8071.928670 secs 2024-04-26T14:02:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:37 smithi193 ceph-mon[32782]: pgmap v4790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8071.928670 secs 2024-04-26T14:02:39.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:39 smithi196 ceph-mon[32572]: pgmap v4791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:39 smithi110 ceph-mon[28069]: pgmap v4791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:39.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:39 smithi193 ceph-mon[32782]: pgmap v4791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:41 smithi196 ceph-mon[32572]: pgmap v4792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:41 smithi110 ceph-mon[28069]: pgmap v4792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:41 smithi193 ceph-mon[32782]: pgmap v4792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8076.928795 secs 2024-04-26T14:02:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8076.928795 secs 2024-04-26T14:02:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8076.928795 secs 2024-04-26T14:02:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:43 smithi196 ceph-mon[32572]: pgmap v4793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:43 smithi110 ceph-mon[28069]: pgmap v4793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:43 smithi193 ceph-mon[32782]: pgmap v4793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:02:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:02:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:02:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:45 smithi196 ceph-mon[32572]: pgmap v4794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:45 smithi110 ceph-mon[28069]: pgmap v4794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:45 smithi193 ceph-mon[32782]: pgmap v4794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:46 smithi196 ceph-mon[32572]: pgmap v4795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:02:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:02:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:46 smithi196 ceph-mon[32572]: pgmap v4796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T14:02:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:46 smithi196 ceph-mon[32572]: pgmap v4797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T14:02:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:46 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8081.928873 secs 2024-04-26T14:02:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:46 smithi110 ceph-mon[28069]: pgmap v4795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:02:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:02:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:46 smithi110 ceph-mon[28069]: pgmap v4796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T14:02:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:46 smithi110 ceph-mon[28069]: pgmap v4797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T14:02:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:46 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8081.928873 secs 2024-04-26T14:02:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:46 smithi193 ceph-mon[32782]: pgmap v4795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:46 smithi193 ceph-mon[32782]: pgmap v4796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T14:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:46 smithi193 ceph-mon[32782]: pgmap v4797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T14:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:46 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8081.928873 secs 2024-04-26T14:02:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:48 smithi193 ceph-mon[32782]: pgmap v4798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:49.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:48 smithi196 ceph-mon[32572]: pgmap v4798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:48 smithi110 ceph-mon[28069]: pgmap v4798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:50 smithi193 ceph-mon[32782]: pgmap v4799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:50 smithi196 ceph-mon[32572]: pgmap v4799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:50 smithi110 ceph-mon[28069]: pgmap v4799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:51 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8086.929002 secs 2024-04-26T14:02:52.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:51 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8086.929002 secs 2024-04-26T14:02:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:51 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8086.929002 secs 2024-04-26T14:02:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:52 smithi193 ceph-mon[32782]: pgmap v4800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T14:02:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:52 smithi196 ceph-mon[32572]: pgmap v4800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T14:02:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:52 smithi110 ceph-mon[28069]: pgmap v4800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T14:02:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:54 smithi193 ceph-mon[32782]: pgmap v4801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:54 smithi196 ceph-mon[32572]: pgmap v4801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:54 smithi110 ceph-mon[28069]: pgmap v4801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:57.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:56 smithi110 ceph-mon[28069]: pgmap v4802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:02:57.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:56 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8091.929145 secs 2024-04-26T14:02:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:56 smithi193 ceph-mon[32782]: pgmap v4802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:02:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:56 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8091.929145 secs 2024-04-26T14:02:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:56 smithi196 ceph-mon[32572]: pgmap v4802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:02:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:56 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8091.929145 secs 2024-04-26T14:02:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:02:58 smithi193 ceph-mon[32782]: pgmap v4803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:02:58 smithi196 ceph-mon[32572]: pgmap v4803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:02:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:02:58 smithi110 ceph-mon[28069]: pgmap v4803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:00 smithi193 ceph-mon[32782]: pgmap v4804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:03:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:00 smithi196 ceph-mon[32572]: pgmap v4804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:03:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:00 smithi110 ceph-mon[28069]: pgmap v4804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:03:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:01 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8096.929266 secs 2024-04-26T14:03:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:01 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8096.929266 secs 2024-04-26T14:03:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:01 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8096.929266 secs 2024-04-26T14:03:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:02 smithi196 ceph-mon[32572]: pgmap v4805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:03:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:02 smithi110 ceph-mon[28069]: pgmap v4805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:03:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:02 smithi193 ceph-mon[32782]: pgmap v4805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:03:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:04 smithi196 ceph-mon[32572]: pgmap v4806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:04 smithi110 ceph-mon[28069]: pgmap v4806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:04 smithi193 ceph-mon[32782]: pgmap v4806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:07.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:06 smithi193 ceph-mon[32782]: pgmap v4807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:03:07.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:06 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8101.929404 secs 2024-04-26T14:03:07.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:06 smithi196 ceph-mon[32572]: pgmap v4807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:03:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:06 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8101.929404 secs 2024-04-26T14:03:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:06 smithi110 ceph-mon[28069]: pgmap v4807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:03:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:06 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8101.929404 secs 2024-04-26T14:03:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:08 smithi196 ceph-mon[32572]: pgmap v4808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:08 smithi110 ceph-mon[28069]: pgmap v4808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:08 smithi193 ceph-mon[32782]: pgmap v4808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:10 smithi196 ceph-mon[32572]: pgmap v4809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:10 smithi110 ceph-mon[28069]: pgmap v4809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:10 smithi193 ceph-mon[32782]: pgmap v4809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:12.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:11 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8106.929524 secs 2024-04-26T14:03:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:11 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8106.929524 secs 2024-04-26T14:03:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:11 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8106.929524 secs 2024-04-26T14:03:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:12 smithi196 ceph-mon[32572]: pgmap v4810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:12 smithi110 ceph-mon[28069]: pgmap v4810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:12 smithi193 ceph-mon[32782]: pgmap v4810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:14 smithi196 ceph-mon[32572]: pgmap v4811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:14 smithi110 ceph-mon[28069]: pgmap v4811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:14 smithi193 ceph-mon[32782]: pgmap v4811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.385+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T14:03:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.385+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T14:03:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.385+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a52d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614014040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T14:03:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.385+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a52d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614014040 comp rx=0 tx=0).stop 2024-04-26T14:03:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.385+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a52d0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T14:03:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.385+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a52d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T14:03:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.385+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a52d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T14:03:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.385+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T14:03:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.386+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T14:03:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.387+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f261401f050 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T14:03:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.402+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T14:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.402+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T14:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.402+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T14:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.402+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T14:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.403+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T14:03:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.404+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T14:03:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:16.404+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T14:03:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:16 smithi196 ceph-mon[32572]: pgmap v4812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:16 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8111.929642 secs 2024-04-26T14:03:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:16 smithi110 ceph-mon[28069]: pgmap v4812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:16 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8111.929642 secs 2024-04-26T14:03:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:16 smithi193 ceph-mon[32782]: pgmap v4812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:16 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8111.929642 secs 2024-04-26T14:03:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:17.677+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063c0 con 0x7f261c104b50 2024-04-26T14:03:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:17.677+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:03:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:17.677+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 66 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:03:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:03:17.677+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 66 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063c0 con 0x55db1be4fdd0 2024-04-26T14:03:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:18 smithi196 ceph-mon[32572]: pgmap v4813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:18 smithi110 ceph-mon[28069]: pgmap v4813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:18 smithi193 ceph-mon[32782]: pgmap v4813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:20 smithi196 ceph-mon[32572]: pgmap v4814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:20 smithi110 ceph-mon[28069]: pgmap v4814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:20 smithi193 ceph-mon[32782]: pgmap v4814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:21 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8116.929762 secs 2024-04-26T14:03:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:21 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8116.929762 secs 2024-04-26T14:03:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:21 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8116.929762 secs 2024-04-26T14:03:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:22 smithi196 ceph-mon[32572]: pgmap v4815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:22 smithi110 ceph-mon[28069]: pgmap v4815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:22 smithi193 ceph-mon[32782]: pgmap v4815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:24 smithi196 ceph-mon[32572]: pgmap v4816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:24 smithi110 ceph-mon[28069]: pgmap v4816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:24 smithi193 ceph-mon[32782]: pgmap v4816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:26 smithi196 ceph-mon[32572]: pgmap v4817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:26 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8121.929843 secs 2024-04-26T14:03:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:26 smithi110 ceph-mon[28069]: pgmap v4817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:26 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8121.929843 secs 2024-04-26T14:03:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:26 smithi193 ceph-mon[32782]: pgmap v4817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:26 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8121.929843 secs 2024-04-26T14:03:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:28 smithi196 ceph-mon[32572]: pgmap v4818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:28 smithi110 ceph-mon[28069]: pgmap v4818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:28 smithi193 ceph-mon[32782]: pgmap v4818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:30 smithi196 ceph-mon[32572]: pgmap v4819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:30 smithi110 ceph-mon[28069]: pgmap v4819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:30 smithi193 ceph-mon[32782]: pgmap v4819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:31 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8126.929961 secs 2024-04-26T14:03:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:31 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8126.929961 secs 2024-04-26T14:03:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:31 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8126.929961 secs 2024-04-26T14:03:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:32 smithi196 ceph-mon[32572]: pgmap v4820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:32 smithi110 ceph-mon[28069]: pgmap v4820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:32 smithi193 ceph-mon[32782]: pgmap v4820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:34 smithi196 ceph-mon[32572]: pgmap v4821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:34 smithi110 ceph-mon[28069]: pgmap v4821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:34 smithi193 ceph-mon[32782]: pgmap v4821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:37 smithi196 ceph-mon[32572]: pgmap v4822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8131.930091 secs 2024-04-26T14:03:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:37 smithi110 ceph-mon[28069]: pgmap v4822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8131.930091 secs 2024-04-26T14:03:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:37 smithi193 ceph-mon[32782]: pgmap v4822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8131.930091 secs 2024-04-26T14:03:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:39 smithi110 ceph-mon[28069]: pgmap v4823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:39 smithi193 ceph-mon[32782]: pgmap v4823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:39 smithi196 ceph-mon[32572]: pgmap v4823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:41 smithi110 ceph-mon[28069]: pgmap v4824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:41 smithi193 ceph-mon[32782]: pgmap v4824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:41 smithi196 ceph-mon[32572]: pgmap v4824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8136.930251 secs 2024-04-26T14:03:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8136.930251 secs 2024-04-26T14:03:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8136.930251 secs 2024-04-26T14:03:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:43 smithi110 ceph-mon[28069]: pgmap v4825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:43 smithi193 ceph-mon[32782]: pgmap v4825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:43 smithi196 ceph-mon[32572]: pgmap v4825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:45 smithi110 ceph-mon[28069]: pgmap v4826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:45 smithi193 ceph-mon[32782]: pgmap v4826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:45 smithi196 ceph-mon[32572]: pgmap v4826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:03:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:03:46.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:03:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:03:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:47 smithi193 ceph-mon[32782]: pgmap v4827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8141.930323 secs 2024-04-26T14:03:47.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:47 smithi196 ceph-mon[32572]: pgmap v4827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:47.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8141.930323 secs 2024-04-26T14:03:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:47 smithi110 ceph-mon[28069]: pgmap v4827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8141.930323 secs 2024-04-26T14:03:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:03:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:03:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:48 smithi193 ceph-mon[32782]: pgmap v4828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:03:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:48 smithi193 ceph-mon[32782]: pgmap v4829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:03:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:03:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:03:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:48 smithi196 ceph-mon[32572]: pgmap v4828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:03:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:48 smithi196 ceph-mon[32572]: pgmap v4829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:03:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:03:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:03:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:48 smithi110 ceph-mon[28069]: pgmap v4828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:03:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:48 smithi110 ceph-mon[28069]: pgmap v4829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:03:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:50 smithi193 ceph-mon[32782]: pgmap v4830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:50 smithi196 ceph-mon[32572]: pgmap v4830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:50 smithi110 ceph-mon[28069]: pgmap v4830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:51.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:51 smithi193 ceph-mon[32782]: pgmap v4831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:51.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:51 smithi196 ceph-mon[32572]: pgmap v4831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:51 smithi110 ceph-mon[28069]: pgmap v4831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8146.930445 secs 2024-04-26T14:03:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8146.930445 secs 2024-04-26T14:03:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8146.930445 secs 2024-04-26T14:03:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:53 smithi196 ceph-mon[32572]: pgmap v4832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:53 smithi110 ceph-mon[28069]: pgmap v4832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:53 smithi193 ceph-mon[32782]: pgmap v4832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:56 smithi193 ceph-mon[32782]: pgmap v4833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:56 smithi196 ceph-mon[32572]: pgmap v4833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:56 smithi110 ceph-mon[28069]: pgmap v4833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:03:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8151.930580 secs 2024-04-26T14:03:57.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8151.930580 secs 2024-04-26T14:03:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8151.930580 secs 2024-04-26T14:03:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:58 smithi193 ceph-mon[32782]: pgmap v4834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:03:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:58 smithi196 ceph-mon[32572]: pgmap v4834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:03:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:58 smithi110 ceph-mon[28069]: pgmap v4834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:03:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:03:59 smithi193 ceph-mon[32782]: pgmap v4835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:03:59 smithi196 ceph-mon[32572]: pgmap v4835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:03:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:03:59 smithi110 ceph-mon[28069]: pgmap v4835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8156.930681 secs 2024-04-26T14:04:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:02 smithi193 ceph-mon[32782]: pgmap v4836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8156.930681 secs 2024-04-26T14:04:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:02 smithi196 ceph-mon[32572]: pgmap v4836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8156.930681 secs 2024-04-26T14:04:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:02 smithi110 ceph-mon[28069]: pgmap v4836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:03 smithi193 ceph-mon[32782]: pgmap v4837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:03 smithi196 ceph-mon[32572]: pgmap v4837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:03 smithi110 ceph-mon[28069]: pgmap v4837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:04:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:04:04.211+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:04:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:04:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:04:04.211+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:04:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:04:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:04:04.211+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:04:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:04:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:04:04.211+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:04:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:04:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:04:04.211+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:04:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:06 smithi193 ceph-mon[32782]: pgmap v4838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:06 smithi196 ceph-mon[32572]: pgmap v4838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:06 smithi110 ceph-mon[28069]: pgmap v4838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8161.930796 secs 2024-04-26T14:04:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:07 smithi193 ceph-mon[32782]: pgmap v4839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8161.930796 secs 2024-04-26T14:04:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:07 smithi196 ceph-mon[32572]: pgmap v4839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8161.930796 secs 2024-04-26T14:04:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:07 smithi110 ceph-mon[28069]: pgmap v4839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:09 smithi193 ceph-mon[32782]: pgmap v4840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:09 smithi196 ceph-mon[32572]: pgmap v4840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:09 smithi110 ceph-mon[28069]: pgmap v4840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:11 smithi193 ceph-mon[32782]: pgmap v4841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:11 smithi196 ceph-mon[32572]: pgmap v4841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:11 smithi110 ceph-mon[28069]: pgmap v4841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8166.930919 secs 2024-04-26T14:04:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8166.930919 secs 2024-04-26T14:04:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8166.930919 secs 2024-04-26T14:04:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:13 smithi196 ceph-mon[32572]: pgmap v4842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:13 smithi110 ceph-mon[28069]: pgmap v4842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:13 smithi193 ceph-mon[32782]: pgmap v4842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:15 smithi193 ceph-mon[32782]: pgmap v4843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:15 smithi196 ceph-mon[32572]: pgmap v4843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:15 smithi110 ceph-mon[28069]: pgmap v4843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:16 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8171.931034 secs 2024-04-26T14:04:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:16 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8171.931034 secs 2024-04-26T14:04:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:16 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8171.931034 secs 2024-04-26T14:04:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:17 smithi196 ceph-mon[32572]: pgmap v4844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:17 smithi110 ceph-mon[28069]: pgmap v4844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:17 smithi193 ceph-mon[32782]: pgmap v4844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T14:04:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:19 smithi193 ceph-mon[32782]: pgmap v4845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:19 smithi196 ceph-mon[32572]: pgmap v4845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:19 smithi110 ceph-mon[28069]: pgmap v4845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:21 smithi193 ceph-mon[32782]: pgmap v4846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:21 smithi196 ceph-mon[32572]: pgmap v4846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:21 smithi110 ceph-mon[28069]: pgmap v4846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8176.931153 secs 2024-04-26T14:04:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8176.931153 secs 2024-04-26T14:04:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8176.931153 secs 2024-04-26T14:04:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:23 smithi196 ceph-mon[32572]: pgmap v4847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:23 smithi110 ceph-mon[28069]: pgmap v4847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:23 smithi193 ceph-mon[32782]: pgmap v4847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:25 smithi193 ceph-mon[32782]: pgmap v4848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:25.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:25 smithi196 ceph-mon[32572]: pgmap v4848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:25 smithi110 ceph-mon[28069]: pgmap v4848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:26 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8181.931271 secs 2024-04-26T14:04:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:26 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8181.931271 secs 2024-04-26T14:04:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:26 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8181.931271 secs 2024-04-26T14:04:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:27 smithi196 ceph-mon[32572]: pgmap v4849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:27 smithi110 ceph-mon[28069]: pgmap v4849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:27 smithi193 ceph-mon[32782]: pgmap v4849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:29 smithi193 ceph-mon[32782]: pgmap v4850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:29 smithi196 ceph-mon[32572]: pgmap v4850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:29 smithi110 ceph-mon[28069]: pgmap v4850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:31 smithi193 ceph-mon[32782]: pgmap v4851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:31 smithi196 ceph-mon[32572]: pgmap v4851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:31 smithi110 ceph-mon[28069]: pgmap v4851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8186.931357 secs 2024-04-26T14:04:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8186.931357 secs 2024-04-26T14:04:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8186.931357 secs 2024-04-26T14:04:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:33 smithi196 ceph-mon[32572]: pgmap v4852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:33 smithi110 ceph-mon[28069]: pgmap v4852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:33 smithi193 ceph-mon[32782]: pgmap v4852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:35 smithi196 ceph-mon[32572]: pgmap v4853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:35 smithi110 ceph-mon[28069]: pgmap v4853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:35 smithi193 ceph-mon[32782]: pgmap v4853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:36 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8191.931472 secs 2024-04-26T14:04:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:36 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8191.931472 secs 2024-04-26T14:04:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:36 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8191.931472 secs 2024-04-26T14:04:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:37 smithi196 ceph-mon[32572]: pgmap v4854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:37.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:37 smithi193 ceph-mon[32782]: pgmap v4854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:37 smithi110 ceph-mon[28069]: pgmap v4854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:39 smithi196 ceph-mon[32572]: pgmap v4855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:39 smithi110 ceph-mon[28069]: pgmap v4855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:39 smithi193 ceph-mon[32782]: pgmap v4855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:41 smithi196 ceph-mon[32572]: pgmap v4856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:41 smithi110 ceph-mon[28069]: pgmap v4856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:41 smithi193 ceph-mon[32782]: pgmap v4856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8196.931590 secs 2024-04-26T14:04:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8196.931590 secs 2024-04-26T14:04:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8196.931590 secs 2024-04-26T14:04:43.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:43 smithi196 ceph-mon[32572]: pgmap v4857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:43 smithi110 ceph-mon[28069]: pgmap v4857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:43 smithi193 ceph-mon[32782]: pgmap v4857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:45 smithi196 ceph-mon[32572]: pgmap v4858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:45 smithi110 ceph-mon[28069]: pgmap v4858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:45 smithi193 ceph-mon[32782]: pgmap v4858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:46 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8201.931685 secs 2024-04-26T14:04:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:46 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8201.931685 secs 2024-04-26T14:04:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:46 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8201.931685 secs 2024-04-26T14:04:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:47 smithi196 ceph-mon[32572]: pgmap v4859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:47 smithi110 ceph-mon[28069]: pgmap v4859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:47 smithi193 ceph-mon[32782]: pgmap v4859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:04:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:04:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:04:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:04:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:04:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:04:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:04:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:04:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:04:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:49 smithi196 ceph-mon[32572]: pgmap v4860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:49 smithi110 ceph-mon[28069]: pgmap v4860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:49 smithi193 ceph-mon[32782]: pgmap v4860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:04:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:04:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:04:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:50 smithi196 ceph-mon[32572]: pgmap v4861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T14:04:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:50 smithi196 ceph-mon[32572]: pgmap v4862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:04:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:04:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:04:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:50 smithi110 ceph-mon[28069]: pgmap v4861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T14:04:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:50 smithi110 ceph-mon[28069]: pgmap v4862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:04:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:04:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:04:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:50 smithi193 ceph-mon[32782]: pgmap v4861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T14:04:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:50 smithi193 ceph-mon[32782]: pgmap v4862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:04:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:51 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8206.931806 secs 2024-04-26T14:04:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:51 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8206.931806 secs 2024-04-26T14:04:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:51 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8206.931806 secs 2024-04-26T14:04:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:52 smithi110 ceph-mon[28069]: pgmap v4863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:04:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:52 smithi193 ceph-mon[32782]: pgmap v4863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:04:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:52 smithi196 ceph-mon[32572]: pgmap v4863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:04:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:54 smithi196 ceph-mon[32572]: pgmap v4864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:54 smithi110 ceph-mon[28069]: pgmap v4864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:54 smithi193 ceph-mon[32782]: pgmap v4864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:56 smithi196 ceph-mon[32572]: pgmap v4865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:04:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:56 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8211.931919 secs 2024-04-26T14:04:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:56 smithi110 ceph-mon[28069]: pgmap v4865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:04:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:56 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8211.931919 secs 2024-04-26T14:04:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:56 smithi193 ceph-mon[32782]: pgmap v4865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:04:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:56 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8211.931919 secs 2024-04-26T14:04:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:04:58 smithi196 ceph-mon[32572]: pgmap v4866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:04:58 smithi110 ceph-mon[28069]: pgmap v4866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:04:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:04:58 smithi193 ceph-mon[32782]: pgmap v4866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:00 smithi196 ceph-mon[32572]: pgmap v4867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:05:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:00 smithi110 ceph-mon[28069]: pgmap v4867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:05:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:00 smithi193 ceph-mon[32782]: pgmap v4867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:05:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:01 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8216.932039 secs 2024-04-26T14:05:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:01 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8216.932039 secs 2024-04-26T14:05:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:01 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8216.932039 secs 2024-04-26T14:05:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:02 smithi196 ceph-mon[32572]: pgmap v4868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:02 smithi110 ceph-mon[28069]: pgmap v4868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:02 smithi193 ceph-mon[32782]: pgmap v4868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:04 smithi196 ceph-mon[32572]: pgmap v4869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:05:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:04 smithi110 ceph-mon[28069]: pgmap v4869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:05:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:04 smithi193 ceph-mon[32782]: pgmap v4869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:05:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:06 smithi196 ceph-mon[32572]: pgmap v4870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:05:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:06 smithi196 ceph-mon[32572]: 8 slow requests, 1 included below; oldest blocked for > 8221.932163 secs 2024-04-26T14:05:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:06 smithi196 ceph-mon[32572]: slow request 362.229685 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:05:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:06 smithi110 ceph-mon[28069]: pgmap v4870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:05:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:06 smithi110 ceph-mon[28069]: 8 slow requests, 1 included below; oldest blocked for > 8221.932163 secs 2024-04-26T14:05:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:06 smithi110 ceph-mon[28069]: slow request 362.229685 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:05:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:06 smithi193 ceph-mon[32782]: pgmap v4870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:05:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:06 smithi193 ceph-mon[32782]: 8 slow requests, 1 included below; oldest blocked for > 8221.932163 secs 2024-04-26T14:05:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:06 smithi193 ceph-mon[32782]: slow request 362.229685 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:05:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:08 smithi110 ceph-mon[28069]: pgmap v4871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:05:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:08 smithi193 ceph-mon[32782]: pgmap v4871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:05:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:08 smithi196 ceph-mon[32572]: pgmap v4871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:05:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:10 smithi110 ceph-mon[28069]: pgmap v4872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:05:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:10 smithi193 ceph-mon[32782]: pgmap v4872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:05:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:10 smithi196 ceph-mon[32572]: pgmap v4872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:05:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:11 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8226.932306 secs 2024-04-26T14:05:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:11 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8226.932306 secs 2024-04-26T14:05:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:11 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8226.932306 secs 2024-04-26T14:05:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:12 smithi110 ceph-mon[28069]: pgmap v4873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:05:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:12 smithi193 ceph-mon[32782]: pgmap v4873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:05:13.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:12 smithi196 ceph-mon[32572]: pgmap v4873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:05:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:14 smithi110 ceph-mon[28069]: pgmap v4874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:05:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:14 smithi193 ceph-mon[32782]: pgmap v4874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:05:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:14 smithi196 ceph-mon[32572]: pgmap v4874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:05:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:16 smithi110 ceph-mon[28069]: pgmap v4875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:16 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8231.932423 secs 2024-04-26T14:05:17.055 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:16 smithi196 ceph-mon[32572]: pgmap v4875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:17.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:16 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8231.932423 secs 2024-04-26T14:05:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:16 smithi193 ceph-mon[32782]: pgmap v4875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:16 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8231.932423 secs 2024-04-26T14:05:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:18 smithi193 ceph-mon[32782]: pgmap v4876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:18 smithi196 ceph-mon[32572]: pgmap v4876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:18 smithi110 ceph-mon[28069]: pgmap v4876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:20 smithi193 ceph-mon[32782]: pgmap v4877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:20 smithi196 ceph-mon[32572]: pgmap v4877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:20 smithi110 ceph-mon[28069]: pgmap v4877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:21 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8236.932586 secs 2024-04-26T14:05:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:21 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8236.932586 secs 2024-04-26T14:05:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:21 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8236.932586 secs 2024-04-26T14:05:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:22 smithi193 ceph-mon[32782]: pgmap v4878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:22 smithi196 ceph-mon[32572]: pgmap v4878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:22 smithi110 ceph-mon[28069]: pgmap v4878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:24 smithi193 ceph-mon[32782]: pgmap v4879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:25.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:24 smithi196 ceph-mon[32572]: pgmap v4879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:24 smithi110 ceph-mon[28069]: pgmap v4879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:26 smithi193 ceph-mon[32782]: pgmap v4880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:26 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8241.932713 secs 2024-04-26T14:05:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:26 smithi196 ceph-mon[32572]: pgmap v4880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:26 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8241.932713 secs 2024-04-26T14:05:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:26 smithi110 ceph-mon[28069]: pgmap v4880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:26 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8241.932713 secs 2024-04-26T14:05:29.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:28 smithi110 ceph-mon[28069]: pgmap v4881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:28 smithi193 ceph-mon[32782]: pgmap v4881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:28 smithi196 ceph-mon[32572]: pgmap v4881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:30 smithi193 ceph-mon[32782]: pgmap v4882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:30 smithi196 ceph-mon[32572]: pgmap v4882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:30 smithi110 ceph-mon[28069]: pgmap v4882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:31 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8246.932792 secs 2024-04-26T14:05:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:31 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8246.932792 secs 2024-04-26T14:05:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:31 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8246.932792 secs 2024-04-26T14:05:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:32 smithi193 ceph-mon[32782]: pgmap v4883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:32 smithi196 ceph-mon[32572]: pgmap v4883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:32 smithi110 ceph-mon[28069]: pgmap v4883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:34 smithi193 ceph-mon[32782]: pgmap v4884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:34 smithi196 ceph-mon[32572]: pgmap v4884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:34 smithi110 ceph-mon[28069]: pgmap v4884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:36 smithi193 ceph-mon[32782]: pgmap v4885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:36 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8251.932909 secs 2024-04-26T14:05:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:36 smithi196 ceph-mon[32572]: pgmap v4885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:36 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8251.932909 secs 2024-04-26T14:05:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:36 smithi110 ceph-mon[28069]: pgmap v4885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:36 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8251.932909 secs 2024-04-26T14:05:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:38 smithi193 ceph-mon[32782]: pgmap v4886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:38 smithi196 ceph-mon[32572]: pgmap v4886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:38 smithi110 ceph-mon[28069]: pgmap v4886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:40 smithi196 ceph-mon[32572]: pgmap v4887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:40 smithi110 ceph-mon[28069]: pgmap v4887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:40 smithi193 ceph-mon[32782]: pgmap v4887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:41 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8256.933028 secs 2024-04-26T14:05:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:41 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8256.933028 secs 2024-04-26T14:05:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:41 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8256.933028 secs 2024-04-26T14:05:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:42 smithi196 ceph-mon[32572]: pgmap v4888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:42 smithi110 ceph-mon[28069]: pgmap v4888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:42 smithi193 ceph-mon[32782]: pgmap v4888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:44 smithi196 ceph-mon[32572]: pgmap v4889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:44 smithi110 ceph-mon[28069]: pgmap v4889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:44 smithi193 ceph-mon[32782]: pgmap v4889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:46 smithi196 ceph-mon[32572]: pgmap v4890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:46 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8261.933146 secs 2024-04-26T14:05:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:46 smithi110 ceph-mon[28069]: pgmap v4890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:46 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8261.933146 secs 2024-04-26T14:05:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:46 smithi193 ceph-mon[32782]: pgmap v4890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:46 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8261.933146 secs 2024-04-26T14:05:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:48 smithi196 ceph-mon[32572]: pgmap v4891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:48 smithi110 ceph-mon[28069]: pgmap v4891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:48 smithi193 ceph-mon[32782]: pgmap v4891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:05:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:05:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:05:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:05:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:50 smithi196 ceph-mon[32572]: pgmap v4892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:50 smithi110 ceph-mon[28069]: pgmap v4892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:50 smithi193 ceph-mon[32782]: pgmap v4892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:05:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:51 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8266.933264 secs 2024-04-26T14:05:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:05:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:05:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:51 smithi196 ceph-mon[32572]: pgmap v4893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T14:05:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:51 smithi196 ceph-mon[32572]: pgmap v4894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:51 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8266.933264 secs 2024-04-26T14:05:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:05:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:05:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:51 smithi110 ceph-mon[28069]: pgmap v4893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T14:05:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:51 smithi110 ceph-mon[28069]: pgmap v4894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:51 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8266.933264 secs 2024-04-26T14:05:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:05:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:05:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:51 smithi193 ceph-mon[32782]: pgmap v4893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T14:05:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:51 smithi193 ceph-mon[32782]: pgmap v4894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:05:53.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:53 smithi196 ceph-mon[32572]: pgmap v4895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:53 smithi110 ceph-mon[28069]: pgmap v4895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:53 smithi193 ceph-mon[32782]: pgmap v4895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:55 smithi196 ceph-mon[32572]: pgmap v4896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:55 smithi110 ceph-mon[28069]: pgmap v4896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:55 smithi193 ceph-mon[32782]: pgmap v4896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:56 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8271.933396 secs 2024-04-26T14:05:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:56 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8271.933396 secs 2024-04-26T14:05:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:56 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8271.933396 secs 2024-04-26T14:05:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:57 smithi196 ceph-mon[32572]: pgmap v4897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:57 smithi110 ceph-mon[28069]: pgmap v4897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:57 smithi193 ceph-mon[32782]: pgmap v4897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:05:59 smithi196 ceph-mon[32572]: pgmap v4898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:05:59 smithi110 ceph-mon[28069]: pgmap v4898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:05:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:05:59 smithi193 ceph-mon[32782]: pgmap v4898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:06:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:01 smithi196 ceph-mon[32572]: pgmap v4899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:06:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:01 smithi110 ceph-mon[28069]: pgmap v4899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:06:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:01 smithi193 ceph-mon[32782]: pgmap v4899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:06:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8276.933496 secs 2024-04-26T14:06:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8276.933496 secs 2024-04-26T14:06:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8276.933496 secs 2024-04-26T14:06:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:03 smithi196 ceph-mon[32572]: pgmap v4900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:03 smithi110 ceph-mon[28069]: pgmap v4900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:03 smithi193 ceph-mon[32782]: pgmap v4900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:05 smithi196 ceph-mon[32572]: pgmap v4901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:05 smithi110 ceph-mon[28069]: pgmap v4901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:05 smithi193 ceph-mon[32782]: pgmap v4901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:06 smithi196 ceph-mon[32572]: 8 slow requests, 1 included below; oldest blocked for > 8281.933620 secs 2024-04-26T14:06:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:06 smithi196 ceph-mon[32572]: slow request 722.327190 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:06:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:06 smithi110 ceph-mon[28069]: 8 slow requests, 1 included below; oldest blocked for > 8281.933620 secs 2024-04-26T14:06:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:06 smithi110 ceph-mon[28069]: slow request 722.327190 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:06:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:06 smithi193 ceph-mon[32782]: 8 slow requests, 1 included below; oldest blocked for > 8281.933620 secs 2024-04-26T14:06:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:06 smithi193 ceph-mon[32782]: slow request 722.327190 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:06:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:08 smithi196 ceph-mon[32572]: pgmap v4902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:08 smithi110 ceph-mon[28069]: pgmap v4902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:08 smithi193 ceph-mon[32782]: pgmap v4902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:10 smithi196 ceph-mon[32572]: pgmap v4903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:10 smithi110 ceph-mon[28069]: pgmap v4903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:10 smithi193 ceph-mon[32782]: pgmap v4903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:11 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8286.933743 secs 2024-04-26T14:06:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:11 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8286.933743 secs 2024-04-26T14:06:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:11 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8286.933743 secs 2024-04-26T14:06:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:12 smithi110 ceph-mon[28069]: pgmap v4904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:12 smithi193 ceph-mon[32782]: pgmap v4904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:12 smithi196 ceph-mon[32572]: pgmap v4904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:14 smithi110 ceph-mon[28069]: pgmap v4905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:14.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:14 smithi193 ceph-mon[32782]: pgmap v4905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:14 smithi196 ceph-mon[32572]: pgmap v4905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:16 smithi110 ceph-mon[28069]: pgmap v4906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:16 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8291.933882 secs 2024-04-26T14:06:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:16 smithi193 ceph-mon[32782]: pgmap v4906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:16 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8291.933882 secs 2024-04-26T14:06:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:16 smithi196 ceph-mon[32572]: pgmap v4906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:16 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8291.933882 secs 2024-04-26T14:06:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:06:17.707+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006390 con 0x7f261c104b50 2024-04-26T14:06:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:06:17.707+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:06:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:06:17.708+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 67 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:06:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:06:17.708+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 67 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006390 con 0x55db1be4fdd0 2024-04-26T14:06:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:18 smithi110 ceph-mon[28069]: pgmap v4907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:18.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:18 smithi196 ceph-mon[32572]: pgmap v4907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:18 smithi193 ceph-mon[32782]: pgmap v4907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:20 smithi110 ceph-mon[28069]: pgmap v4908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:20 smithi193 ceph-mon[32782]: pgmap v4908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:20 smithi196 ceph-mon[32572]: pgmap v4908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:21 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8296.934024 secs 2024-04-26T14:06:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:21 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8296.934024 secs 2024-04-26T14:06:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:21 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8296.934024 secs 2024-04-26T14:06:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:22 smithi110 ceph-mon[28069]: pgmap v4909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:22 smithi193 ceph-mon[32782]: pgmap v4909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:22 smithi196 ceph-mon[32572]: pgmap v4909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:24 smithi193 ceph-mon[32782]: pgmap v4910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:24 smithi196 ceph-mon[32572]: pgmap v4910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:24 smithi110 ceph-mon[28069]: pgmap v4910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:26 smithi193 ceph-mon[32782]: pgmap v4911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:26 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8301.934143 secs 2024-04-26T14:06:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:26 smithi196 ceph-mon[32572]: pgmap v4911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:26 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8301.934143 secs 2024-04-26T14:06:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:26 smithi110 ceph-mon[28069]: pgmap v4911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:26 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8301.934143 secs 2024-04-26T14:06:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:28 smithi193 ceph-mon[32782]: pgmap v4912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:28 smithi196 ceph-mon[32572]: pgmap v4912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:28 smithi110 ceph-mon[28069]: pgmap v4912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:30.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:30 smithi110 ceph-mon[28069]: pgmap v4913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:30 smithi193 ceph-mon[32782]: pgmap v4913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:30 smithi196 ceph-mon[32572]: pgmap v4913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:31 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8306.934206 secs 2024-04-26T14:06:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:31 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8306.934206 secs 2024-04-26T14:06:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:31 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8306.934206 secs 2024-04-26T14:06:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:32 smithi193 ceph-mon[32782]: pgmap v4914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:32 smithi196 ceph-mon[32572]: pgmap v4914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:32 smithi110 ceph-mon[28069]: pgmap v4914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:34 smithi193 ceph-mon[32782]: pgmap v4915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:34 smithi196 ceph-mon[32572]: pgmap v4915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:34 smithi110 ceph-mon[28069]: pgmap v4915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:36 smithi193 ceph-mon[32782]: pgmap v4916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:36 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8311.934306 secs 2024-04-26T14:06:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:36 smithi196 ceph-mon[32572]: pgmap v4916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:36 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8311.934306 secs 2024-04-26T14:06:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:36 smithi110 ceph-mon[28069]: pgmap v4916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:36 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8311.934306 secs 2024-04-26T14:06:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:38 smithi193 ceph-mon[32782]: pgmap v4917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:38 smithi196 ceph-mon[32572]: pgmap v4917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:38 smithi110 ceph-mon[28069]: pgmap v4917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:40 smithi193 ceph-mon[32782]: pgmap v4918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:40 smithi196 ceph-mon[32572]: pgmap v4918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:40 smithi110 ceph-mon[28069]: pgmap v4918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:41 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8316.934422 secs 2024-04-26T14:06:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:41 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8316.934422 secs 2024-04-26T14:06:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:41 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8316.934422 secs 2024-04-26T14:06:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:42 smithi193 ceph-mon[32782]: pgmap v4919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:42 smithi196 ceph-mon[32572]: pgmap v4919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:42 smithi110 ceph-mon[28069]: pgmap v4919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:44 smithi193 ceph-mon[32782]: pgmap v4920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:44 smithi196 ceph-mon[32572]: pgmap v4920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:44 smithi110 ceph-mon[28069]: pgmap v4920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:46 smithi193 ceph-mon[32782]: pgmap v4921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:46 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8321.934553 secs 2024-04-26T14:06:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:46 smithi196 ceph-mon[32572]: pgmap v4921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:46 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8321.934553 secs 2024-04-26T14:06:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:46 smithi110 ceph-mon[28069]: pgmap v4921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:46 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8321.934553 secs 2024-04-26T14:06:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:48 smithi196 ceph-mon[32572]: pgmap v4922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:48 smithi110 ceph-mon[28069]: pgmap v4922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:48 smithi193 ceph-mon[32782]: pgmap v4922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:50 smithi196 ceph-mon[32572]: pgmap v4923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:50 smithi110 ceph-mon[28069]: pgmap v4923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:50 smithi193 ceph-mon[32782]: pgmap v4923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:51 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8326.934680 secs 2024-04-26T14:06:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:06:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:51 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8326.934680 secs 2024-04-26T14:06:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:06:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:51 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8326.934680 secs 2024-04-26T14:06:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:06:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:52 smithi196 ceph-mon[32572]: pgmap v4924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:52 smithi193 ceph-mon[32782]: pgmap v4924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:53.013 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:52 smithi110 ceph-mon[28069]: pgmap v4924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: pgmap v4925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: pgmap v4925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:06:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:06:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: pgmap v4925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:06:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:55.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:55 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:06:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:55 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:06:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:55 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:06:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:55 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:06:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:55 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:06:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:55 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:06:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:56 smithi196 ceph-mon[32572]: pgmap v4926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:56 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8331.934788 secs 2024-04-26T14:06:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:56 smithi110 ceph-mon[28069]: pgmap v4926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:56 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8331.934788 secs 2024-04-26T14:06:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:56 smithi193 ceph-mon[32782]: pgmap v4926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:06:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:56 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8331.934788 secs 2024-04-26T14:06:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: pgmap v4927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T14:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: pgmap v4928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T14:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:06:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: pgmap v4927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T14:06:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: pgmap v4928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T14:06:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:06:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: pgmap v4927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T14:06:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: pgmap v4928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T14:06:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:07:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:06:59 smithi196 ceph-mon[32572]: pgmap v4929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:06:59 smithi110 ceph-mon[28069]: pgmap v4929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:06:59 smithi193 ceph-mon[32782]: pgmap v4929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:01 smithi196 ceph-mon[32572]: pgmap v4930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:01 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8336.934921 secs 2024-04-26T14:07:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:01 smithi110 ceph-mon[28069]: pgmap v4930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:01 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8336.934921 secs 2024-04-26T14:07:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:01 smithi193 ceph-mon[32782]: pgmap v4930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:01 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8336.934921 secs 2024-04-26T14:07:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:03 smithi196 ceph-mon[32572]: pgmap v4931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:03 smithi110 ceph-mon[28069]: pgmap v4931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:03 smithi193 ceph-mon[32782]: pgmap v4931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:05 smithi196 ceph-mon[32572]: pgmap v4932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:05 smithi110 ceph-mon[28069]: pgmap v4932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:05 smithi193 ceph-mon[32782]: pgmap v4932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:07:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8341.934998 secs 2024-04-26T14:07:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8341.934998 secs 2024-04-26T14:07:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8341.934998 secs 2024-04-26T14:07:08.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:08 smithi193 ceph-mon[32782]: pgmap v4933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:07:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:08 smithi110 ceph-mon[28069]: pgmap v4933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:07:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:08 smithi196 ceph-mon[32572]: pgmap v4933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:07:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:10 smithi110 ceph-mon[28069]: pgmap v4934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:10 smithi193 ceph-mon[32782]: pgmap v4934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:10 smithi196 ceph-mon[32572]: pgmap v4934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:12 smithi110 ceph-mon[28069]: pgmap v4935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8346.935139 secs 2024-04-26T14:07:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:12 smithi193 ceph-mon[32782]: pgmap v4935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8346.935139 secs 2024-04-26T14:07:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:12 smithi196 ceph-mon[32572]: pgmap v4935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8346.935139 secs 2024-04-26T14:07:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:14 smithi110 ceph-mon[28069]: pgmap v4936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:14.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:14 smithi193 ceph-mon[32782]: pgmap v4936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:14 smithi196 ceph-mon[32572]: pgmap v4936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:16 smithi110 ceph-mon[28069]: pgmap v4937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:16.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:16 smithi193 ceph-mon[32782]: pgmap v4937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:16 smithi196 ceph-mon[32572]: pgmap v4937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8351.935277 secs 2024-04-26T14:07:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8351.935277 secs 2024-04-26T14:07:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8351.935277 secs 2024-04-26T14:07:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:18 smithi193 ceph-mon[32782]: pgmap v4938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:18.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:18 smithi196 ceph-mon[32572]: pgmap v4938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:18 smithi110 ceph-mon[28069]: pgmap v4938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:20 smithi193 ceph-mon[32782]: pgmap v4939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:20 smithi196 ceph-mon[32572]: pgmap v4939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:20 smithi110 ceph-mon[28069]: pgmap v4939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:22 smithi193 ceph-mon[32782]: pgmap v4940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8356.935431 secs 2024-04-26T14:07:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:22 smithi196 ceph-mon[32572]: pgmap v4940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8356.935431 secs 2024-04-26T14:07:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:22 smithi110 ceph-mon[28069]: pgmap v4940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8356.935431 secs 2024-04-26T14:07:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:24 smithi193 ceph-mon[32782]: pgmap v4941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:24 smithi196 ceph-mon[32572]: pgmap v4941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:24 smithi110 ceph-mon[28069]: pgmap v4941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:26 smithi193 ceph-mon[32782]: pgmap v4942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:26 smithi196 ceph-mon[32572]: pgmap v4942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:26 smithi110 ceph-mon[28069]: pgmap v4942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8361.935574 secs 2024-04-26T14:07:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8361.935574 secs 2024-04-26T14:07:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8361.935574 secs 2024-04-26T14:07:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:28 smithi193 ceph-mon[32782]: pgmap v4943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:28 smithi196 ceph-mon[32572]: pgmap v4943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:28 smithi110 ceph-mon[28069]: pgmap v4943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:30.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:30 smithi110 ceph-mon[28069]: pgmap v4944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:30.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:30 smithi193 ceph-mon[32782]: pgmap v4944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:30 smithi196 ceph-mon[32572]: pgmap v4944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:32 smithi193 ceph-mon[32782]: pgmap v4945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8366.935695 secs 2024-04-26T14:07:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:32 smithi196 ceph-mon[32572]: pgmap v4945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8366.935695 secs 2024-04-26T14:07:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:32 smithi110 ceph-mon[28069]: pgmap v4945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8366.935695 secs 2024-04-26T14:07:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:34 smithi193 ceph-mon[32782]: pgmap v4946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:34 smithi196 ceph-mon[32572]: pgmap v4946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:34 smithi110 ceph-mon[28069]: pgmap v4946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:36 smithi193 ceph-mon[32782]: pgmap v4947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:36 smithi196 ceph-mon[32572]: pgmap v4947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:36 smithi110 ceph-mon[28069]: pgmap v4947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8371.935824 secs 2024-04-26T14:07:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8371.935824 secs 2024-04-26T14:07:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8371.935824 secs 2024-04-26T14:07:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:38 smithi193 ceph-mon[32782]: pgmap v4948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:38 smithi196 ceph-mon[32572]: pgmap v4948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:38 smithi110 ceph-mon[28069]: pgmap v4948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:40 smithi193 ceph-mon[32782]: pgmap v4949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:40 smithi196 ceph-mon[32572]: pgmap v4949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:40 smithi110 ceph-mon[28069]: pgmap v4949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:42 smithi196 ceph-mon[32572]: pgmap v4950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8376.935890 secs 2024-04-26T14:07:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:42 smithi110 ceph-mon[28069]: pgmap v4950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8376.935890 secs 2024-04-26T14:07:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:42 smithi193 ceph-mon[32782]: pgmap v4950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8376.935890 secs 2024-04-26T14:07:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:44 smithi196 ceph-mon[32572]: pgmap v4951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:44 smithi110 ceph-mon[28069]: pgmap v4951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:44 smithi193 ceph-mon[32782]: pgmap v4951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:46 smithi196 ceph-mon[32572]: pgmap v4952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:46 smithi110 ceph-mon[28069]: pgmap v4952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:46 smithi193 ceph-mon[32782]: pgmap v4952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8381.935972 secs 2024-04-26T14:07:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8381.935972 secs 2024-04-26T14:07:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8381.935972 secs 2024-04-26T14:07:48.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:48 smithi196 ceph-mon[32572]: pgmap v4953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:48 smithi110 ceph-mon[28069]: pgmap v4953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:48 smithi193 ceph-mon[32782]: pgmap v4953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:50 smithi196 ceph-mon[32572]: pgmap v4954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:50 smithi110 ceph-mon[28069]: pgmap v4954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:50 smithi193 ceph-mon[32782]: pgmap v4954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:52 smithi196 ceph-mon[32572]: pgmap v4955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8386.936093 secs 2024-04-26T14:07:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:52 smithi110 ceph-mon[28069]: pgmap v4955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8386.936093 secs 2024-04-26T14:07:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:52 smithi193 ceph-mon[32782]: pgmap v4955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8386.936093 secs 2024-04-26T14:07:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:54 smithi196 ceph-mon[32572]: pgmap v4956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:54 smithi110 ceph-mon[28069]: pgmap v4956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:54 smithi193 ceph-mon[32782]: pgmap v4956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:07:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:56 smithi196 ceph-mon[32572]: pgmap v4957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:56 smithi110 ceph-mon[28069]: pgmap v4957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:56 smithi193 ceph-mon[32782]: pgmap v4957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8391.936213 secs 2024-04-26T14:07:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8391.936213 secs 2024-04-26T14:07:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8391.936213 secs 2024-04-26T14:07:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:58 smithi196 ceph-mon[32572]: pgmap v4958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:07:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:58 smithi110 ceph-mon[28069]: pgmap v4958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:07:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:58 smithi193 ceph-mon[32782]: pgmap v4958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:07:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:07:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:07:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:07:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:07:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:07:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:07:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:07:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:07:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:07:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:07:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:07:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:07:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:08:00.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:00 smithi110 ceph-mon[28069]: pgmap v4959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:08:00.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:00 smithi110 ceph-mon[28069]: pgmap v4960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:00 smithi196 ceph-mon[32572]: pgmap v4959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:08:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:00 smithi196 ceph-mon[32572]: pgmap v4960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:00 smithi193 ceph-mon[32782]: pgmap v4959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:08:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:00 smithi193 ceph-mon[32782]: pgmap v4960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:02 smithi196 ceph-mon[32572]: pgmap v4961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8396.936290 secs 2024-04-26T14:08:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:02 smithi110 ceph-mon[28069]: pgmap v4961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8396.936290 secs 2024-04-26T14:08:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:02 smithi193 ceph-mon[32782]: pgmap v4961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8396.936290 secs 2024-04-26T14:08:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:04 smithi196 ceph-mon[32572]: pgmap v4962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:04 smithi110 ceph-mon[28069]: pgmap v4962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:04 smithi193 ceph-mon[32782]: pgmap v4962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:06 smithi196 ceph-mon[32572]: pgmap v4963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:06 smithi110 ceph-mon[28069]: pgmap v4963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:06 smithi193 ceph-mon[32782]: pgmap v4963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8401.936414 secs 2024-04-26T14:08:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8401.936414 secs 2024-04-26T14:08:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8401.936414 secs 2024-04-26T14:08:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:08 smithi196 ceph-mon[32572]: pgmap v4964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:08.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:08 smithi193 ceph-mon[32782]: pgmap v4964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:08 smithi110 ceph-mon[28069]: pgmap v4964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:08:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:10 smithi196 ceph-mon[32572]: pgmap v4965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:08:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:10 smithi110 ceph-mon[28069]: pgmap v4965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:08:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:10 smithi193 ceph-mon[32782]: pgmap v4965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:08:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:12 smithi196 ceph-mon[32572]: pgmap v4966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8406.936507 secs 2024-04-26T14:08:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:12 smithi110 ceph-mon[28069]: pgmap v4966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8406.936507 secs 2024-04-26T14:08:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:12 smithi193 ceph-mon[32782]: pgmap v4966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8406.936507 secs 2024-04-26T14:08:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:14 smithi196 ceph-mon[32572]: pgmap v4967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:14 smithi110 ceph-mon[28069]: pgmap v4967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:14 smithi193 ceph-mon[32782]: pgmap v4967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:16 smithi196 ceph-mon[32572]: pgmap v4968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:16 smithi110 ceph-mon[28069]: pgmap v4968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:16 smithi193 ceph-mon[32782]: pgmap v4968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8411.936652 secs 2024-04-26T14:08:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8411.936652 secs 2024-04-26T14:08:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8411.936652 secs 2024-04-26T14:08:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:18 smithi196 ceph-mon[32572]: pgmap v4969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:18 smithi110 ceph-mon[28069]: pgmap v4969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:18 smithi193 ceph-mon[32782]: pgmap v4969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:20 smithi110 ceph-mon[28069]: pgmap v4970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:20 smithi193 ceph-mon[32782]: pgmap v4970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:20 smithi196 ceph-mon[32572]: pgmap v4970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:22 smithi110 ceph-mon[28069]: pgmap v4971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8416.936772 secs 2024-04-26T14:08:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:22 smithi193 ceph-mon[32782]: pgmap v4971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8416.936772 secs 2024-04-26T14:08:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:22 smithi196 ceph-mon[32572]: pgmap v4971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8416.936772 secs 2024-04-26T14:08:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:24 smithi110 ceph-mon[28069]: pgmap v4972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:24 smithi193 ceph-mon[32782]: pgmap v4972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:24 smithi196 ceph-mon[32572]: pgmap v4972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:26 smithi110 ceph-mon[28069]: pgmap v4973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:26 smithi193 ceph-mon[32782]: pgmap v4973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:26 smithi196 ceph-mon[32572]: pgmap v4973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8421.936896 secs 2024-04-26T14:08:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8421.936896 secs 2024-04-26T14:08:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8421.936896 secs 2024-04-26T14:08:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:28 smithi110 ceph-mon[28069]: pgmap v4974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:28 smithi193 ceph-mon[32782]: pgmap v4974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:28 smithi196 ceph-mon[32572]: pgmap v4974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:30 smithi193 ceph-mon[32782]: pgmap v4975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:30 smithi196 ceph-mon[32572]: pgmap v4975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:30 smithi110 ceph-mon[28069]: pgmap v4975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:32 smithi193 ceph-mon[32782]: pgmap v4976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8426.937019 secs 2024-04-26T14:08:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:08:32.729+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:08:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:08:32.729+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006390 con 0x7f261c104b50 2024-04-26T14:08:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:08:32.730+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 68 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:08:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:08:32.730+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 68 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006390 con 0x55db1be4fdd0 2024-04-26T14:08:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:32 smithi196 ceph-mon[32572]: pgmap v4976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8426.937019 secs 2024-04-26T14:08:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:32 smithi110 ceph-mon[28069]: pgmap v4976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8426.937019 secs 2024-04-26T14:08:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:34 smithi193 ceph-mon[32782]: pgmap v4977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:34 smithi196 ceph-mon[32572]: pgmap v4977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:34 smithi110 ceph-mon[28069]: pgmap v4977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:36 smithi193 ceph-mon[32782]: pgmap v4978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:36 smithi196 ceph-mon[32572]: pgmap v4978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:36 smithi110 ceph-mon[28069]: pgmap v4978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8431.937139 secs 2024-04-26T14:08:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8431.937139 secs 2024-04-26T14:08:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8431.937139 secs 2024-04-26T14:08:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:38 smithi193 ceph-mon[32782]: pgmap v4979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:38 smithi196 ceph-mon[32572]: pgmap v4979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:38 smithi110 ceph-mon[28069]: pgmap v4979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:40 smithi193 ceph-mon[32782]: pgmap v4980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:40 smithi196 ceph-mon[32572]: pgmap v4980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:40 smithi110 ceph-mon[28069]: pgmap v4980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:42 smithi193 ceph-mon[32782]: pgmap v4981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8436.937259 secs 2024-04-26T14:08:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:42 smithi196 ceph-mon[32572]: pgmap v4981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8436.937259 secs 2024-04-26T14:08:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:42 smithi110 ceph-mon[28069]: pgmap v4981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8436.937259 secs 2024-04-26T14:08:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:44 smithi193 ceph-mon[32782]: pgmap v4982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:44 smithi196 ceph-mon[32572]: pgmap v4982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:44 smithi110 ceph-mon[28069]: pgmap v4982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:46 smithi193 ceph-mon[32782]: pgmap v4983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:46 smithi196 ceph-mon[32572]: pgmap v4983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:46 smithi110 ceph-mon[28069]: pgmap v4983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8441.937362 secs 2024-04-26T14:08:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8441.937362 secs 2024-04-26T14:08:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8441.937362 secs 2024-04-26T14:08:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:48 smithi193 ceph-mon[32782]: pgmap v4984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:48.654 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:48 smithi196 ceph-mon[32572]: pgmap v4984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:48 smithi110 ceph-mon[28069]: pgmap v4984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:50 smithi193 ceph-mon[32782]: pgmap v4985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:50 smithi196 ceph-mon[32572]: pgmap v4985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:50 smithi110 ceph-mon[28069]: pgmap v4985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:52 smithi196 ceph-mon[32572]: pgmap v4986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8446.937482 secs 2024-04-26T14:08:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:52 smithi110 ceph-mon[28069]: pgmap v4986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8446.937482 secs 2024-04-26T14:08:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:52 smithi193 ceph-mon[32782]: pgmap v4986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8446.937482 secs 2024-04-26T14:08:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:53 smithi196 ceph-mon[32572]: pgmap v4987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:53 smithi110 ceph-mon[28069]: pgmap v4987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:53 smithi193 ceph-mon[32782]: pgmap v4987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:55 smithi110 ceph-mon[28069]: pgmap v4988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:55 smithi193 ceph-mon[32782]: pgmap v4988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:55 smithi196 ceph-mon[32572]: pgmap v4988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:56 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8451.937596 secs 2024-04-26T14:08:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:56 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8451.937596 secs 2024-04-26T14:08:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:56 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8451.937596 secs 2024-04-26T14:08:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:57 smithi193 ceph-mon[32782]: pgmap v4989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:57 smithi196 ceph-mon[32572]: pgmap v4989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:57 smithi110 ceph-mon[28069]: pgmap v4989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:08:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:59 smithi193 ceph-mon[32782]: pgmap v4990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:08:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:08:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:09:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:59 smithi196 ceph-mon[32572]: pgmap v4990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:08:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:09:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:59 smithi110 ceph-mon[28069]: pgmap v4990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:08:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:09:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:09:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:09:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:00 smithi193 ceph-mon[32782]: pgmap v4991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:09:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:00 smithi193 ceph-mon[32782]: pgmap v4992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:09:00.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:09:00.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:09:00.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:00 smithi110 ceph-mon[28069]: pgmap v4991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:09:00.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:00 smithi110 ceph-mon[28069]: pgmap v4992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:00.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:09:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:09:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:09:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:00 smithi196 ceph-mon[32572]: pgmap v4991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:09:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:00 smithi196 ceph-mon[32572]: pgmap v4992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:09:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:01 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8456.937667 secs 2024-04-26T14:09:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:01 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8456.937667 secs 2024-04-26T14:09:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:01 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8456.937667 secs 2024-04-26T14:09:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:02 smithi193 ceph-mon[32782]: pgmap v4993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:09:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:02 smithi196 ceph-mon[32572]: pgmap v4993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:09:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:02 smithi110 ceph-mon[28069]: pgmap v4993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:09:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:09:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:09:04.279+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:09:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:09:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:09:04.279+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:09:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:09:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:09:04.279+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:09:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:09:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:09:04.279+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:09:04.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:09:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:09:04.279+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:09:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:05 smithi193 ceph-mon[32782]: pgmap v4994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:05 smithi196 ceph-mon[32572]: pgmap v4994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:05 smithi110 ceph-mon[28069]: pgmap v4994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:07 smithi193 ceph-mon[32782]: pgmap v4995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8461.937784 secs 2024-04-26T14:09:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:07 smithi196 ceph-mon[32572]: pgmap v4995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8461.937784 secs 2024-04-26T14:09:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:07 smithi110 ceph-mon[28069]: pgmap v4995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8461.937784 secs 2024-04-26T14:09:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:09 smithi193 ceph-mon[32782]: pgmap v4996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:09 smithi196 ceph-mon[32572]: pgmap v4996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:09 smithi110 ceph-mon[28069]: pgmap v4996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:09:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:11 smithi193 ceph-mon[32782]: pgmap v4997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:09:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:11 smithi196 ceph-mon[32572]: pgmap v4997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:09:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:11 smithi110 ceph-mon[28069]: pgmap v4997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:09:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8466.937909 secs 2024-04-26T14:09:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8466.937909 secs 2024-04-26T14:09:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8466.937909 secs 2024-04-26T14:09:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:13 smithi193 ceph-mon[32782]: pgmap v4998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:13 smithi196 ceph-mon[32572]: pgmap v4998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:13 smithi110 ceph-mon[28069]: pgmap v4998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:15 smithi193 ceph-mon[32782]: pgmap v4999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:15 smithi196 ceph-mon[32572]: pgmap v4999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:15 smithi110 ceph-mon[28069]: pgmap v4999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:17 smithi193 ceph-mon[32782]: pgmap v5000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8471.938011 secs 2024-04-26T14:09:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:17 smithi196 ceph-mon[32572]: pgmap v5000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8471.938011 secs 2024-04-26T14:09:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:17 smithi110 ceph-mon[28069]: pgmap v5000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8471.938011 secs 2024-04-26T14:09:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:09:17.737+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006390 con 0x7f261c104b50 2024-04-26T14:09:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:09:17.737+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:09:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:09:17.738+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 69 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:09:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:09:17.738+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 69 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006390 con 0x55db1be4fdd0 2024-04-26T14:09:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:19 smithi193 ceph-mon[32782]: pgmap v5001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:19 smithi196 ceph-mon[32572]: pgmap v5001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:19 smithi110 ceph-mon[28069]: pgmap v5001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:21 smithi196 ceph-mon[32572]: pgmap v5002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:21 smithi110 ceph-mon[28069]: pgmap v5002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:21 smithi193 ceph-mon[32782]: pgmap v5002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8476.938142 secs 2024-04-26T14:09:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8476.938142 secs 2024-04-26T14:09:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8476.938142 secs 2024-04-26T14:09:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:23 smithi196 ceph-mon[32572]: pgmap v5003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:23 smithi110 ceph-mon[28069]: pgmap v5003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:23 smithi193 ceph-mon[32782]: pgmap v5003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:25 smithi196 ceph-mon[32572]: pgmap v5004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:25 smithi110 ceph-mon[28069]: pgmap v5004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:25 smithi193 ceph-mon[32782]: pgmap v5004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:27 smithi196 ceph-mon[32572]: pgmap v5005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8481.938260 secs 2024-04-26T14:09:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:27 smithi110 ceph-mon[28069]: pgmap v5005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8481.938260 secs 2024-04-26T14:09:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:27 smithi193 ceph-mon[32782]: pgmap v5005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8481.938260 secs 2024-04-26T14:09:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:29 smithi196 ceph-mon[32572]: pgmap v5006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:29 smithi110 ceph-mon[28069]: pgmap v5006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:29 smithi193 ceph-mon[32782]: pgmap v5006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:31 smithi196 ceph-mon[32572]: pgmap v5007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:31 smithi110 ceph-mon[28069]: pgmap v5007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:31 smithi193 ceph-mon[32782]: pgmap v5007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8486.938378 secs 2024-04-26T14:09:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8486.938378 secs 2024-04-26T14:09:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8486.938378 secs 2024-04-26T14:09:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:33 smithi196 ceph-mon[32572]: pgmap v5008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:33 smithi110 ceph-mon[28069]: pgmap v5008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:33 smithi193 ceph-mon[32782]: pgmap v5008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:35 smithi196 ceph-mon[32572]: pgmap v5009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:35 smithi110 ceph-mon[28069]: pgmap v5009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:35.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:35 smithi193 ceph-mon[32782]: pgmap v5009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:37 smithi196 ceph-mon[32572]: pgmap v5010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8491.938495 secs 2024-04-26T14:09:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:37 smithi110 ceph-mon[28069]: pgmap v5010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8491.938495 secs 2024-04-26T14:09:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:37 smithi193 ceph-mon[32782]: pgmap v5010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8491.938495 secs 2024-04-26T14:09:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:39 smithi196 ceph-mon[32572]: pgmap v5011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:39 smithi110 ceph-mon[28069]: pgmap v5011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:39 smithi193 ceph-mon[32782]: pgmap v5011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:41 smithi196 ceph-mon[32572]: pgmap v5012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:41 smithi110 ceph-mon[28069]: pgmap v5012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:41 smithi193 ceph-mon[32782]: pgmap v5012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8496.938626 secs 2024-04-26T14:09:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8496.938626 secs 2024-04-26T14:09:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8496.938626 secs 2024-04-26T14:09:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:43 smithi196 ceph-mon[32572]: pgmap v5013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:43 smithi110 ceph-mon[28069]: pgmap v5013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:43 smithi193 ceph-mon[32782]: pgmap v5013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:45 smithi196 ceph-mon[32572]: pgmap v5014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:45 smithi110 ceph-mon[28069]: pgmap v5014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:45 smithi193 ceph-mon[32782]: pgmap v5014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:47 smithi196 ceph-mon[32572]: pgmap v5015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8501.938765 secs 2024-04-26T14:09:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:47 smithi110 ceph-mon[28069]: pgmap v5015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8501.938765 secs 2024-04-26T14:09:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:47 smithi193 ceph-mon[32782]: pgmap v5015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8501.938765 secs 2024-04-26T14:09:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:49 smithi196 ceph-mon[32572]: pgmap v5016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:49 smithi110 ceph-mon[28069]: pgmap v5016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:49 smithi193 ceph-mon[32782]: pgmap v5016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:51 smithi196 ceph-mon[32572]: pgmap v5017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:51 smithi110 ceph-mon[28069]: pgmap v5017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:51.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:51 smithi193 ceph-mon[32782]: pgmap v5017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8506.938881 secs 2024-04-26T14:09:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8506.938881 secs 2024-04-26T14:09:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8506.938881 secs 2024-04-26T14:09:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:53 smithi196 ceph-mon[32572]: pgmap v5018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:53 smithi110 ceph-mon[28069]: pgmap v5018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:53 smithi193 ceph-mon[32782]: pgmap v5018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:55 smithi196 ceph-mon[32572]: pgmap v5019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:55 smithi110 ceph-mon[28069]: pgmap v5019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:55 smithi193 ceph-mon[32782]: pgmap v5019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:57 smithi196 ceph-mon[32572]: pgmap v5020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8511.938952 secs 2024-04-26T14:09:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:57 smithi110 ceph-mon[28069]: pgmap v5020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8511.938952 secs 2024-04-26T14:09:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:57 smithi193 ceph-mon[32782]: pgmap v5020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:09:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8511.938952 secs 2024-04-26T14:09:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:09:59 smithi196 ceph-mon[32572]: pgmap v5021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:09:59 smithi110 ceph-mon[28069]: pgmap v5021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:09:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:09:59 smithi193 ceph-mon[32782]: pgmap v5021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:10:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:10:00.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:10:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:01 smithi110 ceph-mon[28069]: pgmap v5022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:10:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:01 smithi193 ceph-mon[32782]: pgmap v5022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:10:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:01 smithi196 ceph-mon[32572]: pgmap v5022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:10:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8516.939015 secs 2024-04-26T14:10:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:10:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:10:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:10:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8516.939015 secs 2024-04-26T14:10:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:10:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:10:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:10:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8516.939015 secs 2024-04-26T14:10:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:10:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:10:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:10:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:03 smithi110 ceph-mon[28069]: pgmap v5023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:10:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:03 smithi110 ceph-mon[28069]: pgmap v5024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:03 smithi193 ceph-mon[32782]: pgmap v5023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:10:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:03 smithi193 ceph-mon[32782]: pgmap v5024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:03 smithi196 ceph-mon[32572]: pgmap v5023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:10:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:03 smithi196 ceph-mon[32572]: pgmap v5024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:05 smithi110 ceph-mon[28069]: pgmap v5025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:05 smithi193 ceph-mon[32782]: pgmap v5025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:05 smithi196 ceph-mon[32572]: pgmap v5025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:07 smithi110 ceph-mon[28069]: pgmap v5026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8521.939145 secs 2024-04-26T14:10:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:07 smithi193 ceph-mon[32782]: pgmap v5026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8521.939145 secs 2024-04-26T14:10:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:07 smithi196 ceph-mon[32572]: pgmap v5026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8521.939145 secs 2024-04-26T14:10:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:09 smithi110 ceph-mon[28069]: pgmap v5027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:09 smithi193 ceph-mon[32782]: pgmap v5027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:09 smithi196 ceph-mon[32572]: pgmap v5027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:11 smithi193 ceph-mon[32782]: pgmap v5028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:11 smithi196 ceph-mon[32572]: pgmap v5028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:11 smithi110 ceph-mon[28069]: pgmap v5028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:10:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8526.939270 secs 2024-04-26T14:10:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8526.939270 secs 2024-04-26T14:10:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8526.939270 secs 2024-04-26T14:10:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:13 smithi193 ceph-mon[32782]: pgmap v5029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:10:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:13 smithi196 ceph-mon[32572]: pgmap v5029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:10:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:13 smithi110 ceph-mon[28069]: pgmap v5029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:10:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:15 smithi193 ceph-mon[32782]: pgmap v5030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:15 smithi196 ceph-mon[32572]: pgmap v5030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:15 smithi110 ceph-mon[28069]: pgmap v5030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:17 smithi193 ceph-mon[32782]: pgmap v5031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8531.939399 secs 2024-04-26T14:10:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:17 smithi196 ceph-mon[32572]: pgmap v5031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8531.939399 secs 2024-04-26T14:10:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:17 smithi110 ceph-mon[28069]: pgmap v5031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8531.939399 secs 2024-04-26T14:10:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:19 smithi193 ceph-mon[32782]: pgmap v5032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:19 smithi196 ceph-mon[32572]: pgmap v5032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:19 smithi110 ceph-mon[28069]: pgmap v5032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:21 smithi193 ceph-mon[32782]: pgmap v5033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:21 smithi196 ceph-mon[32572]: pgmap v5033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:21 smithi110 ceph-mon[28069]: pgmap v5033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:22.588 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8536.939518 secs 2024-04-26T14:10:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8536.939518 secs 2024-04-26T14:10:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8536.939518 secs 2024-04-26T14:10:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:23 smithi193 ceph-mon[32782]: pgmap v5034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:23 smithi196 ceph-mon[32572]: pgmap v5034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:23 smithi110 ceph-mon[28069]: pgmap v5034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:25 smithi193 ceph-mon[32782]: pgmap v5035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:25 smithi196 ceph-mon[32572]: pgmap v5035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:25 smithi110 ceph-mon[28069]: pgmap v5035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:27 smithi193 ceph-mon[32782]: pgmap v5036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8541.939613 secs 2024-04-26T14:10:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:27 smithi196 ceph-mon[32572]: pgmap v5036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8541.939613 secs 2024-04-26T14:10:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:27 smithi110 ceph-mon[28069]: pgmap v5036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8541.939613 secs 2024-04-26T14:10:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:29 smithi193 ceph-mon[32782]: pgmap v5037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:29 smithi196 ceph-mon[32572]: pgmap v5037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:29 smithi110 ceph-mon[28069]: pgmap v5037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:31 smithi193 ceph-mon[32782]: pgmap v5038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:31 smithi196 ceph-mon[32572]: pgmap v5038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:31 smithi110 ceph-mon[28069]: pgmap v5038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8546.939706 secs 2024-04-26T14:10:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8546.939706 secs 2024-04-26T14:10:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8546.939706 secs 2024-04-26T14:10:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:33 smithi196 ceph-mon[32572]: pgmap v5039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:33 smithi110 ceph-mon[28069]: pgmap v5039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:33 smithi193 ceph-mon[32782]: pgmap v5039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:35 smithi196 ceph-mon[32572]: pgmap v5040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:35 smithi110 ceph-mon[28069]: pgmap v5040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:35 smithi193 ceph-mon[32782]: pgmap v5040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:37 smithi196 ceph-mon[32572]: pgmap v5041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8551.939825 secs 2024-04-26T14:10:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:37 smithi110 ceph-mon[28069]: pgmap v5041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8551.939825 secs 2024-04-26T14:10:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:37 smithi193 ceph-mon[32782]: pgmap v5041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8551.939825 secs 2024-04-26T14:10:39.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:39 smithi193 ceph-mon[32782]: pgmap v5042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:39 smithi196 ceph-mon[32572]: pgmap v5042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:39 smithi110 ceph-mon[28069]: pgmap v5042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:41 smithi196 ceph-mon[32572]: pgmap v5043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:41 smithi110 ceph-mon[28069]: pgmap v5043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:41 smithi193 ceph-mon[32782]: pgmap v5043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8556.939902 secs 2024-04-26T14:10:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:42 smithi196 ceph-mon[32572]: pgmap v5044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8556.939902 secs 2024-04-26T14:10:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:42 smithi110 ceph-mon[28069]: pgmap v5044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8556.939902 secs 2024-04-26T14:10:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:42 smithi193 ceph-mon[32782]: pgmap v5044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:44 smithi196 ceph-mon[32572]: pgmap v5045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:44 smithi110 ceph-mon[28069]: pgmap v5045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:44 smithi193 ceph-mon[32782]: pgmap v5045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:46 smithi196 ceph-mon[32572]: pgmap v5046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:46 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8561.940010 secs 2024-04-26T14:10:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:46 smithi110 ceph-mon[28069]: pgmap v5046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:46 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8561.940010 secs 2024-04-26T14:10:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:46 smithi193 ceph-mon[32782]: pgmap v5046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:46 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8561.940010 secs 2024-04-26T14:10:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:48 smithi196 ceph-mon[32572]: pgmap v5047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:48 smithi110 ceph-mon[28069]: pgmap v5047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:48 smithi193 ceph-mon[32782]: pgmap v5047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:50 smithi196 ceph-mon[32572]: pgmap v5048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:50 smithi110 ceph-mon[28069]: pgmap v5048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:50 smithi193 ceph-mon[32782]: pgmap v5048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:51 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8566.940130 secs 2024-04-26T14:10:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:51 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8566.940130 secs 2024-04-26T14:10:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:51 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8566.940130 secs 2024-04-26T14:10:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:52 smithi196 ceph-mon[32572]: pgmap v5049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:52 smithi110 ceph-mon[28069]: pgmap v5049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:52 smithi193 ceph-mon[32782]: pgmap v5049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:54 smithi196 ceph-mon[32572]: pgmap v5050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:54 smithi110 ceph-mon[28069]: pgmap v5050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:54 smithi193 ceph-mon[32782]: pgmap v5050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:56 smithi196 ceph-mon[32572]: pgmap v5051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:56 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8571.940247 secs 2024-04-26T14:10:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:56 smithi110 ceph-mon[28069]: pgmap v5051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:56 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8571.940247 secs 2024-04-26T14:10:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:56 smithi193 ceph-mon[32782]: pgmap v5051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:10:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:56 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8571.940247 secs 2024-04-26T14:10:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:10:58 smithi196 ceph-mon[32572]: pgmap v5052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:10:58 smithi110 ceph-mon[28069]: pgmap v5052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:10:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:10:58 smithi193 ceph-mon[32782]: pgmap v5052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:00 smithi196 ceph-mon[32572]: pgmap v5053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:00 smithi110 ceph-mon[28069]: pgmap v5053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:00 smithi193 ceph-mon[32782]: pgmap v5053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:01 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8576.940365 secs 2024-04-26T14:11:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:01 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8576.940365 secs 2024-04-26T14:11:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:01 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8576.940365 secs 2024-04-26T14:11:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:02 smithi196 ceph-mon[32572]: pgmap v5054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:11:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:02 smithi110 ceph-mon[28069]: pgmap v5054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:11:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:02 smithi193 ceph-mon[32782]: pgmap v5054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:11:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:11:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:11:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:03 smithi196 ceph-mon[32572]: pgmap v5055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:11:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:03 smithi196 ceph-mon[32572]: pgmap v5056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:11:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:11:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:11:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:03 smithi110 ceph-mon[28069]: pgmap v5055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:11:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:03 smithi110 ceph-mon[28069]: pgmap v5056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:11:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:11:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:11:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:03 smithi193 ceph-mon[32782]: pgmap v5055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:11:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:03 smithi193 ceph-mon[32782]: pgmap v5056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:11:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:06 smithi196 ceph-mon[32572]: pgmap v5057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:06 smithi110 ceph-mon[28069]: pgmap v5057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:06 smithi193 ceph-mon[32782]: pgmap v5057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:07 smithi196 ceph-mon[32572]: 8 slow requests, 1 included below; oldest blocked for > 8581.940460 secs 2024-04-26T14:11:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:07 smithi196 ceph-mon[32572]: slow request 722.237982 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:11:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:07 smithi110 ceph-mon[28069]: 8 slow requests, 1 included below; oldest blocked for > 8581.940460 secs 2024-04-26T14:11:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:07 smithi110 ceph-mon[28069]: slow request 722.237982 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:11:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:07 smithi193 ceph-mon[32782]: 8 slow requests, 1 included below; oldest blocked for > 8581.940460 secs 2024-04-26T14:11:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:07 smithi193 ceph-mon[32782]: slow request 722.237982 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:11:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:08 smithi196 ceph-mon[32572]: pgmap v5058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:11:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:08 smithi110 ceph-mon[28069]: pgmap v5058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:11:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:08 smithi193 ceph-mon[32782]: pgmap v5058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:11:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:10 smithi196 ceph-mon[32572]: pgmap v5059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:10 smithi110 ceph-mon[28069]: pgmap v5059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:10 smithi193 ceph-mon[32782]: pgmap v5059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:12 smithi196 ceph-mon[32572]: pgmap v5060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8586.940600 secs 2024-04-26T14:11:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:12 smithi110 ceph-mon[28069]: pgmap v5060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8586.940600 secs 2024-04-26T14:11:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:12 smithi193 ceph-mon[32782]: pgmap v5060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:11:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8586.940600 secs 2024-04-26T14:11:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:14 smithi196 ceph-mon[32572]: pgmap v5061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:11:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:14 smithi110 ceph-mon[28069]: pgmap v5061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:11:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:14 smithi193 ceph-mon[32782]: pgmap v5061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:11:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:16 smithi196 ceph-mon[32572]: pgmap v5062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:16 smithi110 ceph-mon[28069]: pgmap v5062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:16 smithi193 ceph-mon[32782]: pgmap v5062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8591.940718 secs 2024-04-26T14:11:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8591.940718 secs 2024-04-26T14:11:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8591.940718 secs 2024-04-26T14:11:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:18 smithi196 ceph-mon[32572]: pgmap v5063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:18 smithi110 ceph-mon[28069]: pgmap v5063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:18 smithi193 ceph-mon[32782]: pgmap v5063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:20 smithi110 ceph-mon[28069]: pgmap v5064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:20 smithi193 ceph-mon[32782]: pgmap v5064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:20 smithi196 ceph-mon[32572]: pgmap v5064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:22 smithi110 ceph-mon[28069]: pgmap v5065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8596.940835 secs 2024-04-26T14:11:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:22 smithi193 ceph-mon[32782]: pgmap v5065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8596.940835 secs 2024-04-26T14:11:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:22 smithi196 ceph-mon[32572]: pgmap v5065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8596.940835 secs 2024-04-26T14:11:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:24 smithi110 ceph-mon[28069]: pgmap v5066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:24 smithi193 ceph-mon[32782]: pgmap v5066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:24 smithi196 ceph-mon[32572]: pgmap v5066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:26 smithi110 ceph-mon[28069]: pgmap v5067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:26 smithi193 ceph-mon[32782]: pgmap v5067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:26 smithi196 ceph-mon[32572]: pgmap v5067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8601.940896 secs 2024-04-26T14:11:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8601.940896 secs 2024-04-26T14:11:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8601.940896 secs 2024-04-26T14:11:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:28 smithi110 ceph-mon[28069]: pgmap v5068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:28 smithi193 ceph-mon[32782]: pgmap v5068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:28 smithi196 ceph-mon[32572]: pgmap v5068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:30 smithi193 ceph-mon[32782]: pgmap v5069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:30 smithi196 ceph-mon[32572]: pgmap v5069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:30 smithi110 ceph-mon[28069]: pgmap v5069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:32.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:32 smithi110 ceph-mon[28069]: pgmap v5070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:32.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8606.941025 secs 2024-04-26T14:11:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:32 smithi193 ceph-mon[32782]: pgmap v5070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8606.941025 secs 2024-04-26T14:11:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:32 smithi196 ceph-mon[32572]: pgmap v5070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8606.941025 secs 2024-04-26T14:11:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:34 smithi193 ceph-mon[32782]: pgmap v5071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:34 smithi196 ceph-mon[32572]: pgmap v5071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:34 smithi110 ceph-mon[28069]: pgmap v5071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:36 smithi193 ceph-mon[32782]: pgmap v5072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:36 smithi196 ceph-mon[32572]: pgmap v5072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:36 smithi110 ceph-mon[28069]: pgmap v5072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8611.941122 secs 2024-04-26T14:11:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8611.941122 secs 2024-04-26T14:11:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8611.941122 secs 2024-04-26T14:11:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:38 smithi193 ceph-mon[32782]: pgmap v5073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:38 smithi196 ceph-mon[32572]: pgmap v5073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:38 smithi110 ceph-mon[28069]: pgmap v5073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:40 smithi193 ceph-mon[32782]: pgmap v5074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:40 smithi196 ceph-mon[32572]: pgmap v5074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:40 smithi110 ceph-mon[28069]: pgmap v5074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:42 smithi193 ceph-mon[32782]: pgmap v5075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:11:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8616.941215 secs 2024-04-26T14:11:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:42 smithi196 ceph-mon[32572]: pgmap v5075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:11:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8616.941215 secs 2024-04-26T14:11:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:42 smithi110 ceph-mon[28069]: pgmap v5075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:11:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8616.941215 secs 2024-04-26T14:11:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:44 smithi193 ceph-mon[32782]: pgmap v5076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:44 smithi196 ceph-mon[32572]: pgmap v5076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:44 smithi110 ceph-mon[28069]: pgmap v5076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:46 smithi193 ceph-mon[32782]: pgmap v5077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:11:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:46 smithi196 ceph-mon[32572]: pgmap v5077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:11:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:46 smithi110 ceph-mon[28069]: pgmap v5077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:11:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8621.941279 secs 2024-04-26T14:11:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8621.941279 secs 2024-04-26T14:11:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8621.941279 secs 2024-04-26T14:11:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:48 smithi193 ceph-mon[32782]: pgmap v5078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:11:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:48 smithi196 ceph-mon[32572]: pgmap v5078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:11:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:48 smithi110 ceph-mon[28069]: pgmap v5078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:11:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:50 smithi193 ceph-mon[32782]: pgmap v5079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:50 smithi196 ceph-mon[32572]: pgmap v5079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:50 smithi110 ceph-mon[28069]: pgmap v5079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:52 smithi193 ceph-mon[32782]: pgmap v5080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8626.941402 secs 2024-04-26T14:11:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:52 smithi196 ceph-mon[32572]: pgmap v5080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8626.941402 secs 2024-04-26T14:11:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:52 smithi110 ceph-mon[28069]: pgmap v5080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8626.941402 secs 2024-04-26T14:11:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:54 smithi196 ceph-mon[32572]: pgmap v5081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:54 smithi110 ceph-mon[28069]: pgmap v5081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:54 smithi193 ceph-mon[32782]: pgmap v5081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:11:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:56 smithi196 ceph-mon[32572]: pgmap v5082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:56 smithi110 ceph-mon[28069]: pgmap v5082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:56 smithi193 ceph-mon[32782]: pgmap v5082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8631.941539 secs 2024-04-26T14:11:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8631.941539 secs 2024-04-26T14:11:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8631.941539 secs 2024-04-26T14:11:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:11:58 smithi196 ceph-mon[32572]: pgmap v5083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:11:58 smithi110 ceph-mon[28069]: pgmap v5083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:11:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:11:58 smithi193 ceph-mon[32782]: pgmap v5083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:00 smithi196 ceph-mon[32572]: pgmap v5084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:00 smithi110 ceph-mon[28069]: pgmap v5084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:00 smithi193 ceph-mon[32782]: pgmap v5084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:02 smithi196 ceph-mon[32572]: pgmap v5085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8636.941656 secs 2024-04-26T14:12:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:02 smithi110 ceph-mon[28069]: pgmap v5085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8636.941656 secs 2024-04-26T14:12:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:02 smithi193 ceph-mon[32782]: pgmap v5085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8636.941656 secs 2024-04-26T14:12:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:04 smithi196 ceph-mon[32572]: pgmap v5086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:12:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:04 smithi110 ceph-mon[28069]: pgmap v5086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:12:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:04 smithi193 ceph-mon[32782]: pgmap v5086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:12:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:12:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:12:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:12:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:12:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:12:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:12:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:12:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:12:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:12:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:06 smithi196 ceph-mon[32572]: pgmap v5087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:12:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:06 smithi196 ceph-mon[32572]: pgmap v5088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:06 smithi110 ceph-mon[28069]: pgmap v5087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:12:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:06 smithi110 ceph-mon[28069]: pgmap v5088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:06 smithi193 ceph-mon[32782]: pgmap v5087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:12:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:06 smithi193 ceph-mon[32782]: pgmap v5088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:07 smithi196 ceph-mon[32572]: 8 slow requests, 1 included below; oldest blocked for > 8641.941775 secs 2024-04-26T14:12:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:07 smithi196 ceph-mon[32572]: slow request 2883.197069 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:12:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:07 smithi196 ceph-mon[32572]: pgmap v5089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:07 smithi110 ceph-mon[28069]: 8 slow requests, 1 included below; oldest blocked for > 8641.941775 secs 2024-04-26T14:12:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:07 smithi110 ceph-mon[28069]: slow request 2883.197069 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:12:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:07 smithi110 ceph-mon[28069]: pgmap v5089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:07 smithi193 ceph-mon[32782]: 8 slow requests, 1 included below; oldest blocked for > 8641.941775 secs 2024-04-26T14:12:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:07 smithi193 ceph-mon[32782]: slow request 2883.197069 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:12:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:07 smithi193 ceph-mon[32782]: pgmap v5089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:09 smithi110 ceph-mon[28069]: pgmap v5090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:09 smithi193 ceph-mon[32782]: pgmap v5090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:09 smithi196 ceph-mon[32572]: pgmap v5090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:11 smithi110 ceph-mon[28069]: pgmap v5091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:11 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8646.941859 secs 2024-04-26T14:12:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:11 smithi193 ceph-mon[32782]: pgmap v5091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:11 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8646.941859 secs 2024-04-26T14:12:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:11 smithi196 ceph-mon[32572]: pgmap v5091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:12:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:11 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8646.941859 secs 2024-04-26T14:12:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:13 smithi193 ceph-mon[32782]: pgmap v5092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:12:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:13 smithi196 ceph-mon[32572]: pgmap v5092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:12:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:13 smithi110 ceph-mon[28069]: pgmap v5092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:12:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:15 smithi193 ceph-mon[32782]: pgmap v5093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:12:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:15 smithi196 ceph-mon[32572]: pgmap v5093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:12:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:15 smithi110 ceph-mon[28069]: pgmap v5093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:12:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:16 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8651.941979 secs 2024-04-26T14:12:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:16 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8651.941979 secs 2024-04-26T14:12:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:16 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8651.941979 secs 2024-04-26T14:12:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:12:17.766+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006390 con 0x7f261c104b50 2024-04-26T14:12:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:12:17.766+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:12:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:12:17.767+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 70 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:12:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:12:17.767+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 70 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006390 con 0x55db1be4fdd0 2024-04-26T14:12:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:17 smithi193 ceph-mon[32782]: pgmap v5094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:17 smithi196 ceph-mon[32572]: pgmap v5094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:17 smithi110 ceph-mon[28069]: pgmap v5094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:19 smithi193 ceph-mon[32782]: pgmap v5095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:19 smithi196 ceph-mon[32572]: pgmap v5095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:19 smithi110 ceph-mon[28069]: pgmap v5095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:21 smithi193 ceph-mon[32782]: pgmap v5096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:21 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8656.942089 secs 2024-04-26T14:12:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:21 smithi196 ceph-mon[32572]: pgmap v5096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:21 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8656.942089 secs 2024-04-26T14:12:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:21 smithi110 ceph-mon[28069]: pgmap v5096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:21 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8656.942089 secs 2024-04-26T14:12:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:23 smithi193 ceph-mon[32782]: pgmap v5097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:23 smithi196 ceph-mon[32572]: pgmap v5097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:23 smithi110 ceph-mon[28069]: pgmap v5097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:25 smithi193 ceph-mon[32782]: pgmap v5098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:25 smithi196 ceph-mon[32572]: pgmap v5098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:25 smithi110 ceph-mon[28069]: pgmap v5098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:26 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8661.942208 secs 2024-04-26T14:12:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:26 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8661.942208 secs 2024-04-26T14:12:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:26 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8661.942208 secs 2024-04-26T14:12:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:27 smithi193 ceph-mon[32782]: pgmap v5099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:27 smithi196 ceph-mon[32572]: pgmap v5099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:27 smithi110 ceph-mon[28069]: pgmap v5099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:29 smithi193 ceph-mon[32782]: pgmap v5100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:29 smithi196 ceph-mon[32572]: pgmap v5100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:29 smithi110 ceph-mon[28069]: pgmap v5100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:31 smithi193 ceph-mon[32782]: pgmap v5101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:31 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8666.942331 secs 2024-04-26T14:12:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:31 smithi196 ceph-mon[32572]: pgmap v5101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:31 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8666.942331 secs 2024-04-26T14:12:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:31 smithi110 ceph-mon[28069]: pgmap v5101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:31 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8666.942331 secs 2024-04-26T14:12:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:34 smithi193 ceph-mon[32782]: pgmap v5102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:34 smithi196 ceph-mon[32572]: pgmap v5102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:34 smithi110 ceph-mon[28069]: pgmap v5102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:36 smithi193 ceph-mon[32782]: pgmap v5103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:36 smithi196 ceph-mon[32572]: pgmap v5103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:36 smithi110 ceph-mon[28069]: pgmap v5103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8671.942451 secs 2024-04-26T14:12:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8671.942451 secs 2024-04-26T14:12:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8671.942451 secs 2024-04-26T14:12:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:38 smithi193 ceph-mon[32782]: pgmap v5104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:38 smithi196 ceph-mon[32572]: pgmap v5104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:38 smithi110 ceph-mon[28069]: pgmap v5104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:40 smithi196 ceph-mon[32572]: pgmap v5105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:40 smithi110 ceph-mon[28069]: pgmap v5105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:40 smithi193 ceph-mon[32782]: pgmap v5105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:42 smithi196 ceph-mon[32572]: pgmap v5106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8676.942590 secs 2024-04-26T14:12:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:42 smithi110 ceph-mon[28069]: pgmap v5106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8676.942590 secs 2024-04-26T14:12:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:42 smithi193 ceph-mon[32782]: pgmap v5106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8676.942590 secs 2024-04-26T14:12:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:44 smithi196 ceph-mon[32572]: pgmap v5107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:44 smithi110 ceph-mon[28069]: pgmap v5107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:44 smithi193 ceph-mon[32782]: pgmap v5107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:46 smithi196 ceph-mon[32572]: pgmap v5108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:46 smithi110 ceph-mon[28069]: pgmap v5108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:46 smithi193 ceph-mon[32782]: pgmap v5108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8681.942705 secs 2024-04-26T14:12:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8681.942705 secs 2024-04-26T14:12:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8681.942705 secs 2024-04-26T14:12:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:48 smithi196 ceph-mon[32572]: pgmap v5109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:48 smithi110 ceph-mon[28069]: pgmap v5109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:48 smithi193 ceph-mon[32782]: pgmap v5109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:50 smithi196 ceph-mon[32572]: pgmap v5110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:50 smithi110 ceph-mon[28069]: pgmap v5110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:50 smithi193 ceph-mon[32782]: pgmap v5110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:52 smithi196 ceph-mon[32572]: pgmap v5111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8686.942861 secs 2024-04-26T14:12:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:52 smithi110 ceph-mon[28069]: pgmap v5111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8686.942861 secs 2024-04-26T14:12:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:52 smithi193 ceph-mon[32782]: pgmap v5111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8686.942861 secs 2024-04-26T14:12:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:54 smithi196 ceph-mon[32572]: pgmap v5112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:54 smithi110 ceph-mon[28069]: pgmap v5112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:54 smithi193 ceph-mon[32782]: pgmap v5112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:12:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:56 smithi196 ceph-mon[32572]: pgmap v5113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:56 smithi110 ceph-mon[28069]: pgmap v5113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:56 smithi193 ceph-mon[32782]: pgmap v5113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8691.942985 secs 2024-04-26T14:12:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8691.942985 secs 2024-04-26T14:12:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8691.942985 secs 2024-04-26T14:12:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:12:58 smithi196 ceph-mon[32572]: pgmap v5114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:12:58 smithi110 ceph-mon[28069]: pgmap v5114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:12:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:12:58 smithi193 ceph-mon[32782]: pgmap v5114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:00 smithi196 ceph-mon[32572]: pgmap v5115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:00 smithi110 ceph-mon[28069]: pgmap v5115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:00 smithi193 ceph-mon[32782]: pgmap v5115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:02 smithi196 ceph-mon[32572]: pgmap v5116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8696.943116 secs 2024-04-26T14:13:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:02 smithi110 ceph-mon[28069]: pgmap v5116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8696.943116 secs 2024-04-26T14:13:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:02 smithi193 ceph-mon[32782]: pgmap v5116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8696.943116 secs 2024-04-26T14:13:04.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:04 smithi196 ceph-mon[32572]: pgmap v5117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:04 smithi110 ceph-mon[28069]: pgmap v5117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:04 smithi193 ceph-mon[32782]: pgmap v5117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:13:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:13:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:13:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:06 smithi196 ceph-mon[32572]: pgmap v5118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:06 smithi110 ceph-mon[28069]: pgmap v5118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:06 smithi193 ceph-mon[32782]: pgmap v5118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8701.943239 secs 2024-04-26T14:13:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:13:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:13:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:07 smithi196 ceph-mon[32572]: pgmap v5119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T14:13:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:07 smithi196 ceph-mon[32572]: pgmap v5120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:13:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8701.943239 secs 2024-04-26T14:13:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:13:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:13:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:07 smithi110 ceph-mon[28069]: pgmap v5119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T14:13:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:07 smithi110 ceph-mon[28069]: pgmap v5120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:13:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8701.943239 secs 2024-04-26T14:13:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:13:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:13:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:07 smithi193 ceph-mon[32782]: pgmap v5119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T14:13:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:07 smithi193 ceph-mon[32782]: pgmap v5120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:13:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:09 smithi193 ceph-mon[32782]: pgmap v5121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:09 smithi196 ceph-mon[32572]: pgmap v5121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:09 smithi110 ceph-mon[28069]: pgmap v5121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:11 smithi196 ceph-mon[32572]: pgmap v5122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:11 smithi110 ceph-mon[28069]: pgmap v5122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:11 smithi193 ceph-mon[32782]: pgmap v5122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8706.943368 secs 2024-04-26T14:13:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8706.943368 secs 2024-04-26T14:13:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8706.943368 secs 2024-04-26T14:13:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:13 smithi196 ceph-mon[32572]: pgmap v5123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:13:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:13 smithi110 ceph-mon[28069]: pgmap v5123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:13:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:13 smithi193 ceph-mon[32782]: pgmap v5123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:13:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:15 smithi196 ceph-mon[32572]: pgmap v5124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:15 smithi110 ceph-mon[28069]: pgmap v5124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:15 smithi193 ceph-mon[32782]: pgmap v5124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:13:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8711.943477 secs 2024-04-26T14:13:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:17 smithi196 ceph-mon[32572]: pgmap v5125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:13:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8711.943477 secs 2024-04-26T14:13:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:17 smithi110 ceph-mon[28069]: pgmap v5125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:13:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8711.943477 secs 2024-04-26T14:13:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:17 smithi193 ceph-mon[32782]: pgmap v5125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:13:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:19 smithi196 ceph-mon[32572]: pgmap v5126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:19 smithi110 ceph-mon[28069]: pgmap v5126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:19 smithi193 ceph-mon[32782]: pgmap v5126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:21 smithi196 ceph-mon[32572]: pgmap v5127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:21 smithi110 ceph-mon[28069]: pgmap v5127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:21 smithi193 ceph-mon[32782]: pgmap v5127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8716.943623 secs 2024-04-26T14:13:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8716.943623 secs 2024-04-26T14:13:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8716.943623 secs 2024-04-26T14:13:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:23 smithi196 ceph-mon[32572]: pgmap v5128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:23 smithi110 ceph-mon[28069]: pgmap v5128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:23 smithi193 ceph-mon[32782]: pgmap v5128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:25 smithi196 ceph-mon[32572]: pgmap v5129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:13:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:25 smithi110 ceph-mon[28069]: pgmap v5129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:13:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:25 smithi193 ceph-mon[32782]: pgmap v5129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:13:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8721.943738 secs 2024-04-26T14:13:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:27 smithi196 ceph-mon[32572]: pgmap v5130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8721.943738 secs 2024-04-26T14:13:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:27 smithi110 ceph-mon[28069]: pgmap v5130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8721.943738 secs 2024-04-26T14:13:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:27 smithi193 ceph-mon[32782]: pgmap v5130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:28 smithi196 ceph-mon[32572]: pgmap v5131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:28 smithi110 ceph-mon[28069]: pgmap v5131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:28 smithi193 ceph-mon[32782]: pgmap v5131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:31 smithi196 ceph-mon[32572]: pgmap v5132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:31 smithi110 ceph-mon[28069]: pgmap v5132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:31 smithi193 ceph-mon[32782]: pgmap v5132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:32.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8726.943818 secs 2024-04-26T14:13:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8726.943818 secs 2024-04-26T14:13:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8726.943818 secs 2024-04-26T14:13:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:33 smithi196 ceph-mon[32572]: pgmap v5133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:33 smithi110 ceph-mon[28069]: pgmap v5133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:33 smithi193 ceph-mon[32782]: pgmap v5133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:35 smithi196 ceph-mon[32572]: pgmap v5134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:13:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:35 smithi110 ceph-mon[28069]: pgmap v5134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:13:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:35 smithi193 ceph-mon[32782]: pgmap v5134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:13:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8731.943916 secs 2024-04-26T14:13:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:37 smithi196 ceph-mon[32572]: pgmap v5135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8731.943916 secs 2024-04-26T14:13:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:37 smithi110 ceph-mon[28069]: pgmap v5135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8731.943916 secs 2024-04-26T14:13:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:37 smithi193 ceph-mon[32782]: pgmap v5135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:39 smithi196 ceph-mon[32572]: pgmap v5136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:39 smithi110 ceph-mon[28069]: pgmap v5136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:39 smithi193 ceph-mon[32782]: pgmap v5136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:41.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:41 smithi193 ceph-mon[32782]: pgmap v5137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:41 smithi196 ceph-mon[32572]: pgmap v5137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:41 smithi110 ceph-mon[28069]: pgmap v5137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8736.943996 secs 2024-04-26T14:13:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8736.943996 secs 2024-04-26T14:13:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8736.943996 secs 2024-04-26T14:13:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:43 smithi196 ceph-mon[32572]: pgmap v5138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:43 smithi110 ceph-mon[28069]: pgmap v5138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:43 smithi193 ceph-mon[32782]: pgmap v5138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:45 smithi196 ceph-mon[32572]: pgmap v5139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:13:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:45 smithi110 ceph-mon[28069]: pgmap v5139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:13:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:45 smithi193 ceph-mon[32782]: pgmap v5139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:13:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8741.944057 secs 2024-04-26T14:13:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:47 smithi196 ceph-mon[32572]: pgmap v5140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8741.944057 secs 2024-04-26T14:13:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:47 smithi110 ceph-mon[28069]: pgmap v5140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8741.944057 secs 2024-04-26T14:13:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:47 smithi193 ceph-mon[32782]: pgmap v5140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:48 smithi196 ceph-mon[32572]: pgmap v5141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:48 smithi110 ceph-mon[28069]: pgmap v5141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:48.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:48 smithi193 ceph-mon[32782]: pgmap v5141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:51 smithi196 ceph-mon[32572]: pgmap v5142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:51 smithi110 ceph-mon[28069]: pgmap v5142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:51 smithi193 ceph-mon[32782]: pgmap v5142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8746.944177 secs 2024-04-26T14:13:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8746.944177 secs 2024-04-26T14:13:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8746.944177 secs 2024-04-26T14:13:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:53 smithi196 ceph-mon[32572]: pgmap v5143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:53 smithi110 ceph-mon[28069]: pgmap v5143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:53 smithi193 ceph-mon[32782]: pgmap v5143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:55 smithi196 ceph-mon[32572]: pgmap v5144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:55 smithi110 ceph-mon[28069]: pgmap v5144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:55 smithi193 ceph-mon[32782]: pgmap v5144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8751.944298 secs 2024-04-26T14:13:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:57 smithi196 ceph-mon[32572]: pgmap v5145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8751.944298 secs 2024-04-26T14:13:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:57 smithi110 ceph-mon[28069]: pgmap v5145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8751.944298 secs 2024-04-26T14:13:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:57 smithi193 ceph-mon[32782]: pgmap v5145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:13:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:13:59 smithi196 ceph-mon[32572]: pgmap v5146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:13:59 smithi110 ceph-mon[28069]: pgmap v5146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:13:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:13:59 smithi193 ceph-mon[32782]: pgmap v5146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:01 smithi196 ceph-mon[32572]: pgmap v5147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:01 smithi110 ceph-mon[28069]: pgmap v5147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:01 smithi193 ceph-mon[32782]: pgmap v5147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:02.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8756.944456 secs 2024-04-26T14:14:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8756.944456 secs 2024-04-26T14:14:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8756.944456 secs 2024-04-26T14:14:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:03 smithi196 ceph-mon[32572]: pgmap v5148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:03 smithi110 ceph-mon[28069]: pgmap v5148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:03 smithi193 ceph-mon[32782]: pgmap v5148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:04.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:14:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:14:04.476+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:14:04.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:14:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:14:04.476+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:14:04.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:14:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:14:04.476+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:14:04.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:14:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:14:04.476+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:14:04.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:14:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:14:04.476+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:05 smithi196 ceph-mon[32572]: pgmap v5149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:05 smithi110 ceph-mon[28069]: pgmap v5149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:06.252 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:05 smithi193 ceph-mon[32782]: pgmap v5149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8761.944593 secs 2024-04-26T14:14:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:07 smithi196 ceph-mon[32572]: pgmap v5150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:14:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8761.944593 secs 2024-04-26T14:14:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:07 smithi110 ceph-mon[28069]: pgmap v5150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:14:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8761.944593 secs 2024-04-26T14:14:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:07 smithi193 ceph-mon[32782]: pgmap v5150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:14:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:14:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:14:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:08 smithi196 ceph-mon[32572]: pgmap v5151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 176 B/s wr, 14 op/s 2024-04-26T14:14:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:08 smithi196 ceph-mon[32572]: pgmap v5152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:14:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:14:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:14:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:08 smithi110 ceph-mon[28069]: pgmap v5151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 176 B/s wr, 14 op/s 2024-04-26T14:14:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:08 smithi110 ceph-mon[28069]: pgmap v5152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:14:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:14:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:14:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:08 smithi193 ceph-mon[32782]: pgmap v5151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 176 B/s wr, 14 op/s 2024-04-26T14:14:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:08 smithi193 ceph-mon[32782]: pgmap v5152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:14:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:10 smithi196 ceph-mon[32572]: pgmap v5153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:10 smithi110 ceph-mon[28069]: pgmap v5153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:10 smithi193 ceph-mon[32782]: pgmap v5153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:11 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8766.944706 secs 2024-04-26T14:14:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:11 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8766.944706 secs 2024-04-26T14:14:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:11 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8766.944706 secs 2024-04-26T14:14:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:12 smithi196 ceph-mon[32572]: pgmap v5154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 213 B/s wr, 15 op/s 2024-04-26T14:14:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:12 smithi110 ceph-mon[28069]: pgmap v5154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 213 B/s wr, 15 op/s 2024-04-26T14:14:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:12 smithi193 ceph-mon[32782]: pgmap v5154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 213 B/s wr, 15 op/s 2024-04-26T14:14:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:15 smithi196 ceph-mon[32572]: pgmap v5155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:15 smithi110 ceph-mon[28069]: pgmap v5155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:15 smithi193 ceph-mon[32782]: pgmap v5155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:17 smithi110 ceph-mon[28069]: pgmap v5156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8771.944828 secs 2024-04-26T14:14:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:17 smithi193 ceph-mon[32782]: pgmap v5156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8771.944828 secs 2024-04-26T14:14:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:17 smithi196 ceph-mon[32572]: pgmap v5156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 213 B/s wr, 16 op/s 2024-04-26T14:14:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8771.944828 secs 2024-04-26T14:14:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:19 smithi110 ceph-mon[28069]: pgmap v5157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:14:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:19 smithi193 ceph-mon[32782]: pgmap v5157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:14:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:19 smithi196 ceph-mon[32572]: pgmap v5157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:14:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:21 smithi110 ceph-mon[28069]: pgmap v5158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:21.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:21 smithi196 ceph-mon[32572]: pgmap v5158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:21 smithi193 ceph-mon[32782]: pgmap v5158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8776.944924 secs 2024-04-26T14:14:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8776.944924 secs 2024-04-26T14:14:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8776.944924 secs 2024-04-26T14:14:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:23 smithi110 ceph-mon[28069]: pgmap v5159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:23 smithi193 ceph-mon[32782]: pgmap v5159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:23 smithi196 ceph-mon[32572]: pgmap v5159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:25 smithi110 ceph-mon[28069]: pgmap v5160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:25 smithi193 ceph-mon[32782]: pgmap v5160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:25 smithi196 ceph-mon[32572]: pgmap v5160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:27 smithi110 ceph-mon[28069]: pgmap v5161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8781.945002 secs 2024-04-26T14:14:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:27 smithi193 ceph-mon[32782]: pgmap v5161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8781.945002 secs 2024-04-26T14:14:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:27 smithi196 ceph-mon[32572]: pgmap v5161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8781.945002 secs 2024-04-26T14:14:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:29 smithi193 ceph-mon[32782]: pgmap v5162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:29 smithi196 ceph-mon[32572]: pgmap v5162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:29 smithi110 ceph-mon[28069]: pgmap v5162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:31 smithi193 ceph-mon[32782]: pgmap v5163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:31 smithi196 ceph-mon[32572]: pgmap v5163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:31 smithi110 ceph-mon[28069]: pgmap v5163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8786.945125 secs 2024-04-26T14:14:32.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8786.945125 secs 2024-04-26T14:14:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8786.945125 secs 2024-04-26T14:14:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:33 smithi193 ceph-mon[32782]: pgmap v5164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:33 smithi196 ceph-mon[32572]: pgmap v5164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:33 smithi110 ceph-mon[28069]: pgmap v5164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:35 smithi193 ceph-mon[32782]: pgmap v5165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:35 smithi196 ceph-mon[32572]: pgmap v5165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:35 smithi110 ceph-mon[28069]: pgmap v5165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:37 smithi193 ceph-mon[32782]: pgmap v5166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8791.945239 secs 2024-04-26T14:14:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:37 smithi196 ceph-mon[32572]: pgmap v5166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8791.945239 secs 2024-04-26T14:14:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:37 smithi110 ceph-mon[28069]: pgmap v5166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8791.945239 secs 2024-04-26T14:14:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:39 smithi193 ceph-mon[32782]: pgmap v5167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:39 smithi196 ceph-mon[32572]: pgmap v5167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:39 smithi110 ceph-mon[28069]: pgmap v5167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:41 smithi193 ceph-mon[32782]: pgmap v5168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:41 smithi196 ceph-mon[32572]: pgmap v5168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:41 smithi110 ceph-mon[28069]: pgmap v5168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8796.945358 secs 2024-04-26T14:14:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8796.945358 secs 2024-04-26T14:14:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8796.945358 secs 2024-04-26T14:14:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:43 smithi193 ceph-mon[32782]: pgmap v5169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:43 smithi196 ceph-mon[32572]: pgmap v5169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:43 smithi110 ceph-mon[28069]: pgmap v5169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:45 smithi193 ceph-mon[32782]: pgmap v5170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:45 smithi196 ceph-mon[32572]: pgmap v5170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:45 smithi110 ceph-mon[28069]: pgmap v5170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:47 smithi193 ceph-mon[32782]: pgmap v5171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8801.945480 secs 2024-04-26T14:14:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:47 smithi196 ceph-mon[32572]: pgmap v5171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8801.945480 secs 2024-04-26T14:14:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:47 smithi110 ceph-mon[28069]: pgmap v5171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8801.945480 secs 2024-04-26T14:14:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:49 smithi193 ceph-mon[32782]: pgmap v5172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:49 smithi196 ceph-mon[32572]: pgmap v5172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:49 smithi110 ceph-mon[28069]: pgmap v5172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:51 smithi193 ceph-mon[32782]: pgmap v5173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:51 smithi196 ceph-mon[32572]: pgmap v5173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:51 smithi110 ceph-mon[28069]: pgmap v5173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8806.945574 secs 2024-04-26T14:14:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8806.945574 secs 2024-04-26T14:14:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8806.945574 secs 2024-04-26T14:14:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:53 smithi196 ceph-mon[32572]: pgmap v5174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:53 smithi110 ceph-mon[28069]: pgmap v5174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:53 smithi193 ceph-mon[32782]: pgmap v5174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:55 smithi196 ceph-mon[32572]: pgmap v5175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:55 smithi110 ceph-mon[28069]: pgmap v5175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:55 smithi193 ceph-mon[32782]: pgmap v5175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:57 smithi196 ceph-mon[32572]: pgmap v5176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8811.945661 secs 2024-04-26T14:14:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:57 smithi110 ceph-mon[28069]: pgmap v5176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8811.945661 secs 2024-04-26T14:14:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:57 smithi193 ceph-mon[32782]: pgmap v5176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:14:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8811.945661 secs 2024-04-26T14:14:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:14:59 smithi196 ceph-mon[32572]: pgmap v5177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:14:59 smithi110 ceph-mon[28069]: pgmap v5177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:14:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:14:59 smithi193 ceph-mon[32782]: pgmap v5177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:01 smithi196 ceph-mon[32572]: pgmap v5178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:01 smithi110 ceph-mon[28069]: pgmap v5178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:01 smithi193 ceph-mon[32782]: pgmap v5178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:02.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8816.945792 secs 2024-04-26T14:15:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8816.945792 secs 2024-04-26T14:15:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8816.945792 secs 2024-04-26T14:15:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:03 smithi196 ceph-mon[32572]: pgmap v5179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:03 smithi110 ceph-mon[28069]: pgmap v5179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:03 smithi193 ceph-mon[32782]: pgmap v5179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:05 smithi196 ceph-mon[32572]: pgmap v5180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:15:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:05 smithi110 ceph-mon[28069]: pgmap v5180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:15:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:05 smithi193 ceph-mon[32782]: pgmap v5180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:15:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:07 smithi196 ceph-mon[32572]: pgmap v5181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:15:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8821.945867 secs 2024-04-26T14:15:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:07 smithi110 ceph-mon[28069]: pgmap v5181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:15:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8821.945867 secs 2024-04-26T14:15:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:07 smithi193 ceph-mon[32782]: pgmap v5181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:15:07.671 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8821.945867 secs 2024-04-26T14:15:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:09 smithi196 ceph-mon[32572]: pgmap v5182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:15:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:15:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:15:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:15:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:09 smithi110 ceph-mon[28069]: pgmap v5182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:15:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:15:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:15:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:15:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:09 smithi193 ceph-mon[32782]: pgmap v5182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:15:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:15:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:15:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:15:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:11 smithi196 ceph-mon[32572]: pgmap v5183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:15:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:15:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:15:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:11 smithi196 ceph-mon[32572]: pgmap v5184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:15:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:11 smithi196 ceph-mon[32572]: pgmap v5185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T14:15:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:15:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:11 smithi110 ceph-mon[28069]: pgmap v5183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:15:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:15:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:15:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:11 smithi110 ceph-mon[28069]: pgmap v5184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:15:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:11 smithi110 ceph-mon[28069]: pgmap v5185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T14:15:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:15:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:11 smithi193 ceph-mon[32782]: pgmap v5183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:15:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:15:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:15:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:11 smithi193 ceph-mon[32782]: pgmap v5184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:15:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:11 smithi193 ceph-mon[32782]: pgmap v5185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T14:15:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:15:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8826.946007 secs 2024-04-26T14:15:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8826.946007 secs 2024-04-26T14:15:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8826.946007 secs 2024-04-26T14:15:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:13 smithi196 ceph-mon[32572]: pgmap v5186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:13 smithi110 ceph-mon[28069]: pgmap v5186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:13 smithi193 ceph-mon[32782]: pgmap v5186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:15 smithi196 ceph-mon[32572]: pgmap v5187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:15 smithi110 ceph-mon[28069]: pgmap v5187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:15 smithi193 ceph-mon[32782]: pgmap v5187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8831.946068 secs 2024-04-26T14:15:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:17 smithi196 ceph-mon[32572]: pgmap v5188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T14:15:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8831.946068 secs 2024-04-26T14:15:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:17 smithi110 ceph-mon[28069]: pgmap v5188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T14:15:17.796 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:15:17.797+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:15:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:15:17.797+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006390 con 0x7f261c104b50 2024-04-26T14:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:15:17.798+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 71 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006390 con 0x55db1be4fdd0 2024-04-26T14:15:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:15:17.798+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 71 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:15:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8831.946068 secs 2024-04-26T14:15:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:17 smithi193 ceph-mon[32782]: pgmap v5188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T14:15:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:18 smithi196 ceph-mon[32572]: pgmap v5189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:18 smithi110 ceph-mon[28069]: pgmap v5189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:18 smithi193 ceph-mon[32782]: pgmap v5189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:21 smithi196 ceph-mon[32572]: pgmap v5190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:15:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:21 smithi110 ceph-mon[28069]: pgmap v5190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:15:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:21 smithi193 ceph-mon[32782]: pgmap v5190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:15:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8836.946187 secs 2024-04-26T14:15:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8836.946187 secs 2024-04-26T14:15:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8836.946187 secs 2024-04-26T14:15:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:23 smithi196 ceph-mon[32572]: pgmap v5191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:23 smithi110 ceph-mon[28069]: pgmap v5191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:23 smithi193 ceph-mon[32782]: pgmap v5191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:24 smithi196 ceph-mon[32572]: pgmap v5192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:24 smithi110 ceph-mon[28069]: pgmap v5192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:24 smithi193 ceph-mon[32782]: pgmap v5192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8841.946302 secs 2024-04-26T14:15:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:27 smithi196 ceph-mon[32572]: pgmap v5193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8841.946302 secs 2024-04-26T14:15:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:27 smithi110 ceph-mon[28069]: pgmap v5193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8841.946302 secs 2024-04-26T14:15:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:27 smithi193 ceph-mon[32782]: pgmap v5193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:29 smithi196 ceph-mon[32572]: pgmap v5194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:29 smithi110 ceph-mon[28069]: pgmap v5194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:29 smithi193 ceph-mon[32782]: pgmap v5194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:30 smithi196 ceph-mon[32572]: pgmap v5195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:30 smithi110 ceph-mon[28069]: pgmap v5195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:30 smithi193 ceph-mon[32782]: pgmap v5195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:31 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8846.946440 secs 2024-04-26T14:15:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:31 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8846.946440 secs 2024-04-26T14:15:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:31 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8846.946440 secs 2024-04-26T14:15:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:32 smithi193 ceph-mon[32782]: pgmap v5196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:32.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:32 smithi110 ceph-mon[28069]: pgmap v5196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:32 smithi196 ceph-mon[32572]: pgmap v5196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:35 smithi196 ceph-mon[32572]: pgmap v5197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:35 smithi110 ceph-mon[28069]: pgmap v5197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:35 smithi193 ceph-mon[32782]: pgmap v5197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:36 smithi110 ceph-mon[28069]: pgmap v5198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:36 smithi193 ceph-mon[32782]: pgmap v5198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:36 smithi196 ceph-mon[32572]: pgmap v5198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8851.946555 secs 2024-04-26T14:15:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8851.946555 secs 2024-04-26T14:15:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8851.946555 secs 2024-04-26T14:15:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:38 smithi110 ceph-mon[28069]: pgmap v5199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:38 smithi193 ceph-mon[32782]: pgmap v5199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:38 smithi196 ceph-mon[32572]: pgmap v5199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:41 smithi196 ceph-mon[32572]: pgmap v5200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:41 smithi110 ceph-mon[28069]: pgmap v5200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:41 smithi193 ceph-mon[32782]: pgmap v5200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8856.946671 secs 2024-04-26T14:15:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:42 smithi196 ceph-mon[32572]: pgmap v5201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8856.946671 secs 2024-04-26T14:15:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:42 smithi110 ceph-mon[28069]: pgmap v5201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8856.946671 secs 2024-04-26T14:15:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:42 smithi193 ceph-mon[32782]: pgmap v5201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:45 smithi196 ceph-mon[32572]: pgmap v5202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:45 smithi110 ceph-mon[28069]: pgmap v5202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:45 smithi193 ceph-mon[32782]: pgmap v5202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:46 smithi196 ceph-mon[32572]: pgmap v5203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:46 smithi110 ceph-mon[28069]: pgmap v5203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:46 smithi193 ceph-mon[32782]: pgmap v5203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8861.946779 secs 2024-04-26T14:15:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8861.946779 secs 2024-04-26T14:15:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8861.946779 secs 2024-04-26T14:15:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:48 smithi196 ceph-mon[32572]: pgmap v5204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:48 smithi110 ceph-mon[28069]: pgmap v5204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:48 smithi193 ceph-mon[32782]: pgmap v5204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:50 smithi110 ceph-mon[28069]: pgmap v5205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:50 smithi193 ceph-mon[32782]: pgmap v5205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:50 smithi196 ceph-mon[32572]: pgmap v5205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:51 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8866.946859 secs 2024-04-26T14:15:51.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:51 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8866.946859 secs 2024-04-26T14:15:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:51 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8866.946859 secs 2024-04-26T14:15:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:52 smithi193 ceph-mon[32782]: pgmap v5206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:52 smithi196 ceph-mon[32572]: pgmap v5206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:52 smithi110 ceph-mon[28069]: pgmap v5206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:54 smithi110 ceph-mon[28069]: pgmap v5207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:54 smithi193 ceph-mon[32782]: pgmap v5207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:54 smithi196 ceph-mon[32572]: pgmap v5207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:56 smithi110 ceph-mon[28069]: pgmap v5208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:56 smithi193 ceph-mon[32782]: pgmap v5208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:56 smithi196 ceph-mon[32572]: pgmap v5208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:15:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8871.946976 secs 2024-04-26T14:15:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8871.946976 secs 2024-04-26T14:15:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8871.946976 secs 2024-04-26T14:15:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:15:58 smithi110 ceph-mon[28069]: pgmap v5209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:15:58 smithi193 ceph-mon[32782]: pgmap v5209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:15:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:15:58 smithi196 ceph-mon[32572]: pgmap v5209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:00 smithi110 ceph-mon[28069]: pgmap v5210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:00 smithi193 ceph-mon[32782]: pgmap v5210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:00 smithi196 ceph-mon[32572]: pgmap v5210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:01 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8876.947099 secs 2024-04-26T14:16:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:01 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8876.947099 secs 2024-04-26T14:16:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:01 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8876.947099 secs 2024-04-26T14:16:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:02 smithi193 ceph-mon[32782]: pgmap v5211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:02.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:02 smithi110 ceph-mon[28069]: pgmap v5211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:02 smithi196 ceph-mon[32572]: pgmap v5211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:04 smithi110 ceph-mon[28069]: pgmap v5212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:04 smithi193 ceph-mon[32782]: pgmap v5212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:04 smithi196 ceph-mon[32572]: pgmap v5212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:06 smithi110 ceph-mon[28069]: pgmap v5213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:06 smithi193 ceph-mon[32782]: pgmap v5213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:06 smithi196 ceph-mon[32572]: pgmap v5213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8881.947174 secs 2024-04-26T14:16:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8881.947174 secs 2024-04-26T14:16:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8881.947174 secs 2024-04-26T14:16:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:08 smithi110 ceph-mon[28069]: pgmap v5214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:08 smithi193 ceph-mon[32782]: pgmap v5214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:08 smithi196 ceph-mon[32572]: pgmap v5214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:10 smithi110 ceph-mon[28069]: pgmap v5215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:10 smithi193 ceph-mon[32782]: pgmap v5215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:10 smithi196 ceph-mon[32572]: pgmap v5215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:11.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:16:11.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:11.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:11.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:11.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:16:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:16:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8886.947264 secs 2024-04-26T14:16:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:16:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:16:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:12 smithi110 ceph-mon[28069]: pgmap v5216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:16:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:12 smithi110 ceph-mon[28069]: pgmap v5217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:16:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8886.947264 secs 2024-04-26T14:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:12 smithi193 ceph-mon[32782]: pgmap v5216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:12 smithi193 ceph-mon[32782]: pgmap v5217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8886.947264 secs 2024-04-26T14:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:12 smithi196 ceph-mon[32572]: pgmap v5216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:12 smithi196 ceph-mon[32572]: pgmap v5217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:16:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:15 smithi110 ceph-mon[28069]: pgmap v5218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:15 smithi193 ceph-mon[32782]: pgmap v5218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:15 smithi196 ceph-mon[32572]: pgmap v5218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:17 smithi110 ceph-mon[28069]: pgmap v5219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8891.947388 secs 2024-04-26T14:16:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:17 smithi193 ceph-mon[32782]: pgmap v5219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8891.947388 secs 2024-04-26T14:16:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:17 smithi196 ceph-mon[32572]: pgmap v5219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8891.947388 secs 2024-04-26T14:16:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:19 smithi110 ceph-mon[28069]: pgmap v5220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:19 smithi193 ceph-mon[32782]: pgmap v5220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:19 smithi196 ceph-mon[32572]: pgmap v5220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:21 smithi110 ceph-mon[28069]: pgmap v5221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:21.305 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:21 smithi196 ceph-mon[32572]: pgmap v5221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:21 smithi193 ceph-mon[32782]: pgmap v5221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:16:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8896.947512 secs 2024-04-26T14:16:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8896.947512 secs 2024-04-26T14:16:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8896.947512 secs 2024-04-26T14:16:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:23 smithi193 ceph-mon[32782]: pgmap v5222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:16:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:23 smithi196 ceph-mon[32572]: pgmap v5222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:16:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:23 smithi110 ceph-mon[28069]: pgmap v5222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:16:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:25 smithi193 ceph-mon[32782]: pgmap v5223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:25 smithi196 ceph-mon[32572]: pgmap v5223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:25 smithi110 ceph-mon[28069]: pgmap v5223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:27 smithi193 ceph-mon[32782]: pgmap v5224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8901.947629 secs 2024-04-26T14:16:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:27 smithi196 ceph-mon[32572]: pgmap v5224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8901.947629 secs 2024-04-26T14:16:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:27 smithi110 ceph-mon[28069]: pgmap v5224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8901.947629 secs 2024-04-26T14:16:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:29 smithi193 ceph-mon[32782]: pgmap v5225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:29 smithi196 ceph-mon[32572]: pgmap v5225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:29 smithi110 ceph-mon[28069]: pgmap v5225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:31 smithi193 ceph-mon[32782]: pgmap v5226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:31 smithi196 ceph-mon[32572]: pgmap v5226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:31 smithi110 ceph-mon[28069]: pgmap v5226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8906.947749 secs 2024-04-26T14:16:32.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8906.947749 secs 2024-04-26T14:16:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8906.947749 secs 2024-04-26T14:16:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:33 smithi193 ceph-mon[32782]: pgmap v5227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:33 smithi196 ceph-mon[32572]: pgmap v5227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:33 smithi110 ceph-mon[28069]: pgmap v5227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:35 smithi193 ceph-mon[32782]: pgmap v5228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:35 smithi196 ceph-mon[32572]: pgmap v5228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:35 smithi110 ceph-mon[28069]: pgmap v5228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:37 smithi193 ceph-mon[32782]: pgmap v5229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8911.947871 secs 2024-04-26T14:16:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:37 smithi196 ceph-mon[32572]: pgmap v5229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8911.947871 secs 2024-04-26T14:16:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:37 smithi110 ceph-mon[28069]: pgmap v5229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8911.947871 secs 2024-04-26T14:16:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:39 smithi193 ceph-mon[32782]: pgmap v5230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:39 smithi196 ceph-mon[32572]: pgmap v5230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:39 smithi110 ceph-mon[28069]: pgmap v5230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:41 smithi193 ceph-mon[32782]: pgmap v5231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:41 smithi196 ceph-mon[32572]: pgmap v5231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:41 smithi110 ceph-mon[28069]: pgmap v5231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8916.947947 secs 2024-04-26T14:16:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8916.947947 secs 2024-04-26T14:16:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8916.947947 secs 2024-04-26T14:16:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:43 smithi193 ceph-mon[32782]: pgmap v5232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:43 smithi196 ceph-mon[32572]: pgmap v5232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:43 smithi110 ceph-mon[28069]: pgmap v5232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:45 smithi193 ceph-mon[32782]: pgmap v5233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:45 smithi196 ceph-mon[32572]: pgmap v5233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:45 smithi110 ceph-mon[28069]: pgmap v5233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:47 smithi196 ceph-mon[32572]: pgmap v5234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8921.948069 secs 2024-04-26T14:16:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:47 smithi110 ceph-mon[28069]: pgmap v5234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8921.948069 secs 2024-04-26T14:16:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:47 smithi193 ceph-mon[32782]: pgmap v5234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8921.948069 secs 2024-04-26T14:16:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:16:47.811+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006390 con 0x7f261c104b50 2024-04-26T14:16:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:16:47.811+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:16:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:16:47.812+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 72 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:16:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:16:47.812+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 72 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006390 con 0x55db1be4fdd0 2024-04-26T14:16:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:49 smithi196 ceph-mon[32572]: pgmap v5235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:49 smithi110 ceph-mon[28069]: pgmap v5235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:49 smithi193 ceph-mon[32782]: pgmap v5235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:51 smithi196 ceph-mon[32572]: pgmap v5236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:51 smithi110 ceph-mon[28069]: pgmap v5236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:51 smithi193 ceph-mon[32782]: pgmap v5236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8926.948168 secs 2024-04-26T14:16:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8926.948168 secs 2024-04-26T14:16:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8926.948168 secs 2024-04-26T14:16:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:53 smithi196 ceph-mon[32572]: pgmap v5237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:53 smithi110 ceph-mon[28069]: pgmap v5237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:53 smithi193 ceph-mon[32782]: pgmap v5237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:55 smithi196 ceph-mon[32572]: pgmap v5238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:55 smithi110 ceph-mon[28069]: pgmap v5238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:55 smithi193 ceph-mon[32782]: pgmap v5238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:57 smithi196 ceph-mon[32572]: pgmap v5239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8931.948311 secs 2024-04-26T14:16:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:57 smithi110 ceph-mon[28069]: pgmap v5239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8931.948311 secs 2024-04-26T14:16:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:57 smithi193 ceph-mon[32782]: pgmap v5239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:16:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8931.948311 secs 2024-04-26T14:16:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:16:59 smithi196 ceph-mon[32572]: pgmap v5240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:16:59 smithi110 ceph-mon[28069]: pgmap v5240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:16:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:16:59 smithi193 ceph-mon[32782]: pgmap v5240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:01 smithi196 ceph-mon[32572]: pgmap v5241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:01 smithi110 ceph-mon[28069]: pgmap v5241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:01 smithi193 ceph-mon[32782]: pgmap v5241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:02.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 8936.948433 secs 2024-04-26T14:17:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 8936.948433 secs 2024-04-26T14:17:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 8936.948433 secs 2024-04-26T14:17:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:03 smithi196 ceph-mon[32572]: pgmap v5242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:03 smithi110 ceph-mon[28069]: pgmap v5242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:03 smithi193 ceph-mon[32782]: pgmap v5242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:05 smithi196 ceph-mon[32572]: pgmap v5243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:05 smithi110 ceph-mon[28069]: pgmap v5243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:05 smithi193 ceph-mon[32782]: pgmap v5243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:07 smithi196 ceph-mon[32572]: pgmap v5244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:07 smithi196 ceph-mon[32572]: 9 slow requests, 1 included below; oldest blocked for > 8941.948557 secs 2024-04-26T14:17:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:07 smithi196 ceph-mon[32572]: slow request 181.761517 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:17:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:07 smithi110 ceph-mon[28069]: pgmap v5244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:07 smithi110 ceph-mon[28069]: 9 slow requests, 1 included below; oldest blocked for > 8941.948557 secs 2024-04-26T14:17:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:07 smithi110 ceph-mon[28069]: slow request 181.761517 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:17:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:07 smithi193 ceph-mon[32782]: pgmap v5244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:07 smithi193 ceph-mon[32782]: 9 slow requests, 1 included below; oldest blocked for > 8941.948557 secs 2024-04-26T14:17:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:07 smithi193 ceph-mon[32782]: slow request 181.761517 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:17:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:09 smithi196 ceph-mon[32572]: pgmap v5245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:17:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:09 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:17:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:09 smithi110 ceph-mon[28069]: pgmap v5245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:17:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:09 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:17:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:09 smithi193 ceph-mon[32782]: pgmap v5245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:17:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:09 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:17:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:11 smithi196 ceph-mon[32572]: pgmap v5246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:11 smithi110 ceph-mon[28069]: pgmap v5246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:11 smithi193 ceph-mon[32782]: pgmap v5246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:12 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8946.948642 secs 2024-04-26T14:17:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:12 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8946.948642 secs 2024-04-26T14:17:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:12 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8946.948642 secs 2024-04-26T14:17:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:13 smithi193 ceph-mon[32782]: pgmap v5247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:17:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:13 smithi196 ceph-mon[32572]: pgmap v5247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:17:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:13 smithi110 ceph-mon[28069]: pgmap v5247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:17:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: pgmap v5248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: pgmap v5248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: pgmap v5248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:17:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:17:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:17:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:17:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:17:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:17:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:17:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:17:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:17:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:17:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:17 smithi193 ceph-mon[32782]: pgmap v5249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:17 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8951.948763 secs 2024-04-26T14:17:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:17 smithi196 ceph-mon[32572]: pgmap v5249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:17 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8951.948763 secs 2024-04-26T14:17:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:17 smithi110 ceph-mon[28069]: pgmap v5249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:17 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8951.948763 secs 2024-04-26T14:17:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:17:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:17:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:17:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:17:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:17:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:17:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:19 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:17:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:19 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:17:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:19 smithi193 ceph-mon[32782]: pgmap v5250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:17:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:19 smithi193 ceph-mon[32782]: pgmap v5251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:19 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:17:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:19 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:17:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:19 smithi196 ceph-mon[32572]: pgmap v5250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:17:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:19 smithi196 ceph-mon[32572]: pgmap v5251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:19 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:17:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:19 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:17:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:19 smithi110 ceph-mon[28069]: pgmap v5250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:17:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:19 smithi110 ceph-mon[28069]: pgmap v5251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:21 smithi193 ceph-mon[32782]: pgmap v5252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:21 smithi196 ceph-mon[32572]: pgmap v5252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:21 smithi110 ceph-mon[28069]: pgmap v5252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:22 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8956.948897 secs 2024-04-26T14:17:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:22 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8956.948897 secs 2024-04-26T14:17:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:22 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8956.948897 secs 2024-04-26T14:17:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:23 smithi193 ceph-mon[32782]: pgmap v5253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:23 smithi196 ceph-mon[32572]: pgmap v5253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:23 smithi110 ceph-mon[28069]: pgmap v5253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:25 smithi193 ceph-mon[32782]: pgmap v5254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:25 smithi196 ceph-mon[32572]: pgmap v5254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:25 smithi110 ceph-mon[28069]: pgmap v5254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:27 smithi193 ceph-mon[32782]: pgmap v5255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:27 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8961.948964 secs 2024-04-26T14:17:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:27 smithi196 ceph-mon[32572]: pgmap v5255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:27 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8961.948964 secs 2024-04-26T14:17:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:27 smithi110 ceph-mon[28069]: pgmap v5255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:17:27.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:27 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8961.948964 secs 2024-04-26T14:17:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:29 smithi193 ceph-mon[32782]: pgmap v5256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:17:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:29 smithi196 ceph-mon[32572]: pgmap v5256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:17:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:29 smithi110 ceph-mon[28069]: pgmap v5256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:17:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:31 smithi196 ceph-mon[32572]: pgmap v5257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:31 smithi110 ceph-mon[28069]: pgmap v5257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:31 smithi193 ceph-mon[32782]: pgmap v5257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:32.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:32 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8966.949088 secs 2024-04-26T14:17:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:32 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8966.949088 secs 2024-04-26T14:17:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:32 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8966.949088 secs 2024-04-26T14:17:33.721 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:33 smithi110 ceph-mon[28069]: pgmap v5258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:33 smithi196 ceph-mon[32572]: pgmap v5258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:33 smithi193 ceph-mon[32782]: pgmap v5258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:35 smithi196 ceph-mon[32572]: pgmap v5259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:35 smithi110 ceph-mon[28069]: pgmap v5259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:35 smithi193 ceph-mon[32782]: pgmap v5259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:37 smithi196 ceph-mon[32572]: pgmap v5260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:37 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8971.949230 secs 2024-04-26T14:17:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:37 smithi110 ceph-mon[28069]: pgmap v5260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:37 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8971.949230 secs 2024-04-26T14:17:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:37 smithi193 ceph-mon[32782]: pgmap v5260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:37 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8971.949230 secs 2024-04-26T14:17:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:39 smithi196 ceph-mon[32572]: pgmap v5261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:39 smithi110 ceph-mon[28069]: pgmap v5261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:39 smithi193 ceph-mon[32782]: pgmap v5261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:41.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:41 smithi193 ceph-mon[32782]: pgmap v5262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:41 smithi196 ceph-mon[32572]: pgmap v5262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:41 smithi110 ceph-mon[28069]: pgmap v5262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:42.690 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:42 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8976.949316 secs 2024-04-26T14:17:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:42 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8976.949316 secs 2024-04-26T14:17:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:42 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8976.949316 secs 2024-04-26T14:17:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:43 smithi196 ceph-mon[32572]: pgmap v5263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:43 smithi110 ceph-mon[28069]: pgmap v5263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:43 smithi193 ceph-mon[32782]: pgmap v5263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:45 smithi196 ceph-mon[32572]: pgmap v5264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:45 smithi110 ceph-mon[28069]: pgmap v5264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:45 smithi193 ceph-mon[32782]: pgmap v5264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:47 smithi196 ceph-mon[32572]: pgmap v5265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:47 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8981.949433 secs 2024-04-26T14:17:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:47 smithi110 ceph-mon[28069]: pgmap v5265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:47 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8981.949433 secs 2024-04-26T14:17:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:47 smithi193 ceph-mon[32782]: pgmap v5265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:47 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8981.949433 secs 2024-04-26T14:17:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:49 smithi196 ceph-mon[32572]: pgmap v5266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:49 smithi110 ceph-mon[28069]: pgmap v5266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:49 smithi193 ceph-mon[32782]: pgmap v5266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:51 smithi196 ceph-mon[32572]: pgmap v5267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:51 smithi110 ceph-mon[28069]: pgmap v5267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:51 smithi193 ceph-mon[32782]: pgmap v5267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:52 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8986.949557 secs 2024-04-26T14:17:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:52 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8986.949557 secs 2024-04-26T14:17:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:52 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8986.949557 secs 2024-04-26T14:17:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:53 smithi196 ceph-mon[32572]: pgmap v5268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:53 smithi110 ceph-mon[28069]: pgmap v5268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:53 smithi193 ceph-mon[32782]: pgmap v5268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:55 smithi196 ceph-mon[32572]: pgmap v5269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:55 smithi110 ceph-mon[28069]: pgmap v5269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:55 smithi193 ceph-mon[32782]: pgmap v5269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:57 smithi196 ceph-mon[32572]: pgmap v5270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:57 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8991.949699 secs 2024-04-26T14:17:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:57 smithi110 ceph-mon[28069]: pgmap v5270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:57 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8991.949699 secs 2024-04-26T14:17:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:57 smithi193 ceph-mon[32782]: pgmap v5270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:17:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:57 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8991.949699 secs 2024-04-26T14:17:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:17:59 smithi196 ceph-mon[32572]: pgmap v5271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:17:59 smithi110 ceph-mon[28069]: pgmap v5271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:17:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:17:59 smithi193 ceph-mon[32782]: pgmap v5271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:01 smithi196 ceph-mon[32572]: pgmap v5272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:01 smithi110 ceph-mon[28069]: pgmap v5272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:01 smithi193 ceph-mon[32782]: pgmap v5272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:02 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 8996.949827 secs 2024-04-26T14:18:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:02 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 8996.949827 secs 2024-04-26T14:18:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:02 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 8996.949827 secs 2024-04-26T14:18:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:03 smithi196 ceph-mon[32572]: pgmap v5273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:03 smithi110 ceph-mon[28069]: pgmap v5273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:03 smithi193 ceph-mon[32782]: pgmap v5273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:04 smithi196 ceph-mon[32572]: pgmap v5274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:04 smithi110 ceph-mon[28069]: pgmap v5274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:04 smithi193 ceph-mon[32782]: pgmap v5274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:06 smithi196 ceph-mon[32572]: pgmap v5275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:06 smithi196 ceph-mon[32572]: 9 slow requests, 1 included below; oldest blocked for > 9001.949886 secs 2024-04-26T14:18:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:06 smithi196 ceph-mon[32572]: slow request 1442.343456 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:18:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:06 smithi110 ceph-mon[28069]: pgmap v5275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:06 smithi110 ceph-mon[28069]: 9 slow requests, 1 included below; oldest blocked for > 9001.949886 secs 2024-04-26T14:18:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:06 smithi110 ceph-mon[28069]: slow request 1442.343456 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:18:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:06 smithi193 ceph-mon[32782]: pgmap v5275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:06 smithi193 ceph-mon[32782]: 9 slow requests, 1 included below; oldest blocked for > 9001.949886 secs 2024-04-26T14:18:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:06 smithi193 ceph-mon[32782]: slow request 1442.343456 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:18:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:08 smithi196 ceph-mon[32572]: pgmap v5276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:08 smithi110 ceph-mon[28069]: pgmap v5276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:08 smithi193 ceph-mon[32782]: pgmap v5276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:10 smithi196 ceph-mon[32572]: pgmap v5277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:10 smithi110 ceph-mon[28069]: pgmap v5277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:10 smithi193 ceph-mon[32782]: pgmap v5277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:11 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9006.950005 secs 2024-04-26T14:18:12.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:11 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9006.950005 secs 2024-04-26T14:18:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:11 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9006.950005 secs 2024-04-26T14:18:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:12 smithi196 ceph-mon[32572]: pgmap v5278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:12 smithi110 ceph-mon[28069]: pgmap v5278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:12 smithi193 ceph-mon[32782]: pgmap v5278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:14 smithi196 ceph-mon[32572]: pgmap v5279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:14 smithi110 ceph-mon[28069]: pgmap v5279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:14 smithi193 ceph-mon[32782]: pgmap v5279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.389+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T14:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.389+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T14:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.389+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f261401f050 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T14:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.389+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f261401f050 comp rx=0 tx=0).stop 2024-04-26T14:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.389+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T14:18:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.389+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T14:18:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.389+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T14:18:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.389+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T14:18:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.390+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T14:18:16.391 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.391+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261403d000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T14:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.405+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T14:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.405+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T14:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.405+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T14:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.405+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T14:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.405+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T14:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.406+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T14:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:16.407+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T14:18:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:16 smithi196 ceph-mon[32572]: pgmap v5280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:16 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9011.950137 secs 2024-04-26T14:18:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:16 smithi110 ceph-mon[28069]: pgmap v5280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:16 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9011.950137 secs 2024-04-26T14:18:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:16 smithi193 ceph-mon[32782]: pgmap v5280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:16 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9011.950137 secs 2024-04-26T14:18:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:17.826+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006370 con 0x7f261c104b50 2024-04-26T14:18:17.826 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:17.826+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:18:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:17.827+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 73 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:18:17.827 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:18:17.827+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 73 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006370 con 0x55db1be4fdd0 2024-04-26T14:18:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:18 smithi196 ceph-mon[32572]: pgmap v5281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:18:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:18 smithi110 ceph-mon[28069]: pgmap v5281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:18:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:18 smithi193 ceph-mon[32782]: pgmap v5281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:18:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:18:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:18:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:19 smithi196 ceph-mon[32572]: pgmap v5282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T14:18:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:19 smithi196 ceph-mon[32572]: pgmap v5283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:18:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:18:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:18:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:19 smithi110 ceph-mon[28069]: pgmap v5282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T14:18:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:19 smithi110 ceph-mon[28069]: pgmap v5283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:18:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:18:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:18:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:19 smithi193 ceph-mon[32782]: pgmap v5282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T14:18:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:19 smithi193 ceph-mon[32782]: pgmap v5283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:18:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:22 smithi196 ceph-mon[32572]: pgmap v5284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:22 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9016.950281 secs 2024-04-26T14:18:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:22 smithi110 ceph-mon[28069]: pgmap v5284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:22 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9016.950281 secs 2024-04-26T14:18:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:22 smithi193 ceph-mon[32782]: pgmap v5284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:22 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9016.950281 secs 2024-04-26T14:18:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:24 smithi196 ceph-mon[32572]: pgmap v5285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:24 smithi110 ceph-mon[28069]: pgmap v5285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:24 smithi193 ceph-mon[32782]: pgmap v5285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:26 smithi196 ceph-mon[32572]: pgmap v5286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:26 smithi110 ceph-mon[28069]: pgmap v5286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:26 smithi193 ceph-mon[32782]: pgmap v5286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:18:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:27 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9021.950392 secs 2024-04-26T14:18:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:27 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9021.950392 secs 2024-04-26T14:18:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:27 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9021.950392 secs 2024-04-26T14:18:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:28 smithi196 ceph-mon[32572]: pgmap v5287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T14:18:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:28 smithi110 ceph-mon[28069]: pgmap v5287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T14:18:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:28 smithi193 ceph-mon[32782]: pgmap v5287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T14:18:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:30 smithi196 ceph-mon[32572]: pgmap v5288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:18:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:30 smithi110 ceph-mon[28069]: pgmap v5288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:18:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:30 smithi193 ceph-mon[32782]: pgmap v5288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:18:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:32 smithi196 ceph-mon[32572]: pgmap v5289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:32 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9026.950516 secs 2024-04-26T14:18:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:32 smithi110 ceph-mon[28069]: pgmap v5289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:32 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9026.950516 secs 2024-04-26T14:18:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:32 smithi193 ceph-mon[32782]: pgmap v5289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:32 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9026.950516 secs 2024-04-26T14:18:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:34 smithi196 ceph-mon[32572]: pgmap v5290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:34 smithi110 ceph-mon[28069]: pgmap v5290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:34 smithi193 ceph-mon[32782]: pgmap v5290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:36 smithi196 ceph-mon[32572]: pgmap v5291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:36 smithi110 ceph-mon[28069]: pgmap v5291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:36 smithi193 ceph-mon[32782]: pgmap v5291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:37 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9031.950639 secs 2024-04-26T14:18:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:37 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9031.950639 secs 2024-04-26T14:18:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:37 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9031.950639 secs 2024-04-26T14:18:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:38 smithi196 ceph-mon[32572]: pgmap v5292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:38 smithi110 ceph-mon[28069]: pgmap v5292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:38 smithi193 ceph-mon[32782]: pgmap v5292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:40 smithi196 ceph-mon[32572]: pgmap v5293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:40 smithi110 ceph-mon[28069]: pgmap v5293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:40 smithi193 ceph-mon[32782]: pgmap v5293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:42 smithi196 ceph-mon[32572]: pgmap v5294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:42 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9036.950766 secs 2024-04-26T14:18:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:42 smithi110 ceph-mon[28069]: pgmap v5294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:42 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9036.950766 secs 2024-04-26T14:18:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:42 smithi193 ceph-mon[32782]: pgmap v5294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:42 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9036.950766 secs 2024-04-26T14:18:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:44 smithi196 ceph-mon[32572]: pgmap v5295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:44 smithi110 ceph-mon[28069]: pgmap v5295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:44 smithi193 ceph-mon[32782]: pgmap v5295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:46 smithi196 ceph-mon[32572]: pgmap v5296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:46 smithi110 ceph-mon[28069]: pgmap v5296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:46 smithi193 ceph-mon[32782]: pgmap v5296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:47 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9041.950828 secs 2024-04-26T14:18:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:47 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9041.950828 secs 2024-04-26T14:18:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:47 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9041.950828 secs 2024-04-26T14:18:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:48 smithi110 ceph-mon[28069]: pgmap v5297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:48 smithi193 ceph-mon[32782]: pgmap v5297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:48 smithi196 ceph-mon[32572]: pgmap v5297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:50 smithi110 ceph-mon[28069]: pgmap v5298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:50 smithi193 ceph-mon[32782]: pgmap v5298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:50 smithi196 ceph-mon[32572]: pgmap v5298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:52 smithi110 ceph-mon[28069]: pgmap v5299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:52 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9046.950958 secs 2024-04-26T14:18:52.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:52 smithi196 ceph-mon[32572]: pgmap v5299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:52.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:52 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9046.950958 secs 2024-04-26T14:18:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:52 smithi193 ceph-mon[32782]: pgmap v5299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:52 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9046.950958 secs 2024-04-26T14:18:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:54 smithi110 ceph-mon[28069]: pgmap v5300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:54 smithi193 ceph-mon[32782]: pgmap v5300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:54 smithi196 ceph-mon[32572]: pgmap v5300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:18:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:56 smithi110 ceph-mon[28069]: pgmap v5301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:56 smithi193 ceph-mon[32782]: pgmap v5301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:56 smithi196 ceph-mon[32572]: pgmap v5301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:57 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9051.951099 secs 2024-04-26T14:18:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:57 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9051.951099 secs 2024-04-26T14:18:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:57 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9051.951099 secs 2024-04-26T14:18:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:18:58 smithi193 ceph-mon[32782]: pgmap v5302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:18:58 smithi196 ceph-mon[32572]: pgmap v5302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:18:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:18:58 smithi110 ceph-mon[28069]: pgmap v5302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:00 smithi193 ceph-mon[32782]: pgmap v5303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:00 smithi196 ceph-mon[32572]: pgmap v5303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:00 smithi110 ceph-mon[28069]: pgmap v5303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:02.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:02 smithi110 ceph-mon[28069]: pgmap v5304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:02.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:02 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9056.951236 secs 2024-04-26T14:19:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:02 smithi193 ceph-mon[32782]: pgmap v5304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:02 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9056.951236 secs 2024-04-26T14:19:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:02 smithi196 ceph-mon[32572]: pgmap v5304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:02 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9056.951236 secs 2024-04-26T14:19:04.573 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:04 smithi110 ceph-mon[28069]: pgmap v5305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:04 smithi193 ceph-mon[32782]: pgmap v5305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:04 smithi196 ceph-mon[32572]: pgmap v5305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:05.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:19:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:19:04.571+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:19:05.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:19:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:19:04.571+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:19:05.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:19:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:19:04.571+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:19:05.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:19:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:19:04.571+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:19:05.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:19:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:19:04.571+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:19:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:06 smithi193 ceph-mon[32782]: pgmap v5306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:06 smithi196 ceph-mon[32572]: pgmap v5306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:06 smithi110 ceph-mon[28069]: pgmap v5306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:07 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9061.951366 secs 2024-04-26T14:19:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:07 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9061.951366 secs 2024-04-26T14:19:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:07 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9061.951366 secs 2024-04-26T14:19:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:08 smithi193 ceph-mon[32782]: pgmap v5307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:08 smithi196 ceph-mon[32572]: pgmap v5307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:08 smithi110 ceph-mon[28069]: pgmap v5307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:10 smithi193 ceph-mon[32782]: pgmap v5308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:19:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:10 smithi196 ceph-mon[32572]: pgmap v5308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:19:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:10 smithi110 ceph-mon[28069]: pgmap v5308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:19:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:12 smithi193 ceph-mon[32782]: pgmap v5309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:19:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:12 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9066.951492 secs 2024-04-26T14:19:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:12 smithi196 ceph-mon[32572]: pgmap v5309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:19:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:12 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9066.951492 secs 2024-04-26T14:19:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:12 smithi110 ceph-mon[28069]: pgmap v5309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:19:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:12 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9066.951492 secs 2024-04-26T14:19:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:14 smithi193 ceph-mon[32782]: pgmap v5310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:19:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:14 smithi196 ceph-mon[32572]: pgmap v5310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:19:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:14 smithi110 ceph-mon[28069]: pgmap v5310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:19:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:16 smithi193 ceph-mon[32782]: pgmap v5311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:19:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:16 smithi196 ceph-mon[32572]: pgmap v5311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:19:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:16 smithi110 ceph-mon[28069]: pgmap v5311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:19:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:17 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9071.951637 secs 2024-04-26T14:19:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:17 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9071.951637 secs 2024-04-26T14:19:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:17 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9071.951637 secs 2024-04-26T14:19:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:18 smithi193 ceph-mon[32782]: pgmap v5312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:19:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:18 smithi196 ceph-mon[32572]: pgmap v5312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:19:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:18 smithi110 ceph-mon[28069]: pgmap v5312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:19:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:20 smithi193 ceph-mon[32782]: pgmap v5313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:19:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:19:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:20 smithi196 ceph-mon[32572]: pgmap v5313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:19:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:19:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:20 smithi110 ceph-mon[28069]: pgmap v5313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:19:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:19:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:19:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:19:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:19:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:19:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:19:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:19:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:19:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:19:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:19:22.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:22 smithi196 ceph-mon[32572]: pgmap v5314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:19:22.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:22 smithi196 ceph-mon[32572]: pgmap v5315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:22.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:22 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9076.951756 secs 2024-04-26T14:19:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:22 smithi110 ceph-mon[28069]: pgmap v5314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:19:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:22 smithi110 ceph-mon[28069]: pgmap v5315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:22 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9076.951756 secs 2024-04-26T14:19:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:22 smithi193 ceph-mon[32782]: pgmap v5314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:19:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:22 smithi193 ceph-mon[32782]: pgmap v5315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:22 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9076.951756 secs 2024-04-26T14:19:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:24 smithi196 ceph-mon[32572]: pgmap v5316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:24 smithi110 ceph-mon[28069]: pgmap v5316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:24 smithi193 ceph-mon[32782]: pgmap v5316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:26 smithi196 ceph-mon[32572]: pgmap v5317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:26 smithi110 ceph-mon[28069]: pgmap v5317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:26 smithi193 ceph-mon[32782]: pgmap v5317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:27 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9081.951842 secs 2024-04-26T14:19:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:27 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9081.951842 secs 2024-04-26T14:19:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:27 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9081.951842 secs 2024-04-26T14:19:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:28 smithi196 ceph-mon[32572]: pgmap v5318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:28 smithi110 ceph-mon[28069]: pgmap v5318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:28 smithi193 ceph-mon[32782]: pgmap v5318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:30 smithi196 ceph-mon[32572]: pgmap v5319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:30 smithi110 ceph-mon[28069]: pgmap v5319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:30 smithi193 ceph-mon[32782]: pgmap v5319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:19:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:32 smithi196 ceph-mon[32572]: pgmap v5320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:19:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:32 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9086.951973 secs 2024-04-26T14:19:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:32 smithi110 ceph-mon[28069]: pgmap v5320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:19:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:32 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9086.951973 secs 2024-04-26T14:19:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:32 smithi193 ceph-mon[32782]: pgmap v5320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:19:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:32 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9086.951973 secs 2024-04-26T14:19:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:34 smithi196 ceph-mon[32572]: pgmap v5321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:34 smithi110 ceph-mon[28069]: pgmap v5321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:34 smithi193 ceph-mon[32782]: pgmap v5321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:36 smithi196 ceph-mon[32572]: pgmap v5322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:36 smithi110 ceph-mon[28069]: pgmap v5322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:36 smithi193 ceph-mon[32782]: pgmap v5322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:37.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:37 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9091.952052 secs 2024-04-26T14:19:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:37 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9091.952052 secs 2024-04-26T14:19:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:37 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9091.952052 secs 2024-04-26T14:19:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:38 smithi196 ceph-mon[32572]: pgmap v5323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:38 smithi110 ceph-mon[28069]: pgmap v5323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:38 smithi193 ceph-mon[32782]: pgmap v5323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:40 smithi196 ceph-mon[32572]: pgmap v5324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:40 smithi110 ceph-mon[28069]: pgmap v5324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:40 smithi193 ceph-mon[32782]: pgmap v5324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:42 smithi196 ceph-mon[32572]: pgmap v5325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:42 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9096.952183 secs 2024-04-26T14:19:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:42 smithi110 ceph-mon[28069]: pgmap v5325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:42 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9096.952183 secs 2024-04-26T14:19:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:42 smithi193 ceph-mon[32782]: pgmap v5325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:42 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9096.952183 secs 2024-04-26T14:19:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:44 smithi196 ceph-mon[32572]: pgmap v5326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:44 smithi110 ceph-mon[28069]: pgmap v5326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:44 smithi193 ceph-mon[32782]: pgmap v5326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:46 smithi196 ceph-mon[32572]: pgmap v5327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:46 smithi110 ceph-mon[28069]: pgmap v5327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:46 smithi193 ceph-mon[32782]: pgmap v5327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:47 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9101.952307 secs 2024-04-26T14:19:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:47 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9101.952307 secs 2024-04-26T14:19:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:47 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9101.952307 secs 2024-04-26T14:19:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:48 smithi196 ceph-mon[32572]: pgmap v5328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:48 smithi110 ceph-mon[28069]: pgmap v5328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:48 smithi193 ceph-mon[32782]: pgmap v5328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:50 smithi196 ceph-mon[32572]: pgmap v5329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:50 smithi110 ceph-mon[28069]: pgmap v5329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:50 smithi193 ceph-mon[32782]: pgmap v5329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:52 smithi196 ceph-mon[32572]: pgmap v5330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:52 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9106.952430 secs 2024-04-26T14:19:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:52 smithi110 ceph-mon[28069]: pgmap v5330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:52 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9106.952430 secs 2024-04-26T14:19:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:52 smithi193 ceph-mon[32782]: pgmap v5330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:52 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9106.952430 secs 2024-04-26T14:19:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:54 smithi196 ceph-mon[32572]: pgmap v5331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:54 smithi110 ceph-mon[28069]: pgmap v5331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:54 smithi193 ceph-mon[32782]: pgmap v5331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:56 smithi196 ceph-mon[32572]: pgmap v5332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:56 smithi110 ceph-mon[28069]: pgmap v5332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:56 smithi193 ceph-mon[32782]: pgmap v5332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:57 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9111.952595 secs 2024-04-26T14:19:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:57 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9111.952595 secs 2024-04-26T14:19:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:57 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9111.952595 secs 2024-04-26T14:19:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:58 smithi110 ceph-mon[28069]: pgmap v5333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:58 smithi193 ceph-mon[32782]: pgmap v5333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:58 smithi196 ceph-mon[32572]: pgmap v5333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:19:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:19:59 smithi110 ceph-mon[28069]: pgmap v5334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:19:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:19:59 smithi193 ceph-mon[32782]: pgmap v5334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:19:59 smithi196 ceph-mon[32572]: pgmap v5334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:20:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:20:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:20:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:01 smithi110 ceph-mon[28069]: pgmap v5335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:01 smithi193 ceph-mon[32782]: pgmap v5335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:01 smithi196 ceph-mon[32572]: pgmap v5335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:02 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9116.952747 secs 2024-04-26T14:20:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:02 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9116.952747 secs 2024-04-26T14:20:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:02 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9116.952747 secs 2024-04-26T14:20:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:03 smithi193 ceph-mon[32782]: pgmap v5336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:03 smithi196 ceph-mon[32572]: pgmap v5336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:03 smithi110 ceph-mon[28069]: pgmap v5336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:05 smithi110 ceph-mon[28069]: pgmap v5337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:05 smithi193 ceph-mon[32782]: pgmap v5337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:05 smithi196 ceph-mon[32572]: pgmap v5337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:06 smithi110 ceph-mon[28069]: 9 slow requests, 1 included below; oldest blocked for > 9121.952816 secs 2024-04-26T14:20:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:06 smithi110 ceph-mon[28069]: slow request 361.765775 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:20:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:06 smithi193 ceph-mon[32782]: 9 slow requests, 1 included below; oldest blocked for > 9121.952816 secs 2024-04-26T14:20:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:06 smithi193 ceph-mon[32782]: slow request 361.765775 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:20:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:06 smithi196 ceph-mon[32572]: 9 slow requests, 1 included below; oldest blocked for > 9121.952816 secs 2024-04-26T14:20:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:06 smithi196 ceph-mon[32572]: slow request 361.765775 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:20:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:07 smithi110 ceph-mon[28069]: pgmap v5338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:07 smithi193 ceph-mon[32782]: pgmap v5338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:07 smithi196 ceph-mon[32572]: pgmap v5338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:09 smithi110 ceph-mon[28069]: pgmap v5339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:09 smithi193 ceph-mon[32782]: pgmap v5339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:09 smithi196 ceph-mon[32572]: pgmap v5339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:11 smithi110 ceph-mon[28069]: pgmap v5340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:11 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9126.952893 secs 2024-04-26T14:20:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:11 smithi193 ceph-mon[32782]: pgmap v5340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:11 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9126.952893 secs 2024-04-26T14:20:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:11 smithi196 ceph-mon[32572]: pgmap v5340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:11 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9126.952893 secs 2024-04-26T14:20:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:13 smithi110 ceph-mon[28069]: pgmap v5341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:13 smithi193 ceph-mon[32782]: pgmap v5341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:13 smithi196 ceph-mon[32572]: pgmap v5341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:15 smithi110 ceph-mon[28069]: pgmap v5342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:15 smithi193 ceph-mon[32782]: pgmap v5342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:15 smithi196 ceph-mon[32572]: pgmap v5342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:16 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9131.953015 secs 2024-04-26T14:20:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:16 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9131.953015 secs 2024-04-26T14:20:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:16 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9131.953015 secs 2024-04-26T14:20:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:17 smithi193 ceph-mon[32782]: pgmap v5343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:17 smithi196 ceph-mon[32572]: pgmap v5343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:17 smithi110 ceph-mon[28069]: pgmap v5343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:19 smithi193 ceph-mon[32782]: pgmap v5344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:19 smithi196 ceph-mon[32572]: pgmap v5344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:19 smithi110 ceph-mon[28069]: pgmap v5344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:21 smithi193 ceph-mon[32782]: pgmap v5345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:20:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:21 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9136.953107 secs 2024-04-26T14:20:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:21 smithi196 ceph-mon[32572]: pgmap v5345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:20:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:21 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9136.953107 secs 2024-04-26T14:20:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:21 smithi110 ceph-mon[28069]: pgmap v5345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:20:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:21 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9136.953107 secs 2024-04-26T14:20:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:20:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:20:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:22 smithi193 ceph-mon[32782]: pgmap v5346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:20:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:22 smithi193 ceph-mon[32782]: pgmap v5347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:20:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:20:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:20:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:20:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:22 smithi196 ceph-mon[32572]: pgmap v5346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:20:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:22 smithi196 ceph-mon[32572]: pgmap v5347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:20:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:20:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:20:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:20:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:22 smithi110 ceph-mon[28069]: pgmap v5346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:20:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:22 smithi110 ceph-mon[28069]: pgmap v5347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:20:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:20:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:25 smithi193 ceph-mon[32782]: pgmap v5348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:25 smithi196 ceph-mon[32572]: pgmap v5348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:25 smithi110 ceph-mon[28069]: pgmap v5348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:27 smithi193 ceph-mon[32782]: pgmap v5349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:27 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9141.953253 secs 2024-04-26T14:20:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:27 smithi196 ceph-mon[32572]: pgmap v5349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:27 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9141.953253 secs 2024-04-26T14:20:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:27 smithi110 ceph-mon[28069]: pgmap v5349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:27 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9141.953253 secs 2024-04-26T14:20:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:29 smithi193 ceph-mon[32782]: pgmap v5350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:29 smithi196 ceph-mon[32572]: pgmap v5350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:29 smithi110 ceph-mon[28069]: pgmap v5350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:31 smithi193 ceph-mon[32782]: pgmap v5351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:31 smithi196 ceph-mon[32572]: pgmap v5351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:31 smithi110 ceph-mon[28069]: pgmap v5351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T14:20:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:32 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9146.953372 secs 2024-04-26T14:20:32.691 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:32 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9146.953372 secs 2024-04-26T14:20:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:32 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9146.953372 secs 2024-04-26T14:20:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:33 smithi193 ceph-mon[32782]: pgmap v5352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T14:20:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:33 smithi196 ceph-mon[32572]: pgmap v5352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T14:20:33.795 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:33 smithi110 ceph-mon[28069]: pgmap v5352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T14:20:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:35 smithi193 ceph-mon[32782]: pgmap v5353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:35 smithi196 ceph-mon[32572]: pgmap v5353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:35 smithi110 ceph-mon[28069]: pgmap v5353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:37 smithi193 ceph-mon[32782]: pgmap v5354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:37 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9151.953521 secs 2024-04-26T14:20:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:37 smithi196 ceph-mon[32572]: pgmap v5354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:37 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9151.953521 secs 2024-04-26T14:20:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:37 smithi110 ceph-mon[28069]: pgmap v5354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:37 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9151.953521 secs 2024-04-26T14:20:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:39 smithi193 ceph-mon[32782]: pgmap v5355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:39 smithi196 ceph-mon[32572]: pgmap v5355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:39 smithi110 ceph-mon[28069]: pgmap v5355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:41 smithi193 ceph-mon[32782]: pgmap v5356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:41 smithi196 ceph-mon[32572]: pgmap v5356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:41 smithi110 ceph-mon[28069]: pgmap v5356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:42 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9156.953648 secs 2024-04-26T14:20:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:42 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9156.953648 secs 2024-04-26T14:20:42.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:42 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9156.953648 secs 2024-04-26T14:20:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:43 smithi193 ceph-mon[32782]: pgmap v5357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:43 smithi196 ceph-mon[32572]: pgmap v5357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:43 smithi110 ceph-mon[28069]: pgmap v5357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:45 smithi193 ceph-mon[32782]: pgmap v5358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:45 smithi196 ceph-mon[32572]: pgmap v5358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:45 smithi110 ceph-mon[28069]: pgmap v5358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:47 smithi193 ceph-mon[32782]: pgmap v5359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:47 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9161.953734 secs 2024-04-26T14:20:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:47 smithi196 ceph-mon[32572]: pgmap v5359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:47 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9161.953734 secs 2024-04-26T14:20:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:47 smithi110 ceph-mon[28069]: pgmap v5359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:47 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9161.953734 secs 2024-04-26T14:20:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:49 smithi196 ceph-mon[32572]: pgmap v5360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:49 smithi110 ceph-mon[28069]: pgmap v5360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:49 smithi193 ceph-mon[32782]: pgmap v5360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:51 smithi196 ceph-mon[32572]: pgmap v5361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:51 smithi110 ceph-mon[28069]: pgmap v5361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:51 smithi193 ceph-mon[32782]: pgmap v5361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:52.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:52 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9166.953865 secs 2024-04-26T14:20:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:52 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9166.953865 secs 2024-04-26T14:20:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:52 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9166.953865 secs 2024-04-26T14:20:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:53 smithi196 ceph-mon[32572]: pgmap v5362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:53 smithi110 ceph-mon[28069]: pgmap v5362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:53 smithi193 ceph-mon[32782]: pgmap v5362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:55 smithi196 ceph-mon[32572]: pgmap v5363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:55 smithi110 ceph-mon[28069]: pgmap v5363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:55 smithi193 ceph-mon[32782]: pgmap v5363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:57 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9171.953974 secs 2024-04-26T14:20:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:57 smithi196 ceph-mon[32572]: pgmap v5364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:57 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9171.953974 secs 2024-04-26T14:20:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:57 smithi110 ceph-mon[28069]: pgmap v5364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:57 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9171.953974 secs 2024-04-26T14:20:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:57 smithi193 ceph-mon[32782]: pgmap v5364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:20:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:20:59 smithi196 ceph-mon[32572]: pgmap v5365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:20:59 smithi110 ceph-mon[28069]: pgmap v5365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:20:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:20:59 smithi193 ceph-mon[32782]: pgmap v5365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:01 smithi196 ceph-mon[32572]: pgmap v5366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:01 smithi110 ceph-mon[28069]: pgmap v5366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:01 smithi193 ceph-mon[32782]: pgmap v5366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:02.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:02 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9176.954097 secs 2024-04-26T14:21:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:02 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9176.954097 secs 2024-04-26T14:21:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:02 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9176.954097 secs 2024-04-26T14:21:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:03 smithi196 ceph-mon[32572]: pgmap v5367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:03 smithi110 ceph-mon[28069]: pgmap v5367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:03 smithi193 ceph-mon[32782]: pgmap v5367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:05 smithi196 ceph-mon[32572]: pgmap v5368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:05 smithi110 ceph-mon[28069]: pgmap v5368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:05 smithi193 ceph-mon[32782]: pgmap v5368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:07 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9181.954172 secs 2024-04-26T14:21:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:07 smithi196 ceph-mon[32572]: pgmap v5369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:07 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9181.954172 secs 2024-04-26T14:21:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:07 smithi110 ceph-mon[28069]: pgmap v5369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:07 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9181.954172 secs 2024-04-26T14:21:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:07 smithi193 ceph-mon[32782]: pgmap v5369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:09 smithi196 ceph-mon[32572]: pgmap v5370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:09 smithi110 ceph-mon[28069]: pgmap v5370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:09 smithi193 ceph-mon[32782]: pgmap v5370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:11 smithi196 ceph-mon[32572]: pgmap v5371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:11 smithi110 ceph-mon[28069]: pgmap v5371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:11 smithi193 ceph-mon[32782]: pgmap v5371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:12 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9186.954336 secs 2024-04-26T14:21:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:12 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9186.954336 secs 2024-04-26T14:21:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:12 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9186.954336 secs 2024-04-26T14:21:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:13 smithi196 ceph-mon[32572]: pgmap v5372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:13.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:13 smithi193 ceph-mon[32782]: pgmap v5372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:13 smithi110 ceph-mon[28069]: pgmap v5372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:15 smithi196 ceph-mon[32572]: pgmap v5373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:15 smithi110 ceph-mon[28069]: pgmap v5373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:15 smithi193 ceph-mon[32782]: pgmap v5373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:17 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9191.954435 secs 2024-04-26T14:21:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:17 smithi196 ceph-mon[32572]: pgmap v5374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:17 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9191.954435 secs 2024-04-26T14:21:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:17 smithi110 ceph-mon[28069]: pgmap v5374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:21:17.856+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:21:17.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:21:17.856+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006630 con 0x7f261c104b50 2024-04-26T14:21:17.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:21:17.856+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 74 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006630 con 0x55db1be4fdd0 2024-04-26T14:21:17.856 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:21:17.856+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 74 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:21:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:17 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9191.954435 secs 2024-04-26T14:21:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:17 smithi193 ceph-mon[32782]: pgmap v5374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:19 smithi196 ceph-mon[32572]: pgmap v5375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:19 smithi110 ceph-mon[28069]: pgmap v5375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:19 smithi193 ceph-mon[32782]: pgmap v5375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:21 smithi196 ceph-mon[32572]: pgmap v5376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:21 smithi110 ceph-mon[28069]: pgmap v5376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:21 smithi193 ceph-mon[32782]: pgmap v5376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:22 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9196.954547 secs 2024-04-26T14:21:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:22 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9196.954547 secs 2024-04-26T14:21:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:22 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9196.954547 secs 2024-04-26T14:21:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:23 smithi196 ceph-mon[32572]: pgmap v5377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:21:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:23 smithi110 ceph-mon[28069]: pgmap v5377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:21:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:23 smithi193 ceph-mon[32782]: pgmap v5377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:21:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:21:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:21:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:21:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:21:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:21:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:21:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:21:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:21:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:21:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:25 smithi110 ceph-mon[28069]: pgmap v5378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:21:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:25 smithi110 ceph-mon[28069]: pgmap v5379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:25 smithi193 ceph-mon[32782]: pgmap v5378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:21:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:25 smithi193 ceph-mon[32782]: pgmap v5379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:25 smithi196 ceph-mon[32572]: pgmap v5378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:21:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:25 smithi196 ceph-mon[32572]: pgmap v5379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:27 smithi110 ceph-mon[28069]: pgmap v5380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:27 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9201.954599 secs 2024-04-26T14:21:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:27 smithi193 ceph-mon[32782]: pgmap v5380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:27 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9201.954599 secs 2024-04-26T14:21:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:27 smithi196 ceph-mon[32572]: pgmap v5380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:27 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9201.954599 secs 2024-04-26T14:21:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:29 smithi110 ceph-mon[28069]: pgmap v5381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:29 smithi193 ceph-mon[32782]: pgmap v5381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:29 smithi196 ceph-mon[32572]: pgmap v5381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:31 smithi110 ceph-mon[28069]: pgmap v5382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:31 smithi193 ceph-mon[32782]: pgmap v5382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:31 smithi196 ceph-mon[32572]: pgmap v5382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:32 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9206.954695 secs 2024-04-26T14:21:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:32 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9206.954695 secs 2024-04-26T14:21:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:32 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9206.954695 secs 2024-04-26T14:21:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:33 smithi110 ceph-mon[28069]: pgmap v5383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:33 smithi193 ceph-mon[32782]: pgmap v5383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:33 smithi196 ceph-mon[32572]: pgmap v5383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:21:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:34 smithi193 ceph-mon[32782]: pgmap v5384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:21:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:34 smithi196 ceph-mon[32572]: pgmap v5384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:21:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:34 smithi110 ceph-mon[28069]: pgmap v5384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:21:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:36 smithi193 ceph-mon[32782]: pgmap v5385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:36 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9211.954815 secs 2024-04-26T14:21:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:36 smithi196 ceph-mon[32572]: pgmap v5385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:36 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9211.954815 secs 2024-04-26T14:21:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:36 smithi110 ceph-mon[28069]: pgmap v5385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:36 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9211.954815 secs 2024-04-26T14:21:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:38 smithi193 ceph-mon[32782]: pgmap v5386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:38 smithi196 ceph-mon[32572]: pgmap v5386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:38 smithi110 ceph-mon[28069]: pgmap v5386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:40 smithi196 ceph-mon[32572]: pgmap v5387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:41.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:40 smithi110 ceph-mon[28069]: pgmap v5387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:40 smithi193 ceph-mon[32782]: pgmap v5387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:41 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9216.954932 secs 2024-04-26T14:21:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:41 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9216.954932 secs 2024-04-26T14:21:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:41 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9216.954932 secs 2024-04-26T14:21:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:42 smithi196 ceph-mon[32572]: pgmap v5388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:43.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:42 smithi193 ceph-mon[32782]: pgmap v5388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:42 smithi110 ceph-mon[28069]: pgmap v5388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:44 smithi196 ceph-mon[32572]: pgmap v5389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:44 smithi110 ceph-mon[28069]: pgmap v5389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:44 smithi193 ceph-mon[32782]: pgmap v5389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:46 smithi196 ceph-mon[32572]: pgmap v5390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:46 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9221.955049 secs 2024-04-26T14:21:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:46 smithi110 ceph-mon[28069]: pgmap v5390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:46 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9221.955049 secs 2024-04-26T14:21:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:46 smithi193 ceph-mon[32782]: pgmap v5390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:46 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9221.955049 secs 2024-04-26T14:21:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:48 smithi196 ceph-mon[32572]: pgmap v5391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:48 smithi110 ceph-mon[28069]: pgmap v5391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:48 smithi193 ceph-mon[32782]: pgmap v5391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:50 smithi196 ceph-mon[32572]: pgmap v5392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:50 smithi110 ceph-mon[28069]: pgmap v5392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:50 smithi193 ceph-mon[32782]: pgmap v5392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:51 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9226.955169 secs 2024-04-26T14:21:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:51 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9226.955169 secs 2024-04-26T14:21:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:51 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9226.955169 secs 2024-04-26T14:21:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:52 smithi196 ceph-mon[32572]: pgmap v5393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:52 smithi110 ceph-mon[28069]: pgmap v5393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:52 smithi193 ceph-mon[32782]: pgmap v5393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:54 smithi196 ceph-mon[32572]: pgmap v5394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:54 smithi110 ceph-mon[28069]: pgmap v5394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:54 smithi193 ceph-mon[32782]: pgmap v5394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:56 smithi196 ceph-mon[32572]: pgmap v5395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:56 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9231.955281 secs 2024-04-26T14:21:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:56 smithi110 ceph-mon[28069]: pgmap v5395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:56 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9231.955281 secs 2024-04-26T14:21:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:56 smithi193 ceph-mon[32782]: pgmap v5395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:21:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:56 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9231.955281 secs 2024-04-26T14:21:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:21:58 smithi196 ceph-mon[32572]: pgmap v5396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:21:58 smithi110 ceph-mon[28069]: pgmap v5396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:21:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:21:58 smithi193 ceph-mon[32782]: pgmap v5396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:00 smithi196 ceph-mon[32572]: pgmap v5397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:00 smithi110 ceph-mon[28069]: pgmap v5397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:00 smithi193 ceph-mon[32782]: pgmap v5397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:01 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 9236.955406 secs 2024-04-26T14:22:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:01 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 9236.955406 secs 2024-04-26T14:22:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:01 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 9236.955406 secs 2024-04-26T14:22:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:03 smithi193 ceph-mon[32782]: pgmap v5398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:03 smithi196 ceph-mon[32572]: pgmap v5398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:03 smithi110 ceph-mon[28069]: pgmap v5398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:05 smithi193 ceph-mon[32782]: pgmap v5399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:05 smithi196 ceph-mon[32572]: pgmap v5399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:05 smithi110 ceph-mon[28069]: pgmap v5399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:07 smithi193 ceph-mon[32782]: pgmap v5400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:07 smithi193 ceph-mon[32782]: 10 slow requests, 1 included below; oldest blocked for > 9241.955523 secs 2024-04-26T14:22:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:07 smithi193 ceph-mon[32782]: slow request 181.674045 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:22:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:07 smithi196 ceph-mon[32572]: pgmap v5400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:07 smithi196 ceph-mon[32572]: 10 slow requests, 1 included below; oldest blocked for > 9241.955523 secs 2024-04-26T14:22:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:07 smithi196 ceph-mon[32572]: slow request 181.674045 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:22:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:07 smithi110 ceph-mon[28069]: pgmap v5400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:07 smithi110 ceph-mon[28069]: 10 slow requests, 1 included below; oldest blocked for > 9241.955523 secs 2024-04-26T14:22:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:07 smithi110 ceph-mon[28069]: slow request 181.674045 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:22:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:09 smithi193 ceph-mon[32782]: pgmap v5401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:22:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:09 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:22:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:09 smithi196 ceph-mon[32572]: pgmap v5401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:22:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:09 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:22:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:09 smithi110 ceph-mon[28069]: pgmap v5401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:22:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:09 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:22:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:11 smithi193 ceph-mon[32782]: pgmap v5402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:11 smithi196 ceph-mon[32572]: pgmap v5402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:11 smithi110 ceph-mon[28069]: pgmap v5402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:12 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9246.955642 secs 2024-04-26T14:22:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:12 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9246.955642 secs 2024-04-26T14:22:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:12 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9246.955642 secs 2024-04-26T14:22:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:13 smithi193 ceph-mon[32782]: pgmap v5403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:13 smithi196 ceph-mon[32572]: pgmap v5403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:13 smithi110 ceph-mon[28069]: pgmap v5403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:15 smithi193 ceph-mon[32782]: pgmap v5404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:15 smithi196 ceph-mon[32572]: pgmap v5404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:15 smithi110 ceph-mon[28069]: pgmap v5404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:17 smithi193 ceph-mon[32782]: pgmap v5405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:17 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9251.955719 secs 2024-04-26T14:22:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:17 smithi196 ceph-mon[32572]: pgmap v5405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:17 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9251.955719 secs 2024-04-26T14:22:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:17 smithi110 ceph-mon[28069]: pgmap v5405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:17 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9251.955719 secs 2024-04-26T14:22:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:19 smithi196 ceph-mon[32572]: pgmap v5406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:19 smithi110 ceph-mon[28069]: pgmap v5406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:19 smithi193 ceph-mon[32782]: pgmap v5406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:21 smithi196 ceph-mon[32572]: pgmap v5407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:21 smithi110 ceph-mon[28069]: pgmap v5407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:21 smithi193 ceph-mon[32782]: pgmap v5407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:22.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:22 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9256.955837 secs 2024-04-26T14:22:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:22 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9256.955837 secs 2024-04-26T14:22:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:22 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9256.955837 secs 2024-04-26T14:22:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:23 smithi196 ceph-mon[32572]: pgmap v5408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:23 smithi110 ceph-mon[28069]: pgmap v5408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:23 smithi193 ceph-mon[32782]: pgmap v5408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:22:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:22:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:22:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:25 smithi196 ceph-mon[32572]: pgmap v5409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:22:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:22:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:22:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:25 smithi110 ceph-mon[28069]: pgmap v5409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:22:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:22:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:22:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:25 smithi193 ceph-mon[32782]: pgmap v5409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:22:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:22:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:22:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:26 smithi196 ceph-mon[32572]: pgmap v5410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T14:22:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:26 smithi196 ceph-mon[32572]: pgmap v5411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:26 smithi110 ceph-mon[28069]: pgmap v5410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T14:22:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:26 smithi110 ceph-mon[28069]: pgmap v5411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:26 smithi193 ceph-mon[32782]: pgmap v5410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T14:22:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:26 smithi193 ceph-mon[32782]: pgmap v5411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:27 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9261.955955 secs 2024-04-26T14:22:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:27 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9261.955955 secs 2024-04-26T14:22:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:27 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9261.955955 secs 2024-04-26T14:22:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:28 smithi196 ceph-mon[32572]: pgmap v5412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T14:22:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:28 smithi110 ceph-mon[28069]: pgmap v5412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T14:22:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:28 smithi193 ceph-mon[32782]: pgmap v5412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T14:22:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:30 smithi196 ceph-mon[32572]: pgmap v5413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:30 smithi110 ceph-mon[28069]: pgmap v5413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:30 smithi193 ceph-mon[32782]: pgmap v5413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:32 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9266.956075 secs 2024-04-26T14:22:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:32 smithi196 ceph-mon[32572]: pgmap v5414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:32 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9266.956075 secs 2024-04-26T14:22:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:32 smithi110 ceph-mon[28069]: pgmap v5414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:32 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9266.956075 secs 2024-04-26T14:22:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:32 smithi193 ceph-mon[32782]: pgmap v5414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:34 smithi196 ceph-mon[32572]: pgmap v5415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:34 smithi110 ceph-mon[28069]: pgmap v5415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:34 smithi193 ceph-mon[32782]: pgmap v5415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:22:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:36 smithi196 ceph-mon[32572]: pgmap v5416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:22:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:36 smithi110 ceph-mon[28069]: pgmap v5416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:22:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:36 smithi193 ceph-mon[32782]: pgmap v5416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:22:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:37 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9271.956202 secs 2024-04-26T14:22:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:37 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9271.956202 secs 2024-04-26T14:22:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:37 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9271.956202 secs 2024-04-26T14:22:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:38 smithi196 ceph-mon[32572]: pgmap v5417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:38 smithi110 ceph-mon[28069]: pgmap v5417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:38 smithi193 ceph-mon[32782]: pgmap v5417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:40 smithi196 ceph-mon[32572]: pgmap v5418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:40 smithi110 ceph-mon[28069]: pgmap v5418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:40 smithi193 ceph-mon[32782]: pgmap v5418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:42 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9276.956320 secs 2024-04-26T14:22:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:42 smithi196 ceph-mon[32572]: pgmap v5419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:42 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9276.956320 secs 2024-04-26T14:22:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:42 smithi110 ceph-mon[28069]: pgmap v5419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:42 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9276.956320 secs 2024-04-26T14:22:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:42 smithi193 ceph-mon[32782]: pgmap v5419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:44 smithi196 ceph-mon[32572]: pgmap v5420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:44 smithi110 ceph-mon[28069]: pgmap v5420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:44 smithi193 ceph-mon[32782]: pgmap v5420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:46 smithi196 ceph-mon[32572]: pgmap v5421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:46 smithi110 ceph-mon[28069]: pgmap v5421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:46 smithi193 ceph-mon[32782]: pgmap v5421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:47 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9281.956460 secs 2024-04-26T14:22:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:47 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9281.956460 secs 2024-04-26T14:22:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:47 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9281.956460 secs 2024-04-26T14:22:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:48 smithi196 ceph-mon[32572]: pgmap v5422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:48 smithi110 ceph-mon[28069]: pgmap v5422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:48 smithi193 ceph-mon[32782]: pgmap v5422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:50 smithi196 ceph-mon[32572]: pgmap v5423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:50 smithi110 ceph-mon[28069]: pgmap v5423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:50 smithi193 ceph-mon[32782]: pgmap v5423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:52 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9286.956601 secs 2024-04-26T14:22:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:52 smithi196 ceph-mon[32572]: pgmap v5424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:52 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9286.956601 secs 2024-04-26T14:22:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:52 smithi110 ceph-mon[28069]: pgmap v5424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:52 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9286.956601 secs 2024-04-26T14:22:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:52 smithi193 ceph-mon[32782]: pgmap v5424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:54 smithi110 ceph-mon[28069]: pgmap v5425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:54 smithi193 ceph-mon[32782]: pgmap v5425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:54 smithi196 ceph-mon[32572]: pgmap v5425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:56 smithi110 ceph-mon[28069]: pgmap v5426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:56 smithi193 ceph-mon[32782]: pgmap v5426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:56 smithi196 ceph-mon[32572]: pgmap v5426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:22:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:57 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9291.956719 secs 2024-04-26T14:22:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:57 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9291.956719 secs 2024-04-26T14:22:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:57 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9291.956719 secs 2024-04-26T14:22:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:22:58 smithi110 ceph-mon[28069]: pgmap v5427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:22:58 smithi193 ceph-mon[32782]: pgmap v5427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:22:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:22:58 smithi196 ceph-mon[32572]: pgmap v5427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:00 smithi110 ceph-mon[28069]: pgmap v5428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:00 smithi193 ceph-mon[32782]: pgmap v5428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:00 smithi196 ceph-mon[32572]: pgmap v5428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:02 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9296.956839 secs 2024-04-26T14:23:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:02 smithi110 ceph-mon[28069]: pgmap v5429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:02 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9296.956839 secs 2024-04-26T14:23:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:02 smithi193 ceph-mon[32782]: pgmap v5429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:02 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9296.956839 secs 2024-04-26T14:23:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:02 smithi196 ceph-mon[32572]: pgmap v5429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:04 smithi110 ceph-mon[28069]: pgmap v5430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:04 smithi193 ceph-mon[32782]: pgmap v5430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:04 smithi196 ceph-mon[32572]: pgmap v5430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:06 smithi193 ceph-mon[32782]: pgmap v5431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:06 smithi196 ceph-mon[32572]: pgmap v5431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:06 smithi110 ceph-mon[28069]: pgmap v5431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:07 smithi193 ceph-mon[32782]: 10 slow requests, 1 included below; oldest blocked for > 9301.956927 secs 2024-04-26T14:23:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:07 smithi193 ceph-mon[32782]: slow request 1442.254450 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:23:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:07 smithi196 ceph-mon[32572]: 10 slow requests, 1 included below; oldest blocked for > 9301.956927 secs 2024-04-26T14:23:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:07 smithi196 ceph-mon[32572]: slow request 1442.254450 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:23:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:07 smithi110 ceph-mon[28069]: 10 slow requests, 1 included below; oldest blocked for > 9301.956927 secs 2024-04-26T14:23:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:07 smithi110 ceph-mon[28069]: slow request 1442.254450 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:23:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:08 smithi193 ceph-mon[32782]: pgmap v5432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:08 smithi196 ceph-mon[32572]: pgmap v5432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:08 smithi110 ceph-mon[28069]: pgmap v5432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:09 smithi193 ceph-mon[32782]: pgmap v5433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:23:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:09 smithi196 ceph-mon[32572]: pgmap v5433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:23:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:09 smithi110 ceph-mon[28069]: pgmap v5433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:23:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:12 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9306.957081 secs 2024-04-26T14:23:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:12 smithi196 ceph-mon[32572]: pgmap v5434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:12 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9306.957081 secs 2024-04-26T14:23:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:12 smithi110 ceph-mon[28069]: pgmap v5434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:12 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9306.957081 secs 2024-04-26T14:23:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:12 smithi193 ceph-mon[32782]: pgmap v5434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:14.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:14 smithi193 ceph-mon[32782]: pgmap v5435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:14 smithi196 ceph-mon[32572]: pgmap v5435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:14 smithi110 ceph-mon[28069]: pgmap v5435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:16 smithi196 ceph-mon[32572]: pgmap v5436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:16 smithi110 ceph-mon[28069]: pgmap v5436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:16 smithi193 ceph-mon[32782]: pgmap v5436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:17 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9311.957197 secs 2024-04-26T14:23:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:17 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9311.957197 secs 2024-04-26T14:23:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:17 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9311.957197 secs 2024-04-26T14:23:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:18 smithi196 ceph-mon[32572]: pgmap v5437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:18 smithi110 ceph-mon[28069]: pgmap v5437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:18 smithi193 ceph-mon[32782]: pgmap v5437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:20 smithi196 ceph-mon[32572]: pgmap v5438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:23:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:20 smithi110 ceph-mon[28069]: pgmap v5438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:23:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:20 smithi193 ceph-mon[32782]: pgmap v5438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:23:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:22 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9316.957326 secs 2024-04-26T14:23:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:22 smithi196 ceph-mon[32572]: pgmap v5439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:22 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9316.957326 secs 2024-04-26T14:23:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:22 smithi110 ceph-mon[28069]: pgmap v5439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:22 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9316.957326 secs 2024-04-26T14:23:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:22 smithi193 ceph-mon[32782]: pgmap v5439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:24 smithi196 ceph-mon[32572]: pgmap v5440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:24 smithi110 ceph-mon[28069]: pgmap v5440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:24 smithi193 ceph-mon[32782]: pgmap v5440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:26 smithi196 ceph-mon[32572]: pgmap v5441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:23:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:26 smithi110 ceph-mon[28069]: pgmap v5441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:23:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:26 smithi193 ceph-mon[32782]: pgmap v5441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:23:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:27 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9321.957454 secs 2024-04-26T14:23:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:23:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:23:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:23:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:27 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9321.957454 secs 2024-04-26T14:23:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:23:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:23:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:23:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:27 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9321.957454 secs 2024-04-26T14:23:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:23:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:23:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:23:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:28 smithi196 ceph-mon[32572]: pgmap v5442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:23:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:28 smithi196 ceph-mon[32572]: pgmap v5443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:23:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:28 smithi110 ceph-mon[28069]: pgmap v5442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:23:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:28 smithi110 ceph-mon[28069]: pgmap v5443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:23:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:28 smithi193 ceph-mon[32782]: pgmap v5442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:23:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:28 smithi193 ceph-mon[32782]: pgmap v5443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:23:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:30 smithi196 ceph-mon[32572]: pgmap v5444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:30 smithi110 ceph-mon[28069]: pgmap v5444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:30 smithi193 ceph-mon[32782]: pgmap v5444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:32.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:32 smithi196 ceph-mon[32572]: pgmap v5445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:32.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:32 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9326.957594 secs 2024-04-26T14:23:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:32 smithi110 ceph-mon[28069]: pgmap v5445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:32 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9326.957594 secs 2024-04-26T14:23:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:32 smithi193 ceph-mon[32782]: pgmap v5445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:32 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9326.957594 secs 2024-04-26T14:23:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:34 smithi196 ceph-mon[32572]: pgmap v5446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:34 smithi110 ceph-mon[28069]: pgmap v5446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:34 smithi193 ceph-mon[32782]: pgmap v5446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:36 smithi196 ceph-mon[32572]: pgmap v5447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:36 smithi110 ceph-mon[28069]: pgmap v5447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:36 smithi193 ceph-mon[32782]: pgmap v5447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:23:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:37 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9331.957716 secs 2024-04-26T14:23:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:37 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9331.957716 secs 2024-04-26T14:23:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:37 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9331.957716 secs 2024-04-26T14:23:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:38 smithi196 ceph-mon[32572]: pgmap v5448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:23:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:38 smithi110 ceph-mon[28069]: pgmap v5448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:23:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:38 smithi193 ceph-mon[32782]: pgmap v5448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:23:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:40 smithi196 ceph-mon[32572]: pgmap v5449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:40 smithi110 ceph-mon[28069]: pgmap v5449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:40 smithi193 ceph-mon[32782]: pgmap v5449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:42 smithi196 ceph-mon[32572]: pgmap v5450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:42 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9336.957798 secs 2024-04-26T14:23:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:42 smithi110 ceph-mon[28069]: pgmap v5450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:42 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9336.957798 secs 2024-04-26T14:23:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:42 smithi193 ceph-mon[32782]: pgmap v5450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:42 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9336.957798 secs 2024-04-26T14:23:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:44 smithi110 ceph-mon[28069]: pgmap v5451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:44 smithi193 ceph-mon[32782]: pgmap v5451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:44 smithi196 ceph-mon[32572]: pgmap v5451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:46 smithi110 ceph-mon[28069]: pgmap v5452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:46 smithi193 ceph-mon[32782]: pgmap v5452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:46 smithi196 ceph-mon[32572]: pgmap v5452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:47 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9341.957922 secs 2024-04-26T14:23:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:47 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9341.957922 secs 2024-04-26T14:23:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:47 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9341.957922 secs 2024-04-26T14:23:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:48 smithi110 ceph-mon[28069]: pgmap v5453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:48 smithi193 ceph-mon[32782]: pgmap v5453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:48 smithi196 ceph-mon[32572]: pgmap v5453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:50 smithi110 ceph-mon[28069]: pgmap v5454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:50 smithi193 ceph-mon[32782]: pgmap v5454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:50 smithi196 ceph-mon[32572]: pgmap v5454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:52 smithi110 ceph-mon[28069]: pgmap v5455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:52 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9346.958039 secs 2024-04-26T14:23:52.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:52 smithi196 ceph-mon[32572]: pgmap v5455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:52.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:52 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9346.958039 secs 2024-04-26T14:23:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:52 smithi193 ceph-mon[32782]: pgmap v5455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:52 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9346.958039 secs 2024-04-26T14:23:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:54 smithi193 ceph-mon[32782]: pgmap v5456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:54 smithi196 ceph-mon[32572]: pgmap v5456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:54 smithi110 ceph-mon[28069]: pgmap v5456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:23:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:56 smithi193 ceph-mon[32782]: pgmap v5457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:56 smithi196 ceph-mon[32572]: pgmap v5457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:56 smithi110 ceph-mon[28069]: pgmap v5457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:57 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9351.958178 secs 2024-04-26T14:23:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:57 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9351.958178 secs 2024-04-26T14:23:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:57 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9351.958178 secs 2024-04-26T14:23:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:58 smithi193 ceph-mon[32782]: pgmap v5458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:58 smithi196 ceph-mon[32572]: pgmap v5458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:58 smithi110 ceph-mon[28069]: pgmap v5458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:23:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:23:59 smithi193 ceph-mon[32782]: pgmap v5459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:23:59 smithi196 ceph-mon[32572]: pgmap v5459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:23:59 smithi110 ceph-mon[28069]: pgmap v5459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:01 smithi196 ceph-mon[32572]: pgmap v5460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:01 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9356.958267 secs 2024-04-26T14:24:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:01 smithi110 ceph-mon[28069]: pgmap v5460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:01 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9356.958267 secs 2024-04-26T14:24:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:01 smithi193 ceph-mon[32782]: pgmap v5460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:01 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9356.958267 secs 2024-04-26T14:24:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:03 smithi196 ceph-mon[32572]: pgmap v5461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:03 smithi110 ceph-mon[28069]: pgmap v5461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:03 smithi193 ceph-mon[32782]: pgmap v5461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:24:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:24:04.796+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:24:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:24:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:24:04.796+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:24:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:24:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:24:04.796+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:24:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:24:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:24:04.796+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:24:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:24:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:24:04.796+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:24:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:05 smithi196 ceph-mon[32572]: pgmap v5462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:05 smithi110 ceph-mon[28069]: pgmap v5462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:05 smithi193 ceph-mon[32782]: pgmap v5462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:06 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9361.958406 secs 2024-04-26T14:24:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:06 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9361.958406 secs 2024-04-26T14:24:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:06 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9361.958406 secs 2024-04-26T14:24:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:07 smithi196 ceph-mon[32572]: pgmap v5463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:07 smithi110 ceph-mon[28069]: pgmap v5463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:07 smithi193 ceph-mon[32782]: pgmap v5463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:09 smithi196 ceph-mon[32572]: pgmap v5464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:24:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:09 smithi110 ceph-mon[28069]: pgmap v5464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:24:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:09 smithi193 ceph-mon[32782]: pgmap v5464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:24:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:11 smithi196 ceph-mon[32572]: pgmap v5465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:24:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:11 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9366.958526 secs 2024-04-26T14:24:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:11 smithi110 ceph-mon[28069]: pgmap v5465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:24:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:11 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9366.958526 secs 2024-04-26T14:24:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:11 smithi193 ceph-mon[32782]: pgmap v5465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:24:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:11 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9366.958526 secs 2024-04-26T14:24:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:13 smithi196 ceph-mon[32572]: pgmap v5466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:24:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:13 smithi110 ceph-mon[28069]: pgmap v5466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:24:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:13 smithi193 ceph-mon[32782]: pgmap v5466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:24:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:16 smithi196 ceph-mon[32572]: pgmap v5467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:24:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:16 smithi110 ceph-mon[28069]: pgmap v5467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:24:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:16 smithi193 ceph-mon[32782]: pgmap v5467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:24:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:17 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9371.958651 secs 2024-04-26T14:24:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:17 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9371.958651 secs 2024-04-26T14:24:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:17 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9371.958651 secs 2024-04-26T14:24:17.884 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:24:17.884+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:24:17.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:24:17.884+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006630 con 0x7f261c104b50 2024-04-26T14:24:17.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:24:17.884+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 75 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006630 con 0x55db1be4fdd0 2024-04-26T14:24:17.885 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:24:17.884+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 75 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:24:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:18 smithi110 ceph-mon[28069]: pgmap v5468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:24:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:18 smithi193 ceph-mon[32782]: pgmap v5468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:24:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:18 smithi196 ceph-mon[32572]: pgmap v5468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:24:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:20 smithi110 ceph-mon[28069]: pgmap v5469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:24:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:20 smithi193 ceph-mon[32782]: pgmap v5469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:24:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:20 smithi196 ceph-mon[32572]: pgmap v5469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:24:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:22 smithi110 ceph-mon[28069]: pgmap v5470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:22.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:22 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9376.958744 secs 2024-04-26T14:24:22.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:22 smithi196 ceph-mon[32572]: pgmap v5470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:22.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:22 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9376.958744 secs 2024-04-26T14:24:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:22 smithi193 ceph-mon[32782]: pgmap v5470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:22 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9376.958744 secs 2024-04-26T14:24:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:24 smithi110 ceph-mon[28069]: pgmap v5471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:24 smithi193 ceph-mon[32782]: pgmap v5471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:24 smithi196 ceph-mon[32572]: pgmap v5471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:26 smithi110 ceph-mon[28069]: pgmap v5472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:26 smithi193 ceph-mon[32782]: pgmap v5472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:26 smithi196 ceph-mon[32572]: pgmap v5472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:27 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9381.958897 secs 2024-04-26T14:24:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:27 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9381.958897 secs 2024-04-26T14:24:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:27 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9381.958897 secs 2024-04-26T14:24:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:28 smithi193 ceph-mon[32782]: pgmap v5473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:24:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:28 smithi196 ceph-mon[32572]: pgmap v5473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:24:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:28 smithi110 ceph-mon[28069]: pgmap v5473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:24:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:24:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:24:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:29 smithi193 ceph-mon[32782]: pgmap v5474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:24:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:29 smithi193 ceph-mon[32782]: pgmap v5475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:24:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:24:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:24:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:29 smithi196 ceph-mon[32572]: pgmap v5474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:24:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:29 smithi196 ceph-mon[32572]: pgmap v5475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:24:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:24:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:24:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:29 smithi110 ceph-mon[28069]: pgmap v5474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:24:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:29 smithi110 ceph-mon[28069]: pgmap v5475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:24:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:31 smithi110 ceph-mon[28069]: pgmap v5476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:31 smithi193 ceph-mon[32782]: pgmap v5476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:31 smithi196 ceph-mon[32572]: pgmap v5476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:32 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9386.959026 secs 2024-04-26T14:24:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:32 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9386.959026 secs 2024-04-26T14:24:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:32 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9386.959026 secs 2024-04-26T14:24:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:33 smithi193 ceph-mon[32782]: pgmap v5477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:33 smithi196 ceph-mon[32572]: pgmap v5477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:33 smithi110 ceph-mon[28069]: pgmap v5477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:35 smithi193 ceph-mon[32782]: pgmap v5478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:35 smithi196 ceph-mon[32572]: pgmap v5478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:35 smithi110 ceph-mon[28069]: pgmap v5478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:37 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9391.959163 secs 2024-04-26T14:24:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:37 smithi193 ceph-mon[32782]: pgmap v5479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:37 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9391.959163 secs 2024-04-26T14:24:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:37 smithi196 ceph-mon[32572]: pgmap v5479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:37 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9391.959163 secs 2024-04-26T14:24:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:37 smithi110 ceph-mon[28069]: pgmap v5479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:24:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:39 smithi193 ceph-mon[32782]: pgmap v5480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:24:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:39 smithi196 ceph-mon[32572]: pgmap v5480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:24:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:39 smithi110 ceph-mon[28069]: pgmap v5480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:24:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:41 smithi193 ceph-mon[32782]: pgmap v5481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:41 smithi196 ceph-mon[32572]: pgmap v5481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:41 smithi110 ceph-mon[28069]: pgmap v5481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:42 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9396.959315 secs 2024-04-26T14:24:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:42 smithi193 ceph-mon[32782]: pgmap v5482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:42 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9396.959315 secs 2024-04-26T14:24:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:42 smithi196 ceph-mon[32572]: pgmap v5482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:42 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9396.959315 secs 2024-04-26T14:24:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:42 smithi110 ceph-mon[28069]: pgmap v5482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:45 smithi193 ceph-mon[32782]: pgmap v5483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:45 smithi196 ceph-mon[32572]: pgmap v5483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:45 smithi110 ceph-mon[28069]: pgmap v5483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:47 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9401.959456 secs 2024-04-26T14:24:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:47 smithi193 ceph-mon[32782]: pgmap v5484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:47 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9401.959456 secs 2024-04-26T14:24:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:47 smithi196 ceph-mon[32572]: pgmap v5484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:47 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9401.959456 secs 2024-04-26T14:24:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:47 smithi110 ceph-mon[28069]: pgmap v5484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:49 smithi193 ceph-mon[32782]: pgmap v5485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:49 smithi196 ceph-mon[32572]: pgmap v5485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:49 smithi110 ceph-mon[28069]: pgmap v5485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:51 smithi193 ceph-mon[32782]: pgmap v5486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:51 smithi196 ceph-mon[32572]: pgmap v5486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:51 smithi110 ceph-mon[28069]: pgmap v5486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:52 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9406.959601 secs 2024-04-26T14:24:52.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:52 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9406.959601 secs 2024-04-26T14:24:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:52 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9406.959601 secs 2024-04-26T14:24:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:53 smithi193 ceph-mon[32782]: pgmap v5487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:53 smithi196 ceph-mon[32572]: pgmap v5487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:53 smithi110 ceph-mon[28069]: pgmap v5487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:24:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:54 smithi193 ceph-mon[32782]: pgmap v5488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:54 smithi196 ceph-mon[32572]: pgmap v5488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:54 smithi110 ceph-mon[28069]: pgmap v5488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:57 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9411.959718 secs 2024-04-26T14:24:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:57 smithi193 ceph-mon[32782]: pgmap v5489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:57 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9411.959718 secs 2024-04-26T14:24:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:57 smithi196 ceph-mon[32572]: pgmap v5489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:57 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9411.959718 secs 2024-04-26T14:24:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:57 smithi110 ceph-mon[28069]: pgmap v5489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:24:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:24:59 smithi193 ceph-mon[32782]: pgmap v5490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:24:59 smithi196 ceph-mon[32572]: pgmap v5490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:24:59 smithi110 ceph-mon[28069]: pgmap v5490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:01 smithi193 ceph-mon[32782]: pgmap v5491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:01 smithi196 ceph-mon[32572]: pgmap v5491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:01 smithi110 ceph-mon[28069]: pgmap v5491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:02 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9416.959861 secs 2024-04-26T14:25:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:25:02.892+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006630 con 0x7f261c104b50 2024-04-26T14:25:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:25:02.892+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:25:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:25:02.893+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 76 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:25:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:25:02.893+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 76 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006630 con 0x55db1be4fdd0 2024-04-26T14:25:02.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:02 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9416.959861 secs 2024-04-26T14:25:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:02 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9416.959861 secs 2024-04-26T14:25:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:03 smithi193 ceph-mon[32782]: pgmap v5492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:25:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:03 smithi196 ceph-mon[32572]: pgmap v5492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:25:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:03 smithi110 ceph-mon[28069]: pgmap v5492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:25:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:05 smithi193 ceph-mon[32782]: pgmap v5493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:25:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:05 smithi196 ceph-mon[32572]: pgmap v5493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:25:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:05 smithi110 ceph-mon[28069]: pgmap v5493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:25:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:07 smithi193 ceph-mon[32782]: 10 slow requests, 1 included below; oldest blocked for > 9421.959988 secs 2024-04-26T14:25:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:07 smithi193 ceph-mon[32782]: slow request 361.678510 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:25:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:07 smithi193 ceph-mon[32782]: pgmap v5494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:25:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:07 smithi196 ceph-mon[32572]: 10 slow requests, 1 included below; oldest blocked for > 9421.959988 secs 2024-04-26T14:25:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:07 smithi196 ceph-mon[32572]: slow request 361.678510 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:25:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:07 smithi196 ceph-mon[32572]: pgmap v5494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:25:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:07 smithi110 ceph-mon[28069]: 10 slow requests, 1 included below; oldest blocked for > 9421.959988 secs 2024-04-26T14:25:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:07 smithi110 ceph-mon[28069]: slow request 361.678510 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:25:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:07 smithi110 ceph-mon[28069]: pgmap v5494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:25:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:08 smithi193 ceph-mon[32782]: pgmap v5495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:25:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:08 smithi196 ceph-mon[32572]: pgmap v5495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:25:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:08 smithi110 ceph-mon[28069]: pgmap v5495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:25:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:11 smithi193 ceph-mon[32782]: pgmap v5496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:25:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:11 smithi196 ceph-mon[32572]: pgmap v5496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:25:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:11 smithi110 ceph-mon[28069]: pgmap v5496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:25:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:12 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9426.960113 secs 2024-04-26T14:25:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:12 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9426.960113 secs 2024-04-26T14:25:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:12 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9426.960113 secs 2024-04-26T14:25:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:13 smithi193 ceph-mon[32782]: pgmap v5497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:25:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:13 smithi196 ceph-mon[32572]: pgmap v5497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:25:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:13 smithi110 ceph-mon[28069]: pgmap v5497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:25:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:15 smithi193 ceph-mon[32782]: pgmap v5498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:15 smithi196 ceph-mon[32572]: pgmap v5498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:15 smithi110 ceph-mon[28069]: pgmap v5498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:16 smithi193 ceph-mon[32782]: pgmap v5499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:16 smithi196 ceph-mon[32572]: pgmap v5499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:16 smithi110 ceph-mon[28069]: pgmap v5499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:17 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9431.960254 secs 2024-04-26T14:25:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:17 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9431.960254 secs 2024-04-26T14:25:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:17 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9431.960254 secs 2024-04-26T14:25:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:18 smithi193 ceph-mon[32782]: pgmap v5500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:18 smithi196 ceph-mon[32572]: pgmap v5500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:18 smithi110 ceph-mon[28069]: pgmap v5500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:21 smithi193 ceph-mon[32782]: pgmap v5501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:21 smithi196 ceph-mon[32572]: pgmap v5501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:21 smithi110 ceph-mon[28069]: pgmap v5501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:22 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9436.960394 secs 2024-04-26T14:25:22.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:22 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9436.960394 secs 2024-04-26T14:25:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:22 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9436.960394 secs 2024-04-26T14:25:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:23 smithi193 ceph-mon[32782]: pgmap v5502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:23 smithi196 ceph-mon[32572]: pgmap v5502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:23 smithi110 ceph-mon[28069]: pgmap v5502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:25 smithi193 ceph-mon[32782]: pgmap v5503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:25 smithi196 ceph-mon[32572]: pgmap v5503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:25 smithi110 ceph-mon[28069]: pgmap v5503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:26 smithi193 ceph-mon[32782]: pgmap v5504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:27.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:26 smithi196 ceph-mon[32572]: pgmap v5504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:26 smithi110 ceph-mon[28069]: pgmap v5504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:27 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9441.960490 secs 2024-04-26T14:25:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:27 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9441.960490 secs 2024-04-26T14:25:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:27 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9441.960490 secs 2024-04-26T14:25:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:28 smithi193 ceph-mon[32782]: pgmap v5505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:28 smithi196 ceph-mon[32572]: pgmap v5505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:28 smithi110 ceph-mon[28069]: pgmap v5505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:25:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:25:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:25:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:25:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:25:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:25:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:25:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:30 smithi196 ceph-mon[32572]: pgmap v5506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:25:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:30 smithi110 ceph-mon[28069]: pgmap v5506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:25:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:30 smithi193 ceph-mon[32782]: pgmap v5506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:25:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:25:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:31 smithi196 ceph-mon[32572]: pgmap v5507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T14:25:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:31 smithi196 ceph-mon[32572]: pgmap v5508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:25:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:25:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:31 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9446.960630 secs 2024-04-26T14:25:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:25:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:25:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:31 smithi110 ceph-mon[28069]: pgmap v5507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T14:25:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:31 smithi110 ceph-mon[28069]: pgmap v5508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:25:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:25:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:31 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9446.960630 secs 2024-04-26T14:25:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:25:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:25:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:31 smithi193 ceph-mon[32782]: pgmap v5507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T14:25:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:31 smithi193 ceph-mon[32782]: pgmap v5508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:25:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:25:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:31 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9446.960630 secs 2024-04-26T14:25:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:33 smithi196 ceph-mon[32572]: pgmap v5509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:33 smithi110 ceph-mon[28069]: pgmap v5509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:33 smithi193 ceph-mon[32782]: pgmap v5509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:35 smithi196 ceph-mon[32572]: pgmap v5510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:35 smithi110 ceph-mon[28069]: pgmap v5510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:35 smithi193 ceph-mon[32782]: pgmap v5510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:36 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9451.960690 secs 2024-04-26T14:25:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:36 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9451.960690 secs 2024-04-26T14:25:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:36 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9451.960690 secs 2024-04-26T14:25:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:37 smithi196 ceph-mon[32572]: pgmap v5511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:25:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:37 smithi110 ceph-mon[28069]: pgmap v5511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:25:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:37 smithi193 ceph-mon[32782]: pgmap v5511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T14:25:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:39 smithi196 ceph-mon[32572]: pgmap v5512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:39 smithi110 ceph-mon[28069]: pgmap v5512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:39 smithi193 ceph-mon[32782]: pgmap v5512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:41 smithi196 ceph-mon[32572]: pgmap v5513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:25:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:41 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9456.960813 secs 2024-04-26T14:25:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:41 smithi110 ceph-mon[28069]: pgmap v5513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:25:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:41 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9456.960813 secs 2024-04-26T14:25:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:41 smithi193 ceph-mon[32782]: pgmap v5513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:25:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:41 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9456.960813 secs 2024-04-26T14:25:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:43 smithi196 ceph-mon[32572]: pgmap v5514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:43 smithi110 ceph-mon[28069]: pgmap v5514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:43 smithi193 ceph-mon[32782]: pgmap v5514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:45 smithi196 ceph-mon[32572]: pgmap v5515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:45 smithi110 ceph-mon[28069]: pgmap v5515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:45 smithi193 ceph-mon[32782]: pgmap v5515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:47 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9461.960932 secs 2024-04-26T14:25:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:47 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9461.960932 secs 2024-04-26T14:25:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:47 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9461.960932 secs 2024-04-26T14:25:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:48 smithi110 ceph-mon[28069]: pgmap v5516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:48 smithi193 ceph-mon[32782]: pgmap v5516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:48 smithi196 ceph-mon[32572]: pgmap v5516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:50 smithi110 ceph-mon[28069]: pgmap v5517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:50 smithi193 ceph-mon[32782]: pgmap v5517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:50 smithi196 ceph-mon[32572]: pgmap v5517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:52 smithi110 ceph-mon[28069]: pgmap v5518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:52 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9466.961052 secs 2024-04-26T14:25:52.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:52 smithi196 ceph-mon[32572]: pgmap v5518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:52.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:52 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9466.961052 secs 2024-04-26T14:25:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:52 smithi193 ceph-mon[32782]: pgmap v5518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:52 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9466.961052 secs 2024-04-26T14:25:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:54 smithi110 ceph-mon[28069]: pgmap v5519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:54 smithi193 ceph-mon[32782]: pgmap v5519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:54 smithi196 ceph-mon[32572]: pgmap v5519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:25:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:56 smithi110 ceph-mon[28069]: pgmap v5520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:56 smithi193 ceph-mon[32782]: pgmap v5520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:56 smithi196 ceph-mon[32572]: pgmap v5520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:57 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9471.961170 secs 2024-04-26T14:25:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:57 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9471.961170 secs 2024-04-26T14:25:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:57 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9471.961170 secs 2024-04-26T14:25:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:25:58 smithi110 ceph-mon[28069]: pgmap v5521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:25:58 smithi193 ceph-mon[32782]: pgmap v5521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:25:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:25:58 smithi196 ceph-mon[32572]: pgmap v5521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:00.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:00 smithi193 ceph-mon[32782]: pgmap v5522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:00 smithi196 ceph-mon[32572]: pgmap v5522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:00 smithi110 ceph-mon[28069]: pgmap v5522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:02 smithi193 ceph-mon[32782]: pgmap v5523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:02 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9476.961306 secs 2024-04-26T14:26:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:02 smithi196 ceph-mon[32572]: pgmap v5523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:02 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9476.961306 secs 2024-04-26T14:26:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:02 smithi110 ceph-mon[28069]: pgmap v5523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:02 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9476.961306 secs 2024-04-26T14:26:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:04 smithi196 ceph-mon[32572]: pgmap v5524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:04 smithi110 ceph-mon[28069]: pgmap v5524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:04.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:04 smithi193 ceph-mon[32782]: pgmap v5524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:06 smithi196 ceph-mon[32572]: pgmap v5525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:06 smithi110 ceph-mon[28069]: pgmap v5525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:06 smithi193 ceph-mon[32782]: pgmap v5525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:07 smithi196 ceph-mon[32572]: 10 slow requests, 1 included below; oldest blocked for > 9481.961423 secs 2024-04-26T14:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:07 smithi196 ceph-mon[32572]: slow request 721.774383 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:26:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:07 smithi110 ceph-mon[28069]: 10 slow requests, 1 included below; oldest blocked for > 9481.961423 secs 2024-04-26T14:26:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:07 smithi110 ceph-mon[28069]: slow request 721.774383 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:07 smithi193 ceph-mon[32782]: 10 slow requests, 1 included below; oldest blocked for > 9481.961423 secs 2024-04-26T14:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:07 smithi193 ceph-mon[32782]: slow request 721.774383 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:26:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:08 smithi196 ceph-mon[32572]: pgmap v5526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:08 smithi110 ceph-mon[28069]: pgmap v5526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:08 smithi193 ceph-mon[32782]: pgmap v5526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:10 smithi196 ceph-mon[32572]: pgmap v5527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:10 smithi110 ceph-mon[28069]: pgmap v5527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:10 smithi193 ceph-mon[32782]: pgmap v5527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:12 smithi196 ceph-mon[32572]: pgmap v5528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:12 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9486.961548 secs 2024-04-26T14:26:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:12 smithi110 ceph-mon[28069]: pgmap v5528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:12 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9486.961548 secs 2024-04-26T14:26:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:12 smithi193 ceph-mon[32782]: pgmap v5528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:12 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9486.961548 secs 2024-04-26T14:26:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:14 smithi196 ceph-mon[32572]: pgmap v5529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:14 smithi110 ceph-mon[28069]: pgmap v5529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:14 smithi193 ceph-mon[32782]: pgmap v5529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:16 smithi196 ceph-mon[32572]: pgmap v5530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:16 smithi110 ceph-mon[28069]: pgmap v5530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:16 smithi193 ceph-mon[32782]: pgmap v5530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:17 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9491.961663 secs 2024-04-26T14:26:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:17 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9491.961663 secs 2024-04-26T14:26:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:17 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9491.961663 secs 2024-04-26T14:26:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:18 smithi196 ceph-mon[32572]: pgmap v5531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:18 smithi110 ceph-mon[28069]: pgmap v5531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:18 smithi193 ceph-mon[32782]: pgmap v5531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:20 smithi196 ceph-mon[32572]: pgmap v5532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:20 smithi110 ceph-mon[28069]: pgmap v5532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:20 smithi193 ceph-mon[32782]: pgmap v5532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:22 smithi196 ceph-mon[32572]: pgmap v5533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:22 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9496.961745 secs 2024-04-26T14:26:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:22 smithi110 ceph-mon[28069]: pgmap v5533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:22 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9496.961745 secs 2024-04-26T14:26:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:22 smithi193 ceph-mon[32782]: pgmap v5533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:22 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9496.961745 secs 2024-04-26T14:26:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:24 smithi196 ceph-mon[32572]: pgmap v5534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:24 smithi110 ceph-mon[28069]: pgmap v5534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:24 smithi193 ceph-mon[32782]: pgmap v5534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:26 smithi196 ceph-mon[32572]: pgmap v5535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:26 smithi110 ceph-mon[28069]: pgmap v5535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:26 smithi193 ceph-mon[32782]: pgmap v5535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:27 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9501.961862 secs 2024-04-26T14:26:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:27 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9501.961862 secs 2024-04-26T14:26:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:27 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9501.961862 secs 2024-04-26T14:26:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:28 smithi196 ceph-mon[32572]: pgmap v5536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:28 smithi110 ceph-mon[28069]: pgmap v5536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:28 smithi193 ceph-mon[32782]: pgmap v5536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:30 smithi110 ceph-mon[28069]: pgmap v5537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:30 smithi193 ceph-mon[32782]: pgmap v5537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:30 smithi196 ceph-mon[32572]: pgmap v5537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:26:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:26:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:26:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:32 smithi110 ceph-mon[28069]: pgmap v5538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:32 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9506.961931 secs 2024-04-26T14:26:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:32 smithi193 ceph-mon[32782]: pgmap v5538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:32 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9506.961931 secs 2024-04-26T14:26:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:32 smithi196 ceph-mon[32572]: pgmap v5538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:32 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9506.961931 secs 2024-04-26T14:26:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:34 smithi193 ceph-mon[32782]: pgmap v5539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:34 smithi196 ceph-mon[32572]: pgmap v5539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:34 smithi110 ceph-mon[28069]: pgmap v5539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:36 smithi196 ceph-mon[32572]: pgmap v5540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:26:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:26:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:36 smithi110 ceph-mon[28069]: pgmap v5540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:26:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:26:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:36 smithi193 ceph-mon[32782]: pgmap v5540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:26:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:26:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:26:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:37 smithi110 ceph-mon[28069]: pgmap v5541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 918 B/s rd, 1 op/s 2024-04-26T14:26:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:37 smithi110 ceph-mon[28069]: pgmap v5542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:37 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9511.961996 secs 2024-04-26T14:26:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:37 smithi193 ceph-mon[32782]: pgmap v5541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 918 B/s rd, 1 op/s 2024-04-26T14:26:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:37 smithi193 ceph-mon[32782]: pgmap v5542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:37 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9511.961996 secs 2024-04-26T14:26:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:37 smithi196 ceph-mon[32572]: pgmap v5541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 918 B/s rd, 1 op/s 2024-04-26T14:26:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:37 smithi196 ceph-mon[32572]: pgmap v5542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:37 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9511.961996 secs 2024-04-26T14:26:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:39 smithi110 ceph-mon[28069]: pgmap v5543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:39 smithi193 ceph-mon[32782]: pgmap v5543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:39 smithi196 ceph-mon[32572]: pgmap v5543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:41 smithi193 ceph-mon[32782]: pgmap v5544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:41 smithi196 ceph-mon[32572]: pgmap v5544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:41 smithi110 ceph-mon[28069]: pgmap v5544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:42 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9516.962093 secs 2024-04-26T14:26:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:42 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9516.962093 secs 2024-04-26T14:26:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:42 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9516.962093 secs 2024-04-26T14:26:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:43 smithi193 ceph-mon[32782]: pgmap v5545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 1 op/s 2024-04-26T14:26:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:43 smithi196 ceph-mon[32572]: pgmap v5545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 1 op/s 2024-04-26T14:26:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:43 smithi110 ceph-mon[28069]: pgmap v5545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 1 op/s 2024-04-26T14:26:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:45 smithi193 ceph-mon[32782]: pgmap v5546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:45.881 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:45 smithi196 ceph-mon[32572]: pgmap v5546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:45 smithi110 ceph-mon[28069]: pgmap v5546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:26:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:47 smithi193 ceph-mon[32782]: pgmap v5547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:26:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:47 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9521.962214 secs 2024-04-26T14:26:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:47 smithi196 ceph-mon[32572]: pgmap v5547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:26:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:47 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9521.962214 secs 2024-04-26T14:26:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:47 smithi110 ceph-mon[28069]: pgmap v5547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:26:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:47 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9521.962214 secs 2024-04-26T14:26:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:49 smithi193 ceph-mon[32782]: pgmap v5548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:49 smithi196 ceph-mon[32572]: pgmap v5548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:49 smithi110 ceph-mon[28069]: pgmap v5548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:51 smithi193 ceph-mon[32782]: pgmap v5549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:51 smithi196 ceph-mon[32572]: pgmap v5549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:51 smithi110 ceph-mon[28069]: pgmap v5549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:52 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9526.962332 secs 2024-04-26T14:26:52.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:52 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9526.962332 secs 2024-04-26T14:26:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:52 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9526.962332 secs 2024-04-26T14:26:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:53 smithi193 ceph-mon[32782]: pgmap v5550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:53 smithi196 ceph-mon[32572]: pgmap v5550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:53 smithi110 ceph-mon[28069]: pgmap v5550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:55 smithi193 ceph-mon[32782]: pgmap v5551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:55 smithi196 ceph-mon[32572]: pgmap v5551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:55 smithi110 ceph-mon[28069]: pgmap v5551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:57 smithi193 ceph-mon[32782]: pgmap v5552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:57 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9531.962451 secs 2024-04-26T14:26:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:57 smithi196 ceph-mon[32572]: pgmap v5552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:57 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9531.962451 secs 2024-04-26T14:26:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:57 smithi110 ceph-mon[28069]: pgmap v5552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:26:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:57 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9531.962451 secs 2024-04-26T14:26:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:26:58 smithi193 ceph-mon[32782]: pgmap v5553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:26:58 smithi196 ceph-mon[32572]: pgmap v5553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:26:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:26:58 smithi110 ceph-mon[28069]: pgmap v5553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:01 smithi196 ceph-mon[32572]: pgmap v5554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:01 smithi110 ceph-mon[28069]: pgmap v5554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:01 smithi193 ceph-mon[32782]: pgmap v5554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:02 smithi196 ceph-mon[32572]: 10 slow requests, 0 included below; oldest blocked for > 9536.962576 secs 2024-04-26T14:27:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:02 smithi110 ceph-mon[28069]: 10 slow requests, 0 included below; oldest blocked for > 9536.962576 secs 2024-04-26T14:27:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:02 smithi193 ceph-mon[32782]: 10 slow requests, 0 included below; oldest blocked for > 9536.962576 secs 2024-04-26T14:27:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:03 smithi196 ceph-mon[32572]: pgmap v5555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:03 smithi110 ceph-mon[28069]: pgmap v5555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:03 smithi193 ceph-mon[32782]: pgmap v5555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:05 smithi196 ceph-mon[32572]: pgmap v5556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:05 smithi110 ceph-mon[28069]: pgmap v5556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:05 smithi193 ceph-mon[32782]: pgmap v5556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:07 smithi196 ceph-mon[32572]: pgmap v5557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 9541.962694 secs 2024-04-26T14:27:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:07 smithi196 ceph-mon[32572]: slow request 181.456180 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:27:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:07 smithi110 ceph-mon[28069]: pgmap v5557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 9541.962694 secs 2024-04-26T14:27:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:07 smithi110 ceph-mon[28069]: slow request 181.456180 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:27:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:07 smithi193 ceph-mon[32782]: pgmap v5557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 9541.962694 secs 2024-04-26T14:27:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:07 smithi193 ceph-mon[32782]: slow request 181.456180 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T14:27:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:09 smithi196 ceph-mon[32572]: pgmap v5558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:27:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:09 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:27:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:09 smithi110 ceph-mon[28069]: pgmap v5558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:27:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:09 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:27:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:09 smithi193 ceph-mon[32782]: pgmap v5558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T14:27:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:09 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T14:27:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:11 smithi196 ceph-mon[32572]: pgmap v5559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:11 smithi110 ceph-mon[28069]: pgmap v5559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:11 smithi193 ceph-mon[32782]: pgmap v5559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9546.962773 secs 2024-04-26T14:27:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9546.962773 secs 2024-04-26T14:27:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9546.962773 secs 2024-04-26T14:27:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:13 smithi196 ceph-mon[32572]: pgmap v5560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:13 smithi110 ceph-mon[28069]: pgmap v5560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:13 smithi193 ceph-mon[32782]: pgmap v5560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:15 smithi196 ceph-mon[32572]: pgmap v5561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:15 smithi110 ceph-mon[28069]: pgmap v5561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:15 smithi193 ceph-mon[32782]: pgmap v5561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:17 smithi196 ceph-mon[32572]: pgmap v5562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9551.962890 secs 2024-04-26T14:27:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:17 smithi110 ceph-mon[28069]: pgmap v5562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9551.962890 secs 2024-04-26T14:27:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:17 smithi193 ceph-mon[32782]: pgmap v5562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9551.962890 secs 2024-04-26T14:27:17.914 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:27:17.914+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:27:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:27:17.914+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006390 con 0x7f261c104b50 2024-04-26T14:27:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:27:17.914+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 77 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006390 con 0x55db1be4fdd0 2024-04-26T14:27:17.915 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:27:17.914+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 77 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:27:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:19 smithi196 ceph-mon[32572]: pgmap v5563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:19 smithi110 ceph-mon[28069]: pgmap v5563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:19 smithi193 ceph-mon[32782]: pgmap v5563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:21 smithi196 ceph-mon[32572]: pgmap v5564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:21 smithi110 ceph-mon[28069]: pgmap v5564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:21 smithi193 ceph-mon[32782]: pgmap v5564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9556.962970 secs 2024-04-26T14:27:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9556.962970 secs 2024-04-26T14:27:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9556.962970 secs 2024-04-26T14:27:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:23 smithi196 ceph-mon[32572]: pgmap v5565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:23 smithi110 ceph-mon[28069]: pgmap v5565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:23 smithi193 ceph-mon[32782]: pgmap v5565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:25 smithi196 ceph-mon[32572]: pgmap v5566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:25 smithi110 ceph-mon[28069]: pgmap v5566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:25 smithi193 ceph-mon[32782]: pgmap v5566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:27 smithi196 ceph-mon[32572]: pgmap v5567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9561.963077 secs 2024-04-26T14:27:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:27 smithi110 ceph-mon[28069]: pgmap v5567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9561.963077 secs 2024-04-26T14:27:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:27 smithi193 ceph-mon[32782]: pgmap v5567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9561.963077 secs 2024-04-26T14:27:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:29 smithi196 ceph-mon[32572]: pgmap v5568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:29 smithi110 ceph-mon[28069]: pgmap v5568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:29 smithi193 ceph-mon[32782]: pgmap v5568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:31 smithi196 ceph-mon[32572]: pgmap v5569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:31 smithi110 ceph-mon[28069]: pgmap v5569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:31 smithi193 ceph-mon[32782]: pgmap v5569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9566.963216 secs 2024-04-26T14:27:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9566.963216 secs 2024-04-26T14:27:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9566.963216 secs 2024-04-26T14:27:33.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:33 smithi196 ceph-mon[32572]: pgmap v5570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:33 smithi110 ceph-mon[28069]: pgmap v5570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:33 smithi193 ceph-mon[32782]: pgmap v5570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:35 smithi110 ceph-mon[28069]: pgmap v5571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:35 smithi193 ceph-mon[32782]: pgmap v5571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:35 smithi196 ceph-mon[32572]: pgmap v5571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:37 smithi110 ceph-mon[28069]: pgmap v5572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9571.963328 secs 2024-04-26T14:27:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:27:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:37 smithi193 ceph-mon[32782]: pgmap v5572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9571.963328 secs 2024-04-26T14:27:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:27:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:37 smithi196 ceph-mon[32572]: pgmap v5572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9571.963328 secs 2024-04-26T14:27:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:27:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: pgmap v5573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: pgmap v5573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: pgmap v5573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:40 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:27:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:40 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:27:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:40 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:27:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:40 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:27:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:40 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:27:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:40 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:27:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:40 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:27:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:40 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:27:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:40 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:27:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:40 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:27:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:40 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:27:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:40 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:27:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:41 smithi196 ceph-mon[32572]: pgmap v5574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:41 smithi110 ceph-mon[28069]: pgmap v5574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:41 smithi193 ceph-mon[32782]: pgmap v5574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9576.963446 secs 2024-04-26T14:27:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9576.963446 secs 2024-04-26T14:27:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9576.963446 secs 2024-04-26T14:27:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:43 smithi196 ceph-mon[32572]: pgmap v5575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:43 smithi110 ceph-mon[28069]: pgmap v5575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:43 smithi193 ceph-mon[32782]: pgmap v5575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:45 smithi196 ceph-mon[32572]: pgmap v5576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:45 smithi110 ceph-mon[28069]: pgmap v5576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:45 smithi193 ceph-mon[32782]: pgmap v5576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:27:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: pgmap v5577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9581.963586 secs 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: pgmap v5577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9581.963586 secs 2024-04-26T14:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:27:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:27:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: pgmap v5577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9581.963586 secs 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:27:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:27:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:27:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:27:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:48 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:27:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:48 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:27:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:48 smithi110 ceph-mon[28069]: pgmap v5578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:27:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:48 smithi110 ceph-mon[28069]: pgmap v5579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T14:27:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:48 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:27:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:48 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:27:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:48 smithi193 ceph-mon[32782]: pgmap v5578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:27:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:48 smithi193 ceph-mon[32782]: pgmap v5579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T14:27:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:48 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:27:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:48 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:27:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:48 smithi196 ceph-mon[32572]: pgmap v5578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:27:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:48 smithi196 ceph-mon[32572]: pgmap v5579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T14:27:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:50 smithi110 ceph-mon[28069]: pgmap v5580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:50 smithi193 ceph-mon[32782]: pgmap v5580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:50 smithi196 ceph-mon[32572]: pgmap v5580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9586.963721 secs 2024-04-26T14:27:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:52 smithi110 ceph-mon[28069]: pgmap v5581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:52.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9586.963721 secs 2024-04-26T14:27:52.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:52 smithi196 ceph-mon[32572]: pgmap v5581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9586.963721 secs 2024-04-26T14:27:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:52 smithi193 ceph-mon[32782]: pgmap v5581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:54 smithi110 ceph-mon[28069]: pgmap v5582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:54 smithi193 ceph-mon[32782]: pgmap v5582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:54 smithi196 ceph-mon[32572]: pgmap v5582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:56 smithi110 ceph-mon[28069]: pgmap v5583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:56 smithi193 ceph-mon[32782]: pgmap v5583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:56 smithi196 ceph-mon[32572]: pgmap v5583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:27:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9591.963838 secs 2024-04-26T14:27:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9591.963838 secs 2024-04-26T14:27:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9591.963838 secs 2024-04-26T14:27:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:27:58 smithi110 ceph-mon[28069]: pgmap v5584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:27:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:27:58 smithi193 ceph-mon[32782]: pgmap v5584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:27:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:27:58 smithi196 ceph-mon[32572]: pgmap v5584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:28:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:00 smithi193 ceph-mon[32782]: pgmap v5585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:00 smithi196 ceph-mon[32572]: pgmap v5585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:00 smithi110 ceph-mon[28069]: pgmap v5585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9596.963960 secs 2024-04-26T14:28:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:02 smithi193 ceph-mon[32782]: pgmap v5586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9596.963960 secs 2024-04-26T14:28:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:02 smithi196 ceph-mon[32572]: pgmap v5586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9596.963960 secs 2024-04-26T14:28:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:02 smithi110 ceph-mon[28069]: pgmap v5586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:04 smithi193 ceph-mon[32782]: pgmap v5587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:04 smithi196 ceph-mon[32572]: pgmap v5587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:04 smithi110 ceph-mon[28069]: pgmap v5587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:06.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:06 smithi110 ceph-mon[28069]: pgmap v5588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:06 smithi193 ceph-mon[32782]: pgmap v5588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:06 smithi196 ceph-mon[32572]: pgmap v5588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:07.869 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9601.964083 secs 2024-04-26T14:28:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9601.964083 secs 2024-04-26T14:28:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9601.964083 secs 2024-04-26T14:28:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:08 smithi193 ceph-mon[32782]: pgmap v5589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:08 smithi196 ceph-mon[32572]: pgmap v5589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:08 smithi110 ceph-mon[28069]: pgmap v5589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:10 smithi193 ceph-mon[32782]: pgmap v5590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:10 smithi196 ceph-mon[32572]: pgmap v5590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:10 smithi110 ceph-mon[28069]: pgmap v5590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9606.964218 secs 2024-04-26T14:28:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:12 smithi193 ceph-mon[32782]: pgmap v5591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9606.964218 secs 2024-04-26T14:28:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:12 smithi196 ceph-mon[32572]: pgmap v5591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9606.964218 secs 2024-04-26T14:28:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:12 smithi110 ceph-mon[28069]: pgmap v5591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:14 smithi193 ceph-mon[32782]: pgmap v5592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:14 smithi196 ceph-mon[32572]: pgmap v5592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:14 smithi110 ceph-mon[28069]: pgmap v5592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:16 smithi193 ceph-mon[32782]: pgmap v5593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:16 smithi196 ceph-mon[32572]: pgmap v5593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:16 smithi110 ceph-mon[28069]: pgmap v5593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9611.964335 secs 2024-04-26T14:28:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9611.964335 secs 2024-04-26T14:28:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9611.964335 secs 2024-04-26T14:28:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:18 smithi193 ceph-mon[32782]: pgmap v5594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:18.904 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:18 smithi110 ceph-mon[28069]: pgmap v5594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:18 smithi196 ceph-mon[32572]: pgmap v5594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:20 smithi193 ceph-mon[32782]: pgmap v5595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:20 smithi196 ceph-mon[32572]: pgmap v5595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:20 smithi110 ceph-mon[28069]: pgmap v5595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9616.964457 secs 2024-04-26T14:28:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:22 smithi193 ceph-mon[32782]: pgmap v5596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9616.964457 secs 2024-04-26T14:28:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:22 smithi196 ceph-mon[32572]: pgmap v5596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9616.964457 secs 2024-04-26T14:28:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:22 smithi110 ceph-mon[28069]: pgmap v5596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:23 smithi196 ceph-mon[32572]: pgmap v5597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:23 smithi110 ceph-mon[28069]: pgmap v5597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:23 smithi193 ceph-mon[32782]: pgmap v5597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:26 smithi196 ceph-mon[32572]: pgmap v5598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:26 smithi110 ceph-mon[28069]: pgmap v5598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:26 smithi193 ceph-mon[32782]: pgmap v5598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9621.964595 secs 2024-04-26T14:28:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9621.964595 secs 2024-04-26T14:28:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9621.964595 secs 2024-04-26T14:28:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:28 smithi196 ceph-mon[32572]: pgmap v5599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:28 smithi110 ceph-mon[28069]: pgmap v5599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:28 smithi193 ceph-mon[32782]: pgmap v5599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:30 smithi196 ceph-mon[32572]: pgmap v5600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:30 smithi110 ceph-mon[28069]: pgmap v5600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:30 smithi193 ceph-mon[32782]: pgmap v5600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9626.964715 secs 2024-04-26T14:28:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:32 smithi196 ceph-mon[32572]: pgmap v5601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9626.964715 secs 2024-04-26T14:28:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:32 smithi110 ceph-mon[28069]: pgmap v5601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9626.964715 secs 2024-04-26T14:28:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:32 smithi193 ceph-mon[32782]: pgmap v5601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:34 smithi196 ceph-mon[32572]: pgmap v5602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:34 smithi110 ceph-mon[28069]: pgmap v5602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:34 smithi193 ceph-mon[32782]: pgmap v5602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:36 smithi196 ceph-mon[32572]: pgmap v5603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:36 smithi110 ceph-mon[28069]: pgmap v5603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:36 smithi193 ceph-mon[32782]: pgmap v5603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9631.964829 secs 2024-04-26T14:28:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9631.964829 secs 2024-04-26T14:28:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9631.964829 secs 2024-04-26T14:28:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:38 smithi196 ceph-mon[32572]: pgmap v5604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:38 smithi110 ceph-mon[28069]: pgmap v5604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:38 smithi193 ceph-mon[32782]: pgmap v5604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:40 smithi196 ceph-mon[32572]: pgmap v5605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:40 smithi110 ceph-mon[28069]: pgmap v5605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:40 smithi193 ceph-mon[32782]: pgmap v5605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:28:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9636.964915 secs 2024-04-26T14:28:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:42 smithi196 ceph-mon[32572]: pgmap v5606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9636.964915 secs 2024-04-26T14:28:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:42 smithi110 ceph-mon[28069]: pgmap v5606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9636.964915 secs 2024-04-26T14:28:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:42 smithi193 ceph-mon[32782]: pgmap v5606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:44 smithi110 ceph-mon[28069]: pgmap v5607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:44 smithi193 ceph-mon[32782]: pgmap v5607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:44 smithi196 ceph-mon[32572]: pgmap v5607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:46 smithi110 ceph-mon[28069]: pgmap v5608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:46 smithi193 ceph-mon[32782]: pgmap v5608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:46 smithi196 ceph-mon[32572]: pgmap v5608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:28:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9641.965058 secs 2024-04-26T14:28:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9641.965058 secs 2024-04-26T14:28:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9641.965058 secs 2024-04-26T14:28:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:48 smithi110 ceph-mon[28069]: pgmap v5609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:28:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:48 smithi193 ceph-mon[32782]: pgmap v5609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:28:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:48 smithi196 ceph-mon[32572]: pgmap v5609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:28:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:28:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:28:49.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:28:49.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:28:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:28:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:28:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:28:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:28:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:28:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:28:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:50 smithi110 ceph-mon[28069]: pgmap v5610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 2 op/s 2024-04-26T14:28:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:50 smithi110 ceph-mon[28069]: pgmap v5611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:50 smithi193 ceph-mon[32782]: pgmap v5610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 2 op/s 2024-04-26T14:28:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:50 smithi193 ceph-mon[32782]: pgmap v5611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:50 smithi196 ceph-mon[32572]: pgmap v5610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 2 op/s 2024-04-26T14:28:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:50 smithi196 ceph-mon[32572]: pgmap v5611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:52.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:52 smithi196 ceph-mon[32572]: pgmap v5612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:52.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9646.965192 secs 2024-04-26T14:28:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:52 smithi193 ceph-mon[32782]: pgmap v5612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9646.965192 secs 2024-04-26T14:28:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:52 smithi110 ceph-mon[28069]: pgmap v5612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9646.965192 secs 2024-04-26T14:28:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:54 smithi193 ceph-mon[32782]: pgmap v5613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:54 smithi196 ceph-mon[32572]: pgmap v5613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:54 smithi110 ceph-mon[28069]: pgmap v5613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:56 smithi193 ceph-mon[32782]: pgmap v5614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:56 smithi196 ceph-mon[32572]: pgmap v5614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:56 smithi110 ceph-mon[28069]: pgmap v5614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:28:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9651.965305 secs 2024-04-26T14:28:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9651.965305 secs 2024-04-26T14:28:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9651.965305 secs 2024-04-26T14:28:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:28:58 smithi193 ceph-mon[32782]: pgmap v5615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T14:28:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:28:58 smithi196 ceph-mon[32572]: pgmap v5615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T14:28:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:28:58 smithi110 ceph-mon[28069]: pgmap v5615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T14:29:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:00 smithi193 ceph-mon[32782]: pgmap v5616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:29:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:00 smithi196 ceph-mon[32572]: pgmap v5616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:29:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:00 smithi110 ceph-mon[28069]: pgmap v5616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:29:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:02 smithi193 ceph-mon[32782]: pgmap v5617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9656.965424 secs 2024-04-26T14:29:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:02 smithi196 ceph-mon[32572]: pgmap v5617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9656.965424 secs 2024-04-26T14:29:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:02 smithi110 ceph-mon[28069]: pgmap v5617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9656.965424 secs 2024-04-26T14:29:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:04 smithi193 ceph-mon[32782]: pgmap v5618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:04.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:04 smithi110 ceph-mon[28069]: pgmap v5618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:04 smithi196 ceph-mon[32572]: pgmap v5618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:29:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:29:04.889+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:29:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:29:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:29:04.889+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:29:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:29:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:29:04.889+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:29:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:29:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:29:04.889+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:29:05.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:29:04 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:29:04.889+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:29:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:06 smithi193 ceph-mon[32782]: pgmap v5619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:06 smithi196 ceph-mon[32572]: pgmap v5619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:06 smithi110 ceph-mon[28069]: pgmap v5619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9661.965559 secs 2024-04-26T14:29:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9661.965559 secs 2024-04-26T14:29:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9661.965559 secs 2024-04-26T14:29:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:08 smithi193 ceph-mon[32782]: pgmap v5620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:08 smithi196 ceph-mon[32572]: pgmap v5620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:08 smithi110 ceph-mon[28069]: pgmap v5620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:10 smithi193 ceph-mon[32782]: pgmap v5621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:29:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:10 smithi196 ceph-mon[32572]: pgmap v5621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:29:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:10 smithi110 ceph-mon[28069]: pgmap v5621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:29:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:12 smithi193 ceph-mon[32782]: pgmap v5622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:29:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9666.965683 secs 2024-04-26T14:29:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:12 smithi196 ceph-mon[32572]: pgmap v5622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:29:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9666.965683 secs 2024-04-26T14:29:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:12 smithi110 ceph-mon[28069]: pgmap v5622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:29:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9666.965683 secs 2024-04-26T14:29:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:14 smithi193 ceph-mon[32782]: pgmap v5623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:29:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:14 smithi196 ceph-mon[32572]: pgmap v5623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:29:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:14 smithi110 ceph-mon[28069]: pgmap v5623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:29:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:16 smithi193 ceph-mon[32782]: pgmap v5624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:29:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:16 smithi196 ceph-mon[32572]: pgmap v5624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:29:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:16 smithi110 ceph-mon[28069]: pgmap v5624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:29:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9671.965798 secs 2024-04-26T14:29:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9671.965798 secs 2024-04-26T14:29:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9671.965798 secs 2024-04-26T14:29:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:18 smithi196 ceph-mon[32572]: pgmap v5625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:29:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:18 smithi110 ceph-mon[28069]: pgmap v5625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:29:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:18 smithi193 ceph-mon[32782]: pgmap v5625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:29:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:19 smithi196 ceph-mon[32572]: pgmap v5626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:29:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:19 smithi110 ceph-mon[28069]: pgmap v5626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:29:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:19 smithi193 ceph-mon[32782]: pgmap v5626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:29:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:22 smithi193 ceph-mon[32782]: pgmap v5627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:29:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9676.965909 secs 2024-04-26T14:29:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:22 smithi196 ceph-mon[32572]: pgmap v5627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:29:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9676.965909 secs 2024-04-26T14:29:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:22 smithi110 ceph-mon[28069]: pgmap v5627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:29:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9676.965909 secs 2024-04-26T14:29:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:24 smithi193 ceph-mon[32782]: pgmap v5628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:24 smithi196 ceph-mon[32572]: pgmap v5628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:24 smithi110 ceph-mon[28069]: pgmap v5628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:26 smithi193 ceph-mon[32782]: pgmap v5629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:26 smithi196 ceph-mon[32572]: pgmap v5629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:26 smithi110 ceph-mon[28069]: pgmap v5629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9681.966048 secs 2024-04-26T14:29:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9681.966048 secs 2024-04-26T14:29:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9681.966048 secs 2024-04-26T14:29:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:28 smithi193 ceph-mon[32782]: pgmap v5630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:28 smithi196 ceph-mon[32572]: pgmap v5630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:28 smithi110 ceph-mon[28069]: pgmap v5630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:30 smithi193 ceph-mon[32782]: pgmap v5631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:30 smithi196 ceph-mon[32572]: pgmap v5631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:30 smithi110 ceph-mon[28069]: pgmap v5631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:32 smithi193 ceph-mon[32782]: pgmap v5632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9686.966116 secs 2024-04-26T14:29:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:32 smithi196 ceph-mon[32572]: pgmap v5632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9686.966116 secs 2024-04-26T14:29:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:32 smithi110 ceph-mon[28069]: pgmap v5632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9686.966116 secs 2024-04-26T14:29:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:34 smithi193 ceph-mon[32782]: pgmap v5633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:34 smithi196 ceph-mon[32572]: pgmap v5633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:34 smithi110 ceph-mon[28069]: pgmap v5633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:36 smithi193 ceph-mon[32782]: pgmap v5634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:36 smithi196 ceph-mon[32572]: pgmap v5634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:36 smithi110 ceph-mon[28069]: pgmap v5634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9691.966181 secs 2024-04-26T14:29:37.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9691.966181 secs 2024-04-26T14:29:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9691.966181 secs 2024-04-26T14:29:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:38 smithi196 ceph-mon[32572]: pgmap v5635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:38 smithi110 ceph-mon[28069]: pgmap v5635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:38 smithi193 ceph-mon[32782]: pgmap v5635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:40 smithi196 ceph-mon[32572]: pgmap v5636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:40 smithi110 ceph-mon[28069]: pgmap v5636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:40 smithi193 ceph-mon[32782]: pgmap v5636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:42 smithi196 ceph-mon[32572]: pgmap v5637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9696.966298 secs 2024-04-26T14:29:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:42 smithi110 ceph-mon[28069]: pgmap v5637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9696.966298 secs 2024-04-26T14:29:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:42 smithi193 ceph-mon[32782]: pgmap v5637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9696.966298 secs 2024-04-26T14:29:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:44 smithi196 ceph-mon[32572]: pgmap v5638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:44 smithi110 ceph-mon[28069]: pgmap v5638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:44 smithi193 ceph-mon[32782]: pgmap v5638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:46 smithi196 ceph-mon[32572]: pgmap v5639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:46 smithi110 ceph-mon[28069]: pgmap v5639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:46 smithi193 ceph-mon[32782]: pgmap v5639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9701.966417 secs 2024-04-26T14:29:47.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9701.966417 secs 2024-04-26T14:29:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9701.966417 secs 2024-04-26T14:29:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:48 smithi196 ceph-mon[32572]: pgmap v5640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:48 smithi110 ceph-mon[28069]: pgmap v5640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:48 smithi193 ceph-mon[32782]: pgmap v5640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:29:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:50 smithi196 ceph-mon[32572]: pgmap v5641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:29:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:50 smithi110 ceph-mon[28069]: pgmap v5641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:29:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:50 smithi193 ceph-mon[32782]: pgmap v5641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:29:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:29:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:29:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:29:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:51 smithi196 ceph-mon[32572]: pgmap v5642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T14:29:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:51 smithi196 ceph-mon[32572]: pgmap v5643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:29:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:29:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:29:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:51 smithi110 ceph-mon[28069]: pgmap v5642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T14:29:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:51 smithi110 ceph-mon[28069]: pgmap v5643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:29:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:29:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:29:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:51 smithi193 ceph-mon[32782]: pgmap v5642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T14:29:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:51 smithi193 ceph-mon[32782]: pgmap v5643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:29:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9706.966535 secs 2024-04-26T14:29:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9706.966535 secs 2024-04-26T14:29:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9706.966535 secs 2024-04-26T14:29:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:53 smithi196 ceph-mon[32572]: pgmap v5644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:53 smithi110 ceph-mon[28069]: pgmap v5644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:53 smithi193 ceph-mon[32782]: pgmap v5644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:55 smithi193 ceph-mon[32782]: pgmap v5645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:55 smithi196 ceph-mon[32572]: pgmap v5645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:55 smithi110 ceph-mon[28069]: pgmap v5645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9711.966600 secs 2024-04-26T14:29:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:57 smithi193 ceph-mon[32782]: pgmap v5646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9711.966600 secs 2024-04-26T14:29:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:57 smithi196 ceph-mon[32572]: pgmap v5646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9711.966600 secs 2024-04-26T14:29:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:57 smithi110 ceph-mon[28069]: pgmap v5646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:29:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:29:59 smithi193 ceph-mon[32782]: pgmap v5647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:30:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:29:59 smithi196 ceph-mon[32572]: pgmap v5647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:30:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:29:59 smithi110 ceph-mon[28069]: pgmap v5647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:30:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:30:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:30:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:30:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:01 smithi193 ceph-mon[32782]: pgmap v5648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:30:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:01 smithi196 ceph-mon[32572]: pgmap v5648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:30:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:01 smithi110 ceph-mon[28069]: pgmap v5648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:30:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9716.966666 secs 2024-04-26T14:30:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9716.966666 secs 2024-04-26T14:30:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9716.966666 secs 2024-04-26T14:30:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:03 smithi193 ceph-mon[32782]: pgmap v5649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:03 smithi196 ceph-mon[32572]: pgmap v5649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:03 smithi110 ceph-mon[28069]: pgmap v5649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:05 smithi193 ceph-mon[32782]: pgmap v5650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:05 smithi196 ceph-mon[32572]: pgmap v5650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:05 smithi110 ceph-mon[28069]: pgmap v5650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 9721.966789 secs 2024-04-26T14:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:07 smithi193 ceph-mon[32782]: slow request 361.460275 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:07 smithi193 ceph-mon[32782]: pgmap v5651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 9721.966789 secs 2024-04-26T14:30:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:07 smithi196 ceph-mon[32572]: slow request 361.460275 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:30:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:07 smithi196 ceph-mon[32572]: pgmap v5651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 9721.966789 secs 2024-04-26T14:30:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:07 smithi110 ceph-mon[28069]: slow request 361.460275 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:30:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:07 smithi110 ceph-mon[28069]: pgmap v5651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:09 smithi193 ceph-mon[32782]: pgmap v5652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:09 smithi196 ceph-mon[32572]: pgmap v5652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:09 smithi110 ceph-mon[28069]: pgmap v5652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:11 smithi193 ceph-mon[32782]: pgmap v5653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:11 smithi196 ceph-mon[32572]: pgmap v5653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:11 smithi110 ceph-mon[28069]: pgmap v5653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9726.966929 secs 2024-04-26T14:30:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9726.966929 secs 2024-04-26T14:30:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9726.966929 secs 2024-04-26T14:30:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:13 smithi196 ceph-mon[32572]: pgmap v5654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:13 smithi110 ceph-mon[28069]: pgmap v5654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:13 smithi193 ceph-mon[32782]: pgmap v5654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:15 smithi196 ceph-mon[32572]: pgmap v5655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:15 smithi110 ceph-mon[28069]: pgmap v5655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:15 smithi193 ceph-mon[32782]: pgmap v5655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:17.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9731.967044 secs 2024-04-26T14:30:17.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:17 smithi193 ceph-mon[32782]: pgmap v5656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:17.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:30:17.944+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006390 con 0x7f261c104b50 2024-04-26T14:30:17.944 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:30:17.944+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:30:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:30:17.945+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 78 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:30:17.945 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:30:17.945+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 78 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006390 con 0x55db1be4fdd0 2024-04-26T14:30:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9731.967044 secs 2024-04-26T14:30:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:17 smithi196 ceph-mon[32572]: pgmap v5656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9731.967044 secs 2024-04-26T14:30:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:17 smithi110 ceph-mon[28069]: pgmap v5656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:18 smithi196 ceph-mon[32572]: pgmap v5657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:18 smithi110 ceph-mon[28069]: pgmap v5657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:18 smithi193 ceph-mon[32782]: pgmap v5657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:21 smithi193 ceph-mon[32782]: pgmap v5658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:21 smithi196 ceph-mon[32572]: pgmap v5658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:21 smithi110 ceph-mon[28069]: pgmap v5658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9736.967162 secs 2024-04-26T14:30:22.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9736.967162 secs 2024-04-26T14:30:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9736.967162 secs 2024-04-26T14:30:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:23 smithi193 ceph-mon[32782]: pgmap v5659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:23 smithi196 ceph-mon[32572]: pgmap v5659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:23 smithi110 ceph-mon[28069]: pgmap v5659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:25 smithi193 ceph-mon[32782]: pgmap v5660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:25 smithi196 ceph-mon[32572]: pgmap v5660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:25 smithi110 ceph-mon[28069]: pgmap v5660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9741.967277 secs 2024-04-26T14:30:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:27 smithi193 ceph-mon[32782]: pgmap v5661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9741.967277 secs 2024-04-26T14:30:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:27 smithi196 ceph-mon[32572]: pgmap v5661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9741.967277 secs 2024-04-26T14:30:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:27 smithi110 ceph-mon[28069]: pgmap v5661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:29 smithi193 ceph-mon[32782]: pgmap v5662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:29 smithi196 ceph-mon[32572]: pgmap v5662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:29 smithi110 ceph-mon[28069]: pgmap v5662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:31 smithi196 ceph-mon[32572]: pgmap v5663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:31 smithi110 ceph-mon[28069]: pgmap v5663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:31 smithi193 ceph-mon[32782]: pgmap v5663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9746.967394 secs 2024-04-26T14:30:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9746.967394 secs 2024-04-26T14:30:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9746.967394 secs 2024-04-26T14:30:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:33 smithi196 ceph-mon[32572]: pgmap v5664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:33 smithi110 ceph-mon[28069]: pgmap v5664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:33 smithi193 ceph-mon[32782]: pgmap v5664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:35 smithi196 ceph-mon[32572]: pgmap v5665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:35 smithi110 ceph-mon[28069]: pgmap v5665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:35 smithi193 ceph-mon[32782]: pgmap v5665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9751.967515 secs 2024-04-26T14:30:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:37 smithi196 ceph-mon[32572]: pgmap v5666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9751.967515 secs 2024-04-26T14:30:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:37 smithi110 ceph-mon[28069]: pgmap v5666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9751.967515 secs 2024-04-26T14:30:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:37 smithi193 ceph-mon[32782]: pgmap v5666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:39 smithi196 ceph-mon[32572]: pgmap v5667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:39 smithi110 ceph-mon[28069]: pgmap v5667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:39 smithi193 ceph-mon[32782]: pgmap v5667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:40 smithi196 ceph-mon[32572]: pgmap v5668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:40 smithi110 ceph-mon[28069]: pgmap v5668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:40 smithi193 ceph-mon[32782]: pgmap v5668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9756.967642 secs 2024-04-26T14:30:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9756.967642 secs 2024-04-26T14:30:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9756.967642 secs 2024-04-26T14:30:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:42 smithi196 ceph-mon[32572]: pgmap v5669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:42 smithi110 ceph-mon[28069]: pgmap v5669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:42 smithi193 ceph-mon[32782]: pgmap v5669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:45 smithi193 ceph-mon[32782]: pgmap v5670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:45 smithi196 ceph-mon[32572]: pgmap v5670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:45 smithi110 ceph-mon[28069]: pgmap v5670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9761.967761 secs 2024-04-26T14:30:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:47 smithi193 ceph-mon[32782]: pgmap v5671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9761.967761 secs 2024-04-26T14:30:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:47 smithi196 ceph-mon[32572]: pgmap v5671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9761.967761 secs 2024-04-26T14:30:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:47 smithi110 ceph-mon[28069]: pgmap v5671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:49 smithi193 ceph-mon[32782]: pgmap v5672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:49 smithi196 ceph-mon[32572]: pgmap v5672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:49 smithi110 ceph-mon[28069]: pgmap v5672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:30:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:51 smithi193 ceph-mon[32782]: pgmap v5673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:30:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:51 smithi196 ceph-mon[32572]: pgmap v5673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:30:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:51 smithi110 ceph-mon[28069]: pgmap v5673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:30:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:30:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9766.967829 secs 2024-04-26T14:30:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:30:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:30:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:30:52.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9766.967829 secs 2024-04-26T14:30:52.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:30:52.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:30:52.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:30:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9766.967829 secs 2024-04-26T14:30:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:30:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:30:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:30:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:53 smithi193 ceph-mon[32782]: pgmap v5674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T14:30:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:53 smithi193 ceph-mon[32782]: pgmap v5675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T14:30:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:53 smithi196 ceph-mon[32572]: pgmap v5674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T14:30:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:53 smithi196 ceph-mon[32572]: pgmap v5675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T14:30:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:53 smithi110 ceph-mon[28069]: pgmap v5674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T14:30:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:53 smithi110 ceph-mon[28069]: pgmap v5675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T14:30:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:55 smithi196 ceph-mon[32572]: pgmap v5676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:30:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:55 smithi110 ceph-mon[28069]: pgmap v5676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:30:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:55 smithi193 ceph-mon[32782]: pgmap v5676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:30:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:57 smithi196 ceph-mon[32572]: pgmap v5677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:30:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9771.967977 secs 2024-04-26T14:30:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:57 smithi110 ceph-mon[28069]: pgmap v5677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:30:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9771.967977 secs 2024-04-26T14:30:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:57 smithi193 ceph-mon[32782]: pgmap v5677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:30:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9771.967977 secs 2024-04-26T14:30:59.938 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:30:59 smithi193 ceph-mon[32782]: pgmap v5678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:30:59 smithi196 ceph-mon[32572]: pgmap v5678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:30:59 smithi110 ceph-mon[28069]: pgmap v5678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:01 smithi196 ceph-mon[32572]: pgmap v5679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:01 smithi110 ceph-mon[28069]: pgmap v5679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:01 smithi193 ceph-mon[32782]: pgmap v5679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9776.968114 secs 2024-04-26T14:31:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9776.968114 secs 2024-04-26T14:31:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9776.968114 secs 2024-04-26T14:31:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:03 smithi196 ceph-mon[32572]: pgmap v5680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:31:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:03 smithi110 ceph-mon[28069]: pgmap v5680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:31:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:03 smithi193 ceph-mon[32782]: pgmap v5680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:31:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:04 smithi196 ceph-mon[32572]: pgmap v5681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:04 smithi110 ceph-mon[28069]: pgmap v5681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:04 smithi193 ceph-mon[32782]: pgmap v5681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:07 smithi196 ceph-mon[32572]: pgmap v5682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 9781.968264 secs 2024-04-26T14:31:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:07 smithi196 ceph-mon[32572]: slow request 721.686787 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:31:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:07 smithi110 ceph-mon[28069]: pgmap v5682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 9781.968264 secs 2024-04-26T14:31:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:07 smithi110 ceph-mon[28069]: slow request 721.686787 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:31:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:07 smithi193 ceph-mon[32782]: pgmap v5682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 9781.968264 secs 2024-04-26T14:31:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:07 smithi193 ceph-mon[32782]: slow request 721.686787 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:31:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:09 smithi196 ceph-mon[32572]: pgmap v5683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:09 smithi110 ceph-mon[28069]: pgmap v5683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:09 smithi193 ceph-mon[32782]: pgmap v5683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:11 smithi196 ceph-mon[32572]: pgmap v5684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:11 smithi110 ceph-mon[28069]: pgmap v5684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:11 smithi193 ceph-mon[32782]: pgmap v5684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9786.968402 secs 2024-04-26T14:31:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9786.968402 secs 2024-04-26T14:31:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9786.968402 secs 2024-04-26T14:31:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:13 smithi196 ceph-mon[32572]: pgmap v5685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:13 smithi110 ceph-mon[28069]: pgmap v5685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:13 smithi193 ceph-mon[32782]: pgmap v5685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:15 smithi196 ceph-mon[32572]: pgmap v5686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:15 smithi110 ceph-mon[28069]: pgmap v5686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:15 smithi193 ceph-mon[32782]: pgmap v5686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:17.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:17 smithi193 ceph-mon[32782]: pgmap v5687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:17.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9791.968511 secs 2024-04-26T14:31:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:17 smithi196 ceph-mon[32572]: pgmap v5687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9791.968511 secs 2024-04-26T14:31:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:17 smithi110 ceph-mon[28069]: pgmap v5687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9791.968511 secs 2024-04-26T14:31:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:19 smithi196 ceph-mon[32572]: pgmap v5688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:19 smithi110 ceph-mon[28069]: pgmap v5688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:19 smithi193 ceph-mon[32782]: pgmap v5688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:21 smithi196 ceph-mon[32572]: pgmap v5689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:21 smithi110 ceph-mon[28069]: pgmap v5689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:21 smithi193 ceph-mon[32782]: pgmap v5689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9796.968631 secs 2024-04-26T14:31:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9796.968631 secs 2024-04-26T14:31:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9796.968631 secs 2024-04-26T14:31:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:23 smithi196 ceph-mon[32572]: pgmap v5690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:23 smithi110 ceph-mon[28069]: pgmap v5690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:23 smithi193 ceph-mon[32782]: pgmap v5690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:25 smithi196 ceph-mon[32572]: pgmap v5691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:25 smithi110 ceph-mon[28069]: pgmap v5691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:25 smithi193 ceph-mon[32782]: pgmap v5691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:27 smithi196 ceph-mon[32572]: pgmap v5692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:27.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9801.968731 secs 2024-04-26T14:31:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:27 smithi110 ceph-mon[28069]: pgmap v5692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9801.968731 secs 2024-04-26T14:31:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:27 smithi193 ceph-mon[32782]: pgmap v5692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9801.968731 secs 2024-04-26T14:31:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:29 smithi196 ceph-mon[32572]: pgmap v5693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:29 smithi110 ceph-mon[28069]: pgmap v5693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:29 smithi193 ceph-mon[32782]: pgmap v5693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:31 smithi196 ceph-mon[32572]: pgmap v5694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:31 smithi110 ceph-mon[28069]: pgmap v5694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:31 smithi193 ceph-mon[32782]: pgmap v5694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9806.968857 secs 2024-04-26T14:31:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9806.968857 secs 2024-04-26T14:31:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9806.968857 secs 2024-04-26T14:31:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:33 smithi196 ceph-mon[32572]: pgmap v5695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:33 smithi110 ceph-mon[28069]: pgmap v5695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:33 smithi193 ceph-mon[32782]: pgmap v5695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:35 smithi196 ceph-mon[32572]: pgmap v5696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:35 smithi110 ceph-mon[28069]: pgmap v5696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:35 smithi193 ceph-mon[32782]: pgmap v5696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:37 smithi196 ceph-mon[32572]: pgmap v5697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9811.968975 secs 2024-04-26T14:31:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:37 smithi110 ceph-mon[28069]: pgmap v5697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9811.968975 secs 2024-04-26T14:31:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:37 smithi193 ceph-mon[32782]: pgmap v5697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9811.968975 secs 2024-04-26T14:31:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:39 smithi196 ceph-mon[32572]: pgmap v5698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:39 smithi110 ceph-mon[28069]: pgmap v5698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:39 smithi193 ceph-mon[32782]: pgmap v5698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:41 smithi196 ceph-mon[32572]: pgmap v5699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:41 smithi110 ceph-mon[28069]: pgmap v5699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:41 smithi193 ceph-mon[32782]: pgmap v5699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9816.969098 secs 2024-04-26T14:31:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9816.969098 secs 2024-04-26T14:31:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9816.969098 secs 2024-04-26T14:31:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:43 smithi196 ceph-mon[32572]: pgmap v5700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:43 smithi110 ceph-mon[28069]: pgmap v5700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:43 smithi193 ceph-mon[32782]: pgmap v5700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:45 smithi196 ceph-mon[32572]: pgmap v5701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:45 smithi110 ceph-mon[28069]: pgmap v5701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:45 smithi193 ceph-mon[32782]: pgmap v5701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:47 smithi110 ceph-mon[28069]: pgmap v5702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9821.969216 secs 2024-04-26T14:31:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:47 smithi193 ceph-mon[32782]: pgmap v5702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9821.969216 secs 2024-04-26T14:31:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:47 smithi196 ceph-mon[32572]: pgmap v5702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9821.969216 secs 2024-04-26T14:31:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:49 smithi110 ceph-mon[28069]: pgmap v5703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:49 smithi193 ceph-mon[32782]: pgmap v5703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:49 smithi196 ceph-mon[32572]: pgmap v5703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:31:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:51 smithi110 ceph-mon[28069]: pgmap v5704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:51 smithi193 ceph-mon[32782]: pgmap v5704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:51 smithi196 ceph-mon[32572]: pgmap v5704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9826.969312 secs 2024-04-26T14:31:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9826.969312 secs 2024-04-26T14:31:52.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9826.969312 secs 2024-04-26T14:31:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:53 smithi110 ceph-mon[28069]: pgmap v5705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:31:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:53 smithi193 ceph-mon[32782]: pgmap v5705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:31:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:53 smithi196 ceph-mon[32572]: pgmap v5705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:31:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:31:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:31:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:31:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:54 smithi193 ceph-mon[32782]: pgmap v5706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:31:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:54 smithi193 ceph-mon[32782]: pgmap v5707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:31:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:31:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:31:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:54 smithi196 ceph-mon[32572]: pgmap v5706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:31:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:54 smithi196 ceph-mon[32572]: pgmap v5707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:31:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:31:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:31:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:54 smithi110 ceph-mon[28069]: pgmap v5706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:31:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:54 smithi110 ceph-mon[28069]: pgmap v5707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:31:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:55 smithi196 ceph-mon[32572]: pgmap v5708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:55 smithi110 ceph-mon[28069]: pgmap v5708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:55 smithi193 ceph-mon[32782]: pgmap v5708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:56 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9831.969429 secs 2024-04-26T14:31:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:56 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9831.969429 secs 2024-04-26T14:31:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:56 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9831.969429 secs 2024-04-26T14:31:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:57 smithi196 ceph-mon[32572]: pgmap v5709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:57 smithi110 ceph-mon[28069]: pgmap v5709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:31:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:57 smithi193 ceph-mon[32782]: pgmap v5709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:32:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:31:59 smithi196 ceph-mon[32572]: pgmap v5710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:32:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:31:59 smithi110 ceph-mon[28069]: pgmap v5710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:32:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:31:59 smithi193 ceph-mon[32782]: pgmap v5710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:32:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:01 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9836.969576 secs 2024-04-26T14:32:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:01 smithi196 ceph-mon[32572]: pgmap v5711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:32:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:01 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9836.969576 secs 2024-04-26T14:32:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:01 smithi110 ceph-mon[28069]: pgmap v5711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:32:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:01 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9836.969576 secs 2024-04-26T14:32:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:01 smithi193 ceph-mon[32782]: pgmap v5711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:32:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:03 smithi196 ceph-mon[32572]: pgmap v5712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:32:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:03 smithi110 ceph-mon[28069]: pgmap v5712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:32:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:03 smithi193 ceph-mon[32782]: pgmap v5712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:32:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:05 smithi196 ceph-mon[32572]: pgmap v5713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:05 smithi110 ceph-mon[28069]: pgmap v5713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:05 smithi193 ceph-mon[32782]: pgmap v5713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:06 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9841.969694 secs 2024-04-26T14:32:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:06 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9841.969694 secs 2024-04-26T14:32:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:06 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9841.969694 secs 2024-04-26T14:32:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:07 smithi196 ceph-mon[32572]: pgmap v5714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:07 smithi110 ceph-mon[28069]: pgmap v5714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:07 smithi193 ceph-mon[32782]: pgmap v5714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:09 smithi196 ceph-mon[32572]: pgmap v5715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:09 smithi110 ceph-mon[28069]: pgmap v5715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:09 smithi193 ceph-mon[32782]: pgmap v5715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9846.969811 secs 2024-04-26T14:32:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:11 smithi196 ceph-mon[32572]: pgmap v5716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9846.969811 secs 2024-04-26T14:32:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:11 smithi110 ceph-mon[28069]: pgmap v5716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9846.969811 secs 2024-04-26T14:32:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:11 smithi193 ceph-mon[32782]: pgmap v5716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:13 smithi196 ceph-mon[32572]: pgmap v5717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:13 smithi110 ceph-mon[28069]: pgmap v5717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:13 smithi193 ceph-mon[32782]: pgmap v5717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:15 smithi196 ceph-mon[32572]: pgmap v5718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:15 smithi110 ceph-mon[28069]: pgmap v5718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:15 smithi193 ceph-mon[32782]: pgmap v5718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9851.969933 secs 2024-04-26T14:32:17.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9851.969933 secs 2024-04-26T14:32:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9851.969933 secs 2024-04-26T14:32:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:17 smithi196 ceph-mon[32572]: pgmap v5719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:17 smithi110 ceph-mon[28069]: pgmap v5719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:17 smithi193 ceph-mon[32782]: pgmap v5719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:19 smithi196 ceph-mon[32572]: pgmap v5720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:19 smithi110 ceph-mon[28069]: pgmap v5720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:20.124 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:19 smithi193 ceph-mon[32782]: pgmap v5720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9856.969997 secs 2024-04-26T14:32:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:21 smithi196 ceph-mon[32572]: pgmap v5721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9856.969997 secs 2024-04-26T14:32:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:21 smithi110 ceph-mon[28069]: pgmap v5721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9856.969997 secs 2024-04-26T14:32:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:21 smithi193 ceph-mon[32782]: pgmap v5721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:23 smithi196 ceph-mon[32572]: pgmap v5722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:23 smithi110 ceph-mon[28069]: pgmap v5722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:23 smithi193 ceph-mon[32782]: pgmap v5722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:25 smithi196 ceph-mon[32572]: pgmap v5723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:25 smithi110 ceph-mon[28069]: pgmap v5723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:25 smithi193 ceph-mon[32782]: pgmap v5723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:26 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9861.970121 secs 2024-04-26T14:32:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:26 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9861.970121 secs 2024-04-26T14:32:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:26 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9861.970121 secs 2024-04-26T14:32:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:27 smithi196 ceph-mon[32572]: pgmap v5724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:27 smithi110 ceph-mon[28069]: pgmap v5724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:27 smithi193 ceph-mon[32782]: pgmap v5724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:29 smithi196 ceph-mon[32572]: pgmap v5725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:29 smithi110 ceph-mon[28069]: pgmap v5725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:29 smithi193 ceph-mon[32782]: pgmap v5725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:31 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9866.970240 secs 2024-04-26T14:32:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:31 smithi196 ceph-mon[32572]: pgmap v5726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:31 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9866.970240 secs 2024-04-26T14:32:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:31 smithi110 ceph-mon[28069]: pgmap v5726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:31 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9866.970240 secs 2024-04-26T14:32:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:31 smithi193 ceph-mon[32782]: pgmap v5726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:33 smithi196 ceph-mon[32572]: pgmap v5727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:33 smithi110 ceph-mon[28069]: pgmap v5727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:33 smithi193 ceph-mon[32782]: pgmap v5727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:35 smithi196 ceph-mon[32572]: pgmap v5728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:35 smithi110 ceph-mon[28069]: pgmap v5728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:35 smithi193 ceph-mon[32782]: pgmap v5728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:36 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9871.970357 secs 2024-04-26T14:32:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:36 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9871.970357 secs 2024-04-26T14:32:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:36 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9871.970357 secs 2024-04-26T14:32:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:37 smithi196 ceph-mon[32572]: pgmap v5729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:37 smithi110 ceph-mon[28069]: pgmap v5729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:37 smithi193 ceph-mon[32782]: pgmap v5729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:39 smithi196 ceph-mon[32572]: pgmap v5730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:39 smithi110 ceph-mon[28069]: pgmap v5730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:39 smithi193 ceph-mon[32782]: pgmap v5730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9876.970453 secs 2024-04-26T14:32:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:41 smithi196 ceph-mon[32572]: pgmap v5731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9876.970453 secs 2024-04-26T14:32:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:41 smithi110 ceph-mon[28069]: pgmap v5731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9876.970453 secs 2024-04-26T14:32:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:41 smithi193 ceph-mon[32782]: pgmap v5731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:43 smithi196 ceph-mon[32572]: pgmap v5732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:43 smithi110 ceph-mon[28069]: pgmap v5732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:43 smithi193 ceph-mon[32782]: pgmap v5732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:45 smithi196 ceph-mon[32572]: pgmap v5733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:45 smithi110 ceph-mon[28069]: pgmap v5733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:45 smithi193 ceph-mon[32782]: pgmap v5733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9881.970590 secs 2024-04-26T14:32:47.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9881.970590 secs 2024-04-26T14:32:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9881.970590 secs 2024-04-26T14:32:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:47 smithi196 ceph-mon[32572]: pgmap v5734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:47 smithi110 ceph-mon[28069]: pgmap v5734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:47 smithi193 ceph-mon[32782]: pgmap v5734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:49 smithi196 ceph-mon[32572]: pgmap v5735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:49 smithi110 ceph-mon[28069]: pgmap v5735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:49 smithi193 ceph-mon[32782]: pgmap v5735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:51 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9886.970705 secs 2024-04-26T14:32:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:51 smithi196 ceph-mon[32572]: pgmap v5736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:51 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9886.970705 secs 2024-04-26T14:32:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:51 smithi110 ceph-mon[28069]: pgmap v5736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:51 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9886.970705 secs 2024-04-26T14:32:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:51 smithi193 ceph-mon[32782]: pgmap v5736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:53 smithi196 ceph-mon[32572]: pgmap v5737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:53 smithi110 ceph-mon[28069]: pgmap v5737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:53 smithi193 ceph-mon[32782]: pgmap v5737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:32:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:32:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: pgmap v5738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:32:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: pgmap v5738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:32:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:32:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: pgmap v5738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:32:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:57 smithi193 ceph-mon[32782]: pgmap v5739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T14:32:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:57 smithi193 ceph-mon[32782]: pgmap v5740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T14:32:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9891.970821 secs 2024-04-26T14:32:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:57 smithi196 ceph-mon[32572]: pgmap v5739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T14:32:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:57 smithi196 ceph-mon[32572]: pgmap v5740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T14:32:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9891.970821 secs 2024-04-26T14:32:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:57 smithi110 ceph-mon[28069]: pgmap v5739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T14:32:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:57 smithi110 ceph-mon[28069]: pgmap v5740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T14:32:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9891.970821 secs 2024-04-26T14:32:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:32:59 smithi193 ceph-mon[32782]: pgmap v5741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:32:59 smithi196 ceph-mon[32572]: pgmap v5741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:32:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:32:59 smithi110 ceph-mon[28069]: pgmap v5741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:01 smithi193 ceph-mon[32782]: pgmap v5742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:01 smithi196 ceph-mon[32572]: pgmap v5742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:01 smithi110 ceph-mon[28069]: pgmap v5742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9896.970939 secs 2024-04-26T14:33:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9896.970939 secs 2024-04-26T14:33:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9896.970939 secs 2024-04-26T14:33:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:03 smithi193 ceph-mon[32782]: pgmap v5743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T14:33:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:03 smithi196 ceph-mon[32572]: pgmap v5743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T14:33:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:03 smithi110 ceph-mon[28069]: pgmap v5743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T14:33:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:05 smithi193 ceph-mon[32782]: pgmap v5744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:05 smithi196 ceph-mon[32572]: pgmap v5744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:05 smithi110 ceph-mon[28069]: pgmap v5744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:07 smithi196 ceph-mon[32572]: pgmap v5745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:33:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9901.971054 secs 2024-04-26T14:33:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:07 smithi110 ceph-mon[28069]: pgmap v5745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:33:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9901.971054 secs 2024-04-26T14:33:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:07 smithi193 ceph-mon[32782]: pgmap v5745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:33:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9901.971054 secs 2024-04-26T14:33:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:09 smithi196 ceph-mon[32572]: pgmap v5746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:09 smithi110 ceph-mon[28069]: pgmap v5746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:09 smithi193 ceph-mon[32782]: pgmap v5746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:11 smithi196 ceph-mon[32572]: pgmap v5747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:11 smithi110 ceph-mon[28069]: pgmap v5747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:11 smithi193 ceph-mon[32782]: pgmap v5747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9906.971177 secs 2024-04-26T14:33:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9906.971177 secs 2024-04-26T14:33:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9906.971177 secs 2024-04-26T14:33:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:13 smithi196 ceph-mon[32572]: pgmap v5748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:13 smithi110 ceph-mon[28069]: pgmap v5748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:13 smithi193 ceph-mon[32782]: pgmap v5748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:15 smithi196 ceph-mon[32572]: pgmap v5749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:15 smithi110 ceph-mon[28069]: pgmap v5749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:15 smithi193 ceph-mon[32782]: pgmap v5749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.391+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T14:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.391+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T14:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.391+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261403d000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T14:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.391+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261403d000 comp rx=0 tx=0).stop 2024-04-26T14:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.391+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T14:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.391+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T14:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.391+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T14:33:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.391+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T14:33:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.393+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T14:33:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.395+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f2614050000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T14:33:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.408+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T14:33:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.408+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T14:33:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.408+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T14:33:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.408+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T14:33:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.409+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T14:33:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.410+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T14:33:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:16.410+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T14:33:17.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:17 smithi193 ceph-mon[32782]: pgmap v5750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:17.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9911.971292 secs 2024-04-26T14:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:17 smithi196 ceph-mon[32572]: pgmap v5750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9911.971292 secs 2024-04-26T14:33:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:17 smithi110 ceph-mon[28069]: pgmap v5750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9911.971292 secs 2024-04-26T14:33:17.974 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:17.974+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006650 con 0x7f261c104b50 2024-04-26T14:33:17.974 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:17.974+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T14:33:17.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:17.975+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 79 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T14:33:17.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:17.975+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 79 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x55db1bb93620 con 0x55db1be4fdd0 2024-04-26T14:33:17.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:17.975+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:33:17.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:17.975+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:33:17.975 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:17.976+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 80 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:33:17.976 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:33:17.976+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 80 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:33:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:19 smithi196 ceph-mon[32572]: pgmap v5751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:19 smithi110 ceph-mon[28069]: pgmap v5751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:19 smithi193 ceph-mon[32782]: pgmap v5751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:21 smithi196 ceph-mon[32572]: pgmap v5752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:21 smithi110 ceph-mon[28069]: pgmap v5752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:21 smithi193 ceph-mon[32782]: pgmap v5752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9916.971417 secs 2024-04-26T14:33:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9916.971417 secs 2024-04-26T14:33:22.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9916.971417 secs 2024-04-26T14:33:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:23 smithi196 ceph-mon[32572]: pgmap v5753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:23 smithi110 ceph-mon[28069]: pgmap v5753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:23 smithi193 ceph-mon[32782]: pgmap v5753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:25 smithi196 ceph-mon[32572]: pgmap v5754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:25 smithi110 ceph-mon[28069]: pgmap v5754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:25 smithi193 ceph-mon[32782]: pgmap v5754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:27 smithi196 ceph-mon[32572]: pgmap v5755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9921.971535 secs 2024-04-26T14:33:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:27 smithi110 ceph-mon[28069]: pgmap v5755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9921.971535 secs 2024-04-26T14:33:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:27 smithi193 ceph-mon[32782]: pgmap v5755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9921.971535 secs 2024-04-26T14:33:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:29 smithi196 ceph-mon[32572]: pgmap v5756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:29 smithi110 ceph-mon[28069]: pgmap v5756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:29 smithi193 ceph-mon[32782]: pgmap v5756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:31 smithi196 ceph-mon[32572]: pgmap v5757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:31 smithi110 ceph-mon[28069]: pgmap v5757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:31 smithi193 ceph-mon[32782]: pgmap v5757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9926.971622 secs 2024-04-26T14:33:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9926.971622 secs 2024-04-26T14:33:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9926.971622 secs 2024-04-26T14:33:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:33 smithi196 ceph-mon[32572]: pgmap v5758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:33 smithi110 ceph-mon[28069]: pgmap v5758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:33 smithi193 ceph-mon[32782]: pgmap v5758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:35 smithi196 ceph-mon[32572]: pgmap v5759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:35 smithi110 ceph-mon[28069]: pgmap v5759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:35 smithi193 ceph-mon[32782]: pgmap v5759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:37 smithi196 ceph-mon[32572]: pgmap v5760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9931.971699 secs 2024-04-26T14:33:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:37 smithi110 ceph-mon[28069]: pgmap v5760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9931.971699 secs 2024-04-26T14:33:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:37 smithi193 ceph-mon[32782]: pgmap v5760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9931.971699 secs 2024-04-26T14:33:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:39 smithi196 ceph-mon[32572]: pgmap v5761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:39 smithi110 ceph-mon[28069]: pgmap v5761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:39 smithi193 ceph-mon[32782]: pgmap v5761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:41 smithi196 ceph-mon[32572]: pgmap v5762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:41 smithi110 ceph-mon[28069]: pgmap v5762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:41 smithi193 ceph-mon[32782]: pgmap v5762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9936.971817 secs 2024-04-26T14:33:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9936.971817 secs 2024-04-26T14:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9936.971817 secs 2024-04-26T14:33:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:43 smithi196 ceph-mon[32572]: pgmap v5763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:43 smithi110 ceph-mon[28069]: pgmap v5763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:43 smithi193 ceph-mon[32782]: pgmap v5763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:45 smithi196 ceph-mon[32572]: pgmap v5764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:45 smithi110 ceph-mon[28069]: pgmap v5764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:45 smithi193 ceph-mon[32782]: pgmap v5764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:47 smithi196 ceph-mon[32572]: pgmap v5765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9941.971950 secs 2024-04-26T14:33:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:47 smithi110 ceph-mon[28069]: pgmap v5765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9941.971950 secs 2024-04-26T14:33:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:47 smithi193 ceph-mon[32782]: pgmap v5765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9941.971950 secs 2024-04-26T14:33:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:49 smithi110 ceph-mon[28069]: pgmap v5766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:49 smithi193 ceph-mon[32782]: pgmap v5766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:49 smithi196 ceph-mon[32572]: pgmap v5766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:51 smithi110 ceph-mon[28069]: pgmap v5767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:51 smithi193 ceph-mon[32782]: pgmap v5767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:51 smithi196 ceph-mon[32572]: pgmap v5767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9946.972053 secs 2024-04-26T14:33:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9946.972053 secs 2024-04-26T14:33:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9946.972053 secs 2024-04-26T14:33:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:53 smithi110 ceph-mon[28069]: pgmap v5768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:53 smithi193 ceph-mon[32782]: pgmap v5768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:53.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:53 smithi196 ceph-mon[32572]: pgmap v5768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:55 smithi110 ceph-mon[28069]: pgmap v5769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:55 smithi193 ceph-mon[32782]: pgmap v5769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:55 smithi196 ceph-mon[32572]: pgmap v5769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:33:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:33:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:33:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:33:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:57 smithi110 ceph-mon[28069]: pgmap v5770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9951.972163 secs 2024-04-26T14:33:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:57 smithi193 ceph-mon[32782]: pgmap v5770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9951.972163 secs 2024-04-26T14:33:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:57 smithi196 ceph-mon[32572]: pgmap v5770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:33:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9951.972163 secs 2024-04-26T14:33:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:33:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:33:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:58 smithi193 ceph-mon[32782]: pgmap v5771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:33:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:58 smithi193 ceph-mon[32782]: pgmap v5772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:33:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:33:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:33:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:33:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:33:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:58 smithi196 ceph-mon[32572]: pgmap v5771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:33:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:58 smithi196 ceph-mon[32572]: pgmap v5772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:33:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:33:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:33:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:33:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:33:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:58 smithi110 ceph-mon[28069]: pgmap v5771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:33:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:58 smithi110 ceph-mon[28069]: pgmap v5772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:33:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:33:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:34:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:00 smithi196 ceph-mon[32572]: pgmap v5773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:00 smithi110 ceph-mon[28069]: pgmap v5773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:00 smithi193 ceph-mon[32782]: pgmap v5773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9956.972297 secs 2024-04-26T14:34:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:02 smithi196 ceph-mon[32572]: pgmap v5774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9956.972297 secs 2024-04-26T14:34:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:02 smithi110 ceph-mon[28069]: pgmap v5774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9956.972297 secs 2024-04-26T14:34:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:02 smithi193 ceph-mon[32782]: pgmap v5774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:04 smithi196 ceph-mon[32572]: pgmap v5775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:04 smithi110 ceph-mon[28069]: pgmap v5775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:04 smithi193 ceph-mon[32782]: pgmap v5775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:34:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:34:05.080+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:34:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:34:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:34:05.080+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:34:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:34:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:34:05.080+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:34:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:34:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:34:05.080+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:34:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:34:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:34:05.080+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:34:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:06 smithi196 ceph-mon[32572]: pgmap v5776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:06 smithi110 ceph-mon[28069]: pgmap v5776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:06 smithi193 ceph-mon[32782]: pgmap v5776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:34:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9961.972398 secs 2024-04-26T14:34:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9961.972398 secs 2024-04-26T14:34:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9961.972398 secs 2024-04-26T14:34:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:08 smithi196 ceph-mon[32572]: pgmap v5777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T14:34:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:08 smithi110 ceph-mon[28069]: pgmap v5777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T14:34:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:08 smithi193 ceph-mon[32782]: pgmap v5777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T14:34:10.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:09 smithi196 ceph-mon[32572]: pgmap v5778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:34:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:09 smithi110 ceph-mon[28069]: pgmap v5778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:34:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:09 smithi193 ceph-mon[32782]: pgmap v5778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:34:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9966.972541 secs 2024-04-26T14:34:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:12 smithi196 ceph-mon[32572]: pgmap v5779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:34:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9966.972541 secs 2024-04-26T14:34:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:12 smithi110 ceph-mon[28069]: pgmap v5779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:34:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9966.972541 secs 2024-04-26T14:34:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:12 smithi193 ceph-mon[32782]: pgmap v5779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:34:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:14 smithi196 ceph-mon[32572]: pgmap v5780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:34:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:14 smithi110 ceph-mon[28069]: pgmap v5780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:34:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:14 smithi193 ceph-mon[32782]: pgmap v5780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:34:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:16 smithi196 ceph-mon[32572]: pgmap v5781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:34:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:16 smithi110 ceph-mon[28069]: pgmap v5781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:34:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:16 smithi193 ceph-mon[32782]: pgmap v5781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:34:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9971.972657 secs 2024-04-26T14:34:18.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9971.972657 secs 2024-04-26T14:34:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9971.972657 secs 2024-04-26T14:34:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:18 smithi196 ceph-mon[32572]: pgmap v5782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:34:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:18 smithi110 ceph-mon[28069]: pgmap v5782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:34:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:18 smithi193 ceph-mon[32782]: pgmap v5782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:34:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:19 smithi196 ceph-mon[32572]: pgmap v5783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:19 smithi110 ceph-mon[28069]: pgmap v5783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:19 smithi193 ceph-mon[32782]: pgmap v5783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9976.972721 secs 2024-04-26T14:34:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:22 smithi196 ceph-mon[32572]: pgmap v5784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9976.972721 secs 2024-04-26T14:34:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:22 smithi110 ceph-mon[28069]: pgmap v5784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9976.972721 secs 2024-04-26T14:34:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:22 smithi193 ceph-mon[32782]: pgmap v5784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:24 smithi196 ceph-mon[32572]: pgmap v5785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:24 smithi110 ceph-mon[28069]: pgmap v5785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:24 smithi193 ceph-mon[32782]: pgmap v5785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:26 smithi196 ceph-mon[32572]: pgmap v5786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:26 smithi110 ceph-mon[28069]: pgmap v5786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:26 smithi193 ceph-mon[32782]: pgmap v5786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9981.972837 secs 2024-04-26T14:34:28.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9981.972837 secs 2024-04-26T14:34:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9981.972837 secs 2024-04-26T14:34:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:28 smithi196 ceph-mon[32572]: pgmap v5787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:28 smithi110 ceph-mon[28069]: pgmap v5787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:28 smithi193 ceph-mon[32782]: pgmap v5787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:29 smithi196 ceph-mon[32572]: pgmap v5788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:29 smithi110 ceph-mon[28069]: pgmap v5788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:29 smithi193 ceph-mon[32782]: pgmap v5788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9986.972974 secs 2024-04-26T14:34:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:32 smithi196 ceph-mon[32572]: pgmap v5789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9986.972974 secs 2024-04-26T14:34:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:32 smithi110 ceph-mon[28069]: pgmap v5789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9986.972974 secs 2024-04-26T14:34:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:32 smithi193 ceph-mon[32782]: pgmap v5789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:34 smithi196 ceph-mon[32572]: pgmap v5790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:34 smithi110 ceph-mon[28069]: pgmap v5790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:34 smithi193 ceph-mon[32782]: pgmap v5790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:36 smithi196 ceph-mon[32572]: pgmap v5791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:36 smithi110 ceph-mon[28069]: pgmap v5791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:36 smithi193 ceph-mon[32782]: pgmap v5791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:37.944 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9991.973115 secs 2024-04-26T14:34:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9991.973115 secs 2024-04-26T14:34:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9991.973115 secs 2024-04-26T14:34:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:38 smithi196 ceph-mon[32572]: pgmap v5792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:38 smithi110 ceph-mon[28069]: pgmap v5792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:38 smithi193 ceph-mon[32782]: pgmap v5792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:39 smithi196 ceph-mon[32572]: pgmap v5793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:39 smithi110 ceph-mon[28069]: pgmap v5793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:39 smithi193 ceph-mon[32782]: pgmap v5793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 9996.973251 secs 2024-04-26T14:34:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:42 smithi196 ceph-mon[32572]: pgmap v5794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 9996.973251 secs 2024-04-26T14:34:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:42 smithi110 ceph-mon[28069]: pgmap v5794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 9996.973251 secs 2024-04-26T14:34:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:42 smithi193 ceph-mon[32782]: pgmap v5794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:44 smithi196 ceph-mon[32572]: pgmap v5795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:44 smithi110 ceph-mon[28069]: pgmap v5795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:44 smithi193 ceph-mon[32782]: pgmap v5795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:46 smithi196 ceph-mon[32572]: pgmap v5796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10001.973362 secs 2024-04-26T14:34:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:46 smithi110 ceph-mon[28069]: pgmap v5796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10001.973362 secs 2024-04-26T14:34:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:46 smithi193 ceph-mon[32782]: pgmap v5796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10001.973362 secs 2024-04-26T14:34:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:48 smithi196 ceph-mon[32572]: pgmap v5797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:48 smithi110 ceph-mon[28069]: pgmap v5797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:48 smithi193 ceph-mon[32782]: pgmap v5797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:49 smithi196 ceph-mon[32572]: pgmap v5798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:49 smithi110 ceph-mon[28069]: pgmap v5798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:49 smithi193 ceph-mon[32782]: pgmap v5798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10006.973481 secs 2024-04-26T14:34:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:52 smithi196 ceph-mon[32572]: pgmap v5799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10006.973481 secs 2024-04-26T14:34:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:52 smithi110 ceph-mon[28069]: pgmap v5799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10006.973481 secs 2024-04-26T14:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:52 smithi193 ceph-mon[32782]: pgmap v5799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:54 smithi196 ceph-mon[32572]: pgmap v5800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:54 smithi110 ceph-mon[28069]: pgmap v5800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:54 smithi193 ceph-mon[32782]: pgmap v5800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:56 smithi196 ceph-mon[32572]: pgmap v5801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:56 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10011.973621 secs 2024-04-26T14:34:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:56 smithi110 ceph-mon[28069]: pgmap v5801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:56 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10011.973621 secs 2024-04-26T14:34:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:56 smithi193 ceph-mon[32782]: pgmap v5801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:34:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:56 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10011.973621 secs 2024-04-26T14:34:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:58 smithi196 ceph-mon[32572]: pgmap v5802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:34:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:58 smithi110 ceph-mon[28069]: pgmap v5802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:34:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:58 smithi193 ceph-mon[32782]: pgmap v5802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:34:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:35:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:35:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:35:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:59 smithi196 ceph-mon[32572]: pgmap v5803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T14:35:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:59 smithi196 ceph-mon[32572]: pgmap v5804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:35:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:34:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:35:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:35:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:35:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:59 smithi110 ceph-mon[28069]: pgmap v5803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T14:35:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:59 smithi110 ceph-mon[28069]: pgmap v5804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:35:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:34:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:35:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:35:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:35:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:59 smithi193 ceph-mon[32782]: pgmap v5803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T14:35:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:59 smithi193 ceph-mon[32782]: pgmap v5804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:35:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:34:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:35:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:02 smithi196 ceph-mon[32572]: pgmap v5805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:35:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10016.973754 secs 2024-04-26T14:35:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:02 smithi110 ceph-mon[28069]: pgmap v5805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:35:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10016.973754 secs 2024-04-26T14:35:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:02 smithi193 ceph-mon[32782]: pgmap v5805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:35:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10016.973754 secs 2024-04-26T14:35:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:04 smithi196 ceph-mon[32572]: pgmap v5806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:04 smithi110 ceph-mon[28069]: pgmap v5806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:04 smithi193 ceph-mon[32782]: pgmap v5806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:06 smithi196 ceph-mon[32572]: pgmap v5807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:06 smithi110 ceph-mon[28069]: pgmap v5807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:06 smithi193 ceph-mon[32782]: pgmap v5807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10021.973851 secs 2024-04-26T14:35:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10021.973851 secs 2024-04-26T14:35:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10021.973851 secs 2024-04-26T14:35:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:08 smithi196 ceph-mon[32572]: pgmap v5808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:35:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:08 smithi110 ceph-mon[28069]: pgmap v5808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:35:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:08 smithi193 ceph-mon[32782]: pgmap v5808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:35:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:10 smithi196 ceph-mon[32572]: pgmap v5809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:10 smithi110 ceph-mon[28069]: pgmap v5809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:10 smithi193 ceph-mon[32782]: pgmap v5809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:12 smithi196 ceph-mon[32572]: pgmap v5810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:35:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10026.974005 secs 2024-04-26T14:35:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:12 smithi110 ceph-mon[28069]: pgmap v5810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:35:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10026.974005 secs 2024-04-26T14:35:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:12 smithi193 ceph-mon[32782]: pgmap v5810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:35:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10026.974005 secs 2024-04-26T14:35:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:14 smithi196 ceph-mon[32572]: pgmap v5811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:14 smithi110 ceph-mon[28069]: pgmap v5811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:14 smithi193 ceph-mon[32782]: pgmap v5811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:35:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:16 smithi196 ceph-mon[32572]: pgmap v5812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:16 smithi110 ceph-mon[28069]: pgmap v5812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:16 smithi193 ceph-mon[32782]: pgmap v5812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10031.974122 secs 2024-04-26T14:35:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10031.974122 secs 2024-04-26T14:35:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10031.974122 secs 2024-04-26T14:35:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:18 smithi196 ceph-mon[32572]: pgmap v5813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:18.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:18 smithi193 ceph-mon[32782]: pgmap v5813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:18 smithi110 ceph-mon[28069]: pgmap v5813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:20 smithi196 ceph-mon[32572]: pgmap v5814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:20 smithi110 ceph-mon[28069]: pgmap v5814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:20 smithi193 ceph-mon[32782]: pgmap v5814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:22 smithi196 ceph-mon[32572]: pgmap v5815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10036.974243 secs 2024-04-26T14:35:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:22 smithi110 ceph-mon[28069]: pgmap v5815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10036.974243 secs 2024-04-26T14:35:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:22 smithi193 ceph-mon[32782]: pgmap v5815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10036.974243 secs 2024-04-26T14:35:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:24 smithi196 ceph-mon[32572]: pgmap v5816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:24 smithi110 ceph-mon[28069]: pgmap v5816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:24 smithi193 ceph-mon[32782]: pgmap v5816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:26 smithi110 ceph-mon[28069]: pgmap v5817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:26 smithi193 ceph-mon[32782]: pgmap v5817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:26 smithi196 ceph-mon[32572]: pgmap v5817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10041.974380 secs 2024-04-26T14:35:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10041.974380 secs 2024-04-26T14:35:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10041.974380 secs 2024-04-26T14:35:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:28 smithi110 ceph-mon[28069]: pgmap v5818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:28 smithi193 ceph-mon[32782]: pgmap v5818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:28 smithi196 ceph-mon[32572]: pgmap v5818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:30 smithi110 ceph-mon[28069]: pgmap v5819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:30 smithi193 ceph-mon[32782]: pgmap v5819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:30 smithi196 ceph-mon[32572]: pgmap v5819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:32 smithi110 ceph-mon[28069]: pgmap v5820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10046.974454 secs 2024-04-26T14:35:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:32 smithi193 ceph-mon[32782]: pgmap v5820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10046.974454 secs 2024-04-26T14:35:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:32 smithi196 ceph-mon[32572]: pgmap v5820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10046.974454 secs 2024-04-26T14:35:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:34 smithi110 ceph-mon[28069]: pgmap v5821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:34 smithi193 ceph-mon[32782]: pgmap v5821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:34 smithi196 ceph-mon[32572]: pgmap v5821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:36 smithi110 ceph-mon[28069]: pgmap v5822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:36 smithi193 ceph-mon[32782]: pgmap v5822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:36 smithi196 ceph-mon[32572]: pgmap v5822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10051.974579 secs 2024-04-26T14:35:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10051.974579 secs 2024-04-26T14:35:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10051.974579 secs 2024-04-26T14:35:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:38 smithi193 ceph-mon[32782]: pgmap v5823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:38 smithi196 ceph-mon[32572]: pgmap v5823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:38 smithi110 ceph-mon[28069]: pgmap v5823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:40 smithi193 ceph-mon[32782]: pgmap v5824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:40 smithi196 ceph-mon[32572]: pgmap v5824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:40 smithi110 ceph-mon[28069]: pgmap v5824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:42 smithi193 ceph-mon[32782]: pgmap v5825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10056.974702 secs 2024-04-26T14:35:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:42 smithi196 ceph-mon[32572]: pgmap v5825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10056.974702 secs 2024-04-26T14:35:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:42 smithi110 ceph-mon[28069]: pgmap v5825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10056.974702 secs 2024-04-26T14:35:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:44 smithi193 ceph-mon[32782]: pgmap v5826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:44 smithi196 ceph-mon[32572]: pgmap v5826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:44 smithi110 ceph-mon[28069]: pgmap v5826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:46 smithi193 ceph-mon[32782]: pgmap v5827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:46 smithi196 ceph-mon[32572]: pgmap v5827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:46 smithi110 ceph-mon[28069]: pgmap v5827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10061.974805 secs 2024-04-26T14:35:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10061.974805 secs 2024-04-26T14:35:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10061.974805 secs 2024-04-26T14:35:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:48 smithi193 ceph-mon[32782]: pgmap v5828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:48 smithi196 ceph-mon[32572]: pgmap v5828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:48 smithi110 ceph-mon[28069]: pgmap v5828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:50 smithi193 ceph-mon[32782]: pgmap v5829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:50 smithi196 ceph-mon[32572]: pgmap v5829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:50 smithi110 ceph-mon[28069]: pgmap v5829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:52 smithi193 ceph-mon[32782]: pgmap v5830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10066.974911 secs 2024-04-26T14:35:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:52 smithi196 ceph-mon[32572]: pgmap v5830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10066.974911 secs 2024-04-26T14:35:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:52 smithi110 ceph-mon[28069]: pgmap v5830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10066.974911 secs 2024-04-26T14:35:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:54 smithi193 ceph-mon[32782]: pgmap v5831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:54 smithi196 ceph-mon[32572]: pgmap v5831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:54 smithi110 ceph-mon[28069]: pgmap v5831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:35:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:56 smithi193 ceph-mon[32782]: pgmap v5832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:56 smithi196 ceph-mon[32572]: pgmap v5832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:56 smithi110 ceph-mon[28069]: pgmap v5832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10071.975027 secs 2024-04-26T14:35:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10071.975027 secs 2024-04-26T14:35:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10071.975027 secs 2024-04-26T14:35:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:35:58 smithi193 ceph-mon[32782]: pgmap v5833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:35:58 smithi196 ceph-mon[32572]: pgmap v5833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:35:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:35:58 smithi110 ceph-mon[28069]: pgmap v5833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:00 smithi193 ceph-mon[32782]: pgmap v5834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:36:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:36:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:36:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:00 smithi196 ceph-mon[32572]: pgmap v5834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:36:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:36:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:36:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:00 smithi110 ceph-mon[28069]: pgmap v5834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:36:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:36:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:36:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:02 smithi196 ceph-mon[32572]: pgmap v5835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10076.975165 secs 2024-04-26T14:36:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:36:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:36:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:02 smithi196 ceph-mon[32572]: pgmap v5836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T14:36:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:02 smithi196 ceph-mon[32572]: pgmap v5837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T14:36:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:02 smithi110 ceph-mon[28069]: pgmap v5835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10076.975165 secs 2024-04-26T14:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:02 smithi110 ceph-mon[28069]: pgmap v5836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T14:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:02 smithi110 ceph-mon[28069]: pgmap v5837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T14:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:02 smithi193 ceph-mon[32782]: pgmap v5835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10076.975165 secs 2024-04-26T14:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:02 smithi193 ceph-mon[32782]: pgmap v5836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T14:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:02 smithi193 ceph-mon[32782]: pgmap v5837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T14:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:36:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:04 smithi196 ceph-mon[32572]: pgmap v5838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:04 smithi110 ceph-mon[28069]: pgmap v5838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:04 smithi193 ceph-mon[32782]: pgmap v5838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:06 smithi196 ceph-mon[32572]: pgmap v5839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:06 smithi110 ceph-mon[28069]: pgmap v5839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:06 smithi193 ceph-mon[32782]: pgmap v5839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:07.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 10081.975227 secs 2024-04-26T14:36:07.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:07 smithi110 ceph-mon[28069]: slow request 721.468713 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:36:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 10081.975227 secs 2024-04-26T14:36:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:07 smithi196 ceph-mon[32572]: slow request 721.468713 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:36:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 10081.975227 secs 2024-04-26T14:36:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:07 smithi193 ceph-mon[32782]: slow request 721.468713 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:36:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:08 smithi196 ceph-mon[32572]: pgmap v5840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:08 smithi110 ceph-mon[28069]: pgmap v5840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:08 smithi193 ceph-mon[32782]: pgmap v5840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:10 smithi196 ceph-mon[32572]: pgmap v5841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:10 smithi110 ceph-mon[28069]: pgmap v5841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:10 smithi193 ceph-mon[32782]: pgmap v5841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10086.975347 secs 2024-04-26T14:36:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:12 smithi196 ceph-mon[32572]: pgmap v5842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:36:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10086.975347 secs 2024-04-26T14:36:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:12 smithi110 ceph-mon[28069]: pgmap v5842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:36:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10086.975347 secs 2024-04-26T14:36:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:12 smithi193 ceph-mon[32782]: pgmap v5842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:36:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:14 smithi196 ceph-mon[32572]: pgmap v5843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:14 smithi110 ceph-mon[28069]: pgmap v5843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:14 smithi193 ceph-mon[32782]: pgmap v5843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:16 smithi196 ceph-mon[32572]: pgmap v5844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:16 smithi110 ceph-mon[28069]: pgmap v5844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:16 smithi193 ceph-mon[32782]: pgmap v5844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10091.975462 secs 2024-04-26T14:36:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:36:18.005+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:36:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:36:18.005+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:36:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:36:18.006+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 81 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:36:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:36:18.006+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 81 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:36:18.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10091.975462 secs 2024-04-26T14:36:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10091.975462 secs 2024-04-26T14:36:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:18 smithi196 ceph-mon[32572]: pgmap v5845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:18 smithi110 ceph-mon[28069]: pgmap v5845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:18 smithi193 ceph-mon[32782]: pgmap v5845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:20 smithi196 ceph-mon[32572]: pgmap v5846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:20 smithi110 ceph-mon[28069]: pgmap v5846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:20 smithi193 ceph-mon[32782]: pgmap v5846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10096.975607 secs 2024-04-26T14:36:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:21 smithi196 ceph-mon[32572]: pgmap v5847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10096.975607 secs 2024-04-26T14:36:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:21 smithi110 ceph-mon[28069]: pgmap v5847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10096.975607 secs 2024-04-26T14:36:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:21 smithi193 ceph-mon[32782]: pgmap v5847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:24 smithi193 ceph-mon[32782]: pgmap v5848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:24 smithi196 ceph-mon[32572]: pgmap v5848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:24 smithi110 ceph-mon[28069]: pgmap v5848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:26 smithi193 ceph-mon[32782]: pgmap v5849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:36:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:26 smithi196 ceph-mon[32572]: pgmap v5849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:36:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:26 smithi110 ceph-mon[28069]: pgmap v5849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:36:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10101.975673 secs 2024-04-26T14:36:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10101.975673 secs 2024-04-26T14:36:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10101.975673 secs 2024-04-26T14:36:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:28 smithi193 ceph-mon[32782]: pgmap v5850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:28 smithi196 ceph-mon[32572]: pgmap v5850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:28 smithi110 ceph-mon[28069]: pgmap v5850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:30 smithi193 ceph-mon[32782]: pgmap v5851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:36:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:30 smithi196 ceph-mon[32572]: pgmap v5851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:36:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:30 smithi110 ceph-mon[28069]: pgmap v5851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:36:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10106.975797 secs 2024-04-26T14:36:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:32 smithi193 ceph-mon[32782]: pgmap v5852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:36:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10106.975797 secs 2024-04-26T14:36:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:32 smithi196 ceph-mon[32572]: pgmap v5852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:36:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10106.975797 secs 2024-04-26T14:36:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:32 smithi110 ceph-mon[28069]: pgmap v5852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:36:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:34 smithi193 ceph-mon[32782]: pgmap v5853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:34 smithi196 ceph-mon[32572]: pgmap v5853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:34 smithi110 ceph-mon[28069]: pgmap v5853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:36 smithi193 ceph-mon[32782]: pgmap v5854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:36 smithi196 ceph-mon[32572]: pgmap v5854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:36 smithi110 ceph-mon[28069]: pgmap v5854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10111.975914 secs 2024-04-26T14:36:37.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10111.975914 secs 2024-04-26T14:36:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10111.975914 secs 2024-04-26T14:36:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:38 smithi193 ceph-mon[32782]: pgmap v5855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:38 smithi196 ceph-mon[32572]: pgmap v5855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:38 smithi110 ceph-mon[28069]: pgmap v5855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:40 smithi193 ceph-mon[32782]: pgmap v5856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:40 smithi196 ceph-mon[32572]: pgmap v5856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:40 smithi110 ceph-mon[28069]: pgmap v5856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10116.976053 secs 2024-04-26T14:36:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:42 smithi196 ceph-mon[32572]: pgmap v5857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10116.976053 secs 2024-04-26T14:36:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:42 smithi110 ceph-mon[28069]: pgmap v5857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10116.976053 secs 2024-04-26T14:36:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:42 smithi193 ceph-mon[32782]: pgmap v5857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:44 smithi196 ceph-mon[32572]: pgmap v5858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:44 smithi110 ceph-mon[28069]: pgmap v5858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:44 smithi193 ceph-mon[32782]: pgmap v5858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:46 smithi196 ceph-mon[32572]: pgmap v5859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:46 smithi110 ceph-mon[28069]: pgmap v5859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:46 smithi193 ceph-mon[32782]: pgmap v5859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10121.976178 secs 2024-04-26T14:36:48.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10121.976178 secs 2024-04-26T14:36:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10121.976178 secs 2024-04-26T14:36:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:48 smithi196 ceph-mon[32572]: pgmap v5860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:48 smithi110 ceph-mon[28069]: pgmap v5860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:48 smithi193 ceph-mon[32782]: pgmap v5860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:50 smithi196 ceph-mon[32572]: pgmap v5861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:50 smithi110 ceph-mon[28069]: pgmap v5861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:50 smithi193 ceph-mon[32782]: pgmap v5861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10126.976296 secs 2024-04-26T14:36:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:52 smithi196 ceph-mon[32572]: pgmap v5862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10126.976296 secs 2024-04-26T14:36:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:52 smithi110 ceph-mon[28069]: pgmap v5862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10126.976296 secs 2024-04-26T14:36:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:52 smithi193 ceph-mon[32782]: pgmap v5862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:54 smithi196 ceph-mon[32572]: pgmap v5863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:54 smithi110 ceph-mon[28069]: pgmap v5863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:54 smithi193 ceph-mon[32782]: pgmap v5863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:56 smithi196 ceph-mon[32572]: pgmap v5864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:56 smithi110 ceph-mon[28069]: pgmap v5864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:56 smithi193 ceph-mon[32782]: pgmap v5864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:36:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10131.976414 secs 2024-04-26T14:36:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10131.976414 secs 2024-04-26T14:36:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10131.976414 secs 2024-04-26T14:36:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:36:58 smithi196 ceph-mon[32572]: pgmap v5865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:36:58 smithi110 ceph-mon[28069]: pgmap v5865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:36:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:36:58 smithi193 ceph-mon[32782]: pgmap v5865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:00 smithi196 ceph-mon[32572]: pgmap v5866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:00 smithi110 ceph-mon[28069]: pgmap v5866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:00 smithi193 ceph-mon[32782]: pgmap v5866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10136.976532 secs 2024-04-26T14:37:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:02 smithi196 ceph-mon[32572]: pgmap v5867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:37:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10136.976532 secs 2024-04-26T14:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:02 smithi110 ceph-mon[28069]: pgmap v5867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10136.976532 secs 2024-04-26T14:37:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:02 smithi193 ceph-mon[32782]: pgmap v5867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:37:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:37:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:37:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:37:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:37:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:37:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:37:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:37:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:04 smithi196 ceph-mon[32572]: pgmap v5868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:37:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:04 smithi196 ceph-mon[32572]: pgmap v5869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:04 smithi110 ceph-mon[28069]: pgmap v5868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:37:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:04 smithi110 ceph-mon[28069]: pgmap v5869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:04 smithi193 ceph-mon[32782]: pgmap v5868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:37:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:04 smithi193 ceph-mon[32782]: pgmap v5869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:06 smithi196 ceph-mon[32572]: pgmap v5870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:06 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10141.976681 secs 2024-04-26T14:37:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:06 smithi110 ceph-mon[28069]: pgmap v5870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:06 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10141.976681 secs 2024-04-26T14:37:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:06 smithi193 ceph-mon[32782]: pgmap v5870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:06 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10141.976681 secs 2024-04-26T14:37:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:08 smithi196 ceph-mon[32572]: pgmap v5871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T14:37:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:08 smithi110 ceph-mon[28069]: pgmap v5871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T14:37:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:08 smithi193 ceph-mon[32782]: pgmap v5871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T14:37:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:10 smithi196 ceph-mon[32572]: pgmap v5872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:10 smithi110 ceph-mon[28069]: pgmap v5872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:10 smithi193 ceph-mon[32782]: pgmap v5872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10146.976795 secs 2024-04-26T14:37:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10146.976795 secs 2024-04-26T14:37:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10146.976795 secs 2024-04-26T14:37:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:12 smithi196 ceph-mon[32572]: pgmap v5873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:12 smithi110 ceph-mon[28069]: pgmap v5873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:12 smithi193 ceph-mon[32782]: pgmap v5873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:37:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:13 smithi196 ceph-mon[32572]: pgmap v5874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:37:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:13 smithi110 ceph-mon[28069]: pgmap v5874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:37:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:13 smithi193 ceph-mon[32782]: pgmap v5874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:37:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:16 smithi196 ceph-mon[32572]: pgmap v5875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:16 smithi110 ceph-mon[28069]: pgmap v5875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:16 smithi193 ceph-mon[32782]: pgmap v5875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10151.976894 secs 2024-04-26T14:37:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10151.976894 secs 2024-04-26T14:37:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10151.976894 secs 2024-04-26T14:37:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:18 smithi196 ceph-mon[32572]: pgmap v5876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:18.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:18 smithi193 ceph-mon[32782]: pgmap v5876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:18 smithi110 ceph-mon[28069]: pgmap v5876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:20 smithi196 ceph-mon[32572]: pgmap v5877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:20 smithi110 ceph-mon[28069]: pgmap v5877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:20 smithi193 ceph-mon[32782]: pgmap v5877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:22 smithi110 ceph-mon[28069]: pgmap v5878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10156.977046 secs 2024-04-26T14:37:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:22 smithi193 ceph-mon[32782]: pgmap v5878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10156.977046 secs 2024-04-26T14:37:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:22 smithi196 ceph-mon[32572]: pgmap v5878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10156.977046 secs 2024-04-26T14:37:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:24 smithi110 ceph-mon[28069]: pgmap v5879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:24.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:24 smithi196 ceph-mon[32572]: pgmap v5879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:24 smithi193 ceph-mon[32782]: pgmap v5879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:26 smithi110 ceph-mon[28069]: pgmap v5880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:26 smithi193 ceph-mon[32782]: pgmap v5880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:26 smithi196 ceph-mon[32572]: pgmap v5880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10161.977129 secs 2024-04-26T14:37:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10161.977129 secs 2024-04-26T14:37:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10161.977129 secs 2024-04-26T14:37:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:28 smithi110 ceph-mon[28069]: pgmap v5881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:28 smithi193 ceph-mon[32782]: pgmap v5881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:28 smithi196 ceph-mon[32572]: pgmap v5881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:30 smithi110 ceph-mon[28069]: pgmap v5882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:30 smithi193 ceph-mon[32782]: pgmap v5882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:30 smithi196 ceph-mon[32572]: pgmap v5882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:32 smithi193 ceph-mon[32782]: pgmap v5883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10166.977268 secs 2024-04-26T14:37:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:32 smithi196 ceph-mon[32572]: pgmap v5883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10166.977268 secs 2024-04-26T14:37:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:32 smithi110 ceph-mon[28069]: pgmap v5883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10166.977268 secs 2024-04-26T14:37:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:34 smithi193 ceph-mon[32782]: pgmap v5884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:34 smithi196 ceph-mon[32572]: pgmap v5884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:34 smithi110 ceph-mon[28069]: pgmap v5884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:36 smithi193 ceph-mon[32782]: pgmap v5885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:36 smithi196 ceph-mon[32572]: pgmap v5885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:36 smithi110 ceph-mon[28069]: pgmap v5885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10171.977397 secs 2024-04-26T14:37:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10171.977397 secs 2024-04-26T14:37:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10171.977397 secs 2024-04-26T14:37:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:38 smithi193 ceph-mon[32782]: pgmap v5886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:38.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:38 smithi110 ceph-mon[28069]: pgmap v5886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:38 smithi196 ceph-mon[32572]: pgmap v5886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:40 smithi193 ceph-mon[32782]: pgmap v5887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:40 smithi196 ceph-mon[32572]: pgmap v5887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:40 smithi110 ceph-mon[28069]: pgmap v5887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:42 smithi193 ceph-mon[32782]: pgmap v5888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10176.977524 secs 2024-04-26T14:37:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:42 smithi196 ceph-mon[32572]: pgmap v5888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10176.977524 secs 2024-04-26T14:37:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:42 smithi110 ceph-mon[28069]: pgmap v5888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10176.977524 secs 2024-04-26T14:37:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:44 smithi193 ceph-mon[32782]: pgmap v5889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:44 smithi196 ceph-mon[32572]: pgmap v5889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:44 smithi110 ceph-mon[28069]: pgmap v5889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:46 smithi193 ceph-mon[32782]: pgmap v5890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:46 smithi196 ceph-mon[32572]: pgmap v5890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:46 smithi110 ceph-mon[28069]: pgmap v5890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10181.977584 secs 2024-04-26T14:37:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10181.977584 secs 2024-04-26T14:37:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10181.977584 secs 2024-04-26T14:37:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:48 smithi193 ceph-mon[32782]: pgmap v5891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:48 smithi196 ceph-mon[32572]: pgmap v5891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:48 smithi110 ceph-mon[28069]: pgmap v5891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:50 smithi193 ceph-mon[32782]: pgmap v5892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:50 smithi196 ceph-mon[32572]: pgmap v5892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:50 smithi110 ceph-mon[28069]: pgmap v5892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:52 smithi193 ceph-mon[32782]: pgmap v5893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10186.977689 secs 2024-04-26T14:37:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:52 smithi196 ceph-mon[32572]: pgmap v5893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10186.977689 secs 2024-04-26T14:37:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:52 smithi110 ceph-mon[28069]: pgmap v5893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10186.977689 secs 2024-04-26T14:37:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:54 smithi196 ceph-mon[32572]: pgmap v5894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:54 smithi110 ceph-mon[28069]: pgmap v5894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:54 smithi193 ceph-mon[32782]: pgmap v5894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:37:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:56 smithi196 ceph-mon[32572]: pgmap v5895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:56 smithi110 ceph-mon[28069]: pgmap v5895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:56 smithi193 ceph-mon[32782]: pgmap v5895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10191.977831 secs 2024-04-26T14:37:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10191.977831 secs 2024-04-26T14:37:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10191.977831 secs 2024-04-26T14:37:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:37:58 smithi196 ceph-mon[32572]: pgmap v5896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:37:58 smithi110 ceph-mon[28069]: pgmap v5896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:37:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:37:58 smithi193 ceph-mon[32782]: pgmap v5896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:00 smithi196 ceph-mon[32572]: pgmap v5897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:00 smithi110 ceph-mon[28069]: pgmap v5897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:00 smithi193 ceph-mon[32782]: pgmap v5897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:02 smithi196 ceph-mon[32572]: pgmap v5898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10196.977917 secs 2024-04-26T14:38:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:02 smithi110 ceph-mon[28069]: pgmap v5898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10196.977917 secs 2024-04-26T14:38:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:02 smithi193 ceph-mon[32782]: pgmap v5898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10196.977917 secs 2024-04-26T14:38:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:38:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:38:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:38:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:04 smithi196 ceph-mon[32572]: pgmap v5899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:04 smithi110 ceph-mon[28069]: pgmap v5899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:04 smithi193 ceph-mon[32782]: pgmap v5899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: pgmap v5900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: pgmap v5900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: pgmap v5900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:38:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:38:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 10201.978042 secs 2024-04-26T14:38:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: slow request 1441.791002 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:38:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:38:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:38:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 10201.978042 secs 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: slow request 1441.791002 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 10201.978042 secs 2024-04-26T14:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: slow request 1441.791002 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:38:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:38:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:08 smithi110 ceph-mon[28069]: pgmap v5901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:08 smithi193 ceph-mon[32782]: pgmap v5901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:08 smithi196 ceph-mon[32572]: pgmap v5901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:38:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:38:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:38:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:38:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: pgmap v5902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:38:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: pgmap v5903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: pgmap v5902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: pgmap v5903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:38:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:38:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:38:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:38:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:38:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: pgmap v5902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:38:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: pgmap v5903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:38:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:11 smithi196 ceph-mon[32572]: pgmap v5904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10206.978117 secs 2024-04-26T14:38:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:11 smithi110 ceph-mon[28069]: pgmap v5904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10206.978117 secs 2024-04-26T14:38:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:11 smithi193 ceph-mon[32782]: pgmap v5904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10206.978117 secs 2024-04-26T14:38:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:12 smithi196 ceph-mon[32572]: pgmap v5905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:12 smithi110 ceph-mon[28069]: pgmap v5905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:12 smithi193 ceph-mon[32782]: pgmap v5905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:15 smithi196 ceph-mon[32572]: pgmap v5906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:15 smithi110 ceph-mon[28069]: pgmap v5906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:15 smithi193 ceph-mon[32782]: pgmap v5906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10211.978249 secs 2024-04-26T14:38:17.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:16 smithi196 ceph-mon[32572]: pgmap v5907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10211.978249 secs 2024-04-26T14:38:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:16 smithi110 ceph-mon[28069]: pgmap v5907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10211.978249 secs 2024-04-26T14:38:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:16 smithi193 ceph-mon[32782]: pgmap v5907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:38:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:18 smithi110 ceph-mon[28069]: pgmap v5908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:38:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:18 smithi193 ceph-mon[32782]: pgmap v5908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:38:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:18 smithi196 ceph-mon[32572]: pgmap v5908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:38:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:20 smithi110 ceph-mon[28069]: pgmap v5909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:20 smithi193 ceph-mon[32782]: pgmap v5909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:20 smithi196 ceph-mon[32572]: pgmap v5909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10216.978365 secs 2024-04-26T14:38:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10216.978365 secs 2024-04-26T14:38:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10216.978365 secs 2024-04-26T14:38:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:22 smithi193 ceph-mon[32782]: pgmap v5910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:22 smithi196 ceph-mon[32572]: pgmap v5910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:22 smithi110 ceph-mon[28069]: pgmap v5910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:24 smithi110 ceph-mon[28069]: pgmap v5911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:25.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:24 smithi196 ceph-mon[32572]: pgmap v5911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:24 smithi193 ceph-mon[32782]: pgmap v5911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:26 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10221.978439 secs 2024-04-26T14:38:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:26 smithi110 ceph-mon[28069]: pgmap v5912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:26 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10221.978439 secs 2024-04-26T14:38:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:26 smithi193 ceph-mon[32782]: pgmap v5912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:26 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10221.978439 secs 2024-04-26T14:38:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:26 smithi196 ceph-mon[32572]: pgmap v5912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:28 smithi193 ceph-mon[32782]: pgmap v5913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:28 smithi196 ceph-mon[32572]: pgmap v5913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:28 smithi110 ceph-mon[28069]: pgmap v5913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:30 smithi193 ceph-mon[32782]: pgmap v5914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:30 smithi196 ceph-mon[32572]: pgmap v5914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:30 smithi110 ceph-mon[28069]: pgmap v5914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:31 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10226.978539 secs 2024-04-26T14:38:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:31 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10226.978539 secs 2024-04-26T14:38:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:31 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10226.978539 secs 2024-04-26T14:38:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:32 smithi193 ceph-mon[32782]: pgmap v5915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:32 smithi196 ceph-mon[32572]: pgmap v5915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:32 smithi110 ceph-mon[28069]: pgmap v5915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:34 smithi193 ceph-mon[32782]: pgmap v5916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:34 smithi196 ceph-mon[32572]: pgmap v5916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:34 smithi110 ceph-mon[28069]: pgmap v5916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:36 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10231.978657 secs 2024-04-26T14:38:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:36 smithi110 ceph-mon[28069]: pgmap v5917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:36 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10231.978657 secs 2024-04-26T14:38:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:36 smithi193 ceph-mon[32782]: pgmap v5917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:36 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10231.978657 secs 2024-04-26T14:38:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:36 smithi196 ceph-mon[32572]: pgmap v5917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:38 smithi193 ceph-mon[32782]: pgmap v5918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:38 smithi196 ceph-mon[32572]: pgmap v5918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:38 smithi110 ceph-mon[28069]: pgmap v5918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:40 smithi193 ceph-mon[32782]: pgmap v5919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:40 smithi196 ceph-mon[32572]: pgmap v5919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:40 smithi110 ceph-mon[28069]: pgmap v5919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10236.978771 secs 2024-04-26T14:38:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10236.978771 secs 2024-04-26T14:38:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10236.978771 secs 2024-04-26T14:38:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:42 smithi193 ceph-mon[32782]: pgmap v5920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:42 smithi196 ceph-mon[32572]: pgmap v5920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:42 smithi110 ceph-mon[28069]: pgmap v5920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:44 smithi193 ceph-mon[32782]: pgmap v5921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:44 smithi196 ceph-mon[32572]: pgmap v5921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:44 smithi110 ceph-mon[28069]: pgmap v5921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10241.978884 secs 2024-04-26T14:38:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:46 smithi110 ceph-mon[28069]: pgmap v5922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10241.978884 secs 2024-04-26T14:38:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:46 smithi193 ceph-mon[32782]: pgmap v5922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10241.978884 secs 2024-04-26T14:38:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:46 smithi196 ceph-mon[32572]: pgmap v5922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:49 smithi196 ceph-mon[32572]: pgmap v5923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:49 smithi110 ceph-mon[28069]: pgmap v5923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:49 smithi193 ceph-mon[32782]: pgmap v5923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:51 smithi196 ceph-mon[32572]: pgmap v5924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:51 smithi110 ceph-mon[28069]: pgmap v5924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:51 smithi193 ceph-mon[32782]: pgmap v5924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10246.978958 secs 2024-04-26T14:38:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10246.978958 secs 2024-04-26T14:38:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10246.978958 secs 2024-04-26T14:38:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:53 smithi196 ceph-mon[32572]: pgmap v5925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:53 smithi110 ceph-mon[28069]: pgmap v5925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:53 smithi193 ceph-mon[32782]: pgmap v5925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:55 smithi196 ceph-mon[32572]: pgmap v5926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:55 smithi110 ceph-mon[28069]: pgmap v5926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:55 smithi193 ceph-mon[32782]: pgmap v5926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:56 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10251.979077 secs 2024-04-26T14:38:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:56 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10251.979077 secs 2024-04-26T14:38:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:56 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10251.979077 secs 2024-04-26T14:38:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:57 smithi196 ceph-mon[32572]: pgmap v5927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:57 smithi110 ceph-mon[28069]: pgmap v5927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:57 smithi193 ceph-mon[32782]: pgmap v5927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:38:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:38:58 smithi110 ceph-mon[28069]: pgmap v5928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:38:58 smithi193 ceph-mon[32782]: pgmap v5928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:38:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:38:58 smithi196 ceph-mon[32572]: pgmap v5928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:00 smithi193 ceph-mon[32782]: pgmap v5929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:00 smithi196 ceph-mon[32572]: pgmap v5929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:00 smithi110 ceph-mon[28069]: pgmap v5929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:01 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10256.979198 secs 2024-04-26T14:39:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:01 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10256.979198 secs 2024-04-26T14:39:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:01 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10256.979198 secs 2024-04-26T14:39:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:02 smithi193 ceph-mon[32782]: pgmap v5930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:02 smithi196 ceph-mon[32572]: pgmap v5930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:02 smithi110 ceph-mon[28069]: pgmap v5930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:04 smithi193 ceph-mon[32782]: pgmap v5931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:05.150 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:04 smithi110 ceph-mon[28069]: pgmap v5931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:04 smithi196 ceph-mon[32572]: pgmap v5931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:39:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:39:05.149+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:39:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:39:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:39:05.149+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:39:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:39:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:39:05.149+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:39:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:39:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:39:05.149+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:39:05.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:39:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:39:05.149+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:39:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:06 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10261.979330 secs 2024-04-26T14:39:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:06 smithi110 ceph-mon[28069]: pgmap v5932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:06 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10261.979330 secs 2024-04-26T14:39:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:06 smithi193 ceph-mon[32782]: pgmap v5932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:06 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10261.979330 secs 2024-04-26T14:39:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:06 smithi196 ceph-mon[32572]: pgmap v5932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:08 smithi193 ceph-mon[32782]: pgmap v5933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:08 smithi196 ceph-mon[32572]: pgmap v5933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:08 smithi110 ceph-mon[28069]: pgmap v5933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:39:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:39:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:39:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:39:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:39:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:10 smithi193 ceph-mon[32782]: pgmap v5934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T14:39:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:10 smithi193 ceph-mon[32782]: pgmap v5935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:39:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:39:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:39:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:10 smithi196 ceph-mon[32572]: pgmap v5934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T14:39:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:10 smithi196 ceph-mon[32572]: pgmap v5935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:39:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:39:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:39:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:10 smithi110 ceph-mon[28069]: pgmap v5934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T14:39:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:10 smithi110 ceph-mon[28069]: pgmap v5935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:39:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10266.979447 secs 2024-04-26T14:39:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10266.979447 secs 2024-04-26T14:39:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10266.979447 secs 2024-04-26T14:39:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:12 smithi193 ceph-mon[32782]: pgmap v5936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:12 smithi196 ceph-mon[32572]: pgmap v5936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:12 smithi110 ceph-mon[28069]: pgmap v5936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:15 smithi193 ceph-mon[32782]: pgmap v5937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:15 smithi196 ceph-mon[32572]: pgmap v5937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:15 smithi110 ceph-mon[28069]: pgmap v5937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10271.979557 secs 2024-04-26T14:39:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:17 smithi196 ceph-mon[32572]: pgmap v5938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10271.979557 secs 2024-04-26T14:39:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:17 smithi110 ceph-mon[28069]: pgmap v5938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10271.979557 secs 2024-04-26T14:39:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:17 smithi193 ceph-mon[32782]: pgmap v5938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:39:18.036+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:39:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:39:18.036+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:39:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:39:18.037+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 82 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:39:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:39:18.037+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 82 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:39:19.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:19 smithi193 ceph-mon[32782]: pgmap v5939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:19 smithi196 ceph-mon[32572]: pgmap v5939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:19 smithi110 ceph-mon[28069]: pgmap v5939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:39:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:21 smithi196 ceph-mon[32572]: pgmap v5940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:39:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:21 smithi110 ceph-mon[28069]: pgmap v5940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:39:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:21 smithi193 ceph-mon[32782]: pgmap v5940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:39:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10276.979672 secs 2024-04-26T14:39:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10276.979672 secs 2024-04-26T14:39:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10276.979672 secs 2024-04-26T14:39:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:23 smithi196 ceph-mon[32572]: pgmap v5941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:23 smithi110 ceph-mon[28069]: pgmap v5941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:23 smithi193 ceph-mon[32782]: pgmap v5941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:25 smithi196 ceph-mon[32572]: pgmap v5942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:25 smithi110 ceph-mon[28069]: pgmap v5942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:25 smithi193 ceph-mon[32782]: pgmap v5942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10281.979795 secs 2024-04-26T14:39:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:27 smithi196 ceph-mon[32572]: pgmap v5943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10281.979795 secs 2024-04-26T14:39:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:27 smithi110 ceph-mon[28069]: pgmap v5943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10281.979795 secs 2024-04-26T14:39:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:27 smithi193 ceph-mon[32782]: pgmap v5943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:29 smithi196 ceph-mon[32572]: pgmap v5944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:29 smithi110 ceph-mon[28069]: pgmap v5944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:29.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:29 smithi193 ceph-mon[32782]: pgmap v5944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:31 smithi196 ceph-mon[32572]: pgmap v5945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:31 smithi110 ceph-mon[28069]: pgmap v5945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:31 smithi193 ceph-mon[32782]: pgmap v5945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10286.979912 secs 2024-04-26T14:39:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10286.979912 secs 2024-04-26T14:39:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10286.979912 secs 2024-04-26T14:39:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:33 smithi196 ceph-mon[32572]: pgmap v5946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:33 smithi110 ceph-mon[28069]: pgmap v5946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:33 smithi193 ceph-mon[32782]: pgmap v5946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:35 smithi196 ceph-mon[32572]: pgmap v5947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:35 smithi110 ceph-mon[28069]: pgmap v5947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:35 smithi193 ceph-mon[32782]: pgmap v5947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10291.979985 secs 2024-04-26T14:39:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:37 smithi196 ceph-mon[32572]: pgmap v5948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10291.979985 secs 2024-04-26T14:39:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:37 smithi110 ceph-mon[28069]: pgmap v5948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10291.979985 secs 2024-04-26T14:39:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:37 smithi193 ceph-mon[32782]: pgmap v5948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:39 smithi196 ceph-mon[32572]: pgmap v5949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:39 smithi110 ceph-mon[28069]: pgmap v5949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:39 smithi193 ceph-mon[32782]: pgmap v5949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:41.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:41 smithi196 ceph-mon[32572]: pgmap v5950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:41 smithi110 ceph-mon[28069]: pgmap v5950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:41 smithi193 ceph-mon[32782]: pgmap v5950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10296.980105 secs 2024-04-26T14:39:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10296.980105 secs 2024-04-26T14:39:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10296.980105 secs 2024-04-26T14:39:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:43 smithi196 ceph-mon[32572]: pgmap v5951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:43 smithi110 ceph-mon[28069]: pgmap v5951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:43 smithi193 ceph-mon[32782]: pgmap v5951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:45 smithi196 ceph-mon[32572]: pgmap v5952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:45 smithi110 ceph-mon[28069]: pgmap v5952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:45 smithi193 ceph-mon[32782]: pgmap v5952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10301.980206 secs 2024-04-26T14:39:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10301.980206 secs 2024-04-26T14:39:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10301.980206 secs 2024-04-26T14:39:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:47 smithi196 ceph-mon[32572]: pgmap v5953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:47 smithi110 ceph-mon[28069]: pgmap v5953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:47 smithi193 ceph-mon[32782]: pgmap v5953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:49 smithi196 ceph-mon[32572]: pgmap v5954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:49 smithi110 ceph-mon[28069]: pgmap v5954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:49 smithi193 ceph-mon[32782]: pgmap v5954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:50 smithi193 ceph-mon[32782]: pgmap v5955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:50 smithi196 ceph-mon[32572]: pgmap v5955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:50 smithi110 ceph-mon[28069]: pgmap v5955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:51 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10306.980350 secs 2024-04-26T14:39:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:51 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10306.980350 secs 2024-04-26T14:39:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:51 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10306.980350 secs 2024-04-26T14:39:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:52 smithi193 ceph-mon[32782]: pgmap v5956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:52 smithi196 ceph-mon[32572]: pgmap v5956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:52 smithi110 ceph-mon[28069]: pgmap v5956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:55 smithi196 ceph-mon[32572]: pgmap v5957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:55 smithi110 ceph-mon[28069]: pgmap v5957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:55 smithi193 ceph-mon[32782]: pgmap v5957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10311.980465 secs 2024-04-26T14:39:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:57 smithi196 ceph-mon[32572]: pgmap v5958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10311.980465 secs 2024-04-26T14:39:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:57 smithi110 ceph-mon[28069]: pgmap v5958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10311.980465 secs 2024-04-26T14:39:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:57 smithi193 ceph-mon[32782]: pgmap v5958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:39:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:39:59 smithi196 ceph-mon[32572]: pgmap v5959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:39:59 smithi110 ceph-mon[28069]: pgmap v5959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:39:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:39:59 smithi193 ceph-mon[32782]: pgmap v5959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:40:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:40:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:40:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:01 smithi196 ceph-mon[32572]: pgmap v5960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:01 smithi110 ceph-mon[28069]: pgmap v5960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:01 smithi193 ceph-mon[32782]: pgmap v5960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10316.980588 secs 2024-04-26T14:40:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10316.980588 secs 2024-04-26T14:40:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10316.980588 secs 2024-04-26T14:40:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:03 smithi196 ceph-mon[32572]: pgmap v5961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:03 smithi110 ceph-mon[28069]: pgmap v5961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:03 smithi193 ceph-mon[32782]: pgmap v5961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:05 smithi196 ceph-mon[32572]: pgmap v5962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:05 smithi110 ceph-mon[28069]: pgmap v5962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:05 smithi193 ceph-mon[32782]: pgmap v5962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 10321.980704 secs 2024-04-26T14:40:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:07 smithi196 ceph-mon[32572]: slow request 5763.808303 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:40:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:07 smithi196 ceph-mon[32572]: pgmap v5963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 10321.980704 secs 2024-04-26T14:40:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:07 smithi110 ceph-mon[28069]: slow request 5763.808303 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:40:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:07 smithi110 ceph-mon[28069]: pgmap v5963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 10321.980704 secs 2024-04-26T14:40:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:07 smithi193 ceph-mon[32782]: slow request 5763.808303 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:40:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:07 smithi193 ceph-mon[32782]: pgmap v5963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:09 smithi196 ceph-mon[32572]: pgmap v5964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:09 smithi110 ceph-mon[28069]: pgmap v5964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:09 smithi193 ceph-mon[32782]: pgmap v5964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:11 smithi110 ceph-mon[28069]: pgmap v5965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:40:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:11 smithi196 ceph-mon[32572]: pgmap v5965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:40:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:11 smithi193 ceph-mon[32782]: pgmap v5965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:40:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10326.980807 secs 2024-04-26T14:40:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:40:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:40:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:40:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10326.980807 secs 2024-04-26T14:40:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:40:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:40:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:40:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10326.980807 secs 2024-04-26T14:40:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:40:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:40:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:40:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:13 smithi196 ceph-mon[32572]: pgmap v5966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T14:40:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:13 smithi196 ceph-mon[32572]: pgmap v5967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T14:40:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:13 smithi110 ceph-mon[28069]: pgmap v5966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T14:40:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:13 smithi110 ceph-mon[28069]: pgmap v5967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T14:40:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:13 smithi193 ceph-mon[32782]: pgmap v5966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T14:40:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:13 smithi193 ceph-mon[32782]: pgmap v5967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T14:40:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:15 smithi196 ceph-mon[32572]: pgmap v5968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:15 smithi110 ceph-mon[28069]: pgmap v5968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:15 smithi193 ceph-mon[32782]: pgmap v5968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:17 smithi196 ceph-mon[32572]: pgmap v5969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10331.980929 secs 2024-04-26T14:40:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:17 smithi110 ceph-mon[28069]: pgmap v5969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10331.980929 secs 2024-04-26T14:40:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:17 smithi193 ceph-mon[32782]: pgmap v5969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10331.980929 secs 2024-04-26T14:40:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:19 smithi196 ceph-mon[32572]: pgmap v5970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:19 smithi110 ceph-mon[28069]: pgmap v5970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:19 smithi193 ceph-mon[32782]: pgmap v5970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:21 smithi196 ceph-mon[32572]: pgmap v5971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:21 smithi110 ceph-mon[28069]: pgmap v5971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:21 smithi193 ceph-mon[32782]: pgmap v5971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:40:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10336.981042 secs 2024-04-26T14:40:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10336.981042 secs 2024-04-26T14:40:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10336.981042 secs 2024-04-26T14:40:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:23 smithi196 ceph-mon[32572]: pgmap v5972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:40:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:23 smithi110 ceph-mon[28069]: pgmap v5972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:40:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:23 smithi193 ceph-mon[32782]: pgmap v5972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:40:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:25 smithi196 ceph-mon[32572]: pgmap v5973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:25 smithi110 ceph-mon[28069]: pgmap v5973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:25 smithi193 ceph-mon[32782]: pgmap v5973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:27 smithi196 ceph-mon[32572]: pgmap v5974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10341.981173 secs 2024-04-26T14:40:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:27 smithi110 ceph-mon[28069]: pgmap v5974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10341.981173 secs 2024-04-26T14:40:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:27 smithi193 ceph-mon[32782]: pgmap v5974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10341.981173 secs 2024-04-26T14:40:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:29 smithi196 ceph-mon[32572]: pgmap v5975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:29 smithi110 ceph-mon[28069]: pgmap v5975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:29 smithi193 ceph-mon[32782]: pgmap v5975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:31 smithi110 ceph-mon[28069]: pgmap v5976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:31 smithi193 ceph-mon[32782]: pgmap v5976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:31 smithi196 ceph-mon[32572]: pgmap v5976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10346.981289 secs 2024-04-26T14:40:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10346.981289 secs 2024-04-26T14:40:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10346.981289 secs 2024-04-26T14:40:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:33 smithi110 ceph-mon[28069]: pgmap v5977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:33 smithi193 ceph-mon[32782]: pgmap v5977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:33 smithi196 ceph-mon[32572]: pgmap v5977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:35.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:35 smithi110 ceph-mon[28069]: pgmap v5978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:35 smithi193 ceph-mon[32782]: pgmap v5978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:35 smithi196 ceph-mon[32572]: pgmap v5978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:37 smithi110 ceph-mon[28069]: pgmap v5979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10351.981424 secs 2024-04-26T14:40:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:37 smithi193 ceph-mon[32782]: pgmap v5979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10351.981424 secs 2024-04-26T14:40:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:37 smithi196 ceph-mon[32572]: pgmap v5979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10351.981424 secs 2024-04-26T14:40:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:39 smithi110 ceph-mon[28069]: pgmap v5980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:39 smithi193 ceph-mon[32782]: pgmap v5980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:39 smithi196 ceph-mon[32572]: pgmap v5980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:41 smithi193 ceph-mon[32782]: pgmap v5981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:41 smithi196 ceph-mon[32572]: pgmap v5981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:41 smithi110 ceph-mon[28069]: pgmap v5981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10356.981558 secs 2024-04-26T14:40:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10356.981558 secs 2024-04-26T14:40:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10356.981558 secs 2024-04-26T14:40:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:43 smithi193 ceph-mon[32782]: pgmap v5982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:43 smithi196 ceph-mon[32572]: pgmap v5982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:43 smithi110 ceph-mon[28069]: pgmap v5982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:45 smithi193 ceph-mon[32782]: pgmap v5983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:45 smithi196 ceph-mon[32572]: pgmap v5983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:45 smithi110 ceph-mon[28069]: pgmap v5983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:47 smithi193 ceph-mon[32782]: pgmap v5984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10361.981673 secs 2024-04-26T14:40:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:47 smithi196 ceph-mon[32572]: pgmap v5984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10361.981673 secs 2024-04-26T14:40:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:47 smithi110 ceph-mon[28069]: pgmap v5984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10361.981673 secs 2024-04-26T14:40:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:49 smithi193 ceph-mon[32782]: pgmap v5985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:49 smithi196 ceph-mon[32572]: pgmap v5985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:49 smithi110 ceph-mon[28069]: pgmap v5985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:51 smithi193 ceph-mon[32782]: pgmap v5986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:51 smithi196 ceph-mon[32572]: pgmap v5986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:52.051 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:51 smithi110 ceph-mon[28069]: pgmap v5986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10366.981793 secs 2024-04-26T14:40:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10366.981793 secs 2024-04-26T14:40:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10366.981793 secs 2024-04-26T14:40:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:53 smithi193 ceph-mon[32782]: pgmap v5987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:53 smithi196 ceph-mon[32572]: pgmap v5987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:53 smithi110 ceph-mon[28069]: pgmap v5987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:55 smithi193 ceph-mon[32782]: pgmap v5988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:55 smithi196 ceph-mon[32572]: pgmap v5988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:55 smithi110 ceph-mon[28069]: pgmap v5988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:40:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:57 smithi193 ceph-mon[32782]: pgmap v5989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10371.981875 secs 2024-04-26T14:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:57 smithi196 ceph-mon[32572]: pgmap v5989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10371.981875 secs 2024-04-26T14:40:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:57 smithi110 ceph-mon[28069]: pgmap v5989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:40:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10371.981875 secs 2024-04-26T14:40:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:40:59 smithi193 ceph-mon[32782]: pgmap v5990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:40:59 smithi196 ceph-mon[32572]: pgmap v5990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:40:59 smithi110 ceph-mon[28069]: pgmap v5990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:01 smithi193 ceph-mon[32782]: pgmap v5991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:01 smithi196 ceph-mon[32572]: pgmap v5991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:01 smithi110 ceph-mon[28069]: pgmap v5991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10376.982013 secs 2024-04-26T14:41:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10376.982013 secs 2024-04-26T14:41:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10376.982013 secs 2024-04-26T14:41:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:03 smithi193 ceph-mon[32782]: pgmap v5992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:03 smithi196 ceph-mon[32572]: pgmap v5992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:03 smithi110 ceph-mon[28069]: pgmap v5992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:05 smithi196 ceph-mon[32572]: pgmap v5993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:05 smithi110 ceph-mon[28069]: pgmap v5993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:05 smithi193 ceph-mon[32782]: pgmap v5993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:07 smithi196 ceph-mon[32572]: pgmap v5994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10381.982127 secs 2024-04-26T14:41:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:07 smithi110 ceph-mon[28069]: pgmap v5994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10381.982127 secs 2024-04-26T14:41:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:07 smithi193 ceph-mon[32782]: pgmap v5994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10381.982127 secs 2024-04-26T14:41:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:09 smithi196 ceph-mon[32572]: pgmap v5995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:09 smithi110 ceph-mon[28069]: pgmap v5995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:09 smithi193 ceph-mon[32782]: pgmap v5995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:11 smithi196 ceph-mon[32572]: pgmap v5996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:11 smithi110 ceph-mon[28069]: pgmap v5996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:11 smithi193 ceph-mon[32782]: pgmap v5996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10386.982245 secs 2024-04-26T14:41:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:41:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10386.982245 secs 2024-04-26T14:41:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:41:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10386.982245 secs 2024-04-26T14:41:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:41:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:13 smithi196 ceph-mon[32572]: pgmap v5997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:41:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:41:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:41:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:13 smithi110 ceph-mon[28069]: pgmap v5997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:41:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:41:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:41:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:13 smithi193 ceph-mon[32782]: pgmap v5997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:41:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:41:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:41:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:14 smithi196 ceph-mon[32572]: pgmap v5998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:41:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:14 smithi196 ceph-mon[32572]: pgmap v5999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:14 smithi110 ceph-mon[28069]: pgmap v5998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:41:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:14 smithi110 ceph-mon[28069]: pgmap v5999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:14 smithi193 ceph-mon[32782]: pgmap v5998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:41:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:14 smithi193 ceph-mon[32782]: pgmap v5999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:16 smithi196 ceph-mon[32572]: pgmap v6000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:16 smithi110 ceph-mon[28069]: pgmap v6000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:16 smithi193 ceph-mon[32782]: pgmap v6000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10391.982315 secs 2024-04-26T14:41:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10391.982315 secs 2024-04-26T14:41:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10391.982315 secs 2024-04-26T14:41:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:18 smithi196 ceph-mon[32572]: pgmap v6001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T14:41:19.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:18 smithi193 ceph-mon[32782]: pgmap v6001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T14:41:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:18 smithi110 ceph-mon[28069]: pgmap v6001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T14:41:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:20 smithi196 ceph-mon[32572]: pgmap v6002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:20 smithi110 ceph-mon[28069]: pgmap v6002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:20 smithi193 ceph-mon[32782]: pgmap v6002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:22 smithi196 ceph-mon[32572]: pgmap v6003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10396.982439 secs 2024-04-26T14:41:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:22 smithi110 ceph-mon[28069]: pgmap v6003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10396.982439 secs 2024-04-26T14:41:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:22 smithi193 ceph-mon[32782]: pgmap v6003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:41:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10396.982439 secs 2024-04-26T14:41:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:24 smithi196 ceph-mon[32572]: pgmap v6004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:41:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:24 smithi110 ceph-mon[28069]: pgmap v6004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:41:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:24 smithi193 ceph-mon[32782]: pgmap v6004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:41:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:26 smithi196 ceph-mon[32572]: pgmap v6005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:26 smithi110 ceph-mon[28069]: pgmap v6005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:26 smithi193 ceph-mon[32782]: pgmap v6005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10401.982555 secs 2024-04-26T14:41:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10401.982555 secs 2024-04-26T14:41:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10401.982555 secs 2024-04-26T14:41:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:28 smithi196 ceph-mon[32572]: pgmap v6006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:28 smithi110 ceph-mon[28069]: pgmap v6006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:28 smithi193 ceph-mon[32782]: pgmap v6006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:30 smithi196 ceph-mon[32572]: pgmap v6007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:41:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:30 smithi110 ceph-mon[28069]: pgmap v6007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:41:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:30 smithi193 ceph-mon[32782]: pgmap v6007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:41:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10406.982691 secs 2024-04-26T14:41:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:32 smithi196 ceph-mon[32572]: pgmap v6008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10406.982691 secs 2024-04-26T14:41:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:32 smithi110 ceph-mon[28069]: pgmap v6008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:33.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:41:33.059+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:41:33.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:41:33.059+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:41:33.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:41:33.060+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 83 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:41:33.060 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:41:33.060+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 83 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:41:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10406.982691 secs 2024-04-26T14:41:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:32 smithi193 ceph-mon[32782]: pgmap v6008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:34 smithi196 ceph-mon[32572]: pgmap v6009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:34 smithi110 ceph-mon[28069]: pgmap v6009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:34 smithi193 ceph-mon[32782]: pgmap v6009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:36 smithi196 ceph-mon[32572]: pgmap v6010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:36 smithi110 ceph-mon[28069]: pgmap v6010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:36 smithi193 ceph-mon[32782]: pgmap v6010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10411.982768 secs 2024-04-26T14:41:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10411.982768 secs 2024-04-26T14:41:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10411.982768 secs 2024-04-26T14:41:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:38 smithi196 ceph-mon[32572]: pgmap v6011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:38 smithi110 ceph-mon[28069]: pgmap v6011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:38 smithi193 ceph-mon[32782]: pgmap v6011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:40 smithi110 ceph-mon[28069]: pgmap v6012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:41:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:40 smithi193 ceph-mon[32782]: pgmap v6012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:41:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:40 smithi196 ceph-mon[32572]: pgmap v6012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:41:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10416.982917 secs 2024-04-26T14:41:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10416.982917 secs 2024-04-26T14:41:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10416.982917 secs 2024-04-26T14:41:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:42 smithi110 ceph-mon[28069]: pgmap v6013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:42 smithi193 ceph-mon[32782]: pgmap v6013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:42 smithi196 ceph-mon[32572]: pgmap v6013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:44 smithi110 ceph-mon[28069]: pgmap v6014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:44 smithi193 ceph-mon[32782]: pgmap v6014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:44 smithi196 ceph-mon[32572]: pgmap v6014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:46 smithi110 ceph-mon[28069]: pgmap v6015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10421.983045 secs 2024-04-26T14:41:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:46 smithi193 ceph-mon[32782]: pgmap v6015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10421.983045 secs 2024-04-26T14:41:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:46 smithi196 ceph-mon[32572]: pgmap v6015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10421.983045 secs 2024-04-26T14:41:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:47 smithi193 ceph-mon[32782]: pgmap v6016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:47 smithi196 ceph-mon[32572]: pgmap v6016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:47 smithi110 ceph-mon[28069]: pgmap v6016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:50 smithi193 ceph-mon[32782]: pgmap v6017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:41:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:50 smithi196 ceph-mon[32572]: pgmap v6017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:41:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:50 smithi110 ceph-mon[28069]: pgmap v6017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:41:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10426.983168 secs 2024-04-26T14:41:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:52 smithi193 ceph-mon[32782]: pgmap v6018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10426.983168 secs 2024-04-26T14:41:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:52 smithi196 ceph-mon[32572]: pgmap v6018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10426.983168 secs 2024-04-26T14:41:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:52 smithi110 ceph-mon[28069]: pgmap v6018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:54 smithi193 ceph-mon[32782]: pgmap v6019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:54 smithi196 ceph-mon[32572]: pgmap v6019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:54 smithi110 ceph-mon[28069]: pgmap v6019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:56 smithi193 ceph-mon[32782]: pgmap v6020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:56 smithi196 ceph-mon[32572]: pgmap v6020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:56 smithi110 ceph-mon[28069]: pgmap v6020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:41:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10431.983284 secs 2024-04-26T14:41:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10431.983284 secs 2024-04-26T14:41:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10431.983284 secs 2024-04-26T14:41:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:41:58 smithi196 ceph-mon[32572]: pgmap v6021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:41:58 smithi110 ceph-mon[28069]: pgmap v6021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:41:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:41:58 smithi193 ceph-mon[32782]: pgmap v6021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:00 smithi196 ceph-mon[32572]: pgmap v6022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:42:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:00 smithi110 ceph-mon[28069]: pgmap v6022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:42:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:00 smithi193 ceph-mon[32782]: pgmap v6022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:42:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10436.983410 secs 2024-04-26T14:42:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:02 smithi196 ceph-mon[32572]: pgmap v6023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10436.983410 secs 2024-04-26T14:42:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:02 smithi110 ceph-mon[28069]: pgmap v6023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10436.983410 secs 2024-04-26T14:42:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:02 smithi193 ceph-mon[32782]: pgmap v6023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:04 smithi110 ceph-mon[28069]: pgmap v6024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:04 smithi193 ceph-mon[32782]: pgmap v6024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:04 smithi196 ceph-mon[32572]: pgmap v6024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:06 smithi110 ceph-mon[28069]: pgmap v6025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:06 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 10441.983525 secs 2024-04-26T14:42:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:06 smithi110 ceph-mon[28069]: slow request 2882.377095 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:42:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:06 smithi193 ceph-mon[32782]: pgmap v6025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:06 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 10441.983525 secs 2024-04-26T14:42:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:06 smithi193 ceph-mon[32782]: slow request 2882.377095 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:42:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:06 smithi196 ceph-mon[32572]: pgmap v6025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:06 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 10441.983525 secs 2024-04-26T14:42:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:06 smithi196 ceph-mon[32572]: slow request 2882.377095 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:42:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:07 smithi110 ceph-mon[28069]: pgmap v6026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:07 smithi193 ceph-mon[32782]: pgmap v6026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:07 smithi196 ceph-mon[32572]: pgmap v6026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:10 smithi193 ceph-mon[32782]: pgmap v6027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:42:10.744 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:10 smithi110 ceph-mon[28069]: pgmap v6027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:42:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:10 smithi196 ceph-mon[32572]: pgmap v6027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:42:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10446.983661 secs 2024-04-26T14:42:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:12 smithi193 ceph-mon[32782]: pgmap v6028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10446.983661 secs 2024-04-26T14:42:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:12 smithi196 ceph-mon[32572]: pgmap v6028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10446.983661 secs 2024-04-26T14:42:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:12 smithi110 ceph-mon[28069]: pgmap v6028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:14 smithi193 ceph-mon[32782]: pgmap v6029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:42:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:14 smithi196 ceph-mon[32572]: pgmap v6029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:42:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:14 smithi110 ceph-mon[28069]: pgmap v6029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:42:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:42:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:42:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:42:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:42:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:42:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:42:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:42:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:42:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:42:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:16 smithi196 ceph-mon[32572]: pgmap v6030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:42:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:16 smithi196 ceph-mon[32572]: pgmap v6031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:16 smithi110 ceph-mon[28069]: pgmap v6030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:42:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:16 smithi110 ceph-mon[28069]: pgmap v6031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:16 smithi193 ceph-mon[32782]: pgmap v6030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:42:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:16 smithi193 ceph-mon[32782]: pgmap v6031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10451.983778 secs 2024-04-26T14:42:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10451.983778 secs 2024-04-26T14:42:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10451.983778 secs 2024-04-26T14:42:18.067 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:42:18.067+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:42:18.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:42:18.067+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:42:18.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:42:18.068+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 84 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:42:18.068 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:42:18.068+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 84 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:42:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:18 smithi196 ceph-mon[32572]: pgmap v6032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:42:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:18 smithi110 ceph-mon[28069]: pgmap v6032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:42:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:18 smithi193 ceph-mon[32782]: pgmap v6032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:42:20.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:20 smithi193 ceph-mon[32782]: pgmap v6033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:20 smithi196 ceph-mon[32572]: pgmap v6033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:20 smithi110 ceph-mon[28069]: pgmap v6033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:22 smithi196 ceph-mon[32572]: pgmap v6034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10456.983900 secs 2024-04-26T14:42:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:22 smithi110 ceph-mon[28069]: pgmap v6034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10456.983900 secs 2024-04-26T14:42:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:22 smithi193 ceph-mon[32782]: pgmap v6034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10456.983900 secs 2024-04-26T14:42:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:24 smithi196 ceph-mon[32572]: pgmap v6035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:24 smithi110 ceph-mon[28069]: pgmap v6035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:24 smithi193 ceph-mon[32782]: pgmap v6035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:42:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:26 smithi196 ceph-mon[32572]: pgmap v6036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:42:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:26 smithi110 ceph-mon[28069]: pgmap v6036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:42:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:26 smithi193 ceph-mon[32782]: pgmap v6036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:42:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10461.984014 secs 2024-04-26T14:42:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10461.984014 secs 2024-04-26T14:42:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10461.984014 secs 2024-04-26T14:42:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:28 smithi196 ceph-mon[32572]: pgmap v6037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:28 smithi110 ceph-mon[28069]: pgmap v6037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:28 smithi193 ceph-mon[32782]: pgmap v6037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:30 smithi196 ceph-mon[32572]: pgmap v6038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:30 smithi110 ceph-mon[28069]: pgmap v6038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:30 smithi193 ceph-mon[32782]: pgmap v6038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:32 smithi196 ceph-mon[32572]: pgmap v6039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10466.984123 secs 2024-04-26T14:42:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:32 smithi110 ceph-mon[28069]: pgmap v6039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10466.984123 secs 2024-04-26T14:42:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:32 smithi193 ceph-mon[32782]: pgmap v6039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10466.984123 secs 2024-04-26T14:42:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:34 smithi196 ceph-mon[32572]: pgmap v6040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:34 smithi110 ceph-mon[28069]: pgmap v6040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:34 smithi193 ceph-mon[32782]: pgmap v6040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:36 smithi196 ceph-mon[32572]: pgmap v6041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:36 smithi110 ceph-mon[28069]: pgmap v6041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:36 smithi193 ceph-mon[32782]: pgmap v6041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10471.984241 secs 2024-04-26T14:42:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10471.984241 secs 2024-04-26T14:42:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10471.984241 secs 2024-04-26T14:42:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:38 smithi196 ceph-mon[32572]: pgmap v6042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:38 smithi110 ceph-mon[28069]: pgmap v6042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:38 smithi193 ceph-mon[32782]: pgmap v6042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:40 smithi196 ceph-mon[32572]: pgmap v6043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:40 smithi110 ceph-mon[28069]: pgmap v6043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:40 smithi193 ceph-mon[32782]: pgmap v6043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:42 smithi196 ceph-mon[32572]: pgmap v6044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10476.984339 secs 2024-04-26T14:42:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:42 smithi110 ceph-mon[28069]: pgmap v6044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10476.984339 secs 2024-04-26T14:42:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:42 smithi193 ceph-mon[32782]: pgmap v6044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10476.984339 secs 2024-04-26T14:42:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:44 smithi196 ceph-mon[32572]: pgmap v6045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:44 smithi110 ceph-mon[28069]: pgmap v6045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:44 smithi193 ceph-mon[32782]: pgmap v6045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:46 smithi196 ceph-mon[32572]: pgmap v6046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:46 smithi110 ceph-mon[28069]: pgmap v6046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:46 smithi193 ceph-mon[32782]: pgmap v6046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10481.984402 secs 2024-04-26T14:42:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10481.984402 secs 2024-04-26T14:42:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10481.984402 secs 2024-04-26T14:42:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:48 smithi196 ceph-mon[32572]: pgmap v6047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:48 smithi110 ceph-mon[28069]: pgmap v6047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:48 smithi193 ceph-mon[32782]: pgmap v6047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:50 smithi196 ceph-mon[32572]: pgmap v6048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:50 smithi110 ceph-mon[28069]: pgmap v6048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:50 smithi193 ceph-mon[32782]: pgmap v6048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:52 smithi196 ceph-mon[32572]: pgmap v6049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10486.984539 secs 2024-04-26T14:42:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:52 smithi110 ceph-mon[28069]: pgmap v6049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10486.984539 secs 2024-04-26T14:42:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:52 smithi193 ceph-mon[32782]: pgmap v6049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10486.984539 secs 2024-04-26T14:42:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:54 smithi110 ceph-mon[28069]: pgmap v6050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:54 smithi193 ceph-mon[32782]: pgmap v6050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:54 smithi196 ceph-mon[32572]: pgmap v6050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:42:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:56 smithi110 ceph-mon[28069]: pgmap v6051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:56.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:56 smithi196 ceph-mon[32572]: pgmap v6051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:56 smithi193 ceph-mon[32782]: pgmap v6051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10491.984672 secs 2024-04-26T14:42:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10491.984672 secs 2024-04-26T14:42:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10491.984672 secs 2024-04-26T14:42:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:42:58 smithi110 ceph-mon[28069]: pgmap v6052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:42:58 smithi193 ceph-mon[32782]: pgmap v6052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:42:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:42:58 smithi196 ceph-mon[32572]: pgmap v6052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:00 smithi110 ceph-mon[28069]: pgmap v6053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:00 smithi193 ceph-mon[32782]: pgmap v6053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:00 smithi196 ceph-mon[32572]: pgmap v6053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:02 smithi110 ceph-mon[28069]: pgmap v6054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10496.984737 secs 2024-04-26T14:43:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:02 smithi193 ceph-mon[32782]: pgmap v6054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10496.984737 secs 2024-04-26T14:43:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:02 smithi196 ceph-mon[32572]: pgmap v6054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10496.984737 secs 2024-04-26T14:43:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:04 smithi110 ceph-mon[28069]: pgmap v6055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:04 smithi193 ceph-mon[32782]: pgmap v6055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:04 smithi196 ceph-mon[32572]: pgmap v6055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:06 smithi193 ceph-mon[32782]: pgmap v6056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:06 smithi196 ceph-mon[32572]: pgmap v6056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:06 smithi110 ceph-mon[28069]: pgmap v6056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 10501.984852 secs 2024-04-26T14:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:07 smithi193 ceph-mon[32782]: slow request 1441.703374 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:43:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 10501.984852 secs 2024-04-26T14:43:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:07 smithi196 ceph-mon[32572]: slow request 1441.703374 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:43:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 10501.984852 secs 2024-04-26T14:43:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:07 smithi110 ceph-mon[28069]: slow request 1441.703374 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:43:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:08 smithi193 ceph-mon[32782]: pgmap v6057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:08 smithi196 ceph-mon[32572]: pgmap v6057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:08 smithi110 ceph-mon[28069]: pgmap v6057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:10.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:10 smithi110 ceph-mon[28069]: pgmap v6058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:10 smithi193 ceph-mon[32782]: pgmap v6058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:10 smithi196 ceph-mon[32572]: pgmap v6058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:12 smithi193 ceph-mon[32782]: pgmap v6059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10506.984948 secs 2024-04-26T14:43:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:12 smithi196 ceph-mon[32572]: pgmap v6059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10506.984948 secs 2024-04-26T14:43:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:12 smithi110 ceph-mon[28069]: pgmap v6059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10506.984948 secs 2024-04-26T14:43:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:14 smithi193 ceph-mon[32782]: pgmap v6060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:15.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:14 smithi196 ceph-mon[32572]: pgmap v6060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:14 smithi110 ceph-mon[28069]: pgmap v6060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:43:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:43:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:43:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:16 smithi193 ceph-mon[32782]: pgmap v6061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:43:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:43:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:43:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:16 smithi196 ceph-mon[32572]: pgmap v6061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:43:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:43:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:43:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:16 smithi110 ceph-mon[28069]: pgmap v6061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:43:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:43:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:43:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10511.985066 secs 2024-04-26T14:43:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:17 smithi193 ceph-mon[32782]: pgmap v6062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T14:43:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:17 smithi193 ceph-mon[32782]: pgmap v6063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10511.985066 secs 2024-04-26T14:43:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:17 smithi196 ceph-mon[32572]: pgmap v6062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T14:43:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:17 smithi196 ceph-mon[32572]: pgmap v6063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10511.985066 secs 2024-04-26T14:43:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:17 smithi110 ceph-mon[28069]: pgmap v6062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T14:43:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:17 smithi110 ceph-mon[28069]: pgmap v6063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:19 smithi193 ceph-mon[32782]: pgmap v6064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:19 smithi196 ceph-mon[32572]: pgmap v6064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:19 smithi110 ceph-mon[28069]: pgmap v6064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:21 smithi193 ceph-mon[32782]: pgmap v6065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:21 smithi196 ceph-mon[32572]: pgmap v6065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:21 smithi110 ceph-mon[28069]: pgmap v6065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10516.985203 secs 2024-04-26T14:43:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10516.985203 secs 2024-04-26T14:43:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10516.985203 secs 2024-04-26T14:43:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:23 smithi193 ceph-mon[32782]: pgmap v6066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T14:43:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:23 smithi196 ceph-mon[32572]: pgmap v6066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T14:43:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:23 smithi110 ceph-mon[28069]: pgmap v6066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T14:43:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:25 smithi196 ceph-mon[32572]: pgmap v6067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:25 smithi110 ceph-mon[28069]: pgmap v6067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:25 smithi193 ceph-mon[32782]: pgmap v6067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:43:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10521.985299 secs 2024-04-26T14:43:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:27 smithi196 ceph-mon[32572]: pgmap v6068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:43:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10521.985299 secs 2024-04-26T14:43:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:27 smithi110 ceph-mon[28069]: pgmap v6068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:43:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10521.985299 secs 2024-04-26T14:43:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:27 smithi193 ceph-mon[32782]: pgmap v6068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:43:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:29 smithi196 ceph-mon[32572]: pgmap v6069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:29 smithi110 ceph-mon[28069]: pgmap v6069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:29 smithi193 ceph-mon[32782]: pgmap v6069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:31 smithi196 ceph-mon[32572]: pgmap v6070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:31 smithi110 ceph-mon[28069]: pgmap v6070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:31 smithi193 ceph-mon[32782]: pgmap v6070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10526.985418 secs 2024-04-26T14:43:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10526.985418 secs 2024-04-26T14:43:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10526.985418 secs 2024-04-26T14:43:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:33 smithi196 ceph-mon[32572]: pgmap v6071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:33 smithi110 ceph-mon[28069]: pgmap v6071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:33 smithi193 ceph-mon[32782]: pgmap v6071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:35 smithi196 ceph-mon[32572]: pgmap v6072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:43:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:35 smithi110 ceph-mon[28069]: pgmap v6072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:43:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:35 smithi193 ceph-mon[32782]: pgmap v6072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:43:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10531.985535 secs 2024-04-26T14:43:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:37 smithi196 ceph-mon[32572]: pgmap v6073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10531.985535 secs 2024-04-26T14:43:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:37 smithi110 ceph-mon[28069]: pgmap v6073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10531.985535 secs 2024-04-26T14:43:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:37 smithi193 ceph-mon[32782]: pgmap v6073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:39 smithi196 ceph-mon[32572]: pgmap v6074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:39 smithi110 ceph-mon[28069]: pgmap v6074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:39 smithi193 ceph-mon[32782]: pgmap v6074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:41 smithi196 ceph-mon[32572]: pgmap v6075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:41 smithi110 ceph-mon[28069]: pgmap v6075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:41 smithi193 ceph-mon[32782]: pgmap v6075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10536.985653 secs 2024-04-26T14:43:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10536.985653 secs 2024-04-26T14:43:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10536.985653 secs 2024-04-26T14:43:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:43 smithi196 ceph-mon[32572]: pgmap v6076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:43 smithi110 ceph-mon[28069]: pgmap v6076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:43 smithi193 ceph-mon[32782]: pgmap v6076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:45 smithi196 ceph-mon[32572]: pgmap v6077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:43:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:45 smithi110 ceph-mon[28069]: pgmap v6077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:43:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:45 smithi193 ceph-mon[32782]: pgmap v6077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:43:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10541.985734 secs 2024-04-26T14:43:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:47 smithi196 ceph-mon[32572]: pgmap v6078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10541.985734 secs 2024-04-26T14:43:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:47 smithi110 ceph-mon[28069]: pgmap v6078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10541.985734 secs 2024-04-26T14:43:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:47 smithi193 ceph-mon[32782]: pgmap v6078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:49 smithi196 ceph-mon[32572]: pgmap v6079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:49 smithi110 ceph-mon[28069]: pgmap v6079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:49 smithi193 ceph-mon[32782]: pgmap v6079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:51 smithi196 ceph-mon[32572]: pgmap v6080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:51 smithi110 ceph-mon[28069]: pgmap v6080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:51 smithi193 ceph-mon[32782]: pgmap v6080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10546.985850 secs 2024-04-26T14:43:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10546.985850 secs 2024-04-26T14:43:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10546.985850 secs 2024-04-26T14:43:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:53 smithi196 ceph-mon[32572]: pgmap v6081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:53 smithi110 ceph-mon[28069]: pgmap v6081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:53 smithi193 ceph-mon[32782]: pgmap v6081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:43:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:55 smithi196 ceph-mon[32572]: pgmap v6082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:43:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:55 smithi110 ceph-mon[28069]: pgmap v6082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:43:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:55 smithi193 ceph-mon[32782]: pgmap v6082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:43:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10551.985932 secs 2024-04-26T14:43:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:57 smithi196 ceph-mon[32572]: pgmap v6083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10551.985932 secs 2024-04-26T14:43:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:57 smithi110 ceph-mon[28069]: pgmap v6083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:43:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10551.985932 secs 2024-04-26T14:43:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:57 smithi193 ceph-mon[32782]: pgmap v6083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:43:59 smithi196 ceph-mon[32572]: pgmap v6084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:43:59 smithi110 ceph-mon[28069]: pgmap v6084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:43:59 smithi193 ceph-mon[32782]: pgmap v6084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:01 smithi196 ceph-mon[32572]: pgmap v6085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:01 smithi110 ceph-mon[28069]: pgmap v6085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:01 smithi193 ceph-mon[32782]: pgmap v6085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10556.986070 secs 2024-04-26T14:44:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10556.986070 secs 2024-04-26T14:44:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10556.986070 secs 2024-04-26T14:44:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:03 smithi196 ceph-mon[32572]: pgmap v6086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:03 smithi110 ceph-mon[28069]: pgmap v6086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:03 smithi193 ceph-mon[32782]: pgmap v6086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:05.759 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:44:05.339+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:44:05.759 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:44:05.339+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:44:05.759 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:44:05.339+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:44:05.759 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:44:05.339+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:44:05.759 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:44:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:44:05.339+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:44:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:05 smithi110 ceph-mon[28069]: pgmap v6087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:44:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:05 smithi193 ceph-mon[32782]: pgmap v6087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:44:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:05 smithi196 ceph-mon[32572]: pgmap v6087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:44:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10561.986193 secs 2024-04-26T14:44:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:07 smithi110 ceph-mon[28069]: pgmap v6088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10561.986193 secs 2024-04-26T14:44:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:07 smithi193 ceph-mon[32782]: pgmap v6088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10561.986193 secs 2024-04-26T14:44:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:07 smithi196 ceph-mon[32572]: pgmap v6088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:09 smithi110 ceph-mon[28069]: pgmap v6089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:44:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:09 smithi193 ceph-mon[32782]: pgmap v6089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:44:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:09 smithi196 ceph-mon[32572]: pgmap v6089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:44:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:11 smithi110 ceph-mon[28069]: pgmap v6090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:44:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10566.986313 secs 2024-04-26T14:44:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:11 smithi193 ceph-mon[32782]: pgmap v6090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:44:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10566.986313 secs 2024-04-26T14:44:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:11 smithi196 ceph-mon[32572]: pgmap v6090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:44:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10566.986313 secs 2024-04-26T14:44:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:13 smithi110 ceph-mon[28069]: pgmap v6091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:44:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:13 smithi193 ceph-mon[32782]: pgmap v6091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:44:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:13 smithi196 ceph-mon[32572]: pgmap v6091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:44:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:15 smithi110 ceph-mon[28069]: pgmap v6092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:44:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:15 smithi193 ceph-mon[32782]: pgmap v6092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:44:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:15 smithi196 ceph-mon[32572]: pgmap v6092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T14:44:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10571.986464 secs 2024-04-26T14:44:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:44:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10571.986464 secs 2024-04-26T14:44:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:44:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10571.986464 secs 2024-04-26T14:44:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:44:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:17 smithi193 ceph-mon[32782]: pgmap v6093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:44:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:17 smithi196 ceph-mon[32572]: pgmap v6093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:44:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:17 smithi110 ceph-mon[28069]: pgmap v6093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T14:44:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:44:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:44:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:44:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:44:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:44:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:44:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:44:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:44:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:44:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:19 smithi193 ceph-mon[32782]: pgmap v6094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T14:44:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:19 smithi193 ceph-mon[32782]: pgmap v6095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:19 smithi196 ceph-mon[32572]: pgmap v6094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T14:44:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:19 smithi196 ceph-mon[32572]: pgmap v6095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:19 smithi110 ceph-mon[28069]: pgmap v6094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T14:44:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:19 smithi110 ceph-mon[28069]: pgmap v6095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:21 smithi193 ceph-mon[32782]: pgmap v6096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10576.986582 secs 2024-04-26T14:44:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:21 smithi196 ceph-mon[32572]: pgmap v6096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10576.986582 secs 2024-04-26T14:44:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:21 smithi110 ceph-mon[28069]: pgmap v6096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10576.986582 secs 2024-04-26T14:44:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:22 smithi193 ceph-mon[32782]: pgmap v6097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:44:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:22 smithi196 ceph-mon[32572]: pgmap v6097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:44:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:22 smithi110 ceph-mon[28069]: pgmap v6097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:44:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:24 smithi196 ceph-mon[32572]: pgmap v6098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:24 smithi110 ceph-mon[28069]: pgmap v6098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:24 smithi193 ceph-mon[32782]: pgmap v6098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:26 smithi196 ceph-mon[32572]: pgmap v6099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:26 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10581.986699 secs 2024-04-26T14:44:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:26 smithi110 ceph-mon[28069]: pgmap v6099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:26 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10581.986699 secs 2024-04-26T14:44:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:26 smithi193 ceph-mon[32782]: pgmap v6099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:44:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:26 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10581.986699 secs 2024-04-26T14:44:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:28 smithi196 ceph-mon[32572]: pgmap v6100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:44:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:28 smithi110 ceph-mon[28069]: pgmap v6100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:44:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:28 smithi193 ceph-mon[32782]: pgmap v6100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:44:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:30 smithi196 ceph-mon[32572]: pgmap v6101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:30 smithi110 ceph-mon[28069]: pgmap v6101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:30 smithi193 ceph-mon[32782]: pgmap v6101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:31 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10586.986810 secs 2024-04-26T14:44:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:31 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10586.986810 secs 2024-04-26T14:44:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:31 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10586.986810 secs 2024-04-26T14:44:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:32 smithi196 ceph-mon[32572]: pgmap v6102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:32 smithi110 ceph-mon[28069]: pgmap v6102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:32 smithi193 ceph-mon[32782]: pgmap v6102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:34 smithi196 ceph-mon[32572]: pgmap v6103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:34 smithi110 ceph-mon[28069]: pgmap v6103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:34 smithi193 ceph-mon[32782]: pgmap v6103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:36 smithi196 ceph-mon[32572]: pgmap v6104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:36 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10591.986928 secs 2024-04-26T14:44:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:36 smithi110 ceph-mon[28069]: pgmap v6104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:36 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10591.986928 secs 2024-04-26T14:44:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:36 smithi193 ceph-mon[32782]: pgmap v6104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:36 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10591.986928 secs 2024-04-26T14:44:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:38 smithi196 ceph-mon[32572]: pgmap v6105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:38 smithi110 ceph-mon[28069]: pgmap v6105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:38 smithi193 ceph-mon[32782]: pgmap v6105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:40 smithi196 ceph-mon[32572]: pgmap v6106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:40 smithi110 ceph-mon[28069]: pgmap v6106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:40 smithi193 ceph-mon[32782]: pgmap v6106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10596.987030 secs 2024-04-26T14:44:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10596.987030 secs 2024-04-26T14:44:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10596.987030 secs 2024-04-26T14:44:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:42 smithi196 ceph-mon[32572]: pgmap v6107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:42 smithi110 ceph-mon[28069]: pgmap v6107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:42 smithi193 ceph-mon[32782]: pgmap v6107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:45 smithi110 ceph-mon[28069]: pgmap v6108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:45 smithi193 ceph-mon[32782]: pgmap v6108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:45 smithi196 ceph-mon[32572]: pgmap v6108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:47 smithi110 ceph-mon[28069]: pgmap v6109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10601.987108 secs 2024-04-26T14:44:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:47 smithi193 ceph-mon[32782]: pgmap v6109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10601.987108 secs 2024-04-26T14:44:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:47 smithi196 ceph-mon[32572]: pgmap v6109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10601.987108 secs 2024-04-26T14:44:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:49 smithi110 ceph-mon[28069]: pgmap v6110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:49 smithi193 ceph-mon[32782]: pgmap v6110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:49 smithi196 ceph-mon[32572]: pgmap v6110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:51 smithi110 ceph-mon[28069]: pgmap v6111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:51 smithi193 ceph-mon[32782]: pgmap v6111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:51 smithi196 ceph-mon[32572]: pgmap v6111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10606.987224 secs 2024-04-26T14:44:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10606.987224 secs 2024-04-26T14:44:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10606.987224 secs 2024-04-26T14:44:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:53 smithi110 ceph-mon[28069]: pgmap v6112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:53 smithi193 ceph-mon[32782]: pgmap v6112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:53 smithi196 ceph-mon[32572]: pgmap v6112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:55 smithi193 ceph-mon[32782]: pgmap v6113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:55 smithi196 ceph-mon[32572]: pgmap v6113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:55 smithi110 ceph-mon[28069]: pgmap v6113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:57.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:57 smithi196 ceph-mon[32572]: pgmap v6114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:57.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10611.987338 secs 2024-04-26T14:44:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:57 smithi193 ceph-mon[32782]: pgmap v6114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10611.987338 secs 2024-04-26T14:44:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:57 smithi110 ceph-mon[28069]: pgmap v6114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:44:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10611.987338 secs 2024-04-26T14:44:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:44:59 smithi193 ceph-mon[32782]: pgmap v6115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:44:59 smithi196 ceph-mon[32572]: pgmap v6115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:44:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:44:59 smithi110 ceph-mon[28069]: pgmap v6115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:01 smithi193 ceph-mon[32782]: pgmap v6116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:01 smithi196 ceph-mon[32572]: pgmap v6116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:01 smithi110 ceph-mon[28069]: pgmap v6116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10616.987477 secs 2024-04-26T14:45:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10616.987477 secs 2024-04-26T14:45:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10616.987477 secs 2024-04-26T14:45:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:03 smithi193 ceph-mon[32782]: pgmap v6117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:03 smithi196 ceph-mon[32572]: pgmap v6117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:03 smithi110 ceph-mon[28069]: pgmap v6117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:05 smithi193 ceph-mon[32782]: pgmap v6118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:45:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:05 smithi196 ceph-mon[32572]: pgmap v6118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:45:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:05 smithi110 ceph-mon[28069]: pgmap v6118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:45:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:07 smithi193 ceph-mon[32782]: pgmap v6119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:45:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10621.987618 secs 2024-04-26T14:45:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:07 smithi196 ceph-mon[32572]: pgmap v6119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:45:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10621.987618 secs 2024-04-26T14:45:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:07 smithi110 ceph-mon[28069]: pgmap v6119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:45:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10621.987618 secs 2024-04-26T14:45:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:09 smithi193 ceph-mon[32782]: pgmap v6120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:45:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:09 smithi196 ceph-mon[32572]: pgmap v6120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:45:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:09 smithi110 ceph-mon[28069]: pgmap v6120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:45:11.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:11 smithi110 ceph-mon[28069]: pgmap v6121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:45:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:11 smithi193 ceph-mon[32782]: pgmap v6121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:45:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:11 smithi196 ceph-mon[32572]: pgmap v6121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:45:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10626.987759 secs 2024-04-26T14:45:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10626.987759 secs 2024-04-26T14:45:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10626.987759 secs 2024-04-26T14:45:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:13 smithi193 ceph-mon[32782]: pgmap v6122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:45:13.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:13 smithi196 ceph-mon[32572]: pgmap v6122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:45:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:13 smithi110 ceph-mon[28069]: pgmap v6122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:45:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:15 smithi193 ceph-mon[32782]: pgmap v6123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:45:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:15 smithi196 ceph-mon[32572]: pgmap v6123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:45:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:15 smithi110 ceph-mon[28069]: pgmap v6123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:45:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:17 smithi193 ceph-mon[32782]: pgmap v6124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:45:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10631.987874 secs 2024-04-26T14:45:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:17 smithi196 ceph-mon[32572]: pgmap v6124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:45:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10631.987874 secs 2024-04-26T14:45:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:17 smithi110 ceph-mon[28069]: pgmap v6124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:45:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10631.987874 secs 2024-04-26T14:45:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:45:18.097+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:45:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:45:18.097+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:45:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:45:18.098+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 85 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:45:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:45:18.098+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 85 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:45:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:19 smithi196 ceph-mon[32572]: pgmap v6125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:45:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:19 smithi110 ceph-mon[28069]: pgmap v6125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:45:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:19 smithi193 ceph-mon[32782]: pgmap v6125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:45:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:45:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:45:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:20 smithi196 ceph-mon[32572]: pgmap v6126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 801 B/s rd, 1 op/s 2024-04-26T14:45:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:20 smithi196 ceph-mon[32572]: pgmap v6127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T14:45:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:45:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:45:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:45:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:20 smithi110 ceph-mon[28069]: pgmap v6126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 801 B/s rd, 1 op/s 2024-04-26T14:45:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:20 smithi110 ceph-mon[28069]: pgmap v6127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T14:45:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:45:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:45:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:45:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:20 smithi193 ceph-mon[32782]: pgmap v6126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 801 B/s rd, 1 op/s 2024-04-26T14:45:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:20 smithi193 ceph-mon[32782]: pgmap v6127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T14:45:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:45:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10636.987996 secs 2024-04-26T14:45:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:22 smithi196 ceph-mon[32572]: pgmap v6128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T14:45:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10636.987996 secs 2024-04-26T14:45:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:22 smithi110 ceph-mon[28069]: pgmap v6128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T14:45:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10636.987996 secs 2024-04-26T14:45:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:22 smithi193 ceph-mon[32782]: pgmap v6128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T14:45:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:24 smithi196 ceph-mon[32572]: pgmap v6129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:45:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:24 smithi110 ceph-mon[28069]: pgmap v6129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:45:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:24 smithi193 ceph-mon[32782]: pgmap v6129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:45:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:26 smithi196 ceph-mon[32572]: pgmap v6130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:45:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:26 smithi110 ceph-mon[28069]: pgmap v6130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:45:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:26 smithi193 ceph-mon[32782]: pgmap v6130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:45:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10641.988115 secs 2024-04-26T14:45:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10641.988115 secs 2024-04-26T14:45:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10641.988115 secs 2024-04-26T14:45:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:28 smithi196 ceph-mon[32572]: pgmap v6131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:45:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:28 smithi110 ceph-mon[28069]: pgmap v6131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:45:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:28 smithi193 ceph-mon[32782]: pgmap v6131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:45:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:30 smithi196 ceph-mon[32572]: pgmap v6132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:45:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:30 smithi110 ceph-mon[28069]: pgmap v6132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:45:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:30 smithi193 ceph-mon[32782]: pgmap v6132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:45:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10646.988257 secs 2024-04-26T14:45:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:32 smithi196 ceph-mon[32572]: pgmap v6133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10646.988257 secs 2024-04-26T14:45:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:32 smithi110 ceph-mon[28069]: pgmap v6133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10646.988257 secs 2024-04-26T14:45:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:32 smithi193 ceph-mon[32782]: pgmap v6133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:34 smithi196 ceph-mon[32572]: pgmap v6134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:34 smithi110 ceph-mon[28069]: pgmap v6134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:34 smithi193 ceph-mon[32782]: pgmap v6134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:36 smithi196 ceph-mon[32572]: pgmap v6135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:36 smithi110 ceph-mon[28069]: pgmap v6135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:36 smithi193 ceph-mon[32782]: pgmap v6135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10651.988367 secs 2024-04-26T14:45:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10651.988367 secs 2024-04-26T14:45:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10651.988367 secs 2024-04-26T14:45:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:38 smithi110 ceph-mon[28069]: pgmap v6136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:38 smithi193 ceph-mon[32782]: pgmap v6136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:38 smithi196 ceph-mon[32572]: pgmap v6136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:40 smithi110 ceph-mon[28069]: pgmap v6137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:40 smithi193 ceph-mon[32782]: pgmap v6137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:40 smithi196 ceph-mon[32572]: pgmap v6137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10656.988485 secs 2024-04-26T14:45:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:42 smithi110 ceph-mon[28069]: pgmap v6138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10656.988485 secs 2024-04-26T14:45:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:42 smithi193 ceph-mon[32782]: pgmap v6138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10656.988485 secs 2024-04-26T14:45:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:42 smithi196 ceph-mon[32572]: pgmap v6138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:44 smithi110 ceph-mon[28069]: pgmap v6139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:44 smithi193 ceph-mon[32782]: pgmap v6139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:44 smithi196 ceph-mon[32572]: pgmap v6139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:46 smithi110 ceph-mon[28069]: pgmap v6140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:46 smithi193 ceph-mon[32782]: pgmap v6140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:46 smithi196 ceph-mon[32572]: pgmap v6140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10661.988637 secs 2024-04-26T14:45:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10661.988637 secs 2024-04-26T14:45:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10661.988637 secs 2024-04-26T14:45:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:48 smithi110 ceph-mon[28069]: pgmap v6141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:48 smithi193 ceph-mon[32782]: pgmap v6141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:48 smithi196 ceph-mon[32572]: pgmap v6141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:50 smithi193 ceph-mon[32782]: pgmap v6142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:50 smithi196 ceph-mon[32572]: pgmap v6142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:50 smithi110 ceph-mon[28069]: pgmap v6142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10666.988759 secs 2024-04-26T14:45:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:52 smithi193 ceph-mon[32782]: pgmap v6143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10666.988759 secs 2024-04-26T14:45:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:52 smithi196 ceph-mon[32572]: pgmap v6143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10666.988759 secs 2024-04-26T14:45:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:52 smithi110 ceph-mon[28069]: pgmap v6143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:54 smithi193 ceph-mon[32782]: pgmap v6144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:54 smithi196 ceph-mon[32572]: pgmap v6144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:54 smithi110 ceph-mon[28069]: pgmap v6144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:56 smithi193 ceph-mon[32782]: pgmap v6145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:56 smithi196 ceph-mon[32572]: pgmap v6145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:56 smithi110 ceph-mon[28069]: pgmap v6145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:45:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10671.988855 secs 2024-04-26T14:45:57.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10671.988855 secs 2024-04-26T14:45:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10671.988855 secs 2024-04-26T14:45:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:45:58 smithi193 ceph-mon[32782]: pgmap v6146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:45:58 smithi196 ceph-mon[32572]: pgmap v6146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:45:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:45:58 smithi110 ceph-mon[28069]: pgmap v6146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:00 smithi193 ceph-mon[32782]: pgmap v6147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:00 smithi196 ceph-mon[32572]: pgmap v6147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:00 smithi110 ceph-mon[28069]: pgmap v6147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10676.988929 secs 2024-04-26T14:46:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:02 smithi193 ceph-mon[32782]: pgmap v6148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10676.988929 secs 2024-04-26T14:46:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:02 smithi196 ceph-mon[32572]: pgmap v6148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10676.988929 secs 2024-04-26T14:46:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:02 smithi110 ceph-mon[28069]: pgmap v6148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:03 smithi193 ceph-mon[32782]: pgmap v6149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:03 smithi196 ceph-mon[32572]: pgmap v6149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:03 smithi110 ceph-mon[28069]: pgmap v6149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:06 smithi196 ceph-mon[32572]: pgmap v6150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:06 smithi110 ceph-mon[28069]: pgmap v6150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:06 smithi193 ceph-mon[32782]: pgmap v6150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10681.989089 secs 2024-04-26T14:46:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10681.989089 secs 2024-04-26T14:46:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10681.989089 secs 2024-04-26T14:46:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:08 smithi196 ceph-mon[32572]: pgmap v6151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:08 smithi110 ceph-mon[28069]: pgmap v6151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:08 smithi193 ceph-mon[32782]: pgmap v6151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:10 smithi196 ceph-mon[32572]: pgmap v6152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:10 smithi110 ceph-mon[28069]: pgmap v6152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:10 smithi193 ceph-mon[32782]: pgmap v6152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10686.989210 secs 2024-04-26T14:46:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:12 smithi196 ceph-mon[32572]: pgmap v6153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10686.989210 secs 2024-04-26T14:46:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:12 smithi110 ceph-mon[28069]: pgmap v6153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10686.989210 secs 2024-04-26T14:46:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:12 smithi193 ceph-mon[32782]: pgmap v6153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:14 smithi196 ceph-mon[32572]: pgmap v6154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:14 smithi110 ceph-mon[28069]: pgmap v6154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:14 smithi193 ceph-mon[32782]: pgmap v6154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:16 smithi196 ceph-mon[32572]: pgmap v6155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:16 smithi110 ceph-mon[28069]: pgmap v6155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:16 smithi193 ceph-mon[32782]: pgmap v6155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10691.989327 secs 2024-04-26T14:46:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10691.989327 secs 2024-04-26T14:46:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10691.989327 secs 2024-04-26T14:46:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:18 smithi110 ceph-mon[28069]: pgmap v6156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:18 smithi193 ceph-mon[32782]: pgmap v6156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:18 smithi196 ceph-mon[32572]: pgmap v6156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:20 smithi110 ceph-mon[28069]: pgmap v6157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:46:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:46:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:46:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:20 smithi193 ceph-mon[32782]: pgmap v6157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:46:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:46:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:46:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:20 smithi196 ceph-mon[32572]: pgmap v6157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:46:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:46:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:46:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10696.989446 secs 2024-04-26T14:46:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:22 smithi110 ceph-mon[28069]: pgmap v6158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:46:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:46:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:22 smithi110 ceph-mon[28069]: pgmap v6159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 B/s rd, 1 op/s 2024-04-26T14:46:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:22 smithi110 ceph-mon[28069]: pgmap v6160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-04-26T14:46:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:46:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10696.989446 secs 2024-04-26T14:46:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:22 smithi193 ceph-mon[32782]: pgmap v6158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:46:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:46:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:22 smithi193 ceph-mon[32782]: pgmap v6159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 B/s rd, 1 op/s 2024-04-26T14:46:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:22 smithi193 ceph-mon[32782]: pgmap v6160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-04-26T14:46:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:46:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10696.989446 secs 2024-04-26T14:46:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:22 smithi196 ceph-mon[32572]: pgmap v6158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:46:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:46:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:22 smithi196 ceph-mon[32572]: pgmap v6159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 B/s rd, 1 op/s 2024-04-26T14:46:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:22 smithi196 ceph-mon[32572]: pgmap v6160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-04-26T14:46:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:46:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:24 smithi193 ceph-mon[32782]: pgmap v6161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:24 smithi196 ceph-mon[32572]: pgmap v6161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:24 smithi110 ceph-mon[28069]: pgmap v6161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:26 smithi193 ceph-mon[32782]: pgmap v6162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-04-26T14:46:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:26 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10701.989578 secs 2024-04-26T14:46:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:26 smithi196 ceph-mon[32572]: pgmap v6162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-04-26T14:46:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:26 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10701.989578 secs 2024-04-26T14:46:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:26 smithi110 ceph-mon[28069]: pgmap v6162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-04-26T14:46:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:26 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10701.989578 secs 2024-04-26T14:46:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:28 smithi193 ceph-mon[32782]: pgmap v6163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:28 smithi196 ceph-mon[32572]: pgmap v6163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:28 smithi110 ceph-mon[28069]: pgmap v6163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:30 smithi193 ceph-mon[32782]: pgmap v6164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:30 smithi196 ceph-mon[32572]: pgmap v6164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:30 smithi110 ceph-mon[28069]: pgmap v6164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:31 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10706.989614 secs 2024-04-26T14:46:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:31 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10706.989614 secs 2024-04-26T14:46:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:31 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10706.989614 secs 2024-04-26T14:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:32 smithi193 ceph-mon[32782]: pgmap v6165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:46:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:32 smithi196 ceph-mon[32572]: pgmap v6165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:46:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:32 smithi110 ceph-mon[28069]: pgmap v6165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:46:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:33 smithi196 ceph-mon[32572]: pgmap v6166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:33 smithi110 ceph-mon[28069]: pgmap v6166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:33 smithi193 ceph-mon[32782]: pgmap v6166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:36 smithi193 ceph-mon[32782]: pgmap v6167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:36 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10711.989733 secs 2024-04-26T14:46:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:36 smithi196 ceph-mon[32572]: pgmap v6167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:36 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10711.989733 secs 2024-04-26T14:46:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:36 smithi110 ceph-mon[28069]: pgmap v6167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:36 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10711.989733 secs 2024-04-26T14:46:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:38 smithi193 ceph-mon[32782]: pgmap v6168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:38 smithi196 ceph-mon[32572]: pgmap v6168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:38 smithi110 ceph-mon[28069]: pgmap v6168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:40 smithi193 ceph-mon[32782]: pgmap v6169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:40 smithi196 ceph-mon[32572]: pgmap v6169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:40 smithi110 ceph-mon[28069]: pgmap v6169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10716.989852 secs 2024-04-26T14:46:42.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10716.989852 secs 2024-04-26T14:46:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10716.989852 secs 2024-04-26T14:46:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:42 smithi193 ceph-mon[32782]: pgmap v6170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:42 smithi196 ceph-mon[32572]: pgmap v6170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:42 smithi110 ceph-mon[28069]: pgmap v6170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:44 smithi193 ceph-mon[32782]: pgmap v6171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:44 smithi196 ceph-mon[32572]: pgmap v6171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:44 smithi110 ceph-mon[28069]: pgmap v6171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:46 smithi193 ceph-mon[32782]: pgmap v6172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10721.989945 secs 2024-04-26T14:46:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:46 smithi196 ceph-mon[32572]: pgmap v6172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10721.989945 secs 2024-04-26T14:46:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:46 smithi110 ceph-mon[28069]: pgmap v6172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10721.989945 secs 2024-04-26T14:46:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:47 smithi193 ceph-mon[32782]: pgmap v6173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:47 smithi196 ceph-mon[32572]: pgmap v6173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:47 smithi110 ceph-mon[28069]: pgmap v6173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:50 smithi193 ceph-mon[32782]: pgmap v6174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:50 smithi196 ceph-mon[32572]: pgmap v6174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:50 smithi110 ceph-mon[28069]: pgmap v6174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:51 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10726.990063 secs 2024-04-26T14:46:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:51 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10726.990063 secs 2024-04-26T14:46:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:51 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10726.990063 secs 2024-04-26T14:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:52 smithi193 ceph-mon[32782]: pgmap v6175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:52 smithi196 ceph-mon[32572]: pgmap v6175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:52 smithi110 ceph-mon[28069]: pgmap v6175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:54 smithi193 ceph-mon[32782]: pgmap v6176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:54 smithi196 ceph-mon[32572]: pgmap v6176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:54 smithi110 ceph-mon[28069]: pgmap v6176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:56 smithi193 ceph-mon[32782]: pgmap v6177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:56 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10731.990208 secs 2024-04-26T14:46:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:56 smithi196 ceph-mon[32572]: pgmap v6177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:56 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10731.990208 secs 2024-04-26T14:46:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:56 smithi110 ceph-mon[28069]: pgmap v6177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:46:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:56 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10731.990208 secs 2024-04-26T14:46:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:58 smithi193 ceph-mon[32782]: pgmap v6178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:58 smithi196 ceph-mon[32572]: pgmap v6178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:46:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:58 smithi110 ceph-mon[28069]: pgmap v6178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:46:59 smithi193 ceph-mon[32782]: pgmap v6179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:46:59 smithi196 ceph-mon[32572]: pgmap v6179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:46:59 smithi110 ceph-mon[28069]: pgmap v6179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:01 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10736.990326 secs 2024-04-26T14:47:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:01 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10736.990326 secs 2024-04-26T14:47:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:01 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10736.990326 secs 2024-04-26T14:47:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:02 smithi193 ceph-mon[32782]: pgmap v6180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:02 smithi196 ceph-mon[32572]: pgmap v6180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:02 smithi110 ceph-mon[28069]: pgmap v6180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:03 smithi196 ceph-mon[32572]: pgmap v6181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:03 smithi110 ceph-mon[28069]: pgmap v6181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:03 smithi193 ceph-mon[32782]: pgmap v6181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:06 smithi193 ceph-mon[32782]: pgmap v6182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:06 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 10741.990449 secs 2024-04-26T14:47:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:06 smithi193 ceph-mon[32782]: slow request 2882.287971 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:47:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:06 smithi196 ceph-mon[32572]: pgmap v6182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:06 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 10741.990449 secs 2024-04-26T14:47:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:06 smithi196 ceph-mon[32572]: slow request 2882.287971 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:47:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:06 smithi110 ceph-mon[28069]: pgmap v6182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:06 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 10741.990449 secs 2024-04-26T14:47:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:06 smithi110 ceph-mon[28069]: slow request 2882.287971 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:47:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:08 smithi193 ceph-mon[32782]: pgmap v6183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:08 smithi196 ceph-mon[32572]: pgmap v6183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:08 smithi110 ceph-mon[28069]: pgmap v6183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:10 smithi193 ceph-mon[32782]: pgmap v6184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:10 smithi196 ceph-mon[32572]: pgmap v6184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:10 smithi110 ceph-mon[28069]: pgmap v6184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10746.990584 secs 2024-04-26T14:47:12.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10746.990584 secs 2024-04-26T14:47:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10746.990584 secs 2024-04-26T14:47:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:12 smithi193 ceph-mon[32782]: pgmap v6185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:12 smithi196 ceph-mon[32572]: pgmap v6185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:12 smithi110 ceph-mon[28069]: pgmap v6185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:13 smithi193 ceph-mon[32782]: pgmap v6186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:13 smithi196 ceph-mon[32572]: pgmap v6186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:13 smithi110 ceph-mon[28069]: pgmap v6186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:16 smithi193 ceph-mon[32782]: pgmap v6187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10751.990647 secs 2024-04-26T14:47:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:16 smithi196 ceph-mon[32572]: pgmap v6187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10751.990647 secs 2024-04-26T14:47:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:16 smithi110 ceph-mon[28069]: pgmap v6187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10751.990647 secs 2024-04-26T14:47:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:18 smithi193 ceph-mon[32782]: pgmap v6188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:18 smithi196 ceph-mon[32572]: pgmap v6188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:18 smithi110 ceph-mon[28069]: pgmap v6188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:20 smithi193 ceph-mon[32782]: pgmap v6189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:20 smithi196 ceph-mon[32572]: pgmap v6189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:20 smithi110 ceph-mon[28069]: pgmap v6189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10756.990735 secs 2024-04-26T14:47:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10756.990735 secs 2024-04-26T14:47:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10756.990735 secs 2024-04-26T14:47:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:22 smithi193 ceph-mon[32782]: pgmap v6190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:47:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:22 smithi196 ceph-mon[32572]: pgmap v6190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:47:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:22 smithi110 ceph-mon[28069]: pgmap v6190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:47:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:47:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:47:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:23 smithi193 ceph-mon[32782]: pgmap v6191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:47:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:23 smithi193 ceph-mon[32782]: pgmap v6192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:47:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:47:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:23 smithi196 ceph-mon[32572]: pgmap v6191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:47:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:23 smithi196 ceph-mon[32572]: pgmap v6192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:47:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:47:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:23 smithi110 ceph-mon[28069]: pgmap v6191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:47:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:23 smithi110 ceph-mon[28069]: pgmap v6192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:47:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:26 smithi196 ceph-mon[32572]: pgmap v6193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:26 smithi110 ceph-mon[28069]: pgmap v6193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:26 smithi193 ceph-mon[32782]: pgmap v6193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10761.990852 secs 2024-04-26T14:47:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10761.990852 secs 2024-04-26T14:47:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10761.990852 secs 2024-04-26T14:47:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:28 smithi196 ceph-mon[32572]: pgmap v6194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:28 smithi110 ceph-mon[28069]: pgmap v6194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:28 smithi193 ceph-mon[32782]: pgmap v6194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:30 smithi196 ceph-mon[32572]: pgmap v6195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:30 smithi110 ceph-mon[28069]: pgmap v6195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:30 smithi193 ceph-mon[32782]: pgmap v6195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10766.990967 secs 2024-04-26T14:47:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:32 smithi196 ceph-mon[32572]: pgmap v6196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10766.990967 secs 2024-04-26T14:47:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:32 smithi110 ceph-mon[28069]: pgmap v6196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10766.990967 secs 2024-04-26T14:47:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:32 smithi193 ceph-mon[32782]: pgmap v6196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:47:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:34 smithi196 ceph-mon[32572]: pgmap v6197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:47:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:34 smithi110 ceph-mon[28069]: pgmap v6197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:47:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:34 smithi193 ceph-mon[32782]: pgmap v6197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:36 smithi110 ceph-mon[28069]: pgmap v6198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:36 smithi193 ceph-mon[32782]: pgmap v6198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:36 smithi196 ceph-mon[32572]: pgmap v6198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10771.991082 secs 2024-04-26T14:47:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10771.991082 secs 2024-04-26T14:47:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10771.991082 secs 2024-04-26T14:47:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:38 smithi110 ceph-mon[28069]: pgmap v6199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:38 smithi193 ceph-mon[32782]: pgmap v6199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:38 smithi196 ceph-mon[32572]: pgmap v6199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:40 smithi110 ceph-mon[28069]: pgmap v6200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:40 smithi193 ceph-mon[32782]: pgmap v6200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:40 smithi196 ceph-mon[32572]: pgmap v6200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10776.991193 secs 2024-04-26T14:47:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:42 smithi110 ceph-mon[28069]: pgmap v6201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10776.991193 secs 2024-04-26T14:47:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:42 smithi193 ceph-mon[32782]: pgmap v6201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10776.991193 secs 2024-04-26T14:47:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:42 smithi196 ceph-mon[32572]: pgmap v6201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:44 smithi110 ceph-mon[28069]: pgmap v6202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:44 smithi193 ceph-mon[32782]: pgmap v6202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:45.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:44 smithi196 ceph-mon[32572]: pgmap v6202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:46 smithi193 ceph-mon[32782]: pgmap v6203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:46 smithi196 ceph-mon[32572]: pgmap v6203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:46 smithi110 ceph-mon[28069]: pgmap v6203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10781.991312 secs 2024-04-26T14:47:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10781.991312 secs 2024-04-26T14:47:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10781.991312 secs 2024-04-26T14:47:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:48 smithi193 ceph-mon[32782]: pgmap v6204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:48 smithi196 ceph-mon[32572]: pgmap v6204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:48 smithi110 ceph-mon[28069]: pgmap v6204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:50 smithi193 ceph-mon[32782]: pgmap v6205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:50 smithi196 ceph-mon[32572]: pgmap v6205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:50 smithi110 ceph-mon[28069]: pgmap v6205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10786.991446 secs 2024-04-26T14:47:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:52 smithi193 ceph-mon[32782]: pgmap v6206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10786.991446 secs 2024-04-26T14:47:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:52 smithi196 ceph-mon[32572]: pgmap v6206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10786.991446 secs 2024-04-26T14:47:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:52 smithi110 ceph-mon[28069]: pgmap v6206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:54 smithi193 ceph-mon[32782]: pgmap v6207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:54 smithi196 ceph-mon[32572]: pgmap v6207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:54 smithi110 ceph-mon[28069]: pgmap v6207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:56 smithi193 ceph-mon[32782]: pgmap v6208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:56 smithi196 ceph-mon[32572]: pgmap v6208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:56 smithi110 ceph-mon[28069]: pgmap v6208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:47:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10791.991560 secs 2024-04-26T14:47:57.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10791.991560 secs 2024-04-26T14:47:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10791.991560 secs 2024-04-26T14:47:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:47:58 smithi193 ceph-mon[32782]: pgmap v6209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:47:58 smithi196 ceph-mon[32572]: pgmap v6209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:47:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:47:58 smithi110 ceph-mon[28069]: pgmap v6209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:00 smithi193 ceph-mon[32782]: pgmap v6210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:00 smithi196 ceph-mon[32572]: pgmap v6210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:00 smithi110 ceph-mon[28069]: pgmap v6210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10796.991676 secs 2024-04-26T14:48:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:02 smithi193 ceph-mon[32782]: pgmap v6211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10796.991676 secs 2024-04-26T14:48:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:02 smithi196 ceph-mon[32572]: pgmap v6211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10796.991676 secs 2024-04-26T14:48:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:02 smithi110 ceph-mon[28069]: pgmap v6211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:04 smithi193 ceph-mon[32782]: pgmap v6212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:04 smithi196 ceph-mon[32572]: pgmap v6212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:04 smithi110 ceph-mon[28069]: pgmap v6212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:06 smithi193 ceph-mon[32782]: pgmap v6213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:06 smithi196 ceph-mon[32572]: pgmap v6213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:06 smithi110 ceph-mon[28069]: pgmap v6213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 10801.991793 secs 2024-04-26T14:48:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:07 smithi193 ceph-mon[32782]: slow request 1441.485279 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:48:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 10801.991793 secs 2024-04-26T14:48:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:07 smithi196 ceph-mon[32572]: slow request 1441.485279 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:48:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 10801.991793 secs 2024-04-26T14:48:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:07 smithi110 ceph-mon[28069]: slow request 1441.485279 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T14:48:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:08 smithi193 ceph-mon[32782]: pgmap v6214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:08 smithi196 ceph-mon[32572]: pgmap v6214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:08 smithi110 ceph-mon[28069]: pgmap v6214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:10 smithi196 ceph-mon[32572]: pgmap v6215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:10 smithi110 ceph-mon[28069]: pgmap v6215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:10 smithi193 ceph-mon[32782]: pgmap v6215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10806.991919 secs 2024-04-26T14:48:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:12 smithi196 ceph-mon[32572]: pgmap v6216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10806.991919 secs 2024-04-26T14:48:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:12 smithi110 ceph-mon[28069]: pgmap v6216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10806.991919 secs 2024-04-26T14:48:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:12 smithi193 ceph-mon[32782]: pgmap v6216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:14 smithi196 ceph-mon[32572]: pgmap v6217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:14 smithi110 ceph-mon[28069]: pgmap v6217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:14 smithi193 ceph-mon[32782]: pgmap v6217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.399+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T14:48:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.399+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T14:48:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.399+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f2614050000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T14:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.399+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55db1be3dd30 tx=0x7f2614050000 comp rx=0 tx=0).stop 2024-04-26T14:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.399+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T14:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.399+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T14:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.399+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T14:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.399+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T14:48:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.399+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T14:48:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.401+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614013000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T14:48:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.411+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T14:48:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.411+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T14:48:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.411+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T14:48:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.411+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T14:48:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.411+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T14:48:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.412+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T14:48:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:16.412+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T14:48:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:16 smithi196 ceph-mon[32572]: pgmap v6218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:16 smithi110 ceph-mon[28069]: pgmap v6218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:16 smithi193 ceph-mon[32782]: pgmap v6218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10811.992030 secs 2024-04-26T14:48:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10811.992030 secs 2024-04-26T14:48:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10811.992030 secs 2024-04-26T14:48:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:18.129+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:48:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:18.129+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:48:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:18.130+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 86 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:48:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:48:18.130+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 86 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:48:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:18 smithi196 ceph-mon[32572]: pgmap v6219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:18 smithi110 ceph-mon[28069]: pgmap v6219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:18 smithi193 ceph-mon[32782]: pgmap v6219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:20 smithi196 ceph-mon[32572]: pgmap v6220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:20 smithi110 ceph-mon[28069]: pgmap v6220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:20 smithi193 ceph-mon[32782]: pgmap v6220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10816.992153 secs 2024-04-26T14:48:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:22 smithi196 ceph-mon[32572]: pgmap v6221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10816.992153 secs 2024-04-26T14:48:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:22 smithi110 ceph-mon[28069]: pgmap v6221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10816.992153 secs 2024-04-26T14:48:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:22 smithi193 ceph-mon[32782]: pgmap v6221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:24 smithi196 ceph-mon[32572]: pgmap v6222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:48:24.837 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:24 smithi193 ceph-mon[32782]: pgmap v6222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:24.837 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:48:24.990 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:24 smithi110 ceph-mon[28069]: pgmap v6222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:24.991 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:48:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: pgmap v6223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10821.992237 secs 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: pgmap v6223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10821.992237 secs 2024-04-26T14:48:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: pgmap v6223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10821.992237 secs 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:27.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:27 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:48:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:27 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:48:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:27 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:48:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:27 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:48:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:27 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:48:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:27 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:48:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:27 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:48:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:27 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:48:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:27 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:48:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:27 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:48:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:27 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:48:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:27 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:48:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:28 smithi193 ceph-mon[32782]: pgmap v6224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:28 smithi196 ceph-mon[32572]: pgmap v6224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:28 smithi110 ceph-mon[28069]: pgmap v6224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:48:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:48:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:48:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:48:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:48:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:48:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:48:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:30 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:48:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:30 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:48:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:30 smithi193 ceph-mon[32782]: pgmap v6225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 881 B/s rd, 1 op/s 2024-04-26T14:48:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:30 smithi193 ceph-mon[32782]: pgmap v6226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:30 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:48:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:30 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:48:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:30 smithi196 ceph-mon[32572]: pgmap v6225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 881 B/s rd, 1 op/s 2024-04-26T14:48:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:30 smithi196 ceph-mon[32572]: pgmap v6226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:30 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:48:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:30 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:48:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:30 smithi110 ceph-mon[28069]: pgmap v6225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 881 B/s rd, 1 op/s 2024-04-26T14:48:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:30 smithi110 ceph-mon[28069]: pgmap v6226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:31 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10826.992357 secs 2024-04-26T14:48:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:31 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10826.992357 secs 2024-04-26T14:48:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:31 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10826.992357 secs 2024-04-26T14:48:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:32 smithi193 ceph-mon[32782]: pgmap v6227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:32 smithi196 ceph-mon[32572]: pgmap v6227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:32 smithi110 ceph-mon[28069]: pgmap v6227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:34 smithi193 ceph-mon[32782]: pgmap v6228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:34 smithi196 ceph-mon[32572]: pgmap v6228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:34 smithi110 ceph-mon[28069]: pgmap v6228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:36 smithi193 ceph-mon[32782]: pgmap v6229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:36 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10831.992496 secs 2024-04-26T14:48:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:36 smithi196 ceph-mon[32572]: pgmap v6229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:36 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10831.992496 secs 2024-04-26T14:48:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:36 smithi110 ceph-mon[28069]: pgmap v6229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:48:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:36 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10831.992496 secs 2024-04-26T14:48:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:37 smithi196 ceph-mon[32572]: pgmap v6230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T14:48:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:37 smithi110 ceph-mon[28069]: pgmap v6230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T14:48:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:37 smithi193 ceph-mon[32782]: pgmap v6230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T14:48:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:40 smithi196 ceph-mon[32572]: pgmap v6231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:48:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:40 smithi110 ceph-mon[28069]: pgmap v6231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:48:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:40 smithi193 ceph-mon[32782]: pgmap v6231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:48:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:42 smithi196 ceph-mon[32572]: pgmap v6232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10836.992634 secs 2024-04-26T14:48:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:42 smithi110 ceph-mon[28069]: pgmap v6232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10836.992634 secs 2024-04-26T14:48:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:42 smithi193 ceph-mon[32782]: pgmap v6232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10836.992634 secs 2024-04-26T14:48:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:44 smithi196 ceph-mon[32572]: pgmap v6233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:44 smithi110 ceph-mon[28069]: pgmap v6233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:44 smithi193 ceph-mon[32782]: pgmap v6233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:46 smithi196 ceph-mon[32572]: pgmap v6234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:46 smithi110 ceph-mon[28069]: pgmap v6234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:46 smithi193 ceph-mon[32782]: pgmap v6234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10841.992746 secs 2024-04-26T14:48:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10841.992746 secs 2024-04-26T14:48:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10841.992746 secs 2024-04-26T14:48:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:48 smithi196 ceph-mon[32572]: pgmap v6235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:48 smithi110 ceph-mon[28069]: pgmap v6235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:48 smithi193 ceph-mon[32782]: pgmap v6235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:50 smithi196 ceph-mon[32572]: pgmap v6236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:50 smithi110 ceph-mon[28069]: pgmap v6236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:50 smithi193 ceph-mon[32782]: pgmap v6236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:52.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:52 smithi193 ceph-mon[32782]: pgmap v6237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:52.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10846.992863 secs 2024-04-26T14:48:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:52 smithi196 ceph-mon[32572]: pgmap v6237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10846.992863 secs 2024-04-26T14:48:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:52 smithi110 ceph-mon[28069]: pgmap v6237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10846.992863 secs 2024-04-26T14:48:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:54 smithi196 ceph-mon[32572]: pgmap v6238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:54 smithi110 ceph-mon[28069]: pgmap v6238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:54 smithi193 ceph-mon[32782]: pgmap v6238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:48:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:56 smithi196 ceph-mon[32572]: pgmap v6239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:56 smithi110 ceph-mon[28069]: pgmap v6239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:56 smithi193 ceph-mon[32782]: pgmap v6239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10851.992944 secs 2024-04-26T14:48:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10851.992944 secs 2024-04-26T14:48:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10851.992944 secs 2024-04-26T14:48:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:48:58 smithi196 ceph-mon[32572]: pgmap v6240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:48:58 smithi110 ceph-mon[28069]: pgmap v6240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:48:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:48:58 smithi193 ceph-mon[32782]: pgmap v6240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:00 smithi196 ceph-mon[32572]: pgmap v6241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:00 smithi110 ceph-mon[28069]: pgmap v6241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:00 smithi193 ceph-mon[32782]: pgmap v6241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:02 smithi196 ceph-mon[32572]: pgmap v6242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10856.993045 secs 2024-04-26T14:49:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:02 smithi110 ceph-mon[28069]: pgmap v6242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10856.993045 secs 2024-04-26T14:49:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:02 smithi193 ceph-mon[32782]: pgmap v6242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10856.993045 secs 2024-04-26T14:49:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:04 smithi196 ceph-mon[32572]: pgmap v6243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:04 smithi110 ceph-mon[28069]: pgmap v6243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:04 smithi193 ceph-mon[32782]: pgmap v6243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:05.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:49:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:49:05.405+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:49:05.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:49:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:49:05.405+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:49:05.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:49:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:49:05.405+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:49:05.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:49:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:49:05.405+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:49:05.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:49:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:49:05.405+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:49:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:06 smithi196 ceph-mon[32572]: pgmap v6244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:06 smithi110 ceph-mon[28069]: pgmap v6244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:06 smithi193 ceph-mon[32782]: pgmap v6244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10861.993190 secs 2024-04-26T14:49:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10861.993190 secs 2024-04-26T14:49:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10861.993190 secs 2024-04-26T14:49:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:08 smithi196 ceph-mon[32572]: pgmap v6245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:08 smithi110 ceph-mon[28069]: pgmap v6245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:08 smithi193 ceph-mon[32782]: pgmap v6245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:10 smithi196 ceph-mon[32572]: pgmap v6246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:49:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:10 smithi110 ceph-mon[28069]: pgmap v6246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:49:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:10 smithi193 ceph-mon[32782]: pgmap v6246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:49:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:12 smithi196 ceph-mon[32572]: pgmap v6247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:49:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10866.993305 secs 2024-04-26T14:49:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:12 smithi110 ceph-mon[28069]: pgmap v6247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:49:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10866.993305 secs 2024-04-26T14:49:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:12 smithi193 ceph-mon[32782]: pgmap v6247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:49:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10866.993305 secs 2024-04-26T14:49:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:14 smithi196 ceph-mon[32572]: pgmap v6248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:49:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:14 smithi110 ceph-mon[28069]: pgmap v6248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:49:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:14 smithi193 ceph-mon[32782]: pgmap v6248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:49:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:16 smithi196 ceph-mon[32572]: pgmap v6249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:49:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:16 smithi110 ceph-mon[28069]: pgmap v6249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:49:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:16 smithi193 ceph-mon[32782]: pgmap v6249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:49:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10871.993427 secs 2024-04-26T14:49:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10871.993427 secs 2024-04-26T14:49:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10871.993427 secs 2024-04-26T14:49:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:18 smithi196 ceph-mon[32572]: pgmap v6250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:49:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:18 smithi110 ceph-mon[28069]: pgmap v6250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:49:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:18 smithi193 ceph-mon[32782]: pgmap v6250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T14:49:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:20 smithi110 ceph-mon[28069]: pgmap v6251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:49:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:20 smithi193 ceph-mon[32782]: pgmap v6251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:49:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:20 smithi196 ceph-mon[32572]: pgmap v6251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T14:49:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:22 smithi110 ceph-mon[28069]: pgmap v6252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10876.993548 secs 2024-04-26T14:49:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:22 smithi193 ceph-mon[32782]: pgmap v6252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10876.993548 secs 2024-04-26T14:49:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:22 smithi196 ceph-mon[32572]: pgmap v6252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10876.993548 secs 2024-04-26T14:49:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:24 smithi110 ceph-mon[28069]: pgmap v6253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:24 smithi193 ceph-mon[32782]: pgmap v6253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:24 smithi196 ceph-mon[32572]: pgmap v6253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:26 smithi110 ceph-mon[28069]: pgmap v6254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:26 smithi193 ceph-mon[32782]: pgmap v6254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:26 smithi196 ceph-mon[32572]: pgmap v6254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10881.993671 secs 2024-04-26T14:49:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10881.993671 secs 2024-04-26T14:49:27.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10881.993671 secs 2024-04-26T14:49:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:28 smithi110 ceph-mon[28069]: pgmap v6255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:28 smithi193 ceph-mon[32782]: pgmap v6255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:28 smithi196 ceph-mon[32572]: pgmap v6255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:30.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:30 smithi110 ceph-mon[28069]: pgmap v6256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:30.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:49:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:30 smithi193 ceph-mon[32782]: pgmap v6256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:49:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:30 smithi196 ceph-mon[32572]: pgmap v6256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:49:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:49:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:49:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:31 smithi193 ceph-mon[32782]: pgmap v6257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T14:49:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:31 smithi193 ceph-mon[32782]: pgmap v6258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:49:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:49:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:49:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:31 smithi196 ceph-mon[32572]: pgmap v6257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T14:49:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:31 smithi196 ceph-mon[32572]: pgmap v6258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:49:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:49:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:49:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:31 smithi110 ceph-mon[28069]: pgmap v6257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T14:49:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:31 smithi110 ceph-mon[28069]: pgmap v6258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:49:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10886.993739 secs 2024-04-26T14:49:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10886.993739 secs 2024-04-26T14:49:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10886.993739 secs 2024-04-26T14:49:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:33 smithi193 ceph-mon[32782]: pgmap v6259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:33 smithi196 ceph-mon[32572]: pgmap v6259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:33 smithi110 ceph-mon[28069]: pgmap v6259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:35 smithi196 ceph-mon[32572]: pgmap v6260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:35 smithi110 ceph-mon[28069]: pgmap v6260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:35 smithi193 ceph-mon[32782]: pgmap v6260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10891.993859 secs 2024-04-26T14:49:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:37 smithi196 ceph-mon[32572]: pgmap v6261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10891.993859 secs 2024-04-26T14:49:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:37 smithi110 ceph-mon[28069]: pgmap v6261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10891.993859 secs 2024-04-26T14:49:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:37 smithi193 ceph-mon[32782]: pgmap v6261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:39 smithi196 ceph-mon[32572]: pgmap v6262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:39 smithi110 ceph-mon[28069]: pgmap v6262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:39 smithi193 ceph-mon[32782]: pgmap v6262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:49:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:41 smithi196 ceph-mon[32572]: pgmap v6263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:49:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:41 smithi110 ceph-mon[28069]: pgmap v6263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:49:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:41 smithi193 ceph-mon[32782]: pgmap v6263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:49:42.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10896.993976 secs 2024-04-26T14:49:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10896.993976 secs 2024-04-26T14:49:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10896.993976 secs 2024-04-26T14:49:43.971 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:43 smithi110 ceph-mon[28069]: pgmap v6264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:43 smithi196 ceph-mon[32572]: pgmap v6264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:43 smithi193 ceph-mon[32782]: pgmap v6264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:45 smithi110 ceph-mon[28069]: pgmap v6265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:45 smithi196 ceph-mon[32572]: pgmap v6265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:45 smithi193 ceph-mon[32782]: pgmap v6265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10901.994100 secs 2024-04-26T14:49:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:47 smithi196 ceph-mon[32572]: pgmap v6266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10901.994100 secs 2024-04-26T14:49:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:47 smithi110 ceph-mon[28069]: pgmap v6266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10901.994100 secs 2024-04-26T14:49:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:47 smithi193 ceph-mon[32782]: pgmap v6266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:48.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:49:48.144+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:49:48.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:49:48.144+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:49:48.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:49:48.145+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 87 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:49:48.146 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:49:48.145+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 87 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:49:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:49 smithi196 ceph-mon[32572]: pgmap v6267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:49 smithi110 ceph-mon[28069]: pgmap v6267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:49 smithi193 ceph-mon[32782]: pgmap v6267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:51 smithi196 ceph-mon[32572]: pgmap v6268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:51 smithi110 ceph-mon[28069]: pgmap v6268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:51 smithi193 ceph-mon[32782]: pgmap v6268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10906.994233 secs 2024-04-26T14:49:53.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10906.994233 secs 2024-04-26T14:49:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10906.994233 secs 2024-04-26T14:49:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:53 smithi196 ceph-mon[32572]: pgmap v6269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:53 smithi110 ceph-mon[28069]: pgmap v6269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:53 smithi193 ceph-mon[32782]: pgmap v6269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:49:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:55 smithi196 ceph-mon[32572]: pgmap v6270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:55 smithi110 ceph-mon[28069]: pgmap v6270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:55 smithi193 ceph-mon[32782]: pgmap v6270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10911.994323 secs 2024-04-26T14:49:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:57 smithi196 ceph-mon[32572]: pgmap v6271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10911.994323 secs 2024-04-26T14:49:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:57 smithi110 ceph-mon[28069]: pgmap v6271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:49:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10911.994323 secs 2024-04-26T14:49:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:57 smithi193 ceph-mon[32782]: pgmap v6271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:49:59 smithi196 ceph-mon[32572]: pgmap v6272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:49:59 smithi110 ceph-mon[28069]: pgmap v6272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:49:59 smithi193 ceph-mon[32782]: pgmap v6272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:50:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:50:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T14:50:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:01 smithi110 ceph-mon[28069]: pgmap v6273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:01 smithi193 ceph-mon[32782]: pgmap v6273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:01 smithi196 ceph-mon[32572]: pgmap v6273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10916.994437 secs 2024-04-26T14:50:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10916.994437 secs 2024-04-26T14:50:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10916.994437 secs 2024-04-26T14:50:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:03 smithi110 ceph-mon[28069]: pgmap v6274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:03 smithi193 ceph-mon[32782]: pgmap v6274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:03 smithi196 ceph-mon[32572]: pgmap v6274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:05 smithi110 ceph-mon[28069]: pgmap v6275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:05 smithi193 ceph-mon[32782]: pgmap v6275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:05 smithi196 ceph-mon[32572]: pgmap v6275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10921.994552 secs 2024-04-26T14:50:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:07 smithi110 ceph-mon[28069]: pgmap v6276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10921.994552 secs 2024-04-26T14:50:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:07 smithi193 ceph-mon[32782]: pgmap v6276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10921.994552 secs 2024-04-26T14:50:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:07 smithi196 ceph-mon[32572]: pgmap v6276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:09 smithi193 ceph-mon[32782]: pgmap v6277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:09 smithi196 ceph-mon[32572]: pgmap v6277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:09 smithi110 ceph-mon[28069]: pgmap v6277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:12.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:11 smithi110 ceph-mon[28069]: pgmap v6278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:11 smithi193 ceph-mon[32782]: pgmap v6278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:11 smithi196 ceph-mon[32572]: pgmap v6278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10926.994669 secs 2024-04-26T14:50:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10926.994669 secs 2024-04-26T14:50:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10926.994669 secs 2024-04-26T14:50:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:13 smithi193 ceph-mon[32782]: pgmap v6279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:13 smithi196 ceph-mon[32572]: pgmap v6279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:13 smithi110 ceph-mon[28069]: pgmap v6279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:15 smithi193 ceph-mon[32782]: pgmap v6280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:15 smithi196 ceph-mon[32572]: pgmap v6280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:15 smithi110 ceph-mon[28069]: pgmap v6280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10931.994740 secs 2024-04-26T14:50:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10931.994740 secs 2024-04-26T14:50:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10931.994740 secs 2024-04-26T14:50:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:17 smithi196 ceph-mon[32572]: pgmap v6281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:17 smithi110 ceph-mon[28069]: pgmap v6281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:17 smithi193 ceph-mon[32782]: pgmap v6281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:19 smithi196 ceph-mon[32572]: pgmap v6282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:19 smithi110 ceph-mon[28069]: pgmap v6282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:19 smithi193 ceph-mon[32782]: pgmap v6282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:21 smithi196 ceph-mon[32572]: pgmap v6283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10936.994865 secs 2024-04-26T14:50:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:21 smithi110 ceph-mon[28069]: pgmap v6283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10936.994865 secs 2024-04-26T14:50:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:21 smithi193 ceph-mon[32782]: pgmap v6283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10936.994865 secs 2024-04-26T14:50:24.172 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:23 smithi193 ceph-mon[32782]: pgmap v6284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:23 smithi196 ceph-mon[32572]: pgmap v6284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:23 smithi110 ceph-mon[28069]: pgmap v6284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:25.188 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:24 smithi193 ceph-mon[32782]: pgmap v6285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:24 smithi196 ceph-mon[32572]: pgmap v6285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:24 smithi110 ceph-mon[28069]: pgmap v6285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:27.958 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10941.994953 secs 2024-04-26T14:50:27.958 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:27 smithi196 ceph-mon[32572]: pgmap v6286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10941.994953 secs 2024-04-26T14:50:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:27 smithi110 ceph-mon[28069]: pgmap v6286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10941.994953 secs 2024-04-26T14:50:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:27 smithi193 ceph-mon[32782]: pgmap v6286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:29 smithi196 ceph-mon[32572]: pgmap v6287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:29 smithi110 ceph-mon[28069]: pgmap v6287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:29 smithi193 ceph-mon[32782]: pgmap v6287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:31 smithi196 ceph-mon[32572]: pgmap v6288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:50:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:31 smithi110 ceph-mon[28069]: pgmap v6288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:50:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:31 smithi193 ceph-mon[32782]: pgmap v6288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:50:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10946.995047 secs 2024-04-26T14:50:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:50:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:50:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:50:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10946.995047 secs 2024-04-26T14:50:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:50:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:50:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:50:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10946.995047 secs 2024-04-26T14:50:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:50:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:50:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:50:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:33 smithi196 ceph-mon[32572]: pgmap v6289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T14:50:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:33 smithi196 ceph-mon[32572]: pgmap v6290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T14:50:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:33 smithi110 ceph-mon[28069]: pgmap v6289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T14:50:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:33 smithi110 ceph-mon[28069]: pgmap v6290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T14:50:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:33 smithi193 ceph-mon[32782]: pgmap v6289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T14:50:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:33 smithi193 ceph-mon[32782]: pgmap v6290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T14:50:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:35 smithi196 ceph-mon[32572]: pgmap v6291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:35 smithi110 ceph-mon[28069]: pgmap v6291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:35 smithi193 ceph-mon[32782]: pgmap v6291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:37 smithi196 ceph-mon[32572]: pgmap v6292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10951.995163 secs 2024-04-26T14:50:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:37 smithi110 ceph-mon[28069]: pgmap v6292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10951.995163 secs 2024-04-26T14:50:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:37 smithi193 ceph-mon[32782]: pgmap v6292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10951.995163 secs 2024-04-26T14:50:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:39 smithi196 ceph-mon[32572]: pgmap v6293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:39 smithi110 ceph-mon[28069]: pgmap v6293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:39 smithi193 ceph-mon[32782]: pgmap v6293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:41 smithi196 ceph-mon[32572]: pgmap v6294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:41 smithi110 ceph-mon[28069]: pgmap v6294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:41 smithi193 ceph-mon[32782]: pgmap v6294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:50:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10956.995287 secs 2024-04-26T14:50:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10956.995287 secs 2024-04-26T14:50:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10956.995287 secs 2024-04-26T14:50:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:43 smithi110 ceph-mon[28069]: pgmap v6295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:50:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:43 smithi193 ceph-mon[32782]: pgmap v6295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:50:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:43 smithi196 ceph-mon[32572]: pgmap v6295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:50:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:45 smithi110 ceph-mon[28069]: pgmap v6296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:45 smithi193 ceph-mon[32782]: pgmap v6296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:45 smithi196 ceph-mon[32572]: pgmap v6296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:47 smithi110 ceph-mon[28069]: pgmap v6297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10961.995383 secs 2024-04-26T14:50:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:47 smithi193 ceph-mon[32782]: pgmap v6297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10961.995383 secs 2024-04-26T14:50:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:47 smithi196 ceph-mon[32572]: pgmap v6297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10961.995383 secs 2024-04-26T14:50:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:49 smithi110 ceph-mon[28069]: pgmap v6298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:49 smithi193 ceph-mon[32782]: pgmap v6298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:49 smithi196 ceph-mon[32572]: pgmap v6298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:51 smithi110 ceph-mon[28069]: pgmap v6299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:51 smithi193 ceph-mon[32782]: pgmap v6299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:51 smithi196 ceph-mon[32572]: pgmap v6299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10966.995523 secs 2024-04-26T14:50:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10966.995523 secs 2024-04-26T14:50:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10966.995523 secs 2024-04-26T14:50:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:53 smithi193 ceph-mon[32782]: pgmap v6300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:53 smithi196 ceph-mon[32572]: pgmap v6300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:53 smithi110 ceph-mon[28069]: pgmap v6300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:55 smithi193 ceph-mon[32782]: pgmap v6301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:55 smithi196 ceph-mon[32572]: pgmap v6301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:55 smithi110 ceph-mon[28069]: pgmap v6301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:50:58.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:57 smithi196 ceph-mon[32572]: pgmap v6302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:58.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10971.995659 secs 2024-04-26T14:50:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:57 smithi193 ceph-mon[32782]: pgmap v6302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10971.995659 secs 2024-04-26T14:50:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:57 smithi110 ceph-mon[28069]: pgmap v6302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:50:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10971.995659 secs 2024-04-26T14:51:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:50:59 smithi193 ceph-mon[32782]: pgmap v6303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:50:59 smithi196 ceph-mon[32572]: pgmap v6303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:50:59 smithi110 ceph-mon[28069]: pgmap v6303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:01 smithi193 ceph-mon[32782]: pgmap v6304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:01 smithi196 ceph-mon[32572]: pgmap v6304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:01 smithi110 ceph-mon[28069]: pgmap v6304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10976.995761 secs 2024-04-26T14:51:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10976.995761 secs 2024-04-26T14:51:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10976.995761 secs 2024-04-26T14:51:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:03 smithi193 ceph-mon[32782]: pgmap v6305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:03 smithi196 ceph-mon[32572]: pgmap v6305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:03 smithi110 ceph-mon[28069]: pgmap v6305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:05 smithi193 ceph-mon[32782]: pgmap v6306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:05 smithi196 ceph-mon[32572]: pgmap v6306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:05 smithi110 ceph-mon[28069]: pgmap v6306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:06 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10981.995881 secs 2024-04-26T14:51:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:06 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10981.995881 secs 2024-04-26T14:51:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:06 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10981.995881 secs 2024-04-26T14:51:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:07 smithi193 ceph-mon[32782]: pgmap v6307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:07 smithi196 ceph-mon[32572]: pgmap v6307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:07 smithi110 ceph-mon[28069]: pgmap v6307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:09 smithi193 ceph-mon[32782]: pgmap v6308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:09 smithi196 ceph-mon[32572]: pgmap v6308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:09 smithi110 ceph-mon[28069]: pgmap v6308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:11 smithi193 ceph-mon[32782]: pgmap v6309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10986.996015 secs 2024-04-26T14:51:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:11 smithi196 ceph-mon[32572]: pgmap v6309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10986.996015 secs 2024-04-26T14:51:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:11 smithi110 ceph-mon[28069]: pgmap v6309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10986.996015 secs 2024-04-26T14:51:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:13 smithi193 ceph-mon[32782]: pgmap v6310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:13 smithi196 ceph-mon[32572]: pgmap v6310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:13 smithi110 ceph-mon[28069]: pgmap v6310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:15 smithi193 ceph-mon[32782]: pgmap v6311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:15 smithi196 ceph-mon[32572]: pgmap v6311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:15 smithi110 ceph-mon[28069]: pgmap v6311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10991.996131 secs 2024-04-26T14:51:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10991.996131 secs 2024-04-26T14:51:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10991.996131 secs 2024-04-26T14:51:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:51:18.158+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:51:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:51:18.158+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:51:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:51:18.159+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 88 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:51:18.161 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:51:18.161+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 88 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:51:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:17 smithi196 ceph-mon[32572]: pgmap v6312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:17 smithi110 ceph-mon[28069]: pgmap v6312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:17 smithi193 ceph-mon[32782]: pgmap v6312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:19 smithi196 ceph-mon[32572]: pgmap v6313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:19 smithi110 ceph-mon[28069]: pgmap v6313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:19 smithi193 ceph-mon[32782]: pgmap v6313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:21 smithi196 ceph-mon[32572]: pgmap v6314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 10996.996248 secs 2024-04-26T14:51:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:21 smithi110 ceph-mon[28069]: pgmap v6314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 10996.996248 secs 2024-04-26T14:51:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:21 smithi193 ceph-mon[32782]: pgmap v6314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 10996.996248 secs 2024-04-26T14:51:24.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:23 smithi193 ceph-mon[32782]: pgmap v6315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:23 smithi196 ceph-mon[32572]: pgmap v6315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:23 smithi110 ceph-mon[28069]: pgmap v6315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:25 smithi196 ceph-mon[32572]: pgmap v6316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:25 smithi110 ceph-mon[28069]: pgmap v6316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:25 smithi193 ceph-mon[32782]: pgmap v6316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:26 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11001.996357 secs 2024-04-26T14:51:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:26 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11001.996357 secs 2024-04-26T14:51:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:26 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11001.996357 secs 2024-04-26T14:51:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:27 smithi196 ceph-mon[32572]: pgmap v6317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:27 smithi110 ceph-mon[28069]: pgmap v6317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:27 smithi193 ceph-mon[32782]: pgmap v6317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:28 smithi196 ceph-mon[32572]: pgmap v6318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:28 smithi110 ceph-mon[28069]: pgmap v6318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:28 smithi193 ceph-mon[32782]: pgmap v6318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:31 smithi196 ceph-mon[32572]: pgmap v6319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:31 smithi110 ceph-mon[28069]: pgmap v6319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:31 smithi193 ceph-mon[32782]: pgmap v6319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11006.996481 secs 2024-04-26T14:51:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11006.996481 secs 2024-04-26T14:51:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11006.996481 secs 2024-04-26T14:51:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:33 smithi196 ceph-mon[32572]: pgmap v6320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:51:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:33 smithi110 ceph-mon[28069]: pgmap v6320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:51:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:33 smithi193 ceph-mon[32782]: pgmap v6320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:51:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:51:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:51:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:34 smithi196 ceph-mon[32572]: pgmap v6321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:51:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:34 smithi196 ceph-mon[32572]: pgmap v6322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:51:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:51:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:51:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:34 smithi110 ceph-mon[28069]: pgmap v6321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:51:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:34 smithi110 ceph-mon[28069]: pgmap v6322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:51:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:51:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:51:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:34 smithi193 ceph-mon[32782]: pgmap v6321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:51:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:34 smithi193 ceph-mon[32782]: pgmap v6322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:51:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:36 smithi196 ceph-mon[32572]: pgmap v6323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:36 smithi110 ceph-mon[28069]: pgmap v6323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:36 smithi193 ceph-mon[32782]: pgmap v6323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11011.996596 secs 2024-04-26T14:51:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11011.996596 secs 2024-04-26T14:51:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11011.996596 secs 2024-04-26T14:51:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:38 smithi196 ceph-mon[32572]: pgmap v6324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:38 smithi110 ceph-mon[28069]: pgmap v6324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:38 smithi193 ceph-mon[32782]: pgmap v6324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:40 smithi196 ceph-mon[32572]: pgmap v6325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:40 smithi110 ceph-mon[28069]: pgmap v6325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:40 smithi193 ceph-mon[32782]: pgmap v6325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11016.996664 secs 2024-04-26T14:51:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:42 smithi196 ceph-mon[32572]: pgmap v6326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11016.996664 secs 2024-04-26T14:51:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:42 smithi110 ceph-mon[28069]: pgmap v6326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11016.996664 secs 2024-04-26T14:51:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:42 smithi193 ceph-mon[32782]: pgmap v6326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:51:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:44 smithi196 ceph-mon[32572]: pgmap v6327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:51:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:44 smithi110 ceph-mon[28069]: pgmap v6327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:51:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:44 smithi193 ceph-mon[32782]: pgmap v6327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:51:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:46 smithi196 ceph-mon[32572]: pgmap v6328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:46 smithi110 ceph-mon[28069]: pgmap v6328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:46 smithi193 ceph-mon[32782]: pgmap v6328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11021.996788 secs 2024-04-26T14:51:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11021.996788 secs 2024-04-26T14:51:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11021.996788 secs 2024-04-26T14:51:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:48 smithi110 ceph-mon[28069]: pgmap v6329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:48 smithi193 ceph-mon[32782]: pgmap v6329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:48 smithi196 ceph-mon[32572]: pgmap v6329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:50 smithi110 ceph-mon[28069]: pgmap v6330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:50 smithi193 ceph-mon[32782]: pgmap v6330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:50 smithi196 ceph-mon[32572]: pgmap v6330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11026.996910 secs 2024-04-26T14:51:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:52 smithi110 ceph-mon[28069]: pgmap v6331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11026.996910 secs 2024-04-26T14:51:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:52 smithi193 ceph-mon[32782]: pgmap v6331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11026.996910 secs 2024-04-26T14:51:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:52 smithi196 ceph-mon[32572]: pgmap v6331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:54 smithi193 ceph-mon[32782]: pgmap v6332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:54 smithi196 ceph-mon[32572]: pgmap v6332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:54 smithi110 ceph-mon[28069]: pgmap v6332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:56 smithi193 ceph-mon[32782]: pgmap v6333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:56 smithi196 ceph-mon[32572]: pgmap v6333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:56 smithi110 ceph-mon[28069]: pgmap v6333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:51:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11031.997030 secs 2024-04-26T14:51:58.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11031.997030 secs 2024-04-26T14:51:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11031.997030 secs 2024-04-26T14:51:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:51:58 smithi193 ceph-mon[32782]: pgmap v6334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:51:58 smithi196 ceph-mon[32572]: pgmap v6334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:51:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:51:58 smithi110 ceph-mon[28069]: pgmap v6334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:00 smithi193 ceph-mon[32782]: pgmap v6335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:00 smithi196 ceph-mon[32572]: pgmap v6335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:00 smithi110 ceph-mon[28069]: pgmap v6335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11036.997094 secs 2024-04-26T14:52:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:02 smithi193 ceph-mon[32782]: pgmap v6336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11036.997094 secs 2024-04-26T14:52:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:02 smithi196 ceph-mon[32572]: pgmap v6336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11036.997094 secs 2024-04-26T14:52:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:02 smithi110 ceph-mon[28069]: pgmap v6336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:04 smithi193 ceph-mon[32782]: pgmap v6337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:04 smithi196 ceph-mon[32572]: pgmap v6337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:04 smithi110 ceph-mon[28069]: pgmap v6337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:06 smithi193 ceph-mon[32782]: pgmap v6338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:06 smithi196 ceph-mon[32572]: pgmap v6338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:06 smithi110 ceph-mon[28069]: pgmap v6338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11041.997246 secs 2024-04-26T14:52:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11041.997246 secs 2024-04-26T14:52:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11041.997246 secs 2024-04-26T14:52:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:08 smithi193 ceph-mon[32782]: pgmap v6339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:08 smithi196 ceph-mon[32572]: pgmap v6339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:08 smithi110 ceph-mon[28069]: pgmap v6339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:10 smithi193 ceph-mon[32782]: pgmap v6340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:10 smithi196 ceph-mon[32572]: pgmap v6340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:10 smithi110 ceph-mon[28069]: pgmap v6340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11046.997393 secs 2024-04-26T14:52:12.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11046.997393 secs 2024-04-26T14:52:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11046.997393 secs 2024-04-26T14:52:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:12 smithi193 ceph-mon[32782]: pgmap v6341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:12 smithi196 ceph-mon[32572]: pgmap v6341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:12 smithi110 ceph-mon[28069]: pgmap v6341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:14 smithi193 ceph-mon[32782]: pgmap v6342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:14 smithi196 ceph-mon[32572]: pgmap v6342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:14 smithi110 ceph-mon[28069]: pgmap v6342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:16 smithi193 ceph-mon[32782]: pgmap v6343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11051.997536 secs 2024-04-26T14:52:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:16 smithi196 ceph-mon[32572]: pgmap v6343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11051.997536 secs 2024-04-26T14:52:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:16 smithi110 ceph-mon[28069]: pgmap v6343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11051.997536 secs 2024-04-26T14:52:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:18 smithi196 ceph-mon[32572]: pgmap v6344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:18 smithi110 ceph-mon[28069]: pgmap v6344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:18 smithi193 ceph-mon[32782]: pgmap v6344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:20 smithi196 ceph-mon[32572]: pgmap v6345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:20 smithi110 ceph-mon[28069]: pgmap v6345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:20 smithi193 ceph-mon[32782]: pgmap v6345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11056.997658 secs 2024-04-26T14:52:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11056.997658 secs 2024-04-26T14:52:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11056.997658 secs 2024-04-26T14:52:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:22 smithi196 ceph-mon[32572]: pgmap v6346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:22 smithi110 ceph-mon[28069]: pgmap v6346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:22 smithi193 ceph-mon[32782]: pgmap v6346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:25.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:24 smithi193 ceph-mon[32782]: pgmap v6347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:24 smithi196 ceph-mon[32572]: pgmap v6347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:24 smithi110 ceph-mon[28069]: pgmap v6347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:26 smithi196 ceph-mon[32572]: pgmap v6348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:26 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11061.997784 secs 2024-04-26T14:52:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:26 smithi110 ceph-mon[28069]: pgmap v6348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:26 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11061.997784 secs 2024-04-26T14:52:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:26 smithi193 ceph-mon[32782]: pgmap v6348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:26 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11061.997784 secs 2024-04-26T14:52:29.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:28 smithi196 ceph-mon[32572]: pgmap v6349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:28 smithi110 ceph-mon[28069]: pgmap v6349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:28 smithi193 ceph-mon[32782]: pgmap v6349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:30 smithi196 ceph-mon[32572]: pgmap v6350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:30 smithi110 ceph-mon[28069]: pgmap v6350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:30 smithi193 ceph-mon[32782]: pgmap v6350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:31 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11066.997885 secs 2024-04-26T14:52:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:31 smithi196 ceph-mon[32572]: pgmap v6351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:31 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11066.997885 secs 2024-04-26T14:52:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:31 smithi110 ceph-mon[28069]: pgmap v6351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:31 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11066.997885 secs 2024-04-26T14:52:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:31 smithi193 ceph-mon[32782]: pgmap v6351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:34 smithi196 ceph-mon[32572]: pgmap v6352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:52:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:34 smithi110 ceph-mon[28069]: pgmap v6352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:52:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:34 smithi193 ceph-mon[32782]: pgmap v6352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:52:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:52:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:52:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:52:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:52:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:52:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:52:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:52:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:52:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:52:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:36 smithi110 ceph-mon[28069]: pgmap v6353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:52:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:36 smithi110 ceph-mon[28069]: pgmap v6354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:36 smithi193 ceph-mon[32782]: pgmap v6353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:52:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:36 smithi193 ceph-mon[32782]: pgmap v6354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:36 smithi196 ceph-mon[32572]: pgmap v6353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:52:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:36 smithi196 ceph-mon[32572]: pgmap v6354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11071.997970 secs 2024-04-26T14:52:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11071.997970 secs 2024-04-26T14:52:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11071.997970 secs 2024-04-26T14:52:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:38 smithi110 ceph-mon[28069]: pgmap v6355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:52:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:38 smithi193 ceph-mon[32782]: pgmap v6355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:52:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:38 smithi196 ceph-mon[32572]: pgmap v6355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T14:52:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:40 smithi110 ceph-mon[28069]: pgmap v6356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:40 smithi193 ceph-mon[32782]: pgmap v6356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:40 smithi196 ceph-mon[32572]: pgmap v6356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:42 smithi110 ceph-mon[28069]: pgmap v6357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11076.998108 secs 2024-04-26T14:52:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:42 smithi193 ceph-mon[32782]: pgmap v6357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11076.998108 secs 2024-04-26T14:52:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:42 smithi196 ceph-mon[32572]: pgmap v6357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11076.998108 secs 2024-04-26T14:52:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:44 smithi110 ceph-mon[28069]: pgmap v6358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:44 smithi193 ceph-mon[32782]: pgmap v6358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:44 smithi196 ceph-mon[32572]: pgmap v6358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:52:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:46 smithi193 ceph-mon[32782]: pgmap v6359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:52:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:46 smithi196 ceph-mon[32572]: pgmap v6359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:52:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:46 smithi110 ceph-mon[28069]: pgmap v6359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:52:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11081.998233 secs 2024-04-26T14:52:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11081.998233 secs 2024-04-26T14:52:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11081.998233 secs 2024-04-26T14:52:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:48 smithi193 ceph-mon[32782]: pgmap v6360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:48 smithi196 ceph-mon[32572]: pgmap v6360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:48 smithi110 ceph-mon[28069]: pgmap v6360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:50 smithi193 ceph-mon[32782]: pgmap v6361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:50 smithi196 ceph-mon[32572]: pgmap v6361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:50 smithi110 ceph-mon[28069]: pgmap v6361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:52 smithi193 ceph-mon[32782]: pgmap v6362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11086.998357 secs 2024-04-26T14:52:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:52 smithi196 ceph-mon[32572]: pgmap v6362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11086.998357 secs 2024-04-26T14:52:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:52 smithi110 ceph-mon[28069]: pgmap v6362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11086.998357 secs 2024-04-26T14:52:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:54 smithi193 ceph-mon[32782]: pgmap v6363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:54 smithi196 ceph-mon[32572]: pgmap v6363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:54 smithi110 ceph-mon[28069]: pgmap v6363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:52:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:56 smithi193 ceph-mon[32782]: pgmap v6364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:56 smithi196 ceph-mon[32572]: pgmap v6364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:56 smithi110 ceph-mon[28069]: pgmap v6364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11091.998480 secs 2024-04-26T14:52:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11091.998480 secs 2024-04-26T14:52:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11091.998480 secs 2024-04-26T14:52:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:52:58 smithi193 ceph-mon[32782]: pgmap v6365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:59.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:52:58 smithi196 ceph-mon[32572]: pgmap v6365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:52:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:52:58 smithi110 ceph-mon[28069]: pgmap v6365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:00 smithi193 ceph-mon[32782]: pgmap v6366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:00 smithi196 ceph-mon[32572]: pgmap v6366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:00 smithi110 ceph-mon[28069]: pgmap v6366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:01 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11096.998605 secs 2024-04-26T14:53:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:01 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11096.998605 secs 2024-04-26T14:53:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:01 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11096.998605 secs 2024-04-26T14:53:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:02 smithi193 ceph-mon[32782]: pgmap v6367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:02 smithi196 ceph-mon[32572]: pgmap v6367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:02 smithi110 ceph-mon[28069]: pgmap v6367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:04 smithi193 ceph-mon[32782]: pgmap v6368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:04 smithi196 ceph-mon[32572]: pgmap v6368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:04 smithi110 ceph-mon[28069]: pgmap v6368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:06 smithi193 ceph-mon[32782]: pgmap v6369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:06 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11101.998699 secs 2024-04-26T14:53:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:06 smithi196 ceph-mon[32572]: pgmap v6369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:06 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11101.998699 secs 2024-04-26T14:53:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:06 smithi110 ceph-mon[28069]: pgmap v6369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:06 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11101.998699 secs 2024-04-26T14:53:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:08 smithi196 ceph-mon[32572]: pgmap v6370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:08 smithi110 ceph-mon[28069]: pgmap v6370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:08 smithi193 ceph-mon[32782]: pgmap v6370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:10 smithi196 ceph-mon[32572]: pgmap v6371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:10 smithi110 ceph-mon[28069]: pgmap v6371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:10 smithi193 ceph-mon[32782]: pgmap v6371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:12.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11106.998773 secs 2024-04-26T14:53:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11106.998773 secs 2024-04-26T14:53:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11106.998773 secs 2024-04-26T14:53:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:12 smithi196 ceph-mon[32572]: pgmap v6372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:13.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:12 smithi110 ceph-mon[28069]: pgmap v6372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:12 smithi193 ceph-mon[32782]: pgmap v6372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:14 smithi196 ceph-mon[32572]: pgmap v6373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:14 smithi110 ceph-mon[28069]: pgmap v6373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:14 smithi193 ceph-mon[32782]: pgmap v6373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:16 smithi196 ceph-mon[32572]: pgmap v6374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11111.998882 secs 2024-04-26T14:53:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:16 smithi110 ceph-mon[28069]: pgmap v6374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11111.998882 secs 2024-04-26T14:53:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:16 smithi193 ceph-mon[32782]: pgmap v6374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11111.998882 secs 2024-04-26T14:53:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:18 smithi196 ceph-mon[32572]: pgmap v6375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:18 smithi110 ceph-mon[28069]: pgmap v6375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:18 smithi193 ceph-mon[32782]: pgmap v6375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:20 smithi196 ceph-mon[32572]: pgmap v6376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:20 smithi110 ceph-mon[28069]: pgmap v6376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:20 smithi193 ceph-mon[32782]: pgmap v6376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11116.998998 secs 2024-04-26T14:53:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11116.998998 secs 2024-04-26T14:53:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11116.998998 secs 2024-04-26T14:53:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:22 smithi196 ceph-mon[32572]: pgmap v6377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:22 smithi110 ceph-mon[28069]: pgmap v6377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:22 smithi193 ceph-mon[32782]: pgmap v6377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:24 smithi110 ceph-mon[28069]: pgmap v6378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:24 smithi193 ceph-mon[32782]: pgmap v6378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:24 smithi196 ceph-mon[32572]: pgmap v6378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:26 smithi193 ceph-mon[32782]: pgmap v6379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:26 smithi196 ceph-mon[32572]: pgmap v6379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:26 smithi110 ceph-mon[28069]: pgmap v6379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11121.999114 secs 2024-04-26T14:53:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11121.999114 secs 2024-04-26T14:53:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11121.999114 secs 2024-04-26T14:53:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:28 smithi193 ceph-mon[32782]: pgmap v6380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:28 smithi196 ceph-mon[32572]: pgmap v6380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:28 smithi110 ceph-mon[28069]: pgmap v6380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:30 smithi193 ceph-mon[32782]: pgmap v6381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:30 smithi196 ceph-mon[32572]: pgmap v6381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:30 smithi110 ceph-mon[28069]: pgmap v6381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:32 smithi193 ceph-mon[32782]: pgmap v6382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11126.999249 secs 2024-04-26T14:53:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:32 smithi196 ceph-mon[32572]: pgmap v6382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11126.999249 secs 2024-04-26T14:53:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:32 smithi110 ceph-mon[28069]: pgmap v6382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11126.999249 secs 2024-04-26T14:53:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:34 smithi193 ceph-mon[32782]: pgmap v6383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:34 smithi196 ceph-mon[32572]: pgmap v6383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:34 smithi110 ceph-mon[28069]: pgmap v6383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:36 smithi193 ceph-mon[32782]: pgmap v6384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:53:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:36 smithi196 ceph-mon[32572]: pgmap v6384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:53:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:36 smithi110 ceph-mon[28069]: pgmap v6384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:53:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11131.999367 secs 2024-04-26T14:53:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:53:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:53:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:37 smithi193 ceph-mon[32782]: pgmap v6385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:53:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:37 smithi193 ceph-mon[32782]: pgmap v6386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:53:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11131.999367 secs 2024-04-26T14:53:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:53:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:53:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:37 smithi196 ceph-mon[32572]: pgmap v6385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:53:37.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:37 smithi196 ceph-mon[32572]: pgmap v6386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:37.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:53:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11131.999367 secs 2024-04-26T14:53:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:53:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:53:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:37 smithi110 ceph-mon[28069]: pgmap v6385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T14:53:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:37 smithi110 ceph-mon[28069]: pgmap v6386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:53:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:39 smithi193 ceph-mon[32782]: pgmap v6387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:39 smithi196 ceph-mon[32572]: pgmap v6387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:39 smithi110 ceph-mon[28069]: pgmap v6387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:41 smithi193 ceph-mon[32782]: pgmap v6388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11136.999449 secs 2024-04-26T14:53:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:41 smithi196 ceph-mon[32572]: pgmap v6388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11136.999449 secs 2024-04-26T14:53:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:41 smithi110 ceph-mon[28069]: pgmap v6388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11136.999449 secs 2024-04-26T14:53:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:43 smithi193 ceph-mon[32782]: pgmap v6389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:43 smithi196 ceph-mon[32572]: pgmap v6389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:43 smithi110 ceph-mon[28069]: pgmap v6389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:45 smithi193 ceph-mon[32782]: pgmap v6390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:45 smithi196 ceph-mon[32572]: pgmap v6390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:45 smithi110 ceph-mon[28069]: pgmap v6390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:53:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11141.999587 secs 2024-04-26T14:53:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11141.999587 secs 2024-04-26T14:53:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11141.999587 secs 2024-04-26T14:53:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:47 smithi196 ceph-mon[32572]: pgmap v6391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:53:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:47 smithi110 ceph-mon[28069]: pgmap v6391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:53:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:47 smithi193 ceph-mon[32782]: pgmap v6391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:53:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:49 smithi196 ceph-mon[32572]: pgmap v6392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:49 smithi110 ceph-mon[28069]: pgmap v6392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:49 smithi193 ceph-mon[32782]: pgmap v6392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:51 smithi196 ceph-mon[32572]: pgmap v6393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:51 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11146.999685 secs 2024-04-26T14:53:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:51 smithi110 ceph-mon[28069]: pgmap v6393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:51 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11146.999685 secs 2024-04-26T14:53:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:51 smithi193 ceph-mon[32782]: pgmap v6393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:51 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11146.999685 secs 2024-04-26T14:53:54.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:53 smithi196 ceph-mon[32572]: pgmap v6394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:53 smithi110 ceph-mon[28069]: pgmap v6394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:53 smithi193 ceph-mon[32782]: pgmap v6394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:53:56.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:55 smithi193 ceph-mon[32782]: pgmap v6395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:55 smithi196 ceph-mon[32572]: pgmap v6395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:55 smithi110 ceph-mon[28069]: pgmap v6395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:56 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11151.999824 secs 2024-04-26T14:53:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:56 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11151.999824 secs 2024-04-26T14:53:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:56 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11151.999824 secs 2024-04-26T14:53:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:57 smithi196 ceph-mon[32572]: pgmap v6396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:57 smithi110 ceph-mon[28069]: pgmap v6396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:53:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:57 smithi193 ceph-mon[32782]: pgmap v6396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:53:59 smithi196 ceph-mon[32572]: pgmap v6397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:53:59 smithi110 ceph-mon[28069]: pgmap v6397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:53:59 smithi193 ceph-mon[32782]: pgmap v6397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:01 smithi196 ceph-mon[32572]: pgmap v6398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:01 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11156.999922 secs 2024-04-26T14:54:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:01 smithi110 ceph-mon[28069]: pgmap v6398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:01 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11156.999922 secs 2024-04-26T14:54:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:01 smithi193 ceph-mon[32782]: pgmap v6398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:01 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11156.999922 secs 2024-04-26T14:54:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:03 smithi196 ceph-mon[32572]: pgmap v6399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:03 smithi110 ceph-mon[28069]: pgmap v6399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:03 smithi193 ceph-mon[32782]: pgmap v6399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:05.935 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:54:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:54:05.630+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:54:05.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:54:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:54:05.630+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:54:05.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:54:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:54:05.630+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:54:05.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:54:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:54:05.630+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:54:05.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:54:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:54:05.630+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:54:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:05 smithi196 ceph-mon[32572]: pgmap v6400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:54:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:05 smithi110 ceph-mon[28069]: pgmap v6400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:54:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:05 smithi193 ceph-mon[32782]: pgmap v6400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:54:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:06 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11162.000034 secs 2024-04-26T14:54:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:06 smithi196 ceph-mon[32572]: pgmap v6401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:54:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:06 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11162.000034 secs 2024-04-26T14:54:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:06 smithi110 ceph-mon[28069]: pgmap v6401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:54:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:06 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11162.000034 secs 2024-04-26T14:54:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:06 smithi193 ceph-mon[32782]: pgmap v6401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T14:54:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:09 smithi193 ceph-mon[32782]: pgmap v6402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:09 smithi196 ceph-mon[32572]: pgmap v6402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:09 smithi110 ceph-mon[28069]: pgmap v6402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:11 smithi196 ceph-mon[32572]: pgmap v6403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:12.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11167.000106 secs 2024-04-26T14:54:12.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:11 smithi110 ceph-mon[28069]: pgmap v6403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:12.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11167.000106 secs 2024-04-26T14:54:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:11 smithi193 ceph-mon[32782]: pgmap v6403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11167.000106 secs 2024-04-26T14:54:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:13 smithi196 ceph-mon[32572]: pgmap v6404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:13 smithi110 ceph-mon[28069]: pgmap v6404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:13 smithi193 ceph-mon[32782]: pgmap v6404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:15 smithi196 ceph-mon[32572]: pgmap v6405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:15 smithi110 ceph-mon[28069]: pgmap v6405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:15 smithi193 ceph-mon[32782]: pgmap v6405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11172.000197 secs 2024-04-26T14:54:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11172.000197 secs 2024-04-26T14:54:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11172.000197 secs 2024-04-26T14:54:18.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:54:18.189+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:54:18.190 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:54:18.189+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:54:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:54:18.189+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 89 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:54:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:54:18.189+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 89 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:54:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:17 smithi196 ceph-mon[32572]: pgmap v6406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:17 smithi110 ceph-mon[28069]: pgmap v6406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:17 smithi193 ceph-mon[32782]: pgmap v6406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T14:54:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:19 smithi196 ceph-mon[32572]: pgmap v6407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:54:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:19 smithi110 ceph-mon[28069]: pgmap v6407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:54:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:19 smithi193 ceph-mon[32782]: pgmap v6407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T14:54:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:21 smithi196 ceph-mon[32572]: pgmap v6408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11177.000319 secs 2024-04-26T14:54:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:21 smithi110 ceph-mon[28069]: pgmap v6408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11177.000319 secs 2024-04-26T14:54:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:21 smithi193 ceph-mon[32782]: pgmap v6408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11177.000319 secs 2024-04-26T14:54:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:23 smithi196 ceph-mon[32572]: pgmap v6409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:23 smithi110 ceph-mon[28069]: pgmap v6409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:23 smithi193 ceph-mon[32782]: pgmap v6409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:26.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:25 smithi193 ceph-mon[32782]: pgmap v6410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:25 smithi196 ceph-mon[32572]: pgmap v6410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:25 smithi110 ceph-mon[28069]: pgmap v6410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:26 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11182.000441 secs 2024-04-26T14:54:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:26 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11182.000441 secs 2024-04-26T14:54:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:26 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11182.000441 secs 2024-04-26T14:54:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:27 smithi196 ceph-mon[32572]: pgmap v6411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:27 smithi110 ceph-mon[28069]: pgmap v6411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:27 smithi193 ceph-mon[32782]: pgmap v6411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:29 smithi196 ceph-mon[32572]: pgmap v6412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:29 smithi110 ceph-mon[28069]: pgmap v6412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:29 smithi193 ceph-mon[32782]: pgmap v6412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:31 smithi196 ceph-mon[32572]: pgmap v6413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:31 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11187.000559 secs 2024-04-26T14:54:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:31 smithi110 ceph-mon[28069]: pgmap v6413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:31 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11187.000559 secs 2024-04-26T14:54:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:31 smithi193 ceph-mon[32782]: pgmap v6413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:31 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11187.000559 secs 2024-04-26T14:54:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:33 smithi196 ceph-mon[32572]: pgmap v6414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:33 smithi110 ceph-mon[28069]: pgmap v6414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:33 smithi193 ceph-mon[32782]: pgmap v6414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:34 smithi196 ceph-mon[32572]: pgmap v6415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:34 smithi110 ceph-mon[28069]: pgmap v6415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:34 smithi193 ceph-mon[32782]: pgmap v6415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:36 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11192.000675 secs 2024-04-26T14:54:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:36 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11192.000675 secs 2024-04-26T14:54:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:36 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11192.000675 secs 2024-04-26T14:54:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:37 smithi196 ceph-mon[32572]: pgmap v6416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:54:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:37 smithi110 ceph-mon[28069]: pgmap v6416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:54:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:37 smithi193 ceph-mon[32782]: pgmap v6416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:54:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:54:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:54:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:54:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:54:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:54:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:54:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:54:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:54:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:54:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:39 smithi196 ceph-mon[32572]: pgmap v6417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:54:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:39 smithi196 ceph-mon[32572]: pgmap v6418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:39 smithi110 ceph-mon[28069]: pgmap v6417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:54:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:39 smithi110 ceph-mon[28069]: pgmap v6418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:39 smithi193 ceph-mon[32782]: pgmap v6417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:54:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:39 smithi193 ceph-mon[32782]: pgmap v6418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:41 smithi196 ceph-mon[32572]: pgmap v6419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11197.000794 secs 2024-04-26T14:54:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:41 smithi110 ceph-mon[28069]: pgmap v6419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11197.000794 secs 2024-04-26T14:54:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:41 smithi193 ceph-mon[32782]: pgmap v6419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11197.000794 secs 2024-04-26T14:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:43 smithi196 ceph-mon[32572]: pgmap v6420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:54:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:43 smithi110 ceph-mon[28069]: pgmap v6420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:54:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:43 smithi193 ceph-mon[32782]: pgmap v6420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T14:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:45 smithi196 ceph-mon[32572]: pgmap v6421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:45 smithi110 ceph-mon[28069]: pgmap v6421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:45 smithi193 ceph-mon[32782]: pgmap v6421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11202.000914 secs 2024-04-26T14:54:47.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11202.000914 secs 2024-04-26T14:54:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11202.000914 secs 2024-04-26T14:54:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:47 smithi196 ceph-mon[32572]: pgmap v6422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:47 smithi110 ceph-mon[28069]: pgmap v6422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:47 smithi193 ceph-mon[32782]: pgmap v6422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:54:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:48 smithi196 ceph-mon[32572]: pgmap v6423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:54:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:48 smithi110 ceph-mon[28069]: pgmap v6423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:54:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:48 smithi193 ceph-mon[32782]: pgmap v6423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:54:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:51 smithi196 ceph-mon[32572]: pgmap v6424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:51 smithi110 ceph-mon[28069]: pgmap v6424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:51 smithi193 ceph-mon[32782]: pgmap v6424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11207.001048 secs 2024-04-26T14:54:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11207.001048 secs 2024-04-26T14:54:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11207.001048 secs 2024-04-26T14:54:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:53 smithi196 ceph-mon[32572]: pgmap v6425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:53 smithi110 ceph-mon[28069]: pgmap v6425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:53 smithi193 ceph-mon[32782]: pgmap v6425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:55 smithi196 ceph-mon[32572]: pgmap v6426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:54:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:55 smithi110 ceph-mon[28069]: pgmap v6426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:54:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:55 smithi193 ceph-mon[32782]: pgmap v6426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:54:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11212.001164 secs 2024-04-26T14:54:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:57 smithi196 ceph-mon[32572]: pgmap v6427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11212.001164 secs 2024-04-26T14:54:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:57 smithi110 ceph-mon[28069]: pgmap v6427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11212.001164 secs 2024-04-26T14:54:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:57 smithi193 ceph-mon[32782]: pgmap v6427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:54:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:54:59 smithi196 ceph-mon[32572]: pgmap v6428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:54:59 smithi110 ceph-mon[28069]: pgmap v6428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:54:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:54:59 smithi193 ceph-mon[32782]: pgmap v6428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:01 smithi196 ceph-mon[32572]: pgmap v6429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:01 smithi110 ceph-mon[28069]: pgmap v6429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:01 smithi193 ceph-mon[32782]: pgmap v6429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11217.001302 secs 2024-04-26T14:55:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11217.001302 secs 2024-04-26T14:55:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11217.001302 secs 2024-04-26T14:55:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:03 smithi196 ceph-mon[32572]: pgmap v6430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:55:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:03 smithi110 ceph-mon[28069]: pgmap v6430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:55:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:03 smithi193 ceph-mon[32782]: pgmap v6430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:55:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:05 smithi196 ceph-mon[32572]: pgmap v6431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:05 smithi110 ceph-mon[28069]: pgmap v6431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:05 smithi193 ceph-mon[32782]: pgmap v6431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11222.001418 secs 2024-04-26T14:55:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:07 smithi196 ceph-mon[32572]: pgmap v6432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:55:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11222.001418 secs 2024-04-26T14:55:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:07 smithi110 ceph-mon[28069]: pgmap v6432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:55:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11222.001418 secs 2024-04-26T14:55:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:07 smithi193 ceph-mon[32782]: pgmap v6432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:55:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:09 smithi196 ceph-mon[32572]: pgmap v6433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:09 smithi110 ceph-mon[28069]: pgmap v6433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:09 smithi193 ceph-mon[32782]: pgmap v6433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:11 smithi196 ceph-mon[32572]: pgmap v6434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:55:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:11 smithi110 ceph-mon[28069]: pgmap v6434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:55:11.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:11 smithi193 ceph-mon[32782]: pgmap v6434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T14:55:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11227.001534 secs 2024-04-26T14:55:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11227.001534 secs 2024-04-26T14:55:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11227.001534 secs 2024-04-26T14:55:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:13 smithi196 ceph-mon[32572]: pgmap v6435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:13 smithi110 ceph-mon[28069]: pgmap v6435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:13 smithi193 ceph-mon[32782]: pgmap v6435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:15 smithi110 ceph-mon[28069]: pgmap v6436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:15 smithi193 ceph-mon[32782]: pgmap v6436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:15 smithi196 ceph-mon[32572]: pgmap v6436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T14:55:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11232.001644 secs 2024-04-26T14:55:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:17 smithi110 ceph-mon[28069]: pgmap v6437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11232.001644 secs 2024-04-26T14:55:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:17 smithi193 ceph-mon[32782]: pgmap v6437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11232.001644 secs 2024-04-26T14:55:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:17 smithi196 ceph-mon[32572]: pgmap v6437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:19 smithi110 ceph-mon[28069]: pgmap v6438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:19 smithi193 ceph-mon[32782]: pgmap v6438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:19 smithi196 ceph-mon[32572]: pgmap v6438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:21 smithi110 ceph-mon[28069]: pgmap v6439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:21 smithi193 ceph-mon[32782]: pgmap v6439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:21 smithi196 ceph-mon[32572]: pgmap v6439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11237.001742 secs 2024-04-26T14:55:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11237.001742 secs 2024-04-26T14:55:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11237.001742 secs 2024-04-26T14:55:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:23 smithi110 ceph-mon[28069]: pgmap v6440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:23 smithi193 ceph-mon[32782]: pgmap v6440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:23 smithi196 ceph-mon[32572]: pgmap v6440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:25 smithi193 ceph-mon[32782]: pgmap v6441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:55:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:25 smithi196 ceph-mon[32572]: pgmap v6441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:55:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:25 smithi110 ceph-mon[28069]: pgmap v6441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:55:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11242.001860 secs 2024-04-26T14:55:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:27 smithi193 ceph-mon[32782]: pgmap v6442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11242.001860 secs 2024-04-26T14:55:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:27 smithi196 ceph-mon[32572]: pgmap v6442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11242.001860 secs 2024-04-26T14:55:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:27 smithi110 ceph-mon[28069]: pgmap v6442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:29 smithi193 ceph-mon[32782]: pgmap v6443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:29 smithi196 ceph-mon[32572]: pgmap v6443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:29 smithi110 ceph-mon[28069]: pgmap v6443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:31 smithi193 ceph-mon[32782]: pgmap v6444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:31 smithi196 ceph-mon[32572]: pgmap v6444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:31 smithi110 ceph-mon[28069]: pgmap v6444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11247.001977 secs 2024-04-26T14:55:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11247.001977 secs 2024-04-26T14:55:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11247.001977 secs 2024-04-26T14:55:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:33 smithi193 ceph-mon[32782]: pgmap v6445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:33 smithi196 ceph-mon[32572]: pgmap v6445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:33 smithi110 ceph-mon[28069]: pgmap v6445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:35 smithi193 ceph-mon[32782]: pgmap v6446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:55:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:35 smithi196 ceph-mon[32572]: pgmap v6446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:55:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:35 smithi110 ceph-mon[28069]: pgmap v6446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T14:55:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11252.002108 secs 2024-04-26T14:55:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:37 smithi193 ceph-mon[32782]: pgmap v6447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11252.002108 secs 2024-04-26T14:55:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:37 smithi196 ceph-mon[32572]: pgmap v6447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11252.002108 secs 2024-04-26T14:55:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:37 smithi110 ceph-mon[28069]: pgmap v6447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:39 smithi193 ceph-mon[32782]: pgmap v6448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:55:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:39 smithi196 ceph-mon[32572]: pgmap v6448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:55:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:39 smithi110 ceph-mon[28069]: pgmap v6448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:55:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:55:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:55:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:40 smithi193 ceph-mon[32782]: pgmap v6449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:55:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:40 smithi193 ceph-mon[32782]: pgmap v6450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:55:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:55:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:55:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:40 smithi196 ceph-mon[32572]: pgmap v6449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:55:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:40 smithi196 ceph-mon[32572]: pgmap v6450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:55:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:55:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:55:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:40 smithi110 ceph-mon[28069]: pgmap v6449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T14:55:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:40 smithi110 ceph-mon[28069]: pgmap v6450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:55:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11257.002244 secs 2024-04-26T14:55:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11257.002244 secs 2024-04-26T14:55:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11257.002244 secs 2024-04-26T14:55:43.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:42 smithi110 ceph-mon[28069]: pgmap v6451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T14:55:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:42 smithi196 ceph-mon[32572]: pgmap v6451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T14:55:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:42 smithi193 ceph-mon[32782]: pgmap v6451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T14:55:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:44 smithi110 ceph-mon[28069]: pgmap v6452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:44 smithi193 ceph-mon[32782]: pgmap v6452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:44 smithi196 ceph-mon[32572]: pgmap v6452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:46 smithi110 ceph-mon[28069]: pgmap v6453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:46 smithi193 ceph-mon[32782]: pgmap v6453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:46 smithi196 ceph-mon[32572]: pgmap v6453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11262.002386 secs 2024-04-26T14:55:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11262.002386 secs 2024-04-26T14:55:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11262.002386 secs 2024-04-26T14:55:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:48 smithi110 ceph-mon[28069]: pgmap v6454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:48 smithi193 ceph-mon[32782]: pgmap v6454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:48 smithi196 ceph-mon[32572]: pgmap v6454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:55:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:50 smithi110 ceph-mon[28069]: pgmap v6455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:55:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:50 smithi193 ceph-mon[32782]: pgmap v6455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:55:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:50 smithi196 ceph-mon[32572]: pgmap v6455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:55:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:51 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11267.002501 secs 2024-04-26T14:55:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:51 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11267.002501 secs 2024-04-26T14:55:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:51 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11267.002501 secs 2024-04-26T14:55:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:52 smithi196 ceph-mon[32572]: pgmap v6456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:52 smithi110 ceph-mon[28069]: pgmap v6456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:52 smithi193 ceph-mon[32782]: pgmap v6456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:54 smithi110 ceph-mon[28069]: pgmap v6457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:54 smithi193 ceph-mon[32782]: pgmap v6457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:54 smithi196 ceph-mon[32572]: pgmap v6457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:56 smithi110 ceph-mon[28069]: pgmap v6458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:56 smithi193 ceph-mon[32782]: pgmap v6458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:56 smithi196 ceph-mon[32572]: pgmap v6458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:55:57.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11272.002618 secs 2024-04-26T14:55:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11272.002618 secs 2024-04-26T14:55:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11272.002618 secs 2024-04-26T14:55:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:55:58 smithi110 ceph-mon[28069]: pgmap v6459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:55:58 smithi193 ceph-mon[32782]: pgmap v6459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:55:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:55:58 smithi196 ceph-mon[32572]: pgmap v6459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:00 smithi110 ceph-mon[28069]: pgmap v6460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:00 smithi193 ceph-mon[32782]: pgmap v6460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:00 smithi196 ceph-mon[32572]: pgmap v6460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:01 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11277.002736 secs 2024-04-26T14:56:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:01 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11277.002736 secs 2024-04-26T14:56:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:01 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11277.002736 secs 2024-04-26T14:56:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:02 smithi196 ceph-mon[32572]: pgmap v6461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:02 smithi110 ceph-mon[28069]: pgmap v6461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:02 smithi193 ceph-mon[32782]: pgmap v6461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:04 smithi110 ceph-mon[28069]: pgmap v6462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:04 smithi193 ceph-mon[32782]: pgmap v6462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:04 smithi196 ceph-mon[32572]: pgmap v6462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:06 smithi110 ceph-mon[28069]: pgmap v6463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:06 smithi193 ceph-mon[32782]: pgmap v6463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:06 smithi196 ceph-mon[32572]: pgmap v6463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11282.002851 secs 2024-04-26T14:56:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11282.002851 secs 2024-04-26T14:56:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11282.002851 secs 2024-04-26T14:56:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:08 smithi110 ceph-mon[28069]: pgmap v6464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:08 smithi193 ceph-mon[32782]: pgmap v6464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:08 smithi196 ceph-mon[32572]: pgmap v6464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:10 smithi110 ceph-mon[28069]: pgmap v6465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:10 smithi193 ceph-mon[32782]: pgmap v6465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:10 smithi196 ceph-mon[32572]: pgmap v6465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:11 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11287.002966 secs 2024-04-26T14:56:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:11 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11287.002966 secs 2024-04-26T14:56:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:11 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11287.002966 secs 2024-04-26T14:56:13.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:12 smithi110 ceph-mon[28069]: pgmap v6466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:12 smithi196 ceph-mon[32572]: pgmap v6466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:12 smithi193 ceph-mon[32782]: pgmap v6466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:14 smithi110 ceph-mon[28069]: pgmap v6467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:14 smithi193 ceph-mon[32782]: pgmap v6467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:14 smithi196 ceph-mon[32572]: pgmap v6467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:16 smithi110 ceph-mon[28069]: pgmap v6468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:16 smithi193 ceph-mon[32782]: pgmap v6468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:16 smithi196 ceph-mon[32572]: pgmap v6468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11292.003077 secs 2024-04-26T14:56:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11292.003077 secs 2024-04-26T14:56:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11292.003077 secs 2024-04-26T14:56:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:18 smithi110 ceph-mon[28069]: pgmap v6469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:18 smithi193 ceph-mon[32782]: pgmap v6469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:18 smithi196 ceph-mon[32572]: pgmap v6469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:20 smithi110 ceph-mon[28069]: pgmap v6470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:20 smithi193 ceph-mon[32782]: pgmap v6470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:20 smithi196 ceph-mon[32572]: pgmap v6470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:21 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11297.003214 secs 2024-04-26T14:56:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:21 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11297.003214 secs 2024-04-26T14:56:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:21 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11297.003214 secs 2024-04-26T14:56:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:22 smithi196 ceph-mon[32572]: pgmap v6471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:22 smithi110 ceph-mon[28069]: pgmap v6471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:22 smithi193 ceph-mon[32782]: pgmap v6471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:24 smithi110 ceph-mon[28069]: pgmap v6472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:24 smithi193 ceph-mon[32782]: pgmap v6472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:24 smithi196 ceph-mon[32572]: pgmap v6472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:26 smithi110 ceph-mon[28069]: pgmap v6473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:26 smithi193 ceph-mon[32782]: pgmap v6473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:26 smithi196 ceph-mon[32572]: pgmap v6473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11302.003354 secs 2024-04-26T14:56:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11302.003354 secs 2024-04-26T14:56:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11302.003354 secs 2024-04-26T14:56:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:28 smithi110 ceph-mon[28069]: pgmap v6474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:28 smithi193 ceph-mon[32782]: pgmap v6474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:28 smithi196 ceph-mon[32572]: pgmap v6474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:30 smithi110 ceph-mon[28069]: pgmap v6475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:30 smithi193 ceph-mon[32782]: pgmap v6475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:30 smithi196 ceph-mon[32572]: pgmap v6475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:31 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11307.003464 secs 2024-04-26T14:56:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:31 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11307.003464 secs 2024-04-26T14:56:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:31 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11307.003464 secs 2024-04-26T14:56:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:32 smithi196 ceph-mon[32572]: pgmap v6476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:32 smithi110 ceph-mon[28069]: pgmap v6476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:32 smithi193 ceph-mon[32782]: pgmap v6476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:34 smithi110 ceph-mon[28069]: pgmap v6477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:34 smithi193 ceph-mon[32782]: pgmap v6477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:34 smithi196 ceph-mon[32572]: pgmap v6477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:36 smithi110 ceph-mon[28069]: pgmap v6478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:36 smithi193 ceph-mon[32782]: pgmap v6478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:36 smithi196 ceph-mon[32572]: pgmap v6478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11312.003606 secs 2024-04-26T14:56:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11312.003606 secs 2024-04-26T14:56:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11312.003606 secs 2024-04-26T14:56:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:39 smithi110 ceph-mon[28069]: pgmap v6479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:39 smithi193 ceph-mon[32782]: pgmap v6479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:39 smithi196 ceph-mon[32572]: pgmap v6479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:41 smithi110 ceph-mon[28069]: pgmap v6480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:56:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:41 smithi193 ceph-mon[32782]: pgmap v6480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:56:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:41 smithi196 ceph-mon[32572]: pgmap v6480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:56:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11317.003673 secs 2024-04-26T14:56:42.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:42.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:42.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11317.003673 secs 2024-04-26T14:56:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11317.003673 secs 2024-04-26T14:56:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:43 smithi193 ceph-mon[32782]: pgmap v6481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:43 smithi196 ceph-mon[32572]: pgmap v6481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:43.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:43 smithi110 ceph-mon[28069]: pgmap v6481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: pgmap v6482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:56:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:56:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: pgmap v6483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 1 op/s 2024-04-26T14:56:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: pgmap v6484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: pgmap v6482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:56:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:56:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: pgmap v6483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 1 op/s 2024-04-26T14:56:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: pgmap v6484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: pgmap v6482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:56:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:56:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: pgmap v6483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 1 op/s 2024-04-26T14:56:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: pgmap v6484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:56:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11322.003786 secs 2024-04-26T14:56:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:47 smithi110 ceph-mon[28069]: pgmap v6485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 601 B/s rd, 1 op/s 2024-04-26T14:56:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11322.003786 secs 2024-04-26T14:56:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:47 smithi193 ceph-mon[32782]: pgmap v6485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 601 B/s rd, 1 op/s 2024-04-26T14:56:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11322.003786 secs 2024-04-26T14:56:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:47 smithi196 ceph-mon[32572]: pgmap v6485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 601 B/s rd, 1 op/s 2024-04-26T14:56:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:49 smithi193 ceph-mon[32782]: pgmap v6486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:49 smithi196 ceph-mon[32572]: pgmap v6486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:49 smithi110 ceph-mon[28069]: pgmap v6486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:51 smithi193 ceph-mon[32782]: pgmap v6487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:51 smithi196 ceph-mon[32572]: pgmap v6487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:51 smithi110 ceph-mon[28069]: pgmap v6487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11327.003901 secs 2024-04-26T14:56:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11327.003901 secs 2024-04-26T14:56:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11327.003901 secs 2024-04-26T14:56:53.839 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:53 smithi193 ceph-mon[32782]: pgmap v6488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:53.980 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:53 smithi196 ceph-mon[32572]: pgmap v6488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:53 smithi110 ceph-mon[28069]: pgmap v6488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:56:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:55 smithi193 ceph-mon[32782]: pgmap v6489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:56:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:55 smithi196 ceph-mon[32572]: pgmap v6489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:56:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:55 smithi110 ceph-mon[28069]: pgmap v6489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:56:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11332.003972 secs 2024-04-26T14:56:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:57 smithi193 ceph-mon[32782]: pgmap v6490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11332.003972 secs 2024-04-26T14:56:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:57 smithi196 ceph-mon[32572]: pgmap v6490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11332.003972 secs 2024-04-26T14:56:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:57 smithi110 ceph-mon[28069]: pgmap v6490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:56:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:56:59 smithi193 ceph-mon[32782]: pgmap v6491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:56:59 smithi196 ceph-mon[32572]: pgmap v6491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:56:59 smithi110 ceph-mon[28069]: pgmap v6491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:01 smithi193 ceph-mon[32782]: pgmap v6492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:01 smithi196 ceph-mon[32572]: pgmap v6492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:01 smithi110 ceph-mon[28069]: pgmap v6492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11337.004036 secs 2024-04-26T14:57:02.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11337.004036 secs 2024-04-26T14:57:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11337.004036 secs 2024-04-26T14:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:03 smithi193 ceph-mon[32782]: pgmap v6493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:03.921 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:03 smithi196 ceph-mon[32572]: pgmap v6493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:03 smithi110 ceph-mon[28069]: pgmap v6493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:05 smithi193 ceph-mon[32782]: pgmap v6494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:05 smithi196 ceph-mon[32572]: pgmap v6494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:05 smithi110 ceph-mon[28069]: pgmap v6494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11342.004154 secs 2024-04-26T14:57:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:07 smithi193 ceph-mon[32782]: pgmap v6495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11342.004154 secs 2024-04-26T14:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:07 smithi196 ceph-mon[32572]: pgmap v6495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11342.004154 secs 2024-04-26T14:57:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:07 smithi110 ceph-mon[28069]: pgmap v6495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:09 smithi193 ceph-mon[32782]: pgmap v6496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:09 smithi196 ceph-mon[32572]: pgmap v6496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:09 smithi110 ceph-mon[28069]: pgmap v6496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:11 smithi193 ceph-mon[32782]: pgmap v6497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:11 smithi196 ceph-mon[32572]: pgmap v6497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:11 smithi110 ceph-mon[28069]: pgmap v6497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11347.004274 secs 2024-04-26T14:57:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11347.004274 secs 2024-04-26T14:57:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11347.004274 secs 2024-04-26T14:57:13.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:13 smithi110 ceph-mon[28069]: pgmap v6498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:13 smithi196 ceph-mon[32572]: pgmap v6498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:13 smithi193 ceph-mon[32782]: pgmap v6498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:15 smithi196 ceph-mon[32572]: pgmap v6499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:15 smithi110 ceph-mon[28069]: pgmap v6499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:15 smithi193 ceph-mon[32782]: pgmap v6499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11352.004363 secs 2024-04-26T14:57:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:17 smithi196 ceph-mon[32572]: pgmap v6500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11352.004363 secs 2024-04-26T14:57:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:17 smithi110 ceph-mon[28069]: pgmap v6500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11352.004363 secs 2024-04-26T14:57:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:17 smithi193 ceph-mon[32782]: pgmap v6500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:57:18.218+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:57:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:57:18.218+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:57:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:57:18.219+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 90 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:57:18.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:57:18.219+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 90 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:57:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:19 smithi196 ceph-mon[32572]: pgmap v6501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:19 smithi110 ceph-mon[28069]: pgmap v6501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:19 smithi193 ceph-mon[32782]: pgmap v6501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:21 smithi196 ceph-mon[32572]: pgmap v6502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:21 smithi110 ceph-mon[28069]: pgmap v6502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:21 smithi193 ceph-mon[32782]: pgmap v6502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11357.004500 secs 2024-04-26T14:57:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11357.004500 secs 2024-04-26T14:57:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11357.004500 secs 2024-04-26T14:57:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:23 smithi196 ceph-mon[32572]: pgmap v6503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:23 smithi110 ceph-mon[28069]: pgmap v6503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:23 smithi193 ceph-mon[32782]: pgmap v6503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:25 smithi196 ceph-mon[32572]: pgmap v6504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:25 smithi110 ceph-mon[28069]: pgmap v6504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:25 smithi193 ceph-mon[32782]: pgmap v6504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:27.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11362.004618 secs 2024-04-26T14:57:27.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:27 smithi193 ceph-mon[32782]: pgmap v6505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11362.004618 secs 2024-04-26T14:57:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:27 smithi196 ceph-mon[32572]: pgmap v6505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11362.004618 secs 2024-04-26T14:57:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:27 smithi110 ceph-mon[28069]: pgmap v6505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:29 smithi196 ceph-mon[32572]: pgmap v6506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:29 smithi110 ceph-mon[28069]: pgmap v6506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:29 smithi193 ceph-mon[32782]: pgmap v6506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:31 smithi196 ceph-mon[32572]: pgmap v6507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:31 smithi110 ceph-mon[28069]: pgmap v6507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:31 smithi193 ceph-mon[32782]: pgmap v6507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11367.004713 secs 2024-04-26T14:57:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11367.004713 secs 2024-04-26T14:57:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11367.004713 secs 2024-04-26T14:57:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:33 smithi196 ceph-mon[32572]: pgmap v6508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:33 smithi110 ceph-mon[28069]: pgmap v6508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:33 smithi193 ceph-mon[32782]: pgmap v6508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:35 smithi196 ceph-mon[32572]: pgmap v6509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:35 smithi110 ceph-mon[28069]: pgmap v6509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:35 smithi193 ceph-mon[32782]: pgmap v6509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11372.004832 secs 2024-04-26T14:57:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:37 smithi196 ceph-mon[32572]: pgmap v6510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11372.004832 secs 2024-04-26T14:57:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:37 smithi110 ceph-mon[28069]: pgmap v6510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11372.004832 secs 2024-04-26T14:57:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:37 smithi193 ceph-mon[32782]: pgmap v6510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:39 smithi196 ceph-mon[32572]: pgmap v6511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:39 smithi110 ceph-mon[28069]: pgmap v6511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:39 smithi193 ceph-mon[32782]: pgmap v6511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:41 smithi196 ceph-mon[32572]: pgmap v6512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:41 smithi110 ceph-mon[28069]: pgmap v6512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:41 smithi193 ceph-mon[32782]: pgmap v6512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11377.004966 secs 2024-04-26T14:57:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11377.004966 secs 2024-04-26T14:57:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11377.004966 secs 2024-04-26T14:57:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:43 smithi196 ceph-mon[32572]: pgmap v6513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:43 smithi110 ceph-mon[28069]: pgmap v6513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:43 smithi193 ceph-mon[32782]: pgmap v6513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:57:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:45 smithi196 ceph-mon[32572]: pgmap v6514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:57:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:45 smithi110 ceph-mon[28069]: pgmap v6514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:57:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:45 smithi193 ceph-mon[32782]: pgmap v6514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:57:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:57:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:57:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:57:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:57:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:57:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:57:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:57:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:57:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:47 smithi196 ceph-mon[32572]: pgmap v6515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T14:57:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:47 smithi196 ceph-mon[32572]: pgmap v6516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11382.005110 secs 2024-04-26T14:57:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:47 smithi110 ceph-mon[28069]: pgmap v6515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T14:57:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:47 smithi110 ceph-mon[28069]: pgmap v6516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11382.005110 secs 2024-04-26T14:57:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:47 smithi193 ceph-mon[32782]: pgmap v6515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T14:57:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:47 smithi193 ceph-mon[32782]: pgmap v6516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11382.005110 secs 2024-04-26T14:57:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:49 smithi196 ceph-mon[32572]: pgmap v6517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:49 smithi110 ceph-mon[28069]: pgmap v6517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:49 smithi193 ceph-mon[32782]: pgmap v6517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:51 smithi110 ceph-mon[28069]: pgmap v6518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:51 smithi193 ceph-mon[32782]: pgmap v6518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:51 smithi196 ceph-mon[32572]: pgmap v6518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11387.005226 secs 2024-04-26T14:57:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11387.005226 secs 2024-04-26T14:57:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11387.005226 secs 2024-04-26T14:57:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:53 smithi110 ceph-mon[28069]: pgmap v6519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T14:57:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:53 smithi193 ceph-mon[32782]: pgmap v6519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T14:57:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:53 smithi196 ceph-mon[32572]: pgmap v6519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T14:57:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:55 smithi110 ceph-mon[28069]: pgmap v6520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:55 smithi193 ceph-mon[32782]: pgmap v6520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:55 smithi196 ceph-mon[32572]: pgmap v6520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:57:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:57 smithi110 ceph-mon[28069]: pgmap v6521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:57:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11392.005340 secs 2024-04-26T14:57:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:57 smithi193 ceph-mon[32782]: pgmap v6521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:57:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11392.005340 secs 2024-04-26T14:57:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:57 smithi196 ceph-mon[32572]: pgmap v6521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:57:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11392.005340 secs 2024-04-26T14:58:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:57:59 smithi110 ceph-mon[28069]: pgmap v6522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:57:59 smithi193 ceph-mon[32782]: pgmap v6522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:57:59 smithi196 ceph-mon[32572]: pgmap v6522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:01 smithi110 ceph-mon[28069]: pgmap v6523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:02.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:01 smithi196 ceph-mon[32572]: pgmap v6523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:01 smithi193 ceph-mon[32782]: pgmap v6523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11397.005466 secs 2024-04-26T14:58:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:58:03.227+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T14:58:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:58:03.227+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T14:58:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:58:03.228+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 91 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T14:58:03.228 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T14:58:03.228+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 91 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T14:58:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11397.005466 secs 2024-04-26T14:58:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11397.005466 secs 2024-04-26T14:58:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:03 smithi193 ceph-mon[32782]: pgmap v6524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:03 smithi196 ceph-mon[32572]: pgmap v6524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:03 smithi110 ceph-mon[28069]: pgmap v6524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:05 smithi193 ceph-mon[32782]: pgmap v6525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:05 smithi196 ceph-mon[32572]: pgmap v6525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:05 smithi110 ceph-mon[28069]: pgmap v6525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:07 smithi193 ceph-mon[32782]: pgmap v6526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11402.005611 secs 2024-04-26T14:58:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:07 smithi196 ceph-mon[32572]: pgmap v6526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11402.005611 secs 2024-04-26T14:58:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:07 smithi110 ceph-mon[28069]: pgmap v6526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11402.005611 secs 2024-04-26T14:58:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:09 smithi193 ceph-mon[32782]: pgmap v6527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:09 smithi196 ceph-mon[32572]: pgmap v6527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:09 smithi110 ceph-mon[28069]: pgmap v6527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:11 smithi193 ceph-mon[32782]: pgmap v6528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:11 smithi196 ceph-mon[32572]: pgmap v6528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:11 smithi110 ceph-mon[28069]: pgmap v6528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11407.005689 secs 2024-04-26T14:58:13.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11407.005689 secs 2024-04-26T14:58:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11407.005689 secs 2024-04-26T14:58:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:13 smithi193 ceph-mon[32782]: pgmap v6529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:13 smithi196 ceph-mon[32572]: pgmap v6529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:13 smithi110 ceph-mon[28069]: pgmap v6529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:15 smithi193 ceph-mon[32782]: pgmap v6530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:15 smithi196 ceph-mon[32572]: pgmap v6530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:15 smithi110 ceph-mon[28069]: pgmap v6530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:17 smithi193 ceph-mon[32782]: pgmap v6531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11412.005760 secs 2024-04-26T14:58:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:17 smithi196 ceph-mon[32572]: pgmap v6531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11412.005760 secs 2024-04-26T14:58:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:17 smithi110 ceph-mon[28069]: pgmap v6531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11412.005760 secs 2024-04-26T14:58:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:19 smithi193 ceph-mon[32782]: pgmap v6532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:19 smithi196 ceph-mon[32572]: pgmap v6532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:19 smithi110 ceph-mon[28069]: pgmap v6532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:21 smithi193 ceph-mon[32782]: pgmap v6533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:21 smithi196 ceph-mon[32572]: pgmap v6533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:21 smithi110 ceph-mon[28069]: pgmap v6533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11417.005821 secs 2024-04-26T14:58:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11417.005821 secs 2024-04-26T14:58:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11417.005821 secs 2024-04-26T14:58:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:23 smithi193 ceph-mon[32782]: pgmap v6534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:23 smithi196 ceph-mon[32572]: pgmap v6534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:23 smithi110 ceph-mon[28069]: pgmap v6534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:25 smithi196 ceph-mon[32572]: pgmap v6535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:26.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:25 smithi110 ceph-mon[28069]: pgmap v6535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:25 smithi193 ceph-mon[32782]: pgmap v6535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:28.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:27 smithi193 ceph-mon[32782]: pgmap v6536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:28.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11422.005922 secs 2024-04-26T14:58:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:27 smithi196 ceph-mon[32572]: pgmap v6536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11422.005922 secs 2024-04-26T14:58:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:27 smithi110 ceph-mon[28069]: pgmap v6536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11422.005922 secs 2024-04-26T14:58:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:29 smithi196 ceph-mon[32572]: pgmap v6537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:29 smithi110 ceph-mon[28069]: pgmap v6537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:29 smithi193 ceph-mon[32782]: pgmap v6537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:31 smithi196 ceph-mon[32572]: pgmap v6538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:31 smithi110 ceph-mon[28069]: pgmap v6538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:31 smithi193 ceph-mon[32782]: pgmap v6538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11427.006040 secs 2024-04-26T14:58:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11427.006040 secs 2024-04-26T14:58:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11427.006040 secs 2024-04-26T14:58:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:33 smithi196 ceph-mon[32572]: pgmap v6539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:33 smithi110 ceph-mon[28069]: pgmap v6539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:33 smithi193 ceph-mon[32782]: pgmap v6539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:35 smithi196 ceph-mon[32572]: pgmap v6540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:35 smithi110 ceph-mon[28069]: pgmap v6540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:35 smithi193 ceph-mon[32782]: pgmap v6540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:36 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11432.006162 secs 2024-04-26T14:58:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:36 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11432.006162 secs 2024-04-26T14:58:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:36 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11432.006162 secs 2024-04-26T14:58:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:37 smithi196 ceph-mon[32572]: pgmap v6541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:37 smithi110 ceph-mon[28069]: pgmap v6541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:37 smithi193 ceph-mon[32782]: pgmap v6541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:39 smithi196 ceph-mon[32572]: pgmap v6542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:39 smithi110 ceph-mon[28069]: pgmap v6542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:39 smithi193 ceph-mon[32782]: pgmap v6542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:41 smithi196 ceph-mon[32572]: pgmap v6543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11437.006224 secs 2024-04-26T14:58:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:41 smithi110 ceph-mon[28069]: pgmap v6543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11437.006224 secs 2024-04-26T14:58:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:41 smithi193 ceph-mon[32782]: pgmap v6543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11437.006224 secs 2024-04-26T14:58:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:43 smithi196 ceph-mon[32572]: pgmap v6544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:43 smithi110 ceph-mon[28069]: pgmap v6544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:43 smithi193 ceph-mon[32782]: pgmap v6544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:45 smithi196 ceph-mon[32572]: pgmap v6545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:45 smithi110 ceph-mon[28069]: pgmap v6545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:45 smithi193 ceph-mon[32782]: pgmap v6545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:47.208 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11442.006348 secs 2024-04-26T14:58:47.209 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:58:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11442.006348 secs 2024-04-26T14:58:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:58:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11442.006348 secs 2024-04-26T14:58:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:58:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:47 smithi196 ceph-mon[32572]: pgmap v6546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:47 smithi110 ceph-mon[28069]: pgmap v6546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:47 smithi193 ceph-mon[32782]: pgmap v6546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: pgmap v6547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: pgmap v6547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: pgmap v6547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:58:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:58:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:58:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T14:58:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T14:58:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T14:58:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T14:58:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:51 smithi196 ceph-mon[32572]: pgmap v6548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:51 smithi110 ceph-mon[28069]: pgmap v6548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:51 smithi193 ceph-mon[32782]: pgmap v6548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:52.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11447.006502 secs 2024-04-26T14:58:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11447.006502 secs 2024-04-26T14:58:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11447.006502 secs 2024-04-26T14:58:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:53 smithi110 ceph-mon[28069]: pgmap v6549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:53 smithi193 ceph-mon[32782]: pgmap v6549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:53 smithi196 ceph-mon[32572]: pgmap v6549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:55 smithi110 ceph-mon[28069]: pgmap v6550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:55 smithi193 ceph-mon[32782]: pgmap v6550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:55 smithi196 ceph-mon[32572]: pgmap v6550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: pgmap v6551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11452.006620 secs 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:58:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:58:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:58:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:58:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: pgmap v6552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 943 B/s rd, 1 op/s 2024-04-26T14:58:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: pgmap v6553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 578 B/s rd, 1 op/s 2024-04-26T14:58:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: pgmap v6551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11452.006620 secs 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:58:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:58:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:58:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:58:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: pgmap v6552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 943 B/s rd, 1 op/s 2024-04-26T14:58:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: pgmap v6553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 578 B/s rd, 1 op/s 2024-04-26T14:58:57.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: pgmap v6551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11452.006620 secs 2024-04-26T14:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: pgmap v6552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 943 B/s rd, 1 op/s 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: pgmap v6553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 578 B/s rd, 1 op/s 2024-04-26T14:58:58.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:58:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:58:59 smithi193 ceph-mon[32782]: pgmap v6554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:58:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:58:59 smithi196 ceph-mon[32572]: pgmap v6554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:58:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:58:59 smithi110 ceph-mon[28069]: pgmap v6554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:01 smithi193 ceph-mon[32782]: pgmap v6555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:01.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:01 smithi196 ceph-mon[32572]: pgmap v6555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:01 smithi110 ceph-mon[28069]: pgmap v6555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11457.006716 secs 2024-04-26T14:59:02.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11457.006716 secs 2024-04-26T14:59:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11457.006716 secs 2024-04-26T14:59:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:03 smithi193 ceph-mon[32782]: pgmap v6556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:03 smithi196 ceph-mon[32572]: pgmap v6556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:03 smithi110 ceph-mon[28069]: pgmap v6556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:05 smithi193 ceph-mon[32782]: pgmap v6557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:05 smithi196 ceph-mon[32572]: pgmap v6557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:05.538 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:05 smithi110 ceph-mon[28069]: pgmap v6557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T14:59:05.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:59:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:59:05.728+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:59:05.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:59:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:59:05.728+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:59:05.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:59:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:59:05.728+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:59:05.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:59:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:59:05.728+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:59:05.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 14:59:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T14:59:05.728+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T14:59:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:06 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11462.006832 secs 2024-04-26T14:59:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:06 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11462.006832 secs 2024-04-26T14:59:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:06 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11462.006832 secs 2024-04-26T14:59:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:07 smithi196 ceph-mon[32572]: pgmap v6558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:59:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:07 smithi110 ceph-mon[28069]: pgmap v6558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:59:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:07 smithi193 ceph-mon[32782]: pgmap v6558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T14:59:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:09 smithi193 ceph-mon[32782]: pgmap v6559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:59:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:09 smithi196 ceph-mon[32572]: pgmap v6559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:59:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:09 smithi110 ceph-mon[28069]: pgmap v6559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:59:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:11 smithi193 ceph-mon[32782]: pgmap v6560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:59:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:11 smithi196 ceph-mon[32572]: pgmap v6560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:59:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:11 smithi110 ceph-mon[28069]: pgmap v6560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:59:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11467.006981 secs 2024-04-26T14:59:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11467.006981 secs 2024-04-26T14:59:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11467.006981 secs 2024-04-26T14:59:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:13 smithi193 ceph-mon[32782]: pgmap v6561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:59:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:13 smithi196 ceph-mon[32572]: pgmap v6561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:59:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:13 smithi110 ceph-mon[28069]: pgmap v6561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:59:15.342 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:15 smithi110 ceph-mon[28069]: pgmap v6562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:59:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:15 smithi193 ceph-mon[32782]: pgmap v6562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:59:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:15 smithi196 ceph-mon[32572]: pgmap v6562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:59:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:16 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11472.007049 secs 2024-04-26T14:59:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:16 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11472.007049 secs 2024-04-26T14:59:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:16 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11472.007049 secs 2024-04-26T14:59:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:17 smithi196 ceph-mon[32572]: pgmap v6563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:59:18.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:17 smithi110 ceph-mon[28069]: pgmap v6563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:59:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:17 smithi193 ceph-mon[32782]: pgmap v6563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T14:59:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:19 smithi193 ceph-mon[32782]: pgmap v6564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:59:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:19 smithi196 ceph-mon[32572]: pgmap v6564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:59:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:19 smithi110 ceph-mon[28069]: pgmap v6564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T14:59:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:21 smithi193 ceph-mon[32782]: pgmap v6565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:21 smithi196 ceph-mon[32572]: pgmap v6565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:21 smithi110 ceph-mon[28069]: pgmap v6565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11477.007189 secs 2024-04-26T14:59:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11477.007189 secs 2024-04-26T14:59:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11477.007189 secs 2024-04-26T14:59:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:23 smithi193 ceph-mon[32782]: pgmap v6566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:23 smithi196 ceph-mon[32572]: pgmap v6566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:23 smithi110 ceph-mon[28069]: pgmap v6566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:25 smithi193 ceph-mon[32782]: pgmap v6567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:25 smithi196 ceph-mon[32572]: pgmap v6567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:25 smithi110 ceph-mon[28069]: pgmap v6567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:26 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11482.007336 secs 2024-04-26T14:59:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:26 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11482.007336 secs 2024-04-26T14:59:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:26 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11482.007336 secs 2024-04-26T14:59:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:27 smithi196 ceph-mon[32572]: pgmap v6568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:27 smithi110 ceph-mon[28069]: pgmap v6568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:27 smithi193 ceph-mon[32782]: pgmap v6568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:29 smithi193 ceph-mon[32782]: pgmap v6569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:29 smithi196 ceph-mon[32572]: pgmap v6569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:29 smithi110 ceph-mon[28069]: pgmap v6569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:31 smithi193 ceph-mon[32782]: pgmap v6570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:31 smithi196 ceph-mon[32572]: pgmap v6570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:31 smithi110 ceph-mon[28069]: pgmap v6570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11487.007460 secs 2024-04-26T14:59:32.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11487.007460 secs 2024-04-26T14:59:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11487.007460 secs 2024-04-26T14:59:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:33 smithi193 ceph-mon[32782]: pgmap v6571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:33 smithi196 ceph-mon[32572]: pgmap v6571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:33 smithi110 ceph-mon[28069]: pgmap v6571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:35 smithi193 ceph-mon[32782]: pgmap v6572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:35 smithi196 ceph-mon[32572]: pgmap v6572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:35 smithi110 ceph-mon[28069]: pgmap v6572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:36 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11492.007591 secs 2024-04-26T14:59:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:36 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11492.007591 secs 2024-04-26T14:59:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:36 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11492.007591 secs 2024-04-26T14:59:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:37 smithi196 ceph-mon[32572]: pgmap v6573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:37 smithi110 ceph-mon[28069]: pgmap v6573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:37 smithi193 ceph-mon[32782]: pgmap v6573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:39 smithi193 ceph-mon[32782]: pgmap v6574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:39 smithi196 ceph-mon[32572]: pgmap v6574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:39 smithi110 ceph-mon[28069]: pgmap v6574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:41 smithi193 ceph-mon[32782]: pgmap v6575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:41 smithi196 ceph-mon[32572]: pgmap v6575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:41 smithi110 ceph-mon[28069]: pgmap v6575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11497.007717 secs 2024-04-26T14:59:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11497.007717 secs 2024-04-26T14:59:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11497.007717 secs 2024-04-26T14:59:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:43 smithi193 ceph-mon[32782]: pgmap v6576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:43 smithi196 ceph-mon[32572]: pgmap v6576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:43 smithi110 ceph-mon[28069]: pgmap v6576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:45.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:45 smithi110 ceph-mon[28069]: pgmap v6577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:45 smithi193 ceph-mon[32782]: pgmap v6577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:45 smithi196 ceph-mon[32572]: pgmap v6577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11502.007841 secs 2024-04-26T14:59:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11502.007841 secs 2024-04-26T14:59:47.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11502.007841 secs 2024-04-26T14:59:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:47 smithi196 ceph-mon[32572]: pgmap v6578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:47 smithi110 ceph-mon[28069]: pgmap v6578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:47 smithi193 ceph-mon[32782]: pgmap v6578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:49 smithi193 ceph-mon[32782]: pgmap v6579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:49 smithi196 ceph-mon[32572]: pgmap v6579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:49 smithi110 ceph-mon[28069]: pgmap v6579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:51 smithi193 ceph-mon[32782]: pgmap v6580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:51 smithi196 ceph-mon[32572]: pgmap v6580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:51 smithi110 ceph-mon[28069]: pgmap v6580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11507.007918 secs 2024-04-26T14:59:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11507.007918 secs 2024-04-26T14:59:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11507.007918 secs 2024-04-26T14:59:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:53 smithi193 ceph-mon[32782]: pgmap v6581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:53 smithi196 ceph-mon[32572]: pgmap v6581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:53 smithi110 ceph-mon[28069]: pgmap v6581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T14:59:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:55 smithi193 ceph-mon[32782]: pgmap v6582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:55 smithi196 ceph-mon[32572]: pgmap v6582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:55 smithi110 ceph-mon[28069]: pgmap v6582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:56 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11512.008034 secs 2024-04-26T14:59:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:56 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11512.008034 secs 2024-04-26T14:59:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:56 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11512.008034 secs 2024-04-26T14:59:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:57 smithi196 ceph-mon[32572]: pgmap v6583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:59:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:57 smithi110 ceph-mon[28069]: pgmap v6583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:59:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:57 smithi193 ceph-mon[32782]: pgmap v6583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T14:59:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T14:59:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:59:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:59:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:59 smithi196 ceph-mon[32572]: pgmap v6584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:59:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:59 smithi196 ceph-mon[32572]: pgmap v6585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:59:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 14:59:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:59:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:59:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:59:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:59 smithi110 ceph-mon[28069]: pgmap v6584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:59:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:59 smithi110 ceph-mon[28069]: pgmap v6585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:59:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 14:59:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T14:59:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T14:59:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T14:59:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:59 smithi193 ceph-mon[32782]: pgmap v6584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T14:59:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:59 smithi193 ceph-mon[32782]: pgmap v6585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T14:59:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 14:59:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:00:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:00:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:00:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:00:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:01 smithi196 ceph-mon[32572]: pgmap v6586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:01 smithi110 ceph-mon[28069]: pgmap v6586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:01 smithi193 ceph-mon[32782]: pgmap v6586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11517.008175 secs 2024-04-26T15:00:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11517.008175 secs 2024-04-26T15:00:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11517.008175 secs 2024-04-26T15:00:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:03 smithi196 ceph-mon[32572]: pgmap v6587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:03 smithi110 ceph-mon[28069]: pgmap v6587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:03 smithi193 ceph-mon[32782]: pgmap v6587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:05 smithi196 ceph-mon[32572]: pgmap v6588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:05 smithi110 ceph-mon[28069]: pgmap v6588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:05 smithi193 ceph-mon[32782]: pgmap v6588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:07 smithi196 ceph-mon[32572]: 11 slow requests, 2 included below; oldest blocked for > 11522.008293 secs 2024-04-26T15:00:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:07 smithi196 ceph-mon[32572]: slow request 11522.008293 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T15:00:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:07 smithi196 ceph-mon[32572]: slow request 5763.263587 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:00:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:07 smithi196 ceph-mon[32572]: pgmap v6589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:07 smithi110 ceph-mon[28069]: 11 slow requests, 2 included below; oldest blocked for > 11522.008293 secs 2024-04-26T15:00:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:07 smithi110 ceph-mon[28069]: slow request 11522.008293 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T15:00:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:07 smithi110 ceph-mon[28069]: slow request 5763.263587 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:00:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:07 smithi110 ceph-mon[28069]: pgmap v6589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:07 smithi193 ceph-mon[32782]: 11 slow requests, 2 included below; oldest blocked for > 11522.008293 secs 2024-04-26T15:00:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:07 smithi193 ceph-mon[32782]: slow request 11522.008293 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T15:00:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:07 smithi193 ceph-mon[32782]: slow request 5763.263587 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:00:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:07 smithi193 ceph-mon[32782]: pgmap v6589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:00:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:09 smithi196 ceph-mon[32572]: pgmap v6590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:00:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:09 smithi110 ceph-mon[28069]: pgmap v6590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:00:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:09 smithi193 ceph-mon[32782]: pgmap v6590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:00:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:11 smithi196 ceph-mon[32572]: pgmap v6591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:11 smithi110 ceph-mon[28069]: pgmap v6591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:11 smithi193 ceph-mon[32782]: pgmap v6591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11527.008410 secs 2024-04-26T15:00:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11527.008410 secs 2024-04-26T15:00:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11527.008410 secs 2024-04-26T15:00:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:13 smithi196 ceph-mon[32572]: pgmap v6592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:13 smithi110 ceph-mon[28069]: pgmap v6592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:13 smithi193 ceph-mon[32782]: pgmap v6592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:15 smithi196 ceph-mon[32572]: pgmap v6593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:15 smithi110 ceph-mon[28069]: pgmap v6593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:15 smithi193 ceph-mon[32782]: pgmap v6593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11532.008533 secs 2024-04-26T15:00:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:17 smithi196 ceph-mon[32572]: pgmap v6594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11532.008533 secs 2024-04-26T15:00:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:17 smithi110 ceph-mon[28069]: pgmap v6594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11532.008533 secs 2024-04-26T15:00:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:17 smithi193 ceph-mon[32782]: pgmap v6594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:00:18.248+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T15:00:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:00:18.248+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:00:18.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:00:18.249+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 92 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:00:18.250 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:00:18.249+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 92 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T15:00:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:19 smithi196 ceph-mon[32572]: pgmap v6595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:19 smithi110 ceph-mon[28069]: pgmap v6595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:19 smithi193 ceph-mon[32782]: pgmap v6595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:21 smithi196 ceph-mon[32572]: pgmap v6596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:21 smithi110 ceph-mon[28069]: pgmap v6596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:21 smithi193 ceph-mon[32782]: pgmap v6596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11537.008623 secs 2024-04-26T15:00:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11537.008623 secs 2024-04-26T15:00:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11537.008623 secs 2024-04-26T15:00:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:23 smithi196 ceph-mon[32572]: pgmap v6597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:23 smithi110 ceph-mon[28069]: pgmap v6597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:23 smithi193 ceph-mon[32782]: pgmap v6597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:25 smithi196 ceph-mon[32572]: pgmap v6598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:25 smithi110 ceph-mon[28069]: pgmap v6598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:25 smithi193 ceph-mon[32782]: pgmap v6598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11542.008733 secs 2024-04-26T15:00:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:27 smithi196 ceph-mon[32572]: pgmap v6599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11542.008733 secs 2024-04-26T15:00:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:27 smithi110 ceph-mon[28069]: pgmap v6599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11542.008733 secs 2024-04-26T15:00:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:27 smithi193 ceph-mon[32782]: pgmap v6599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:29 smithi196 ceph-mon[32572]: pgmap v6600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:29 smithi110 ceph-mon[28069]: pgmap v6600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:29 smithi193 ceph-mon[32782]: pgmap v6600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:31 smithi196 ceph-mon[32572]: pgmap v6601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:31 smithi110 ceph-mon[28069]: pgmap v6601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:31 smithi193 ceph-mon[32782]: pgmap v6601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11547.008842 secs 2024-04-26T15:00:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11547.008842 secs 2024-04-26T15:00:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11547.008842 secs 2024-04-26T15:00:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:33 smithi196 ceph-mon[32572]: pgmap v6602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:33 smithi110 ceph-mon[28069]: pgmap v6602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:33 smithi193 ceph-mon[32782]: pgmap v6602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:35 smithi196 ceph-mon[32572]: pgmap v6603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:35 smithi110 ceph-mon[28069]: pgmap v6603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:35 smithi193 ceph-mon[32782]: pgmap v6603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11552.008957 secs 2024-04-26T15:00:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:37 smithi196 ceph-mon[32572]: pgmap v6604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11552.008957 secs 2024-04-26T15:00:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:37 smithi110 ceph-mon[28069]: pgmap v6604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11552.008957 secs 2024-04-26T15:00:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:37 smithi193 ceph-mon[32782]: pgmap v6604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:40.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:39 smithi196 ceph-mon[32572]: pgmap v6605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:39 smithi110 ceph-mon[28069]: pgmap v6605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:39 smithi193 ceph-mon[32782]: pgmap v6605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:41 smithi196 ceph-mon[32572]: pgmap v6606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:41 smithi110 ceph-mon[28069]: pgmap v6606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:41 smithi193 ceph-mon[32782]: pgmap v6606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11557.009063 secs 2024-04-26T15:00:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11557.009063 secs 2024-04-26T15:00:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11557.009063 secs 2024-04-26T15:00:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:43 smithi110 ceph-mon[28069]: pgmap v6607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:43 smithi193 ceph-mon[32782]: pgmap v6607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:43 smithi196 ceph-mon[32572]: pgmap v6607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:45 smithi110 ceph-mon[28069]: pgmap v6608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:45 smithi193 ceph-mon[32782]: pgmap v6608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:45 smithi196 ceph-mon[32572]: pgmap v6608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11562.009178 secs 2024-04-26T15:00:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:47 smithi110 ceph-mon[28069]: pgmap v6609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11562.009178 secs 2024-04-26T15:00:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:47 smithi193 ceph-mon[32782]: pgmap v6609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11562.009178 secs 2024-04-26T15:00:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:47 smithi196 ceph-mon[32572]: pgmap v6609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:49 smithi110 ceph-mon[28069]: pgmap v6610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:49 smithi193 ceph-mon[32782]: pgmap v6610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:49 smithi196 ceph-mon[32572]: pgmap v6610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:51 smithi110 ceph-mon[28069]: pgmap v6611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:51 smithi193 ceph-mon[32782]: pgmap v6611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:51 smithi196 ceph-mon[32572]: pgmap v6611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11567.009299 secs 2024-04-26T15:00:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11567.009299 secs 2024-04-26T15:00:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11567.009299 secs 2024-04-26T15:00:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:53 smithi193 ceph-mon[32782]: pgmap v6612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:53 smithi196 ceph-mon[32572]: pgmap v6612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:53 smithi110 ceph-mon[28069]: pgmap v6612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:00:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:55 smithi193 ceph-mon[32782]: pgmap v6613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:55 smithi196 ceph-mon[32572]: pgmap v6613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:55 smithi110 ceph-mon[28069]: pgmap v6613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11572.009439 secs 2024-04-26T15:00:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:57 smithi193 ceph-mon[32782]: pgmap v6614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11572.009439 secs 2024-04-26T15:00:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:57 smithi196 ceph-mon[32572]: pgmap v6614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:00:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11572.009439 secs 2024-04-26T15:00:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:57 smithi110 ceph-mon[28069]: pgmap v6614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:59 smithi193 ceph-mon[32782]: pgmap v6615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:00:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:01:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:59 smithi196 ceph-mon[32572]: pgmap v6615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:00:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:01:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:59 smithi110 ceph-mon[28069]: pgmap v6615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:00:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:01:01.118 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:01:01.119 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:01:01.119 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:01:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:01:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:01:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:01:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:01:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:01:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:01:01.826 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:01 smithi110 ceph-mon[28069]: pgmap v6616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:01:01.826 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:01 smithi110 ceph-mon[28069]: pgmap v6617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:01 smithi193 ceph-mon[32782]: pgmap v6616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:01:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:01 smithi193 ceph-mon[32782]: pgmap v6617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:02.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:01 smithi196 ceph-mon[32572]: pgmap v6616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:01:02.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:01 smithi196 ceph-mon[32572]: pgmap v6617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11577.009548 secs 2024-04-26T15:01:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11577.009548 secs 2024-04-26T15:01:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11577.009548 secs 2024-04-26T15:01:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:03 smithi193 ceph-mon[32782]: pgmap v6618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:01:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:03 smithi196 ceph-mon[32572]: pgmap v6618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:01:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:03 smithi110 ceph-mon[28069]: pgmap v6618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:01:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:05 smithi193 ceph-mon[32782]: pgmap v6619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:05 smithi196 ceph-mon[32572]: pgmap v6619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:05 smithi110 ceph-mon[28069]: pgmap v6619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:07 smithi193 ceph-mon[32782]: pgmap v6620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 11582.009678 secs 2024-04-26T15:01:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:07 smithi193 ceph-mon[32782]: slow request 11522.032140 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T15:01:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:07 smithi196 ceph-mon[32572]: pgmap v6620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 11582.009678 secs 2024-04-26T15:01:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:07 smithi196 ceph-mon[32572]: slow request 11522.032140 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T15:01:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:07 smithi110 ceph-mon[28069]: pgmap v6620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 11582.009678 secs 2024-04-26T15:01:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:07 smithi110 ceph-mon[28069]: slow request 11522.032140 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T15:01:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:09 smithi193 ceph-mon[32782]: pgmap v6621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:09 smithi196 ceph-mon[32572]: pgmap v6621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:09 smithi110 ceph-mon[28069]: pgmap v6621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:01:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:11 smithi193 ceph-mon[32782]: pgmap v6622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:01:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:11 smithi196 ceph-mon[32572]: pgmap v6622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:01:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:11 smithi110 ceph-mon[28069]: pgmap v6622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:01:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11587.009796 secs 2024-04-26T15:01:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11587.009796 secs 2024-04-26T15:01:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11587.009796 secs 2024-04-26T15:01:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:13 smithi193 ceph-mon[32782]: pgmap v6623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:13 smithi196 ceph-mon[32572]: pgmap v6623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:13 smithi110 ceph-mon[28069]: pgmap v6623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:15 smithi196 ceph-mon[32572]: pgmap v6624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:15 smithi110 ceph-mon[28069]: pgmap v6624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:15 smithi193 ceph-mon[32782]: pgmap v6624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:17 smithi196 ceph-mon[32572]: pgmap v6625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11592.009922 secs 2024-04-26T15:01:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:17 smithi110 ceph-mon[28069]: pgmap v6625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11592.009922 secs 2024-04-26T15:01:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:17 smithi193 ceph-mon[32782]: pgmap v6625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11592.009922 secs 2024-04-26T15:01:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:19 smithi196 ceph-mon[32572]: pgmap v6626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:19 smithi110 ceph-mon[28069]: pgmap v6626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:20.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:19 smithi193 ceph-mon[32782]: pgmap v6626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:21 smithi196 ceph-mon[32572]: pgmap v6627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:01:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:21 smithi110 ceph-mon[28069]: pgmap v6627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:01:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:21 smithi193 ceph-mon[32782]: pgmap v6627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:01:23.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11597.010040 secs 2024-04-26T15:01:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11597.010040 secs 2024-04-26T15:01:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11597.010040 secs 2024-04-26T15:01:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:23 smithi196 ceph-mon[32572]: pgmap v6628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:01:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:23 smithi110 ceph-mon[28069]: pgmap v6628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:01:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:23 smithi193 ceph-mon[32782]: pgmap v6628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:01:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:25 smithi196 ceph-mon[32572]: pgmap v6629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:25 smithi110 ceph-mon[28069]: pgmap v6629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:25 smithi193 ceph-mon[32782]: pgmap v6629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:27 smithi196 ceph-mon[32572]: pgmap v6630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:01:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11602.010161 secs 2024-04-26T15:01:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:27 smithi110 ceph-mon[28069]: pgmap v6630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:01:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11602.010161 secs 2024-04-26T15:01:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:27 smithi193 ceph-mon[32782]: pgmap v6630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:01:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11602.010161 secs 2024-04-26T15:01:30.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:29 smithi193 ceph-mon[32782]: pgmap v6631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:29 smithi196 ceph-mon[32572]: pgmap v6631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:29 smithi110 ceph-mon[28069]: pgmap v6631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:31 smithi196 ceph-mon[32572]: pgmap v6632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:31 smithi110 ceph-mon[28069]: pgmap v6632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:31 smithi193 ceph-mon[32782]: pgmap v6632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11607.010284 secs 2024-04-26T15:01:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11607.010284 secs 2024-04-26T15:01:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11607.010284 secs 2024-04-26T15:01:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:33 smithi196 ceph-mon[32572]: pgmap v6633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:33 smithi110 ceph-mon[28069]: pgmap v6633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:33 smithi193 ceph-mon[32782]: pgmap v6633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:35 smithi196 ceph-mon[32572]: pgmap v6634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:35 smithi110 ceph-mon[28069]: pgmap v6634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:35 smithi193 ceph-mon[32782]: pgmap v6634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:36 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11612.010434 secs 2024-04-26T15:01:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:36 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11612.010434 secs 2024-04-26T15:01:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:36 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11612.010434 secs 2024-04-26T15:01:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:37 smithi196 ceph-mon[32572]: pgmap v6635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:37 smithi110 ceph-mon[28069]: pgmap v6635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:37 smithi193 ceph-mon[32782]: pgmap v6635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:39 smithi196 ceph-mon[32572]: pgmap v6636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:39 smithi110 ceph-mon[28069]: pgmap v6636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:39 smithi193 ceph-mon[32782]: pgmap v6636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:41 smithi196 ceph-mon[32572]: pgmap v6637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:41 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11617.010580 secs 2024-04-26T15:01:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:41 smithi110 ceph-mon[28069]: pgmap v6637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:41 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11617.010580 secs 2024-04-26T15:01:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:41 smithi193 ceph-mon[32782]: pgmap v6637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:41 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11617.010580 secs 2024-04-26T15:01:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:43 smithi196 ceph-mon[32572]: pgmap v6638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:43 smithi110 ceph-mon[28069]: pgmap v6638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:43 smithi193 ceph-mon[32782]: pgmap v6638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:45 smithi196 ceph-mon[32572]: pgmap v6639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:45 smithi110 ceph-mon[28069]: pgmap v6639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:45 smithi193 ceph-mon[32782]: pgmap v6639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:46 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11622.010700 secs 2024-04-26T15:01:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:46 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11622.010700 secs 2024-04-26T15:01:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:46 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11622.010700 secs 2024-04-26T15:01:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:47 smithi196 ceph-mon[32572]: pgmap v6640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:47 smithi110 ceph-mon[28069]: pgmap v6640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:47 smithi193 ceph-mon[32782]: pgmap v6640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:49 smithi196 ceph-mon[32572]: pgmap v6641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:49 smithi110 ceph-mon[28069]: pgmap v6641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:49 smithi193 ceph-mon[32782]: pgmap v6641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:51 smithi196 ceph-mon[32572]: pgmap v6642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:51 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11627.010814 secs 2024-04-26T15:01:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:51 smithi110 ceph-mon[28069]: pgmap v6642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:51 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11627.010814 secs 2024-04-26T15:01:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:51 smithi193 ceph-mon[32782]: pgmap v6642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:51 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11627.010814 secs 2024-04-26T15:01:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:53 smithi196 ceph-mon[32572]: pgmap v6643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:53 smithi110 ceph-mon[28069]: pgmap v6643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:53 smithi193 ceph-mon[32782]: pgmap v6643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:56 smithi196 ceph-mon[32572]: pgmap v6644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:56 smithi110 ceph-mon[28069]: pgmap v6644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:56 smithi193 ceph-mon[32782]: pgmap v6644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:01:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11632.010944 secs 2024-04-26T15:01:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11632.010944 secs 2024-04-26T15:01:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11632.010944 secs 2024-04-26T15:01:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:01:58 smithi110 ceph-mon[28069]: pgmap v6645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:01:58 smithi193 ceph-mon[32782]: pgmap v6645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:01:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:01:58 smithi196 ceph-mon[32572]: pgmap v6645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:00 smithi110 ceph-mon[28069]: pgmap v6646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:00 smithi193 ceph-mon[32782]: pgmap v6646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:00 smithi196 ceph-mon[32572]: pgmap v6646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:02:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:02:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:02:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:02 smithi110 ceph-mon[28069]: pgmap v6647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11637.011050 secs 2024-04-26T15:02:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:02:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:02:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:02:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:02 smithi193 ceph-mon[32782]: pgmap v6647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11637.011050 secs 2024-04-26T15:02:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:02:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:02:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:02:02.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:02 smithi196 ceph-mon[32572]: pgmap v6647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:02.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11637.011050 secs 2024-04-26T15:02:02.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:02:02.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:02:02.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:02:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:03 smithi110 ceph-mon[28069]: pgmap v6648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:02:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:03 smithi110 ceph-mon[28069]: pgmap v6649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:03 smithi193 ceph-mon[32782]: pgmap v6648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:02:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:03 smithi193 ceph-mon[32782]: pgmap v6649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:03 smithi196 ceph-mon[32572]: pgmap v6648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:02:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:03 smithi196 ceph-mon[32572]: pgmap v6649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:04 smithi196 ceph-mon[32572]: pgmap v6650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:04 smithi110 ceph-mon[28069]: pgmap v6650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:04 smithi193 ceph-mon[32782]: pgmap v6650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:06 smithi196 ceph-mon[32572]: pgmap v6651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:06 smithi110 ceph-mon[28069]: pgmap v6651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:06 smithi193 ceph-mon[32782]: pgmap v6651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 11642.011123 secs 2024-04-26T15:02:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:07 smithi196 ceph-mon[32572]: slow request 2881.824082 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:02:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 11642.011123 secs 2024-04-26T15:02:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:07 smithi110 ceph-mon[28069]: slow request 2881.824082 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:02:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 11642.011123 secs 2024-04-26T15:02:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:07 smithi193 ceph-mon[32782]: slow request 2881.824082 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:02:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:08 smithi196 ceph-mon[32572]: pgmap v6652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:08 smithi110 ceph-mon[28069]: pgmap v6652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:08 smithi193 ceph-mon[32782]: pgmap v6652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:10 smithi196 ceph-mon[32572]: pgmap v6653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:10 smithi110 ceph-mon[28069]: pgmap v6653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:10 smithi193 ceph-mon[32782]: pgmap v6653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:02:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11647.011239 secs 2024-04-26T15:02:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:12 smithi196 ceph-mon[32572]: pgmap v6654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:02:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11647.011239 secs 2024-04-26T15:02:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:12 smithi110 ceph-mon[28069]: pgmap v6654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:02:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11647.011239 secs 2024-04-26T15:02:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:12 smithi193 ceph-mon[32782]: pgmap v6654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:02:15.011 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:14 smithi196 ceph-mon[32572]: pgmap v6655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:15.047 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:14 smithi110 ceph-mon[28069]: pgmap v6655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:15.126 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:14 smithi193 ceph-mon[32782]: pgmap v6655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:16 smithi196 ceph-mon[32572]: pgmap v6656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:16 smithi110 ceph-mon[28069]: pgmap v6656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:16 smithi193 ceph-mon[32782]: pgmap v6656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11652.011354 secs 2024-04-26T15:02:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11652.011354 secs 2024-04-26T15:02:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11652.011354 secs 2024-04-26T15:02:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:18 smithi196 ceph-mon[32572]: pgmap v6657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:18 smithi110 ceph-mon[28069]: pgmap v6657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:18 smithi193 ceph-mon[32782]: pgmap v6657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:20 smithi196 ceph-mon[32572]: pgmap v6658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:20 smithi110 ceph-mon[28069]: pgmap v6658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:20 smithi193 ceph-mon[32782]: pgmap v6658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11657.011473 secs 2024-04-26T15:02:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:22 smithi196 ceph-mon[32572]: pgmap v6659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11657.011473 secs 2024-04-26T15:02:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:22 smithi110 ceph-mon[28069]: pgmap v6659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11657.011473 secs 2024-04-26T15:02:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:22 smithi193 ceph-mon[32782]: pgmap v6659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:24 smithi196 ceph-mon[32572]: pgmap v6660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:24 smithi110 ceph-mon[28069]: pgmap v6660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:24 smithi193 ceph-mon[32782]: pgmap v6660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:26 smithi196 ceph-mon[32572]: pgmap v6661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:26 smithi110 ceph-mon[28069]: pgmap v6661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:26 smithi193 ceph-mon[32782]: pgmap v6661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11662.011626 secs 2024-04-26T15:02:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11662.011626 secs 2024-04-26T15:02:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11662.011626 secs 2024-04-26T15:02:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:28 smithi110 ceph-mon[28069]: pgmap v6662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:28 smithi193 ceph-mon[32782]: pgmap v6662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:28 smithi196 ceph-mon[32572]: pgmap v6662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:30 smithi110 ceph-mon[28069]: pgmap v6663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:30 smithi193 ceph-mon[32782]: pgmap v6663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:30 smithi196 ceph-mon[32572]: pgmap v6663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11667.011709 secs 2024-04-26T15:02:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:32 smithi110 ceph-mon[28069]: pgmap v6664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:33.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11667.011709 secs 2024-04-26T15:02:33.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:32 smithi196 ceph-mon[32572]: pgmap v6664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11667.011709 secs 2024-04-26T15:02:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:32 smithi193 ceph-mon[32782]: pgmap v6664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:34 smithi110 ceph-mon[28069]: pgmap v6665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:34 smithi193 ceph-mon[32782]: pgmap v6665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:34 smithi196 ceph-mon[32572]: pgmap v6665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:36 smithi110 ceph-mon[28069]: pgmap v6666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:36 smithi193 ceph-mon[32782]: pgmap v6666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:36 smithi196 ceph-mon[32572]: pgmap v6666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11672.011825 secs 2024-04-26T15:02:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11672.011825 secs 2024-04-26T15:02:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11672.011825 secs 2024-04-26T15:02:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:38 smithi110 ceph-mon[28069]: pgmap v6667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:38 smithi193 ceph-mon[32782]: pgmap v6667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:38 smithi196 ceph-mon[32572]: pgmap v6667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:40 smithi193 ceph-mon[32782]: pgmap v6668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:40 smithi196 ceph-mon[32572]: pgmap v6668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:40 smithi110 ceph-mon[28069]: pgmap v6668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11677.011941 secs 2024-04-26T15:02:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:42 smithi193 ceph-mon[32782]: pgmap v6669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11677.011941 secs 2024-04-26T15:02:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:42 smithi196 ceph-mon[32572]: pgmap v6669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11677.011941 secs 2024-04-26T15:02:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:42 smithi110 ceph-mon[28069]: pgmap v6669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:44 smithi193 ceph-mon[32782]: pgmap v6670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:44 smithi196 ceph-mon[32572]: pgmap v6670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:44 smithi110 ceph-mon[28069]: pgmap v6670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:47.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:46 smithi110 ceph-mon[28069]: pgmap v6671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:46 smithi193 ceph-mon[32782]: pgmap v6671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:46 smithi196 ceph-mon[32572]: pgmap v6671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11682.012080 secs 2024-04-26T15:02:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11682.012080 secs 2024-04-26T15:02:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11682.012080 secs 2024-04-26T15:02:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:48 smithi193 ceph-mon[32782]: pgmap v6672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:48 smithi196 ceph-mon[32572]: pgmap v6672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:48 smithi110 ceph-mon[28069]: pgmap v6672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:50 smithi193 ceph-mon[32782]: pgmap v6673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:50 smithi196 ceph-mon[32572]: pgmap v6673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:50 smithi110 ceph-mon[28069]: pgmap v6673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11687.012202 secs 2024-04-26T15:02:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:52 smithi193 ceph-mon[32782]: pgmap v6674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11687.012202 secs 2024-04-26T15:02:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:52 smithi196 ceph-mon[32572]: pgmap v6674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11687.012202 secs 2024-04-26T15:02:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:52 smithi110 ceph-mon[28069]: pgmap v6674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:54 smithi193 ceph-mon[32782]: pgmap v6675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:54 smithi196 ceph-mon[32572]: pgmap v6675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:54 smithi110 ceph-mon[28069]: pgmap v6675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:56 smithi193 ceph-mon[32782]: pgmap v6676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:56 smithi196 ceph-mon[32572]: pgmap v6676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:56 smithi110 ceph-mon[28069]: pgmap v6676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:02:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11692.012320 secs 2024-04-26T15:02:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11692.012320 secs 2024-04-26T15:02:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11692.012320 secs 2024-04-26T15:02:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:02:58 smithi193 ceph-mon[32782]: pgmap v6677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:02:58 smithi196 ceph-mon[32572]: pgmap v6677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:02:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:02:58 smithi110 ceph-mon[28069]: pgmap v6677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:00 smithi193 ceph-mon[32782]: pgmap v6678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:00 smithi196 ceph-mon[32572]: pgmap v6678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:01.348 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:00 smithi110 ceph-mon[28069]: pgmap v6678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11697.012422 secs 2024-04-26T15:03:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:02 smithi193 ceph-mon[32782]: pgmap v6679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:03:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11697.012422 secs 2024-04-26T15:03:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:02 smithi196 ceph-mon[32572]: pgmap v6679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:03:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11697.012422 secs 2024-04-26T15:03:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:02 smithi110 ceph-mon[28069]: pgmap v6679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:03:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: pgmap v6680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: pgmap v6681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: pgmap v6682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: pgmap v6680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: pgmap v6681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: pgmap v6682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: pgmap v6680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:03:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:03:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: pgmap v6681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T15:03:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: pgmap v6682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:03:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:06 smithi193 ceph-mon[32782]: pgmap v6683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:03:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:06 smithi196 ceph-mon[32572]: pgmap v6683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:03:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:06 smithi110 ceph-mon[28069]: pgmap v6683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:03:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11702.012539 secs 2024-04-26T15:03:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11702.012539 secs 2024-04-26T15:03:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11702.012539 secs 2024-04-26T15:03:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:08 smithi193 ceph-mon[32782]: pgmap v6684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:08 smithi196 ceph-mon[32572]: pgmap v6684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:08 smithi110 ceph-mon[28069]: pgmap v6684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:10 smithi193 ceph-mon[32782]: pgmap v6685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:10 smithi196 ceph-mon[32572]: pgmap v6685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:10 smithi110 ceph-mon[28069]: pgmap v6685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:11 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 11707.012648 secs 2024-04-26T15:03:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:11 smithi196 ceph-mon[32572]: slow request 11523.227787 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:03:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:11 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 11707.012648 secs 2024-04-26T15:03:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:12 smithi110 ceph-mon[28069]: slow request 11523.227787 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:03:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:12 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 11707.012648 secs 2024-04-26T15:03:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:12 smithi193 ceph-mon[32782]: slow request 11523.227787 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:03:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:13 smithi110 ceph-mon[28069]: pgmap v6686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:03:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:13 smithi193 ceph-mon[32782]: pgmap v6686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:03:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:13 smithi196 ceph-mon[32572]: pgmap v6686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:03:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:14 smithi193 ceph-mon[32782]: pgmap v6687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:03:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:14 smithi196 ceph-mon[32572]: pgmap v6687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:03:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:14 smithi110 ceph-mon[28069]: pgmap v6687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:03:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:16 smithi193 ceph-mon[32782]: pgmap v6688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.402+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T15:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.402+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T15:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.402+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614013000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T15:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.402+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614013000 comp rx=0 tx=0).stop 2024-04-26T15:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.402+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T15:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.402+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T15:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.402+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T15:03:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.402+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T15:03:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.402+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T15:03:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.404+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614057000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T15:03:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.412+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T15:03:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.412+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T15:03:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.412+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T15:03:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.412+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T15:03:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.412+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T15:03:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.413+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T15:03:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:16.413+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T15:03:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:16 smithi196 ceph-mon[32572]: pgmap v6688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:16 smithi110 ceph-mon[28069]: pgmap v6688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11712.012768 secs 2024-04-26T15:03:17.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11712.012768 secs 2024-04-26T15:03:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11712.012768 secs 2024-04-26T15:03:18.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:18.278+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:03:18.280 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:18.278+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T15:03:18.281 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:18.279+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 93 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T15:03:18.281 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:03:18.279+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 93 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:03:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:18 smithi193 ceph-mon[32782]: pgmap v6689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:18 smithi196 ceph-mon[32572]: pgmap v6689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:18 smithi110 ceph-mon[28069]: pgmap v6689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:20 smithi193 ceph-mon[32782]: pgmap v6690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:20 smithi196 ceph-mon[32572]: pgmap v6690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:20 smithi110 ceph-mon[28069]: pgmap v6690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11717.012865 secs 2024-04-26T15:03:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11717.012865 secs 2024-04-26T15:03:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11717.012865 secs 2024-04-26T15:03:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:23 smithi110 ceph-mon[28069]: pgmap v6691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:23 smithi193 ceph-mon[32782]: pgmap v6691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:23 smithi196 ceph-mon[32572]: pgmap v6691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:24 smithi193 ceph-mon[32782]: pgmap v6692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:24 smithi196 ceph-mon[32572]: pgmap v6692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:24 smithi110 ceph-mon[28069]: pgmap v6692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:26 smithi193 ceph-mon[32782]: pgmap v6693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:26 smithi196 ceph-mon[32572]: pgmap v6693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:26 smithi110 ceph-mon[28069]: pgmap v6693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11722.012982 secs 2024-04-26T15:03:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11722.012982 secs 2024-04-26T15:03:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11722.012982 secs 2024-04-26T15:03:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:28 smithi193 ceph-mon[32782]: pgmap v6694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:28 smithi196 ceph-mon[32572]: pgmap v6694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:28 smithi110 ceph-mon[28069]: pgmap v6694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:30 smithi193 ceph-mon[32782]: pgmap v6695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:30 smithi196 ceph-mon[32572]: pgmap v6695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:30 smithi110 ceph-mon[28069]: pgmap v6695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11727.013099 secs 2024-04-26T15:03:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11727.013099 secs 2024-04-26T15:03:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11727.013099 secs 2024-04-26T15:03:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:33 smithi110 ceph-mon[28069]: pgmap v6696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:33 smithi193 ceph-mon[32782]: pgmap v6696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:33 smithi196 ceph-mon[32572]: pgmap v6696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:34 smithi193 ceph-mon[32782]: pgmap v6697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:34 smithi196 ceph-mon[32572]: pgmap v6697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:34 smithi110 ceph-mon[28069]: pgmap v6697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:36 smithi193 ceph-mon[32782]: pgmap v6698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:36 smithi196 ceph-mon[32572]: pgmap v6698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:36 smithi110 ceph-mon[28069]: pgmap v6698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11732.013241 secs 2024-04-26T15:03:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11732.013241 secs 2024-04-26T15:03:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11732.013241 secs 2024-04-26T15:03:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:38 smithi193 ceph-mon[32782]: pgmap v6699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:38 smithi196 ceph-mon[32572]: pgmap v6699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:38 smithi110 ceph-mon[28069]: pgmap v6699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:40 smithi193 ceph-mon[32782]: pgmap v6700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:40 smithi196 ceph-mon[32572]: pgmap v6700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:40 smithi110 ceph-mon[28069]: pgmap v6700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11737.013386 secs 2024-04-26T15:03:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11737.013386 secs 2024-04-26T15:03:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11737.013386 secs 2024-04-26T15:03:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:43 smithi110 ceph-mon[28069]: pgmap v6701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:43 smithi193 ceph-mon[32782]: pgmap v6701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:43 smithi196 ceph-mon[32572]: pgmap v6701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:44 smithi193 ceph-mon[32782]: pgmap v6702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:44 smithi196 ceph-mon[32572]: pgmap v6702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:44 smithi110 ceph-mon[28069]: pgmap v6702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:46 smithi193 ceph-mon[32782]: pgmap v6703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:46 smithi196 ceph-mon[32572]: pgmap v6703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:46 smithi110 ceph-mon[28069]: pgmap v6703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:47.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11742.013513 secs 2024-04-26T15:03:47.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11742.013513 secs 2024-04-26T15:03:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11742.013513 secs 2024-04-26T15:03:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:48 smithi193 ceph-mon[32782]: pgmap v6704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:48 smithi196 ceph-mon[32572]: pgmap v6704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:48 smithi110 ceph-mon[28069]: pgmap v6704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:50 smithi193 ceph-mon[32782]: pgmap v6705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:50 smithi196 ceph-mon[32572]: pgmap v6705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:50 smithi110 ceph-mon[28069]: pgmap v6705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11747.013634 secs 2024-04-26T15:03:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11747.013634 secs 2024-04-26T15:03:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11747.013634 secs 2024-04-26T15:03:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:53 smithi110 ceph-mon[28069]: pgmap v6706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:53 smithi193 ceph-mon[32782]: pgmap v6706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:53 smithi196 ceph-mon[32572]: pgmap v6706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:54 smithi193 ceph-mon[32782]: pgmap v6707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:54 smithi196 ceph-mon[32572]: pgmap v6707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:54 smithi110 ceph-mon[28069]: pgmap v6707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:56 smithi193 ceph-mon[32782]: pgmap v6708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:56 smithi196 ceph-mon[32572]: pgmap v6708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:56 smithi110 ceph-mon[28069]: pgmap v6708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:03:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11752.013755 secs 2024-04-26T15:03:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11752.013755 secs 2024-04-26T15:03:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11752.013755 secs 2024-04-26T15:03:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:03:58 smithi196 ceph-mon[32572]: pgmap v6709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:03:58 smithi110 ceph-mon[28069]: pgmap v6709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:03:58 smithi193 ceph-mon[32782]: pgmap v6709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:00 smithi193 ceph-mon[32782]: pgmap v6710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:00 smithi196 ceph-mon[32572]: pgmap v6710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:00 smithi110 ceph-mon[28069]: pgmap v6710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11757.013830 secs 2024-04-26T15:04:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11757.013830 secs 2024-04-26T15:04:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11757.013830 secs 2024-04-26T15:04:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:03 smithi110 ceph-mon[28069]: pgmap v6711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:03 smithi193 ceph-mon[32782]: pgmap v6711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:03.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:03 smithi196 ceph-mon[32572]: pgmap v6711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:04 smithi193 ceph-mon[32782]: pgmap v6712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:04 smithi196 ceph-mon[32572]: pgmap v6712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:04 smithi110 ceph-mon[28069]: pgmap v6712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:04:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:04:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:04:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:04:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:04:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:06 smithi110 ceph-mon[28069]: pgmap v6713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:04:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:06 smithi110 ceph-mon[28069]: pgmap v6714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:04:06.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:04:06.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:04:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:04:05.955+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:04:06.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:04:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:04:05.955+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:04:06.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:04:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:04:05.955+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:04:06.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:04:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:04:05.955+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:04:06.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:04:05 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:04:05.955+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:04:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:04:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:04:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:06 smithi196 ceph-mon[32572]: pgmap v6713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:04:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:06 smithi196 ceph-mon[32572]: pgmap v6714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:04:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:04:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:04:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:04:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:06 smithi193 ceph-mon[32782]: pgmap v6713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:04:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:06 smithi193 ceph-mon[32782]: pgmap v6714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:04:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:04:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11762.013954 secs 2024-04-26T15:04:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11762.013954 secs 2024-04-26T15:04:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11762.013954 secs 2024-04-26T15:04:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:08 smithi196 ceph-mon[32572]: pgmap v6715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:08 smithi110 ceph-mon[28069]: pgmap v6715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:08 smithi193 ceph-mon[32782]: pgmap v6715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:10 smithi196 ceph-mon[32572]: pgmap v6716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:10 smithi110 ceph-mon[28069]: pgmap v6716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:10 smithi193 ceph-mon[32782]: pgmap v6716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11767.014026 secs 2024-04-26T15:04:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:12 smithi196 ceph-mon[32572]: pgmap v6717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11767.014026 secs 2024-04-26T15:04:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:12 smithi110 ceph-mon[28069]: pgmap v6717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11767.014026 secs 2024-04-26T15:04:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:12 smithi193 ceph-mon[32782]: pgmap v6717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:14 smithi196 ceph-mon[32572]: pgmap v6718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:14 smithi110 ceph-mon[28069]: pgmap v6718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:14 smithi193 ceph-mon[32782]: pgmap v6718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T15:04:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:16 smithi196 ceph-mon[32572]: pgmap v6719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T15:04:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:16 smithi110 ceph-mon[28069]: pgmap v6719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T15:04:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:16 smithi193 ceph-mon[32782]: pgmap v6719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T15:04:17.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11772.014102 secs 2024-04-26T15:04:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11772.014102 secs 2024-04-26T15:04:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11772.014102 secs 2024-04-26T15:04:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:18 smithi196 ceph-mon[32572]: pgmap v6720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:04:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:18 smithi110 ceph-mon[28069]: pgmap v6720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:04:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:18 smithi193 ceph-mon[32782]: pgmap v6720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:04:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:20 smithi196 ceph-mon[32572]: pgmap v6721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:20 smithi110 ceph-mon[28069]: pgmap v6721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:20 smithi193 ceph-mon[32782]: pgmap v6721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11777.014243 secs 2024-04-26T15:04:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:22 smithi196 ceph-mon[32572]: pgmap v6722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11777.014243 secs 2024-04-26T15:04:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:22 smithi110 ceph-mon[28069]: pgmap v6722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11777.014243 secs 2024-04-26T15:04:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:22 smithi193 ceph-mon[32782]: pgmap v6722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:24 smithi196 ceph-mon[32572]: pgmap v6723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:24 smithi110 ceph-mon[28069]: pgmap v6723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:24 smithi193 ceph-mon[32782]: pgmap v6723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:26 smithi196 ceph-mon[32572]: pgmap v6724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:26 smithi110 ceph-mon[28069]: pgmap v6724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:26 smithi193 ceph-mon[32782]: pgmap v6724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11782.014359 secs 2024-04-26T15:04:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11782.014359 secs 2024-04-26T15:04:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11782.014359 secs 2024-04-26T15:04:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:28 smithi196 ceph-mon[32572]: pgmap v6725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:28 smithi110 ceph-mon[28069]: pgmap v6725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:28 smithi193 ceph-mon[32782]: pgmap v6725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:30 smithi196 ceph-mon[32572]: pgmap v6726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:30 smithi110 ceph-mon[28069]: pgmap v6726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:30 smithi193 ceph-mon[32782]: pgmap v6726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11787.014482 secs 2024-04-26T15:04:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:32 smithi196 ceph-mon[32572]: pgmap v6727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11787.014482 secs 2024-04-26T15:04:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:32 smithi110 ceph-mon[28069]: pgmap v6727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11787.014482 secs 2024-04-26T15:04:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:32 smithi193 ceph-mon[32782]: pgmap v6727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:34 smithi196 ceph-mon[32572]: pgmap v6728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:34 smithi110 ceph-mon[28069]: pgmap v6728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:34 smithi193 ceph-mon[32782]: pgmap v6728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:36 smithi196 ceph-mon[32572]: pgmap v6729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:36 smithi110 ceph-mon[28069]: pgmap v6729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:36 smithi193 ceph-mon[32782]: pgmap v6729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11792.014630 secs 2024-04-26T15:04:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11792.014630 secs 2024-04-26T15:04:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11792.014630 secs 2024-04-26T15:04:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:38 smithi196 ceph-mon[32572]: pgmap v6730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:38 smithi110 ceph-mon[28069]: pgmap v6730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:38 smithi193 ceph-mon[32782]: pgmap v6730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:40 smithi196 ceph-mon[32572]: pgmap v6731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:40 smithi110 ceph-mon[28069]: pgmap v6731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:40 smithi193 ceph-mon[32782]: pgmap v6731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11797.014735 secs 2024-04-26T15:04:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:42 smithi110 ceph-mon[28069]: pgmap v6732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11797.014735 secs 2024-04-26T15:04:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:42 smithi193 ceph-mon[32782]: pgmap v6732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11797.014735 secs 2024-04-26T15:04:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:42 smithi196 ceph-mon[32572]: pgmap v6732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:44 smithi110 ceph-mon[28069]: pgmap v6733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:44 smithi193 ceph-mon[32782]: pgmap v6733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:44 smithi196 ceph-mon[32572]: pgmap v6733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:46 smithi110 ceph-mon[28069]: pgmap v6734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:46 smithi193 ceph-mon[32782]: pgmap v6734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:46 smithi196 ceph-mon[32572]: pgmap v6734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11802.014822 secs 2024-04-26T15:04:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11802.014822 secs 2024-04-26T15:04:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11802.014822 secs 2024-04-26T15:04:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:48 smithi110 ceph-mon[28069]: pgmap v6735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:48 smithi193 ceph-mon[32782]: pgmap v6735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:48 smithi196 ceph-mon[32572]: pgmap v6735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:50 smithi110 ceph-mon[28069]: pgmap v6736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:50 smithi193 ceph-mon[32782]: pgmap v6736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:50 smithi196 ceph-mon[32572]: pgmap v6736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11807.014946 secs 2024-04-26T15:04:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:52 smithi110 ceph-mon[28069]: pgmap v6737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11807.014946 secs 2024-04-26T15:04:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:52 smithi193 ceph-mon[32782]: pgmap v6737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11807.014946 secs 2024-04-26T15:04:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:52 smithi196 ceph-mon[32572]: pgmap v6737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:54 smithi193 ceph-mon[32782]: pgmap v6738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:54 smithi196 ceph-mon[32572]: pgmap v6738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:54 smithi110 ceph-mon[28069]: pgmap v6738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:56 smithi193 ceph-mon[32782]: pgmap v6739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:56 smithi196 ceph-mon[32572]: pgmap v6739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:56 smithi110 ceph-mon[28069]: pgmap v6739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:04:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11812.015032 secs 2024-04-26T15:04:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11812.015032 secs 2024-04-26T15:04:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11812.015032 secs 2024-04-26T15:04:59.126 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:04:58 smithi193 ceph-mon[32782]: pgmap v6740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:04:58 smithi196 ceph-mon[32572]: pgmap v6740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:04:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:04:58 smithi110 ceph-mon[28069]: pgmap v6740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:00 smithi193 ceph-mon[32782]: pgmap v6741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:00 smithi196 ceph-mon[32572]: pgmap v6741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:00 smithi110 ceph-mon[28069]: pgmap v6741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11817.015079 secs 2024-04-26T15:05:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:02 smithi193 ceph-mon[32782]: pgmap v6742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11817.015079 secs 2024-04-26T15:05:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:02 smithi196 ceph-mon[32572]: pgmap v6742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11817.015079 secs 2024-04-26T15:05:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:02 smithi110 ceph-mon[28069]: pgmap v6742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:04 smithi193 ceph-mon[32782]: pgmap v6743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:04 smithi196 ceph-mon[32572]: pgmap v6743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:04 smithi110 ceph-mon[28069]: pgmap v6743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:06 smithi193 ceph-mon[32782]: pgmap v6744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:05:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:05:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:06 smithi196 ceph-mon[32572]: pgmap v6744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:05:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:05:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:06 smithi110 ceph-mon[28069]: pgmap v6744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:05:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:05:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11822.015164 secs 2024-04-26T15:05:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:05:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:05:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:05:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11822.015164 secs 2024-04-26T15:05:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:05:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:05:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:05:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11822.015164 secs 2024-04-26T15:05:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:05:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:05:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:05:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:08 smithi193 ceph-mon[32782]: pgmap v6745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:08 smithi193 ceph-mon[32782]: pgmap v6746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:05:09.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:08 smithi196 ceph-mon[32572]: pgmap v6745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:09.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:08 smithi196 ceph-mon[32572]: pgmap v6746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:05:09.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:08 smithi110 ceph-mon[28069]: pgmap v6745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:09.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:08 smithi110 ceph-mon[28069]: pgmap v6746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:05:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:10 smithi193 ceph-mon[32782]: pgmap v6747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:10 smithi196 ceph-mon[32572]: pgmap v6747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:10 smithi110 ceph-mon[28069]: pgmap v6747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:12 smithi193 ceph-mon[32782]: pgmap v6748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11827.015309 secs 2024-04-26T15:05:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:12 smithi196 ceph-mon[32572]: pgmap v6748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11827.015309 secs 2024-04-26T15:05:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:12 smithi110 ceph-mon[28069]: pgmap v6748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:05:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11827.015309 secs 2024-04-26T15:05:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:14 smithi193 ceph-mon[32782]: pgmap v6749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:05:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:14 smithi196 ceph-mon[32572]: pgmap v6749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:05:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:14 smithi110 ceph-mon[28069]: pgmap v6749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:05:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:16 smithi193 ceph-mon[32782]: pgmap v6750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:05:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:16 smithi196 ceph-mon[32572]: pgmap v6750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:05:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:16 smithi110 ceph-mon[28069]: pgmap v6750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:05:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11832.015430 secs 2024-04-26T15:05:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11832.015430 secs 2024-04-26T15:05:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11832.015430 secs 2024-04-26T15:05:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:18 smithi196 ceph-mon[32572]: pgmap v6751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:05:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:18 smithi110 ceph-mon[28069]: pgmap v6751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:05:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:18 smithi193 ceph-mon[32782]: pgmap v6751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:05:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:20 smithi196 ceph-mon[32572]: pgmap v6752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:20 smithi110 ceph-mon[28069]: pgmap v6752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:20 smithi193 ceph-mon[32782]: pgmap v6752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:22 smithi196 ceph-mon[32572]: pgmap v6753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11837.015558 secs 2024-04-26T15:05:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:22 smithi110 ceph-mon[28069]: pgmap v6753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11837.015558 secs 2024-04-26T15:05:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:22 smithi193 ceph-mon[32782]: pgmap v6753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11837.015558 secs 2024-04-26T15:05:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:24 smithi196 ceph-mon[32572]: pgmap v6754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:24 smithi110 ceph-mon[28069]: pgmap v6754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:24 smithi193 ceph-mon[32782]: pgmap v6754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:26 smithi196 ceph-mon[32572]: pgmap v6755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:26 smithi110 ceph-mon[28069]: pgmap v6755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:26 smithi193 ceph-mon[32782]: pgmap v6755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:28.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11842.015681 secs 2024-04-26T15:05:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11842.015681 secs 2024-04-26T15:05:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11842.015681 secs 2024-04-26T15:05:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:28 smithi196 ceph-mon[32572]: pgmap v6756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:28 smithi110 ceph-mon[28069]: pgmap v6756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:28 smithi193 ceph-mon[32782]: pgmap v6756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:31.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:30 smithi193 ceph-mon[32782]: pgmap v6757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:30 smithi196 ceph-mon[32572]: pgmap v6757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:30 smithi110 ceph-mon[28069]: pgmap v6757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:32 smithi196 ceph-mon[32572]: pgmap v6758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11847.015845 secs 2024-04-26T15:05:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:32 smithi110 ceph-mon[28069]: pgmap v6758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11847.015845 secs 2024-04-26T15:05:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:32 smithi193 ceph-mon[32782]: pgmap v6758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11847.015845 secs 2024-04-26T15:05:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:34 smithi196 ceph-mon[32572]: pgmap v6759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:34 smithi110 ceph-mon[28069]: pgmap v6759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:34 smithi193 ceph-mon[32782]: pgmap v6759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:36 smithi196 ceph-mon[32572]: pgmap v6760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:36 smithi110 ceph-mon[28069]: pgmap v6760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:36 smithi193 ceph-mon[32782]: pgmap v6760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11852.015930 secs 2024-04-26T15:05:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11852.015930 secs 2024-04-26T15:05:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11852.015930 secs 2024-04-26T15:05:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:38 smithi196 ceph-mon[32572]: pgmap v6761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:38 smithi110 ceph-mon[28069]: pgmap v6761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:38 smithi193 ceph-mon[32782]: pgmap v6761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:40 smithi196 ceph-mon[32572]: pgmap v6762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:40 smithi110 ceph-mon[28069]: pgmap v6762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:40 smithi193 ceph-mon[32782]: pgmap v6762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:42 smithi196 ceph-mon[32572]: pgmap v6763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11857.016041 secs 2024-04-26T15:05:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:42 smithi110 ceph-mon[28069]: pgmap v6763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11857.016041 secs 2024-04-26T15:05:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:42 smithi193 ceph-mon[32782]: pgmap v6763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11857.016041 secs 2024-04-26T15:05:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:44 smithi196 ceph-mon[32572]: pgmap v6764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:44 smithi110 ceph-mon[28069]: pgmap v6764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:44 smithi193 ceph-mon[32782]: pgmap v6764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:46 smithi196 ceph-mon[32572]: pgmap v6765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:46 smithi110 ceph-mon[28069]: pgmap v6765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:46 smithi193 ceph-mon[32782]: pgmap v6765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11862.016188 secs 2024-04-26T15:05:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11862.016188 secs 2024-04-26T15:05:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11862.016188 secs 2024-04-26T15:05:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:48 smithi196 ceph-mon[32572]: pgmap v6766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:48 smithi110 ceph-mon[28069]: pgmap v6766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:48 smithi193 ceph-mon[32782]: pgmap v6766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:50 smithi196 ceph-mon[32572]: pgmap v6767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:50 smithi110 ceph-mon[28069]: pgmap v6767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:50 smithi193 ceph-mon[32782]: pgmap v6767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:51 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11867.016320 secs 2024-04-26T15:05:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:51 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11867.016320 secs 2024-04-26T15:05:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:51 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11867.016320 secs 2024-04-26T15:05:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:52 smithi196 ceph-mon[32572]: pgmap v6768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:52 smithi110 ceph-mon[28069]: pgmap v6768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:52 smithi193 ceph-mon[32782]: pgmap v6768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:54 smithi196 ceph-mon[32572]: pgmap v6769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:54 smithi110 ceph-mon[28069]: pgmap v6769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:54 smithi193 ceph-mon[32782]: pgmap v6769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:05:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:57 smithi196 ceph-mon[32572]: pgmap v6770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11872.016469 secs 2024-04-26T15:05:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:57 smithi110 ceph-mon[28069]: pgmap v6770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11872.016469 secs 2024-04-26T15:05:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:57 smithi193 ceph-mon[32782]: pgmap v6770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11872.016469 secs 2024-04-26T15:05:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:05:59 smithi110 ceph-mon[28069]: pgmap v6771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:05:59 smithi193 ceph-mon[32782]: pgmap v6771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:05:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:05:59 smithi196 ceph-mon[32572]: pgmap v6771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:01 smithi110 ceph-mon[28069]: pgmap v6772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:01 smithi193 ceph-mon[32782]: pgmap v6772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:01 smithi196 ceph-mon[32572]: pgmap v6772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:02 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 11877.016596 secs 2024-04-26T15:06:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:02 smithi110 ceph-mon[28069]: slow request 11520.774544 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:06:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:02 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 11877.016596 secs 2024-04-26T15:06:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:02 smithi193 ceph-mon[32782]: slow request 11520.774544 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:06:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:02 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 11877.016596 secs 2024-04-26T15:06:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:02 smithi196 ceph-mon[32572]: slow request 11520.774544 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:06:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:03 smithi110 ceph-mon[28069]: pgmap v6773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:03 smithi193 ceph-mon[32782]: pgmap v6773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:03 smithi196 ceph-mon[32572]: pgmap v6773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:05 smithi110 ceph-mon[28069]: pgmap v6774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:05.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:05 smithi196 ceph-mon[32572]: pgmap v6774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:05 smithi193 ceph-mon[32782]: pgmap v6774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:07 smithi110 ceph-mon[28069]: pgmap v6775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11882.016708 secs 2024-04-26T15:06:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:07 smithi193 ceph-mon[32782]: pgmap v6775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11882.016708 secs 2024-04-26T15:06:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:07 smithi196 ceph-mon[32572]: pgmap v6775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11882.016708 secs 2024-04-26T15:06:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:06:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:06:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:06:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:09 smithi193 ceph-mon[32782]: pgmap v6776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:06:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:06:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:06:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:09 smithi196 ceph-mon[32572]: pgmap v6776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:06:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:06:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:06:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:09 smithi110 ceph-mon[28069]: pgmap v6776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:06:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:06:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:06:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:10 smithi193 ceph-mon[32782]: pgmap v6777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:06:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:10 smithi193 ceph-mon[32782]: pgmap v6778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:10 smithi196 ceph-mon[32572]: pgmap v6777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:06:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:10 smithi196 ceph-mon[32572]: pgmap v6778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:10 smithi110 ceph-mon[28069]: pgmap v6777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:06:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:10 smithi110 ceph-mon[28069]: pgmap v6778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:12 smithi193 ceph-mon[32782]: pgmap v6779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11887.016807 secs 2024-04-26T15:06:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:12 smithi196 ceph-mon[32572]: pgmap v6779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11887.016807 secs 2024-04-26T15:06:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:12 smithi110 ceph-mon[28069]: pgmap v6779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11887.016807 secs 2024-04-26T15:06:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:14 smithi193 ceph-mon[32782]: pgmap v6780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:14 smithi196 ceph-mon[32572]: pgmap v6780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:14 smithi110 ceph-mon[28069]: pgmap v6780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:16 smithi193 ceph-mon[32782]: pgmap v6781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:16 smithi196 ceph-mon[32572]: pgmap v6781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:16 smithi110 ceph-mon[28069]: pgmap v6781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11892.016873 secs 2024-04-26T15:06:17.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11892.016873 secs 2024-04-26T15:06:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11892.016873 secs 2024-04-26T15:06:18.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:06:18.308+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:06:18.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:06:18.308+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T15:06:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:06:18.309+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 94 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T15:06:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:06:18.309+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x55db1bb93620 con 0x55db1be4fdd0 2024-04-26T15:06:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:06:18.309+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 94 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:06:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:06:18.309+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:06:18.310 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:06:18.310+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 95 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:06:18.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:06:18.310+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 95 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x55db1bb93620 con 0x7f261c104b50 2024-04-26T15:06:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:18 smithi193 ceph-mon[32782]: pgmap v6782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:18 smithi196 ceph-mon[32572]: pgmap v6782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:18 smithi110 ceph-mon[28069]: pgmap v6782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:06:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:19 smithi193 ceph-mon[32782]: pgmap v6783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:06:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:19 smithi196 ceph-mon[32572]: pgmap v6783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:06:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:19 smithi110 ceph-mon[28069]: pgmap v6783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:06:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:21 smithi193 ceph-mon[32782]: pgmap v6784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:21 smithi196 ceph-mon[32572]: pgmap v6784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:21 smithi110 ceph-mon[28069]: pgmap v6784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11897.016994 secs 2024-04-26T15:06:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11897.016994 secs 2024-04-26T15:06:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11897.016994 secs 2024-04-26T15:06:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:23 smithi193 ceph-mon[32782]: pgmap v6785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:23 smithi196 ceph-mon[32572]: pgmap v6785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:23 smithi110 ceph-mon[28069]: pgmap v6785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:25 smithi193 ceph-mon[32782]: pgmap v6786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:25 smithi196 ceph-mon[32572]: pgmap v6786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:25 smithi110 ceph-mon[28069]: pgmap v6786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11902.017146 secs 2024-04-26T15:06:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:27 smithi193 ceph-mon[32782]: pgmap v6787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11902.017146 secs 2024-04-26T15:06:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:27 smithi196 ceph-mon[32572]: pgmap v6787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11902.017146 secs 2024-04-26T15:06:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:27 smithi110 ceph-mon[28069]: pgmap v6787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:29 smithi193 ceph-mon[32782]: pgmap v6788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:29 smithi196 ceph-mon[32572]: pgmap v6788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:29 smithi110 ceph-mon[28069]: pgmap v6788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:31 smithi193 ceph-mon[32782]: pgmap v6789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:31 smithi196 ceph-mon[32572]: pgmap v6789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:31 smithi110 ceph-mon[28069]: pgmap v6789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11907.017279 secs 2024-04-26T15:06:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11907.017279 secs 2024-04-26T15:06:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11907.017279 secs 2024-04-26T15:06:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:33 smithi193 ceph-mon[32782]: pgmap v6790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:33 smithi196 ceph-mon[32572]: pgmap v6790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:33 smithi110 ceph-mon[28069]: pgmap v6790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:35 smithi193 ceph-mon[32782]: pgmap v6791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:35 smithi196 ceph-mon[32572]: pgmap v6791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:35 smithi110 ceph-mon[28069]: pgmap v6791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11912.017421 secs 2024-04-26T15:06:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:37 smithi193 ceph-mon[32782]: pgmap v6792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11912.017421 secs 2024-04-26T15:06:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:37 smithi196 ceph-mon[32572]: pgmap v6792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11912.017421 secs 2024-04-26T15:06:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:37 smithi110 ceph-mon[28069]: pgmap v6792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:39 smithi193 ceph-mon[32782]: pgmap v6793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:39 smithi196 ceph-mon[32572]: pgmap v6793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:39 smithi110 ceph-mon[28069]: pgmap v6793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:41 smithi193 ceph-mon[32782]: pgmap v6794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:41 smithi196 ceph-mon[32572]: pgmap v6794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:41 smithi110 ceph-mon[28069]: pgmap v6794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11917.017569 secs 2024-04-26T15:06:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11917.017569 secs 2024-04-26T15:06:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11917.017569 secs 2024-04-26T15:06:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:43 smithi196 ceph-mon[32572]: pgmap v6795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:43 smithi110 ceph-mon[28069]: pgmap v6795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:43 smithi193 ceph-mon[32782]: pgmap v6795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:45 smithi196 ceph-mon[32572]: pgmap v6796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:45 smithi110 ceph-mon[28069]: pgmap v6796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:45 smithi193 ceph-mon[32782]: pgmap v6796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11922.017584 secs 2024-04-26T15:06:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:47 smithi196 ceph-mon[32572]: pgmap v6797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11922.017584 secs 2024-04-26T15:06:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:47 smithi110 ceph-mon[28069]: pgmap v6797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11922.017584 secs 2024-04-26T15:06:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:47 smithi193 ceph-mon[32782]: pgmap v6797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:49 smithi196 ceph-mon[32572]: pgmap v6798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:49 smithi110 ceph-mon[28069]: pgmap v6798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:49 smithi193 ceph-mon[32782]: pgmap v6798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:51 smithi196 ceph-mon[32572]: pgmap v6799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:51 smithi110 ceph-mon[28069]: pgmap v6799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:51 smithi193 ceph-mon[32782]: pgmap v6799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11927.017682 secs 2024-04-26T15:06:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11927.017682 secs 2024-04-26T15:06:53.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11927.017682 secs 2024-04-26T15:06:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:53 smithi196 ceph-mon[32572]: pgmap v6800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:53 smithi110 ceph-mon[28069]: pgmap v6800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:53 smithi193 ceph-mon[32782]: pgmap v6800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:06:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:55 smithi196 ceph-mon[32572]: pgmap v6801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:55 smithi110 ceph-mon[28069]: pgmap v6801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:55 smithi193 ceph-mon[32782]: pgmap v6801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11932.017794 secs 2024-04-26T15:06:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:57 smithi196 ceph-mon[32572]: pgmap v6802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11932.017794 secs 2024-04-26T15:06:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:57 smithi110 ceph-mon[28069]: pgmap v6802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:06:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11932.017794 secs 2024-04-26T15:06:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:57 smithi193 ceph-mon[32782]: pgmap v6802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:06:59 smithi196 ceph-mon[32572]: pgmap v6803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:06:59 smithi110 ceph-mon[28069]: pgmap v6803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:06:59 smithi193 ceph-mon[32782]: pgmap v6803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:01 smithi196 ceph-mon[32572]: pgmap v6804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:01 smithi110 ceph-mon[28069]: pgmap v6804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:01 smithi193 ceph-mon[32782]: pgmap v6804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11937.017924 secs 2024-04-26T15:07:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11937.017924 secs 2024-04-26T15:07:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11937.017924 secs 2024-04-26T15:07:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:03 smithi196 ceph-mon[32572]: pgmap v6805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:03 smithi110 ceph-mon[28069]: pgmap v6805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:03 smithi193 ceph-mon[32782]: pgmap v6805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:05 smithi196 ceph-mon[32572]: pgmap v6806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:05 smithi110 ceph-mon[28069]: pgmap v6806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:05 smithi193 ceph-mon[32782]: pgmap v6806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 11942.018004 secs 2024-04-26T15:07:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:07 smithi196 ceph-mon[32572]: slow request 2881.736527 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:07:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:07 smithi196 ceph-mon[32572]: pgmap v6807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 11942.018004 secs 2024-04-26T15:07:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:07 smithi110 ceph-mon[28069]: slow request 2881.736527 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:07:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:07 smithi110 ceph-mon[28069]: pgmap v6807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 11942.018004 secs 2024-04-26T15:07:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:07 smithi193 ceph-mon[32782]: slow request 2881.736527 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:07:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:07 smithi193 ceph-mon[32782]: pgmap v6807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:09 smithi196 ceph-mon[32572]: pgmap v6808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:07:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:07:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:07:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:09 smithi110 ceph-mon[28069]: pgmap v6808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:07:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:07:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:07:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:09 smithi193 ceph-mon[32782]: pgmap v6808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:07:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:07:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:07:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:11 smithi196 ceph-mon[32572]: pgmap v6809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:07:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:07:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:07:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:11 smithi110 ceph-mon[28069]: pgmap v6809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:07:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:07:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:07:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:11 smithi193 ceph-mon[32782]: pgmap v6809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:07:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:07:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:07:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:12 smithi196 ceph-mon[32572]: pgmap v6810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T15:07:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:12 smithi196 ceph-mon[32572]: pgmap v6811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:07:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11947.018129 secs 2024-04-26T15:07:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:12 smithi110 ceph-mon[28069]: pgmap v6810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T15:07:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:12 smithi110 ceph-mon[28069]: pgmap v6811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:07:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11947.018129 secs 2024-04-26T15:07:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:12 smithi193 ceph-mon[32782]: pgmap v6810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T15:07:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:12 smithi193 ceph-mon[32782]: pgmap v6811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:07:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11947.018129 secs 2024-04-26T15:07:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:14 smithi196 ceph-mon[32572]: pgmap v6812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:14 smithi110 ceph-mon[28069]: pgmap v6812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:14 smithi193 ceph-mon[32782]: pgmap v6812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:16 smithi196 ceph-mon[32572]: pgmap v6813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:16 smithi110 ceph-mon[28069]: pgmap v6813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:16 smithi193 ceph-mon[32782]: pgmap v6813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11952.018245 secs 2024-04-26T15:07:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11952.018245 secs 2024-04-26T15:07:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11952.018245 secs 2024-04-26T15:07:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:18 smithi196 ceph-mon[32572]: pgmap v6814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:07:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:18 smithi110 ceph-mon[28069]: pgmap v6814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:07:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:18 smithi193 ceph-mon[32782]: pgmap v6814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T15:07:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:21 smithi196 ceph-mon[32572]: pgmap v6815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:21 smithi110 ceph-mon[28069]: pgmap v6815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:21 smithi193 ceph-mon[32782]: pgmap v6815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11957.018363 secs 2024-04-26T15:07:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11957.018363 secs 2024-04-26T15:07:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11957.018363 secs 2024-04-26T15:07:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:23 smithi110 ceph-mon[28069]: pgmap v6816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:07:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:23 smithi193 ceph-mon[32782]: pgmap v6816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:07:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:23 smithi196 ceph-mon[32572]: pgmap v6816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:07:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:25 smithi110 ceph-mon[28069]: pgmap v6817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:25 smithi193 ceph-mon[32782]: pgmap v6817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:25 smithi196 ceph-mon[32572]: pgmap v6817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:27 smithi110 ceph-mon[28069]: pgmap v6818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11962.018479 secs 2024-04-26T15:07:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:27 smithi193 ceph-mon[32782]: pgmap v6818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11962.018479 secs 2024-04-26T15:07:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:27 smithi196 ceph-mon[32572]: pgmap v6818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11962.018479 secs 2024-04-26T15:07:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:29 smithi110 ceph-mon[28069]: pgmap v6819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:29 smithi193 ceph-mon[32782]: pgmap v6819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:29 smithi196 ceph-mon[32572]: pgmap v6819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:31 smithi110 ceph-mon[28069]: pgmap v6820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:31 smithi193 ceph-mon[32782]: pgmap v6820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:31 smithi196 ceph-mon[32572]: pgmap v6820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11967.018627 secs 2024-04-26T15:07:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11967.018627 secs 2024-04-26T15:07:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11967.018627 secs 2024-04-26T15:07:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:33 smithi193 ceph-mon[32782]: pgmap v6821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:33 smithi196 ceph-mon[32572]: pgmap v6821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:33 smithi110 ceph-mon[28069]: pgmap v6821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:35 smithi193 ceph-mon[32782]: pgmap v6822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:35 smithi196 ceph-mon[32572]: pgmap v6822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:35 smithi110 ceph-mon[28069]: pgmap v6822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:37 smithi193 ceph-mon[32782]: pgmap v6823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11972.018738 secs 2024-04-26T15:07:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:37 smithi196 ceph-mon[32572]: pgmap v6823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11972.018738 secs 2024-04-26T15:07:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:37 smithi110 ceph-mon[28069]: pgmap v6823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11972.018738 secs 2024-04-26T15:07:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:39 smithi193 ceph-mon[32782]: pgmap v6824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:39 smithi196 ceph-mon[32572]: pgmap v6824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:39 smithi110 ceph-mon[28069]: pgmap v6824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:41 smithi193 ceph-mon[32782]: pgmap v6825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:41 smithi196 ceph-mon[32572]: pgmap v6825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:41 smithi110 ceph-mon[28069]: pgmap v6825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11977.018836 secs 2024-04-26T15:07:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11977.018836 secs 2024-04-26T15:07:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11977.018836 secs 2024-04-26T15:07:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:43 smithi193 ceph-mon[32782]: pgmap v6826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:43 smithi196 ceph-mon[32572]: pgmap v6826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:43 smithi110 ceph-mon[28069]: pgmap v6826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:45 smithi193 ceph-mon[32782]: pgmap v6827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:45 smithi196 ceph-mon[32572]: pgmap v6827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:45 smithi110 ceph-mon[28069]: pgmap v6827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:47 smithi193 ceph-mon[32782]: pgmap v6828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11982.018952 secs 2024-04-26T15:07:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:47 smithi196 ceph-mon[32572]: pgmap v6828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11982.018952 secs 2024-04-26T15:07:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:47 smithi110 ceph-mon[28069]: pgmap v6828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11982.018952 secs 2024-04-26T15:07:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:49 smithi193 ceph-mon[32782]: pgmap v6829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:49 smithi196 ceph-mon[32572]: pgmap v6829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:49 smithi110 ceph-mon[28069]: pgmap v6829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:51 smithi193 ceph-mon[32782]: pgmap v6830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:51 smithi196 ceph-mon[32572]: pgmap v6830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:51 smithi110 ceph-mon[28069]: pgmap v6830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11987.019073 secs 2024-04-26T15:07:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11987.019073 secs 2024-04-26T15:07:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11987.019073 secs 2024-04-26T15:07:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:53 smithi193 ceph-mon[32782]: pgmap v6831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:53 smithi196 ceph-mon[32572]: pgmap v6831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:53 smithi110 ceph-mon[28069]: pgmap v6831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:54 smithi196 ceph-mon[32572]: pgmap v6832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:54 smithi110 ceph-mon[28069]: pgmap v6832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:54 smithi193 ceph-mon[32782]: pgmap v6832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:07:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:56 smithi196 ceph-mon[32572]: pgmap v6833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:56 smithi110 ceph-mon[28069]: pgmap v6833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:56 smithi193 ceph-mon[32782]: pgmap v6833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11992.019199 secs 2024-04-26T15:07:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11992.019199 secs 2024-04-26T15:07:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11992.019199 secs 2024-04-26T15:07:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:07:58 smithi196 ceph-mon[32572]: pgmap v6834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:07:58 smithi110 ceph-mon[28069]: pgmap v6834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:07:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:07:58 smithi193 ceph-mon[32782]: pgmap v6834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:00 smithi196 ceph-mon[32572]: pgmap v6835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:00 smithi110 ceph-mon[28069]: pgmap v6835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:00 smithi193 ceph-mon[32782]: pgmap v6835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:02 smithi110 ceph-mon[28069]: pgmap v6836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 11997.019313 secs 2024-04-26T15:08:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:02 smithi193 ceph-mon[32782]: pgmap v6836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 11997.019313 secs 2024-04-26T15:08:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:02 smithi196 ceph-mon[32572]: pgmap v6836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 11997.019313 secs 2024-04-26T15:08:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:04 smithi110 ceph-mon[28069]: pgmap v6837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:04 smithi193 ceph-mon[32782]: pgmap v6837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:04 smithi196 ceph-mon[32572]: pgmap v6837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:06 smithi110 ceph-mon[28069]: pgmap v6838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:06 smithi193 ceph-mon[32782]: pgmap v6838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:06 smithi196 ceph-mon[32572]: pgmap v6838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12002.019413 secs 2024-04-26T15:08:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12002.019413 secs 2024-04-26T15:08:07.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12002.019413 secs 2024-04-26T15:08:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:08 smithi110 ceph-mon[28069]: pgmap v6839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:08 smithi193 ceph-mon[32782]: pgmap v6839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:08 smithi196 ceph-mon[32572]: pgmap v6839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:10 smithi110 ceph-mon[28069]: pgmap v6840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:10 smithi193 ceph-mon[32782]: pgmap v6840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:10 smithi196 ceph-mon[32572]: pgmap v6840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:12 smithi110 ceph-mon[28069]: pgmap v6841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12007.019534 secs 2024-04-26T15:08:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:08:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:12 smithi193 ceph-mon[32782]: pgmap v6841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12007.019534 secs 2024-04-26T15:08:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:08:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:12 smithi196 ceph-mon[32572]: pgmap v6841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12007.019534 secs 2024-04-26T15:08:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:08:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:08:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:08:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:13 smithi193 ceph-mon[32782]: pgmap v6842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:08:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:13 smithi193 ceph-mon[32782]: pgmap v6843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:08:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:08:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:13 smithi196 ceph-mon[32572]: pgmap v6842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:08:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:13 smithi196 ceph-mon[32572]: pgmap v6843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:08:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:08:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:13 smithi110 ceph-mon[28069]: pgmap v6842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:08:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:13 smithi110 ceph-mon[28069]: pgmap v6843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:08:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:15 smithi193 ceph-mon[32782]: pgmap v6844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:15 smithi196 ceph-mon[32572]: pgmap v6844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:15 smithi110 ceph-mon[28069]: pgmap v6844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12012.019646 secs 2024-04-26T15:08:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:17 smithi193 ceph-mon[32782]: pgmap v6845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12012.019646 secs 2024-04-26T15:08:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:17 smithi196 ceph-mon[32572]: pgmap v6845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12012.019646 secs 2024-04-26T15:08:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:17 smithi110 ceph-mon[28069]: pgmap v6845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:20.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:19 smithi110 ceph-mon[28069]: pgmap v6846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:19 smithi193 ceph-mon[32782]: pgmap v6846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:19 smithi196 ceph-mon[32572]: pgmap v6846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:21 smithi193 ceph-mon[32782]: pgmap v6847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:21 smithi196 ceph-mon[32572]: pgmap v6847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:21 smithi110 ceph-mon[28069]: pgmap v6847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:08:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12017.019738 secs 2024-04-26T15:08:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12017.019738 secs 2024-04-26T15:08:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12017.019738 secs 2024-04-26T15:08:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:23 smithi193 ceph-mon[32782]: pgmap v6848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:08:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:23 smithi196 ceph-mon[32572]: pgmap v6848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:08:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:23 smithi110 ceph-mon[28069]: pgmap v6848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:08:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:25 smithi193 ceph-mon[32782]: pgmap v6849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:25 smithi196 ceph-mon[32572]: pgmap v6849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:25 smithi110 ceph-mon[28069]: pgmap v6849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12022.019831 secs 2024-04-26T15:08:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:27 smithi193 ceph-mon[32782]: pgmap v6850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12022.019831 secs 2024-04-26T15:08:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:27 smithi196 ceph-mon[32572]: pgmap v6850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12022.019831 secs 2024-04-26T15:08:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:27 smithi110 ceph-mon[28069]: pgmap v6850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:29 smithi196 ceph-mon[32572]: pgmap v6851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:29 smithi110 ceph-mon[28069]: pgmap v6851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:29 smithi193 ceph-mon[32782]: pgmap v6851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:32.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:31 smithi193 ceph-mon[32782]: pgmap v6852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:31 smithi196 ceph-mon[32572]: pgmap v6852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:31 smithi110 ceph-mon[28069]: pgmap v6852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12027.019928 secs 2024-04-26T15:08:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12027.019928 secs 2024-04-26T15:08:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12027.019928 secs 2024-04-26T15:08:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:33 smithi196 ceph-mon[32572]: pgmap v6853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:33 smithi110 ceph-mon[28069]: pgmap v6853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:33 smithi193 ceph-mon[32782]: pgmap v6853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:35 smithi196 ceph-mon[32572]: pgmap v6854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:35 smithi110 ceph-mon[28069]: pgmap v6854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:35 smithi193 ceph-mon[32782]: pgmap v6854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12032.020040 secs 2024-04-26T15:08:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:37 smithi196 ceph-mon[32572]: pgmap v6855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12032.020040 secs 2024-04-26T15:08:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:37 smithi110 ceph-mon[28069]: pgmap v6855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12032.020040 secs 2024-04-26T15:08:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:37 smithi193 ceph-mon[32782]: pgmap v6855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:39 smithi196 ceph-mon[32572]: pgmap v6856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:39 smithi110 ceph-mon[28069]: pgmap v6856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:39 smithi193 ceph-mon[32782]: pgmap v6856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:41 smithi196 ceph-mon[32572]: pgmap v6857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:41 smithi110 ceph-mon[28069]: pgmap v6857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:41 smithi193 ceph-mon[32782]: pgmap v6857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12037.020162 secs 2024-04-26T15:08:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12037.020162 secs 2024-04-26T15:08:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12037.020162 secs 2024-04-26T15:08:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:43 smithi196 ceph-mon[32572]: pgmap v6858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:43 smithi110 ceph-mon[28069]: pgmap v6858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:43 smithi193 ceph-mon[32782]: pgmap v6858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:45 smithi196 ceph-mon[32572]: pgmap v6859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:45 smithi110 ceph-mon[28069]: pgmap v6859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:45 smithi193 ceph-mon[32782]: pgmap v6859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12042.020320 secs 2024-04-26T15:08:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:47 smithi196 ceph-mon[32572]: pgmap v6860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12042.020320 secs 2024-04-26T15:08:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:47 smithi110 ceph-mon[28069]: pgmap v6860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12042.020320 secs 2024-04-26T15:08:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:47 smithi193 ceph-mon[32782]: pgmap v6860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:49 smithi196 ceph-mon[32572]: pgmap v6861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:50.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:49 smithi110 ceph-mon[28069]: pgmap v6861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:49 smithi193 ceph-mon[32782]: pgmap v6861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:51 smithi196 ceph-mon[32572]: pgmap v6862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:51 smithi110 ceph-mon[28069]: pgmap v6862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:51 smithi193 ceph-mon[32782]: pgmap v6862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12047.020440 secs 2024-04-26T15:08:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12047.020440 secs 2024-04-26T15:08:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12047.020440 secs 2024-04-26T15:08:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:53 smithi196 ceph-mon[32572]: pgmap v6863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:53 smithi110 ceph-mon[28069]: pgmap v6863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:53 smithi193 ceph-mon[32782]: pgmap v6863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:08:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:55 smithi196 ceph-mon[32572]: pgmap v6864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:55 smithi110 ceph-mon[28069]: pgmap v6864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:55 smithi193 ceph-mon[32782]: pgmap v6864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12052.020594 secs 2024-04-26T15:08:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:57 smithi196 ceph-mon[32572]: pgmap v6865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12052.020594 secs 2024-04-26T15:08:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:57 smithi110 ceph-mon[28069]: pgmap v6865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:08:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12052.020594 secs 2024-04-26T15:08:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:57 smithi193 ceph-mon[32782]: pgmap v6865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:08:59 smithi196 ceph-mon[32572]: pgmap v6866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:08:59 smithi110 ceph-mon[28069]: pgmap v6866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:08:59 smithi193 ceph-mon[32782]: pgmap v6866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:01 smithi196 ceph-mon[32572]: pgmap v6867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:01 smithi110 ceph-mon[28069]: pgmap v6867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:02.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:01 smithi193 ceph-mon[32782]: pgmap v6867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12057.020749 secs 2024-04-26T15:09:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12057.020749 secs 2024-04-26T15:09:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12057.020749 secs 2024-04-26T15:09:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:03 smithi196 ceph-mon[32572]: pgmap v6868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:03 smithi110 ceph-mon[28069]: pgmap v6868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:03 smithi193 ceph-mon[32782]: pgmap v6868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:06 smithi196 ceph-mon[32572]: pgmap v6869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:06 smithi110 ceph-mon[28069]: pgmap v6869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:06.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:09:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:09:06.020+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:09:06.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:09:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:09:06.020+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:09:06.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:09:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:09:06.020+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:09:06.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:09:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:09:06.020+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:09:06.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:09:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:09:06.020+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:09:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:06 smithi193 ceph-mon[32782]: pgmap v6869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12062.020811 secs 2024-04-26T15:09:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12062.020811 secs 2024-04-26T15:09:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12062.020811 secs 2024-04-26T15:09:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:08 smithi193 ceph-mon[32782]: pgmap v6870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:08.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:08 smithi196 ceph-mon[32572]: pgmap v6870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:08 smithi110 ceph-mon[28069]: pgmap v6870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:10.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:10 smithi193 ceph-mon[32782]: pgmap v6871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:09:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:10 smithi196 ceph-mon[32572]: pgmap v6871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:09:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:10 smithi110 ceph-mon[28069]: pgmap v6871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:09:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:12 smithi193 ceph-mon[32782]: pgmap v6872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:09:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12067.020914 secs 2024-04-26T15:09:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:12 smithi196 ceph-mon[32572]: pgmap v6872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:09:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12067.020914 secs 2024-04-26T15:09:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:12 smithi110 ceph-mon[28069]: pgmap v6872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:09:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12067.020914 secs 2024-04-26T15:09:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:09:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:09:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:09:14.142 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:14 smithi193 ceph-mon[32782]: pgmap v6873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:09:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:14 smithi196 ceph-mon[32572]: pgmap v6873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:09:14.333 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:14 smithi110 ceph-mon[28069]: pgmap v6873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:09:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: pgmap v6874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: pgmap v6874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:09:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: pgmap v6874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:09:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12072.020972 secs 2024-04-26T15:09:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:09:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:09:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:09:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:09:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12072.020972 secs 2024-04-26T15:09:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:09:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:09:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:09:17.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:09:17.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12072.020972 secs 2024-04-26T15:09:17.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:17.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:09:18.339+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:09:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:09:18.339+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T15:09:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:09:18.340+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 96 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T15:09:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:09:18.340+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 96 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:09:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:18 smithi193 ceph-mon[32782]: pgmap v6875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:09:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:18 smithi196 ceph-mon[32572]: pgmap v6875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:09:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:18 smithi110 ceph-mon[28069]: pgmap v6875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:09:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:09:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:09:19.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:09:19.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:09:19.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:09:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:09:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:20 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:09:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:20 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:09:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:20 smithi193 ceph-mon[32782]: pgmap v6876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 176 B/s wr, 2 op/s 2024-04-26T15:09:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:20 smithi193 ceph-mon[32782]: pgmap v6877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:20.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:20 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:09:20.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:20 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:09:20.444 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:20 smithi110 ceph-mon[28069]: pgmap v6876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 176 B/s wr, 2 op/s 2024-04-26T15:09:20.444 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:20 smithi110 ceph-mon[28069]: pgmap v6877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:20 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:09:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:20 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:09:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:20 smithi196 ceph-mon[32572]: pgmap v6876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 176 B/s wr, 2 op/s 2024-04-26T15:09:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:20 smithi196 ceph-mon[32572]: pgmap v6877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:22 smithi193 ceph-mon[32782]: pgmap v6878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12077.021083 secs 2024-04-26T15:09:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:22 smithi196 ceph-mon[32572]: pgmap v6878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12077.021083 secs 2024-04-26T15:09:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:22 smithi110 ceph-mon[28069]: pgmap v6878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12077.021083 secs 2024-04-26T15:09:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:24 smithi196 ceph-mon[32572]: pgmap v6879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:24 smithi110 ceph-mon[28069]: pgmap v6879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:24 smithi193 ceph-mon[32782]: pgmap v6879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:25 smithi196 ceph-mon[32572]: pgmap v6880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:25 smithi110 ceph-mon[28069]: pgmap v6880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:25 smithi193 ceph-mon[32782]: pgmap v6880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12082.021134 secs 2024-04-26T15:09:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:27 smithi196 ceph-mon[32572]: pgmap v6881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12082.021134 secs 2024-04-26T15:09:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:27 smithi110 ceph-mon[28069]: pgmap v6881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12082.021134 secs 2024-04-26T15:09:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:27 smithi193 ceph-mon[32782]: pgmap v6881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:09:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:29 smithi196 ceph-mon[32572]: pgmap v6882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:09:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:29 smithi110 ceph-mon[28069]: pgmap v6882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:09:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:29 smithi193 ceph-mon[32782]: pgmap v6882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:09:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:31 smithi196 ceph-mon[32572]: pgmap v6883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:31 smithi110 ceph-mon[28069]: pgmap v6883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:31 smithi193 ceph-mon[32782]: pgmap v6883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12087.021252 secs 2024-04-26T15:09:32.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12087.021252 secs 2024-04-26T15:09:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12087.021252 secs 2024-04-26T15:09:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:33 smithi196 ceph-mon[32572]: pgmap v6884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:33 smithi110 ceph-mon[28069]: pgmap v6884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:33.793 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:33 smithi193 ceph-mon[32782]: pgmap v6884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:35 smithi196 ceph-mon[32572]: pgmap v6885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:35 smithi110 ceph-mon[28069]: pgmap v6885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:35 smithi193 ceph-mon[32782]: pgmap v6885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12092.021371 secs 2024-04-26T15:09:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:37 smithi196 ceph-mon[32572]: pgmap v6886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12092.021371 secs 2024-04-26T15:09:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:37 smithi110 ceph-mon[28069]: pgmap v6886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12092.021371 secs 2024-04-26T15:09:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:37 smithi193 ceph-mon[32782]: pgmap v6886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:39 smithi196 ceph-mon[32572]: pgmap v6887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:39 smithi110 ceph-mon[28069]: pgmap v6887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:39 smithi193 ceph-mon[32782]: pgmap v6887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:41 smithi196 ceph-mon[32572]: pgmap v6888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:41 smithi110 ceph-mon[28069]: pgmap v6888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:41 smithi193 ceph-mon[32782]: pgmap v6888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:42.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12097.021470 secs 2024-04-26T15:09:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12097.021470 secs 2024-04-26T15:09:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12097.021470 secs 2024-04-26T15:09:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:43 smithi196 ceph-mon[32572]: pgmap v6889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:43 smithi110 ceph-mon[28069]: pgmap v6889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:43 smithi193 ceph-mon[32782]: pgmap v6889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:45 smithi196 ceph-mon[32572]: pgmap v6890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:45 smithi110 ceph-mon[28069]: pgmap v6890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:45 smithi193 ceph-mon[32782]: pgmap v6890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12102.021597 secs 2024-04-26T15:09:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:47 smithi196 ceph-mon[32572]: pgmap v6891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12102.021597 secs 2024-04-26T15:09:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:47 smithi110 ceph-mon[28069]: pgmap v6891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12102.021597 secs 2024-04-26T15:09:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:47 smithi193 ceph-mon[32782]: pgmap v6891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:49 smithi196 ceph-mon[32572]: pgmap v6892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:49 smithi110 ceph-mon[28069]: pgmap v6892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:49 smithi193 ceph-mon[32782]: pgmap v6892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:51 smithi110 ceph-mon[28069]: pgmap v6893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:51 smithi193 ceph-mon[32782]: pgmap v6893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:51 smithi196 ceph-mon[32572]: pgmap v6893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12107.021662 secs 2024-04-26T15:09:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12107.021662 secs 2024-04-26T15:09:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12107.021662 secs 2024-04-26T15:09:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:53 smithi110 ceph-mon[28069]: pgmap v6894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:53 smithi193 ceph-mon[32782]: pgmap v6894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:53 smithi196 ceph-mon[32572]: pgmap v6894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:55 smithi110 ceph-mon[28069]: pgmap v6895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:55 smithi193 ceph-mon[32782]: pgmap v6895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:55 smithi196 ceph-mon[32572]: pgmap v6895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12112.021798 secs 2024-04-26T15:09:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:57 smithi110 ceph-mon[28069]: pgmap v6896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12112.021798 secs 2024-04-26T15:09:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:57 smithi193 ceph-mon[32782]: pgmap v6896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12112.021798 secs 2024-04-26T15:09:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:57 smithi196 ceph-mon[32572]: pgmap v6896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:09:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:09:59 smithi110 ceph-mon[28069]: pgmap v6897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:09:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:09:59 smithi193 ceph-mon[32782]: pgmap v6897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:09:59 smithi196 ceph-mon[32572]: pgmap v6897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:10:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:10:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:10:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:01 smithi193 ceph-mon[32782]: pgmap v6898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:01 smithi196 ceph-mon[32572]: pgmap v6898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:01 smithi110 ceph-mon[28069]: pgmap v6898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12117.021934 secs 2024-04-26T15:10:03.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12117.021934 secs 2024-04-26T15:10:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12117.021934 secs 2024-04-26T15:10:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:03 smithi193 ceph-mon[32782]: pgmap v6899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:03 smithi196 ceph-mon[32572]: pgmap v6899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:03 smithi110 ceph-mon[28069]: pgmap v6899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:05 smithi193 ceph-mon[32782]: pgmap v6900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:10:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:05 smithi196 ceph-mon[32572]: pgmap v6900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:10:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:05 smithi110 ceph-mon[28069]: pgmap v6900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:10:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12122.022030 secs 2024-04-26T15:10:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:07 smithi193 ceph-mon[32782]: pgmap v6901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:10:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12122.022030 secs 2024-04-26T15:10:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:07 smithi196 ceph-mon[32572]: pgmap v6901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:10:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12122.022030 secs 2024-04-26T15:10:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:07 smithi110 ceph-mon[28069]: pgmap v6901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:10:09.809 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:09 smithi196 ceph-mon[32572]: pgmap v6902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:09 smithi193 ceph-mon[32782]: pgmap v6902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:09 smithi110 ceph-mon[28069]: pgmap v6902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:11 smithi193 ceph-mon[32782]: pgmap v6903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:10:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:11 smithi196 ceph-mon[32572]: pgmap v6903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:10:12.050 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:11 smithi110 ceph-mon[28069]: pgmap v6903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:10:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12127.022157 secs 2024-04-26T15:10:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12127.022157 secs 2024-04-26T15:10:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12127.022157 secs 2024-04-26T15:10:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:13 smithi193 ceph-mon[32782]: pgmap v6904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:13 smithi196 ceph-mon[32572]: pgmap v6904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:13 smithi110 ceph-mon[28069]: pgmap v6904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:15 smithi193 ceph-mon[32782]: pgmap v6905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:15 smithi196 ceph-mon[32572]: pgmap v6905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:15 smithi110 ceph-mon[28069]: pgmap v6905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12132.022279 secs 2024-04-26T15:10:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:17 smithi193 ceph-mon[32782]: pgmap v6906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12132.022279 secs 2024-04-26T15:10:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:17 smithi196 ceph-mon[32572]: pgmap v6906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12132.022279 secs 2024-04-26T15:10:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:17 smithi110 ceph-mon[28069]: pgmap v6906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:19 smithi193 ceph-mon[32782]: pgmap v6907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:10:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:19 smithi196 ceph-mon[32572]: pgmap v6907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:10:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:19 smithi110 ceph-mon[28069]: pgmap v6907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:10:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:10:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:10:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:20 smithi193 ceph-mon[32782]: pgmap v6908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:10:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:20 smithi193 ceph-mon[32782]: pgmap v6909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:10:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:10:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:10:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:10:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:20 smithi196 ceph-mon[32572]: pgmap v6908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:10:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:20 smithi196 ceph-mon[32572]: pgmap v6909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:10:21.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:10:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:10:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:10:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:20 smithi110 ceph-mon[28069]: pgmap v6908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:10:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:20 smithi110 ceph-mon[28069]: pgmap v6909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:10:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:10:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:23 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12137.022404 secs 2024-04-26T15:10:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:23 smithi196 ceph-mon[32572]: pgmap v6910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:10:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:23 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12137.022404 secs 2024-04-26T15:10:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:23 smithi110 ceph-mon[28069]: pgmap v6910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:10:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:23 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12137.022404 secs 2024-04-26T15:10:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:23 smithi193 ceph-mon[32782]: pgmap v6910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:10:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:25 smithi110 ceph-mon[28069]: pgmap v6911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:10:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:25 smithi193 ceph-mon[32782]: pgmap v6911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:10:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:25 smithi196 ceph-mon[32572]: pgmap v6911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:10:27.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:27 smithi110 ceph-mon[28069]: pgmap v6912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:10:27.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:27 smithi193 ceph-mon[32782]: pgmap v6912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:10:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:27 smithi196 ceph-mon[32572]: pgmap v6912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:10:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:28 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12142.022523 secs 2024-04-26T15:10:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:28 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12142.022523 secs 2024-04-26T15:10:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:28 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12142.022523 secs 2024-04-26T15:10:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:29 smithi110 ceph-mon[28069]: pgmap v6913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:10:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:29 smithi193 ceph-mon[32782]: pgmap v6913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:10:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:29 smithi196 ceph-mon[32572]: pgmap v6913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:10:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:31 smithi110 ceph-mon[28069]: pgmap v6914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:10:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:31 smithi193 ceph-mon[32782]: pgmap v6914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:10:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:31 smithi196 ceph-mon[32572]: pgmap v6914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:10:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12147.022653 secs 2024-04-26T15:10:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12147.022653 secs 2024-04-26T15:10:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12147.022653 secs 2024-04-26T15:10:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:33 smithi193 ceph-mon[32782]: pgmap v6915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:33 smithi196 ceph-mon[32572]: pgmap v6915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:33 smithi110 ceph-mon[28069]: pgmap v6915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:35.358 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:35 smithi110 ceph-mon[28069]: pgmap v6916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:35 smithi193 ceph-mon[32782]: pgmap v6916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:35 smithi196 ceph-mon[32572]: pgmap v6916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:37 smithi193 ceph-mon[32782]: pgmap v6917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12152.022718 secs 2024-04-26T15:10:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:37 smithi196 ceph-mon[32572]: pgmap v6917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12152.022718 secs 2024-04-26T15:10:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:37 smithi110 ceph-mon[28069]: pgmap v6917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12152.022718 secs 2024-04-26T15:10:39.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:39 smithi196 ceph-mon[32572]: pgmap v6918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:39 smithi193 ceph-mon[32782]: pgmap v6918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:39 smithi110 ceph-mon[28069]: pgmap v6918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:41 smithi193 ceph-mon[32782]: pgmap v6919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:41 smithi196 ceph-mon[32572]: pgmap v6919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:41 smithi110 ceph-mon[28069]: pgmap v6919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12157.022813 secs 2024-04-26T15:10:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12157.022813 secs 2024-04-26T15:10:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12157.022813 secs 2024-04-26T15:10:43.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:43 smithi193 ceph-mon[32782]: pgmap v6920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:43 smithi196 ceph-mon[32572]: pgmap v6920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:43 smithi110 ceph-mon[28069]: pgmap v6920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:45 smithi193 ceph-mon[32782]: pgmap v6921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:45 smithi196 ceph-mon[32572]: pgmap v6921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:45 smithi110 ceph-mon[28069]: pgmap v6921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:47 smithi193 ceph-mon[32782]: pgmap v6922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12162.022895 secs 2024-04-26T15:10:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:47 smithi196 ceph-mon[32572]: pgmap v6922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12162.022895 secs 2024-04-26T15:10:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:47 smithi110 ceph-mon[28069]: pgmap v6922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12162.022895 secs 2024-04-26T15:10:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:49 smithi193 ceph-mon[32782]: pgmap v6923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:49 smithi196 ceph-mon[32572]: pgmap v6923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:49 smithi110 ceph-mon[28069]: pgmap v6923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:51 smithi193 ceph-mon[32782]: pgmap v6924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:51 smithi196 ceph-mon[32572]: pgmap v6924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:51 smithi110 ceph-mon[28069]: pgmap v6924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12167.022970 secs 2024-04-26T15:10:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12167.022970 secs 2024-04-26T15:10:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12167.022970 secs 2024-04-26T15:10:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:53 smithi193 ceph-mon[32782]: pgmap v6925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:53.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:53 smithi110 ceph-mon[28069]: pgmap v6925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:53 smithi196 ceph-mon[32572]: pgmap v6925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:55 smithi193 ceph-mon[32782]: pgmap v6926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:55 smithi196 ceph-mon[32572]: pgmap v6926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:55 smithi110 ceph-mon[28069]: pgmap v6926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:57 smithi193 ceph-mon[32782]: pgmap v6927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12172.023081 secs 2024-04-26T15:10:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:57 smithi196 ceph-mon[32572]: pgmap v6927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12172.023081 secs 2024-04-26T15:10:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:57 smithi110 ceph-mon[28069]: pgmap v6927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:10:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12172.023081 secs 2024-04-26T15:10:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:10:59 smithi196 ceph-mon[32572]: pgmap v6928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:10:59 smithi110 ceph-mon[28069]: pgmap v6928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:10:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:10:59 smithi193 ceph-mon[32782]: pgmap v6928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:01 smithi196 ceph-mon[32572]: pgmap v6929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:01 smithi110 ceph-mon[28069]: pgmap v6929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:01 smithi193 ceph-mon[32782]: pgmap v6929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12177.023232 secs 2024-04-26T15:11:02.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12177.023232 secs 2024-04-26T15:11:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12177.023232 secs 2024-04-26T15:11:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:03 smithi196 ceph-mon[32572]: pgmap v6930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:03 smithi110 ceph-mon[28069]: pgmap v6930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:03 smithi193 ceph-mon[32782]: pgmap v6930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:05 smithi196 ceph-mon[32572]: pgmap v6931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:05 smithi110 ceph-mon[28069]: pgmap v6931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:05 smithi193 ceph-mon[32782]: pgmap v6931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:06 smithi196 ceph-mon[32572]: pgmap v6932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:06 smithi110 ceph-mon[28069]: pgmap v6932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:06 smithi193 ceph-mon[32782]: pgmap v6932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12182.023378 secs 2024-04-26T15:11:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12182.023378 secs 2024-04-26T15:11:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12182.023378 secs 2024-04-26T15:11:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:08 smithi196 ceph-mon[32572]: pgmap v6933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:08 smithi110 ceph-mon[28069]: pgmap v6933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:08 smithi193 ceph-mon[32782]: pgmap v6933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:11 smithi110 ceph-mon[28069]: pgmap v6934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:11 smithi193 ceph-mon[32782]: pgmap v6934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:11 smithi196 ceph-mon[32572]: pgmap v6934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12187.023514 secs 2024-04-26T15:11:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12187.023514 secs 2024-04-26T15:11:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12187.023514 secs 2024-04-26T15:11:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:13 smithi110 ceph-mon[28069]: pgmap v6935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:13 smithi193 ceph-mon[32782]: pgmap v6935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:13 smithi196 ceph-mon[32572]: pgmap v6935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:15 smithi193 ceph-mon[32782]: pgmap v6936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:15 smithi196 ceph-mon[32572]: pgmap v6936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:15 smithi110 ceph-mon[28069]: pgmap v6936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:17 smithi193 ceph-mon[32782]: pgmap v6937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:17.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12192.023639 secs 2024-04-26T15:11:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:17 smithi196 ceph-mon[32572]: pgmap v6937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12192.023639 secs 2024-04-26T15:11:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:17 smithi110 ceph-mon[28069]: pgmap v6937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12192.023639 secs 2024-04-26T15:11:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:19 smithi193 ceph-mon[32782]: pgmap v6938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:19 smithi196 ceph-mon[32572]: pgmap v6938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:19 smithi110 ceph-mon[28069]: pgmap v6938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:21 smithi193 ceph-mon[32782]: pgmap v6939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:11:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:21 smithi196 ceph-mon[32572]: pgmap v6939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:11:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:21 smithi110 ceph-mon[28069]: pgmap v6939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:11:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12197.023771 secs 2024-04-26T15:11:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:11:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:11:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:11:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12197.023771 secs 2024-04-26T15:11:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:11:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:11:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:11:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12197.023771 secs 2024-04-26T15:11:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:11:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:11:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:11:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:23 smithi193 ceph-mon[32782]: pgmap v6940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T15:11:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:23 smithi193 ceph-mon[32782]: pgmap v6941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:23.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:23 smithi110 ceph-mon[28069]: pgmap v6940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T15:11:23.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:23 smithi110 ceph-mon[28069]: pgmap v6941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:23 smithi196 ceph-mon[32572]: pgmap v6940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T15:11:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:23 smithi196 ceph-mon[32572]: pgmap v6941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:25 smithi193 ceph-mon[32782]: pgmap v6942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:25 smithi196 ceph-mon[32572]: pgmap v6942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:25 smithi110 ceph-mon[28069]: pgmap v6942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:27 smithi193 ceph-mon[32782]: pgmap v6943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12202.023912 secs 2024-04-26T15:11:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:27 smithi196 ceph-mon[32572]: pgmap v6943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12202.023912 secs 2024-04-26T15:11:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:27 smithi110 ceph-mon[28069]: pgmap v6943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12202.023912 secs 2024-04-26T15:11:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:29 smithi193 ceph-mon[32782]: pgmap v6944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:29 smithi196 ceph-mon[32572]: pgmap v6944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:29 smithi110 ceph-mon[28069]: pgmap v6944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:31 smithi193 ceph-mon[32782]: pgmap v6945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:31 smithi196 ceph-mon[32572]: pgmap v6945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:31 smithi110 ceph-mon[28069]: pgmap v6945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:11:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12207.024002 secs 2024-04-26T15:11:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12207.024002 secs 2024-04-26T15:11:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12207.024002 secs 2024-04-26T15:11:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:33 smithi193 ceph-mon[32782]: pgmap v6946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:11:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:33 smithi196 ceph-mon[32572]: pgmap v6946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:11:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:33 smithi110 ceph-mon[28069]: pgmap v6946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:11:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:35 smithi193 ceph-mon[32782]: pgmap v6947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:35 smithi196 ceph-mon[32572]: pgmap v6947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:35 smithi110 ceph-mon[28069]: pgmap v6947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:37 smithi193 ceph-mon[32782]: pgmap v6948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12212.024078 secs 2024-04-26T15:11:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:37 smithi196 ceph-mon[32572]: pgmap v6948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12212.024078 secs 2024-04-26T15:11:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:37 smithi110 ceph-mon[28069]: pgmap v6948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12212.024078 secs 2024-04-26T15:11:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:39 smithi193 ceph-mon[32782]: pgmap v6949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:39 smithi196 ceph-mon[32572]: pgmap v6949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:39 smithi110 ceph-mon[28069]: pgmap v6949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:41 smithi196 ceph-mon[32572]: pgmap v6950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:41 smithi110 ceph-mon[28069]: pgmap v6950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:41 smithi193 ceph-mon[32782]: pgmap v6950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12217.024171 secs 2024-04-26T15:11:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12217.024171 secs 2024-04-26T15:11:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12217.024171 secs 2024-04-26T15:11:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:43 smithi196 ceph-mon[32572]: pgmap v6951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:43 smithi110 ceph-mon[28069]: pgmap v6951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:43 smithi193 ceph-mon[32782]: pgmap v6951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:45 smithi196 ceph-mon[32572]: pgmap v6952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:45 smithi110 ceph-mon[28069]: pgmap v6952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:45 smithi193 ceph-mon[32782]: pgmap v6952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:47 smithi196 ceph-mon[32572]: pgmap v6953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12222.024302 secs 2024-04-26T15:11:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:47 smithi110 ceph-mon[28069]: pgmap v6953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12222.024302 secs 2024-04-26T15:11:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:47 smithi193 ceph-mon[32782]: pgmap v6953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12222.024302 secs 2024-04-26T15:11:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:49 smithi196 ceph-mon[32572]: pgmap v6954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:49 smithi110 ceph-mon[28069]: pgmap v6954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:49 smithi193 ceph-mon[32782]: pgmap v6954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:51 smithi196 ceph-mon[32572]: pgmap v6955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:51 smithi110 ceph-mon[28069]: pgmap v6955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:51 smithi193 ceph-mon[32782]: pgmap v6955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12227.024439 secs 2024-04-26T15:11:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:52 smithi196 ceph-mon[32572]: pgmap v6956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12227.024439 secs 2024-04-26T15:11:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:52 smithi110 ceph-mon[28069]: pgmap v6956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12227.024439 secs 2024-04-26T15:11:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:52 smithi193 ceph-mon[32782]: pgmap v6956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:54 smithi196 ceph-mon[32572]: pgmap v6957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:54 smithi110 ceph-mon[28069]: pgmap v6957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:54 smithi193 ceph-mon[32782]: pgmap v6957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:56 smithi196 ceph-mon[32572]: pgmap v6958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:56 smithi110 ceph-mon[28069]: pgmap v6958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:56 smithi193 ceph-mon[32782]: pgmap v6958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:11:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12232.024553 secs 2024-04-26T15:11:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12232.024553 secs 2024-04-26T15:11:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12232.024553 secs 2024-04-26T15:11:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:11:58 smithi196 ceph-mon[32572]: pgmap v6959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:11:58 smithi110 ceph-mon[28069]: pgmap v6959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:11:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:11:58 smithi193 ceph-mon[32782]: pgmap v6959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:00 smithi196 ceph-mon[32572]: pgmap v6960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:00 smithi110 ceph-mon[28069]: pgmap v6960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:00 smithi193 ceph-mon[32782]: pgmap v6960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:02.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12237.024650 secs 2024-04-26T15:12:02.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:02 smithi193 ceph-mon[32782]: pgmap v6961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12237.024650 secs 2024-04-26T15:12:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:02 smithi196 ceph-mon[32572]: pgmap v6961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12237.024650 secs 2024-04-26T15:12:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:02 smithi110 ceph-mon[28069]: pgmap v6961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:04 smithi196 ceph-mon[32572]: pgmap v6962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:04 smithi110 ceph-mon[28069]: pgmap v6962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:04 smithi193 ceph-mon[32782]: pgmap v6962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:06 smithi196 ceph-mon[32572]: pgmap v6963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:06 smithi110 ceph-mon[28069]: pgmap v6963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:06 smithi193 ceph-mon[32782]: pgmap v6963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:07 smithi196 ceph-mon[32572]: 11 slow requests, 1 included below; oldest blocked for > 12242.024800 secs 2024-04-26T15:12:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:07 smithi196 ceph-mon[32572]: slow request 2881.518286 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:12:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:07 smithi110 ceph-mon[28069]: 11 slow requests, 1 included below; oldest blocked for > 12242.024800 secs 2024-04-26T15:12:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:07 smithi110 ceph-mon[28069]: slow request 2881.518286 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:12:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:07 smithi193 ceph-mon[32782]: 11 slow requests, 1 included below; oldest blocked for > 12242.024800 secs 2024-04-26T15:12:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:07 smithi193 ceph-mon[32782]: slow request 2881.518286 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:12:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:08 smithi196 ceph-mon[32572]: pgmap v6964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:08 smithi110 ceph-mon[28069]: pgmap v6964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:08 smithi193 ceph-mon[32782]: pgmap v6964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:10 smithi196 ceph-mon[32572]: pgmap v6965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:10 smithi110 ceph-mon[28069]: pgmap v6965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:10 smithi193 ceph-mon[32782]: pgmap v6965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12247.024945 secs 2024-04-26T15:12:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:12 smithi196 ceph-mon[32572]: pgmap v6966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12247.024945 secs 2024-04-26T15:12:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:12 smithi110 ceph-mon[28069]: pgmap v6966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12247.024945 secs 2024-04-26T15:12:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:12 smithi193 ceph-mon[32782]: pgmap v6966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:14 smithi196 ceph-mon[32572]: pgmap v6967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:14 smithi110 ceph-mon[28069]: pgmap v6967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:14 smithi193 ceph-mon[32782]: pgmap v6967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:16 smithi196 ceph-mon[32572]: pgmap v6968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:16 smithi110 ceph-mon[28069]: pgmap v6968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:16 smithi193 ceph-mon[32782]: pgmap v6968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12252.025084 secs 2024-04-26T15:12:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12252.025084 secs 2024-04-26T15:12:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12252.025084 secs 2024-04-26T15:12:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:12:18.370+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:12:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:12:18.370+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T15:12:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:12:18.371+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 97 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T15:12:18.372 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:12:18.371+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 97 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:12:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:18 smithi196 ceph-mon[32572]: pgmap v6969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:18 smithi110 ceph-mon[28069]: pgmap v6969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:18 smithi193 ceph-mon[32782]: pgmap v6969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:20 smithi196 ceph-mon[32572]: pgmap v6970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:20 smithi110 ceph-mon[28069]: pgmap v6970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:20 smithi193 ceph-mon[32782]: pgmap v6970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12257.025210 secs 2024-04-26T15:12:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:22 smithi196 ceph-mon[32572]: pgmap v6971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:12:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12257.025210 secs 2024-04-26T15:12:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:22 smithi110 ceph-mon[28069]: pgmap v6971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:12:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12257.025210 secs 2024-04-26T15:12:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:22 smithi193 ceph-mon[32782]: pgmap v6971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:12:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:12:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:12:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:12:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:12:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:12:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:12:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:12:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:12:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:12:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:24 smithi196 ceph-mon[32572]: pgmap v6972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:12:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:24 smithi196 ceph-mon[32572]: pgmap v6973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:24 smithi110 ceph-mon[28069]: pgmap v6972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:12:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:24 smithi110 ceph-mon[28069]: pgmap v6973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:24 smithi193 ceph-mon[32782]: pgmap v6972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:12:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:24 smithi193 ceph-mon[32782]: pgmap v6973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:26 smithi196 ceph-mon[32572]: pgmap v6974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:26 smithi110 ceph-mon[28069]: pgmap v6974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:26 smithi193 ceph-mon[32782]: pgmap v6974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12262.025305 secs 2024-04-26T15:12:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12262.025305 secs 2024-04-26T15:12:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12262.025305 secs 2024-04-26T15:12:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:28 smithi110 ceph-mon[28069]: pgmap v6975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T15:12:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:28 smithi193 ceph-mon[32782]: pgmap v6975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T15:12:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:28 smithi196 ceph-mon[32572]: pgmap v6975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T15:12:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:30 smithi110 ceph-mon[28069]: pgmap v6976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:30 smithi193 ceph-mon[32782]: pgmap v6976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:30 smithi196 ceph-mon[32572]: pgmap v6976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:32 smithi110 ceph-mon[28069]: pgmap v6977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12267.025430 secs 2024-04-26T15:12:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:32 smithi193 ceph-mon[32782]: pgmap v6977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12267.025430 secs 2024-04-26T15:12:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:32 smithi196 ceph-mon[32572]: pgmap v6977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:12:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12267.025430 secs 2024-04-26T15:12:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:34 smithi110 ceph-mon[28069]: pgmap v6978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:12:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:34 smithi193 ceph-mon[32782]: pgmap v6978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:12:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:34 smithi196 ceph-mon[32572]: pgmap v6978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:12:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:36 smithi110 ceph-mon[28069]: pgmap v6979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:36 smithi193 ceph-mon[32782]: pgmap v6979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:36 smithi196 ceph-mon[32572]: pgmap v6979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12272.025500 secs 2024-04-26T15:12:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12272.025500 secs 2024-04-26T15:12:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12272.025500 secs 2024-04-26T15:12:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:38 smithi193 ceph-mon[32782]: pgmap v6980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:38 smithi196 ceph-mon[32572]: pgmap v6980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:38 smithi110 ceph-mon[28069]: pgmap v6980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:40 smithi193 ceph-mon[32782]: pgmap v6981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:40 smithi196 ceph-mon[32572]: pgmap v6981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:40 smithi110 ceph-mon[28069]: pgmap v6981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:43.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:42 smithi196 ceph-mon[32572]: pgmap v6982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:43.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12277.025604 secs 2024-04-26T15:12:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:42 smithi193 ceph-mon[32782]: pgmap v6982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12277.025604 secs 2024-04-26T15:12:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:42 smithi110 ceph-mon[28069]: pgmap v6982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12277.025604 secs 2024-04-26T15:12:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:44 smithi193 ceph-mon[32782]: pgmap v6983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:44 smithi196 ceph-mon[32572]: pgmap v6983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:44 smithi110 ceph-mon[28069]: pgmap v6983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:46 smithi193 ceph-mon[32782]: pgmap v6984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:46 smithi196 ceph-mon[32572]: pgmap v6984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:46 smithi110 ceph-mon[28069]: pgmap v6984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12282.025720 secs 2024-04-26T15:12:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12282.025720 secs 2024-04-26T15:12:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12282.025720 secs 2024-04-26T15:12:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:48 smithi193 ceph-mon[32782]: pgmap v6985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:48 smithi196 ceph-mon[32572]: pgmap v6985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:48 smithi110 ceph-mon[28069]: pgmap v6985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:50 smithi193 ceph-mon[32782]: pgmap v6986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:50 smithi196 ceph-mon[32572]: pgmap v6986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:50 smithi110 ceph-mon[28069]: pgmap v6986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:52 smithi193 ceph-mon[32782]: pgmap v6987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12287.025857 secs 2024-04-26T15:12:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:52 smithi196 ceph-mon[32572]: pgmap v6987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12287.025857 secs 2024-04-26T15:12:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:52 smithi110 ceph-mon[28069]: pgmap v6987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12287.025857 secs 2024-04-26T15:12:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:54 smithi193 ceph-mon[32782]: pgmap v6988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:54 smithi196 ceph-mon[32572]: pgmap v6988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:54 smithi110 ceph-mon[28069]: pgmap v6988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:12:57.096 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:56 smithi110 ceph-mon[28069]: pgmap v6989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:56 smithi193 ceph-mon[32782]: pgmap v6989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:56 smithi196 ceph-mon[32572]: pgmap v6989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12292.025974 secs 2024-04-26T15:12:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12292.025974 secs 2024-04-26T15:12:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12292.025974 secs 2024-04-26T15:12:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:12:58 smithi193 ceph-mon[32782]: pgmap v6990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:12:58 smithi196 ceph-mon[32572]: pgmap v6990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:12:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:12:58 smithi110 ceph-mon[28069]: pgmap v6990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:00 smithi196 ceph-mon[32572]: pgmap v6991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:00 smithi110 ceph-mon[28069]: pgmap v6991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:00 smithi193 ceph-mon[32782]: pgmap v6991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:03.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:02 smithi193 ceph-mon[32782]: pgmap v6992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:03.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12297.026095 secs 2024-04-26T15:13:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:02 smithi196 ceph-mon[32572]: pgmap v6992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12297.026095 secs 2024-04-26T15:13:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:02 smithi110 ceph-mon[28069]: pgmap v6992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12297.026095 secs 2024-04-26T15:13:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:04 smithi196 ceph-mon[32572]: pgmap v6993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:04 smithi110 ceph-mon[28069]: pgmap v6993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:04 smithi193 ceph-mon[32782]: pgmap v6993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:06 smithi196 ceph-mon[32572]: pgmap v6994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:06 smithi110 ceph-mon[28069]: pgmap v6994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:06 smithi193 ceph-mon[32782]: pgmap v6994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12302.026211 secs 2024-04-26T15:13:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12302.026211 secs 2024-04-26T15:13:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12302.026211 secs 2024-04-26T15:13:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:08 smithi196 ceph-mon[32572]: pgmap v6995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:08 smithi110 ceph-mon[28069]: pgmap v6995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:08 smithi193 ceph-mon[32782]: pgmap v6995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:10 smithi196 ceph-mon[32572]: pgmap v6996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:10 smithi110 ceph-mon[28069]: pgmap v6996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:10 smithi193 ceph-mon[32782]: pgmap v6996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:12 smithi196 ceph-mon[32572]: pgmap v6997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12307.026370 secs 2024-04-26T15:13:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:12 smithi110 ceph-mon[28069]: pgmap v6997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12307.026370 secs 2024-04-26T15:13:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:12 smithi193 ceph-mon[32782]: pgmap v6997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12307.026370 secs 2024-04-26T15:13:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:14 smithi196 ceph-mon[32572]: pgmap v6998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:14 smithi110 ceph-mon[28069]: pgmap v6998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:14 smithi193 ceph-mon[32782]: pgmap v6998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:16 smithi196 ceph-mon[32572]: pgmap v6999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:16 smithi110 ceph-mon[28069]: pgmap v6999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:16 smithi193 ceph-mon[32782]: pgmap v6999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12312.026491 secs 2024-04-26T15:13:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12312.026491 secs 2024-04-26T15:13:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12312.026491 secs 2024-04-26T15:13:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:18 smithi196 ceph-mon[32572]: pgmap v7000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:18 smithi110 ceph-mon[28069]: pgmap v7000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:18 smithi193 ceph-mon[32782]: pgmap v7000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:20 smithi196 ceph-mon[32572]: pgmap v7001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:20 smithi110 ceph-mon[28069]: pgmap v7001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:20 smithi193 ceph-mon[32782]: pgmap v7001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:22 smithi196 ceph-mon[32572]: pgmap v7002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12317.026615 secs 2024-04-26T15:13:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:22 smithi110 ceph-mon[28069]: pgmap v7002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12317.026615 secs 2024-04-26T15:13:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:22 smithi193 ceph-mon[32782]: pgmap v7002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12317.026615 secs 2024-04-26T15:13:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:13:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:13:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:13:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:24 smithi196 ceph-mon[32572]: pgmap v7003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:13:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:13:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:13:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:24 smithi110 ceph-mon[28069]: pgmap v7003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:13:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:13:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:13:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:24 smithi193 ceph-mon[32782]: pgmap v7003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:13:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:13:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:13:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:25 smithi196 ceph-mon[32572]: pgmap v7004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:13:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:25 smithi196 ceph-mon[32572]: pgmap v7005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:25 smithi110 ceph-mon[28069]: pgmap v7004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:13:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:25 smithi110 ceph-mon[28069]: pgmap v7005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:25 smithi193 ceph-mon[32782]: pgmap v7004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:13:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:25 smithi193 ceph-mon[32782]: pgmap v7005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12322.026768 secs 2024-04-26T15:13:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:27 smithi196 ceph-mon[32572]: pgmap v7006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12322.026768 secs 2024-04-26T15:13:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:27 smithi110 ceph-mon[28069]: pgmap v7006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12322.026768 secs 2024-04-26T15:13:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:27 smithi193 ceph-mon[32782]: pgmap v7006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:29 smithi196 ceph-mon[32572]: pgmap v7007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:29 smithi110 ceph-mon[28069]: pgmap v7007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:29 smithi193 ceph-mon[32782]: pgmap v7007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:31 smithi196 ceph-mon[32572]: pgmap v7008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:31 smithi110 ceph-mon[28069]: pgmap v7008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:31 smithi193 ceph-mon[32782]: pgmap v7008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12327.026911 secs 2024-04-26T15:13:33.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12327.026911 secs 2024-04-26T15:13:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12327.026911 secs 2024-04-26T15:13:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:33 smithi196 ceph-mon[32572]: pgmap v7009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:33 smithi110 ceph-mon[28069]: pgmap v7009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:33 smithi193 ceph-mon[32782]: pgmap v7009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:13:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:36 smithi196 ceph-mon[32572]: pgmap v7010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:13:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:36 smithi110 ceph-mon[28069]: pgmap v7010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:13:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:36 smithi193 ceph-mon[32782]: pgmap v7010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:13:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:38 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12332.027030 secs 2024-04-26T15:13:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:38 smithi110 ceph-mon[28069]: pgmap v7011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:38 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12332.027030 secs 2024-04-26T15:13:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:38 smithi193 ceph-mon[32782]: pgmap v7011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:38 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12332.027030 secs 2024-04-26T15:13:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:38 smithi196 ceph-mon[32572]: pgmap v7011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:40.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:40 smithi110 ceph-mon[28069]: pgmap v7012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:40 smithi193 ceph-mon[32782]: pgmap v7012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:40 smithi196 ceph-mon[32572]: pgmap v7012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:42 smithi110 ceph-mon[28069]: pgmap v7013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:42 smithi193 ceph-mon[32782]: pgmap v7013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:42 smithi196 ceph-mon[32572]: pgmap v7013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:43 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12337.027152 secs 2024-04-26T15:13:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:43 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12337.027152 secs 2024-04-26T15:13:43.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:43 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12337.027152 secs 2024-04-26T15:13:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:44 smithi110 ceph-mon[28069]: pgmap v7014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:44 smithi193 ceph-mon[32782]: pgmap v7014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:44 smithi196 ceph-mon[32572]: pgmap v7014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:46 smithi110 ceph-mon[28069]: pgmap v7015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:46 smithi193 ceph-mon[32782]: pgmap v7015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:46 smithi196 ceph-mon[32572]: pgmap v7015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:48 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12342.027270 secs 2024-04-26T15:13:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:48 smithi110 ceph-mon[28069]: pgmap v7016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:48 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12342.027270 secs 2024-04-26T15:13:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:48 smithi193 ceph-mon[32782]: pgmap v7016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:48 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12342.027270 secs 2024-04-26T15:13:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:48 smithi196 ceph-mon[32572]: pgmap v7016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:50 smithi193 ceph-mon[32782]: pgmap v7017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:50 smithi196 ceph-mon[32572]: pgmap v7017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:50 smithi110 ceph-mon[28069]: pgmap v7017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:52 smithi193 ceph-mon[32782]: pgmap v7018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12347.027413 secs 2024-04-26T15:13:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:52 smithi196 ceph-mon[32572]: pgmap v7018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12347.027413 secs 2024-04-26T15:13:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:52 smithi110 ceph-mon[28069]: pgmap v7018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12347.027413 secs 2024-04-26T15:13:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:54 smithi193 ceph-mon[32782]: pgmap v7019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:54 smithi196 ceph-mon[32572]: pgmap v7019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:54 smithi110 ceph-mon[28069]: pgmap v7019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:13:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:56 smithi193 ceph-mon[32782]: pgmap v7020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:56 smithi196 ceph-mon[32572]: pgmap v7020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:56 smithi110 ceph-mon[28069]: pgmap v7020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12352.027587 secs 2024-04-26T15:13:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12352.027587 secs 2024-04-26T15:13:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12352.027587 secs 2024-04-26T15:13:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:13:58 smithi193 ceph-mon[32782]: pgmap v7021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:58.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:13:58 smithi110 ceph-mon[28069]: pgmap v7021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:13:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:13:58 smithi196 ceph-mon[32572]: pgmap v7021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:00 smithi193 ceph-mon[32782]: pgmap v7022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:00 smithi196 ceph-mon[32572]: pgmap v7022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:00 smithi110 ceph-mon[28069]: pgmap v7022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:02 smithi193 ceph-mon[32782]: pgmap v7023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12357.027680 secs 2024-04-26T15:14:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:02 smithi196 ceph-mon[32572]: pgmap v7023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12357.027680 secs 2024-04-26T15:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:02 smithi110 ceph-mon[28069]: pgmap v7023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12357.027680 secs 2024-04-26T15:14:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:04 smithi193 ceph-mon[32782]: pgmap v7024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:04 smithi196 ceph-mon[32572]: pgmap v7024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:04 smithi110 ceph-mon[28069]: pgmap v7024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:06 smithi193 ceph-mon[32782]: pgmap v7025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:06.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:06 smithi196 ceph-mon[32572]: pgmap v7025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:06 smithi110 ceph-mon[28069]: pgmap v7025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:06.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:14:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:14:06.245+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:14:06.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:14:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:14:06.245+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:14:06.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:14:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:14:06.245+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:14:06.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:14:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:14:06.245+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:14:06.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:14:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:14:06.245+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:14:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12362.027797 secs 2024-04-26T15:14:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12362.027797 secs 2024-04-26T15:14:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12362.027797 secs 2024-04-26T15:14:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:08 smithi193 ceph-mon[32782]: pgmap v7026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:08 smithi196 ceph-mon[32572]: pgmap v7026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:08 smithi110 ceph-mon[28069]: pgmap v7026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:10 smithi193 ceph-mon[32782]: pgmap v7027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:14:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:10 smithi196 ceph-mon[32572]: pgmap v7027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:14:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:10 smithi110 ceph-mon[28069]: pgmap v7027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:14:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:12 smithi193 ceph-mon[32782]: pgmap v7028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:14:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12367.027902 secs 2024-04-26T15:14:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:12 smithi196 ceph-mon[32572]: pgmap v7028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:14:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12367.027902 secs 2024-04-26T15:14:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:12 smithi110 ceph-mon[28069]: pgmap v7028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:14:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12367.027902 secs 2024-04-26T15:14:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:14 smithi193 ceph-mon[32782]: pgmap v7029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:14:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:14 smithi196 ceph-mon[32572]: pgmap v7029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:14:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:14 smithi110 ceph-mon[28069]: pgmap v7029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:14:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:16 smithi196 ceph-mon[32572]: pgmap v7030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:14:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:16 smithi110 ceph-mon[28069]: pgmap v7030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:14:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:16 smithi193 ceph-mon[32782]: pgmap v7030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:14:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12372.027979 secs 2024-04-26T15:14:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12372.027979 secs 2024-04-26T15:14:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12372.027979 secs 2024-04-26T15:14:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:18 smithi196 ceph-mon[32572]: pgmap v7031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:14:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:18 smithi110 ceph-mon[28069]: pgmap v7031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:14:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:18 smithi193 ceph-mon[32782]: pgmap v7031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:14:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:20 smithi196 ceph-mon[32572]: pgmap v7032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:14:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:20 smithi110 ceph-mon[28069]: pgmap v7032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:14:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:20 smithi193 ceph-mon[32782]: pgmap v7032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:14:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:22 smithi196 ceph-mon[32572]: pgmap v7033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12377.028119 secs 2024-04-26T15:14:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:22 smithi110 ceph-mon[28069]: pgmap v7033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12377.028119 secs 2024-04-26T15:14:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:22 smithi193 ceph-mon[32782]: pgmap v7033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12377.028119 secs 2024-04-26T15:14:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:24 smithi196 ceph-mon[32572]: pgmap v7034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:24 smithi110 ceph-mon[28069]: pgmap v7034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:24 smithi193 ceph-mon[32782]: pgmap v7034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:14:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:14:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:14:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:26 smithi196 ceph-mon[32572]: pgmap v7035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:26 smithi110 ceph-mon[28069]: pgmap v7035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:26 smithi193 ceph-mon[32782]: pgmap v7035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:14:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:14:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:14:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12382.028239 secs 2024-04-26T15:14:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:14:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:14:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:14:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12382.028239 secs 2024-04-26T15:14:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:14:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:14:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:14:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12382.028239 secs 2024-04-26T15:14:28.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:28 smithi110 ceph-mon[28069]: pgmap v7036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T15:14:28.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:28 smithi110 ceph-mon[28069]: pgmap v7037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:28 smithi196 ceph-mon[32572]: pgmap v7036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T15:14:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:28 smithi196 ceph-mon[32572]: pgmap v7037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:28 smithi193 ceph-mon[32782]: pgmap v7036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T15:14:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:28 smithi193 ceph-mon[32782]: pgmap v7037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:30 smithi196 ceph-mon[32572]: pgmap v7038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:30 smithi110 ceph-mon[28069]: pgmap v7038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:30 smithi193 ceph-mon[32782]: pgmap v7038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:32 smithi196 ceph-mon[32572]: pgmap v7039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12387.028354 secs 2024-04-26T15:14:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:32 smithi110 ceph-mon[28069]: pgmap v7039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12387.028354 secs 2024-04-26T15:14:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:32 smithi193 ceph-mon[32782]: pgmap v7039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12387.028354 secs 2024-04-26T15:14:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:14:33.394+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T15:14:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:14:33.394+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:14:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:14:33.395+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 98 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:14:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:14:33.395+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 98 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T15:14:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:33 smithi196 ceph-mon[32572]: pgmap v7040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T15:14:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:33 smithi110 ceph-mon[28069]: pgmap v7040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T15:14:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:33 smithi193 ceph-mon[32782]: pgmap v7040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T15:14:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:35 smithi193 ceph-mon[32782]: pgmap v7041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:35 smithi196 ceph-mon[32572]: pgmap v7041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:35 smithi110 ceph-mon[28069]: pgmap v7041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:14:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:37 smithi193 ceph-mon[32782]: pgmap v7042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:14:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12392.028447 secs 2024-04-26T15:14:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:37 smithi196 ceph-mon[32572]: pgmap v7042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:14:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12392.028447 secs 2024-04-26T15:14:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:37 smithi110 ceph-mon[28069]: pgmap v7042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:14:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12392.028447 secs 2024-04-26T15:14:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:39 smithi193 ceph-mon[32782]: pgmap v7043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:39 smithi196 ceph-mon[32572]: pgmap v7043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:39 smithi110 ceph-mon[28069]: pgmap v7043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:41 smithi193 ceph-mon[32782]: pgmap v7044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:41 smithi196 ceph-mon[32572]: pgmap v7044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:41 smithi110 ceph-mon[28069]: pgmap v7044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12397.028581 secs 2024-04-26T15:14:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12397.028581 secs 2024-04-26T15:14:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12397.028581 secs 2024-04-26T15:14:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:43 smithi196 ceph-mon[32572]: pgmap v7045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:43 smithi110 ceph-mon[28069]: pgmap v7045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:43 smithi193 ceph-mon[32782]: pgmap v7045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:45 smithi196 ceph-mon[32572]: pgmap v7046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:14:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:45 smithi110 ceph-mon[28069]: pgmap v7046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:14:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:45 smithi193 ceph-mon[32782]: pgmap v7046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:14:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:47 smithi196 ceph-mon[32572]: pgmap v7047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12402.028681 secs 2024-04-26T15:14:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:47 smithi110 ceph-mon[28069]: pgmap v7047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12402.028681 secs 2024-04-26T15:14:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:47 smithi193 ceph-mon[32782]: pgmap v7047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12402.028681 secs 2024-04-26T15:14:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:49 smithi196 ceph-mon[32572]: pgmap v7048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:49 smithi110 ceph-mon[28069]: pgmap v7048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:49 smithi193 ceph-mon[32782]: pgmap v7048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:51 smithi196 ceph-mon[32572]: pgmap v7049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:51 smithi110 ceph-mon[28069]: pgmap v7049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:51 smithi193 ceph-mon[32782]: pgmap v7049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12407.028802 secs 2024-04-26T15:14:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12407.028802 secs 2024-04-26T15:14:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12407.028802 secs 2024-04-26T15:14:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:53 smithi196 ceph-mon[32572]: pgmap v7050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:53 smithi110 ceph-mon[28069]: pgmap v7050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:53 smithi193 ceph-mon[32782]: pgmap v7050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:55 smithi196 ceph-mon[32572]: pgmap v7051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:14:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:55 smithi110 ceph-mon[28069]: pgmap v7051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:14:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:55 smithi193 ceph-mon[32782]: pgmap v7051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:14:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:57 smithi196 ceph-mon[32572]: pgmap v7052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12412.028915 secs 2024-04-26T15:14:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:57 smithi110 ceph-mon[28069]: pgmap v7052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12412.028915 secs 2024-04-26T15:14:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:57 smithi193 ceph-mon[32782]: pgmap v7052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:14:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12412.028915 secs 2024-04-26T15:14:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:14:59 smithi196 ceph-mon[32572]: pgmap v7053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:14:59 smithi110 ceph-mon[28069]: pgmap v7053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:14:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:14:59 smithi193 ceph-mon[32782]: pgmap v7053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:01 smithi196 ceph-mon[32572]: pgmap v7054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:01 smithi110 ceph-mon[28069]: pgmap v7054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:01 smithi193 ceph-mon[32782]: pgmap v7054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12417.029050 secs 2024-04-26T15:15:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12417.029050 secs 2024-04-26T15:15:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12417.029050 secs 2024-04-26T15:15:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:03 smithi196 ceph-mon[32572]: pgmap v7055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:15:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:03 smithi110 ceph-mon[28069]: pgmap v7055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:15:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:03 smithi193 ceph-mon[32782]: pgmap v7055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:15:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:05 smithi196 ceph-mon[32572]: pgmap v7056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:05 smithi110 ceph-mon[28069]: pgmap v7056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:05 smithi193 ceph-mon[32782]: pgmap v7056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:07 smithi196 ceph-mon[32572]: pgmap v7057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:15:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:07 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12422.029131 secs 2024-04-26T15:15:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:07 smithi110 ceph-mon[28069]: pgmap v7057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:15:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:07 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12422.029131 secs 2024-04-26T15:15:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:07 smithi193 ceph-mon[32782]: pgmap v7057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:15:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:07 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12422.029131 secs 2024-04-26T15:15:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:09 smithi196 ceph-mon[32572]: pgmap v7058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:09 smithi110 ceph-mon[28069]: pgmap v7058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:09 smithi193 ceph-mon[32782]: pgmap v7058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:11 smithi196 ceph-mon[32572]: pgmap v7059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:15:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:11 smithi110 ceph-mon[28069]: pgmap v7059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:15:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:11 smithi193 ceph-mon[32782]: pgmap v7059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:15:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:12 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12427.029254 secs 2024-04-26T15:15:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:12 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12427.029254 secs 2024-04-26T15:15:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:12 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12427.029254 secs 2024-04-26T15:15:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:13 smithi196 ceph-mon[32572]: pgmap v7060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:13 smithi110 ceph-mon[28069]: pgmap v7060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:13 smithi193 ceph-mon[32782]: pgmap v7060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:15 smithi196 ceph-mon[32572]: pgmap v7061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:15 smithi110 ceph-mon[28069]: pgmap v7061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:15 smithi193 ceph-mon[32782]: pgmap v7061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:15:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:17 smithi196 ceph-mon[32572]: pgmap v7062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:17 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12432.029391 secs 2024-04-26T15:15:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:17 smithi110 ceph-mon[28069]: pgmap v7062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:17 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12432.029391 secs 2024-04-26T15:15:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:17 smithi193 ceph-mon[32782]: pgmap v7062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:17 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12432.029391 secs 2024-04-26T15:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:15:18.402+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T15:15:18.403 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:15:18.402+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:15:18.403+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 99 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:15:18.404 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:15:18.403+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 99 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T15:15:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:19 smithi196 ceph-mon[32572]: pgmap v7063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:19 smithi110 ceph-mon[28069]: pgmap v7063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:19 smithi193 ceph-mon[32782]: pgmap v7063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:21 smithi196 ceph-mon[32572]: pgmap v7064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:21 smithi110 ceph-mon[28069]: pgmap v7064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:21 smithi193 ceph-mon[32782]: pgmap v7064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12437.029515 secs 2024-04-26T15:15:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12437.029515 secs 2024-04-26T15:15:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12437.029515 secs 2024-04-26T15:15:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:23 smithi110 ceph-mon[28069]: pgmap v7065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:23 smithi193 ceph-mon[32782]: pgmap v7065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:23 smithi196 ceph-mon[32572]: pgmap v7065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:25 smithi110 ceph-mon[28069]: pgmap v7066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:15:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:25 smithi193 ceph-mon[32782]: pgmap v7066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:15:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:25 smithi196 ceph-mon[32572]: pgmap v7066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:27 smithi110 ceph-mon[28069]: pgmap v7067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12442.029635 secs 2024-04-26T15:15:27.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:15:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:27 smithi193 ceph-mon[32782]: pgmap v7067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12442.029635 secs 2024-04-26T15:15:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:15:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:27 smithi196 ceph-mon[32572]: pgmap v7067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12442.029635 secs 2024-04-26T15:15:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:15:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:15:28.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:15:28.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:28 smithi110 ceph-mon[28069]: pgmap v7068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:15:28.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:28 smithi110 ceph-mon[28069]: pgmap v7069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:28.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:15:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:15:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:15:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:28 smithi193 ceph-mon[32782]: pgmap v7068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:15:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:28 smithi193 ceph-mon[32782]: pgmap v7069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:15:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:15:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:15:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:28 smithi196 ceph-mon[32572]: pgmap v7068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:15:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:28 smithi196 ceph-mon[32572]: pgmap v7069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:15:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:30 smithi196 ceph-mon[32572]: pgmap v7070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:30 smithi110 ceph-mon[28069]: pgmap v7070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:30 smithi193 ceph-mon[32782]: pgmap v7070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12447.029765 secs 2024-04-26T15:15:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:32 smithi196 ceph-mon[32572]: pgmap v7071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:15:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12447.029765 secs 2024-04-26T15:15:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:32 smithi110 ceph-mon[28069]: pgmap v7071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:15:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12447.029765 secs 2024-04-26T15:15:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:32 smithi193 ceph-mon[32782]: pgmap v7071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:15:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:34 smithi196 ceph-mon[32572]: pgmap v7072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:34 smithi110 ceph-mon[28069]: pgmap v7072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:34 smithi193 ceph-mon[32782]: pgmap v7072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:36 smithi196 ceph-mon[32572]: pgmap v7073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:36 smithi110 ceph-mon[28069]: pgmap v7073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:36 smithi193 ceph-mon[32782]: pgmap v7073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:15:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12452.029887 secs 2024-04-26T15:15:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12452.029887 secs 2024-04-26T15:15:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12452.029887 secs 2024-04-26T15:15:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:38 smithi196 ceph-mon[32572]: pgmap v7074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:15:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:38 smithi110 ceph-mon[28069]: pgmap v7074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:15:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:38 smithi193 ceph-mon[32782]: pgmap v7074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:15:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:40 smithi196 ceph-mon[32572]: pgmap v7075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:40 smithi110 ceph-mon[28069]: pgmap v7075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:40 smithi193 ceph-mon[32782]: pgmap v7075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12457.029987 secs 2024-04-26T15:15:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:42 smithi196 ceph-mon[32572]: pgmap v7076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12457.029987 secs 2024-04-26T15:15:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:42 smithi110 ceph-mon[28069]: pgmap v7076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12457.029987 secs 2024-04-26T15:15:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:42 smithi193 ceph-mon[32782]: pgmap v7076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:44 smithi196 ceph-mon[32572]: pgmap v7077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:44 smithi110 ceph-mon[28069]: pgmap v7077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:44 smithi193 ceph-mon[32782]: pgmap v7077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:46 smithi196 ceph-mon[32572]: pgmap v7078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:46 smithi110 ceph-mon[28069]: pgmap v7078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:46 smithi193 ceph-mon[32782]: pgmap v7078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12462.030064 secs 2024-04-26T15:15:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12462.030064 secs 2024-04-26T15:15:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12462.030064 secs 2024-04-26T15:15:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:48 smithi196 ceph-mon[32572]: pgmap v7079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:48 smithi110 ceph-mon[28069]: pgmap v7079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:48 smithi193 ceph-mon[32782]: pgmap v7079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:50 smithi196 ceph-mon[32572]: pgmap v7080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:50 smithi110 ceph-mon[28069]: pgmap v7080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:50 smithi193 ceph-mon[32782]: pgmap v7080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12467.030176 secs 2024-04-26T15:15:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:52 smithi196 ceph-mon[32572]: pgmap v7081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12467.030176 secs 2024-04-26T15:15:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:52 smithi110 ceph-mon[28069]: pgmap v7081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12467.030176 secs 2024-04-26T15:15:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:52 smithi193 ceph-mon[32782]: pgmap v7081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:54 smithi196 ceph-mon[32572]: pgmap v7082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:54 smithi110 ceph-mon[28069]: pgmap v7082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:54 smithi193 ceph-mon[32782]: pgmap v7082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:57 smithi196 ceph-mon[32572]: pgmap v7083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:57 smithi110 ceph-mon[28069]: pgmap v7083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:57 smithi193 ceph-mon[32782]: pgmap v7083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:15:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:58 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12472.030307 secs 2024-04-26T15:15:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:58 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12472.030307 secs 2024-04-26T15:15:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:58 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12472.030307 secs 2024-04-26T15:15:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:15:59 smithi110 ceph-mon[28069]: pgmap v7084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:15:59 smithi193 ceph-mon[32782]: pgmap v7084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:15:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:15:59 smithi196 ceph-mon[32572]: pgmap v7084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:01 smithi110 ceph-mon[28069]: pgmap v7085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:01 smithi193 ceph-mon[32782]: pgmap v7085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:01 smithi196 ceph-mon[32572]: pgmap v7085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:03 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12477.030436 secs 2024-04-26T15:16:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:03 smithi110 ceph-mon[28069]: pgmap v7086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:03 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12477.030436 secs 2024-04-26T15:16:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:03 smithi193 ceph-mon[32782]: pgmap v7086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:03 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12477.030436 secs 2024-04-26T15:16:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:03 smithi196 ceph-mon[32572]: pgmap v7086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:05 smithi110 ceph-mon[28069]: pgmap v7087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:05 smithi193 ceph-mon[32782]: pgmap v7087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:05 smithi196 ceph-mon[32572]: pgmap v7087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:07 smithi110 ceph-mon[28069]: pgmap v7088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:07 smithi193 ceph-mon[32782]: pgmap v7088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:07 smithi196 ceph-mon[32572]: pgmap v7088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:08 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12482.030582 secs 2024-04-26T15:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:08 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12482.030582 secs 2024-04-26T15:16:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:08 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12482.030582 secs 2024-04-26T15:16:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:09 smithi193 ceph-mon[32782]: pgmap v7089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:09 smithi196 ceph-mon[32572]: pgmap v7089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:09 smithi110 ceph-mon[28069]: pgmap v7089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:11 smithi193 ceph-mon[32782]: pgmap v7090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:11 smithi196 ceph-mon[32572]: pgmap v7090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:11 smithi110 ceph-mon[28069]: pgmap v7090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:13 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12487.030674 secs 2024-04-26T15:16:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:13 smithi193 ceph-mon[32782]: pgmap v7091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:13 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12487.030674 secs 2024-04-26T15:16:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:13 smithi196 ceph-mon[32572]: pgmap v7091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:13 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12487.030674 secs 2024-04-26T15:16:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:13 smithi110 ceph-mon[28069]: pgmap v7091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:15 smithi193 ceph-mon[32782]: pgmap v7092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:15 smithi196 ceph-mon[32572]: pgmap v7092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:15 smithi110 ceph-mon[28069]: pgmap v7092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:17 smithi193 ceph-mon[32782]: pgmap v7093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:17 smithi196 ceph-mon[32572]: pgmap v7093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:17 smithi110 ceph-mon[28069]: pgmap v7093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:18 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12492.030773 secs 2024-04-26T15:16:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:18 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12492.030773 secs 2024-04-26T15:16:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:18 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12492.030773 secs 2024-04-26T15:16:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:19 smithi193 ceph-mon[32782]: pgmap v7094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:19 smithi196 ceph-mon[32572]: pgmap v7094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:19 smithi110 ceph-mon[28069]: pgmap v7094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:21 smithi193 ceph-mon[32782]: pgmap v7095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:21 smithi196 ceph-mon[32572]: pgmap v7095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:21 smithi110 ceph-mon[28069]: pgmap v7095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:22 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12497.030864 secs 2024-04-26T15:16:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:22 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12497.030864 secs 2024-04-26T15:16:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:22 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12497.030864 secs 2024-04-26T15:16:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:23 smithi193 ceph-mon[32782]: pgmap v7096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:23 smithi196 ceph-mon[32572]: pgmap v7096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:23 smithi110 ceph-mon[28069]: pgmap v7096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:25 smithi193 ceph-mon[32782]: pgmap v7097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:25 smithi196 ceph-mon[32572]: pgmap v7097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:25 smithi110 ceph-mon[28069]: pgmap v7097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:27 smithi193 ceph-mon[32782]: pgmap v7098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:27 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12502.030962 secs 2024-04-26T15:16:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:27 smithi196 ceph-mon[32572]: pgmap v7098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:27 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12502.030962 secs 2024-04-26T15:16:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:27 smithi110 ceph-mon[28069]: pgmap v7098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:27 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12502.030962 secs 2024-04-26T15:16:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:29 smithi193 ceph-mon[32782]: pgmap v7099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:16:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:29 smithi196 ceph-mon[32572]: pgmap v7099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:16:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:29 smithi110 ceph-mon[28069]: pgmap v7099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:16:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:16:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:16:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:16:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:16:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:16:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:16:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:16:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:16:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:16:31.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:31 smithi110 ceph-mon[28069]: pgmap v7100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T15:16:31.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:31 smithi110 ceph-mon[28069]: pgmap v7101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:31 smithi196 ceph-mon[32572]: pgmap v7100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T15:16:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:31 smithi196 ceph-mon[32572]: pgmap v7101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:31 smithi193 ceph-mon[32782]: pgmap v7100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T15:16:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:31 smithi193 ceph-mon[32782]: pgmap v7101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:32 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12507.031101 secs 2024-04-26T15:16:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:32 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12507.031101 secs 2024-04-26T15:16:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:32 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12507.031101 secs 2024-04-26T15:16:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:33 smithi196 ceph-mon[32572]: pgmap v7102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:33 smithi110 ceph-mon[28069]: pgmap v7102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:33 smithi193 ceph-mon[32782]: pgmap v7102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:35.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:35 smithi193 ceph-mon[32782]: pgmap v7103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:35 smithi196 ceph-mon[32572]: pgmap v7103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:35 smithi110 ceph-mon[28069]: pgmap v7103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:37 smithi196 ceph-mon[32572]: pgmap v7104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:37 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12512.031217 secs 2024-04-26T15:16:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:37 smithi110 ceph-mon[28069]: pgmap v7104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:37 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12512.031217 secs 2024-04-26T15:16:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:37 smithi193 ceph-mon[32782]: pgmap v7104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:37 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12512.031217 secs 2024-04-26T15:16:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:39 smithi196 ceph-mon[32572]: pgmap v7105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:39 smithi110 ceph-mon[28069]: pgmap v7105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:39 smithi193 ceph-mon[32782]: pgmap v7105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:16:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:41 smithi196 ceph-mon[32572]: pgmap v7106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:16:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:41 smithi110 ceph-mon[28069]: pgmap v7106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:16:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:41 smithi193 ceph-mon[32782]: pgmap v7106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:16:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:42 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12517.031356 secs 2024-04-26T15:16:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:42 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12517.031356 secs 2024-04-26T15:16:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:42 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12517.031356 secs 2024-04-26T15:16:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:43 smithi196 ceph-mon[32572]: pgmap v7107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:43 smithi110 ceph-mon[28069]: pgmap v7107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:43 smithi193 ceph-mon[32782]: pgmap v7107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:45 smithi196 ceph-mon[32572]: pgmap v7108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:45 smithi110 ceph-mon[28069]: pgmap v7108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:45 smithi193 ceph-mon[32782]: pgmap v7108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:47 smithi196 ceph-mon[32572]: pgmap v7109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:47 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12522.031473 secs 2024-04-26T15:16:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:47 smithi110 ceph-mon[28069]: pgmap v7109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:47 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12522.031473 secs 2024-04-26T15:16:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:47 smithi193 ceph-mon[32782]: pgmap v7109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:47 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12522.031473 secs 2024-04-26T15:16:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:49 smithi196 ceph-mon[32572]: pgmap v7110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:49 smithi110 ceph-mon[28069]: pgmap v7110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:49 smithi193 ceph-mon[32782]: pgmap v7110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:51 smithi196 ceph-mon[32572]: pgmap v7111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:51 smithi110 ceph-mon[28069]: pgmap v7111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:51 smithi193 ceph-mon[32782]: pgmap v7111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:52 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12527.031590 secs 2024-04-26T15:16:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:52 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12527.031590 secs 2024-04-26T15:16:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:52 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12527.031590 secs 2024-04-26T15:16:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:53 smithi196 ceph-mon[32572]: pgmap v7112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:53 smithi110 ceph-mon[28069]: pgmap v7112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:53 smithi193 ceph-mon[32782]: pgmap v7112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:55 smithi196 ceph-mon[32572]: pgmap v7113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:55 smithi110 ceph-mon[28069]: pgmap v7113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:55 smithi193 ceph-mon[32782]: pgmap v7113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:57 smithi196 ceph-mon[32572]: pgmap v7114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:57 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12532.031726 secs 2024-04-26T15:16:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:57 smithi110 ceph-mon[28069]: pgmap v7114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:57 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12532.031726 secs 2024-04-26T15:16:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:57 smithi193 ceph-mon[32782]: pgmap v7114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:16:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:57 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12532.031726 secs 2024-04-26T15:16:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:16:58 smithi196 ceph-mon[32572]: pgmap v7115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:16:58 smithi110 ceph-mon[28069]: pgmap v7115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:16:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:16:58 smithi193 ceph-mon[32782]: pgmap v7115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:00 smithi193 ceph-mon[32782]: pgmap v7116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:00 smithi196 ceph-mon[32572]: pgmap v7116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:00 smithi110 ceph-mon[28069]: pgmap v7116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:02.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:02 smithi193 ceph-mon[32782]: 11 slow requests, 0 included below; oldest blocked for > 12537.031843 secs 2024-04-26T15:17:02.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:02 smithi193 ceph-mon[32782]: pgmap v7117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:02 smithi196 ceph-mon[32572]: 11 slow requests, 0 included below; oldest blocked for > 12537.031843 secs 2024-04-26T15:17:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:02 smithi196 ceph-mon[32572]: pgmap v7117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:02 smithi110 ceph-mon[28069]: 11 slow requests, 0 included below; oldest blocked for > 12537.031843 secs 2024-04-26T15:17:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:02 smithi110 ceph-mon[28069]: pgmap v7117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:04 smithi193 ceph-mon[32782]: pgmap v7118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:04 smithi196 ceph-mon[32572]: pgmap v7118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:04 smithi110 ceph-mon[28069]: pgmap v7118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:06 smithi193 ceph-mon[32782]: pgmap v7119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:06 smithi196 ceph-mon[32572]: pgmap v7119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:06 smithi110 ceph-mon[28069]: pgmap v7119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:07 smithi193 ceph-mon[32782]: 12 slow requests, 1 included below; oldest blocked for > 12542.031981 secs 2024-04-26T15:17:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:07 smithi193 ceph-mon[32782]: slow request 180.076598 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:17:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:07 smithi196 ceph-mon[32572]: 12 slow requests, 1 included below; oldest blocked for > 12542.031981 secs 2024-04-26T15:17:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:07 smithi196 ceph-mon[32572]: slow request 180.076598 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:17:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:07 smithi110 ceph-mon[28069]: 12 slow requests, 1 included below; oldest blocked for > 12542.031981 secs 2024-04-26T15:17:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:07 smithi110 ceph-mon[28069]: slow request 180.076598 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:17:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:08 smithi193 ceph-mon[32782]: pgmap v7120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:08 smithi196 ceph-mon[32572]: pgmap v7120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:08 smithi110 ceph-mon[28069]: pgmap v7120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:09 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:17:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:09 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:17:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:09 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:17:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:09 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:17:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:09 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:17:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:09 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:17:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:10 smithi193 ceph-mon[32782]: pgmap v7121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:10 smithi196 ceph-mon[32572]: pgmap v7121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:10 smithi110 ceph-mon[28069]: pgmap v7121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12547.032062 secs 2024-04-26T15:17:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:12 smithi193 ceph-mon[32782]: pgmap v7122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12547.032062 secs 2024-04-26T15:17:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:12 smithi196 ceph-mon[32572]: pgmap v7122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12547.032062 secs 2024-04-26T15:17:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:12 smithi110 ceph-mon[28069]: pgmap v7122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:14 smithi193 ceph-mon[32782]: pgmap v7123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:14 smithi196 ceph-mon[32572]: pgmap v7123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:14 smithi110 ceph-mon[28069]: pgmap v7123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:16 smithi193 ceph-mon[32782]: pgmap v7124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:16 smithi196 ceph-mon[32572]: pgmap v7124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:16 smithi110 ceph-mon[28069]: pgmap v7124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12552.032134 secs 2024-04-26T15:17:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12552.032134 secs 2024-04-26T15:17:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12552.032134 secs 2024-04-26T15:17:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:18 smithi196 ceph-mon[32572]: pgmap v7125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:18 smithi110 ceph-mon[28069]: pgmap v7125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:18 smithi193 ceph-mon[32782]: pgmap v7125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:20 smithi196 ceph-mon[32572]: pgmap v7126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:20 smithi110 ceph-mon[28069]: pgmap v7126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:20 smithi193 ceph-mon[32782]: pgmap v7126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12557.032254 secs 2024-04-26T15:17:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:22 smithi196 ceph-mon[32572]: pgmap v7127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12557.032254 secs 2024-04-26T15:17:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:22 smithi110 ceph-mon[28069]: pgmap v7127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12557.032254 secs 2024-04-26T15:17:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:22 smithi193 ceph-mon[32782]: pgmap v7127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:24 smithi196 ceph-mon[32572]: pgmap v7128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:24 smithi110 ceph-mon[28069]: pgmap v7128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:24 smithi193 ceph-mon[32782]: pgmap v7128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:26 smithi196 ceph-mon[32572]: pgmap v7129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:26 smithi110 ceph-mon[28069]: pgmap v7129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:26 smithi193 ceph-mon[32782]: pgmap v7129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12562.032366 secs 2024-04-26T15:17:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12562.032366 secs 2024-04-26T15:17:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12562.032366 secs 2024-04-26T15:17:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:28 smithi196 ceph-mon[32572]: pgmap v7130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:28 smithi110 ceph-mon[28069]: pgmap v7130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:28 smithi193 ceph-mon[32782]: pgmap v7130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:30 smithi196 ceph-mon[32572]: pgmap v7131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:17:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:17:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:17:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:30 smithi110 ceph-mon[28069]: pgmap v7131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:17:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:17:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:17:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:30 smithi193 ceph-mon[32782]: pgmap v7131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:17:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:17:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12567.032486 secs 2024-04-26T15:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:32 smithi196 ceph-mon[32572]: pgmap v7132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:32 smithi196 ceph-mon[32572]: pgmap v7133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T15:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:32 smithi196 ceph-mon[32572]: pgmap v7134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T15:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12567.032486 secs 2024-04-26T15:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:32 smithi110 ceph-mon[28069]: pgmap v7132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:17:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:17:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:32 smithi110 ceph-mon[28069]: pgmap v7133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T15:17:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:32 smithi110 ceph-mon[28069]: pgmap v7134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T15:17:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:17:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12567.032486 secs 2024-04-26T15:17:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:32 smithi193 ceph-mon[32782]: pgmap v7132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:17:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:17:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:32 smithi193 ceph-mon[32782]: pgmap v7133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T15:17:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:32 smithi193 ceph-mon[32782]: pgmap v7134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T15:17:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:17:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:35 smithi110 ceph-mon[28069]: pgmap v7135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:35 smithi193 ceph-mon[32782]: pgmap v7135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:35 smithi196 ceph-mon[32572]: pgmap v7135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:37 smithi110 ceph-mon[28069]: pgmap v7136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T15:17:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:37 smithi193 ceph-mon[32782]: pgmap v7136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T15:17:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:37 smithi196 ceph-mon[32572]: pgmap v7136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T15:17:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:38 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12572.032585 secs 2024-04-26T15:17:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:38 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12572.032585 secs 2024-04-26T15:17:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:38 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12572.032585 secs 2024-04-26T15:17:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:39 smithi110 ceph-mon[28069]: pgmap v7137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:39 smithi193 ceph-mon[32782]: pgmap v7137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:39 smithi196 ceph-mon[32572]: pgmap v7137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:41 smithi110 ceph-mon[28069]: pgmap v7138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:41 smithi193 ceph-mon[32782]: pgmap v7138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:41 smithi196 ceph-mon[32572]: pgmap v7138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:43 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12577.032712 secs 2024-04-26T15:17:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:43 smithi110 ceph-mon[28069]: pgmap v7139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:17:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:43 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12577.032712 secs 2024-04-26T15:17:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:43 smithi193 ceph-mon[32782]: pgmap v7139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:17:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:43 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12577.032712 secs 2024-04-26T15:17:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:43 smithi196 ceph-mon[32572]: pgmap v7139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:17:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:45 smithi193 ceph-mon[32782]: pgmap v7140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:45 smithi196 ceph-mon[32572]: pgmap v7140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:45 smithi110 ceph-mon[28069]: pgmap v7140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:47.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:47 smithi196 ceph-mon[32572]: pgmap v7141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:47 smithi193 ceph-mon[32782]: pgmap v7141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:47 smithi110 ceph-mon[28069]: pgmap v7141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:48 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12582.032783 secs 2024-04-26T15:17:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:48 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12582.032783 secs 2024-04-26T15:17:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:48 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12582.032783 secs 2024-04-26T15:17:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:49 smithi193 ceph-mon[32782]: pgmap v7142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:49 smithi196 ceph-mon[32572]: pgmap v7142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:49 smithi110 ceph-mon[28069]: pgmap v7142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:51 smithi193 ceph-mon[32782]: pgmap v7143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:51 smithi196 ceph-mon[32572]: pgmap v7143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:51 smithi110 ceph-mon[28069]: pgmap v7143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:53 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12587.032901 secs 2024-04-26T15:17:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:53 smithi193 ceph-mon[32782]: pgmap v7144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:53 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12587.032901 secs 2024-04-26T15:17:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:53 smithi196 ceph-mon[32572]: pgmap v7144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:53 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12587.032901 secs 2024-04-26T15:17:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:53 smithi110 ceph-mon[28069]: pgmap v7144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:55 smithi193 ceph-mon[32782]: pgmap v7145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:55 smithi196 ceph-mon[32572]: pgmap v7145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:55 smithi110 ceph-mon[28069]: pgmap v7145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:57 smithi193 ceph-mon[32782]: pgmap v7146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:57 smithi196 ceph-mon[32572]: pgmap v7146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:57 smithi110 ceph-mon[28069]: pgmap v7146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:17:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:58 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12592.033027 secs 2024-04-26T15:17:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:58 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12592.033027 secs 2024-04-26T15:17:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:58 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12592.033027 secs 2024-04-26T15:17:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:17:59 smithi193 ceph-mon[32782]: pgmap v7147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:17:59 smithi196 ceph-mon[32572]: pgmap v7147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:17:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:17:59 smithi110 ceph-mon[28069]: pgmap v7147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:01 smithi193 ceph-mon[32782]: pgmap v7148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:01 smithi196 ceph-mon[32572]: pgmap v7148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:01 smithi110 ceph-mon[28069]: pgmap v7148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12597.033174 secs 2024-04-26T15:18:02.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12597.033174 secs 2024-04-26T15:18:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12597.033174 secs 2024-04-26T15:18:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:03 smithi193 ceph-mon[32782]: pgmap v7149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:03 smithi196 ceph-mon[32572]: pgmap v7149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:03 smithi110 ceph-mon[28069]: pgmap v7149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:04 smithi193 ceph-mon[32782]: pgmap v7150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:04 smithi196 ceph-mon[32572]: pgmap v7150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:04 smithi110 ceph-mon[28069]: pgmap v7150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:07 smithi110 ceph-mon[28069]: pgmap v7151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:07 smithi193 ceph-mon[32782]: pgmap v7151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:07 smithi196 ceph-mon[32572]: pgmap v7151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:08 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12602.033297 secs 2024-04-26T15:18:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:08 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12602.033297 secs 2024-04-26T15:18:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:08 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12602.033297 secs 2024-04-26T15:18:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:09 smithi110 ceph-mon[28069]: pgmap v7152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:09.559 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:09 smithi196 ceph-mon[32572]: pgmap v7152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:09.559 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:09 smithi193 ceph-mon[32782]: pgmap v7152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:11 smithi193 ceph-mon[32782]: pgmap v7153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:11 smithi196 ceph-mon[32572]: pgmap v7153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:11 smithi110 ceph-mon[28069]: pgmap v7153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:13 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12607.033440 secs 2024-04-26T15:18:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:13 smithi193 ceph-mon[32782]: pgmap v7154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:13 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12607.033440 secs 2024-04-26T15:18:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:13 smithi196 ceph-mon[32572]: pgmap v7154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:13 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12607.033440 secs 2024-04-26T15:18:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:13 smithi110 ceph-mon[28069]: pgmap v7154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:15 smithi193 ceph-mon[32782]: pgmap v7155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:15 smithi196 ceph-mon[32572]: pgmap v7155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:15 smithi110 ceph-mon[28069]: pgmap v7155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.405+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T15:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.405+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T15:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.405+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614057000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T15:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.405+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614057000 comp rx=0 tx=0).stop 2024-04-26T15:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.405+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T15:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.405+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T15:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.405+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T15:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.405+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T15:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.406+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T15:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.407+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2614004010 tx=0x7f2614037070 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T15:18:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.414+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T15:18:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.414+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T15:18:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.414+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T15:18:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.414+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T15:18:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.415+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T15:18:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.415+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T15:18:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:16.415+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T15:18:17.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:17 smithi196 ceph-mon[32572]: pgmap v7156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:17 smithi193 ceph-mon[32782]: pgmap v7156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:17 smithi110 ceph-mon[28069]: pgmap v7156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:18 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12612.033602 secs 2024-04-26T15:18:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:18.434+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:18:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:18.434+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T15:18:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:18.436+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 100 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:18:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:18:18.436+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 100 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T15:18:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:18 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12612.033602 secs 2024-04-26T15:18:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:18 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12612.033602 secs 2024-04-26T15:18:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:19 smithi193 ceph-mon[32782]: pgmap v7157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:19 smithi196 ceph-mon[32572]: pgmap v7157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:19 smithi110 ceph-mon[28069]: pgmap v7157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:21 smithi193 ceph-mon[32782]: pgmap v7158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:21 smithi196 ceph-mon[32572]: pgmap v7158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:21 smithi110 ceph-mon[28069]: pgmap v7158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:23 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12617.033670 secs 2024-04-26T15:18:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:23 smithi193 ceph-mon[32782]: pgmap v7159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:23 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12617.033670 secs 2024-04-26T15:18:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:23 smithi196 ceph-mon[32572]: pgmap v7159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:23 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12617.033670 secs 2024-04-26T15:18:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:23 smithi110 ceph-mon[28069]: pgmap v7159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:25 smithi193 ceph-mon[32782]: pgmap v7160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:25 smithi196 ceph-mon[32572]: pgmap v7160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:25 smithi110 ceph-mon[28069]: pgmap v7160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:27 smithi193 ceph-mon[32782]: pgmap v7161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12622.033795 secs 2024-04-26T15:18:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:27 smithi196 ceph-mon[32572]: pgmap v7161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12622.033795 secs 2024-04-26T15:18:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:27 smithi110 ceph-mon[28069]: pgmap v7161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12622.033795 secs 2024-04-26T15:18:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:29 smithi193 ceph-mon[32782]: pgmap v7162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:29 smithi196 ceph-mon[32572]: pgmap v7162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:29 smithi110 ceph-mon[28069]: pgmap v7162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:31 smithi193 ceph-mon[32782]: pgmap v7163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:31 smithi196 ceph-mon[32572]: pgmap v7163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:31 smithi110 ceph-mon[28069]: pgmap v7163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12627.033918 secs 2024-04-26T15:18:32.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12627.033918 secs 2024-04-26T15:18:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12627.033918 secs 2024-04-26T15:18:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:33 smithi193 ceph-mon[32782]: pgmap v7164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:18:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:33 smithi196 ceph-mon[32572]: pgmap v7164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:18:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:33 smithi110 ceph-mon[28069]: pgmap v7164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:18:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:18:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:18:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:18:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:18:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:18:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:18:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:18:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:35 smithi196 ceph-mon[32572]: pgmap v7165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:18:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:35 smithi196 ceph-mon[32572]: pgmap v7166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:35 smithi110 ceph-mon[28069]: pgmap v7165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:18:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:35 smithi110 ceph-mon[28069]: pgmap v7166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:35 smithi193 ceph-mon[32782]: pgmap v7165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:18:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:35 smithi193 ceph-mon[32782]: pgmap v7166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:37.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:37 smithi193 ceph-mon[32782]: pgmap v7167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:37.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12632.034042 secs 2024-04-26T15:18:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:37 smithi196 ceph-mon[32572]: pgmap v7167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12632.034042 secs 2024-04-26T15:18:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:37 smithi110 ceph-mon[28069]: pgmap v7167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12632.034042 secs 2024-04-26T15:18:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:39 smithi196 ceph-mon[32572]: pgmap v7168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:39 smithi110 ceph-mon[28069]: pgmap v7168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:39 smithi193 ceph-mon[32782]: pgmap v7168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:41 smithi196 ceph-mon[32572]: pgmap v7169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:41 smithi110 ceph-mon[28069]: pgmap v7169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:41 smithi193 ceph-mon[32782]: pgmap v7169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12637.034182 secs 2024-04-26T15:18:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12637.034182 secs 2024-04-26T15:18:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12637.034182 secs 2024-04-26T15:18:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:43 smithi196 ceph-mon[32572]: pgmap v7170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:43 smithi110 ceph-mon[28069]: pgmap v7170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:43 smithi193 ceph-mon[32782]: pgmap v7170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:18:45.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:45 smithi196 ceph-mon[32572]: pgmap v7171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:18:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:45 smithi110 ceph-mon[28069]: pgmap v7171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:18:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:45 smithi193 ceph-mon[32782]: pgmap v7171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:18:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:47 smithi196 ceph-mon[32572]: pgmap v7172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12642.034303 secs 2024-04-26T15:18:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:47 smithi110 ceph-mon[28069]: pgmap v7172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12642.034303 secs 2024-04-26T15:18:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:47 smithi193 ceph-mon[32782]: pgmap v7172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12642.034303 secs 2024-04-26T15:18:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:49 smithi196 ceph-mon[32572]: pgmap v7173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:49 smithi110 ceph-mon[28069]: pgmap v7173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:49 smithi193 ceph-mon[32782]: pgmap v7173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:51 smithi196 ceph-mon[32572]: pgmap v7174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:51 smithi110 ceph-mon[28069]: pgmap v7174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:51 smithi193 ceph-mon[32782]: pgmap v7174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12647.034410 secs 2024-04-26T15:18:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12647.034410 secs 2024-04-26T15:18:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12647.034410 secs 2024-04-26T15:18:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:53 smithi196 ceph-mon[32572]: pgmap v7175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:53 smithi110 ceph-mon[28069]: pgmap v7175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:53 smithi193 ceph-mon[32782]: pgmap v7175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:55 smithi196 ceph-mon[32572]: pgmap v7176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:55 smithi110 ceph-mon[28069]: pgmap v7176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:55 smithi193 ceph-mon[32782]: pgmap v7176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:57 smithi196 ceph-mon[32572]: pgmap v7177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12652.034551 secs 2024-04-26T15:18:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:57 smithi110 ceph-mon[28069]: pgmap v7177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12652.034551 secs 2024-04-26T15:18:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:57 smithi193 ceph-mon[32782]: pgmap v7177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:18:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12652.034551 secs 2024-04-26T15:18:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:18:59 smithi196 ceph-mon[32572]: pgmap v7178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:18:59 smithi110 ceph-mon[28069]: pgmap v7178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:18:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:18:59 smithi193 ceph-mon[32782]: pgmap v7178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:01 smithi196 ceph-mon[32572]: pgmap v7179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:01 smithi110 ceph-mon[28069]: pgmap v7179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:01 smithi193 ceph-mon[32782]: pgmap v7179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12657.034686 secs 2024-04-26T15:19:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12657.034686 secs 2024-04-26T15:19:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12657.034686 secs 2024-04-26T15:19:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:03 smithi196 ceph-mon[32572]: pgmap v7180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:03 smithi110 ceph-mon[28069]: pgmap v7180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:03 smithi193 ceph-mon[32782]: pgmap v7180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:05 smithi196 ceph-mon[32572]: pgmap v7181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:05 smithi110 ceph-mon[28069]: pgmap v7181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:05 smithi193 ceph-mon[32782]: pgmap v7181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:06.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:19:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:19:06.339+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:19:06.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:19:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:19:06.339+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:19:06.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:19:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:19:06.339+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:19:06.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:19:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:19:06.339+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:19:06.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:19:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:19:06.339+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:19:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:07 smithi196 ceph-mon[32572]: pgmap v7182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:19:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:07 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12662.034769 secs 2024-04-26T15:19:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:07 smithi110 ceph-mon[28069]: pgmap v7182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:19:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:07 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12662.034769 secs 2024-04-26T15:19:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:07 smithi193 ceph-mon[32782]: pgmap v7182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:19:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:07 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12662.034769 secs 2024-04-26T15:19:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:09 smithi196 ceph-mon[32572]: pgmap v7183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:09 smithi110 ceph-mon[28069]: pgmap v7183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:09 smithi193 ceph-mon[32782]: pgmap v7183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:11 smithi196 ceph-mon[32572]: pgmap v7184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:19:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:11 smithi110 ceph-mon[28069]: pgmap v7184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:19:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:11 smithi193 ceph-mon[32782]: pgmap v7184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:19:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12667.034854 secs 2024-04-26T15:19:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12667.034854 secs 2024-04-26T15:19:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12667.034854 secs 2024-04-26T15:19:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:13 smithi196 ceph-mon[32572]: pgmap v7185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:19:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:13 smithi110 ceph-mon[28069]: pgmap v7185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:19:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:13 smithi193 ceph-mon[32782]: pgmap v7185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:19:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:14 smithi110 ceph-mon[28069]: pgmap v7186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:14 smithi193 ceph-mon[32782]: pgmap v7186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:14 smithi196 ceph-mon[32572]: pgmap v7186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:16 smithi196 ceph-mon[32572]: pgmap v7187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:16 smithi110 ceph-mon[28069]: pgmap v7187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:16 smithi193 ceph-mon[32782]: pgmap v7187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12672.034934 secs 2024-04-26T15:19:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12672.034934 secs 2024-04-26T15:19:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12672.034934 secs 2024-04-26T15:19:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:18 smithi196 ceph-mon[32572]: pgmap v7188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:18 smithi110 ceph-mon[28069]: pgmap v7188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:18 smithi193 ceph-mon[32782]: pgmap v7188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:19:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:20 smithi196 ceph-mon[32572]: pgmap v7189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:20 smithi110 ceph-mon[28069]: pgmap v7189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:20 smithi193 ceph-mon[32782]: pgmap v7189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12677.035016 secs 2024-04-26T15:19:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:22 smithi196 ceph-mon[32572]: pgmap v7190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12677.035016 secs 2024-04-26T15:19:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:22 smithi110 ceph-mon[28069]: pgmap v7190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12677.035016 secs 2024-04-26T15:19:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:22 smithi193 ceph-mon[32782]: pgmap v7190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:24 smithi196 ceph-mon[32572]: pgmap v7191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:24 smithi110 ceph-mon[28069]: pgmap v7191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:24 smithi193 ceph-mon[32782]: pgmap v7191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:26 smithi196 ceph-mon[32572]: pgmap v7192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:26 smithi110 ceph-mon[28069]: pgmap v7192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:26 smithi193 ceph-mon[32782]: pgmap v7192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12682.035140 secs 2024-04-26T15:19:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12682.035140 secs 2024-04-26T15:19:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12682.035140 secs 2024-04-26T15:19:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:28 smithi196 ceph-mon[32572]: pgmap v7193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:28 smithi110 ceph-mon[28069]: pgmap v7193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:28 smithi193 ceph-mon[32782]: pgmap v7193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:30 smithi196 ceph-mon[32572]: pgmap v7194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:30 smithi110 ceph-mon[28069]: pgmap v7194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:30 smithi193 ceph-mon[32782]: pgmap v7194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12687.035264 secs 2024-04-26T15:19:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:32 smithi196 ceph-mon[32572]: pgmap v7195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12687.035264 secs 2024-04-26T15:19:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:32 smithi110 ceph-mon[28069]: pgmap v7195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12687.035264 secs 2024-04-26T15:19:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:32 smithi193 ceph-mon[32782]: pgmap v7195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:34 smithi196 ceph-mon[32572]: pgmap v7196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:19:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:34 smithi110 ceph-mon[28069]: pgmap v7196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:19:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:34 smithi193 ceph-mon[32782]: pgmap v7196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:19:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: pgmap v7197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: pgmap v7197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: pgmap v7197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:38 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12692.035353 secs 2024-04-26T15:19:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:38 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:19:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:38 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:19:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:38 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:19:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:38 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:19:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:38 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12692.035353 secs 2024-04-26T15:19:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:38 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:19:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:38 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:19:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:38 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:19:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:38 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:19:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:38 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12692.035353 secs 2024-04-26T15:19:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:38 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:19:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:38 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:19:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:38 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:19:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:38 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:19:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:39 smithi110 ceph-mon[28069]: pgmap v7198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:39 smithi193 ceph-mon[32782]: pgmap v7198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:39 smithi196 ceph-mon[32572]: pgmap v7198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:19:40.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: pgmap v7199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T15:19:40.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: pgmap v7200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:40.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: pgmap v7199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T15:19:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: pgmap v7200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:40.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:19:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:19:40.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:19:40.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: pgmap v7199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T15:19:40.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: pgmap v7200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:40.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:19:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:42 smithi196 ceph-mon[32572]: pgmap v7201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12697.035482 secs 2024-04-26T15:19:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:42 smithi110 ceph-mon[28069]: pgmap v7201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12697.035482 secs 2024-04-26T15:19:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:42 smithi193 ceph-mon[32782]: pgmap v7201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12697.035482 secs 2024-04-26T15:19:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:44 smithi196 ceph-mon[32572]: pgmap v7202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:44 smithi110 ceph-mon[28069]: pgmap v7202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:44 smithi193 ceph-mon[32782]: pgmap v7202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:46 smithi196 ceph-mon[32572]: pgmap v7203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:46 smithi110 ceph-mon[28069]: pgmap v7203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:46 smithi193 ceph-mon[32782]: pgmap v7203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:19:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12702.035611 secs 2024-04-26T15:19:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12702.035611 secs 2024-04-26T15:19:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12702.035611 secs 2024-04-26T15:19:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:48 smithi193 ceph-mon[32782]: pgmap v7204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T15:19:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:48 smithi196 ceph-mon[32572]: pgmap v7204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T15:19:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:48 smithi110 ceph-mon[28069]: pgmap v7204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T15:19:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:50 smithi196 ceph-mon[32572]: pgmap v7205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:19:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:50 smithi110 ceph-mon[28069]: pgmap v7205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:19:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:50 smithi193 ceph-mon[32782]: pgmap v7205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:19:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:52 smithi110 ceph-mon[28069]: pgmap v7206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12707.035662 secs 2024-04-26T15:19:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:52 smithi193 ceph-mon[32782]: pgmap v7206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12707.035662 secs 2024-04-26T15:19:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:52 smithi196 ceph-mon[32572]: pgmap v7206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12707.035662 secs 2024-04-26T15:19:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:53 smithi110 ceph-mon[28069]: pgmap v7207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:53 smithi193 ceph-mon[32782]: pgmap v7207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:53 smithi196 ceph-mon[32572]: pgmap v7207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:19:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:56 smithi196 ceph-mon[32572]: pgmap v7208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:56 smithi110 ceph-mon[28069]: pgmap v7208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:56 smithi193 ceph-mon[32782]: pgmap v7208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12712.035775 secs 2024-04-26T15:19:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12712.035775 secs 2024-04-26T15:19:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12712.035775 secs 2024-04-26T15:19:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:19:58 smithi196 ceph-mon[32572]: pgmap v7209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:19:58 smithi110 ceph-mon[28069]: pgmap v7209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:19:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:19:58 smithi193 ceph-mon[32782]: pgmap v7209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:00 smithi196 ceph-mon[32572]: pgmap v7210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:20:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:00 smithi110 ceph-mon[28069]: pgmap v7210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:20:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:00 smithi193 ceph-mon[32782]: pgmap v7210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:20:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:02 smithi196 ceph-mon[32572]: pgmap v7211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12717.035841 secs 2024-04-26T15:20:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:02 smithi110 ceph-mon[28069]: pgmap v7211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12717.035841 secs 2024-04-26T15:20:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:02 smithi193 ceph-mon[32782]: pgmap v7211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12717.035841 secs 2024-04-26T15:20:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:04 smithi110 ceph-mon[28069]: pgmap v7212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:04 smithi193 ceph-mon[32782]: pgmap v7212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:04 smithi196 ceph-mon[32572]: pgmap v7212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:05 smithi110 ceph-mon[28069]: pgmap v7213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:05 smithi193 ceph-mon[32782]: pgmap v7213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:05 smithi196 ceph-mon[32572]: pgmap v7213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:07.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:07 smithi193 ceph-mon[32782]: 12 slow requests, 1 included below; oldest blocked for > 12722.035963 secs 2024-04-26T15:20:07.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:07 smithi193 ceph-mon[32782]: slow request 360.080581 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:20:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:07 smithi196 ceph-mon[32572]: 12 slow requests, 1 included below; oldest blocked for > 12722.035963 secs 2024-04-26T15:20:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:07 smithi196 ceph-mon[32572]: slow request 360.080581 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:20:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:07 smithi110 ceph-mon[28069]: 12 slow requests, 1 included below; oldest blocked for > 12722.035963 secs 2024-04-26T15:20:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:07 smithi110 ceph-mon[28069]: slow request 360.080581 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:20:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:08 smithi196 ceph-mon[32572]: pgmap v7214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:08 smithi110 ceph-mon[28069]: pgmap v7214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:08 smithi193 ceph-mon[32782]: pgmap v7214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:10 smithi196 ceph-mon[32572]: pgmap v7215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:10 smithi110 ceph-mon[28069]: pgmap v7215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:10 smithi193 ceph-mon[32782]: pgmap v7215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:12 smithi196 ceph-mon[32572]: pgmap v7216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12727.036090 secs 2024-04-26T15:20:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:12 smithi110 ceph-mon[28069]: pgmap v7216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12727.036090 secs 2024-04-26T15:20:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:12 smithi193 ceph-mon[32782]: pgmap v7216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12727.036090 secs 2024-04-26T15:20:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:14 smithi196 ceph-mon[32572]: pgmap v7217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:14 smithi110 ceph-mon[28069]: pgmap v7217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:14 smithi193 ceph-mon[32782]: pgmap v7217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:16 smithi196 ceph-mon[32572]: pgmap v7218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:16 smithi110 ceph-mon[28069]: pgmap v7218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:16 smithi193 ceph-mon[32782]: pgmap v7218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12732.036216 secs 2024-04-26T15:20:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12732.036216 secs 2024-04-26T15:20:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12732.036216 secs 2024-04-26T15:20:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:18 smithi110 ceph-mon[28069]: pgmap v7219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:18 smithi193 ceph-mon[32782]: pgmap v7219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:18 smithi196 ceph-mon[32572]: pgmap v7219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:19 smithi110 ceph-mon[28069]: pgmap v7220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:19 smithi193 ceph-mon[32782]: pgmap v7220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:19 smithi196 ceph-mon[32572]: pgmap v7220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:22 smithi196 ceph-mon[32572]: pgmap v7221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12737.036343 secs 2024-04-26T15:20:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:22 smithi110 ceph-mon[28069]: pgmap v7221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12737.036343 secs 2024-04-26T15:20:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:22 smithi193 ceph-mon[32782]: pgmap v7221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12737.036343 secs 2024-04-26T15:20:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:24 smithi196 ceph-mon[32572]: pgmap v7222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:24 smithi110 ceph-mon[28069]: pgmap v7222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:24 smithi193 ceph-mon[32782]: pgmap v7222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:26 smithi196 ceph-mon[32572]: pgmap v7223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:26 smithi110 ceph-mon[28069]: pgmap v7223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:26 smithi193 ceph-mon[32782]: pgmap v7223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12742.036463 secs 2024-04-26T15:20:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12742.036463 secs 2024-04-26T15:20:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12742.036463 secs 2024-04-26T15:20:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:28 smithi110 ceph-mon[28069]: pgmap v7224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:28 smithi193 ceph-mon[32782]: pgmap v7224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:28 smithi196 ceph-mon[32572]: pgmap v7224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:29 smithi110 ceph-mon[28069]: pgmap v7225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:29 smithi193 ceph-mon[32782]: pgmap v7225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:29 smithi196 ceph-mon[32572]: pgmap v7225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:32 smithi196 ceph-mon[32572]: pgmap v7226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12747.036623 secs 2024-04-26T15:20:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:32 smithi110 ceph-mon[28069]: pgmap v7226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12747.036623 secs 2024-04-26T15:20:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:32 smithi193 ceph-mon[32782]: pgmap v7226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12747.036623 secs 2024-04-26T15:20:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:34 smithi196 ceph-mon[32572]: pgmap v7227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:34 smithi110 ceph-mon[28069]: pgmap v7227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:34 smithi193 ceph-mon[32782]: pgmap v7227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:36 smithi110 ceph-mon[28069]: pgmap v7228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:36 smithi193 ceph-mon[32782]: pgmap v7228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:36 smithi196 ceph-mon[32572]: pgmap v7228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:37.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12752.036772 secs 2024-04-26T15:20:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12752.036772 secs 2024-04-26T15:20:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12752.036772 secs 2024-04-26T15:20:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:38 smithi110 ceph-mon[28069]: pgmap v7229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:38 smithi193 ceph-mon[32782]: pgmap v7229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:38 smithi196 ceph-mon[32572]: pgmap v7229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:39 smithi110 ceph-mon[28069]: pgmap v7230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:39 smithi193 ceph-mon[32782]: pgmap v7230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:39 smithi196 ceph-mon[32572]: pgmap v7230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:20:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:20:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:20:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:20:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:20:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:41 smithi193 ceph-mon[32782]: pgmap v7231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T15:20:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:41 smithi193 ceph-mon[32782]: pgmap v7232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:20:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:20:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:20:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:41 smithi196 ceph-mon[32572]: pgmap v7231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T15:20:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:41 smithi196 ceph-mon[32572]: pgmap v7232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:20:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:20:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:20:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:41 smithi110 ceph-mon[28069]: pgmap v7231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T15:20:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:41 smithi110 ceph-mon[28069]: pgmap v7232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:20:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12757.036872 secs 2024-04-26T15:20:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12757.036872 secs 2024-04-26T15:20:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12757.036872 secs 2024-04-26T15:20:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:43 smithi193 ceph-mon[32782]: pgmap v7233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:43 smithi196 ceph-mon[32572]: pgmap v7233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:43 smithi110 ceph-mon[28069]: pgmap v7233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:45 smithi193 ceph-mon[32782]: pgmap v7234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:45 smithi196 ceph-mon[32572]: pgmap v7234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:45 smithi110 ceph-mon[28069]: pgmap v7234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12762.036983 secs 2024-04-26T15:20:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:47 smithi193 ceph-mon[32782]: pgmap v7235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12762.036983 secs 2024-04-26T15:20:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:47 smithi196 ceph-mon[32572]: pgmap v7235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12762.036983 secs 2024-04-26T15:20:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:47 smithi110 ceph-mon[28069]: pgmap v7235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:49 smithi193 ceph-mon[32782]: pgmap v7236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:49 smithi196 ceph-mon[32572]: pgmap v7236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:49 smithi110 ceph-mon[28069]: pgmap v7236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:20:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:51 smithi193 ceph-mon[32782]: pgmap v7237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:20:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:51 smithi196 ceph-mon[32572]: pgmap v7237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:20:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:51 smithi110 ceph-mon[28069]: pgmap v7237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:20:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12767.037100 secs 2024-04-26T15:20:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12767.037100 secs 2024-04-26T15:20:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12767.037100 secs 2024-04-26T15:20:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:53 smithi193 ceph-mon[32782]: pgmap v7238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:53 smithi196 ceph-mon[32572]: pgmap v7238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:53 smithi110 ceph-mon[28069]: pgmap v7238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:20:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:55 smithi196 ceph-mon[32572]: pgmap v7239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:55 smithi110 ceph-mon[28069]: pgmap v7239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:55 smithi193 ceph-mon[32782]: pgmap v7239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12772.037216 secs 2024-04-26T15:20:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:57 smithi196 ceph-mon[32572]: pgmap v7240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12772.037216 secs 2024-04-26T15:20:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:57 smithi110 ceph-mon[28069]: pgmap v7240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:20:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12772.037216 secs 2024-04-26T15:20:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:57 smithi193 ceph-mon[32782]: pgmap v7240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:20:59 smithi196 ceph-mon[32572]: pgmap v7241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:20:59 smithi110 ceph-mon[28069]: pgmap v7241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:20:59 smithi193 ceph-mon[32782]: pgmap v7241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:01 smithi196 ceph-mon[32572]: pgmap v7242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:01 smithi110 ceph-mon[28069]: pgmap v7242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:01 smithi193 ceph-mon[32782]: pgmap v7242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12777.037345 secs 2024-04-26T15:21:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12777.037345 secs 2024-04-26T15:21:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12777.037345 secs 2024-04-26T15:21:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:03 smithi196 ceph-mon[32572]: pgmap v7243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:03 smithi110 ceph-mon[28069]: pgmap v7243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:03 smithi193 ceph-mon[32782]: pgmap v7243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:05 smithi196 ceph-mon[32572]: pgmap v7244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:05 smithi110 ceph-mon[28069]: pgmap v7244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:05 smithi193 ceph-mon[32782]: pgmap v7244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:08.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:07 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12782.037465 secs 2024-04-26T15:21:08.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:07 smithi193 ceph-mon[32782]: pgmap v7245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:07 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12782.037465 secs 2024-04-26T15:21:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:07 smithi196 ceph-mon[32572]: pgmap v7245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:07 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12782.037465 secs 2024-04-26T15:21:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:07 smithi110 ceph-mon[28069]: pgmap v7245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:09 smithi196 ceph-mon[32572]: pgmap v7246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:09 smithi110 ceph-mon[28069]: pgmap v7246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:09 smithi193 ceph-mon[32782]: pgmap v7246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:11 smithi196 ceph-mon[32572]: pgmap v7247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:11 smithi110 ceph-mon[28069]: pgmap v7247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:11 smithi193 ceph-mon[32782]: pgmap v7247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12787.037585 secs 2024-04-26T15:21:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12787.037585 secs 2024-04-26T15:21:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12787.037585 secs 2024-04-26T15:21:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:13 smithi196 ceph-mon[32572]: pgmap v7248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:13 smithi110 ceph-mon[28069]: pgmap v7248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:13 smithi193 ceph-mon[32782]: pgmap v7248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:15 smithi196 ceph-mon[32572]: pgmap v7249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:15 smithi110 ceph-mon[28069]: pgmap v7249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:15 smithi193 ceph-mon[32782]: pgmap v7249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12792.037748 secs 2024-04-26T15:21:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:17 smithi196 ceph-mon[32572]: pgmap v7250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12792.037748 secs 2024-04-26T15:21:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:17 smithi110 ceph-mon[28069]: pgmap v7250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12792.037748 secs 2024-04-26T15:21:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:17 smithi193 ceph-mon[32782]: pgmap v7250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:21:18.464+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:21:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:21:18.464+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T15:21:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:21:18.465+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 101 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T15:21:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:21:18.465+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 101 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:21:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:19 smithi196 ceph-mon[32572]: pgmap v7251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:19 smithi110 ceph-mon[28069]: pgmap v7251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:19 smithi193 ceph-mon[32782]: pgmap v7251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:21 smithi196 ceph-mon[32572]: pgmap v7252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:21 smithi110 ceph-mon[28069]: pgmap v7252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:21 smithi193 ceph-mon[32782]: pgmap v7252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12797.037865 secs 2024-04-26T15:21:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12797.037865 secs 2024-04-26T15:21:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12797.037865 secs 2024-04-26T15:21:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:23 smithi196 ceph-mon[32572]: pgmap v7253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:23 smithi110 ceph-mon[28069]: pgmap v7253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:23 smithi193 ceph-mon[32782]: pgmap v7253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:25 smithi196 ceph-mon[32572]: pgmap v7254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:25 smithi110 ceph-mon[28069]: pgmap v7254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:25 smithi193 ceph-mon[32782]: pgmap v7254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12802.037947 secs 2024-04-26T15:21:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:27 smithi196 ceph-mon[32572]: pgmap v7255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12802.037947 secs 2024-04-26T15:21:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:27 smithi110 ceph-mon[28069]: pgmap v7255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12802.037947 secs 2024-04-26T15:21:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:27 smithi193 ceph-mon[32782]: pgmap v7255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:29 smithi196 ceph-mon[32572]: pgmap v7256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:29 smithi110 ceph-mon[28069]: pgmap v7256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:29 smithi193 ceph-mon[32782]: pgmap v7256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:31 smithi196 ceph-mon[32572]: pgmap v7257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:31 smithi110 ceph-mon[28069]: pgmap v7257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:31 smithi193 ceph-mon[32782]: pgmap v7257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:33 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12807.038068 secs 2024-04-26T15:21:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:33 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12807.038068 secs 2024-04-26T15:21:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:33 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12807.038068 secs 2024-04-26T15:21:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:34 smithi110 ceph-mon[28069]: pgmap v7258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:34 smithi193 ceph-mon[32782]: pgmap v7258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:34 smithi196 ceph-mon[32572]: pgmap v7258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:36 smithi110 ceph-mon[28069]: pgmap v7259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:36 smithi193 ceph-mon[32782]: pgmap v7259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:36 smithi196 ceph-mon[32572]: pgmap v7259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:38 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12812.038187 secs 2024-04-26T15:21:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:38 smithi110 ceph-mon[28069]: pgmap v7260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:38 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12812.038187 secs 2024-04-26T15:21:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:38 smithi193 ceph-mon[32782]: pgmap v7260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:38 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12812.038187 secs 2024-04-26T15:21:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:38 smithi196 ceph-mon[32572]: pgmap v7260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:40 smithi110 ceph-mon[28069]: pgmap v7261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:40 smithi193 ceph-mon[32782]: pgmap v7261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:40 smithi196 ceph-mon[32572]: pgmap v7261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:42 smithi110 ceph-mon[28069]: pgmap v7262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:21:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:42 smithi193 ceph-mon[32782]: pgmap v7262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:21:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:42 smithi196 ceph-mon[32572]: pgmap v7262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:21:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:43 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12817.038275 secs 2024-04-26T15:21:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:21:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:21:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:21:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:43 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12817.038275 secs 2024-04-26T15:21:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:21:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:21:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:21:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:43 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12817.038275 secs 2024-04-26T15:21:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:21:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:21:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:21:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:44 smithi110 ceph-mon[28069]: pgmap v7263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:21:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:44 smithi110 ceph-mon[28069]: pgmap v7264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:21:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:44 smithi193 ceph-mon[32782]: pgmap v7263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:21:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:44 smithi193 ceph-mon[32782]: pgmap v7264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:21:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:44 smithi196 ceph-mon[32572]: pgmap v7263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:21:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:44 smithi196 ceph-mon[32572]: pgmap v7264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:21:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:46 smithi193 ceph-mon[32782]: pgmap v7265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:46 smithi196 ceph-mon[32572]: pgmap v7265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:46 smithi110 ceph-mon[28069]: pgmap v7265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:48.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:48 smithi196 ceph-mon[32572]: pgmap v7266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:48.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:48 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12822.038395 secs 2024-04-26T15:21:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:48 smithi193 ceph-mon[32782]: pgmap v7266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:48 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12822.038395 secs 2024-04-26T15:21:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:48 smithi110 ceph-mon[28069]: pgmap v7266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:48 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12822.038395 secs 2024-04-26T15:21:50.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:50 smithi193 ceph-mon[32782]: pgmap v7267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:50 smithi196 ceph-mon[32572]: pgmap v7267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:50 smithi110 ceph-mon[28069]: pgmap v7267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:52 smithi193 ceph-mon[32782]: pgmap v7268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:52 smithi196 ceph-mon[32572]: pgmap v7268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:52 smithi110 ceph-mon[28069]: pgmap v7268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:21:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:53 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12827.038525 secs 2024-04-26T15:21:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:53 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12827.038525 secs 2024-04-26T15:21:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:53 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12827.038525 secs 2024-04-26T15:21:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:54 smithi193 ceph-mon[32782]: pgmap v7269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:21:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:54 smithi196 ceph-mon[32572]: pgmap v7269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:21:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:54 smithi110 ceph-mon[28069]: pgmap v7269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:21:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:56 smithi193 ceph-mon[32782]: pgmap v7270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:56 smithi196 ceph-mon[32572]: pgmap v7270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:56 smithi110 ceph-mon[28069]: pgmap v7270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:21:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:58 smithi193 ceph-mon[32782]: pgmap v7271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:21:58 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12832.038670 secs 2024-04-26T15:21:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:58 smithi196 ceph-mon[32572]: pgmap v7271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:21:58 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12832.038670 secs 2024-04-26T15:21:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:58 smithi110 ceph-mon[28069]: pgmap v7271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:21:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:21:58 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12832.038670 secs 2024-04-26T15:22:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:00 smithi193 ceph-mon[32782]: pgmap v7272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:00 smithi196 ceph-mon[32572]: pgmap v7272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:00 smithi110 ceph-mon[28069]: pgmap v7272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:02.345 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:02 smithi110 ceph-mon[28069]: pgmap v7273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:02 smithi193 ceph-mon[32782]: pgmap v7273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:02 smithi196 ceph-mon[32572]: pgmap v7273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:03 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12837.038781 secs 2024-04-26T15:22:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:03 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12837.038781 secs 2024-04-26T15:22:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:03 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12837.038781 secs 2024-04-26T15:22:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:04 smithi193 ceph-mon[32782]: pgmap v7274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:04 smithi196 ceph-mon[32572]: pgmap v7274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:04 smithi110 ceph-mon[28069]: pgmap v7274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:06 smithi193 ceph-mon[32782]: pgmap v7275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:06 smithi196 ceph-mon[32572]: pgmap v7275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:06 smithi110 ceph-mon[28069]: pgmap v7275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:08 smithi193 ceph-mon[32782]: pgmap v7276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:08 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12842.038911 secs 2024-04-26T15:22:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:08 smithi196 ceph-mon[32572]: pgmap v7276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:08 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12842.038911 secs 2024-04-26T15:22:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:08 smithi110 ceph-mon[28069]: pgmap v7276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:08 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12842.038911 secs 2024-04-26T15:22:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:10 smithi196 ceph-mon[32572]: pgmap v7277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:10 smithi110 ceph-mon[28069]: pgmap v7277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:10 smithi193 ceph-mon[32782]: pgmap v7277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:12 smithi196 ceph-mon[32572]: pgmap v7278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12847.039034 secs 2024-04-26T15:22:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:12 smithi110 ceph-mon[28069]: pgmap v7278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12847.039034 secs 2024-04-26T15:22:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:12 smithi193 ceph-mon[32782]: pgmap v7278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12847.039034 secs 2024-04-26T15:22:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:14 smithi196 ceph-mon[32572]: pgmap v7279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:14 smithi110 ceph-mon[28069]: pgmap v7279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:14 smithi193 ceph-mon[32782]: pgmap v7279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:16 smithi196 ceph-mon[32572]: pgmap v7280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:16 smithi110 ceph-mon[28069]: pgmap v7280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:16 smithi193 ceph-mon[32782]: pgmap v7280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12852.039186 secs 2024-04-26T15:22:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12852.039186 secs 2024-04-26T15:22:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12852.039186 secs 2024-04-26T15:22:18.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:18 smithi196 ceph-mon[32572]: pgmap v7281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:18 smithi110 ceph-mon[28069]: pgmap v7281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:18 smithi193 ceph-mon[32782]: pgmap v7281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:20 smithi196 ceph-mon[32572]: pgmap v7282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:20 smithi110 ceph-mon[28069]: pgmap v7282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:20 smithi193 ceph-mon[32782]: pgmap v7282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:22 smithi196 ceph-mon[32572]: pgmap v7283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12857.039311 secs 2024-04-26T15:22:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:22 smithi110 ceph-mon[28069]: pgmap v7283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12857.039311 secs 2024-04-26T15:22:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:22 smithi193 ceph-mon[32782]: pgmap v7283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12857.039311 secs 2024-04-26T15:22:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:24 smithi196 ceph-mon[32572]: pgmap v7284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:24 smithi110 ceph-mon[28069]: pgmap v7284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:24 smithi193 ceph-mon[32782]: pgmap v7284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:26 smithi196 ceph-mon[32572]: pgmap v7285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:26 smithi110 ceph-mon[28069]: pgmap v7285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:26 smithi193 ceph-mon[32782]: pgmap v7285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12862.039447 secs 2024-04-26T15:22:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12862.039447 secs 2024-04-26T15:22:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12862.039447 secs 2024-04-26T15:22:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:28 smithi196 ceph-mon[32572]: pgmap v7286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:28 smithi110 ceph-mon[28069]: pgmap v7286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:28 smithi193 ceph-mon[32782]: pgmap v7286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:30 smithi196 ceph-mon[32572]: pgmap v7287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:30 smithi110 ceph-mon[28069]: pgmap v7287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:30 smithi193 ceph-mon[32782]: pgmap v7287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:32 smithi196 ceph-mon[32572]: pgmap v7288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12867.039601 secs 2024-04-26T15:22:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:32 smithi110 ceph-mon[28069]: pgmap v7288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12867.039601 secs 2024-04-26T15:22:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:32 smithi193 ceph-mon[32782]: pgmap v7288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12867.039601 secs 2024-04-26T15:22:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:34 smithi196 ceph-mon[32572]: pgmap v7289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:34 smithi110 ceph-mon[28069]: pgmap v7289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:34 smithi193 ceph-mon[32782]: pgmap v7289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:36 smithi196 ceph-mon[32572]: pgmap v7290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:36 smithi110 ceph-mon[28069]: pgmap v7290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:36 smithi193 ceph-mon[32782]: pgmap v7290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12872.039732 secs 2024-04-26T15:22:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12872.039732 secs 2024-04-26T15:22:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12872.039732 secs 2024-04-26T15:22:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:38 smithi196 ceph-mon[32572]: pgmap v7291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:38.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:38 smithi193 ceph-mon[32782]: pgmap v7291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:38 smithi110 ceph-mon[28069]: pgmap v7291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:40 smithi196 ceph-mon[32572]: pgmap v7292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:40 smithi110 ceph-mon[28069]: pgmap v7292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:40 smithi193 ceph-mon[32782]: pgmap v7292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:42 smithi196 ceph-mon[32572]: pgmap v7293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12877.039816 secs 2024-04-26T15:22:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:42 smithi110 ceph-mon[28069]: pgmap v7293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12877.039816 secs 2024-04-26T15:22:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:42 smithi193 ceph-mon[32782]: pgmap v7293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12877.039816 secs 2024-04-26T15:22:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:22:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:22:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:22:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:44 smithi196 ceph-mon[32572]: pgmap v7294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:22:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:22:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:22:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:44 smithi110 ceph-mon[28069]: pgmap v7294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:22:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:22:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:22:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:44 smithi193 ceph-mon[32782]: pgmap v7294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:22:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:22:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:22:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:45 smithi196 ceph-mon[32572]: pgmap v7295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:22:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:45 smithi196 ceph-mon[32572]: pgmap v7296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:45 smithi110 ceph-mon[28069]: pgmap v7295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:22:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:45 smithi110 ceph-mon[28069]: pgmap v7296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:45 smithi193 ceph-mon[32782]: pgmap v7295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:22:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:45 smithi193 ceph-mon[32782]: pgmap v7296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:47 smithi110 ceph-mon[28069]: pgmap v7297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12882.039899 secs 2024-04-26T15:22:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:47 smithi193 ceph-mon[32782]: pgmap v7297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12882.039899 secs 2024-04-26T15:22:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:47 smithi196 ceph-mon[32572]: pgmap v7297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12882.039899 secs 2024-04-26T15:22:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:22:48.479+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T15:22:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:22:48.479+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:22:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:22:48.479+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 102 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:22:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:22:48.480+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 102 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T15:22:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:49 smithi110 ceph-mon[28069]: pgmap v7298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:49.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:49 smithi196 ceph-mon[32572]: pgmap v7298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:49 smithi193 ceph-mon[32782]: pgmap v7298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:51 smithi110 ceph-mon[28069]: pgmap v7299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:51 smithi193 ceph-mon[32782]: pgmap v7299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:51 smithi196 ceph-mon[32572]: pgmap v7299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12887.039982 secs 2024-04-26T15:22:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12887.039982 secs 2024-04-26T15:22:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12887.039982 secs 2024-04-26T15:22:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:53 smithi110 ceph-mon[28069]: pgmap v7300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:53 smithi193 ceph-mon[32782]: pgmap v7300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:53 smithi196 ceph-mon[32572]: pgmap v7300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:22:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:55 smithi110 ceph-mon[28069]: pgmap v7301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:22:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:55 smithi193 ceph-mon[32782]: pgmap v7301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:22:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:55 smithi196 ceph-mon[32572]: pgmap v7301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:22:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:57 smithi110 ceph-mon[28069]: pgmap v7302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12892.040062 secs 2024-04-26T15:22:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:57 smithi193 ceph-mon[32782]: pgmap v7302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12892.040062 secs 2024-04-26T15:22:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:57 smithi196 ceph-mon[32572]: pgmap v7302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:22:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12892.040062 secs 2024-04-26T15:22:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:22:59 smithi193 ceph-mon[32782]: pgmap v7303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:22:59 smithi196 ceph-mon[32572]: pgmap v7303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:22:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:22:59 smithi110 ceph-mon[28069]: pgmap v7303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:00 smithi193 ceph-mon[32782]: pgmap v7304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:00 smithi196 ceph-mon[32572]: pgmap v7304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:00 smithi110 ceph-mon[28069]: pgmap v7304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12897.040163 secs 2024-04-26T15:23:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:02 smithi196 ceph-mon[32572]: pgmap v7305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12897.040163 secs 2024-04-26T15:23:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:02 smithi110 ceph-mon[28069]: pgmap v7305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12897.040163 secs 2024-04-26T15:23:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:02 smithi193 ceph-mon[32782]: pgmap v7305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:04 smithi196 ceph-mon[32572]: pgmap v7306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:04 smithi110 ceph-mon[28069]: pgmap v7306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:04 smithi193 ceph-mon[32782]: pgmap v7306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:06 smithi196 ceph-mon[32572]: pgmap v7307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:06 smithi110 ceph-mon[28069]: pgmap v7307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:06 smithi193 ceph-mon[32782]: pgmap v7307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:07 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12902.040293 secs 2024-04-26T15:23:08.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:07 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12902.040293 secs 2024-04-26T15:23:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:07 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12902.040293 secs 2024-04-26T15:23:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:08 smithi196 ceph-mon[32572]: pgmap v7308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:08 smithi110 ceph-mon[28069]: pgmap v7308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:08 smithi193 ceph-mon[32782]: pgmap v7308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:10 smithi196 ceph-mon[32572]: pgmap v7309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:10 smithi110 ceph-mon[28069]: pgmap v7309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:10 smithi193 ceph-mon[32782]: pgmap v7309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12907.040410 secs 2024-04-26T15:23:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:12 smithi196 ceph-mon[32572]: pgmap v7310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12907.040410 secs 2024-04-26T15:23:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:12 smithi110 ceph-mon[28069]: pgmap v7310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12907.040410 secs 2024-04-26T15:23:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:12 smithi193 ceph-mon[32782]: pgmap v7310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:14 smithi196 ceph-mon[32572]: pgmap v7311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:14 smithi110 ceph-mon[28069]: pgmap v7311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:14 smithi193 ceph-mon[32782]: pgmap v7311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:16 smithi196 ceph-mon[32572]: pgmap v7312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:16 smithi110 ceph-mon[28069]: pgmap v7312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:16 smithi193 ceph-mon[32782]: pgmap v7312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12912.040552 secs 2024-04-26T15:23:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12912.040552 secs 2024-04-26T15:23:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12912.040552 secs 2024-04-26T15:23:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:18 smithi196 ceph-mon[32572]: pgmap v7313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:18 smithi110 ceph-mon[28069]: pgmap v7313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:18 smithi193 ceph-mon[32782]: pgmap v7313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:20 smithi196 ceph-mon[32572]: pgmap v7314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:20 smithi110 ceph-mon[28069]: pgmap v7314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:20 smithi193 ceph-mon[32782]: pgmap v7314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12917.040585 secs 2024-04-26T15:23:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:22 smithi196 ceph-mon[32572]: pgmap v7315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12917.040585 secs 2024-04-26T15:23:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:22 smithi110 ceph-mon[28069]: pgmap v7315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12917.040585 secs 2024-04-26T15:23:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:22 smithi193 ceph-mon[32782]: pgmap v7315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:24 smithi196 ceph-mon[32572]: pgmap v7316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:24 smithi110 ceph-mon[28069]: pgmap v7316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:24 smithi193 ceph-mon[32782]: pgmap v7316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:26 smithi196 ceph-mon[32572]: pgmap v7317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:26 smithi110 ceph-mon[28069]: pgmap v7317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:26 smithi193 ceph-mon[32782]: pgmap v7317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12922.040703 secs 2024-04-26T15:23:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12922.040703 secs 2024-04-26T15:23:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12922.040703 secs 2024-04-26T15:23:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:28 smithi196 ceph-mon[32572]: pgmap v7318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:28 smithi110 ceph-mon[28069]: pgmap v7318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:28 smithi193 ceph-mon[32782]: pgmap v7318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:30 smithi196 ceph-mon[32572]: pgmap v7319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:30 smithi110 ceph-mon[28069]: pgmap v7319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:30 smithi193 ceph-mon[32782]: pgmap v7319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12927.040785 secs 2024-04-26T15:23:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:32 smithi196 ceph-mon[32572]: pgmap v7320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12927.040785 secs 2024-04-26T15:23:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:32 smithi110 ceph-mon[28069]: pgmap v7320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12927.040785 secs 2024-04-26T15:23:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:32 smithi193 ceph-mon[32782]: pgmap v7320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:34 smithi196 ceph-mon[32572]: pgmap v7321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:34 smithi110 ceph-mon[28069]: pgmap v7321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:34 smithi193 ceph-mon[32782]: pgmap v7321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:36 smithi196 ceph-mon[32572]: pgmap v7322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:36 smithi110 ceph-mon[28069]: pgmap v7322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:36 smithi193 ceph-mon[32782]: pgmap v7322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12932.040920 secs 2024-04-26T15:23:38.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12932.040920 secs 2024-04-26T15:23:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12932.040920 secs 2024-04-26T15:23:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:38 smithi196 ceph-mon[32572]: pgmap v7323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:38 smithi110 ceph-mon[28069]: pgmap v7323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:38 smithi193 ceph-mon[32782]: pgmap v7323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:41 smithi196 ceph-mon[32572]: pgmap v7324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:41 smithi110 ceph-mon[28069]: pgmap v7324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:41.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:41 smithi193 ceph-mon[32782]: pgmap v7324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:43 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12937.041038 secs 2024-04-26T15:23:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:43 smithi110 ceph-mon[28069]: pgmap v7325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:43 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12937.041038 secs 2024-04-26T15:23:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:43 smithi193 ceph-mon[32782]: pgmap v7325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:43 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12937.041038 secs 2024-04-26T15:23:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:43 smithi196 ceph-mon[32572]: pgmap v7325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:23:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:45 smithi110 ceph-mon[28069]: pgmap v7326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:23:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:45 smithi193 ceph-mon[32782]: pgmap v7326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:23:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:45 smithi196 ceph-mon[32572]: pgmap v7326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:23:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:23:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:23:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:23:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:23:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:23:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:23:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:23:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:23:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:23:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:47 smithi110 ceph-mon[28069]: pgmap v7327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T15:23:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:47 smithi110 ceph-mon[28069]: pgmap v7328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:47 smithi193 ceph-mon[32782]: pgmap v7327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T15:23:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:47 smithi193 ceph-mon[32782]: pgmap v7328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:47 smithi196 ceph-mon[32572]: pgmap v7327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T15:23:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:47 smithi196 ceph-mon[32572]: pgmap v7328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:48 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12942.041148 secs 2024-04-26T15:23:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:48 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12942.041148 secs 2024-04-26T15:23:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:48 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12942.041148 secs 2024-04-26T15:23:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:49 smithi193 ceph-mon[32782]: pgmap v7329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:49.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:49 smithi196 ceph-mon[32572]: pgmap v7329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:49 smithi110 ceph-mon[28069]: pgmap v7329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:51.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:51 smithi193 ceph-mon[32782]: pgmap v7330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:51 smithi196 ceph-mon[32572]: pgmap v7330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:51 smithi110 ceph-mon[28069]: pgmap v7330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:53 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12947.041270 secs 2024-04-26T15:23:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:53 smithi193 ceph-mon[32782]: pgmap v7331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:53 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12947.041270 secs 2024-04-26T15:23:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:53 smithi196 ceph-mon[32572]: pgmap v7331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:53 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12947.041270 secs 2024-04-26T15:23:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:53 smithi110 ceph-mon[28069]: pgmap v7331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:55 smithi193 ceph-mon[32782]: pgmap v7332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:55 smithi196 ceph-mon[32572]: pgmap v7332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:55 smithi110 ceph-mon[28069]: pgmap v7332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:23:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:57 smithi193 ceph-mon[32782]: pgmap v7333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:23:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:57 smithi196 ceph-mon[32572]: pgmap v7333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:23:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:57 smithi110 ceph-mon[28069]: pgmap v7333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:23:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:58 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12952.041388 secs 2024-04-26T15:23:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:58 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12952.041388 secs 2024-04-26T15:23:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:58 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12952.041388 secs 2024-04-26T15:23:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:23:59 smithi193 ceph-mon[32782]: pgmap v7334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:23:59 smithi196 ceph-mon[32572]: pgmap v7334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:23:59.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:23:59 smithi110 ceph-mon[28069]: pgmap v7334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:01 smithi193 ceph-mon[32782]: pgmap v7335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:01 smithi196 ceph-mon[32572]: pgmap v7335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:01 smithi110 ceph-mon[28069]: pgmap v7335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:03.342 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:03 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12957.041518 secs 2024-04-26T15:24:03.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:03 smithi110 ceph-mon[28069]: pgmap v7336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:03 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12957.041518 secs 2024-04-26T15:24:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:03 smithi193 ceph-mon[32782]: pgmap v7336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:03 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12957.041518 secs 2024-04-26T15:24:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:03 smithi196 ceph-mon[32572]: pgmap v7336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:05 smithi193 ceph-mon[32782]: pgmap v7337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:05 smithi196 ceph-mon[32572]: pgmap v7337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:05 smithi110 ceph-mon[28069]: pgmap v7337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:24:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:24:06.567+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:24:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:24:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:24:06.567+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:24:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:24:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:24:06.567+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:24:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:24:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:24:06.567+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:24:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:24:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:24:06.567+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:24:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:07 smithi193 ceph-mon[32782]: pgmap v7338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:07 smithi196 ceph-mon[32572]: pgmap v7338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:07 smithi110 ceph-mon[28069]: pgmap v7338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:08 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12962.041634 secs 2024-04-26T15:24:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:08 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12962.041634 secs 2024-04-26T15:24:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:08 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12962.041634 secs 2024-04-26T15:24:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:09 smithi193 ceph-mon[32782]: pgmap v7339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:24:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:09 smithi196 ceph-mon[32572]: pgmap v7339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:24:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:09 smithi110 ceph-mon[28069]: pgmap v7339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:24:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:11 smithi193 ceph-mon[32782]: pgmap v7340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:24:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:11 smithi196 ceph-mon[32572]: pgmap v7340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:24:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:11 smithi110 ceph-mon[28069]: pgmap v7340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:24:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:13 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12967.041707 secs 2024-04-26T15:24:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:13 smithi196 ceph-mon[32572]: pgmap v7341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:24:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:13 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12967.041707 secs 2024-04-26T15:24:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:13 smithi110 ceph-mon[28069]: pgmap v7341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:24:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:13 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12967.041707 secs 2024-04-26T15:24:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:13 smithi193 ceph-mon[32782]: pgmap v7341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:24:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:15 smithi196 ceph-mon[32572]: pgmap v7342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:24:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:15 smithi110 ceph-mon[28069]: pgmap v7342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:24:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:15 smithi193 ceph-mon[32782]: pgmap v7342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:24:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:17 smithi196 ceph-mon[32572]: pgmap v7343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:24:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:17 smithi110 ceph-mon[28069]: pgmap v7343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:24:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:17 smithi193 ceph-mon[32782]: pgmap v7343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:24:18.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:24:18.496+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:24:18.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:24:18.496+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T15:24:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:24:18.497+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 103 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T15:24:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:24:18.497+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 103 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:24:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:18 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12972.041843 secs 2024-04-26T15:24:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:18 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12972.041843 secs 2024-04-26T15:24:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:18 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12972.041843 secs 2024-04-26T15:24:19.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:19 smithi196 ceph-mon[32572]: pgmap v7344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:24:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:19 smithi110 ceph-mon[28069]: pgmap v7344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:24:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:19 smithi193 ceph-mon[32782]: pgmap v7344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:24:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:21 smithi196 ceph-mon[32572]: pgmap v7345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:21 smithi110 ceph-mon[28069]: pgmap v7345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:21 smithi193 ceph-mon[32782]: pgmap v7345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12977.041968 secs 2024-04-26T15:24:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12977.041968 secs 2024-04-26T15:24:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12977.041968 secs 2024-04-26T15:24:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:23 smithi196 ceph-mon[32572]: pgmap v7346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:23 smithi110 ceph-mon[28069]: pgmap v7346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:23 smithi193 ceph-mon[32782]: pgmap v7346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:25 smithi196 ceph-mon[32572]: pgmap v7347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:25 smithi110 ceph-mon[28069]: pgmap v7347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:25 smithi193 ceph-mon[32782]: pgmap v7347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:27 smithi196 ceph-mon[32572]: pgmap v7348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12982.042092 secs 2024-04-26T15:24:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:27 smithi110 ceph-mon[28069]: pgmap v7348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12982.042092 secs 2024-04-26T15:24:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:27 smithi193 ceph-mon[32782]: pgmap v7348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12982.042092 secs 2024-04-26T15:24:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:29 smithi196 ceph-mon[32572]: pgmap v7349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:29 smithi110 ceph-mon[28069]: pgmap v7349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:29 smithi193 ceph-mon[32782]: pgmap v7349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:31 smithi196 ceph-mon[32572]: pgmap v7350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:31 smithi110 ceph-mon[28069]: pgmap v7350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:31 smithi193 ceph-mon[32782]: pgmap v7350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12987.042173 secs 2024-04-26T15:24:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12987.042173 secs 2024-04-26T15:24:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12987.042173 secs 2024-04-26T15:24:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:33 smithi196 ceph-mon[32572]: pgmap v7351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:33 smithi110 ceph-mon[28069]: pgmap v7351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:33 smithi193 ceph-mon[32782]: pgmap v7351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:35 smithi196 ceph-mon[32572]: pgmap v7352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:35 smithi110 ceph-mon[28069]: pgmap v7352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:35.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:35 smithi193 ceph-mon[32782]: pgmap v7352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:37 smithi196 ceph-mon[32572]: pgmap v7353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12992.042274 secs 2024-04-26T15:24:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:37 smithi110 ceph-mon[28069]: pgmap v7353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12992.042274 secs 2024-04-26T15:24:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:37 smithi193 ceph-mon[32782]: pgmap v7353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12992.042274 secs 2024-04-26T15:24:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:39 smithi196 ceph-mon[32572]: pgmap v7354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:39 smithi110 ceph-mon[28069]: pgmap v7354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:39 smithi193 ceph-mon[32782]: pgmap v7354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:41 smithi196 ceph-mon[32572]: pgmap v7355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:41 smithi110 ceph-mon[28069]: pgmap v7355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:41 smithi193 ceph-mon[32782]: pgmap v7355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 12997.042392 secs 2024-04-26T15:24:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 12997.042392 secs 2024-04-26T15:24:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 12997.042392 secs 2024-04-26T15:24:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:43 smithi196 ceph-mon[32572]: pgmap v7356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:43 smithi110 ceph-mon[28069]: pgmap v7356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:43 smithi193 ceph-mon[32782]: pgmap v7356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:45 smithi196 ceph-mon[32572]: pgmap v7357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:45 smithi110 ceph-mon[28069]: pgmap v7357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:45 smithi193 ceph-mon[32782]: pgmap v7357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:24:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:24:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:24:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:24:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:47 smithi196 ceph-mon[32572]: pgmap v7358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13002.042480 secs 2024-04-26T15:24:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:24:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:24:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:24:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:47 smithi110 ceph-mon[28069]: pgmap v7358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13002.042480 secs 2024-04-26T15:24:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:24:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:24:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:24:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:47 smithi193 ceph-mon[32782]: pgmap v7358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:24:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13002.042480 secs 2024-04-26T15:24:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:24:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:24:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:24:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:48 smithi110 ceph-mon[28069]: pgmap v7359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:24:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:48 smithi110 ceph-mon[28069]: pgmap v7360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:24:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:48 smithi193 ceph-mon[32782]: pgmap v7359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:24:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:48 smithi193 ceph-mon[32782]: pgmap v7360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:24:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:48 smithi196 ceph-mon[32572]: pgmap v7359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:24:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:48 smithi196 ceph-mon[32572]: pgmap v7360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:24:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:50 smithi110 ceph-mon[28069]: pgmap v7361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:50.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:50 smithi196 ceph-mon[32572]: pgmap v7361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:50 smithi193 ceph-mon[32782]: pgmap v7361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:52 smithi110 ceph-mon[28069]: pgmap v7362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13007.042646 secs 2024-04-26T15:24:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:52 smithi193 ceph-mon[32782]: pgmap v7362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13007.042646 secs 2024-04-26T15:24:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:52 smithi196 ceph-mon[32572]: pgmap v7362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13007.042646 secs 2024-04-26T15:24:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:54 smithi110 ceph-mon[28069]: pgmap v7363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:54 smithi193 ceph-mon[32782]: pgmap v7363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:54 smithi196 ceph-mon[32572]: pgmap v7363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:56 smithi110 ceph-mon[28069]: pgmap v7364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:56 smithi193 ceph-mon[32782]: pgmap v7364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:56 smithi196 ceph-mon[32572]: pgmap v7364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:24:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13012.042769 secs 2024-04-26T15:24:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13012.042769 secs 2024-04-26T15:24:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13012.042769 secs 2024-04-26T15:24:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:24:58 smithi110 ceph-mon[28069]: pgmap v7365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:24:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:24:58 smithi193 ceph-mon[32782]: pgmap v7365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:24:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:24:58 smithi196 ceph-mon[32572]: pgmap v7365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:25:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:00 smithi193 ceph-mon[32782]: pgmap v7366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:00 smithi196 ceph-mon[32572]: pgmap v7366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:00 smithi110 ceph-mon[28069]: pgmap v7366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:02 smithi193 ceph-mon[32782]: pgmap v7367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13017.042886 secs 2024-04-26T15:25:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:02 smithi196 ceph-mon[32572]: pgmap v7367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13017.042886 secs 2024-04-26T15:25:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:02 smithi110 ceph-mon[28069]: pgmap v7367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13017.042886 secs 2024-04-26T15:25:04.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:04 smithi110 ceph-mon[28069]: pgmap v7368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:25:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:04 smithi193 ceph-mon[32782]: pgmap v7368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:25:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:04 smithi196 ceph-mon[32572]: pgmap v7368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:25:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:06 smithi193 ceph-mon[32782]: pgmap v7369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:25:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:06 smithi196 ceph-mon[32572]: pgmap v7369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:25:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:06 smithi110 ceph-mon[28069]: pgmap v7369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:25:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:07 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13022.042958 secs 2024-04-26T15:25:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:07 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13022.042958 secs 2024-04-26T15:25:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:07 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13022.042958 secs 2024-04-26T15:25:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:08 smithi193 ceph-mon[32782]: pgmap v7370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:25:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:08 smithi196 ceph-mon[32572]: pgmap v7370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:25:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:08 smithi110 ceph-mon[28069]: pgmap v7370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:25:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:09 smithi196 ceph-mon[32572]: pgmap v7371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:25:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:09 smithi110 ceph-mon[28069]: pgmap v7371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:25:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:09 smithi193 ceph-mon[32782]: pgmap v7371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:25:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:12 smithi193 ceph-mon[32782]: pgmap v7372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:25:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:12 smithi196 ceph-mon[32572]: pgmap v7372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:25:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:12 smithi110 ceph-mon[28069]: pgmap v7372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:25:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:13 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13027.043074 secs 2024-04-26T15:25:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:13 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13027.043074 secs 2024-04-26T15:25:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:13 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13027.043074 secs 2024-04-26T15:25:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:14 smithi193 ceph-mon[32782]: pgmap v7373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:25:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:14 smithi196 ceph-mon[32572]: pgmap v7373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:25:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:14 smithi110 ceph-mon[28069]: pgmap v7373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:25:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:16 smithi193 ceph-mon[32782]: pgmap v7374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:16 smithi196 ceph-mon[32572]: pgmap v7374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:16 smithi110 ceph-mon[28069]: pgmap v7374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:18 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13032.043147 secs 2024-04-26T15:25:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:18 smithi196 ceph-mon[32572]: pgmap v7375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:18 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13032.043147 secs 2024-04-26T15:25:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:18 smithi110 ceph-mon[28069]: pgmap v7375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:18 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13032.043147 secs 2024-04-26T15:25:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:18 smithi193 ceph-mon[32782]: pgmap v7375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:20 smithi196 ceph-mon[32572]: pgmap v7376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:20 smithi110 ceph-mon[28069]: pgmap v7376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:20 smithi193 ceph-mon[32782]: pgmap v7376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:22 smithi196 ceph-mon[32572]: pgmap v7377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:22 smithi110 ceph-mon[28069]: pgmap v7377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:22 smithi193 ceph-mon[32782]: pgmap v7377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:23 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13037.043260 secs 2024-04-26T15:25:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:23 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13037.043260 secs 2024-04-26T15:25:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:23 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13037.043260 secs 2024-04-26T15:25:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:24 smithi196 ceph-mon[32572]: pgmap v7378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:24 smithi110 ceph-mon[28069]: pgmap v7378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:24 smithi193 ceph-mon[32782]: pgmap v7378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:26 smithi196 ceph-mon[32572]: pgmap v7379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:26 smithi110 ceph-mon[28069]: pgmap v7379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:26 smithi193 ceph-mon[32782]: pgmap v7379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13042.043335 secs 2024-04-26T15:25:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13042.043335 secs 2024-04-26T15:25:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13042.043335 secs 2024-04-26T15:25:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:28 smithi196 ceph-mon[32572]: pgmap v7380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:28 smithi110 ceph-mon[28069]: pgmap v7380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:28 smithi193 ceph-mon[32782]: pgmap v7380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:30 smithi196 ceph-mon[32572]: pgmap v7381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:30 smithi110 ceph-mon[28069]: pgmap v7381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:30 smithi193 ceph-mon[32782]: pgmap v7381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:32 smithi196 ceph-mon[32572]: pgmap v7382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13047.043452 secs 2024-04-26T15:25:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:32 smithi110 ceph-mon[28069]: pgmap v7382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13047.043452 secs 2024-04-26T15:25:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:32 smithi193 ceph-mon[32782]: pgmap v7382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13047.043452 secs 2024-04-26T15:25:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:34 smithi196 ceph-mon[32572]: pgmap v7383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:34 smithi110 ceph-mon[28069]: pgmap v7383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:34 smithi193 ceph-mon[32782]: pgmap v7383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:36 smithi196 ceph-mon[32572]: pgmap v7384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:36 smithi110 ceph-mon[28069]: pgmap v7384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:36 smithi193 ceph-mon[32782]: pgmap v7384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13052.043590 secs 2024-04-26T15:25:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13052.043590 secs 2024-04-26T15:25:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13052.043590 secs 2024-04-26T15:25:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:38 smithi196 ceph-mon[32572]: pgmap v7385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:38 smithi110 ceph-mon[28069]: pgmap v7385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:38 smithi193 ceph-mon[32782]: pgmap v7385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:40 smithi196 ceph-mon[32572]: pgmap v7386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:40 smithi110 ceph-mon[28069]: pgmap v7386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:40 smithi193 ceph-mon[32782]: pgmap v7386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:42 smithi196 ceph-mon[32572]: pgmap v7387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13057.043656 secs 2024-04-26T15:25:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:42 smithi110 ceph-mon[28069]: pgmap v7387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13057.043656 secs 2024-04-26T15:25:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:42 smithi193 ceph-mon[32782]: pgmap v7387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13057.043656 secs 2024-04-26T15:25:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:44 smithi196 ceph-mon[32572]: pgmap v7388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:44 smithi110 ceph-mon[28069]: pgmap v7388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:44 smithi193 ceph-mon[32782]: pgmap v7388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:25:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:46 smithi110 ceph-mon[28069]: pgmap v7389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:46 smithi193 ceph-mon[32782]: pgmap v7389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:46 smithi196 ceph-mon[32572]: pgmap v7389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13062.043780 secs 2024-04-26T15:25:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13062.043780 secs 2024-04-26T15:25:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13062.043780 secs 2024-04-26T15:25:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:48 smithi110 ceph-mon[28069]: pgmap v7390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:25:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:48 smithi193 ceph-mon[32782]: pgmap v7390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:25:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:48 smithi196 ceph-mon[32572]: pgmap v7390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:25:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:25:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:25:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:25:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:25:49.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:25:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:25:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:25:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:25:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:25:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:25:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:50 smithi110 ceph-mon[28069]: pgmap v7391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:25:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:50 smithi110 ceph-mon[28069]: pgmap v7392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:50 smithi193 ceph-mon[32782]: pgmap v7391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:25:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:50 smithi193 ceph-mon[32782]: pgmap v7392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:50.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:50 smithi196 ceph-mon[32572]: pgmap v7391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:25:50.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:50 smithi196 ceph-mon[32572]: pgmap v7392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:52 smithi110 ceph-mon[28069]: pgmap v7393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13067.043916 secs 2024-04-26T15:25:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:52 smithi193 ceph-mon[32782]: pgmap v7393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13067.043916 secs 2024-04-26T15:25:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:52 smithi196 ceph-mon[32572]: pgmap v7393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13067.043916 secs 2024-04-26T15:25:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:54 smithi193 ceph-mon[32782]: pgmap v7394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:54 smithi196 ceph-mon[32572]: pgmap v7394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:54 smithi110 ceph-mon[28069]: pgmap v7394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:56 smithi193 ceph-mon[32782]: pgmap v7395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:56 smithi196 ceph-mon[32572]: pgmap v7395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:56 smithi110 ceph-mon[28069]: pgmap v7395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13072.044028 secs 2024-04-26T15:25:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13072.044028 secs 2024-04-26T15:25:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13072.044028 secs 2024-04-26T15:25:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:25:58 smithi193 ceph-mon[32782]: pgmap v7396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:25:58 smithi196 ceph-mon[32572]: pgmap v7396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:25:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:25:58 smithi110 ceph-mon[28069]: pgmap v7396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:26:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:00 smithi193 ceph-mon[32782]: pgmap v7397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:26:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:00 smithi196 ceph-mon[32572]: pgmap v7397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:26:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:00 smithi110 ceph-mon[28069]: pgmap v7397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:26:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:02 smithi193 ceph-mon[32782]: pgmap v7398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13077.044149 secs 2024-04-26T15:26:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:02 smithi196 ceph-mon[32572]: pgmap v7398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13077.044149 secs 2024-04-26T15:26:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:02 smithi110 ceph-mon[28069]: pgmap v7398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13077.044149 secs 2024-04-26T15:26:04.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:04 smithi110 ceph-mon[28069]: pgmap v7399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:04 smithi193 ceph-mon[32782]: pgmap v7399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:04 smithi196 ceph-mon[32572]: pgmap v7399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:06 smithi193 ceph-mon[32782]: pgmap v7400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:06 smithi196 ceph-mon[32572]: pgmap v7400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:06 smithi110 ceph-mon[28069]: pgmap v7400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:07 smithi193 ceph-mon[32782]: 12 slow requests, 1 included below; oldest blocked for > 13082.044311 secs 2024-04-26T15:26:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:07 smithi193 ceph-mon[32782]: slow request 720.088929 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:26:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:07 smithi193 ceph-mon[32782]: pgmap v7401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:07 smithi196 ceph-mon[32572]: 12 slow requests, 1 included below; oldest blocked for > 13082.044311 secs 2024-04-26T15:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:07 smithi196 ceph-mon[32572]: slow request 720.088929 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:07 smithi196 ceph-mon[32572]: pgmap v7401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:07 smithi110 ceph-mon[28069]: 12 slow requests, 1 included below; oldest blocked for > 13082.044311 secs 2024-04-26T15:26:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:07 smithi110 ceph-mon[28069]: slow request 720.088929 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:26:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:07 smithi110 ceph-mon[28069]: pgmap v7401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:09 smithi196 ceph-mon[32572]: pgmap v7402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:09 smithi110 ceph-mon[28069]: pgmap v7402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:09 smithi193 ceph-mon[32782]: pgmap v7402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:11 smithi196 ceph-mon[32572]: pgmap v7403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:11 smithi110 ceph-mon[28069]: pgmap v7403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:11 smithi193 ceph-mon[32782]: pgmap v7403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13087.044450 secs 2024-04-26T15:26:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13087.044450 secs 2024-04-26T15:26:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13087.044450 secs 2024-04-26T15:26:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:13 smithi196 ceph-mon[32572]: pgmap v7404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:13 smithi110 ceph-mon[28069]: pgmap v7404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:13 smithi193 ceph-mon[32782]: pgmap v7404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:15 smithi196 ceph-mon[32572]: pgmap v7405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:15 smithi110 ceph-mon[28069]: pgmap v7405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:15 smithi193 ceph-mon[32782]: pgmap v7405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13092.044539 secs 2024-04-26T15:26:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:17 smithi196 ceph-mon[32572]: pgmap v7406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13092.044539 secs 2024-04-26T15:26:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:17 smithi110 ceph-mon[28069]: pgmap v7406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13092.044539 secs 2024-04-26T15:26:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:17 smithi193 ceph-mon[32782]: pgmap v7406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:19 smithi196 ceph-mon[32572]: pgmap v7407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:19 smithi110 ceph-mon[28069]: pgmap v7407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:19 smithi193 ceph-mon[32782]: pgmap v7407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:21 smithi196 ceph-mon[32572]: pgmap v7408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:21 smithi110 ceph-mon[28069]: pgmap v7408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:21 smithi193 ceph-mon[32782]: pgmap v7408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13097.044627 secs 2024-04-26T15:26:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13097.044627 secs 2024-04-26T15:26:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13097.044627 secs 2024-04-26T15:26:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:23 smithi110 ceph-mon[28069]: pgmap v7409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:23 smithi193 ceph-mon[32782]: pgmap v7409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:23 smithi196 ceph-mon[32572]: pgmap v7409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:25 smithi110 ceph-mon[28069]: pgmap v7410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:25 smithi193 ceph-mon[32782]: pgmap v7410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:25 smithi196 ceph-mon[32572]: pgmap v7410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13102.044753 secs 2024-04-26T15:26:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:27 smithi110 ceph-mon[28069]: pgmap v7411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13102.044753 secs 2024-04-26T15:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:27 smithi193 ceph-mon[32782]: pgmap v7411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13102.044753 secs 2024-04-26T15:26:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:27 smithi196 ceph-mon[32572]: pgmap v7411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:29 smithi110 ceph-mon[28069]: pgmap v7412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:29 smithi193 ceph-mon[32782]: pgmap v7412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:29 smithi196 ceph-mon[32572]: pgmap v7412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:31 smithi110 ceph-mon[28069]: pgmap v7413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:31 smithi193 ceph-mon[32782]: pgmap v7413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:31 smithi196 ceph-mon[32572]: pgmap v7413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13107.044850 secs 2024-04-26T15:26:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13107.044850 secs 2024-04-26T15:26:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13107.044850 secs 2024-04-26T15:26:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:33 smithi193 ceph-mon[32782]: pgmap v7414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:33 smithi196 ceph-mon[32572]: pgmap v7414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:33 smithi110 ceph-mon[28069]: pgmap v7414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:36.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:35 smithi110 ceph-mon[28069]: pgmap v7415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:35 smithi193 ceph-mon[32782]: pgmap v7415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:35 smithi196 ceph-mon[32572]: pgmap v7415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13112.044969 secs 2024-04-26T15:26:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:37 smithi193 ceph-mon[32782]: pgmap v7416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13112.044969 secs 2024-04-26T15:26:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:37 smithi196 ceph-mon[32572]: pgmap v7416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13112.044969 secs 2024-04-26T15:26:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:37 smithi110 ceph-mon[28069]: pgmap v7416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:39 smithi193 ceph-mon[32782]: pgmap v7417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:39 smithi196 ceph-mon[32572]: pgmap v7417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:39 smithi110 ceph-mon[28069]: pgmap v7417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:41 smithi193 ceph-mon[32782]: pgmap v7418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:41 smithi196 ceph-mon[32572]: pgmap v7418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:41 smithi110 ceph-mon[28069]: pgmap v7418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13117.045087 secs 2024-04-26T15:26:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13117.045087 secs 2024-04-26T15:26:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13117.045087 secs 2024-04-26T15:26:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:43 smithi193 ceph-mon[32782]: pgmap v7419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:43 smithi196 ceph-mon[32572]: pgmap v7419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:43 smithi110 ceph-mon[28069]: pgmap v7419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:45 smithi193 ceph-mon[32782]: pgmap v7420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:45 smithi196 ceph-mon[32572]: pgmap v7420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:45 smithi110 ceph-mon[28069]: pgmap v7420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13122.045203 secs 2024-04-26T15:26:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:47 smithi193 ceph-mon[32782]: pgmap v7421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13122.045203 secs 2024-04-26T15:26:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:47 smithi196 ceph-mon[32572]: pgmap v7421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13122.045203 secs 2024-04-26T15:26:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:47 smithi110 ceph-mon[28069]: pgmap v7421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:49 smithi193 ceph-mon[32782]: pgmap v7422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:26:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:49 smithi196 ceph-mon[32572]: pgmap v7422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:26:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:49 smithi110 ceph-mon[28069]: pgmap v7422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:26:51.944 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:51 smithi193 ceph-mon[32782]: pgmap v7423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:51 smithi196 ceph-mon[32572]: pgmap v7423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:51 smithi110 ceph-mon[28069]: pgmap v7423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:26:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13127.045311 secs 2024-04-26T15:26:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13127.045311 secs 2024-04-26T15:26:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13127.045311 secs 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: pgmap v7424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: pgmap v7425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: pgmap v7426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: pgmap v7424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:26:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:26:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: pgmap v7425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T15:26:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: pgmap v7426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: pgmap v7424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:26:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:26:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: pgmap v7425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T15:26:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: pgmap v7426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:26:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:55 smithi196 ceph-mon[32572]: pgmap v7427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:55 smithi110 ceph-mon[28069]: pgmap v7427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:55 smithi193 ceph-mon[32782]: pgmap v7427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:26:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13132.045406 secs 2024-04-26T15:26:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13132.045406 secs 2024-04-26T15:26:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13132.045406 secs 2024-04-26T15:26:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:58 smithi196 ceph-mon[32572]: pgmap v7428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 591 B/s rd, 1 op/s 2024-04-26T15:26:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:58 smithi110 ceph-mon[28069]: pgmap v7428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 591 B/s rd, 1 op/s 2024-04-26T15:26:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:58 smithi193 ceph-mon[32782]: pgmap v7428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 591 B/s rd, 1 op/s 2024-04-26T15:27:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:26:59 smithi110 ceph-mon[28069]: pgmap v7429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:26:59 smithi193 ceph-mon[32782]: pgmap v7429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:26:59 smithi196 ceph-mon[32572]: pgmap v7429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:01 smithi196 ceph-mon[32572]: pgmap v7430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 591 B/s rd, 1 op/s 2024-04-26T15:27:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:01 smithi110 ceph-mon[28069]: pgmap v7430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 591 B/s rd, 1 op/s 2024-04-26T15:27:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:01 smithi193 ceph-mon[32782]: pgmap v7430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 591 B/s rd, 1 op/s 2024-04-26T15:27:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13137.045542 secs 2024-04-26T15:27:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13137.045542 secs 2024-04-26T15:27:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13137.045542 secs 2024-04-26T15:27:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:03 smithi193 ceph-mon[32782]: pgmap v7431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:27:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:03 smithi196 ceph-mon[32572]: pgmap v7431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:27:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:03 smithi110 ceph-mon[28069]: pgmap v7431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:27:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:05 smithi196 ceph-mon[32572]: pgmap v7432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:05 smithi110 ceph-mon[28069]: pgmap v7432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:05 smithi193 ceph-mon[32782]: pgmap v7432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:07 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13142.045640 secs 2024-04-26T15:27:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:07 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13142.045640 secs 2024-04-26T15:27:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:07 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13142.045640 secs 2024-04-26T15:27:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:08 smithi196 ceph-mon[32572]: pgmap v7433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:08 smithi110 ceph-mon[28069]: pgmap v7433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:08 smithi193 ceph-mon[32782]: pgmap v7433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:09 smithi196 ceph-mon[32572]: pgmap v7434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:09 smithi110 ceph-mon[28069]: pgmap v7434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:09 smithi193 ceph-mon[32782]: pgmap v7434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:11.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:11 smithi193 ceph-mon[32782]: pgmap v7435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:11 smithi196 ceph-mon[32572]: pgmap v7435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:11 smithi110 ceph-mon[28069]: pgmap v7435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13147.045718 secs 2024-04-26T15:27:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13147.045718 secs 2024-04-26T15:27:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13147.045718 secs 2024-04-26T15:27:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:13 smithi196 ceph-mon[32572]: pgmap v7436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:13 smithi110 ceph-mon[28069]: pgmap v7436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:13 smithi193 ceph-mon[32782]: pgmap v7436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:15 smithi196 ceph-mon[32572]: pgmap v7437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:15 smithi110 ceph-mon[28069]: pgmap v7437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:15 smithi193 ceph-mon[32782]: pgmap v7437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13152.045794 secs 2024-04-26T15:27:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13152.045794 secs 2024-04-26T15:27:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13152.045794 secs 2024-04-26T15:27:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:18 smithi196 ceph-mon[32572]: pgmap v7438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:27:18.528+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:27:18.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:27:18.528+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T15:27:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:27:18.529+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 104 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T15:27:18.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:27:18.529+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 104 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:27:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:18 smithi110 ceph-mon[28069]: pgmap v7438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:18 smithi193 ceph-mon[32782]: pgmap v7438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:19 smithi196 ceph-mon[32572]: pgmap v7439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:19 smithi110 ceph-mon[28069]: pgmap v7439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:19 smithi193 ceph-mon[32782]: pgmap v7439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:21 smithi196 ceph-mon[32572]: pgmap v7440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:21 smithi110 ceph-mon[28069]: pgmap v7440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:21 smithi193 ceph-mon[32782]: pgmap v7440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13157.045867 secs 2024-04-26T15:27:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13157.045867 secs 2024-04-26T15:27:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13157.045867 secs 2024-04-26T15:27:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:23 smithi196 ceph-mon[32572]: pgmap v7441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:23 smithi110 ceph-mon[28069]: pgmap v7441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:23 smithi193 ceph-mon[32782]: pgmap v7441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:25 smithi196 ceph-mon[32572]: pgmap v7442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:25 smithi110 ceph-mon[28069]: pgmap v7442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:25 smithi193 ceph-mon[32782]: pgmap v7442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13162.045936 secs 2024-04-26T15:27:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13162.045936 secs 2024-04-26T15:27:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13162.045936 secs 2024-04-26T15:27:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:28 smithi196 ceph-mon[32572]: pgmap v7443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:28 smithi110 ceph-mon[28069]: pgmap v7443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:28 smithi193 ceph-mon[32782]: pgmap v7443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:29 smithi196 ceph-mon[32572]: pgmap v7444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:29 smithi110 ceph-mon[28069]: pgmap v7444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:29 smithi193 ceph-mon[32782]: pgmap v7444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:31 smithi196 ceph-mon[32572]: pgmap v7445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:31 smithi110 ceph-mon[28069]: pgmap v7445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:31 smithi193 ceph-mon[32782]: pgmap v7445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13167.046052 secs 2024-04-26T15:27:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13167.046052 secs 2024-04-26T15:27:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13167.046052 secs 2024-04-26T15:27:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:33 smithi196 ceph-mon[32572]: pgmap v7446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:33 smithi110 ceph-mon[28069]: pgmap v7446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:33 smithi193 ceph-mon[32782]: pgmap v7446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:35 smithi196 ceph-mon[32572]: pgmap v7447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:35 smithi110 ceph-mon[28069]: pgmap v7447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:35 smithi193 ceph-mon[32782]: pgmap v7447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13172.046169 secs 2024-04-26T15:27:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13172.046169 secs 2024-04-26T15:27:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13172.046169 secs 2024-04-26T15:27:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:38 smithi196 ceph-mon[32572]: pgmap v7448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:38 smithi110 ceph-mon[28069]: pgmap v7448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:38 smithi193 ceph-mon[32782]: pgmap v7448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:39 smithi196 ceph-mon[32572]: pgmap v7449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:39 smithi110 ceph-mon[28069]: pgmap v7449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:39 smithi193 ceph-mon[32782]: pgmap v7449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:41.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:41 smithi193 ceph-mon[32782]: pgmap v7450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:41 smithi196 ceph-mon[32572]: pgmap v7450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:41 smithi110 ceph-mon[28069]: pgmap v7450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13177.046290 secs 2024-04-26T15:27:42.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13177.046290 secs 2024-04-26T15:27:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13177.046290 secs 2024-04-26T15:27:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:43 smithi196 ceph-mon[32572]: pgmap v7451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:43 smithi110 ceph-mon[28069]: pgmap v7451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:43 smithi193 ceph-mon[32782]: pgmap v7451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:45 smithi196 ceph-mon[32572]: pgmap v7452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:45 smithi110 ceph-mon[28069]: pgmap v7452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:45 smithi193 ceph-mon[32782]: pgmap v7452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13182.046425 secs 2024-04-26T15:27:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13182.046425 secs 2024-04-26T15:27:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13182.046425 secs 2024-04-26T15:27:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:48 smithi196 ceph-mon[32572]: pgmap v7453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:48 smithi110 ceph-mon[28069]: pgmap v7453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:48 smithi193 ceph-mon[32782]: pgmap v7453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:49 smithi196 ceph-mon[32572]: pgmap v7454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:49 smithi110 ceph-mon[28069]: pgmap v7454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:49 smithi193 ceph-mon[32782]: pgmap v7454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:51 smithi196 ceph-mon[32572]: pgmap v7455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:51 smithi110 ceph-mon[28069]: pgmap v7455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:51 smithi193 ceph-mon[32782]: pgmap v7455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:27:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13187.046586 secs 2024-04-26T15:27:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13187.046586 secs 2024-04-26T15:27:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13187.046586 secs 2024-04-26T15:27:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:53 smithi196 ceph-mon[32572]: pgmap v7456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:53 smithi110 ceph-mon[28069]: pgmap v7456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:53 smithi193 ceph-mon[32782]: pgmap v7456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:27:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:27:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:27:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:27:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:27:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:27:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:55 smithi196 ceph-mon[32572]: pgmap v7457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:27:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:27:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:27:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:55 smithi110 ceph-mon[28069]: pgmap v7457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:27:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:27:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:27:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:55 smithi193 ceph-mon[32782]: pgmap v7457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:27:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:27:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:27:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:56 smithi110 ceph-mon[28069]: pgmap v7458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:27:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:56 smithi110 ceph-mon[28069]: pgmap v7459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:27:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:27:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:27:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:27:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:56 smithi193 ceph-mon[32782]: pgmap v7458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:27:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:56 smithi193 ceph-mon[32782]: pgmap v7459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:27:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:27:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:27:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:27:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:56 smithi196 ceph-mon[32572]: pgmap v7458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:27:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:56 smithi196 ceph-mon[32572]: pgmap v7459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:27:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:27:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13192.046629 secs 2024-04-26T15:27:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13192.046629 secs 2024-04-26T15:27:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13192.046629 secs 2024-04-26T15:27:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:27:58 smithi110 ceph-mon[28069]: pgmap v7460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:27:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:27:58 smithi193 ceph-mon[32782]: pgmap v7460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:27:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:27:58 smithi196 ceph-mon[32572]: pgmap v7460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:28:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:00 smithi110 ceph-mon[28069]: pgmap v7461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:28:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:00 smithi193 ceph-mon[32782]: pgmap v7461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:28:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:00 smithi196 ceph-mon[32572]: pgmap v7461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:28:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13197.046708 secs 2024-04-26T15:28:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:02 smithi193 ceph-mon[32782]: pgmap v7462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T15:28:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13197.046708 secs 2024-04-26T15:28:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:02 smithi196 ceph-mon[32572]: pgmap v7462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T15:28:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13197.046708 secs 2024-04-26T15:28:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:02 smithi110 ceph-mon[28069]: pgmap v7462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T15:28:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:04 smithi193 ceph-mon[32782]: pgmap v7463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:04 smithi196 ceph-mon[32572]: pgmap v7463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:04 smithi110 ceph-mon[28069]: pgmap v7463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:07.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:06 smithi110 ceph-mon[28069]: pgmap v7464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:28:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:06 smithi193 ceph-mon[32782]: pgmap v7464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:28:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:06 smithi196 ceph-mon[32572]: pgmap v7464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:28:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:07 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13202.046828 secs 2024-04-26T15:28:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:07 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13202.046828 secs 2024-04-26T15:28:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:07 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13202.046828 secs 2024-04-26T15:28:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:08 smithi193 ceph-mon[32782]: pgmap v7465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:08 smithi196 ceph-mon[32572]: pgmap v7465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:08 smithi110 ceph-mon[28069]: pgmap v7465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:10 smithi193 ceph-mon[32782]: pgmap v7466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:10 smithi196 ceph-mon[32572]: pgmap v7466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:10 smithi110 ceph-mon[28069]: pgmap v7466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13207.046945 secs 2024-04-26T15:28:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:12 smithi193 ceph-mon[32782]: pgmap v7467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13207.046945 secs 2024-04-26T15:28:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:12 smithi196 ceph-mon[32572]: pgmap v7467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13207.046945 secs 2024-04-26T15:28:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:12 smithi110 ceph-mon[28069]: pgmap v7467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:14 smithi193 ceph-mon[32782]: pgmap v7468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:14 smithi196 ceph-mon[32572]: pgmap v7468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:14 smithi110 ceph-mon[28069]: pgmap v7468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:16 smithi193 ceph-mon[32782]: pgmap v7469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:16 smithi196 ceph-mon[32572]: pgmap v7469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:16 smithi110 ceph-mon[28069]: pgmap v7469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13212.047051 secs 2024-04-26T15:28:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13212.047051 secs 2024-04-26T15:28:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13212.047051 secs 2024-04-26T15:28:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:18 smithi193 ceph-mon[32782]: pgmap v7470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:18 smithi196 ceph-mon[32572]: pgmap v7470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:18 smithi110 ceph-mon[28069]: pgmap v7470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:20 smithi193 ceph-mon[32782]: pgmap v7471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:20 smithi196 ceph-mon[32572]: pgmap v7471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:20 smithi110 ceph-mon[28069]: pgmap v7471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13217.047172 secs 2024-04-26T15:28:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:22 smithi193 ceph-mon[32782]: pgmap v7472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13217.047172 secs 2024-04-26T15:28:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:22 smithi196 ceph-mon[32572]: pgmap v7472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13217.047172 secs 2024-04-26T15:28:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:22 smithi110 ceph-mon[28069]: pgmap v7472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:24 smithi193 ceph-mon[32782]: pgmap v7473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:24 smithi196 ceph-mon[32572]: pgmap v7473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:24 smithi110 ceph-mon[28069]: pgmap v7473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:26 smithi193 ceph-mon[32782]: pgmap v7474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:26 smithi196 ceph-mon[32572]: pgmap v7474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:26 smithi110 ceph-mon[28069]: pgmap v7474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13222.047307 secs 2024-04-26T15:28:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13222.047307 secs 2024-04-26T15:28:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13222.047307 secs 2024-04-26T15:28:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:28 smithi196 ceph-mon[32572]: pgmap v7475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:28 smithi110 ceph-mon[28069]: pgmap v7475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:28 smithi193 ceph-mon[32782]: pgmap v7475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:30 smithi196 ceph-mon[32572]: pgmap v7476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:30 smithi110 ceph-mon[28069]: pgmap v7476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:30 smithi193 ceph-mon[32782]: pgmap v7476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13227.047431 secs 2024-04-26T15:28:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:32 smithi196 ceph-mon[32572]: pgmap v7477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13227.047431 secs 2024-04-26T15:28:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:32 smithi110 ceph-mon[28069]: pgmap v7477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13227.047431 secs 2024-04-26T15:28:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:32 smithi193 ceph-mon[32782]: pgmap v7477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:34 smithi196 ceph-mon[32572]: pgmap v7478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:34 smithi110 ceph-mon[28069]: pgmap v7478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:34 smithi193 ceph-mon[32782]: pgmap v7478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:36 smithi196 ceph-mon[32572]: pgmap v7479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:36 smithi110 ceph-mon[28069]: pgmap v7479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:36 smithi193 ceph-mon[32782]: pgmap v7479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13232.047542 secs 2024-04-26T15:28:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13232.047542 secs 2024-04-26T15:28:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13232.047542 secs 2024-04-26T15:28:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:38 smithi196 ceph-mon[32572]: pgmap v7480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:38 smithi110 ceph-mon[28069]: pgmap v7480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:38 smithi193 ceph-mon[32782]: pgmap v7480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:40 smithi196 ceph-mon[32572]: pgmap v7481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:40 smithi110 ceph-mon[28069]: pgmap v7481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:40 smithi193 ceph-mon[32782]: pgmap v7481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13237.047659 secs 2024-04-26T15:28:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:42 smithi196 ceph-mon[32572]: pgmap v7482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13237.047659 secs 2024-04-26T15:28:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:42 smithi110 ceph-mon[28069]: pgmap v7482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13237.047659 secs 2024-04-26T15:28:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:42 smithi193 ceph-mon[32782]: pgmap v7482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:44 smithi196 ceph-mon[32572]: pgmap v7483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:44 smithi110 ceph-mon[28069]: pgmap v7483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:44 smithi193 ceph-mon[32782]: pgmap v7483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:46 smithi196 ceph-mon[32572]: pgmap v7484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:46 smithi110 ceph-mon[28069]: pgmap v7484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:46 smithi193 ceph-mon[32782]: pgmap v7484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13242.047770 secs 2024-04-26T15:28:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13242.047770 secs 2024-04-26T15:28:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13242.047770 secs 2024-04-26T15:28:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:48 smithi196 ceph-mon[32572]: pgmap v7485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:48 smithi110 ceph-mon[28069]: pgmap v7485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:48 smithi193 ceph-mon[32782]: pgmap v7485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:50 smithi196 ceph-mon[32572]: pgmap v7486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:50 smithi110 ceph-mon[28069]: pgmap v7486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:50 smithi193 ceph-mon[32782]: pgmap v7486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13247.047886 secs 2024-04-26T15:28:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:52 smithi196 ceph-mon[32572]: pgmap v7487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13247.047886 secs 2024-04-26T15:28:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:52 smithi110 ceph-mon[28069]: pgmap v7487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13247.047886 secs 2024-04-26T15:28:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:52 smithi193 ceph-mon[32782]: pgmap v7487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:54 smithi196 ceph-mon[32572]: pgmap v7488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:54 smithi110 ceph-mon[28069]: pgmap v7488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:54 smithi193 ceph-mon[32782]: pgmap v7488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:56 smithi196 ceph-mon[32572]: pgmap v7489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:28:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:56 smithi110 ceph-mon[28069]: pgmap v7489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:28:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:56 smithi193 ceph-mon[32782]: pgmap v7489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:28:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:28:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:28:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13252.047975 secs 2024-04-26T15:28:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13252.047975 secs 2024-04-26T15:28:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13252.047975 secs 2024-04-26T15:28:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:28:58 smithi196 ceph-mon[32572]: pgmap v7490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:28:58 smithi110 ceph-mon[28069]: pgmap v7490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:28:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:28:58 smithi193 ceph-mon[32782]: pgmap v7490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:01.117 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:00 smithi110 ceph-mon[28069]: pgmap v7491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:00 smithi196 ceph-mon[32572]: pgmap v7491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:00 smithi193 ceph-mon[32782]: pgmap v7491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13257.048112 secs 2024-04-26T15:29:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:02 smithi196 ceph-mon[32572]: pgmap v7492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13257.048112 secs 2024-04-26T15:29:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:02 smithi110 ceph-mon[28069]: pgmap v7492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13257.048112 secs 2024-04-26T15:29:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:02 smithi193 ceph-mon[32782]: pgmap v7492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:29:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:29:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:29:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:29:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:04 smithi193 ceph-mon[32782]: pgmap v7493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:29:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:04 smithi193 ceph-mon[32782]: pgmap v7494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:29:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:29:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:29:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:29:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:29:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:29:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:04 smithi196 ceph-mon[32572]: pgmap v7493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:29:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:04 smithi196 ceph-mon[32572]: pgmap v7494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:29:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:29:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:29:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:29:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:29:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:29:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:04 smithi110 ceph-mon[28069]: pgmap v7493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:29:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:04 smithi110 ceph-mon[28069]: pgmap v7494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:29:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:29:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:06 smithi196 ceph-mon[32572]: pgmap v7495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:29:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:06 smithi110 ceph-mon[28069]: pgmap v7495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:29:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:06 smithi193 ceph-mon[32782]: pgmap v7495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:29:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:29:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:29:06.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:29:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:29:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:29:06.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:29:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:29:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:29:06.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:29:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:29:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:29:06.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:29:07.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:29:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:29:06.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:29:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:08 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13262.048230 secs 2024-04-26T15:29:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:08 smithi196 ceph-mon[32572]: pgmap v7496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 547 B/s rd, 1 op/s 2024-04-26T15:29:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:08 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13262.048230 secs 2024-04-26T15:29:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:08 smithi110 ceph-mon[28069]: pgmap v7496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 547 B/s rd, 1 op/s 2024-04-26T15:29:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:08 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13262.048230 secs 2024-04-26T15:29:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:08 smithi193 ceph-mon[32782]: pgmap v7496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 547 B/s rd, 1 op/s 2024-04-26T15:29:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:10 smithi196 ceph-mon[32572]: pgmap v7497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 328 B/s wr, 2 op/s 2024-04-26T15:29:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:10 smithi110 ceph-mon[28069]: pgmap v7497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 328 B/s wr, 2 op/s 2024-04-26T15:29:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:10 smithi193 ceph-mon[32782]: pgmap v7497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 328 B/s wr, 2 op/s 2024-04-26T15:29:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:12 smithi196 ceph-mon[32572]: pgmap v7498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 328 B/s wr, 2 op/s 2024-04-26T15:29:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:12 smithi110 ceph-mon[28069]: pgmap v7498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 328 B/s wr, 2 op/s 2024-04-26T15:29:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:12 smithi193 ceph-mon[32782]: pgmap v7498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 328 B/s wr, 2 op/s 2024-04-26T15:29:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:13 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13267.048345 secs 2024-04-26T15:29:13.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:13 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13267.048345 secs 2024-04-26T15:29:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:13 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13267.048345 secs 2024-04-26T15:29:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:14 smithi196 ceph-mon[32572]: pgmap v7499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-04-26T15:29:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:14 smithi110 ceph-mon[28069]: pgmap v7499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-04-26T15:29:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:14 smithi193 ceph-mon[32782]: pgmap v7499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 307 B/s wr, 2 op/s 2024-04-26T15:29:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:16 smithi196 ceph-mon[32572]: pgmap v7500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:29:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:16 smithi110 ceph-mon[28069]: pgmap v7500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:29:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:16 smithi193 ceph-mon[32782]: pgmap v7500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:29:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13272.048488 secs 2024-04-26T15:29:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13272.048488 secs 2024-04-26T15:29:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13272.048488 secs 2024-04-26T15:29:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:18 smithi196 ceph-mon[32572]: pgmap v7501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:29:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:18 smithi110 ceph-mon[28069]: pgmap v7501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:29:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:18 smithi193 ceph-mon[32782]: pgmap v7501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:29:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:20 smithi196 ceph-mon[32572]: pgmap v7502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:29:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:20 smithi110 ceph-mon[28069]: pgmap v7502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:29:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:20 smithi193 ceph-mon[32782]: pgmap v7502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:29:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:22 smithi196 ceph-mon[32572]: pgmap v7503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T15:29:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13277.048627 secs 2024-04-26T15:29:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:22 smithi110 ceph-mon[28069]: pgmap v7503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T15:29:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13277.048627 secs 2024-04-26T15:29:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:22 smithi193 ceph-mon[32782]: pgmap v7503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T15:29:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13277.048627 secs 2024-04-26T15:29:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:24 smithi196 ceph-mon[32572]: pgmap v7504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:29:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:24 smithi110 ceph-mon[28069]: pgmap v7504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:29:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:24 smithi193 ceph-mon[32782]: pgmap v7504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:29:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:26 smithi196 ceph-mon[32572]: pgmap v7505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:26 smithi110 ceph-mon[28069]: pgmap v7505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:26 smithi193 ceph-mon[32782]: pgmap v7505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13282.048758 secs 2024-04-26T15:29:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13282.048758 secs 2024-04-26T15:29:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13282.048758 secs 2024-04-26T15:29:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:28 smithi196 ceph-mon[32572]: pgmap v7506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:28 smithi110 ceph-mon[28069]: pgmap v7506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:28 smithi193 ceph-mon[32782]: pgmap v7506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:30 smithi196 ceph-mon[32572]: pgmap v7507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:30 smithi110 ceph-mon[28069]: pgmap v7507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:30 smithi193 ceph-mon[32782]: pgmap v7507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:32 smithi196 ceph-mon[32572]: pgmap v7508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13287.048885 secs 2024-04-26T15:29:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:32 smithi110 ceph-mon[28069]: pgmap v7508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13287.048885 secs 2024-04-26T15:29:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:32 smithi193 ceph-mon[32782]: pgmap v7508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13287.048885 secs 2024-04-26T15:29:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:34 smithi110 ceph-mon[28069]: pgmap v7509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:34 smithi193 ceph-mon[32782]: pgmap v7509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:34 smithi196 ceph-mon[32572]: pgmap v7509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:36 smithi110 ceph-mon[28069]: pgmap v7510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:36 smithi193 ceph-mon[32782]: pgmap v7510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:36 smithi196 ceph-mon[32572]: pgmap v7510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13292.048950 secs 2024-04-26T15:29:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13292.048950 secs 2024-04-26T15:29:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13292.048950 secs 2024-04-26T15:29:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:38 smithi110 ceph-mon[28069]: pgmap v7511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:38 smithi193 ceph-mon[32782]: pgmap v7511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:38 smithi196 ceph-mon[32572]: pgmap v7511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:40 smithi110 ceph-mon[28069]: pgmap v7512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:40 smithi193 ceph-mon[32782]: pgmap v7512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:40 smithi196 ceph-mon[32572]: pgmap v7512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:42 smithi110 ceph-mon[28069]: pgmap v7513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13297.049103 secs 2024-04-26T15:29:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:42 smithi193 ceph-mon[32782]: pgmap v7513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13297.049103 secs 2024-04-26T15:29:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:42 smithi196 ceph-mon[32572]: pgmap v7513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13297.049103 secs 2024-04-26T15:29:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:44 smithi193 ceph-mon[32782]: pgmap v7514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:44 smithi196 ceph-mon[32572]: pgmap v7514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:44 smithi110 ceph-mon[28069]: pgmap v7514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:46 smithi193 ceph-mon[32782]: pgmap v7515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:46 smithi196 ceph-mon[32572]: pgmap v7515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:46 smithi110 ceph-mon[28069]: pgmap v7515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13302.049246 secs 2024-04-26T15:29:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13302.049246 secs 2024-04-26T15:29:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13302.049246 secs 2024-04-26T15:29:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:48 smithi193 ceph-mon[32782]: pgmap v7516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:48 smithi196 ceph-mon[32572]: pgmap v7516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:48 smithi110 ceph-mon[28069]: pgmap v7516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:50 smithi193 ceph-mon[32782]: pgmap v7517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:50 smithi196 ceph-mon[32572]: pgmap v7517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:50 smithi110 ceph-mon[28069]: pgmap v7517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:52 smithi193 ceph-mon[32782]: pgmap v7518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13307.049367 secs 2024-04-26T15:29:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:52 smithi196 ceph-mon[32572]: pgmap v7518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13307.049367 secs 2024-04-26T15:29:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:52 smithi110 ceph-mon[28069]: pgmap v7518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13307.049367 secs 2024-04-26T15:29:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:54 smithi193 ceph-mon[32782]: pgmap v7519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:54 smithi196 ceph-mon[32572]: pgmap v7519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:54 smithi110 ceph-mon[28069]: pgmap v7519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:29:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:56 smithi193 ceph-mon[32782]: pgmap v7520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:56 smithi196 ceph-mon[32572]: pgmap v7520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:56 smithi110 ceph-mon[28069]: pgmap v7520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13312.049520 secs 2024-04-26T15:29:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13312.049520 secs 2024-04-26T15:29:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13312.049520 secs 2024-04-26T15:29:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:29:58 smithi193 ceph-mon[32782]: pgmap v7521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:29:58 smithi196 ceph-mon[32572]: pgmap v7521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:29:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:29:58 smithi110 ceph-mon[28069]: pgmap v7521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:00 smithi193 ceph-mon[32782]: pgmap v7522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:30:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:00 smithi196 ceph-mon[32572]: pgmap v7522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:30:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:00 smithi110 ceph-mon[28069]: pgmap v7522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:30:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:02 smithi193 ceph-mon[32782]: pgmap v7523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13317.049644 secs 2024-04-26T15:30:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:02 smithi196 ceph-mon[32572]: pgmap v7523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13317.049644 secs 2024-04-26T15:30:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:02 smithi110 ceph-mon[28069]: pgmap v7523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13317.049644 secs 2024-04-26T15:30:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:04 smithi193 ceph-mon[32782]: pgmap v7524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:30:04.718 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:04 smithi110 ceph-mon[28069]: pgmap v7524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:04.718 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:30:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:04 smithi196 ceph-mon[32572]: pgmap v7524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: pgmap v7525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: pgmap v7525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: pgmap v7525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:30:07.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:30:07.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: 12 slow requests, 1 included below; oldest blocked for > 13322.049798 secs 2024-04-26T15:30:07.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: slow request 5762.443368 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:30:07.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:30:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:30:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: 12 slow requests, 1 included below; oldest blocked for > 13322.049798 secs 2024-04-26T15:30:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: slow request 5762.443368 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:30:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: 12 slow requests, 1 included below; oldest blocked for > 13322.049798 secs 2024-04-26T15:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: slow request 5762.443368 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:08 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:30:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:08 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:30:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:08 smithi196 ceph-mon[32572]: pgmap v7526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:08 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:30:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:08 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:30:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:08 smithi110 ceph-mon[28069]: pgmap v7526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:08 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:30:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:08 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:30:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:08 smithi193 ceph-mon[32782]: pgmap v7526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:30:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:30:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:30:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:30:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:10 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:30:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:10 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:30:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:10 smithi196 ceph-mon[32572]: pgmap v7527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:30:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:10 smithi196 ceph-mon[32572]: pgmap v7528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:10 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:30:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:10 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:30:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:10 smithi110 ceph-mon[28069]: pgmap v7527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:30:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:10 smithi110 ceph-mon[28069]: pgmap v7528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:10 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:30:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:10 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:30:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:10 smithi193 ceph-mon[32782]: pgmap v7527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:30:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:10 smithi193 ceph-mon[32782]: pgmap v7528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:11 smithi196 ceph-mon[32572]: pgmap v7529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:11 smithi110 ceph-mon[28069]: pgmap v7529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:11 smithi193 ceph-mon[32782]: pgmap v7529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13327.049929 secs 2024-04-26T15:30:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13327.049929 secs 2024-04-26T15:30:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13327.049929 secs 2024-04-26T15:30:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:13 smithi196 ceph-mon[32572]: pgmap v7530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:13 smithi110 ceph-mon[28069]: pgmap v7530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:13 smithi193 ceph-mon[32782]: pgmap v7530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:15 smithi193 ceph-mon[32782]: pgmap v7531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:15 smithi196 ceph-mon[32572]: pgmap v7531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:15 smithi110 ceph-mon[28069]: pgmap v7531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13332.050052 secs 2024-04-26T15:30:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:17 smithi193 ceph-mon[32782]: pgmap v7532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13332.050052 secs 2024-04-26T15:30:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:17 smithi196 ceph-mon[32572]: pgmap v7532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13332.050052 secs 2024-04-26T15:30:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:17 smithi110 ceph-mon[28069]: pgmap v7532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:30:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:30:18.559+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:30:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:30:18.559+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T15:30:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:30:18.559+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 105 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T15:30:18.559 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:30:18.559+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 105 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:30:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:19 smithi193 ceph-mon[32782]: pgmap v7533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:30:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:19 smithi196 ceph-mon[32572]: pgmap v7533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:30:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:19 smithi110 ceph-mon[28069]: pgmap v7533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:30:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:21 smithi193 ceph-mon[32782]: pgmap v7534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:21 smithi196 ceph-mon[32572]: pgmap v7534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:21 smithi110 ceph-mon[28069]: pgmap v7534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13337.050174 secs 2024-04-26T15:30:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13337.050174 secs 2024-04-26T15:30:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13337.050174 secs 2024-04-26T15:30:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:23 smithi193 ceph-mon[32782]: pgmap v7535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:23 smithi196 ceph-mon[32572]: pgmap v7535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:23 smithi110 ceph-mon[28069]: pgmap v7535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:25 smithi193 ceph-mon[32782]: pgmap v7536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:25 smithi196 ceph-mon[32572]: pgmap v7536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:25 smithi110 ceph-mon[28069]: pgmap v7536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13342.050297 secs 2024-04-26T15:30:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:27 smithi193 ceph-mon[32782]: pgmap v7537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13342.050297 secs 2024-04-26T15:30:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:27 smithi196 ceph-mon[32572]: pgmap v7537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13342.050297 secs 2024-04-26T15:30:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:27 smithi110 ceph-mon[28069]: pgmap v7537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:29 smithi193 ceph-mon[32782]: pgmap v7538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:29 smithi196 ceph-mon[32572]: pgmap v7538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:29 smithi110 ceph-mon[28069]: pgmap v7538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:31 smithi193 ceph-mon[32782]: pgmap v7539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:31 smithi196 ceph-mon[32572]: pgmap v7539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:31 smithi110 ceph-mon[28069]: pgmap v7539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13347.050439 secs 2024-04-26T15:30:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13347.050439 secs 2024-04-26T15:30:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13347.050439 secs 2024-04-26T15:30:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:33 smithi193 ceph-mon[32782]: pgmap v7540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:33 smithi196 ceph-mon[32572]: pgmap v7540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:33 smithi110 ceph-mon[28069]: pgmap v7540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:35 smithi196 ceph-mon[32572]: pgmap v7541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:35 smithi110 ceph-mon[28069]: pgmap v7541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:35 smithi193 ceph-mon[32782]: pgmap v7541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13352.050581 secs 2024-04-26T15:30:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:37 smithi196 ceph-mon[32572]: pgmap v7542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13352.050581 secs 2024-04-26T15:30:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:37 smithi110 ceph-mon[28069]: pgmap v7542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13352.050581 secs 2024-04-26T15:30:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:37 smithi193 ceph-mon[32782]: pgmap v7542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:39 smithi196 ceph-mon[32572]: pgmap v7543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:39 smithi110 ceph-mon[28069]: pgmap v7543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:39 smithi193 ceph-mon[32782]: pgmap v7543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:41 smithi196 ceph-mon[32572]: pgmap v7544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:41 smithi110 ceph-mon[28069]: pgmap v7544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:41 smithi193 ceph-mon[32782]: pgmap v7544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13357.050684 secs 2024-04-26T15:30:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13357.050684 secs 2024-04-26T15:30:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13357.050684 secs 2024-04-26T15:30:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:43 smithi196 ceph-mon[32572]: pgmap v7545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:43 smithi110 ceph-mon[28069]: pgmap v7545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:43 smithi193 ceph-mon[32782]: pgmap v7545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:46.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:45 smithi193 ceph-mon[32782]: pgmap v7546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:45 smithi196 ceph-mon[32572]: pgmap v7546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:45 smithi110 ceph-mon[28069]: pgmap v7546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13362.050805 secs 2024-04-26T15:30:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:47 smithi196 ceph-mon[32572]: pgmap v7547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13362.050805 secs 2024-04-26T15:30:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:47 smithi110 ceph-mon[28069]: pgmap v7547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13362.050805 secs 2024-04-26T15:30:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:47 smithi193 ceph-mon[32782]: pgmap v7547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:49 smithi196 ceph-mon[32572]: pgmap v7548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:49 smithi110 ceph-mon[28069]: pgmap v7548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:49 smithi193 ceph-mon[32782]: pgmap v7548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:51 smithi196 ceph-mon[32572]: pgmap v7549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:51 smithi110 ceph-mon[28069]: pgmap v7549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:51 smithi193 ceph-mon[32782]: pgmap v7549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13367.050929 secs 2024-04-26T15:30:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13367.050929 secs 2024-04-26T15:30:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13367.050929 secs 2024-04-26T15:30:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:53 smithi196 ceph-mon[32572]: pgmap v7550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:53 smithi110 ceph-mon[28069]: pgmap v7550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:53 smithi193 ceph-mon[32782]: pgmap v7550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:30:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:55 smithi196 ceph-mon[32572]: pgmap v7551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:55 smithi110 ceph-mon[28069]: pgmap v7551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:55 smithi193 ceph-mon[32782]: pgmap v7551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13372.051069 secs 2024-04-26T15:30:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:57 smithi196 ceph-mon[32572]: pgmap v7552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13372.051069 secs 2024-04-26T15:30:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:57 smithi110 ceph-mon[28069]: pgmap v7552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:30:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13372.051069 secs 2024-04-26T15:30:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:57 smithi193 ceph-mon[32782]: pgmap v7552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:30:59 smithi196 ceph-mon[32572]: pgmap v7553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:30:59 smithi110 ceph-mon[28069]: pgmap v7553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:30:59 smithi193 ceph-mon[32782]: pgmap v7553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:01 smithi196 ceph-mon[32572]: pgmap v7554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:01 smithi110 ceph-mon[28069]: pgmap v7554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:01 smithi193 ceph-mon[32782]: pgmap v7554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13377.051197 secs 2024-04-26T15:31:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13377.051197 secs 2024-04-26T15:31:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13377.051197 secs 2024-04-26T15:31:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:31:03.567+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T15:31:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:31:03.567+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:31:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:31:03.568+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 106 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T15:31:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:31:03.568+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 106 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:31:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:03 smithi196 ceph-mon[32572]: pgmap v7555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:03 smithi110 ceph-mon[28069]: pgmap v7555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:03 smithi193 ceph-mon[32782]: pgmap v7555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:05 smithi196 ceph-mon[32572]: pgmap v7556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:05 smithi110 ceph-mon[28069]: pgmap v7556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:05 smithi193 ceph-mon[32782]: pgmap v7556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:07 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13382.051316 secs 2024-04-26T15:31:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:07 smithi196 ceph-mon[32572]: pgmap v7557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:07 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13382.051316 secs 2024-04-26T15:31:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:07 smithi110 ceph-mon[28069]: pgmap v7557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:07 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13382.051316 secs 2024-04-26T15:31:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:07 smithi193 ceph-mon[32782]: pgmap v7557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:09 smithi196 ceph-mon[32572]: pgmap v7558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:31:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:09 smithi110 ceph-mon[28069]: pgmap v7558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:31:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:09 smithi193 ceph-mon[32782]: pgmap v7558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:31:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:31:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:31:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:11 smithi110 ceph-mon[28069]: pgmap v7559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:31:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:11 smithi110 ceph-mon[28069]: pgmap v7560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:31:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:31:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:31:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:11 smithi193 ceph-mon[32782]: pgmap v7559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:31:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:11 smithi193 ceph-mon[32782]: pgmap v7560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:31:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:31:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:31:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:11 smithi196 ceph-mon[32572]: pgmap v7559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:31:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:11 smithi196 ceph-mon[32572]: pgmap v7560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:31:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:12 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13387.051460 secs 2024-04-26T15:31:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:12 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13387.051460 secs 2024-04-26T15:31:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:12 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13387.051460 secs 2024-04-26T15:31:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:13 smithi110 ceph-mon[28069]: pgmap v7561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:31:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:13 smithi193 ceph-mon[32782]: pgmap v7561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:31:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:13 smithi196 ceph-mon[32572]: pgmap v7561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:31:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:15 smithi193 ceph-mon[32782]: pgmap v7562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:15 smithi196 ceph-mon[32572]: pgmap v7562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:15 smithi110 ceph-mon[28069]: pgmap v7562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:17.693 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:17 smithi193 ceph-mon[32782]: pgmap v7563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:17.693 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:17 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13392.051601 secs 2024-04-26T15:31:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:17 smithi196 ceph-mon[32572]: pgmap v7563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:17 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13392.051601 secs 2024-04-26T15:31:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:17 smithi110 ceph-mon[28069]: pgmap v7563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:17 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13392.051601 secs 2024-04-26T15:31:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:19 smithi196 ceph-mon[32572]: pgmap v7564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:19 smithi110 ceph-mon[28069]: pgmap v7564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:19 smithi193 ceph-mon[32782]: pgmap v7564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:31:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:21 smithi196 ceph-mon[32572]: pgmap v7565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:31:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:21 smithi110 ceph-mon[28069]: pgmap v7565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:31:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:21 smithi193 ceph-mon[32782]: pgmap v7565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:31:22.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:22 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13397.051744 secs 2024-04-26T15:31:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:22 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13397.051744 secs 2024-04-26T15:31:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:22 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13397.051744 secs 2024-04-26T15:31:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:23 smithi196 ceph-mon[32572]: pgmap v7566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:23 smithi110 ceph-mon[28069]: pgmap v7566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:23 smithi193 ceph-mon[32782]: pgmap v7566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:25 smithi196 ceph-mon[32572]: pgmap v7567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:25 smithi110 ceph-mon[28069]: pgmap v7567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:25 smithi193 ceph-mon[32782]: pgmap v7567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:26 smithi196 ceph-mon[32572]: pgmap v7568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:26 smithi110 ceph-mon[28069]: pgmap v7568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:26 smithi193 ceph-mon[32782]: pgmap v7568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:27 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13402.051865 secs 2024-04-26T15:31:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:27 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13402.051865 secs 2024-04-26T15:31:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:27 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13402.051865 secs 2024-04-26T15:31:28.683 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:28 smithi193 ceph-mon[32782]: pgmap v7569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:28 smithi196 ceph-mon[32572]: pgmap v7569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:28 smithi110 ceph-mon[28069]: pgmap v7569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:31 smithi196 ceph-mon[32572]: pgmap v7570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:31 smithi110 ceph-mon[28069]: pgmap v7570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:31 smithi193 ceph-mon[32782]: pgmap v7570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:32 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13407.051986 secs 2024-04-26T15:31:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:32 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13407.051986 secs 2024-04-26T15:31:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:32 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13407.051986 secs 2024-04-26T15:31:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:33 smithi196 ceph-mon[32572]: pgmap v7571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:33 smithi110 ceph-mon[28069]: pgmap v7571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:33 smithi193 ceph-mon[32782]: pgmap v7571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:35 smithi196 ceph-mon[32572]: pgmap v7572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:35 smithi110 ceph-mon[28069]: pgmap v7572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:35 smithi193 ceph-mon[32782]: pgmap v7572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:37 smithi196 ceph-mon[32572]: pgmap v7573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:37 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13412.052112 secs 2024-04-26T15:31:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:37 smithi110 ceph-mon[28069]: pgmap v7573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:37 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13412.052112 secs 2024-04-26T15:31:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:37 smithi193 ceph-mon[32782]: pgmap v7573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:37 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13412.052112 secs 2024-04-26T15:31:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:39 smithi196 ceph-mon[32572]: pgmap v7574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:39 smithi110 ceph-mon[28069]: pgmap v7574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:39 smithi193 ceph-mon[32782]: pgmap v7574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:40 smithi196 ceph-mon[32572]: pgmap v7575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:40 smithi110 ceph-mon[28069]: pgmap v7575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:40 smithi193 ceph-mon[32782]: pgmap v7575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:42 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13417.052233 secs 2024-04-26T15:31:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:42 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13417.052233 secs 2024-04-26T15:31:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:42 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13417.052233 secs 2024-04-26T15:31:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:43 smithi110 ceph-mon[28069]: pgmap v7576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:43 smithi193 ceph-mon[32782]: pgmap v7576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:43 smithi196 ceph-mon[32572]: pgmap v7576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:45 smithi196 ceph-mon[32572]: pgmap v7577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:45 smithi110 ceph-mon[28069]: pgmap v7577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:45 smithi193 ceph-mon[32782]: pgmap v7577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:47.672 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:47 smithi193 ceph-mon[32782]: pgmap v7578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:47.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:47 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13422.052358 secs 2024-04-26T15:31:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:47 smithi196 ceph-mon[32572]: pgmap v7578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:47 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13422.052358 secs 2024-04-26T15:31:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:47 smithi110 ceph-mon[28069]: pgmap v7578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:47 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13422.052358 secs 2024-04-26T15:31:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:49 smithi196 ceph-mon[32572]: pgmap v7579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:49 smithi110 ceph-mon[28069]: pgmap v7579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:49 smithi193 ceph-mon[32782]: pgmap v7579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:51 smithi196 ceph-mon[32572]: pgmap v7580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:51 smithi110 ceph-mon[28069]: pgmap v7580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:51 smithi193 ceph-mon[32782]: pgmap v7580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:52 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13427.052479 secs 2024-04-26T15:31:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:52 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13427.052479 secs 2024-04-26T15:31:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:52 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13427.052479 secs 2024-04-26T15:31:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:53 smithi196 ceph-mon[32572]: pgmap v7581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:53 smithi110 ceph-mon[28069]: pgmap v7581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:53 smithi193 ceph-mon[32782]: pgmap v7581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:54 smithi196 ceph-mon[32572]: pgmap v7582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:54 smithi110 ceph-mon[28069]: pgmap v7582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:54 smithi193 ceph-mon[32782]: pgmap v7582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:57 smithi196 ceph-mon[32572]: pgmap v7583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:57 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13432.052604 secs 2024-04-26T15:31:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:57 smithi110 ceph-mon[28069]: pgmap v7583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:57 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13432.052604 secs 2024-04-26T15:31:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:57 smithi193 ceph-mon[32782]: pgmap v7583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:31:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:57 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13432.052604 secs 2024-04-26T15:31:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:31:59 smithi196 ceph-mon[32572]: pgmap v7584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:31:59 smithi110 ceph-mon[28069]: pgmap v7584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:31:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:31:59 smithi193 ceph-mon[32782]: pgmap v7584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:01 smithi196 ceph-mon[32572]: pgmap v7585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:01 smithi110 ceph-mon[28069]: pgmap v7585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:01 smithi193 ceph-mon[32782]: pgmap v7585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:02 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13437.052728 secs 2024-04-26T15:32:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:02 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13437.052728 secs 2024-04-26T15:32:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:02 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13437.052728 secs 2024-04-26T15:32:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:03 smithi196 ceph-mon[32572]: pgmap v7586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:03 smithi110 ceph-mon[28069]: pgmap v7586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:03 smithi193 ceph-mon[32782]: pgmap v7586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:05 smithi196 ceph-mon[32572]: pgmap v7587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:05 smithi110 ceph-mon[28069]: pgmap v7587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:05 smithi193 ceph-mon[32782]: pgmap v7587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:06 smithi196 ceph-mon[32572]: pgmap v7588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:06 smithi110 ceph-mon[28069]: pgmap v7588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:06 smithi193 ceph-mon[32782]: pgmap v7588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:07 smithi196 ceph-mon[32572]: 12 slow requests, 0 included below; oldest blocked for > 13442.052848 secs 2024-04-26T15:32:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:07 smithi110 ceph-mon[28069]: 12 slow requests, 0 included below; oldest blocked for > 13442.052848 secs 2024-04-26T15:32:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:07 smithi193 ceph-mon[32782]: 12 slow requests, 0 included below; oldest blocked for > 13442.052848 secs 2024-04-26T15:32:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:08 smithi196 ceph-mon[32572]: pgmap v7589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:08 smithi110 ceph-mon[28069]: pgmap v7589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:08 smithi193 ceph-mon[32782]: pgmap v7589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:11 smithi196 ceph-mon[32572]: pgmap v7590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:32:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:11 smithi110 ceph-mon[28069]: pgmap v7590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:32:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:11 smithi193 ceph-mon[32782]: pgmap v7590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:32:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:12 smithi196 ceph-mon[32572]: 13 slow requests, 1 included below; oldest blocked for > 13447.052975 secs 2024-04-26T15:32:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:12 smithi196 ceph-mon[32572]: slow request 184.677859 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:32:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:32:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:32:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:32:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:12 smithi110 ceph-mon[28069]: 13 slow requests, 1 included below; oldest blocked for > 13447.052975 secs 2024-04-26T15:32:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:12 smithi110 ceph-mon[28069]: slow request 184.677859 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:32:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:32:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:32:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:32:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:12 smithi193 ceph-mon[32782]: 13 slow requests, 1 included below; oldest blocked for > 13447.052975 secs 2024-04-26T15:32:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:12 smithi193 ceph-mon[32782]: slow request 184.677859 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:32:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:32:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:32:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:32:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:13 smithi196 ceph-mon[32572]: pgmap v7591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:32:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:13 smithi196 ceph-mon[32572]: pgmap v7592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:32:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:13 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:32:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:13 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:32:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:13 smithi110 ceph-mon[28069]: pgmap v7591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:32:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:13 smithi110 ceph-mon[28069]: pgmap v7592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:32:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:13 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:32:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:13 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:32:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:13 smithi193 ceph-mon[32782]: pgmap v7591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:32:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:13 smithi193 ceph-mon[32782]: pgmap v7592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:32:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:13 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:32:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:13 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:32:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:15 smithi196 ceph-mon[32572]: pgmap v7593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:15 smithi110 ceph-mon[28069]: pgmap v7593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:15 smithi193 ceph-mon[32782]: pgmap v7593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:16 smithi196 ceph-mon[32572]: pgmap v7594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:16 smithi110 ceph-mon[28069]: pgmap v7594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:16 smithi193 ceph-mon[32782]: pgmap v7594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:17 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13452.053116 secs 2024-04-26T15:32:17.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:17 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13452.053116 secs 2024-04-26T15:32:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:17 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13452.053116 secs 2024-04-26T15:32:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:18 smithi196 ceph-mon[32572]: pgmap v7595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:18 smithi110 ceph-mon[28069]: pgmap v7595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:18 smithi193 ceph-mon[32782]: pgmap v7595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:20 smithi196 ceph-mon[32572]: pgmap v7596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:20 smithi110 ceph-mon[28069]: pgmap v7596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:20 smithi193 ceph-mon[32782]: pgmap v7596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:32:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:22 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13457.053247 secs 2024-04-26T15:32:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:22 smithi196 ceph-mon[32572]: pgmap v7597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:32:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:22 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13457.053247 secs 2024-04-26T15:32:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:22 smithi110 ceph-mon[28069]: pgmap v7597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:32:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:22 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13457.053247 secs 2024-04-26T15:32:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:22 smithi193 ceph-mon[32782]: pgmap v7597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:32:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:24 smithi196 ceph-mon[32572]: pgmap v7598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:24 smithi110 ceph-mon[28069]: pgmap v7598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:24 smithi193 ceph-mon[32782]: pgmap v7598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:26 smithi196 ceph-mon[32572]: pgmap v7599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:26 smithi110 ceph-mon[28069]: pgmap v7599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:26 smithi193 ceph-mon[32782]: pgmap v7599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:27 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13462.053386 secs 2024-04-26T15:32:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:27 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13462.053386 secs 2024-04-26T15:32:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:27 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13462.053386 secs 2024-04-26T15:32:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:28 smithi196 ceph-mon[32572]: pgmap v7600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:28 smithi110 ceph-mon[28069]: pgmap v7600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:28 smithi193 ceph-mon[32782]: pgmap v7600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:30 smithi196 ceph-mon[32572]: pgmap v7601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:30 smithi110 ceph-mon[28069]: pgmap v7601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:30 smithi193 ceph-mon[32782]: pgmap v7601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:32 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13467.053511 secs 2024-04-26T15:32:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:32 smithi196 ceph-mon[32572]: pgmap v7602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:32 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13467.053511 secs 2024-04-26T15:32:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:32 smithi110 ceph-mon[28069]: pgmap v7602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:32 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13467.053511 secs 2024-04-26T15:32:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:32 smithi193 ceph-mon[32782]: pgmap v7602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:34 smithi196 ceph-mon[32572]: pgmap v7603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:34 smithi110 ceph-mon[28069]: pgmap v7603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:34 smithi193 ceph-mon[32782]: pgmap v7603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:36 smithi196 ceph-mon[32572]: pgmap v7604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:36 smithi110 ceph-mon[28069]: pgmap v7604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:36 smithi193 ceph-mon[32782]: pgmap v7604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:37 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13472.053637 secs 2024-04-26T15:32:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:37 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13472.053637 secs 2024-04-26T15:32:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:37 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13472.053637 secs 2024-04-26T15:32:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:38 smithi196 ceph-mon[32572]: pgmap v7605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:38 smithi110 ceph-mon[28069]: pgmap v7605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:38 smithi193 ceph-mon[32782]: pgmap v7605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:40 smithi196 ceph-mon[32572]: pgmap v7606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:40 smithi110 ceph-mon[28069]: pgmap v7606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:40 smithi193 ceph-mon[32782]: pgmap v7606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:42 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13477.053748 secs 2024-04-26T15:32:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:42 smithi196 ceph-mon[32572]: pgmap v7607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:42 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13477.053748 secs 2024-04-26T15:32:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:42 smithi110 ceph-mon[28069]: pgmap v7607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:42 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13477.053748 secs 2024-04-26T15:32:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:42 smithi193 ceph-mon[32782]: pgmap v7607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:44 smithi196 ceph-mon[32572]: pgmap v7608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:44 smithi110 ceph-mon[28069]: pgmap v7608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:44 smithi193 ceph-mon[32782]: pgmap v7608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:46 smithi196 ceph-mon[32572]: pgmap v7609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:46 smithi110 ceph-mon[28069]: pgmap v7609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:46 smithi193 ceph-mon[32782]: pgmap v7609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:47 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13482.053808 secs 2024-04-26T15:32:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:47 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13482.053808 secs 2024-04-26T15:32:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:47 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13482.053808 secs 2024-04-26T15:32:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:48 smithi196 ceph-mon[32572]: pgmap v7610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:48 smithi110 ceph-mon[28069]: pgmap v7610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:48 smithi193 ceph-mon[32782]: pgmap v7610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:50 smithi196 ceph-mon[32572]: pgmap v7611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:50 smithi110 ceph-mon[28069]: pgmap v7611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:50 smithi193 ceph-mon[32782]: pgmap v7611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:52 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13487.053927 secs 2024-04-26T15:32:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:52 smithi196 ceph-mon[32572]: pgmap v7612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:52 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13487.053927 secs 2024-04-26T15:32:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:52 smithi110 ceph-mon[28069]: pgmap v7612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:52 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13487.053927 secs 2024-04-26T15:32:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:52 smithi193 ceph-mon[32782]: pgmap v7612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:54 smithi196 ceph-mon[32572]: pgmap v7613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:54 smithi110 ceph-mon[28069]: pgmap v7613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:54 smithi193 ceph-mon[32782]: pgmap v7613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:56 smithi196 ceph-mon[32572]: pgmap v7614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:56 smithi110 ceph-mon[28069]: pgmap v7614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:56 smithi193 ceph-mon[32782]: pgmap v7614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:32:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:58 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13492.054020 secs 2024-04-26T15:32:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:58 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13492.054020 secs 2024-04-26T15:32:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:58 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13492.054020 secs 2024-04-26T15:32:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:32:59 smithi110 ceph-mon[28069]: pgmap v7615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:32:59 smithi193 ceph-mon[32782]: pgmap v7615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:32:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:32:59 smithi196 ceph-mon[32572]: pgmap v7615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:01 smithi110 ceph-mon[28069]: pgmap v7616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:01 smithi193 ceph-mon[32782]: pgmap v7616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:01.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:01 smithi196 ceph-mon[32572]: pgmap v7616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:03 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13497.054179 secs 2024-04-26T15:33:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:03 smithi110 ceph-mon[28069]: pgmap v7617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:03 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13497.054179 secs 2024-04-26T15:33:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:03 smithi193 ceph-mon[32782]: pgmap v7617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:03 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13497.054179 secs 2024-04-26T15:33:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:03 smithi196 ceph-mon[32572]: pgmap v7617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:05 smithi110 ceph-mon[28069]: pgmap v7618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:05 smithi193 ceph-mon[32782]: pgmap v7618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:05 smithi196 ceph-mon[32572]: pgmap v7618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:07 smithi110 ceph-mon[28069]: pgmap v7619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:07 smithi193 ceph-mon[32782]: pgmap v7619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:07 smithi196 ceph-mon[32572]: pgmap v7619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:08 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13502.054299 secs 2024-04-26T15:33:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:08 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13502.054299 secs 2024-04-26T15:33:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:08 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13502.054299 secs 2024-04-26T15:33:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:09 smithi110 ceph-mon[28069]: pgmap v7620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:09 smithi193 ceph-mon[32782]: pgmap v7620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:09 smithi196 ceph-mon[32572]: pgmap v7620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:11 smithi193 ceph-mon[32782]: pgmap v7621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:11 smithi196 ceph-mon[32572]: pgmap v7621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:11 smithi110 ceph-mon[28069]: pgmap v7621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:13 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13507.054421 secs 2024-04-26T15:33:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:13 smithi193 ceph-mon[32782]: pgmap v7622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:33:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:13 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13507.054421 secs 2024-04-26T15:33:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:13 smithi196 ceph-mon[32572]: pgmap v7622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:33:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:13 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13507.054421 secs 2024-04-26T15:33:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:13 smithi110 ceph-mon[28069]: pgmap v7622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:33:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:33:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:15 smithi196 ceph-mon[32572]: pgmap v7623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:15 smithi196 ceph-mon[32572]: pgmap v7624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s rd, 1 op/s 2024-04-26T15:33:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:15 smithi196 ceph-mon[32572]: pgmap v7625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:15 smithi110 ceph-mon[28069]: pgmap v7623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:15 smithi110 ceph-mon[28069]: pgmap v7624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s rd, 1 op/s 2024-04-26T15:33:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:15 smithi110 ceph-mon[28069]: pgmap v7625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:15 smithi193 ceph-mon[32782]: pgmap v7623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:15 smithi193 ceph-mon[32782]: pgmap v7624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s rd, 1 op/s 2024-04-26T15:33:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:15 smithi193 ceph-mon[32782]: pgmap v7625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.410+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T15:33:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.410+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T15:33:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.410+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2614004010 tx=0x7f2614037070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T15:33:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.410+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2614004010 tx=0x7f2614037070 comp rx=0 tx=0).stop 2024-04-26T15:33:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.410+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T15:33:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.410+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T15:33:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.410+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T15:33:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.410+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T15:33:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.411+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T15:33:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.412+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614014070 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T15:33:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.415+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T15:33:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.415+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T15:33:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.415+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T15:33:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.415+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T15:33:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.415+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T15:33:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.416+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T15:33:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:16.416+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T15:33:17.672 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:17 smithi193 ceph-mon[32782]: pgmap v7626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T15:33:17.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:17 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13512.054556 secs 2024-04-26T15:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:17 smithi196 ceph-mon[32572]: pgmap v7626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T15:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:17 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13512.054556 secs 2024-04-26T15:33:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:17 smithi110 ceph-mon[28069]: pgmap v7626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T15:33:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:17 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13512.054556 secs 2024-04-26T15:33:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:18.586+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T15:33:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:18.587+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:33:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:18.587+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 107 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:33:18.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:33:18.587+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 107 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T15:33:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:19 smithi196 ceph-mon[32572]: pgmap v7627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:19 smithi110 ceph-mon[28069]: pgmap v7627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:19 smithi193 ceph-mon[32782]: pgmap v7627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:21 smithi196 ceph-mon[32572]: pgmap v7628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:21 smithi110 ceph-mon[28069]: pgmap v7628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:21 smithi193 ceph-mon[32782]: pgmap v7628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:22 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13517.054668 secs 2024-04-26T15:33:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:22 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13517.054668 secs 2024-04-26T15:33:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:22 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13517.054668 secs 2024-04-26T15:33:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:23 smithi196 ceph-mon[32572]: pgmap v7629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T15:33:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:23 smithi110 ceph-mon[28069]: pgmap v7629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T15:33:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:23 smithi193 ceph-mon[32782]: pgmap v7629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T15:33:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:24 smithi196 ceph-mon[32572]: pgmap v7630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:33:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:24 smithi110 ceph-mon[28069]: pgmap v7630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:33:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:24 smithi193 ceph-mon[32782]: pgmap v7630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:33:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:27 smithi196 ceph-mon[32572]: pgmap v7631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:27 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13522.054786 secs 2024-04-26T15:33:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:27 smithi110 ceph-mon[28069]: pgmap v7631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:27 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13522.054786 secs 2024-04-26T15:33:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:27 smithi193 ceph-mon[32782]: pgmap v7631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:27 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13522.054786 secs 2024-04-26T15:33:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:29 smithi196 ceph-mon[32572]: pgmap v7632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:29 smithi110 ceph-mon[28069]: pgmap v7632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:29 smithi193 ceph-mon[32782]: pgmap v7632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:31 smithi110 ceph-mon[28069]: pgmap v7633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:31 smithi193 ceph-mon[32782]: pgmap v7633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:31 smithi196 ceph-mon[32572]: pgmap v7633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:32 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13527.054915 secs 2024-04-26T15:33:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:32 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13527.054915 secs 2024-04-26T15:33:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:32 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13527.054915 secs 2024-04-26T15:33:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:33 smithi110 ceph-mon[28069]: pgmap v7634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:33 smithi193 ceph-mon[32782]: pgmap v7634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:33 smithi196 ceph-mon[32572]: pgmap v7634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:34 smithi196 ceph-mon[32572]: pgmap v7635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:34 smithi110 ceph-mon[28069]: pgmap v7635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:34 smithi193 ceph-mon[32782]: pgmap v7635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:37 smithi196 ceph-mon[32572]: pgmap v7636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:37 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13532.055044 secs 2024-04-26T15:33:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:37 smithi110 ceph-mon[28069]: pgmap v7636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:37 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13532.055044 secs 2024-04-26T15:33:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:37 smithi193 ceph-mon[32782]: pgmap v7636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:37 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13532.055044 secs 2024-04-26T15:33:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:39 smithi110 ceph-mon[28069]: pgmap v7637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:39.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:39 smithi193 ceph-mon[32782]: pgmap v7637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:39 smithi196 ceph-mon[32572]: pgmap v7637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:41 smithi110 ceph-mon[28069]: pgmap v7638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:41 smithi193 ceph-mon[32782]: pgmap v7638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:41.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:41 smithi196 ceph-mon[32572]: pgmap v7638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:42 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13537.055171 secs 2024-04-26T15:33:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:42 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13537.055171 secs 2024-04-26T15:33:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:42 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13537.055171 secs 2024-04-26T15:33:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:43 smithi110 ceph-mon[28069]: pgmap v7639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:43 smithi193 ceph-mon[32782]: pgmap v7639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:43 smithi196 ceph-mon[32572]: pgmap v7639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:45 smithi110 ceph-mon[28069]: pgmap v7640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:45 smithi193 ceph-mon[32782]: pgmap v7640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:45 smithi196 ceph-mon[32572]: pgmap v7640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:47 smithi110 ceph-mon[28069]: pgmap v7641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:47 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13542.055325 secs 2024-04-26T15:33:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:47 smithi193 ceph-mon[32782]: pgmap v7641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:47 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13542.055325 secs 2024-04-26T15:33:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:47 smithi196 ceph-mon[32572]: pgmap v7641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:47 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13542.055325 secs 2024-04-26T15:33:49.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:49 smithi193 ceph-mon[32782]: pgmap v7642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:49 smithi196 ceph-mon[32572]: pgmap v7642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:49 smithi110 ceph-mon[28069]: pgmap v7642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:51.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:51 smithi193 ceph-mon[32782]: pgmap v7643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:51 smithi196 ceph-mon[32572]: pgmap v7643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:51 smithi110 ceph-mon[28069]: pgmap v7643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:52 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13547.055465 secs 2024-04-26T15:33:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:52 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13547.055465 secs 2024-04-26T15:33:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:52 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13547.055465 secs 2024-04-26T15:33:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:53 smithi193 ceph-mon[32782]: pgmap v7644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:53.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:53 smithi196 ceph-mon[32572]: pgmap v7644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:53 smithi110 ceph-mon[28069]: pgmap v7644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:55.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:55 smithi193 ceph-mon[32782]: pgmap v7645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:55 smithi196 ceph-mon[32572]: pgmap v7645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:55 smithi110 ceph-mon[28069]: pgmap v7645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:57 smithi193 ceph-mon[32782]: pgmap v7646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:57 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13552.055593 secs 2024-04-26T15:33:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:57 smithi196 ceph-mon[32572]: pgmap v7646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:57 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13552.055593 secs 2024-04-26T15:33:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:57 smithi110 ceph-mon[28069]: pgmap v7646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:33:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:57 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13552.055593 secs 2024-04-26T15:33:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:33:59 smithi193 ceph-mon[32782]: pgmap v7647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:33:59 smithi196 ceph-mon[32572]: pgmap v7647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:33:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:33:59 smithi110 ceph-mon[28069]: pgmap v7647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:01 smithi193 ceph-mon[32782]: pgmap v7648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:01.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:01 smithi196 ceph-mon[32572]: pgmap v7648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:01 smithi110 ceph-mon[28069]: pgmap v7648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:02 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13557.055665 secs 2024-04-26T15:34:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:02 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13557.055665 secs 2024-04-26T15:34:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:02 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13557.055665 secs 2024-04-26T15:34:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:03 smithi193 ceph-mon[32782]: pgmap v7649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:03.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:03 smithi196 ceph-mon[32572]: pgmap v7649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:03 smithi110 ceph-mon[28069]: pgmap v7649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:04 smithi196 ceph-mon[32572]: pgmap v7650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:04 smithi110 ceph-mon[28069]: pgmap v7650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:04 smithi193 ceph-mon[32782]: pgmap v7650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:07.268 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:34:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:34:06.890+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:34:07.268 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:34:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:34:06.890+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:34:07.268 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:34:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:34:06.890+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:34:07.268 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:34:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:34:06.890+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:34:07.268 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:34:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:34:06.890+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:34:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:07 smithi110 ceph-mon[28069]: pgmap v7651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:07 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13562.055786 secs 2024-04-26T15:34:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:07 smithi193 ceph-mon[32782]: pgmap v7651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:07 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13562.055786 secs 2024-04-26T15:34:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:07 smithi196 ceph-mon[32572]: pgmap v7651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:07 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13562.055786 secs 2024-04-26T15:34:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:09 smithi110 ceph-mon[28069]: pgmap v7652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:09 smithi193 ceph-mon[32782]: pgmap v7652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:09 smithi196 ceph-mon[32572]: pgmap v7652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:11 smithi110 ceph-mon[28069]: pgmap v7653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:11 smithi193 ceph-mon[32782]: pgmap v7653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:11 smithi196 ceph-mon[32572]: pgmap v7653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:12 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13567.055904 secs 2024-04-26T15:34:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:12 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13567.055904 secs 2024-04-26T15:34:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:12 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13567.055904 secs 2024-04-26T15:34:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:13 smithi193 ceph-mon[32782]: pgmap v7654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:13 smithi196 ceph-mon[32572]: pgmap v7654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:13 smithi110 ceph-mon[28069]: pgmap v7654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:15 smithi193 ceph-mon[32782]: pgmap v7655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:34:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:15 smithi196 ceph-mon[32572]: pgmap v7655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:34:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:15 smithi110 ceph-mon[28069]: pgmap v7655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T15:34:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:34:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:34:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:34:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:34:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:34:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:34:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:34:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:34:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:34:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:34:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:17 smithi193 ceph-mon[32782]: pgmap v7656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 176 B/s wr, 13 op/s 2024-04-26T15:34:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:17 smithi193 ceph-mon[32782]: pgmap v7657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 212 B/s wr, 16 op/s 2024-04-26T15:34:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:17 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13572.055995 secs 2024-04-26T15:34:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:17 smithi196 ceph-mon[32572]: pgmap v7656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 176 B/s wr, 13 op/s 2024-04-26T15:34:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:17 smithi196 ceph-mon[32572]: pgmap v7657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 212 B/s wr, 16 op/s 2024-04-26T15:34:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:17 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13572.055995 secs 2024-04-26T15:34:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:17 smithi110 ceph-mon[28069]: pgmap v7656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 176 B/s wr, 13 op/s 2024-04-26T15:34:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:17 smithi110 ceph-mon[28069]: pgmap v7657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 212 B/s wr, 16 op/s 2024-04-26T15:34:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:17 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13572.055995 secs 2024-04-26T15:34:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:19 smithi193 ceph-mon[32782]: pgmap v7658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:19 smithi196 ceph-mon[32572]: pgmap v7658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:19 smithi110 ceph-mon[28069]: pgmap v7658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:21 smithi193 ceph-mon[32782]: pgmap v7659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:21 smithi196 ceph-mon[32572]: pgmap v7659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:21 smithi110 ceph-mon[28069]: pgmap v7659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:22 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13577.056127 secs 2024-04-26T15:34:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:22 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13577.056127 secs 2024-04-26T15:34:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:22 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13577.056127 secs 2024-04-26T15:34:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:23 smithi193 ceph-mon[32782]: pgmap v7660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:23.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:23 smithi196 ceph-mon[32572]: pgmap v7660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:23 smithi110 ceph-mon[28069]: pgmap v7660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:25 smithi193 ceph-mon[32782]: pgmap v7661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:25 smithi196 ceph-mon[32572]: pgmap v7661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:25 smithi110 ceph-mon[28069]: pgmap v7661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:34:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:27 smithi193 ceph-mon[32782]: pgmap v7662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:34:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:27 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13582.056225 secs 2024-04-26T15:34:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:27 smithi196 ceph-mon[32572]: pgmap v7662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:34:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:27 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13582.056225 secs 2024-04-26T15:34:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:27 smithi110 ceph-mon[28069]: pgmap v7662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:34:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:27 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13582.056225 secs 2024-04-26T15:34:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:29 smithi193 ceph-mon[32782]: pgmap v7663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:29 smithi196 ceph-mon[32572]: pgmap v7663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:29 smithi110 ceph-mon[28069]: pgmap v7663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:31 smithi193 ceph-mon[32782]: pgmap v7664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:31 smithi196 ceph-mon[32572]: pgmap v7664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:31 smithi110 ceph-mon[28069]: pgmap v7664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:32 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13587.056347 secs 2024-04-26T15:34:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:32 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13587.056347 secs 2024-04-26T15:34:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:32 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13587.056347 secs 2024-04-26T15:34:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:33 smithi196 ceph-mon[32572]: pgmap v7665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:33 smithi110 ceph-mon[28069]: pgmap v7665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:33 smithi193 ceph-mon[32782]: pgmap v7665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:35 smithi196 ceph-mon[32572]: pgmap v7666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:35 smithi110 ceph-mon[28069]: pgmap v7666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:35 smithi193 ceph-mon[32782]: pgmap v7666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:37 smithi196 ceph-mon[32572]: pgmap v7667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:37 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13592.056462 secs 2024-04-26T15:34:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:37 smithi110 ceph-mon[28069]: pgmap v7667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:37 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13592.056462 secs 2024-04-26T15:34:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:37 smithi193 ceph-mon[32782]: pgmap v7667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:37 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13592.056462 secs 2024-04-26T15:34:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:39 smithi196 ceph-mon[32572]: pgmap v7668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:39 smithi110 ceph-mon[28069]: pgmap v7668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:39 smithi193 ceph-mon[32782]: pgmap v7668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:41 smithi196 ceph-mon[32572]: pgmap v7669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:41 smithi110 ceph-mon[28069]: pgmap v7669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:41 smithi193 ceph-mon[32782]: pgmap v7669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:42 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13597.056604 secs 2024-04-26T15:34:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:42 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13597.056604 secs 2024-04-26T15:34:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:42 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13597.056604 secs 2024-04-26T15:34:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:43 smithi196 ceph-mon[32572]: pgmap v7670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:43 smithi110 ceph-mon[28069]: pgmap v7670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:43 smithi193 ceph-mon[32782]: pgmap v7670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:45 smithi196 ceph-mon[32572]: pgmap v7671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:45 smithi110 ceph-mon[28069]: pgmap v7671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:45 smithi193 ceph-mon[32782]: pgmap v7671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:47.672 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:47 smithi193 ceph-mon[32782]: pgmap v7672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:47.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:47 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13602.056717 secs 2024-04-26T15:34:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:47 smithi196 ceph-mon[32572]: pgmap v7672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:47 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13602.056717 secs 2024-04-26T15:34:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:47 smithi110 ceph-mon[28069]: pgmap v7672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:47 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13602.056717 secs 2024-04-26T15:34:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:49 smithi196 ceph-mon[32572]: pgmap v7673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:49 smithi110 ceph-mon[28069]: pgmap v7673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:49 smithi193 ceph-mon[32782]: pgmap v7673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:51 smithi196 ceph-mon[32572]: pgmap v7674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:51 smithi110 ceph-mon[28069]: pgmap v7674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:51 smithi193 ceph-mon[32782]: pgmap v7674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:52 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13607.056834 secs 2024-04-26T15:34:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:52 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13607.056834 secs 2024-04-26T15:34:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:52 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13607.056834 secs 2024-04-26T15:34:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:53 smithi196 ceph-mon[32572]: pgmap v7675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:53 smithi110 ceph-mon[28069]: pgmap v7675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:53 smithi193 ceph-mon[32782]: pgmap v7675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:34:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:54 smithi196 ceph-mon[32572]: pgmap v7676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:54 smithi110 ceph-mon[28069]: pgmap v7676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:54 smithi193 ceph-mon[32782]: pgmap v7676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:57.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:56 smithi196 ceph-mon[32572]: pgmap v7677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:34:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:56 smithi110 ceph-mon[28069]: pgmap v7677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:34:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:56 smithi193 ceph-mon[32782]: pgmap v7677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:34:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:57 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13612.056901 secs 2024-04-26T15:34:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:57 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13612.056901 secs 2024-04-26T15:34:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:57 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13612.056901 secs 2024-04-26T15:34:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:34:58 smithi196 ceph-mon[32572]: pgmap v7678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:34:58 smithi110 ceph-mon[28069]: pgmap v7678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:34:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:34:58 smithi193 ceph-mon[32782]: pgmap v7678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:00 smithi196 ceph-mon[32572]: pgmap v7679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:35:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:00 smithi110 ceph-mon[28069]: pgmap v7679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:35:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:00 smithi193 ceph-mon[32782]: pgmap v7679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:35:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:02 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13617.057028 secs 2024-04-26T15:35:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:02 smithi196 ceph-mon[32572]: pgmap v7680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:35:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:02 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13617.057028 secs 2024-04-26T15:35:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:02 smithi110 ceph-mon[28069]: pgmap v7680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:35:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:02 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13617.057028 secs 2024-04-26T15:35:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:02 smithi193 ceph-mon[32782]: pgmap v7680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:35:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:04 smithi196 ceph-mon[32572]: pgmap v7681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:35:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:04 smithi110 ceph-mon[28069]: pgmap v7681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:35:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:04 smithi193 ceph-mon[32782]: pgmap v7681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:35:07.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:06 smithi196 ceph-mon[32572]: pgmap v7682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:35:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:06 smithi110 ceph-mon[28069]: pgmap v7682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:35:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:06 smithi193 ceph-mon[32782]: pgmap v7682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:35:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:07 smithi196 ceph-mon[32572]: 13 slow requests, 1 included below; oldest blocked for > 13622.057151 secs 2024-04-26T15:35:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:07 smithi196 ceph-mon[32572]: slow request 5762.354673 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:35:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:07 smithi110 ceph-mon[28069]: 13 slow requests, 1 included below; oldest blocked for > 13622.057151 secs 2024-04-26T15:35:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:07 smithi110 ceph-mon[28069]: slow request 5762.354673 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:35:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:07 smithi193 ceph-mon[32782]: 13 slow requests, 1 included below; oldest blocked for > 13622.057151 secs 2024-04-26T15:35:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:07 smithi193 ceph-mon[32782]: slow request 5762.354673 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:35:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:08 smithi196 ceph-mon[32572]: pgmap v7683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:35:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:08 smithi110 ceph-mon[28069]: pgmap v7683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:35:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:08 smithi193 ceph-mon[32782]: pgmap v7683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:35:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:10 smithi196 ceph-mon[32572]: pgmap v7684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:35:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:10 smithi110 ceph-mon[28069]: pgmap v7684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:35:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:10 smithi193 ceph-mon[32782]: pgmap v7684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:35:13.001 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:12 smithi110 ceph-mon[28069]: 13 slow requests, 1 included below; oldest blocked for > 13627.057298 secs 2024-04-26T15:35:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:12 smithi196 ceph-mon[32572]: 13 slow requests, 1 included below; oldest blocked for > 13627.057298 secs 2024-04-26T15:35:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:12 smithi196 ceph-mon[32572]: slow request 364.682183 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:35:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:12 smithi196 ceph-mon[32572]: pgmap v7685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:35:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:12 smithi110 ceph-mon[28069]: slow request 364.682183 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:35:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:12 smithi110 ceph-mon[28069]: pgmap v7685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:35:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:12 smithi193 ceph-mon[32782]: 13 slow requests, 1 included below; oldest blocked for > 13627.057298 secs 2024-04-26T15:35:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:12 smithi193 ceph-mon[32782]: slow request 364.682183 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:35:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:12 smithi193 ceph-mon[32782]: pgmap v7685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:35:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:14 smithi196 ceph-mon[32572]: pgmap v7686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:35:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:14 smithi110 ceph-mon[28069]: pgmap v7686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:35:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:14 smithi193 ceph-mon[32782]: pgmap v7686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:35:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:16 smithi196 ceph-mon[32572]: pgmap v7687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:35:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:16 smithi110 ceph-mon[28069]: pgmap v7687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:35:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:16 smithi193 ceph-mon[32782]: pgmap v7687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:17.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:35:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:17 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13632.057390 secs 2024-04-26T15:35:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:35:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:35:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:35:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:17 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13632.057390 secs 2024-04-26T15:35:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:35:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:35:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:35:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:17 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13632.057390 secs 2024-04-26T15:35:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:35:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:35:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:35:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:19 smithi196 ceph-mon[32572]: pgmap v7688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:35:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:19 smithi196 ceph-mon[32572]: pgmap v7689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:19 smithi110 ceph-mon[28069]: pgmap v7688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:35:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:19 smithi110 ceph-mon[28069]: pgmap v7689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:19 smithi193 ceph-mon[32782]: pgmap v7688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:35:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:19 smithi193 ceph-mon[32782]: pgmap v7689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:21 smithi110 ceph-mon[28069]: pgmap v7690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:21 smithi193 ceph-mon[32782]: pgmap v7690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:21.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:21 smithi196 ceph-mon[32572]: pgmap v7690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:23 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13637.057508 secs 2024-04-26T15:35:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:23 smithi110 ceph-mon[28069]: pgmap v7691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:23.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:23 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13637.057508 secs 2024-04-26T15:35:23.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:23 smithi196 ceph-mon[32572]: pgmap v7691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:23 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13637.057508 secs 2024-04-26T15:35:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:23 smithi193 ceph-mon[32782]: pgmap v7691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:25 smithi110 ceph-mon[28069]: pgmap v7692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:25 smithi193 ceph-mon[32782]: pgmap v7692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:25 smithi196 ceph-mon[32572]: pgmap v7692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:27 smithi110 ceph-mon[28069]: pgmap v7693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:27 smithi193 ceph-mon[32782]: pgmap v7693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:27 smithi196 ceph-mon[32572]: pgmap v7693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:35:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:28 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13642.057656 secs 2024-04-26T15:35:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:28 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13642.057656 secs 2024-04-26T15:35:28.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:28 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13642.057656 secs 2024-04-26T15:35:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:29 smithi110 ceph-mon[28069]: pgmap v7694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:35:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:29 smithi193 ceph-mon[32782]: pgmap v7694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:35:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:29 smithi196 ceph-mon[32572]: pgmap v7694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:35:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:31 smithi110 ceph-mon[28069]: pgmap v7695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:31 smithi193 ceph-mon[32782]: pgmap v7695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:31 smithi196 ceph-mon[32572]: pgmap v7695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:33 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13647.057769 secs 2024-04-26T15:35:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:33 smithi193 ceph-mon[32782]: pgmap v7696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:33 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13647.057769 secs 2024-04-26T15:35:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:33 smithi196 ceph-mon[32572]: pgmap v7696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:33 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13647.057769 secs 2024-04-26T15:35:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:33 smithi110 ceph-mon[28069]: pgmap v7696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:35 smithi193 ceph-mon[32782]: pgmap v7697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:35.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:35 smithi196 ceph-mon[32572]: pgmap v7697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:35 smithi110 ceph-mon[28069]: pgmap v7697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:37 smithi193 ceph-mon[32782]: pgmap v7698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:37 smithi196 ceph-mon[32572]: pgmap v7698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:37 smithi110 ceph-mon[28069]: pgmap v7698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:38 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13652.057888 secs 2024-04-26T15:35:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:38 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13652.057888 secs 2024-04-26T15:35:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:38 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13652.057888 secs 2024-04-26T15:35:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:39 smithi193 ceph-mon[32782]: pgmap v7699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:39 smithi196 ceph-mon[32572]: pgmap v7699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:39 smithi110 ceph-mon[28069]: pgmap v7699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:41.345 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:41 smithi110 ceph-mon[28069]: pgmap v7700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:41 smithi193 ceph-mon[32782]: pgmap v7700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:41 smithi196 ceph-mon[32572]: pgmap v7700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:43 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13657.057956 secs 2024-04-26T15:35:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:43 smithi193 ceph-mon[32782]: pgmap v7701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:43 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13657.057956 secs 2024-04-26T15:35:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:43 smithi196 ceph-mon[32572]: pgmap v7701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:43 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13657.057956 secs 2024-04-26T15:35:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:43 smithi110 ceph-mon[28069]: pgmap v7701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:45 smithi193 ceph-mon[32782]: pgmap v7702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:45.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:45 smithi196 ceph-mon[32572]: pgmap v7702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:45 smithi110 ceph-mon[28069]: pgmap v7702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:47 smithi193 ceph-mon[32782]: pgmap v7703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:47.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:47 smithi196 ceph-mon[32572]: pgmap v7703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:47 smithi110 ceph-mon[28069]: pgmap v7703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:48 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13662.058073 secs 2024-04-26T15:35:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:48 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13662.058073 secs 2024-04-26T15:35:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:48 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13662.058073 secs 2024-04-26T15:35:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:49 smithi193 ceph-mon[32782]: pgmap v7704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:49 smithi196 ceph-mon[32572]: pgmap v7704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:49 smithi110 ceph-mon[28069]: pgmap v7704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:51 smithi193 ceph-mon[32782]: pgmap v7705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:51 smithi196 ceph-mon[32572]: pgmap v7705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:51 smithi110 ceph-mon[28069]: pgmap v7705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:53 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13667.058213 secs 2024-04-26T15:35:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:53 smithi193 ceph-mon[32782]: pgmap v7706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:53 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13667.058213 secs 2024-04-26T15:35:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:53 smithi196 ceph-mon[32572]: pgmap v7706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:53 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13667.058213 secs 2024-04-26T15:35:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:53 smithi110 ceph-mon[28069]: pgmap v7706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:55 smithi193 ceph-mon[32782]: pgmap v7707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:55 smithi196 ceph-mon[32572]: pgmap v7707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:55 smithi110 ceph-mon[28069]: pgmap v7707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:57 smithi193 ceph-mon[32782]: pgmap v7708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:57 smithi196 ceph-mon[32572]: pgmap v7708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:57 smithi110 ceph-mon[28069]: pgmap v7708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:35:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:58 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13672.058360 secs 2024-04-26T15:35:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:58 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13672.058360 secs 2024-04-26T15:35:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:58 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13672.058360 secs 2024-04-26T15:35:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:35:59 smithi196 ceph-mon[32572]: pgmap v7709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:35:59 smithi110 ceph-mon[28069]: pgmap v7709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:35:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:35:59 smithi193 ceph-mon[32782]: pgmap v7709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:01.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:01 smithi196 ceph-mon[32572]: pgmap v7710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:01 smithi110 ceph-mon[28069]: pgmap v7710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:01 smithi193 ceph-mon[32782]: pgmap v7710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:03.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:03 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13677.058496 secs 2024-04-26T15:36:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:03 smithi196 ceph-mon[32572]: pgmap v7711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:03 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13677.058496 secs 2024-04-26T15:36:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:03 smithi110 ceph-mon[28069]: pgmap v7711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:03 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13677.058496 secs 2024-04-26T15:36:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:03 smithi193 ceph-mon[32782]: pgmap v7711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:05 smithi196 ceph-mon[32572]: pgmap v7712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:05 smithi110 ceph-mon[28069]: pgmap v7712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:05 smithi193 ceph-mon[32782]: pgmap v7712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:07 smithi196 ceph-mon[32572]: pgmap v7713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:07 smithi110 ceph-mon[28069]: pgmap v7713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:07 smithi193 ceph-mon[32782]: pgmap v7713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:08.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:08 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13682.058625 secs 2024-04-26T15:36:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:08 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13682.058625 secs 2024-04-26T15:36:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:08 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13682.058625 secs 2024-04-26T15:36:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:09 smithi196 ceph-mon[32572]: pgmap v7714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:09 smithi110 ceph-mon[28069]: pgmap v7714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:09 smithi193 ceph-mon[32782]: pgmap v7714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:11.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:11 smithi196 ceph-mon[32572]: pgmap v7715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:11 smithi110 ceph-mon[28069]: pgmap v7715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:11 smithi193 ceph-mon[32782]: pgmap v7715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:13.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:13 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13687.058737 secs 2024-04-26T15:36:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:13 smithi196 ceph-mon[32572]: pgmap v7716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:13 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13687.058737 secs 2024-04-26T15:36:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:13 smithi110 ceph-mon[28069]: pgmap v7716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:13 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13687.058737 secs 2024-04-26T15:36:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:13 smithi193 ceph-mon[32782]: pgmap v7716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:15.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:15 smithi196 ceph-mon[32572]: pgmap v7717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:15 smithi110 ceph-mon[28069]: pgmap v7717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:15 smithi193 ceph-mon[32782]: pgmap v7717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:17 smithi196 ceph-mon[32572]: pgmap v7718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:17 smithi110 ceph-mon[28069]: pgmap v7718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:17 smithi193 ceph-mon[32782]: pgmap v7718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:18 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13692.058814 secs 2024-04-26T15:36:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:36:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:18 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13692.058814 secs 2024-04-26T15:36:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:36:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:36:18.615+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T15:36:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:36:18.615+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:36:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:36:18.616+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 108 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:36:18.616 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:36:18.616+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 108 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T15:36:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:18 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13692.058814 secs 2024-04-26T15:36:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:36:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:19 smithi196 ceph-mon[32572]: pgmap v7719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:36:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:36:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:36:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:19 smithi110 ceph-mon[28069]: pgmap v7719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:36:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:36:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:36:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:19 smithi193 ceph-mon[32782]: pgmap v7719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:36:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:36:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:36:20.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:20 smithi196 ceph-mon[32572]: pgmap v7720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:36:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:20 smithi196 ceph-mon[32572]: pgmap v7721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:20 smithi110 ceph-mon[28069]: pgmap v7720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:36:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:20 smithi110 ceph-mon[28069]: pgmap v7721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:20 smithi193 ceph-mon[32782]: pgmap v7720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:36:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:20 smithi193 ceph-mon[32782]: pgmap v7721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:22.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:22 smithi196 ceph-mon[32572]: pgmap v7722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:22 smithi110 ceph-mon[28069]: pgmap v7722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:22 smithi193 ceph-mon[32782]: pgmap v7722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:23 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13697.058885 secs 2024-04-26T15:36:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:23 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13697.058885 secs 2024-04-26T15:36:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:23 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13697.058885 secs 2024-04-26T15:36:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:24 smithi196 ceph-mon[32572]: pgmap v7723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:24 smithi110 ceph-mon[28069]: pgmap v7723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:24 smithi193 ceph-mon[32782]: pgmap v7723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:26.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:26 smithi196 ceph-mon[32572]: pgmap v7724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:26 smithi110 ceph-mon[28069]: pgmap v7724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:26 smithi193 ceph-mon[32782]: pgmap v7724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:36:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:28 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13702.058982 secs 2024-04-26T15:36:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:28 smithi196 ceph-mon[32572]: pgmap v7725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:36:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:28 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13702.058982 secs 2024-04-26T15:36:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:28 smithi110 ceph-mon[28069]: pgmap v7725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:36:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:28 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13702.058982 secs 2024-04-26T15:36:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:28 smithi193 ceph-mon[32782]: pgmap v7725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:36:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:30 smithi196 ceph-mon[32572]: pgmap v7726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:36:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:30 smithi110 ceph-mon[28069]: pgmap v7726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:36:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:30 smithi193 ceph-mon[32782]: pgmap v7726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:36:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:32 smithi196 ceph-mon[32572]: pgmap v7727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:32 smithi110 ceph-mon[28069]: pgmap v7727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:32 smithi193 ceph-mon[32782]: pgmap v7727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:33 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13707.059083 secs 2024-04-26T15:36:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:33 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13707.059083 secs 2024-04-26T15:36:33.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:33 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13707.059083 secs 2024-04-26T15:36:34.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:34 smithi196 ceph-mon[32572]: pgmap v7728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:34 smithi110 ceph-mon[28069]: pgmap v7728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:34 smithi193 ceph-mon[32782]: pgmap v7728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:36 smithi110 ceph-mon[28069]: pgmap v7729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:36 smithi193 ceph-mon[32782]: pgmap v7729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:36 smithi196 ceph-mon[32572]: pgmap v7729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:37 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13712.059219 secs 2024-04-26T15:36:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:37 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13712.059219 secs 2024-04-26T15:36:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:37 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13712.059219 secs 2024-04-26T15:36:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:38 smithi110 ceph-mon[28069]: pgmap v7730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:38 smithi193 ceph-mon[32782]: pgmap v7730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:38 smithi196 ceph-mon[32572]: pgmap v7730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:40 smithi110 ceph-mon[28069]: pgmap v7731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:40 smithi193 ceph-mon[32782]: pgmap v7731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:40 smithi196 ceph-mon[32572]: pgmap v7731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:42 smithi110 ceph-mon[28069]: pgmap v7732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:42 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13717.059283 secs 2024-04-26T15:36:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:42 smithi193 ceph-mon[32782]: pgmap v7732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:42 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13717.059283 secs 2024-04-26T15:36:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:42 smithi196 ceph-mon[32572]: pgmap v7732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:42 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13717.059283 secs 2024-04-26T15:36:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:44 smithi193 ceph-mon[32782]: pgmap v7733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:44 smithi196 ceph-mon[32572]: pgmap v7733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:44 smithi110 ceph-mon[28069]: pgmap v7733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:46 smithi193 ceph-mon[32782]: pgmap v7734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:46.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:46 smithi196 ceph-mon[32572]: pgmap v7734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:46 smithi110 ceph-mon[28069]: pgmap v7734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:47 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13722.059400 secs 2024-04-26T15:36:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:47 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13722.059400 secs 2024-04-26T15:36:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:47 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13722.059400 secs 2024-04-26T15:36:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:48 smithi193 ceph-mon[32782]: pgmap v7735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:48 smithi196 ceph-mon[32572]: pgmap v7735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:48 smithi110 ceph-mon[28069]: pgmap v7735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:50.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:49 smithi196 ceph-mon[32572]: pgmap v7736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:49 smithi110 ceph-mon[28069]: pgmap v7736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:49 smithi193 ceph-mon[32782]: pgmap v7736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:52 smithi193 ceph-mon[32782]: pgmap v7737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:52 smithi196 ceph-mon[32572]: pgmap v7737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:52 smithi110 ceph-mon[28069]: pgmap v7737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:53.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:53 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13727.059522 secs 2024-04-26T15:36:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:53 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13727.059522 secs 2024-04-26T15:36:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:53 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13727.059522 secs 2024-04-26T15:36:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:54 smithi196 ceph-mon[32572]: pgmap v7738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:54 smithi110 ceph-mon[28069]: pgmap v7738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:54 smithi193 ceph-mon[32782]: pgmap v7738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:36:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:56 smithi196 ceph-mon[32572]: pgmap v7739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:56 smithi110 ceph-mon[28069]: pgmap v7739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:56 smithi193 ceph-mon[32782]: pgmap v7739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:58 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13732.059640 secs 2024-04-26T15:36:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:36:58 smithi196 ceph-mon[32572]: pgmap v7740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:58 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13732.059640 secs 2024-04-26T15:36:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:36:58 smithi110 ceph-mon[28069]: pgmap v7740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:36:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:58 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13732.059640 secs 2024-04-26T15:36:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:36:58 smithi193 ceph-mon[32782]: pgmap v7740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:00 smithi196 ceph-mon[32572]: pgmap v7741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:00 smithi110 ceph-mon[28069]: pgmap v7741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:00 smithi193 ceph-mon[32782]: pgmap v7741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:02 smithi196 ceph-mon[32572]: pgmap v7742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:02 smithi110 ceph-mon[28069]: pgmap v7742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:02 smithi193 ceph-mon[32782]: pgmap v7742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:03.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:03 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13737.059751 secs 2024-04-26T15:37:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:03 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13737.059751 secs 2024-04-26T15:37:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:03 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13737.059751 secs 2024-04-26T15:37:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:04 smithi196 ceph-mon[32572]: pgmap v7743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:04 smithi110 ceph-mon[28069]: pgmap v7743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:04 smithi193 ceph-mon[32782]: pgmap v7743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:06 smithi196 ceph-mon[32572]: pgmap v7744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:06 smithi110 ceph-mon[28069]: pgmap v7744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:06 smithi193 ceph-mon[32782]: pgmap v7744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:08 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13742.059866 secs 2024-04-26T15:37:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:08 smithi196 ceph-mon[32572]: pgmap v7745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:08 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13742.059866 secs 2024-04-26T15:37:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:08 smithi110 ceph-mon[28069]: pgmap v7745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:08 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13742.059866 secs 2024-04-26T15:37:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:08 smithi193 ceph-mon[32782]: pgmap v7745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:10 smithi196 ceph-mon[32572]: pgmap v7746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:10 smithi110 ceph-mon[28069]: pgmap v7746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:10 smithi193 ceph-mon[32782]: pgmap v7746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:12.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:12 smithi196 ceph-mon[32572]: pgmap v7747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:12 smithi110 ceph-mon[28069]: pgmap v7747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:12 smithi193 ceph-mon[32782]: pgmap v7747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:13 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13747.059984 secs 2024-04-26T15:37:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:13 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13747.059984 secs 2024-04-26T15:37:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:13 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13747.059984 secs 2024-04-26T15:37:14.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:14 smithi196 ceph-mon[32572]: pgmap v7748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:14 smithi110 ceph-mon[28069]: pgmap v7748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:14 smithi193 ceph-mon[32782]: pgmap v7748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:16 smithi196 ceph-mon[32572]: pgmap v7749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:16 smithi110 ceph-mon[28069]: pgmap v7749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:16 smithi193 ceph-mon[32782]: pgmap v7749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:18 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13752.060068 secs 2024-04-26T15:37:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:18 smithi196 ceph-mon[32572]: pgmap v7750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:18 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13752.060068 secs 2024-04-26T15:37:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:18 smithi110 ceph-mon[28069]: pgmap v7750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:18 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13752.060068 secs 2024-04-26T15:37:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:18 smithi193 ceph-mon[32782]: pgmap v7750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:20 smithi196 ceph-mon[32572]: pgmap v7751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:37:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:20 smithi110 ceph-mon[28069]: pgmap v7751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:37:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:20 smithi193 ceph-mon[32782]: pgmap v7751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:37:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:37:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:37:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:37:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:37:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:37:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:37:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:37:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:37:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:37:22.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:22 smithi196 ceph-mon[32572]: pgmap v7752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T15:37:22.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:22 smithi196 ceph-mon[32572]: pgmap v7753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:22 smithi110 ceph-mon[28069]: pgmap v7752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T15:37:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:22 smithi110 ceph-mon[28069]: pgmap v7753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:22 smithi193 ceph-mon[32782]: pgmap v7752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T15:37:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:22 smithi193 ceph-mon[32782]: pgmap v7753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:23 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13757.060206 secs 2024-04-26T15:37:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:23 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13757.060206 secs 2024-04-26T15:37:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:23 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13757.060206 secs 2024-04-26T15:37:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:24 smithi196 ceph-mon[32572]: pgmap v7754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:24 smithi110 ceph-mon[28069]: pgmap v7754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:24 smithi193 ceph-mon[32782]: pgmap v7754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:26.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:26 smithi196 ceph-mon[32572]: pgmap v7755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:26 smithi110 ceph-mon[28069]: pgmap v7755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:26 smithi193 ceph-mon[32782]: pgmap v7755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:28 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13762.060339 secs 2024-04-26T15:37:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:28 smithi110 ceph-mon[28069]: pgmap v7756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:28 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13762.060339 secs 2024-04-26T15:37:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:28 smithi193 ceph-mon[32782]: pgmap v7756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:28 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13762.060339 secs 2024-04-26T15:37:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:28 smithi196 ceph-mon[32572]: pgmap v7756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:30 smithi110 ceph-mon[28069]: pgmap v7757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:30 smithi193 ceph-mon[32782]: pgmap v7757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:30 smithi196 ceph-mon[32572]: pgmap v7757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:37:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:32 smithi110 ceph-mon[28069]: pgmap v7758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:37:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:32 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13767.060461 secs 2024-04-26T15:37:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:32 smithi193 ceph-mon[32782]: pgmap v7758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:37:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:32 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13767.060461 secs 2024-04-26T15:37:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:32 smithi196 ceph-mon[32572]: pgmap v7758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:37:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:32 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13767.060461 secs 2024-04-26T15:37:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:34 smithi110 ceph-mon[28069]: pgmap v7759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:34 smithi193 ceph-mon[32782]: pgmap v7759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:34.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:34 smithi196 ceph-mon[32572]: pgmap v7759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:36 smithi110 ceph-mon[28069]: pgmap v7760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:36 smithi193 ceph-mon[32782]: pgmap v7760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:36 smithi196 ceph-mon[32572]: pgmap v7760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:37 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13772.060524 secs 2024-04-26T15:37:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:37 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13772.060524 secs 2024-04-26T15:37:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:37 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13772.060524 secs 2024-04-26T15:37:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:38 smithi193 ceph-mon[32782]: pgmap v7761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:38 smithi196 ceph-mon[32572]: pgmap v7761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:38 smithi110 ceph-mon[28069]: pgmap v7761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:40 smithi193 ceph-mon[32782]: pgmap v7762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:40 smithi196 ceph-mon[32572]: pgmap v7762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:40 smithi110 ceph-mon[28069]: pgmap v7762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:42 smithi110 ceph-mon[28069]: pgmap v7763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:42 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13777.060679 secs 2024-04-26T15:37:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:42 smithi193 ceph-mon[32782]: pgmap v7763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:42 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13777.060679 secs 2024-04-26T15:37:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:42 smithi196 ceph-mon[32572]: pgmap v7763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:42 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13777.060679 secs 2024-04-26T15:37:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:44 smithi193 ceph-mon[32782]: pgmap v7764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:44.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:44 smithi196 ceph-mon[32572]: pgmap v7764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:44 smithi110 ceph-mon[28069]: pgmap v7764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:46 smithi193 ceph-mon[32782]: pgmap v7765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:46.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:46 smithi196 ceph-mon[32572]: pgmap v7765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:46 smithi110 ceph-mon[28069]: pgmap v7765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:47 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13782.060770 secs 2024-04-26T15:37:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:47 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13782.060770 secs 2024-04-26T15:37:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:47 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13782.060770 secs 2024-04-26T15:37:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:48 smithi193 ceph-mon[32782]: pgmap v7766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:48 smithi196 ceph-mon[32572]: pgmap v7766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:48 smithi110 ceph-mon[28069]: pgmap v7766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:50 smithi193 ceph-mon[32782]: pgmap v7767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:50.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:50 smithi196 ceph-mon[32572]: pgmap v7767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:50 smithi110 ceph-mon[28069]: pgmap v7767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:52 smithi193 ceph-mon[32782]: pgmap v7768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:52 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13787.060891 secs 2024-04-26T15:37:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:52 smithi196 ceph-mon[32572]: pgmap v7768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:52 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13787.060891 secs 2024-04-26T15:37:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:52 smithi110 ceph-mon[28069]: pgmap v7768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:52 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13787.060891 secs 2024-04-26T15:37:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:54 smithi193 ceph-mon[32782]: pgmap v7769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:54 smithi196 ceph-mon[32572]: pgmap v7769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:54 smithi110 ceph-mon[28069]: pgmap v7769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:37:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:56 smithi193 ceph-mon[32782]: pgmap v7770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:56 smithi196 ceph-mon[32572]: pgmap v7770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:56 smithi110 ceph-mon[28069]: pgmap v7770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:57 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13792.061000 secs 2024-04-26T15:37:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:57 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13792.061000 secs 2024-04-26T15:37:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:57 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13792.061000 secs 2024-04-26T15:37:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:37:58 smithi193 ceph-mon[32782]: pgmap v7771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:37:58 smithi196 ceph-mon[32572]: pgmap v7771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:37:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:37:58 smithi110 ceph-mon[28069]: pgmap v7771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:00 smithi193 ceph-mon[32782]: pgmap v7772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:00 smithi196 ceph-mon[32572]: pgmap v7772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:00 smithi110 ceph-mon[28069]: pgmap v7772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:02 smithi196 ceph-mon[32572]: pgmap v7773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:02 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13797.061117 secs 2024-04-26T15:38:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:02 smithi110 ceph-mon[28069]: pgmap v7773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:02 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13797.061117 secs 2024-04-26T15:38:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:02 smithi193 ceph-mon[32782]: pgmap v7773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:02 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13797.061117 secs 2024-04-26T15:38:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:04 smithi196 ceph-mon[32572]: pgmap v7774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:04 smithi110 ceph-mon[28069]: pgmap v7774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:04 smithi193 ceph-mon[32782]: pgmap v7774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:06 smithi196 ceph-mon[32572]: pgmap v7775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:06 smithi110 ceph-mon[28069]: pgmap v7775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:06 smithi193 ceph-mon[32782]: pgmap v7775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:07 smithi196 ceph-mon[32572]: 13 slow requests, 1 included below; oldest blocked for > 13802.061263 secs 2024-04-26T15:38:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:07 smithi196 ceph-mon[32572]: slow request 1440.105881 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:38:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:07 smithi110 ceph-mon[28069]: 13 slow requests, 1 included below; oldest blocked for > 13802.061263 secs 2024-04-26T15:38:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:07 smithi110 ceph-mon[28069]: slow request 1440.105881 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:38:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:07 smithi193 ceph-mon[32782]: 13 slow requests, 1 included below; oldest blocked for > 13802.061263 secs 2024-04-26T15:38:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:07 smithi193 ceph-mon[32782]: slow request 1440.105881 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:38:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:08 smithi196 ceph-mon[32572]: pgmap v7776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:08 smithi110 ceph-mon[28069]: pgmap v7776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:08 smithi193 ceph-mon[32782]: pgmap v7776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:10 smithi196 ceph-mon[32572]: pgmap v7777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:10 smithi110 ceph-mon[28069]: pgmap v7777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:10 smithi193 ceph-mon[32782]: pgmap v7777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:12 smithi196 ceph-mon[32572]: pgmap v7778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:12 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13807.061387 secs 2024-04-26T15:38:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:12 smithi110 ceph-mon[28069]: pgmap v7778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:12 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13807.061387 secs 2024-04-26T15:38:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:12 smithi193 ceph-mon[32782]: pgmap v7778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:12 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13807.061387 secs 2024-04-26T15:38:14.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:14 smithi196 ceph-mon[32572]: pgmap v7779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:14 smithi110 ceph-mon[28069]: pgmap v7779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:14 smithi193 ceph-mon[32782]: pgmap v7779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:16 smithi196 ceph-mon[32572]: pgmap v7780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:16 smithi110 ceph-mon[28069]: pgmap v7780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:16 smithi193 ceph-mon[32782]: pgmap v7780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:17 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13812.061522 secs 2024-04-26T15:38:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:17 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13812.061522 secs 2024-04-26T15:38:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:17 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13812.061522 secs 2024-04-26T15:38:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:18 smithi196 ceph-mon[32572]: pgmap v7781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:18.771 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:18 smithi193 ceph-mon[32782]: pgmap v7781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:18 smithi110 ceph-mon[28069]: pgmap v7781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:20 smithi196 ceph-mon[32572]: pgmap v7782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:20 smithi110 ceph-mon[28069]: pgmap v7782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:20 smithi193 ceph-mon[32782]: pgmap v7782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:38:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:38:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:38:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:22 smithi196 ceph-mon[32572]: pgmap v7783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:22 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13817.061617 secs 2024-04-26T15:38:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:38:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:38:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:22 smithi110 ceph-mon[28069]: pgmap v7783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:22 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13817.061617 secs 2024-04-26T15:38:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:38:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:38:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:22 smithi193 ceph-mon[32782]: pgmap v7783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:22 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13817.061617 secs 2024-04-26T15:38:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:38:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:38:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:38:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:38:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:38:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:38:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:38:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:38:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:38:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:38:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:38:24.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:24 smithi196 ceph-mon[32572]: pgmap v7784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:24 smithi196 ceph-mon[32572]: pgmap v7785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 B/s rd, 1 op/s 2024-04-26T15:38:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:24 smithi196 ceph-mon[32572]: pgmap v7786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:24 smithi110 ceph-mon[28069]: pgmap v7784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:24 smithi110 ceph-mon[28069]: pgmap v7785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 B/s rd, 1 op/s 2024-04-26T15:38:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:24 smithi110 ceph-mon[28069]: pgmap v7786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:24 smithi193 ceph-mon[32782]: pgmap v7784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:24 smithi193 ceph-mon[32782]: pgmap v7785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 B/s rd, 1 op/s 2024-04-26T15:38:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:24 smithi193 ceph-mon[32782]: pgmap v7786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:26 smithi196 ceph-mon[32572]: pgmap v7787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:26 smithi110 ceph-mon[28069]: pgmap v7787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:26 smithi193 ceph-mon[32782]: pgmap v7787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:27 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13822.061718 secs 2024-04-26T15:38:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:27 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13822.061718 secs 2024-04-26T15:38:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:27 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13822.061718 secs 2024-04-26T15:38:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:28 smithi196 ceph-mon[32572]: pgmap v7788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 615 B/s rd, 1 op/s 2024-04-26T15:38:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:28 smithi110 ceph-mon[28069]: pgmap v7788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 615 B/s rd, 1 op/s 2024-04-26T15:38:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:28 smithi193 ceph-mon[32782]: pgmap v7788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 615 B/s rd, 1 op/s 2024-04-26T15:38:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:30 smithi196 ceph-mon[32572]: pgmap v7789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:30.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:30 smithi110 ceph-mon[28069]: pgmap v7789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:30 smithi193 ceph-mon[32782]: pgmap v7789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:32 smithi196 ceph-mon[32572]: pgmap v7790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 615 B/s rd, 1 op/s 2024-04-26T15:38:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:32 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13827.061779 secs 2024-04-26T15:38:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:32 smithi110 ceph-mon[28069]: pgmap v7790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 615 B/s rd, 1 op/s 2024-04-26T15:38:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:32 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13827.061779 secs 2024-04-26T15:38:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:32 smithi193 ceph-mon[32782]: pgmap v7790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 615 B/s rd, 1 op/s 2024-04-26T15:38:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:32 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13827.061779 secs 2024-04-26T15:38:34.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:34 smithi196 ceph-mon[32572]: pgmap v7791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:38:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:34 smithi110 ceph-mon[28069]: pgmap v7791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:38:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:34 smithi193 ceph-mon[32782]: pgmap v7791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:38:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:35 smithi193 ceph-mon[32782]: pgmap v7792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:36.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:35 smithi196 ceph-mon[32572]: pgmap v7792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:35 smithi110 ceph-mon[28069]: pgmap v7792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:38 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13832.061917 secs 2024-04-26T15:38:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:38 smithi193 ceph-mon[32782]: pgmap v7793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:38 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13832.061917 secs 2024-04-26T15:38:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:38 smithi196 ceph-mon[32572]: pgmap v7793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:38 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13832.061917 secs 2024-04-26T15:38:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:38 smithi110 ceph-mon[28069]: pgmap v7793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:40 smithi193 ceph-mon[32782]: pgmap v7794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:40 smithi196 ceph-mon[32572]: pgmap v7794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:40 smithi110 ceph-mon[28069]: pgmap v7794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:42.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:42 smithi110 ceph-mon[28069]: pgmap v7795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:42 smithi193 ceph-mon[32782]: pgmap v7795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:42 smithi196 ceph-mon[32572]: pgmap v7795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:43 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13837.062022 secs 2024-04-26T15:38:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:43 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13837.062022 secs 2024-04-26T15:38:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:43 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13837.062022 secs 2024-04-26T15:38:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:44 smithi193 ceph-mon[32782]: pgmap v7796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:44 smithi196 ceph-mon[32572]: pgmap v7796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:44 smithi110 ceph-mon[28069]: pgmap v7796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:46 smithi193 ceph-mon[32782]: pgmap v7797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:46.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:46 smithi196 ceph-mon[32572]: pgmap v7797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:46 smithi110 ceph-mon[28069]: pgmap v7797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:48.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:48 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13842.062139 secs 2024-04-26T15:38:48.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:48 smithi193 ceph-mon[32782]: pgmap v7798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:48.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:48 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13842.062139 secs 2024-04-26T15:38:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:48 smithi196 ceph-mon[32572]: pgmap v7798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:48 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13842.062139 secs 2024-04-26T15:38:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:48 smithi110 ceph-mon[28069]: pgmap v7798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:50.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:50 smithi196 ceph-mon[32572]: pgmap v7799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:50 smithi110 ceph-mon[28069]: pgmap v7799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:50 smithi193 ceph-mon[32782]: pgmap v7799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:52 smithi196 ceph-mon[32572]: pgmap v7800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:52 smithi110 ceph-mon[28069]: pgmap v7800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:52 smithi193 ceph-mon[32782]: pgmap v7800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:53.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:53 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13847.062291 secs 2024-04-26T15:38:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:53 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13847.062291 secs 2024-04-26T15:38:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:53 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13847.062291 secs 2024-04-26T15:38:54.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:54 smithi196 ceph-mon[32572]: pgmap v7801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:54 smithi110 ceph-mon[28069]: pgmap v7801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:54 smithi193 ceph-mon[32782]: pgmap v7801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:38:56.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:56 smithi196 ceph-mon[32572]: pgmap v7802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:56 smithi110 ceph-mon[28069]: pgmap v7802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:56 smithi193 ceph-mon[32782]: pgmap v7802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:58 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13852.062407 secs 2024-04-26T15:38:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:38:58 smithi196 ceph-mon[32572]: pgmap v7803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:58 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13852.062407 secs 2024-04-26T15:38:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:38:58 smithi110 ceph-mon[28069]: pgmap v7803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:38:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:58 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13852.062407 secs 2024-04-26T15:38:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:38:58 smithi193 ceph-mon[32782]: pgmap v7803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:00 smithi196 ceph-mon[32572]: pgmap v7804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:00 smithi110 ceph-mon[28069]: pgmap v7804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:00 smithi193 ceph-mon[32782]: pgmap v7804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:02 smithi196 ceph-mon[32572]: pgmap v7805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:02 smithi110 ceph-mon[28069]: pgmap v7805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:02 smithi193 ceph-mon[32782]: pgmap v7805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:03 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13857.062546 secs 2024-04-26T15:39:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:03 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13857.062546 secs 2024-04-26T15:39:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:03 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13857.062546 secs 2024-04-26T15:39:04.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:04 smithi196 ceph-mon[32572]: pgmap v7806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:04 smithi110 ceph-mon[28069]: pgmap v7806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:04 smithi193 ceph-mon[32782]: pgmap v7806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:06 smithi196 ceph-mon[32572]: pgmap v7807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:06 smithi110 ceph-mon[28069]: pgmap v7807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:06 smithi193 ceph-mon[32782]: pgmap v7807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:07.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:39:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:39:06.953+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:39:07.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:39:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:39:06.953+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:39:07.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:39:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:39:06.953+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:39:07.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:39:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:39:06.953+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:39:07.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:39:06 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:39:06.953+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:39:08.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:08 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13862.062656 secs 2024-04-26T15:39:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:08 smithi196 ceph-mon[32572]: pgmap v7808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:08 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13862.062656 secs 2024-04-26T15:39:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:08 smithi110 ceph-mon[28069]: pgmap v7808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:08 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13862.062656 secs 2024-04-26T15:39:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:08 smithi193 ceph-mon[32782]: pgmap v7808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:10 smithi196 ceph-mon[32572]: pgmap v7809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:39:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:10 smithi110 ceph-mon[28069]: pgmap v7809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:39:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:10 smithi193 ceph-mon[32782]: pgmap v7809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:39:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:12 smithi196 ceph-mon[32572]: pgmap v7810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:39:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:12 smithi110 ceph-mon[28069]: pgmap v7810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:39:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:12 smithi193 ceph-mon[32782]: pgmap v7810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:39:13.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:13 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13867.062835 secs 2024-04-26T15:39:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:13 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13867.062835 secs 2024-04-26T15:39:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:13 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13867.062835 secs 2024-04-26T15:39:14.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:14 smithi196 ceph-mon[32572]: pgmap v7811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:39:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:14 smithi110 ceph-mon[28069]: pgmap v7811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:39:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:14 smithi193 ceph-mon[32782]: pgmap v7811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:39:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:16 smithi196 ceph-mon[32572]: pgmap v7812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:39:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:16 smithi110 ceph-mon[28069]: pgmap v7812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:39:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:16 smithi193 ceph-mon[32782]: pgmap v7812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:39:18.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:18 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13872.062957 secs 2024-04-26T15:39:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:18 smithi196 ceph-mon[32572]: pgmap v7813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:39:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:18 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13872.062957 secs 2024-04-26T15:39:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:18 smithi110 ceph-mon[28069]: pgmap v7813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:39:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:18 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13872.062957 secs 2024-04-26T15:39:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:18 smithi193 ceph-mon[32782]: pgmap v7813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T15:39:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:39:18.646+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T15:39:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:39:18.646+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T15:39:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:39:18.646+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 109 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T15:39:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:39:18.646+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:39:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:39:18.646+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 109 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T15:39:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:39:18.646+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T15:39:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:39:18.647+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 110 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T15:39:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:39:18.647+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 110 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:39:20.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:20 smithi196 ceph-mon[32572]: pgmap v7814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:39:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:20 smithi110 ceph-mon[28069]: pgmap v7814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:39:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:20 smithi193 ceph-mon[32782]: pgmap v7814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:39:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:22 smithi196 ceph-mon[32572]: pgmap v7815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T15:39:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:22 smithi110 ceph-mon[28069]: pgmap v7815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T15:39:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:22 smithi193 ceph-mon[32782]: pgmap v7815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T15:39:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:23 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13877.063073 secs 2024-04-26T15:39:23.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:23 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13877.063073 secs 2024-04-26T15:39:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:23 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13877.063073 secs 2024-04-26T15:39:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:24 smithi196 ceph-mon[32572]: pgmap v7816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:39:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:39:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:24 smithi110 ceph-mon[28069]: pgmap v7816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:39:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:39:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:24 smithi193 ceph-mon[32782]: pgmap v7816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:39:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:39:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:25.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:39:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:39:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:39:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:39:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:39:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:39:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:39:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:26 smithi196 ceph-mon[32572]: pgmap v7817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T15:39:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:26 smithi196 ceph-mon[32572]: pgmap v7818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:26 smithi110 ceph-mon[28069]: pgmap v7817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T15:39:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:26 smithi110 ceph-mon[28069]: pgmap v7818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:26 smithi193 ceph-mon[32782]: pgmap v7817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T15:39:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:26 smithi193 ceph-mon[32782]: pgmap v7818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:28 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13882.063230 secs 2024-04-26T15:39:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:28 smithi110 ceph-mon[28069]: pgmap v7819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:28 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13882.063230 secs 2024-04-26T15:39:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:28 smithi193 ceph-mon[32782]: pgmap v7819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:28 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13882.063230 secs 2024-04-26T15:39:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:28 smithi196 ceph-mon[32572]: pgmap v7819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:30 smithi110 ceph-mon[28069]: pgmap v7820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:30 smithi193 ceph-mon[32782]: pgmap v7820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:30 smithi196 ceph-mon[32572]: pgmap v7820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:32 smithi110 ceph-mon[28069]: pgmap v7821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:32 smithi193 ceph-mon[32782]: pgmap v7821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:32 smithi196 ceph-mon[32572]: pgmap v7821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:33 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13887.063357 secs 2024-04-26T15:39:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:33 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13887.063357 secs 2024-04-26T15:39:33.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:33 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13887.063357 secs 2024-04-26T15:39:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:34 smithi110 ceph-mon[28069]: pgmap v7822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:34 smithi193 ceph-mon[32782]: pgmap v7822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:34.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:34 smithi196 ceph-mon[32572]: pgmap v7822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:39:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:36 smithi110 ceph-mon[28069]: pgmap v7823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:39:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:36 smithi193 ceph-mon[32782]: pgmap v7823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:39:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:36 smithi196 ceph-mon[32572]: pgmap v7823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:39:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:37 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13892.063495 secs 2024-04-26T15:39:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:37 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13892.063495 secs 2024-04-26T15:39:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:37 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13892.063495 secs 2024-04-26T15:39:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:38 smithi193 ceph-mon[32782]: pgmap v7824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:38 smithi196 ceph-mon[32572]: pgmap v7824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:38 smithi110 ceph-mon[28069]: pgmap v7824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:40 smithi193 ceph-mon[32782]: pgmap v7825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:40.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:40 smithi196 ceph-mon[32572]: pgmap v7825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:40 smithi110 ceph-mon[28069]: pgmap v7825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:42 smithi110 ceph-mon[28069]: pgmap v7826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:42 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13897.063629 secs 2024-04-26T15:39:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:42 smithi193 ceph-mon[32782]: pgmap v7826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:42 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13897.063629 secs 2024-04-26T15:39:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:42 smithi196 ceph-mon[32572]: pgmap v7826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:42 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13897.063629 secs 2024-04-26T15:39:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:44 smithi193 ceph-mon[32782]: pgmap v7827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:44 smithi196 ceph-mon[32572]: pgmap v7827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:44 smithi110 ceph-mon[28069]: pgmap v7827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:46 smithi193 ceph-mon[32782]: pgmap v7828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:46.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:46 smithi196 ceph-mon[32572]: pgmap v7828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:46 smithi110 ceph-mon[28069]: pgmap v7828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:47 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13902.063761 secs 2024-04-26T15:39:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:47 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13902.063761 secs 2024-04-26T15:39:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:47 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13902.063761 secs 2024-04-26T15:39:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:48 smithi193 ceph-mon[32782]: pgmap v7829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:48.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:48 smithi196 ceph-mon[32572]: pgmap v7829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:48 smithi110 ceph-mon[28069]: pgmap v7829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:50 smithi193 ceph-mon[32782]: pgmap v7830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:50 smithi196 ceph-mon[32572]: pgmap v7830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:50 smithi110 ceph-mon[28069]: pgmap v7830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:52 smithi193 ceph-mon[32782]: pgmap v7831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:52 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13907.063877 secs 2024-04-26T15:39:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:52 smithi196 ceph-mon[32572]: pgmap v7831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:52 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13907.063877 secs 2024-04-26T15:39:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:52 smithi110 ceph-mon[28069]: pgmap v7831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:52 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13907.063877 secs 2024-04-26T15:39:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:54 smithi193 ceph-mon[32782]: pgmap v7832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:54 smithi196 ceph-mon[32572]: pgmap v7832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:54 smithi110 ceph-mon[28069]: pgmap v7832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:39:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:56 smithi193 ceph-mon[32782]: pgmap v7833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:56.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:56 smithi196 ceph-mon[32572]: pgmap v7833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:56 smithi110 ceph-mon[28069]: pgmap v7833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:57 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13912.063938 secs 2024-04-26T15:39:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:57 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13912.063938 secs 2024-04-26T15:39:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:57 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13912.063938 secs 2024-04-26T15:39:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:39:58 smithi193 ceph-mon[32782]: pgmap v7834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:39:58 smithi196 ceph-mon[32572]: pgmap v7834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:39:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:39:58 smithi110 ceph-mon[28069]: pgmap v7834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:00 smithi196 ceph-mon[32572]: pgmap v7835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:40:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:00 smithi110 ceph-mon[28069]: pgmap v7835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:40:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:00 smithi193 ceph-mon[32782]: pgmap v7835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:40:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:02 smithi196 ceph-mon[32572]: pgmap v7836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:02 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13917.064040 secs 2024-04-26T15:40:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:02 smithi110 ceph-mon[28069]: pgmap v7836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:02 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13917.064040 secs 2024-04-26T15:40:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:02 smithi193 ceph-mon[32782]: pgmap v7836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:02 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13917.064040 secs 2024-04-26T15:40:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:04 smithi196 ceph-mon[32572]: pgmap v7837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:04 smithi110 ceph-mon[28069]: pgmap v7837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:04 smithi193 ceph-mon[32782]: pgmap v7837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:06 smithi196 ceph-mon[32572]: pgmap v7838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:06 smithi110 ceph-mon[28069]: pgmap v7838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:06 smithi193 ceph-mon[32782]: pgmap v7838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:07 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13922.064155 secs 2024-04-26T15:40:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:07 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13922.064155 secs 2024-04-26T15:40:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:07 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13922.064155 secs 2024-04-26T15:40:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:08 smithi196 ceph-mon[32572]: pgmap v7839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:08 smithi110 ceph-mon[28069]: pgmap v7839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:08 smithi193 ceph-mon[32782]: pgmap v7839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:10 smithi196 ceph-mon[32572]: pgmap v7840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:10 smithi110 ceph-mon[28069]: pgmap v7840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:10 smithi193 ceph-mon[32782]: pgmap v7840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:12 smithi196 ceph-mon[32572]: pgmap v7841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:12 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13927.064271 secs 2024-04-26T15:40:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:12 smithi110 ceph-mon[28069]: pgmap v7841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:12 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13927.064271 secs 2024-04-26T15:40:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:12 smithi193 ceph-mon[32782]: pgmap v7841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:12 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13927.064271 secs 2024-04-26T15:40:14.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:14 smithi196 ceph-mon[32572]: pgmap v7842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:14 smithi110 ceph-mon[28069]: pgmap v7842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:14 smithi193 ceph-mon[32782]: pgmap v7842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:16 smithi196 ceph-mon[32572]: pgmap v7843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:16 smithi110 ceph-mon[28069]: pgmap v7843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:16 smithi193 ceph-mon[32782]: pgmap v7843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:17 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13932.064386 secs 2024-04-26T15:40:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:17 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13932.064386 secs 2024-04-26T15:40:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:17 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13932.064386 secs 2024-04-26T15:40:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:18 smithi196 ceph-mon[32572]: pgmap v7844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:18.771 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:18 smithi193 ceph-mon[32782]: pgmap v7844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:18 smithi110 ceph-mon[28069]: pgmap v7844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:20 smithi196 ceph-mon[32572]: pgmap v7845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:20 smithi110 ceph-mon[28069]: pgmap v7845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:20 smithi193 ceph-mon[32782]: pgmap v7845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:22 smithi196 ceph-mon[32572]: pgmap v7846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:22 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13937.064540 secs 2024-04-26T15:40:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:22 smithi110 ceph-mon[28069]: pgmap v7846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:22 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13937.064540 secs 2024-04-26T15:40:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:22 smithi193 ceph-mon[32782]: pgmap v7846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:22 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13937.064540 secs 2024-04-26T15:40:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:24 smithi196 ceph-mon[32572]: pgmap v7847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:24 smithi110 ceph-mon[28069]: pgmap v7847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:24 smithi193 ceph-mon[32782]: pgmap v7847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:25.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:40:25.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:40:25.825 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:40:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:26 smithi110 ceph-mon[28069]: pgmap v7848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:26 smithi196 ceph-mon[32572]: pgmap v7848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:26 smithi193 ceph-mon[32782]: pgmap v7848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13942.064585 secs 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: pgmap v7849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13942.064585 secs 2024-04-26T15:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: pgmap v7849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13942.064585 secs 2024-04-26T15:40:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: pgmap v7849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:29 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:40:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:29 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:40:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:29 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:40:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:29 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:40:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:29.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:29 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:40:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:29 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:40:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:29 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:40:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:29 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:40:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:29 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:40:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:29 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:40:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:29 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:40:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:29 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:40:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:30.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:30 smithi193 ceph-mon[32782]: pgmap v7850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:30 smithi196 ceph-mon[32572]: pgmap v7850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:30 smithi110 ceph-mon[28069]: pgmap v7850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: pgmap v7851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T15:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: pgmap v7852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:40:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:40:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: pgmap v7851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T15:40:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: pgmap v7852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:40:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:40:31.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: pgmap v7851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T15:40:31.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: pgmap v7852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:31.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:40:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:32 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13947.064705 secs 2024-04-26T15:40:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:32 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13947.064705 secs 2024-04-26T15:40:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:32 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13947.064705 secs 2024-04-26T15:40:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:33 smithi193 ceph-mon[32782]: pgmap v7853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:33.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:33 smithi196 ceph-mon[32572]: pgmap v7853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:33 smithi110 ceph-mon[28069]: pgmap v7853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:35.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:35 smithi196 ceph-mon[32572]: pgmap v7854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:35 smithi110 ceph-mon[28069]: pgmap v7854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:35 smithi193 ceph-mon[32782]: pgmap v7854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:37 smithi196 ceph-mon[32572]: pgmap v7855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:37 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13952.064796 secs 2024-04-26T15:40:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:37 smithi110 ceph-mon[28069]: pgmap v7855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:37 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13952.064796 secs 2024-04-26T15:40:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:37 smithi193 ceph-mon[32782]: pgmap v7855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:37 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13952.064796 secs 2024-04-26T15:40:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:39 smithi196 ceph-mon[32572]: pgmap v7856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:39 smithi110 ceph-mon[28069]: pgmap v7856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:39 smithi193 ceph-mon[32782]: pgmap v7856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:40:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:41 smithi196 ceph-mon[32572]: pgmap v7857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:40:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:41 smithi110 ceph-mon[28069]: pgmap v7857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:40:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:41 smithi193 ceph-mon[32782]: pgmap v7857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:40:42.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:42 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13957.064949 secs 2024-04-26T15:40:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:42 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13957.064949 secs 2024-04-26T15:40:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:42 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13957.064949 secs 2024-04-26T15:40:43.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:43 smithi196 ceph-mon[32572]: pgmap v7858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:43 smithi110 ceph-mon[28069]: pgmap v7858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:43 smithi193 ceph-mon[32782]: pgmap v7858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:45.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:45 smithi196 ceph-mon[32572]: pgmap v7859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:45 smithi110 ceph-mon[28069]: pgmap v7859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:45 smithi193 ceph-mon[32782]: pgmap v7859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:47 smithi196 ceph-mon[32572]: pgmap v7860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:47 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13962.065067 secs 2024-04-26T15:40:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:47 smithi110 ceph-mon[28069]: pgmap v7860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:47 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13962.065067 secs 2024-04-26T15:40:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:47 smithi193 ceph-mon[32782]: pgmap v7860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:47 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13962.065067 secs 2024-04-26T15:40:49.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:49 smithi196 ceph-mon[32572]: pgmap v7861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:49 smithi110 ceph-mon[28069]: pgmap v7861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:49 smithi193 ceph-mon[32782]: pgmap v7861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:51.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:51 smithi196 ceph-mon[32572]: pgmap v7862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:51 smithi110 ceph-mon[28069]: pgmap v7862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:51 smithi193 ceph-mon[32782]: pgmap v7862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:52 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13967.065201 secs 2024-04-26T15:40:52.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:52 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13967.065201 secs 2024-04-26T15:40:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:52 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13967.065201 secs 2024-04-26T15:40:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:53 smithi196 ceph-mon[32572]: pgmap v7863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:53 smithi110 ceph-mon[28069]: pgmap v7863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:53 smithi193 ceph-mon[32782]: pgmap v7863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:55.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:55 smithi196 ceph-mon[32572]: pgmap v7864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:55 smithi110 ceph-mon[28069]: pgmap v7864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:55 smithi193 ceph-mon[32782]: pgmap v7864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:57 smithi196 ceph-mon[32572]: pgmap v7865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:57 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13972.065310 secs 2024-04-26T15:40:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:57 smithi110 ceph-mon[28069]: pgmap v7865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:57 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13972.065310 secs 2024-04-26T15:40:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:57 smithi193 ceph-mon[32782]: pgmap v7865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:40:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:57 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13972.065310 secs 2024-04-26T15:40:59.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:40:59 smithi196 ceph-mon[32572]: pgmap v7866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:40:59 smithi110 ceph-mon[28069]: pgmap v7866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:40:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:40:59 smithi193 ceph-mon[32782]: pgmap v7866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:01 smithi196 ceph-mon[32572]: pgmap v7867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:01.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:01 smithi110 ceph-mon[28069]: pgmap v7867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:01 smithi193 ceph-mon[32782]: pgmap v7867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:02 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13977.065401 secs 2024-04-26T15:41:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:02 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13977.065401 secs 2024-04-26T15:41:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:02 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13977.065401 secs 2024-04-26T15:41:03.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:03 smithi196 ceph-mon[32572]: pgmap v7868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:03 smithi110 ceph-mon[28069]: pgmap v7868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:03 smithi193 ceph-mon[32782]: pgmap v7868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:05 smithi110 ceph-mon[28069]: pgmap v7869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:05 smithi193 ceph-mon[32782]: pgmap v7869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:06.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:05 smithi196 ceph-mon[32572]: pgmap v7869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:07 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13982.065522 secs 2024-04-26T15:41:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:07 smithi110 ceph-mon[28069]: pgmap v7870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:07 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13982.065522 secs 2024-04-26T15:41:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:07 smithi193 ceph-mon[32782]: pgmap v7870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:07 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13982.065522 secs 2024-04-26T15:41:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:07 smithi196 ceph-mon[32572]: pgmap v7870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:09 smithi110 ceph-mon[28069]: pgmap v7871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:09 smithi193 ceph-mon[32782]: pgmap v7871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:09 smithi196 ceph-mon[32572]: pgmap v7871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:11 smithi110 ceph-mon[28069]: pgmap v7872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:11 smithi193 ceph-mon[32782]: pgmap v7872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:11 smithi196 ceph-mon[32572]: pgmap v7872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:12 smithi110 ceph-mon[28069]: 13 slow requests, 1 included below; oldest blocked for > 13987.065636 secs 2024-04-26T15:41:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:12 smithi110 ceph-mon[28069]: slow request 724.690521 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:41:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:12 smithi193 ceph-mon[32782]: 13 slow requests, 1 included below; oldest blocked for > 13987.065636 secs 2024-04-26T15:41:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:12 smithi193 ceph-mon[32782]: slow request 724.690521 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:41:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:12 smithi196 ceph-mon[32572]: 13 slow requests, 1 included below; oldest blocked for > 13987.065636 secs 2024-04-26T15:41:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:12 smithi196 ceph-mon[32572]: slow request 724.690521 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:41:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:13 smithi110 ceph-mon[28069]: pgmap v7873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:13 smithi193 ceph-mon[32782]: pgmap v7873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:13 smithi196 ceph-mon[32572]: pgmap v7873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:14 smithi193 ceph-mon[32782]: pgmap v7874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:14 smithi196 ceph-mon[32572]: pgmap v7874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:14 smithi110 ceph-mon[28069]: pgmap v7874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:17 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13992.065720 secs 2024-04-26T15:41:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:17 smithi196 ceph-mon[32572]: pgmap v7875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:17 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13992.065720 secs 2024-04-26T15:41:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:17 smithi110 ceph-mon[28069]: pgmap v7875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:17 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13992.065720 secs 2024-04-26T15:41:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:17 smithi193 ceph-mon[32782]: pgmap v7875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:19.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:19 smithi196 ceph-mon[32572]: pgmap v7876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:19 smithi110 ceph-mon[28069]: pgmap v7876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:19 smithi193 ceph-mon[32782]: pgmap v7876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:21.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:21 smithi196 ceph-mon[32572]: pgmap v7877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:21 smithi110 ceph-mon[28069]: pgmap v7877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:21 smithi193 ceph-mon[32782]: pgmap v7877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:22 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 13997.065813 secs 2024-04-26T15:41:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:22 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 13997.065813 secs 2024-04-26T15:41:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:22 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 13997.065813 secs 2024-04-26T15:41:23.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:23 smithi196 ceph-mon[32572]: pgmap v7878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:23 smithi110 ceph-mon[28069]: pgmap v7878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:23 smithi193 ceph-mon[32782]: pgmap v7878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:25.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:25 smithi196 ceph-mon[32572]: pgmap v7879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:25 smithi110 ceph-mon[28069]: pgmap v7879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:25 smithi193 ceph-mon[32782]: pgmap v7879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:27 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 14002.065907 secs 2024-04-26T15:41:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:27 smithi196 ceph-mon[32572]: pgmap v7880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:27 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 14002.065907 secs 2024-04-26T15:41:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:27 smithi110 ceph-mon[28069]: pgmap v7880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:27 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 14002.065907 secs 2024-04-26T15:41:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:27 smithi193 ceph-mon[32782]: pgmap v7880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:29.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:29 smithi196 ceph-mon[32572]: pgmap v7881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:29 smithi110 ceph-mon[28069]: pgmap v7881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:29 smithi193 ceph-mon[32782]: pgmap v7881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:31.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:31 smithi196 ceph-mon[32572]: pgmap v7882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:41:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:31 smithi110 ceph-mon[28069]: pgmap v7882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:41:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:31 smithi193 ceph-mon[32782]: pgmap v7882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:41:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:32 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 14007.066019 secs 2024-04-26T15:41:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:41:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:41:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:41:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:32 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 14007.066019 secs 2024-04-26T15:41:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:41:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:41:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:41:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:32 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 14007.066019 secs 2024-04-26T15:41:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:41:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:41:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:41:33.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:33 smithi196 ceph-mon[32572]: pgmap v7883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:41:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:33 smithi196 ceph-mon[32572]: pgmap v7884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:41:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:33 smithi110 ceph-mon[28069]: pgmap v7883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:41:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:33 smithi110 ceph-mon[28069]: pgmap v7884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:41:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:33 smithi193 ceph-mon[32782]: pgmap v7883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:41:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:33 smithi193 ceph-mon[32782]: pgmap v7884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:41:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:35 smithi196 ceph-mon[32572]: pgmap v7885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:35 smithi110 ceph-mon[28069]: pgmap v7885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:35 smithi193 ceph-mon[32782]: pgmap v7885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:37 smithi196 ceph-mon[32572]: pgmap v7886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:37 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 14012.066095 secs 2024-04-26T15:41:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:37 smithi110 ceph-mon[28069]: pgmap v7886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:37 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 14012.066095 secs 2024-04-26T15:41:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:37 smithi193 ceph-mon[32782]: pgmap v7886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:37 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 14012.066095 secs 2024-04-26T15:41:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:39 smithi196 ceph-mon[32572]: pgmap v7887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:39 smithi110 ceph-mon[28069]: pgmap v7887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:39 smithi193 ceph-mon[32782]: pgmap v7887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:41 smithi196 ceph-mon[32572]: pgmap v7888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:41.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:41 smithi110 ceph-mon[28069]: pgmap v7888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:41 smithi193 ceph-mon[32782]: pgmap v7888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:41:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:42 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 14017.066242 secs 2024-04-26T15:41:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:42 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 14017.066242 secs 2024-04-26T15:41:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:42 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 14017.066242 secs 2024-04-26T15:41:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:43 smithi110 ceph-mon[28069]: pgmap v7889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:41:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:43 smithi193 ceph-mon[32782]: pgmap v7889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:41:44.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:43 smithi196 ceph-mon[32572]: pgmap v7889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:41:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:45 smithi110 ceph-mon[28069]: pgmap v7890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:45 smithi193 ceph-mon[32782]: pgmap v7890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:45 smithi196 ceph-mon[32572]: pgmap v7890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:47 smithi110 ceph-mon[28069]: pgmap v7891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:47 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 14022.066379 secs 2024-04-26T15:41:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:47 smithi193 ceph-mon[32782]: pgmap v7891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:47 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 14022.066379 secs 2024-04-26T15:41:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:47 smithi196 ceph-mon[32572]: pgmap v7891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:47 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 14022.066379 secs 2024-04-26T15:41:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:49 smithi110 ceph-mon[28069]: pgmap v7892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:49 smithi193 ceph-mon[32782]: pgmap v7892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:49 smithi196 ceph-mon[32572]: pgmap v7892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:50 smithi193 ceph-mon[32782]: pgmap v7893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:50 smithi196 ceph-mon[32572]: pgmap v7893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:51.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:50 smithi110 ceph-mon[28069]: pgmap v7893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:52 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 14027.066474 secs 2024-04-26T15:41:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:52 smithi196 ceph-mon[32572]: pgmap v7894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:52 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 14027.066474 secs 2024-04-26T15:41:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:52 smithi110 ceph-mon[28069]: pgmap v7894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:52 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 14027.066474 secs 2024-04-26T15:41:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:52 smithi193 ceph-mon[32782]: pgmap v7894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:54 smithi196 ceph-mon[32572]: pgmap v7895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:54 smithi110 ceph-mon[28069]: pgmap v7895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:54 smithi193 ceph-mon[32782]: pgmap v7895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:56 smithi196 ceph-mon[32572]: pgmap v7896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:56 smithi110 ceph-mon[28069]: pgmap v7896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:56 smithi193 ceph-mon[32782]: pgmap v7896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:41:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:58 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 14032.066584 secs 2024-04-26T15:41:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:58 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 14032.066584 secs 2024-04-26T15:41:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:58 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 14032.066584 secs 2024-04-26T15:41:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:41:59 smithi110 ceph-mon[28069]: pgmap v7897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:41:59 smithi193 ceph-mon[32782]: pgmap v7897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:41:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:41:59 smithi196 ceph-mon[32572]: pgmap v7897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:01 smithi110 ceph-mon[28069]: pgmap v7898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:01 smithi193 ceph-mon[32782]: pgmap v7898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:01.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:01 smithi196 ceph-mon[32572]: pgmap v7898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:03 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 14037.066648 secs 2024-04-26T15:42:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:03 smithi110 ceph-mon[28069]: pgmap v7899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:03 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 14037.066648 secs 2024-04-26T15:42:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:03 smithi193 ceph-mon[32782]: pgmap v7899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:03.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:03 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 14037.066648 secs 2024-04-26T15:42:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:03 smithi196 ceph-mon[32572]: pgmap v7899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:05 smithi193 ceph-mon[32782]: pgmap v7900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:05.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:05 smithi196 ceph-mon[32572]: pgmap v7900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:05 smithi110 ceph-mon[28069]: pgmap v7900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:07 smithi193 ceph-mon[32782]: pgmap v7901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:07.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:07 smithi196 ceph-mon[32572]: pgmap v7901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:07 smithi110 ceph-mon[28069]: pgmap v7901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:08.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:08 smithi196 ceph-mon[32572]: 13 slow requests, 0 included below; oldest blocked for > 14042.066760 secs 2024-04-26T15:42:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:08 smithi110 ceph-mon[28069]: 13 slow requests, 0 included below; oldest blocked for > 14042.066760 secs 2024-04-26T15:42:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:08 smithi193 ceph-mon[32782]: 13 slow requests, 0 included below; oldest blocked for > 14042.066760 secs 2024-04-26T15:42:09.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:09 smithi196 ceph-mon[32572]: pgmap v7902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:09 smithi110 ceph-mon[28069]: pgmap v7902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:09 smithi193 ceph-mon[32782]: pgmap v7902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:11 smithi196 ceph-mon[32572]: pgmap v7903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:11 smithi110 ceph-mon[28069]: pgmap v7903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:11 smithi193 ceph-mon[32782]: pgmap v7903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:13 smithi196 ceph-mon[32572]: 14 slow requests, 1 included below; oldest blocked for > 14047.066834 secs 2024-04-26T15:42:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:13 smithi196 ceph-mon[32572]: slow request 184.402966 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:42:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:13 smithi196 ceph-mon[32572]: pgmap v7904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:13 smithi110 ceph-mon[28069]: 14 slow requests, 1 included below; oldest blocked for > 14047.066834 secs 2024-04-26T15:42:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:13 smithi110 ceph-mon[28069]: slow request 184.402966 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:42:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:13 smithi110 ceph-mon[28069]: pgmap v7904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:13 smithi193 ceph-mon[32782]: 14 slow requests, 1 included below; oldest blocked for > 14047.066834 secs 2024-04-26T15:42:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:13 smithi193 ceph-mon[32782]: slow request 184.402966 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:42:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:13 smithi193 ceph-mon[32782]: pgmap v7904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:14.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:14 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:42:14.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:14 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:42:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:14 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:42:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:14 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:42:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:14 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:42:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:14 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:42:15.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:15 smithi196 ceph-mon[32572]: pgmap v7905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:15 smithi110 ceph-mon[28069]: pgmap v7905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:15 smithi193 ceph-mon[32782]: pgmap v7905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:17.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:17 smithi196 ceph-mon[32572]: pgmap v7906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:17.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:17 smithi110 ceph-mon[28069]: pgmap v7906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:17 smithi193 ceph-mon[32782]: pgmap v7906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:18.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:18 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14052.066898 secs 2024-04-26T15:42:18.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:18 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14052.066898 secs 2024-04-26T15:42:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:18 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14052.066898 secs 2024-04-26T15:42:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:42:18.676+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:42:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:42:18.676+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T15:42:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:42:18.677+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 111 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T15:42:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:42:18.677+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 111 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:42:19.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:19 smithi196 ceph-mon[32572]: pgmap v7907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:19.521 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:19 smithi193 ceph-mon[32782]: pgmap v7907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:19 smithi110 ceph-mon[28069]: pgmap v7907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:21.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:21 smithi196 ceph-mon[32572]: pgmap v7908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:21 smithi110 ceph-mon[28069]: pgmap v7908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:21 smithi193 ceph-mon[32782]: pgmap v7908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:23.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:23 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14057.067020 secs 2024-04-26T15:42:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:23 smithi196 ceph-mon[32572]: pgmap v7909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:23 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14057.067020 secs 2024-04-26T15:42:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:23 smithi110 ceph-mon[28069]: pgmap v7909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:23 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14057.067020 secs 2024-04-26T15:42:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:23 smithi193 ceph-mon[32782]: pgmap v7909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:25.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:25 smithi196 ceph-mon[32572]: pgmap v7910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:25 smithi110 ceph-mon[28069]: pgmap v7910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:25 smithi193 ceph-mon[32782]: pgmap v7910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:27 smithi196 ceph-mon[32572]: pgmap v7911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:27 smithi110 ceph-mon[28069]: pgmap v7911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:27 smithi193 ceph-mon[32782]: pgmap v7911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:28.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:28 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14062.067136 secs 2024-04-26T15:42:28.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:28 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14062.067136 secs 2024-04-26T15:42:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:28 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14062.067136 secs 2024-04-26T15:42:29.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:29 smithi196 ceph-mon[32572]: pgmap v7912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:29.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:29 smithi110 ceph-mon[28069]: pgmap v7912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:29 smithi193 ceph-mon[32782]: pgmap v7912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:31.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:31 smithi196 ceph-mon[32572]: pgmap v7913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:31.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:31 smithi110 ceph-mon[28069]: pgmap v7913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:31 smithi193 ceph-mon[32782]: pgmap v7913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:42:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:42:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:42:33.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:33 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14067.067252 secs 2024-04-26T15:42:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:33 smithi196 ceph-mon[32572]: pgmap v7914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:33.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:33 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14067.067252 secs 2024-04-26T15:42:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:33 smithi110 ceph-mon[28069]: pgmap v7914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:33 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14067.067252 secs 2024-04-26T15:42:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:33 smithi193 ceph-mon[32782]: pgmap v7914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:34.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:42:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:42:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:34 smithi196 ceph-mon[32572]: pgmap v7915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:42:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:34 smithi196 ceph-mon[32572]: pgmap v7916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:42:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:42:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:42:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:34 smithi110 ceph-mon[28069]: pgmap v7915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:42:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:34 smithi110 ceph-mon[28069]: pgmap v7916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:42:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:42:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:42:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:34 smithi193 ceph-mon[32782]: pgmap v7915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:42:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:34 smithi193 ceph-mon[32782]: pgmap v7916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:42:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:36 smithi196 ceph-mon[32572]: pgmap v7917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:36 smithi110 ceph-mon[28069]: pgmap v7917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:36 smithi193 ceph-mon[32782]: pgmap v7917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:37 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14072.067402 secs 2024-04-26T15:42:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:37 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14072.067402 secs 2024-04-26T15:42:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:37 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14072.067402 secs 2024-04-26T15:42:38.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:38 smithi110 ceph-mon[28069]: pgmap v7918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:38 smithi193 ceph-mon[32782]: pgmap v7918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:39.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:38 smithi196 ceph-mon[32572]: pgmap v7918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:40 smithi110 ceph-mon[28069]: pgmap v7919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:40 smithi193 ceph-mon[32782]: pgmap v7919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:40 smithi196 ceph-mon[32572]: pgmap v7919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:42 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14077.067541 secs 2024-04-26T15:42:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:42 smithi110 ceph-mon[28069]: pgmap v7920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:42 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14077.067541 secs 2024-04-26T15:42:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:42 smithi193 ceph-mon[32782]: pgmap v7920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:42 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14077.067541 secs 2024-04-26T15:42:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:42 smithi196 ceph-mon[32572]: pgmap v7920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:42:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:44 smithi110 ceph-mon[28069]: pgmap v7921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:42:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:44 smithi193 ceph-mon[32782]: pgmap v7921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:42:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:44 smithi196 ceph-mon[32572]: pgmap v7921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:42:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:46 smithi110 ceph-mon[28069]: pgmap v7922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:46 smithi193 ceph-mon[32782]: pgmap v7922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:46 smithi196 ceph-mon[32572]: pgmap v7922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:47 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14082.067641 secs 2024-04-26T15:42:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:47 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14082.067641 secs 2024-04-26T15:42:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:47 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14082.067641 secs 2024-04-26T15:42:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:48 smithi193 ceph-mon[32782]: pgmap v7923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:48 smithi196 ceph-mon[32572]: pgmap v7923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:48 smithi110 ceph-mon[28069]: pgmap v7923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:50 smithi193 ceph-mon[32782]: pgmap v7924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:50 smithi196 ceph-mon[32572]: pgmap v7924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:50 smithi110 ceph-mon[28069]: pgmap v7924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:51 smithi193 ceph-mon[32782]: pgmap v7925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:51 smithi196 ceph-mon[32572]: pgmap v7925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:51 smithi110 ceph-mon[28069]: pgmap v7925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:52 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14087.067755 secs 2024-04-26T15:42:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:52 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14087.067755 secs 2024-04-26T15:42:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:52 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14087.067755 secs 2024-04-26T15:42:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:53 smithi193 ceph-mon[32782]: pgmap v7926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:53 smithi196 ceph-mon[32572]: pgmap v7926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:53 smithi110 ceph-mon[28069]: pgmap v7926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:56 smithi110 ceph-mon[28069]: pgmap v7927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:56 smithi193 ceph-mon[32782]: pgmap v7927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:56 smithi196 ceph-mon[32572]: pgmap v7927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:42:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:57 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14092.067881 secs 2024-04-26T15:42:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:57 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14092.067881 secs 2024-04-26T15:42:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:57 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14092.067881 secs 2024-04-26T15:42:58.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:42:58 smithi110 ceph-mon[28069]: pgmap v7928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:42:58 smithi193 ceph-mon[32782]: pgmap v7928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:42:59.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:42:58 smithi196 ceph-mon[32572]: pgmap v7928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:00 smithi110 ceph-mon[28069]: pgmap v7929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:00 smithi193 ceph-mon[32782]: pgmap v7929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:00 smithi196 ceph-mon[32572]: pgmap v7929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:02 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14097.067998 secs 2024-04-26T15:43:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:02 smithi110 ceph-mon[28069]: pgmap v7930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:02 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14097.067998 secs 2024-04-26T15:43:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:02 smithi193 ceph-mon[32782]: pgmap v7930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:02 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14097.067998 secs 2024-04-26T15:43:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:02 smithi196 ceph-mon[32572]: pgmap v7930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:04 smithi110 ceph-mon[28069]: pgmap v7931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:04 smithi193 ceph-mon[32782]: pgmap v7931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:05.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:04 smithi196 ceph-mon[32572]: pgmap v7931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:06 smithi193 ceph-mon[32782]: pgmap v7932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:06 smithi196 ceph-mon[32572]: pgmap v7932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:06 smithi110 ceph-mon[28069]: pgmap v7932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:07 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14102.068095 secs 2024-04-26T15:43:08.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:07 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14102.068095 secs 2024-04-26T15:43:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:07 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14102.068095 secs 2024-04-26T15:43:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:08 smithi193 ceph-mon[32782]: pgmap v7933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:08 smithi196 ceph-mon[32572]: pgmap v7933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:08 smithi110 ceph-mon[28069]: pgmap v7933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:09 smithi193 ceph-mon[32782]: pgmap v7934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:09 smithi196 ceph-mon[32572]: pgmap v7934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:09 smithi110 ceph-mon[28069]: pgmap v7934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:12 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14107.068209 secs 2024-04-26T15:43:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:12 smithi110 ceph-mon[28069]: pgmap v7935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:12 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14107.068209 secs 2024-04-26T15:43:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:12 smithi193 ceph-mon[32782]: pgmap v7935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:12 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14107.068209 secs 2024-04-26T15:43:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:12 smithi196 ceph-mon[32572]: pgmap v7935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:14 smithi110 ceph-mon[28069]: pgmap v7936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:14 smithi193 ceph-mon[32782]: pgmap v7936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:14 smithi196 ceph-mon[32572]: pgmap v7936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:16 smithi110 ceph-mon[28069]: pgmap v7937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:16 smithi193 ceph-mon[32782]: pgmap v7937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:16 smithi196 ceph-mon[32572]: pgmap v7937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:17 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14112.068330 secs 2024-04-26T15:43:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:17 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14112.068330 secs 2024-04-26T15:43:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:17 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14112.068330 secs 2024-04-26T15:43:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:18 smithi110 ceph-mon[28069]: pgmap v7938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:18 smithi193 ceph-mon[32782]: pgmap v7938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:19.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:18 smithi196 ceph-mon[32572]: pgmap v7938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:20 smithi193 ceph-mon[32782]: pgmap v7939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:20 smithi196 ceph-mon[32572]: pgmap v7939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:20 smithi110 ceph-mon[28069]: pgmap v7939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:22 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14117.068449 secs 2024-04-26T15:43:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:22 smithi193 ceph-mon[32782]: pgmap v7940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:22 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14117.068449 secs 2024-04-26T15:43:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:22 smithi196 ceph-mon[32572]: pgmap v7940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:22 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14117.068449 secs 2024-04-26T15:43:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:22 smithi110 ceph-mon[28069]: pgmap v7940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:24 smithi193 ceph-mon[32782]: pgmap v7941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:24 smithi196 ceph-mon[32572]: pgmap v7941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:24 smithi110 ceph-mon[28069]: pgmap v7941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:25 smithi193 ceph-mon[32782]: pgmap v7942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:25 smithi196 ceph-mon[32572]: pgmap v7942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:25 smithi110 ceph-mon[28069]: pgmap v7942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:27 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14122.068594 secs 2024-04-26T15:43:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:27 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14122.068594 secs 2024-04-26T15:43:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:27 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14122.068594 secs 2024-04-26T15:43:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:28 smithi196 ceph-mon[32572]: pgmap v7943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:28 smithi110 ceph-mon[28069]: pgmap v7943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:28 smithi193 ceph-mon[32782]: pgmap v7943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:30 smithi110 ceph-mon[28069]: pgmap v7944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:30 smithi193 ceph-mon[32782]: pgmap v7944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:31.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:30 smithi196 ceph-mon[32572]: pgmap v7944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:32 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14127.068690 secs 2024-04-26T15:43:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:32 smithi110 ceph-mon[28069]: pgmap v7945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:32 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14127.068690 secs 2024-04-26T15:43:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:32 smithi193 ceph-mon[32782]: pgmap v7945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:32 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14127.068690 secs 2024-04-26T15:43:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:32 smithi196 ceph-mon[32572]: pgmap v7945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:34 smithi110 ceph-mon[28069]: pgmap v7946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:43:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:34 smithi193 ceph-mon[32782]: pgmap v7946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:43:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:34 smithi196 ceph-mon[32572]: pgmap v7946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:43:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:43:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:43:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:43:36.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:43:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:43:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:43:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:43:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:43:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:43:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:36 smithi193 ceph-mon[32782]: pgmap v7947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:43:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:36 smithi193 ceph-mon[32782]: pgmap v7948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:43:37.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:36 smithi196 ceph-mon[32572]: pgmap v7947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:43:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:36 smithi196 ceph-mon[32572]: pgmap v7948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:43:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:36 smithi110 ceph-mon[28069]: pgmap v7947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:43:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:36 smithi110 ceph-mon[28069]: pgmap v7948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:43:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:37 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14132.068750 secs 2024-04-26T15:43:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:37 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14132.068750 secs 2024-04-26T15:43:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:37 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14132.068750 secs 2024-04-26T15:43:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:38 smithi193 ceph-mon[32782]: pgmap v7949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:43:39.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:38 smithi196 ceph-mon[32572]: pgmap v7949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:43:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:38 smithi110 ceph-mon[28069]: pgmap v7949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T15:43:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:39 smithi193 ceph-mon[32782]: pgmap v7950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:43:40.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:39 smithi196 ceph-mon[32572]: pgmap v7950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:43:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:39 smithi110 ceph-mon[28069]: pgmap v7950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:43:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:42 smithi193 ceph-mon[32782]: pgmap v7951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:43:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:42 smithi196 ceph-mon[32572]: pgmap v7951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:43:42.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:42 smithi110 ceph-mon[28069]: pgmap v7951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:43:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:43 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14137.068831 secs 2024-04-26T15:43:43.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:43 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14137.068831 secs 2024-04-26T15:43:43.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:43 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14137.068831 secs 2024-04-26T15:43:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:44 smithi193 ceph-mon[32782]: pgmap v7952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T15:43:44.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:44 smithi110 ceph-mon[28069]: pgmap v7952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T15:43:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:44 smithi196 ceph-mon[32572]: pgmap v7952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T15:43:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:46 smithi193 ceph-mon[32782]: pgmap v7953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T15:43:46.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:46 smithi196 ceph-mon[32572]: pgmap v7953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T15:43:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:46 smithi110 ceph-mon[28069]: pgmap v7953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T15:43:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:48 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14142.068944 secs 2024-04-26T15:43:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:48 smithi193 ceph-mon[32782]: pgmap v7954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:43:48.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:48 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14142.068944 secs 2024-04-26T15:43:48.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:48 smithi196 ceph-mon[32572]: pgmap v7954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:43:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:48 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14142.068944 secs 2024-04-26T15:43:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:48 smithi110 ceph-mon[28069]: pgmap v7954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:43:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:50 smithi193 ceph-mon[32782]: pgmap v7955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:50.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:50 smithi196 ceph-mon[32572]: pgmap v7955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:50 smithi110 ceph-mon[28069]: pgmap v7955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:52 smithi193 ceph-mon[32782]: pgmap v7956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:43:52.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:52 smithi196 ceph-mon[32572]: pgmap v7956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:43:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:52 smithi110 ceph-mon[28069]: pgmap v7956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:43:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:53 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14147.069068 secs 2024-04-26T15:43:53.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:53 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14147.069068 secs 2024-04-26T15:43:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:53 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14147.069068 secs 2024-04-26T15:43:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:54 smithi193 ceph-mon[32782]: pgmap v7957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:54.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:54 smithi196 ceph-mon[32572]: pgmap v7957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:54 smithi110 ceph-mon[28069]: pgmap v7957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:43:56.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:56 smithi196 ceph-mon[32572]: pgmap v7958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:56 smithi110 ceph-mon[28069]: pgmap v7958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:56 smithi193 ceph-mon[32782]: pgmap v7958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:58 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14152.069186 secs 2024-04-26T15:43:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:43:58 smithi196 ceph-mon[32572]: pgmap v7959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:58 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14152.069186 secs 2024-04-26T15:43:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:43:58 smithi110 ceph-mon[28069]: pgmap v7959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:43:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:58 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14152.069186 secs 2024-04-26T15:43:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:43:58 smithi193 ceph-mon[32782]: pgmap v7959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:00 smithi196 ceph-mon[32572]: pgmap v7960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:00 smithi110 ceph-mon[28069]: pgmap v7960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:00 smithi193 ceph-mon[32782]: pgmap v7960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:02 smithi196 ceph-mon[32572]: pgmap v7961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:02 smithi110 ceph-mon[28069]: pgmap v7961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:02 smithi193 ceph-mon[32782]: pgmap v7961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:03.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:03 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14157.069306 secs 2024-04-26T15:44:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:03 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14157.069306 secs 2024-04-26T15:44:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:03 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14157.069306 secs 2024-04-26T15:44:04.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:04 smithi196 ceph-mon[32572]: pgmap v7962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:04 smithi110 ceph-mon[28069]: pgmap v7962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:04 smithi193 ceph-mon[32782]: pgmap v7962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:06 smithi196 ceph-mon[32572]: pgmap v7963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:06 smithi110 ceph-mon[28069]: pgmap v7963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:06 smithi193 ceph-mon[32782]: pgmap v7963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:07.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:44:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:44:07.178+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:44:07.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:44:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:44:07.178+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:44:07.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:44:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:44:07.178+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:44:07.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:44:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:44:07.178+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:44:07.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:44:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:44:07.178+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:44:08.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:08 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14162.069379 secs 2024-04-26T15:44:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:08 smithi196 ceph-mon[32572]: pgmap v7964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:08.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:08 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14162.069379 secs 2024-04-26T15:44:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:08 smithi110 ceph-mon[28069]: pgmap v7964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:08 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14162.069379 secs 2024-04-26T15:44:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:08 smithi193 ceph-mon[32782]: pgmap v7964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:10.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:10 smithi196 ceph-mon[32572]: pgmap v7965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:44:10.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:10 smithi110 ceph-mon[28069]: pgmap v7965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:44:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:10 smithi193 ceph-mon[32782]: pgmap v7965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:44:12.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:12 smithi196 ceph-mon[32572]: pgmap v7966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:12 smithi110 ceph-mon[28069]: pgmap v7966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:12 smithi193 ceph-mon[32782]: pgmap v7966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:13.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:13 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14167.069495 secs 2024-04-26T15:44:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:13 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14167.069495 secs 2024-04-26T15:44:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:13 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14167.069495 secs 2024-04-26T15:44:14.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:14 smithi110 ceph-mon[28069]: pgmap v7967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:44:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:14 smithi196 ceph-mon[32572]: pgmap v7967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:44:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:14 smithi193 ceph-mon[32782]: pgmap v7967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:44:16.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:16 smithi196 ceph-mon[32572]: pgmap v7968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:16 smithi110 ceph-mon[28069]: pgmap v7968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:16 smithi193 ceph-mon[32782]: pgmap v7968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:18.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:18 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14172.069611 secs 2024-04-26T15:44:18.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:18 smithi196 ceph-mon[32572]: pgmap v7969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:18 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14172.069611 secs 2024-04-26T15:44:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:18 smithi110 ceph-mon[28069]: pgmap v7969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:18 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14172.069611 secs 2024-04-26T15:44:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:18 smithi193 ceph-mon[32782]: pgmap v7969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:20.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:20 smithi196 ceph-mon[32572]: pgmap v7970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:20 smithi110 ceph-mon[28069]: pgmap v7970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:20 smithi193 ceph-mon[32782]: pgmap v7970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:44:22.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:22 smithi196 ceph-mon[32572]: pgmap v7971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:22.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:22 smithi110 ceph-mon[28069]: pgmap v7971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:22 smithi193 ceph-mon[32782]: pgmap v7971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:23.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:23 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14177.069731 secs 2024-04-26T15:44:23.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:23 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14177.069731 secs 2024-04-26T15:44:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:23 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14177.069731 secs 2024-04-26T15:44:24.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:24 smithi196 ceph-mon[32572]: pgmap v7972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:24 smithi110 ceph-mon[28069]: pgmap v7972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:24 smithi193 ceph-mon[32782]: pgmap v7972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:26.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:26 smithi196 ceph-mon[32572]: pgmap v7973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:26.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:26 smithi110 ceph-mon[28069]: pgmap v7973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:26 smithi193 ceph-mon[32782]: pgmap v7973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:28 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14182.069855 secs 2024-04-26T15:44:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:28 smithi196 ceph-mon[32572]: pgmap v7974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:28 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14182.069855 secs 2024-04-26T15:44:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:28 smithi110 ceph-mon[28069]: pgmap v7974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:28 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14182.069855 secs 2024-04-26T15:44:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:28 smithi193 ceph-mon[32782]: pgmap v7974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:30.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:30 smithi196 ceph-mon[32572]: pgmap v7975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:30 smithi110 ceph-mon[28069]: pgmap v7975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:30 smithi193 ceph-mon[32782]: pgmap v7975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:32 smithi196 ceph-mon[32572]: pgmap v7976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:32.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:32 smithi110 ceph-mon[28069]: pgmap v7976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:32 smithi193 ceph-mon[32782]: pgmap v7976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:33.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:33 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14187.069933 secs 2024-04-26T15:44:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:33 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14187.069933 secs 2024-04-26T15:44:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:33 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14187.069933 secs 2024-04-26T15:44:34.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:34 smithi196 ceph-mon[32572]: pgmap v7977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:34 smithi110 ceph-mon[28069]: pgmap v7977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:34 smithi193 ceph-mon[32782]: pgmap v7977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:36.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:36 smithi110 ceph-mon[28069]: pgmap v7978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:44:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:36 smithi193 ceph-mon[32782]: pgmap v7978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:44:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:36 smithi196 ceph-mon[32572]: pgmap v7978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:44:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:44:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:44:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:37 smithi110 ceph-mon[28069]: pgmap v7979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 898 B/s rd, 1 op/s 2024-04-26T15:44:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:37 smithi110 ceph-mon[28069]: pgmap v7980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:44:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:44:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:44:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:37 smithi193 ceph-mon[32782]: pgmap v7979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 898 B/s rd, 1 op/s 2024-04-26T15:44:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:37 smithi193 ceph-mon[32782]: pgmap v7980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:44:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:44:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:44:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:37 smithi196 ceph-mon[32572]: pgmap v7979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 898 B/s rd, 1 op/s 2024-04-26T15:44:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:37 smithi196 ceph-mon[32572]: pgmap v7980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:44:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:38 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14192.070039 secs 2024-04-26T15:44:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:38 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14192.070039 secs 2024-04-26T15:44:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:38 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14192.070039 secs 2024-04-26T15:44:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:39 smithi110 ceph-mon[28069]: pgmap v7981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:39.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:39 smithi193 ceph-mon[32782]: pgmap v7981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:39.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:39 smithi196 ceph-mon[32572]: pgmap v7981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:41.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:41 smithi196 ceph-mon[32572]: pgmap v7982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:41 smithi110 ceph-mon[28069]: pgmap v7982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:41 smithi193 ceph-mon[32782]: pgmap v7982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:42 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14197.070175 secs 2024-04-26T15:44:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:42 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14197.070175 secs 2024-04-26T15:44:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:42 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14197.070175 secs 2024-04-26T15:44:43.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:43 smithi196 ceph-mon[32572]: pgmap v7983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:43.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:43 smithi110 ceph-mon[28069]: pgmap v7983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:43 smithi193 ceph-mon[32782]: pgmap v7983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:45 smithi110 ceph-mon[28069]: pgmap v7984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:45 smithi193 ceph-mon[32782]: pgmap v7984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:45 smithi196 ceph-mon[32572]: pgmap v7984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:44:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:47 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14202.070291 secs 2024-04-26T15:44:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:47 smithi110 ceph-mon[28069]: pgmap v7985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:44:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:47 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14202.070291 secs 2024-04-26T15:44:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:47 smithi193 ceph-mon[32782]: pgmap v7985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:44:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:47 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14202.070291 secs 2024-04-26T15:44:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:47 smithi196 ceph-mon[32572]: pgmap v7985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:44:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:49 smithi110 ceph-mon[28069]: pgmap v7986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:49 smithi193 ceph-mon[32782]: pgmap v7986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:50.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:49 smithi196 ceph-mon[32572]: pgmap v7986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:51 smithi110 ceph-mon[28069]: pgmap v7987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:51 smithi193 ceph-mon[32782]: pgmap v7987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:52.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:51 smithi196 ceph-mon[32572]: pgmap v7987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:52 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14207.070420 secs 2024-04-26T15:44:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:52 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14207.070420 secs 2024-04-26T15:44:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:52 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14207.070420 secs 2024-04-26T15:44:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:53 smithi193 ceph-mon[32782]: pgmap v7988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:53 smithi196 ceph-mon[32572]: pgmap v7988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:54.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:53 smithi110 ceph-mon[28069]: pgmap v7988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:44:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:55 smithi193 ceph-mon[32782]: pgmap v7989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:55 smithi196 ceph-mon[32572]: pgmap v7989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:55 smithi110 ceph-mon[28069]: pgmap v7989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:57 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14212.070535 secs 2024-04-26T15:44:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:57 smithi193 ceph-mon[32782]: pgmap v7990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:57 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14212.070535 secs 2024-04-26T15:44:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:57 smithi196 ceph-mon[32572]: pgmap v7990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:57 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14212.070535 secs 2024-04-26T15:44:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:57 smithi110 ceph-mon[28069]: pgmap v7990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:44:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:44:59 smithi193 ceph-mon[32782]: pgmap v7991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:00.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:44:59 smithi196 ceph-mon[32572]: pgmap v7991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:44:59 smithi110 ceph-mon[28069]: pgmap v7991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:01 smithi193 ceph-mon[32782]: pgmap v7992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:02.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:01 smithi196 ceph-mon[32572]: pgmap v7992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:02.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:01 smithi110 ceph-mon[28069]: pgmap v7992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:02 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14217.070662 secs 2024-04-26T15:45:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:02 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14217.070662 secs 2024-04-26T15:45:03.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:02 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14217.070662 secs 2024-04-26T15:45:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:03 smithi193 ceph-mon[32782]: pgmap v7993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:45:04.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:03 smithi196 ceph-mon[32572]: pgmap v7993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:45:04.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:03 smithi110 ceph-mon[28069]: pgmap v7993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:45:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:04 smithi193 ceph-mon[32782]: pgmap v7994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:45:05.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:04 smithi196 ceph-mon[32572]: pgmap v7994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:45:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:04 smithi110 ceph-mon[28069]: pgmap v7994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:45:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:07 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14222.070782 secs 2024-04-26T15:45:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:07 smithi196 ceph-mon[32572]: pgmap v7995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:45:07.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:07 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14222.070782 secs 2024-04-26T15:45:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:07 smithi110 ceph-mon[28069]: pgmap v7995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:45:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:07 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14222.070782 secs 2024-04-26T15:45:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:07 smithi193 ceph-mon[32782]: pgmap v7995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:45:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:09 smithi110 ceph-mon[28069]: pgmap v7996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:45:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:09 smithi193 ceph-mon[32782]: pgmap v7996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:45:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:09 smithi196 ceph-mon[32572]: pgmap v7996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:45:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:11 smithi110 ceph-mon[28069]: pgmap v7997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:45:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:11 smithi193 ceph-mon[32782]: pgmap v7997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:45:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:11 smithi196 ceph-mon[32572]: pgmap v7997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:45:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:12 smithi110 ceph-mon[28069]: 14 slow requests, 1 included below; oldest blocked for > 14227.070849 secs 2024-04-26T15:45:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:12 smithi110 ceph-mon[28069]: slow request 364.406982 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:45:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:12 smithi193 ceph-mon[32782]: 14 slow requests, 1 included below; oldest blocked for > 14227.070849 secs 2024-04-26T15:45:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:12 smithi193 ceph-mon[32782]: slow request 364.406982 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:45:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:12 smithi196 ceph-mon[32572]: 14 slow requests, 1 included below; oldest blocked for > 14227.070849 secs 2024-04-26T15:45:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:12 smithi196 ceph-mon[32572]: slow request 364.406982 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:45:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:13 smithi110 ceph-mon[28069]: pgmap v7998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:45:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:13 smithi193 ceph-mon[32782]: pgmap v7998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:45:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:13 smithi196 ceph-mon[32572]: pgmap v7998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:45:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:15 smithi110 ceph-mon[28069]: pgmap v7999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:15 smithi193 ceph-mon[32782]: pgmap v7999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:16.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:15 smithi196 ceph-mon[32572]: pgmap v7999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:17 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14232.070928 secs 2024-04-26T15:45:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:17 smithi110 ceph-mon[28069]: pgmap v8000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:17 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14232.070928 secs 2024-04-26T15:45:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:17 smithi193 ceph-mon[32782]: pgmap v8000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:17 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14232.070928 secs 2024-04-26T15:45:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:17 smithi196 ceph-mon[32572]: pgmap v8000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:18.708 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:45:18.709+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:45:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:45:18.709+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006150 con 0x7f261c104b50 2024-04-26T15:45:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:45:18.710+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 112 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006150 con 0x55db1be4fdd0 2024-04-26T15:45:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:45:18.710+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 112 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:45:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:19 smithi110 ceph-mon[28069]: pgmap v8001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:19 smithi193 ceph-mon[32782]: pgmap v8001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:20.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:19 smithi196 ceph-mon[32572]: pgmap v8001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:21 smithi193 ceph-mon[32782]: pgmap v8002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:21 smithi196 ceph-mon[32572]: pgmap v8002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:21 smithi110 ceph-mon[28069]: pgmap v8002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:22 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14237.071007 secs 2024-04-26T15:45:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:22 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14237.071007 secs 2024-04-26T15:45:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:22 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14237.071007 secs 2024-04-26T15:45:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:23 smithi193 ceph-mon[32782]: pgmap v8003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:24.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:23 smithi196 ceph-mon[32572]: pgmap v8003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:23 smithi110 ceph-mon[28069]: pgmap v8003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:25 smithi193 ceph-mon[32782]: pgmap v8004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:25 smithi196 ceph-mon[32572]: pgmap v8004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:25 smithi110 ceph-mon[28069]: pgmap v8004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:27.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:27 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14242.071146 secs 2024-04-26T15:45:27.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:27 smithi193 ceph-mon[32782]: pgmap v8005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:27 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14242.071146 secs 2024-04-26T15:45:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:27 smithi196 ceph-mon[32572]: pgmap v8005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:27 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14242.071146 secs 2024-04-26T15:45:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:27 smithi110 ceph-mon[28069]: pgmap v8005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:29 smithi193 ceph-mon[32782]: pgmap v8006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:30.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:29 smithi196 ceph-mon[32572]: pgmap v8006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:29 smithi110 ceph-mon[28069]: pgmap v8006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:31 smithi193 ceph-mon[32782]: pgmap v8007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:31 smithi196 ceph-mon[32572]: pgmap v8007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:31 smithi110 ceph-mon[28069]: pgmap v8007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:32 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14247.071278 secs 2024-04-26T15:45:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:32 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14247.071278 secs 2024-04-26T15:45:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:32 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14247.071278 secs 2024-04-26T15:45:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:33 smithi193 ceph-mon[32782]: pgmap v8008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:34.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:33 smithi196 ceph-mon[32572]: pgmap v8008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:33 smithi110 ceph-mon[28069]: pgmap v8008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:34 smithi193 ceph-mon[32782]: pgmap v8009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:34 smithi196 ceph-mon[32572]: pgmap v8009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:34 smithi110 ceph-mon[28069]: pgmap v8009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:37 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14252.071390 secs 2024-04-26T15:45:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:37 smithi110 ceph-mon[28069]: pgmap v8010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:45:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:37 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14252.071390 secs 2024-04-26T15:45:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:37 smithi193 ceph-mon[32782]: pgmap v8010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:45:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:37 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14252.071390 secs 2024-04-26T15:45:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:37 smithi196 ceph-mon[32572]: pgmap v8010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:45:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:45:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:45:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:45:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:45:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:45:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:45:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:45:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:45:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:45:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:39 smithi110 ceph-mon[28069]: pgmap v8011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:45:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:39 smithi110 ceph-mon[28069]: pgmap v8012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:39 smithi193 ceph-mon[32782]: pgmap v8011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:45:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:39 smithi193 ceph-mon[32782]: pgmap v8012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:40.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:39 smithi196 ceph-mon[32572]: pgmap v8011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:45:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:39 smithi196 ceph-mon[32572]: pgmap v8012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:41 smithi110 ceph-mon[28069]: pgmap v8013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:41 smithi193 ceph-mon[32782]: pgmap v8013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:41 smithi196 ceph-mon[32572]: pgmap v8013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:42 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14257.071506 secs 2024-04-26T15:45:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:42 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14257.071506 secs 2024-04-26T15:45:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:42 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14257.071506 secs 2024-04-26T15:45:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:43 smithi193 ceph-mon[32782]: pgmap v8014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 541 B/s rd, 1 op/s 2024-04-26T15:45:44.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:43 smithi196 ceph-mon[32572]: pgmap v8014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 541 B/s rd, 1 op/s 2024-04-26T15:45:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:43 smithi110 ceph-mon[28069]: pgmap v8014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 541 B/s rd, 1 op/s 2024-04-26T15:45:45.842 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:45 smithi110 ceph-mon[28069]: pgmap v8015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:45 smithi193 ceph-mon[32782]: pgmap v8015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:45 smithi196 ceph-mon[32572]: pgmap v8015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:47 smithi193 ceph-mon[32782]: pgmap v8016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:47 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14262.071628 secs 2024-04-26T15:45:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:47 smithi196 ceph-mon[32572]: pgmap v8016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:47 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14262.071628 secs 2024-04-26T15:45:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:47 smithi110 ceph-mon[28069]: pgmap v8016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:45:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:47 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14262.071628 secs 2024-04-26T15:45:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:49 smithi193 ceph-mon[32782]: pgmap v8017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:45:50.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:49 smithi196 ceph-mon[32572]: pgmap v8017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:45:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:49 smithi110 ceph-mon[28069]: pgmap v8017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:45:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:51 smithi193 ceph-mon[32782]: pgmap v8018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:51 smithi196 ceph-mon[32572]: pgmap v8018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:52.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:51 smithi110 ceph-mon[28069]: pgmap v8018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:52 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14267.071744 secs 2024-04-26T15:45:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:52 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14267.071744 secs 2024-04-26T15:45:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:52 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14267.071744 secs 2024-04-26T15:45:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:53 smithi193 ceph-mon[32782]: pgmap v8019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:53 smithi196 ceph-mon[32572]: pgmap v8019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:54.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:53 smithi110 ceph-mon[28069]: pgmap v8019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:55 smithi193 ceph-mon[32782]: pgmap v8020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:55 smithi196 ceph-mon[32572]: pgmap v8020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:55 smithi110 ceph-mon[28069]: pgmap v8020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:56 smithi193 ceph-mon[32782]: pgmap v8021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:56 smithi196 ceph-mon[32572]: pgmap v8021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:56 smithi110 ceph-mon[28069]: pgmap v8021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:45:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:57 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14272.071816 secs 2024-04-26T15:45:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:57 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14272.071816 secs 2024-04-26T15:45:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:57 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14272.071816 secs 2024-04-26T15:45:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:45:58 smithi193 ceph-mon[32782]: pgmap v8022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:59.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:45:58 smithi196 ceph-mon[32572]: pgmap v8022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:45:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:45:58 smithi110 ceph-mon[28069]: pgmap v8022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:00 smithi196 ceph-mon[32572]: pgmap v8023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:00 smithi110 ceph-mon[28069]: pgmap v8023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:00 smithi193 ceph-mon[32782]: pgmap v8023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:02 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14277.071939 secs 2024-04-26T15:46:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:02 smithi196 ceph-mon[32572]: pgmap v8024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:02 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14277.071939 secs 2024-04-26T15:46:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:02 smithi110 ceph-mon[28069]: pgmap v8024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:02 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14277.071939 secs 2024-04-26T15:46:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:02 smithi193 ceph-mon[32782]: pgmap v8024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:05.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:05 smithi196 ceph-mon[32572]: pgmap v8025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:05 smithi110 ceph-mon[28069]: pgmap v8025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:05 smithi193 ceph-mon[32782]: pgmap v8025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:07 smithi196 ceph-mon[32572]: pgmap v8026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:07 smithi110 ceph-mon[28069]: pgmap v8026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:07 smithi193 ceph-mon[32782]: pgmap v8026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:08.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:08 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14282.072077 secs 2024-04-26T15:46:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:08 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14282.072077 secs 2024-04-26T15:46:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:08 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14282.072077 secs 2024-04-26T15:46:09.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:09 smithi196 ceph-mon[32572]: pgmap v8027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:09 smithi110 ceph-mon[28069]: pgmap v8027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:09 smithi193 ceph-mon[32782]: pgmap v8027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:11.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:11 smithi196 ceph-mon[32572]: pgmap v8028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:11 smithi110 ceph-mon[28069]: pgmap v8028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:11 smithi193 ceph-mon[32782]: pgmap v8028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:13.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:13 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14287.072199 secs 2024-04-26T15:46:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:13 smithi196 ceph-mon[32572]: pgmap v8029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:13 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14287.072199 secs 2024-04-26T15:46:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:13 smithi110 ceph-mon[28069]: pgmap v8029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:13 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14287.072199 secs 2024-04-26T15:46:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:13 smithi193 ceph-mon[32782]: pgmap v8029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:15.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:15 smithi196 ceph-mon[32572]: pgmap v8030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:15 smithi110 ceph-mon[28069]: pgmap v8030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:15 smithi193 ceph-mon[32782]: pgmap v8030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:17.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:17 smithi196 ceph-mon[32572]: pgmap v8031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:17 smithi110 ceph-mon[28069]: pgmap v8031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:17 smithi193 ceph-mon[32782]: pgmap v8031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:18.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:18 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14292.072341 secs 2024-04-26T15:46:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:18 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14292.072341 secs 2024-04-26T15:46:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:18 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14292.072341 secs 2024-04-26T15:46:19.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:19 smithi196 ceph-mon[32572]: pgmap v8032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:19 smithi110 ceph-mon[28069]: pgmap v8032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:19 smithi193 ceph-mon[32782]: pgmap v8032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:21.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:21 smithi196 ceph-mon[32572]: pgmap v8033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:21 smithi110 ceph-mon[28069]: pgmap v8033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:21 smithi193 ceph-mon[32782]: pgmap v8033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:23.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:23 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14297.072453 secs 2024-04-26T15:46:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:23 smithi196 ceph-mon[32572]: pgmap v8034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:23 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14297.072453 secs 2024-04-26T15:46:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:23 smithi110 ceph-mon[28069]: pgmap v8034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:23 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14297.072453 secs 2024-04-26T15:46:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:23 smithi193 ceph-mon[32782]: pgmap v8034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:25 smithi110 ceph-mon[28069]: pgmap v8035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:25 smithi193 ceph-mon[32782]: pgmap v8035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:25.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:25 smithi196 ceph-mon[32572]: pgmap v8035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:27 smithi110 ceph-mon[28069]: pgmap v8036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:27 smithi193 ceph-mon[32782]: pgmap v8036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:27 smithi196 ceph-mon[32572]: pgmap v8036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:28 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14302.072594 secs 2024-04-26T15:46:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:28 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14302.072594 secs 2024-04-26T15:46:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:28 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14302.072594 secs 2024-04-26T15:46:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:29 smithi110 ceph-mon[28069]: pgmap v8037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:29 smithi193 ceph-mon[32782]: pgmap v8037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:29.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:29 smithi196 ceph-mon[32572]: pgmap v8037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:31 smithi110 ceph-mon[28069]: pgmap v8038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:31.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:31 smithi196 ceph-mon[32572]: pgmap v8038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:31 smithi193 ceph-mon[32782]: pgmap v8038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:33 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14307.072687 secs 2024-04-26T15:46:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:33 smithi110 ceph-mon[28069]: pgmap v8039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:33 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14307.072687 secs 2024-04-26T15:46:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:33 smithi193 ceph-mon[32782]: pgmap v8039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:33.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:33 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14307.072687 secs 2024-04-26T15:46:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:33 smithi196 ceph-mon[32572]: pgmap v8039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:35.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:35 smithi193 ceph-mon[32782]: pgmap v8040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:35.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:35 smithi196 ceph-mon[32572]: pgmap v8040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:35 smithi110 ceph-mon[28069]: pgmap v8040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:37 smithi193 ceph-mon[32782]: pgmap v8041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:37 smithi196 ceph-mon[32572]: pgmap v8041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:37 smithi110 ceph-mon[28069]: pgmap v8041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:38 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14312.072806 secs 2024-04-26T15:46:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:46:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:38 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14312.072806 secs 2024-04-26T15:46:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:46:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:38 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14312.072806 secs 2024-04-26T15:46:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:46:39.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:39 smithi193 ceph-mon[32782]: pgmap v8042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:39.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:39 smithi196 ceph-mon[32572]: pgmap v8042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:39 smithi110 ceph-mon[28069]: pgmap v8042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:46:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:46:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:40 smithi193 ceph-mon[32782]: pgmap v8043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:46:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:40 smithi193 ceph-mon[32782]: pgmap v8044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:46:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:46:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:46:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:40 smithi196 ceph-mon[32572]: pgmap v8043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:46:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:40 smithi196 ceph-mon[32572]: pgmap v8044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:46:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:46:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:46:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:40 smithi110 ceph-mon[28069]: pgmap v8043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:46:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:40 smithi110 ceph-mon[28069]: pgmap v8044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:46:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:42 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14317.072901 secs 2024-04-26T15:46:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:42 smithi110 ceph-mon[28069]: pgmap v8045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:42 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14317.072901 secs 2024-04-26T15:46:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:42 smithi193 ceph-mon[32782]: pgmap v8045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:42 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14317.072901 secs 2024-04-26T15:46:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:42 smithi196 ceph-mon[32572]: pgmap v8045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:44 smithi193 ceph-mon[32782]: pgmap v8046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:44 smithi196 ceph-mon[32572]: pgmap v8046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:45.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:44 smithi110 ceph-mon[28069]: pgmap v8046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:46.842 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:46 smithi110 ceph-mon[28069]: pgmap v8047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:46 smithi193 ceph-mon[32782]: pgmap v8047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:46 smithi196 ceph-mon[32572]: pgmap v8047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:47 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14322.073040 secs 2024-04-26T15:46:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:47 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14322.073040 secs 2024-04-26T15:46:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:47 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14322.073040 secs 2024-04-26T15:46:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:48 smithi193 ceph-mon[32782]: pgmap v8048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:48 smithi196 ceph-mon[32572]: pgmap v8048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:48 smithi110 ceph-mon[28069]: pgmap v8048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:46:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:50 smithi193 ceph-mon[32782]: pgmap v8049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:46:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:50 smithi196 ceph-mon[32572]: pgmap v8049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:46:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:50 smithi110 ceph-mon[28069]: pgmap v8049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:46:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:52 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14327.073121 secs 2024-04-26T15:46:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:52 smithi193 ceph-mon[32782]: pgmap v8050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:52 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14327.073121 secs 2024-04-26T15:46:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:52 smithi196 ceph-mon[32572]: pgmap v8050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:52 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14327.073121 secs 2024-04-26T15:46:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:52 smithi110 ceph-mon[28069]: pgmap v8050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:54 smithi193 ceph-mon[32782]: pgmap v8051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:55.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:54 smithi196 ceph-mon[32572]: pgmap v8051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:54 smithi110 ceph-mon[28069]: pgmap v8051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:56 smithi193 ceph-mon[32782]: pgmap v8052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:56 smithi196 ceph-mon[32572]: pgmap v8052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:57.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:56 smithi110 ceph-mon[28069]: pgmap v8052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:46:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:57 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14332.073235 secs 2024-04-26T15:46:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:57 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14332.073235 secs 2024-04-26T15:46:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:57 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14332.073235 secs 2024-04-26T15:46:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:46:58 smithi193 ceph-mon[32782]: pgmap v8053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:59.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:46:58 smithi196 ceph-mon[32572]: pgmap v8053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:46:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:46:58 smithi110 ceph-mon[28069]: pgmap v8053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:00.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:00 smithi196 ceph-mon[32572]: pgmap v8054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:00 smithi110 ceph-mon[28069]: pgmap v8054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:00 smithi193 ceph-mon[32782]: pgmap v8054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:02 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14337.073346 secs 2024-04-26T15:47:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:02 smithi193 ceph-mon[32782]: pgmap v8055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:02 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14337.073346 secs 2024-04-26T15:47:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:02 smithi196 ceph-mon[32572]: pgmap v8055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:02 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14337.073346 secs 2024-04-26T15:47:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:02 smithi110 ceph-mon[28069]: pgmap v8055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:04 smithi193 ceph-mon[32782]: pgmap v8056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:05.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:04 smithi196 ceph-mon[32572]: pgmap v8056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:04 smithi110 ceph-mon[28069]: pgmap v8056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:06 smithi193 ceph-mon[32782]: pgmap v8057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:06 smithi196 ceph-mon[32572]: pgmap v8057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:06 smithi110 ceph-mon[28069]: pgmap v8057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:07 smithi193 ceph-mon[32782]: 14 slow requests, 0 included below; oldest blocked for > 14342.073464 secs 2024-04-26T15:47:08.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:07 smithi196 ceph-mon[32572]: 14 slow requests, 0 included below; oldest blocked for > 14342.073464 secs 2024-04-26T15:47:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:07 smithi110 ceph-mon[28069]: 14 slow requests, 0 included below; oldest blocked for > 14342.073464 secs 2024-04-26T15:47:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:08 smithi193 ceph-mon[32782]: pgmap v8058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:09.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:08 smithi196 ceph-mon[32572]: pgmap v8058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:08 smithi110 ceph-mon[28069]: pgmap v8058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:10 smithi193 ceph-mon[32782]: pgmap v8059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:11.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:10 smithi196 ceph-mon[32572]: pgmap v8059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:10 smithi110 ceph-mon[28069]: pgmap v8059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:12 smithi193 ceph-mon[32782]: 15 slow requests, 1 included below; oldest blocked for > 14347.073571 secs 2024-04-26T15:47:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:12 smithi193 ceph-mon[32782]: slow request 184.184458 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:47:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:12 smithi193 ceph-mon[32782]: pgmap v8060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:12 smithi196 ceph-mon[32572]: 15 slow requests, 1 included below; oldest blocked for > 14347.073571 secs 2024-04-26T15:47:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:12 smithi196 ceph-mon[32572]: slow request 184.184458 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:47:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:12 smithi196 ceph-mon[32572]: pgmap v8060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:12 smithi110 ceph-mon[28069]: 15 slow requests, 1 included below; oldest blocked for > 14347.073571 secs 2024-04-26T15:47:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:12 smithi110 ceph-mon[28069]: slow request 184.184458 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:47:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:12 smithi110 ceph-mon[28069]: pgmap v8060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:13 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:47:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:13 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:47:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:13 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:47:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:13 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:47:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:13 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:47:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:13 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:47:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:14 smithi193 ceph-mon[32782]: pgmap v8061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:14 smithi196 ceph-mon[32572]: pgmap v8061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:14 smithi110 ceph-mon[28069]: pgmap v8061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:15 smithi193 ceph-mon[32782]: pgmap v8062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:16.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:15 smithi196 ceph-mon[32572]: pgmap v8062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:15 smithi110 ceph-mon[28069]: pgmap v8062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:17 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14352.073673 secs 2024-04-26T15:47:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:17 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14352.073673 secs 2024-04-26T15:47:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:17 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14352.073673 secs 2024-04-26T15:47:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:18 smithi196 ceph-mon[32572]: pgmap v8063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:18 smithi110 ceph-mon[28069]: pgmap v8063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:18 smithi193 ceph-mon[32782]: pgmap v8063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:20 smithi193 ceph-mon[32782]: pgmap v8064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:20 smithi196 ceph-mon[32572]: pgmap v8064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:20 smithi110 ceph-mon[28069]: pgmap v8064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:22 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14357.073777 secs 2024-04-26T15:47:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:22 smithi193 ceph-mon[32782]: pgmap v8065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:22 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14357.073777 secs 2024-04-26T15:47:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:22 smithi196 ceph-mon[32572]: pgmap v8065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:22 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14357.073777 secs 2024-04-26T15:47:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:22 smithi110 ceph-mon[28069]: pgmap v8065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:24 smithi193 ceph-mon[32782]: pgmap v8066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:24 smithi196 ceph-mon[32572]: pgmap v8066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:24 smithi110 ceph-mon[28069]: pgmap v8066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:26 smithi193 ceph-mon[32782]: pgmap v8067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:26 smithi196 ceph-mon[32572]: pgmap v8067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:26 smithi110 ceph-mon[28069]: pgmap v8067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:27 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14362.073841 secs 2024-04-26T15:47:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:27 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14362.073841 secs 2024-04-26T15:47:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:27 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14362.073841 secs 2024-04-26T15:47:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:28 smithi193 ceph-mon[32782]: pgmap v8068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:28 smithi196 ceph-mon[32572]: pgmap v8068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:28 smithi110 ceph-mon[28069]: pgmap v8068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:30 smithi193 ceph-mon[32782]: pgmap v8069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:31.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:30 smithi196 ceph-mon[32572]: pgmap v8069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:30 smithi110 ceph-mon[28069]: pgmap v8069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:32 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14367.073962 secs 2024-04-26T15:47:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:32 smithi193 ceph-mon[32782]: pgmap v8070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:32 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14367.073962 secs 2024-04-26T15:47:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:32 smithi196 ceph-mon[32572]: pgmap v8070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:32 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14367.073962 secs 2024-04-26T15:47:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:32 smithi110 ceph-mon[28069]: pgmap v8070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:33.731 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:47:33.732+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T15:47:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:47:33.732+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:47:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:47:33.733+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 113 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:47:33.732 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:47:33.733+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 113 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T15:47:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:34 smithi193 ceph-mon[32782]: pgmap v8071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:34 smithi196 ceph-mon[32572]: pgmap v8071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:35.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:34 smithi110 ceph-mon[28069]: pgmap v8071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:36 smithi193 ceph-mon[32782]: pgmap v8072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:37.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:36 smithi196 ceph-mon[32572]: pgmap v8072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:37.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:36 smithi110 ceph-mon[28069]: pgmap v8072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:37 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14372.074077 secs 2024-04-26T15:47:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:37 smithi193 ceph-mon[32782]: pgmap v8073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:37 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14372.074077 secs 2024-04-26T15:47:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:37 smithi196 ceph-mon[32572]: pgmap v8073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:37 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14372.074077 secs 2024-04-26T15:47:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:37 smithi110 ceph-mon[28069]: pgmap v8073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:40 smithi193 ceph-mon[32782]: pgmap v8074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:47:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:40 smithi196 ceph-mon[32572]: pgmap v8074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:47:41.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:40 smithi110 ceph-mon[28069]: pgmap v8074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:47:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:47:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:47:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:47:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:47:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:47:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:47:42.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:47:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:47:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:47:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:42 smithi193 ceph-mon[32782]: pgmap v8075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T15:47:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:42 smithi193 ceph-mon[32782]: pgmap v8076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:42 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14377.074198 secs 2024-04-26T15:47:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:42 smithi196 ceph-mon[32572]: pgmap v8075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T15:47:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:42 smithi196 ceph-mon[32572]: pgmap v8076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:42 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14377.074198 secs 2024-04-26T15:47:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:42 smithi110 ceph-mon[28069]: pgmap v8075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T15:47:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:42 smithi110 ceph-mon[28069]: pgmap v8076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:42 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14377.074198 secs 2024-04-26T15:47:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:44 smithi193 ceph-mon[32782]: pgmap v8077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:44 smithi196 ceph-mon[32572]: pgmap v8077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:45.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:44 smithi110 ceph-mon[28069]: pgmap v8077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:46 smithi193 ceph-mon[32782]: pgmap v8078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:46 smithi196 ceph-mon[32572]: pgmap v8078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:47.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:46 smithi110 ceph-mon[28069]: pgmap v8078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:47 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14382.074307 secs 2024-04-26T15:47:47.941 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:47 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14382.074307 secs 2024-04-26T15:47:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:47 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14382.074307 secs 2024-04-26T15:47:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:48 smithi193 ceph-mon[32782]: pgmap v8079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T15:47:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:48 smithi196 ceph-mon[32572]: pgmap v8079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T15:47:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:48 smithi110 ceph-mon[28069]: pgmap v8079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T15:47:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:50 smithi193 ceph-mon[32782]: pgmap v8080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:50 smithi196 ceph-mon[32572]: pgmap v8080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:50 smithi110 ceph-mon[28069]: pgmap v8080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:47:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:52 smithi193 ceph-mon[32782]: pgmap v8081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:47:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:52 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14387.074426 secs 2024-04-26T15:47:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:52 smithi196 ceph-mon[32572]: pgmap v8081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:47:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:52 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14387.074426 secs 2024-04-26T15:47:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:52 smithi110 ceph-mon[28069]: pgmap v8081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:47:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:52 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14387.074426 secs 2024-04-26T15:47:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:53 smithi193 ceph-mon[32782]: pgmap v8082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:53 smithi196 ceph-mon[32572]: pgmap v8082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:54.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:53 smithi110 ceph-mon[28069]: pgmap v8082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:47:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:56 smithi193 ceph-mon[32782]: pgmap v8083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:56.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:56 smithi196 ceph-mon[32572]: pgmap v8083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:56 smithi110 ceph-mon[28069]: pgmap v8083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:58 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14392.074489 secs 2024-04-26T15:47:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:47:58 smithi193 ceph-mon[32782]: pgmap v8084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:58 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14392.074489 secs 2024-04-26T15:47:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:47:58 smithi196 ceph-mon[32572]: pgmap v8084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:47:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:58 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14392.074489 secs 2024-04-26T15:47:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:47:58 smithi110 ceph-mon[28069]: pgmap v8084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:00 smithi193 ceph-mon[32782]: pgmap v8085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:00.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:00 smithi196 ceph-mon[32572]: pgmap v8085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:00 smithi110 ceph-mon[28069]: pgmap v8085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:02 smithi193 ceph-mon[32782]: pgmap v8086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:02 smithi196 ceph-mon[32572]: pgmap v8086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:02 smithi110 ceph-mon[28069]: pgmap v8086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:03 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14397.074626 secs 2024-04-26T15:48:03.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:03 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14397.074626 secs 2024-04-26T15:48:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:03 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14397.074626 secs 2024-04-26T15:48:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:04 smithi193 ceph-mon[32782]: pgmap v8087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:04.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:04 smithi196 ceph-mon[32572]: pgmap v8087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:04 smithi110 ceph-mon[28069]: pgmap v8087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:06 smithi193 ceph-mon[32782]: pgmap v8088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:06.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:06 smithi196 ceph-mon[32572]: pgmap v8088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:06 smithi110 ceph-mon[28069]: pgmap v8088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:08 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14402.074703 secs 2024-04-26T15:48:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:08 smithi193 ceph-mon[32782]: pgmap v8089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:08 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14402.074703 secs 2024-04-26T15:48:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:08 smithi196 ceph-mon[32572]: pgmap v8089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:08 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14402.074703 secs 2024-04-26T15:48:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:08 smithi110 ceph-mon[28069]: pgmap v8089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:10 smithi193 ceph-mon[32782]: pgmap v8090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:10.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:10 smithi196 ceph-mon[32572]: pgmap v8090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:10 smithi110 ceph-mon[28069]: pgmap v8090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:12 smithi193 ceph-mon[32782]: pgmap v8091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:12.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:12 smithi196 ceph-mon[32572]: pgmap v8091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:12 smithi110 ceph-mon[28069]: pgmap v8091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:13 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14407.074820 secs 2024-04-26T15:48:13.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:13 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14407.074820 secs 2024-04-26T15:48:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:13 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14407.074820 secs 2024-04-26T15:48:14.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:14 smithi196 ceph-mon[32572]: pgmap v8092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:14 smithi110 ceph-mon[28069]: pgmap v8092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:14 smithi193 ceph-mon[32782]: pgmap v8092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.412+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T15:48:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.412+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T15:48:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.412+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614014070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T15:48:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.412+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614014070 comp rx=0 tx=0).stop 2024-04-26T15:48:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.412+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T15:48:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.412+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T15:48:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.412+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4e20 0x7f26000b4670 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T15:48:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.412+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T15:48:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.413+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T15:48:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.414+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614014040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T15:48:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.417+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T15:48:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.417+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T15:48:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.417+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T15:48:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.417+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T15:48:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.417+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T15:48:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.418+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T15:48:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:16.418+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T15:48:16.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:16 smithi196 ceph-mon[32572]: pgmap v8093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:16 smithi110 ceph-mon[28069]: pgmap v8093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:16 smithi193 ceph-mon[32782]: pgmap v8093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:18.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:18 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14412.074894 secs 2024-04-26T15:48:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:18 smithi196 ceph-mon[32572]: pgmap v8094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:18 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14412.074894 secs 2024-04-26T15:48:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:18 smithi110 ceph-mon[28069]: pgmap v8094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:18 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14412.074894 secs 2024-04-26T15:48:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:18 smithi193 ceph-mon[32782]: pgmap v8094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:18.740+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:48:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:18.740+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T15:48:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:18.741+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 114 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T15:48:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:48:18.741+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 114 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:48:20.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:20 smithi196 ceph-mon[32572]: pgmap v8095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:20.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:20 smithi110 ceph-mon[28069]: pgmap v8095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:20 smithi193 ceph-mon[32782]: pgmap v8095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:22.422 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:22 smithi193 ceph-mon[32782]: pgmap v8096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:22.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:22 smithi196 ceph-mon[32572]: pgmap v8096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:22.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:22 smithi110 ceph-mon[28069]: pgmap v8096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:23.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:23 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14417.075011 secs 2024-04-26T15:48:23.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:23 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14417.075011 secs 2024-04-26T15:48:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:23 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14417.075011 secs 2024-04-26T15:48:24.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:24 smithi196 ceph-mon[32572]: pgmap v8097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:24.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:24 smithi110 ceph-mon[28069]: pgmap v8097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:24 smithi193 ceph-mon[32782]: pgmap v8097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:26.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:26 smithi196 ceph-mon[32572]: pgmap v8098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:26.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:26 smithi110 ceph-mon[28069]: pgmap v8098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:26 smithi193 ceph-mon[32782]: pgmap v8098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:28 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14422.075143 secs 2024-04-26T15:48:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:28 smithi196 ceph-mon[32572]: pgmap v8099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:28 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14422.075143 secs 2024-04-26T15:48:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:28 smithi110 ceph-mon[28069]: pgmap v8099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:28 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14422.075143 secs 2024-04-26T15:48:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:28 smithi193 ceph-mon[32782]: pgmap v8099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:30 smithi196 ceph-mon[32572]: pgmap v8100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:30 smithi110 ceph-mon[28069]: pgmap v8100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:30 smithi193 ceph-mon[32782]: pgmap v8100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:32 smithi196 ceph-mon[32572]: pgmap v8101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:32 smithi110 ceph-mon[28069]: pgmap v8101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:32 smithi193 ceph-mon[32782]: pgmap v8101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:33.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:33 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14427.075282 secs 2024-04-26T15:48:33.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:33 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14427.075282 secs 2024-04-26T15:48:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:33 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14427.075282 secs 2024-04-26T15:48:34.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:34 smithi196 ceph-mon[32572]: pgmap v8102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:34 smithi110 ceph-mon[28069]: pgmap v8102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:34.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:34 smithi193 ceph-mon[32782]: pgmap v8102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:36.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:36 smithi196 ceph-mon[32572]: pgmap v8103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:36 smithi110 ceph-mon[28069]: pgmap v8103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:36 smithi193 ceph-mon[32782]: pgmap v8103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:38.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:38 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14432.075433 secs 2024-04-26T15:48:38.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:38 smithi196 ceph-mon[32572]: pgmap v8104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:38 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14432.075433 secs 2024-04-26T15:48:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:38 smithi110 ceph-mon[28069]: pgmap v8104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:38 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14432.075433 secs 2024-04-26T15:48:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:38 smithi193 ceph-mon[32782]: pgmap v8104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:40.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:40 smithi196 ceph-mon[32572]: pgmap v8105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:40 smithi110 ceph-mon[28069]: pgmap v8105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:40 smithi193 ceph-mon[32782]: pgmap v8105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:42 smithi196 ceph-mon[32572]: pgmap v8106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:48:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:48:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:48:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:42 smithi110 ceph-mon[28069]: pgmap v8106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:48:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:48:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:48:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:42 smithi193 ceph-mon[32782]: pgmap v8106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:48:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:48:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:48:43.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:43 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14437.075501 secs 2024-04-26T15:48:43.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:43 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14437.075501 secs 2024-04-26T15:48:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:43 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14437.075501 secs 2024-04-26T15:48:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:44 smithi196 ceph-mon[32572]: pgmap v8107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:48:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:48:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:44 smithi196 ceph-mon[32572]: pgmap v8108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 B/s rd, 1 op/s 2024-04-26T15:48:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:44 smithi196 ceph-mon[32572]: pgmap v8109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:48:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:44 smithi110 ceph-mon[28069]: pgmap v8107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:48:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:48:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:44 smithi110 ceph-mon[28069]: pgmap v8108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 B/s rd, 1 op/s 2024-04-26T15:48:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:44 smithi110 ceph-mon[28069]: pgmap v8109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:48:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:44 smithi193 ceph-mon[32782]: pgmap v8107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:48:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:48:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:44 smithi193 ceph-mon[32782]: pgmap v8108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 991 B/s rd, 1 op/s 2024-04-26T15:48:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:44 smithi193 ceph-mon[32782]: pgmap v8109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:48:46.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:46 smithi196 ceph-mon[32572]: pgmap v8110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:46 smithi110 ceph-mon[28069]: pgmap v8110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:46 smithi193 ceph-mon[32782]: pgmap v8110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:47 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14442.075622 secs 2024-04-26T15:48:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:47 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14442.075622 secs 2024-04-26T15:48:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:47 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14442.075622 secs 2024-04-26T15:48:48.691 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:48 smithi110 ceph-mon[28069]: pgmap v8111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T15:48:48.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:48 smithi196 ceph-mon[32572]: pgmap v8111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T15:48:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:48 smithi193 ceph-mon[32782]: pgmap v8111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T15:48:50.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:50 smithi196 ceph-mon[32572]: pgmap v8112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:50 smithi110 ceph-mon[28069]: pgmap v8112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:50 smithi193 ceph-mon[32782]: pgmap v8112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:52 smithi196 ceph-mon[32572]: pgmap v8113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-04-26T15:48:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:52 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14447.075742 secs 2024-04-26T15:48:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:52 smithi110 ceph-mon[28069]: pgmap v8113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-04-26T15:48:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:52 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14447.075742 secs 2024-04-26T15:48:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:52 smithi193 ceph-mon[32782]: pgmap v8113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-04-26T15:48:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:52 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14447.075742 secs 2024-04-26T15:48:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:54 smithi196 ceph-mon[32572]: pgmap v8114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:48:54.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:54 smithi110 ceph-mon[28069]: pgmap v8114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:48:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:54 smithi193 ceph-mon[32782]: pgmap v8114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:48:56.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:56 smithi196 ceph-mon[32572]: pgmap v8115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:56 smithi110 ceph-mon[28069]: pgmap v8115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:56 smithi193 ceph-mon[32782]: pgmap v8115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:48:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:57 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14452.075894 secs 2024-04-26T15:48:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:57 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14452.075894 secs 2024-04-26T15:48:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:57 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14452.075894 secs 2024-04-26T15:48:58.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:48:58 smithi196 ceph-mon[32572]: pgmap v8116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:48:58 smithi110 ceph-mon[28069]: pgmap v8116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:48:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:48:58 smithi193 ceph-mon[32782]: pgmap v8116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:00.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:00 smithi196 ceph-mon[32572]: pgmap v8117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:49:00.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:00 smithi110 ceph-mon[28069]: pgmap v8117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:49:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:00 smithi193 ceph-mon[32782]: pgmap v8117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:49:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:02 smithi196 ceph-mon[32572]: pgmap v8118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:02 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14457.076033 secs 2024-04-26T15:49:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:02 smithi110 ceph-mon[28069]: pgmap v8118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:02 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14457.076033 secs 2024-04-26T15:49:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:02 smithi193 ceph-mon[32782]: pgmap v8118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:02 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14457.076033 secs 2024-04-26T15:49:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:04 smithi196 ceph-mon[32572]: pgmap v8119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:04 smithi110 ceph-mon[28069]: pgmap v8119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:04 smithi193 ceph-mon[32782]: pgmap v8119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:06.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:06 smithi196 ceph-mon[32572]: pgmap v8120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:06 smithi110 ceph-mon[28069]: pgmap v8120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:06 smithi193 ceph-mon[32782]: pgmap v8120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:07 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14462.076194 secs 2024-04-26T15:49:07.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:49:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:49:07.270+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:49:07.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:49:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:49:07.270+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:49:07.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:49:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:49:07.270+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:49:07.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:49:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:49:07.270+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:49:07.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:49:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:49:07.270+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:49:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:07 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14462.076194 secs 2024-04-26T15:49:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:07 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14462.076194 secs 2024-04-26T15:49:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:08 smithi196 ceph-mon[32572]: pgmap v8121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T15:49:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:08 smithi110 ceph-mon[28069]: pgmap v8121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T15:49:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:08 smithi193 ceph-mon[32782]: pgmap v8121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T15:49:10.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:10 smithi196 ceph-mon[32572]: pgmap v8122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:49:10.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:10 smithi110 ceph-mon[28069]: pgmap v8122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:49:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:10 smithi193 ceph-mon[32782]: pgmap v8122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:49:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:12 smithi110 ceph-mon[28069]: pgmap v8123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:49:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:12 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14467.076313 secs 2024-04-26T15:49:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:12 smithi193 ceph-mon[32782]: pgmap v8123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:49:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:12 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14467.076313 secs 2024-04-26T15:49:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:12 smithi196 ceph-mon[32572]: pgmap v8123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:49:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:12 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14467.076313 secs 2024-04-26T15:49:14.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:14 smithi110 ceph-mon[28069]: pgmap v8124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:49:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:14 smithi193 ceph-mon[32782]: pgmap v8124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:49:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:14 smithi196 ceph-mon[32572]: pgmap v8124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:49:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:16 smithi110 ceph-mon[28069]: pgmap v8125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:49:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:16 smithi193 ceph-mon[32782]: pgmap v8125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:49:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:16 smithi196 ceph-mon[32572]: pgmap v8125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T15:49:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:17 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14472.076429 secs 2024-04-26T15:49:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:17 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14472.076429 secs 2024-04-26T15:49:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:17 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14472.076429 secs 2024-04-26T15:49:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:18 smithi110 ceph-mon[28069]: pgmap v8126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:49:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:18 smithi193 ceph-mon[32782]: pgmap v8126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:49:19.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:18 smithi196 ceph-mon[32572]: pgmap v8126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T15:49:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:20 smithi110 ceph-mon[28069]: pgmap v8127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:49:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:20 smithi193 ceph-mon[32782]: pgmap v8127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:49:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:20 smithi196 ceph-mon[32572]: pgmap v8127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:49:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:22 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14477.076529 secs 2024-04-26T15:49:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:22 smithi193 ceph-mon[32782]: pgmap v8128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T15:49:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:22 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14477.076529 secs 2024-04-26T15:49:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:22 smithi196 ceph-mon[32572]: pgmap v8128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T15:49:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:22 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14477.076529 secs 2024-04-26T15:49:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:22 smithi110 ceph-mon[28069]: pgmap v8128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T15:49:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:24 smithi193 ceph-mon[32782]: pgmap v8129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:49:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:24 smithi196 ceph-mon[32572]: pgmap v8129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:49:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:24 smithi110 ceph-mon[28069]: pgmap v8129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:49:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:26 smithi193 ceph-mon[32782]: pgmap v8130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:26 smithi196 ceph-mon[32572]: pgmap v8130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:26 smithi110 ceph-mon[28069]: pgmap v8130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:27 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14482.076654 secs 2024-04-26T15:49:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:27 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14482.076654 secs 2024-04-26T15:49:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:27 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14482.076654 secs 2024-04-26T15:49:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:28 smithi193 ceph-mon[32782]: pgmap v8131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:29.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:28 smithi196 ceph-mon[32572]: pgmap v8131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:28 smithi110 ceph-mon[28069]: pgmap v8131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:30 smithi193 ceph-mon[32782]: pgmap v8132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:49:31.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:30 smithi196 ceph-mon[32572]: pgmap v8132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:49:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:30 smithi110 ceph-mon[28069]: pgmap v8132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:49:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:32 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14487.076775 secs 2024-04-26T15:49:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:32 smithi193 ceph-mon[32782]: pgmap v8133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:32 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14487.076775 secs 2024-04-26T15:49:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:32 smithi196 ceph-mon[32572]: pgmap v8133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:32 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14487.076775 secs 2024-04-26T15:49:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:32 smithi110 ceph-mon[28069]: pgmap v8133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:34 smithi193 ceph-mon[32782]: pgmap v8134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:34 smithi196 ceph-mon[32572]: pgmap v8134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:35.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:34 smithi110 ceph-mon[28069]: pgmap v8134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:36 smithi193 ceph-mon[32782]: pgmap v8135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:37.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:36 smithi196 ceph-mon[32572]: pgmap v8135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:36 smithi110 ceph-mon[28069]: pgmap v8135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:37 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14492.076894 secs 2024-04-26T15:49:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:37 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14492.076894 secs 2024-04-26T15:49:38.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:37 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14492.076894 secs 2024-04-26T15:49:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:38 smithi193 ceph-mon[32782]: pgmap v8136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:39.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:38 smithi196 ceph-mon[32572]: pgmap v8136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:38 smithi110 ceph-mon[28069]: pgmap v8136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:40 smithi193 ceph-mon[32782]: pgmap v8137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:49:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:40 smithi196 ceph-mon[32572]: pgmap v8137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:49:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:40 smithi110 ceph-mon[28069]: pgmap v8137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:49:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:42 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14497.077013 secs 2024-04-26T15:49:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:42 smithi193 ceph-mon[32782]: pgmap v8138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:42 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14497.077013 secs 2024-04-26T15:49:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:42 smithi196 ceph-mon[32572]: pgmap v8138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:42 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14497.077013 secs 2024-04-26T15:49:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:42 smithi110 ceph-mon[28069]: pgmap v8138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:44 smithi193 ceph-mon[32782]: pgmap v8139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:49:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:44 smithi196 ceph-mon[32572]: pgmap v8139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:49:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:44 smithi110 ceph-mon[28069]: pgmap v8139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:49:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:49:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:49:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:49:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:49:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:49:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:49:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:49:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:49:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:46 smithi196 ceph-mon[32572]: pgmap v8140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 876 B/s rd, 1 op/s 2024-04-26T15:49:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:46 smithi196 ceph-mon[32572]: pgmap v8141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:47.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:46 smithi110 ceph-mon[28069]: pgmap v8140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 876 B/s rd, 1 op/s 2024-04-26T15:49:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:46 smithi110 ceph-mon[28069]: pgmap v8141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:46 smithi193 ceph-mon[32782]: pgmap v8140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 876 B/s rd, 1 op/s 2024-04-26T15:49:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:46 smithi193 ceph-mon[32782]: pgmap v8141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:47 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14502.077128 secs 2024-04-26T15:49:48.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:47 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14502.077128 secs 2024-04-26T15:49:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:47 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14502.077128 secs 2024-04-26T15:49:48.941 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:48 smithi110 ceph-mon[28069]: pgmap v8142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 528 B/s rd, 1 op/s 2024-04-26T15:49:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:48 smithi196 ceph-mon[32572]: pgmap v8142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 528 B/s rd, 1 op/s 2024-04-26T15:49:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:48 smithi193 ceph-mon[32782]: pgmap v8142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 528 B/s rd, 1 op/s 2024-04-26T15:49:50.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:49 smithi196 ceph-mon[32572]: pgmap v8143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:49 smithi110 ceph-mon[28069]: pgmap v8143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:49 smithi193 ceph-mon[32782]: pgmap v8143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:52.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:52 smithi196 ceph-mon[32572]: pgmap v8144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:52.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:52 smithi110 ceph-mon[28069]: pgmap v8144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:52 smithi193 ceph-mon[32782]: pgmap v8144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:53.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:53 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14507.077207 secs 2024-04-26T15:49:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:53 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14507.077207 secs 2024-04-26T15:49:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:53 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14507.077207 secs 2024-04-26T15:49:54.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:54 smithi196 ceph-mon[32572]: pgmap v8145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:54.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:54 smithi110 ceph-mon[28069]: pgmap v8145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:54 smithi193 ceph-mon[32782]: pgmap v8145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:49:56.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:56 smithi196 ceph-mon[32572]: pgmap v8146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:49:56.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:56 smithi110 ceph-mon[28069]: pgmap v8146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:49:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:56 smithi193 ceph-mon[32782]: pgmap v8146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:49:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:58 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14512.077292 secs 2024-04-26T15:49:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:49:58 smithi196 ceph-mon[32572]: pgmap v8147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:58 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14512.077292 secs 2024-04-26T15:49:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:49:58 smithi110 ceph-mon[28069]: pgmap v8147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:49:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:58 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14512.077292 secs 2024-04-26T15:49:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:49:58 smithi193 ceph-mon[32782]: pgmap v8147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:00.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:00 smithi196 ceph-mon[32572]: pgmap v8148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:50:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:00 smithi110 ceph-mon[28069]: pgmap v8148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:50:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:00 smithi193 ceph-mon[32782]: pgmap v8148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T15:50:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:02 smithi196 ceph-mon[32572]: pgmap v8149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:02.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:02 smithi110 ceph-mon[28069]: pgmap v8149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:02 smithi193 ceph-mon[32782]: pgmap v8149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:03 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14517.077429 secs 2024-04-26T15:50:03.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:03 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14517.077429 secs 2024-04-26T15:50:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:03 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14517.077429 secs 2024-04-26T15:50:04.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:04 smithi196 ceph-mon[32572]: pgmap v8150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:04 smithi110 ceph-mon[28069]: pgmap v8150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:04 smithi193 ceph-mon[32782]: pgmap v8150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:06 smithi193 ceph-mon[32782]: pgmap v8151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:06.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:06 smithi196 ceph-mon[32572]: pgmap v8151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:06 smithi110 ceph-mon[28069]: pgmap v8151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:08 smithi193 ceph-mon[32782]: 15 slow requests, 1 included below; oldest blocked for > 14522.077502 secs 2024-04-26T15:50:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:08 smithi193 ceph-mon[32782]: slow request 5761.890462 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:50:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:08 smithi193 ceph-mon[32782]: pgmap v8152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:08 smithi196 ceph-mon[32572]: 15 slow requests, 1 included below; oldest blocked for > 14522.077502 secs 2024-04-26T15:50:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:08 smithi196 ceph-mon[32572]: slow request 5761.890462 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:50:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:08 smithi196 ceph-mon[32572]: pgmap v8152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:08 smithi110 ceph-mon[28069]: 15 slow requests, 1 included below; oldest blocked for > 14522.077502 secs 2024-04-26T15:50:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:08 smithi110 ceph-mon[28069]: slow request 5761.890462 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:50:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:08 smithi110 ceph-mon[28069]: pgmap v8152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:10 smithi193 ceph-mon[32782]: pgmap v8153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:10.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:10 smithi196 ceph-mon[32572]: pgmap v8153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:10 smithi110 ceph-mon[28069]: pgmap v8153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:12 smithi193 ceph-mon[32782]: pgmap v8154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:12 smithi196 ceph-mon[32572]: pgmap v8154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:12 smithi110 ceph-mon[28069]: pgmap v8154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:13 smithi193 ceph-mon[32782]: 15 slow requests, 1 included below; oldest blocked for > 14527.077620 secs 2024-04-26T15:50:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:13 smithi193 ceph-mon[32782]: slow request 364.188507 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:50:13.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:13 smithi196 ceph-mon[32572]: 15 slow requests, 1 included below; oldest blocked for > 14527.077620 secs 2024-04-26T15:50:13.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:13 smithi196 ceph-mon[32572]: slow request 364.188507 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:50:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:13 smithi110 ceph-mon[28069]: 15 slow requests, 1 included below; oldest blocked for > 14527.077620 secs 2024-04-26T15:50:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:13 smithi110 ceph-mon[28069]: slow request 364.188507 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:50:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:14 smithi193 ceph-mon[32782]: pgmap v8155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:14 smithi196 ceph-mon[32572]: pgmap v8155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:14 smithi110 ceph-mon[28069]: pgmap v8155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:16 smithi193 ceph-mon[32782]: pgmap v8156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:16 smithi196 ceph-mon[32572]: pgmap v8156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:16 smithi110 ceph-mon[28069]: pgmap v8156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:18.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:18 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14532.077701 secs 2024-04-26T15:50:18.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:18 smithi110 ceph-mon[28069]: pgmap v8157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:18 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14532.077701 secs 2024-04-26T15:50:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:18 smithi193 ceph-mon[32782]: pgmap v8157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:18 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14532.077701 secs 2024-04-26T15:50:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:18 smithi196 ceph-mon[32572]: pgmap v8157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:20 smithi193 ceph-mon[32782]: pgmap v8158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:20.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:20 smithi196 ceph-mon[32572]: pgmap v8158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:20 smithi110 ceph-mon[28069]: pgmap v8158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:22 smithi193 ceph-mon[32782]: pgmap v8159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:22 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14537.077827 secs 2024-04-26T15:50:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:22 smithi196 ceph-mon[32572]: pgmap v8159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:22 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14537.077827 secs 2024-04-26T15:50:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:22 smithi110 ceph-mon[28069]: pgmap v8159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:22 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14537.077827 secs 2024-04-26T15:50:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:24 smithi193 ceph-mon[32782]: pgmap v8160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:24.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:24 smithi196 ceph-mon[32572]: pgmap v8160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:24 smithi110 ceph-mon[28069]: pgmap v8160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:26 smithi193 ceph-mon[32782]: pgmap v8161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:26 smithi196 ceph-mon[32572]: pgmap v8161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:26.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:26 smithi110 ceph-mon[28069]: pgmap v8161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:27 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14542.077909 secs 2024-04-26T15:50:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:27 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14542.077909 secs 2024-04-26T15:50:27.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:27 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14542.077909 secs 2024-04-26T15:50:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:28 smithi193 ceph-mon[32782]: pgmap v8162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:28 smithi196 ceph-mon[32572]: pgmap v8162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:28.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:28 smithi110 ceph-mon[28069]: pgmap v8162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:30 smithi193 ceph-mon[32782]: pgmap v8163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:30 smithi196 ceph-mon[32572]: pgmap v8163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:30.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:30 smithi110 ceph-mon[28069]: pgmap v8163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:32 smithi196 ceph-mon[32572]: pgmap v8164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:32 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14547.078000 secs 2024-04-26T15:50:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:32 smithi110 ceph-mon[28069]: pgmap v8164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:32 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14547.078000 secs 2024-04-26T15:50:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:32 smithi193 ceph-mon[32782]: pgmap v8164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:32 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14547.078000 secs 2024-04-26T15:50:34.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:34 smithi196 ceph-mon[32572]: pgmap v8165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:34 smithi110 ceph-mon[28069]: pgmap v8165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:34 smithi193 ceph-mon[32782]: pgmap v8165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:36 smithi196 ceph-mon[32572]: pgmap v8166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:36 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14552.078095 secs 2024-04-26T15:50:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:36 smithi110 ceph-mon[28069]: pgmap v8166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:36 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14552.078095 secs 2024-04-26T15:50:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:36 smithi193 ceph-mon[32782]: pgmap v8166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:36 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14552.078095 secs 2024-04-26T15:50:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:38 smithi196 ceph-mon[32572]: pgmap v8167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:38.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:38 smithi110 ceph-mon[28069]: pgmap v8167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:38 smithi193 ceph-mon[32782]: pgmap v8167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:40.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:40 smithi196 ceph-mon[32572]: pgmap v8168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:40 smithi110 ceph-mon[28069]: pgmap v8168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:40 smithi193 ceph-mon[32782]: pgmap v8168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:41.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:41 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14557.078209 secs 2024-04-26T15:50:41.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:41 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14557.078209 secs 2024-04-26T15:50:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:41 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14557.078209 secs 2024-04-26T15:50:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:42 smithi196 ceph-mon[32572]: pgmap v8169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:42 smithi110 ceph-mon[28069]: pgmap v8169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:42 smithi193 ceph-mon[32782]: pgmap v8169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:44.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:44 smithi196 ceph-mon[32572]: pgmap v8170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:44.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:44 smithi110 ceph-mon[28069]: pgmap v8170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:44 smithi193 ceph-mon[32782]: pgmap v8170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:45.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:50:45.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:50:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:50:46.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:46 smithi196 ceph-mon[32572]: pgmap v8171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:46.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:46 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14562.078340 secs 2024-04-26T15:50:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:46 smithi193 ceph-mon[32782]: pgmap v8171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:46 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14562.078340 secs 2024-04-26T15:50:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:46 smithi110 ceph-mon[28069]: pgmap v8171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:46 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14562.078340 secs 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: pgmap v8172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: pgmap v8172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: pgmap v8172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:50:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:49.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:49 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:50:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:49 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:50:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:49 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:50:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:49 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:50:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:49 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:50:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:49 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:50:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:49 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:50:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:49 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:50:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:49 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T15:50:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:49 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T15:50:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:49 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T15:50:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:49 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T15:50:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:50.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:50 smithi196 ceph-mon[32572]: pgmap v8173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:50.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:50 smithi110 ceph-mon[28069]: pgmap v8173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:50 smithi193 ceph-mon[32782]: pgmap v8173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:50:51.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:50:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: pgmap v8174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T15:50:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: pgmap v8175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:51 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14567.078447 secs 2024-04-26T15:50:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: pgmap v8174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: pgmap v8175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:51 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14567.078447 secs 2024-04-26T15:50:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: pgmap v8174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: pgmap v8175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:51 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14567.078447 secs 2024-04-26T15:50:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:52 smithi196 ceph-mon[32572]: pgmap v8176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:53.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:52 smithi110 ceph-mon[28069]: pgmap v8176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:52 smithi193 ceph-mon[32782]: pgmap v8176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:55.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:54 smithi196 ceph-mon[32572]: pgmap v8177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:55.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:54 smithi110 ceph-mon[28069]: pgmap v8177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:54 smithi193 ceph-mon[32782]: pgmap v8177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:56.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:56 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14572.078572 secs 2024-04-26T15:50:56.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:56 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14572.078572 secs 2024-04-26T15:50:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:56 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14572.078572 secs 2024-04-26T15:50:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:57 smithi196 ceph-mon[32572]: pgmap v8178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:57 smithi110 ceph-mon[28069]: pgmap v8178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:57 smithi193 ceph-mon[32782]: pgmap v8178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:59.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:50:58 smithi196 ceph-mon[32572]: pgmap v8179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:50:58 smithi110 ceph-mon[28069]: pgmap v8179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:50:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:50:58 smithi193 ceph-mon[32782]: pgmap v8179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:51:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:00 smithi196 ceph-mon[32572]: pgmap v8180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:51:01.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:00 smithi110 ceph-mon[28069]: pgmap v8180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:51:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:00 smithi193 ceph-mon[32782]: pgmap v8180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:51:02.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:01 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14577.078684 secs 2024-04-26T15:51:02.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:01 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14577.078684 secs 2024-04-26T15:51:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:01 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14577.078684 secs 2024-04-26T15:51:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:02 smithi196 ceph-mon[32572]: pgmap v8181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:03.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:02 smithi110 ceph-mon[28069]: pgmap v8181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:02 smithi193 ceph-mon[32782]: pgmap v8181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:05.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:04 smithi196 ceph-mon[32572]: pgmap v8182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:04 smithi110 ceph-mon[28069]: pgmap v8182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:04 smithi193 ceph-mon[32782]: pgmap v8182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:06.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:06 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14582.078804 secs 2024-04-26T15:51:06.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:06 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14582.078804 secs 2024-04-26T15:51:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:06 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14582.078804 secs 2024-04-26T15:51:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:07 smithi196 ceph-mon[32572]: pgmap v8183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:07.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:07 smithi110 ceph-mon[28069]: pgmap v8183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:07 smithi193 ceph-mon[32782]: pgmap v8183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:08 smithi196 ceph-mon[32572]: pgmap v8184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:08 smithi110 ceph-mon[28069]: pgmap v8184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:08 smithi193 ceph-mon[32782]: pgmap v8184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:10 smithi196 ceph-mon[32572]: pgmap v8185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:10 smithi110 ceph-mon[28069]: pgmap v8185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:10 smithi193 ceph-mon[32782]: pgmap v8185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:11 smithi196 ceph-mon[32572]: 15 slow requests, 1 included below; oldest blocked for > 14587.078914 secs 2024-04-26T15:51:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:11 smithi196 ceph-mon[32572]: slow request 724.415047 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:51:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:11 smithi110 ceph-mon[28069]: 15 slow requests, 1 included below; oldest blocked for > 14587.078914 secs 2024-04-26T15:51:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:11 smithi110 ceph-mon[28069]: slow request 724.415047 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:51:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:11 smithi193 ceph-mon[32782]: 15 slow requests, 1 included below; oldest blocked for > 14587.078914 secs 2024-04-26T15:51:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:11 smithi193 ceph-mon[32782]: slow request 724.415047 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:51:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:12 smithi196 ceph-mon[32572]: pgmap v8186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:13.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:12 smithi110 ceph-mon[28069]: pgmap v8186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:12 smithi193 ceph-mon[32782]: pgmap v8186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:14 smithi196 ceph-mon[32572]: pgmap v8187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:14 smithi110 ceph-mon[28069]: pgmap v8187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:14 smithi193 ceph-mon[32782]: pgmap v8187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:16.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:16 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14592.078985 secs 2024-04-26T15:51:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:16 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14592.078985 secs 2024-04-26T15:51:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:16 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14592.078985 secs 2024-04-26T15:51:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:17 smithi196 ceph-mon[32572]: pgmap v8188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:17 smithi110 ceph-mon[28069]: pgmap v8188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:17 smithi193 ceph-mon[32782]: pgmap v8188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:18.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:51:18.770+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:51:18.769 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:51:18.770+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T15:51:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:51:18.771+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 115 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T15:51:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:51:18.771+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 115 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:51:19.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:18 smithi196 ceph-mon[32572]: pgmap v8189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:18 smithi110 ceph-mon[28069]: pgmap v8189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:18 smithi193 ceph-mon[32782]: pgmap v8189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:20 smithi196 ceph-mon[32572]: pgmap v8190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:20 smithi110 ceph-mon[28069]: pgmap v8190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:20 smithi193 ceph-mon[32782]: pgmap v8190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:21 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14597.079059 secs 2024-04-26T15:51:22.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:21 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14597.079059 secs 2024-04-26T15:51:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:21 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14597.079059 secs 2024-04-26T15:51:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:22 smithi196 ceph-mon[32572]: pgmap v8191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:22 smithi110 ceph-mon[28069]: pgmap v8191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:22 smithi193 ceph-mon[32782]: pgmap v8191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:24 smithi196 ceph-mon[32572]: pgmap v8192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:24 smithi110 ceph-mon[28069]: pgmap v8192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:24 smithi193 ceph-mon[32782]: pgmap v8192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:26 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14602.079197 secs 2024-04-26T15:51:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:26 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14602.079197 secs 2024-04-26T15:51:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:26 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14602.079197 secs 2024-04-26T15:51:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:27 smithi196 ceph-mon[32572]: pgmap v8193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:27 smithi110 ceph-mon[28069]: pgmap v8193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:27 smithi193 ceph-mon[32782]: pgmap v8193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:29.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:28 smithi196 ceph-mon[32572]: pgmap v8194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:28 smithi110 ceph-mon[28069]: pgmap v8194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:28 smithi193 ceph-mon[32782]: pgmap v8194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:31.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:30 smithi196 ceph-mon[32572]: pgmap v8195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:31.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:30 smithi110 ceph-mon[28069]: pgmap v8195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:30 smithi193 ceph-mon[32782]: pgmap v8195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:31 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14607.079316 secs 2024-04-26T15:51:32.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:31 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14607.079316 secs 2024-04-26T15:51:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:31 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14607.079316 secs 2024-04-26T15:51:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:32 smithi196 ceph-mon[32572]: pgmap v8196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:33.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:32 smithi110 ceph-mon[28069]: pgmap v8196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:32 smithi193 ceph-mon[32782]: pgmap v8196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:34 smithi196 ceph-mon[32572]: pgmap v8197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:35.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:34 smithi110 ceph-mon[28069]: pgmap v8197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:34 smithi193 ceph-mon[32782]: pgmap v8197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:36 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14612.079404 secs 2024-04-26T15:51:36.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:36 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14612.079404 secs 2024-04-26T15:51:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:36 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14612.079404 secs 2024-04-26T15:51:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:37 smithi196 ceph-mon[32572]: pgmap v8198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:37 smithi110 ceph-mon[28069]: pgmap v8198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:37 smithi193 ceph-mon[32782]: pgmap v8198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:39.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:38 smithi196 ceph-mon[32572]: pgmap v8199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:39.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:38 smithi110 ceph-mon[28069]: pgmap v8199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:38 smithi193 ceph-mon[32782]: pgmap v8199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:40 smithi196 ceph-mon[32572]: pgmap v8200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:41.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:40 smithi110 ceph-mon[28069]: pgmap v8200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:40 smithi193 ceph-mon[32782]: pgmap v8200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:41 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14617.079526 secs 2024-04-26T15:51:42.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:41 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14617.079526 secs 2024-04-26T15:51:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:41 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14617.079526 secs 2024-04-26T15:51:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:42 smithi196 ceph-mon[32572]: pgmap v8201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:43.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:42 smithi110 ceph-mon[28069]: pgmap v8201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:42 smithi193 ceph-mon[32782]: pgmap v8201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:44 smithi196 ceph-mon[32572]: pgmap v8202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:45.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:44 smithi110 ceph-mon[28069]: pgmap v8202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:44 smithi193 ceph-mon[32782]: pgmap v8202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:46.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:46 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14622.079665 secs 2024-04-26T15:51:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:46 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14622.079665 secs 2024-04-26T15:51:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:46 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14622.079665 secs 2024-04-26T15:51:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:47 smithi196 ceph-mon[32572]: pgmap v8203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:47.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:47 smithi110 ceph-mon[28069]: pgmap v8203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:47 smithi193 ceph-mon[32782]: pgmap v8203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:48 smithi196 ceph-mon[32572]: pgmap v8204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:49.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:48 smithi110 ceph-mon[28069]: pgmap v8204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:48 smithi193 ceph-mon[32782]: pgmap v8204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:51:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:50 smithi196 ceph-mon[32572]: pgmap v8205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:51.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:50 smithi110 ceph-mon[28069]: pgmap v8205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:50 smithi193 ceph-mon[32782]: pgmap v8205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:51:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:51:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:51 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14627.079729 secs 2024-04-26T15:51:52.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:51:52.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:51 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14627.079729 secs 2024-04-26T15:51:52.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:51:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:51 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14627.079729 secs 2024-04-26T15:51:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:52 smithi196 ceph-mon[32572]: pgmap v8206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:52 smithi196 ceph-mon[32572]: pgmap v8207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T15:51:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:51:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:51:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:51:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:52 smithi110 ceph-mon[28069]: pgmap v8206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:51:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:52 smithi110 ceph-mon[28069]: pgmap v8207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T15:51:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:51:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:51:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:51:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:52 smithi193 ceph-mon[32782]: pgmap v8206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T15:51:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:52 smithi193 ceph-mon[32782]: pgmap v8207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T15:51:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:51:55.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:55 smithi196 ceph-mon[32572]: pgmap v8208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:51:55.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:55 smithi110 ceph-mon[28069]: pgmap v8208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:51:55.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:55 smithi193 ceph-mon[32782]: pgmap v8208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:51:57.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:57 smithi196 ceph-mon[32572]: pgmap v8209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:51:57.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:57 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14632.079793 secs 2024-04-26T15:51:57.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:57 smithi110 ceph-mon[28069]: pgmap v8209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:51:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:57 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14632.079793 secs 2024-04-26T15:51:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:57 smithi193 ceph-mon[32782]: pgmap v8209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:51:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:57 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14632.079793 secs 2024-04-26T15:51:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:51:59 smithi196 ceph-mon[32572]: pgmap v8210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:51:59.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:51:59 smithi110 ceph-mon[28069]: pgmap v8210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:51:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:51:59 smithi193 ceph-mon[32782]: pgmap v8210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:01.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:01 smithi196 ceph-mon[32572]: pgmap v8211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:01 smithi110 ceph-mon[28069]: pgmap v8211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:01 smithi193 ceph-mon[32782]: pgmap v8211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:02 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14637.079919 secs 2024-04-26T15:52:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:02 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14637.079919 secs 2024-04-26T15:52:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:02 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14637.079919 secs 2024-04-26T15:52:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:03 smithi193 ceph-mon[32782]: pgmap v8212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:52:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:03 smithi110 ceph-mon[28069]: pgmap v8212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:52:03.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:03 smithi196 ceph-mon[32572]: pgmap v8212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:52:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:05 smithi110 ceph-mon[28069]: pgmap v8213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:05.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:05 smithi196 ceph-mon[32572]: pgmap v8213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:05 smithi193 ceph-mon[32782]: pgmap v8213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:07 smithi110 ceph-mon[28069]: pgmap v8214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:07 smithi110 ceph-mon[28069]: 15 slow requests, 0 included below; oldest blocked for > 14642.079983 secs 2024-04-26T15:52:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:07 smithi193 ceph-mon[32782]: pgmap v8214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:07 smithi193 ceph-mon[32782]: 15 slow requests, 0 included below; oldest blocked for > 14642.079983 secs 2024-04-26T15:52:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:07 smithi196 ceph-mon[32572]: pgmap v8214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:07 smithi196 ceph-mon[32572]: 15 slow requests, 0 included below; oldest blocked for > 14642.079983 secs 2024-04-26T15:52:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:09 smithi110 ceph-mon[28069]: pgmap v8215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:09 smithi193 ceph-mon[32782]: pgmap v8215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:09.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:09 smithi196 ceph-mon[32572]: pgmap v8215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:11.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:11 smithi110 ceph-mon[28069]: pgmap v8216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:11 smithi193 ceph-mon[32782]: pgmap v8216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:11 smithi196 ceph-mon[32572]: pgmap v8216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:12 smithi110 ceph-mon[28069]: 16 slow requests, 1 included below; oldest blocked for > 14647.080120 secs 2024-04-26T15:52:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:12 smithi110 ceph-mon[28069]: slow request 184.097880 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:52:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:12 smithi193 ceph-mon[32782]: 16 slow requests, 1 included below; oldest blocked for > 14647.080120 secs 2024-04-26T15:52:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:12 smithi193 ceph-mon[32782]: slow request 184.097880 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:52:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:12 smithi196 ceph-mon[32572]: 16 slow requests, 1 included below; oldest blocked for > 14647.080120 secs 2024-04-26T15:52:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:12 smithi196 ceph-mon[32572]: slow request 184.097880 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:52:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:13 smithi193 ceph-mon[32782]: pgmap v8217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:13.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:13 smithi196 ceph-mon[32572]: pgmap v8217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:13 smithi110 ceph-mon[28069]: pgmap v8217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:14 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:52:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:14 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:52:14.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:14 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:52:14.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:14 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:52:14.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:14 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:52:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:14 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:52:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:15 smithi193 ceph-mon[32782]: pgmap v8218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:15.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:15 smithi196 ceph-mon[32572]: pgmap v8218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:15.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:15 smithi110 ceph-mon[28069]: pgmap v8218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:17 smithi193 ceph-mon[32782]: pgmap v8219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:17 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14652.080217 secs 2024-04-26T15:52:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:17 smithi196 ceph-mon[32572]: pgmap v8219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:17 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14652.080217 secs 2024-04-26T15:52:17.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:17 smithi110 ceph-mon[28069]: pgmap v8219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:17.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:17 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14652.080217 secs 2024-04-26T15:52:19.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:19 smithi110 ceph-mon[28069]: pgmap v8220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:19 smithi193 ceph-mon[32782]: pgmap v8220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:19.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:19 smithi196 ceph-mon[32572]: pgmap v8220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:21 smithi193 ceph-mon[32782]: pgmap v8221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:21.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:21 smithi196 ceph-mon[32572]: pgmap v8221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:21 smithi110 ceph-mon[28069]: pgmap v8221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:22 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14657.080327 secs 2024-04-26T15:52:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:22 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14657.080327 secs 2024-04-26T15:52:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:22 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14657.080327 secs 2024-04-26T15:52:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:23 smithi193 ceph-mon[32782]: pgmap v8222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:23.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:23 smithi196 ceph-mon[32572]: pgmap v8222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:23 smithi110 ceph-mon[28069]: pgmap v8222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:25 smithi193 ceph-mon[32782]: pgmap v8223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:25.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:25 smithi196 ceph-mon[32572]: pgmap v8223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:25 smithi110 ceph-mon[28069]: pgmap v8223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:27 smithi193 ceph-mon[32782]: pgmap v8224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:27 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14662.080444 secs 2024-04-26T15:52:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:27 smithi196 ceph-mon[32572]: pgmap v8224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:27 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14662.080444 secs 2024-04-26T15:52:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:27 smithi110 ceph-mon[28069]: pgmap v8224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:27 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14662.080444 secs 2024-04-26T15:52:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:29 smithi193 ceph-mon[32782]: pgmap v8225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:29.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:29 smithi196 ceph-mon[32572]: pgmap v8225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:29.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:29 smithi110 ceph-mon[28069]: pgmap v8225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:31 smithi193 ceph-mon[32782]: pgmap v8226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:31.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:31 smithi196 ceph-mon[32572]: pgmap v8226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:31 smithi110 ceph-mon[28069]: pgmap v8226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:32 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14667.080560 secs 2024-04-26T15:52:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:32 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14667.080560 secs 2024-04-26T15:52:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:32 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14667.080560 secs 2024-04-26T15:52:33.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:33 smithi196 ceph-mon[32572]: pgmap v8227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:33 smithi110 ceph-mon[28069]: pgmap v8227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:33 smithi193 ceph-mon[32782]: pgmap v8227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:35.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:35 smithi196 ceph-mon[32572]: pgmap v8228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:35.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:35 smithi110 ceph-mon[28069]: pgmap v8228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:35 smithi193 ceph-mon[32782]: pgmap v8228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:37 smithi196 ceph-mon[32572]: pgmap v8229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:37 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14672.080676 secs 2024-04-26T15:52:37.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:37 smithi110 ceph-mon[28069]: pgmap v8229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:37 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14672.080676 secs 2024-04-26T15:52:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:37 smithi193 ceph-mon[32782]: pgmap v8229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:37 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14672.080676 secs 2024-04-26T15:52:39.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:39 smithi196 ceph-mon[32572]: pgmap v8230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:39 smithi110 ceph-mon[28069]: pgmap v8230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:39 smithi193 ceph-mon[32782]: pgmap v8230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:41.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:41 smithi196 ceph-mon[32572]: pgmap v8231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:52:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:41 smithi110 ceph-mon[28069]: pgmap v8231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:52:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:41 smithi193 ceph-mon[32782]: pgmap v8231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:52:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:42 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14677.080756 secs 2024-04-26T15:52:42.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:42 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14677.080756 secs 2024-04-26T15:52:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:42 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14677.080756 secs 2024-04-26T15:52:43.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:43 smithi196 ceph-mon[32572]: pgmap v8232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:52:43.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:43 smithi110 ceph-mon[28069]: pgmap v8232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:52:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:43 smithi193 ceph-mon[32782]: pgmap v8232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:52:45.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:45 smithi196 ceph-mon[32572]: pgmap v8233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:45.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:45 smithi110 ceph-mon[28069]: pgmap v8233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:45 smithi193 ceph-mon[32782]: pgmap v8233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:46.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:46 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14682.080837 secs 2024-04-26T15:52:46.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:46 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14682.080837 secs 2024-04-26T15:52:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:46 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14682.080837 secs 2024-04-26T15:52:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:47 smithi196 ceph-mon[32572]: pgmap v8234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:52:47.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:47 smithi110 ceph-mon[28069]: pgmap v8234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:52:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:47 smithi193 ceph-mon[32782]: pgmap v8234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T15:52:49.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:49 smithi196 ceph-mon[32572]: pgmap v8235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:49.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:49 smithi110 ceph-mon[28069]: pgmap v8235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:49 smithi193 ceph-mon[32782]: pgmap v8235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:52:51.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:51 smithi196 ceph-mon[32572]: pgmap v8236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:51.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:51 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14687.080977 secs 2024-04-26T15:52:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:51 smithi110 ceph-mon[28069]: pgmap v8236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:51 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14687.080977 secs 2024-04-26T15:52:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:51 smithi193 ceph-mon[32782]: pgmap v8236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:51 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14687.080977 secs 2024-04-26T15:52:53.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:53 smithi196 ceph-mon[32572]: pgmap v8237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:52:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:53 smithi110 ceph-mon[28069]: pgmap v8237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:52:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:53 smithi193 ceph-mon[32782]: pgmap v8237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:52:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:52:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:52:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:52:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:52:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:52:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:52:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:52:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:52:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:52:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:52:55.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:55 smithi196 ceph-mon[32572]: pgmap v8238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:52:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:55 smithi196 ceph-mon[32572]: pgmap v8239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:55.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:55 smithi110 ceph-mon[28069]: pgmap v8238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:52:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:55 smithi110 ceph-mon[28069]: pgmap v8239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:55 smithi193 ceph-mon[32782]: pgmap v8238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:52:55.890 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:55 smithi193 ceph-mon[32782]: pgmap v8239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:56.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:56 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14692.081041 secs 2024-04-26T15:52:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:56 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14692.081041 secs 2024-04-26T15:52:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:56 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14692.081041 secs 2024-04-26T15:52:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:57 smithi196 ceph-mon[32572]: pgmap v8240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:57.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:57 smithi110 ceph-mon[28069]: pgmap v8240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:57 smithi193 ceph-mon[32782]: pgmap v8240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:59.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:52:59 smithi196 ceph-mon[32572]: pgmap v8241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:59.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:52:59 smithi110 ceph-mon[28069]: pgmap v8241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:52:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:52:59 smithi193 ceph-mon[32782]: pgmap v8241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:01.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:01 smithi196 ceph-mon[32572]: pgmap v8242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:01.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:01 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14697.081160 secs 2024-04-26T15:53:01.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:01 smithi110 ceph-mon[28069]: pgmap v8242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:01 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14697.081160 secs 2024-04-26T15:53:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:01 smithi193 ceph-mon[32782]: pgmap v8242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:01 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14697.081160 secs 2024-04-26T15:53:03.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:03 smithi196 ceph-mon[32572]: pgmap v8243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:03 smithi110 ceph-mon[28069]: pgmap v8243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:03 smithi193 ceph-mon[32782]: pgmap v8243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:05.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:05 smithi196 ceph-mon[32572]: pgmap v8244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:53:05.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:05 smithi110 ceph-mon[28069]: pgmap v8244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:53:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:05 smithi193 ceph-mon[32782]: pgmap v8244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:53:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:06 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14702.081295 secs 2024-04-26T15:53:06.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:06 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14702.081295 secs 2024-04-26T15:53:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:06 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14702.081295 secs 2024-04-26T15:53:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:07 smithi196 ceph-mon[32572]: pgmap v8245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:07 smithi110 ceph-mon[28069]: pgmap v8245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:07 smithi193 ceph-mon[32782]: pgmap v8245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:09 smithi110 ceph-mon[28069]: pgmap v8246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:09 smithi193 ceph-mon[32782]: pgmap v8246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:09 smithi196 ceph-mon[32572]: pgmap v8246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:11 smithi110 ceph-mon[28069]: pgmap v8247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:11 smithi110 ceph-mon[28069]: 16 slow requests, 1 included below; oldest blocked for > 14707.081434 secs 2024-04-26T15:53:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:11 smithi110 ceph-mon[28069]: slow request 1444.706319 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:53:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:11 smithi193 ceph-mon[32782]: pgmap v8247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:11 smithi193 ceph-mon[32782]: 16 slow requests, 1 included below; oldest blocked for > 14707.081434 secs 2024-04-26T15:53:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:11 smithi193 ceph-mon[32782]: slow request 1444.706319 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:53:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:11 smithi196 ceph-mon[32572]: pgmap v8247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:11 smithi196 ceph-mon[32572]: 16 slow requests, 1 included below; oldest blocked for > 14707.081434 secs 2024-04-26T15:53:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:11 smithi196 ceph-mon[32572]: slow request 1444.706319 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:53:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:13 smithi110 ceph-mon[28069]: pgmap v8248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:13 smithi193 ceph-mon[32782]: pgmap v8248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:13 smithi196 ceph-mon[32572]: pgmap v8248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:15 smithi110 ceph-mon[28069]: pgmap v8249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:15 smithi193 ceph-mon[32782]: pgmap v8249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:16.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:15 smithi196 ceph-mon[32572]: pgmap v8249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:16 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14712.081593 secs 2024-04-26T15:53:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:16 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14712.081593 secs 2024-04-26T15:53:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:16 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14712.081593 secs 2024-04-26T15:53:17.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:17 smithi110 ceph-mon[28069]: pgmap v8250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:17 smithi193 ceph-mon[32782]: pgmap v8250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:17 smithi196 ceph-mon[32572]: pgmap v8250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:19 smithi110 ceph-mon[28069]: pgmap v8251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:19 smithi193 ceph-mon[32782]: pgmap v8251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:20.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:19 smithi196 ceph-mon[32572]: pgmap v8251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:21 smithi193 ceph-mon[32782]: pgmap v8252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:21 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14717.081714 secs 2024-04-26T15:53:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:21 smithi196 ceph-mon[32572]: pgmap v8252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:21 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14717.081714 secs 2024-04-26T15:53:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:21 smithi110 ceph-mon[28069]: pgmap v8252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:21 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14717.081714 secs 2024-04-26T15:53:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:23 smithi193 ceph-mon[32782]: pgmap v8253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:24.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:23 smithi196 ceph-mon[32572]: pgmap v8253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:24.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:23 smithi110 ceph-mon[28069]: pgmap v8253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:25 smithi193 ceph-mon[32782]: pgmap v8254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:25 smithi196 ceph-mon[32572]: pgmap v8254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:25 smithi110 ceph-mon[28069]: pgmap v8254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:26 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14722.081843 secs 2024-04-26T15:53:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:26 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14722.081843 secs 2024-04-26T15:53:27.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:26 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14722.081843 secs 2024-04-26T15:53:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:27 smithi193 ceph-mon[32782]: pgmap v8255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:27 smithi196 ceph-mon[32572]: pgmap v8255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:27 smithi110 ceph-mon[28069]: pgmap v8255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:29 smithi193 ceph-mon[32782]: pgmap v8256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:30.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:29 smithi196 ceph-mon[32572]: pgmap v8256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:30.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:29 smithi110 ceph-mon[28069]: pgmap v8256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:31 smithi193 ceph-mon[32782]: pgmap v8257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:31 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14727.081933 secs 2024-04-26T15:53:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:31 smithi196 ceph-mon[32572]: pgmap v8257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:31 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14727.081933 secs 2024-04-26T15:53:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:31 smithi110 ceph-mon[28069]: pgmap v8257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:31 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14727.081933 secs 2024-04-26T15:53:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:33 smithi193 ceph-mon[32782]: pgmap v8258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:34.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:33 smithi196 ceph-mon[32572]: pgmap v8258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:33 smithi110 ceph-mon[28069]: pgmap v8258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:35 smithi193 ceph-mon[32782]: pgmap v8259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:36.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:35 smithi196 ceph-mon[32572]: pgmap v8259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:35 smithi110 ceph-mon[28069]: pgmap v8259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:36 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14732.082052 secs 2024-04-26T15:53:37.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:36 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14732.082052 secs 2024-04-26T15:53:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:36 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14732.082052 secs 2024-04-26T15:53:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:37 smithi193 ceph-mon[32782]: pgmap v8260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:37 smithi196 ceph-mon[32572]: pgmap v8260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:37 smithi110 ceph-mon[28069]: pgmap v8260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:39 smithi193 ceph-mon[32782]: pgmap v8261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:40.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:39 smithi196 ceph-mon[32572]: pgmap v8261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:39 smithi110 ceph-mon[28069]: pgmap v8261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:41 smithi193 ceph-mon[32782]: pgmap v8262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:41 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14737.082191 secs 2024-04-26T15:53:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:41 smithi196 ceph-mon[32572]: pgmap v8262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:41 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14737.082191 secs 2024-04-26T15:53:42.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:41 smithi110 ceph-mon[28069]: pgmap v8262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:41 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14737.082191 secs 2024-04-26T15:53:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:43 smithi193 ceph-mon[32782]: pgmap v8263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:44.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:43 smithi196 ceph-mon[32572]: pgmap v8263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:43 smithi110 ceph-mon[28069]: pgmap v8263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:45 smithi196 ceph-mon[32572]: pgmap v8264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:45 smithi110 ceph-mon[28069]: pgmap v8264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:45 smithi193 ceph-mon[32782]: pgmap v8264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:46 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14742.082325 secs 2024-04-26T15:53:47.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:46 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14742.082325 secs 2024-04-26T15:53:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:46 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14742.082325 secs 2024-04-26T15:53:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:47 smithi196 ceph-mon[32572]: pgmap v8265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:47 smithi110 ceph-mon[28069]: pgmap v8265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:47 smithi193 ceph-mon[32782]: pgmap v8265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:50.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:49 smithi196 ceph-mon[32572]: pgmap v8266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:49 smithi110 ceph-mon[28069]: pgmap v8266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:49 smithi193 ceph-mon[32782]: pgmap v8266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:51 smithi196 ceph-mon[32572]: pgmap v8267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:51 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14747.082443 secs 2024-04-26T15:53:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:51 smithi110 ceph-mon[28069]: pgmap v8267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:51 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14747.082443 secs 2024-04-26T15:53:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:51 smithi193 ceph-mon[32782]: pgmap v8267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:51 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14747.082443 secs 2024-04-26T15:53:53.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:53 smithi193 ceph-mon[32782]: pgmap v8268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:53 smithi196 ceph-mon[32572]: pgmap v8268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:53 smithi110 ceph-mon[28069]: pgmap v8268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:53:55.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:53:55.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:53:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:53:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:55 smithi196 ceph-mon[32572]: pgmap v8269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:53:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:53:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:53:56.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:55 smithi110 ceph-mon[28069]: pgmap v8269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:53:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:53:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:53:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:55 smithi193 ceph-mon[32782]: pgmap v8269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:53:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:53:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:53:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:53:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:56 smithi196 ceph-mon[32572]: pgmap v8270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:53:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:56 smithi196 ceph-mon[32572]: pgmap v8271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:56 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14752.082558 secs 2024-04-26T15:53:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:56 smithi110 ceph-mon[28069]: pgmap v8270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:53:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:56 smithi110 ceph-mon[28069]: pgmap v8271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:56 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14752.082558 secs 2024-04-26T15:53:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:56 smithi193 ceph-mon[32782]: pgmap v8270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:53:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:56 smithi193 ceph-mon[32782]: pgmap v8271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:53:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:56 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14752.082558 secs 2024-04-26T15:53:59.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:53:58 smithi196 ceph-mon[32572]: pgmap v8272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:53:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:53:58 smithi110 ceph-mon[28069]: pgmap v8272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:53:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:53:58 smithi193 ceph-mon[32782]: pgmap v8272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T15:54:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:00 smithi196 ceph-mon[32572]: pgmap v8273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:54:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:00 smithi110 ceph-mon[28069]: pgmap v8273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:54:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:00 smithi193 ceph-mon[32782]: pgmap v8273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:54:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:01 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14757.082681 secs 2024-04-26T15:54:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:01 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14757.082681 secs 2024-04-26T15:54:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:01 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14757.082681 secs 2024-04-26T15:54:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:02 smithi196 ceph-mon[32572]: pgmap v8274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:54:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:02 smithi110 ceph-mon[28069]: pgmap v8274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:54:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:02 smithi193 ceph-mon[32782]: pgmap v8274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:54:04.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:03 smithi196 ceph-mon[32572]: pgmap v8275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:54:04.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:03 smithi110 ceph-mon[28069]: pgmap v8275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:54:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:03 smithi193 ceph-mon[32782]: pgmap v8275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:54:06.706 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:06 smithi196 ceph-mon[32572]: pgmap v8276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:54:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:06 smithi110 ceph-mon[28069]: pgmap v8276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:54:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:06 smithi193 ceph-mon[32782]: pgmap v8276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:54:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:07 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14762.082741 secs 2024-04-26T15:54:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:07 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14762.082741 secs 2024-04-26T15:54:07.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:54:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:54:07.497+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:54:07.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:54:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:54:07.497+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:54:07.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:54:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:54:07.497+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:54:07.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:54:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:54:07.497+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:54:07.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:54:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:54:07.497+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:54:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:07 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14762.082741 secs 2024-04-26T15:54:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:08 smithi196 ceph-mon[32572]: pgmap v8277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:08 smithi110 ceph-mon[28069]: pgmap v8277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:08 smithi193 ceph-mon[32782]: pgmap v8277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:10.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:10 smithi196 ceph-mon[32572]: pgmap v8278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T15:54:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:10 smithi110 ceph-mon[28069]: pgmap v8278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T15:54:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:10 smithi193 ceph-mon[32782]: pgmap v8278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T15:54:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:11 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14767.082865 secs 2024-04-26T15:54:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:11 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14767.082865 secs 2024-04-26T15:54:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:11 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14767.082865 secs 2024-04-26T15:54:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:12 smithi196 ceph-mon[32572]: pgmap v8279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T15:54:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:12 smithi110 ceph-mon[28069]: pgmap v8279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T15:54:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:12 smithi193 ceph-mon[32782]: pgmap v8279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T15:54:14.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:14 smithi196 ceph-mon[32572]: pgmap v8280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:54:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:14 smithi110 ceph-mon[28069]: pgmap v8280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:54:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:14 smithi193 ceph-mon[32782]: pgmap v8280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T15:54:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:16 smithi196 ceph-mon[32572]: pgmap v8281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:54:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:16 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14772.082979 secs 2024-04-26T15:54:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:16 smithi110 ceph-mon[28069]: pgmap v8281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:54:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:16 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14772.082979 secs 2024-04-26T15:54:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:16 smithi193 ceph-mon[32782]: pgmap v8281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:54:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:16 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14772.082979 secs 2024-04-26T15:54:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:18 smithi196 ceph-mon[32572]: pgmap v8282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:54:18.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:18 smithi110 ceph-mon[28069]: pgmap v8282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:54:18.799 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:54:18.800+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:54:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:54:18.800+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T15:54:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:54:18.801+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 116 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T15:54:18.800 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:54:18.801+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 116 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:54:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:18 smithi193 ceph-mon[32782]: pgmap v8282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:54:20.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:20 smithi196 ceph-mon[32572]: pgmap v8283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:54:20.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:20 smithi110 ceph-mon[28069]: pgmap v8283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:54:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:20 smithi193 ceph-mon[32782]: pgmap v8283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T15:54:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:21 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14777.083097 secs 2024-04-26T15:54:21.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:21 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14777.083097 secs 2024-04-26T15:54:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:21 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14777.083097 secs 2024-04-26T15:54:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:22 smithi196 ceph-mon[32572]: pgmap v8284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-26T15:54:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:22 smithi110 ceph-mon[28069]: pgmap v8284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-26T15:54:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:22 smithi193 ceph-mon[32782]: pgmap v8284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-26T15:54:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:24 smithi196 ceph-mon[32572]: pgmap v8285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T15:54:24.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:24 smithi110 ceph-mon[28069]: pgmap v8285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T15:54:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:24 smithi193 ceph-mon[32782]: pgmap v8285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T15:54:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:26 smithi196 ceph-mon[32572]: pgmap v8286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:26 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14782.083212 secs 2024-04-26T15:54:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:26 smithi110 ceph-mon[28069]: pgmap v8286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:26 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14782.083212 secs 2024-04-26T15:54:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:26 smithi193 ceph-mon[32782]: pgmap v8286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:26 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14782.083212 secs 2024-04-26T15:54:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:28 smithi196 ceph-mon[32572]: pgmap v8287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:28.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:28 smithi110 ceph-mon[28069]: pgmap v8287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:28 smithi193 ceph-mon[32782]: pgmap v8287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:30 smithi196 ceph-mon[32572]: pgmap v8288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:54:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:30 smithi110 ceph-mon[28069]: pgmap v8288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:54:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:30 smithi193 ceph-mon[32782]: pgmap v8288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:54:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:31 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14787.083324 secs 2024-04-26T15:54:31.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:31 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14787.083324 secs 2024-04-26T15:54:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:31 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14787.083324 secs 2024-04-26T15:54:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:32 smithi196 ceph-mon[32572]: pgmap v8289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:32 smithi110 ceph-mon[28069]: pgmap v8289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:32 smithi193 ceph-mon[32782]: pgmap v8289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:34.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:34 smithi196 ceph-mon[32572]: pgmap v8290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:34.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:34 smithi110 ceph-mon[28069]: pgmap v8290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:34 smithi193 ceph-mon[32782]: pgmap v8290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:36 smithi196 ceph-mon[32572]: pgmap v8291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:36 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14792.083456 secs 2024-04-26T15:54:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:36 smithi110 ceph-mon[28069]: pgmap v8291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:36 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14792.083456 secs 2024-04-26T15:54:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:36 smithi193 ceph-mon[32782]: pgmap v8291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:36 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14792.083456 secs 2024-04-26T15:54:38.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:38 smithi110 ceph-mon[28069]: pgmap v8292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:38 smithi193 ceph-mon[32782]: pgmap v8292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:39.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:38 smithi196 ceph-mon[32572]: pgmap v8292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:40 smithi110 ceph-mon[28069]: pgmap v8293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:54:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:40 smithi193 ceph-mon[32782]: pgmap v8293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:54:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:40 smithi196 ceph-mon[32572]: pgmap v8293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:54:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:41 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14797.083589 secs 2024-04-26T15:54:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:41 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14797.083589 secs 2024-04-26T15:54:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:41 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14797.083589 secs 2024-04-26T15:54:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:42 smithi110 ceph-mon[28069]: pgmap v8294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:42 smithi193 ceph-mon[32782]: pgmap v8294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:42 smithi196 ceph-mon[32572]: pgmap v8294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:44.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:44 smithi110 ceph-mon[28069]: pgmap v8295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:44 smithi193 ceph-mon[32782]: pgmap v8295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:44 smithi196 ceph-mon[32572]: pgmap v8295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:46 smithi110 ceph-mon[28069]: pgmap v8296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:46 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14802.083705 secs 2024-04-26T15:54:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:46 smithi193 ceph-mon[32782]: pgmap v8296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:46 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14802.083705 secs 2024-04-26T15:54:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:46 smithi196 ceph-mon[32572]: pgmap v8296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:46 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14802.083705 secs 2024-04-26T15:54:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:48 smithi110 ceph-mon[28069]: pgmap v8297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:48 smithi193 ceph-mon[32782]: pgmap v8297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:48 smithi196 ceph-mon[32572]: pgmap v8297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:50 smithi193 ceph-mon[32782]: pgmap v8298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:54:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:50 smithi196 ceph-mon[32572]: pgmap v8298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:54:51.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:50 smithi110 ceph-mon[28069]: pgmap v8298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:54:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:51 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14807.083789 secs 2024-04-26T15:54:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:51 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14807.083789 secs 2024-04-26T15:54:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:51 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14807.083789 secs 2024-04-26T15:54:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:52 smithi193 ceph-mon[32782]: pgmap v8299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:52 smithi196 ceph-mon[32572]: pgmap v8299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:52 smithi110 ceph-mon[28069]: pgmap v8299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:54 smithi193 ceph-mon[32782]: pgmap v8300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:55.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:54 smithi196 ceph-mon[32572]: pgmap v8300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:55.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:54 smithi110 ceph-mon[28069]: pgmap v8300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:54:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:56 smithi193 ceph-mon[32782]: pgmap v8301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:54:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:56 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14812.083870 secs 2024-04-26T15:54:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:56 smithi196 ceph-mon[32572]: pgmap v8301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:54:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:56 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14812.083870 secs 2024-04-26T15:54:57.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:56 smithi110 ceph-mon[28069]: pgmap v8301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:54:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:54:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:56 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14812.083870 secs 2024-04-26T15:54:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:54:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:54:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:54:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:54:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:54:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:54:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:54:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:54:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:54:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:58 smithi193 ceph-mon[32782]: pgmap v8302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:54:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:54:58 smithi193 ceph-mon[32782]: pgmap v8303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:54:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:58 smithi196 ceph-mon[32572]: pgmap v8302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:54:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:54:58 smithi196 ceph-mon[32572]: pgmap v8303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:54:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:58 smithi110 ceph-mon[28069]: pgmap v8302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T15:54:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:54:58 smithi110 ceph-mon[28069]: pgmap v8303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T15:55:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:00 smithi193 ceph-mon[32782]: pgmap v8304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:55:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:00 smithi196 ceph-mon[32572]: pgmap v8304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:55:01.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:00 smithi110 ceph-mon[28069]: pgmap v8304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:55:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:01 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14817.083996 secs 2024-04-26T15:55:02.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:01 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14817.083996 secs 2024-04-26T15:55:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:01 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14817.083996 secs 2024-04-26T15:55:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:02 smithi193 ceph-mon[32782]: pgmap v8305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:55:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:02 smithi196 ceph-mon[32572]: pgmap v8305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:55:03.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:02 smithi110 ceph-mon[28069]: pgmap v8305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:55:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:04 smithi193 ceph-mon[32782]: pgmap v8306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:05.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:04 smithi196 ceph-mon[32572]: pgmap v8306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:04 smithi110 ceph-mon[28069]: pgmap v8306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:06 smithi193 ceph-mon[32782]: pgmap v8307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:06 smithi193 ceph-mon[32782]: 16 slow requests, 1 included below; oldest blocked for > 14822.084091 secs 2024-04-26T15:55:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:06 smithi193 ceph-mon[32782]: slow request 5761.802614 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:55:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:06 smithi196 ceph-mon[32572]: pgmap v8307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:06 smithi196 ceph-mon[32572]: 16 slow requests, 1 included below; oldest blocked for > 14822.084091 secs 2024-04-26T15:55:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:06 smithi196 ceph-mon[32572]: slow request 5761.802614 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:55:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:06 smithi110 ceph-mon[28069]: pgmap v8307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:06 smithi110 ceph-mon[28069]: 16 slow requests, 1 included below; oldest blocked for > 14822.084091 secs 2024-04-26T15:55:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:06 smithi110 ceph-mon[28069]: slow request 5761.802614 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:55:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:08 smithi193 ceph-mon[32782]: pgmap v8308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:09.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:08 smithi196 ceph-mon[32572]: pgmap v8308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:08 smithi110 ceph-mon[28069]: pgmap v8308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:10 smithi193 ceph-mon[32782]: pgmap v8309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:11.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:10 smithi196 ceph-mon[32572]: pgmap v8309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:11.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:10 smithi110 ceph-mon[28069]: pgmap v8309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:11 smithi196 ceph-mon[32572]: 16 slow requests, 1 included below; oldest blocked for > 14827.084231 secs 2024-04-26T15:55:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:11 smithi196 ceph-mon[32572]: slow request 364.101991 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:55:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:11 smithi110 ceph-mon[28069]: 16 slow requests, 1 included below; oldest blocked for > 14827.084231 secs 2024-04-26T15:55:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:11 smithi110 ceph-mon[28069]: slow request 364.101991 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:55:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:11 smithi193 ceph-mon[32782]: 16 slow requests, 1 included below; oldest blocked for > 14827.084231 secs 2024-04-26T15:55:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:11 smithi193 ceph-mon[32782]: slow request 364.101991 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:55:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:12 smithi196 ceph-mon[32572]: pgmap v8310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:55:13.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:12 smithi110 ceph-mon[28069]: pgmap v8310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:55:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:12 smithi193 ceph-mon[32782]: pgmap v8310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T15:55:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:14 smithi196 ceph-mon[32572]: pgmap v8311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:14 smithi110 ceph-mon[28069]: pgmap v8311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:14 smithi193 ceph-mon[32782]: pgmap v8311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T15:55:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:16 smithi196 ceph-mon[32572]: pgmap v8312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:16 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14832.084298 secs 2024-04-26T15:55:17.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:16 smithi110 ceph-mon[28069]: pgmap v8312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:16 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14832.084298 secs 2024-04-26T15:55:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:16 smithi193 ceph-mon[32782]: pgmap v8312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:16 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14832.084298 secs 2024-04-26T15:55:19.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:18 smithi196 ceph-mon[32572]: pgmap v8313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:18 smithi110 ceph-mon[28069]: pgmap v8313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:18 smithi193 ceph-mon[32782]: pgmap v8313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:20 smithi196 ceph-mon[32572]: pgmap v8314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:20 smithi110 ceph-mon[28069]: pgmap v8314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:20 smithi193 ceph-mon[32782]: pgmap v8314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:21 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14837.084451 secs 2024-04-26T15:55:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:21 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14837.084451 secs 2024-04-26T15:55:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:21 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14837.084451 secs 2024-04-26T15:55:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:22 smithi196 ceph-mon[32572]: pgmap v8315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:22 smithi110 ceph-mon[28069]: pgmap v8315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:22 smithi193 ceph-mon[32782]: pgmap v8315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:24.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:24 smithi193 ceph-mon[32782]: pgmap v8316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:24 smithi196 ceph-mon[32572]: pgmap v8316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:24 smithi110 ceph-mon[28069]: pgmap v8316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:26 smithi196 ceph-mon[32572]: pgmap v8317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:26 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14842.084581 secs 2024-04-26T15:55:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:26 smithi110 ceph-mon[28069]: pgmap v8317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:26 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14842.084581 secs 2024-04-26T15:55:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:26 smithi193 ceph-mon[32782]: pgmap v8317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:26 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14842.084581 secs 2024-04-26T15:55:29.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:28 smithi196 ceph-mon[32572]: pgmap v8318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:29.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:28 smithi110 ceph-mon[28069]: pgmap v8318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:28 smithi193 ceph-mon[32782]: pgmap v8318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:31.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:30 smithi196 ceph-mon[32572]: pgmap v8319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:30 smithi110 ceph-mon[28069]: pgmap v8319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:30 smithi193 ceph-mon[32782]: pgmap v8319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:31 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14847.084655 secs 2024-04-26T15:55:32.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:31 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14847.084655 secs 2024-04-26T15:55:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:31 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14847.084655 secs 2024-04-26T15:55:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:32 smithi196 ceph-mon[32572]: pgmap v8320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:33.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:32 smithi110 ceph-mon[28069]: pgmap v8320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:32 smithi193 ceph-mon[32782]: pgmap v8320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:34.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:33 smithi110 ceph-mon[28069]: pgmap v8321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:33 smithi193 ceph-mon[32782]: pgmap v8321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:33 smithi196 ceph-mon[32572]: pgmap v8321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:35 smithi196 ceph-mon[32572]: pgmap v8322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:35 smithi110 ceph-mon[28069]: pgmap v8322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:35 smithi193 ceph-mon[32782]: pgmap v8322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:37.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:36 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14852.084728 secs 2024-04-26T15:55:37.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:36 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14852.084728 secs 2024-04-26T15:55:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:36 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14852.084728 secs 2024-04-26T15:55:38.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:37 smithi196 ceph-mon[32572]: pgmap v8323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:38.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:37 smithi110 ceph-mon[28069]: pgmap v8323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:37 smithi193 ceph-mon[32782]: pgmap v8323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:39 smithi196 ceph-mon[32572]: pgmap v8324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:39 smithi110 ceph-mon[28069]: pgmap v8324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:39 smithi193 ceph-mon[32782]: pgmap v8324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:42.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:41 smithi196 ceph-mon[32572]: pgmap v8325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:41 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14857.084826 secs 2024-04-26T15:55:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:41 smithi110 ceph-mon[28069]: pgmap v8325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:41 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14857.084826 secs 2024-04-26T15:55:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:41 smithi193 ceph-mon[32782]: pgmap v8325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:41 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14857.084826 secs 2024-04-26T15:55:44.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:43 smithi196 ceph-mon[32572]: pgmap v8326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:43 smithi110 ceph-mon[28069]: pgmap v8326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:43 smithi193 ceph-mon[32782]: pgmap v8326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:46.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:45 smithi196 ceph-mon[32572]: pgmap v8327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:45 smithi110 ceph-mon[28069]: pgmap v8327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:45 smithi193 ceph-mon[32782]: pgmap v8327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:47.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:46 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14862.084906 secs 2024-04-26T15:55:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:46 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14862.084906 secs 2024-04-26T15:55:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:46 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14862.084906 secs 2024-04-26T15:55:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:47 smithi196 ceph-mon[32572]: pgmap v8328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:47 smithi110 ceph-mon[28069]: pgmap v8328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:47 smithi193 ceph-mon[32782]: pgmap v8328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:48.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:55:48.815+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T15:55:48.815 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:55:48.815+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:55:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:55:48.816+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 117 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:55:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:55:48.816+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 117 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T15:55:50.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:49 smithi196 ceph-mon[32572]: pgmap v8329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:49 smithi110 ceph-mon[28069]: pgmap v8329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:49 smithi193 ceph-mon[32782]: pgmap v8329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:52.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:52 smithi196 ceph-mon[32572]: pgmap v8330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:52 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14867.085007 secs 2024-04-26T15:55:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:52 smithi110 ceph-mon[28069]: pgmap v8330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:52 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14867.085007 secs 2024-04-26T15:55:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:52 smithi193 ceph-mon[32782]: pgmap v8330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:52 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14867.085007 secs 2024-04-26T15:55:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:54 smithi110 ceph-mon[28069]: pgmap v8331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:54 smithi193 ceph-mon[32782]: pgmap v8331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:54.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:54 smithi196 ceph-mon[32572]: pgmap v8331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:55:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:56 smithi110 ceph-mon[28069]: pgmap v8332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:56 smithi193 ceph-mon[32782]: pgmap v8332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:56.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:56 smithi196 ceph-mon[32572]: pgmap v8332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:57.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:57 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14872.085075 secs 2024-04-26T15:55:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:57 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14872.085075 secs 2024-04-26T15:55:57.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:57 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14872.085075 secs 2024-04-26T15:55:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:58 smithi110 ceph-mon[28069]: pgmap v8333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:55:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:58 smithi193 ceph-mon[32782]: pgmap v8333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:55:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:58 smithi196 ceph-mon[32572]: pgmap v8333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:55:58.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:55:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:55:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:55:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:59 smithi110 ceph-mon[28069]: pgmap v8334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:55:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:59 smithi110 ceph-mon[28069]: pgmap v8335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:55:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:55:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:55:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:55:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:55:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:59 smithi193 ceph-mon[32782]: pgmap v8334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:55:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:59 smithi193 ceph-mon[32782]: pgmap v8335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:55:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:55:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:55:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:55:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:55:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:59 smithi196 ceph-mon[32572]: pgmap v8334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T15:55:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:59 smithi196 ceph-mon[32572]: pgmap v8335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:55:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:55:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:56:01.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:01 smithi196 ceph-mon[32572]: pgmap v8336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:56:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:01 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14877.085194 secs 2024-04-26T15:56:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:01 smithi110 ceph-mon[28069]: pgmap v8336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:56:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:01 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14877.085194 secs 2024-04-26T15:56:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:01 smithi193 ceph-mon[32782]: pgmap v8336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:56:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:01 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14877.085194 secs 2024-04-26T15:56:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:03 smithi196 ceph-mon[32572]: pgmap v8337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T15:56:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:03 smithi110 ceph-mon[28069]: pgmap v8337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T15:56:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:03 smithi193 ceph-mon[32782]: pgmap v8337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T15:56:05.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:05 smithi196 ceph-mon[32572]: pgmap v8338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:56:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:05 smithi110 ceph-mon[28069]: pgmap v8338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:56:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:05 smithi193 ceph-mon[32782]: pgmap v8338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:56:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:06 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14882.085308 secs 2024-04-26T15:56:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:06 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14882.085308 secs 2024-04-26T15:56:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:06 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14882.085308 secs 2024-04-26T15:56:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:07 smithi196 ceph-mon[32572]: pgmap v8339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:56:07.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:07 smithi110 ceph-mon[28069]: pgmap v8339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:56:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:07 smithi193 ceph-mon[32782]: pgmap v8339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:56:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:09 smithi196 ceph-mon[32572]: pgmap v8340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:56:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:09 smithi110 ceph-mon[28069]: pgmap v8340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:56:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:09 smithi193 ceph-mon[32782]: pgmap v8340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:56:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:11 smithi196 ceph-mon[32572]: pgmap v8341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:11 smithi196 ceph-mon[32572]: 16 slow requests, 1 included below; oldest blocked for > 14887.085423 secs 2024-04-26T15:56:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:11 smithi196 ceph-mon[32572]: slow request 724.196310 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:56:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:11 smithi110 ceph-mon[28069]: pgmap v8341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:11 smithi110 ceph-mon[28069]: 16 slow requests, 1 included below; oldest blocked for > 14887.085423 secs 2024-04-26T15:56:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:11 smithi110 ceph-mon[28069]: slow request 724.196310 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:56:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:11 smithi193 ceph-mon[32782]: pgmap v8341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:11 smithi193 ceph-mon[32782]: 16 slow requests, 1 included below; oldest blocked for > 14887.085423 secs 2024-04-26T15:56:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:11 smithi193 ceph-mon[32782]: slow request 724.196310 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T15:56:13.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:13 smithi196 ceph-mon[32572]: pgmap v8342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:13.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:13 smithi110 ceph-mon[28069]: pgmap v8342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:13 smithi193 ceph-mon[32782]: pgmap v8342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:15.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:15 smithi196 ceph-mon[32572]: pgmap v8343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:15 smithi110 ceph-mon[28069]: pgmap v8343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:15 smithi193 ceph-mon[32782]: pgmap v8343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:16.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:16 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14892.085589 secs 2024-04-26T15:56:16.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:16 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14892.085589 secs 2024-04-26T15:56:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:16 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14892.085589 secs 2024-04-26T15:56:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:17 smithi196 ceph-mon[32572]: pgmap v8344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:17 smithi110 ceph-mon[28069]: pgmap v8344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:17 smithi193 ceph-mon[32782]: pgmap v8344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:19.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:19 smithi196 ceph-mon[32572]: pgmap v8345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:19 smithi110 ceph-mon[28069]: pgmap v8345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:19 smithi193 ceph-mon[32782]: pgmap v8345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:21 smithi110 ceph-mon[28069]: pgmap v8346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:21 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14897.085666 secs 2024-04-26T15:56:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:21 smithi193 ceph-mon[32782]: pgmap v8346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:21 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14897.085666 secs 2024-04-26T15:56:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:21 smithi196 ceph-mon[32572]: pgmap v8346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:21 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14897.085666 secs 2024-04-26T15:56:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:23 smithi110 ceph-mon[28069]: pgmap v8347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:23 smithi193 ceph-mon[32782]: pgmap v8347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:24.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:23 smithi196 ceph-mon[32572]: pgmap v8347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:25 smithi110 ceph-mon[28069]: pgmap v8348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:25 smithi193 ceph-mon[32782]: pgmap v8348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:25 smithi196 ceph-mon[32572]: pgmap v8348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:26.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:26 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14902.085787 secs 2024-04-26T15:56:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:26 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14902.085787 secs 2024-04-26T15:56:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:26 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14902.085787 secs 2024-04-26T15:56:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:27 smithi110 ceph-mon[28069]: pgmap v8349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:27 smithi193 ceph-mon[32782]: pgmap v8349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:27 smithi196 ceph-mon[32572]: pgmap v8349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:29 smithi110 ceph-mon[28069]: pgmap v8350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:29 smithi193 ceph-mon[32782]: pgmap v8350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:30.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:29 smithi196 ceph-mon[32572]: pgmap v8350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:31 smithi193 ceph-mon[32782]: pgmap v8351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:31 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14907.085898 secs 2024-04-26T15:56:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:31 smithi196 ceph-mon[32572]: pgmap v8351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:31 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14907.085898 secs 2024-04-26T15:56:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:31 smithi110 ceph-mon[28069]: pgmap v8351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:31 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14907.085898 secs 2024-04-26T15:56:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:33 smithi193 ceph-mon[32782]: pgmap v8352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:34.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:33 smithi196 ceph-mon[32572]: pgmap v8352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:33 smithi110 ceph-mon[28069]: pgmap v8352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:35 smithi193 ceph-mon[32782]: pgmap v8353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:36.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:35 smithi196 ceph-mon[32572]: pgmap v8353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:35 smithi110 ceph-mon[28069]: pgmap v8353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:36 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14912.086019 secs 2024-04-26T15:56:36.904 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:36 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14912.086019 secs 2024-04-26T15:56:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:36 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14912.086019 secs 2024-04-26T15:56:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:37 smithi193 ceph-mon[32782]: pgmap v8354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:38.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:37 smithi196 ceph-mon[32572]: pgmap v8354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:37 smithi110 ceph-mon[28069]: pgmap v8354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:39 smithi193 ceph-mon[32782]: pgmap v8355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:40.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:39 smithi196 ceph-mon[32572]: pgmap v8355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:39 smithi110 ceph-mon[28069]: pgmap v8355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:41 smithi193 ceph-mon[32782]: pgmap v8356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:41 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14917.086144 secs 2024-04-26T15:56:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:41 smithi196 ceph-mon[32572]: pgmap v8356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:41 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14917.086144 secs 2024-04-26T15:56:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:41 smithi110 ceph-mon[28069]: pgmap v8356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:41 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14917.086144 secs 2024-04-26T15:56:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:43 smithi193 ceph-mon[32782]: pgmap v8357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:43 smithi196 ceph-mon[32572]: pgmap v8357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:43 smithi110 ceph-mon[28069]: pgmap v8357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:45 smithi193 ceph-mon[32782]: pgmap v8358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:45 smithi196 ceph-mon[32572]: pgmap v8358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:45 smithi110 ceph-mon[28069]: pgmap v8358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:46 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14922.086278 secs 2024-04-26T15:56:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:46 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14922.086278 secs 2024-04-26T15:56:47.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:46 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14922.086278 secs 2024-04-26T15:56:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:47 smithi193 ceph-mon[32782]: pgmap v8359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:47 smithi196 ceph-mon[32572]: pgmap v8359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:47 smithi110 ceph-mon[28069]: pgmap v8359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:49 smithi193 ceph-mon[32782]: pgmap v8360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:50.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:49 smithi196 ceph-mon[32572]: pgmap v8360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:49 smithi110 ceph-mon[28069]: pgmap v8360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:51 smithi193 ceph-mon[32782]: pgmap v8361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:51 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14927.086390 secs 2024-04-26T15:56:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:51 smithi196 ceph-mon[32572]: pgmap v8361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:51 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14927.086390 secs 2024-04-26T15:56:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:51 smithi110 ceph-mon[28069]: pgmap v8361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:51 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14927.086390 secs 2024-04-26T15:56:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:53 smithi193 ceph-mon[32782]: pgmap v8362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:53 smithi196 ceph-mon[32572]: pgmap v8362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:53 smithi110 ceph-mon[28069]: pgmap v8362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:56:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:55 smithi193 ceph-mon[32782]: pgmap v8363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:55 smithi196 ceph-mon[32572]: pgmap v8363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:55 smithi110 ceph-mon[28069]: pgmap v8363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:56:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:56 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14932.086509 secs 2024-04-26T15:56:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:56 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14932.086509 secs 2024-04-26T15:56:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:56 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14932.086509 secs 2024-04-26T15:56:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:57 smithi196 ceph-mon[32572]: pgmap v8364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:57 smithi110 ceph-mon[28069]: pgmap v8364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:56:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:57 smithi193 ceph-mon[32782]: pgmap v8364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:00.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:59 smithi196 ceph-mon[32572]: pgmap v8365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:56:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:57:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:59 smithi110 ceph-mon[28069]: pgmap v8365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:56:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:57:00.052 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:59 smithi193 ceph-mon[32782]: pgmap v8365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:00.052 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:56:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:57:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:01 smithi196 ceph-mon[32572]: pgmap v8366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:01 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14937.086652 secs 2024-04-26T15:57:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:01 smithi193 ceph-mon[32782]: pgmap v8366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:01 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14937.086652 secs 2024-04-26T15:57:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:01 smithi110 ceph-mon[28069]: pgmap v8366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:01 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14937.086652 secs 2024-04-26T15:57:03.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:03 smithi196 ceph-mon[32572]: pgmap v8367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:57:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:57:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:03 smithi193 ceph-mon[32782]: pgmap v8367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:03 smithi110 ceph-mon[28069]: pgmap v8367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:57:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:57:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:57:05.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:04 smithi196 ceph-mon[32572]: pgmap v8368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 957 B/s rd, 2 op/s 2024-04-26T15:57:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:04 smithi196 ceph-mon[32572]: pgmap v8369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:57:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:04 smithi110 ceph-mon[28069]: pgmap v8368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 957 B/s rd, 2 op/s 2024-04-26T15:57:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:04 smithi110 ceph-mon[28069]: pgmap v8369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:57:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:04 smithi193 ceph-mon[32782]: pgmap v8368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 957 B/s rd, 2 op/s 2024-04-26T15:57:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:04 smithi193 ceph-mon[32782]: pgmap v8369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:57:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:06 smithi196 ceph-mon[32572]: pgmap v8370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:57:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:06 smithi196 ceph-mon[32572]: 16 slow requests, 0 included below; oldest blocked for > 14942.086781 secs 2024-04-26T15:57:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:06 smithi110 ceph-mon[28069]: pgmap v8370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:57:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:06 smithi110 ceph-mon[28069]: 16 slow requests, 0 included below; oldest blocked for > 14942.086781 secs 2024-04-26T15:57:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:06 smithi193 ceph-mon[32782]: pgmap v8370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:57:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:06 smithi193 ceph-mon[32782]: 16 slow requests, 0 included below; oldest blocked for > 14942.086781 secs 2024-04-26T15:57:09.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:08 smithi196 ceph-mon[32572]: pgmap v8371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 588 B/s rd, 1 op/s 2024-04-26T15:57:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:08 smithi110 ceph-mon[28069]: pgmap v8371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 588 B/s rd, 1 op/s 2024-04-26T15:57:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:08 smithi193 ceph-mon[32782]: pgmap v8371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 588 B/s rd, 1 op/s 2024-04-26T15:57:11.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:10 smithi196 ceph-mon[32572]: pgmap v8372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:57:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:10 smithi110 ceph-mon[28069]: pgmap v8372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:57:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:10 smithi193 ceph-mon[32782]: pgmap v8372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T15:57:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:11 smithi196 ceph-mon[32572]: 17 slow requests, 1 included below; oldest blocked for > 14947.086846 secs 2024-04-26T15:57:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:11 smithi196 ceph-mon[32572]: slow request 183.879332 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:57:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:11 smithi110 ceph-mon[28069]: 17 slow requests, 1 included below; oldest blocked for > 14947.086846 secs 2024-04-26T15:57:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:11 smithi110 ceph-mon[28069]: slow request 183.879332 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:57:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:11 smithi193 ceph-mon[32782]: 17 slow requests, 1 included below; oldest blocked for > 14947.086846 secs 2024-04-26T15:57:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:11 smithi193 ceph-mon[32782]: slow request 183.879332 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T15:57:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:12 smithi196 ceph-mon[32572]: pgmap v8373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 588 B/s rd, 1 op/s 2024-04-26T15:57:13.006 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:12 smithi193 ceph-mon[32782]: pgmap v8373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 588 B/s rd, 1 op/s 2024-04-26T15:57:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:12 smithi110 ceph-mon[28069]: pgmap v8373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 588 B/s rd, 1 op/s 2024-04-26T15:57:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:13 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:57:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:13 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:57:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:13 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:57:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:13 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:57:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:13 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T15:57:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:13 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T15:57:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:14 smithi196 ceph-mon[32572]: pgmap v8374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:57:15.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:14 smithi110 ceph-mon[28069]: pgmap v8374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:57:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:14 smithi193 ceph-mon[32782]: pgmap v8374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:57:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:16 smithi196 ceph-mon[32572]: pgmap v8375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:16 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14952.086909 secs 2024-04-26T15:57:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:16 smithi110 ceph-mon[28069]: pgmap v8375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:16 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14952.086909 secs 2024-04-26T15:57:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:16 smithi193 ceph-mon[32782]: pgmap v8375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:16 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14952.086909 secs 2024-04-26T15:57:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:57:18.831+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T15:57:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:57:18.831+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T15:57:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:57:18.832+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 118 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T15:57:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T15:57:18.832+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 118 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T15:57:19.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:18 smithi196 ceph-mon[32572]: pgmap v8376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:18 smithi110 ceph-mon[28069]: pgmap v8376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:18 smithi193 ceph-mon[32782]: pgmap v8376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:20 smithi196 ceph-mon[32572]: pgmap v8377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:20 smithi110 ceph-mon[28069]: pgmap v8377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:20 smithi193 ceph-mon[32782]: pgmap v8377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14957.087054 secs 2024-04-26T15:57:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14957.087054 secs 2024-04-26T15:57:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14957.087054 secs 2024-04-26T15:57:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:22 smithi196 ceph-mon[32572]: pgmap v8378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:22 smithi110 ceph-mon[28069]: pgmap v8378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:22 smithi193 ceph-mon[32782]: pgmap v8378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:23 smithi110 ceph-mon[28069]: pgmap v8379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:23 smithi193 ceph-mon[32782]: pgmap v8379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:24.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:23 smithi196 ceph-mon[32572]: pgmap v8379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:26.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:26 smithi196 ceph-mon[32572]: pgmap v8380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:26 smithi110 ceph-mon[28069]: pgmap v8380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:26 smithi193 ceph-mon[32782]: pgmap v8380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:27.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:27 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14962.087187 secs 2024-04-26T15:57:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:27 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14962.087187 secs 2024-04-26T15:57:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:27 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14962.087187 secs 2024-04-26T15:57:28.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:28 smithi196 ceph-mon[32572]: pgmap v8381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:28 smithi110 ceph-mon[28069]: pgmap v8381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:28 smithi193 ceph-mon[32782]: pgmap v8381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:30.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:30 smithi196 ceph-mon[32572]: pgmap v8382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:30 smithi110 ceph-mon[28069]: pgmap v8382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:30 smithi193 ceph-mon[32782]: pgmap v8382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:32 smithi196 ceph-mon[32572]: pgmap v8383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:32 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14967.087307 secs 2024-04-26T15:57:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:32 smithi110 ceph-mon[28069]: pgmap v8383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:32 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14967.087307 secs 2024-04-26T15:57:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:32 smithi193 ceph-mon[32782]: pgmap v8383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:32 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14967.087307 secs 2024-04-26T15:57:34.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:34 smithi196 ceph-mon[32572]: pgmap v8384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:34 smithi110 ceph-mon[28069]: pgmap v8384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:34 smithi193 ceph-mon[32782]: pgmap v8384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:36.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:36 smithi196 ceph-mon[32572]: pgmap v8385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:36 smithi110 ceph-mon[28069]: pgmap v8385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:36 smithi193 ceph-mon[32782]: pgmap v8385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:37.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:37 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14972.087386 secs 2024-04-26T15:57:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:37 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14972.087386 secs 2024-04-26T15:57:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:37 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14972.087386 secs 2024-04-26T15:57:38.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:38 smithi196 ceph-mon[32572]: pgmap v8386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:38 smithi110 ceph-mon[28069]: pgmap v8386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:38 smithi193 ceph-mon[32782]: pgmap v8386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:40.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:40 smithi196 ceph-mon[32572]: pgmap v8387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:40 smithi110 ceph-mon[28069]: pgmap v8387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:40 smithi193 ceph-mon[32782]: pgmap v8387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:42 smithi196 ceph-mon[32572]: pgmap v8388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:42 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14977.087524 secs 2024-04-26T15:57:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:42 smithi110 ceph-mon[28069]: pgmap v8388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:42 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14977.087524 secs 2024-04-26T15:57:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:42 smithi193 ceph-mon[32782]: pgmap v8388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:42 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14977.087524 secs 2024-04-26T15:57:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:44 smithi196 ceph-mon[32572]: pgmap v8389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:44 smithi110 ceph-mon[28069]: pgmap v8389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:44 smithi193 ceph-mon[32782]: pgmap v8389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:46.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:46 smithi196 ceph-mon[32572]: pgmap v8390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:46 smithi110 ceph-mon[28069]: pgmap v8390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:46 smithi193 ceph-mon[32782]: pgmap v8390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:47.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:47 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14982.087634 secs 2024-04-26T15:57:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:47 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14982.087634 secs 2024-04-26T15:57:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:47 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14982.087634 secs 2024-04-26T15:57:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:48 smithi110 ceph-mon[28069]: pgmap v8391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:48 smithi193 ceph-mon[32782]: pgmap v8391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:48.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:48 smithi196 ceph-mon[32572]: pgmap v8391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:50 smithi110 ceph-mon[28069]: pgmap v8392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:50 smithi193 ceph-mon[32782]: pgmap v8392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:50.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:50 smithi196 ceph-mon[32572]: pgmap v8392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:52 smithi110 ceph-mon[28069]: pgmap v8393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:52 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14987.087748 secs 2024-04-26T15:57:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:52 smithi193 ceph-mon[32782]: pgmap v8393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:52 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14987.087748 secs 2024-04-26T15:57:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:52 smithi196 ceph-mon[32572]: pgmap v8393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:52 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14987.087748 secs 2024-04-26T15:57:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:54 smithi110 ceph-mon[28069]: pgmap v8394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:54 smithi193 ceph-mon[32782]: pgmap v8394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:54 smithi196 ceph-mon[32572]: pgmap v8394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:57:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:56 smithi110 ceph-mon[28069]: pgmap v8395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:56 smithi193 ceph-mon[32782]: pgmap v8395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:56.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:56 smithi196 ceph-mon[32572]: pgmap v8395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:57 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14992.087869 secs 2024-04-26T15:57:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:57 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14992.087869 secs 2024-04-26T15:57:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:57 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14992.087869 secs 2024-04-26T15:57:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:57:58 smithi110 ceph-mon[28069]: pgmap v8396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:57:58 smithi193 ceph-mon[32782]: pgmap v8396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:57:58.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:57:58 smithi196 ceph-mon[32572]: pgmap v8396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:00 smithi193 ceph-mon[32782]: pgmap v8397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:00.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:00 smithi196 ceph-mon[32572]: pgmap v8397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:00 smithi110 ceph-mon[28069]: pgmap v8397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:02 smithi193 ceph-mon[32782]: pgmap v8398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:02 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 14997.087985 secs 2024-04-26T15:58:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:02 smithi196 ceph-mon[32572]: pgmap v8398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:02 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 14997.087985 secs 2024-04-26T15:58:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:02 smithi110 ceph-mon[28069]: pgmap v8398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:02 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 14997.087985 secs 2024-04-26T15:58:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:04 smithi193 ceph-mon[32782]: pgmap v8399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:58:04.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:04 smithi196 ceph-mon[32572]: pgmap v8399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:04.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:58:04.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:04 smithi110 ceph-mon[28069]: pgmap v8399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:04.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:58:05.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:58:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:58:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:05 smithi196 ceph-mon[32572]: pgmap v8400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:58:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:05 smithi196 ceph-mon[32572]: pgmap v8401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:58:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:58:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:58:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:05 smithi110 ceph-mon[28069]: pgmap v8400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:58:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:05 smithi110 ceph-mon[28069]: pgmap v8401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:58:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:58:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:58:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:05 smithi193 ceph-mon[32782]: pgmap v8400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T15:58:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:05 smithi193 ceph-mon[32782]: pgmap v8401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:58:06.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:06 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15002.088114 secs 2024-04-26T15:58:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:06 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15002.088114 secs 2024-04-26T15:58:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:06 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15002.088114 secs 2024-04-26T15:58:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:07 smithi196 ceph-mon[32572]: pgmap v8402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:07.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:07 smithi110 ceph-mon[28069]: pgmap v8402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:07 smithi193 ceph-mon[32782]: pgmap v8402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:09 smithi196 ceph-mon[32572]: pgmap v8403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:09 smithi110 ceph-mon[28069]: pgmap v8403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:09 smithi193 ceph-mon[32782]: pgmap v8403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:10 smithi110 ceph-mon[28069]: pgmap v8404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:10 smithi193 ceph-mon[32782]: pgmap v8404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:10 smithi196 ceph-mon[32572]: pgmap v8404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:11 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15007.088182 secs 2024-04-26T15:58:12.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:11 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15007.088182 secs 2024-04-26T15:58:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:11 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15007.088182 secs 2024-04-26T15:58:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:12 smithi193 ceph-mon[32782]: pgmap v8405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:13.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:12 smithi196 ceph-mon[32572]: pgmap v8405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:12 smithi110 ceph-mon[28069]: pgmap v8405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T15:58:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:15 smithi196 ceph-mon[32572]: pgmap v8406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:58:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:15 smithi110 ceph-mon[28069]: pgmap v8406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:58:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:15 smithi193 ceph-mon[32782]: pgmap v8406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T15:58:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:16 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15012.088298 secs 2024-04-26T15:58:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:16 smithi196 ceph-mon[32572]: pgmap v8407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:16 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15012.088298 secs 2024-04-26T15:58:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:16 smithi110 ceph-mon[28069]: pgmap v8407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:16 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15012.088298 secs 2024-04-26T15:58:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:16 smithi193 ceph-mon[32782]: pgmap v8407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:20.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:19 smithi196 ceph-mon[32572]: pgmap v8408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:19 smithi110 ceph-mon[28069]: pgmap v8408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:19 smithi193 ceph-mon[32782]: pgmap v8408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:20 smithi196 ceph-mon[32572]: pgmap v8409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:20 smithi110 ceph-mon[28069]: pgmap v8409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:20 smithi193 ceph-mon[32782]: pgmap v8409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15017.088432 secs 2024-04-26T15:58:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15017.088432 secs 2024-04-26T15:58:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15017.088432 secs 2024-04-26T15:58:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:22 smithi110 ceph-mon[28069]: pgmap v8410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:22 smithi193 ceph-mon[32782]: pgmap v8410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:23.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:22 smithi196 ceph-mon[32572]: pgmap v8410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:24 smithi193 ceph-mon[32782]: pgmap v8411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:25.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:24 smithi196 ceph-mon[32572]: pgmap v8411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:24 smithi110 ceph-mon[28069]: pgmap v8411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:26 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15022.088528 secs 2024-04-26T15:58:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:26 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15022.088528 secs 2024-04-26T15:58:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:26 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15022.088528 secs 2024-04-26T15:58:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:27 smithi110 ceph-mon[28069]: pgmap v8412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:27 smithi193 ceph-mon[32782]: pgmap v8412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:27 smithi196 ceph-mon[32572]: pgmap v8412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:28 smithi193 ceph-mon[32782]: pgmap v8413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:29.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:28 smithi196 ceph-mon[32572]: pgmap v8413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:28 smithi110 ceph-mon[28069]: pgmap v8413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:30 smithi193 ceph-mon[32782]: pgmap v8414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:31.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:30 smithi196 ceph-mon[32572]: pgmap v8414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:30 smithi110 ceph-mon[28069]: pgmap v8414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:31 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15027.088653 secs 2024-04-26T15:58:32.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:31 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15027.088653 secs 2024-04-26T15:58:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:31 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15027.088653 secs 2024-04-26T15:58:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:32 smithi193 ceph-mon[32782]: pgmap v8415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:33.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:32 smithi196 ceph-mon[32572]: pgmap v8415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:32 smithi110 ceph-mon[28069]: pgmap v8415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:34 smithi193 ceph-mon[32782]: pgmap v8416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:35.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:34 smithi196 ceph-mon[32572]: pgmap v8416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:34 smithi110 ceph-mon[28069]: pgmap v8416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:36 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15032.088762 secs 2024-04-26T15:58:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:36 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15032.088762 secs 2024-04-26T15:58:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:36 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15032.088762 secs 2024-04-26T15:58:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:37 smithi110 ceph-mon[28069]: pgmap v8417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:37 smithi193 ceph-mon[32782]: pgmap v8417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:37 smithi196 ceph-mon[32572]: pgmap v8417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:38 smithi193 ceph-mon[32782]: pgmap v8418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:39.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:38 smithi196 ceph-mon[32572]: pgmap v8418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:38 smithi110 ceph-mon[28069]: pgmap v8418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:40 smithi193 ceph-mon[32782]: pgmap v8419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:41.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:40 smithi196 ceph-mon[32572]: pgmap v8419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:40 smithi110 ceph-mon[28069]: pgmap v8419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:41 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15037.088883 secs 2024-04-26T15:58:42.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:41 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15037.088883 secs 2024-04-26T15:58:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:41 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15037.088883 secs 2024-04-26T15:58:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:42 smithi193 ceph-mon[32782]: pgmap v8420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:43.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:42 smithi196 ceph-mon[32572]: pgmap v8420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:42 smithi110 ceph-mon[28069]: pgmap v8420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:44 smithi193 ceph-mon[32782]: pgmap v8421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:45.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:44 smithi196 ceph-mon[32572]: pgmap v8421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:44 smithi110 ceph-mon[28069]: pgmap v8421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:46 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15042.088959 secs 2024-04-26T15:58:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:46 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15042.088959 secs 2024-04-26T15:58:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:46 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15042.088959 secs 2024-04-26T15:58:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:47 smithi110 ceph-mon[28069]: pgmap v8422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:47 smithi193 ceph-mon[32782]: pgmap v8422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:47 smithi196 ceph-mon[32572]: pgmap v8422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:48 smithi193 ceph-mon[32782]: pgmap v8423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:48 smithi196 ceph-mon[32572]: pgmap v8423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:48 smithi110 ceph-mon[28069]: pgmap v8423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:50 smithi193 ceph-mon[32782]: pgmap v8424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:51.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:50 smithi196 ceph-mon[32572]: pgmap v8424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:51.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:50 smithi110 ceph-mon[28069]: pgmap v8424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:51 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15047.089094 secs 2024-04-26T15:58:52.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:51 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15047.089094 secs 2024-04-26T15:58:52.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:51 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15047.089094 secs 2024-04-26T15:58:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:52 smithi193 ceph-mon[32782]: pgmap v8425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:53.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:52 smithi196 ceph-mon[32572]: pgmap v8425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:52 smithi110 ceph-mon[28069]: pgmap v8425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:54 smithi193 ceph-mon[32782]: pgmap v8426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:54 smithi196 ceph-mon[32572]: pgmap v8426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:54 smithi110 ceph-mon[28069]: pgmap v8426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:56 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15052.089226 secs 2024-04-26T15:58:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:56 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15052.089226 secs 2024-04-26T15:58:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:56 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15052.089226 secs 2024-04-26T15:58:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:57 smithi110 ceph-mon[28069]: pgmap v8427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:57 smithi193 ceph-mon[32782]: pgmap v8427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:57 smithi196 ceph-mon[32572]: pgmap v8427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:58:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:58:58 smithi193 ceph-mon[32782]: pgmap v8428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:58:58 smithi196 ceph-mon[32572]: pgmap v8428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:58:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:58:58 smithi110 ceph-mon[28069]: pgmap v8428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:00 smithi193 ceph-mon[32782]: pgmap v8429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:00 smithi196 ceph-mon[32572]: pgmap v8429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:00 smithi110 ceph-mon[28069]: pgmap v8429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:01 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15057.089369 secs 2024-04-26T15:59:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:01 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15057.089369 secs 2024-04-26T15:59:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:01 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15057.089369 secs 2024-04-26T15:59:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:02 smithi193 ceph-mon[32782]: pgmap v8430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:02 smithi196 ceph-mon[32572]: pgmap v8430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:02 smithi110 ceph-mon[28069]: pgmap v8430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:04 smithi193 ceph-mon[32782]: pgmap v8431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:05.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:04 smithi196 ceph-mon[32572]: pgmap v8431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:04 smithi110 ceph-mon[28069]: pgmap v8431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:59:06.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:59:06.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T15:59:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:06 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15062.089464 secs 2024-04-26T15:59:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:06 smithi193 ceph-mon[32782]: pgmap v8432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:07.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:07.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:07.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:06 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15062.089464 secs 2024-04-26T15:59:07.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:06 smithi196 ceph-mon[32572]: pgmap v8432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:06 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15062.089464 secs 2024-04-26T15:59:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:06 smithi110 ceph-mon[28069]: pgmap v8432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:08.040 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:59:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:59:07.589+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:59:08.040 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:59:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:59:07.589+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:59:08.040 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:59:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:59:07.589+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:59:08.040 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:59:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:59:07.589+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:59:08.040 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 15:59:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T15:59:07.589+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T15:59:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:08 smithi193 ceph-mon[32782]: pgmap v8433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:09.148 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:08 smithi110 ceph-mon[28069]: pgmap v8433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:08 smithi196 ceph-mon[32572]: pgmap v8433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:10 smithi193 ceph-mon[32782]: pgmap v8434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:11.247 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:10 smithi110 ceph-mon[28069]: pgmap v8434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:11.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:10 smithi196 ceph-mon[32572]: pgmap v8434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:11.804 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:11 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15067.089603 secs 2024-04-26T15:59:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:11 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15067.089603 secs 2024-04-26T15:59:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:11 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15067.089603 secs 2024-04-26T15:59:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:59:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:59:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:13 smithi196 ceph-mon[32572]: pgmap v8435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 87 B/s wr, 2 op/s 2024-04-26T15:59:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:13 smithi196 ceph-mon[32572]: pgmap v8436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 105 B/s wr, 1 op/s 2024-04-26T15:59:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:59:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:59:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:13 smithi110 ceph-mon[28069]: pgmap v8435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 87 B/s wr, 2 op/s 2024-04-26T15:59:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:13 smithi110 ceph-mon[28069]: pgmap v8436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 105 B/s wr, 1 op/s 2024-04-26T15:59:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T15:59:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T15:59:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:13 smithi193 ceph-mon[32782]: pgmap v8435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 87 B/s wr, 2 op/s 2024-04-26T15:59:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:13 smithi193 ceph-mon[32782]: pgmap v8436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 105 B/s wr, 1 op/s 2024-04-26T15:59:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T15:59:15.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:15 smithi196 ceph-mon[32572]: pgmap v8437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:15 smithi110 ceph-mon[28069]: pgmap v8437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:15 smithi193 ceph-mon[32782]: pgmap v8437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:16 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15072.089752 secs 2024-04-26T15:59:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:16 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15072.089752 secs 2024-04-26T15:59:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:16 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15072.089752 secs 2024-04-26T15:59:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:17 smithi110 ceph-mon[28069]: pgmap v8438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:17 smithi193 ceph-mon[32782]: pgmap v8438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:17 smithi196 ceph-mon[32572]: pgmap v8438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:19 smithi110 ceph-mon[28069]: pgmap v8439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:19 smithi193 ceph-mon[32782]: pgmap v8439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:20.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:19 smithi196 ceph-mon[32572]: pgmap v8439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:21 smithi110 ceph-mon[28069]: pgmap v8440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15077.089874 secs 2024-04-26T15:59:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:21 smithi193 ceph-mon[32782]: pgmap v8440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15077.089874 secs 2024-04-26T15:59:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:21 smithi196 ceph-mon[32572]: pgmap v8440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 316 B/s wr, 2 op/s 2024-04-26T15:59:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15077.089874 secs 2024-04-26T15:59:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:23 smithi110 ceph-mon[28069]: pgmap v8441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T15:59:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:23 smithi193 ceph-mon[32782]: pgmap v8441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T15:59:24.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:23 smithi196 ceph-mon[32572]: pgmap v8441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T15:59:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:25 smithi110 ceph-mon[28069]: pgmap v8442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:59:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:25 smithi193 ceph-mon[32782]: pgmap v8442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:59:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:25 smithi196 ceph-mon[32572]: pgmap v8442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T15:59:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:26 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15082.089987 secs 2024-04-26T15:59:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:26 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15082.089987 secs 2024-04-26T15:59:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:26 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15082.089987 secs 2024-04-26T15:59:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:27 smithi193 ceph-mon[32782]: pgmap v8443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:27 smithi196 ceph-mon[32572]: pgmap v8443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:27 smithi110 ceph-mon[28069]: pgmap v8443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:29 smithi193 ceph-mon[32782]: pgmap v8444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:29 smithi196 ceph-mon[32572]: pgmap v8444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:29 smithi110 ceph-mon[28069]: pgmap v8444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:31 smithi193 ceph-mon[32782]: pgmap v8445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:31 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15087.090084 secs 2024-04-26T15:59:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:31 smithi196 ceph-mon[32572]: pgmap v8445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:31 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15087.090084 secs 2024-04-26T15:59:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:31 smithi110 ceph-mon[28069]: pgmap v8445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:31 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15087.090084 secs 2024-04-26T15:59:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:33 smithi193 ceph-mon[32782]: pgmap v8446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:33 smithi196 ceph-mon[32572]: pgmap v8446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:33 smithi110 ceph-mon[28069]: pgmap v8446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:35 smithi193 ceph-mon[32782]: pgmap v8447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:59:36.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:35 smithi196 ceph-mon[32572]: pgmap v8447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:59:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:35 smithi110 ceph-mon[28069]: pgmap v8447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:59:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:36 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15092.090204 secs 2024-04-26T15:59:37.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:36 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15092.090204 secs 2024-04-26T15:59:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:36 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15092.090204 secs 2024-04-26T15:59:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:37 smithi193 ceph-mon[32782]: pgmap v8448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:37.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:37 smithi196 ceph-mon[32572]: pgmap v8448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:37 smithi110 ceph-mon[28069]: pgmap v8448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:39 smithi193 ceph-mon[32782]: pgmap v8449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:40.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:39 smithi196 ceph-mon[32572]: pgmap v8449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:39 smithi110 ceph-mon[28069]: pgmap v8449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:41 smithi193 ceph-mon[32782]: pgmap v8450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:41 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15097.090344 secs 2024-04-26T15:59:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:41 smithi196 ceph-mon[32572]: pgmap v8450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:41 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15097.090344 secs 2024-04-26T15:59:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:41 smithi110 ceph-mon[28069]: pgmap v8450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:41 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15097.090344 secs 2024-04-26T15:59:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:43 smithi193 ceph-mon[32782]: pgmap v8451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:44.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:43 smithi196 ceph-mon[32572]: pgmap v8451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:43 smithi110 ceph-mon[28069]: pgmap v8451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:45 smithi193 ceph-mon[32782]: pgmap v8452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:59:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:45 smithi196 ceph-mon[32572]: pgmap v8452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:59:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:45 smithi110 ceph-mon[28069]: pgmap v8452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:59:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:46 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15102.090482 secs 2024-04-26T15:59:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:46 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15102.090482 secs 2024-04-26T15:59:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:46 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15102.090482 secs 2024-04-26T15:59:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:47 smithi193 ceph-mon[32782]: pgmap v8453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:47 smithi196 ceph-mon[32572]: pgmap v8453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:47 smithi110 ceph-mon[28069]: pgmap v8453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:49 smithi193 ceph-mon[32782]: pgmap v8454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:50.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:49 smithi196 ceph-mon[32572]: pgmap v8454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:49 smithi110 ceph-mon[28069]: pgmap v8454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:51 smithi196 ceph-mon[32572]: pgmap v8455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:51 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15107.090634 secs 2024-04-26T15:59:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:51 smithi110 ceph-mon[28069]: pgmap v8455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:51 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15107.090634 secs 2024-04-26T15:59:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:51 smithi193 ceph-mon[32782]: pgmap v8455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:51 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15107.090634 secs 2024-04-26T15:59:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:53 smithi196 ceph-mon[32572]: pgmap v8456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:53 smithi110 ceph-mon[28069]: pgmap v8456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:53 smithi193 ceph-mon[32782]: pgmap v8456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T15:59:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:55 smithi196 ceph-mon[32572]: pgmap v8457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:59:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:55 smithi110 ceph-mon[28069]: pgmap v8457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:59:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:55 smithi193 ceph-mon[32782]: pgmap v8457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T15:59:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:56 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15112.090744 secs 2024-04-26T15:59:57.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:56 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15112.090744 secs 2024-04-26T15:59:57.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:56 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15112.090744 secs 2024-04-26T15:59:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:57 smithi196 ceph-mon[32572]: pgmap v8458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:57 smithi110 ceph-mon[28069]: pgmap v8458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T15:59:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:57 smithi193 ceph-mon[32782]: pgmap v8458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 15:59:59 smithi196 ceph-mon[32572]: pgmap v8459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 15:59:59 smithi110 ceph-mon[28069]: pgmap v8459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 15:59:59 smithi193 ceph-mon[32782]: pgmap v8459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:00:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:00:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:00:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:01 smithi196 ceph-mon[32572]: pgmap v8460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:01 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15117.090812 secs 2024-04-26T16:00:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:01 smithi110 ceph-mon[28069]: pgmap v8460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:01 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15117.090812 secs 2024-04-26T16:00:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:01 smithi193 ceph-mon[32782]: pgmap v8460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:01 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15117.090812 secs 2024-04-26T16:00:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:03 smithi196 ceph-mon[32572]: pgmap v8461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:03 smithi110 ceph-mon[28069]: pgmap v8461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:03 smithi193 ceph-mon[32782]: pgmap v8461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:05 smithi196 ceph-mon[32572]: pgmap v8462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:00:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:05 smithi110 ceph-mon[28069]: pgmap v8462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:00:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:05 smithi193 ceph-mon[32782]: pgmap v8462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:00:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:06 smithi196 ceph-mon[32572]: 17 slow requests, 1 included below; oldest blocked for > 15122.090909 secs 2024-04-26T16:00:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:06 smithi196 ceph-mon[32572]: slow request 5761.584395 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:00:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:06 smithi110 ceph-mon[28069]: 17 slow requests, 1 included below; oldest blocked for > 15122.090909 secs 2024-04-26T16:00:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:06 smithi110 ceph-mon[28069]: slow request 5761.584395 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:00:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:06 smithi193 ceph-mon[32782]: 17 slow requests, 1 included below; oldest blocked for > 15122.090909 secs 2024-04-26T16:00:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:06 smithi193 ceph-mon[32782]: slow request 5761.584395 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:00:08.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:07 smithi196 ceph-mon[32572]: pgmap v8463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:07 smithi110 ceph-mon[28069]: pgmap v8463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:07 smithi193 ceph-mon[32782]: pgmap v8463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:09 smithi196 ceph-mon[32572]: pgmap v8464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:09 smithi110 ceph-mon[28069]: pgmap v8464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:09 smithi193 ceph-mon[32782]: pgmap v8464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:11 smithi196 ceph-mon[32572]: pgmap v8465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:11 smithi196 ceph-mon[32572]: 17 slow requests, 1 included below; oldest blocked for > 15127.091049 secs 2024-04-26T16:00:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:11 smithi196 ceph-mon[32572]: slow request 363.883534 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:00:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:11 smithi110 ceph-mon[28069]: pgmap v8465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:11 smithi110 ceph-mon[28069]: 17 slow requests, 1 included below; oldest blocked for > 15127.091049 secs 2024-04-26T16:00:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:11 smithi110 ceph-mon[28069]: slow request 363.883534 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:00:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:11 smithi193 ceph-mon[32782]: pgmap v8465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:11 smithi193 ceph-mon[32782]: 17 slow requests, 1 included below; oldest blocked for > 15127.091049 secs 2024-04-26T16:00:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:11 smithi193 ceph-mon[32782]: slow request 363.883534 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:00:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:00:13.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:00:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:00:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:13 smithi196 ceph-mon[32572]: pgmap v8466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:13 smithi110 ceph-mon[28069]: pgmap v8466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:13 smithi193 ceph-mon[32782]: pgmap v8466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:00:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:00:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:00:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:00:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:00:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:00:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:00:16.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:15 smithi196 ceph-mon[32572]: pgmap v8467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 2 op/s 2024-04-26T16:00:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:15 smithi196 ceph-mon[32572]: pgmap v8468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:15 smithi110 ceph-mon[28069]: pgmap v8467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 2 op/s 2024-04-26T16:00:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:15 smithi110 ceph-mon[28069]: pgmap v8468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:15 smithi193 ceph-mon[32782]: pgmap v8467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 2 op/s 2024-04-26T16:00:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:15 smithi193 ceph-mon[32782]: pgmap v8468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:16 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15132.091161 secs 2024-04-26T16:00:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:16 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15132.091161 secs 2024-04-26T16:00:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:16 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15132.091161 secs 2024-04-26T16:00:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:17 smithi196 ceph-mon[32572]: pgmap v8469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:17 smithi110 ceph-mon[28069]: pgmap v8469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:17 smithi193 ceph-mon[32782]: pgmap v8469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:00:18.860+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:00:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:00:18.860+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T16:00:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:00:18.861+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 119 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T16:00:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:00:18.861+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 119 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:00:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:19 smithi196 ceph-mon[32572]: pgmap v8470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:19 smithi110 ceph-mon[28069]: pgmap v8470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:19 smithi193 ceph-mon[32782]: pgmap v8470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:21 smithi196 ceph-mon[32572]: pgmap v8471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15137.091234 secs 2024-04-26T16:00:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:21 smithi110 ceph-mon[28069]: pgmap v8471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15137.091234 secs 2024-04-26T16:00:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:21 smithi193 ceph-mon[32782]: pgmap v8471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:00:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15137.091234 secs 2024-04-26T16:00:24.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:23 smithi196 ceph-mon[32572]: pgmap v8472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T16:00:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:23 smithi110 ceph-mon[28069]: pgmap v8472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T16:00:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:23 smithi193 ceph-mon[32782]: pgmap v8472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T16:00:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:25 smithi196 ceph-mon[32572]: pgmap v8473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:00:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:25 smithi110 ceph-mon[28069]: pgmap v8473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:00:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:25 smithi193 ceph-mon[32782]: pgmap v8473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:00:27.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:26 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15142.091349 secs 2024-04-26T16:00:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:26 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15142.091349 secs 2024-04-26T16:00:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:26 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15142.091349 secs 2024-04-26T16:00:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:27 smithi110 ceph-mon[28069]: pgmap v8474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:27 smithi193 ceph-mon[32782]: pgmap v8474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:27 smithi196 ceph-mon[32572]: pgmap v8474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:28 smithi193 ceph-mon[32782]: pgmap v8475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:29.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:28 smithi196 ceph-mon[32572]: pgmap v8475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:28 smithi110 ceph-mon[28069]: pgmap v8475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:31.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:31 smithi196 ceph-mon[32572]: pgmap v8476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:31 smithi110 ceph-mon[28069]: pgmap v8476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:31 smithi193 ceph-mon[32782]: pgmap v8476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:32 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15147.091475 secs 2024-04-26T16:00:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:32 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15147.091475 secs 2024-04-26T16:00:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:32 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15147.091475 secs 2024-04-26T16:00:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:33 smithi196 ceph-mon[32572]: pgmap v8477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:33.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:33 smithi110 ceph-mon[28069]: pgmap v8477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:33.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:33 smithi193 ceph-mon[32782]: pgmap v8477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:35.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:35 smithi196 ceph-mon[32572]: pgmap v8478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:35 smithi110 ceph-mon[28069]: pgmap v8478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:35.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:35 smithi193 ceph-mon[32782]: pgmap v8478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:37 smithi196 ceph-mon[32572]: pgmap v8479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:37 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15152.091622 secs 2024-04-26T16:00:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:37 smithi110 ceph-mon[28069]: pgmap v8479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:37 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15152.091622 secs 2024-04-26T16:00:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:37 smithi193 ceph-mon[32782]: pgmap v8479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:37 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15152.091622 secs 2024-04-26T16:00:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:39 smithi196 ceph-mon[32572]: pgmap v8480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:39 smithi110 ceph-mon[28069]: pgmap v8480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:39.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:39 smithi193 ceph-mon[32782]: pgmap v8480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:41 smithi196 ceph-mon[32572]: pgmap v8481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:41 smithi110 ceph-mon[28069]: pgmap v8481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:41 smithi193 ceph-mon[32782]: pgmap v8481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:42 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15157.091740 secs 2024-04-26T16:00:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:42 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15157.091740 secs 2024-04-26T16:00:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:42 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15157.091740 secs 2024-04-26T16:00:43.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:43 smithi196 ceph-mon[32572]: pgmap v8482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:43 smithi110 ceph-mon[28069]: pgmap v8482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:43 smithi193 ceph-mon[32782]: pgmap v8482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:45.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:45 smithi196 ceph-mon[32572]: pgmap v8483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:45 smithi110 ceph-mon[28069]: pgmap v8483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:45 smithi193 ceph-mon[32782]: pgmap v8483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:47 smithi196 ceph-mon[32572]: pgmap v8484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:47 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15162.091855 secs 2024-04-26T16:00:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:47 smithi110 ceph-mon[28069]: pgmap v8484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:47 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15162.091855 secs 2024-04-26T16:00:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:47 smithi193 ceph-mon[32782]: pgmap v8484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:47 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15162.091855 secs 2024-04-26T16:00:49.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:49 smithi196 ceph-mon[32572]: pgmap v8485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:49 smithi110 ceph-mon[28069]: pgmap v8485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:49.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:49 smithi193 ceph-mon[32782]: pgmap v8485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:51.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:51 smithi196 ceph-mon[32572]: pgmap v8486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:51 smithi110 ceph-mon[28069]: pgmap v8486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:51.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:51 smithi193 ceph-mon[32782]: pgmap v8486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:52.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:52 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15167.091977 secs 2024-04-26T16:00:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:52 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15167.091977 secs 2024-04-26T16:00:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:52 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15167.091977 secs 2024-04-26T16:00:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:53 smithi196 ceph-mon[32572]: pgmap v8487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:53 smithi110 ceph-mon[28069]: pgmap v8487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:53 smithi193 ceph-mon[32782]: pgmap v8487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:55.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:55 smithi196 ceph-mon[32572]: pgmap v8488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:55 smithi110 ceph-mon[28069]: pgmap v8488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:55.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:55 smithi193 ceph-mon[32782]: pgmap v8488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:57.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:57 smithi196 ceph-mon[32572]: pgmap v8489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:57 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15172.092055 secs 2024-04-26T16:00:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:57 smithi110 ceph-mon[28069]: pgmap v8489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:57 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15172.092055 secs 2024-04-26T16:00:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:57 smithi193 ceph-mon[32782]: pgmap v8489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:00:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:57 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15172.092055 secs 2024-04-26T16:00:59.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:00:59 smithi196 ceph-mon[32572]: pgmap v8490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:00:59 smithi110 ceph-mon[28069]: pgmap v8490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:00:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:00:59 smithi193 ceph-mon[32782]: pgmap v8490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:01.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:01 smithi196 ceph-mon[32572]: pgmap v8491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:01 smithi110 ceph-mon[28069]: pgmap v8491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:01 smithi193 ceph-mon[32782]: pgmap v8491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:02 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15177.092153 secs 2024-04-26T16:01:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:02 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15177.092153 secs 2024-04-26T16:01:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:02 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15177.092153 secs 2024-04-26T16:01:03.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:03 smithi196 ceph-mon[32572]: pgmap v8492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:03 smithi110 ceph-mon[28069]: pgmap v8492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:03 smithi193 ceph-mon[32782]: pgmap v8492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:05 smithi196 ceph-mon[32572]: pgmap v8493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:05 smithi110 ceph-mon[28069]: pgmap v8493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:05 smithi193 ceph-mon[32782]: pgmap v8493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:07 smithi110 ceph-mon[28069]: pgmap v8494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:07 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15182.092275 secs 2024-04-26T16:01:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:07 smithi193 ceph-mon[32782]: pgmap v8494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:07 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15182.092275 secs 2024-04-26T16:01:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:07 smithi196 ceph-mon[32572]: pgmap v8494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:07 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15182.092275 secs 2024-04-26T16:01:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:09 smithi110 ceph-mon[28069]: pgmap v8495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:09 smithi193 ceph-mon[32782]: pgmap v8495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:09 smithi196 ceph-mon[32572]: pgmap v8495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:11 smithi110 ceph-mon[28069]: pgmap v8496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:11 smithi193 ceph-mon[32782]: pgmap v8496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:11 smithi196 ceph-mon[32572]: pgmap v8496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:12 smithi110 ceph-mon[28069]: 17 slow requests, 1 included below; oldest blocked for > 15187.092375 secs 2024-04-26T16:01:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:12 smithi110 ceph-mon[28069]: slow request 724.110135 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:01:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:12 smithi193 ceph-mon[32782]: 17 slow requests, 1 included below; oldest blocked for > 15187.092375 secs 2024-04-26T16:01:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:12 smithi193 ceph-mon[32782]: slow request 724.110135 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:01:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:12 smithi196 ceph-mon[32572]: 17 slow requests, 1 included below; oldest blocked for > 15187.092375 secs 2024-04-26T16:01:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:12 smithi196 ceph-mon[32572]: slow request 724.110135 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:01:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:13 smithi110 ceph-mon[28069]: pgmap v8497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:13 smithi193 ceph-mon[32782]: pgmap v8497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:13.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:13 smithi196 ceph-mon[32572]: pgmap v8497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:15 smithi110 ceph-mon[28069]: pgmap v8498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:01:15.598 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:15 smithi196 ceph-mon[32572]: pgmap v8498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:15.598 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:01:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:15 smithi193 ceph-mon[32782]: pgmap v8498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:01:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: pgmap v8499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15192.092497 secs 2024-04-26T16:01:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: pgmap v8499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15192.092497 secs 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: pgmap v8499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15192.092497 secs 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:01:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:18 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:01:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:01:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:01:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:18 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:01:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:01:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:18 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:01:19.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:19 smithi196 ceph-mon[32572]: pgmap v8500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:19 smithi110 ceph-mon[28069]: pgmap v8500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:19 smithi193 ceph-mon[32782]: pgmap v8500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:01:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:01:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:01:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: pgmap v8501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 789 B/s rd, 1 op/s 2024-04-26T16:01:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: pgmap v8502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: pgmap v8501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 789 B/s rd, 1 op/s 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: pgmap v8502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:01:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:01:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: pgmap v8501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 789 B/s rd, 1 op/s 2024-04-26T16:01:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: pgmap v8502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:01:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15197.092616 secs 2024-04-26T16:01:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15197.092616 secs 2024-04-26T16:01:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15197.092616 secs 2024-04-26T16:01:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:22 smithi193 ceph-mon[32782]: pgmap v8503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:22 smithi196 ceph-mon[32572]: pgmap v8503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:22 smithi110 ceph-mon[28069]: pgmap v8503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:23 smithi193 ceph-mon[32782]: pgmap v8504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:24.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:23 smithi196 ceph-mon[32572]: pgmap v8504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:23 smithi110 ceph-mon[28069]: pgmap v8504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:25 smithi193 ceph-mon[32782]: pgmap v8505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:26.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:25 smithi196 ceph-mon[32572]: pgmap v8505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:25 smithi110 ceph-mon[28069]: pgmap v8505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T16:01:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:26 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15202.092730 secs 2024-04-26T16:01:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:26 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15202.092730 secs 2024-04-26T16:01:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:26 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15202.092730 secs 2024-04-26T16:01:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:27 smithi193 ceph-mon[32782]: pgmap v8506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:01:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:27 smithi196 ceph-mon[32572]: pgmap v8506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:01:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:27 smithi110 ceph-mon[28069]: pgmap v8506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:01:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:29 smithi193 ceph-mon[32782]: pgmap v8507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:01:30.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:29 smithi196 ceph-mon[32572]: pgmap v8507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:01:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:29 smithi110 ceph-mon[28069]: pgmap v8507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:01:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:31 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15207.092848 secs 2024-04-26T16:01:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:31 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15207.092848 secs 2024-04-26T16:01:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:31 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15207.092848 secs 2024-04-26T16:01:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:32 smithi193 ceph-mon[32782]: pgmap v8508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:32 smithi196 ceph-mon[32572]: pgmap v8508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:32 smithi110 ceph-mon[28069]: pgmap v8508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:33 smithi193 ceph-mon[32782]: pgmap v8509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:33 smithi196 ceph-mon[32572]: pgmap v8509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:33 smithi110 ceph-mon[28069]: pgmap v8509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:35 smithi110 ceph-mon[28069]: pgmap v8510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:35 smithi193 ceph-mon[32782]: pgmap v8510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:35 smithi196 ceph-mon[32572]: pgmap v8510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:36 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15212.092932 secs 2024-04-26T16:01:37.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:36 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15212.092932 secs 2024-04-26T16:01:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:36 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15212.092932 secs 2024-04-26T16:01:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:37 smithi193 ceph-mon[32782]: pgmap v8511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:37 smithi196 ceph-mon[32572]: pgmap v8511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:37 smithi110 ceph-mon[28069]: pgmap v8511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:39 smithi193 ceph-mon[32782]: pgmap v8512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:39 smithi196 ceph-mon[32572]: pgmap v8512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:39 smithi110 ceph-mon[28069]: pgmap v8512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:41 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15217.093051 secs 2024-04-26T16:01:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:41 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15217.093051 secs 2024-04-26T16:01:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:41 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15217.093051 secs 2024-04-26T16:01:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:42 smithi193 ceph-mon[32782]: pgmap v8513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:42 smithi196 ceph-mon[32572]: pgmap v8513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:42 smithi110 ceph-mon[28069]: pgmap v8513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:43 smithi193 ceph-mon[32782]: pgmap v8514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:44.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:43 smithi196 ceph-mon[32572]: pgmap v8514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:43 smithi110 ceph-mon[28069]: pgmap v8514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:45 smithi193 ceph-mon[32782]: pgmap v8515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:46.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:45 smithi196 ceph-mon[32572]: pgmap v8515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:45 smithi110 ceph-mon[28069]: pgmap v8515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:46 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15222.093173 secs 2024-04-26T16:01:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:46 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15222.093173 secs 2024-04-26T16:01:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:46 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15222.093173 secs 2024-04-26T16:01:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:47 smithi193 ceph-mon[32782]: pgmap v8516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:47 smithi196 ceph-mon[32572]: pgmap v8516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:47 smithi110 ceph-mon[28069]: pgmap v8516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:49 smithi193 ceph-mon[32782]: pgmap v8517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:49 smithi196 ceph-mon[32572]: pgmap v8517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:49 smithi110 ceph-mon[28069]: pgmap v8517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:51 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15227.093298 secs 2024-04-26T16:01:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:51 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15227.093298 secs 2024-04-26T16:01:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:51 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15227.093298 secs 2024-04-26T16:01:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:52 smithi193 ceph-mon[32782]: pgmap v8518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:52 smithi196 ceph-mon[32572]: pgmap v8518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:52 smithi110 ceph-mon[28069]: pgmap v8518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:53 smithi193 ceph-mon[32782]: pgmap v8519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:54.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:53 smithi196 ceph-mon[32572]: pgmap v8519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:53 smithi110 ceph-mon[28069]: pgmap v8519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:55 smithi193 ceph-mon[32782]: pgmap v8520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:56.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:55 smithi196 ceph-mon[32572]: pgmap v8520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:55 smithi110 ceph-mon[28069]: pgmap v8520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:01:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:56 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15232.093416 secs 2024-04-26T16:01:57.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:56 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15232.093416 secs 2024-04-26T16:01:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:56 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15232.093416 secs 2024-04-26T16:01:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:57 smithi193 ceph-mon[32782]: pgmap v8521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:57 smithi196 ceph-mon[32572]: pgmap v8521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:01:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:57 smithi110 ceph-mon[28069]: pgmap v8521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:01:59 smithi193 ceph-mon[32782]: pgmap v8522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:00.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:01:59 smithi196 ceph-mon[32572]: pgmap v8522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:01:59 smithi110 ceph-mon[28069]: pgmap v8522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:01 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15237.093536 secs 2024-04-26T16:02:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:01 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15237.093536 secs 2024-04-26T16:02:02.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:01 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15237.093536 secs 2024-04-26T16:02:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:02 smithi193 ceph-mon[32782]: pgmap v8523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:02 smithi196 ceph-mon[32572]: pgmap v8523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:02 smithi110 ceph-mon[28069]: pgmap v8523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:03 smithi193 ceph-mon[32782]: pgmap v8524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:04.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:03 smithi196 ceph-mon[32572]: pgmap v8524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:03 smithi110 ceph-mon[28069]: pgmap v8524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:05 smithi193 ceph-mon[32782]: pgmap v8525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:06.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:05 smithi196 ceph-mon[32572]: pgmap v8525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:05 smithi110 ceph-mon[28069]: pgmap v8525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:06 smithi193 ceph-mon[32782]: 17 slow requests, 1 included below; oldest blocked for > 15242.093653 secs 2024-04-26T16:02:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:06 smithi193 ceph-mon[32782]: slow request 2880.138271 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:02:07.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:06 smithi196 ceph-mon[32572]: 17 slow requests, 1 included below; oldest blocked for > 15242.093653 secs 2024-04-26T16:02:07.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:06 smithi196 ceph-mon[32572]: slow request 2880.138271 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:02:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:06 smithi110 ceph-mon[28069]: 17 slow requests, 1 included below; oldest blocked for > 15242.093653 secs 2024-04-26T16:02:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:06 smithi110 ceph-mon[28069]: slow request 2880.138271 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:02:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:08 smithi193 ceph-mon[32782]: pgmap v8526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:08 smithi196 ceph-mon[32572]: pgmap v8526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:08 smithi110 ceph-mon[28069]: pgmap v8526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:10 smithi193 ceph-mon[32782]: pgmap v8527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:11.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:10 smithi196 ceph-mon[32572]: pgmap v8527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:10 smithi110 ceph-mon[28069]: pgmap v8527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:11 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15247.093765 secs 2024-04-26T16:02:12.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:11 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15247.093765 secs 2024-04-26T16:02:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:11 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15247.093765 secs 2024-04-26T16:02:13.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:12 smithi196 ceph-mon[32572]: pgmap v8528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:12 smithi110 ceph-mon[28069]: pgmap v8528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:12 smithi193 ceph-mon[32782]: pgmap v8528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:15.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:14 smithi196 ceph-mon[32572]: pgmap v8529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:14 smithi110 ceph-mon[28069]: pgmap v8529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:14 smithi193 ceph-mon[32782]: pgmap v8529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:16 smithi196 ceph-mon[32572]: pgmap v8530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:16 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15252.093835 secs 2024-04-26T16:02:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:16 smithi110 ceph-mon[28069]: pgmap v8530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:16 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15252.093835 secs 2024-04-26T16:02:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:16 smithi193 ceph-mon[32782]: pgmap v8530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:16 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15252.093835 secs 2024-04-26T16:02:19.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:18 smithi196 ceph-mon[32572]: pgmap v8531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:18 smithi110 ceph-mon[28069]: pgmap v8531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:18 smithi193 ceph-mon[32782]: pgmap v8531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:20 smithi196 ceph-mon[32572]: pgmap v8532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:02:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:20 smithi110 ceph-mon[28069]: pgmap v8532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:02:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:20 smithi193 ceph-mon[32782]: pgmap v8532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:02:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:02:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:02:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:21 smithi196 ceph-mon[32572]: pgmap v8533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:02:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:21 smithi196 ceph-mon[32572]: pgmap v8534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:02:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15257.093961 secs 2024-04-26T16:02:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:02:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:02:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:21 smithi110 ceph-mon[28069]: pgmap v8533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:02:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:21 smithi110 ceph-mon[28069]: pgmap v8534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:02:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15257.093961 secs 2024-04-26T16:02:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:02:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:02:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:21 smithi193 ceph-mon[32782]: pgmap v8533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:02:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:21 smithi193 ceph-mon[32782]: pgmap v8534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:02:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15257.093961 secs 2024-04-26T16:02:24.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:24 smithi196 ceph-mon[32572]: pgmap v8535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:24 smithi110 ceph-mon[28069]: pgmap v8535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:24 smithi193 ceph-mon[32782]: pgmap v8535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:26 smithi196 ceph-mon[32572]: pgmap v8536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:26 smithi110 ceph-mon[28069]: pgmap v8536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:26 smithi193 ceph-mon[32782]: pgmap v8536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:27 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15262.094075 secs 2024-04-26T16:02:27.771 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:27 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15262.094075 secs 2024-04-26T16:02:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:27 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15262.094075 secs 2024-04-26T16:02:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:28 smithi196 ceph-mon[32572]: pgmap v8537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:28 smithi110 ceph-mon[28069]: pgmap v8537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:28 smithi193 ceph-mon[32782]: pgmap v8537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:30 smithi196 ceph-mon[32572]: pgmap v8538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:30 smithi110 ceph-mon[28069]: pgmap v8538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:30 smithi193 ceph-mon[32782]: pgmap v8538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:02:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:32 smithi196 ceph-mon[32572]: pgmap v8539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:02:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:32 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15267.094194 secs 2024-04-26T16:02:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:32 smithi110 ceph-mon[28069]: pgmap v8539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:02:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:32 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15267.094194 secs 2024-04-26T16:02:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:32 smithi193 ceph-mon[32782]: pgmap v8539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:02:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:32 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15267.094194 secs 2024-04-26T16:02:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:34 smithi196 ceph-mon[32572]: pgmap v8540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:34 smithi110 ceph-mon[28069]: pgmap v8540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:34 smithi193 ceph-mon[32782]: pgmap v8540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:36 smithi196 ceph-mon[32572]: pgmap v8541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:36 smithi110 ceph-mon[28069]: pgmap v8541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:36 smithi193 ceph-mon[32782]: pgmap v8541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:37 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15272.094309 secs 2024-04-26T16:02:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:37 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15272.094309 secs 2024-04-26T16:02:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:37 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15272.094309 secs 2024-04-26T16:02:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:38 smithi196 ceph-mon[32572]: pgmap v8542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:38 smithi110 ceph-mon[28069]: pgmap v8542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:38 smithi193 ceph-mon[32782]: pgmap v8542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:40 smithi196 ceph-mon[32572]: pgmap v8543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:40 smithi110 ceph-mon[28069]: pgmap v8543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:40 smithi193 ceph-mon[32782]: pgmap v8543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:42 smithi196 ceph-mon[32572]: pgmap v8544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:42 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15277.094428 secs 2024-04-26T16:02:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:42 smithi110 ceph-mon[28069]: pgmap v8544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:42 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15277.094428 secs 2024-04-26T16:02:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:42 smithi193 ceph-mon[32782]: pgmap v8544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:42 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15277.094428 secs 2024-04-26T16:02:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:44 smithi196 ceph-mon[32572]: pgmap v8545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:44 smithi110 ceph-mon[28069]: pgmap v8545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:44 smithi193 ceph-mon[32782]: pgmap v8545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:46 smithi196 ceph-mon[32572]: pgmap v8546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:46 smithi110 ceph-mon[28069]: pgmap v8546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:46 smithi193 ceph-mon[32782]: pgmap v8546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:47 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15282.094544 secs 2024-04-26T16:02:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:47 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15282.094544 secs 2024-04-26T16:02:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:47 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15282.094544 secs 2024-04-26T16:02:48.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:48 smithi196 ceph-mon[32572]: pgmap v8547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:48 smithi110 ceph-mon[28069]: pgmap v8547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:48 smithi193 ceph-mon[32782]: pgmap v8547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:50 smithi196 ceph-mon[32572]: pgmap v8548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:50 smithi110 ceph-mon[28069]: pgmap v8548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:50 smithi193 ceph-mon[32782]: pgmap v8548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:52 smithi196 ceph-mon[32572]: pgmap v8549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:52 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15287.094605 secs 2024-04-26T16:02:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:52 smithi110 ceph-mon[28069]: pgmap v8549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:52 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15287.094605 secs 2024-04-26T16:02:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:52 smithi193 ceph-mon[32782]: pgmap v8549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:52 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15287.094605 secs 2024-04-26T16:02:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:54 smithi196 ceph-mon[32572]: pgmap v8550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:54 smithi110 ceph-mon[28069]: pgmap v8550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:54 smithi193 ceph-mon[32782]: pgmap v8550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:56 smithi196 ceph-mon[32572]: pgmap v8551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:56 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15292.094701 secs 2024-04-26T16:02:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:56 smithi110 ceph-mon[28069]: pgmap v8551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:56 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15292.094701 secs 2024-04-26T16:02:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:56 smithi193 ceph-mon[32782]: pgmap v8551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:02:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:56 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15292.094701 secs 2024-04-26T16:02:58.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:02:58 smithi196 ceph-mon[32572]: pgmap v8552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:02:58 smithi110 ceph-mon[28069]: pgmap v8552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:02:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:02:58 smithi193 ceph-mon[32782]: pgmap v8552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:00 smithi110 ceph-mon[28069]: pgmap v8553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:00 smithi193 ceph-mon[32782]: pgmap v8553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:00 smithi196 ceph-mon[32572]: pgmap v8553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:01 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15297.094786 secs 2024-04-26T16:03:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:01 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15297.094786 secs 2024-04-26T16:03:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:01 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15297.094786 secs 2024-04-26T16:03:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:02 smithi110 ceph-mon[28069]: pgmap v8554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:02 smithi193 ceph-mon[32782]: pgmap v8554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:02 smithi196 ceph-mon[32572]: pgmap v8554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:04 smithi110 ceph-mon[28069]: pgmap v8555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:04 smithi193 ceph-mon[32782]: pgmap v8555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:04 smithi196 ceph-mon[32572]: pgmap v8555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:06 smithi110 ceph-mon[28069]: pgmap v8556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:06 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15302.094899 secs 2024-04-26T16:03:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:06 smithi193 ceph-mon[32782]: pgmap v8556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:06 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15302.094899 secs 2024-04-26T16:03:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:06 smithi196 ceph-mon[32572]: pgmap v8556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:06 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15302.094899 secs 2024-04-26T16:03:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:08 smithi110 ceph-mon[28069]: pgmap v8557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:08.805 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:08 smithi196 ceph-mon[32572]: pgmap v8557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:08 smithi193 ceph-mon[32782]: pgmap v8557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:10 smithi110 ceph-mon[28069]: pgmap v8558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:10 smithi193 ceph-mon[32782]: pgmap v8558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:10 smithi196 ceph-mon[32572]: pgmap v8558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:11 smithi193 ceph-mon[32782]: 17 slow requests, 1 included below; oldest blocked for > 15307.095036 secs 2024-04-26T16:03:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:11 smithi193 ceph-mon[32782]: slow request 1444.431169 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:03:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:11 smithi196 ceph-mon[32572]: 17 slow requests, 1 included below; oldest blocked for > 15307.095036 secs 2024-04-26T16:03:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:11 smithi196 ceph-mon[32572]: slow request 1444.431169 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:03:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:11 smithi110 ceph-mon[28069]: 17 slow requests, 1 included below; oldest blocked for > 15307.095036 secs 2024-04-26T16:03:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:11 smithi110 ceph-mon[28069]: slow request 1444.431169 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:03:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:12 smithi193 ceph-mon[32782]: pgmap v8559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:12 smithi196 ceph-mon[32572]: pgmap v8559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:12 smithi110 ceph-mon[28069]: pgmap v8559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:14 smithi193 ceph-mon[32782]: pgmap v8560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:14 smithi196 ceph-mon[32572]: pgmap v8560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:14 smithi110 ceph-mon[28069]: pgmap v8560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.415+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T16:03:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.415+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T16:03:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.415+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614014040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T16:03:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.415+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614014040 comp rx=0 tx=0).stop 2024-04-26T16:03:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.415+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T16:03:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.415+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T16:03:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.415+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5200 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T16:03:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.415+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T16:03:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.416+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T16:03:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.417+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261405a000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T16:03:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.418+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T16:03:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.418+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T16:03:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.418+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T16:03:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.418+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T16:03:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.418+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T16:03:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.419+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T16:03:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:16.419+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T16:03:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:16 smithi193 ceph-mon[32782]: pgmap v8561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:16 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15312.095171 secs 2024-04-26T16:03:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:16 smithi196 ceph-mon[32572]: pgmap v8561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:16 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15312.095171 secs 2024-04-26T16:03:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:16 smithi110 ceph-mon[28069]: pgmap v8561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:16 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15312.095171 secs 2024-04-26T16:03:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:18 smithi193 ceph-mon[32782]: pgmap v8562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:18.891+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:03:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:18.891+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T16:03:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:18.892+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 120 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T16:03:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:03:18.892+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 120 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:03:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:18 smithi196 ceph-mon[32572]: pgmap v8562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:18 smithi110 ceph-mon[28069]: pgmap v8562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:20 smithi193 ceph-mon[32782]: pgmap v8563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:20 smithi196 ceph-mon[32572]: pgmap v8563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:20 smithi110 ceph-mon[28069]: pgmap v8563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15317.095320 secs 2024-04-26T16:03:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15317.095320 secs 2024-04-26T16:03:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15317.095320 secs 2024-04-26T16:03:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:22 smithi193 ceph-mon[32782]: pgmap v8564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:03:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:22 smithi196 ceph-mon[32572]: pgmap v8564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:03:23.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:22 smithi110 ceph-mon[28069]: pgmap v8564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:23.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: pgmap v8565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:03:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: pgmap v8566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T16:03:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: pgmap v8567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: pgmap v8565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:03:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:03:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: pgmap v8566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T16:03:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: pgmap v8567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: pgmap v8565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: pgmap v8566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: pgmap v8567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:03:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:26 smithi110 ceph-mon[28069]: pgmap v8568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T16:03:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:26 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15322.095411 secs 2024-04-26T16:03:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:26 smithi193 ceph-mon[32782]: pgmap v8568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T16:03:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:26 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15322.095411 secs 2024-04-26T16:03:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:26 smithi196 ceph-mon[32572]: pgmap v8568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T16:03:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:26 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15322.095411 secs 2024-04-26T16:03:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:28 smithi193 ceph-mon[32782]: pgmap v8569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:29.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:28 smithi196 ceph-mon[32572]: pgmap v8569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:28 smithi110 ceph-mon[28069]: pgmap v8569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:30 smithi193 ceph-mon[32782]: pgmap v8570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:31.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:30 smithi196 ceph-mon[32572]: pgmap v8570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:30 smithi110 ceph-mon[28069]: pgmap v8570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:31 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15327.095537 secs 2024-04-26T16:03:32.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:31 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15327.095537 secs 2024-04-26T16:03:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:31 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15327.095537 secs 2024-04-26T16:03:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:32 smithi193 ceph-mon[32782]: pgmap v8571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T16:03:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:32 smithi196 ceph-mon[32572]: pgmap v8571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T16:03:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:32 smithi110 ceph-mon[28069]: pgmap v8571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T16:03:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:33 smithi193 ceph-mon[32782]: pgmap v8572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:03:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:33 smithi196 ceph-mon[32572]: pgmap v8572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:03:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:33 smithi110 ceph-mon[28069]: pgmap v8572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:03:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:36 smithi193 ceph-mon[32782]: pgmap v8573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:36 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15332.095653 secs 2024-04-26T16:03:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:36 smithi196 ceph-mon[32572]: pgmap v8573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:36 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15332.095653 secs 2024-04-26T16:03:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:36 smithi110 ceph-mon[28069]: pgmap v8573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:36 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15332.095653 secs 2024-04-26T16:03:39.055 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:38 smithi196 ceph-mon[32572]: pgmap v8574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:38 smithi193 ceph-mon[32782]: pgmap v8574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:38 smithi110 ceph-mon[28069]: pgmap v8574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:40 smithi193 ceph-mon[32782]: pgmap v8575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:41.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:40 smithi196 ceph-mon[32572]: pgmap v8575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:40 smithi110 ceph-mon[28069]: pgmap v8575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:41 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15337.095773 secs 2024-04-26T16:03:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:41 smithi193 ceph-mon[32782]: pgmap v8576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:42.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:41 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15337.095773 secs 2024-04-26T16:03:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:41 smithi196 ceph-mon[32572]: pgmap v8576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:41 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15337.095773 secs 2024-04-26T16:03:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:41 smithi110 ceph-mon[28069]: pgmap v8576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:44 smithi193 ceph-mon[32782]: pgmap v8577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:44 smithi196 ceph-mon[32572]: pgmap v8577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:44 smithi110 ceph-mon[28069]: pgmap v8577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:46 smithi193 ceph-mon[32782]: pgmap v8578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:46 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15342.095888 secs 2024-04-26T16:03:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:46 smithi196 ceph-mon[32572]: pgmap v8578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:46 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15342.095888 secs 2024-04-26T16:03:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:46 smithi110 ceph-mon[28069]: pgmap v8578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:46 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15342.095888 secs 2024-04-26T16:03:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:48 smithi193 ceph-mon[32782]: pgmap v8579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:48 smithi196 ceph-mon[32572]: pgmap v8579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:48 smithi110 ceph-mon[28069]: pgmap v8579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:49 smithi193 ceph-mon[32782]: pgmap v8580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:50.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:49 smithi196 ceph-mon[32572]: pgmap v8580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:49 smithi110 ceph-mon[28069]: pgmap v8580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:51 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15347.095952 secs 2024-04-26T16:03:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:51 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15347.095952 secs 2024-04-26T16:03:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:51 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15347.095952 secs 2024-04-26T16:03:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:52 smithi193 ceph-mon[32782]: pgmap v8581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:52 smithi196 ceph-mon[32572]: pgmap v8581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:52 smithi110 ceph-mon[28069]: pgmap v8581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:54 smithi193 ceph-mon[32782]: pgmap v8582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:54 smithi196 ceph-mon[32572]: pgmap v8582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:54 smithi110 ceph-mon[28069]: pgmap v8582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:57.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:56 smithi110 ceph-mon[28069]: pgmap v8583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:57.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:56 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15352.096088 secs 2024-04-26T16:03:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:56 smithi193 ceph-mon[32782]: pgmap v8583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:56 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15352.096088 secs 2024-04-26T16:03:57.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:56 smithi196 ceph-mon[32572]: pgmap v8583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:03:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:56 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15352.096088 secs 2024-04-26T16:03:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:03:57 smithi193 ceph-mon[32782]: pgmap v8584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:03:57 smithi196 ceph-mon[32572]: pgmap v8584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:03:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:03:57 smithi110 ceph-mon[28069]: pgmap v8584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:00 smithi193 ceph-mon[32782]: pgmap v8585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:00 smithi196 ceph-mon[32572]: pgmap v8585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:00 smithi110 ceph-mon[28069]: pgmap v8585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:01 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15357.096184 secs 2024-04-26T16:04:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:01 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15357.096184 secs 2024-04-26T16:04:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:01 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15357.096184 secs 2024-04-26T16:04:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:02 smithi193 ceph-mon[32782]: pgmap v8586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:02 smithi196 ceph-mon[32572]: pgmap v8586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:02 smithi110 ceph-mon[28069]: pgmap v8586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:03.898 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:04:03.898+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:04:03.898 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:04:03.898+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T16:04:03.899 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:04:03.899+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 121 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T16:04:03.899 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:04:03.899+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 121 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:04:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:03 smithi193 ceph-mon[32782]: pgmap v8587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:04.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:03 smithi196 ceph-mon[32572]: pgmap v8587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:03 smithi110 ceph-mon[28069]: pgmap v8587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:06 smithi193 ceph-mon[32782]: pgmap v8588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:06 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15362.096303 secs 2024-04-26T16:04:07.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:06 smithi196 ceph-mon[32572]: pgmap v8588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:06 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15362.096303 secs 2024-04-26T16:04:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:06 smithi110 ceph-mon[28069]: pgmap v8588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:06 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15362.096303 secs 2024-04-26T16:04:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:07 smithi193 ceph-mon[32782]: pgmap v8589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:07 smithi196 ceph-mon[32572]: pgmap v8589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:07 smithi110 ceph-mon[28069]: pgmap v8589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:08.290 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:04:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:04:07.811+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:04:08.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:04:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:04:07.811+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:04:08.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:04:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:04:07.811+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:04:08.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:04:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:04:07.811+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:04:08.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:04:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:04:07.811+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:04:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:10 smithi193 ceph-mon[32782]: pgmap v8590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:11.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:10 smithi196 ceph-mon[32572]: pgmap v8590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:10 smithi110 ceph-mon[28069]: pgmap v8590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:11 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15367.096423 secs 2024-04-26T16:04:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:11 smithi193 ceph-mon[32782]: pgmap v8591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:12.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:11 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15367.096423 secs 2024-04-26T16:04:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:11 smithi196 ceph-mon[32572]: pgmap v8591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:11 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15367.096423 secs 2024-04-26T16:04:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:11 smithi110 ceph-mon[28069]: pgmap v8591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:14 smithi193 ceph-mon[32782]: pgmap v8592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T16:04:15.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:14 smithi196 ceph-mon[32572]: pgmap v8592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T16:04:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:14 smithi110 ceph-mon[28069]: pgmap v8592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T16:04:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:15 smithi193 ceph-mon[32782]: pgmap v8593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T16:04:16.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:15 smithi196 ceph-mon[32572]: pgmap v8593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T16:04:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:15 smithi110 ceph-mon[28069]: pgmap v8593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T16:04:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:16 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15372.096545 secs 2024-04-26T16:04:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:16 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15372.096545 secs 2024-04-26T16:04:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:16 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15372.096545 secs 2024-04-26T16:04:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:17 smithi193 ceph-mon[32782]: pgmap v8594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T16:04:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:17 smithi196 ceph-mon[32572]: pgmap v8594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T16:04:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:17 smithi110 ceph-mon[28069]: pgmap v8594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T16:04:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:19 smithi193 ceph-mon[32782]: pgmap v8595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T16:04:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:19 smithi196 ceph-mon[32572]: pgmap v8595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T16:04:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:19 smithi110 ceph-mon[28069]: pgmap v8595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T16:04:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15377.096673 secs 2024-04-26T16:04:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15377.096673 secs 2024-04-26T16:04:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15377.096673 secs 2024-04-26T16:04:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:22 smithi193 ceph-mon[32782]: pgmap v8596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T16:04:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:22 smithi196 ceph-mon[32572]: pgmap v8596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T16:04:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:22 smithi110 ceph-mon[28069]: pgmap v8596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T16:04:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:23 smithi193 ceph-mon[32782]: pgmap v8597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T16:04:24.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:23 smithi196 ceph-mon[32572]: pgmap v8597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T16:04:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:23 smithi110 ceph-mon[28069]: pgmap v8597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T16:04:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:04:25.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:04:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:04:26.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:04:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:04:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:25 smithi196 ceph-mon[32572]: pgmap v8598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:04:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:25 smithi196 ceph-mon[32572]: pgmap v8599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:04:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:04:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:04:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:25 smithi110 ceph-mon[28069]: pgmap v8598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:04:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:25 smithi110 ceph-mon[28069]: pgmap v8599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:04:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:04:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:04:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:25 smithi193 ceph-mon[32782]: pgmap v8598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:04:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:25 smithi193 ceph-mon[32782]: pgmap v8599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:04:27.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:26 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15382.096770 secs 2024-04-26T16:04:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:26 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15382.096770 secs 2024-04-26T16:04:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:26 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15382.096770 secs 2024-04-26T16:04:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:27 smithi196 ceph-mon[32572]: pgmap v8600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:28.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:27 smithi193 ceph-mon[32782]: pgmap v8600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:27 smithi110 ceph-mon[28069]: pgmap v8600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:30 smithi193 ceph-mon[32782]: pgmap v8601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:30 smithi196 ceph-mon[32572]: pgmap v8601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:30 smithi110 ceph-mon[28069]: pgmap v8601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:32 smithi193 ceph-mon[32782]: pgmap v8602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:32 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15387.096887 secs 2024-04-26T16:04:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:32 smithi196 ceph-mon[32572]: pgmap v8602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:32 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15387.096887 secs 2024-04-26T16:04:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:32 smithi110 ceph-mon[28069]: pgmap v8602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:32 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15387.096887 secs 2024-04-26T16:04:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:34 smithi196 ceph-mon[32572]: pgmap v8603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:34 smithi110 ceph-mon[28069]: pgmap v8603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:34 smithi193 ceph-mon[32782]: pgmap v8603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:04:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:36 smithi196 ceph-mon[32572]: pgmap v8604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:04:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:36 smithi110 ceph-mon[28069]: pgmap v8604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:04:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:36 smithi193 ceph-mon[32782]: pgmap v8604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:04:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:37 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15392.097028 secs 2024-04-26T16:04:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:37 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15392.097028 secs 2024-04-26T16:04:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:37 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15392.097028 secs 2024-04-26T16:04:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:38 smithi196 ceph-mon[32572]: pgmap v8605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:38 smithi110 ceph-mon[28069]: pgmap v8605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:38 smithi193 ceph-mon[32782]: pgmap v8605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:40.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:40 smithi196 ceph-mon[32572]: pgmap v8606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:40 smithi110 ceph-mon[28069]: pgmap v8606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:40 smithi193 ceph-mon[32782]: pgmap v8606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:42 smithi196 ceph-mon[32572]: pgmap v8607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:42 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15397.097145 secs 2024-04-26T16:04:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:42 smithi110 ceph-mon[28069]: pgmap v8607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:42 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15397.097145 secs 2024-04-26T16:04:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:42 smithi193 ceph-mon[32782]: pgmap v8607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:42 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15397.097145 secs 2024-04-26T16:04:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:44 smithi196 ceph-mon[32572]: pgmap v8608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:44 smithi110 ceph-mon[28069]: pgmap v8608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:44 smithi193 ceph-mon[32782]: pgmap v8608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:46 smithi196 ceph-mon[32572]: pgmap v8609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:46 smithi110 ceph-mon[28069]: pgmap v8609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:46 smithi193 ceph-mon[32782]: pgmap v8609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:47 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15402.097259 secs 2024-04-26T16:04:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:47 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15402.097259 secs 2024-04-26T16:04:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:47 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15402.097259 secs 2024-04-26T16:04:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:48 smithi196 ceph-mon[32572]: pgmap v8610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:48 smithi110 ceph-mon[28069]: pgmap v8610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:48 smithi193 ceph-mon[32782]: pgmap v8610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:50.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:50 smithi196 ceph-mon[32572]: pgmap v8611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:50 smithi110 ceph-mon[28069]: pgmap v8611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:50 smithi193 ceph-mon[32782]: pgmap v8611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:52 smithi196 ceph-mon[32572]: pgmap v8612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:52 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15407.097379 secs 2024-04-26T16:04:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:52 smithi110 ceph-mon[28069]: pgmap v8612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:52 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15407.097379 secs 2024-04-26T16:04:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:52 smithi193 ceph-mon[32782]: pgmap v8612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:52 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15407.097379 secs 2024-04-26T16:04:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:54 smithi196 ceph-mon[32572]: pgmap v8613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:54 smithi110 ceph-mon[28069]: pgmap v8613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:54 smithi193 ceph-mon[32782]: pgmap v8613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:56.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:56 smithi196 ceph-mon[32572]: pgmap v8614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:56 smithi110 ceph-mon[28069]: pgmap v8614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:56 smithi193 ceph-mon[32782]: pgmap v8614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:04:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:57 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15412.097496 secs 2024-04-26T16:04:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:57 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15412.097496 secs 2024-04-26T16:04:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:57 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15412.097496 secs 2024-04-26T16:04:58.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:04:58 smithi196 ceph-mon[32572]: pgmap v8615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:58.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:04:58 smithi193 ceph-mon[32782]: pgmap v8615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:04:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:04:58 smithi110 ceph-mon[28069]: pgmap v8615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:00 smithi196 ceph-mon[32572]: pgmap v8616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:00 smithi110 ceph-mon[28069]: pgmap v8616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:00 smithi193 ceph-mon[32782]: pgmap v8616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:02 smithi196 ceph-mon[32572]: pgmap v8617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:02 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15417.097620 secs 2024-04-26T16:05:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:02 smithi110 ceph-mon[28069]: pgmap v8617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:02 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15417.097620 secs 2024-04-26T16:05:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:02 smithi193 ceph-mon[32782]: pgmap v8617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:02 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15417.097620 secs 2024-04-26T16:05:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:04 smithi196 ceph-mon[32572]: pgmap v8618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:05:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:04 smithi110 ceph-mon[28069]: pgmap v8618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:05:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:04 smithi193 ceph-mon[32782]: pgmap v8618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:05:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:06 smithi196 ceph-mon[32572]: pgmap v8619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:05:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:06 smithi110 ceph-mon[28069]: pgmap v8619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:05:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:06 smithi193 ceph-mon[32782]: pgmap v8619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:05:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:07 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15422.097752 secs 2024-04-26T16:05:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:07 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15422.097752 secs 2024-04-26T16:05:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:07 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15422.097752 secs 2024-04-26T16:05:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:08 smithi196 ceph-mon[32572]: pgmap v8620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:05:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:08 smithi110 ceph-mon[28069]: pgmap v8620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:05:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:08 smithi193 ceph-mon[32782]: pgmap v8620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:05:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:10 smithi196 ceph-mon[32572]: pgmap v8621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:05:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:10 smithi110 ceph-mon[28069]: pgmap v8621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:05:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:10 smithi193 ceph-mon[32782]: pgmap v8621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:05:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:12 smithi196 ceph-mon[32572]: pgmap v8622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:05:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:12 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15427.097869 secs 2024-04-26T16:05:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:12 smithi110 ceph-mon[28069]: pgmap v8622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:05:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:12 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15427.097869 secs 2024-04-26T16:05:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:12 smithi193 ceph-mon[32782]: pgmap v8622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:05:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:12 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15427.097869 secs 2024-04-26T16:05:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:14 smithi110 ceph-mon[28069]: pgmap v8623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:05:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:14 smithi193 ceph-mon[32782]: pgmap v8623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:05:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:14 smithi196 ceph-mon[32572]: pgmap v8623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:05:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:16 smithi110 ceph-mon[28069]: pgmap v8624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:16 smithi193 ceph-mon[32782]: pgmap v8624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:16 smithi196 ceph-mon[32572]: pgmap v8624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:17 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15432.097983 secs 2024-04-26T16:05:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:17 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15432.097983 secs 2024-04-26T16:05:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:17 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15432.097983 secs 2024-04-26T16:05:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:18 smithi110 ceph-mon[28069]: pgmap v8625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:18 smithi193 ceph-mon[32782]: pgmap v8625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:18 smithi196 ceph-mon[32572]: pgmap v8625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:20 smithi110 ceph-mon[28069]: pgmap v8626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:20 smithi193 ceph-mon[32782]: pgmap v8626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:20 smithi196 ceph-mon[32572]: pgmap v8626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15437.098047 secs 2024-04-26T16:05:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15437.098047 secs 2024-04-26T16:05:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15437.098047 secs 2024-04-26T16:05:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:22 smithi193 ceph-mon[32782]: pgmap v8627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:22 smithi196 ceph-mon[32572]: pgmap v8627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:22 smithi110 ceph-mon[28069]: pgmap v8627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:24 smithi193 ceph-mon[32782]: pgmap v8628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:24 smithi196 ceph-mon[32572]: pgmap v8628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:24 smithi110 ceph-mon[28069]: pgmap v8628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:26 smithi193 ceph-mon[32782]: pgmap v8629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:05:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:26 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15442.098158 secs 2024-04-26T16:05:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:26 smithi196 ceph-mon[32572]: pgmap v8629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:05:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:26 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15442.098158 secs 2024-04-26T16:05:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:26 smithi110 ceph-mon[28069]: pgmap v8629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:05:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:26 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15442.098158 secs 2024-04-26T16:05:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:05:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:05:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:05:27.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:05:27.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:05:27.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:05:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:05:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:05:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:05:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:28 smithi193 ceph-mon[32782]: pgmap v8630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:05:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:28 smithi193 ceph-mon[32782]: pgmap v8631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:05:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:28 smithi196 ceph-mon[32572]: pgmap v8630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:05:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:28 smithi196 ceph-mon[32572]: pgmap v8631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:05:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:28 smithi110 ceph-mon[28069]: pgmap v8630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:05:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:28 smithi110 ceph-mon[28069]: pgmap v8631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:05:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:30 smithi193 ceph-mon[32782]: pgmap v8632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:30 smithi196 ceph-mon[32572]: pgmap v8632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:30 smithi110 ceph-mon[28069]: pgmap v8632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:31 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15447.098270 secs 2024-04-26T16:05:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:31 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15447.098270 secs 2024-04-26T16:05:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:31 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15447.098270 secs 2024-04-26T16:05:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:32 smithi193 ceph-mon[32782]: pgmap v8633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:32 smithi196 ceph-mon[32572]: pgmap v8633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:32 smithi110 ceph-mon[28069]: pgmap v8633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:34 smithi193 ceph-mon[32782]: pgmap v8634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:34 smithi196 ceph-mon[32572]: pgmap v8634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:34 smithi110 ceph-mon[28069]: pgmap v8634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:36 smithi193 ceph-mon[32782]: pgmap v8635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:36 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15452.098384 secs 2024-04-26T16:05:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:36 smithi196 ceph-mon[32572]: pgmap v8635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:36 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15452.098384 secs 2024-04-26T16:05:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:36 smithi110 ceph-mon[28069]: pgmap v8635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:05:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:36 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15452.098384 secs 2024-04-26T16:05:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:38 smithi193 ceph-mon[32782]: pgmap v8636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:05:39.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:38 smithi196 ceph-mon[32572]: pgmap v8636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:05:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:38 smithi110 ceph-mon[28069]: pgmap v8636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:05:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:40 smithi193 ceph-mon[32782]: pgmap v8637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:40 smithi196 ceph-mon[32572]: pgmap v8637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:40 smithi110 ceph-mon[28069]: pgmap v8637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:41 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15457.098524 secs 2024-04-26T16:05:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:41 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15457.098524 secs 2024-04-26T16:05:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:41 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15457.098524 secs 2024-04-26T16:05:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:42 smithi193 ceph-mon[32782]: pgmap v8638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:42 smithi196 ceph-mon[32572]: pgmap v8638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:42 smithi110 ceph-mon[28069]: pgmap v8638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:44 smithi196 ceph-mon[32572]: pgmap v8639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:44 smithi110 ceph-mon[28069]: pgmap v8639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:44 smithi193 ceph-mon[32782]: pgmap v8639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:46 smithi196 ceph-mon[32572]: pgmap v8640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:46 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15462.098641 secs 2024-04-26T16:05:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:46 smithi110 ceph-mon[28069]: pgmap v8640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:46 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15462.098641 secs 2024-04-26T16:05:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:46 smithi193 ceph-mon[32782]: pgmap v8640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:46 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15462.098641 secs 2024-04-26T16:05:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:48 smithi196 ceph-mon[32572]: pgmap v8641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:48 smithi110 ceph-mon[28069]: pgmap v8641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:48 smithi193 ceph-mon[32782]: pgmap v8641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:50 smithi196 ceph-mon[32572]: pgmap v8642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:50 smithi110 ceph-mon[28069]: pgmap v8642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:50 smithi193 ceph-mon[32782]: pgmap v8642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:51 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15467.098765 secs 2024-04-26T16:05:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:51 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15467.098765 secs 2024-04-26T16:05:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:51 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15467.098765 secs 2024-04-26T16:05:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:52 smithi196 ceph-mon[32572]: pgmap v8643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:52 smithi110 ceph-mon[28069]: pgmap v8643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:52 smithi193 ceph-mon[32782]: pgmap v8643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:54 smithi196 ceph-mon[32572]: pgmap v8644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:54 smithi110 ceph-mon[28069]: pgmap v8644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:54 smithi193 ceph-mon[32782]: pgmap v8644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:05:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:56 smithi196 ceph-mon[32572]: pgmap v8645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:56 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15472.098879 secs 2024-04-26T16:05:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:56 smithi110 ceph-mon[28069]: pgmap v8645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:56 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15472.098879 secs 2024-04-26T16:05:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:56 smithi193 ceph-mon[32782]: pgmap v8645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:56 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15472.098879 secs 2024-04-26T16:05:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:05:58 smithi196 ceph-mon[32572]: pgmap v8646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:05:58 smithi110 ceph-mon[28069]: pgmap v8646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:05:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:05:58 smithi193 ceph-mon[32782]: pgmap v8646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:00 smithi196 ceph-mon[32572]: pgmap v8647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:00 smithi110 ceph-mon[28069]: pgmap v8647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:00 smithi193 ceph-mon[32782]: pgmap v8647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:02.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:01 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15477.098984 secs 2024-04-26T16:06:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:01 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15477.098984 secs 2024-04-26T16:06:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:01 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15477.098984 secs 2024-04-26T16:06:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:02 smithi196 ceph-mon[32572]: pgmap v8648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:02 smithi110 ceph-mon[28069]: pgmap v8648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:02 smithi193 ceph-mon[32782]: pgmap v8648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:05.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:04 smithi196 ceph-mon[32572]: pgmap v8649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:04 smithi110 ceph-mon[28069]: pgmap v8649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:04 smithi193 ceph-mon[32782]: pgmap v8649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:06 smithi196 ceph-mon[32572]: pgmap v8650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:06 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15482.099099 secs 2024-04-26T16:06:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:06 smithi110 ceph-mon[28069]: pgmap v8650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:06 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15482.099099 secs 2024-04-26T16:06:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:06 smithi193 ceph-mon[32782]: pgmap v8650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:06 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15482.099099 secs 2024-04-26T16:06:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:08 smithi196 ceph-mon[32572]: pgmap v8651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:08 smithi110 ceph-mon[28069]: pgmap v8651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:08 smithi193 ceph-mon[32782]: pgmap v8651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:10 smithi196 ceph-mon[32572]: pgmap v8652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:10 smithi110 ceph-mon[28069]: pgmap v8652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:10 smithi193 ceph-mon[32782]: pgmap v8652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:11 smithi196 ceph-mon[32572]: 17 slow requests, 1 included below; oldest blocked for > 15487.099216 secs 2024-04-26T16:06:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:11 smithi196 ceph-mon[32572]: slow request 723.891701 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:06:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:11 smithi110 ceph-mon[28069]: 17 slow requests, 1 included below; oldest blocked for > 15487.099216 secs 2024-04-26T16:06:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:11 smithi110 ceph-mon[28069]: slow request 723.891701 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:06:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:11 smithi193 ceph-mon[32782]: 17 slow requests, 1 included below; oldest blocked for > 15487.099216 secs 2024-04-26T16:06:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:11 smithi193 ceph-mon[32782]: slow request 723.891701 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:06:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:12 smithi196 ceph-mon[32572]: pgmap v8653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:12 smithi110 ceph-mon[28069]: pgmap v8653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:12 smithi193 ceph-mon[32782]: pgmap v8653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:14 smithi196 ceph-mon[32572]: pgmap v8654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:14 smithi110 ceph-mon[28069]: pgmap v8654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:14 smithi193 ceph-mon[32782]: pgmap v8654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:16 smithi196 ceph-mon[32572]: pgmap v8655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:16 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15492.099330 secs 2024-04-26T16:06:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:16 smithi110 ceph-mon[28069]: pgmap v8655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:16 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15492.099330 secs 2024-04-26T16:06:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:16 smithi193 ceph-mon[32782]: pgmap v8655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:16 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15492.099330 secs 2024-04-26T16:06:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:06:18.920+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T16:06:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:06:18.920+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:06:18.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:06:18.920+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 122 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:06:18.921 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:06:18.920+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 122 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T16:06:19.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:18 smithi196 ceph-mon[32572]: pgmap v8656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:18 smithi110 ceph-mon[28069]: pgmap v8656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:18 smithi193 ceph-mon[32782]: pgmap v8656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:20 smithi196 ceph-mon[32572]: pgmap v8657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:20 smithi110 ceph-mon[28069]: pgmap v8657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:20 smithi193 ceph-mon[32782]: pgmap v8657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:21 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15497.099484 secs 2024-04-26T16:06:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:21 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15497.099484 secs 2024-04-26T16:06:22.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:21 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15497.099484 secs 2024-04-26T16:06:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:22 smithi110 ceph-mon[28069]: pgmap v8658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:22 smithi193 ceph-mon[32782]: pgmap v8658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:23.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:22 smithi196 ceph-mon[32572]: pgmap v8658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:24 smithi110 ceph-mon[28069]: pgmap v8659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:24 smithi193 ceph-mon[32782]: pgmap v8659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:25.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:24 smithi196 ceph-mon[32572]: pgmap v8659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:26 smithi110 ceph-mon[28069]: pgmap v8660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:26 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15502.099600 secs 2024-04-26T16:06:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:26 smithi193 ceph-mon[32782]: pgmap v8660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:26 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15502.099600 secs 2024-04-26T16:06:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:26 smithi196 ceph-mon[32572]: pgmap v8660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:26 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15502.099600 secs 2024-04-26T16:06:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:06:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:06:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:06:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:28 smithi193 ceph-mon[32782]: pgmap v8661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:06:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:06:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:06:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:28 smithi196 ceph-mon[32572]: pgmap v8661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:06:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:06:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:06:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:28 smithi110 ceph-mon[28069]: pgmap v8661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:06:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:06:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:06:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:29 smithi193 ceph-mon[32782]: pgmap v8662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:06:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:29 smithi193 ceph-mon[32782]: pgmap v8663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:30.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:29 smithi196 ceph-mon[32572]: pgmap v8662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:06:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:29 smithi196 ceph-mon[32572]: pgmap v8663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:29 smithi110 ceph-mon[28069]: pgmap v8662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:06:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:29 smithi110 ceph-mon[28069]: pgmap v8663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:31 smithi193 ceph-mon[32782]: pgmap v8664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:31 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15507.099667 secs 2024-04-26T16:06:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:31 smithi196 ceph-mon[32572]: pgmap v8664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:31 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15507.099667 secs 2024-04-26T16:06:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:31 smithi110 ceph-mon[28069]: pgmap v8664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:31 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15507.099667 secs 2024-04-26T16:06:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:33 smithi193 ceph-mon[32782]: pgmap v8665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:33 smithi196 ceph-mon[32572]: pgmap v8665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:33 smithi110 ceph-mon[28069]: pgmap v8665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:35 smithi193 ceph-mon[32782]: pgmap v8666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:35 smithi196 ceph-mon[32572]: pgmap v8666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:35 smithi110 ceph-mon[28069]: pgmap v8666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:36 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15512.099763 secs 2024-04-26T16:06:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:36 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15512.099763 secs 2024-04-26T16:06:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:36 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15512.099763 secs 2024-04-26T16:06:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:37 smithi193 ceph-mon[32782]: pgmap v8667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:38.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:37 smithi196 ceph-mon[32572]: pgmap v8667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:37 smithi110 ceph-mon[28069]: pgmap v8667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:06:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:39 smithi193 ceph-mon[32782]: pgmap v8668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:06:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:39 smithi196 ceph-mon[32572]: pgmap v8668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:06:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:39 smithi110 ceph-mon[28069]: pgmap v8668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:06:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:41 smithi193 ceph-mon[32782]: pgmap v8669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:41 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15517.099903 secs 2024-04-26T16:06:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:41 smithi196 ceph-mon[32572]: pgmap v8669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:41 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15517.099903 secs 2024-04-26T16:06:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:41 smithi110 ceph-mon[28069]: pgmap v8669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:41 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15517.099903 secs 2024-04-26T16:06:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:43 smithi193 ceph-mon[32782]: pgmap v8670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:43 smithi196 ceph-mon[32572]: pgmap v8670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:43 smithi110 ceph-mon[28069]: pgmap v8670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:45.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:44 smithi196 ceph-mon[32572]: pgmap v8671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:44 smithi110 ceph-mon[28069]: pgmap v8671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:44 smithi193 ceph-mon[32782]: pgmap v8671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:46 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15522.100040 secs 2024-04-26T16:06:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:46 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15522.100040 secs 2024-04-26T16:06:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:46 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15522.100040 secs 2024-04-26T16:06:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:47 smithi193 ceph-mon[32782]: pgmap v8672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:47 smithi196 ceph-mon[32572]: pgmap v8672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:47 smithi110 ceph-mon[28069]: pgmap v8672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:49 smithi193 ceph-mon[32782]: pgmap v8673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:49 smithi196 ceph-mon[32572]: pgmap v8673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:49 smithi110 ceph-mon[28069]: pgmap v8673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:51 smithi193 ceph-mon[32782]: pgmap v8674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:51 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15527.100180 secs 2024-04-26T16:06:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:51 smithi196 ceph-mon[32572]: pgmap v8674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:51 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15527.100180 secs 2024-04-26T16:06:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:51 smithi110 ceph-mon[28069]: pgmap v8674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:51 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15527.100180 secs 2024-04-26T16:06:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:53 smithi193 ceph-mon[32782]: pgmap v8675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:53 smithi196 ceph-mon[32572]: pgmap v8675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:53 smithi110 ceph-mon[28069]: pgmap v8675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:06:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:55 smithi196 ceph-mon[32572]: pgmap v8676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:55 smithi110 ceph-mon[28069]: pgmap v8676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:55 smithi193 ceph-mon[32782]: pgmap v8676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:56 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15532.100312 secs 2024-04-26T16:06:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:56 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15532.100312 secs 2024-04-26T16:06:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:56 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15532.100312 secs 2024-04-26T16:06:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:57 smithi196 ceph-mon[32572]: pgmap v8677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:58.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:57 smithi193 ceph-mon[32782]: pgmap v8677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:06:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:57 smithi110 ceph-mon[28069]: pgmap v8677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:00.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:06:59 smithi196 ceph-mon[32572]: pgmap v8678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:06:59 smithi110 ceph-mon[28069]: pgmap v8678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:06:59 smithi193 ceph-mon[32782]: pgmap v8678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:01 smithi196 ceph-mon[32572]: pgmap v8679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:01 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15537.100446 secs 2024-04-26T16:07:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:01 smithi110 ceph-mon[28069]: pgmap v8679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:01 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15537.100446 secs 2024-04-26T16:07:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:01 smithi193 ceph-mon[32782]: pgmap v8679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:01 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15537.100446 secs 2024-04-26T16:07:04.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:03 smithi196 ceph-mon[32572]: pgmap v8680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:03 smithi110 ceph-mon[28069]: pgmap v8680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:03 smithi193 ceph-mon[32782]: pgmap v8680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:05 smithi196 ceph-mon[32572]: pgmap v8681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:05 smithi110 ceph-mon[28069]: pgmap v8681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:05 smithi193 ceph-mon[32782]: pgmap v8681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:06 smithi196 ceph-mon[32572]: 17 slow requests, 0 included below; oldest blocked for > 15542.100582 secs 2024-04-26T16:07:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:06 smithi110 ceph-mon[28069]: 17 slow requests, 0 included below; oldest blocked for > 15542.100582 secs 2024-04-26T16:07:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:06 smithi193 ceph-mon[32782]: 17 slow requests, 0 included below; oldest blocked for > 15542.100582 secs 2024-04-26T16:07:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:07 smithi196 ceph-mon[32572]: pgmap v8682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:07 smithi110 ceph-mon[28069]: pgmap v8682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:07 smithi193 ceph-mon[32782]: pgmap v8682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:09 smithi196 ceph-mon[32572]: pgmap v8683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:09 smithi110 ceph-mon[28069]: pgmap v8683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:09 smithi193 ceph-mon[32782]: pgmap v8683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:11 smithi196 ceph-mon[32572]: pgmap v8684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:11 smithi196 ceph-mon[32572]: 18 slow requests, 1 included below; oldest blocked for > 15547.100640 secs 2024-04-26T16:07:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:11 smithi196 ceph-mon[32572]: slow request 183.577906 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T16:07:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:11 smithi110 ceph-mon[28069]: pgmap v8684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:11 smithi110 ceph-mon[28069]: 18 slow requests, 1 included below; oldest blocked for > 15547.100640 secs 2024-04-26T16:07:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:11 smithi110 ceph-mon[28069]: slow request 183.577906 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T16:07:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:11 smithi193 ceph-mon[32782]: pgmap v8684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:11 smithi193 ceph-mon[32782]: 18 slow requests, 1 included below; oldest blocked for > 15547.100640 secs 2024-04-26T16:07:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:11 smithi193 ceph-mon[32782]: slow request 183.577906 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T16:07:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:13 smithi196 ceph-mon[32572]: pgmap v8685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:13 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T16:07:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:13 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T16:07:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:13 smithi110 ceph-mon[28069]: pgmap v8685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:13 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T16:07:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:13 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T16:07:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:13 smithi193 ceph-mon[32782]: pgmap v8685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:13 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T16:07:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:13 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T16:07:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:15 smithi196 ceph-mon[32572]: pgmap v8686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:15 smithi110 ceph-mon[28069]: pgmap v8686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:15 smithi193 ceph-mon[32782]: pgmap v8686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:16 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15552.100720 secs 2024-04-26T16:07:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:16 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15552.100720 secs 2024-04-26T16:07:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:16 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15552.100720 secs 2024-04-26T16:07:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:17 smithi110 ceph-mon[28069]: pgmap v8687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:17 smithi193 ceph-mon[32782]: pgmap v8687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:17 smithi196 ceph-mon[32572]: pgmap v8687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:19 smithi110 ceph-mon[28069]: pgmap v8688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:19 smithi193 ceph-mon[32782]: pgmap v8688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:20.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:19 smithi196 ceph-mon[32572]: pgmap v8688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:21 smithi110 ceph-mon[28069]: pgmap v8689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:21 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15557.100834 secs 2024-04-26T16:07:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:21 smithi193 ceph-mon[32782]: pgmap v8689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:21 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15557.100834 secs 2024-04-26T16:07:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:21 smithi196 ceph-mon[32572]: pgmap v8689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:21 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15557.100834 secs 2024-04-26T16:07:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:23 smithi110 ceph-mon[28069]: pgmap v8690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:23 smithi193 ceph-mon[32782]: pgmap v8690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:24.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:23 smithi196 ceph-mon[32572]: pgmap v8690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:25 smithi110 ceph-mon[28069]: pgmap v8691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:25 smithi193 ceph-mon[32782]: pgmap v8691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:26.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:25 smithi196 ceph-mon[32572]: pgmap v8691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:26 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15562.100915 secs 2024-04-26T16:07:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:26 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15562.100915 secs 2024-04-26T16:07:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:26 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15562.100915 secs 2024-04-26T16:07:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:27 smithi110 ceph-mon[28069]: pgmap v8692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:27 smithi193 ceph-mon[32782]: pgmap v8692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:27 smithi196 ceph-mon[32572]: pgmap v8692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:07:29.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:07:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:07:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:29 smithi193 ceph-mon[32782]: pgmap v8693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:30.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:29 smithi110 ceph-mon[28069]: pgmap v8693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:29 smithi196 ceph-mon[32572]: pgmap v8693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:07:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:07:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:07:31.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:07:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:07:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:07:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:07:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:07:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:07:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:31 smithi193 ceph-mon[32782]: pgmap v8694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:07:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:31 smithi193 ceph-mon[32782]: pgmap v8695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:31 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15567.101032 secs 2024-04-26T16:07:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:31 smithi196 ceph-mon[32572]: pgmap v8694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:07:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:31 smithi196 ceph-mon[32572]: pgmap v8695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:31 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15567.101032 secs 2024-04-26T16:07:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:31 smithi110 ceph-mon[28069]: pgmap v8694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:07:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:31 smithi110 ceph-mon[28069]: pgmap v8695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:31 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15567.101032 secs 2024-04-26T16:07:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:33 smithi193 ceph-mon[32782]: pgmap v8696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:07:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:33 smithi196 ceph-mon[32572]: pgmap v8696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:07:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:33 smithi110 ceph-mon[28069]: pgmap v8696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:07:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:35 smithi193 ceph-mon[32782]: pgmap v8697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:35 smithi196 ceph-mon[32572]: pgmap v8697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:35 smithi110 ceph-mon[28069]: pgmap v8697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:36 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15572.101146 secs 2024-04-26T16:07:37.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:36 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15572.101146 secs 2024-04-26T16:07:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:36 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15572.101146 secs 2024-04-26T16:07:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:37 smithi193 ceph-mon[32782]: pgmap v8698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:38.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:37 smithi196 ceph-mon[32572]: pgmap v8698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:37 smithi110 ceph-mon[28069]: pgmap v8698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:39 smithi193 ceph-mon[32782]: pgmap v8699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:39 smithi196 ceph-mon[32572]: pgmap v8699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:39 smithi110 ceph-mon[28069]: pgmap v8699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:07:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:41 smithi193 ceph-mon[32782]: pgmap v8700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:07:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:41 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15577.101283 secs 2024-04-26T16:07:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:41 smithi196 ceph-mon[32572]: pgmap v8700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:07:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:41 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15577.101283 secs 2024-04-26T16:07:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:41 smithi110 ceph-mon[28069]: pgmap v8700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:07:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:41 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15577.101283 secs 2024-04-26T16:07:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:43 smithi193 ceph-mon[32782]: pgmap v8701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:43 smithi196 ceph-mon[32572]: pgmap v8701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:43 smithi110 ceph-mon[28069]: pgmap v8701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:44 smithi193 ceph-mon[32782]: pgmap v8702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:45.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:44 smithi196 ceph-mon[32572]: pgmap v8702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:44 smithi110 ceph-mon[28069]: pgmap v8702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:47 smithi196 ceph-mon[32572]: pgmap v8703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:47 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15582.101345 secs 2024-04-26T16:07:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:47 smithi110 ceph-mon[28069]: pgmap v8703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:47 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15582.101345 secs 2024-04-26T16:07:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:47 smithi193 ceph-mon[32782]: pgmap v8703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:47 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15582.101345 secs 2024-04-26T16:07:49.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:49 smithi196 ceph-mon[32572]: pgmap v8704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:49 smithi110 ceph-mon[28069]: pgmap v8704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:49 smithi193 ceph-mon[32782]: pgmap v8704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:51 smithi196 ceph-mon[32572]: pgmap v8705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:51 smithi110 ceph-mon[28069]: pgmap v8705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:51 smithi193 ceph-mon[32782]: pgmap v8705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:52.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:52 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15587.101463 secs 2024-04-26T16:07:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:52 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15587.101463 secs 2024-04-26T16:07:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:52 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15587.101463 secs 2024-04-26T16:07:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:53 smithi196 ceph-mon[32572]: pgmap v8706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:53 smithi110 ceph-mon[28069]: pgmap v8706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:53 smithi193 ceph-mon[32782]: pgmap v8706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:55 smithi196 ceph-mon[32572]: pgmap v8707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:55 smithi110 ceph-mon[28069]: pgmap v8707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:55.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:55 smithi193 ceph-mon[32782]: pgmap v8707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:57 smithi196 ceph-mon[32572]: pgmap v8708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:57 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15592.101618 secs 2024-04-26T16:07:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:57 smithi110 ceph-mon[28069]: pgmap v8708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:57 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15592.101618 secs 2024-04-26T16:07:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:57 smithi193 ceph-mon[32782]: pgmap v8708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:07:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:57 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15592.101618 secs 2024-04-26T16:07:59.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:07:59 smithi193 ceph-mon[32782]: pgmap v8709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:07:59 smithi196 ceph-mon[32572]: pgmap v8709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:07:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:07:59 smithi110 ceph-mon[28069]: pgmap v8709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:01 smithi196 ceph-mon[32572]: pgmap v8710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:01 smithi110 ceph-mon[28069]: pgmap v8710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:01 smithi193 ceph-mon[32782]: pgmap v8710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:02.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:02 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15597.101720 secs 2024-04-26T16:08:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:02 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15597.101720 secs 2024-04-26T16:08:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:02 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15597.101720 secs 2024-04-26T16:08:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:03 smithi196 ceph-mon[32572]: pgmap v8711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:03 smithi110 ceph-mon[28069]: pgmap v8711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:03 smithi193 ceph-mon[32782]: pgmap v8711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:05 smithi196 ceph-mon[32572]: pgmap v8712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:05 smithi110 ceph-mon[28069]: pgmap v8712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:05 smithi193 ceph-mon[32782]: pgmap v8712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:07 smithi196 ceph-mon[32572]: pgmap v8713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:07 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15602.101850 secs 2024-04-26T16:08:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:07 smithi110 ceph-mon[28069]: pgmap v8713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:07 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15602.101850 secs 2024-04-26T16:08:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:07 smithi193 ceph-mon[32782]: pgmap v8713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:07 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15602.101850 secs 2024-04-26T16:08:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:09 smithi196 ceph-mon[32572]: pgmap v8714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:09 smithi110 ceph-mon[28069]: pgmap v8714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:09 smithi193 ceph-mon[32782]: pgmap v8714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:11 smithi196 ceph-mon[32572]: pgmap v8715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:11 smithi110 ceph-mon[28069]: pgmap v8715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:11 smithi193 ceph-mon[32782]: pgmap v8715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:12 smithi196 ceph-mon[32572]: 18 slow requests, 1 included below; oldest blocked for > 15607.101967 secs 2024-04-26T16:08:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:12 smithi196 ceph-mon[32572]: slow request 1444.212854 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:08:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:12 smithi110 ceph-mon[28069]: 18 slow requests, 1 included below; oldest blocked for > 15607.101967 secs 2024-04-26T16:08:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:12 smithi110 ceph-mon[28069]: slow request 1444.212854 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:08:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:12 smithi193 ceph-mon[32782]: 18 slow requests, 1 included below; oldest blocked for > 15607.101967 secs 2024-04-26T16:08:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:12 smithi193 ceph-mon[32782]: slow request 1444.212854 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:08:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:13 smithi196 ceph-mon[32572]: pgmap v8716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:13 smithi110 ceph-mon[28069]: pgmap v8716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:13 smithi193 ceph-mon[32782]: pgmap v8716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:15 smithi196 ceph-mon[32572]: pgmap v8717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:15 smithi110 ceph-mon[28069]: pgmap v8717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:15 smithi193 ceph-mon[32782]: pgmap v8717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:17 smithi196 ceph-mon[32572]: pgmap v8718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:17 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15612.102087 secs 2024-04-26T16:08:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:17 smithi110 ceph-mon[28069]: pgmap v8718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:17 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15612.102087 secs 2024-04-26T16:08:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:17 smithi193 ceph-mon[32782]: pgmap v8718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:17 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15612.102087 secs 2024-04-26T16:08:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:19 smithi196 ceph-mon[32572]: pgmap v8719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:19 smithi110 ceph-mon[28069]: pgmap v8719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:19 smithi193 ceph-mon[32782]: pgmap v8719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:21.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:21 smithi196 ceph-mon[32572]: pgmap v8720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:21 smithi110 ceph-mon[28069]: pgmap v8720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:21 smithi193 ceph-mon[32782]: pgmap v8720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:22.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:22 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15617.102224 secs 2024-04-26T16:08:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:22 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15617.102224 secs 2024-04-26T16:08:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:22 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15617.102224 secs 2024-04-26T16:08:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:23 smithi196 ceph-mon[32572]: pgmap v8721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:23 smithi110 ceph-mon[28069]: pgmap v8721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:23 smithi193 ceph-mon[32782]: pgmap v8721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:25 smithi196 ceph-mon[32572]: pgmap v8722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:25 smithi110 ceph-mon[28069]: pgmap v8722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:25 smithi193 ceph-mon[32782]: pgmap v8722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:27 smithi110 ceph-mon[28069]: pgmap v8723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:27 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15622.102341 secs 2024-04-26T16:08:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:27 smithi193 ceph-mon[32782]: pgmap v8723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:27 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15622.102341 secs 2024-04-26T16:08:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:27 smithi196 ceph-mon[32572]: pgmap v8723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:27 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15622.102341 secs 2024-04-26T16:08:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:29 smithi110 ceph-mon[28069]: pgmap v8724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:29 smithi193 ceph-mon[32782]: pgmap v8724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:29.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:29 smithi196 ceph-mon[32572]: pgmap v8724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:31 smithi110 ceph-mon[28069]: pgmap v8725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:08:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:31 smithi193 ceph-mon[32782]: pgmap v8725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:08:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:31 smithi196 ceph-mon[32572]: pgmap v8725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:08:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:32 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15627.102456 secs 2024-04-26T16:08:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:08:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:08:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:32 smithi110 ceph-mon[28069]: pgmap v8726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:08:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:32 smithi110 ceph-mon[28069]: pgmap v8727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:08:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:08:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:32 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15627.102456 secs 2024-04-26T16:08:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:08:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:08:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:32 smithi193 ceph-mon[32782]: pgmap v8726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:08:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:32 smithi193 ceph-mon[32782]: pgmap v8727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:08:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:08:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:32 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15627.102456 secs 2024-04-26T16:08:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:08:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:08:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:32 smithi196 ceph-mon[32572]: pgmap v8726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:08:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:32 smithi196 ceph-mon[32572]: pgmap v8727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:08:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:08:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:34 smithi196 ceph-mon[32572]: pgmap v8728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:08:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:34 smithi110 ceph-mon[28069]: pgmap v8728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:08:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:34 smithi193 ceph-mon[32782]: pgmap v8728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:08:37.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:36 smithi196 ceph-mon[32572]: pgmap v8729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:08:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:36 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15632.102594 secs 2024-04-26T16:08:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:36 smithi110 ceph-mon[28069]: pgmap v8729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:08:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:36 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15632.102594 secs 2024-04-26T16:08:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:36 smithi193 ceph-mon[32782]: pgmap v8729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:08:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:36 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15632.102594 secs 2024-04-26T16:08:39.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:38 smithi196 ceph-mon[32572]: pgmap v8730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T16:08:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:38 smithi110 ceph-mon[28069]: pgmap v8730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T16:08:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:38 smithi193 ceph-mon[32782]: pgmap v8730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T16:08:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:40 smithi196 ceph-mon[32572]: pgmap v8731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T16:08:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:40 smithi110 ceph-mon[28069]: pgmap v8731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T16:08:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:40 smithi193 ceph-mon[32782]: pgmap v8731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T16:08:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:41 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15637.102709 secs 2024-04-26T16:08:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:41 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15637.102709 secs 2024-04-26T16:08:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:41 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15637.102709 secs 2024-04-26T16:08:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:42 smithi196 ceph-mon[32572]: pgmap v8732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T16:08:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:42 smithi110 ceph-mon[28069]: pgmap v8732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T16:08:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:42 smithi193 ceph-mon[32782]: pgmap v8732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T16:08:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:44 smithi196 ceph-mon[32572]: pgmap v8733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:44 smithi110 ceph-mon[28069]: pgmap v8733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:44 smithi193 ceph-mon[32782]: pgmap v8733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:46 smithi196 ceph-mon[32572]: pgmap v8734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:08:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:46 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15642.102816 secs 2024-04-26T16:08:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:46 smithi110 ceph-mon[28069]: pgmap v8734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:08:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:46 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15642.102816 secs 2024-04-26T16:08:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:46 smithi193 ceph-mon[32782]: pgmap v8734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:08:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:46 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15642.102816 secs 2024-04-26T16:08:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:48 smithi196 ceph-mon[32572]: pgmap v8735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:48 smithi110 ceph-mon[28069]: pgmap v8735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:48 smithi193 ceph-mon[32782]: pgmap v8735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:50 smithi196 ceph-mon[32572]: pgmap v8736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:50 smithi110 ceph-mon[28069]: pgmap v8736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:50 smithi193 ceph-mon[32782]: pgmap v8736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:51 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15647.102933 secs 2024-04-26T16:08:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:51 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15647.102933 secs 2024-04-26T16:08:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:51 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15647.102933 secs 2024-04-26T16:08:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:52 smithi196 ceph-mon[32572]: pgmap v8737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:52 smithi110 ceph-mon[28069]: pgmap v8737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:52 smithi193 ceph-mon[32782]: pgmap v8737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:54 smithi196 ceph-mon[32572]: pgmap v8738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:54 smithi110 ceph-mon[28069]: pgmap v8738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:54 smithi193 ceph-mon[32782]: pgmap v8738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:56 smithi110 ceph-mon[28069]: pgmap v8739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:56 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15652.102993 secs 2024-04-26T16:08:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:56 smithi193 ceph-mon[32782]: pgmap v8739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:56 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15652.102993 secs 2024-04-26T16:08:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:56 smithi196 ceph-mon[32572]: pgmap v8739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:08:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:56 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15652.102993 secs 2024-04-26T16:08:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:08:58 smithi110 ceph-mon[28069]: pgmap v8740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:08:58 smithi193 ceph-mon[32782]: pgmap v8740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:08:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:08:58 smithi196 ceph-mon[32572]: pgmap v8740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:00 smithi110 ceph-mon[28069]: pgmap v8741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:00 smithi193 ceph-mon[32782]: pgmap v8741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:00 smithi196 ceph-mon[32572]: pgmap v8741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:01 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15657.103111 secs 2024-04-26T16:09:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:01 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15657.103111 secs 2024-04-26T16:09:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:01 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15657.103111 secs 2024-04-26T16:09:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:02 smithi110 ceph-mon[28069]: pgmap v8742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:02 smithi193 ceph-mon[32782]: pgmap v8742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:02 smithi196 ceph-mon[32572]: pgmap v8742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:04 smithi110 ceph-mon[28069]: pgmap v8743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:04 smithi193 ceph-mon[32782]: pgmap v8743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:05.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:04 smithi196 ceph-mon[32572]: pgmap v8743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:06 smithi110 ceph-mon[28069]: pgmap v8744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:06 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15662.103226 secs 2024-04-26T16:09:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:06 smithi193 ceph-mon[32782]: pgmap v8744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:06 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15662.103226 secs 2024-04-26T16:09:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:06 smithi196 ceph-mon[32572]: pgmap v8744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:06 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15662.103226 secs 2024-04-26T16:09:08.290 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:09:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:09:07.905+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:09:08.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:09:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:09:07.905+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:09:08.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:09:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:09:07.905+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:09:08.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:09:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:09:07.905+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:09:08.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:09:07 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:09:07.905+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:09:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:08 smithi193 ceph-mon[32782]: pgmap v8745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:08 smithi196 ceph-mon[32572]: pgmap v8745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:08 smithi110 ceph-mon[28069]: pgmap v8745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:10 smithi193 ceph-mon[32782]: pgmap v8746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:11.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:10 smithi196 ceph-mon[32572]: pgmap v8746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:10 smithi110 ceph-mon[28069]: pgmap v8746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:11 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15667.103342 secs 2024-04-26T16:09:12.154 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:11 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15667.103342 secs 2024-04-26T16:09:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:11 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15667.103342 secs 2024-04-26T16:09:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:12 smithi193 ceph-mon[32782]: pgmap v8747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:12 smithi196 ceph-mon[32572]: pgmap v8747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:12 smithi110 ceph-mon[28069]: pgmap v8747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:14 smithi193 ceph-mon[32782]: pgmap v8748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T16:09:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:14 smithi196 ceph-mon[32572]: pgmap v8748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T16:09:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:14 smithi110 ceph-mon[28069]: pgmap v8748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T16:09:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:16 smithi193 ceph-mon[32782]: pgmap v8749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T16:09:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:16 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15672.103476 secs 2024-04-26T16:09:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:16 smithi196 ceph-mon[32572]: pgmap v8749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T16:09:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:16 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15672.103476 secs 2024-04-26T16:09:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:16 smithi110 ceph-mon[28069]: pgmap v8749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T16:09:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:16 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15672.103476 secs 2024-04-26T16:09:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:09:18.949+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:09:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:09:18.949+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T16:09:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:09:18.950+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 123 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:09:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:09:18.950+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 123 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T16:09:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:18 smithi193 ceph-mon[32782]: pgmap v8750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T16:09:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:18 smithi196 ceph-mon[32572]: pgmap v8750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T16:09:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:18 smithi110 ceph-mon[28069]: pgmap v8750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T16:09:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:20 smithi193 ceph-mon[32782]: pgmap v8751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T16:09:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:20 smithi196 ceph-mon[32572]: pgmap v8751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T16:09:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:20 smithi110 ceph-mon[28069]: pgmap v8751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T16:09:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:21 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15677.103616 secs 2024-04-26T16:09:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:21 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15677.103616 secs 2024-04-26T16:09:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:21 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15677.103616 secs 2024-04-26T16:09:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:22 smithi193 ceph-mon[32782]: pgmap v8752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T16:09:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:22 smithi196 ceph-mon[32572]: pgmap v8752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T16:09:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:22 smithi110 ceph-mon[28069]: pgmap v8752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T16:09:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:24 smithi193 ceph-mon[32782]: pgmap v8753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T16:09:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:24 smithi196 ceph-mon[32572]: pgmap v8753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T16:09:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:24 smithi110 ceph-mon[28069]: pgmap v8753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T16:09:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:26 smithi193 ceph-mon[32782]: pgmap v8754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:26 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15682.103718 secs 2024-04-26T16:09:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:26 smithi196 ceph-mon[32572]: pgmap v8754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:26 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15682.103718 secs 2024-04-26T16:09:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:26 smithi110 ceph-mon[28069]: pgmap v8754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:26 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15682.103718 secs 2024-04-26T16:09:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:28 smithi193 ceph-mon[32782]: pgmap v8755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:28 smithi196 ceph-mon[32572]: pgmap v8755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:28 smithi110 ceph-mon[28069]: pgmap v8755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:30 smithi193 ceph-mon[32782]: pgmap v8756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:30 smithi196 ceph-mon[32572]: pgmap v8756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:30 smithi110 ceph-mon[28069]: pgmap v8756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:32.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:31 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15687.103803 secs 2024-04-26T16:09:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:31 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15687.103803 secs 2024-04-26T16:09:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:31 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15687.103803 secs 2024-04-26T16:09:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:32 smithi196 ceph-mon[32572]: pgmap v8757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:09:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:09:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:09:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:32 smithi110 ceph-mon[28069]: pgmap v8757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:09:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:09:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:09:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:32 smithi193 ceph-mon[32782]: pgmap v8757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:09:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:09:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:09:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:33 smithi196 ceph-mon[32572]: pgmap v8758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:33 smithi110 ceph-mon[28069]: pgmap v8758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:34.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:33 smithi193 ceph-mon[32782]: pgmap v8758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:09:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:09:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:34 smithi196 ceph-mon[32572]: pgmap v8759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T16:09:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:34 smithi196 ceph-mon[32572]: pgmap v8760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:09:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:09:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:09:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:34 smithi110 ceph-mon[28069]: pgmap v8759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T16:09:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:34 smithi110 ceph-mon[28069]: pgmap v8760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:09:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:09:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:09:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:34 smithi193 ceph-mon[32782]: pgmap v8759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T16:09:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:34 smithi193 ceph-mon[32782]: pgmap v8760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:09:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:37 smithi196 ceph-mon[32572]: pgmap v8761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T16:09:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:37 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15692.103919 secs 2024-04-26T16:09:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:37 smithi110 ceph-mon[28069]: pgmap v8761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T16:09:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:37 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15692.103919 secs 2024-04-26T16:09:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:37 smithi193 ceph-mon[32782]: pgmap v8761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T16:09:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:37 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15692.103919 secs 2024-04-26T16:09:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:39 smithi196 ceph-mon[32572]: pgmap v8762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:39 smithi110 ceph-mon[28069]: pgmap v8762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:39 smithi193 ceph-mon[32782]: pgmap v8762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:41 smithi196 ceph-mon[32572]: pgmap v8763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:41 smithi110 ceph-mon[28069]: pgmap v8763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:41 smithi193 ceph-mon[32782]: pgmap v8763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:42 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15697.104037 secs 2024-04-26T16:09:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:42 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15697.104037 secs 2024-04-26T16:09:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:42 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15697.104037 secs 2024-04-26T16:09:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:43 smithi196 ceph-mon[32572]: pgmap v8764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T16:09:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:43 smithi110 ceph-mon[28069]: pgmap v8764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T16:09:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:43 smithi193 ceph-mon[32782]: pgmap v8764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T16:09:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:45 smithi196 ceph-mon[32572]: pgmap v8765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:09:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:45 smithi110 ceph-mon[28069]: pgmap v8765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:09:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:45 smithi193 ceph-mon[32782]: pgmap v8765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:09:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:47 smithi196 ceph-mon[32572]: pgmap v8766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:47 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15702.104153 secs 2024-04-26T16:09:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:47 smithi110 ceph-mon[28069]: pgmap v8766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:47.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:47 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15702.104153 secs 2024-04-26T16:09:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:47 smithi193 ceph-mon[32782]: pgmap v8766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:47 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15702.104153 secs 2024-04-26T16:09:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:49 smithi196 ceph-mon[32572]: pgmap v8767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:49 smithi110 ceph-mon[28069]: pgmap v8767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:49.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:49 smithi193 ceph-mon[32782]: pgmap v8767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:51 smithi196 ceph-mon[32572]: pgmap v8768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:51 smithi110 ceph-mon[28069]: pgmap v8768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:51 smithi193 ceph-mon[32782]: pgmap v8768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:52 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15707.104297 secs 2024-04-26T16:09:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:52 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15707.104297 secs 2024-04-26T16:09:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:52 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15707.104297 secs 2024-04-26T16:09:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:53 smithi196 ceph-mon[32572]: pgmap v8769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:53 smithi110 ceph-mon[28069]: pgmap v8769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:53 smithi193 ceph-mon[32782]: pgmap v8769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:55 smithi196 ceph-mon[32572]: pgmap v8770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:55 smithi110 ceph-mon[28069]: pgmap v8770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:55 smithi193 ceph-mon[32782]: pgmap v8770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:57 smithi196 ceph-mon[32572]: pgmap v8771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:57 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15712.104397 secs 2024-04-26T16:09:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:57 smithi110 ceph-mon[28069]: pgmap v8771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:57 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15712.104397 secs 2024-04-26T16:09:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:57 smithi193 ceph-mon[32782]: pgmap v8771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:09:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:57 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15712.104397 secs 2024-04-26T16:09:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:09:59 smithi196 ceph-mon[32572]: pgmap v8772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:09:59 smithi110 ceph-mon[28069]: pgmap v8772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:09:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:09:59 smithi193 ceph-mon[32782]: pgmap v8772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:10:00.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:10:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:10:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:01 smithi196 ceph-mon[32572]: pgmap v8773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:01 smithi110 ceph-mon[28069]: pgmap v8773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:01.629 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:01 smithi193 ceph-mon[32782]: pgmap v8773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:02 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15717.104515 secs 2024-04-26T16:10:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:02 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15717.104515 secs 2024-04-26T16:10:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:02 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15717.104515 secs 2024-04-26T16:10:03.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:03 smithi196 ceph-mon[32572]: pgmap v8774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:03 smithi110 ceph-mon[28069]: pgmap v8774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:03 smithi193 ceph-mon[32782]: pgmap v8774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:05 smithi196 ceph-mon[32572]: pgmap v8775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:05 smithi110 ceph-mon[28069]: pgmap v8775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:05 smithi193 ceph-mon[32782]: pgmap v8775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:06 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15722.104581 secs 2024-04-26T16:10:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:06 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15722.104581 secs 2024-04-26T16:10:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:06 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15722.104581 secs 2024-04-26T16:10:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:07 smithi110 ceph-mon[28069]: pgmap v8776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:07 smithi193 ceph-mon[32782]: pgmap v8776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:07 smithi196 ceph-mon[32572]: pgmap v8776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:09 smithi110 ceph-mon[28069]: pgmap v8777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:09 smithi193 ceph-mon[32782]: pgmap v8777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:10.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:09 smithi196 ceph-mon[32572]: pgmap v8777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:11 smithi110 ceph-mon[28069]: pgmap v8778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:11 smithi110 ceph-mon[28069]: 18 slow requests, 1 included below; oldest blocked for > 15727.104722 secs 2024-04-26T16:10:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:11 smithi110 ceph-mon[28069]: slow request 363.581987 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:10:12.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:11 smithi196 ceph-mon[32572]: pgmap v8778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:12.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:11 smithi196 ceph-mon[32572]: 18 slow requests, 1 included below; oldest blocked for > 15727.104722 secs 2024-04-26T16:10:12.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:11 smithi196 ceph-mon[32572]: slow request 363.581987 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:10:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:11 smithi193 ceph-mon[32782]: pgmap v8778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:11 smithi193 ceph-mon[32782]: 18 slow requests, 1 included below; oldest blocked for > 15727.104722 secs 2024-04-26T16:10:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:11 smithi193 ceph-mon[32782]: slow request 363.581987 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:10:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:13 smithi110 ceph-mon[28069]: pgmap v8779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:13 smithi193 ceph-mon[32782]: pgmap v8779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:13 smithi196 ceph-mon[32572]: pgmap v8779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:15 smithi110 ceph-mon[28069]: pgmap v8780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:15 smithi193 ceph-mon[32782]: pgmap v8780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:15 smithi196 ceph-mon[32572]: pgmap v8780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:16 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15732.104864 secs 2024-04-26T16:10:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:16 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15732.104864 secs 2024-04-26T16:10:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:16 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15732.104864 secs 2024-04-26T16:10:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:17 smithi193 ceph-mon[32782]: pgmap v8781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:17 smithi196 ceph-mon[32572]: pgmap v8781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:17 smithi110 ceph-mon[28069]: pgmap v8781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:19 smithi193 ceph-mon[32782]: pgmap v8782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:19 smithi196 ceph-mon[32572]: pgmap v8782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:19 smithi110 ceph-mon[28069]: pgmap v8782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:21 smithi193 ceph-mon[32782]: pgmap v8783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:22.152 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:21 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15737.105019 secs 2024-04-26T16:10:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:21 smithi196 ceph-mon[32572]: pgmap v8783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:21 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15737.105019 secs 2024-04-26T16:10:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:21 smithi110 ceph-mon[28069]: pgmap v8783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:21 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15737.105019 secs 2024-04-26T16:10:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:23 smithi193 ceph-mon[32782]: pgmap v8784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:23 smithi196 ceph-mon[32572]: pgmap v8784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:23 smithi110 ceph-mon[28069]: pgmap v8784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:25 smithi193 ceph-mon[32782]: pgmap v8785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:25 smithi196 ceph-mon[32572]: pgmap v8785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:25 smithi110 ceph-mon[28069]: pgmap v8785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:26 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15742.105144 secs 2024-04-26T16:10:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:26 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15742.105144 secs 2024-04-26T16:10:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:26 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15742.105144 secs 2024-04-26T16:10:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:27 smithi193 ceph-mon[32782]: pgmap v8786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:27 smithi196 ceph-mon[32572]: pgmap v8786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:27 smithi110 ceph-mon[28069]: pgmap v8786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:29 smithi193 ceph-mon[32782]: pgmap v8787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:29 smithi196 ceph-mon[32572]: pgmap v8787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:29 smithi110 ceph-mon[28069]: pgmap v8787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:32.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:31 smithi110 ceph-mon[28069]: pgmap v8788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:32.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:31 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15747.105267 secs 2024-04-26T16:10:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:31 smithi193 ceph-mon[32782]: pgmap v8788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:31 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15747.105267 secs 2024-04-26T16:10:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:31 smithi196 ceph-mon[32572]: pgmap v8788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:31 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15747.105267 secs 2024-04-26T16:10:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:33 smithi193 ceph-mon[32782]: pgmap v8789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:33 smithi196 ceph-mon[32572]: pgmap v8789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:33 smithi110 ceph-mon[28069]: pgmap v8789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:10:35.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:10:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:10:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:35 smithi193 ceph-mon[32782]: pgmap v8790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:10:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:10:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:35 smithi196 ceph-mon[32572]: pgmap v8790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:10:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:10:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:35 smithi110 ceph-mon[28069]: pgmap v8790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:10:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:10:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:10:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:36 smithi193 ceph-mon[32782]: pgmap v8791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T16:10:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:36 smithi193 ceph-mon[32782]: pgmap v8792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:36 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15752.105382 secs 2024-04-26T16:10:37.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:36 smithi196 ceph-mon[32572]: pgmap v8791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T16:10:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:36 smithi196 ceph-mon[32572]: pgmap v8792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:36 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15752.105382 secs 2024-04-26T16:10:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:36 smithi110 ceph-mon[28069]: pgmap v8791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T16:10:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:36 smithi110 ceph-mon[28069]: pgmap v8792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:36 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15752.105382 secs 2024-04-26T16:10:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:38 smithi193 ceph-mon[32782]: pgmap v8793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:38 smithi196 ceph-mon[32572]: pgmap v8793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:38 smithi110 ceph-mon[28069]: pgmap v8793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:41.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:40 smithi196 ceph-mon[32572]: pgmap v8794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:40 smithi110 ceph-mon[28069]: pgmap v8794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:40 smithi193 ceph-mon[32782]: pgmap v8794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:42.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:41 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15757.105528 secs 2024-04-26T16:10:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:41 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15757.105528 secs 2024-04-26T16:10:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:41 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15757.105528 secs 2024-04-26T16:10:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:42 smithi196 ceph-mon[32572]: pgmap v8795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:42 smithi110 ceph-mon[28069]: pgmap v8795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:42 smithi193 ceph-mon[32782]: pgmap v8795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:44 smithi196 ceph-mon[32572]: pgmap v8796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:44 smithi110 ceph-mon[28069]: pgmap v8796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:44 smithi193 ceph-mon[32782]: pgmap v8796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:10:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:45 smithi196 ceph-mon[32572]: pgmap v8797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:10:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:45 smithi110 ceph-mon[28069]: pgmap v8797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:10:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:45 smithi193 ceph-mon[32782]: pgmap v8797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:10:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:46 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15762.105651 secs 2024-04-26T16:10:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:46 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15762.105651 secs 2024-04-26T16:10:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:46 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15762.105651 secs 2024-04-26T16:10:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:47 smithi196 ceph-mon[32572]: pgmap v8798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:47 smithi110 ceph-mon[28069]: pgmap v8798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:47 smithi193 ceph-mon[32782]: pgmap v8798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:50 smithi193 ceph-mon[32782]: pgmap v8799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:50 smithi196 ceph-mon[32572]: pgmap v8799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:50 smithi110 ceph-mon[28069]: pgmap v8799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:51 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15767.105786 secs 2024-04-26T16:10:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:51 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15767.105786 secs 2024-04-26T16:10:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:51 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15767.105786 secs 2024-04-26T16:10:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:52 smithi193 ceph-mon[32782]: pgmap v8800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:52 smithi196 ceph-mon[32572]: pgmap v8800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:52 smithi110 ceph-mon[28069]: pgmap v8800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:54 smithi193 ceph-mon[32782]: pgmap v8801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:54 smithi196 ceph-mon[32572]: pgmap v8801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:54 smithi110 ceph-mon[28069]: pgmap v8801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:56 smithi193 ceph-mon[32782]: pgmap v8802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:56 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15772.105905 secs 2024-04-26T16:10:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:56 smithi196 ceph-mon[32572]: pgmap v8802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:56 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15772.105905 secs 2024-04-26T16:10:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:56 smithi110 ceph-mon[28069]: pgmap v8802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:10:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:56 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15772.105905 secs 2024-04-26T16:10:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:10:58 smithi193 ceph-mon[32782]: pgmap v8803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:10:58 smithi196 ceph-mon[32572]: pgmap v8803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:10:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:10:58 smithi110 ceph-mon[28069]: pgmap v8803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:00 smithi193 ceph-mon[32782]: pgmap v8804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:00 smithi196 ceph-mon[32572]: pgmap v8804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:00 smithi110 ceph-mon[28069]: pgmap v8804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:02.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:01 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15777.106004 secs 2024-04-26T16:11:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:01 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15777.106004 secs 2024-04-26T16:11:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:01 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15777.106004 secs 2024-04-26T16:11:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:02 smithi196 ceph-mon[32572]: pgmap v8805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:02 smithi110 ceph-mon[28069]: pgmap v8805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:02 smithi193 ceph-mon[32782]: pgmap v8805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:04 smithi196 ceph-mon[32572]: pgmap v8806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:04 smithi110 ceph-mon[28069]: pgmap v8806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:04 smithi193 ceph-mon[32782]: pgmap v8806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:06 smithi196 ceph-mon[32572]: pgmap v8807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:06 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15782.106082 secs 2024-04-26T16:11:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:06 smithi110 ceph-mon[28069]: pgmap v8807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:06 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15782.106082 secs 2024-04-26T16:11:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:06 smithi193 ceph-mon[32782]: pgmap v8807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:06 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15782.106082 secs 2024-04-26T16:11:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:08 smithi196 ceph-mon[32572]: pgmap v8808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:08 smithi110 ceph-mon[28069]: pgmap v8808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:08 smithi193 ceph-mon[32782]: pgmap v8808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:10 smithi196 ceph-mon[32572]: pgmap v8809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:10 smithi110 ceph-mon[28069]: pgmap v8809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:10 smithi193 ceph-mon[32782]: pgmap v8809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:11 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15787.106205 secs 2024-04-26T16:11:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:11 smithi196 ceph-mon[32572]: pgmap v8810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:11 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15787.106205 secs 2024-04-26T16:11:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:11 smithi110 ceph-mon[28069]: pgmap v8810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:11 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15787.106205 secs 2024-04-26T16:11:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:11 smithi193 ceph-mon[32782]: pgmap v8810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:14 smithi193 ceph-mon[32782]: pgmap v8811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:14 smithi196 ceph-mon[32572]: pgmap v8811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:14 smithi110 ceph-mon[28069]: pgmap v8811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:16 smithi193 ceph-mon[32782]: pgmap v8812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:16 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15792.106325 secs 2024-04-26T16:11:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:16 smithi196 ceph-mon[32572]: pgmap v8812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:16 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15792.106325 secs 2024-04-26T16:11:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:16 smithi110 ceph-mon[28069]: pgmap v8812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:16 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15792.106325 secs 2024-04-26T16:11:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:18 smithi193 ceph-mon[32782]: pgmap v8813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:18 smithi196 ceph-mon[32572]: pgmap v8813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:18 smithi110 ceph-mon[28069]: pgmap v8813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:20 smithi193 ceph-mon[32782]: pgmap v8814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:20 smithi196 ceph-mon[32572]: pgmap v8814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:20 smithi110 ceph-mon[28069]: pgmap v8814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:21 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15797.106445 secs 2024-04-26T16:11:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:21 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15797.106445 secs 2024-04-26T16:11:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:21 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15797.106445 secs 2024-04-26T16:11:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:22 smithi196 ceph-mon[32572]: pgmap v8815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:22 smithi110 ceph-mon[28069]: pgmap v8815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:22 smithi193 ceph-mon[32782]: pgmap v8815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:24 smithi196 ceph-mon[32572]: pgmap v8816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:24 smithi110 ceph-mon[28069]: pgmap v8816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:24 smithi193 ceph-mon[32782]: pgmap v8816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:26 smithi196 ceph-mon[32572]: pgmap v8817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:26 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15802.106601 secs 2024-04-26T16:11:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:26 smithi110 ceph-mon[28069]: pgmap v8817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:26 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15802.106601 secs 2024-04-26T16:11:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:26 smithi193 ceph-mon[32782]: pgmap v8817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:26 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15802.106601 secs 2024-04-26T16:11:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:28 smithi196 ceph-mon[32572]: pgmap v8818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:28 smithi110 ceph-mon[28069]: pgmap v8818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:28 smithi193 ceph-mon[32782]: pgmap v8818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:30 smithi196 ceph-mon[32572]: pgmap v8819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:30 smithi110 ceph-mon[28069]: pgmap v8819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:30 smithi193 ceph-mon[32782]: pgmap v8819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:32.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:31 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15807.106718 secs 2024-04-26T16:11:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:31 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15807.106718 secs 2024-04-26T16:11:32.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:31 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15807.106718 secs 2024-04-26T16:11:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:32 smithi196 ceph-mon[32572]: pgmap v8820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:32 smithi110 ceph-mon[28069]: pgmap v8820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:32 smithi193 ceph-mon[32782]: pgmap v8820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:33 smithi196 ceph-mon[32572]: pgmap v8821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:33 smithi110 ceph-mon[28069]: pgmap v8821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:33 smithi193 ceph-mon[32782]: pgmap v8821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:36 smithi193 ceph-mon[32782]: pgmap v8822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:11:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:36 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15812.106782 secs 2024-04-26T16:11:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:36 smithi196 ceph-mon[32572]: pgmap v8822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:11:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:36 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15812.106782 secs 2024-04-26T16:11:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:36 smithi110 ceph-mon[28069]: pgmap v8822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:11:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:36 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15812.106782 secs 2024-04-26T16:11:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: pgmap v8823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: pgmap v8823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: pgmap v8823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:11:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:11:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:11:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:11:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:40 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:11:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:40 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:11:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:40 smithi196 ceph-mon[32572]: pgmap v8824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:40 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:11:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:40 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:11:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:40 smithi110 ceph-mon[28069]: pgmap v8824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:40 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:11:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:40 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:11:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:40 smithi193 ceph-mon[32782]: pgmap v8824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:41 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15817.106899 secs 2024-04-26T16:11:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:41 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15817.106899 secs 2024-04-26T16:11:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:11:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:11:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:11:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:11:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:41 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15817.106899 secs 2024-04-26T16:11:43.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:42 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:11:43.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:42 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:11:43.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:42 smithi196 ceph-mon[32572]: pgmap v8825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T16:11:43.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:42 smithi196 ceph-mon[32572]: pgmap v8826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:42 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:11:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:42 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:11:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:42 smithi110 ceph-mon[28069]: pgmap v8825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T16:11:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:42 smithi110 ceph-mon[28069]: pgmap v8826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:42 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:11:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:42 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:11:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:42 smithi193 ceph-mon[32782]: pgmap v8825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T16:11:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:42 smithi193 ceph-mon[32782]: pgmap v8826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:44 smithi196 ceph-mon[32572]: pgmap v8827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:44 smithi110 ceph-mon[28069]: pgmap v8827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:44 smithi193 ceph-mon[32782]: pgmap v8827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:46 smithi196 ceph-mon[32572]: pgmap v8828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:46 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15822.107013 secs 2024-04-26T16:11:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:46 smithi110 ceph-mon[28069]: pgmap v8828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:46 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15822.107013 secs 2024-04-26T16:11:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:46 smithi193 ceph-mon[32782]: pgmap v8828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:46 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15822.107013 secs 2024-04-26T16:11:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:48 smithi196 ceph-mon[32572]: pgmap v8829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:48 smithi110 ceph-mon[28069]: pgmap v8829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:48 smithi193 ceph-mon[32782]: pgmap v8829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:50 smithi196 ceph-mon[32572]: pgmap v8830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:50 smithi110 ceph-mon[28069]: pgmap v8830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:50 smithi193 ceph-mon[32782]: pgmap v8830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:11:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:51 smithi196 ceph-mon[32572]: pgmap v8831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:11:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:51 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15827.107086 secs 2024-04-26T16:11:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:51 smithi110 ceph-mon[28069]: pgmap v8831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:11:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:51 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15827.107086 secs 2024-04-26T16:11:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:51 smithi193 ceph-mon[32782]: pgmap v8831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:11:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:51 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15827.107086 secs 2024-04-26T16:11:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:54 smithi196 ceph-mon[32572]: pgmap v8832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:54 smithi110 ceph-mon[28069]: pgmap v8832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:54 smithi193 ceph-mon[32782]: pgmap v8832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:56 smithi196 ceph-mon[32572]: pgmap v8833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:56 smithi110 ceph-mon[28069]: pgmap v8833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:56 smithi193 ceph-mon[32782]: pgmap v8833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:11:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:57 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15832.107205 secs 2024-04-26T16:11:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:57 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15832.107205 secs 2024-04-26T16:11:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:57 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15832.107205 secs 2024-04-26T16:11:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:11:58 smithi196 ceph-mon[32572]: pgmap v8834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:11:58 smithi110 ceph-mon[28069]: pgmap v8834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:11:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:11:58 smithi193 ceph-mon[32782]: pgmap v8834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:00 smithi196 ceph-mon[32572]: pgmap v8835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:00 smithi110 ceph-mon[28069]: pgmap v8835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:00 smithi193 ceph-mon[32782]: pgmap v8835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:02 smithi196 ceph-mon[32572]: pgmap v8836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:02 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15837.107341 secs 2024-04-26T16:12:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:02 smithi110 ceph-mon[28069]: pgmap v8836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:02 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15837.107341 secs 2024-04-26T16:12:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:02 smithi193 ceph-mon[32782]: pgmap v8836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:02 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15837.107341 secs 2024-04-26T16:12:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:04 smithi196 ceph-mon[32572]: pgmap v8837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:04 smithi110 ceph-mon[28069]: pgmap v8837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:04 smithi193 ceph-mon[32782]: pgmap v8837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:06 smithi196 ceph-mon[32572]: pgmap v8838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:06 smithi110 ceph-mon[28069]: pgmap v8838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:06 smithi193 ceph-mon[32782]: pgmap v8838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:07 smithi196 ceph-mon[32572]: 18 slow requests, 0 included below; oldest blocked for > 15842.107456 secs 2024-04-26T16:12:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:07 smithi110 ceph-mon[28069]: 18 slow requests, 0 included below; oldest blocked for > 15842.107456 secs 2024-04-26T16:12:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:07 smithi193 ceph-mon[32782]: 18 slow requests, 0 included below; oldest blocked for > 15842.107456 secs 2024-04-26T16:12:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:08 smithi196 ceph-mon[32572]: pgmap v8839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:08 smithi110 ceph-mon[28069]: pgmap v8839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:08 smithi193 ceph-mon[32782]: pgmap v8839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:10 smithi196 ceph-mon[32572]: pgmap v8840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:10 smithi110 ceph-mon[28069]: pgmap v8840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:10 smithi193 ceph-mon[32782]: pgmap v8840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:12 smithi196 ceph-mon[32572]: pgmap v8841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 15847.107591 secs 2024-04-26T16:12:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:12 smithi196 ceph-mon[32572]: slow request 183.493416 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T16:12:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:12 smithi110 ceph-mon[28069]: pgmap v8841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 15847.107591 secs 2024-04-26T16:12:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:12 smithi110 ceph-mon[28069]: slow request 183.493416 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T16:12:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:12 smithi193 ceph-mon[32782]: pgmap v8841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 15847.107591 secs 2024-04-26T16:12:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:12 smithi193 ceph-mon[32782]: slow request 183.493416 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T16:12:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:14 smithi110 ceph-mon[28069]: pgmap v8842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:14 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T16:12:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:14 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T16:12:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:14 smithi193 ceph-mon[32782]: pgmap v8842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:14 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T16:12:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:14 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T16:12:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:14 smithi196 ceph-mon[32572]: pgmap v8842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:14 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T16:12:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:14 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T16:12:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:16 smithi110 ceph-mon[28069]: pgmap v8843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:16 smithi193 ceph-mon[32782]: pgmap v8843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:16 smithi196 ceph-mon[32572]: pgmap v8843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15852.107727 secs 2024-04-26T16:12:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15852.107727 secs 2024-04-26T16:12:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15852.107727 secs 2024-04-26T16:12:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:18 smithi110 ceph-mon[28069]: pgmap v8844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:18 smithi193 ceph-mon[32782]: pgmap v8844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:12:18.981+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T16:12:18.980 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:12:18.981+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:12:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:12:18.982+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 124 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:12:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:12:18.982+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:12:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:12:18.982+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 124 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T16:12:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:12:18.982+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T16:12:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:12:18.983+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 125 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T16:12:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:12:18.983+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 125 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:12:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:18 smithi196 ceph-mon[32572]: pgmap v8844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:20 smithi110 ceph-mon[28069]: pgmap v8845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:20 smithi193 ceph-mon[32782]: pgmap v8845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:20 smithi196 ceph-mon[32572]: pgmap v8845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:22 smithi110 ceph-mon[28069]: pgmap v8846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15857.107843 secs 2024-04-26T16:12:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:22 smithi193 ceph-mon[32782]: pgmap v8846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15857.107843 secs 2024-04-26T16:12:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:22 smithi196 ceph-mon[32572]: pgmap v8846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15857.107843 secs 2024-04-26T16:12:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:24 smithi110 ceph-mon[28069]: pgmap v8847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:24 smithi193 ceph-mon[32782]: pgmap v8847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:24 smithi196 ceph-mon[32572]: pgmap v8847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:26 smithi193 ceph-mon[32782]: pgmap v8848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:26 smithi196 ceph-mon[32572]: pgmap v8848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:26 smithi110 ceph-mon[28069]: pgmap v8848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15862.107902 secs 2024-04-26T16:12:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15862.107902 secs 2024-04-26T16:12:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15862.107902 secs 2024-04-26T16:12:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:28 smithi193 ceph-mon[32782]: pgmap v8849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:28 smithi196 ceph-mon[32572]: pgmap v8849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:28 smithi110 ceph-mon[28069]: pgmap v8849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:30 smithi193 ceph-mon[32782]: pgmap v8850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:30 smithi196 ceph-mon[32572]: pgmap v8850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:30 smithi110 ceph-mon[28069]: pgmap v8850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:32.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:32 smithi110 ceph-mon[28069]: pgmap v8851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:32.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15867.107969 secs 2024-04-26T16:12:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:32 smithi193 ceph-mon[32782]: pgmap v8851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15867.107969 secs 2024-04-26T16:12:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:32 smithi196 ceph-mon[32572]: pgmap v8851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15867.107969 secs 2024-04-26T16:12:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:34 smithi193 ceph-mon[32782]: pgmap v8852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:34 smithi196 ceph-mon[32572]: pgmap v8852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:34 smithi110 ceph-mon[28069]: pgmap v8852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:36 smithi193 ceph-mon[32782]: pgmap v8853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:36 smithi196 ceph-mon[32572]: pgmap v8853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:36 smithi110 ceph-mon[28069]: pgmap v8853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15872.108084 secs 2024-04-26T16:12:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15872.108084 secs 2024-04-26T16:12:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15872.108084 secs 2024-04-26T16:12:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:38 smithi193 ceph-mon[32782]: pgmap v8854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:38 smithi196 ceph-mon[32572]: pgmap v8854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:38 smithi110 ceph-mon[28069]: pgmap v8854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:40 smithi193 ceph-mon[32782]: pgmap v8855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:40 smithi196 ceph-mon[32572]: pgmap v8855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:40 smithi110 ceph-mon[28069]: pgmap v8855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:41.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15877.108206 secs 2024-04-26T16:12:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15877.108206 secs 2024-04-26T16:12:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15877.108206 secs 2024-04-26T16:12:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:42 smithi193 ceph-mon[32782]: pgmap v8856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:12:42.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:42 smithi196 ceph-mon[32572]: pgmap v8856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:42.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:12:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:42 smithi110 ceph-mon[28069]: pgmap v8856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:12:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:12:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:12:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:43 smithi193 ceph-mon[32782]: pgmap v8857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:12:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:43 smithi193 ceph-mon[32782]: pgmap v8858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:12:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:12:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:12:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:43 smithi196 ceph-mon[32572]: pgmap v8857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:12:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:43 smithi196 ceph-mon[32572]: pgmap v8858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:12:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:12:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:12:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:43 smithi110 ceph-mon[28069]: pgmap v8857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:12:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:43 smithi110 ceph-mon[28069]: pgmap v8858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:12:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:44 smithi196 ceph-mon[32572]: pgmap v8859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:44 smithi110 ceph-mon[28069]: pgmap v8859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:44 smithi193 ceph-mon[32782]: pgmap v8859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15882.108320 secs 2024-04-26T16:12:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15882.108320 secs 2024-04-26T16:12:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15882.108320 secs 2024-04-26T16:12:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:47 smithi196 ceph-mon[32572]: pgmap v8860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:12:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:47 smithi110 ceph-mon[28069]: pgmap v8860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:12:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:47 smithi193 ceph-mon[32782]: pgmap v8860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:12:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:48 smithi196 ceph-mon[32572]: pgmap v8861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:48 smithi110 ceph-mon[28069]: pgmap v8861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:48 smithi193 ceph-mon[32782]: pgmap v8861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:50 smithi196 ceph-mon[32572]: pgmap v8862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:50 smithi110 ceph-mon[28069]: pgmap v8862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:50 smithi193 ceph-mon[32782]: pgmap v8862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:12:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15887.108393 secs 2024-04-26T16:12:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15887.108393 secs 2024-04-26T16:12:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15887.108393 secs 2024-04-26T16:12:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:52 smithi196 ceph-mon[32572]: pgmap v8863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:12:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:52 smithi110 ceph-mon[28069]: pgmap v8863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:12:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:52 smithi193 ceph-mon[32782]: pgmap v8863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:12:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:54 smithi196 ceph-mon[32572]: pgmap v8864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:54 smithi110 ceph-mon[28069]: pgmap v8864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:54 smithi193 ceph-mon[32782]: pgmap v8864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15892.108516 secs 2024-04-26T16:12:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15892.108516 secs 2024-04-26T16:12:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15892.108516 secs 2024-04-26T16:12:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:57 smithi196 ceph-mon[32572]: pgmap v8865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:57 smithi110 ceph-mon[28069]: pgmap v8865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:57 smithi193 ceph-mon[32782]: pgmap v8865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:12:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:12:58 smithi196 ceph-mon[32572]: pgmap v8866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:12:58 smithi110 ceph-mon[28069]: pgmap v8866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:12:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:12:58 smithi193 ceph-mon[32782]: pgmap v8866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:00 smithi196 ceph-mon[32572]: pgmap v8867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:00 smithi110 ceph-mon[28069]: pgmap v8867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:00 smithi193 ceph-mon[32782]: pgmap v8867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15897.108626 secs 2024-04-26T16:13:02.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15897.108626 secs 2024-04-26T16:13:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15897.108626 secs 2024-04-26T16:13:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:02 smithi196 ceph-mon[32572]: pgmap v8868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:02 smithi110 ceph-mon[28069]: pgmap v8868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:02 smithi193 ceph-mon[32782]: pgmap v8868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:04 smithi196 ceph-mon[32572]: pgmap v8869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:04 smithi110 ceph-mon[28069]: pgmap v8869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:04 smithi193 ceph-mon[32782]: pgmap v8869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15902.108741 secs 2024-04-26T16:13:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15902.108741 secs 2024-04-26T16:13:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15902.108741 secs 2024-04-26T16:13:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:07 smithi196 ceph-mon[32572]: pgmap v8870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:07 smithi110 ceph-mon[28069]: pgmap v8870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:07 smithi193 ceph-mon[32782]: pgmap v8870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:08 smithi196 ceph-mon[32572]: pgmap v8871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:08 smithi110 ceph-mon[28069]: pgmap v8871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:08 smithi193 ceph-mon[32782]: pgmap v8871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:10 smithi196 ceph-mon[32572]: pgmap v8872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:10 smithi110 ceph-mon[28069]: pgmap v8872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:10 smithi193 ceph-mon[32782]: pgmap v8872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:11 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 15907.108884 secs 2024-04-26T16:13:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:11 smithi196 ceph-mon[32572]: slow request 1444.126629 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:13:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:11 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 15907.108884 secs 2024-04-26T16:13:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:11 smithi110 ceph-mon[28069]: slow request 1444.126629 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:13:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:11 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 15907.108884 secs 2024-04-26T16:13:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:11 smithi193 ceph-mon[32782]: slow request 1444.126629 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:13:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:12 smithi196 ceph-mon[32572]: pgmap v8873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:12 smithi110 ceph-mon[28069]: pgmap v8873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:12 smithi193 ceph-mon[32782]: pgmap v8873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:14 smithi196 ceph-mon[32572]: pgmap v8874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:14 smithi110 ceph-mon[28069]: pgmap v8874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:14 smithi193 ceph-mon[32782]: pgmap v8874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15912.108978 secs 2024-04-26T16:13:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15912.108978 secs 2024-04-26T16:13:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15912.108978 secs 2024-04-26T16:13:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:17 smithi196 ceph-mon[32572]: pgmap v8875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:17 smithi110 ceph-mon[28069]: pgmap v8875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:17 smithi193 ceph-mon[32782]: pgmap v8875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:18 smithi196 ceph-mon[32572]: pgmap v8876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:18 smithi110 ceph-mon[28069]: pgmap v8876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:18 smithi193 ceph-mon[32782]: pgmap v8876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:20 smithi196 ceph-mon[32572]: pgmap v8877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:20 smithi110 ceph-mon[28069]: pgmap v8877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:20 smithi193 ceph-mon[32782]: pgmap v8877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15917.109104 secs 2024-04-26T16:13:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15917.109104 secs 2024-04-26T16:13:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15917.109104 secs 2024-04-26T16:13:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:22 smithi196 ceph-mon[32572]: pgmap v8878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:22 smithi110 ceph-mon[28069]: pgmap v8878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:22 smithi193 ceph-mon[32782]: pgmap v8878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:24 smithi196 ceph-mon[32572]: pgmap v8879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:24 smithi110 ceph-mon[28069]: pgmap v8879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:24 smithi193 ceph-mon[32782]: pgmap v8879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15922.109198 secs 2024-04-26T16:13:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15922.109198 secs 2024-04-26T16:13:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15922.109198 secs 2024-04-26T16:13:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:27 smithi196 ceph-mon[32572]: pgmap v8880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:27 smithi110 ceph-mon[28069]: pgmap v8880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:27 smithi193 ceph-mon[32782]: pgmap v8880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:28 smithi196 ceph-mon[32572]: pgmap v8881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:28 smithi110 ceph-mon[28069]: pgmap v8881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:28 smithi193 ceph-mon[32782]: pgmap v8881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:30 smithi196 ceph-mon[32572]: pgmap v8882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:30 smithi110 ceph-mon[28069]: pgmap v8882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:30 smithi193 ceph-mon[32782]: pgmap v8882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15927.109321 secs 2024-04-26T16:13:32.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15927.109321 secs 2024-04-26T16:13:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15927.109321 secs 2024-04-26T16:13:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:32 smithi196 ceph-mon[32572]: pgmap v8883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:32 smithi110 ceph-mon[28069]: pgmap v8883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:32 smithi193 ceph-mon[32782]: pgmap v8883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:35 smithi193 ceph-mon[32782]: pgmap v8884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:35 smithi196 ceph-mon[32572]: pgmap v8884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:35 smithi110 ceph-mon[28069]: pgmap v8884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15932.109390 secs 2024-04-26T16:13:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15932.109390 secs 2024-04-26T16:13:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15932.109390 secs 2024-04-26T16:13:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:37 smithi193 ceph-mon[32782]: pgmap v8885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:37 smithi196 ceph-mon[32572]: pgmap v8885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:37 smithi110 ceph-mon[28069]: pgmap v8885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:38 smithi196 ceph-mon[32572]: pgmap v8886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:38 smithi110 ceph-mon[28069]: pgmap v8886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:38 smithi193 ceph-mon[32782]: pgmap v8886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:40 smithi196 ceph-mon[32572]: pgmap v8887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:40 smithi110 ceph-mon[28069]: pgmap v8887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:40 smithi193 ceph-mon[32782]: pgmap v8887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15937.109530 secs 2024-04-26T16:13:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15937.109530 secs 2024-04-26T16:13:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15937.109530 secs 2024-04-26T16:13:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:42 smithi196 ceph-mon[32572]: pgmap v8888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:42 smithi110 ceph-mon[28069]: pgmap v8888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:42 smithi193 ceph-mon[32782]: pgmap v8888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:13:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:13:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:13:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:13:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:13:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:13:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:45 smithi196 ceph-mon[32572]: pgmap v8889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:13:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:45 smithi196 ceph-mon[32572]: pgmap v8890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:13:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:13:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:13:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:45 smithi110 ceph-mon[28069]: pgmap v8889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:13:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:45 smithi110 ceph-mon[28069]: pgmap v8890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:13:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:13:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:13:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:45 smithi193 ceph-mon[32782]: pgmap v8889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:13:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:45 smithi193 ceph-mon[32782]: pgmap v8890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:13:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15942.109662 secs 2024-04-26T16:13:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:47 smithi110 ceph-mon[28069]: pgmap v8891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15942.109662 secs 2024-04-26T16:13:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:47 smithi193 ceph-mon[32782]: pgmap v8891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15942.109662 secs 2024-04-26T16:13:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:47 smithi196 ceph-mon[32572]: pgmap v8891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:49.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:49 smithi110 ceph-mon[28069]: pgmap v8892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:49 smithi193 ceph-mon[32782]: pgmap v8892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:49 smithi196 ceph-mon[32572]: pgmap v8892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:51 smithi110 ceph-mon[28069]: pgmap v8893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:51 smithi193 ceph-mon[32782]: pgmap v8893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:51 smithi196 ceph-mon[32572]: pgmap v8893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15947.109812 secs 2024-04-26T16:13:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15947.109812 secs 2024-04-26T16:13:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15947.109812 secs 2024-04-26T16:13:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:53 smithi110 ceph-mon[28069]: pgmap v8894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:53 smithi193 ceph-mon[32782]: pgmap v8894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:53 smithi196 ceph-mon[32572]: pgmap v8894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:13:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:55 smithi110 ceph-mon[28069]: pgmap v8895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:13:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:55 smithi193 ceph-mon[32782]: pgmap v8895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:13:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:55 smithi196 ceph-mon[32572]: pgmap v8895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:13:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15952.109929 secs 2024-04-26T16:13:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:57 smithi193 ceph-mon[32782]: pgmap v8896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15952.109929 secs 2024-04-26T16:13:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:57 smithi196 ceph-mon[32572]: pgmap v8896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15952.109929 secs 2024-04-26T16:13:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:57 smithi110 ceph-mon[28069]: pgmap v8896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:13:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:13:59 smithi193 ceph-mon[32782]: pgmap v8897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:13:59 smithi196 ceph-mon[32572]: pgmap v8897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:13:59 smithi110 ceph-mon[28069]: pgmap v8897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:01 smithi193 ceph-mon[32782]: pgmap v8898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:01 smithi196 ceph-mon[32572]: pgmap v8898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:01 smithi110 ceph-mon[28069]: pgmap v8898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15957.110038 secs 2024-04-26T16:14:02.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15957.110038 secs 2024-04-26T16:14:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15957.110038 secs 2024-04-26T16:14:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:03 smithi193 ceph-mon[32782]: pgmap v8899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:03 smithi196 ceph-mon[32572]: pgmap v8899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:03 smithi110 ceph-mon[28069]: pgmap v8899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:05 smithi193 ceph-mon[32782]: pgmap v8900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:05 smithi196 ceph-mon[32572]: pgmap v8900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:05 smithi110 ceph-mon[28069]: pgmap v8900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15962.110153 secs 2024-04-26T16:14:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15962.110153 secs 2024-04-26T16:14:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15962.110153 secs 2024-04-26T16:14:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:07 smithi193 ceph-mon[32782]: pgmap v8901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:08.128 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:07 smithi110 ceph-mon[28069]: pgmap v8901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:07 smithi196 ceph-mon[32572]: pgmap v8901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:14:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:14:08.127+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:14:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:14:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:14:08.127+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:14:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:14:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:14:08.127+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:14:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:14:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:14:08.127+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:14:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:14:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:14:08.127+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:14:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:09 smithi193 ceph-mon[32782]: pgmap v8902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:09 smithi196 ceph-mon[32572]: pgmap v8902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:09 smithi110 ceph-mon[28069]: pgmap v8902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:11 smithi193 ceph-mon[32782]: pgmap v8903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:11 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15967.110265 secs 2024-04-26T16:14:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:11 smithi196 ceph-mon[32572]: pgmap v8903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:11 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15967.110265 secs 2024-04-26T16:14:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:11 smithi110 ceph-mon[28069]: pgmap v8903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:11 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15967.110265 secs 2024-04-26T16:14:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:13 smithi193 ceph-mon[32782]: pgmap v8904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:13 smithi196 ceph-mon[32572]: pgmap v8904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:13 smithi110 ceph-mon[28069]: pgmap v8904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:15 smithi193 ceph-mon[32782]: pgmap v8905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:15 smithi196 ceph-mon[32572]: pgmap v8905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:15 smithi110 ceph-mon[28069]: pgmap v8905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15972.110382 secs 2024-04-26T16:14:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15972.110382 secs 2024-04-26T16:14:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15972.110382 secs 2024-04-26T16:14:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:17 smithi196 ceph-mon[32572]: pgmap v8906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:17 smithi110 ceph-mon[28069]: pgmap v8906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:17 smithi193 ceph-mon[32782]: pgmap v8906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:19 smithi196 ceph-mon[32572]: pgmap v8907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:19 smithi110 ceph-mon[28069]: pgmap v8907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:19 smithi193 ceph-mon[32782]: pgmap v8907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:21 smithi196 ceph-mon[32572]: pgmap v8908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15977.110500 secs 2024-04-26T16:14:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:21 smithi110 ceph-mon[28069]: pgmap v8908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15977.110500 secs 2024-04-26T16:14:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:21 smithi193 ceph-mon[32782]: pgmap v8908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15977.110500 secs 2024-04-26T16:14:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:23 smithi196 ceph-mon[32572]: pgmap v8909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:23 smithi110 ceph-mon[28069]: pgmap v8909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:23 smithi193 ceph-mon[32782]: pgmap v8909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:14:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:25 smithi196 ceph-mon[32572]: pgmap v8910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:25 smithi110 ceph-mon[28069]: pgmap v8910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:25 smithi193 ceph-mon[32782]: pgmap v8910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15982.110616 secs 2024-04-26T16:14:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15982.110616 secs 2024-04-26T16:14:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15982.110616 secs 2024-04-26T16:14:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:27 smithi196 ceph-mon[32572]: pgmap v8911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:27 smithi110 ceph-mon[28069]: pgmap v8911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:27 smithi193 ceph-mon[32782]: pgmap v8911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:29 smithi196 ceph-mon[32572]: pgmap v8912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:29 smithi110 ceph-mon[28069]: pgmap v8912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:29 smithi193 ceph-mon[32782]: pgmap v8912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:32.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:31 smithi193 ceph-mon[32782]: pgmap v8913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:32.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15987.110741 secs 2024-04-26T16:14:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:31 smithi196 ceph-mon[32572]: pgmap v8913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15987.110741 secs 2024-04-26T16:14:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:31 smithi110 ceph-mon[28069]: pgmap v8913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15987.110741 secs 2024-04-26T16:14:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:33 smithi196 ceph-mon[32572]: pgmap v8914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:33 smithi110 ceph-mon[28069]: pgmap v8914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:33 smithi193 ceph-mon[32782]: pgmap v8914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:35 smithi196 ceph-mon[32572]: pgmap v8915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:35 smithi110 ceph-mon[28069]: pgmap v8915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:35 smithi193 ceph-mon[32782]: pgmap v8915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15992.110859 secs 2024-04-26T16:14:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15992.110859 secs 2024-04-26T16:14:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15992.110859 secs 2024-04-26T16:14:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:37 smithi196 ceph-mon[32572]: pgmap v8916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:37 smithi110 ceph-mon[28069]: pgmap v8916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:37 smithi193 ceph-mon[32782]: pgmap v8916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:38 smithi196 ceph-mon[32572]: pgmap v8917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:38 smithi110 ceph-mon[28069]: pgmap v8917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:38 smithi193 ceph-mon[32782]: pgmap v8917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:41 smithi110 ceph-mon[28069]: pgmap v8918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:41 smithi193 ceph-mon[32782]: pgmap v8918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:41 smithi196 ceph-mon[32572]: pgmap v8918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 15997.110995 secs 2024-04-26T16:14:42.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 15997.110995 secs 2024-04-26T16:14:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 15997.110995 secs 2024-04-26T16:14:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:43 smithi193 ceph-mon[32782]: pgmap v8919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:43 smithi196 ceph-mon[32572]: pgmap v8919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:43 smithi110 ceph-mon[28069]: pgmap v8919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:14:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:45 smithi193 ceph-mon[32782]: pgmap v8920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:14:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:45 smithi196 ceph-mon[32572]: pgmap v8920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:14:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:45 smithi110 ceph-mon[28069]: pgmap v8920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:14:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:14:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:14:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:14:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:14:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:14:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:14:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:14:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:14:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:14:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:14:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:47 smithi193 ceph-mon[32782]: pgmap v8921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T16:14:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:47 smithi193 ceph-mon[32782]: pgmap v8922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16002.111110 secs 2024-04-26T16:14:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:47 smithi196 ceph-mon[32572]: pgmap v8921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T16:14:48.189 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:47 smithi196 ceph-mon[32572]: pgmap v8922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:48.190 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16002.111110 secs 2024-04-26T16:14:48.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:47 smithi110 ceph-mon[28069]: pgmap v8921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T16:14:48.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:47 smithi110 ceph-mon[28069]: pgmap v8922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:48.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16002.111110 secs 2024-04-26T16:14:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:49 smithi193 ceph-mon[32782]: pgmap v8923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:49 smithi196 ceph-mon[32572]: pgmap v8923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:49 smithi110 ceph-mon[28069]: pgmap v8923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:51 smithi193 ceph-mon[32782]: pgmap v8924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:51 smithi196 ceph-mon[32572]: pgmap v8924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:51 smithi110 ceph-mon[28069]: pgmap v8924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16007.111249 secs 2024-04-26T16:14:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16007.111249 secs 2024-04-26T16:14:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16007.111249 secs 2024-04-26T16:14:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:53 smithi193 ceph-mon[32782]: pgmap v8925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:14:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:53 smithi196 ceph-mon[32572]: pgmap v8925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:14:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:53 smithi110 ceph-mon[28069]: pgmap v8925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:14:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:55 smithi193 ceph-mon[32782]: pgmap v8926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:55 smithi196 ceph-mon[32572]: pgmap v8926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:55 smithi110 ceph-mon[28069]: pgmap v8926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:14:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:57 smithi193 ceph-mon[32782]: pgmap v8927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:14:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16012.111364 secs 2024-04-26T16:14:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:57 smithi196 ceph-mon[32572]: pgmap v8927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:14:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16012.111364 secs 2024-04-26T16:14:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:57 smithi110 ceph-mon[28069]: pgmap v8927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:14:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16012.111364 secs 2024-04-26T16:14:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:14:59 smithi193 ceph-mon[32782]: pgmap v8928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:14:59 smithi196 ceph-mon[32572]: pgmap v8928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:14:59 smithi110 ceph-mon[28069]: pgmap v8928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:01 smithi193 ceph-mon[32782]: pgmap v8929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16017.111502 secs 2024-04-26T16:15:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:01 smithi196 ceph-mon[32572]: pgmap v8929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16017.111502 secs 2024-04-26T16:15:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:01 smithi110 ceph-mon[28069]: pgmap v8929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16017.111502 secs 2024-04-26T16:15:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:03 smithi193 ceph-mon[32782]: pgmap v8930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:03 smithi196 ceph-mon[32572]: pgmap v8930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:03 smithi110 ceph-mon[28069]: pgmap v8930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:05 smithi193 ceph-mon[32782]: pgmap v8931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:15:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:05 smithi196 ceph-mon[32572]: pgmap v8931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:15:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:05 smithi110 ceph-mon[28069]: pgmap v8931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:15:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16022.111639 secs 2024-04-26T16:15:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16022.111639 secs 2024-04-26T16:15:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16022.111639 secs 2024-04-26T16:15:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:07 smithi193 ceph-mon[32782]: pgmap v8932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:15:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:07 smithi196 ceph-mon[32572]: pgmap v8932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:15:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:07 smithi110 ceph-mon[28069]: pgmap v8932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:15:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:09 smithi196 ceph-mon[32572]: pgmap v8933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:15:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:09 smithi110 ceph-mon[28069]: pgmap v8933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:15:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:09 smithi193 ceph-mon[32782]: pgmap v8933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:15:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:11 smithi196 ceph-mon[32572]: pgmap v8934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:15:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:11 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 16027.111751 secs 2024-04-26T16:15:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:11 smithi196 ceph-mon[32572]: slow request 363.497576 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:15:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:11 smithi110 ceph-mon[28069]: pgmap v8934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:15:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:11 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 16027.111751 secs 2024-04-26T16:15:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:11 smithi110 ceph-mon[28069]: slow request 363.497576 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:15:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:11 smithi193 ceph-mon[32782]: pgmap v8934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:15:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:11 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 16027.111751 secs 2024-04-26T16:15:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:11 smithi193 ceph-mon[32782]: slow request 363.497576 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:15:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:13 smithi196 ceph-mon[32572]: pgmap v8935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:15:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:13 smithi110 ceph-mon[28069]: pgmap v8935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:15:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:13 smithi193 ceph-mon[32782]: pgmap v8935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:15:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:15 smithi196 ceph-mon[32572]: pgmap v8936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:15:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:15 smithi110 ceph-mon[28069]: pgmap v8936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:15:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:15 smithi193 ceph-mon[32782]: pgmap v8936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:15:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16032.111812 secs 2024-04-26T16:15:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16032.111812 secs 2024-04-26T16:15:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16032.111812 secs 2024-04-26T16:15:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:17 smithi196 ceph-mon[32572]: pgmap v8937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:17 smithi110 ceph-mon[28069]: pgmap v8937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:17 smithi193 ceph-mon[32782]: pgmap v8937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:15:19.010+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:15:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:15:19.010+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T16:15:19.014 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:15:19.011+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 126 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T16:15:19.015 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:15:19.011+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 126 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:15:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:19 smithi196 ceph-mon[32572]: pgmap v8938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:19 smithi110 ceph-mon[28069]: pgmap v8938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:19 smithi193 ceph-mon[32782]: pgmap v8938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:21 smithi196 ceph-mon[32572]: pgmap v8939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16037.111924 secs 2024-04-26T16:15:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:21 smithi110 ceph-mon[28069]: pgmap v8939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16037.111924 secs 2024-04-26T16:15:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:21 smithi193 ceph-mon[32782]: pgmap v8939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16037.111924 secs 2024-04-26T16:15:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:23 smithi196 ceph-mon[32572]: pgmap v8940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:23 smithi110 ceph-mon[28069]: pgmap v8940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:23 smithi193 ceph-mon[32782]: pgmap v8940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:25 smithi196 ceph-mon[32572]: pgmap v8941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:25 smithi110 ceph-mon[28069]: pgmap v8941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:25 smithi193 ceph-mon[32782]: pgmap v8941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16042.112005 secs 2024-04-26T16:15:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16042.112005 secs 2024-04-26T16:15:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16042.112005 secs 2024-04-26T16:15:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:27 smithi196 ceph-mon[32572]: pgmap v8942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:27 smithi110 ceph-mon[28069]: pgmap v8942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:27 smithi193 ceph-mon[32782]: pgmap v8942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:29 smithi196 ceph-mon[32572]: pgmap v8943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:29 smithi110 ceph-mon[28069]: pgmap v8943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:29 smithi193 ceph-mon[32782]: pgmap v8943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:31 smithi196 ceph-mon[32572]: pgmap v8944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16047.112083 secs 2024-04-26T16:15:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:31 smithi110 ceph-mon[28069]: pgmap v8944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16047.112083 secs 2024-04-26T16:15:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:31 smithi193 ceph-mon[32782]: pgmap v8944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16047.112083 secs 2024-04-26T16:15:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:33 smithi196 ceph-mon[32572]: pgmap v8945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:33 smithi110 ceph-mon[28069]: pgmap v8945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:33 smithi193 ceph-mon[32782]: pgmap v8945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:35 smithi196 ceph-mon[32572]: pgmap v8946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:35 smithi110 ceph-mon[28069]: pgmap v8946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:35 smithi193 ceph-mon[32782]: pgmap v8946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:37 smithi110 ceph-mon[28069]: pgmap v8947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16052.112217 secs 2024-04-26T16:15:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:37 smithi193 ceph-mon[32782]: pgmap v8947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16052.112217 secs 2024-04-26T16:15:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:37 smithi196 ceph-mon[32572]: pgmap v8947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16052.112217 secs 2024-04-26T16:15:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:39 smithi110 ceph-mon[28069]: pgmap v8948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:39 smithi193 ceph-mon[32782]: pgmap v8948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:39 smithi196 ceph-mon[32572]: pgmap v8948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:41 smithi110 ceph-mon[28069]: pgmap v8949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:41 smithi193 ceph-mon[32782]: pgmap v8949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:41 smithi196 ceph-mon[32572]: pgmap v8949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16057.112358 secs 2024-04-26T16:15:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16057.112358 secs 2024-04-26T16:15:42.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16057.112358 secs 2024-04-26T16:15:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:43 smithi110 ceph-mon[28069]: pgmap v8950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:43 smithi193 ceph-mon[32782]: pgmap v8950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:43 smithi196 ceph-mon[32572]: pgmap v8950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:45 smithi110 ceph-mon[28069]: pgmap v8951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:45 smithi193 ceph-mon[32782]: pgmap v8951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:45 smithi196 ceph-mon[32572]: pgmap v8951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:15:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:47 smithi193 ceph-mon[32782]: pgmap v8952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:15:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16062.112453 secs 2024-04-26T16:15:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:47 smithi196 ceph-mon[32572]: pgmap v8952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:15:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16062.112453 secs 2024-04-26T16:15:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:47 smithi110 ceph-mon[28069]: pgmap v8952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:15:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:15:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16062.112453 secs 2024-04-26T16:15:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:15:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:15:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:48 smithi193 ceph-mon[32782]: pgmap v8953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:15:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:48 smithi193 ceph-mon[32782]: pgmap v8954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:15:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:15:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:15:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:48 smithi196 ceph-mon[32572]: pgmap v8953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:15:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:48 smithi196 ceph-mon[32572]: pgmap v8954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:15:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:15:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:15:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:48 smithi110 ceph-mon[28069]: pgmap v8953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:15:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:48 smithi110 ceph-mon[28069]: pgmap v8954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:15:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:50 smithi110 ceph-mon[28069]: pgmap v8955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:50 smithi193 ceph-mon[32782]: pgmap v8955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:50 smithi196 ceph-mon[32572]: pgmap v8955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16067.112530 secs 2024-04-26T16:15:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:52 smithi193 ceph-mon[32782]: pgmap v8956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16067.112530 secs 2024-04-26T16:15:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:52 smithi196 ceph-mon[32572]: pgmap v8956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16067.112530 secs 2024-04-26T16:15:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:52 smithi110 ceph-mon[28069]: pgmap v8956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:54 smithi193 ceph-mon[32782]: pgmap v8957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:54 smithi196 ceph-mon[32572]: pgmap v8957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:54 smithi110 ceph-mon[28069]: pgmap v8957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:56 smithi193 ceph-mon[32782]: pgmap v8958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:56 smithi196 ceph-mon[32572]: pgmap v8958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:56 smithi110 ceph-mon[28069]: pgmap v8958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:15:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16072.112638 secs 2024-04-26T16:15:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16072.112638 secs 2024-04-26T16:15:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16072.112638 secs 2024-04-26T16:15:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:15:58 smithi193 ceph-mon[32782]: pgmap v8959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:15:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:15:58 smithi196 ceph-mon[32572]: pgmap v8959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:15:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:15:58 smithi110 ceph-mon[28069]: pgmap v8959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:16:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:00 smithi193 ceph-mon[32782]: pgmap v8960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:00 smithi196 ceph-mon[32572]: pgmap v8960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:00 smithi110 ceph-mon[28069]: pgmap v8960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16077.112719 secs 2024-04-26T16:16:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:02 smithi193 ceph-mon[32782]: pgmap v8961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16077.112719 secs 2024-04-26T16:16:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:02 smithi196 ceph-mon[32572]: pgmap v8961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16077.112719 secs 2024-04-26T16:16:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:02 smithi110 ceph-mon[28069]: pgmap v8961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:04.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:04 smithi110 ceph-mon[28069]: pgmap v8962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:04 smithi193 ceph-mon[32782]: pgmap v8962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:04 smithi196 ceph-mon[32572]: pgmap v8962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:06 smithi193 ceph-mon[32782]: pgmap v8963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:06 smithi196 ceph-mon[32572]: pgmap v8963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:06 smithi110 ceph-mon[28069]: pgmap v8963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:07 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 16082.112833 secs 2024-04-26T16:16:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:07 smithi193 ceph-mon[32782]: slow request 11523.940433 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:16:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:07 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 16082.112833 secs 2024-04-26T16:16:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:07 smithi196 ceph-mon[32572]: slow request 11523.940433 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:16:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:07 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 16082.112833 secs 2024-04-26T16:16:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:07 smithi110 ceph-mon[28069]: slow request 11523.940433 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:16:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:08 smithi193 ceph-mon[32782]: pgmap v8964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:08 smithi196 ceph-mon[32572]: pgmap v8964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:08 smithi110 ceph-mon[28069]: pgmap v8964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:10 smithi193 ceph-mon[32782]: pgmap v8965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:10 smithi196 ceph-mon[32572]: pgmap v8965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:10 smithi110 ceph-mon[28069]: pgmap v8965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 16087.112955 secs 2024-04-26T16:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:12 smithi193 ceph-mon[32782]: slow request 723.590220 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:12 smithi193 ceph-mon[32782]: pgmap v8966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 16087.112955 secs 2024-04-26T16:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:12 smithi196 ceph-mon[32572]: slow request 723.590220 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:12 smithi196 ceph-mon[32572]: pgmap v8966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 16087.112955 secs 2024-04-26T16:16:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:12 smithi110 ceph-mon[28069]: slow request 723.590220 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:16:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:12 smithi110 ceph-mon[28069]: pgmap v8966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:14 smithi193 ceph-mon[32782]: pgmap v8967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:14 smithi196 ceph-mon[32572]: pgmap v8967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:14 smithi110 ceph-mon[28069]: pgmap v8967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:16 smithi196 ceph-mon[32572]: pgmap v8968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16092.113089 secs 2024-04-26T16:16:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:16 smithi110 ceph-mon[28069]: pgmap v8968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16092.113089 secs 2024-04-26T16:16:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:16 smithi193 ceph-mon[32782]: pgmap v8968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16092.113089 secs 2024-04-26T16:16:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:18 smithi196 ceph-mon[32572]: pgmap v8969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:18 smithi110 ceph-mon[28069]: pgmap v8969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:18 smithi193 ceph-mon[32782]: pgmap v8969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:20 smithi196 ceph-mon[32572]: pgmap v8970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:20 smithi110 ceph-mon[28069]: pgmap v8970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:20 smithi193 ceph-mon[32782]: pgmap v8970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16097.113208 secs 2024-04-26T16:16:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16097.113208 secs 2024-04-26T16:16:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16097.113208 secs 2024-04-26T16:16:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:22 smithi196 ceph-mon[32572]: pgmap v8971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:22 smithi110 ceph-mon[28069]: pgmap v8971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:22 smithi193 ceph-mon[32782]: pgmap v8971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:24 smithi196 ceph-mon[32572]: pgmap v8972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:24 smithi110 ceph-mon[28069]: pgmap v8972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:24 smithi193 ceph-mon[32782]: pgmap v8972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:26 smithi196 ceph-mon[32572]: pgmap v8973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16102.113315 secs 2024-04-26T16:16:27.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:26 smithi110 ceph-mon[28069]: pgmap v8973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:27.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16102.113315 secs 2024-04-26T16:16:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:26 smithi193 ceph-mon[32782]: pgmap v8973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16102.113315 secs 2024-04-26T16:16:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:28 smithi196 ceph-mon[32572]: pgmap v8974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:28 smithi110 ceph-mon[28069]: pgmap v8974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:28 smithi193 ceph-mon[32782]: pgmap v8974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:30 smithi196 ceph-mon[32572]: pgmap v8975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:30 smithi110 ceph-mon[28069]: pgmap v8975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:30 smithi193 ceph-mon[32782]: pgmap v8975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16107.113449 secs 2024-04-26T16:16:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16107.113449 secs 2024-04-26T16:16:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16107.113449 secs 2024-04-26T16:16:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:32 smithi196 ceph-mon[32572]: pgmap v8976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:32 smithi110 ceph-mon[28069]: pgmap v8976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:32 smithi193 ceph-mon[32782]: pgmap v8976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:34 smithi196 ceph-mon[32572]: pgmap v8977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:34 smithi110 ceph-mon[28069]: pgmap v8977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:34 smithi193 ceph-mon[32782]: pgmap v8977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:36 smithi196 ceph-mon[32572]: pgmap v8978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16112.113590 secs 2024-04-26T16:16:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:36 smithi110 ceph-mon[28069]: pgmap v8978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16112.113590 secs 2024-04-26T16:16:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:36 smithi193 ceph-mon[32782]: pgmap v8978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:16:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16112.113590 secs 2024-04-26T16:16:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:38 smithi196 ceph-mon[32572]: pgmap v8979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:38 smithi110 ceph-mon[28069]: pgmap v8979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:38 smithi193 ceph-mon[32782]: pgmap v8979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:40 smithi196 ceph-mon[32572]: pgmap v8980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:16:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:40 smithi110 ceph-mon[28069]: pgmap v8980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:16:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:40 smithi193 ceph-mon[32782]: pgmap v8980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:16:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16117.113679 secs 2024-04-26T16:16:42.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16117.113679 secs 2024-04-26T16:16:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16117.113679 secs 2024-04-26T16:16:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:42 smithi196 ceph-mon[32572]: pgmap v8981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:16:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:42 smithi110 ceph-mon[28069]: pgmap v8981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:16:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:42 smithi193 ceph-mon[32782]: pgmap v8981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:16:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:44 smithi196 ceph-mon[32572]: pgmap v8982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:44 smithi110 ceph-mon[28069]: pgmap v8982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:44 smithi193 ceph-mon[32782]: pgmap v8982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:46 smithi196 ceph-mon[32572]: pgmap v8983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:16:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16122.113789 secs 2024-04-26T16:16:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:46 smithi110 ceph-mon[28069]: pgmap v8983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:16:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16122.113789 secs 2024-04-26T16:16:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:46 smithi193 ceph-mon[32782]: pgmap v8983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:16:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16122.113789 secs 2024-04-26T16:16:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:48 smithi196 ceph-mon[32572]: pgmap v8984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:16:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:48 smithi110 ceph-mon[28069]: pgmap v8984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:16:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:48 smithi193 ceph-mon[32782]: pgmap v8984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:16:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:16:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:16:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:16:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:16:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:16:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:16:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:16:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:16:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:16:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:16:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:50 smithi196 ceph-mon[32572]: pgmap v8985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:16:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:50 smithi196 ceph-mon[32572]: pgmap v8986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:50 smithi110 ceph-mon[28069]: pgmap v8985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:16:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:50 smithi110 ceph-mon[28069]: pgmap v8986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:50 smithi193 ceph-mon[32782]: pgmap v8985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:16:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:50 smithi193 ceph-mon[32782]: pgmap v8986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16127.113910 secs 2024-04-26T16:16:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16127.113910 secs 2024-04-26T16:16:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16127.113910 secs 2024-04-26T16:16:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:52 smithi196 ceph-mon[32572]: pgmap v8987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:52 smithi110 ceph-mon[28069]: pgmap v8987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:52 smithi193 ceph-mon[32782]: pgmap v8987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:54 smithi110 ceph-mon[28069]: pgmap v8988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:54 smithi193 ceph-mon[32782]: pgmap v8988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:54 smithi196 ceph-mon[32572]: pgmap v8988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:56 smithi110 ceph-mon[28069]: pgmap v8989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16132.114025 secs 2024-04-26T16:16:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:56 smithi193 ceph-mon[32782]: pgmap v8989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16132.114025 secs 2024-04-26T16:16:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:56 smithi196 ceph-mon[32572]: pgmap v8989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:16:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16132.114025 secs 2024-04-26T16:16:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:16:58 smithi110 ceph-mon[28069]: pgmap v8990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:16:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:16:58 smithi193 ceph-mon[32782]: pgmap v8990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:16:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:16:58 smithi196 ceph-mon[32572]: pgmap v8990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:17:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:00 smithi110 ceph-mon[28069]: pgmap v8991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:17:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:00 smithi193 ceph-mon[32782]: pgmap v8991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:17:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:00 smithi196 ceph-mon[32572]: pgmap v8991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:17:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16137.114141 secs 2024-04-26T16:17:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16137.114141 secs 2024-04-26T16:17:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16137.114141 secs 2024-04-26T16:17:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:02 smithi110 ceph-mon[28069]: pgmap v8992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:02 smithi193 ceph-mon[32782]: pgmap v8992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:02 smithi196 ceph-mon[32572]: pgmap v8992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:04 smithi193 ceph-mon[32782]: pgmap v8993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:04 smithi196 ceph-mon[32572]: pgmap v8993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:04 smithi110 ceph-mon[28069]: pgmap v8993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:06 smithi193 ceph-mon[32782]: pgmap v8994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16142.114219 secs 2024-04-26T16:17:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:06 smithi196 ceph-mon[32572]: pgmap v8994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16142.114219 secs 2024-04-26T16:17:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:06 smithi110 ceph-mon[28069]: pgmap v8994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16142.114219 secs 2024-04-26T16:17:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:08 smithi193 ceph-mon[32782]: pgmap v8995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:08 smithi196 ceph-mon[32572]: pgmap v8995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:08 smithi110 ceph-mon[28069]: pgmap v8995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:10 smithi193 ceph-mon[32782]: pgmap v8996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:10 smithi196 ceph-mon[32572]: pgmap v8996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:10 smithi110 ceph-mon[28069]: pgmap v8996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:11 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 16147.114331 secs 2024-04-26T16:17:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:11 smithi193 ceph-mon[32782]: slow request 2884.739215 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:17:12.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:11 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 16147.114331 secs 2024-04-26T16:17:12.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:11 smithi196 ceph-mon[32572]: slow request 2884.739215 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:17:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:11 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 16147.114331 secs 2024-04-26T16:17:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:11 smithi110 ceph-mon[28069]: slow request 2884.739215 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:17:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:12 smithi193 ceph-mon[32782]: pgmap v8997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:12 smithi196 ceph-mon[32572]: pgmap v8997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:12 smithi110 ceph-mon[28069]: pgmap v8997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:14 smithi193 ceph-mon[32782]: pgmap v8998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:14 smithi196 ceph-mon[32572]: pgmap v8998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:14 smithi110 ceph-mon[28069]: pgmap v8998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:16 smithi193 ceph-mon[32782]: pgmap v8999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16152.114465 secs 2024-04-26T16:17:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:16 smithi196 ceph-mon[32572]: pgmap v8999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16152.114465 secs 2024-04-26T16:17:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:16 smithi110 ceph-mon[28069]: pgmap v8999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16152.114465 secs 2024-04-26T16:17:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:18 smithi193 ceph-mon[32782]: pgmap v9000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:18 smithi196 ceph-mon[32572]: pgmap v9000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:18 smithi110 ceph-mon[28069]: pgmap v9000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:20 smithi193 ceph-mon[32782]: pgmap v9001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:20 smithi196 ceph-mon[32572]: pgmap v9001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:20 smithi110 ceph-mon[28069]: pgmap v9001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16157.114602 secs 2024-04-26T16:17:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16157.114602 secs 2024-04-26T16:17:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16157.114602 secs 2024-04-26T16:17:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:22 smithi193 ceph-mon[32782]: pgmap v9002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:22 smithi196 ceph-mon[32572]: pgmap v9002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:22 smithi110 ceph-mon[28069]: pgmap v9002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:24 smithi193 ceph-mon[32782]: pgmap v9003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:24 smithi196 ceph-mon[32572]: pgmap v9003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:24 smithi110 ceph-mon[28069]: pgmap v9003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:26 smithi193 ceph-mon[32782]: pgmap v9004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16162.114691 secs 2024-04-26T16:17:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:26 smithi196 ceph-mon[32572]: pgmap v9004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16162.114691 secs 2024-04-26T16:17:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:26 smithi110 ceph-mon[28069]: pgmap v9004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16162.114691 secs 2024-04-26T16:17:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:28 smithi193 ceph-mon[32782]: pgmap v9005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:29.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:28 smithi196 ceph-mon[32572]: pgmap v9005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:28 smithi110 ceph-mon[28069]: pgmap v9005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:30 smithi196 ceph-mon[32572]: pgmap v9006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:30 smithi110 ceph-mon[28069]: pgmap v9006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:30 smithi193 ceph-mon[32782]: pgmap v9006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16167.114785 secs 2024-04-26T16:17:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16167.114785 secs 2024-04-26T16:17:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16167.114785 secs 2024-04-26T16:17:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:32 smithi196 ceph-mon[32572]: pgmap v9007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:32 smithi110 ceph-mon[28069]: pgmap v9007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:32 smithi193 ceph-mon[32782]: pgmap v9007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:35.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:34 smithi193 ceph-mon[32782]: pgmap v9008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:34 smithi196 ceph-mon[32572]: pgmap v9008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:34 smithi110 ceph-mon[28069]: pgmap v9008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:36 smithi196 ceph-mon[32572]: pgmap v9009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16172.114906 secs 2024-04-26T16:17:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:36 smithi110 ceph-mon[28069]: pgmap v9009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16172.114906 secs 2024-04-26T16:17:37.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:36 smithi193 ceph-mon[32782]: pgmap v9009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:37.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16172.114906 secs 2024-04-26T16:17:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:38 smithi196 ceph-mon[32572]: pgmap v9010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:38 smithi110 ceph-mon[28069]: pgmap v9010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:38 smithi193 ceph-mon[32782]: pgmap v9010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:40 smithi196 ceph-mon[32572]: pgmap v9011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:40 smithi110 ceph-mon[28069]: pgmap v9011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:40 smithi193 ceph-mon[32782]: pgmap v9011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16177.115028 secs 2024-04-26T16:17:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16177.115028 secs 2024-04-26T16:17:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16177.115028 secs 2024-04-26T16:17:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:42 smithi196 ceph-mon[32572]: pgmap v9012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:42 smithi110 ceph-mon[28069]: pgmap v9012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:42 smithi193 ceph-mon[32782]: pgmap v9012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:44 smithi196 ceph-mon[32572]: pgmap v9013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:44 smithi110 ceph-mon[28069]: pgmap v9013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:44 smithi193 ceph-mon[32782]: pgmap v9013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:46 smithi196 ceph-mon[32572]: pgmap v9014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16182.115153 secs 2024-04-26T16:17:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:46 smithi110 ceph-mon[28069]: pgmap v9014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16182.115153 secs 2024-04-26T16:17:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:46 smithi193 ceph-mon[32782]: pgmap v9014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16182.115153 secs 2024-04-26T16:17:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:48 smithi196 ceph-mon[32572]: pgmap v9015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:48 smithi110 ceph-mon[28069]: pgmap v9015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:48 smithi193 ceph-mon[32782]: pgmap v9015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:17:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:17:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:17:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:17:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:50 smithi196 ceph-mon[32572]: pgmap v9016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:17:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:17:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:17:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:50 smithi110 ceph-mon[28069]: pgmap v9016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:17:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:17:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:17:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:50 smithi193 ceph-mon[32782]: pgmap v9016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:17:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:17:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:17:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:17:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:51 smithi196 ceph-mon[32572]: pgmap v9017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T16:17:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:51 smithi196 ceph-mon[32572]: pgmap v9018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16187.115278 secs 2024-04-26T16:17:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:51 smithi110 ceph-mon[28069]: pgmap v9017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T16:17:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:51 smithi110 ceph-mon[28069]: pgmap v9018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16187.115278 secs 2024-04-26T16:17:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:51 smithi193 ceph-mon[32782]: pgmap v9017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T16:17:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:51 smithi193 ceph-mon[32782]: pgmap v9018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16187.115278 secs 2024-04-26T16:17:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:53 smithi196 ceph-mon[32572]: pgmap v9019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:53 smithi110 ceph-mon[28069]: pgmap v9019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:53 smithi193 ceph-mon[32782]: pgmap v9019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:55 smithi196 ceph-mon[32572]: pgmap v9020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:55 smithi110 ceph-mon[28069]: pgmap v9020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:55 smithi193 ceph-mon[32782]: pgmap v9020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16192.115393 secs 2024-04-26T16:17:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16192.115393 secs 2024-04-26T16:17:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16192.115393 secs 2024-04-26T16:17:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:57 smithi196 ceph-mon[32572]: pgmap v9021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:57 smithi110 ceph-mon[28069]: pgmap v9021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:57 smithi193 ceph-mon[32782]: pgmap v9021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:17:58 smithi196 ceph-mon[32572]: pgmap v9022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:17:58 smithi110 ceph-mon[28069]: pgmap v9022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:17:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:17:58 smithi193 ceph-mon[32782]: pgmap v9022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:18:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:01 smithi196 ceph-mon[32572]: pgmap v9023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:18:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16197.115510 secs 2024-04-26T16:18:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:01 smithi110 ceph-mon[28069]: pgmap v9023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:18:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16197.115510 secs 2024-04-26T16:18:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:01 smithi193 ceph-mon[32782]: pgmap v9023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:18:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16197.115510 secs 2024-04-26T16:18:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:03 smithi196 ceph-mon[32572]: pgmap v9024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:03 smithi110 ceph-mon[28069]: pgmap v9024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:03 smithi193 ceph-mon[32782]: pgmap v9024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:05 smithi196 ceph-mon[32572]: pgmap v9025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:05 smithi110 ceph-mon[28069]: pgmap v9025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:05 smithi193 ceph-mon[32782]: pgmap v9025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16202.115627 secs 2024-04-26T16:18:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16202.115627 secs 2024-04-26T16:18:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16202.115627 secs 2024-04-26T16:18:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:07 smithi196 ceph-mon[32572]: pgmap v9026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:07 smithi110 ceph-mon[28069]: pgmap v9026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:07 smithi193 ceph-mon[32782]: pgmap v9026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:09 smithi196 ceph-mon[32572]: pgmap v9027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:09 smithi110 ceph-mon[28069]: pgmap v9027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:09 smithi193 ceph-mon[32782]: pgmap v9027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:11 smithi196 ceph-mon[32572]: pgmap v9028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:11 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 16207.115743 secs 2024-04-26T16:18:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:11 smithi196 ceph-mon[32572]: slow request 1443.908229 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:18:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:11 smithi110 ceph-mon[28069]: pgmap v9028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:11 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 16207.115743 secs 2024-04-26T16:18:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:11 smithi110 ceph-mon[28069]: slow request 1443.908229 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:18:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:11 smithi193 ceph-mon[32782]: pgmap v9028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:11 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 16207.115743 secs 2024-04-26T16:18:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:11 smithi193 ceph-mon[32782]: slow request 1443.908229 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:18:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:13 smithi196 ceph-mon[32572]: pgmap v9029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:13 smithi110 ceph-mon[28069]: pgmap v9029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:13 smithi193 ceph-mon[32782]: pgmap v9029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:15 smithi196 ceph-mon[32572]: pgmap v9030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:15 smithi110 ceph-mon[28069]: pgmap v9030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:15 smithi193 ceph-mon[32782]: pgmap v9030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.419+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T16:18:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.419+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T16:18:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.419+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261405a000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T16:18:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.419+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261405a000 comp rx=0 tx=0).stop 2024-04-26T16:18:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.419+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T16:18:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.419+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T16:18:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.419+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T16:18:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.419+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T16:18:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.420+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T16:18:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.420+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T16:18:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.420+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T16:18:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.420+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T16:18:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.420+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T16:18:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.421+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T16:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.422+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e050 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T16:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.422+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T16:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:16.422+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T16:18:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16212.115853 secs 2024-04-26T16:18:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16212.115853 secs 2024-04-26T16:18:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16212.115853 secs 2024-04-26T16:18:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:17 smithi196 ceph-mon[32572]: pgmap v9031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:17 smithi110 ceph-mon[28069]: pgmap v9031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:17 smithi193 ceph-mon[32782]: pgmap v9031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:19.042+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T16:18:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:19.042+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:18:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:19.043+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 127 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:18:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:18:19.043+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 127 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T16:18:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:19 smithi196 ceph-mon[32572]: pgmap v9032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:19 smithi110 ceph-mon[28069]: pgmap v9032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:19 smithi193 ceph-mon[32782]: pgmap v9032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:21 smithi196 ceph-mon[32572]: pgmap v9033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16217.115967 secs 2024-04-26T16:18:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:21 smithi110 ceph-mon[28069]: pgmap v9033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16217.115967 secs 2024-04-26T16:18:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:21 smithi193 ceph-mon[32782]: pgmap v9033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16217.115967 secs 2024-04-26T16:18:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:23 smithi196 ceph-mon[32572]: pgmap v9034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:23 smithi110 ceph-mon[28069]: pgmap v9034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:23 smithi193 ceph-mon[32782]: pgmap v9034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:25 smithi196 ceph-mon[32572]: pgmap v9035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:25 smithi110 ceph-mon[28069]: pgmap v9035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:25 smithi193 ceph-mon[32782]: pgmap v9035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16222.116083 secs 2024-04-26T16:18:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16222.116083 secs 2024-04-26T16:18:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16222.116083 secs 2024-04-26T16:18:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:27 smithi196 ceph-mon[32572]: pgmap v9036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:27 smithi110 ceph-mon[28069]: pgmap v9036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:27 smithi193 ceph-mon[32782]: pgmap v9036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:29 smithi196 ceph-mon[32572]: pgmap v9037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:29 smithi110 ceph-mon[28069]: pgmap v9037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:29 smithi193 ceph-mon[32782]: pgmap v9037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:31 smithi196 ceph-mon[32572]: pgmap v9038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16227.116164 secs 2024-04-26T16:18:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:31 smithi110 ceph-mon[28069]: pgmap v9038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16227.116164 secs 2024-04-26T16:18:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:31 smithi193 ceph-mon[32782]: pgmap v9038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16227.116164 secs 2024-04-26T16:18:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:33 smithi196 ceph-mon[32572]: pgmap v9039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:33 smithi110 ceph-mon[28069]: pgmap v9039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:33 smithi193 ceph-mon[32782]: pgmap v9039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:35.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:35 smithi193 ceph-mon[32782]: pgmap v9040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:35 smithi196 ceph-mon[32572]: pgmap v9040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:35 smithi110 ceph-mon[28069]: pgmap v9040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:36.941 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16232.116280 secs 2024-04-26T16:18:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16232.116280 secs 2024-04-26T16:18:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16232.116280 secs 2024-04-26T16:18:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:37 smithi196 ceph-mon[32572]: pgmap v9041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:37 smithi110 ceph-mon[28069]: pgmap v9041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:37 smithi193 ceph-mon[32782]: pgmap v9041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:39 smithi196 ceph-mon[32572]: pgmap v9042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:39 smithi110 ceph-mon[28069]: pgmap v9042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:39 smithi193 ceph-mon[32782]: pgmap v9042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:41 smithi196 ceph-mon[32572]: pgmap v9043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16237.116398 secs 2024-04-26T16:18:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:41 smithi110 ceph-mon[28069]: pgmap v9043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16237.116398 secs 2024-04-26T16:18:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:41 smithi193 ceph-mon[32782]: pgmap v9043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16237.116398 secs 2024-04-26T16:18:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:43 smithi196 ceph-mon[32572]: pgmap v9044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:43 smithi110 ceph-mon[28069]: pgmap v9044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:43 smithi193 ceph-mon[32782]: pgmap v9044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:45 smithi196 ceph-mon[32572]: pgmap v9045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:45 smithi110 ceph-mon[28069]: pgmap v9045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:45 smithi193 ceph-mon[32782]: pgmap v9045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16242.116533 secs 2024-04-26T16:18:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16242.116533 secs 2024-04-26T16:18:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16242.116533 secs 2024-04-26T16:18:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:47 smithi196 ceph-mon[32572]: pgmap v9046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:47 smithi110 ceph-mon[28069]: pgmap v9046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:47 smithi193 ceph-mon[32782]: pgmap v9046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:49 smithi196 ceph-mon[32572]: pgmap v9047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:49 smithi110 ceph-mon[28069]: pgmap v9047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:49 smithi193 ceph-mon[32782]: pgmap v9047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:18:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:51 smithi196 ceph-mon[32572]: pgmap v9048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:18:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16247.116606 secs 2024-04-26T16:18:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:51 smithi110 ceph-mon[28069]: pgmap v9048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:18:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16247.116606 secs 2024-04-26T16:18:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:51 smithi193 ceph-mon[32782]: pgmap v9048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:18:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:18:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16247.116606 secs 2024-04-26T16:18:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:18:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:18:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:18:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:18:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:18:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:18:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:18:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:18:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:18:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:53 smithi196 ceph-mon[32572]: pgmap v9049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:18:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:53 smithi196 ceph-mon[32572]: pgmap v9050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:18:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:53 smithi110 ceph-mon[28069]: pgmap v9049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:18:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:53 smithi110 ceph-mon[28069]: pgmap v9050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:18:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:53 smithi193 ceph-mon[32782]: pgmap v9049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:18:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:53 smithi193 ceph-mon[32782]: pgmap v9050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:18:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:55 smithi196 ceph-mon[32572]: pgmap v9051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:18:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:55 smithi110 ceph-mon[28069]: pgmap v9051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:18:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:55 smithi193 ceph-mon[32782]: pgmap v9051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:18:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16252.116722 secs 2024-04-26T16:18:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16252.116722 secs 2024-04-26T16:18:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16252.116722 secs 2024-04-26T16:18:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:57 smithi196 ceph-mon[32572]: pgmap v9052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:18:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:57 smithi110 ceph-mon[28069]: pgmap v9052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:18:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:57 smithi193 ceph-mon[32782]: pgmap v9052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:19:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:18:59 smithi110 ceph-mon[28069]: pgmap v9053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:19:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:18:59 smithi193 ceph-mon[32782]: pgmap v9053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:19:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:18:59 smithi196 ceph-mon[32572]: pgmap v9053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:19:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:01 smithi110 ceph-mon[28069]: pgmap v9054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:19:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16257.116841 secs 2024-04-26T16:19:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:01 smithi193 ceph-mon[32782]: pgmap v9054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:19:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16257.116841 secs 2024-04-26T16:19:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:01 smithi196 ceph-mon[32572]: pgmap v9054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:19:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16257.116841 secs 2024-04-26T16:19:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:03 smithi110 ceph-mon[28069]: pgmap v9055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:19:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:03 smithi193 ceph-mon[32782]: pgmap v9055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:19:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:03 smithi196 ceph-mon[32572]: pgmap v9055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:19:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:05 smithi110 ceph-mon[28069]: pgmap v9056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:05 smithi193 ceph-mon[32782]: pgmap v9056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:05 smithi196 ceph-mon[32572]: pgmap v9056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16262.116963 secs 2024-04-26T16:19:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16262.116963 secs 2024-04-26T16:19:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16262.116963 secs 2024-04-26T16:19:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:07 smithi110 ceph-mon[28069]: pgmap v9057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:07 smithi193 ceph-mon[32782]: pgmap v9057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:07 smithi196 ceph-mon[32572]: pgmap v9057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:19:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:19:08.195+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:19:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:19:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:19:08.195+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:19:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:19:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:19:08.195+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:19:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:19:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:19:08.195+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:19:08.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:19:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:19:08.195+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:19:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:09 smithi110 ceph-mon[28069]: pgmap v9058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:09 smithi193 ceph-mon[32782]: pgmap v9058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:09 smithi196 ceph-mon[32572]: pgmap v9058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:11 smithi193 ceph-mon[32782]: pgmap v9059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:11 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16267.117080 secs 2024-04-26T16:19:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:11 smithi196 ceph-mon[32572]: pgmap v9059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:11 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16267.117080 secs 2024-04-26T16:19:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:11 smithi110 ceph-mon[28069]: pgmap v9059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:11 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16267.117080 secs 2024-04-26T16:19:14.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:13 smithi196 ceph-mon[32572]: pgmap v9060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:13 smithi193 ceph-mon[32782]: pgmap v9060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:13 smithi110 ceph-mon[28069]: pgmap v9060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:15 smithi193 ceph-mon[32782]: pgmap v9061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:19:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:15 smithi196 ceph-mon[32572]: pgmap v9061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:19:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:15 smithi110 ceph-mon[28069]: pgmap v9061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:19:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16272.117214 secs 2024-04-26T16:19:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16272.117214 secs 2024-04-26T16:19:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16272.117214 secs 2024-04-26T16:19:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:17 smithi193 ceph-mon[32782]: pgmap v9062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:19:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:17 smithi196 ceph-mon[32572]: pgmap v9062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:19:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:17 smithi110 ceph-mon[28069]: pgmap v9062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:19:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:19 smithi193 ceph-mon[32782]: pgmap v9063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:19:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:19 smithi196 ceph-mon[32572]: pgmap v9063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:19:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:19 smithi110 ceph-mon[28069]: pgmap v9063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:19:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:21 smithi193 ceph-mon[32782]: pgmap v9064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:19:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16277.117340 secs 2024-04-26T16:19:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:21 smithi196 ceph-mon[32572]: pgmap v9064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:19:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16277.117340 secs 2024-04-26T16:19:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:21 smithi110 ceph-mon[28069]: pgmap v9064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:19:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16277.117340 secs 2024-04-26T16:19:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:23 smithi193 ceph-mon[32782]: pgmap v9065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:19:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:23 smithi196 ceph-mon[32572]: pgmap v9065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:19:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:23 smithi110 ceph-mon[28069]: pgmap v9065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:19:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:25 smithi193 ceph-mon[32782]: pgmap v9066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:19:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:25 smithi196 ceph-mon[32572]: pgmap v9066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:19:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:25 smithi110 ceph-mon[28069]: pgmap v9066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:19:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16282.117455 secs 2024-04-26T16:19:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16282.117455 secs 2024-04-26T16:19:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16282.117455 secs 2024-04-26T16:19:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:27 smithi193 ceph-mon[32782]: pgmap v9067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:27 smithi196 ceph-mon[32572]: pgmap v9067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:27 smithi110 ceph-mon[28069]: pgmap v9067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:29 smithi193 ceph-mon[32782]: pgmap v9068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:29 smithi196 ceph-mon[32572]: pgmap v9068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:29 smithi110 ceph-mon[28069]: pgmap v9068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:31 smithi193 ceph-mon[32782]: pgmap v9069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16287.117601 secs 2024-04-26T16:19:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:31 smithi196 ceph-mon[32572]: pgmap v9069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16287.117601 secs 2024-04-26T16:19:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:31 smithi110 ceph-mon[28069]: pgmap v9069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16287.117601 secs 2024-04-26T16:19:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:33 smithi193 ceph-mon[32782]: pgmap v9070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:33 smithi196 ceph-mon[32572]: pgmap v9070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:33 smithi110 ceph-mon[28069]: pgmap v9070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:35 smithi193 ceph-mon[32782]: pgmap v9071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:35 smithi196 ceph-mon[32572]: pgmap v9071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:35 smithi110 ceph-mon[28069]: pgmap v9071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16292.117716 secs 2024-04-26T16:19:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16292.117716 secs 2024-04-26T16:19:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16292.117716 secs 2024-04-26T16:19:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:37 smithi196 ceph-mon[32572]: pgmap v9072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:37 smithi110 ceph-mon[28069]: pgmap v9072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:37 smithi193 ceph-mon[32782]: pgmap v9072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:39 smithi196 ceph-mon[32572]: pgmap v9073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:39 smithi110 ceph-mon[28069]: pgmap v9073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:39 smithi193 ceph-mon[32782]: pgmap v9073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:41 smithi196 ceph-mon[32572]: pgmap v9074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16297.117810 secs 2024-04-26T16:19:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:41 smithi110 ceph-mon[28069]: pgmap v9074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16297.117810 secs 2024-04-26T16:19:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:41 smithi193 ceph-mon[32782]: pgmap v9074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16297.117810 secs 2024-04-26T16:19:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:43 smithi196 ceph-mon[32572]: pgmap v9075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:43 smithi110 ceph-mon[28069]: pgmap v9075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:43 smithi193 ceph-mon[32782]: pgmap v9075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:45 smithi196 ceph-mon[32572]: pgmap v9076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:45 smithi110 ceph-mon[28069]: pgmap v9076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:45 smithi193 ceph-mon[32782]: pgmap v9076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16302.117917 secs 2024-04-26T16:19:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16302.117917 secs 2024-04-26T16:19:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16302.117917 secs 2024-04-26T16:19:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:47 smithi196 ceph-mon[32572]: pgmap v9077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:47 smithi110 ceph-mon[28069]: pgmap v9077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:47 smithi193 ceph-mon[32782]: pgmap v9077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:49 smithi196 ceph-mon[32572]: pgmap v9078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:49 smithi110 ceph-mon[28069]: pgmap v9078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:49 smithi193 ceph-mon[32782]: pgmap v9078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:51 smithi196 ceph-mon[32572]: pgmap v9079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16307.118057 secs 2024-04-26T16:19:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:51 smithi110 ceph-mon[28069]: pgmap v9079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16307.118057 secs 2024-04-26T16:19:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:51 smithi193 ceph-mon[32782]: pgmap v9079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16307.118057 secs 2024-04-26T16:19:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:19:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:19:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:19:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:53 smithi196 ceph-mon[32572]: pgmap v9080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:19:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:19:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:53 smithi110 ceph-mon[28069]: pgmap v9080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:19:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:19:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:53 smithi193 ceph-mon[32782]: pgmap v9080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:19:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:19:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:19:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:19:55.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:19:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:19:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:19:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:19:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:19:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:19:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:19:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:55 smithi196 ceph-mon[32572]: pgmap v9081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:55 smithi196 ceph-mon[32572]: pgmap v9082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T16:19:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:55 smithi196 ceph-mon[32572]: pgmap v9083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:55 smithi110 ceph-mon[28069]: pgmap v9081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:55 smithi110 ceph-mon[28069]: pgmap v9082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T16:19:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:55 smithi110 ceph-mon[28069]: pgmap v9083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:55 smithi193 ceph-mon[32782]: pgmap v9081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:55 smithi193 ceph-mon[32782]: pgmap v9082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T16:19:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:55 smithi193 ceph-mon[32782]: pgmap v9083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:19:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16312.118180 secs 2024-04-26T16:19:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16312.118180 secs 2024-04-26T16:19:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16312.118180 secs 2024-04-26T16:19:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:57 smithi196 ceph-mon[32572]: pgmap v9084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:19:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:57 smithi110 ceph-mon[28069]: pgmap v9084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:19:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:57 smithi193 ceph-mon[32782]: pgmap v9084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:20:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:19:59 smithi196 ceph-mon[32572]: pgmap v9085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:19:59 smithi110 ceph-mon[28069]: pgmap v9085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:00.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:19:59 smithi193 ceph-mon[32782]: pgmap v9085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:20:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:20:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:20:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:01 smithi196 ceph-mon[32572]: pgmap v9086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16317.118305 secs 2024-04-26T16:20:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:01 smithi110 ceph-mon[28069]: pgmap v9086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16317.118305 secs 2024-04-26T16:20:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:01 smithi193 ceph-mon[32782]: pgmap v9086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16317.118305 secs 2024-04-26T16:20:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:04 smithi196 ceph-mon[32572]: pgmap v9087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:04 smithi110 ceph-mon[28069]: pgmap v9087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:04 smithi193 ceph-mon[32782]: pgmap v9087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:06 smithi110 ceph-mon[28069]: pgmap v9088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:20:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:06 smithi193 ceph-mon[32782]: pgmap v9088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:20:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:06 smithi196 ceph-mon[32572]: pgmap v9088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:20:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16322.118422 secs 2024-04-26T16:20:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:07 smithi110 ceph-mon[28069]: pgmap v9089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16322.118422 secs 2024-04-26T16:20:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:07 smithi193 ceph-mon[32782]: pgmap v9089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16322.118422 secs 2024-04-26T16:20:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:07 smithi196 ceph-mon[32572]: pgmap v9089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:09 smithi196 ceph-mon[32572]: pgmap v9090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:09 smithi110 ceph-mon[28069]: pgmap v9090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:09 smithi193 ceph-mon[32782]: pgmap v9090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:11 smithi196 ceph-mon[32572]: pgmap v9091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:11 smithi110 ceph-mon[28069]: pgmap v9091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:11 smithi193 ceph-mon[32782]: pgmap v9091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16327.118542 secs 2024-04-26T16:20:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16327.118542 secs 2024-04-26T16:20:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16327.118542 secs 2024-04-26T16:20:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:13 smithi196 ceph-mon[32572]: pgmap v9092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:13 smithi110 ceph-mon[28069]: pgmap v9092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:13 smithi193 ceph-mon[32782]: pgmap v9092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:15 smithi196 ceph-mon[32572]: pgmap v9093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:15 smithi110 ceph-mon[28069]: pgmap v9093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:15 smithi193 ceph-mon[32782]: pgmap v9093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16332.118639 secs 2024-04-26T16:20:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16332.118639 secs 2024-04-26T16:20:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16332.118639 secs 2024-04-26T16:20:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:17 smithi196 ceph-mon[32572]: pgmap v9094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:17 smithi110 ceph-mon[28069]: pgmap v9094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:17 smithi193 ceph-mon[32782]: pgmap v9094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:19 smithi196 ceph-mon[32572]: pgmap v9095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:19 smithi110 ceph-mon[28069]: pgmap v9095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:19 smithi193 ceph-mon[32782]: pgmap v9095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:21 smithi196 ceph-mon[32572]: pgmap v9096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16337.118718 secs 2024-04-26T16:20:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:21 smithi110 ceph-mon[28069]: pgmap v9096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16337.118718 secs 2024-04-26T16:20:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:21 smithi193 ceph-mon[32782]: pgmap v9096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16337.118718 secs 2024-04-26T16:20:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:23 smithi196 ceph-mon[32572]: pgmap v9097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:23 smithi110 ceph-mon[28069]: pgmap v9097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:23 smithi193 ceph-mon[32782]: pgmap v9097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:25 smithi196 ceph-mon[32572]: pgmap v9098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:25 smithi110 ceph-mon[28069]: pgmap v9098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:25 smithi193 ceph-mon[32782]: pgmap v9098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16342.118865 secs 2024-04-26T16:20:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16342.118865 secs 2024-04-26T16:20:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16342.118865 secs 2024-04-26T16:20:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:28 smithi110 ceph-mon[28069]: pgmap v9099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:28 smithi193 ceph-mon[32782]: pgmap v9099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:28 smithi196 ceph-mon[32572]: pgmap v9099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:30 smithi110 ceph-mon[28069]: pgmap v9100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:30 smithi193 ceph-mon[32782]: pgmap v9100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:30 smithi196 ceph-mon[32572]: pgmap v9100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:31 smithi193 ceph-mon[32782]: pgmap v9101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:31 smithi196 ceph-mon[32572]: pgmap v9101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:31 smithi110 ceph-mon[28069]: pgmap v9101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16347.118968 secs 2024-04-26T16:20:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16347.118968 secs 2024-04-26T16:20:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16347.118968 secs 2024-04-26T16:20:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:33 smithi193 ceph-mon[32782]: pgmap v9102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:33 smithi196 ceph-mon[32572]: pgmap v9102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:33 smithi110 ceph-mon[28069]: pgmap v9102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:20:34.065+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:20:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:20:34.065+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T16:20:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:20:34.066+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 128 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T16:20:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:20:34.066+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 128 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:20:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:35 smithi196 ceph-mon[32572]: pgmap v9103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:35 smithi110 ceph-mon[28069]: pgmap v9103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:36.074 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:35 smithi193 ceph-mon[32782]: pgmap v9103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16352.119051 secs 2024-04-26T16:20:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:37 smithi196 ceph-mon[32572]: pgmap v9104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16352.119051 secs 2024-04-26T16:20:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:37 smithi110 ceph-mon[28069]: pgmap v9104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16352.119051 secs 2024-04-26T16:20:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:37 smithi193 ceph-mon[32782]: pgmap v9104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:39 smithi196 ceph-mon[32572]: pgmap v9105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:39 smithi110 ceph-mon[28069]: pgmap v9105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:39 smithi193 ceph-mon[32782]: pgmap v9105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:41 smithi196 ceph-mon[32572]: pgmap v9106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16357.119169 secs 2024-04-26T16:20:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:41 smithi110 ceph-mon[28069]: pgmap v9106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16357.119169 secs 2024-04-26T16:20:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:41 smithi193 ceph-mon[32782]: pgmap v9106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16357.119169 secs 2024-04-26T16:20:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:43 smithi196 ceph-mon[32572]: pgmap v9107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:43 smithi110 ceph-mon[28069]: pgmap v9107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:43 smithi193 ceph-mon[32782]: pgmap v9107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:45 smithi196 ceph-mon[32572]: pgmap v9108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:45 smithi110 ceph-mon[28069]: pgmap v9108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:45 smithi193 ceph-mon[32782]: pgmap v9108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16362.119284 secs 2024-04-26T16:20:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16362.119284 secs 2024-04-26T16:20:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16362.119284 secs 2024-04-26T16:20:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:47 smithi196 ceph-mon[32572]: pgmap v9109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:47 smithi110 ceph-mon[28069]: pgmap v9109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:47 smithi193 ceph-mon[32782]: pgmap v9109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:49 smithi196 ceph-mon[32572]: pgmap v9110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:49 smithi110 ceph-mon[28069]: pgmap v9110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:49 smithi193 ceph-mon[32782]: pgmap v9110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:51 smithi196 ceph-mon[32572]: pgmap v9111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16367.119398 secs 2024-04-26T16:20:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:51 smithi110 ceph-mon[28069]: pgmap v9111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16367.119398 secs 2024-04-26T16:20:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:51 smithi193 ceph-mon[32782]: pgmap v9111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16367.119398 secs 2024-04-26T16:20:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:53 smithi196 ceph-mon[32572]: pgmap v9112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:53 smithi110 ceph-mon[28069]: pgmap v9112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:53 smithi193 ceph-mon[32782]: pgmap v9112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:20:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:55 smithi196 ceph-mon[32572]: pgmap v9113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:20:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:55 smithi110 ceph-mon[28069]: pgmap v9113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:20:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:55 smithi193 ceph-mon[32782]: pgmap v9113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:20:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:20:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:20:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:20:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16372.119504 secs 2024-04-26T16:20:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:20:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:20:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16372.119504 secs 2024-04-26T16:20:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:20:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:20:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:20:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16372.119504 secs 2024-04-26T16:20:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:57 smithi196 ceph-mon[32572]: pgmap v9114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s rd, 1 op/s 2024-04-26T16:20:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:57 smithi196 ceph-mon[32572]: pgmap v9115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:20:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:57 smithi110 ceph-mon[28069]: pgmap v9114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s rd, 1 op/s 2024-04-26T16:20:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:57 smithi110 ceph-mon[28069]: pgmap v9115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:20:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:57 smithi193 ceph-mon[32782]: pgmap v9114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s rd, 1 op/s 2024-04-26T16:20:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:57 smithi193 ceph-mon[32782]: pgmap v9115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:20:59 smithi196 ceph-mon[32572]: pgmap v9116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:20:59 smithi110 ceph-mon[28069]: pgmap v9116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:20:59 smithi193 ceph-mon[32782]: pgmap v9116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:01 smithi196 ceph-mon[32572]: pgmap v9117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16377.119601 secs 2024-04-26T16:21:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:01 smithi110 ceph-mon[28069]: pgmap v9117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16377.119601 secs 2024-04-26T16:21:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:01 smithi193 ceph-mon[32782]: pgmap v9117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16377.119601 secs 2024-04-26T16:21:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:03 smithi196 ceph-mon[32572]: pgmap v9118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:21:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:03 smithi110 ceph-mon[28069]: pgmap v9118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:21:04.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:03 smithi193 ceph-mon[32782]: pgmap v9118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:21:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:05 smithi196 ceph-mon[32572]: pgmap v9119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:05 smithi110 ceph-mon[28069]: pgmap v9119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:05 smithi193 ceph-mon[32782]: pgmap v9119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:21:07.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16382.119717 secs 2024-04-26T16:21:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16382.119717 secs 2024-04-26T16:21:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16382.119717 secs 2024-04-26T16:21:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:07 smithi110 ceph-mon[28069]: pgmap v9120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:21:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:07 smithi193 ceph-mon[32782]: pgmap v9120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:21:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:07 smithi196 ceph-mon[32572]: pgmap v9120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:21:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:09 smithi110 ceph-mon[28069]: pgmap v9121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:09 smithi193 ceph-mon[32782]: pgmap v9121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:09 smithi196 ceph-mon[32572]: pgmap v9121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:11 smithi110 ceph-mon[28069]: pgmap v9122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:11 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 16387.119833 secs 2024-04-26T16:21:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:11 smithi110 ceph-mon[28069]: slow request 723.505658 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:21:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:11 smithi193 ceph-mon[32782]: pgmap v9122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:11 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 16387.119833 secs 2024-04-26T16:21:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:11 smithi193 ceph-mon[32782]: slow request 723.505658 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:21:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:11 smithi196 ceph-mon[32572]: pgmap v9122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:11 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 16387.119833 secs 2024-04-26T16:21:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:11 smithi196 ceph-mon[32572]: slow request 723.505658 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:21:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:13 smithi110 ceph-mon[28069]: pgmap v9123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:13 smithi193 ceph-mon[32782]: pgmap v9123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:13 smithi196 ceph-mon[32572]: pgmap v9123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:15 smithi110 ceph-mon[28069]: pgmap v9124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:16.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:15 smithi196 ceph-mon[32572]: pgmap v9124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:15 smithi193 ceph-mon[32782]: pgmap v9124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16392.119946 secs 2024-04-26T16:21:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16392.119946 secs 2024-04-26T16:21:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16392.119946 secs 2024-04-26T16:21:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:17 smithi110 ceph-mon[28069]: pgmap v9125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:17 smithi193 ceph-mon[32782]: pgmap v9125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:17 smithi196 ceph-mon[32572]: pgmap v9125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:21:19.073+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T16:21:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:21:19.073+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:21:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:21:19.074+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 129 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:21:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:21:19.074+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 129 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T16:21:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:19 smithi193 ceph-mon[32782]: pgmap v9126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:19 smithi196 ceph-mon[32572]: pgmap v9126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:19 smithi110 ceph-mon[28069]: pgmap v9126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:21 smithi193 ceph-mon[32782]: pgmap v9127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16397.120077 secs 2024-04-26T16:21:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:21 smithi196 ceph-mon[32572]: pgmap v9127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16397.120077 secs 2024-04-26T16:21:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:21 smithi110 ceph-mon[28069]: pgmap v9127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16397.120077 secs 2024-04-26T16:21:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:23 smithi193 ceph-mon[32782]: pgmap v9128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:23 smithi196 ceph-mon[32572]: pgmap v9128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:23 smithi110 ceph-mon[28069]: pgmap v9128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:25 smithi193 ceph-mon[32782]: pgmap v9129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:25 smithi196 ceph-mon[32572]: pgmap v9129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:25 smithi110 ceph-mon[28069]: pgmap v9129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16402.120213 secs 2024-04-26T16:21:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16402.120213 secs 2024-04-26T16:21:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16402.120213 secs 2024-04-26T16:21:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:27 smithi193 ceph-mon[32782]: pgmap v9130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:27 smithi196 ceph-mon[32572]: pgmap v9130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:27 smithi110 ceph-mon[28069]: pgmap v9130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:29 smithi193 ceph-mon[32782]: pgmap v9131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:29 smithi196 ceph-mon[32572]: pgmap v9131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:29 smithi110 ceph-mon[28069]: pgmap v9131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:31 smithi193 ceph-mon[32782]: pgmap v9132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16407.120348 secs 2024-04-26T16:21:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:31 smithi196 ceph-mon[32572]: pgmap v9132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16407.120348 secs 2024-04-26T16:21:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:31 smithi110 ceph-mon[28069]: pgmap v9132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16407.120348 secs 2024-04-26T16:21:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:33 smithi193 ceph-mon[32782]: pgmap v9133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:33 smithi196 ceph-mon[32572]: pgmap v9133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:33 smithi110 ceph-mon[28069]: pgmap v9133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:36.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:35 smithi110 ceph-mon[28069]: pgmap v9134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:35 smithi193 ceph-mon[32782]: pgmap v9134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:35 smithi196 ceph-mon[32572]: pgmap v9134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16412.120463 secs 2024-04-26T16:21:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16412.120463 secs 2024-04-26T16:21:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16412.120463 secs 2024-04-26T16:21:38.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:37 smithi193 ceph-mon[32782]: pgmap v9135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:37 smithi196 ceph-mon[32572]: pgmap v9135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:37 smithi110 ceph-mon[28069]: pgmap v9135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:39 smithi193 ceph-mon[32782]: pgmap v9136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:39 smithi196 ceph-mon[32572]: pgmap v9136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:39 smithi110 ceph-mon[28069]: pgmap v9136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:41 smithi193 ceph-mon[32782]: pgmap v9137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16417.120595 secs 2024-04-26T16:21:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:41 smithi196 ceph-mon[32572]: pgmap v9137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16417.120595 secs 2024-04-26T16:21:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:41 smithi110 ceph-mon[28069]: pgmap v9137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16417.120595 secs 2024-04-26T16:21:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:43 smithi196 ceph-mon[32572]: pgmap v9138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:43 smithi110 ceph-mon[28069]: pgmap v9138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:43 smithi193 ceph-mon[32782]: pgmap v9138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:45 smithi196 ceph-mon[32572]: pgmap v9139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:45 smithi110 ceph-mon[28069]: pgmap v9139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:45 smithi193 ceph-mon[32782]: pgmap v9139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16422.120706 secs 2024-04-26T16:21:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16422.120706 secs 2024-04-26T16:21:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16422.120706 secs 2024-04-26T16:21:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:47 smithi196 ceph-mon[32572]: pgmap v9140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:47 smithi110 ceph-mon[28069]: pgmap v9140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:47 smithi193 ceph-mon[32782]: pgmap v9140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:49 smithi196 ceph-mon[32572]: pgmap v9141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:49 smithi110 ceph-mon[28069]: pgmap v9141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:49 smithi193 ceph-mon[32782]: pgmap v9141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:51 smithi196 ceph-mon[32572]: pgmap v9142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16427.120788 secs 2024-04-26T16:21:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:51 smithi110 ceph-mon[28069]: pgmap v9142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16427.120788 secs 2024-04-26T16:21:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:51 smithi193 ceph-mon[32782]: pgmap v9142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16427.120788 secs 2024-04-26T16:21:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:53 smithi196 ceph-mon[32572]: pgmap v9143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:53 smithi110 ceph-mon[28069]: pgmap v9143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:53 smithi193 ceph-mon[32782]: pgmap v9143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:21:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:55 smithi196 ceph-mon[32572]: pgmap v9144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:55 smithi110 ceph-mon[28069]: pgmap v9144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:55 smithi193 ceph-mon[32782]: pgmap v9144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:21:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16432.120897 secs 2024-04-26T16:21:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:21:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16432.120897 secs 2024-04-26T16:21:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:21:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16432.120897 secs 2024-04-26T16:21:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:21:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:57 smithi196 ceph-mon[32572]: pgmap v9145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:57 smithi110 ceph-mon[28069]: pgmap v9145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:21:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:57 smithi193 ceph-mon[32782]: pgmap v9145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: pgmap v9146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:21:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: pgmap v9146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.046 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.047 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.047 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:21:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: pgmap v9146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:00.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:21:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:00 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:22:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:00 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:22:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:00 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:22:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:00 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:22:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:00 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:22:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:00 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:22:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:00 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:22:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:00 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:22:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:00 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:22:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:00 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:22:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:00 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:22:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:00 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:22:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:01 smithi196 ceph-mon[32572]: pgmap v9147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:02.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:01 smithi110 ceph-mon[28069]: pgmap v9147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:01 smithi193 ceph-mon[32782]: pgmap v9147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16437.121009 secs 2024-04-26T16:22:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:22:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:22:03.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: pgmap v9148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 893 B/s rd, 1 op/s 2024-04-26T16:22:03.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: pgmap v9149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 540 B/s rd, 1 op/s 2024-04-26T16:22:03.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16437.121009 secs 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:22:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:22:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: pgmap v9148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 893 B/s rd, 1 op/s 2024-04-26T16:22:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: pgmap v9149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 540 B/s rd, 1 op/s 2024-04-26T16:22:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16437.121009 secs 2024-04-26T16:22:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:22:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:22:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:22:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:22:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:22:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: pgmap v9148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 893 B/s rd, 1 op/s 2024-04-26T16:22:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: pgmap v9149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 540 B/s rd, 1 op/s 2024-04-26T16:22:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:22:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:04 smithi193 ceph-mon[32782]: pgmap v9150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:04 smithi196 ceph-mon[32572]: pgmap v9150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:04 smithi110 ceph-mon[28069]: pgmap v9150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:07 smithi110 ceph-mon[28069]: pgmap v9151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16442.121080 secs 2024-04-26T16:22:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:07 smithi193 ceph-mon[32782]: pgmap v9151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16442.121080 secs 2024-04-26T16:22:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:07 smithi196 ceph-mon[32572]: pgmap v9151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16442.121080 secs 2024-04-26T16:22:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:09 smithi110 ceph-mon[28069]: pgmap v9152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:09 smithi193 ceph-mon[32782]: pgmap v9152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:09 smithi196 ceph-mon[32572]: pgmap v9152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:11 smithi110 ceph-mon[28069]: pgmap v9153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:11 smithi193 ceph-mon[32782]: pgmap v9153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:11 smithi196 ceph-mon[32572]: pgmap v9153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:22:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16447.121205 secs 2024-04-26T16:22:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16447.121205 secs 2024-04-26T16:22:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16447.121205 secs 2024-04-26T16:22:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:13 smithi193 ceph-mon[32782]: pgmap v9154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:22:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:13 smithi196 ceph-mon[32572]: pgmap v9154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:22:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:13 smithi110 ceph-mon[28069]: pgmap v9154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:22:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:14 smithi193 ceph-mon[32782]: pgmap v9155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:14 smithi196 ceph-mon[32572]: pgmap v9155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:14 smithi110 ceph-mon[28069]: pgmap v9155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:16 smithi193 ceph-mon[32782]: pgmap v9156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16452.121318 secs 2024-04-26T16:22:17.207 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:16 smithi196 ceph-mon[32572]: pgmap v9156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:17.207 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16452.121318 secs 2024-04-26T16:22:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:16 smithi110 ceph-mon[28069]: pgmap v9156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16452.121318 secs 2024-04-26T16:22:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:18 smithi193 ceph-mon[32782]: pgmap v9157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:19.154 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:18 smithi110 ceph-mon[28069]: pgmap v9157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:18 smithi196 ceph-mon[32572]: pgmap v9157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:20 smithi193 ceph-mon[32782]: pgmap v9158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:20 smithi196 ceph-mon[32572]: pgmap v9158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:20 smithi110 ceph-mon[28069]: pgmap v9158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16457.121416 secs 2024-04-26T16:22:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16457.121416 secs 2024-04-26T16:22:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16457.121416 secs 2024-04-26T16:22:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:22 smithi196 ceph-mon[32572]: pgmap v9159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:22 smithi110 ceph-mon[28069]: pgmap v9159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:22 smithi193 ceph-mon[32782]: pgmap v9159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:24 smithi196 ceph-mon[32572]: pgmap v9160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:24 smithi110 ceph-mon[28069]: pgmap v9160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:24 smithi193 ceph-mon[32782]: pgmap v9160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:26 smithi196 ceph-mon[32572]: pgmap v9161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16462.121573 secs 2024-04-26T16:22:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:26 smithi110 ceph-mon[28069]: pgmap v9161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16462.121573 secs 2024-04-26T16:22:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:26 smithi193 ceph-mon[32782]: pgmap v9161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16462.121573 secs 2024-04-26T16:22:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:28 smithi196 ceph-mon[32572]: pgmap v9162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:28 smithi110 ceph-mon[28069]: pgmap v9162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:28 smithi193 ceph-mon[32782]: pgmap v9162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:30 smithi196 ceph-mon[32572]: pgmap v9163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:30 smithi110 ceph-mon[28069]: pgmap v9163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:30 smithi193 ceph-mon[32782]: pgmap v9163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16467.121632 secs 2024-04-26T16:22:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16467.121632 secs 2024-04-26T16:22:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16467.121632 secs 2024-04-26T16:22:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:32 smithi196 ceph-mon[32572]: pgmap v9164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:32 smithi110 ceph-mon[28069]: pgmap v9164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:32 smithi193 ceph-mon[32782]: pgmap v9164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:34 smithi196 ceph-mon[32572]: pgmap v9165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:34 smithi110 ceph-mon[28069]: pgmap v9165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:34 smithi193 ceph-mon[32782]: pgmap v9165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:37.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:36 smithi193 ceph-mon[32782]: pgmap v9166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:37.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16472.121770 secs 2024-04-26T16:22:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:36 smithi196 ceph-mon[32572]: pgmap v9166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16472.121770 secs 2024-04-26T16:22:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:36 smithi110 ceph-mon[28069]: pgmap v9166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16472.121770 secs 2024-04-26T16:22:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:38 smithi196 ceph-mon[32572]: pgmap v9167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:38 smithi110 ceph-mon[28069]: pgmap v9167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:38 smithi193 ceph-mon[32782]: pgmap v9167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:40 smithi196 ceph-mon[32572]: pgmap v9168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:40 smithi110 ceph-mon[28069]: pgmap v9168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:40 smithi193 ceph-mon[32782]: pgmap v9168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16477.121891 secs 2024-04-26T16:22:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16477.121891 secs 2024-04-26T16:22:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16477.121891 secs 2024-04-26T16:22:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:42 smithi196 ceph-mon[32572]: pgmap v9169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:42 smithi110 ceph-mon[28069]: pgmap v9169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:42 smithi193 ceph-mon[32782]: pgmap v9169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:44 smithi196 ceph-mon[32572]: pgmap v9170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:44 smithi110 ceph-mon[28069]: pgmap v9170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:44 smithi193 ceph-mon[32782]: pgmap v9170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:46 smithi196 ceph-mon[32572]: pgmap v9171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16482.122008 secs 2024-04-26T16:22:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:46 smithi110 ceph-mon[28069]: pgmap v9171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16482.122008 secs 2024-04-26T16:22:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:46 smithi193 ceph-mon[32782]: pgmap v9171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16482.122008 secs 2024-04-26T16:22:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:48 smithi196 ceph-mon[32572]: pgmap v9172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:48 smithi110 ceph-mon[28069]: pgmap v9172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:48 smithi193 ceph-mon[32782]: pgmap v9172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:50 smithi196 ceph-mon[32572]: pgmap v9173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:50 smithi110 ceph-mon[28069]: pgmap v9173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:50 smithi193 ceph-mon[32782]: pgmap v9173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16487.122126 secs 2024-04-26T16:22:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16487.122126 secs 2024-04-26T16:22:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16487.122126 secs 2024-04-26T16:22:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:52 smithi196 ceph-mon[32572]: pgmap v9174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:52 smithi110 ceph-mon[28069]: pgmap v9174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:52 smithi193 ceph-mon[32782]: pgmap v9174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:54 smithi196 ceph-mon[32572]: pgmap v9175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:54 smithi110 ceph-mon[28069]: pgmap v9175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:54 smithi193 ceph-mon[32782]: pgmap v9175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:56 smithi196 ceph-mon[32572]: pgmap v9176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16492.122236 secs 2024-04-26T16:22:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:56 smithi110 ceph-mon[28069]: pgmap v9176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16492.122236 secs 2024-04-26T16:22:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:56 smithi193 ceph-mon[32782]: pgmap v9176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:22:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16492.122236 secs 2024-04-26T16:22:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:22:58 smithi196 ceph-mon[32572]: pgmap v9177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:22:58 smithi110 ceph-mon[28069]: pgmap v9177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:22:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:22:58 smithi193 ceph-mon[32782]: pgmap v9177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:01 smithi196 ceph-mon[32572]: pgmap v9178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:01 smithi110 ceph-mon[28069]: pgmap v9178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:01 smithi193 ceph-mon[32782]: pgmap v9178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16497.122376 secs 2024-04-26T16:23:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16497.122376 secs 2024-04-26T16:23:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16497.122376 secs 2024-04-26T16:23:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:03 smithi110 ceph-mon[28069]: pgmap v9179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:23:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:03 smithi193 ceph-mon[32782]: pgmap v9179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:23:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:03 smithi196 ceph-mon[32572]: pgmap v9179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:23:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:23:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:23:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:23:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:23:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:23:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:23:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:23:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:23:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:23:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:05 smithi110 ceph-mon[28069]: pgmap v9180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:23:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:05 smithi110 ceph-mon[28069]: pgmap v9181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:05 smithi193 ceph-mon[32782]: pgmap v9180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:23:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:05 smithi193 ceph-mon[32782]: pgmap v9181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:05 smithi196 ceph-mon[32572]: pgmap v9180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:23:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:05 smithi196 ceph-mon[32572]: pgmap v9181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:07 smithi110 ceph-mon[28069]: pgmap v9182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16502.122514 secs 2024-04-26T16:23:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:07 smithi193 ceph-mon[32782]: pgmap v9182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16502.122514 secs 2024-04-26T16:23:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:07 smithi196 ceph-mon[32572]: pgmap v9182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16502.122514 secs 2024-04-26T16:23:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:09 smithi110 ceph-mon[28069]: pgmap v9183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:23:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:09 smithi193 ceph-mon[32782]: pgmap v9183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:23:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:09 smithi196 ceph-mon[32572]: pgmap v9183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:23:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:11 smithi110 ceph-mon[28069]: pgmap v9184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:11 smithi193 ceph-mon[32782]: pgmap v9184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:11 smithi196 ceph-mon[32572]: pgmap v9184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16507.122626 secs 2024-04-26T16:23:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16507.122626 secs 2024-04-26T16:23:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16507.122626 secs 2024-04-26T16:23:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:13 smithi193 ceph-mon[32782]: pgmap v9185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:13 smithi196 ceph-mon[32572]: pgmap v9185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:13 smithi110 ceph-mon[28069]: pgmap v9185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:23:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:14 smithi193 ceph-mon[32782]: pgmap v9186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:23:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:14 smithi196 ceph-mon[32572]: pgmap v9186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:23:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:14 smithi110 ceph-mon[28069]: pgmap v9186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:23:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:16 smithi196 ceph-mon[32572]: pgmap v9187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:16 smithi110 ceph-mon[28069]: pgmap v9187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:16 smithi193 ceph-mon[32782]: pgmap v9187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16512.122690 secs 2024-04-26T16:23:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16512.122690 secs 2024-04-26T16:23:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16512.122690 secs 2024-04-26T16:23:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:18 smithi196 ceph-mon[32572]: pgmap v9188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:18 smithi110 ceph-mon[28069]: pgmap v9188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:18 smithi193 ceph-mon[32782]: pgmap v9188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:20 smithi196 ceph-mon[32572]: pgmap v9189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:20 smithi110 ceph-mon[28069]: pgmap v9189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:20 smithi193 ceph-mon[32782]: pgmap v9189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:22 smithi196 ceph-mon[32572]: pgmap v9190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16517.122809 secs 2024-04-26T16:23:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:22 smithi110 ceph-mon[28069]: pgmap v9190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16517.122809 secs 2024-04-26T16:23:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:22 smithi193 ceph-mon[32782]: pgmap v9190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16517.122809 secs 2024-04-26T16:23:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:24 smithi196 ceph-mon[32572]: pgmap v9191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:24 smithi110 ceph-mon[28069]: pgmap v9191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:24 smithi193 ceph-mon[32782]: pgmap v9191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:26 smithi196 ceph-mon[32572]: pgmap v9192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:26 smithi110 ceph-mon[28069]: pgmap v9192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:26 smithi193 ceph-mon[32782]: pgmap v9192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16522.122929 secs 2024-04-26T16:23:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16522.122929 secs 2024-04-26T16:23:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16522.122929 secs 2024-04-26T16:23:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:28 smithi196 ceph-mon[32572]: pgmap v9193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:28 smithi110 ceph-mon[28069]: pgmap v9193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:28 smithi193 ceph-mon[32782]: pgmap v9193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:30 smithi196 ceph-mon[32572]: pgmap v9194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:30 smithi110 ceph-mon[28069]: pgmap v9194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:30 smithi193 ceph-mon[32782]: pgmap v9194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:32 smithi196 ceph-mon[32572]: pgmap v9195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16527.123043 secs 2024-04-26T16:23:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:32 smithi110 ceph-mon[28069]: pgmap v9195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16527.123043 secs 2024-04-26T16:23:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:32 smithi193 ceph-mon[32782]: pgmap v9195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16527.123043 secs 2024-04-26T16:23:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:34 smithi196 ceph-mon[32572]: pgmap v9196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:34 smithi110 ceph-mon[28069]: pgmap v9196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:34 smithi193 ceph-mon[32782]: pgmap v9196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:36 smithi196 ceph-mon[32572]: pgmap v9197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:36 smithi110 ceph-mon[28069]: pgmap v9197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:36 smithi193 ceph-mon[32782]: pgmap v9197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16532.123161 secs 2024-04-26T16:23:37.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16532.123161 secs 2024-04-26T16:23:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16532.123161 secs 2024-04-26T16:23:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:38 smithi110 ceph-mon[28069]: pgmap v9198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:38 smithi193 ceph-mon[32782]: pgmap v9198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:38 smithi196 ceph-mon[32572]: pgmap v9198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:40 smithi110 ceph-mon[28069]: pgmap v9199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:40 smithi193 ceph-mon[32782]: pgmap v9199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:40 smithi196 ceph-mon[32572]: pgmap v9199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:42 smithi110 ceph-mon[28069]: pgmap v9200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16537.123286 secs 2024-04-26T16:23:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:42 smithi193 ceph-mon[32782]: pgmap v9200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16537.123286 secs 2024-04-26T16:23:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:42 smithi196 ceph-mon[32572]: pgmap v9200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16537.123286 secs 2024-04-26T16:23:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:44 smithi110 ceph-mon[28069]: pgmap v9201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:44 smithi193 ceph-mon[32782]: pgmap v9201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:44 smithi196 ceph-mon[32572]: pgmap v9201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:46 smithi110 ceph-mon[28069]: pgmap v9202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:46 smithi193 ceph-mon[32782]: pgmap v9202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:46 smithi196 ceph-mon[32572]: pgmap v9202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16542.123416 secs 2024-04-26T16:23:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16542.123416 secs 2024-04-26T16:23:47.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16542.123416 secs 2024-04-26T16:23:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:48 smithi110 ceph-mon[28069]: pgmap v9203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:48 smithi193 ceph-mon[32782]: pgmap v9203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:48 smithi196 ceph-mon[32572]: pgmap v9203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:50 smithi193 ceph-mon[32782]: pgmap v9204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:50 smithi196 ceph-mon[32572]: pgmap v9204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:50 smithi110 ceph-mon[28069]: pgmap v9204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:23:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:52 smithi193 ceph-mon[32782]: pgmap v9205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16547.123531 secs 2024-04-26T16:23:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:52 smithi196 ceph-mon[32572]: pgmap v9205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16547.123531 secs 2024-04-26T16:23:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:52 smithi110 ceph-mon[28069]: pgmap v9205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16547.123531 secs 2024-04-26T16:23:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:54 smithi193 ceph-mon[32782]: pgmap v9206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:54 smithi196 ceph-mon[32572]: pgmap v9206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:54 smithi110 ceph-mon[28069]: pgmap v9206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:56 smithi193 ceph-mon[32782]: pgmap v9207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:56 smithi196 ceph-mon[32572]: pgmap v9207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:56 smithi110 ceph-mon[28069]: pgmap v9207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:23:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16552.123650 secs 2024-04-26T16:23:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16552.123650 secs 2024-04-26T16:23:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16552.123650 secs 2024-04-26T16:23:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:23:58 smithi193 ceph-mon[32782]: pgmap v9208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:23:58 smithi196 ceph-mon[32572]: pgmap v9208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:23:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:23:58 smithi110 ceph-mon[28069]: pgmap v9208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:00 smithi193 ceph-mon[32782]: pgmap v9209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:24:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:00 smithi196 ceph-mon[32572]: pgmap v9209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:24:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:00 smithi110 ceph-mon[28069]: pgmap v9209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:24:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:02 smithi193 ceph-mon[32782]: pgmap v9210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16557.123768 secs 2024-04-26T16:24:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:02 smithi196 ceph-mon[32572]: pgmap v9210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16557.123768 secs 2024-04-26T16:24:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:02 smithi110 ceph-mon[28069]: pgmap v9210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16557.123768 secs 2024-04-26T16:24:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:04 smithi193 ceph-mon[32782]: pgmap v9211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:24:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:04 smithi196 ceph-mon[32572]: pgmap v9211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:24:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:04 smithi110 ceph-mon[28069]: pgmap v9211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:24:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:24:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:24:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:05 smithi193 ceph-mon[32782]: pgmap v9212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:24:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:05 smithi193 ceph-mon[32782]: pgmap v9213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:24:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:24:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:24:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:24:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:05 smithi196 ceph-mon[32572]: pgmap v9212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:24:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:05 smithi196 ceph-mon[32572]: pgmap v9213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:24:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:24:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:24:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:24:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:05 smithi110 ceph-mon[28069]: pgmap v9212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:24:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:05 smithi110 ceph-mon[28069]: pgmap v9213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:24:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:24:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16562.123884 secs 2024-04-26T16:24:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16562.123884 secs 2024-04-26T16:24:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16562.123884 secs 2024-04-26T16:24:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:07 smithi196 ceph-mon[32572]: pgmap v9214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:24:08.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:07 smithi193 ceph-mon[32782]: pgmap v9214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:24:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:07 smithi110 ceph-mon[28069]: pgmap v9214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:24:08.790 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:24:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:24:08.414+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:24:08.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:24:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:24:08.414+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:24:08.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:24:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:24:08.414+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:24:08.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:24:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:24:08.414+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:24:08.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:24:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:24:08.414+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:24:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:09 smithi196 ceph-mon[32572]: pgmap v9215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:24:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:09 smithi110 ceph-mon[28069]: pgmap v9215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:24:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:09 smithi193 ceph-mon[32782]: pgmap v9215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:24:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:11 smithi196 ceph-mon[32572]: pgmap v9216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:24:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:11 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16567.124009 secs 2024-04-26T16:24:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:11 smithi110 ceph-mon[28069]: pgmap v9216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:24:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:11 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16567.124009 secs 2024-04-26T16:24:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:11 smithi193 ceph-mon[32782]: pgmap v9216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:24:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:11 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16567.124009 secs 2024-04-26T16:24:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:13 smithi196 ceph-mon[32572]: pgmap v9217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T16:24:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:13 smithi110 ceph-mon[28069]: pgmap v9217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T16:24:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:13 smithi193 ceph-mon[32782]: pgmap v9217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T16:24:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:15 smithi196 ceph-mon[32572]: pgmap v9218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T16:24:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:15 smithi110 ceph-mon[28069]: pgmap v9218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T16:24:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:15 smithi193 ceph-mon[32782]: pgmap v9218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T16:24:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16572.124151 secs 2024-04-26T16:24:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16572.124151 secs 2024-04-26T16:24:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16572.124151 secs 2024-04-26T16:24:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:18 smithi110 ceph-mon[28069]: pgmap v9219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:18 smithi193 ceph-mon[32782]: pgmap v9219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:18 smithi196 ceph-mon[32572]: pgmap v9219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:24:19.102+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:24:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:24:19.102+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:24:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:24:19.103+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 130 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:24:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:24:19.103+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 130 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:24:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:20 smithi110 ceph-mon[28069]: pgmap v9220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:20 smithi193 ceph-mon[32782]: pgmap v9220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:20 smithi196 ceph-mon[32572]: pgmap v9220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:22 smithi110 ceph-mon[28069]: pgmap v9221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16577.124291 secs 2024-04-26T16:24:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:22 smithi193 ceph-mon[32782]: pgmap v9221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16577.124291 secs 2024-04-26T16:24:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:22 smithi196 ceph-mon[32572]: pgmap v9221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16577.124291 secs 2024-04-26T16:24:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:24 smithi110 ceph-mon[28069]: pgmap v9222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:24 smithi193 ceph-mon[32782]: pgmap v9222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:24 smithi196 ceph-mon[32572]: pgmap v9222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:24:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:26 smithi110 ceph-mon[28069]: pgmap v9223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:26 smithi193 ceph-mon[32782]: pgmap v9223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:26 smithi196 ceph-mon[32572]: pgmap v9223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16582.124423 secs 2024-04-26T16:24:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16582.124423 secs 2024-04-26T16:24:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16582.124423 secs 2024-04-26T16:24:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:28 smithi193 ceph-mon[32782]: pgmap v9224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:28 smithi196 ceph-mon[32572]: pgmap v9224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:28 smithi110 ceph-mon[28069]: pgmap v9224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:30 smithi193 ceph-mon[32782]: pgmap v9225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:30 smithi196 ceph-mon[32572]: pgmap v9225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:30 smithi110 ceph-mon[28069]: pgmap v9225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:32 smithi193 ceph-mon[32782]: pgmap v9226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16587.124544 secs 2024-04-26T16:24:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:32 smithi196 ceph-mon[32572]: pgmap v9226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16587.124544 secs 2024-04-26T16:24:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:32 smithi110 ceph-mon[28069]: pgmap v9226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16587.124544 secs 2024-04-26T16:24:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:34 smithi193 ceph-mon[32782]: pgmap v9227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:34 smithi196 ceph-mon[32572]: pgmap v9227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:34 smithi110 ceph-mon[28069]: pgmap v9227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:36 smithi193 ceph-mon[32782]: pgmap v9228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:36.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:36 smithi196 ceph-mon[32572]: pgmap v9228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:36 smithi110 ceph-mon[28069]: pgmap v9228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16592.124667 secs 2024-04-26T16:24:37.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16592.124667 secs 2024-04-26T16:24:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16592.124667 secs 2024-04-26T16:24:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:38 smithi193 ceph-mon[32782]: pgmap v9229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:38 smithi196 ceph-mon[32572]: pgmap v9229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:38 smithi110 ceph-mon[28069]: pgmap v9229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:39 smithi193 ceph-mon[32782]: pgmap v9230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:39 smithi196 ceph-mon[32572]: pgmap v9230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:39 smithi110 ceph-mon[28069]: pgmap v9230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:41 smithi196 ceph-mon[32572]: pgmap v9231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16597.124787 secs 2024-04-26T16:24:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:41 smithi110 ceph-mon[28069]: pgmap v9231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16597.124787 secs 2024-04-26T16:24:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:41 smithi193 ceph-mon[32782]: pgmap v9231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16597.124787 secs 2024-04-26T16:24:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:44 smithi196 ceph-mon[32572]: pgmap v9232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:44 smithi110 ceph-mon[28069]: pgmap v9232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:44 smithi193 ceph-mon[32782]: pgmap v9232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:46 smithi110 ceph-mon[28069]: pgmap v9233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:46 smithi193 ceph-mon[32782]: pgmap v9233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:46 smithi196 ceph-mon[32572]: pgmap v9233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16602.124900 secs 2024-04-26T16:24:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16602.124900 secs 2024-04-26T16:24:47.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16602.124900 secs 2024-04-26T16:24:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:48 smithi110 ceph-mon[28069]: pgmap v9234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:48 smithi193 ceph-mon[32782]: pgmap v9234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:48 smithi196 ceph-mon[32572]: pgmap v9234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:50 smithi110 ceph-mon[28069]: pgmap v9235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:50 smithi193 ceph-mon[32782]: pgmap v9235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:50 smithi196 ceph-mon[32572]: pgmap v9235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:52 smithi110 ceph-mon[28069]: pgmap v9236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16607.124965 secs 2024-04-26T16:24:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:52 smithi193 ceph-mon[32782]: pgmap v9236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16607.124965 secs 2024-04-26T16:24:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:52 smithi196 ceph-mon[32572]: pgmap v9236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16607.124965 secs 2024-04-26T16:24:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:54 smithi110 ceph-mon[28069]: pgmap v9237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:54 smithi193 ceph-mon[32782]: pgmap v9237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:54 smithi196 ceph-mon[32572]: pgmap v9237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:24:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:56 smithi110 ceph-mon[28069]: pgmap v9238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:56 smithi193 ceph-mon[32782]: pgmap v9238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:56 smithi196 ceph-mon[32572]: pgmap v9238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16612.125101 secs 2024-04-26T16:24:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16612.125101 secs 2024-04-26T16:24:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16612.125101 secs 2024-04-26T16:24:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:24:58 smithi193 ceph-mon[32782]: pgmap v9239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:24:58 smithi196 ceph-mon[32572]: pgmap v9239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:24:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:24:58 smithi110 ceph-mon[28069]: pgmap v9239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:00 smithi193 ceph-mon[32782]: pgmap v9240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:00 smithi196 ceph-mon[32572]: pgmap v9240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:00 smithi110 ceph-mon[28069]: pgmap v9240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:02 smithi193 ceph-mon[32782]: pgmap v9241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16617.125252 secs 2024-04-26T16:25:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:02 smithi196 ceph-mon[32572]: pgmap v9241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16617.125252 secs 2024-04-26T16:25:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:02 smithi110 ceph-mon[28069]: pgmap v9241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16617.125252 secs 2024-04-26T16:25:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:04 smithi193 ceph-mon[32782]: pgmap v9242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:04 smithi196 ceph-mon[32572]: pgmap v9242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:04 smithi110 ceph-mon[28069]: pgmap v9242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:05 smithi196 ceph-mon[32572]: pgmap v9243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:25:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:05 smithi110 ceph-mon[28069]: pgmap v9243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:25:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:05 smithi193 ceph-mon[32782]: pgmap v9243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:25:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:25:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:25:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:25:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16622.125366 secs 2024-04-26T16:25:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:25:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:25:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:07 smithi110 ceph-mon[28069]: pgmap v9244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:07 smithi110 ceph-mon[28069]: pgmap v9245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:25:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16622.125366 secs 2024-04-26T16:25:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:25:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:25:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:07 smithi196 ceph-mon[32572]: pgmap v9244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:07 smithi196 ceph-mon[32572]: pgmap v9245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:25:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16622.125366 secs 2024-04-26T16:25:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:25:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:25:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:07 smithi193 ceph-mon[32782]: pgmap v9244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:07 smithi193 ceph-mon[32782]: pgmap v9245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:25:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:09 smithi196 ceph-mon[32572]: pgmap v9246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:09 smithi110 ceph-mon[28069]: pgmap v9246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:09 smithi193 ceph-mon[32782]: pgmap v9246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:11 smithi196 ceph-mon[32572]: pgmap v9247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:11 smithi110 ceph-mon[28069]: pgmap v9247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:11 smithi193 ceph-mon[32782]: pgmap v9247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:25:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16627.125488 secs 2024-04-26T16:25:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16627.125488 secs 2024-04-26T16:25:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16627.125488 secs 2024-04-26T16:25:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:13 smithi110 ceph-mon[28069]: pgmap v9248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T16:25:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:13 smithi193 ceph-mon[32782]: pgmap v9248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T16:25:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:13 smithi196 ceph-mon[32572]: pgmap v9248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T16:25:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:15 smithi110 ceph-mon[28069]: pgmap v9249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:25:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:15 smithi193 ceph-mon[32782]: pgmap v9249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:25:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:15 smithi196 ceph-mon[32572]: pgmap v9249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:25:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16632.125638 secs 2024-04-26T16:25:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:17 smithi110 ceph-mon[28069]: pgmap v9250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:25:17.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16632.125638 secs 2024-04-26T16:25:17.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:17 smithi196 ceph-mon[32572]: pgmap v9250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:25:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16632.125638 secs 2024-04-26T16:25:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:17 smithi193 ceph-mon[32782]: pgmap v9250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:25:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:19 smithi110 ceph-mon[28069]: pgmap v9251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:19 smithi193 ceph-mon[32782]: pgmap v9251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:19 smithi196 ceph-mon[32572]: pgmap v9251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:21 smithi110 ceph-mon[28069]: pgmap v9252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:21 smithi193 ceph-mon[32782]: pgmap v9252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:21 smithi196 ceph-mon[32572]: pgmap v9252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16637.125768 secs 2024-04-26T16:25:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16637.125768 secs 2024-04-26T16:25:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16637.125768 secs 2024-04-26T16:25:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:23 smithi193 ceph-mon[32782]: pgmap v9253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:23 smithi196 ceph-mon[32572]: pgmap v9253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:23 smithi110 ceph-mon[28069]: pgmap v9253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:25 smithi193 ceph-mon[32782]: pgmap v9254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:25:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:25 smithi196 ceph-mon[32572]: pgmap v9254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:25:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:25 smithi110 ceph-mon[28069]: pgmap v9254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:25:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16642.125881 secs 2024-04-26T16:25:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:27 smithi193 ceph-mon[32782]: pgmap v9255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16642.125881 secs 2024-04-26T16:25:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:27 smithi196 ceph-mon[32572]: pgmap v9255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16642.125881 secs 2024-04-26T16:25:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:27 smithi110 ceph-mon[28069]: pgmap v9255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:29 smithi193 ceph-mon[32782]: pgmap v9256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:29 smithi196 ceph-mon[32572]: pgmap v9256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:29 smithi110 ceph-mon[28069]: pgmap v9256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:31 smithi193 ceph-mon[32782]: pgmap v9257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:31 smithi196 ceph-mon[32572]: pgmap v9257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:31 smithi110 ceph-mon[28069]: pgmap v9257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16647.126015 secs 2024-04-26T16:25:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16647.126015 secs 2024-04-26T16:25:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16647.126015 secs 2024-04-26T16:25:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:33 smithi193 ceph-mon[32782]: pgmap v9258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:33 smithi196 ceph-mon[32572]: pgmap v9258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:33 smithi110 ceph-mon[28069]: pgmap v9258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:35 smithi193 ceph-mon[32782]: pgmap v9259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:25:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:35 smithi196 ceph-mon[32572]: pgmap v9259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:25:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:35 smithi110 ceph-mon[28069]: pgmap v9259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:25:37.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16652.126152 secs 2024-04-26T16:25:37.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:37 smithi110 ceph-mon[28069]: pgmap v9260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16652.126152 secs 2024-04-26T16:25:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:37 smithi193 ceph-mon[32782]: pgmap v9260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16652.126152 secs 2024-04-26T16:25:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:37 smithi196 ceph-mon[32572]: pgmap v9260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:39 smithi193 ceph-mon[32782]: pgmap v9261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:39 smithi196 ceph-mon[32572]: pgmap v9261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:39 smithi110 ceph-mon[28069]: pgmap v9261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:41 smithi193 ceph-mon[32782]: pgmap v9262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:25:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:41 smithi196 ceph-mon[32572]: pgmap v9262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:25:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:41 smithi110 ceph-mon[28069]: pgmap v9262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:25:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16657.126291 secs 2024-04-26T16:25:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16657.126291 secs 2024-04-26T16:25:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16657.126291 secs 2024-04-26T16:25:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:43 smithi193 ceph-mon[32782]: pgmap v9263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T16:25:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:43 smithi196 ceph-mon[32572]: pgmap v9263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T16:25:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:43 smithi110 ceph-mon[28069]: pgmap v9263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T16:25:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:45 smithi193 ceph-mon[32782]: pgmap v9264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:25:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:45 smithi196 ceph-mon[32572]: pgmap v9264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:25:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:45 smithi110 ceph-mon[28069]: pgmap v9264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:25:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16662.126414 secs 2024-04-26T16:25:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:47 smithi196 ceph-mon[32572]: pgmap v9265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:25:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16662.126414 secs 2024-04-26T16:25:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:47 smithi110 ceph-mon[28069]: pgmap v9265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:25:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16662.126414 secs 2024-04-26T16:25:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:47 smithi193 ceph-mon[32782]: pgmap v9265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:25:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:49 smithi196 ceph-mon[32572]: pgmap v9266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:49 smithi110 ceph-mon[28069]: pgmap v9266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:49 smithi193 ceph-mon[32782]: pgmap v9266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:51 smithi196 ceph-mon[32572]: pgmap v9267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:51 smithi110 ceph-mon[28069]: pgmap v9267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:51 smithi193 ceph-mon[32782]: pgmap v9267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16667.126589 secs 2024-04-26T16:25:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16667.126589 secs 2024-04-26T16:25:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16667.126589 secs 2024-04-26T16:25:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:53 smithi196 ceph-mon[32572]: pgmap v9268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:53 smithi110 ceph-mon[28069]: pgmap v9268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:53 smithi193 ceph-mon[32782]: pgmap v9268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:25:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:55 smithi196 ceph-mon[32572]: pgmap v9269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:25:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:55 smithi110 ceph-mon[28069]: pgmap v9269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:25:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:55 smithi193 ceph-mon[32782]: pgmap v9269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:25:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16672.126709 secs 2024-04-26T16:25:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:57 smithi196 ceph-mon[32572]: pgmap v9270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16672.126709 secs 2024-04-26T16:25:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:57 smithi110 ceph-mon[28069]: pgmap v9270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:25:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16672.126709 secs 2024-04-26T16:25:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:57 smithi193 ceph-mon[32782]: pgmap v9270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:25:59 smithi196 ceph-mon[32572]: pgmap v9271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:25:59 smithi110 ceph-mon[28069]: pgmap v9271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:25:59 smithi193 ceph-mon[32782]: pgmap v9271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:01 smithi196 ceph-mon[32572]: pgmap v9272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:01 smithi110 ceph-mon[28069]: pgmap v9272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:01 smithi193 ceph-mon[32782]: pgmap v9272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16677.126820 secs 2024-04-26T16:26:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16677.126820 secs 2024-04-26T16:26:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16677.126820 secs 2024-04-26T16:26:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:03 smithi196 ceph-mon[32572]: pgmap v9273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:03 smithi110 ceph-mon[28069]: pgmap v9273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:03 smithi193 ceph-mon[32782]: pgmap v9273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:05 smithi196 ceph-mon[32572]: pgmap v9274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:26:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:05 smithi110 ceph-mon[28069]: pgmap v9274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:26:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:05 smithi193 ceph-mon[32782]: pgmap v9274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:26:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16682.126945 secs 2024-04-26T16:26:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:07 smithi196 ceph-mon[32572]: pgmap v9275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:26:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16682.126945 secs 2024-04-26T16:26:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:07 smithi110 ceph-mon[28069]: pgmap v9275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:26:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16682.126945 secs 2024-04-26T16:26:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:07 smithi193 ceph-mon[32782]: pgmap v9275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:26:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:26:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:26:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:08 smithi196 ceph-mon[32572]: pgmap v9276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:26:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:08 smithi196 ceph-mon[32572]: pgmap v9277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:26:09.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:26:09.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:26:09.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:08 smithi193 ceph-mon[32782]: pgmap v9276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:26:09.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:08 smithi193 ceph-mon[32782]: pgmap v9277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:09.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:26:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:26:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:26:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:08 smithi110 ceph-mon[28069]: pgmap v9276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:26:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:08 smithi110 ceph-mon[28069]: pgmap v9277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:26:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:10 smithi196 ceph-mon[32572]: pgmap v9278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:10 smithi110 ceph-mon[28069]: pgmap v9278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:10 smithi193 ceph-mon[32782]: pgmap v9278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:11 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16687.127064 secs 2024-04-26T16:26:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:11 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16687.127064 secs 2024-04-26T16:26:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:11 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16687.127064 secs 2024-04-26T16:26:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:12 smithi110 ceph-mon[28069]: pgmap v9279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T16:26:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:12 smithi193 ceph-mon[32782]: pgmap v9279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T16:26:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:12 smithi196 ceph-mon[32572]: pgmap v9279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T16:26:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:14 smithi196 ceph-mon[32572]: pgmap v9280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:14 smithi110 ceph-mon[28069]: pgmap v9280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:14 smithi193 ceph-mon[32782]: pgmap v9280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:16 smithi196 ceph-mon[32572]: pgmap v9281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:16 smithi110 ceph-mon[28069]: pgmap v9281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:16 smithi193 ceph-mon[32782]: pgmap v9281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:26:17.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16692.127201 secs 2024-04-26T16:26:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16692.127201 secs 2024-04-26T16:26:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16692.127201 secs 2024-04-26T16:26:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:18 smithi196 ceph-mon[32572]: pgmap v9282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:26:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:18 smithi110 ceph-mon[28069]: pgmap v9282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:26:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:18 smithi193 ceph-mon[32782]: pgmap v9282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:26:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:20 smithi196 ceph-mon[32572]: pgmap v9283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:20 smithi110 ceph-mon[28069]: pgmap v9283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:20 smithi193 ceph-mon[32782]: pgmap v9283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16697.127327 secs 2024-04-26T16:26:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16697.127327 secs 2024-04-26T16:26:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16697.127327 secs 2024-04-26T16:26:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:22 smithi110 ceph-mon[28069]: pgmap v9284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:22 smithi193 ceph-mon[32782]: pgmap v9284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:22 smithi196 ceph-mon[32572]: pgmap v9284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:24 smithi196 ceph-mon[32572]: pgmap v9285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:24 smithi110 ceph-mon[28069]: pgmap v9285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:24 smithi193 ceph-mon[32782]: pgmap v9285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:26 smithi196 ceph-mon[32572]: pgmap v9286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:26 smithi110 ceph-mon[28069]: pgmap v9286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:26 smithi193 ceph-mon[32782]: pgmap v9286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16702.127465 secs 2024-04-26T16:26:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16702.127465 secs 2024-04-26T16:26:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16702.127465 secs 2024-04-26T16:26:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:28 smithi196 ceph-mon[32572]: pgmap v9287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:28 smithi110 ceph-mon[28069]: pgmap v9287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:28 smithi193 ceph-mon[32782]: pgmap v9287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:30 smithi196 ceph-mon[32572]: pgmap v9288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:30 smithi110 ceph-mon[28069]: pgmap v9288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:30 smithi193 ceph-mon[32782]: pgmap v9288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16707.127623 secs 2024-04-26T16:26:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16707.127623 secs 2024-04-26T16:26:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16707.127623 secs 2024-04-26T16:26:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:32 smithi110 ceph-mon[28069]: pgmap v9289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:32 smithi193 ceph-mon[32782]: pgmap v9289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:32 smithi196 ceph-mon[32572]: pgmap v9289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:34 smithi196 ceph-mon[32572]: pgmap v9290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:34 smithi110 ceph-mon[28069]: pgmap v9290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:34 smithi193 ceph-mon[32782]: pgmap v9290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:36 smithi196 ceph-mon[32572]: pgmap v9291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:36 smithi110 ceph-mon[28069]: pgmap v9291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:36 smithi193 ceph-mon[32782]: pgmap v9291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:37.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16712.127759 secs 2024-04-26T16:26:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16712.127759 secs 2024-04-26T16:26:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16712.127759 secs 2024-04-26T16:26:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:38 smithi196 ceph-mon[32572]: pgmap v9292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:38 smithi110 ceph-mon[28069]: pgmap v9292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:38 smithi193 ceph-mon[32782]: pgmap v9292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:40.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:40 smithi193 ceph-mon[32782]: pgmap v9293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:40 smithi196 ceph-mon[32572]: pgmap v9293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:40 smithi110 ceph-mon[28069]: pgmap v9293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16717.127894 secs 2024-04-26T16:26:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16717.127894 secs 2024-04-26T16:26:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16717.127894 secs 2024-04-26T16:26:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:42 smithi110 ceph-mon[28069]: pgmap v9294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:42 smithi193 ceph-mon[32782]: pgmap v9294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:42 smithi196 ceph-mon[32572]: pgmap v9294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:44 smithi196 ceph-mon[32572]: pgmap v9295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:44 smithi110 ceph-mon[28069]: pgmap v9295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:44 smithi193 ceph-mon[32782]: pgmap v9295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:46 smithi196 ceph-mon[32572]: pgmap v9296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:46 smithi110 ceph-mon[28069]: pgmap v9296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:46 smithi193 ceph-mon[32782]: pgmap v9296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:47.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16722.128030 secs 2024-04-26T16:26:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16722.128030 secs 2024-04-26T16:26:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16722.128030 secs 2024-04-26T16:26:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:48 smithi196 ceph-mon[32572]: pgmap v9297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:48 smithi110 ceph-mon[28069]: pgmap v9297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:48 smithi193 ceph-mon[32782]: pgmap v9297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:50 smithi196 ceph-mon[32572]: pgmap v9298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:50 smithi110 ceph-mon[28069]: pgmap v9298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:50 smithi193 ceph-mon[32782]: pgmap v9298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16727.128163 secs 2024-04-26T16:26:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16727.128163 secs 2024-04-26T16:26:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16727.128163 secs 2024-04-26T16:26:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:52 smithi110 ceph-mon[28069]: pgmap v9299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:52 smithi193 ceph-mon[32782]: pgmap v9299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:52 smithi196 ceph-mon[32572]: pgmap v9299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:54 smithi196 ceph-mon[32572]: pgmap v9300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:54 smithi110 ceph-mon[28069]: pgmap v9300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:54 smithi193 ceph-mon[32782]: pgmap v9300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:56 smithi196 ceph-mon[32572]: pgmap v9301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:56 smithi110 ceph-mon[28069]: pgmap v9301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:56 smithi193 ceph-mon[32782]: pgmap v9301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:26:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16732.128307 secs 2024-04-26T16:26:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16732.128307 secs 2024-04-26T16:26:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16732.128307 secs 2024-04-26T16:26:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:26:58 smithi196 ceph-mon[32572]: pgmap v9302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:26:58 smithi110 ceph-mon[28069]: pgmap v9302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:26:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:26:58 smithi193 ceph-mon[32782]: pgmap v9302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:00 smithi196 ceph-mon[32572]: pgmap v9303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:00 smithi110 ceph-mon[28069]: pgmap v9303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:00 smithi193 ceph-mon[32782]: pgmap v9303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16737.128403 secs 2024-04-26T16:27:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16737.128403 secs 2024-04-26T16:27:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16737.128403 secs 2024-04-26T16:27:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:02 smithi110 ceph-mon[28069]: pgmap v9304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:02 smithi193 ceph-mon[32782]: pgmap v9304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:02 smithi196 ceph-mon[32572]: pgmap v9304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:04 smithi196 ceph-mon[32572]: pgmap v9305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:04 smithi110 ceph-mon[28069]: pgmap v9305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:04 smithi193 ceph-mon[32782]: pgmap v9305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:06 smithi196 ceph-mon[32572]: pgmap v9306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:06 smithi110 ceph-mon[28069]: pgmap v9306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:06 smithi193 ceph-mon[32782]: pgmap v9306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16742.128518 secs 2024-04-26T16:27:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16742.128518 secs 2024-04-26T16:27:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16742.128518 secs 2024-04-26T16:27:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:08 smithi196 ceph-mon[32572]: pgmap v9307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:08 smithi110 ceph-mon[28069]: pgmap v9307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:08 smithi193 ceph-mon[32782]: pgmap v9307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:27:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:27:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:27:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:10 smithi196 ceph-mon[32572]: pgmap v9308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:10.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:10 smithi193 ceph-mon[32782]: pgmap v9308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:10 smithi110 ceph-mon[28069]: pgmap v9308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:11.993 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:11 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 16747.128609 secs 2024-04-26T16:27:11.993 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:11 smithi193 ceph-mon[32782]: slow request 2884.464742 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:27:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:11 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 16747.128609 secs 2024-04-26T16:27:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:11 smithi110 ceph-mon[28069]: slow request 2884.464742 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:27:12.139 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:11 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 16747.128609 secs 2024-04-26T16:27:12.139 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:11 smithi196 ceph-mon[32572]: slow request 2884.464742 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:27:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:12 smithi110 ceph-mon[28069]: pgmap v9309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.098 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:12 smithi196 ceph-mon[32572]: pgmap v9309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:13.098 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.098 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.098 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.098 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:12 smithi193 ceph-mon[32782]: pgmap v9309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:27:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:27:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:13 smithi110 ceph-mon[28069]: pgmap v9310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T16:27:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:13 smithi110 ceph-mon[28069]: pgmap v9311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:27:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:27:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:13 smithi193 ceph-mon[32782]: pgmap v9310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T16:27:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:13 smithi193 ceph-mon[32782]: pgmap v9311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:27:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:27:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:13 smithi196 ceph-mon[32572]: pgmap v9310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T16:27:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:13 smithi196 ceph-mon[32572]: pgmap v9311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:27:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:15 smithi193 ceph-mon[32782]: pgmap v9312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:15 smithi196 ceph-mon[32572]: pgmap v9312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:15 smithi110 ceph-mon[28069]: pgmap v9312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16752.128684 secs 2024-04-26T16:27:17.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16752.128684 secs 2024-04-26T16:27:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16752.128684 secs 2024-04-26T16:27:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:17 smithi193 ceph-mon[32782]: pgmap v9313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 587 B/s rd, 1 op/s 2024-04-26T16:27:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:17 smithi196 ceph-mon[32572]: pgmap v9313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 587 B/s rd, 1 op/s 2024-04-26T16:27:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:17 smithi110 ceph-mon[28069]: pgmap v9313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 587 B/s rd, 1 op/s 2024-04-26T16:27:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:27:19.133+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:27:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:27:19.133+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:27:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:27:19.133+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 131 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:27:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:27:19.133+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 131 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:27:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:19 smithi193 ceph-mon[32782]: pgmap v9314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:19 smithi196 ceph-mon[32572]: pgmap v9314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:19 smithi110 ceph-mon[28069]: pgmap v9314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:21 smithi193 ceph-mon[32782]: pgmap v9315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16757.128790 secs 2024-04-26T16:27:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:21 smithi196 ceph-mon[32572]: pgmap v9315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16757.128790 secs 2024-04-26T16:27:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:21 smithi110 ceph-mon[28069]: pgmap v9315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:27:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16757.128790 secs 2024-04-26T16:27:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:23 smithi196 ceph-mon[32572]: pgmap v9316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:27:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:23 smithi110 ceph-mon[28069]: pgmap v9316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:27:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:23 smithi193 ceph-mon[32782]: pgmap v9316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:27:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:25 smithi196 ceph-mon[32572]: pgmap v9317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:25 smithi110 ceph-mon[28069]: pgmap v9317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:25 smithi193 ceph-mon[32782]: pgmap v9317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16762.128918 secs 2024-04-26T16:27:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16762.128918 secs 2024-04-26T16:27:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16762.128918 secs 2024-04-26T16:27:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:27 smithi196 ceph-mon[32572]: pgmap v9318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:27 smithi110 ceph-mon[28069]: pgmap v9318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:27 smithi193 ceph-mon[32782]: pgmap v9318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:29 smithi196 ceph-mon[32572]: pgmap v9319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:29 smithi110 ceph-mon[28069]: pgmap v9319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:29 smithi193 ceph-mon[32782]: pgmap v9319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:31 smithi196 ceph-mon[32572]: pgmap v9320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16767.129038 secs 2024-04-26T16:27:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:31 smithi110 ceph-mon[28069]: pgmap v9320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16767.129038 secs 2024-04-26T16:27:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:31 smithi193 ceph-mon[32782]: pgmap v9320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16767.129038 secs 2024-04-26T16:27:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:33 smithi196 ceph-mon[32572]: pgmap v9321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:33 smithi110 ceph-mon[28069]: pgmap v9321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:33 smithi193 ceph-mon[32782]: pgmap v9321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:35 smithi196 ceph-mon[32572]: pgmap v9322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:35 smithi110 ceph-mon[28069]: pgmap v9322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:35 smithi193 ceph-mon[32782]: pgmap v9322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:37.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16772.129150 secs 2024-04-26T16:27:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16772.129150 secs 2024-04-26T16:27:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16772.129150 secs 2024-04-26T16:27:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:37 smithi196 ceph-mon[32572]: pgmap v9323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:37 smithi110 ceph-mon[28069]: pgmap v9323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:37 smithi193 ceph-mon[32782]: pgmap v9323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:39 smithi196 ceph-mon[32572]: pgmap v9324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:39 smithi110 ceph-mon[28069]: pgmap v9324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:39 smithi193 ceph-mon[32782]: pgmap v9324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:41 smithi196 ceph-mon[32572]: pgmap v9325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16777.129292 secs 2024-04-26T16:27:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:41 smithi110 ceph-mon[28069]: pgmap v9325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16777.129292 secs 2024-04-26T16:27:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:41 smithi193 ceph-mon[32782]: pgmap v9325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16777.129292 secs 2024-04-26T16:27:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:43 smithi196 ceph-mon[32572]: pgmap v9326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:43 smithi110 ceph-mon[28069]: pgmap v9326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:43 smithi193 ceph-mon[32782]: pgmap v9326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:45 smithi196 ceph-mon[32572]: pgmap v9327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:45 smithi110 ceph-mon[28069]: pgmap v9327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:45 smithi193 ceph-mon[32782]: pgmap v9327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16782.129413 secs 2024-04-26T16:27:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16782.129413 secs 2024-04-26T16:27:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16782.129413 secs 2024-04-26T16:27:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:47 smithi196 ceph-mon[32572]: pgmap v9328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:47 smithi110 ceph-mon[28069]: pgmap v9328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:47 smithi193 ceph-mon[32782]: pgmap v9328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:49 smithi196 ceph-mon[32572]: pgmap v9329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:49 smithi110 ceph-mon[28069]: pgmap v9329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:49 smithi193 ceph-mon[32782]: pgmap v9329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:51 smithi196 ceph-mon[32572]: pgmap v9330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16787.129549 secs 2024-04-26T16:27:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:51 smithi110 ceph-mon[28069]: pgmap v9330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16787.129549 secs 2024-04-26T16:27:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:51 smithi193 ceph-mon[32782]: pgmap v9330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16787.129549 secs 2024-04-26T16:27:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:53 smithi196 ceph-mon[32572]: pgmap v9331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:53 smithi110 ceph-mon[28069]: pgmap v9331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:53 smithi193 ceph-mon[32782]: pgmap v9331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:27:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:55 smithi196 ceph-mon[32572]: pgmap v9332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:56.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:55 smithi110 ceph-mon[28069]: pgmap v9332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:55 smithi193 ceph-mon[32782]: pgmap v9332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16792.129666 secs 2024-04-26T16:27:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16792.129666 secs 2024-04-26T16:27:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16792.129666 secs 2024-04-26T16:27:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:27:57 smithi196 ceph-mon[32572]: pgmap v9333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:57 smithi110 ceph-mon[28069]: pgmap v9333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:27:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:27:57 smithi193 ceph-mon[32782]: pgmap v9333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:00 smithi196 ceph-mon[32572]: pgmap v9334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:27:59 smithi110 ceph-mon[28069]: pgmap v9334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:00 smithi193 ceph-mon[32782]: pgmap v9334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:02 smithi110 ceph-mon[28069]: pgmap v9335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16797.129778 secs 2024-04-26T16:28:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:02 smithi193 ceph-mon[32782]: pgmap v9335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16797.129778 secs 2024-04-26T16:28:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:02 smithi196 ceph-mon[32572]: pgmap v9335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16797.129778 secs 2024-04-26T16:28:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:04 smithi110 ceph-mon[28069]: pgmap v9336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:04 smithi193 ceph-mon[32782]: pgmap v9336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:04 smithi196 ceph-mon[32572]: pgmap v9336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:06 smithi110 ceph-mon[28069]: pgmap v9337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:06 smithi193 ceph-mon[32782]: pgmap v9337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:06 smithi196 ceph-mon[32572]: pgmap v9337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16802.129887 secs 2024-04-26T16:28:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16802.129887 secs 2024-04-26T16:28:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16802.129887 secs 2024-04-26T16:28:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:08 smithi110 ceph-mon[28069]: pgmap v9338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:08 smithi193 ceph-mon[32782]: pgmap v9338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:08 smithi196 ceph-mon[32572]: pgmap v9338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:10 smithi110 ceph-mon[28069]: pgmap v9339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:10 smithi193 ceph-mon[32782]: pgmap v9339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:10 smithi196 ceph-mon[32572]: pgmap v9339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:12.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:12 smithi110 ceph-mon[28069]: pgmap v9340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:12.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 16807.129988 secs 2024-04-26T16:28:12.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:12 smithi110 ceph-mon[28069]: slow request 1443.607254 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:28:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:12 smithi193 ceph-mon[32782]: pgmap v9340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 16807.129988 secs 2024-04-26T16:28:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:12 smithi193 ceph-mon[32782]: slow request 1443.607254 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:28:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:12 smithi196 ceph-mon[32572]: pgmap v9340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 16807.129988 secs 2024-04-26T16:28:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:12 smithi196 ceph-mon[32572]: slow request 1443.607254 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:28:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:14 smithi193 ceph-mon[32782]: pgmap v9341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:28:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:14 smithi196 ceph-mon[32572]: pgmap v9341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:28:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:14 smithi110 ceph-mon[28069]: pgmap v9341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:28:15.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:28:15.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:28:15.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:28:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:28:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:28:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:28:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:28:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:28:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:28:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:16 smithi193 ceph-mon[32782]: pgmap v9342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T16:28:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:16 smithi193 ceph-mon[32782]: pgmap v9343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:16 smithi196 ceph-mon[32572]: pgmap v9342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T16:28:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:16 smithi196 ceph-mon[32572]: pgmap v9343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:16 smithi110 ceph-mon[28069]: pgmap v9342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T16:28:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:16 smithi110 ceph-mon[28069]: pgmap v9343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16812.130124 secs 2024-04-26T16:28:17.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16812.130124 secs 2024-04-26T16:28:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16812.130124 secs 2024-04-26T16:28:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:18 smithi193 ceph-mon[32782]: pgmap v9344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:18 smithi196 ceph-mon[32572]: pgmap v9344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:18 smithi110 ceph-mon[28069]: pgmap v9344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:20 smithi193 ceph-mon[32782]: pgmap v9345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:20 smithi196 ceph-mon[32572]: pgmap v9345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:20 smithi110 ceph-mon[28069]: pgmap v9345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:22 smithi193 ceph-mon[32782]: pgmap v9346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16817.130256 secs 2024-04-26T16:28:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:22 smithi196 ceph-mon[32572]: pgmap v9346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16817.130256 secs 2024-04-26T16:28:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:22 smithi110 ceph-mon[28069]: pgmap v9346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:28:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16817.130256 secs 2024-04-26T16:28:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:24 smithi193 ceph-mon[32782]: pgmap v9347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:28:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:24 smithi196 ceph-mon[32572]: pgmap v9347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:28:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:24 smithi110 ceph-mon[28069]: pgmap v9347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:28:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:26 smithi193 ceph-mon[32782]: pgmap v9348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:28:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:26 smithi196 ceph-mon[32572]: pgmap v9348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:28:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:26 smithi110 ceph-mon[28069]: pgmap v9348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:28:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16822.130390 secs 2024-04-26T16:28:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16822.130390 secs 2024-04-26T16:28:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16822.130390 secs 2024-04-26T16:28:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:28 smithi193 ceph-mon[32782]: pgmap v9349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:28 smithi196 ceph-mon[32572]: pgmap v9349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:28 smithi110 ceph-mon[28069]: pgmap v9349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:30 smithi193 ceph-mon[32782]: pgmap v9350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:30 smithi196 ceph-mon[32572]: pgmap v9350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:30 smithi110 ceph-mon[28069]: pgmap v9350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:32 smithi193 ceph-mon[32782]: pgmap v9351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16827.130554 secs 2024-04-26T16:28:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:32 smithi196 ceph-mon[32572]: pgmap v9351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16827.130554 secs 2024-04-26T16:28:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:32 smithi110 ceph-mon[28069]: pgmap v9351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16827.130554 secs 2024-04-26T16:28:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:33 smithi196 ceph-mon[32572]: pgmap v9352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:33 smithi110 ceph-mon[28069]: pgmap v9352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:33 smithi193 ceph-mon[32782]: pgmap v9352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:35 smithi196 ceph-mon[32572]: pgmap v9353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:28:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:35 smithi110 ceph-mon[28069]: pgmap v9353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:28:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:35 smithi193 ceph-mon[32782]: pgmap v9353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:28:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:37 smithi196 ceph-mon[32572]: pgmap v9354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16832.130671 secs 2024-04-26T16:28:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:37 smithi110 ceph-mon[28069]: pgmap v9354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16832.130671 secs 2024-04-26T16:28:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:37 smithi193 ceph-mon[32782]: pgmap v9354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16832.130671 secs 2024-04-26T16:28:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:39 smithi196 ceph-mon[32572]: pgmap v9355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:39 smithi110 ceph-mon[28069]: pgmap v9355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:39 smithi193 ceph-mon[32782]: pgmap v9355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:41 smithi196 ceph-mon[32572]: pgmap v9356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:41 smithi110 ceph-mon[28069]: pgmap v9356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:41 smithi193 ceph-mon[32782]: pgmap v9356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16837.130793 secs 2024-04-26T16:28:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16837.130793 secs 2024-04-26T16:28:42.857 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16837.130793 secs 2024-04-26T16:28:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:43 smithi196 ceph-mon[32572]: pgmap v9357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:43 smithi110 ceph-mon[28069]: pgmap v9357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:43 smithi193 ceph-mon[32782]: pgmap v9357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:45 smithi196 ceph-mon[32572]: pgmap v9358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:28:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:45 smithi110 ceph-mon[28069]: pgmap v9358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:28:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:45 smithi193 ceph-mon[32782]: pgmap v9358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:28:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:47 smithi196 ceph-mon[32572]: pgmap v9359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16842.130894 secs 2024-04-26T16:28:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:47 smithi110 ceph-mon[28069]: pgmap v9359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16842.130894 secs 2024-04-26T16:28:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:47 smithi193 ceph-mon[32782]: pgmap v9359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16842.130894 secs 2024-04-26T16:28:49.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:28:49.148+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:28:49.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:28:49.148+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:28:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:28:49.149+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 132 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:28:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:28:49.149+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 132 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:28:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:49 smithi196 ceph-mon[32572]: pgmap v9360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:49 smithi110 ceph-mon[28069]: pgmap v9360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:49 smithi193 ceph-mon[32782]: pgmap v9360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:51 smithi196 ceph-mon[32572]: pgmap v9361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:51 smithi110 ceph-mon[28069]: pgmap v9361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:51 smithi193 ceph-mon[32782]: pgmap v9361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16847.131015 secs 2024-04-26T16:28:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16847.131015 secs 2024-04-26T16:28:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16847.131015 secs 2024-04-26T16:28:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:53 smithi196 ceph-mon[32572]: pgmap v9362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:53 smithi110 ceph-mon[28069]: pgmap v9362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:53 smithi193 ceph-mon[32782]: pgmap v9362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:55 smithi196 ceph-mon[32572]: pgmap v9363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:28:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:55 smithi110 ceph-mon[28069]: pgmap v9363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:28:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:55 smithi193 ceph-mon[32782]: pgmap v9363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:28:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:57 smithi110 ceph-mon[28069]: pgmap v9364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16852.131108 secs 2024-04-26T16:28:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:57 smithi193 ceph-mon[32782]: pgmap v9364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16852.131108 secs 2024-04-26T16:28:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:57 smithi196 ceph-mon[32572]: pgmap v9364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:28:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16852.131108 secs 2024-04-26T16:28:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:28:59 smithi110 ceph-mon[28069]: pgmap v9365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:28:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:28:59 smithi193 ceph-mon[32782]: pgmap v9365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:28:59 smithi196 ceph-mon[32572]: pgmap v9365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:01 smithi110 ceph-mon[28069]: pgmap v9366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:01 smithi193 ceph-mon[32782]: pgmap v9366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:01 smithi196 ceph-mon[32572]: pgmap v9366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16857.131227 secs 2024-04-26T16:29:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16857.131227 secs 2024-04-26T16:29:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16857.131227 secs 2024-04-26T16:29:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:03 smithi110 ceph-mon[28069]: pgmap v9367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:03 smithi193 ceph-mon[32782]: pgmap v9367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:03 smithi196 ceph-mon[32572]: pgmap v9367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:05 smithi110 ceph-mon[28069]: pgmap v9368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:29:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:05 smithi193 ceph-mon[32782]: pgmap v9368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:29:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:05 smithi196 ceph-mon[32572]: pgmap v9368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:29:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:07 smithi193 ceph-mon[32782]: pgmap v9369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16862.131341 secs 2024-04-26T16:29:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:07 smithi196 ceph-mon[32572]: pgmap v9369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16862.131341 secs 2024-04-26T16:29:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:07 smithi110 ceph-mon[28069]: pgmap v9369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16862.131341 secs 2024-04-26T16:29:08.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:29:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:29:08.480+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:29:08.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:29:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:29:08.480+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:29:08.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:29:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:29:08.480+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:29:08.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:29:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:29:08.480+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:29:08.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:29:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:29:08.480+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:29:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:09 smithi193 ceph-mon[32782]: pgmap v9370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:09 smithi196 ceph-mon[32572]: pgmap v9370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:09 smithi110 ceph-mon[28069]: pgmap v9370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:11 smithi193 ceph-mon[32782]: pgmap v9371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:11 smithi196 ceph-mon[32572]: pgmap v9371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:11 smithi110 ceph-mon[28069]: pgmap v9371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16867.131460 secs 2024-04-26T16:29:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16867.131460 secs 2024-04-26T16:29:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16867.131460 secs 2024-04-26T16:29:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:13 smithi193 ceph-mon[32782]: pgmap v9372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T16:29:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:13 smithi196 ceph-mon[32572]: pgmap v9372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T16:29:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:13 smithi110 ceph-mon[28069]: pgmap v9372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T16:29:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:15 smithi193 ceph-mon[32782]: pgmap v9373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:29:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:29:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:15 smithi196 ceph-mon[32572]: pgmap v9373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:29:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:29:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:15 smithi110 ceph-mon[28069]: pgmap v9373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:29:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:29:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:17 smithi110 ceph-mon[28069]: pgmap v9374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:29:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16872.131589 secs 2024-04-26T16:29:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:17 smithi193 ceph-mon[32782]: pgmap v9374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:29:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16872.131589 secs 2024-04-26T16:29:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:17 smithi196 ceph-mon[32572]: pgmap v9374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:29:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16872.131589 secs 2024-04-26T16:29:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:19 smithi193 ceph-mon[32782]: pgmap v9375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:29:19.930 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:19 smithi110 ceph-mon[28069]: pgmap v9375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:29:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:19 smithi196 ceph-mon[32572]: pgmap v9375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T16:29:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:21 smithi110 ceph-mon[28069]: pgmap v9376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:29:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:29:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:21 smithi193 ceph-mon[32782]: pgmap v9376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:29:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:29:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:21 smithi196 ceph-mon[32572]: pgmap v9376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T16:29:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:29:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16877.131716 secs 2024-04-26T16:29:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:29:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:29:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:29:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:22 smithi193 ceph-mon[32782]: pgmap v9377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 B/s rd, 182 B/s wr, 2 op/s 2024-04-26T16:29:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:22 smithi193 ceph-mon[32782]: pgmap v9378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 667 B/s rd, 111 B/s wr, 1 op/s 2024-04-26T16:29:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:29:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16877.131716 secs 2024-04-26T16:29:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:29:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:29:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:29:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:22 smithi196 ceph-mon[32572]: pgmap v9377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 B/s rd, 182 B/s wr, 2 op/s 2024-04-26T16:29:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:22 smithi196 ceph-mon[32572]: pgmap v9378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 667 B/s rd, 111 B/s wr, 1 op/s 2024-04-26T16:29:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:29:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16877.131716 secs 2024-04-26T16:29:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:29:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:29:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:29:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:22 smithi110 ceph-mon[28069]: pgmap v9377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 B/s rd, 182 B/s wr, 2 op/s 2024-04-26T16:29:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:22 smithi110 ceph-mon[28069]: pgmap v9378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 667 B/s rd, 111 B/s wr, 1 op/s 2024-04-26T16:29:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:29:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:24 smithi196 ceph-mon[32572]: pgmap v9379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:24 smithi110 ceph-mon[28069]: pgmap v9379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:24 smithi193 ceph-mon[32782]: pgmap v9379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:26 smithi196 ceph-mon[32572]: pgmap v9380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:26 smithi110 ceph-mon[28069]: pgmap v9380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:26 smithi193 ceph-mon[32782]: pgmap v9380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16882.131830 secs 2024-04-26T16:29:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16882.131830 secs 2024-04-26T16:29:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16882.131830 secs 2024-04-26T16:29:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:28 smithi196 ceph-mon[32572]: pgmap v9381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:28 smithi110 ceph-mon[28069]: pgmap v9381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:28 smithi193 ceph-mon[32782]: pgmap v9381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:30.970 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:30 smithi110 ceph-mon[28069]: pgmap v9382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:30 smithi196 ceph-mon[32572]: pgmap v9382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:30 smithi193 ceph-mon[32782]: pgmap v9382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:29:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16887.131940 secs 2024-04-26T16:29:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:32 smithi196 ceph-mon[32572]: pgmap v9383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:29:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16887.131940 secs 2024-04-26T16:29:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:32 smithi110 ceph-mon[28069]: pgmap v9383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:29:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16887.131940 secs 2024-04-26T16:29:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:32 smithi193 ceph-mon[32782]: pgmap v9383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:29:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:34 smithi196 ceph-mon[32572]: pgmap v9384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:34 smithi110 ceph-mon[28069]: pgmap v9384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:34 smithi193 ceph-mon[32782]: pgmap v9384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:36 smithi196 ceph-mon[32572]: pgmap v9385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:36 smithi110 ceph-mon[28069]: pgmap v9385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:36 smithi193 ceph-mon[32782]: pgmap v9385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16892.132058 secs 2024-04-26T16:29:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16892.132058 secs 2024-04-26T16:29:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16892.132058 secs 2024-04-26T16:29:38.973 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:38 smithi110 ceph-mon[28069]: pgmap v9386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:38 smithi196 ceph-mon[32572]: pgmap v9386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:38 smithi193 ceph-mon[32782]: pgmap v9386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:40 smithi110 ceph-mon[28069]: pgmap v9387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:40 smithi196 ceph-mon[32572]: pgmap v9387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:40 smithi193 ceph-mon[32782]: pgmap v9387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16897.132176 secs 2024-04-26T16:29:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:42 smithi196 ceph-mon[32572]: pgmap v9388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16897.132176 secs 2024-04-26T16:29:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:42 smithi110 ceph-mon[28069]: pgmap v9388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16897.132176 secs 2024-04-26T16:29:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:42 smithi193 ceph-mon[32782]: pgmap v9388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:44 smithi196 ceph-mon[32572]: pgmap v9389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:44 smithi110 ceph-mon[28069]: pgmap v9389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:44 smithi193 ceph-mon[32782]: pgmap v9389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:46 smithi196 ceph-mon[32572]: pgmap v9390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:46 smithi110 ceph-mon[28069]: pgmap v9390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:46 smithi193 ceph-mon[32782]: pgmap v9390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16902.132251 secs 2024-04-26T16:29:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16902.132251 secs 2024-04-26T16:29:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16902.132251 secs 2024-04-26T16:29:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:48 smithi196 ceph-mon[32572]: pgmap v9391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:48 smithi110 ceph-mon[28069]: pgmap v9391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:48 smithi193 ceph-mon[32782]: pgmap v9391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:50 smithi196 ceph-mon[32572]: pgmap v9392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:50 smithi110 ceph-mon[28069]: pgmap v9392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:50 smithi193 ceph-mon[32782]: pgmap v9392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16907.132368 secs 2024-04-26T16:29:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16907.132368 secs 2024-04-26T16:29:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16907.132368 secs 2024-04-26T16:29:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:52 smithi110 ceph-mon[28069]: pgmap v9393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:52 smithi193 ceph-mon[32782]: pgmap v9393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:52 smithi196 ceph-mon[32572]: pgmap v9393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:54 smithi110 ceph-mon[28069]: pgmap v9394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:54 smithi193 ceph-mon[32782]: pgmap v9394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:54 smithi196 ceph-mon[32572]: pgmap v9394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:56 smithi110 ceph-mon[28069]: pgmap v9395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16912.132467 secs 2024-04-26T16:29:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:56 smithi193 ceph-mon[32782]: pgmap v9395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16912.132467 secs 2024-04-26T16:29:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:56 smithi196 ceph-mon[32572]: pgmap v9395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:29:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16912.132467 secs 2024-04-26T16:29:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:29:58 smithi110 ceph-mon[28069]: pgmap v9396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:29:58 smithi193 ceph-mon[32782]: pgmap v9396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:29:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:29:58 smithi196 ceph-mon[32572]: pgmap v9396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:00 smithi110 ceph-mon[28069]: pgmap v9397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:30:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:00 smithi193 ceph-mon[32782]: pgmap v9397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:30:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:00 smithi196 ceph-mon[32572]: pgmap v9397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:30:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16917.132588 secs 2024-04-26T16:30:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16917.132588 secs 2024-04-26T16:30:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16917.132588 secs 2024-04-26T16:30:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:02 smithi193 ceph-mon[32782]: pgmap v9398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:02 smithi196 ceph-mon[32572]: pgmap v9398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:02 smithi110 ceph-mon[28069]: pgmap v9398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:04 smithi193 ceph-mon[32782]: pgmap v9399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:04 smithi196 ceph-mon[32572]: pgmap v9399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:04 smithi110 ceph-mon[28069]: pgmap v9399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:06 smithi196 ceph-mon[32572]: pgmap v9400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:06 smithi110 ceph-mon[28069]: pgmap v9400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:06 smithi193 ceph-mon[32782]: pgmap v9400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16922.132719 secs 2024-04-26T16:30:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16922.132719 secs 2024-04-26T16:30:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16922.132719 secs 2024-04-26T16:30:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:08 smithi196 ceph-mon[32572]: pgmap v9401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:08 smithi110 ceph-mon[28069]: pgmap v9401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:08 smithi193 ceph-mon[32782]: pgmap v9401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:10 smithi196 ceph-mon[32572]: pgmap v9402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:10 smithi110 ceph-mon[28069]: pgmap v9402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:10 smithi193 ceph-mon[32782]: pgmap v9402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16927.132835 secs 2024-04-26T16:30:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:12 smithi196 ceph-mon[32572]: pgmap v9403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16927.132835 secs 2024-04-26T16:30:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:12 smithi110 ceph-mon[28069]: pgmap v9403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16927.132835 secs 2024-04-26T16:30:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:12 smithi193 ceph-mon[32782]: pgmap v9403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:14 smithi196 ceph-mon[32572]: pgmap v9404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:14 smithi110 ceph-mon[28069]: pgmap v9404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:14 smithi193 ceph-mon[32782]: pgmap v9404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:16 smithi196 ceph-mon[32572]: pgmap v9405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:16 smithi110 ceph-mon[28069]: pgmap v9405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:16 smithi193 ceph-mon[32782]: pgmap v9405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16932.132957 secs 2024-04-26T16:30:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16932.132957 secs 2024-04-26T16:30:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16932.132957 secs 2024-04-26T16:30:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:18 smithi196 ceph-mon[32572]: pgmap v9406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:18 smithi110 ceph-mon[28069]: pgmap v9406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:18 smithi193 ceph-mon[32782]: pgmap v9406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:30:19.164+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:30:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:30:19.164+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:30:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:30:19.165+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 133 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:30:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:30:19.165+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 133 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:30:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:20 smithi196 ceph-mon[32572]: pgmap v9407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:20 smithi110 ceph-mon[28069]: pgmap v9407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:20 smithi193 ceph-mon[32782]: pgmap v9407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16937.133075 secs 2024-04-26T16:30:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:22 smithi196 ceph-mon[32572]: pgmap v9408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:30:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:30:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16937.133075 secs 2024-04-26T16:30:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:22 smithi110 ceph-mon[28069]: pgmap v9408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:30:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:30:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16937.133075 secs 2024-04-26T16:30:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:22 smithi193 ceph-mon[32782]: pgmap v9408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:30:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:30:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:30:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:30:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:30:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:24 smithi110 ceph-mon[28069]: pgmap v9409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:30:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:30:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:24 smithi110 ceph-mon[28069]: pgmap v9410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T16:30:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:24 smithi110 ceph-mon[28069]: pgmap v9411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:30:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:24 smithi193 ceph-mon[32782]: pgmap v9409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:30:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:30:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:24 smithi193 ceph-mon[32782]: pgmap v9410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T16:30:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:24 smithi193 ceph-mon[32782]: pgmap v9411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:30:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:24 smithi196 ceph-mon[32572]: pgmap v9409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:30:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:30:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:24 smithi196 ceph-mon[32572]: pgmap v9410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T16:30:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:24 smithi196 ceph-mon[32572]: pgmap v9411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:30:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:27 smithi193 ceph-mon[32782]: pgmap v9412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:30:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16942.133192 secs 2024-04-26T16:30:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:27 smithi196 ceph-mon[32572]: pgmap v9412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:30:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16942.133192 secs 2024-04-26T16:30:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:27 smithi110 ceph-mon[28069]: pgmap v9412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:30:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16942.133192 secs 2024-04-26T16:30:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:29 smithi193 ceph-mon[32782]: pgmap v9413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:29 smithi196 ceph-mon[32572]: pgmap v9413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:29 smithi110 ceph-mon[28069]: pgmap v9413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:31 smithi193 ceph-mon[32782]: pgmap v9414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:31 smithi196 ceph-mon[32572]: pgmap v9414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:31 smithi110 ceph-mon[28069]: pgmap v9414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16947.133312 secs 2024-04-26T16:30:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16947.133312 secs 2024-04-26T16:30:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16947.133312 secs 2024-04-26T16:30:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:33 smithi193 ceph-mon[32782]: pgmap v9415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:30:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:33 smithi196 ceph-mon[32572]: pgmap v9415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:30:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:33 smithi110 ceph-mon[28069]: pgmap v9415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:30:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:35 smithi193 ceph-mon[32782]: pgmap v9416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:30:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:35 smithi196 ceph-mon[32572]: pgmap v9416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:30:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:35 smithi110 ceph-mon[28069]: pgmap v9416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:30:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:37 smithi193 ceph-mon[32782]: pgmap v9417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16952.133426 secs 2024-04-26T16:30:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:37 smithi196 ceph-mon[32572]: pgmap v9417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16952.133426 secs 2024-04-26T16:30:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:37 smithi110 ceph-mon[28069]: pgmap v9417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16952.133426 secs 2024-04-26T16:30:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:39 smithi196 ceph-mon[32572]: pgmap v9418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:39 smithi110 ceph-mon[28069]: pgmap v9418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:39 smithi193 ceph-mon[32782]: pgmap v9418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:41 smithi196 ceph-mon[32572]: pgmap v9419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:41 smithi110 ceph-mon[28069]: pgmap v9419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:41 smithi193 ceph-mon[32782]: pgmap v9419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16957.133547 secs 2024-04-26T16:30:42.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16957.133547 secs 2024-04-26T16:30:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16957.133547 secs 2024-04-26T16:30:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:43 smithi196 ceph-mon[32572]: pgmap v9420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:43 smithi110 ceph-mon[28069]: pgmap v9420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:43 smithi193 ceph-mon[32782]: pgmap v9420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:44 smithi196 ceph-mon[32572]: pgmap v9421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:44 smithi110 ceph-mon[28069]: pgmap v9421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:44 smithi193 ceph-mon[32782]: pgmap v9421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:47 smithi193 ceph-mon[32782]: pgmap v9422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16962.133662 secs 2024-04-26T16:30:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:47 smithi196 ceph-mon[32572]: pgmap v9422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16962.133662 secs 2024-04-26T16:30:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:47 smithi110 ceph-mon[28069]: pgmap v9422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16962.133662 secs 2024-04-26T16:30:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:49 smithi193 ceph-mon[32782]: pgmap v9423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:49 smithi196 ceph-mon[32572]: pgmap v9423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:49 smithi110 ceph-mon[28069]: pgmap v9423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:51 smithi193 ceph-mon[32782]: pgmap v9424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:51 smithi196 ceph-mon[32572]: pgmap v9424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:51 smithi110 ceph-mon[28069]: pgmap v9424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16967.133778 secs 2024-04-26T16:30:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16967.133778 secs 2024-04-26T16:30:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16967.133778 secs 2024-04-26T16:30:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:53 smithi193 ceph-mon[32782]: pgmap v9425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:53 smithi196 ceph-mon[32572]: pgmap v9425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:53 smithi110 ceph-mon[28069]: pgmap v9425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:55 smithi196 ceph-mon[32572]: pgmap v9426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:55 smithi110 ceph-mon[28069]: pgmap v9426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:55 smithi193 ceph-mon[32782]: pgmap v9426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:57 smithi196 ceph-mon[32572]: pgmap v9427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16972.133855 secs 2024-04-26T16:30:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:57 smithi110 ceph-mon[28069]: pgmap v9427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16972.133855 secs 2024-04-26T16:30:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:57 smithi193 ceph-mon[32782]: pgmap v9427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:30:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16972.133855 secs 2024-04-26T16:30:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:30:59 smithi196 ceph-mon[32572]: pgmap v9428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:30:59 smithi110 ceph-mon[28069]: pgmap v9428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:30:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:30:59 smithi193 ceph-mon[32782]: pgmap v9428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:01 smithi196 ceph-mon[32572]: pgmap v9429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:01 smithi110 ceph-mon[28069]: pgmap v9429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:01 smithi193 ceph-mon[32782]: pgmap v9429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16977.133974 secs 2024-04-26T16:31:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16977.133974 secs 2024-04-26T16:31:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16977.133974 secs 2024-04-26T16:31:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:03 smithi196 ceph-mon[32572]: pgmap v9430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:03 smithi110 ceph-mon[28069]: pgmap v9430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:03 smithi193 ceph-mon[32782]: pgmap v9430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:04 smithi196 ceph-mon[32572]: pgmap v9431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:04 smithi110 ceph-mon[28069]: pgmap v9431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:04 smithi193 ceph-mon[32782]: pgmap v9431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:07 smithi193 ceph-mon[32782]: pgmap v9432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16982.134072 secs 2024-04-26T16:31:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:07 smithi196 ceph-mon[32572]: pgmap v9432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16982.134072 secs 2024-04-26T16:31:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:07 smithi110 ceph-mon[28069]: pgmap v9432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16982.134072 secs 2024-04-26T16:31:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:09 smithi193 ceph-mon[32782]: pgmap v9433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:09 smithi196 ceph-mon[32572]: pgmap v9433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:09 smithi110 ceph-mon[28069]: pgmap v9433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:11 smithi193 ceph-mon[32782]: pgmap v9434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:11 smithi196 ceph-mon[32572]: pgmap v9434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:11 smithi110 ceph-mon[28069]: pgmap v9434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16987.134188 secs 2024-04-26T16:31:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16987.134188 secs 2024-04-26T16:31:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16987.134188 secs 2024-04-26T16:31:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:13 smithi196 ceph-mon[32572]: pgmap v9435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:13 smithi110 ceph-mon[28069]: pgmap v9435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:13 smithi193 ceph-mon[32782]: pgmap v9435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:15 smithi196 ceph-mon[32572]: pgmap v9436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:15 smithi110 ceph-mon[28069]: pgmap v9436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:15 smithi193 ceph-mon[32782]: pgmap v9436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:17 smithi196 ceph-mon[32572]: pgmap v9437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16992.134324 secs 2024-04-26T16:31:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:17 smithi110 ceph-mon[28069]: pgmap v9437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16992.134324 secs 2024-04-26T16:31:17.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:17 smithi193 ceph-mon[32782]: pgmap v9437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:17.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16992.134324 secs 2024-04-26T16:31:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:19 smithi196 ceph-mon[32572]: pgmap v9438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:19 smithi110 ceph-mon[28069]: pgmap v9438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:19 smithi193 ceph-mon[32782]: pgmap v9438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:21 smithi196 ceph-mon[32572]: pgmap v9439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:21 smithi110 ceph-mon[28069]: pgmap v9439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:21 smithi193 ceph-mon[32782]: pgmap v9439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 16997.134438 secs 2024-04-26T16:31:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:22 smithi196 ceph-mon[32572]: pgmap v9440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 16997.134438 secs 2024-04-26T16:31:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:22 smithi110 ceph-mon[28069]: pgmap v9440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 16997.134438 secs 2024-04-26T16:31:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:22 smithi193 ceph-mon[32782]: pgmap v9440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:25 smithi193 ceph-mon[32782]: pgmap v9441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:31:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:25 smithi196 ceph-mon[32572]: pgmap v9441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:31:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:25 smithi110 ceph-mon[28069]: pgmap v9441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:31:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:31:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:31:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:31:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:31:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:31:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:31:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:31:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:27 smithi196 ceph-mon[32572]: pgmap v9442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T16:31:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:27 smithi196 ceph-mon[32572]: pgmap v9443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17002.134548 secs 2024-04-26T16:31:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:27 smithi110 ceph-mon[28069]: pgmap v9442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T16:31:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:27 smithi110 ceph-mon[28069]: pgmap v9443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17002.134548 secs 2024-04-26T16:31:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:27 smithi193 ceph-mon[32782]: pgmap v9442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T16:31:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:27 smithi193 ceph-mon[32782]: pgmap v9443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17002.134548 secs 2024-04-26T16:31:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:29 smithi196 ceph-mon[32572]: pgmap v9444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:29 smithi110 ceph-mon[28069]: pgmap v9444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:29 smithi193 ceph-mon[32782]: pgmap v9444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:31 smithi196 ceph-mon[32572]: pgmap v9445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:31 smithi110 ceph-mon[28069]: pgmap v9445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:31 smithi193 ceph-mon[32782]: pgmap v9445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17007.134665 secs 2024-04-26T16:31:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17007.134665 secs 2024-04-26T16:31:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17007.134665 secs 2024-04-26T16:31:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:33 smithi196 ceph-mon[32572]: pgmap v9446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:33 smithi110 ceph-mon[28069]: pgmap v9446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:33 smithi193 ceph-mon[32782]: pgmap v9446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:34 smithi196 ceph-mon[32572]: pgmap v9447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:34 smithi110 ceph-mon[28069]: pgmap v9447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:34 smithi193 ceph-mon[32782]: pgmap v9447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:31:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:36 smithi196 ceph-mon[32572]: pgmap v9448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:31:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:36 smithi110 ceph-mon[28069]: pgmap v9448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:31:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:36 smithi193 ceph-mon[32782]: pgmap v9448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:31:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17012.134779 secs 2024-04-26T16:31:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17012.134779 secs 2024-04-26T16:31:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17012.134779 secs 2024-04-26T16:31:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:38 smithi196 ceph-mon[32572]: pgmap v9449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:38 smithi110 ceph-mon[28069]: pgmap v9449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:38 smithi193 ceph-mon[32782]: pgmap v9449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:40 smithi196 ceph-mon[32572]: pgmap v9450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:40 smithi110 ceph-mon[28069]: pgmap v9450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:40 smithi193 ceph-mon[32782]: pgmap v9450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17017.134914 secs 2024-04-26T16:31:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:42 smithi196 ceph-mon[32572]: pgmap v9451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17017.134914 secs 2024-04-26T16:31:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:42 smithi110 ceph-mon[28069]: pgmap v9451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17017.134914 secs 2024-04-26T16:31:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:42 smithi193 ceph-mon[32782]: pgmap v9451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:44 smithi196 ceph-mon[32572]: pgmap v9452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:44 smithi110 ceph-mon[28069]: pgmap v9452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:44 smithi193 ceph-mon[32782]: pgmap v9452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:46 smithi196 ceph-mon[32572]: pgmap v9453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:46 smithi110 ceph-mon[28069]: pgmap v9453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:46 smithi193 ceph-mon[32782]: pgmap v9453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17022.135051 secs 2024-04-26T16:31:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17022.135051 secs 2024-04-26T16:31:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17022.135051 secs 2024-04-26T16:31:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:48 smithi196 ceph-mon[32572]: pgmap v9454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:48 smithi110 ceph-mon[28069]: pgmap v9454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:48 smithi193 ceph-mon[32782]: pgmap v9454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:50 smithi110 ceph-mon[28069]: pgmap v9455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:50 smithi193 ceph-mon[32782]: pgmap v9455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:50 smithi196 ceph-mon[32572]: pgmap v9455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17027.135187 secs 2024-04-26T16:31:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17027.135187 secs 2024-04-26T16:31:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17027.135187 secs 2024-04-26T16:31:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:52 smithi193 ceph-mon[32782]: pgmap v9456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:52 smithi196 ceph-mon[32572]: pgmap v9456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:52 smithi110 ceph-mon[28069]: pgmap v9456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:54 smithi193 ceph-mon[32782]: pgmap v9457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:54 smithi196 ceph-mon[32572]: pgmap v9457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:54 smithi110 ceph-mon[28069]: pgmap v9457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:56 smithi193 ceph-mon[32782]: pgmap v9458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17032.135317 secs 2024-04-26T16:31:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:56 smithi196 ceph-mon[32572]: pgmap v9458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17032.135317 secs 2024-04-26T16:31:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:56 smithi110 ceph-mon[28069]: pgmap v9458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:31:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17032.135317 secs 2024-04-26T16:31:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:31:58 smithi193 ceph-mon[32782]: pgmap v9459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:31:58 smithi196 ceph-mon[32572]: pgmap v9459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:31:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:31:58 smithi110 ceph-mon[28069]: pgmap v9459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:00 smithi193 ceph-mon[32782]: pgmap v9460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:00 smithi196 ceph-mon[32572]: pgmap v9460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:00 smithi110 ceph-mon[28069]: pgmap v9460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17037.135439 secs 2024-04-26T16:32:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17037.135439 secs 2024-04-26T16:32:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17037.135439 secs 2024-04-26T16:32:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:02 smithi193 ceph-mon[32782]: pgmap v9461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:02 smithi196 ceph-mon[32572]: pgmap v9461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:02 smithi110 ceph-mon[28069]: pgmap v9461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:04 smithi193 ceph-mon[32782]: pgmap v9462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:04 smithi196 ceph-mon[32572]: pgmap v9462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:04 smithi110 ceph-mon[28069]: pgmap v9462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:06 smithi193 ceph-mon[32782]: pgmap v9463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17042.135558 secs 2024-04-26T16:32:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:06 smithi196 ceph-mon[32572]: pgmap v9463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17042.135558 secs 2024-04-26T16:32:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:06 smithi110 ceph-mon[28069]: pgmap v9463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17042.135558 secs 2024-04-26T16:32:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:08 smithi193 ceph-mon[32782]: pgmap v9464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:08 smithi196 ceph-mon[32572]: pgmap v9464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:08 smithi110 ceph-mon[28069]: pgmap v9464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:10 smithi193 ceph-mon[32782]: pgmap v9465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:10 smithi196 ceph-mon[32572]: pgmap v9465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:10 smithi110 ceph-mon[28069]: pgmap v9465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:11 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 17047.135678 secs 2024-04-26T16:32:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:11 smithi196 ceph-mon[32572]: slow request 2884.246565 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:32:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:11 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 17047.135678 secs 2024-04-26T16:32:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:11 smithi110 ceph-mon[28069]: slow request 2884.246565 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:32:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:11 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 17047.135678 secs 2024-04-26T16:32:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:11 smithi193 ceph-mon[32782]: slow request 2884.246565 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:32:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:12 smithi196 ceph-mon[32572]: pgmap v9466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:12 smithi110 ceph-mon[28069]: pgmap v9466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:12 smithi193 ceph-mon[32782]: pgmap v9466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:14 smithi196 ceph-mon[32572]: pgmap v9467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:14 smithi110 ceph-mon[28069]: pgmap v9467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:14 smithi193 ceph-mon[32782]: pgmap v9467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:17.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:16 smithi196 ceph-mon[32572]: pgmap v9468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:17.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17052.135810 secs 2024-04-26T16:32:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:16 smithi110 ceph-mon[28069]: pgmap v9468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17052.135810 secs 2024-04-26T16:32:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:16 smithi193 ceph-mon[32782]: pgmap v9468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17052.135810 secs 2024-04-26T16:32:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:18 smithi196 ceph-mon[32572]: pgmap v9469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:18 smithi110 ceph-mon[28069]: pgmap v9469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:18 smithi193 ceph-mon[32782]: pgmap v9469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:20 smithi196 ceph-mon[32572]: pgmap v9470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:20 smithi110 ceph-mon[28069]: pgmap v9470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:20 smithi193 ceph-mon[32782]: pgmap v9470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17057.135912 secs 2024-04-26T16:32:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17057.135912 secs 2024-04-26T16:32:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17057.135912 secs 2024-04-26T16:32:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:22 smithi196 ceph-mon[32572]: pgmap v9471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:22 smithi110 ceph-mon[28069]: pgmap v9471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:22 smithi193 ceph-mon[32782]: pgmap v9471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:24 smithi196 ceph-mon[32572]: pgmap v9472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:24 smithi110 ceph-mon[28069]: pgmap v9472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:24 smithi193 ceph-mon[32782]: pgmap v9472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:32:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:32:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:32:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:26 smithi193 ceph-mon[32782]: pgmap v9473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17062.135977 secs 2024-04-26T16:32:27.233 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:26 smithi110 ceph-mon[28069]: pgmap v9473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:27.233 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17062.135977 secs 2024-04-26T16:32:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:26 smithi196 ceph-mon[32572]: pgmap v9473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17062.135977 secs 2024-04-26T16:32:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: pgmap v9474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: pgmap v9474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: pgmap v9474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:29.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:30 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:32:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:30 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:32:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:30 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:32:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:30 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:32:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:30 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:32:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:30 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:32:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:30 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:32:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:30 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:32:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:30 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:32:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:30 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:32:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:30 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:32:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:30 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:32:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:31 smithi193 ceph-mon[32782]: pgmap v9475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:31 smithi196 ceph-mon[32572]: pgmap v9475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:31 smithi110 ceph-mon[28069]: pgmap v9475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:32:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:32:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17067.136055 secs 2024-04-26T16:32:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17067.136055 secs 2024-04-26T16:32:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:32:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:32:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:32:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:32:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17067.136055 secs 2024-04-26T16:32:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:33 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:32:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:33 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:32:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:33 smithi193 ceph-mon[32782]: pgmap v9476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T16:32:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:33 smithi193 ceph-mon[32782]: pgmap v9477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:33 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:32:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:33 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:32:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:33 smithi196 ceph-mon[32572]: pgmap v9476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T16:32:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:33 smithi196 ceph-mon[32572]: pgmap v9477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:33 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:32:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:33 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:32:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:33 smithi110 ceph-mon[28069]: pgmap v9476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T16:32:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:33 smithi110 ceph-mon[28069]: pgmap v9477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:35 smithi196 ceph-mon[32572]: pgmap v9478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:35 smithi110 ceph-mon[28069]: pgmap v9478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:35 smithi193 ceph-mon[32782]: pgmap v9478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:37.382 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:37 smithi110 ceph-mon[28069]: pgmap v9479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:37.382 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17072.136168 secs 2024-04-26T16:32:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:37 smithi196 ceph-mon[32572]: pgmap v9479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17072.136168 secs 2024-04-26T16:32:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:37 smithi193 ceph-mon[32782]: pgmap v9479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17072.136168 secs 2024-04-26T16:32:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:39 smithi110 ceph-mon[28069]: pgmap v9480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T16:32:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:39 smithi196 ceph-mon[32572]: pgmap v9480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T16:32:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:39 smithi193 ceph-mon[32782]: pgmap v9480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T16:32:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:41 smithi196 ceph-mon[32572]: pgmap v9481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:41 smithi110 ceph-mon[28069]: pgmap v9481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:41 smithi193 ceph-mon[32782]: pgmap v9481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:32:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17077.136262 secs 2024-04-26T16:32:42.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17077.136262 secs 2024-04-26T16:32:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17077.136262 secs 2024-04-26T16:32:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:43 smithi196 ceph-mon[32572]: pgmap v9482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:32:43.534 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:43 smithi193 ceph-mon[32782]: pgmap v9482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:32:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:43 smithi110 ceph-mon[28069]: pgmap v9482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:32:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:45 smithi196 ceph-mon[32572]: pgmap v9483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:45 smithi110 ceph-mon[28069]: pgmap v9483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:45 smithi193 ceph-mon[32782]: pgmap v9483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:47 smithi196 ceph-mon[32572]: pgmap v9484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17082.136352 secs 2024-04-26T16:32:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:47 smithi110 ceph-mon[28069]: pgmap v9484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17082.136352 secs 2024-04-26T16:32:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:47 smithi193 ceph-mon[32782]: pgmap v9484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17082.136352 secs 2024-04-26T16:32:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:49 smithi110 ceph-mon[28069]: pgmap v9485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:32:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:49 smithi196 ceph-mon[32572]: pgmap v9485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:32:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:49 smithi193 ceph-mon[32782]: pgmap v9485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:32:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:50 smithi196 ceph-mon[32572]: pgmap v9486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:50 smithi110 ceph-mon[28069]: pgmap v9486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:50 smithi193 ceph-mon[32782]: pgmap v9486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:52 smithi193 ceph-mon[32782]: pgmap v9487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17087.136475 secs 2024-04-26T16:32:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:52 smithi196 ceph-mon[32572]: pgmap v9487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17087.136475 secs 2024-04-26T16:32:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:52 smithi110 ceph-mon[28069]: pgmap v9487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17087.136475 secs 2024-04-26T16:32:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:54 smithi193 ceph-mon[32782]: pgmap v9488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:54 smithi196 ceph-mon[32572]: pgmap v9488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:54 smithi110 ceph-mon[28069]: pgmap v9488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:32:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:56 smithi196 ceph-mon[32572]: pgmap v9489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:56 smithi110 ceph-mon[28069]: pgmap v9489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:56 smithi193 ceph-mon[32782]: pgmap v9489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:32:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17092.136613 secs 2024-04-26T16:32:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17092.136613 secs 2024-04-26T16:32:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17092.136613 secs 2024-04-26T16:32:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:32:58 smithi196 ceph-mon[32572]: pgmap v9490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:32:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:32:58 smithi110 ceph-mon[28069]: pgmap v9490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:32:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:32:58 smithi193 ceph-mon[32782]: pgmap v9490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:33:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:00 smithi196 ceph-mon[32572]: pgmap v9491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:00 smithi110 ceph-mon[28069]: pgmap v9491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:00 smithi193 ceph-mon[32782]: pgmap v9491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:02 smithi196 ceph-mon[32572]: pgmap v9492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17097.136733 secs 2024-04-26T16:33:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:02 smithi110 ceph-mon[28069]: pgmap v9492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17097.136733 secs 2024-04-26T16:33:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:02 smithi193 ceph-mon[32782]: pgmap v9492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17097.136733 secs 2024-04-26T16:33:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:04 smithi196 ceph-mon[32572]: pgmap v9493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:04 smithi110 ceph-mon[28069]: pgmap v9493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:04 smithi193 ceph-mon[32782]: pgmap v9493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:06 smithi196 ceph-mon[32572]: pgmap v9494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:06 smithi110 ceph-mon[28069]: pgmap v9494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:06 smithi193 ceph-mon[32782]: pgmap v9494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:07.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17102.136801 secs 2024-04-26T16:33:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17102.136801 secs 2024-04-26T16:33:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17102.136801 secs 2024-04-26T16:33:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:08 smithi196 ceph-mon[32572]: pgmap v9495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:33:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:08 smithi110 ceph-mon[28069]: pgmap v9495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:33:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:08 smithi193 ceph-mon[32782]: pgmap v9495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:33:10.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:10 smithi196 ceph-mon[32572]: pgmap v9496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:10 smithi110 ceph-mon[28069]: pgmap v9496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:10 smithi193 ceph-mon[32782]: pgmap v9496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:12 smithi196 ceph-mon[32572]: pgmap v9497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 17107.136870 secs 2024-04-26T16:33:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:12 smithi196 ceph-mon[32572]: slow request 1443.522695 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:33:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:12 smithi110 ceph-mon[28069]: pgmap v9497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 17107.136870 secs 2024-04-26T16:33:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:12 smithi110 ceph-mon[28069]: slow request 1443.522695 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:33:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:12 smithi193 ceph-mon[32782]: pgmap v9497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 17107.136870 secs 2024-04-26T16:33:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:12 smithi193 ceph-mon[32782]: slow request 1443.522695 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:14 smithi196 ceph-mon[32572]: pgmap v9498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:14 smithi110 ceph-mon[28069]: pgmap v9498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:14 smithi193 ceph-mon[32782]: pgmap v9498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T16:33:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e050 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e050 comp rx=0 tx=0).stop 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T16:33:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.423+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T16:33:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.424+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T16:33:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.424+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T16:33:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.424+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T16:33:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:16.425+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T16:33:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:16 smithi196 ceph-mon[32572]: pgmap v9499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:16 smithi110 ceph-mon[28069]: pgmap v9499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:16 smithi193 ceph-mon[32782]: pgmap v9499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17112.136947 secs 2024-04-26T16:33:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17112.136947 secs 2024-04-26T16:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17112.136947 secs 2024-04-26T16:33:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:18 smithi196 ceph-mon[32572]: pgmap v9500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:18 smithi110 ceph-mon[28069]: pgmap v9500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:18 smithi193 ceph-mon[32782]: pgmap v9500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:19.194+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:33:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:19.194+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:33:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:19.194+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 134 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:33:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:33:19.194+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 134 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:33:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:20 smithi196 ceph-mon[32572]: pgmap v9501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:20 smithi110 ceph-mon[28069]: pgmap v9501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:20 smithi193 ceph-mon[32782]: pgmap v9501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:22 smithi196 ceph-mon[32572]: pgmap v9502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17117.137067 secs 2024-04-26T16:33:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:22 smithi110 ceph-mon[28069]: pgmap v9502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17117.137067 secs 2024-04-26T16:33:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:22 smithi193 ceph-mon[32782]: pgmap v9502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17117.137067 secs 2024-04-26T16:33:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:24 smithi196 ceph-mon[32572]: pgmap v9503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:24 smithi110 ceph-mon[28069]: pgmap v9503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:24 smithi193 ceph-mon[32782]: pgmap v9503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:26 smithi196 ceph-mon[32572]: pgmap v9504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:26 smithi110 ceph-mon[28069]: pgmap v9504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:26 smithi193 ceph-mon[32782]: pgmap v9504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17122.137182 secs 2024-04-26T16:33:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17122.137182 secs 2024-04-26T16:33:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17122.137182 secs 2024-04-26T16:33:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:28 smithi196 ceph-mon[32572]: pgmap v9505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:28 smithi110 ceph-mon[28069]: pgmap v9505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:28 smithi193 ceph-mon[32782]: pgmap v9505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:30 smithi196 ceph-mon[32572]: pgmap v9506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:30 smithi110 ceph-mon[28069]: pgmap v9506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:30 smithi193 ceph-mon[32782]: pgmap v9506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:32 smithi196 ceph-mon[32572]: pgmap v9507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17127.137303 secs 2024-04-26T16:33:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:33:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:32 smithi110 ceph-mon[28069]: pgmap v9507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17127.137303 secs 2024-04-26T16:33:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:33:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:32 smithi193 ceph-mon[32782]: pgmap v9507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17127.137303 secs 2024-04-26T16:33:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:33:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:33:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:33:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:33:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:33:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:33:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:33:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:33:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:34 smithi196 ceph-mon[32572]: pgmap v9508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:34 smithi196 ceph-mon[32572]: pgmap v9509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T16:33:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:34 smithi196 ceph-mon[32572]: pgmap v9510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:34 smithi110 ceph-mon[28069]: pgmap v9508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:34 smithi110 ceph-mon[28069]: pgmap v9509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T16:33:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:34 smithi110 ceph-mon[28069]: pgmap v9510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:34 smithi193 ceph-mon[32782]: pgmap v9508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:34 smithi193 ceph-mon[32782]: pgmap v9509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T16:33:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:34 smithi193 ceph-mon[32782]: pgmap v9510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:36 smithi196 ceph-mon[32572]: pgmap v9511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:33:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17132.137422 secs 2024-04-26T16:33:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:36 smithi110 ceph-mon[28069]: pgmap v9511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:33:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17132.137422 secs 2024-04-26T16:33:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:36 smithi193 ceph-mon[32782]: pgmap v9511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:33:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17132.137422 secs 2024-04-26T16:33:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:38 smithi196 ceph-mon[32572]: pgmap v9512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:38 smithi110 ceph-mon[28069]: pgmap v9512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:38 smithi193 ceph-mon[32782]: pgmap v9512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:40 smithi196 ceph-mon[32572]: pgmap v9513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:40 smithi110 ceph-mon[28069]: pgmap v9513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:40 smithi193 ceph-mon[32782]: pgmap v9513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17137.137541 secs 2024-04-26T16:33:42.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17137.137541 secs 2024-04-26T16:33:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17137.137541 secs 2024-04-26T16:33:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:42 smithi196 ceph-mon[32572]: pgmap v9514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:33:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:42 smithi110 ceph-mon[28069]: pgmap v9514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:33:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:42 smithi193 ceph-mon[32782]: pgmap v9514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T16:33:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:44 smithi196 ceph-mon[32572]: pgmap v9515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:33:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:44 smithi110 ceph-mon[28069]: pgmap v9515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:33:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:44 smithi193 ceph-mon[32782]: pgmap v9515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:33:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:46 smithi196 ceph-mon[32572]: pgmap v9516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17142.137657 secs 2024-04-26T16:33:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:46 smithi110 ceph-mon[28069]: pgmap v9516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17142.137657 secs 2024-04-26T16:33:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:46 smithi193 ceph-mon[32782]: pgmap v9516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17142.137657 secs 2024-04-26T16:33:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:48 smithi196 ceph-mon[32572]: pgmap v9517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:48 smithi110 ceph-mon[28069]: pgmap v9517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:48 smithi193 ceph-mon[32782]: pgmap v9517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:50 smithi196 ceph-mon[32572]: pgmap v9518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:50 smithi110 ceph-mon[28069]: pgmap v9518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:50 smithi193 ceph-mon[32782]: pgmap v9518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17147.137770 secs 2024-04-26T16:33:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17147.137770 secs 2024-04-26T16:33:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17147.137770 secs 2024-04-26T16:33:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:53 smithi110 ceph-mon[28069]: pgmap v9519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:53 smithi193 ceph-mon[32782]: pgmap v9519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:53 smithi196 ceph-mon[32572]: pgmap v9519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:55 smithi110 ceph-mon[28069]: pgmap v9520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:55 smithi193 ceph-mon[32782]: pgmap v9520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:55 smithi196 ceph-mon[32572]: pgmap v9520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:57 smithi110 ceph-mon[28069]: pgmap v9521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17152.137873 secs 2024-04-26T16:33:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:57 smithi193 ceph-mon[32782]: pgmap v9521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17152.137873 secs 2024-04-26T16:33:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:57 smithi196 ceph-mon[32572]: pgmap v9521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:33:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17152.137873 secs 2024-04-26T16:33:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:33:59 smithi110 ceph-mon[28069]: pgmap v9522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:33:59 smithi193 ceph-mon[32782]: pgmap v9522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:33:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:33:59 smithi196 ceph-mon[32572]: pgmap v9522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:01 smithi110 ceph-mon[28069]: pgmap v9523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:01 smithi193 ceph-mon[32782]: pgmap v9523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:01 smithi196 ceph-mon[32572]: pgmap v9523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17157.138000 secs 2024-04-26T16:34:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17157.138000 secs 2024-04-26T16:34:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17157.138000 secs 2024-04-26T16:34:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:03 smithi193 ceph-mon[32782]: pgmap v9524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:03 smithi196 ceph-mon[32572]: pgmap v9524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:03 smithi110 ceph-mon[28069]: pgmap v9524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:05 smithi193 ceph-mon[32782]: pgmap v9525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:05 smithi196 ceph-mon[32572]: pgmap v9525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:05 smithi110 ceph-mon[28069]: pgmap v9525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:06 smithi193 ceph-mon[32782]: pgmap v9526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:06 smithi196 ceph-mon[32572]: pgmap v9526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:06 smithi110 ceph-mon[28069]: pgmap v9526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17162.138134 secs 2024-04-26T16:34:07.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17162.138134 secs 2024-04-26T16:34:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17162.138134 secs 2024-04-26T16:34:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:08 smithi193 ceph-mon[32782]: pgmap v9527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:08.707 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:08 smithi110 ceph-mon[28069]: pgmap v9527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:08 smithi196 ceph-mon[32572]: pgmap v9527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:09.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:34:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:34:08.705+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:34:09.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:34:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:34:08.705+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:34:09.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:34:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:34:08.705+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:34:09.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:34:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:34:08.705+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:34:09.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:34:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:34:08.705+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:34:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:10 smithi193 ceph-mon[32782]: pgmap v9528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:10 smithi196 ceph-mon[32572]: pgmap v9528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:10 smithi110 ceph-mon[28069]: pgmap v9528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:11 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17167.138253 secs 2024-04-26T16:34:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:11 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17167.138253 secs 2024-04-26T16:34:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:11 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17167.138253 secs 2024-04-26T16:34:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:12 smithi193 ceph-mon[32782]: pgmap v9529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:12 smithi196 ceph-mon[32572]: pgmap v9529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:12 smithi110 ceph-mon[28069]: pgmap v9529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:14 smithi193 ceph-mon[32782]: pgmap v9530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:14 smithi196 ceph-mon[32572]: pgmap v9530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:14 smithi110 ceph-mon[28069]: pgmap v9530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:16 smithi193 ceph-mon[32782]: pgmap v9531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17172.138369 secs 2024-04-26T16:34:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:16 smithi196 ceph-mon[32572]: pgmap v9531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17172.138369 secs 2024-04-26T16:34:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:16 smithi110 ceph-mon[28069]: pgmap v9531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17172.138369 secs 2024-04-26T16:34:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:18 smithi193 ceph-mon[32782]: pgmap v9532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:18 smithi196 ceph-mon[32572]: pgmap v9532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:18 smithi110 ceph-mon[28069]: pgmap v9532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:20 smithi193 ceph-mon[32782]: pgmap v9533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:20 smithi196 ceph-mon[32572]: pgmap v9533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:20 smithi110 ceph-mon[28069]: pgmap v9533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17177.138490 secs 2024-04-26T16:34:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17177.138490 secs 2024-04-26T16:34:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17177.138490 secs 2024-04-26T16:34:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:22 smithi193 ceph-mon[32782]: pgmap v9534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:22 smithi196 ceph-mon[32572]: pgmap v9534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:22 smithi110 ceph-mon[28069]: pgmap v9534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:24 smithi193 ceph-mon[32782]: pgmap v9535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:24 smithi196 ceph-mon[32572]: pgmap v9535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:24 smithi110 ceph-mon[28069]: pgmap v9535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T16:34:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:26 smithi193 ceph-mon[32782]: pgmap v9536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17182.138622 secs 2024-04-26T16:34:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:26 smithi196 ceph-mon[32572]: pgmap v9536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17182.138622 secs 2024-04-26T16:34:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:26 smithi110 ceph-mon[28069]: pgmap v9536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17182.138622 secs 2024-04-26T16:34:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:28 smithi193 ceph-mon[32782]: pgmap v9537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:28 smithi196 ceph-mon[32572]: pgmap v9537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:28 smithi110 ceph-mon[28069]: pgmap v9537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:30 smithi193 ceph-mon[32782]: pgmap v9538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:34:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:30 smithi196 ceph-mon[32572]: pgmap v9538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:34:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:30 smithi110 ceph-mon[28069]: pgmap v9538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:34:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17187.138742 secs 2024-04-26T16:34:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17187.138742 secs 2024-04-26T16:34:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17187.138742 secs 2024-04-26T16:34:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:32 smithi196 ceph-mon[32572]: pgmap v9539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:34:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:32 smithi110 ceph-mon[28069]: pgmap v9539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:34:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:32 smithi193 ceph-mon[32782]: pgmap v9539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:34:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:34 smithi196 ceph-mon[32572]: pgmap v9540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:34:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:34 smithi110 ceph-mon[28069]: pgmap v9540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:34:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:34 smithi193 ceph-mon[32782]: pgmap v9540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:34:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:34:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:34:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:34:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:34:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:34:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:34:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:34:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:34:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:34:37.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:36 smithi110 ceph-mon[28069]: pgmap v9541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 802 B/s rd, 1 op/s 2024-04-26T16:34:37.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:36 smithi110 ceph-mon[28069]: pgmap v9542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T16:34:37.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17192.138862 secs 2024-04-26T16:34:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:36 smithi196 ceph-mon[32572]: pgmap v9541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 802 B/s rd, 1 op/s 2024-04-26T16:34:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:36 smithi196 ceph-mon[32572]: pgmap v9542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T16:34:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17192.138862 secs 2024-04-26T16:34:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:36 smithi193 ceph-mon[32782]: pgmap v9541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 802 B/s rd, 1 op/s 2024-04-26T16:34:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:36 smithi193 ceph-mon[32782]: pgmap v9542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T16:34:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17192.138862 secs 2024-04-26T16:34:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:38 smithi196 ceph-mon[32572]: pgmap v9543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:34:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:38 smithi110 ceph-mon[28069]: pgmap v9543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:34:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:38 smithi193 ceph-mon[32782]: pgmap v9543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:34:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:40 smithi196 ceph-mon[32572]: pgmap v9544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:34:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:40 smithi110 ceph-mon[28069]: pgmap v9544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:34:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:40 smithi193 ceph-mon[32782]: pgmap v9544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:34:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17197.138963 secs 2024-04-26T16:34:42.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17197.138963 secs 2024-04-26T16:34:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17197.138963 secs 2024-04-26T16:34:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:42 smithi196 ceph-mon[32572]: pgmap v9545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:34:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:42 smithi110 ceph-mon[28069]: pgmap v9545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:34:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:42 smithi193 ceph-mon[32782]: pgmap v9545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:34:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:44 smithi196 ceph-mon[32572]: pgmap v9546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:34:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:44 smithi110 ceph-mon[28069]: pgmap v9546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:34:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:44 smithi193 ceph-mon[32782]: pgmap v9546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:34:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:46 smithi196 ceph-mon[32572]: pgmap v9547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:34:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17202.139106 secs 2024-04-26T16:34:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:46 smithi110 ceph-mon[28069]: pgmap v9547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:34:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17202.139106 secs 2024-04-26T16:34:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:46 smithi193 ceph-mon[32782]: pgmap v9547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:34:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17202.139106 secs 2024-04-26T16:34:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:48 smithi196 ceph-mon[32572]: pgmap v9548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:48 smithi110 ceph-mon[28069]: pgmap v9548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:48 smithi193 ceph-mon[32782]: pgmap v9548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:50 smithi196 ceph-mon[32572]: pgmap v9549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:50 smithi110 ceph-mon[28069]: pgmap v9549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:50 smithi193 ceph-mon[32782]: pgmap v9549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17207.139218 secs 2024-04-26T16:34:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17207.139218 secs 2024-04-26T16:34:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17207.139218 secs 2024-04-26T16:34:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:52 smithi196 ceph-mon[32572]: pgmap v9550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:52 smithi110 ceph-mon[28069]: pgmap v9550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:52 smithi193 ceph-mon[32782]: pgmap v9550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:54 smithi196 ceph-mon[32572]: pgmap v9551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:54 smithi110 ceph-mon[28069]: pgmap v9551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:54 smithi193 ceph-mon[32782]: pgmap v9551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:34:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:56 smithi196 ceph-mon[32572]: pgmap v9552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17212.139352 secs 2024-04-26T16:34:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:56 smithi110 ceph-mon[28069]: pgmap v9552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17212.139352 secs 2024-04-26T16:34:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:56 smithi193 ceph-mon[32782]: pgmap v9552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17212.139352 secs 2024-04-26T16:34:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:34:58 smithi196 ceph-mon[32572]: pgmap v9553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:34:58 smithi110 ceph-mon[28069]: pgmap v9553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:34:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:34:58 smithi193 ceph-mon[32782]: pgmap v9553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:00 smithi196 ceph-mon[32572]: pgmap v9554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:00 smithi110 ceph-mon[28069]: pgmap v9554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:00 smithi193 ceph-mon[32782]: pgmap v9554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17217.139468 secs 2024-04-26T16:35:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17217.139468 secs 2024-04-26T16:35:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17217.139468 secs 2024-04-26T16:35:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:02 smithi196 ceph-mon[32572]: pgmap v9555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:02 smithi110 ceph-mon[28069]: pgmap v9555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:02 smithi193 ceph-mon[32782]: pgmap v9555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:04 smithi196 ceph-mon[32572]: pgmap v9556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:35:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:04 smithi110 ceph-mon[28069]: pgmap v9556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:35:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:04 smithi193 ceph-mon[32782]: pgmap v9556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:06 smithi196 ceph-mon[32572]: pgmap v9557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:35:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17222.139601 secs 2024-04-26T16:35:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:06 smithi110 ceph-mon[28069]: pgmap v9557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:35:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17222.139601 secs 2024-04-26T16:35:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:06 smithi193 ceph-mon[32782]: pgmap v9557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:35:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17222.139601 secs 2024-04-26T16:35:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:08 smithi196 ceph-mon[32572]: pgmap v9558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:35:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:08 smithi110 ceph-mon[28069]: pgmap v9558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:35:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:08 smithi193 ceph-mon[32782]: pgmap v9558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:35:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:11 smithi196 ceph-mon[32572]: pgmap v9559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:35:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:11 smithi110 ceph-mon[28069]: pgmap v9559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:35:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:11 smithi193 ceph-mon[32782]: pgmap v9559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:35:12.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17227.139702 secs 2024-04-26T16:35:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17227.139702 secs 2024-04-26T16:35:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17227.139702 secs 2024-04-26T16:35:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:13 smithi110 ceph-mon[28069]: pgmap v9560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:35:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:13 smithi193 ceph-mon[32782]: pgmap v9560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:35:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:13 smithi196 ceph-mon[32572]: pgmap v9560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:35:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:15 smithi110 ceph-mon[28069]: pgmap v9561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:35:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:15 smithi193 ceph-mon[32782]: pgmap v9561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:35:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:15 smithi196 ceph-mon[32572]: pgmap v9561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:35:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:17 smithi110 ceph-mon[28069]: pgmap v9562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17232.139768 secs 2024-04-26T16:35:17.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:17 smithi196 ceph-mon[32572]: pgmap v9562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:17.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17232.139768 secs 2024-04-26T16:35:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:17 smithi193 ceph-mon[32782]: pgmap v9562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17232.139768 secs 2024-04-26T16:35:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:19 smithi110 ceph-mon[28069]: pgmap v9563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:19 smithi193 ceph-mon[32782]: pgmap v9563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:19 smithi196 ceph-mon[32572]: pgmap v9563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:21 smithi110 ceph-mon[28069]: pgmap v9564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:21 smithi193 ceph-mon[32782]: pgmap v9564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:21 smithi196 ceph-mon[32572]: pgmap v9564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17237.139833 secs 2024-04-26T16:35:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17237.139833 secs 2024-04-26T16:35:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17237.139833 secs 2024-04-26T16:35:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:23 smithi193 ceph-mon[32782]: pgmap v9565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:23 smithi196 ceph-mon[32572]: pgmap v9565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:23 smithi110 ceph-mon[28069]: pgmap v9565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:25 smithi193 ceph-mon[32782]: pgmap v9566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:25 smithi196 ceph-mon[32572]: pgmap v9566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:25 smithi110 ceph-mon[28069]: pgmap v9566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:27 smithi193 ceph-mon[32782]: pgmap v9567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17242.139941 secs 2024-04-26T16:35:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:27 smithi196 ceph-mon[32572]: pgmap v9567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17242.139941 secs 2024-04-26T16:35:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:27 smithi110 ceph-mon[28069]: pgmap v9567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17242.139941 secs 2024-04-26T16:35:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:29 smithi193 ceph-mon[32782]: pgmap v9568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:35:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:29 smithi196 ceph-mon[32572]: pgmap v9568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:35:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:29 smithi110 ceph-mon[28069]: pgmap v9568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:35:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:31 smithi193 ceph-mon[32782]: pgmap v9569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:31 smithi196 ceph-mon[32572]: pgmap v9569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:31 smithi110 ceph-mon[28069]: pgmap v9569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17247.140045 secs 2024-04-26T16:35:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17247.140045 secs 2024-04-26T16:35:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17247.140045 secs 2024-04-26T16:35:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:33 smithi193 ceph-mon[32782]: pgmap v9570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:33 smithi196 ceph-mon[32572]: pgmap v9570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:33 smithi110 ceph-mon[28069]: pgmap v9570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:35 smithi193 ceph-mon[32782]: pgmap v9571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:35 smithi196 ceph-mon[32572]: pgmap v9571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:35 smithi110 ceph-mon[28069]: pgmap v9571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:35:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:35:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:35:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:37 smithi193 ceph-mon[32782]: pgmap v9572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17252.140178 secs 2024-04-26T16:35:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:35:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:35:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:35:37.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:37 smithi110 ceph-mon[28069]: pgmap v9572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:37.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17252.140178 secs 2024-04-26T16:35:37.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:35:37.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:35:37.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:35:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:37 smithi196 ceph-mon[32572]: pgmap v9572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17252.140178 secs 2024-04-26T16:35:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:35:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:35:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:35:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:38 smithi193 ceph-mon[32782]: pgmap v9573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T16:35:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:38 smithi193 ceph-mon[32782]: pgmap v9574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:35:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:38 smithi196 ceph-mon[32572]: pgmap v9573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T16:35:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:38 smithi196 ceph-mon[32572]: pgmap v9574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:35:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:38 smithi110 ceph-mon[28069]: pgmap v9573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T16:35:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:38 smithi110 ceph-mon[28069]: pgmap v9574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:35:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:40 smithi193 ceph-mon[32782]: pgmap v9575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:40 smithi196 ceph-mon[32572]: pgmap v9575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:40 smithi110 ceph-mon[28069]: pgmap v9575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:42 smithi196 ceph-mon[32572]: pgmap v9576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17257.140299 secs 2024-04-26T16:35:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:42 smithi110 ceph-mon[28069]: pgmap v9576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17257.140299 secs 2024-04-26T16:35:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:42 smithi193 ceph-mon[32782]: pgmap v9576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17257.140299 secs 2024-04-26T16:35:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:44 smithi196 ceph-mon[32572]: pgmap v9577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:44 smithi110 ceph-mon[28069]: pgmap v9577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:44 smithi193 ceph-mon[32782]: pgmap v9577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:46 smithi196 ceph-mon[32572]: pgmap v9578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:46 smithi110 ceph-mon[28069]: pgmap v9578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:46 smithi193 ceph-mon[32782]: pgmap v9578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:35:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17262.140440 secs 2024-04-26T16:35:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17262.140440 secs 2024-04-26T16:35:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17262.140440 secs 2024-04-26T16:35:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:48 smithi196 ceph-mon[32572]: pgmap v9579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:35:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:48 smithi110 ceph-mon[28069]: pgmap v9579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:35:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:48 smithi193 ceph-mon[32782]: pgmap v9579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:35:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:50 smithi196 ceph-mon[32572]: pgmap v9580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:50 smithi110 ceph-mon[28069]: pgmap v9580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:50 smithi193 ceph-mon[32782]: pgmap v9580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:52 smithi196 ceph-mon[32572]: pgmap v9581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17267.140580 secs 2024-04-26T16:35:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:52 smithi110 ceph-mon[28069]: pgmap v9581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17267.140580 secs 2024-04-26T16:35:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:52 smithi193 ceph-mon[32782]: pgmap v9581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17267.140580 secs 2024-04-26T16:35:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:54 smithi196 ceph-mon[32572]: pgmap v9582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:54 smithi110 ceph-mon[28069]: pgmap v9582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:54 smithi193 ceph-mon[32782]: pgmap v9582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:35:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:56 smithi196 ceph-mon[32572]: pgmap v9583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:56 smithi110 ceph-mon[28069]: pgmap v9583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:56 smithi193 ceph-mon[32782]: pgmap v9583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17272.140698 secs 2024-04-26T16:35:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17272.140698 secs 2024-04-26T16:35:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17272.140698 secs 2024-04-26T16:35:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:35:58 smithi196 ceph-mon[32572]: pgmap v9584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:35:58 smithi110 ceph-mon[28069]: pgmap v9584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:35:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:35:58 smithi193 ceph-mon[32782]: pgmap v9584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:00 smithi196 ceph-mon[32572]: pgmap v9585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:00 smithi110 ceph-mon[28069]: pgmap v9585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:00 smithi193 ceph-mon[32782]: pgmap v9585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:02 smithi196 ceph-mon[32572]: pgmap v9586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17277.140809 secs 2024-04-26T16:36:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:02 smithi110 ceph-mon[28069]: pgmap v9586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17277.140809 secs 2024-04-26T16:36:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:02 smithi193 ceph-mon[32782]: pgmap v9586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17277.140809 secs 2024-04-26T16:36:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:04 smithi196 ceph-mon[32572]: pgmap v9587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:04 smithi110 ceph-mon[28069]: pgmap v9587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:04 smithi193 ceph-mon[32782]: pgmap v9587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:06 smithi196 ceph-mon[32572]: pgmap v9588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:06 smithi110 ceph-mon[28069]: pgmap v9588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:06 smithi193 ceph-mon[32782]: pgmap v9588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:07 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 17282.140925 secs 2024-04-26T16:36:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:07 smithi196 ceph-mon[32572]: slow request 11523.396219 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:36:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:07 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 17282.140925 secs 2024-04-26T16:36:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:07 smithi110 ceph-mon[28069]: slow request 11523.396219 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:36:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:07 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 17282.140925 secs 2024-04-26T16:36:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:07 smithi193 ceph-mon[32782]: slow request 11523.396219 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:36:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:08 smithi196 ceph-mon[32572]: pgmap v9589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:08 smithi110 ceph-mon[28069]: pgmap v9589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:08 smithi193 ceph-mon[32782]: pgmap v9589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:09 smithi196 ceph-mon[32572]: pgmap v9590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:09 smithi110 ceph-mon[28069]: pgmap v9590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:09 smithi193 ceph-mon[32782]: pgmap v9590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:11 smithi196 ceph-mon[32572]: pgmap v9591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:11 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17287.141042 secs 2024-04-26T16:36:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:11 smithi110 ceph-mon[28069]: pgmap v9591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:11 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17287.141042 secs 2024-04-26T16:36:12.324 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:11 smithi193 ceph-mon[32782]: pgmap v9591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:12.325 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:11 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17287.141042 secs 2024-04-26T16:36:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:13 smithi196 ceph-mon[32572]: pgmap v9592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:13 smithi110 ceph-mon[28069]: pgmap v9592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:13 smithi193 ceph-mon[32782]: pgmap v9592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:15 smithi196 ceph-mon[32572]: pgmap v9593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:15 smithi110 ceph-mon[28069]: pgmap v9593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:15 smithi193 ceph-mon[32782]: pgmap v9593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17292.141156 secs 2024-04-26T16:36:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17292.141156 secs 2024-04-26T16:36:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17292.141156 secs 2024-04-26T16:36:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:17 smithi196 ceph-mon[32572]: pgmap v9594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:17 smithi110 ceph-mon[28069]: pgmap v9594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:17 smithi193 ceph-mon[32782]: pgmap v9594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:36:19.224+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:36:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:36:19.224+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:36:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:36:19.224+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 135 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:36:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:36:19.224+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 135 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:36:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:19 smithi196 ceph-mon[32572]: pgmap v9595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:19 smithi110 ceph-mon[28069]: pgmap v9595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:19 smithi193 ceph-mon[32782]: pgmap v9595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:21 smithi196 ceph-mon[32572]: pgmap v9596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17297.141276 secs 2024-04-26T16:36:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:21 smithi110 ceph-mon[28069]: pgmap v9596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17297.141276 secs 2024-04-26T16:36:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:21 smithi193 ceph-mon[32782]: pgmap v9596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17297.141276 secs 2024-04-26T16:36:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:23 smithi196 ceph-mon[32572]: pgmap v9597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:23 smithi110 ceph-mon[28069]: pgmap v9597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:23 smithi193 ceph-mon[32782]: pgmap v9597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:25 smithi196 ceph-mon[32572]: pgmap v9598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:25 smithi110 ceph-mon[28069]: pgmap v9598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:25 smithi193 ceph-mon[32782]: pgmap v9598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17302.141338 secs 2024-04-26T16:36:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17302.141338 secs 2024-04-26T16:36:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17302.141338 secs 2024-04-26T16:36:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:27 smithi196 ceph-mon[32572]: pgmap v9599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:27 smithi110 ceph-mon[28069]: pgmap v9599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:27 smithi193 ceph-mon[32782]: pgmap v9599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:29 smithi196 ceph-mon[32572]: pgmap v9600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:29 smithi110 ceph-mon[28069]: pgmap v9600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:29 smithi193 ceph-mon[32782]: pgmap v9600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:31 smithi196 ceph-mon[32572]: pgmap v9601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17307.141458 secs 2024-04-26T16:36:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:31 smithi110 ceph-mon[28069]: pgmap v9601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17307.141458 secs 2024-04-26T16:36:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:31 smithi193 ceph-mon[32782]: pgmap v9601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17307.141458 secs 2024-04-26T16:36:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:34 smithi196 ceph-mon[32572]: pgmap v9602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:34 smithi110 ceph-mon[28069]: pgmap v9602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:34 smithi193 ceph-mon[32782]: pgmap v9602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:36 smithi110 ceph-mon[28069]: pgmap v9603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:36 smithi193 ceph-mon[32782]: pgmap v9603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:36 smithi196 ceph-mon[32572]: pgmap v9603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17312.141588 secs 2024-04-26T16:36:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17312.141588 secs 2024-04-26T16:36:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17312.141588 secs 2024-04-26T16:36:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:38 smithi110 ceph-mon[28069]: pgmap v9604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:36:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:38 smithi193 ceph-mon[32782]: pgmap v9604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:36:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:38 smithi196 ceph-mon[32572]: pgmap v9604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:36:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:36:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:36:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:36:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:36:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:36:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:36:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:36:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:36:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:36:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:40 smithi110 ceph-mon[28069]: pgmap v9605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:36:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:40 smithi110 ceph-mon[28069]: pgmap v9606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:40 smithi193 ceph-mon[32782]: pgmap v9605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:36:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:40 smithi193 ceph-mon[32782]: pgmap v9606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:40 smithi196 ceph-mon[32572]: pgmap v9605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:36:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:40 smithi196 ceph-mon[32572]: pgmap v9606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:42 smithi110 ceph-mon[28069]: pgmap v9607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17317.141633 secs 2024-04-26T16:36:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:42 smithi193 ceph-mon[32782]: pgmap v9607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17317.141633 secs 2024-04-26T16:36:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:42 smithi196 ceph-mon[32572]: pgmap v9607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17317.141633 secs 2024-04-26T16:36:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:44 smithi193 ceph-mon[32782]: pgmap v9608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:44 smithi196 ceph-mon[32572]: pgmap v9608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:44 smithi110 ceph-mon[28069]: pgmap v9608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:46 smithi193 ceph-mon[32782]: pgmap v9609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:46 smithi196 ceph-mon[32572]: pgmap v9609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:46 smithi110 ceph-mon[28069]: pgmap v9609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17322.141750 secs 2024-04-26T16:36:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17322.141750 secs 2024-04-26T16:36:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17322.141750 secs 2024-04-26T16:36:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:48 smithi193 ceph-mon[32782]: pgmap v9610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:48 smithi196 ceph-mon[32572]: pgmap v9610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:48 smithi110 ceph-mon[28069]: pgmap v9610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:36:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:50 smithi193 ceph-mon[32782]: pgmap v9611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:36:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:50 smithi196 ceph-mon[32572]: pgmap v9611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:36:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:50 smithi110 ceph-mon[28069]: pgmap v9611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:36:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:52 smithi193 ceph-mon[32782]: pgmap v9612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17327.141863 secs 2024-04-26T16:36:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:52 smithi196 ceph-mon[32572]: pgmap v9612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17327.141863 secs 2024-04-26T16:36:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:52 smithi110 ceph-mon[28069]: pgmap v9612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17327.141863 secs 2024-04-26T16:36:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:54 smithi193 ceph-mon[32782]: pgmap v9613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:54 smithi196 ceph-mon[32572]: pgmap v9613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:54 smithi110 ceph-mon[28069]: pgmap v9613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:36:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:56 smithi193 ceph-mon[32782]: pgmap v9614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:56 smithi196 ceph-mon[32572]: pgmap v9614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:56.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:56 smithi110 ceph-mon[28069]: pgmap v9614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17332.141986 secs 2024-04-26T16:36:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17332.141986 secs 2024-04-26T16:36:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17332.141986 secs 2024-04-26T16:36:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:36:58 smithi193 ceph-mon[32782]: pgmap v9615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:36:58 smithi196 ceph-mon[32572]: pgmap v9615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:36:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:36:58 smithi110 ceph-mon[28069]: pgmap v9615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:00 smithi193 ceph-mon[32782]: pgmap v9616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:00 smithi196 ceph-mon[32572]: pgmap v9616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:00 smithi110 ceph-mon[28069]: pgmap v9616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:02 smithi193 ceph-mon[32782]: pgmap v9617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17337.142085 secs 2024-04-26T16:37:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:02 smithi196 ceph-mon[32572]: pgmap v9617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17337.142085 secs 2024-04-26T16:37:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:02 smithi110 ceph-mon[28069]: pgmap v9617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17337.142085 secs 2024-04-26T16:37:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:37:04.232+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:37:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:37:04.232+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:37:04.232 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:37:04.232+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 136 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:37:04.233 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:37:04.233+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 136 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:37:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:04 smithi193 ceph-mon[32782]: pgmap v9618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:04 smithi196 ceph-mon[32572]: pgmap v9618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:04 smithi110 ceph-mon[28069]: pgmap v9618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:06 smithi193 ceph-mon[32782]: pgmap v9619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:06 smithi196 ceph-mon[32572]: pgmap v9619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:06 smithi110 ceph-mon[28069]: pgmap v9619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17342.142221 secs 2024-04-26T16:37:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17342.142221 secs 2024-04-26T16:37:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17342.142221 secs 2024-04-26T16:37:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:08 smithi196 ceph-mon[32572]: pgmap v9620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:08 smithi110 ceph-mon[28069]: pgmap v9620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:08 smithi193 ceph-mon[32782]: pgmap v9620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:10 smithi196 ceph-mon[32572]: pgmap v9621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:10.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:10 smithi110 ceph-mon[28069]: pgmap v9621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:10 smithi193 ceph-mon[32782]: pgmap v9621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:12.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:12 smithi193 ceph-mon[32782]: pgmap v9622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:12.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 17347.142340 secs 2024-04-26T16:37:12.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:12 smithi193 ceph-mon[32782]: slow request 2884.160100 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:37:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:12 smithi196 ceph-mon[32572]: pgmap v9622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 17347.142340 secs 2024-04-26T16:37:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:12 smithi196 ceph-mon[32572]: slow request 2884.160100 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:37:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:12 smithi110 ceph-mon[28069]: pgmap v9622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 17347.142340 secs 2024-04-26T16:37:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:12 smithi110 ceph-mon[28069]: slow request 2884.160100 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:37:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:14 smithi196 ceph-mon[32572]: pgmap v9623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:14 smithi110 ceph-mon[28069]: pgmap v9623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:14 smithi193 ceph-mon[32782]: pgmap v9623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:16 smithi196 ceph-mon[32572]: pgmap v9624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:16 smithi110 ceph-mon[28069]: pgmap v9624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:16 smithi193 ceph-mon[32782]: pgmap v9624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17352.142470 secs 2024-04-26T16:37:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17352.142470 secs 2024-04-26T16:37:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17352.142470 secs 2024-04-26T16:37:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:18 smithi196 ceph-mon[32572]: pgmap v9625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:18 smithi110 ceph-mon[28069]: pgmap v9625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:18 smithi193 ceph-mon[32782]: pgmap v9625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:20 smithi196 ceph-mon[32572]: pgmap v9626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:20 smithi110 ceph-mon[28069]: pgmap v9626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:20 smithi193 ceph-mon[32782]: pgmap v9626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:22 smithi196 ceph-mon[32572]: pgmap v9627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17357.142593 secs 2024-04-26T16:37:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:22 smithi110 ceph-mon[28069]: pgmap v9627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17357.142593 secs 2024-04-26T16:37:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:22 smithi193 ceph-mon[32782]: pgmap v9627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17357.142593 secs 2024-04-26T16:37:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:24 smithi196 ceph-mon[32572]: pgmap v9628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:24 smithi110 ceph-mon[28069]: pgmap v9628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:24 smithi193 ceph-mon[32782]: pgmap v9628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:26 smithi196 ceph-mon[32572]: pgmap v9629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:26 smithi110 ceph-mon[28069]: pgmap v9629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:26 smithi193 ceph-mon[32782]: pgmap v9629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17362.142716 secs 2024-04-26T16:37:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17362.142716 secs 2024-04-26T16:37:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17362.142716 secs 2024-04-26T16:37:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:28 smithi196 ceph-mon[32572]: pgmap v9630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:28 smithi110 ceph-mon[28069]: pgmap v9630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:28 smithi193 ceph-mon[32782]: pgmap v9630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:30 smithi196 ceph-mon[32572]: pgmap v9631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:30 smithi110 ceph-mon[28069]: pgmap v9631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:30 smithi193 ceph-mon[32782]: pgmap v9631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:32 smithi196 ceph-mon[32572]: pgmap v9632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17367.142835 secs 2024-04-26T16:37:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:32 smithi110 ceph-mon[28069]: pgmap v9632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17367.142835 secs 2024-04-26T16:37:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:32 smithi193 ceph-mon[32782]: pgmap v9632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17367.142835 secs 2024-04-26T16:37:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:34 smithi196 ceph-mon[32572]: pgmap v9633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:34 smithi110 ceph-mon[28069]: pgmap v9633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:34 smithi193 ceph-mon[32782]: pgmap v9633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:36 smithi196 ceph-mon[32572]: pgmap v9634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:36 smithi110 ceph-mon[28069]: pgmap v9634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:36 smithi193 ceph-mon[32782]: pgmap v9634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17372.142961 secs 2024-04-26T16:37:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17372.142961 secs 2024-04-26T16:37:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17372.142961 secs 2024-04-26T16:37:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:38 smithi196 ceph-mon[32572]: pgmap v9635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:38 smithi110 ceph-mon[28069]: pgmap v9635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:38 smithi193 ceph-mon[32782]: pgmap v9635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:37:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:37:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:37:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:40 smithi196 ceph-mon[32572]: pgmap v9636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:37:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:37:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:40 smithi196 ceph-mon[32572]: pgmap v9637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T16:37:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:40 smithi196 ceph-mon[32572]: pgmap v9638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:37:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:40 smithi110 ceph-mon[28069]: pgmap v9636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:37:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:37:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:40 smithi110 ceph-mon[28069]: pgmap v9637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T16:37:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:40 smithi110 ceph-mon[28069]: pgmap v9638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:37:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:40 smithi193 ceph-mon[32782]: pgmap v9636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:37:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:37:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:40 smithi193 ceph-mon[32782]: pgmap v9637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T16:37:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:40 smithi193 ceph-mon[32782]: pgmap v9638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:37:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17377.143082 secs 2024-04-26T16:37:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17377.143082 secs 2024-04-26T16:37:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17377.143082 secs 2024-04-26T16:37:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:42 smithi196 ceph-mon[32572]: pgmap v9639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:37:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:42 smithi110 ceph-mon[28069]: pgmap v9639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:37:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:42 smithi193 ceph-mon[32782]: pgmap v9639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:37:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:45 smithi110 ceph-mon[28069]: pgmap v9640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:45 smithi193 ceph-mon[32782]: pgmap v9640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:45 smithi196 ceph-mon[32572]: pgmap v9640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:47 smithi110 ceph-mon[28069]: pgmap v9641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17382.143215 secs 2024-04-26T16:37:47.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:47 smithi196 ceph-mon[32572]: pgmap v9641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:47.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17382.143215 secs 2024-04-26T16:37:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:47 smithi193 ceph-mon[32782]: pgmap v9641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17382.143215 secs 2024-04-26T16:37:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:49 smithi110 ceph-mon[28069]: pgmap v9642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:49 smithi193 ceph-mon[32782]: pgmap v9642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:49 smithi196 ceph-mon[32572]: pgmap v9642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:37:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:51 smithi110 ceph-mon[28069]: pgmap v9643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:37:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:51 smithi193 ceph-mon[32782]: pgmap v9643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:37:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:51 smithi196 ceph-mon[32572]: pgmap v9643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:37:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17387.143277 secs 2024-04-26T16:37:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17387.143277 secs 2024-04-26T16:37:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17387.143277 secs 2024-04-26T16:37:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:53 smithi110 ceph-mon[28069]: pgmap v9644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:53 smithi193 ceph-mon[32782]: pgmap v9644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:53 smithi196 ceph-mon[32572]: pgmap v9644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:55 smithi110 ceph-mon[28069]: pgmap v9645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:55 smithi193 ceph-mon[32782]: pgmap v9645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:55 smithi196 ceph-mon[32572]: pgmap v9645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:57 smithi193 ceph-mon[32782]: pgmap v9646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17392.143411 secs 2024-04-26T16:37:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:57 smithi196 ceph-mon[32572]: pgmap v9646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17392.143411 secs 2024-04-26T16:37:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:57 smithi110 ceph-mon[28069]: pgmap v9646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:37:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17392.143411 secs 2024-04-26T16:37:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:37:59 smithi193 ceph-mon[32782]: pgmap v9647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:37:59 smithi196 ceph-mon[32572]: pgmap v9647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:37:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:37:59 smithi110 ceph-mon[28069]: pgmap v9647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:01 smithi193 ceph-mon[32782]: pgmap v9648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:01 smithi196 ceph-mon[32572]: pgmap v9648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:01 smithi110 ceph-mon[28069]: pgmap v9648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17397.143574 secs 2024-04-26T16:38:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17397.143574 secs 2024-04-26T16:38:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17397.143574 secs 2024-04-26T16:38:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:03 smithi193 ceph-mon[32782]: pgmap v9649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:03 smithi196 ceph-mon[32572]: pgmap v9649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:03 smithi110 ceph-mon[28069]: pgmap v9649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:05 smithi193 ceph-mon[32782]: pgmap v9650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:05 smithi196 ceph-mon[32572]: pgmap v9650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:05 smithi110 ceph-mon[28069]: pgmap v9650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:06 smithi196 ceph-mon[32572]: pgmap v9651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:06 smithi110 ceph-mon[28069]: pgmap v9651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:06 smithi193 ceph-mon[32782]: pgmap v9651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:07.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17402.143680 secs 2024-04-26T16:38:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17402.143680 secs 2024-04-26T16:38:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17402.143680 secs 2024-04-26T16:38:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:08 smithi196 ceph-mon[32572]: pgmap v9652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:08 smithi110 ceph-mon[28069]: pgmap v9652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:08 smithi193 ceph-mon[32782]: pgmap v9652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:11 smithi110 ceph-mon[28069]: pgmap v9653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:11 smithi193 ceph-mon[32782]: pgmap v9653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:11 smithi196 ceph-mon[32572]: pgmap v9653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:12.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17407.143797 secs 2024-04-26T16:38:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17407.143797 secs 2024-04-26T16:38:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17407.143797 secs 2024-04-26T16:38:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:13 smithi110 ceph-mon[28069]: pgmap v9654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:13 smithi193 ceph-mon[32782]: pgmap v9654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:13 smithi196 ceph-mon[32572]: pgmap v9654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:15 smithi110 ceph-mon[28069]: pgmap v9655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:15 smithi193 ceph-mon[32782]: pgmap v9655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:15 smithi196 ceph-mon[32572]: pgmap v9655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:17 smithi110 ceph-mon[28069]: pgmap v9656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17412.143891 secs 2024-04-26T16:38:17.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:17 smithi196 ceph-mon[32572]: pgmap v9656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:17.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17412.143891 secs 2024-04-26T16:38:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:17 smithi193 ceph-mon[32782]: pgmap v9656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17412.143891 secs 2024-04-26T16:38:19.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:19 smithi110 ceph-mon[28069]: pgmap v9657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:19 smithi193 ceph-mon[32782]: pgmap v9657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:19 smithi196 ceph-mon[32572]: pgmap v9657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:21 smithi193 ceph-mon[32782]: pgmap v9658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:21 smithi196 ceph-mon[32572]: pgmap v9658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:21 smithi110 ceph-mon[28069]: pgmap v9658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:22.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17417.144035 secs 2024-04-26T16:38:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17417.144035 secs 2024-04-26T16:38:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17417.144035 secs 2024-04-26T16:38:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:23 smithi193 ceph-mon[32782]: pgmap v9659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:23 smithi196 ceph-mon[32572]: pgmap v9659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:23 smithi110 ceph-mon[28069]: pgmap v9659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:25 smithi193 ceph-mon[32782]: pgmap v9660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:25 smithi196 ceph-mon[32572]: pgmap v9660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:25 smithi110 ceph-mon[28069]: pgmap v9660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:27 smithi193 ceph-mon[32782]: pgmap v9661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17422.144116 secs 2024-04-26T16:38:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:27 smithi196 ceph-mon[32572]: pgmap v9661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17422.144116 secs 2024-04-26T16:38:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:27 smithi110 ceph-mon[28069]: pgmap v9661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17422.144116 secs 2024-04-26T16:38:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:29 smithi193 ceph-mon[32782]: pgmap v9662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:29 smithi196 ceph-mon[32572]: pgmap v9662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:29 smithi110 ceph-mon[28069]: pgmap v9662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:31 smithi193 ceph-mon[32782]: pgmap v9663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:31 smithi196 ceph-mon[32572]: pgmap v9663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:31 smithi110 ceph-mon[28069]: pgmap v9663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17427.144252 secs 2024-04-26T16:38:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17427.144252 secs 2024-04-26T16:38:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17427.144252 secs 2024-04-26T16:38:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:33 smithi193 ceph-mon[32782]: pgmap v9664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:33 smithi196 ceph-mon[32572]: pgmap v9664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:33 smithi110 ceph-mon[28069]: pgmap v9664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:35 smithi193 ceph-mon[32782]: pgmap v9665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:35 smithi196 ceph-mon[32572]: pgmap v9665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:35 smithi110 ceph-mon[28069]: pgmap v9665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:37 smithi193 ceph-mon[32782]: pgmap v9666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17432.144386 secs 2024-04-26T16:38:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:37 smithi196 ceph-mon[32572]: pgmap v9666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17432.144386 secs 2024-04-26T16:38:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:37 smithi110 ceph-mon[28069]: pgmap v9666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17432.144386 secs 2024-04-26T16:38:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:39 smithi193 ceph-mon[32782]: pgmap v9667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:39 smithi196 ceph-mon[32572]: pgmap v9667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:39 smithi110 ceph-mon[28069]: pgmap v9667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:41 smithi193 ceph-mon[32782]: pgmap v9668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:38:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:41 smithi196 ceph-mon[32572]: pgmap v9668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:38:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:41 smithi110 ceph-mon[28069]: pgmap v9668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:38:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17437.144523 secs 2024-04-26T16:38:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:38:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:38:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:38:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17437.144523 secs 2024-04-26T16:38:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:38:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:38:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:38:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17437.144523 secs 2024-04-26T16:38:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:38:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:38:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:38:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:43 smithi193 ceph-mon[32782]: pgmap v9669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:38:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:43 smithi193 ceph-mon[32782]: pgmap v9670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:43 smithi196 ceph-mon[32572]: pgmap v9669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:38:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:43 smithi196 ceph-mon[32572]: pgmap v9670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:43 smithi110 ceph-mon[28069]: pgmap v9669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:38:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:43 smithi110 ceph-mon[28069]: pgmap v9670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:45 smithi196 ceph-mon[32572]: pgmap v9671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:45 smithi110 ceph-mon[28069]: pgmap v9671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:45 smithi193 ceph-mon[32782]: pgmap v9671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:47 smithi196 ceph-mon[32572]: pgmap v9672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17442.144638 secs 2024-04-26T16:38:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:47 smithi110 ceph-mon[28069]: pgmap v9672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17442.144638 secs 2024-04-26T16:38:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:47 smithi193 ceph-mon[32782]: pgmap v9672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17442.144638 secs 2024-04-26T16:38:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:49 smithi196 ceph-mon[32572]: pgmap v9673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:49 smithi110 ceph-mon[28069]: pgmap v9673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:49 smithi193 ceph-mon[32782]: pgmap v9673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:51 smithi196 ceph-mon[32572]: pgmap v9674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:51 smithi110 ceph-mon[28069]: pgmap v9674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:51 smithi193 ceph-mon[32782]: pgmap v9674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:38:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17447.144755 secs 2024-04-26T16:38:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17447.144755 secs 2024-04-26T16:38:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17447.144755 secs 2024-04-26T16:38:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:53 smithi196 ceph-mon[32572]: pgmap v9675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:38:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:53 smithi110 ceph-mon[28069]: pgmap v9675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:38:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:53 smithi193 ceph-mon[32782]: pgmap v9675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:38:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:55 smithi196 ceph-mon[32572]: pgmap v9676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:55 smithi110 ceph-mon[28069]: pgmap v9676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:55 smithi193 ceph-mon[32782]: pgmap v9676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:57 smithi196 ceph-mon[32572]: pgmap v9677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17452.144876 secs 2024-04-26T16:38:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:57 smithi110 ceph-mon[28069]: pgmap v9677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17452.144876 secs 2024-04-26T16:38:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:57 smithi193 ceph-mon[32782]: pgmap v9677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:38:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17452.144876 secs 2024-04-26T16:38:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:38:59 smithi196 ceph-mon[32572]: pgmap v9678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:38:59 smithi110 ceph-mon[28069]: pgmap v9678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:38:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:38:59 smithi193 ceph-mon[32782]: pgmap v9678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:01 smithi196 ceph-mon[32572]: pgmap v9679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:01 smithi110 ceph-mon[28069]: pgmap v9679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:01 smithi193 ceph-mon[32782]: pgmap v9679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17457.144998 secs 2024-04-26T16:39:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17457.144998 secs 2024-04-26T16:39:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17457.144998 secs 2024-04-26T16:39:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:03 smithi196 ceph-mon[32572]: pgmap v9680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:03 smithi110 ceph-mon[28069]: pgmap v9680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:03 smithi193 ceph-mon[32782]: pgmap v9680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:05 smithi196 ceph-mon[32572]: pgmap v9681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:05 smithi110 ceph-mon[28069]: pgmap v9681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:05 smithi193 ceph-mon[32782]: pgmap v9681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:07 smithi196 ceph-mon[32572]: pgmap v9682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17462.145112 secs 2024-04-26T16:39:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:07 smithi110 ceph-mon[28069]: pgmap v9682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17462.145112 secs 2024-04-26T16:39:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:07 smithi193 ceph-mon[32782]: pgmap v9682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17462.145112 secs 2024-04-26T16:39:09.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:39:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:39:08.772+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:39:09.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:39:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:39:08.772+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:39:09.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:39:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:39:08.772+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:39:09.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:39:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:39:08.772+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:39:09.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:39:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:39:08.772+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:39:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:09 smithi196 ceph-mon[32572]: pgmap v9683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:09 smithi110 ceph-mon[28069]: pgmap v9683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:09 smithi193 ceph-mon[32782]: pgmap v9683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:11 smithi196 ceph-mon[32572]: pgmap v9684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:11 smithi110 ceph-mon[28069]: pgmap v9684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:11 smithi193 ceph-mon[32782]: pgmap v9684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17467.145229 secs 2024-04-26T16:39:12.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17467.145229 secs 2024-04-26T16:39:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17467.145229 secs 2024-04-26T16:39:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:13 smithi196 ceph-mon[32572]: pgmap v9685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:13 smithi110 ceph-mon[28069]: pgmap v9685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:13 smithi193 ceph-mon[32782]: pgmap v9685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:15 smithi196 ceph-mon[32572]: pgmap v9686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:15 smithi110 ceph-mon[28069]: pgmap v9686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:15 smithi193 ceph-mon[32782]: pgmap v9686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:17 smithi196 ceph-mon[32572]: pgmap v9687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17472.145351 secs 2024-04-26T16:39:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:17 smithi110 ceph-mon[28069]: pgmap v9687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17472.145351 secs 2024-04-26T16:39:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:17 smithi193 ceph-mon[32782]: pgmap v9687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17472.145351 secs 2024-04-26T16:39:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:39:19.252+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:39:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:39:19.252+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:39:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:39:19.253+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 137 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:39:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:39:19.253+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 137 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:39:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:19 smithi196 ceph-mon[32572]: pgmap v9688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:19 smithi110 ceph-mon[28069]: pgmap v9688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:19 smithi193 ceph-mon[32782]: pgmap v9688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:21 smithi196 ceph-mon[32572]: pgmap v9689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:21 smithi110 ceph-mon[28069]: pgmap v9689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:21 smithi193 ceph-mon[32782]: pgmap v9689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17477.145476 secs 2024-04-26T16:39:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17477.145476 secs 2024-04-26T16:39:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17477.145476 secs 2024-04-26T16:39:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:23 smithi110 ceph-mon[28069]: pgmap v9690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:23 smithi193 ceph-mon[32782]: pgmap v9690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:23 smithi196 ceph-mon[32572]: pgmap v9690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:24 smithi110 ceph-mon[28069]: pgmap v9691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:24 smithi193 ceph-mon[32782]: pgmap v9691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:24 smithi196 ceph-mon[32572]: pgmap v9691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:26 smithi193 ceph-mon[32782]: pgmap v9692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:26 smithi196 ceph-mon[32572]: pgmap v9692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:26 smithi110 ceph-mon[28069]: pgmap v9692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17482.145589 secs 2024-04-26T16:39:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17482.145589 secs 2024-04-26T16:39:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17482.145589 secs 2024-04-26T16:39:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:28 smithi193 ceph-mon[32782]: pgmap v9693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:28 smithi196 ceph-mon[32572]: pgmap v9693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:28 smithi110 ceph-mon[28069]: pgmap v9693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:30 smithi193 ceph-mon[32782]: pgmap v9694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:30 smithi196 ceph-mon[32572]: pgmap v9694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:30 smithi110 ceph-mon[28069]: pgmap v9694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17487.145685 secs 2024-04-26T16:39:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:32 smithi193 ceph-mon[32782]: pgmap v9695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17487.145685 secs 2024-04-26T16:39:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:32 smithi196 ceph-mon[32572]: pgmap v9695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17487.145685 secs 2024-04-26T16:39:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:32 smithi110 ceph-mon[28069]: pgmap v9695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:34 smithi193 ceph-mon[32782]: pgmap v9696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:34 smithi196 ceph-mon[32572]: pgmap v9696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:34 smithi110 ceph-mon[28069]: pgmap v9696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:36 smithi196 ceph-mon[32572]: pgmap v9697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:36 smithi110 ceph-mon[28069]: pgmap v9697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:36 smithi193 ceph-mon[32782]: pgmap v9697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:37.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17492.145796 secs 2024-04-26T16:39:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17492.145796 secs 2024-04-26T16:39:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17492.145796 secs 2024-04-26T16:39:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:38 smithi196 ceph-mon[32572]: pgmap v9698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:38 smithi110 ceph-mon[28069]: pgmap v9698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:38 smithi193 ceph-mon[32782]: pgmap v9698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:39:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:40 smithi196 ceph-mon[32572]: pgmap v9699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:40 smithi110 ceph-mon[28069]: pgmap v9699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:40 smithi193 ceph-mon[32782]: pgmap v9699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:42.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17497.145931 secs 2024-04-26T16:39:42.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:42 smithi193 ceph-mon[32782]: pgmap v9700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:42.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:39:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17497.145931 secs 2024-04-26T16:39:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:42 smithi196 ceph-mon[32572]: pgmap v9700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:39:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17497.145931 secs 2024-04-26T16:39:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:42 smithi110 ceph-mon[28069]: pgmap v9700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:39:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:39:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:39:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:43 smithi196 ceph-mon[32572]: pgmap v9701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:39:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:43 smithi196 ceph-mon[32572]: pgmap v9702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:39:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:39:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:39:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:43 smithi110 ceph-mon[28069]: pgmap v9701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:39:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:43 smithi110 ceph-mon[28069]: pgmap v9702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:39:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:39:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:39:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:43 smithi193 ceph-mon[32782]: pgmap v9701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:39:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:43 smithi193 ceph-mon[32782]: pgmap v9702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:39:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:46 smithi196 ceph-mon[32572]: pgmap v9703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:46 smithi110 ceph-mon[28069]: pgmap v9703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:46 smithi193 ceph-mon[32782]: pgmap v9703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17502.146028 secs 2024-04-26T16:39:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17502.146028 secs 2024-04-26T16:39:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17502.146028 secs 2024-04-26T16:39:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:48 smithi196 ceph-mon[32572]: pgmap v9704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T16:39:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:48 smithi110 ceph-mon[28069]: pgmap v9704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T16:39:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:48 smithi193 ceph-mon[32782]: pgmap v9704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T16:39:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:50 smithi196 ceph-mon[32572]: pgmap v9705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:50 smithi110 ceph-mon[28069]: pgmap v9705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:50 smithi193 ceph-mon[32782]: pgmap v9705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:52 smithi196 ceph-mon[32572]: pgmap v9706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17507.146126 secs 2024-04-26T16:39:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:52 smithi110 ceph-mon[28069]: pgmap v9706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17507.146126 secs 2024-04-26T16:39:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:52 smithi193 ceph-mon[32782]: pgmap v9706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:39:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17507.146126 secs 2024-04-26T16:39:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:54 smithi196 ceph-mon[32572]: pgmap v9707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:39:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:54 smithi110 ceph-mon[28069]: pgmap v9707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:39:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:54 smithi193 ceph-mon[32782]: pgmap v9707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:39:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:56 smithi196 ceph-mon[32572]: pgmap v9708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:56 smithi110 ceph-mon[28069]: pgmap v9708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:56 smithi193 ceph-mon[32782]: pgmap v9708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17512.146244 secs 2024-04-26T16:39:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17512.146244 secs 2024-04-26T16:39:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17512.146244 secs 2024-04-26T16:39:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:39:58 smithi196 ceph-mon[32572]: pgmap v9709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:39:58 smithi110 ceph-mon[28069]: pgmap v9709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:39:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:39:58 smithi193 ceph-mon[32782]: pgmap v9709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:00.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:00 smithi196 ceph-mon[32572]: pgmap v9710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:00.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:40:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:00 smithi110 ceph-mon[28069]: pgmap v9710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:40:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:00 smithi193 ceph-mon[32782]: pgmap v9710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:40:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:02 smithi196 ceph-mon[32572]: pgmap v9711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17517.146386 secs 2024-04-26T16:40:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:02 smithi110 ceph-mon[28069]: pgmap v9711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17517.146386 secs 2024-04-26T16:40:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:02 smithi193 ceph-mon[32782]: pgmap v9711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17517.146386 secs 2024-04-26T16:40:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:04 smithi196 ceph-mon[32572]: pgmap v9712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:04 smithi110 ceph-mon[28069]: pgmap v9712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:04 smithi193 ceph-mon[32782]: pgmap v9712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:06 smithi196 ceph-mon[32572]: pgmap v9713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:06 smithi110 ceph-mon[28069]: pgmap v9713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:06 smithi193 ceph-mon[32782]: pgmap v9713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17522.146498 secs 2024-04-26T16:40:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17522.146498 secs 2024-04-26T16:40:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17522.146498 secs 2024-04-26T16:40:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:08 smithi110 ceph-mon[28069]: pgmap v9714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:08 smithi193 ceph-mon[32782]: pgmap v9714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:08 smithi196 ceph-mon[32572]: pgmap v9714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:09 smithi193 ceph-mon[32782]: pgmap v9715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:09 smithi196 ceph-mon[32572]: pgmap v9715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:09 smithi110 ceph-mon[28069]: pgmap v9715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:12 smithi196 ceph-mon[32572]: pgmap v9716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17527.146621 secs 2024-04-26T16:40:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:12 smithi110 ceph-mon[28069]: pgmap v9716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17527.146621 secs 2024-04-26T16:40:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:12 smithi193 ceph-mon[32782]: pgmap v9716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17527.146621 secs 2024-04-26T16:40:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:14 smithi196 ceph-mon[32572]: pgmap v9717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:14 smithi110 ceph-mon[28069]: pgmap v9717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:14 smithi193 ceph-mon[32782]: pgmap v9717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:16 smithi196 ceph-mon[32572]: pgmap v9718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:16 smithi110 ceph-mon[28069]: pgmap v9718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:16 smithi193 ceph-mon[32782]: pgmap v9718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17532.146739 secs 2024-04-26T16:40:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17532.146739 secs 2024-04-26T16:40:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17532.146739 secs 2024-04-26T16:40:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:18 smithi196 ceph-mon[32572]: pgmap v9719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:18 smithi110 ceph-mon[28069]: pgmap v9719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:18 smithi193 ceph-mon[32782]: pgmap v9719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:20 smithi196 ceph-mon[32572]: pgmap v9720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:20 smithi110 ceph-mon[28069]: pgmap v9720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:20 smithi193 ceph-mon[32782]: pgmap v9720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:22 smithi196 ceph-mon[32572]: pgmap v9721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17537.146862 secs 2024-04-26T16:40:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:22 smithi110 ceph-mon[28069]: pgmap v9721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17537.146862 secs 2024-04-26T16:40:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:22 smithi193 ceph-mon[32782]: pgmap v9721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17537.146862 secs 2024-04-26T16:40:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:24 smithi196 ceph-mon[32572]: pgmap v9722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:24 smithi110 ceph-mon[28069]: pgmap v9722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:24 smithi193 ceph-mon[32782]: pgmap v9722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:26 smithi196 ceph-mon[32572]: pgmap v9723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:26 smithi110 ceph-mon[28069]: pgmap v9723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:26 smithi193 ceph-mon[32782]: pgmap v9723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17542.147003 secs 2024-04-26T16:40:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17542.147003 secs 2024-04-26T16:40:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17542.147003 secs 2024-04-26T16:40:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:28 smithi196 ceph-mon[32572]: pgmap v9724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:28 smithi110 ceph-mon[28069]: pgmap v9724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:28 smithi193 ceph-mon[32782]: pgmap v9724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:30 smithi110 ceph-mon[28069]: pgmap v9725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:30 smithi193 ceph-mon[32782]: pgmap v9725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:30 smithi196 ceph-mon[32572]: pgmap v9725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:32 smithi110 ceph-mon[28069]: pgmap v9726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17547.147121 secs 2024-04-26T16:40:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:32 smithi193 ceph-mon[32782]: pgmap v9726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17547.147121 secs 2024-04-26T16:40:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:32 smithi196 ceph-mon[32572]: pgmap v9726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17547.147121 secs 2024-04-26T16:40:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:34 smithi110 ceph-mon[28069]: pgmap v9727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:34 smithi193 ceph-mon[32782]: pgmap v9727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:34 smithi196 ceph-mon[32572]: pgmap v9727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:35 smithi193 ceph-mon[32782]: pgmap v9728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:35 smithi196 ceph-mon[32572]: pgmap v9728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:35 smithi110 ceph-mon[28069]: pgmap v9728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17552.147236 secs 2024-04-26T16:40:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17552.147236 secs 2024-04-26T16:40:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17552.147236 secs 2024-04-26T16:40:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:37 smithi196 ceph-mon[32572]: pgmap v9729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:37 smithi110 ceph-mon[28069]: pgmap v9729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:37 smithi193 ceph-mon[32782]: pgmap v9729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:40 smithi196 ceph-mon[32572]: pgmap v9730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:40 smithi110 ceph-mon[28069]: pgmap v9730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:40 smithi193 ceph-mon[32782]: pgmap v9730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:42 smithi196 ceph-mon[32572]: pgmap v9731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17557.147376 secs 2024-04-26T16:40:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:42 smithi110 ceph-mon[28069]: pgmap v9731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17557.147376 secs 2024-04-26T16:40:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:42 smithi193 ceph-mon[32782]: pgmap v9731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17557.147376 secs 2024-04-26T16:40:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:44 smithi196 ceph-mon[32572]: pgmap v9732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:40:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:44 smithi110 ceph-mon[28069]: pgmap v9732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:40:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:44 smithi193 ceph-mon[32782]: pgmap v9732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:40:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:40:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:40:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:45 smithi110 ceph-mon[28069]: pgmap v9733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:40:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:40:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:45 smithi193 ceph-mon[32782]: pgmap v9733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:40:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:40:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:45 smithi196 ceph-mon[32572]: pgmap v9733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:40:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:40:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:40:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:46 smithi193 ceph-mon[32782]: pgmap v9734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s rd, 1 op/s 2024-04-26T16:40:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:46 smithi193 ceph-mon[32782]: pgmap v9735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:40:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:40:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:40:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:46 smithi196 ceph-mon[32572]: pgmap v9734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s rd, 1 op/s 2024-04-26T16:40:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:46 smithi196 ceph-mon[32572]: pgmap v9735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:40:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:40:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:40:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:46 smithi110 ceph-mon[28069]: pgmap v9734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s rd, 1 op/s 2024-04-26T16:40:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:46 smithi110 ceph-mon[28069]: pgmap v9735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:40:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17562.147498 secs 2024-04-26T16:40:47.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17562.147498 secs 2024-04-26T16:40:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17562.147498 secs 2024-04-26T16:40:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:48 smithi193 ceph-mon[32782]: pgmap v9736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:48.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:48 smithi196 ceph-mon[32572]: pgmap v9736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:48 smithi110 ceph-mon[28069]: pgmap v9736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:50 smithi196 ceph-mon[32572]: pgmap v9737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:50 smithi110 ceph-mon[28069]: pgmap v9737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:50 smithi193 ceph-mon[32782]: pgmap v9737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17567.147620 secs 2024-04-26T16:40:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:52 smithi196 ceph-mon[32572]: pgmap v9738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T16:40:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17567.147620 secs 2024-04-26T16:40:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:52 smithi110 ceph-mon[28069]: pgmap v9738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T16:40:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17567.147620 secs 2024-04-26T16:40:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:52 smithi193 ceph-mon[32782]: pgmap v9738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T16:40:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:54 smithi196 ceph-mon[32572]: pgmap v9739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:54 smithi110 ceph-mon[28069]: pgmap v9739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:54 smithi193 ceph-mon[32782]: pgmap v9739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:56 smithi196 ceph-mon[32572]: pgmap v9740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:40:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:56 smithi110 ceph-mon[28069]: pgmap v9740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:40:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:56 smithi193 ceph-mon[32782]: pgmap v9740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17572.147735 secs 2024-04-26T16:40:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17572.147735 secs 2024-04-26T16:40:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17572.147735 secs 2024-04-26T16:40:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:40:58 smithi196 ceph-mon[32572]: pgmap v9741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:40:58 smithi110 ceph-mon[28069]: pgmap v9741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:40:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:40:58 smithi193 ceph-mon[32782]: pgmap v9741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:00 smithi196 ceph-mon[32572]: pgmap v9742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:00 smithi110 ceph-mon[28069]: pgmap v9742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:00 smithi193 ceph-mon[32782]: pgmap v9742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17577.147800 secs 2024-04-26T16:41:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:02 smithi196 ceph-mon[32572]: pgmap v9743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17577.147800 secs 2024-04-26T16:41:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:02 smithi110 ceph-mon[28069]: pgmap v9743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17577.147800 secs 2024-04-26T16:41:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:02 smithi193 ceph-mon[32782]: pgmap v9743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:04 smithi196 ceph-mon[32572]: pgmap v9744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:04 smithi110 ceph-mon[28069]: pgmap v9744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:04 smithi193 ceph-mon[32782]: pgmap v9744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:06 smithi196 ceph-mon[32572]: pgmap v9745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:06 smithi110 ceph-mon[28069]: pgmap v9745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:06 smithi193 ceph-mon[32782]: pgmap v9745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17582.147876 secs 2024-04-26T16:41:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17582.147876 secs 2024-04-26T16:41:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17582.147876 secs 2024-04-26T16:41:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:08 smithi196 ceph-mon[32572]: pgmap v9746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:08 smithi110 ceph-mon[28069]: pgmap v9746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:08 smithi193 ceph-mon[32782]: pgmap v9746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:10 smithi110 ceph-mon[28069]: pgmap v9747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:10 smithi193 ceph-mon[32782]: pgmap v9747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:10 smithi196 ceph-mon[32572]: pgmap v9747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17587.148001 secs 2024-04-26T16:41:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:12 smithi110 ceph-mon[28069]: pgmap v9748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17587.148001 secs 2024-04-26T16:41:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:12 smithi193 ceph-mon[32782]: pgmap v9748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17587.148001 secs 2024-04-26T16:41:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:12 smithi196 ceph-mon[32572]: pgmap v9748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:14 smithi110 ceph-mon[28069]: pgmap v9749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:14 smithi193 ceph-mon[32782]: pgmap v9749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:14 smithi196 ceph-mon[32572]: pgmap v9749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:16 smithi110 ceph-mon[28069]: pgmap v9750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:17.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:16 smithi196 ceph-mon[32572]: pgmap v9750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:16 smithi193 ceph-mon[32782]: pgmap v9750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17592.148119 secs 2024-04-26T16:41:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17592.148119 secs 2024-04-26T16:41:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17592.148119 secs 2024-04-26T16:41:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:18 smithi110 ceph-mon[28069]: pgmap v9751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:18 smithi193 ceph-mon[32782]: pgmap v9751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:18 smithi196 ceph-mon[32572]: pgmap v9751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:20 smithi110 ceph-mon[28069]: pgmap v9752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:20 smithi193 ceph-mon[32782]: pgmap v9752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:20 smithi196 ceph-mon[32572]: pgmap v9752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17597.148248 secs 2024-04-26T16:41:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:22 smithi193 ceph-mon[32782]: pgmap v9753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17597.148248 secs 2024-04-26T16:41:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:22 smithi196 ceph-mon[32572]: pgmap v9753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17597.148248 secs 2024-04-26T16:41:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:22 smithi110 ceph-mon[28069]: pgmap v9753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:24 smithi193 ceph-mon[32782]: pgmap v9754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:24 smithi196 ceph-mon[32572]: pgmap v9754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:24 smithi110 ceph-mon[28069]: pgmap v9754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:26 smithi193 ceph-mon[32782]: pgmap v9755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:26 smithi196 ceph-mon[32572]: pgmap v9755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:26 smithi110 ceph-mon[28069]: pgmap v9755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17602.148376 secs 2024-04-26T16:41:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17602.148376 secs 2024-04-26T16:41:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17602.148376 secs 2024-04-26T16:41:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:28 smithi193 ceph-mon[32782]: pgmap v9756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:28 smithi196 ceph-mon[32572]: pgmap v9756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:28 smithi110 ceph-mon[28069]: pgmap v9756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:30 smithi193 ceph-mon[32782]: pgmap v9757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:30 smithi196 ceph-mon[32572]: pgmap v9757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:30 smithi110 ceph-mon[28069]: pgmap v9757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17607.148484 secs 2024-04-26T16:41:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:32 smithi193 ceph-mon[32782]: pgmap v9758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17607.148484 secs 2024-04-26T16:41:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:32 smithi196 ceph-mon[32572]: pgmap v9758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17607.148484 secs 2024-04-26T16:41:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:32 smithi110 ceph-mon[28069]: pgmap v9758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:34 smithi193 ceph-mon[32782]: pgmap v9759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:34 smithi196 ceph-mon[32572]: pgmap v9759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:34 smithi110 ceph-mon[28069]: pgmap v9759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:36 smithi193 ceph-mon[32782]: pgmap v9760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17612.148592 secs 2024-04-26T16:41:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:36 smithi196 ceph-mon[32572]: pgmap v9760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17612.148592 secs 2024-04-26T16:41:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:36 smithi110 ceph-mon[28069]: pgmap v9760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17612.148592 secs 2024-04-26T16:41:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:38 smithi193 ceph-mon[32782]: pgmap v9761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:38 smithi196 ceph-mon[32572]: pgmap v9761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:38 smithi110 ceph-mon[28069]: pgmap v9761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:40 smithi193 ceph-mon[32782]: pgmap v9762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:40 smithi196 ceph-mon[32572]: pgmap v9762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:40 smithi110 ceph-mon[28069]: pgmap v9762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:41 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17617.148704 secs 2024-04-26T16:41:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:41 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17617.148704 secs 2024-04-26T16:41:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:41 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17617.148704 secs 2024-04-26T16:41:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:42 smithi196 ceph-mon[32572]: pgmap v9763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:42 smithi110 ceph-mon[28069]: pgmap v9763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:42 smithi193 ceph-mon[32782]: pgmap v9763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:44 smithi196 ceph-mon[32572]: pgmap v9764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:44 smithi110 ceph-mon[28069]: pgmap v9764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:44 smithi193 ceph-mon[32782]: pgmap v9764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:46 smithi196 ceph-mon[32572]: pgmap v9765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17622.148767 secs 2024-04-26T16:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:46 smithi110 ceph-mon[28069]: pgmap v9765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:41:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17622.148767 secs 2024-04-26T16:41:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:46 smithi193 ceph-mon[32782]: pgmap v9765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:41:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:41:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17622.148767 secs 2024-04-26T16:41:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:41:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:41:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:47 smithi196 ceph-mon[32572]: pgmap v9766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T16:41:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:47 smithi196 ceph-mon[32572]: pgmap v9767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T16:41:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:41:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:41:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:47 smithi110 ceph-mon[28069]: pgmap v9766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T16:41:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:47 smithi110 ceph-mon[28069]: pgmap v9767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T16:41:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:41:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:41:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:47 smithi193 ceph-mon[32782]: pgmap v9766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T16:41:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:47 smithi193 ceph-mon[32782]: pgmap v9767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T16:41:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:41:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:49 smithi193 ceph-mon[32782]: pgmap v9768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:49 smithi196 ceph-mon[32572]: pgmap v9768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:49 smithi110 ceph-mon[28069]: pgmap v9768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:51 smithi193 ceph-mon[32782]: pgmap v9769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:51 smithi196 ceph-mon[32572]: pgmap v9769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:51 smithi110 ceph-mon[28069]: pgmap v9769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17627.148909 secs 2024-04-26T16:41:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17627.148909 secs 2024-04-26T16:41:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17627.148909 secs 2024-04-26T16:41:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:53 smithi193 ceph-mon[32782]: pgmap v9770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:53 smithi196 ceph-mon[32572]: pgmap v9770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:53 smithi110 ceph-mon[28069]: pgmap v9770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:55 smithi193 ceph-mon[32782]: pgmap v9771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:55 smithi196 ceph-mon[32572]: pgmap v9771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:55 smithi110 ceph-mon[28069]: pgmap v9771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:41:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17632.149050 secs 2024-04-26T16:41:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17632.149050 secs 2024-04-26T16:41:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17632.149050 secs 2024-04-26T16:41:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:57 smithi196 ceph-mon[32572]: pgmap v9772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:41:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:57 smithi110 ceph-mon[28069]: pgmap v9772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:41:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:57 smithi193 ceph-mon[32782]: pgmap v9772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:41:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:41:59 smithi193 ceph-mon[32782]: pgmap v9773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:41:59 smithi196 ceph-mon[32572]: pgmap v9773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:41:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:41:59 smithi110 ceph-mon[28069]: pgmap v9773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:01 smithi193 ceph-mon[32782]: pgmap v9774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:01 smithi196 ceph-mon[32572]: pgmap v9774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:01 smithi110 ceph-mon[28069]: pgmap v9774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17637.149181 secs 2024-04-26T16:42:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17637.149181 secs 2024-04-26T16:42:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17637.149181 secs 2024-04-26T16:42:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:03 smithi193 ceph-mon[32782]: pgmap v9775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:03 smithi196 ceph-mon[32572]: pgmap v9775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:03 smithi110 ceph-mon[28069]: pgmap v9775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:05 smithi193 ceph-mon[32782]: pgmap v9776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:05 smithi196 ceph-mon[32572]: pgmap v9776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:05 smithi110 ceph-mon[28069]: pgmap v9776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17642.149309 secs 2024-04-26T16:42:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17642.149309 secs 2024-04-26T16:42:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17642.149309 secs 2024-04-26T16:42:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:07 smithi196 ceph-mon[32572]: pgmap v9777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:07 smithi110 ceph-mon[28069]: pgmap v9777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:07 smithi193 ceph-mon[32782]: pgmap v9777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:09 smithi193 ceph-mon[32782]: pgmap v9778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:09 smithi196 ceph-mon[32572]: pgmap v9778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:09 smithi110 ceph-mon[28069]: pgmap v9778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:11 smithi193 ceph-mon[32782]: pgmap v9779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:11 smithi196 ceph-mon[32572]: pgmap v9779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:11 smithi110 ceph-mon[28069]: pgmap v9779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 17647.149443 secs 2024-04-26T16:42:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:12 smithi193 ceph-mon[32782]: slow request 2883.941928 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:42:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 17647.149443 secs 2024-04-26T16:42:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:12 smithi196 ceph-mon[32572]: slow request 2883.941928 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:42:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 17647.149443 secs 2024-04-26T16:42:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:12 smithi110 ceph-mon[28069]: slow request 2883.941928 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:42:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:13 smithi193 ceph-mon[32782]: pgmap v9780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:13 smithi196 ceph-mon[32572]: pgmap v9780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:13 smithi110 ceph-mon[28069]: pgmap v9780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:15 smithi193 ceph-mon[32782]: pgmap v9781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:15 smithi196 ceph-mon[32572]: pgmap v9781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:15 smithi110 ceph-mon[28069]: pgmap v9781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17652.149598 secs 2024-04-26T16:42:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17652.149598 secs 2024-04-26T16:42:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17652.149598 secs 2024-04-26T16:42:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:17 smithi196 ceph-mon[32572]: pgmap v9782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:17 smithi110 ceph-mon[28069]: pgmap v9782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:17 smithi193 ceph-mon[32782]: pgmap v9782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:42:19.282+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:42:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:42:19.282+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:42:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:42:19.283+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 138 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:42:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:42:19.283+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 138 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:42:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:19 smithi193 ceph-mon[32782]: pgmap v9783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:19 smithi196 ceph-mon[32572]: pgmap v9783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:19 smithi110 ceph-mon[28069]: pgmap v9783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:21 smithi193 ceph-mon[32782]: pgmap v9784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:21 smithi196 ceph-mon[32572]: pgmap v9784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:21 smithi110 ceph-mon[28069]: pgmap v9784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17657.149643 secs 2024-04-26T16:42:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17657.149643 secs 2024-04-26T16:42:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17657.149643 secs 2024-04-26T16:42:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:23 smithi193 ceph-mon[32782]: pgmap v9785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:23 smithi196 ceph-mon[32572]: pgmap v9785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:23 smithi110 ceph-mon[28069]: pgmap v9785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:25 smithi193 ceph-mon[32782]: pgmap v9786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:25 smithi196 ceph-mon[32572]: pgmap v9786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:25 smithi110 ceph-mon[28069]: pgmap v9786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17662.149756 secs 2024-04-26T16:42:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17662.149756 secs 2024-04-26T16:42:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17662.149756 secs 2024-04-26T16:42:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:27 smithi196 ceph-mon[32572]: pgmap v9787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:27 smithi110 ceph-mon[28069]: pgmap v9787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:27 smithi193 ceph-mon[32782]: pgmap v9787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:29 smithi193 ceph-mon[32782]: pgmap v9788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:29 smithi196 ceph-mon[32572]: pgmap v9788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:29 smithi110 ceph-mon[28069]: pgmap v9788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:31 smithi193 ceph-mon[32782]: pgmap v9789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:31 smithi196 ceph-mon[32572]: pgmap v9789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:31 smithi110 ceph-mon[28069]: pgmap v9789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17667.149877 secs 2024-04-26T16:42:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17667.149877 secs 2024-04-26T16:42:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17667.149877 secs 2024-04-26T16:42:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:33 smithi193 ceph-mon[32782]: pgmap v9790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:33 smithi196 ceph-mon[32572]: pgmap v9790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:33 smithi110 ceph-mon[28069]: pgmap v9790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:35 smithi193 ceph-mon[32782]: pgmap v9791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:35 smithi196 ceph-mon[32572]: pgmap v9791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:35 smithi110 ceph-mon[28069]: pgmap v9791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:36 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17672.150010 secs 2024-04-26T16:42:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:36 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17672.150010 secs 2024-04-26T16:42:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:36 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17672.150010 secs 2024-04-26T16:42:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:37 smithi196 ceph-mon[32572]: pgmap v9792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:37 smithi110 ceph-mon[28069]: pgmap v9792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:37 smithi193 ceph-mon[32782]: pgmap v9792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:39 smithi193 ceph-mon[32782]: pgmap v9793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:39 smithi196 ceph-mon[32572]: pgmap v9793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:39 smithi110 ceph-mon[28069]: pgmap v9793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:41 smithi193 ceph-mon[32782]: pgmap v9794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:41 smithi196 ceph-mon[32572]: pgmap v9794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:41 smithi110 ceph-mon[28069]: pgmap v9794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17677.150115 secs 2024-04-26T16:42:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17677.150115 secs 2024-04-26T16:42:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17677.150115 secs 2024-04-26T16:42:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:43 smithi193 ceph-mon[32782]: pgmap v9795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:43 smithi196 ceph-mon[32572]: pgmap v9795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:43 smithi110 ceph-mon[28069]: pgmap v9795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:45 smithi193 ceph-mon[32782]: pgmap v9796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:45 smithi196 ceph-mon[32572]: pgmap v9796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:45 smithi110 ceph-mon[28069]: pgmap v9796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:46 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17682.150231 secs 2024-04-26T16:42:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:46 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17682.150231 secs 2024-04-26T16:42:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:46 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17682.150231 secs 2024-04-26T16:42:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:47 smithi196 ceph-mon[32572]: pgmap v9797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:42:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:47 smithi110 ceph-mon[28069]: pgmap v9797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:42:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:47 smithi193 ceph-mon[32782]: pgmap v9797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:42:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:49 smithi193 ceph-mon[32782]: pgmap v9798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:49 smithi196 ceph-mon[32572]: pgmap v9798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:49 smithi110 ceph-mon[28069]: pgmap v9798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:42:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:51 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:42:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:51 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:42:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:51 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:42:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:51 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:42:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:51 smithi196 ceph-mon[32572]: pgmap v9799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:51 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:42:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:51 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:42:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:51 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:42:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:51 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:42:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:51 smithi110 ceph-mon[28069]: pgmap v9799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:51 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:42:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:51 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:42:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:51 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:42:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:51 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:42:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:51 smithi193 ceph-mon[32782]: pgmap v9799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:42:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17687.150330 secs 2024-04-26T16:42:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17687.150330 secs 2024-04-26T16:42:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17687.150330 secs 2024-04-26T16:42:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:42:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:42:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:42:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:42:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: pgmap v9800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:42:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: pgmap v9801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:42:54.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: pgmap v9800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: pgmap v9801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:42:54.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: pgmap v9800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: pgmap v9801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:42:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:42:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:55 smithi196 ceph-mon[32572]: pgmap v9802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:42:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:55 smithi110 ceph-mon[28069]: pgmap v9802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:42:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:55 smithi193 ceph-mon[32782]: pgmap v9802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:42:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17692.150452 secs 2024-04-26T16:42:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17692.150452 secs 2024-04-26T16:42:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17692.150452 secs 2024-04-26T16:42:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:57 smithi196 ceph-mon[32572]: pgmap v9803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:42:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:57 smithi110 ceph-mon[28069]: pgmap v9803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:42:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:57 smithi193 ceph-mon[32782]: pgmap v9803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:43:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:42:59 smithi196 ceph-mon[32572]: pgmap v9804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:43:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:42:59 smithi110 ceph-mon[28069]: pgmap v9804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:43:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:42:59 smithi193 ceph-mon[32782]: pgmap v9804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:43:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:01 smithi196 ceph-mon[32572]: pgmap v9805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:43:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17697.150586 secs 2024-04-26T16:43:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:01 smithi110 ceph-mon[28069]: pgmap v9805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:43:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17697.150586 secs 2024-04-26T16:43:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:01 smithi193 ceph-mon[32782]: pgmap v9805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:43:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17697.150586 secs 2024-04-26T16:43:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:03 smithi196 ceph-mon[32572]: pgmap v9806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:43:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:03 smithi110 ceph-mon[28069]: pgmap v9806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:43:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:03 smithi193 ceph-mon[32782]: pgmap v9806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:43:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:05 smithi196 ceph-mon[32572]: pgmap v9807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:05 smithi110 ceph-mon[28069]: pgmap v9807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:05 smithi193 ceph-mon[32782]: pgmap v9807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:07.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:06 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17702.150704 secs 2024-04-26T16:43:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:06 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17702.150704 secs 2024-04-26T16:43:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:06 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17702.150704 secs 2024-04-26T16:43:08.223 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:07 smithi110 ceph-mon[28069]: pgmap v9808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:07 smithi196 ceph-mon[32572]: pgmap v9808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:07 smithi193 ceph-mon[32782]: pgmap v9808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:09 smithi196 ceph-mon[32572]: pgmap v9809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:09 smithi110 ceph-mon[28069]: pgmap v9809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:09 smithi193 ceph-mon[32782]: pgmap v9809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:12.187 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:11 smithi193 ceph-mon[32782]: pgmap v9810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:12.187 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:11 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17707.150772 secs 2024-04-26T16:43:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:11 smithi196 ceph-mon[32572]: pgmap v9810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:11 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17707.150772 secs 2024-04-26T16:43:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:11 smithi110 ceph-mon[28069]: pgmap v9810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:11 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17707.150772 secs 2024-04-26T16:43:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:13 smithi196 ceph-mon[32572]: pgmap v9811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:13 smithi110 ceph-mon[28069]: pgmap v9811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:13 smithi193 ceph-mon[32782]: pgmap v9811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:15 smithi196 ceph-mon[32572]: pgmap v9812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:15 smithi110 ceph-mon[28069]: pgmap v9812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:15 smithi193 ceph-mon[32782]: pgmap v9812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:16 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17712.150882 secs 2024-04-26T16:43:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:16 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17712.150882 secs 2024-04-26T16:43:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:16 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17712.150882 secs 2024-04-26T16:43:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:17 smithi196 ceph-mon[32572]: pgmap v9813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:17 smithi110 ceph-mon[28069]: pgmap v9813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:17 smithi193 ceph-mon[32782]: pgmap v9813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:19 smithi196 ceph-mon[32572]: pgmap v9814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:19 smithi110 ceph-mon[28069]: pgmap v9814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:19 smithi193 ceph-mon[32782]: pgmap v9814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:21 smithi196 ceph-mon[32572]: pgmap v9815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:21 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17717.151024 secs 2024-04-26T16:43:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:21 smithi110 ceph-mon[28069]: pgmap v9815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:21 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17717.151024 secs 2024-04-26T16:43:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:21 smithi193 ceph-mon[32782]: pgmap v9815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:21 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17717.151024 secs 2024-04-26T16:43:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:23 smithi196 ceph-mon[32572]: pgmap v9816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:23 smithi110 ceph-mon[28069]: pgmap v9816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:23 smithi193 ceph-mon[32782]: pgmap v9816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:25 smithi196 ceph-mon[32572]: pgmap v9817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:43:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:25 smithi110 ceph-mon[28069]: pgmap v9817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:43:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:25 smithi193 ceph-mon[32782]: pgmap v9817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:43:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:26 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17722.151140 secs 2024-04-26T16:43:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:26 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17722.151140 secs 2024-04-26T16:43:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:26 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17722.151140 secs 2024-04-26T16:43:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:27 smithi196 ceph-mon[32572]: pgmap v9818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:43:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:27 smithi110 ceph-mon[28069]: pgmap v9818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:43:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:27 smithi193 ceph-mon[32782]: pgmap v9818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:43:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:29 smithi196 ceph-mon[32572]: pgmap v9819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:29 smithi110 ceph-mon[28069]: pgmap v9819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:29 smithi193 ceph-mon[32782]: pgmap v9819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:31 smithi196 ceph-mon[32572]: pgmap v9820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:43:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:31 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17727.151289 secs 2024-04-26T16:43:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:31 smithi110 ceph-mon[28069]: pgmap v9820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:43:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:31 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17727.151289 secs 2024-04-26T16:43:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:31 smithi193 ceph-mon[32782]: pgmap v9820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:43:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:31 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17727.151289 secs 2024-04-26T16:43:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:34 smithi196 ceph-mon[32572]: pgmap v9821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:34 smithi110 ceph-mon[28069]: pgmap v9821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:34 smithi193 ceph-mon[32782]: pgmap v9821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:36 smithi110 ceph-mon[28069]: pgmap v9822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:36 smithi193 ceph-mon[32782]: pgmap v9822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:36 smithi196 ceph-mon[32572]: pgmap v9822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17732.151405 secs 2024-04-26T16:43:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17732.151405 secs 2024-04-26T16:43:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17732.151405 secs 2024-04-26T16:43:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:38 smithi110 ceph-mon[28069]: pgmap v9823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:38 smithi193 ceph-mon[32782]: pgmap v9823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:38 smithi196 ceph-mon[32572]: pgmap v9823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:40 smithi110 ceph-mon[28069]: pgmap v9824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:40 smithi193 ceph-mon[32782]: pgmap v9824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:40 smithi196 ceph-mon[32572]: pgmap v9824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:42 smithi110 ceph-mon[28069]: pgmap v9825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17737.151522 secs 2024-04-26T16:43:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:42 smithi193 ceph-mon[32782]: pgmap v9825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17737.151522 secs 2024-04-26T16:43:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:42 smithi196 ceph-mon[32572]: pgmap v9825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17737.151522 secs 2024-04-26T16:43:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:44 smithi110 ceph-mon[28069]: pgmap v9826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:44.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:44 smithi193 ceph-mon[32782]: pgmap v9826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:44 smithi196 ceph-mon[32572]: pgmap v9826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:46 smithi110 ceph-mon[28069]: pgmap v9827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:46 smithi193 ceph-mon[32782]: pgmap v9827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:46 smithi196 ceph-mon[32572]: pgmap v9827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17742.151650 secs 2024-04-26T16:43:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17742.151650 secs 2024-04-26T16:43:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17742.151650 secs 2024-04-26T16:43:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:48 smithi193 ceph-mon[32782]: pgmap v9828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:48 smithi196 ceph-mon[32572]: pgmap v9828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:48 smithi110 ceph-mon[28069]: pgmap v9828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:50 smithi193 ceph-mon[32782]: pgmap v9829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:50 smithi196 ceph-mon[32572]: pgmap v9829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:50 smithi110 ceph-mon[28069]: pgmap v9829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:52 smithi193 ceph-mon[32782]: pgmap v9830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17747.151770 secs 2024-04-26T16:43:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:52 smithi196 ceph-mon[32572]: pgmap v9830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17747.151770 secs 2024-04-26T16:43:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:52 smithi110 ceph-mon[28069]: pgmap v9830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:43:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17747.151770 secs 2024-04-26T16:43:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:54 smithi193 ceph-mon[32782]: pgmap v9831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:43:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:54 smithi196 ceph-mon[32572]: pgmap v9831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:43:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:54 smithi110 ceph-mon[28069]: pgmap v9831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:43:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:43:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:43:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:43:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:43:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:43:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:43:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:43:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:43:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:43:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:43:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:56 smithi193 ceph-mon[32782]: pgmap v9832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T16:43:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:56 smithi193 ceph-mon[32782]: pgmap v9833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:43:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:56 smithi196 ceph-mon[32572]: pgmap v9832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T16:43:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:56 smithi196 ceph-mon[32572]: pgmap v9833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:43:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:56 smithi110 ceph-mon[28069]: pgmap v9832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T16:43:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:56 smithi110 ceph-mon[28069]: pgmap v9833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:43:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17752.151865 secs 2024-04-26T16:43:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17752.151865 secs 2024-04-26T16:43:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17752.151865 secs 2024-04-26T16:43:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:43:58 smithi193 ceph-mon[32782]: pgmap v9834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:43:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:43:58 smithi196 ceph-mon[32572]: pgmap v9834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:43:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:43:58 smithi110 ceph-mon[28069]: pgmap v9834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:00 smithi193 ceph-mon[32782]: pgmap v9835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:00 smithi196 ceph-mon[32572]: pgmap v9835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:00 smithi110 ceph-mon[28069]: pgmap v9835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:02 smithi193 ceph-mon[32782]: pgmap v9836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17757.151992 secs 2024-04-26T16:44:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:02 smithi196 ceph-mon[32572]: pgmap v9836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17757.151992 secs 2024-04-26T16:44:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:02 smithi110 ceph-mon[28069]: pgmap v9836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17757.151992 secs 2024-04-26T16:44:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:04 smithi193 ceph-mon[32782]: pgmap v9837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:04 smithi196 ceph-mon[32572]: pgmap v9837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:04 smithi110 ceph-mon[28069]: pgmap v9837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:44:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:06 smithi193 ceph-mon[32782]: pgmap v9838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:44:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:06 smithi196 ceph-mon[32572]: pgmap v9838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:44:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:06 smithi110 ceph-mon[28069]: pgmap v9838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:44:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17762.152116 secs 2024-04-26T16:44:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17762.152116 secs 2024-04-26T16:44:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17762.152116 secs 2024-04-26T16:44:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:08 smithi196 ceph-mon[32572]: pgmap v9839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:08 smithi110 ceph-mon[28069]: pgmap v9839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:08 smithi193 ceph-mon[32782]: pgmap v9839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:09.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:44:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:44:08.976+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:44:09.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:44:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:44:08.976+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:44:09.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:44:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:44:08.976+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:44:09.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:44:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:44:08.976+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:44:09.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:44:08 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:44:08.976+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:44:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:10 smithi196 ceph-mon[32572]: pgmap v9840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:10 smithi110 ceph-mon[28069]: pgmap v9840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:10 smithi193 ceph-mon[32782]: pgmap v9840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:12.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:12 smithi193 ceph-mon[32782]: pgmap v9841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:12.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17767.152263 secs 2024-04-26T16:44:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:12 smithi196 ceph-mon[32572]: pgmap v9841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17767.152263 secs 2024-04-26T16:44:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:12 smithi110 ceph-mon[28069]: pgmap v9841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17767.152263 secs 2024-04-26T16:44:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:14 smithi196 ceph-mon[32572]: pgmap v9842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:44:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:14 smithi110 ceph-mon[28069]: pgmap v9842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:44:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:14 smithi193 ceph-mon[32782]: pgmap v9842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:44:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:16 smithi196 ceph-mon[32572]: pgmap v9843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T16:44:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:16 smithi110 ceph-mon[28069]: pgmap v9843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T16:44:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:16 smithi193 ceph-mon[32782]: pgmap v9843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T16:44:17.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17772.152383 secs 2024-04-26T16:44:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17772.152383 secs 2024-04-26T16:44:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17772.152383 secs 2024-04-26T16:44:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:18 smithi196 ceph-mon[32572]: pgmap v9844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T16:44:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:18 smithi110 ceph-mon[28069]: pgmap v9844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T16:44:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:18 smithi193 ceph-mon[32782]: pgmap v9844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T16:44:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:20 smithi196 ceph-mon[32572]: pgmap v9845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:44:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:20 smithi110 ceph-mon[28069]: pgmap v9845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:44:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:20 smithi193 ceph-mon[32782]: pgmap v9845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:44:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:22 smithi196 ceph-mon[32572]: pgmap v9846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T16:44:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17777.152503 secs 2024-04-26T16:44:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:22 smithi110 ceph-mon[28069]: pgmap v9846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T16:44:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17777.152503 secs 2024-04-26T16:44:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:22 smithi193 ceph-mon[32782]: pgmap v9846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T16:44:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17777.152503 secs 2024-04-26T16:44:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:24 smithi196 ceph-mon[32572]: pgmap v9847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:44:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:24 smithi110 ceph-mon[28069]: pgmap v9847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:44:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:24 smithi193 ceph-mon[32782]: pgmap v9847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:44:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:26 smithi196 ceph-mon[32572]: pgmap v9848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:26 smithi110 ceph-mon[28069]: pgmap v9848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:26 smithi193 ceph-mon[32782]: pgmap v9848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17782.152622 secs 2024-04-26T16:44:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17782.152622 secs 2024-04-26T16:44:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17782.152622 secs 2024-04-26T16:44:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:28 smithi196 ceph-mon[32572]: pgmap v9849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:28 smithi110 ceph-mon[28069]: pgmap v9849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:28 smithi193 ceph-mon[32782]: pgmap v9849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:30 smithi196 ceph-mon[32572]: pgmap v9850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:30 smithi110 ceph-mon[28069]: pgmap v9850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:30 smithi193 ceph-mon[32782]: pgmap v9850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:32 smithi196 ceph-mon[32572]: pgmap v9851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17787.152743 secs 2024-04-26T16:44:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:32 smithi110 ceph-mon[28069]: pgmap v9851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17787.152743 secs 2024-04-26T16:44:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:32 smithi193 ceph-mon[32782]: pgmap v9851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17787.152743 secs 2024-04-26T16:44:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:34 smithi196 ceph-mon[32572]: pgmap v9852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:34 smithi110 ceph-mon[28069]: pgmap v9852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:34 smithi193 ceph-mon[32782]: pgmap v9852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:36 smithi196 ceph-mon[32572]: pgmap v9853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:36 smithi110 ceph-mon[28069]: pgmap v9853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:36 smithi193 ceph-mon[32782]: pgmap v9853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17792.152865 secs 2024-04-26T16:44:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17792.152865 secs 2024-04-26T16:44:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17792.152865 secs 2024-04-26T16:44:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:38 smithi196 ceph-mon[32572]: pgmap v9854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:38 smithi110 ceph-mon[28069]: pgmap v9854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:38 smithi193 ceph-mon[32782]: pgmap v9854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:40 smithi196 ceph-mon[32572]: pgmap v9855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:40 smithi110 ceph-mon[28069]: pgmap v9855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:40 smithi193 ceph-mon[32782]: pgmap v9855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:42 smithi196 ceph-mon[32572]: pgmap v9856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17797.152990 secs 2024-04-26T16:44:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:42 smithi110 ceph-mon[28069]: pgmap v9856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17797.152990 secs 2024-04-26T16:44:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:42 smithi193 ceph-mon[32782]: pgmap v9856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17797.152990 secs 2024-04-26T16:44:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:44 smithi196 ceph-mon[32572]: pgmap v9857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:44 smithi110 ceph-mon[28069]: pgmap v9857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:44 smithi193 ceph-mon[32782]: pgmap v9857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:46 smithi196 ceph-mon[32572]: pgmap v9858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:46 smithi110 ceph-mon[28069]: pgmap v9858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:46 smithi193 ceph-mon[32782]: pgmap v9858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17802.153107 secs 2024-04-26T16:44:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17802.153107 secs 2024-04-26T16:44:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17802.153107 secs 2024-04-26T16:44:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:48 smithi110 ceph-mon[28069]: pgmap v9859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:48 smithi193 ceph-mon[32782]: pgmap v9859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:48 smithi196 ceph-mon[32572]: pgmap v9859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:50 smithi110 ceph-mon[28069]: pgmap v9860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:50 smithi193 ceph-mon[32782]: pgmap v9860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:50 smithi196 ceph-mon[32572]: pgmap v9860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:52 smithi110 ceph-mon[28069]: pgmap v9861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17807.153231 secs 2024-04-26T16:44:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:52 smithi193 ceph-mon[32782]: pgmap v9861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17807.153231 secs 2024-04-26T16:44:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:52 smithi196 ceph-mon[32572]: pgmap v9861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17807.153231 secs 2024-04-26T16:44:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:54 smithi110 ceph-mon[28069]: pgmap v9862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:54 smithi193 ceph-mon[32782]: pgmap v9862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:54 smithi196 ceph-mon[32572]: pgmap v9862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:44:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:44:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:44:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:56 smithi193 ceph-mon[32782]: pgmap v9863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:44:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:44:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:56 smithi196 ceph-mon[32572]: pgmap v9863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:44:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:56 smithi110 ceph-mon[28069]: pgmap v9863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:44:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:44:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:44:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:44:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:57 smithi193 ceph-mon[32782]: pgmap v9864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T16:44:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:57 smithi193 ceph-mon[32782]: pgmap v9865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:44:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17812.153370 secs 2024-04-26T16:44:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:57 smithi196 ceph-mon[32572]: pgmap v9864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T16:44:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:57 smithi196 ceph-mon[32572]: pgmap v9865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:44:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17812.153370 secs 2024-04-26T16:44:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:57 smithi110 ceph-mon[28069]: pgmap v9864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T16:44:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:57 smithi110 ceph-mon[28069]: pgmap v9865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:44:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17812.153370 secs 2024-04-26T16:44:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:44:59 smithi193 ceph-mon[32782]: pgmap v9866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:44:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:44:59 smithi196 ceph-mon[32572]: pgmap v9866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:44:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:44:59 smithi110 ceph-mon[28069]: pgmap v9866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:45:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:01 smithi193 ceph-mon[32782]: pgmap v9867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:45:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:01 smithi196 ceph-mon[32572]: pgmap v9867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:45:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:01 smithi110 ceph-mon[28069]: pgmap v9867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:45:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17817.153498 secs 2024-04-26T16:45:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17817.153498 secs 2024-04-26T16:45:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17817.153498 secs 2024-04-26T16:45:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:03 smithi193 ceph-mon[32782]: pgmap v9868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T16:45:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:03 smithi196 ceph-mon[32572]: pgmap v9868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T16:45:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:03 smithi110 ceph-mon[28069]: pgmap v9868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T16:45:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:04 smithi193 ceph-mon[32782]: pgmap v9869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:04 smithi196 ceph-mon[32572]: pgmap v9869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:04 smithi110 ceph-mon[28069]: pgmap v9869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:07 smithi193 ceph-mon[32782]: pgmap v9870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17822.153612 secs 2024-04-26T16:45:07.494 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:07 smithi110 ceph-mon[28069]: pgmap v9870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:07.495 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17822.153612 secs 2024-04-26T16:45:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:07 smithi196 ceph-mon[32572]: pgmap v9870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17822.153612 secs 2024-04-26T16:45:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:09 smithi193 ceph-mon[32782]: pgmap v9871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:09 smithi196 ceph-mon[32572]: pgmap v9871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:09 smithi110 ceph-mon[28069]: pgmap v9871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:11.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:11 smithi193 ceph-mon[32782]: pgmap v9872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:45:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:11 smithi196 ceph-mon[32572]: pgmap v9872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:45:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:11 smithi110 ceph-mon[28069]: pgmap v9872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:45:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17827.153685 secs 2024-04-26T16:45:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17827.153685 secs 2024-04-26T16:45:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17827.153685 secs 2024-04-26T16:45:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:13 smithi193 ceph-mon[32782]: pgmap v9873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:45:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:13 smithi196 ceph-mon[32572]: pgmap v9873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:45:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:13 smithi110 ceph-mon[28069]: pgmap v9873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:45:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:15 smithi193 ceph-mon[32782]: pgmap v9874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:15 smithi196 ceph-mon[32572]: pgmap v9874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:15 smithi110 ceph-mon[28069]: pgmap v9874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:45:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:17 smithi193 ceph-mon[32782]: pgmap v9875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17832.153803 secs 2024-04-26T16:45:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:17 smithi196 ceph-mon[32572]: pgmap v9875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17832.153803 secs 2024-04-26T16:45:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:17 smithi110 ceph-mon[28069]: pgmap v9875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17832.153803 secs 2024-04-26T16:45:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:45:19.311+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006550 con 0x55db1be4fdd0 2024-04-26T16:45:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:45:19.311+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T16:45:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:45:19.312+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 139 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T16:45:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:45:19.312+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T16:45:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:45:19.312+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 139 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T16:45:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:45:19.312+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:45:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:45:19.312+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 140 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:45:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:45:19.313+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 140 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006550 con 0x7f261c104b50 2024-04-26T16:45:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:19 smithi193 ceph-mon[32782]: pgmap v9876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:19 smithi196 ceph-mon[32572]: pgmap v9876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:19 smithi110 ceph-mon[28069]: pgmap v9876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:21 smithi193 ceph-mon[32782]: pgmap v9877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:21 smithi196 ceph-mon[32572]: pgmap v9877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:21 smithi110 ceph-mon[28069]: pgmap v9877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17837.153871 secs 2024-04-26T16:45:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17837.153871 secs 2024-04-26T16:45:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17837.153871 secs 2024-04-26T16:45:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:23 smithi193 ceph-mon[32782]: pgmap v9878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:23 smithi196 ceph-mon[32572]: pgmap v9878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:23 smithi110 ceph-mon[28069]: pgmap v9878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:25 smithi196 ceph-mon[32572]: pgmap v9879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:25 smithi110 ceph-mon[28069]: pgmap v9879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:25 smithi193 ceph-mon[32782]: pgmap v9879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:27 smithi196 ceph-mon[32572]: pgmap v9880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17842.154005 secs 2024-04-26T16:45:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:27 smithi110 ceph-mon[28069]: pgmap v9880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17842.154005 secs 2024-04-26T16:45:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:27 smithi193 ceph-mon[32782]: pgmap v9880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17842.154005 secs 2024-04-26T16:45:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:29 smithi196 ceph-mon[32572]: pgmap v9881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:29 smithi110 ceph-mon[28069]: pgmap v9881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:29 smithi193 ceph-mon[32782]: pgmap v9881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:31 smithi196 ceph-mon[32572]: pgmap v9882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:31 smithi110 ceph-mon[28069]: pgmap v9882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:31 smithi193 ceph-mon[32782]: pgmap v9882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17847.154145 secs 2024-04-26T16:45:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17847.154145 secs 2024-04-26T16:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17847.154145 secs 2024-04-26T16:45:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:33 smithi196 ceph-mon[32572]: pgmap v9883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:33 smithi110 ceph-mon[28069]: pgmap v9883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:33 smithi193 ceph-mon[32782]: pgmap v9883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:35 smithi196 ceph-mon[32572]: pgmap v9884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:35 smithi110 ceph-mon[28069]: pgmap v9884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:35 smithi193 ceph-mon[32782]: pgmap v9884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:37 smithi196 ceph-mon[32572]: pgmap v9885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17852.154277 secs 2024-04-26T16:45:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:37 smithi110 ceph-mon[28069]: pgmap v9885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17852.154277 secs 2024-04-26T16:45:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:37 smithi193 ceph-mon[32782]: pgmap v9885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17852.154277 secs 2024-04-26T16:45:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:39 smithi196 ceph-mon[32572]: pgmap v9886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:39 smithi110 ceph-mon[28069]: pgmap v9886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:39 smithi193 ceph-mon[32782]: pgmap v9886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:41 smithi196 ceph-mon[32572]: pgmap v9887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:41 smithi110 ceph-mon[28069]: pgmap v9887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:41 smithi193 ceph-mon[32782]: pgmap v9887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17857.154396 secs 2024-04-26T16:45:42.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17857.154396 secs 2024-04-26T16:45:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17857.154396 secs 2024-04-26T16:45:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:43 smithi196 ceph-mon[32572]: pgmap v9888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:43 smithi110 ceph-mon[28069]: pgmap v9888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:43 smithi193 ceph-mon[32782]: pgmap v9888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:45 smithi196 ceph-mon[32572]: pgmap v9889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:45 smithi110 ceph-mon[28069]: pgmap v9889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:45 smithi193 ceph-mon[32782]: pgmap v9889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:47 smithi196 ceph-mon[32572]: pgmap v9890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17862.154510 secs 2024-04-26T16:45:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:47 smithi110 ceph-mon[28069]: pgmap v9890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17862.154510 secs 2024-04-26T16:45:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:47 smithi193 ceph-mon[32782]: pgmap v9890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17862.154510 secs 2024-04-26T16:45:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:49 smithi196 ceph-mon[32572]: pgmap v9891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:49 smithi110 ceph-mon[28069]: pgmap v9891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:49 smithi193 ceph-mon[32782]: pgmap v9891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:51 smithi196 ceph-mon[32572]: pgmap v9892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:51 smithi110 ceph-mon[28069]: pgmap v9892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:51 smithi193 ceph-mon[32782]: pgmap v9892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17867.154647 secs 2024-04-26T16:45:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17867.154647 secs 2024-04-26T16:45:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17867.154647 secs 2024-04-26T16:45:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:53 smithi196 ceph-mon[32572]: pgmap v9893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:53 smithi110 ceph-mon[28069]: pgmap v9893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:53 smithi193 ceph-mon[32782]: pgmap v9893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:55 smithi196 ceph-mon[32572]: pgmap v9894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:55 smithi110 ceph-mon[28069]: pgmap v9894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:55 smithi193 ceph-mon[32782]: pgmap v9894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:45:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:57 smithi196 ceph-mon[32572]: pgmap v9895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:45:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17872.154741 secs 2024-04-26T16:45:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:57 smithi110 ceph-mon[28069]: pgmap v9895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:45:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17872.154741 secs 2024-04-26T16:45:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:57 smithi193 ceph-mon[32782]: pgmap v9895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:45:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:45:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17872.154741 secs 2024-04-26T16:45:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:45:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:45:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:45:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:45:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:45:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:45:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:45:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:45:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:45:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:59 smithi196 ceph-mon[32572]: pgmap v9896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:45:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:45:59 smithi196 ceph-mon[32572]: pgmap v9897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:45:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:59 smithi110 ceph-mon[28069]: pgmap v9896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:45:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:45:59 smithi110 ceph-mon[28069]: pgmap v9897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:45:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:59 smithi193 ceph-mon[32782]: pgmap v9896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:45:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:45:59 smithi193 ceph-mon[32782]: pgmap v9897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:01 smithi196 ceph-mon[32572]: pgmap v9898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:01 smithi110 ceph-mon[28069]: pgmap v9898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:01 smithi193 ceph-mon[32782]: pgmap v9898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17877.154835 secs 2024-04-26T16:46:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17877.154835 secs 2024-04-26T16:46:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17877.154835 secs 2024-04-26T16:46:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:03 smithi110 ceph-mon[28069]: pgmap v9899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:03 smithi193 ceph-mon[32782]: pgmap v9899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:03 smithi196 ceph-mon[32572]: pgmap v9899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:05 smithi110 ceph-mon[28069]: pgmap v9900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:05 smithi193 ceph-mon[32782]: pgmap v9900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:05 smithi196 ceph-mon[32572]: pgmap v9900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:06 smithi193 ceph-mon[32782]: pgmap v9901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:06 smithi196 ceph-mon[32572]: pgmap v9901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:06 smithi110 ceph-mon[28069]: pgmap v9901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:46:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17882.154950 secs 2024-04-26T16:46:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17882.154950 secs 2024-04-26T16:46:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17882.154950 secs 2024-04-26T16:46:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:08 smithi193 ceph-mon[32782]: pgmap v9902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:46:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:08 smithi196 ceph-mon[32572]: pgmap v9902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:46:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:08 smithi110 ceph-mon[28069]: pgmap v9902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:46:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:10 smithi196 ceph-mon[32572]: pgmap v9903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:10 smithi110 ceph-mon[28069]: pgmap v9903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:10 smithi193 ceph-mon[32782]: pgmap v9903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:12.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17887.155067 secs 2024-04-26T16:46:12.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:12 smithi193 ceph-mon[32782]: pgmap v9904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17887.155067 secs 2024-04-26T16:46:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:12 smithi196 ceph-mon[32572]: pgmap v9904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17887.155067 secs 2024-04-26T16:46:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:12 smithi110 ceph-mon[28069]: pgmap v9904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:14 smithi196 ceph-mon[32572]: pgmap v9905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:14 smithi110 ceph-mon[28069]: pgmap v9905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:14 smithi193 ceph-mon[32782]: pgmap v9905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:16 smithi196 ceph-mon[32572]: pgmap v9906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:16 smithi110 ceph-mon[28069]: pgmap v9906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:16 smithi193 ceph-mon[32782]: pgmap v9906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:17.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17892.155136 secs 2024-04-26T16:46:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17892.155136 secs 2024-04-26T16:46:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17892.155136 secs 2024-04-26T16:46:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:18 smithi196 ceph-mon[32572]: pgmap v9907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:18 smithi110 ceph-mon[28069]: pgmap v9907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:18 smithi193 ceph-mon[32782]: pgmap v9907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:20 smithi196 ceph-mon[32572]: pgmap v9908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:20 smithi110 ceph-mon[28069]: pgmap v9908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:20 smithi193 ceph-mon[32782]: pgmap v9908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17897.155255 secs 2024-04-26T16:46:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:22 smithi196 ceph-mon[32572]: pgmap v9909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17897.155255 secs 2024-04-26T16:46:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:22 smithi110 ceph-mon[28069]: pgmap v9909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17897.155255 secs 2024-04-26T16:46:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:22 smithi193 ceph-mon[32782]: pgmap v9909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:24 smithi196 ceph-mon[32572]: pgmap v9910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:24 smithi110 ceph-mon[28069]: pgmap v9910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:24 smithi193 ceph-mon[32782]: pgmap v9910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:26 smithi196 ceph-mon[32572]: pgmap v9911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:26 smithi110 ceph-mon[28069]: pgmap v9911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:26 smithi193 ceph-mon[32782]: pgmap v9911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17902.155387 secs 2024-04-26T16:46:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17902.155387 secs 2024-04-26T16:46:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17902.155387 secs 2024-04-26T16:46:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:28 smithi196 ceph-mon[32572]: pgmap v9912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:28 smithi110 ceph-mon[28069]: pgmap v9912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:28 smithi193 ceph-mon[32782]: pgmap v9912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:30 smithi196 ceph-mon[32572]: pgmap v9913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:30 smithi110 ceph-mon[28069]: pgmap v9913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:30 smithi193 ceph-mon[32782]: pgmap v9913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17907.155520 secs 2024-04-26T16:46:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:32 smithi196 ceph-mon[32572]: pgmap v9914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17907.155520 secs 2024-04-26T16:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:32 smithi110 ceph-mon[28069]: pgmap v9914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17907.155520 secs 2024-04-26T16:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:32 smithi193 ceph-mon[32782]: pgmap v9914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:34 smithi196 ceph-mon[32572]: pgmap v9915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:34 smithi110 ceph-mon[28069]: pgmap v9915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:34 smithi193 ceph-mon[32782]: pgmap v9915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:36 smithi196 ceph-mon[32572]: pgmap v9916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:36 smithi110 ceph-mon[28069]: pgmap v9916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:36 smithi193 ceph-mon[32782]: pgmap v9916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17912.155658 secs 2024-04-26T16:46:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17912.155658 secs 2024-04-26T16:46:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17912.155658 secs 2024-04-26T16:46:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:38 smithi196 ceph-mon[32572]: pgmap v9917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:38 smithi110 ceph-mon[28069]: pgmap v9917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:38 smithi193 ceph-mon[32782]: pgmap v9917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:40 smithi196 ceph-mon[32572]: pgmap v9918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:40 smithi110 ceph-mon[28069]: pgmap v9918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:40 smithi193 ceph-mon[32782]: pgmap v9918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17917.155723 secs 2024-04-26T16:46:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:42 smithi196 ceph-mon[32572]: pgmap v9919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17917.155723 secs 2024-04-26T16:46:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:42 smithi110 ceph-mon[28069]: pgmap v9919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17917.155723 secs 2024-04-26T16:46:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:42 smithi193 ceph-mon[32782]: pgmap v9919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:44 smithi196 ceph-mon[32572]: pgmap v9920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:44 smithi110 ceph-mon[28069]: pgmap v9920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:44 smithi193 ceph-mon[32782]: pgmap v9920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:46 smithi196 ceph-mon[32572]: pgmap v9921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:46 smithi110 ceph-mon[28069]: pgmap v9921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:46 smithi193 ceph-mon[32782]: pgmap v9921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17922.155783 secs 2024-04-26T16:46:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17922.155783 secs 2024-04-26T16:46:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17922.155783 secs 2024-04-26T16:46:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:48 smithi110 ceph-mon[28069]: pgmap v9922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:48 smithi193 ceph-mon[32782]: pgmap v9922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:48 smithi196 ceph-mon[32572]: pgmap v9922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:50 smithi110 ceph-mon[28069]: pgmap v9923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:50 smithi193 ceph-mon[32782]: pgmap v9923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:50 smithi196 ceph-mon[32572]: pgmap v9923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17927.155903 secs 2024-04-26T16:46:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:52 smithi110 ceph-mon[28069]: pgmap v9924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17927.155903 secs 2024-04-26T16:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:52 smithi193 ceph-mon[32782]: pgmap v9924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17927.155903 secs 2024-04-26T16:46:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:52 smithi196 ceph-mon[32572]: pgmap v9924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:54 smithi110 ceph-mon[28069]: pgmap v9925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:54 smithi193 ceph-mon[32782]: pgmap v9925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:54 smithi196 ceph-mon[32572]: pgmap v9925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:56 smithi110 ceph-mon[28069]: pgmap v9926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:56 smithi193 ceph-mon[32782]: pgmap v9926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:56 smithi196 ceph-mon[32572]: pgmap v9926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:46:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17932.156021 secs 2024-04-26T16:46:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17932.156021 secs 2024-04-26T16:46:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17932.156021 secs 2024-04-26T16:46:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:58 smithi193 ceph-mon[32782]: pgmap v9927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:46:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:58 smithi196 ceph-mon[32572]: pgmap v9927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:46:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:58 smithi110 ceph-mon[28069]: pgmap v9927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:46:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:47:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:47:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:47:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:59 smithi193 ceph-mon[32782]: pgmap v9928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T16:47:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:59 smithi193 ceph-mon[32782]: pgmap v9929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:46:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:47:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:47:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:47:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:59 smithi196 ceph-mon[32572]: pgmap v9928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T16:47:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:59 smithi196 ceph-mon[32572]: pgmap v9929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:46:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:47:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:47:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:47:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:59 smithi110 ceph-mon[28069]: pgmap v9928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T16:47:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:59 smithi110 ceph-mon[28069]: pgmap v9929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:46:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:47:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:02 smithi196 ceph-mon[32572]: pgmap v9930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:02.601 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17937.156141 secs 2024-04-26T16:47:02.602 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:02 smithi110 ceph-mon[28069]: pgmap v9930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:02.602 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17937.156141 secs 2024-04-26T16:47:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:02 smithi193 ceph-mon[32782]: pgmap v9930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17937.156141 secs 2024-04-26T16:47:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:04 smithi196 ceph-mon[32572]: pgmap v9931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:04 smithi110 ceph-mon[28069]: pgmap v9931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:04 smithi193 ceph-mon[32782]: pgmap v9931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:06 smithi196 ceph-mon[32572]: pgmap v9932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:06 smithi110 ceph-mon[28069]: pgmap v9932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:06 smithi193 ceph-mon[32782]: pgmap v9932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:47:07.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17942.156256 secs 2024-04-26T16:47:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17942.156256 secs 2024-04-26T16:47:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17942.156256 secs 2024-04-26T16:47:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:08 smithi196 ceph-mon[32572]: pgmap v9933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:47:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:08 smithi110 ceph-mon[28069]: pgmap v9933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:47:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:08 smithi193 ceph-mon[32782]: pgmap v9933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T16:47:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:10 smithi196 ceph-mon[32572]: pgmap v9934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:47:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:10 smithi110 ceph-mon[28069]: pgmap v9934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:47:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:10 smithi193 ceph-mon[32782]: pgmap v9934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:47:12.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:12 smithi193 ceph-mon[32782]: pgmap v9935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:12.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17947.156376 secs 2024-04-26T16:47:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:12 smithi196 ceph-mon[32572]: pgmap v9935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17947.156376 secs 2024-04-26T16:47:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:12 smithi110 ceph-mon[28069]: pgmap v9935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17947.156376 secs 2024-04-26T16:47:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:14 smithi196 ceph-mon[32572]: pgmap v9936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:14 smithi110 ceph-mon[28069]: pgmap v9936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:14 smithi193 ceph-mon[32782]: pgmap v9936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:16 smithi196 ceph-mon[32572]: pgmap v9937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:16 smithi110 ceph-mon[28069]: pgmap v9937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:16 smithi193 ceph-mon[32782]: pgmap v9937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17952.156506 secs 2024-04-26T16:47:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17952.156506 secs 2024-04-26T16:47:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17952.156506 secs 2024-04-26T16:47:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:18 smithi196 ceph-mon[32572]: pgmap v9938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:18 smithi110 ceph-mon[28069]: pgmap v9938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:18 smithi193 ceph-mon[32782]: pgmap v9938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:20 smithi196 ceph-mon[32572]: pgmap v9939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:20 smithi110 ceph-mon[28069]: pgmap v9939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:20 smithi193 ceph-mon[32782]: pgmap v9939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:22 smithi196 ceph-mon[32572]: pgmap v9940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17957.156631 secs 2024-04-26T16:47:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:22 smithi110 ceph-mon[28069]: pgmap v9940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17957.156631 secs 2024-04-26T16:47:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:22 smithi193 ceph-mon[32782]: pgmap v9940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17957.156631 secs 2024-04-26T16:47:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:24 smithi196 ceph-mon[32572]: pgmap v9941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:24 smithi110 ceph-mon[28069]: pgmap v9941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:24 smithi193 ceph-mon[32782]: pgmap v9941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:26 smithi196 ceph-mon[32572]: pgmap v9942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:26 smithi110 ceph-mon[28069]: pgmap v9942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:26 smithi193 ceph-mon[32782]: pgmap v9942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17962.156746 secs 2024-04-26T16:47:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17962.156746 secs 2024-04-26T16:47:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17962.156746 secs 2024-04-26T16:47:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:28 smithi196 ceph-mon[32572]: pgmap v9943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:28 smithi110 ceph-mon[28069]: pgmap v9943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:28 smithi193 ceph-mon[32782]: pgmap v9943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:30 smithi196 ceph-mon[32572]: pgmap v9944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:30 smithi110 ceph-mon[28069]: pgmap v9944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:30 smithi193 ceph-mon[32782]: pgmap v9944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:32 smithi196 ceph-mon[32572]: pgmap v9945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17967.156866 secs 2024-04-26T16:47:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:32 smithi110 ceph-mon[28069]: pgmap v9945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17967.156866 secs 2024-04-26T16:47:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:32 smithi193 ceph-mon[32782]: pgmap v9945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17967.156866 secs 2024-04-26T16:47:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:34 smithi196 ceph-mon[32572]: pgmap v9946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:34 smithi110 ceph-mon[28069]: pgmap v9946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:34 smithi193 ceph-mon[32782]: pgmap v9946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:36 smithi196 ceph-mon[32572]: pgmap v9947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:36 smithi110 ceph-mon[28069]: pgmap v9947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:36 smithi193 ceph-mon[32782]: pgmap v9947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17972.156981 secs 2024-04-26T16:47:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17972.156981 secs 2024-04-26T16:47:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17972.156981 secs 2024-04-26T16:47:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:38 smithi110 ceph-mon[28069]: pgmap v9948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:38 smithi193 ceph-mon[32782]: pgmap v9948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:38 smithi196 ceph-mon[32572]: pgmap v9948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:40 smithi110 ceph-mon[28069]: pgmap v9949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:40 smithi193 ceph-mon[32782]: pgmap v9949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:40 smithi196 ceph-mon[32572]: pgmap v9949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:42 smithi110 ceph-mon[28069]: pgmap v9950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17977.157108 secs 2024-04-26T16:47:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:42 smithi193 ceph-mon[32782]: pgmap v9950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17977.157108 secs 2024-04-26T16:47:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:42 smithi196 ceph-mon[32572]: pgmap v9950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17977.157108 secs 2024-04-26T16:47:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:44 smithi110 ceph-mon[28069]: pgmap v9951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:44 smithi193 ceph-mon[32782]: pgmap v9951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:44 smithi196 ceph-mon[32572]: pgmap v9951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:46 smithi110 ceph-mon[28069]: pgmap v9952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:46 smithi193 ceph-mon[32782]: pgmap v9952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:46 smithi196 ceph-mon[32572]: pgmap v9952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17982.157245 secs 2024-04-26T16:47:47.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17982.157245 secs 2024-04-26T16:47:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17982.157245 secs 2024-04-26T16:47:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:48 smithi193 ceph-mon[32782]: pgmap v9953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:48 smithi196 ceph-mon[32572]: pgmap v9953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:48 smithi110 ceph-mon[28069]: pgmap v9953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:50 smithi193 ceph-mon[32782]: pgmap v9954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:50 smithi196 ceph-mon[32572]: pgmap v9954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:50 smithi110 ceph-mon[28069]: pgmap v9954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:52 smithi193 ceph-mon[32782]: pgmap v9955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17987.157366 secs 2024-04-26T16:47:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:52 smithi196 ceph-mon[32572]: pgmap v9955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17987.157366 secs 2024-04-26T16:47:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:52 smithi110 ceph-mon[28069]: pgmap v9955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17987.157366 secs 2024-04-26T16:47:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:54 smithi193 ceph-mon[32782]: pgmap v9956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:54 smithi196 ceph-mon[32572]: pgmap v9956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:54 smithi110 ceph-mon[28069]: pgmap v9956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:47:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:56 smithi193 ceph-mon[32782]: pgmap v9957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:56 smithi196 ceph-mon[32572]: pgmap v9957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:56 smithi110 ceph-mon[28069]: pgmap v9957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17992.157491 secs 2024-04-26T16:47:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17992.157491 secs 2024-04-26T16:47:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17992.157491 secs 2024-04-26T16:47:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:47:58 smithi193 ceph-mon[32782]: pgmap v9958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:47:58 smithi196 ceph-mon[32572]: pgmap v9958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:47:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:47:58 smithi110 ceph-mon[28069]: pgmap v9958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:00 smithi193 ceph-mon[32782]: pgmap v9959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:48:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:00 smithi196 ceph-mon[32572]: pgmap v9959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:48:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:00 smithi110 ceph-mon[28069]: pgmap v9959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:48:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:48:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:48:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:48:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:48:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:48:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:48:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:48:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:48:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:48:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:02 smithi193 ceph-mon[32782]: pgmap v9960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T16:48:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:02 smithi193 ceph-mon[32782]: pgmap v9961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 17997.157616 secs 2024-04-26T16:48:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:02 smithi196 ceph-mon[32572]: pgmap v9960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T16:48:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:02 smithi196 ceph-mon[32572]: pgmap v9961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 17997.157616 secs 2024-04-26T16:48:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:02 smithi110 ceph-mon[28069]: pgmap v9960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T16:48:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:02 smithi110 ceph-mon[28069]: pgmap v9961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 17997.157616 secs 2024-04-26T16:48:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:04 smithi193 ceph-mon[32782]: pgmap v9962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:04 smithi196 ceph-mon[32572]: pgmap v9962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:04 smithi110 ceph-mon[28069]: pgmap v9962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:06 smithi193 ceph-mon[32782]: pgmap v9963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:06 smithi196 ceph-mon[32572]: pgmap v9963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:06 smithi110 ceph-mon[28069]: pgmap v9963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18002.157755 secs 2024-04-26T16:48:07.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18002.157755 secs 2024-04-26T16:48:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18002.157755 secs 2024-04-26T16:48:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:08 smithi193 ceph-mon[32782]: pgmap v9964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:08 smithi196 ceph-mon[32572]: pgmap v9964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:08 smithi110 ceph-mon[28069]: pgmap v9964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:09 smithi196 ceph-mon[32572]: pgmap v9965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:09 smithi110 ceph-mon[28069]: pgmap v9965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:09 smithi193 ceph-mon[32782]: pgmap v9965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:48:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:11 smithi196 ceph-mon[32572]: pgmap v9966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:48:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:11 smithi110 ceph-mon[28069]: pgmap v9966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:48:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:11 smithi193 ceph-mon[32782]: pgmap v9966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:48:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18007.157854 secs 2024-04-26T16:48:13.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18007.157854 secs 2024-04-26T16:48:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18007.157854 secs 2024-04-26T16:48:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:13 smithi196 ceph-mon[32572]: pgmap v9967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:13 smithi110 ceph-mon[28069]: pgmap v9967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:13 smithi193 ceph-mon[32782]: pgmap v9967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:15 smithi196 ceph-mon[32572]: pgmap v9968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:15 smithi110 ceph-mon[28069]: pgmap v9968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:15 smithi193 ceph-mon[32782]: pgmap v9968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.425+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T16:48:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.425+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T16:48:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.425+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T16:48:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.425+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T16:48:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.426+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T16:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.426+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T16:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.426+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T16:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.426+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T16:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.426+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).stop 2024-04-26T16:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.426+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T16:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.426+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T16:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.426+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T16:48:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.426+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T16:48:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.427+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T16:48:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.427+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T16:48:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.427+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T16:48:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:16.428+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614014040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T16:48:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18012.157946 secs 2024-04-26T16:48:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:17 smithi196 ceph-mon[32572]: pgmap v9969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18012.157946 secs 2024-04-26T16:48:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:17 smithi110 ceph-mon[28069]: pgmap v9969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18012.157946 secs 2024-04-26T16:48:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:17 smithi193 ceph-mon[32782]: pgmap v9969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:19.340+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T16:48:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:19.340+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:48:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:19.341+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 141 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:48:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:48:19.341+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 141 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T16:48:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:19 smithi196 ceph-mon[32572]: pgmap v9970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:19 smithi110 ceph-mon[28069]: pgmap v9970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:19 smithi193 ceph-mon[32782]: pgmap v9970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:21 smithi196 ceph-mon[32572]: pgmap v9971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:21 smithi110 ceph-mon[28069]: pgmap v9971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:21 smithi193 ceph-mon[32782]: pgmap v9971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18017.158065 secs 2024-04-26T16:48:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18017.158065 secs 2024-04-26T16:48:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18017.158065 secs 2024-04-26T16:48:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:23 smithi196 ceph-mon[32572]: pgmap v9972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:23 smithi110 ceph-mon[28069]: pgmap v9972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:23 smithi193 ceph-mon[32782]: pgmap v9972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:25 smithi196 ceph-mon[32572]: pgmap v9973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:25 smithi110 ceph-mon[28069]: pgmap v9973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:25 smithi193 ceph-mon[32782]: pgmap v9973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18022.158179 secs 2024-04-26T16:48:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:27 smithi196 ceph-mon[32572]: pgmap v9974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18022.158179 secs 2024-04-26T16:48:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:27 smithi110 ceph-mon[28069]: pgmap v9974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18022.158179 secs 2024-04-26T16:48:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:27 smithi193 ceph-mon[32782]: pgmap v9974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:29 smithi196 ceph-mon[32572]: pgmap v9975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:29 smithi110 ceph-mon[28069]: pgmap v9975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:29 smithi193 ceph-mon[32782]: pgmap v9975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:31 smithi196 ceph-mon[32572]: pgmap v9976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:31 smithi110 ceph-mon[28069]: pgmap v9976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:31 smithi193 ceph-mon[32782]: pgmap v9976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18027.158296 secs 2024-04-26T16:48:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18027.158296 secs 2024-04-26T16:48:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18027.158296 secs 2024-04-26T16:48:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:33 smithi196 ceph-mon[32572]: pgmap v9977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:33 smithi110 ceph-mon[28069]: pgmap v9977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:33 smithi193 ceph-mon[32782]: pgmap v9977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:35 smithi110 ceph-mon[28069]: pgmap v9978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:35 smithi193 ceph-mon[32782]: pgmap v9978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:35 smithi196 ceph-mon[32572]: pgmap v9978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18032.158416 secs 2024-04-26T16:48:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:37 smithi110 ceph-mon[28069]: pgmap v9979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18032.158416 secs 2024-04-26T16:48:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:37 smithi193 ceph-mon[32782]: pgmap v9979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18032.158416 secs 2024-04-26T16:48:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:37 smithi196 ceph-mon[32572]: pgmap v9979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:39 smithi110 ceph-mon[28069]: pgmap v9980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:39 smithi193 ceph-mon[32782]: pgmap v9980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:39 smithi196 ceph-mon[32572]: pgmap v9980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:41 smithi110 ceph-mon[28069]: pgmap v9981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:41 smithi193 ceph-mon[32782]: pgmap v9981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:41 smithi196 ceph-mon[32572]: pgmap v9981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18037.158538 secs 2024-04-26T16:48:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18037.158538 secs 2024-04-26T16:48:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18037.158538 secs 2024-04-26T16:48:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:43 smithi110 ceph-mon[28069]: pgmap v9982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:43 smithi193 ceph-mon[32782]: pgmap v9982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:43 smithi196 ceph-mon[32572]: pgmap v9982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:45 smithi110 ceph-mon[28069]: pgmap v9983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:45 smithi193 ceph-mon[32782]: pgmap v9983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:45 smithi196 ceph-mon[32572]: pgmap v9983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:48.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18042.158643 secs 2024-04-26T16:48:48.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:47 smithi196 ceph-mon[32572]: pgmap v9984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18042.158643 secs 2024-04-26T16:48:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:47 smithi193 ceph-mon[32782]: pgmap v9984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18042.158643 secs 2024-04-26T16:48:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:47 smithi110 ceph-mon[28069]: pgmap v9984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:49 smithi193 ceph-mon[32782]: pgmap v9985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:49 smithi196 ceph-mon[32572]: pgmap v9985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:49 smithi110 ceph-mon[28069]: pgmap v9985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:51 smithi193 ceph-mon[32782]: pgmap v9986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:51 smithi196 ceph-mon[32572]: pgmap v9986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:51 smithi110 ceph-mon[28069]: pgmap v9986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18047.158762 secs 2024-04-26T16:48:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18047.158762 secs 2024-04-26T16:48:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18047.158762 secs 2024-04-26T16:48:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:53 smithi193 ceph-mon[32782]: pgmap v9987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:53 smithi196 ceph-mon[32572]: pgmap v9987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:53 smithi110 ceph-mon[28069]: pgmap v9987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:48:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:55 smithi193 ceph-mon[32782]: pgmap v9988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:55 smithi196 ceph-mon[32572]: pgmap v9988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:55 smithi110 ceph-mon[28069]: pgmap v9988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18052.158906 secs 2024-04-26T16:48:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:57 smithi193 ceph-mon[32782]: pgmap v9989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18052.158906 secs 2024-04-26T16:48:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:57 smithi196 ceph-mon[32572]: pgmap v9989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:48:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18052.158906 secs 2024-04-26T16:48:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:57 smithi110 ceph-mon[28069]: pgmap v9989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:48:59 smithi193 ceph-mon[32782]: pgmap v9990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:48:59 smithi196 ceph-mon[32572]: pgmap v9990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:48:59 smithi110 ceph-mon[28069]: pgmap v9990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:01 smithi193 ceph-mon[32782]: pgmap v9991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:49:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:01 smithi196 ceph-mon[32572]: pgmap v9991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:49:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:01 smithi110 ceph-mon[28069]: pgmap v9991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:49:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18057.159011 secs 2024-04-26T16:49:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:49:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:49:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:02 smithi193 ceph-mon[32782]: pgmap v9992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:49:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:02 smithi193 ceph-mon[32782]: pgmap v9993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:49:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:49:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18057.159011 secs 2024-04-26T16:49:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:49:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:49:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:02 smithi196 ceph-mon[32572]: pgmap v9992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:49:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:02 smithi196 ceph-mon[32572]: pgmap v9993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:49:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:49:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18057.159011 secs 2024-04-26T16:49:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:49:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:49:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:02 smithi110 ceph-mon[28069]: pgmap v9992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:49:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:02 smithi110 ceph-mon[28069]: pgmap v9993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T16:49:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:49:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:05 smithi196 ceph-mon[32572]: pgmap v9994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:05 smithi110 ceph-mon[28069]: pgmap v9994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:05 smithi193 ceph-mon[32782]: pgmap v9994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:07 smithi196 ceph-mon[32572]: pgmap v9995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18062.159119 secs 2024-04-26T16:49:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:07 smithi110 ceph-mon[28069]: pgmap v9995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18062.159119 secs 2024-04-26T16:49:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:07 smithi193 ceph-mon[32782]: pgmap v9995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18062.159119 secs 2024-04-26T16:49:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:09 smithi196 ceph-mon[32572]: pgmap v9996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:09 smithi110 ceph-mon[28069]: pgmap v9996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:09.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:49:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:49:09.040+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:49:09.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:49:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:49:09.040+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:49:09.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:49:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:49:09.040+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:49:09.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:49:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:49:09.040+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:49:09.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:49:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:49:09.040+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:49:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:09 smithi193 ceph-mon[32782]: pgmap v9996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:11 smithi196 ceph-mon[32572]: pgmap v9997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:11 smithi110 ceph-mon[28069]: pgmap v9997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:11 smithi193 ceph-mon[32782]: pgmap v9997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:49:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18067.159256 secs 2024-04-26T16:49:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18067.159256 secs 2024-04-26T16:49:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18067.159256 secs 2024-04-26T16:49:13.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:13 smithi193 ceph-mon[32782]: pgmap v9998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:49:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:13 smithi110 ceph-mon[28069]: pgmap v9998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:49:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:13 smithi196 ceph-mon[32572]: pgmap v9998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:49:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:15 smithi110 ceph-mon[28069]: pgmap v9999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:15 smithi193 ceph-mon[32782]: pgmap v9999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:15 smithi196 ceph-mon[32572]: pgmap v9999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:17 smithi110 ceph-mon[28069]: pgmap v10000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18072.159367 secs 2024-04-26T16:49:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:17 smithi193 ceph-mon[32782]: pgmap v10000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18072.159367 secs 2024-04-26T16:49:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:17 smithi196 ceph-mon[32572]: pgmap v10000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18072.159367 secs 2024-04-26T16:49:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:19 smithi110 ceph-mon[28069]: pgmap v10001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:19.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:19 smithi196 ceph-mon[32572]: pgmap v10001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:19 smithi193 ceph-mon[32782]: pgmap v10001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:21 smithi110 ceph-mon[28069]: pgmap v10002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:21 smithi193 ceph-mon[32782]: pgmap v10002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:21 smithi196 ceph-mon[32572]: pgmap v10002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18077.159458 secs 2024-04-26T16:49:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18077.159458 secs 2024-04-26T16:49:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18077.159458 secs 2024-04-26T16:49:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:23 smithi110 ceph-mon[28069]: pgmap v10003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:23 smithi193 ceph-mon[32782]: pgmap v10003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:23 smithi196 ceph-mon[32572]: pgmap v10003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:25 smithi193 ceph-mon[32782]: pgmap v10004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:25 smithi196 ceph-mon[32572]: pgmap v10004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:25 smithi110 ceph-mon[28069]: pgmap v10004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:27 smithi193 ceph-mon[32782]: pgmap v10005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18082.159589 secs 2024-04-26T16:49:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:27 smithi196 ceph-mon[32572]: pgmap v10005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18082.159589 secs 2024-04-26T16:49:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:27 smithi110 ceph-mon[28069]: pgmap v10005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18082.159589 secs 2024-04-26T16:49:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:29 smithi193 ceph-mon[32782]: pgmap v10006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:29 smithi196 ceph-mon[32572]: pgmap v10006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:29 smithi110 ceph-mon[28069]: pgmap v10006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:31 smithi193 ceph-mon[32782]: pgmap v10007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:31 smithi196 ceph-mon[32572]: pgmap v10007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:31 smithi110 ceph-mon[28069]: pgmap v10007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18087.159741 secs 2024-04-26T16:49:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18087.159741 secs 2024-04-26T16:49:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18087.159741 secs 2024-04-26T16:49:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:33 smithi193 ceph-mon[32782]: pgmap v10008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:33 smithi196 ceph-mon[32572]: pgmap v10008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:33 smithi110 ceph-mon[28069]: pgmap v10008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:35 smithi193 ceph-mon[32782]: pgmap v10009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:35 smithi196 ceph-mon[32572]: pgmap v10009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:35 smithi110 ceph-mon[28069]: pgmap v10009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:37.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:37 smithi110 ceph-mon[28069]: pgmap v10010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:37.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18092.159860 secs 2024-04-26T16:49:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:37 smithi193 ceph-mon[32782]: pgmap v10010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18092.159860 secs 2024-04-26T16:49:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:37 smithi196 ceph-mon[32572]: pgmap v10010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18092.159860 secs 2024-04-26T16:49:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:39 smithi193 ceph-mon[32782]: pgmap v10011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:39 smithi196 ceph-mon[32572]: pgmap v10011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:39 smithi110 ceph-mon[28069]: pgmap v10011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:41 smithi193 ceph-mon[32782]: pgmap v10012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:41 smithi196 ceph-mon[32572]: pgmap v10012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:41 smithi110 ceph-mon[28069]: pgmap v10012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18097.159979 secs 2024-04-26T16:49:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18097.159979 secs 2024-04-26T16:49:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18097.159979 secs 2024-04-26T16:49:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:43 smithi193 ceph-mon[32782]: pgmap v10013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:43 smithi196 ceph-mon[32572]: pgmap v10013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:43 smithi110 ceph-mon[28069]: pgmap v10013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:45 smithi193 ceph-mon[32782]: pgmap v10014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:45 smithi196 ceph-mon[32572]: pgmap v10014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:45 smithi110 ceph-mon[28069]: pgmap v10014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:47 smithi193 ceph-mon[32782]: pgmap v10015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18102.160102 secs 2024-04-26T16:49:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:47 smithi196 ceph-mon[32572]: pgmap v10015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18102.160102 secs 2024-04-26T16:49:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:47 smithi110 ceph-mon[28069]: pgmap v10015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18102.160102 secs 2024-04-26T16:49:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:49 smithi193 ceph-mon[32782]: pgmap v10016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:49 smithi196 ceph-mon[32572]: pgmap v10016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:49 smithi110 ceph-mon[28069]: pgmap v10016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:51 smithi196 ceph-mon[32572]: pgmap v10017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:51 smithi110 ceph-mon[28069]: pgmap v10017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:51 smithi193 ceph-mon[32782]: pgmap v10017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18107.160220 secs 2024-04-26T16:49:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18107.160220 secs 2024-04-26T16:49:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18107.160220 secs 2024-04-26T16:49:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:53 smithi196 ceph-mon[32572]: pgmap v10018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:53 smithi110 ceph-mon[28069]: pgmap v10018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:53 smithi193 ceph-mon[32782]: pgmap v10018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:54 smithi196 ceph-mon[32572]: pgmap v10019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:54 smithi110 ceph-mon[28069]: pgmap v10019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:54 smithi193 ceph-mon[32782]: pgmap v10019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:57 smithi196 ceph-mon[32572]: pgmap v10020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18112.160338 secs 2024-04-26T16:49:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:57 smithi110 ceph-mon[28069]: pgmap v10020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18112.160338 secs 2024-04-26T16:49:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:57 smithi193 ceph-mon[32782]: pgmap v10020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:49:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18112.160338 secs 2024-04-26T16:49:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:49:59 smithi110 ceph-mon[28069]: pgmap v10021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:49:59 smithi193 ceph-mon[32782]: pgmap v10021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:49:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:49:59 smithi196 ceph-mon[32572]: pgmap v10021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:50:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:50:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T16:50:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:01 smithi110 ceph-mon[28069]: pgmap v10022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:01 smithi193 ceph-mon[32782]: pgmap v10022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:01 smithi196 ceph-mon[32572]: pgmap v10022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18117.160455 secs 2024-04-26T16:50:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18117.160455 secs 2024-04-26T16:50:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18117.160455 secs 2024-04-26T16:50:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:03 smithi110 ceph-mon[28069]: pgmap v10023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:50:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:03 smithi193 ceph-mon[32782]: pgmap v10023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:50:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:03 smithi196 ceph-mon[32572]: pgmap v10023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:50:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:50:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:50:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:50:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:50:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:50:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:50:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:50:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:50:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:50:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:05 smithi193 ceph-mon[32782]: pgmap v10024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:50:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:05 smithi193 ceph-mon[32782]: pgmap v10025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:05 smithi196 ceph-mon[32572]: pgmap v10024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:50:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:05 smithi196 ceph-mon[32572]: pgmap v10025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:05 smithi110 ceph-mon[28069]: pgmap v10024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:50:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:05 smithi110 ceph-mon[28069]: pgmap v10025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:06 smithi196 ceph-mon[32572]: pgmap v10026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:06 smithi110 ceph-mon[28069]: pgmap v10026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:06 smithi193 ceph-mon[32782]: pgmap v10026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:07.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:07 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 18122.160587 secs 2024-04-26T16:50:07.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:07 smithi110 ceph-mon[28069]: slow request 5760.205205 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:50:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:07 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 18122.160587 secs 2024-04-26T16:50:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:07 smithi196 ceph-mon[32572]: slow request 5760.205205 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:50:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:07 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 18122.160587 secs 2024-04-26T16:50:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:07 smithi193 ceph-mon[32782]: slow request 5760.205205 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:50:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:08 smithi196 ceph-mon[32572]: pgmap v10027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:08 smithi110 ceph-mon[28069]: pgmap v10027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:08 smithi193 ceph-mon[32782]: pgmap v10027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:10 smithi193 ceph-mon[32782]: pgmap v10028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:10 smithi196 ceph-mon[32572]: pgmap v10028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:10 smithi110 ceph-mon[28069]: pgmap v10028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18127.160706 secs 2024-04-26T16:50:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:12 smithi193 ceph-mon[32782]: pgmap v10029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18127.160706 secs 2024-04-26T16:50:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:12 smithi196 ceph-mon[32572]: pgmap v10029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18127.160706 secs 2024-04-26T16:50:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:12 smithi110 ceph-mon[28069]: pgmap v10029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:50:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:14 smithi193 ceph-mon[32782]: pgmap v10030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:50:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:14 smithi196 ceph-mon[32572]: pgmap v10030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:50:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:14 smithi110 ceph-mon[28069]: pgmap v10030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:50:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:16 smithi193 ceph-mon[32782]: pgmap v10031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:16 smithi196 ceph-mon[32572]: pgmap v10031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:16 smithi110 ceph-mon[28069]: pgmap v10031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18132.160821 secs 2024-04-26T16:50:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18132.160821 secs 2024-04-26T16:50:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18132.160821 secs 2024-04-26T16:50:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:18 smithi193 ceph-mon[32782]: pgmap v10032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:19.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:18 smithi196 ceph-mon[32572]: pgmap v10032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:18 smithi110 ceph-mon[28069]: pgmap v10032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:20 smithi193 ceph-mon[32782]: pgmap v10033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:20 smithi196 ceph-mon[32572]: pgmap v10033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:20 smithi110 ceph-mon[28069]: pgmap v10033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18137.160932 secs 2024-04-26T16:50:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:22 smithi193 ceph-mon[32782]: pgmap v10034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18137.160932 secs 2024-04-26T16:50:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:22 smithi196 ceph-mon[32572]: pgmap v10034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18137.160932 secs 2024-04-26T16:50:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:22 smithi110 ceph-mon[28069]: pgmap v10034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:24 smithi193 ceph-mon[32782]: pgmap v10035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:24 smithi196 ceph-mon[32572]: pgmap v10035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:24 smithi110 ceph-mon[28069]: pgmap v10035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:26 smithi193 ceph-mon[32782]: pgmap v10036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:26 smithi196 ceph-mon[32572]: pgmap v10036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:26 smithi110 ceph-mon[28069]: pgmap v10036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18142.161046 secs 2024-04-26T16:50:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18142.161046 secs 2024-04-26T16:50:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18142.161046 secs 2024-04-26T16:50:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:28 smithi193 ceph-mon[32782]: pgmap v10037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:28 smithi196 ceph-mon[32572]: pgmap v10037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:28 smithi110 ceph-mon[28069]: pgmap v10037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:30 smithi196 ceph-mon[32572]: pgmap v10038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:50:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:30 smithi110 ceph-mon[28069]: pgmap v10038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:50:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:30 smithi193 ceph-mon[32782]: pgmap v10038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:50:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18147.161162 secs 2024-04-26T16:50:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:32 smithi196 ceph-mon[32572]: pgmap v10039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:50:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18147.161162 secs 2024-04-26T16:50:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:32 smithi110 ceph-mon[28069]: pgmap v10039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:50:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18147.161162 secs 2024-04-26T16:50:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:32 smithi193 ceph-mon[32782]: pgmap v10039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:50:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:34 smithi196 ceph-mon[32572]: pgmap v10040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:34 smithi110 ceph-mon[28069]: pgmap v10040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:34 smithi193 ceph-mon[32782]: pgmap v10040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:36 smithi196 ceph-mon[32572]: pgmap v10041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:50:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:36 smithi110 ceph-mon[28069]: pgmap v10041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:50:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:36 smithi193 ceph-mon[32782]: pgmap v10041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:50:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18152.161270 secs 2024-04-26T16:50:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18152.161270 secs 2024-04-26T16:50:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18152.161270 secs 2024-04-26T16:50:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:38 smithi196 ceph-mon[32572]: pgmap v10042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:38 smithi110 ceph-mon[28069]: pgmap v10042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:38 smithi193 ceph-mon[32782]: pgmap v10042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:40 smithi196 ceph-mon[32572]: pgmap v10043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:40 smithi110 ceph-mon[28069]: pgmap v10043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:40 smithi193 ceph-mon[32782]: pgmap v10043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18157.161386 secs 2024-04-26T16:50:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:42 smithi196 ceph-mon[32572]: pgmap v10044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18157.161386 secs 2024-04-26T16:50:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:42 smithi110 ceph-mon[28069]: pgmap v10044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18157.161386 secs 2024-04-26T16:50:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:42 smithi193 ceph-mon[32782]: pgmap v10044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:45.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:44 smithi193 ceph-mon[32782]: pgmap v10045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:44 smithi196 ceph-mon[32572]: pgmap v10045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:44 smithi110 ceph-mon[28069]: pgmap v10045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:46 smithi196 ceph-mon[32572]: pgmap v10046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:46 smithi110 ceph-mon[28069]: pgmap v10046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:46 smithi193 ceph-mon[32782]: pgmap v10046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18162.161496 secs 2024-04-26T16:50:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18162.161496 secs 2024-04-26T16:50:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18162.161496 secs 2024-04-26T16:50:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:48 smithi196 ceph-mon[32572]: pgmap v10047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:48 smithi110 ceph-mon[28069]: pgmap v10047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:48 smithi193 ceph-mon[32782]: pgmap v10047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:50 smithi196 ceph-mon[32572]: pgmap v10048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:50 smithi110 ceph-mon[28069]: pgmap v10048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:50 smithi193 ceph-mon[32782]: pgmap v10048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:52.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18167.161621 secs 2024-04-26T16:50:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18167.161621 secs 2024-04-26T16:50:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18167.161621 secs 2024-04-26T16:50:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:52 smithi196 ceph-mon[32572]: pgmap v10049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:52 smithi110 ceph-mon[28069]: pgmap v10049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:52 smithi193 ceph-mon[32782]: pgmap v10049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:54 smithi196 ceph-mon[32572]: pgmap v10050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:54 smithi110 ceph-mon[28069]: pgmap v10050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:54 smithi193 ceph-mon[32782]: pgmap v10050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:56 smithi196 ceph-mon[32572]: pgmap v10051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18172.161739 secs 2024-04-26T16:50:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:56 smithi110 ceph-mon[28069]: pgmap v10051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18172.161739 secs 2024-04-26T16:50:57.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:56 smithi193 ceph-mon[32782]: pgmap v10051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:50:57.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18172.161739 secs 2024-04-26T16:50:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:50:58 smithi196 ceph-mon[32572]: pgmap v10052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:50:58 smithi110 ceph-mon[28069]: pgmap v10052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:50:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:50:58 smithi193 ceph-mon[32782]: pgmap v10052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:00 smithi196 ceph-mon[32572]: pgmap v10053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:00 smithi110 ceph-mon[28069]: pgmap v10053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:00 smithi193 ceph-mon[32782]: pgmap v10053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18177.161859 secs 2024-04-26T16:51:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18177.161859 secs 2024-04-26T16:51:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18177.161859 secs 2024-04-26T16:51:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:02 smithi196 ceph-mon[32572]: pgmap v10054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:02 smithi110 ceph-mon[28069]: pgmap v10054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:02 smithi193 ceph-mon[32782]: pgmap v10054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:04 smithi196 ceph-mon[32572]: pgmap v10055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:51:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:51:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:51:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:04 smithi110 ceph-mon[28069]: pgmap v10055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:51:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:51:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:51:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:04 smithi193 ceph-mon[32782]: pgmap v10055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:51:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:51:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:51:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:07 smithi196 ceph-mon[32572]: pgmap v10056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:51:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:51:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:07 smithi196 ceph-mon[32572]: pgmap v10057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T16:51:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:07 smithi196 ceph-mon[32572]: pgmap v10058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T16:51:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:51:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18182.161982 secs 2024-04-26T16:51:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:07 smithi110 ceph-mon[28069]: pgmap v10056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:51:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:51:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:07 smithi110 ceph-mon[28069]: pgmap v10057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T16:51:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:07 smithi110 ceph-mon[28069]: pgmap v10058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T16:51:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:51:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18182.161982 secs 2024-04-26T16:51:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:07 smithi193 ceph-mon[32782]: pgmap v10056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:51:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:51:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:07 smithi193 ceph-mon[32782]: pgmap v10057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T16:51:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:07 smithi193 ceph-mon[32782]: pgmap v10058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T16:51:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:51:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18182.161982 secs 2024-04-26T16:51:09.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:09 smithi196 ceph-mon[32572]: pgmap v10059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:09 smithi110 ceph-mon[28069]: pgmap v10059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:09 smithi193 ceph-mon[32782]: pgmap v10059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:11 smithi196 ceph-mon[32572]: pgmap v10060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:11 smithi110 ceph-mon[28069]: pgmap v10060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:11 smithi193 ceph-mon[32782]: pgmap v10060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18187.162134 secs 2024-04-26T16:51:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18187.162134 secs 2024-04-26T16:51:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18187.162134 secs 2024-04-26T16:51:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:13 smithi196 ceph-mon[32572]: pgmap v10061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T16:51:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:13 smithi110 ceph-mon[28069]: pgmap v10061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T16:51:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:13 smithi193 ceph-mon[32782]: pgmap v10061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T16:51:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:15 smithi196 ceph-mon[32572]: pgmap v10062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:15 smithi110 ceph-mon[28069]: pgmap v10062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:15 smithi193 ceph-mon[32782]: pgmap v10062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:17 smithi196 ceph-mon[32572]: pgmap v10063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:51:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18192.162250 secs 2024-04-26T16:51:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:17 smithi110 ceph-mon[28069]: pgmap v10063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:51:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18192.162250 secs 2024-04-26T16:51:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:17 smithi193 ceph-mon[32782]: pgmap v10063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:51:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18192.162250 secs 2024-04-26T16:51:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:51:19.370+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:51:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:51:19.370+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T16:51:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:51:19.371+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 142 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T16:51:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:51:19.371+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 142 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:51:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:19 smithi196 ceph-mon[32572]: pgmap v10064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:19 smithi110 ceph-mon[28069]: pgmap v10064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:19 smithi193 ceph-mon[32782]: pgmap v10064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:21 smithi196 ceph-mon[32572]: pgmap v10065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:21 smithi110 ceph-mon[28069]: pgmap v10065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:21 smithi193 ceph-mon[32782]: pgmap v10065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18197.162368 secs 2024-04-26T16:51:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18197.162368 secs 2024-04-26T16:51:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18197.162368 secs 2024-04-26T16:51:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:23 smithi196 ceph-mon[32572]: pgmap v10066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:23 smithi110 ceph-mon[28069]: pgmap v10066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:23 smithi193 ceph-mon[32782]: pgmap v10066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:25 smithi196 ceph-mon[32572]: pgmap v10067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:25 smithi110 ceph-mon[28069]: pgmap v10067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:25 smithi193 ceph-mon[32782]: pgmap v10067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:27 smithi196 ceph-mon[32572]: pgmap v10068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18202.162492 secs 2024-04-26T16:51:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:27 smithi110 ceph-mon[28069]: pgmap v10068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18202.162492 secs 2024-04-26T16:51:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:27 smithi193 ceph-mon[32782]: pgmap v10068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18202.162492 secs 2024-04-26T16:51:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:29 smithi196 ceph-mon[32572]: pgmap v10069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:29 smithi110 ceph-mon[28069]: pgmap v10069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:29 smithi193 ceph-mon[32782]: pgmap v10069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:31 smithi196 ceph-mon[32572]: pgmap v10070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:31 smithi110 ceph-mon[28069]: pgmap v10070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:31 smithi193 ceph-mon[32782]: pgmap v10070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18207.162609 secs 2024-04-26T16:51:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18207.162609 secs 2024-04-26T16:51:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18207.162609 secs 2024-04-26T16:51:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:33 smithi110 ceph-mon[28069]: pgmap v10071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:33 smithi193 ceph-mon[32782]: pgmap v10071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:33 smithi196 ceph-mon[32572]: pgmap v10071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:35 smithi110 ceph-mon[28069]: pgmap v10072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:35 smithi193 ceph-mon[32782]: pgmap v10072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:35 smithi196 ceph-mon[32572]: pgmap v10072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:37 smithi110 ceph-mon[28069]: pgmap v10073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18212.162748 secs 2024-04-26T16:51:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:37 smithi193 ceph-mon[32782]: pgmap v10073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18212.162748 secs 2024-04-26T16:51:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:37 smithi196 ceph-mon[32572]: pgmap v10073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18212.162748 secs 2024-04-26T16:51:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:39 smithi110 ceph-mon[28069]: pgmap v10074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:39 smithi193 ceph-mon[32782]: pgmap v10074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:39 smithi196 ceph-mon[32572]: pgmap v10074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:41 smithi110 ceph-mon[28069]: pgmap v10075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:41 smithi193 ceph-mon[32782]: pgmap v10075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:41 smithi196 ceph-mon[32572]: pgmap v10075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:42.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18217.162852 secs 2024-04-26T16:51:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18217.162852 secs 2024-04-26T16:51:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18217.162852 secs 2024-04-26T16:51:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:43 smithi193 ceph-mon[32782]: pgmap v10076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:43 smithi196 ceph-mon[32572]: pgmap v10076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:43 smithi110 ceph-mon[28069]: pgmap v10076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:45 smithi193 ceph-mon[32782]: pgmap v10077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:45 smithi196 ceph-mon[32572]: pgmap v10077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:45 smithi110 ceph-mon[28069]: pgmap v10077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:47 smithi193 ceph-mon[32782]: pgmap v10078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18222.162950 secs 2024-04-26T16:51:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:47 smithi196 ceph-mon[32572]: pgmap v10078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18222.162950 secs 2024-04-26T16:51:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:47 smithi110 ceph-mon[28069]: pgmap v10078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18222.162950 secs 2024-04-26T16:51:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:49 smithi193 ceph-mon[32782]: pgmap v10079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:49 smithi196 ceph-mon[32572]: pgmap v10079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:49 smithi110 ceph-mon[28069]: pgmap v10079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:51 smithi193 ceph-mon[32782]: pgmap v10080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:51 smithi196 ceph-mon[32572]: pgmap v10080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:51 smithi110 ceph-mon[28069]: pgmap v10080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18227.163044 secs 2024-04-26T16:51:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18227.163044 secs 2024-04-26T16:51:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18227.163044 secs 2024-04-26T16:51:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:53 smithi193 ceph-mon[32782]: pgmap v10081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:53 smithi196 ceph-mon[32572]: pgmap v10081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:53 smithi110 ceph-mon[28069]: pgmap v10081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:55 smithi193 ceph-mon[32782]: pgmap v10082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:55 smithi196 ceph-mon[32572]: pgmap v10082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:55 smithi110 ceph-mon[28069]: pgmap v10082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:57 smithi193 ceph-mon[32782]: pgmap v10083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18232.163115 secs 2024-04-26T16:51:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:57 smithi196 ceph-mon[32572]: pgmap v10083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18232.163115 secs 2024-04-26T16:51:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:57 smithi110 ceph-mon[28069]: pgmap v10083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:51:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18232.163115 secs 2024-04-26T16:51:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:51:59 smithi193 ceph-mon[32782]: pgmap v10084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:51:59 smithi196 ceph-mon[32572]: pgmap v10084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:51:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:51:59 smithi110 ceph-mon[28069]: pgmap v10084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:01 smithi193 ceph-mon[32782]: pgmap v10085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:01 smithi196 ceph-mon[32572]: pgmap v10085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:01 smithi110 ceph-mon[28069]: pgmap v10085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18237.163238 secs 2024-04-26T16:52:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18237.163238 secs 2024-04-26T16:52:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18237.163238 secs 2024-04-26T16:52:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:03 smithi196 ceph-mon[32572]: pgmap v10086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:03 smithi110 ceph-mon[28069]: pgmap v10086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:03 smithi193 ceph-mon[32782]: pgmap v10086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:05 smithi196 ceph-mon[32572]: pgmap v10087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:05 smithi110 ceph-mon[28069]: pgmap v10087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:05 smithi193 ceph-mon[32782]: pgmap v10087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:07 smithi196 ceph-mon[32572]: pgmap v10088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:52:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18242.163347 secs 2024-04-26T16:52:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:07 smithi110 ceph-mon[28069]: pgmap v10088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:52:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18242.163347 secs 2024-04-26T16:52:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:07 smithi193 ceph-mon[32782]: pgmap v10088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:52:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18242.163347 secs 2024-04-26T16:52:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:52:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:52:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:52:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:52:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:52:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:52:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:52:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:09 smithi196 ceph-mon[32572]: pgmap v10089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:52:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:09 smithi196 ceph-mon[32572]: pgmap v10090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:52:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:09 smithi110 ceph-mon[28069]: pgmap v10089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:52:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:09 smithi110 ceph-mon[28069]: pgmap v10090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:52:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:09 smithi193 ceph-mon[32782]: pgmap v10089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:52:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:09 smithi193 ceph-mon[32782]: pgmap v10090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:52:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:11 smithi196 ceph-mon[32572]: pgmap v10091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:52:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:11 smithi110 ceph-mon[28069]: pgmap v10091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:52:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:11 smithi193 ceph-mon[32782]: pgmap v10091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:52:12.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 18247.163464 secs 2024-04-26T16:52:12.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:12 smithi196 ceph-mon[32572]: slow request 2883.640729 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:52:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 18247.163464 secs 2024-04-26T16:52:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:12 smithi110 ceph-mon[28069]: slow request 2883.640729 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:52:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 18247.163464 secs 2024-04-26T16:52:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:12 smithi193 ceph-mon[32782]: slow request 2883.640729 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:52:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:13 smithi196 ceph-mon[32572]: pgmap v10092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:52:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:13 smithi110 ceph-mon[28069]: pgmap v10092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:52:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:13 smithi193 ceph-mon[32782]: pgmap v10092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:52:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:14 smithi196 ceph-mon[32572]: pgmap v10093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:52:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:14 smithi110 ceph-mon[28069]: pgmap v10093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:52:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:14 smithi193 ceph-mon[32782]: pgmap v10093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:52:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:16 smithi193 ceph-mon[32782]: pgmap v10094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:52:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:16 smithi196 ceph-mon[32572]: pgmap v10094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:52:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:16 smithi110 ceph-mon[28069]: pgmap v10094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:52:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18252.163590 secs 2024-04-26T16:52:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18252.163590 secs 2024-04-26T16:52:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18252.163590 secs 2024-04-26T16:52:19.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:18 smithi193 ceph-mon[32782]: pgmap v10095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:52:19.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:18 smithi196 ceph-mon[32572]: pgmap v10095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:52:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:18 smithi110 ceph-mon[28069]: pgmap v10095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:52:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:20 smithi193 ceph-mon[32782]: pgmap v10096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:20 smithi196 ceph-mon[32572]: pgmap v10096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:20 smithi110 ceph-mon[28069]: pgmap v10096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18257.163708 secs 2024-04-26T16:52:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:22 smithi193 ceph-mon[32782]: pgmap v10097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18257.163708 secs 2024-04-26T16:52:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:22 smithi196 ceph-mon[32572]: pgmap v10097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18257.163708 secs 2024-04-26T16:52:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:22 smithi110 ceph-mon[28069]: pgmap v10097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:24 smithi193 ceph-mon[32782]: pgmap v10098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:24 smithi196 ceph-mon[32572]: pgmap v10098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:24 smithi110 ceph-mon[28069]: pgmap v10098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:26 smithi193 ceph-mon[32782]: pgmap v10099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:26 smithi196 ceph-mon[32572]: pgmap v10099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:26 smithi110 ceph-mon[28069]: pgmap v10099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18262.163782 secs 2024-04-26T16:52:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18262.163782 secs 2024-04-26T16:52:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18262.163782 secs 2024-04-26T16:52:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:28 smithi196 ceph-mon[32572]: pgmap v10100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:28 smithi110 ceph-mon[28069]: pgmap v10100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:28 smithi193 ceph-mon[32782]: pgmap v10100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:30 smithi196 ceph-mon[32572]: pgmap v10101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:30 smithi110 ceph-mon[28069]: pgmap v10101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:30 smithi193 ceph-mon[32782]: pgmap v10101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18267.163833 secs 2024-04-26T16:52:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:32 smithi196 ceph-mon[32572]: pgmap v10102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18267.163833 secs 2024-04-26T16:52:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:32 smithi110 ceph-mon[28069]: pgmap v10102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18267.163833 secs 2024-04-26T16:52:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:32 smithi193 ceph-mon[32782]: pgmap v10102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:34 smithi196 ceph-mon[32572]: pgmap v10103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:34 smithi110 ceph-mon[28069]: pgmap v10103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:34 smithi193 ceph-mon[32782]: pgmap v10103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:36 smithi196 ceph-mon[32572]: pgmap v10104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:36 smithi110 ceph-mon[28069]: pgmap v10104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:36 smithi193 ceph-mon[32782]: pgmap v10104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18272.163969 secs 2024-04-26T16:52:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18272.163969 secs 2024-04-26T16:52:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18272.163969 secs 2024-04-26T16:52:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:38 smithi196 ceph-mon[32572]: pgmap v10105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:38 smithi110 ceph-mon[28069]: pgmap v10105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:38 smithi193 ceph-mon[32782]: pgmap v10105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:40 smithi196 ceph-mon[32572]: pgmap v10106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:40 smithi110 ceph-mon[28069]: pgmap v10106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:40 smithi193 ceph-mon[32782]: pgmap v10106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18277.164091 secs 2024-04-26T16:52:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:42 smithi196 ceph-mon[32572]: pgmap v10107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18277.164091 secs 2024-04-26T16:52:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:42 smithi110 ceph-mon[28069]: pgmap v10107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18277.164091 secs 2024-04-26T16:52:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:42 smithi193 ceph-mon[32782]: pgmap v10107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:44 smithi196 ceph-mon[32572]: pgmap v10108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:44 smithi110 ceph-mon[28069]: pgmap v10108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:44 smithi193 ceph-mon[32782]: pgmap v10108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:46 smithi196 ceph-mon[32572]: pgmap v10109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:46 smithi110 ceph-mon[28069]: pgmap v10109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:46 smithi193 ceph-mon[32782]: pgmap v10109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18282.164212 secs 2024-04-26T16:52:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18282.164212 secs 2024-04-26T16:52:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18282.164212 secs 2024-04-26T16:52:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:48 smithi196 ceph-mon[32572]: pgmap v10110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:48 smithi110 ceph-mon[28069]: pgmap v10110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:48 smithi193 ceph-mon[32782]: pgmap v10110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:50 smithi196 ceph-mon[32572]: pgmap v10111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:50 smithi110 ceph-mon[28069]: pgmap v10111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:50 smithi193 ceph-mon[32782]: pgmap v10111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:51 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18287.164328 secs 2024-04-26T16:52:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:51 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18287.164328 secs 2024-04-26T16:52:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:51 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18287.164328 secs 2024-04-26T16:52:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:52 smithi196 ceph-mon[32572]: pgmap v10112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:52 smithi110 ceph-mon[28069]: pgmap v10112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:52 smithi193 ceph-mon[32782]: pgmap v10112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:54 smithi196 ceph-mon[32572]: pgmap v10113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:54 smithi110 ceph-mon[28069]: pgmap v10113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:54 smithi193 ceph-mon[32782]: pgmap v10113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:56 smithi196 ceph-mon[32572]: pgmap v10114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:56 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18292.164443 secs 2024-04-26T16:52:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:56 smithi110 ceph-mon[28069]: pgmap v10114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:56 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18292.164443 secs 2024-04-26T16:52:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:56 smithi193 ceph-mon[32782]: pgmap v10114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:52:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:56 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18292.164443 secs 2024-04-26T16:52:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:52:58 smithi196 ceph-mon[32572]: pgmap v10115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:52:58 smithi110 ceph-mon[28069]: pgmap v10115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:52:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:52:58 smithi193 ceph-mon[32782]: pgmap v10115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:00 smithi196 ceph-mon[32572]: pgmap v10116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:00 smithi110 ceph-mon[28069]: pgmap v10116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:00 smithi193 ceph-mon[32782]: pgmap v10116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:01 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18297.164569 secs 2024-04-26T16:53:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:01 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18297.164569 secs 2024-04-26T16:53:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:01 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18297.164569 secs 2024-04-26T16:53:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:03 smithi196 ceph-mon[32572]: pgmap v10117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:02 smithi110 ceph-mon[28069]: pgmap v10117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:03 smithi193 ceph-mon[32782]: pgmap v10117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:05 smithi196 ceph-mon[32572]: pgmap v10118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:05 smithi110 ceph-mon[28069]: pgmap v10118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:05 smithi193 ceph-mon[32782]: pgmap v10118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:07 smithi110 ceph-mon[28069]: pgmap v10119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18302.164678 secs 2024-04-26T16:53:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:07 smithi193 ceph-mon[32782]: pgmap v10119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18302.164678 secs 2024-04-26T16:53:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:07 smithi196 ceph-mon[32572]: pgmap v10119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18302.164678 secs 2024-04-26T16:53:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:09 smithi196 ceph-mon[32572]: pgmap v10120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:53:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:09 smithi110 ceph-mon[28069]: pgmap v10120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:53:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:09 smithi193 ceph-mon[32782]: pgmap v10120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: pgmap v10121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: pgmap v10121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: pgmap v10121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:53:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:53:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18307.164774 secs 2024-04-26T16:53:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:53:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:53:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18307.164774 secs 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T16:53:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18307.164774 secs 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:13 smithi196 ceph-mon[32572]: pgmap v10122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:13 smithi110 ceph-mon[28069]: pgmap v10122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:13 smithi193 ceph-mon[32782]: pgmap v10122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:53:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:53:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:53:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:53:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: pgmap v10123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:53:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: pgmap v10124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:53:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:53:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:53:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:53:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: pgmap v10123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:53:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: pgmap v10124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:53:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: pgmap v10123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:53:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: pgmap v10124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:53:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:15 smithi196 ceph-mon[32572]: pgmap v10125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:15 smithi110 ceph-mon[28069]: pgmap v10125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:15 smithi193 ceph-mon[32782]: pgmap v10125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18312.164887 secs 2024-04-26T16:53:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18312.164887 secs 2024-04-26T16:53:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18312.164887 secs 2024-04-26T16:53:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:18 smithi110 ceph-mon[28069]: pgmap v10126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:53:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:18 smithi193 ceph-mon[32782]: pgmap v10126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:53:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:18 smithi196 ceph-mon[32572]: pgmap v10126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T16:53:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:19 smithi196 ceph-mon[32572]: pgmap v10127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:19 smithi110 ceph-mon[28069]: pgmap v10127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:19 smithi193 ceph-mon[32782]: pgmap v10127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:21 smithi196 ceph-mon[32572]: pgmap v10128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:21 smithi110 ceph-mon[28069]: pgmap v10128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:21 smithi193 ceph-mon[32782]: pgmap v10128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:53:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18317.165008 secs 2024-04-26T16:53:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18317.165008 secs 2024-04-26T16:53:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18317.165008 secs 2024-04-26T16:53:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:23 smithi196 ceph-mon[32572]: pgmap v10129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:53:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:23 smithi110 ceph-mon[28069]: pgmap v10129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:53:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:23 smithi193 ceph-mon[32782]: pgmap v10129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:53:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:25 smithi196 ceph-mon[32572]: pgmap v10130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:25 smithi110 ceph-mon[28069]: pgmap v10130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:25 smithi193 ceph-mon[32782]: pgmap v10130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18322.165125 secs 2024-04-26T16:53:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18322.165125 secs 2024-04-26T16:53:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18322.165125 secs 2024-04-26T16:53:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:28 smithi110 ceph-mon[28069]: pgmap v10131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:28.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:28 smithi193 ceph-mon[32782]: pgmap v10131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:28 smithi196 ceph-mon[32572]: pgmap v10131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:29 smithi196 ceph-mon[32572]: pgmap v10132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:29 smithi110 ceph-mon[28069]: pgmap v10132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:29 smithi193 ceph-mon[32782]: pgmap v10132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:31 smithi196 ceph-mon[32572]: pgmap v10133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:31 smithi110 ceph-mon[28069]: pgmap v10133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:31 smithi193 ceph-mon[32782]: pgmap v10133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18327.165259 secs 2024-04-26T16:53:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18327.165259 secs 2024-04-26T16:53:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18327.165259 secs 2024-04-26T16:53:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:33 smithi196 ceph-mon[32572]: pgmap v10134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:33 smithi110 ceph-mon[28069]: pgmap v10134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:33 smithi193 ceph-mon[32782]: pgmap v10134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:53:34.393+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:53:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:53:34.393+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T16:53:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:53:34.394+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 143 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:53:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:53:34.394+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 143 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T16:53:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:35 smithi196 ceph-mon[32572]: pgmap v10135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:35 smithi110 ceph-mon[28069]: pgmap v10135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:35 smithi193 ceph-mon[32782]: pgmap v10135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18332.165383 secs 2024-04-26T16:53:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18332.165383 secs 2024-04-26T16:53:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18332.165383 secs 2024-04-26T16:53:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:38 smithi110 ceph-mon[28069]: pgmap v10136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:38 smithi193 ceph-mon[32782]: pgmap v10136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:38 smithi196 ceph-mon[32572]: pgmap v10136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:39 smithi196 ceph-mon[32572]: pgmap v10137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:39 smithi110 ceph-mon[28069]: pgmap v10137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:39 smithi193 ceph-mon[32782]: pgmap v10137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:41 smithi196 ceph-mon[32572]: pgmap v10138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:41 smithi110 ceph-mon[28069]: pgmap v10138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:41 smithi193 ceph-mon[32782]: pgmap v10138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18337.165481 secs 2024-04-26T16:53:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18337.165481 secs 2024-04-26T16:53:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18337.165481 secs 2024-04-26T16:53:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:43 smithi196 ceph-mon[32572]: pgmap v10139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:43 smithi110 ceph-mon[28069]: pgmap v10139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:43 smithi193 ceph-mon[32782]: pgmap v10139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:45 smithi196 ceph-mon[32572]: pgmap v10140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:45 smithi110 ceph-mon[28069]: pgmap v10140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:45 smithi193 ceph-mon[32782]: pgmap v10140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18342.165628 secs 2024-04-26T16:53:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18342.165628 secs 2024-04-26T16:53:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18342.165628 secs 2024-04-26T16:53:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:48 smithi110 ceph-mon[28069]: pgmap v10141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:48 smithi193 ceph-mon[32782]: pgmap v10141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:48 smithi196 ceph-mon[32572]: pgmap v10141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:49 smithi196 ceph-mon[32572]: pgmap v10142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:49 smithi110 ceph-mon[28069]: pgmap v10142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:49 smithi193 ceph-mon[32782]: pgmap v10142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:51 smithi196 ceph-mon[32572]: pgmap v10143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:51 smithi110 ceph-mon[28069]: pgmap v10143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:51 smithi193 ceph-mon[32782]: pgmap v10143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18347.165696 secs 2024-04-26T16:53:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18347.165696 secs 2024-04-26T16:53:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18347.165696 secs 2024-04-26T16:53:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:53 smithi196 ceph-mon[32572]: pgmap v10144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:53 smithi110 ceph-mon[28069]: pgmap v10144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:53 smithi193 ceph-mon[32782]: pgmap v10144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:55 smithi196 ceph-mon[32572]: pgmap v10145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:55 smithi110 ceph-mon[28069]: pgmap v10145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:55 smithi193 ceph-mon[32782]: pgmap v10145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:53:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18352.165771 secs 2024-04-26T16:53:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18352.165771 secs 2024-04-26T16:53:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18352.165771 secs 2024-04-26T16:53:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:58 smithi110 ceph-mon[28069]: pgmap v10146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:58 smithi193 ceph-mon[32782]: pgmap v10146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:58 smithi196 ceph-mon[32572]: pgmap v10146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:53:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:53:59 smithi196 ceph-mon[32572]: pgmap v10147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:53:59 smithi110 ceph-mon[28069]: pgmap v10147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:53:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:53:59 smithi193 ceph-mon[32782]: pgmap v10147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:54:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:01 smithi196 ceph-mon[32572]: pgmap v10148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:01 smithi110 ceph-mon[28069]: pgmap v10148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:01 smithi193 ceph-mon[32782]: pgmap v10148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18357.165888 secs 2024-04-26T16:54:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18357.165888 secs 2024-04-26T16:54:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18357.165888 secs 2024-04-26T16:54:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:03 smithi196 ceph-mon[32572]: pgmap v10149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:03 smithi110 ceph-mon[28069]: pgmap v10149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:03 smithi193 ceph-mon[32782]: pgmap v10149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:05 smithi196 ceph-mon[32572]: pgmap v10150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:05 smithi110 ceph-mon[28069]: pgmap v10150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:05 smithi193 ceph-mon[32782]: pgmap v10150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18362.166003 secs 2024-04-26T16:54:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18362.166003 secs 2024-04-26T16:54:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18362.166003 secs 2024-04-26T16:54:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:08 smithi110 ceph-mon[28069]: pgmap v10151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:08 smithi193 ceph-mon[32782]: pgmap v10151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:08 smithi196 ceph-mon[32572]: pgmap v10151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:09 smithi110 ceph-mon[28069]: pgmap v10152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:54:09.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:54:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:54:09.237+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:54:09.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:54:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:54:09.237+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:54:09.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:54:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:54:09.237+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:54:09.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:54:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:54:09.237+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:54:09.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:54:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:54:09.237+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:54:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:09 smithi196 ceph-mon[32572]: pgmap v10152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:54:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:09 smithi193 ceph-mon[32782]: pgmap v10152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T16:54:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:11 smithi196 ceph-mon[32572]: pgmap v10153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:11 smithi110 ceph-mon[28069]: pgmap v10153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:11 smithi193 ceph-mon[32782]: pgmap v10153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18367.166142 secs 2024-04-26T16:54:12.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18367.166142 secs 2024-04-26T16:54:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18367.166142 secs 2024-04-26T16:54:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:13 smithi196 ceph-mon[32572]: pgmap v10154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:54:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:13 smithi110 ceph-mon[28069]: pgmap v10154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:54:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:13 smithi193 ceph-mon[32782]: pgmap v10154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:54:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:54:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:54:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:54:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:54:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:54:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:15 smithi110 ceph-mon[28069]: pgmap v10155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:54:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:15 smithi110 ceph-mon[28069]: pgmap v10156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:54:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:54:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:54:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:15 smithi193 ceph-mon[32782]: pgmap v10155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:54:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:15 smithi193 ceph-mon[32782]: pgmap v10156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:54:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:54:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:54:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:15 smithi196 ceph-mon[32572]: pgmap v10155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T16:54:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:15 smithi196 ceph-mon[32572]: pgmap v10156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:54:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18372.166275 secs 2024-04-26T16:54:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18372.166275 secs 2024-04-26T16:54:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18372.166275 secs 2024-04-26T16:54:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:18 smithi110 ceph-mon[28069]: pgmap v10157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:18 smithi193 ceph-mon[32782]: pgmap v10157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:18 smithi196 ceph-mon[32572]: pgmap v10157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:19.401 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:54:19.401+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:54:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:54:19.401+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T16:54:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:54:19.402+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 144 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T16:54:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:54:19.402+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 144 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:54:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:20 smithi110 ceph-mon[28069]: pgmap v10158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:20 smithi193 ceph-mon[32782]: pgmap v10158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:20 smithi196 ceph-mon[32572]: pgmap v10158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:22 smithi110 ceph-mon[28069]: pgmap v10159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18377.166392 secs 2024-04-26T16:54:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:22 smithi193 ceph-mon[32782]: pgmap v10159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18377.166392 secs 2024-04-26T16:54:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:22 smithi196 ceph-mon[32572]: pgmap v10159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T16:54:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18377.166392 secs 2024-04-26T16:54:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:24 smithi110 ceph-mon[28069]: pgmap v10160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:54:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:24 smithi193 ceph-mon[32782]: pgmap v10160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:54:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:24 smithi196 ceph-mon[32572]: pgmap v10160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:54:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:26 smithi110 ceph-mon[28069]: pgmap v10161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:54:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:26 smithi193 ceph-mon[32782]: pgmap v10161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:54:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:26 smithi196 ceph-mon[32572]: pgmap v10161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:54:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18382.166531 secs 2024-04-26T16:54:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18382.166531 secs 2024-04-26T16:54:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18382.166531 secs 2024-04-26T16:54:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:28 smithi193 ceph-mon[32782]: pgmap v10162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:28 smithi196 ceph-mon[32572]: pgmap v10162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:28 smithi110 ceph-mon[28069]: pgmap v10162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:30 smithi193 ceph-mon[32782]: pgmap v10163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:30 smithi196 ceph-mon[32572]: pgmap v10163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:30 smithi110 ceph-mon[28069]: pgmap v10163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:32 smithi193 ceph-mon[32782]: pgmap v10164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18387.166670 secs 2024-04-26T16:54:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:32 smithi196 ceph-mon[32572]: pgmap v10164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18387.166670 secs 2024-04-26T16:54:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:32 smithi110 ceph-mon[28069]: pgmap v10164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18387.166670 secs 2024-04-26T16:54:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:34 smithi193 ceph-mon[32782]: pgmap v10165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:34 smithi196 ceph-mon[32572]: pgmap v10165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:34 smithi110 ceph-mon[28069]: pgmap v10165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:36 smithi193 ceph-mon[32782]: pgmap v10166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:36 smithi196 ceph-mon[32572]: pgmap v10166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:36 smithi110 ceph-mon[28069]: pgmap v10166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18392.166763 secs 2024-04-26T16:54:37.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18392.166763 secs 2024-04-26T16:54:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18392.166763 secs 2024-04-26T16:54:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:38 smithi193 ceph-mon[32782]: pgmap v10167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:38 smithi196 ceph-mon[32572]: pgmap v10167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:38 smithi110 ceph-mon[28069]: pgmap v10167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:40 smithi193 ceph-mon[32782]: pgmap v10168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:40 smithi196 ceph-mon[32572]: pgmap v10168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:40 smithi110 ceph-mon[28069]: pgmap v10168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:42 smithi193 ceph-mon[32782]: pgmap v10169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18397.166847 secs 2024-04-26T16:54:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:42 smithi196 ceph-mon[32572]: pgmap v10169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18397.166847 secs 2024-04-26T16:54:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:42 smithi110 ceph-mon[28069]: pgmap v10169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18397.166847 secs 2024-04-26T16:54:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:44 smithi193 ceph-mon[32782]: pgmap v10170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:44 smithi196 ceph-mon[32572]: pgmap v10170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:44 smithi110 ceph-mon[28069]: pgmap v10170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:46 smithi193 ceph-mon[32782]: pgmap v10171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:46 smithi196 ceph-mon[32572]: pgmap v10171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:46 smithi110 ceph-mon[28069]: pgmap v10171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18402.166935 secs 2024-04-26T16:54:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18402.166935 secs 2024-04-26T16:54:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18402.166935 secs 2024-04-26T16:54:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:48 smithi193 ceph-mon[32782]: pgmap v10172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:48 smithi196 ceph-mon[32572]: pgmap v10172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:48 smithi110 ceph-mon[28069]: pgmap v10172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:50 smithi196 ceph-mon[32572]: pgmap v10173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:50 smithi110 ceph-mon[28069]: pgmap v10173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:50 smithi193 ceph-mon[32782]: pgmap v10173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:52 smithi196 ceph-mon[32572]: pgmap v10174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18407.167073 secs 2024-04-26T16:54:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:52 smithi110 ceph-mon[28069]: pgmap v10174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18407.167073 secs 2024-04-26T16:54:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:52 smithi193 ceph-mon[32782]: pgmap v10174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18407.167073 secs 2024-04-26T16:54:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:54 smithi196 ceph-mon[32572]: pgmap v10175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:54 smithi110 ceph-mon[28069]: pgmap v10175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:54 smithi193 ceph-mon[32782]: pgmap v10175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:54:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:56 smithi196 ceph-mon[32572]: pgmap v10176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:56 smithi110 ceph-mon[28069]: pgmap v10176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:56 smithi193 ceph-mon[32782]: pgmap v10176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18412.167134 secs 2024-04-26T16:54:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18412.167134 secs 2024-04-26T16:54:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18412.167134 secs 2024-04-26T16:54:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:54:58 smithi196 ceph-mon[32572]: pgmap v10177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:54:58 smithi110 ceph-mon[28069]: pgmap v10177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:54:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:54:58 smithi193 ceph-mon[32782]: pgmap v10177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:00 smithi196 ceph-mon[32572]: pgmap v10178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:00 smithi110 ceph-mon[28069]: pgmap v10178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:00 smithi193 ceph-mon[32782]: pgmap v10178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:02.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:02 smithi196 ceph-mon[32572]: pgmap v10179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:02.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18417.167273 secs 2024-04-26T16:55:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:02 smithi110 ceph-mon[28069]: pgmap v10179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18417.167273 secs 2024-04-26T16:55:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:02 smithi193 ceph-mon[32782]: pgmap v10179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18417.167273 secs 2024-04-26T16:55:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:04 smithi196 ceph-mon[32572]: pgmap v10180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:55:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:04 smithi110 ceph-mon[28069]: pgmap v10180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:55:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:04 smithi193 ceph-mon[32782]: pgmap v10180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:55:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:06 smithi196 ceph-mon[32572]: pgmap v10181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:55:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:06 smithi110 ceph-mon[28069]: pgmap v10181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:55:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:06 smithi193 ceph-mon[32782]: pgmap v10181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:55:07.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18422.167407 secs 2024-04-26T16:55:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18422.167407 secs 2024-04-26T16:55:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18422.167407 secs 2024-04-26T16:55:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:08 smithi196 ceph-mon[32572]: pgmap v10182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:55:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:08 smithi110 ceph-mon[28069]: pgmap v10182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:55:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:08 smithi193 ceph-mon[32782]: pgmap v10182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:55:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:10 smithi196 ceph-mon[32572]: pgmap v10183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:55:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:10 smithi110 ceph-mon[28069]: pgmap v10183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:55:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:10 smithi193 ceph-mon[32782]: pgmap v10183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:55:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:12 smithi196 ceph-mon[32572]: pgmap v10184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:55:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18427.167524 secs 2024-04-26T16:55:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:12 smithi110 ceph-mon[28069]: pgmap v10184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:55:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18427.167524 secs 2024-04-26T16:55:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:12 smithi193 ceph-mon[32782]: pgmap v10184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T16:55:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18427.167524 secs 2024-04-26T16:55:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:13 smithi196 ceph-mon[32572]: pgmap v10185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:55:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:13 smithi110 ceph-mon[28069]: pgmap v10185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:55:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:13 smithi193 ceph-mon[32782]: pgmap v10185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T16:55:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:16 smithi193 ceph-mon[32782]: pgmap v10186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:55:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:16 smithi196 ceph-mon[32572]: pgmap v10186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:55:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:16 smithi110 ceph-mon[28069]: pgmap v10186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:55:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18432.167603 secs 2024-04-26T16:55:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:55:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:55:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:55:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18432.167603 secs 2024-04-26T16:55:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:55:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:55:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:55:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18432.167603 secs 2024-04-26T16:55:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:55:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:55:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:55:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:18 smithi193 ceph-mon[32782]: pgmap v10187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:55:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:18 smithi193 ceph-mon[32782]: pgmap v10188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:18 smithi196 ceph-mon[32572]: pgmap v10187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:55:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:18 smithi196 ceph-mon[32572]: pgmap v10188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:18 smithi110 ceph-mon[28069]: pgmap v10187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T16:55:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:18 smithi110 ceph-mon[28069]: pgmap v10188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:20 smithi193 ceph-mon[32782]: pgmap v10189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:20 smithi196 ceph-mon[32572]: pgmap v10189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:20 smithi110 ceph-mon[28069]: pgmap v10189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:22 smithi193 ceph-mon[32782]: pgmap v10190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18437.167671 secs 2024-04-26T16:55:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:22 smithi196 ceph-mon[32572]: pgmap v10190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18437.167671 secs 2024-04-26T16:55:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:22 smithi110 ceph-mon[28069]: pgmap v10190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18437.167671 secs 2024-04-26T16:55:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:24 smithi193 ceph-mon[32782]: pgmap v10191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:24 smithi196 ceph-mon[32572]: pgmap v10191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:24 smithi110 ceph-mon[28069]: pgmap v10191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:26 smithi193 ceph-mon[32782]: pgmap v10192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:26 smithi196 ceph-mon[32572]: pgmap v10192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:26 smithi110 ceph-mon[28069]: pgmap v10192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:55:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18442.167780 secs 2024-04-26T16:55:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18442.167780 secs 2024-04-26T16:55:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18442.167780 secs 2024-04-26T16:55:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:28 smithi193 ceph-mon[32782]: pgmap v10193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:55:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:28 smithi196 ceph-mon[32572]: pgmap v10193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:55:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:28 smithi110 ceph-mon[28069]: pgmap v10193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:55:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:30 smithi193 ceph-mon[32782]: pgmap v10194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:30 smithi196 ceph-mon[32572]: pgmap v10194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:30 smithi110 ceph-mon[28069]: pgmap v10194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:32 smithi193 ceph-mon[32782]: pgmap v10195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18447.167901 secs 2024-04-26T16:55:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:32 smithi196 ceph-mon[32572]: pgmap v10195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18447.167901 secs 2024-04-26T16:55:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:32 smithi110 ceph-mon[28069]: pgmap v10195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18447.167901 secs 2024-04-26T16:55:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:34 smithi193 ceph-mon[32782]: pgmap v10196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:34 smithi196 ceph-mon[32572]: pgmap v10196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:34 smithi110 ceph-mon[28069]: pgmap v10196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:36 smithi196 ceph-mon[32572]: pgmap v10197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:36 smithi110 ceph-mon[28069]: pgmap v10197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:36 smithi193 ceph-mon[32782]: pgmap v10197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:37.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18452.168018 secs 2024-04-26T16:55:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18452.168018 secs 2024-04-26T16:55:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18452.168018 secs 2024-04-26T16:55:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:38 smithi196 ceph-mon[32572]: pgmap v10198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:38 smithi110 ceph-mon[28069]: pgmap v10198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:38 smithi193 ceph-mon[32782]: pgmap v10198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:40 smithi196 ceph-mon[32572]: pgmap v10199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:40 smithi110 ceph-mon[28069]: pgmap v10199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:40 smithi193 ceph-mon[32782]: pgmap v10199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:42 smithi196 ceph-mon[32572]: pgmap v10200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18457.168114 secs 2024-04-26T16:55:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:42 smithi110 ceph-mon[28069]: pgmap v10200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18457.168114 secs 2024-04-26T16:55:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:42 smithi193 ceph-mon[32782]: pgmap v10200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18457.168114 secs 2024-04-26T16:55:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:44 smithi196 ceph-mon[32572]: pgmap v10201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:44 smithi110 ceph-mon[28069]: pgmap v10201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:44 smithi193 ceph-mon[32782]: pgmap v10201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:46 smithi196 ceph-mon[32572]: pgmap v10202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:46 smithi110 ceph-mon[28069]: pgmap v10202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:46 smithi193 ceph-mon[32782]: pgmap v10202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18462.168231 secs 2024-04-26T16:55:47.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18462.168231 secs 2024-04-26T16:55:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18462.168231 secs 2024-04-26T16:55:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:48 smithi196 ceph-mon[32572]: pgmap v10203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:48 smithi110 ceph-mon[28069]: pgmap v10203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:48 smithi193 ceph-mon[32782]: pgmap v10203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:50 smithi196 ceph-mon[32572]: pgmap v10204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:50 smithi110 ceph-mon[28069]: pgmap v10204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:50 smithi193 ceph-mon[32782]: pgmap v10204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:52 smithi196 ceph-mon[32572]: pgmap v10205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18467.168348 secs 2024-04-26T16:55:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:52 smithi110 ceph-mon[28069]: pgmap v10205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18467.168348 secs 2024-04-26T16:55:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:52 smithi193 ceph-mon[32782]: pgmap v10205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18467.168348 secs 2024-04-26T16:55:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:54 smithi196 ceph-mon[32572]: pgmap v10206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:54 smithi110 ceph-mon[28069]: pgmap v10206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:54 smithi193 ceph-mon[32782]: pgmap v10206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:56 smithi196 ceph-mon[32572]: pgmap v10207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:56 smithi110 ceph-mon[28069]: pgmap v10207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:56 smithi193 ceph-mon[32782]: pgmap v10207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18472.168470 secs 2024-04-26T16:55:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18472.168470 secs 2024-04-26T16:55:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18472.168470 secs 2024-04-26T16:55:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:58 smithi196 ceph-mon[32572]: pgmap v10208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:58 smithi110 ceph-mon[28069]: pgmap v10208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:58 smithi193 ceph-mon[32782]: pgmap v10208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:55:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:55:59 smithi196 ceph-mon[32572]: pgmap v10209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:55:59 smithi110 ceph-mon[28069]: pgmap v10209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:55:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:55:59 smithi193 ceph-mon[32782]: pgmap v10209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:01 smithi193 ceph-mon[32782]: pgmap v10210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:01 smithi196 ceph-mon[32572]: pgmap v10210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:01 smithi110 ceph-mon[28069]: pgmap v10210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18477.168610 secs 2024-04-26T16:56:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18477.168610 secs 2024-04-26T16:56:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18477.168610 secs 2024-04-26T16:56:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:03 smithi193 ceph-mon[32782]: pgmap v10211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:03 smithi196 ceph-mon[32572]: pgmap v10211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:03 smithi110 ceph-mon[28069]: pgmap v10211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:05 smithi193 ceph-mon[32782]: pgmap v10212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:05 smithi196 ceph-mon[32572]: pgmap v10212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:05 smithi110 ceph-mon[28069]: pgmap v10212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18482.168772 secs 2024-04-26T16:56:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:07 smithi196 ceph-mon[32572]: pgmap v10213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18482.168772 secs 2024-04-26T16:56:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:07 smithi110 ceph-mon[28069]: pgmap v10213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18482.168772 secs 2024-04-26T16:56:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:07 smithi193 ceph-mon[32782]: pgmap v10213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:09 smithi196 ceph-mon[32572]: pgmap v10214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:09 smithi110 ceph-mon[28069]: pgmap v10214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:09 smithi193 ceph-mon[32782]: pgmap v10214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:11 smithi196 ceph-mon[32572]: pgmap v10215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:11 smithi110 ceph-mon[28069]: pgmap v10215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:11 smithi193 ceph-mon[32782]: pgmap v10215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18487.168886 secs 2024-04-26T16:56:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18487.168886 secs 2024-04-26T16:56:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18487.168886 secs 2024-04-26T16:56:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:13 smithi196 ceph-mon[32572]: pgmap v10216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:13 smithi110 ceph-mon[28069]: pgmap v10216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:13 smithi193 ceph-mon[32782]: pgmap v10216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:15 smithi196 ceph-mon[32572]: pgmap v10217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:15 smithi110 ceph-mon[28069]: pgmap v10217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:15 smithi193 ceph-mon[32782]: pgmap v10217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:18.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18492.168949 secs 2024-04-26T16:56:18.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:17 smithi193 ceph-mon[32782]: pgmap v10218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:18.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:56:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18492.168949 secs 2024-04-26T16:56:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:17 smithi196 ceph-mon[32572]: pgmap v10218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:56:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18492.168949 secs 2024-04-26T16:56:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:17 smithi110 ceph-mon[28069]: pgmap v10218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:56:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:56:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:56:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:18 smithi196 ceph-mon[32572]: pgmap v10219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:56:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:18 smithi196 ceph-mon[32572]: pgmap v10220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:56:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:56:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:56:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:18 smithi110 ceph-mon[28069]: pgmap v10219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:56:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:18 smithi110 ceph-mon[28069]: pgmap v10220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:56:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:56:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:56:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:18 smithi193 ceph-mon[32782]: pgmap v10219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T16:56:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:18 smithi193 ceph-mon[32782]: pgmap v10220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:56:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:21 smithi110 ceph-mon[28069]: pgmap v10221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:21 smithi193 ceph-mon[32782]: pgmap v10221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:21 smithi196 ceph-mon[32572]: pgmap v10221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18497.169043 secs 2024-04-26T16:56:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18497.169043 secs 2024-04-26T16:56:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18497.169043 secs 2024-04-26T16:56:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:23 smithi193 ceph-mon[32782]: pgmap v10222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T16:56:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:23 smithi196 ceph-mon[32572]: pgmap v10222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T16:56:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:23 smithi110 ceph-mon[28069]: pgmap v10222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T16:56:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:25 smithi193 ceph-mon[32782]: pgmap v10223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:25 smithi196 ceph-mon[32572]: pgmap v10223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:25 smithi110 ceph-mon[28069]: pgmap v10223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:27 smithi193 ceph-mon[32782]: pgmap v10224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18502.169119 secs 2024-04-26T16:56:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:27 smithi196 ceph-mon[32572]: pgmap v10224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18502.169119 secs 2024-04-26T16:56:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:27 smithi110 ceph-mon[28069]: pgmap v10224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:56:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18502.169119 secs 2024-04-26T16:56:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:29 smithi193 ceph-mon[32782]: pgmap v10225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:56:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:29 smithi196 ceph-mon[32572]: pgmap v10225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:56:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:29 smithi110 ceph-mon[28069]: pgmap v10225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:56:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:31 smithi193 ceph-mon[32782]: pgmap v10226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:31 smithi196 ceph-mon[32572]: pgmap v10226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:31 smithi110 ceph-mon[28069]: pgmap v10226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18507.169180 secs 2024-04-26T16:56:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18507.169180 secs 2024-04-26T16:56:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18507.169180 secs 2024-04-26T16:56:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:33 smithi193 ceph-mon[32782]: pgmap v10227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:33 smithi196 ceph-mon[32572]: pgmap v10227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:33 smithi110 ceph-mon[28069]: pgmap v10227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:35 smithi193 ceph-mon[32782]: pgmap v10228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:35 smithi196 ceph-mon[32572]: pgmap v10228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:35 smithi110 ceph-mon[28069]: pgmap v10228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:37 smithi193 ceph-mon[32782]: pgmap v10229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18512.169244 secs 2024-04-26T16:56:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:37 smithi196 ceph-mon[32572]: pgmap v10229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18512.169244 secs 2024-04-26T16:56:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:37 smithi110 ceph-mon[28069]: pgmap v10229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18512.169244 secs 2024-04-26T16:56:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:39 smithi193 ceph-mon[32782]: pgmap v10230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:39 smithi196 ceph-mon[32572]: pgmap v10230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:39 smithi110 ceph-mon[28069]: pgmap v10230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:41 smithi193 ceph-mon[32782]: pgmap v10231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:41 smithi196 ceph-mon[32572]: pgmap v10231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:41 smithi110 ceph-mon[28069]: pgmap v10231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18517.169400 secs 2024-04-26T16:56:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18517.169400 secs 2024-04-26T16:56:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18517.169400 secs 2024-04-26T16:56:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:43 smithi193 ceph-mon[32782]: pgmap v10232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:43 smithi196 ceph-mon[32572]: pgmap v10232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:43 smithi110 ceph-mon[28069]: pgmap v10232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:45 smithi196 ceph-mon[32572]: pgmap v10233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:45 smithi110 ceph-mon[28069]: pgmap v10233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:45 smithi193 ceph-mon[32782]: pgmap v10233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:47 smithi196 ceph-mon[32572]: pgmap v10234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18522.169514 secs 2024-04-26T16:56:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:47 smithi110 ceph-mon[28069]: pgmap v10234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18522.169514 secs 2024-04-26T16:56:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:47 smithi193 ceph-mon[32782]: pgmap v10234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18522.169514 secs 2024-04-26T16:56:49.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:49 smithi193 ceph-mon[32782]: pgmap v10235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:49 smithi196 ceph-mon[32572]: pgmap v10235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:49 smithi110 ceph-mon[28069]: pgmap v10235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:51 smithi196 ceph-mon[32572]: pgmap v10236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:51 smithi110 ceph-mon[28069]: pgmap v10236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:51 smithi193 ceph-mon[32782]: pgmap v10236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18527.169635 secs 2024-04-26T16:56:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18527.169635 secs 2024-04-26T16:56:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18527.169635 secs 2024-04-26T16:56:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:53 smithi196 ceph-mon[32572]: pgmap v10237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:53 smithi110 ceph-mon[28069]: pgmap v10237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:53 smithi193 ceph-mon[32782]: pgmap v10237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:55 smithi196 ceph-mon[32572]: pgmap v10238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:55 smithi110 ceph-mon[28069]: pgmap v10238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:55 smithi193 ceph-mon[32782]: pgmap v10238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:57 smithi196 ceph-mon[32572]: pgmap v10239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18532.169752 secs 2024-04-26T16:56:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:57 smithi110 ceph-mon[28069]: pgmap v10239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18532.169752 secs 2024-04-26T16:56:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:57 smithi193 ceph-mon[32782]: pgmap v10239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:56:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18532.169752 secs 2024-04-26T16:56:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:56:59 smithi196 ceph-mon[32572]: pgmap v10240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:56:59 smithi110 ceph-mon[28069]: pgmap v10240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:56:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:56:59 smithi193 ceph-mon[32782]: pgmap v10240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:01 smithi196 ceph-mon[32572]: pgmap v10241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:01 smithi110 ceph-mon[28069]: pgmap v10241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:01 smithi193 ceph-mon[32782]: pgmap v10241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18537.169850 secs 2024-04-26T16:57:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18537.169850 secs 2024-04-26T16:57:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18537.169850 secs 2024-04-26T16:57:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:03 smithi196 ceph-mon[32572]: pgmap v10242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:03 smithi110 ceph-mon[28069]: pgmap v10242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:03 smithi193 ceph-mon[32782]: pgmap v10242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:05 smithi196 ceph-mon[32572]: pgmap v10243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:05 smithi110 ceph-mon[28069]: pgmap v10243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:05 smithi193 ceph-mon[32782]: pgmap v10243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:07 smithi196 ceph-mon[32572]: pgmap v10244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18542.169916 secs 2024-04-26T16:57:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:07 smithi110 ceph-mon[28069]: pgmap v10244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18542.169916 secs 2024-04-26T16:57:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:07 smithi193 ceph-mon[32782]: pgmap v10244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18542.169916 secs 2024-04-26T16:57:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:09 smithi196 ceph-mon[32572]: pgmap v10245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:09 smithi110 ceph-mon[28069]: pgmap v10245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:09 smithi193 ceph-mon[32782]: pgmap v10245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:11 smithi196 ceph-mon[32572]: pgmap v10246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:11 smithi110 ceph-mon[28069]: pgmap v10246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:11 smithi193 ceph-mon[32782]: pgmap v10246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 18547.170055 secs 2024-04-26T16:57:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:12 smithi196 ceph-mon[32572]: slow request 2883.555880 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:57:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 18547.170055 secs 2024-04-26T16:57:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:12 smithi110 ceph-mon[28069]: slow request 2883.555880 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:57:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 18547.170055 secs 2024-04-26T16:57:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:12 smithi193 ceph-mon[32782]: slow request 2883.555880 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T16:57:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:13 smithi196 ceph-mon[32572]: pgmap v10247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:13 smithi110 ceph-mon[28069]: pgmap v10247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:13.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:13 smithi193 ceph-mon[32782]: pgmap v10247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:14 smithi110 ceph-mon[28069]: pgmap v10248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:14 smithi193 ceph-mon[32782]: pgmap v10248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:14 smithi196 ceph-mon[32572]: pgmap v10248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:17 smithi193 ceph-mon[32782]: pgmap v10249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18552.170169 secs 2024-04-26T16:57:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:17 smithi196 ceph-mon[32572]: pgmap v10249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18552.170169 secs 2024-04-26T16:57:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:17 smithi110 ceph-mon[28069]: pgmap v10249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18552.170169 secs 2024-04-26T16:57:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:57:19.431+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T16:57:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:57:19.431+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T16:57:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:57:19.432+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 145 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T16:57:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T16:57:19.432+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 145 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T16:57:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:19 smithi193 ceph-mon[32782]: pgmap v10250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:57:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:19 smithi196 ceph-mon[32572]: pgmap v10250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:57:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:19 smithi110 ceph-mon[28069]: pgmap v10250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:57:21.459 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:21 smithi196 ceph-mon[32572]: pgmap v10251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:21.562 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:21 smithi193 ceph-mon[32782]: pgmap v10251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:21 smithi110 ceph-mon[28069]: pgmap v10251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:22.534 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18557.170264 secs 2024-04-26T16:57:22.592 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18557.170264 secs 2024-04-26T16:57:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18557.170264 secs 2024-04-26T16:57:23.337 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:23 smithi193 ceph-mon[32782]: pgmap v10252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:23.338 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.338 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.338 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.338 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.338 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:57:23.338 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:57:23.338 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:23 smithi196 ceph-mon[32572]: pgmap v10252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:23 smithi110 ceph-mon[28069]: pgmap v10252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:57:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:57:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:57:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:24 smithi193 ceph-mon[32782]: pgmap v10253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T16:57:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:24 smithi193 ceph-mon[32782]: pgmap v10254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:24 smithi196 ceph-mon[32572]: pgmap v10253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T16:57:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:24 smithi196 ceph-mon[32572]: pgmap v10254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:24 smithi110 ceph-mon[28069]: pgmap v10253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T16:57:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:24 smithi110 ceph-mon[28069]: pgmap v10254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:26 smithi193 ceph-mon[32782]: pgmap v10255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:26 smithi196 ceph-mon[32572]: pgmap v10255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:26 smithi110 ceph-mon[28069]: pgmap v10255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18562.170398 secs 2024-04-26T16:57:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18562.170398 secs 2024-04-26T16:57:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18562.170398 secs 2024-04-26T16:57:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:28 smithi193 ceph-mon[32782]: pgmap v10256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 582 B/s rd, 1 op/s 2024-04-26T16:57:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:28 smithi196 ceph-mon[32572]: pgmap v10256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 582 B/s rd, 1 op/s 2024-04-26T16:57:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:28 smithi110 ceph-mon[28069]: pgmap v10256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 582 B/s rd, 1 op/s 2024-04-26T16:57:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:30 smithi193 ceph-mon[32782]: pgmap v10257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:30 smithi196 ceph-mon[32572]: pgmap v10257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:30 smithi110 ceph-mon[28069]: pgmap v10257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:32 smithi193 ceph-mon[32782]: pgmap v10258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18567.170499 secs 2024-04-26T16:57:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:32 smithi196 ceph-mon[32572]: pgmap v10258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18567.170499 secs 2024-04-26T16:57:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:32 smithi110 ceph-mon[28069]: pgmap v10258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:57:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18567.170499 secs 2024-04-26T16:57:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:34 smithi196 ceph-mon[32572]: pgmap v10259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:57:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:34 smithi110 ceph-mon[28069]: pgmap v10259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:57:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:34 smithi193 ceph-mon[32782]: pgmap v10259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:57:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:36 smithi196 ceph-mon[32572]: pgmap v10260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:36 smithi110 ceph-mon[28069]: pgmap v10260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:36 smithi193 ceph-mon[32782]: pgmap v10260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18572.170600 secs 2024-04-26T16:57:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18572.170600 secs 2024-04-26T16:57:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18572.170600 secs 2024-04-26T16:57:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:38 smithi196 ceph-mon[32572]: pgmap v10261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:38 smithi110 ceph-mon[28069]: pgmap v10261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:38 smithi193 ceph-mon[32782]: pgmap v10261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:40 smithi196 ceph-mon[32572]: pgmap v10262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:40 smithi110 ceph-mon[28069]: pgmap v10262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:40 smithi193 ceph-mon[32782]: pgmap v10262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:42 smithi196 ceph-mon[32572]: pgmap v10263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18577.170684 secs 2024-04-26T16:57:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:42 smithi110 ceph-mon[28069]: pgmap v10263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18577.170684 secs 2024-04-26T16:57:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:42 smithi193 ceph-mon[32782]: pgmap v10263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18577.170684 secs 2024-04-26T16:57:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:44 smithi196 ceph-mon[32572]: pgmap v10264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:44 smithi110 ceph-mon[28069]: pgmap v10264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:44 smithi193 ceph-mon[32782]: pgmap v10264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:46 smithi196 ceph-mon[32572]: pgmap v10265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:46 smithi110 ceph-mon[28069]: pgmap v10265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:46 smithi193 ceph-mon[32782]: pgmap v10265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18582.170800 secs 2024-04-26T16:57:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18582.170800 secs 2024-04-26T16:57:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18582.170800 secs 2024-04-26T16:57:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:48 smithi196 ceph-mon[32572]: pgmap v10266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:48 smithi110 ceph-mon[28069]: pgmap v10266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:48 smithi193 ceph-mon[32782]: pgmap v10266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:50 smithi196 ceph-mon[32572]: pgmap v10267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:50 smithi110 ceph-mon[28069]: pgmap v10267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:50 smithi193 ceph-mon[32782]: pgmap v10267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:52 smithi196 ceph-mon[32572]: pgmap v10268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18587.170920 secs 2024-04-26T16:57:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:52 smithi110 ceph-mon[28069]: pgmap v10268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18587.170920 secs 2024-04-26T16:57:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:52 smithi193 ceph-mon[32782]: pgmap v10268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18587.170920 secs 2024-04-26T16:57:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:54 smithi196 ceph-mon[32572]: pgmap v10269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:54 smithi110 ceph-mon[28069]: pgmap v10269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:54 smithi193 ceph-mon[32782]: pgmap v10269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:57:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:56 smithi196 ceph-mon[32572]: pgmap v10270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:56 smithi110 ceph-mon[28069]: pgmap v10270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:56 smithi193 ceph-mon[32782]: pgmap v10270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18592.171042 secs 2024-04-26T16:57:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18592.171042 secs 2024-04-26T16:57:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18592.171042 secs 2024-04-26T16:57:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:57:58 smithi196 ceph-mon[32572]: pgmap v10271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:57:58 smithi110 ceph-mon[28069]: pgmap v10271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:57:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:57:58 smithi193 ceph-mon[32782]: pgmap v10271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:00 smithi196 ceph-mon[32572]: pgmap v10272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:00 smithi110 ceph-mon[28069]: pgmap v10272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:00 smithi193 ceph-mon[32782]: pgmap v10272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:02 smithi196 ceph-mon[32572]: pgmap v10273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18597.171104 secs 2024-04-26T16:58:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:02 smithi110 ceph-mon[28069]: pgmap v10273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18597.171104 secs 2024-04-26T16:58:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:02 smithi193 ceph-mon[32782]: pgmap v10273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18597.171104 secs 2024-04-26T16:58:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:04 smithi196 ceph-mon[32572]: pgmap v10274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:04 smithi110 ceph-mon[28069]: pgmap v10274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:04 smithi193 ceph-mon[32782]: pgmap v10274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:06 smithi196 ceph-mon[32572]: pgmap v10275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:06 smithi110 ceph-mon[28069]: pgmap v10275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:06 smithi193 ceph-mon[32782]: pgmap v10275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18602.171214 secs 2024-04-26T16:58:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18602.171214 secs 2024-04-26T16:58:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18602.171214 secs 2024-04-26T16:58:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:08 smithi196 ceph-mon[32572]: pgmap v10276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:08 smithi110 ceph-mon[28069]: pgmap v10276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:08 smithi193 ceph-mon[32782]: pgmap v10276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:09 smithi196 ceph-mon[32572]: pgmap v10277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:09 smithi110 ceph-mon[28069]: pgmap v10277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:09 smithi193 ceph-mon[32782]: pgmap v10277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:12 smithi193 ceph-mon[32782]: pgmap v10278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18607.171331 secs 2024-04-26T16:58:12.493 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:12 smithi110 ceph-mon[28069]: pgmap v10278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:12.493 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18607.171331 secs 2024-04-26T16:58:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:12 smithi196 ceph-mon[32572]: pgmap v10278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18607.171331 secs 2024-04-26T16:58:14.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:14 smithi196 ceph-mon[32572]: pgmap v10279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:14 smithi110 ceph-mon[28069]: pgmap v10279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:14 smithi193 ceph-mon[32782]: pgmap v10279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:16 smithi196 ceph-mon[32572]: pgmap v10280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:16 smithi110 ceph-mon[28069]: pgmap v10280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:16 smithi193 ceph-mon[32782]: pgmap v10280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18612.171419 secs 2024-04-26T16:58:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18612.171419 secs 2024-04-26T16:58:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18612.171419 secs 2024-04-26T16:58:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:18 smithi196 ceph-mon[32572]: pgmap v10281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:18 smithi110 ceph-mon[28069]: pgmap v10281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:18 smithi193 ceph-mon[32782]: pgmap v10281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:20.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:20 smithi193 ceph-mon[32782]: pgmap v10282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:20 smithi196 ceph-mon[32572]: pgmap v10282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:20 smithi110 ceph-mon[28069]: pgmap v10282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:22 smithi196 ceph-mon[32572]: pgmap v10283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18617.171554 secs 2024-04-26T16:58:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:22 smithi110 ceph-mon[28069]: pgmap v10283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18617.171554 secs 2024-04-26T16:58:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:22 smithi193 ceph-mon[32782]: pgmap v10283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18617.171554 secs 2024-04-26T16:58:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:24 smithi196 ceph-mon[32572]: pgmap v10284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:58:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:24 smithi110 ceph-mon[28069]: pgmap v10284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:58:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:24 smithi193 ceph-mon[32782]: pgmap v10284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:58:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:58:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:58:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:58:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:58:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:58:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:58:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:58:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:58:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:58:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:26 smithi196 ceph-mon[32572]: pgmap v10285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:58:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:26 smithi196 ceph-mon[32572]: pgmap v10286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:26 smithi110 ceph-mon[28069]: pgmap v10285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:58:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:26 smithi110 ceph-mon[28069]: pgmap v10286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:26 smithi193 ceph-mon[32782]: pgmap v10285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T16:58:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:26 smithi193 ceph-mon[32782]: pgmap v10286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18622.171650 secs 2024-04-26T16:58:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18622.171650 secs 2024-04-26T16:58:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18622.171650 secs 2024-04-26T16:58:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:28 smithi196 ceph-mon[32572]: pgmap v10287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:28 smithi110 ceph-mon[28069]: pgmap v10287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:28 smithi193 ceph-mon[32782]: pgmap v10287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:30 smithi196 ceph-mon[32572]: pgmap v10288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:30 smithi110 ceph-mon[28069]: pgmap v10288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:30 smithi193 ceph-mon[32782]: pgmap v10288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:32 smithi196 ceph-mon[32572]: pgmap v10289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18627.171768 secs 2024-04-26T16:58:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:32 smithi110 ceph-mon[28069]: pgmap v10289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18627.171768 secs 2024-04-26T16:58:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:32 smithi193 ceph-mon[32782]: pgmap v10289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18627.171768 secs 2024-04-26T16:58:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:34 smithi196 ceph-mon[32572]: pgmap v10290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:34 smithi110 ceph-mon[28069]: pgmap v10290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:34 smithi193 ceph-mon[32782]: pgmap v10290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T16:58:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:36 smithi196 ceph-mon[32572]: pgmap v10291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:58:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:36 smithi110 ceph-mon[28069]: pgmap v10291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:58:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:36 smithi193 ceph-mon[32782]: pgmap v10291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:58:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18632.171874 secs 2024-04-26T16:58:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18632.171874 secs 2024-04-26T16:58:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18632.171874 secs 2024-04-26T16:58:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:38 smithi196 ceph-mon[32572]: pgmap v10292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:38 smithi110 ceph-mon[28069]: pgmap v10292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:38 smithi193 ceph-mon[32782]: pgmap v10292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:40 smithi196 ceph-mon[32572]: pgmap v10293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:40 smithi110 ceph-mon[28069]: pgmap v10293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:40 smithi193 ceph-mon[32782]: pgmap v10293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:42 smithi196 ceph-mon[32572]: pgmap v10294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18637.171996 secs 2024-04-26T16:58:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:42 smithi110 ceph-mon[28069]: pgmap v10294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18637.171996 secs 2024-04-26T16:58:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:42 smithi193 ceph-mon[32782]: pgmap v10294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18637.171996 secs 2024-04-26T16:58:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:44 smithi196 ceph-mon[32572]: pgmap v10295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:44 smithi110 ceph-mon[28069]: pgmap v10295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:44 smithi193 ceph-mon[32782]: pgmap v10295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:46 smithi196 ceph-mon[32572]: pgmap v10296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:46 smithi110 ceph-mon[28069]: pgmap v10296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:46 smithi193 ceph-mon[32782]: pgmap v10296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18642.172110 secs 2024-04-26T16:58:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18642.172110 secs 2024-04-26T16:58:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18642.172110 secs 2024-04-26T16:58:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:48 smithi196 ceph-mon[32572]: pgmap v10297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:48 smithi110 ceph-mon[28069]: pgmap v10297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:48 smithi193 ceph-mon[32782]: pgmap v10297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:50 smithi110 ceph-mon[28069]: pgmap v10298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:50 smithi193 ceph-mon[32782]: pgmap v10298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:50 smithi196 ceph-mon[32572]: pgmap v10298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:52 smithi110 ceph-mon[28069]: pgmap v10299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18647.172195 secs 2024-04-26T16:58:52.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:52 smithi196 ceph-mon[32572]: pgmap v10299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:52.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18647.172195 secs 2024-04-26T16:58:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:52 smithi193 ceph-mon[32782]: pgmap v10299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18647.172195 secs 2024-04-26T16:58:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:54 smithi110 ceph-mon[28069]: pgmap v10300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:54 smithi193 ceph-mon[32782]: pgmap v10300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:54 smithi196 ceph-mon[32572]: pgmap v10300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:58:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:56 smithi110 ceph-mon[28069]: pgmap v10301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:56 smithi193 ceph-mon[32782]: pgmap v10301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:56 smithi196 ceph-mon[32572]: pgmap v10301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18652.172272 secs 2024-04-26T16:58:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18652.172272 secs 2024-04-26T16:58:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18652.172272 secs 2024-04-26T16:58:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:58:58 smithi110 ceph-mon[28069]: pgmap v10302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:58:58 smithi193 ceph-mon[32782]: pgmap v10302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:58:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:58:58 smithi196 ceph-mon[32572]: pgmap v10302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:00 smithi110 ceph-mon[28069]: pgmap v10303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:00 smithi193 ceph-mon[32782]: pgmap v10303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:00 smithi196 ceph-mon[32572]: pgmap v10303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:02 smithi193 ceph-mon[32782]: pgmap v10304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18657.172389 secs 2024-04-26T16:59:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:02 smithi196 ceph-mon[32572]: pgmap v10304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18657.172389 secs 2024-04-26T16:59:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:02 smithi110 ceph-mon[28069]: pgmap v10304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18657.172389 secs 2024-04-26T16:59:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:04 smithi193 ceph-mon[32782]: pgmap v10305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:04 smithi196 ceph-mon[32572]: pgmap v10305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:04 smithi110 ceph-mon[28069]: pgmap v10305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:06 smithi193 ceph-mon[32782]: pgmap v10306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:06 smithi196 ceph-mon[32572]: pgmap v10306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:06 smithi110 ceph-mon[28069]: pgmap v10306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18662.172458 secs 2024-04-26T16:59:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18662.172458 secs 2024-04-26T16:59:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18662.172458 secs 2024-04-26T16:59:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:08 smithi193 ceph-mon[32782]: pgmap v10307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:08 smithi196 ceph-mon[32572]: pgmap v10307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:08 smithi110 ceph-mon[28069]: pgmap v10307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:09.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:59:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:59:09.301+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:59:09.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:59:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:59:09.301+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:59:09.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:59:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:59:09.301+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:59:09.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:59:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:59:09.301+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:59:09.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 16:59:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T16:59:09.301+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T16:59:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:10 smithi193 ceph-mon[32782]: pgmap v10308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:10 smithi196 ceph-mon[32572]: pgmap v10308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:10 smithi110 ceph-mon[28069]: pgmap v10308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:12.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:12 smithi110 ceph-mon[28069]: pgmap v10309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:12.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18667.172611 secs 2024-04-26T16:59:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:12 smithi193 ceph-mon[32782]: pgmap v10309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18667.172611 secs 2024-04-26T16:59:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:12 smithi196 ceph-mon[32572]: pgmap v10309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18667.172611 secs 2024-04-26T16:59:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:14 smithi193 ceph-mon[32782]: pgmap v10310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:14 smithi196 ceph-mon[32572]: pgmap v10310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:14 smithi110 ceph-mon[28069]: pgmap v10310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:16 smithi193 ceph-mon[32782]: pgmap v10311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:16 smithi196 ceph-mon[32572]: pgmap v10311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:16 smithi110 ceph-mon[28069]: pgmap v10311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18672.172700 secs 2024-04-26T16:59:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18672.172700 secs 2024-04-26T16:59:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18672.172700 secs 2024-04-26T16:59:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:18 smithi193 ceph-mon[32782]: pgmap v10312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:18 smithi196 ceph-mon[32572]: pgmap v10312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:18 smithi110 ceph-mon[28069]: pgmap v10312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:20 smithi193 ceph-mon[32782]: pgmap v10313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:20 smithi196 ceph-mon[32572]: pgmap v10313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:20 smithi110 ceph-mon[28069]: pgmap v10313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:22 smithi196 ceph-mon[32572]: pgmap v10314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18677.172800 secs 2024-04-26T16:59:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:22 smithi110 ceph-mon[28069]: pgmap v10314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18677.172800 secs 2024-04-26T16:59:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:22 smithi193 ceph-mon[32782]: pgmap v10314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18677.172800 secs 2024-04-26T16:59:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:24 smithi196 ceph-mon[32572]: pgmap v10315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:24 smithi110 ceph-mon[28069]: pgmap v10315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:24 smithi193 ceph-mon[32782]: pgmap v10315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:59:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:59:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T16:59:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:26 smithi196 ceph-mon[32572]: pgmap v10316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:59:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:26 smithi110 ceph-mon[28069]: pgmap v10316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:59:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:26 smithi193 ceph-mon[32782]: pgmap v10316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:59:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18682.172900 secs 2024-04-26T16:59:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18682.172900 secs 2024-04-26T16:59:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18682.172900 secs 2024-04-26T16:59:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:28 smithi110 ceph-mon[28069]: pgmap v10317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:59:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:28 smithi196 ceph-mon[32572]: pgmap v10317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:59:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:28 smithi193 ceph-mon[32782]: pgmap v10317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:59:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:30 smithi196 ceph-mon[32572]: pgmap v10318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:30 smithi110 ceph-mon[28069]: pgmap v10318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:30 smithi193 ceph-mon[32782]: pgmap v10318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:32 smithi196 ceph-mon[32572]: pgmap v10319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:59:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18687.172994 secs 2024-04-26T16:59:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:59:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:59:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:59:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:59:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:59:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:32 smithi110 ceph-mon[28069]: pgmap v10319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:59:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18687.172994 secs 2024-04-26T16:59:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:59:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:59:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:59:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:59:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:59:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:32 smithi193 ceph-mon[32782]: pgmap v10319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T16:59:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18687.172994 secs 2024-04-26T16:59:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:59:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:59:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T16:59:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T16:59:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T16:59:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:33 smithi196 ceph-mon[32572]: pgmap v10320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 826 B/s rd, 1 op/s 2024-04-26T16:59:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:33 smithi196 ceph-mon[32572]: pgmap v10321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 1 op/s 2024-04-26T16:59:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:33 smithi110 ceph-mon[28069]: pgmap v10320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 826 B/s rd, 1 op/s 2024-04-26T16:59:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:33 smithi110 ceph-mon[28069]: pgmap v10321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 1 op/s 2024-04-26T16:59:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:33 smithi193 ceph-mon[32782]: pgmap v10320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 826 B/s rd, 1 op/s 2024-04-26T16:59:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:33 smithi193 ceph-mon[32782]: pgmap v10321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 1 op/s 2024-04-26T16:59:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:35 smithi196 ceph-mon[32572]: pgmap v10322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:35 smithi110 ceph-mon[28069]: pgmap v10322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:35 smithi193 ceph-mon[32782]: pgmap v10322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:37 smithi196 ceph-mon[32572]: pgmap v10323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18692.173113 secs 2024-04-26T16:59:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:37 smithi110 ceph-mon[28069]: pgmap v10323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18692.173113 secs 2024-04-26T16:59:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:37 smithi193 ceph-mon[32782]: pgmap v10323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18692.173113 secs 2024-04-26T16:59:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:39 smithi196 ceph-mon[32572]: pgmap v10324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:39 smithi110 ceph-mon[28069]: pgmap v10324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:39 smithi193 ceph-mon[32782]: pgmap v10324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:41 smithi196 ceph-mon[32572]: pgmap v10325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:41 smithi110 ceph-mon[28069]: pgmap v10325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:41 smithi193 ceph-mon[32782]: pgmap v10325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T16:59:42.694 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18697.173232 secs 2024-04-26T16:59:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18697.173232 secs 2024-04-26T16:59:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18697.173232 secs 2024-04-26T16:59:43.731 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:43 smithi110 ceph-mon[28069]: pgmap v10326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:59:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:43 smithi196 ceph-mon[32572]: pgmap v10326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:59:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:43 smithi193 ceph-mon[32782]: pgmap v10326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T16:59:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:45 smithi196 ceph-mon[32572]: pgmap v10327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:45 smithi110 ceph-mon[28069]: pgmap v10327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:45 smithi193 ceph-mon[32782]: pgmap v10327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:47 smithi196 ceph-mon[32572]: pgmap v10328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18702.173382 secs 2024-04-26T16:59:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:47 smithi110 ceph-mon[28069]: pgmap v10328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18702.173382 secs 2024-04-26T16:59:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:47 smithi193 ceph-mon[32782]: pgmap v10328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18702.173382 secs 2024-04-26T16:59:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:49 smithi196 ceph-mon[32572]: pgmap v10329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:49 smithi110 ceph-mon[28069]: pgmap v10329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:49 smithi193 ceph-mon[32782]: pgmap v10329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:51 smithi196 ceph-mon[32572]: pgmap v10330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:51 smithi110 ceph-mon[28069]: pgmap v10330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:51 smithi193 ceph-mon[32782]: pgmap v10330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18707.173483 secs 2024-04-26T16:59:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18707.173483 secs 2024-04-26T16:59:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18707.173483 secs 2024-04-26T16:59:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:53 smithi196 ceph-mon[32572]: pgmap v10331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:53 smithi110 ceph-mon[28069]: pgmap v10331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:53 smithi193 ceph-mon[32782]: pgmap v10331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:55 smithi196 ceph-mon[32572]: pgmap v10332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:55 smithi110 ceph-mon[28069]: pgmap v10332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:55 smithi193 ceph-mon[32782]: pgmap v10332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:57 smithi196 ceph-mon[32572]: pgmap v10333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18712.173630 secs 2024-04-26T16:59:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:57 smithi110 ceph-mon[28069]: pgmap v10333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18712.173630 secs 2024-04-26T16:59:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:57 smithi193 ceph-mon[32782]: pgmap v10333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T16:59:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18712.173630 secs 2024-04-26T16:59:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 16:59:59 smithi196 ceph-mon[32572]: pgmap v10334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 16:59:59 smithi110 ceph-mon[28069]: pgmap v10334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T16:59:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 16:59:59 smithi193 ceph-mon[32782]: pgmap v10334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:00:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:00:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:00:01.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:01 smithi110 ceph-mon[28069]: pgmap v10335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:01 smithi193 ceph-mon[32782]: pgmap v10335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:01 smithi196 ceph-mon[32572]: pgmap v10335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18717.173755 secs 2024-04-26T17:00:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:02 smithi110 ceph-mon[28069]: pgmap v10336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18717.173755 secs 2024-04-26T17:00:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:02 smithi193 ceph-mon[32782]: pgmap v10336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18717.173755 secs 2024-04-26T17:00:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:02 smithi196 ceph-mon[32572]: pgmap v10336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:04 smithi193 ceph-mon[32782]: pgmap v10337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:04 smithi196 ceph-mon[32572]: pgmap v10337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:04 smithi110 ceph-mon[28069]: pgmap v10337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:06 smithi196 ceph-mon[32572]: pgmap v10338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:06 smithi110 ceph-mon[28069]: pgmap v10338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:06 smithi193 ceph-mon[32782]: pgmap v10338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18722.173874 secs 2024-04-26T17:00:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18722.173874 secs 2024-04-26T17:00:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18722.173874 secs 2024-04-26T17:00:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:08 smithi196 ceph-mon[32572]: pgmap v10339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:08 smithi110 ceph-mon[28069]: pgmap v10339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:08 smithi193 ceph-mon[32782]: pgmap v10339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:10 smithi196 ceph-mon[32572]: pgmap v10340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:10 smithi110 ceph-mon[28069]: pgmap v10340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:10 smithi193 ceph-mon[32782]: pgmap v10340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:13.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18727.173995 secs 2024-04-26T17:00:13.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:12 smithi196 ceph-mon[32572]: pgmap v10341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18727.173995 secs 2024-04-26T17:00:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:12 smithi110 ceph-mon[28069]: pgmap v10341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18727.173995 secs 2024-04-26T17:00:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:12 smithi193 ceph-mon[32782]: pgmap v10341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:14 smithi196 ceph-mon[32572]: pgmap v10342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:14 smithi110 ceph-mon[28069]: pgmap v10342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:14 smithi193 ceph-mon[32782]: pgmap v10342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:16 smithi196 ceph-mon[32572]: pgmap v10343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:16 smithi110 ceph-mon[28069]: pgmap v10343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:16 smithi193 ceph-mon[32782]: pgmap v10343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18732.174115 secs 2024-04-26T17:00:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18732.174115 secs 2024-04-26T17:00:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18732.174115 secs 2024-04-26T17:00:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:18 smithi196 ceph-mon[32572]: pgmap v10344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:18 smithi110 ceph-mon[28069]: pgmap v10344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:18 smithi193 ceph-mon[32782]: pgmap v10344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:00:19.462+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:00:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:00:19.462+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T17:00:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:00:19.462+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 146 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T17:00:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:00:19.462+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 146 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:00:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:20 smithi196 ceph-mon[32572]: pgmap v10345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:20 smithi110 ceph-mon[28069]: pgmap v10345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:20 smithi193 ceph-mon[32782]: pgmap v10345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18737.174258 secs 2024-04-26T17:00:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:22 smithi196 ceph-mon[32572]: pgmap v10346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18737.174258 secs 2024-04-26T17:00:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:22 smithi110 ceph-mon[28069]: pgmap v10346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18737.174258 secs 2024-04-26T17:00:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:22 smithi193 ceph-mon[32782]: pgmap v10346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:24 smithi196 ceph-mon[32572]: pgmap v10347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:24 smithi110 ceph-mon[28069]: pgmap v10347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:24 smithi193 ceph-mon[32782]: pgmap v10347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:26 smithi196 ceph-mon[32572]: pgmap v10348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:26 smithi110 ceph-mon[28069]: pgmap v10348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:26 smithi193 ceph-mon[32782]: pgmap v10348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18742.174379 secs 2024-04-26T17:00:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18742.174379 secs 2024-04-26T17:00:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18742.174379 secs 2024-04-26T17:00:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:28 smithi196 ceph-mon[32572]: pgmap v10349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:28 smithi110 ceph-mon[28069]: pgmap v10349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:28 smithi193 ceph-mon[32782]: pgmap v10349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:30 smithi196 ceph-mon[32572]: pgmap v10350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:30 smithi110 ceph-mon[28069]: pgmap v10350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:30 smithi193 ceph-mon[32782]: pgmap v10350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18747.174457 secs 2024-04-26T17:00:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:32 smithi196 ceph-mon[32572]: pgmap v10351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:00:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18747.174457 secs 2024-04-26T17:00:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:32 smithi110 ceph-mon[28069]: pgmap v10351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:00:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18747.174457 secs 2024-04-26T17:00:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:32 smithi193 ceph-mon[32782]: pgmap v10351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:00:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:00:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:00:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:33 smithi196 ceph-mon[32572]: pgmap v10352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:00:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:33 smithi196 ceph-mon[32572]: pgmap v10353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:00:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:00:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:00:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:33 smithi110 ceph-mon[28069]: pgmap v10352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:00:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:33 smithi110 ceph-mon[28069]: pgmap v10353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:34.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:00:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:00:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:00:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:33 smithi193 ceph-mon[32782]: pgmap v10352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:00:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:33 smithi193 ceph-mon[32782]: pgmap v10353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:00:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:36 smithi196 ceph-mon[32572]: pgmap v10354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:36 smithi110 ceph-mon[28069]: pgmap v10354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:36 smithi193 ceph-mon[32782]: pgmap v10354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18752.174578 secs 2024-04-26T17:00:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18752.174578 secs 2024-04-26T17:00:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18752.174578 secs 2024-04-26T17:00:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:38 smithi196 ceph-mon[32572]: pgmap v10355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:00:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:38 smithi110 ceph-mon[28069]: pgmap v10355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:00:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:38 smithi193 ceph-mon[32782]: pgmap v10355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:00:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:40 smithi196 ceph-mon[32572]: pgmap v10356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:40 smithi110 ceph-mon[28069]: pgmap v10356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:40 smithi193 ceph-mon[32782]: pgmap v10356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:41 smithi196 ceph-mon[32572]: pgmap v10357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:41 smithi110 ceph-mon[28069]: pgmap v10357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:41 smithi193 ceph-mon[32782]: pgmap v10357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:00:43.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18757.174693 secs 2024-04-26T17:00:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18757.174693 secs 2024-04-26T17:00:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18757.174693 secs 2024-04-26T17:00:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:43 smithi196 ceph-mon[32572]: pgmap v10358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:00:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:43 smithi110 ceph-mon[28069]: pgmap v10358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:00:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:43 smithi193 ceph-mon[32782]: pgmap v10358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:00:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:46 smithi196 ceph-mon[32572]: pgmap v10359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:46 smithi110 ceph-mon[28069]: pgmap v10359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:46 smithi193 ceph-mon[32782]: pgmap v10359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18762.174780 secs 2024-04-26T17:00:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18762.174780 secs 2024-04-26T17:00:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18762.174780 secs 2024-04-26T17:00:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:48 smithi196 ceph-mon[32572]: pgmap v10360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:48 smithi110 ceph-mon[28069]: pgmap v10360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:48 smithi193 ceph-mon[32782]: pgmap v10360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:50 smithi110 ceph-mon[28069]: pgmap v10361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:00:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:50 smithi193 ceph-mon[32782]: pgmap v10361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:00:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:50 smithi196 ceph-mon[32572]: pgmap v10361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:00:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:52 smithi110 ceph-mon[28069]: pgmap v10362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18767.174871 secs 2024-04-26T17:00:52.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:52 smithi196 ceph-mon[32572]: pgmap v10362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:52.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18767.174871 secs 2024-04-26T17:00:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:52 smithi193 ceph-mon[32782]: pgmap v10362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18767.174871 secs 2024-04-26T17:00:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:54 smithi110 ceph-mon[28069]: pgmap v10363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:54 smithi193 ceph-mon[32782]: pgmap v10363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:54 smithi196 ceph-mon[32572]: pgmap v10363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:55 smithi193 ceph-mon[32782]: pgmap v10364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:55 smithi196 ceph-mon[32572]: pgmap v10364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:55 smithi110 ceph-mon[28069]: pgmap v10364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:00:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18772.174934 secs 2024-04-26T17:00:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18772.174934 secs 2024-04-26T17:00:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18772.174934 secs 2024-04-26T17:00:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:00:58 smithi193 ceph-mon[32782]: pgmap v10365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:00:58 smithi196 ceph-mon[32572]: pgmap v10365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:00:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:00:58 smithi110 ceph-mon[28069]: pgmap v10365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:00 smithi196 ceph-mon[32572]: pgmap v10366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:01:00.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:00 smithi110 ceph-mon[28069]: pgmap v10366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:01:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:00 smithi193 ceph-mon[32782]: pgmap v10366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:01:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:02 smithi196 ceph-mon[32572]: pgmap v10367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18777.175013 secs 2024-04-26T17:01:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:02 smithi110 ceph-mon[28069]: pgmap v10367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18777.175013 secs 2024-04-26T17:01:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:02 smithi193 ceph-mon[32782]: pgmap v10367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18777.175013 secs 2024-04-26T17:01:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:04 smithi196 ceph-mon[32572]: pgmap v10368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:04 smithi110 ceph-mon[28069]: pgmap v10368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:04 smithi193 ceph-mon[32782]: pgmap v10368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:06 smithi110 ceph-mon[28069]: pgmap v10369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:06 smithi193 ceph-mon[32782]: pgmap v10369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:06 smithi196 ceph-mon[32572]: pgmap v10369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18782.175082 secs 2024-04-26T17:01:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18782.175082 secs 2024-04-26T17:01:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18782.175082 secs 2024-04-26T17:01:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:08 smithi110 ceph-mon[28069]: pgmap v10370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:08 smithi193 ceph-mon[32782]: pgmap v10370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:08 smithi196 ceph-mon[32572]: pgmap v10370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:09 smithi110 ceph-mon[28069]: pgmap v10371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:09 smithi193 ceph-mon[32782]: pgmap v10371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:09 smithi196 ceph-mon[32572]: pgmap v10371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:12 smithi196 ceph-mon[32572]: pgmap v10372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18787.175153 secs 2024-04-26T17:01:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:12 smithi110 ceph-mon[28069]: pgmap v10372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18787.175153 secs 2024-04-26T17:01:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:12 smithi193 ceph-mon[32782]: pgmap v10372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18787.175153 secs 2024-04-26T17:01:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:14 smithi196 ceph-mon[32572]: pgmap v10373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:14 smithi110 ceph-mon[28069]: pgmap v10373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:14 smithi193 ceph-mon[32782]: pgmap v10373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:16 smithi110 ceph-mon[28069]: pgmap v10374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:16 smithi193 ceph-mon[32782]: pgmap v10374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:16 smithi196 ceph-mon[32572]: pgmap v10374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18792.175249 secs 2024-04-26T17:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18792.175249 secs 2024-04-26T17:01:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18792.175249 secs 2024-04-26T17:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:18 smithi110 ceph-mon[28069]: pgmap v10375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:18 smithi193 ceph-mon[32782]: pgmap v10375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:18 smithi196 ceph-mon[32572]: pgmap v10375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:19 smithi110 ceph-mon[28069]: pgmap v10376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:19 smithi193 ceph-mon[32782]: pgmap v10376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:19 smithi196 ceph-mon[32572]: pgmap v10376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:22 smithi196 ceph-mon[32572]: pgmap v10377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18797.175397 secs 2024-04-26T17:01:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:22 smithi110 ceph-mon[28069]: pgmap v10377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18797.175397 secs 2024-04-26T17:01:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:22 smithi193 ceph-mon[32782]: pgmap v10377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18797.175397 secs 2024-04-26T17:01:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:24 smithi110 ceph-mon[28069]: pgmap v10378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:24 smithi193 ceph-mon[32782]: pgmap v10378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:24 smithi196 ceph-mon[32572]: pgmap v10378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:26 smithi110 ceph-mon[28069]: pgmap v10379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:26 smithi193 ceph-mon[32782]: pgmap v10379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:26 smithi196 ceph-mon[32572]: pgmap v10379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18802.175513 secs 2024-04-26T17:01:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18802.175513 secs 2024-04-26T17:01:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18802.175513 secs 2024-04-26T17:01:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:28 smithi110 ceph-mon[28069]: pgmap v10380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:28 smithi193 ceph-mon[32782]: pgmap v10380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:28 smithi196 ceph-mon[32572]: pgmap v10380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:29 smithi110 ceph-mon[28069]: pgmap v10381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:29 smithi193 ceph-mon[32782]: pgmap v10381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:29 smithi196 ceph-mon[32572]: pgmap v10381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:32 smithi110 ceph-mon[28069]: pgmap v10382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18807.175595 secs 2024-04-26T17:01:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:32 smithi193 ceph-mon[32782]: pgmap v10382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18807.175595 secs 2024-04-26T17:01:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:32 smithi196 ceph-mon[32572]: pgmap v10382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18807.175595 secs 2024-04-26T17:01:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:34 smithi110 ceph-mon[28069]: pgmap v10383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:01:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:34 smithi193 ceph-mon[32782]: pgmap v10383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:01:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:34 smithi196 ceph-mon[32572]: pgmap v10383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:01:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:01:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:01:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:35 smithi110 ceph-mon[28069]: pgmap v10384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:01:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:01:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:35 smithi193 ceph-mon[32782]: pgmap v10384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:01:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:01:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:35 smithi196 ceph-mon[32572]: pgmap v10384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:01:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:01:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:36 smithi193 ceph-mon[32782]: pgmap v10385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T17:01:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:36 smithi193 ceph-mon[32782]: pgmap v10386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T17:01:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:01:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:01:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:01:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:36 smithi196 ceph-mon[32572]: pgmap v10385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T17:01:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:36 smithi196 ceph-mon[32572]: pgmap v10386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T17:01:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:01:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:01:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:01:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:36 smithi110 ceph-mon[28069]: pgmap v10385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T17:01:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:36 smithi110 ceph-mon[28069]: pgmap v10386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T17:01:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:01:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18812.175656 secs 2024-04-26T17:01:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18812.175656 secs 2024-04-26T17:01:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18812.175656 secs 2024-04-26T17:01:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:38 smithi193 ceph-mon[32782]: pgmap v10387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:38 smithi196 ceph-mon[32572]: pgmap v10387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:38 smithi110 ceph-mon[28069]: pgmap v10387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:40 smithi196 ceph-mon[32572]: pgmap v10388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:40 smithi110 ceph-mon[28069]: pgmap v10388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:40 smithi193 ceph-mon[32782]: pgmap v10388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18817.175755 secs 2024-04-26T17:01:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:42 smithi196 ceph-mon[32572]: pgmap v10389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T17:01:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18817.175755 secs 2024-04-26T17:01:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:42 smithi110 ceph-mon[28069]: pgmap v10389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T17:01:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18817.175755 secs 2024-04-26T17:01:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:42 smithi193 ceph-mon[32782]: pgmap v10389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 611 B/s rd, 1 op/s 2024-04-26T17:01:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:44 smithi196 ceph-mon[32572]: pgmap v10390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:44 smithi110 ceph-mon[28069]: pgmap v10390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:44 smithi193 ceph-mon[32782]: pgmap v10390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:46 smithi196 ceph-mon[32572]: pgmap v10391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:01:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:46 smithi110 ceph-mon[28069]: pgmap v10391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:01:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:46 smithi193 ceph-mon[32782]: pgmap v10391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:01:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18822.175895 secs 2024-04-26T17:01:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18822.175895 secs 2024-04-26T17:01:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18822.175895 secs 2024-04-26T17:01:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:48 smithi196 ceph-mon[32572]: pgmap v10392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:48 smithi110 ceph-mon[28069]: pgmap v10392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:48 smithi193 ceph-mon[32782]: pgmap v10392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:01:49.476+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T17:01:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:01:49.476+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:01:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:01:49.477+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 147 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:01:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:01:49.478+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 147 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T17:01:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:50 smithi196 ceph-mon[32572]: pgmap v10393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:50 smithi110 ceph-mon[28069]: pgmap v10393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:50 smithi193 ceph-mon[32782]: pgmap v10393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:53.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18827.176023 secs 2024-04-26T17:01:53.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:52 smithi193 ceph-mon[32782]: pgmap v10394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18827.176023 secs 2024-04-26T17:01:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:52 smithi196 ceph-mon[32572]: pgmap v10394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18827.176023 secs 2024-04-26T17:01:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:52 smithi110 ceph-mon[28069]: pgmap v10394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:54 smithi196 ceph-mon[32572]: pgmap v10395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:54 smithi110 ceph-mon[28069]: pgmap v10395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:54 smithi193 ceph-mon[32782]: pgmap v10395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:56 smithi196 ceph-mon[32572]: pgmap v10396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:56 smithi110 ceph-mon[28069]: pgmap v10396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:56 smithi193 ceph-mon[32782]: pgmap v10396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:01:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18832.176115 secs 2024-04-26T17:01:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18832.176115 secs 2024-04-26T17:01:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18832.176115 secs 2024-04-26T17:01:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:01:58 smithi196 ceph-mon[32572]: pgmap v10397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:01:58 smithi110 ceph-mon[28069]: pgmap v10397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:01:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:01:58 smithi193 ceph-mon[32782]: pgmap v10397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:00 smithi196 ceph-mon[32572]: pgmap v10398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:00 smithi110 ceph-mon[28069]: pgmap v10398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:00 smithi193 ceph-mon[32782]: pgmap v10398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18837.176251 secs 2024-04-26T17:02:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:02 smithi196 ceph-mon[32572]: pgmap v10399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18837.176251 secs 2024-04-26T17:02:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:02 smithi110 ceph-mon[28069]: pgmap v10399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18837.176251 secs 2024-04-26T17:02:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:02 smithi193 ceph-mon[32782]: pgmap v10399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:04 smithi196 ceph-mon[32572]: pgmap v10400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:04 smithi110 ceph-mon[28069]: pgmap v10400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:04 smithi193 ceph-mon[32782]: pgmap v10400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:06 smithi196 ceph-mon[32572]: pgmap v10401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:06 smithi110 ceph-mon[28069]: pgmap v10401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:06 smithi193 ceph-mon[32782]: pgmap v10401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18842.176369 secs 2024-04-26T17:02:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18842.176369 secs 2024-04-26T17:02:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18842.176369 secs 2024-04-26T17:02:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:08 smithi196 ceph-mon[32572]: pgmap v10402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:08 smithi110 ceph-mon[28069]: pgmap v10402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:08 smithi193 ceph-mon[32782]: pgmap v10402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:10 smithi196 ceph-mon[32572]: pgmap v10403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:10 smithi110 ceph-mon[28069]: pgmap v10403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:10 smithi193 ceph-mon[32782]: pgmap v10403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18847.176471 secs 2024-04-26T17:02:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:12 smithi196 ceph-mon[32572]: pgmap v10404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18847.176471 secs 2024-04-26T17:02:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:12 smithi110 ceph-mon[28069]: pgmap v10404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18847.176471 secs 2024-04-26T17:02:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:12 smithi193 ceph-mon[32782]: pgmap v10404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:14 smithi196 ceph-mon[32572]: pgmap v10405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:14 smithi110 ceph-mon[28069]: pgmap v10405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:14 smithi193 ceph-mon[32782]: pgmap v10405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:16 smithi196 ceph-mon[32572]: pgmap v10406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:16 smithi110 ceph-mon[28069]: pgmap v10406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:16 smithi193 ceph-mon[32782]: pgmap v10406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:18 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18852.176556 secs 2024-04-26T17:02:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:18 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18852.176556 secs 2024-04-26T17:02:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:18 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18852.176556 secs 2024-04-26T17:02:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:19 smithi110 ceph-mon[28069]: pgmap v10407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:19 smithi193 ceph-mon[32782]: pgmap v10407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:19 smithi196 ceph-mon[32572]: pgmap v10407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:21.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:21 smithi110 ceph-mon[28069]: pgmap v10408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:21 smithi193 ceph-mon[32782]: pgmap v10408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:21 smithi196 ceph-mon[32572]: pgmap v10408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:23 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18857.176679 secs 2024-04-26T17:02:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:23 smithi110 ceph-mon[28069]: pgmap v10409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:23.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:23 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18857.176679 secs 2024-04-26T17:02:23.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:23 smithi196 ceph-mon[32572]: pgmap v10409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:23 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18857.176679 secs 2024-04-26T17:02:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:23 smithi193 ceph-mon[32782]: pgmap v10409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:25 smithi110 ceph-mon[28069]: pgmap v10410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:25 smithi193 ceph-mon[32782]: pgmap v10410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:25 smithi196 ceph-mon[32572]: pgmap v10410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:27 smithi110 ceph-mon[28069]: pgmap v10411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:27.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:27 smithi193 ceph-mon[32782]: pgmap v10411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:27 smithi196 ceph-mon[32572]: pgmap v10411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:28 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18862.176757 secs 2024-04-26T17:02:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:28 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18862.176757 secs 2024-04-26T17:02:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:28 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18862.176757 secs 2024-04-26T17:02:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:29 smithi193 ceph-mon[32782]: pgmap v10412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:29 smithi196 ceph-mon[32572]: pgmap v10412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:29 smithi110 ceph-mon[28069]: pgmap v10412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:31 smithi193 ceph-mon[32782]: pgmap v10413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:31 smithi196 ceph-mon[32572]: pgmap v10413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:31 smithi110 ceph-mon[28069]: pgmap v10413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18867.176853 secs 2024-04-26T17:02:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18867.176853 secs 2024-04-26T17:02:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18867.176853 secs 2024-04-26T17:02:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:33 smithi193 ceph-mon[32782]: pgmap v10414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:33 smithi196 ceph-mon[32572]: pgmap v10414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:33 smithi110 ceph-mon[28069]: pgmap v10414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:35 smithi193 ceph-mon[32782]: pgmap v10415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:35 smithi196 ceph-mon[32572]: pgmap v10415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:35 smithi110 ceph-mon[28069]: pgmap v10415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:37 smithi193 ceph-mon[32782]: pgmap v10416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:02:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18872.176937 secs 2024-04-26T17:02:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:37 smithi196 ceph-mon[32572]: pgmap v10416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:02:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18872.176937 secs 2024-04-26T17:02:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:37 smithi110 ceph-mon[28069]: pgmap v10416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:02:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18872.176937 secs 2024-04-26T17:02:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:02:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:02:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:38 smithi193 ceph-mon[32782]: pgmap v10417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:02:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:38 smithi193 ceph-mon[32782]: pgmap v10418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:02:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:02:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:38 smithi196 ceph-mon[32572]: pgmap v10417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:02:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:38 smithi196 ceph-mon[32572]: pgmap v10418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:02:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:02:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:38 smithi110 ceph-mon[28069]: pgmap v10417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:02:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:38 smithi110 ceph-mon[28069]: pgmap v10418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:02:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:40 smithi110 ceph-mon[28069]: pgmap v10419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:40 smithi193 ceph-mon[32782]: pgmap v10419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:40 smithi196 ceph-mon[32572]: pgmap v10419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:42 smithi110 ceph-mon[28069]: pgmap v10420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18877.177050 secs 2024-04-26T17:02:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:42 smithi193 ceph-mon[32782]: pgmap v10420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18877.177050 secs 2024-04-26T17:02:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:42 smithi196 ceph-mon[32572]: pgmap v10420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18877.177050 secs 2024-04-26T17:02:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:44 smithi110 ceph-mon[28069]: pgmap v10421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:44 smithi193 ceph-mon[32782]: pgmap v10421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:44 smithi196 ceph-mon[32572]: pgmap v10421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:46 smithi110 ceph-mon[28069]: pgmap v10422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:46 smithi193 ceph-mon[32782]: pgmap v10422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:46 smithi196 ceph-mon[32572]: pgmap v10422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:02:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18882.177166 secs 2024-04-26T17:02:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18882.177166 secs 2024-04-26T17:02:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18882.177166 secs 2024-04-26T17:02:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:48 smithi110 ceph-mon[28069]: pgmap v10423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:02:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:48 smithi193 ceph-mon[32782]: pgmap v10423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:02:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:48 smithi196 ceph-mon[32572]: pgmap v10423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:02:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:50 smithi110 ceph-mon[28069]: pgmap v10424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:50 smithi193 ceph-mon[32782]: pgmap v10424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:50 smithi196 ceph-mon[32572]: pgmap v10424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:51 smithi193 ceph-mon[32782]: pgmap v10425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:51 smithi196 ceph-mon[32572]: pgmap v10425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:51 smithi110 ceph-mon[28069]: pgmap v10425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18887.177300 secs 2024-04-26T17:02:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18887.177300 secs 2024-04-26T17:02:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18887.177300 secs 2024-04-26T17:02:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:53 smithi193 ceph-mon[32782]: pgmap v10426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:53.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:53 smithi196 ceph-mon[32572]: pgmap v10426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:53 smithi110 ceph-mon[28069]: pgmap v10426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:56 smithi110 ceph-mon[28069]: pgmap v10427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:56 smithi193 ceph-mon[32782]: pgmap v10427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:56 smithi196 ceph-mon[32572]: pgmap v10427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:02:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18892.177439 secs 2024-04-26T17:02:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18892.177439 secs 2024-04-26T17:02:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18892.177439 secs 2024-04-26T17:02:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:02:58 smithi110 ceph-mon[28069]: pgmap v10428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:02:58 smithi193 ceph-mon[32782]: pgmap v10428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:02:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:02:58 smithi196 ceph-mon[32572]: pgmap v10428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:00 smithi110 ceph-mon[28069]: pgmap v10429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:00 smithi193 ceph-mon[32782]: pgmap v10429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:00 smithi196 ceph-mon[32572]: pgmap v10429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:02 smithi110 ceph-mon[28069]: pgmap v10430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18897.177554 secs 2024-04-26T17:03:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:02 smithi193 ceph-mon[32782]: pgmap v10430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18897.177554 secs 2024-04-26T17:03:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:02 smithi196 ceph-mon[32572]: pgmap v10430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18897.177554 secs 2024-04-26T17:03:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:03 smithi193 ceph-mon[32782]: pgmap v10431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:03 smithi196 ceph-mon[32572]: pgmap v10431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:03 smithi110 ceph-mon[28069]: pgmap v10431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:06 smithi110 ceph-mon[28069]: pgmap v10432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:06 smithi193 ceph-mon[32782]: pgmap v10432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:06 smithi196 ceph-mon[32572]: pgmap v10432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18902.177669 secs 2024-04-26T17:03:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18902.177669 secs 2024-04-26T17:03:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18902.177669 secs 2024-04-26T17:03:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:08 smithi110 ceph-mon[28069]: pgmap v10433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:08 smithi193 ceph-mon[32782]: pgmap v10433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:08 smithi196 ceph-mon[32572]: pgmap v10433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:10 smithi110 ceph-mon[28069]: pgmap v10434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:10 smithi193 ceph-mon[32782]: pgmap v10434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:10 smithi196 ceph-mon[32572]: pgmap v10434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:12 smithi193 ceph-mon[32782]: pgmap v10435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18907.177787 secs 2024-04-26T17:03:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:12 smithi196 ceph-mon[32572]: pgmap v10435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18907.177787 secs 2024-04-26T17:03:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:12 smithi110 ceph-mon[28069]: pgmap v10435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18907.177787 secs 2024-04-26T17:03:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:13 smithi193 ceph-mon[32782]: pgmap v10436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:13 smithi196 ceph-mon[32572]: pgmap v10436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:13 smithi110 ceph-mon[28069]: pgmap v10436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.428+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T17:03:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.428+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T17:03:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.428+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:03:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.428+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T17:03:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.429+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:03:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T17:03:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T17:03:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T17:03:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T17:03:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614014040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:03:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614014040 comp rx=0 tx=0).stop 2024-04-26T17:03:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T17:03:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T17:03:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:03:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.430+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:03:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.431+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:03:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:16.432+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:03:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:16 smithi110 ceph-mon[28069]: pgmap v10437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:16 smithi193 ceph-mon[32782]: pgmap v10437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:16 smithi196 ceph-mon[32572]: pgmap v10437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18912.177909 secs 2024-04-26T17:03:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18912.177909 secs 2024-04-26T17:03:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18912.177909 secs 2024-04-26T17:03:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:18 smithi110 ceph-mon[28069]: pgmap v10438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:18 smithi193 ceph-mon[32782]: pgmap v10438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:18 smithi196 ceph-mon[32572]: pgmap v10438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:19.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:19.492+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T17:03:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:19.492+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:03:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:19.492+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 148 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:03:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:03:19.493+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 148 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T17:03:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:20 smithi110 ceph-mon[28069]: pgmap v10439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:20 smithi193 ceph-mon[32782]: pgmap v10439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:20 smithi196 ceph-mon[32572]: pgmap v10439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:22 smithi193 ceph-mon[32782]: pgmap v10440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18917.178030 secs 2024-04-26T17:03:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:22 smithi196 ceph-mon[32572]: pgmap v10440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18917.178030 secs 2024-04-26T17:03:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:22 smithi110 ceph-mon[28069]: pgmap v10440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18917.178030 secs 2024-04-26T17:03:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:23 smithi193 ceph-mon[32782]: pgmap v10441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:23.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:23 smithi196 ceph-mon[32572]: pgmap v10441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:23 smithi110 ceph-mon[28069]: pgmap v10441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:26 smithi110 ceph-mon[28069]: pgmap v10442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:26 smithi193 ceph-mon[32782]: pgmap v10442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:26 smithi196 ceph-mon[32572]: pgmap v10442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18922.178180 secs 2024-04-26T17:03:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18922.178180 secs 2024-04-26T17:03:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18922.178180 secs 2024-04-26T17:03:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:28 smithi110 ceph-mon[28069]: pgmap v10443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:28 smithi193 ceph-mon[32782]: pgmap v10443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:28 smithi196 ceph-mon[32572]: pgmap v10443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:30 smithi193 ceph-mon[32782]: pgmap v10444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:30 smithi196 ceph-mon[32572]: pgmap v10444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:30 smithi110 ceph-mon[28069]: pgmap v10444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:31 smithi193 ceph-mon[32782]: pgmap v10445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:31 smithi196 ceph-mon[32572]: pgmap v10445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:31 smithi110 ceph-mon[28069]: pgmap v10445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18927.178316 secs 2024-04-26T17:03:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18927.178316 secs 2024-04-26T17:03:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18927.178316 secs 2024-04-26T17:03:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:33 smithi193 ceph-mon[32782]: pgmap v10446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:33 smithi196 ceph-mon[32572]: pgmap v10446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:33 smithi110 ceph-mon[28069]: pgmap v10446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:36 smithi110 ceph-mon[28069]: pgmap v10447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:36 smithi193 ceph-mon[32782]: pgmap v10447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:36 smithi196 ceph-mon[32572]: pgmap v10447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18932.178435 secs 2024-04-26T17:03:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18932.178435 secs 2024-04-26T17:03:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18932.178435 secs 2024-04-26T17:03:38.844 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:38 smithi193 ceph-mon[32782]: pgmap v10448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:38.844 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:03:38.973 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:38 smithi110 ceph-mon[28069]: pgmap v10448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:38.973 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:03:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:38 smithi196 ceph-mon[32572]: pgmap v10448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:03:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:39 smithi193 ceph-mon[32782]: pgmap v10449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:39 smithi196 ceph-mon[32572]: pgmap v10449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:39 smithi110 ceph-mon[28069]: pgmap v10449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:03:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:03:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: pgmap v10450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:03:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:03:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: pgmap v10450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: pgmap v10450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:42.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:43 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18937.178551 secs 2024-04-26T17:03:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:43 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18937.178551 secs 2024-04-26T17:03:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:43 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18937.178551 secs 2024-04-26T17:03:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: pgmap v10451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:03:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:03:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: pgmap v10451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:03:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: pgmap v10451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:03:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:03:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:03:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:03:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:45 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:03:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:45 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:03:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:45 smithi110 ceph-mon[28069]: pgmap v10452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 B/s rd, 1 op/s 2024-04-26T17:03:45.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:45 smithi110 ceph-mon[28069]: pgmap v10453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:45 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:03:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:45 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:03:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:45 smithi193 ceph-mon[32782]: pgmap v10452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 B/s rd, 1 op/s 2024-04-26T17:03:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:45 smithi193 ceph-mon[32782]: pgmap v10453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:45 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:03:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:45 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:03:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:45 smithi196 ceph-mon[32572]: pgmap v10452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 B/s rd, 1 op/s 2024-04-26T17:03:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:45 smithi196 ceph-mon[32572]: pgmap v10453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:47 smithi110 ceph-mon[28069]: pgmap v10454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 626 B/s rd, 1 op/s 2024-04-26T17:03:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:47 smithi193 ceph-mon[32782]: pgmap v10454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 626 B/s rd, 1 op/s 2024-04-26T17:03:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:47 smithi196 ceph-mon[32572]: pgmap v10454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 626 B/s rd, 1 op/s 2024-04-26T17:03:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:48 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18942.178665 secs 2024-04-26T17:03:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:48 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18942.178665 secs 2024-04-26T17:03:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:48 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18942.178665 secs 2024-04-26T17:03:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:49 smithi193 ceph-mon[32782]: pgmap v10455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:49 smithi196 ceph-mon[32572]: pgmap v10455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:49 smithi110 ceph-mon[28069]: pgmap v10455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:51 smithi193 ceph-mon[32782]: pgmap v10456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:51 smithi196 ceph-mon[32572]: pgmap v10456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:51 smithi110 ceph-mon[28069]: pgmap v10456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18947.178786 secs 2024-04-26T17:03:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18947.178786 secs 2024-04-26T17:03:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18947.178786 secs 2024-04-26T17:03:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:53 smithi193 ceph-mon[32782]: pgmap v10457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 626 B/s rd, 1 op/s 2024-04-26T17:03:53.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:53 smithi196 ceph-mon[32572]: pgmap v10457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 626 B/s rd, 1 op/s 2024-04-26T17:03:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:53 smithi110 ceph-mon[28069]: pgmap v10457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 626 B/s rd, 1 op/s 2024-04-26T17:03:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:55 smithi193 ceph-mon[32782]: pgmap v10458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:03:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:55 smithi196 ceph-mon[32572]: pgmap v10458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:03:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:55 smithi110 ceph-mon[28069]: pgmap v10458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:03:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:57 smithi193 ceph-mon[32782]: pgmap v10459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18952.178914 secs 2024-04-26T17:03:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:57 smithi196 ceph-mon[32572]: pgmap v10459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18952.178914 secs 2024-04-26T17:03:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:57 smithi110 ceph-mon[28069]: pgmap v10459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:03:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18952.178914 secs 2024-04-26T17:03:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:03:59 smithi193 ceph-mon[32782]: pgmap v10460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:03:59 smithi196 ceph-mon[32572]: pgmap v10460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:03:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:03:59 smithi110 ceph-mon[28069]: pgmap v10460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:01 smithi193 ceph-mon[32782]: pgmap v10461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:01 smithi196 ceph-mon[32572]: pgmap v10461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:01 smithi110 ceph-mon[28069]: pgmap v10461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18957.179034 secs 2024-04-26T17:04:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18957.179034 secs 2024-04-26T17:04:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18957.179034 secs 2024-04-26T17:04:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:03 smithi193 ceph-mon[32782]: pgmap v10462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:03 smithi196 ceph-mon[32572]: pgmap v10462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:03 smithi110 ceph-mon[28069]: pgmap v10462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:05.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:05 smithi193 ceph-mon[32782]: pgmap v10463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:05 smithi196 ceph-mon[32572]: pgmap v10463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:05 smithi110 ceph-mon[28069]: pgmap v10463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:07 smithi193 ceph-mon[32782]: pgmap v10464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18962.179148 secs 2024-04-26T17:04:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:07 smithi196 ceph-mon[32572]: pgmap v10464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18962.179148 secs 2024-04-26T17:04:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:07 smithi110 ceph-mon[28069]: pgmap v10464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18962.179148 secs 2024-04-26T17:04:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:09 smithi193 ceph-mon[32782]: pgmap v10465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:09.498 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:09 smithi110 ceph-mon[28069]: pgmap v10465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:09 smithi196 ceph-mon[32572]: pgmap v10465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:09.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:04:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:04:09.496+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:04:09.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:04:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:04:09.496+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:04:09.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:04:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:04:09.496+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:04:09.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:04:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:04:09.496+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:04:09.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:04:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:04:09.496+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:04:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:11 smithi193 ceph-mon[32782]: pgmap v10466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:11 smithi196 ceph-mon[32572]: pgmap v10466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:11 smithi110 ceph-mon[28069]: pgmap v10466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18967.179273 secs 2024-04-26T17:04:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18967.179273 secs 2024-04-26T17:04:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18967.179273 secs 2024-04-26T17:04:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:13 smithi196 ceph-mon[32572]: pgmap v10467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:13 smithi110 ceph-mon[28069]: pgmap v10467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:13 smithi193 ceph-mon[32782]: pgmap v10467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:15 smithi196 ceph-mon[32572]: pgmap v10468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:04:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:15 smithi110 ceph-mon[28069]: pgmap v10468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:04:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:15 smithi193 ceph-mon[32782]: pgmap v10468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:04:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:17 smithi196 ceph-mon[32572]: pgmap v10469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:04:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18972.179387 secs 2024-04-26T17:04:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:17 smithi110 ceph-mon[28069]: pgmap v10469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:04:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18972.179387 secs 2024-04-26T17:04:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:17 smithi193 ceph-mon[32782]: pgmap v10469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:04:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18972.179387 secs 2024-04-26T17:04:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:19 smithi196 ceph-mon[32572]: pgmap v10470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:04:19.578 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:19 smithi110 ceph-mon[28069]: pgmap v10470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:04:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:19 smithi193 ceph-mon[32782]: pgmap v10470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:04:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:21 smithi196 ceph-mon[32572]: pgmap v10471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:04:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:21 smithi110 ceph-mon[28069]: pgmap v10471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:04:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:21 smithi193 ceph-mon[32782]: pgmap v10471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:04:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18977.179507 secs 2024-04-26T17:04:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18977.179507 secs 2024-04-26T17:04:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18977.179507 secs 2024-04-26T17:04:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:23 smithi196 ceph-mon[32572]: pgmap v10472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:04:23.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:23 smithi193 ceph-mon[32782]: pgmap v10472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:04:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:23 smithi110 ceph-mon[28069]: pgmap v10472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:04:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:25 smithi196 ceph-mon[32572]: pgmap v10473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:04:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:25 smithi110 ceph-mon[28069]: pgmap v10473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:04:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:25 smithi193 ceph-mon[32782]: pgmap v10473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:04:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:27 smithi196 ceph-mon[32572]: pgmap v10474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18982.179624 secs 2024-04-26T17:04:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:27 smithi110 ceph-mon[28069]: pgmap v10474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18982.179624 secs 2024-04-26T17:04:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:27 smithi193 ceph-mon[32782]: pgmap v10474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18982.179624 secs 2024-04-26T17:04:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:29 smithi196 ceph-mon[32572]: pgmap v10475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:29 smithi110 ceph-mon[28069]: pgmap v10475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:29 smithi193 ceph-mon[32782]: pgmap v10475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:31 smithi196 ceph-mon[32572]: pgmap v10476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:31 smithi110 ceph-mon[28069]: pgmap v10476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:31 smithi193 ceph-mon[32782]: pgmap v10476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18987.179748 secs 2024-04-26T17:04:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18987.179748 secs 2024-04-26T17:04:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18987.179748 secs 2024-04-26T17:04:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:33 smithi196 ceph-mon[32572]: pgmap v10477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:33 smithi110 ceph-mon[28069]: pgmap v10477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:33 smithi193 ceph-mon[32782]: pgmap v10477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:35 smithi196 ceph-mon[32572]: pgmap v10478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:35 smithi110 ceph-mon[28069]: pgmap v10478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:35 smithi193 ceph-mon[32782]: pgmap v10478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:37 smithi196 ceph-mon[32572]: pgmap v10479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18992.179856 secs 2024-04-26T17:04:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:37 smithi110 ceph-mon[28069]: pgmap v10479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18992.179856 secs 2024-04-26T17:04:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:37 smithi193 ceph-mon[32782]: pgmap v10479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18992.179856 secs 2024-04-26T17:04:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:39 smithi196 ceph-mon[32572]: pgmap v10480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:39.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:39 smithi110 ceph-mon[28069]: pgmap v10480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:39 smithi193 ceph-mon[32782]: pgmap v10480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:41 smithi196 ceph-mon[32572]: pgmap v10481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:41 smithi110 ceph-mon[28069]: pgmap v10481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:41 smithi193 ceph-mon[32782]: pgmap v10481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 18997.179934 secs 2024-04-26T17:04:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 18997.179934 secs 2024-04-26T17:04:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 18997.179934 secs 2024-04-26T17:04:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:43 smithi196 ceph-mon[32572]: pgmap v10482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:43 smithi110 ceph-mon[28069]: pgmap v10482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:43 smithi193 ceph-mon[32782]: pgmap v10482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:04:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:04:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:04:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:45 smithi196 ceph-mon[32572]: pgmap v10483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:04:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:04:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:04:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:45 smithi110 ceph-mon[28069]: pgmap v10483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:04:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:04:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:04:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:45 smithi193 ceph-mon[32782]: pgmap v10483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:04:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:04:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:04:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:04:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:46 smithi110 ceph-mon[28069]: pgmap v10484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:04:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:46 smithi110 ceph-mon[28069]: pgmap v10485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:46 smithi193 ceph-mon[32782]: pgmap v10484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:04:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:46 smithi193 ceph-mon[32782]: pgmap v10485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:46 smithi196 ceph-mon[32572]: pgmap v10484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:04:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:46 smithi196 ceph-mon[32572]: pgmap v10485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19002.180031 secs 2024-04-26T17:04:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19002.180031 secs 2024-04-26T17:04:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19002.180031 secs 2024-04-26T17:04:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:48 smithi110 ceph-mon[28069]: pgmap v10486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:04:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:48 smithi193 ceph-mon[32782]: pgmap v10486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:04:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:48 smithi196 ceph-mon[32572]: pgmap v10486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:04:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:50 smithi110 ceph-mon[28069]: pgmap v10487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:50 smithi193 ceph-mon[32782]: pgmap v10487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:50 smithi196 ceph-mon[32572]: pgmap v10487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:52 smithi110 ceph-mon[28069]: pgmap v10488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19007.180167 secs 2024-04-26T17:04:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:52 smithi193 ceph-mon[32782]: pgmap v10488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19007.180167 secs 2024-04-26T17:04:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:52 smithi196 ceph-mon[32572]: pgmap v10488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19007.180167 secs 2024-04-26T17:04:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:54 smithi110 ceph-mon[28069]: pgmap v10489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:54.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:54 smithi196 ceph-mon[32572]: pgmap v10489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:54 smithi193 ceph-mon[32782]: pgmap v10489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:04:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:56 smithi110 ceph-mon[28069]: pgmap v10490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:04:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:56 smithi193 ceph-mon[32782]: pgmap v10490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:04:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:56 smithi196 ceph-mon[32572]: pgmap v10490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:04:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19012.180283 secs 2024-04-26T17:04:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19012.180283 secs 2024-04-26T17:04:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19012.180283 secs 2024-04-26T17:04:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:04:58 smithi193 ceph-mon[32782]: pgmap v10491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:04:58 smithi196 ceph-mon[32572]: pgmap v10491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:04:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:04:58 smithi110 ceph-mon[28069]: pgmap v10491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:00 smithi193 ceph-mon[32782]: pgmap v10492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:00 smithi196 ceph-mon[32572]: pgmap v10492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:00 smithi110 ceph-mon[28069]: pgmap v10492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:02 smithi193 ceph-mon[32782]: pgmap v10493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19017.180414 secs 2024-04-26T17:05:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:02 smithi196 ceph-mon[32572]: pgmap v10493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19017.180414 secs 2024-04-26T17:05:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:02 smithi110 ceph-mon[28069]: pgmap v10493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19017.180414 secs 2024-04-26T17:05:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:04 smithi193 ceph-mon[32782]: pgmap v10494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:05:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:04 smithi196 ceph-mon[32572]: pgmap v10494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:05:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:04 smithi110 ceph-mon[28069]: pgmap v10494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:05:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:06 smithi193 ceph-mon[32782]: pgmap v10495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:05:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:06 smithi196 ceph-mon[32572]: pgmap v10495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:05:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:06 smithi110 ceph-mon[28069]: pgmap v10495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:05:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19022.180537 secs 2024-04-26T17:05:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19022.180537 secs 2024-04-26T17:05:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19022.180537 secs 2024-04-26T17:05:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:08 smithi193 ceph-mon[32782]: pgmap v10496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:05:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:08 smithi196 ceph-mon[32572]: pgmap v10496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:05:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:08 smithi110 ceph-mon[28069]: pgmap v10496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:05:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:10 smithi193 ceph-mon[32782]: pgmap v10497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:05:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:10 smithi196 ceph-mon[32572]: pgmap v10497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:05:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:10 smithi110 ceph-mon[28069]: pgmap v10497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:12 smithi193 ceph-mon[32782]: pgmap v10498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 19027.180687 secs 2024-04-26T17:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:12 smithi193 ceph-mon[32782]: slow request 5764.805571 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:05:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:12 smithi196 ceph-mon[32572]: pgmap v10498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:05:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 19027.180687 secs 2024-04-26T17:05:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:12 smithi196 ceph-mon[32572]: slow request 5764.805571 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:05:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:12 smithi110 ceph-mon[28069]: pgmap v10498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:05:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 19027.180687 secs 2024-04-26T17:05:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:12 smithi110 ceph-mon[28069]: slow request 5764.805571 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:05:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:14 smithi193 ceph-mon[32782]: pgmap v10499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:05:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:14 smithi196 ceph-mon[32572]: pgmap v10499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:05:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:14 smithi110 ceph-mon[28069]: pgmap v10499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:05:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:16 smithi193 ceph-mon[32782]: pgmap v10500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:16 smithi196 ceph-mon[32572]: pgmap v10500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:16.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:16 smithi110 ceph-mon[28069]: pgmap v10500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19032.180796 secs 2024-04-26T17:05:17.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19032.180796 secs 2024-04-26T17:05:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19032.180796 secs 2024-04-26T17:05:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:18 smithi193 ceph-mon[32782]: pgmap v10501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:18 smithi196 ceph-mon[32572]: pgmap v10501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:18 smithi110 ceph-mon[28069]: pgmap v10501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:20 smithi196 ceph-mon[32572]: pgmap v10502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:20 smithi110 ceph-mon[28069]: pgmap v10502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:20 smithi193 ceph-mon[32782]: pgmap v10502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:22 smithi196 ceph-mon[32572]: pgmap v10503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19037.180882 secs 2024-04-26T17:05:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:22 smithi110 ceph-mon[28069]: pgmap v10503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19037.180882 secs 2024-04-26T17:05:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:22 smithi193 ceph-mon[32782]: pgmap v10503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19037.180882 secs 2024-04-26T17:05:24.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:24 smithi193 ceph-mon[32782]: pgmap v10504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:24 smithi196 ceph-mon[32572]: pgmap v10504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:24 smithi110 ceph-mon[28069]: pgmap v10504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:26 smithi196 ceph-mon[32572]: pgmap v10505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:26 smithi110 ceph-mon[28069]: pgmap v10505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:26 smithi193 ceph-mon[32782]: pgmap v10505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19042.181002 secs 2024-04-26T17:05:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19042.181002 secs 2024-04-26T17:05:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19042.181002 secs 2024-04-26T17:05:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:28 smithi196 ceph-mon[32572]: pgmap v10506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:28 smithi110 ceph-mon[28069]: pgmap v10506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:28 smithi193 ceph-mon[32782]: pgmap v10506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:30 smithi196 ceph-mon[32572]: pgmap v10507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:30 smithi110 ceph-mon[28069]: pgmap v10507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:30 smithi193 ceph-mon[32782]: pgmap v10507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:32 smithi196 ceph-mon[32572]: pgmap v10508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19047.181134 secs 2024-04-26T17:05:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:32 smithi110 ceph-mon[28069]: pgmap v10508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19047.181134 secs 2024-04-26T17:05:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:32 smithi193 ceph-mon[32782]: pgmap v10508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19047.181134 secs 2024-04-26T17:05:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:34 smithi196 ceph-mon[32572]: pgmap v10509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:34 smithi110 ceph-mon[28069]: pgmap v10509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:34 smithi193 ceph-mon[32782]: pgmap v10509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:36 smithi196 ceph-mon[32572]: pgmap v10510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:36 smithi110 ceph-mon[28069]: pgmap v10510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:36 smithi193 ceph-mon[32782]: pgmap v10510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19052.181257 secs 2024-04-26T17:05:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19052.181257 secs 2024-04-26T17:05:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19052.181257 secs 2024-04-26T17:05:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:38 smithi196 ceph-mon[32572]: pgmap v10511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:38 smithi110 ceph-mon[28069]: pgmap v10511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:38 smithi193 ceph-mon[32782]: pgmap v10511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:40 smithi196 ceph-mon[32572]: pgmap v10512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:40 smithi110 ceph-mon[28069]: pgmap v10512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:40 smithi193 ceph-mon[32782]: pgmap v10512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:42 smithi196 ceph-mon[32572]: pgmap v10513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19057.181377 secs 2024-04-26T17:05:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:42 smithi110 ceph-mon[28069]: pgmap v10513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19057.181377 secs 2024-04-26T17:05:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:42 smithi193 ceph-mon[32782]: pgmap v10513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19057.181377 secs 2024-04-26T17:05:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:44 smithi196 ceph-mon[32572]: pgmap v10514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:44 smithi110 ceph-mon[28069]: pgmap v10514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:44 smithi193 ceph-mon[32782]: pgmap v10514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:05:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:46 smithi196 ceph-mon[32572]: pgmap v10515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:05:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:46 smithi110 ceph-mon[28069]: pgmap v10515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:05:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:46 smithi193 ceph-mon[32782]: pgmap v10515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:05:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:05:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19062.181516 secs 2024-04-26T17:05:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:05:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:05:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:05:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19062.181516 secs 2024-04-26T17:05:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:05:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:05:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:05:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19062.181516 secs 2024-04-26T17:05:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:05:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:05:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:05:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:48 smithi196 ceph-mon[32572]: pgmap v10516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:05:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:48 smithi196 ceph-mon[32572]: pgmap v10517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:48 smithi110 ceph-mon[28069]: pgmap v10516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:05:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:48 smithi110 ceph-mon[28069]: pgmap v10517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:48 smithi193 ceph-mon[32782]: pgmap v10516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:05:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:48 smithi193 ceph-mon[32782]: pgmap v10517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:50 smithi196 ceph-mon[32572]: pgmap v10518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:50 smithi110 ceph-mon[28069]: pgmap v10518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:50 smithi193 ceph-mon[32782]: pgmap v10518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:52 smithi196 ceph-mon[32572]: pgmap v10519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19067.181614 secs 2024-04-26T17:05:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:52 smithi110 ceph-mon[28069]: pgmap v10519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19067.181614 secs 2024-04-26T17:05:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:52 smithi193 ceph-mon[32782]: pgmap v10519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19067.181614 secs 2024-04-26T17:05:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:54 smithi196 ceph-mon[32572]: pgmap v10520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:54 smithi110 ceph-mon[28069]: pgmap v10520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:54 smithi193 ceph-mon[32782]: pgmap v10520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:56 smithi196 ceph-mon[32572]: pgmap v10521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:56 smithi110 ceph-mon[28069]: pgmap v10521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:56 smithi193 ceph-mon[32782]: pgmap v10521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:05:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19072.181661 secs 2024-04-26T17:05:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19072.181661 secs 2024-04-26T17:05:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19072.181661 secs 2024-04-26T17:05:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:05:58 smithi110 ceph-mon[28069]: pgmap v10522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:05:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:05:58 smithi193 ceph-mon[32782]: pgmap v10522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:05:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:05:58 smithi196 ceph-mon[32572]: pgmap v10522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:06:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:00 smithi110 ceph-mon[28069]: pgmap v10523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:00 smithi193 ceph-mon[32782]: pgmap v10523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:00 smithi196 ceph-mon[32572]: pgmap v10523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:02 smithi110 ceph-mon[28069]: pgmap v10524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19077.181725 secs 2024-04-26T17:06:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:02 smithi193 ceph-mon[32782]: pgmap v10524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19077.181725 secs 2024-04-26T17:06:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:02 smithi196 ceph-mon[32572]: pgmap v10524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19077.181725 secs 2024-04-26T17:06:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:04 smithi110 ceph-mon[28069]: pgmap v10525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:04 smithi193 ceph-mon[32782]: pgmap v10525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:04 smithi196 ceph-mon[32572]: pgmap v10525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:06 smithi110 ceph-mon[28069]: pgmap v10526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:06 smithi193 ceph-mon[32782]: pgmap v10526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:06 smithi196 ceph-mon[32572]: pgmap v10526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:07 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 19082.181842 secs 2024-04-26T17:06:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:07 smithi193 ceph-mon[32782]: slow request 11522.575412 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:06:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:07 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 19082.181842 secs 2024-04-26T17:06:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:07 smithi196 ceph-mon[32572]: slow request 11522.575412 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:06:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:07 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 19082.181842 secs 2024-04-26T17:06:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:07 smithi110 ceph-mon[28069]: slow request 11522.575412 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:06:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:08 smithi193 ceph-mon[32782]: pgmap v10527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:08 smithi196 ceph-mon[32572]: pgmap v10527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:08 smithi110 ceph-mon[28069]: pgmap v10527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:10 smithi193 ceph-mon[32782]: pgmap v10528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:10 smithi196 ceph-mon[32572]: pgmap v10528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:10 smithi110 ceph-mon[28069]: pgmap v10528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:12 smithi193 ceph-mon[32782]: pgmap v10529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19087.181954 secs 2024-04-26T17:06:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:12 smithi196 ceph-mon[32572]: pgmap v10529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19087.181954 secs 2024-04-26T17:06:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:12 smithi110 ceph-mon[28069]: pgmap v10529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19087.181954 secs 2024-04-26T17:06:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:14 smithi193 ceph-mon[32782]: pgmap v10530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:14 smithi196 ceph-mon[32572]: pgmap v10530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:14 smithi110 ceph-mon[28069]: pgmap v10530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:16 smithi193 ceph-mon[32782]: pgmap v10531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:16 smithi196 ceph-mon[32572]: pgmap v10531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:16 smithi110 ceph-mon[28069]: pgmap v10531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19092.182054 secs 2024-04-26T17:06:17.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19092.182054 secs 2024-04-26T17:06:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19092.182054 secs 2024-04-26T17:06:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:18 smithi193 ceph-mon[32782]: pgmap v10532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:18 smithi196 ceph-mon[32572]: pgmap v10532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:18 smithi110 ceph-mon[28069]: pgmap v10532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:06:19.521+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:06:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:06:19.521+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T17:06:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:06:19.522+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 149 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T17:06:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:06:19.522+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 149 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:06:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:20 smithi193 ceph-mon[32782]: pgmap v10533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:20 smithi196 ceph-mon[32572]: pgmap v10533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:20 smithi110 ceph-mon[28069]: pgmap v10533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:21 smithi193 ceph-mon[32782]: pgmap v10534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:21 smithi196 ceph-mon[32572]: pgmap v10534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:21 smithi110 ceph-mon[28069]: pgmap v10534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19097.182158 secs 2024-04-26T17:06:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19097.182158 secs 2024-04-26T17:06:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19097.182158 secs 2024-04-26T17:06:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:23 smithi193 ceph-mon[32782]: pgmap v10535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:23 smithi196 ceph-mon[32572]: pgmap v10535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:23 smithi110 ceph-mon[28069]: pgmap v10535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:25 smithi193 ceph-mon[32782]: pgmap v10536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:25 smithi196 ceph-mon[32572]: pgmap v10536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:25 smithi110 ceph-mon[28069]: pgmap v10536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19102.182274 secs 2024-04-26T17:06:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:27 smithi193 ceph-mon[32782]: pgmap v10537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19102.182274 secs 2024-04-26T17:06:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:27 smithi196 ceph-mon[32572]: pgmap v10537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19102.182274 secs 2024-04-26T17:06:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:27 smithi110 ceph-mon[28069]: pgmap v10537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:29 smithi193 ceph-mon[32782]: pgmap v10538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:29 smithi196 ceph-mon[32572]: pgmap v10538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:29 smithi110 ceph-mon[28069]: pgmap v10538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:31 smithi193 ceph-mon[32782]: pgmap v10539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:31 smithi196 ceph-mon[32572]: pgmap v10539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:31 smithi110 ceph-mon[28069]: pgmap v10539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19107.182423 secs 2024-04-26T17:06:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19107.182423 secs 2024-04-26T17:06:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19107.182423 secs 2024-04-26T17:06:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:33 smithi196 ceph-mon[32572]: pgmap v10540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:33 smithi110 ceph-mon[28069]: pgmap v10540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:33 smithi193 ceph-mon[32782]: pgmap v10540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:35 smithi196 ceph-mon[32572]: pgmap v10541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:35 smithi110 ceph-mon[28069]: pgmap v10541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:35 smithi193 ceph-mon[32782]: pgmap v10541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19112.182540 secs 2024-04-26T17:06:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:37 smithi196 ceph-mon[32572]: pgmap v10542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19112.182540 secs 2024-04-26T17:06:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:37 smithi110 ceph-mon[28069]: pgmap v10542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19112.182540 secs 2024-04-26T17:06:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:37 smithi193 ceph-mon[32782]: pgmap v10542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:39 smithi196 ceph-mon[32572]: pgmap v10543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:39 smithi110 ceph-mon[28069]: pgmap v10543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:39 smithi193 ceph-mon[32782]: pgmap v10543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:41 smithi196 ceph-mon[32572]: pgmap v10544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:41 smithi110 ceph-mon[28069]: pgmap v10544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:41 smithi193 ceph-mon[32782]: pgmap v10544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19117.182644 secs 2024-04-26T17:06:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19117.182644 secs 2024-04-26T17:06:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19117.182644 secs 2024-04-26T17:06:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:43 smithi196 ceph-mon[32572]: pgmap v10545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:43 smithi110 ceph-mon[28069]: pgmap v10545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:43 smithi193 ceph-mon[32782]: pgmap v10545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:06:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:45 smithi196 ceph-mon[32572]: pgmap v10546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:45 smithi110 ceph-mon[28069]: pgmap v10546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:45 smithi193 ceph-mon[32782]: pgmap v10546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19122.182757 secs 2024-04-26T17:06:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:47 smithi196 ceph-mon[32572]: pgmap v10547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:06:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19122.182757 secs 2024-04-26T17:06:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:47 smithi110 ceph-mon[28069]: pgmap v10547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:06:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19122.182757 secs 2024-04-26T17:06:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:47 smithi193 ceph-mon[32782]: pgmap v10547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:06:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:06:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:06:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:06:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:48 smithi196 ceph-mon[32572]: pgmap v10548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:06:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:48 smithi196 ceph-mon[32572]: pgmap v10549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:06:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:06:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:06:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:48 smithi110 ceph-mon[28069]: pgmap v10548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:06:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:48 smithi110 ceph-mon[28069]: pgmap v10549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:06:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:06:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:06:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:48 smithi193 ceph-mon[32782]: pgmap v10548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:06:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:48 smithi193 ceph-mon[32782]: pgmap v10549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:06:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:51 smithi193 ceph-mon[32782]: pgmap v10550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:51 smithi196 ceph-mon[32572]: pgmap v10550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:51 smithi110 ceph-mon[28069]: pgmap v10550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19127.182879 secs 2024-04-26T17:06:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19127.182879 secs 2024-04-26T17:06:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19127.182879 secs 2024-04-26T17:06:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:53 smithi193 ceph-mon[32782]: pgmap v10551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:06:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:53 smithi196 ceph-mon[32572]: pgmap v10551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:06:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:53 smithi110 ceph-mon[28069]: pgmap v10551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:06:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:55 smithi193 ceph-mon[32782]: pgmap v10552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:55 smithi196 ceph-mon[32572]: pgmap v10552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:55 smithi110 ceph-mon[28069]: pgmap v10552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:57 smithi196 ceph-mon[32572]: pgmap v10553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19132.182992 secs 2024-04-26T17:06:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:57 smithi110 ceph-mon[28069]: pgmap v10553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19132.182992 secs 2024-04-26T17:06:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:57 smithi193 ceph-mon[32782]: pgmap v10553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:06:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19132.182992 secs 2024-04-26T17:06:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:06:59 smithi196 ceph-mon[32572]: pgmap v10554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:06:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:06:59 smithi110 ceph-mon[28069]: pgmap v10554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:06:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:06:59 smithi193 ceph-mon[32782]: pgmap v10554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:07:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:01 smithi196 ceph-mon[32572]: pgmap v10555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:01 smithi110 ceph-mon[28069]: pgmap v10555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:01 smithi193 ceph-mon[32782]: pgmap v10555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19137.183130 secs 2024-04-26T17:07:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19137.183130 secs 2024-04-26T17:07:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19137.183130 secs 2024-04-26T17:07:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:03 smithi196 ceph-mon[32572]: pgmap v10556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:07:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:03 smithi110 ceph-mon[28069]: pgmap v10556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:07:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:03 smithi193 ceph-mon[32782]: pgmap v10556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:07:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:05 smithi196 ceph-mon[32572]: pgmap v10557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:05 smithi110 ceph-mon[28069]: pgmap v10557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:05 smithi193 ceph-mon[32782]: pgmap v10557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:07 smithi196 ceph-mon[32572]: pgmap v10558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19142.183248 secs 2024-04-26T17:07:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:07 smithi110 ceph-mon[28069]: pgmap v10558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19142.183248 secs 2024-04-26T17:07:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:07 smithi193 ceph-mon[32782]: pgmap v10558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19142.183248 secs 2024-04-26T17:07:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:09 smithi196 ceph-mon[32572]: pgmap v10559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:09 smithi110 ceph-mon[28069]: pgmap v10559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:09 smithi193 ceph-mon[32782]: pgmap v10559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:11 smithi196 ceph-mon[32572]: pgmap v10560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:11 smithi110 ceph-mon[28069]: pgmap v10560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:11 smithi193 ceph-mon[32782]: pgmap v10560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19147.183388 secs 2024-04-26T17:07:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19147.183388 secs 2024-04-26T17:07:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19147.183388 secs 2024-04-26T17:07:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:13 smithi196 ceph-mon[32572]: pgmap v10561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:07:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:13 smithi110 ceph-mon[28069]: pgmap v10561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:07:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:13 smithi193 ceph-mon[32782]: pgmap v10561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:07:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:15 smithi196 ceph-mon[32572]: pgmap v10562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:15 smithi110 ceph-mon[28069]: pgmap v10562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:15 smithi193 ceph-mon[32782]: pgmap v10562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:17 smithi196 ceph-mon[32572]: pgmap v10563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19152.183505 secs 2024-04-26T17:07:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:17 smithi110 ceph-mon[28069]: pgmap v10563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19152.183505 secs 2024-04-26T17:07:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:17 smithi193 ceph-mon[32782]: pgmap v10563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19152.183505 secs 2024-04-26T17:07:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:19 smithi196 ceph-mon[32572]: pgmap v10564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:19 smithi110 ceph-mon[28069]: pgmap v10564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:19 smithi193 ceph-mon[32782]: pgmap v10564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:21 smithi196 ceph-mon[32572]: pgmap v10565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:21 smithi110 ceph-mon[28069]: pgmap v10565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:21 smithi193 ceph-mon[32782]: pgmap v10565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19157.183647 secs 2024-04-26T17:07:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19157.183647 secs 2024-04-26T17:07:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19157.183647 secs 2024-04-26T17:07:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:23 smithi196 ceph-mon[32572]: pgmap v10566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:07:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:23 smithi110 ceph-mon[28069]: pgmap v10566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:07:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:23 smithi193 ceph-mon[32782]: pgmap v10566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:07:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:25 smithi196 ceph-mon[32572]: pgmap v10567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:25 smithi110 ceph-mon[28069]: pgmap v10567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:25 smithi193 ceph-mon[32782]: pgmap v10567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:27 smithi110 ceph-mon[28069]: pgmap v10568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:27 smithi193 ceph-mon[32782]: pgmap v10568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:27 smithi196 ceph-mon[32572]: pgmap v10568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:28 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19162.183753 secs 2024-04-26T17:07:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:28 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19162.183753 secs 2024-04-26T17:07:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:28 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19162.183753 secs 2024-04-26T17:07:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:29 smithi193 ceph-mon[32782]: pgmap v10569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:29 smithi196 ceph-mon[32572]: pgmap v10569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:29 smithi110 ceph-mon[28069]: pgmap v10569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:31 smithi193 ceph-mon[32782]: pgmap v10570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:31 smithi196 ceph-mon[32572]: pgmap v10570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:31 smithi110 ceph-mon[28069]: pgmap v10570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19167.183877 secs 2024-04-26T17:07:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19167.183877 secs 2024-04-26T17:07:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19167.183877 secs 2024-04-26T17:07:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:33 smithi196 ceph-mon[32572]: pgmap v10571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:33 smithi110 ceph-mon[28069]: pgmap v10571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:33 smithi193 ceph-mon[32782]: pgmap v10571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:35 smithi196 ceph-mon[32572]: pgmap v10572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T17:07:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:35 smithi110 ceph-mon[28069]: pgmap v10572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T17:07:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:35 smithi193 ceph-mon[32782]: pgmap v10572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T17:07:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:37 smithi196 ceph-mon[32572]: pgmap v10573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19172.183994 secs 2024-04-26T17:07:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:37 smithi110 ceph-mon[28069]: pgmap v10573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19172.183994 secs 2024-04-26T17:07:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:37 smithi193 ceph-mon[32782]: pgmap v10573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19172.183994 secs 2024-04-26T17:07:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:39 smithi196 ceph-mon[32572]: pgmap v10574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:39 smithi110 ceph-mon[28069]: pgmap v10574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:39 smithi193 ceph-mon[32782]: pgmap v10574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:41 smithi196 ceph-mon[32572]: pgmap v10575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:41 smithi110 ceph-mon[28069]: pgmap v10575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:41 smithi193 ceph-mon[32782]: pgmap v10575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19177.184113 secs 2024-04-26T17:07:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19177.184113 secs 2024-04-26T17:07:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19177.184113 secs 2024-04-26T17:07:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:43 smithi196 ceph-mon[32572]: pgmap v10576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:43 smithi110 ceph-mon[28069]: pgmap v10576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:43 smithi193 ceph-mon[32782]: pgmap v10576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:45 smithi196 ceph-mon[32572]: pgmap v10577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:45 smithi110 ceph-mon[28069]: pgmap v10577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:45 smithi193 ceph-mon[32782]: pgmap v10577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:47 smithi196 ceph-mon[32572]: pgmap v10578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19182.184229 secs 2024-04-26T17:07:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:47 smithi110 ceph-mon[28069]: pgmap v10578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19182.184229 secs 2024-04-26T17:07:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:47 smithi193 ceph-mon[32782]: pgmap v10578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:07:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19182.184229 secs 2024-04-26T17:07:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:49 smithi196 ceph-mon[32572]: pgmap v10579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:07:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:49 smithi110 ceph-mon[28069]: pgmap v10579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:07:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:49 smithi193 ceph-mon[32782]: pgmap v10579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:07:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:07:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:07:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:07:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:07:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:07:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:07:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:07:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:07:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:07:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:07:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:51 smithi196 ceph-mon[32572]: pgmap v10580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:07:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:51 smithi196 ceph-mon[32572]: pgmap v10581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:51 smithi110 ceph-mon[28069]: pgmap v10580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:07:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:51 smithi110 ceph-mon[28069]: pgmap v10581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:51 smithi193 ceph-mon[32782]: pgmap v10580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:07:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:51 smithi193 ceph-mon[32782]: pgmap v10581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19187.184327 secs 2024-04-26T17:07:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19187.184327 secs 2024-04-26T17:07:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19187.184327 secs 2024-04-26T17:07:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:53 smithi196 ceph-mon[32572]: pgmap v10582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:07:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:53 smithi110 ceph-mon[28069]: pgmap v10582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:07:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:53 smithi193 ceph-mon[32782]: pgmap v10582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:07:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:55 smithi196 ceph-mon[32572]: pgmap v10583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:55 smithi110 ceph-mon[28069]: pgmap v10583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:55 smithi193 ceph-mon[32782]: pgmap v10583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:57 smithi196 ceph-mon[32572]: pgmap v10584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19192.184448 secs 2024-04-26T17:07:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:57 smithi110 ceph-mon[28069]: pgmap v10584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19192.184448 secs 2024-04-26T17:07:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:57 smithi193 ceph-mon[32782]: pgmap v10584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19192.184448 secs 2024-04-26T17:07:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:07:59 smithi196 ceph-mon[32572]: pgmap v10585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:07:59 smithi110 ceph-mon[28069]: pgmap v10585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:07:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:07:59 smithi193 ceph-mon[32782]: pgmap v10585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:01 smithi196 ceph-mon[32572]: pgmap v10586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:08:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:01 smithi110 ceph-mon[28069]: pgmap v10586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:08:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:01 smithi193 ceph-mon[32782]: pgmap v10586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:08:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19197.184595 secs 2024-04-26T17:08:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19197.184595 secs 2024-04-26T17:08:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19197.184595 secs 2024-04-26T17:08:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:03 smithi196 ceph-mon[32572]: pgmap v10587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:03 smithi110 ceph-mon[28069]: pgmap v10587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:03 smithi193 ceph-mon[32782]: pgmap v10587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:05 smithi196 ceph-mon[32572]: pgmap v10588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:05 smithi110 ceph-mon[28069]: pgmap v10588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:05 smithi193 ceph-mon[32782]: pgmap v10588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:07 smithi196 ceph-mon[32572]: pgmap v10589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19202.184663 secs 2024-04-26T17:08:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:07 smithi110 ceph-mon[28069]: pgmap v10589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19202.184663 secs 2024-04-26T17:08:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:07 smithi193 ceph-mon[32782]: pgmap v10589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19202.184663 secs 2024-04-26T17:08:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:09 smithi196 ceph-mon[32572]: pgmap v10590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:09 smithi110 ceph-mon[28069]: pgmap v10590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:09 smithi193 ceph-mon[32782]: pgmap v10590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:11 smithi196 ceph-mon[32572]: pgmap v10591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:08:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:11 smithi110 ceph-mon[28069]: pgmap v10591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:08:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:11 smithi193 ceph-mon[32782]: pgmap v10591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:08:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19207.184780 secs 2024-04-26T17:08:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19207.184780 secs 2024-04-26T17:08:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19207.184780 secs 2024-04-26T17:08:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:13 smithi110 ceph-mon[28069]: pgmap v10592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:08:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:13 smithi193 ceph-mon[32782]: pgmap v10592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:08:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:13 smithi196 ceph-mon[32572]: pgmap v10592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:08:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:15 smithi110 ceph-mon[28069]: pgmap v10593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:15 smithi193 ceph-mon[32782]: pgmap v10593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:15 smithi196 ceph-mon[32572]: pgmap v10593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:17 smithi110 ceph-mon[28069]: pgmap v10594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:08:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19212.184898 secs 2024-04-26T17:08:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:17 smithi193 ceph-mon[32782]: pgmap v10594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:08:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19212.184898 secs 2024-04-26T17:08:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:17 smithi196 ceph-mon[32572]: pgmap v10594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:08:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19212.184898 secs 2024-04-26T17:08:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:19 smithi110 ceph-mon[28069]: pgmap v10595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:19 smithi193 ceph-mon[32782]: pgmap v10595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:19 smithi196 ceph-mon[32572]: pgmap v10595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:21 smithi110 ceph-mon[28069]: pgmap v10596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:21 smithi193 ceph-mon[32782]: pgmap v10596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:21 smithi196 ceph-mon[32572]: pgmap v10596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19217.185010 secs 2024-04-26T17:08:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19217.185010 secs 2024-04-26T17:08:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19217.185010 secs 2024-04-26T17:08:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:23 smithi193 ceph-mon[32782]: pgmap v10597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:23 smithi196 ceph-mon[32572]: pgmap v10597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:24.014 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:23 smithi110 ceph-mon[28069]: pgmap v10597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:25 smithi193 ceph-mon[32782]: pgmap v10598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:26.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:25 smithi196 ceph-mon[32572]: pgmap v10598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:25 smithi110 ceph-mon[28069]: pgmap v10598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:27 smithi193 ceph-mon[32782]: pgmap v10599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19222.185131 secs 2024-04-26T17:08:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:27 smithi196 ceph-mon[32572]: pgmap v10599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19222.185131 secs 2024-04-26T17:08:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:27 smithi110 ceph-mon[28069]: pgmap v10599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19222.185131 secs 2024-04-26T17:08:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:29 smithi193 ceph-mon[32782]: pgmap v10600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:29 smithi196 ceph-mon[32572]: pgmap v10600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:29 smithi110 ceph-mon[28069]: pgmap v10600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:31 smithi193 ceph-mon[32782]: pgmap v10601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:31 smithi196 ceph-mon[32572]: pgmap v10601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:31 smithi110 ceph-mon[28069]: pgmap v10601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19227.185247 secs 2024-04-26T17:08:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19227.185247 secs 2024-04-26T17:08:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19227.185247 secs 2024-04-26T17:08:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:33 smithi193 ceph-mon[32782]: pgmap v10602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:33 smithi196 ceph-mon[32572]: pgmap v10602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:33 smithi110 ceph-mon[28069]: pgmap v10602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:35 smithi193 ceph-mon[32782]: pgmap v10603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:35 smithi196 ceph-mon[32572]: pgmap v10603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:35 smithi110 ceph-mon[28069]: pgmap v10603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:37 smithi193 ceph-mon[32782]: pgmap v10604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19232.185363 secs 2024-04-26T17:08:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:37 smithi196 ceph-mon[32572]: pgmap v10604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19232.185363 secs 2024-04-26T17:08:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:37 smithi110 ceph-mon[28069]: pgmap v10604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19232.185363 secs 2024-04-26T17:08:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:39 smithi193 ceph-mon[32782]: pgmap v10605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:39 smithi196 ceph-mon[32572]: pgmap v10605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:39 smithi110 ceph-mon[28069]: pgmap v10605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:41 smithi193 ceph-mon[32782]: pgmap v10606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:41 smithi196 ceph-mon[32572]: pgmap v10606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:41 smithi110 ceph-mon[28069]: pgmap v10606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19237.185486 secs 2024-04-26T17:08:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19237.185486 secs 2024-04-26T17:08:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19237.185486 secs 2024-04-26T17:08:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:43 smithi193 ceph-mon[32782]: pgmap v10607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:43 smithi196 ceph-mon[32572]: pgmap v10607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:43 smithi110 ceph-mon[28069]: pgmap v10607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:44 smithi196 ceph-mon[32572]: pgmap v10608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:44 smithi110 ceph-mon[28069]: pgmap v10608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:44 smithi193 ceph-mon[32782]: pgmap v10608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:46 smithi196 ceph-mon[32572]: pgmap v10609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:46 smithi110 ceph-mon[28069]: pgmap v10609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:46 smithi193 ceph-mon[32782]: pgmap v10609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19242.185581 secs 2024-04-26T17:08:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19242.185581 secs 2024-04-26T17:08:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19242.185581 secs 2024-04-26T17:08:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:48 smithi196 ceph-mon[32572]: pgmap v10610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:48 smithi110 ceph-mon[28069]: pgmap v10610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:48 smithi193 ceph-mon[32782]: pgmap v10610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:08:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:50 smithi196 ceph-mon[32572]: pgmap v10611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:08:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:50 smithi110 ceph-mon[28069]: pgmap v10611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:08:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:50 smithi193 ceph-mon[32782]: pgmap v10611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:08:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:08:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:08:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:08:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:51 smithi196 ceph-mon[32572]: pgmap v10612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T17:08:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:51 smithi196 ceph-mon[32572]: pgmap v10613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:08:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:08:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:08:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:51 smithi110 ceph-mon[28069]: pgmap v10612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T17:08:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:51 smithi110 ceph-mon[28069]: pgmap v10613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:08:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:08:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:08:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:51 smithi193 ceph-mon[32782]: pgmap v10612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T17:08:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:51 smithi193 ceph-mon[32782]: pgmap v10613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:08:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19247.185720 secs 2024-04-26T17:08:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19247.185720 secs 2024-04-26T17:08:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19247.185720 secs 2024-04-26T17:08:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:53 smithi196 ceph-mon[32572]: pgmap v10614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:53 smithi110 ceph-mon[28069]: pgmap v10614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:53 smithi193 ceph-mon[32782]: pgmap v10614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:56 smithi110 ceph-mon[28069]: pgmap v10615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:56 smithi193 ceph-mon[32782]: pgmap v10615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:57.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:56 smithi196 ceph-mon[32572]: pgmap v10615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19252.185816 secs 2024-04-26T17:08:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19252.185816 secs 2024-04-26T17:08:57.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19252.185816 secs 2024-04-26T17:08:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:08:58 smithi110 ceph-mon[28069]: pgmap v10616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:08:58 smithi193 ceph-mon[32782]: pgmap v10616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:08:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:08:58 smithi196 ceph-mon[32572]: pgmap v10616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:00 smithi193 ceph-mon[32782]: pgmap v10617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:00 smithi196 ceph-mon[32572]: pgmap v10617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:00 smithi110 ceph-mon[28069]: pgmap v10617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:02 smithi193 ceph-mon[32782]: pgmap v10618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:09:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19257.185935 secs 2024-04-26T17:09:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:02 smithi196 ceph-mon[32572]: pgmap v10618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:09:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19257.185935 secs 2024-04-26T17:09:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:02 smithi110 ceph-mon[28069]: pgmap v10618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:09:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19257.185935 secs 2024-04-26T17:09:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:04 smithi193 ceph-mon[32782]: pgmap v10619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:04 smithi196 ceph-mon[32572]: pgmap v10619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:04 smithi110 ceph-mon[28069]: pgmap v10619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:06 smithi193 ceph-mon[32782]: pgmap v10620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:06 smithi196 ceph-mon[32572]: pgmap v10620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:06 smithi110 ceph-mon[28069]: pgmap v10620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19262.186074 secs 2024-04-26T17:09:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19262.186074 secs 2024-04-26T17:09:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19262.186074 secs 2024-04-26T17:09:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:08 smithi193 ceph-mon[32782]: pgmap v10621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:08 smithi196 ceph-mon[32572]: pgmap v10621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:08 smithi110 ceph-mon[28069]: pgmap v10621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:10.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:09:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:09:09.559+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:09:10.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:09:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:09:09.559+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:09:10.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:09:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:09:09.559+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:09:10.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:09:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:09:09.559+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:09:10.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:09:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:09:09.559+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:09:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:10 smithi193 ceph-mon[32782]: pgmap v10622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:10 smithi196 ceph-mon[32572]: pgmap v10622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:10 smithi110 ceph-mon[28069]: pgmap v10622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:12 smithi193 ceph-mon[32782]: pgmap v10623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19267.186198 secs 2024-04-26T17:09:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:12 smithi196 ceph-mon[32572]: pgmap v10623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19267.186198 secs 2024-04-26T17:09:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:12 smithi110 ceph-mon[28069]: pgmap v10623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19267.186198 secs 2024-04-26T17:09:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:14 smithi193 ceph-mon[32782]: pgmap v10624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:09:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:14 smithi196 ceph-mon[32572]: pgmap v10624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:09:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:14 smithi110 ceph-mon[28069]: pgmap v10624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:09:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:16 smithi193 ceph-mon[32782]: pgmap v10625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:09:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:16 smithi196 ceph-mon[32572]: pgmap v10625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:09:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:16 smithi110 ceph-mon[28069]: pgmap v10625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:09:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19272.186314 secs 2024-04-26T17:09:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19272.186314 secs 2024-04-26T17:09:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19272.186314 secs 2024-04-26T17:09:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:18 smithi193 ceph-mon[32782]: pgmap v10626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:09:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:18 smithi196 ceph-mon[32572]: pgmap v10626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:09:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:18 smithi110 ceph-mon[28069]: pgmap v10626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:09:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:09:19.550+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:09:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:09:19.550+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T17:09:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:09:19.550+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 150 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T17:09:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:09:19.550+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 150 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:09:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:20 smithi193 ceph-mon[32782]: pgmap v10627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:09:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:20 smithi196 ceph-mon[32572]: pgmap v10627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:09:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:20 smithi110 ceph-mon[28069]: pgmap v10627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:09:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:22 smithi193 ceph-mon[32782]: pgmap v10628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:09:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19277.186454 secs 2024-04-26T17:09:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:22 smithi196 ceph-mon[32572]: pgmap v10628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:09:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19277.186454 secs 2024-04-26T17:09:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:22 smithi110 ceph-mon[28069]: pgmap v10628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:09:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19277.186454 secs 2024-04-26T17:09:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:24 smithi193 ceph-mon[32782]: pgmap v10629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:09:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:24 smithi196 ceph-mon[32572]: pgmap v10629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:09:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:24 smithi110 ceph-mon[28069]: pgmap v10629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:09:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:26 smithi196 ceph-mon[32572]: pgmap v10630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:26 smithi110 ceph-mon[28069]: pgmap v10630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:26 smithi193 ceph-mon[32782]: pgmap v10630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:27.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19282.186543 secs 2024-04-26T17:09:27.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:27 smithi196 ceph-mon[32572]: pgmap v10631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:28.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19282.186543 secs 2024-04-26T17:09:28.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:27 smithi193 ceph-mon[32782]: pgmap v10631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19282.186543 secs 2024-04-26T17:09:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:27 smithi110 ceph-mon[28069]: pgmap v10631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:30 smithi193 ceph-mon[32782]: pgmap v10632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:30 smithi196 ceph-mon[32572]: pgmap v10632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:30 smithi110 ceph-mon[28069]: pgmap v10632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:32 smithi193 ceph-mon[32782]: pgmap v10633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19287.186638 secs 2024-04-26T17:09:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:32 smithi196 ceph-mon[32572]: pgmap v10633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19287.186638 secs 2024-04-26T17:09:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:32 smithi110 ceph-mon[28069]: pgmap v10633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19287.186638 secs 2024-04-26T17:09:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:34 smithi193 ceph-mon[32782]: pgmap v10634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:34 smithi196 ceph-mon[32572]: pgmap v10634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:34 smithi110 ceph-mon[28069]: pgmap v10634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:36 smithi193 ceph-mon[32782]: pgmap v10635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:36 smithi196 ceph-mon[32572]: pgmap v10635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:36 smithi110 ceph-mon[28069]: pgmap v10635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19292.186750 secs 2024-04-26T17:09:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19292.186750 secs 2024-04-26T17:09:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19292.186750 secs 2024-04-26T17:09:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:38 smithi193 ceph-mon[32782]: pgmap v10636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:38 smithi196 ceph-mon[32572]: pgmap v10636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:38 smithi110 ceph-mon[28069]: pgmap v10636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:40 smithi193 ceph-mon[32782]: pgmap v10637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:40 smithi196 ceph-mon[32572]: pgmap v10637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:40 smithi110 ceph-mon[28069]: pgmap v10637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19297.186903 secs 2024-04-26T17:09:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:42 smithi193 ceph-mon[32782]: pgmap v10638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19297.186903 secs 2024-04-26T17:09:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:42 smithi196 ceph-mon[32572]: pgmap v10638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19297.186903 secs 2024-04-26T17:09:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:42 smithi110 ceph-mon[28069]: pgmap v10638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:44 smithi193 ceph-mon[32782]: pgmap v10639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:44 smithi196 ceph-mon[32572]: pgmap v10639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:44 smithi110 ceph-mon[28069]: pgmap v10639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:46 smithi193 ceph-mon[32782]: pgmap v10640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:46 smithi196 ceph-mon[32572]: pgmap v10640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:46 smithi110 ceph-mon[28069]: pgmap v10640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19302.187018 secs 2024-04-26T17:09:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19302.187018 secs 2024-04-26T17:09:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19302.187018 secs 2024-04-26T17:09:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:48 smithi193 ceph-mon[32782]: pgmap v10641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:48 smithi196 ceph-mon[32572]: pgmap v10641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:48 smithi110 ceph-mon[28069]: pgmap v10641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:09:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:50 smithi193 ceph-mon[32782]: pgmap v10642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:50 smithi196 ceph-mon[32572]: pgmap v10642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:50 smithi110 ceph-mon[28069]: pgmap v10642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19307.187147 secs 2024-04-26T17:09:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:52 smithi196 ceph-mon[32572]: pgmap v10643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:09:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19307.187147 secs 2024-04-26T17:09:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:52 smithi110 ceph-mon[28069]: pgmap v10643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:09:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19307.187147 secs 2024-04-26T17:09:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:52 smithi193 ceph-mon[32782]: pgmap v10643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:09:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:09:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:09:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:09:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:09:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:09:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:09:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:09:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:09:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:09:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:09:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:54 smithi196 ceph-mon[32572]: pgmap v10644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:09:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:54 smithi196 ceph-mon[32572]: pgmap v10645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:54 smithi110 ceph-mon[28069]: pgmap v10644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:09:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:54 smithi110 ceph-mon[28069]: pgmap v10645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:54 smithi193 ceph-mon[32782]: pgmap v10644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:09:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:54 smithi193 ceph-mon[32782]: pgmap v10645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:55 smithi196 ceph-mon[32572]: pgmap v10646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:55 smithi110 ceph-mon[28069]: pgmap v10646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:55 smithi193 ceph-mon[32782]: pgmap v10646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:09:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19312.187280 secs 2024-04-26T17:09:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19312.187280 secs 2024-04-26T17:09:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19312.187280 secs 2024-04-26T17:09:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:09:58 smithi196 ceph-mon[32572]: pgmap v10647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T17:09:58.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:09:58 smithi193 ceph-mon[32782]: pgmap v10647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T17:09:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:09:58 smithi110 ceph-mon[28069]: pgmap v10647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T17:10:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:00 smithi196 ceph-mon[32572]: pgmap v10648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:10:00.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:10:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:00 smithi110 ceph-mon[28069]: pgmap v10648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:10:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:10:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:00 smithi193 ceph-mon[32782]: pgmap v10648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:10:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:10:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:02 smithi196 ceph-mon[32572]: pgmap v10649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:10:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19317.187364 secs 2024-04-26T17:10:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:02 smithi110 ceph-mon[28069]: pgmap v10649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:10:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19317.187364 secs 2024-04-26T17:10:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:02 smithi193 ceph-mon[32782]: pgmap v10649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:10:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19317.187364 secs 2024-04-26T17:10:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:04 smithi196 ceph-mon[32572]: pgmap v10650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:10:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:04 smithi110 ceph-mon[28069]: pgmap v10650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:10:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:10:04.558+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T17:10:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:10:04.558+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:10:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:10:04.558+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 151 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T17:10:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:10:04.558+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 151 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:10:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:04 smithi193 ceph-mon[32782]: pgmap v10650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:10:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:06 smithi196 ceph-mon[32572]: pgmap v10651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:06 smithi110 ceph-mon[28069]: pgmap v10651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:06 smithi193 ceph-mon[32782]: pgmap v10651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19322.187437 secs 2024-04-26T17:10:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19322.187437 secs 2024-04-26T17:10:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19322.187437 secs 2024-04-26T17:10:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:08 smithi196 ceph-mon[32572]: pgmap v10652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:08 smithi110 ceph-mon[28069]: pgmap v10652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:08 smithi193 ceph-mon[32782]: pgmap v10652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:10 smithi196 ceph-mon[32572]: pgmap v10653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:10 smithi110 ceph-mon[28069]: pgmap v10653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:10 smithi193 ceph-mon[32782]: pgmap v10653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:12 smithi196 ceph-mon[32572]: pgmap v10654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19327.187554 secs 2024-04-26T17:10:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:12 smithi110 ceph-mon[28069]: pgmap v10654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19327.187554 secs 2024-04-26T17:10:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:12 smithi193 ceph-mon[32782]: pgmap v10654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19327.187554 secs 2024-04-26T17:10:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:14 smithi196 ceph-mon[32572]: pgmap v10655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:14 smithi110 ceph-mon[28069]: pgmap v10655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:14 smithi193 ceph-mon[32782]: pgmap v10655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:16 smithi196 ceph-mon[32572]: pgmap v10656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:16 smithi110 ceph-mon[28069]: pgmap v10656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:16 smithi193 ceph-mon[32782]: pgmap v10656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19332.187652 secs 2024-04-26T17:10:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19332.187652 secs 2024-04-26T17:10:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19332.187652 secs 2024-04-26T17:10:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:18 smithi196 ceph-mon[32572]: pgmap v10657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:18 smithi110 ceph-mon[28069]: pgmap v10657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:18 smithi193 ceph-mon[32782]: pgmap v10657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:20 smithi196 ceph-mon[32572]: pgmap v10658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:20 smithi110 ceph-mon[28069]: pgmap v10658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:20 smithi193 ceph-mon[32782]: pgmap v10658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:22 smithi196 ceph-mon[32572]: pgmap v10659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19337.187773 secs 2024-04-26T17:10:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:22 smithi110 ceph-mon[28069]: pgmap v10659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19337.187773 secs 2024-04-26T17:10:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:22 smithi193 ceph-mon[32782]: pgmap v10659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19337.187773 secs 2024-04-26T17:10:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:24 smithi196 ceph-mon[32572]: pgmap v10660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:24 smithi110 ceph-mon[28069]: pgmap v10660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:24 smithi193 ceph-mon[32782]: pgmap v10660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:26 smithi196 ceph-mon[32572]: pgmap v10661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:26 smithi110 ceph-mon[28069]: pgmap v10661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:26 smithi193 ceph-mon[32782]: pgmap v10661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19342.187911 secs 2024-04-26T17:10:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19342.187911 secs 2024-04-26T17:10:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19342.187911 secs 2024-04-26T17:10:28.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:28 smithi193 ceph-mon[32782]: pgmap v10662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:28 smithi110 ceph-mon[28069]: pgmap v10662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:28.680 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:28 smithi196 ceph-mon[32572]: pgmap v10662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:30 smithi110 ceph-mon[28069]: pgmap v10663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:30 smithi193 ceph-mon[32782]: pgmap v10663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:30 smithi196 ceph-mon[32572]: pgmap v10663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:32 smithi110 ceph-mon[28069]: pgmap v10664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19347.188050 secs 2024-04-26T17:10:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:32 smithi193 ceph-mon[32782]: pgmap v10664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19347.188050 secs 2024-04-26T17:10:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:32 smithi196 ceph-mon[32572]: pgmap v10664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19347.188050 secs 2024-04-26T17:10:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:34 smithi110 ceph-mon[28069]: pgmap v10665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:34 smithi193 ceph-mon[32782]: pgmap v10665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:34 smithi196 ceph-mon[32572]: pgmap v10665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:36 smithi110 ceph-mon[28069]: pgmap v10666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:36 smithi193 ceph-mon[32782]: pgmap v10666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:36 smithi196 ceph-mon[32572]: pgmap v10666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19352.188158 secs 2024-04-26T17:10:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19352.188158 secs 2024-04-26T17:10:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19352.188158 secs 2024-04-26T17:10:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:38 smithi193 ceph-mon[32782]: pgmap v10667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:38 smithi196 ceph-mon[32572]: pgmap v10667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:38 smithi110 ceph-mon[28069]: pgmap v10667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:40 smithi193 ceph-mon[32782]: pgmap v10668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:40 smithi196 ceph-mon[32572]: pgmap v10668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:40 smithi110 ceph-mon[28069]: pgmap v10668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:42 smithi193 ceph-mon[32782]: pgmap v10669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19357.188295 secs 2024-04-26T17:10:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:42 smithi196 ceph-mon[32572]: pgmap v10669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19357.188295 secs 2024-04-26T17:10:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:42 smithi110 ceph-mon[28069]: pgmap v10669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19357.188295 secs 2024-04-26T17:10:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:44 smithi193 ceph-mon[32782]: pgmap v10670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:44 smithi196 ceph-mon[32572]: pgmap v10670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:44 smithi110 ceph-mon[28069]: pgmap v10670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:46 smithi193 ceph-mon[32782]: pgmap v10671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:46 smithi196 ceph-mon[32572]: pgmap v10671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:46 smithi110 ceph-mon[28069]: pgmap v10671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19362.188408 secs 2024-04-26T17:10:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19362.188408 secs 2024-04-26T17:10:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19362.188408 secs 2024-04-26T17:10:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:48 smithi193 ceph-mon[32782]: pgmap v10672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:48 smithi196 ceph-mon[32572]: pgmap v10672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:48 smithi110 ceph-mon[28069]: pgmap v10672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:50.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:50 smithi110 ceph-mon[28069]: pgmap v10673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:50 smithi193 ceph-mon[32782]: pgmap v10673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:50 smithi196 ceph-mon[32572]: pgmap v10673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:52 smithi193 ceph-mon[32782]: pgmap v10674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19367.188525 secs 2024-04-26T17:10:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:52 smithi196 ceph-mon[32572]: pgmap v10674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19367.188525 secs 2024-04-26T17:10:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:52 smithi110 ceph-mon[28069]: pgmap v10674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:10:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19367.188525 secs 2024-04-26T17:10:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:54 smithi193 ceph-mon[32782]: pgmap v10675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:10:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:54 smithi196 ceph-mon[32572]: pgmap v10675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:10:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:54 smithi110 ceph-mon[28069]: pgmap v10675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:10:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:10:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:10:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:10:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:55 smithi193 ceph-mon[32782]: pgmap v10676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T17:10:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:55 smithi193 ceph-mon[32782]: pgmap v10677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:10:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:10:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:10:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:10:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:55 smithi196 ceph-mon[32572]: pgmap v10676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T17:10:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:55 smithi196 ceph-mon[32572]: pgmap v10677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:10:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:10:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:10:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:10:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:55 smithi110 ceph-mon[28069]: pgmap v10676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T17:10:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:55 smithi110 ceph-mon[28069]: pgmap v10677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:10:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:10:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19372.188639 secs 2024-04-26T17:10:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:57 smithi193 ceph-mon[32782]: pgmap v10678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:10:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19372.188639 secs 2024-04-26T17:10:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:57 smithi196 ceph-mon[32572]: pgmap v10678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:10:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19372.188639 secs 2024-04-26T17:10:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:57 smithi110 ceph-mon[28069]: pgmap v10678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:10:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:10:59 smithi193 ceph-mon[32782]: pgmap v10679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:11:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:10:59 smithi196 ceph-mon[32572]: pgmap v10679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:11:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:10:59 smithi110 ceph-mon[28069]: pgmap v10679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:11:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:01 smithi196 ceph-mon[32572]: pgmap v10680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:11:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:01 smithi110 ceph-mon[28069]: pgmap v10680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:11:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:01 smithi193 ceph-mon[32782]: pgmap v10680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:11:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19377.188758 secs 2024-04-26T17:11:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19377.188758 secs 2024-04-26T17:11:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19377.188758 secs 2024-04-26T17:11:04.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:03 smithi196 ceph-mon[32572]: pgmap v10681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:11:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:03 smithi110 ceph-mon[28069]: pgmap v10681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:11:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:03 smithi193 ceph-mon[32782]: pgmap v10681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:11:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:04 smithi196 ceph-mon[32572]: pgmap v10682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:11:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:04 smithi110 ceph-mon[28069]: pgmap v10682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:11:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:04 smithi193 ceph-mon[32782]: pgmap v10682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:11:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:07 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 19382.188847 secs 2024-04-26T17:11:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:07 smithi193 ceph-mon[32782]: slow request 11522.486369 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:11:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:07 smithi193 ceph-mon[32782]: pgmap v10683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:07 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 19382.188847 secs 2024-04-26T17:11:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:07 smithi196 ceph-mon[32572]: slow request 11522.486369 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:11:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:07 smithi196 ceph-mon[32572]: pgmap v10683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:07 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 19382.188847 secs 2024-04-26T17:11:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:07 smithi110 ceph-mon[28069]: slow request 11522.486369 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:11:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:07 smithi110 ceph-mon[28069]: pgmap v10683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:09 smithi196 ceph-mon[32572]: pgmap v10684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:09 smithi110 ceph-mon[28069]: pgmap v10684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:09 smithi193 ceph-mon[32782]: pgmap v10684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:11 smithi196 ceph-mon[32572]: pgmap v10685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:11 smithi110 ceph-mon[28069]: pgmap v10685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:11 smithi193 ceph-mon[32782]: pgmap v10685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19387.188960 secs 2024-04-26T17:11:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19387.188960 secs 2024-04-26T17:11:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19387.188960 secs 2024-04-26T17:11:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:13 smithi196 ceph-mon[32572]: pgmap v10686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:13 smithi110 ceph-mon[28069]: pgmap v10686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:13 smithi193 ceph-mon[32782]: pgmap v10686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:14 smithi196 ceph-mon[32572]: pgmap v10687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:14 smithi110 ceph-mon[28069]: pgmap v10687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:14 smithi193 ceph-mon[32782]: pgmap v10687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19392.189075 secs 2024-04-26T17:11:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:17 smithi196 ceph-mon[32572]: pgmap v10688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19392.189075 secs 2024-04-26T17:11:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:17 smithi110 ceph-mon[28069]: pgmap v10688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19392.189075 secs 2024-04-26T17:11:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:17 smithi193 ceph-mon[32782]: pgmap v10688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:19 smithi196 ceph-mon[32572]: pgmap v10689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:19 smithi110 ceph-mon[28069]: pgmap v10689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:19 smithi193 ceph-mon[32782]: pgmap v10689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:21 smithi196 ceph-mon[32572]: pgmap v10690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:21 smithi110 ceph-mon[28069]: pgmap v10690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:21 smithi193 ceph-mon[32782]: pgmap v10690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19397.189196 secs 2024-04-26T17:11:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19397.189196 secs 2024-04-26T17:11:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19397.189196 secs 2024-04-26T17:11:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:23 smithi196 ceph-mon[32572]: pgmap v10691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:23 smithi110 ceph-mon[28069]: pgmap v10691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:23 smithi193 ceph-mon[32782]: pgmap v10691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:24 smithi196 ceph-mon[32572]: pgmap v10692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:24 smithi110 ceph-mon[28069]: pgmap v10692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:24 smithi193 ceph-mon[32782]: pgmap v10692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19402.189255 secs 2024-04-26T17:11:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:27 smithi196 ceph-mon[32572]: pgmap v10693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19402.189255 secs 2024-04-26T17:11:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:27 smithi110 ceph-mon[28069]: pgmap v10693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19402.189255 secs 2024-04-26T17:11:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:27 smithi193 ceph-mon[32782]: pgmap v10693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:29.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:29 smithi193 ceph-mon[32782]: pgmap v10694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:29 smithi196 ceph-mon[32572]: pgmap v10694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:29 smithi110 ceph-mon[28069]: pgmap v10694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:31 smithi196 ceph-mon[32572]: pgmap v10695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:31 smithi110 ceph-mon[28069]: pgmap v10695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:31 smithi193 ceph-mon[32782]: pgmap v10695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19407.189329 secs 2024-04-26T17:11:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19407.189329 secs 2024-04-26T17:11:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19407.189329 secs 2024-04-26T17:11:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:33 smithi196 ceph-mon[32572]: pgmap v10696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:33 smithi110 ceph-mon[28069]: pgmap v10696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:33 smithi193 ceph-mon[32782]: pgmap v10696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:34 smithi196 ceph-mon[32572]: pgmap v10697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:34 smithi110 ceph-mon[28069]: pgmap v10697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:34 smithi193 ceph-mon[32782]: pgmap v10697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19412.189463 secs 2024-04-26T17:11:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:37 smithi196 ceph-mon[32572]: pgmap v10698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19412.189463 secs 2024-04-26T17:11:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:37 smithi110 ceph-mon[28069]: pgmap v10698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19412.189463 secs 2024-04-26T17:11:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:37 smithi193 ceph-mon[32782]: pgmap v10698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:39 smithi196 ceph-mon[32572]: pgmap v10699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:39 smithi110 ceph-mon[28069]: pgmap v10699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:39 smithi193 ceph-mon[32782]: pgmap v10699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:42.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:41 smithi196 ceph-mon[32572]: pgmap v10700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:41 smithi110 ceph-mon[28069]: pgmap v10700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:41 smithi193 ceph-mon[32782]: pgmap v10700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19417.189622 secs 2024-04-26T17:11:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19417.189622 secs 2024-04-26T17:11:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19417.189622 secs 2024-04-26T17:11:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:43 smithi196 ceph-mon[32572]: pgmap v10701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:43 smithi110 ceph-mon[28069]: pgmap v10701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:43 smithi193 ceph-mon[32782]: pgmap v10701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:44 smithi196 ceph-mon[32572]: pgmap v10702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:44 smithi110 ceph-mon[28069]: pgmap v10702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:44 smithi193 ceph-mon[32782]: pgmap v10702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19422.189731 secs 2024-04-26T17:11:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:47 smithi196 ceph-mon[32572]: pgmap v10703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19422.189731 secs 2024-04-26T17:11:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:47 smithi110 ceph-mon[28069]: pgmap v10703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19422.189731 secs 2024-04-26T17:11:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:47 smithi193 ceph-mon[32782]: pgmap v10703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:49 smithi196 ceph-mon[32572]: pgmap v10704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:49 smithi110 ceph-mon[28069]: pgmap v10704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:49 smithi193 ceph-mon[32782]: pgmap v10704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:51 smithi196 ceph-mon[32572]: pgmap v10705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:51 smithi110 ceph-mon[28069]: pgmap v10705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:51 smithi193 ceph-mon[32782]: pgmap v10705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19427.189848 secs 2024-04-26T17:11:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:52 smithi196 ceph-mon[32572]: pgmap v10706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19427.189848 secs 2024-04-26T17:11:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:52 smithi110 ceph-mon[28069]: pgmap v10706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19427.189848 secs 2024-04-26T17:11:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:52 smithi193 ceph-mon[32782]: pgmap v10706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:11:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:55 smithi196 ceph-mon[32572]: pgmap v10707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:11:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:55 smithi110 ceph-mon[28069]: pgmap v10707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:11:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:55 smithi193 ceph-mon[32782]: pgmap v10707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:11:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:11:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:11:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:56 smithi196 ceph-mon[32572]: pgmap v10708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:11:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:11:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:56 smithi110 ceph-mon[28069]: pgmap v10708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:11:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:11:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:56 smithi193 ceph-mon[32782]: pgmap v10708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:11:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19432.189997 secs 2024-04-26T17:11:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:11:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:11:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:57 smithi196 ceph-mon[32572]: pgmap v10709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T17:11:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:57 smithi196 ceph-mon[32572]: pgmap v10710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T17:11:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:11:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:11:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19432.189997 secs 2024-04-26T17:11:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:11:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:11:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:57 smithi110 ceph-mon[28069]: pgmap v10709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T17:11:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:57 smithi110 ceph-mon[28069]: pgmap v10710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T17:11:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:11:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:11:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19432.189997 secs 2024-04-26T17:11:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:11:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:11:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:57 smithi193 ceph-mon[32782]: pgmap v10709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T17:11:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:57 smithi193 ceph-mon[32782]: pgmap v10710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T17:11:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:11:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:00 smithi193 ceph-mon[32782]: pgmap v10711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:00 smithi196 ceph-mon[32572]: pgmap v10711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:00 smithi110 ceph-mon[28069]: pgmap v10711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:02 smithi193 ceph-mon[32782]: pgmap v10712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T17:12:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:02 smithi196 ceph-mon[32572]: pgmap v10712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T17:12:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:02 smithi110 ceph-mon[28069]: pgmap v10712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T17:12:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:03 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19437.190064 secs 2024-04-26T17:12:03.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:03 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19437.190064 secs 2024-04-26T17:12:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:03 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19437.190064 secs 2024-04-26T17:12:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:04 smithi193 ceph-mon[32782]: pgmap v10713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:04 smithi196 ceph-mon[32572]: pgmap v10713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:04 smithi110 ceph-mon[28069]: pgmap v10713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:06 smithi193 ceph-mon[32782]: pgmap v10714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:06 smithi196 ceph-mon[32572]: pgmap v10714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:06 smithi110 ceph-mon[28069]: pgmap v10714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:08 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19442.190194 secs 2024-04-26T17:12:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:08 smithi193 ceph-mon[32782]: pgmap v10715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:12:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:08 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19442.190194 secs 2024-04-26T17:12:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:08 smithi196 ceph-mon[32572]: pgmap v10715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:12:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:08 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19442.190194 secs 2024-04-26T17:12:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:08 smithi110 ceph-mon[28069]: pgmap v10715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:12:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:10 smithi193 ceph-mon[32782]: pgmap v10716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:10 smithi196 ceph-mon[32572]: pgmap v10716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:10 smithi110 ceph-mon[28069]: pgmap v10716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:12 smithi196 ceph-mon[32572]: pgmap v10717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:12 smithi110 ceph-mon[28069]: pgmap v10717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:12 smithi193 ceph-mon[32782]: pgmap v10717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:13 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19447.190312 secs 2024-04-26T17:12:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:13 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19447.190312 secs 2024-04-26T17:12:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:13 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19447.190312 secs 2024-04-26T17:12:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:14 smithi196 ceph-mon[32572]: pgmap v10718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:14 smithi110 ceph-mon[28069]: pgmap v10718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:14 smithi193 ceph-mon[32782]: pgmap v10718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:16 smithi196 ceph-mon[32572]: pgmap v10719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:16 smithi110 ceph-mon[28069]: pgmap v10719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:16 smithi193 ceph-mon[32782]: pgmap v10719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19452.190435 secs 2024-04-26T17:12:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19452.190435 secs 2024-04-26T17:12:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19452.190435 secs 2024-04-26T17:12:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:18 smithi196 ceph-mon[32572]: pgmap v10720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:18 smithi110 ceph-mon[28069]: pgmap v10720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:18 smithi193 ceph-mon[32782]: pgmap v10720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:12:19.580+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:12:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:12:19.580+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T17:12:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:12:19.580+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 152 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T17:12:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:12:19.580+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 152 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:12:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:20 smithi196 ceph-mon[32572]: pgmap v10721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:20 smithi110 ceph-mon[28069]: pgmap v10721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:20 smithi193 ceph-mon[32782]: pgmap v10721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:22 smithi196 ceph-mon[32572]: pgmap v10722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19457.190555 secs 2024-04-26T17:12:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:22 smithi110 ceph-mon[28069]: pgmap v10722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19457.190555 secs 2024-04-26T17:12:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:22 smithi193 ceph-mon[32782]: pgmap v10722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19457.190555 secs 2024-04-26T17:12:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:24 smithi196 ceph-mon[32572]: pgmap v10723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:24 smithi110 ceph-mon[28069]: pgmap v10723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:24 smithi193 ceph-mon[32782]: pgmap v10723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:26 smithi196 ceph-mon[32572]: pgmap v10724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:26 smithi110 ceph-mon[28069]: pgmap v10724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:26 smithi193 ceph-mon[32782]: pgmap v10724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19462.190670 secs 2024-04-26T17:12:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19462.190670 secs 2024-04-26T17:12:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19462.190670 secs 2024-04-26T17:12:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:28 smithi196 ceph-mon[32572]: pgmap v10725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:28 smithi110 ceph-mon[28069]: pgmap v10725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:28 smithi193 ceph-mon[32782]: pgmap v10725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:30 smithi196 ceph-mon[32572]: pgmap v10726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:30 smithi110 ceph-mon[28069]: pgmap v10726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:30 smithi193 ceph-mon[32782]: pgmap v10726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:32 smithi196 ceph-mon[32572]: pgmap v10727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19467.190749 secs 2024-04-26T17:12:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:32 smithi110 ceph-mon[28069]: pgmap v10727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19467.190749 secs 2024-04-26T17:12:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:32 smithi193 ceph-mon[32782]: pgmap v10727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19467.190749 secs 2024-04-26T17:12:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:34 smithi196 ceph-mon[32572]: pgmap v10728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:34 smithi110 ceph-mon[28069]: pgmap v10728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:34 smithi193 ceph-mon[32782]: pgmap v10728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:36 smithi196 ceph-mon[32572]: pgmap v10729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:36 smithi110 ceph-mon[28069]: pgmap v10729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:36 smithi193 ceph-mon[32782]: pgmap v10729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19472.190863 secs 2024-04-26T17:12:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19472.190863 secs 2024-04-26T17:12:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19472.190863 secs 2024-04-26T17:12:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:38 smithi196 ceph-mon[32572]: pgmap v10730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:38 smithi110 ceph-mon[28069]: pgmap v10730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:38 smithi193 ceph-mon[32782]: pgmap v10730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:40 smithi196 ceph-mon[32572]: pgmap v10731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:40 smithi110 ceph-mon[28069]: pgmap v10731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:40 smithi193 ceph-mon[32782]: pgmap v10731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:42 smithi196 ceph-mon[32572]: pgmap v10732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19477.190987 secs 2024-04-26T17:12:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:42 smithi110 ceph-mon[28069]: pgmap v10732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19477.190987 secs 2024-04-26T17:12:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:42 smithi193 ceph-mon[32782]: pgmap v10732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19477.190987 secs 2024-04-26T17:12:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:44 smithi196 ceph-mon[32572]: pgmap v10733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:44 smithi110 ceph-mon[28069]: pgmap v10733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:44 smithi193 ceph-mon[32782]: pgmap v10733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:46 smithi196 ceph-mon[32572]: pgmap v10734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:46 smithi110 ceph-mon[28069]: pgmap v10734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:46 smithi193 ceph-mon[32782]: pgmap v10734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19482.191108 secs 2024-04-26T17:12:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19482.191108 secs 2024-04-26T17:12:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19482.191108 secs 2024-04-26T17:12:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:48 smithi196 ceph-mon[32572]: pgmap v10735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:48 smithi110 ceph-mon[28069]: pgmap v10735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:48 smithi193 ceph-mon[32782]: pgmap v10735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:50 smithi110 ceph-mon[28069]: pgmap v10736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:50 smithi193 ceph-mon[32782]: pgmap v10736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:50 smithi196 ceph-mon[32572]: pgmap v10736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:52 smithi110 ceph-mon[28069]: pgmap v10737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19487.191243 secs 2024-04-26T17:12:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:52 smithi193 ceph-mon[32782]: pgmap v10737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19487.191243 secs 2024-04-26T17:12:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:52 smithi196 ceph-mon[32572]: pgmap v10737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19487.191243 secs 2024-04-26T17:12:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:54 smithi110 ceph-mon[28069]: pgmap v10738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:54 smithi193 ceph-mon[32782]: pgmap v10738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:54 smithi196 ceph-mon[32572]: pgmap v10738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:12:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:56 smithi110 ceph-mon[28069]: pgmap v10739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:56 smithi193 ceph-mon[32782]: pgmap v10739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:56 smithi196 ceph-mon[32572]: pgmap v10739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:57.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19492.191345 secs 2024-04-26T17:12:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19492.191345 secs 2024-04-26T17:12:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19492.191345 secs 2024-04-26T17:12:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:58 smithi110 ceph-mon[28069]: pgmap v10740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:12:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:58 smithi193 ceph-mon[32782]: pgmap v10740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:12:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:58 smithi196 ceph-mon[32572]: pgmap v10740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:12:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:12:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:12:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:12:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:12:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:12:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:12:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:12:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:12:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:12:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:12:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:12:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:13:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:00 smithi193 ceph-mon[32782]: pgmap v10741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:13:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:00 smithi193 ceph-mon[32782]: pgmap v10742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:00.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:00 smithi196 ceph-mon[32572]: pgmap v10741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:13:00.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:00 smithi196 ceph-mon[32572]: pgmap v10742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:00 smithi110 ceph-mon[28069]: pgmap v10741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:13:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:00 smithi110 ceph-mon[28069]: pgmap v10742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:02 smithi193 ceph-mon[32782]: pgmap v10743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19497.191432 secs 2024-04-26T17:13:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:02 smithi196 ceph-mon[32572]: pgmap v10743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19497.191432 secs 2024-04-26T17:13:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:02 smithi110 ceph-mon[28069]: pgmap v10743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19497.191432 secs 2024-04-26T17:13:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:04 smithi193 ceph-mon[32782]: pgmap v10744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:04.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:04 smithi196 ceph-mon[32572]: pgmap v10744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:04 smithi110 ceph-mon[28069]: pgmap v10744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:06 smithi193 ceph-mon[32782]: pgmap v10745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:06.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:06 smithi196 ceph-mon[32572]: pgmap v10745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:06 smithi110 ceph-mon[28069]: pgmap v10745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19502.191582 secs 2024-04-26T17:13:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19502.191582 secs 2024-04-26T17:13:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19502.191582 secs 2024-04-26T17:13:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:08 smithi193 ceph-mon[32782]: pgmap v10746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:08 smithi196 ceph-mon[32572]: pgmap v10746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:08 smithi110 ceph-mon[28069]: pgmap v10746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:13:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:10 smithi193 ceph-mon[32782]: pgmap v10747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:13:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:10 smithi196 ceph-mon[32572]: pgmap v10747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:13:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:10 smithi110 ceph-mon[28069]: pgmap v10747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:13:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:12 smithi193 ceph-mon[32782]: pgmap v10748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19507.191708 secs 2024-04-26T17:13:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:12 smithi196 ceph-mon[32572]: pgmap v10748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19507.191708 secs 2024-04-26T17:13:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:12 smithi110 ceph-mon[28069]: pgmap v10748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19507.191708 secs 2024-04-26T17:13:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:14 smithi193 ceph-mon[32782]: pgmap v10749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:14 smithi196 ceph-mon[32572]: pgmap v10749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:14 smithi110 ceph-mon[28069]: pgmap v10749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:16 smithi193 ceph-mon[32782]: pgmap v10750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:16 smithi196 ceph-mon[32572]: pgmap v10750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:16 smithi110 ceph-mon[28069]: pgmap v10750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19512.191843 secs 2024-04-26T17:13:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19512.191843 secs 2024-04-26T17:13:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19512.191843 secs 2024-04-26T17:13:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:18 smithi193 ceph-mon[32782]: pgmap v10751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:18 smithi196 ceph-mon[32572]: pgmap v10751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:18 smithi110 ceph-mon[28069]: pgmap v10751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:20 smithi193 ceph-mon[32782]: pgmap v10752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:20 smithi196 ceph-mon[32572]: pgmap v10752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:20 smithi110 ceph-mon[28069]: pgmap v10752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:22 smithi196 ceph-mon[32572]: pgmap v10753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19517.191966 secs 2024-04-26T17:13:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:22 smithi110 ceph-mon[28069]: pgmap v10753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19517.191966 secs 2024-04-26T17:13:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:22 smithi193 ceph-mon[32782]: pgmap v10753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19517.191966 secs 2024-04-26T17:13:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:24 smithi196 ceph-mon[32572]: pgmap v10754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:24 smithi110 ceph-mon[28069]: pgmap v10754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:24 smithi193 ceph-mon[32782]: pgmap v10754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:26 smithi196 ceph-mon[32572]: pgmap v10755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:26 smithi110 ceph-mon[28069]: pgmap v10755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:26 smithi193 ceph-mon[32782]: pgmap v10755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19522.192103 secs 2024-04-26T17:13:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19522.192103 secs 2024-04-26T17:13:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19522.192103 secs 2024-04-26T17:13:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:28 smithi196 ceph-mon[32572]: pgmap v10756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:28 smithi110 ceph-mon[28069]: pgmap v10756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:28 smithi193 ceph-mon[32782]: pgmap v10756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:30.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:30 smithi193 ceph-mon[32782]: pgmap v10757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:30 smithi196 ceph-mon[32572]: pgmap v10757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:30 smithi110 ceph-mon[28069]: pgmap v10757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:32 smithi196 ceph-mon[32572]: pgmap v10758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19527.192199 secs 2024-04-26T17:13:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:32 smithi110 ceph-mon[28069]: pgmap v10758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19527.192199 secs 2024-04-26T17:13:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:32 smithi193 ceph-mon[32782]: pgmap v10758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19527.192199 secs 2024-04-26T17:13:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:34 smithi196 ceph-mon[32572]: pgmap v10759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:34 smithi110 ceph-mon[28069]: pgmap v10759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:34 smithi193 ceph-mon[32782]: pgmap v10759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:36 smithi196 ceph-mon[32572]: pgmap v10760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:36 smithi110 ceph-mon[28069]: pgmap v10760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:36 smithi193 ceph-mon[32782]: pgmap v10760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19532.192322 secs 2024-04-26T17:13:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19532.192322 secs 2024-04-26T17:13:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19532.192322 secs 2024-04-26T17:13:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:38 smithi196 ceph-mon[32572]: pgmap v10761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:38 smithi110 ceph-mon[28069]: pgmap v10761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:38 smithi193 ceph-mon[32782]: pgmap v10761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:40 smithi196 ceph-mon[32572]: pgmap v10762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:40 smithi110 ceph-mon[28069]: pgmap v10762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:40 smithi193 ceph-mon[32782]: pgmap v10762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:42 smithi196 ceph-mon[32572]: pgmap v10763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19537.192439 secs 2024-04-26T17:13:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:42 smithi110 ceph-mon[28069]: pgmap v10763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19537.192439 secs 2024-04-26T17:13:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:42 smithi193 ceph-mon[32782]: pgmap v10763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19537.192439 secs 2024-04-26T17:13:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:44 smithi196 ceph-mon[32572]: pgmap v10764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:44 smithi110 ceph-mon[28069]: pgmap v10764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:44 smithi193 ceph-mon[32782]: pgmap v10764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:46 smithi196 ceph-mon[32572]: pgmap v10765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:46 smithi110 ceph-mon[28069]: pgmap v10765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:46 smithi193 ceph-mon[32782]: pgmap v10765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19542.192555 secs 2024-04-26T17:13:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19542.192555 secs 2024-04-26T17:13:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19542.192555 secs 2024-04-26T17:13:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:48 smithi196 ceph-mon[32572]: pgmap v10766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:48 smithi110 ceph-mon[28069]: pgmap v10766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:48 smithi193 ceph-mon[32782]: pgmap v10766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:50 smithi196 ceph-mon[32572]: pgmap v10767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:50 smithi110 ceph-mon[28069]: pgmap v10767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:50 smithi193 ceph-mon[32782]: pgmap v10767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:52 smithi196 ceph-mon[32572]: pgmap v10768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19547.192676 secs 2024-04-26T17:13:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:52 smithi110 ceph-mon[28069]: pgmap v10768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19547.192676 secs 2024-04-26T17:13:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:52 smithi193 ceph-mon[32782]: pgmap v10768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19547.192676 secs 2024-04-26T17:13:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:54 smithi196 ceph-mon[32572]: pgmap v10769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:54 smithi110 ceph-mon[28069]: pgmap v10769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:54 smithi193 ceph-mon[32782]: pgmap v10769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:13:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:56 smithi196 ceph-mon[32572]: pgmap v10770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:56 smithi110 ceph-mon[28069]: pgmap v10770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:56 smithi193 ceph-mon[32782]: pgmap v10770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19552.192747 secs 2024-04-26T17:13:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19552.192747 secs 2024-04-26T17:13:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19552.192747 secs 2024-04-26T17:13:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:58 smithi196 ceph-mon[32572]: pgmap v10771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:58 smithi110 ceph-mon[28069]: pgmap v10771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:58 smithi193 ceph-mon[32782]: pgmap v10771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:13:59.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:13:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:13:59.826 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:13:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:13:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:13:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:14:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:00 smithi110 ceph-mon[28069]: pgmap v10772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:00 smithi193 ceph-mon[32782]: pgmap v10772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:00 smithi196 ceph-mon[32572]: pgmap v10772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: pgmap v10773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19557.192814 secs 2024-04-26T17:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: pgmap v10773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19557.192814 secs 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: pgmap v10773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19557.192814 secs 2024-04-26T17:14:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:03 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:14:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:03 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:14:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:03 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:14:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:03 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:14:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:03 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:14:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:03 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:14:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:03 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:14:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:03 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:14:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:03 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:14:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:03 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:14:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:03 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:14:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:03 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:14:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:04 smithi110 ceph-mon[28069]: pgmap v10774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:04 smithi193 ceph-mon[32782]: pgmap v10774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:04 smithi196 ceph-mon[32572]: pgmap v10774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:14:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:14:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: pgmap v10775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T17:14:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: pgmap v10776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: pgmap v10775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T17:14:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: pgmap v10776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:14:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:14:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:14:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: pgmap v10775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T17:14:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: pgmap v10776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:14:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:07 smithi196 ceph-mon[32572]: pgmap v10777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19562.192935 secs 2024-04-26T17:14:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:07 smithi110 ceph-mon[28069]: pgmap v10777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19562.192935 secs 2024-04-26T17:14:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:07 smithi193 ceph-mon[32782]: pgmap v10777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19562.192935 secs 2024-04-26T17:14:09.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:09 smithi196 ceph-mon[32572]: pgmap v10778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:09.786 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:09 smithi110 ceph-mon[28069]: pgmap v10778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:09 smithi193 ceph-mon[32782]: pgmap v10778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:10.040 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:14:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:14:09.784+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:14:10.040 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:14:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:14:09.784+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:14:10.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:14:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:14:09.784+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:14:10.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:14:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:14:09.784+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:14:10.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:14:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:14:09.784+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:14:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:11 smithi196 ceph-mon[32572]: pgmap v10779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:11 smithi110 ceph-mon[28069]: pgmap v10779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:11 smithi193 ceph-mon[32782]: pgmap v10779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:14:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19567.193078 secs 2024-04-26T17:14:12.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19567.193078 secs 2024-04-26T17:14:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19567.193078 secs 2024-04-26T17:14:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:13 smithi196 ceph-mon[32572]: pgmap v10780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 213 B/s wr, 15 op/s 2024-04-26T17:14:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:13 smithi110 ceph-mon[28069]: pgmap v10780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 213 B/s wr, 15 op/s 2024-04-26T17:14:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:13 smithi193 ceph-mon[32782]: pgmap v10780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 213 B/s wr, 15 op/s 2024-04-26T17:14:15.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:15 smithi196 ceph-mon[32572]: pgmap v10781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T17:14:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:15 smithi110 ceph-mon[28069]: pgmap v10781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T17:14:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:15 smithi193 ceph-mon[32782]: pgmap v10781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T17:14:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:17 smithi196 ceph-mon[32572]: pgmap v10782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T17:14:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19572.193194 secs 2024-04-26T17:14:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:17 smithi110 ceph-mon[28069]: pgmap v10782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T17:14:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19572.193194 secs 2024-04-26T17:14:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:17 smithi193 ceph-mon[32782]: pgmap v10782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T17:14:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19572.193194 secs 2024-04-26T17:14:19.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:19 smithi196 ceph-mon[32572]: pgmap v10783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T17:14:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:19 smithi110 ceph-mon[28069]: pgmap v10783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T17:14:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:19 smithi193 ceph-mon[32782]: pgmap v10783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T17:14:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:21 smithi196 ceph-mon[32572]: pgmap v10784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T17:14:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:21 smithi110 ceph-mon[28069]: pgmap v10784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T17:14:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:21 smithi193 ceph-mon[32782]: pgmap v10784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T17:14:22.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19577.193316 secs 2024-04-26T17:14:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19577.193316 secs 2024-04-26T17:14:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19577.193316 secs 2024-04-26T17:14:23.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:23 smithi196 ceph-mon[32572]: pgmap v10785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T17:14:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:23 smithi110 ceph-mon[28069]: pgmap v10785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T17:14:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:23 smithi193 ceph-mon[32782]: pgmap v10785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T17:14:25.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:25 smithi196 ceph-mon[32572]: pgmap v10786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T17:14:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:25 smithi110 ceph-mon[28069]: pgmap v10786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T17:14:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:25 smithi193 ceph-mon[32782]: pgmap v10786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T17:14:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:27 smithi196 ceph-mon[32572]: pgmap v10787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19582.193440 secs 2024-04-26T17:14:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:27 smithi110 ceph-mon[28069]: pgmap v10787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19582.193440 secs 2024-04-26T17:14:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:27 smithi193 ceph-mon[32782]: pgmap v10787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19582.193440 secs 2024-04-26T17:14:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:29 smithi196 ceph-mon[32572]: pgmap v10788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:29 smithi110 ceph-mon[28069]: pgmap v10788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:29 smithi193 ceph-mon[32782]: pgmap v10788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:31 smithi196 ceph-mon[32572]: pgmap v10789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:31 smithi110 ceph-mon[28069]: pgmap v10789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:31 smithi193 ceph-mon[32782]: pgmap v10789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19587.193576 secs 2024-04-26T17:14:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19587.193576 secs 2024-04-26T17:14:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19587.193576 secs 2024-04-26T17:14:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:33 smithi196 ceph-mon[32572]: pgmap v10790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:14:33.769 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:33 smithi110 ceph-mon[28069]: pgmap v10790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:14:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:33 smithi193 ceph-mon[32782]: pgmap v10790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:14:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:35 smithi196 ceph-mon[32572]: pgmap v10791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:35 smithi110 ceph-mon[28069]: pgmap v10791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:35 smithi193 ceph-mon[32782]: pgmap v10791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:37 smithi196 ceph-mon[32572]: pgmap v10792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19592.193720 secs 2024-04-26T17:14:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:37 smithi110 ceph-mon[28069]: pgmap v10792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19592.193720 secs 2024-04-26T17:14:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:37 smithi193 ceph-mon[32782]: pgmap v10792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19592.193720 secs 2024-04-26T17:14:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:39 smithi196 ceph-mon[32572]: pgmap v10793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:39 smithi110 ceph-mon[28069]: pgmap v10793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:39 smithi193 ceph-mon[32782]: pgmap v10793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:41 smithi196 ceph-mon[32572]: pgmap v10794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:41 smithi110 ceph-mon[28069]: pgmap v10794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:41 smithi193 ceph-mon[32782]: pgmap v10794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19597.193814 secs 2024-04-26T17:14:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19597.193814 secs 2024-04-26T17:14:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19597.193814 secs 2024-04-26T17:14:43.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:43 smithi196 ceph-mon[32572]: pgmap v10795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:14:43.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:43 smithi110 ceph-mon[28069]: pgmap v10795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:14:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:43 smithi193 ceph-mon[32782]: pgmap v10795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:14:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:45 smithi196 ceph-mon[32572]: pgmap v10796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:45 smithi110 ceph-mon[28069]: pgmap v10796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:45 smithi193 ceph-mon[32782]: pgmap v10796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:47 smithi110 ceph-mon[28069]: pgmap v10797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19602.193935 secs 2024-04-26T17:14:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:47 smithi193 ceph-mon[32782]: pgmap v10797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19602.193935 secs 2024-04-26T17:14:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:47 smithi196 ceph-mon[32572]: pgmap v10797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19602.193935 secs 2024-04-26T17:14:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:49 smithi110 ceph-mon[28069]: pgmap v10798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:49 smithi193 ceph-mon[32782]: pgmap v10798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:50.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:49 smithi196 ceph-mon[32572]: pgmap v10798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:51 smithi110 ceph-mon[28069]: pgmap v10799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:51 smithi193 ceph-mon[32782]: pgmap v10799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:51 smithi196 ceph-mon[32572]: pgmap v10799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19607.194021 secs 2024-04-26T17:14:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19607.194021 secs 2024-04-26T17:14:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19607.194021 secs 2024-04-26T17:14:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:53 smithi110 ceph-mon[28069]: pgmap v10800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:14:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:53 smithi193 ceph-mon[32782]: pgmap v10800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:14:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:53 smithi196 ceph-mon[32572]: pgmap v10800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:14:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:55 smithi110 ceph-mon[28069]: pgmap v10801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:55 smithi193 ceph-mon[32782]: pgmap v10801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:55 smithi196 ceph-mon[32572]: pgmap v10801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:14:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:57 smithi193 ceph-mon[32782]: pgmap v10802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19612.194145 secs 2024-04-26T17:14:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:57 smithi196 ceph-mon[32572]: pgmap v10802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19612.194145 secs 2024-04-26T17:14:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:57 smithi110 ceph-mon[28069]: pgmap v10802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:14:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19612.194145 secs 2024-04-26T17:14:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:14:59 smithi193 ceph-mon[32782]: pgmap v10803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:00.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:14:59 smithi196 ceph-mon[32572]: pgmap v10803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:14:59 smithi110 ceph-mon[28069]: pgmap v10803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:01.805 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:01 smithi196 ceph-mon[32572]: pgmap v10804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:01 smithi193 ceph-mon[32782]: pgmap v10804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:01 smithi110 ceph-mon[28069]: pgmap v10804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19617.194273 secs 2024-04-26T17:15:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19617.194273 secs 2024-04-26T17:15:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19617.194273 secs 2024-04-26T17:15:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:03 smithi193 ceph-mon[32782]: pgmap v10805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:04.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:03 smithi196 ceph-mon[32572]: pgmap v10805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:03 smithi110 ceph-mon[28069]: pgmap v10805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:05 smithi193 ceph-mon[32782]: pgmap v10806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:15:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:05 smithi196 ceph-mon[32572]: pgmap v10806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:15:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:05 smithi110 ceph-mon[28069]: pgmap v10806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:15:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:15:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:15:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:15:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:15:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:15:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:15:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:15:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:15:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:15:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:07 smithi193 ceph-mon[32782]: pgmap v10807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:07 smithi193 ceph-mon[32782]: pgmap v10808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19622.194401 secs 2024-04-26T17:15:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:07 smithi196 ceph-mon[32572]: pgmap v10807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:07 smithi196 ceph-mon[32572]: pgmap v10808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19622.194401 secs 2024-04-26T17:15:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:07 smithi110 ceph-mon[28069]: pgmap v10807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:07 smithi110 ceph-mon[28069]: pgmap v10808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19622.194401 secs 2024-04-26T17:15:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:09 smithi193 ceph-mon[32782]: pgmap v10809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:09 smithi196 ceph-mon[32572]: pgmap v10809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:09 smithi110 ceph-mon[28069]: pgmap v10809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:11 smithi193 ceph-mon[32782]: pgmap v10810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:11 smithi196 ceph-mon[32572]: pgmap v10810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:11 smithi110 ceph-mon[28069]: pgmap v10810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:15:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 19627.194513 secs 2024-04-26T17:15:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:12 smithi193 ceph-mon[32782]: slow request 5764.530646 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:15:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 19627.194513 secs 2024-04-26T17:15:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:12 smithi196 ceph-mon[32572]: slow request 5764.530646 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:15:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 19627.194513 secs 2024-04-26T17:15:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:12 smithi110 ceph-mon[28069]: slow request 5764.530646 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:15:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:13 smithi193 ceph-mon[32782]: pgmap v10811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T17:15:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:13 smithi196 ceph-mon[32572]: pgmap v10811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T17:15:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:13 smithi110 ceph-mon[28069]: pgmap v10811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T17:15:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:15 smithi193 ceph-mon[32782]: pgmap v10812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:15:16.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:15 smithi196 ceph-mon[32572]: pgmap v10812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:15:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:15 smithi110 ceph-mon[28069]: pgmap v10812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:15:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:17 smithi193 ceph-mon[32782]: pgmap v10813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:15:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19632.194595 secs 2024-04-26T17:15:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:17 smithi196 ceph-mon[32572]: pgmap v10813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:15:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19632.194595 secs 2024-04-26T17:15:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:17 smithi110 ceph-mon[28069]: pgmap v10813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:15:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19632.194595 secs 2024-04-26T17:15:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:15:19.609+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T17:15:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:15:19.609+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:15:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:15:19.610+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 153 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:15:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:15:19.610+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 153 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T17:15:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:19 smithi193 ceph-mon[32782]: pgmap v10814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:19 smithi196 ceph-mon[32572]: pgmap v10814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:19 smithi110 ceph-mon[28069]: pgmap v10814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:21 smithi196 ceph-mon[32572]: pgmap v10815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:21 smithi110 ceph-mon[28069]: pgmap v10815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:21 smithi193 ceph-mon[32782]: pgmap v10815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:22.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19637.194668 secs 2024-04-26T17:15:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19637.194668 secs 2024-04-26T17:15:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19637.194668 secs 2024-04-26T17:15:24.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:23 smithi196 ceph-mon[32572]: pgmap v10816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:23 smithi110 ceph-mon[28069]: pgmap v10816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:23 smithi193 ceph-mon[32782]: pgmap v10816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:25 smithi196 ceph-mon[32572]: pgmap v10817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:25 smithi110 ceph-mon[28069]: pgmap v10817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:25 smithi193 ceph-mon[32782]: pgmap v10817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:27 smithi196 ceph-mon[32572]: pgmap v10818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19642.194749 secs 2024-04-26T17:15:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:27 smithi110 ceph-mon[28069]: pgmap v10818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19642.194749 secs 2024-04-26T17:15:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:27 smithi193 ceph-mon[32782]: pgmap v10818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19642.194749 secs 2024-04-26T17:15:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:29 smithi196 ceph-mon[32572]: pgmap v10819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:29 smithi110 ceph-mon[28069]: pgmap v10819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:29 smithi193 ceph-mon[32782]: pgmap v10819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:31.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:31 smithi193 ceph-mon[32782]: pgmap v10820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:31 smithi196 ceph-mon[32572]: pgmap v10820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:31 smithi110 ceph-mon[28069]: pgmap v10820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19647.194875 secs 2024-04-26T17:15:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19647.194875 secs 2024-04-26T17:15:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19647.194875 secs 2024-04-26T17:15:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:33 smithi196 ceph-mon[32572]: pgmap v10821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:33 smithi110 ceph-mon[28069]: pgmap v10821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:33 smithi193 ceph-mon[32782]: pgmap v10821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:35 smithi196 ceph-mon[32572]: pgmap v10822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:35 smithi110 ceph-mon[28069]: pgmap v10822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:35 smithi193 ceph-mon[32782]: pgmap v10822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:37 smithi196 ceph-mon[32572]: pgmap v10823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19652.194954 secs 2024-04-26T17:15:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:37 smithi110 ceph-mon[28069]: pgmap v10823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19652.194954 secs 2024-04-26T17:15:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:37 smithi193 ceph-mon[32782]: pgmap v10823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19652.194954 secs 2024-04-26T17:15:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:39 smithi196 ceph-mon[32572]: pgmap v10824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:39 smithi110 ceph-mon[28069]: pgmap v10824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:39 smithi193 ceph-mon[32782]: pgmap v10824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:40 smithi196 ceph-mon[32572]: pgmap v10825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:40 smithi110 ceph-mon[28069]: pgmap v10825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:40 smithi193 ceph-mon[32782]: pgmap v10825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19657.195079 secs 2024-04-26T17:15:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:42 smithi196 ceph-mon[32572]: pgmap v10826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19657.195079 secs 2024-04-26T17:15:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:42 smithi110 ceph-mon[28069]: pgmap v10826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19657.195079 secs 2024-04-26T17:15:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:42 smithi193 ceph-mon[32782]: pgmap v10826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:44 smithi196 ceph-mon[32572]: pgmap v10827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:44 smithi110 ceph-mon[28069]: pgmap v10827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:44 smithi193 ceph-mon[32782]: pgmap v10827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:46 smithi196 ceph-mon[32572]: pgmap v10828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:46 smithi110 ceph-mon[28069]: pgmap v10828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:46 smithi193 ceph-mon[32782]: pgmap v10828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19662.195214 secs 2024-04-26T17:15:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19662.195214 secs 2024-04-26T17:15:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19662.195214 secs 2024-04-26T17:15:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:48 smithi196 ceph-mon[32572]: pgmap v10829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:48 smithi110 ceph-mon[28069]: pgmap v10829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:48 smithi193 ceph-mon[32782]: pgmap v10829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:50 smithi196 ceph-mon[32572]: pgmap v10830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:50 smithi110 ceph-mon[28069]: pgmap v10830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:50 smithi193 ceph-mon[32782]: pgmap v10830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19667.195342 secs 2024-04-26T17:15:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:52 smithi196 ceph-mon[32572]: pgmap v10831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19667.195342 secs 2024-04-26T17:15:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:52 smithi110 ceph-mon[28069]: pgmap v10831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19667.195342 secs 2024-04-26T17:15:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:52 smithi193 ceph-mon[32782]: pgmap v10831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:54 smithi196 ceph-mon[32572]: pgmap v10832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:54 smithi110 ceph-mon[28069]: pgmap v10832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:54 smithi193 ceph-mon[32782]: pgmap v10832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:56 smithi196 ceph-mon[32572]: pgmap v10833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:56 smithi110 ceph-mon[28069]: pgmap v10833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:56 smithi193 ceph-mon[32782]: pgmap v10833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:15:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19672.195477 secs 2024-04-26T17:15:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19672.195477 secs 2024-04-26T17:15:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:58 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19672.195477 secs 2024-04-26T17:15:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:15:59 smithi196 ceph-mon[32572]: pgmap v10834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:15:59 smithi110 ceph-mon[28069]: pgmap v10834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:15:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:15:59 smithi193 ceph-mon[32782]: pgmap v10834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:01 smithi110 ceph-mon[28069]: pgmap v10835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:01 smithi193 ceph-mon[32782]: pgmap v10835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:01 smithi196 ceph-mon[32572]: pgmap v10835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:03 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19677.195589 secs 2024-04-26T17:16:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:03 smithi110 ceph-mon[28069]: pgmap v10836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:03 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19677.195589 secs 2024-04-26T17:16:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:03 smithi193 ceph-mon[32782]: pgmap v10836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:03 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19677.195589 secs 2024-04-26T17:16:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:03 smithi196 ceph-mon[32572]: pgmap v10836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:05 smithi110 ceph-mon[28069]: pgmap v10837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:05 smithi193 ceph-mon[32782]: pgmap v10837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:05 smithi196 ceph-mon[32572]: pgmap v10837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:07 smithi110 ceph-mon[28069]: pgmap v10838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:16:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:07 smithi193 ceph-mon[32782]: pgmap v10838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:16:07.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:07 smithi196 ceph-mon[32572]: pgmap v10838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:16:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:08 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19682.195647 secs 2024-04-26T17:16:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:16:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:16:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:08 smithi110 ceph-mon[28069]: pgmap v10839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:16:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:08 smithi110 ceph-mon[28069]: pgmap v10840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:16:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:08 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19682.195647 secs 2024-04-26T17:16:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:16:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:16:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:08 smithi193 ceph-mon[32782]: pgmap v10839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:16:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:08 smithi193 ceph-mon[32782]: pgmap v10840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:08 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19682.195647 secs 2024-04-26T17:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:08 smithi196 ceph-mon[32572]: pgmap v10839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:08 smithi196 ceph-mon[32572]: pgmap v10840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:16:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:10 smithi193 ceph-mon[32782]: pgmap v10841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:11.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:10 smithi196 ceph-mon[32572]: pgmap v10841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:10 smithi110 ceph-mon[28069]: pgmap v10841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:12 smithi193 ceph-mon[32782]: pgmap v10842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19687.195759 secs 2024-04-26T17:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:12 smithi196 ceph-mon[32572]: pgmap v10842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19687.195759 secs 2024-04-26T17:16:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:12 smithi110 ceph-mon[28069]: pgmap v10842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19687.195759 secs 2024-04-26T17:16:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:14 smithi193 ceph-mon[32782]: pgmap v10843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:14 smithi196 ceph-mon[32572]: pgmap v10843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:14 smithi110 ceph-mon[28069]: pgmap v10843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:16 smithi193 ceph-mon[32782]: pgmap v10844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:16 smithi196 ceph-mon[32572]: pgmap v10844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:16 smithi110 ceph-mon[28069]: pgmap v10844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:16:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19692.195881 secs 2024-04-26T17:16:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19692.195881 secs 2024-04-26T17:16:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19692.195881 secs 2024-04-26T17:16:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:18 smithi193 ceph-mon[32782]: pgmap v10845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T17:16:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:18 smithi196 ceph-mon[32572]: pgmap v10845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T17:16:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:18 smithi110 ceph-mon[28069]: pgmap v10845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T17:16:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:20 smithi193 ceph-mon[32782]: pgmap v10846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:16:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:20 smithi196 ceph-mon[32572]: pgmap v10846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:16:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:20 smithi110 ceph-mon[28069]: pgmap v10846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:16:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19697.196002 secs 2024-04-26T17:16:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:22 smithi193 ceph-mon[32782]: pgmap v10847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:16:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19697.196002 secs 2024-04-26T17:16:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:22 smithi196 ceph-mon[32572]: pgmap v10847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:16:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19697.196002 secs 2024-04-26T17:16:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:22 smithi110 ceph-mon[28069]: pgmap v10847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:16:24.842 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:24 smithi110 ceph-mon[28069]: pgmap v10848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:24 smithi193 ceph-mon[32782]: pgmap v10848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:24 smithi196 ceph-mon[32572]: pgmap v10848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:26 smithi193 ceph-mon[32782]: pgmap v10849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:16:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:26 smithi196 ceph-mon[32572]: pgmap v10849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:16:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:26 smithi110 ceph-mon[28069]: pgmap v10849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:16:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19702.196138 secs 2024-04-26T17:16:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19702.196138 secs 2024-04-26T17:16:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19702.196138 secs 2024-04-26T17:16:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:28 smithi193 ceph-mon[32782]: pgmap v10850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:28 smithi196 ceph-mon[32572]: pgmap v10850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:28 smithi110 ceph-mon[28069]: pgmap v10850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:30 smithi193 ceph-mon[32782]: pgmap v10851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:30 smithi196 ceph-mon[32572]: pgmap v10851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:30 smithi110 ceph-mon[28069]: pgmap v10851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19707.196286 secs 2024-04-26T17:16:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:32 smithi193 ceph-mon[32782]: pgmap v10852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19707.196286 secs 2024-04-26T17:16:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:32 smithi196 ceph-mon[32572]: pgmap v10852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19707.196286 secs 2024-04-26T17:16:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:32 smithi110 ceph-mon[28069]: pgmap v10852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:34 smithi196 ceph-mon[32572]: pgmap v10853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:34 smithi110 ceph-mon[28069]: pgmap v10853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:34 smithi193 ceph-mon[32782]: pgmap v10853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:36 smithi196 ceph-mon[32572]: pgmap v10854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:36 smithi110 ceph-mon[28069]: pgmap v10854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:36 smithi193 ceph-mon[32782]: pgmap v10854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19712.196419 secs 2024-04-26T17:16:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19712.196419 secs 2024-04-26T17:16:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19712.196419 secs 2024-04-26T17:16:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:38 smithi196 ceph-mon[32572]: pgmap v10855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:38 smithi110 ceph-mon[28069]: pgmap v10855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:38 smithi193 ceph-mon[32782]: pgmap v10855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:40 smithi196 ceph-mon[32572]: pgmap v10856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:40 smithi110 ceph-mon[28069]: pgmap v10856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:40 smithi193 ceph-mon[32782]: pgmap v10856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:43.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19717.196618 secs 2024-04-26T17:16:43.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:42 smithi196 ceph-mon[32572]: pgmap v10857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19717.196618 secs 2024-04-26T17:16:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:42 smithi110 ceph-mon[28069]: pgmap v10857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19717.196618 secs 2024-04-26T17:16:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:42 smithi193 ceph-mon[32782]: pgmap v10857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:44 smithi196 ceph-mon[32572]: pgmap v10858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:44 smithi110 ceph-mon[28069]: pgmap v10858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:44 smithi193 ceph-mon[32782]: pgmap v10858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:46 smithi196 ceph-mon[32572]: pgmap v10859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:46 smithi110 ceph-mon[28069]: pgmap v10859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:46 smithi193 ceph-mon[32782]: pgmap v10859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19722.196724 secs 2024-04-26T17:16:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19722.196724 secs 2024-04-26T17:16:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19722.196724 secs 2024-04-26T17:16:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:48 smithi196 ceph-mon[32572]: pgmap v10860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:48 smithi110 ceph-mon[28069]: pgmap v10860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:48 smithi193 ceph-mon[32782]: pgmap v10860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:50 smithi196 ceph-mon[32572]: pgmap v10861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:50 smithi110 ceph-mon[28069]: pgmap v10861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:50 smithi193 ceph-mon[32782]: pgmap v10861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19727.196824 secs 2024-04-26T17:16:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:52 smithi196 ceph-mon[32572]: pgmap v10862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19727.196824 secs 2024-04-26T17:16:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:52 smithi110 ceph-mon[28069]: pgmap v10862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19727.196824 secs 2024-04-26T17:16:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:52 smithi193 ceph-mon[32782]: pgmap v10862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:54 smithi196 ceph-mon[32572]: pgmap v10863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:54 smithi110 ceph-mon[28069]: pgmap v10863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:54 smithi193 ceph-mon[32782]: pgmap v10863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:55 smithi196 ceph-mon[32572]: pgmap v10864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:55 smithi110 ceph-mon[28069]: pgmap v10864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:55 smithi193 ceph-mon[32782]: pgmap v10864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:16:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19732.196950 secs 2024-04-26T17:16:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19732.196950 secs 2024-04-26T17:16:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19732.196950 secs 2024-04-26T17:16:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:16:58 smithi196 ceph-mon[32572]: pgmap v10865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:16:58 smithi110 ceph-mon[28069]: pgmap v10865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:16:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:16:58 smithi193 ceph-mon[32782]: pgmap v10865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:00 smithi193 ceph-mon[32782]: pgmap v10866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:00 smithi196 ceph-mon[32572]: pgmap v10866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:00 smithi110 ceph-mon[28069]: pgmap v10866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19737.197070 secs 2024-04-26T17:17:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:02 smithi193 ceph-mon[32782]: pgmap v10867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19737.197070 secs 2024-04-26T17:17:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:02 smithi196 ceph-mon[32572]: pgmap v10867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19737.197070 secs 2024-04-26T17:17:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:02 smithi110 ceph-mon[28069]: pgmap v10867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:04 smithi193 ceph-mon[32782]: pgmap v10868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:04 smithi196 ceph-mon[32572]: pgmap v10868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:04 smithi110 ceph-mon[28069]: pgmap v10868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:06 smithi193 ceph-mon[32782]: pgmap v10869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:06 smithi196 ceph-mon[32572]: pgmap v10869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:06 smithi110 ceph-mon[28069]: pgmap v10869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19742.197190 secs 2024-04-26T17:17:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19742.197190 secs 2024-04-26T17:17:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19742.197190 secs 2024-04-26T17:17:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:08 smithi193 ceph-mon[32782]: pgmap v10870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:17:09.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:08 smithi196 ceph-mon[32572]: pgmap v10870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:17:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:08 smithi110 ceph-mon[28069]: pgmap v10870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:17:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:17:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:17:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:17:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:17:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:17:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:17:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:17:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:17:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:17:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:10 smithi193 ceph-mon[32782]: pgmap v10871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:17:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:10 smithi193 ceph-mon[32782]: pgmap v10872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:10 smithi196 ceph-mon[32572]: pgmap v10871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:17:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:10 smithi196 ceph-mon[32572]: pgmap v10872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:10 smithi110 ceph-mon[28069]: pgmap v10871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:17:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:10 smithi110 ceph-mon[28069]: pgmap v10872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:12 smithi193 ceph-mon[32782]: pgmap v10873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19747.197311 secs 2024-04-26T17:17:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:12 smithi196 ceph-mon[32572]: pgmap v10873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19747.197311 secs 2024-04-26T17:17:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:12 smithi110 ceph-mon[28069]: pgmap v10873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19747.197311 secs 2024-04-26T17:17:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:14 smithi196 ceph-mon[32572]: pgmap v10874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:14 smithi110 ceph-mon[28069]: pgmap v10874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:14 smithi193 ceph-mon[32782]: pgmap v10874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:16 smithi196 ceph-mon[32572]: pgmap v10875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:16 smithi110 ceph-mon[28069]: pgmap v10875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:16 smithi193 ceph-mon[32782]: pgmap v10875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:17:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19752.197426 secs 2024-04-26T17:17:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19752.197426 secs 2024-04-26T17:17:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19752.197426 secs 2024-04-26T17:17:19.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:18 smithi196 ceph-mon[32572]: pgmap v10876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:17:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:18 smithi110 ceph-mon[28069]: pgmap v10876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:17:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:18 smithi193 ceph-mon[32782]: pgmap v10876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:17:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:20 smithi196 ceph-mon[32572]: pgmap v10877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:17:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:20 smithi110 ceph-mon[28069]: pgmap v10877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:17:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:20 smithi193 ceph-mon[32782]: pgmap v10877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:17:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:22 smithi196 ceph-mon[32572]: pgmap v10878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19757.197545 secs 2024-04-26T17:17:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:22 smithi110 ceph-mon[28069]: pgmap v10878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19757.197545 secs 2024-04-26T17:17:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:22 smithi193 ceph-mon[32782]: pgmap v10878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19757.197545 secs 2024-04-26T17:17:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:24 smithi196 ceph-mon[32572]: pgmap v10879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:24 smithi110 ceph-mon[28069]: pgmap v10879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:24 smithi193 ceph-mon[32782]: pgmap v10879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:26 smithi196 ceph-mon[32572]: pgmap v10880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:26 smithi110 ceph-mon[28069]: pgmap v10880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:26 smithi193 ceph-mon[32782]: pgmap v10880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19762.197661 secs 2024-04-26T17:17:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19762.197661 secs 2024-04-26T17:17:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19762.197661 secs 2024-04-26T17:17:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:28 smithi196 ceph-mon[32572]: pgmap v10881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:28 smithi110 ceph-mon[28069]: pgmap v10881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:28 smithi193 ceph-mon[32782]: pgmap v10881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:30 smithi196 ceph-mon[32572]: pgmap v10882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:30 smithi110 ceph-mon[28069]: pgmap v10882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:30 smithi193 ceph-mon[32782]: pgmap v10882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:32 smithi196 ceph-mon[32572]: pgmap v10883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19767.197799 secs 2024-04-26T17:17:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:32 smithi110 ceph-mon[28069]: pgmap v10883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19767.197799 secs 2024-04-26T17:17:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:32 smithi193 ceph-mon[32782]: pgmap v10883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19767.197799 secs 2024-04-26T17:17:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:34 smithi196 ceph-mon[32572]: pgmap v10884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:34 smithi110 ceph-mon[28069]: pgmap v10884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:34 smithi193 ceph-mon[32782]: pgmap v10884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:37.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:36 smithi196 ceph-mon[32572]: pgmap v10885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:36 smithi110 ceph-mon[28069]: pgmap v10885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:36 smithi193 ceph-mon[32782]: pgmap v10885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:38.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19772.197927 secs 2024-04-26T17:17:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19772.197927 secs 2024-04-26T17:17:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19772.197927 secs 2024-04-26T17:17:39.011 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:38 smithi196 ceph-mon[32572]: pgmap v10886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:39.046 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:38 smithi110 ceph-mon[28069]: pgmap v10886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:39.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:38 smithi193 ceph-mon[32782]: pgmap v10886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:39 smithi196 ceph-mon[32572]: pgmap v10887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:39 smithi110 ceph-mon[28069]: pgmap v10887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:39 smithi193 ceph-mon[32782]: pgmap v10887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:42 smithi196 ceph-mon[32572]: pgmap v10888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:42 smithi110 ceph-mon[28069]: pgmap v10888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:42 smithi193 ceph-mon[32782]: pgmap v10888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:43 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19777.198046 secs 2024-04-26T17:17:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:43 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19777.198046 secs 2024-04-26T17:17:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:43 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19777.198046 secs 2024-04-26T17:17:44.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:44 smithi196 ceph-mon[32572]: pgmap v10889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:44 smithi110 ceph-mon[28069]: pgmap v10889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:44 smithi193 ceph-mon[32782]: pgmap v10889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:46 smithi196 ceph-mon[32572]: pgmap v10890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:46 smithi110 ceph-mon[28069]: pgmap v10890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:46 smithi193 ceph-mon[32782]: pgmap v10890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:48 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19782.198106 secs 2024-04-26T17:17:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:48 smithi196 ceph-mon[32572]: pgmap v10891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:48 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19782.198106 secs 2024-04-26T17:17:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:48 smithi110 ceph-mon[28069]: pgmap v10891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:48 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19782.198106 secs 2024-04-26T17:17:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:48 smithi193 ceph-mon[32782]: pgmap v10891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:50.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:50 smithi196 ceph-mon[32572]: pgmap v10892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:50 smithi110 ceph-mon[28069]: pgmap v10892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:50 smithi193 ceph-mon[32782]: pgmap v10892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:52 smithi196 ceph-mon[32572]: pgmap v10893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:52 smithi110 ceph-mon[28069]: pgmap v10893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:52 smithi193 ceph-mon[32782]: pgmap v10893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:53.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:53 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19787.198211 secs 2024-04-26T17:17:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:53 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19787.198211 secs 2024-04-26T17:17:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:53 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19787.198211 secs 2024-04-26T17:17:54.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:54 smithi110 ceph-mon[28069]: pgmap v10894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:54 smithi196 ceph-mon[32572]: pgmap v10894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:54 smithi193 ceph-mon[32782]: pgmap v10894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:17:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:56 smithi196 ceph-mon[32572]: pgmap v10895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:56 smithi110 ceph-mon[28069]: pgmap v10895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:56.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:56 smithi193 ceph-mon[32782]: pgmap v10895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19792.198333 secs 2024-04-26T17:17:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19792.198333 secs 2024-04-26T17:17:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19792.198333 secs 2024-04-26T17:17:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:17:58 smithi196 ceph-mon[32572]: pgmap v10896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:17:58 smithi110 ceph-mon[28069]: pgmap v10896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:17:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:17:58 smithi193 ceph-mon[32782]: pgmap v10896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:00 smithi196 ceph-mon[32572]: pgmap v10897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:00 smithi110 ceph-mon[28069]: pgmap v10897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:00 smithi193 ceph-mon[32782]: pgmap v10897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:02 smithi196 ceph-mon[32572]: pgmap v10898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19797.198452 secs 2024-04-26T17:18:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:02 smithi110 ceph-mon[28069]: pgmap v10898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19797.198452 secs 2024-04-26T17:18:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:02 smithi193 ceph-mon[32782]: pgmap v10898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19797.198452 secs 2024-04-26T17:18:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:04 smithi196 ceph-mon[32572]: pgmap v10899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:04 smithi110 ceph-mon[28069]: pgmap v10899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:04 smithi193 ceph-mon[32782]: pgmap v10899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:06.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:06 smithi196 ceph-mon[32572]: pgmap v10900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:06 smithi110 ceph-mon[28069]: pgmap v10900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:06 smithi193 ceph-mon[32782]: pgmap v10900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19802.198591 secs 2024-04-26T17:18:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19802.198591 secs 2024-04-26T17:18:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19802.198591 secs 2024-04-26T17:18:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:08 smithi110 ceph-mon[28069]: pgmap v10901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:08 smithi193 ceph-mon[32782]: pgmap v10901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:08 smithi196 ceph-mon[32572]: pgmap v10901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:10 smithi110 ceph-mon[28069]: pgmap v10902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:18:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:10 smithi193 ceph-mon[32782]: pgmap v10902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:18:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:10 smithi196 ceph-mon[32572]: pgmap v10902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:18:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:18:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:18:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:11 smithi193 ceph-mon[32782]: pgmap v10903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:18:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:18:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:18:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:11 smithi196 ceph-mon[32572]: pgmap v10903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:18:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:18:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:18:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:11 smithi110 ceph-mon[28069]: pgmap v10903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:18:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19807.198648 secs 2024-04-26T17:18:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19807.198648 secs 2024-04-26T17:18:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19807.198648 secs 2024-04-26T17:18:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:13 smithi193 ceph-mon[32782]: pgmap v10904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:18:13.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:13 smithi196 ceph-mon[32572]: pgmap v10904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:18:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:13 smithi110 ceph-mon[28069]: pgmap v10904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:18:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:15 smithi196 ceph-mon[32572]: pgmap v10905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:15 smithi110 ceph-mon[28069]: pgmap v10905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:15 smithi193 ceph-mon[32782]: pgmap v10905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.431+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T17:18:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.431+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T17:18:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.431+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:18:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.431+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T17:18:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.432+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:18:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.432+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T17:18:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.432+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T17:18:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.432+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:18:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.432+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).stop 2024-04-26T17:18:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.432+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T17:18:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.432+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T17:18:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.432+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:18:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.432+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:18:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.433+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:18:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.433+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T17:18:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.433+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T17:18:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:16.434+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614063040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:18:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19812.198728 secs 2024-04-26T17:18:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:17 smithi196 ceph-mon[32572]: pgmap v10906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19812.198728 secs 2024-04-26T17:18:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:17 smithi110 ceph-mon[28069]: pgmap v10906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19812.198728 secs 2024-04-26T17:18:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:17 smithi193 ceph-mon[32782]: pgmap v10906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:19.638+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T17:18:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:19.638+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:18:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:19.639+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 154 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:18:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:19.639+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 154 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T17:18:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:19.640+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:18:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:19.640+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T17:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:19.640+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 155 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T17:18:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:18:19.640+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 155 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:18:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:19 smithi196 ceph-mon[32572]: pgmap v10907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:18:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:19 smithi110 ceph-mon[28069]: pgmap v10907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:18:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:19 smithi193 ceph-mon[32782]: pgmap v10907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:18:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:21 smithi196 ceph-mon[32572]: pgmap v10908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:21 smithi110 ceph-mon[28069]: pgmap v10908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:21 smithi193 ceph-mon[32782]: pgmap v10908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:18:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19817.198861 secs 2024-04-26T17:18:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19817.198861 secs 2024-04-26T17:18:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19817.198861 secs 2024-04-26T17:18:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:23 smithi196 ceph-mon[32572]: pgmap v10909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:23 smithi110 ceph-mon[28069]: pgmap v10909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:23 smithi193 ceph-mon[32782]: pgmap v10909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:25 smithi196 ceph-mon[32572]: pgmap v10910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:25 smithi110 ceph-mon[28069]: pgmap v10910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:25 smithi193 ceph-mon[32782]: pgmap v10910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19822.198954 secs 2024-04-26T17:18:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:27 smithi196 ceph-mon[32572]: pgmap v10911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19822.198954 secs 2024-04-26T17:18:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:27 smithi110 ceph-mon[28069]: pgmap v10911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19822.198954 secs 2024-04-26T17:18:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:27 smithi193 ceph-mon[32782]: pgmap v10911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:29 smithi196 ceph-mon[32572]: pgmap v10912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:29 smithi110 ceph-mon[28069]: pgmap v10912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:29 smithi193 ceph-mon[32782]: pgmap v10912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:31 smithi196 ceph-mon[32572]: pgmap v10913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:31 smithi110 ceph-mon[28069]: pgmap v10913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:31 smithi193 ceph-mon[32782]: pgmap v10913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19827.199081 secs 2024-04-26T17:18:33.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19827.199081 secs 2024-04-26T17:18:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19827.199081 secs 2024-04-26T17:18:34.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:33 smithi196 ceph-mon[32572]: pgmap v10914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:33 smithi110 ceph-mon[28069]: pgmap v10914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:33 smithi193 ceph-mon[32782]: pgmap v10914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:35 smithi196 ceph-mon[32572]: pgmap v10915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:35 smithi110 ceph-mon[28069]: pgmap v10915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:35 smithi193 ceph-mon[32782]: pgmap v10915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19832.199205 secs 2024-04-26T17:18:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:37 smithi196 ceph-mon[32572]: pgmap v10916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19832.199205 secs 2024-04-26T17:18:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:37 smithi110 ceph-mon[28069]: pgmap v10916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19832.199205 secs 2024-04-26T17:18:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:37 smithi193 ceph-mon[32782]: pgmap v10916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:39 smithi196 ceph-mon[32572]: pgmap v10917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:39 smithi110 ceph-mon[28069]: pgmap v10917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:39 smithi193 ceph-mon[32782]: pgmap v10917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:40 smithi196 ceph-mon[32572]: pgmap v10918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:40 smithi110 ceph-mon[28069]: pgmap v10918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:40 smithi193 ceph-mon[32782]: pgmap v10918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19837.199358 secs 2024-04-26T17:18:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19837.199358 secs 2024-04-26T17:18:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19837.199358 secs 2024-04-26T17:18:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:43 smithi196 ceph-mon[32572]: pgmap v10919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:43 smithi110 ceph-mon[28069]: pgmap v10919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:43 smithi193 ceph-mon[32782]: pgmap v10919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:45 smithi196 ceph-mon[32572]: pgmap v10920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:45 smithi110 ceph-mon[28069]: pgmap v10920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:45 smithi193 ceph-mon[32782]: pgmap v10920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19842.199495 secs 2024-04-26T17:18:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:47 smithi196 ceph-mon[32572]: pgmap v10921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19842.199495 secs 2024-04-26T17:18:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:47 smithi110 ceph-mon[28069]: pgmap v10921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19842.199495 secs 2024-04-26T17:18:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:47 smithi193 ceph-mon[32782]: pgmap v10921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:49 smithi196 ceph-mon[32572]: pgmap v10922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:49 smithi110 ceph-mon[28069]: pgmap v10922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:49 smithi193 ceph-mon[32782]: pgmap v10922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:51 smithi196 ceph-mon[32572]: pgmap v10923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:51 smithi110 ceph-mon[28069]: pgmap v10923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:51 smithi193 ceph-mon[32782]: pgmap v10923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19847.199644 secs 2024-04-26T17:18:53.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19847.199644 secs 2024-04-26T17:18:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19847.199644 secs 2024-04-26T17:18:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:53 smithi196 ceph-mon[32572]: pgmap v10924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:53 smithi110 ceph-mon[28069]: pgmap v10924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:53 smithi193 ceph-mon[32782]: pgmap v10924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:18:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:55 smithi196 ceph-mon[32572]: pgmap v10925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:55 smithi110 ceph-mon[28069]: pgmap v10925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:55 smithi193 ceph-mon[32782]: pgmap v10925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19852.199764 secs 2024-04-26T17:18:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:57 smithi196 ceph-mon[32572]: pgmap v10926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19852.199764 secs 2024-04-26T17:18:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:57 smithi110 ceph-mon[28069]: pgmap v10926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:18:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19852.199764 secs 2024-04-26T17:18:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:57 smithi193 ceph-mon[32782]: pgmap v10926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:00.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:18:59 smithi196 ceph-mon[32572]: pgmap v10927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:18:59 smithi110 ceph-mon[28069]: pgmap v10927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:18:59 smithi193 ceph-mon[32782]: pgmap v10927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:02.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:01 smithi196 ceph-mon[32572]: pgmap v10928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:01 smithi110 ceph-mon[28069]: pgmap v10928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:01 smithi193 ceph-mon[32782]: pgmap v10928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19857.199888 secs 2024-04-26T17:19:03.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19857.199888 secs 2024-04-26T17:19:03.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19857.199888 secs 2024-04-26T17:19:04.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:03 smithi196 ceph-mon[32572]: pgmap v10929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:03 smithi110 ceph-mon[28069]: pgmap v10929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:03 smithi193 ceph-mon[32782]: pgmap v10929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:05 smithi196 ceph-mon[32572]: pgmap v10930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:05 smithi110 ceph-mon[28069]: pgmap v10930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:05 smithi193 ceph-mon[32782]: pgmap v10930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:06 smithi196 ceph-mon[32572]: pgmap v10931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:06 smithi110 ceph-mon[28069]: pgmap v10931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:06 smithi193 ceph-mon[32782]: pgmap v10931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19862.200001 secs 2024-04-26T17:19:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19862.200001 secs 2024-04-26T17:19:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19862.200001 secs 2024-04-26T17:19:09.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:08 smithi196 ceph-mon[32572]: pgmap v10932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:08 smithi110 ceph-mon[28069]: pgmap v10932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:08 smithi193 ceph-mon[32782]: pgmap v10932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:10.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:19:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:19:09.878+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:19:10.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:19:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:19:09.878+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:19:10.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:19:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:19:09.878+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:19:10.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:19:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:19:09.878+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:19:10.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:19:09 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:19:09.878+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:19:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:11 smithi196 ceph-mon[32572]: pgmap v10933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:19:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:11 smithi110 ceph-mon[28069]: pgmap v10933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:19:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:11 smithi193 ceph-mon[32782]: pgmap v10933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:19:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19867.200162 secs 2024-04-26T17:19:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:19:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:19:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:19:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19867.200162 secs 2024-04-26T17:19:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:19:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:19:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:19:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19867.200162 secs 2024-04-26T17:19:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:19:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:19:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:19:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:13 smithi196 ceph-mon[32572]: pgmap v10934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T17:19:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:13 smithi196 ceph-mon[32572]: pgmap v10935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T17:19:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:13 smithi110 ceph-mon[28069]: pgmap v10934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T17:19:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:13 smithi110 ceph-mon[28069]: pgmap v10935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T17:19:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:13 smithi193 ceph-mon[32782]: pgmap v10934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T17:19:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:13 smithi193 ceph-mon[32782]: pgmap v10935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T17:19:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:15 smithi196 ceph-mon[32572]: pgmap v10936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:15 smithi110 ceph-mon[28069]: pgmap v10936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:15 smithi193 ceph-mon[32782]: pgmap v10936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:17 smithi196 ceph-mon[32572]: pgmap v10937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19872.200298 secs 2024-04-26T17:19:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:17 smithi110 ceph-mon[28069]: pgmap v10937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19872.200298 secs 2024-04-26T17:19:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:17 smithi193 ceph-mon[32782]: pgmap v10937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19872.200298 secs 2024-04-26T17:19:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:19 smithi196 ceph-mon[32572]: pgmap v10938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:19 smithi110 ceph-mon[28069]: pgmap v10938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:19 smithi193 ceph-mon[32782]: pgmap v10938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:21 smithi196 ceph-mon[32572]: pgmap v10939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:21 smithi110 ceph-mon[28069]: pgmap v10939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:21 smithi193 ceph-mon[32782]: pgmap v10939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T17:19:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19877.200442 secs 2024-04-26T17:19:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19877.200442 secs 2024-04-26T17:19:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19877.200442 secs 2024-04-26T17:19:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:23 smithi196 ceph-mon[32572]: pgmap v10940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T17:19:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:23 smithi110 ceph-mon[28069]: pgmap v10940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T17:19:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:23 smithi193 ceph-mon[32782]: pgmap v10940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T17:19:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:25 smithi196 ceph-mon[32572]: pgmap v10941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:19:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:25 smithi110 ceph-mon[28069]: pgmap v10941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:19:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:25 smithi193 ceph-mon[32782]: pgmap v10941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:19:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:27 smithi196 ceph-mon[32572]: pgmap v10942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19882.200611 secs 2024-04-26T17:19:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:27 smithi110 ceph-mon[28069]: pgmap v10942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19882.200611 secs 2024-04-26T17:19:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:27 smithi193 ceph-mon[32782]: pgmap v10942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19882.200611 secs 2024-04-26T17:19:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:28 smithi110 ceph-mon[28069]: pgmap v10943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:28 smithi193 ceph-mon[32782]: pgmap v10943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:29.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:28 smithi196 ceph-mon[32572]: pgmap v10943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:31.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:31 smithi196 ceph-mon[32572]: pgmap v10944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:31.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:31 smithi110 ceph-mon[28069]: pgmap v10944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:31 smithi193 ceph-mon[32782]: pgmap v10944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:32.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19887.200732 secs 2024-04-26T17:19:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19887.200732 secs 2024-04-26T17:19:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19887.200732 secs 2024-04-26T17:19:33.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:33 smithi196 ceph-mon[32572]: pgmap v10945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:33.521 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:33 smithi193 ceph-mon[32782]: pgmap v10945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:33 smithi110 ceph-mon[28069]: pgmap v10945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:35 smithi196 ceph-mon[32572]: pgmap v10946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:35 smithi110 ceph-mon[28069]: pgmap v10946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:35.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:35 smithi193 ceph-mon[32782]: pgmap v10946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:37 smithi196 ceph-mon[32572]: pgmap v10947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19892.200826 secs 2024-04-26T17:19:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:37 smithi110 ceph-mon[28069]: pgmap v10947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19892.200826 secs 2024-04-26T17:19:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:37 smithi193 ceph-mon[32782]: pgmap v10947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19892.200826 secs 2024-04-26T17:19:39.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:39 smithi196 ceph-mon[32572]: pgmap v10948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:39 smithi110 ceph-mon[28069]: pgmap v10948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:39.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:39 smithi193 ceph-mon[32782]: pgmap v10948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:41 smithi196 ceph-mon[32572]: pgmap v10949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:41.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:41 smithi110 ceph-mon[28069]: pgmap v10949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:41.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:41 smithi193 ceph-mon[32782]: pgmap v10949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:42.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19897.200956 secs 2024-04-26T17:19:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19897.200956 secs 2024-04-26T17:19:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19897.200956 secs 2024-04-26T17:19:43.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:43 smithi196 ceph-mon[32572]: pgmap v10950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:43.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:43 smithi110 ceph-mon[28069]: pgmap v10950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:43.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:43 smithi193 ceph-mon[32782]: pgmap v10950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:45 smithi110 ceph-mon[28069]: pgmap v10951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:45.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:45 smithi193 ceph-mon[32782]: pgmap v10951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:45.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:45 smithi196 ceph-mon[32572]: pgmap v10951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:47 smithi110 ceph-mon[28069]: pgmap v10952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19902.201092 secs 2024-04-26T17:19:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:47 smithi193 ceph-mon[32782]: pgmap v10952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19902.201092 secs 2024-04-26T17:19:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:47 smithi196 ceph-mon[32572]: pgmap v10952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19902.201092 secs 2024-04-26T17:19:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:49 smithi110 ceph-mon[28069]: pgmap v10953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:49.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:49 smithi193 ceph-mon[32782]: pgmap v10953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:49.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:49 smithi196 ceph-mon[32572]: pgmap v10953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:51 smithi110 ceph-mon[28069]: pgmap v10954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:51.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:51 smithi193 ceph-mon[32782]: pgmap v10954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:51.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:51 smithi196 ceph-mon[32572]: pgmap v10954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19907.201240 secs 2024-04-26T17:19:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19907.201240 secs 2024-04-26T17:19:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19907.201240 secs 2024-04-26T17:19:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:53 smithi110 ceph-mon[28069]: pgmap v10955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:53 smithi193 ceph-mon[32782]: pgmap v10955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:53.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:53 smithi196 ceph-mon[32572]: pgmap v10955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:55 smithi110 ceph-mon[28069]: pgmap v10956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:55.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:55 smithi193 ceph-mon[32782]: pgmap v10956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:55.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:55 smithi196 ceph-mon[32572]: pgmap v10956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:57 smithi193 ceph-mon[32782]: pgmap v10957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19912.201369 secs 2024-04-26T17:19:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:57 smithi196 ceph-mon[32572]: pgmap v10957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19912.201369 secs 2024-04-26T17:19:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:57 smithi110 ceph-mon[28069]: pgmap v10957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:19:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19912.201369 secs 2024-04-26T17:19:59.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:19:59 smithi193 ceph-mon[32782]: pgmap v10958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:59.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:19:59 smithi196 ceph-mon[32572]: pgmap v10958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:19:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:19:59 smithi110 ceph-mon[28069]: pgmap v10958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:20:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:20:00.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:20:01.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:01 smithi193 ceph-mon[32782]: pgmap v10959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:01.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:01 smithi196 ceph-mon[32572]: pgmap v10959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:01 smithi110 ceph-mon[28069]: pgmap v10959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19917.201523 secs 2024-04-26T17:20:02.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19917.201523 secs 2024-04-26T17:20:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19917.201523 secs 2024-04-26T17:20:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:03 smithi193 ceph-mon[32782]: pgmap v10960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:03.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:03 smithi196 ceph-mon[32572]: pgmap v10960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:03 smithi110 ceph-mon[28069]: pgmap v10960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:05 smithi193 ceph-mon[32782]: pgmap v10961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:05.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:05 smithi196 ceph-mon[32572]: pgmap v10961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:05 smithi110 ceph-mon[28069]: pgmap v10961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:07 smithi193 ceph-mon[32782]: pgmap v10962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19922.201646 secs 2024-04-26T17:20:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:07 smithi196 ceph-mon[32572]: pgmap v10962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19922.201646 secs 2024-04-26T17:20:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:07 smithi110 ceph-mon[28069]: pgmap v10962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19922.201646 secs 2024-04-26T17:20:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:09 smithi193 ceph-mon[32782]: pgmap v10963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:09 smithi196 ceph-mon[32572]: pgmap v10963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:09 smithi110 ceph-mon[28069]: pgmap v10963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:11 smithi193 ceph-mon[32782]: pgmap v10964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:11 smithi196 ceph-mon[32572]: pgmap v10964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:11 smithi110 ceph-mon[28069]: pgmap v10964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 19927.201774 secs 2024-04-26T17:20:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:12 smithi193 ceph-mon[32782]: slow request 5764.312661 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:20:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 19927.201774 secs 2024-04-26T17:20:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:12 smithi196 ceph-mon[32572]: slow request 5764.312661 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:20:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 19927.201774 secs 2024-04-26T17:20:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:12 smithi110 ceph-mon[28069]: slow request 5764.312661 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:20:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:13 smithi193 ceph-mon[32782]: pgmap v10965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:20:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:13 smithi196 ceph-mon[32572]: pgmap v10965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:20:13.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:13 smithi110 ceph-mon[28069]: pgmap v10965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:13.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:20:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:20:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:20:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:14 smithi193 ceph-mon[32782]: pgmap v10966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:20:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:14 smithi193 ceph-mon[32782]: pgmap v10967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:20:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:20:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:20:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:14 smithi196 ceph-mon[32572]: pgmap v10966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:20:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:14 smithi196 ceph-mon[32572]: pgmap v10967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:20:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:20:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:20:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:14 smithi110 ceph-mon[28069]: pgmap v10966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:20:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:14 smithi110 ceph-mon[28069]: pgmap v10967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:20:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:15 smithi110 ceph-mon[28069]: pgmap v10968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:15 smithi193 ceph-mon[32782]: pgmap v10968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:16.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:15 smithi196 ceph-mon[32572]: pgmap v10968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19932.201839 secs 2024-04-26T17:20:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19932.201839 secs 2024-04-26T17:20:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19932.201839 secs 2024-04-26T17:20:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:18 smithi110 ceph-mon[28069]: pgmap v10969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:18 smithi193 ceph-mon[32782]: pgmap v10969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:18 smithi196 ceph-mon[32572]: pgmap v10969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:19 smithi110 ceph-mon[28069]: pgmap v10970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:19 smithi193 ceph-mon[32782]: pgmap v10970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:20.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:19 smithi196 ceph-mon[32572]: pgmap v10970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:21 smithi110 ceph-mon[28069]: pgmap v10971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:21 smithi193 ceph-mon[32782]: pgmap v10971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:22.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:21 smithi196 ceph-mon[32572]: pgmap v10971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:20:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19937.201969 secs 2024-04-26T17:20:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19937.201969 secs 2024-04-26T17:20:23.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19937.201969 secs 2024-04-26T17:20:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:23 smithi193 ceph-mon[32782]: pgmap v10972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:20:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:23 smithi196 ceph-mon[32572]: pgmap v10972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:20:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:23 smithi110 ceph-mon[28069]: pgmap v10972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:20:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:25 smithi110 ceph-mon[28069]: pgmap v10973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:25 smithi193 ceph-mon[32782]: pgmap v10973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:26.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:25 smithi196 ceph-mon[32572]: pgmap v10973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19942.202071 secs 2024-04-26T17:20:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19942.202071 secs 2024-04-26T17:20:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19942.202071 secs 2024-04-26T17:20:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:28 smithi110 ceph-mon[28069]: pgmap v10974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:28 smithi193 ceph-mon[32782]: pgmap v10974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:28 smithi196 ceph-mon[32572]: pgmap v10974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:29 smithi110 ceph-mon[28069]: pgmap v10975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:29 smithi193 ceph-mon[32782]: pgmap v10975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:30.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:29 smithi196 ceph-mon[32572]: pgmap v10975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:31 smithi110 ceph-mon[28069]: pgmap v10976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:32.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:31 smithi196 ceph-mon[32572]: pgmap v10976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:31 smithi193 ceph-mon[32782]: pgmap v10976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19947.202203 secs 2024-04-26T17:20:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19947.202203 secs 2024-04-26T17:20:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19947.202203 secs 2024-04-26T17:20:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:33 smithi193 ceph-mon[32782]: pgmap v10977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:33 smithi196 ceph-mon[32572]: pgmap v10977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:33 smithi110 ceph-mon[28069]: pgmap v10977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:35 smithi110 ceph-mon[28069]: pgmap v10978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:35 smithi193 ceph-mon[32782]: pgmap v10978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:35 smithi196 ceph-mon[32572]: pgmap v10978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19952.202327 secs 2024-04-26T17:20:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19952.202327 secs 2024-04-26T17:20:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19952.202327 secs 2024-04-26T17:20:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:38 smithi110 ceph-mon[28069]: pgmap v10979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:38 smithi193 ceph-mon[32782]: pgmap v10979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:38 smithi196 ceph-mon[32572]: pgmap v10979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:39 smithi110 ceph-mon[28069]: pgmap v10980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:39 smithi193 ceph-mon[32782]: pgmap v10980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:39 smithi196 ceph-mon[32572]: pgmap v10980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:41 smithi110 ceph-mon[28069]: pgmap v10981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:41 smithi193 ceph-mon[32782]: pgmap v10981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:42.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:41 smithi196 ceph-mon[32572]: pgmap v10981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19957.202449 secs 2024-04-26T17:20:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19957.202449 secs 2024-04-26T17:20:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19957.202449 secs 2024-04-26T17:20:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:43 smithi193 ceph-mon[32782]: pgmap v10982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:44.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:43 smithi196 ceph-mon[32572]: pgmap v10982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:43 smithi110 ceph-mon[28069]: pgmap v10982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:45 smithi193 ceph-mon[32782]: pgmap v10983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:46.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:45 smithi196 ceph-mon[32572]: pgmap v10983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:45 smithi110 ceph-mon[28069]: pgmap v10983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19962.202595 secs 2024-04-26T17:20:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19962.202595 secs 2024-04-26T17:20:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19962.202595 secs 2024-04-26T17:20:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:48 smithi110 ceph-mon[28069]: pgmap v10984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:48 smithi193 ceph-mon[32782]: pgmap v10984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:48.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:48 smithi196 ceph-mon[32572]: pgmap v10984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:49 smithi193 ceph-mon[32782]: pgmap v10985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:50.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:49 smithi196 ceph-mon[32572]: pgmap v10985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:49 smithi110 ceph-mon[28069]: pgmap v10985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:51 smithi193 ceph-mon[32782]: pgmap v10986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:52.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:51 smithi196 ceph-mon[32572]: pgmap v10986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:51 smithi110 ceph-mon[28069]: pgmap v10986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19967.202713 secs 2024-04-26T17:20:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19967.202713 secs 2024-04-26T17:20:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19967.202713 secs 2024-04-26T17:20:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:53 smithi193 ceph-mon[32782]: pgmap v10987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:53 smithi196 ceph-mon[32572]: pgmap v10987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:53 smithi110 ceph-mon[28069]: pgmap v10987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:56.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:55 smithi110 ceph-mon[28069]: pgmap v10988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:55 smithi193 ceph-mon[32782]: pgmap v10988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:56.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:55 smithi196 ceph-mon[32572]: pgmap v10988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:20:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19972.202797 secs 2024-04-26T17:20:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19972.202797 secs 2024-04-26T17:20:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19972.202797 secs 2024-04-26T17:20:58.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:58 smithi193 ceph-mon[32782]: pgmap v10989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:58.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:58 smithi196 ceph-mon[32572]: pgmap v10989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:20:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:58 smithi110 ceph-mon[28069]: pgmap v10989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:20:59 smithi193 ceph-mon[32782]: pgmap v10990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:00.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:20:59 smithi196 ceph-mon[32572]: pgmap v10990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:20:59 smithi110 ceph-mon[28069]: pgmap v10990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:02.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:01 smithi196 ceph-mon[32572]: pgmap v10991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:01 smithi193 ceph-mon[32782]: pgmap v10991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:01 smithi110 ceph-mon[28069]: pgmap v10991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19977.202950 secs 2024-04-26T17:21:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19977.202950 secs 2024-04-26T17:21:03.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19977.202950 secs 2024-04-26T17:21:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:03 smithi193 ceph-mon[32782]: pgmap v10992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:03 smithi196 ceph-mon[32572]: pgmap v10992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:03 smithi110 ceph-mon[28069]: pgmap v10992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:05 smithi193 ceph-mon[32782]: pgmap v10993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:06.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:05 smithi196 ceph-mon[32572]: pgmap v10993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:05 smithi110 ceph-mon[28069]: pgmap v10993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19982.203026 secs 2024-04-26T17:21:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19982.203026 secs 2024-04-26T17:21:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19982.203026 secs 2024-04-26T17:21:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:08 smithi193 ceph-mon[32782]: pgmap v10994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:08 smithi196 ceph-mon[32572]: pgmap v10994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:08 smithi110 ceph-mon[28069]: pgmap v10994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:09 smithi193 ceph-mon[32782]: pgmap v10995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:10.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:09 smithi196 ceph-mon[32572]: pgmap v10995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:10.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:09 smithi110 ceph-mon[28069]: pgmap v10995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:11 smithi193 ceph-mon[32782]: pgmap v10996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:11 smithi196 ceph-mon[32572]: pgmap v10996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:12.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:11 smithi110 ceph-mon[28069]: pgmap v10996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19987.203154 secs 2024-04-26T17:21:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19987.203154 secs 2024-04-26T17:21:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19987.203154 secs 2024-04-26T17:21:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:13 smithi193 ceph-mon[32782]: pgmap v10997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:14.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:13 smithi196 ceph-mon[32572]: pgmap v10997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:13 smithi110 ceph-mon[28069]: pgmap v10997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:21:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:21:15.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:21:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:21:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:21:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:15 smithi193 ceph-mon[32782]: pgmap v10998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T17:21:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:15 smithi193 ceph-mon[32782]: pgmap v10999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:21:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:21:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:21:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:15 smithi196 ceph-mon[32572]: pgmap v10998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T17:21:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:15 smithi196 ceph-mon[32572]: pgmap v10999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:21:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:21:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:21:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:15 smithi110 ceph-mon[28069]: pgmap v10998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T17:21:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:15 smithi110 ceph-mon[28069]: pgmap v10999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:21:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19992.203294 secs 2024-04-26T17:21:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19992.203294 secs 2024-04-26T17:21:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19992.203294 secs 2024-04-26T17:21:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:18 smithi110 ceph-mon[28069]: pgmap v11000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:21:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:18 smithi193 ceph-mon[32782]: pgmap v11000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:21:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:18 smithi196 ceph-mon[32572]: pgmap v11000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:21:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:21:19.668+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:21:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:21:19.668+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:21:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:21:19.669+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 156 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:21:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:21:19.669+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 156 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:21:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:20 smithi110 ceph-mon[28069]: pgmap v11001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:20 smithi193 ceph-mon[32782]: pgmap v11001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:20.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:20 smithi196 ceph-mon[32572]: pgmap v11001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:22 smithi110 ceph-mon[28069]: pgmap v11002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 19997.203419 secs 2024-04-26T17:21:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:22 smithi193 ceph-mon[32782]: pgmap v11002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 19997.203419 secs 2024-04-26T17:21:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:22 smithi196 ceph-mon[32572]: pgmap v11002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 19997.203419 secs 2024-04-26T17:21:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:24 smithi110 ceph-mon[28069]: pgmap v11003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:24.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:24 smithi193 ceph-mon[32782]: pgmap v11003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:24 smithi196 ceph-mon[32572]: pgmap v11003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:21:26.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:26 smithi193 ceph-mon[32782]: pgmap v11004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:21:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:26 smithi196 ceph-mon[32572]: pgmap v11004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:21:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:26 smithi110 ceph-mon[28069]: pgmap v11004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:21:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20002.203544 secs 2024-04-26T17:21:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20002.203544 secs 2024-04-26T17:21:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20002.203544 secs 2024-04-26T17:21:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:28 smithi193 ceph-mon[32782]: pgmap v11005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:28 smithi196 ceph-mon[32572]: pgmap v11005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:28 smithi110 ceph-mon[28069]: pgmap v11005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:30.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:30 smithi193 ceph-mon[32782]: pgmap v11006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:30 smithi196 ceph-mon[32572]: pgmap v11006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:30 smithi110 ceph-mon[28069]: pgmap v11006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:32 smithi193 ceph-mon[32782]: pgmap v11007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20007.203671 secs 2024-04-26T17:21:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:32 smithi196 ceph-mon[32572]: pgmap v11007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20007.203671 secs 2024-04-26T17:21:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:32 smithi110 ceph-mon[28069]: pgmap v11007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20007.203671 secs 2024-04-26T17:21:34.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:34 smithi193 ceph-mon[32782]: pgmap v11008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:34.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:34 smithi196 ceph-mon[32572]: pgmap v11008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:34 smithi110 ceph-mon[28069]: pgmap v11008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:36.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:36 smithi193 ceph-mon[32782]: pgmap v11009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:36 smithi196 ceph-mon[32572]: pgmap v11009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:36 smithi110 ceph-mon[28069]: pgmap v11009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20012.203740 secs 2024-04-26T17:21:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20012.203740 secs 2024-04-26T17:21:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20012.203740 secs 2024-04-26T17:21:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:38 smithi193 ceph-mon[32782]: pgmap v11010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:38 smithi196 ceph-mon[32572]: pgmap v11010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:38.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:38 smithi110 ceph-mon[28069]: pgmap v11010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:40.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:40 smithi193 ceph-mon[32782]: pgmap v11011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:40 smithi196 ceph-mon[32572]: pgmap v11011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:40.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:40 smithi110 ceph-mon[28069]: pgmap v11011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:42 smithi193 ceph-mon[32782]: pgmap v11012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20017.203863 secs 2024-04-26T17:21:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:42 smithi196 ceph-mon[32572]: pgmap v11012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20017.203863 secs 2024-04-26T17:21:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:42 smithi110 ceph-mon[28069]: pgmap v11012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20017.203863 secs 2024-04-26T17:21:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:44 smithi193 ceph-mon[32782]: pgmap v11013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:44 smithi196 ceph-mon[32572]: pgmap v11013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:44 smithi110 ceph-mon[28069]: pgmap v11013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:46.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:46 smithi193 ceph-mon[32782]: pgmap v11014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:46.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:46 smithi196 ceph-mon[32572]: pgmap v11014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:46 smithi110 ceph-mon[28069]: pgmap v11014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20022.203988 secs 2024-04-26T17:21:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20022.203988 secs 2024-04-26T17:21:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20022.203988 secs 2024-04-26T17:21:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:48 smithi196 ceph-mon[32572]: pgmap v11015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:48 smithi110 ceph-mon[28069]: pgmap v11015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:48 smithi193 ceph-mon[32782]: pgmap v11015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:50.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:50 smithi196 ceph-mon[32572]: pgmap v11016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:50 smithi110 ceph-mon[28069]: pgmap v11016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:50 smithi193 ceph-mon[32782]: pgmap v11016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:52 smithi196 ceph-mon[32572]: pgmap v11017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20027.204110 secs 2024-04-26T17:21:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:52 smithi110 ceph-mon[28069]: pgmap v11017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20027.204110 secs 2024-04-26T17:21:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:52 smithi193 ceph-mon[32782]: pgmap v11017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20027.204110 secs 2024-04-26T17:21:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:54 smithi196 ceph-mon[32572]: pgmap v11018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:54.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:54 smithi110 ceph-mon[28069]: pgmap v11018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:54 smithi193 ceph-mon[32782]: pgmap v11018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:21:56.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:56 smithi196 ceph-mon[32572]: pgmap v11019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:56 smithi110 ceph-mon[28069]: pgmap v11019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:56 smithi193 ceph-mon[32782]: pgmap v11019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20032.204234 secs 2024-04-26T17:21:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20032.204234 secs 2024-04-26T17:21:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20032.204234 secs 2024-04-26T17:21:58.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:21:58 smithi196 ceph-mon[32572]: pgmap v11020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:21:58 smithi110 ceph-mon[28069]: pgmap v11020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:21:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:21:58 smithi193 ceph-mon[32782]: pgmap v11020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:00.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:00 smithi196 ceph-mon[32572]: pgmap v11021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:00 smithi110 ceph-mon[28069]: pgmap v11021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:00 smithi193 ceph-mon[32782]: pgmap v11021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:02 smithi196 ceph-mon[32572]: pgmap v11022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20037.204357 secs 2024-04-26T17:22:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:02 smithi110 ceph-mon[28069]: pgmap v11022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20037.204357 secs 2024-04-26T17:22:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:02 smithi193 ceph-mon[32782]: pgmap v11022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20037.204357 secs 2024-04-26T17:22:04.672 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:04 smithi193 ceph-mon[32782]: pgmap v11023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:04.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:04 smithi196 ceph-mon[32572]: pgmap v11023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:04 smithi110 ceph-mon[28069]: pgmap v11023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:06 smithi196 ceph-mon[32572]: pgmap v11024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:06 smithi110 ceph-mon[28069]: pgmap v11024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:06 smithi193 ceph-mon[32782]: pgmap v11024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20042.204451 secs 2024-04-26T17:22:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20042.204451 secs 2024-04-26T17:22:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20042.204451 secs 2024-04-26T17:22:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:08 smithi196 ceph-mon[32572]: pgmap v11025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:08 smithi110 ceph-mon[28069]: pgmap v11025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:08.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:08 smithi193 ceph-mon[32782]: pgmap v11025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:10 smithi196 ceph-mon[32572]: pgmap v11026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:10 smithi110 ceph-mon[28069]: pgmap v11026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:10.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:10 smithi193 ceph-mon[32782]: pgmap v11026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:12 smithi196 ceph-mon[32572]: pgmap v11027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20047.204550 secs 2024-04-26T17:22:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:12 smithi110 ceph-mon[28069]: pgmap v11027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20047.204550 secs 2024-04-26T17:22:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:12 smithi193 ceph-mon[32782]: pgmap v11027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20047.204550 secs 2024-04-26T17:22:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:14 smithi196 ceph-mon[32572]: pgmap v11028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:14 smithi110 ceph-mon[28069]: pgmap v11028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:14 smithi193 ceph-mon[32782]: pgmap v11028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:16.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:16 smithi196 ceph-mon[32572]: pgmap v11029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:22:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:22:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:22:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:16 smithi110 ceph-mon[28069]: pgmap v11029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:22:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:22:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:22:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:16 smithi193 ceph-mon[32782]: pgmap v11029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:22:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:22:16.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:22:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20052.204585 secs 2024-04-26T17:22:17.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20052.204585 secs 2024-04-26T17:22:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20052.204585 secs 2024-04-26T17:22:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:18 smithi196 ceph-mon[32572]: pgmap v11030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:22:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:22:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:18 smithi196 ceph-mon[32572]: pgmap v11031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:22:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:18 smithi196 ceph-mon[32572]: pgmap v11032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:22:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:18 smithi110 ceph-mon[28069]: pgmap v11030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:22:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:22:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:18 smithi110 ceph-mon[28069]: pgmap v11031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:22:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:18 smithi110 ceph-mon[28069]: pgmap v11032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:22:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:18 smithi193 ceph-mon[32782]: pgmap v11030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:22:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:22:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:18 smithi193 ceph-mon[32782]: pgmap v11031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:22:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:18 smithi193 ceph-mon[32782]: pgmap v11032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:22:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:19 smithi193 ceph-mon[32782]: pgmap v11033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:20.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:19 smithi196 ceph-mon[32572]: pgmap v11033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:19 smithi110 ceph-mon[28069]: pgmap v11033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:21 smithi193 ceph-mon[32782]: pgmap v11034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T17:22:22.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:21 smithi196 ceph-mon[32572]: pgmap v11034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T17:22:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:21 smithi110 ceph-mon[28069]: pgmap v11034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T17:22:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20057.204673 secs 2024-04-26T17:22:23.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20057.204673 secs 2024-04-26T17:22:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20057.204673 secs 2024-04-26T17:22:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:23 smithi193 ceph-mon[32782]: pgmap v11035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:24.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:23 smithi196 ceph-mon[32572]: pgmap v11035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:23 smithi110 ceph-mon[28069]: pgmap v11035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:26.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:25 smithi110 ceph-mon[28069]: pgmap v11036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:25 smithi193 ceph-mon[32782]: pgmap v11036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:26.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:25 smithi196 ceph-mon[32572]: pgmap v11036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20062.204797 secs 2024-04-26T17:22:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20062.204797 secs 2024-04-26T17:22:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20062.204797 secs 2024-04-26T17:22:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:28 smithi110 ceph-mon[28069]: pgmap v11037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:22:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:28 smithi193 ceph-mon[32782]: pgmap v11037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:22:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:28 smithi196 ceph-mon[32572]: pgmap v11037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:22:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:29 smithi193 ceph-mon[32782]: pgmap v11038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:30.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:29 smithi196 ceph-mon[32572]: pgmap v11038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:30.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:29 smithi110 ceph-mon[28069]: pgmap v11038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:31 smithi193 ceph-mon[32782]: pgmap v11039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:31 smithi196 ceph-mon[32572]: pgmap v11039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:31 smithi110 ceph-mon[28069]: pgmap v11039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20067.204919 secs 2024-04-26T17:22:33.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20067.204919 secs 2024-04-26T17:22:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20067.204919 secs 2024-04-26T17:22:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:33 smithi193 ceph-mon[32782]: pgmap v11040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:33 smithi196 ceph-mon[32572]: pgmap v11040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:33 smithi110 ceph-mon[28069]: pgmap v11040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:35 smithi193 ceph-mon[32782]: pgmap v11041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:35 smithi196 ceph-mon[32572]: pgmap v11041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:35 smithi110 ceph-mon[28069]: pgmap v11041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20072.205000 secs 2024-04-26T17:22:37.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20072.205000 secs 2024-04-26T17:22:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20072.205000 secs 2024-04-26T17:22:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:38 smithi110 ceph-mon[28069]: pgmap v11042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:38 smithi193 ceph-mon[32782]: pgmap v11042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:38 smithi196 ceph-mon[32572]: pgmap v11042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:39 smithi193 ceph-mon[32782]: pgmap v11043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:39 smithi196 ceph-mon[32572]: pgmap v11043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:39 smithi110 ceph-mon[28069]: pgmap v11043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:41 smithi193 ceph-mon[32782]: pgmap v11044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:42.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:41 smithi196 ceph-mon[32572]: pgmap v11044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:41 smithi110 ceph-mon[28069]: pgmap v11044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20077.205117 secs 2024-04-26T17:22:43.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20077.205117 secs 2024-04-26T17:22:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20077.205117 secs 2024-04-26T17:22:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:43 smithi193 ceph-mon[32782]: pgmap v11045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:44.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:43 smithi196 ceph-mon[32572]: pgmap v11045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:43 smithi110 ceph-mon[28069]: pgmap v11045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:45 smithi193 ceph-mon[32782]: pgmap v11046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:46.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:45 smithi196 ceph-mon[32572]: pgmap v11046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:46.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:45 smithi110 ceph-mon[28069]: pgmap v11046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20082.205237 secs 2024-04-26T17:22:47.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20082.205237 secs 2024-04-26T17:22:47.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20082.205237 secs 2024-04-26T17:22:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:48 smithi110 ceph-mon[28069]: pgmap v11047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:48.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:48 smithi193 ceph-mon[32782]: pgmap v11047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:48.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:48 smithi196 ceph-mon[32572]: pgmap v11047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:49 smithi193 ceph-mon[32782]: pgmap v11048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:50.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:49 smithi196 ceph-mon[32572]: pgmap v11048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:49 smithi110 ceph-mon[28069]: pgmap v11048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:51 smithi193 ceph-mon[32782]: pgmap v11049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:52.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:51 smithi196 ceph-mon[32572]: pgmap v11049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:51 smithi110 ceph-mon[28069]: pgmap v11049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20087.205386 secs 2024-04-26T17:22:53.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20087.205386 secs 2024-04-26T17:22:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20087.205386 secs 2024-04-26T17:22:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:53 smithi193 ceph-mon[32782]: pgmap v11050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:54.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:53 smithi196 ceph-mon[32572]: pgmap v11050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:53 smithi110 ceph-mon[28069]: pgmap v11050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:56.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:55 smithi110 ceph-mon[28069]: pgmap v11051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:55 smithi193 ceph-mon[32782]: pgmap v11051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:56.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:55 smithi196 ceph-mon[32572]: pgmap v11051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:22:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20092.205512 secs 2024-04-26T17:22:57.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20092.205512 secs 2024-04-26T17:22:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20092.205512 secs 2024-04-26T17:22:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:58 smithi110 ceph-mon[28069]: pgmap v11052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:58 smithi193 ceph-mon[32782]: pgmap v11052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:22:58.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:58 smithi196 ceph-mon[32572]: pgmap v11052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:22:59 smithi193 ceph-mon[32782]: pgmap v11053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:00.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:22:59 smithi196 ceph-mon[32572]: pgmap v11053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:22:59 smithi110 ceph-mon[28069]: pgmap v11053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:01 smithi193 ceph-mon[32782]: pgmap v11054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:01 smithi196 ceph-mon[32572]: pgmap v11054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:01 smithi110 ceph-mon[28069]: pgmap v11054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20097.205635 secs 2024-04-26T17:23:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20097.205635 secs 2024-04-26T17:23:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20097.205635 secs 2024-04-26T17:23:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:03 smithi193 ceph-mon[32782]: pgmap v11055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:04.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:03 smithi196 ceph-mon[32572]: pgmap v11055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:03 smithi110 ceph-mon[28069]: pgmap v11055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:05 smithi193 ceph-mon[32782]: pgmap v11056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:06.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:05 smithi196 ceph-mon[32572]: pgmap v11056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:05 smithi110 ceph-mon[28069]: pgmap v11056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20102.205713 secs 2024-04-26T17:23:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20102.205713 secs 2024-04-26T17:23:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20102.205713 secs 2024-04-26T17:23:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:08 smithi193 ceph-mon[32782]: pgmap v11057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:08 smithi196 ceph-mon[32572]: pgmap v11057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:08 smithi110 ceph-mon[28069]: pgmap v11057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:09 smithi193 ceph-mon[32782]: pgmap v11058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:10.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:09 smithi196 ceph-mon[32572]: pgmap v11058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:09 smithi110 ceph-mon[28069]: pgmap v11058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:11 smithi193 ceph-mon[32782]: pgmap v11059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:12.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:11 smithi196 ceph-mon[32572]: pgmap v11059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:11 smithi110 ceph-mon[28069]: pgmap v11059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20107.205840 secs 2024-04-26T17:23:13.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20107.205840 secs 2024-04-26T17:23:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20107.205840 secs 2024-04-26T17:23:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:13 smithi193 ceph-mon[32782]: pgmap v11060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:14.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:13 smithi196 ceph-mon[32572]: pgmap v11060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:14.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:13 smithi110 ceph-mon[28069]: pgmap v11060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:15 smithi193 ceph-mon[32782]: pgmap v11061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:16.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:15 smithi196 ceph-mon[32572]: pgmap v11061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:15 smithi110 ceph-mon[28069]: pgmap v11061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20112.205964 secs 2024-04-26T17:23:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20112.205964 secs 2024-04-26T17:23:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20112.205964 secs 2024-04-26T17:23:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:18 smithi193 ceph-mon[32782]: pgmap v11062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:23:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:18 smithi196 ceph-mon[32572]: pgmap v11062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:23:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:18 smithi110 ceph-mon[28069]: pgmap v11062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:23:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:23:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:23:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:23:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:23:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:23:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:23:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:23:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:20 smithi193 ceph-mon[32782]: pgmap v11063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T17:23:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:20 smithi193 ceph-mon[32782]: pgmap v11064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:20 smithi196 ceph-mon[32572]: pgmap v11063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T17:23:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:20 smithi196 ceph-mon[32572]: pgmap v11064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:20 smithi110 ceph-mon[28069]: pgmap v11063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T17:23:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:20 smithi110 ceph-mon[28069]: pgmap v11064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:22 smithi193 ceph-mon[32782]: pgmap v11065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20117.206047 secs 2024-04-26T17:23:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:22 smithi196 ceph-mon[32572]: pgmap v11065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20117.206047 secs 2024-04-26T17:23:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:22 smithi110 ceph-mon[28069]: pgmap v11065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20117.206047 secs 2024-04-26T17:23:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:24 smithi193 ceph-mon[32782]: pgmap v11066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:24 smithi196 ceph-mon[32572]: pgmap v11066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:24 smithi110 ceph-mon[28069]: pgmap v11066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:26 smithi193 ceph-mon[32782]: pgmap v11067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:26 smithi196 ceph-mon[32572]: pgmap v11067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:26 smithi110 ceph-mon[28069]: pgmap v11067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:23:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20122.206188 secs 2024-04-26T17:23:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20122.206188 secs 2024-04-26T17:23:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20122.206188 secs 2024-04-26T17:23:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:28 smithi196 ceph-mon[32572]: pgmap v11068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:23:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:28 smithi110 ceph-mon[28069]: pgmap v11068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:23:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:28 smithi193 ceph-mon[32782]: pgmap v11068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:23:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:30 smithi196 ceph-mon[32572]: pgmap v11069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:23:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:30 smithi110 ceph-mon[28069]: pgmap v11069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:23:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:30 smithi193 ceph-mon[32782]: pgmap v11069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:23:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:32 smithi196 ceph-mon[32572]: pgmap v11070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20127.206343 secs 2024-04-26T17:23:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:32 smithi110 ceph-mon[28069]: pgmap v11070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20127.206343 secs 2024-04-26T17:23:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:32 smithi193 ceph-mon[32782]: pgmap v11070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20127.206343 secs 2024-04-26T17:23:34.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:34 smithi193 ceph-mon[32782]: pgmap v11071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:34 smithi196 ceph-mon[32572]: pgmap v11071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:34 smithi110 ceph-mon[28069]: pgmap v11071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:36 smithi196 ceph-mon[32572]: pgmap v11072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:36 smithi110 ceph-mon[28069]: pgmap v11072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:36 smithi193 ceph-mon[32782]: pgmap v11072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20132.206463 secs 2024-04-26T17:23:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20132.206463 secs 2024-04-26T17:23:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20132.206463 secs 2024-04-26T17:23:39.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:38 smithi196 ceph-mon[32572]: pgmap v11073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:38 smithi110 ceph-mon[28069]: pgmap v11073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:38 smithi193 ceph-mon[32782]: pgmap v11073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:40 smithi196 ceph-mon[32572]: pgmap v11074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:23:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:40 smithi110 ceph-mon[28069]: pgmap v11074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:23:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:40 smithi193 ceph-mon[32782]: pgmap v11074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:23:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:42 smithi196 ceph-mon[32572]: pgmap v11075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20137.206605 secs 2024-04-26T17:23:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:42 smithi110 ceph-mon[28069]: pgmap v11075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20137.206605 secs 2024-04-26T17:23:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:42 smithi193 ceph-mon[32782]: pgmap v11075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20137.206605 secs 2024-04-26T17:23:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:44 smithi196 ceph-mon[32572]: pgmap v11076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:44 smithi110 ceph-mon[28069]: pgmap v11076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:44 smithi193 ceph-mon[32782]: pgmap v11076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:46 smithi196 ceph-mon[32572]: pgmap v11077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:46 smithi110 ceph-mon[28069]: pgmap v11077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:46 smithi193 ceph-mon[32782]: pgmap v11077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20142.206675 secs 2024-04-26T17:23:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20142.206675 secs 2024-04-26T17:23:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20142.206675 secs 2024-04-26T17:23:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:48 smithi196 ceph-mon[32572]: pgmap v11078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:48 smithi110 ceph-mon[28069]: pgmap v11078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:48 smithi193 ceph-mon[32782]: pgmap v11078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:50 smithi196 ceph-mon[32572]: pgmap v11079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:23:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:50 smithi110 ceph-mon[28069]: pgmap v11079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:23:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:50 smithi193 ceph-mon[32782]: pgmap v11079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:23:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:52 smithi196 ceph-mon[32572]: pgmap v11080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20147.206754 secs 2024-04-26T17:23:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:52 smithi110 ceph-mon[28069]: pgmap v11080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20147.206754 secs 2024-04-26T17:23:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:52 smithi193 ceph-mon[32782]: pgmap v11080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20147.206754 secs 2024-04-26T17:23:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:54 smithi196 ceph-mon[32572]: pgmap v11081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:54 smithi110 ceph-mon[28069]: pgmap v11081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:54 smithi193 ceph-mon[32782]: pgmap v11081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:56 smithi196 ceph-mon[32572]: pgmap v11082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:56 smithi110 ceph-mon[28069]: pgmap v11082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:56 smithi193 ceph-mon[32782]: pgmap v11082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:23:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20152.206825 secs 2024-04-26T17:23:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20152.206825 secs 2024-04-26T17:23:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20152.206825 secs 2024-04-26T17:23:59.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:23:58 smithi196 ceph-mon[32572]: pgmap v11083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:23:58 smithi110 ceph-mon[28069]: pgmap v11083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:23:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:23:58 smithi193 ceph-mon[32782]: pgmap v11083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:00 smithi196 ceph-mon[32572]: pgmap v11084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:24:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:00 smithi110 ceph-mon[28069]: pgmap v11084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:24:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:00 smithi193 ceph-mon[32782]: pgmap v11084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:24:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:02 smithi196 ceph-mon[32572]: pgmap v11085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20157.206937 secs 2024-04-26T17:24:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:02 smithi110 ceph-mon[28069]: pgmap v11085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20157.206937 secs 2024-04-26T17:24:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:02 smithi193 ceph-mon[32782]: pgmap v11085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20157.206937 secs 2024-04-26T17:24:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:04 smithi196 ceph-mon[32572]: pgmap v11086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:04 smithi110 ceph-mon[28069]: pgmap v11086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:04 smithi193 ceph-mon[32782]: pgmap v11086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:06 smithi196 ceph-mon[32572]: pgmap v11087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:06 smithi110 ceph-mon[28069]: pgmap v11087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:06 smithi193 ceph-mon[32782]: pgmap v11087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20162.207071 secs 2024-04-26T17:24:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20162.207071 secs 2024-04-26T17:24:08.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20162.207071 secs 2024-04-26T17:24:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:08 smithi110 ceph-mon[28069]: pgmap v11088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:08 smithi193 ceph-mon[32782]: pgmap v11088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:08 smithi196 ceph-mon[32572]: pgmap v11088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:10.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:24:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:24:10.076+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:24:10.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:24:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:24:10.076+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:24:10.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:24:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:24:10.077+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:24:10.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:24:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:24:10.077+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:24:10.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:24:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:24:10.077+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:24:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:10 smithi110 ceph-mon[28069]: pgmap v11089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:24:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:10 smithi193 ceph-mon[32782]: pgmap v11089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:24:11.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:10 smithi196 ceph-mon[32572]: pgmap v11089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:24:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:12 smithi110 ceph-mon[28069]: pgmap v11090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20167.207208 secs 2024-04-26T17:24:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:12 smithi193 ceph-mon[32782]: pgmap v11090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20167.207208 secs 2024-04-26T17:24:13.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:12 smithi196 ceph-mon[32572]: pgmap v11090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20167.207208 secs 2024-04-26T17:24:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:14 smithi110 ceph-mon[28069]: pgmap v11091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:14 smithi193 ceph-mon[32782]: pgmap v11091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:15.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:14 smithi196 ceph-mon[32572]: pgmap v11091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:15 smithi193 ceph-mon[32782]: pgmap v11092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:16.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:15 smithi196 ceph-mon[32572]: pgmap v11092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:15 smithi110 ceph-mon[28069]: pgmap v11092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20172.207332 secs 2024-04-26T17:24:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20172.207332 secs 2024-04-26T17:24:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20172.207332 secs 2024-04-26T17:24:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:18 smithi193 ceph-mon[32782]: pgmap v11093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:18 smithi196 ceph-mon[32572]: pgmap v11093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:18 smithi110 ceph-mon[28069]: pgmap v11093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:19.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:24:19.699+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:24:19.698 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:24:19.699+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:24:19.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:24:19.700+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 157 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:24:19.699 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:24:19.700+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 157 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:24:20.749 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:20 smithi193 ceph-mon[32782]: pgmap v11094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:20.749 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:24:20.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:20 smithi196 ceph-mon[32572]: pgmap v11094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:20.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:24:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:20 smithi110 ceph-mon[28069]: pgmap v11094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:24:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:22 smithi196 ceph-mon[32572]: pgmap v11095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20177.207420 secs 2024-04-26T17:24:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:22 smithi110 ceph-mon[28069]: pgmap v11095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20177.207420 secs 2024-04-26T17:24:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:22 smithi193 ceph-mon[32782]: pgmap v11095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20177.207420 secs 2024-04-26T17:24:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:24:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:24:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:24:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:24 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:24:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:24 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:24:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:24 smithi193 ceph-mon[32782]: pgmap v11096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:24 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:24:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:24 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:24:25.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:24 smithi196 ceph-mon[32572]: pgmap v11096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:24 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:24:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:24 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:24:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:24 smithi110 ceph-mon[28069]: pgmap v11096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:24:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:24:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:24:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:24:26.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:26 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:24:26.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:26 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:24:26.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:26 smithi110 ceph-mon[28069]: pgmap v11097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 B/s rd, 1 op/s 2024-04-26T17:24:26.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:26 smithi110 ceph-mon[28069]: pgmap v11098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 962 B/s rd, 1 op/s 2024-04-26T17:24:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:26 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:24:27.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:26 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:24:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:26 smithi196 ceph-mon[32572]: pgmap v11097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 B/s rd, 1 op/s 2024-04-26T17:24:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:26 smithi196 ceph-mon[32572]: pgmap v11098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 962 B/s rd, 1 op/s 2024-04-26T17:24:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:26 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:24:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:26 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:24:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:26 smithi193 ceph-mon[32782]: pgmap v11097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 795 B/s rd, 1 op/s 2024-04-26T17:24:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:26 smithi193 ceph-mon[32782]: pgmap v11098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 962 B/s rd, 1 op/s 2024-04-26T17:24:27.968 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20182.207554 secs 2024-04-26T17:24:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20182.207554 secs 2024-04-26T17:24:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20182.207554 secs 2024-04-26T17:24:29.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:28 smithi196 ceph-mon[32572]: pgmap v11099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T17:24:29.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:28 smithi110 ceph-mon[28069]: pgmap v11099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T17:24:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:28 smithi193 ceph-mon[32782]: pgmap v11099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T17:24:31.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:30 smithi196 ceph-mon[32572]: pgmap v11100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:24:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:30 smithi110 ceph-mon[28069]: pgmap v11100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:24:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:30 smithi193 ceph-mon[32782]: pgmap v11100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:24:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:32 smithi196 ceph-mon[32572]: pgmap v11101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:24:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20187.207671 secs 2024-04-26T17:24:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:32 smithi110 ceph-mon[28069]: pgmap v11101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:24:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20187.207671 secs 2024-04-26T17:24:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:32 smithi193 ceph-mon[32782]: pgmap v11101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:24:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20187.207671 secs 2024-04-26T17:24:34.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:34 smithi193 ceph-mon[32782]: pgmap v11102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:24:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:34 smithi196 ceph-mon[32572]: pgmap v11102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:24:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:34 smithi110 ceph-mon[28069]: pgmap v11102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:24:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:36 smithi196 ceph-mon[32572]: pgmap v11103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:24:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:36 smithi110 ceph-mon[28069]: pgmap v11103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:24:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:36 smithi193 ceph-mon[32782]: pgmap v11103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:24:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20192.207770 secs 2024-04-26T17:24:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20192.207770 secs 2024-04-26T17:24:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20192.207770 secs 2024-04-26T17:24:38.994 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:38 smithi110 ceph-mon[28069]: pgmap v11104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:39.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:38 smithi196 ceph-mon[32572]: pgmap v11104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:38 smithi193 ceph-mon[32782]: pgmap v11104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:40 smithi196 ceph-mon[32572]: pgmap v11105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:40 smithi110 ceph-mon[28069]: pgmap v11105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:40 smithi193 ceph-mon[32782]: pgmap v11105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:42 smithi196 ceph-mon[32572]: pgmap v11106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20197.207890 secs 2024-04-26T17:24:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:42 smithi110 ceph-mon[28069]: pgmap v11106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20197.207890 secs 2024-04-26T17:24:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:42 smithi193 ceph-mon[32782]: pgmap v11106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20197.207890 secs 2024-04-26T17:24:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:44 smithi196 ceph-mon[32572]: pgmap v11107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:44 smithi110 ceph-mon[28069]: pgmap v11107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:44 smithi193 ceph-mon[32782]: pgmap v11107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:46 smithi196 ceph-mon[32572]: pgmap v11108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:46 smithi110 ceph-mon[28069]: pgmap v11108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:46 smithi193 ceph-mon[32782]: pgmap v11108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20202.207987 secs 2024-04-26T17:24:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20202.207987 secs 2024-04-26T17:24:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20202.207987 secs 2024-04-26T17:24:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:48 smithi196 ceph-mon[32572]: pgmap v11109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:48 smithi110 ceph-mon[28069]: pgmap v11109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:48 smithi193 ceph-mon[32782]: pgmap v11109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:50 smithi196 ceph-mon[32572]: pgmap v11110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:50 smithi110 ceph-mon[28069]: pgmap v11110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:50 smithi193 ceph-mon[32782]: pgmap v11110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:52 smithi196 ceph-mon[32572]: pgmap v11111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20207.208060 secs 2024-04-26T17:24:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:52 smithi110 ceph-mon[28069]: pgmap v11111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20207.208060 secs 2024-04-26T17:24:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:52 smithi193 ceph-mon[32782]: pgmap v11111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20207.208060 secs 2024-04-26T17:24:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:54 smithi196 ceph-mon[32572]: pgmap v11112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:54 smithi110 ceph-mon[28069]: pgmap v11112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:54 smithi193 ceph-mon[32782]: pgmap v11112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:24:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:56 smithi196 ceph-mon[32572]: pgmap v11113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:56 smithi110 ceph-mon[28069]: pgmap v11113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:56 smithi193 ceph-mon[32782]: pgmap v11113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20212.208201 secs 2024-04-26T17:24:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20212.208201 secs 2024-04-26T17:24:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20212.208201 secs 2024-04-26T17:24:59.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:24:58 smithi196 ceph-mon[32572]: pgmap v11114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:59.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:24:58 smithi110 ceph-mon[28069]: pgmap v11114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:24:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:24:58 smithi193 ceph-mon[32782]: pgmap v11114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:01.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:00 smithi196 ceph-mon[32572]: pgmap v11115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:00 smithi110 ceph-mon[28069]: pgmap v11115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:00 smithi193 ceph-mon[32782]: pgmap v11115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:02 smithi196 ceph-mon[32572]: pgmap v11116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20217.208296 secs 2024-04-26T17:25:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:02 smithi110 ceph-mon[28069]: pgmap v11116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20217.208296 secs 2024-04-26T17:25:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:02 smithi193 ceph-mon[32782]: pgmap v11116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20217.208296 secs 2024-04-26T17:25:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:04 smithi196 ceph-mon[32572]: pgmap v11117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:25:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:04 smithi110 ceph-mon[28069]: pgmap v11117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:25:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:04 smithi193 ceph-mon[32782]: pgmap v11117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:25:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:06 smithi110 ceph-mon[28069]: pgmap v11118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:25:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:06 smithi193 ceph-mon[32782]: pgmap v11118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:25:07.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:06 smithi196 ceph-mon[32572]: pgmap v11118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:25:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20222.208375 secs 2024-04-26T17:25:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20222.208375 secs 2024-04-26T17:25:08.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20222.208375 secs 2024-04-26T17:25:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:08 smithi110 ceph-mon[28069]: pgmap v11119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:25:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:08 smithi193 ceph-mon[32782]: pgmap v11119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:25:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:08 smithi196 ceph-mon[32572]: pgmap v11119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:25:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:10 smithi110 ceph-mon[28069]: pgmap v11120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:25:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:10 smithi193 ceph-mon[32782]: pgmap v11120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:25:11.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:10 smithi196 ceph-mon[32572]: pgmap v11120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:25:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:12 smithi110 ceph-mon[28069]: pgmap v11121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:25:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 20227.208490 secs 2024-04-26T17:25:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:12 smithi110 ceph-mon[28069]: slow request 5764.226251 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:25:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:12 smithi193 ceph-mon[32782]: pgmap v11121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:25:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 20227.208490 secs 2024-04-26T17:25:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:12 smithi193 ceph-mon[32782]: slow request 5764.226251 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:25:13.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:12 smithi196 ceph-mon[32572]: pgmap v11121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:25:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 20227.208490 secs 2024-04-26T17:25:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:12 smithi196 ceph-mon[32572]: slow request 5764.226251 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:25:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:14 smithi110 ceph-mon[28069]: pgmap v11122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:25:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:14 smithi193 ceph-mon[32782]: pgmap v11122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:25:15.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:14 smithi196 ceph-mon[32572]: pgmap v11122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:25:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:16 smithi193 ceph-mon[32782]: pgmap v11123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:16 smithi196 ceph-mon[32572]: pgmap v11123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:16 smithi110 ceph-mon[28069]: pgmap v11123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20232.208552 secs 2024-04-26T17:25:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20232.208552 secs 2024-04-26T17:25:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20232.208552 secs 2024-04-26T17:25:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:18 smithi193 ceph-mon[32782]: pgmap v11124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:19.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:18 smithi196 ceph-mon[32572]: pgmap v11124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:19.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:18 smithi110 ceph-mon[28069]: pgmap v11124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:19 smithi193 ceph-mon[32782]: pgmap v11125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:20.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:19 smithi196 ceph-mon[32572]: pgmap v11125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:19 smithi110 ceph-mon[28069]: pgmap v11125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:22.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:22 smithi193 ceph-mon[32782]: pgmap v11126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:22.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:22 smithi196 ceph-mon[32572]: pgmap v11126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:22.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:22 smithi110 ceph-mon[28069]: pgmap v11126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:23 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20237.208640 secs 2024-04-26T17:25:23.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:23 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20237.208640 secs 2024-04-26T17:25:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:23 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20237.208640 secs 2024-04-26T17:25:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:24 smithi193 ceph-mon[32782]: pgmap v11127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:24.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:24 smithi196 ceph-mon[32572]: pgmap v11127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:24.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:24 smithi110 ceph-mon[28069]: pgmap v11127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:26.342 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:26 smithi110 ceph-mon[28069]: pgmap v11128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:26.342 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:25:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:26 smithi193 ceph-mon[32782]: pgmap v11128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:25:26.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:26 smithi196 ceph-mon[32572]: pgmap v11128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:26.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:25:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:25:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:25:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:27 smithi193 ceph-mon[32782]: pgmap v11129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:25:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:27 smithi193 ceph-mon[32782]: pgmap v11130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:25:27.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:25:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:25:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:27 smithi196 ceph-mon[32572]: pgmap v11129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:25:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:27 smithi196 ceph-mon[32572]: pgmap v11130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:25:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:25:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:25:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:27 smithi110 ceph-mon[28069]: pgmap v11129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:25:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:27 smithi110 ceph-mon[28069]: pgmap v11130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:25:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:28 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20242.208698 secs 2024-04-26T17:25:28.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:28 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20242.208698 secs 2024-04-26T17:25:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:28 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20242.208698 secs 2024-04-26T17:25:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:29 smithi193 ceph-mon[32782]: pgmap v11131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:29.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:29 smithi196 ceph-mon[32572]: pgmap v11131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:29 smithi110 ceph-mon[28069]: pgmap v11131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:31 smithi193 ceph-mon[32782]: pgmap v11132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:31 smithi196 ceph-mon[32572]: pgmap v11132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:31 smithi110 ceph-mon[28069]: pgmap v11132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20247.208819 secs 2024-04-26T17:25:33.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20247.208819 secs 2024-04-26T17:25:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20247.208819 secs 2024-04-26T17:25:34.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:33 smithi196 ceph-mon[32572]: pgmap v11133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:33 smithi110 ceph-mon[28069]: pgmap v11133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:33 smithi193 ceph-mon[32782]: pgmap v11133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:35.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:35 smithi193 ceph-mon[32782]: pgmap v11134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:36.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:35 smithi196 ceph-mon[32572]: pgmap v11134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:35 smithi110 ceph-mon[28069]: pgmap v11134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:25:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20252.208933 secs 2024-04-26T17:25:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:37 smithi196 ceph-mon[32572]: pgmap v11135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:25:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20252.208933 secs 2024-04-26T17:25:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:37 smithi110 ceph-mon[28069]: pgmap v11135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:25:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20252.208933 secs 2024-04-26T17:25:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:37 smithi193 ceph-mon[32782]: pgmap v11135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:25:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:39 smithi196 ceph-mon[32572]: pgmap v11136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:39 smithi110 ceph-mon[28069]: pgmap v11136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:39 smithi193 ceph-mon[32782]: pgmap v11136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:41 smithi196 ceph-mon[32572]: pgmap v11137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:41 smithi110 ceph-mon[28069]: pgmap v11137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:41 smithi193 ceph-mon[32782]: pgmap v11137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20257.209049 secs 2024-04-26T17:25:43.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20257.209049 secs 2024-04-26T17:25:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20257.209049 secs 2024-04-26T17:25:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:43 smithi196 ceph-mon[32572]: pgmap v11138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:43 smithi110 ceph-mon[28069]: pgmap v11138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:43 smithi193 ceph-mon[32782]: pgmap v11138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:45 smithi196 ceph-mon[32572]: pgmap v11139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:45 smithi110 ceph-mon[28069]: pgmap v11139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:45 smithi193 ceph-mon[32782]: pgmap v11139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20262.209166 secs 2024-04-26T17:25:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:47 smithi196 ceph-mon[32572]: pgmap v11140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20262.209166 secs 2024-04-26T17:25:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:47 smithi110 ceph-mon[28069]: pgmap v11140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20262.209166 secs 2024-04-26T17:25:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:47 smithi193 ceph-mon[32782]: pgmap v11140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:50.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:49 smithi196 ceph-mon[32572]: pgmap v11141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:49 smithi110 ceph-mon[28069]: pgmap v11141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:49 smithi193 ceph-mon[32782]: pgmap v11141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:51 smithi196 ceph-mon[32572]: pgmap v11142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:51 smithi110 ceph-mon[28069]: pgmap v11142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:51 smithi193 ceph-mon[32782]: pgmap v11142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20267.209281 secs 2024-04-26T17:25:53.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20267.209281 secs 2024-04-26T17:25:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20267.209281 secs 2024-04-26T17:25:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:53 smithi196 ceph-mon[32572]: pgmap v11143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:53 smithi110 ceph-mon[28069]: pgmap v11143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:53 smithi193 ceph-mon[32782]: pgmap v11143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:25:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:55 smithi196 ceph-mon[32572]: pgmap v11144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:55 smithi110 ceph-mon[28069]: pgmap v11144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:55 smithi193 ceph-mon[32782]: pgmap v11144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20272.209429 secs 2024-04-26T17:25:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:57 smithi196 ceph-mon[32572]: pgmap v11145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20272.209429 secs 2024-04-26T17:25:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:57 smithi110 ceph-mon[28069]: pgmap v11145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:25:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20272.209429 secs 2024-04-26T17:25:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:57 smithi193 ceph-mon[32782]: pgmap v11145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:00.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:25:59 smithi196 ceph-mon[32572]: pgmap v11146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:25:59 smithi110 ceph-mon[28069]: pgmap v11146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:25:59 smithi193 ceph-mon[32782]: pgmap v11146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:02.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:01 smithi196 ceph-mon[32572]: pgmap v11147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:01 smithi110 ceph-mon[28069]: pgmap v11147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:01 smithi193 ceph-mon[32782]: pgmap v11147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20277.209493 secs 2024-04-26T17:26:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20277.209493 secs 2024-04-26T17:26:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20277.209493 secs 2024-04-26T17:26:04.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:03 smithi196 ceph-mon[32572]: pgmap v11148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:03 smithi110 ceph-mon[28069]: pgmap v11148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:03 smithi193 ceph-mon[32782]: pgmap v11148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:06.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:05 smithi196 ceph-mon[32572]: pgmap v11149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:05 smithi110 ceph-mon[28069]: pgmap v11149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:05 smithi193 ceph-mon[32782]: pgmap v11149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:07 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 20282.209619 secs 2024-04-26T17:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:07 smithi196 ceph-mon[32572]: slow request 11522.022579 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:07 smithi196 ceph-mon[32572]: pgmap v11150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:07 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 20282.209619 secs 2024-04-26T17:26:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:07 smithi110 ceph-mon[28069]: slow request 11522.022579 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:26:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:07 smithi110 ceph-mon[28069]: pgmap v11150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:07 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 20282.209619 secs 2024-04-26T17:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:07 smithi193 ceph-mon[32782]: slow request 11522.022579 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:07 smithi193 ceph-mon[32782]: pgmap v11150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:09 smithi196 ceph-mon[32572]: pgmap v11151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:09 smithi110 ceph-mon[28069]: pgmap v11151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:09 smithi193 ceph-mon[32782]: pgmap v11151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:11 smithi196 ceph-mon[32572]: pgmap v11152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:11 smithi110 ceph-mon[28069]: pgmap v11152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:11 smithi193 ceph-mon[32782]: pgmap v11152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20287.209736 secs 2024-04-26T17:26:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20287.209736 secs 2024-04-26T17:26:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20287.209736 secs 2024-04-26T17:26:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:13 smithi196 ceph-mon[32572]: pgmap v11153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:14.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:13 smithi110 ceph-mon[28069]: pgmap v11153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:13 smithi193 ceph-mon[32782]: pgmap v11153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:16.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:15 smithi196 ceph-mon[32572]: pgmap v11154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:16.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:15 smithi110 ceph-mon[28069]: pgmap v11154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:15 smithi193 ceph-mon[32782]: pgmap v11154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20292.209814 secs 2024-04-26T17:26:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:17 smithi196 ceph-mon[32572]: pgmap v11155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20292.209814 secs 2024-04-26T17:26:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:17 smithi110 ceph-mon[28069]: pgmap v11155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20292.209814 secs 2024-04-26T17:26:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:17 smithi193 ceph-mon[32782]: pgmap v11155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:20.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:19 smithi196 ceph-mon[32572]: pgmap v11156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:19 smithi110 ceph-mon[28069]: pgmap v11156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:19 smithi193 ceph-mon[32782]: pgmap v11156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:21 smithi196 ceph-mon[32572]: pgmap v11157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:21 smithi110 ceph-mon[28069]: pgmap v11157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:21 smithi193 ceph-mon[32782]: pgmap v11157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20297.209875 secs 2024-04-26T17:26:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20297.209875 secs 2024-04-26T17:26:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20297.209875 secs 2024-04-26T17:26:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:23 smithi196 ceph-mon[32572]: pgmap v11158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:24.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:23 smithi110 ceph-mon[28069]: pgmap v11158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:23 smithi193 ceph-mon[32782]: pgmap v11158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:25 smithi196 ceph-mon[32572]: pgmap v11159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:25 smithi110 ceph-mon[28069]: pgmap v11159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:25 smithi193 ceph-mon[32782]: pgmap v11159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20302.210000 secs 2024-04-26T17:26:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:27 smithi196 ceph-mon[32572]: pgmap v11160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:26:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20302.210000 secs 2024-04-26T17:26:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:27 smithi110 ceph-mon[28069]: pgmap v11160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:26:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20302.210000 secs 2024-04-26T17:26:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:27 smithi193 ceph-mon[32782]: pgmap v11160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:26:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:26:29.351 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:26:29.352 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:26:29.353 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:26:29.353 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:26:29.353 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:26:29.353 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:26:29.353 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:26:29.353 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:26:30.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:29 smithi196 ceph-mon[32572]: pgmap v11161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:26:30.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:29 smithi196 ceph-mon[32572]: pgmap v11162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:29 smithi110 ceph-mon[28069]: pgmap v11161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:26:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:29 smithi110 ceph-mon[28069]: pgmap v11162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:29 smithi193 ceph-mon[32782]: pgmap v11161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:26:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:29 smithi193 ceph-mon[32782]: pgmap v11162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:31 smithi196 ceph-mon[32572]: pgmap v11163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:31 smithi110 ceph-mon[28069]: pgmap v11163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:31 smithi193 ceph-mon[32782]: pgmap v11163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:33.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20307.210120 secs 2024-04-26T17:26:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20307.210120 secs 2024-04-26T17:26:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20307.210120 secs 2024-04-26T17:26:34.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:33 smithi196 ceph-mon[32572]: pgmap v11164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:26:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:33 smithi110 ceph-mon[28069]: pgmap v11164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:26:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:33 smithi193 ceph-mon[32782]: pgmap v11164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:26:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:26:34.721+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:26:34.720 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:26:34.721+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:26:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:26:34.721+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 158 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:26:34.721 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:26:34.722+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 158 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:26:36.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:35 smithi196 ceph-mon[32572]: pgmap v11165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:35 smithi110 ceph-mon[28069]: pgmap v11165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:35 smithi193 ceph-mon[32782]: pgmap v11165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:37 smithi196 ceph-mon[32572]: pgmap v11166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20312.210240 secs 2024-04-26T17:26:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:37 smithi110 ceph-mon[28069]: pgmap v11166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20312.210240 secs 2024-04-26T17:26:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:37 smithi193 ceph-mon[32782]: pgmap v11166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:26:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20312.210240 secs 2024-04-26T17:26:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:39 smithi196 ceph-mon[32572]: pgmap v11167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:26:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:39 smithi110 ceph-mon[28069]: pgmap v11167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:26:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:39 smithi193 ceph-mon[32782]: pgmap v11167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:26:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:41 smithi196 ceph-mon[32572]: pgmap v11168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:41 smithi110 ceph-mon[28069]: pgmap v11168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:41 smithi193 ceph-mon[32782]: pgmap v11168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20317.210365 secs 2024-04-26T17:26:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20317.210365 secs 2024-04-26T17:26:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20317.210365 secs 2024-04-26T17:26:44.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:43 smithi196 ceph-mon[32572]: pgmap v11169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:44.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:43 smithi110 ceph-mon[28069]: pgmap v11169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:43 smithi193 ceph-mon[32782]: pgmap v11169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:45 smithi110 ceph-mon[28069]: pgmap v11170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:45 smithi193 ceph-mon[32782]: pgmap v11170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:46.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:45 smithi196 ceph-mon[32572]: pgmap v11170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:47 smithi110 ceph-mon[28069]: pgmap v11171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20322.210483 secs 2024-04-26T17:26:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:47 smithi193 ceph-mon[32782]: pgmap v11171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20322.210483 secs 2024-04-26T17:26:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:47 smithi196 ceph-mon[32572]: pgmap v11171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20322.210483 secs 2024-04-26T17:26:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:49 smithi110 ceph-mon[28069]: pgmap v11172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:49 smithi193 ceph-mon[32782]: pgmap v11172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:49 smithi196 ceph-mon[32572]: pgmap v11172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:51 smithi110 ceph-mon[28069]: pgmap v11173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:51 smithi193 ceph-mon[32782]: pgmap v11173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:51 smithi196 ceph-mon[32572]: pgmap v11173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20327.210602 secs 2024-04-26T17:26:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20327.210602 secs 2024-04-26T17:26:53.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20327.210602 secs 2024-04-26T17:26:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:53 smithi110 ceph-mon[28069]: pgmap v11174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:53 smithi193 ceph-mon[32782]: pgmap v11174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:54.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:53 smithi196 ceph-mon[32572]: pgmap v11174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:55 smithi193 ceph-mon[32782]: pgmap v11175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:56.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:55 smithi196 ceph-mon[32572]: pgmap v11175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:55 smithi110 ceph-mon[28069]: pgmap v11175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:26:58.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:57 smithi110 ceph-mon[28069]: pgmap v11176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:58.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20332.210709 secs 2024-04-26T17:26:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:57 smithi193 ceph-mon[32782]: pgmap v11176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20332.210709 secs 2024-04-26T17:26:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:57 smithi196 ceph-mon[32572]: pgmap v11176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:26:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20332.210709 secs 2024-04-26T17:27:00.125 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:26:59 smithi193 ceph-mon[32782]: pgmap v11177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:00.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:26:59 smithi196 ceph-mon[32572]: pgmap v11177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:26:59 smithi110 ceph-mon[28069]: pgmap v11177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:02.055 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:01 smithi196 ceph-mon[32572]: pgmap v11178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:01 smithi193 ceph-mon[32782]: pgmap v11178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:01 smithi110 ceph-mon[28069]: pgmap v11178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20337.210783 secs 2024-04-26T17:27:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20337.210783 secs 2024-04-26T17:27:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20337.210783 secs 2024-04-26T17:27:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:03 smithi193 ceph-mon[32782]: pgmap v11179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:04.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:03 smithi196 ceph-mon[32572]: pgmap v11179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:04.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:03 smithi110 ceph-mon[28069]: pgmap v11179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:04 smithi193 ceph-mon[32782]: pgmap v11180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:05.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:04 smithi196 ceph-mon[32572]: pgmap v11180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:04 smithi110 ceph-mon[28069]: pgmap v11180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:07.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:07 smithi196 ceph-mon[32572]: pgmap v11181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:07 smithi110 ceph-mon[28069]: pgmap v11181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:07 smithi193 ceph-mon[32782]: pgmap v11181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:08 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20342.210893 secs 2024-04-26T17:27:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:08 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20342.210893 secs 2024-04-26T17:27:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:08 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20342.210893 secs 2024-04-26T17:27:09.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:09 smithi196 ceph-mon[32572]: pgmap v11182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:09 smithi110 ceph-mon[28069]: pgmap v11182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:09.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:09 smithi193 ceph-mon[32782]: pgmap v11182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:11.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:11 smithi196 ceph-mon[32572]: pgmap v11183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:11.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:11 smithi110 ceph-mon[28069]: pgmap v11183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:11.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:11 smithi193 ceph-mon[32782]: pgmap v11183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:13.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:13 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20347.211030 secs 2024-04-26T17:27:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:13 smithi196 ceph-mon[32572]: pgmap v11184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:13 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20347.211030 secs 2024-04-26T17:27:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:13 smithi110 ceph-mon[28069]: pgmap v11184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:13 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20347.211030 secs 2024-04-26T17:27:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:13 smithi193 ceph-mon[32782]: pgmap v11184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:15 smithi196 ceph-mon[32572]: pgmap v11185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:15 smithi110 ceph-mon[28069]: pgmap v11185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:15 smithi193 ceph-mon[32782]: pgmap v11185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:17.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:17 smithi196 ceph-mon[32572]: pgmap v11186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:17 smithi110 ceph-mon[28069]: pgmap v11186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:17 smithi193 ceph-mon[32782]: pgmap v11186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:18.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:18 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20352.211140 secs 2024-04-26T17:27:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:18 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20352.211140 secs 2024-04-26T17:27:18.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:18 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20352.211140 secs 2024-04-26T17:27:19.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:19 smithi196 ceph-mon[32572]: pgmap v11187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:19 smithi110 ceph-mon[28069]: pgmap v11187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:19 smithi193 ceph-mon[32782]: pgmap v11187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:19.728 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:27:19.728+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:27:19.728 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:27:19.728+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:27:19.728 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:27:19.729+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 159 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:27:19.729 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:27:19.730+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 159 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:27:21.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:21 smithi196 ceph-mon[32572]: pgmap v11188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:21 smithi110 ceph-mon[28069]: pgmap v11188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:21.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:21 smithi193 ceph-mon[32782]: pgmap v11188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:23.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:23 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20357.211257 secs 2024-04-26T17:27:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:23 smithi196 ceph-mon[32572]: pgmap v11189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:23 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20357.211257 secs 2024-04-26T17:27:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:23 smithi110 ceph-mon[28069]: pgmap v11189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:23 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20357.211257 secs 2024-04-26T17:27:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:23 smithi193 ceph-mon[32782]: pgmap v11189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:25 smithi196 ceph-mon[32572]: pgmap v11190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:25 smithi110 ceph-mon[28069]: pgmap v11190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:25 smithi193 ceph-mon[32782]: pgmap v11190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:27.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:27 smithi196 ceph-mon[32572]: pgmap v11191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:27 smithi110 ceph-mon[28069]: pgmap v11191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:27 smithi193 ceph-mon[32782]: pgmap v11191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:28.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:28 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20362.211374 secs 2024-04-26T17:27:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:28 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20362.211374 secs 2024-04-26T17:27:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:28 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20362.211374 secs 2024-04-26T17:27:29.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:29 smithi196 ceph-mon[32572]: pgmap v11192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:27:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:29 smithi110 ceph-mon[28069]: pgmap v11192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:27:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:29 smithi193 ceph-mon[32782]: pgmap v11192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:27:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:31 smithi196 ceph-mon[32572]: pgmap v11193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:31 smithi110 ceph-mon[28069]: pgmap v11193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:31 smithi193 ceph-mon[32782]: pgmap v11193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20367.211467 secs 2024-04-26T17:27:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20367.211467 secs 2024-04-26T17:27:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20367.211467 secs 2024-04-26T17:27:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:33 smithi193 ceph-mon[32782]: pgmap v11194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:27:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:27:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:33 smithi196 ceph-mon[32572]: pgmap v11194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:27:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:27:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:33 smithi110 ceph-mon[28069]: pgmap v11194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:27:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:27:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:27:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:34 smithi193 ceph-mon[32782]: pgmap v11195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:27:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:34 smithi193 ceph-mon[32782]: pgmap v11196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:35.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:34 smithi196 ceph-mon[32572]: pgmap v11195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:27:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:34 smithi196 ceph-mon[32572]: pgmap v11196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:34 smithi110 ceph-mon[28069]: pgmap v11195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:27:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:34 smithi110 ceph-mon[28069]: pgmap v11196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:37.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:36 smithi196 ceph-mon[32572]: pgmap v11197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:37.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:36 smithi110 ceph-mon[28069]: pgmap v11197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:36 smithi193 ceph-mon[32782]: pgmap v11197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20372.211619 secs 2024-04-26T17:27:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20372.211619 secs 2024-04-26T17:27:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20372.211619 secs 2024-04-26T17:27:39.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:38 smithi196 ceph-mon[32572]: pgmap v11198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 582 B/s rd, 1 op/s 2024-04-26T17:27:39.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:38 smithi110 ceph-mon[28069]: pgmap v11198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 582 B/s rd, 1 op/s 2024-04-26T17:27:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:38 smithi193 ceph-mon[32782]: pgmap v11198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 582 B/s rd, 1 op/s 2024-04-26T17:27:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:40 smithi196 ceph-mon[32572]: pgmap v11199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:41.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:40 smithi110 ceph-mon[28069]: pgmap v11199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:40 smithi193 ceph-mon[32782]: pgmap v11199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:42 smithi196 ceph-mon[32572]: pgmap v11200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20377.211712 secs 2024-04-26T17:27:43.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:42 smithi110 ceph-mon[28069]: pgmap v11200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20377.211712 secs 2024-04-26T17:27:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:42 smithi193 ceph-mon[32782]: pgmap v11200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:27:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20377.211712 secs 2024-04-26T17:27:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:44 smithi196 ceph-mon[32572]: pgmap v11201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:27:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:44 smithi110 ceph-mon[28069]: pgmap v11201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:27:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:44 smithi193 ceph-mon[32782]: pgmap v11201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:27:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:46 smithi196 ceph-mon[32572]: pgmap v11202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:46 smithi110 ceph-mon[28069]: pgmap v11202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:46 smithi193 ceph-mon[32782]: pgmap v11202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20382.211813 secs 2024-04-26T17:27:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20382.211813 secs 2024-04-26T17:27:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20382.211813 secs 2024-04-26T17:27:49.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:48 smithi196 ceph-mon[32572]: pgmap v11203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:48 smithi110 ceph-mon[28069]: pgmap v11203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:48 smithi193 ceph-mon[32782]: pgmap v11203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:51.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:50 smithi196 ceph-mon[32572]: pgmap v11204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:50 smithi110 ceph-mon[28069]: pgmap v11204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:50 smithi193 ceph-mon[32782]: pgmap v11204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:52 smithi196 ceph-mon[32572]: pgmap v11205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20387.211929 secs 2024-04-26T17:27:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:52 smithi110 ceph-mon[28069]: pgmap v11205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20387.211929 secs 2024-04-26T17:27:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:52 smithi193 ceph-mon[32782]: pgmap v11205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20387.211929 secs 2024-04-26T17:27:55.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:54 smithi196 ceph-mon[32572]: pgmap v11206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:55.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:54 smithi110 ceph-mon[28069]: pgmap v11206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:54 smithi193 ceph-mon[32782]: pgmap v11206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:27:57.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:56 smithi196 ceph-mon[32572]: pgmap v11207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:56 smithi110 ceph-mon[28069]: pgmap v11207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:56 smithi193 ceph-mon[32782]: pgmap v11207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20392.212047 secs 2024-04-26T17:27:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20392.212047 secs 2024-04-26T17:27:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20392.212047 secs 2024-04-26T17:27:59.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:27:58 smithi196 ceph-mon[32572]: pgmap v11208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:27:58 smithi110 ceph-mon[28069]: pgmap v11208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:27:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:27:58 smithi193 ceph-mon[32782]: pgmap v11208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:00 smithi196 ceph-mon[32572]: pgmap v11209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:00 smithi110 ceph-mon[28069]: pgmap v11209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:00 smithi193 ceph-mon[32782]: pgmap v11209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:02 smithi196 ceph-mon[32572]: pgmap v11210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20397.212157 secs 2024-04-26T17:28:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:02 smithi110 ceph-mon[28069]: pgmap v11210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20397.212157 secs 2024-04-26T17:28:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:02 smithi193 ceph-mon[32782]: pgmap v11210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20397.212157 secs 2024-04-26T17:28:05.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:04 smithi196 ceph-mon[32572]: pgmap v11211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:04 smithi110 ceph-mon[28069]: pgmap v11211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:04 smithi193 ceph-mon[32782]: pgmap v11211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:06 smithi196 ceph-mon[32572]: pgmap v11212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:06 smithi110 ceph-mon[28069]: pgmap v11212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:06 smithi193 ceph-mon[32782]: pgmap v11212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:08.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20402.212292 secs 2024-04-26T17:28:08.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20402.212292 secs 2024-04-26T17:28:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20402.212292 secs 2024-04-26T17:28:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:08 smithi196 ceph-mon[32572]: pgmap v11213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:08 smithi110 ceph-mon[28069]: pgmap v11213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:08 smithi193 ceph-mon[32782]: pgmap v11213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:11.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:10 smithi196 ceph-mon[32572]: pgmap v11214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:10 smithi110 ceph-mon[28069]: pgmap v11214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:10 smithi193 ceph-mon[32782]: pgmap v11214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:12 smithi196 ceph-mon[32572]: pgmap v11215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20407.212427 secs 2024-04-26T17:28:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:12 smithi110 ceph-mon[28069]: pgmap v11215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20407.212427 secs 2024-04-26T17:28:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:12 smithi193 ceph-mon[32782]: pgmap v11215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20407.212427 secs 2024-04-26T17:28:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:14 smithi196 ceph-mon[32572]: pgmap v11216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:14 smithi110 ceph-mon[28069]: pgmap v11216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:14 smithi193 ceph-mon[32782]: pgmap v11216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:16 smithi110 ceph-mon[28069]: pgmap v11217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:16 smithi193 ceph-mon[32782]: pgmap v11217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:16 smithi196 ceph-mon[32572]: pgmap v11217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20412.212597 secs 2024-04-26T17:28:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20412.212597 secs 2024-04-26T17:28:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20412.212597 secs 2024-04-26T17:28:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:18 smithi110 ceph-mon[28069]: pgmap v11218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:18 smithi193 ceph-mon[32782]: pgmap v11218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:19.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:18 smithi196 ceph-mon[32572]: pgmap v11218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:20 smithi110 ceph-mon[28069]: pgmap v11219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:20 smithi193 ceph-mon[32782]: pgmap v11219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:21.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:20 smithi196 ceph-mon[32572]: pgmap v11219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:22 smithi110 ceph-mon[28069]: pgmap v11220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20417.212713 secs 2024-04-26T17:28:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:22 smithi193 ceph-mon[32782]: pgmap v11220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20417.212713 secs 2024-04-26T17:28:23.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:22 smithi196 ceph-mon[32572]: pgmap v11220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20417.212713 secs 2024-04-26T17:28:25.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:24 smithi110 ceph-mon[28069]: pgmap v11221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:24 smithi193 ceph-mon[32782]: pgmap v11221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:25.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:24 smithi196 ceph-mon[32572]: pgmap v11221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:26 smithi193 ceph-mon[32782]: pgmap v11222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:26 smithi196 ceph-mon[32572]: pgmap v11222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:26 smithi110 ceph-mon[28069]: pgmap v11222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20422.212834 secs 2024-04-26T17:28:28.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20422.212834 secs 2024-04-26T17:28:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20422.212834 secs 2024-04-26T17:28:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:28 smithi193 ceph-mon[32782]: pgmap v11223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:29.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:28 smithi196 ceph-mon[32572]: pgmap v11223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:28 smithi110 ceph-mon[28069]: pgmap v11223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:30 smithi193 ceph-mon[32782]: pgmap v11224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:31.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:30 smithi196 ceph-mon[32572]: pgmap v11224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:30 smithi110 ceph-mon[28069]: pgmap v11224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:32 smithi193 ceph-mon[32782]: pgmap v11225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20427.212951 secs 2024-04-26T17:28:33.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:32 smithi196 ceph-mon[32572]: pgmap v11225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:33.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20427.212951 secs 2024-04-26T17:28:33.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:32 smithi110 ceph-mon[28069]: pgmap v11225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:33.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20427.212951 secs 2024-04-26T17:28:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:28:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:28:34.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:28:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:34 smithi193 ceph-mon[32782]: pgmap v11226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:28:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:28:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:28:35.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:34 smithi196 ceph-mon[32572]: pgmap v11226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:28:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:28:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:28:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:34 smithi110 ceph-mon[28069]: pgmap v11226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:28:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:28:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:28:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:35 smithi193 ceph-mon[32782]: pgmap v11227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T17:28:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:35 smithi193 ceph-mon[32782]: pgmap v11228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:35 smithi196 ceph-mon[32572]: pgmap v11227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T17:28:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:35 smithi196 ceph-mon[32572]: pgmap v11228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:35 smithi110 ceph-mon[28069]: pgmap v11227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T17:28:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:35 smithi110 ceph-mon[28069]: pgmap v11228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:36 smithi193 ceph-mon[32782]: pgmap v11229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:37.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:36 smithi196 ceph-mon[32572]: pgmap v11229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:36 smithi110 ceph-mon[28069]: pgmap v11229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20432.213091 secs 2024-04-26T17:28:38.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20432.213091 secs 2024-04-26T17:28:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20432.213091 secs 2024-04-26T17:28:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:38 smithi193 ceph-mon[32782]: pgmap v11230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:39.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:38 smithi196 ceph-mon[32572]: pgmap v11230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:38 smithi110 ceph-mon[28069]: pgmap v11230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:41 smithi193 ceph-mon[32782]: pgmap v11231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:42.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:41 smithi196 ceph-mon[32572]: pgmap v11231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:41 smithi110 ceph-mon[28069]: pgmap v11231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20437.213207 secs 2024-04-26T17:28:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20437.213207 secs 2024-04-26T17:28:43.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20437.213207 secs 2024-04-26T17:28:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:43 smithi193 ceph-mon[32782]: pgmap v11232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:44.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:43 smithi196 ceph-mon[32572]: pgmap v11232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:44.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:43 smithi110 ceph-mon[28069]: pgmap v11232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:28:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:45 smithi193 ceph-mon[32782]: pgmap v11233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:28:46.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:45 smithi196 ceph-mon[32572]: pgmap v11233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:28:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:45 smithi110 ceph-mon[28069]: pgmap v11233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:28:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:47 smithi193 ceph-mon[32782]: pgmap v11234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20442.213361 secs 2024-04-26T17:28:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:47 smithi196 ceph-mon[32572]: pgmap v11234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20442.213361 secs 2024-04-26T17:28:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:47 smithi110 ceph-mon[28069]: pgmap v11234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20442.213361 secs 2024-04-26T17:28:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:49 smithi193 ceph-mon[32782]: pgmap v11235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:50.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:49 smithi196 ceph-mon[32572]: pgmap v11235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:50.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:49 smithi110 ceph-mon[28069]: pgmap v11235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:51 smithi193 ceph-mon[32782]: pgmap v11236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:52.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:51 smithi196 ceph-mon[32572]: pgmap v11236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:52.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:51 smithi110 ceph-mon[28069]: pgmap v11236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20447.213506 secs 2024-04-26T17:28:53.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20447.213506 secs 2024-04-26T17:28:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20447.213506 secs 2024-04-26T17:28:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:53 smithi193 ceph-mon[32782]: pgmap v11237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:54.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:53 smithi196 ceph-mon[32572]: pgmap v11237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:53 smithi110 ceph-mon[28069]: pgmap v11237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:28:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:55 smithi193 ceph-mon[32782]: pgmap v11238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:56.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:55 smithi196 ceph-mon[32572]: pgmap v11238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:55 smithi110 ceph-mon[28069]: pgmap v11238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20452.213636 secs 2024-04-26T17:28:58.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:57 smithi196 ceph-mon[32572]: pgmap v11239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20452.213636 secs 2024-04-26T17:28:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:57 smithi110 ceph-mon[28069]: pgmap v11239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:28:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20452.213636 secs 2024-04-26T17:28:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:57 smithi193 ceph-mon[32782]: pgmap v11239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:00.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:28:59 smithi196 ceph-mon[32572]: pgmap v11240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:28:59 smithi110 ceph-mon[28069]: pgmap v11240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:28:59 smithi193 ceph-mon[32782]: pgmap v11240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:02.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:01 smithi196 ceph-mon[32572]: pgmap v11241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:02.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:01 smithi110 ceph-mon[28069]: pgmap v11241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:01 smithi193 ceph-mon[32782]: pgmap v11241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20457.213722 secs 2024-04-26T17:29:03.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20457.213722 secs 2024-04-26T17:29:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20457.213722 secs 2024-04-26T17:29:03.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:03 smithi196 ceph-mon[32572]: pgmap v11242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:03 smithi110 ceph-mon[28069]: pgmap v11242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:03 smithi193 ceph-mon[32782]: pgmap v11242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:06.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:05 smithi196 ceph-mon[32572]: pgmap v11243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:06.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:05 smithi110 ceph-mon[28069]: pgmap v11243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:06.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:05 smithi193 ceph-mon[32782]: pgmap v11243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:07.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20462.213844 secs 2024-04-26T17:29:07.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:07 smithi193 ceph-mon[32782]: pgmap v11244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:08.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20462.213844 secs 2024-04-26T17:29:08.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:07 smithi196 ceph-mon[32572]: pgmap v11244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20462.213844 secs 2024-04-26T17:29:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:07 smithi110 ceph-mon[28069]: pgmap v11244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:10.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:09 smithi196 ceph-mon[32572]: pgmap v11245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:10.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:09 smithi110 ceph-mon[28069]: pgmap v11245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:09 smithi193 ceph-mon[32782]: pgmap v11245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:10.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:29:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:29:10.172+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:29:10.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:29:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:29:10.172+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:29:10.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:29:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:29:10.172+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:29:10.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:29:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:29:10.172+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:29:10.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:29:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:29:10.172+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:29:12.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:11 smithi196 ceph-mon[32572]: pgmap v11246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:11 smithi110 ceph-mon[28069]: pgmap v11246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:11 smithi193 ceph-mon[32782]: pgmap v11246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20467.213957 secs 2024-04-26T17:29:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20467.213957 secs 2024-04-26T17:29:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20467.213957 secs 2024-04-26T17:29:14.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:13 smithi196 ceph-mon[32572]: pgmap v11247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:29:14.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:13 smithi110 ceph-mon[28069]: pgmap v11247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:29:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:13 smithi193 ceph-mon[32782]: pgmap v11247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:29:16.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:15 smithi196 ceph-mon[32572]: pgmap v11248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:29:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:15 smithi110 ceph-mon[28069]: pgmap v11248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:29:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:15 smithi193 ceph-mon[32782]: pgmap v11248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:29:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20472.214074 secs 2024-04-26T17:29:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:17 smithi196 ceph-mon[32572]: pgmap v11249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:29:18.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20472.214074 secs 2024-04-26T17:29:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:17 smithi110 ceph-mon[28069]: pgmap v11249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:29:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20472.214074 secs 2024-04-26T17:29:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:17 smithi193 ceph-mon[32782]: pgmap v11249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:29:20.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:19 smithi196 ceph-mon[32572]: pgmap v11250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:29:20.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:19 smithi110 ceph-mon[28069]: pgmap v11250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:29:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:19 smithi193 ceph-mon[32782]: pgmap v11250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:29:22.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:21 smithi196 ceph-mon[32572]: pgmap v11251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:29:22.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:21 smithi110 ceph-mon[28069]: pgmap v11251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:29:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:21 smithi193 ceph-mon[32782]: pgmap v11251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:29:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20477.214192 secs 2024-04-26T17:29:23.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20477.214192 secs 2024-04-26T17:29:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20477.214192 secs 2024-04-26T17:29:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:23 smithi196 ceph-mon[32572]: pgmap v11252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:29:24.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:23 smithi110 ceph-mon[28069]: pgmap v11252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:29:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:23 smithi193 ceph-mon[32782]: pgmap v11252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:29:26.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:25 smithi196 ceph-mon[32572]: pgmap v11253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:25 smithi110 ceph-mon[28069]: pgmap v11253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:25 smithi193 ceph-mon[32782]: pgmap v11253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20482.214327 secs 2024-04-26T17:29:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:27 smithi196 ceph-mon[32572]: pgmap v11254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:28.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20482.214327 secs 2024-04-26T17:29:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:27 smithi110 ceph-mon[28069]: pgmap v11254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20482.214327 secs 2024-04-26T17:29:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:27 smithi193 ceph-mon[32782]: pgmap v11254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:30.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:29 smithi196 ceph-mon[32572]: pgmap v11255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:29 smithi110 ceph-mon[28069]: pgmap v11255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:29 smithi193 ceph-mon[32782]: pgmap v11255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:32.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:31 smithi196 ceph-mon[32572]: pgmap v11256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:32.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:31 smithi110 ceph-mon[28069]: pgmap v11256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:31 smithi193 ceph-mon[32782]: pgmap v11256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20487.214482 secs 2024-04-26T17:29:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20487.214482 secs 2024-04-26T17:29:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20487.214482 secs 2024-04-26T17:29:34.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:33 smithi196 ceph-mon[32572]: pgmap v11257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:34.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:33 smithi110 ceph-mon[28069]: pgmap v11257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:33 smithi193 ceph-mon[32782]: pgmap v11257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:36.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:35 smithi196 ceph-mon[32572]: pgmap v11258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:29:36.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:35 smithi110 ceph-mon[28069]: pgmap v11258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:36.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:29:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:35 smithi193 ceph-mon[32782]: pgmap v11258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:29:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20492.214616 secs 2024-04-26T17:29:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:37 smithi110 ceph-mon[28069]: pgmap v11259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20492.214616 secs 2024-04-26T17:29:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:37 smithi193 ceph-mon[32782]: pgmap v11259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20492.214616 secs 2024-04-26T17:29:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:37 smithi196 ceph-mon[32572]: pgmap v11259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:39 smithi110 ceph-mon[28069]: pgmap v11260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:39 smithi193 ceph-mon[32782]: pgmap v11260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:39 smithi196 ceph-mon[32572]: pgmap v11260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:41 smithi110 ceph-mon[28069]: pgmap v11261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:29:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:29:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:29:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:29:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:29:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:41 smithi193 ceph-mon[32782]: pgmap v11261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:29:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:29:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:29:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:29:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:29:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:41 smithi196 ceph-mon[32572]: pgmap v11261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:29:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:29:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:29:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:29:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:29:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20497.214683 secs 2024-04-26T17:29:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:42 smithi110 ceph-mon[28069]: pgmap v11262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 923 B/s rd, 1 op/s 2024-04-26T17:29:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:42 smithi110 ceph-mon[28069]: pgmap v11263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 563 B/s rd, 1 op/s 2024-04-26T17:29:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20497.214683 secs 2024-04-26T17:29:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:42 smithi193 ceph-mon[32782]: pgmap v11262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 923 B/s rd, 1 op/s 2024-04-26T17:29:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:42 smithi193 ceph-mon[32782]: pgmap v11263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 563 B/s rd, 1 op/s 2024-04-26T17:29:43.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20497.214683 secs 2024-04-26T17:29:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:42 smithi196 ceph-mon[32572]: pgmap v11262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 923 B/s rd, 1 op/s 2024-04-26T17:29:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:42 smithi196 ceph-mon[32572]: pgmap v11263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 563 B/s rd, 1 op/s 2024-04-26T17:29:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:44 smithi110 ceph-mon[28069]: pgmap v11264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:44 smithi193 ceph-mon[32782]: pgmap v11264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:45.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:44 smithi196 ceph-mon[32572]: pgmap v11264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:46 smithi110 ceph-mon[28069]: pgmap v11265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:46 smithi193 ceph-mon[32782]: pgmap v11265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:47.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:46 smithi196 ceph-mon[32572]: pgmap v11265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20502.214815 secs 2024-04-26T17:29:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20502.214815 secs 2024-04-26T17:29:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20502.214815 secs 2024-04-26T17:29:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:48 smithi110 ceph-mon[28069]: pgmap v11266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:48 smithi193 ceph-mon[32782]: pgmap v11266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:48 smithi196 ceph-mon[32572]: pgmap v11266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:50 smithi110 ceph-mon[28069]: pgmap v11267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:50 smithi193 ceph-mon[32782]: pgmap v11267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:51.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:50 smithi196 ceph-mon[32572]: pgmap v11267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:29:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20507.214917 secs 2024-04-26T17:29:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:52 smithi193 ceph-mon[32782]: pgmap v11268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:29:53.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20507.214917 secs 2024-04-26T17:29:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:52 smithi196 ceph-mon[32572]: pgmap v11268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:29:53.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20507.214917 secs 2024-04-26T17:29:53.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:52 smithi110 ceph-mon[28069]: pgmap v11268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:29:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:54 smithi193 ceph-mon[32782]: pgmap v11269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:54 smithi196 ceph-mon[32572]: pgmap v11269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:55.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:54 smithi110 ceph-mon[28069]: pgmap v11269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:56 smithi193 ceph-mon[32782]: pgmap v11270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:57.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:56 smithi196 ceph-mon[32572]: pgmap v11270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:57.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:56 smithi110 ceph-mon[28069]: pgmap v11270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:29:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20512.214992 secs 2024-04-26T17:29:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20512.214992 secs 2024-04-26T17:29:58.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20512.214992 secs 2024-04-26T17:29:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:29:58 smithi193 ceph-mon[32782]: pgmap v11271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:59.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:29:58 smithi110 ceph-mon[28069]: pgmap v11271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:29:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:29:58 smithi196 ceph-mon[32572]: pgmap v11271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:00 smithi193 ceph-mon[32782]: pgmap v11272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:30:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:00 smithi196 ceph-mon[32572]: pgmap v11272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:30:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:00 smithi110 ceph-mon[28069]: pgmap v11272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:30:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20517.215109 secs 2024-04-26T17:30:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:02 smithi193 ceph-mon[32782]: pgmap v11273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20517.215109 secs 2024-04-26T17:30:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:02 smithi196 ceph-mon[32572]: pgmap v11273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:03.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20517.215109 secs 2024-04-26T17:30:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:02 smithi110 ceph-mon[28069]: pgmap v11273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:04 smithi193 ceph-mon[32782]: pgmap v11274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:05.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:04 smithi196 ceph-mon[32572]: pgmap v11274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:05.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:04 smithi110 ceph-mon[28069]: pgmap v11274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:06 smithi193 ceph-mon[32782]: pgmap v11275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:07.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:06 smithi196 ceph-mon[32572]: pgmap v11275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:07.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:06 smithi110 ceph-mon[28069]: pgmap v11275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20522.215225 secs 2024-04-26T17:30:08.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20522.215225 secs 2024-04-26T17:30:08.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20522.215225 secs 2024-04-26T17:30:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:08 smithi193 ceph-mon[32782]: pgmap v11276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:08 smithi196 ceph-mon[32572]: pgmap v11276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:08 smithi110 ceph-mon[28069]: pgmap v11276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:09 smithi193 ceph-mon[32782]: pgmap v11277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:10.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:09 smithi196 ceph-mon[32572]: pgmap v11277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:10.257 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:09 smithi110 ceph-mon[28069]: pgmap v11277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 20527.215378 secs 2024-04-26T17:30:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:12 smithi196 ceph-mon[32572]: slow request 5764.007863 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:30:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:12 smithi196 ceph-mon[32572]: pgmap v11278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 20527.215378 secs 2024-04-26T17:30:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:12 smithi110 ceph-mon[28069]: slow request 5764.007863 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:30:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:12 smithi110 ceph-mon[28069]: pgmap v11278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 20527.215378 secs 2024-04-26T17:30:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:12 smithi193 ceph-mon[32782]: slow request 5764.007863 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:30:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:12 smithi193 ceph-mon[32782]: pgmap v11278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:14 smithi196 ceph-mon[32572]: pgmap v11279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:15.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:14 smithi110 ceph-mon[28069]: pgmap v11279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:14 smithi193 ceph-mon[32782]: pgmap v11279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:16 smithi196 ceph-mon[32572]: pgmap v11280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:16 smithi110 ceph-mon[28069]: pgmap v11280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:16 smithi193 ceph-mon[32782]: pgmap v11280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20532.215496 secs 2024-04-26T17:30:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20532.215496 secs 2024-04-26T17:30:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20532.215496 secs 2024-04-26T17:30:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:18 smithi196 ceph-mon[32572]: pgmap v11281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:19.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:18 smithi110 ceph-mon[28069]: pgmap v11281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:18 smithi193 ceph-mon[32782]: pgmap v11281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:30:19.759+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:30:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:30:19.759+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:30:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:30:19.760+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 160 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:30:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:30:19.760+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 160 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:30:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:20 smithi196 ceph-mon[32572]: pgmap v11282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:21.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:20 smithi110 ceph-mon[28069]: pgmap v11282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:20 smithi193 ceph-mon[32782]: pgmap v11282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20537.215636 secs 2024-04-26T17:30:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:22 smithi196 ceph-mon[32572]: pgmap v11283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:23.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20537.215636 secs 2024-04-26T17:30:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:22 smithi110 ceph-mon[28069]: pgmap v11283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20537.215636 secs 2024-04-26T17:30:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:22 smithi193 ceph-mon[32782]: pgmap v11283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:24 smithi196 ceph-mon[32572]: pgmap v11284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:25.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:24 smithi110 ceph-mon[28069]: pgmap v11284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:24 smithi193 ceph-mon[32782]: pgmap v11284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:26 smithi196 ceph-mon[32572]: pgmap v11285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:27.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:26 smithi110 ceph-mon[28069]: pgmap v11285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:26 smithi193 ceph-mon[32782]: pgmap v11285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20542.215698 secs 2024-04-26T17:30:28.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20542.215698 secs 2024-04-26T17:30:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20542.215698 secs 2024-04-26T17:30:29.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:28 smithi196 ceph-mon[32572]: pgmap v11286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:29.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:28 smithi110 ceph-mon[28069]: pgmap v11286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:28 smithi193 ceph-mon[32782]: pgmap v11286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:30 smithi110 ceph-mon[28069]: pgmap v11287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:30 smithi193 ceph-mon[32782]: pgmap v11287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:31.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:30 smithi196 ceph-mon[32572]: pgmap v11287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20547.215818 secs 2024-04-26T17:30:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:32 smithi110 ceph-mon[28069]: pgmap v11288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:33.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20547.215818 secs 2024-04-26T17:30:33.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:32 smithi196 ceph-mon[32572]: pgmap v11288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20547.215818 secs 2024-04-26T17:30:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:32 smithi193 ceph-mon[32782]: pgmap v11288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:34 smithi110 ceph-mon[28069]: pgmap v11289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:34 smithi193 ceph-mon[32782]: pgmap v11289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:35.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:34 smithi196 ceph-mon[32572]: pgmap v11289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:36 smithi110 ceph-mon[28069]: pgmap v11290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:36 smithi193 ceph-mon[32782]: pgmap v11290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:37.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:36 smithi196 ceph-mon[32572]: pgmap v11290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20552.215938 secs 2024-04-26T17:30:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20552.215938 secs 2024-04-26T17:30:38.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20552.215938 secs 2024-04-26T17:30:39.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:38 smithi110 ceph-mon[28069]: pgmap v11291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:38 smithi193 ceph-mon[32782]: pgmap v11291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:39.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:38 smithi196 ceph-mon[32572]: pgmap v11291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:30:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:40 smithi193 ceph-mon[32782]: pgmap v11292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:40 smithi196 ceph-mon[32572]: pgmap v11292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:40 smithi110 ceph-mon[28069]: pgmap v11292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20557.216056 secs 2024-04-26T17:30:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:42 smithi193 ceph-mon[32782]: pgmap v11293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:30:43.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20557.216056 secs 2024-04-26T17:30:43.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:42 smithi196 ceph-mon[32572]: pgmap v11293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:43.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:30:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20557.216056 secs 2024-04-26T17:30:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:42 smithi110 ceph-mon[28069]: pgmap v11293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:30:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:30:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:30:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:30:44.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:30:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:30:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:30:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:30:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:30:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:30:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:44 smithi193 ceph-mon[32782]: pgmap v11294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:30:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:44 smithi193 ceph-mon[32782]: pgmap v11295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:45.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:44 smithi196 ceph-mon[32572]: pgmap v11294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:30:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:44 smithi196 ceph-mon[32572]: pgmap v11295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:44 smithi110 ceph-mon[28069]: pgmap v11294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:30:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:44 smithi110 ceph-mon[28069]: pgmap v11295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:46 smithi193 ceph-mon[32782]: pgmap v11296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:47.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:46 smithi196 ceph-mon[32572]: pgmap v11296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:47.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:46 smithi110 ceph-mon[28069]: pgmap v11296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20562.216181 secs 2024-04-26T17:30:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20562.216181 secs 2024-04-26T17:30:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20562.216181 secs 2024-04-26T17:30:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:48 smithi193 ceph-mon[32782]: pgmap v11297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T17:30:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:48 smithi196 ceph-mon[32572]: pgmap v11297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T17:30:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:48 smithi110 ceph-mon[28069]: pgmap v11297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T17:30:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:50 smithi193 ceph-mon[32782]: pgmap v11298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:51.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:50 smithi196 ceph-mon[32572]: pgmap v11298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:50 smithi110 ceph-mon[28069]: pgmap v11298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:52.852 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:52 smithi196 ceph-mon[32572]: pgmap v11299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:52 smithi193 ceph-mon[32782]: pgmap v11299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20567.216292 secs 2024-04-26T17:30:53.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20567.216292 secs 2024-04-26T17:30:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:52 smithi110 ceph-mon[28069]: pgmap v11299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:30:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20567.216292 secs 2024-04-26T17:30:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:54 smithi193 ceph-mon[32782]: pgmap v11300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:30:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:54 smithi196 ceph-mon[32572]: pgmap v11300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:30:55.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:54 smithi110 ceph-mon[28069]: pgmap v11300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:30:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:56 smithi193 ceph-mon[32782]: pgmap v11301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:57.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:56 smithi196 ceph-mon[32572]: pgmap v11301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:56 smithi110 ceph-mon[28069]: pgmap v11301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20572.216430 secs 2024-04-26T17:30:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20572.216430 secs 2024-04-26T17:30:58.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20572.216430 secs 2024-04-26T17:30:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:58 smithi196 ceph-mon[32572]: pgmap v11302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:58 smithi110 ceph-mon[28069]: pgmap v11302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:30:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:58 smithi193 ceph-mon[32782]: pgmap v11302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:00.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:30:59 smithi110 ceph-mon[28069]: pgmap v11303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:00.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:30:59 smithi196 ceph-mon[32572]: pgmap v11303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:30:59 smithi193 ceph-mon[32782]: pgmap v11303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:02 smithi193 ceph-mon[32782]: pgmap v11304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20577.216579 secs 2024-04-26T17:31:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:02 smithi196 ceph-mon[32572]: pgmap v11304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20577.216579 secs 2024-04-26T17:31:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:02 smithi110 ceph-mon[28069]: pgmap v11304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20577.216579 secs 2024-04-26T17:31:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:04 smithi193 ceph-mon[32782]: pgmap v11305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:04.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:04 smithi196 ceph-mon[32572]: pgmap v11305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:04 smithi110 ceph-mon[28069]: pgmap v11305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:06 smithi193 ceph-mon[32782]: pgmap v11306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:06.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:06 smithi196 ceph-mon[32572]: pgmap v11306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:06.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:06 smithi110 ceph-mon[28069]: pgmap v11306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:07 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 20582.216668 secs 2024-04-26T17:31:07.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:07 smithi193 ceph-mon[32782]: slow request 11521.935190 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:31:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:07 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 20582.216668 secs 2024-04-26T17:31:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:07 smithi196 ceph-mon[32572]: slow request 11521.935190 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:31:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:07 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 20582.216668 secs 2024-04-26T17:31:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:07 smithi110 ceph-mon[28069]: slow request 11521.935190 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:31:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:08 smithi193 ceph-mon[32782]: pgmap v11307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:08.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:08 smithi196 ceph-mon[32572]: pgmap v11307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:08 smithi110 ceph-mon[28069]: pgmap v11307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:10.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:10 smithi193 ceph-mon[32782]: pgmap v11308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:10.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:10 smithi196 ceph-mon[32572]: pgmap v11308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:10 smithi110 ceph-mon[28069]: pgmap v11308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:12 smithi193 ceph-mon[32782]: pgmap v11309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20587.216751 secs 2024-04-26T17:31:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:12 smithi196 ceph-mon[32572]: pgmap v11309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20587.216751 secs 2024-04-26T17:31:12.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:12 smithi110 ceph-mon[28069]: pgmap v11309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20587.216751 secs 2024-04-26T17:31:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:14 smithi193 ceph-mon[32782]: pgmap v11310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:14.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:14 smithi196 ceph-mon[32572]: pgmap v11310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:14.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:14 smithi110 ceph-mon[28069]: pgmap v11310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:16 smithi193 ceph-mon[32782]: pgmap v11311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:16.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:16 smithi196 ceph-mon[32572]: pgmap v11311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:16.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:16 smithi110 ceph-mon[28069]: pgmap v11311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20592.216819 secs 2024-04-26T17:31:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20592.216819 secs 2024-04-26T17:31:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20592.216819 secs 2024-04-26T17:31:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:18 smithi196 ceph-mon[32572]: pgmap v11312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:18.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:18 smithi110 ceph-mon[28069]: pgmap v11312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:18 smithi193 ceph-mon[32782]: pgmap v11312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:20.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:20 smithi196 ceph-mon[32572]: pgmap v11313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:20 smithi110 ceph-mon[28069]: pgmap v11313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:20 smithi193 ceph-mon[32782]: pgmap v11313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:22 smithi196 ceph-mon[32572]: pgmap v11314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20597.216936 secs 2024-04-26T17:31:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:22 smithi110 ceph-mon[28069]: pgmap v11314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20597.216936 secs 2024-04-26T17:31:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:22 smithi193 ceph-mon[32782]: pgmap v11314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20597.216936 secs 2024-04-26T17:31:24.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:24 smithi196 ceph-mon[32572]: pgmap v11315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:24.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:24 smithi110 ceph-mon[28069]: pgmap v11315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:24 smithi193 ceph-mon[32782]: pgmap v11315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:26.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:26 smithi196 ceph-mon[32572]: pgmap v11316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:26 smithi110 ceph-mon[28069]: pgmap v11316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:26 smithi193 ceph-mon[32782]: pgmap v11316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20602.217054 secs 2024-04-26T17:31:27.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20602.217054 secs 2024-04-26T17:31:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20602.217054 secs 2024-04-26T17:31:28.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:28 smithi196 ceph-mon[32572]: pgmap v11317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:28.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:28 smithi110 ceph-mon[28069]: pgmap v11317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:28 smithi193 ceph-mon[32782]: pgmap v11317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:30.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:30 smithi196 ceph-mon[32572]: pgmap v11318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:30 smithi110 ceph-mon[28069]: pgmap v11318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:30 smithi193 ceph-mon[32782]: pgmap v11318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:32 smithi196 ceph-mon[32572]: pgmap v11319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20607.217168 secs 2024-04-26T17:31:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:32 smithi110 ceph-mon[28069]: pgmap v11319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20607.217168 secs 2024-04-26T17:31:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:32 smithi193 ceph-mon[32782]: pgmap v11319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20607.217168 secs 2024-04-26T17:31:34.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:34 smithi196 ceph-mon[32572]: pgmap v11320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:34.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:34 smithi110 ceph-mon[28069]: pgmap v11320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:34 smithi193 ceph-mon[32782]: pgmap v11320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:36 smithi196 ceph-mon[32572]: pgmap v11321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:36.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:36 smithi110 ceph-mon[28069]: pgmap v11321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:36 smithi193 ceph-mon[32782]: pgmap v11321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20612.217306 secs 2024-04-26T17:31:37.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20612.217306 secs 2024-04-26T17:31:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20612.217306 secs 2024-04-26T17:31:38.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:38 smithi196 ceph-mon[32572]: pgmap v11322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:38.771 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:38 smithi193 ceph-mon[32782]: pgmap v11322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:38.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:38 smithi110 ceph-mon[28069]: pgmap v11322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:40 smithi196 ceph-mon[32572]: pgmap v11323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:40.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:40 smithi110 ceph-mon[28069]: pgmap v11323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:40 smithi193 ceph-mon[32782]: pgmap v11323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:42 smithi196 ceph-mon[32572]: pgmap v11324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20617.217442 secs 2024-04-26T17:31:42.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:42 smithi110 ceph-mon[28069]: pgmap v11324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:42.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20617.217442 secs 2024-04-26T17:31:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:42 smithi193 ceph-mon[32782]: pgmap v11324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20617.217442 secs 2024-04-26T17:31:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:44 smithi196 ceph-mon[32572]: pgmap v11325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:31:44.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:44 smithi110 ceph-mon[28069]: pgmap v11325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:31:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:44 smithi193 ceph-mon[32782]: pgmap v11325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:31:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:31:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:31:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:45 smithi196 ceph-mon[32572]: pgmap v11326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:31:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:45 smithi196 ceph-mon[32572]: pgmap v11327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:31:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:31:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:31:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:45 smithi110 ceph-mon[28069]: pgmap v11326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:31:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:45 smithi110 ceph-mon[28069]: pgmap v11327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:31:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:31:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:31:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:45 smithi193 ceph-mon[32782]: pgmap v11326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:31:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:45 smithi193 ceph-mon[32782]: pgmap v11327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:31:47.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:46 smithi196 ceph-mon[32572]: pgmap v11328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:31:47.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:46 smithi110 ceph-mon[28069]: pgmap v11328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:31:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:46 smithi193 ceph-mon[32782]: pgmap v11328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:31:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20622.217552 secs 2024-04-26T17:31:48.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20622.217552 secs 2024-04-26T17:31:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20622.217552 secs 2024-04-26T17:31:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:48 smithi196 ceph-mon[32572]: pgmap v11329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:48 smithi110 ceph-mon[28069]: pgmap v11329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:48 smithi193 ceph-mon[32782]: pgmap v11329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:51.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:50 smithi196 ceph-mon[32572]: pgmap v11330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:50 smithi110 ceph-mon[28069]: pgmap v11330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:50 smithi193 ceph-mon[32782]: pgmap v11330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20627.217649 secs 2024-04-26T17:31:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20627.217649 secs 2024-04-26T17:31:52.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20627.217649 secs 2024-04-26T17:31:53.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:53 smithi196 ceph-mon[32572]: pgmap v11331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:53 smithi110 ceph-mon[28069]: pgmap v11331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:53 smithi193 ceph-mon[32782]: pgmap v11331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:31:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:54 smithi196 ceph-mon[32572]: pgmap v11332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:31:55.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:54 smithi110 ceph-mon[28069]: pgmap v11332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:31:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:54 smithi193 ceph-mon[32782]: pgmap v11332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:31:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:56 smithi196 ceph-mon[32572]: pgmap v11333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:57.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:56 smithi110 ceph-mon[28069]: pgmap v11333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:56 smithi193 ceph-mon[32782]: pgmap v11333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:31:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20632.217746 secs 2024-04-26T17:31:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20632.217746 secs 2024-04-26T17:31:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20632.217746 secs 2024-04-26T17:31:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:31:58 smithi196 ceph-mon[32572]: pgmap v11334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:59.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:31:58 smithi110 ceph-mon[28069]: pgmap v11334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:31:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:31:58 smithi193 ceph-mon[32782]: pgmap v11334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:00 smithi196 ceph-mon[32572]: pgmap v11335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:01.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:00 smithi110 ceph-mon[28069]: pgmap v11335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:00 smithi193 ceph-mon[32782]: pgmap v11335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20637.217869 secs 2024-04-26T17:32:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20637.217869 secs 2024-04-26T17:32:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20637.217869 secs 2024-04-26T17:32:03.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:03 smithi196 ceph-mon[32572]: pgmap v11336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:03.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:03 smithi110 ceph-mon[28069]: pgmap v11336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:03 smithi193 ceph-mon[32782]: pgmap v11336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:05.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:04 smithi196 ceph-mon[32572]: pgmap v11337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:04 smithi110 ceph-mon[28069]: pgmap v11337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:04 smithi193 ceph-mon[32782]: pgmap v11337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20642.217989 secs 2024-04-26T17:32:07.879 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:07 smithi193 ceph-mon[32782]: pgmap v11338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:08.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20642.217989 secs 2024-04-26T17:32:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:07 smithi196 ceph-mon[32572]: pgmap v11338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20642.217989 secs 2024-04-26T17:32:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:07 smithi110 ceph-mon[28069]: pgmap v11338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:08 smithi196 ceph-mon[32572]: pgmap v11339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:09.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:08 smithi110 ceph-mon[28069]: pgmap v11339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:08 smithi193 ceph-mon[32782]: pgmap v11339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:11.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:10 smithi196 ceph-mon[32572]: pgmap v11340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:10 smithi110 ceph-mon[28069]: pgmap v11340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:10 smithi193 ceph-mon[32782]: pgmap v11340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20647.218108 secs 2024-04-26T17:32:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20647.218108 secs 2024-04-26T17:32:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20647.218108 secs 2024-04-26T17:32:13.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:13 smithi196 ceph-mon[32572]: pgmap v11341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:13.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:13 smithi110 ceph-mon[28069]: pgmap v11341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:13 smithi193 ceph-mon[32782]: pgmap v11341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:14 smithi196 ceph-mon[32572]: pgmap v11342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:15.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:14 smithi110 ceph-mon[28069]: pgmap v11342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:14 smithi193 ceph-mon[32782]: pgmap v11342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:16 smithi196 ceph-mon[32572]: pgmap v11343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:17.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:16 smithi110 ceph-mon[28069]: pgmap v11343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:16 smithi193 ceph-mon[32782]: pgmap v11343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20652.218219 secs 2024-04-26T17:32:18.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20652.218219 secs 2024-04-26T17:32:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20652.218219 secs 2024-04-26T17:32:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:18 smithi196 ceph-mon[32572]: pgmap v11344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:19.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:18 smithi110 ceph-mon[28069]: pgmap v11344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:18 smithi193 ceph-mon[32782]: pgmap v11344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:20 smithi196 ceph-mon[32572]: pgmap v11345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:21.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:20 smithi110 ceph-mon[28069]: pgmap v11345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:20 smithi193 ceph-mon[32782]: pgmap v11345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:22.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20657.218337 secs 2024-04-26T17:32:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20657.218337 secs 2024-04-26T17:32:22.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20657.218337 secs 2024-04-26T17:32:23.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:23 smithi196 ceph-mon[32572]: pgmap v11346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:23 smithi110 ceph-mon[28069]: pgmap v11346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:23 smithi193 ceph-mon[32782]: pgmap v11346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:25.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:24 smithi196 ceph-mon[32572]: pgmap v11347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:32:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:24 smithi110 ceph-mon[28069]: pgmap v11347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:32:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:24 smithi193 ceph-mon[32782]: pgmap v11347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:32:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:26 smithi196 ceph-mon[32572]: pgmap v11348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:32:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:26 smithi110 ceph-mon[28069]: pgmap v11348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:32:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:26 smithi193 ceph-mon[32782]: pgmap v11348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:32:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20662.218471 secs 2024-04-26T17:32:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20662.218471 secs 2024-04-26T17:32:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20662.218471 secs 2024-04-26T17:32:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:28 smithi196 ceph-mon[32572]: pgmap v11349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:29.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:28 smithi110 ceph-mon[28069]: pgmap v11349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:28 smithi193 ceph-mon[32782]: pgmap v11349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:30 smithi196 ceph-mon[32572]: pgmap v11350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:32:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:30 smithi110 ceph-mon[28069]: pgmap v11350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:32:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:30 smithi193 ceph-mon[32782]: pgmap v11350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:32:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20667.218595 secs 2024-04-26T17:32:32.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20667.218595 secs 2024-04-26T17:32:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20667.218595 secs 2024-04-26T17:32:33.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:33 smithi196 ceph-mon[32572]: pgmap v11351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:33 smithi110 ceph-mon[28069]: pgmap v11351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:33 smithi193 ceph-mon[32782]: pgmap v11351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:35.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:34 smithi196 ceph-mon[32572]: pgmap v11352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:34 smithi110 ceph-mon[28069]: pgmap v11352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:34 smithi193 ceph-mon[32782]: pgmap v11352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:37.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:36 smithi196 ceph-mon[32572]: pgmap v11353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:36 smithi110 ceph-mon[28069]: pgmap v11353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:36 smithi193 ceph-mon[32782]: pgmap v11353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20672.218714 secs 2024-04-26T17:32:38.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20672.218714 secs 2024-04-26T17:32:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20672.218714 secs 2024-04-26T17:32:39.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:38 smithi196 ceph-mon[32572]: pgmap v11354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:39.271 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:38 smithi193 ceph-mon[32782]: pgmap v11354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:39.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:38 smithi110 ceph-mon[28069]: pgmap v11354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:40 smithi196 ceph-mon[32572]: pgmap v11355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:41.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:40 smithi110 ceph-mon[28069]: pgmap v11355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:40 smithi193 ceph-mon[32782]: pgmap v11355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:42.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20677.218838 secs 2024-04-26T17:32:42.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20677.218838 secs 2024-04-26T17:32:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20677.218838 secs 2024-04-26T17:32:43.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:43 smithi196 ceph-mon[32572]: pgmap v11356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:43.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:43 smithi110 ceph-mon[28069]: pgmap v11356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:43 smithi193 ceph-mon[32782]: pgmap v11356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:45.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:44 smithi196 ceph-mon[32572]: pgmap v11357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:45.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:44 smithi110 ceph-mon[28069]: pgmap v11357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:44 smithi193 ceph-mon[32782]: pgmap v11357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:46.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:32:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:32:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:32:47.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:32:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:32:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:46 smithi196 ceph-mon[32572]: pgmap v11358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:32:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:32:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:46 smithi110 ceph-mon[28069]: pgmap v11358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:32:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:32:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:46 smithi193 ceph-mon[32782]: pgmap v11358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:32:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:48 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20682.218955 secs 2024-04-26T17:32:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:32:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:32:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:48 smithi110 ceph-mon[28069]: pgmap v11359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:32:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:48 smithi110 ceph-mon[28069]: pgmap v11360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:32:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:48 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20682.218955 secs 2024-04-26T17:32:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:32:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:32:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:48 smithi193 ceph-mon[32782]: pgmap v11359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:32:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:48 smithi193 ceph-mon[32782]: pgmap v11360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:32:48.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:48 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20682.218955 secs 2024-04-26T17:32:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:32:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:32:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:48 smithi196 ceph-mon[32572]: pgmap v11359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:32:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:48 smithi196 ceph-mon[32572]: pgmap v11360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:32:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:50 smithi193 ceph-mon[32782]: pgmap v11361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:50.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:50 smithi196 ceph-mon[32572]: pgmap v11361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:50 smithi110 ceph-mon[28069]: pgmap v11361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:52 smithi193 ceph-mon[32782]: pgmap v11362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T17:32:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20687.219072 secs 2024-04-26T17:32:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:52 smithi196 ceph-mon[32572]: pgmap v11362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T17:32:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20687.219072 secs 2024-04-26T17:32:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:52 smithi110 ceph-mon[28069]: pgmap v11362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T17:32:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20687.219072 secs 2024-04-26T17:32:54.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:54 smithi193 ceph-mon[32782]: pgmap v11363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:54 smithi196 ceph-mon[32572]: pgmap v11363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:54 smithi110 ceph-mon[28069]: pgmap v11363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:56.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:56 smithi196 ceph-mon[32572]: pgmap v11364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:56.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:56 smithi110 ceph-mon[28069]: pgmap v11364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:56 smithi193 ceph-mon[32782]: pgmap v11364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:32:57.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20692.219191 secs 2024-04-26T17:32:57.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20692.219191 secs 2024-04-26T17:32:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20692.219191 secs 2024-04-26T17:32:58.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:32:58 smithi196 ceph-mon[32572]: pgmap v11365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:32:58.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:32:58 smithi110 ceph-mon[28069]: pgmap v11365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:32:58.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:32:58 smithi193 ceph-mon[32782]: pgmap v11365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:33:00.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:00 smithi196 ceph-mon[32572]: pgmap v11366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:00.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:00 smithi110 ceph-mon[28069]: pgmap v11366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:00.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:00 smithi193 ceph-mon[32782]: pgmap v11366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:02 smithi193 ceph-mon[32782]: pgmap v11367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20697.219304 secs 2024-04-26T17:33:03.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:02 smithi196 ceph-mon[32572]: pgmap v11367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20697.219304 secs 2024-04-26T17:33:03.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:02 smithi110 ceph-mon[28069]: pgmap v11367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20697.219304 secs 2024-04-26T17:33:04.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:04 smithi193 ceph-mon[32782]: pgmap v11368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:04 smithi196 ceph-mon[32572]: pgmap v11368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:05.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:04 smithi110 ceph-mon[28069]: pgmap v11368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:06.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:06 smithi193 ceph-mon[32782]: pgmap v11369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:07.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:06 smithi196 ceph-mon[32572]: pgmap v11369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:06 smithi110 ceph-mon[28069]: pgmap v11369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:08.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20702.219405 secs 2024-04-26T17:33:08.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20702.219405 secs 2024-04-26T17:33:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20702.219405 secs 2024-04-26T17:33:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:08 smithi196 ceph-mon[32572]: pgmap v11370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:09.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:08 smithi193 ceph-mon[32782]: pgmap v11370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:09.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:08 smithi110 ceph-mon[28069]: pgmap v11370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:11.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:10 smithi196 ceph-mon[32572]: pgmap v11371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:11.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:10 smithi110 ceph-mon[28069]: pgmap v11371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:10 smithi193 ceph-mon[32782]: pgmap v11371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:12 smithi196 ceph-mon[32572]: pgmap v11372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20707.219523 secs 2024-04-26T17:33:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:12 smithi110 ceph-mon[28069]: pgmap v11372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20707.219523 secs 2024-04-26T17:33:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:12 smithi193 ceph-mon[32782]: pgmap v11372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20707.219523 secs 2024-04-26T17:33:15.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:14 smithi196 ceph-mon[32572]: pgmap v11373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:14 smithi110 ceph-mon[28069]: pgmap v11373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:14 smithi193 ceph-mon[32782]: pgmap v11373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.434+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T17:33:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.434+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T17:33:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.434+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:33:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.434+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T17:33:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.435+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:33:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T17:33:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T17:33:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614063040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:33:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614063040 comp rx=0 tx=0).stop 2024-04-26T17:33:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T17:33:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T17:33:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:33:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T17:33:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T17:33:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.436+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:33:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.437+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:33:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:16.438+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614042040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:33:17.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:16 smithi196 ceph-mon[32572]: pgmap v11374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:17.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:16 smithi110 ceph-mon[28069]: pgmap v11374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:16 smithi193 ceph-mon[32782]: pgmap v11374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:18.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20712.219661 secs 2024-04-26T17:33:18.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20712.219661 secs 2024-04-26T17:33:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20712.219661 secs 2024-04-26T17:33:19.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:18 smithi196 ceph-mon[32572]: pgmap v11375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:19.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:18 smithi110 ceph-mon[28069]: pgmap v11375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:18 smithi193 ceph-mon[32782]: pgmap v11375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:19.790+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:33:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:19.790+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:33:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:19.791+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 161 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:33:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:33:19.791+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 161 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:33:21.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:20 smithi196 ceph-mon[32572]: pgmap v11376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:21.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:20 smithi110 ceph-mon[28069]: pgmap v11376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:20 smithi193 ceph-mon[32782]: pgmap v11376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:22 smithi196 ceph-mon[32572]: pgmap v11377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20717.219758 secs 2024-04-26T17:33:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:22 smithi110 ceph-mon[28069]: pgmap v11377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20717.219758 secs 2024-04-26T17:33:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:22 smithi193 ceph-mon[32782]: pgmap v11377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20717.219758 secs 2024-04-26T17:33:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:24 smithi196 ceph-mon[32572]: pgmap v11378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:25.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:24 smithi110 ceph-mon[28069]: pgmap v11378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:24 smithi193 ceph-mon[32782]: pgmap v11378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:26 smithi196 ceph-mon[32572]: pgmap v11379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:26 smithi110 ceph-mon[28069]: pgmap v11379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:26 smithi193 ceph-mon[32782]: pgmap v11379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:28.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20722.219857 secs 2024-04-26T17:33:28.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20722.219857 secs 2024-04-26T17:33:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20722.219857 secs 2024-04-26T17:33:29.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:28 smithi196 ceph-mon[32572]: pgmap v11380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:29.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:28 smithi110 ceph-mon[28069]: pgmap v11380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:28 smithi193 ceph-mon[32782]: pgmap v11380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:31.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:30 smithi196 ceph-mon[32572]: pgmap v11381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:31.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:30 smithi110 ceph-mon[28069]: pgmap v11381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:30 smithi193 ceph-mon[32782]: pgmap v11381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:32 smithi196 ceph-mon[32572]: pgmap v11382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20727.219954 secs 2024-04-26T17:33:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:32 smithi110 ceph-mon[28069]: pgmap v11382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20727.219954 secs 2024-04-26T17:33:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:32 smithi193 ceph-mon[32782]: pgmap v11382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20727.219954 secs 2024-04-26T17:33:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:34 smithi196 ceph-mon[32572]: pgmap v11383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:35.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:34 smithi110 ceph-mon[28069]: pgmap v11383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:34 smithi193 ceph-mon[32782]: pgmap v11383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:37.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:36 smithi196 ceph-mon[32572]: pgmap v11384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:37.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:36 smithi110 ceph-mon[28069]: pgmap v11384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:36 smithi193 ceph-mon[32782]: pgmap v11384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:38.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20732.220090 secs 2024-04-26T17:33:38.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20732.220090 secs 2024-04-26T17:33:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20732.220090 secs 2024-04-26T17:33:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:38 smithi196 ceph-mon[32572]: pgmap v11385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:39.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:38 smithi193 ceph-mon[32782]: pgmap v11385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:38 smithi110 ceph-mon[28069]: pgmap v11385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:41.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:40 smithi196 ceph-mon[32572]: pgmap v11386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:41.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:40 smithi110 ceph-mon[28069]: pgmap v11386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:40 smithi193 ceph-mon[32782]: pgmap v11386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:43.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:42 smithi196 ceph-mon[32572]: pgmap v11387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20737.220212 secs 2024-04-26T17:33:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:42 smithi110 ceph-mon[28069]: pgmap v11387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20737.220212 secs 2024-04-26T17:33:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:42 smithi193 ceph-mon[32782]: pgmap v11387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20737.220212 secs 2024-04-26T17:33:45.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:44 smithi196 ceph-mon[32572]: pgmap v11388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:44 smithi110 ceph-mon[28069]: pgmap v11388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:44 smithi193 ceph-mon[32782]: pgmap v11388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:47.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:46 smithi196 ceph-mon[32572]: pgmap v11389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:47.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:46 smithi110 ceph-mon[28069]: pgmap v11389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:46 smithi193 ceph-mon[32782]: pgmap v11389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:48.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20742.220349 secs 2024-04-26T17:33:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:33:48.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20742.220349 secs 2024-04-26T17:33:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:33:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20742.220349 secs 2024-04-26T17:33:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:33:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:48 smithi110 ceph-mon[28069]: pgmap v11390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:48 smithi193 ceph-mon[32782]: pgmap v11390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:48 smithi196 ceph-mon[32572]: pgmap v11390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: pgmap v11391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: pgmap v11392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T17:33:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: pgmap v11393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: pgmap v11391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:33:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:33:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: pgmap v11392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T17:33:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: pgmap v11393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: pgmap v11391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:33:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: pgmap v11392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T17:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: pgmap v11393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:33:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20747.220445 secs 2024-04-26T17:33:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:52 smithi110 ceph-mon[28069]: pgmap v11394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T17:33:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20747.220445 secs 2024-04-26T17:33:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:52 smithi193 ceph-mon[32782]: pgmap v11394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T17:33:53.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20747.220445 secs 2024-04-26T17:33:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:52 smithi196 ceph-mon[32572]: pgmap v11394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T17:33:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:54 smithi110 ceph-mon[28069]: pgmap v11395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:54 smithi193 ceph-mon[32782]: pgmap v11395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:54 smithi196 ceph-mon[32572]: pgmap v11395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:57.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:56 smithi110 ceph-mon[28069]: pgmap v11396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T17:33:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:56 smithi193 ceph-mon[32782]: pgmap v11396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T17:33:57.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:56 smithi196 ceph-mon[32572]: pgmap v11396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T17:33:58.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20752.220586 secs 2024-04-26T17:33:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20752.220586 secs 2024-04-26T17:33:58.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20752.220586 secs 2024-04-26T17:33:59.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:33:58 smithi110 ceph-mon[28069]: pgmap v11397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:33:58 smithi193 ceph-mon[32782]: pgmap v11397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:33:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:33:58 smithi196 ceph-mon[32572]: pgmap v11397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:00 smithi193 ceph-mon[32782]: pgmap v11398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:34:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:00 smithi196 ceph-mon[32572]: pgmap v11398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:34:01.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:00 smithi110 ceph-mon[28069]: pgmap v11398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:34:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20757.220655 secs 2024-04-26T17:34:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:02 smithi193 ceph-mon[32782]: pgmap v11399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20757.220655 secs 2024-04-26T17:34:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:02 smithi196 ceph-mon[32572]: pgmap v11399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20757.220655 secs 2024-04-26T17:34:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:02 smithi110 ceph-mon[28069]: pgmap v11399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:05.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:04 smithi110 ceph-mon[28069]: pgmap v11400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:04 smithi193 ceph-mon[32782]: pgmap v11400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:05.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:04 smithi196 ceph-mon[32572]: pgmap v11400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:07.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:06 smithi196 ceph-mon[32572]: pgmap v11401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:06 smithi193 ceph-mon[32782]: pgmap v11401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:07.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:06 smithi110 ceph-mon[28069]: pgmap v11401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20762.220755 secs 2024-04-26T17:34:08.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20762.220755 secs 2024-04-26T17:34:08.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20762.220755 secs 2024-04-26T17:34:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:08 smithi193 ceph-mon[32782]: pgmap v11402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:09.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:08 smithi196 ceph-mon[32572]: pgmap v11402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:08 smithi110 ceph-mon[28069]: pgmap v11402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:10.790 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:34:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:34:10.366+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:34:10.790 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:34:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:34:10.366+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:34:10.790 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:34:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:34:10.366+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:34:10.790 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:34:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:34:10.366+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:34:10.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:34:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:34:10.366+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:34:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:10 smithi193 ceph-mon[32782]: pgmap v11403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:11.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:10 smithi196 ceph-mon[32572]: pgmap v11403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:11.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:10 smithi110 ceph-mon[28069]: pgmap v11403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:13.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20767.220873 secs 2024-04-26T17:34:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:12 smithi196 ceph-mon[32572]: pgmap v11404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:13.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20767.220873 secs 2024-04-26T17:34:13.039 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:12 smithi110 ceph-mon[28069]: pgmap v11404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20767.220873 secs 2024-04-26T17:34:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:12 smithi193 ceph-mon[32782]: pgmap v11404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:14 smithi193 ceph-mon[32782]: pgmap v11405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:14 smithi196 ceph-mon[32572]: pgmap v11405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:15.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:14 smithi110 ceph-mon[28069]: pgmap v11405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:16 smithi193 ceph-mon[32782]: pgmap v11406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:17.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:16 smithi196 ceph-mon[32572]: pgmap v11406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:17.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:16 smithi110 ceph-mon[28069]: pgmap v11406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20772.220993 secs 2024-04-26T17:34:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20772.220993 secs 2024-04-26T17:34:18.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20772.220993 secs 2024-04-26T17:34:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:18 smithi193 ceph-mon[32782]: pgmap v11407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:19.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:18 smithi196 ceph-mon[32572]: pgmap v11407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:18 smithi110 ceph-mon[28069]: pgmap v11407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:20 smithi193 ceph-mon[32782]: pgmap v11408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:21.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:20 smithi196 ceph-mon[32572]: pgmap v11408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:20 smithi110 ceph-mon[28069]: pgmap v11408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20777.221115 secs 2024-04-26T17:34:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:22 smithi193 ceph-mon[32782]: pgmap v11409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:23.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20777.221115 secs 2024-04-26T17:34:23.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:22 smithi196 ceph-mon[32572]: pgmap v11409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20777.221115 secs 2024-04-26T17:34:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:22 smithi110 ceph-mon[28069]: pgmap v11409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:25.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:24 smithi193 ceph-mon[32782]: pgmap v11410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:25.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:24 smithi196 ceph-mon[32572]: pgmap v11410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:25.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:24 smithi110 ceph-mon[28069]: pgmap v11410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:34:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:26 smithi193 ceph-mon[32782]: pgmap v11411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:27.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:26 smithi196 ceph-mon[32572]: pgmap v11411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:26 smithi110 ceph-mon[28069]: pgmap v11411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20782.221240 secs 2024-04-26T17:34:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20782.221240 secs 2024-04-26T17:34:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20782.221240 secs 2024-04-26T17:34:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:28 smithi196 ceph-mon[32572]: pgmap v11412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:29.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:28 smithi110 ceph-mon[28069]: pgmap v11412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:28 smithi193 ceph-mon[32782]: pgmap v11412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:30 smithi196 ceph-mon[32572]: pgmap v11413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:31.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:30 smithi110 ceph-mon[28069]: pgmap v11413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:30 smithi193 ceph-mon[32782]: pgmap v11413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:33.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20787.221357 secs 2024-04-26T17:34:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:32 smithi196 ceph-mon[32572]: pgmap v11414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:33.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20787.221357 secs 2024-04-26T17:34:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:32 smithi110 ceph-mon[28069]: pgmap v11414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20787.221357 secs 2024-04-26T17:34:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:32 smithi193 ceph-mon[32782]: pgmap v11414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:34 smithi196 ceph-mon[32572]: pgmap v11415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:34 smithi110 ceph-mon[28069]: pgmap v11415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:34 smithi193 ceph-mon[32782]: pgmap v11415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:36 smithi196 ceph-mon[32572]: pgmap v11416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:36 smithi110 ceph-mon[28069]: pgmap v11416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:36 smithi193 ceph-mon[32782]: pgmap v11416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20792.221476 secs 2024-04-26T17:34:38.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20792.221476 secs 2024-04-26T17:34:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20792.221476 secs 2024-04-26T17:34:39.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:38 smithi196 ceph-mon[32572]: pgmap v11417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:39.271 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:38 smithi193 ceph-mon[32782]: pgmap v11417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:39.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:38 smithi110 ceph-mon[28069]: pgmap v11417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:39 smithi196 ceph-mon[32572]: pgmap v11418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:39 smithi110 ceph-mon[28069]: pgmap v11418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:39 smithi193 ceph-mon[32782]: pgmap v11418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20797.221615 secs 2024-04-26T17:34:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:42 smithi193 ceph-mon[32782]: pgmap v11419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:43.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20797.221615 secs 2024-04-26T17:34:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:42 smithi196 ceph-mon[32572]: pgmap v11419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20797.221615 secs 2024-04-26T17:34:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:42 smithi110 ceph-mon[28069]: pgmap v11419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:44 smithi193 ceph-mon[32782]: pgmap v11420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:45.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:44 smithi196 ceph-mon[32572]: pgmap v11420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:44 smithi110 ceph-mon[28069]: pgmap v11420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:46 smithi193 ceph-mon[32782]: pgmap v11421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:47.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:46 smithi196 ceph-mon[32572]: pgmap v11421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:47.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:46 smithi110 ceph-mon[28069]: pgmap v11421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20802.221692 secs 2024-04-26T17:34:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20802.221692 secs 2024-04-26T17:34:48.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20802.221692 secs 2024-04-26T17:34:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:48 smithi193 ceph-mon[32782]: pgmap v11422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:48 smithi196 ceph-mon[32572]: pgmap v11422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:48 smithi110 ceph-mon[28069]: pgmap v11422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:34:49.804+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:34:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:34:49.804+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:34:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:34:49.805+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 162 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:34:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:34:49.806+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 162 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:34:51.119 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:50 smithi193 ceph-mon[32782]: pgmap v11423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:51.119 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:34:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:50 smithi196 ceph-mon[32572]: pgmap v11423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:34:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:50 smithi110 ceph-mon[28069]: pgmap v11423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:34:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20807.221761 secs 2024-04-26T17:34:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: pgmap v11424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20807.221761 secs 2024-04-26T17:34:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: pgmap v11424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20807.221761 secs 2024-04-26T17:34:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: pgmap v11424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:34:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:34:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:34:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:34:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:34:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:34:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:34:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:55.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:54 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:34:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:54 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:34:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:54 smithi196 ceph-mon[32572]: pgmap v11425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:54 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:34:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:54 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:34:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:54 smithi110 ceph-mon[28069]: pgmap v11425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:54 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:34:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:54 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:34:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:54 smithi193 ceph-mon[32782]: pgmap v11425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:34:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:34:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:34:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:34:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:34:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:34:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:34:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:34:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:34:57.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:56 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:34:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:56 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:34:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:56 smithi196 ceph-mon[32572]: pgmap v11426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T17:34:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:56 smithi196 ceph-mon[32572]: pgmap v11427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:34:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:56 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:34:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:56 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:34:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:56 smithi110 ceph-mon[28069]: pgmap v11426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T17:34:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:56 smithi110 ceph-mon[28069]: pgmap v11427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:34:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:56 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:34:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:56 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:34:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:56 smithi193 ceph-mon[32782]: pgmap v11426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T17:34:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:56 smithi193 ceph-mon[32782]: pgmap v11427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:34:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20812.221893 secs 2024-04-26T17:34:58.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20812.221893 secs 2024-04-26T17:34:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20812.221893 secs 2024-04-26T17:34:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:34:58 smithi196 ceph-mon[32572]: pgmap v11428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:34:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:34:58 smithi110 ceph-mon[28069]: pgmap v11428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:34:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:34:58 smithi193 ceph-mon[32782]: pgmap v11428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:35:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:00 smithi196 ceph-mon[32572]: pgmap v11429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:35:01.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:00 smithi110 ceph-mon[28069]: pgmap v11429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:35:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:00 smithi193 ceph-mon[32782]: pgmap v11429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:35:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:01 smithi196 ceph-mon[32572]: pgmap v11430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:35:02.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:01 smithi110 ceph-mon[28069]: pgmap v11430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:35:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:01 smithi193 ceph-mon[32782]: pgmap v11430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:35:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20817.222014 secs 2024-04-26T17:35:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20817.222014 secs 2024-04-26T17:35:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20817.222014 secs 2024-04-26T17:35:04.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:03 smithi196 ceph-mon[32572]: pgmap v11431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:04.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:03 smithi110 ceph-mon[28069]: pgmap v11431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:03 smithi193 ceph-mon[32782]: pgmap v11431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:06 smithi193 ceph-mon[32782]: pgmap v11432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:06.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:06 smithi196 ceph-mon[32572]: pgmap v11432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:06 smithi110 ceph-mon[28069]: pgmap v11432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:08.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:08 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20822.222138 secs 2024-04-26T17:35:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:08 smithi193 ceph-mon[32782]: pgmap v11433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:08 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20822.222138 secs 2024-04-26T17:35:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:08 smithi196 ceph-mon[32572]: pgmap v11433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:08.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:08 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20822.222138 secs 2024-04-26T17:35:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:08 smithi110 ceph-mon[28069]: pgmap v11433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:10 smithi193 ceph-mon[32782]: pgmap v11434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:35:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:10 smithi196 ceph-mon[32572]: pgmap v11434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:35:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:10 smithi110 ceph-mon[28069]: pgmap v11434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:35:12.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:12 smithi193 ceph-mon[32782]: pgmap v11435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:35:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:12 smithi196 ceph-mon[32572]: pgmap v11435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:35:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:12 smithi110 ceph-mon[28069]: pgmap v11435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:35:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:13 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20827.222278 secs 2024-04-26T17:35:13.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:13 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20827.222278 secs 2024-04-26T17:35:13.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:13 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20827.222278 secs 2024-04-26T17:35:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:14 smithi193 ceph-mon[32782]: pgmap v11436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:14.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:14 smithi196 ceph-mon[32572]: pgmap v11436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:14 smithi110 ceph-mon[28069]: pgmap v11436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:35:16.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:16 smithi193 ceph-mon[32782]: pgmap v11437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:16.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:16 smithi196 ceph-mon[32572]: pgmap v11437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:16.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:16 smithi110 ceph-mon[28069]: pgmap v11437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:17.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20832.222423 secs 2024-04-26T17:35:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20832.222423 secs 2024-04-26T17:35:17.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20832.222423 secs 2024-04-26T17:35:18.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:18 smithi196 ceph-mon[32572]: pgmap v11438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:18.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:18 smithi110 ceph-mon[28069]: pgmap v11438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:18.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:18 smithi193 ceph-mon[32782]: pgmap v11438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:20.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:20 smithi196 ceph-mon[32572]: pgmap v11439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:20.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:20 smithi110 ceph-mon[28069]: pgmap v11439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:20 smithi193 ceph-mon[32782]: pgmap v11439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:22.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:22 smithi196 ceph-mon[32572]: pgmap v11440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20837.222542 secs 2024-04-26T17:35:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:22 smithi110 ceph-mon[28069]: pgmap v11440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20837.222542 secs 2024-04-26T17:35:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:22 smithi193 ceph-mon[32782]: pgmap v11440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20837.222542 secs 2024-04-26T17:35:24.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:24 smithi196 ceph-mon[32572]: pgmap v11441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:24.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:24 smithi110 ceph-mon[28069]: pgmap v11441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:24 smithi193 ceph-mon[32782]: pgmap v11441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:26 smithi196 ceph-mon[32572]: pgmap v11442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:26.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:26 smithi110 ceph-mon[28069]: pgmap v11442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:26.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:26 smithi193 ceph-mon[32782]: pgmap v11442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:27.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20842.222597 secs 2024-04-26T17:35:27.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20842.222597 secs 2024-04-26T17:35:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20842.222597 secs 2024-04-26T17:35:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:28 smithi196 ceph-mon[32572]: pgmap v11443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:28 smithi110 ceph-mon[28069]: pgmap v11443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:28.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:28 smithi193 ceph-mon[32782]: pgmap v11443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:30 smithi196 ceph-mon[32572]: pgmap v11444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:30.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:30 smithi110 ceph-mon[28069]: pgmap v11444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:30.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:30 smithi193 ceph-mon[32782]: pgmap v11444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:32 smithi196 ceph-mon[32572]: pgmap v11445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20847.222695 secs 2024-04-26T17:35:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:32 smithi110 ceph-mon[28069]: pgmap v11445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20847.222695 secs 2024-04-26T17:35:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:32 smithi193 ceph-mon[32782]: pgmap v11445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:32.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20847.222695 secs 2024-04-26T17:35:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:34 smithi196 ceph-mon[32572]: pgmap v11446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:34.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:34 smithi110 ceph-mon[28069]: pgmap v11446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:34.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:34 smithi193 ceph-mon[32782]: pgmap v11446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:36.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:36 smithi196 ceph-mon[32572]: pgmap v11447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:36 smithi110 ceph-mon[28069]: pgmap v11447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:36 smithi193 ceph-mon[32782]: pgmap v11447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:37.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20852.222783 secs 2024-04-26T17:35:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20852.222783 secs 2024-04-26T17:35:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20852.222783 secs 2024-04-26T17:35:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:38 smithi196 ceph-mon[32572]: pgmap v11448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:38.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:38 smithi110 ceph-mon[28069]: pgmap v11448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:38 smithi193 ceph-mon[32782]: pgmap v11448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:40.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:40 smithi196 ceph-mon[32572]: pgmap v11449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:40.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:40 smithi110 ceph-mon[28069]: pgmap v11449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:40.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:40 smithi193 ceph-mon[32782]: pgmap v11449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:42 smithi196 ceph-mon[32572]: pgmap v11450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20857.222908 secs 2024-04-26T17:35:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:42 smithi110 ceph-mon[28069]: pgmap v11450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20857.222908 secs 2024-04-26T17:35:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:42 smithi193 ceph-mon[32782]: pgmap v11450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20857.222908 secs 2024-04-26T17:35:44.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:44 smithi196 ceph-mon[32572]: pgmap v11451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:44 smithi110 ceph-mon[28069]: pgmap v11451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:44.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:44 smithi193 ceph-mon[32782]: pgmap v11451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:46.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:46 smithi196 ceph-mon[32572]: pgmap v11452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:46 smithi110 ceph-mon[28069]: pgmap v11452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:46.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:46 smithi193 ceph-mon[32782]: pgmap v11452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20862.223034 secs 2024-04-26T17:35:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20862.223034 secs 2024-04-26T17:35:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20862.223034 secs 2024-04-26T17:35:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:48 smithi196 ceph-mon[32572]: pgmap v11453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:48.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:48 smithi110 ceph-mon[28069]: pgmap v11453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:48 smithi193 ceph-mon[32782]: pgmap v11453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:50.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:50 smithi196 ceph-mon[32572]: pgmap v11454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:50 smithi110 ceph-mon[28069]: pgmap v11454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:50.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:50 smithi193 ceph-mon[32782]: pgmap v11454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:52.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:52 smithi196 ceph-mon[32572]: pgmap v11455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20867.223183 secs 2024-04-26T17:35:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:52 smithi110 ceph-mon[28069]: pgmap v11455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20867.223183 secs 2024-04-26T17:35:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:52 smithi193 ceph-mon[32782]: pgmap v11455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20867.223183 secs 2024-04-26T17:35:54.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:54 smithi196 ceph-mon[32572]: pgmap v11456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:54 smithi110 ceph-mon[28069]: pgmap v11456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:54.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:54 smithi193 ceph-mon[32782]: pgmap v11456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:35:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:56 smithi196 ceph-mon[32572]: pgmap v11457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:35:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:56 smithi110 ceph-mon[28069]: pgmap v11457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:35:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:56 smithi193 ceph-mon[32782]: pgmap v11457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:35:56.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:35:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20872.223337 secs 2024-04-26T17:35:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:35:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:35:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:57 smithi196 ceph-mon[32572]: pgmap v11458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:35:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:57 smithi196 ceph-mon[32572]: pgmap v11459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:35:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:35:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20872.223337 secs 2024-04-26T17:35:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:35:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:35:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:57 smithi110 ceph-mon[28069]: pgmap v11458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:35:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:57 smithi110 ceph-mon[28069]: pgmap v11459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:35:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:35:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20872.223337 secs 2024-04-26T17:35:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:35:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:35:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:57 smithi193 ceph-mon[32782]: pgmap v11458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:35:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:57 smithi193 ceph-mon[32782]: pgmap v11459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:35:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:36:00.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:35:59 smithi196 ceph-mon[32572]: pgmap v11460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:00.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:35:59 smithi110 ceph-mon[28069]: pgmap v11460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:35:59 smithi193 ceph-mon[32782]: pgmap v11460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:02.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:01 smithi196 ceph-mon[32572]: pgmap v11461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:01 smithi110 ceph-mon[28069]: pgmap v11461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:01 smithi193 ceph-mon[32782]: pgmap v11461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:03.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20877.223482 secs 2024-04-26T17:36:03.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20877.223482 secs 2024-04-26T17:36:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20877.223482 secs 2024-04-26T17:36:04.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:03 smithi196 ceph-mon[32572]: pgmap v11462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:04.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:03 smithi110 ceph-mon[28069]: pgmap v11462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:03 smithi193 ceph-mon[32782]: pgmap v11462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:06.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:05 smithi196 ceph-mon[32572]: pgmap v11463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:05 smithi110 ceph-mon[28069]: pgmap v11463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:05 smithi193 ceph-mon[32782]: pgmap v11463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:36:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:07 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 20882.223610 secs 2024-04-26T17:36:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:07 smithi196 ceph-mon[32572]: slow request 11521.717096 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:36:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:07 smithi196 ceph-mon[32572]: pgmap v11464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:36:08.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:07 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 20882.223610 secs 2024-04-26T17:36:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:07 smithi110 ceph-mon[28069]: slow request 11521.717096 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:36:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:07 smithi110 ceph-mon[28069]: pgmap v11464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:36:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:07 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 20882.223610 secs 2024-04-26T17:36:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:07 smithi193 ceph-mon[32782]: slow request 11521.717096 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:36:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:07 smithi193 ceph-mon[32782]: pgmap v11464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:36:10.172 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:09 smithi193 ceph-mon[32782]: pgmap v11465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:09 smithi196 ceph-mon[32572]: pgmap v11465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:09 smithi110 ceph-mon[28069]: pgmap v11465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:11 smithi196 ceph-mon[32572]: pgmap v11466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:12.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:11 smithi110 ceph-mon[28069]: pgmap v11466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:12.363 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:11 smithi193 ceph-mon[32782]: pgmap v11466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20887.223624 secs 2024-04-26T17:36:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20887.223624 secs 2024-04-26T17:36:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20887.223624 secs 2024-04-26T17:36:14.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:13 smithi196 ceph-mon[32572]: pgmap v11467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:14.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:13 smithi110 ceph-mon[28069]: pgmap v11467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:14.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:13 smithi193 ceph-mon[32782]: pgmap v11467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:14 smithi196 ceph-mon[32572]: pgmap v11468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:14 smithi110 ceph-mon[28069]: pgmap v11468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:14 smithi193 ceph-mon[32782]: pgmap v11468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20892.223740 secs 2024-04-26T17:36:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:17 smithi196 ceph-mon[32572]: pgmap v11469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20892.223740 secs 2024-04-26T17:36:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:17 smithi110 ceph-mon[28069]: pgmap v11469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20892.223740 secs 2024-04-26T17:36:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:17 smithi193 ceph-mon[32782]: pgmap v11469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:36:19.819+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:36:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:36:19.819+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:36:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:36:19.820+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 163 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:36:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:36:19.820+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 163 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:36:20.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:19 smithi196 ceph-mon[32572]: pgmap v11470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:19 smithi110 ceph-mon[28069]: pgmap v11470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:19 smithi193 ceph-mon[32782]: pgmap v11470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:21 smithi193 ceph-mon[32782]: pgmap v11471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:21 smithi196 ceph-mon[32572]: pgmap v11471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:21 smithi110 ceph-mon[28069]: pgmap v11471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:23.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20897.223834 secs 2024-04-26T17:36:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20897.223834 secs 2024-04-26T17:36:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20897.223834 secs 2024-04-26T17:36:24.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:23 smithi196 ceph-mon[32572]: pgmap v11472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:23 smithi110 ceph-mon[28069]: pgmap v11472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:23 smithi193 ceph-mon[32782]: pgmap v11472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:25 smithi196 ceph-mon[32572]: pgmap v11473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:25 smithi110 ceph-mon[28069]: pgmap v11473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:25 smithi193 ceph-mon[32782]: pgmap v11473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20902.223954 secs 2024-04-26T17:36:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:27 smithi196 ceph-mon[32572]: pgmap v11474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20902.223954 secs 2024-04-26T17:36:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:27 smithi110 ceph-mon[28069]: pgmap v11474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20902.223954 secs 2024-04-26T17:36:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:27 smithi193 ceph-mon[32782]: pgmap v11474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:29 smithi196 ceph-mon[32572]: pgmap v11475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:29 smithi110 ceph-mon[28069]: pgmap v11475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:30.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:29 smithi193 ceph-mon[32782]: pgmap v11475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:30 smithi196 ceph-mon[32572]: pgmap v11476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:30 smithi110 ceph-mon[28069]: pgmap v11476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:30 smithi193 ceph-mon[32782]: pgmap v11476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20907.224073 secs 2024-04-26T17:36:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20907.224073 secs 2024-04-26T17:36:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20907.224073 secs 2024-04-26T17:36:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:33 smithi196 ceph-mon[32572]: pgmap v11477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:33 smithi110 ceph-mon[28069]: pgmap v11477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:33 smithi193 ceph-mon[32782]: pgmap v11477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:35 smithi196 ceph-mon[32572]: pgmap v11478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:35 smithi110 ceph-mon[28069]: pgmap v11478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:35 smithi193 ceph-mon[32782]: pgmap v11478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:38.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20912.224143 secs 2024-04-26T17:36:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:37 smithi196 ceph-mon[32572]: pgmap v11479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20912.224143 secs 2024-04-26T17:36:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:37 smithi110 ceph-mon[28069]: pgmap v11479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20912.224143 secs 2024-04-26T17:36:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:37 smithi193 ceph-mon[32782]: pgmap v11479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:40.172 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:39 smithi193 ceph-mon[32782]: pgmap v11480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:39 smithi196 ceph-mon[32572]: pgmap v11480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:39 smithi110 ceph-mon[28069]: pgmap v11480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:42.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:41 smithi196 ceph-mon[32572]: pgmap v11481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:42.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:41 smithi110 ceph-mon[28069]: pgmap v11481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:41 smithi193 ceph-mon[32782]: pgmap v11481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20917.224260 secs 2024-04-26T17:36:43.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20917.224260 secs 2024-04-26T17:36:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20917.224260 secs 2024-04-26T17:36:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:43 smithi196 ceph-mon[32572]: pgmap v11482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:43 smithi110 ceph-mon[28069]: pgmap v11482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:43 smithi193 ceph-mon[32782]: pgmap v11482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:45 smithi196 ceph-mon[32572]: pgmap v11483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:45 smithi110 ceph-mon[28069]: pgmap v11483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:45 smithi193 ceph-mon[32782]: pgmap v11483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:46 smithi196 ceph-mon[32572]: pgmap v11484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:47.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:46 smithi110 ceph-mon[28069]: pgmap v11484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:46 smithi193 ceph-mon[32782]: pgmap v11484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:48.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20922.224384 secs 2024-04-26T17:36:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20922.224384 secs 2024-04-26T17:36:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20922.224384 secs 2024-04-26T17:36:49.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:48 smithi196 ceph-mon[32572]: pgmap v11485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:48 smithi110 ceph-mon[28069]: pgmap v11485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:48 smithi193 ceph-mon[32782]: pgmap v11485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:51 smithi196 ceph-mon[32572]: pgmap v11486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:51 smithi110 ceph-mon[28069]: pgmap v11486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:51 smithi193 ceph-mon[32782]: pgmap v11486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20927.224483 secs 2024-04-26T17:36:53.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20927.224483 secs 2024-04-26T17:36:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20927.224483 secs 2024-04-26T17:36:54.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:53 smithi196 ceph-mon[32572]: pgmap v11487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:53 smithi110 ceph-mon[28069]: pgmap v11487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:53 smithi193 ceph-mon[32782]: pgmap v11487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:36:56.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:55 smithi196 ceph-mon[32572]: pgmap v11488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:55 smithi110 ceph-mon[28069]: pgmap v11488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:55 smithi193 ceph-mon[32782]: pgmap v11488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20932.224600 secs 2024-04-26T17:36:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:57 smithi196 ceph-mon[32572]: pgmap v11489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:36:58.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20932.224600 secs 2024-04-26T17:36:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:57 smithi110 ceph-mon[28069]: pgmap v11489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:36:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20932.224600 secs 2024-04-26T17:36:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:57 smithi193 ceph-mon[32782]: pgmap v11489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:36:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:36:59.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:36:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:36:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:36:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:36:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:36:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:36:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:36:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:36:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:37:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:59 smithi196 ceph-mon[32572]: pgmap v11490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:37:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:36:59 smithi196 ceph-mon[32572]: pgmap v11491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:59 smithi110 ceph-mon[28069]: pgmap v11490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:37:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:36:59 smithi110 ceph-mon[28069]: pgmap v11491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:59 smithi193 ceph-mon[32782]: pgmap v11490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:37:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:36:59 smithi193 ceph-mon[32782]: pgmap v11491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:01.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:00 smithi196 ceph-mon[32572]: pgmap v11492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:00 smithi110 ceph-mon[28069]: pgmap v11492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:00 smithi193 ceph-mon[32782]: pgmap v11492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:02.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20937.224713 secs 2024-04-26T17:37:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20937.224713 secs 2024-04-26T17:37:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20937.224713 secs 2024-04-26T17:37:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:03 smithi196 ceph-mon[32572]: pgmap v11493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:03 smithi110 ceph-mon[28069]: pgmap v11493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:03 smithi193 ceph-mon[32782]: pgmap v11493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:05 smithi196 ceph-mon[32572]: pgmap v11494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:05.789 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:05 smithi110 ceph-mon[28069]: pgmap v11494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:05 smithi193 ceph-mon[32782]: pgmap v11494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:07.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:07 smithi196 ceph-mon[32572]: pgmap v11495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20942.224837 secs 2024-04-26T17:37:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:07 smithi110 ceph-mon[28069]: pgmap v11495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20942.224837 secs 2024-04-26T17:37:07.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:07 smithi193 ceph-mon[32782]: pgmap v11495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:37:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20942.224837 secs 2024-04-26T17:37:09.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:09 smithi196 ceph-mon[32572]: pgmap v11496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:37:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:09 smithi110 ceph-mon[28069]: pgmap v11496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:37:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:09 smithi193 ceph-mon[32782]: pgmap v11496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:37:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:11 smithi196 ceph-mon[32572]: pgmap v11497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:11 smithi110 ceph-mon[28069]: pgmap v11497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:11.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:11 smithi193 ceph-mon[32782]: pgmap v11497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:12.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20947.224924 secs 2024-04-26T17:37:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20947.224924 secs 2024-04-26T17:37:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20947.224924 secs 2024-04-26T17:37:13.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:13 smithi196 ceph-mon[32572]: pgmap v11498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:13 smithi110 ceph-mon[28069]: pgmap v11498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:13.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:13 smithi193 ceph-mon[32782]: pgmap v11498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:15 smithi196 ceph-mon[32572]: pgmap v11499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:15 smithi110 ceph-mon[28069]: pgmap v11499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:15.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:15 smithi193 ceph-mon[32782]: pgmap v11499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:17.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:17 smithi196 ceph-mon[32572]: pgmap v11500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20952.225040 secs 2024-04-26T17:37:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:17 smithi110 ceph-mon[28069]: pgmap v11500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20952.225040 secs 2024-04-26T17:37:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:17 smithi193 ceph-mon[32782]: pgmap v11500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20952.225040 secs 2024-04-26T17:37:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:19 smithi110 ceph-mon[28069]: pgmap v11501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:19.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:19 smithi193 ceph-mon[32782]: pgmap v11501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:19 smithi196 ceph-mon[32572]: pgmap v11501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:21 smithi110 ceph-mon[28069]: pgmap v11502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:21.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:21 smithi193 ceph-mon[32782]: pgmap v11502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:21 smithi196 ceph-mon[32572]: pgmap v11502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20957.225122 secs 2024-04-26T17:37:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20957.225122 secs 2024-04-26T17:37:23.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20957.225122 secs 2024-04-26T17:37:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:23 smithi110 ceph-mon[28069]: pgmap v11503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:23 smithi193 ceph-mon[32782]: pgmap v11503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:24.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:23 smithi196 ceph-mon[32572]: pgmap v11503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:25 smithi110 ceph-mon[28069]: pgmap v11504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:25.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:25 smithi193 ceph-mon[32782]: pgmap v11504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:25 smithi196 ceph-mon[32572]: pgmap v11504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:27 smithi110 ceph-mon[28069]: pgmap v11505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20962.225237 secs 2024-04-26T17:37:27.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:27 smithi193 ceph-mon[32782]: pgmap v11505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20962.225237 secs 2024-04-26T17:37:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:27 smithi196 ceph-mon[32572]: pgmap v11505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20962.225237 secs 2024-04-26T17:37:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:29 smithi110 ceph-mon[28069]: pgmap v11506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:29.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:29 smithi193 ceph-mon[32782]: pgmap v11506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:29 smithi196 ceph-mon[32572]: pgmap v11506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:31.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:31 smithi193 ceph-mon[32782]: pgmap v11507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:31 smithi196 ceph-mon[32572]: pgmap v11507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:31 smithi110 ceph-mon[28069]: pgmap v11507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:32.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20967.225353 secs 2024-04-26T17:37:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20967.225353 secs 2024-04-26T17:37:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20967.225353 secs 2024-04-26T17:37:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:33 smithi193 ceph-mon[32782]: pgmap v11508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:33 smithi196 ceph-mon[32572]: pgmap v11508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:33 smithi110 ceph-mon[28069]: pgmap v11508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:35 smithi193 ceph-mon[32782]: pgmap v11509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:35 smithi196 ceph-mon[32572]: pgmap v11509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:35 smithi110 ceph-mon[28069]: pgmap v11509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:37.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:37 smithi110 ceph-mon[28069]: pgmap v11510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:37.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20972.225473 secs 2024-04-26T17:37:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:37 smithi193 ceph-mon[32782]: pgmap v11510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20972.225473 secs 2024-04-26T17:37:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:37 smithi196 ceph-mon[32572]: pgmap v11510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20972.225473 secs 2024-04-26T17:37:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:39 smithi193 ceph-mon[32782]: pgmap v11511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:39 smithi196 ceph-mon[32572]: pgmap v11511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:39 smithi110 ceph-mon[28069]: pgmap v11511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:41 smithi193 ceph-mon[32782]: pgmap v11512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:41 smithi196 ceph-mon[32572]: pgmap v11512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:41 smithi110 ceph-mon[28069]: pgmap v11512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:42.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20977.225547 secs 2024-04-26T17:37:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20977.225547 secs 2024-04-26T17:37:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20977.225547 secs 2024-04-26T17:37:43.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:43 smithi193 ceph-mon[32782]: pgmap v11513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:43 smithi196 ceph-mon[32572]: pgmap v11513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:43 smithi110 ceph-mon[28069]: pgmap v11513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:45 smithi193 ceph-mon[32782]: pgmap v11514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:45 smithi196 ceph-mon[32572]: pgmap v11514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:45 smithi110 ceph-mon[28069]: pgmap v11514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:47 smithi193 ceph-mon[32782]: pgmap v11515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20982.225602 secs 2024-04-26T17:37:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:47 smithi196 ceph-mon[32572]: pgmap v11515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20982.225602 secs 2024-04-26T17:37:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:47 smithi110 ceph-mon[28069]: pgmap v11515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20982.225602 secs 2024-04-26T17:37:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:49 smithi193 ceph-mon[32782]: pgmap v11516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:49 smithi196 ceph-mon[32572]: pgmap v11516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:49 smithi110 ceph-mon[28069]: pgmap v11516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:51 smithi193 ceph-mon[32782]: pgmap v11517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:51 smithi196 ceph-mon[32572]: pgmap v11517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:51 smithi110 ceph-mon[28069]: pgmap v11517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20987.225743 secs 2024-04-26T17:37:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20987.225743 secs 2024-04-26T17:37:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20987.225743 secs 2024-04-26T17:37:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:53 smithi196 ceph-mon[32572]: pgmap v11518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:53 smithi110 ceph-mon[28069]: pgmap v11518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:53 smithi193 ceph-mon[32782]: pgmap v11518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:37:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:55 smithi196 ceph-mon[32572]: pgmap v11519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:55 smithi110 ceph-mon[28069]: pgmap v11519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:56.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:55 smithi193 ceph-mon[32782]: pgmap v11519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:57 smithi196 ceph-mon[32572]: pgmap v11520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20992.225862 secs 2024-04-26T17:37:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:57 smithi110 ceph-mon[28069]: pgmap v11520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20992.225862 secs 2024-04-26T17:37:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:57 smithi193 ceph-mon[32782]: pgmap v11520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:37:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20992.225862 secs 2024-04-26T17:38:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:59 smithi196 ceph-mon[32572]: pgmap v11521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:37:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:38:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:59 smithi110 ceph-mon[28069]: pgmap v11521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:37:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:38:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:59 smithi193 ceph-mon[32782]: pgmap v11521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:37:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:38:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:38:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:38:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:38:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:38:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:38:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:38:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:38:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:38:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:38:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:01 smithi196 ceph-mon[32572]: pgmap v11522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T17:38:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:01 smithi196 ceph-mon[32572]: pgmap v11523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:01 smithi110 ceph-mon[28069]: pgmap v11522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T17:38:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:01 smithi110 ceph-mon[28069]: pgmap v11523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:01 smithi193 ceph-mon[32782]: pgmap v11522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T17:38:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:01 smithi193 ceph-mon[32782]: pgmap v11523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 20997.225988 secs 2024-04-26T17:38:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 20997.225988 secs 2024-04-26T17:38:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 20997.225988 secs 2024-04-26T17:38:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:03 smithi196 ceph-mon[32572]: pgmap v11524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T17:38:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:03 smithi110 ceph-mon[28069]: pgmap v11524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T17:38:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:03 smithi193 ceph-mon[32782]: pgmap v11524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T17:38:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:05 smithi196 ceph-mon[32572]: pgmap v11525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:05 smithi110 ceph-mon[28069]: pgmap v11525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:05 smithi193 ceph-mon[32782]: pgmap v11525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:07 smithi196 ceph-mon[32572]: pgmap v11526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21002.226060 secs 2024-04-26T17:38:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:07 smithi110 ceph-mon[28069]: pgmap v11526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21002.226060 secs 2024-04-26T17:38:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:07 smithi193 ceph-mon[32782]: pgmap v11526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21002.226060 secs 2024-04-26T17:38:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:09 smithi196 ceph-mon[32572]: pgmap v11527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:09 smithi110 ceph-mon[28069]: pgmap v11527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:09 smithi193 ceph-mon[32782]: pgmap v11527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:38:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:11 smithi196 ceph-mon[32572]: pgmap v11528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:38:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:11 smithi110 ceph-mon[28069]: pgmap v11528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:38:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:11 smithi193 ceph-mon[32782]: pgmap v11528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:38:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21007.226178 secs 2024-04-26T17:38:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21007.226178 secs 2024-04-26T17:38:13.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21007.226178 secs 2024-04-26T17:38:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:13 smithi196 ceph-mon[32572]: pgmap v11529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:13 smithi110 ceph-mon[28069]: pgmap v11529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:13 smithi193 ceph-mon[32782]: pgmap v11529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:15 smithi196 ceph-mon[32572]: pgmap v11530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:15 smithi110 ceph-mon[28069]: pgmap v11530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:15 smithi193 ceph-mon[32782]: pgmap v11530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:17 smithi196 ceph-mon[32572]: pgmap v11531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21012.226313 secs 2024-04-26T17:38:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:17 smithi110 ceph-mon[28069]: pgmap v11531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21012.226313 secs 2024-04-26T17:38:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:17 smithi193 ceph-mon[32782]: pgmap v11531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21012.226313 secs 2024-04-26T17:38:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:19 smithi110 ceph-mon[28069]: pgmap v11532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:19 smithi193 ceph-mon[32782]: pgmap v11532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:19 smithi196 ceph-mon[32572]: pgmap v11532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:21 smithi110 ceph-mon[28069]: pgmap v11533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:21 smithi193 ceph-mon[32782]: pgmap v11533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:21 smithi196 ceph-mon[32572]: pgmap v11533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21017.226396 secs 2024-04-26T17:38:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21017.226396 secs 2024-04-26T17:38:23.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21017.226396 secs 2024-04-26T17:38:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:23 smithi110 ceph-mon[28069]: pgmap v11534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:23 smithi193 ceph-mon[32782]: pgmap v11534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:24.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:23 smithi196 ceph-mon[32572]: pgmap v11534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:25 smithi110 ceph-mon[28069]: pgmap v11535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:25 smithi193 ceph-mon[32782]: pgmap v11535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:25 smithi196 ceph-mon[32572]: pgmap v11535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:27 smithi110 ceph-mon[28069]: pgmap v11536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21022.226516 secs 2024-04-26T17:38:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:27 smithi193 ceph-mon[32782]: pgmap v11536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21022.226516 secs 2024-04-26T17:38:28.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:27 smithi196 ceph-mon[32572]: pgmap v11536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21022.226516 secs 2024-04-26T17:38:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:29 smithi193 ceph-mon[32782]: pgmap v11537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:29 smithi196 ceph-mon[32572]: pgmap v11537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:29 smithi110 ceph-mon[28069]: pgmap v11537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:31 smithi193 ceph-mon[32782]: pgmap v11538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:32.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:31 smithi196 ceph-mon[32572]: pgmap v11538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:31 smithi110 ceph-mon[28069]: pgmap v11538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21027.226631 secs 2024-04-26T17:38:33.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21027.226631 secs 2024-04-26T17:38:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21027.226631 secs 2024-04-26T17:38:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:33 smithi193 ceph-mon[32782]: pgmap v11539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:34.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:33 smithi196 ceph-mon[32572]: pgmap v11539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:33 smithi110 ceph-mon[28069]: pgmap v11539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:35 smithi193 ceph-mon[32782]: pgmap v11540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:36.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:35 smithi196 ceph-mon[32572]: pgmap v11540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:35 smithi110 ceph-mon[28069]: pgmap v11540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:38.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:37 smithi110 ceph-mon[28069]: pgmap v11541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:38.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21032.226733 secs 2024-04-26T17:38:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:37 smithi193 ceph-mon[32782]: pgmap v11541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21032.226733 secs 2024-04-26T17:38:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:37 smithi196 ceph-mon[32572]: pgmap v11541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21032.226733 secs 2024-04-26T17:38:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:39 smithi193 ceph-mon[32782]: pgmap v11542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:40.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:39 smithi196 ceph-mon[32572]: pgmap v11542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:39 smithi110 ceph-mon[28069]: pgmap v11542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:42.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:41 smithi193 ceph-mon[32782]: pgmap v11543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:41 smithi196 ceph-mon[32572]: pgmap v11543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:41 smithi110 ceph-mon[28069]: pgmap v11543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21037.226813 secs 2024-04-26T17:38:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21037.226813 secs 2024-04-26T17:38:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21037.226813 secs 2024-04-26T17:38:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:43 smithi193 ceph-mon[32782]: pgmap v11544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:43 smithi196 ceph-mon[32572]: pgmap v11544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:43 smithi110 ceph-mon[28069]: pgmap v11544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:46.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:45 smithi193 ceph-mon[32782]: pgmap v11545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:45 smithi196 ceph-mon[32572]: pgmap v11545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:45 smithi110 ceph-mon[28069]: pgmap v11545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:48.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:47 smithi193 ceph-mon[32782]: pgmap v11546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:48.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21042.226902 secs 2024-04-26T17:38:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:47 smithi196 ceph-mon[32572]: pgmap v11546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21042.226902 secs 2024-04-26T17:38:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:47 smithi110 ceph-mon[28069]: pgmap v11546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21042.226902 secs 2024-04-26T17:38:50.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:49 smithi193 ceph-mon[32782]: pgmap v11547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:49 smithi196 ceph-mon[32572]: pgmap v11547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:49 smithi110 ceph-mon[28069]: pgmap v11547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:51 smithi193 ceph-mon[32782]: pgmap v11548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:52.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:51 smithi196 ceph-mon[32572]: pgmap v11548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:51 smithi110 ceph-mon[28069]: pgmap v11548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:53.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21047.227041 secs 2024-04-26T17:38:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21047.227041 secs 2024-04-26T17:38:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21047.227041 secs 2024-04-26T17:38:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:53 smithi196 ceph-mon[32572]: pgmap v11549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:53 smithi110 ceph-mon[28069]: pgmap v11549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:53 smithi193 ceph-mon[32782]: pgmap v11549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:55 smithi196 ceph-mon[32572]: pgmap v11550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:55 smithi110 ceph-mon[28069]: pgmap v11550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:55 smithi193 ceph-mon[32782]: pgmap v11550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:38:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:57 smithi196 ceph-mon[32572]: pgmap v11551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21052.227113 secs 2024-04-26T17:38:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:57 smithi110 ceph-mon[28069]: pgmap v11551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21052.227113 secs 2024-04-26T17:38:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:57 smithi193 ceph-mon[32782]: pgmap v11551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:38:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21052.227113 secs 2024-04-26T17:39:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:38:59 smithi196 ceph-mon[32572]: pgmap v11552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:38:59 smithi110 ceph-mon[28069]: pgmap v11552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:38:59 smithi193 ceph-mon[32782]: pgmap v11552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:39:01.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:39:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:39:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:01 smithi196 ceph-mon[32572]: pgmap v11553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:39:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:39:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:39:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:01 smithi110 ceph-mon[28069]: pgmap v11553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:39:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:39:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:39:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:01 smithi193 ceph-mon[32782]: pgmap v11553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:39:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:39:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:39:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21057.227223 secs 2024-04-26T17:39:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:02 smithi196 ceph-mon[32572]: pgmap v11554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:39:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:02 smithi196 ceph-mon[32572]: pgmap v11555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21057.227223 secs 2024-04-26T17:39:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:02 smithi110 ceph-mon[28069]: pgmap v11554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:39:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:02 smithi110 ceph-mon[28069]: pgmap v11555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21057.227223 secs 2024-04-26T17:39:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:02 smithi193 ceph-mon[32782]: pgmap v11554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:39:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:02 smithi193 ceph-mon[32782]: pgmap v11555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:04 smithi196 ceph-mon[32572]: pgmap v11556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:04 smithi110 ceph-mon[28069]: pgmap v11556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:04 smithi193 ceph-mon[32782]: pgmap v11556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:06 smithi196 ceph-mon[32572]: pgmap v11557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:06 smithi110 ceph-mon[28069]: pgmap v11557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:06 smithi193 ceph-mon[32782]: pgmap v11557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:08.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21062.227347 secs 2024-04-26T17:39:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21062.227347 secs 2024-04-26T17:39:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21062.227347 secs 2024-04-26T17:39:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:08 smithi196 ceph-mon[32572]: pgmap v11558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:08 smithi110 ceph-mon[28069]: pgmap v11558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:08 smithi193 ceph-mon[32782]: pgmap v11558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:10.790 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:39:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:39:10.463+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:39:10.790 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:39:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:39:10.463+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:39:10.790 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:39:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:39:10.463+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:39:10.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:39:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:39:10.463+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:39:10.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:39:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:39:10.463+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:39:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:10 smithi196 ceph-mon[32572]: pgmap v11559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:10 smithi110 ceph-mon[28069]: pgmap v11559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:11.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:10 smithi193 ceph-mon[32782]: pgmap v11559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:39:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21067.227466 secs 2024-04-26T17:39:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:12 smithi196 ceph-mon[32572]: pgmap v11560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:39:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21067.227466 secs 2024-04-26T17:39:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:12 smithi110 ceph-mon[28069]: pgmap v11560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:39:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21067.227466 secs 2024-04-26T17:39:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:12 smithi193 ceph-mon[32782]: pgmap v11560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:39:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:14 smithi196 ceph-mon[32572]: pgmap v11561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:39:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:14 smithi110 ceph-mon[28069]: pgmap v11561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:39:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:14 smithi193 ceph-mon[32782]: pgmap v11561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:39:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:16 smithi196 ceph-mon[32572]: pgmap v11562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:39:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:16 smithi110 ceph-mon[28069]: pgmap v11562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:39:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:16 smithi193 ceph-mon[32782]: pgmap v11562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:39:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21072.227600 secs 2024-04-26T17:39:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21072.227600 secs 2024-04-26T17:39:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21072.227600 secs 2024-04-26T17:39:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:18 smithi196 ceph-mon[32572]: pgmap v11563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:39:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:18 smithi110 ceph-mon[28069]: pgmap v11563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:39:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:18 smithi193 ceph-mon[32782]: pgmap v11563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:39:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:39:19.850+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:39:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:39:19.850+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:39:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:39:19.850+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 164 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:39:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:39:19.850+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 164 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:39:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:19 smithi196 ceph-mon[32572]: pgmap v11564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:39:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:19 smithi110 ceph-mon[28069]: pgmap v11564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:39:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:19 smithi193 ceph-mon[32782]: pgmap v11564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:39:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21077.227722 secs 2024-04-26T17:39:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:22 smithi196 ceph-mon[32572]: pgmap v11565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:39:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21077.227722 secs 2024-04-26T17:39:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:22 smithi110 ceph-mon[28069]: pgmap v11565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:39:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21077.227722 secs 2024-04-26T17:39:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:22 smithi193 ceph-mon[32782]: pgmap v11565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:39:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:24 smithi196 ceph-mon[32572]: pgmap v11566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:39:25.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:24 smithi110 ceph-mon[28069]: pgmap v11566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:39:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:24 smithi193 ceph-mon[32782]: pgmap v11566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:39:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:26 smithi196 ceph-mon[32572]: pgmap v11567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:26 smithi110 ceph-mon[28069]: pgmap v11567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:27.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:26 smithi193 ceph-mon[32782]: pgmap v11567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21082.227834 secs 2024-04-26T17:39:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21082.227834 secs 2024-04-26T17:39:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21082.227834 secs 2024-04-26T17:39:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:28 smithi196 ceph-mon[32572]: pgmap v11568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:28 smithi110 ceph-mon[28069]: pgmap v11568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:29.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:28 smithi193 ceph-mon[32782]: pgmap v11568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:31.003 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:30 smithi196 ceph-mon[32572]: pgmap v11569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:30 smithi110 ceph-mon[28069]: pgmap v11569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:31.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:30 smithi193 ceph-mon[32782]: pgmap v11569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21087.227930 secs 2024-04-26T17:39:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:32 smithi196 ceph-mon[32572]: pgmap v11570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21087.227930 secs 2024-04-26T17:39:33.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:32 smithi110 ceph-mon[28069]: pgmap v11570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21087.227930 secs 2024-04-26T17:39:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:32 smithi193 ceph-mon[32782]: pgmap v11570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:34 smithi196 ceph-mon[32572]: pgmap v11571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:34 smithi110 ceph-mon[28069]: pgmap v11571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:34 smithi193 ceph-mon[32782]: pgmap v11571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:36 smithi196 ceph-mon[32572]: pgmap v11572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:36 smithi110 ceph-mon[28069]: pgmap v11572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:36 smithi193 ceph-mon[32782]: pgmap v11572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21092.228066 secs 2024-04-26T17:39:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21092.228066 secs 2024-04-26T17:39:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21092.228066 secs 2024-04-26T17:39:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:38 smithi196 ceph-mon[32572]: pgmap v11573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:38 smithi110 ceph-mon[28069]: pgmap v11573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:38 smithi193 ceph-mon[32782]: pgmap v11573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:40 smithi196 ceph-mon[32572]: pgmap v11574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:40 smithi110 ceph-mon[28069]: pgmap v11574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:40 smithi193 ceph-mon[32782]: pgmap v11574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21097.228182 secs 2024-04-26T17:39:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:42 smithi196 ceph-mon[32572]: pgmap v11575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21097.228182 secs 2024-04-26T17:39:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:42 smithi110 ceph-mon[28069]: pgmap v11575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21097.228182 secs 2024-04-26T17:39:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:42 smithi193 ceph-mon[32782]: pgmap v11575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:44 smithi196 ceph-mon[32572]: pgmap v11576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:44 smithi110 ceph-mon[28069]: pgmap v11576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:45.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:44 smithi193 ceph-mon[32782]: pgmap v11576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:46 smithi196 ceph-mon[32572]: pgmap v11577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:46 smithi110 ceph-mon[28069]: pgmap v11577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:47.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:46 smithi193 ceph-mon[32782]: pgmap v11577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21102.228298 secs 2024-04-26T17:39:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21102.228298 secs 2024-04-26T17:39:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21102.228298 secs 2024-04-26T17:39:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:48 smithi196 ceph-mon[32572]: pgmap v11578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:48 smithi110 ceph-mon[28069]: pgmap v11578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:48 smithi193 ceph-mon[32782]: pgmap v11578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:50 smithi196 ceph-mon[32572]: pgmap v11579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:50 smithi110 ceph-mon[28069]: pgmap v11579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:50 smithi193 ceph-mon[32782]: pgmap v11579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21107.228422 secs 2024-04-26T17:39:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:52 smithi110 ceph-mon[28069]: pgmap v11580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21107.228422 secs 2024-04-26T17:39:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:52 smithi193 ceph-mon[32782]: pgmap v11580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21107.228422 secs 2024-04-26T17:39:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:52 smithi196 ceph-mon[32572]: pgmap v11580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:54 smithi110 ceph-mon[28069]: pgmap v11581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:54 smithi193 ceph-mon[32782]: pgmap v11581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:54 smithi196 ceph-mon[32572]: pgmap v11581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:56 smithi110 ceph-mon[28069]: pgmap v11582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:57.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:56 smithi193 ceph-mon[32782]: pgmap v11582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:56 smithi196 ceph-mon[32572]: pgmap v11582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:39:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21112.228553 secs 2024-04-26T17:39:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21112.228553 secs 2024-04-26T17:39:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21112.228553 secs 2024-04-26T17:39:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:39:58 smithi110 ceph-mon[28069]: pgmap v11583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:59.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:39:58 smithi193 ceph-mon[32782]: pgmap v11583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:39:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:39:58 smithi196 ceph-mon[32572]: pgmap v11583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:00 smithi110 ceph-mon[28069]: pgmap v11584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:40:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:00 smithi193 ceph-mon[32782]: pgmap v11584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:40:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:00 smithi196 ceph-mon[32572]: pgmap v11584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:40:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21117.228672 secs 2024-04-26T17:40:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:02 smithi110 ceph-mon[28069]: pgmap v11585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:40:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21117.228672 secs 2024-04-26T17:40:03.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:02 smithi193 ceph-mon[32782]: pgmap v11585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:40:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21117.228672 secs 2024-04-26T17:40:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:02 smithi196 ceph-mon[32572]: pgmap v11585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:40:04.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:40:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:40:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:40:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:40:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:40:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:40:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:40:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:40:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:40:05.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:04 smithi193 ceph-mon[32782]: pgmap v11586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:40:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:04 smithi193 ceph-mon[32782]: pgmap v11587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:04 smithi196 ceph-mon[32572]: pgmap v11586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:40:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:04 smithi196 ceph-mon[32572]: pgmap v11587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:04 smithi110 ceph-mon[28069]: pgmap v11586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:40:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:04 smithi110 ceph-mon[28069]: pgmap v11587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:07.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:06 smithi193 ceph-mon[32782]: pgmap v11588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:06 smithi196 ceph-mon[32572]: pgmap v11588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:06 smithi110 ceph-mon[28069]: pgmap v11588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21122.228808 secs 2024-04-26T17:40:08.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21122.228808 secs 2024-04-26T17:40:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21122.228808 secs 2024-04-26T17:40:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:08 smithi193 ceph-mon[32782]: pgmap v11589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:40:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:08 smithi196 ceph-mon[32572]: pgmap v11589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:40:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:08 smithi110 ceph-mon[28069]: pgmap v11589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T17:40:11.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:10 smithi193 ceph-mon[32782]: pgmap v11590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:10 smithi196 ceph-mon[32572]: pgmap v11590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:10 smithi110 ceph-mon[28069]: pgmap v11590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:12 smithi193 ceph-mon[32782]: pgmap v11591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 21127.228926 secs 2024-04-26T17:40:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:12 smithi193 ceph-mon[32782]: slow request 5763.706191 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:40:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:12 smithi196 ceph-mon[32572]: pgmap v11591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 21127.228926 secs 2024-04-26T17:40:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:12 smithi196 ceph-mon[32572]: slow request 5763.706191 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:40:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:12 smithi110 ceph-mon[28069]: pgmap v11591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:40:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 21127.228926 secs 2024-04-26T17:40:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:12 smithi110 ceph-mon[28069]: slow request 5763.706191 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:40:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:14 smithi193 ceph-mon[32782]: pgmap v11592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:40:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:14 smithi196 ceph-mon[32572]: pgmap v11592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:40:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:14 smithi110 ceph-mon[28069]: pgmap v11592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:40:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:16 smithi193 ceph-mon[32782]: pgmap v11593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:16 smithi196 ceph-mon[32572]: pgmap v11593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:16 smithi110 ceph-mon[28069]: pgmap v11593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21132.229042 secs 2024-04-26T17:40:18.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21132.229042 secs 2024-04-26T17:40:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21132.229042 secs 2024-04-26T17:40:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:18 smithi193 ceph-mon[32782]: pgmap v11594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:19.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:18 smithi196 ceph-mon[32572]: pgmap v11594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:18 smithi110 ceph-mon[28069]: pgmap v11594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:21.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:20 smithi193 ceph-mon[32782]: pgmap v11595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:21.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:20 smithi196 ceph-mon[32572]: pgmap v11595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:20 smithi110 ceph-mon[28069]: pgmap v11595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:22 smithi193 ceph-mon[32782]: pgmap v11596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21137.229178 secs 2024-04-26T17:40:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:22 smithi196 ceph-mon[32572]: pgmap v11596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21137.229178 secs 2024-04-26T17:40:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:22 smithi110 ceph-mon[28069]: pgmap v11596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21137.229178 secs 2024-04-26T17:40:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:24 smithi196 ceph-mon[32572]: pgmap v11597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:24 smithi110 ceph-mon[28069]: pgmap v11597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:24 smithi193 ceph-mon[32782]: pgmap v11597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:26 smithi196 ceph-mon[32572]: pgmap v11598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:26 smithi110 ceph-mon[28069]: pgmap v11598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:26 smithi193 ceph-mon[32782]: pgmap v11598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21142.229242 secs 2024-04-26T17:40:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21142.229242 secs 2024-04-26T17:40:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21142.229242 secs 2024-04-26T17:40:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:28 smithi196 ceph-mon[32572]: pgmap v11599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:28 smithi110 ceph-mon[28069]: pgmap v11599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:28 smithi193 ceph-mon[32782]: pgmap v11599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:30 smithi196 ceph-mon[32572]: pgmap v11600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:30 smithi110 ceph-mon[28069]: pgmap v11600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:31.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:30 smithi193 ceph-mon[32782]: pgmap v11600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:32 smithi196 ceph-mon[32572]: pgmap v11601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21147.229362 secs 2024-04-26T17:40:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:32 smithi110 ceph-mon[28069]: pgmap v11601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21147.229362 secs 2024-04-26T17:40:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:32 smithi193 ceph-mon[32782]: pgmap v11601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21147.229362 secs 2024-04-26T17:40:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:34 smithi196 ceph-mon[32572]: pgmap v11602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:34 smithi110 ceph-mon[28069]: pgmap v11602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:34 smithi193 ceph-mon[32782]: pgmap v11602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:36 smithi196 ceph-mon[32572]: pgmap v11603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:36 smithi110 ceph-mon[28069]: pgmap v11603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:36 smithi193 ceph-mon[32782]: pgmap v11603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:38.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21152.229459 secs 2024-04-26T17:40:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21152.229459 secs 2024-04-26T17:40:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21152.229459 secs 2024-04-26T17:40:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:38 smithi196 ceph-mon[32572]: pgmap v11604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:38 smithi110 ceph-mon[28069]: pgmap v11604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:38 smithi193 ceph-mon[32782]: pgmap v11604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:40 smithi196 ceph-mon[32572]: pgmap v11605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:40 smithi110 ceph-mon[28069]: pgmap v11605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:40 smithi193 ceph-mon[32782]: pgmap v11605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:42 smithi196 ceph-mon[32572]: pgmap v11606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21157.229600 secs 2024-04-26T17:40:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:42 smithi110 ceph-mon[28069]: pgmap v11606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21157.229600 secs 2024-04-26T17:40:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:42 smithi193 ceph-mon[32782]: pgmap v11606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21157.229600 secs 2024-04-26T17:40:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:44 smithi196 ceph-mon[32572]: pgmap v11607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:44 smithi110 ceph-mon[28069]: pgmap v11607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:44 smithi193 ceph-mon[32782]: pgmap v11607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:46 smithi196 ceph-mon[32572]: pgmap v11608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:46 smithi110 ceph-mon[28069]: pgmap v11608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:47.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:46 smithi193 ceph-mon[32782]: pgmap v11608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21162.229691 secs 2024-04-26T17:40:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21162.229691 secs 2024-04-26T17:40:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21162.229691 secs 2024-04-26T17:40:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:48 smithi196 ceph-mon[32572]: pgmap v11609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:48 smithi110 ceph-mon[28069]: pgmap v11609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:49.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:48 smithi193 ceph-mon[32782]: pgmap v11609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:50 smithi196 ceph-mon[32572]: pgmap v11610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:50 smithi110 ceph-mon[28069]: pgmap v11610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:50 smithi193 ceph-mon[32782]: pgmap v11610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:52 smithi196 ceph-mon[32572]: pgmap v11611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21167.229789 secs 2024-04-26T17:40:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:52 smithi110 ceph-mon[28069]: pgmap v11611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21167.229789 secs 2024-04-26T17:40:53.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:52 smithi193 ceph-mon[32782]: pgmap v11611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21167.229789 secs 2024-04-26T17:40:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:54 smithi196 ceph-mon[32572]: pgmap v11612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:54 smithi110 ceph-mon[28069]: pgmap v11612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:54 smithi193 ceph-mon[32782]: pgmap v11612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:40:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:56 smithi196 ceph-mon[32572]: pgmap v11613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:56 smithi110 ceph-mon[28069]: pgmap v11613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:56 smithi193 ceph-mon[32782]: pgmap v11613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21172.229886 secs 2024-04-26T17:40:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21172.229886 secs 2024-04-26T17:40:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21172.229886 secs 2024-04-26T17:40:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:40:58 smithi196 ceph-mon[32572]: pgmap v11614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:40:58 smithi110 ceph-mon[28069]: pgmap v11614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:40:59.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:40:58 smithi193 ceph-mon[32782]: pgmap v11614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:00 smithi196 ceph-mon[32572]: pgmap v11615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:00 smithi110 ceph-mon[28069]: pgmap v11615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:00 smithi193 ceph-mon[32782]: pgmap v11615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:02 smithi196 ceph-mon[32572]: pgmap v11616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:02 smithi110 ceph-mon[28069]: pgmap v11616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:02.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:02 smithi193 ceph-mon[32782]: pgmap v11616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:03 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21177.230000 secs 2024-04-26T17:41:03.539 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:03 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21177.230000 secs 2024-04-26T17:41:03.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:03 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21177.230000 secs 2024-04-26T17:41:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:04 smithi196 ceph-mon[32572]: pgmap v11617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:41:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:04 smithi110 ceph-mon[28069]: pgmap v11617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:41:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:04 smithi193 ceph-mon[32782]: pgmap v11617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:04.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:41:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:41:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:41:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:05 smithi196 ceph-mon[32572]: pgmap v11618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:41:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:05 smithi196 ceph-mon[32572]: pgmap v11619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:41:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:41:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:41:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:05 smithi110 ceph-mon[28069]: pgmap v11618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:41:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:05 smithi110 ceph-mon[28069]: pgmap v11619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:41:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:41:05.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:41:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:05 smithi193 ceph-mon[32782]: pgmap v11618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T17:41:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:05 smithi193 ceph-mon[32782]: pgmap v11619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:41:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21182.230114 secs 2024-04-26T17:41:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:07 smithi196 ceph-mon[32572]: pgmap v11620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21182.230114 secs 2024-04-26T17:41:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:07 smithi110 ceph-mon[28069]: pgmap v11620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:08.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21182.230114 secs 2024-04-26T17:41:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:07 smithi193 ceph-mon[32782]: pgmap v11620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:09 smithi196 ceph-mon[32572]: pgmap v11621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:09 smithi110 ceph-mon[28069]: pgmap v11621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:10.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:09 smithi193 ceph-mon[32782]: pgmap v11621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:11 smithi196 ceph-mon[32572]: pgmap v11622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:11 smithi110 ceph-mon[28069]: pgmap v11622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:11 smithi193 ceph-mon[32782]: pgmap v11622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:41:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21187.230252 secs 2024-04-26T17:41:13.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21187.230252 secs 2024-04-26T17:41:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21187.230252 secs 2024-04-26T17:41:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:13 smithi196 ceph-mon[32572]: pgmap v11623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 970 B/s rd, 2 op/s 2024-04-26T17:41:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:13 smithi110 ceph-mon[28069]: pgmap v11623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 970 B/s rd, 2 op/s 2024-04-26T17:41:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:13 smithi193 ceph-mon[32782]: pgmap v11623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 970 B/s rd, 2 op/s 2024-04-26T17:41:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:15 smithi196 ceph-mon[32572]: pgmap v11624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T17:41:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:15 smithi110 ceph-mon[28069]: pgmap v11624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T17:41:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:15 smithi193 ceph-mon[32782]: pgmap v11624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T17:41:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21192.230369 secs 2024-04-26T17:41:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:17 smithi193 ceph-mon[32782]: pgmap v11625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:41:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21192.230369 secs 2024-04-26T17:41:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:17 smithi196 ceph-mon[32572]: pgmap v11625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:41:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21192.230369 secs 2024-04-26T17:41:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:17 smithi110 ceph-mon[28069]: pgmap v11625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:41:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:19 smithi193 ceph-mon[32782]: pgmap v11626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:19 smithi196 ceph-mon[32572]: pgmap v11626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:19 smithi110 ceph-mon[28069]: pgmap v11626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:21 smithi193 ceph-mon[32782]: pgmap v11627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:41:22.262 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:21 smithi196 ceph-mon[32572]: pgmap v11627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:41:22.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:21 smithi110 ceph-mon[28069]: pgmap v11627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:41:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21197.230466 secs 2024-04-26T17:41:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21197.230466 secs 2024-04-26T17:41:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21197.230466 secs 2024-04-26T17:41:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:23 smithi193 ceph-mon[32782]: pgmap v11628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:23 smithi196 ceph-mon[32572]: pgmap v11628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:23 smithi110 ceph-mon[28069]: pgmap v11628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:25 smithi193 ceph-mon[32782]: pgmap v11629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:25 smithi196 ceph-mon[32572]: pgmap v11629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:25 smithi110 ceph-mon[28069]: pgmap v11629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21202.230606 secs 2024-04-26T17:41:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:27 smithi193 ceph-mon[32782]: pgmap v11630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21202.230606 secs 2024-04-26T17:41:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:27 smithi196 ceph-mon[32572]: pgmap v11630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21202.230606 secs 2024-04-26T17:41:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:27 smithi110 ceph-mon[28069]: pgmap v11630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:29 smithi193 ceph-mon[32782]: pgmap v11631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:29 smithi196 ceph-mon[32572]: pgmap v11631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:29 smithi110 ceph-mon[28069]: pgmap v11631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:31 smithi193 ceph-mon[32782]: pgmap v11632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:31 smithi196 ceph-mon[32572]: pgmap v11632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:31 smithi110 ceph-mon[28069]: pgmap v11632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21207.230717 secs 2024-04-26T17:41:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21207.230717 secs 2024-04-26T17:41:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21207.230717 secs 2024-04-26T17:41:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:33 smithi193 ceph-mon[32782]: pgmap v11633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:33 smithi196 ceph-mon[32572]: pgmap v11633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:33 smithi110 ceph-mon[28069]: pgmap v11633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:35 smithi196 ceph-mon[32572]: pgmap v11634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:35 smithi110 ceph-mon[28069]: pgmap v11634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:35 smithi193 ceph-mon[32782]: pgmap v11634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21212.230830 secs 2024-04-26T17:41:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:37 smithi196 ceph-mon[32572]: pgmap v11635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21212.230830 secs 2024-04-26T17:41:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:37 smithi110 ceph-mon[28069]: pgmap v11635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21212.230830 secs 2024-04-26T17:41:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:37 smithi193 ceph-mon[32782]: pgmap v11635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:39 smithi196 ceph-mon[32572]: pgmap v11636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:39 smithi110 ceph-mon[28069]: pgmap v11636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:39 smithi193 ceph-mon[32782]: pgmap v11636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:41 smithi196 ceph-mon[32572]: pgmap v11637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:41 smithi110 ceph-mon[28069]: pgmap v11637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:41 smithi193 ceph-mon[32782]: pgmap v11637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:43.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21217.230939 secs 2024-04-26T17:41:43.396 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21217.230939 secs 2024-04-26T17:41:43.396 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21217.230939 secs 2024-04-26T17:41:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:43 smithi196 ceph-mon[32572]: pgmap v11638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:43 smithi110 ceph-mon[28069]: pgmap v11638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:43 smithi193 ceph-mon[32782]: pgmap v11638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:45 smithi196 ceph-mon[32572]: pgmap v11639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:45 smithi110 ceph-mon[28069]: pgmap v11639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:45 smithi193 ceph-mon[32782]: pgmap v11639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21222.231043 secs 2024-04-26T17:41:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:47 smithi196 ceph-mon[32572]: pgmap v11640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21222.231043 secs 2024-04-26T17:41:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:47 smithi110 ceph-mon[28069]: pgmap v11640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21222.231043 secs 2024-04-26T17:41:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:47 smithi193 ceph-mon[32782]: pgmap v11640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:49 smithi196 ceph-mon[32572]: pgmap v11641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:49 smithi110 ceph-mon[28069]: pgmap v11641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:49 smithi193 ceph-mon[32782]: pgmap v11641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:51 smithi196 ceph-mon[32572]: pgmap v11642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:51 smithi110 ceph-mon[28069]: pgmap v11642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:51 smithi193 ceph-mon[32782]: pgmap v11642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21227.231163 secs 2024-04-26T17:41:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21227.231163 secs 2024-04-26T17:41:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21227.231163 secs 2024-04-26T17:41:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:53 smithi196 ceph-mon[32572]: pgmap v11643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:53 smithi110 ceph-mon[28069]: pgmap v11643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:53 smithi193 ceph-mon[32782]: pgmap v11643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:41:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:55 smithi196 ceph-mon[32572]: pgmap v11644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:55 smithi110 ceph-mon[28069]: pgmap v11644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:55 smithi193 ceph-mon[32782]: pgmap v11644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21232.231239 secs 2024-04-26T17:41:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:57 smithi196 ceph-mon[32572]: pgmap v11645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21232.231239 secs 2024-04-26T17:41:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:57 smithi110 ceph-mon[28069]: pgmap v11645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:41:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21232.231239 secs 2024-04-26T17:41:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:57 smithi193 ceph-mon[32782]: pgmap v11645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:41:59 smithi196 ceph-mon[32572]: pgmap v11646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:41:59 smithi110 ceph-mon[28069]: pgmap v11646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:41:59 smithi193 ceph-mon[32782]: pgmap v11646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:01 smithi196 ceph-mon[32572]: pgmap v11647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:01 smithi110 ceph-mon[28069]: pgmap v11647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:01 smithi193 ceph-mon[32782]: pgmap v11647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21237.231374 secs 2024-04-26T17:42:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21237.231374 secs 2024-04-26T17:42:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21237.231374 secs 2024-04-26T17:42:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:03 smithi196 ceph-mon[32572]: pgmap v11648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:03 smithi110 ceph-mon[28069]: pgmap v11648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:03 smithi193 ceph-mon[32782]: pgmap v11648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:42:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:42:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:42:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:05 smithi196 ceph-mon[32572]: pgmap v11649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:06.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:05 smithi110 ceph-mon[28069]: pgmap v11649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:05 smithi193 ceph-mon[32782]: pgmap v11649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:42:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:42:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:42:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:42:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:42:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:42:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:42:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:42:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:42:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:07 smithi196 ceph-mon[32572]: pgmap v11650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T17:42:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:07 smithi196 ceph-mon[32572]: pgmap v11651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21242.231502 secs 2024-04-26T17:42:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:07 smithi110 ceph-mon[28069]: pgmap v11650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T17:42:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:07 smithi110 ceph-mon[28069]: pgmap v11651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21242.231502 secs 2024-04-26T17:42:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:07 smithi193 ceph-mon[32782]: pgmap v11650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T17:42:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:07 smithi193 ceph-mon[32782]: pgmap v11651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21242.231502 secs 2024-04-26T17:42:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:09 smithi196 ceph-mon[32572]: pgmap v11652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:09 smithi110 ceph-mon[28069]: pgmap v11652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:09 smithi193 ceph-mon[32782]: pgmap v11652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:11 smithi193 ceph-mon[32782]: pgmap v11653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:11 smithi196 ceph-mon[32572]: pgmap v11653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:11 smithi110 ceph-mon[28069]: pgmap v11653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:13 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21247.231624 secs 2024-04-26T17:42:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:13 smithi193 ceph-mon[32782]: pgmap v11654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T17:42:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:13 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21247.231624 secs 2024-04-26T17:42:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:13 smithi196 ceph-mon[32572]: pgmap v11654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T17:42:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:13 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21247.231624 secs 2024-04-26T17:42:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:13 smithi110 ceph-mon[28069]: pgmap v11654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T17:42:15.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:15 smithi193 ceph-mon[32782]: pgmap v11655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:15 smithi196 ceph-mon[32572]: pgmap v11655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:15 smithi110 ceph-mon[28069]: pgmap v11655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:42:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:17 smithi193 ceph-mon[32782]: pgmap v11656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:42:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:17 smithi196 ceph-mon[32572]: pgmap v11656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:42:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:17 smithi110 ceph-mon[28069]: pgmap v11656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:42:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:18 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21252.231752 secs 2024-04-26T17:42:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:18 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21252.231752 secs 2024-04-26T17:42:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:18 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21252.231752 secs 2024-04-26T17:42:19.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:19 smithi193 ceph-mon[32782]: pgmap v11657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:19 smithi196 ceph-mon[32572]: pgmap v11657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:19 smithi110 ceph-mon[28069]: pgmap v11657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:19.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:42:19.878+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:42:19.879 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:42:19.878+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:42:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:42:19.879+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 165 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:42:19.880 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:42:19.879+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 165 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:42:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:21 smithi193 ceph-mon[32782]: pgmap v11658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:21 smithi196 ceph-mon[32572]: pgmap v11658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:21 smithi110 ceph-mon[28069]: pgmap v11658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:23.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:23 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21257.231876 secs 2024-04-26T17:42:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:23 smithi193 ceph-mon[32782]: pgmap v11659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:23 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21257.231876 secs 2024-04-26T17:42:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:23 smithi196 ceph-mon[32572]: pgmap v11659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:23 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21257.231876 secs 2024-04-26T17:42:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:23 smithi110 ceph-mon[28069]: pgmap v11659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:25.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:25 smithi193 ceph-mon[32782]: pgmap v11660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:25 smithi196 ceph-mon[32572]: pgmap v11660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:25 smithi110 ceph-mon[28069]: pgmap v11660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:27.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:27 smithi193 ceph-mon[32782]: pgmap v11661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:27 smithi196 ceph-mon[32572]: pgmap v11661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:27 smithi110 ceph-mon[28069]: pgmap v11661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:28.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:28 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21262.232017 secs 2024-04-26T17:42:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:28 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21262.232017 secs 2024-04-26T17:42:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:28 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21262.232017 secs 2024-04-26T17:42:29.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:29 smithi193 ceph-mon[32782]: pgmap v11662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:29 smithi196 ceph-mon[32572]: pgmap v11662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:29 smithi110 ceph-mon[28069]: pgmap v11662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:31.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:31 smithi193 ceph-mon[32782]: pgmap v11663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:31 smithi196 ceph-mon[32572]: pgmap v11663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:31 smithi110 ceph-mon[28069]: pgmap v11663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:33 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21267.232131 secs 2024-04-26T17:42:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:33 smithi196 ceph-mon[32572]: pgmap v11664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:33 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21267.232131 secs 2024-04-26T17:42:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:33 smithi110 ceph-mon[28069]: pgmap v11664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:33 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21267.232131 secs 2024-04-26T17:42:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:33 smithi193 ceph-mon[32782]: pgmap v11664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:35 smithi196 ceph-mon[32572]: pgmap v11665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:35 smithi110 ceph-mon[28069]: pgmap v11665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:35.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:35 smithi193 ceph-mon[32782]: pgmap v11665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:37 smithi196 ceph-mon[32572]: pgmap v11666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:37 smithi110 ceph-mon[28069]: pgmap v11666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:37.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:37 smithi193 ceph-mon[32782]: pgmap v11666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:38.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:38 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21272.232248 secs 2024-04-26T17:42:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:38 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21272.232248 secs 2024-04-26T17:42:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:38 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21272.232248 secs 2024-04-26T17:42:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:39 smithi196 ceph-mon[32572]: pgmap v11667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:39 smithi110 ceph-mon[28069]: pgmap v11667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:39.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:39 smithi193 ceph-mon[32782]: pgmap v11667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:41 smithi196 ceph-mon[32572]: pgmap v11668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:41 smithi110 ceph-mon[28069]: pgmap v11668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:41.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:41 smithi193 ceph-mon[32782]: pgmap v11668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:43.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:43 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21277.232324 secs 2024-04-26T17:42:43.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:43 smithi193 ceph-mon[32782]: pgmap v11669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:43 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21277.232324 secs 2024-04-26T17:42:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:43 smithi196 ceph-mon[32572]: pgmap v11669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:43 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21277.232324 secs 2024-04-26T17:42:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:43 smithi110 ceph-mon[28069]: pgmap v11669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:45 smithi196 ceph-mon[32572]: pgmap v11670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:45 smithi110 ceph-mon[28069]: pgmap v11670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:45 smithi193 ceph-mon[32782]: pgmap v11670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:47 smithi196 ceph-mon[32572]: pgmap v11671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21282.232468 secs 2024-04-26T17:42:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:47 smithi110 ceph-mon[28069]: pgmap v11671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21282.232468 secs 2024-04-26T17:42:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:47 smithi193 ceph-mon[32782]: pgmap v11671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21282.232468 secs 2024-04-26T17:42:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:49 smithi196 ceph-mon[32572]: pgmap v11672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:49 smithi110 ceph-mon[28069]: pgmap v11672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:49 smithi193 ceph-mon[32782]: pgmap v11672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:51 smithi196 ceph-mon[32572]: pgmap v11673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:51 smithi110 ceph-mon[28069]: pgmap v11673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:51.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:51 smithi193 ceph-mon[32782]: pgmap v11673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21287.232558 secs 2024-04-26T17:42:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21287.232558 secs 2024-04-26T17:42:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21287.232558 secs 2024-04-26T17:42:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:53 smithi196 ceph-mon[32572]: pgmap v11674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:53 smithi110 ceph-mon[28069]: pgmap v11674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:53 smithi193 ceph-mon[32782]: pgmap v11674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:55 smithi196 ceph-mon[32572]: pgmap v11675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:55 smithi110 ceph-mon[28069]: pgmap v11675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:55.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:55 smithi193 ceph-mon[32782]: pgmap v11675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:57 smithi196 ceph-mon[32572]: pgmap v11676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21292.232674 secs 2024-04-26T17:42:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:57 smithi110 ceph-mon[28069]: pgmap v11676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21292.232674 secs 2024-04-26T17:42:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:57 smithi193 ceph-mon[32782]: pgmap v11676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:42:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21292.232674 secs 2024-04-26T17:42:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:42:59 smithi196 ceph-mon[32572]: pgmap v11677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:42:59 smithi110 ceph-mon[28069]: pgmap v11677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:42:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:42:59 smithi193 ceph-mon[32782]: pgmap v11677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:01 smithi196 ceph-mon[32572]: pgmap v11678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:01 smithi110 ceph-mon[28069]: pgmap v11678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:01 smithi193 ceph-mon[32782]: pgmap v11678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21297.232766 secs 2024-04-26T17:43:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21297.232766 secs 2024-04-26T17:43:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21297.232766 secs 2024-04-26T17:43:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:03 smithi196 ceph-mon[32572]: pgmap v11679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:03 smithi110 ceph-mon[28069]: pgmap v11679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:03 smithi193 ceph-mon[32782]: pgmap v11679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:43:04.888+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:43:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:43:04.888+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:43:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:43:04.888+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 166 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:43:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:43:04.888+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 166 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:43:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:05 smithi196 ceph-mon[32572]: pgmap v11680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:05 smithi110 ceph-mon[28069]: pgmap v11680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:05 smithi193 ceph-mon[32782]: pgmap v11680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:07 smithi196 ceph-mon[32572]: pgmap v11681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21302.232866 secs 2024-04-26T17:43:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:43:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:43:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:43:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:07 smithi110 ceph-mon[28069]: pgmap v11681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21302.232866 secs 2024-04-26T17:43:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:43:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:43:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:07 smithi193 ceph-mon[32782]: pgmap v11681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21302.232866 secs 2024-04-26T17:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:43:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:09 smithi196 ceph-mon[32572]: pgmap v11682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:43:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:43:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:09 smithi196 ceph-mon[32572]: pgmap v11683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T17:43:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:09 smithi196 ceph-mon[32572]: pgmap v11684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:43:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:09 smithi110 ceph-mon[28069]: pgmap v11682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:43:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:43:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:09 smithi110 ceph-mon[28069]: pgmap v11683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T17:43:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:09 smithi110 ceph-mon[28069]: pgmap v11684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:43:09.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:09 smithi193 ceph-mon[32782]: pgmap v11682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:09.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:43:09.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:43:09.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:09 smithi193 ceph-mon[32782]: pgmap v11683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T17:43:09.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:09 smithi193 ceph-mon[32782]: pgmap v11684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:09.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:43:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:11 smithi196 ceph-mon[32572]: pgmap v11685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:11 smithi110 ceph-mon[28069]: pgmap v11685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:12.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:11 smithi193 ceph-mon[32782]: pgmap v11685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21307.232973 secs 2024-04-26T17:43:13.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21307.232973 secs 2024-04-26T17:43:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21307.232973 secs 2024-04-26T17:43:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:13 smithi196 ceph-mon[32572]: pgmap v11686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:13 smithi110 ceph-mon[28069]: pgmap v11686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:14.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:13 smithi193 ceph-mon[32782]: pgmap v11686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:15 smithi196 ceph-mon[32572]: pgmap v11687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:15 smithi110 ceph-mon[28069]: pgmap v11687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:15 smithi193 ceph-mon[32782]: pgmap v11687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21312.233037 secs 2024-04-26T17:43:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:17 smithi196 ceph-mon[32572]: pgmap v11688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T17:43:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21312.233037 secs 2024-04-26T17:43:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:17 smithi110 ceph-mon[28069]: pgmap v11688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T17:43:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21312.233037 secs 2024-04-26T17:43:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:17 smithi193 ceph-mon[32782]: pgmap v11688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T17:43:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:19 smithi196 ceph-mon[32572]: pgmap v11689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:43:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:19 smithi110 ceph-mon[28069]: pgmap v11689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:43:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:19 smithi193 ceph-mon[32782]: pgmap v11689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:43:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:21 smithi110 ceph-mon[28069]: pgmap v11690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:21 smithi193 ceph-mon[32782]: pgmap v11690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:21 smithi196 ceph-mon[32572]: pgmap v11690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21317.233175 secs 2024-04-26T17:43:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21317.233175 secs 2024-04-26T17:43:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21317.233175 secs 2024-04-26T17:43:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:23 smithi110 ceph-mon[28069]: pgmap v11691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:23 smithi193 ceph-mon[32782]: pgmap v11691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:23 smithi196 ceph-mon[32572]: pgmap v11691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:25 smithi110 ceph-mon[28069]: pgmap v11692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:25 smithi193 ceph-mon[32782]: pgmap v11692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:25 smithi196 ceph-mon[32572]: pgmap v11692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21322.233311 secs 2024-04-26T17:43:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:27 smithi110 ceph-mon[28069]: pgmap v11693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21322.233311 secs 2024-04-26T17:43:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:27 smithi193 ceph-mon[32782]: pgmap v11693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21322.233311 secs 2024-04-26T17:43:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:27 smithi196 ceph-mon[32572]: pgmap v11693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:29 smithi110 ceph-mon[28069]: pgmap v11694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:30.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:29 smithi193 ceph-mon[32782]: pgmap v11694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:29 smithi196 ceph-mon[32572]: pgmap v11694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:31 smithi110 ceph-mon[28069]: pgmap v11695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:31 smithi193 ceph-mon[32782]: pgmap v11695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:31 smithi196 ceph-mon[32572]: pgmap v11695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21327.233430 secs 2024-04-26T17:43:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21327.233430 secs 2024-04-26T17:43:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21327.233430 secs 2024-04-26T17:43:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:33 smithi193 ceph-mon[32782]: pgmap v11696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:33 smithi196 ceph-mon[32572]: pgmap v11696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:33 smithi110 ceph-mon[28069]: pgmap v11696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:36.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:35 smithi193 ceph-mon[32782]: pgmap v11697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:35 smithi196 ceph-mon[32572]: pgmap v11697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:35 smithi110 ceph-mon[28069]: pgmap v11697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21332.233546 secs 2024-04-26T17:43:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:37 smithi193 ceph-mon[32782]: pgmap v11698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21332.233546 secs 2024-04-26T17:43:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:37 smithi196 ceph-mon[32572]: pgmap v11698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21332.233546 secs 2024-04-26T17:43:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:37 smithi110 ceph-mon[28069]: pgmap v11698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:40.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:39 smithi110 ceph-mon[28069]: pgmap v11699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:39 smithi193 ceph-mon[32782]: pgmap v11699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:39 smithi196 ceph-mon[32572]: pgmap v11699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:41 smithi193 ceph-mon[32782]: pgmap v11700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:41 smithi196 ceph-mon[32572]: pgmap v11700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:41 smithi110 ceph-mon[28069]: pgmap v11700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21337.233683 secs 2024-04-26T17:43:43.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21337.233683 secs 2024-04-26T17:43:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21337.233683 secs 2024-04-26T17:43:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:43 smithi193 ceph-mon[32782]: pgmap v11701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:43 smithi196 ceph-mon[32572]: pgmap v11701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:43 smithi110 ceph-mon[28069]: pgmap v11701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:45 smithi193 ceph-mon[32782]: pgmap v11702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:45 smithi196 ceph-mon[32572]: pgmap v11702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:45 smithi110 ceph-mon[28069]: pgmap v11702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21342.233804 secs 2024-04-26T17:43:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:47 smithi193 ceph-mon[32782]: pgmap v11703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21342.233804 secs 2024-04-26T17:43:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:47 smithi196 ceph-mon[32572]: pgmap v11703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21342.233804 secs 2024-04-26T17:43:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:47 smithi110 ceph-mon[28069]: pgmap v11703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:49 smithi193 ceph-mon[32782]: pgmap v11704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:49 smithi196 ceph-mon[32572]: pgmap v11704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:49 smithi110 ceph-mon[28069]: pgmap v11704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:52.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:51 smithi193 ceph-mon[32782]: pgmap v11705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:51 smithi196 ceph-mon[32572]: pgmap v11705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:51 smithi110 ceph-mon[28069]: pgmap v11705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21347.233927 secs 2024-04-26T17:43:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21347.233927 secs 2024-04-26T17:43:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21347.233927 secs 2024-04-26T17:43:54.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:53 smithi193 ceph-mon[32782]: pgmap v11706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:53 smithi196 ceph-mon[32572]: pgmap v11706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:53 smithi110 ceph-mon[28069]: pgmap v11706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:43:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:55 smithi196 ceph-mon[32572]: pgmap v11707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:55 smithi110 ceph-mon[28069]: pgmap v11707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:55 smithi193 ceph-mon[32782]: pgmap v11707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21352.234049 secs 2024-04-26T17:43:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:57 smithi196 ceph-mon[32572]: pgmap v11708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21352.234049 secs 2024-04-26T17:43:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:57 smithi110 ceph-mon[28069]: pgmap v11708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:43:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21352.234049 secs 2024-04-26T17:43:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:57 smithi193 ceph-mon[32782]: pgmap v11708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:43:59 smithi196 ceph-mon[32572]: pgmap v11709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:43:59 smithi110 ceph-mon[28069]: pgmap v11709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:43:59 smithi193 ceph-mon[32782]: pgmap v11709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:01 smithi196 ceph-mon[32572]: pgmap v11710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:01 smithi110 ceph-mon[28069]: pgmap v11710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:01 smithi193 ceph-mon[32782]: pgmap v11710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21357.234166 secs 2024-04-26T17:44:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21357.234166 secs 2024-04-26T17:44:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21357.234166 secs 2024-04-26T17:44:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:03 smithi196 ceph-mon[32572]: pgmap v11711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:03 smithi110 ceph-mon[28069]: pgmap v11711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:03 smithi193 ceph-mon[32782]: pgmap v11711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:05 smithi196 ceph-mon[32572]: pgmap v11712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:05 smithi110 ceph-mon[28069]: pgmap v11712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:05 smithi193 ceph-mon[32782]: pgmap v11712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21362.234284 secs 2024-04-26T17:44:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:07 smithi196 ceph-mon[32572]: pgmap v11713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21362.234284 secs 2024-04-26T17:44:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:07 smithi110 ceph-mon[28069]: pgmap v11713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21362.234284 secs 2024-04-26T17:44:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:07 smithi193 ceph-mon[32782]: pgmap v11713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:09 smithi196 ceph-mon[32572]: pgmap v11714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:44:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:09 smithi110 ceph-mon[28069]: pgmap v11714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:44:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:09 smithi193 ceph-mon[32782]: pgmap v11714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:44:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:10.928 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:44:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:44:10.665+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:44:10.929 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:44:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:44:10.665+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:44:10.929 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:44:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:44:10.665+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:44:10.929 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:44:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:44:10.665+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:44:10.929 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:44:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:44:10.665+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:44:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:44:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:44:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:44:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:44:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:44:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:44:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:44:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:11 smithi196 ceph-mon[32572]: pgmap v11715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T17:44:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:11 smithi196 ceph-mon[32572]: pgmap v11716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:44:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:11 smithi110 ceph-mon[28069]: pgmap v11715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T17:44:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:11 smithi110 ceph-mon[28069]: pgmap v11716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:44:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:11 smithi193 ceph-mon[32782]: pgmap v11715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T17:44:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:11 smithi193 ceph-mon[32782]: pgmap v11716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:44:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21367.234401 secs 2024-04-26T17:44:13.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21367.234401 secs 2024-04-26T17:44:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21367.234401 secs 2024-04-26T17:44:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:13 smithi196 ceph-mon[32572]: pgmap v11717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-04-26T17:44:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:13 smithi110 ceph-mon[28069]: pgmap v11717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-04-26T17:44:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:13 smithi193 ceph-mon[32782]: pgmap v11717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2 op/s 2024-04-26T17:44:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:15 smithi196 ceph-mon[32572]: pgmap v11718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T17:44:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:15 smithi110 ceph-mon[28069]: pgmap v11718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T17:44:16.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:15 smithi193 ceph-mon[32782]: pgmap v11718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T17:44:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:17 smithi196 ceph-mon[32572]: pgmap v11719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T17:44:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21372.234523 secs 2024-04-26T17:44:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:17 smithi110 ceph-mon[28069]: pgmap v11719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T17:44:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21372.234523 secs 2024-04-26T17:44:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:17 smithi193 ceph-mon[32782]: pgmap v11719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T17:44:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21372.234523 secs 2024-04-26T17:44:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:19 smithi196 ceph-mon[32572]: pgmap v11720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T17:44:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:19 smithi110 ceph-mon[28069]: pgmap v11720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T17:44:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:19 smithi193 ceph-mon[32782]: pgmap v11720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T17:44:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:21 smithi196 ceph-mon[32572]: pgmap v11721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T17:44:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:21 smithi110 ceph-mon[28069]: pgmap v11721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T17:44:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:21 smithi193 ceph-mon[32782]: pgmap v11721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T17:44:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21377.234645 secs 2024-04-26T17:44:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21377.234645 secs 2024-04-26T17:44:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21377.234645 secs 2024-04-26T17:44:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:23 smithi196 ceph-mon[32572]: pgmap v11722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:44:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:23 smithi110 ceph-mon[28069]: pgmap v11722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:44:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:23 smithi193 ceph-mon[32782]: pgmap v11722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T17:44:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:25 smithi196 ceph-mon[32572]: pgmap v11723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:44:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:25 smithi110 ceph-mon[28069]: pgmap v11723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:44:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:25 smithi193 ceph-mon[32782]: pgmap v11723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T17:44:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:27 smithi196 ceph-mon[32572]: pgmap v11724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21382.234776 secs 2024-04-26T17:44:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:27 smithi110 ceph-mon[28069]: pgmap v11724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21382.234776 secs 2024-04-26T17:44:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:27 smithi193 ceph-mon[32782]: pgmap v11724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21382.234776 secs 2024-04-26T17:44:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:29 smithi196 ceph-mon[32572]: pgmap v11725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:29 smithi110 ceph-mon[28069]: pgmap v11725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:29 smithi193 ceph-mon[32782]: pgmap v11725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:32 smithi196 ceph-mon[32572]: pgmap v11726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:32 smithi110 ceph-mon[28069]: pgmap v11726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:32 smithi193 ceph-mon[32782]: pgmap v11726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:33 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21387.234898 secs 2024-04-26T17:44:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:33 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21387.234898 secs 2024-04-26T17:44:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:33 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21387.234898 secs 2024-04-26T17:44:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:34 smithi110 ceph-mon[28069]: pgmap v11727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:34 smithi193 ceph-mon[32782]: pgmap v11727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:34 smithi196 ceph-mon[32572]: pgmap v11727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:36 smithi110 ceph-mon[28069]: pgmap v11728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:44:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:36 smithi193 ceph-mon[32782]: pgmap v11728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:44:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:36 smithi196 ceph-mon[32572]: pgmap v11728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:44:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:38 smithi110 ceph-mon[28069]: pgmap v11729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:38 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21392.234965 secs 2024-04-26T17:44:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:38 smithi193 ceph-mon[32782]: pgmap v11729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:38 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21392.234965 secs 2024-04-26T17:44:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:38 smithi196 ceph-mon[32572]: pgmap v11729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:38 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21392.234965 secs 2024-04-26T17:44:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:40 smithi110 ceph-mon[28069]: pgmap v11730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:40 smithi193 ceph-mon[32782]: pgmap v11730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:40 smithi196 ceph-mon[32572]: pgmap v11730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:42 smithi110 ceph-mon[28069]: pgmap v11731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:42 smithi193 ceph-mon[32782]: pgmap v11731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:42 smithi196 ceph-mon[32572]: pgmap v11731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:43 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21397.235152 secs 2024-04-26T17:44:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:43 smithi110 ceph-mon[28069]: pgmap v11732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:43 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21397.235152 secs 2024-04-26T17:44:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:43 smithi193 ceph-mon[32782]: pgmap v11732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:43.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:43 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21397.235152 secs 2024-04-26T17:44:43.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:43 smithi196 ceph-mon[32572]: pgmap v11732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:45 smithi196 ceph-mon[32572]: pgmap v11733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:44:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:45 smithi110 ceph-mon[28069]: pgmap v11733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:44:45.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:45 smithi193 ceph-mon[32782]: pgmap v11733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:44:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:47 smithi196 ceph-mon[32572]: pgmap v11734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:47 smithi110 ceph-mon[28069]: pgmap v11734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:47.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:47 smithi193 ceph-mon[32782]: pgmap v11734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:48 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21402.235249 secs 2024-04-26T17:44:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:48 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21402.235249 secs 2024-04-26T17:44:48.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:48 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21402.235249 secs 2024-04-26T17:44:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:49 smithi196 ceph-mon[32572]: pgmap v11735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:49 smithi110 ceph-mon[28069]: pgmap v11735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:49.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:49 smithi193 ceph-mon[32782]: pgmap v11735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:51 smithi196 ceph-mon[32572]: pgmap v11736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:51 smithi110 ceph-mon[28069]: pgmap v11736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:51 smithi193 ceph-mon[32782]: pgmap v11736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21407.235368 secs 2024-04-26T17:44:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21407.235368 secs 2024-04-26T17:44:52.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21407.235368 secs 2024-04-26T17:44:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:53 smithi196 ceph-mon[32572]: pgmap v11737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:53 smithi110 ceph-mon[28069]: pgmap v11737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:53 smithi193 ceph-mon[32782]: pgmap v11737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:55 smithi196 ceph-mon[32572]: pgmap v11738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:44:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:55 smithi110 ceph-mon[28069]: pgmap v11738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:44:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:55 smithi193 ceph-mon[32782]: pgmap v11738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:44:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:57 smithi196 ceph-mon[32572]: pgmap v11739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21412.235465 secs 2024-04-26T17:44:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:57 smithi110 ceph-mon[28069]: pgmap v11739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21412.235465 secs 2024-04-26T17:44:57.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:57 smithi193 ceph-mon[32782]: pgmap v11739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:44:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21412.235465 secs 2024-04-26T17:44:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:44:59 smithi196 ceph-mon[32572]: pgmap v11740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:44:59 smithi110 ceph-mon[28069]: pgmap v11740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:44:59.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:44:59 smithi193 ceph-mon[32782]: pgmap v11740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:01 smithi196 ceph-mon[32572]: pgmap v11741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:01 smithi110 ceph-mon[28069]: pgmap v11741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:01.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:01 smithi193 ceph-mon[32782]: pgmap v11741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21417.235602 secs 2024-04-26T17:45:02.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21417.235602 secs 2024-04-26T17:45:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21417.235602 secs 2024-04-26T17:45:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:03 smithi110 ceph-mon[28069]: pgmap v11742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:03.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:03 smithi193 ceph-mon[32782]: pgmap v11742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:03 smithi196 ceph-mon[32572]: pgmap v11742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:05 smithi110 ceph-mon[28069]: pgmap v11743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:05.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:05 smithi193 ceph-mon[32782]: pgmap v11743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:05 smithi196 ceph-mon[32572]: pgmap v11743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:07 smithi110 ceph-mon[28069]: pgmap v11744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:45:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21422.235721 secs 2024-04-26T17:45:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:07 smithi193 ceph-mon[32782]: pgmap v11744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:45:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21422.235721 secs 2024-04-26T17:45:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:07 smithi196 ceph-mon[32572]: pgmap v11744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:45:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21422.235721 secs 2024-04-26T17:45:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:09 smithi110 ceph-mon[28069]: pgmap v11745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:09.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:09 smithi193 ceph-mon[32782]: pgmap v11745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:09 smithi196 ceph-mon[32572]: pgmap v11745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:11.675 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:11 smithi193 ceph-mon[32782]: pgmap v11746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:45:11.675 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:45:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:11 smithi196 ceph-mon[32572]: pgmap v11746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:45:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:45:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:11 smithi110 ceph-mon[28069]: pgmap v11746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:45:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:45:12.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:12 smithi193 ceph-mon[32782]: 19 slow requests, 1 included below; oldest blocked for > 21427.235788 secs 2024-04-26T17:45:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:12 smithi193 ceph-mon[32782]: slow request 5763.621613 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:45:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:12 smithi196 ceph-mon[32572]: 19 slow requests, 1 included below; oldest blocked for > 21427.235788 secs 2024-04-26T17:45:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:12 smithi196 ceph-mon[32572]: slow request 5763.621613 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:45:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:12 smithi110 ceph-mon[28069]: 19 slow requests, 1 included below; oldest blocked for > 21427.235788 secs 2024-04-26T17:45:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:12 smithi110 ceph-mon[28069]: slow request 5763.621613 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: pgmap v11747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: pgmap v11747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: pgmap v11747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:45:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:45:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:45:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:14 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:45:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:14 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:45:15.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:45:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:14 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:45:16.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:15 smithi193 ceph-mon[32782]: pgmap v11748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:45:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:15 smithi196 ceph-mon[32572]: pgmap v11748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:45:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:15 smithi110 ceph-mon[28069]: pgmap v11748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:45:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:45:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:45:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:45:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:45:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:45:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:17 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:45:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:17 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:45:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:17 smithi193 ceph-mon[32782]: pgmap v11749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 870 B/s rd, 1 op/s 2024-04-26T17:45:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:17 smithi193 ceph-mon[32782]: pgmap v11750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21432.235905 secs 2024-04-26T17:45:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:17 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:45:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:17 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:45:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:17 smithi196 ceph-mon[32572]: pgmap v11749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 870 B/s rd, 1 op/s 2024-04-26T17:45:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:17 smithi196 ceph-mon[32572]: pgmap v11750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21432.235905 secs 2024-04-26T17:45:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:17 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:45:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:17 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:45:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:17 smithi110 ceph-mon[28069]: pgmap v11749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 870 B/s rd, 1 op/s 2024-04-26T17:45:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:17 smithi110 ceph-mon[28069]: pgmap v11750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21432.235905 secs 2024-04-26T17:45:19.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:45:19.909+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:45:19.909 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:45:19.910+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063a0 con 0x7f261c104b50 2024-04-26T17:45:19.910 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:45:19.911+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 167 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063a0 con 0x55db1be4fdd0 2024-04-26T17:45:19.911 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:45:19.911+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 167 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:45:20.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:19 smithi193 ceph-mon[32782]: pgmap v11751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:19 smithi196 ceph-mon[32572]: pgmap v11751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:19 smithi110 ceph-mon[28069]: pgmap v11751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:22.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:21 smithi193 ceph-mon[32782]: pgmap v11752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:21 smithi196 ceph-mon[32572]: pgmap v11752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:21 smithi110 ceph-mon[28069]: pgmap v11752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:23.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21437.236039 secs 2024-04-26T17:45:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21437.236039 secs 2024-04-26T17:45:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21437.236039 secs 2024-04-26T17:45:24.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:23 smithi193 ceph-mon[32782]: pgmap v11753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 524 B/s rd, 1 op/s 2024-04-26T17:45:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:23 smithi196 ceph-mon[32572]: pgmap v11753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 524 B/s rd, 1 op/s 2024-04-26T17:45:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:23 smithi110 ceph-mon[28069]: pgmap v11753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 524 B/s rd, 1 op/s 2024-04-26T17:45:26.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:25 smithi193 ceph-mon[32782]: pgmap v11754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:25 smithi196 ceph-mon[32572]: pgmap v11754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:25 smithi110 ceph-mon[28069]: pgmap v11754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:45:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:27 smithi193 ceph-mon[32782]: pgmap v11755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:45:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21442.236160 secs 2024-04-26T17:45:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:27 smithi196 ceph-mon[32572]: pgmap v11755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:45:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21442.236160 secs 2024-04-26T17:45:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:27 smithi110 ceph-mon[28069]: pgmap v11755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:45:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21442.236160 secs 2024-04-26T17:45:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:29 smithi193 ceph-mon[32782]: pgmap v11756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:29 smithi196 ceph-mon[32572]: pgmap v11756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:29 smithi110 ceph-mon[28069]: pgmap v11756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:31 smithi193 ceph-mon[32782]: pgmap v11757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:31 smithi196 ceph-mon[32572]: pgmap v11757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:31 smithi110 ceph-mon[28069]: pgmap v11757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21447.236277 secs 2024-04-26T17:45:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21447.236277 secs 2024-04-26T17:45:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21447.236277 secs 2024-04-26T17:45:34.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:33 smithi193 ceph-mon[32782]: pgmap v11758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:33 smithi196 ceph-mon[32572]: pgmap v11758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:33 smithi110 ceph-mon[28069]: pgmap v11758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:35 smithi196 ceph-mon[32572]: pgmap v11759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:35 smithi110 ceph-mon[28069]: pgmap v11759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:35 smithi193 ceph-mon[32782]: pgmap v11759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:37 smithi196 ceph-mon[32572]: pgmap v11760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21452.236401 secs 2024-04-26T17:45:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:37 smithi110 ceph-mon[28069]: pgmap v11760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21452.236401 secs 2024-04-26T17:45:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:37 smithi193 ceph-mon[32782]: pgmap v11760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21452.236401 secs 2024-04-26T17:45:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:39 smithi196 ceph-mon[32572]: pgmap v11761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:39 smithi110 ceph-mon[28069]: pgmap v11761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:39 smithi193 ceph-mon[32782]: pgmap v11761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:41 smithi196 ceph-mon[32572]: pgmap v11762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:41 smithi110 ceph-mon[28069]: pgmap v11762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:41 smithi193 ceph-mon[32782]: pgmap v11762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:43.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21457.236498 secs 2024-04-26T17:45:43.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21457.236498 secs 2024-04-26T17:45:43.289 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21457.236498 secs 2024-04-26T17:45:44.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:43 smithi110 ceph-mon[28069]: pgmap v11763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:43 smithi196 ceph-mon[32572]: pgmap v11763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:43 smithi193 ceph-mon[32782]: pgmap v11763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:45 smithi196 ceph-mon[32572]: pgmap v11764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:45 smithi110 ceph-mon[28069]: pgmap v11764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:45 smithi193 ceph-mon[32782]: pgmap v11764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:47 smithi196 ceph-mon[32572]: pgmap v11765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21462.236611 secs 2024-04-26T17:45:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:47 smithi110 ceph-mon[28069]: pgmap v11765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21462.236611 secs 2024-04-26T17:45:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:47 smithi193 ceph-mon[32782]: pgmap v11765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21462.236611 secs 2024-04-26T17:45:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:49 smithi196 ceph-mon[32572]: pgmap v11766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:49 smithi110 ceph-mon[28069]: pgmap v11766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:49 smithi193 ceph-mon[32782]: pgmap v11766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:51 smithi196 ceph-mon[32572]: pgmap v11767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:51 smithi110 ceph-mon[28069]: pgmap v11767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:51 smithi193 ceph-mon[32782]: pgmap v11767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:53.180 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21467.236758 secs 2024-04-26T17:45:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21467.236758 secs 2024-04-26T17:45:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21467.236758 secs 2024-04-26T17:45:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:53 smithi196 ceph-mon[32572]: pgmap v11768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:53 smithi110 ceph-mon[28069]: pgmap v11768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:53 smithi193 ceph-mon[32782]: pgmap v11768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:55 smithi196 ceph-mon[32572]: pgmap v11769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:55 smithi110 ceph-mon[28069]: pgmap v11769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:55 smithi193 ceph-mon[32782]: pgmap v11769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:45:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:57 smithi196 ceph-mon[32572]: pgmap v11770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21472.236900 secs 2024-04-26T17:45:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:57 smithi110 ceph-mon[28069]: pgmap v11770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21472.236900 secs 2024-04-26T17:45:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:57 smithi193 ceph-mon[32782]: pgmap v11770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:45:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21472.236900 secs 2024-04-26T17:46:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:45:59 smithi196 ceph-mon[32572]: pgmap v11771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:45:59 smithi110 ceph-mon[28069]: pgmap v11771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:45:59 smithi193 ceph-mon[32782]: pgmap v11771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:01 smithi196 ceph-mon[32572]: pgmap v11772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:01 smithi110 ceph-mon[28069]: pgmap v11772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:02.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:01 smithi193 ceph-mon[32782]: pgmap v11772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21477.237012 secs 2024-04-26T17:46:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21477.237012 secs 2024-04-26T17:46:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21477.237012 secs 2024-04-26T17:46:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:03 smithi196 ceph-mon[32572]: pgmap v11773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:03 smithi110 ceph-mon[28069]: pgmap v11773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:03 smithi193 ceph-mon[32782]: pgmap v11773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:05 smithi196 ceph-mon[32572]: pgmap v11774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:05 smithi110 ceph-mon[28069]: pgmap v11774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:05 smithi193 ceph-mon[32782]: pgmap v11774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:07 smithi196 ceph-mon[32572]: pgmap v11775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21482.237136 secs 2024-04-26T17:46:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:07 smithi110 ceph-mon[28069]: pgmap v11775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21482.237136 secs 2024-04-26T17:46:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:07 smithi193 ceph-mon[32782]: pgmap v11775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21482.237136 secs 2024-04-26T17:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:09 smithi196 ceph-mon[32572]: pgmap v11776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:09 smithi110 ceph-mon[28069]: pgmap v11776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:09 smithi193 ceph-mon[32782]: pgmap v11776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:11 smithi196 ceph-mon[32572]: pgmap v11777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:11 smithi110 ceph-mon[28069]: pgmap v11777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:12.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:11 smithi193 ceph-mon[32782]: pgmap v11777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21487.237256 secs 2024-04-26T17:46:13.271 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21487.237256 secs 2024-04-26T17:46:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21487.237256 secs 2024-04-26T17:46:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:13 smithi196 ceph-mon[32572]: pgmap v11778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:14.287 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:13 smithi193 ceph-mon[32782]: pgmap v11778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:13 smithi110 ceph-mon[28069]: pgmap v11778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:16 smithi196 ceph-mon[32572]: pgmap v11779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:16 smithi110 ceph-mon[28069]: pgmap v11779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:16 smithi193 ceph-mon[32782]: pgmap v11779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:46:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:46:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:46:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:18 smithi110 ceph-mon[28069]: pgmap v11780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:18 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21492.237351 secs 2024-04-26T17:46:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:46:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:46:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:46:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:18 smithi193 ceph-mon[32782]: pgmap v11780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:18 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21492.237351 secs 2024-04-26T17:46:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:46:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:46:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:46:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:18 smithi196 ceph-mon[32572]: pgmap v11780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:18 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21492.237351 secs 2024-04-26T17:46:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:46:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:46:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:46:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:19 smithi110 ceph-mon[28069]: pgmap v11781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:46:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:19 smithi110 ceph-mon[28069]: pgmap v11782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:19 smithi193 ceph-mon[32782]: pgmap v11781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:46:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:19 smithi193 ceph-mon[32782]: pgmap v11782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:19 smithi196 ceph-mon[32572]: pgmap v11781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:46:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:19 smithi196 ceph-mon[32572]: pgmap v11782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:21 smithi110 ceph-mon[28069]: pgmap v11783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:21.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:21 smithi193 ceph-mon[32782]: pgmap v11783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:21 smithi196 ceph-mon[32572]: pgmap v11783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:23 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21497.237499 secs 2024-04-26T17:46:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:23 smithi110 ceph-mon[28069]: pgmap v11784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:23 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21497.237499 secs 2024-04-26T17:46:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:23 smithi193 ceph-mon[32782]: pgmap v11784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:23 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21497.237499 secs 2024-04-26T17:46:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:23 smithi196 ceph-mon[32572]: pgmap v11784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:25 smithi193 ceph-mon[32782]: pgmap v11785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:25 smithi196 ceph-mon[32572]: pgmap v11785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:25 smithi110 ceph-mon[28069]: pgmap v11785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:27 smithi193 ceph-mon[32782]: pgmap v11786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:27 smithi196 ceph-mon[32572]: pgmap v11786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:27 smithi110 ceph-mon[28069]: pgmap v11786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:46:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:28 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21502.237616 secs 2024-04-26T17:46:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:28 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21502.237616 secs 2024-04-26T17:46:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:28 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21502.237616 secs 2024-04-26T17:46:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:29 smithi193 ceph-mon[32782]: pgmap v11787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:46:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:29 smithi196 ceph-mon[32572]: pgmap v11787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:46:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:29 smithi110 ceph-mon[28069]: pgmap v11787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:46:30.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:30 smithi193 ceph-mon[32782]: pgmap v11788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:30 smithi196 ceph-mon[32572]: pgmap v11788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:30 smithi110 ceph-mon[28069]: pgmap v11788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21507.237699 secs 2024-04-26T17:46:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:32 smithi110 ceph-mon[28069]: pgmap v11789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21507.237699 secs 2024-04-26T17:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:32 smithi193 ceph-mon[32782]: pgmap v11789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21507.237699 secs 2024-04-26T17:46:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:32 smithi196 ceph-mon[32572]: pgmap v11789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:34 smithi110 ceph-mon[28069]: pgmap v11790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:35.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:34 smithi193 ceph-mon[32782]: pgmap v11790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:34 smithi196 ceph-mon[32572]: pgmap v11790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:36 smithi110 ceph-mon[28069]: pgmap v11791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:37.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:36 smithi193 ceph-mon[32782]: pgmap v11791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:36 smithi196 ceph-mon[32572]: pgmap v11791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21512.237823 secs 2024-04-26T17:46:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21512.237823 secs 2024-04-26T17:46:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21512.237823 secs 2024-04-26T17:46:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:38 smithi110 ceph-mon[28069]: pgmap v11792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:38 smithi193 ceph-mon[32782]: pgmap v11792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:38 smithi196 ceph-mon[32572]: pgmap v11792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:40 smithi110 ceph-mon[28069]: pgmap v11793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:41.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:40 smithi193 ceph-mon[32782]: pgmap v11793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:40 smithi196 ceph-mon[32572]: pgmap v11793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21517.237956 secs 2024-04-26T17:46:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:42 smithi110 ceph-mon[28069]: pgmap v11794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:43.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21517.237956 secs 2024-04-26T17:46:43.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:42 smithi196 ceph-mon[32572]: pgmap v11794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21517.237956 secs 2024-04-26T17:46:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:42 smithi193 ceph-mon[32782]: pgmap v11794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:44 smithi193 ceph-mon[32782]: pgmap v11795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:44 smithi196 ceph-mon[32572]: pgmap v11795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:44 smithi110 ceph-mon[28069]: pgmap v11795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:46 smithi193 ceph-mon[32782]: pgmap v11796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:46 smithi196 ceph-mon[32572]: pgmap v11796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:46 smithi110 ceph-mon[28069]: pgmap v11796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21522.238067 secs 2024-04-26T17:46:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21522.238067 secs 2024-04-26T17:46:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21522.238067 secs 2024-04-26T17:46:49.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:48 smithi193 ceph-mon[32782]: pgmap v11797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:48 smithi196 ceph-mon[32572]: pgmap v11797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:48 smithi110 ceph-mon[28069]: pgmap v11797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:51.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:50 smithi193 ceph-mon[32782]: pgmap v11798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:50 smithi196 ceph-mon[32572]: pgmap v11798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:50 smithi110 ceph-mon[28069]: pgmap v11798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21527.238184 secs 2024-04-26T17:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:52 smithi193 ceph-mon[32782]: pgmap v11799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21527.238184 secs 2024-04-26T17:46:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:52 smithi196 ceph-mon[32572]: pgmap v11799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21527.238184 secs 2024-04-26T17:46:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:52 smithi110 ceph-mon[28069]: pgmap v11799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:54 smithi193 ceph-mon[32782]: pgmap v11800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:54 smithi196 ceph-mon[32572]: pgmap v11800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:54 smithi110 ceph-mon[28069]: pgmap v11800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:56 smithi193 ceph-mon[32782]: pgmap v11801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:56 smithi196 ceph-mon[32572]: pgmap v11801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:56 smithi110 ceph-mon[28069]: pgmap v11801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:46:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21532.238300 secs 2024-04-26T17:46:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21532.238300 secs 2024-04-26T17:46:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21532.238300 secs 2024-04-26T17:46:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:46:58 smithi193 ceph-mon[32782]: pgmap v11802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:46:58 smithi196 ceph-mon[32572]: pgmap v11802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:46:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:46:58 smithi110 ceph-mon[28069]: pgmap v11802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:00 smithi193 ceph-mon[32782]: pgmap v11803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:00 smithi196 ceph-mon[32572]: pgmap v11803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:00 smithi110 ceph-mon[28069]: pgmap v11803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21537.238444 secs 2024-04-26T17:47:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:02 smithi193 ceph-mon[32782]: pgmap v11804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21537.238444 secs 2024-04-26T17:47:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:02 smithi196 ceph-mon[32572]: pgmap v11804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21537.238444 secs 2024-04-26T17:47:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:02 smithi110 ceph-mon[28069]: pgmap v11804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:04 smithi193 ceph-mon[32782]: pgmap v11805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:04 smithi196 ceph-mon[32572]: pgmap v11805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:04 smithi110 ceph-mon[28069]: pgmap v11805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:06 smithi193 ceph-mon[32782]: pgmap v11806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:06 smithi196 ceph-mon[32572]: pgmap v11806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:06 smithi110 ceph-mon[28069]: pgmap v11806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21542.238506 secs 2024-04-26T17:47:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21542.238506 secs 2024-04-26T17:47:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21542.238506 secs 2024-04-26T17:47:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:08 smithi196 ceph-mon[32572]: pgmap v11807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:08 smithi110 ceph-mon[28069]: pgmap v11807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:08 smithi193 ceph-mon[32782]: pgmap v11807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:10 smithi196 ceph-mon[32572]: pgmap v11808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:10 smithi110 ceph-mon[28069]: pgmap v11808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:10 smithi193 ceph-mon[32782]: pgmap v11808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:12 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21547.238625 secs 2024-04-26T17:47:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:12 smithi196 ceph-mon[32572]: pgmap v11809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:12 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21547.238625 secs 2024-04-26T17:47:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:12 smithi110 ceph-mon[28069]: pgmap v11809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:12 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21547.238625 secs 2024-04-26T17:47:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:12 smithi193 ceph-mon[32782]: pgmap v11809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:15.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:14 smithi193 ceph-mon[32782]: pgmap v11810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:14 smithi196 ceph-mon[32572]: pgmap v11810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:14 smithi110 ceph-mon[28069]: pgmap v11810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:16 smithi196 ceph-mon[32572]: pgmap v11811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:16 smithi110 ceph-mon[28069]: pgmap v11811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:17.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:16 smithi193 ceph-mon[32782]: pgmap v11811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21552.238687 secs 2024-04-26T17:47:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21552.238687 secs 2024-04-26T17:47:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21552.238687 secs 2024-04-26T17:47:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:18 smithi196 ceph-mon[32572]: pgmap v11812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:47:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:18 smithi110 ceph-mon[28069]: pgmap v11812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:47:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:18 smithi193 ceph-mon[32782]: pgmap v11812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:47:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:47:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:47:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:47:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:47:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:47:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:47:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:47:20.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:47:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:47:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:20 smithi196 ceph-mon[32572]: pgmap v11813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:47:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:20 smithi196 ceph-mon[32572]: pgmap v11814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:20 smithi110 ceph-mon[28069]: pgmap v11813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:47:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:20 smithi110 ceph-mon[28069]: pgmap v11814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:20 smithi193 ceph-mon[32782]: pgmap v11813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:47:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:20 smithi193 ceph-mon[32782]: pgmap v11814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:22 smithi196 ceph-mon[32572]: pgmap v11815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21557.238797 secs 2024-04-26T17:47:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:22 smithi110 ceph-mon[28069]: pgmap v11815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21557.238797 secs 2024-04-26T17:47:23.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:22 smithi193 ceph-mon[32782]: pgmap v11815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21557.238797 secs 2024-04-26T17:47:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:24 smithi196 ceph-mon[32572]: pgmap v11816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:24 smithi110 ceph-mon[28069]: pgmap v11816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:24 smithi193 ceph-mon[32782]: pgmap v11816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:26 smithi196 ceph-mon[32572]: pgmap v11817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:26 smithi110 ceph-mon[28069]: pgmap v11817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:27.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:26 smithi193 ceph-mon[32782]: pgmap v11817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:47:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21562.238907 secs 2024-04-26T17:47:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21562.238907 secs 2024-04-26T17:47:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21562.238907 secs 2024-04-26T17:47:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:28 smithi196 ceph-mon[32572]: pgmap v11818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:47:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:28 smithi110 ceph-mon[28069]: pgmap v11818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:47:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:28 smithi193 ceph-mon[32782]: pgmap v11818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:47:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:30 smithi196 ceph-mon[32572]: pgmap v11819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:47:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:30 smithi110 ceph-mon[28069]: pgmap v11819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:47:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:30 smithi193 ceph-mon[32782]: pgmap v11819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:47:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:32 smithi196 ceph-mon[32572]: pgmap v11820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21567.239024 secs 2024-04-26T17:47:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:32 smithi110 ceph-mon[28069]: pgmap v11820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21567.239024 secs 2024-04-26T17:47:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:32 smithi193 ceph-mon[32782]: pgmap v11820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21567.239024 secs 2024-04-26T17:47:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:34 smithi196 ceph-mon[32572]: pgmap v11821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:34 smithi110 ceph-mon[28069]: pgmap v11821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:34 smithi193 ceph-mon[32782]: pgmap v11821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:36 smithi196 ceph-mon[32572]: pgmap v11822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:36 smithi110 ceph-mon[28069]: pgmap v11822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:36 smithi193 ceph-mon[32782]: pgmap v11822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21572.239085 secs 2024-04-26T17:47:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21572.239085 secs 2024-04-26T17:47:38.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21572.239085 secs 2024-04-26T17:47:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:38 smithi196 ceph-mon[32572]: pgmap v11823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:38 smithi110 ceph-mon[28069]: pgmap v11823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:38 smithi193 ceph-mon[32782]: pgmap v11823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:40 smithi196 ceph-mon[32572]: pgmap v11824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:47:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:40 smithi110 ceph-mon[28069]: pgmap v11824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:47:41.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:40 smithi193 ceph-mon[32782]: pgmap v11824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:47:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:42 smithi196 ceph-mon[32572]: pgmap v11825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21577.239148 secs 2024-04-26T17:47:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:42 smithi110 ceph-mon[28069]: pgmap v11825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21577.239148 secs 2024-04-26T17:47:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:42 smithi193 ceph-mon[32782]: pgmap v11825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21577.239148 secs 2024-04-26T17:47:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:45 smithi196 ceph-mon[32572]: pgmap v11826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:45 smithi110 ceph-mon[28069]: pgmap v11826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:45 smithi193 ceph-mon[32782]: pgmap v11826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:47 smithi110 ceph-mon[28069]: pgmap v11827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:47 smithi193 ceph-mon[32782]: pgmap v11827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:47 smithi196 ceph-mon[32572]: pgmap v11827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:48 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21582.239301 secs 2024-04-26T17:47:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:48 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21582.239301 secs 2024-04-26T17:47:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:48 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21582.239301 secs 2024-04-26T17:47:49.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:49 smithi193 ceph-mon[32782]: pgmap v11828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:49 smithi110 ceph-mon[28069]: pgmap v11828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:49 smithi196 ceph-mon[32572]: pgmap v11828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:51 smithi110 ceph-mon[28069]: pgmap v11829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:47:51.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:51 smithi193 ceph-mon[32782]: pgmap v11829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:47:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:51 smithi196 ceph-mon[32572]: pgmap v11829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:47:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:53 smithi110 ceph-mon[28069]: pgmap v11830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:53 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21587.239423 secs 2024-04-26T17:47:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:53 smithi193 ceph-mon[32782]: pgmap v11830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:53 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21587.239423 secs 2024-04-26T17:47:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:53 smithi196 ceph-mon[32572]: pgmap v11830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:53 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21587.239423 secs 2024-04-26T17:47:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:55 smithi110 ceph-mon[28069]: pgmap v11831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:55 smithi193 ceph-mon[32782]: pgmap v11831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:55 smithi196 ceph-mon[32572]: pgmap v11831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:57 smithi110 ceph-mon[28069]: pgmap v11832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:57.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:57 smithi193 ceph-mon[32782]: pgmap v11832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:57 smithi196 ceph-mon[32572]: pgmap v11832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:47:58.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:58 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21592.239547 secs 2024-04-26T17:47:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:58 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21592.239547 secs 2024-04-26T17:47:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:58 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21592.239547 secs 2024-04-26T17:47:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:47:59 smithi193 ceph-mon[32782]: pgmap v11833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:47:59 smithi196 ceph-mon[32572]: pgmap v11833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:47:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:47:59 smithi110 ceph-mon[28069]: pgmap v11833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:01 smithi193 ceph-mon[32782]: pgmap v11834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:48:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:01 smithi196 ceph-mon[32572]: pgmap v11834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:48:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:01 smithi110 ceph-mon[28069]: pgmap v11834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:48:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:03 smithi193 ceph-mon[32782]: pgmap v11835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:03 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21597.239673 secs 2024-04-26T17:48:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:03 smithi196 ceph-mon[32572]: pgmap v11835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:03 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21597.239673 secs 2024-04-26T17:48:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:03 smithi110 ceph-mon[28069]: pgmap v11835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:03 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21597.239673 secs 2024-04-26T17:48:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:05 smithi193 ceph-mon[32782]: pgmap v11836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:05 smithi196 ceph-mon[32572]: pgmap v11836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:05 smithi110 ceph-mon[28069]: pgmap v11836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:07 smithi193 ceph-mon[32782]: pgmap v11837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:07 smithi196 ceph-mon[32572]: pgmap v11837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:07 smithi110 ceph-mon[28069]: pgmap v11837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:08 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21602.239803 secs 2024-04-26T17:48:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:08 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21602.239803 secs 2024-04-26T17:48:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:08 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21602.239803 secs 2024-04-26T17:48:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:09 smithi193 ceph-mon[32782]: pgmap v11838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:09 smithi196 ceph-mon[32572]: pgmap v11838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:09 smithi110 ceph-mon[28069]: pgmap v11838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:10 smithi193 ceph-mon[32782]: pgmap v11839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:48:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:10 smithi196 ceph-mon[32572]: pgmap v11839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:48:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:10 smithi110 ceph-mon[28069]: pgmap v11839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:48:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:12 smithi193 ceph-mon[32782]: pgmap v11840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:12 smithi196 ceph-mon[32572]: pgmap v11840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:12 smithi110 ceph-mon[28069]: pgmap v11840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:13.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:13 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21607.239930 secs 2024-04-26T17:48:13.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:13 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21607.239930 secs 2024-04-26T17:48:13.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:13 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21607.239930 secs 2024-04-26T17:48:14.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:14 smithi193 ceph-mon[32782]: pgmap v11841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:14 smithi196 ceph-mon[32572]: pgmap v11841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:14 smithi110 ceph-mon[28069]: pgmap v11841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.437+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T17:48:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.437+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T17:48:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.437+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:48:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.437+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T17:48:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.438+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614042040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614042040 comp rx=0 tx=0).stop 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.439+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.440+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:16.442+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:16 smithi193 ceph-mon[32782]: pgmap v11842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:16 smithi196 ceph-mon[32572]: pgmap v11842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:16 smithi110 ceph-mon[28069]: pgmap v11842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:18 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21612.240003 secs 2024-04-26T17:48:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:18 smithi193 ceph-mon[32782]: pgmap v11843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:18 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21612.240003 secs 2024-04-26T17:48:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:18 smithi196 ceph-mon[32572]: pgmap v11843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:18 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21612.240003 secs 2024-04-26T17:48:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:18 smithi110 ceph-mon[28069]: pgmap v11843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:19.939+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:48:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:19.939+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:48:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:19.940+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 168 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:48:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:48:19.940+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 168 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:48:20.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:20 smithi193 ceph-mon[32782]: pgmap v11844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:48:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:48:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:20 smithi196 ceph-mon[32572]: pgmap v11844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:48:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:48:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:20 smithi110 ceph-mon[28069]: pgmap v11844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:48:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:48:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:48:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:48:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:21 smithi196 ceph-mon[32572]: pgmap v11845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:48:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:21 smithi196 ceph-mon[32572]: pgmap v11846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:48:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:48:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:48:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:21 smithi110 ceph-mon[28069]: pgmap v11845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:48:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:21 smithi110 ceph-mon[28069]: pgmap v11846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:48:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:48:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:48:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:21 smithi193 ceph-mon[32782]: pgmap v11845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:48:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:21 smithi193 ceph-mon[32782]: pgmap v11846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:48:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21617.240137 secs 2024-04-26T17:48:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21617.240137 secs 2024-04-26T17:48:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21617.240137 secs 2024-04-26T17:48:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:23 smithi110 ceph-mon[28069]: pgmap v11847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:23 smithi193 ceph-mon[32782]: pgmap v11847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:23 smithi196 ceph-mon[32572]: pgmap v11847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:25 smithi196 ceph-mon[32572]: pgmap v11848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:25 smithi110 ceph-mon[28069]: pgmap v11848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:26.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:25 smithi193 ceph-mon[32782]: pgmap v11848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:27 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21622.240252 secs 2024-04-26T17:48:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:27 smithi196 ceph-mon[32572]: pgmap v11849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:48:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:27 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21622.240252 secs 2024-04-26T17:48:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:27 smithi110 ceph-mon[28069]: pgmap v11849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:48:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:27 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21622.240252 secs 2024-04-26T17:48:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:27 smithi193 ceph-mon[32782]: pgmap v11849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:48:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:29 smithi196 ceph-mon[32572]: pgmap v11850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:29 smithi110 ceph-mon[28069]: pgmap v11850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:29 smithi193 ceph-mon[32782]: pgmap v11850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:48:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:31 smithi196 ceph-mon[32572]: pgmap v11851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:48:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:31 smithi110 ceph-mon[28069]: pgmap v11851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:48:32.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:31 smithi193 ceph-mon[32782]: pgmap v11851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:48:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:32 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21627.240375 secs 2024-04-26T17:48:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:32 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21627.240375 secs 2024-04-26T17:48:33.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:32 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21627.240375 secs 2024-04-26T17:48:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:33 smithi196 ceph-mon[32572]: pgmap v11852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:33 smithi110 ceph-mon[28069]: pgmap v11852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:34.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:33 smithi193 ceph-mon[32782]: pgmap v11852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:35 smithi196 ceph-mon[32572]: pgmap v11853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:35 smithi110 ceph-mon[28069]: pgmap v11853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:36.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:35 smithi193 ceph-mon[32782]: pgmap v11853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21632.240453 secs 2024-04-26T17:48:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:37 smithi196 ceph-mon[32572]: pgmap v11854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21632.240453 secs 2024-04-26T17:48:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:37 smithi110 ceph-mon[28069]: pgmap v11854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21632.240453 secs 2024-04-26T17:48:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:37 smithi193 ceph-mon[32782]: pgmap v11854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:39 smithi196 ceph-mon[32572]: pgmap v11855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:39 smithi110 ceph-mon[28069]: pgmap v11855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:39 smithi193 ceph-mon[32782]: pgmap v11855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:41 smithi196 ceph-mon[32572]: pgmap v11856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:41 smithi110 ceph-mon[28069]: pgmap v11856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:41 smithi193 ceph-mon[32782]: pgmap v11856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:42 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21637.240595 secs 2024-04-26T17:48:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:42 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21637.240595 secs 2024-04-26T17:48:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:42 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21637.240595 secs 2024-04-26T17:48:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:43 smithi196 ceph-mon[32572]: pgmap v11857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:43 smithi110 ceph-mon[28069]: pgmap v11857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:43 smithi193 ceph-mon[32782]: pgmap v11857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:45 smithi196 ceph-mon[32572]: pgmap v11858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:45 smithi110 ceph-mon[28069]: pgmap v11858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:45 smithi193 ceph-mon[32782]: pgmap v11858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21642.240712 secs 2024-04-26T17:48:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:47 smithi196 ceph-mon[32572]: pgmap v11859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21642.240712 secs 2024-04-26T17:48:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:47 smithi110 ceph-mon[28069]: pgmap v11859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:48.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21642.240712 secs 2024-04-26T17:48:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:47 smithi193 ceph-mon[32782]: pgmap v11859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:49 smithi196 ceph-mon[32572]: pgmap v11860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:49 smithi110 ceph-mon[28069]: pgmap v11860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:49 smithi193 ceph-mon[32782]: pgmap v11860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:51 smithi196 ceph-mon[32572]: pgmap v11861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:51 smithi110 ceph-mon[28069]: pgmap v11861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:52.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:51 smithi193 ceph-mon[32782]: pgmap v11861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21647.240828 secs 2024-04-26T17:48:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21647.240828 secs 2024-04-26T17:48:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21647.240828 secs 2024-04-26T17:48:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:53 smithi196 ceph-mon[32572]: pgmap v11862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:53 smithi110 ceph-mon[28069]: pgmap v11862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:53 smithi193 ceph-mon[32782]: pgmap v11862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:48:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:55 smithi196 ceph-mon[32572]: pgmap v11863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:55 smithi110 ceph-mon[28069]: pgmap v11863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:55 smithi193 ceph-mon[32782]: pgmap v11863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21652.240893 secs 2024-04-26T17:48:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:57 smithi196 ceph-mon[32572]: pgmap v11864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21652.240893 secs 2024-04-26T17:48:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:57 smithi110 ceph-mon[28069]: pgmap v11864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:48:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21652.240893 secs 2024-04-26T17:48:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:57 smithi193 ceph-mon[32782]: pgmap v11864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:48:59 smithi196 ceph-mon[32572]: pgmap v11865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:48:59 smithi110 ceph-mon[28069]: pgmap v11865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:48:59 smithi193 ceph-mon[32782]: pgmap v11865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:02 smithi196 ceph-mon[32572]: pgmap v11866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:02 smithi110 ceph-mon[28069]: pgmap v11866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:02 smithi193 ceph-mon[32782]: pgmap v11866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:03 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21657.241002 secs 2024-04-26T17:49:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:03 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21657.241002 secs 2024-04-26T17:49:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:03 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21657.241002 secs 2024-04-26T17:49:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:04 smithi110 ceph-mon[28069]: pgmap v11867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:04 smithi193 ceph-mon[32782]: pgmap v11867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:04 smithi196 ceph-mon[32572]: pgmap v11867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:06 smithi110 ceph-mon[28069]: pgmap v11868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:06 smithi193 ceph-mon[32782]: pgmap v11868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:06 smithi196 ceph-mon[32572]: pgmap v11868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:08 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21662.241099 secs 2024-04-26T17:49:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:08 smithi110 ceph-mon[28069]: pgmap v11869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:08 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21662.241099 secs 2024-04-26T17:49:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:08 smithi193 ceph-mon[32782]: pgmap v11869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:08 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21662.241099 secs 2024-04-26T17:49:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:08 smithi196 ceph-mon[32572]: pgmap v11869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:10 smithi110 ceph-mon[28069]: pgmap v11870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:10 smithi193 ceph-mon[32782]: pgmap v11870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:10 smithi196 ceph-mon[32572]: pgmap v11870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:11.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:49:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:49:10.736+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:49:11.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:49:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:49:10.736+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:49:11.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:49:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:49:10.736+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:49:11.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:49:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:49:10.736+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:49:11.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:49:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:49:10.736+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:49:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:12 smithi110 ceph-mon[28069]: pgmap v11871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:12 smithi193 ceph-mon[32782]: pgmap v11871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:12 smithi196 ceph-mon[32572]: pgmap v11871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:13 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21667.241222 secs 2024-04-26T17:49:13.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:13 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21667.241222 secs 2024-04-26T17:49:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:13 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21667.241222 secs 2024-04-26T17:49:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:14 smithi193 ceph-mon[32782]: pgmap v11872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:49:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:14 smithi196 ceph-mon[32572]: pgmap v11872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:49:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:14 smithi110 ceph-mon[28069]: pgmap v11872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:49:16.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:16 smithi193 ceph-mon[32782]: pgmap v11873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:49:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:16 smithi196 ceph-mon[32572]: pgmap v11873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:49:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:16 smithi110 ceph-mon[28069]: pgmap v11873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:49:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:18 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21672.241340 secs 2024-04-26T17:49:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:18 smithi193 ceph-mon[32782]: pgmap v11874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:49:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:18 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21672.241340 secs 2024-04-26T17:49:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:18 smithi196 ceph-mon[32572]: pgmap v11874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:49:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:18 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21672.241340 secs 2024-04-26T17:49:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:18 smithi110 ceph-mon[28069]: pgmap v11874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:49:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:20 smithi193 ceph-mon[32782]: pgmap v11875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:49:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:20 smithi196 ceph-mon[32572]: pgmap v11875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:49:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:20 smithi110 ceph-mon[28069]: pgmap v11875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:49:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:22 smithi193 ceph-mon[32782]: pgmap v11876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:49:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:22 smithi196 ceph-mon[32572]: pgmap v11876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:49:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:22 smithi110 ceph-mon[28069]: pgmap v11876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:49:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:23 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21677.241409 secs 2024-04-26T17:49:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:49:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:23 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21677.241409 secs 2024-04-26T17:49:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:49:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:23 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21677.241409 secs 2024-04-26T17:49:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:49:24.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:24 smithi193 ceph-mon[32782]: pgmap v11877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 177 B/s wr, 2 op/s 2024-04-26T17:49:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:24 smithi193 ceph-mon[32782]: pgmap v11878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:49:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:24 smithi196 ceph-mon[32572]: pgmap v11877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 177 B/s wr, 2 op/s 2024-04-26T17:49:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:24 smithi196 ceph-mon[32572]: pgmap v11878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:49:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:24 smithi110 ceph-mon[28069]: pgmap v11877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 177 B/s wr, 2 op/s 2024-04-26T17:49:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:24 smithi110 ceph-mon[28069]: pgmap v11878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:49:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:26 smithi193 ceph-mon[32782]: pgmap v11879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:26 smithi196 ceph-mon[32572]: pgmap v11879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:26 smithi110 ceph-mon[28069]: pgmap v11879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:28 smithi193 ceph-mon[32782]: pgmap v11880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:28 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21682.241544 secs 2024-04-26T17:49:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:28 smithi196 ceph-mon[32572]: pgmap v11880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:28 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21682.241544 secs 2024-04-26T17:49:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:28 smithi110 ceph-mon[28069]: pgmap v11880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:28 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21682.241544 secs 2024-04-26T17:49:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:29 smithi193 ceph-mon[32782]: pgmap v11881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:29 smithi196 ceph-mon[32572]: pgmap v11881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:29 smithi110 ceph-mon[28069]: pgmap v11881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:31 smithi196 ceph-mon[32572]: pgmap v11882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:31 smithi110 ceph-mon[28069]: pgmap v11882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:31 smithi193 ceph-mon[32782]: pgmap v11882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:49:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:33 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21687.241682 secs 2024-04-26T17:49:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:33 smithi196 ceph-mon[32572]: pgmap v11883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:49:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:33 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21687.241682 secs 2024-04-26T17:49:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:33 smithi110 ceph-mon[28069]: pgmap v11883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:49:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:33 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21687.241682 secs 2024-04-26T17:49:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:33 smithi193 ceph-mon[32782]: pgmap v11883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:49:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:35 smithi196 ceph-mon[32572]: pgmap v11884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:49:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:35 smithi110 ceph-mon[28069]: pgmap v11884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:49:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:35 smithi193 ceph-mon[32782]: pgmap v11884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:49:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:37 smithi196 ceph-mon[32572]: pgmap v11885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:37 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21692.241797 secs 2024-04-26T17:49:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:37 smithi110 ceph-mon[28069]: pgmap v11885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:37 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21692.241797 secs 2024-04-26T17:49:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:37 smithi193 ceph-mon[32782]: pgmap v11885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:37 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21692.241797 secs 2024-04-26T17:49:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:40 smithi196 ceph-mon[32572]: pgmap v11886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:40 smithi110 ceph-mon[28069]: pgmap v11886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:40.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:40 smithi193 ceph-mon[32782]: pgmap v11886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:42 smithi110 ceph-mon[28069]: pgmap v11887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:42.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:42 smithi193 ceph-mon[32782]: pgmap v11887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:42 smithi196 ceph-mon[32572]: pgmap v11887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:43 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21697.241882 secs 2024-04-26T17:49:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:43 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21697.241882 secs 2024-04-26T17:49:43.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:43 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21697.241882 secs 2024-04-26T17:49:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:44 smithi110 ceph-mon[28069]: pgmap v11888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:44.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:44 smithi193 ceph-mon[32782]: pgmap v11888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:44 smithi196 ceph-mon[32572]: pgmap v11888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:46 smithi110 ceph-mon[28069]: pgmap v11889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:49:46.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:46 smithi193 ceph-mon[32782]: pgmap v11889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:49:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:46 smithi196 ceph-mon[32572]: pgmap v11889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:49:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:48 smithi110 ceph-mon[28069]: pgmap v11890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:48 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21702.242004 secs 2024-04-26T17:49:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:48 smithi193 ceph-mon[32782]: pgmap v11890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:48 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21702.242004 secs 2024-04-26T17:49:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:48 smithi196 ceph-mon[32572]: pgmap v11890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:48 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21702.242004 secs 2024-04-26T17:49:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:50 smithi110 ceph-mon[28069]: pgmap v11891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:50.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:50 smithi193 ceph-mon[32782]: pgmap v11891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:50 smithi196 ceph-mon[32572]: pgmap v11891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:52 smithi193 ceph-mon[32782]: pgmap v11892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:52 smithi196 ceph-mon[32572]: pgmap v11892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:52 smithi110 ceph-mon[28069]: pgmap v11892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:53 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21707.242120 secs 2024-04-26T17:49:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:53 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21707.242120 secs 2024-04-26T17:49:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:53 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21707.242120 secs 2024-04-26T17:49:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:54 smithi193 ceph-mon[32782]: pgmap v11893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:54 smithi196 ceph-mon[32572]: pgmap v11893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:54 smithi110 ceph-mon[28069]: pgmap v11893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:49:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:56 smithi193 ceph-mon[32782]: pgmap v11894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:49:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:56 smithi196 ceph-mon[32572]: pgmap v11894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:49:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:56 smithi110 ceph-mon[28069]: pgmap v11894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:49:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:58 smithi193 ceph-mon[32782]: pgmap v11895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:49:58 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21712.242242 secs 2024-04-26T17:49:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:58 smithi196 ceph-mon[32572]: pgmap v11895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:49:58 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21712.242242 secs 2024-04-26T17:49:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:58 smithi110 ceph-mon[28069]: pgmap v11895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:49:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:49:58 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21712.242242 secs 2024-04-26T17:50:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:00 smithi193 ceph-mon[32782]: pgmap v11896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:50:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:00 smithi196 ceph-mon[32572]: pgmap v11896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:50:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:00 smithi110 ceph-mon[28069]: pgmap v11896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T17:50:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:02 smithi193 ceph-mon[32782]: pgmap v11897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:02 smithi196 ceph-mon[32572]: pgmap v11897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:02 smithi110 ceph-mon[28069]: pgmap v11897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:03 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21717.242376 secs 2024-04-26T17:50:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:03 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21717.242376 secs 2024-04-26T17:50:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:03 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21717.242376 secs 2024-04-26T17:50:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:04 smithi193 ceph-mon[32782]: pgmap v11898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:04 smithi196 ceph-mon[32572]: pgmap v11898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:04 smithi110 ceph-mon[28069]: pgmap v11898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:06 smithi193 ceph-mon[32782]: pgmap v11899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:50:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:06 smithi196 ceph-mon[32572]: pgmap v11899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:50:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:06 smithi110 ceph-mon[28069]: pgmap v11899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:50:08.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:08 smithi193 ceph-mon[32782]: pgmap v11900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:08 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21722.242500 secs 2024-04-26T17:50:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:08 smithi196 ceph-mon[32572]: pgmap v11900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:08 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21722.242500 secs 2024-04-26T17:50:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:08 smithi110 ceph-mon[28069]: pgmap v11900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:08 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21722.242500 secs 2024-04-26T17:50:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:10 smithi193 ceph-mon[32782]: pgmap v11901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:10 smithi196 ceph-mon[32572]: pgmap v11901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:10 smithi110 ceph-mon[28069]: pgmap v11901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:11 smithi193 ceph-mon[32782]: pgmap v11902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:11 smithi196 ceph-mon[32572]: pgmap v11902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:11 smithi110 ceph-mon[28069]: pgmap v11902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:13 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21727.242619 secs 2024-04-26T17:50:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:13 smithi196 ceph-mon[32572]: pgmap v11903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:13 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21727.242619 secs 2024-04-26T17:50:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:13 smithi110 ceph-mon[28069]: pgmap v11903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:13 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21727.242619 secs 2024-04-26T17:50:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:13 smithi193 ceph-mon[32782]: pgmap v11903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:15 smithi196 ceph-mon[32572]: pgmap v11904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:15 smithi110 ceph-mon[28069]: pgmap v11904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:15 smithi193 ceph-mon[32782]: pgmap v11904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:17 smithi196 ceph-mon[32572]: pgmap v11905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21732.242750 secs 2024-04-26T17:50:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:17 smithi110 ceph-mon[28069]: pgmap v11905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21732.242750 secs 2024-04-26T17:50:17.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:17 smithi193 ceph-mon[32782]: pgmap v11905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21732.242750 secs 2024-04-26T17:50:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:19 smithi196 ceph-mon[32572]: pgmap v11906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:19 smithi110 ceph-mon[28069]: pgmap v11906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:19 smithi193 ceph-mon[32782]: pgmap v11906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:21 smithi196 ceph-mon[32572]: pgmap v11907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:21 smithi110 ceph-mon[28069]: pgmap v11907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:21 smithi193 ceph-mon[32782]: pgmap v11907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:22 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21737.242856 secs 2024-04-26T17:50:22.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:22 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21737.242856 secs 2024-04-26T17:50:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:22 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21737.242856 secs 2024-04-26T17:50:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:23 smithi110 ceph-mon[28069]: pgmap v11908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:23.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:23 smithi193 ceph-mon[32782]: pgmap v11908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:23 smithi196 ceph-mon[32572]: pgmap v11908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:24 smithi110 ceph-mon[28069]: pgmap v11909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:50:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:24 smithi110 ceph-mon[28069]: pgmap v11910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:50:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:24 smithi193 ceph-mon[32782]: pgmap v11909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:50:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:24 smithi193 ceph-mon[32782]: pgmap v11910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:50:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:24 smithi196 ceph-mon[32572]: pgmap v11909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:50:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:24 smithi196 ceph-mon[32572]: pgmap v11910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:50:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:27 smithi110 ceph-mon[28069]: pgmap v11911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:27 smithi193 ceph-mon[32782]: pgmap v11911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:27 smithi196 ceph-mon[32572]: pgmap v11911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:28 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21742.242955 secs 2024-04-26T17:50:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:28 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21742.242955 secs 2024-04-26T17:50:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:28 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21742.242955 secs 2024-04-26T17:50:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:29 smithi110 ceph-mon[28069]: pgmap v11912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:29 smithi193 ceph-mon[32782]: pgmap v11912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:29 smithi196 ceph-mon[32572]: pgmap v11912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:31 smithi193 ceph-mon[32782]: pgmap v11913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:31 smithi196 ceph-mon[32572]: pgmap v11913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:31 smithi110 ceph-mon[28069]: pgmap v11913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:50:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:33 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21747.243076 secs 2024-04-26T17:50:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:33 smithi193 ceph-mon[32782]: pgmap v11914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:50:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:33 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21747.243076 secs 2024-04-26T17:50:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:33 smithi196 ceph-mon[32572]: pgmap v11914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:50:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:33 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21747.243076 secs 2024-04-26T17:50:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:33 smithi110 ceph-mon[28069]: pgmap v11914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:50:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:35 smithi193 ceph-mon[32782]: pgmap v11915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:50:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:35 smithi196 ceph-mon[32572]: pgmap v11915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:50:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:35 smithi110 ceph-mon[28069]: pgmap v11915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:50:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:37 smithi193 ceph-mon[32782]: pgmap v11916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:37 smithi196 ceph-mon[32572]: pgmap v11916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:37 smithi110 ceph-mon[28069]: pgmap v11916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:38 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21752.243194 secs 2024-04-26T17:50:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:38 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21752.243194 secs 2024-04-26T17:50:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:38 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21752.243194 secs 2024-04-26T17:50:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:39 smithi193 ceph-mon[32782]: pgmap v11917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:39 smithi196 ceph-mon[32572]: pgmap v11917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:39 smithi110 ceph-mon[28069]: pgmap v11917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:41 smithi193 ceph-mon[32782]: pgmap v11918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:41 smithi196 ceph-mon[32572]: pgmap v11918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:41 smithi110 ceph-mon[28069]: pgmap v11918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:43.342 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:43 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21757.243332 secs 2024-04-26T17:50:43.342 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:43 smithi110 ceph-mon[28069]: pgmap v11919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:43.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:43 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21757.243332 secs 2024-04-26T17:50:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:43 smithi193 ceph-mon[32782]: pgmap v11919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:43 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21757.243332 secs 2024-04-26T17:50:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:43 smithi196 ceph-mon[32572]: pgmap v11919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:45 smithi193 ceph-mon[32782]: pgmap v11920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:45 smithi196 ceph-mon[32572]: pgmap v11920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:45 smithi110 ceph-mon[28069]: pgmap v11920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:47 smithi193 ceph-mon[32782]: pgmap v11921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:47 smithi196 ceph-mon[32572]: pgmap v11921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:47 smithi110 ceph-mon[28069]: pgmap v11921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:48 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21762.243442 secs 2024-04-26T17:50:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:48 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21762.243442 secs 2024-04-26T17:50:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:48 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21762.243442 secs 2024-04-26T17:50:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:49 smithi193 ceph-mon[32782]: pgmap v11922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:49 smithi196 ceph-mon[32572]: pgmap v11922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:49 smithi110 ceph-mon[28069]: pgmap v11922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:50 smithi196 ceph-mon[32572]: pgmap v11923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:50 smithi110 ceph-mon[28069]: pgmap v11923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:50.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:50 smithi193 ceph-mon[32782]: pgmap v11923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:53 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21767.243541 secs 2024-04-26T17:50:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:53 smithi110 ceph-mon[28069]: pgmap v11924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:53 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21767.243541 secs 2024-04-26T17:50:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:53 smithi193 ceph-mon[32782]: pgmap v11924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:53 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21767.243541 secs 2024-04-26T17:50:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:53 smithi196 ceph-mon[32572]: pgmap v11924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:55 smithi193 ceph-mon[32782]: pgmap v11925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:55 smithi196 ceph-mon[32572]: pgmap v11925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:55 smithi110 ceph-mon[28069]: pgmap v11925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:57 smithi193 ceph-mon[32782]: pgmap v11926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:57 smithi196 ceph-mon[32572]: pgmap v11926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:57 smithi110 ceph-mon[28069]: pgmap v11926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:50:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:58 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21772.243655 secs 2024-04-26T17:50:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:58 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21772.243655 secs 2024-04-26T17:50:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:58 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21772.243655 secs 2024-04-26T17:50:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:50:59 smithi193 ceph-mon[32782]: pgmap v11927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:50:59 smithi196 ceph-mon[32572]: pgmap v11927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:50:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:50:59 smithi110 ceph-mon[28069]: pgmap v11927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:01 smithi193 ceph-mon[32782]: pgmap v11928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:01 smithi196 ceph-mon[32572]: pgmap v11928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:01 smithi110 ceph-mon[28069]: pgmap v11928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:03 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21777.243732 secs 2024-04-26T17:51:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:03 smithi193 ceph-mon[32782]: pgmap v11929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:03 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21777.243732 secs 2024-04-26T17:51:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:03 smithi196 ceph-mon[32572]: pgmap v11929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:03 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21777.243732 secs 2024-04-26T17:51:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:03 smithi110 ceph-mon[28069]: pgmap v11929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:05 smithi193 ceph-mon[32782]: pgmap v11930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:05 smithi196 ceph-mon[32572]: pgmap v11930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:05 smithi110 ceph-mon[28069]: pgmap v11930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:07 smithi193 ceph-mon[32782]: pgmap v11931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:07 smithi196 ceph-mon[32572]: pgmap v11931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:07 smithi110 ceph-mon[28069]: pgmap v11931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:08 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21782.243850 secs 2024-04-26T17:51:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:08 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21782.243850 secs 2024-04-26T17:51:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:08 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21782.243850 secs 2024-04-26T17:51:09.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:09 smithi193 ceph-mon[32782]: pgmap v11932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:09 smithi196 ceph-mon[32572]: pgmap v11932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:09 smithi110 ceph-mon[28069]: pgmap v11932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:11 smithi193 ceph-mon[32782]: pgmap v11933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:11 smithi196 ceph-mon[32572]: pgmap v11933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:11 smithi110 ceph-mon[28069]: pgmap v11933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:13.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:13 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21787.244001 secs 2024-04-26T17:51:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:13 smithi193 ceph-mon[32782]: pgmap v11934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:13 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21787.244001 secs 2024-04-26T17:51:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:13 smithi196 ceph-mon[32572]: pgmap v11934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:13 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21787.244001 secs 2024-04-26T17:51:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:13 smithi110 ceph-mon[28069]: pgmap v11934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:15.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:15 smithi193 ceph-mon[32782]: pgmap v11935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:15 smithi196 ceph-mon[32572]: pgmap v11935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:15 smithi110 ceph-mon[28069]: pgmap v11935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:16 smithi196 ceph-mon[32572]: pgmap v11936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:16 smithi110 ceph-mon[28069]: pgmap v11936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:16 smithi193 ceph-mon[32782]: pgmap v11936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:17 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21792.244104 secs 2024-04-26T17:51:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:17 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21792.244104 secs 2024-04-26T17:51:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:17 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21792.244104 secs 2024-04-26T17:51:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:18 smithi193 ceph-mon[32782]: pgmap v11937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:18 smithi196 ceph-mon[32572]: pgmap v11937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:18 smithi110 ceph-mon[28069]: pgmap v11937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:51:19.968+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T17:51:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:51:19.968+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T17:51:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:51:19.970+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 169 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T17:51:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:51:19.970+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T17:51:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:51:19.970+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 169 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T17:51:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:51:19.970+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:51:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:51:19.971+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 170 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:51:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:51:19.971+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 170 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T17:51:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:21 smithi193 ceph-mon[32782]: pgmap v11938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:21 smithi196 ceph-mon[32572]: pgmap v11938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:21 smithi110 ceph-mon[28069]: pgmap v11938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:23 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21797.244219 secs 2024-04-26T17:51:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:23 smithi193 ceph-mon[32782]: pgmap v11939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:23 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21797.244219 secs 2024-04-26T17:51:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:23 smithi196 ceph-mon[32572]: pgmap v11939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:23 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21797.244219 secs 2024-04-26T17:51:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:23 smithi110 ceph-mon[28069]: pgmap v11939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:25.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:25 smithi193 ceph-mon[32782]: pgmap v11940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:25 smithi196 ceph-mon[32572]: pgmap v11940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:25 smithi110 ceph-mon[28069]: pgmap v11940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:51:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:51:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:51:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:27 smithi193 ceph-mon[32782]: pgmap v11941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:51:27.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:27 smithi193 ceph-mon[32782]: pgmap v11942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:27 smithi196 ceph-mon[32572]: pgmap v11941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:51:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:27 smithi196 ceph-mon[32572]: pgmap v11942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:27 smithi110 ceph-mon[28069]: pgmap v11941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T17:51:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:27 smithi110 ceph-mon[28069]: pgmap v11942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:28.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:28 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21802.244355 secs 2024-04-26T17:51:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:28 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21802.244355 secs 2024-04-26T17:51:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:28 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21802.244355 secs 2024-04-26T17:51:29.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:29 smithi193 ceph-mon[32782]: pgmap v11943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:29 smithi196 ceph-mon[32572]: pgmap v11943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:29 smithi110 ceph-mon[28069]: pgmap v11943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:31 smithi193 ceph-mon[32782]: pgmap v11944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:31 smithi196 ceph-mon[32572]: pgmap v11944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:31 smithi110 ceph-mon[28069]: pgmap v11944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:33 smithi193 ceph-mon[32782]: pgmap v11945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:33 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21807.244474 secs 2024-04-26T17:51:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:33 smithi196 ceph-mon[32572]: pgmap v11945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:33 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21807.244474 secs 2024-04-26T17:51:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:33 smithi110 ceph-mon[28069]: pgmap v11945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:33 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21807.244474 secs 2024-04-26T17:51:35.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:35 smithi193 ceph-mon[32782]: pgmap v11946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:35 smithi196 ceph-mon[32572]: pgmap v11946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:35 smithi110 ceph-mon[28069]: pgmap v11946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:51:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:37 smithi193 ceph-mon[32782]: pgmap v11947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:51:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:37 smithi196 ceph-mon[32572]: pgmap v11947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:51:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:37 smithi110 ceph-mon[28069]: pgmap v11947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:51:38.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:38 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21812.244613 secs 2024-04-26T17:51:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:38 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21812.244613 secs 2024-04-26T17:51:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:38 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21812.244613 secs 2024-04-26T17:51:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:39 smithi193 ceph-mon[32782]: pgmap v11948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:39 smithi196 ceph-mon[32572]: pgmap v11948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:39 smithi110 ceph-mon[28069]: pgmap v11948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:41 smithi193 ceph-mon[32782]: pgmap v11949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:41 smithi196 ceph-mon[32572]: pgmap v11949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:41 smithi110 ceph-mon[28069]: pgmap v11949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:42 smithi196 ceph-mon[32572]: pgmap v11950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:42 smithi110 ceph-mon[28069]: pgmap v11950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:42.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:42 smithi193 ceph-mon[32782]: pgmap v11950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:43.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:43 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21817.244752 secs 2024-04-26T17:51:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:43 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21817.244752 secs 2024-04-26T17:51:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:43 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21817.244752 secs 2024-04-26T17:51:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:44 smithi196 ceph-mon[32572]: pgmap v11951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:44 smithi110 ceph-mon[28069]: pgmap v11951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:44 smithi193 ceph-mon[32782]: pgmap v11951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:46 smithi193 ceph-mon[32782]: pgmap v11952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:46 smithi196 ceph-mon[32572]: pgmap v11952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:46 smithi110 ceph-mon[28069]: pgmap v11952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:47 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21822.244825 secs 2024-04-26T17:51:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:47 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21822.244825 secs 2024-04-26T17:51:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:47 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21822.244825 secs 2024-04-26T17:51:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:48 smithi193 ceph-mon[32782]: pgmap v11953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:48 smithi196 ceph-mon[32572]: pgmap v11953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:48 smithi110 ceph-mon[28069]: pgmap v11953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:50 smithi193 ceph-mon[32782]: pgmap v11954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:50 smithi196 ceph-mon[32572]: pgmap v11954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:50 smithi110 ceph-mon[28069]: pgmap v11954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:52 smithi196 ceph-mon[32572]: pgmap v11955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:52 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21827.244940 secs 2024-04-26T17:51:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:52 smithi110 ceph-mon[28069]: pgmap v11955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:52 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21827.244940 secs 2024-04-26T17:51:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:52 smithi193 ceph-mon[32782]: pgmap v11955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:52 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21827.244940 secs 2024-04-26T17:51:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:54 smithi196 ceph-mon[32572]: pgmap v11956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:54 smithi110 ceph-mon[28069]: pgmap v11956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:55.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:54 smithi193 ceph-mon[32782]: pgmap v11956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:56 smithi196 ceph-mon[32572]: pgmap v11957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:56 smithi110 ceph-mon[28069]: pgmap v11957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:56 smithi193 ceph-mon[32782]: pgmap v11957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:51:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:57 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21832.245037 secs 2024-04-26T17:51:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:57 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21832.245037 secs 2024-04-26T17:51:58.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:57 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21832.245037 secs 2024-04-26T17:51:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:51:58 smithi196 ceph-mon[32572]: pgmap v11958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:51:58 smithi110 ceph-mon[28069]: pgmap v11958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:51:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:51:58 smithi193 ceph-mon[32782]: pgmap v11958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:00 smithi196 ceph-mon[32572]: pgmap v11959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:00 smithi110 ceph-mon[28069]: pgmap v11959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:01.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:00 smithi193 ceph-mon[32782]: pgmap v11959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:02 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21837.245114 secs 2024-04-26T17:52:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:02 smithi196 ceph-mon[32572]: pgmap v11960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:02 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21837.245114 secs 2024-04-26T17:52:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:02 smithi110 ceph-mon[28069]: pgmap v11960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:02 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21837.245114 secs 2024-04-26T17:52:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:02 smithi193 ceph-mon[32782]: pgmap v11960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:04 smithi196 ceph-mon[32572]: pgmap v11961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:04 smithi110 ceph-mon[28069]: pgmap v11961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:04 smithi193 ceph-mon[32782]: pgmap v11961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:06 smithi196 ceph-mon[32572]: pgmap v11962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:06 smithi110 ceph-mon[28069]: pgmap v11962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:06 smithi193 ceph-mon[32782]: pgmap v11962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:07 smithi196 ceph-mon[32572]: 19 slow requests, 0 included below; oldest blocked for > 21842.245238 secs 2024-04-26T17:52:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:07 smithi110 ceph-mon[28069]: 19 slow requests, 0 included below; oldest blocked for > 21842.245238 secs 2024-04-26T17:52:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:07 smithi193 ceph-mon[32782]: 19 slow requests, 0 included below; oldest blocked for > 21842.245238 secs 2024-04-26T17:52:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:08 smithi196 ceph-mon[32572]: pgmap v11963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:08 smithi110 ceph-mon[28069]: pgmap v11963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:09.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:08 smithi193 ceph-mon[32782]: pgmap v11963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:10 smithi196 ceph-mon[32572]: pgmap v11964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:10 smithi110 ceph-mon[28069]: pgmap v11964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:10 smithi193 ceph-mon[32782]: pgmap v11964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:12 smithi196 ceph-mon[32572]: 20 slow requests, 1 included below; oldest blocked for > 21847.245360 secs 2024-04-26T17:52:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:12 smithi196 ceph-mon[32572]: slow request 180.798350 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T17:52:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:12 smithi196 ceph-mon[32572]: pgmap v11965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:12 smithi110 ceph-mon[28069]: 20 slow requests, 1 included below; oldest blocked for > 21847.245360 secs 2024-04-26T17:52:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:12 smithi110 ceph-mon[28069]: slow request 180.798350 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T17:52:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:12 smithi110 ceph-mon[28069]: pgmap v11965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:12 smithi193 ceph-mon[32782]: 20 slow requests, 1 included below; oldest blocked for > 21847.245360 secs 2024-04-26T17:52:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:12 smithi193 ceph-mon[32782]: slow request 180.798350 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T17:52:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:12 smithi193 ceph-mon[32782]: pgmap v11965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:14 smithi196 ceph-mon[32572]: pgmap v11966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:14 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T17:52:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:14 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T17:52:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:14 smithi110 ceph-mon[28069]: pgmap v11966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:14 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T17:52:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:14 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T17:52:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:14 smithi193 ceph-mon[32782]: pgmap v11966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:14 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T17:52:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:14 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T17:52:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:16 smithi196 ceph-mon[32572]: pgmap v11967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:16 smithi110 ceph-mon[28069]: pgmap v11967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:17.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:16 smithi193 ceph-mon[32782]: pgmap v11967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21852.245480 secs 2024-04-26T17:52:18.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21852.245480 secs 2024-04-26T17:52:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21852.245480 secs 2024-04-26T17:52:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:18 smithi196 ceph-mon[32572]: pgmap v11968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:18 smithi110 ceph-mon[28069]: pgmap v11968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:19.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:18 smithi193 ceph-mon[32782]: pgmap v11968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:20 smithi196 ceph-mon[32572]: pgmap v11969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:20 smithi110 ceph-mon[28069]: pgmap v11969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:20 smithi193 ceph-mon[32782]: pgmap v11969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21857.245599 secs 2024-04-26T17:52:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:22 smithi196 ceph-mon[32572]: pgmap v11970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21857.245599 secs 2024-04-26T17:52:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:22 smithi110 ceph-mon[28069]: pgmap v11970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21857.245599 secs 2024-04-26T17:52:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:22 smithi193 ceph-mon[32782]: pgmap v11970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:24 smithi196 ceph-mon[32572]: pgmap v11971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:24 smithi110 ceph-mon[28069]: pgmap v11971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:24 smithi193 ceph-mon[32782]: pgmap v11971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:26 smithi196 ceph-mon[32572]: pgmap v11972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:26 smithi110 ceph-mon[28069]: pgmap v11972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:26 smithi193 ceph-mon[32782]: pgmap v11972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21862.245689 secs 2024-04-26T17:52:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:52:28.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21862.245689 secs 2024-04-26T17:52:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:52:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21862.245689 secs 2024-04-26T17:52:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:52:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:28 smithi110 ceph-mon[28069]: pgmap v11973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T17:52:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:28 smithi110 ceph-mon[28069]: pgmap v11974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T17:52:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:28 smithi193 ceph-mon[32782]: pgmap v11973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T17:52:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:28 smithi193 ceph-mon[32782]: pgmap v11974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T17:52:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:28 smithi196 ceph-mon[32572]: pgmap v11973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T17:52:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:28 smithi196 ceph-mon[32572]: pgmap v11974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T17:52:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:30 smithi110 ceph-mon[28069]: pgmap v11975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:30 smithi193 ceph-mon[32782]: pgmap v11975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:30 smithi196 ceph-mon[32572]: pgmap v11975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:32 smithi110 ceph-mon[28069]: pgmap v11976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21867.245801 secs 2024-04-26T17:52:33.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:32 smithi193 ceph-mon[32782]: pgmap v11976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21867.245801 secs 2024-04-26T17:52:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:32 smithi196 ceph-mon[32572]: pgmap v11976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21867.245801 secs 2024-04-26T17:52:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:34 smithi110 ceph-mon[28069]: pgmap v11977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:34 smithi193 ceph-mon[32782]: pgmap v11977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:34 smithi196 ceph-mon[32572]: pgmap v11977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:36 smithi110 ceph-mon[28069]: pgmap v11978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:36 smithi193 ceph-mon[32782]: pgmap v11978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:36 smithi196 ceph-mon[32572]: pgmap v11978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:52:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21872.245875 secs 2024-04-26T17:52:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21872.245875 secs 2024-04-26T17:52:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21872.245875 secs 2024-04-26T17:52:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:38 smithi193 ceph-mon[32782]: pgmap v11979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:52:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:38 smithi196 ceph-mon[32572]: pgmap v11979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:52:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:38 smithi110 ceph-mon[28069]: pgmap v11979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:52:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:40 smithi193 ceph-mon[32782]: pgmap v11980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:40 smithi196 ceph-mon[32572]: pgmap v11980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:40 smithi110 ceph-mon[28069]: pgmap v11980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:42 smithi193 ceph-mon[32782]: pgmap v11981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21877.245988 secs 2024-04-26T17:52:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:42 smithi196 ceph-mon[32572]: pgmap v11981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21877.245988 secs 2024-04-26T17:52:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:42 smithi110 ceph-mon[28069]: pgmap v11981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21877.245988 secs 2024-04-26T17:52:45.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:44 smithi110 ceph-mon[28069]: pgmap v11982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:44 smithi193 ceph-mon[32782]: pgmap v11982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:44 smithi196 ceph-mon[32572]: pgmap v11982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:46 smithi193 ceph-mon[32782]: pgmap v11983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:46 smithi196 ceph-mon[32572]: pgmap v11983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:46 smithi110 ceph-mon[28069]: pgmap v11983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21882.246106 secs 2024-04-26T17:52:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21882.246106 secs 2024-04-26T17:52:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21882.246106 secs 2024-04-26T17:52:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:48 smithi193 ceph-mon[32782]: pgmap v11984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:48 smithi196 ceph-mon[32572]: pgmap v11984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:48 smithi110 ceph-mon[28069]: pgmap v11984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:50 smithi193 ceph-mon[32782]: pgmap v11985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:50 smithi196 ceph-mon[32572]: pgmap v11985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:50 smithi110 ceph-mon[28069]: pgmap v11985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:52 smithi193 ceph-mon[32782]: pgmap v11986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21887.246246 secs 2024-04-26T17:52:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:52 smithi196 ceph-mon[32572]: pgmap v11986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21887.246246 secs 2024-04-26T17:52:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:52 smithi110 ceph-mon[28069]: pgmap v11986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21887.246246 secs 2024-04-26T17:52:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:54 smithi193 ceph-mon[32782]: pgmap v11987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:54 smithi196 ceph-mon[32572]: pgmap v11987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:54 smithi110 ceph-mon[28069]: pgmap v11987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:52:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:56 smithi193 ceph-mon[32782]: pgmap v11988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:56 smithi196 ceph-mon[32572]: pgmap v11988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:56 smithi110 ceph-mon[28069]: pgmap v11988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21892.246389 secs 2024-04-26T17:52:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21892.246389 secs 2024-04-26T17:52:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21892.246389 secs 2024-04-26T17:52:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:52:58 smithi193 ceph-mon[32782]: pgmap v11989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:52:58 smithi196 ceph-mon[32572]: pgmap v11989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:52:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:52:58 smithi110 ceph-mon[28069]: pgmap v11989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:00 smithi193 ceph-mon[32782]: pgmap v11990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:00 smithi196 ceph-mon[32572]: pgmap v11990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:00 smithi110 ceph-mon[28069]: pgmap v11990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:02 smithi196 ceph-mon[32572]: pgmap v11991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21897.246532 secs 2024-04-26T17:53:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:02 smithi110 ceph-mon[28069]: pgmap v11991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21897.246532 secs 2024-04-26T17:53:03.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:02 smithi193 ceph-mon[32782]: pgmap v11991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21897.246532 secs 2024-04-26T17:53:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:04 smithi196 ceph-mon[32572]: pgmap v11992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:04 smithi110 ceph-mon[28069]: pgmap v11992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:04 smithi193 ceph-mon[32782]: pgmap v11992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:06 smithi196 ceph-mon[32572]: pgmap v11993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:06 smithi110 ceph-mon[28069]: pgmap v11993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:07.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:06 smithi193 ceph-mon[32782]: pgmap v11993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21902.246649 secs 2024-04-26T17:53:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21902.246649 secs 2024-04-26T17:53:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21902.246649 secs 2024-04-26T17:53:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:08 smithi196 ceph-mon[32572]: pgmap v11994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:08 smithi110 ceph-mon[28069]: pgmap v11994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:08 smithi193 ceph-mon[32782]: pgmap v11994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:10 smithi196 ceph-mon[32572]: pgmap v11995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:10 smithi110 ceph-mon[28069]: pgmap v11995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:10 smithi193 ceph-mon[32782]: pgmap v11995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:12 smithi196 ceph-mon[32572]: pgmap v11996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21907.246786 secs 2024-04-26T17:53:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:12 smithi110 ceph-mon[28069]: pgmap v11996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21907.246786 secs 2024-04-26T17:53:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:12 smithi193 ceph-mon[32782]: pgmap v11996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21907.246786 secs 2024-04-26T17:53:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:14 smithi196 ceph-mon[32572]: pgmap v11997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:14 smithi110 ceph-mon[28069]: pgmap v11997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:14 smithi193 ceph-mon[32782]: pgmap v11997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:16 smithi196 ceph-mon[32572]: pgmap v11998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:16 smithi110 ceph-mon[28069]: pgmap v11998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:16 smithi193 ceph-mon[32782]: pgmap v11998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21912.246897 secs 2024-04-26T17:53:18.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21912.246897 secs 2024-04-26T17:53:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21912.246897 secs 2024-04-26T17:53:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:18 smithi196 ceph-mon[32572]: pgmap v11999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:18 smithi110 ceph-mon[28069]: pgmap v11999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:19.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:18 smithi193 ceph-mon[32782]: pgmap v11999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:20 smithi196 ceph-mon[32572]: pgmap v12000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:20 smithi110 ceph-mon[28069]: pgmap v12000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:20 smithi193 ceph-mon[32782]: pgmap v12000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:22 smithi196 ceph-mon[32572]: pgmap v12001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21917.246989 secs 2024-04-26T17:53:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:22 smithi110 ceph-mon[28069]: pgmap v12001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21917.246989 secs 2024-04-26T17:53:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:22 smithi193 ceph-mon[32782]: pgmap v12001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21917.246989 secs 2024-04-26T17:53:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:24 smithi196 ceph-mon[32572]: pgmap v12002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:24 smithi110 ceph-mon[28069]: pgmap v12002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:24 smithi193 ceph-mon[32782]: pgmap v12002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:26 smithi196 ceph-mon[32572]: pgmap v12003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:26 smithi110 ceph-mon[28069]: pgmap v12003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:26 smithi193 ceph-mon[32782]: pgmap v12003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21922.247110 secs 2024-04-26T17:53:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21922.247110 secs 2024-04-26T17:53:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21922.247110 secs 2024-04-26T17:53:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:28 smithi196 ceph-mon[32572]: pgmap v12004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:53:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:53:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:28 smithi110 ceph-mon[28069]: pgmap v12004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:53:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:53:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:28 smithi193 ceph-mon[32782]: pgmap v12004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:53:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:53:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:53:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:53:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:53:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:30 smithi196 ceph-mon[32572]: pgmap v12005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:30 smithi196 ceph-mon[32572]: pgmap v12006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T17:53:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:30 smithi196 ceph-mon[32572]: pgmap v12007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:30 smithi110 ceph-mon[28069]: pgmap v12005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:30 smithi110 ceph-mon[28069]: pgmap v12006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T17:53:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:30 smithi110 ceph-mon[28069]: pgmap v12007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:30 smithi193 ceph-mon[32782]: pgmap v12005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:30 smithi193 ceph-mon[32782]: pgmap v12006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T17:53:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:30 smithi193 ceph-mon[32782]: pgmap v12007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21927.247251 secs 2024-04-26T17:53:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:32 smithi196 ceph-mon[32572]: pgmap v12008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T17:53:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21927.247251 secs 2024-04-26T17:53:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:32 smithi110 ceph-mon[28069]: pgmap v12008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T17:53:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21927.247251 secs 2024-04-26T17:53:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:32 smithi193 ceph-mon[32782]: pgmap v12008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T17:53:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:34 smithi196 ceph-mon[32572]: pgmap v12009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:34 smithi110 ceph-mon[28069]: pgmap v12009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:34 smithi193 ceph-mon[32782]: pgmap v12009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:36 smithi196 ceph-mon[32572]: pgmap v12010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:36 smithi110 ceph-mon[28069]: pgmap v12010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:36 smithi193 ceph-mon[32782]: pgmap v12010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:38 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21932.247385 secs 2024-04-26T17:53:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:38 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21932.247385 secs 2024-04-26T17:53:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:38 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21932.247385 secs 2024-04-26T17:53:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:39 smithi196 ceph-mon[32572]: pgmap v12011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:39 smithi110 ceph-mon[28069]: pgmap v12011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:39 smithi193 ceph-mon[32782]: pgmap v12011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:41 smithi110 ceph-mon[28069]: pgmap v12012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:53:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:41 smithi193 ceph-mon[32782]: pgmap v12012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:53:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:41 smithi196 ceph-mon[32572]: pgmap v12012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:53:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:43 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21937.247523 secs 2024-04-26T17:53:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:43 smithi110 ceph-mon[28069]: pgmap v12013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:43 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21937.247523 secs 2024-04-26T17:53:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:43 smithi193 ceph-mon[32782]: pgmap v12013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:43 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21937.247523 secs 2024-04-26T17:53:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:43 smithi196 ceph-mon[32572]: pgmap v12013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:45 smithi110 ceph-mon[28069]: pgmap v12014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:45.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:45 smithi196 ceph-mon[32572]: pgmap v12014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:45.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:45 smithi193 ceph-mon[32782]: pgmap v12014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:47 smithi110 ceph-mon[28069]: pgmap v12015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:47 smithi193 ceph-mon[32782]: pgmap v12015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:47 smithi196 ceph-mon[32572]: pgmap v12015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:48 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21942.247669 secs 2024-04-26T17:53:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:48 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21942.247669 secs 2024-04-26T17:53:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:48 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21942.247669 secs 2024-04-26T17:53:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:49 smithi110 ceph-mon[28069]: pgmap v12016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:49 smithi193 ceph-mon[32782]: pgmap v12016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:49 smithi196 ceph-mon[32572]: pgmap v12016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:51 smithi193 ceph-mon[32782]: pgmap v12017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:51 smithi196 ceph-mon[32572]: pgmap v12017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:51 smithi110 ceph-mon[28069]: pgmap v12017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:53 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21947.247763 secs 2024-04-26T17:53:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:53 smithi193 ceph-mon[32782]: pgmap v12018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:53 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21947.247763 secs 2024-04-26T17:53:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:53 smithi196 ceph-mon[32572]: pgmap v12018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:53 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21947.247763 secs 2024-04-26T17:53:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:53 smithi110 ceph-mon[28069]: pgmap v12018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:55.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:55 smithi193 ceph-mon[32782]: pgmap v12019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:55 smithi196 ceph-mon[32572]: pgmap v12019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:55 smithi110 ceph-mon[28069]: pgmap v12019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:57 smithi193 ceph-mon[32782]: pgmap v12020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:57 smithi196 ceph-mon[32572]: pgmap v12020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:57 smithi110 ceph-mon[28069]: pgmap v12020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:53:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:58 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21952.247828 secs 2024-04-26T17:53:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:58 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21952.247828 secs 2024-04-26T17:53:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:58 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21952.247828 secs 2024-04-26T17:53:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:53:59 smithi193 ceph-mon[32782]: pgmap v12021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:53:59 smithi196 ceph-mon[32572]: pgmap v12021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:53:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:53:59 smithi110 ceph-mon[28069]: pgmap v12021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:01.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:01 smithi193 ceph-mon[32782]: pgmap v12022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:01 smithi196 ceph-mon[32572]: pgmap v12022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:01 smithi110 ceph-mon[28069]: pgmap v12022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:03 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21957.247900 secs 2024-04-26T17:54:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:03 smithi193 ceph-mon[32782]: pgmap v12023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:03 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21957.247900 secs 2024-04-26T17:54:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:03 smithi196 ceph-mon[32572]: pgmap v12023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:03 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21957.247900 secs 2024-04-26T17:54:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:03 smithi110 ceph-mon[28069]: pgmap v12023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:05.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:05 smithi193 ceph-mon[32782]: pgmap v12024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:05 smithi196 ceph-mon[32572]: pgmap v12024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:05 smithi110 ceph-mon[28069]: pgmap v12024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:07 smithi193 ceph-mon[32782]: pgmap v12025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:07 smithi196 ceph-mon[32572]: pgmap v12025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:07 smithi110 ceph-mon[28069]: pgmap v12025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:08 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21962.248017 secs 2024-04-26T17:54:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:08 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21962.248017 secs 2024-04-26T17:54:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:08 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21962.248017 secs 2024-04-26T17:54:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:09 smithi193 ceph-mon[32782]: pgmap v12026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:09 smithi196 ceph-mon[32572]: pgmap v12026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:09 smithi110 ceph-mon[28069]: pgmap v12026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:11 smithi110 ceph-mon[28069]: pgmap v12027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:54:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:54:10.966+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:54:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:54:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:54:10.966+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:54:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:54:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:54:10.966+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:54:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:54:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:54:10.966+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:54:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:54:10 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:54:10.966+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:54:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:11 smithi193 ceph-mon[32782]: pgmap v12027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:11 smithi196 ceph-mon[32572]: pgmap v12027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:13 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21967.248117 secs 2024-04-26T17:54:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:13 smithi196 ceph-mon[32572]: pgmap v12028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:13 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21967.248117 secs 2024-04-26T17:54:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:13 smithi110 ceph-mon[28069]: pgmap v12028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:13 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21967.248117 secs 2024-04-26T17:54:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:13 smithi193 ceph-mon[32782]: pgmap v12028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:15 smithi196 ceph-mon[32572]: pgmap v12029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:15 smithi110 ceph-mon[28069]: pgmap v12029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:15 smithi193 ceph-mon[32782]: pgmap v12029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:17 smithi196 ceph-mon[32572]: pgmap v12030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:17 smithi110 ceph-mon[28069]: pgmap v12030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:17 smithi193 ceph-mon[32782]: pgmap v12030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:18 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21972.248192 secs 2024-04-26T17:54:18.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:18 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21972.248192 secs 2024-04-26T17:54:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:18 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21972.248192 secs 2024-04-26T17:54:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:19 smithi196 ceph-mon[32572]: pgmap v12031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:19 smithi110 ceph-mon[28069]: pgmap v12031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:19 smithi193 ceph-mon[32782]: pgmap v12031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:54:19.999+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:54:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:54:19.999+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T17:54:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:54:20.000+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 171 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T17:54:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:54:20.000+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 171 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:54:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:21 smithi196 ceph-mon[32572]: pgmap v12032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:21 smithi110 ceph-mon[28069]: pgmap v12032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:21 smithi193 ceph-mon[32782]: pgmap v12032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:22 smithi196 ceph-mon[32572]: pgmap v12033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:22 smithi110 ceph-mon[28069]: pgmap v12033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:22 smithi193 ceph-mon[32782]: pgmap v12033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:23 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21977.248281 secs 2024-04-26T17:54:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:23 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21977.248281 secs 2024-04-26T17:54:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:23 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21977.248281 secs 2024-04-26T17:54:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:24 smithi196 ceph-mon[32572]: pgmap v12034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:24 smithi110 ceph-mon[28069]: pgmap v12034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:24 smithi193 ceph-mon[32782]: pgmap v12034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T17:54:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:26 smithi196 ceph-mon[32572]: pgmap v12035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:26 smithi110 ceph-mon[28069]: pgmap v12035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:26 smithi193 ceph-mon[32782]: pgmap v12035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21982.248427 secs 2024-04-26T17:54:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21982.248427 secs 2024-04-26T17:54:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21982.248427 secs 2024-04-26T17:54:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:28 smithi196 ceph-mon[32572]: pgmap v12036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:28 smithi110 ceph-mon[28069]: pgmap v12036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:28 smithi193 ceph-mon[32782]: pgmap v12036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:30 smithi196 ceph-mon[32572]: pgmap v12037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:30 smithi110 ceph-mon[28069]: pgmap v12037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:30 smithi193 ceph-mon[32782]: pgmap v12037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:32.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:54:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:33 smithi193 ceph-mon[32782]: pgmap v12038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T17:54:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:33 smithi193 ceph-mon[32782]: pgmap v12039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:33 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21987.248524 secs 2024-04-26T17:54:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:33 smithi196 ceph-mon[32572]: pgmap v12038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T17:54:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:33 smithi196 ceph-mon[32572]: pgmap v12039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:33 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21987.248524 secs 2024-04-26T17:54:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:33 smithi110 ceph-mon[28069]: pgmap v12038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T17:54:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:33 smithi110 ceph-mon[28069]: pgmap v12039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:33 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21987.248524 secs 2024-04-26T17:54:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:35 smithi193 ceph-mon[32782]: pgmap v12040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:35 smithi196 ceph-mon[32572]: pgmap v12040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:35 smithi110 ceph-mon[28069]: pgmap v12040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:37 smithi193 ceph-mon[32782]: pgmap v12041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:37 smithi196 ceph-mon[32572]: pgmap v12041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:37 smithi110 ceph-mon[28069]: pgmap v12041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:38 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21992.248643 secs 2024-04-26T17:54:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:38 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21992.248643 secs 2024-04-26T17:54:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:38 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21992.248643 secs 2024-04-26T17:54:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:39 smithi196 ceph-mon[32572]: pgmap v12042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T17:54:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:39 smithi110 ceph-mon[28069]: pgmap v12042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T17:54:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:39 smithi193 ceph-mon[32782]: pgmap v12042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T17:54:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:41 smithi196 ceph-mon[32572]: pgmap v12043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:41 smithi110 ceph-mon[28069]: pgmap v12043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:41 smithi193 ceph-mon[32782]: pgmap v12043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:54:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:43 smithi196 ceph-mon[32572]: pgmap v12044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:54:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:43 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 21997.248796 secs 2024-04-26T17:54:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:43 smithi110 ceph-mon[28069]: pgmap v12044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:54:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:43 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 21997.248796 secs 2024-04-26T17:54:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:43 smithi193 ceph-mon[32782]: pgmap v12044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:54:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:43 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 21997.248796 secs 2024-04-26T17:54:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:45 smithi196 ceph-mon[32572]: pgmap v12045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:45 smithi110 ceph-mon[28069]: pgmap v12045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:45 smithi193 ceph-mon[32782]: pgmap v12045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:47 smithi196 ceph-mon[32572]: pgmap v12046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:47 smithi110 ceph-mon[28069]: pgmap v12046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:47 smithi193 ceph-mon[32782]: pgmap v12046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:48 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22002.248873 secs 2024-04-26T17:54:48.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:48 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22002.248873 secs 2024-04-26T17:54:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:48 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22002.248873 secs 2024-04-26T17:54:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:49 smithi196 ceph-mon[32572]: pgmap v12047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:49 smithi110 ceph-mon[28069]: pgmap v12047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:49 smithi193 ceph-mon[32782]: pgmap v12047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:50 smithi196 ceph-mon[32572]: pgmap v12048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:50 smithi110 ceph-mon[28069]: pgmap v12048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:50 smithi193 ceph-mon[32782]: pgmap v12048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:52 smithi110 ceph-mon[28069]: pgmap v12049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:52.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:52 smithi193 ceph-mon[32782]: pgmap v12049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:52 smithi196 ceph-mon[32572]: pgmap v12049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:53 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22007.249001 secs 2024-04-26T17:54:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:53 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22007.249001 secs 2024-04-26T17:54:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:53 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22007.249001 secs 2024-04-26T17:54:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:54 smithi193 ceph-mon[32782]: pgmap v12050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:54 smithi196 ceph-mon[32572]: pgmap v12050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:54 smithi110 ceph-mon[28069]: pgmap v12050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:54:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:56 smithi193 ceph-mon[32782]: pgmap v12051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:56 smithi196 ceph-mon[32572]: pgmap v12051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:56 smithi110 ceph-mon[28069]: pgmap v12051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:58 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22012.249067 secs 2024-04-26T17:54:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:54:58 smithi193 ceph-mon[32782]: pgmap v12052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:58 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22012.249067 secs 2024-04-26T17:54:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:54:58 smithi196 ceph-mon[32572]: pgmap v12052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:54:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:58 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22012.249067 secs 2024-04-26T17:54:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:54:58 smithi110 ceph-mon[28069]: pgmap v12052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:00 smithi193 ceph-mon[32782]: pgmap v12053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:00 smithi196 ceph-mon[32572]: pgmap v12053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:00 smithi110 ceph-mon[28069]: pgmap v12053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:02 smithi193 ceph-mon[32782]: pgmap v12054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:02 smithi196 ceph-mon[32572]: pgmap v12054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:02 smithi110 ceph-mon[28069]: pgmap v12054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:03 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22017.249185 secs 2024-04-26T17:55:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:03 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22017.249185 secs 2024-04-26T17:55:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:03 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22017.249185 secs 2024-04-26T17:55:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:04 smithi193 ceph-mon[32782]: pgmap v12055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:55:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:04 smithi196 ceph-mon[32572]: pgmap v12055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:55:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:04 smithi110 ceph-mon[28069]: pgmap v12055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:55:06.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:06 smithi193 ceph-mon[32782]: pgmap v12056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:55:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:06 smithi196 ceph-mon[32572]: pgmap v12056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:55:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:06 smithi110 ceph-mon[28069]: pgmap v12056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:55:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:08 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22022.249303 secs 2024-04-26T17:55:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:08 smithi193 ceph-mon[32782]: pgmap v12057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:55:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:08 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22022.249303 secs 2024-04-26T17:55:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:08 smithi196 ceph-mon[32572]: pgmap v12057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:55:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:08 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22022.249303 secs 2024-04-26T17:55:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:08 smithi110 ceph-mon[28069]: pgmap v12057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:55:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:10 smithi193 ceph-mon[32782]: pgmap v12058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:55:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:10 smithi196 ceph-mon[32572]: pgmap v12058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:55:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:10 smithi110 ceph-mon[28069]: pgmap v12058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:55:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:12 smithi193 ceph-mon[32782]: pgmap v12059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:55:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:12 smithi196 ceph-mon[32572]: pgmap v12059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:55:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:12 smithi110 ceph-mon[28069]: pgmap v12059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T17:55:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:13 smithi193 ceph-mon[32782]: 20 slow requests, 1 included below; oldest blocked for > 22027.249426 secs 2024-04-26T17:55:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:13 smithi193 ceph-mon[32782]: slow request 360.802416 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:55:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:13 smithi196 ceph-mon[32572]: 20 slow requests, 1 included below; oldest blocked for > 22027.249426 secs 2024-04-26T17:55:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:13 smithi196 ceph-mon[32572]: slow request 360.802416 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:55:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:13 smithi110 ceph-mon[28069]: 20 slow requests, 1 included below; oldest blocked for > 22027.249426 secs 2024-04-26T17:55:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:13 smithi110 ceph-mon[28069]: slow request 360.802416 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T17:55:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:14 smithi193 ceph-mon[32782]: pgmap v12060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:55:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:14 smithi196 ceph-mon[32572]: pgmap v12060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:55:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:14 smithi110 ceph-mon[28069]: pgmap v12060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T17:55:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:16 smithi193 ceph-mon[32782]: pgmap v12061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:16 smithi196 ceph-mon[32572]: pgmap v12061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:16 smithi110 ceph-mon[28069]: pgmap v12061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:18 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22032.249558 secs 2024-04-26T17:55:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:18 smithi193 ceph-mon[32782]: pgmap v12062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:18 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22032.249558 secs 2024-04-26T17:55:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:18 smithi196 ceph-mon[32572]: pgmap v12062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:18 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22032.249558 secs 2024-04-26T17:55:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:18 smithi110 ceph-mon[28069]: pgmap v12062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:20 smithi196 ceph-mon[32572]: pgmap v12063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:20 smithi110 ceph-mon[28069]: pgmap v12063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:20.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:20 smithi193 ceph-mon[32782]: pgmap v12063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:22 smithi196 ceph-mon[32572]: pgmap v12064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:22 smithi110 ceph-mon[28069]: pgmap v12064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:22 smithi193 ceph-mon[32782]: pgmap v12064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:23 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22037.249633 secs 2024-04-26T17:55:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:23 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22037.249633 secs 2024-04-26T17:55:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:23 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22037.249633 secs 2024-04-26T17:55:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:24 smithi196 ceph-mon[32572]: pgmap v12065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:24 smithi110 ceph-mon[28069]: pgmap v12065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:24.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:24 smithi193 ceph-mon[32782]: pgmap v12065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:26 smithi196 ceph-mon[32572]: pgmap v12066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:26 smithi110 ceph-mon[28069]: pgmap v12066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:26 smithi193 ceph-mon[32782]: pgmap v12066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:28 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22042.249761 secs 2024-04-26T17:55:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:28 smithi196 ceph-mon[32572]: pgmap v12067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:28 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22042.249761 secs 2024-04-26T17:55:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:28 smithi110 ceph-mon[28069]: pgmap v12067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:28 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22042.249761 secs 2024-04-26T17:55:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:28 smithi193 ceph-mon[32782]: pgmap v12067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:30 smithi196 ceph-mon[32572]: pgmap v12068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:30 smithi110 ceph-mon[28069]: pgmap v12068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:30 smithi193 ceph-mon[32782]: pgmap v12068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:32.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:32 smithi193 ceph-mon[32782]: pgmap v12069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:32 smithi196 ceph-mon[32572]: pgmap v12069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:32.768 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:32 smithi110 ceph-mon[28069]: pgmap v12069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:32.768 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:33 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22047.249840 secs 2024-04-26T17:55:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:33 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22047.249840 secs 2024-04-26T17:55:33.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:33 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22047.249840 secs 2024-04-26T17:55:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: pgmap v12070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: pgmap v12070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: pgmap v12070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:35 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:55:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:35 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:55:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:35 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:55:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:35 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:55:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:35 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:55:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:35 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:55:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:35 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:55:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:35 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:55:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:35 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T17:55:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:35 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T17:55:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:35 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T17:55:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:35 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T17:55:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: pgmap v12071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: pgmap v12071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: pgmap v12071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:55:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22052.249955 secs 2024-04-26T17:55:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:37 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:55:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:37 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:55:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:37 smithi196 ceph-mon[32572]: pgmap v12072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 900 B/s rd, 1 op/s 2024-04-26T17:55:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:37 smithi196 ceph-mon[32572]: pgmap v12073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22052.249955 secs 2024-04-26T17:55:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:37 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:55:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:37 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:55:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:37 smithi110 ceph-mon[28069]: pgmap v12072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 900 B/s rd, 1 op/s 2024-04-26T17:55:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:37 smithi110 ceph-mon[28069]: pgmap v12073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22052.249955 secs 2024-04-26T17:55:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:37 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T17:55:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:37 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T17:55:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:37 smithi193 ceph-mon[32782]: pgmap v12072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 900 B/s rd, 1 op/s 2024-04-26T17:55:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:37 smithi193 ceph-mon[32782]: pgmap v12073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:39 smithi196 ceph-mon[32572]: pgmap v12074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:39 smithi110 ceph-mon[28069]: pgmap v12074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:39 smithi193 ceph-mon[32782]: pgmap v12074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:41 smithi196 ceph-mon[32572]: pgmap v12075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:41 smithi110 ceph-mon[28069]: pgmap v12075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:41 smithi193 ceph-mon[32782]: pgmap v12075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22057.250071 secs 2024-04-26T17:55:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22057.250071 secs 2024-04-26T17:55:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22057.250071 secs 2024-04-26T17:55:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:43 smithi196 ceph-mon[32572]: pgmap v12076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:43 smithi110 ceph-mon[28069]: pgmap v12076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:44.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:43 smithi193 ceph-mon[32782]: pgmap v12076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:45 smithi196 ceph-mon[32572]: pgmap v12077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:45 smithi110 ceph-mon[28069]: pgmap v12077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:45 smithi193 ceph-mon[32782]: pgmap v12077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T17:55:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22062.250207 secs 2024-04-26T17:55:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:47 smithi196 ceph-mon[32572]: pgmap v12078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:55:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22062.250207 secs 2024-04-26T17:55:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:47 smithi110 ceph-mon[28069]: pgmap v12078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:55:48.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22062.250207 secs 2024-04-26T17:55:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:47 smithi193 ceph-mon[32782]: pgmap v12078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:55:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:49 smithi110 ceph-mon[28069]: pgmap v12079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:49 smithi196 ceph-mon[32572]: pgmap v12079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:49 smithi193 ceph-mon[32782]: pgmap v12079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:51 smithi196 ceph-mon[32572]: pgmap v12080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:51 smithi110 ceph-mon[28069]: pgmap v12080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:51 smithi193 ceph-mon[32782]: pgmap v12080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22067.250342 secs 2024-04-26T17:55:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22067.250342 secs 2024-04-26T17:55:53.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22067.250342 secs 2024-04-26T17:55:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:53 smithi196 ceph-mon[32572]: pgmap v12081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:53 smithi110 ceph-mon[28069]: pgmap v12081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:53 smithi193 ceph-mon[32782]: pgmap v12081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:55:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:55 smithi196 ceph-mon[32572]: pgmap v12082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:55 smithi110 ceph-mon[28069]: pgmap v12082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:55 smithi193 ceph-mon[32782]: pgmap v12082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22072.250463 secs 2024-04-26T17:55:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:57 smithi196 ceph-mon[32572]: pgmap v12083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22072.250463 secs 2024-04-26T17:55:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:57 smithi110 ceph-mon[28069]: pgmap v12083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:55:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22072.250463 secs 2024-04-26T17:55:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:57 smithi193 ceph-mon[32782]: pgmap v12083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:55:59 smithi196 ceph-mon[32572]: pgmap v12084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:55:59 smithi110 ceph-mon[28069]: pgmap v12084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:00.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:55:59 smithi193 ceph-mon[32782]: pgmap v12084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:01 smithi196 ceph-mon[32572]: pgmap v12085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:01 smithi110 ceph-mon[28069]: pgmap v12085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:01 smithi193 ceph-mon[32782]: pgmap v12085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22077.250599 secs 2024-04-26T17:56:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22077.250599 secs 2024-04-26T17:56:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22077.250599 secs 2024-04-26T17:56:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:03 smithi196 ceph-mon[32572]: pgmap v12086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:03 smithi110 ceph-mon[28069]: pgmap v12086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:03 smithi193 ceph-mon[32782]: pgmap v12086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:05 smithi196 ceph-mon[32572]: pgmap v12087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:05 smithi110 ceph-mon[28069]: pgmap v12087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:05 smithi193 ceph-mon[32782]: pgmap v12087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22082.250706 secs 2024-04-26T17:56:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:07 smithi196 ceph-mon[32572]: pgmap v12088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22082.250706 secs 2024-04-26T17:56:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:07 smithi110 ceph-mon[28069]: pgmap v12088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22082.250706 secs 2024-04-26T17:56:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:07 smithi193 ceph-mon[32782]: pgmap v12088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:09 smithi110 ceph-mon[28069]: pgmap v12089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:09 smithi193 ceph-mon[32782]: pgmap v12089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:09 smithi196 ceph-mon[32572]: pgmap v12089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:11 smithi110 ceph-mon[28069]: pgmap v12090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:11 smithi193 ceph-mon[32782]: pgmap v12090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:11 smithi196 ceph-mon[32572]: pgmap v12090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22087.250831 secs 2024-04-26T17:56:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22087.250831 secs 2024-04-26T17:56:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22087.250831 secs 2024-04-26T17:56:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:13 smithi110 ceph-mon[28069]: pgmap v12091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:13 smithi193 ceph-mon[32782]: pgmap v12091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:13 smithi196 ceph-mon[32572]: pgmap v12091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:15 smithi110 ceph-mon[28069]: pgmap v12092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:15 smithi193 ceph-mon[32782]: pgmap v12092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:15 smithi196 ceph-mon[32572]: pgmap v12092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22092.250947 secs 2024-04-26T17:56:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:17 smithi110 ceph-mon[28069]: pgmap v12093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:18.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22092.250947 secs 2024-04-26T17:56:18.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:17 smithi196 ceph-mon[32572]: pgmap v12093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:18.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22092.250947 secs 2024-04-26T17:56:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:17 smithi193 ceph-mon[32782]: pgmap v12093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:19 smithi110 ceph-mon[28069]: pgmap v12094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:19 smithi193 ceph-mon[32782]: pgmap v12094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:19 smithi196 ceph-mon[32572]: pgmap v12094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:21 smithi193 ceph-mon[32782]: pgmap v12095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:21 smithi196 ceph-mon[32572]: pgmap v12095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:21 smithi110 ceph-mon[28069]: pgmap v12095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22097.251066 secs 2024-04-26T17:56:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22097.251066 secs 2024-04-26T17:56:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22097.251066 secs 2024-04-26T17:56:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:23 smithi193 ceph-mon[32782]: pgmap v12096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:23 smithi196 ceph-mon[32572]: pgmap v12096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:23 smithi110 ceph-mon[28069]: pgmap v12096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:25 smithi193 ceph-mon[32782]: pgmap v12097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:25 smithi196 ceph-mon[32572]: pgmap v12097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:25 smithi110 ceph-mon[28069]: pgmap v12097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22102.251202 secs 2024-04-26T17:56:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:27 smithi193 ceph-mon[32782]: pgmap v12098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22102.251202 secs 2024-04-26T17:56:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:27 smithi196 ceph-mon[32572]: pgmap v12098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22102.251202 secs 2024-04-26T17:56:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:27 smithi110 ceph-mon[28069]: pgmap v12098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:29 smithi193 ceph-mon[32782]: pgmap v12099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:29 smithi196 ceph-mon[32572]: pgmap v12099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:29 smithi110 ceph-mon[28069]: pgmap v12099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:31 smithi193 ceph-mon[32782]: pgmap v12100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:31 smithi196 ceph-mon[32572]: pgmap v12100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:31 smithi110 ceph-mon[28069]: pgmap v12100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22107.251347 secs 2024-04-26T17:56:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22107.251347 secs 2024-04-26T17:56:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22107.251347 secs 2024-04-26T17:56:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:33 smithi193 ceph-mon[32782]: pgmap v12101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:33 smithi196 ceph-mon[32572]: pgmap v12101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:33 smithi110 ceph-mon[28069]: pgmap v12101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:35 smithi193 ceph-mon[32782]: pgmap v12102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:35 smithi196 ceph-mon[32572]: pgmap v12102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:35 smithi110 ceph-mon[28069]: pgmap v12102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:38.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22112.251472 secs 2024-04-26T17:56:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:37 smithi193 ceph-mon[32782]: pgmap v12103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:56:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22112.251472 secs 2024-04-26T17:56:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:37 smithi196 ceph-mon[32572]: pgmap v12103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:56:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22112.251472 secs 2024-04-26T17:56:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:37 smithi110 ceph-mon[28069]: pgmap v12103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:56:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:56:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:56:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:56:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:56:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:56:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:56:40.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:39 smithi193 ceph-mon[32782]: pgmap v12104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:56:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:39 smithi193 ceph-mon[32782]: pgmap v12105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:39 smithi196 ceph-mon[32572]: pgmap v12104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:56:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:39 smithi196 ceph-mon[32572]: pgmap v12105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:39 smithi110 ceph-mon[28069]: pgmap v12104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T17:56:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:39 smithi110 ceph-mon[28069]: pgmap v12105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:41 smithi193 ceph-mon[32782]: pgmap v12106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:41 smithi196 ceph-mon[32572]: pgmap v12106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:41 smithi110 ceph-mon[28069]: pgmap v12106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22117.251630 secs 2024-04-26T17:56:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22117.251630 secs 2024-04-26T17:56:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22117.251630 secs 2024-04-26T17:56:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:43 smithi196 ceph-mon[32572]: pgmap v12107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:56:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:43 smithi110 ceph-mon[28069]: pgmap v12107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:56:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:43 smithi193 ceph-mon[32782]: pgmap v12107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T17:56:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:45 smithi196 ceph-mon[32572]: pgmap v12108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:45 smithi110 ceph-mon[28069]: pgmap v12108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:45 smithi193 ceph-mon[32782]: pgmap v12108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:47 smithi196 ceph-mon[32572]: pgmap v12109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22122.251751 secs 2024-04-26T17:56:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:47 smithi110 ceph-mon[28069]: pgmap v12109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22122.251751 secs 2024-04-26T17:56:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:47 smithi193 ceph-mon[32782]: pgmap v12109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:56:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22122.251751 secs 2024-04-26T17:56:50.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:49 smithi193 ceph-mon[32782]: pgmap v12110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:56:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:49 smithi196 ceph-mon[32572]: pgmap v12110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:56:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:49 smithi110 ceph-mon[28069]: pgmap v12110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:56:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:51 smithi196 ceph-mon[32572]: pgmap v12111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:51 smithi110 ceph-mon[28069]: pgmap v12111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:51 smithi193 ceph-mon[32782]: pgmap v12111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22127.251864 secs 2024-04-26T17:56:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22127.251864 secs 2024-04-26T17:56:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22127.251864 secs 2024-04-26T17:56:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:53 smithi196 ceph-mon[32572]: pgmap v12112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:53 smithi110 ceph-mon[28069]: pgmap v12112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:53 smithi193 ceph-mon[32782]: pgmap v12112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:55 smithi196 ceph-mon[32572]: pgmap v12113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:55 smithi110 ceph-mon[28069]: pgmap v12113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:56.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:55 smithi193 ceph-mon[32782]: pgmap v12113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:56:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:57 smithi196 ceph-mon[32572]: pgmap v12114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22132.251989 secs 2024-04-26T17:56:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:57 smithi110 ceph-mon[28069]: pgmap v12114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22132.251989 secs 2024-04-26T17:56:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:57 smithi193 ceph-mon[32782]: pgmap v12114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:56:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22132.251989 secs 2024-04-26T17:57:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:56:59 smithi196 ceph-mon[32572]: pgmap v12115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:56:59 smithi110 ceph-mon[28069]: pgmap v12115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:00.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:56:59 smithi193 ceph-mon[32782]: pgmap v12115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:01 smithi196 ceph-mon[32572]: pgmap v12116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:01 smithi110 ceph-mon[28069]: pgmap v12116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:01 smithi193 ceph-mon[32782]: pgmap v12116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22137.252103 secs 2024-04-26T17:57:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22137.252103 secs 2024-04-26T17:57:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22137.252103 secs 2024-04-26T17:57:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:03 smithi196 ceph-mon[32572]: pgmap v12117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:03 smithi110 ceph-mon[28069]: pgmap v12117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:04.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:03 smithi193 ceph-mon[32782]: pgmap v12117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:05 smithi196 ceph-mon[32572]: pgmap v12118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:05 smithi110 ceph-mon[28069]: pgmap v12118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:05 smithi193 ceph-mon[32782]: pgmap v12118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:07 smithi196 ceph-mon[32572]: pgmap v12119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22142.252245 secs 2024-04-26T17:57:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:07 smithi110 ceph-mon[28069]: pgmap v12119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22142.252245 secs 2024-04-26T17:57:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:07 smithi193 ceph-mon[32782]: pgmap v12119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22142.252245 secs 2024-04-26T17:57:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:09 smithi196 ceph-mon[32572]: pgmap v12120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:09 smithi110 ceph-mon[28069]: pgmap v12120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:09 smithi193 ceph-mon[32782]: pgmap v12120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:11 smithi196 ceph-mon[32572]: pgmap v12121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:11 smithi110 ceph-mon[28069]: pgmap v12121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:11 smithi193 ceph-mon[32782]: pgmap v12121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22147.252368 secs 2024-04-26T17:57:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22147.252368 secs 2024-04-26T17:57:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22147.252368 secs 2024-04-26T17:57:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:13 smithi196 ceph-mon[32572]: pgmap v12122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:13 smithi110 ceph-mon[28069]: pgmap v12122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:13 smithi193 ceph-mon[32782]: pgmap v12122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:15 smithi196 ceph-mon[32572]: pgmap v12123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:15 smithi110 ceph-mon[28069]: pgmap v12123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:15 smithi193 ceph-mon[32782]: pgmap v12123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:17 smithi196 ceph-mon[32572]: pgmap v12124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22152.252499 secs 2024-04-26T17:57:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:17 smithi110 ceph-mon[28069]: pgmap v12124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22152.252499 secs 2024-04-26T17:57:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:17 smithi193 ceph-mon[32782]: pgmap v12124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22152.252499 secs 2024-04-26T17:57:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:57:20.028+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:57:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:57:20.028+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T17:57:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:57:20.029+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 172 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T17:57:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:57:20.029+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 172 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:57:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:19 smithi196 ceph-mon[32572]: pgmap v12125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:19 smithi110 ceph-mon[28069]: pgmap v12125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:19 smithi193 ceph-mon[32782]: pgmap v12125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:22 smithi196 ceph-mon[32572]: pgmap v12126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:22 smithi110 ceph-mon[28069]: pgmap v12126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:22 smithi193 ceph-mon[32782]: pgmap v12126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:23 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22157.252650 secs 2024-04-26T17:57:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:23 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22157.252650 secs 2024-04-26T17:57:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:23 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22157.252650 secs 2024-04-26T17:57:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:24 smithi110 ceph-mon[28069]: pgmap v12127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:24 smithi193 ceph-mon[32782]: pgmap v12127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:24 smithi196 ceph-mon[32572]: pgmap v12127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:26 smithi110 ceph-mon[28069]: pgmap v12128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:26 smithi193 ceph-mon[32782]: pgmap v12128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:26 smithi196 ceph-mon[32572]: pgmap v12128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:28 smithi110 ceph-mon[28069]: pgmap v12129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:28 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22162.252778 secs 2024-04-26T17:57:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:28 smithi193 ceph-mon[32782]: pgmap v12129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:28 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22162.252778 secs 2024-04-26T17:57:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:28 smithi196 ceph-mon[32572]: pgmap v12129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:28 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22162.252778 secs 2024-04-26T17:57:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:30 smithi110 ceph-mon[28069]: pgmap v12130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:30 smithi193 ceph-mon[32782]: pgmap v12130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:30 smithi196 ceph-mon[32572]: pgmap v12130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:32 smithi110 ceph-mon[28069]: pgmap v12131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:32 smithi193 ceph-mon[32782]: pgmap v12131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:32 smithi196 ceph-mon[32572]: pgmap v12131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:33 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22167.252840 secs 2024-04-26T17:57:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:33 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22167.252840 secs 2024-04-26T17:57:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:33 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22167.252840 secs 2024-04-26T17:57:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:34 smithi193 ceph-mon[32782]: pgmap v12132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:34 smithi196 ceph-mon[32572]: pgmap v12132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:34 smithi110 ceph-mon[28069]: pgmap v12132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:36 smithi193 ceph-mon[32782]: pgmap v12133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:36 smithi196 ceph-mon[32572]: pgmap v12133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:36 smithi110 ceph-mon[28069]: pgmap v12133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:38 smithi193 ceph-mon[32782]: pgmap v12134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:38 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22172.252940 secs 2024-04-26T17:57:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:38 smithi196 ceph-mon[32572]: pgmap v12134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:38 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22172.252940 secs 2024-04-26T17:57:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:38 smithi110 ceph-mon[28069]: pgmap v12134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:38 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22172.252940 secs 2024-04-26T17:57:39.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:57:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:57:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:57:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:40 smithi193 ceph-mon[32782]: pgmap v12135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:40 smithi196 ceph-mon[32572]: pgmap v12135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:40 smithi110 ceph-mon[28069]: pgmap v12135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:42.311 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:42 smithi193 ceph-mon[32782]: pgmap v12136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:42 smithi196 ceph-mon[32572]: pgmap v12136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:42 smithi110 ceph-mon[28069]: pgmap v12136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:43 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22177.253003 secs 2024-04-26T17:57:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:57:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:57:43.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:43 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22177.253003 secs 2024-04-26T17:57:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:57:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:57:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:43 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22177.253003 secs 2024-04-26T17:57:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:57:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:57:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:57:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:44 smithi193 ceph-mon[32782]: pgmap v12137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:44 smithi193 ceph-mon[32782]: pgmap v12138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:57:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:44 smithi193 ceph-mon[32782]: pgmap v12139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:44 smithi196 ceph-mon[32572]: pgmap v12137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:44 smithi196 ceph-mon[32572]: pgmap v12138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:57:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:44 smithi196 ceph-mon[32572]: pgmap v12139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:44 smithi110 ceph-mon[28069]: pgmap v12137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:44 smithi110 ceph-mon[28069]: pgmap v12138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:57:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:44 smithi110 ceph-mon[28069]: pgmap v12139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:46 smithi193 ceph-mon[32782]: pgmap v12140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:46 smithi196 ceph-mon[32572]: pgmap v12140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:46 smithi110 ceph-mon[28069]: pgmap v12140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:48 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22182.253133 secs 2024-04-26T17:57:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:48 smithi196 ceph-mon[32572]: pgmap v12141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 599 B/s rd, 1 op/s 2024-04-26T17:57:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:48 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22182.253133 secs 2024-04-26T17:57:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:48 smithi110 ceph-mon[28069]: pgmap v12141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 599 B/s rd, 1 op/s 2024-04-26T17:57:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:48 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22182.253133 secs 2024-04-26T17:57:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:48 smithi193 ceph-mon[32782]: pgmap v12141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 599 B/s rd, 1 op/s 2024-04-26T17:57:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:50 smithi196 ceph-mon[32572]: pgmap v12142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:50 smithi110 ceph-mon[28069]: pgmap v12142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:50 smithi193 ceph-mon[32782]: pgmap v12142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:52 smithi196 ceph-mon[32572]: pgmap v12143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:52 smithi110 ceph-mon[28069]: pgmap v12143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:52 smithi193 ceph-mon[32782]: pgmap v12143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:57:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:53 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22187.253269 secs 2024-04-26T17:57:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:53 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22187.253269 secs 2024-04-26T17:57:53.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:53 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22187.253269 secs 2024-04-26T17:57:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:54 smithi196 ceph-mon[32572]: pgmap v12144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:57:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:54 smithi110 ceph-mon[28069]: pgmap v12144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:57:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:54 smithi193 ceph-mon[32782]: pgmap v12144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:57:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:55 smithi196 ceph-mon[32572]: pgmap v12145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:55 smithi110 ceph-mon[28069]: pgmap v12145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:55 smithi193 ceph-mon[32782]: pgmap v12145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:58 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22192.253399 secs 2024-04-26T17:57:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:57:58 smithi196 ceph-mon[32572]: pgmap v12146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:58 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22192.253399 secs 2024-04-26T17:57:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:57:58 smithi110 ceph-mon[28069]: pgmap v12146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:57:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:58 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22192.253399 secs 2024-04-26T17:57:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:57:58 smithi193 ceph-mon[32782]: pgmap v12146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:00 smithi196 ceph-mon[32572]: pgmap v12147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:00 smithi110 ceph-mon[28069]: pgmap v12147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:00 smithi193 ceph-mon[32782]: pgmap v12147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:02 smithi196 ceph-mon[32572]: pgmap v12148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:02 smithi110 ceph-mon[28069]: pgmap v12148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:02 smithi193 ceph-mon[32782]: pgmap v12148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:03 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22197.253520 secs 2024-04-26T17:58:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:03 smithi196 ceph-mon[32572]: pgmap v12149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:03 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22197.253520 secs 2024-04-26T17:58:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:03 smithi110 ceph-mon[28069]: pgmap v12149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:03 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22197.253520 secs 2024-04-26T17:58:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:03 smithi193 ceph-mon[32782]: pgmap v12149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:05 smithi193 ceph-mon[32782]: pgmap v12150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:05 smithi196 ceph-mon[32572]: pgmap v12150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:05 smithi110 ceph-mon[28069]: pgmap v12150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:08 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22202.253645 secs 2024-04-26T17:58:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:08 smithi196 ceph-mon[32572]: pgmap v12151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:08 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22202.253645 secs 2024-04-26T17:58:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:08 smithi110 ceph-mon[28069]: pgmap v12151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:08 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22202.253645 secs 2024-04-26T17:58:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:08 smithi193 ceph-mon[32782]: pgmap v12151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:10 smithi196 ceph-mon[32572]: pgmap v12152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:10 smithi110 ceph-mon[28069]: pgmap v12152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:10 smithi193 ceph-mon[32782]: pgmap v12152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:11 smithi196 ceph-mon[32572]: pgmap v12153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:58:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:11 smithi110 ceph-mon[28069]: pgmap v12153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:58:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:11 smithi193 ceph-mon[32782]: pgmap v12153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:58:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22207.253739 secs 2024-04-26T17:58:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22207.253739 secs 2024-04-26T17:58:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22207.253739 secs 2024-04-26T17:58:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:13 smithi193 ceph-mon[32782]: pgmap v12154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:13 smithi196 ceph-mon[32572]: pgmap v12154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:13 smithi110 ceph-mon[28069]: pgmap v12154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:15 smithi193 ceph-mon[32782]: pgmap v12155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:58:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:15 smithi196 ceph-mon[32572]: pgmap v12155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:58:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:15 smithi110 ceph-mon[28069]: pgmap v12155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:58:18.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22212.253862 secs 2024-04-26T17:58:18.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:17 smithi110 ceph-mon[28069]: pgmap v12156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:58:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22212.253862 secs 2024-04-26T17:58:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:17 smithi193 ceph-mon[32782]: pgmap v12156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:58:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22212.253862 secs 2024-04-26T17:58:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:17 smithi196 ceph-mon[32572]: pgmap v12156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T17:58:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:19 smithi193 ceph-mon[32782]: pgmap v12157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:19 smithi196 ceph-mon[32572]: pgmap v12157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:19 smithi110 ceph-mon[28069]: pgmap v12157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:21 smithi193 ceph-mon[32782]: pgmap v12158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:21 smithi196 ceph-mon[32572]: pgmap v12158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:21 smithi110 ceph-mon[28069]: pgmap v12158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22217.253981 secs 2024-04-26T17:58:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22217.253981 secs 2024-04-26T17:58:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22217.253981 secs 2024-04-26T17:58:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:23 smithi193 ceph-mon[32782]: pgmap v12159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:23 smithi196 ceph-mon[32572]: pgmap v12159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:23 smithi110 ceph-mon[28069]: pgmap v12159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:25 smithi193 ceph-mon[32782]: pgmap v12160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:25 smithi196 ceph-mon[32572]: pgmap v12160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:25 smithi110 ceph-mon[28069]: pgmap v12160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22222.254124 secs 2024-04-26T17:58:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:27 smithi193 ceph-mon[32782]: pgmap v12161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22222.254124 secs 2024-04-26T17:58:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:27 smithi196 ceph-mon[32572]: pgmap v12161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22222.254124 secs 2024-04-26T17:58:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:27 smithi110 ceph-mon[28069]: pgmap v12161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:29 smithi193 ceph-mon[32782]: pgmap v12162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:29 smithi196 ceph-mon[32572]: pgmap v12162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:29 smithi110 ceph-mon[28069]: pgmap v12162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:31 smithi193 ceph-mon[32782]: pgmap v12163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:31 smithi196 ceph-mon[32572]: pgmap v12163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:31 smithi110 ceph-mon[28069]: pgmap v12163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22227.254241 secs 2024-04-26T17:58:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22227.254241 secs 2024-04-26T17:58:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22227.254241 secs 2024-04-26T17:58:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:33 smithi196 ceph-mon[32572]: pgmap v12164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:33 smithi110 ceph-mon[28069]: pgmap v12164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:33 smithi193 ceph-mon[32782]: pgmap v12164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:35 smithi196 ceph-mon[32572]: pgmap v12165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:35 smithi110 ceph-mon[28069]: pgmap v12165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:35 smithi193 ceph-mon[32782]: pgmap v12165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:36 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22232.254365 secs 2024-04-26T17:58:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:36 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22232.254365 secs 2024-04-26T17:58:37.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:36 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22232.254365 secs 2024-04-26T17:58:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:37 smithi196 ceph-mon[32572]: pgmap v12166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:37 smithi110 ceph-mon[28069]: pgmap v12166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:37 smithi193 ceph-mon[32782]: pgmap v12166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:39 smithi196 ceph-mon[32572]: pgmap v12167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:39 smithi110 ceph-mon[28069]: pgmap v12167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:39 smithi193 ceph-mon[32782]: pgmap v12167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:41 smithi196 ceph-mon[32572]: pgmap v12168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:41 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22237.254509 secs 2024-04-26T17:58:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:41 smithi110 ceph-mon[28069]: pgmap v12168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:41 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22237.254509 secs 2024-04-26T17:58:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:41 smithi193 ceph-mon[32782]: pgmap v12168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:41 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22237.254509 secs 2024-04-26T17:58:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:43 smithi196 ceph-mon[32572]: pgmap v12169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:58:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:43 smithi110 ceph-mon[28069]: pgmap v12169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:58:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:43 smithi193 ceph-mon[32782]: pgmap v12169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:58:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:58:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:58:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:58:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:58:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:58:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:58:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:58:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:58:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:58:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:58:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:45 smithi196 ceph-mon[32572]: pgmap v12170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:58:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:45 smithi196 ceph-mon[32572]: pgmap v12171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:45 smithi110 ceph-mon[28069]: pgmap v12170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:58:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:45 smithi110 ceph-mon[28069]: pgmap v12171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:45 smithi193 ceph-mon[32782]: pgmap v12170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T17:58:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:45 smithi193 ceph-mon[32782]: pgmap v12171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:46 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22242.254639 secs 2024-04-26T17:58:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:46 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22242.254639 secs 2024-04-26T17:58:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:46 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22242.254639 secs 2024-04-26T17:58:48.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:47 smithi110 ceph-mon[28069]: pgmap v12172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:47 smithi196 ceph-mon[32572]: pgmap v12172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:47 smithi193 ceph-mon[32782]: pgmap v12172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:49 smithi196 ceph-mon[32572]: pgmap v12173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:49 smithi110 ceph-mon[28069]: pgmap v12173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:49 smithi193 ceph-mon[32782]: pgmap v12173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:51 smithi196 ceph-mon[32572]: pgmap v12174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22247.254765 secs 2024-04-26T17:58:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:51 smithi110 ceph-mon[28069]: pgmap v12174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22247.254765 secs 2024-04-26T17:58:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:51 smithi193 ceph-mon[32782]: pgmap v12174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T17:58:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22247.254765 secs 2024-04-26T17:58:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:53 smithi196 ceph-mon[32572]: pgmap v12175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:58:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:53 smithi110 ceph-mon[28069]: pgmap v12175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:58:54.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:53 smithi193 ceph-mon[32782]: pgmap v12175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T17:58:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:55 smithi196 ceph-mon[32572]: pgmap v12176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:58:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:55 smithi110 ceph-mon[28069]: pgmap v12176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:58:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:55 smithi193 ceph-mon[32782]: pgmap v12176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T17:58:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22252.254874 secs 2024-04-26T17:58:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22252.254874 secs 2024-04-26T17:58:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22252.254874 secs 2024-04-26T17:58:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:57 smithi196 ceph-mon[32572]: pgmap v12177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:57 smithi110 ceph-mon[28069]: pgmap v12177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:58:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:57 smithi193 ceph-mon[32782]: pgmap v12177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:58:59 smithi196 ceph-mon[32572]: pgmap v12178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:58:59 smithi110 ceph-mon[28069]: pgmap v12178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:58:59 smithi193 ceph-mon[32782]: pgmap v12178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:01 smithi196 ceph-mon[32572]: pgmap v12179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:01 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22257.254988 secs 2024-04-26T17:59:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:01 smithi110 ceph-mon[28069]: pgmap v12179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:01 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22257.254988 secs 2024-04-26T17:59:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:01 smithi193 ceph-mon[32782]: pgmap v12179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:01 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22257.254988 secs 2024-04-26T17:59:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:03 smithi196 ceph-mon[32572]: pgmap v12180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:03 smithi110 ceph-mon[28069]: pgmap v12180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:03 smithi193 ceph-mon[32782]: pgmap v12180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:05 smithi196 ceph-mon[32572]: pgmap v12181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:59:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:05 smithi110 ceph-mon[28069]: pgmap v12181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:59:06.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:05 smithi193 ceph-mon[32782]: pgmap v12181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:59:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22262.255085 secs 2024-04-26T17:59:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22262.255085 secs 2024-04-26T17:59:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22262.255085 secs 2024-04-26T17:59:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:08 smithi110 ceph-mon[28069]: pgmap v12182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:08 smithi193 ceph-mon[32782]: pgmap v12182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:08 smithi196 ceph-mon[32572]: pgmap v12182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:10 smithi110 ceph-mon[28069]: pgmap v12183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:10 smithi193 ceph-mon[32782]: pgmap v12183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:10 smithi196 ceph-mon[32572]: pgmap v12183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:59:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:59:11.030+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:59:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:59:11.030+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:59:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:59:11.030+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:59:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:59:11.030+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:11.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 17:59:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T17:59:11.030+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:12 smithi110 ceph-mon[28069]: pgmap v12184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22267.255209 secs 2024-04-26T17:59:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:12 smithi193 ceph-mon[32782]: pgmap v12184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22267.255209 secs 2024-04-26T17:59:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:12 smithi196 ceph-mon[32572]: pgmap v12184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22267.255209 secs 2024-04-26T17:59:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:14 smithi110 ceph-mon[28069]: pgmap v12185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T17:59:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:14 smithi193 ceph-mon[32782]: pgmap v12185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T17:59:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:14 smithi196 ceph-mon[32572]: pgmap v12185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T17:59:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:16 smithi110 ceph-mon[28069]: pgmap v12186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:59:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:16 smithi193 ceph-mon[32782]: pgmap v12186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:59:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:16 smithi196 ceph-mon[32572]: pgmap v12186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:59:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22272.255349 secs 2024-04-26T17:59:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22272.255349 secs 2024-04-26T17:59:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22272.255349 secs 2024-04-26T17:59:18.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:18 smithi193 ceph-mon[32782]: pgmap v12187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:59:18.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:18 smithi196 ceph-mon[32572]: pgmap v12187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:59:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:18 smithi110 ceph-mon[28069]: pgmap v12187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:59:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:20 smithi193 ceph-mon[32782]: pgmap v12188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:59:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:20 smithi196 ceph-mon[32572]: pgmap v12188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:59:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:20 smithi110 ceph-mon[28069]: pgmap v12188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:59:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:22 smithi193 ceph-mon[32782]: pgmap v12189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:59:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22277.255435 secs 2024-04-26T17:59:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:22 smithi196 ceph-mon[32572]: pgmap v12189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:59:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22277.255435 secs 2024-04-26T17:59:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:22 smithi110 ceph-mon[28069]: pgmap v12189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T17:59:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22277.255435 secs 2024-04-26T17:59:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:24 smithi193 ceph-mon[32782]: pgmap v12190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:59:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:24 smithi196 ceph-mon[32572]: pgmap v12190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:59:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:24 smithi110 ceph-mon[28069]: pgmap v12190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T17:59:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:26 smithi193 ceph-mon[32782]: pgmap v12191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-04-26T17:59:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:26 smithi196 ceph-mon[32572]: pgmap v12191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-04-26T17:59:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:26 smithi110 ceph-mon[28069]: pgmap v12191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-04-26T17:59:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22282.255560 secs 2024-04-26T17:59:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22282.255560 secs 2024-04-26T17:59:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22282.255560 secs 2024-04-26T17:59:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:28 smithi193 ceph-mon[32782]: pgmap v12192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:28 smithi196 ceph-mon[32572]: pgmap v12192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:28 smithi110 ceph-mon[28069]: pgmap v12192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:30 smithi193 ceph-mon[32782]: pgmap v12193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:30 smithi196 ceph-mon[32572]: pgmap v12193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:30 smithi110 ceph-mon[28069]: pgmap v12193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:32 smithi193 ceph-mon[32782]: pgmap v12194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22287.255684 secs 2024-04-26T17:59:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:32 smithi196 ceph-mon[32572]: pgmap v12194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22287.255684 secs 2024-04-26T17:59:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:32 smithi110 ceph-mon[28069]: pgmap v12194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22287.255684 secs 2024-04-26T17:59:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:34 smithi193 ceph-mon[32782]: pgmap v12195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:34 smithi196 ceph-mon[32572]: pgmap v12195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:34 smithi110 ceph-mon[28069]: pgmap v12195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:35.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:59:35.050+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T17:59:35.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:59:35.050+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006380 con 0x7f261c104b50 2024-04-26T17:59:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:59:35.050+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 173 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006380 con 0x55db1be4fdd0 2024-04-26T17:59:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T17:59:35.050+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 173 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T17:59:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:36 smithi193 ceph-mon[32782]: pgmap v12196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:59:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:36 smithi196 ceph-mon[32572]: pgmap v12196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:59:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:36 smithi110 ceph-mon[28069]: pgmap v12196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:59:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22292.255745 secs 2024-04-26T17:59:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22292.255745 secs 2024-04-26T17:59:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22292.255745 secs 2024-04-26T17:59:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:38 smithi193 ceph-mon[32782]: pgmap v12197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:38 smithi196 ceph-mon[32572]: pgmap v12197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:38 smithi110 ceph-mon[28069]: pgmap v12197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:40 smithi193 ceph-mon[32782]: pgmap v12198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:40 smithi196 ceph-mon[32572]: pgmap v12198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:40 smithi110 ceph-mon[28069]: pgmap v12198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:42 smithi193 ceph-mon[32782]: pgmap v12199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22297.255872 secs 2024-04-26T17:59:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:42 smithi196 ceph-mon[32572]: pgmap v12199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22297.255872 secs 2024-04-26T17:59:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:42 smithi110 ceph-mon[28069]: pgmap v12199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22297.255872 secs 2024-04-26T17:59:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:44 smithi196 ceph-mon[32572]: pgmap v12200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:44 smithi110 ceph-mon[28069]: pgmap v12200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:44.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:44 smithi193 ceph-mon[32782]: pgmap v12200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:46 smithi196 ceph-mon[32572]: pgmap v12201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:59:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:46 smithi110 ceph-mon[28069]: pgmap v12201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:59:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:46 smithi193 ceph-mon[32782]: pgmap v12201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T17:59:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22302.255968 secs 2024-04-26T17:59:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22302.255968 secs 2024-04-26T17:59:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22302.255968 secs 2024-04-26T17:59:48.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:48 smithi196 ceph-mon[32572]: pgmap v12202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:48 smithi110 ceph-mon[28069]: pgmap v12202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:48 smithi193 ceph-mon[32782]: pgmap v12202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:50 smithi196 ceph-mon[32572]: pgmap v12203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:50.510 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:50 smithi110 ceph-mon[28069]: pgmap v12203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:50 smithi193 ceph-mon[32782]: pgmap v12203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T17:59:52.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:52 smithi193 ceph-mon[32782]: pgmap v12204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:52.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:59:52.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:59:52.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:52.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:52.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:59:52.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22307.256030 secs 2024-04-26T17:59:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:52 smithi196 ceph-mon[32572]: pgmap v12204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:59:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:59:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:59:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22307.256030 secs 2024-04-26T17:59:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:52 smithi110 ceph-mon[28069]: pgmap v12204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T17:59:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:59:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:59:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T17:59:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22307.256030 secs 2024-04-26T17:59:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:53 smithi196 ceph-mon[32572]: pgmap v12205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T17:59:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:53 smithi110 ceph-mon[28069]: pgmap v12205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T17:59:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:53 smithi193 ceph-mon[32782]: pgmap v12205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T17:59:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:55 smithi196 ceph-mon[32572]: pgmap v12206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 2 op/s 2024-04-26T17:59:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:55 smithi110 ceph-mon[28069]: pgmap v12206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 2 op/s 2024-04-26T17:59:55.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:55 smithi193 ceph-mon[32782]: pgmap v12206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 2 op/s 2024-04-26T17:59:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:57 smithi196 ceph-mon[32572]: pgmap v12207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T17:59:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22312.256176 secs 2024-04-26T17:59:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:57 smithi110 ceph-mon[28069]: pgmap v12207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T17:59:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22312.256176 secs 2024-04-26T17:59:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:57 smithi193 ceph-mon[32782]: pgmap v12207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T17:59:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22312.256176 secs 2024-04-26T17:59:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 17:59:59 smithi196 ceph-mon[32572]: pgmap v12208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:59:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 17:59:59 smithi110 ceph-mon[28069]: pgmap v12208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T17:59:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 17:59:59 smithi193 ceph-mon[32782]: pgmap v12208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T18:00:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:00:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:00:00.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:00:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:01 smithi196 ceph-mon[32572]: pgmap v12209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T18:00:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:01 smithi110 ceph-mon[28069]: pgmap v12209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T18:00:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:01 smithi193 ceph-mon[32782]: pgmap v12209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T18:00:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22317.256301 secs 2024-04-26T18:00:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22317.256301 secs 2024-04-26T18:00:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22317.256301 secs 2024-04-26T18:00:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:03 smithi196 ceph-mon[32572]: pgmap v12210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T18:00:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:03 smithi110 ceph-mon[28069]: pgmap v12210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T18:00:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:03 smithi193 ceph-mon[32782]: pgmap v12210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T18:00:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:05 smithi196 ceph-mon[32572]: pgmap v12211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:05 smithi110 ceph-mon[28069]: pgmap v12211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:05 smithi193 ceph-mon[32782]: pgmap v12211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:07 smithi196 ceph-mon[32572]: pgmap v12212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22322.256442 secs 2024-04-26T18:00:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:07 smithi110 ceph-mon[28069]: pgmap v12212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22322.256442 secs 2024-04-26T18:00:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:07 smithi193 ceph-mon[32782]: pgmap v12212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22322.256442 secs 2024-04-26T18:00:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:09 smithi196 ceph-mon[32572]: pgmap v12213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T18:00:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:09 smithi110 ceph-mon[28069]: pgmap v12213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T18:00:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:09 smithi193 ceph-mon[32782]: pgmap v12213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T18:00:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:10 smithi110 ceph-mon[28069]: pgmap v12214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:10 smithi193 ceph-mon[32782]: pgmap v12214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:10 smithi196 ceph-mon[32572]: pgmap v12214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:12 smithi110 ceph-mon[28069]: pgmap v12215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22327.256588 secs 2024-04-26T18:00:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:12 smithi193 ceph-mon[32782]: pgmap v12215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22327.256588 secs 2024-04-26T18:00:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:12 smithi196 ceph-mon[32572]: pgmap v12215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22327.256588 secs 2024-04-26T18:00:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:14 smithi110 ceph-mon[28069]: pgmap v12216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:14.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:14 smithi193 ceph-mon[32782]: pgmap v12216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:14 smithi196 ceph-mon[32572]: pgmap v12216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:16 smithi110 ceph-mon[28069]: pgmap v12217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:16 smithi193 ceph-mon[32782]: pgmap v12217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:16 smithi196 ceph-mon[32572]: pgmap v12217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22332.256580 secs 2024-04-26T18:00:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22332.256580 secs 2024-04-26T18:00:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22332.256580 secs 2024-04-26T18:00:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:18 smithi110 ceph-mon[28069]: pgmap v12218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:18 smithi193 ceph-mon[32782]: pgmap v12218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:18.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:18 smithi196 ceph-mon[32572]: pgmap v12218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:00:20.058+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006380 con 0x7f261c104b50 2024-04-26T18:00:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:00:20.058+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:00:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:00:20.059+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 174 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:00:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:00:20.059+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 174 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006380 con 0x55db1be4fdd0 2024-04-26T18:00:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:20 smithi193 ceph-mon[32782]: pgmap v12219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:20 smithi196 ceph-mon[32572]: pgmap v12219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:20 smithi110 ceph-mon[28069]: pgmap v12219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:22 smithi193 ceph-mon[32782]: pgmap v12220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22337.256671 secs 2024-04-26T18:00:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:22 smithi196 ceph-mon[32572]: pgmap v12220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22337.256671 secs 2024-04-26T18:00:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:22 smithi110 ceph-mon[28069]: pgmap v12220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22337.256671 secs 2024-04-26T18:00:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:24 smithi193 ceph-mon[32782]: pgmap v12221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:24 smithi196 ceph-mon[32572]: pgmap v12221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:24 smithi110 ceph-mon[28069]: pgmap v12221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:26 smithi193 ceph-mon[32782]: pgmap v12222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:26 smithi196 ceph-mon[32572]: pgmap v12222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:26 smithi110 ceph-mon[28069]: pgmap v12222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22342.256736 secs 2024-04-26T18:00:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22342.256736 secs 2024-04-26T18:00:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22342.256736 secs 2024-04-26T18:00:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:28 smithi193 ceph-mon[32782]: pgmap v12223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:28 smithi196 ceph-mon[32572]: pgmap v12223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:28 smithi110 ceph-mon[28069]: pgmap v12223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:30 smithi110 ceph-mon[28069]: pgmap v12224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:30 smithi193 ceph-mon[32782]: pgmap v12224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:30 smithi196 ceph-mon[32572]: pgmap v12224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:31 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22347.256854 secs 2024-04-26T18:00:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:31 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22347.256854 secs 2024-04-26T18:00:32.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:31 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22347.256854 secs 2024-04-26T18:00:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:32 smithi193 ceph-mon[32782]: pgmap v12225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:32 smithi196 ceph-mon[32572]: pgmap v12225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:32 smithi110 ceph-mon[28069]: pgmap v12225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:34 smithi193 ceph-mon[32782]: pgmap v12226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:34 smithi196 ceph-mon[32572]: pgmap v12226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:34 smithi110 ceph-mon[28069]: pgmap v12226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:36.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:36 smithi193 ceph-mon[32782]: pgmap v12227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:36 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22352.256933 secs 2024-04-26T18:00:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:36 smithi196 ceph-mon[32572]: pgmap v12227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:36 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22352.256933 secs 2024-04-26T18:00:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:36 smithi110 ceph-mon[28069]: pgmap v12227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:36 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22352.256933 secs 2024-04-26T18:00:38.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:38 smithi193 ceph-mon[32782]: pgmap v12228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:38 smithi196 ceph-mon[32572]: pgmap v12228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:38 smithi110 ceph-mon[28069]: pgmap v12228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:40 smithi193 ceph-mon[32782]: pgmap v12229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:40 smithi196 ceph-mon[32572]: pgmap v12229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:40 smithi110 ceph-mon[28069]: pgmap v12229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:41 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22357.257053 secs 2024-04-26T18:00:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:41 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22357.257053 secs 2024-04-26T18:00:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:41 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22357.257053 secs 2024-04-26T18:00:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:42 smithi193 ceph-mon[32782]: pgmap v12230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:42 smithi196 ceph-mon[32572]: pgmap v12230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:42 smithi110 ceph-mon[28069]: pgmap v12230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:44 smithi196 ceph-mon[32572]: pgmap v12231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:44 smithi110 ceph-mon[28069]: pgmap v12231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:44 smithi193 ceph-mon[32782]: pgmap v12231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:46 smithi196 ceph-mon[32572]: pgmap v12232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:46 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22362.257174 secs 2024-04-26T18:00:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:46 smithi110 ceph-mon[28069]: pgmap v12232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:46 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22362.257174 secs 2024-04-26T18:00:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:46 smithi193 ceph-mon[32782]: pgmap v12232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:46 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22362.257174 secs 2024-04-26T18:00:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:48 smithi196 ceph-mon[32572]: pgmap v12233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:48 smithi110 ceph-mon[28069]: pgmap v12233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:48 smithi193 ceph-mon[32782]: pgmap v12233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:00:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:50 smithi196 ceph-mon[32572]: pgmap v12234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:50 smithi110 ceph-mon[28069]: pgmap v12234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:50 smithi193 ceph-mon[32782]: pgmap v12234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:00:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22367.257293 secs 2024-04-26T18:00:52.021 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22367.257293 secs 2024-04-26T18:00:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22367.257293 secs 2024-04-26T18:00:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:52 smithi196 ceph-mon[32572]: pgmap v12235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:00:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:52 smithi110 ceph-mon[28069]: pgmap v12235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:00:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:52 smithi193 ceph-mon[32782]: pgmap v12235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:00:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:00:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:00:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:00:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:53 smithi196 ceph-mon[32572]: pgmap v12236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:00:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:53 smithi196 ceph-mon[32572]: pgmap v12237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:00:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:00:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:00:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:00:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:53 smithi110 ceph-mon[28069]: pgmap v12236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:00:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:53 smithi110 ceph-mon[28069]: pgmap v12237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:00:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:00:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:00:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:00:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:53 smithi193 ceph-mon[32782]: pgmap v12236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:00:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:53 smithi193 ceph-mon[32782]: pgmap v12237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:00:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:00:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:56 smithi193 ceph-mon[32782]: pgmap v12238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:00:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:56 smithi196 ceph-mon[32572]: pgmap v12238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:00:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:56 smithi110 ceph-mon[28069]: pgmap v12238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:00:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22372.257418 secs 2024-04-26T18:00:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22372.257418 secs 2024-04-26T18:00:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22372.257418 secs 2024-04-26T18:00:58.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:00:58 smithi193 ceph-mon[32782]: pgmap v12239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:00:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:00:58 smithi196 ceph-mon[32572]: pgmap v12239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:00:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:00:58 smithi110 ceph-mon[28069]: pgmap v12239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:01:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:00 smithi193 ceph-mon[32782]: pgmap v12240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:00 smithi196 ceph-mon[32572]: pgmap v12240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:00 smithi110 ceph-mon[28069]: pgmap v12240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:02 smithi196 ceph-mon[32572]: pgmap v12241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22377.257536 secs 2024-04-26T18:01:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:02 smithi193 ceph-mon[32782]: pgmap v12241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22377.257536 secs 2024-04-26T18:01:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:02 smithi110 ceph-mon[28069]: pgmap v12241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22377.257536 secs 2024-04-26T18:01:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:04 smithi193 ceph-mon[32782]: pgmap v12242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:01:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:04 smithi196 ceph-mon[32572]: pgmap v12242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:01:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:04 smithi110 ceph-mon[28069]: pgmap v12242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:01:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:06 smithi193 ceph-mon[32782]: pgmap v12243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:06 smithi196 ceph-mon[32572]: pgmap v12243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:06 smithi110 ceph-mon[28069]: pgmap v12243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22382.257678 secs 2024-04-26T18:01:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22382.257678 secs 2024-04-26T18:01:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22382.257678 secs 2024-04-26T18:01:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:08 smithi193 ceph-mon[32782]: pgmap v12244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:08 smithi196 ceph-mon[32572]: pgmap v12244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:08 smithi110 ceph-mon[28069]: pgmap v12244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:10 smithi196 ceph-mon[32572]: pgmap v12245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:10 smithi110 ceph-mon[28069]: pgmap v12245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:10 smithi193 ceph-mon[32782]: pgmap v12245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:12 smithi196 ceph-mon[32572]: pgmap v12246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:12 smithi196 ceph-mon[32572]: 20 slow requests, 1 included below; oldest blocked for > 22387.257761 secs 2024-04-26T18:01:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:12 smithi196 ceph-mon[32572]: slow request 720.810751 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:01:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:12 smithi110 ceph-mon[28069]: pgmap v12246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:12 smithi110 ceph-mon[28069]: 20 slow requests, 1 included below; oldest blocked for > 22387.257761 secs 2024-04-26T18:01:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:12 smithi110 ceph-mon[28069]: slow request 720.810751 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:01:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:12 smithi193 ceph-mon[32782]: pgmap v12246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:12 smithi193 ceph-mon[32782]: 20 slow requests, 1 included below; oldest blocked for > 22387.257761 secs 2024-04-26T18:01:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:12 smithi193 ceph-mon[32782]: slow request 720.810751 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:01:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:14 smithi196 ceph-mon[32572]: pgmap v12247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:14 smithi110 ceph-mon[28069]: pgmap v12247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:14 smithi193 ceph-mon[32782]: pgmap v12247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:16 smithi196 ceph-mon[32572]: pgmap v12248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:16 smithi110 ceph-mon[28069]: pgmap v12248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:16 smithi193 ceph-mon[32782]: pgmap v12248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22392.257858 secs 2024-04-26T18:01:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22392.257858 secs 2024-04-26T18:01:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22392.257858 secs 2024-04-26T18:01:18.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:18 smithi196 ceph-mon[32572]: pgmap v12249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:18.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:18 smithi110 ceph-mon[28069]: pgmap v12249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:18 smithi193 ceph-mon[32782]: pgmap v12249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:20 smithi196 ceph-mon[32572]: pgmap v12250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:20 smithi110 ceph-mon[28069]: pgmap v12250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:20 smithi193 ceph-mon[32782]: pgmap v12250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:22.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:22 smithi193 ceph-mon[32782]: pgmap v12251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:22.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22397.257981 secs 2024-04-26T18:01:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:22 smithi196 ceph-mon[32572]: pgmap v12251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22397.257981 secs 2024-04-26T18:01:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:22 smithi110 ceph-mon[28069]: pgmap v12251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22397.257981 secs 2024-04-26T18:01:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:24 smithi196 ceph-mon[32572]: pgmap v12252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:24 smithi110 ceph-mon[28069]: pgmap v12252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:24 smithi193 ceph-mon[32782]: pgmap v12252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:26 smithi196 ceph-mon[32572]: pgmap v12253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:26 smithi110 ceph-mon[28069]: pgmap v12253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:26 smithi193 ceph-mon[32782]: pgmap v12253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22402.258100 secs 2024-04-26T18:01:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22402.258100 secs 2024-04-26T18:01:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22402.258100 secs 2024-04-26T18:01:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:28 smithi196 ceph-mon[32572]: pgmap v12254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:28 smithi110 ceph-mon[28069]: pgmap v12254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:28 smithi193 ceph-mon[32782]: pgmap v12254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:30 smithi196 ceph-mon[32572]: pgmap v12255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:30 smithi110 ceph-mon[28069]: pgmap v12255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:30 smithi193 ceph-mon[32782]: pgmap v12255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:32 smithi196 ceph-mon[32572]: pgmap v12256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22407.258220 secs 2024-04-26T18:01:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:32 smithi110 ceph-mon[28069]: pgmap v12256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22407.258220 secs 2024-04-26T18:01:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:32 smithi193 ceph-mon[32782]: pgmap v12256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22407.258220 secs 2024-04-26T18:01:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:34 smithi196 ceph-mon[32572]: pgmap v12257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:34 smithi110 ceph-mon[28069]: pgmap v12257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:34 smithi193 ceph-mon[32782]: pgmap v12257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:36 smithi196 ceph-mon[32572]: pgmap v12258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:36 smithi110 ceph-mon[28069]: pgmap v12258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:36 smithi193 ceph-mon[32782]: pgmap v12258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22412.258350 secs 2024-04-26T18:01:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22412.258350 secs 2024-04-26T18:01:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22412.258350 secs 2024-04-26T18:01:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:38 smithi196 ceph-mon[32572]: pgmap v12259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:38 smithi110 ceph-mon[28069]: pgmap v12259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:38.620 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:38 smithi193 ceph-mon[32782]: pgmap v12259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:40 smithi196 ceph-mon[32572]: pgmap v12260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:40 smithi110 ceph-mon[28069]: pgmap v12260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:40 smithi193 ceph-mon[32782]: pgmap v12260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:42 smithi196 ceph-mon[32572]: pgmap v12261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22417.258464 secs 2024-04-26T18:01:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:42 smithi110 ceph-mon[28069]: pgmap v12261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22417.258464 secs 2024-04-26T18:01:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:42 smithi193 ceph-mon[32782]: pgmap v12261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22417.258464 secs 2024-04-26T18:01:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:44 smithi196 ceph-mon[32572]: pgmap v12262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:44 smithi110 ceph-mon[28069]: pgmap v12262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:44 smithi193 ceph-mon[32782]: pgmap v12262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:46 smithi196 ceph-mon[32572]: pgmap v12263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:46 smithi110 ceph-mon[28069]: pgmap v12263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:46 smithi193 ceph-mon[32782]: pgmap v12263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22422.258595 secs 2024-04-26T18:01:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22422.258595 secs 2024-04-26T18:01:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22422.258595 secs 2024-04-26T18:01:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:48 smithi110 ceph-mon[28069]: pgmap v12264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:48 smithi193 ceph-mon[32782]: pgmap v12264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:48 smithi196 ceph-mon[32572]: pgmap v12264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:49 smithi110 ceph-mon[28069]: pgmap v12265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:49 smithi193 ceph-mon[32782]: pgmap v12265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:49 smithi196 ceph-mon[32572]: pgmap v12265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:52 smithi193 ceph-mon[32782]: pgmap v12266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22427.258679 secs 2024-04-26T18:01:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:52 smithi196 ceph-mon[32572]: pgmap v12266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22427.258679 secs 2024-04-26T18:01:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:52 smithi110 ceph-mon[28069]: pgmap v12266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:01:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22427.258679 secs 2024-04-26T18:01:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:54 smithi193 ceph-mon[32782]: pgmap v12267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:01:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:54 smithi196 ceph-mon[32572]: pgmap v12267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:01:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:54 smithi110 ceph-mon[28069]: pgmap v12267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:01:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:01:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:01:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:01:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:01:55.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:01:55.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:01:55.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:01:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:01:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:01:55.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:01:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:56 smithi193 ceph-mon[32782]: pgmap v12268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:01:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:56 smithi193 ceph-mon[32782]: pgmap v12269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:56 smithi196 ceph-mon[32572]: pgmap v12268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:01:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:56 smithi196 ceph-mon[32572]: pgmap v12269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:56 smithi110 ceph-mon[28069]: pgmap v12268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:01:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:56 smithi110 ceph-mon[28069]: pgmap v12269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22432.258796 secs 2024-04-26T18:01:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22432.258796 secs 2024-04-26T18:01:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22432.258796 secs 2024-04-26T18:01:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:01:58 smithi196 ceph-mon[32572]: pgmap v12270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:01:58 smithi110 ceph-mon[28069]: pgmap v12270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:01:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:01:58 smithi193 ceph-mon[32782]: pgmap v12270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:00 smithi196 ceph-mon[32572]: pgmap v12271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:00 smithi110 ceph-mon[28069]: pgmap v12271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:00 smithi193 ceph-mon[32782]: pgmap v12271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:02 smithi196 ceph-mon[32572]: pgmap v12272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22437.258920 secs 2024-04-26T18:02:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:02 smithi110 ceph-mon[28069]: pgmap v12272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22437.258920 secs 2024-04-26T18:02:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:02 smithi193 ceph-mon[32782]: pgmap v12272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22437.258920 secs 2024-04-26T18:02:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:04 smithi196 ceph-mon[32572]: pgmap v12273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:04 smithi110 ceph-mon[28069]: pgmap v12273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:04 smithi193 ceph-mon[32782]: pgmap v12273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:06 smithi196 ceph-mon[32572]: pgmap v12274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:02:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:06 smithi110 ceph-mon[28069]: pgmap v12274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:02:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:06 smithi193 ceph-mon[32782]: pgmap v12274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:02:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22442.259038 secs 2024-04-26T18:02:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22442.259038 secs 2024-04-26T18:02:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22442.259038 secs 2024-04-26T18:02:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:08 smithi196 ceph-mon[32572]: pgmap v12275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:08 smithi110 ceph-mon[28069]: pgmap v12275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:08 smithi193 ceph-mon[32782]: pgmap v12275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:10 smithi196 ceph-mon[32572]: pgmap v12276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:10 smithi110 ceph-mon[28069]: pgmap v12276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:10 smithi193 ceph-mon[32782]: pgmap v12276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:12 smithi196 ceph-mon[32572]: pgmap v12277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22447.259162 secs 2024-04-26T18:02:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:12 smithi110 ceph-mon[28069]: pgmap v12277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22447.259162 secs 2024-04-26T18:02:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:12 smithi193 ceph-mon[32782]: pgmap v12277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22447.259162 secs 2024-04-26T18:02:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:14 smithi196 ceph-mon[32572]: pgmap v12278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:14 smithi110 ceph-mon[28069]: pgmap v12278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:14 smithi193 ceph-mon[32782]: pgmap v12278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:16 smithi196 ceph-mon[32572]: pgmap v12279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:16 smithi110 ceph-mon[28069]: pgmap v12279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:16 smithi193 ceph-mon[32782]: pgmap v12279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22452.259286 secs 2024-04-26T18:02:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22452.259286 secs 2024-04-26T18:02:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22452.259286 secs 2024-04-26T18:02:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:18 smithi196 ceph-mon[32572]: pgmap v12280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:18 smithi110 ceph-mon[28069]: pgmap v12280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:18 smithi193 ceph-mon[32782]: pgmap v12280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:20 smithi196 ceph-mon[32572]: pgmap v12281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:20 smithi110 ceph-mon[28069]: pgmap v12281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:20 smithi193 ceph-mon[32782]: pgmap v12281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:22 smithi196 ceph-mon[32572]: pgmap v12282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22457.259419 secs 2024-04-26T18:02:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:22 smithi110 ceph-mon[28069]: pgmap v12282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22457.259419 secs 2024-04-26T18:02:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:22 smithi193 ceph-mon[32782]: pgmap v12282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22457.259419 secs 2024-04-26T18:02:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:24 smithi196 ceph-mon[32572]: pgmap v12283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:24 smithi110 ceph-mon[28069]: pgmap v12283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:24 smithi193 ceph-mon[32782]: pgmap v12283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:26 smithi196 ceph-mon[32572]: pgmap v12284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:26 smithi110 ceph-mon[28069]: pgmap v12284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:26 smithi193 ceph-mon[32782]: pgmap v12284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22462.259537 secs 2024-04-26T18:02:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22462.259537 secs 2024-04-26T18:02:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22462.259537 secs 2024-04-26T18:02:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:28 smithi196 ceph-mon[32572]: pgmap v12285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:28 smithi110 ceph-mon[28069]: pgmap v12285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:28 smithi193 ceph-mon[32782]: pgmap v12285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:30 smithi196 ceph-mon[32572]: pgmap v12286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:30 smithi110 ceph-mon[28069]: pgmap v12286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:30 smithi193 ceph-mon[32782]: pgmap v12286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:32 smithi196 ceph-mon[32572]: pgmap v12287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22467.259644 secs 2024-04-26T18:02:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:32 smithi110 ceph-mon[28069]: pgmap v12287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22467.259644 secs 2024-04-26T18:02:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:32 smithi193 ceph-mon[32782]: pgmap v12287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22467.259644 secs 2024-04-26T18:02:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:34 smithi196 ceph-mon[32572]: pgmap v12288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:34 smithi110 ceph-mon[28069]: pgmap v12288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:34 smithi193 ceph-mon[32782]: pgmap v12288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:36 smithi196 ceph-mon[32572]: pgmap v12289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:36 smithi110 ceph-mon[28069]: pgmap v12289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:36 smithi193 ceph-mon[32782]: pgmap v12289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22472.259792 secs 2024-04-26T18:02:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22472.259792 secs 2024-04-26T18:02:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22472.259792 secs 2024-04-26T18:02:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:38 smithi110 ceph-mon[28069]: pgmap v12290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:38 smithi193 ceph-mon[32782]: pgmap v12290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:38 smithi196 ceph-mon[32572]: pgmap v12290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:39 smithi110 ceph-mon[28069]: pgmap v12291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:39 smithi193 ceph-mon[32782]: pgmap v12291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:39 smithi196 ceph-mon[32572]: pgmap v12291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:41 smithi196 ceph-mon[32572]: pgmap v12292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:41 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22477.259911 secs 2024-04-26T18:02:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:41 smithi110 ceph-mon[28069]: pgmap v12292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:41 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22477.259911 secs 2024-04-26T18:02:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:41 smithi193 ceph-mon[32782]: pgmap v12292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:41 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22477.259911 secs 2024-04-26T18:02:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:43 smithi196 ceph-mon[32572]: pgmap v12293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:43 smithi110 ceph-mon[28069]: pgmap v12293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:43 smithi193 ceph-mon[32782]: pgmap v12293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:45 smithi196 ceph-mon[32572]: pgmap v12294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:45 smithi110 ceph-mon[28069]: pgmap v12294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:45 smithi193 ceph-mon[32782]: pgmap v12294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:46 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22482.259980 secs 2024-04-26T18:02:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:46 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22482.259980 secs 2024-04-26T18:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:46 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22482.259980 secs 2024-04-26T18:02:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:47 smithi196 ceph-mon[32572]: pgmap v12295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:47 smithi110 ceph-mon[28069]: pgmap v12295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:47 smithi193 ceph-mon[32782]: pgmap v12295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:49 smithi196 ceph-mon[32572]: pgmap v12296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:49 smithi110 ceph-mon[28069]: pgmap v12296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:49 smithi193 ceph-mon[32782]: pgmap v12296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:51 smithi196 ceph-mon[32572]: pgmap v12297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22487.260117 secs 2024-04-26T18:02:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:51 smithi110 ceph-mon[28069]: pgmap v12297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22487.260117 secs 2024-04-26T18:02:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:51 smithi193 ceph-mon[32782]: pgmap v12297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22487.260117 secs 2024-04-26T18:02:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:53 smithi196 ceph-mon[32572]: pgmap v12298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:53 smithi110 ceph-mon[28069]: pgmap v12298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:53 smithi193 ceph-mon[32782]: pgmap v12298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:02:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:55 smithi196 ceph-mon[32572]: pgmap v12299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:02:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:55 smithi110 ceph-mon[28069]: pgmap v12299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:02:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:55 smithi193 ceph-mon[32782]: pgmap v12299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:02:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:02:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:02:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:02:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:56 smithi196 ceph-mon[32572]: pgmap v12300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:02:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:56 smithi196 ceph-mon[32572]: pgmap v12301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:02:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22492.260273 secs 2024-04-26T18:02:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:02:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:02:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:56 smithi110 ceph-mon[28069]: pgmap v12300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:02:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:56 smithi110 ceph-mon[28069]: pgmap v12301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:02:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22492.260273 secs 2024-04-26T18:02:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:02:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:02:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:56 smithi193 ceph-mon[32782]: pgmap v12300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:02:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:56 smithi193 ceph-mon[32782]: pgmap v12301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:02:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22492.260273 secs 2024-04-26T18:02:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:02:59 smithi196 ceph-mon[32572]: pgmap v12302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:02:59 smithi110 ceph-mon[28069]: pgmap v12302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:02:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:02:59 smithi193 ceph-mon[32782]: pgmap v12302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:03:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:01 smithi196 ceph-mon[32572]: pgmap v12303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:03:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:01 smithi110 ceph-mon[28069]: pgmap v12303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:03:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:01 smithi193 ceph-mon[32782]: pgmap v12303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:03:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22497.260391 secs 2024-04-26T18:03:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22497.260391 secs 2024-04-26T18:03:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22497.260391 secs 2024-04-26T18:03:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:03 smithi196 ceph-mon[32572]: pgmap v12304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:03:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:03 smithi110 ceph-mon[28069]: pgmap v12304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:03:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:03 smithi193 ceph-mon[32782]: pgmap v12304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:03:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:05 smithi196 ceph-mon[32572]: pgmap v12305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:03:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:05 smithi110 ceph-mon[28069]: pgmap v12305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:03:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:05 smithi193 ceph-mon[32782]: pgmap v12305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:03:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:07 smithi196 ceph-mon[32572]: pgmap v12306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:03:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22502.260512 secs 2024-04-26T18:03:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:07 smithi110 ceph-mon[28069]: pgmap v12306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:03:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22502.260512 secs 2024-04-26T18:03:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:07 smithi193 ceph-mon[32782]: pgmap v12306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:03:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22502.260512 secs 2024-04-26T18:03:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:09 smithi196 ceph-mon[32572]: pgmap v12307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:09 smithi110 ceph-mon[28069]: pgmap v12307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:09 smithi193 ceph-mon[32782]: pgmap v12307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:11 smithi196 ceph-mon[32572]: pgmap v12308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:11 smithi110 ceph-mon[28069]: pgmap v12308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:11 smithi193 ceph-mon[32782]: pgmap v12308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22507.260631 secs 2024-04-26T18:03:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22507.260631 secs 2024-04-26T18:03:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22507.260631 secs 2024-04-26T18:03:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:13 smithi110 ceph-mon[28069]: pgmap v12309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:13 smithi193 ceph-mon[32782]: pgmap v12309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:13 smithi196 ceph-mon[32572]: pgmap v12309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:14 smithi110 ceph-mon[28069]: pgmap v12310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:14 smithi193 ceph-mon[32782]: pgmap v12310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:14 smithi196 ceph-mon[32572]: pgmap v12310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.439+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T18:03:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.439+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:03:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.439+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:03:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.439+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T18:03:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.439+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.440+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T18:03:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.441+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T18:03:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.442+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T18:03:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.442+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T18:03:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.442+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:03:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.442+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e040 comp rx=0 tx=0).stop 2024-04-26T18:03:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.442+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T18:03:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.442+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.442+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.443+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:16.444+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614059040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:17 smithi196 ceph-mon[32572]: pgmap v12311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22512.260695 secs 2024-04-26T18:03:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:17 smithi110 ceph-mon[28069]: pgmap v12311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22512.260695 secs 2024-04-26T18:03:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:17 smithi193 ceph-mon[32782]: pgmap v12311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22512.260695 secs 2024-04-26T18:03:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:19 smithi196 ceph-mon[32572]: pgmap v12312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:19 smithi110 ceph-mon[28069]: pgmap v12312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:19 smithi193 ceph-mon[32782]: pgmap v12312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:20.090+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:03:20.089 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:20.090+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006380 con 0x7f261c104b50 2024-04-26T18:03:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:20.090+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 175 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006380 con 0x55db1be4fdd0 2024-04-26T18:03:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:03:20.090+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 175 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:03:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:21 smithi196 ceph-mon[32572]: pgmap v12313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:21 smithi110 ceph-mon[28069]: pgmap v12313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:21 smithi193 ceph-mon[32782]: pgmap v12313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22517.260757 secs 2024-04-26T18:03:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22517.260757 secs 2024-04-26T18:03:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22517.260757 secs 2024-04-26T18:03:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:23 smithi196 ceph-mon[32572]: pgmap v12314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:23.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:23 smithi193 ceph-mon[32782]: pgmap v12314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:23 smithi110 ceph-mon[28069]: pgmap v12314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:25 smithi196 ceph-mon[32572]: pgmap v12315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:25 smithi110 ceph-mon[28069]: pgmap v12315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:25 smithi193 ceph-mon[32782]: pgmap v12315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:27 smithi196 ceph-mon[32572]: pgmap v12316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22522.260876 secs 2024-04-26T18:03:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:27 smithi110 ceph-mon[28069]: pgmap v12316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22522.260876 secs 2024-04-26T18:03:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:27 smithi193 ceph-mon[32782]: pgmap v12316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22522.260876 secs 2024-04-26T18:03:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:29 smithi110 ceph-mon[28069]: pgmap v12317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:29 smithi193 ceph-mon[32782]: pgmap v12317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:29 smithi196 ceph-mon[32572]: pgmap v12317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:31 smithi110 ceph-mon[28069]: pgmap v12318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:31 smithi193 ceph-mon[32782]: pgmap v12318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:31 smithi196 ceph-mon[32572]: pgmap v12318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22527.261017 secs 2024-04-26T18:03:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22527.261017 secs 2024-04-26T18:03:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22527.261017 secs 2024-04-26T18:03:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:33 smithi110 ceph-mon[28069]: pgmap v12319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:33 smithi193 ceph-mon[32782]: pgmap v12319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:33 smithi196 ceph-mon[32572]: pgmap v12319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:34 smithi110 ceph-mon[28069]: pgmap v12320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:34 smithi193 ceph-mon[32782]: pgmap v12320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:34 smithi196 ceph-mon[32572]: pgmap v12320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:37 smithi196 ceph-mon[32572]: pgmap v12321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22532.261155 secs 2024-04-26T18:03:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:37 smithi110 ceph-mon[28069]: pgmap v12321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22532.261155 secs 2024-04-26T18:03:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:37 smithi193 ceph-mon[32782]: pgmap v12321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22532.261155 secs 2024-04-26T18:03:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:39 smithi196 ceph-mon[32572]: pgmap v12322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:39 smithi110 ceph-mon[28069]: pgmap v12322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:39 smithi193 ceph-mon[32782]: pgmap v12322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:41 smithi196 ceph-mon[32572]: pgmap v12323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:41 smithi110 ceph-mon[28069]: pgmap v12323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:41 smithi193 ceph-mon[32782]: pgmap v12323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22537.261271 secs 2024-04-26T18:03:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22537.261271 secs 2024-04-26T18:03:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22537.261271 secs 2024-04-26T18:03:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:43 smithi196 ceph-mon[32572]: pgmap v12324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:43 smithi110 ceph-mon[28069]: pgmap v12324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:43 smithi193 ceph-mon[32782]: pgmap v12324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:45 smithi110 ceph-mon[28069]: pgmap v12325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:45 smithi193 ceph-mon[32782]: pgmap v12325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:45 smithi196 ceph-mon[32572]: pgmap v12325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:47 smithi110 ceph-mon[28069]: pgmap v12326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22542.261408 secs 2024-04-26T18:03:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:47 smithi193 ceph-mon[32782]: pgmap v12326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22542.261408 secs 2024-04-26T18:03:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:47 smithi196 ceph-mon[32572]: pgmap v12326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22542.261408 secs 2024-04-26T18:03:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:49 smithi110 ceph-mon[28069]: pgmap v12327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:49.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:49 smithi196 ceph-mon[32572]: pgmap v12327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:49 smithi193 ceph-mon[32782]: pgmap v12327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:50 smithi110 ceph-mon[28069]: pgmap v12328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:50 smithi193 ceph-mon[32782]: pgmap v12328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:50 smithi196 ceph-mon[32572]: pgmap v12328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22547.261521 secs 2024-04-26T18:03:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22547.261521 secs 2024-04-26T18:03:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22547.261521 secs 2024-04-26T18:03:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:52 smithi196 ceph-mon[32572]: pgmap v12329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:53.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:52 smithi193 ceph-mon[32782]: pgmap v12329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:52 smithi110 ceph-mon[28069]: pgmap v12329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:55 smithi196 ceph-mon[32572]: pgmap v12330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:55 smithi110 ceph-mon[28069]: pgmap v12330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:55 smithi193 ceph-mon[32782]: pgmap v12330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:57 smithi196 ceph-mon[32572]: pgmap v12331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:03:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22552.261625 secs 2024-04-26T18:03:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:57 smithi110 ceph-mon[28069]: pgmap v12331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:03:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22552.261625 secs 2024-04-26T18:03:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:57 smithi193 ceph-mon[32782]: pgmap v12331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:03:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:03:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22552.261625 secs 2024-04-26T18:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:03:58 smithi193 ceph-mon[32782]: pgmap v12332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:03:58 smithi196 ceph-mon[32572]: pgmap v12332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:03:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:03:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:03:58 smithi110 ceph-mon[28069]: pgmap v12332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:04:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:04:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:04:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:04:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:00 smithi196 ceph-mon[32572]: pgmap v12333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 911 B/s rd, 1 op/s 2024-04-26T18:04:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:00 smithi196 ceph-mon[32572]: pgmap v12334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:04:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:04:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:04:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:04:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:04:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:00 smithi110 ceph-mon[28069]: pgmap v12333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 911 B/s rd, 1 op/s 2024-04-26T18:04:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:00 smithi110 ceph-mon[28069]: pgmap v12334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:04:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:04:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:04:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:04:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:04:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:00 smithi193 ceph-mon[32782]: pgmap v12333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 911 B/s rd, 1 op/s 2024-04-26T18:04:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:00 smithi193 ceph-mon[32782]: pgmap v12334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:04:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:02 smithi196 ceph-mon[32572]: pgmap v12335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22557.261691 secs 2024-04-26T18:04:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:02 smithi110 ceph-mon[28069]: pgmap v12335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22557.261691 secs 2024-04-26T18:04:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:02 smithi193 ceph-mon[32782]: pgmap v12335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22557.261691 secs 2024-04-26T18:04:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:04 smithi196 ceph-mon[32572]: pgmap v12336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:04 smithi110 ceph-mon[28069]: pgmap v12336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:04 smithi193 ceph-mon[32782]: pgmap v12336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:06 smithi196 ceph-mon[32572]: pgmap v12337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:06 smithi110 ceph-mon[28069]: pgmap v12337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:06 smithi193 ceph-mon[32782]: pgmap v12337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22562.261784 secs 2024-04-26T18:04:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22562.261784 secs 2024-04-26T18:04:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22562.261784 secs 2024-04-26T18:04:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:08 smithi196 ceph-mon[32572]: pgmap v12338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:08 smithi110 ceph-mon[28069]: pgmap v12338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:08 smithi193 ceph-mon[32782]: pgmap v12338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:04:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:10 smithi196 ceph-mon[32572]: pgmap v12339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:04:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:10 smithi110 ceph-mon[28069]: pgmap v12339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:04:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:10 smithi193 ceph-mon[32782]: pgmap v12339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:04:11.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:04:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:04:11.255+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:04:11.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:04:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:04:11.255+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:04:11.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:04:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:04:11.255+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:04:11.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:04:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:04:11.255+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:04:11.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:04:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:04:11.255+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:04:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:12 smithi110 ceph-mon[28069]: pgmap v12340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22567.261939 secs 2024-04-26T18:04:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:12 smithi193 ceph-mon[32782]: pgmap v12340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22567.261939 secs 2024-04-26T18:04:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:12 smithi196 ceph-mon[32572]: pgmap v12340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22567.261939 secs 2024-04-26T18:04:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:14 smithi110 ceph-mon[28069]: pgmap v12341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:14 smithi193 ceph-mon[32782]: pgmap v12341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:14 smithi196 ceph-mon[32572]: pgmap v12341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:16 smithi110 ceph-mon[28069]: pgmap v12342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:16 smithi193 ceph-mon[32782]: pgmap v12342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:16 smithi196 ceph-mon[32572]: pgmap v12342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22572.262036 secs 2024-04-26T18:04:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22572.262036 secs 2024-04-26T18:04:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22572.262036 secs 2024-04-26T18:04:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:18 smithi110 ceph-mon[28069]: pgmap v12343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:18 smithi193 ceph-mon[32782]: pgmap v12343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:18 smithi196 ceph-mon[32572]: pgmap v12343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:20 smithi110 ceph-mon[28069]: pgmap v12344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:20.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:20 smithi196 ceph-mon[32572]: pgmap v12344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:20 smithi193 ceph-mon[32782]: pgmap v12344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:22 smithi110 ceph-mon[28069]: pgmap v12345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22577.262157 secs 2024-04-26T18:04:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:22 smithi193 ceph-mon[32782]: pgmap v12345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22577.262157 secs 2024-04-26T18:04:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:22 smithi196 ceph-mon[32572]: pgmap v12345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22577.262157 secs 2024-04-26T18:04:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:24 smithi193 ceph-mon[32782]: pgmap v12346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:24 smithi196 ceph-mon[32572]: pgmap v12346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:24 smithi110 ceph-mon[28069]: pgmap v12346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:04:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:26 smithi193 ceph-mon[32782]: pgmap v12347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:26 smithi196 ceph-mon[32572]: pgmap v12347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:26 smithi110 ceph-mon[28069]: pgmap v12347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:27.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22582.262292 secs 2024-04-26T18:04:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22582.262292 secs 2024-04-26T18:04:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22582.262292 secs 2024-04-26T18:04:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:28 smithi193 ceph-mon[32782]: pgmap v12348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:28 smithi196 ceph-mon[32572]: pgmap v12348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:28 smithi110 ceph-mon[28069]: pgmap v12348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:30 smithi193 ceph-mon[32782]: pgmap v12349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:30 smithi196 ceph-mon[32572]: pgmap v12349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:30 smithi110 ceph-mon[28069]: pgmap v12349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:32 smithi193 ceph-mon[32782]: pgmap v12350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22587.262393 secs 2024-04-26T18:04:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:32 smithi196 ceph-mon[32572]: pgmap v12350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22587.262393 secs 2024-04-26T18:04:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:32 smithi110 ceph-mon[28069]: pgmap v12350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22587.262393 secs 2024-04-26T18:04:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:34 smithi193 ceph-mon[32782]: pgmap v12351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:35.145 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:34 smithi110 ceph-mon[28069]: pgmap v12351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:35.146 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:34 smithi196 ceph-mon[32572]: pgmap v12351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:36 smithi193 ceph-mon[32782]: pgmap v12352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:36 smithi196 ceph-mon[32572]: pgmap v12352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:36 smithi110 ceph-mon[28069]: pgmap v12352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22592.262539 secs 2024-04-26T18:04:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22592.262539 secs 2024-04-26T18:04:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22592.262539 secs 2024-04-26T18:04:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:38 smithi193 ceph-mon[32782]: pgmap v12353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:38 smithi196 ceph-mon[32572]: pgmap v12353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:38 smithi110 ceph-mon[28069]: pgmap v12353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:40 smithi193 ceph-mon[32782]: pgmap v12354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:40 smithi196 ceph-mon[32572]: pgmap v12354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:40 smithi110 ceph-mon[28069]: pgmap v12354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:42 smithi193 ceph-mon[32782]: pgmap v12355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22597.262584 secs 2024-04-26T18:04:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:42 smithi196 ceph-mon[32572]: pgmap v12355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22597.262584 secs 2024-04-26T18:04:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:42 smithi110 ceph-mon[28069]: pgmap v12355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22597.262584 secs 2024-04-26T18:04:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:44 smithi193 ceph-mon[32782]: pgmap v12356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:44 smithi196 ceph-mon[32572]: pgmap v12356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:44 smithi110 ceph-mon[28069]: pgmap v12356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:46 smithi193 ceph-mon[32782]: pgmap v12357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:46 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22602.262702 secs 2024-04-26T18:04:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:46 smithi196 ceph-mon[32572]: pgmap v12357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:46 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22602.262702 secs 2024-04-26T18:04:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:46 smithi110 ceph-mon[28069]: pgmap v12357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:46 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22602.262702 secs 2024-04-26T18:04:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:48 smithi193 ceph-mon[32782]: pgmap v12358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:48 smithi196 ceph-mon[32572]: pgmap v12358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:48 smithi110 ceph-mon[28069]: pgmap v12358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:50 smithi196 ceph-mon[32572]: pgmap v12359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:50 smithi110 ceph-mon[28069]: pgmap v12359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:50 smithi193 ceph-mon[32782]: pgmap v12359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22607.262820 secs 2024-04-26T18:04:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22607.262820 secs 2024-04-26T18:04:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22607.262820 secs 2024-04-26T18:04:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:52 smithi196 ceph-mon[32572]: pgmap v12360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:52 smithi110 ceph-mon[28069]: pgmap v12360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:52 smithi193 ceph-mon[32782]: pgmap v12360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:54.922 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:54 smithi193 ceph-mon[32782]: pgmap v12361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:54 smithi196 ceph-mon[32572]: pgmap v12361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:54 smithi110 ceph-mon[28069]: pgmap v12361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:56 smithi196 ceph-mon[32572]: pgmap v12362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22612.262973 secs 2024-04-26T18:04:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:56 smithi110 ceph-mon[28069]: pgmap v12362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22612.262973 secs 2024-04-26T18:04:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:56 smithi193 ceph-mon[32782]: pgmap v12362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:04:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22612.262973 secs 2024-04-26T18:04:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:04:58 smithi196 ceph-mon[32572]: pgmap v12363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:04:58 smithi110 ceph-mon[28069]: pgmap v12363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:04:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:04:58 smithi193 ceph-mon[32782]: pgmap v12363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:00 smithi196 ceph-mon[32572]: pgmap v12364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:05:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:00 smithi110 ceph-mon[28069]: pgmap v12364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:05:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:00 smithi193 ceph-mon[32782]: pgmap v12364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:05:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:05:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:05:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:01 smithi196 ceph-mon[32572]: pgmap v12365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:05:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:01 smithi196 ceph-mon[32572]: pgmap v12366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:05:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:01 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22617.263047 secs 2024-04-26T18:05:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:05:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:05:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:01 smithi110 ceph-mon[28069]: pgmap v12365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:05:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:01 smithi110 ceph-mon[28069]: pgmap v12366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:05:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:01 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22617.263047 secs 2024-04-26T18:05:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:05:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:05:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:01 smithi193 ceph-mon[32782]: pgmap v12365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:05:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:01 smithi193 ceph-mon[32782]: pgmap v12366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:05:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:05:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:01 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22617.263047 secs 2024-04-26T18:05:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:04 smithi196 ceph-mon[32572]: pgmap v12367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:04 smithi110 ceph-mon[28069]: pgmap v12367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:04 smithi193 ceph-mon[32782]: pgmap v12367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:06 smithi196 ceph-mon[32572]: pgmap v12368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:06 smithi110 ceph-mon[28069]: pgmap v12368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:06 smithi193 ceph-mon[32782]: pgmap v12368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22622.263140 secs 2024-04-26T18:05:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22622.263140 secs 2024-04-26T18:05:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22622.263140 secs 2024-04-26T18:05:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:08 smithi196 ceph-mon[32572]: pgmap v12369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:05:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:08 smithi110 ceph-mon[28069]: pgmap v12369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:05:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:08 smithi193 ceph-mon[32782]: pgmap v12369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:05:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:10 smithi196 ceph-mon[32572]: pgmap v12370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:10 smithi110 ceph-mon[28069]: pgmap v12370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:10 smithi193 ceph-mon[32782]: pgmap v12370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:12 smithi196 ceph-mon[32572]: pgmap v12371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22627.263276 secs 2024-04-26T18:05:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:12 smithi110 ceph-mon[28069]: pgmap v12371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22627.263276 secs 2024-04-26T18:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:12 smithi193 ceph-mon[32782]: pgmap v12371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22627.263276 secs 2024-04-26T18:05:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:14 smithi196 ceph-mon[32572]: pgmap v12372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:14 smithi110 ceph-mon[28069]: pgmap v12372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:14 smithi193 ceph-mon[32782]: pgmap v12372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:05:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:16 smithi196 ceph-mon[32572]: pgmap v12373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:16.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:16 smithi110 ceph-mon[28069]: pgmap v12373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:16 smithi193 ceph-mon[32782]: pgmap v12373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22632.263412 secs 2024-04-26T18:05:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22632.263412 secs 2024-04-26T18:05:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22632.263412 secs 2024-04-26T18:05:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:18 smithi196 ceph-mon[32572]: pgmap v12374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:18 smithi110 ceph-mon[28069]: pgmap v12374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:18 smithi193 ceph-mon[32782]: pgmap v12374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:20 smithi196 ceph-mon[32572]: pgmap v12375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:20 smithi110 ceph-mon[28069]: pgmap v12375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:20 smithi193 ceph-mon[32782]: pgmap v12375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:22 smithi196 ceph-mon[32572]: pgmap v12376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22637.263476 secs 2024-04-26T18:05:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:22 smithi110 ceph-mon[28069]: pgmap v12376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22637.263476 secs 2024-04-26T18:05:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:22 smithi193 ceph-mon[32782]: pgmap v12376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22637.263476 secs 2024-04-26T18:05:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:24 smithi196 ceph-mon[32572]: pgmap v12377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:24 smithi110 ceph-mon[28069]: pgmap v12377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:24 smithi193 ceph-mon[32782]: pgmap v12377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:26 smithi196 ceph-mon[32572]: pgmap v12378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:26 smithi110 ceph-mon[28069]: pgmap v12378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:26 smithi193 ceph-mon[32782]: pgmap v12378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22642.263630 secs 2024-04-26T18:05:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22642.263630 secs 2024-04-26T18:05:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22642.263630 secs 2024-04-26T18:05:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:28 smithi196 ceph-mon[32572]: pgmap v12379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:28 smithi110 ceph-mon[28069]: pgmap v12379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:28 smithi193 ceph-mon[32782]: pgmap v12379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:30 smithi196 ceph-mon[32572]: pgmap v12380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:30 smithi110 ceph-mon[28069]: pgmap v12380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:30 smithi193 ceph-mon[32782]: pgmap v12380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:32 smithi196 ceph-mon[32572]: pgmap v12381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22647.263757 secs 2024-04-26T18:05:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:32 smithi110 ceph-mon[28069]: pgmap v12381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22647.263757 secs 2024-04-26T18:05:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:32 smithi193 ceph-mon[32782]: pgmap v12381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22647.263757 secs 2024-04-26T18:05:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:34 smithi196 ceph-mon[32572]: pgmap v12382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:34 smithi110 ceph-mon[28069]: pgmap v12382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:34 smithi193 ceph-mon[32782]: pgmap v12382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:36 smithi196 ceph-mon[32572]: pgmap v12383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:36 smithi110 ceph-mon[28069]: pgmap v12383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:36 smithi193 ceph-mon[32782]: pgmap v12383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22652.263853 secs 2024-04-26T18:05:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22652.263853 secs 2024-04-26T18:05:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22652.263853 secs 2024-04-26T18:05:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:38 smithi110 ceph-mon[28069]: pgmap v12384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:38 smithi193 ceph-mon[32782]: pgmap v12384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:38 smithi196 ceph-mon[32572]: pgmap v12384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:40 smithi110 ceph-mon[28069]: pgmap v12385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:40 smithi193 ceph-mon[32782]: pgmap v12385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:40 smithi196 ceph-mon[32572]: pgmap v12385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:42 smithi110 ceph-mon[28069]: pgmap v12386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22657.263969 secs 2024-04-26T18:05:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:42 smithi193 ceph-mon[32782]: pgmap v12386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22657.263969 secs 2024-04-26T18:05:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:42 smithi196 ceph-mon[32572]: pgmap v12386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22657.263969 secs 2024-04-26T18:05:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:44 smithi110 ceph-mon[28069]: pgmap v12387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:44 smithi193 ceph-mon[32782]: pgmap v12387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:44 smithi196 ceph-mon[32572]: pgmap v12387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:46.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:46 smithi110 ceph-mon[28069]: pgmap v12388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:46 smithi193 ceph-mon[32782]: pgmap v12388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:46 smithi196 ceph-mon[32572]: pgmap v12388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22662.264093 secs 2024-04-26T18:05:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22662.264093 secs 2024-04-26T18:05:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22662.264093 secs 2024-04-26T18:05:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:48 smithi110 ceph-mon[28069]: pgmap v12389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:48 smithi193 ceph-mon[32782]: pgmap v12389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:48 smithi196 ceph-mon[32572]: pgmap v12389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:49 smithi193 ceph-mon[32782]: pgmap v12390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:49 smithi196 ceph-mon[32572]: pgmap v12390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:49 smithi110 ceph-mon[28069]: pgmap v12390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:52.458 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:52 smithi196 ceph-mon[32572]: pgmap v12391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:52.458 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22667.264210 secs 2024-04-26T18:05:52.494 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:52 smithi110 ceph-mon[28069]: pgmap v12391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:52.494 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22667.264210 secs 2024-04-26T18:05:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:52 smithi193 ceph-mon[32782]: pgmap v12391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22667.264210 secs 2024-04-26T18:05:54.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:54 smithi193 ceph-mon[32782]: pgmap v12392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:54 smithi196 ceph-mon[32572]: pgmap v12392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:54 smithi110 ceph-mon[28069]: pgmap v12392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:05:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:56 smithi196 ceph-mon[32572]: pgmap v12393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:56 smithi110 ceph-mon[28069]: pgmap v12393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:56 smithi193 ceph-mon[32782]: pgmap v12393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22672.264329 secs 2024-04-26T18:05:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22672.264329 secs 2024-04-26T18:05:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22672.264329 secs 2024-04-26T18:05:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:05:58 smithi196 ceph-mon[32572]: pgmap v12394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:05:58 smithi110 ceph-mon[28069]: pgmap v12394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:05:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:05:58 smithi193 ceph-mon[32782]: pgmap v12394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:00 smithi196 ceph-mon[32572]: pgmap v12395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:00 smithi110 ceph-mon[28069]: pgmap v12395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:00 smithi193 ceph-mon[32782]: pgmap v12395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:02.466 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:02 smithi193 ceph-mon[32782]: pgmap v12396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:02.466 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:06:02.466 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22677.264392 secs 2024-04-26T18:06:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:02 smithi196 ceph-mon[32572]: pgmap v12396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:06:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22677.264392 secs 2024-04-26T18:06:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:02 smithi110 ceph-mon[28069]: pgmap v12396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:06:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22677.264392 secs 2024-04-26T18:06:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: pgmap v12397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: pgmap v12397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: pgmap v12397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:06:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:05 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:06:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:06:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:06:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:06:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:05 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:06:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:06:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:06:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:06:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:05 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:06:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:06 smithi196 ceph-mon[32572]: pgmap v12398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:06 smithi110 ceph-mon[28069]: pgmap v12398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:06 smithi193 ceph-mon[32782]: pgmap v12398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22682.264541 secs 2024-04-26T18:06:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:06:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:06:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22682.264541 secs 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:06:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:06:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22682.264541 secs 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:06:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:06:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:06:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:06:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:08 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:06:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:08 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:06:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:08 smithi196 ceph-mon[32572]: pgmap v12399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T18:06:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:08 smithi196 ceph-mon[32572]: pgmap v12400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:08 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:06:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:08 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:06:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:08 smithi110 ceph-mon[28069]: pgmap v12399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T18:06:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:08 smithi110 ceph-mon[28069]: pgmap v12400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:08 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:06:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:08 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:06:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:08 smithi193 ceph-mon[32782]: pgmap v12399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T18:06:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:08 smithi193 ceph-mon[32782]: pgmap v12400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:10 smithi196 ceph-mon[32572]: pgmap v12401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:10 smithi110 ceph-mon[28069]: pgmap v12401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:10 smithi193 ceph-mon[32782]: pgmap v12401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:12 smithi196 ceph-mon[32572]: pgmap v12402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22687.264614 secs 2024-04-26T18:06:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:12 smithi110 ceph-mon[28069]: pgmap v12402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22687.264614 secs 2024-04-26T18:06:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:12 smithi193 ceph-mon[32782]: pgmap v12402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22687.264614 secs 2024-04-26T18:06:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:14 smithi196 ceph-mon[32572]: pgmap v12403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:14 smithi110 ceph-mon[28069]: pgmap v12403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:14 smithi193 ceph-mon[32782]: pgmap v12403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:16 smithi196 ceph-mon[32572]: pgmap v12404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:16 smithi110 ceph-mon[28069]: pgmap v12404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:16 smithi193 ceph-mon[32782]: pgmap v12404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:06:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22692.264733 secs 2024-04-26T18:06:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22692.264733 secs 2024-04-26T18:06:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22692.264733 secs 2024-04-26T18:06:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:18 smithi110 ceph-mon[28069]: pgmap v12405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:06:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:18 smithi193 ceph-mon[32782]: pgmap v12405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:06:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:18 smithi196 ceph-mon[32572]: pgmap v12405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:06:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:06:20.119+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006380 con 0x7f261c104b50 2024-04-26T18:06:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:06:20.119+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:06:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:06:20.119+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 176 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:06:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:06:20.119+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 176 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006380 con 0x55db1be4fdd0 2024-04-26T18:06:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:20 smithi110 ceph-mon[28069]: pgmap v12406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:20 smithi193 ceph-mon[32782]: pgmap v12406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:20 smithi196 ceph-mon[32572]: pgmap v12406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:22 smithi110 ceph-mon[28069]: pgmap v12407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22697.264830 secs 2024-04-26T18:06:22.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:22 smithi196 ceph-mon[32572]: pgmap v12407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:22.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22697.264830 secs 2024-04-26T18:06:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:22 smithi193 ceph-mon[32782]: pgmap v12407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22697.264830 secs 2024-04-26T18:06:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:24 smithi110 ceph-mon[28069]: pgmap v12408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:24 smithi193 ceph-mon[32782]: pgmap v12408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:24 smithi196 ceph-mon[32572]: pgmap v12408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:26 smithi110 ceph-mon[28069]: pgmap v12409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:26 smithi193 ceph-mon[32782]: pgmap v12409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:26 smithi196 ceph-mon[32572]: pgmap v12409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22702.264896 secs 2024-04-26T18:06:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22702.264896 secs 2024-04-26T18:06:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22702.264896 secs 2024-04-26T18:06:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:28 smithi193 ceph-mon[32782]: pgmap v12410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:28 smithi196 ceph-mon[32572]: pgmap v12410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:28 smithi110 ceph-mon[28069]: pgmap v12410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:30.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:30 smithi193 ceph-mon[32782]: pgmap v12411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:31.836 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:31 smithi193 ceph-mon[32782]: pgmap v12412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:31.836 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:30 smithi110 ceph-mon[28069]: pgmap v12411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:31.836 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:31 smithi110 ceph-mon[28069]: pgmap v12412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:31.837 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:30 smithi196 ceph-mon[32572]: pgmap v12411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:31.837 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:31 smithi196 ceph-mon[32572]: pgmap v12412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22707.265009 secs 2024-04-26T18:06:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22707.265009 secs 2024-04-26T18:06:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22707.265009 secs 2024-04-26T18:06:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:33 smithi193 ceph-mon[32782]: pgmap v12413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:33 smithi196 ceph-mon[32572]: pgmap v12413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:33 smithi110 ceph-mon[28069]: pgmap v12413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:35 smithi193 ceph-mon[32782]: pgmap v12414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:35 smithi196 ceph-mon[32572]: pgmap v12414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:35 smithi110 ceph-mon[28069]: pgmap v12414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:36 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22712.265144 secs 2024-04-26T18:06:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:36 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22712.265144 secs 2024-04-26T18:06:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:36 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22712.265144 secs 2024-04-26T18:06:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:37 smithi193 ceph-mon[32782]: pgmap v12415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:37 smithi196 ceph-mon[32572]: pgmap v12415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:37 smithi110 ceph-mon[28069]: pgmap v12415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:39 smithi193 ceph-mon[32782]: pgmap v12416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:39 smithi196 ceph-mon[32572]: pgmap v12416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:39 smithi110 ceph-mon[28069]: pgmap v12416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:41 smithi193 ceph-mon[32782]: pgmap v12417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:41 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22717.265236 secs 2024-04-26T18:06:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:41 smithi196 ceph-mon[32572]: pgmap v12417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:41 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22717.265236 secs 2024-04-26T18:06:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:41 smithi110 ceph-mon[28069]: pgmap v12417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:41 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22717.265236 secs 2024-04-26T18:06:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:43 smithi193 ceph-mon[32782]: pgmap v12418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:43 smithi196 ceph-mon[32572]: pgmap v12418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:43 smithi110 ceph-mon[28069]: pgmap v12418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:45 smithi193 ceph-mon[32782]: pgmap v12419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:45 smithi196 ceph-mon[32572]: pgmap v12419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:45 smithi110 ceph-mon[28069]: pgmap v12419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:46 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22722.265372 secs 2024-04-26T18:06:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:46 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22722.265372 secs 2024-04-26T18:06:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:46 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22722.265372 secs 2024-04-26T18:06:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:47 smithi193 ceph-mon[32782]: pgmap v12420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:47 smithi196 ceph-mon[32572]: pgmap v12420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:47 smithi110 ceph-mon[28069]: pgmap v12420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:49 smithi193 ceph-mon[32782]: pgmap v12421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:49 smithi196 ceph-mon[32572]: pgmap v12421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:49 smithi110 ceph-mon[28069]: pgmap v12421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:51 smithi193 ceph-mon[32782]: pgmap v12422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:52.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22727.265489 secs 2024-04-26T18:06:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:51 smithi196 ceph-mon[32572]: pgmap v12422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22727.265489 secs 2024-04-26T18:06:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:51 smithi110 ceph-mon[28069]: pgmap v12422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22727.265489 secs 2024-04-26T18:06:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:53 smithi193 ceph-mon[32782]: pgmap v12423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:53 smithi196 ceph-mon[32572]: pgmap v12423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:53 smithi110 ceph-mon[28069]: pgmap v12423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:06:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:55 smithi193 ceph-mon[32782]: pgmap v12424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:55 smithi196 ceph-mon[32572]: pgmap v12424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:55 smithi110 ceph-mon[28069]: pgmap v12424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22732.265620 secs 2024-04-26T18:06:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22732.265620 secs 2024-04-26T18:06:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22732.265620 secs 2024-04-26T18:06:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:57 smithi196 ceph-mon[32572]: pgmap v12425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:57 smithi110 ceph-mon[28069]: pgmap v12425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:06:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:57 smithi193 ceph-mon[32782]: pgmap v12425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:06:59 smithi196 ceph-mon[32572]: pgmap v12426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:06:59 smithi110 ceph-mon[28069]: pgmap v12426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:06:59 smithi193 ceph-mon[32782]: pgmap v12426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:01 smithi196 ceph-mon[32572]: pgmap v12427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:01 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22737.265732 secs 2024-04-26T18:07:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:01 smithi110 ceph-mon[28069]: pgmap v12427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:01 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22737.265732 secs 2024-04-26T18:07:02.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:01 smithi193 ceph-mon[32782]: pgmap v12427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:02.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:01 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22737.265732 secs 2024-04-26T18:07:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:03 smithi196 ceph-mon[32572]: pgmap v12428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:03 smithi110 ceph-mon[28069]: pgmap v12428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:03 smithi193 ceph-mon[32782]: pgmap v12428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:05 smithi196 ceph-mon[32572]: pgmap v12429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:05 smithi110 ceph-mon[28069]: pgmap v12429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:05 smithi193 ceph-mon[32782]: pgmap v12429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:06 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22742.265844 secs 2024-04-26T18:07:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:06 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22742.265844 secs 2024-04-26T18:07:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:06 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22742.265844 secs 2024-04-26T18:07:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:07 smithi196 ceph-mon[32572]: pgmap v12430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:07:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:07 smithi110 ceph-mon[28069]: pgmap v12430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:07:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:07 smithi193 ceph-mon[32782]: pgmap v12430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:07:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:07:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:07:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:08 smithi196 ceph-mon[32572]: pgmap v12431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:08 smithi196 ceph-mon[32572]: pgmap v12432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:07:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:07:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:07:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:08 smithi110 ceph-mon[28069]: pgmap v12431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:08 smithi110 ceph-mon[28069]: pgmap v12432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:07:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:07:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:07:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:08 smithi193 ceph-mon[32782]: pgmap v12431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:08 smithi193 ceph-mon[32782]: pgmap v12432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:07:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:10 smithi193 ceph-mon[32782]: pgmap v12433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:10 smithi196 ceph-mon[32572]: pgmap v12433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:10 smithi110 ceph-mon[28069]: pgmap v12433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:12.014 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:11 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22747.265953 secs 2024-04-26T18:07:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:11 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22747.265953 secs 2024-04-26T18:07:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:11 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22747.265953 secs 2024-04-26T18:07:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:12 smithi196 ceph-mon[32572]: pgmap v12434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 429 B/s rd, 1 op/s 2024-04-26T18:07:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:12 smithi110 ceph-mon[28069]: pgmap v12434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 429 B/s rd, 1 op/s 2024-04-26T18:07:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:12 smithi193 ceph-mon[32782]: pgmap v12434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 429 B/s rd, 1 op/s 2024-04-26T18:07:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:14 smithi193 ceph-mon[32782]: pgmap v12435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:14 smithi196 ceph-mon[32572]: pgmap v12435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:14 smithi110 ceph-mon[28069]: pgmap v12435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:16 smithi193 ceph-mon[32782]: pgmap v12436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:16 smithi196 ceph-mon[32572]: pgmap v12436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:16 smithi110 ceph-mon[28069]: pgmap v12436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:07:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22752.266077 secs 2024-04-26T18:07:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22752.266077 secs 2024-04-26T18:07:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22752.266077 secs 2024-04-26T18:07:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:18 smithi196 ceph-mon[32572]: pgmap v12437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:07:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:18 smithi110 ceph-mon[28069]: pgmap v12437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:07:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:18 smithi193 ceph-mon[32782]: pgmap v12437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:07:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:20 smithi193 ceph-mon[32782]: pgmap v12438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:20 smithi196 ceph-mon[32572]: pgmap v12438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:20 smithi110 ceph-mon[28069]: pgmap v12438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:21 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22757.266153 secs 2024-04-26T18:07:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:21 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22757.266153 secs 2024-04-26T18:07:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:21 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22757.266153 secs 2024-04-26T18:07:22.944 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:22 smithi110 ceph-mon[28069]: pgmap v12439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:22 smithi196 ceph-mon[32572]: pgmap v12439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:22 smithi193 ceph-mon[32782]: pgmap v12439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:24 smithi193 ceph-mon[32782]: pgmap v12440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:24 smithi196 ceph-mon[32572]: pgmap v12440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:24 smithi110 ceph-mon[28069]: pgmap v12440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:26 smithi193 ceph-mon[32782]: pgmap v12441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:26 smithi196 ceph-mon[32572]: pgmap v12441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:26 smithi110 ceph-mon[28069]: pgmap v12441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22762.266277 secs 2024-04-26T18:07:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22762.266277 secs 2024-04-26T18:07:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22762.266277 secs 2024-04-26T18:07:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:28 smithi196 ceph-mon[32572]: pgmap v12442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:28 smithi110 ceph-mon[28069]: pgmap v12442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:28 smithi193 ceph-mon[32782]: pgmap v12442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:30 smithi193 ceph-mon[32782]: pgmap v12443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:30 smithi196 ceph-mon[32572]: pgmap v12443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:30 smithi110 ceph-mon[28069]: pgmap v12443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:31 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22767.266376 secs 2024-04-26T18:07:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:31 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22767.266376 secs 2024-04-26T18:07:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:31 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22767.266376 secs 2024-04-26T18:07:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:32 smithi196 ceph-mon[32572]: pgmap v12444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:32 smithi110 ceph-mon[28069]: pgmap v12444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:32 smithi193 ceph-mon[32782]: pgmap v12444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:34 smithi193 ceph-mon[32782]: pgmap v12445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:34 smithi196 ceph-mon[32572]: pgmap v12445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:34 smithi110 ceph-mon[28069]: pgmap v12445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:36 smithi193 ceph-mon[32782]: pgmap v12446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:36 smithi196 ceph-mon[32572]: pgmap v12446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:36 smithi110 ceph-mon[28069]: pgmap v12446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22772.266533 secs 2024-04-26T18:07:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22772.266533 secs 2024-04-26T18:07:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22772.266533 secs 2024-04-26T18:07:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:38 smithi196 ceph-mon[32572]: pgmap v12447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:38 smithi110 ceph-mon[28069]: pgmap v12447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:38 smithi193 ceph-mon[32782]: pgmap v12447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:40 smithi193 ceph-mon[32782]: pgmap v12448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:40 smithi196 ceph-mon[32572]: pgmap v12448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:40.796 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:40 smithi110 ceph-mon[28069]: pgmap v12448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:41 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22777.266581 secs 2024-04-26T18:07:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:41 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22777.266581 secs 2024-04-26T18:07:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:41 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22777.266581 secs 2024-04-26T18:07:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:42 smithi196 ceph-mon[32572]: pgmap v12449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:42 smithi110 ceph-mon[28069]: pgmap v12449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:42 smithi193 ceph-mon[32782]: pgmap v12449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:44 smithi196 ceph-mon[32572]: pgmap v12450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:44 smithi110 ceph-mon[28069]: pgmap v12450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:44 smithi193 ceph-mon[32782]: pgmap v12450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:46 smithi196 ceph-mon[32572]: pgmap v12451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:46 smithi110 ceph-mon[28069]: pgmap v12451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:46 smithi193 ceph-mon[32782]: pgmap v12451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22782.266678 secs 2024-04-26T18:07:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22782.266678 secs 2024-04-26T18:07:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22782.266678 secs 2024-04-26T18:07:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:48 smithi196 ceph-mon[32572]: pgmap v12452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:48 smithi110 ceph-mon[28069]: pgmap v12452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:48 smithi193 ceph-mon[32782]: pgmap v12452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:07:50.134+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:07:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:07:50.134+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006380 con 0x7f261c104b50 2024-04-26T18:07:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:07:50.135+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 177 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006380 con 0x55db1be4fdd0 2024-04-26T18:07:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:07:50.135+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 177 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:07:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:50 smithi196 ceph-mon[32572]: pgmap v12453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:50 smithi110 ceph-mon[28069]: pgmap v12453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:50 smithi193 ceph-mon[32782]: pgmap v12453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22787.266796 secs 2024-04-26T18:07:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22787.266796 secs 2024-04-26T18:07:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22787.266796 secs 2024-04-26T18:07:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:52 smithi196 ceph-mon[32572]: pgmap v12454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:52 smithi110 ceph-mon[28069]: pgmap v12454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:52 smithi193 ceph-mon[32782]: pgmap v12454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:07:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:54 smithi196 ceph-mon[32572]: pgmap v12455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:54 smithi110 ceph-mon[28069]: pgmap v12455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:54 smithi193 ceph-mon[32782]: pgmap v12455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:56.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:56 smithi193 ceph-mon[32782]: pgmap v12456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:56 smithi196 ceph-mon[32572]: pgmap v12456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:56 smithi110 ceph-mon[28069]: pgmap v12456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:07:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22792.266861 secs 2024-04-26T18:07:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22792.266861 secs 2024-04-26T18:07:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22792.266861 secs 2024-04-26T18:07:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:07:58 smithi196 ceph-mon[32572]: pgmap v12457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:07:58 smithi110 ceph-mon[28069]: pgmap v12457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:07:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:07:58 smithi193 ceph-mon[32782]: pgmap v12457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:00 smithi196 ceph-mon[32572]: pgmap v12458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:00 smithi110 ceph-mon[28069]: pgmap v12458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:00 smithi193 ceph-mon[32782]: pgmap v12458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:01 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22797.266934 secs 2024-04-26T18:08:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:01 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22797.266934 secs 2024-04-26T18:08:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:01 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22797.266934 secs 2024-04-26T18:08:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:03 smithi196 ceph-mon[32572]: pgmap v12459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:08:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:03 smithi110 ceph-mon[28069]: pgmap v12459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:08:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:03 smithi193 ceph-mon[32782]: pgmap v12459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:08:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:05 smithi196 ceph-mon[32572]: pgmap v12460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:05 smithi110 ceph-mon[28069]: pgmap v12460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:05 smithi193 ceph-mon[32782]: pgmap v12460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:06 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22802.267002 secs 2024-04-26T18:08:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:06 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22802.267002 secs 2024-04-26T18:08:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:06 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22802.267002 secs 2024-04-26T18:08:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:07 smithi196 ceph-mon[32572]: pgmap v12461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:07 smithi110 ceph-mon[28069]: pgmap v12461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:07 smithi193 ceph-mon[32782]: pgmap v12461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:08:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:08:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:08:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:09 smithi196 ceph-mon[32572]: pgmap v12462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:09 smithi110 ceph-mon[28069]: pgmap v12462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:09 smithi193 ceph-mon[32782]: pgmap v12462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:08:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:08:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:10 smithi196 ceph-mon[32572]: pgmap v12463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T18:08:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:10 smithi196 ceph-mon[32572]: pgmap v12464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:08:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:08:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:08:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:10 smithi110 ceph-mon[28069]: pgmap v12463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T18:08:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:10 smithi110 ceph-mon[28069]: pgmap v12464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:10 smithi193 ceph-mon[32782]: pgmap v12463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:10 smithi193 ceph-mon[32782]: pgmap v12464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:08:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:11 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22807.267128 secs 2024-04-26T18:08:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:11 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22807.267128 secs 2024-04-26T18:08:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:11 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22807.267128 secs 2024-04-26T18:08:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:12 smithi196 ceph-mon[32572]: pgmap v12465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:08:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:12 smithi110 ceph-mon[28069]: pgmap v12465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:08:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:12 smithi193 ceph-mon[32782]: pgmap v12465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:08:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:14 smithi196 ceph-mon[32572]: pgmap v12466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:14 smithi110 ceph-mon[28069]: pgmap v12466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:14 smithi193 ceph-mon[32782]: pgmap v12466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:16 smithi196 ceph-mon[32572]: pgmap v12467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:16 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22812.267226 secs 2024-04-26T18:08:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:16 smithi110 ceph-mon[28069]: pgmap v12467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:16 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22812.267226 secs 2024-04-26T18:08:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:16 smithi193 ceph-mon[32782]: pgmap v12467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:16 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22812.267226 secs 2024-04-26T18:08:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:18 smithi196 ceph-mon[32572]: pgmap v12468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:18 smithi110 ceph-mon[28069]: pgmap v12468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:18 smithi193 ceph-mon[32782]: pgmap v12468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:08:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:20 smithi196 ceph-mon[32572]: pgmap v12469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:08:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:20 smithi110 ceph-mon[28069]: pgmap v12469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:08:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:20 smithi193 ceph-mon[32782]: pgmap v12469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:08:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:21 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22817.267346 secs 2024-04-26T18:08:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:21 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22817.267346 secs 2024-04-26T18:08:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:21 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22817.267346 secs 2024-04-26T18:08:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:22 smithi196 ceph-mon[32572]: pgmap v12470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:22 smithi110 ceph-mon[28069]: pgmap v12470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:22 smithi193 ceph-mon[32782]: pgmap v12470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:25 smithi196 ceph-mon[32572]: pgmap v12471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:25 smithi110 ceph-mon[28069]: pgmap v12471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:25 smithi193 ceph-mon[32782]: pgmap v12471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:27 smithi110 ceph-mon[28069]: pgmap v12472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22822.267472 secs 2024-04-26T18:08:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:27 smithi193 ceph-mon[32782]: pgmap v12472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22822.267472 secs 2024-04-26T18:08:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:27 smithi196 ceph-mon[32572]: pgmap v12472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22822.267472 secs 2024-04-26T18:08:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:29 smithi110 ceph-mon[28069]: pgmap v12473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:29 smithi193 ceph-mon[32782]: pgmap v12473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:29 smithi196 ceph-mon[32572]: pgmap v12473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:31 smithi110 ceph-mon[28069]: pgmap v12474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:31 smithi193 ceph-mon[32782]: pgmap v12474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:31 smithi196 ceph-mon[32572]: pgmap v12474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22827.267582 secs 2024-04-26T18:08:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22827.267582 secs 2024-04-26T18:08:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22827.267582 secs 2024-04-26T18:08:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:33 smithi110 ceph-mon[28069]: pgmap v12475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:33 smithi193 ceph-mon[32782]: pgmap v12475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:33 smithi196 ceph-mon[32572]: pgmap v12475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:35 smithi110 ceph-mon[28069]: pgmap v12476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:35 smithi193 ceph-mon[32782]: pgmap v12476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:35 smithi196 ceph-mon[32572]: pgmap v12476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:37 smithi110 ceph-mon[28069]: pgmap v12477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22832.267668 secs 2024-04-26T18:08:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:37 smithi193 ceph-mon[32782]: pgmap v12477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22832.267668 secs 2024-04-26T18:08:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:37 smithi196 ceph-mon[32572]: pgmap v12477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22832.267668 secs 2024-04-26T18:08:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:39 smithi193 ceph-mon[32782]: pgmap v12478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:39 smithi196 ceph-mon[32572]: pgmap v12478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:39 smithi110 ceph-mon[28069]: pgmap v12478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:41 smithi193 ceph-mon[32782]: pgmap v12479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:41 smithi196 ceph-mon[32572]: pgmap v12479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:41 smithi110 ceph-mon[28069]: pgmap v12479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22837.267741 secs 2024-04-26T18:08:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22837.267741 secs 2024-04-26T18:08:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22837.267741 secs 2024-04-26T18:08:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:43 smithi193 ceph-mon[32782]: pgmap v12480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:43 smithi196 ceph-mon[32572]: pgmap v12480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:43 smithi110 ceph-mon[28069]: pgmap v12480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:45 smithi193 ceph-mon[32782]: pgmap v12481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:45 smithi196 ceph-mon[32572]: pgmap v12481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:45 smithi110 ceph-mon[28069]: pgmap v12481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:47 smithi193 ceph-mon[32782]: pgmap v12482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22842.267820 secs 2024-04-26T18:08:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:47 smithi196 ceph-mon[32572]: pgmap v12482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22842.267820 secs 2024-04-26T18:08:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:47 smithi110 ceph-mon[28069]: pgmap v12482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22842.267820 secs 2024-04-26T18:08:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:49 smithi193 ceph-mon[32782]: pgmap v12483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:49 smithi196 ceph-mon[32572]: pgmap v12483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:49 smithi110 ceph-mon[28069]: pgmap v12483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:51 smithi193 ceph-mon[32782]: pgmap v12484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:51 smithi196 ceph-mon[32572]: pgmap v12484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:51 smithi110 ceph-mon[28069]: pgmap v12484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22847.267887 secs 2024-04-26T18:08:52.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22847.267887 secs 2024-04-26T18:08:52.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22847.267887 secs 2024-04-26T18:08:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:53 smithi193 ceph-mon[32782]: pgmap v12485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:53 smithi196 ceph-mon[32572]: pgmap v12485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:53 smithi110 ceph-mon[28069]: pgmap v12485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:55 smithi193 ceph-mon[32782]: pgmap v12486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:55.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:55 smithi196 ceph-mon[32572]: pgmap v12486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:55 smithi110 ceph-mon[28069]: pgmap v12486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:57 smithi193 ceph-mon[32782]: pgmap v12487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22852.268013 secs 2024-04-26T18:08:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:57 smithi196 ceph-mon[32572]: pgmap v12487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22852.268013 secs 2024-04-26T18:08:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:57 smithi110 ceph-mon[28069]: pgmap v12487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:08:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22852.268013 secs 2024-04-26T18:08:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:08:59 smithi193 ceph-mon[32782]: pgmap v12488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:08:59 smithi196 ceph-mon[32572]: pgmap v12488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:08:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:08:59 smithi110 ceph-mon[28069]: pgmap v12488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:01 smithi193 ceph-mon[32782]: pgmap v12489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:01 smithi196 ceph-mon[32572]: pgmap v12489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:01 smithi110 ceph-mon[28069]: pgmap v12489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22857.268095 secs 2024-04-26T18:09:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22857.268095 secs 2024-04-26T18:09:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22857.268095 secs 2024-04-26T18:09:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:03 smithi196 ceph-mon[32572]: pgmap v12490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:03 smithi110 ceph-mon[28069]: pgmap v12490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:03 smithi193 ceph-mon[32782]: pgmap v12490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:05 smithi196 ceph-mon[32572]: pgmap v12491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:05 smithi110 ceph-mon[28069]: pgmap v12491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:05 smithi193 ceph-mon[32782]: pgmap v12491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:07 smithi196 ceph-mon[32572]: pgmap v12492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22862.268215 secs 2024-04-26T18:09:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:07 smithi110 ceph-mon[28069]: pgmap v12492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22862.268215 secs 2024-04-26T18:09:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:07 smithi193 ceph-mon[32782]: pgmap v12492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22862.268215 secs 2024-04-26T18:09:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:09 smithi196 ceph-mon[32572]: pgmap v12493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:09 smithi110 ceph-mon[28069]: pgmap v12493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:09 smithi193 ceph-mon[32782]: pgmap v12493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:11 smithi196 ceph-mon[32572]: pgmap v12494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:09:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:11 smithi110 ceph-mon[28069]: pgmap v12494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:09:11.540 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:09:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:09:11.318+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:09:11.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:09:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:09:11.318+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:09:11.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:09:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:09:11.318+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:09:11.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:09:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:09:11.318+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:09:11.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:09:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:09:11.318+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:09:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:11 smithi193 ceph-mon[32782]: pgmap v12494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:09:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:09:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:09:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:09:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22867.268288 secs 2024-04-26T18:09:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:09:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:09:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:09:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22867.268288 secs 2024-04-26T18:09:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:09:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:09:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:09:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22867.268288 secs 2024-04-26T18:09:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:13 smithi196 ceph-mon[32572]: pgmap v12495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 892 B/s rd, 1 op/s 2024-04-26T18:09:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:13 smithi196 ceph-mon[32572]: pgmap v12496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:13 smithi110 ceph-mon[28069]: pgmap v12495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 892 B/s rd, 1 op/s 2024-04-26T18:09:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:13 smithi110 ceph-mon[28069]: pgmap v12496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:13 smithi193 ceph-mon[32782]: pgmap v12495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 892 B/s rd, 1 op/s 2024-04-26T18:09:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:13 smithi193 ceph-mon[32782]: pgmap v12496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:15 smithi196 ceph-mon[32572]: pgmap v12497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:15 smithi110 ceph-mon[28069]: pgmap v12497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:15 smithi193 ceph-mon[32782]: pgmap v12497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:17 smithi196 ceph-mon[32572]: pgmap v12498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22872.268425 secs 2024-04-26T18:09:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:17 smithi110 ceph-mon[28069]: pgmap v12498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22872.268425 secs 2024-04-26T18:09:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:17 smithi193 ceph-mon[32782]: pgmap v12498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22872.268425 secs 2024-04-26T18:09:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:19 smithi196 ceph-mon[32572]: pgmap v12499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:19 smithi110 ceph-mon[28069]: pgmap v12499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:19 smithi193 ceph-mon[32782]: pgmap v12499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:09:20.149+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:09:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:09:20.149+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006380 con 0x7f261c104b50 2024-04-26T18:09:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:09:20.150+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 178 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006380 con 0x55db1be4fdd0 2024-04-26T18:09:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:09:20.150+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 178 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:09:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:21 smithi196 ceph-mon[32572]: pgmap v12500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:21 smithi110 ceph-mon[28069]: pgmap v12500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:21 smithi193 ceph-mon[32782]: pgmap v12500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:09:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22877.268511 secs 2024-04-26T18:09:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22877.268511 secs 2024-04-26T18:09:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22877.268511 secs 2024-04-26T18:09:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:23 smithi196 ceph-mon[32572]: pgmap v12501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:09:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:23 smithi110 ceph-mon[28069]: pgmap v12501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:09:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:23 smithi193 ceph-mon[32782]: pgmap v12501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:09:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:25 smithi196 ceph-mon[32572]: pgmap v12502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:25 smithi110 ceph-mon[28069]: pgmap v12502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:25 smithi193 ceph-mon[32782]: pgmap v12502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:27 smithi196 ceph-mon[32572]: pgmap v12503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22882.268629 secs 2024-04-26T18:09:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:27 smithi110 ceph-mon[28069]: pgmap v12503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22882.268629 secs 2024-04-26T18:09:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:27 smithi193 ceph-mon[32782]: pgmap v12503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22882.268629 secs 2024-04-26T18:09:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:29 smithi196 ceph-mon[32572]: pgmap v12504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:29 smithi110 ceph-mon[28069]: pgmap v12504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:29 smithi193 ceph-mon[32782]: pgmap v12504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:31 smithi196 ceph-mon[32572]: pgmap v12505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:31 smithi110 ceph-mon[28069]: pgmap v12505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:31 smithi193 ceph-mon[32782]: pgmap v12505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22887.268768 secs 2024-04-26T18:09:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22887.268768 secs 2024-04-26T18:09:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22887.268768 secs 2024-04-26T18:09:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:33 smithi196 ceph-mon[32572]: pgmap v12506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:33 smithi110 ceph-mon[28069]: pgmap v12506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:33 smithi193 ceph-mon[32782]: pgmap v12506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:35 smithi196 ceph-mon[32572]: pgmap v12507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:35 smithi110 ceph-mon[28069]: pgmap v12507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:35 smithi193 ceph-mon[32782]: pgmap v12507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:37 smithi196 ceph-mon[32572]: pgmap v12508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22892.268887 secs 2024-04-26T18:09:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:37 smithi110 ceph-mon[28069]: pgmap v12508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22892.268887 secs 2024-04-26T18:09:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:37 smithi193 ceph-mon[32782]: pgmap v12508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22892.268887 secs 2024-04-26T18:09:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:39 smithi196 ceph-mon[32572]: pgmap v12509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:39 smithi110 ceph-mon[28069]: pgmap v12509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:39 smithi193 ceph-mon[32782]: pgmap v12509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:41 smithi110 ceph-mon[28069]: pgmap v12510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:41 smithi193 ceph-mon[32782]: pgmap v12510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:41 smithi196 ceph-mon[32572]: pgmap v12510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22897.269008 secs 2024-04-26T18:09:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22897.269008 secs 2024-04-26T18:09:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22897.269008 secs 2024-04-26T18:09:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:43 smithi110 ceph-mon[28069]: pgmap v12511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:43 smithi193 ceph-mon[32782]: pgmap v12511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:43 smithi196 ceph-mon[32572]: pgmap v12511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:45 smithi110 ceph-mon[28069]: pgmap v12512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:45 smithi193 ceph-mon[32782]: pgmap v12512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:45 smithi196 ceph-mon[32572]: pgmap v12512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:47 smithi193 ceph-mon[32782]: pgmap v12513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22902.269077 secs 2024-04-26T18:09:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:47 smithi196 ceph-mon[32572]: pgmap v12513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22902.269077 secs 2024-04-26T18:09:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:47 smithi110 ceph-mon[28069]: pgmap v12513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22902.269077 secs 2024-04-26T18:09:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:49 smithi193 ceph-mon[32782]: pgmap v12514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:49 smithi196 ceph-mon[32572]: pgmap v12514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:49 smithi110 ceph-mon[28069]: pgmap v12514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:51 smithi193 ceph-mon[32782]: pgmap v12515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:51 smithi196 ceph-mon[32572]: pgmap v12515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:51 smithi110 ceph-mon[28069]: pgmap v12515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22907.269151 secs 2024-04-26T18:09:52.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22907.269151 secs 2024-04-26T18:09:52.691 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22907.269151 secs 2024-04-26T18:09:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:53 smithi193 ceph-mon[32782]: pgmap v12516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:53 smithi196 ceph-mon[32572]: pgmap v12516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:53 smithi110 ceph-mon[28069]: pgmap v12516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:55 smithi193 ceph-mon[32782]: pgmap v12517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:55 smithi196 ceph-mon[32572]: pgmap v12517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:55 smithi110 ceph-mon[28069]: pgmap v12517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:57 smithi193 ceph-mon[32782]: pgmap v12518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22912.269270 secs 2024-04-26T18:09:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:57 smithi196 ceph-mon[32572]: pgmap v12518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22912.269270 secs 2024-04-26T18:09:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:57 smithi110 ceph-mon[28069]: pgmap v12518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:09:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22912.269270 secs 2024-04-26T18:09:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:09:59 smithi193 ceph-mon[32782]: pgmap v12519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:09:59 smithi196 ceph-mon[32572]: pgmap v12519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:09:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:09:59 smithi110 ceph-mon[28069]: pgmap v12519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:10:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:10:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:10:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:01 smithi193 ceph-mon[32782]: pgmap v12520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:01 smithi196 ceph-mon[32572]: pgmap v12520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:01 smithi110 ceph-mon[28069]: pgmap v12520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22917.269389 secs 2024-04-26T18:10:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22917.269389 secs 2024-04-26T18:10:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22917.269389 secs 2024-04-26T18:10:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:03 smithi193 ceph-mon[32782]: pgmap v12521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:03 smithi196 ceph-mon[32572]: pgmap v12521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:03 smithi110 ceph-mon[28069]: pgmap v12521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:04 smithi193 ceph-mon[32782]: pgmap v12522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:04 smithi196 ceph-mon[32572]: pgmap v12522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:04 smithi110 ceph-mon[28069]: pgmap v12522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:06 smithi196 ceph-mon[32572]: pgmap v12523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:06 smithi110 ceph-mon[28069]: pgmap v12523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:06 smithi193 ceph-mon[32782]: pgmap v12523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22922.269524 secs 2024-04-26T18:10:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22922.269524 secs 2024-04-26T18:10:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22922.269524 secs 2024-04-26T18:10:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:08 smithi196 ceph-mon[32572]: pgmap v12524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:08 smithi110 ceph-mon[28069]: pgmap v12524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:08 smithi193 ceph-mon[32782]: pgmap v12524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:10 smithi110 ceph-mon[28069]: pgmap v12525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:10 smithi193 ceph-mon[32782]: pgmap v12525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:10 smithi196 ceph-mon[32572]: pgmap v12525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:12 smithi110 ceph-mon[28069]: pgmap v12526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22927.269667 secs 2024-04-26T18:10:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:10:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:12 smithi193 ceph-mon[32782]: pgmap v12526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22927.269667 secs 2024-04-26T18:10:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:10:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:12 smithi196 ceph-mon[32572]: pgmap v12526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22927.269667 secs 2024-04-26T18:10:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:10:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:10:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:10:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:13 smithi110 ceph-mon[28069]: pgmap v12527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:10:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:13 smithi110 ceph-mon[28069]: pgmap v12528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:10:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:10:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:10:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:13 smithi193 ceph-mon[32782]: pgmap v12527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:10:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:13 smithi193 ceph-mon[32782]: pgmap v12528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:10:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:10:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:10:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:13 smithi196 ceph-mon[32572]: pgmap v12527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:10:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:13 smithi196 ceph-mon[32572]: pgmap v12528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:10:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:16 smithi110 ceph-mon[28069]: pgmap v12529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:16 smithi193 ceph-mon[32782]: pgmap v12529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:16 smithi196 ceph-mon[32572]: pgmap v12529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22932.269770 secs 2024-04-26T18:10:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22932.269770 secs 2024-04-26T18:10:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22932.269770 secs 2024-04-26T18:10:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:18 smithi193 ceph-mon[32782]: pgmap v12530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:10:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:18 smithi196 ceph-mon[32572]: pgmap v12530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:10:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:18 smithi110 ceph-mon[28069]: pgmap v12530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:10:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:20 smithi193 ceph-mon[32782]: pgmap v12531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:20 smithi196 ceph-mon[32572]: pgmap v12531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:20 smithi110 ceph-mon[28069]: pgmap v12531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:22.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:22 smithi196 ceph-mon[32572]: pgmap v12532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:22.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22937.269894 secs 2024-04-26T18:10:22.346 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:22 smithi110 ceph-mon[28069]: pgmap v12532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:22.346 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22937.269894 secs 2024-04-26T18:10:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:22 smithi193 ceph-mon[32782]: pgmap v12532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:10:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22937.269894 secs 2024-04-26T18:10:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:24 smithi193 ceph-mon[32782]: pgmap v12533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:10:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:24 smithi196 ceph-mon[32572]: pgmap v12533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:10:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:24 smithi110 ceph-mon[28069]: pgmap v12533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:10:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:26 smithi193 ceph-mon[32782]: pgmap v12534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:26 smithi196 ceph-mon[32572]: pgmap v12534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:26 smithi110 ceph-mon[28069]: pgmap v12534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22942.270020 secs 2024-04-26T18:10:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22942.270020 secs 2024-04-26T18:10:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22942.270020 secs 2024-04-26T18:10:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:28 smithi193 ceph-mon[32782]: pgmap v12535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:28 smithi196 ceph-mon[32572]: pgmap v12535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:28 smithi110 ceph-mon[28069]: pgmap v12535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:30 smithi193 ceph-mon[32782]: pgmap v12536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:30 smithi196 ceph-mon[32572]: pgmap v12536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:30 smithi110 ceph-mon[28069]: pgmap v12536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:32 smithi193 ceph-mon[32782]: pgmap v12537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22947.270136 secs 2024-04-26T18:10:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:32 smithi196 ceph-mon[32572]: pgmap v12537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22947.270136 secs 2024-04-26T18:10:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:32 smithi110 ceph-mon[28069]: pgmap v12537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22947.270136 secs 2024-04-26T18:10:34.377 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:34 smithi193 ceph-mon[32782]: pgmap v12538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:34 smithi196 ceph-mon[32572]: pgmap v12538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:34 smithi110 ceph-mon[28069]: pgmap v12538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:36 smithi193 ceph-mon[32782]: pgmap v12539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:36 smithi196 ceph-mon[32572]: pgmap v12539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:36 smithi110 ceph-mon[28069]: pgmap v12539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22952.270260 secs 2024-04-26T18:10:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22952.270260 secs 2024-04-26T18:10:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22952.270260 secs 2024-04-26T18:10:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:38 smithi193 ceph-mon[32782]: pgmap v12540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:38 smithi196 ceph-mon[32572]: pgmap v12540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:38 smithi110 ceph-mon[28069]: pgmap v12540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:40 smithi193 ceph-mon[32782]: pgmap v12541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:40 smithi196 ceph-mon[32572]: pgmap v12541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:40 smithi110 ceph-mon[28069]: pgmap v12541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:42 smithi193 ceph-mon[32782]: pgmap v12542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22957.270381 secs 2024-04-26T18:10:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:42 smithi196 ceph-mon[32572]: pgmap v12542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22957.270381 secs 2024-04-26T18:10:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:42 smithi110 ceph-mon[28069]: pgmap v12542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22957.270381 secs 2024-04-26T18:10:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:44 smithi196 ceph-mon[32572]: pgmap v12543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:44 smithi110 ceph-mon[28069]: pgmap v12543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:44 smithi193 ceph-mon[32782]: pgmap v12543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:46 smithi196 ceph-mon[32572]: pgmap v12544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:46 smithi110 ceph-mon[28069]: pgmap v12544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:46 smithi193 ceph-mon[32782]: pgmap v12544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22962.270523 secs 2024-04-26T18:10:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22962.270523 secs 2024-04-26T18:10:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22962.270523 secs 2024-04-26T18:10:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:48 smithi196 ceph-mon[32572]: pgmap v12545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:48 smithi110 ceph-mon[28069]: pgmap v12545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:48 smithi193 ceph-mon[32782]: pgmap v12545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:50 smithi196 ceph-mon[32572]: pgmap v12546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:50 smithi110 ceph-mon[28069]: pgmap v12546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:50 smithi193 ceph-mon[32782]: pgmap v12546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:52 smithi196 ceph-mon[32572]: pgmap v12547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22967.270662 secs 2024-04-26T18:10:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:52 smithi110 ceph-mon[28069]: pgmap v12547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22967.270662 secs 2024-04-26T18:10:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:52 smithi193 ceph-mon[32782]: pgmap v12547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22967.270662 secs 2024-04-26T18:10:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:54 smithi196 ceph-mon[32572]: pgmap v12548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:54 smithi110 ceph-mon[28069]: pgmap v12548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:54 smithi193 ceph-mon[32782]: pgmap v12548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:10:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:56 smithi196 ceph-mon[32572]: pgmap v12549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:56 smithi110 ceph-mon[28069]: pgmap v12549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:56 smithi193 ceph-mon[32782]: pgmap v12549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22972.270801 secs 2024-04-26T18:10:57.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22972.270801 secs 2024-04-26T18:10:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22972.270801 secs 2024-04-26T18:10:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:10:58 smithi196 ceph-mon[32572]: pgmap v12550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:10:58 smithi110 ceph-mon[28069]: pgmap v12550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:10:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:10:58 smithi193 ceph-mon[32782]: pgmap v12550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:00 smithi196 ceph-mon[32572]: pgmap v12551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:00 smithi110 ceph-mon[28069]: pgmap v12551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:00 smithi193 ceph-mon[32782]: pgmap v12551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:02 smithi196 ceph-mon[32572]: pgmap v12552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22977.270920 secs 2024-04-26T18:11:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:02 smithi110 ceph-mon[28069]: pgmap v12552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22977.270920 secs 2024-04-26T18:11:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:02 smithi193 ceph-mon[32782]: pgmap v12552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22977.270920 secs 2024-04-26T18:11:04.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:04 smithi196 ceph-mon[32572]: pgmap v12553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:04 smithi110 ceph-mon[28069]: pgmap v12553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:04.628 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:04 smithi193 ceph-mon[32782]: pgmap v12553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:06 smithi196 ceph-mon[32572]: pgmap v12554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:06 smithi110 ceph-mon[28069]: pgmap v12554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:06 smithi193 ceph-mon[32782]: pgmap v12554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22982.271038 secs 2024-04-26T18:11:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22982.271038 secs 2024-04-26T18:11:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22982.271038 secs 2024-04-26T18:11:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:08 smithi196 ceph-mon[32572]: pgmap v12555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:08 smithi110 ceph-mon[28069]: pgmap v12555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:08 smithi193 ceph-mon[32782]: pgmap v12555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:10 smithi196 ceph-mon[32572]: pgmap v12556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:10 smithi110 ceph-mon[28069]: pgmap v12556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:10 smithi193 ceph-mon[32782]: pgmap v12556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:12 smithi196 ceph-mon[32572]: pgmap v12557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22987.271156 secs 2024-04-26T18:11:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:12 smithi110 ceph-mon[28069]: pgmap v12557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22987.271156 secs 2024-04-26T18:11:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:12 smithi193 ceph-mon[32782]: pgmap v12557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22987.271156 secs 2024-04-26T18:11:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:14 smithi196 ceph-mon[32572]: pgmap v12558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:11:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:14 smithi110 ceph-mon[28069]: pgmap v12558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:11:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:14 smithi193 ceph-mon[32782]: pgmap v12558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:11:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:11:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:11:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:11:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:11:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:11:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:11:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:11:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:11:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:11:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:16 smithi196 ceph-mon[32572]: pgmap v12559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T18:11:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:16 smithi196 ceph-mon[32572]: pgmap v12560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:16 smithi110 ceph-mon[28069]: pgmap v12559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T18:11:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:16 smithi110 ceph-mon[28069]: pgmap v12560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:16 smithi193 ceph-mon[32782]: pgmap v12559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T18:11:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:16 smithi193 ceph-mon[32782]: pgmap v12560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22992.271273 secs 2024-04-26T18:11:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22992.271273 secs 2024-04-26T18:11:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22992.271273 secs 2024-04-26T18:11:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:18 smithi196 ceph-mon[32572]: pgmap v12561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:18 smithi110 ceph-mon[28069]: pgmap v12561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:18 smithi193 ceph-mon[32782]: pgmap v12561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:20 smithi110 ceph-mon[28069]: pgmap v12562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:20 smithi193 ceph-mon[32782]: pgmap v12562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:20 smithi196 ceph-mon[32572]: pgmap v12562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:22 smithi110 ceph-mon[28069]: pgmap v12563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 22997.271410 secs 2024-04-26T18:11:22.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:22 smithi196 ceph-mon[32572]: pgmap v12563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:22.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 22997.271410 secs 2024-04-26T18:11:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:22 smithi193 ceph-mon[32782]: pgmap v12563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 22997.271410 secs 2024-04-26T18:11:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:24 smithi110 ceph-mon[28069]: pgmap v12564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:24 smithi193 ceph-mon[32782]: pgmap v12564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:24 smithi196 ceph-mon[32572]: pgmap v12564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:11:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:26 smithi110 ceph-mon[28069]: pgmap v12565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:11:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:26 smithi193 ceph-mon[32782]: pgmap v12565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:11:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:26 smithi196 ceph-mon[32572]: pgmap v12565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:11:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23002.271547 secs 2024-04-26T18:11:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23002.271547 secs 2024-04-26T18:11:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23002.271547 secs 2024-04-26T18:11:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:28 smithi110 ceph-mon[28069]: pgmap v12566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:28 smithi193 ceph-mon[32782]: pgmap v12566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:28 smithi196 ceph-mon[32572]: pgmap v12566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:30 smithi110 ceph-mon[28069]: pgmap v12567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:30 smithi193 ceph-mon[32782]: pgmap v12567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:30 smithi196 ceph-mon[32572]: pgmap v12567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:32 smithi193 ceph-mon[32782]: pgmap v12568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23007.271618 secs 2024-04-26T18:11:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:32 smithi196 ceph-mon[32572]: pgmap v12568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23007.271618 secs 2024-04-26T18:11:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:32 smithi110 ceph-mon[28069]: pgmap v12568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23007.271618 secs 2024-04-26T18:11:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:34 smithi193 ceph-mon[32782]: pgmap v12569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:34 smithi196 ceph-mon[32572]: pgmap v12569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:34 smithi110 ceph-mon[28069]: pgmap v12569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:36 smithi193 ceph-mon[32782]: pgmap v12570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:36 smithi196 ceph-mon[32572]: pgmap v12570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:36 smithi110 ceph-mon[28069]: pgmap v12570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23012.271699 secs 2024-04-26T18:11:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23012.271699 secs 2024-04-26T18:11:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23012.271699 secs 2024-04-26T18:11:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:38 smithi193 ceph-mon[32782]: pgmap v12571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:38 smithi196 ceph-mon[32572]: pgmap v12571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:38 smithi110 ceph-mon[28069]: pgmap v12571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:40 smithi193 ceph-mon[32782]: pgmap v12572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:40 smithi196 ceph-mon[32572]: pgmap v12572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:40 smithi110 ceph-mon[28069]: pgmap v12572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:42 smithi193 ceph-mon[32782]: pgmap v12573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23017.271844 secs 2024-04-26T18:11:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:42 smithi196 ceph-mon[32572]: pgmap v12573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23017.271844 secs 2024-04-26T18:11:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:42 smithi110 ceph-mon[28069]: pgmap v12573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23017.271844 secs 2024-04-26T18:11:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:44 smithi193 ceph-mon[32782]: pgmap v12574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:44 smithi196 ceph-mon[32572]: pgmap v12574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:44 smithi110 ceph-mon[28069]: pgmap v12574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:46 smithi193 ceph-mon[32782]: pgmap v12575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:46 smithi196 ceph-mon[32572]: pgmap v12575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:46 smithi110 ceph-mon[28069]: pgmap v12575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23022.271967 secs 2024-04-26T18:11:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23022.271967 secs 2024-04-26T18:11:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23022.271967 secs 2024-04-26T18:11:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:48 smithi193 ceph-mon[32782]: pgmap v12576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:48 smithi196 ceph-mon[32572]: pgmap v12576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:48 smithi110 ceph-mon[28069]: pgmap v12576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:50 smithi193 ceph-mon[32782]: pgmap v12577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:50 smithi196 ceph-mon[32572]: pgmap v12577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:50 smithi110 ceph-mon[28069]: pgmap v12577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:52 smithi193 ceph-mon[32782]: pgmap v12578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23027.272079 secs 2024-04-26T18:11:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:52 smithi196 ceph-mon[32572]: pgmap v12578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23027.272079 secs 2024-04-26T18:11:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:52 smithi110 ceph-mon[28069]: pgmap v12578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23027.272079 secs 2024-04-26T18:11:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:53 smithi196 ceph-mon[32572]: pgmap v12579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:53 smithi110 ceph-mon[28069]: pgmap v12579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:53 smithi193 ceph-mon[32782]: pgmap v12579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:11:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:55 smithi193 ceph-mon[32782]: pgmap v12580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:55 smithi196 ceph-mon[32572]: pgmap v12580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:55 smithi110 ceph-mon[28069]: pgmap v12580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:57 smithi193 ceph-mon[32782]: pgmap v12581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23032.272199 secs 2024-04-26T18:11:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:57 smithi196 ceph-mon[32572]: pgmap v12581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23032.272199 secs 2024-04-26T18:11:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:57 smithi110 ceph-mon[28069]: pgmap v12581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:11:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23032.272199 secs 2024-04-26T18:11:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:11:59 smithi193 ceph-mon[32782]: pgmap v12582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:11:59 smithi196 ceph-mon[32572]: pgmap v12582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:11:59 smithi110 ceph-mon[28069]: pgmap v12582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:01 smithi193 ceph-mon[32782]: pgmap v12583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:01 smithi196 ceph-mon[32572]: pgmap v12583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:01 smithi110 ceph-mon[28069]: pgmap v12583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23037.272301 secs 2024-04-26T18:12:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23037.272301 secs 2024-04-26T18:12:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23037.272301 secs 2024-04-26T18:12:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:03 smithi193 ceph-mon[32782]: pgmap v12584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:03 smithi196 ceph-mon[32572]: pgmap v12584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:03 smithi110 ceph-mon[28069]: pgmap v12584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:05 smithi193 ceph-mon[32782]: pgmap v12585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:05 smithi196 ceph-mon[32572]: pgmap v12585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:05 smithi110 ceph-mon[28069]: pgmap v12585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:07 smithi193 ceph-mon[32782]: pgmap v12586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:07 smithi193 ceph-mon[32782]: 20 slow requests, 1 included below; oldest blocked for > 23042.272402 secs 2024-04-26T18:12:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:07 smithi193 ceph-mon[32782]: slow request 23042.272401 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:12:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:07 smithi196 ceph-mon[32572]: pgmap v12586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:07 smithi196 ceph-mon[32572]: 20 slow requests, 1 included below; oldest blocked for > 23042.272402 secs 2024-04-26T18:12:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:07 smithi196 ceph-mon[32572]: slow request 23042.272401 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:12:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:07 smithi110 ceph-mon[28069]: pgmap v12586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:07 smithi110 ceph-mon[28069]: 20 slow requests, 1 included below; oldest blocked for > 23042.272402 secs 2024-04-26T18:12:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:07 smithi110 ceph-mon[28069]: slow request 23042.272401 seconds old, received at 2024-04-26T11:48:04.298323+0000: client_request(client.15165:206 rmsnap #0x1//scheduled-2024-04-26-11_42_00_UTC 2024-04-26T11:48:04.297886+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:12:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:09 smithi193 ceph-mon[32782]: pgmap v12587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:09 smithi196 ceph-mon[32572]: pgmap v12587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:09 smithi110 ceph-mon[28069]: pgmap v12587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:11 smithi193 ceph-mon[32782]: pgmap v12588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:11 smithi196 ceph-mon[32572]: pgmap v12588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:11 smithi110 ceph-mon[28069]: pgmap v12588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23047.272484 secs 2024-04-26T18:12:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23047.272484 secs 2024-04-26T18:12:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23047.272484 secs 2024-04-26T18:12:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:13 smithi193 ceph-mon[32782]: pgmap v12589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:13 smithi196 ceph-mon[32572]: pgmap v12589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:13 smithi110 ceph-mon[28069]: pgmap v12589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:15 smithi196 ceph-mon[32572]: pgmap v12590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:12:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:15 smithi110 ceph-mon[28069]: pgmap v12590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:12:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:15 smithi193 ceph-mon[32782]: pgmap v12590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:12:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:12:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:12:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:16 smithi196 ceph-mon[32572]: pgmap v12591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T18:12:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:16 smithi196 ceph-mon[32572]: pgmap v12592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:12:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:12:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:12:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:16 smithi110 ceph-mon[28069]: pgmap v12591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T18:12:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:16 smithi110 ceph-mon[28069]: pgmap v12592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:12:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:12:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:12:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:16 smithi193 ceph-mon[32782]: pgmap v12591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T18:12:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:16 smithi193 ceph-mon[32782]: pgmap v12592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:12:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23052.272570 secs 2024-04-26T18:12:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23052.272570 secs 2024-04-26T18:12:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23052.272570 secs 2024-04-26T18:12:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:18 smithi196 ceph-mon[32572]: pgmap v12593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:18 smithi110 ceph-mon[28069]: pgmap v12593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:19.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:18 smithi193 ceph-mon[32782]: pgmap v12593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:12:20.180+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:12:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:12:20.180+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006380 con 0x7f261c104b50 2024-04-26T18:12:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:12:20.181+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 179 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006380 con 0x55db1be4fdd0 2024-04-26T18:12:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:12:20.181+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 179 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:12:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:21 smithi196 ceph-mon[32572]: pgmap v12594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:21 smithi110 ceph-mon[28069]: pgmap v12594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:21 smithi193 ceph-mon[32782]: pgmap v12594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:22.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23057.272673 secs 2024-04-26T18:12:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23057.272673 secs 2024-04-26T18:12:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23057.272673 secs 2024-04-26T18:12:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:23 smithi196 ceph-mon[32572]: pgmap v12595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:12:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:23 smithi110 ceph-mon[28069]: pgmap v12595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:12:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:23 smithi193 ceph-mon[32782]: pgmap v12595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:12:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:25 smithi196 ceph-mon[32572]: pgmap v12596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:25 smithi110 ceph-mon[28069]: pgmap v12596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:25 smithi193 ceph-mon[32782]: pgmap v12596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:12:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:27 smithi196 ceph-mon[32572]: pgmap v12597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:12:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23062.272785 secs 2024-04-26T18:12:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:27 smithi110 ceph-mon[28069]: pgmap v12597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:12:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23062.272785 secs 2024-04-26T18:12:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:27 smithi193 ceph-mon[32782]: pgmap v12597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:12:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23062.272785 secs 2024-04-26T18:12:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:29 smithi196 ceph-mon[32572]: pgmap v12598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:29 smithi110 ceph-mon[28069]: pgmap v12598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:29 smithi193 ceph-mon[32782]: pgmap v12598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:31 smithi196 ceph-mon[32572]: pgmap v12599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:31 smithi110 ceph-mon[28069]: pgmap v12599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:31 smithi193 ceph-mon[32782]: pgmap v12599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23067.272905 secs 2024-04-26T18:12:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23067.272905 secs 2024-04-26T18:12:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23067.272905 secs 2024-04-26T18:12:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:33 smithi196 ceph-mon[32572]: pgmap v12600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:33 smithi110 ceph-mon[28069]: pgmap v12600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:33 smithi193 ceph-mon[32782]: pgmap v12600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:35 smithi196 ceph-mon[32572]: pgmap v12601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:35 smithi110 ceph-mon[28069]: pgmap v12601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:35 smithi193 ceph-mon[32782]: pgmap v12601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:37 smithi196 ceph-mon[32572]: pgmap v12602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23072.273050 secs 2024-04-26T18:12:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:37 smithi110 ceph-mon[28069]: pgmap v12602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23072.273050 secs 2024-04-26T18:12:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:37 smithi193 ceph-mon[32782]: pgmap v12602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23072.273050 secs 2024-04-26T18:12:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:39 smithi196 ceph-mon[32572]: pgmap v12603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:39 smithi110 ceph-mon[28069]: pgmap v12603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:39 smithi193 ceph-mon[32782]: pgmap v12603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:41 smithi196 ceph-mon[32572]: pgmap v12604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:41 smithi110 ceph-mon[28069]: pgmap v12604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:41 smithi193 ceph-mon[32782]: pgmap v12604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23077.273188 secs 2024-04-26T18:12:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23077.273188 secs 2024-04-26T18:12:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23077.273188 secs 2024-04-26T18:12:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:43 smithi196 ceph-mon[32572]: pgmap v12605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:43 smithi110 ceph-mon[28069]: pgmap v12605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:43 smithi193 ceph-mon[32782]: pgmap v12605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:45 smithi196 ceph-mon[32572]: pgmap v12606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:45 smithi110 ceph-mon[28069]: pgmap v12606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:45 smithi193 ceph-mon[32782]: pgmap v12606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:47 smithi196 ceph-mon[32572]: pgmap v12607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23082.273310 secs 2024-04-26T18:12:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:47 smithi110 ceph-mon[28069]: pgmap v12607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23082.273310 secs 2024-04-26T18:12:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:47 smithi193 ceph-mon[32782]: pgmap v12607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23082.273310 secs 2024-04-26T18:12:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:49 smithi196 ceph-mon[32572]: pgmap v12608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:49 smithi110 ceph-mon[28069]: pgmap v12608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:49 smithi193 ceph-mon[32782]: pgmap v12608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:51 smithi110 ceph-mon[28069]: pgmap v12609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:51 smithi193 ceph-mon[32782]: pgmap v12609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:51 smithi196 ceph-mon[32572]: pgmap v12609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23087.273431 secs 2024-04-26T18:12:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23087.273431 secs 2024-04-26T18:12:52.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23087.273431 secs 2024-04-26T18:12:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:53 smithi110 ceph-mon[28069]: pgmap v12610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:53 smithi193 ceph-mon[32782]: pgmap v12610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:53 smithi196 ceph-mon[32572]: pgmap v12610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:55 smithi110 ceph-mon[28069]: pgmap v12611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:55 smithi193 ceph-mon[32782]: pgmap v12611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:55 smithi196 ceph-mon[32572]: pgmap v12611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:57 smithi110 ceph-mon[28069]: pgmap v12612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23092.273546 secs 2024-04-26T18:12:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:57 smithi193 ceph-mon[32782]: pgmap v12612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23092.273546 secs 2024-04-26T18:12:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:57 smithi196 ceph-mon[32572]: pgmap v12612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:12:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23092.273546 secs 2024-04-26T18:12:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:12:59 smithi110 ceph-mon[28069]: pgmap v12613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:12:59 smithi193 ceph-mon[32782]: pgmap v12613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:12:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:12:59 smithi196 ceph-mon[32572]: pgmap v12613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:01 smithi110 ceph-mon[28069]: pgmap v12614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:01 smithi193 ceph-mon[32782]: pgmap v12614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:01 smithi196 ceph-mon[32572]: pgmap v12614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23097.273656 secs 2024-04-26T18:13:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23097.273656 secs 2024-04-26T18:13:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23097.273656 secs 2024-04-26T18:13:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:03 smithi193 ceph-mon[32782]: pgmap v12615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:03 smithi196 ceph-mon[32572]: pgmap v12615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:03 smithi110 ceph-mon[28069]: pgmap v12615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:05 smithi193 ceph-mon[32782]: pgmap v12616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:05 smithi196 ceph-mon[32572]: pgmap v12616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:05 smithi110 ceph-mon[28069]: pgmap v12616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:07 smithi193 ceph-mon[32782]: pgmap v12617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:07 smithi193 ceph-mon[32782]: 20 slow requests, 1 included below; oldest blocked for > 23102.273796 secs 2024-04-26T18:13:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:07 smithi193 ceph-mon[32782]: slow request 23042.296259 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:13:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:07 smithi196 ceph-mon[32572]: pgmap v12617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:07 smithi196 ceph-mon[32572]: 20 slow requests, 1 included below; oldest blocked for > 23102.273796 secs 2024-04-26T18:13:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:07 smithi196 ceph-mon[32572]: slow request 23042.296259 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:13:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:07 smithi110 ceph-mon[28069]: pgmap v12617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:07 smithi110 ceph-mon[28069]: 20 slow requests, 1 included below; oldest blocked for > 23102.273796 secs 2024-04-26T18:13:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:07 smithi110 ceph-mon[28069]: slow request 23042.296259 seconds old, received at 2024-04-26T11:49:04.275860+0000: client_request(client.25049:4784 open #0x10000000006/postmaster.pid 2024-04-26T11:49:04.273954+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:13:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:09 smithi193 ceph-mon[32782]: pgmap v12618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:09 smithi196 ceph-mon[32572]: pgmap v12618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:09 smithi110 ceph-mon[28069]: pgmap v12618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:11 smithi193 ceph-mon[32782]: pgmap v12619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:11 smithi196 ceph-mon[32572]: pgmap v12619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:11 smithi110 ceph-mon[28069]: pgmap v12619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:12 smithi193 ceph-mon[32782]: 20 slow requests, 1 included below; oldest blocked for > 23107.273903 secs 2024-04-26T18:13:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:12 smithi193 ceph-mon[32782]: slow request 1440.826892 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:13:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:12 smithi196 ceph-mon[32572]: 20 slow requests, 1 included below; oldest blocked for > 23107.273903 secs 2024-04-26T18:13:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:12 smithi196 ceph-mon[32572]: slow request 1440.826892 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:13:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:12 smithi110 ceph-mon[28069]: 20 slow requests, 1 included below; oldest blocked for > 23107.273903 secs 2024-04-26T18:13:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:12 smithi110 ceph-mon[28069]: slow request 1440.826892 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:13:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:13 smithi193 ceph-mon[32782]: pgmap v12620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:13 smithi196 ceph-mon[32572]: pgmap v12620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:13 smithi110 ceph-mon[28069]: pgmap v12620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:15 smithi193 ceph-mon[32782]: pgmap v12621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:15 smithi196 ceph-mon[32572]: pgmap v12621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:15 smithi110 ceph-mon[28069]: pgmap v12621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:17 smithi193 ceph-mon[32782]: pgmap v12622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:13:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23112.273973 secs 2024-04-26T18:13:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:17 smithi196 ceph-mon[32572]: pgmap v12622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:13:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23112.273973 secs 2024-04-26T18:13:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:17 smithi110 ceph-mon[28069]: pgmap v12622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:13:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23112.273973 secs 2024-04-26T18:13:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:13:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:13:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:13:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:13:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:13:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:13:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:13:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:13:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:13:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:19 smithi193 ceph-mon[32782]: pgmap v12623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:13:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:19 smithi193 ceph-mon[32782]: pgmap v12624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:19 smithi196 ceph-mon[32572]: pgmap v12623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:13:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:19 smithi196 ceph-mon[32572]: pgmap v12624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:19 smithi110 ceph-mon[28069]: pgmap v12623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:13:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:19 smithi110 ceph-mon[28069]: pgmap v12624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:21 smithi196 ceph-mon[32572]: pgmap v12625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:21 smithi110 ceph-mon[28069]: pgmap v12625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:21 smithi193 ceph-mon[32782]: pgmap v12625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:22.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23117.274067 secs 2024-04-26T18:13:22.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23117.274067 secs 2024-04-26T18:13:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23117.274067 secs 2024-04-26T18:13:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:23 smithi196 ceph-mon[32572]: pgmap v12626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:23 smithi110 ceph-mon[28069]: pgmap v12626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:23 smithi193 ceph-mon[32782]: pgmap v12626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:24 smithi196 ceph-mon[32572]: pgmap v12627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:24 smithi110 ceph-mon[28069]: pgmap v12627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:24 smithi193 ceph-mon[32782]: pgmap v12627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:26 smithi110 ceph-mon[28069]: pgmap v12628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:26 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23122.274219 secs 2024-04-26T18:13:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:26 smithi193 ceph-mon[32782]: pgmap v12628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:26 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23122.274219 secs 2024-04-26T18:13:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:26 smithi196 ceph-mon[32572]: pgmap v12628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:13:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:26 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23122.274219 secs 2024-04-26T18:13:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:28 smithi110 ceph-mon[28069]: pgmap v12629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:13:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:28 smithi193 ceph-mon[32782]: pgmap v12629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:13:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:28 smithi196 ceph-mon[32572]: pgmap v12629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:13:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:30 smithi110 ceph-mon[28069]: pgmap v12630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:30 smithi193 ceph-mon[32782]: pgmap v12630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:30 smithi196 ceph-mon[32572]: pgmap v12630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:31 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23127.274356 secs 2024-04-26T18:13:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:31 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23127.274356 secs 2024-04-26T18:13:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:31 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23127.274356 secs 2024-04-26T18:13:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:32 smithi110 ceph-mon[28069]: pgmap v12631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:32 smithi193 ceph-mon[32782]: pgmap v12631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:32 smithi196 ceph-mon[32572]: pgmap v12631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:34 smithi193 ceph-mon[32782]: pgmap v12632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:34 smithi196 ceph-mon[32572]: pgmap v12632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:34 smithi110 ceph-mon[28069]: pgmap v12632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:36 smithi193 ceph-mon[32782]: pgmap v12633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:36 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23132.274475 secs 2024-04-26T18:13:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:36 smithi196 ceph-mon[32572]: pgmap v12633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:36 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23132.274475 secs 2024-04-26T18:13:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:36 smithi110 ceph-mon[28069]: pgmap v12633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:36 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23132.274475 secs 2024-04-26T18:13:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:38 smithi193 ceph-mon[32782]: pgmap v12634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:38 smithi196 ceph-mon[32572]: pgmap v12634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:38 smithi110 ceph-mon[28069]: pgmap v12634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:40 smithi193 ceph-mon[32782]: pgmap v12635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:40 smithi196 ceph-mon[32572]: pgmap v12635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:40 smithi110 ceph-mon[28069]: pgmap v12635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:41 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23137.274635 secs 2024-04-26T18:13:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:41 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23137.274635 secs 2024-04-26T18:13:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:41 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23137.274635 secs 2024-04-26T18:13:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:42 smithi193 ceph-mon[32782]: pgmap v12636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:42 smithi196 ceph-mon[32572]: pgmap v12636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:42 smithi110 ceph-mon[28069]: pgmap v12636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:44 smithi193 ceph-mon[32782]: pgmap v12637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:44 smithi196 ceph-mon[32572]: pgmap v12637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:44 smithi110 ceph-mon[28069]: pgmap v12637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:46 smithi193 ceph-mon[32782]: pgmap v12638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:46 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23142.274755 secs 2024-04-26T18:13:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:46 smithi196 ceph-mon[32572]: pgmap v12638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:46 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23142.274755 secs 2024-04-26T18:13:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:46 smithi110 ceph-mon[28069]: pgmap v12638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:46 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23142.274755 secs 2024-04-26T18:13:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:48 smithi193 ceph-mon[32782]: pgmap v12639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:48 smithi196 ceph-mon[32572]: pgmap v12639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:48 smithi110 ceph-mon[28069]: pgmap v12639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:50 smithi193 ceph-mon[32782]: pgmap v12640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:50 smithi196 ceph-mon[32572]: pgmap v12640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:50 smithi110 ceph-mon[28069]: pgmap v12640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23147.274888 secs 2024-04-26T18:13:52.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23147.274888 secs 2024-04-26T18:13:52.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23147.274888 secs 2024-04-26T18:13:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:52 smithi193 ceph-mon[32782]: pgmap v12641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:52 smithi196 ceph-mon[32572]: pgmap v12641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:52 smithi110 ceph-mon[28069]: pgmap v12641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:54 smithi193 ceph-mon[32782]: pgmap v12642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:54 smithi196 ceph-mon[32572]: pgmap v12642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:54 smithi110 ceph-mon[28069]: pgmap v12642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:56 smithi193 ceph-mon[32782]: pgmap v12643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23152.275046 secs 2024-04-26T18:13:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:56 smithi196 ceph-mon[32572]: pgmap v12643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23152.275046 secs 2024-04-26T18:13:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:56 smithi110 ceph-mon[28069]: pgmap v12643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:13:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23152.275046 secs 2024-04-26T18:13:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:13:58 smithi193 ceph-mon[32782]: pgmap v12644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:13:58 smithi196 ceph-mon[32572]: pgmap v12644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:13:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:13:58 smithi110 ceph-mon[28069]: pgmap v12644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:00 smithi196 ceph-mon[32572]: pgmap v12645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:00 smithi110 ceph-mon[28069]: pgmap v12645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:00 smithi193 ceph-mon[32782]: pgmap v12645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:01 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23157.275179 secs 2024-04-26T18:14:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:01 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23157.275179 secs 2024-04-26T18:14:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:01 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23157.275179 secs 2024-04-26T18:14:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:02 smithi196 ceph-mon[32572]: pgmap v12646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:02 smithi110 ceph-mon[28069]: pgmap v12646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:02 smithi193 ceph-mon[32782]: pgmap v12646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:04 smithi196 ceph-mon[32572]: pgmap v12647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:04 smithi110 ceph-mon[28069]: pgmap v12647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:05.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:04 smithi193 ceph-mon[32782]: pgmap v12647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:06 smithi196 ceph-mon[32572]: pgmap v12648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:06 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23162.275306 secs 2024-04-26T18:14:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:06 smithi110 ceph-mon[28069]: pgmap v12648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:06 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23162.275306 secs 2024-04-26T18:14:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:06 smithi193 ceph-mon[32782]: pgmap v12648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:06 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23162.275306 secs 2024-04-26T18:14:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:08 smithi193 ceph-mon[32782]: pgmap v12649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:08 smithi196 ceph-mon[32572]: pgmap v12649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:08 smithi110 ceph-mon[28069]: pgmap v12649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:11.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:10 smithi110 ceph-mon[28069]: pgmap v12650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:10 smithi193 ceph-mon[32782]: pgmap v12650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:10 smithi196 ceph-mon[32572]: pgmap v12650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:11.788 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:14:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:14:11.516+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:14:11.789 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:14:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:14:11.516+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:14:11.789 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:14:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:14:11.516+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:14:11.789 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:14:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:14:11.516+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:14:11.789 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:14:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:14:11.516+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:14:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:11 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23167.275416 secs 2024-04-26T18:14:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:11 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23167.275416 secs 2024-04-26T18:14:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:11 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23167.275416 secs 2024-04-26T18:14:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:12 smithi193 ceph-mon[32782]: pgmap v12651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:12 smithi196 ceph-mon[32572]: pgmap v12651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:13.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:12 smithi110 ceph-mon[28069]: pgmap v12651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:14 smithi193 ceph-mon[32782]: pgmap v12652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T18:14:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:14 smithi196 ceph-mon[32572]: pgmap v12652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T18:14:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:14 smithi110 ceph-mon[28069]: pgmap v12652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T18:14:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:16 smithi193 ceph-mon[32782]: pgmap v12653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T18:14:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:16 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23172.275581 secs 2024-04-26T18:14:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:16 smithi196 ceph-mon[32572]: pgmap v12653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T18:14:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:16 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23172.275581 secs 2024-04-26T18:14:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:16 smithi110 ceph-mon[28069]: pgmap v12653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T18:14:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:16 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23172.275581 secs 2024-04-26T18:14:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:18 smithi193 ceph-mon[32782]: pgmap v12654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T18:14:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:14:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:18 smithi196 ceph-mon[32572]: pgmap v12654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T18:14:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:14:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:18 smithi110 ceph-mon[28069]: pgmap v12654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T18:14:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:14:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:14:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:14:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:14:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:14:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:14:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:14:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:20 smithi196 ceph-mon[32572]: pgmap v12655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T18:14:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:14:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:14:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:20 smithi196 ceph-mon[32572]: pgmap v12656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:14:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:20 smithi196 ceph-mon[32572]: pgmap v12657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T18:14:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:14:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:20 smithi110 ceph-mon[28069]: pgmap v12655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T18:14:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:14:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:14:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:20 smithi110 ceph-mon[28069]: pgmap v12656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:14:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:20 smithi110 ceph-mon[28069]: pgmap v12657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T18:14:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:14:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:20 smithi193 ceph-mon[32782]: pgmap v12655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T18:14:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:14:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:14:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:20 smithi193 ceph-mon[32782]: pgmap v12656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:14:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:20 smithi193 ceph-mon[32782]: pgmap v12657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T18:14:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:14:22.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:21 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23177.275726 secs 2024-04-26T18:14:22.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:21 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23177.275726 secs 2024-04-26T18:14:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:21 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23177.275726 secs 2024-04-26T18:14:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:22 smithi196 ceph-mon[32572]: pgmap v12658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:14:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:22 smithi110 ceph-mon[28069]: pgmap v12658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:14:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:22 smithi193 ceph-mon[32782]: pgmap v12658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:14:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:25 smithi196 ceph-mon[32572]: pgmap v12659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:25 smithi110 ceph-mon[28069]: pgmap v12659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:25 smithi193 ceph-mon[32782]: pgmap v12659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:27 smithi196 ceph-mon[32572]: pgmap v12660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:14:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23182.275839 secs 2024-04-26T18:14:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:27 smithi110 ceph-mon[28069]: pgmap v12660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:14:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23182.275839 secs 2024-04-26T18:14:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:27 smithi193 ceph-mon[32782]: pgmap v12660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:14:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23182.275839 secs 2024-04-26T18:14:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:29 smithi196 ceph-mon[32572]: pgmap v12661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:29 smithi110 ceph-mon[28069]: pgmap v12661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:29 smithi193 ceph-mon[32782]: pgmap v12661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:31 smithi196 ceph-mon[32572]: pgmap v12662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:14:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:31 smithi110 ceph-mon[28069]: pgmap v12662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:14:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:31 smithi193 ceph-mon[32782]: pgmap v12662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:14:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23187.275956 secs 2024-04-26T18:14:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23187.275956 secs 2024-04-26T18:14:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23187.275956 secs 2024-04-26T18:14:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:33 smithi196 ceph-mon[32572]: pgmap v12663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:33 smithi110 ceph-mon[28069]: pgmap v12663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:33 smithi193 ceph-mon[32782]: pgmap v12663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:35 smithi196 ceph-mon[32572]: pgmap v12664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:35 smithi110 ceph-mon[28069]: pgmap v12664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:35 smithi193 ceph-mon[32782]: pgmap v12664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:37 smithi196 ceph-mon[32572]: pgmap v12665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23192.276072 secs 2024-04-26T18:14:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:37 smithi110 ceph-mon[28069]: pgmap v12665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23192.276072 secs 2024-04-26T18:14:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:37 smithi193 ceph-mon[32782]: pgmap v12665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23192.276072 secs 2024-04-26T18:14:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:39 smithi196 ceph-mon[32572]: pgmap v12666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:39 smithi110 ceph-mon[28069]: pgmap v12666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:39 smithi193 ceph-mon[32782]: pgmap v12666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:41 smithi196 ceph-mon[32572]: pgmap v12667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:41 smithi110 ceph-mon[28069]: pgmap v12667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:41 smithi193 ceph-mon[32782]: pgmap v12667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23197.276199 secs 2024-04-26T18:14:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23197.276199 secs 2024-04-26T18:14:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23197.276199 secs 2024-04-26T18:14:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:43 smithi196 ceph-mon[32572]: pgmap v12668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:43 smithi110 ceph-mon[28069]: pgmap v12668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:43 smithi193 ceph-mon[32782]: pgmap v12668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:45 smithi110 ceph-mon[28069]: pgmap v12669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:45 smithi193 ceph-mon[32782]: pgmap v12669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:45 smithi196 ceph-mon[32572]: pgmap v12669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:47 smithi110 ceph-mon[28069]: pgmap v12670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23202.276323 secs 2024-04-26T18:14:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:47 smithi193 ceph-mon[32782]: pgmap v12670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23202.276323 secs 2024-04-26T18:14:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:47 smithi196 ceph-mon[32572]: pgmap v12670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23202.276323 secs 2024-04-26T18:14:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:48 smithi193 ceph-mon[32782]: pgmap v12671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:48 smithi196 ceph-mon[32572]: pgmap v12671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:48 smithi110 ceph-mon[28069]: pgmap v12671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:51 smithi196 ceph-mon[32572]: pgmap v12672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:51 smithi110 ceph-mon[28069]: pgmap v12672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:51 smithi193 ceph-mon[32782]: pgmap v12672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23207.276395 secs 2024-04-26T18:14:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23207.276395 secs 2024-04-26T18:14:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23207.276395 secs 2024-04-26T18:14:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:53 smithi196 ceph-mon[32572]: pgmap v12673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:53 smithi110 ceph-mon[28069]: pgmap v12673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:53 smithi193 ceph-mon[32782]: pgmap v12673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:55 smithi196 ceph-mon[32572]: pgmap v12674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:55 smithi110 ceph-mon[28069]: pgmap v12674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:55 smithi193 ceph-mon[32782]: pgmap v12674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:57 smithi196 ceph-mon[32572]: pgmap v12675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23212.276515 secs 2024-04-26T18:14:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:57 smithi110 ceph-mon[28069]: pgmap v12675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23212.276515 secs 2024-04-26T18:14:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:57 smithi193 ceph-mon[32782]: pgmap v12675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:14:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23212.276515 secs 2024-04-26T18:14:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:14:59 smithi196 ceph-mon[32572]: pgmap v12676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:14:59 smithi110 ceph-mon[28069]: pgmap v12676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:14:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:14:59 smithi193 ceph-mon[32782]: pgmap v12676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:01 smithi196 ceph-mon[32572]: pgmap v12677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:01 smithi110 ceph-mon[28069]: pgmap v12677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:01 smithi193 ceph-mon[32782]: pgmap v12677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23217.276637 secs 2024-04-26T18:15:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23217.276637 secs 2024-04-26T18:15:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23217.276637 secs 2024-04-26T18:15:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:03 smithi196 ceph-mon[32572]: pgmap v12678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:03 smithi110 ceph-mon[28069]: pgmap v12678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:03 smithi193 ceph-mon[32782]: pgmap v12678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:05 smithi196 ceph-mon[32572]: pgmap v12679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:15:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:05 smithi110 ceph-mon[28069]: pgmap v12679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:15:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:05 smithi193 ceph-mon[32782]: pgmap v12679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:15:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:07 smithi110 ceph-mon[28069]: pgmap v12680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:15:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23222.276757 secs 2024-04-26T18:15:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:07 smithi193 ceph-mon[32782]: pgmap v12680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:15:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23222.276757 secs 2024-04-26T18:15:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:07 smithi196 ceph-mon[32572]: pgmap v12680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:15:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23222.276757 secs 2024-04-26T18:15:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:09 smithi110 ceph-mon[28069]: pgmap v12681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:15:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:09 smithi193 ceph-mon[32782]: pgmap v12681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:15:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:09 smithi196 ceph-mon[32572]: pgmap v12681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:15:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:11 smithi110 ceph-mon[28069]: pgmap v12682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:15:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:11 smithi193 ceph-mon[32782]: pgmap v12682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:15:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:11 smithi196 ceph-mon[32572]: pgmap v12682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:15:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:12 smithi110 ceph-mon[28069]: 20 slow requests, 1 included below; oldest blocked for > 23227.276876 secs 2024-04-26T18:15:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:12 smithi110 ceph-mon[28069]: slow request 23043.492014 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:15:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:12 smithi193 ceph-mon[32782]: 20 slow requests, 1 included below; oldest blocked for > 23227.276876 secs 2024-04-26T18:15:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:12 smithi193 ceph-mon[32782]: slow request 23043.492014 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:15:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:12 smithi196 ceph-mon[32572]: 20 slow requests, 1 included below; oldest blocked for > 23227.276876 secs 2024-04-26T18:15:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:12 smithi196 ceph-mon[32572]: slow request 23043.492014 seconds old, received at 2024-04-26T11:51:08.083184+0000: client_request(client.26582:1 getattr pAsLsXsFs #0x1 2024-04-26T11:49:00.315521+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:15:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:13 smithi110 ceph-mon[28069]: pgmap v12683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:15:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:13 smithi193 ceph-mon[32782]: pgmap v12683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:15:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:13 smithi196 ceph-mon[32572]: pgmap v12683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:15:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:15 smithi110 ceph-mon[28069]: pgmap v12684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:15:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:15 smithi193 ceph-mon[32782]: pgmap v12684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:15:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:15 smithi196 ceph-mon[32572]: pgmap v12684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:15:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:17 smithi110 ceph-mon[28069]: pgmap v12685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23232.276997 secs 2024-04-26T18:15:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:17 smithi193 ceph-mon[32782]: pgmap v12685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23232.276997 secs 2024-04-26T18:15:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:17 smithi196 ceph-mon[32572]: pgmap v12685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23232.276997 secs 2024-04-26T18:15:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:19 smithi193 ceph-mon[32782]: pgmap v12686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:19 smithi196 ceph-mon[32572]: pgmap v12686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:19 smithi110 ceph-mon[28069]: pgmap v12686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:15:20.210+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:15:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:15:20.210+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006380 con 0x7f261c104b50 2024-04-26T18:15:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:15:20.211+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 180 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006380 con 0x55db1be4fdd0 2024-04-26T18:15:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:15:20.211+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 180 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:15:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:21 smithi193 ceph-mon[32782]: pgmap v12687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:15:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:21 smithi196 ceph-mon[32572]: pgmap v12687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:15:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:21 smithi110 ceph-mon[28069]: pgmap v12687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:15:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23237.277095 secs 2024-04-26T18:15:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:15:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:15:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:22.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23237.277095 secs 2024-04-26T18:15:22.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:15:22.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:15:22.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:22.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23237.277095 secs 2024-04-26T18:15:22.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:15:22.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:15:22.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:15:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:23 smithi193 ceph-mon[32782]: pgmap v12688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:23 smithi196 ceph-mon[32572]: pgmap v12688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:23 smithi110 ceph-mon[28069]: pgmap v12688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:25 smithi193 ceph-mon[32782]: pgmap v12689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:15:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:25 smithi196 ceph-mon[32572]: pgmap v12689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:15:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:25 smithi110 ceph-mon[28069]: pgmap v12689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:15:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:27 smithi193 ceph-mon[32782]: pgmap v12690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23242.277217 secs 2024-04-26T18:15:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:27 smithi196 ceph-mon[32572]: pgmap v12690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23242.277217 secs 2024-04-26T18:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:27 smithi110 ceph-mon[28069]: pgmap v12690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23242.277217 secs 2024-04-26T18:15:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:29 smithi193 ceph-mon[32782]: pgmap v12691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:15:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:29 smithi196 ceph-mon[32572]: pgmap v12691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:15:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:29 smithi110 ceph-mon[28069]: pgmap v12691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:15:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:31 smithi193 ceph-mon[32782]: pgmap v12692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:31 smithi196 ceph-mon[32572]: pgmap v12692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:31 smithi110 ceph-mon[28069]: pgmap v12692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23247.277338 secs 2024-04-26T18:15:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23247.277338 secs 2024-04-26T18:15:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23247.277338 secs 2024-04-26T18:15:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:33 smithi193 ceph-mon[32782]: pgmap v12693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:33 smithi196 ceph-mon[32572]: pgmap v12693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:33 smithi110 ceph-mon[28069]: pgmap v12693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T18:15:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:35 smithi193 ceph-mon[32782]: pgmap v12694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:35 smithi196 ceph-mon[32572]: pgmap v12694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:35 smithi110 ceph-mon[28069]: pgmap v12694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:37 smithi193 ceph-mon[32782]: pgmap v12695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23252.277449 secs 2024-04-26T18:15:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:37 smithi196 ceph-mon[32572]: pgmap v12695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23252.277449 secs 2024-04-26T18:15:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:37 smithi110 ceph-mon[28069]: pgmap v12695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23252.277449 secs 2024-04-26T18:15:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:39 smithi193 ceph-mon[32782]: pgmap v12696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:39 smithi196 ceph-mon[32572]: pgmap v12696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:39 smithi110 ceph-mon[28069]: pgmap v12696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:41 smithi193 ceph-mon[32782]: pgmap v12697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:41 smithi196 ceph-mon[32572]: pgmap v12697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:41 smithi110 ceph-mon[28069]: pgmap v12697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23257.277583 secs 2024-04-26T18:15:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23257.277583 secs 2024-04-26T18:15:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23257.277583 secs 2024-04-26T18:15:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:43 smithi196 ceph-mon[32572]: pgmap v12698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:43 smithi110 ceph-mon[28069]: pgmap v12698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:43 smithi193 ceph-mon[32782]: pgmap v12698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:45 smithi196 ceph-mon[32572]: pgmap v12699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:45 smithi110 ceph-mon[28069]: pgmap v12699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:45 smithi193 ceph-mon[32782]: pgmap v12699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:47 smithi196 ceph-mon[32572]: pgmap v12700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23262.277638 secs 2024-04-26T18:15:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:47 smithi110 ceph-mon[28069]: pgmap v12700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23262.277638 secs 2024-04-26T18:15:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:47 smithi193 ceph-mon[32782]: pgmap v12700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23262.277638 secs 2024-04-26T18:15:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:49 smithi196 ceph-mon[32572]: pgmap v12701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:49 smithi110 ceph-mon[28069]: pgmap v12701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:49 smithi193 ceph-mon[32782]: pgmap v12701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:51 smithi196 ceph-mon[32572]: pgmap v12702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:51 smithi110 ceph-mon[28069]: pgmap v12702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:51 smithi193 ceph-mon[32782]: pgmap v12702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:52.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23267.277758 secs 2024-04-26T18:15:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23267.277758 secs 2024-04-26T18:15:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23267.277758 secs 2024-04-26T18:15:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:53 smithi196 ceph-mon[32572]: pgmap v12703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:53 smithi110 ceph-mon[28069]: pgmap v12703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:53 smithi193 ceph-mon[32782]: pgmap v12703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:54 smithi196 ceph-mon[32572]: pgmap v12704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:54 smithi110 ceph-mon[28069]: pgmap v12704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:54 smithi193 ceph-mon[32782]: pgmap v12704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:56 smithi193 ceph-mon[32782]: pgmap v12705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23272.277876 secs 2024-04-26T18:15:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:56 smithi196 ceph-mon[32572]: pgmap v12705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23272.277876 secs 2024-04-26T18:15:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:56 smithi110 ceph-mon[28069]: pgmap v12705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:15:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23272.277876 secs 2024-04-26T18:15:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:15:58 smithi193 ceph-mon[32782]: pgmap v12706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:15:58 smithi196 ceph-mon[32572]: pgmap v12706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:15:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:15:58 smithi110 ceph-mon[28069]: pgmap v12706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:00 smithi196 ceph-mon[32572]: pgmap v12707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:16:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:00 smithi110 ceph-mon[28069]: pgmap v12707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:16:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:00 smithi193 ceph-mon[32782]: pgmap v12707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:16:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:01 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23277.277998 secs 2024-04-26T18:16:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:01 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23277.277998 secs 2024-04-26T18:16:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:01 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23277.277998 secs 2024-04-26T18:16:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:02 smithi196 ceph-mon[32572]: pgmap v12708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:16:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:02 smithi110 ceph-mon[28069]: pgmap v12708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:16:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:02 smithi193 ceph-mon[32782]: pgmap v12708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:16:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:16:05.219+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:16:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:16:05.219+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006380 con 0x7f261c104b50 2024-04-26T18:16:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:16:05.219+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 181 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006380 con 0x55db1be4fdd0 2024-04-26T18:16:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:16:05.219+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 181 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:16:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:04 smithi196 ceph-mon[32572]: pgmap v12709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:04 smithi110 ceph-mon[28069]: pgmap v12709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:04 smithi193 ceph-mon[32782]: pgmap v12709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:06 smithi196 ceph-mon[32572]: pgmap v12710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:16:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:06 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23282.278118 secs 2024-04-26T18:16:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:06 smithi110 ceph-mon[28069]: pgmap v12710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:16:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:06 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23282.278118 secs 2024-04-26T18:16:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:06 smithi193 ceph-mon[32782]: pgmap v12710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:16:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:06 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23282.278118 secs 2024-04-26T18:16:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:08 smithi193 ceph-mon[32782]: pgmap v12711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:08 smithi196 ceph-mon[32572]: pgmap v12711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:08 smithi110 ceph-mon[28069]: pgmap v12711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:10 smithi196 ceph-mon[32572]: pgmap v12712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:10 smithi110 ceph-mon[28069]: pgmap v12712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:10 smithi193 ceph-mon[32782]: pgmap v12712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:11 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23287.278235 secs 2024-04-26T18:16:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:11 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23287.278235 secs 2024-04-26T18:16:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:11 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23287.278235 secs 2024-04-26T18:16:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:12 smithi196 ceph-mon[32572]: pgmap v12713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:12 smithi110 ceph-mon[28069]: pgmap v12713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:12 smithi193 ceph-mon[32782]: pgmap v12713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:14 smithi196 ceph-mon[32572]: pgmap v12714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:14 smithi110 ceph-mon[28069]: pgmap v12714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:14 smithi193 ceph-mon[32782]: pgmap v12714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:16 smithi196 ceph-mon[32572]: pgmap v12715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:16 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23292.278346 secs 2024-04-26T18:16:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:16 smithi110 ceph-mon[28069]: pgmap v12715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:16 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23292.278346 secs 2024-04-26T18:16:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:16 smithi193 ceph-mon[32782]: pgmap v12715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:16 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23292.278346 secs 2024-04-26T18:16:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:18 smithi196 ceph-mon[32572]: pgmap v12716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:18 smithi110 ceph-mon[28069]: pgmap v12716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:18 smithi193 ceph-mon[32782]: pgmap v12716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:20 smithi196 ceph-mon[32572]: pgmap v12717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:20 smithi110 ceph-mon[28069]: pgmap v12717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:20 smithi193 ceph-mon[32782]: pgmap v12717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:22.191 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:21 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23297.278483 secs 2024-04-26T18:16:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:21 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23297.278483 secs 2024-04-26T18:16:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:21 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23297.278483 secs 2024-04-26T18:16:23.217 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:22 smithi193 ceph-mon[32782]: pgmap v12718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:23.217 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:16:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:22 smithi196 ceph-mon[32572]: pgmap v12718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:16:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:22 smithi110 ceph-mon[28069]: pgmap v12718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: pgmap v12719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: pgmap v12719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: pgmap v12719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:25.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:26 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:16:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:26 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:16:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:26 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:16:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:26 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:16:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:26 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:16:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:26 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:16:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:26 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:16:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:26 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:16:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:26 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:16:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:26 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:16:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:26 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:16:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:26 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:16:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:27 smithi196 ceph-mon[32572]: pgmap v12720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23302.278600 secs 2024-04-26T18:16:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:27 smithi110 ceph-mon[28069]: pgmap v12720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23302.278600 secs 2024-04-26T18:16:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:27 smithi193 ceph-mon[32782]: pgmap v12720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23302.278600 secs 2024-04-26T18:16:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:16:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:16:28.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:16:28.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: pgmap v12721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:16:28.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: pgmap v12722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:16:28.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: pgmap v12721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: pgmap v12722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:16:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: pgmap v12721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: pgmap v12722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:16:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:16:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:30 smithi196 ceph-mon[32572]: pgmap v12723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:30 smithi110 ceph-mon[28069]: pgmap v12723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:30 smithi193 ceph-mon[32782]: pgmap v12723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:32 smithi196 ceph-mon[32572]: pgmap v12724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23307.278693 secs 2024-04-26T18:16:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:32 smithi110 ceph-mon[28069]: pgmap v12724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23307.278693 secs 2024-04-26T18:16:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:32 smithi193 ceph-mon[32782]: pgmap v12724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23307.278693 secs 2024-04-26T18:16:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:33 smithi196 ceph-mon[32572]: pgmap v12725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:33 smithi110 ceph-mon[28069]: pgmap v12725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:33 smithi193 ceph-mon[32782]: pgmap v12725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:36 smithi196 ceph-mon[32572]: pgmap v12726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:36 smithi110 ceph-mon[28069]: pgmap v12726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:36 smithi193 ceph-mon[32782]: pgmap v12726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:16:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23312.278787 secs 2024-04-26T18:16:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23312.278787 secs 2024-04-26T18:16:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23312.278787 secs 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:38 smithi196 ceph-mon[32572]: pgmap v12727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:16:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:38 smithi110 ceph-mon[28069]: pgmap v12727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:16:38.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:38 smithi193 ceph-mon[32782]: pgmap v12727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:16:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:39 smithi196 ceph-mon[32572]: pgmap v12728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:16:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:39 smithi110 ceph-mon[28069]: pgmap v12728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:16:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:39 smithi193 ceph-mon[32782]: pgmap v12728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:16:42.687 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:42 smithi193 ceph-mon[32782]: pgmap v12729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:42.687 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23317.278901 secs 2024-04-26T18:16:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:42 smithi196 ceph-mon[32572]: pgmap v12729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23317.278901 secs 2024-04-26T18:16:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:42 smithi110 ceph-mon[28069]: pgmap v12729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23317.278901 secs 2024-04-26T18:16:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:43 smithi196 ceph-mon[32572]: pgmap v12730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:43 smithi110 ceph-mon[28069]: pgmap v12730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:43 smithi193 ceph-mon[32782]: pgmap v12730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:46 smithi196 ceph-mon[32572]: pgmap v12731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:46 smithi110 ceph-mon[28069]: pgmap v12731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:46 smithi193 ceph-mon[32782]: pgmap v12731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23322.279020 secs 2024-04-26T18:16:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:47 smithi196 ceph-mon[32572]: pgmap v12732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23322.279020 secs 2024-04-26T18:16:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:47 smithi110 ceph-mon[28069]: pgmap v12732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23322.279020 secs 2024-04-26T18:16:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:47 smithi193 ceph-mon[32782]: pgmap v12732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:50 smithi196 ceph-mon[32572]: pgmap v12733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:16:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:50 smithi110 ceph-mon[28069]: pgmap v12733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:16:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:50 smithi193 ceph-mon[32782]: pgmap v12733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:16:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:51 smithi196 ceph-mon[32572]: pgmap v12734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:51 smithi110 ceph-mon[28069]: pgmap v12734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:51 smithi193 ceph-mon[32782]: pgmap v12734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:52.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23327.279147 secs 2024-04-26T18:16:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23327.279147 secs 2024-04-26T18:16:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23327.279147 secs 2024-04-26T18:16:53.728 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:53 smithi110 ceph-mon[28069]: pgmap v12735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:53 smithi196 ceph-mon[32572]: pgmap v12735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:53 smithi193 ceph-mon[32782]: pgmap v12735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:55 smithi196 ceph-mon[32572]: pgmap v12736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:55 smithi110 ceph-mon[28069]: pgmap v12736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:55 smithi193 ceph-mon[32782]: pgmap v12736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:16:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23332.279270 secs 2024-04-26T18:16:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23332.279270 secs 2024-04-26T18:16:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23332.279270 secs 2024-04-26T18:16:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:57 smithi110 ceph-mon[28069]: pgmap v12737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:57 smithi193 ceph-mon[32782]: pgmap v12737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:57 smithi196 ceph-mon[32572]: pgmap v12737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:16:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:16:59 smithi196 ceph-mon[32572]: pgmap v12738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:16:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:16:59 smithi110 ceph-mon[28069]: pgmap v12738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:16:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:16:59 smithi193 ceph-mon[32782]: pgmap v12738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:17:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:01 smithi196 ceph-mon[32572]: pgmap v12739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:01 smithi110 ceph-mon[28069]: pgmap v12739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:01 smithi193 ceph-mon[32782]: pgmap v12739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23337.279409 secs 2024-04-26T18:17:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23337.279409 secs 2024-04-26T18:17:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23337.279409 secs 2024-04-26T18:17:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:03 smithi196 ceph-mon[32572]: pgmap v12740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:03 smithi110 ceph-mon[28069]: pgmap v12740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:03 smithi193 ceph-mon[32782]: pgmap v12740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:05 smithi196 ceph-mon[32572]: pgmap v12741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:05 smithi110 ceph-mon[28069]: pgmap v12741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:05 smithi193 ceph-mon[32782]: pgmap v12741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:06 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23342.279526 secs 2024-04-26T18:17:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:06 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23342.279526 secs 2024-04-26T18:17:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:06 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23342.279526 secs 2024-04-26T18:17:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:07 smithi110 ceph-mon[28069]: pgmap v12742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:07 smithi193 ceph-mon[32782]: pgmap v12742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:07 smithi196 ceph-mon[32572]: pgmap v12742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:09 smithi196 ceph-mon[32572]: pgmap v12743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:17:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:09 smithi110 ceph-mon[28069]: pgmap v12743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:17:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:09 smithi193 ceph-mon[32782]: pgmap v12743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:17:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:11 smithi196 ceph-mon[32572]: pgmap v12744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:11 smithi110 ceph-mon[28069]: pgmap v12744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:11 smithi193 ceph-mon[32782]: pgmap v12744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23347.279638 secs 2024-04-26T18:17:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23347.279638 secs 2024-04-26T18:17:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23347.279638 secs 2024-04-26T18:17:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:13 smithi196 ceph-mon[32572]: pgmap v12745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:13 smithi110 ceph-mon[28069]: pgmap v12745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:13 smithi193 ceph-mon[32782]: pgmap v12745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:15 smithi196 ceph-mon[32572]: pgmap v12746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:15 smithi110 ceph-mon[28069]: pgmap v12746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:15 smithi193 ceph-mon[32782]: pgmap v12746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:16 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23352.279756 secs 2024-04-26T18:17:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:16 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23352.279756 secs 2024-04-26T18:17:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:16 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23352.279756 secs 2024-04-26T18:17:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:17 smithi110 ceph-mon[28069]: pgmap v12747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:17 smithi193 ceph-mon[32782]: pgmap v12747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:17 smithi196 ceph-mon[32572]: pgmap v12747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:19 smithi196 ceph-mon[32572]: pgmap v12748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:17:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:19 smithi110 ceph-mon[28069]: pgmap v12748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:17:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:19 smithi193 ceph-mon[32782]: pgmap v12748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:17:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:21 smithi196 ceph-mon[32572]: pgmap v12749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:21 smithi110 ceph-mon[28069]: pgmap v12749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:21 smithi193 ceph-mon[32782]: pgmap v12749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23357.279822 secs 2024-04-26T18:17:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23357.279822 secs 2024-04-26T18:17:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23357.279822 secs 2024-04-26T18:17:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:23 smithi196 ceph-mon[32572]: pgmap v12750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:23 smithi110 ceph-mon[28069]: pgmap v12750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:23 smithi193 ceph-mon[32782]: pgmap v12750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:25 smithi196 ceph-mon[32572]: pgmap v12751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:25 smithi110 ceph-mon[28069]: pgmap v12751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:25 smithi193 ceph-mon[32782]: pgmap v12751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:26 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23362.279941 secs 2024-04-26T18:17:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:26 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23362.279941 secs 2024-04-26T18:17:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:26 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23362.279941 secs 2024-04-26T18:17:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:27 smithi110 ceph-mon[28069]: pgmap v12752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:17:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:27 smithi193 ceph-mon[32782]: pgmap v12752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:17:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:27 smithi196 ceph-mon[32572]: pgmap v12752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:17:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:17:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:17:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:17:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:17:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:17:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:17:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:17:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:17:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:17:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:30 smithi110 ceph-mon[28069]: pgmap v12753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 2 op/s 2024-04-26T18:17:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:30 smithi110 ceph-mon[28069]: pgmap v12754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:30 smithi193 ceph-mon[32782]: pgmap v12753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 2 op/s 2024-04-26T18:17:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:30 smithi193 ceph-mon[32782]: pgmap v12754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:30 smithi196 ceph-mon[32572]: pgmap v12753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 2 op/s 2024-04-26T18:17:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:30 smithi196 ceph-mon[32572]: pgmap v12754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:32 smithi110 ceph-mon[28069]: pgmap v12755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23367.280059 secs 2024-04-26T18:17:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:32 smithi193 ceph-mon[32782]: pgmap v12755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23367.280059 secs 2024-04-26T18:17:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:32 smithi196 ceph-mon[32572]: pgmap v12755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23367.280059 secs 2024-04-26T18:17:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:34 smithi193 ceph-mon[32782]: pgmap v12756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:34 smithi196 ceph-mon[32572]: pgmap v12756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:34 smithi110 ceph-mon[28069]: pgmap v12756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:36 smithi193 ceph-mon[32782]: pgmap v12757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:36 smithi196 ceph-mon[32572]: pgmap v12757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:36 smithi110 ceph-mon[28069]: pgmap v12757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:17:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23372.280182 secs 2024-04-26T18:17:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23372.280182 secs 2024-04-26T18:17:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23372.280182 secs 2024-04-26T18:17:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:38 smithi193 ceph-mon[32782]: pgmap v12758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:17:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:38 smithi196 ceph-mon[32572]: pgmap v12758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:17:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:38 smithi110 ceph-mon[28069]: pgmap v12758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:17:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:40 smithi193 ceph-mon[32782]: pgmap v12759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:17:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:40 smithi196 ceph-mon[32572]: pgmap v12759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:17:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:40 smithi110 ceph-mon[28069]: pgmap v12759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:17:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:42 smithi193 ceph-mon[32782]: pgmap v12760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23377.280304 secs 2024-04-26T18:17:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:42 smithi196 ceph-mon[32572]: pgmap v12760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23377.280304 secs 2024-04-26T18:17:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:42 smithi110 ceph-mon[28069]: pgmap v12760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23377.280304 secs 2024-04-26T18:17:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:44 smithi193 ceph-mon[32782]: pgmap v12761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:44 smithi196 ceph-mon[32572]: pgmap v12761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:44 smithi110 ceph-mon[28069]: pgmap v12761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:46 smithi193 ceph-mon[32782]: pgmap v12762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:46 smithi196 ceph-mon[32572]: pgmap v12762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:46 smithi110 ceph-mon[28069]: pgmap v12762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23382.280447 secs 2024-04-26T18:17:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23382.280447 secs 2024-04-26T18:17:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23382.280447 secs 2024-04-26T18:17:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:48 smithi193 ceph-mon[32782]: pgmap v12763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:48 smithi196 ceph-mon[32572]: pgmap v12763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:48 smithi110 ceph-mon[28069]: pgmap v12763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:50 smithi193 ceph-mon[32782]: pgmap v12764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:50 smithi196 ceph-mon[32572]: pgmap v12764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:50 smithi110 ceph-mon[28069]: pgmap v12764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:52 smithi193 ceph-mon[32782]: pgmap v12765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23387.280595 secs 2024-04-26T18:17:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:52 smithi196 ceph-mon[32572]: pgmap v12765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23387.280595 secs 2024-04-26T18:17:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:52 smithi110 ceph-mon[28069]: pgmap v12765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23387.280595 secs 2024-04-26T18:17:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:54 smithi193 ceph-mon[32782]: pgmap v12766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:54 smithi196 ceph-mon[32572]: pgmap v12766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:54 smithi110 ceph-mon[28069]: pgmap v12766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:17:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:56 smithi193 ceph-mon[32782]: pgmap v12767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:56 smithi196 ceph-mon[32572]: pgmap v12767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:56 smithi110 ceph-mon[28069]: pgmap v12767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23392.280706 secs 2024-04-26T18:17:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23392.280706 secs 2024-04-26T18:17:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23392.280706 secs 2024-04-26T18:17:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:17:58 smithi196 ceph-mon[32572]: pgmap v12768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:17:58 smithi110 ceph-mon[28069]: pgmap v12768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:17:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:17:58 smithi193 ceph-mon[32782]: pgmap v12768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:00 smithi196 ceph-mon[32572]: pgmap v12769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:00 smithi110 ceph-mon[28069]: pgmap v12769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:00 smithi193 ceph-mon[32782]: pgmap v12769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:02.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:02 smithi193 ceph-mon[32782]: pgmap v12770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:02.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:02 smithi193 ceph-mon[32782]: 20 slow requests, 1 included below; oldest blocked for > 23397.280794 secs 2024-04-26T18:18:02.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:02 smithi193 ceph-mon[32782]: slow request 23041.038742 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:18:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:02 smithi196 ceph-mon[32572]: pgmap v12770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:02 smithi196 ceph-mon[32572]: 20 slow requests, 1 included below; oldest blocked for > 23397.280794 secs 2024-04-26T18:18:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:02 smithi196 ceph-mon[32572]: slow request 23041.038742 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:18:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:02 smithi110 ceph-mon[28069]: pgmap v12770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:02 smithi110 ceph-mon[28069]: 20 slow requests, 1 included below; oldest blocked for > 23397.280794 secs 2024-04-26T18:18:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:02 smithi110 ceph-mon[28069]: slow request 23041.038742 seconds old, received at 2024-04-26T11:54:00.540374+0000: client_request(client.26656:1 getattr pAsLsXsFs #0x1 2024-04-26T11:54:00.536538+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:18:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:04 smithi196 ceph-mon[32572]: pgmap v12771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:04 smithi110 ceph-mon[28069]: pgmap v12771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:04 smithi193 ceph-mon[32782]: pgmap v12771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:06 smithi196 ceph-mon[32572]: pgmap v12772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:06 smithi110 ceph-mon[28069]: pgmap v12772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:06 smithi193 ceph-mon[32782]: pgmap v12772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23402.280862 secs 2024-04-26T18:18:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23402.280862 secs 2024-04-26T18:18:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23402.280862 secs 2024-04-26T18:18:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:08 smithi196 ceph-mon[32572]: pgmap v12773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:08 smithi110 ceph-mon[28069]: pgmap v12773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:08 smithi193 ceph-mon[32782]: pgmap v12773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:10 smithi196 ceph-mon[32572]: pgmap v12774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:10 smithi110 ceph-mon[28069]: pgmap v12774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:10 smithi193 ceph-mon[32782]: pgmap v12774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:12 smithi196 ceph-mon[32572]: pgmap v12775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23407.280987 secs 2024-04-26T18:18:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:12 smithi110 ceph-mon[28069]: pgmap v12775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23407.280987 secs 2024-04-26T18:18:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:12 smithi193 ceph-mon[32782]: pgmap v12775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23407.280987 secs 2024-04-26T18:18:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:14 smithi196 ceph-mon[32572]: pgmap v12776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:14 smithi110 ceph-mon[28069]: pgmap v12776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:14 smithi193 ceph-mon[32782]: pgmap v12776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.441+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T18:18:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.441+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:18:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.441+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:18:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.441+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T18:18:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.441+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.442+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T18:18:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.442+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T18:18:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.444+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T18:18:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.444+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T18:18:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.444+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614059040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:18:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.444+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614059040 comp rx=0 tx=0).stop 2024-04-26T18:18:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.444+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T18:18:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.444+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T18:18:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.444+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.444+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.445+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:16.446+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614037040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:16 smithi196 ceph-mon[32572]: pgmap v12777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:16 smithi110 ceph-mon[28069]: pgmap v12777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:16 smithi193 ceph-mon[32782]: pgmap v12777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23412.281113 secs 2024-04-26T18:18:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23412.281113 secs 2024-04-26T18:18:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23412.281113 secs 2024-04-26T18:18:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:18 smithi196 ceph-mon[32572]: pgmap v12778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:18 smithi110 ceph-mon[28069]: pgmap v12778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:18 smithi193 ceph-mon[32782]: pgmap v12778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:20.241+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T18:18:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:20.242+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:18:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:20.243+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 182 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:18:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:18:20.243+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 182 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T18:18:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:20 smithi196 ceph-mon[32572]: pgmap v12779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:20 smithi110 ceph-mon[28069]: pgmap v12779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:20 smithi193 ceph-mon[32782]: pgmap v12779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:22 smithi196 ceph-mon[32572]: pgmap v12780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23417.281241 secs 2024-04-26T18:18:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:22 smithi110 ceph-mon[28069]: pgmap v12780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23417.281241 secs 2024-04-26T18:18:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:22 smithi193 ceph-mon[32782]: pgmap v12780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23417.281241 secs 2024-04-26T18:18:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:24 smithi196 ceph-mon[32572]: pgmap v12781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:24 smithi110 ceph-mon[28069]: pgmap v12781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:24 smithi193 ceph-mon[32782]: pgmap v12781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:26 smithi196 ceph-mon[32572]: pgmap v12782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:26 smithi110 ceph-mon[28069]: pgmap v12782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:26 smithi193 ceph-mon[32782]: pgmap v12782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23422.281367 secs 2024-04-26T18:18:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23422.281367 secs 2024-04-26T18:18:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23422.281367 secs 2024-04-26T18:18:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:28 smithi196 ceph-mon[32572]: pgmap v12783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:28 smithi110 ceph-mon[28069]: pgmap v12783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:28 smithi193 ceph-mon[32782]: pgmap v12783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:30 smithi196 ceph-mon[32572]: pgmap v12784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:18:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:30 smithi110 ceph-mon[28069]: pgmap v12784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:18:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:30 smithi193 ceph-mon[32782]: pgmap v12784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:18:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:18:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:18:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:18:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:18:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:18:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:18:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:18:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:18:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:18:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:32 smithi196 ceph-mon[32572]: pgmap v12785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T18:18:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:32 smithi196 ceph-mon[32572]: pgmap v12786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23427.281461 secs 2024-04-26T18:18:32.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:32 smithi193 ceph-mon[32782]: pgmap v12785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T18:18:32.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:32 smithi193 ceph-mon[32782]: pgmap v12786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:32.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23427.281461 secs 2024-04-26T18:18:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:32 smithi110 ceph-mon[28069]: pgmap v12785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T18:18:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:32 smithi110 ceph-mon[28069]: pgmap v12786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23427.281461 secs 2024-04-26T18:18:34.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:34 smithi110 ceph-mon[28069]: pgmap v12787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:34 smithi193 ceph-mon[32782]: pgmap v12787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:34 smithi196 ceph-mon[32572]: pgmap v12787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:36 smithi110 ceph-mon[28069]: pgmap v12788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:36 smithi193 ceph-mon[32782]: pgmap v12788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:36 smithi196 ceph-mon[32572]: pgmap v12788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23432.281571 secs 2024-04-26T18:18:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23432.281571 secs 2024-04-26T18:18:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23432.281571 secs 2024-04-26T18:18:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:38 smithi110 ceph-mon[28069]: pgmap v12789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:38 smithi193 ceph-mon[32782]: pgmap v12789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:38 smithi196 ceph-mon[32572]: pgmap v12789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:40 smithi110 ceph-mon[28069]: pgmap v12790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:40 smithi193 ceph-mon[32782]: pgmap v12790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:40 smithi196 ceph-mon[32572]: pgmap v12790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:18:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:42 smithi110 ceph-mon[28069]: pgmap v12791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:18:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23437.281683 secs 2024-04-26T18:18:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:42 smithi193 ceph-mon[32782]: pgmap v12791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:18:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23437.281683 secs 2024-04-26T18:18:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:42 smithi196 ceph-mon[32572]: pgmap v12791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:18:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23437.281683 secs 2024-04-26T18:18:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:44 smithi110 ceph-mon[28069]: pgmap v12792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:44 smithi193 ceph-mon[32782]: pgmap v12792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:44 smithi196 ceph-mon[32572]: pgmap v12792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:46 smithi193 ceph-mon[32782]: pgmap v12793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:46 smithi196 ceph-mon[32572]: pgmap v12793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:46 smithi110 ceph-mon[28069]: pgmap v12793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23442.281809 secs 2024-04-26T18:18:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23442.281809 secs 2024-04-26T18:18:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23442.281809 secs 2024-04-26T18:18:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:48 smithi193 ceph-mon[32782]: pgmap v12794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:48 smithi196 ceph-mon[32572]: pgmap v12794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:48 smithi110 ceph-mon[28069]: pgmap v12794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:50 smithi193 ceph-mon[32782]: pgmap v12795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:50 smithi196 ceph-mon[32572]: pgmap v12795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:50 smithi110 ceph-mon[28069]: pgmap v12795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:52.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:52 smithi110 ceph-mon[28069]: pgmap v12796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:52.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23447.281927 secs 2024-04-26T18:18:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:52 smithi193 ceph-mon[32782]: pgmap v12796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23447.281927 secs 2024-04-26T18:18:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:52 smithi196 ceph-mon[32572]: pgmap v12796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23447.281927 secs 2024-04-26T18:18:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:54 smithi193 ceph-mon[32782]: pgmap v12797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:54 smithi196 ceph-mon[32572]: pgmap v12797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:54 smithi110 ceph-mon[28069]: pgmap v12797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:18:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:56 smithi193 ceph-mon[32782]: pgmap v12798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:56 smithi196 ceph-mon[32572]: pgmap v12798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:56 smithi110 ceph-mon[28069]: pgmap v12798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23452.282030 secs 2024-04-26T18:18:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23452.282030 secs 2024-04-26T18:18:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23452.282030 secs 2024-04-26T18:18:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:18:58 smithi193 ceph-mon[32782]: pgmap v12799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:18:58 smithi196 ceph-mon[32572]: pgmap v12799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:18:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:18:58 smithi110 ceph-mon[28069]: pgmap v12799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:00 smithi193 ceph-mon[32782]: pgmap v12800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:00 smithi196 ceph-mon[32572]: pgmap v12800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:00 smithi110 ceph-mon[28069]: pgmap v12800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:02 smithi193 ceph-mon[32782]: pgmap v12801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23457.282131 secs 2024-04-26T18:19:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:02 smithi196 ceph-mon[32572]: pgmap v12801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23457.282131 secs 2024-04-26T18:19:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:02 smithi110 ceph-mon[28069]: pgmap v12801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23457.282131 secs 2024-04-26T18:19:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:04 smithi193 ceph-mon[32782]: pgmap v12802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:04 smithi196 ceph-mon[32572]: pgmap v12802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:04 smithi110 ceph-mon[28069]: pgmap v12802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:06 smithi193 ceph-mon[32782]: pgmap v12803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:06 smithi196 ceph-mon[32572]: pgmap v12803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:06 smithi110 ceph-mon[28069]: pgmap v12803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23462.282251 secs 2024-04-26T18:19:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23462.282251 secs 2024-04-26T18:19:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23462.282251 secs 2024-04-26T18:19:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:08 smithi196 ceph-mon[32572]: pgmap v12804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:08 smithi110 ceph-mon[28069]: pgmap v12804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:08 smithi193 ceph-mon[32782]: pgmap v12804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:10 smithi196 ceph-mon[32572]: pgmap v12805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:10 smithi110 ceph-mon[28069]: pgmap v12805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:10 smithi193 ceph-mon[32782]: pgmap v12805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:12.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:19:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:19:11.584+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:12.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:19:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:19:11.584+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:12.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:19:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:19:11.584+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:12.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:19:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:19:11.584+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:12.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:19:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:19:11.584+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:12 smithi196 ceph-mon[32572]: pgmap v12806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23467.282372 secs 2024-04-26T18:19:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:12 smithi110 ceph-mon[28069]: pgmap v12806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23467.282372 secs 2024-04-26T18:19:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:12 smithi193 ceph-mon[32782]: pgmap v12806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23467.282372 secs 2024-04-26T18:19:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:14 smithi196 ceph-mon[32572]: pgmap v12807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:19:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:14 smithi110 ceph-mon[28069]: pgmap v12807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:19:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:14 smithi193 ceph-mon[32782]: pgmap v12807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:19:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:16 smithi196 ceph-mon[32572]: pgmap v12808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:19:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:16 smithi110 ceph-mon[28069]: pgmap v12808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:19:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:16 smithi193 ceph-mon[32782]: pgmap v12808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:19:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23472.282470 secs 2024-04-26T18:19:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23472.282470 secs 2024-04-26T18:19:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23472.282470 secs 2024-04-26T18:19:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:18 smithi196 ceph-mon[32572]: pgmap v12809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:19:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:18 smithi110 ceph-mon[28069]: pgmap v12809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:19:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:18 smithi193 ceph-mon[32782]: pgmap v12809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:19:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:20 smithi196 ceph-mon[32572]: pgmap v12810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:19:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:20 smithi110 ceph-mon[28069]: pgmap v12810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:19:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:20 smithi193 ceph-mon[32782]: pgmap v12810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:19:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:22 smithi196 ceph-mon[32572]: pgmap v12811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:19:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23477.282604 secs 2024-04-26T18:19:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:22 smithi110 ceph-mon[28069]: pgmap v12811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:19:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23477.282604 secs 2024-04-26T18:19:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:22 smithi193 ceph-mon[32782]: pgmap v12811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:19:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23477.282604 secs 2024-04-26T18:19:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:24 smithi196 ceph-mon[32572]: pgmap v12812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:19:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:24 smithi110 ceph-mon[28069]: pgmap v12812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:19:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:24 smithi193 ceph-mon[32782]: pgmap v12812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:19:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:26 smithi196 ceph-mon[32572]: pgmap v12813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:26 smithi110 ceph-mon[28069]: pgmap v12813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:26 smithi193 ceph-mon[32782]: pgmap v12813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23482.282721 secs 2024-04-26T18:19:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23482.282721 secs 2024-04-26T18:19:27.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23482.282721 secs 2024-04-26T18:19:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:28 smithi196 ceph-mon[32572]: pgmap v12814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:28 smithi110 ceph-mon[28069]: pgmap v12814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:28 smithi193 ceph-mon[32782]: pgmap v12814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:30 smithi196 ceph-mon[32572]: pgmap v12815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:30 smithi110 ceph-mon[28069]: pgmap v12815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:30 smithi193 ceph-mon[32782]: pgmap v12815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:19:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:19:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:19:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:32 smithi196 ceph-mon[32572]: pgmap v12816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23487.282786 secs 2024-04-26T18:19:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:19:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:19:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:19:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:32 smithi193 ceph-mon[32782]: pgmap v12816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23487.282786 secs 2024-04-26T18:19:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:19:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:19:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:19:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:32 smithi110 ceph-mon[28069]: pgmap v12816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23487.282786 secs 2024-04-26T18:19:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:19:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:19:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:19:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:33 smithi196 ceph-mon[32572]: pgmap v12817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:19:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:33 smithi196 ceph-mon[32572]: pgmap v12818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:19:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:33 smithi110 ceph-mon[28069]: pgmap v12817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:19:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:33 smithi110 ceph-mon[28069]: pgmap v12818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:19:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:33 smithi193 ceph-mon[32782]: pgmap v12817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:19:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:33 smithi193 ceph-mon[32782]: pgmap v12818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:19:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:34 smithi196 ceph-mon[32572]: pgmap v12819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:34 smithi110 ceph-mon[28069]: pgmap v12819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:34 smithi193 ceph-mon[32782]: pgmap v12819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:37 smithi193 ceph-mon[32782]: pgmap v12820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23492.282907 secs 2024-04-26T18:19:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:37 smithi196 ceph-mon[32572]: pgmap v12820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23492.282907 secs 2024-04-26T18:19:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:37 smithi110 ceph-mon[28069]: pgmap v12820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23492.282907 secs 2024-04-26T18:19:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:39 smithi196 ceph-mon[32572]: pgmap v12821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:39 smithi110 ceph-mon[28069]: pgmap v12821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:39 smithi193 ceph-mon[32782]: pgmap v12821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:41 smithi196 ceph-mon[32572]: pgmap v12822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:41.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:41 smithi110 ceph-mon[28069]: pgmap v12822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:41 smithi193 ceph-mon[32782]: pgmap v12822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:19:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23497.282974 secs 2024-04-26T18:19:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23497.282974 secs 2024-04-26T18:19:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23497.282974 secs 2024-04-26T18:19:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:43 smithi196 ceph-mon[32572]: pgmap v12823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:19:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:43 smithi110 ceph-mon[28069]: pgmap v12823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:19:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:43 smithi193 ceph-mon[32782]: pgmap v12823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:19:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:45 smithi196 ceph-mon[32572]: pgmap v12824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:45 smithi110 ceph-mon[28069]: pgmap v12824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:45 smithi193 ceph-mon[32782]: pgmap v12824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:47 smithi196 ceph-mon[32572]: pgmap v12825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23502.283096 secs 2024-04-26T18:19:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:47 smithi110 ceph-mon[28069]: pgmap v12825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23502.283096 secs 2024-04-26T18:19:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:47 smithi193 ceph-mon[32782]: pgmap v12825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23502.283096 secs 2024-04-26T18:19:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:49 smithi196 ceph-mon[32572]: pgmap v12826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:49 smithi110 ceph-mon[28069]: pgmap v12826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:49 smithi193 ceph-mon[32782]: pgmap v12826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:51 smithi196 ceph-mon[32572]: pgmap v12827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:51 smithi110 ceph-mon[28069]: pgmap v12827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:51 smithi193 ceph-mon[32782]: pgmap v12827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:52.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23507.283214 secs 2024-04-26T18:19:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23507.283214 secs 2024-04-26T18:19:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23507.283214 secs 2024-04-26T18:19:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:53 smithi196 ceph-mon[32572]: pgmap v12828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:53 smithi110 ceph-mon[28069]: pgmap v12828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:53 smithi193 ceph-mon[32782]: pgmap v12828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:55 smithi196 ceph-mon[32572]: pgmap v12829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:55 smithi110 ceph-mon[28069]: pgmap v12829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:55 smithi193 ceph-mon[32782]: pgmap v12829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:57 smithi196 ceph-mon[32572]: pgmap v12830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23512.283293 secs 2024-04-26T18:19:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:57 smithi110 ceph-mon[28069]: pgmap v12830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23512.283293 secs 2024-04-26T18:19:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:57 smithi193 ceph-mon[32782]: pgmap v12830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:19:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23512.283293 secs 2024-04-26T18:19:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:19:59 smithi196 ceph-mon[32572]: pgmap v12831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:19:59 smithi110 ceph-mon[28069]: pgmap v12831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:19:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:19:59 smithi193 ceph-mon[32782]: pgmap v12831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:20:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:20:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:20:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:01 smithi196 ceph-mon[32572]: pgmap v12832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:01 smithi110 ceph-mon[28069]: pgmap v12832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:01 smithi193 ceph-mon[32782]: pgmap v12832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23517.283409 secs 2024-04-26T18:20:02.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23517.283409 secs 2024-04-26T18:20:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23517.283409 secs 2024-04-26T18:20:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:03 smithi196 ceph-mon[32572]: pgmap v12833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:03 smithi110 ceph-mon[28069]: pgmap v12833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:03 smithi193 ceph-mon[32782]: pgmap v12833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:05 smithi196 ceph-mon[32572]: pgmap v12834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:05 smithi110 ceph-mon[28069]: pgmap v12834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:05 smithi193 ceph-mon[32782]: pgmap v12834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:07 smithi196 ceph-mon[32572]: pgmap v12835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23522.283532 secs 2024-04-26T18:20:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:07 smithi110 ceph-mon[28069]: pgmap v12835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23522.283532 secs 2024-04-26T18:20:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:07 smithi193 ceph-mon[32782]: pgmap v12835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23522.283532 secs 2024-04-26T18:20:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:09 smithi196 ceph-mon[32572]: pgmap v12836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:09 smithi110 ceph-mon[28069]: pgmap v12836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:09 smithi193 ceph-mon[32782]: pgmap v12836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:11 smithi196 ceph-mon[32572]: pgmap v12837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:11 smithi110 ceph-mon[28069]: pgmap v12837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:11 smithi193 ceph-mon[32782]: pgmap v12837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23527.283649 secs 2024-04-26T18:20:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23527.283649 secs 2024-04-26T18:20:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23527.283649 secs 2024-04-26T18:20:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:13 smithi196 ceph-mon[32572]: pgmap v12838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:13 smithi110 ceph-mon[28069]: pgmap v12838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:13 smithi193 ceph-mon[32782]: pgmap v12838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:15 smithi196 ceph-mon[32572]: pgmap v12839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:15 smithi110 ceph-mon[28069]: pgmap v12839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:15 smithi193 ceph-mon[32782]: pgmap v12839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:17 smithi110 ceph-mon[28069]: pgmap v12840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23532.283769 secs 2024-04-26T18:20:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:17 smithi193 ceph-mon[32782]: pgmap v12840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23532.283769 secs 2024-04-26T18:20:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:17 smithi196 ceph-mon[32572]: pgmap v12840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23532.283769 secs 2024-04-26T18:20:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:19 smithi110 ceph-mon[28069]: pgmap v12841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:19 smithi193 ceph-mon[32782]: pgmap v12841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:19 smithi196 ceph-mon[32572]: pgmap v12841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:21 smithi110 ceph-mon[28069]: pgmap v12842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:21 smithi193 ceph-mon[32782]: pgmap v12842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:21 smithi196 ceph-mon[32572]: pgmap v12842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23537.283878 secs 2024-04-26T18:20:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23537.283878 secs 2024-04-26T18:20:22.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23537.283878 secs 2024-04-26T18:20:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:23 smithi110 ceph-mon[28069]: pgmap v12843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:23 smithi193 ceph-mon[32782]: pgmap v12843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:23 smithi196 ceph-mon[32572]: pgmap v12843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:25 smithi193 ceph-mon[32782]: pgmap v12844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:25 smithi196 ceph-mon[32572]: pgmap v12844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:25 smithi110 ceph-mon[28069]: pgmap v12844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:27 smithi193 ceph-mon[32782]: pgmap v12845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23542.283956 secs 2024-04-26T18:20:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:27 smithi196 ceph-mon[32572]: pgmap v12845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23542.283956 secs 2024-04-26T18:20:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:27 smithi110 ceph-mon[28069]: pgmap v12845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23542.283956 secs 2024-04-26T18:20:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:29 smithi193 ceph-mon[32782]: pgmap v12846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:29 smithi196 ceph-mon[32572]: pgmap v12846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:29 smithi110 ceph-mon[28069]: pgmap v12846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:31 smithi193 ceph-mon[32782]: pgmap v12847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:31 smithi196 ceph-mon[32572]: pgmap v12847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:31 smithi110 ceph-mon[28069]: pgmap v12847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23547.284073 secs 2024-04-26T18:20:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23547.284073 secs 2024-04-26T18:20:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23547.284073 secs 2024-04-26T18:20:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:33 smithi193 ceph-mon[32782]: pgmap v12848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:20:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:33 smithi196 ceph-mon[32572]: pgmap v12848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:20:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:33 smithi110 ceph-mon[28069]: pgmap v12848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:20:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:20:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:20:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:20:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:20:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:20:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:20:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:20:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:20:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:20:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:35 smithi193 ceph-mon[32782]: pgmap v12849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:20:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:35 smithi193 ceph-mon[32782]: pgmap v12850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:35 smithi196 ceph-mon[32572]: pgmap v12849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:20:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:35 smithi196 ceph-mon[32572]: pgmap v12850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:35 smithi110 ceph-mon[28069]: pgmap v12849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:20:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:35 smithi110 ceph-mon[28069]: pgmap v12850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:37 smithi193 ceph-mon[32782]: pgmap v12851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23552.284204 secs 2024-04-26T18:20:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:37 smithi196 ceph-mon[32572]: pgmap v12851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23552.284204 secs 2024-04-26T18:20:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:37 smithi110 ceph-mon[28069]: pgmap v12851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23552.284204 secs 2024-04-26T18:20:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:39 smithi193 ceph-mon[32782]: pgmap v12852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:39 smithi196 ceph-mon[32572]: pgmap v12852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:39 smithi110 ceph-mon[28069]: pgmap v12852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:41 smithi193 ceph-mon[32782]: pgmap v12853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:41 smithi196 ceph-mon[32572]: pgmap v12853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:41 smithi110 ceph-mon[28069]: pgmap v12853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23557.284343 secs 2024-04-26T18:20:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23557.284343 secs 2024-04-26T18:20:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23557.284343 secs 2024-04-26T18:20:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:43 smithi193 ceph-mon[32782]: pgmap v12854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:43 smithi196 ceph-mon[32572]: pgmap v12854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:43 smithi110 ceph-mon[28069]: pgmap v12854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:20:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:45 smithi193 ceph-mon[32782]: pgmap v12855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:20:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:45 smithi196 ceph-mon[32572]: pgmap v12855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:20:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:45 smithi110 ceph-mon[28069]: pgmap v12855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:20:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:47 smithi196 ceph-mon[32572]: pgmap v12856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23562.284462 secs 2024-04-26T18:20:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:47 smithi110 ceph-mon[28069]: pgmap v12856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23562.284462 secs 2024-04-26T18:20:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:47 smithi193 ceph-mon[32782]: pgmap v12856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23562.284462 secs 2024-04-26T18:20:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:49 smithi196 ceph-mon[32572]: pgmap v12857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:49 smithi110 ceph-mon[28069]: pgmap v12857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:49 smithi193 ceph-mon[32782]: pgmap v12857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:51 smithi196 ceph-mon[32572]: pgmap v12858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:51 smithi110 ceph-mon[28069]: pgmap v12858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:51 smithi193 ceph-mon[32782]: pgmap v12858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:52.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23567.284595 secs 2024-04-26T18:20:52.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23567.284595 secs 2024-04-26T18:20:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23567.284595 secs 2024-04-26T18:20:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:53 smithi196 ceph-mon[32572]: pgmap v12859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:53 smithi110 ceph-mon[28069]: pgmap v12859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:53 smithi193 ceph-mon[32782]: pgmap v12859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:55 smithi196 ceph-mon[32572]: pgmap v12860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:55 smithi110 ceph-mon[28069]: pgmap v12860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:55 smithi193 ceph-mon[32782]: pgmap v12860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:57 smithi196 ceph-mon[32572]: pgmap v12861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23572.284715 secs 2024-04-26T18:20:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:57 smithi110 ceph-mon[28069]: pgmap v12861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23572.284715 secs 2024-04-26T18:20:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:57 smithi193 ceph-mon[32782]: pgmap v12861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:20:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23572.284715 secs 2024-04-26T18:20:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:20:59 smithi196 ceph-mon[32572]: pgmap v12862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:20:59 smithi110 ceph-mon[28069]: pgmap v12862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:20:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:20:59 smithi193 ceph-mon[32782]: pgmap v12862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:01 smithi196 ceph-mon[32572]: pgmap v12863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:01 smithi110 ceph-mon[28069]: pgmap v12863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:01 smithi193 ceph-mon[32782]: pgmap v12863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23577.284851 secs 2024-04-26T18:21:02.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23577.284851 secs 2024-04-26T18:21:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23577.284851 secs 2024-04-26T18:21:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:03 smithi196 ceph-mon[32572]: pgmap v12864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:03 smithi110 ceph-mon[28069]: pgmap v12864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:03 smithi193 ceph-mon[32782]: pgmap v12864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:05 smithi196 ceph-mon[32572]: pgmap v12865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:05 smithi110 ceph-mon[28069]: pgmap v12865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:05 smithi193 ceph-mon[32782]: pgmap v12865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:07 smithi196 ceph-mon[32572]: pgmap v12866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23582.284945 secs 2024-04-26T18:21:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:07 smithi110 ceph-mon[28069]: pgmap v12866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23582.284945 secs 2024-04-26T18:21:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:07 smithi193 ceph-mon[32782]: pgmap v12866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23582.284945 secs 2024-04-26T18:21:09.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:09 smithi196 ceph-mon[32572]: pgmap v12867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:09 smithi110 ceph-mon[28069]: pgmap v12867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:09 smithi193 ceph-mon[32782]: pgmap v12867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:11 smithi196 ceph-mon[32572]: pgmap v12868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:11 smithi110 ceph-mon[28069]: pgmap v12868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:11 smithi193 ceph-mon[32782]: pgmap v12868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23587.285019 secs 2024-04-26T18:21:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23587.285019 secs 2024-04-26T18:21:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23587.285019 secs 2024-04-26T18:21:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:13 smithi196 ceph-mon[32572]: pgmap v12869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:13.805 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:13 smithi110 ceph-mon[28069]: pgmap v12869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:13 smithi193 ceph-mon[32782]: pgmap v12869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:15 smithi196 ceph-mon[32572]: pgmap v12870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:15 smithi110 ceph-mon[28069]: pgmap v12870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:15 smithi193 ceph-mon[32782]: pgmap v12870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:17 smithi196 ceph-mon[32572]: pgmap v12871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23592.285154 secs 2024-04-26T18:21:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:17 smithi110 ceph-mon[28069]: pgmap v12871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23592.285154 secs 2024-04-26T18:21:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:17 smithi193 ceph-mon[32782]: pgmap v12871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23592.285154 secs 2024-04-26T18:21:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:19 smithi196 ceph-mon[32572]: pgmap v12872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:19 smithi110 ceph-mon[28069]: pgmap v12872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:19 smithi193 ceph-mon[32782]: pgmap v12872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:21:20.273+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:21:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:21:20.273+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T18:21:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:21:20.274+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 183 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T18:21:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:21:20.274+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 183 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:21:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:20 smithi196 ceph-mon[32572]: pgmap v12873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:20 smithi110 ceph-mon[28069]: pgmap v12873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:20 smithi193 ceph-mon[32782]: pgmap v12873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23597.285292 secs 2024-04-26T18:21:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:22 smithi196 ceph-mon[32572]: pgmap v12874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23597.285292 secs 2024-04-26T18:21:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:22 smithi110 ceph-mon[28069]: pgmap v12874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23597.285292 secs 2024-04-26T18:21:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:22 smithi193 ceph-mon[32782]: pgmap v12874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:24 smithi196 ceph-mon[32572]: pgmap v12875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:24 smithi110 ceph-mon[28069]: pgmap v12875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:24 smithi193 ceph-mon[32782]: pgmap v12875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:26 smithi196 ceph-mon[32572]: pgmap v12876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:26 smithi110 ceph-mon[28069]: pgmap v12876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:26 smithi193 ceph-mon[32782]: pgmap v12876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23602.285432 secs 2024-04-26T18:21:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23602.285432 secs 2024-04-26T18:21:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23602.285432 secs 2024-04-26T18:21:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:28 smithi196 ceph-mon[32572]: pgmap v12877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:28 smithi110 ceph-mon[28069]: pgmap v12877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:28 smithi193 ceph-mon[32782]: pgmap v12877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:30 smithi196 ceph-mon[32572]: pgmap v12878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:30 smithi110 ceph-mon[28069]: pgmap v12878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:30 smithi193 ceph-mon[32782]: pgmap v12878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23607.285549 secs 2024-04-26T18:21:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:32 smithi196 ceph-mon[32572]: pgmap v12879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23607.285549 secs 2024-04-26T18:21:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:32 smithi110 ceph-mon[28069]: pgmap v12879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23607.285549 secs 2024-04-26T18:21:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:32 smithi193 ceph-mon[32782]: pgmap v12879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:34 smithi110 ceph-mon[28069]: pgmap v12880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:21:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:34 smithi193 ceph-mon[32782]: pgmap v12880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:21:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:34 smithi196 ceph-mon[32572]: pgmap v12880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:21:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:21:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:21:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:35 smithi110 ceph-mon[28069]: pgmap v12881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T18:21:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:35 smithi110 ceph-mon[28069]: pgmap v12882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:21:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:21:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:21:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:35 smithi193 ceph-mon[32782]: pgmap v12881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T18:21:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:35 smithi193 ceph-mon[32782]: pgmap v12882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:21:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:21:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:21:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:35 smithi196 ceph-mon[32572]: pgmap v12881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T18:21:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:35 smithi196 ceph-mon[32572]: pgmap v12882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:21:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:36 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23612.285647 secs 2024-04-26T18:21:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:36 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23612.285647 secs 2024-04-26T18:21:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:36 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23612.285647 secs 2024-04-26T18:21:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:37 smithi110 ceph-mon[28069]: pgmap v12883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:21:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:37 smithi193 ceph-mon[32782]: pgmap v12883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:21:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:37 smithi196 ceph-mon[32572]: pgmap v12883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:21:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:40 smithi193 ceph-mon[32782]: pgmap v12884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:40 smithi196 ceph-mon[32572]: pgmap v12884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:40 smithi110 ceph-mon[28069]: pgmap v12884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:42 smithi193 ceph-mon[32782]: pgmap v12885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23617.285746 secs 2024-04-26T18:21:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:42 smithi196 ceph-mon[32572]: pgmap v12885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23617.285746 secs 2024-04-26T18:21:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:42 smithi110 ceph-mon[28069]: pgmap v12885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23617.285746 secs 2024-04-26T18:21:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:44 smithi193 ceph-mon[32782]: pgmap v12886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:44 smithi196 ceph-mon[32572]: pgmap v12886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:44 smithi110 ceph-mon[28069]: pgmap v12886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:21:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:46 smithi193 ceph-mon[32782]: pgmap v12887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:21:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:46 smithi196 ceph-mon[32572]: pgmap v12887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:21:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:46 smithi110 ceph-mon[28069]: pgmap v12887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:21:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23622.285856 secs 2024-04-26T18:21:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23622.285856 secs 2024-04-26T18:21:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23622.285856 secs 2024-04-26T18:21:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:48 smithi193 ceph-mon[32782]: pgmap v12888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:48 smithi196 ceph-mon[32572]: pgmap v12888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:48 smithi110 ceph-mon[28069]: pgmap v12888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:50 smithi193 ceph-mon[32782]: pgmap v12889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:21:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:50 smithi196 ceph-mon[32572]: pgmap v12889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:21:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:50 smithi110 ceph-mon[28069]: pgmap v12889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:21:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:52 smithi193 ceph-mon[32782]: pgmap v12890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23627.285962 secs 2024-04-26T18:21:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:52 smithi196 ceph-mon[32572]: pgmap v12890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23627.285962 secs 2024-04-26T18:21:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:52 smithi110 ceph-mon[28069]: pgmap v12890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23627.285962 secs 2024-04-26T18:21:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:54 smithi193 ceph-mon[32782]: pgmap v12891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:54 smithi196 ceph-mon[32572]: pgmap v12891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:54 smithi110 ceph-mon[28069]: pgmap v12891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:56 smithi193 ceph-mon[32782]: pgmap v12892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:56 smithi196 ceph-mon[32572]: pgmap v12892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:56 smithi110 ceph-mon[28069]: pgmap v12892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:21:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23632.286032 secs 2024-04-26T18:21:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23632.286032 secs 2024-04-26T18:21:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23632.286032 secs 2024-04-26T18:21:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:21:58 smithi196 ceph-mon[32572]: pgmap v12893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:21:58 smithi110 ceph-mon[28069]: pgmap v12893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:21:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:21:58 smithi193 ceph-mon[32782]: pgmap v12893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:00 smithi196 ceph-mon[32572]: pgmap v12894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:00 smithi110 ceph-mon[28069]: pgmap v12894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:00 smithi193 ceph-mon[32782]: pgmap v12894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:02.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:02 smithi193 ceph-mon[32782]: pgmap v12895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:02.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23637.286173 secs 2024-04-26T18:22:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:02 smithi196 ceph-mon[32572]: pgmap v12895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23637.286173 secs 2024-04-26T18:22:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:02 smithi110 ceph-mon[28069]: pgmap v12895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23637.286173 secs 2024-04-26T18:22:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:04 smithi196 ceph-mon[32572]: pgmap v12896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:04 smithi110 ceph-mon[28069]: pgmap v12896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:04 smithi193 ceph-mon[32782]: pgmap v12896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:06 smithi196 ceph-mon[32572]: pgmap v12897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:06 smithi110 ceph-mon[28069]: pgmap v12897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:06 smithi193 ceph-mon[32782]: pgmap v12897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23642.286290 secs 2024-04-26T18:22:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23642.286290 secs 2024-04-26T18:22:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23642.286290 secs 2024-04-26T18:22:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:08 smithi196 ceph-mon[32572]: pgmap v12898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:08 smithi110 ceph-mon[28069]: pgmap v12898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:08 smithi193 ceph-mon[32782]: pgmap v12898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:10 smithi196 ceph-mon[32572]: pgmap v12899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:10.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:10 smithi110 ceph-mon[28069]: pgmap v12899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:10.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:10 smithi193 ceph-mon[32782]: pgmap v12899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:12 smithi196 ceph-mon[32572]: pgmap v12900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23647.286411 secs 2024-04-26T18:22:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:12 smithi110 ceph-mon[28069]: pgmap v12900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23647.286411 secs 2024-04-26T18:22:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:12 smithi193 ceph-mon[32782]: pgmap v12900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23647.286411 secs 2024-04-26T18:22:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:14 smithi196 ceph-mon[32572]: pgmap v12901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:14 smithi110 ceph-mon[28069]: pgmap v12901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:14 smithi193 ceph-mon[32782]: pgmap v12901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:16 smithi196 ceph-mon[32572]: pgmap v12902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:16 smithi110 ceph-mon[28069]: pgmap v12902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:16 smithi193 ceph-mon[32782]: pgmap v12902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23652.286555 secs 2024-04-26T18:22:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23652.286555 secs 2024-04-26T18:22:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23652.286555 secs 2024-04-26T18:22:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:18 smithi196 ceph-mon[32572]: pgmap v12903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:18 smithi110 ceph-mon[28069]: pgmap v12903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:18 smithi193 ceph-mon[32782]: pgmap v12903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:20 smithi196 ceph-mon[32572]: pgmap v12904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:20 smithi110 ceph-mon[28069]: pgmap v12904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:20 smithi193 ceph-mon[32782]: pgmap v12904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:22 smithi196 ceph-mon[32572]: pgmap v12905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23657.286649 secs 2024-04-26T18:22:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:22 smithi110 ceph-mon[28069]: pgmap v12905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23657.286649 secs 2024-04-26T18:22:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:22 smithi193 ceph-mon[32782]: pgmap v12905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23657.286649 secs 2024-04-26T18:22:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:24 smithi196 ceph-mon[32572]: pgmap v12906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:24 smithi110 ceph-mon[28069]: pgmap v12906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:24 smithi193 ceph-mon[32782]: pgmap v12906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:26 smithi196 ceph-mon[32572]: pgmap v12907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:26 smithi110 ceph-mon[28069]: pgmap v12907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:26 smithi193 ceph-mon[32782]: pgmap v12907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23662.286769 secs 2024-04-26T18:22:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23662.286769 secs 2024-04-26T18:22:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23662.286769 secs 2024-04-26T18:22:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:28 smithi196 ceph-mon[32572]: pgmap v12908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:28 smithi110 ceph-mon[28069]: pgmap v12908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:28 smithi193 ceph-mon[32782]: pgmap v12908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:30 smithi196 ceph-mon[32572]: pgmap v12909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:30 smithi110 ceph-mon[28069]: pgmap v12909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:30 smithi193 ceph-mon[32782]: pgmap v12909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:22:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:32 smithi196 ceph-mon[32572]: pgmap v12910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23667.286863 secs 2024-04-26T18:22:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:32 smithi110 ceph-mon[28069]: pgmap v12910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23667.286863 secs 2024-04-26T18:22:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:32 smithi193 ceph-mon[32782]: pgmap v12910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23667.286863 secs 2024-04-26T18:22:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:34 smithi196 ceph-mon[32572]: pgmap v12911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:34 smithi110 ceph-mon[28069]: pgmap v12911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:34 smithi193 ceph-mon[32782]: pgmap v12911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:36 smithi196 ceph-mon[32572]: pgmap v12912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:22:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:36 smithi110 ceph-mon[28069]: pgmap v12912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:22:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:36 smithi193 ceph-mon[32782]: pgmap v12912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:22:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23672.286956 secs 2024-04-26T18:22:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:22:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:22:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:37 smithi110 ceph-mon[28069]: pgmap v12913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:22:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:37 smithi110 ceph-mon[28069]: pgmap v12914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:22:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:22:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23672.286956 secs 2024-04-26T18:22:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:22:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:22:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:37 smithi193 ceph-mon[32782]: pgmap v12913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:22:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:37 smithi193 ceph-mon[32782]: pgmap v12914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:22:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:22:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23672.286956 secs 2024-04-26T18:22:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:22:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:22:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:37 smithi196 ceph-mon[32572]: pgmap v12913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:22:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:37 smithi196 ceph-mon[32572]: pgmap v12914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:22:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:22:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:39 smithi196 ceph-mon[32572]: pgmap v12915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:39 smithi110 ceph-mon[28069]: pgmap v12915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:39 smithi193 ceph-mon[32782]: pgmap v12915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:41 smithi196 ceph-mon[32572]: pgmap v12916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:41 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23677.287082 secs 2024-04-26T18:22:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:41 smithi110 ceph-mon[28069]: pgmap v12916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:41 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23677.287082 secs 2024-04-26T18:22:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:41 smithi193 ceph-mon[32782]: pgmap v12916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:41 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23677.287082 secs 2024-04-26T18:22:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:43 smithi196 ceph-mon[32572]: pgmap v12917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:43 smithi110 ceph-mon[28069]: pgmap v12917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:43 smithi193 ceph-mon[32782]: pgmap v12917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:45 smithi196 ceph-mon[32572]: pgmap v12918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:45 smithi110 ceph-mon[28069]: pgmap v12918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:45 smithi193 ceph-mon[32782]: pgmap v12918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:22:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:46 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23682.287156 secs 2024-04-26T18:22:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:46 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23682.287156 secs 2024-04-26T18:22:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:46 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23682.287156 secs 2024-04-26T18:22:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:47 smithi196 ceph-mon[32572]: pgmap v12919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:22:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:47 smithi110 ceph-mon[28069]: pgmap v12919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:22:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:47 smithi193 ceph-mon[32782]: pgmap v12919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:22:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:49 smithi196 ceph-mon[32572]: pgmap v12920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:49 smithi110 ceph-mon[28069]: pgmap v12920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:49 smithi193 ceph-mon[32782]: pgmap v12920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:51 smithi196 ceph-mon[32572]: pgmap v12921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23687.287295 secs 2024-04-26T18:22:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:51 smithi110 ceph-mon[28069]: pgmap v12921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23687.287295 secs 2024-04-26T18:22:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:51 smithi193 ceph-mon[32782]: pgmap v12921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23687.287295 secs 2024-04-26T18:22:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:53 smithi196 ceph-mon[32572]: pgmap v12922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:53 smithi110 ceph-mon[28069]: pgmap v12922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:53 smithi193 ceph-mon[32782]: pgmap v12922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:22:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:55 smithi196 ceph-mon[32572]: pgmap v12923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:55 smithi110 ceph-mon[28069]: pgmap v12923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:55 smithi193 ceph-mon[32782]: pgmap v12923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23692.287440 secs 2024-04-26T18:22:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23692.287440 secs 2024-04-26T18:22:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23692.287440 secs 2024-04-26T18:22:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:57 smithi196 ceph-mon[32572]: pgmap v12924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:57 smithi110 ceph-mon[28069]: pgmap v12924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:22:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:57 smithi193 ceph-mon[32782]: pgmap v12924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:22:59 smithi196 ceph-mon[32572]: pgmap v12925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:22:59 smithi110 ceph-mon[28069]: pgmap v12925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:22:59 smithi193 ceph-mon[32782]: pgmap v12925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:02.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:01 smithi193 ceph-mon[32782]: pgmap v12926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:02.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:01 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23697.287548 secs 2024-04-26T18:23:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:01 smithi196 ceph-mon[32572]: pgmap v12926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:01 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23697.287548 secs 2024-04-26T18:23:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:01 smithi110 ceph-mon[28069]: pgmap v12926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:01 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23697.287548 secs 2024-04-26T18:23:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:03 smithi196 ceph-mon[32572]: pgmap v12927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:03 smithi110 ceph-mon[28069]: pgmap v12927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:03 smithi193 ceph-mon[32782]: pgmap v12927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:05 smithi196 ceph-mon[32572]: pgmap v12928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:05 smithi110 ceph-mon[28069]: pgmap v12928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:05 smithi193 ceph-mon[32782]: pgmap v12928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:06 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23702.287660 secs 2024-04-26T18:23:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:06 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23702.287660 secs 2024-04-26T18:23:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:06 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23702.287660 secs 2024-04-26T18:23:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:07 smithi196 ceph-mon[32572]: pgmap v12929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:07 smithi110 ceph-mon[28069]: pgmap v12929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:07 smithi193 ceph-mon[32782]: pgmap v12929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:09 smithi196 ceph-mon[32572]: pgmap v12930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:09 smithi110 ceph-mon[28069]: pgmap v12930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:09 smithi193 ceph-mon[32782]: pgmap v12930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:11 smithi196 ceph-mon[32572]: pgmap v12931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:11 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23707.287779 secs 2024-04-26T18:23:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:11 smithi110 ceph-mon[28069]: pgmap v12931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:11 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23707.287779 secs 2024-04-26T18:23:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:11 smithi193 ceph-mon[32782]: pgmap v12931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:11 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23707.287779 secs 2024-04-26T18:23:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:13 smithi196 ceph-mon[32572]: pgmap v12932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:13 smithi110 ceph-mon[28069]: pgmap v12932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:13 smithi193 ceph-mon[32782]: pgmap v12932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:15 smithi196 ceph-mon[32572]: pgmap v12933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:23:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:15 smithi110 ceph-mon[28069]: pgmap v12933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:23:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:15 smithi193 ceph-mon[32782]: pgmap v12933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:23:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:16 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23712.287918 secs 2024-04-26T18:23:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:16 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23712.287918 secs 2024-04-26T18:23:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:16 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23712.287918 secs 2024-04-26T18:23:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:17 smithi196 ceph-mon[32572]: pgmap v12934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:23:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:17 smithi110 ceph-mon[28069]: pgmap v12934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:23:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:17 smithi193 ceph-mon[32782]: pgmap v12934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:23:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:19 smithi196 ceph-mon[32572]: pgmap v12935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:19 smithi110 ceph-mon[28069]: pgmap v12935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:19 smithi193 ceph-mon[32782]: pgmap v12935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:21 smithi196 ceph-mon[32572]: pgmap v12936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:23:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:21 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23717.288034 secs 2024-04-26T18:23:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:21 smithi110 ceph-mon[28069]: pgmap v12936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:23:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:21 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23717.288034 secs 2024-04-26T18:23:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:21 smithi193 ceph-mon[32782]: pgmap v12936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:23:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:21 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23717.288034 secs 2024-04-26T18:23:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:23 smithi196 ceph-mon[32572]: pgmap v12937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:23 smithi110 ceph-mon[28069]: pgmap v12937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:23 smithi193 ceph-mon[32782]: pgmap v12937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:25 smithi196 ceph-mon[32572]: pgmap v12938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:25 smithi110 ceph-mon[28069]: pgmap v12938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:25 smithi193 ceph-mon[32782]: pgmap v12938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:26 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23722.288161 secs 2024-04-26T18:23:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:26 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23722.288161 secs 2024-04-26T18:23:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:26 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23722.288161 secs 2024-04-26T18:23:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:27 smithi196 ceph-mon[32572]: pgmap v12939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:27 smithi110 ceph-mon[28069]: pgmap v12939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:27 smithi193 ceph-mon[32782]: pgmap v12939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:30 smithi196 ceph-mon[32572]: pgmap v12940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:30 smithi110 ceph-mon[28069]: pgmap v12940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:30 smithi193 ceph-mon[32782]: pgmap v12940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:32 smithi110 ceph-mon[28069]: pgmap v12941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23727.288228 secs 2024-04-26T18:23:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:32 smithi193 ceph-mon[32782]: pgmap v12941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23727.288228 secs 2024-04-26T18:23:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:32 smithi196 ceph-mon[32572]: pgmap v12941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23727.288228 secs 2024-04-26T18:23:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:34 smithi110 ceph-mon[28069]: pgmap v12942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:34 smithi193 ceph-mon[32782]: pgmap v12942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:34 smithi196 ceph-mon[32572]: pgmap v12942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:36 smithi110 ceph-mon[28069]: pgmap v12943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:36 smithi193 ceph-mon[32782]: pgmap v12943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:36 smithi196 ceph-mon[32572]: pgmap v12943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23732.288347 secs 2024-04-26T18:23:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23732.288347 secs 2024-04-26T18:23:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23732.288347 secs 2024-04-26T18:23:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:38 smithi110 ceph-mon[28069]: pgmap v12944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:23:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:38 smithi193 ceph-mon[32782]: pgmap v12944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:23:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:38 smithi196 ceph-mon[32572]: pgmap v12944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:23:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:23:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:23:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:39 smithi193 ceph-mon[32782]: pgmap v12945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:23:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:39 smithi193 ceph-mon[32782]: pgmap v12946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:23:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:23:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:23:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:39 smithi196 ceph-mon[32572]: pgmap v12945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:23:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:39 smithi196 ceph-mon[32572]: pgmap v12946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:23:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:23:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:23:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:39 smithi110 ceph-mon[28069]: pgmap v12945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:23:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:39 smithi110 ceph-mon[28069]: pgmap v12946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:23:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:41 smithi196 ceph-mon[32572]: pgmap v12947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:41 smithi110 ceph-mon[28069]: pgmap v12947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:41 smithi193 ceph-mon[32782]: pgmap v12947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23737.288472 secs 2024-04-26T18:23:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23737.288472 secs 2024-04-26T18:23:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23737.288472 secs 2024-04-26T18:23:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:43 smithi196 ceph-mon[32572]: pgmap v12948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:23:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:43 smithi110 ceph-mon[28069]: pgmap v12948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:23:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:43 smithi193 ceph-mon[32782]: pgmap v12948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:23:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:45 smithi196 ceph-mon[32572]: pgmap v12949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:45 smithi110 ceph-mon[28069]: pgmap v12949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:45 smithi193 ceph-mon[32782]: pgmap v12949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:47 smithi196 ceph-mon[32572]: pgmap v12950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23742.288593 secs 2024-04-26T18:23:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:47 smithi110 ceph-mon[28069]: pgmap v12950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23742.288593 secs 2024-04-26T18:23:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:47 smithi193 ceph-mon[32782]: pgmap v12950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:23:47.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23742.288593 secs 2024-04-26T18:23:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:49 smithi196 ceph-mon[32572]: pgmap v12951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:23:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:49 smithi110 ceph-mon[28069]: pgmap v12951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:23:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:49 smithi193 ceph-mon[32782]: pgmap v12951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:23:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:51 smithi196 ceph-mon[32572]: pgmap v12952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:51 smithi110 ceph-mon[28069]: pgmap v12952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:51 smithi193 ceph-mon[32782]: pgmap v12952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23747.288710 secs 2024-04-26T18:23:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23747.288710 secs 2024-04-26T18:23:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23747.288710 secs 2024-04-26T18:23:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:53 smithi196 ceph-mon[32572]: pgmap v12953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:53 smithi110 ceph-mon[28069]: pgmap v12953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:53 smithi193 ceph-mon[32782]: pgmap v12953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:55 smithi196 ceph-mon[32572]: pgmap v12954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:23:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:55 smithi110 ceph-mon[28069]: pgmap v12954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:23:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:55 smithi193 ceph-mon[32782]: pgmap v12954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:23:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:57 smithi196 ceph-mon[32572]: pgmap v12955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23752.288850 secs 2024-04-26T18:23:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:57 smithi110 ceph-mon[28069]: pgmap v12955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23752.288850 secs 2024-04-26T18:23:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:57 smithi193 ceph-mon[32782]: pgmap v12955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:23:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23752.288850 secs 2024-04-26T18:23:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:23:59 smithi196 ceph-mon[32572]: pgmap v12956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:23:59 smithi110 ceph-mon[28069]: pgmap v12956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:23:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:23:59 smithi193 ceph-mon[32782]: pgmap v12956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:01 smithi110 ceph-mon[28069]: pgmap v12957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:01 smithi193 ceph-mon[32782]: pgmap v12957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:01 smithi196 ceph-mon[32572]: pgmap v12957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:02.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23757.288972 secs 2024-04-26T18:24:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23757.288972 secs 2024-04-26T18:24:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23757.288972 secs 2024-04-26T18:24:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:03 smithi110 ceph-mon[28069]: pgmap v12958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:03 smithi193 ceph-mon[32782]: pgmap v12958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:03 smithi196 ceph-mon[32572]: pgmap v12958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:04 smithi110 ceph-mon[28069]: pgmap v12959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:24:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:04 smithi193 ceph-mon[32782]: pgmap v12959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:24:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:04 smithi196 ceph-mon[32572]: pgmap v12959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:24:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:07 smithi196 ceph-mon[32572]: pgmap v12960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23762.289101 secs 2024-04-26T18:24:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:07 smithi110 ceph-mon[28069]: pgmap v12960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23762.289101 secs 2024-04-26T18:24:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:07 smithi193 ceph-mon[32782]: pgmap v12960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23762.289101 secs 2024-04-26T18:24:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:09 smithi196 ceph-mon[32572]: pgmap v12961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:09 smithi110 ceph-mon[28069]: pgmap v12961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:09 smithi193 ceph-mon[32782]: pgmap v12961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:11 smithi196 ceph-mon[32572]: pgmap v12962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:11 smithi110 ceph-mon[28069]: pgmap v12962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:11 smithi193 ceph-mon[32782]: pgmap v12962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:12.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:24:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:24:11.807+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:12.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:24:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:24:11.807+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:12.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:24:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:24:11.807+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:12.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:24:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:24:11.807+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:12.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:24:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:24:11.807+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23767.289224 secs 2024-04-26T18:24:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23767.289224 secs 2024-04-26T18:24:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23767.289224 secs 2024-04-26T18:24:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:13 smithi196 ceph-mon[32572]: pgmap v12963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T18:24:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:13 smithi110 ceph-mon[28069]: pgmap v12963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T18:24:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:13 smithi193 ceph-mon[32782]: pgmap v12963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T18:24:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:15 smithi196 ceph-mon[32572]: pgmap v12964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:15 smithi110 ceph-mon[28069]: pgmap v12964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:15 smithi193 ceph-mon[32782]: pgmap v12964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:17 smithi196 ceph-mon[32572]: pgmap v12965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23772.289355 secs 2024-04-26T18:24:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:17 smithi110 ceph-mon[28069]: pgmap v12965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23772.289355 secs 2024-04-26T18:24:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:17 smithi193 ceph-mon[32782]: pgmap v12965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23772.289355 secs 2024-04-26T18:24:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:19 smithi196 ceph-mon[32572]: pgmap v12966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:19 smithi110 ceph-mon[28069]: pgmap v12966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:19 smithi193 ceph-mon[32782]: pgmap v12966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:24:20.303+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:24:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:24:20.303+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T18:24:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:24:20.303+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 184 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T18:24:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:24:20.303+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 184 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:24:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:24:20.303+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:24:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:24:20.303+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:24:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:24:20.304+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 185 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:24:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:24:20.304+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 185 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:24:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:21 smithi196 ceph-mon[32572]: pgmap v12967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:21 smithi110 ceph-mon[28069]: pgmap v12967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:21 smithi193 ceph-mon[32782]: pgmap v12967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23777.289480 secs 2024-04-26T18:24:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23777.289480 secs 2024-04-26T18:24:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23777.289480 secs 2024-04-26T18:24:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:23 smithi110 ceph-mon[28069]: pgmap v12968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:23 smithi193 ceph-mon[32782]: pgmap v12968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:23 smithi196 ceph-mon[32572]: pgmap v12968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:24:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:25 smithi110 ceph-mon[28069]: pgmap v12969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:24:25.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:25 smithi196 ceph-mon[32572]: pgmap v12969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:24:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:25 smithi193 ceph-mon[32782]: pgmap v12969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:24:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:27 smithi110 ceph-mon[28069]: pgmap v12970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23782.289602 secs 2024-04-26T18:24:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:27 smithi193 ceph-mon[32782]: pgmap v12970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23782.289602 secs 2024-04-26T18:24:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:27 smithi196 ceph-mon[32572]: pgmap v12970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23782.289602 secs 2024-04-26T18:24:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:28 smithi193 ceph-mon[32782]: pgmap v12971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:29.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:28 smithi196 ceph-mon[32572]: pgmap v12971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:28 smithi110 ceph-mon[28069]: pgmap v12971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:31 smithi196 ceph-mon[32572]: pgmap v12972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:31 smithi110 ceph-mon[28069]: pgmap v12972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:31 smithi193 ceph-mon[32782]: pgmap v12972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23787.289715 secs 2024-04-26T18:24:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23787.289715 secs 2024-04-26T18:24:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23787.289715 secs 2024-04-26T18:24:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:33 smithi196 ceph-mon[32572]: pgmap v12973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:33 smithi110 ceph-mon[28069]: pgmap v12973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:33 smithi193 ceph-mon[32782]: pgmap v12973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:35 smithi196 ceph-mon[32572]: pgmap v12974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:24:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:35 smithi110 ceph-mon[28069]: pgmap v12974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:24:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:35 smithi193 ceph-mon[32782]: pgmap v12974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:24:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:37 smithi196 ceph-mon[32572]: pgmap v12975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23792.289797 secs 2024-04-26T18:24:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:37 smithi110 ceph-mon[28069]: pgmap v12975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23792.289797 secs 2024-04-26T18:24:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:37 smithi193 ceph-mon[32782]: pgmap v12975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23792.289797 secs 2024-04-26T18:24:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:39 smithi196 ceph-mon[32572]: pgmap v12976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:24:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:39 smithi110 ceph-mon[28069]: pgmap v12976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:24:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:39 smithi193 ceph-mon[32782]: pgmap v12976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:24:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:24:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:24:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:24:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:24:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:24:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:24:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:41 smithi110 ceph-mon[28069]: pgmap v12977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:24:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:24:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:24:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:41 smithi193 ceph-mon[32782]: pgmap v12977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:24:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:24:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:24:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:41 smithi196 ceph-mon[32572]: pgmap v12977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:24:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:24:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:24:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:42 smithi110 ceph-mon[28069]: pgmap v12978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T18:24:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:42 smithi110 ceph-mon[28069]: pgmap v12979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:24:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23797.289927 secs 2024-04-26T18:24:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:42 smithi193 ceph-mon[32782]: pgmap v12978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T18:24:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:42 smithi193 ceph-mon[32782]: pgmap v12979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:24:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23797.289927 secs 2024-04-26T18:24:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:42 smithi196 ceph-mon[32572]: pgmap v12978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T18:24:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:42 smithi196 ceph-mon[32572]: pgmap v12979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:24:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23797.289927 secs 2024-04-26T18:24:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:43 smithi110 ceph-mon[28069]: pgmap v12980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:43 smithi193 ceph-mon[32782]: pgmap v12980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:43 smithi196 ceph-mon[32572]: pgmap v12980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:45 smithi193 ceph-mon[32782]: pgmap v12981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:45 smithi196 ceph-mon[32572]: pgmap v12981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:45 smithi110 ceph-mon[28069]: pgmap v12981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:46 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23802.290051 secs 2024-04-26T18:24:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:46 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23802.290051 secs 2024-04-26T18:24:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:46 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23802.290051 secs 2024-04-26T18:24:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:47 smithi196 ceph-mon[32572]: pgmap v12982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:24:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:47 smithi110 ceph-mon[28069]: pgmap v12982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:24:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:47 smithi193 ceph-mon[32782]: pgmap v12982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T18:24:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:49 smithi196 ceph-mon[32572]: pgmap v12983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:49 smithi110 ceph-mon[28069]: pgmap v12983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:49 smithi193 ceph-mon[32782]: pgmap v12983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:51 smithi196 ceph-mon[32572]: pgmap v12984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:24:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23807.290198 secs 2024-04-26T18:24:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:51 smithi110 ceph-mon[28069]: pgmap v12984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:24:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23807.290198 secs 2024-04-26T18:24:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:51 smithi193 ceph-mon[32782]: pgmap v12984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:24:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23807.290198 secs 2024-04-26T18:24:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:53 smithi196 ceph-mon[32572]: pgmap v12985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:53 smithi110 ceph-mon[28069]: pgmap v12985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:53 smithi193 ceph-mon[32782]: pgmap v12985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:24:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:55 smithi196 ceph-mon[32572]: pgmap v12986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:55 smithi110 ceph-mon[28069]: pgmap v12986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:55 smithi193 ceph-mon[32782]: pgmap v12986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23812.290341 secs 2024-04-26T18:24:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23812.290341 secs 2024-04-26T18:24:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23812.290341 secs 2024-04-26T18:24:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:57 smithi110 ceph-mon[28069]: pgmap v12987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:57 smithi196 ceph-mon[32572]: pgmap v12987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:24:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:57 smithi193 ceph-mon[32782]: pgmap v12987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:00.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:24:59 smithi196 ceph-mon[32572]: pgmap v12988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:24:59 smithi110 ceph-mon[28069]: pgmap v12988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:24:59 smithi193 ceph-mon[32782]: pgmap v12988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:02.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:01 smithi193 ceph-mon[32782]: pgmap v12989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:02.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:01 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23817.290482 secs 2024-04-26T18:25:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:01 smithi196 ceph-mon[32572]: pgmap v12989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:01 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23817.290482 secs 2024-04-26T18:25:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:01 smithi110 ceph-mon[28069]: pgmap v12989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:01 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23817.290482 secs 2024-04-26T18:25:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:03 smithi196 ceph-mon[32572]: pgmap v12990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:25:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:03 smithi110 ceph-mon[28069]: pgmap v12990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:25:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:03 smithi193 ceph-mon[32782]: pgmap v12990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:25:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:05 smithi196 ceph-mon[32572]: pgmap v12991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:25:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:05 smithi110 ceph-mon[28069]: pgmap v12991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:25:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:05 smithi193 ceph-mon[32782]: pgmap v12991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:25:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:06 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23822.290604 secs 2024-04-26T18:25:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:06 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23822.290604 secs 2024-04-26T18:25:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:06 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23822.290604 secs 2024-04-26T18:25:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:07 smithi196 ceph-mon[32572]: pgmap v12992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:25:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:07 smithi110 ceph-mon[28069]: pgmap v12992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:25:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:07 smithi193 ceph-mon[32782]: pgmap v12992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:25:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:09 smithi196 ceph-mon[32572]: pgmap v12993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:25:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:09 smithi110 ceph-mon[28069]: pgmap v12993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:25:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:09 smithi193 ceph-mon[32782]: pgmap v12993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:25:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:11 smithi196 ceph-mon[32572]: pgmap v12994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:25:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:11 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23827.290686 secs 2024-04-26T18:25:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:11 smithi110 ceph-mon[28069]: pgmap v12994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:25:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:11 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23827.290686 secs 2024-04-26T18:25:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:11 smithi193 ceph-mon[32782]: pgmap v12994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:25:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:11 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23827.290686 secs 2024-04-26T18:25:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:13 smithi196 ceph-mon[32572]: pgmap v12995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:25:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:13 smithi110 ceph-mon[28069]: pgmap v12995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:25:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:13 smithi193 ceph-mon[32782]: pgmap v12995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:25:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:15 smithi196 ceph-mon[32572]: pgmap v12996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:15 smithi110 ceph-mon[28069]: pgmap v12996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:15 smithi193 ceph-mon[32782]: pgmap v12996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:16 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23832.290814 secs 2024-04-26T18:25:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:16 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23832.290814 secs 2024-04-26T18:25:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:16 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23832.290814 secs 2024-04-26T18:25:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:17 smithi196 ceph-mon[32572]: pgmap v12997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:17 smithi110 ceph-mon[28069]: pgmap v12997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:17 smithi193 ceph-mon[32782]: pgmap v12997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:19 smithi196 ceph-mon[32572]: pgmap v12998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:19 smithi110 ceph-mon[28069]: pgmap v12998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:19 smithi193 ceph-mon[32782]: pgmap v12998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:21 smithi196 ceph-mon[32572]: pgmap v12999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:21 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23837.290946 secs 2024-04-26T18:25:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:21 smithi110 ceph-mon[28069]: pgmap v12999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:21 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23837.290946 secs 2024-04-26T18:25:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:21 smithi193 ceph-mon[32782]: pgmap v12999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:21 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23837.290946 secs 2024-04-26T18:25:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:23 smithi196 ceph-mon[32572]: pgmap v13000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:23 smithi110 ceph-mon[28069]: pgmap v13000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:23 smithi193 ceph-mon[32782]: pgmap v13000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:25 smithi196 ceph-mon[32572]: pgmap v13001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:25 smithi110 ceph-mon[28069]: pgmap v13001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:25 smithi193 ceph-mon[32782]: pgmap v13001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23842.291074 secs 2024-04-26T18:25:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23842.291074 secs 2024-04-26T18:25:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23842.291074 secs 2024-04-26T18:25:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:28 smithi110 ceph-mon[28069]: pgmap v13002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:28 smithi193 ceph-mon[32782]: pgmap v13002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:28 smithi196 ceph-mon[32572]: pgmap v13002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:30 smithi110 ceph-mon[28069]: pgmap v13003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:30 smithi193 ceph-mon[32782]: pgmap v13003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:30 smithi196 ceph-mon[32572]: pgmap v13003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:32 smithi110 ceph-mon[28069]: pgmap v13004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23847.291214 secs 2024-04-26T18:25:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:32 smithi193 ceph-mon[32782]: pgmap v13004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23847.291214 secs 2024-04-26T18:25:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:32 smithi196 ceph-mon[32572]: pgmap v13004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23847.291214 secs 2024-04-26T18:25:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:34 smithi110 ceph-mon[28069]: pgmap v13005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:34 smithi193 ceph-mon[32782]: pgmap v13005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:34 smithi196 ceph-mon[32572]: pgmap v13005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:36 smithi110 ceph-mon[28069]: pgmap v13006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:36 smithi193 ceph-mon[32782]: pgmap v13006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:36 smithi196 ceph-mon[32572]: pgmap v13006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23852.291355 secs 2024-04-26T18:25:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23852.291355 secs 2024-04-26T18:25:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23852.291355 secs 2024-04-26T18:25:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:38 smithi110 ceph-mon[28069]: pgmap v13007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:38 smithi193 ceph-mon[32782]: pgmap v13007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:38 smithi196 ceph-mon[32572]: pgmap v13007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:40 smithi193 ceph-mon[32782]: pgmap v13008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:40 smithi196 ceph-mon[32572]: pgmap v13008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:40 smithi110 ceph-mon[28069]: pgmap v13008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:42 smithi193 ceph-mon[32782]: pgmap v13009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23857.291450 secs 2024-04-26T18:25:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:42 smithi196 ceph-mon[32572]: pgmap v13009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23857.291450 secs 2024-04-26T18:25:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:42 smithi110 ceph-mon[28069]: pgmap v13009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23857.291450 secs 2024-04-26T18:25:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:25:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:25:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:43 smithi193 ceph-mon[32782]: pgmap v13010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:25:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:43 smithi193 ceph-mon[32782]: pgmap v13011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:25:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:25:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:25:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:43 smithi196 ceph-mon[32572]: pgmap v13010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:25:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:43 smithi196 ceph-mon[32572]: pgmap v13011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:25:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:25:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:25:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:43 smithi110 ceph-mon[28069]: pgmap v13010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:25:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:43 smithi110 ceph-mon[28069]: pgmap v13011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:25:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:25:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:45 smithi196 ceph-mon[32572]: pgmap v13012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:45 smithi110 ceph-mon[28069]: pgmap v13012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:45 smithi193 ceph-mon[32782]: pgmap v13012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:47 smithi196 ceph-mon[32572]: pgmap v13013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23862.291603 secs 2024-04-26T18:25:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:47 smithi110 ceph-mon[28069]: pgmap v13013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23862.291603 secs 2024-04-26T18:25:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:47 smithi193 ceph-mon[32782]: pgmap v13013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23862.291603 secs 2024-04-26T18:25:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:49 smithi196 ceph-mon[32572]: pgmap v13014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:49 smithi110 ceph-mon[28069]: pgmap v13014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:49 smithi193 ceph-mon[32782]: pgmap v13014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:51 smithi196 ceph-mon[32572]: pgmap v13015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:51 smithi110 ceph-mon[28069]: pgmap v13015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:51 smithi193 ceph-mon[32782]: pgmap v13015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:25:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23867.291731 secs 2024-04-26T18:25:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23867.291731 secs 2024-04-26T18:25:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23867.291731 secs 2024-04-26T18:25:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:53 smithi196 ceph-mon[32572]: pgmap v13016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:25:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:53 smithi110 ceph-mon[28069]: pgmap v13016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:25:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:53 smithi193 ceph-mon[32782]: pgmap v13016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:25:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:55 smithi196 ceph-mon[32572]: pgmap v13017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:25:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:55 smithi110 ceph-mon[28069]: pgmap v13017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:25:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:55 smithi193 ceph-mon[32782]: pgmap v13017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:25:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:57 smithi196 ceph-mon[32572]: pgmap v13018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23872.291861 secs 2024-04-26T18:25:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:57 smithi110 ceph-mon[28069]: pgmap v13018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23872.291861 secs 2024-04-26T18:25:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:57 smithi193 ceph-mon[32782]: pgmap v13018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:25:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23872.291861 secs 2024-04-26T18:25:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:25:59 smithi196 ceph-mon[32572]: pgmap v13019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:25:59 smithi110 ceph-mon[28069]: pgmap v13019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:25:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:25:59 smithi193 ceph-mon[32782]: pgmap v13019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:01 smithi196 ceph-mon[32572]: pgmap v13020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:01 smithi110 ceph-mon[28069]: pgmap v13020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:01 smithi193 ceph-mon[32782]: pgmap v13020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23877.292003 secs 2024-04-26T18:26:02.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23877.292003 secs 2024-04-26T18:26:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23877.292003 secs 2024-04-26T18:26:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:03 smithi196 ceph-mon[32572]: pgmap v13021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:03 smithi110 ceph-mon[28069]: pgmap v13021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:03 smithi193 ceph-mon[32782]: pgmap v13021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:05 smithi196 ceph-mon[32572]: pgmap v13022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:05 smithi110 ceph-mon[28069]: pgmap v13022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:05 smithi193 ceph-mon[32782]: pgmap v13022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:07 smithi196 ceph-mon[32572]: pgmap v13023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:07 smithi196 ceph-mon[32572]: 20 slow requests, 1 included below; oldest blocked for > 23882.292108 secs 2024-04-26T18:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:07 smithi196 ceph-mon[32572]: slow request 11520.336725 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:26:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:07 smithi110 ceph-mon[28069]: pgmap v13023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:07 smithi110 ceph-mon[28069]: 20 slow requests, 1 included below; oldest blocked for > 23882.292108 secs 2024-04-26T18:26:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:07 smithi110 ceph-mon[28069]: slow request 11520.336725 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:07 smithi193 ceph-mon[32782]: pgmap v13023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:07 smithi193 ceph-mon[32782]: 20 slow requests, 1 included below; oldest blocked for > 23882.292108 secs 2024-04-26T18:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:07 smithi193 ceph-mon[32782]: slow request 11520.336725 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:26:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:08 smithi193 ceph-mon[32782]: pgmap v13024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:08 smithi196 ceph-mon[32572]: pgmap v13024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:08 smithi110 ceph-mon[28069]: pgmap v13024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:11 smithi196 ceph-mon[32572]: pgmap v13025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:11 smithi110 ceph-mon[28069]: pgmap v13025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:11 smithi193 ceph-mon[32782]: pgmap v13025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23887.292238 secs 2024-04-26T18:26:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23887.292238 secs 2024-04-26T18:26:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23887.292238 secs 2024-04-26T18:26:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:13 smithi196 ceph-mon[32572]: pgmap v13026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:13 smithi110 ceph-mon[28069]: pgmap v13026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:13 smithi193 ceph-mon[32782]: pgmap v13026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:15 smithi196 ceph-mon[32572]: pgmap v13027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:15 smithi110 ceph-mon[28069]: pgmap v13027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:15 smithi193 ceph-mon[32782]: pgmap v13027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:17 smithi196 ceph-mon[32572]: pgmap v13028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23892.292363 secs 2024-04-26T18:26:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:17 smithi110 ceph-mon[28069]: pgmap v13028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23892.292363 secs 2024-04-26T18:26:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:17 smithi193 ceph-mon[32782]: pgmap v13028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23892.292363 secs 2024-04-26T18:26:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:19 smithi196 ceph-mon[32572]: pgmap v13029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:19 smithi110 ceph-mon[28069]: pgmap v13029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:19 smithi193 ceph-mon[32782]: pgmap v13029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:21 smithi196 ceph-mon[32572]: pgmap v13030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:21 smithi110 ceph-mon[28069]: pgmap v13030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:21 smithi193 ceph-mon[32782]: pgmap v13030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23897.292486 secs 2024-04-26T18:26:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23897.292486 secs 2024-04-26T18:26:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23897.292486 secs 2024-04-26T18:26:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:23 smithi196 ceph-mon[32572]: pgmap v13031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:23 smithi110 ceph-mon[28069]: pgmap v13031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:23 smithi193 ceph-mon[32782]: pgmap v13031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:25 smithi196 ceph-mon[32572]: pgmap v13032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:25 smithi110 ceph-mon[28069]: pgmap v13032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:25 smithi193 ceph-mon[32782]: pgmap v13032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:27 smithi196 ceph-mon[32572]: pgmap v13033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23902.292610 secs 2024-04-26T18:26:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:27 smithi110 ceph-mon[28069]: pgmap v13033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23902.292610 secs 2024-04-26T18:26:27.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:27 smithi193 ceph-mon[32782]: pgmap v13033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:27.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23902.292610 secs 2024-04-26T18:26:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:29 smithi196 ceph-mon[32572]: pgmap v13034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:29 smithi110 ceph-mon[28069]: pgmap v13034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:29 smithi193 ceph-mon[32782]: pgmap v13034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:31 smithi196 ceph-mon[32572]: pgmap v13035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:31 smithi110 ceph-mon[28069]: pgmap v13035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:31 smithi193 ceph-mon[32782]: pgmap v13035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23907.292726 secs 2024-04-26T18:26:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23907.292726 secs 2024-04-26T18:26:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23907.292726 secs 2024-04-26T18:26:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:33 smithi110 ceph-mon[28069]: pgmap v13036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:33 smithi193 ceph-mon[32782]: pgmap v13036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:33 smithi196 ceph-mon[32572]: pgmap v13036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:35 smithi110 ceph-mon[28069]: pgmap v13037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:35 smithi193 ceph-mon[32782]: pgmap v13037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:35 smithi196 ceph-mon[32572]: pgmap v13037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:37 smithi110 ceph-mon[28069]: pgmap v13038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23912.292853 secs 2024-04-26T18:26:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:37 smithi193 ceph-mon[32782]: pgmap v13038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23912.292853 secs 2024-04-26T18:26:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:37 smithi196 ceph-mon[32572]: pgmap v13038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23912.292853 secs 2024-04-26T18:26:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:39 smithi110 ceph-mon[28069]: pgmap v13039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:39 smithi193 ceph-mon[32782]: pgmap v13039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:39 smithi196 ceph-mon[32572]: pgmap v13039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:41 smithi110 ceph-mon[28069]: pgmap v13040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:41 smithi193 ceph-mon[32782]: pgmap v13040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:41 smithi196 ceph-mon[32572]: pgmap v13040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23917.292992 secs 2024-04-26T18:26:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23917.292992 secs 2024-04-26T18:26:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23917.292992 secs 2024-04-26T18:26:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:43 smithi196 ceph-mon[32572]: pgmap v13041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:43.771 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:43 smithi193 ceph-mon[32782]: pgmap v13041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:43.771 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:43.959 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:43 smithi110 ceph-mon[28069]: pgmap v13041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:43.959 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:44.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:44 smithi193 ceph-mon[32782]: pgmap v13042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:44 smithi196 ceph-mon[32572]: pgmap v13042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:44 smithi110 ceph-mon[28069]: pgmap v13042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:26:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:26:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:26:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:26:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:46.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:46 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:26:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:46 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:26:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:46 smithi196 ceph-mon[32572]: pgmap v13043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:46 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:26:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:46 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:26:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:46 smithi110 ceph-mon[28069]: pgmap v13043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:46 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:26:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:46 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:26:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:46 smithi193 ceph-mon[32782]: pgmap v13043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:26:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23922.293080 secs 2024-04-26T18:26:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23922.293080 secs 2024-04-26T18:26:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23922.293080 secs 2024-04-26T18:26:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: pgmap v13044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:26:49.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: pgmap v13045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:49.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:26:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:26:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: pgmap v13044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:26:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: pgmap v13045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: pgmap v13044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: pgmap v13045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:26:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:50 smithi196 ceph-mon[32572]: pgmap v13046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:50 smithi110 ceph-mon[28069]: pgmap v13046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:50 smithi193 ceph-mon[32782]: pgmap v13046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:51 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23927.293226 secs 2024-04-26T18:26:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:51 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23927.293226 secs 2024-04-26T18:26:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:51 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23927.293226 secs 2024-04-26T18:26:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:52 smithi196 ceph-mon[32572]: pgmap v13047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T18:26:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:52 smithi110 ceph-mon[28069]: pgmap v13047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T18:26:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:52 smithi193 ceph-mon[32782]: pgmap v13047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T18:26:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:54 smithi196 ceph-mon[32572]: pgmap v13048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:54 smithi110 ceph-mon[28069]: pgmap v13048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:54 smithi193 ceph-mon[32782]: pgmap v13048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:56 smithi196 ceph-mon[32572]: pgmap v13049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23932.293347 secs 2024-04-26T18:26:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:56 smithi110 ceph-mon[28069]: pgmap v13049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23932.293347 secs 2024-04-26T18:26:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:56 smithi193 ceph-mon[32782]: pgmap v13049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:26:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23932.293347 secs 2024-04-26T18:26:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:26:58 smithi196 ceph-mon[32572]: pgmap v13050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:26:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:26:58 smithi110 ceph-mon[28069]: pgmap v13050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:26:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:26:58 smithi193 ceph-mon[32782]: pgmap v13050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:27:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:01 smithi196 ceph-mon[32572]: pgmap v13051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:01 smithi110 ceph-mon[28069]: pgmap v13051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:01 smithi193 ceph-mon[32782]: pgmap v13051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:02.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23937.293472 secs 2024-04-26T18:27:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23937.293472 secs 2024-04-26T18:27:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23937.293472 secs 2024-04-26T18:27:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:03 smithi110 ceph-mon[28069]: pgmap v13052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:03 smithi193 ceph-mon[32782]: pgmap v13052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:03 smithi196 ceph-mon[32572]: pgmap v13052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:05 smithi110 ceph-mon[28069]: pgmap v13053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:05 smithi193 ceph-mon[32782]: pgmap v13053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:05 smithi196 ceph-mon[32572]: pgmap v13053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:07 smithi110 ceph-mon[28069]: pgmap v13054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23942.293595 secs 2024-04-26T18:27:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:07 smithi193 ceph-mon[32782]: pgmap v13054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23942.293595 secs 2024-04-26T18:27:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:07 smithi196 ceph-mon[32572]: pgmap v13054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23942.293595 secs 2024-04-26T18:27:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:08 smithi193 ceph-mon[32782]: pgmap v13055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:08 smithi196 ceph-mon[32572]: pgmap v13055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:08 smithi110 ceph-mon[28069]: pgmap v13055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:10 smithi196 ceph-mon[32572]: pgmap v13056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:10 smithi110 ceph-mon[28069]: pgmap v13056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:10 smithi193 ceph-mon[32782]: pgmap v13056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:11 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23947.293682 secs 2024-04-26T18:27:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:11 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23947.293682 secs 2024-04-26T18:27:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:11 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23947.293682 secs 2024-04-26T18:27:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:12 smithi196 ceph-mon[32572]: pgmap v13057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:12 smithi110 ceph-mon[28069]: pgmap v13057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:12 smithi193 ceph-mon[32782]: pgmap v13057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:14 smithi196 ceph-mon[32572]: pgmap v13058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:14 smithi110 ceph-mon[28069]: pgmap v13058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:14 smithi193 ceph-mon[32782]: pgmap v13058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:17 smithi196 ceph-mon[32572]: pgmap v13059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23952.293837 secs 2024-04-26T18:27:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:17 smithi110 ceph-mon[28069]: pgmap v13059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23952.293837 secs 2024-04-26T18:27:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:17 smithi193 ceph-mon[32782]: pgmap v13059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23952.293837 secs 2024-04-26T18:27:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:19 smithi110 ceph-mon[28069]: pgmap v13060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:19 smithi193 ceph-mon[32782]: pgmap v13060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:19 smithi196 ceph-mon[32572]: pgmap v13060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:27:20.332+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:27:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:27:20.332+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:27:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:27:20.333+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 186 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:27:20.333 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:27:20.333+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 186 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:27:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:21 smithi110 ceph-mon[28069]: pgmap v13061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:21 smithi193 ceph-mon[32782]: pgmap v13061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:21 smithi196 ceph-mon[32572]: pgmap v13061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23957.293976 secs 2024-04-26T18:27:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23957.293976 secs 2024-04-26T18:27:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23957.293976 secs 2024-04-26T18:27:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:23 smithi110 ceph-mon[28069]: pgmap v13062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:23.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:23 smithi193 ceph-mon[32782]: pgmap v13062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:23 smithi196 ceph-mon[32572]: pgmap v13062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:25 smithi110 ceph-mon[28069]: pgmap v13063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:25 smithi193 ceph-mon[32782]: pgmap v13063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:25 smithi196 ceph-mon[32572]: pgmap v13063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:27 smithi110 ceph-mon[28069]: pgmap v13064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23962.294128 secs 2024-04-26T18:27:27.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:27 smithi196 ceph-mon[32572]: pgmap v13064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:27.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23962.294128 secs 2024-04-26T18:27:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:27 smithi193 ceph-mon[32782]: pgmap v13064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23962.294128 secs 2024-04-26T18:27:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:29 smithi110 ceph-mon[28069]: pgmap v13065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:29 smithi193 ceph-mon[32782]: pgmap v13065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:29 smithi196 ceph-mon[32572]: pgmap v13065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:31 smithi193 ceph-mon[32782]: pgmap v13066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:31 smithi196 ceph-mon[32572]: pgmap v13066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:31 smithi110 ceph-mon[28069]: pgmap v13066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23967.294266 secs 2024-04-26T18:27:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23967.294266 secs 2024-04-26T18:27:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23967.294266 secs 2024-04-26T18:27:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:33 smithi193 ceph-mon[32782]: pgmap v13067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:33 smithi196 ceph-mon[32572]: pgmap v13067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:33 smithi110 ceph-mon[28069]: pgmap v13067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:35 smithi193 ceph-mon[32782]: pgmap v13068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:35 smithi196 ceph-mon[32572]: pgmap v13068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:35 smithi110 ceph-mon[28069]: pgmap v13068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:37 smithi193 ceph-mon[32782]: pgmap v13069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23972.294399 secs 2024-04-26T18:27:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:37 smithi196 ceph-mon[32572]: pgmap v13069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23972.294399 secs 2024-04-26T18:27:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:37 smithi110 ceph-mon[28069]: pgmap v13069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23972.294399 secs 2024-04-26T18:27:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:39 smithi193 ceph-mon[32782]: pgmap v13070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:39 smithi196 ceph-mon[32572]: pgmap v13070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:39 smithi110 ceph-mon[28069]: pgmap v13070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:41 smithi193 ceph-mon[32782]: pgmap v13071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:41 smithi196 ceph-mon[32572]: pgmap v13071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:41 smithi110 ceph-mon[28069]: pgmap v13071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23977.294532 secs 2024-04-26T18:27:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23977.294532 secs 2024-04-26T18:27:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23977.294532 secs 2024-04-26T18:27:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:43 smithi193 ceph-mon[32782]: pgmap v13072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:43 smithi196 ceph-mon[32572]: pgmap v13072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:43 smithi110 ceph-mon[28069]: pgmap v13072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:45 smithi193 ceph-mon[32782]: pgmap v13073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:45 smithi196 ceph-mon[32572]: pgmap v13073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:45 smithi110 ceph-mon[28069]: pgmap v13073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:47 smithi193 ceph-mon[32782]: pgmap v13074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23982.294676 secs 2024-04-26T18:27:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:47 smithi196 ceph-mon[32572]: pgmap v13074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23982.294676 secs 2024-04-26T18:27:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:47 smithi110 ceph-mon[28069]: pgmap v13074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23982.294676 secs 2024-04-26T18:27:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:49 smithi193 ceph-mon[32782]: pgmap v13075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:49 smithi196 ceph-mon[32572]: pgmap v13075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:49 smithi110 ceph-mon[28069]: pgmap v13075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:27:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:51 smithi196 ceph-mon[32572]: pgmap v13076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:51 smithi193 ceph-mon[32782]: pgmap v13076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:51 smithi110 ceph-mon[28069]: pgmap v13076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:52.370 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23987.294731 secs 2024-04-26T18:27:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23987.294731 secs 2024-04-26T18:27:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23987.294731 secs 2024-04-26T18:27:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:53 smithi196 ceph-mon[32572]: pgmap v13077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:53 smithi110 ceph-mon[28069]: pgmap v13077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:53 smithi193 ceph-mon[32782]: pgmap v13077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:27:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:27:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:54 smithi196 ceph-mon[32572]: pgmap v13078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T18:27:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:54 smithi196 ceph-mon[32572]: pgmap v13079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:27:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:54 smithi110 ceph-mon[28069]: pgmap v13078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T18:27:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:54 smithi110 ceph-mon[28069]: pgmap v13079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:27:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:54 smithi193 ceph-mon[32782]: pgmap v13078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T18:27:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:54 smithi193 ceph-mon[32782]: pgmap v13079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:27:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:56 smithi196 ceph-mon[32572]: pgmap v13080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:27:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:56 smithi110 ceph-mon[28069]: pgmap v13080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:27:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:56 smithi193 ceph-mon[32782]: pgmap v13080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:27:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23992.294820 secs 2024-04-26T18:27:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23992.294820 secs 2024-04-26T18:27:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23992.294820 secs 2024-04-26T18:27:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:27:58 smithi196 ceph-mon[32572]: pgmap v13081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 588 B/s rd, 1 op/s 2024-04-26T18:27:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:27:58 smithi110 ceph-mon[28069]: pgmap v13081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 588 B/s rd, 1 op/s 2024-04-26T18:27:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:27:58 smithi193 ceph-mon[32782]: pgmap v13081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 588 B/s rd, 1 op/s 2024-04-26T18:28:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:00 smithi196 ceph-mon[32572]: pgmap v13082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:00 smithi110 ceph-mon[28069]: pgmap v13082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:00 smithi193 ceph-mon[32782]: pgmap v13082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:02 smithi196 ceph-mon[32572]: pgmap v13083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 23997.294938 secs 2024-04-26T18:28:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:02 smithi110 ceph-mon[28069]: pgmap v13083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 23997.294938 secs 2024-04-26T18:28:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:02 smithi193 ceph-mon[32782]: pgmap v13083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 23997.294938 secs 2024-04-26T18:28:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:04 smithi196 ceph-mon[32572]: pgmap v13084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:28:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:04 smithi110 ceph-mon[28069]: pgmap v13084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:28:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:04 smithi193 ceph-mon[32782]: pgmap v13084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:28:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:06 smithi196 ceph-mon[32572]: pgmap v13085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:06 smithi110 ceph-mon[28069]: pgmap v13085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:06 smithi193 ceph-mon[32782]: pgmap v13085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24002.295040 secs 2024-04-26T18:28:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24002.295040 secs 2024-04-26T18:28:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24002.295040 secs 2024-04-26T18:28:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:08 smithi110 ceph-mon[28069]: pgmap v13086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:08 smithi193 ceph-mon[32782]: pgmap v13086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:08 smithi196 ceph-mon[32572]: pgmap v13086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:10 smithi110 ceph-mon[28069]: pgmap v13087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:10 smithi193 ceph-mon[32782]: pgmap v13087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:10 smithi196 ceph-mon[32572]: pgmap v13087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:12 smithi110 ceph-mon[28069]: pgmap v13088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24007.295120 secs 2024-04-26T18:28:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:12 smithi193 ceph-mon[32782]: pgmap v13088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24007.295120 secs 2024-04-26T18:28:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:12 smithi196 ceph-mon[32572]: pgmap v13088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24007.295120 secs 2024-04-26T18:28:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:14 smithi110 ceph-mon[28069]: pgmap v13089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:14 smithi193 ceph-mon[32782]: pgmap v13089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:14 smithi196 ceph-mon[32572]: pgmap v13089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:16 smithi110 ceph-mon[28069]: pgmap v13090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:16 smithi193 ceph-mon[32782]: pgmap v13090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:16 smithi196 ceph-mon[32572]: pgmap v13090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24012.295268 secs 2024-04-26T18:28:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24012.295268 secs 2024-04-26T18:28:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24012.295268 secs 2024-04-26T18:28:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:18 smithi110 ceph-mon[28069]: pgmap v13091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:18 smithi193 ceph-mon[32782]: pgmap v13091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:18 smithi196 ceph-mon[32572]: pgmap v13091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:20 smithi193 ceph-mon[32782]: pgmap v13092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:20 smithi196 ceph-mon[32572]: pgmap v13092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:20 smithi110 ceph-mon[28069]: pgmap v13092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:22 smithi193 ceph-mon[32782]: pgmap v13093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24017.295414 secs 2024-04-26T18:28:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:22 smithi196 ceph-mon[32572]: pgmap v13093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24017.295414 secs 2024-04-26T18:28:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:22 smithi110 ceph-mon[28069]: pgmap v13093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24017.295414 secs 2024-04-26T18:28:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:24 smithi193 ceph-mon[32782]: pgmap v13094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:25.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:24 smithi196 ceph-mon[32572]: pgmap v13094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:24 smithi110 ceph-mon[28069]: pgmap v13094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:26 smithi193 ceph-mon[32782]: pgmap v13095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:26 smithi196 ceph-mon[32572]: pgmap v13095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:26 smithi110 ceph-mon[28069]: pgmap v13095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24022.295552 secs 2024-04-26T18:28:27.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24022.295552 secs 2024-04-26T18:28:27.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24022.295552 secs 2024-04-26T18:28:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:28 smithi193 ceph-mon[32782]: pgmap v13096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:28 smithi196 ceph-mon[32572]: pgmap v13096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:28 smithi110 ceph-mon[28069]: pgmap v13096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:29 smithi193 ceph-mon[32782]: pgmap v13097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:29 smithi196 ceph-mon[32572]: pgmap v13097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:29 smithi110 ceph-mon[28069]: pgmap v13097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:31 smithi196 ceph-mon[32572]: pgmap v13098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:31 smithi110 ceph-mon[28069]: pgmap v13098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:31 smithi193 ceph-mon[32782]: pgmap v13098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24027.295649 secs 2024-04-26T18:28:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24027.295649 secs 2024-04-26T18:28:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24027.295649 secs 2024-04-26T18:28:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:33 smithi196 ceph-mon[32572]: pgmap v13099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:33 smithi110 ceph-mon[28069]: pgmap v13099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:33 smithi193 ceph-mon[32782]: pgmap v13099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:35 smithi196 ceph-mon[32572]: pgmap v13100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:35 smithi110 ceph-mon[28069]: pgmap v13100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:35 smithi193 ceph-mon[32782]: pgmap v13100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24032.295768 secs 2024-04-26T18:28:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:37 smithi196 ceph-mon[32572]: pgmap v13101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24032.295768 secs 2024-04-26T18:28:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:37 smithi110 ceph-mon[28069]: pgmap v13101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24032.295768 secs 2024-04-26T18:28:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:37 smithi193 ceph-mon[32782]: pgmap v13101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:39 smithi196 ceph-mon[32572]: pgmap v13102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:39 smithi110 ceph-mon[28069]: pgmap v13102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:39 smithi193 ceph-mon[32782]: pgmap v13102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:41 smithi196 ceph-mon[32572]: pgmap v13103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:41 smithi110 ceph-mon[28069]: pgmap v13103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:41 smithi193 ceph-mon[32782]: pgmap v13103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24037.295890 secs 2024-04-26T18:28:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24037.295890 secs 2024-04-26T18:28:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24037.295890 secs 2024-04-26T18:28:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:43 smithi196 ceph-mon[32572]: pgmap v13104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:43 smithi110 ceph-mon[28069]: pgmap v13104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:43 smithi193 ceph-mon[32782]: pgmap v13104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:45 smithi196 ceph-mon[32572]: pgmap v13105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:45 smithi110 ceph-mon[28069]: pgmap v13105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:45 smithi193 ceph-mon[32782]: pgmap v13105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24042.296007 secs 2024-04-26T18:28:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:47 smithi110 ceph-mon[28069]: pgmap v13106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24042.296007 secs 2024-04-26T18:28:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:47 smithi193 ceph-mon[32782]: pgmap v13106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24042.296007 secs 2024-04-26T18:28:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:47 smithi196 ceph-mon[32572]: pgmap v13106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:49 smithi110 ceph-mon[28069]: pgmap v13107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:49 smithi193 ceph-mon[32782]: pgmap v13107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:49 smithi196 ceph-mon[32572]: pgmap v13107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:51 smithi110 ceph-mon[28069]: pgmap v13108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:51 smithi193 ceph-mon[32782]: pgmap v13108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:51 smithi196 ceph-mon[32572]: pgmap v13108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:28:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24047.296098 secs 2024-04-26T18:28:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24047.296098 secs 2024-04-26T18:28:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24047.296098 secs 2024-04-26T18:28:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:53 smithi110 ceph-mon[28069]: pgmap v13109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:53 smithi193 ceph-mon[32782]: pgmap v13109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:53 smithi196 ceph-mon[32572]: pgmap v13109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:28:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:54 smithi193 ceph-mon[32782]: pgmap v13110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T18:28:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:54 smithi193 ceph-mon[32782]: pgmap v13111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:28:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:54 smithi196 ceph-mon[32572]: pgmap v13110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T18:28:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:54 smithi196 ceph-mon[32572]: pgmap v13111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:28:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:54 smithi110 ceph-mon[28069]: pgmap v13110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T18:28:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:54 smithi110 ceph-mon[28069]: pgmap v13111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:28:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:57 smithi196 ceph-mon[32572]: pgmap v13112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24052.296238 secs 2024-04-26T18:28:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:57 smithi110 ceph-mon[28069]: pgmap v13112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24052.296238 secs 2024-04-26T18:28:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:57 smithi193 ceph-mon[32782]: pgmap v13112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24052.296238 secs 2024-04-26T18:28:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:28:59 smithi196 ceph-mon[32572]: pgmap v13113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:28:59 smithi110 ceph-mon[28069]: pgmap v13113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:28:59 smithi193 ceph-mon[32782]: pgmap v13113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:29:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:01 smithi196 ceph-mon[32572]: pgmap v13114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:29:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:01 smithi110 ceph-mon[28069]: pgmap v13114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:29:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:01 smithi193 ceph-mon[32782]: pgmap v13114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:29:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24057.296356 secs 2024-04-26T18:29:02.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24057.296356 secs 2024-04-26T18:29:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24057.296356 secs 2024-04-26T18:29:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:03 smithi196 ceph-mon[32572]: pgmap v13115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T18:29:03.538 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:03 smithi193 ceph-mon[32782]: pgmap v13115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T18:29:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:03 smithi110 ceph-mon[28069]: pgmap v13115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T18:29:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:05 smithi196 ceph-mon[32572]: pgmap v13116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:29:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:05 smithi110 ceph-mon[28069]: pgmap v13116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:29:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:05 smithi193 ceph-mon[32782]: pgmap v13116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:29:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:07 smithi196 ceph-mon[32572]: pgmap v13117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24062.296476 secs 2024-04-26T18:29:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:07 smithi110 ceph-mon[28069]: pgmap v13117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24062.296476 secs 2024-04-26T18:29:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:07 smithi193 ceph-mon[32782]: pgmap v13117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24062.296476 secs 2024-04-26T18:29:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:09 smithi196 ceph-mon[32572]: pgmap v13118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:09 smithi110 ceph-mon[28069]: pgmap v13118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:09 smithi193 ceph-mon[32782]: pgmap v13118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:11 smithi196 ceph-mon[32572]: pgmap v13119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:11 smithi110 ceph-mon[28069]: pgmap v13119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:11 smithi193 ceph-mon[32782]: pgmap v13119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:12.261 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:29:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:29:11.875+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:29:12.261 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:29:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:29:11.875+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:29:12.261 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:29:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:29:11.875+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:29:12.261 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:29:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:29:11.875+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:29:12.261 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:29:11 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:29:11.875+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:29:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24067.296613 secs 2024-04-26T18:29:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24067.296613 secs 2024-04-26T18:29:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24067.296613 secs 2024-04-26T18:29:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:13 smithi110 ceph-mon[28069]: pgmap v13120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:13 smithi193 ceph-mon[32782]: pgmap v13120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:13 smithi196 ceph-mon[32572]: pgmap v13120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:15 smithi110 ceph-mon[28069]: pgmap v13121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:15 smithi193 ceph-mon[32782]: pgmap v13121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:15 smithi196 ceph-mon[32572]: pgmap v13121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:17 smithi110 ceph-mon[28069]: pgmap v13122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24072.296731 secs 2024-04-26T18:29:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:17 smithi193 ceph-mon[32782]: pgmap v13122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24072.296731 secs 2024-04-26T18:29:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:17 smithi196 ceph-mon[32572]: pgmap v13122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24072.296731 secs 2024-04-26T18:29:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:19 smithi110 ceph-mon[28069]: pgmap v13123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:19 smithi193 ceph-mon[32782]: pgmap v13123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:19 smithi196 ceph-mon[32572]: pgmap v13123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:21 smithi110 ceph-mon[28069]: pgmap v13124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:21 smithi193 ceph-mon[32782]: pgmap v13124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:21 smithi196 ceph-mon[32572]: pgmap v13124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24077.296841 secs 2024-04-26T18:29:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24077.296841 secs 2024-04-26T18:29:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24077.296841 secs 2024-04-26T18:29:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:23 smithi193 ceph-mon[32782]: pgmap v13125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:23 smithi196 ceph-mon[32572]: pgmap v13125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:23 smithi110 ceph-mon[28069]: pgmap v13125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:25 smithi193 ceph-mon[32782]: pgmap v13126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:25 smithi196 ceph-mon[32572]: pgmap v13126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:25 smithi110 ceph-mon[28069]: pgmap v13126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:27.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:27 smithi196 ceph-mon[32572]: pgmap v13127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:27.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24082.296958 secs 2024-04-26T18:29:27.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:27 smithi110 ceph-mon[28069]: pgmap v13127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:27.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24082.296958 secs 2024-04-26T18:29:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:27 smithi193 ceph-mon[32782]: pgmap v13127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24082.296958 secs 2024-04-26T18:29:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:29 smithi193 ceph-mon[32782]: pgmap v13128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:29 smithi196 ceph-mon[32572]: pgmap v13128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:29 smithi110 ceph-mon[28069]: pgmap v13128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:31 smithi193 ceph-mon[32782]: pgmap v13129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:31 smithi196 ceph-mon[32572]: pgmap v13129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:31 smithi110 ceph-mon[28069]: pgmap v13129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24087.297103 secs 2024-04-26T18:29:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24087.297103 secs 2024-04-26T18:29:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24087.297103 secs 2024-04-26T18:29:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:33 smithi193 ceph-mon[32782]: pgmap v13130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:33 smithi196 ceph-mon[32572]: pgmap v13130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:33 smithi110 ceph-mon[28069]: pgmap v13130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:35 smithi193 ceph-mon[32782]: pgmap v13131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:35 smithi196 ceph-mon[32572]: pgmap v13131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:35 smithi110 ceph-mon[28069]: pgmap v13131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:37 smithi193 ceph-mon[32782]: pgmap v13132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24092.297225 secs 2024-04-26T18:29:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:37 smithi196 ceph-mon[32572]: pgmap v13132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24092.297225 secs 2024-04-26T18:29:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:37 smithi110 ceph-mon[28069]: pgmap v13132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24092.297225 secs 2024-04-26T18:29:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:39 smithi193 ceph-mon[32782]: pgmap v13133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:39 smithi196 ceph-mon[32572]: pgmap v13133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:39 smithi110 ceph-mon[28069]: pgmap v13133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:41 smithi193 ceph-mon[32782]: pgmap v13134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:41 smithi196 ceph-mon[32572]: pgmap v13134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:41 smithi110 ceph-mon[28069]: pgmap v13134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24097.297361 secs 2024-04-26T18:29:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24097.297361 secs 2024-04-26T18:29:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24097.297361 secs 2024-04-26T18:29:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:43 smithi193 ceph-mon[32782]: pgmap v13135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:43 smithi196 ceph-mon[32572]: pgmap v13135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:43 smithi110 ceph-mon[28069]: pgmap v13135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:45 smithi193 ceph-mon[32782]: pgmap v13136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:45 smithi196 ceph-mon[32572]: pgmap v13136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:45 smithi110 ceph-mon[28069]: pgmap v13136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:47 smithi196 ceph-mon[32572]: pgmap v13137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24102.297496 secs 2024-04-26T18:29:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:47 smithi110 ceph-mon[28069]: pgmap v13137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24102.297496 secs 2024-04-26T18:29:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:47 smithi193 ceph-mon[32782]: pgmap v13137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24102.297496 secs 2024-04-26T18:29:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:49 smithi196 ceph-mon[32572]: pgmap v13138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:49 smithi110 ceph-mon[28069]: pgmap v13138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:49 smithi193 ceph-mon[32782]: pgmap v13138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:51 smithi196 ceph-mon[32572]: pgmap v13139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:51 smithi110 ceph-mon[28069]: pgmap v13139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:51 smithi193 ceph-mon[32782]: pgmap v13139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24107.297646 secs 2024-04-26T18:29:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24107.297646 secs 2024-04-26T18:29:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24107.297646 secs 2024-04-26T18:29:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:53 smithi196 ceph-mon[32572]: pgmap v13140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:53 smithi110 ceph-mon[28069]: pgmap v13140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:53 smithi193 ceph-mon[32782]: pgmap v13140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:55 smithi196 ceph-mon[32572]: pgmap v13141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:55 smithi110 ceph-mon[28069]: pgmap v13141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:55 smithi193 ceph-mon[32782]: pgmap v13141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:57.640 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:57 smithi110 ceph-mon[28069]: pgmap v13142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:57.640 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24112.297713 secs 2024-04-26T18:29:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:57 smithi196 ceph-mon[32572]: pgmap v13142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24112.297713 secs 2024-04-26T18:29:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:57 smithi193 ceph-mon[32782]: pgmap v13142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:29:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24112.297713 secs 2024-04-26T18:29:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:29:59 smithi196 ceph-mon[32572]: pgmap v13143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:29:59 smithi110 ceph-mon[28069]: pgmap v13143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:29:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:29:59 smithi193 ceph-mon[32782]: pgmap v13143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:30:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:30:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:30:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:01 smithi196 ceph-mon[32572]: pgmap v13144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:30:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:30:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:30:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:01 smithi110 ceph-mon[28069]: pgmap v13144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:30:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:30:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:30:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:01 smithi193 ceph-mon[32782]: pgmap v13144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:30:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:30:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:30:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:02 smithi196 ceph-mon[32572]: pgmap v13145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 931 B/s rd, 1 op/s 2024-04-26T18:30:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:02 smithi196 ceph-mon[32572]: pgmap v13146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24117.297778 secs 2024-04-26T18:30:02.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:02 smithi193 ceph-mon[32782]: pgmap v13145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 931 B/s rd, 1 op/s 2024-04-26T18:30:02.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:02 smithi193 ceph-mon[32782]: pgmap v13146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:02.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24117.297778 secs 2024-04-26T18:30:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:02 smithi110 ceph-mon[28069]: pgmap v13145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 931 B/s rd, 1 op/s 2024-04-26T18:30:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:02 smithi110 ceph-mon[28069]: pgmap v13146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24117.297778 secs 2024-04-26T18:30:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:04 smithi196 ceph-mon[32572]: pgmap v13147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:04 smithi110 ceph-mon[28069]: pgmap v13147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:04 smithi193 ceph-mon[32782]: pgmap v13147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:06 smithi196 ceph-mon[32572]: pgmap v13148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:06.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:06 smithi110 ceph-mon[28069]: pgmap v13148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:06 smithi193 ceph-mon[32782]: pgmap v13148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24122.297929 secs 2024-04-26T18:30:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24122.297929 secs 2024-04-26T18:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24122.297929 secs 2024-04-26T18:30:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:08 smithi196 ceph-mon[32572]: pgmap v13149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 569 B/s rd, 1 op/s 2024-04-26T18:30:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:08 smithi110 ceph-mon[28069]: pgmap v13149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 569 B/s rd, 1 op/s 2024-04-26T18:30:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:08 smithi193 ceph-mon[32782]: pgmap v13149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 569 B/s rd, 1 op/s 2024-04-26T18:30:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:10 smithi196 ceph-mon[32572]: pgmap v13150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:10 smithi110 ceph-mon[28069]: pgmap v13150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:10 smithi193 ceph-mon[32782]: pgmap v13150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:30:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:12 smithi196 ceph-mon[32572]: pgmap v13151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:30:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24127.298017 secs 2024-04-26T18:30:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:12 smithi110 ceph-mon[28069]: pgmap v13151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:30:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24127.298017 secs 2024-04-26T18:30:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:12 smithi193 ceph-mon[32782]: pgmap v13151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:30:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24127.298017 secs 2024-04-26T18:30:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:14 smithi196 ceph-mon[32572]: pgmap v13152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:14 smithi110 ceph-mon[28069]: pgmap v13152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:14 smithi193 ceph-mon[32782]: pgmap v13152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:16 smithi196 ceph-mon[32572]: pgmap v13153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:16 smithi110 ceph-mon[28069]: pgmap v13153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:16 smithi193 ceph-mon[32782]: pgmap v13153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24132.298138 secs 2024-04-26T18:30:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24132.298138 secs 2024-04-26T18:30:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24132.298138 secs 2024-04-26T18:30:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:18 smithi196 ceph-mon[32572]: pgmap v13154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:18 smithi110 ceph-mon[28069]: pgmap v13154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:18 smithi193 ceph-mon[32782]: pgmap v13154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:30:20.362+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:30:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:30:20.362+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:30:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:30:20.363+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 187 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:30:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:30:20.363+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 187 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:30:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:20 smithi196 ceph-mon[32572]: pgmap v13155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:20 smithi110 ceph-mon[28069]: pgmap v13155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:20 smithi193 ceph-mon[32782]: pgmap v13155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:22 smithi196 ceph-mon[32572]: pgmap v13156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24137.298283 secs 2024-04-26T18:30:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:22 smithi110 ceph-mon[28069]: pgmap v13156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24137.298283 secs 2024-04-26T18:30:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:22 smithi193 ceph-mon[32782]: pgmap v13156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24137.298283 secs 2024-04-26T18:30:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:24 smithi196 ceph-mon[32572]: pgmap v13157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:24 smithi110 ceph-mon[28069]: pgmap v13157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:24 smithi193 ceph-mon[32782]: pgmap v13157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:26 smithi196 ceph-mon[32572]: pgmap v13158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:26 smithi110 ceph-mon[28069]: pgmap v13158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:26 smithi193 ceph-mon[32782]: pgmap v13158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24142.298420 secs 2024-04-26T18:30:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24142.298420 secs 2024-04-26T18:30:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24142.298420 secs 2024-04-26T18:30:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:28 smithi110 ceph-mon[28069]: pgmap v13159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:28 smithi193 ceph-mon[32782]: pgmap v13159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:28 smithi196 ceph-mon[32572]: pgmap v13159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:30 smithi110 ceph-mon[28069]: pgmap v13160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:30 smithi193 ceph-mon[32782]: pgmap v13160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:30 smithi196 ceph-mon[32572]: pgmap v13160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:32 smithi110 ceph-mon[28069]: pgmap v13161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24147.298546 secs 2024-04-26T18:30:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:32 smithi193 ceph-mon[32782]: pgmap v13161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24147.298546 secs 2024-04-26T18:30:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:32 smithi196 ceph-mon[32572]: pgmap v13161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24147.298546 secs 2024-04-26T18:30:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:34 smithi110 ceph-mon[28069]: pgmap v13162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:34 smithi193 ceph-mon[32782]: pgmap v13162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:34 smithi196 ceph-mon[32572]: pgmap v13162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:36 smithi110 ceph-mon[28069]: pgmap v13163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:36 smithi193 ceph-mon[32782]: pgmap v13163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:36 smithi196 ceph-mon[32572]: pgmap v13163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24152.298667 secs 2024-04-26T18:30:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24152.298667 secs 2024-04-26T18:30:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24152.298667 secs 2024-04-26T18:30:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:38 smithi193 ceph-mon[32782]: pgmap v13164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:38 smithi196 ceph-mon[32572]: pgmap v13164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:38 smithi110 ceph-mon[28069]: pgmap v13164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:40 smithi110 ceph-mon[28069]: pgmap v13165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:40 smithi193 ceph-mon[32782]: pgmap v13165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:40 smithi196 ceph-mon[32572]: pgmap v13165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:42 smithi193 ceph-mon[32782]: pgmap v13166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24157.298805 secs 2024-04-26T18:30:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:42 smithi196 ceph-mon[32572]: pgmap v13166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24157.298805 secs 2024-04-26T18:30:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:42 smithi110 ceph-mon[28069]: pgmap v13166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24157.298805 secs 2024-04-26T18:30:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:44 smithi193 ceph-mon[32782]: pgmap v13167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:44 smithi196 ceph-mon[32572]: pgmap v13167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:44 smithi110 ceph-mon[28069]: pgmap v13167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:46 smithi193 ceph-mon[32782]: pgmap v13168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:46 smithi196 ceph-mon[32572]: pgmap v13168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:46 smithi110 ceph-mon[28069]: pgmap v13168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24162.298878 secs 2024-04-26T18:30:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24162.298878 secs 2024-04-26T18:30:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24162.298878 secs 2024-04-26T18:30:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:48 smithi193 ceph-mon[32782]: pgmap v13169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:48 smithi196 ceph-mon[32572]: pgmap v13169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:48 smithi110 ceph-mon[28069]: pgmap v13169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:50 smithi193 ceph-mon[32782]: pgmap v13170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:50 smithi196 ceph-mon[32572]: pgmap v13170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:50 smithi110 ceph-mon[28069]: pgmap v13170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:52 smithi193 ceph-mon[32782]: pgmap v13171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24167.298943 secs 2024-04-26T18:30:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:52 smithi196 ceph-mon[32572]: pgmap v13171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24167.298943 secs 2024-04-26T18:30:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:52 smithi110 ceph-mon[28069]: pgmap v13171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24167.298943 secs 2024-04-26T18:30:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:54 smithi193 ceph-mon[32782]: pgmap v13172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:54 smithi196 ceph-mon[32572]: pgmap v13172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:54 smithi110 ceph-mon[28069]: pgmap v13172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:55 smithi193 ceph-mon[32782]: pgmap v13173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:55 smithi196 ceph-mon[32572]: pgmap v13173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:55 smithi110 ceph-mon[28069]: pgmap v13173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:56 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24172.299061 secs 2024-04-26T18:30:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:56 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24172.299061 secs 2024-04-26T18:30:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:56 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24172.299061 secs 2024-04-26T18:30:58.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:30:57 smithi110 ceph-mon[28069]: pgmap v13174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:30:57 smithi196 ceph-mon[32572]: pgmap v13174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:30:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:30:57 smithi193 ceph-mon[32782]: pgmap v13174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:00 smithi196 ceph-mon[32572]: pgmap v13175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:00 smithi110 ceph-mon[28069]: pgmap v13175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:00 smithi193 ceph-mon[32782]: pgmap v13175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:02 smithi110 ceph-mon[28069]: pgmap v13176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24177.299157 secs 2024-04-26T18:31:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:02 smithi193 ceph-mon[32782]: pgmap v13176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24177.299157 secs 2024-04-26T18:31:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:02 smithi196 ceph-mon[32572]: pgmap v13176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:02.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24177.299157 secs 2024-04-26T18:31:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:31:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:31:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:31:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:04 smithi110 ceph-mon[28069]: pgmap v13177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:31:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:04 smithi110 ceph-mon[28069]: pgmap v13178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:04 smithi193 ceph-mon[32782]: pgmap v13177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:31:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:04 smithi193 ceph-mon[32782]: pgmap v13178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:04 smithi196 ceph-mon[32572]: pgmap v13177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:31:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:04 smithi196 ceph-mon[32572]: pgmap v13178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:06 smithi110 ceph-mon[28069]: pgmap v13179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:06 smithi193 ceph-mon[32782]: pgmap v13179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:06 smithi196 ceph-mon[32572]: pgmap v13179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24182.299295 secs 2024-04-26T18:31:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24182.299295 secs 2024-04-26T18:31:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24182.299295 secs 2024-04-26T18:31:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:08 smithi193 ceph-mon[32782]: pgmap v13180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:08 smithi196 ceph-mon[32572]: pgmap v13180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:08 smithi110 ceph-mon[28069]: pgmap v13180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:10 smithi193 ceph-mon[32782]: pgmap v13181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:10 smithi196 ceph-mon[32572]: pgmap v13181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:10 smithi110 ceph-mon[28069]: pgmap v13181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:12 smithi193 ceph-mon[32782]: pgmap v13182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24187.299412 secs 2024-04-26T18:31:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:12 smithi196 ceph-mon[32572]: pgmap v13182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24187.299412 secs 2024-04-26T18:31:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:12 smithi110 ceph-mon[28069]: pgmap v13182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24187.299412 secs 2024-04-26T18:31:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:14 smithi193 ceph-mon[32782]: pgmap v13183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:31:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:14 smithi196 ceph-mon[32572]: pgmap v13183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:31:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:14 smithi110 ceph-mon[28069]: pgmap v13183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:31:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:16 smithi193 ceph-mon[32782]: pgmap v13184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:16 smithi196 ceph-mon[32572]: pgmap v13184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:16 smithi110 ceph-mon[28069]: pgmap v13184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24192.299537 secs 2024-04-26T18:31:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24192.299537 secs 2024-04-26T18:31:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24192.299537 secs 2024-04-26T18:31:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:18 smithi193 ceph-mon[32782]: pgmap v13185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:18 smithi196 ceph-mon[32572]: pgmap v13185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:18 smithi110 ceph-mon[28069]: pgmap v13185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:20 smithi193 ceph-mon[32782]: pgmap v13186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:20 smithi196 ceph-mon[32572]: pgmap v13186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:20 smithi110 ceph-mon[28069]: pgmap v13186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:22 smithi193 ceph-mon[32782]: pgmap v13187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24197.299668 secs 2024-04-26T18:31:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:22 smithi196 ceph-mon[32572]: pgmap v13187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24197.299668 secs 2024-04-26T18:31:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:22 smithi110 ceph-mon[28069]: pgmap v13187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24197.299668 secs 2024-04-26T18:31:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:24 smithi193 ceph-mon[32782]: pgmap v13188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:24 smithi196 ceph-mon[32572]: pgmap v13188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:24 smithi110 ceph-mon[28069]: pgmap v13188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:26 smithi193 ceph-mon[32782]: pgmap v13189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:26 smithi196 ceph-mon[32572]: pgmap v13189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:26 smithi110 ceph-mon[28069]: pgmap v13189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24202.299786 secs 2024-04-26T18:31:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24202.299786 secs 2024-04-26T18:31:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24202.299786 secs 2024-04-26T18:31:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:28 smithi193 ceph-mon[32782]: pgmap v13190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:28.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:28 smithi196 ceph-mon[32572]: pgmap v13190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:28.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:28 smithi110 ceph-mon[28069]: pgmap v13190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:30 smithi193 ceph-mon[32782]: pgmap v13191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:30 smithi196 ceph-mon[32572]: pgmap v13191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:30 smithi110 ceph-mon[28069]: pgmap v13191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:32 smithi196 ceph-mon[32572]: pgmap v13192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24207.299903 secs 2024-04-26T18:31:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:32 smithi110 ceph-mon[28069]: pgmap v13192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24207.299903 secs 2024-04-26T18:31:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:32 smithi193 ceph-mon[32782]: pgmap v13192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24207.299903 secs 2024-04-26T18:31:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:34 smithi196 ceph-mon[32572]: pgmap v13193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:34 smithi110 ceph-mon[28069]: pgmap v13193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:34 smithi193 ceph-mon[32782]: pgmap v13193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:36 smithi196 ceph-mon[32572]: pgmap v13194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:36 smithi110 ceph-mon[28069]: pgmap v13194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:36 smithi193 ceph-mon[32782]: pgmap v13194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24212.300025 secs 2024-04-26T18:31:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24212.300025 secs 2024-04-26T18:31:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24212.300025 secs 2024-04-26T18:31:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:38 smithi196 ceph-mon[32572]: pgmap v13195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:38 smithi110 ceph-mon[28069]: pgmap v13195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:38 smithi193 ceph-mon[32782]: pgmap v13195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:40 smithi196 ceph-mon[32572]: pgmap v13196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:40 smithi110 ceph-mon[28069]: pgmap v13196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:40 smithi193 ceph-mon[32782]: pgmap v13196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:42 smithi196 ceph-mon[32572]: pgmap v13197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24217.300164 secs 2024-04-26T18:31:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:42 smithi110 ceph-mon[28069]: pgmap v13197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24217.300164 secs 2024-04-26T18:31:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:42 smithi193 ceph-mon[32782]: pgmap v13197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24217.300164 secs 2024-04-26T18:31:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:44 smithi196 ceph-mon[32572]: pgmap v13198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:44 smithi110 ceph-mon[28069]: pgmap v13198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:44 smithi193 ceph-mon[32782]: pgmap v13198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:46 smithi196 ceph-mon[32572]: pgmap v13199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:46 smithi110 ceph-mon[28069]: pgmap v13199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:46 smithi193 ceph-mon[32782]: pgmap v13199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24222.300305 secs 2024-04-26T18:31:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24222.300305 secs 2024-04-26T18:31:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24222.300305 secs 2024-04-26T18:31:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:48 smithi196 ceph-mon[32572]: pgmap v13200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:48 smithi110 ceph-mon[28069]: pgmap v13200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:48 smithi193 ceph-mon[32782]: pgmap v13200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:50 smithi196 ceph-mon[32572]: pgmap v13201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:50 smithi110 ceph-mon[28069]: pgmap v13201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:50 smithi193 ceph-mon[32782]: pgmap v13201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:52 smithi196 ceph-mon[32572]: pgmap v13202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24227.300449 secs 2024-04-26T18:31:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:52 smithi110 ceph-mon[28069]: pgmap v13202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24227.300449 secs 2024-04-26T18:31:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:52 smithi193 ceph-mon[32782]: pgmap v13202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24227.300449 secs 2024-04-26T18:31:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:54 smithi196 ceph-mon[32572]: pgmap v13203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:54 smithi110 ceph-mon[28069]: pgmap v13203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:54 smithi193 ceph-mon[32782]: pgmap v13203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:31:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:56 smithi196 ceph-mon[32572]: pgmap v13204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:56 smithi110 ceph-mon[28069]: pgmap v13204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:56 smithi193 ceph-mon[32782]: pgmap v13204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24232.300590 secs 2024-04-26T18:31:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24232.300590 secs 2024-04-26T18:31:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24232.300590 secs 2024-04-26T18:31:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:31:58 smithi196 ceph-mon[32572]: pgmap v13205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:31:58 smithi110 ceph-mon[28069]: pgmap v13205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:31:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:31:58 smithi193 ceph-mon[32782]: pgmap v13205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:00 smithi196 ceph-mon[32572]: pgmap v13206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:00 smithi110 ceph-mon[28069]: pgmap v13206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:00 smithi193 ceph-mon[32782]: pgmap v13206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:02 smithi196 ceph-mon[32572]: pgmap v13207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24237.300681 secs 2024-04-26T18:32:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:02 smithi110 ceph-mon[28069]: pgmap v13207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24237.300681 secs 2024-04-26T18:32:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:02 smithi193 ceph-mon[32782]: pgmap v13207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24237.300681 secs 2024-04-26T18:32:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:04 smithi196 ceph-mon[32572]: pgmap v13208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:32:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:04 smithi110 ceph-mon[28069]: pgmap v13208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:32:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:04 smithi193 ceph-mon[32782]: pgmap v13208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:32:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:05 smithi196 ceph-mon[32572]: pgmap v13209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:32:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:05 smithi196 ceph-mon[32572]: pgmap v13210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:32:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:05 smithi110 ceph-mon[28069]: pgmap v13209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:32:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:05 smithi110 ceph-mon[28069]: pgmap v13210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:32:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:05 smithi193 ceph-mon[32782]: pgmap v13209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:32:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:05 smithi193 ceph-mon[32782]: pgmap v13210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:32:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:07 smithi196 ceph-mon[32572]: pgmap v13211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:32:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24242.300747 secs 2024-04-26T18:32:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:07 smithi110 ceph-mon[28069]: pgmap v13211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:32:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24242.300747 secs 2024-04-26T18:32:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:07 smithi193 ceph-mon[32782]: pgmap v13211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:32:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24242.300747 secs 2024-04-26T18:32:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:09 smithi110 ceph-mon[28069]: pgmap v13212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:32:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:09 smithi193 ceph-mon[32782]: pgmap v13212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:32:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:09 smithi196 ceph-mon[32572]: pgmap v13212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:32:11.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:11 smithi110 ceph-mon[28069]: pgmap v13213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:32:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:11 smithi193 ceph-mon[32782]: pgmap v13213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:32:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:11 smithi196 ceph-mon[32572]: pgmap v13213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 966 B/s rd, 1 op/s 2024-04-26T18:32:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24247.300860 secs 2024-04-26T18:32:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24247.300860 secs 2024-04-26T18:32:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24247.300860 secs 2024-04-26T18:32:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:13 smithi110 ceph-mon[28069]: pgmap v13214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 429 B/s rd, 1 op/s 2024-04-26T18:32:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:13 smithi193 ceph-mon[32782]: pgmap v13214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 429 B/s rd, 1 op/s 2024-04-26T18:32:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:13 smithi196 ceph-mon[32572]: pgmap v13214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 429 B/s rd, 1 op/s 2024-04-26T18:32:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:15 smithi110 ceph-mon[28069]: pgmap v13215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T18:32:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:15 smithi193 ceph-mon[32782]: pgmap v13215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T18:32:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:15 smithi196 ceph-mon[32572]: pgmap v13215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T18:32:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:17 smithi110 ceph-mon[28069]: pgmap v13216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:32:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24252.300981 secs 2024-04-26T18:32:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:17 smithi193 ceph-mon[32782]: pgmap v13216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:32:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24252.300981 secs 2024-04-26T18:32:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:17 smithi196 ceph-mon[32572]: pgmap v13216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:32:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24252.300981 secs 2024-04-26T18:32:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:19 smithi110 ceph-mon[28069]: pgmap v13217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:19 smithi193 ceph-mon[32782]: pgmap v13217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:19 smithi196 ceph-mon[32572]: pgmap v13217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:21 smithi193 ceph-mon[32782]: pgmap v13218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:21 smithi196 ceph-mon[32572]: pgmap v13218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:21 smithi110 ceph-mon[28069]: pgmap v13218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24257.301115 secs 2024-04-26T18:32:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24257.301115 secs 2024-04-26T18:32:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24257.301115 secs 2024-04-26T18:32:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:23 smithi193 ceph-mon[32782]: pgmap v13219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:23 smithi196 ceph-mon[32572]: pgmap v13219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:23 smithi110 ceph-mon[28069]: pgmap v13219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:25 smithi193 ceph-mon[32782]: pgmap v13220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:25 smithi196 ceph-mon[32572]: pgmap v13220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:25 smithi110 ceph-mon[28069]: pgmap v13220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:27 smithi193 ceph-mon[32782]: pgmap v13221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24262.301240 secs 2024-04-26T18:32:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:27 smithi196 ceph-mon[32572]: pgmap v13221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24262.301240 secs 2024-04-26T18:32:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:27 smithi110 ceph-mon[28069]: pgmap v13221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24262.301240 secs 2024-04-26T18:32:29.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:29 smithi110 ceph-mon[28069]: pgmap v13222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:29 smithi193 ceph-mon[32782]: pgmap v13222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:29 smithi196 ceph-mon[32572]: pgmap v13222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:31 smithi193 ceph-mon[32782]: pgmap v13223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:31 smithi196 ceph-mon[32572]: pgmap v13223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:31 smithi110 ceph-mon[28069]: pgmap v13223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24267.301360 secs 2024-04-26T18:32:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24267.301360 secs 2024-04-26T18:32:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24267.301360 secs 2024-04-26T18:32:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:33 smithi193 ceph-mon[32782]: pgmap v13224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:33 smithi196 ceph-mon[32572]: pgmap v13224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:33 smithi110 ceph-mon[28069]: pgmap v13224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:32:35.384+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:32:35.384 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:32:35.384+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:32:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:32:35.384+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 188 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:32:35.385 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:32:35.384+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 188 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:32:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:35 smithi193 ceph-mon[32782]: pgmap v13225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:35 smithi196 ceph-mon[32572]: pgmap v13225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:35 smithi110 ceph-mon[28069]: pgmap v13225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:37 smithi193 ceph-mon[32782]: pgmap v13226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24272.301426 secs 2024-04-26T18:32:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:37 smithi196 ceph-mon[32572]: pgmap v13226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24272.301426 secs 2024-04-26T18:32:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:37 smithi110 ceph-mon[28069]: pgmap v13226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24272.301426 secs 2024-04-26T18:32:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:39 smithi193 ceph-mon[32782]: pgmap v13227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:39 smithi196 ceph-mon[32572]: pgmap v13227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:39 smithi110 ceph-mon[28069]: pgmap v13227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:41 smithi193 ceph-mon[32782]: pgmap v13228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:41 smithi196 ceph-mon[32572]: pgmap v13228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:41 smithi110 ceph-mon[28069]: pgmap v13228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24277.301579 secs 2024-04-26T18:32:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24277.301579 secs 2024-04-26T18:32:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24277.301579 secs 2024-04-26T18:32:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:43 smithi196 ceph-mon[32572]: pgmap v13229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:43 smithi110 ceph-mon[28069]: pgmap v13229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:43 smithi193 ceph-mon[32782]: pgmap v13229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:44 smithi196 ceph-mon[32572]: pgmap v13230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:44 smithi110 ceph-mon[28069]: pgmap v13230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:44 smithi193 ceph-mon[32782]: pgmap v13230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:47 smithi193 ceph-mon[32782]: pgmap v13231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24282.301704 secs 2024-04-26T18:32:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:47 smithi196 ceph-mon[32572]: pgmap v13231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24282.301704 secs 2024-04-26T18:32:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:47 smithi110 ceph-mon[28069]: pgmap v13231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24282.301704 secs 2024-04-26T18:32:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:49 smithi193 ceph-mon[32782]: pgmap v13232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:49 smithi196 ceph-mon[32572]: pgmap v13232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:49 smithi110 ceph-mon[28069]: pgmap v13232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:51 smithi193 ceph-mon[32782]: pgmap v13233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:51 smithi196 ceph-mon[32572]: pgmap v13233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:51 smithi110 ceph-mon[28069]: pgmap v13233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24287.301777 secs 2024-04-26T18:32:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24287.301777 secs 2024-04-26T18:32:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24287.301777 secs 2024-04-26T18:32:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:53 smithi193 ceph-mon[32782]: pgmap v13234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:53 smithi196 ceph-mon[32572]: pgmap v13234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:53 smithi110 ceph-mon[28069]: pgmap v13234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:32:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:55 smithi193 ceph-mon[32782]: pgmap v13235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:55 smithi196 ceph-mon[32572]: pgmap v13235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:55 smithi110 ceph-mon[28069]: pgmap v13235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:57 smithi193 ceph-mon[32782]: pgmap v13236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24292.301873 secs 2024-04-26T18:32:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:57 smithi196 ceph-mon[32572]: pgmap v13236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24292.301873 secs 2024-04-26T18:32:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:57 smithi110 ceph-mon[28069]: pgmap v13236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:32:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24292.301873 secs 2024-04-26T18:32:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:32:59 smithi193 ceph-mon[32782]: pgmap v13237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:32:59 smithi196 ceph-mon[32572]: pgmap v13237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:32:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:32:59 smithi110 ceph-mon[28069]: pgmap v13237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:01 smithi193 ceph-mon[32782]: pgmap v13238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:01 smithi196 ceph-mon[32572]: pgmap v13238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:01 smithi110 ceph-mon[28069]: pgmap v13238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24297.301998 secs 2024-04-26T18:33:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24297.301998 secs 2024-04-26T18:33:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24297.301998 secs 2024-04-26T18:33:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:03 smithi196 ceph-mon[32572]: pgmap v13239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:33:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:03 smithi110 ceph-mon[28069]: pgmap v13239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:33:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:03 smithi193 ceph-mon[32782]: pgmap v13239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:33:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:05 smithi196 ceph-mon[32572]: pgmap v13240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:33:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:05 smithi110 ceph-mon[28069]: pgmap v13240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:33:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:05 smithi193 ceph-mon[32782]: pgmap v13240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:33:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:33:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:33:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:33:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:33:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:33:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:33:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:33:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:33:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:33:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:07 smithi196 ceph-mon[32572]: pgmap v13241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:33:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:07 smithi196 ceph-mon[32572]: pgmap v13242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24302.302116 secs 2024-04-26T18:33:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:07 smithi110 ceph-mon[28069]: pgmap v13241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:33:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:07 smithi110 ceph-mon[28069]: pgmap v13242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24302.302116 secs 2024-04-26T18:33:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:07 smithi193 ceph-mon[32782]: pgmap v13241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:33:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:07 smithi193 ceph-mon[32782]: pgmap v13242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24302.302116 secs 2024-04-26T18:33:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:09 smithi196 ceph-mon[32572]: pgmap v13243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:09 smithi110 ceph-mon[28069]: pgmap v13243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:09 smithi193 ceph-mon[32782]: pgmap v13243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:11 smithi196 ceph-mon[32572]: pgmap v13244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:11 smithi110 ceph-mon[28069]: pgmap v13244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:11 smithi193 ceph-mon[32782]: pgmap v13244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24307.302234 secs 2024-04-26T18:33:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24307.302234 secs 2024-04-26T18:33:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24307.302234 secs 2024-04-26T18:33:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:13 smithi196 ceph-mon[32572]: pgmap v13245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:33:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:13 smithi110 ceph-mon[28069]: pgmap v13245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:33:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:13 smithi193 ceph-mon[32782]: pgmap v13245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:33:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:15 smithi196 ceph-mon[32572]: pgmap v13246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:15 smithi110 ceph-mon[28069]: pgmap v13246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:15 smithi193 ceph-mon[32782]: pgmap v13246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:33:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.444+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T18:33:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.444+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:33:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.444+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:33:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.444+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T18:33:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.444+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.445+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T18:33:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.445+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T18:33:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.447+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T18:33:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.447+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T18:33:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.447+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614037040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:33:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.447+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614037040 comp rx=0 tx=0).stop 2024-04-26T18:33:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.447+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T18:33:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.447+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T18:33:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.447+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.447+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.448+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:16.449+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614037040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:17 smithi196 ceph-mon[32572]: pgmap v13247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:17 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24312.302353 secs 2024-04-26T18:33:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:17 smithi110 ceph-mon[28069]: pgmap v13247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:33:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:17 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24312.302353 secs 2024-04-26T18:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:17 smithi193 ceph-mon[32782]: pgmap v13247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:17 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24312.302353 secs 2024-04-26T18:33:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:19 smithi196 ceph-mon[32572]: pgmap v13248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:19 smithi110 ceph-mon[28069]: pgmap v13248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:19 smithi193 ceph-mon[32782]: pgmap v13248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:20.392+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:33:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:20.392+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:33:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:20.392+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 189 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:33:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:33:20.392+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 189 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:33:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:21 smithi196 ceph-mon[32572]: pgmap v13249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:21.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:21 smithi110 ceph-mon[28069]: pgmap v13249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:21 smithi193 ceph-mon[32782]: pgmap v13249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:22 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24317.302481 secs 2024-04-26T18:33:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:22 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24317.302481 secs 2024-04-26T18:33:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:22 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24317.302481 secs 2024-04-26T18:33:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:23 smithi196 ceph-mon[32572]: pgmap v13250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:23 smithi110 ceph-mon[28069]: pgmap v13250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:23 smithi193 ceph-mon[32782]: pgmap v13250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:25 smithi196 ceph-mon[32572]: pgmap v13251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:25 smithi110 ceph-mon[28069]: pgmap v13251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:25 smithi193 ceph-mon[32782]: pgmap v13251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:27 smithi196 ceph-mon[32572]: pgmap v13252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:27 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24322.302601 secs 2024-04-26T18:33:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:27 smithi110 ceph-mon[28069]: pgmap v13252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:27 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24322.302601 secs 2024-04-26T18:33:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:27 smithi193 ceph-mon[32782]: pgmap v13252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:27 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24322.302601 secs 2024-04-26T18:33:29.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:29 smithi196 ceph-mon[32572]: pgmap v13253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:29 smithi110 ceph-mon[28069]: pgmap v13253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:29 smithi193 ceph-mon[32782]: pgmap v13253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:31 smithi196 ceph-mon[32572]: pgmap v13254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:31 smithi110 ceph-mon[28069]: pgmap v13254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:31 smithi193 ceph-mon[32782]: pgmap v13254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:32 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24327.302719 secs 2024-04-26T18:33:32.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:32 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24327.302719 secs 2024-04-26T18:33:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:32 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24327.302719 secs 2024-04-26T18:33:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:33 smithi196 ceph-mon[32572]: pgmap v13255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:33 smithi110 ceph-mon[28069]: pgmap v13255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:33 smithi193 ceph-mon[32782]: pgmap v13255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:35 smithi196 ceph-mon[32572]: pgmap v13256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:35 smithi110 ceph-mon[28069]: pgmap v13256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:35 smithi193 ceph-mon[32782]: pgmap v13256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:37 smithi196 ceph-mon[32572]: pgmap v13257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:37 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24332.302838 secs 2024-04-26T18:33:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:37 smithi110 ceph-mon[28069]: pgmap v13257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:37 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24332.302838 secs 2024-04-26T18:33:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:37 smithi193 ceph-mon[32782]: pgmap v13257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:37 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24332.302838 secs 2024-04-26T18:33:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:39 smithi196 ceph-mon[32572]: pgmap v13258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:39 smithi110 ceph-mon[28069]: pgmap v13258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:39 smithi193 ceph-mon[32782]: pgmap v13258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:41 smithi110 ceph-mon[28069]: pgmap v13259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:41 smithi193 ceph-mon[32782]: pgmap v13259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:41 smithi196 ceph-mon[32572]: pgmap v13259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:42 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24337.302947 secs 2024-04-26T18:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:42 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24337.302947 secs 2024-04-26T18:33:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:42 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24337.302947 secs 2024-04-26T18:33:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:43 smithi110 ceph-mon[28069]: pgmap v13260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:43.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:43 smithi193 ceph-mon[32782]: pgmap v13260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:43 smithi196 ceph-mon[32572]: pgmap v13260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:45 smithi110 ceph-mon[28069]: pgmap v13261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:45 smithi193 ceph-mon[32782]: pgmap v13261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:45 smithi196 ceph-mon[32572]: pgmap v13261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:47 smithi110 ceph-mon[28069]: pgmap v13262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:47 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24342.303066 secs 2024-04-26T18:33:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:47 smithi193 ceph-mon[32782]: pgmap v13262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:47 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24342.303066 secs 2024-04-26T18:33:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:47 smithi196 ceph-mon[32572]: pgmap v13262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:47 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24342.303066 secs 2024-04-26T18:33:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:49 smithi110 ceph-mon[28069]: pgmap v13263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:49 smithi193 ceph-mon[32782]: pgmap v13263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:49 smithi196 ceph-mon[32572]: pgmap v13263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:51 smithi110 ceph-mon[28069]: pgmap v13264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:51 smithi193 ceph-mon[32782]: pgmap v13264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:51 smithi196 ceph-mon[32572]: pgmap v13264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:52 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24347.303183 secs 2024-04-26T18:33:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:52 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24347.303183 secs 2024-04-26T18:33:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:52 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24347.303183 secs 2024-04-26T18:33:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:53 smithi193 ceph-mon[32782]: pgmap v13265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:53 smithi196 ceph-mon[32572]: pgmap v13265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:53 smithi110 ceph-mon[28069]: pgmap v13265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:55 smithi193 ceph-mon[32782]: pgmap v13266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:55 smithi196 ceph-mon[32572]: pgmap v13266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:55 smithi110 ceph-mon[28069]: pgmap v13266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:57 smithi193 ceph-mon[32782]: pgmap v13267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:57 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24352.303307 secs 2024-04-26T18:33:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:57 smithi196 ceph-mon[32572]: pgmap v13267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:57 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24352.303307 secs 2024-04-26T18:33:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:57 smithi110 ceph-mon[28069]: pgmap v13267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:33:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:57 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24352.303307 secs 2024-04-26T18:33:59.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:33:59 smithi110 ceph-mon[28069]: pgmap v13268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:33:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:33:59 smithi193 ceph-mon[32782]: pgmap v13268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:33:59 smithi196 ceph-mon[32572]: pgmap v13268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:01 smithi193 ceph-mon[32782]: pgmap v13269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:01 smithi196 ceph-mon[32572]: pgmap v13269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:01 smithi110 ceph-mon[28069]: pgmap v13269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:02 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24357.303435 secs 2024-04-26T18:34:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:02 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24357.303435 secs 2024-04-26T18:34:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:02 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24357.303435 secs 2024-04-26T18:34:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:03 smithi193 ceph-mon[32782]: pgmap v13270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:03 smithi196 ceph-mon[32572]: pgmap v13270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:03 smithi110 ceph-mon[28069]: pgmap v13270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:05 smithi193 ceph-mon[32782]: pgmap v13271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:05 smithi196 ceph-mon[32572]: pgmap v13271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:05 smithi110 ceph-mon[28069]: pgmap v13271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:34:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:34:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:34:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:07 smithi193 ceph-mon[32782]: pgmap v13272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:07 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24362.303506 secs 2024-04-26T18:34:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:07 smithi196 ceph-mon[32572]: pgmap v13272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:07 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24362.303506 secs 2024-04-26T18:34:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:07 smithi110 ceph-mon[28069]: pgmap v13272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:07 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24362.303506 secs 2024-04-26T18:34:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:09 smithi196 ceph-mon[32572]: pgmap v13273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:34:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:34:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:09 smithi196 ceph-mon[32572]: pgmap v13274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T18:34:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:09 smithi196 ceph-mon[32572]: pgmap v13275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:09 smithi110 ceph-mon[28069]: pgmap v13273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:34:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:34:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:09 smithi110 ceph-mon[28069]: pgmap v13274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T18:34:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:09 smithi110 ceph-mon[28069]: pgmap v13275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:09 smithi193 ceph-mon[32782]: pgmap v13273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:34:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:34:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:09 smithi193 ceph-mon[32782]: pgmap v13274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T18:34:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:09 smithi193 ceph-mon[32782]: pgmap v13275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:34:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:11 smithi110 ceph-mon[28069]: pgmap v13276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:11 smithi193 ceph-mon[32782]: pgmap v13276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:11 smithi196 ceph-mon[32572]: pgmap v13276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:12 smithi110 ceph-mon[28069]: 20 slow requests, 0 included below; oldest blocked for > 24367.303589 secs 2024-04-26T18:34:12.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:34:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:34:12.074+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:34:12.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:34:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:34:12.074+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:34:12.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:34:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:34:12.074+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:34:12.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:34:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:34:12.074+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:34:12.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:34:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:34:12.074+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:34:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:12 smithi193 ceph-mon[32782]: 20 slow requests, 0 included below; oldest blocked for > 24367.303589 secs 2024-04-26T18:34:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:12 smithi196 ceph-mon[32572]: 20 slow requests, 0 included below; oldest blocked for > 24367.303589 secs 2024-04-26T18:34:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:13 smithi193 ceph-mon[32782]: pgmap v13277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T18:34:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:13 smithi196 ceph-mon[32572]: pgmap v13277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T18:34:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:13 smithi110 ceph-mon[28069]: pgmap v13277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T18:34:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:15 smithi193 ceph-mon[32782]: pgmap v13278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 B/s wr, 18 op/s 2024-04-26T18:34:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:15 smithi196 ceph-mon[32572]: pgmap v13278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 B/s wr, 18 op/s 2024-04-26T18:34:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:15 smithi110 ceph-mon[28069]: pgmap v13278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 244 B/s wr, 18 op/s 2024-04-26T18:34:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:17 smithi193 ceph-mon[32782]: pgmap v13279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 244 B/s wr, 17 op/s 2024-04-26T18:34:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:17 smithi196 ceph-mon[32572]: pgmap v13279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 244 B/s wr, 17 op/s 2024-04-26T18:34:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:17 smithi110 ceph-mon[28069]: pgmap v13279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 244 B/s wr, 17 op/s 2024-04-26T18:34:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:18 smithi193 ceph-mon[32782]: MDS health message cleared (mds.?): 20 slow requests are blocked > 180 secs 2024-04-26T18:34:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:18 smithi196 ceph-mon[32572]: MDS health message cleared (mds.?): 20 slow requests are blocked > 180 secs 2024-04-26T18:34:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:18 smithi110 ceph-mon[28069]: MDS health message cleared (mds.?): 20 slow requests are blocked > 180 secs 2024-04-26T18:34:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:19 smithi193 ceph-mon[32782]: pgmap v13280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T18:34:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:19 smithi193 ceph-mon[32782]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-04-26T18:34:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T18:34:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T18:34:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:19 smithi196 ceph-mon[32572]: pgmap v13280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T18:34:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:19 smithi196 ceph-mon[32572]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-04-26T18:34:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T18:34:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T18:34:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:19 smithi110 ceph-mon[28069]: pgmap v13280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T18:34:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:19 smithi110 ceph-mon[28069]: Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2024-04-26T18:34:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T18:34:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T18:34:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:21 smithi193 ceph-mon[32782]: pgmap v13281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:34:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:21 smithi196 ceph-mon[32572]: pgmap v13281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:34:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:21 smithi110 ceph-mon[28069]: pgmap v13281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:34:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:23 smithi193 ceph-mon[32782]: pgmap v13282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:34:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:23 smithi196 ceph-mon[32572]: pgmap v13282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:34:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:23 smithi110 ceph-mon[28069]: pgmap v13282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:34:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:25 smithi193 ceph-mon[32782]: pgmap v13283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:34:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:25 smithi196 ceph-mon[32572]: pgmap v13283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:34:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:25 smithi110 ceph-mon[28069]: pgmap v13283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:34:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:27 smithi193 ceph-mon[32782]: pgmap v13284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T18:34:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:27 smithi196 ceph-mon[32572]: pgmap v13284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T18:34:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:27 smithi110 ceph-mon[28069]: pgmap v13284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T18:34:29.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:29 smithi110 ceph-mon[28069]: pgmap v13285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:34:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:29 smithi193 ceph-mon[32782]: pgmap v13285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:34:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:29 smithi196 ceph-mon[32572]: pgmap v13285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:34:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:31 smithi193 ceph-mon[32782]: pgmap v13286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:31 smithi196 ceph-mon[32572]: pgmap v13286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:31 smithi110 ceph-mon[28069]: pgmap v13286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:33 smithi193 ceph-mon[32782]: pgmap v13287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:33 smithi196 ceph-mon[32572]: pgmap v13287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:33 smithi110 ceph-mon[28069]: pgmap v13287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:35 smithi193 ceph-mon[32782]: pgmap v13288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:35 smithi196 ceph-mon[32572]: pgmap v13288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:35.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:35 smithi110 ceph-mon[28069]: pgmap v13288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:37 smithi193 ceph-mon[32782]: pgmap v13289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:37 smithi196 ceph-mon[32572]: pgmap v13289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:37 smithi110 ceph-mon[28069]: pgmap v13289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:39 smithi196 ceph-mon[32572]: pgmap v13290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:39 smithi110 ceph-mon[28069]: pgmap v13290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:39 smithi193 ceph-mon[32782]: pgmap v13290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:41 smithi196 ceph-mon[32572]: pgmap v13291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:41 smithi110 ceph-mon[28069]: pgmap v13291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:41 smithi193 ceph-mon[32782]: pgmap v13291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:43 smithi196 ceph-mon[32572]: pgmap v13292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:43 smithi110 ceph-mon[28069]: pgmap v13292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:43 smithi193 ceph-mon[32782]: pgmap v13292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:45 smithi196 ceph-mon[32572]: pgmap v13293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:45 smithi110 ceph-mon[28069]: pgmap v13293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:45 smithi193 ceph-mon[32782]: pgmap v13293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:47 smithi196 ceph-mon[32572]: pgmap v13294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:47 smithi110 ceph-mon[28069]: pgmap v13294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:47 smithi193 ceph-mon[32782]: pgmap v13294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:49 smithi196 ceph-mon[32572]: pgmap v13295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:49 smithi110 ceph-mon[28069]: pgmap v13295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:49 smithi193 ceph-mon[32782]: pgmap v13295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:51 smithi196 ceph-mon[32572]: pgmap v13296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:51 smithi110 ceph-mon[28069]: pgmap v13296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:51 smithi193 ceph-mon[32782]: pgmap v13296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:53 smithi196 ceph-mon[32572]: pgmap v13297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:53 smithi110 ceph-mon[28069]: pgmap v13297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:53 smithi193 ceph-mon[32782]: pgmap v13297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:55 smithi196 ceph-mon[32572]: pgmap v13298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:55 smithi110 ceph-mon[28069]: pgmap v13298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:55 smithi193 ceph-mon[32782]: pgmap v13298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:57 smithi196 ceph-mon[32572]: pgmap v13299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:57 smithi110 ceph-mon[28069]: pgmap v13299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:57 smithi193 ceph-mon[32782]: pgmap v13299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:34:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:34:59 smithi196 ceph-mon[32572]: pgmap v13300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:34:59 smithi110 ceph-mon[28069]: pgmap v13300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:34:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:34:59 smithi193 ceph-mon[32782]: pgmap v13300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:01 smithi196 ceph-mon[32572]: pgmap v13301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:01 smithi110 ceph-mon[28069]: pgmap v13301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:01 smithi193 ceph-mon[32782]: pgmap v13301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:03 smithi196 ceph-mon[32572]: pgmap v13302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:03 smithi110 ceph-mon[28069]: pgmap v13302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:03 smithi193 ceph-mon[32782]: pgmap v13302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:05 smithi196 ceph-mon[32572]: pgmap v13303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:35:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:05 smithi110 ceph-mon[28069]: pgmap v13303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:35:05.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:05 smithi193 ceph-mon[32782]: pgmap v13303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:35:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:07 smithi196 ceph-mon[32572]: pgmap v13304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:35:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:07 smithi110 ceph-mon[28069]: pgmap v13304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:35:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:07 smithi193 ceph-mon[32782]: pgmap v13304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:35:09.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:09 smithi196 ceph-mon[32572]: pgmap v13305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:35:09.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:35:09.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:35:09.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:35:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:09 smithi110 ceph-mon[28069]: pgmap v13305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:35:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:35:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:35:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:35:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:09 smithi193 ceph-mon[32782]: pgmap v13305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:35:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:35:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:35:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:35:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:11 smithi196 ceph-mon[32572]: pgmap v13306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:35:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:35:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:35:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:11 smithi196 ceph-mon[32572]: pgmap v13307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:35:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:11 smithi196 ceph-mon[32572]: pgmap v13308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:35:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:35:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:11 smithi110 ceph-mon[28069]: pgmap v13306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:35:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:35:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:35:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:11 smithi110 ceph-mon[28069]: pgmap v13307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:35:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:11 smithi110 ceph-mon[28069]: pgmap v13308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:35:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:35:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:11 smithi193 ceph-mon[32782]: pgmap v13306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:35:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:35:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:35:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:11 smithi193 ceph-mon[32782]: pgmap v13307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:35:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:11 smithi193 ceph-mon[32782]: pgmap v13308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:35:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:35:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:13 smithi196 ceph-mon[32572]: pgmap v13309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:13 smithi110 ceph-mon[28069]: pgmap v13309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:13 smithi193 ceph-mon[32782]: pgmap v13309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:15 smithi196 ceph-mon[32572]: pgmap v13310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:15 smithi110 ceph-mon[28069]: pgmap v13310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:15 smithi193 ceph-mon[32782]: pgmap v13310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:17 smithi196 ceph-mon[32572]: pgmap v13311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T18:35:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:17 smithi110 ceph-mon[28069]: pgmap v13311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T18:35:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:17 smithi193 ceph-mon[32782]: pgmap v13311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T18:35:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:20 smithi110 ceph-mon[28069]: pgmap v13312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:20 smithi193 ceph-mon[32782]: pgmap v13312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:20 smithi196 ceph-mon[32572]: pgmap v13312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:22 smithi110 ceph-mon[28069]: pgmap v13313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:35:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:22 smithi193 ceph-mon[32782]: pgmap v13313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:35:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:22 smithi196 ceph-mon[32572]: pgmap v13313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:35:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:24 smithi110 ceph-mon[28069]: pgmap v13314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:24 smithi193 ceph-mon[32782]: pgmap v13314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:24 smithi196 ceph-mon[32572]: pgmap v13314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:26 smithi110 ceph-mon[28069]: pgmap v13315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:26 smithi193 ceph-mon[32782]: pgmap v13315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:26 smithi196 ceph-mon[32572]: pgmap v13315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:28 smithi193 ceph-mon[32782]: pgmap v13316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:28 smithi196 ceph-mon[32572]: pgmap v13316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:28 smithi110 ceph-mon[28069]: pgmap v13316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:30.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:30 smithi196 ceph-mon[32572]: pgmap v13317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:30.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:30 smithi110 ceph-mon[28069]: pgmap v13317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:30 smithi193 ceph-mon[32782]: pgmap v13317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:32 smithi193 ceph-mon[32782]: pgmap v13318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:32 smithi196 ceph-mon[32572]: pgmap v13318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:32 smithi110 ceph-mon[28069]: pgmap v13318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:34 smithi193 ceph-mon[32782]: pgmap v13319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:34 smithi196 ceph-mon[32572]: pgmap v13319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:34.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:34 smithi110 ceph-mon[28069]: pgmap v13319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:36 smithi193 ceph-mon[32782]: pgmap v13320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:36 smithi196 ceph-mon[32572]: pgmap v13320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:36 smithi110 ceph-mon[28069]: pgmap v13320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:38 smithi193 ceph-mon[32782]: pgmap v13321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:38 smithi196 ceph-mon[32572]: pgmap v13321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:38 smithi110 ceph-mon[28069]: pgmap v13321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:40 smithi193 ceph-mon[32782]: pgmap v13322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:40 smithi196 ceph-mon[32572]: pgmap v13322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:40 smithi110 ceph-mon[28069]: pgmap v13322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:42 smithi193 ceph-mon[32782]: pgmap v13323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:42 smithi196 ceph-mon[32572]: pgmap v13323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:42 smithi110 ceph-mon[28069]: pgmap v13323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:44 smithi193 ceph-mon[32782]: pgmap v13324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:44 smithi196 ceph-mon[32572]: pgmap v13324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:44 smithi110 ceph-mon[28069]: pgmap v13324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:46 smithi193 ceph-mon[32782]: pgmap v13325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:46 smithi196 ceph-mon[32572]: pgmap v13325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:46 smithi110 ceph-mon[28069]: pgmap v13325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:48 smithi193 ceph-mon[32782]: pgmap v13326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:48 smithi196 ceph-mon[32572]: pgmap v13326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:48 smithi110 ceph-mon[28069]: pgmap v13326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:50 smithi193 ceph-mon[32782]: pgmap v13327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:50 smithi196 ceph-mon[32572]: pgmap v13327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:50 smithi110 ceph-mon[28069]: pgmap v13327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:52 smithi193 ceph-mon[32782]: pgmap v13328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:52 smithi196 ceph-mon[32572]: pgmap v13328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:52 smithi110 ceph-mon[28069]: pgmap v13328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:54 smithi193 ceph-mon[32782]: pgmap v13329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:54 smithi196 ceph-mon[32572]: pgmap v13329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:54 smithi110 ceph-mon[28069]: pgmap v13329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:35:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:56 smithi193 ceph-mon[32782]: pgmap v13330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:56 smithi196 ceph-mon[32572]: pgmap v13330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:56 smithi110 ceph-mon[28069]: pgmap v13330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:35:58 smithi193 ceph-mon[32782]: pgmap v13331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:35:58 smithi196 ceph-mon[32572]: pgmap v13331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:35:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:35:58 smithi110 ceph-mon[28069]: pgmap v13331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:00 smithi196 ceph-mon[32572]: pgmap v13332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:00 smithi110 ceph-mon[28069]: pgmap v13332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:00 smithi193 ceph-mon[32782]: pgmap v13332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:02 smithi196 ceph-mon[32572]: pgmap v13333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:02 smithi110 ceph-mon[28069]: pgmap v13333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:02 smithi193 ceph-mon[32782]: pgmap v13333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:04.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:04 smithi193 ceph-mon[32782]: pgmap v13334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:04 smithi196 ceph-mon[32572]: pgmap v13334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:04 smithi110 ceph-mon[28069]: pgmap v13334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:06 smithi196 ceph-mon[32572]: pgmap v13335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:06 smithi110 ceph-mon[28069]: pgmap v13335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:06 smithi193 ceph-mon[32782]: pgmap v13335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:08 smithi196 ceph-mon[32572]: pgmap v13336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:08 smithi110 ceph-mon[28069]: pgmap v13336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:08 smithi193 ceph-mon[32782]: pgmap v13336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:10 smithi196 ceph-mon[32572]: pgmap v13337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:10 smithi110 ceph-mon[28069]: pgmap v13337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:10 smithi193 ceph-mon[32782]: pgmap v13337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:12 smithi196 ceph-mon[32572]: pgmap v13338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:12 smithi110 ceph-mon[28069]: pgmap v13338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:12 smithi193 ceph-mon[32782]: pgmap v13338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:36:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:13 smithi196 ceph-mon[32572]: pgmap v13339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T18:36:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:13 smithi196 ceph-mon[32572]: pgmap v13340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:36:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:13 smithi110 ceph-mon[28069]: pgmap v13339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T18:36:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:13 smithi110 ceph-mon[28069]: pgmap v13340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:36:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:13 smithi193 ceph-mon[32782]: pgmap v13339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T18:36:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:13 smithi193 ceph-mon[32782]: pgmap v13340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:36:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:15 smithi196 ceph-mon[32572]: pgmap v13341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:15 smithi110 ceph-mon[28069]: pgmap v13341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:15 smithi193 ceph-mon[32782]: pgmap v13341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:17 smithi196 ceph-mon[32572]: pgmap v13342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:17 smithi110 ceph-mon[28069]: pgmap v13342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:17 smithi193 ceph-mon[32782]: pgmap v13342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:19 smithi196 ceph-mon[32572]: pgmap v13343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:19 smithi110 ceph-mon[28069]: pgmap v13343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:19 smithi193 ceph-mon[32782]: pgmap v13343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:36:20.420+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:36:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:36:20.420+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:36:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:36:20.421+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 190 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:36:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:36:20.421+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 190 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:36:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:21 smithi110 ceph-mon[28069]: pgmap v13344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:21 smithi193 ceph-mon[32782]: pgmap v13344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:21 smithi196 ceph-mon[32572]: pgmap v13344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:36:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:23 smithi110 ceph-mon[28069]: pgmap v13345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:36:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:23 smithi193 ceph-mon[32782]: pgmap v13345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:36:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:23 smithi196 ceph-mon[32572]: pgmap v13345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:36:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:25 smithi110 ceph-mon[28069]: pgmap v13346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:25 smithi193 ceph-mon[32782]: pgmap v13346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:25 smithi196 ceph-mon[32572]: pgmap v13346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:27 smithi110 ceph-mon[28069]: pgmap v13347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:27 smithi193 ceph-mon[32782]: pgmap v13347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:27 smithi196 ceph-mon[32572]: pgmap v13347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:29 smithi110 ceph-mon[28069]: pgmap v13348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:29 smithi193 ceph-mon[32782]: pgmap v13348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:29 smithi196 ceph-mon[32572]: pgmap v13348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:31 smithi110 ceph-mon[28069]: pgmap v13349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:31.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:31 smithi196 ceph-mon[32572]: pgmap v13349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:31 smithi193 ceph-mon[32782]: pgmap v13349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:33 smithi110 ceph-mon[28069]: pgmap v13350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:36:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:33 smithi193 ceph-mon[32782]: pgmap v13350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:36:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:33 smithi196 ceph-mon[32572]: pgmap v13350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:36:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:35 smithi193 ceph-mon[32782]: pgmap v13351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:35 smithi196 ceph-mon[32572]: pgmap v13351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:35 smithi110 ceph-mon[28069]: pgmap v13351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:37 smithi193 ceph-mon[32782]: pgmap v13352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:37 smithi196 ceph-mon[32572]: pgmap v13352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:37 smithi110 ceph-mon[28069]: pgmap v13352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:39 smithi193 ceph-mon[32782]: pgmap v13353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:39 smithi196 ceph-mon[32572]: pgmap v13353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:39 smithi110 ceph-mon[28069]: pgmap v13353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:41 smithi193 ceph-mon[32782]: pgmap v13354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:41 smithi196 ceph-mon[32572]: pgmap v13354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:41 smithi110 ceph-mon[28069]: pgmap v13354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:43 smithi193 ceph-mon[32782]: pgmap v13355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:36:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:43 smithi196 ceph-mon[32572]: pgmap v13355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:36:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:43 smithi110 ceph-mon[28069]: pgmap v13355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:36:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:45 smithi193 ceph-mon[32782]: pgmap v13356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:45 smithi196 ceph-mon[32572]: pgmap v13356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:45 smithi110 ceph-mon[28069]: pgmap v13356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:47 smithi193 ceph-mon[32782]: pgmap v13357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:47 smithi196 ceph-mon[32572]: pgmap v13357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:47 smithi110 ceph-mon[28069]: pgmap v13357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:49 smithi193 ceph-mon[32782]: pgmap v13358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:49 smithi196 ceph-mon[32572]: pgmap v13358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:49 smithi110 ceph-mon[28069]: pgmap v13358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:51 smithi193 ceph-mon[32782]: pgmap v13359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:51 smithi196 ceph-mon[32572]: pgmap v13359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:51 smithi110 ceph-mon[28069]: pgmap v13359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:53 smithi193 ceph-mon[32782]: pgmap v13360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:36:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:53 smithi196 ceph-mon[32572]: pgmap v13360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:36:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:53 smithi110 ceph-mon[28069]: pgmap v13360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:36:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:55 smithi193 ceph-mon[32782]: pgmap v13361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:55 smithi196 ceph-mon[32572]: pgmap v13361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:55 smithi110 ceph-mon[28069]: pgmap v13361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:36:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:57 smithi193 ceph-mon[32782]: pgmap v13362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:57 smithi196 ceph-mon[32572]: pgmap v13362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:57 smithi110 ceph-mon[28069]: pgmap v13362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:36:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:36:59 smithi193 ceph-mon[32782]: pgmap v13363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:36:59 smithi196 ceph-mon[32572]: pgmap v13363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:36:59 smithi110 ceph-mon[28069]: pgmap v13363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:01 smithi193 ceph-mon[32782]: pgmap v13364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:01 smithi196 ceph-mon[32572]: pgmap v13364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:01 smithi110 ceph-mon[28069]: pgmap v13364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:03 smithi193 ceph-mon[32782]: pgmap v13365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:37:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:03 smithi196 ceph-mon[32572]: pgmap v13365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:37:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:03 smithi110 ceph-mon[28069]: pgmap v13365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:37:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:05 smithi193 ceph-mon[32782]: pgmap v13366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:05 smithi196 ceph-mon[32572]: pgmap v13366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:05 smithi110 ceph-mon[28069]: pgmap v13366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:07 smithi196 ceph-mon[32572]: pgmap v13367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:07 smithi110 ceph-mon[28069]: pgmap v13367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:07 smithi193 ceph-mon[32782]: pgmap v13367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:09 smithi196 ceph-mon[32572]: pgmap v13368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:09 smithi110 ceph-mon[28069]: pgmap v13368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:09 smithi193 ceph-mon[32782]: pgmap v13368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:11 smithi196 ceph-mon[32572]: pgmap v13369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:11 smithi110 ceph-mon[28069]: pgmap v13369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:11 smithi193 ceph-mon[32782]: pgmap v13369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:37:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:37:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:37:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:13 smithi196 ceph-mon[32572]: pgmap v13370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:37:14.004 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:13 smithi110 ceph-mon[28069]: pgmap v13370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:37:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:13 smithi193 ceph-mon[32782]: pgmap v13370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:37:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: pgmap v13371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: pgmap v13371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: pgmap v13371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:16.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:16 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:37:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:16 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:37:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:16 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:37:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:16 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:37:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:16 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:37:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:16 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:37:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:16 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:37:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:16 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:37:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:16 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:37:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:16 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:37:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:16 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:37:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:16 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:37:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:17 smithi196 ceph-mon[32572]: pgmap v13372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:17 smithi196 ceph-mon[32572]: 21 slow requests, 2 included below; oldest blocked for > 24552.307908 secs 2024-04-26T18:37:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:17 smithi196 ceph-mon[32572]: slow request 184.523471 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:37:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:17 smithi196 ceph-mon[32572]: slow request 2885.860898 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:37:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:17 smithi110 ceph-mon[28069]: pgmap v13372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:17 smithi110 ceph-mon[28069]: 21 slow requests, 2 included below; oldest blocked for > 24552.307908 secs 2024-04-26T18:37:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:17 smithi110 ceph-mon[28069]: slow request 184.523471 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:37:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:17 smithi110 ceph-mon[28069]: slow request 2885.860898 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:37:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:17 smithi193 ceph-mon[32782]: pgmap v13372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:17 smithi193 ceph-mon[32782]: 21 slow requests, 2 included below; oldest blocked for > 24552.307908 secs 2024-04-26T18:37:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:17 smithi193 ceph-mon[32782]: slow request 184.523471 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:37:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:17 smithi193 ceph-mon[32782]: slow request 2885.860898 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:37:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T18:37:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:37:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T18:37:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T18:37:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:37:19.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T18:37:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T18:37:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T18:37:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:37:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:37:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:19 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:37:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:19 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:37:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:19 smithi196 ceph-mon[32572]: pgmap v13373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:37:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:19 smithi196 ceph-mon[32572]: pgmap v13374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:19 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:37:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:19 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:37:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:19 smithi110 ceph-mon[28069]: pgmap v13373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:37:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:19 smithi110 ceph-mon[28069]: pgmap v13374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:19 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:37:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:19 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:37:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:19 smithi193 ceph-mon[32782]: pgmap v13373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:37:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:19 smithi193 ceph-mon[32782]: pgmap v13374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:21 smithi196 ceph-mon[32572]: pgmap v13375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:21 smithi110 ceph-mon[28069]: pgmap v13375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:21 smithi193 ceph-mon[32782]: pgmap v13375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24557.308022 secs 2024-04-26T18:37:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24557.308022 secs 2024-04-26T18:37:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24557.308022 secs 2024-04-26T18:37:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:23 smithi196 ceph-mon[32572]: pgmap v13376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:37:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:23 smithi110 ceph-mon[28069]: pgmap v13376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:37:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:23 smithi193 ceph-mon[32782]: pgmap v13376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:37:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:24 smithi196 ceph-mon[32572]: pgmap v13377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:24 smithi110 ceph-mon[28069]: pgmap v13377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:24 smithi193 ceph-mon[32782]: pgmap v13377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:27 smithi110 ceph-mon[28069]: pgmap v13378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24562.308154 secs 2024-04-26T18:37:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:27 smithi193 ceph-mon[32782]: pgmap v13378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24562.308154 secs 2024-04-26T18:37:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:27 smithi196 ceph-mon[32572]: pgmap v13378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:37:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24562.308154 secs 2024-04-26T18:37:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:29 smithi110 ceph-mon[28069]: pgmap v13379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:37:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:29 smithi193 ceph-mon[32782]: pgmap v13379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:37:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:29 smithi196 ceph-mon[32572]: pgmap v13379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:37:31.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:31 smithi196 ceph-mon[32572]: pgmap v13380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:31 smithi193 ceph-mon[32782]: pgmap v13380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:31.472 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:31 smithi110 ceph-mon[28069]: pgmap v13380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24567.308275 secs 2024-04-26T18:37:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24567.308275 secs 2024-04-26T18:37:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24567.308275 secs 2024-04-26T18:37:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:33 smithi193 ceph-mon[32782]: pgmap v13381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:33 smithi196 ceph-mon[32572]: pgmap v13381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:33 smithi110 ceph-mon[28069]: pgmap v13381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:35 smithi193 ceph-mon[32782]: pgmap v13382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:35 smithi196 ceph-mon[32572]: pgmap v13382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:35 smithi110 ceph-mon[28069]: pgmap v13382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:37 smithi193 ceph-mon[32782]: pgmap v13383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24572.308387 secs 2024-04-26T18:37:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:37 smithi196 ceph-mon[32572]: pgmap v13383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24572.308387 secs 2024-04-26T18:37:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:37 smithi110 ceph-mon[28069]: pgmap v13383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24572.308387 secs 2024-04-26T18:37:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:39 smithi193 ceph-mon[32782]: pgmap v13384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:39 smithi196 ceph-mon[32572]: pgmap v13384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:39 smithi110 ceph-mon[28069]: pgmap v13384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:41 smithi193 ceph-mon[32782]: pgmap v13385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:41 smithi196 ceph-mon[32572]: pgmap v13385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:41 smithi110 ceph-mon[28069]: pgmap v13385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24577.308509 secs 2024-04-26T18:37:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24577.308509 secs 2024-04-26T18:37:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24577.308509 secs 2024-04-26T18:37:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:43 smithi193 ceph-mon[32782]: pgmap v13386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:43 smithi196 ceph-mon[32572]: pgmap v13386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:43 smithi110 ceph-mon[28069]: pgmap v13386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:45 smithi193 ceph-mon[32782]: pgmap v13387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:45 smithi196 ceph-mon[32572]: pgmap v13387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:45 smithi110 ceph-mon[28069]: pgmap v13387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:47 smithi193 ceph-mon[32782]: pgmap v13388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24582.308627 secs 2024-04-26T18:37:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:47 smithi196 ceph-mon[32572]: pgmap v13388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24582.308627 secs 2024-04-26T18:37:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:47 smithi110 ceph-mon[28069]: pgmap v13388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24582.308627 secs 2024-04-26T18:37:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:49 smithi193 ceph-mon[32782]: pgmap v13389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:49 smithi196 ceph-mon[32572]: pgmap v13389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:49 smithi110 ceph-mon[28069]: pgmap v13389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:51 smithi193 ceph-mon[32782]: pgmap v13390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:51 smithi196 ceph-mon[32572]: pgmap v13390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:51 smithi110 ceph-mon[28069]: pgmap v13390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24587.308722 secs 2024-04-26T18:37:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24587.308722 secs 2024-04-26T18:37:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24587.308722 secs 2024-04-26T18:37:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:53 smithi196 ceph-mon[32572]: pgmap v13391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:53 smithi110 ceph-mon[28069]: pgmap v13391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:53 smithi193 ceph-mon[32782]: pgmap v13391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:55 smithi196 ceph-mon[32572]: pgmap v13392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:55 smithi110 ceph-mon[28069]: pgmap v13392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:55 smithi193 ceph-mon[32782]: pgmap v13392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:57 smithi196 ceph-mon[32572]: pgmap v13393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24592.308849 secs 2024-04-26T18:37:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:57 smithi110 ceph-mon[28069]: pgmap v13393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24592.308849 secs 2024-04-26T18:37:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:57 smithi193 ceph-mon[32782]: pgmap v13393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:37:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24592.308849 secs 2024-04-26T18:37:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:37:59 smithi196 ceph-mon[32572]: pgmap v13394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:37:59 smithi110 ceph-mon[28069]: pgmap v13394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:37:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:37:59 smithi193 ceph-mon[32782]: pgmap v13394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:01 smithi196 ceph-mon[32572]: pgmap v13395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:01 smithi110 ceph-mon[28069]: pgmap v13395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:01 smithi193 ceph-mon[32782]: pgmap v13395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24597.308970 secs 2024-04-26T18:38:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24597.308970 secs 2024-04-26T18:38:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24597.308970 secs 2024-04-26T18:38:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:03 smithi196 ceph-mon[32572]: pgmap v13396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:03 smithi110 ceph-mon[28069]: pgmap v13396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:03 smithi193 ceph-mon[32782]: pgmap v13396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:05.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:05 smithi193 ceph-mon[32782]: pgmap v13397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:05 smithi196 ceph-mon[32572]: pgmap v13397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:05 smithi110 ceph-mon[28069]: pgmap v13397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:07 smithi196 ceph-mon[32572]: pgmap v13398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24602.309115 secs 2024-04-26T18:38:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:07 smithi110 ceph-mon[28069]: pgmap v13398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24602.309115 secs 2024-04-26T18:38:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:07 smithi193 ceph-mon[32782]: pgmap v13398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24602.309115 secs 2024-04-26T18:38:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:09 smithi196 ceph-mon[32572]: pgmap v13399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:09 smithi110 ceph-mon[28069]: pgmap v13399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:09 smithi193 ceph-mon[32782]: pgmap v13399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:11 smithi196 ceph-mon[32572]: pgmap v13400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:11 smithi110 ceph-mon[28069]: pgmap v13400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:11 smithi193 ceph-mon[32782]: pgmap v13400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24607.309234 secs 2024-04-26T18:38:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24607.309234 secs 2024-04-26T18:38:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24607.309234 secs 2024-04-26T18:38:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:13 smithi196 ceph-mon[32572]: pgmap v13401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:13 smithi110 ceph-mon[28069]: pgmap v13401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:13 smithi193 ceph-mon[32782]: pgmap v13401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:15 smithi196 ceph-mon[32572]: pgmap v13402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:15 smithi110 ceph-mon[28069]: pgmap v13402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:15 smithi193 ceph-mon[32782]: pgmap v13402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:17 smithi196 ceph-mon[32572]: pgmap v13403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24612.309379 secs 2024-04-26T18:38:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:17 smithi110 ceph-mon[28069]: pgmap v13403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24612.309379 secs 2024-04-26T18:38:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:17 smithi193 ceph-mon[32782]: pgmap v13403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24612.309379 secs 2024-04-26T18:38:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:19 smithi196 ceph-mon[32572]: pgmap v13404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:38:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:19 smithi110 ceph-mon[28069]: pgmap v13404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:38:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:19 smithi193 ceph-mon[32782]: pgmap v13404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:38:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:38:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:38:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:20 smithi196 ceph-mon[32572]: pgmap v13405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:38:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:38:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:38:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:20 smithi110 ceph-mon[28069]: pgmap v13405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:38:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:38:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:38:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:20 smithi193 ceph-mon[32782]: pgmap v13405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:38:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:22 smithi193 ceph-mon[32782]: pgmap v13406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24617.309517 secs 2024-04-26T18:38:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:22 smithi196 ceph-mon[32572]: pgmap v13406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24617.309517 secs 2024-04-26T18:38:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:22 smithi110 ceph-mon[28069]: pgmap v13406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24617.309517 secs 2024-04-26T18:38:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:24 smithi193 ceph-mon[32782]: pgmap v13407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:38:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:24 smithi196 ceph-mon[32572]: pgmap v13407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:38:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:24 smithi110 ceph-mon[28069]: pgmap v13407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:38:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:26 smithi193 ceph-mon[32782]: pgmap v13408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:26 smithi196 ceph-mon[32572]: pgmap v13408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:26 smithi110 ceph-mon[28069]: pgmap v13408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24622.309640 secs 2024-04-26T18:38:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24622.309640 secs 2024-04-26T18:38:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24622.309640 secs 2024-04-26T18:38:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:28 smithi193 ceph-mon[32782]: pgmap v13409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:38:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:28 smithi196 ceph-mon[32572]: pgmap v13409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:38:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:28 smithi110 ceph-mon[28069]: pgmap v13409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:38:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:30 smithi196 ceph-mon[32572]: pgmap v13410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:30 smithi110 ceph-mon[28069]: pgmap v13410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:30 smithi193 ceph-mon[32782]: pgmap v13410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:38:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:32 smithi196 ceph-mon[32572]: pgmap v13411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24627.309754 secs 2024-04-26T18:38:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:32 smithi110 ceph-mon[28069]: pgmap v13411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24627.309754 secs 2024-04-26T18:38:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:32 smithi193 ceph-mon[32782]: pgmap v13411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24627.309754 secs 2024-04-26T18:38:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:34 smithi196 ceph-mon[32572]: pgmap v13412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:34 smithi110 ceph-mon[28069]: pgmap v13412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:34 smithi193 ceph-mon[32782]: pgmap v13412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:36.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:36 smithi193 ceph-mon[32782]: pgmap v13413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:36 smithi196 ceph-mon[32572]: pgmap v13413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:36 smithi110 ceph-mon[28069]: pgmap v13413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24632.309838 secs 2024-04-26T18:38:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24632.309838 secs 2024-04-26T18:38:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24632.309838 secs 2024-04-26T18:38:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:38 smithi196 ceph-mon[32572]: pgmap v13414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:38 smithi110 ceph-mon[28069]: pgmap v13414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:38 smithi193 ceph-mon[32782]: pgmap v13414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:40 smithi196 ceph-mon[32572]: pgmap v13415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:40 smithi110 ceph-mon[28069]: pgmap v13415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:40 smithi193 ceph-mon[32782]: pgmap v13415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:42 smithi196 ceph-mon[32572]: pgmap v13416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24637.309988 secs 2024-04-26T18:38:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:42 smithi110 ceph-mon[28069]: pgmap v13416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24637.309988 secs 2024-04-26T18:38:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:42 smithi193 ceph-mon[32782]: pgmap v13416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24637.309988 secs 2024-04-26T18:38:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:44 smithi196 ceph-mon[32572]: pgmap v13417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:44 smithi110 ceph-mon[28069]: pgmap v13417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:44 smithi193 ceph-mon[32782]: pgmap v13417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:46 smithi196 ceph-mon[32572]: pgmap v13418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:46 smithi110 ceph-mon[28069]: pgmap v13418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:46 smithi193 ceph-mon[32782]: pgmap v13418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24642.310131 secs 2024-04-26T18:38:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24642.310131 secs 2024-04-26T18:38:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24642.310131 secs 2024-04-26T18:38:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:48 smithi196 ceph-mon[32572]: pgmap v13419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:48 smithi110 ceph-mon[28069]: pgmap v13419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:48 smithi193 ceph-mon[32782]: pgmap v13419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:50 smithi196 ceph-mon[32572]: pgmap v13420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:50 smithi110 ceph-mon[28069]: pgmap v13420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:50 smithi193 ceph-mon[32782]: pgmap v13420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:52 smithi196 ceph-mon[32572]: pgmap v13421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24647.310276 secs 2024-04-26T18:38:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:52 smithi110 ceph-mon[28069]: pgmap v13421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24647.310276 secs 2024-04-26T18:38:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:52 smithi193 ceph-mon[32782]: pgmap v13421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24647.310276 secs 2024-04-26T18:38:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:53 smithi196 ceph-mon[32572]: pgmap v13422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:53 smithi110 ceph-mon[28069]: pgmap v13422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:53 smithi193 ceph-mon[32782]: pgmap v13422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:56 smithi193 ceph-mon[32782]: pgmap v13423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:56 smithi196 ceph-mon[32572]: pgmap v13423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:56 smithi110 ceph-mon[28069]: pgmap v13423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:38:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24652.310339 secs 2024-04-26T18:38:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24652.310339 secs 2024-04-26T18:38:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24652.310339 secs 2024-04-26T18:38:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:38:58 smithi193 ceph-mon[32782]: pgmap v13424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:38:58 smithi196 ceph-mon[32572]: pgmap v13424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:38:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:38:58 smithi110 ceph-mon[28069]: pgmap v13424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:00 smithi196 ceph-mon[32572]: pgmap v13425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:00 smithi110 ceph-mon[28069]: pgmap v13425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:00 smithi193 ceph-mon[32782]: pgmap v13425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:02 smithi196 ceph-mon[32572]: pgmap v13426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24657.310455 secs 2024-04-26T18:39:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:02 smithi110 ceph-mon[28069]: pgmap v13426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24657.310455 secs 2024-04-26T18:39:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:02 smithi193 ceph-mon[32782]: pgmap v13426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24657.310455 secs 2024-04-26T18:39:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:04 smithi196 ceph-mon[32572]: pgmap v13427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:04 smithi110 ceph-mon[28069]: pgmap v13427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:04 smithi193 ceph-mon[32782]: pgmap v13427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:06.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:06 smithi193 ceph-mon[32782]: pgmap v13428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:06 smithi196 ceph-mon[32572]: pgmap v13428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:06 smithi110 ceph-mon[28069]: pgmap v13428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24662.310553 secs 2024-04-26T18:39:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24662.310553 secs 2024-04-26T18:39:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24662.310553 secs 2024-04-26T18:39:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:08 smithi196 ceph-mon[32572]: pgmap v13429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:08 smithi110 ceph-mon[28069]: pgmap v13429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:08 smithi193 ceph-mon[32782]: pgmap v13429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:10 smithi196 ceph-mon[32572]: pgmap v13430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:10 smithi110 ceph-mon[28069]: pgmap v13430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:10 smithi193 ceph-mon[32782]: pgmap v13430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:12.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:39:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:39:12.166+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:39:12.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:39:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:39:12.166+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:39:12.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:39:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:39:12.166+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:39:12.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:39:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:39:12.166+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:39:12.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:39:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:39:12.166+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:39:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:12 smithi196 ceph-mon[32572]: pgmap v13431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24667.310675 secs 2024-04-26T18:39:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:12 smithi110 ceph-mon[28069]: pgmap v13431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24667.310675 secs 2024-04-26T18:39:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:12 smithi193 ceph-mon[32782]: pgmap v13431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24667.310675 secs 2024-04-26T18:39:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:14 smithi196 ceph-mon[32572]: pgmap v13432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:39:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:14 smithi110 ceph-mon[28069]: pgmap v13432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:39:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:14 smithi193 ceph-mon[32782]: pgmap v13432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:39:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:16 smithi196 ceph-mon[32572]: pgmap v13433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:39:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:16 smithi110 ceph-mon[28069]: pgmap v13433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:39:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:16 smithi193 ceph-mon[32782]: pgmap v13433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:39:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24672.310786 secs 2024-04-26T18:39:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24672.310786 secs 2024-04-26T18:39:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24672.310786 secs 2024-04-26T18:39:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:18 smithi196 ceph-mon[32572]: pgmap v13434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:39:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:18 smithi110 ceph-mon[28069]: pgmap v13434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:39:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:18 smithi193 ceph-mon[32782]: pgmap v13434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T18:39:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:39:20.450+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:39:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:39:20.450+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:39:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:39:20.450+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 191 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:39:20.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:39:20.450+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 191 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:39:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:20 smithi196 ceph-mon[32572]: pgmap v13435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:39:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:39:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:20 smithi110 ceph-mon[28069]: pgmap v13435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:39:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:39:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:20 smithi193 ceph-mon[32782]: pgmap v13435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T18:39:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:39:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:39:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:39:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:39:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:39:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:39:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:39:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:39:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:39:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:39:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:22 smithi196 ceph-mon[32572]: pgmap v13436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 178 B/s wr, 2 op/s 2024-04-26T18:39:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:22 smithi196 ceph-mon[32572]: pgmap v13437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 215 B/s wr, 2 op/s 2024-04-26T18:39:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24677.310905 secs 2024-04-26T18:39:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:22 smithi110 ceph-mon[28069]: pgmap v13436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 178 B/s wr, 2 op/s 2024-04-26T18:39:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:22 smithi110 ceph-mon[28069]: pgmap v13437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 215 B/s wr, 2 op/s 2024-04-26T18:39:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24677.310905 secs 2024-04-26T18:39:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:22 smithi193 ceph-mon[32782]: pgmap v13436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 178 B/s wr, 2 op/s 2024-04-26T18:39:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:22 smithi193 ceph-mon[32782]: pgmap v13437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 215 B/s wr, 2 op/s 2024-04-26T18:39:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24677.310905 secs 2024-04-26T18:39:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:23 smithi196 ceph-mon[32572]: pgmap v13438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:23 smithi110 ceph-mon[28069]: pgmap v13438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:23 smithi193 ceph-mon[32782]: pgmap v13438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:26 smithi193 ceph-mon[32782]: pgmap v13439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:26 smithi196 ceph-mon[32572]: pgmap v13439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:26 smithi110 ceph-mon[28069]: pgmap v13439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24682.311027 secs 2024-04-26T18:39:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24682.311027 secs 2024-04-26T18:39:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24682.311027 secs 2024-04-26T18:39:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:28 smithi196 ceph-mon[32572]: pgmap v13440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T18:39:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:28 smithi110 ceph-mon[28069]: pgmap v13440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T18:39:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:28 smithi193 ceph-mon[32782]: pgmap v13440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T18:39:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:30 smithi196 ceph-mon[32572]: pgmap v13441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:30 smithi110 ceph-mon[28069]: pgmap v13441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:30 smithi193 ceph-mon[32782]: pgmap v13441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:32 smithi196 ceph-mon[32572]: pgmap v13442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:39:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24687.311150 secs 2024-04-26T18:39:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:32 smithi110 ceph-mon[28069]: pgmap v13442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:39:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24687.311150 secs 2024-04-26T18:39:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:32 smithi193 ceph-mon[32782]: pgmap v13442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:39:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24687.311150 secs 2024-04-26T18:39:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:34 smithi196 ceph-mon[32572]: pgmap v13443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:34 smithi110 ceph-mon[28069]: pgmap v13443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:34 smithi193 ceph-mon[32782]: pgmap v13443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:36.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:36 smithi193 ceph-mon[32782]: pgmap v13444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:36 smithi196 ceph-mon[32572]: pgmap v13444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:36 smithi110 ceph-mon[28069]: pgmap v13444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24692.311283 secs 2024-04-26T18:39:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24692.311283 secs 2024-04-26T18:39:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24692.311283 secs 2024-04-26T18:39:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:38 smithi196 ceph-mon[32572]: pgmap v13445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:38 smithi110 ceph-mon[28069]: pgmap v13445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:38 smithi193 ceph-mon[32782]: pgmap v13445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:40 smithi196 ceph-mon[32572]: pgmap v13446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:40 smithi110 ceph-mon[28069]: pgmap v13446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:40 smithi193 ceph-mon[32782]: pgmap v13446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:42 smithi196 ceph-mon[32572]: pgmap v13447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24697.311427 secs 2024-04-26T18:39:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:42 smithi110 ceph-mon[28069]: pgmap v13447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24697.311427 secs 2024-04-26T18:39:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:42 smithi193 ceph-mon[32782]: pgmap v13447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24697.311427 secs 2024-04-26T18:39:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:44 smithi196 ceph-mon[32572]: pgmap v13448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:44 smithi110 ceph-mon[28069]: pgmap v13448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:44 smithi193 ceph-mon[32782]: pgmap v13448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:46 smithi196 ceph-mon[32572]: pgmap v13449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:46 smithi110 ceph-mon[28069]: pgmap v13449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:46 smithi193 ceph-mon[32782]: pgmap v13449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24702.311545 secs 2024-04-26T18:39:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24702.311545 secs 2024-04-26T18:39:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24702.311545 secs 2024-04-26T18:39:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:48 smithi196 ceph-mon[32572]: pgmap v13450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:48 smithi110 ceph-mon[28069]: pgmap v13450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:48 smithi193 ceph-mon[32782]: pgmap v13450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:50 smithi196 ceph-mon[32572]: pgmap v13451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:50 smithi110 ceph-mon[28069]: pgmap v13451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:50 smithi193 ceph-mon[32782]: pgmap v13451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:52 smithi196 ceph-mon[32572]: pgmap v13452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24707.311665 secs 2024-04-26T18:39:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:52 smithi110 ceph-mon[28069]: pgmap v13452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24707.311665 secs 2024-04-26T18:39:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:52 smithi193 ceph-mon[32782]: pgmap v13452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24707.311665 secs 2024-04-26T18:39:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:54 smithi196 ceph-mon[32572]: pgmap v13453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:54 smithi110 ceph-mon[28069]: pgmap v13453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:54 smithi193 ceph-mon[32782]: pgmap v13453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:39:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:56 smithi196 ceph-mon[32572]: pgmap v13454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:56 smithi110 ceph-mon[28069]: pgmap v13454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:56 smithi193 ceph-mon[32782]: pgmap v13454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24712.311784 secs 2024-04-26T18:39:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24712.311784 secs 2024-04-26T18:39:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24712.311784 secs 2024-04-26T18:39:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:39:58 smithi196 ceph-mon[32572]: pgmap v13455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:39:58 smithi110 ceph-mon[28069]: pgmap v13455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:39:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:39:58 smithi193 ceph-mon[32782]: pgmap v13455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:00 smithi196 ceph-mon[32572]: pgmap v13456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:40:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:00 smithi110 ceph-mon[28069]: pgmap v13456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:40:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:00 smithi193 ceph-mon[32782]: pgmap v13456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:40:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:02 smithi196 ceph-mon[32572]: pgmap v13457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24717.311910 secs 2024-04-26T18:40:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:02 smithi110 ceph-mon[28069]: pgmap v13457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24717.311910 secs 2024-04-26T18:40:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:02 smithi193 ceph-mon[32782]: pgmap v13457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24717.311910 secs 2024-04-26T18:40:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:04 smithi196 ceph-mon[32572]: pgmap v13458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:04 smithi110 ceph-mon[28069]: pgmap v13458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:04 smithi193 ceph-mon[32782]: pgmap v13458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:06 smithi196 ceph-mon[32572]: pgmap v13459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:06 smithi110 ceph-mon[28069]: pgmap v13459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:06 smithi193 ceph-mon[32782]: pgmap v13459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24722.312013 secs 2024-04-26T18:40:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24722.312013 secs 2024-04-26T18:40:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24722.312013 secs 2024-04-26T18:40:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:08 smithi110 ceph-mon[28069]: pgmap v13460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:08 smithi193 ceph-mon[32782]: pgmap v13460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:08 smithi196 ceph-mon[32572]: pgmap v13460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:10 smithi110 ceph-mon[28069]: pgmap v13461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:10 smithi193 ceph-mon[32782]: pgmap v13461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:10 smithi196 ceph-mon[32572]: pgmap v13461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:12 smithi110 ceph-mon[28069]: pgmap v13462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24727.312131 secs 2024-04-26T18:40:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:12 smithi193 ceph-mon[32782]: pgmap v13462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24727.312131 secs 2024-04-26T18:40:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:12 smithi196 ceph-mon[32572]: pgmap v13462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24727.312131 secs 2024-04-26T18:40:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:14 smithi110 ceph-mon[28069]: pgmap v13463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:14 smithi193 ceph-mon[32782]: pgmap v13463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:14 smithi196 ceph-mon[32572]: pgmap v13463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:16 smithi110 ceph-mon[28069]: pgmap v13464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:16 smithi193 ceph-mon[32782]: pgmap v13464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:16 smithi196 ceph-mon[32572]: pgmap v13464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:17 smithi110 ceph-mon[28069]: 21 slow requests, 1 included below; oldest blocked for > 24732.312242 secs 2024-04-26T18:40:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:17 smithi110 ceph-mon[28069]: slow request 364.527804 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:40:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:17 smithi193 ceph-mon[32782]: 21 slow requests, 1 included below; oldest blocked for > 24732.312242 secs 2024-04-26T18:40:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:17 smithi193 ceph-mon[32782]: slow request 364.527804 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:40:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:17 smithi196 ceph-mon[32572]: 21 slow requests, 1 included below; oldest blocked for > 24732.312242 secs 2024-04-26T18:40:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:17 smithi196 ceph-mon[32572]: slow request 364.527804 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:40:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:18 smithi193 ceph-mon[32782]: pgmap v13465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:18 smithi196 ceph-mon[32572]: pgmap v13465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:18 smithi110 ceph-mon[28069]: pgmap v13465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:20 smithi193 ceph-mon[32782]: pgmap v13466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:20 smithi196 ceph-mon[32572]: pgmap v13466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:20 smithi110 ceph-mon[28069]: pgmap v13466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:22.589 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:22 smithi196 ceph-mon[32572]: pgmap v13467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:22.589 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:40:22.590 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24737.312329 secs 2024-04-26T18:40:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:22 smithi193 ceph-mon[32782]: pgmap v13467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:40:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24737.312329 secs 2024-04-26T18:40:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:22 smithi110 ceph-mon[28069]: pgmap v13467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:40:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24737.312329 secs 2024-04-26T18:40:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:40:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:40:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:40:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:40:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:40:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:40:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:40:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:40:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:40:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:24 smithi193 ceph-mon[32782]: pgmap v13468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:40:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:24 smithi193 ceph-mon[32782]: pgmap v13469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:24 smithi196 ceph-mon[32572]: pgmap v13468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:40:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:24 smithi196 ceph-mon[32572]: pgmap v13469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:24 smithi110 ceph-mon[28069]: pgmap v13468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:40:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:24 smithi110 ceph-mon[28069]: pgmap v13469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:26 smithi193 ceph-mon[32782]: pgmap v13470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:26 smithi196 ceph-mon[32572]: pgmap v13470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:26 smithi110 ceph-mon[28069]: pgmap v13470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24742.312445 secs 2024-04-26T18:40:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24742.312445 secs 2024-04-26T18:40:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24742.312445 secs 2024-04-26T18:40:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:28 smithi193 ceph-mon[32782]: pgmap v13471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:28 smithi196 ceph-mon[32572]: pgmap v13471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:28.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:28 smithi110 ceph-mon[28069]: pgmap v13471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:30 smithi193 ceph-mon[32782]: pgmap v13472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:30 smithi196 ceph-mon[32572]: pgmap v13472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:30 smithi110 ceph-mon[28069]: pgmap v13472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:32.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:32 smithi110 ceph-mon[28069]: pgmap v13473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:32.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24747.312537 secs 2024-04-26T18:40:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:32 smithi193 ceph-mon[32782]: pgmap v13473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24747.312537 secs 2024-04-26T18:40:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:32 smithi196 ceph-mon[32572]: pgmap v13473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:40:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24747.312537 secs 2024-04-26T18:40:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:34 smithi193 ceph-mon[32782]: pgmap v13474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:40:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:34 smithi196 ceph-mon[32572]: pgmap v13474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:40:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:34 smithi110 ceph-mon[28069]: pgmap v13474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:40:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:36 smithi193 ceph-mon[32782]: pgmap v13475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:36 smithi196 ceph-mon[32572]: pgmap v13475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:36 smithi110 ceph-mon[28069]: pgmap v13475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24752.312608 secs 2024-04-26T18:40:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24752.312608 secs 2024-04-26T18:40:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24752.312608 secs 2024-04-26T18:40:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:38 smithi193 ceph-mon[32782]: pgmap v13476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:38 smithi196 ceph-mon[32572]: pgmap v13476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:38 smithi110 ceph-mon[28069]: pgmap v13476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:40 smithi193 ceph-mon[32782]: pgmap v13477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:40 smithi196 ceph-mon[32572]: pgmap v13477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:40 smithi110 ceph-mon[28069]: pgmap v13477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:42 smithi196 ceph-mon[32572]: pgmap v13478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24757.312727 secs 2024-04-26T18:40:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:42 smithi110 ceph-mon[28069]: pgmap v13478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24757.312727 secs 2024-04-26T18:40:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:42 smithi193 ceph-mon[32782]: pgmap v13478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24757.312727 secs 2024-04-26T18:40:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:44 smithi196 ceph-mon[32572]: pgmap v13479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:44 smithi110 ceph-mon[28069]: pgmap v13479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:44 smithi193 ceph-mon[32782]: pgmap v13479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:46 smithi196 ceph-mon[32572]: pgmap v13480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:46 smithi110 ceph-mon[28069]: pgmap v13480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:46 smithi193 ceph-mon[32782]: pgmap v13480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:47.701 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24762.312845 secs 2024-04-26T18:40:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24762.312845 secs 2024-04-26T18:40:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24762.312845 secs 2024-04-26T18:40:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:48 smithi196 ceph-mon[32572]: pgmap v13481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:48 smithi110 ceph-mon[28069]: pgmap v13481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:48 smithi193 ceph-mon[32782]: pgmap v13481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:40:50.466+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:40:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:40:50.466+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:40:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:40:50.467+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 192 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:40:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:40:50.467+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 192 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:40:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:50 smithi196 ceph-mon[32572]: pgmap v13482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:50 smithi110 ceph-mon[28069]: pgmap v13482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:50 smithi193 ceph-mon[32782]: pgmap v13482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:52 smithi196 ceph-mon[32572]: pgmap v13483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24767.312963 secs 2024-04-26T18:40:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:52 smithi110 ceph-mon[28069]: pgmap v13483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24767.312963 secs 2024-04-26T18:40:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:52 smithi193 ceph-mon[32782]: pgmap v13483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24767.312963 secs 2024-04-26T18:40:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:54 smithi196 ceph-mon[32572]: pgmap v13484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:54 smithi110 ceph-mon[28069]: pgmap v13484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:54 smithi193 ceph-mon[32782]: pgmap v13484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:40:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:56 smithi196 ceph-mon[32572]: pgmap v13485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:56 smithi110 ceph-mon[28069]: pgmap v13485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:56 smithi193 ceph-mon[32782]: pgmap v13485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24772.313042 secs 2024-04-26T18:40:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24772.313042 secs 2024-04-26T18:40:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24772.313042 secs 2024-04-26T18:40:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:40:58 smithi196 ceph-mon[32572]: pgmap v13486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:40:58 smithi110 ceph-mon[28069]: pgmap v13486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:40:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:40:58 smithi193 ceph-mon[32782]: pgmap v13486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:00 smithi196 ceph-mon[32572]: pgmap v13487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:00 smithi110 ceph-mon[28069]: pgmap v13487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:00 smithi193 ceph-mon[32782]: pgmap v13487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:02 smithi196 ceph-mon[32572]: pgmap v13488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24777.313165 secs 2024-04-26T18:41:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:02 smithi110 ceph-mon[28069]: pgmap v13488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24777.313165 secs 2024-04-26T18:41:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:02 smithi193 ceph-mon[32782]: pgmap v13488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24777.313165 secs 2024-04-26T18:41:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:04 smithi196 ceph-mon[32572]: pgmap v13489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:04 smithi110 ceph-mon[28069]: pgmap v13489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:04 smithi193 ceph-mon[32782]: pgmap v13489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:06 smithi196 ceph-mon[32572]: pgmap v13490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:41:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:06 smithi110 ceph-mon[28069]: pgmap v13490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:41:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:06 smithi193 ceph-mon[32782]: pgmap v13490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:41:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24782.313263 secs 2024-04-26T18:41:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24782.313263 secs 2024-04-26T18:41:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24782.313263 secs 2024-04-26T18:41:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:08 smithi196 ceph-mon[32572]: pgmap v13491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:41:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:08 smithi110 ceph-mon[28069]: pgmap v13491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:41:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:08 smithi193 ceph-mon[32782]: pgmap v13491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:41:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:10 smithi196 ceph-mon[32572]: pgmap v13492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:10 smithi110 ceph-mon[28069]: pgmap v13492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:10 smithi193 ceph-mon[32782]: pgmap v13492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:12 smithi196 ceph-mon[32572]: pgmap v13493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:41:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:12 smithi196 ceph-mon[32572]: 21 slow requests, 1 included below; oldest blocked for > 24787.313381 secs 2024-04-26T18:41:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:12 smithi196 ceph-mon[32572]: slow request 11524.938265 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:41:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:12 smithi110 ceph-mon[28069]: pgmap v13493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:41:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:12 smithi110 ceph-mon[28069]: 21 slow requests, 1 included below; oldest blocked for > 24787.313381 secs 2024-04-26T18:41:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:12 smithi110 ceph-mon[28069]: slow request 11524.938265 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:41:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:12 smithi193 ceph-mon[32782]: pgmap v13493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:41:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:12 smithi193 ceph-mon[32782]: 21 slow requests, 1 included below; oldest blocked for > 24787.313381 secs 2024-04-26T18:41:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:12 smithi193 ceph-mon[32782]: slow request 11524.938265 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:41:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:14 smithi196 ceph-mon[32572]: pgmap v13494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:14 smithi110 ceph-mon[28069]: pgmap v13494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:14 smithi193 ceph-mon[32782]: pgmap v13494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:16 smithi196 ceph-mon[32572]: pgmap v13495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:16 smithi110 ceph-mon[28069]: pgmap v13495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:16 smithi193 ceph-mon[32782]: pgmap v13495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24792.313499 secs 2024-04-26T18:41:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24792.313499 secs 2024-04-26T18:41:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24792.313499 secs 2024-04-26T18:41:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:18 smithi196 ceph-mon[32572]: pgmap v13496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:18 smithi110 ceph-mon[28069]: pgmap v13496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:18 smithi193 ceph-mon[32782]: pgmap v13496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:20 smithi110 ceph-mon[28069]: pgmap v13497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:20 smithi193 ceph-mon[32782]: pgmap v13497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:20 smithi196 ceph-mon[32572]: pgmap v13497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:22 smithi110 ceph-mon[28069]: pgmap v13498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24797.313627 secs 2024-04-26T18:41:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:22 smithi193 ceph-mon[32782]: pgmap v13498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24797.313627 secs 2024-04-26T18:41:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:22 smithi196 ceph-mon[32572]: pgmap v13498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24797.313627 secs 2024-04-26T18:41:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:41:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:41:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:41:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:24 smithi110 ceph-mon[28069]: pgmap v13499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:41:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:41:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:41:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:24 smithi193 ceph-mon[32782]: pgmap v13499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:41:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:41:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:41:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:24 smithi196 ceph-mon[32572]: pgmap v13499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:41:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:41:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:41:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:25 smithi110 ceph-mon[28069]: pgmap v13500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T18:41:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:25 smithi110 ceph-mon[28069]: pgmap v13501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:25 smithi193 ceph-mon[32782]: pgmap v13500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T18:41:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:25 smithi193 ceph-mon[32782]: pgmap v13501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:25 smithi196 ceph-mon[32572]: pgmap v13500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T18:41:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:25 smithi196 ceph-mon[32572]: pgmap v13501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:27 smithi193 ceph-mon[32782]: pgmap v13502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24802.313712 secs 2024-04-26T18:41:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:27 smithi196 ceph-mon[32572]: pgmap v13502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24802.313712 secs 2024-04-26T18:41:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:27 smithi110 ceph-mon[28069]: pgmap v13502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24802.313712 secs 2024-04-26T18:41:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:29 smithi193 ceph-mon[32782]: pgmap v13503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:29 smithi196 ceph-mon[32572]: pgmap v13503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:29 smithi110 ceph-mon[28069]: pgmap v13503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:31 smithi193 ceph-mon[32782]: pgmap v13504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:31 smithi196 ceph-mon[32572]: pgmap v13504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:31 smithi110 ceph-mon[28069]: pgmap v13504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:41:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24807.313778 secs 2024-04-26T18:41:32.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24807.313778 secs 2024-04-26T18:41:32.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24807.313778 secs 2024-04-26T18:41:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:33 smithi193 ceph-mon[32782]: pgmap v13505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:41:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:33 smithi196 ceph-mon[32572]: pgmap v13505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:41:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:33 smithi110 ceph-mon[28069]: pgmap v13505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:41:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:35 smithi193 ceph-mon[32782]: pgmap v13506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:41:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:35 smithi196 ceph-mon[32572]: pgmap v13506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:41:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:35 smithi110 ceph-mon[28069]: pgmap v13506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:41:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:37 smithi193 ceph-mon[32782]: pgmap v13507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24812.313865 secs 2024-04-26T18:41:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:37 smithi196 ceph-mon[32572]: pgmap v13507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24812.313865 secs 2024-04-26T18:41:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:37 smithi110 ceph-mon[28069]: pgmap v13507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24812.313865 secs 2024-04-26T18:41:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:39 smithi193 ceph-mon[32782]: pgmap v13508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:39 smithi196 ceph-mon[32572]: pgmap v13508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:39 smithi110 ceph-mon[28069]: pgmap v13508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:41 smithi193 ceph-mon[32782]: pgmap v13509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:41 smithi196 ceph-mon[32572]: pgmap v13509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:41 smithi110 ceph-mon[28069]: pgmap v13509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24817.313993 secs 2024-04-26T18:41:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24817.313993 secs 2024-04-26T18:41:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24817.313993 secs 2024-04-26T18:41:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:43 smithi193 ceph-mon[32782]: pgmap v13510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:41:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:43 smithi196 ceph-mon[32572]: pgmap v13510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:41:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:43 smithi110 ceph-mon[28069]: pgmap v13510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:41:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:45 smithi193 ceph-mon[32782]: pgmap v13511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:45 smithi196 ceph-mon[32572]: pgmap v13511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:45 smithi110 ceph-mon[28069]: pgmap v13511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:47 smithi193 ceph-mon[32782]: pgmap v13512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24822.314131 secs 2024-04-26T18:41:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:47 smithi196 ceph-mon[32572]: pgmap v13512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24822.314131 secs 2024-04-26T18:41:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:47 smithi110 ceph-mon[28069]: pgmap v13512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24822.314131 secs 2024-04-26T18:41:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:49 smithi193 ceph-mon[32782]: pgmap v13513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:49 smithi196 ceph-mon[32572]: pgmap v13513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:49 smithi110 ceph-mon[28069]: pgmap v13513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:51 smithi193 ceph-mon[32782]: pgmap v13514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:51 smithi196 ceph-mon[32572]: pgmap v13514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:51 smithi110 ceph-mon[28069]: pgmap v13514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24827.314249 secs 2024-04-26T18:41:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24827.314249 secs 2024-04-26T18:41:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24827.314249 secs 2024-04-26T18:41:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:53 smithi196 ceph-mon[32572]: pgmap v13515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:41:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:53 smithi110 ceph-mon[28069]: pgmap v13515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:41:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:53 smithi193 ceph-mon[32782]: pgmap v13515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:41:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:55 smithi196 ceph-mon[32572]: pgmap v13516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:55 smithi110 ceph-mon[28069]: pgmap v13516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:55 smithi193 ceph-mon[32782]: pgmap v13516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:41:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:57 smithi196 ceph-mon[32572]: pgmap v13517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24832.314369 secs 2024-04-26T18:41:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:57 smithi110 ceph-mon[28069]: pgmap v13517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24832.314369 secs 2024-04-26T18:41:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:57 smithi193 ceph-mon[32782]: pgmap v13517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:41:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24832.314369 secs 2024-04-26T18:42:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:41:59 smithi196 ceph-mon[32572]: pgmap v13518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:41:59 smithi110 ceph-mon[28069]: pgmap v13518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:41:59 smithi193 ceph-mon[32782]: pgmap v13518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:01 smithi196 ceph-mon[32572]: pgmap v13519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:01 smithi110 ceph-mon[28069]: pgmap v13519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:01 smithi193 ceph-mon[32782]: pgmap v13519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:02.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24837.314488 secs 2024-04-26T18:42:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24837.314488 secs 2024-04-26T18:42:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24837.314488 secs 2024-04-26T18:42:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:03 smithi196 ceph-mon[32572]: pgmap v13520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:42:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:03 smithi110 ceph-mon[28069]: pgmap v13520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:42:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:03 smithi193 ceph-mon[32782]: pgmap v13520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:42:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:05 smithi196 ceph-mon[32572]: pgmap v13521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:05 smithi110 ceph-mon[28069]: pgmap v13521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:05 smithi193 ceph-mon[32782]: pgmap v13521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:07 smithi196 ceph-mon[32572]: pgmap v13522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24842.314588 secs 2024-04-26T18:42:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:07 smithi110 ceph-mon[28069]: pgmap v13522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24842.314588 secs 2024-04-26T18:42:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:07 smithi193 ceph-mon[32782]: pgmap v13522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24842.314588 secs 2024-04-26T18:42:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:09 smithi196 ceph-mon[32572]: pgmap v13523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:09 smithi110 ceph-mon[28069]: pgmap v13523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:09 smithi193 ceph-mon[32782]: pgmap v13523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:11 smithi196 ceph-mon[32572]: pgmap v13524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:11 smithi110 ceph-mon[28069]: pgmap v13524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:11 smithi193 ceph-mon[32782]: pgmap v13524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24847.314704 secs 2024-04-26T18:42:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24847.314704 secs 2024-04-26T18:42:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24847.314704 secs 2024-04-26T18:42:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:13 smithi196 ceph-mon[32572]: pgmap v13525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:42:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:13 smithi110 ceph-mon[28069]: pgmap v13525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:42:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:13 smithi193 ceph-mon[32782]: pgmap v13525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:42:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:15 smithi196 ceph-mon[32572]: pgmap v13526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:15 smithi110 ceph-mon[28069]: pgmap v13526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:15 smithi193 ceph-mon[32782]: pgmap v13526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:17 smithi196 ceph-mon[32572]: pgmap v13527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24852.314819 secs 2024-04-26T18:42:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:17 smithi110 ceph-mon[28069]: pgmap v13527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24852.314819 secs 2024-04-26T18:42:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:17 smithi193 ceph-mon[32782]: pgmap v13527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24852.314819 secs 2024-04-26T18:42:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:19 smithi196 ceph-mon[32572]: pgmap v13528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:19 smithi110 ceph-mon[28069]: pgmap v13528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:19 smithi193 ceph-mon[32782]: pgmap v13528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:20.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:42:20.480+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:42:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:42:20.480+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:42:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:42:20.481+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 193 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:42:20.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:42:20.481+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 193 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:42:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:21 smithi196 ceph-mon[32572]: pgmap v13529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:21 smithi110 ceph-mon[28069]: pgmap v13529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:21 smithi193 ceph-mon[32782]: pgmap v13529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24857.314960 secs 2024-04-26T18:42:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24857.314960 secs 2024-04-26T18:42:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24857.314960 secs 2024-04-26T18:42:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:23 smithi196 ceph-mon[32572]: pgmap v13530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:42:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:23 smithi110 ceph-mon[28069]: pgmap v13530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:42:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:23 smithi193 ceph-mon[32782]: pgmap v13530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:42:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:25 smithi196 ceph-mon[32572]: pgmap v13531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:42:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:25 smithi110 ceph-mon[28069]: pgmap v13531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:42:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:25 smithi193 ceph-mon[32782]: pgmap v13531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:42:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:42:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:42:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:42:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:42:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:42:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:42:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:42:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:42:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:42:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:27 smithi196 ceph-mon[32572]: pgmap v13532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:42:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:27 smithi196 ceph-mon[32572]: pgmap v13533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24862.315042 secs 2024-04-26T18:42:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:27 smithi110 ceph-mon[28069]: pgmap v13532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:42:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:27 smithi110 ceph-mon[28069]: pgmap v13533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24862.315042 secs 2024-04-26T18:42:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:27 smithi193 ceph-mon[32782]: pgmap v13532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:42:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:27 smithi193 ceph-mon[32782]: pgmap v13533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24862.315042 secs 2024-04-26T18:42:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:29 smithi196 ceph-mon[32572]: pgmap v13534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:29 smithi110 ceph-mon[28069]: pgmap v13534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:29 smithi193 ceph-mon[32782]: pgmap v13534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:31 smithi196 ceph-mon[32572]: pgmap v13535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:31 smithi110 ceph-mon[28069]: pgmap v13535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:31 smithi193 ceph-mon[32782]: pgmap v13535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24867.315214 secs 2024-04-26T18:42:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24867.315214 secs 2024-04-26T18:42:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24867.315214 secs 2024-04-26T18:42:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:33 smithi110 ceph-mon[28069]: pgmap v13536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:42:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:33 smithi193 ceph-mon[32782]: pgmap v13536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:42:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:33 smithi196 ceph-mon[32572]: pgmap v13536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:42:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:35 smithi110 ceph-mon[28069]: pgmap v13537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:35 smithi193 ceph-mon[32782]: pgmap v13537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:35 smithi196 ceph-mon[32572]: pgmap v13537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:42:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:37 smithi110 ceph-mon[28069]: pgmap v13538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:42:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24872.315372 secs 2024-04-26T18:42:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:37 smithi193 ceph-mon[32782]: pgmap v13538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:42:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24872.315372 secs 2024-04-26T18:42:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:37 smithi196 ceph-mon[32572]: pgmap v13538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:42:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24872.315372 secs 2024-04-26T18:42:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:39 smithi110 ceph-mon[28069]: pgmap v13539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:39 smithi193 ceph-mon[32782]: pgmap v13539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:39 smithi196 ceph-mon[32572]: pgmap v13539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:41 smithi110 ceph-mon[28069]: pgmap v13540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:41 smithi193 ceph-mon[32782]: pgmap v13540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:41 smithi196 ceph-mon[32572]: pgmap v13540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24877.315493 secs 2024-04-26T18:42:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24877.315493 secs 2024-04-26T18:42:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24877.315493 secs 2024-04-26T18:42:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:43 smithi193 ceph-mon[32782]: pgmap v13541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:43 smithi196 ceph-mon[32572]: pgmap v13541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:43 smithi110 ceph-mon[28069]: pgmap v13541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:45 smithi193 ceph-mon[32782]: pgmap v13542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:45 smithi196 ceph-mon[32572]: pgmap v13542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:45 smithi110 ceph-mon[28069]: pgmap v13542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:47 smithi193 ceph-mon[32782]: pgmap v13543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24882.315619 secs 2024-04-26T18:42:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:47 smithi196 ceph-mon[32572]: pgmap v13543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24882.315619 secs 2024-04-26T18:42:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:47 smithi110 ceph-mon[28069]: pgmap v13543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24882.315619 secs 2024-04-26T18:42:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:49 smithi193 ceph-mon[32782]: pgmap v13544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:49 smithi196 ceph-mon[32572]: pgmap v13544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:49 smithi110 ceph-mon[28069]: pgmap v13544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:51 smithi193 ceph-mon[32782]: pgmap v13545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:51 smithi196 ceph-mon[32572]: pgmap v13545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:51 smithi110 ceph-mon[28069]: pgmap v13545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24887.315753 secs 2024-04-26T18:42:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24887.315753 secs 2024-04-26T18:42:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24887.315753 secs 2024-04-26T18:42:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:53 smithi193 ceph-mon[32782]: pgmap v13546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:53 smithi196 ceph-mon[32572]: pgmap v13546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:53 smithi110 ceph-mon[28069]: pgmap v13546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:55 smithi193 ceph-mon[32782]: pgmap v13547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:55 smithi196 ceph-mon[32572]: pgmap v13547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:55 smithi110 ceph-mon[28069]: pgmap v13547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:42:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:57 smithi193 ceph-mon[32782]: pgmap v13548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24892.315884 secs 2024-04-26T18:42:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:57 smithi196 ceph-mon[32572]: pgmap v13548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24892.315884 secs 2024-04-26T18:42:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:57 smithi110 ceph-mon[28069]: pgmap v13548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:42:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24892.315884 secs 2024-04-26T18:42:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:42:59 smithi193 ceph-mon[32782]: pgmap v13549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:42:59 smithi196 ceph-mon[32572]: pgmap v13549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:42:59 smithi110 ceph-mon[28069]: pgmap v13549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:01 smithi193 ceph-mon[32782]: pgmap v13550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:01 smithi196 ceph-mon[32572]: pgmap v13550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:01 smithi110 ceph-mon[28069]: pgmap v13550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24897.315985 secs 2024-04-26T18:43:02.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24897.315985 secs 2024-04-26T18:43:02.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24897.315985 secs 2024-04-26T18:43:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:03 smithi193 ceph-mon[32782]: pgmap v13551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:03 smithi196 ceph-mon[32572]: pgmap v13551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:03 smithi110 ceph-mon[28069]: pgmap v13551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:05 smithi193 ceph-mon[32782]: pgmap v13552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:05 smithi196 ceph-mon[32572]: pgmap v13552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:05 smithi110 ceph-mon[28069]: pgmap v13552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:07 smithi193 ceph-mon[32782]: pgmap v13553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24902.316120 secs 2024-04-26T18:43:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:07 smithi196 ceph-mon[32572]: pgmap v13553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24902.316120 secs 2024-04-26T18:43:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:07 smithi110 ceph-mon[28069]: pgmap v13553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24902.316120 secs 2024-04-26T18:43:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:09 smithi196 ceph-mon[32572]: pgmap v13554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:09 smithi110 ceph-mon[28069]: pgmap v13554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:09 smithi193 ceph-mon[32782]: pgmap v13554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:11 smithi196 ceph-mon[32572]: pgmap v13555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:11 smithi110 ceph-mon[28069]: pgmap v13555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:11 smithi193 ceph-mon[32782]: pgmap v13555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24907.316262 secs 2024-04-26T18:43:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24907.316262 secs 2024-04-26T18:43:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24907.316262 secs 2024-04-26T18:43:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:13 smithi196 ceph-mon[32572]: pgmap v13556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:13 smithi110 ceph-mon[28069]: pgmap v13556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:13 smithi193 ceph-mon[32782]: pgmap v13556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:15 smithi196 ceph-mon[32572]: pgmap v13557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:15 smithi110 ceph-mon[28069]: pgmap v13557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:15 smithi193 ceph-mon[32782]: pgmap v13557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:17 smithi196 ceph-mon[32572]: pgmap v13558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24912.316408 secs 2024-04-26T18:43:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:17 smithi110 ceph-mon[28069]: pgmap v13558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24912.316408 secs 2024-04-26T18:43:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:17 smithi193 ceph-mon[32782]: pgmap v13558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24912.316408 secs 2024-04-26T18:43:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:19 smithi196 ceph-mon[32572]: pgmap v13559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:19 smithi110 ceph-mon[28069]: pgmap v13559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:19 smithi193 ceph-mon[32782]: pgmap v13559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:21 smithi196 ceph-mon[32572]: pgmap v13560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:21 smithi110 ceph-mon[28069]: pgmap v13560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:21 smithi193 ceph-mon[32782]: pgmap v13560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24917.316503 secs 2024-04-26T18:43:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24917.316503 secs 2024-04-26T18:43:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24917.316503 secs 2024-04-26T18:43:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:23 smithi196 ceph-mon[32572]: pgmap v13561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:23 smithi110 ceph-mon[28069]: pgmap v13561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:23 smithi193 ceph-mon[32782]: pgmap v13561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:25 smithi196 ceph-mon[32572]: pgmap v13562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:25 smithi110 ceph-mon[28069]: pgmap v13562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:25 smithi193 ceph-mon[32782]: pgmap v13562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:43:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:43:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:43:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:27 smithi196 ceph-mon[32572]: pgmap v13563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24922.316608 secs 2024-04-26T18:43:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:43:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:43:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:43:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:27 smithi110 ceph-mon[28069]: pgmap v13563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24922.316608 secs 2024-04-26T18:43:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:43:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:43:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:43:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:27 smithi193 ceph-mon[32782]: pgmap v13563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24922.316608 secs 2024-04-26T18:43:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:43:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:43:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:43:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:28 smithi196 ceph-mon[32572]: pgmap v13564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:43:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:28 smithi196 ceph-mon[32572]: pgmap v13565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:28 smithi110 ceph-mon[28069]: pgmap v13564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:43:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:28 smithi110 ceph-mon[28069]: pgmap v13565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:28 smithi193 ceph-mon[32782]: pgmap v13564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:43:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:28 smithi193 ceph-mon[32782]: pgmap v13565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:30 smithi196 ceph-mon[32572]: pgmap v13566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:30 smithi110 ceph-mon[28069]: pgmap v13566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:30 smithi193 ceph-mon[32782]: pgmap v13566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:32 smithi196 ceph-mon[32572]: pgmap v13567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24927.316666 secs 2024-04-26T18:43:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:32 smithi110 ceph-mon[28069]: pgmap v13567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24927.316666 secs 2024-04-26T18:43:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:32 smithi193 ceph-mon[32782]: pgmap v13567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24927.316666 secs 2024-04-26T18:43:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:34 smithi196 ceph-mon[32572]: pgmap v13568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:34 smithi110 ceph-mon[28069]: pgmap v13568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:34 smithi193 ceph-mon[32782]: pgmap v13568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:36 smithi196 ceph-mon[32572]: pgmap v13569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:36 smithi110 ceph-mon[28069]: pgmap v13569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:36 smithi193 ceph-mon[32782]: pgmap v13569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24932.316790 secs 2024-04-26T18:43:38.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24932.316790 secs 2024-04-26T18:43:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24932.316790 secs 2024-04-26T18:43:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:38 smithi196 ceph-mon[32572]: pgmap v13570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:43:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:38 smithi110 ceph-mon[28069]: pgmap v13570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:43:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:38 smithi193 ceph-mon[32782]: pgmap v13570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:43:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:40 smithi196 ceph-mon[32572]: pgmap v13571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:40 smithi110 ceph-mon[28069]: pgmap v13571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:40 smithi193 ceph-mon[32782]: pgmap v13571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:42 smithi196 ceph-mon[32572]: pgmap v13572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24937.316909 secs 2024-04-26T18:43:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:42 smithi110 ceph-mon[28069]: pgmap v13572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24937.316909 secs 2024-04-26T18:43:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:42 smithi193 ceph-mon[32782]: pgmap v13572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24937.316909 secs 2024-04-26T18:43:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:44 smithi196 ceph-mon[32572]: pgmap v13573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:44 smithi110 ceph-mon[28069]: pgmap v13573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:44 smithi193 ceph-mon[32782]: pgmap v13573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:46 smithi196 ceph-mon[32572]: pgmap v13574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:46 smithi110 ceph-mon[28069]: pgmap v13574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:46 smithi193 ceph-mon[32782]: pgmap v13574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24942.317034 secs 2024-04-26T18:43:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24942.317034 secs 2024-04-26T18:43:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24942.317034 secs 2024-04-26T18:43:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:48 smithi110 ceph-mon[28069]: pgmap v13575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:48 smithi193 ceph-mon[32782]: pgmap v13575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:48 smithi196 ceph-mon[32572]: pgmap v13575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:49 smithi110 ceph-mon[28069]: pgmap v13576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:49 smithi193 ceph-mon[32782]: pgmap v13576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:49 smithi196 ceph-mon[32572]: pgmap v13576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:52 smithi196 ceph-mon[32572]: pgmap v13577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24947.317101 secs 2024-04-26T18:43:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:52 smithi110 ceph-mon[28069]: pgmap v13577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24947.317101 secs 2024-04-26T18:43:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:52 smithi193 ceph-mon[32782]: pgmap v13577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24947.317101 secs 2024-04-26T18:43:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:54 smithi110 ceph-mon[28069]: pgmap v13578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:54 smithi193 ceph-mon[32782]: pgmap v13578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:54 smithi196 ceph-mon[32572]: pgmap v13578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:56 smithi110 ceph-mon[28069]: pgmap v13579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:56 smithi193 ceph-mon[32782]: pgmap v13579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:56 smithi196 ceph-mon[32572]: pgmap v13579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:43:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24952.317244 secs 2024-04-26T18:43:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24952.317244 secs 2024-04-26T18:43:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24952.317244 secs 2024-04-26T18:43:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:43:58 smithi110 ceph-mon[28069]: pgmap v13580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:43:58 smithi193 ceph-mon[32782]: pgmap v13580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:43:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:43:58 smithi196 ceph-mon[32572]: pgmap v13580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:00 smithi110 ceph-mon[28069]: pgmap v13581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:00 smithi193 ceph-mon[32782]: pgmap v13581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:00 smithi196 ceph-mon[32572]: pgmap v13581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:02 smithi110 ceph-mon[28069]: pgmap v13582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24957.317363 secs 2024-04-26T18:44:02.808 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:02 smithi196 ceph-mon[32572]: pgmap v13582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:02.808 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24957.317363 secs 2024-04-26T18:44:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:02 smithi193 ceph-mon[32782]: pgmap v13582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24957.317363 secs 2024-04-26T18:44:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:04 smithi110 ceph-mon[28069]: pgmap v13583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:04 smithi193 ceph-mon[32782]: pgmap v13583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:04 smithi196 ceph-mon[32572]: pgmap v13583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:06 smithi193 ceph-mon[32782]: pgmap v13584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:06 smithi196 ceph-mon[32572]: pgmap v13584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:06 smithi110 ceph-mon[28069]: pgmap v13584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24962.317495 secs 2024-04-26T18:44:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24962.317495 secs 2024-04-26T18:44:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24962.317495 secs 2024-04-26T18:44:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:08 smithi193 ceph-mon[32782]: pgmap v13585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:08 smithi196 ceph-mon[32572]: pgmap v13585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:08 smithi110 ceph-mon[28069]: pgmap v13585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:10 smithi193 ceph-mon[32782]: pgmap v13586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:10 smithi196 ceph-mon[32572]: pgmap v13586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:10 smithi110 ceph-mon[28069]: pgmap v13586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:12 smithi110 ceph-mon[28069]: pgmap v13587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24967.317616 secs 2024-04-26T18:44:12.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:44:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:44:12.369+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:44:12.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:44:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:44:12.369+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:44:12.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:44:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:44:12.369+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:44:12.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:44:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:44:12.369+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:44:12.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:44:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:44:12.369+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:44:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:12 smithi193 ceph-mon[32782]: pgmap v13587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24967.317616 secs 2024-04-26T18:44:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:12 smithi196 ceph-mon[32572]: pgmap v13587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24967.317616 secs 2024-04-26T18:44:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:14 smithi193 ceph-mon[32782]: pgmap v13588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-26T18:44:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:14 smithi196 ceph-mon[32572]: pgmap v13588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-26T18:44:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:14 smithi110 ceph-mon[28069]: pgmap v13588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-26T18:44:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:16 smithi193 ceph-mon[32782]: pgmap v13589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:44:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:16 smithi196 ceph-mon[32572]: pgmap v13589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:44:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:16 smithi110 ceph-mon[28069]: pgmap v13589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T18:44:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24972.317714 secs 2024-04-26T18:44:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24972.317714 secs 2024-04-26T18:44:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24972.317714 secs 2024-04-26T18:44:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:18 smithi193 ceph-mon[32782]: pgmap v13590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:18 smithi196 ceph-mon[32572]: pgmap v13590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:18 smithi110 ceph-mon[28069]: pgmap v13590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:20 smithi193 ceph-mon[32782]: pgmap v13591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:20 smithi196 ceph-mon[32572]: pgmap v13591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:20 smithi110 ceph-mon[28069]: pgmap v13591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:22 smithi193 ceph-mon[32782]: pgmap v13592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24977.317836 secs 2024-04-26T18:44:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:22 smithi196 ceph-mon[32572]: pgmap v13592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24977.317836 secs 2024-04-26T18:44:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:22 smithi110 ceph-mon[28069]: pgmap v13592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24977.317836 secs 2024-04-26T18:44:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:24 smithi193 ceph-mon[32782]: pgmap v13593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:24 smithi196 ceph-mon[32572]: pgmap v13593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:24 smithi110 ceph-mon[28069]: pgmap v13593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:44:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:26 smithi193 ceph-mon[32782]: pgmap v13594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T18:44:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:26 smithi196 ceph-mon[32572]: pgmap v13594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T18:44:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:26 smithi110 ceph-mon[28069]: pgmap v13594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T18:44:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24982.317899 secs 2024-04-26T18:44:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24982.317899 secs 2024-04-26T18:44:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24982.317899 secs 2024-04-26T18:44:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:28 smithi196 ceph-mon[32572]: pgmap v13595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T18:44:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:44:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:28 smithi110 ceph-mon[28069]: pgmap v13595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T18:44:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:44:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:28 smithi193 ceph-mon[32782]: pgmap v13595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-26T18:44:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:44:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:44:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:44:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:44:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:44:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:44:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:44:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:44:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:44:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:44:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:30 smithi196 ceph-mon[32572]: pgmap v13596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T18:44:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:30 smithi196 ceph-mon[32572]: pgmap v13597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:30 smithi110 ceph-mon[28069]: pgmap v13596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T18:44:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:30 smithi110 ceph-mon[28069]: pgmap v13597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:30 smithi193 ceph-mon[32782]: pgmap v13596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T18:44:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:30 smithi193 ceph-mon[32782]: pgmap v13597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:32 smithi196 ceph-mon[32572]: pgmap v13598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24987.318022 secs 2024-04-26T18:44:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:32 smithi110 ceph-mon[28069]: pgmap v13598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24987.318022 secs 2024-04-26T18:44:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:32 smithi193 ceph-mon[32782]: pgmap v13598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24987.318022 secs 2024-04-26T18:44:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:34 smithi196 ceph-mon[32572]: pgmap v13599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:34 smithi110 ceph-mon[28069]: pgmap v13599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:34 smithi193 ceph-mon[32782]: pgmap v13599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:36 smithi196 ceph-mon[32572]: pgmap v13600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:36 smithi110 ceph-mon[28069]: pgmap v13600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:36 smithi193 ceph-mon[32782]: pgmap v13600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:44:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24992.318084 secs 2024-04-26T18:44:38.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24992.318084 secs 2024-04-26T18:44:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24992.318084 secs 2024-04-26T18:44:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:38 smithi196 ceph-mon[32572]: pgmap v13601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:44:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:38 smithi110 ceph-mon[28069]: pgmap v13601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:44:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:38 smithi193 ceph-mon[32782]: pgmap v13601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:44:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:40 smithi196 ceph-mon[32572]: pgmap v13602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:44:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:40 smithi110 ceph-mon[28069]: pgmap v13602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:44:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:40 smithi193 ceph-mon[32782]: pgmap v13602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:44:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:42 smithi196 ceph-mon[32572]: pgmap v13603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 24997.318201 secs 2024-04-26T18:44:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:42 smithi110 ceph-mon[28069]: pgmap v13603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 24997.318201 secs 2024-04-26T18:44:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:42 smithi193 ceph-mon[32782]: pgmap v13603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 24997.318201 secs 2024-04-26T18:44:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:44 smithi196 ceph-mon[32572]: pgmap v13604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:44 smithi110 ceph-mon[28069]: pgmap v13604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:44 smithi193 ceph-mon[32782]: pgmap v13604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:46 smithi196 ceph-mon[32572]: pgmap v13605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:46 smithi110 ceph-mon[28069]: pgmap v13605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:46 smithi193 ceph-mon[32782]: pgmap v13605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25002.318318 secs 2024-04-26T18:44:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25002.318318 secs 2024-04-26T18:44:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25002.318318 secs 2024-04-26T18:44:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:48 smithi196 ceph-mon[32572]: pgmap v13606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:48 smithi110 ceph-mon[28069]: pgmap v13606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:48 smithi193 ceph-mon[32782]: pgmap v13606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:50 smithi196 ceph-mon[32572]: pgmap v13607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:50 smithi110 ceph-mon[28069]: pgmap v13607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:50 smithi193 ceph-mon[32782]: pgmap v13607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:52 smithi196 ceph-mon[32572]: pgmap v13608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25007.318435 secs 2024-04-26T18:44:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:52 smithi110 ceph-mon[28069]: pgmap v13608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25007.318435 secs 2024-04-26T18:44:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:52 smithi193 ceph-mon[32782]: pgmap v13608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25007.318435 secs 2024-04-26T18:44:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:54 smithi196 ceph-mon[32572]: pgmap v13609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:54 smithi110 ceph-mon[28069]: pgmap v13609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:54 smithi193 ceph-mon[32782]: pgmap v13609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:44:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:56 smithi196 ceph-mon[32572]: pgmap v13610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:56 smithi110 ceph-mon[28069]: pgmap v13610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:56 smithi193 ceph-mon[32782]: pgmap v13610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25012.318533 secs 2024-04-26T18:44:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25012.318533 secs 2024-04-26T18:44:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25012.318533 secs 2024-04-26T18:44:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:44:58 smithi196 ceph-mon[32572]: pgmap v13611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:44:58 smithi110 ceph-mon[28069]: pgmap v13611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:44:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:44:58 smithi193 ceph-mon[32782]: pgmap v13611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:00 smithi196 ceph-mon[32572]: pgmap v13612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:00 smithi110 ceph-mon[28069]: pgmap v13612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:00 smithi193 ceph-mon[32782]: pgmap v13612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:02 smithi196 ceph-mon[32572]: pgmap v13613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25017.318634 secs 2024-04-26T18:45:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:02 smithi110 ceph-mon[28069]: pgmap v13613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25017.318634 secs 2024-04-26T18:45:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:02 smithi193 ceph-mon[32782]: pgmap v13613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25017.318634 secs 2024-04-26T18:45:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:04 smithi196 ceph-mon[32572]: pgmap v13614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:45:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:04 smithi110 ceph-mon[28069]: pgmap v13614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:45:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:04 smithi193 ceph-mon[32782]: pgmap v13614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:45:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:06 smithi196 ceph-mon[32572]: pgmap v13615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:45:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:06 smithi110 ceph-mon[28069]: pgmap v13615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:45:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:06 smithi193 ceph-mon[32782]: pgmap v13615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:45:08.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25022.318755 secs 2024-04-26T18:45:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25022.318755 secs 2024-04-26T18:45:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25022.318755 secs 2024-04-26T18:45:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:08 smithi110 ceph-mon[28069]: pgmap v13616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:45:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:08 smithi193 ceph-mon[32782]: pgmap v13616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:45:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:08 smithi196 ceph-mon[32572]: pgmap v13616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:45:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:10 smithi110 ceph-mon[28069]: pgmap v13617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:45:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:10 smithi193 ceph-mon[32782]: pgmap v13617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:45:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:10 smithi196 ceph-mon[32572]: pgmap v13617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:45:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:12 smithi110 ceph-mon[28069]: pgmap v13618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:45:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25027.318895 secs 2024-04-26T18:45:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:12 smithi193 ceph-mon[32782]: pgmap v13618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:45:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25027.318895 secs 2024-04-26T18:45:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:12 smithi196 ceph-mon[32572]: pgmap v13618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:45:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25027.318895 secs 2024-04-26T18:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:13 smithi193 ceph-mon[32782]: pgmap v13619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:45:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:13 smithi196 ceph-mon[32572]: pgmap v13619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:45:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:13 smithi110 ceph-mon[28069]: pgmap v13619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:45:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:16 smithi196 ceph-mon[32572]: pgmap v13620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:16 smithi110 ceph-mon[28069]: pgmap v13620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:16 smithi193 ceph-mon[32782]: pgmap v13620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25032.319023 secs 2024-04-26T18:45:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25032.319023 secs 2024-04-26T18:45:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25032.319023 secs 2024-04-26T18:45:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:18 smithi196 ceph-mon[32572]: pgmap v13621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:18 smithi110 ceph-mon[28069]: pgmap v13621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:18 smithi193 ceph-mon[32782]: pgmap v13621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:20 smithi196 ceph-mon[32572]: pgmap v13622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:45:20.510+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:45:20.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:45:20.510+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:45:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:45:20.511+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 194 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:45:20.511 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:45:20.511+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 194 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:45:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:20 smithi110 ceph-mon[28069]: pgmap v13622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:20 smithi193 ceph-mon[32782]: pgmap v13622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:22 smithi196 ceph-mon[32572]: pgmap v13623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25037.319151 secs 2024-04-26T18:45:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:22 smithi110 ceph-mon[28069]: pgmap v13623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25037.319151 secs 2024-04-26T18:45:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:22 smithi193 ceph-mon[32782]: pgmap v13623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25037.319151 secs 2024-04-26T18:45:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:24 smithi196 ceph-mon[32572]: pgmap v13624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:24 smithi110 ceph-mon[28069]: pgmap v13624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:24 smithi193 ceph-mon[32782]: pgmap v13624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:26 smithi196 ceph-mon[32572]: pgmap v13625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:26 smithi110 ceph-mon[28069]: pgmap v13625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:26 smithi193 ceph-mon[32782]: pgmap v13625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25042.319296 secs 2024-04-26T18:45:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25042.319296 secs 2024-04-26T18:45:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25042.319296 secs 2024-04-26T18:45:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:28 smithi196 ceph-mon[32572]: pgmap v13626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:28 smithi110 ceph-mon[28069]: pgmap v13626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:28 smithi193 ceph-mon[32782]: pgmap v13626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:30 smithi196 ceph-mon[32572]: pgmap v13627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:45:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:30 smithi110 ceph-mon[28069]: pgmap v13627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:45:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:30 smithi193 ceph-mon[32782]: pgmap v13627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:45:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:45:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:45:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:45:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:45:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:45:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:45:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:32 smithi196 ceph-mon[32572]: pgmap v13628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:45:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:45:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:32 smithi196 ceph-mon[32572]: pgmap v13629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 1 op/s 2024-04-26T18:45:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:32 smithi196 ceph-mon[32572]: pgmap v13630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 602 B/s rd, 1 op/s 2024-04-26T18:45:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:45:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25047.319429 secs 2024-04-26T18:45:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:32 smithi110 ceph-mon[28069]: pgmap v13628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:45:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:45:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:32 smithi110 ceph-mon[28069]: pgmap v13629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 1 op/s 2024-04-26T18:45:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:32 smithi110 ceph-mon[28069]: pgmap v13630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 602 B/s rd, 1 op/s 2024-04-26T18:45:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:45:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25047.319429 secs 2024-04-26T18:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:32 smithi193 ceph-mon[32782]: pgmap v13628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:32 smithi193 ceph-mon[32782]: pgmap v13629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 1 op/s 2024-04-26T18:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:32 smithi193 ceph-mon[32782]: pgmap v13630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 602 B/s rd, 1 op/s 2024-04-26T18:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25047.319429 secs 2024-04-26T18:45:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:34 smithi196 ceph-mon[32572]: pgmap v13631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:34 smithi110 ceph-mon[28069]: pgmap v13631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:34 smithi193 ceph-mon[32782]: pgmap v13631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:36 smithi196 ceph-mon[32572]: pgmap v13632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:36 smithi110 ceph-mon[28069]: pgmap v13632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:36 smithi193 ceph-mon[32782]: pgmap v13632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25052.319544 secs 2024-04-26T18:45:38.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25052.319544 secs 2024-04-26T18:45:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25052.319544 secs 2024-04-26T18:45:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:38 smithi196 ceph-mon[32572]: pgmap v13633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:38 smithi110 ceph-mon[28069]: pgmap v13633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:38 smithi193 ceph-mon[32782]: pgmap v13633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:40 smithi196 ceph-mon[32572]: pgmap v13634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:40 smithi110 ceph-mon[28069]: pgmap v13634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:40 smithi193 ceph-mon[32782]: pgmap v13634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:42 smithi196 ceph-mon[32572]: pgmap v13635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:45:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25057.319639 secs 2024-04-26T18:45:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:42 smithi110 ceph-mon[28069]: pgmap v13635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:45:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25057.319639 secs 2024-04-26T18:45:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:42 smithi193 ceph-mon[32782]: pgmap v13635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:45:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25057.319639 secs 2024-04-26T18:45:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:44 smithi196 ceph-mon[32572]: pgmap v13636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:44 smithi110 ceph-mon[28069]: pgmap v13636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:44 smithi193 ceph-mon[32782]: pgmap v13636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:46 smithi196 ceph-mon[32572]: pgmap v13637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:46 smithi110 ceph-mon[28069]: pgmap v13637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:46 smithi193 ceph-mon[32782]: pgmap v13637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25062.319710 secs 2024-04-26T18:45:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25062.319710 secs 2024-04-26T18:45:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25062.319710 secs 2024-04-26T18:45:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:48 smithi196 ceph-mon[32572]: pgmap v13638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:48 smithi110 ceph-mon[28069]: pgmap v13638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:48 smithi193 ceph-mon[32782]: pgmap v13638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:50 smithi196 ceph-mon[32572]: pgmap v13639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:50 smithi110 ceph-mon[28069]: pgmap v13639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:50 smithi193 ceph-mon[32782]: pgmap v13639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:52 smithi196 ceph-mon[32572]: pgmap v13640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25067.319780 secs 2024-04-26T18:45:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:52 smithi110 ceph-mon[28069]: pgmap v13640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25067.319780 secs 2024-04-26T18:45:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:52 smithi193 ceph-mon[32782]: pgmap v13640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25067.319780 secs 2024-04-26T18:45:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:54 smithi196 ceph-mon[32572]: pgmap v13641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:54 smithi110 ceph-mon[28069]: pgmap v13641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:54 smithi193 ceph-mon[32782]: pgmap v13641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:56 smithi196 ceph-mon[32572]: pgmap v13642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:56 smithi110 ceph-mon[28069]: pgmap v13642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:56 smithi193 ceph-mon[32782]: pgmap v13642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:45:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25072.319926 secs 2024-04-26T18:45:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25072.319926 secs 2024-04-26T18:45:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25072.319926 secs 2024-04-26T18:45:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:45:58 smithi196 ceph-mon[32572]: pgmap v13643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:45:58 smithi110 ceph-mon[28069]: pgmap v13643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:45:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:45:58 smithi193 ceph-mon[32782]: pgmap v13643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:00 smithi196 ceph-mon[32572]: pgmap v13644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:00 smithi110 ceph-mon[28069]: pgmap v13644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:00 smithi193 ceph-mon[32782]: pgmap v13644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:02 smithi196 ceph-mon[32572]: pgmap v13645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25077.320007 secs 2024-04-26T18:46:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:02 smithi110 ceph-mon[28069]: pgmap v13645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25077.320007 secs 2024-04-26T18:46:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:02 smithi193 ceph-mon[32782]: pgmap v13645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25077.320007 secs 2024-04-26T18:46:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:04 smithi196 ceph-mon[32572]: pgmap v13646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:04 smithi110 ceph-mon[28069]: pgmap v13646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:04 smithi193 ceph-mon[32782]: pgmap v13646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:06 smithi196 ceph-mon[32572]: pgmap v13647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:06 smithi110 ceph-mon[28069]: pgmap v13647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:06 smithi193 ceph-mon[32782]: pgmap v13647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:08.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25082.320133 secs 2024-04-26T18:46:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25082.320133 secs 2024-04-26T18:46:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25082.320133 secs 2024-04-26T18:46:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:08 smithi110 ceph-mon[28069]: pgmap v13648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:08 smithi193 ceph-mon[32782]: pgmap v13648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:08 smithi196 ceph-mon[32572]: pgmap v13648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:10 smithi110 ceph-mon[28069]: pgmap v13649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:10 smithi193 ceph-mon[32782]: pgmap v13649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:10 smithi196 ceph-mon[32572]: pgmap v13649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:12 smithi110 ceph-mon[28069]: pgmap v13650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25087.320258 secs 2024-04-26T18:46:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:12 smithi193 ceph-mon[32782]: pgmap v13650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25087.320258 secs 2024-04-26T18:46:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:12 smithi196 ceph-mon[32572]: pgmap v13650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25087.320258 secs 2024-04-26T18:46:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:14 smithi110 ceph-mon[28069]: pgmap v13651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:14 smithi193 ceph-mon[32782]: pgmap v13651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:14 smithi196 ceph-mon[32572]: pgmap v13651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:16 smithi110 ceph-mon[28069]: pgmap v13652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:16 smithi193 ceph-mon[32782]: pgmap v13652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:16 smithi196 ceph-mon[32572]: pgmap v13652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:17 smithi110 ceph-mon[28069]: 21 slow requests, 1 included below; oldest blocked for > 25092.320380 secs 2024-04-26T18:46:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:17 smithi110 ceph-mon[28069]: slow request 724.535942 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:46:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:17 smithi193 ceph-mon[32782]: 21 slow requests, 1 included below; oldest blocked for > 25092.320380 secs 2024-04-26T18:46:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:17 smithi193 ceph-mon[32782]: slow request 724.535942 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:46:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:17 smithi196 ceph-mon[32572]: 21 slow requests, 1 included below; oldest blocked for > 25092.320380 secs 2024-04-26T18:46:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:17 smithi196 ceph-mon[32572]: slow request 724.535942 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:46:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:18 smithi110 ceph-mon[28069]: pgmap v13653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:18 smithi193 ceph-mon[32782]: pgmap v13653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:18 smithi196 ceph-mon[32572]: pgmap v13653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:19 smithi193 ceph-mon[32782]: pgmap v13654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:19 smithi196 ceph-mon[32572]: pgmap v13654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:19 smithi110 ceph-mon[28069]: pgmap v13654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:22 smithi196 ceph-mon[32572]: pgmap v13655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25097.320470 secs 2024-04-26T18:46:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:22 smithi110 ceph-mon[28069]: pgmap v13655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25097.320470 secs 2024-04-26T18:46:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:22 smithi193 ceph-mon[32782]: pgmap v13655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25097.320470 secs 2024-04-26T18:46:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:24 smithi196 ceph-mon[32572]: pgmap v13656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:24 smithi110 ceph-mon[28069]: pgmap v13656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:24 smithi193 ceph-mon[32782]: pgmap v13656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:26 smithi196 ceph-mon[32572]: pgmap v13657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:26 smithi110 ceph-mon[28069]: pgmap v13657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:26 smithi193 ceph-mon[32782]: pgmap v13657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25102.320609 secs 2024-04-26T18:46:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25102.320609 secs 2024-04-26T18:46:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25102.320609 secs 2024-04-26T18:46:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:28 smithi196 ceph-mon[32572]: pgmap v13658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:28 smithi110 ceph-mon[28069]: pgmap v13658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:28 smithi193 ceph-mon[32782]: pgmap v13658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:30 smithi196 ceph-mon[32572]: pgmap v13659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:30 smithi110 ceph-mon[28069]: pgmap v13659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:30 smithi193 ceph-mon[32782]: pgmap v13659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:32 smithi196 ceph-mon[32572]: pgmap v13660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25107.320732 secs 2024-04-26T18:46:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:46:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:32 smithi110 ceph-mon[28069]: pgmap v13660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25107.320732 secs 2024-04-26T18:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:32 smithi193 ceph-mon[32782]: pgmap v13660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25107.320732 secs 2024-04-26T18:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:46:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:46:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:46:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:46:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:46:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:46:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:46:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:34 smithi196 ceph-mon[32572]: pgmap v13661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:46:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:34 smithi196 ceph-mon[32572]: pgmap v13662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:34 smithi110 ceph-mon[28069]: pgmap v13661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:46:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:34 smithi110 ceph-mon[28069]: pgmap v13662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:34 smithi193 ceph-mon[32782]: pgmap v13661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:46:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:34 smithi193 ceph-mon[32782]: pgmap v13662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:36 smithi196 ceph-mon[32572]: pgmap v13663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:36 smithi110 ceph-mon[28069]: pgmap v13663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:36 smithi193 ceph-mon[32782]: pgmap v13663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25112.320830 secs 2024-04-26T18:46:38.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25112.320830 secs 2024-04-26T18:46:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25112.320830 secs 2024-04-26T18:46:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:38 smithi196 ceph-mon[32572]: pgmap v13664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:46:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:38 smithi110 ceph-mon[28069]: pgmap v13664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:46:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:38 smithi193 ceph-mon[32782]: pgmap v13664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:46:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:40 smithi196 ceph-mon[32572]: pgmap v13665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:40 smithi110 ceph-mon[28069]: pgmap v13665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:40 smithi193 ceph-mon[32782]: pgmap v13665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:42 smithi196 ceph-mon[32572]: pgmap v13666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25117.320953 secs 2024-04-26T18:46:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:42 smithi110 ceph-mon[28069]: pgmap v13666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25117.320953 secs 2024-04-26T18:46:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:42 smithi193 ceph-mon[32782]: pgmap v13666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:46:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25117.320953 secs 2024-04-26T18:46:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:44 smithi196 ceph-mon[32572]: pgmap v13667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:46:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:44 smithi110 ceph-mon[28069]: pgmap v13667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:46:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:44 smithi193 ceph-mon[32782]: pgmap v13667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:46:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:46 smithi196 ceph-mon[32572]: pgmap v13668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:46 smithi110 ceph-mon[28069]: pgmap v13668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:46 smithi193 ceph-mon[32782]: pgmap v13668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25122.321077 secs 2024-04-26T18:46:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25122.321077 secs 2024-04-26T18:46:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25122.321077 secs 2024-04-26T18:46:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:48 smithi110 ceph-mon[28069]: pgmap v13669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:48 smithi193 ceph-mon[32782]: pgmap v13669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:48 smithi196 ceph-mon[32572]: pgmap v13669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:50 smithi110 ceph-mon[28069]: pgmap v13670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:50 smithi193 ceph-mon[32782]: pgmap v13670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:50 smithi196 ceph-mon[32572]: pgmap v13670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:52 smithi110 ceph-mon[28069]: pgmap v13671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25127.321193 secs 2024-04-26T18:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:52 smithi193 ceph-mon[32782]: pgmap v13671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25127.321193 secs 2024-04-26T18:46:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:52 smithi196 ceph-mon[32572]: pgmap v13671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25127.321193 secs 2024-04-26T18:46:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:54 smithi110 ceph-mon[28069]: pgmap v13672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:54 smithi193 ceph-mon[32782]: pgmap v13672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:54 smithi196 ceph-mon[32572]: pgmap v13672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:46:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:56 smithi110 ceph-mon[28069]: pgmap v13673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:56 smithi193 ceph-mon[32782]: pgmap v13673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:56 smithi196 ceph-mon[32572]: pgmap v13673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25132.321259 secs 2024-04-26T18:46:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25132.321259 secs 2024-04-26T18:46:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25132.321259 secs 2024-04-26T18:46:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:46:58 smithi193 ceph-mon[32782]: pgmap v13674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:46:58 smithi196 ceph-mon[32572]: pgmap v13674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:46:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:46:58 smithi110 ceph-mon[28069]: pgmap v13674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:00 smithi193 ceph-mon[32782]: pgmap v13675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:00 smithi196 ceph-mon[32572]: pgmap v13675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:00 smithi110 ceph-mon[28069]: pgmap v13675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:01 smithi193 ceph-mon[32782]: pgmap v13676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:02.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:01 smithi196 ceph-mon[32572]: pgmap v13676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:02.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:01 smithi110 ceph-mon[28069]: pgmap v13676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25137.321364 secs 2024-04-26T18:47:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25137.321364 secs 2024-04-26T18:47:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25137.321364 secs 2024-04-26T18:47:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:03 smithi193 ceph-mon[32782]: pgmap v13677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:03 smithi196 ceph-mon[32572]: pgmap v13677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:03 smithi110 ceph-mon[28069]: pgmap v13677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:06 smithi196 ceph-mon[32572]: pgmap v13678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:06 smithi110 ceph-mon[28069]: pgmap v13678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:06 smithi193 ceph-mon[32782]: pgmap v13678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25142.321486 secs 2024-04-26T18:47:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25142.321486 secs 2024-04-26T18:47:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25142.321486 secs 2024-04-26T18:47:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:08 smithi196 ceph-mon[32572]: pgmap v13679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:08.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:08 smithi193 ceph-mon[32782]: pgmap v13679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:08 smithi110 ceph-mon[28069]: pgmap v13679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:10 smithi196 ceph-mon[32572]: pgmap v13680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:10 smithi110 ceph-mon[28069]: pgmap v13680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:10 smithi193 ceph-mon[32782]: pgmap v13680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:12 smithi196 ceph-mon[32572]: pgmap v13681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25147.321606 secs 2024-04-26T18:47:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:12 smithi110 ceph-mon[28069]: pgmap v13681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25147.321606 secs 2024-04-26T18:47:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:12 smithi193 ceph-mon[32782]: pgmap v13681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25147.321606 secs 2024-04-26T18:47:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:14 smithi196 ceph-mon[32572]: pgmap v13682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:14 smithi110 ceph-mon[28069]: pgmap v13682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:14 smithi193 ceph-mon[32782]: pgmap v13682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:16 smithi196 ceph-mon[32572]: pgmap v13683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:16 smithi110 ceph-mon[28069]: pgmap v13683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:16 smithi193 ceph-mon[32782]: pgmap v13683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25152.321688 secs 2024-04-26T18:47:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25152.321688 secs 2024-04-26T18:47:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25152.321688 secs 2024-04-26T18:47:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:18 smithi110 ceph-mon[28069]: pgmap v13684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:18 smithi193 ceph-mon[32782]: pgmap v13684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:18 smithi196 ceph-mon[32572]: pgmap v13684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:20 smithi110 ceph-mon[28069]: pgmap v13685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:20 smithi193 ceph-mon[32782]: pgmap v13685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:20 smithi196 ceph-mon[32572]: pgmap v13685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:22 smithi110 ceph-mon[28069]: pgmap v13686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25157.321801 secs 2024-04-26T18:47:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:22 smithi193 ceph-mon[32782]: pgmap v13686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25157.321801 secs 2024-04-26T18:47:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:22 smithi196 ceph-mon[32572]: pgmap v13686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25157.321801 secs 2024-04-26T18:47:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:24 smithi110 ceph-mon[28069]: pgmap v13687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:24 smithi193 ceph-mon[32782]: pgmap v13687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:24 smithi196 ceph-mon[32572]: pgmap v13687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:26 smithi110 ceph-mon[28069]: pgmap v13688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:26 smithi193 ceph-mon[32782]: pgmap v13688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:26 smithi196 ceph-mon[32572]: pgmap v13688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25162.321915 secs 2024-04-26T18:47:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25162.321915 secs 2024-04-26T18:47:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25162.321915 secs 2024-04-26T18:47:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:28 smithi193 ceph-mon[32782]: pgmap v13689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:28 smithi196 ceph-mon[32572]: pgmap v13689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:28 smithi110 ceph-mon[28069]: pgmap v13689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:30 smithi193 ceph-mon[32782]: pgmap v13690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:30 smithi196 ceph-mon[32572]: pgmap v13690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:30 smithi110 ceph-mon[28069]: pgmap v13690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:32.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:32 smithi196 ceph-mon[32572]: pgmap v13691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:32.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25167.322051 secs 2024-04-26T18:47:32.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:32 smithi110 ceph-mon[28069]: pgmap v13691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:32.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25167.322051 secs 2024-04-26T18:47:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:32 smithi193 ceph-mon[32782]: pgmap v13691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25167.322051 secs 2024-04-26T18:47:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:34 smithi193 ceph-mon[32782]: pgmap v13692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:47:34.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:34 smithi110 ceph-mon[28069]: pgmap v13692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:34.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:47:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:34 smithi196 ceph-mon[32572]: pgmap v13692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:47:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: pgmap v13693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: pgmap v13693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: pgmap v13693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:37.685 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:37 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:47:37.685 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:37 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:47:37.685 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:37 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:47:37.685 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:37 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:47:37.685 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25172.322165 secs 2024-04-26T18:47:37.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:37.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:37 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:47:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:37 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:47:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:37 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:47:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:37 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:47:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25172.322165 secs 2024-04-26T18:47:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:37 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:47:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:37 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:47:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:37 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:47:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:37 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:47:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25172.322165 secs 2024-04-26T18:47:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:38 smithi196 ceph-mon[32572]: pgmap v13694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:38.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:38 smithi193 ceph-mon[32782]: pgmap v13694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:38 smithi110 ceph-mon[28069]: pgmap v13694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:47:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:47:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:47:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:47:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: pgmap v13695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:47:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: pgmap v13696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:47:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:47:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:47:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:47:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: pgmap v13695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:47:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: pgmap v13696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: pgmap v13695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: pgmap v13696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:47:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:41 smithi196 ceph-mon[32572]: pgmap v13697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:41 smithi110 ceph-mon[28069]: pgmap v13697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:41 smithi193 ceph-mon[32782]: pgmap v13697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25177.322237 secs 2024-04-26T18:47:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25177.322237 secs 2024-04-26T18:47:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25177.322237 secs 2024-04-26T18:47:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:43 smithi196 ceph-mon[32572]: pgmap v13698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:43 smithi110 ceph-mon[28069]: pgmap v13698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:43 smithi193 ceph-mon[32782]: pgmap v13698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:45 smithi196 ceph-mon[32572]: pgmap v13699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:45 smithi110 ceph-mon[28069]: pgmap v13699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:45 smithi193 ceph-mon[32782]: pgmap v13699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:47 smithi196 ceph-mon[32572]: pgmap v13700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25182.322359 secs 2024-04-26T18:47:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:47 smithi110 ceph-mon[28069]: pgmap v13700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25182.322359 secs 2024-04-26T18:47:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:47 smithi193 ceph-mon[32782]: pgmap v13700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25182.322359 secs 2024-04-26T18:47:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:49 smithi196 ceph-mon[32572]: pgmap v13701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:47:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:49 smithi110 ceph-mon[28069]: pgmap v13701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:47:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:49 smithi193 ceph-mon[32782]: pgmap v13701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:47:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:51 smithi196 ceph-mon[32572]: pgmap v13702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:51 smithi110 ceph-mon[28069]: pgmap v13702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:51 smithi193 ceph-mon[32782]: pgmap v13702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25187.322437 secs 2024-04-26T18:47:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25187.322437 secs 2024-04-26T18:47:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25187.322437 secs 2024-04-26T18:47:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:53 smithi196 ceph-mon[32572]: pgmap v13703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:53 smithi110 ceph-mon[28069]: pgmap v13703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:53 smithi193 ceph-mon[32782]: pgmap v13703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:47:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:55 smithi196 ceph-mon[32572]: pgmap v13704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:55 smithi110 ceph-mon[28069]: pgmap v13704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:55 smithi193 ceph-mon[32782]: pgmap v13704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:57 smithi196 ceph-mon[32572]: pgmap v13705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25192.322535 secs 2024-04-26T18:47:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:57 smithi110 ceph-mon[28069]: pgmap v13705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25192.322535 secs 2024-04-26T18:47:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:57 smithi193 ceph-mon[32782]: pgmap v13705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:47:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25192.322535 secs 2024-04-26T18:48:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:47:59 smithi196 ceph-mon[32572]: pgmap v13706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:47:59 smithi110 ceph-mon[28069]: pgmap v13706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:47:59 smithi193 ceph-mon[32782]: pgmap v13706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:01 smithi196 ceph-mon[32572]: pgmap v13707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:01 smithi110 ceph-mon[28069]: pgmap v13707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:02.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:01 smithi193 ceph-mon[32782]: pgmap v13707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25197.322649 secs 2024-04-26T18:48:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25197.322649 secs 2024-04-26T18:48:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25197.322649 secs 2024-04-26T18:48:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:03 smithi196 ceph-mon[32572]: pgmap v13708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:03 smithi110 ceph-mon[28069]: pgmap v13708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:03 smithi193 ceph-mon[32782]: pgmap v13708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:05 smithi196 ceph-mon[32572]: pgmap v13709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:05 smithi110 ceph-mon[28069]: pgmap v13709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:05 smithi193 ceph-mon[32782]: pgmap v13709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:07 smithi196 ceph-mon[32572]: pgmap v13710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25202.322767 secs 2024-04-26T18:48:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:07 smithi110 ceph-mon[28069]: pgmap v13710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25202.322767 secs 2024-04-26T18:48:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:07 smithi193 ceph-mon[32782]: pgmap v13710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25202.322767 secs 2024-04-26T18:48:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:09 smithi196 ceph-mon[32572]: pgmap v13711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:09 smithi110 ceph-mon[28069]: pgmap v13711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:09 smithi193 ceph-mon[32782]: pgmap v13711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:11 smithi196 ceph-mon[32572]: pgmap v13712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:11 smithi110 ceph-mon[28069]: pgmap v13712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:11 smithi193 ceph-mon[32782]: pgmap v13712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25207.322830 secs 2024-04-26T18:48:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25207.322830 secs 2024-04-26T18:48:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25207.322830 secs 2024-04-26T18:48:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:13 smithi110 ceph-mon[28069]: pgmap v13713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:13 smithi193 ceph-mon[32782]: pgmap v13713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:13 smithi196 ceph-mon[32572]: pgmap v13713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:15 smithi110 ceph-mon[28069]: pgmap v13714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:48:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:15 smithi193 ceph-mon[32782]: pgmap v13714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:48:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:15 smithi196 ceph-mon[32572]: pgmap v13714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:48:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.446+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T18:48:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.446+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:48:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.446+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:48:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.446+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T18:48:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.447+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:48:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.448+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T18:48:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.448+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T18:48:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.449+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T18:48:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.449+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T18:48:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.449+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614037040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:48:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.449+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614037040 comp rx=0 tx=0).stop 2024-04-26T18:48:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.449+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T18:48:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.450+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T18:48:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.450+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:48:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.450+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:48:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.450+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:48:16.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:16.452+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261402d040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:48:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:17 smithi110 ceph-mon[28069]: pgmap v13715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:48:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25212.322956 secs 2024-04-26T18:48:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:17 smithi193 ceph-mon[32782]: pgmap v13715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:48:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25212.322956 secs 2024-04-26T18:48:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:17 smithi196 ceph-mon[32572]: pgmap v13715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:48:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25212.322956 secs 2024-04-26T18:48:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:19 smithi110 ceph-mon[28069]: pgmap v13716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:19 smithi193 ceph-mon[32782]: pgmap v13716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:19 smithi196 ceph-mon[32572]: pgmap v13716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:20.540+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:48:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:20.540+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:48:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:20.541+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 195 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:48:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:48:20.541+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 195 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:48:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:21 smithi110 ceph-mon[28069]: pgmap v13717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:48:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:21 smithi193 ceph-mon[32782]: pgmap v13717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:48:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:21 smithi196 ceph-mon[32572]: pgmap v13717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:48:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25217.323079 secs 2024-04-26T18:48:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25217.323079 secs 2024-04-26T18:48:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25217.323079 secs 2024-04-26T18:48:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:23 smithi110 ceph-mon[28069]: pgmap v13718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:23 smithi193 ceph-mon[32782]: pgmap v13718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:23 smithi196 ceph-mon[32572]: pgmap v13718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:25 smithi193 ceph-mon[32782]: pgmap v13719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:25 smithi196 ceph-mon[32572]: pgmap v13719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:25 smithi110 ceph-mon[28069]: pgmap v13719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:27 smithi193 ceph-mon[32782]: pgmap v13720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25222.323218 secs 2024-04-26T18:48:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:27 smithi196 ceph-mon[32572]: pgmap v13720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25222.323218 secs 2024-04-26T18:48:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:27 smithi110 ceph-mon[28069]: pgmap v13720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25222.323218 secs 2024-04-26T18:48:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:29 smithi193 ceph-mon[32782]: pgmap v13721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:29 smithi196 ceph-mon[32572]: pgmap v13721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:29 smithi110 ceph-mon[28069]: pgmap v13721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:32.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:31 smithi196 ceph-mon[32572]: pgmap v13722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:32.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:31 smithi110 ceph-mon[28069]: pgmap v13722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:31 smithi193 ceph-mon[32782]: pgmap v13722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25227.323334 secs 2024-04-26T18:48:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25227.323334 secs 2024-04-26T18:48:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25227.323334 secs 2024-04-26T18:48:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:33 smithi193 ceph-mon[32782]: pgmap v13723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:33 smithi196 ceph-mon[32572]: pgmap v13723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:33 smithi110 ceph-mon[28069]: pgmap v13723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:34 smithi193 ceph-mon[32782]: pgmap v13724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:34 smithi196 ceph-mon[32572]: pgmap v13724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:34 smithi110 ceph-mon[28069]: pgmap v13724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:37 smithi196 ceph-mon[32572]: pgmap v13725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25232.323452 secs 2024-04-26T18:48:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:37 smithi110 ceph-mon[28069]: pgmap v13725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25232.323452 secs 2024-04-26T18:48:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:37 smithi193 ceph-mon[32782]: pgmap v13725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25232.323452 secs 2024-04-26T18:48:39.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:39 smithi193 ceph-mon[32782]: pgmap v13726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:39.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:48:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:39 smithi196 ceph-mon[32572]: pgmap v13726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:48:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:39 smithi110 ceph-mon[28069]: pgmap v13726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:48:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:48:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:48:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:48:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:48:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:48:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:48:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:48:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:48:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:48:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:41 smithi196 ceph-mon[32572]: pgmap v13727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:48:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:41 smithi196 ceph-mon[32572]: pgmap v13728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:41 smithi110 ceph-mon[28069]: pgmap v13727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:48:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:41 smithi110 ceph-mon[28069]: pgmap v13728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:41 smithi193 ceph-mon[32782]: pgmap v13727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:48:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:41 smithi193 ceph-mon[32782]: pgmap v13728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25237.323587 secs 2024-04-26T18:48:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25237.323587 secs 2024-04-26T18:48:43.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25237.323587 secs 2024-04-26T18:48:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:43 smithi196 ceph-mon[32572]: pgmap v13729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:48:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:43 smithi110 ceph-mon[28069]: pgmap v13729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:48:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:43 smithi193 ceph-mon[32782]: pgmap v13729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:48:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:45 smithi196 ceph-mon[32572]: pgmap v13730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:45 smithi110 ceph-mon[28069]: pgmap v13730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:45 smithi193 ceph-mon[32782]: pgmap v13730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:47 smithi196 ceph-mon[32572]: pgmap v13731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25242.323708 secs 2024-04-26T18:48:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:47 smithi110 ceph-mon[28069]: pgmap v13731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25242.323708 secs 2024-04-26T18:48:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:47 smithi193 ceph-mon[32782]: pgmap v13731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25242.323708 secs 2024-04-26T18:48:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:49 smithi196 ceph-mon[32572]: pgmap v13732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:49 smithi110 ceph-mon[28069]: pgmap v13732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:49 smithi193 ceph-mon[32782]: pgmap v13732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:48:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:51 smithi196 ceph-mon[32572]: pgmap v13733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:48:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:51 smithi110 ceph-mon[28069]: pgmap v13733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:48:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:51 smithi193 ceph-mon[32782]: pgmap v13733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:48:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25247.323798 secs 2024-04-26T18:48:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25247.323798 secs 2024-04-26T18:48:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25247.323798 secs 2024-04-26T18:48:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:53 smithi196 ceph-mon[32572]: pgmap v13734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:53 smithi110 ceph-mon[28069]: pgmap v13734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:53 smithi193 ceph-mon[32782]: pgmap v13734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:55 smithi196 ceph-mon[32572]: pgmap v13735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:55 smithi110 ceph-mon[28069]: pgmap v13735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:55 smithi193 ceph-mon[32782]: pgmap v13735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:48:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:57 smithi196 ceph-mon[32572]: pgmap v13736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25252.323915 secs 2024-04-26T18:48:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:57 smithi110 ceph-mon[28069]: pgmap v13736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25252.323915 secs 2024-04-26T18:48:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:57 smithi193 ceph-mon[32782]: pgmap v13736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:48:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25252.323915 secs 2024-04-26T18:49:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:48:59 smithi196 ceph-mon[32572]: pgmap v13737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:48:59 smithi110 ceph-mon[28069]: pgmap v13737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:48:59 smithi193 ceph-mon[32782]: pgmap v13737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:01 smithi196 ceph-mon[32572]: pgmap v13738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:01 smithi110 ceph-mon[28069]: pgmap v13738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:01 smithi193 ceph-mon[32782]: pgmap v13738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25257.324052 secs 2024-04-26T18:49:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25257.324052 secs 2024-04-26T18:49:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25257.324052 secs 2024-04-26T18:49:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:03 smithi110 ceph-mon[28069]: pgmap v13739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:03 smithi193 ceph-mon[32782]: pgmap v13739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:03 smithi196 ceph-mon[32572]: pgmap v13739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:49:05.547+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:49:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:49:05.547+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:49:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:49:05.547+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 196 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:49:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:49:05.547+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 196 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:49:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:05 smithi110 ceph-mon[28069]: pgmap v13740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:05 smithi193 ceph-mon[32782]: pgmap v13740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:05 smithi196 ceph-mon[32572]: pgmap v13740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:07 smithi110 ceph-mon[28069]: pgmap v13741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25262.324174 secs 2024-04-26T18:49:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:07 smithi193 ceph-mon[32782]: pgmap v13741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25262.324174 secs 2024-04-26T18:49:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:07 smithi196 ceph-mon[32572]: pgmap v13741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25262.324174 secs 2024-04-26T18:49:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:09 smithi193 ceph-mon[32782]: pgmap v13742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:09 smithi196 ceph-mon[32572]: pgmap v13742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:09 smithi110 ceph-mon[28069]: pgmap v13742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:11 smithi193 ceph-mon[32782]: pgmap v13743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:11 smithi196 ceph-mon[32572]: pgmap v13743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:11 smithi110 ceph-mon[28069]: pgmap v13743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:12.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:49:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:49:12.466+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:49:12.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:49:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:49:12.466+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:49:12.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:49:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:49:12.466+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:49:12.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:49:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:49:12.466+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:49:12.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:49:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:49:12.466+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:49:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25267.324293 secs 2024-04-26T18:49:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25267.324293 secs 2024-04-26T18:49:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25267.324293 secs 2024-04-26T18:49:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:13 smithi193 ceph-mon[32782]: pgmap v13744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:13 smithi196 ceph-mon[32572]: pgmap v13744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:13 smithi110 ceph-mon[28069]: pgmap v13744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:15 smithi193 ceph-mon[32782]: pgmap v13745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:15 smithi196 ceph-mon[32572]: pgmap v13745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:15 smithi110 ceph-mon[28069]: pgmap v13745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:17 smithi193 ceph-mon[32782]: pgmap v13746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25272.324410 secs 2024-04-26T18:49:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:17 smithi196 ceph-mon[32572]: pgmap v13746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25272.324410 secs 2024-04-26T18:49:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:17 smithi110 ceph-mon[28069]: pgmap v13746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25272.324410 secs 2024-04-26T18:49:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:18 smithi196 ceph-mon[32572]: pgmap v13747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T18:49:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:18 smithi110 ceph-mon[28069]: pgmap v13747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T18:49:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:18 smithi193 ceph-mon[32782]: pgmap v13747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T18:49:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:21 smithi196 ceph-mon[32572]: pgmap v13748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T18:49:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:21 smithi110 ceph-mon[28069]: pgmap v13748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T18:49:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:21 smithi193 ceph-mon[32782]: pgmap v13748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T18:49:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25277.324475 secs 2024-04-26T18:49:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25277.324475 secs 2024-04-26T18:49:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25277.324475 secs 2024-04-26T18:49:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:23 smithi196 ceph-mon[32572]: pgmap v13749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T18:49:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:23 smithi110 ceph-mon[28069]: pgmap v13749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T18:49:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:23 smithi193 ceph-mon[32782]: pgmap v13749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T18:49:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:25 smithi196 ceph-mon[32572]: pgmap v13750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T18:49:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:25 smithi110 ceph-mon[28069]: pgmap v13750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T18:49:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:25 smithi193 ceph-mon[32782]: pgmap v13750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T18:49:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:27 smithi110 ceph-mon[28069]: pgmap v13751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T18:49:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25282.324616 secs 2024-04-26T18:49:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:27 smithi193 ceph-mon[32782]: pgmap v13751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T18:49:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25282.324616 secs 2024-04-26T18:49:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:27 smithi196 ceph-mon[32572]: pgmap v13751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T18:49:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25282.324616 secs 2024-04-26T18:49:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:29 smithi110 ceph-mon[28069]: pgmap v13752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T18:49:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:29 smithi193 ceph-mon[32782]: pgmap v13752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T18:49:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:29 smithi196 ceph-mon[32572]: pgmap v13752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T18:49:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:31 smithi110 ceph-mon[28069]: pgmap v13753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:31 smithi193 ceph-mon[32782]: pgmap v13753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:31 smithi196 ceph-mon[32572]: pgmap v13753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25287.324691 secs 2024-04-26T18:49:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25287.324691 secs 2024-04-26T18:49:32.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25287.324691 secs 2024-04-26T18:49:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:33 smithi110 ceph-mon[28069]: pgmap v13754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:33 smithi193 ceph-mon[32782]: pgmap v13754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:33 smithi196 ceph-mon[32572]: pgmap v13754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:35 smithi110 ceph-mon[28069]: pgmap v13755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:35 smithi193 ceph-mon[32782]: pgmap v13755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:35 smithi196 ceph-mon[32572]: pgmap v13755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:37 smithi193 ceph-mon[32782]: pgmap v13756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25292.324790 secs 2024-04-26T18:49:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:37 smithi196 ceph-mon[32572]: pgmap v13756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25292.324790 secs 2024-04-26T18:49:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:37 smithi110 ceph-mon[28069]: pgmap v13756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25292.324790 secs 2024-04-26T18:49:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:39 smithi193 ceph-mon[32782]: pgmap v13757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:39 smithi196 ceph-mon[32572]: pgmap v13757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:39 smithi110 ceph-mon[28069]: pgmap v13757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:41 smithi193 ceph-mon[32782]: pgmap v13758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:49:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:41 smithi196 ceph-mon[32572]: pgmap v13758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:49:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:41 smithi110 ceph-mon[28069]: pgmap v13758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:49:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25297.324850 secs 2024-04-26T18:49:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:49:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:49:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:42 smithi193 ceph-mon[32782]: pgmap v13759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:49:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:42 smithi193 ceph-mon[32782]: pgmap v13760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:49:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:49:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25297.324850 secs 2024-04-26T18:49:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:49:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:49:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:42 smithi196 ceph-mon[32572]: pgmap v13759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:49:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:42 smithi196 ceph-mon[32572]: pgmap v13760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:49:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:49:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25297.324850 secs 2024-04-26T18:49:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:49:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:49:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:42 smithi110 ceph-mon[28069]: pgmap v13759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:49:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:42 smithi110 ceph-mon[28069]: pgmap v13760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:49:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:49:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:44 smithi110 ceph-mon[28069]: pgmap v13761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:44 smithi193 ceph-mon[32782]: pgmap v13761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:44 smithi196 ceph-mon[32572]: pgmap v13761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:46 smithi110 ceph-mon[28069]: pgmap v13762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:46 smithi193 ceph-mon[32782]: pgmap v13762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:46 smithi196 ceph-mon[32572]: pgmap v13762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25302.324974 secs 2024-04-26T18:49:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25302.324974 secs 2024-04-26T18:49:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25302.324974 secs 2024-04-26T18:49:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:48 smithi193 ceph-mon[32782]: pgmap v13763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:48 smithi196 ceph-mon[32572]: pgmap v13763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:48 smithi110 ceph-mon[28069]: pgmap v13763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:50 smithi193 ceph-mon[32782]: pgmap v13764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:50 smithi196 ceph-mon[32572]: pgmap v13764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:50 smithi110 ceph-mon[28069]: pgmap v13764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:49:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25307.325107 secs 2024-04-26T18:49:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:52 smithi193 ceph-mon[32782]: pgmap v13765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:49:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25307.325107 secs 2024-04-26T18:49:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:52 smithi196 ceph-mon[32572]: pgmap v13765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:49:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25307.325107 secs 2024-04-26T18:49:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:52 smithi110 ceph-mon[28069]: pgmap v13765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:49:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:54 smithi193 ceph-mon[32782]: pgmap v13766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:54 smithi196 ceph-mon[32572]: pgmap v13766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:54 smithi110 ceph-mon[28069]: pgmap v13766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:56 smithi193 ceph-mon[32782]: pgmap v13767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:56 smithi196 ceph-mon[32572]: pgmap v13767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:56 smithi110 ceph-mon[28069]: pgmap v13767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:49:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25312.325242 secs 2024-04-26T18:49:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25312.325242 secs 2024-04-26T18:49:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25312.325242 secs 2024-04-26T18:49:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:49:58 smithi193 ceph-mon[32782]: pgmap v13768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:49:58 smithi196 ceph-mon[32572]: pgmap v13768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:49:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:49:58 smithi110 ceph-mon[28069]: pgmap v13768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:00 smithi193 ceph-mon[32782]: pgmap v13769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:50:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:00 smithi196 ceph-mon[32572]: pgmap v13769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:50:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:00 smithi110 ceph-mon[28069]: pgmap v13769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T18:50:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:01 smithi193 ceph-mon[32782]: pgmap v13770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:02.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:01 smithi196 ceph-mon[32572]: pgmap v13770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:02.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:01 smithi110 ceph-mon[28069]: pgmap v13770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25317.325364 secs 2024-04-26T18:50:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25317.325364 secs 2024-04-26T18:50:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25317.325364 secs 2024-04-26T18:50:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:03 smithi193 ceph-mon[32782]: pgmap v13771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:03 smithi196 ceph-mon[32572]: pgmap v13771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:03 smithi110 ceph-mon[28069]: pgmap v13771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:06 smithi110 ceph-mon[28069]: pgmap v13772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:06 smithi193 ceph-mon[32782]: pgmap v13772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:06 smithi196 ceph-mon[32572]: pgmap v13772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25322.325499 secs 2024-04-26T18:50:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25322.325499 secs 2024-04-26T18:50:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25322.325499 secs 2024-04-26T18:50:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:08 smithi193 ceph-mon[32782]: pgmap v13773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:08 smithi196 ceph-mon[32572]: pgmap v13773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:08 smithi110 ceph-mon[28069]: pgmap v13773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:10 smithi193 ceph-mon[32782]: pgmap v13774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:10 smithi196 ceph-mon[32572]: pgmap v13774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:10 smithi110 ceph-mon[28069]: pgmap v13774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25327.325636 secs 2024-04-26T18:50:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:12 smithi193 ceph-mon[32782]: pgmap v13775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25327.325636 secs 2024-04-26T18:50:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:12 smithi196 ceph-mon[32572]: pgmap v13775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25327.325636 secs 2024-04-26T18:50:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:12 smithi110 ceph-mon[28069]: pgmap v13775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:14 smithi193 ceph-mon[32782]: pgmap v13776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:14 smithi196 ceph-mon[32572]: pgmap v13776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:14 smithi110 ceph-mon[28069]: pgmap v13776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:17.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:16 smithi193 ceph-mon[32782]: pgmap v13777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:16 smithi196 ceph-mon[32572]: pgmap v13777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:16 smithi110 ceph-mon[28069]: pgmap v13777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25332.325744 secs 2024-04-26T18:50:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25332.325744 secs 2024-04-26T18:50:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25332.325744 secs 2024-04-26T18:50:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:18 smithi193 ceph-mon[32782]: pgmap v13778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:18 smithi196 ceph-mon[32572]: pgmap v13778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:18 smithi110 ceph-mon[28069]: pgmap v13778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:20 smithi193 ceph-mon[32782]: pgmap v13779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:20 smithi196 ceph-mon[32572]: pgmap v13779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:20 smithi110 ceph-mon[28069]: pgmap v13779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:21 smithi193 ceph-mon[32782]: pgmap v13780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:21 smithi196 ceph-mon[32572]: pgmap v13780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:21 smithi110 ceph-mon[28069]: pgmap v13780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25337.325855 secs 2024-04-26T18:50:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25337.325855 secs 2024-04-26T18:50:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25337.325855 secs 2024-04-26T18:50:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:23 smithi193 ceph-mon[32782]: pgmap v13781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:23 smithi196 ceph-mon[32572]: pgmap v13781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:23 smithi110 ceph-mon[28069]: pgmap v13781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:26 smithi193 ceph-mon[32782]: pgmap v13782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:26 smithi196 ceph-mon[32572]: pgmap v13782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:26 smithi110 ceph-mon[28069]: pgmap v13782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25342.325941 secs 2024-04-26T18:50:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25342.325941 secs 2024-04-26T18:50:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25342.325941 secs 2024-04-26T18:50:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:28 smithi193 ceph-mon[32782]: pgmap v13783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:28 smithi196 ceph-mon[32572]: pgmap v13783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:28 smithi110 ceph-mon[28069]: pgmap v13783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:30 smithi193 ceph-mon[32782]: pgmap v13784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:30 smithi196 ceph-mon[32572]: pgmap v13784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:30 smithi110 ceph-mon[28069]: pgmap v13784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:33.074 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25347.326059 secs 2024-04-26T18:50:33.074 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:32 smithi196 ceph-mon[32572]: pgmap v13785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:33.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25347.326059 secs 2024-04-26T18:50:33.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:32 smithi110 ceph-mon[28069]: pgmap v13785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25347.326059 secs 2024-04-26T18:50:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:32 smithi193 ceph-mon[32782]: pgmap v13785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:34 smithi193 ceph-mon[32782]: pgmap v13786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:34 smithi196 ceph-mon[32572]: pgmap v13786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:34 smithi110 ceph-mon[28069]: pgmap v13786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:36 smithi193 ceph-mon[32782]: pgmap v13787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:36 smithi196 ceph-mon[32572]: pgmap v13787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:36 smithi110 ceph-mon[28069]: pgmap v13787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25352.326193 secs 2024-04-26T18:50:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25352.326193 secs 2024-04-26T18:50:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25352.326193 secs 2024-04-26T18:50:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:38 smithi193 ceph-mon[32782]: pgmap v13788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:38 smithi196 ceph-mon[32572]: pgmap v13788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:38 smithi110 ceph-mon[28069]: pgmap v13788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:39 smithi193 ceph-mon[32782]: pgmap v13789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:39 smithi196 ceph-mon[32572]: pgmap v13789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:39 smithi110 ceph-mon[28069]: pgmap v13789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25357.326289 secs 2024-04-26T18:50:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:42 smithi193 ceph-mon[32782]: pgmap v13790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:50:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25357.326289 secs 2024-04-26T18:50:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:42 smithi196 ceph-mon[32572]: pgmap v13790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:50:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25357.326289 secs 2024-04-26T18:50:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:42 smithi110 ceph-mon[28069]: pgmap v13790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:50:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:50:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:50:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:50:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:50:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:50:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:50:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:50:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:50:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:50:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:44 smithi193 ceph-mon[32782]: pgmap v13791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:50:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:44 smithi193 ceph-mon[32782]: pgmap v13792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:44 smithi196 ceph-mon[32572]: pgmap v13791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:50:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:44 smithi196 ceph-mon[32572]: pgmap v13792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:44 smithi110 ceph-mon[28069]: pgmap v13791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:50:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:44 smithi110 ceph-mon[28069]: pgmap v13792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:46 smithi193 ceph-mon[32782]: pgmap v13793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:46 smithi196 ceph-mon[32572]: pgmap v13793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:46 smithi110 ceph-mon[28069]: pgmap v13793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25362.326409 secs 2024-04-26T18:50:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25362.326409 secs 2024-04-26T18:50:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25362.326409 secs 2024-04-26T18:50:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:48 smithi193 ceph-mon[32782]: pgmap v13794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:50:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:48 smithi196 ceph-mon[32572]: pgmap v13794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:50:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:48 smithi110 ceph-mon[28069]: pgmap v13794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:50:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:50 smithi193 ceph-mon[32782]: pgmap v13795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:50 smithi196 ceph-mon[32572]: pgmap v13795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:50 smithi110 ceph-mon[28069]: pgmap v13795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:52 smithi193 ceph-mon[32782]: pgmap v13796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25367.326544 secs 2024-04-26T18:50:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:52 smithi196 ceph-mon[32572]: pgmap v13796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25367.326544 secs 2024-04-26T18:50:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:52 smithi110 ceph-mon[28069]: pgmap v13796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:50:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25367.326544 secs 2024-04-26T18:50:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:53 smithi193 ceph-mon[32782]: pgmap v13797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:50:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:53 smithi196 ceph-mon[32572]: pgmap v13797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:50:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:53 smithi110 ceph-mon[28069]: pgmap v13797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:50:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:56 smithi193 ceph-mon[32782]: pgmap v13798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:56 smithi196 ceph-mon[32572]: pgmap v13798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:56 smithi110 ceph-mon[28069]: pgmap v13798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:50:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25372.326662 secs 2024-04-26T18:50:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25372.326662 secs 2024-04-26T18:50:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25372.326662 secs 2024-04-26T18:50:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:50:58 smithi193 ceph-mon[32782]: pgmap v13799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:50:58 smithi196 ceph-mon[32572]: pgmap v13799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:50:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:50:58 smithi110 ceph-mon[28069]: pgmap v13799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:00 smithi193 ceph-mon[32782]: pgmap v13800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:00 smithi196 ceph-mon[32572]: pgmap v13800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:00 smithi110 ceph-mon[28069]: pgmap v13800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:02 smithi193 ceph-mon[32782]: pgmap v13801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25377.326755 secs 2024-04-26T18:51:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:02 smithi196 ceph-mon[32572]: pgmap v13801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25377.326755 secs 2024-04-26T18:51:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:02 smithi110 ceph-mon[28069]: pgmap v13801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25377.326755 secs 2024-04-26T18:51:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:04 smithi193 ceph-mon[32782]: pgmap v13802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:04 smithi196 ceph-mon[32572]: pgmap v13802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:04 smithi110 ceph-mon[28069]: pgmap v13802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:06 smithi196 ceph-mon[32572]: pgmap v13803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:06 smithi110 ceph-mon[28069]: pgmap v13803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:06.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:06 smithi193 ceph-mon[32782]: pgmap v13803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25382.326822 secs 2024-04-26T18:51:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25382.326822 secs 2024-04-26T18:51:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25382.326822 secs 2024-04-26T18:51:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:08 smithi196 ceph-mon[32572]: pgmap v13804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:08 smithi110 ceph-mon[28069]: pgmap v13804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:08 smithi193 ceph-mon[32782]: pgmap v13804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:10.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:10 smithi193 ceph-mon[32782]: pgmap v13805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:10 smithi196 ceph-mon[32572]: pgmap v13805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:10 smithi110 ceph-mon[28069]: pgmap v13805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:12 smithi196 ceph-mon[32572]: pgmap v13806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:12 smithi196 ceph-mon[32572]: 21 slow requests, 1 included below; oldest blocked for > 25387.326940 secs 2024-04-26T18:51:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:12 smithi196 ceph-mon[32572]: slow request 11524.663073 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:51:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:12 smithi110 ceph-mon[28069]: pgmap v13806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:12 smithi110 ceph-mon[28069]: 21 slow requests, 1 included below; oldest blocked for > 25387.326940 secs 2024-04-26T18:51:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:12 smithi110 ceph-mon[28069]: slow request 11524.663073 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:51:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:12 smithi193 ceph-mon[32782]: pgmap v13806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:12 smithi193 ceph-mon[32782]: 21 slow requests, 1 included below; oldest blocked for > 25387.326940 secs 2024-04-26T18:51:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:12 smithi193 ceph-mon[32782]: slow request 11524.663073 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:51:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:14 smithi196 ceph-mon[32572]: pgmap v13807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:14 smithi110 ceph-mon[28069]: pgmap v13807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:14 smithi193 ceph-mon[32782]: pgmap v13807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:16 smithi196 ceph-mon[32572]: pgmap v13808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:16 smithi110 ceph-mon[28069]: pgmap v13808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:16 smithi193 ceph-mon[32782]: pgmap v13808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25392.327016 secs 2024-04-26T18:51:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25392.327016 secs 2024-04-26T18:51:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25392.327016 secs 2024-04-26T18:51:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:18 smithi196 ceph-mon[32572]: pgmap v13809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:18 smithi110 ceph-mon[28069]: pgmap v13809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:18 smithi193 ceph-mon[32782]: pgmap v13809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:51:20.570+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:51:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:51:20.570+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:51:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:51:20.570+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 197 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:51:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:51:20.571+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 197 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:51:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:20 smithi196 ceph-mon[32572]: pgmap v13810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:20 smithi110 ceph-mon[28069]: pgmap v13810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:20 smithi193 ceph-mon[32782]: pgmap v13810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:22 smithi196 ceph-mon[32572]: pgmap v13811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25397.327088 secs 2024-04-26T18:51:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:22 smithi110 ceph-mon[28069]: pgmap v13811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25397.327088 secs 2024-04-26T18:51:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:22 smithi193 ceph-mon[32782]: pgmap v13811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25397.327088 secs 2024-04-26T18:51:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:24 smithi196 ceph-mon[32572]: pgmap v13812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:24 smithi110 ceph-mon[28069]: pgmap v13812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:24 smithi193 ceph-mon[32782]: pgmap v13812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:26 smithi196 ceph-mon[32572]: pgmap v13813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:26 smithi110 ceph-mon[28069]: pgmap v13813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:26 smithi193 ceph-mon[32782]: pgmap v13813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25402.327159 secs 2024-04-26T18:51:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25402.327159 secs 2024-04-26T18:51:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25402.327159 secs 2024-04-26T18:51:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:28 smithi196 ceph-mon[32572]: pgmap v13814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:28 smithi110 ceph-mon[28069]: pgmap v13814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:28 smithi193 ceph-mon[32782]: pgmap v13814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:30 smithi196 ceph-mon[32572]: pgmap v13815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:30 smithi110 ceph-mon[28069]: pgmap v13815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:30 smithi193 ceph-mon[32782]: pgmap v13815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:32 smithi196 ceph-mon[32572]: pgmap v13816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25407.327297 secs 2024-04-26T18:51:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:32 smithi110 ceph-mon[28069]: pgmap v13816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25407.327297 secs 2024-04-26T18:51:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:32 smithi193 ceph-mon[32782]: pgmap v13816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25407.327297 secs 2024-04-26T18:51:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:34 smithi196 ceph-mon[32572]: pgmap v13817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:34 smithi110 ceph-mon[28069]: pgmap v13817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:34 smithi193 ceph-mon[32782]: pgmap v13817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:36 smithi196 ceph-mon[32572]: pgmap v13818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:36 smithi110 ceph-mon[28069]: pgmap v13818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:36 smithi193 ceph-mon[32782]: pgmap v13818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25412.327386 secs 2024-04-26T18:51:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25412.327386 secs 2024-04-26T18:51:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25412.327386 secs 2024-04-26T18:51:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:38 smithi196 ceph-mon[32572]: pgmap v13819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:38 smithi110 ceph-mon[28069]: pgmap v13819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:38 smithi193 ceph-mon[32782]: pgmap v13819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:40 smithi196 ceph-mon[32572]: pgmap v13820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:40 smithi110 ceph-mon[28069]: pgmap v13820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:40 smithi193 ceph-mon[32782]: pgmap v13820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:51:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:42 smithi196 ceph-mon[32572]: pgmap v13821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25417.327488 secs 2024-04-26T18:51:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:42 smithi110 ceph-mon[28069]: pgmap v13821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25417.327488 secs 2024-04-26T18:51:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:42 smithi193 ceph-mon[32782]: pgmap v13821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25417.327488 secs 2024-04-26T18:51:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:44 smithi196 ceph-mon[32572]: pgmap v13822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:51:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:44 smithi110 ceph-mon[28069]: pgmap v13822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:51:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:44 smithi193 ceph-mon[32782]: pgmap v13822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:51:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:51:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:51:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:45 smithi196 ceph-mon[32572]: pgmap v13823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:51:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:45 smithi196 ceph-mon[32572]: pgmap v13824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:51:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:51:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:51:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:45 smithi110 ceph-mon[28069]: pgmap v13823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:51:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:45 smithi110 ceph-mon[28069]: pgmap v13824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:51:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:51:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:51:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:45 smithi193 ceph-mon[32782]: pgmap v13823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T18:51:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:45 smithi193 ceph-mon[32782]: pgmap v13824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:51:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:46 smithi196 ceph-mon[32572]: pgmap v13825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:51:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:46 smithi110 ceph-mon[28069]: pgmap v13825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:51:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:46 smithi193 ceph-mon[32782]: pgmap v13825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T18:51:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25422.327585 secs 2024-04-26T18:51:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25422.327585 secs 2024-04-26T18:51:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25422.327585 secs 2024-04-26T18:51:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:48 smithi196 ceph-mon[32572]: pgmap v13826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:48 smithi110 ceph-mon[28069]: pgmap v13826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:48 smithi193 ceph-mon[32782]: pgmap v13826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:50 smithi196 ceph-mon[32572]: pgmap v13827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:50 smithi110 ceph-mon[28069]: pgmap v13827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:50 smithi193 ceph-mon[32782]: pgmap v13827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25427.327664 secs 2024-04-26T18:51:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25427.327664 secs 2024-04-26T18:51:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25427.327664 secs 2024-04-26T18:51:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:53 smithi193 ceph-mon[32782]: pgmap v13828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:53 smithi196 ceph-mon[32572]: pgmap v13828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:53 smithi110 ceph-mon[28069]: pgmap v13828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:51:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:54 smithi196 ceph-mon[32572]: pgmap v13829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:51:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:54 smithi110 ceph-mon[28069]: pgmap v13829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:51:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:54 smithi193 ceph-mon[32782]: pgmap v13829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:51:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:56 smithi196 ceph-mon[32572]: pgmap v13830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:56 smithi110 ceph-mon[28069]: pgmap v13830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:56 smithi193 ceph-mon[32782]: pgmap v13830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:51:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25432.327781 secs 2024-04-26T18:51:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25432.327781 secs 2024-04-26T18:51:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25432.327781 secs 2024-04-26T18:51:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:51:58 smithi196 ceph-mon[32572]: pgmap v13831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:51:58 smithi110 ceph-mon[28069]: pgmap v13831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:51:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:51:58 smithi193 ceph-mon[32782]: pgmap v13831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:00 smithi196 ceph-mon[32572]: pgmap v13832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:00 smithi110 ceph-mon[28069]: pgmap v13832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:00 smithi193 ceph-mon[32782]: pgmap v13832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:02.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25437.327878 secs 2024-04-26T18:52:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25437.327878 secs 2024-04-26T18:52:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25437.327878 secs 2024-04-26T18:52:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:03 smithi193 ceph-mon[32782]: pgmap v13833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:03 smithi196 ceph-mon[32572]: pgmap v13833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:03 smithi110 ceph-mon[28069]: pgmap v13833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:06.207 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:05 smithi196 ceph-mon[32572]: pgmap v13834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:06.242 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:05 smithi110 ceph-mon[28069]: pgmap v13834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:05 smithi193 ceph-mon[32782]: pgmap v13834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25442.327999 secs 2024-04-26T18:52:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:07 smithi196 ceph-mon[32572]: pgmap v13835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25442.327999 secs 2024-04-26T18:52:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:07 smithi110 ceph-mon[28069]: pgmap v13835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25442.327999 secs 2024-04-26T18:52:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:07 smithi193 ceph-mon[32782]: pgmap v13835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:09 smithi196 ceph-mon[32572]: pgmap v13836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:09 smithi110 ceph-mon[28069]: pgmap v13836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:09 smithi193 ceph-mon[32782]: pgmap v13836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:11 smithi196 ceph-mon[32572]: pgmap v13837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:11 smithi110 ceph-mon[28069]: pgmap v13837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:11 smithi193 ceph-mon[32782]: pgmap v13837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25447.328113 secs 2024-04-26T18:52:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25447.328113 secs 2024-04-26T18:52:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25447.328113 secs 2024-04-26T18:52:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:13 smithi196 ceph-mon[32572]: pgmap v13838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:13 smithi110 ceph-mon[28069]: pgmap v13838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:13 smithi193 ceph-mon[32782]: pgmap v13838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:15 smithi196 ceph-mon[32572]: pgmap v13839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:15 smithi110 ceph-mon[28069]: pgmap v13839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:15 smithi193 ceph-mon[32782]: pgmap v13839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25452.328245 secs 2024-04-26T18:52:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:17 smithi196 ceph-mon[32572]: pgmap v13840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25452.328245 secs 2024-04-26T18:52:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:17 smithi110 ceph-mon[28069]: pgmap v13840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25452.328245 secs 2024-04-26T18:52:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:17 smithi193 ceph-mon[32782]: pgmap v13840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:19 smithi196 ceph-mon[32572]: pgmap v13841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:19 smithi110 ceph-mon[28069]: pgmap v13841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:19 smithi193 ceph-mon[32782]: pgmap v13841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:21 smithi196 ceph-mon[32572]: pgmap v13842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:21 smithi110 ceph-mon[28069]: pgmap v13842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:21 smithi193 ceph-mon[32782]: pgmap v13842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25457.328379 secs 2024-04-26T18:52:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25457.328379 secs 2024-04-26T18:52:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25457.328379 secs 2024-04-26T18:52:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:23 smithi196 ceph-mon[32572]: pgmap v13843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:23 smithi110 ceph-mon[28069]: pgmap v13843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:23 smithi193 ceph-mon[32782]: pgmap v13843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:25 smithi196 ceph-mon[32572]: pgmap v13844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:25 smithi110 ceph-mon[28069]: pgmap v13844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:26.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:25 smithi193 ceph-mon[32782]: pgmap v13844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25462.328498 secs 2024-04-26T18:52:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:27 smithi196 ceph-mon[32572]: pgmap v13845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25462.328498 secs 2024-04-26T18:52:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:27 smithi110 ceph-mon[28069]: pgmap v13845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25462.328498 secs 2024-04-26T18:52:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:27 smithi193 ceph-mon[32782]: pgmap v13845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:29 smithi196 ceph-mon[32572]: pgmap v13846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:29 smithi110 ceph-mon[28069]: pgmap v13846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:29 smithi193 ceph-mon[32782]: pgmap v13846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:31 smithi196 ceph-mon[32572]: pgmap v13847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:31 smithi110 ceph-mon[28069]: pgmap v13847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:31 smithi193 ceph-mon[32782]: pgmap v13847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:33 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25467.328616 secs 2024-04-26T18:52:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:33 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25467.328616 secs 2024-04-26T18:52:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:33 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25467.328616 secs 2024-04-26T18:52:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:34 smithi110 ceph-mon[28069]: pgmap v13848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:34 smithi193 ceph-mon[32782]: pgmap v13848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:34 smithi196 ceph-mon[32572]: pgmap v13848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:36 smithi110 ceph-mon[28069]: pgmap v13849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:36.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:36 smithi196 ceph-mon[32572]: pgmap v13849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:36 smithi193 ceph-mon[32782]: pgmap v13849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:38 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25472.328737 secs 2024-04-26T18:52:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:38 smithi110 ceph-mon[28069]: pgmap v13850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:38 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25472.328737 secs 2024-04-26T18:52:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:38 smithi193 ceph-mon[32782]: pgmap v13850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:38 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25472.328737 secs 2024-04-26T18:52:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:38 smithi196 ceph-mon[32572]: pgmap v13850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:40 smithi110 ceph-mon[28069]: pgmap v13851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:40 smithi193 ceph-mon[32782]: pgmap v13851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:40 smithi196 ceph-mon[32572]: pgmap v13851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:42 smithi110 ceph-mon[28069]: pgmap v13852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:42 smithi193 ceph-mon[32782]: pgmap v13852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:42 smithi196 ceph-mon[32572]: pgmap v13852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:43 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25477.328852 secs 2024-04-26T18:52:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:43 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25477.328852 secs 2024-04-26T18:52:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:43 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25477.328852 secs 2024-04-26T18:52:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:44 smithi193 ceph-mon[32782]: pgmap v13853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:44 smithi196 ceph-mon[32572]: pgmap v13853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:44 smithi110 ceph-mon[28069]: pgmap v13853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:46 smithi193 ceph-mon[32782]: pgmap v13854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:52:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:46 smithi196 ceph-mon[32572]: pgmap v13854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:52:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:46 smithi110 ceph-mon[28069]: pgmap v13854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:52:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:52:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:52:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:52:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:47 smithi193 ceph-mon[32782]: pgmap v13855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:52:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:47 smithi193 ceph-mon[32782]: pgmap v13856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:52:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25482.328969 secs 2024-04-26T18:52:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:52:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:52:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:47 smithi196 ceph-mon[32572]: pgmap v13855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:52:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:47 smithi196 ceph-mon[32572]: pgmap v13856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:52:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25482.328969 secs 2024-04-26T18:52:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:52:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:52:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:47 smithi110 ceph-mon[28069]: pgmap v13855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:52:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:47 smithi110 ceph-mon[28069]: pgmap v13856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:52:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25482.328969 secs 2024-04-26T18:52:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:49 smithi196 ceph-mon[32572]: pgmap v13857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:49 smithi110 ceph-mon[28069]: pgmap v13857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:49 smithi193 ceph-mon[32782]: pgmap v13857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:51 smithi196 ceph-mon[32572]: pgmap v13858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:51 smithi110 ceph-mon[28069]: pgmap v13858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:51 smithi193 ceph-mon[32782]: pgmap v13858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25487.329088 secs 2024-04-26T18:52:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25487.329088 secs 2024-04-26T18:52:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25487.329088 secs 2024-04-26T18:52:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:53 smithi196 ceph-mon[32572]: pgmap v13859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:52:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:53 smithi110 ceph-mon[28069]: pgmap v13859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:52:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:53 smithi193 ceph-mon[32782]: pgmap v13859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:52:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:55 smithi196 ceph-mon[32572]: pgmap v13860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:55 smithi110 ceph-mon[28069]: pgmap v13860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:55 smithi193 ceph-mon[32782]: pgmap v13860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:52:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:57 smithi196 ceph-mon[32572]: pgmap v13861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:52:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25492.329167 secs 2024-04-26T18:52:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:57 smithi110 ceph-mon[28069]: pgmap v13861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:52:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25492.329167 secs 2024-04-26T18:52:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:57 smithi193 ceph-mon[32782]: pgmap v13861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:52:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25492.329167 secs 2024-04-26T18:52:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:52:59 smithi110 ceph-mon[28069]: pgmap v13862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:52:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:52:59 smithi193 ceph-mon[32782]: pgmap v13862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:52:59 smithi196 ceph-mon[32572]: pgmap v13862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:01 smithi110 ceph-mon[28069]: pgmap v13863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:01 smithi193 ceph-mon[32782]: pgmap v13863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:01 smithi196 ceph-mon[32572]: pgmap v13863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25497.329231 secs 2024-04-26T18:53:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25497.329231 secs 2024-04-26T18:53:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25497.329231 secs 2024-04-26T18:53:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:03 smithi110 ceph-mon[28069]: pgmap v13864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:03 smithi193 ceph-mon[32782]: pgmap v13864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:03 smithi196 ceph-mon[32572]: pgmap v13864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:05 smithi110 ceph-mon[28069]: pgmap v13865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:05 smithi193 ceph-mon[32782]: pgmap v13865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:05 smithi196 ceph-mon[32572]: pgmap v13865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:07 smithi110 ceph-mon[28069]: pgmap v13866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25502.329314 secs 2024-04-26T18:53:07.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:07 smithi196 ceph-mon[32572]: pgmap v13866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:07.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25502.329314 secs 2024-04-26T18:53:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:07 smithi193 ceph-mon[32782]: pgmap v13866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25502.329314 secs 2024-04-26T18:53:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:09 smithi110 ceph-mon[28069]: pgmap v13867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:09 smithi193 ceph-mon[32782]: pgmap v13867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:09 smithi196 ceph-mon[32572]: pgmap v13867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:11 smithi193 ceph-mon[32782]: pgmap v13868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:11 smithi196 ceph-mon[32572]: pgmap v13868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:11 smithi110 ceph-mon[28069]: pgmap v13868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25507.329467 secs 2024-04-26T18:53:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25507.329467 secs 2024-04-26T18:53:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25507.329467 secs 2024-04-26T18:53:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:13 smithi193 ceph-mon[32782]: pgmap v13869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:13 smithi196 ceph-mon[32572]: pgmap v13869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:13 smithi110 ceph-mon[28069]: pgmap v13869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:15 smithi193 ceph-mon[32782]: pgmap v13870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:15 smithi196 ceph-mon[32572]: pgmap v13870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:15 smithi110 ceph-mon[28069]: pgmap v13870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:17 smithi193 ceph-mon[32782]: pgmap v13871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25512.329605 secs 2024-04-26T18:53:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:17 smithi196 ceph-mon[32572]: pgmap v13871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25512.329605 secs 2024-04-26T18:53:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:17 smithi110 ceph-mon[28069]: pgmap v13871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25512.329605 secs 2024-04-26T18:53:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:19 smithi193 ceph-mon[32782]: pgmap v13872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:19 smithi196 ceph-mon[32572]: pgmap v13872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:19 smithi110 ceph-mon[28069]: pgmap v13872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:21 smithi193 ceph-mon[32782]: pgmap v13873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:21 smithi196 ceph-mon[32572]: pgmap v13873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:21 smithi110 ceph-mon[28069]: pgmap v13873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25517.329724 secs 2024-04-26T18:53:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25517.329724 secs 2024-04-26T18:53:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25517.329724 secs 2024-04-26T18:53:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:23 smithi193 ceph-mon[32782]: pgmap v13874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:23 smithi196 ceph-mon[32572]: pgmap v13874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:23 smithi110 ceph-mon[28069]: pgmap v13874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:25 smithi193 ceph-mon[32782]: pgmap v13875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:25 smithi196 ceph-mon[32572]: pgmap v13875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:25 smithi110 ceph-mon[28069]: pgmap v13875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:27 smithi193 ceph-mon[32782]: pgmap v13876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25522.329809 secs 2024-04-26T18:53:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:27 smithi196 ceph-mon[32572]: pgmap v13876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25522.329809 secs 2024-04-26T18:53:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:27 smithi110 ceph-mon[28069]: pgmap v13876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25522.329809 secs 2024-04-26T18:53:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:29 smithi193 ceph-mon[32782]: pgmap v13877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:29 smithi196 ceph-mon[32572]: pgmap v13877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:29 smithi110 ceph-mon[28069]: pgmap v13877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:31 smithi193 ceph-mon[32782]: pgmap v13878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:31 smithi196 ceph-mon[32572]: pgmap v13878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:31 smithi110 ceph-mon[28069]: pgmap v13878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25527.329927 secs 2024-04-26T18:53:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25527.329927 secs 2024-04-26T18:53:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25527.329927 secs 2024-04-26T18:53:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:33 smithi193 ceph-mon[32782]: pgmap v13879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:33 smithi196 ceph-mon[32572]: pgmap v13879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:33 smithi110 ceph-mon[28069]: pgmap v13879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:35 smithi196 ceph-mon[32572]: pgmap v13880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:35 smithi110 ceph-mon[28069]: pgmap v13880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:35 smithi193 ceph-mon[32782]: pgmap v13880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:37 smithi196 ceph-mon[32572]: pgmap v13881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25532.330072 secs 2024-04-26T18:53:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:37 smithi110 ceph-mon[28069]: pgmap v13881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25532.330072 secs 2024-04-26T18:53:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:37 smithi193 ceph-mon[32782]: pgmap v13881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25532.330072 secs 2024-04-26T18:53:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:39 smithi196 ceph-mon[32572]: pgmap v13882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:39 smithi110 ceph-mon[28069]: pgmap v13882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:39 smithi193 ceph-mon[32782]: pgmap v13882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:41.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:41 smithi193 ceph-mon[32782]: pgmap v13883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:41 smithi196 ceph-mon[32572]: pgmap v13883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:41 smithi110 ceph-mon[28069]: pgmap v13883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25537.330202 secs 2024-04-26T18:53:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25537.330202 secs 2024-04-26T18:53:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25537.330202 secs 2024-04-26T18:53:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:43 smithi196 ceph-mon[32572]: pgmap v13884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:43 smithi110 ceph-mon[28069]: pgmap v13884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:43 smithi193 ceph-mon[32782]: pgmap v13884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:53:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:45 smithi196 ceph-mon[32572]: pgmap v13885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:45 smithi110 ceph-mon[28069]: pgmap v13885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:45 smithi193 ceph-mon[32782]: pgmap v13885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T18:53:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:47 smithi196 ceph-mon[32572]: pgmap v13886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25542.330321 secs 2024-04-26T18:53:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:53:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:47 smithi110 ceph-mon[28069]: pgmap v13886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25542.330321 secs 2024-04-26T18:53:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:53:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:47 smithi193 ceph-mon[32782]: pgmap v13886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:53:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25542.330321 secs 2024-04-26T18:53:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:53:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:53:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:53:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:53:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:53:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:53:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:53:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:53:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:53:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:53:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:49 smithi196 ceph-mon[32572]: pgmap v13887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:53:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:49 smithi196 ceph-mon[32572]: pgmap v13888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:49 smithi110 ceph-mon[28069]: pgmap v13887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:53:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:49 smithi110 ceph-mon[28069]: pgmap v13888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:49 smithi193 ceph-mon[32782]: pgmap v13887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:53:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:49 smithi193 ceph-mon[32782]: pgmap v13888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:51 smithi196 ceph-mon[32572]: pgmap v13889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:51 smithi110 ceph-mon[28069]: pgmap v13889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:51 smithi193 ceph-mon[32782]: pgmap v13889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25547.330438 secs 2024-04-26T18:53:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25547.330438 secs 2024-04-26T18:53:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25547.330438 secs 2024-04-26T18:53:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:53 smithi196 ceph-mon[32572]: pgmap v13890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:53:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:53 smithi110 ceph-mon[28069]: pgmap v13890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:53:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:53 smithi193 ceph-mon[32782]: pgmap v13890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T18:53:56.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:55 smithi196 ceph-mon[32572]: pgmap v13891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:55 smithi110 ceph-mon[28069]: pgmap v13891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:55 smithi193 ceph-mon[32782]: pgmap v13891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:57 smithi196 ceph-mon[32572]: pgmap v13892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25552.330556 secs 2024-04-26T18:53:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:57 smithi110 ceph-mon[28069]: pgmap v13892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25552.330556 secs 2024-04-26T18:53:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:57 smithi193 ceph-mon[32782]: pgmap v13892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:53:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25552.330556 secs 2024-04-26T18:54:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:53:59 smithi196 ceph-mon[32572]: pgmap v13893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:54:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:53:59 smithi110 ceph-mon[28069]: pgmap v13893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:54:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:53:59 smithi193 ceph-mon[32782]: pgmap v13893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:54:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:01 smithi196 ceph-mon[32572]: pgmap v13894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:01 smithi110 ceph-mon[28069]: pgmap v13894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:01 smithi193 ceph-mon[32782]: pgmap v13894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25557.330653 secs 2024-04-26T18:54:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25557.330653 secs 2024-04-26T18:54:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25557.330653 secs 2024-04-26T18:54:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:03 smithi196 ceph-mon[32572]: pgmap v13895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:03 smithi110 ceph-mon[28069]: pgmap v13895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:03 smithi193 ceph-mon[32782]: pgmap v13895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:05 smithi196 ceph-mon[32572]: pgmap v13896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:05 smithi110 ceph-mon[28069]: pgmap v13896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:05 smithi193 ceph-mon[32782]: pgmap v13896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:07 smithi196 ceph-mon[32572]: pgmap v13897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25562.330772 secs 2024-04-26T18:54:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:07 smithi110 ceph-mon[28069]: pgmap v13897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25562.330772 secs 2024-04-26T18:54:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:07 smithi193 ceph-mon[32782]: pgmap v13897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25562.330772 secs 2024-04-26T18:54:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:09 smithi196 ceph-mon[32572]: pgmap v13898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:09 smithi110 ceph-mon[28069]: pgmap v13898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:09 smithi193 ceph-mon[32782]: pgmap v13898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:11 smithi196 ceph-mon[32572]: pgmap v13899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:11 smithi110 ceph-mon[28069]: pgmap v13899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:11 smithi193 ceph-mon[32782]: pgmap v13899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25567.330846 secs 2024-04-26T18:54:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25567.330846 secs 2024-04-26T18:54:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:54:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:54:12.693+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:54:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:54:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:54:12.693+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:54:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:54:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:54:12.693+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:54:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:54:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:54:12.693+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:54:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:54:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:54:12.693+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:54:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25567.330846 secs 2024-04-26T18:54:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:13 smithi110 ceph-mon[28069]: pgmap v13900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:13 smithi193 ceph-mon[32782]: pgmap v13900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:13 smithi196 ceph-mon[32572]: pgmap v13900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:15 smithi110 ceph-mon[28069]: pgmap v13901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:15 smithi193 ceph-mon[32782]: pgmap v13901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:15 smithi196 ceph-mon[32572]: pgmap v13901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:17 smithi110 ceph-mon[28069]: pgmap v13902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25572.330937 secs 2024-04-26T18:54:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:17 smithi193 ceph-mon[32782]: pgmap v13902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25572.330937 secs 2024-04-26T18:54:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:17 smithi196 ceph-mon[32572]: pgmap v13902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25572.330937 secs 2024-04-26T18:54:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:19 smithi110 ceph-mon[28069]: pgmap v13903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:19 smithi193 ceph-mon[32782]: pgmap v13903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:19 smithi196 ceph-mon[32572]: pgmap v13903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:54:20.600+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:54:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:54:20.600+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:54:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:54:20.601+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 198 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:54:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:54:20.601+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 198 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:54:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:21 smithi110 ceph-mon[28069]: pgmap v13904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:21 smithi193 ceph-mon[32782]: pgmap v13904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:21 smithi196 ceph-mon[32572]: pgmap v13904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25577.331089 secs 2024-04-26T18:54:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25577.331089 secs 2024-04-26T18:54:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25577.331089 secs 2024-04-26T18:54:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:23 smithi193 ceph-mon[32782]: pgmap v13905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:23 smithi196 ceph-mon[32572]: pgmap v13905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:23 smithi110 ceph-mon[28069]: pgmap v13905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:25 smithi193 ceph-mon[32782]: pgmap v13906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:25 smithi196 ceph-mon[32572]: pgmap v13906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:25 smithi110 ceph-mon[28069]: pgmap v13906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:27 smithi193 ceph-mon[32782]: pgmap v13907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25582.331216 secs 2024-04-26T18:54:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:27 smithi196 ceph-mon[32572]: pgmap v13907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25582.331216 secs 2024-04-26T18:54:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:27 smithi110 ceph-mon[28069]: pgmap v13907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25582.331216 secs 2024-04-26T18:54:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:29 smithi193 ceph-mon[32782]: pgmap v13908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:29 smithi196 ceph-mon[32572]: pgmap v13908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:29 smithi110 ceph-mon[28069]: pgmap v13908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T18:54:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:31 smithi193 ceph-mon[32782]: pgmap v13909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:31 smithi196 ceph-mon[32572]: pgmap v13909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:31 smithi110 ceph-mon[28069]: pgmap v13909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25587.331339 secs 2024-04-26T18:54:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25587.331339 secs 2024-04-26T18:54:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25587.331339 secs 2024-04-26T18:54:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:33 smithi193 ceph-mon[32782]: pgmap v13910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:33 smithi196 ceph-mon[32572]: pgmap v13910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:33 smithi110 ceph-mon[28069]: pgmap v13910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:35 smithi193 ceph-mon[32782]: pgmap v13911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:35 smithi196 ceph-mon[32572]: pgmap v13911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:35 smithi110 ceph-mon[28069]: pgmap v13911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:38.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:37 smithi110 ceph-mon[28069]: pgmap v13912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:38.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25592.331463 secs 2024-04-26T18:54:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:37 smithi193 ceph-mon[32782]: pgmap v13912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25592.331463 secs 2024-04-26T18:54:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:37 smithi196 ceph-mon[32572]: pgmap v13912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25592.331463 secs 2024-04-26T18:54:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:39 smithi193 ceph-mon[32782]: pgmap v13913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:39 smithi196 ceph-mon[32572]: pgmap v13913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:39 smithi110 ceph-mon[28069]: pgmap v13913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:41 smithi193 ceph-mon[32782]: pgmap v13914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:41 smithi196 ceph-mon[32572]: pgmap v13914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:41 smithi110 ceph-mon[28069]: pgmap v13914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25597.331583 secs 2024-04-26T18:54:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25597.331583 secs 2024-04-26T18:54:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25597.331583 secs 2024-04-26T18:54:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:43 smithi193 ceph-mon[32782]: pgmap v13915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:43 smithi196 ceph-mon[32572]: pgmap v13915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:43 smithi110 ceph-mon[28069]: pgmap v13915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:45 smithi193 ceph-mon[32782]: pgmap v13916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:45 smithi196 ceph-mon[32572]: pgmap v13916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:45 smithi110 ceph-mon[28069]: pgmap v13916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:47 smithi196 ceph-mon[32572]: pgmap v13917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25602.331702 secs 2024-04-26T18:54:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:47 smithi110 ceph-mon[28069]: pgmap v13917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25602.331702 secs 2024-04-26T18:54:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:47 smithi193 ceph-mon[32782]: pgmap v13917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:54:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25602.331702 secs 2024-04-26T18:54:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:54:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:54:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:54:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:49 smithi196 ceph-mon[32572]: pgmap v13918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:54:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:54:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:54:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:49 smithi110 ceph-mon[28069]: pgmap v13918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:54:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:54:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:54:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:49 smithi193 ceph-mon[32782]: pgmap v13918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:54:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:54:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:54:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:54:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:50 smithi196 ceph-mon[32572]: pgmap v13919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:54:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:50 smithi196 ceph-mon[32572]: pgmap v13920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:50 smithi110 ceph-mon[28069]: pgmap v13919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:54:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:50 smithi110 ceph-mon[28069]: pgmap v13920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:50 smithi193 ceph-mon[32782]: pgmap v13919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T18:54:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:50 smithi193 ceph-mon[32782]: pgmap v13920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:51 smithi196 ceph-mon[32572]: pgmap v13921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:51 smithi110 ceph-mon[28069]: pgmap v13921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:51 smithi193 ceph-mon[32782]: pgmap v13921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25607.331819 secs 2024-04-26T18:54:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25607.331819 secs 2024-04-26T18:54:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25607.331819 secs 2024-04-26T18:54:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:53 smithi196 ceph-mon[32572]: pgmap v13922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:53 smithi110 ceph-mon[28069]: pgmap v13922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:53 smithi193 ceph-mon[32782]: pgmap v13922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:56 smithi196 ceph-mon[32572]: pgmap v13923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:56 smithi110 ceph-mon[28069]: pgmap v13923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:56 smithi193 ceph-mon[32782]: pgmap v13923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25612.331945 secs 2024-04-26T18:54:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25612.331945 secs 2024-04-26T18:54:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25612.331945 secs 2024-04-26T18:54:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:54:58 smithi196 ceph-mon[32572]: pgmap v13924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:54:58 smithi110 ceph-mon[28069]: pgmap v13924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:54:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:54:58 smithi193 ceph-mon[32782]: pgmap v13924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:55:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:00 smithi196 ceph-mon[32572]: pgmap v13925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:55:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:00 smithi110 ceph-mon[28069]: pgmap v13925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:55:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:00 smithi193 ceph-mon[32782]: pgmap v13925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:55:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:02 smithi196 ceph-mon[32572]: pgmap v13926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25617.332025 secs 2024-04-26T18:55:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:02 smithi110 ceph-mon[28069]: pgmap v13926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25617.332025 secs 2024-04-26T18:55:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:02 smithi193 ceph-mon[32782]: pgmap v13926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25617.332025 secs 2024-04-26T18:55:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:04 smithi196 ceph-mon[32572]: pgmap v13927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:55:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:04 smithi110 ceph-mon[28069]: pgmap v13927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:55:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:04 smithi193 ceph-mon[32782]: pgmap v13927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:55:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:06 smithi196 ceph-mon[32572]: pgmap v13928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:55:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:06 smithi110 ceph-mon[28069]: pgmap v13928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:55:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:06 smithi193 ceph-mon[32782]: pgmap v13928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:55:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25622.332150 secs 2024-04-26T18:55:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25622.332150 secs 2024-04-26T18:55:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25622.332150 secs 2024-04-26T18:55:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:08 smithi196 ceph-mon[32572]: pgmap v13929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:55:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:08 smithi110 ceph-mon[28069]: pgmap v13929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:55:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:08 smithi193 ceph-mon[32782]: pgmap v13929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:55:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:10 smithi196 ceph-mon[32572]: pgmap v13930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:55:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:10 smithi110 ceph-mon[28069]: pgmap v13930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:55:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:10 smithi193 ceph-mon[32782]: pgmap v13930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:55:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:12 smithi196 ceph-mon[32572]: pgmap v13931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:55:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25627.332299 secs 2024-04-26T18:55:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:12 smithi110 ceph-mon[28069]: pgmap v13931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:55:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25627.332299 secs 2024-04-26T18:55:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:12 smithi193 ceph-mon[32782]: pgmap v13931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T18:55:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25627.332299 secs 2024-04-26T18:55:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:14 smithi196 ceph-mon[32572]: pgmap v13932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:55:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:14 smithi110 ceph-mon[28069]: pgmap v13932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:55:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:14 smithi193 ceph-mon[32782]: pgmap v13932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T18:55:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:16 smithi196 ceph-mon[32572]: pgmap v13933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:16 smithi110 ceph-mon[28069]: pgmap v13933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:16 smithi193 ceph-mon[32782]: pgmap v13933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25632.332419 secs 2024-04-26T18:55:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25632.332419 secs 2024-04-26T18:55:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25632.332419 secs 2024-04-26T18:55:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:18 smithi196 ceph-mon[32572]: pgmap v13934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:18 smithi110 ceph-mon[28069]: pgmap v13934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:18 smithi193 ceph-mon[32782]: pgmap v13934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:20 smithi196 ceph-mon[32572]: pgmap v13935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:20 smithi110 ceph-mon[28069]: pgmap v13935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:20 smithi193 ceph-mon[32782]: pgmap v13935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:22 smithi110 ceph-mon[28069]: pgmap v13936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25637.332555 secs 2024-04-26T18:55:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:22 smithi193 ceph-mon[32782]: pgmap v13936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25637.332555 secs 2024-04-26T18:55:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:22 smithi196 ceph-mon[32572]: pgmap v13936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25637.332555 secs 2024-04-26T18:55:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:24 smithi110 ceph-mon[28069]: pgmap v13937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:24 smithi193 ceph-mon[32782]: pgmap v13937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:24 smithi196 ceph-mon[32572]: pgmap v13937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:26 smithi110 ceph-mon[28069]: pgmap v13938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:26 smithi193 ceph-mon[32782]: pgmap v13938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:26 smithi196 ceph-mon[32572]: pgmap v13938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25642.332672 secs 2024-04-26T18:55:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25642.332672 secs 2024-04-26T18:55:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25642.332672 secs 2024-04-26T18:55:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:28 smithi110 ceph-mon[28069]: pgmap v13939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:28 smithi193 ceph-mon[32782]: pgmap v13939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:28 smithi196 ceph-mon[32572]: pgmap v13939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:30 smithi110 ceph-mon[28069]: pgmap v13940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:30 smithi193 ceph-mon[32782]: pgmap v13940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:30 smithi196 ceph-mon[32572]: pgmap v13940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:32 smithi193 ceph-mon[32782]: pgmap v13941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25647.332748 secs 2024-04-26T18:55:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:32 smithi196 ceph-mon[32572]: pgmap v13941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25647.332748 secs 2024-04-26T18:55:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:32 smithi110 ceph-mon[28069]: pgmap v13941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25647.332748 secs 2024-04-26T18:55:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:34 smithi193 ceph-mon[32782]: pgmap v13942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:34 smithi196 ceph-mon[32572]: pgmap v13942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:34 smithi110 ceph-mon[28069]: pgmap v13942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:36 smithi193 ceph-mon[32782]: pgmap v13943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:36 smithi196 ceph-mon[32572]: pgmap v13943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:36 smithi110 ceph-mon[28069]: pgmap v13943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25652.332867 secs 2024-04-26T18:55:38.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25652.332867 secs 2024-04-26T18:55:38.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25652.332867 secs 2024-04-26T18:55:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:38 smithi193 ceph-mon[32782]: pgmap v13944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:38 smithi196 ceph-mon[32572]: pgmap v13944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:38 smithi110 ceph-mon[28069]: pgmap v13944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:40 smithi193 ceph-mon[32782]: pgmap v13945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:40 smithi196 ceph-mon[32572]: pgmap v13945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:40 smithi110 ceph-mon[28069]: pgmap v13945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25657.332998 secs 2024-04-26T18:55:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:42 smithi193 ceph-mon[32782]: pgmap v13946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25657.332998 secs 2024-04-26T18:55:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:42 smithi196 ceph-mon[32572]: pgmap v13946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25657.332998 secs 2024-04-26T18:55:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:42 smithi110 ceph-mon[28069]: pgmap v13946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:44 smithi193 ceph-mon[32782]: pgmap v13947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:44 smithi196 ceph-mon[32572]: pgmap v13947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:44 smithi110 ceph-mon[28069]: pgmap v13947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:46 smithi193 ceph-mon[32782]: pgmap v13948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:46 smithi196 ceph-mon[32572]: pgmap v13948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:46 smithi110 ceph-mon[28069]: pgmap v13948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25662.333116 secs 2024-04-26T18:55:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25662.333116 secs 2024-04-26T18:55:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25662.333116 secs 2024-04-26T18:55:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:48 smithi193 ceph-mon[32782]: pgmap v13949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:48 smithi196 ceph-mon[32572]: pgmap v13949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:48 smithi110 ceph-mon[28069]: pgmap v13949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:50 smithi193 ceph-mon[32782]: pgmap v13950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:55:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:55:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:55:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:50 smithi196 ceph-mon[32572]: pgmap v13950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:55:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:55:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:55:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:50 smithi110 ceph-mon[28069]: pgmap v13950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:55:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:55:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:55:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25667.333249 secs 2024-04-26T18:55:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:52 smithi193 ceph-mon[32782]: pgmap v13951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:55:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:55:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:55:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25667.333249 secs 2024-04-26T18:55:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:52 smithi196 ceph-mon[32572]: pgmap v13951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:55:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:55:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:55:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25667.333249 secs 2024-04-26T18:55:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:52 smithi110 ceph-mon[28069]: pgmap v13951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:55:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:55:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:55:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:55:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:53 smithi193 ceph-mon[32782]: pgmap v13952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 1 op/s 2024-04-26T18:55:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:53 smithi193 ceph-mon[32782]: pgmap v13953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 602 B/s rd, 1 op/s 2024-04-26T18:55:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:53 smithi196 ceph-mon[32572]: pgmap v13952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 1 op/s 2024-04-26T18:55:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:53 smithi196 ceph-mon[32572]: pgmap v13953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 602 B/s rd, 1 op/s 2024-04-26T18:55:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:53 smithi110 ceph-mon[28069]: pgmap v13952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 1 op/s 2024-04-26T18:55:54.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:53 smithi110 ceph-mon[28069]: pgmap v13953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 602 B/s rd, 1 op/s 2024-04-26T18:55:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:55 smithi196 ceph-mon[32572]: pgmap v13954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:55 smithi110 ceph-mon[28069]: pgmap v13954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:55 smithi193 ceph-mon[32782]: pgmap v13954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:55:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:57 smithi196 ceph-mon[32572]: pgmap v13955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 602 B/s rd, 1 op/s 2024-04-26T18:55:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25672.333399 secs 2024-04-26T18:55:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:57 smithi110 ceph-mon[28069]: pgmap v13955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 602 B/s rd, 1 op/s 2024-04-26T18:55:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25672.333399 secs 2024-04-26T18:55:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:57 smithi193 ceph-mon[32782]: pgmap v13955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 602 B/s rd, 1 op/s 2024-04-26T18:55:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25672.333399 secs 2024-04-26T18:56:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:55:59 smithi196 ceph-mon[32572]: pgmap v13956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:55:59 smithi110 ceph-mon[28069]: pgmap v13956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:55:59 smithi193 ceph-mon[32782]: pgmap v13956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:01 smithi196 ceph-mon[32572]: pgmap v13957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:01 smithi110 ceph-mon[28069]: pgmap v13957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:01 smithi193 ceph-mon[32782]: pgmap v13957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25677.333519 secs 2024-04-26T18:56:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25677.333519 secs 2024-04-26T18:56:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25677.333519 secs 2024-04-26T18:56:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:03 smithi196 ceph-mon[32572]: pgmap v13958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:56:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:03 smithi110 ceph-mon[28069]: pgmap v13958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:56:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:03 smithi193 ceph-mon[32782]: pgmap v13958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:56:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:05 smithi196 ceph-mon[32572]: pgmap v13959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:05 smithi110 ceph-mon[28069]: pgmap v13959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:05 smithi193 ceph-mon[32782]: pgmap v13959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:06 smithi196 ceph-mon[32572]: pgmap v13960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:06 smithi110 ceph-mon[28069]: pgmap v13960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:06 smithi193 ceph-mon[32782]: pgmap v13960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25682.333660 secs 2024-04-26T18:56:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25682.333660 secs 2024-04-26T18:56:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25682.333660 secs 2024-04-26T18:56:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:08 smithi196 ceph-mon[32572]: pgmap v13961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:08 smithi110 ceph-mon[28069]: pgmap v13961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:08 smithi193 ceph-mon[32782]: pgmap v13961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:11 smithi196 ceph-mon[32572]: pgmap v13962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:11 smithi110 ceph-mon[28069]: pgmap v13962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:11 smithi193 ceph-mon[32782]: pgmap v13962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:12 smithi196 ceph-mon[32572]: 21 slow requests, 1 included below; oldest blocked for > 25687.333728 secs 2024-04-26T18:56:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:12 smithi196 ceph-mon[32572]: slow request 11524.444615 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:56:12.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:12 smithi193 ceph-mon[32782]: 21 slow requests, 1 included below; oldest blocked for > 25687.333728 secs 2024-04-26T18:56:12.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:12 smithi193 ceph-mon[32782]: slow request 11524.444615 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:56:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:12 smithi110 ceph-mon[28069]: 21 slow requests, 1 included below; oldest blocked for > 25687.333728 secs 2024-04-26T18:56:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:12 smithi110 ceph-mon[28069]: slow request 11524.444615 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:56:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:13 smithi196 ceph-mon[32572]: pgmap v13963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:13 smithi110 ceph-mon[28069]: pgmap v13963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:13 smithi193 ceph-mon[32782]: pgmap v13963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:15 smithi196 ceph-mon[32572]: pgmap v13964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:15 smithi110 ceph-mon[28069]: pgmap v13964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:15 smithi193 ceph-mon[32782]: pgmap v13964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:17 smithi196 ceph-mon[32572]: pgmap v13965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25692.333840 secs 2024-04-26T18:56:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:17 smithi110 ceph-mon[28069]: pgmap v13965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25692.333840 secs 2024-04-26T18:56:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:17 smithi193 ceph-mon[32782]: pgmap v13965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25692.333840 secs 2024-04-26T18:56:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:19 smithi196 ceph-mon[32572]: pgmap v13966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:19 smithi110 ceph-mon[28069]: pgmap v13966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:19 smithi193 ceph-mon[32782]: pgmap v13966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:21 smithi196 ceph-mon[32572]: pgmap v13967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:21 smithi110 ceph-mon[28069]: pgmap v13967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:21 smithi193 ceph-mon[32782]: pgmap v13967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25697.333906 secs 2024-04-26T18:56:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25697.333906 secs 2024-04-26T18:56:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25697.333906 secs 2024-04-26T18:56:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:23 smithi196 ceph-mon[32572]: pgmap v13968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:23 smithi110 ceph-mon[28069]: pgmap v13968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:23 smithi193 ceph-mon[32782]: pgmap v13968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:25 smithi196 ceph-mon[32572]: pgmap v13969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:25 smithi110 ceph-mon[28069]: pgmap v13969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:25 smithi193 ceph-mon[32782]: pgmap v13969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:27 smithi110 ceph-mon[28069]: pgmap v13970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25702.334032 secs 2024-04-26T18:56:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:27 smithi193 ceph-mon[32782]: pgmap v13970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25702.334032 secs 2024-04-26T18:56:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:27 smithi196 ceph-mon[32572]: pgmap v13970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25702.334032 secs 2024-04-26T18:56:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:29 smithi110 ceph-mon[28069]: pgmap v13971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:29 smithi193 ceph-mon[32782]: pgmap v13971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:29 smithi196 ceph-mon[32572]: pgmap v13971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:31 smithi110 ceph-mon[28069]: pgmap v13972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:31 smithi193 ceph-mon[32782]: pgmap v13972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:31 smithi196 ceph-mon[32572]: pgmap v13972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25707.334096 secs 2024-04-26T18:56:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25707.334096 secs 2024-04-26T18:56:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25707.334096 secs 2024-04-26T18:56:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:33 smithi110 ceph-mon[28069]: pgmap v13973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:33 smithi193 ceph-mon[32782]: pgmap v13973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:33 smithi196 ceph-mon[32572]: pgmap v13973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:35 smithi110 ceph-mon[28069]: pgmap v13974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:35 smithi193 ceph-mon[32782]: pgmap v13974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:35 smithi196 ceph-mon[32572]: pgmap v13974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:37 smithi193 ceph-mon[32782]: pgmap v13975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25712.334237 secs 2024-04-26T18:56:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:37 smithi196 ceph-mon[32572]: pgmap v13975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25712.334237 secs 2024-04-26T18:56:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:37 smithi110 ceph-mon[28069]: pgmap v13975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25712.334237 secs 2024-04-26T18:56:39.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:39 smithi196 ceph-mon[32572]: pgmap v13976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:39.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:39 smithi110 ceph-mon[28069]: pgmap v13976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:39 smithi193 ceph-mon[32782]: pgmap v13976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:41 smithi193 ceph-mon[32782]: pgmap v13977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:41 smithi196 ceph-mon[32572]: pgmap v13977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:41 smithi110 ceph-mon[28069]: pgmap v13977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25717.334333 secs 2024-04-26T18:56:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25717.334333 secs 2024-04-26T18:56:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25717.334333 secs 2024-04-26T18:56:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:43 smithi193 ceph-mon[32782]: pgmap v13978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:43 smithi196 ceph-mon[32572]: pgmap v13978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:43 smithi110 ceph-mon[28069]: pgmap v13978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:45 smithi193 ceph-mon[32782]: pgmap v13979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:45 smithi196 ceph-mon[32572]: pgmap v13979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:45 smithi110 ceph-mon[28069]: pgmap v13979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:47 smithi193 ceph-mon[32782]: pgmap v13980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:47.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25722.334474 secs 2024-04-26T18:56:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:47 smithi196 ceph-mon[32572]: pgmap v13980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25722.334474 secs 2024-04-26T18:56:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:47 smithi110 ceph-mon[28069]: pgmap v13980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25722.334474 secs 2024-04-26T18:56:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:49 smithi193 ceph-mon[32782]: pgmap v13981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:49 smithi196 ceph-mon[32572]: pgmap v13981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:49 smithi110 ceph-mon[28069]: pgmap v13981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:51 smithi193 ceph-mon[32782]: pgmap v13982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:51 smithi196 ceph-mon[32572]: pgmap v13982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:51 smithi110 ceph-mon[28069]: pgmap v13982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25727.334635 secs 2024-04-26T18:56:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25727.334635 secs 2024-04-26T18:56:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25727.334635 secs 2024-04-26T18:56:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:53 smithi193 ceph-mon[32782]: pgmap v13983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:56:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:53 smithi196 ceph-mon[32572]: pgmap v13983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:56:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:53 smithi110 ceph-mon[28069]: pgmap v13983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:56:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:56:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:56:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:56:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:54 smithi193 ceph-mon[32782]: pgmap v13984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:56:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:54 smithi193 ceph-mon[32782]: pgmap v13985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:56:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:56:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:56:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:54 smithi196 ceph-mon[32572]: pgmap v13984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:56:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:54 smithi196 ceph-mon[32572]: pgmap v13985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:56:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:56:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:56:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:54 smithi110 ceph-mon[28069]: pgmap v13984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:56:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:54 smithi110 ceph-mon[28069]: pgmap v13985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:56:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:56:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:56 smithi196 ceph-mon[32572]: pgmap v13986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:56:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:56 smithi110 ceph-mon[28069]: pgmap v13986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:56:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:56 smithi193 ceph-mon[32782]: pgmap v13986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:56:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25732.334704 secs 2024-04-26T18:56:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25732.334704 secs 2024-04-26T18:56:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25732.334704 secs 2024-04-26T18:56:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:58 smithi196 ceph-mon[32572]: pgmap v13987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:56:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:58 smithi110 ceph-mon[28069]: pgmap v13987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:56:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:58 smithi193 ceph-mon[32782]: pgmap v13987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:57:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:56:59 smithi196 ceph-mon[32572]: pgmap v13988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:57:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:56:59 smithi110 ceph-mon[28069]: pgmap v13988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:57:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:56:59 smithi193 ceph-mon[32782]: pgmap v13988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:57:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25737.334785 secs 2024-04-26T18:57:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:02 smithi196 ceph-mon[32572]: pgmap v13989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:57:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25737.334785 secs 2024-04-26T18:57:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:02 smithi110 ceph-mon[28069]: pgmap v13989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:57:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25737.334785 secs 2024-04-26T18:57:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:02 smithi193 ceph-mon[32782]: pgmap v13989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T18:57:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:04 smithi196 ceph-mon[32572]: pgmap v13990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:57:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:04 smithi110 ceph-mon[28069]: pgmap v13990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:57:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:04 smithi193 ceph-mon[32782]: pgmap v13990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:57:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:06 smithi196 ceph-mon[32572]: pgmap v13991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:06 smithi110 ceph-mon[28069]: pgmap v13991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:06 smithi193 ceph-mon[32782]: pgmap v13991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25742.334900 secs 2024-04-26T18:57:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25742.334900 secs 2024-04-26T18:57:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25742.334900 secs 2024-04-26T18:57:09.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:08 smithi110 ceph-mon[28069]: pgmap v13992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:08 smithi196 ceph-mon[32572]: pgmap v13992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:08 smithi193 ceph-mon[32782]: pgmap v13992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:09 smithi196 ceph-mon[32572]: pgmap v13993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:09 smithi110 ceph-mon[28069]: pgmap v13993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:09 smithi193 ceph-mon[32782]: pgmap v13993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25747.335026 secs 2024-04-26T18:57:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:12 smithi196 ceph-mon[32572]: pgmap v13994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25747.335026 secs 2024-04-26T18:57:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:12 smithi110 ceph-mon[28069]: pgmap v13994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25747.335026 secs 2024-04-26T18:57:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:12 smithi193 ceph-mon[32782]: pgmap v13994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:14 smithi196 ceph-mon[32572]: pgmap v13995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:14 smithi110 ceph-mon[28069]: pgmap v13995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:14 smithi193 ceph-mon[32782]: pgmap v13995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:16 smithi196 ceph-mon[32572]: pgmap v13996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:57:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:16 smithi110 ceph-mon[28069]: pgmap v13996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:57:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:16 smithi193 ceph-mon[32782]: pgmap v13996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:57:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25752.335153 secs 2024-04-26T18:57:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:17 smithi196 ceph-mon[32572]: pgmap v13997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25752.335153 secs 2024-04-26T18:57:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:17 smithi110 ceph-mon[28069]: pgmap v13997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25752.335153 secs 2024-04-26T18:57:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:17 smithi193 ceph-mon[32782]: pgmap v13997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:57:20.630+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T18:57:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:57:20.630+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T18:57:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:57:20.631+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 199 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T18:57:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:57:20.631+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T18:57:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:57:20.631+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 199 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T18:57:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:57:20.631+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T18:57:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:57:20.631+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 200 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T18:57:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T18:57:20.632+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 200 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T18:57:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:20 smithi196 ceph-mon[32572]: pgmap v13998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:57:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:20 smithi110 ceph-mon[28069]: pgmap v13998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:57:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:20 smithi193 ceph-mon[32782]: pgmap v13998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:57:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25757.335277 secs 2024-04-26T18:57:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:22 smithi196 ceph-mon[32572]: pgmap v13999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:57:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25757.335277 secs 2024-04-26T18:57:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:22 smithi110 ceph-mon[28069]: pgmap v13999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:57:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25757.335277 secs 2024-04-26T18:57:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:22 smithi193 ceph-mon[32782]: pgmap v13999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T18:57:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:23 smithi196 ceph-mon[32572]: pgmap v14000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:23 smithi110 ceph-mon[28069]: pgmap v14000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:23 smithi193 ceph-mon[32782]: pgmap v14000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:26 smithi196 ceph-mon[32572]: pgmap v14001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:26 smithi110 ceph-mon[28069]: pgmap v14001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:26 smithi193 ceph-mon[32782]: pgmap v14001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25762.335405 secs 2024-04-26T18:57:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25762.335405 secs 2024-04-26T18:57:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25762.335405 secs 2024-04-26T18:57:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:28 smithi196 ceph-mon[32572]: pgmap v14002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:28 smithi110 ceph-mon[28069]: pgmap v14002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:28 smithi193 ceph-mon[32782]: pgmap v14002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:29 smithi196 ceph-mon[32572]: pgmap v14003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:29 smithi110 ceph-mon[28069]: pgmap v14003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:29 smithi193 ceph-mon[32782]: pgmap v14003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25767.335471 secs 2024-04-26T18:57:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:32 smithi196 ceph-mon[32572]: pgmap v14004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25767.335471 secs 2024-04-26T18:57:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:32 smithi110 ceph-mon[28069]: pgmap v14004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25767.335471 secs 2024-04-26T18:57:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:32 smithi193 ceph-mon[32782]: pgmap v14004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:34 smithi196 ceph-mon[32572]: pgmap v14005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:34 smithi110 ceph-mon[28069]: pgmap v14005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:34 smithi193 ceph-mon[32782]: pgmap v14005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:35 smithi196 ceph-mon[32572]: pgmap v14006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:35 smithi110 ceph-mon[28069]: pgmap v14006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:35 smithi193 ceph-mon[32782]: pgmap v14006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25772.335597 secs 2024-04-26T18:57:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25772.335597 secs 2024-04-26T18:57:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25772.335597 secs 2024-04-26T18:57:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:38 smithi196 ceph-mon[32572]: pgmap v14007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:38 smithi110 ceph-mon[28069]: pgmap v14007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:38 smithi193 ceph-mon[32782]: pgmap v14007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:41.207 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:40 smithi196 ceph-mon[32572]: pgmap v14008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:41.244 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:40 smithi110 ceph-mon[28069]: pgmap v14008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:40 smithi193 ceph-mon[32782]: pgmap v14008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:41 smithi196 ceph-mon[32572]: pgmap v14009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:41 smithi110 ceph-mon[28069]: pgmap v14009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:41 smithi193 ceph-mon[32782]: pgmap v14009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25777.335741 secs 2024-04-26T18:57:43.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25777.335741 secs 2024-04-26T18:57:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25777.335741 secs 2024-04-26T18:57:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:43 smithi196 ceph-mon[32572]: pgmap v14010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:43 smithi110 ceph-mon[28069]: pgmap v14010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:43 smithi193 ceph-mon[32782]: pgmap v14010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:46 smithi196 ceph-mon[32572]: pgmap v14011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:46 smithi110 ceph-mon[28069]: pgmap v14011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:46 smithi193 ceph-mon[32782]: pgmap v14011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25782.335831 secs 2024-04-26T18:57:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:47 smithi196 ceph-mon[32572]: pgmap v14012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25782.335831 secs 2024-04-26T18:57:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:47 smithi110 ceph-mon[28069]: pgmap v14012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25782.335831 secs 2024-04-26T18:57:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:47 smithi193 ceph-mon[32782]: pgmap v14012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:50 smithi196 ceph-mon[32572]: pgmap v14013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:50 smithi110 ceph-mon[28069]: pgmap v14013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:50 smithi193 ceph-mon[32782]: pgmap v14013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:51 smithi196 ceph-mon[32572]: pgmap v14014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:51 smithi110 ceph-mon[28069]: pgmap v14014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:51 smithi193 ceph-mon[32782]: pgmap v14014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25787.335917 secs 2024-04-26T18:57:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25787.335917 secs 2024-04-26T18:57:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25787.335917 secs 2024-04-26T18:57:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:53 smithi196 ceph-mon[32572]: pgmap v14015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:53 smithi110 ceph-mon[28069]: pgmap v14015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:53 smithi193 ceph-mon[32782]: pgmap v14015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:55.231 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:57:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:57:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:57:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:55 smithi196 ceph-mon[32572]: pgmap v14016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:55 smithi110 ceph-mon[28069]: pgmap v14016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:55 smithi193 ceph-mon[32782]: pgmap v14016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:57:57.489 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.489 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.489 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.490 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.490 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25792.335988 secs 2024-04-26T18:57:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25792.335988 secs 2024-04-26T18:57:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25792.335988 secs 2024-04-26T18:57:58.493 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:58 smithi193 ceph-mon[32782]: pgmap v14017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:58.493 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:58.494 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:58 smithi196 ceph-mon[32572]: pgmap v14017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:58 smithi110 ceph-mon[28069]: pgmap v14017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:57:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:57:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.678 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.679 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:57:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:57:59.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:57:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: pgmap v14018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.596 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.596 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: pgmap v14018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T18:58:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T18:58:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: pgmap v14018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:58:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:58:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:58:01.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:58:01.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:58:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:58:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:58:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:58:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:02.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:58:02.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:58:02.008 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:58:02.008 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:58:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:02 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:58:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:02 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:58:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:02 smithi110 ceph-mon[28069]: pgmap v14019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 918 B/s rd, 1 op/s 2024-04-26T18:58:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:02 smithi110 ceph-mon[28069]: pgmap v14020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25797.336120 secs 2024-04-26T18:58:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:02 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:58:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:02 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:58:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:02 smithi193 ceph-mon[32782]: pgmap v14019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 918 B/s rd, 1 op/s 2024-04-26T18:58:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:02 smithi193 ceph-mon[32782]: pgmap v14020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25797.336120 secs 2024-04-26T18:58:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:02 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T18:58:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:02 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T18:58:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:02 smithi196 ceph-mon[32572]: pgmap v14019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 918 B/s rd, 1 op/s 2024-04-26T18:58:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:02 smithi196 ceph-mon[32572]: pgmap v14020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25797.336120 secs 2024-04-26T18:58:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:04 smithi110 ceph-mon[28069]: pgmap v14021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:04 smithi193 ceph-mon[32782]: pgmap v14021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:04 smithi196 ceph-mon[32572]: pgmap v14021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:06 smithi193 ceph-mon[32782]: pgmap v14022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:06 smithi196 ceph-mon[32572]: pgmap v14022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:06 smithi110 ceph-mon[28069]: pgmap v14022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:07.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25802.336222 secs 2024-04-26T18:58:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25802.336222 secs 2024-04-26T18:58:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25802.336222 secs 2024-04-26T18:58:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:08 smithi193 ceph-mon[32782]: pgmap v14023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 1 op/s 2024-04-26T18:58:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:08 smithi196 ceph-mon[32572]: pgmap v14023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 1 op/s 2024-04-26T18:58:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:08 smithi110 ceph-mon[28069]: pgmap v14023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 559 B/s rd, 1 op/s 2024-04-26T18:58:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:10 smithi193 ceph-mon[32782]: pgmap v14024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:10 smithi196 ceph-mon[32572]: pgmap v14024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:10 smithi110 ceph-mon[28069]: pgmap v14024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:12.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:12 smithi110 ceph-mon[28069]: pgmap v14025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:58:12.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25807.336370 secs 2024-04-26T18:58:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:12 smithi193 ceph-mon[32782]: pgmap v14025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:58:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25807.336370 secs 2024-04-26T18:58:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:12 smithi196 ceph-mon[32572]: pgmap v14025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:58:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25807.336370 secs 2024-04-26T18:58:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:14 smithi193 ceph-mon[32782]: pgmap v14026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:14 smithi196 ceph-mon[32572]: pgmap v14026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:14 smithi110 ceph-mon[28069]: pgmap v14026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:16 smithi193 ceph-mon[32782]: pgmap v14027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:16 smithi196 ceph-mon[32572]: pgmap v14027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:16 smithi110 ceph-mon[28069]: pgmap v14027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:17 smithi193 ceph-mon[32782]: 21 slow requests, 1 included below; oldest blocked for > 25812.336471 secs 2024-04-26T18:58:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:17 smithi193 ceph-mon[32782]: slow request 1444.552033 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:58:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:17 smithi196 ceph-mon[32572]: 21 slow requests, 1 included below; oldest blocked for > 25812.336471 secs 2024-04-26T18:58:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:17 smithi196 ceph-mon[32572]: slow request 1444.552033 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:58:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:17 smithi110 ceph-mon[28069]: 21 slow requests, 1 included below; oldest blocked for > 25812.336471 secs 2024-04-26T18:58:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:17 smithi110 ceph-mon[28069]: slow request 1444.552033 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:58:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:18 smithi193 ceph-mon[32782]: pgmap v14028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:18 smithi196 ceph-mon[32572]: pgmap v14028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:18 smithi110 ceph-mon[28069]: pgmap v14028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:20 smithi193 ceph-mon[32782]: pgmap v14029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:20 smithi196 ceph-mon[32572]: pgmap v14029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:20 smithi110 ceph-mon[28069]: pgmap v14029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:22 smithi196 ceph-mon[32572]: pgmap v14030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25817.336612 secs 2024-04-26T18:58:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:22 smithi193 ceph-mon[32782]: pgmap v14030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25817.336612 secs 2024-04-26T18:58:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:22 smithi110 ceph-mon[28069]: pgmap v14030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25817.336612 secs 2024-04-26T18:58:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:24 smithi193 ceph-mon[32782]: pgmap v14031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:24.933 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:24 smithi110 ceph-mon[28069]: pgmap v14031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:24 smithi196 ceph-mon[32572]: pgmap v14031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:26 smithi193 ceph-mon[32782]: pgmap v14032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:26 smithi196 ceph-mon[32572]: pgmap v14032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:26 smithi110 ceph-mon[28069]: pgmap v14032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25822.336744 secs 2024-04-26T18:58:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25822.336744 secs 2024-04-26T18:58:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25822.336744 secs 2024-04-26T18:58:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:28 smithi193 ceph-mon[32782]: pgmap v14033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:28 smithi196 ceph-mon[32572]: pgmap v14033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:28 smithi110 ceph-mon[28069]: pgmap v14033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:30 smithi196 ceph-mon[32572]: pgmap v14034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:30 smithi110 ceph-mon[28069]: pgmap v14034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:30 smithi193 ceph-mon[32782]: pgmap v14034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:32 smithi196 ceph-mon[32572]: pgmap v14035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25827.336837 secs 2024-04-26T18:58:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:32 smithi110 ceph-mon[28069]: pgmap v14035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25827.336837 secs 2024-04-26T18:58:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:32 smithi193 ceph-mon[32782]: pgmap v14035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25827.336837 secs 2024-04-26T18:58:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:34 smithi196 ceph-mon[32572]: pgmap v14036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:34 smithi110 ceph-mon[28069]: pgmap v14036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:34 smithi193 ceph-mon[32782]: pgmap v14036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:36 smithi196 ceph-mon[32572]: pgmap v14037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:36 smithi110 ceph-mon[28069]: pgmap v14037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:36 smithi193 ceph-mon[32782]: pgmap v14037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25832.336920 secs 2024-04-26T18:58:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25832.336920 secs 2024-04-26T18:58:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25832.336920 secs 2024-04-26T18:58:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:38 smithi196 ceph-mon[32572]: pgmap v14038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:38 smithi110 ceph-mon[28069]: pgmap v14038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:38 smithi193 ceph-mon[32782]: pgmap v14038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:40 smithi196 ceph-mon[32572]: pgmap v14039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:40 smithi110 ceph-mon[28069]: pgmap v14039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:40 smithi193 ceph-mon[32782]: pgmap v14039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:42 smithi196 ceph-mon[32572]: pgmap v14040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25837.337037 secs 2024-04-26T18:58:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:42 smithi110 ceph-mon[28069]: pgmap v14040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25837.337037 secs 2024-04-26T18:58:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:42 smithi193 ceph-mon[32782]: pgmap v14040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25837.337037 secs 2024-04-26T18:58:44.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:44 smithi193 ceph-mon[32782]: pgmap v14041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:44 smithi196 ceph-mon[32572]: pgmap v14041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:44 smithi110 ceph-mon[28069]: pgmap v14041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:46 smithi196 ceph-mon[32572]: pgmap v14042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:46 smithi110 ceph-mon[28069]: pgmap v14042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:46 smithi193 ceph-mon[32782]: pgmap v14042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25842.337172 secs 2024-04-26T18:58:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25842.337172 secs 2024-04-26T18:58:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25842.337172 secs 2024-04-26T18:58:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:48 smithi196 ceph-mon[32572]: pgmap v14043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:48 smithi110 ceph-mon[28069]: pgmap v14043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:48 smithi193 ceph-mon[32782]: pgmap v14043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:50 smithi196 ceph-mon[32572]: pgmap v14044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:50 smithi110 ceph-mon[28069]: pgmap v14044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:50 smithi193 ceph-mon[32782]: pgmap v14044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:52 smithi196 ceph-mon[32572]: pgmap v14045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25847.337288 secs 2024-04-26T18:58:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:52 smithi110 ceph-mon[28069]: pgmap v14045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25847.337288 secs 2024-04-26T18:58:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:52 smithi193 ceph-mon[32782]: pgmap v14045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25847.337288 secs 2024-04-26T18:58:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:54 smithi196 ceph-mon[32572]: pgmap v14046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:54 smithi110 ceph-mon[28069]: pgmap v14046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:54 smithi193 ceph-mon[32782]: pgmap v14046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:58:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:56 smithi196 ceph-mon[32572]: pgmap v14047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:56 smithi110 ceph-mon[28069]: pgmap v14047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:56 smithi193 ceph-mon[32782]: pgmap v14047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25852.337350 secs 2024-04-26T18:58:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25852.337350 secs 2024-04-26T18:58:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25852.337350 secs 2024-04-26T18:58:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:58:58 smithi196 ceph-mon[32572]: pgmap v14048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:58:58 smithi110 ceph-mon[28069]: pgmap v14048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:58:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:58:58 smithi193 ceph-mon[32782]: pgmap v14048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:00 smithi196 ceph-mon[32572]: pgmap v14049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:00 smithi110 ceph-mon[28069]: pgmap v14049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:00 smithi193 ceph-mon[32782]: pgmap v14049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:59:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:59:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:59:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:02 smithi196 ceph-mon[32572]: pgmap v14050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25857.337415 secs 2024-04-26T18:59:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:59:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:59:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:59:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:02 smithi110 ceph-mon[28069]: pgmap v14050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25857.337415 secs 2024-04-26T18:59:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:59:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:59:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:59:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:02 smithi193 ceph-mon[32782]: pgmap v14050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25857.337415 secs 2024-04-26T18:59:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:59:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:59:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T18:59:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:03 smithi196 ceph-mon[32572]: pgmap v14051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:59:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:03 smithi196 ceph-mon[32572]: pgmap v14052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:03 smithi110 ceph-mon[28069]: pgmap v14051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:59:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:03 smithi110 ceph-mon[28069]: pgmap v14052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:03 smithi193 ceph-mon[32782]: pgmap v14051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T18:59:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:03 smithi193 ceph-mon[32782]: pgmap v14052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:05 smithi196 ceph-mon[32572]: pgmap v14053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:05 smithi110 ceph-mon[28069]: pgmap v14053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:05 smithi193 ceph-mon[32782]: pgmap v14053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:07 smithi110 ceph-mon[28069]: pgmap v14054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25862.337535 secs 2024-04-26T18:59:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:07 smithi193 ceph-mon[32782]: pgmap v14054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25862.337535 secs 2024-04-26T18:59:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:07 smithi196 ceph-mon[32572]: pgmap v14054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25862.337535 secs 2024-04-26T18:59:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:09 smithi110 ceph-mon[28069]: pgmap v14055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:09 smithi193 ceph-mon[32782]: pgmap v14055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:09 smithi196 ceph-mon[32572]: pgmap v14055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:11 smithi110 ceph-mon[28069]: pgmap v14056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:12.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:11 smithi196 ceph-mon[32572]: pgmap v14056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:11 smithi193 ceph-mon[32782]: pgmap v14056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T18:59:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25867.337650 secs 2024-04-26T18:59:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:59:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:59:12.756+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:59:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:59:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:59:12.756+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:59:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:59:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:59:12.756+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:59:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:59:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:59:12.756+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:59:13.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 18:59:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T18:59:12.756+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:59:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25867.337650 secs 2024-04-26T18:59:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25867.337650 secs 2024-04-26T18:59:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:13 smithi110 ceph-mon[28069]: pgmap v14057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:59:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:13 smithi193 ceph-mon[32782]: pgmap v14057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:59:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:13 smithi196 ceph-mon[32572]: pgmap v14057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T18:59:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:15 smithi110 ceph-mon[28069]: pgmap v14058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:15 smithi193 ceph-mon[32782]: pgmap v14058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:15 smithi196 ceph-mon[32572]: pgmap v14058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25872.337747 secs 2024-04-26T18:59:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:17 smithi110 ceph-mon[28069]: pgmap v14059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25872.337747 secs 2024-04-26T18:59:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:17 smithi193 ceph-mon[32782]: pgmap v14059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25872.337747 secs 2024-04-26T18:59:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:17 smithi196 ceph-mon[32572]: pgmap v14059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:19 smithi193 ceph-mon[32782]: pgmap v14060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:19 smithi196 ceph-mon[32572]: pgmap v14060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:19 smithi110 ceph-mon[28069]: pgmap v14060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:21 smithi193 ceph-mon[32782]: pgmap v14061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:21 smithi196 ceph-mon[32572]: pgmap v14061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:21 smithi110 ceph-mon[28069]: pgmap v14061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25877.337865 secs 2024-04-26T18:59:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25877.337865 secs 2024-04-26T18:59:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25877.337865 secs 2024-04-26T18:59:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:23 smithi193 ceph-mon[32782]: pgmap v14062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:23 smithi196 ceph-mon[32572]: pgmap v14062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:23 smithi110 ceph-mon[28069]: pgmap v14062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:25 smithi193 ceph-mon[32782]: pgmap v14063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:25 smithi196 ceph-mon[32572]: pgmap v14063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:25 smithi110 ceph-mon[28069]: pgmap v14063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25882.338006 secs 2024-04-26T18:59:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:27 smithi193 ceph-mon[32782]: pgmap v14064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25882.338006 secs 2024-04-26T18:59:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:27 smithi196 ceph-mon[32572]: pgmap v14064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25882.338006 secs 2024-04-26T18:59:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:27 smithi110 ceph-mon[28069]: pgmap v14064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:29 smithi193 ceph-mon[32782]: pgmap v14065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:29 smithi196 ceph-mon[32572]: pgmap v14065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:29 smithi110 ceph-mon[28069]: pgmap v14065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:31 smithi193 ceph-mon[32782]: pgmap v14066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:31 smithi196 ceph-mon[32572]: pgmap v14066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:31 smithi110 ceph-mon[28069]: pgmap v14066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25887.338121 secs 2024-04-26T18:59:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25887.338121 secs 2024-04-26T18:59:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25887.338121 secs 2024-04-26T18:59:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:33 smithi193 ceph-mon[32782]: pgmap v14067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:33 smithi196 ceph-mon[32572]: pgmap v14067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:33 smithi110 ceph-mon[28069]: pgmap v14067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:35 smithi193 ceph-mon[32782]: pgmap v14068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:35 smithi196 ceph-mon[32572]: pgmap v14068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:35 smithi110 ceph-mon[28069]: pgmap v14068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25892.338265 secs 2024-04-26T18:59:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:37 smithi193 ceph-mon[32782]: pgmap v14069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25892.338265 secs 2024-04-26T18:59:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:37 smithi196 ceph-mon[32572]: pgmap v14069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25892.338265 secs 2024-04-26T18:59:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:37 smithi110 ceph-mon[28069]: pgmap v14069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:39 smithi193 ceph-mon[32782]: pgmap v14070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:39 smithi196 ceph-mon[32572]: pgmap v14070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:39 smithi110 ceph-mon[28069]: pgmap v14070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:41 smithi196 ceph-mon[32572]: pgmap v14071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:41 smithi110 ceph-mon[28069]: pgmap v14071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:41 smithi193 ceph-mon[32782]: pgmap v14071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25897.338376 secs 2024-04-26T18:59:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25897.338376 secs 2024-04-26T18:59:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25897.338376 secs 2024-04-26T18:59:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:43 smithi196 ceph-mon[32572]: pgmap v14072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:44.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:43 smithi193 ceph-mon[32782]: pgmap v14072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:43 smithi110 ceph-mon[28069]: pgmap v14072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:45 smithi196 ceph-mon[32572]: pgmap v14073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:45 smithi110 ceph-mon[28069]: pgmap v14073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:45 smithi193 ceph-mon[32782]: pgmap v14073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25902.338535 secs 2024-04-26T18:59:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:47 smithi196 ceph-mon[32572]: pgmap v14074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25902.338535 secs 2024-04-26T18:59:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:47 smithi110 ceph-mon[28069]: pgmap v14074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25902.338535 secs 2024-04-26T18:59:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:47 smithi193 ceph-mon[32782]: pgmap v14074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:49 smithi196 ceph-mon[32572]: pgmap v14075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:49 smithi110 ceph-mon[28069]: pgmap v14075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:49 smithi193 ceph-mon[32782]: pgmap v14075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:51 smithi196 ceph-mon[32572]: pgmap v14076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:51 smithi110 ceph-mon[28069]: pgmap v14076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:51 smithi193 ceph-mon[32782]: pgmap v14076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25907.338678 secs 2024-04-26T18:59:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25907.338678 secs 2024-04-26T18:59:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25907.338678 secs 2024-04-26T18:59:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:53 smithi196 ceph-mon[32572]: pgmap v14077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:53 smithi110 ceph-mon[28069]: pgmap v14077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:53 smithi193 ceph-mon[32782]: pgmap v14077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:59:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:55 smithi196 ceph-mon[32572]: pgmap v14078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:55 smithi110 ceph-mon[28069]: pgmap v14078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:55 smithi193 ceph-mon[32782]: pgmap v14078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25912.338765 secs 2024-04-26T18:59:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:57 smithi196 ceph-mon[32572]: pgmap v14079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:58.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25912.338765 secs 2024-04-26T18:59:58.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:57 smithi110 ceph-mon[28069]: pgmap v14079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T18:59:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25912.338765 secs 2024-04-26T18:59:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:57 smithi193 ceph-mon[32782]: pgmap v14079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 18:59:59 smithi196 ceph-mon[32572]: pgmap v14080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 18:59:59 smithi110 ceph-mon[28069]: pgmap v14080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 18:59:59 smithi193 ceph-mon[32782]: pgmap v14080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:00:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:00:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:00:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:01 smithi196 ceph-mon[32572]: pgmap v14081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:01 smithi110 ceph-mon[28069]: pgmap v14081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:01 smithi193 ceph-mon[32782]: pgmap v14081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25917.338888 secs 2024-04-26T19:00:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25917.338888 secs 2024-04-26T19:00:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25917.338888 secs 2024-04-26T19:00:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:03 smithi196 ceph-mon[32572]: pgmap v14082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:00:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:03 smithi110 ceph-mon[28069]: pgmap v14082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:00:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:03 smithi193 ceph-mon[32782]: pgmap v14082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:00:05.224 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:04 smithi110 ceph-mon[28069]: pgmap v14083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:04 smithi196 ceph-mon[32572]: pgmap v14083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:04 smithi193 ceph-mon[32782]: pgmap v14083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:07.922 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25922.339013 secs 2024-04-26T19:00:07.922 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:07 smithi110 ceph-mon[28069]: pgmap v14084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25922.339013 secs 2024-04-26T19:00:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:07 smithi196 ceph-mon[32572]: pgmap v14084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25922.339013 secs 2024-04-26T19:00:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:07 smithi193 ceph-mon[32782]: pgmap v14084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:09 smithi193 ceph-mon[32782]: pgmap v14085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:09 smithi196 ceph-mon[32572]: pgmap v14085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:09 smithi110 ceph-mon[28069]: pgmap v14085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:00:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:00:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:00:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:00:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:10 smithi196 ceph-mon[32572]: pgmap v14086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 930 B/s rd, 1 op/s 2024-04-26T19:00:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:10 smithi196 ceph-mon[32572]: pgmap v14087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:00:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:00:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:00:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:00:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:00:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:10 smithi110 ceph-mon[28069]: pgmap v14086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 930 B/s rd, 1 op/s 2024-04-26T19:00:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:10 smithi110 ceph-mon[28069]: pgmap v14087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:00:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:00:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:00:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:00:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:00:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:10 smithi193 ceph-mon[32782]: pgmap v14086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 930 B/s rd, 1 op/s 2024-04-26T19:00:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:10 smithi193 ceph-mon[32782]: pgmap v14087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:00:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25927.339073 secs 2024-04-26T19:00:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:12 smithi196 ceph-mon[32572]: pgmap v14088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 568 B/s rd, 1 op/s 2024-04-26T19:00:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25927.339073 secs 2024-04-26T19:00:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:12 smithi110 ceph-mon[28069]: pgmap v14088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 568 B/s rd, 1 op/s 2024-04-26T19:00:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25927.339073 secs 2024-04-26T19:00:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:12 smithi193 ceph-mon[32782]: pgmap v14088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 568 B/s rd, 1 op/s 2024-04-26T19:00:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:14 smithi196 ceph-mon[32572]: pgmap v14089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:14 smithi110 ceph-mon[28069]: pgmap v14089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:14 smithi193 ceph-mon[32782]: pgmap v14089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:16 smithi196 ceph-mon[32572]: pgmap v14090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:16 smithi110 ceph-mon[28069]: pgmap v14090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:16 smithi193 ceph-mon[32782]: pgmap v14090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25932.339218 secs 2024-04-26T19:00:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25932.339218 secs 2024-04-26T19:00:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25932.339218 secs 2024-04-26T19:00:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:18 smithi196 ceph-mon[32572]: pgmap v14091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:18 smithi110 ceph-mon[28069]: pgmap v14091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:18 smithi193 ceph-mon[32782]: pgmap v14091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:00:20.660+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:00:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:00:20.660+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:00:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:00:20.660+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 201 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:00:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:00:20.661+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 201 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:00:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:20 smithi110 ceph-mon[28069]: pgmap v14092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:00:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:20 smithi193 ceph-mon[32782]: pgmap v14092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:00:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:20 smithi196 ceph-mon[32572]: pgmap v14092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:00:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25937.339335 secs 2024-04-26T19:00:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:22 smithi196 ceph-mon[32572]: pgmap v14093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:23.012 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25937.339335 secs 2024-04-26T19:00:23.012 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:22 smithi110 ceph-mon[28069]: pgmap v14093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25937.339335 secs 2024-04-26T19:00:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:22 smithi193 ceph-mon[32782]: pgmap v14093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:24 smithi110 ceph-mon[28069]: pgmap v14094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:24 smithi193 ceph-mon[32782]: pgmap v14094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:24 smithi196 ceph-mon[32572]: pgmap v14094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:26 smithi110 ceph-mon[28069]: pgmap v14095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:26 smithi193 ceph-mon[32782]: pgmap v14095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:26 smithi196 ceph-mon[32572]: pgmap v14095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25942.339461 secs 2024-04-26T19:00:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25942.339461 secs 2024-04-26T19:00:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25942.339461 secs 2024-04-26T19:00:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:28 smithi110 ceph-mon[28069]: pgmap v14096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:28 smithi193 ceph-mon[32782]: pgmap v14096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:28 smithi196 ceph-mon[32572]: pgmap v14096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:30 smithi110 ceph-mon[28069]: pgmap v14097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:30 smithi193 ceph-mon[32782]: pgmap v14097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:30 smithi196 ceph-mon[32572]: pgmap v14097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25947.339572 secs 2024-04-26T19:00:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:32 smithi193 ceph-mon[32782]: pgmap v14098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25947.339572 secs 2024-04-26T19:00:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:32 smithi196 ceph-mon[32572]: pgmap v14098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25947.339572 secs 2024-04-26T19:00:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:32 smithi110 ceph-mon[28069]: pgmap v14098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:34 smithi193 ceph-mon[32782]: pgmap v14099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:34 smithi196 ceph-mon[32572]: pgmap v14099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:34 smithi110 ceph-mon[28069]: pgmap v14099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:36 smithi193 ceph-mon[32782]: pgmap v14100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:36 smithi196 ceph-mon[32572]: pgmap v14100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:36 smithi110 ceph-mon[28069]: pgmap v14100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25952.339631 secs 2024-04-26T19:00:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25952.339631 secs 2024-04-26T19:00:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25952.339631 secs 2024-04-26T19:00:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:38 smithi193 ceph-mon[32782]: pgmap v14101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:38 smithi196 ceph-mon[32572]: pgmap v14101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:38 smithi110 ceph-mon[28069]: pgmap v14101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:40 smithi193 ceph-mon[32782]: pgmap v14102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:40 smithi196 ceph-mon[32572]: pgmap v14102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:40 smithi110 ceph-mon[28069]: pgmap v14102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:43.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25957.339749 secs 2024-04-26T19:00:43.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:42 smithi110 ceph-mon[28069]: pgmap v14103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25957.339749 secs 2024-04-26T19:00:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:42 smithi193 ceph-mon[32782]: pgmap v14103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25957.339749 secs 2024-04-26T19:00:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:42 smithi196 ceph-mon[32572]: pgmap v14103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:44 smithi193 ceph-mon[32782]: pgmap v14104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:44 smithi196 ceph-mon[32572]: pgmap v14104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:44 smithi110 ceph-mon[28069]: pgmap v14104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:46 smithi193 ceph-mon[32782]: pgmap v14105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:46 smithi196 ceph-mon[32572]: pgmap v14105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:46 smithi110 ceph-mon[28069]: pgmap v14105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25962.339868 secs 2024-04-26T19:00:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25962.339868 secs 2024-04-26T19:00:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25962.339868 secs 2024-04-26T19:00:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:48 smithi193 ceph-mon[32782]: pgmap v14106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:48 smithi196 ceph-mon[32572]: pgmap v14106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:48 smithi110 ceph-mon[28069]: pgmap v14106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:50 smithi193 ceph-mon[32782]: pgmap v14107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:50 smithi196 ceph-mon[32572]: pgmap v14107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:50 smithi110 ceph-mon[28069]: pgmap v14107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25967.339989 secs 2024-04-26T19:00:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:52 smithi193 ceph-mon[32782]: pgmap v14108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25967.339989 secs 2024-04-26T19:00:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:52 smithi196 ceph-mon[32572]: pgmap v14108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25967.339989 secs 2024-04-26T19:00:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:52 smithi110 ceph-mon[28069]: pgmap v14108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:54 smithi193 ceph-mon[32782]: pgmap v14109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:54 smithi196 ceph-mon[32572]: pgmap v14109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:54 smithi110 ceph-mon[28069]: pgmap v14109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:56 smithi193 ceph-mon[32782]: pgmap v14110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:56 smithi196 ceph-mon[32572]: pgmap v14110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:56 smithi110 ceph-mon[28069]: pgmap v14110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:00:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25972.340113 secs 2024-04-26T19:00:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25972.340113 secs 2024-04-26T19:00:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25972.340113 secs 2024-04-26T19:00:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:00:58 smithi196 ceph-mon[32572]: pgmap v14111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:00:58 smithi110 ceph-mon[28069]: pgmap v14111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:00:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:00:58 smithi193 ceph-mon[32782]: pgmap v14111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:00 smithi196 ceph-mon[32572]: pgmap v14112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:00 smithi110 ceph-mon[28069]: pgmap v14112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:00 smithi193 ceph-mon[32782]: pgmap v14112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25977.340255 secs 2024-04-26T19:01:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:02 smithi196 ceph-mon[32572]: pgmap v14113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25977.340255 secs 2024-04-26T19:01:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:02 smithi110 ceph-mon[28069]: pgmap v14113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25977.340255 secs 2024-04-26T19:01:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:02 smithi193 ceph-mon[32782]: pgmap v14113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:04 smithi196 ceph-mon[32572]: pgmap v14114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:04 smithi110 ceph-mon[28069]: pgmap v14114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:04 smithi193 ceph-mon[32782]: pgmap v14114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:06 smithi196 ceph-mon[32572]: pgmap v14115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:06 smithi110 ceph-mon[28069]: pgmap v14115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:06 smithi193 ceph-mon[32782]: pgmap v14115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25982.340326 secs 2024-04-26T19:01:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25982.340326 secs 2024-04-26T19:01:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25982.340326 secs 2024-04-26T19:01:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:08 smithi196 ceph-mon[32572]: pgmap v14116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:08 smithi110 ceph-mon[28069]: pgmap v14116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:08 smithi193 ceph-mon[32782]: pgmap v14116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:10 smithi196 ceph-mon[32572]: pgmap v14117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:01:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:10 smithi110 ceph-mon[28069]: pgmap v14117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:01:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:10 smithi193 ceph-mon[32782]: pgmap v14117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:01:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:01:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:01:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:01:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:01:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:01:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:01:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:01:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:01:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:01:13.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:12 smithi110 ceph-mon[28069]: pgmap v14118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:01:13.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:12 smithi110 ceph-mon[28069]: pgmap v14119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:13.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:12 smithi110 ceph-mon[28069]: 21 slow requests, 1 included below; oldest blocked for > 25987.340461 secs 2024-04-26T19:01:13.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:12 smithi110 ceph-mon[28069]: slow request 11524.358221 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:01:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:12 smithi196 ceph-mon[32572]: pgmap v14118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:01:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:12 smithi196 ceph-mon[32572]: pgmap v14119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:12 smithi196 ceph-mon[32572]: 21 slow requests, 1 included below; oldest blocked for > 25987.340461 secs 2024-04-26T19:01:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:12 smithi196 ceph-mon[32572]: slow request 11524.358221 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:01:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:12 smithi193 ceph-mon[32782]: pgmap v14118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:01:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:12 smithi193 ceph-mon[32782]: pgmap v14119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:12 smithi193 ceph-mon[32782]: 21 slow requests, 1 included below; oldest blocked for > 25987.340461 secs 2024-04-26T19:01:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:12 smithi193 ceph-mon[32782]: slow request 11524.358221 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:01:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:14 smithi196 ceph-mon[32572]: pgmap v14120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:14 smithi110 ceph-mon[28069]: pgmap v14120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:14 smithi193 ceph-mon[32782]: pgmap v14120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:16 smithi196 ceph-mon[32572]: pgmap v14121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:16 smithi110 ceph-mon[28069]: pgmap v14121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:16 smithi193 ceph-mon[32782]: pgmap v14121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25992.340619 secs 2024-04-26T19:01:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25992.340619 secs 2024-04-26T19:01:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25992.340619 secs 2024-04-26T19:01:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:18 smithi196 ceph-mon[32572]: pgmap v14122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T19:01:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:18 smithi110 ceph-mon[28069]: pgmap v14122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T19:01:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:18 smithi193 ceph-mon[32782]: pgmap v14122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T19:01:21.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:20 smithi196 ceph-mon[32572]: pgmap v14123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:20 smithi110 ceph-mon[28069]: pgmap v14123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:20 smithi193 ceph-mon[32782]: pgmap v14123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:01:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:22 smithi196 ceph-mon[32572]: pgmap v14124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:01:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 25997.340774 secs 2024-04-26T19:01:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:22 smithi110 ceph-mon[28069]: pgmap v14124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:01:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 25997.340774 secs 2024-04-26T19:01:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:22 smithi193 ceph-mon[32782]: pgmap v14124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:01:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 25997.340774 secs 2024-04-26T19:01:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:24 smithi196 ceph-mon[32572]: pgmap v14125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:24 smithi110 ceph-mon[28069]: pgmap v14125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:24 smithi193 ceph-mon[32782]: pgmap v14125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:26 smithi196 ceph-mon[32572]: pgmap v14126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:26 smithi110 ceph-mon[28069]: pgmap v14126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:26 smithi193 ceph-mon[32782]: pgmap v14126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26002.340860 secs 2024-04-26T19:01:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:27 smithi196 ceph-mon[32572]: pgmap v14127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26002.340860 secs 2024-04-26T19:01:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:27 smithi110 ceph-mon[28069]: pgmap v14127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26002.340860 secs 2024-04-26T19:01:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:27 smithi193 ceph-mon[32782]: pgmap v14127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:30 smithi193 ceph-mon[32782]: pgmap v14128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:30 smithi196 ceph-mon[32572]: pgmap v14128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:30 smithi110 ceph-mon[28069]: pgmap v14128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:32 smithi193 ceph-mon[32782]: pgmap v14129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26007.340936 secs 2024-04-26T19:01:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:32 smithi196 ceph-mon[32572]: pgmap v14129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26007.340936 secs 2024-04-26T19:01:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:32 smithi110 ceph-mon[28069]: pgmap v14129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26007.340936 secs 2024-04-26T19:01:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:34 smithi193 ceph-mon[32782]: pgmap v14130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:34 smithi196 ceph-mon[32572]: pgmap v14130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:34 smithi110 ceph-mon[28069]: pgmap v14130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:36 smithi193 ceph-mon[32782]: pgmap v14131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:36 smithi196 ceph-mon[32572]: pgmap v14131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:36 smithi110 ceph-mon[28069]: pgmap v14131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26012.341024 secs 2024-04-26T19:01:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26012.341024 secs 2024-04-26T19:01:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26012.341024 secs 2024-04-26T19:01:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:38 smithi196 ceph-mon[32572]: pgmap v14132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:38 smithi110 ceph-mon[28069]: pgmap v14132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:38 smithi193 ceph-mon[32782]: pgmap v14132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:40 smithi196 ceph-mon[32572]: pgmap v14133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:40 smithi110 ceph-mon[28069]: pgmap v14133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:40 smithi193 ceph-mon[32782]: pgmap v14133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:42 smithi196 ceph-mon[32572]: pgmap v14134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26017.341170 secs 2024-04-26T19:01:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:42 smithi110 ceph-mon[28069]: pgmap v14134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26017.341170 secs 2024-04-26T19:01:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:42 smithi193 ceph-mon[32782]: pgmap v14134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26017.341170 secs 2024-04-26T19:01:44.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:44 smithi196 ceph-mon[32572]: pgmap v14135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:44 smithi110 ceph-mon[28069]: pgmap v14135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:44 smithi193 ceph-mon[32782]: pgmap v14135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:46.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:46 smithi193 ceph-mon[32782]: pgmap v14136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:46 smithi196 ceph-mon[32572]: pgmap v14136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:46 smithi110 ceph-mon[28069]: pgmap v14136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26022.341328 secs 2024-04-26T19:01:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26022.341328 secs 2024-04-26T19:01:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26022.341328 secs 2024-04-26T19:01:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:48 smithi196 ceph-mon[32572]: pgmap v14137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:48 smithi110 ceph-mon[28069]: pgmap v14137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:48 smithi193 ceph-mon[32782]: pgmap v14137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:50 smithi196 ceph-mon[32572]: pgmap v14138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:50 smithi110 ceph-mon[28069]: pgmap v14138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:50 smithi193 ceph-mon[32782]: pgmap v14138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:52 smithi196 ceph-mon[32572]: pgmap v14139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26027.341486 secs 2024-04-26T19:01:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:52 smithi110 ceph-mon[28069]: pgmap v14139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26027.341486 secs 2024-04-26T19:01:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:52 smithi193 ceph-mon[32782]: pgmap v14139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26027.341486 secs 2024-04-26T19:01:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:54 smithi196 ceph-mon[32572]: pgmap v14140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:54 smithi110 ceph-mon[28069]: pgmap v14140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:54 smithi193 ceph-mon[32782]: pgmap v14140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:56 smithi196 ceph-mon[32572]: pgmap v14141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:56 smithi110 ceph-mon[28069]: pgmap v14141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:56 smithi193 ceph-mon[32782]: pgmap v14141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:01:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26032.341634 secs 2024-04-26T19:01:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26032.341634 secs 2024-04-26T19:01:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26032.341634 secs 2024-04-26T19:01:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:01:58 smithi196 ceph-mon[32572]: pgmap v14142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:01:58 smithi110 ceph-mon[28069]: pgmap v14142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:01:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:01:58 smithi193 ceph-mon[32782]: pgmap v14142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:02:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:00 smithi196 ceph-mon[32572]: pgmap v14143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:00 smithi110 ceph-mon[28069]: pgmap v14143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:00 smithi193 ceph-mon[32782]: pgmap v14143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:02 smithi196 ceph-mon[32572]: pgmap v14144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26037.341755 secs 2024-04-26T19:02:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:02 smithi110 ceph-mon[28069]: pgmap v14144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26037.341755 secs 2024-04-26T19:02:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:02 smithi193 ceph-mon[32782]: pgmap v14144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26037.341755 secs 2024-04-26T19:02:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:04 smithi196 ceph-mon[32572]: pgmap v14145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:04 smithi110 ceph-mon[28069]: pgmap v14145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:04 smithi193 ceph-mon[32782]: pgmap v14145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:06 smithi196 ceph-mon[32572]: pgmap v14146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:06 smithi110 ceph-mon[28069]: pgmap v14146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:06 smithi193 ceph-mon[32782]: pgmap v14146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26042.341877 secs 2024-04-26T19:02:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26042.341877 secs 2024-04-26T19:02:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26042.341877 secs 2024-04-26T19:02:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:08 smithi196 ceph-mon[32572]: pgmap v14147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:02:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:08 smithi110 ceph-mon[28069]: pgmap v14147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:02:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:08 smithi193 ceph-mon[32782]: pgmap v14147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:02:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:10 smithi196 ceph-mon[32572]: pgmap v14148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:10 smithi110 ceph-mon[28069]: pgmap v14148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:10 smithi193 ceph-mon[32782]: pgmap v14148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:02:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:02:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:02:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:12 smithi196 ceph-mon[32572]: pgmap v14149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26047.341943 secs 2024-04-26T19:02:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:12 smithi110 ceph-mon[28069]: pgmap v14149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26047.341943 secs 2024-04-26T19:02:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:12 smithi193 ceph-mon[32782]: pgmap v14149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26047.341943 secs 2024-04-26T19:02:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:02:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:02:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:13 smithi196 ceph-mon[32572]: pgmap v14150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:02:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:13 smithi196 ceph-mon[32572]: pgmap v14151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:02:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:02:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:02:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:13 smithi110 ceph-mon[28069]: pgmap v14150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:02:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:13 smithi110 ceph-mon[28069]: pgmap v14151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:02:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:02:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:02:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:13 smithi193 ceph-mon[32782]: pgmap v14150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:02:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:13 smithi193 ceph-mon[32782]: pgmap v14151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:02:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:15 smithi193 ceph-mon[32782]: pgmap v14152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:15 smithi196 ceph-mon[32572]: pgmap v14152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:15 smithi110 ceph-mon[28069]: pgmap v14152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26052.342005 secs 2024-04-26T19:02:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:17 smithi196 ceph-mon[32572]: pgmap v14153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:02:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26052.342005 secs 2024-04-26T19:02:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:17 smithi110 ceph-mon[28069]: pgmap v14153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:02:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26052.342005 secs 2024-04-26T19:02:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:17 smithi193 ceph-mon[32782]: pgmap v14153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:02:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:19 smithi196 ceph-mon[32572]: pgmap v14154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:19 smithi110 ceph-mon[28069]: pgmap v14154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:19 smithi193 ceph-mon[32782]: pgmap v14154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:21 smithi196 ceph-mon[32572]: pgmap v14155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:21 smithi110 ceph-mon[28069]: pgmap v14155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:21 smithi193 ceph-mon[32782]: pgmap v14155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26057.342083 secs 2024-04-26T19:02:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26057.342083 secs 2024-04-26T19:02:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26057.342083 secs 2024-04-26T19:02:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:23 smithi196 ceph-mon[32572]: pgmap v14156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:02:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:23 smithi110 ceph-mon[28069]: pgmap v14156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:02:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:23 smithi193 ceph-mon[32782]: pgmap v14156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:02:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:25 smithi196 ceph-mon[32572]: pgmap v14157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:25 smithi110 ceph-mon[28069]: pgmap v14157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:25 smithi193 ceph-mon[32782]: pgmap v14157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26062.342208 secs 2024-04-26T19:02:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:27 smithi196 ceph-mon[32572]: pgmap v14158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26062.342208 secs 2024-04-26T19:02:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:27 smithi110 ceph-mon[28069]: pgmap v14158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26062.342208 secs 2024-04-26T19:02:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:27 smithi193 ceph-mon[32782]: pgmap v14158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:29 smithi196 ceph-mon[32572]: pgmap v14159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:29 smithi110 ceph-mon[28069]: pgmap v14159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:29 smithi193 ceph-mon[32782]: pgmap v14159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:31 smithi196 ceph-mon[32572]: pgmap v14160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:31 smithi110 ceph-mon[28069]: pgmap v14160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:31 smithi193 ceph-mon[32782]: pgmap v14160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26067.342322 secs 2024-04-26T19:02:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26067.342322 secs 2024-04-26T19:02:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26067.342322 secs 2024-04-26T19:02:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:33 smithi196 ceph-mon[32572]: pgmap v14161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:33 smithi110 ceph-mon[28069]: pgmap v14161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:33 smithi193 ceph-mon[32782]: pgmap v14161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:35 smithi196 ceph-mon[32572]: pgmap v14162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:35 smithi110 ceph-mon[28069]: pgmap v14162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:35 smithi193 ceph-mon[32782]: pgmap v14162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26072.342441 secs 2024-04-26T19:02:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:37 smithi196 ceph-mon[32572]: pgmap v14163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26072.342441 secs 2024-04-26T19:02:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:37 smithi110 ceph-mon[28069]: pgmap v14163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26072.342441 secs 2024-04-26T19:02:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:37 smithi193 ceph-mon[32782]: pgmap v14163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:39 smithi196 ceph-mon[32572]: pgmap v14164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:39 smithi110 ceph-mon[28069]: pgmap v14164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:39 smithi193 ceph-mon[32782]: pgmap v14164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:41 smithi196 ceph-mon[32572]: pgmap v14165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:41 smithi110 ceph-mon[28069]: pgmap v14165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:41 smithi193 ceph-mon[32782]: pgmap v14165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26077.342559 secs 2024-04-26T19:02:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26077.342559 secs 2024-04-26T19:02:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26077.342559 secs 2024-04-26T19:02:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:43 smithi196 ceph-mon[32572]: pgmap v14166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:43 smithi110 ceph-mon[28069]: pgmap v14166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:43 smithi193 ceph-mon[32782]: pgmap v14166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:45 smithi196 ceph-mon[32572]: pgmap v14167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:45 smithi110 ceph-mon[28069]: pgmap v14167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:45 smithi193 ceph-mon[32782]: pgmap v14167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:48.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26082.342722 secs 2024-04-26T19:02:48.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:47 smithi193 ceph-mon[32782]: pgmap v14168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26082.342722 secs 2024-04-26T19:02:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:47 smithi196 ceph-mon[32572]: pgmap v14168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26082.342722 secs 2024-04-26T19:02:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:47 smithi110 ceph-mon[28069]: pgmap v14168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:49 smithi196 ceph-mon[32572]: pgmap v14169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:49 smithi110 ceph-mon[28069]: pgmap v14169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:50.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:49 smithi193 ceph-mon[32782]: pgmap v14169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:51 smithi196 ceph-mon[32572]: pgmap v14170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:51 smithi110 ceph-mon[28069]: pgmap v14170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:51 smithi193 ceph-mon[32782]: pgmap v14170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26087.342850 secs 2024-04-26T19:02:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26087.342850 secs 2024-04-26T19:02:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26087.342850 secs 2024-04-26T19:02:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:53 smithi196 ceph-mon[32572]: pgmap v14171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:53 smithi110 ceph-mon[28069]: pgmap v14171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:53 smithi193 ceph-mon[32782]: pgmap v14171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:02:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:55 smithi196 ceph-mon[32572]: pgmap v14172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:55 smithi110 ceph-mon[28069]: pgmap v14172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:55 smithi193 ceph-mon[32782]: pgmap v14172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26092.342915 secs 2024-04-26T19:02:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:57 smithi196 ceph-mon[32572]: pgmap v14173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26092.342915 secs 2024-04-26T19:02:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:57 smithi110 ceph-mon[28069]: pgmap v14173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:02:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26092.342915 secs 2024-04-26T19:02:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:57 smithi193 ceph-mon[32782]: pgmap v14173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:02:59 smithi196 ceph-mon[32572]: pgmap v14174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:02:59 smithi110 ceph-mon[28069]: pgmap v14174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:02:59 smithi193 ceph-mon[32782]: pgmap v14174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:01 smithi196 ceph-mon[32572]: pgmap v14175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:01 smithi110 ceph-mon[28069]: pgmap v14175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:01 smithi193 ceph-mon[32782]: pgmap v14175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26097.342980 secs 2024-04-26T19:03:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26097.342980 secs 2024-04-26T19:03:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26097.342980 secs 2024-04-26T19:03:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:03 smithi196 ceph-mon[32572]: pgmap v14176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:03 smithi110 ceph-mon[28069]: pgmap v14176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:03 smithi193 ceph-mon[32782]: pgmap v14176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:05 smithi196 ceph-mon[32572]: pgmap v14177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:05 smithi110 ceph-mon[28069]: pgmap v14177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:05 smithi193 ceph-mon[32782]: pgmap v14177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26102.343126 secs 2024-04-26T19:03:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:07 smithi196 ceph-mon[32572]: pgmap v14178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26102.343126 secs 2024-04-26T19:03:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:07 smithi110 ceph-mon[28069]: pgmap v14178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26102.343126 secs 2024-04-26T19:03:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:07 smithi193 ceph-mon[32782]: pgmap v14178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:09 smithi196 ceph-mon[32572]: pgmap v14179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:09 smithi110 ceph-mon[28069]: pgmap v14179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:10.370 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:09 smithi193 ceph-mon[32782]: pgmap v14179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:11 smithi196 ceph-mon[32572]: pgmap v14180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:11 smithi110 ceph-mon[28069]: pgmap v14180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:11 smithi193 ceph-mon[32782]: pgmap v14180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26107.343268 secs 2024-04-26T19:03:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26107.343268 secs 2024-04-26T19:03:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26107.343268 secs 2024-04-26T19:03:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:13 smithi196 ceph-mon[32572]: pgmap v14181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:03:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:13 smithi110 ceph-mon[28069]: pgmap v14181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:03:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:13 smithi193 ceph-mon[32782]: pgmap v14181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:03:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:03:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:03:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:03:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:03:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:03:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:03:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:03:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:03:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:03:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:16 smithi110 ceph-mon[28069]: pgmap v14182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T19:03:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:16 smithi110 ceph-mon[28069]: pgmap v14183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:16 smithi193 ceph-mon[32782]: pgmap v14182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T19:03:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:16 smithi193 ceph-mon[32782]: pgmap v14183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.448+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T19:03:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.448+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T19:03:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.448+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:03:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.448+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T19:03:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.449+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:03:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.450+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T19:03:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.450+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T19:03:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.453+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T19:03:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.453+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T19:03:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.453+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261402d040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:03:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.453+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261402d040 comp rx=0 tx=0).stop 2024-04-26T19:03:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.453+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T19:03:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.453+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T19:03:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.453+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T19:03:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.453+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T19:03:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.454+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:03:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:16.455+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T19:03:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:16 smithi196 ceph-mon[32572]: pgmap v14182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T19:03:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:16 smithi196 ceph-mon[32572]: pgmap v14183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:17 smithi110 ceph-mon[28069]: pgmap v14184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:17 smithi193 ceph-mon[32782]: pgmap v14184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:17 smithi196 ceph-mon[32572]: pgmap v14184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:18 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26112.343382 secs 2024-04-26T19:03:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:18 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26112.343382 secs 2024-04-26T19:03:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:18 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26112.343382 secs 2024-04-26T19:03:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:19 smithi110 ceph-mon[28069]: pgmap v14185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:19 smithi193 ceph-mon[32782]: pgmap v14185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:19 smithi196 ceph-mon[32572]: pgmap v14185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:20.689 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:20.690+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:03:20.690 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:20.690+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:03:20.690 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:20.690+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 202 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:03:20.690 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:03:20.690+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 202 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:03:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:21 smithi196 ceph-mon[32572]: pgmap v14186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:21 smithi110 ceph-mon[28069]: pgmap v14186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:21 smithi193 ceph-mon[32782]: pgmap v14186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26117.343524 secs 2024-04-26T19:03:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26117.343524 secs 2024-04-26T19:03:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26117.343524 secs 2024-04-26T19:03:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:23 smithi196 ceph-mon[32572]: pgmap v14187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:23 smithi110 ceph-mon[28069]: pgmap v14187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:23 smithi193 ceph-mon[32782]: pgmap v14187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:03:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:25 smithi196 ceph-mon[32572]: pgmap v14188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:03:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:25 smithi110 ceph-mon[28069]: pgmap v14188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:03:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:25 smithi193 ceph-mon[32782]: pgmap v14188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:03:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:27 smithi196 ceph-mon[32572]: pgmap v14189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26122.343648 secs 2024-04-26T19:03:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:27 smithi110 ceph-mon[28069]: pgmap v14189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26122.343648 secs 2024-04-26T19:03:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:27 smithi193 ceph-mon[32782]: pgmap v14189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26122.343648 secs 2024-04-26T19:03:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:29 smithi196 ceph-mon[32572]: pgmap v14190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:29 smithi110 ceph-mon[28069]: pgmap v14190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:29 smithi193 ceph-mon[32782]: pgmap v14190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:31 smithi196 ceph-mon[32572]: pgmap v14191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:31 smithi110 ceph-mon[28069]: pgmap v14191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:31 smithi193 ceph-mon[32782]: pgmap v14191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26127.343769 secs 2024-04-26T19:03:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26127.343769 secs 2024-04-26T19:03:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26127.343769 secs 2024-04-26T19:03:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:33 smithi196 ceph-mon[32572]: pgmap v14192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:33 smithi110 ceph-mon[28069]: pgmap v14192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:33 smithi193 ceph-mon[32782]: pgmap v14192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:35 smithi196 ceph-mon[32572]: pgmap v14193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:35 smithi110 ceph-mon[28069]: pgmap v14193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:35 smithi193 ceph-mon[32782]: pgmap v14193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:37 smithi196 ceph-mon[32572]: pgmap v14194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26132.343852 secs 2024-04-26T19:03:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:37 smithi110 ceph-mon[28069]: pgmap v14194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26132.343852 secs 2024-04-26T19:03:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:37 smithi193 ceph-mon[32782]: pgmap v14194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26132.343852 secs 2024-04-26T19:03:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:39 smithi196 ceph-mon[32572]: pgmap v14195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:39 smithi110 ceph-mon[28069]: pgmap v14195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:39 smithi193 ceph-mon[32782]: pgmap v14195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:41 smithi110 ceph-mon[28069]: pgmap v14196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:41 smithi193 ceph-mon[32782]: pgmap v14196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:41 smithi196 ceph-mon[32572]: pgmap v14196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26137.343917 secs 2024-04-26T19:03:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26137.343917 secs 2024-04-26T19:03:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26137.343917 secs 2024-04-26T19:03:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:43 smithi110 ceph-mon[28069]: pgmap v14197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:43 smithi193 ceph-mon[32782]: pgmap v14197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:43 smithi196 ceph-mon[32572]: pgmap v14197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:45 smithi110 ceph-mon[28069]: pgmap v14198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:45 smithi193 ceph-mon[32782]: pgmap v14198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:45 smithi196 ceph-mon[32572]: pgmap v14198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:47 smithi110 ceph-mon[28069]: pgmap v14199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26142.344065 secs 2024-04-26T19:03:47.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:47 smithi196 ceph-mon[32572]: pgmap v14199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:47.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26142.344065 secs 2024-04-26T19:03:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:47 smithi193 ceph-mon[32782]: pgmap v14199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26142.344065 secs 2024-04-26T19:03:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:49 smithi110 ceph-mon[28069]: pgmap v14200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:49 smithi193 ceph-mon[32782]: pgmap v14200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:49 smithi196 ceph-mon[32572]: pgmap v14200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:51 smithi110 ceph-mon[28069]: pgmap v14201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:51 smithi193 ceph-mon[32782]: pgmap v14201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:51 smithi196 ceph-mon[32572]: pgmap v14201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26147.344183 secs 2024-04-26T19:03:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26147.344183 secs 2024-04-26T19:03:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26147.344183 secs 2024-04-26T19:03:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:53 smithi193 ceph-mon[32782]: pgmap v14202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:53 smithi196 ceph-mon[32572]: pgmap v14202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:53 smithi110 ceph-mon[28069]: pgmap v14202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:03:55.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:55 smithi193 ceph-mon[32782]: pgmap v14203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:55 smithi196 ceph-mon[32572]: pgmap v14203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:55 smithi110 ceph-mon[28069]: pgmap v14203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:57 smithi193 ceph-mon[32782]: pgmap v14204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26152.344310 secs 2024-04-26T19:03:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:57 smithi196 ceph-mon[32572]: pgmap v14204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26152.344310 secs 2024-04-26T19:03:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:57 smithi110 ceph-mon[28069]: pgmap v14204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:03:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26152.344310 secs 2024-04-26T19:03:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:03:59 smithi193 ceph-mon[32782]: pgmap v14205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:03:59 smithi196 ceph-mon[32572]: pgmap v14205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:03:59 smithi110 ceph-mon[28069]: pgmap v14205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:01 smithi193 ceph-mon[32782]: pgmap v14206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:01 smithi196 ceph-mon[32572]: pgmap v14206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:01 smithi110 ceph-mon[28069]: pgmap v14206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26157.344432 secs 2024-04-26T19:04:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26157.344432 secs 2024-04-26T19:04:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26157.344432 secs 2024-04-26T19:04:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:03 smithi193 ceph-mon[32782]: pgmap v14207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:03 smithi196 ceph-mon[32572]: pgmap v14207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:03 smithi110 ceph-mon[28069]: pgmap v14207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:05 smithi193 ceph-mon[32782]: pgmap v14208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:05 smithi196 ceph-mon[32572]: pgmap v14208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:05 smithi110 ceph-mon[28069]: pgmap v14208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:07 smithi193 ceph-mon[32782]: pgmap v14209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26162.344590 secs 2024-04-26T19:04:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:07 smithi196 ceph-mon[32572]: pgmap v14209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26162.344590 secs 2024-04-26T19:04:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:07 smithi110 ceph-mon[28069]: pgmap v14209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26162.344590 secs 2024-04-26T19:04:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:09 smithi193 ceph-mon[32782]: pgmap v14210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:09 smithi196 ceph-mon[32572]: pgmap v14210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:09 smithi110 ceph-mon[28069]: pgmap v14210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:11 smithi193 ceph-mon[32782]: pgmap v14211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:11 smithi196 ceph-mon[32572]: pgmap v14211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:11 smithi110 ceph-mon[28069]: pgmap v14211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26167.344721 secs 2024-04-26T19:04:12.960 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26167.344721 secs 2024-04-26T19:04:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26167.344721 secs 2024-04-26T19:04:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:04:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:04:12.958+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:04:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:04:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:04:12.958+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:04:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:04:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:04:12.958+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:04:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:04:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:04:12.958+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:04:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:04:12 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:04:12.958+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:04:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:13 smithi193 ceph-mon[32782]: pgmap v14212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:13 smithi196 ceph-mon[32572]: pgmap v14212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:13 smithi110 ceph-mon[28069]: pgmap v14212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:15 smithi193 ceph-mon[32782]: pgmap v14213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:04:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:15 smithi196 ceph-mon[32572]: pgmap v14213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:04:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:15 smithi110 ceph-mon[28069]: pgmap v14213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:04:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:04:17.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:04:17.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:04:17.526 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:04:17.527 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:04:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:17 smithi196 ceph-mon[32572]: pgmap v14214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26172.344839 secs 2024-04-26T19:04:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:17 smithi196 ceph-mon[32572]: pgmap v14215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T19:04:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:17 smithi196 ceph-mon[32572]: pgmap v14216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T19:04:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:17 smithi110 ceph-mon[28069]: pgmap v14214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26172.344839 secs 2024-04-26T19:04:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:17 smithi110 ceph-mon[28069]: pgmap v14215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T19:04:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:17 smithi110 ceph-mon[28069]: pgmap v14216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T19:04:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:17 smithi193 ceph-mon[32782]: pgmap v14214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26172.344839 secs 2024-04-26T19:04:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:17 smithi193 ceph-mon[32782]: pgmap v14215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T19:04:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:17 smithi193 ceph-mon[32782]: pgmap v14216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T19:04:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:19 smithi196 ceph-mon[32572]: pgmap v14217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T19:04:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:19 smithi110 ceph-mon[28069]: pgmap v14217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T19:04:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:19 smithi193 ceph-mon[32782]: pgmap v14217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T19:04:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:21 smithi196 ceph-mon[32572]: pgmap v14218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-26T19:04:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:21 smithi110 ceph-mon[28069]: pgmap v14218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-26T19:04:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:21 smithi193 ceph-mon[32782]: pgmap v14218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-26T19:04:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26177.344911 secs 2024-04-26T19:04:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26177.344911 secs 2024-04-26T19:04:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26177.344911 secs 2024-04-26T19:04:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:23 smithi196 ceph-mon[32572]: pgmap v14219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T19:04:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:23 smithi110 ceph-mon[28069]: pgmap v14219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T19:04:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:23 smithi193 ceph-mon[32782]: pgmap v14219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T19:04:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:25 smithi196 ceph-mon[32572]: pgmap v14220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T19:04:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:25 smithi110 ceph-mon[28069]: pgmap v14220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T19:04:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:25 smithi193 ceph-mon[32782]: pgmap v14220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T19:04:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26182.345024 secs 2024-04-26T19:04:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:27 smithi196 ceph-mon[32572]: pgmap v14221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T19:04:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26182.345024 secs 2024-04-26T19:04:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:27 smithi110 ceph-mon[28069]: pgmap v14221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T19:04:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26182.345024 secs 2024-04-26T19:04:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:27 smithi193 ceph-mon[32782]: pgmap v14221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T19:04:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:29 smithi196 ceph-mon[32572]: pgmap v14222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:04:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:29 smithi110 ceph-mon[28069]: pgmap v14222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:04:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:30 smithi193 ceph-mon[32782]: pgmap v14222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:04:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:32 smithi196 ceph-mon[32572]: pgmap v14223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:32 smithi110 ceph-mon[28069]: pgmap v14223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:32 smithi193 ceph-mon[32782]: pgmap v14223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:33 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26187.345138 secs 2024-04-26T19:04:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:33 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26187.345138 secs 2024-04-26T19:04:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:33 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26187.345138 secs 2024-04-26T19:04:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:34 smithi110 ceph-mon[28069]: pgmap v14224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:34 smithi193 ceph-mon[32782]: pgmap v14224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:34.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:34 smithi196 ceph-mon[32572]: pgmap v14224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:35 smithi110 ceph-mon[28069]: pgmap v14225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:35 smithi193 ceph-mon[32782]: pgmap v14225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:35 smithi196 ceph-mon[32572]: pgmap v14225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26192.345259 secs 2024-04-26T19:04:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:37 smithi193 ceph-mon[32782]: pgmap v14226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26192.345259 secs 2024-04-26T19:04:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:37 smithi196 ceph-mon[32572]: pgmap v14226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26192.345259 secs 2024-04-26T19:04:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:37 smithi110 ceph-mon[28069]: pgmap v14226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:39 smithi193 ceph-mon[32782]: pgmap v14227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:39 smithi196 ceph-mon[32572]: pgmap v14227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:39 smithi110 ceph-mon[28069]: pgmap v14227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:41 smithi196 ceph-mon[32572]: pgmap v14228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:41 smithi110 ceph-mon[28069]: pgmap v14228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:41 smithi193 ceph-mon[32782]: pgmap v14228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26197.345379 secs 2024-04-26T19:04:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26197.345379 secs 2024-04-26T19:04:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26197.345379 secs 2024-04-26T19:04:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:43 smithi196 ceph-mon[32572]: pgmap v14229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:43 smithi110 ceph-mon[28069]: pgmap v14229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:43 smithi193 ceph-mon[32782]: pgmap v14229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:45 smithi196 ceph-mon[32572]: pgmap v14230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:45 smithi110 ceph-mon[28069]: pgmap v14230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:45 smithi193 ceph-mon[32782]: pgmap v14230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26202.345496 secs 2024-04-26T19:04:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:47 smithi196 ceph-mon[32572]: pgmap v14231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26202.345496 secs 2024-04-26T19:04:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:47 smithi110 ceph-mon[28069]: pgmap v14231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26202.345496 secs 2024-04-26T19:04:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:47 smithi193 ceph-mon[32782]: pgmap v14231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:50.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:49 smithi193 ceph-mon[32782]: pgmap v14232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:49 smithi196 ceph-mon[32572]: pgmap v14232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:49 smithi110 ceph-mon[28069]: pgmap v14232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:51 smithi196 ceph-mon[32572]: pgmap v14233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:51 smithi110 ceph-mon[28069]: pgmap v14233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:51 smithi193 ceph-mon[32782]: pgmap v14233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26207.345646 secs 2024-04-26T19:04:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26207.345646 secs 2024-04-26T19:04:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26207.345646 secs 2024-04-26T19:04:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:53 smithi196 ceph-mon[32572]: pgmap v14234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:53 smithi110 ceph-mon[28069]: pgmap v14234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:53 smithi193 ceph-mon[32782]: pgmap v14234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:04:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:55 smithi196 ceph-mon[32572]: pgmap v14235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:55 smithi110 ceph-mon[28069]: pgmap v14235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:55 smithi193 ceph-mon[32782]: pgmap v14235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26212.345762 secs 2024-04-26T19:04:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:57 smithi196 ceph-mon[32572]: pgmap v14236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26212.345762 secs 2024-04-26T19:04:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:57 smithi110 ceph-mon[28069]: pgmap v14236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:04:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26212.345762 secs 2024-04-26T19:04:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:57 smithi193 ceph-mon[32782]: pgmap v14236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:04:59 smithi196 ceph-mon[32572]: pgmap v14237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:04:59 smithi110 ceph-mon[28069]: pgmap v14237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:04:59 smithi193 ceph-mon[32782]: pgmap v14237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:01 smithi196 ceph-mon[32572]: pgmap v14238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:01 smithi110 ceph-mon[28069]: pgmap v14238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:01 smithi193 ceph-mon[32782]: pgmap v14238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26217.345823 secs 2024-04-26T19:05:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26217.345823 secs 2024-04-26T19:05:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26217.345823 secs 2024-04-26T19:05:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:03 smithi196 ceph-mon[32572]: pgmap v14239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:05:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:03 smithi110 ceph-mon[28069]: pgmap v14239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:05:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:03 smithi193 ceph-mon[32782]: pgmap v14239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:05:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:05 smithi196 ceph-mon[32572]: pgmap v14240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:05:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:05 smithi110 ceph-mon[28069]: pgmap v14240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:05:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:05 smithi193 ceph-mon[32782]: pgmap v14240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:05:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26222.345940 secs 2024-04-26T19:05:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:07 smithi196 ceph-mon[32572]: pgmap v14241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:05:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26222.345940 secs 2024-04-26T19:05:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:07 smithi110 ceph-mon[28069]: pgmap v14241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:05:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26222.345940 secs 2024-04-26T19:05:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:07 smithi193 ceph-mon[32782]: pgmap v14241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:05:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:09 smithi196 ceph-mon[32572]: pgmap v14242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:05:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:09 smithi110 ceph-mon[28069]: pgmap v14242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:05:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:09 smithi193 ceph-mon[32782]: pgmap v14242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:05:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:11 smithi196 ceph-mon[32572]: pgmap v14243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:05:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:11 smithi110 ceph-mon[28069]: pgmap v14243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:05:12.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:11 smithi193 ceph-mon[32782]: pgmap v14243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:05:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26227.346077 secs 2024-04-26T19:05:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26227.346077 secs 2024-04-26T19:05:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26227.346077 secs 2024-04-26T19:05:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:13 smithi196 ceph-mon[32572]: pgmap v14244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:05:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:13 smithi110 ceph-mon[28069]: pgmap v14244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:05:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:13 smithi193 ceph-mon[32782]: pgmap v14244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:05:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:15 smithi196 ceph-mon[32572]: pgmap v14245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:15 smithi110 ceph-mon[28069]: pgmap v14245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:15 smithi193 ceph-mon[32782]: pgmap v14245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26232.346195 secs 2024-04-26T19:05:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:17 smithi196 ceph-mon[32572]: pgmap v14246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:05:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26232.346195 secs 2024-04-26T19:05:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:17 smithi110 ceph-mon[28069]: pgmap v14246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:05:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26232.346195 secs 2024-04-26T19:05:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:17 smithi193 ceph-mon[32782]: pgmap v14246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:05:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:05:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:05:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:05:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:05:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:05:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:05:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:05:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:05:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:05:20.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:20 smithi193 ceph-mon[32782]: pgmap v14247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:05:20.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:20 smithi193 ceph-mon[32782]: pgmap v14248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:20 smithi110 ceph-mon[28069]: pgmap v14247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:05:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:20 smithi110 ceph-mon[28069]: pgmap v14248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:20 smithi196 ceph-mon[32572]: pgmap v14247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:05:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:20 smithi196 ceph-mon[32572]: pgmap v14248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:22 smithi110 ceph-mon[28069]: pgmap v14249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:22 smithi193 ceph-mon[32782]: pgmap v14249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:22 smithi196 ceph-mon[32572]: pgmap v14249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:23 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26237.346316 secs 2024-04-26T19:05:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:23 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26237.346316 secs 2024-04-26T19:05:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:23 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26237.346316 secs 2024-04-26T19:05:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:24 smithi110 ceph-mon[28069]: pgmap v14250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:05:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:24 smithi193 ceph-mon[32782]: pgmap v14250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:05:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:24 smithi196 ceph-mon[32572]: pgmap v14250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:05:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:25 smithi110 ceph-mon[28069]: pgmap v14251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:25 smithi193 ceph-mon[32782]: pgmap v14251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:25 smithi196 ceph-mon[32572]: pgmap v14251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:27 smithi196 ceph-mon[32572]: pgmap v14252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26242.346417 secs 2024-04-26T19:05:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:27 smithi110 ceph-mon[28069]: pgmap v14252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26242.346417 secs 2024-04-26T19:05:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:27 smithi193 ceph-mon[32782]: pgmap v14252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26242.346417 secs 2024-04-26T19:05:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:29 smithi196 ceph-mon[32572]: pgmap v14253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:05:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:29 smithi110 ceph-mon[28069]: pgmap v14253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:05:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:29 smithi193 ceph-mon[32782]: pgmap v14253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:05:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:31 smithi196 ceph-mon[32572]: pgmap v14254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:31 smithi110 ceph-mon[28069]: pgmap v14254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:31 smithi193 ceph-mon[32782]: pgmap v14254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26247.346512 secs 2024-04-26T19:05:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26247.346512 secs 2024-04-26T19:05:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26247.346512 secs 2024-04-26T19:05:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:33 smithi196 ceph-mon[32572]: pgmap v14255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:33 smithi110 ceph-mon[28069]: pgmap v14255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:33 smithi193 ceph-mon[32782]: pgmap v14255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:05:35.711+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:05:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:05:35.711+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:05:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:05:35.712+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 203 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:05:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:05:35.712+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 203 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:05:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:35 smithi196 ceph-mon[32572]: pgmap v14256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:05:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:35 smithi110 ceph-mon[28069]: pgmap v14256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:05:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:35 smithi193 ceph-mon[32782]: pgmap v14256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:05:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:37 smithi196 ceph-mon[32572]: pgmap v14257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26252.346633 secs 2024-04-26T19:05:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:37 smithi110 ceph-mon[28069]: pgmap v14257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26252.346633 secs 2024-04-26T19:05:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:37 smithi193 ceph-mon[32782]: pgmap v14257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26252.346633 secs 2024-04-26T19:05:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:39 smithi196 ceph-mon[32572]: pgmap v14258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:39 smithi110 ceph-mon[28069]: pgmap v14258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:39 smithi193 ceph-mon[32782]: pgmap v14258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:41 smithi196 ceph-mon[32572]: pgmap v14259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:41 smithi110 ceph-mon[28069]: pgmap v14259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:41 smithi193 ceph-mon[32782]: pgmap v14259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26257.346697 secs 2024-04-26T19:05:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26257.346697 secs 2024-04-26T19:05:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26257.346697 secs 2024-04-26T19:05:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:43 smithi196 ceph-mon[32572]: pgmap v14260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:43 smithi110 ceph-mon[28069]: pgmap v14260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:43 smithi193 ceph-mon[32782]: pgmap v14260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:45 smithi196 ceph-mon[32572]: pgmap v14261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:45 smithi110 ceph-mon[28069]: pgmap v14261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:45 smithi193 ceph-mon[32782]: pgmap v14261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:47 smithi196 ceph-mon[32572]: pgmap v14262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26262.346820 secs 2024-04-26T19:05:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:47 smithi110 ceph-mon[28069]: pgmap v14262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26262.346820 secs 2024-04-26T19:05:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:47 smithi193 ceph-mon[32782]: pgmap v14262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26262.346820 secs 2024-04-26T19:05:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:49 smithi196 ceph-mon[32572]: pgmap v14263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:49 smithi110 ceph-mon[28069]: pgmap v14263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:49 smithi193 ceph-mon[32782]: pgmap v14263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:51 smithi196 ceph-mon[32572]: pgmap v14264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:51 smithi110 ceph-mon[28069]: pgmap v14264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:51 smithi193 ceph-mon[32782]: pgmap v14264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26267.346947 secs 2024-04-26T19:05:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26267.346947 secs 2024-04-26T19:05:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26267.346947 secs 2024-04-26T19:05:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:53 smithi196 ceph-mon[32572]: pgmap v14265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:05:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:53 smithi110 ceph-mon[28069]: pgmap v14265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:05:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:53 smithi193 ceph-mon[32782]: pgmap v14265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:05:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:55 smithi196 ceph-mon[32572]: pgmap v14266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:55 smithi110 ceph-mon[28069]: pgmap v14266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:55 smithi193 ceph-mon[32782]: pgmap v14266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:57 smithi196 ceph-mon[32572]: pgmap v14267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26272.347073 secs 2024-04-26T19:05:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:57 smithi110 ceph-mon[28069]: pgmap v14267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26272.347073 secs 2024-04-26T19:05:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:57 smithi193 ceph-mon[32782]: pgmap v14267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:05:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26272.347073 secs 2024-04-26T19:05:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:05:59 smithi196 ceph-mon[32572]: pgmap v14268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:05:59 smithi110 ceph-mon[28069]: pgmap v14268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:05:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:05:59 smithi193 ceph-mon[32782]: pgmap v14268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:01 smithi196 ceph-mon[32572]: pgmap v14269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:01 smithi110 ceph-mon[28069]: pgmap v14269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:01 smithi193 ceph-mon[32782]: pgmap v14269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26277.347155 secs 2024-04-26T19:06:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26277.347155 secs 2024-04-26T19:06:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26277.347155 secs 2024-04-26T19:06:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:03 smithi196 ceph-mon[32572]: pgmap v14270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:06:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:03 smithi110 ceph-mon[28069]: pgmap v14270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:06:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:03 smithi193 ceph-mon[32782]: pgmap v14270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:06:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:05 smithi196 ceph-mon[32572]: pgmap v14271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:05 smithi110 ceph-mon[28069]: pgmap v14271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:05 smithi193 ceph-mon[32782]: pgmap v14271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:07 smithi196 ceph-mon[32572]: pgmap v14272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26282.347282 secs 2024-04-26T19:06:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:07 smithi110 ceph-mon[28069]: pgmap v14272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26282.347282 secs 2024-04-26T19:06:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:07 smithi193 ceph-mon[32782]: pgmap v14272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26282.347282 secs 2024-04-26T19:06:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:09 smithi196 ceph-mon[32572]: pgmap v14273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:09 smithi110 ceph-mon[28069]: pgmap v14273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:09 smithi193 ceph-mon[32782]: pgmap v14273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:11 smithi196 ceph-mon[32572]: pgmap v14274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:11 smithi110 ceph-mon[28069]: pgmap v14274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:11 smithi193 ceph-mon[32782]: pgmap v14274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:12 smithi196 ceph-mon[32572]: 21 slow requests, 1 included below; oldest blocked for > 26287.347400 secs 2024-04-26T19:06:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:12 smithi196 ceph-mon[32572]: slow request 11524.139885 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:06:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:12 smithi110 ceph-mon[28069]: 21 slow requests, 1 included below; oldest blocked for > 26287.347400 secs 2024-04-26T19:06:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:12 smithi110 ceph-mon[28069]: slow request 11524.139885 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:06:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:12 smithi193 ceph-mon[32782]: 21 slow requests, 1 included below; oldest blocked for > 26287.347400 secs 2024-04-26T19:06:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:12 smithi193 ceph-mon[32782]: slow request 11524.139885 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:06:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:13 smithi196 ceph-mon[32572]: pgmap v14275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:06:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:13 smithi110 ceph-mon[28069]: pgmap v14275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:06:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:13 smithi193 ceph-mon[32782]: pgmap v14275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:06:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:15 smithi196 ceph-mon[32572]: pgmap v14276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:06:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:15 smithi110 ceph-mon[28069]: pgmap v14276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:06:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:15 smithi193 ceph-mon[32782]: pgmap v14276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:06:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:17 smithi196 ceph-mon[32572]: pgmap v14277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:06:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26292.347473 secs 2024-04-26T19:06:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:17 smithi110 ceph-mon[28069]: pgmap v14277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:06:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26292.347473 secs 2024-04-26T19:06:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:17 smithi193 ceph-mon[32782]: pgmap v14277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:06:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26292.347473 secs 2024-04-26T19:06:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:06:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:06:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:06:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:19 smithi110 ceph-mon[28069]: pgmap v14278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:06:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:06:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:19 smithi193 ceph-mon[32782]: pgmap v14278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:06:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:06:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:19 smithi196 ceph-mon[32572]: pgmap v14278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:06:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:06:20.718 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:06:20.717+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:06:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:06:20.717+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:06:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:06:20.718+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 204 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:06:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:06:20.718+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 204 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:06:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:21 smithi110 ceph-mon[28069]: pgmap v14279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:06:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:06:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:06:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:21 smithi110 ceph-mon[28069]: pgmap v14280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:06:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:21 smithi110 ceph-mon[28069]: pgmap v14281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:06:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:06:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:21 smithi193 ceph-mon[32782]: pgmap v14279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:06:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:06:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:06:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:21 smithi193 ceph-mon[32782]: pgmap v14280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:06:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:21 smithi193 ceph-mon[32782]: pgmap v14281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:06:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:06:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:21 smithi196 ceph-mon[32572]: pgmap v14279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:06:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:06:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:06:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:21 smithi196 ceph-mon[32572]: pgmap v14280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:06:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:21 smithi196 ceph-mon[32572]: pgmap v14281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:06:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:06:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26297.347545 secs 2024-04-26T19:06:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26297.347545 secs 2024-04-26T19:06:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26297.347545 secs 2024-04-26T19:06:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:23 smithi110 ceph-mon[28069]: pgmap v14282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:23 smithi193 ceph-mon[32782]: pgmap v14282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:23 smithi196 ceph-mon[32572]: pgmap v14282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:25 smithi110 ceph-mon[28069]: pgmap v14283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:25 smithi193 ceph-mon[32782]: pgmap v14283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:25 smithi196 ceph-mon[32572]: pgmap v14283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26302.347665 secs 2024-04-26T19:06:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:27 smithi110 ceph-mon[28069]: pgmap v14284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T19:06:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26302.347665 secs 2024-04-26T19:06:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:27 smithi193 ceph-mon[32782]: pgmap v14284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T19:06:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26302.347665 secs 2024-04-26T19:06:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:27 smithi196 ceph-mon[32572]: pgmap v14284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T19:06:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:29 smithi193 ceph-mon[32782]: pgmap v14285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:29 smithi196 ceph-mon[32572]: pgmap v14285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:29 smithi110 ceph-mon[28069]: pgmap v14285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:31 smithi193 ceph-mon[32782]: pgmap v14286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:06:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:31 smithi196 ceph-mon[32572]: pgmap v14286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:06:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:31 smithi110 ceph-mon[28069]: pgmap v14286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:06:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:32 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26307.347785 secs 2024-04-26T19:06:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:32 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26307.347785 secs 2024-04-26T19:06:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:32 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26307.347785 secs 2024-04-26T19:06:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:33 smithi193 ceph-mon[32782]: pgmap v14287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:33 smithi196 ceph-mon[32572]: pgmap v14287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:33 smithi110 ceph-mon[28069]: pgmap v14287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:35 smithi193 ceph-mon[32782]: pgmap v14288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:35 smithi196 ceph-mon[32572]: pgmap v14288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:35 smithi110 ceph-mon[28069]: pgmap v14288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26312.347906 secs 2024-04-26T19:06:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:37 smithi193 ceph-mon[32782]: pgmap v14289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26312.347906 secs 2024-04-26T19:06:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:37 smithi196 ceph-mon[32572]: pgmap v14289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26312.347906 secs 2024-04-26T19:06:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:37 smithi110 ceph-mon[28069]: pgmap v14289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:39 smithi193 ceph-mon[32782]: pgmap v14290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:39 smithi196 ceph-mon[32572]: pgmap v14290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:39 smithi110 ceph-mon[28069]: pgmap v14290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:41 smithi193 ceph-mon[32782]: pgmap v14291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:41 smithi196 ceph-mon[32572]: pgmap v14291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:41 smithi110 ceph-mon[28069]: pgmap v14291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:42 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26317.348002 secs 2024-04-26T19:06:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:42 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26317.348002 secs 2024-04-26T19:06:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:42 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26317.348002 secs 2024-04-26T19:06:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:43 smithi193 ceph-mon[32782]: pgmap v14292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:43 smithi196 ceph-mon[32572]: pgmap v14292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:43 smithi110 ceph-mon[28069]: pgmap v14292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:45 smithi193 ceph-mon[32782]: pgmap v14293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:45 smithi196 ceph-mon[32572]: pgmap v14293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:45 smithi110 ceph-mon[28069]: pgmap v14293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26322.348118 secs 2024-04-26T19:06:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:47 smithi193 ceph-mon[32782]: pgmap v14294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26322.348118 secs 2024-04-26T19:06:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:47 smithi196 ceph-mon[32572]: pgmap v14294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26322.348118 secs 2024-04-26T19:06:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:47 smithi110 ceph-mon[28069]: pgmap v14294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:49 smithi196 ceph-mon[32572]: pgmap v14295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:49 smithi110 ceph-mon[28069]: pgmap v14295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:49 smithi193 ceph-mon[32782]: pgmap v14295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:52.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:51 smithi193 ceph-mon[32782]: pgmap v14296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:51 smithi196 ceph-mon[32572]: pgmap v14296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:51 smithi110 ceph-mon[28069]: pgmap v14296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26327.348235 secs 2024-04-26T19:06:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26327.348235 secs 2024-04-26T19:06:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26327.348235 secs 2024-04-26T19:06:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:53 smithi196 ceph-mon[32572]: pgmap v14297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:53 smithi110 ceph-mon[28069]: pgmap v14297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:53 smithi193 ceph-mon[32782]: pgmap v14297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:06:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:55 smithi196 ceph-mon[32572]: pgmap v14298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:55 smithi110 ceph-mon[28069]: pgmap v14298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:55 smithi193 ceph-mon[32782]: pgmap v14298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26332.348375 secs 2024-04-26T19:06:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:57 smithi196 ceph-mon[32572]: pgmap v14299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26332.348375 secs 2024-04-26T19:06:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:57 smithi110 ceph-mon[28069]: pgmap v14299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:06:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26332.348375 secs 2024-04-26T19:06:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:57 smithi193 ceph-mon[32782]: pgmap v14299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:06:59 smithi196 ceph-mon[32572]: pgmap v14300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:06:59 smithi110 ceph-mon[28069]: pgmap v14300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:06:59 smithi193 ceph-mon[32782]: pgmap v14300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:01 smithi196 ceph-mon[32572]: pgmap v14301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:01 smithi110 ceph-mon[28069]: pgmap v14301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:01 smithi193 ceph-mon[32782]: pgmap v14301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26337.348440 secs 2024-04-26T19:07:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26337.348440 secs 2024-04-26T19:07:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26337.348440 secs 2024-04-26T19:07:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:03 smithi196 ceph-mon[32572]: pgmap v14302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:03 smithi110 ceph-mon[28069]: pgmap v14302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:03 smithi193 ceph-mon[32782]: pgmap v14302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:05 smithi196 ceph-mon[32572]: pgmap v14303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:05 smithi110 ceph-mon[28069]: pgmap v14303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:05 smithi193 ceph-mon[32782]: pgmap v14303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26342.348587 secs 2024-04-26T19:07:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:07 smithi196 ceph-mon[32572]: pgmap v14304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26342.348587 secs 2024-04-26T19:07:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:07 smithi110 ceph-mon[28069]: pgmap v14304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26342.348587 secs 2024-04-26T19:07:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:07 smithi193 ceph-mon[32782]: pgmap v14304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:09 smithi196 ceph-mon[32572]: pgmap v14305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:09 smithi110 ceph-mon[28069]: pgmap v14305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:09 smithi193 ceph-mon[32782]: pgmap v14305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:11 smithi196 ceph-mon[32572]: pgmap v14306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:11 smithi110 ceph-mon[28069]: pgmap v14306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:11 smithi193 ceph-mon[32782]: pgmap v14306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26347.348706 secs 2024-04-26T19:07:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26347.348706 secs 2024-04-26T19:07:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26347.348706 secs 2024-04-26T19:07:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:13 smithi196 ceph-mon[32572]: pgmap v14307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:13 smithi110 ceph-mon[28069]: pgmap v14307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:13 smithi193 ceph-mon[32782]: pgmap v14307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:15 smithi196 ceph-mon[32572]: pgmap v14308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:15 smithi110 ceph-mon[28069]: pgmap v14308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:15 smithi193 ceph-mon[32782]: pgmap v14308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26352.348819 secs 2024-04-26T19:07:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:17 smithi196 ceph-mon[32572]: pgmap v14309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26352.348819 secs 2024-04-26T19:07:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:17 smithi110 ceph-mon[28069]: pgmap v14309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26352.348819 secs 2024-04-26T19:07:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:17 smithi193 ceph-mon[32782]: pgmap v14309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:19 smithi196 ceph-mon[32572]: pgmap v14310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:19 smithi110 ceph-mon[28069]: pgmap v14310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:19 smithi193 ceph-mon[32782]: pgmap v14310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:21 smithi196 ceph-mon[32572]: pgmap v14311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:07:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:21 smithi110 ceph-mon[28069]: pgmap v14311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:07:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:21 smithi193 ceph-mon[32782]: pgmap v14311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:07:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26357.348893 secs 2024-04-26T19:07:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:07:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:07:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26357.348893 secs 2024-04-26T19:07:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:07:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:07:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26357.348893 secs 2024-04-26T19:07:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:07:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:07:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:07:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:23 smithi196 ceph-mon[32572]: pgmap v14312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:07:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:23 smithi196 ceph-mon[32572]: pgmap v14313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:23 smithi110 ceph-mon[28069]: pgmap v14312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:07:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:23 smithi110 ceph-mon[28069]: pgmap v14313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:23 smithi193 ceph-mon[32782]: pgmap v14312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:07:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:23 smithi193 ceph-mon[32782]: pgmap v14313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:25 smithi196 ceph-mon[32572]: pgmap v14314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:25 smithi110 ceph-mon[28069]: pgmap v14314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:25 smithi193 ceph-mon[32782]: pgmap v14314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:27 smithi196 ceph-mon[32572]: pgmap v14315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26362.349032 secs 2024-04-26T19:07:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:27 smithi110 ceph-mon[28069]: pgmap v14315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26362.349032 secs 2024-04-26T19:07:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:27 smithi193 ceph-mon[32782]: pgmap v14315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26362.349032 secs 2024-04-26T19:07:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:30 smithi196 ceph-mon[32572]: pgmap v14316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:30 smithi110 ceph-mon[28069]: pgmap v14316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:30 smithi193 ceph-mon[32782]: pgmap v14316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:32 smithi110 ceph-mon[28069]: pgmap v14317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:32 smithi193 ceph-mon[32782]: pgmap v14317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:32 smithi196 ceph-mon[32572]: pgmap v14317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:07:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:33 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26367.349104 secs 2024-04-26T19:07:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:33 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26367.349104 secs 2024-04-26T19:07:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:33 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26367.349104 secs 2024-04-26T19:07:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:34 smithi110 ceph-mon[28069]: pgmap v14318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:07:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:34 smithi193 ceph-mon[32782]: pgmap v14318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:07:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:34 smithi196 ceph-mon[32572]: pgmap v14318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:07:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:36 smithi110 ceph-mon[28069]: pgmap v14319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:36 smithi193 ceph-mon[32782]: pgmap v14319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:36 smithi196 ceph-mon[32572]: pgmap v14319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:38 smithi110 ceph-mon[28069]: pgmap v14320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:38 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26372.349232 secs 2024-04-26T19:07:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:38 smithi193 ceph-mon[32782]: pgmap v14320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:38 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26372.349232 secs 2024-04-26T19:07:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:38 smithi196 ceph-mon[32572]: pgmap v14320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:38 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26372.349232 secs 2024-04-26T19:07:40.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:40 smithi110 ceph-mon[28069]: pgmap v14321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:40 smithi193 ceph-mon[32782]: pgmap v14321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:40 smithi196 ceph-mon[32572]: pgmap v14321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:42 smithi110 ceph-mon[28069]: pgmap v14322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:42 smithi193 ceph-mon[32782]: pgmap v14322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:42 smithi196 ceph-mon[32572]: pgmap v14322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:43 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26377.349349 secs 2024-04-26T19:07:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:43 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26377.349349 secs 2024-04-26T19:07:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:43 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26377.349349 secs 2024-04-26T19:07:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:44 smithi193 ceph-mon[32782]: pgmap v14323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:44 smithi196 ceph-mon[32572]: pgmap v14323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:44 smithi110 ceph-mon[28069]: pgmap v14323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:45 smithi193 ceph-mon[32782]: pgmap v14324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:45 smithi196 ceph-mon[32572]: pgmap v14324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:45 smithi110 ceph-mon[28069]: pgmap v14324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:47 smithi196 ceph-mon[32572]: pgmap v14325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26382.349426 secs 2024-04-26T19:07:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:47 smithi110 ceph-mon[28069]: pgmap v14325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26382.349426 secs 2024-04-26T19:07:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:47 smithi193 ceph-mon[32782]: pgmap v14325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26382.349426 secs 2024-04-26T19:07:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:49 smithi196 ceph-mon[32572]: pgmap v14326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:49 smithi110 ceph-mon[28069]: pgmap v14326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:49 smithi193 ceph-mon[32782]: pgmap v14326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:51 smithi196 ceph-mon[32572]: pgmap v14327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:51 smithi110 ceph-mon[28069]: pgmap v14327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:51 smithi193 ceph-mon[32782]: pgmap v14327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:52 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26387.349547 secs 2024-04-26T19:07:52.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:52 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26387.349547 secs 2024-04-26T19:07:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:52 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26387.349547 secs 2024-04-26T19:07:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:53 smithi196 ceph-mon[32572]: pgmap v14328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:53 smithi110 ceph-mon[28069]: pgmap v14328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:53 smithi193 ceph-mon[32782]: pgmap v14328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:55 smithi196 ceph-mon[32572]: pgmap v14329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:55 smithi110 ceph-mon[28069]: pgmap v14329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:55 smithi193 ceph-mon[32782]: pgmap v14329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:57 smithi196 ceph-mon[32572]: pgmap v14330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26392.349675 secs 2024-04-26T19:07:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:57 smithi110 ceph-mon[28069]: pgmap v14330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26392.349675 secs 2024-04-26T19:07:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:57 smithi193 ceph-mon[32782]: pgmap v14330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:07:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26392.349675 secs 2024-04-26T19:07:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:07:59 smithi196 ceph-mon[32572]: pgmap v14331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:07:59 smithi110 ceph-mon[28069]: pgmap v14331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:07:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:07:59 smithi193 ceph-mon[32782]: pgmap v14331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:01 smithi110 ceph-mon[28069]: pgmap v14332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:01 smithi193 ceph-mon[32782]: pgmap v14332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:01 smithi196 ceph-mon[32572]: pgmap v14332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:02 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26397.349797 secs 2024-04-26T19:08:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:02 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26397.349797 secs 2024-04-26T19:08:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:02 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26397.349797 secs 2024-04-26T19:08:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:03 smithi110 ceph-mon[28069]: pgmap v14333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:03 smithi193 ceph-mon[32782]: pgmap v14333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:03 smithi196 ceph-mon[32572]: pgmap v14333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:05 smithi110 ceph-mon[28069]: pgmap v14334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:05 smithi193 ceph-mon[32782]: pgmap v14334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:05 smithi196 ceph-mon[32572]: pgmap v14334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:07 smithi110 ceph-mon[28069]: pgmap v14335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26402.349880 secs 2024-04-26T19:08:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:07 smithi193 ceph-mon[32782]: pgmap v14335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26402.349880 secs 2024-04-26T19:08:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:07 smithi196 ceph-mon[32572]: pgmap v14335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26402.349880 secs 2024-04-26T19:08:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:09 smithi110 ceph-mon[28069]: pgmap v14336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:09 smithi193 ceph-mon[32782]: pgmap v14336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:09 smithi196 ceph-mon[32572]: pgmap v14336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:11 smithi110 ceph-mon[28069]: pgmap v14337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:11 smithi193 ceph-mon[32782]: pgmap v14337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:11 smithi196 ceph-mon[32572]: pgmap v14337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:12 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26407.349999 secs 2024-04-26T19:08:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:12 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26407.349999 secs 2024-04-26T19:08:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:12 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26407.349999 secs 2024-04-26T19:08:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:13 smithi193 ceph-mon[32782]: pgmap v14338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:13 smithi196 ceph-mon[32572]: pgmap v14338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:13 smithi110 ceph-mon[28069]: pgmap v14338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:15 smithi193 ceph-mon[32782]: pgmap v14339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:15 smithi196 ceph-mon[32572]: pgmap v14339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:15 smithi110 ceph-mon[28069]: pgmap v14339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:17 smithi193 ceph-mon[32782]: pgmap v14340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:17 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26412.350119 secs 2024-04-26T19:08:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:17 smithi196 ceph-mon[32572]: pgmap v14340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:17 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26412.350119 secs 2024-04-26T19:08:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:17 smithi110 ceph-mon[28069]: pgmap v14340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:17 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26412.350119 secs 2024-04-26T19:08:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:19 smithi193 ceph-mon[32782]: pgmap v14341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:19 smithi196 ceph-mon[32572]: pgmap v14341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:19 smithi110 ceph-mon[28069]: pgmap v14341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:21.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:21 smithi110 ceph-mon[28069]: pgmap v14342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:21 smithi193 ceph-mon[32782]: pgmap v14342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:21 smithi196 ceph-mon[32572]: pgmap v14342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:22 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26417.350241 secs 2024-04-26T19:08:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:22 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26417.350241 secs 2024-04-26T19:08:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:22 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26417.350241 secs 2024-04-26T19:08:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:23 smithi193 ceph-mon[32782]: pgmap v14343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:08:23.951 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:23 smithi110 ceph-mon[28069]: pgmap v14343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:23.951 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:08:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:23 smithi196 ceph-mon[32572]: pgmap v14343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:08:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: pgmap v14344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: pgmap v14344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: pgmap v14344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:08:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:08:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:08:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:08:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:27.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:08:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:08:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:08:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:08:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:08:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:27 smithi110 ceph-mon[28069]: pgmap v14345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:27 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26422.350392 secs 2024-04-26T19:08:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:27 smithi193 ceph-mon[32782]: pgmap v14345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:27 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26422.350392 secs 2024-04-26T19:08:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:27 smithi196 ceph-mon[32572]: pgmap v14345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:27 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26422.350392 secs 2024-04-26T19:08:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: pgmap v14346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: pgmap v14347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: pgmap v14346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: pgmap v14347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: pgmap v14346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:08:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: pgmap v14347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:29.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:08:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:30 smithi193 ceph-mon[32782]: pgmap v14348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:30 smithi196 ceph-mon[32572]: pgmap v14348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:30 smithi110 ceph-mon[28069]: pgmap v14348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:32 smithi193 ceph-mon[32782]: pgmap v14349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T19:08:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:32 smithi196 ceph-mon[32572]: pgmap v14349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T19:08:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:32 smithi110 ceph-mon[28069]: pgmap v14349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T19:08:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:33 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26427.350508 secs 2024-04-26T19:08:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:33 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26427.350508 secs 2024-04-26T19:08:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:33 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26427.350508 secs 2024-04-26T19:08:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:34 smithi196 ceph-mon[32572]: pgmap v14350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:34 smithi110 ceph-mon[28069]: pgmap v14350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:34 smithi193 ceph-mon[32782]: pgmap v14350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:36 smithi193 ceph-mon[32782]: pgmap v14351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:36 smithi196 ceph-mon[32572]: pgmap v14351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:36 smithi110 ceph-mon[28069]: pgmap v14351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:08:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:37 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26432.350647 secs 2024-04-26T19:08:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:37 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26432.350647 secs 2024-04-26T19:08:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:37 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26432.350647 secs 2024-04-26T19:08:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:38 smithi196 ceph-mon[32572]: pgmap v14352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:08:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:38 smithi110 ceph-mon[28069]: pgmap v14352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:08:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:38 smithi193 ceph-mon[32782]: pgmap v14352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:08:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:40 smithi193 ceph-mon[32782]: pgmap v14353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:40 smithi196 ceph-mon[32572]: pgmap v14353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:40 smithi110 ceph-mon[28069]: pgmap v14353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:42 smithi193 ceph-mon[32782]: pgmap v14354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:42 smithi196 ceph-mon[32572]: pgmap v14354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:42 smithi110 ceph-mon[28069]: pgmap v14354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:43 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26437.350743 secs 2024-04-26T19:08:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:43 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26437.350743 secs 2024-04-26T19:08:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:43 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26437.350743 secs 2024-04-26T19:08:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:44 smithi196 ceph-mon[32572]: pgmap v14355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:44 smithi110 ceph-mon[28069]: pgmap v14355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:44 smithi193 ceph-mon[32782]: pgmap v14355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:46 smithi193 ceph-mon[32782]: pgmap v14356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:46 smithi196 ceph-mon[32572]: pgmap v14356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:46 smithi110 ceph-mon[28069]: pgmap v14356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:47 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26442.350863 secs 2024-04-26T19:08:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:47 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26442.350863 secs 2024-04-26T19:08:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:47 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26442.350863 secs 2024-04-26T19:08:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:48 smithi196 ceph-mon[32572]: pgmap v14357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:48 smithi110 ceph-mon[28069]: pgmap v14357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:48 smithi193 ceph-mon[32782]: pgmap v14357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:50 smithi193 ceph-mon[32782]: pgmap v14358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:50 smithi196 ceph-mon[32572]: pgmap v14358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:50 smithi110 ceph-mon[28069]: pgmap v14358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:52 smithi193 ceph-mon[32782]: pgmap v14359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:52.377 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:52 smithi110 ceph-mon[28069]: pgmap v14359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:52 smithi196 ceph-mon[32572]: pgmap v14359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:53 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26447.350987 secs 2024-04-26T19:08:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:53 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26447.350987 secs 2024-04-26T19:08:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:53 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26447.350987 secs 2024-04-26T19:08:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:54 smithi110 ceph-mon[28069]: pgmap v14360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:54 smithi196 ceph-mon[32572]: pgmap v14360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:54 smithi193 ceph-mon[32782]: pgmap v14360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:56 smithi193 ceph-mon[32782]: pgmap v14361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:56 smithi196 ceph-mon[32572]: pgmap v14361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:56 smithi110 ceph-mon[28069]: pgmap v14361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:08:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:57 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26452.351052 secs 2024-04-26T19:08:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:57 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26452.351052 secs 2024-04-26T19:08:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:57 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26452.351052 secs 2024-04-26T19:08:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:08:58 smithi196 ceph-mon[32572]: pgmap v14362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:08:58 smithi110 ceph-mon[28069]: pgmap v14362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:08:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:08:58 smithi193 ceph-mon[32782]: pgmap v14362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:00 smithi193 ceph-mon[32782]: pgmap v14363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:00 smithi196 ceph-mon[32572]: pgmap v14363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:00 smithi110 ceph-mon[28069]: pgmap v14363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:02 smithi193 ceph-mon[32782]: pgmap v14364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:02 smithi196 ceph-mon[32572]: pgmap v14364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:02 smithi110 ceph-mon[28069]: pgmap v14364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:03 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26457.351153 secs 2024-04-26T19:09:03.435 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:03 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26457.351153 secs 2024-04-26T19:09:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:03 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26457.351153 secs 2024-04-26T19:09:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:04 smithi196 ceph-mon[32572]: pgmap v14365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:04 smithi110 ceph-mon[28069]: pgmap v14365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:04 smithi193 ceph-mon[32782]: pgmap v14365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:06 smithi196 ceph-mon[32572]: pgmap v14366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:06 smithi110 ceph-mon[28069]: pgmap v14366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:06 smithi193 ceph-mon[32782]: pgmap v14366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:07 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26462.351271 secs 2024-04-26T19:09:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:07 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26462.351271 secs 2024-04-26T19:09:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:07 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26462.351271 secs 2024-04-26T19:09:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:08 smithi196 ceph-mon[32572]: pgmap v14367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:08 smithi110 ceph-mon[28069]: pgmap v14367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:08 smithi193 ceph-mon[32782]: pgmap v14367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:10 smithi196 ceph-mon[32572]: pgmap v14368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:10 smithi110 ceph-mon[28069]: pgmap v14368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:10 smithi193 ceph-mon[32782]: pgmap v14368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:12 smithi196 ceph-mon[32572]: pgmap v14369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:12 smithi110 ceph-mon[28069]: pgmap v14369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:12 smithi193 ceph-mon[32782]: pgmap v14369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:13 smithi110 ceph-mon[28069]: 21 slow requests, 0 included below; oldest blocked for > 26467.351398 secs 2024-04-26T19:09:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:09:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:09:13.029+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:09:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:09:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:09:13.029+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:09:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:09:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:09:13.029+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:09:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:09:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:09:13.029+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:09:13.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:09:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:09:13.029+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:09:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:13 smithi196 ceph-mon[32572]: 21 slow requests, 0 included below; oldest blocked for > 26467.351398 secs 2024-04-26T19:09:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:13 smithi193 ceph-mon[32782]: 21 slow requests, 0 included below; oldest blocked for > 26467.351398 secs 2024-04-26T19:09:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:14 smithi196 ceph-mon[32572]: pgmap v14370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:14 smithi110 ceph-mon[28069]: pgmap v14370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:14 smithi193 ceph-mon[32782]: pgmap v14370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:16 smithi196 ceph-mon[32572]: pgmap v14371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:16 smithi110 ceph-mon[28069]: pgmap v14371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:16 smithi193 ceph-mon[32782]: pgmap v14371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:17 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26472.351517 secs 2024-04-26T19:09:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:17 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26472.351517 secs 2024-04-26T19:09:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:17 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26472.351517 secs 2024-04-26T19:09:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:18 smithi196 ceph-mon[32572]: pgmap v14372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:09:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:18 smithi110 ceph-mon[28069]: pgmap v14372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:09:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:18 smithi193 ceph-mon[32782]: pgmap v14372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:09:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:09:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:09:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:09:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:09:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:09:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:09:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:20 smithi110 ceph-mon[28069]: pgmap v14373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:09:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:20 smithi193 ceph-mon[32782]: pgmap v14373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:09:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:09:20.748+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:09:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:09:20.748+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:09:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:09:20.749+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 205 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:09:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:09:20.749+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 205 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:09:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:20 smithi196 ceph-mon[32572]: pgmap v14373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:09:22.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:22 smithi193 ceph-mon[32782]: pgmap v14374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:09:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:22 smithi196 ceph-mon[32572]: pgmap v14374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:09:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:22 smithi110 ceph-mon[28069]: pgmap v14374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:09:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:23 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26477.351632 secs 2024-04-26T19:09:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:23 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26477.351632 secs 2024-04-26T19:09:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:23 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26477.351632 secs 2024-04-26T19:09:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:25 smithi196 ceph-mon[32572]: pgmap v14375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:09:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:25 smithi110 ceph-mon[28069]: pgmap v14375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:09:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:25 smithi193 ceph-mon[32782]: pgmap v14375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:09:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:27 smithi196 ceph-mon[32572]: pgmap v14376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:09:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:27 smithi110 ceph-mon[28069]: pgmap v14376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:09:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:27 smithi193 ceph-mon[32782]: pgmap v14376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:09:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:28 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26482.351755 secs 2024-04-26T19:09:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:28 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26482.351755 secs 2024-04-26T19:09:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:28 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26482.351755 secs 2024-04-26T19:09:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:29 smithi196 ceph-mon[32572]: pgmap v14377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:09:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:09:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:29 smithi110 ceph-mon[28069]: pgmap v14377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:09:29.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:09:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:29 smithi193 ceph-mon[32782]: pgmap v14377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:09:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:09:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:09:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:09:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:30 smithi196 ceph-mon[32572]: pgmap v14378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T19:09:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:30 smithi196 ceph-mon[32572]: pgmap v14379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:09:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:09:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:09:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:30 smithi110 ceph-mon[28069]: pgmap v14378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T19:09:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:30 smithi110 ceph-mon[28069]: pgmap v14379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:09:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:09:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:09:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:30 smithi193 ceph-mon[32782]: pgmap v14378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T19:09:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:30 smithi193 ceph-mon[32782]: pgmap v14379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:09:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:32 smithi196 ceph-mon[32572]: pgmap v14380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:32 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26487.351863 secs 2024-04-26T19:09:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:32 smithi110 ceph-mon[28069]: pgmap v14380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:32 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26487.351863 secs 2024-04-26T19:09:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:32 smithi193 ceph-mon[32782]: pgmap v14380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:32 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26487.351863 secs 2024-04-26T19:09:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:34 smithi196 ceph-mon[32572]: pgmap v14381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:34 smithi110 ceph-mon[28069]: pgmap v14381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:34 smithi193 ceph-mon[32782]: pgmap v14381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:36 smithi196 ceph-mon[32572]: pgmap v14382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:36 smithi110 ceph-mon[28069]: pgmap v14382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:36 smithi193 ceph-mon[32782]: pgmap v14382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:37 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26492.351955 secs 2024-04-26T19:09:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:37 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26492.351955 secs 2024-04-26T19:09:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:37 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26492.351955 secs 2024-04-26T19:09:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:38 smithi196 ceph-mon[32572]: pgmap v14383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:38 smithi110 ceph-mon[28069]: pgmap v14383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:39.120 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:38 smithi193 ceph-mon[32782]: pgmap v14383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:40 smithi196 ceph-mon[32572]: pgmap v14384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:09:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:40 smithi110 ceph-mon[28069]: pgmap v14384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:09:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:40 smithi193 ceph-mon[32782]: pgmap v14384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:09:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:42 smithi196 ceph-mon[32572]: pgmap v14385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:42 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26497.352023 secs 2024-04-26T19:09:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:42 smithi110 ceph-mon[28069]: pgmap v14385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:42 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26497.352023 secs 2024-04-26T19:09:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:42 smithi193 ceph-mon[32782]: pgmap v14385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:42 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26497.352023 secs 2024-04-26T19:09:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:44 smithi196 ceph-mon[32572]: pgmap v14386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:44 smithi110 ceph-mon[28069]: pgmap v14386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:44 smithi193 ceph-mon[32782]: pgmap v14386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:46 smithi196 ceph-mon[32572]: pgmap v14387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:46 smithi110 ceph-mon[28069]: pgmap v14387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:46 smithi193 ceph-mon[32782]: pgmap v14387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:47 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26502.352144 secs 2024-04-26T19:09:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:47 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26502.352144 secs 2024-04-26T19:09:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:47 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26502.352144 secs 2024-04-26T19:09:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:48 smithi196 ceph-mon[32572]: pgmap v14388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:48 smithi110 ceph-mon[28069]: pgmap v14388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:48 smithi193 ceph-mon[32782]: pgmap v14388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:50 smithi196 ceph-mon[32572]: pgmap v14389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:50 smithi110 ceph-mon[28069]: pgmap v14389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:50 smithi193 ceph-mon[32782]: pgmap v14389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:52 smithi196 ceph-mon[32572]: pgmap v14390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:52 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26507.352260 secs 2024-04-26T19:09:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:52 smithi110 ceph-mon[28069]: pgmap v14390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:52 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26507.352260 secs 2024-04-26T19:09:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:52 smithi193 ceph-mon[32782]: pgmap v14390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:52 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26507.352260 secs 2024-04-26T19:09:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:54 smithi196 ceph-mon[32572]: pgmap v14391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:54 smithi110 ceph-mon[28069]: pgmap v14391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:54 smithi193 ceph-mon[32782]: pgmap v14391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:56 smithi196 ceph-mon[32572]: pgmap v14392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:56 smithi110 ceph-mon[28069]: pgmap v14392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:56 smithi193 ceph-mon[32782]: pgmap v14392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:09:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:57 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26512.352378 secs 2024-04-26T19:09:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:57 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26512.352378 secs 2024-04-26T19:09:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:57 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26512.352378 secs 2024-04-26T19:09:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:09:58 smithi196 ceph-mon[32572]: pgmap v14393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:09:58 smithi110 ceph-mon[28069]: pgmap v14393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:09:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:09:58 smithi193 ceph-mon[32782]: pgmap v14393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:00 smithi196 ceph-mon[32572]: pgmap v14394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:10:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:00 smithi110 ceph-mon[28069]: pgmap v14394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:10:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:00 smithi193 ceph-mon[32782]: pgmap v14394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:10:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:02 smithi196 ceph-mon[32572]: pgmap v14395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:02 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26517.352495 secs 2024-04-26T19:10:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:02 smithi110 ceph-mon[28069]: pgmap v14395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:02 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26517.352495 secs 2024-04-26T19:10:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:02 smithi193 ceph-mon[32782]: pgmap v14395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:02 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26517.352495 secs 2024-04-26T19:10:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:04 smithi196 ceph-mon[32572]: pgmap v14396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:04 smithi110 ceph-mon[28069]: pgmap v14396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:04 smithi193 ceph-mon[32782]: pgmap v14396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:06 smithi196 ceph-mon[32572]: pgmap v14397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:06 smithi110 ceph-mon[28069]: pgmap v14397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:06 smithi193 ceph-mon[32782]: pgmap v14397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:07 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26522.352624 secs 2024-04-26T19:10:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:07 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26522.352624 secs 2024-04-26T19:10:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:07 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26522.352624 secs 2024-04-26T19:10:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:08 smithi196 ceph-mon[32572]: pgmap v14398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:08 smithi110 ceph-mon[28069]: pgmap v14398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:08 smithi193 ceph-mon[32782]: pgmap v14398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:10 smithi193 ceph-mon[32782]: pgmap v14399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:10 smithi196 ceph-mon[32572]: pgmap v14399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:10 smithi110 ceph-mon[28069]: pgmap v14399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:12 smithi193 ceph-mon[32782]: pgmap v14400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:12 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26527.352720 secs 2024-04-26T19:10:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:12 smithi196 ceph-mon[32572]: pgmap v14400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:12 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26527.352720 secs 2024-04-26T19:10:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:12 smithi110 ceph-mon[28069]: pgmap v14400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:12 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26527.352720 secs 2024-04-26T19:10:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:14 smithi193 ceph-mon[32782]: pgmap v14401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:14 smithi196 ceph-mon[32572]: pgmap v14401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:14 smithi110 ceph-mon[28069]: pgmap v14401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:16 smithi193 ceph-mon[32782]: pgmap v14402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:16 smithi196 ceph-mon[32572]: pgmap v14402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:16 smithi110 ceph-mon[28069]: pgmap v14402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:17 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26532.352845 secs 2024-04-26T19:10:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:17 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26532.352845 secs 2024-04-26T19:10:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:17 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26532.352845 secs 2024-04-26T19:10:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:18 smithi193 ceph-mon[32782]: pgmap v14403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:18 smithi196 ceph-mon[32572]: pgmap v14403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:18 smithi110 ceph-mon[28069]: pgmap v14403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:20 smithi193 ceph-mon[32782]: pgmap v14404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:20 smithi196 ceph-mon[32572]: pgmap v14404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:20 smithi110 ceph-mon[28069]: pgmap v14404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:22 smithi193 ceph-mon[32782]: pgmap v14405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:22 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26537.352963 secs 2024-04-26T19:10:23.131 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:22 smithi196 ceph-mon[32572]: pgmap v14405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:23.131 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:22 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26537.352963 secs 2024-04-26T19:10:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:22 smithi110 ceph-mon[28069]: pgmap v14405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:22 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26537.352963 secs 2024-04-26T19:10:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:24 smithi193 ceph-mon[32782]: pgmap v14406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:24 smithi196 ceph-mon[32572]: pgmap v14406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:24 smithi110 ceph-mon[28069]: pgmap v14406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:26 smithi193 ceph-mon[32782]: pgmap v14407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:26 smithi196 ceph-mon[32572]: pgmap v14407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:26 smithi110 ceph-mon[28069]: pgmap v14407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:27 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26542.353080 secs 2024-04-26T19:10:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:27 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26542.353080 secs 2024-04-26T19:10:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:27 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26542.353080 secs 2024-04-26T19:10:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:28 smithi196 ceph-mon[32572]: pgmap v14408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:28 smithi110 ceph-mon[28069]: pgmap v14408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:28 smithi193 ceph-mon[32782]: pgmap v14408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:10:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:10:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:10:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:30 smithi196 ceph-mon[32572]: pgmap v14409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:30 smithi110 ceph-mon[28069]: pgmap v14409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:30 smithi193 ceph-mon[32782]: pgmap v14409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:10:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:10:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:10:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:10:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:10:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:10:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:10:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:10:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:10:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:32 smithi196 ceph-mon[32572]: pgmap v14410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T19:10:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:32 smithi196 ceph-mon[32572]: pgmap v14411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:32 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26547.353226 secs 2024-04-26T19:10:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:32 smithi110 ceph-mon[28069]: pgmap v14410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T19:10:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:32 smithi110 ceph-mon[28069]: pgmap v14411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:32 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26547.353226 secs 2024-04-26T19:10:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:32 smithi193 ceph-mon[32782]: pgmap v14410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T19:10:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:32 smithi193 ceph-mon[32782]: pgmap v14411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:32 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26547.353226 secs 2024-04-26T19:10:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:34 smithi196 ceph-mon[32572]: pgmap v14412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:34 smithi110 ceph-mon[28069]: pgmap v14412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:34 smithi193 ceph-mon[32782]: pgmap v14412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:36 smithi196 ceph-mon[32572]: pgmap v14413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:36 smithi110 ceph-mon[28069]: pgmap v14413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:36 smithi193 ceph-mon[32782]: pgmap v14413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:37 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26552.353289 secs 2024-04-26T19:10:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:37 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26552.353289 secs 2024-04-26T19:10:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:37 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26552.353289 secs 2024-04-26T19:10:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:38 smithi196 ceph-mon[32572]: pgmap v14414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:10:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:38 smithi110 ceph-mon[28069]: pgmap v14414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:10:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:38 smithi193 ceph-mon[32782]: pgmap v14414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:10:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:40 smithi196 ceph-mon[32572]: pgmap v14415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:40 smithi110 ceph-mon[28069]: pgmap v14415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:40 smithi193 ceph-mon[32782]: pgmap v14415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:42 smithi196 ceph-mon[32572]: pgmap v14416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:10:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:42 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26557.353409 secs 2024-04-26T19:10:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:42 smithi110 ceph-mon[28069]: pgmap v14416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:10:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:42 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26557.353409 secs 2024-04-26T19:10:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:42 smithi193 ceph-mon[32782]: pgmap v14416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:10:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:42 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26557.353409 secs 2024-04-26T19:10:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:44 smithi196 ceph-mon[32572]: pgmap v14417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:44 smithi110 ceph-mon[28069]: pgmap v14417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:44 smithi193 ceph-mon[32782]: pgmap v14417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:46 smithi196 ceph-mon[32572]: pgmap v14418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:46 smithi110 ceph-mon[28069]: pgmap v14418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:46 smithi193 ceph-mon[32782]: pgmap v14418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:47 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26562.353530 secs 2024-04-26T19:10:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:47 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26562.353530 secs 2024-04-26T19:10:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:47 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26562.353530 secs 2024-04-26T19:10:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:48 smithi196 ceph-mon[32572]: pgmap v14419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:48 smithi110 ceph-mon[28069]: pgmap v14419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:48 smithi193 ceph-mon[32782]: pgmap v14419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:50 smithi196 ceph-mon[32572]: pgmap v14420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:50 smithi110 ceph-mon[28069]: pgmap v14420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:50 smithi193 ceph-mon[32782]: pgmap v14420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:52 smithi196 ceph-mon[32572]: pgmap v14421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:52 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26567.353593 secs 2024-04-26T19:10:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:52 smithi110 ceph-mon[28069]: pgmap v14421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:52 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26567.353593 secs 2024-04-26T19:10:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:52 smithi193 ceph-mon[32782]: pgmap v14421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:52 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26567.353593 secs 2024-04-26T19:10:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:54 smithi196 ceph-mon[32572]: pgmap v14422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:54 smithi110 ceph-mon[28069]: pgmap v14422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:54 smithi193 ceph-mon[32782]: pgmap v14422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:10:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:56 smithi196 ceph-mon[32572]: pgmap v14423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:56 smithi110 ceph-mon[28069]: pgmap v14423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:56 smithi193 ceph-mon[32782]: pgmap v14423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:57 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26572.353731 secs 2024-04-26T19:10:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:57 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26572.353731 secs 2024-04-26T19:10:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:57 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26572.353731 secs 2024-04-26T19:10:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:10:59 smithi196 ceph-mon[32572]: pgmap v14424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:10:59 smithi110 ceph-mon[28069]: pgmap v14424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:10:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:10:59 smithi193 ceph-mon[32782]: pgmap v14424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:01 smithi110 ceph-mon[28069]: pgmap v14425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:01 smithi193 ceph-mon[32782]: pgmap v14425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:01 smithi196 ceph-mon[32572]: pgmap v14425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:03 smithi110 ceph-mon[28069]: pgmap v14426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:03 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26577.353811 secs 2024-04-26T19:11:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:03 smithi193 ceph-mon[32782]: pgmap v14426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:03 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26577.353811 secs 2024-04-26T19:11:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:03 smithi196 ceph-mon[32572]: pgmap v14426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:03 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26577.353811 secs 2024-04-26T19:11:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:05 smithi110 ceph-mon[28069]: pgmap v14427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:05 smithi193 ceph-mon[32782]: pgmap v14427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:05 smithi196 ceph-mon[32572]: pgmap v14427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:07 smithi110 ceph-mon[28069]: pgmap v14428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:07 smithi193 ceph-mon[32782]: pgmap v14428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:07 smithi196 ceph-mon[32572]: pgmap v14428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:08 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26582.353971 secs 2024-04-26T19:11:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:08 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26582.353971 secs 2024-04-26T19:11:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:08 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26582.353971 secs 2024-04-26T19:11:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:09 smithi110 ceph-mon[28069]: pgmap v14429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:09 smithi193 ceph-mon[32782]: pgmap v14429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:09 smithi196 ceph-mon[32572]: pgmap v14429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:11 smithi193 ceph-mon[32782]: pgmap v14430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:11 smithi196 ceph-mon[32572]: pgmap v14430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:11 smithi110 ceph-mon[28069]: pgmap v14430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:13 smithi193 ceph-mon[32782]: pgmap v14431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:13 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26587.354080 secs 2024-04-26T19:11:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:13 smithi196 ceph-mon[32572]: pgmap v14431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:13 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26587.354080 secs 2024-04-26T19:11:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:13 smithi110 ceph-mon[28069]: pgmap v14431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:13 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26587.354080 secs 2024-04-26T19:11:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:15 smithi193 ceph-mon[32782]: pgmap v14432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:15 smithi196 ceph-mon[32572]: pgmap v14432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:15 smithi110 ceph-mon[28069]: pgmap v14432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:17 smithi193 ceph-mon[32782]: pgmap v14433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:17 smithi196 ceph-mon[32572]: pgmap v14433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:17 smithi110 ceph-mon[28069]: pgmap v14433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:18 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26592.354193 secs 2024-04-26T19:11:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:18 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26592.354193 secs 2024-04-26T19:11:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:18 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26592.354193 secs 2024-04-26T19:11:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:19 smithi193 ceph-mon[32782]: pgmap v14434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:19 smithi196 ceph-mon[32572]: pgmap v14434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:19 smithi110 ceph-mon[28069]: pgmap v14434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:21 smithi193 ceph-mon[32782]: pgmap v14435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:21 smithi196 ceph-mon[32572]: pgmap v14435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:21 smithi110 ceph-mon[28069]: pgmap v14435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:23.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:23 smithi110 ceph-mon[28069]: pgmap v14436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:23.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:23 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26597.354310 secs 2024-04-26T19:11:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:23 smithi193 ceph-mon[32782]: pgmap v14436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:23 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26597.354310 secs 2024-04-26T19:11:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:23 smithi196 ceph-mon[32572]: pgmap v14436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:23 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26597.354310 secs 2024-04-26T19:11:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:25 smithi193 ceph-mon[32782]: pgmap v14437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:25 smithi196 ceph-mon[32572]: pgmap v14437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:25 smithi110 ceph-mon[28069]: pgmap v14437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:27 smithi193 ceph-mon[32782]: pgmap v14438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:27 smithi196 ceph-mon[32572]: pgmap v14438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:27 smithi110 ceph-mon[28069]: pgmap v14438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:28 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26602.354435 secs 2024-04-26T19:11:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:28 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26602.354435 secs 2024-04-26T19:11:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:28 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26602.354435 secs 2024-04-26T19:11:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:29 smithi193 ceph-mon[32782]: pgmap v14439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:29 smithi196 ceph-mon[32572]: pgmap v14439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:29 smithi110 ceph-mon[28069]: pgmap v14439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:30 smithi193 ceph-mon[32782]: pgmap v14440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:30 smithi196 ceph-mon[32572]: pgmap v14440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:30 smithi110 ceph-mon[28069]: pgmap v14440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:32 smithi196 ceph-mon[32572]: pgmap v14441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:11:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:32 smithi110 ceph-mon[28069]: pgmap v14441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:11:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:32 smithi193 ceph-mon[32782]: pgmap v14441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:11:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:33 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26607.354525 secs 2024-04-26T19:11:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:11:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:11:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:33 smithi196 ceph-mon[32572]: pgmap v14442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:11:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:33 smithi196 ceph-mon[32572]: pgmap v14443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:11:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:33 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26607.354525 secs 2024-04-26T19:11:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:11:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:11:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:33 smithi110 ceph-mon[28069]: pgmap v14442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:11:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:33 smithi110 ceph-mon[28069]: pgmap v14443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:11:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:33 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26607.354525 secs 2024-04-26T19:11:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:11:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:11:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:33 smithi193 ceph-mon[32782]: pgmap v14442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:11:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:33 smithi193 ceph-mon[32782]: pgmap v14443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:11:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:35 smithi193 ceph-mon[32782]: pgmap v14444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:35 smithi196 ceph-mon[32572]: pgmap v14444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:35 smithi110 ceph-mon[28069]: pgmap v14444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:37 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26612.354647 secs 2024-04-26T19:11:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:37 smithi193 ceph-mon[32782]: pgmap v14445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:37 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26612.354647 secs 2024-04-26T19:11:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:37 smithi196 ceph-mon[32572]: pgmap v14445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:37 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26612.354647 secs 2024-04-26T19:11:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:37 smithi110 ceph-mon[28069]: pgmap v14445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:39 smithi193 ceph-mon[32782]: pgmap v14446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:39 smithi196 ceph-mon[32572]: pgmap v14446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:39 smithi110 ceph-mon[28069]: pgmap v14446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:41 smithi193 ceph-mon[32782]: pgmap v14447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:41 smithi196 ceph-mon[32572]: pgmap v14447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:41 smithi110 ceph-mon[28069]: pgmap v14447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:11:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:42 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26617.354769 secs 2024-04-26T19:11:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:42 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26617.354769 secs 2024-04-26T19:11:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:42 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26617.354769 secs 2024-04-26T19:11:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:43 smithi193 ceph-mon[32782]: pgmap v14448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:11:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:43 smithi196 ceph-mon[32572]: pgmap v14448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:11:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:43 smithi110 ceph-mon[28069]: pgmap v14448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:11:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:45 smithi193 ceph-mon[32782]: pgmap v14449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:45 smithi196 ceph-mon[32572]: pgmap v14449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:45 smithi110 ceph-mon[28069]: pgmap v14449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:47 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26622.354889 secs 2024-04-26T19:11:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:47 smithi193 ceph-mon[32782]: pgmap v14450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:47 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26622.354889 secs 2024-04-26T19:11:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:47 smithi196 ceph-mon[32572]: pgmap v14450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:47 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26622.354889 secs 2024-04-26T19:11:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:47 smithi110 ceph-mon[28069]: pgmap v14450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:49 smithi193 ceph-mon[32782]: pgmap v14451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:49 smithi196 ceph-mon[32572]: pgmap v14451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:49 smithi110 ceph-mon[28069]: pgmap v14451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:51 smithi196 ceph-mon[32572]: pgmap v14452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:51 smithi110 ceph-mon[28069]: pgmap v14452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:51 smithi193 ceph-mon[32782]: pgmap v14452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:53.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:52 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26627.355000 secs 2024-04-26T19:11:53.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:52 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26627.355000 secs 2024-04-26T19:11:53.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:52 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26627.355000 secs 2024-04-26T19:11:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:53 smithi196 ceph-mon[32572]: pgmap v14453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:53 smithi110 ceph-mon[28069]: pgmap v14453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:53 smithi193 ceph-mon[32782]: pgmap v14453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:11:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:55 smithi196 ceph-mon[32572]: pgmap v14454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:55 smithi110 ceph-mon[28069]: pgmap v14454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:55 smithi193 ceph-mon[32782]: pgmap v14454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:57 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26632.355082 secs 2024-04-26T19:11:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:57 smithi196 ceph-mon[32572]: pgmap v14455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:57 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26632.355082 secs 2024-04-26T19:11:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:57 smithi110 ceph-mon[28069]: pgmap v14455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:11:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:57 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26632.355082 secs 2024-04-26T19:11:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:57 smithi193 ceph-mon[32782]: pgmap v14455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:11:59 smithi196 ceph-mon[32572]: pgmap v14456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:11:59 smithi110 ceph-mon[28069]: pgmap v14456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:11:59 smithi193 ceph-mon[32782]: pgmap v14456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:01 smithi196 ceph-mon[32572]: pgmap v14457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:01 smithi110 ceph-mon[28069]: pgmap v14457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:01 smithi193 ceph-mon[32782]: pgmap v14457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:02 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26637.355200 secs 2024-04-26T19:12:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:02 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26637.355200 secs 2024-04-26T19:12:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:02 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26637.355200 secs 2024-04-26T19:12:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:03 smithi196 ceph-mon[32572]: pgmap v14458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:04.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:03 smithi110 ceph-mon[28069]: pgmap v14458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:03 smithi193 ceph-mon[32782]: pgmap v14458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:05 smithi196 ceph-mon[32572]: pgmap v14459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:05 smithi110 ceph-mon[28069]: pgmap v14459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:05 smithi193 ceph-mon[32782]: pgmap v14459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:07 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26642.355340 secs 2024-04-26T19:12:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:07 smithi196 ceph-mon[32572]: pgmap v14460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:07 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26642.355340 secs 2024-04-26T19:12:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:07 smithi110 ceph-mon[28069]: pgmap v14460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:07 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26642.355340 secs 2024-04-26T19:12:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:07 smithi193 ceph-mon[32782]: pgmap v14460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:09 smithi196 ceph-mon[32572]: pgmap v14461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:09 smithi110 ceph-mon[28069]: pgmap v14461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:09 smithi193 ceph-mon[32782]: pgmap v14461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:11 smithi196 ceph-mon[32572]: pgmap v14462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:11 smithi110 ceph-mon[28069]: pgmap v14462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:11 smithi193 ceph-mon[32782]: pgmap v14462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:12 smithi196 ceph-mon[32572]: 1 slow requests, 0 included below; oldest blocked for > 26647.355455 secs 2024-04-26T19:12:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:12 smithi110 ceph-mon[28069]: 1 slow requests, 0 included below; oldest blocked for > 26647.355455 secs 2024-04-26T19:12:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:12 smithi193 ceph-mon[32782]: 1 slow requests, 0 included below; oldest blocked for > 26647.355455 secs 2024-04-26T19:12:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:13 smithi196 ceph-mon[32572]: pgmap v14463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:13 smithi110 ceph-mon[28069]: pgmap v14463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:13 smithi193 ceph-mon[32782]: pgmap v14463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:15 smithi196 ceph-mon[32572]: pgmap v14464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:15 smithi110 ceph-mon[28069]: pgmap v14464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:15 smithi193 ceph-mon[32782]: pgmap v14464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:17 smithi196 ceph-mon[32572]: 22 slow requests, 1 included below; oldest blocked for > 26652.355590 secs 2024-04-26T19:12:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:17 smithi196 ceph-mon[32572]: slow request 183.617204 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:12:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:17 smithi196 ceph-mon[32572]: pgmap v14465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:17 smithi110 ceph-mon[28069]: 22 slow requests, 1 included below; oldest blocked for > 26652.355590 secs 2024-04-26T19:12:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:17 smithi110 ceph-mon[28069]: slow request 183.617204 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:12:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:17 smithi110 ceph-mon[28069]: pgmap v14465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:17 smithi193 ceph-mon[32782]: 22 slow requests, 1 included below; oldest blocked for > 26652.355590 secs 2024-04-26T19:12:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:17 smithi193 ceph-mon[32782]: slow request 183.617204 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:12:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:17 smithi193 ceph-mon[32782]: pgmap v14465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:18 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:12:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:18 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:12:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:18 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:12:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:18 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:12:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:18 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:12:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:18 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:12:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:19 smithi196 ceph-mon[32572]: pgmap v14466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:19 smithi110 ceph-mon[28069]: pgmap v14466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:19 smithi193 ceph-mon[32782]: pgmap v14466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:12:20.779+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:12:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:12:20.779+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:12:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:12:20.780+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 206 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:12:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:12:20.780+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 206 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:12:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:21 smithi196 ceph-mon[32572]: pgmap v14467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:21 smithi110 ceph-mon[28069]: pgmap v14467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:21 smithi193 ceph-mon[32782]: pgmap v14467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26657.355706 secs 2024-04-26T19:12:23.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26657.355706 secs 2024-04-26T19:12:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26657.355706 secs 2024-04-26T19:12:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:24 smithi196 ceph-mon[32572]: pgmap v14468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:24 smithi110 ceph-mon[28069]: pgmap v14468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:24 smithi193 ceph-mon[32782]: pgmap v14468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:26 smithi110 ceph-mon[28069]: pgmap v14469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:26 smithi193 ceph-mon[32782]: pgmap v14469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:26 smithi196 ceph-mon[32572]: pgmap v14469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26662.355819 secs 2024-04-26T19:12:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:28 smithi110 ceph-mon[28069]: pgmap v14470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26662.355819 secs 2024-04-26T19:12:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:28 smithi193 ceph-mon[32782]: pgmap v14470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26662.355819 secs 2024-04-26T19:12:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:28 smithi196 ceph-mon[32572]: pgmap v14470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:30 smithi110 ceph-mon[28069]: pgmap v14471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:30 smithi193 ceph-mon[32782]: pgmap v14471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:30 smithi196 ceph-mon[32572]: pgmap v14471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:32 smithi110 ceph-mon[28069]: pgmap v14472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:32 smithi193 ceph-mon[32782]: pgmap v14472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:32 smithi196 ceph-mon[32572]: pgmap v14472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26667.355941 secs 2024-04-26T19:12:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26667.355941 secs 2024-04-26T19:12:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26667.355941 secs 2024-04-26T19:12:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:34 smithi110 ceph-mon[28069]: pgmap v14473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:12:34.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:34 smithi193 ceph-mon[32782]: pgmap v14473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:34.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:12:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:34 smithi196 ceph-mon[32572]: pgmap v14473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:12:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:12:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:12:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:12:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:12:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:12:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:12:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:12:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:12:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:12:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:36 smithi193 ceph-mon[32782]: pgmap v14474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T19:12:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:36 smithi193 ceph-mon[32782]: pgmap v14475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:36 smithi196 ceph-mon[32572]: pgmap v14474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T19:12:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:36 smithi196 ceph-mon[32572]: pgmap v14475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:36 smithi110 ceph-mon[28069]: pgmap v14474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T19:12:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:36 smithi110 ceph-mon[28069]: pgmap v14475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:38 smithi193 ceph-mon[32782]: pgmap v14476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26672.356023 secs 2024-04-26T19:12:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:38 smithi196 ceph-mon[32572]: pgmap v14476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26672.356023 secs 2024-04-26T19:12:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:38 smithi110 ceph-mon[28069]: pgmap v14476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26672.356023 secs 2024-04-26T19:12:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:40 smithi193 ceph-mon[32782]: pgmap v14477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:40 smithi196 ceph-mon[32572]: pgmap v14477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:40 smithi110 ceph-mon[28069]: pgmap v14477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:42 smithi193 ceph-mon[32782]: pgmap v14478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:42 smithi196 ceph-mon[32572]: pgmap v14478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:42 smithi110 ceph-mon[28069]: pgmap v14478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:12:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26677.356164 secs 2024-04-26T19:12:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26677.356164 secs 2024-04-26T19:12:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26677.356164 secs 2024-04-26T19:12:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:44 smithi193 ceph-mon[32782]: pgmap v14479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T19:12:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:44 smithi196 ceph-mon[32572]: pgmap v14479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T19:12:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:44 smithi110 ceph-mon[28069]: pgmap v14479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T19:12:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:46 smithi193 ceph-mon[32782]: pgmap v14480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:12:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:46 smithi196 ceph-mon[32572]: pgmap v14480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:12:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:46 smithi110 ceph-mon[28069]: pgmap v14480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:12:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:48 smithi193 ceph-mon[32782]: pgmap v14481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26682.356287 secs 2024-04-26T19:12:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:48 smithi196 ceph-mon[32572]: pgmap v14481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26682.356287 secs 2024-04-26T19:12:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:48 smithi110 ceph-mon[28069]: pgmap v14481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26682.356287 secs 2024-04-26T19:12:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:50 smithi193 ceph-mon[32782]: pgmap v14482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:50 smithi196 ceph-mon[32572]: pgmap v14482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:50 smithi110 ceph-mon[28069]: pgmap v14482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:52 smithi193 ceph-mon[32782]: pgmap v14483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:52 smithi196 ceph-mon[32572]: pgmap v14483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:52 smithi110 ceph-mon[28069]: pgmap v14483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26687.356405 secs 2024-04-26T19:12:53.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26687.356405 secs 2024-04-26T19:12:53.446 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26687.356405 secs 2024-04-26T19:12:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:54 smithi193 ceph-mon[32782]: pgmap v14484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:12:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:54 smithi196 ceph-mon[32572]: pgmap v14484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:12:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:54 smithi110 ceph-mon[28069]: pgmap v14484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:12:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:55 smithi196 ceph-mon[32572]: pgmap v14485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:55 smithi110 ceph-mon[28069]: pgmap v14485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:55 smithi193 ceph-mon[32782]: pgmap v14485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:57 smithi196 ceph-mon[32572]: pgmap v14486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26692.356526 secs 2024-04-26T19:12:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:57 smithi110 ceph-mon[28069]: pgmap v14486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26692.356526 secs 2024-04-26T19:12:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:57 smithi193 ceph-mon[32782]: pgmap v14486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:12:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26692.356526 secs 2024-04-26T19:12:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:12:59 smithi196 ceph-mon[32572]: pgmap v14487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:12:59 smithi110 ceph-mon[28069]: pgmap v14487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:12:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:12:59 smithi193 ceph-mon[32782]: pgmap v14487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:01 smithi196 ceph-mon[32572]: pgmap v14488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:01 smithi110 ceph-mon[28069]: pgmap v14488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:01 smithi193 ceph-mon[32782]: pgmap v14488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26697.356643 secs 2024-04-26T19:13:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26697.356643 secs 2024-04-26T19:13:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26697.356643 secs 2024-04-26T19:13:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:03 smithi196 ceph-mon[32572]: pgmap v14489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:03 smithi110 ceph-mon[28069]: pgmap v14489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:03 smithi193 ceph-mon[32782]: pgmap v14489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:05 smithi196 ceph-mon[32572]: pgmap v14490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:05 smithi110 ceph-mon[28069]: pgmap v14490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:05 smithi193 ceph-mon[32782]: pgmap v14490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:07 smithi196 ceph-mon[32572]: pgmap v14491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26702.356759 secs 2024-04-26T19:13:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:07 smithi110 ceph-mon[28069]: pgmap v14491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26702.356759 secs 2024-04-26T19:13:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:07 smithi193 ceph-mon[32782]: pgmap v14491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26702.356759 secs 2024-04-26T19:13:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:09 smithi196 ceph-mon[32572]: pgmap v14492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:09 smithi110 ceph-mon[28069]: pgmap v14492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:09 smithi193 ceph-mon[32782]: pgmap v14492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:11 smithi196 ceph-mon[32572]: pgmap v14493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:11 smithi110 ceph-mon[28069]: pgmap v14493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:11 smithi193 ceph-mon[32782]: pgmap v14493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26707.356842 secs 2024-04-26T19:13:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26707.356842 secs 2024-04-26T19:13:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26707.356842 secs 2024-04-26T19:13:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:13 smithi196 ceph-mon[32572]: pgmap v14494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:13 smithi110 ceph-mon[28069]: pgmap v14494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:13 smithi193 ceph-mon[32782]: pgmap v14494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:15 smithi196 ceph-mon[32572]: pgmap v14495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:15.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:15 smithi110 ceph-mon[28069]: pgmap v14495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:15 smithi193 ceph-mon[32782]: pgmap v14495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:17 smithi110 ceph-mon[28069]: pgmap v14496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:17 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26712.356909 secs 2024-04-26T19:13:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:17 smithi193 ceph-mon[32782]: pgmap v14496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:17 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26712.356909 secs 2024-04-26T19:13:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:17 smithi196 ceph-mon[32572]: pgmap v14496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:17 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26712.356909 secs 2024-04-26T19:13:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:19 smithi110 ceph-mon[28069]: pgmap v14497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:19 smithi193 ceph-mon[32782]: pgmap v14497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:19 smithi196 ceph-mon[32572]: pgmap v14497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:21 smithi110 ceph-mon[28069]: pgmap v14498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:21 smithi193 ceph-mon[32782]: pgmap v14498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:21 smithi196 ceph-mon[32572]: pgmap v14498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26717.357042 secs 2024-04-26T19:13:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26717.357042 secs 2024-04-26T19:13:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26717.357042 secs 2024-04-26T19:13:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:23 smithi110 ceph-mon[28069]: pgmap v14499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:23 smithi193 ceph-mon[32782]: pgmap v14499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:23.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:23 smithi196 ceph-mon[32572]: pgmap v14499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:25 smithi110 ceph-mon[28069]: pgmap v14500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:25 smithi193 ceph-mon[32782]: pgmap v14500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:25 smithi196 ceph-mon[32572]: pgmap v14500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:27 smithi110 ceph-mon[28069]: pgmap v14501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:27 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26722.357125 secs 2024-04-26T19:13:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:27 smithi193 ceph-mon[32782]: pgmap v14501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:27 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26722.357125 secs 2024-04-26T19:13:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:27 smithi196 ceph-mon[32572]: pgmap v14501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:27 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26722.357125 secs 2024-04-26T19:13:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:29 smithi193 ceph-mon[32782]: pgmap v14502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:29 smithi196 ceph-mon[32572]: pgmap v14502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:29 smithi110 ceph-mon[28069]: pgmap v14502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:31 smithi193 ceph-mon[32782]: pgmap v14503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:31 smithi196 ceph-mon[32572]: pgmap v14503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:31 smithi110 ceph-mon[28069]: pgmap v14503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26727.357222 secs 2024-04-26T19:13:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26727.357222 secs 2024-04-26T19:13:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26727.357222 secs 2024-04-26T19:13:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:33 smithi193 ceph-mon[32782]: pgmap v14504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:33 smithi196 ceph-mon[32572]: pgmap v14504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:33 smithi110 ceph-mon[28069]: pgmap v14504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:13:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:35 smithi193 ceph-mon[32782]: pgmap v14505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:13:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:35 smithi196 ceph-mon[32572]: pgmap v14505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:13:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:35 smithi110 ceph-mon[28069]: pgmap v14505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:13:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:13:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:13:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:36 smithi193 ceph-mon[32782]: pgmap v14506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T19:13:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:36 smithi193 ceph-mon[32782]: pgmap v14507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:13:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:13:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:13:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:36 smithi196 ceph-mon[32572]: pgmap v14506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T19:13:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:36 smithi196 ceph-mon[32572]: pgmap v14507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:13:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:13:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:13:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:36 smithi110 ceph-mon[28069]: pgmap v14506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T19:13:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:36 smithi110 ceph-mon[28069]: pgmap v14507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:13:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26732.357347 secs 2024-04-26T19:13:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26732.357347 secs 2024-04-26T19:13:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26732.357347 secs 2024-04-26T19:13:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:38 smithi193 ceph-mon[32782]: pgmap v14508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:38 smithi196 ceph-mon[32572]: pgmap v14508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:38 smithi110 ceph-mon[28069]: pgmap v14508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:41 smithi193 ceph-mon[32782]: pgmap v14509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:41 smithi196 ceph-mon[32572]: pgmap v14509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:41 smithi110 ceph-mon[28069]: pgmap v14509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26737.357442 secs 2024-04-26T19:13:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:43 smithi193 ceph-mon[32782]: pgmap v14510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:13:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26737.357442 secs 2024-04-26T19:13:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:43 smithi196 ceph-mon[32572]: pgmap v14510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:13:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26737.357442 secs 2024-04-26T19:13:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:43 smithi110 ceph-mon[28069]: pgmap v14510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:13:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:45 smithi193 ceph-mon[32782]: pgmap v14511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:45.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:45 smithi196 ceph-mon[32572]: pgmap v14511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:45 smithi110 ceph-mon[28069]: pgmap v14511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:13:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:47 smithi193 ceph-mon[32782]: pgmap v14512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:13:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:47 smithi196 ceph-mon[32572]: pgmap v14512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:13:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:47 smithi110 ceph-mon[28069]: pgmap v14512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:13:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26742.357541 secs 2024-04-26T19:13:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26742.357541 secs 2024-04-26T19:13:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26742.357541 secs 2024-04-26T19:13:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:49 smithi193 ceph-mon[32782]: pgmap v14513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:49 smithi196 ceph-mon[32572]: pgmap v14513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:49 smithi110 ceph-mon[28069]: pgmap v14513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:13:50.794+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:13:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:13:50.794+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:13:50.797 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:13:50.796+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 207 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:13:50.798 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:13:50.796+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 207 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:13:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:51 smithi193 ceph-mon[32782]: pgmap v14514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:51 smithi196 ceph-mon[32572]: pgmap v14514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:51 smithi110 ceph-mon[28069]: pgmap v14514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26747.357638 secs 2024-04-26T19:13:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:53 smithi193 ceph-mon[32782]: pgmap v14515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26747.357638 secs 2024-04-26T19:13:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:53 smithi196 ceph-mon[32572]: pgmap v14515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26747.357638 secs 2024-04-26T19:13:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:53 smithi110 ceph-mon[28069]: pgmap v14515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:55 smithi193 ceph-mon[32782]: pgmap v14516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:55 smithi196 ceph-mon[32572]: pgmap v14516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:55 smithi110 ceph-mon[28069]: pgmap v14516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:57 smithi193 ceph-mon[32782]: pgmap v14517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:57.510 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:57 smithi196 ceph-mon[32572]: pgmap v14517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:57 smithi110 ceph-mon[28069]: pgmap v14517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:13:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26752.357730 secs 2024-04-26T19:13:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26752.357730 secs 2024-04-26T19:13:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26752.357730 secs 2024-04-26T19:13:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:13:59 smithi196 ceph-mon[32572]: pgmap v14518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:13:59 smithi110 ceph-mon[28069]: pgmap v14518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:13:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:13:59 smithi193 ceph-mon[32782]: pgmap v14518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:00 smithi196 ceph-mon[32572]: pgmap v14519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:00 smithi110 ceph-mon[28069]: pgmap v14519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:00 smithi193 ceph-mon[32782]: pgmap v14519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26757.357849 secs 2024-04-26T19:14:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:03 smithi193 ceph-mon[32782]: pgmap v14520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26757.357849 secs 2024-04-26T19:14:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:03 smithi196 ceph-mon[32572]: pgmap v14520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26757.357849 secs 2024-04-26T19:14:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:03 smithi110 ceph-mon[28069]: pgmap v14520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:05 smithi193 ceph-mon[32782]: pgmap v14521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:05 smithi196 ceph-mon[32572]: pgmap v14521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:05 smithi110 ceph-mon[28069]: pgmap v14521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:07 smithi193 ceph-mon[32782]: pgmap v14522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:07 smithi196 ceph-mon[32572]: pgmap v14522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:07 smithi110 ceph-mon[28069]: pgmap v14522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26762.357936 secs 2024-04-26T19:14:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26762.357936 secs 2024-04-26T19:14:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26762.357936 secs 2024-04-26T19:14:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:09 smithi193 ceph-mon[32782]: pgmap v14523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:09 smithi196 ceph-mon[32572]: pgmap v14523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:09 smithi110 ceph-mon[28069]: pgmap v14523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:11 smithi193 ceph-mon[32782]: pgmap v14524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:11 smithi196 ceph-mon[32572]: pgmap v14524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:11 smithi110 ceph-mon[28069]: pgmap v14524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26767.358056 secs 2024-04-26T19:14:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:13 smithi193 ceph-mon[32782]: pgmap v14525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26767.358056 secs 2024-04-26T19:14:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:13 smithi196 ceph-mon[32572]: pgmap v14525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26767.358056 secs 2024-04-26T19:14:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:13 smithi110 ceph-mon[28069]: pgmap v14525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:13.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:14:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:14:13.259+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:14:13.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:14:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:14:13.259+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:14:13.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:14:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:14:13.259+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:14:13.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:14:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:14:13.259+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:14:13.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:14:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:14:13.259+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:14:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:15 smithi193 ceph-mon[32782]: pgmap v14526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:15 smithi196 ceph-mon[32572]: pgmap v14526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:15 smithi110 ceph-mon[28069]: pgmap v14526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:17 smithi193 ceph-mon[32782]: pgmap v14527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:17 smithi196 ceph-mon[32572]: pgmap v14527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:17 smithi110 ceph-mon[28069]: pgmap v14527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26772.358181 secs 2024-04-26T19:14:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26772.358181 secs 2024-04-26T19:14:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26772.358181 secs 2024-04-26T19:14:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:19 smithi193 ceph-mon[32782]: pgmap v14528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:19 smithi196 ceph-mon[32572]: pgmap v14528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:19 smithi110 ceph-mon[28069]: pgmap v14528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:21 smithi196 ceph-mon[32572]: pgmap v14529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:21.546 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:21 smithi110 ceph-mon[28069]: pgmap v14529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:21 smithi193 ceph-mon[32782]: pgmap v14529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:23.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26777.358302 secs 2024-04-26T19:14:23.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:23 smithi193 ceph-mon[32782]: pgmap v14530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26777.358302 secs 2024-04-26T19:14:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:23 smithi196 ceph-mon[32572]: pgmap v14530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26777.358302 secs 2024-04-26T19:14:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:23 smithi110 ceph-mon[28069]: pgmap v14530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:24 smithi196 ceph-mon[32572]: pgmap v14531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:24 smithi110 ceph-mon[28069]: pgmap v14531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:24 smithi193 ceph-mon[32782]: pgmap v14531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:27 smithi193 ceph-mon[32782]: pgmap v14532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:27 smithi196 ceph-mon[32572]: pgmap v14532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:27 smithi110 ceph-mon[28069]: pgmap v14532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26782.358420 secs 2024-04-26T19:14:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26782.358420 secs 2024-04-26T19:14:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26782.358420 secs 2024-04-26T19:14:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:29 smithi193 ceph-mon[32782]: pgmap v14533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:29 smithi196 ceph-mon[32572]: pgmap v14533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:29 smithi110 ceph-mon[28069]: pgmap v14533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:14:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:31 smithi193 ceph-mon[32782]: pgmap v14534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:31 smithi196 ceph-mon[32572]: pgmap v14534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:31 smithi110 ceph-mon[28069]: pgmap v14534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26787.358580 secs 2024-04-26T19:14:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:33 smithi193 ceph-mon[32782]: pgmap v14535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26787.358580 secs 2024-04-26T19:14:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:33 smithi196 ceph-mon[32572]: pgmap v14535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26787.358580 secs 2024-04-26T19:14:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:33 smithi110 ceph-mon[28069]: pgmap v14535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:35 smithi193 ceph-mon[32782]: pgmap v14536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:35.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:35 smithi196 ceph-mon[32572]: pgmap v14536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:35.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:35 smithi110 ceph-mon[28069]: pgmap v14536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:37 smithi193 ceph-mon[32782]: pgmap v14537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:14:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:37 smithi196 ceph-mon[32572]: pgmap v14537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:14:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:37 smithi110 ceph-mon[28069]: pgmap v14537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:14:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26792.358625 secs 2024-04-26T19:14:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:14:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:14:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:14:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26792.358625 secs 2024-04-26T19:14:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:14:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:14:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:14:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26792.358625 secs 2024-04-26T19:14:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:14:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:14:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:14:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:39 smithi196 ceph-mon[32572]: pgmap v14538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:14:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:39 smithi196 ceph-mon[32572]: pgmap v14539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:39 smithi110 ceph-mon[28069]: pgmap v14538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:14:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:39 smithi110 ceph-mon[28069]: pgmap v14539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:39 smithi193 ceph-mon[32782]: pgmap v14538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:14:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:39 smithi193 ceph-mon[32782]: pgmap v14539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:41 smithi196 ceph-mon[32572]: pgmap v14540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:41 smithi110 ceph-mon[28069]: pgmap v14540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:41 smithi193 ceph-mon[32782]: pgmap v14540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:43 smithi196 ceph-mon[32572]: pgmap v14541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26797.358690 secs 2024-04-26T19:14:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:43 smithi110 ceph-mon[28069]: pgmap v14541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26797.358690 secs 2024-04-26T19:14:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:43 smithi193 ceph-mon[32782]: pgmap v14541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26797.358690 secs 2024-04-26T19:14:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:44 smithi196 ceph-mon[32572]: pgmap v14542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:44 smithi110 ceph-mon[28069]: pgmap v14542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:44.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:44 smithi193 ceph-mon[32782]: pgmap v14542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:46 smithi196 ceph-mon[32572]: pgmap v14543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:47.081 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:46 smithi110 ceph-mon[28069]: pgmap v14543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:46 smithi193 ceph-mon[32782]: pgmap v14543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:14:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:47 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26802.358811 secs 2024-04-26T19:14:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:47 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26802.358811 secs 2024-04-26T19:14:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:47 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26802.358811 secs 2024-04-26T19:14:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:48 smithi196 ceph-mon[32572]: pgmap v14544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:14:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:48 smithi110 ceph-mon[28069]: pgmap v14544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:14:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:48 smithi193 ceph-mon[32782]: pgmap v14544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:14:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:50 smithi196 ceph-mon[32572]: pgmap v14545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:50 smithi110 ceph-mon[28069]: pgmap v14545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:51.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:50 smithi193 ceph-mon[32782]: pgmap v14545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:52 smithi196 ceph-mon[32572]: pgmap v14546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26807.358910 secs 2024-04-26T19:14:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:52 smithi110 ceph-mon[28069]: pgmap v14546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26807.358910 secs 2024-04-26T19:14:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:52 smithi193 ceph-mon[32782]: pgmap v14546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26807.358910 secs 2024-04-26T19:14:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:54 smithi196 ceph-mon[32572]: pgmap v14547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:54 smithi110 ceph-mon[28069]: pgmap v14547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:54 smithi193 ceph-mon[32782]: pgmap v14547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:56 smithi196 ceph-mon[32572]: pgmap v14548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:56 smithi110 ceph-mon[28069]: pgmap v14548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:56 smithi193 ceph-mon[32782]: pgmap v14548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:14:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26812.359030 secs 2024-04-26T19:14:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26812.359030 secs 2024-04-26T19:14:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26812.359030 secs 2024-04-26T19:14:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:14:58 smithi196 ceph-mon[32572]: pgmap v14549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:14:58 smithi110 ceph-mon[28069]: pgmap v14549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:14:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:14:58 smithi193 ceph-mon[32782]: pgmap v14549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:00 smithi196 ceph-mon[32572]: pgmap v14550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:00 smithi110 ceph-mon[28069]: pgmap v14550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:00 smithi193 ceph-mon[32782]: pgmap v14550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:02 smithi196 ceph-mon[32572]: pgmap v14551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26817.359146 secs 2024-04-26T19:15:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:02 smithi110 ceph-mon[28069]: pgmap v14551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26817.359146 secs 2024-04-26T19:15:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:02 smithi193 ceph-mon[32782]: pgmap v14551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26817.359146 secs 2024-04-26T19:15:05.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:04 smithi196 ceph-mon[32572]: pgmap v14552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:15:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:04 smithi110 ceph-mon[28069]: pgmap v14552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:15:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:04 smithi193 ceph-mon[32782]: pgmap v14552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:15:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:06 smithi196 ceph-mon[32572]: pgmap v14553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:15:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:06 smithi110 ceph-mon[28069]: pgmap v14553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:15:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:06 smithi193 ceph-mon[32782]: pgmap v14553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:15:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26822.359286 secs 2024-04-26T19:15:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26822.359286 secs 2024-04-26T19:15:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26822.359286 secs 2024-04-26T19:15:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:08 smithi196 ceph-mon[32572]: pgmap v14554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:15:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:08 smithi110 ceph-mon[28069]: pgmap v14554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:15:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:08 smithi193 ceph-mon[32782]: pgmap v14554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:15:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:10 smithi196 ceph-mon[32572]: pgmap v14555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:15:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:10 smithi110 ceph-mon[28069]: pgmap v14555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:15:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:10 smithi193 ceph-mon[32782]: pgmap v14555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:15:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:12 smithi110 ceph-mon[28069]: pgmap v14556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:15:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26827.359407 secs 2024-04-26T19:15:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:12 smithi193 ceph-mon[32782]: pgmap v14556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:15:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26827.359407 secs 2024-04-26T19:15:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:12 smithi196 ceph-mon[32572]: pgmap v14556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:15:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26827.359407 secs 2024-04-26T19:15:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:14 smithi110 ceph-mon[28069]: pgmap v14557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:15:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:14 smithi193 ceph-mon[32782]: pgmap v14557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:15:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:14 smithi196 ceph-mon[32572]: pgmap v14557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:15:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:16 smithi110 ceph-mon[28069]: pgmap v14558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:15:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:16 smithi193 ceph-mon[32782]: pgmap v14558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:15:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:16 smithi196 ceph-mon[32572]: pgmap v14558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:15:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:17 smithi110 ceph-mon[28069]: 22 slow requests, 1 included below; oldest blocked for > 26832.359518 secs 2024-04-26T19:15:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:17 smithi110 ceph-mon[28069]: slow request 363.621132 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:15:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:17 smithi193 ceph-mon[32782]: 22 slow requests, 1 included below; oldest blocked for > 26832.359518 secs 2024-04-26T19:15:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:17 smithi193 ceph-mon[32782]: slow request 363.621132 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:15:18.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:17 smithi196 ceph-mon[32572]: 22 slow requests, 1 included below; oldest blocked for > 26832.359518 secs 2024-04-26T19:15:18.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:17 smithi196 ceph-mon[32572]: slow request 363.621132 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:15:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:18 smithi110 ceph-mon[28069]: pgmap v14559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:18 smithi193 ceph-mon[32782]: pgmap v14559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:18 smithi196 ceph-mon[32572]: pgmap v14559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:15:20.810+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:15:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:15:20.810+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:15:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:15:20.811+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 208 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:15:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:15:20.811+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 208 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:15:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:20 smithi110 ceph-mon[28069]: pgmap v14560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:20 smithi193 ceph-mon[32782]: pgmap v14560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:20 smithi196 ceph-mon[32572]: pgmap v14560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:22 smithi193 ceph-mon[32782]: pgmap v14561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26837.359614 secs 2024-04-26T19:15:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:22 smithi196 ceph-mon[32572]: pgmap v14561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26837.359614 secs 2024-04-26T19:15:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:22 smithi110 ceph-mon[28069]: pgmap v14561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26837.359614 secs 2024-04-26T19:15:25.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:24 smithi196 ceph-mon[32572]: pgmap v14562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:25.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:24 smithi110 ceph-mon[28069]: pgmap v14562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:24 smithi193 ceph-mon[32782]: pgmap v14562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:26 smithi193 ceph-mon[32782]: pgmap v14563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:26 smithi196 ceph-mon[32572]: pgmap v14563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:26 smithi110 ceph-mon[28069]: pgmap v14563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:27 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26842.359726 secs 2024-04-26T19:15:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:27 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26842.359726 secs 2024-04-26T19:15:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:27 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26842.359726 secs 2024-04-26T19:15:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:28 smithi193 ceph-mon[32782]: pgmap v14564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:28 smithi196 ceph-mon[32572]: pgmap v14564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:28 smithi110 ceph-mon[28069]: pgmap v14564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:30 smithi193 ceph-mon[32782]: pgmap v14565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:30 smithi196 ceph-mon[32572]: pgmap v14565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:30 smithi110 ceph-mon[28069]: pgmap v14565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:32 smithi193 ceph-mon[32782]: pgmap v14566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:33.287 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26847.359838 secs 2024-04-26T19:15:33.288 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:32 smithi196 ceph-mon[32572]: pgmap v14566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:33.288 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26847.359838 secs 2024-04-26T19:15:33.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:32 smithi110 ceph-mon[28069]: pgmap v14566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:33.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26847.359838 secs 2024-04-26T19:15:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:34 smithi193 ceph-mon[32782]: pgmap v14567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:34 smithi196 ceph-mon[32572]: pgmap v14567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:34 smithi110 ceph-mon[28069]: pgmap v14567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:36 smithi193 ceph-mon[32782]: pgmap v14568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:36 smithi196 ceph-mon[32572]: pgmap v14568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:36 smithi110 ceph-mon[28069]: pgmap v14568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26852.359913 secs 2024-04-26T19:15:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26852.359913 secs 2024-04-26T19:15:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26852.359913 secs 2024-04-26T19:15:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:38 smithi193 ceph-mon[32782]: pgmap v14569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:15:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:38 smithi196 ceph-mon[32572]: pgmap v14569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:15:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:38 smithi110 ceph-mon[28069]: pgmap v14569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:15:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:15:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:15:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:39 smithi193 ceph-mon[32782]: pgmap v14570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T19:15:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:39 smithi193 ceph-mon[32782]: pgmap v14571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:15:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:15:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:15:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:39 smithi196 ceph-mon[32572]: pgmap v14570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T19:15:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:39 smithi196 ceph-mon[32572]: pgmap v14571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:15:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:15:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:15:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:39 smithi110 ceph-mon[28069]: pgmap v14570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T19:15:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:39 smithi110 ceph-mon[28069]: pgmap v14571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:15:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:42 smithi196 ceph-mon[32572]: pgmap v14572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:42 smithi110 ceph-mon[28069]: pgmap v14572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:42 smithi193 ceph-mon[32782]: pgmap v14572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26857.360035 secs 2024-04-26T19:15:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26857.360035 secs 2024-04-26T19:15:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26857.360035 secs 2024-04-26T19:15:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:44 smithi196 ceph-mon[32572]: pgmap v14573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:44 smithi110 ceph-mon[28069]: pgmap v14573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:44 smithi193 ceph-mon[32782]: pgmap v14573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:45 smithi196 ceph-mon[32572]: pgmap v14574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:45 smithi110 ceph-mon[28069]: pgmap v14574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:45 smithi193 ceph-mon[32782]: pgmap v14574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26862.360132 secs 2024-04-26T19:15:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:48 smithi196 ceph-mon[32572]: pgmap v14575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T19:15:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26862.360132 secs 2024-04-26T19:15:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:48 smithi110 ceph-mon[28069]: pgmap v14575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T19:15:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26862.360132 secs 2024-04-26T19:15:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:48 smithi193 ceph-mon[32782]: pgmap v14575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T19:15:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:50 smithi196 ceph-mon[32572]: pgmap v14576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:15:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:50 smithi110 ceph-mon[28069]: pgmap v14576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:15:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:50 smithi193 ceph-mon[32782]: pgmap v14576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:15:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:51 smithi196 ceph-mon[32572]: pgmap v14577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:51 smithi110 ceph-mon[28069]: pgmap v14577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:51 smithi193 ceph-mon[32782]: pgmap v14577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26867.360231 secs 2024-04-26T19:15:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26867.360231 secs 2024-04-26T19:15:52.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26867.360231 secs 2024-04-26T19:15:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:53 smithi193 ceph-mon[32782]: pgmap v14578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:53 smithi196 ceph-mon[32572]: pgmap v14578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:53 smithi110 ceph-mon[28069]: pgmap v14578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:56.457 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:56 smithi196 ceph-mon[32572]: pgmap v14579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:56.494 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:56 smithi110 ceph-mon[28069]: pgmap v14579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:56 smithi193 ceph-mon[32782]: pgmap v14579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26872.360328 secs 2024-04-26T19:15:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:58 smithi196 ceph-mon[32572]: pgmap v14580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26872.360328 secs 2024-04-26T19:15:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:58 smithi110 ceph-mon[28069]: pgmap v14580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26872.360328 secs 2024-04-26T19:15:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:58 smithi193 ceph-mon[32782]: pgmap v14580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:15:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:15:59 smithi196 ceph-mon[32572]: pgmap v14581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:15:59 smithi110 ceph-mon[28069]: pgmap v14581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:15:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:15:59 smithi193 ceph-mon[32782]: pgmap v14581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:02 smithi196 ceph-mon[32572]: pgmap v14582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:02 smithi110 ceph-mon[28069]: pgmap v14582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:02 smithi193 ceph-mon[32782]: pgmap v14582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26877.360463 secs 2024-04-26T19:16:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26877.360463 secs 2024-04-26T19:16:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26877.360463 secs 2024-04-26T19:16:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:04 smithi196 ceph-mon[32572]: pgmap v14583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:04 smithi110 ceph-mon[28069]: pgmap v14583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:04 smithi193 ceph-mon[32782]: pgmap v14583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:05 smithi196 ceph-mon[32572]: pgmap v14584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:05 smithi110 ceph-mon[28069]: pgmap v14584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:05 smithi193 ceph-mon[32782]: pgmap v14584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26882.360581 secs 2024-04-26T19:16:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:08 smithi196 ceph-mon[32572]: pgmap v14585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26882.360581 secs 2024-04-26T19:16:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:08 smithi110 ceph-mon[28069]: pgmap v14585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26882.360581 secs 2024-04-26T19:16:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:08 smithi193 ceph-mon[32782]: pgmap v14585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:09 smithi196 ceph-mon[32572]: pgmap v14586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:09 smithi110 ceph-mon[28069]: pgmap v14586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:09 smithi193 ceph-mon[32782]: pgmap v14586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:12 smithi196 ceph-mon[32572]: pgmap v14587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:12 smithi110 ceph-mon[28069]: pgmap v14587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:12 smithi193 ceph-mon[32782]: pgmap v14587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:13 smithi196 ceph-mon[32572]: 22 slow requests, 1 included below; oldest blocked for > 26887.360701 secs 2024-04-26T19:16:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:13 smithi196 ceph-mon[32572]: slow request 11523.837966 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:16:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:13 smithi196 ceph-mon[32572]: pgmap v14588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:13 smithi110 ceph-mon[28069]: 22 slow requests, 1 included below; oldest blocked for > 26887.360701 secs 2024-04-26T19:16:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:13 smithi110 ceph-mon[28069]: slow request 11523.837966 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:16:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:13 smithi110 ceph-mon[28069]: pgmap v14588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:13 smithi193 ceph-mon[32782]: 22 slow requests, 1 included below; oldest blocked for > 26887.360701 secs 2024-04-26T19:16:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:13 smithi193 ceph-mon[32782]: slow request 11523.837966 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:16:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:13 smithi193 ceph-mon[32782]: pgmap v14588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:16 smithi196 ceph-mon[32572]: pgmap v14589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:16 smithi110 ceph-mon[28069]: pgmap v14589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:16 smithi193 ceph-mon[32782]: pgmap v14589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:17.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:17 smithi196 ceph-mon[32572]: pgmap v14590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:17 smithi110 ceph-mon[28069]: pgmap v14590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:17 smithi193 ceph-mon[32782]: pgmap v14590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26892.360824 secs 2024-04-26T19:16:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26892.360824 secs 2024-04-26T19:16:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26892.360824 secs 2024-04-26T19:16:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:19 smithi196 ceph-mon[32572]: pgmap v14591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:19 smithi110 ceph-mon[28069]: pgmap v14591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:19 smithi193 ceph-mon[32782]: pgmap v14591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:21.511 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:21 smithi196 ceph-mon[32572]: pgmap v14592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:21 smithi110 ceph-mon[28069]: pgmap v14592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:21 smithi193 ceph-mon[32782]: pgmap v14592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26897.360934 secs 2024-04-26T19:16:22.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26897.360934 secs 2024-04-26T19:16:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26897.360934 secs 2024-04-26T19:16:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:23 smithi193 ceph-mon[32782]: pgmap v14593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:23 smithi196 ceph-mon[32572]: pgmap v14593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:23 smithi110 ceph-mon[28069]: pgmap v14593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:25 smithi196 ceph-mon[32572]: pgmap v14594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:25 smithi110 ceph-mon[28069]: pgmap v14594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:25 smithi193 ceph-mon[32782]: pgmap v14594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:27 smithi196 ceph-mon[32572]: pgmap v14595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:27 smithi110 ceph-mon[28069]: pgmap v14595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:27 smithi193 ceph-mon[32782]: pgmap v14595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26902.361051 secs 2024-04-26T19:16:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26902.361051 secs 2024-04-26T19:16:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26902.361051 secs 2024-04-26T19:16:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:29 smithi196 ceph-mon[32572]: pgmap v14596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:29 smithi110 ceph-mon[28069]: pgmap v14596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:29 smithi193 ceph-mon[32782]: pgmap v14596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:31 smithi196 ceph-mon[32572]: pgmap v14597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:31 smithi110 ceph-mon[28069]: pgmap v14597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:31 smithi193 ceph-mon[32782]: pgmap v14597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26907.361173 secs 2024-04-26T19:16:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26907.361173 secs 2024-04-26T19:16:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26907.361173 secs 2024-04-26T19:16:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:33 smithi193 ceph-mon[32782]: pgmap v14598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:33 smithi196 ceph-mon[32572]: pgmap v14598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:33 smithi110 ceph-mon[28069]: pgmap v14598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:35 smithi196 ceph-mon[32572]: pgmap v14599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:35 smithi110 ceph-mon[28069]: pgmap v14599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:35 smithi193 ceph-mon[32782]: pgmap v14599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:37 smithi196 ceph-mon[32572]: pgmap v14600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:37 smithi110 ceph-mon[28069]: pgmap v14600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:37 smithi193 ceph-mon[32782]: pgmap v14600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26912.361273 secs 2024-04-26T19:16:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26912.361273 secs 2024-04-26T19:16:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26912.361273 secs 2024-04-26T19:16:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:39 smithi196 ceph-mon[32572]: pgmap v14601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:39 smithi110 ceph-mon[28069]: pgmap v14601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:39 smithi193 ceph-mon[32782]: pgmap v14601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:16:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:16:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:16:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:16:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:16:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:41 smithi196 ceph-mon[32572]: pgmap v14602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:16:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:16:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:41 smithi110 ceph-mon[28069]: pgmap v14602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:16:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:16:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:41 smithi193 ceph-mon[32782]: pgmap v14602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:16:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:16:42.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:42 smithi110 ceph-mon[28069]: pgmap v14603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T19:16:42.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:42 smithi110 ceph-mon[28069]: pgmap v14604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T19:16:42.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:16:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:16:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:16:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:42 smithi193 ceph-mon[32782]: pgmap v14603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T19:16:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:42 smithi193 ceph-mon[32782]: pgmap v14604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T19:16:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:16:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:16:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:16:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:42 smithi196 ceph-mon[32572]: pgmap v14603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T19:16:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:42 smithi196 ceph-mon[32572]: pgmap v14604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T19:16:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:16:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26917.361393 secs 2024-04-26T19:16:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26917.361393 secs 2024-04-26T19:16:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26917.361393 secs 2024-04-26T19:16:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:44 smithi110 ceph-mon[28069]: pgmap v14605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:44 smithi193 ceph-mon[32782]: pgmap v14605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:44 smithi196 ceph-mon[32572]: pgmap v14605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:46 smithi193 ceph-mon[32782]: pgmap v14606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:46 smithi196 ceph-mon[32572]: pgmap v14606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:46 smithi110 ceph-mon[28069]: pgmap v14606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:47 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26922.361589 secs 2024-04-26T19:16:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:47 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26922.361589 secs 2024-04-26T19:16:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:47 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26922.361589 secs 2024-04-26T19:16:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:48 smithi193 ceph-mon[32782]: pgmap v14607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:48 smithi196 ceph-mon[32572]: pgmap v14607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:48 smithi110 ceph-mon[28069]: pgmap v14607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:50 smithi193 ceph-mon[32782]: pgmap v14608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:50 smithi196 ceph-mon[32572]: pgmap v14608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:50 smithi110 ceph-mon[28069]: pgmap v14608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:52 smithi196 ceph-mon[32572]: pgmap v14609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:16:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26927.361665 secs 2024-04-26T19:16:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:52 smithi110 ceph-mon[28069]: pgmap v14609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:16:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26927.361665 secs 2024-04-26T19:16:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:52 smithi193 ceph-mon[32782]: pgmap v14609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:16:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26927.361665 secs 2024-04-26T19:16:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:54 smithi196 ceph-mon[32572]: pgmap v14610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:54 smithi110 ceph-mon[28069]: pgmap v14610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:54 smithi193 ceph-mon[32782]: pgmap v14610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:56 smithi196 ceph-mon[32572]: pgmap v14611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:56 smithi110 ceph-mon[28069]: pgmap v14611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:56 smithi193 ceph-mon[32782]: pgmap v14611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:16:57.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26932.361787 secs 2024-04-26T19:16:57.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26932.361787 secs 2024-04-26T19:16:58.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26932.361787 secs 2024-04-26T19:16:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:16:58 smithi196 ceph-mon[32572]: pgmap v14612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:16:58 smithi110 ceph-mon[28069]: pgmap v14612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:16:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:16:58 smithi193 ceph-mon[32782]: pgmap v14612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:00 smithi196 ceph-mon[32572]: pgmap v14613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:00 smithi110 ceph-mon[28069]: pgmap v14613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:00 smithi193 ceph-mon[32782]: pgmap v14613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:02 smithi196 ceph-mon[32572]: pgmap v14614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26937.361925 secs 2024-04-26T19:17:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:02 smithi110 ceph-mon[28069]: pgmap v14614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26937.361925 secs 2024-04-26T19:17:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:02 smithi193 ceph-mon[32782]: pgmap v14614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26937.361925 secs 2024-04-26T19:17:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:04 smithi196 ceph-mon[32572]: pgmap v14615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:04 smithi110 ceph-mon[28069]: pgmap v14615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:04 smithi193 ceph-mon[32782]: pgmap v14615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:06 smithi196 ceph-mon[32572]: pgmap v14616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:06 smithi110 ceph-mon[28069]: pgmap v14616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:06 smithi193 ceph-mon[32782]: pgmap v14616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26942.362040 secs 2024-04-26T19:17:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26942.362040 secs 2024-04-26T19:17:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26942.362040 secs 2024-04-26T19:17:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:08 smithi196 ceph-mon[32572]: pgmap v14617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:08 smithi110 ceph-mon[28069]: pgmap v14617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:08 smithi193 ceph-mon[32782]: pgmap v14617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:10 smithi196 ceph-mon[32572]: pgmap v14618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:10 smithi110 ceph-mon[28069]: pgmap v14618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:10 smithi193 ceph-mon[32782]: pgmap v14618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:12 smithi196 ceph-mon[32572]: pgmap v14619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26947.362112 secs 2024-04-26T19:17:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:12 smithi110 ceph-mon[28069]: pgmap v14619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26947.362112 secs 2024-04-26T19:17:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:12 smithi193 ceph-mon[32782]: pgmap v14619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26947.362112 secs 2024-04-26T19:17:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:14 smithi196 ceph-mon[32572]: pgmap v14620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:14 smithi110 ceph-mon[28069]: pgmap v14620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:14 smithi193 ceph-mon[32782]: pgmap v14620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:16 smithi196 ceph-mon[32572]: pgmap v14621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:16 smithi110 ceph-mon[28069]: pgmap v14621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:16 smithi193 ceph-mon[32782]: pgmap v14621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:17 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26952.362249 secs 2024-04-26T19:17:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:17 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26952.362249 secs 2024-04-26T19:17:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:17 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26952.362249 secs 2024-04-26T19:17:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:18 smithi196 ceph-mon[32572]: pgmap v14622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:18 smithi110 ceph-mon[28069]: pgmap v14622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:18 smithi193 ceph-mon[32782]: pgmap v14622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:20 smithi196 ceph-mon[32572]: pgmap v14623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:20 smithi110 ceph-mon[28069]: pgmap v14623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:20 smithi193 ceph-mon[32782]: pgmap v14623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:22 smithi196 ceph-mon[32572]: pgmap v14624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26957.362388 secs 2024-04-26T19:17:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:22 smithi110 ceph-mon[28069]: pgmap v14624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26957.362388 secs 2024-04-26T19:17:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:22 smithi193 ceph-mon[32782]: pgmap v14624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26957.362388 secs 2024-04-26T19:17:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:24 smithi196 ceph-mon[32572]: pgmap v14625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:24 smithi110 ceph-mon[28069]: pgmap v14625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:24 smithi193 ceph-mon[32782]: pgmap v14625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:26 smithi196 ceph-mon[32572]: pgmap v14626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:26 smithi110 ceph-mon[28069]: pgmap v14626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:26 smithi193 ceph-mon[32782]: pgmap v14626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:28.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:27 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26962.362506 secs 2024-04-26T19:17:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:27 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26962.362506 secs 2024-04-26T19:17:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:27 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26962.362506 secs 2024-04-26T19:17:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:28 smithi110 ceph-mon[28069]: pgmap v14627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:28 smithi193 ceph-mon[32782]: pgmap v14627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:28 smithi196 ceph-mon[32572]: pgmap v14627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:30 smithi110 ceph-mon[28069]: pgmap v14628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:30 smithi193 ceph-mon[32782]: pgmap v14628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:30 smithi196 ceph-mon[32572]: pgmap v14628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:32 smithi110 ceph-mon[28069]: pgmap v14629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26967.362605 secs 2024-04-26T19:17:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:32 smithi193 ceph-mon[32782]: pgmap v14629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26967.362605 secs 2024-04-26T19:17:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:32 smithi196 ceph-mon[32572]: pgmap v14629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26967.362605 secs 2024-04-26T19:17:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:34 smithi110 ceph-mon[28069]: pgmap v14630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:34 smithi193 ceph-mon[32782]: pgmap v14630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:34 smithi196 ceph-mon[32572]: pgmap v14630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:36 smithi110 ceph-mon[28069]: pgmap v14631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:36 smithi193 ceph-mon[32782]: pgmap v14631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:36 smithi196 ceph-mon[32572]: pgmap v14631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26972.362723 secs 2024-04-26T19:17:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26972.362723 secs 2024-04-26T19:17:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26972.362723 secs 2024-04-26T19:17:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:38 smithi193 ceph-mon[32782]: pgmap v14632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:38 smithi196 ceph-mon[32572]: pgmap v14632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:38 smithi110 ceph-mon[28069]: pgmap v14632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:17:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:40 smithi193 ceph-mon[32782]: pgmap v14633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:40 smithi196 ceph-mon[32572]: pgmap v14633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:41.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:40 smithi110 ceph-mon[28069]: pgmap v14633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:42 smithi193 ceph-mon[32782]: pgmap v14634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:42 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26977.362852 secs 2024-04-26T19:17:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:17:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:42 smithi196 ceph-mon[32572]: pgmap v14634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:42 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26977.362852 secs 2024-04-26T19:17:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:17:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:42 smithi110 ceph-mon[28069]: pgmap v14634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:42 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26977.362852 secs 2024-04-26T19:17:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:17:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:17:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:17:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:43 smithi193 ceph-mon[32782]: pgmap v14635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:17:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:43 smithi193 ceph-mon[32782]: pgmap v14636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:17:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:17:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:43 smithi196 ceph-mon[32572]: pgmap v14635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:17:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:43 smithi196 ceph-mon[32572]: pgmap v14636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:17:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:17:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:43 smithi110 ceph-mon[28069]: pgmap v14635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:17:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:43 smithi110 ceph-mon[28069]: pgmap v14636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:17:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:46 smithi196 ceph-mon[32572]: pgmap v14637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:46 smithi110 ceph-mon[28069]: pgmap v14637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:46 smithi193 ceph-mon[32782]: pgmap v14637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26982.362980 secs 2024-04-26T19:17:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:48 smithi196 ceph-mon[32572]: pgmap v14638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T19:17:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26982.362980 secs 2024-04-26T19:17:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:48 smithi110 ceph-mon[28069]: pgmap v14638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T19:17:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26982.362980 secs 2024-04-26T19:17:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:48 smithi193 ceph-mon[32782]: pgmap v14638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T19:17:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:50 smithi196 ceph-mon[32572]: pgmap v14639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:50 smithi110 ceph-mon[28069]: pgmap v14639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:50 smithi193 ceph-mon[32782]: pgmap v14639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:52 smithi196 ceph-mon[32572]: pgmap v14640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:52 smithi110 ceph-mon[28069]: pgmap v14640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:52 smithi193 ceph-mon[32782]: pgmap v14640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:17:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26987.363098 secs 2024-04-26T19:17:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26987.363098 secs 2024-04-26T19:17:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26987.363098 secs 2024-04-26T19:17:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:54 smithi196 ceph-mon[32572]: pgmap v14641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:17:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:54 smithi110 ceph-mon[28069]: pgmap v14641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:17:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:54 smithi193 ceph-mon[32782]: pgmap v14641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:17:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:55 smithi196 ceph-mon[32572]: pgmap v14642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:55 smithi110 ceph-mon[28069]: pgmap v14642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:55 smithi193 ceph-mon[32782]: pgmap v14642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26992.363218 secs 2024-04-26T19:17:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:17:58 smithi196 ceph-mon[32572]: pgmap v14643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26992.363218 secs 2024-04-26T19:17:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:17:58 smithi110 ceph-mon[28069]: pgmap v14643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:17:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26992.363218 secs 2024-04-26T19:17:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:17:58 smithi193 ceph-mon[32782]: pgmap v14643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:00 smithi196 ceph-mon[32572]: pgmap v14644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:00.507 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:00 smithi193 ceph-mon[32782]: pgmap v14644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:00 smithi110 ceph-mon[28069]: pgmap v14644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:02 smithi196 ceph-mon[32572]: pgmap v14645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:02 smithi110 ceph-mon[28069]: pgmap v14645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:02 smithi193 ceph-mon[32782]: pgmap v14645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 26997.363373 secs 2024-04-26T19:18:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 26997.363373 secs 2024-04-26T19:18:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 26997.363373 secs 2024-04-26T19:18:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:04 smithi196 ceph-mon[32572]: pgmap v14646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:04 smithi110 ceph-mon[28069]: pgmap v14646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:04 smithi193 ceph-mon[32782]: pgmap v14646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:05 smithi196 ceph-mon[32572]: pgmap v14647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:05 smithi110 ceph-mon[28069]: pgmap v14647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:05 smithi193 ceph-mon[32782]: pgmap v14647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27002.363524 secs 2024-04-26T19:18:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:08 smithi196 ceph-mon[32572]: pgmap v14648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27002.363524 secs 2024-04-26T19:18:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:08 smithi110 ceph-mon[28069]: pgmap v14648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27002.363524 secs 2024-04-26T19:18:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:08 smithi193 ceph-mon[32782]: pgmap v14648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:09 smithi196 ceph-mon[32572]: pgmap v14649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:10.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:09 smithi110 ceph-mon[28069]: pgmap v14649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:09 smithi193 ceph-mon[32782]: pgmap v14649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:12 smithi196 ceph-mon[32572]: pgmap v14650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:12 smithi110 ceph-mon[28069]: pgmap v14650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:12 smithi193 ceph-mon[32782]: pgmap v14650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27007.363676 secs 2024-04-26T19:18:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27007.363676 secs 2024-04-26T19:18:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27007.363676 secs 2024-04-26T19:18:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:14 smithi196 ceph-mon[32572]: pgmap v14651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:14 smithi110 ceph-mon[28069]: pgmap v14651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:14 smithi193 ceph-mon[32782]: pgmap v14651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:15 smithi196 ceph-mon[32572]: pgmap v14652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:15 smithi110 ceph-mon[28069]: pgmap v14652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:15 smithi193 ceph-mon[32782]: pgmap v14652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.451+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T19:18:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.451+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T19:18:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.451+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:18:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.451+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T19:18:16.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.452+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:18:16.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.453+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T19:18:16.452 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.453+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T19:18:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.455+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T19:18:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.455+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T19:18:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.455+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:18:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.455+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).stop 2024-04-26T19:18:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.455+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T19:18:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.455+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T19:18:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.455+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T19:18:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.455+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T19:18:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.456+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:18:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:16.457+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e070 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T19:18:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27012.363794 secs 2024-04-26T19:18:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:18 smithi196 ceph-mon[32572]: pgmap v14653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27012.363794 secs 2024-04-26T19:18:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:18 smithi110 ceph-mon[28069]: pgmap v14653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27012.363794 secs 2024-04-26T19:18:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:18 smithi193 ceph-mon[32782]: pgmap v14653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:20 smithi196 ceph-mon[32572]: pgmap v14654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:20 smithi110 ceph-mon[28069]: pgmap v14654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:20 smithi193 ceph-mon[32782]: pgmap v14654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:20.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:20.838+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:18:20.838 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:20.838+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:18:20.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:20.839+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 209 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:18:20.839 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:18:20.839+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 209 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:18:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:22 smithi196 ceph-mon[32572]: pgmap v14655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:22 smithi110 ceph-mon[28069]: pgmap v14655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:22 smithi193 ceph-mon[32782]: pgmap v14655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27017.363906 secs 2024-04-26T19:18:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:23 smithi196 ceph-mon[32572]: pgmap v14656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27017.363906 secs 2024-04-26T19:18:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:23 smithi110 ceph-mon[28069]: pgmap v14656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27017.363906 secs 2024-04-26T19:18:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:23 smithi193 ceph-mon[32782]: pgmap v14656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:26 smithi196 ceph-mon[32572]: pgmap v14657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:26 smithi110 ceph-mon[28069]: pgmap v14657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:26 smithi193 ceph-mon[32782]: pgmap v14657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27022.364022 secs 2024-04-26T19:18:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:28 smithi196 ceph-mon[32572]: pgmap v14658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27022.364022 secs 2024-04-26T19:18:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:28 smithi110 ceph-mon[28069]: pgmap v14658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27022.364022 secs 2024-04-26T19:18:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:28 smithi193 ceph-mon[32782]: pgmap v14658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:29 smithi196 ceph-mon[32572]: pgmap v14659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:29 smithi110 ceph-mon[28069]: pgmap v14659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:29 smithi193 ceph-mon[32782]: pgmap v14659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:32 smithi196 ceph-mon[32572]: pgmap v14660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:32 smithi110 ceph-mon[28069]: pgmap v14660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:32 smithi193 ceph-mon[32782]: pgmap v14660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27027.364140 secs 2024-04-26T19:18:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27027.364140 secs 2024-04-26T19:18:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27027.364140 secs 2024-04-26T19:18:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:34 smithi196 ceph-mon[32572]: pgmap v14661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:34 smithi110 ceph-mon[28069]: pgmap v14661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:34 smithi193 ceph-mon[32782]: pgmap v14661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:35 smithi196 ceph-mon[32572]: pgmap v14662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:35 smithi110 ceph-mon[28069]: pgmap v14662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:35 smithi193 ceph-mon[32782]: pgmap v14662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27032.364249 secs 2024-04-26T19:18:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:38 smithi196 ceph-mon[32572]: pgmap v14663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27032.364249 secs 2024-04-26T19:18:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:38 smithi110 ceph-mon[28069]: pgmap v14663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27032.364249 secs 2024-04-26T19:18:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:38 smithi193 ceph-mon[32782]: pgmap v14663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:39 smithi196 ceph-mon[32572]: pgmap v14664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:39 smithi110 ceph-mon[28069]: pgmap v14664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:39 smithi193 ceph-mon[32782]: pgmap v14664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:42 smithi196 ceph-mon[32572]: pgmap v14665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:42 smithi110 ceph-mon[28069]: pgmap v14665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:42 smithi193 ceph-mon[32782]: pgmap v14665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27037.364383 secs 2024-04-26T19:18:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:43 smithi196 ceph-mon[32572]: pgmap v14666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27037.364383 secs 2024-04-26T19:18:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:43 smithi110 ceph-mon[28069]: pgmap v14666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27037.364383 secs 2024-04-26T19:18:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:43 smithi193 ceph-mon[32782]: pgmap v14666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:18:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:18:44.530 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:18:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:18:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:45 smithi196 ceph-mon[32572]: pgmap v14667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:45 smithi110 ceph-mon[28069]: pgmap v14667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:45 smithi193 ceph-mon[32782]: pgmap v14667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:47 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:18:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:47 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:18:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:47 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:18:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:47 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:18:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:47 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27042.364517 secs 2024-04-26T19:18:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:47 smithi193 ceph-mon[32782]: pgmap v14668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:47 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:18:48.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:47 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:18:48.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:47 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:18:48.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:47 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:18:48.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:47 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27042.364517 secs 2024-04-26T19:18:48.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:47 smithi196 ceph-mon[32572]: pgmap v14668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:48.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:48.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:47 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:18:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:47 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:18:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:47 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:18:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:47 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:18:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:47 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27042.364517 secs 2024-04-26T19:18:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:47 smithi110 ceph-mon[28069]: pgmap v14668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:18:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:18:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:18:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:18:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:18:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:18:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:18:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:18:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:49 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:18:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:49 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:18:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:49 smithi196 ceph-mon[32572]: pgmap v14669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:18:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:49 smithi196 ceph-mon[32572]: pgmap v14670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:49 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:18:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:49 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:18:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:49 smithi110 ceph-mon[28069]: pgmap v14669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:18:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:49 smithi110 ceph-mon[28069]: pgmap v14670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:49 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:18:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:49 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:18:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:49 smithi193 ceph-mon[32782]: pgmap v14669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:18:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:49 smithi193 ceph-mon[32782]: pgmap v14670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:51 smithi110 ceph-mon[28069]: pgmap v14671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:51 smithi193 ceph-mon[32782]: pgmap v14671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:51 smithi196 ceph-mon[32572]: pgmap v14671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:52.770 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27047.364638 secs 2024-04-26T19:18:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27047.364638 secs 2024-04-26T19:18:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27047.364638 secs 2024-04-26T19:18:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:53 smithi110 ceph-mon[28069]: pgmap v14672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:53 smithi193 ceph-mon[32782]: pgmap v14672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:53 smithi196 ceph-mon[32572]: pgmap v14672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:55 smithi110 ceph-mon[28069]: pgmap v14673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:55 smithi193 ceph-mon[32782]: pgmap v14673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:55 smithi196 ceph-mon[32572]: pgmap v14673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27052.364771 secs 2024-04-26T19:18:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:57 smithi110 ceph-mon[28069]: pgmap v14674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:58.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27052.364771 secs 2024-04-26T19:18:58.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:57 smithi196 ceph-mon[32572]: pgmap v14674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:18:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27052.364771 secs 2024-04-26T19:18:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:57 smithi193 ceph-mon[32782]: pgmap v14674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:18:59 smithi110 ceph-mon[28069]: pgmap v14675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:19:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:18:59 smithi193 ceph-mon[32782]: pgmap v14675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:19:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:18:59 smithi196 ceph-mon[32572]: pgmap v14675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:19:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:01 smithi193 ceph-mon[32782]: pgmap v14676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:01 smithi196 ceph-mon[32572]: pgmap v14676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:01 smithi110 ceph-mon[28069]: pgmap v14676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27057.364892 secs 2024-04-26T19:19:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27057.364892 secs 2024-04-26T19:19:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27057.364892 secs 2024-04-26T19:19:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:03 smithi193 ceph-mon[32782]: pgmap v14677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:03 smithi196 ceph-mon[32572]: pgmap v14677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:03 smithi110 ceph-mon[28069]: pgmap v14677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:05 smithi193 ceph-mon[32782]: pgmap v14678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:05 smithi196 ceph-mon[32572]: pgmap v14678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:05 smithi110 ceph-mon[28069]: pgmap v14678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27062.365009 secs 2024-04-26T19:19:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:07 smithi193 ceph-mon[32782]: pgmap v14679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27062.365009 secs 2024-04-26T19:19:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:07 smithi196 ceph-mon[32572]: pgmap v14679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27062.365009 secs 2024-04-26T19:19:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:07 smithi110 ceph-mon[28069]: pgmap v14679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:09 smithi193 ceph-mon[32782]: pgmap v14680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:09 smithi196 ceph-mon[32572]: pgmap v14680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:09 smithi110 ceph-mon[28069]: pgmap v14680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:11 smithi110 ceph-mon[28069]: pgmap v14681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:11 smithi193 ceph-mon[32782]: pgmap v14681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:11 smithi196 ceph-mon[32572]: pgmap v14681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27067.365130 secs 2024-04-26T19:19:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27067.365130 secs 2024-04-26T19:19:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27067.365130 secs 2024-04-26T19:19:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:19:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:19:13.325+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:19:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:19:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:19:13.325+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:19:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:19:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:19:13.325+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:19:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:19:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:19:13.325+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:19:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:19:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:19:13.325+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:19:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:13 smithi193 ceph-mon[32782]: pgmap v14682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:13 smithi196 ceph-mon[32572]: pgmap v14682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:13 smithi110 ceph-mon[28069]: pgmap v14682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:15 smithi193 ceph-mon[32782]: pgmap v14683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:15 smithi196 ceph-mon[32572]: pgmap v14683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:15 smithi110 ceph-mon[28069]: pgmap v14683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:17 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27072.365249 secs 2024-04-26T19:19:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:17 smithi193 ceph-mon[32782]: pgmap v14684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:17 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27072.365249 secs 2024-04-26T19:19:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:17 smithi196 ceph-mon[32572]: pgmap v14684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:17 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27072.365249 secs 2024-04-26T19:19:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:17 smithi110 ceph-mon[28069]: pgmap v14684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:19 smithi193 ceph-mon[32782]: pgmap v14685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:19 smithi196 ceph-mon[32572]: pgmap v14685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:19 smithi110 ceph-mon[28069]: pgmap v14685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:21 smithi193 ceph-mon[32782]: pgmap v14686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:21 smithi196 ceph-mon[32572]: pgmap v14686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:21 smithi110 ceph-mon[28069]: pgmap v14686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27077.365370 secs 2024-04-26T19:19:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27077.365370 secs 2024-04-26T19:19:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27077.365370 secs 2024-04-26T19:19:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:23 smithi196 ceph-mon[32572]: pgmap v14687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:23 smithi110 ceph-mon[28069]: pgmap v14687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:23 smithi193 ceph-mon[32782]: pgmap v14687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:25 smithi196 ceph-mon[32572]: pgmap v14688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:25 smithi110 ceph-mon[28069]: pgmap v14688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:25 smithi193 ceph-mon[32782]: pgmap v14688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:27 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27082.365487 secs 2024-04-26T19:19:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:27 smithi196 ceph-mon[32572]: pgmap v14689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:27 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27082.365487 secs 2024-04-26T19:19:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:27 smithi110 ceph-mon[28069]: pgmap v14689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:27 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27082.365487 secs 2024-04-26T19:19:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:27 smithi193 ceph-mon[32782]: pgmap v14689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:30.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:29 smithi193 ceph-mon[32782]: pgmap v14690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:29 smithi196 ceph-mon[32572]: pgmap v14690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:29 smithi110 ceph-mon[28069]: pgmap v14690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:31 smithi196 ceph-mon[32572]: pgmap v14691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:31 smithi110 ceph-mon[28069]: pgmap v14691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:31 smithi193 ceph-mon[32782]: pgmap v14691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27087.365626 secs 2024-04-26T19:19:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27087.365626 secs 2024-04-26T19:19:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27087.365626 secs 2024-04-26T19:19:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:33 smithi196 ceph-mon[32572]: pgmap v14692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:33 smithi110 ceph-mon[28069]: pgmap v14692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:33 smithi193 ceph-mon[32782]: pgmap v14692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:35 smithi196 ceph-mon[32572]: pgmap v14693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:35 smithi110 ceph-mon[28069]: pgmap v14693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:35 smithi193 ceph-mon[32782]: pgmap v14693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27092.365746 secs 2024-04-26T19:19:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:37 smithi196 ceph-mon[32572]: pgmap v14694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27092.365746 secs 2024-04-26T19:19:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:37 smithi110 ceph-mon[28069]: pgmap v14694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27092.365746 secs 2024-04-26T19:19:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:37 smithi193 ceph-mon[32782]: pgmap v14694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:39 smithi196 ceph-mon[32572]: pgmap v14695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:39 smithi110 ceph-mon[28069]: pgmap v14695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:39 smithi193 ceph-mon[32782]: pgmap v14695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:41 smithi196 ceph-mon[32572]: pgmap v14696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:41 smithi110 ceph-mon[28069]: pgmap v14696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:41 smithi193 ceph-mon[32782]: pgmap v14696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:42 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27097.365870 secs 2024-04-26T19:19:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:42 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27097.365870 secs 2024-04-26T19:19:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:42 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27097.365870 secs 2024-04-26T19:19:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:43 smithi196 ceph-mon[32572]: pgmap v14697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:43 smithi110 ceph-mon[28069]: pgmap v14697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:43 smithi193 ceph-mon[32782]: pgmap v14697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:45 smithi196 ceph-mon[32572]: pgmap v14698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:45 smithi110 ceph-mon[28069]: pgmap v14698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:45 smithi193 ceph-mon[32782]: pgmap v14698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:47 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27102.365991 secs 2024-04-26T19:19:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:47 smithi196 ceph-mon[32572]: pgmap v14699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:47 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27102.365991 secs 2024-04-26T19:19:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:47 smithi110 ceph-mon[28069]: pgmap v14699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:47 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27102.365991 secs 2024-04-26T19:19:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:47 smithi193 ceph-mon[32782]: pgmap v14699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:19:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:49 smithi196 ceph-mon[32572]: pgmap v14700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:19:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:49 smithi110 ceph-mon[28069]: pgmap v14700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:19:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:49 smithi193 ceph-mon[32782]: pgmap v14700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:19:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:19:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:19:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:19:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:19:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:19:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:19:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:19:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:19:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:19:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:19:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:51 smithi196 ceph-mon[32572]: pgmap v14701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T19:19:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:51 smithi196 ceph-mon[32572]: pgmap v14702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:51 smithi110 ceph-mon[28069]: pgmap v14701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T19:19:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:51 smithi110 ceph-mon[28069]: pgmap v14702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:51 smithi193 ceph-mon[32782]: pgmap v14701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T19:19:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:51 smithi193 ceph-mon[32782]: pgmap v14702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27107.366108 secs 2024-04-26T19:19:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27107.366108 secs 2024-04-26T19:19:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27107.366108 secs 2024-04-26T19:19:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:53 smithi196 ceph-mon[32572]: pgmap v14703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:19:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:53 smithi110 ceph-mon[28069]: pgmap v14703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:19:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:53 smithi193 ceph-mon[32782]: pgmap v14703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:19:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:55 smithi196 ceph-mon[32572]: pgmap v14704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:55 smithi110 ceph-mon[28069]: pgmap v14704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:55 smithi193 ceph-mon[32782]: pgmap v14704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:57 smithi196 ceph-mon[32572]: pgmap v14705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27112.366244 secs 2024-04-26T19:19:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:57 smithi110 ceph-mon[28069]: pgmap v14705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27112.366244 secs 2024-04-26T19:19:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:57 smithi193 ceph-mon[32782]: pgmap v14705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:19:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27112.366244 secs 2024-04-26T19:20:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:19:59 smithi196 ceph-mon[32572]: pgmap v14706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:20:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:19:59 smithi110 ceph-mon[28069]: pgmap v14706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:20:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:19:59 smithi193 ceph-mon[32782]: pgmap v14706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:20:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:01 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:20:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:01 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:20:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:01 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:20:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:02 smithi110 ceph-mon[28069]: pgmap v14707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:20:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:02 smithi193 ceph-mon[32782]: pgmap v14707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:20:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:02 smithi196 ceph-mon[32572]: pgmap v14707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:20:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27117.366314 secs 2024-04-26T19:20:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27117.366314 secs 2024-04-26T19:20:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27117.366314 secs 2024-04-26T19:20:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:04 smithi110 ceph-mon[28069]: pgmap v14708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:04 smithi193 ceph-mon[32782]: pgmap v14708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:04 smithi196 ceph-mon[32572]: pgmap v14708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:06 smithi110 ceph-mon[28069]: pgmap v14709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:06 smithi193 ceph-mon[32782]: pgmap v14709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:06 smithi196 ceph-mon[32572]: pgmap v14709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:08 smithi110 ceph-mon[28069]: pgmap v14710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27122.366404 secs 2024-04-26T19:20:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:08 smithi193 ceph-mon[32782]: pgmap v14710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27122.366404 secs 2024-04-26T19:20:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:08 smithi196 ceph-mon[32572]: pgmap v14710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27122.366404 secs 2024-04-26T19:20:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:10 smithi110 ceph-mon[28069]: pgmap v14711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:10 smithi193 ceph-mon[32782]: pgmap v14711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:10 smithi196 ceph-mon[32572]: pgmap v14711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:12 smithi193 ceph-mon[32782]: pgmap v14712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:12 smithi196 ceph-mon[32572]: pgmap v14712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:12 smithi110 ceph-mon[28069]: pgmap v14712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27127.366550 secs 2024-04-26T19:20:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27127.366550 secs 2024-04-26T19:20:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27127.366550 secs 2024-04-26T19:20:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:14 smithi193 ceph-mon[32782]: pgmap v14713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:14 smithi196 ceph-mon[32572]: pgmap v14713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:14 smithi110 ceph-mon[28069]: pgmap v14713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:16 smithi193 ceph-mon[32782]: pgmap v14714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:16 smithi196 ceph-mon[32572]: pgmap v14714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:16 smithi110 ceph-mon[28069]: pgmap v14714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:18 smithi193 ceph-mon[32782]: pgmap v14715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27132.366666 secs 2024-04-26T19:20:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:18 smithi196 ceph-mon[32572]: pgmap v14715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27132.366666 secs 2024-04-26T19:20:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:18 smithi110 ceph-mon[28069]: pgmap v14715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27132.366666 secs 2024-04-26T19:20:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:20 smithi193 ceph-mon[32782]: pgmap v14716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:20 smithi196 ceph-mon[32572]: pgmap v14716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:20 smithi110 ceph-mon[28069]: pgmap v14716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:22 smithi193 ceph-mon[32782]: pgmap v14717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:22 smithi196 ceph-mon[32572]: pgmap v14717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:22 smithi110 ceph-mon[28069]: pgmap v14717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27137.366732 secs 2024-04-26T19:20:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27137.366732 secs 2024-04-26T19:20:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27137.366732 secs 2024-04-26T19:20:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:24 smithi193 ceph-mon[32782]: pgmap v14718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:24 smithi196 ceph-mon[32572]: pgmap v14718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:24 smithi110 ceph-mon[28069]: pgmap v14718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:26 smithi193 ceph-mon[32782]: pgmap v14719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:26 smithi196 ceph-mon[32572]: pgmap v14719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:26 smithi110 ceph-mon[28069]: pgmap v14719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:28 smithi193 ceph-mon[32782]: pgmap v14720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27142.366858 secs 2024-04-26T19:20:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:28 smithi196 ceph-mon[32572]: pgmap v14720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27142.366858 secs 2024-04-26T19:20:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:28 smithi110 ceph-mon[28069]: pgmap v14720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27142.366858 secs 2024-04-26T19:20:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:30 smithi193 ceph-mon[32782]: pgmap v14721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:30.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:30 smithi196 ceph-mon[32572]: pgmap v14721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:30 smithi110 ceph-mon[28069]: pgmap v14721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:32 smithi193 ceph-mon[32782]: pgmap v14722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:32 smithi196 ceph-mon[32572]: pgmap v14722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:32 smithi110 ceph-mon[28069]: pgmap v14722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27147.366977 secs 2024-04-26T19:20:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27147.366977 secs 2024-04-26T19:20:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27147.366977 secs 2024-04-26T19:20:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:34 smithi193 ceph-mon[32782]: pgmap v14723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:34 smithi196 ceph-mon[32572]: pgmap v14723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:34 smithi110 ceph-mon[28069]: pgmap v14723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:36 smithi196 ceph-mon[32572]: pgmap v14724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:36 smithi110 ceph-mon[28069]: pgmap v14724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:36 smithi193 ceph-mon[32782]: pgmap v14724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:38 smithi196 ceph-mon[32572]: pgmap v14725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27152.367099 secs 2024-04-26T19:20:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:38 smithi110 ceph-mon[28069]: pgmap v14725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27152.367099 secs 2024-04-26T19:20:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:38 smithi193 ceph-mon[32782]: pgmap v14725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27152.367099 secs 2024-04-26T19:20:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:40 smithi196 ceph-mon[32572]: pgmap v14726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:40 smithi110 ceph-mon[28069]: pgmap v14726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:40 smithi193 ceph-mon[32782]: pgmap v14726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:42 smithi196 ceph-mon[32572]: pgmap v14727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:42 smithi110 ceph-mon[28069]: pgmap v14727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:42 smithi193 ceph-mon[32782]: pgmap v14727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27157.367235 secs 2024-04-26T19:20:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27157.367235 secs 2024-04-26T19:20:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27157.367235 secs 2024-04-26T19:20:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:44 smithi196 ceph-mon[32572]: pgmap v14728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:44 smithi110 ceph-mon[28069]: pgmap v14728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:44 smithi193 ceph-mon[32782]: pgmap v14728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:46 smithi196 ceph-mon[32572]: pgmap v14729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:46 smithi110 ceph-mon[28069]: pgmap v14729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:46 smithi193 ceph-mon[32782]: pgmap v14729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:20:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:48 smithi196 ceph-mon[32572]: pgmap v14730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27162.367373 secs 2024-04-26T19:20:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:48 smithi110 ceph-mon[28069]: pgmap v14730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27162.367373 secs 2024-04-26T19:20:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:48 smithi193 ceph-mon[32782]: pgmap v14730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27162.367373 secs 2024-04-26T19:20:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:50 smithi196 ceph-mon[32572]: pgmap v14731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:50 smithi110 ceph-mon[28069]: pgmap v14731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:50 smithi193 ceph-mon[32782]: pgmap v14731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:20:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:20:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:20:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:20:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:52 smithi196 ceph-mon[32572]: pgmap v14732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:20:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:20:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:20:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:52 smithi110 ceph-mon[28069]: pgmap v14732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:20:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:20:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:20:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:52 smithi193 ceph-mon[32782]: pgmap v14732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:20:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:20:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:20:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:20:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27167.367434 secs 2024-04-26T19:20:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:53 smithi196 ceph-mon[32572]: pgmap v14733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T19:20:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:53 smithi196 ceph-mon[32572]: pgmap v14734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:20:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27167.367434 secs 2024-04-26T19:20:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:53 smithi110 ceph-mon[28069]: pgmap v14733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T19:20:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:53 smithi110 ceph-mon[28069]: pgmap v14734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:20:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27167.367434 secs 2024-04-26T19:20:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:53 smithi193 ceph-mon[32782]: pgmap v14733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T19:20:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:53 smithi193 ceph-mon[32782]: pgmap v14734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:20:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:55 smithi196 ceph-mon[32572]: pgmap v14735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:55 smithi110 ceph-mon[28069]: pgmap v14735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:55 smithi193 ceph-mon[32782]: pgmap v14735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:56 smithi196 ceph-mon[32572]: pgmap v14736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:56 smithi110 ceph-mon[28069]: pgmap v14736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:56 smithi193 ceph-mon[32782]: pgmap v14736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27172.367554 secs 2024-04-26T19:20:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27172.367554 secs 2024-04-26T19:20:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27172.367554 secs 2024-04-26T19:20:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:20:58 smithi193 ceph-mon[32782]: pgmap v14737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:58.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:20:58 smithi196 ceph-mon[32572]: pgmap v14737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:20:58 smithi110 ceph-mon[28069]: pgmap v14737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:01.325 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:01 smithi193 ceph-mon[32782]: pgmap v14738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:01.494 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:01 smithi110 ceph-mon[28069]: pgmap v14738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:01 smithi196 ceph-mon[32572]: pgmap v14738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27177.367666 secs 2024-04-26T19:21:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:03 smithi193 ceph-mon[32782]: pgmap v14739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:21:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27177.367666 secs 2024-04-26T19:21:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:03 smithi196 ceph-mon[32572]: pgmap v14739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:21:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27177.367666 secs 2024-04-26T19:21:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:03 smithi110 ceph-mon[28069]: pgmap v14739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:21:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:05 smithi193 ceph-mon[32782]: pgmap v14740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:05 smithi196 ceph-mon[32572]: pgmap v14740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:05 smithi110 ceph-mon[28069]: pgmap v14740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:07 smithi193 ceph-mon[32782]: pgmap v14741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:07 smithi196 ceph-mon[32572]: pgmap v14741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:07 smithi110 ceph-mon[28069]: pgmap v14741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27182.367804 secs 2024-04-26T19:21:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27182.367804 secs 2024-04-26T19:21:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27182.367804 secs 2024-04-26T19:21:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:09 smithi193 ceph-mon[32782]: pgmap v14742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:09 smithi196 ceph-mon[32572]: pgmap v14742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:09 smithi110 ceph-mon[28069]: pgmap v14742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:11 smithi193 ceph-mon[32782]: pgmap v14743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:11 smithi196 ceph-mon[32572]: pgmap v14743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:11 smithi110 ceph-mon[28069]: pgmap v14743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:13 smithi193 ceph-mon[32782]: 22 slow requests, 1 included below; oldest blocked for > 27187.367903 secs 2024-04-26T19:21:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:13 smithi193 ceph-mon[32782]: slow request 11523.753728 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:21:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:13 smithi193 ceph-mon[32782]: pgmap v14744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:13 smithi196 ceph-mon[32572]: 22 slow requests, 1 included below; oldest blocked for > 27187.367903 secs 2024-04-26T19:21:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:13 smithi196 ceph-mon[32572]: slow request 11523.753728 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:21:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:13 smithi196 ceph-mon[32572]: pgmap v14744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:13 smithi110 ceph-mon[28069]: 22 slow requests, 1 included below; oldest blocked for > 27187.367903 secs 2024-04-26T19:21:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:13 smithi110 ceph-mon[28069]: slow request 11523.753728 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:21:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:13 smithi110 ceph-mon[28069]: pgmap v14744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:15 smithi193 ceph-mon[32782]: pgmap v14745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:15 smithi196 ceph-mon[32572]: pgmap v14745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:15 smithi110 ceph-mon[28069]: pgmap v14745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:17 smithi193 ceph-mon[32782]: pgmap v14746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:17 smithi196 ceph-mon[32572]: pgmap v14746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:17 smithi110 ceph-mon[28069]: pgmap v14746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:18 smithi193 ceph-mon[32782]: 22 slow requests, 1 included below; oldest blocked for > 27192.367982 secs 2024-04-26T19:21:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:18 smithi193 ceph-mon[32782]: slow request 723.629596 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:21:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:18 smithi196 ceph-mon[32572]: 22 slow requests, 1 included below; oldest blocked for > 27192.367982 secs 2024-04-26T19:21:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:18 smithi196 ceph-mon[32572]: slow request 723.629596 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:21:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:18 smithi110 ceph-mon[28069]: 22 slow requests, 1 included below; oldest blocked for > 27192.367982 secs 2024-04-26T19:21:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:18 smithi110 ceph-mon[28069]: slow request 723.629596 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:21:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:19 smithi196 ceph-mon[32572]: pgmap v14747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:19 smithi110 ceph-mon[28069]: pgmap v14747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:19 smithi193 ceph-mon[32782]: pgmap v14747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:21:20.868+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:21:20.868 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:21:20.868+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:21:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:21:20.869+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 210 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:21:20.869 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:21:20.869+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 210 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:21:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:21 smithi196 ceph-mon[32572]: pgmap v14748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:21 smithi110 ceph-mon[28069]: pgmap v14748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:21 smithi193 ceph-mon[32782]: pgmap v14748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27197.368099 secs 2024-04-26T19:21:23.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:23 smithi196 ceph-mon[32572]: pgmap v14749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27197.368099 secs 2024-04-26T19:21:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:23 smithi110 ceph-mon[28069]: pgmap v14749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27197.368099 secs 2024-04-26T19:21:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:23 smithi193 ceph-mon[32782]: pgmap v14749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:25 smithi196 ceph-mon[32572]: pgmap v14750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:25 smithi110 ceph-mon[28069]: pgmap v14750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:25 smithi193 ceph-mon[32782]: pgmap v14750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:27 smithi196 ceph-mon[32572]: pgmap v14751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:27 smithi110 ceph-mon[28069]: pgmap v14751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:27 smithi193 ceph-mon[32782]: pgmap v14751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:28.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27202.368214 secs 2024-04-26T19:21:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27202.368214 secs 2024-04-26T19:21:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27202.368214 secs 2024-04-26T19:21:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:29 smithi196 ceph-mon[32572]: pgmap v14752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:29 smithi110 ceph-mon[28069]: pgmap v14752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:29 smithi193 ceph-mon[32782]: pgmap v14752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:31.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:31 smithi193 ceph-mon[32782]: pgmap v14753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:31 smithi196 ceph-mon[32572]: pgmap v14753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:31 smithi110 ceph-mon[28069]: pgmap v14753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27207.368351 secs 2024-04-26T19:21:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:33 smithi196 ceph-mon[32572]: pgmap v14754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27207.368351 secs 2024-04-26T19:21:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:33 smithi110 ceph-mon[28069]: pgmap v14754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27207.368351 secs 2024-04-26T19:21:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:33 smithi193 ceph-mon[32782]: pgmap v14754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:35 smithi196 ceph-mon[32572]: pgmap v14755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:35 smithi110 ceph-mon[28069]: pgmap v14755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:35 smithi193 ceph-mon[32782]: pgmap v14755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:37 smithi196 ceph-mon[32572]: pgmap v14756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:37 smithi110 ceph-mon[28069]: pgmap v14756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:37 smithi193 ceph-mon[32782]: pgmap v14756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27212.368414 secs 2024-04-26T19:21:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27212.368414 secs 2024-04-26T19:21:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27212.368414 secs 2024-04-26T19:21:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:39 smithi196 ceph-mon[32572]: pgmap v14757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:39 smithi110 ceph-mon[28069]: pgmap v14757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:39 smithi193 ceph-mon[32782]: pgmap v14757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:41 smithi196 ceph-mon[32572]: pgmap v14758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:41 smithi110 ceph-mon[28069]: pgmap v14758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:41 smithi193 ceph-mon[32782]: pgmap v14758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27217.368557 secs 2024-04-26T19:21:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:43 smithi196 ceph-mon[32572]: pgmap v14759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27217.368557 secs 2024-04-26T19:21:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:43 smithi110 ceph-mon[28069]: pgmap v14759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27217.368557 secs 2024-04-26T19:21:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:43 smithi193 ceph-mon[32782]: pgmap v14759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:45 smithi196 ceph-mon[32572]: pgmap v14760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:45 smithi110 ceph-mon[28069]: pgmap v14760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:45 smithi193 ceph-mon[32782]: pgmap v14760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:47 smithi196 ceph-mon[32572]: pgmap v14761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:47 smithi110 ceph-mon[28069]: pgmap v14761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:47 smithi193 ceph-mon[32782]: pgmap v14761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27222.368654 secs 2024-04-26T19:21:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27222.368654 secs 2024-04-26T19:21:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27222.368654 secs 2024-04-26T19:21:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:49 smithi196 ceph-mon[32572]: pgmap v14762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:49 smithi110 ceph-mon[28069]: pgmap v14762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:49 smithi193 ceph-mon[32782]: pgmap v14762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:21:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:50 smithi196 ceph-mon[32572]: pgmap v14763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:50 smithi110 ceph-mon[28069]: pgmap v14763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:50 smithi193 ceph-mon[32782]: pgmap v14763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27227.368765 secs 2024-04-26T19:21:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:52 smithi196 ceph-mon[32572]: pgmap v14764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:21:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27227.368765 secs 2024-04-26T19:21:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:52 smithi110 ceph-mon[28069]: pgmap v14764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:21:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27227.368765 secs 2024-04-26T19:21:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:52 smithi193 ceph-mon[32782]: pgmap v14764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:21:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:21:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:21:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:21:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:21:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:21:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:21:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:21:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:21:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:21:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:21:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:54 smithi196 ceph-mon[32572]: pgmap v14765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:21:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:54 smithi196 ceph-mon[32572]: pgmap v14766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:54 smithi110 ceph-mon[28069]: pgmap v14765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:21:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:54 smithi110 ceph-mon[28069]: pgmap v14766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:54 smithi193 ceph-mon[32782]: pgmap v14765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:21:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:54 smithi193 ceph-mon[32782]: pgmap v14766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:56 smithi196 ceph-mon[32572]: pgmap v14767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:56 smithi110 ceph-mon[28069]: pgmap v14767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:56 smithi193 ceph-mon[32782]: pgmap v14767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:21:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27232.368886 secs 2024-04-26T19:21:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27232.368886 secs 2024-04-26T19:21:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27232.368886 secs 2024-04-26T19:21:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:21:58 smithi196 ceph-mon[32572]: pgmap v14768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:21:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:21:58 smithi110 ceph-mon[28069]: pgmap v14768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:21:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:21:58 smithi193 ceph-mon[32782]: pgmap v14768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:22:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:00 smithi196 ceph-mon[32572]: pgmap v14769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:22:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:00 smithi110 ceph-mon[28069]: pgmap v14769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:22:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:00 smithi193 ceph-mon[32782]: pgmap v14769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:22:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:02 smithi196 ceph-mon[32572]: pgmap v14770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:22:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27237.368995 secs 2024-04-26T19:22:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:02 smithi110 ceph-mon[28069]: pgmap v14770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:22:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27237.368995 secs 2024-04-26T19:22:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:02 smithi193 ceph-mon[32782]: pgmap v14770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:22:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27237.368995 secs 2024-04-26T19:22:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:04 smithi196 ceph-mon[32572]: pgmap v14771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:22:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:04 smithi110 ceph-mon[28069]: pgmap v14771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:22:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:04 smithi193 ceph-mon[32782]: pgmap v14771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:22:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:22:05.876+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:22:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:22:05.875+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:22:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:22:05.877+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 211 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:22:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:22:05.877+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 211 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:22:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:06 smithi196 ceph-mon[32572]: pgmap v14772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:06 smithi110 ceph-mon[28069]: pgmap v14772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:06 smithi193 ceph-mon[32782]: pgmap v14772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27242.369117 secs 2024-04-26T19:22:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27242.369117 secs 2024-04-26T19:22:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27242.369117 secs 2024-04-26T19:22:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:08 smithi196 ceph-mon[32572]: pgmap v14773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:08 smithi110 ceph-mon[28069]: pgmap v14773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:08 smithi193 ceph-mon[32782]: pgmap v14773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:11 smithi193 ceph-mon[32782]: pgmap v14774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:11 smithi196 ceph-mon[32572]: pgmap v14774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:11 smithi110 ceph-mon[28069]: pgmap v14774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:13 smithi193 ceph-mon[32782]: pgmap v14775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27247.369244 secs 2024-04-26T19:22:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:13 smithi196 ceph-mon[32572]: pgmap v14775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27247.369244 secs 2024-04-26T19:22:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:13 smithi110 ceph-mon[28069]: pgmap v14775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27247.369244 secs 2024-04-26T19:22:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:15 smithi193 ceph-mon[32782]: pgmap v14776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:15 smithi196 ceph-mon[32572]: pgmap v14776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:15 smithi110 ceph-mon[28069]: pgmap v14776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:17 smithi193 ceph-mon[32782]: pgmap v14777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:17 smithi196 ceph-mon[32572]: pgmap v14777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:17 smithi110 ceph-mon[28069]: pgmap v14777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:18 smithi193 ceph-mon[32782]: 22 slow requests, 1 included below; oldest blocked for > 27252.369363 secs 2024-04-26T19:22:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:18 smithi193 ceph-mon[32782]: slow request 2884.584925 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:22:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:18 smithi196 ceph-mon[32572]: 22 slow requests, 1 included below; oldest blocked for > 27252.369363 secs 2024-04-26T19:22:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:18 smithi196 ceph-mon[32572]: slow request 2884.584925 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:22:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:18 smithi110 ceph-mon[28069]: 22 slow requests, 1 included below; oldest blocked for > 27252.369363 secs 2024-04-26T19:22:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:18 smithi110 ceph-mon[28069]: slow request 2884.584925 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:22:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:19 smithi193 ceph-mon[32782]: pgmap v14778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:22:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:19 smithi196 ceph-mon[32572]: pgmap v14778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:22:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:19 smithi110 ceph-mon[28069]: pgmap v14778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:22:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:21 smithi193 ceph-mon[32782]: pgmap v14779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:22:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:21 smithi196 ceph-mon[32572]: pgmap v14779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:22:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:21 smithi110 ceph-mon[28069]: pgmap v14779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:22:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:23 smithi196 ceph-mon[32572]: pgmap v14780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:22:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27257.369498 secs 2024-04-26T19:22:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:23 smithi110 ceph-mon[28069]: pgmap v14780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:22:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27257.369498 secs 2024-04-26T19:22:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:23 smithi193 ceph-mon[32782]: pgmap v14780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:22:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27257.369498 secs 2024-04-26T19:22:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:25 smithi196 ceph-mon[32572]: pgmap v14781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:25 smithi110 ceph-mon[28069]: pgmap v14781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:25 smithi193 ceph-mon[32782]: pgmap v14781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:27 smithi196 ceph-mon[32572]: pgmap v14782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:22:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:27 smithi110 ceph-mon[28069]: pgmap v14782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:22:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:27 smithi193 ceph-mon[32782]: pgmap v14782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:22:28.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27262.369644 secs 2024-04-26T19:22:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27262.369644 secs 2024-04-26T19:22:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27262.369644 secs 2024-04-26T19:22:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:29 smithi196 ceph-mon[32572]: pgmap v14783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:22:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:29 smithi110 ceph-mon[28069]: pgmap v14783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:22:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:29 smithi193 ceph-mon[32782]: pgmap v14783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T19:22:31.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:31 smithi193 ceph-mon[32782]: pgmap v14784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:31 smithi196 ceph-mon[32572]: pgmap v14784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:31 smithi110 ceph-mon[28069]: pgmap v14784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:33 smithi196 ceph-mon[32572]: pgmap v14785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27267.369789 secs 2024-04-26T19:22:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:33 smithi110 ceph-mon[28069]: pgmap v14785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27267.369789 secs 2024-04-26T19:22:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:33 smithi193 ceph-mon[32782]: pgmap v14785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27267.369789 secs 2024-04-26T19:22:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:35 smithi196 ceph-mon[32572]: pgmap v14786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:35 smithi110 ceph-mon[28069]: pgmap v14786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:35 smithi193 ceph-mon[32782]: pgmap v14786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:37 smithi196 ceph-mon[32572]: pgmap v14787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:37 smithi110 ceph-mon[28069]: pgmap v14787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:37 smithi193 ceph-mon[32782]: pgmap v14787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27272.369924 secs 2024-04-26T19:22:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27272.369924 secs 2024-04-26T19:22:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27272.369924 secs 2024-04-26T19:22:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:39 smithi196 ceph-mon[32572]: pgmap v14788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:39 smithi110 ceph-mon[28069]: pgmap v14788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:39 smithi193 ceph-mon[32782]: pgmap v14788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:41 smithi196 ceph-mon[32572]: pgmap v14789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:41 smithi110 ceph-mon[28069]: pgmap v14789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:41 smithi193 ceph-mon[32782]: pgmap v14789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:43 smithi196 ceph-mon[32572]: pgmap v14790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27277.370077 secs 2024-04-26T19:22:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:43 smithi110 ceph-mon[28069]: pgmap v14790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27277.370077 secs 2024-04-26T19:22:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:43 smithi193 ceph-mon[32782]: pgmap v14790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27277.370077 secs 2024-04-26T19:22:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:45 smithi196 ceph-mon[32572]: pgmap v14791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:45 smithi110 ceph-mon[28069]: pgmap v14791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:45 smithi193 ceph-mon[32782]: pgmap v14791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:47 smithi196 ceph-mon[32572]: pgmap v14792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:47 smithi110 ceph-mon[28069]: pgmap v14792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:47 smithi193 ceph-mon[32782]: pgmap v14792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27282.370147 secs 2024-04-26T19:22:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27282.370147 secs 2024-04-26T19:22:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27282.370147 secs 2024-04-26T19:22:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:49 smithi196 ceph-mon[32572]: pgmap v14793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:49 smithi110 ceph-mon[28069]: pgmap v14793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:49 smithi193 ceph-mon[32782]: pgmap v14793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:51 smithi196 ceph-mon[32572]: pgmap v14794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:51 smithi110 ceph-mon[28069]: pgmap v14794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:51 smithi193 ceph-mon[32782]: pgmap v14794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:22:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:53 smithi196 ceph-mon[32572]: pgmap v14795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:53.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27287.370283 secs 2024-04-26T19:22:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:53 smithi110 ceph-mon[28069]: pgmap v14795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27287.370283 secs 2024-04-26T19:22:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:53 smithi193 ceph-mon[32782]: pgmap v14795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:22:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27287.370283 secs 2024-04-26T19:22:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:22:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:22:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:22:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:55 smithi196 ceph-mon[32572]: pgmap v14796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:22:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:22:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:55 smithi196 ceph-mon[32572]: pgmap v14797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:22:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:55 smithi196 ceph-mon[32572]: pgmap v14798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:22:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:22:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:55 smithi110 ceph-mon[28069]: pgmap v14796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:22:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:22:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:55 smithi110 ceph-mon[28069]: pgmap v14797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:22:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:55 smithi110 ceph-mon[28069]: pgmap v14798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:22:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:22:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:55 smithi193 ceph-mon[32782]: pgmap v14796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:22:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:22:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:22:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:55 smithi193 ceph-mon[32782]: pgmap v14797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:22:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:55 smithi193 ceph-mon[32782]: pgmap v14798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:22:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:22:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27292.370391 secs 2024-04-26T19:22:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:57 smithi196 ceph-mon[32572]: pgmap v14799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:22:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27292.370391 secs 2024-04-26T19:22:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:57 smithi110 ceph-mon[28069]: pgmap v14799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:22:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27292.370391 secs 2024-04-26T19:22:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:57 smithi193 ceph-mon[32782]: pgmap v14799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:23:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:22:59 smithi196 ceph-mon[32572]: pgmap v14800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:22:59 smithi110 ceph-mon[28069]: pgmap v14800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:22:59 smithi193 ceph-mon[32782]: pgmap v14800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:01 smithi196 ceph-mon[32572]: pgmap v14801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:01 smithi110 ceph-mon[28069]: pgmap v14801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:01 smithi193 ceph-mon[32782]: pgmap v14801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27297.370507 secs 2024-04-26T19:23:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27297.370507 secs 2024-04-26T19:23:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27297.370507 secs 2024-04-26T19:23:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:04 smithi196 ceph-mon[32572]: pgmap v14802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:04 smithi110 ceph-mon[28069]: pgmap v14802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:04 smithi193 ceph-mon[32782]: pgmap v14802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:06 smithi110 ceph-mon[28069]: pgmap v14803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:23:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:06 smithi193 ceph-mon[32782]: pgmap v14803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:23:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:06 smithi196 ceph-mon[32572]: pgmap v14803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:23:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27302.370631 secs 2024-04-26T19:23:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:08 smithi110 ceph-mon[28069]: pgmap v14804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27302.370631 secs 2024-04-26T19:23:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:08 smithi193 ceph-mon[32782]: pgmap v14804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27302.370631 secs 2024-04-26T19:23:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:08 smithi196 ceph-mon[32572]: pgmap v14804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:10 smithi110 ceph-mon[28069]: pgmap v14805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:10 smithi193 ceph-mon[32782]: pgmap v14805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:10 smithi196 ceph-mon[32572]: pgmap v14805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:12 smithi110 ceph-mon[28069]: pgmap v14806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:12 smithi193 ceph-mon[32782]: pgmap v14806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:12 smithi196 ceph-mon[32572]: pgmap v14806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27307.370707 secs 2024-04-26T19:23:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27307.370707 secs 2024-04-26T19:23:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27307.370707 secs 2024-04-26T19:23:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:14 smithi110 ceph-mon[28069]: pgmap v14807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:14 smithi193 ceph-mon[32782]: pgmap v14807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:14 smithi196 ceph-mon[32572]: pgmap v14807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:16 smithi193 ceph-mon[32782]: pgmap v14808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:16 smithi196 ceph-mon[32572]: pgmap v14808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:16 smithi110 ceph-mon[28069]: pgmap v14808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27312.370805 secs 2024-04-26T19:23:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:18 smithi193 ceph-mon[32782]: pgmap v14809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27312.370805 secs 2024-04-26T19:23:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:18 smithi196 ceph-mon[32572]: pgmap v14809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27312.370805 secs 2024-04-26T19:23:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:18 smithi110 ceph-mon[28069]: pgmap v14809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:20 smithi193 ceph-mon[32782]: pgmap v14810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:20 smithi196 ceph-mon[32572]: pgmap v14810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:20 smithi110 ceph-mon[28069]: pgmap v14810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:22 smithi193 ceph-mon[32782]: pgmap v14811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:22 smithi196 ceph-mon[32572]: pgmap v14811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:22 smithi110 ceph-mon[28069]: pgmap v14811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27317.370903 secs 2024-04-26T19:23:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27317.370903 secs 2024-04-26T19:23:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27317.370903 secs 2024-04-26T19:23:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:24 smithi193 ceph-mon[32782]: pgmap v14812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:24 smithi196 ceph-mon[32572]: pgmap v14812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:24 smithi110 ceph-mon[28069]: pgmap v14812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:26 smithi193 ceph-mon[32782]: pgmap v14813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:26 smithi196 ceph-mon[32572]: pgmap v14813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:26 smithi110 ceph-mon[28069]: pgmap v14813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27322.371022 secs 2024-04-26T19:23:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:28 smithi193 ceph-mon[32782]: pgmap v14814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27322.371022 secs 2024-04-26T19:23:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:28 smithi196 ceph-mon[32572]: pgmap v14814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27322.371022 secs 2024-04-26T19:23:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:28 smithi110 ceph-mon[28069]: pgmap v14814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:30 smithi193 ceph-mon[32782]: pgmap v14815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:30 smithi196 ceph-mon[32572]: pgmap v14815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:30 smithi110 ceph-mon[28069]: pgmap v14815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:32.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:32 smithi110 ceph-mon[28069]: pgmap v14816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:32 smithi193 ceph-mon[32782]: pgmap v14816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:32 smithi196 ceph-mon[32572]: pgmap v14816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27327.371158 secs 2024-04-26T19:23:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27327.371158 secs 2024-04-26T19:23:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27327.371158 secs 2024-04-26T19:23:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:34 smithi193 ceph-mon[32782]: pgmap v14817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:34 smithi196 ceph-mon[32572]: pgmap v14817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:34 smithi110 ceph-mon[28069]: pgmap v14817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:36 smithi193 ceph-mon[32782]: pgmap v14818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:36 smithi196 ceph-mon[32572]: pgmap v14818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:36 smithi110 ceph-mon[28069]: pgmap v14818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27332.371291 secs 2024-04-26T19:23:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:38 smithi193 ceph-mon[32782]: pgmap v14819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27332.371291 secs 2024-04-26T19:23:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:38 smithi196 ceph-mon[32572]: pgmap v14819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27332.371291 secs 2024-04-26T19:23:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:38 smithi110 ceph-mon[28069]: pgmap v14819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:40 smithi193 ceph-mon[32782]: pgmap v14820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:40 smithi196 ceph-mon[32572]: pgmap v14820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:40 smithi110 ceph-mon[28069]: pgmap v14820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:42 smithi196 ceph-mon[32572]: pgmap v14821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:42 smithi110 ceph-mon[28069]: pgmap v14821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:42 smithi193 ceph-mon[32782]: pgmap v14821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27337.371413 secs 2024-04-26T19:23:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27337.371413 secs 2024-04-26T19:23:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27337.371413 secs 2024-04-26T19:23:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:44 smithi196 ceph-mon[32572]: pgmap v14822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:44 smithi110 ceph-mon[28069]: pgmap v14822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:44 smithi193 ceph-mon[32782]: pgmap v14822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:46 smithi196 ceph-mon[32572]: pgmap v14823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:46 smithi110 ceph-mon[28069]: pgmap v14823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:46 smithi193 ceph-mon[32782]: pgmap v14823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27342.371530 secs 2024-04-26T19:23:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:48 smithi196 ceph-mon[32572]: pgmap v14824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27342.371530 secs 2024-04-26T19:23:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:48 smithi110 ceph-mon[28069]: pgmap v14824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27342.371530 secs 2024-04-26T19:23:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:48 smithi193 ceph-mon[32782]: pgmap v14824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:50 smithi196 ceph-mon[32572]: pgmap v14825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:50 smithi110 ceph-mon[28069]: pgmap v14825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:50 smithi193 ceph-mon[32782]: pgmap v14825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:52 smithi196 ceph-mon[32572]: pgmap v14826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:52 smithi110 ceph-mon[28069]: pgmap v14826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:52 smithi193 ceph-mon[32782]: pgmap v14826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27347.371668 secs 2024-04-26T19:23:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27347.371668 secs 2024-04-26T19:23:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27347.371668 secs 2024-04-26T19:23:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:54 smithi196 ceph-mon[32572]: pgmap v14827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:54 smithi110 ceph-mon[28069]: pgmap v14827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:54 smithi193 ceph-mon[32782]: pgmap v14827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:23:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:56 smithi196 ceph-mon[32572]: pgmap v14828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:23:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:56 smithi110 ceph-mon[28069]: pgmap v14828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:23:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:56 smithi193 ceph-mon[32782]: pgmap v14828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:23:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:23:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:23:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:23:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:23:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:23:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:23:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:23:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:23:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:23:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:23:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:58 smithi196 ceph-mon[32572]: pgmap v14829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T19:23:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:58 smithi196 ceph-mon[32572]: pgmap v14830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:23:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27352.371789 secs 2024-04-26T19:23:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:58 smithi110 ceph-mon[28069]: pgmap v14829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T19:23:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:58 smithi110 ceph-mon[28069]: pgmap v14830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:23:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27352.371789 secs 2024-04-26T19:23:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:58 smithi193 ceph-mon[32782]: pgmap v14829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T19:23:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:58 smithi193 ceph-mon[32782]: pgmap v14830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:23:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:23:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27352.371789 secs 2024-04-26T19:24:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:00 smithi196 ceph-mon[32572]: pgmap v14831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:24:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:00 smithi110 ceph-mon[28069]: pgmap v14831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:24:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:00 smithi193 ceph-mon[32782]: pgmap v14831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:24:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:02 smithi196 ceph-mon[32572]: pgmap v14832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:24:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:02 smithi110 ceph-mon[28069]: pgmap v14832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:24:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:02 smithi193 ceph-mon[32782]: pgmap v14832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:24:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27357.371900 secs 2024-04-26T19:24:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27357.371900 secs 2024-04-26T19:24:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27357.371900 secs 2024-04-26T19:24:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:04 smithi196 ceph-mon[32572]: pgmap v14833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:24:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:04 smithi110 ceph-mon[28069]: pgmap v14833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:24:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:04 smithi193 ceph-mon[32782]: pgmap v14833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:24:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:06 smithi196 ceph-mon[32572]: pgmap v14834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:24:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:06 smithi110 ceph-mon[28069]: pgmap v14834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:24:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:06 smithi193 ceph-mon[32782]: pgmap v14834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:24:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:08 smithi196 ceph-mon[32572]: pgmap v14835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:24:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27362.371991 secs 2024-04-26T19:24:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:08 smithi110 ceph-mon[28069]: pgmap v14835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:24:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27362.371991 secs 2024-04-26T19:24:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:08 smithi193 ceph-mon[32782]: pgmap v14835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:24:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27362.371991 secs 2024-04-26T19:24:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:10 smithi196 ceph-mon[32572]: pgmap v14836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:10 smithi110 ceph-mon[28069]: pgmap v14836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:10 smithi193 ceph-mon[32782]: pgmap v14836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:12 smithi196 ceph-mon[32572]: pgmap v14837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:12 smithi110 ceph-mon[28069]: pgmap v14837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:12 smithi193 ceph-mon[32782]: pgmap v14837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27367.372108 secs 2024-04-26T19:24:13.526 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27367.372108 secs 2024-04-26T19:24:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27367.372108 secs 2024-04-26T19:24:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:24:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:24:13.525+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:24:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:24:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:24:13.525+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:24:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:24:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:24:13.525+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:24:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:24:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:24:13.525+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:24:13.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:24:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:24:13.526+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:24:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:14 smithi196 ceph-mon[32572]: pgmap v14838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:14 smithi110 ceph-mon[28069]: pgmap v14838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:14 smithi193 ceph-mon[32782]: pgmap v14838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:16 smithi196 ceph-mon[32572]: pgmap v14839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:16 smithi110 ceph-mon[28069]: pgmap v14839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:16 smithi193 ceph-mon[32782]: pgmap v14839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:17 smithi110 ceph-mon[28069]: pgmap v14840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:17 smithi193 ceph-mon[32782]: pgmap v14840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:17 smithi196 ceph-mon[32572]: pgmap v14840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27372.372259 secs 2024-04-26T19:24:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27372.372259 secs 2024-04-26T19:24:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27372.372259 secs 2024-04-26T19:24:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:19 smithi110 ceph-mon[28069]: pgmap v14841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:24:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:19 smithi193 ceph-mon[32782]: pgmap v14841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:24:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:19 smithi196 ceph-mon[32572]: pgmap v14841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:24:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:24:20.897+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:24:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:24:20.897+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:24:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:24:20.898+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 212 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:24:20.898 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:24:20.898+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 212 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:24:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:21 smithi193 ceph-mon[32782]: pgmap v14842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:24:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:21 smithi196 ceph-mon[32572]: pgmap v14842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:24:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:21 smithi110 ceph-mon[28069]: pgmap v14842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:24:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27377.372378 secs 2024-04-26T19:24:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27377.372378 secs 2024-04-26T19:24:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27377.372378 secs 2024-04-26T19:24:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:23 smithi196 ceph-mon[32572]: pgmap v14843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:24:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:23 smithi110 ceph-mon[28069]: pgmap v14843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:24:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:23 smithi193 ceph-mon[32782]: pgmap v14843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:24:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:25 smithi196 ceph-mon[32572]: pgmap v14844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:24:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:25 smithi110 ceph-mon[28069]: pgmap v14844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:24:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:25 smithi193 ceph-mon[32782]: pgmap v14844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:24:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:27 smithi196 ceph-mon[32572]: pgmap v14845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:24:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:27 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27382.372500 secs 2024-04-26T19:24:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:27 smithi110 ceph-mon[28069]: pgmap v14845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:24:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:27 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27382.372500 secs 2024-04-26T19:24:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:27 smithi193 ceph-mon[32782]: pgmap v14845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:24:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:27 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27382.372500 secs 2024-04-26T19:24:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:29 smithi196 ceph-mon[32572]: pgmap v14846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:24:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:29 smithi110 ceph-mon[28069]: pgmap v14846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:24:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:29 smithi193 ceph-mon[32782]: pgmap v14846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:24:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:31 smithi196 ceph-mon[32572]: pgmap v14847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:31 smithi110 ceph-mon[28069]: pgmap v14847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:31 smithi193 ceph-mon[32782]: pgmap v14847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:32.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27387.372614 secs 2024-04-26T19:24:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27387.372614 secs 2024-04-26T19:24:33.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27387.372614 secs 2024-04-26T19:24:33.972 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:33 smithi110 ceph-mon[28069]: pgmap v14848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:33 smithi196 ceph-mon[32572]: pgmap v14848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:33 smithi193 ceph-mon[32782]: pgmap v14848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:35 smithi196 ceph-mon[32572]: pgmap v14849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:35 smithi110 ceph-mon[28069]: pgmap v14849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:35 smithi193 ceph-mon[32782]: pgmap v14849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:37 smithi196 ceph-mon[32572]: pgmap v14850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27392.372724 secs 2024-04-26T19:24:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:37 smithi110 ceph-mon[28069]: pgmap v14850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27392.372724 secs 2024-04-26T19:24:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:37 smithi193 ceph-mon[32782]: pgmap v14850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27392.372724 secs 2024-04-26T19:24:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:39 smithi196 ceph-mon[32572]: pgmap v14851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:39 smithi110 ceph-mon[28069]: pgmap v14851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:39 smithi193 ceph-mon[32782]: pgmap v14851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:41 smithi196 ceph-mon[32572]: pgmap v14852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:41 smithi110 ceph-mon[28069]: pgmap v14852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:41 smithi193 ceph-mon[32782]: pgmap v14852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:42 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27397.372803 secs 2024-04-26T19:24:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:42 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27397.372803 secs 2024-04-26T19:24:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:42 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27397.372803 secs 2024-04-26T19:24:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:43 smithi196 ceph-mon[32572]: pgmap v14853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:43 smithi110 ceph-mon[28069]: pgmap v14853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:43 smithi193 ceph-mon[32782]: pgmap v14853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:45 smithi196 ceph-mon[32572]: pgmap v14854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:45 smithi110 ceph-mon[28069]: pgmap v14854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:45 smithi193 ceph-mon[32782]: pgmap v14854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:47 smithi196 ceph-mon[32572]: pgmap v14855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:47 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27402.372919 secs 2024-04-26T19:24:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:47 smithi110 ceph-mon[28069]: pgmap v14855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:47 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27402.372919 secs 2024-04-26T19:24:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:47 smithi193 ceph-mon[32782]: pgmap v14855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:47 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27402.372919 secs 2024-04-26T19:24:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:49 smithi196 ceph-mon[32572]: pgmap v14856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:49 smithi110 ceph-mon[28069]: pgmap v14856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:49 smithi193 ceph-mon[32782]: pgmap v14856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:51 smithi196 ceph-mon[32572]: pgmap v14857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:51 smithi110 ceph-mon[28069]: pgmap v14857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:51 smithi193 ceph-mon[32782]: pgmap v14857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27407.373038 secs 2024-04-26T19:24:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27407.373038 secs 2024-04-26T19:24:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27407.373038 secs 2024-04-26T19:24:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:53 smithi196 ceph-mon[32572]: pgmap v14858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:53 smithi110 ceph-mon[28069]: pgmap v14858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:53 smithi193 ceph-mon[32782]: pgmap v14858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:24:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:55 smithi196 ceph-mon[32572]: pgmap v14859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:55 smithi110 ceph-mon[28069]: pgmap v14859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:55 smithi193 ceph-mon[32782]: pgmap v14859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:57 smithi196 ceph-mon[32572]: pgmap v14860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27412.373160 secs 2024-04-26T19:24:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:24:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:57 smithi110 ceph-mon[28069]: pgmap v14860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27412.373160 secs 2024-04-26T19:24:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:24:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:57 smithi193 ceph-mon[32782]: pgmap v14860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:24:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27412.373160 secs 2024-04-26T19:24:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:24:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:24:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:24:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:58 smithi110 ceph-mon[28069]: pgmap v14861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:24:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:58 smithi110 ceph-mon[28069]: pgmap v14862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:24:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:24:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:24:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:24:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:24:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:58 smithi193 ceph-mon[32782]: pgmap v14861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:24:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:58 smithi193 ceph-mon[32782]: pgmap v14862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:24:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:24:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:24:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:24:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:24:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:58 smithi196 ceph-mon[32572]: pgmap v14861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:24:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:58 smithi196 ceph-mon[32572]: pgmap v14862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:24:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:24:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:25:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:01 smithi196 ceph-mon[32572]: pgmap v14863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:25:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:01 smithi110 ceph-mon[28069]: pgmap v14863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:25:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:01 smithi193 ceph-mon[32782]: pgmap v14863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:25:03.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27417.373313 secs 2024-04-26T19:25:03.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:03 smithi193 ceph-mon[32782]: pgmap v14864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:25:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27417.373313 secs 2024-04-26T19:25:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:03 smithi196 ceph-mon[32572]: pgmap v14864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:25:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27417.373313 secs 2024-04-26T19:25:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:03 smithi110 ceph-mon[28069]: pgmap v14864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:25:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:05 smithi196 ceph-mon[32572]: pgmap v14865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:05 smithi110 ceph-mon[28069]: pgmap v14865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:05 smithi193 ceph-mon[32782]: pgmap v14865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:07 smithi196 ceph-mon[32572]: pgmap v14866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:07 smithi110 ceph-mon[28069]: pgmap v14866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:07 smithi193 ceph-mon[32782]: pgmap v14866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27422.373441 secs 2024-04-26T19:25:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27422.373441 secs 2024-04-26T19:25:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27422.373441 secs 2024-04-26T19:25:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:09 smithi196 ceph-mon[32572]: pgmap v14867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:09 smithi110 ceph-mon[28069]: pgmap v14867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:09 smithi193 ceph-mon[32782]: pgmap v14867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:11 smithi196 ceph-mon[32572]: pgmap v14868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:25:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:11 smithi110 ceph-mon[28069]: pgmap v14868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:25:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:11 smithi193 ceph-mon[32782]: pgmap v14868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:25:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:13 smithi196 ceph-mon[32572]: 22 slow requests, 1 included below; oldest blocked for > 27427.373588 secs 2024-04-26T19:25:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:13 smithi196 ceph-mon[32572]: slow request 5760.926578 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:25:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:13 smithi196 ceph-mon[32572]: pgmap v14869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:25:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:13 smithi110 ceph-mon[28069]: 22 slow requests, 1 included below; oldest blocked for > 27427.373588 secs 2024-04-26T19:25:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:13 smithi110 ceph-mon[28069]: slow request 5760.926578 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:25:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:13 smithi110 ceph-mon[28069]: pgmap v14869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:25:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:13 smithi193 ceph-mon[32782]: 22 slow requests, 1 included below; oldest blocked for > 27427.373588 secs 2024-04-26T19:25:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:13 smithi193 ceph-mon[32782]: slow request 5760.926578 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:25:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:13 smithi193 ceph-mon[32782]: pgmap v14869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:25:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:15 smithi196 ceph-mon[32572]: pgmap v14870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:15 smithi110 ceph-mon[28069]: pgmap v14870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:15 smithi193 ceph-mon[32782]: pgmap v14870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:25:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:17 smithi196 ceph-mon[32572]: pgmap v14871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:17 smithi110 ceph-mon[28069]: pgmap v14871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:17 smithi193 ceph-mon[32782]: pgmap v14871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27432.373704 secs 2024-04-26T19:25:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27432.373704 secs 2024-04-26T19:25:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27432.373704 secs 2024-04-26T19:25:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:19 smithi196 ceph-mon[32572]: pgmap v14872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:19 smithi110 ceph-mon[28069]: pgmap v14872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:19 smithi193 ceph-mon[32782]: pgmap v14872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:21 smithi196 ceph-mon[32572]: pgmap v14873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:21 smithi110 ceph-mon[28069]: pgmap v14873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:21 smithi193 ceph-mon[32782]: pgmap v14873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27437.373797 secs 2024-04-26T19:25:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:23 smithi196 ceph-mon[32572]: pgmap v14874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27437.373797 secs 2024-04-26T19:25:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:23 smithi110 ceph-mon[28069]: pgmap v14874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27437.373797 secs 2024-04-26T19:25:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:23 smithi193 ceph-mon[32782]: pgmap v14874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:25 smithi196 ceph-mon[32572]: pgmap v14875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:25 smithi110 ceph-mon[28069]: pgmap v14875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:25 smithi193 ceph-mon[32782]: pgmap v14875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:27 smithi196 ceph-mon[32572]: pgmap v14876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:27 smithi110 ceph-mon[28069]: pgmap v14876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:27 smithi193 ceph-mon[32782]: pgmap v14876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27442.373917 secs 2024-04-26T19:25:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27442.373917 secs 2024-04-26T19:25:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27442.373917 secs 2024-04-26T19:25:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:29 smithi196 ceph-mon[32572]: pgmap v14877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:29 smithi110 ceph-mon[28069]: pgmap v14877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:29 smithi193 ceph-mon[32782]: pgmap v14877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:31 smithi196 ceph-mon[32572]: pgmap v14878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:31 smithi110 ceph-mon[28069]: pgmap v14878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:31 smithi193 ceph-mon[32782]: pgmap v14878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27447.373995 secs 2024-04-26T19:25:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:33 smithi196 ceph-mon[32572]: pgmap v14879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27447.373995 secs 2024-04-26T19:25:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:33 smithi110 ceph-mon[28069]: pgmap v14879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27447.373995 secs 2024-04-26T19:25:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:33 smithi193 ceph-mon[32782]: pgmap v14879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:35 smithi196 ceph-mon[32572]: pgmap v14880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:35 smithi110 ceph-mon[28069]: pgmap v14880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:35 smithi193 ceph-mon[32782]: pgmap v14880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:37 smithi196 ceph-mon[32572]: pgmap v14881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:37 smithi110 ceph-mon[28069]: pgmap v14881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:37 smithi193 ceph-mon[32782]: pgmap v14881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27452.374078 secs 2024-04-26T19:25:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27452.374078 secs 2024-04-26T19:25:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27452.374078 secs 2024-04-26T19:25:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:39 smithi196 ceph-mon[32572]: pgmap v14882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:39 smithi110 ceph-mon[28069]: pgmap v14882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:39 smithi193 ceph-mon[32782]: pgmap v14882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:41 smithi110 ceph-mon[28069]: pgmap v14883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:41 smithi193 ceph-mon[32782]: pgmap v14883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:41 smithi196 ceph-mon[32572]: pgmap v14883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27457.374195 secs 2024-04-26T19:25:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:43 smithi110 ceph-mon[28069]: pgmap v14884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27457.374195 secs 2024-04-26T19:25:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:43 smithi193 ceph-mon[32782]: pgmap v14884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27457.374195 secs 2024-04-26T19:25:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:43 smithi196 ceph-mon[32572]: pgmap v14884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:45 smithi110 ceph-mon[28069]: pgmap v14885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:45 smithi193 ceph-mon[32782]: pgmap v14885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:45 smithi196 ceph-mon[32572]: pgmap v14885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:46 smithi193 ceph-mon[32782]: pgmap v14886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:46 smithi196 ceph-mon[32572]: pgmap v14886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:46 smithi110 ceph-mon[28069]: pgmap v14886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:47 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27462.374315 secs 2024-04-26T19:25:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:47 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27462.374315 secs 2024-04-26T19:25:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:47 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27462.374315 secs 2024-04-26T19:25:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:48 smithi196 ceph-mon[32572]: pgmap v14887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:48 smithi110 ceph-mon[28069]: pgmap v14887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:48 smithi193 ceph-mon[32782]: pgmap v14887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:51 smithi196 ceph-mon[32572]: pgmap v14888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:51 smithi110 ceph-mon[28069]: pgmap v14888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:51 smithi193 ceph-mon[32782]: pgmap v14888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27467.374431 secs 2024-04-26T19:25:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:53 smithi196 ceph-mon[32572]: pgmap v14889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27467.374431 secs 2024-04-26T19:25:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:53 smithi110 ceph-mon[28069]: pgmap v14889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27467.374431 secs 2024-04-26T19:25:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:53 smithi193 ceph-mon[32782]: pgmap v14889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:55 smithi196 ceph-mon[32572]: pgmap v14890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:55 smithi110 ceph-mon[28069]: pgmap v14890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:55 smithi193 ceph-mon[32782]: pgmap v14890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:57 smithi196 ceph-mon[32572]: pgmap v14891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:57 smithi110 ceph-mon[28069]: pgmap v14891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:57 smithi193 ceph-mon[32782]: pgmap v14891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:25:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27472.374532 secs 2024-04-26T19:25:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27472.374532 secs 2024-04-26T19:25:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27472.374532 secs 2024-04-26T19:25:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:59 smithi196 ceph-mon[32572]: pgmap v14892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:25:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:25:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:59 smithi110 ceph-mon[28069]: pgmap v14892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:25:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:25:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:59 smithi193 ceph-mon[32782]: pgmap v14892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:25:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:25:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:26:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:26:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:26:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:26:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:26:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:26:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:26:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:26:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:26:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:26:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:01 smithi196 ceph-mon[32572]: pgmap v14893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T19:26:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:01 smithi196 ceph-mon[32572]: pgmap v14894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:01 smithi110 ceph-mon[28069]: pgmap v14893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T19:26:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:01 smithi110 ceph-mon[28069]: pgmap v14894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:01 smithi193 ceph-mon[32782]: pgmap v14893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T19:26:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:01 smithi193 ceph-mon[32782]: pgmap v14894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:03 smithi196 ceph-mon[32572]: pgmap v14895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27477.374656 secs 2024-04-26T19:26:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:03 smithi110 ceph-mon[28069]: pgmap v14895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27477.374656 secs 2024-04-26T19:26:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:03 smithi193 ceph-mon[32782]: pgmap v14895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27477.374656 secs 2024-04-26T19:26:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:05 smithi196 ceph-mon[32572]: pgmap v14896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:05 smithi110 ceph-mon[28069]: pgmap v14896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:05 smithi193 ceph-mon[32782]: pgmap v14896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:07 smithi196 ceph-mon[32572]: pgmap v14897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:07 smithi110 ceph-mon[28069]: pgmap v14897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:07 smithi193 ceph-mon[32782]: pgmap v14897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27482.374769 secs 2024-04-26T19:26:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27482.374769 secs 2024-04-26T19:26:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27482.374769 secs 2024-04-26T19:26:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:09 smithi196 ceph-mon[32572]: pgmap v14898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:09 smithi110 ceph-mon[28069]: pgmap v14898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:09 smithi193 ceph-mon[32782]: pgmap v14898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:26:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:11 smithi196 ceph-mon[32572]: pgmap v14899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:26:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:11 smithi110 ceph-mon[28069]: pgmap v14899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:26:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:11 smithi193 ceph-mon[32782]: pgmap v14899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:26:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:13 smithi196 ceph-mon[32572]: pgmap v14900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27487.374841 secs 2024-04-26T19:26:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:13 smithi110 ceph-mon[28069]: pgmap v14900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27487.374841 secs 2024-04-26T19:26:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:13 smithi193 ceph-mon[32782]: pgmap v14900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27487.374841 secs 2024-04-26T19:26:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:15 smithi196 ceph-mon[32572]: pgmap v14901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:15 smithi110 ceph-mon[28069]: pgmap v14901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:15 smithi193 ceph-mon[32782]: pgmap v14901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:17 smithi196 ceph-mon[32572]: pgmap v14902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:17 smithi110 ceph-mon[28069]: pgmap v14902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:17 smithi193 ceph-mon[32782]: pgmap v14902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27492.374961 secs 2024-04-26T19:26:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27492.374961 secs 2024-04-26T19:26:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27492.374961 secs 2024-04-26T19:26:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:19 smithi196 ceph-mon[32572]: pgmap v14903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:19 smithi110 ceph-mon[28069]: pgmap v14903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:19 smithi193 ceph-mon[32782]: pgmap v14903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:21 smithi110 ceph-mon[28069]: pgmap v14904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:21 smithi193 ceph-mon[32782]: pgmap v14904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:21 smithi196 ceph-mon[32572]: pgmap v14904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:23 smithi110 ceph-mon[28069]: pgmap v14905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27497.375080 secs 2024-04-26T19:26:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:23 smithi193 ceph-mon[32782]: pgmap v14905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27497.375080 secs 2024-04-26T19:26:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:23 smithi196 ceph-mon[32572]: pgmap v14905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27497.375080 secs 2024-04-26T19:26:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:25 smithi110 ceph-mon[28069]: pgmap v14906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:25 smithi193 ceph-mon[32782]: pgmap v14906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:25 smithi196 ceph-mon[32572]: pgmap v14906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:27 smithi110 ceph-mon[28069]: pgmap v14907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:27 smithi193 ceph-mon[32782]: pgmap v14907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:27 smithi196 ceph-mon[32572]: pgmap v14907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27502.375201 secs 2024-04-26T19:26:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27502.375201 secs 2024-04-26T19:26:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27502.375201 secs 2024-04-26T19:26:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:29 smithi110 ceph-mon[28069]: pgmap v14908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:29 smithi193 ceph-mon[32782]: pgmap v14908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:29 smithi196 ceph-mon[32572]: pgmap v14908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:30 smithi193 ceph-mon[32782]: pgmap v14909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:30 smithi196 ceph-mon[32572]: pgmap v14909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:30 smithi110 ceph-mon[28069]: pgmap v14909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:32 smithi196 ceph-mon[32572]: pgmap v14910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27507.375350 secs 2024-04-26T19:26:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:32 smithi110 ceph-mon[28069]: pgmap v14910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27507.375350 secs 2024-04-26T19:26:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:32 smithi193 ceph-mon[32782]: pgmap v14910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27507.375350 secs 2024-04-26T19:26:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:34 smithi196 ceph-mon[32572]: pgmap v14911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:34 smithi110 ceph-mon[28069]: pgmap v14911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:34 smithi193 ceph-mon[32782]: pgmap v14911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:36 smithi196 ceph-mon[32572]: pgmap v14912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:36 smithi110 ceph-mon[28069]: pgmap v14912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:36 smithi193 ceph-mon[32782]: pgmap v14912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27512.375444 secs 2024-04-26T19:26:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27512.375444 secs 2024-04-26T19:26:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27512.375444 secs 2024-04-26T19:26:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:38 smithi196 ceph-mon[32572]: pgmap v14913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:38 smithi110 ceph-mon[28069]: pgmap v14913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:38 smithi193 ceph-mon[32782]: pgmap v14913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:40 smithi196 ceph-mon[32572]: pgmap v14914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:40 smithi110 ceph-mon[28069]: pgmap v14914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:40 smithi193 ceph-mon[32782]: pgmap v14914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:42 smithi196 ceph-mon[32572]: pgmap v14915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:42 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27517.375557 secs 2024-04-26T19:26:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:42 smithi110 ceph-mon[28069]: pgmap v14915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:42 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27517.375557 secs 2024-04-26T19:26:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:42 smithi193 ceph-mon[32782]: pgmap v14915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:42 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27517.375557 secs 2024-04-26T19:26:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:44 smithi196 ceph-mon[32572]: pgmap v14916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:44 smithi110 ceph-mon[28069]: pgmap v14916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:44 smithi193 ceph-mon[32782]: pgmap v14916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:46 smithi196 ceph-mon[32572]: pgmap v14917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:46 smithi110 ceph-mon[28069]: pgmap v14917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:46 smithi193 ceph-mon[32782]: pgmap v14917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:47 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27522.375675 secs 2024-04-26T19:26:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:47 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27522.375675 secs 2024-04-26T19:26:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:47 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27522.375675 secs 2024-04-26T19:26:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:48 smithi196 ceph-mon[32572]: pgmap v14918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:48 smithi110 ceph-mon[28069]: pgmap v14918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:48 smithi193 ceph-mon[32782]: pgmap v14918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:50 smithi196 ceph-mon[32572]: pgmap v14919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:50 smithi110 ceph-mon[28069]: pgmap v14919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:50 smithi193 ceph-mon[32782]: pgmap v14919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:52 smithi196 ceph-mon[32572]: pgmap v14920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27527.375797 secs 2024-04-26T19:26:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:52 smithi110 ceph-mon[28069]: pgmap v14920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27527.375797 secs 2024-04-26T19:26:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:52 smithi193 ceph-mon[32782]: pgmap v14920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27527.375797 secs 2024-04-26T19:26:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:54 smithi196 ceph-mon[32572]: pgmap v14921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:54 smithi110 ceph-mon[28069]: pgmap v14921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:54 smithi193 ceph-mon[32782]: pgmap v14921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:56 smithi196 ceph-mon[32572]: pgmap v14922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:56 smithi110 ceph-mon[28069]: pgmap v14922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:56 smithi193 ceph-mon[32782]: pgmap v14922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:26:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27532.375927 secs 2024-04-26T19:26:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27532.375927 secs 2024-04-26T19:26:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27532.375927 secs 2024-04-26T19:26:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:26:58 smithi196 ceph-mon[32572]: pgmap v14923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:26:58 smithi110 ceph-mon[28069]: pgmap v14923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:26:58 smithi193 ceph-mon[32782]: pgmap v14923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:00 smithi110 ceph-mon[28069]: pgmap v14924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:27:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:27:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:00 smithi193 ceph-mon[32782]: pgmap v14924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:27:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:27:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:00 smithi196 ceph-mon[32572]: pgmap v14924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:27:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:27:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:27:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:27:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:27:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:02 smithi110 ceph-mon[28069]: pgmap v14925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27537.376039 secs 2024-04-26T19:27:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:27:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:27:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:02 smithi110 ceph-mon[28069]: pgmap v14926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T19:27:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:02 smithi110 ceph-mon[28069]: pgmap v14927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T19:27:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:02 smithi193 ceph-mon[32782]: pgmap v14925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27537.376039 secs 2024-04-26T19:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:02 smithi193 ceph-mon[32782]: pgmap v14926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T19:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:02 smithi193 ceph-mon[32782]: pgmap v14927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T19:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:27:03.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:02 smithi196 ceph-mon[32572]: pgmap v14925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:03.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27537.376039 secs 2024-04-26T19:27:03.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:27:03.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:27:03.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:02 smithi196 ceph-mon[32572]: pgmap v14926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T19:27:03.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:02 smithi196 ceph-mon[32572]: pgmap v14927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T19:27:03.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:27:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:05 smithi193 ceph-mon[32782]: pgmap v14928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:05 smithi196 ceph-mon[32572]: pgmap v14928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:05 smithi110 ceph-mon[28069]: pgmap v14928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:07 smithi193 ceph-mon[32782]: pgmap v14929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T19:27:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:07 smithi196 ceph-mon[32572]: pgmap v14929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T19:27:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:07 smithi110 ceph-mon[28069]: pgmap v14929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T19:27:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27542.376173 secs 2024-04-26T19:27:08.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27542.376173 secs 2024-04-26T19:27:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27542.376173 secs 2024-04-26T19:27:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:09 smithi193 ceph-mon[32782]: pgmap v14930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:09 smithi196 ceph-mon[32572]: pgmap v14930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:09 smithi110 ceph-mon[28069]: pgmap v14930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:11 smithi193 ceph-mon[32782]: pgmap v14931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:11 smithi196 ceph-mon[32572]: pgmap v14931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:11 smithi110 ceph-mon[28069]: pgmap v14931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27547.376313 secs 2024-04-26T19:27:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:13 smithi193 ceph-mon[32782]: pgmap v14932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:27:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27547.376313 secs 2024-04-26T19:27:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:13 smithi196 ceph-mon[32572]: pgmap v14932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:27:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27547.376313 secs 2024-04-26T19:27:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:13 smithi110 ceph-mon[28069]: pgmap v14932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:27:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:15 smithi193 ceph-mon[32782]: pgmap v14933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:15 smithi196 ceph-mon[32572]: pgmap v14933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:15 smithi110 ceph-mon[28069]: pgmap v14933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:17 smithi193 ceph-mon[32782]: pgmap v14934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:17 smithi196 ceph-mon[32572]: pgmap v14934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:17 smithi110 ceph-mon[28069]: pgmap v14934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27552.376378 secs 2024-04-26T19:27:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27552.376378 secs 2024-04-26T19:27:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27552.376378 secs 2024-04-26T19:27:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:19 smithi193 ceph-mon[32782]: pgmap v14935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:19 smithi196 ceph-mon[32572]: pgmap v14935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:19 smithi110 ceph-mon[28069]: pgmap v14935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:20.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:27:20.927+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:27:20.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:27:20.927+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:27:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:27:20.928+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 213 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:27:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:27:20.928+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 213 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:27:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:21 smithi193 ceph-mon[32782]: pgmap v14936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:21 smithi196 ceph-mon[32572]: pgmap v14936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:21 smithi110 ceph-mon[28069]: pgmap v14936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27557.376498 secs 2024-04-26T19:27:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:23 smithi196 ceph-mon[32572]: pgmap v14937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27557.376498 secs 2024-04-26T19:27:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:23 smithi110 ceph-mon[28069]: pgmap v14937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27557.376498 secs 2024-04-26T19:27:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:23 smithi193 ceph-mon[32782]: pgmap v14937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:25 smithi196 ceph-mon[32572]: pgmap v14938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:25 smithi110 ceph-mon[28069]: pgmap v14938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:25 smithi193 ceph-mon[32782]: pgmap v14938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:27 smithi196 ceph-mon[32572]: pgmap v14939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:27 smithi110 ceph-mon[28069]: pgmap v14939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:27 smithi193 ceph-mon[32782]: pgmap v14939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27562.376618 secs 2024-04-26T19:27:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27562.376618 secs 2024-04-26T19:27:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27562.376618 secs 2024-04-26T19:27:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:29 smithi196 ceph-mon[32572]: pgmap v14940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:29 smithi110 ceph-mon[28069]: pgmap v14940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:29 smithi193 ceph-mon[32782]: pgmap v14940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:31 smithi196 ceph-mon[32572]: pgmap v14941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:31 smithi110 ceph-mon[28069]: pgmap v14941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:31 smithi193 ceph-mon[32782]: pgmap v14941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:33.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27567.376735 secs 2024-04-26T19:27:33.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:33 smithi193 ceph-mon[32782]: pgmap v14942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27567.376735 secs 2024-04-26T19:27:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:33 smithi196 ceph-mon[32572]: pgmap v14942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27567.376735 secs 2024-04-26T19:27:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:33 smithi110 ceph-mon[28069]: pgmap v14942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:35 smithi196 ceph-mon[32572]: pgmap v14943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:35 smithi110 ceph-mon[28069]: pgmap v14943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:35 smithi193 ceph-mon[32782]: pgmap v14943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:37 smithi196 ceph-mon[32572]: pgmap v14944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:37 smithi110 ceph-mon[28069]: pgmap v14944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:37 smithi193 ceph-mon[32782]: pgmap v14944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27572.376853 secs 2024-04-26T19:27:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27572.376853 secs 2024-04-26T19:27:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27572.376853 secs 2024-04-26T19:27:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:39 smithi196 ceph-mon[32572]: pgmap v14945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:39 smithi110 ceph-mon[28069]: pgmap v14945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:39 smithi193 ceph-mon[32782]: pgmap v14945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:41 smithi196 ceph-mon[32572]: pgmap v14946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:41 smithi110 ceph-mon[28069]: pgmap v14946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:41 smithi193 ceph-mon[32782]: pgmap v14946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27577.376970 secs 2024-04-26T19:27:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:43 smithi196 ceph-mon[32572]: pgmap v14947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27577.376970 secs 2024-04-26T19:27:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:43 smithi110 ceph-mon[28069]: pgmap v14947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27577.376970 secs 2024-04-26T19:27:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:43 smithi193 ceph-mon[32782]: pgmap v14947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:45 smithi196 ceph-mon[32572]: pgmap v14948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:45 smithi110 ceph-mon[28069]: pgmap v14948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:45 smithi193 ceph-mon[32782]: pgmap v14948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:47 smithi196 ceph-mon[32572]: pgmap v14949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:47 smithi110 ceph-mon[28069]: pgmap v14949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:47 smithi193 ceph-mon[32782]: pgmap v14949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27582.377095 secs 2024-04-26T19:27:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27582.377095 secs 2024-04-26T19:27:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27582.377095 secs 2024-04-26T19:27:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:49 smithi196 ceph-mon[32572]: pgmap v14950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:49 smithi110 ceph-mon[28069]: pgmap v14950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:49 smithi193 ceph-mon[32782]: pgmap v14950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:51 smithi196 ceph-mon[32572]: pgmap v14951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:51 smithi110 ceph-mon[28069]: pgmap v14951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:51 smithi193 ceph-mon[32782]: pgmap v14951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27587.377217 secs 2024-04-26T19:27:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:53 smithi196 ceph-mon[32572]: pgmap v14952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27587.377217 secs 2024-04-26T19:27:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:53 smithi110 ceph-mon[28069]: pgmap v14952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27587.377217 secs 2024-04-26T19:27:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:53 smithi193 ceph-mon[32782]: pgmap v14952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:55 smithi196 ceph-mon[32572]: pgmap v14953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:55 smithi110 ceph-mon[28069]: pgmap v14953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:55 smithi193 ceph-mon[32782]: pgmap v14953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:57 smithi196 ceph-mon[32572]: pgmap v14954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:57 smithi110 ceph-mon[28069]: pgmap v14954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:57 smithi193 ceph-mon[32782]: pgmap v14954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:27:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27592.377338 secs 2024-04-26T19:27:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27592.377338 secs 2024-04-26T19:27:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27592.377338 secs 2024-04-26T19:27:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:27:59 smithi196 ceph-mon[32572]: pgmap v14955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:27:59 smithi110 ceph-mon[28069]: pgmap v14955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:27:59 smithi193 ceph-mon[32782]: pgmap v14955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:01 smithi196 ceph-mon[32572]: pgmap v14956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:01 smithi110 ceph-mon[28069]: pgmap v14956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:01 smithi193 ceph-mon[32782]: pgmap v14956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27597.377457 secs 2024-04-26T19:28:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:03 smithi196 ceph-mon[32572]: pgmap v14957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:28:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27597.377457 secs 2024-04-26T19:28:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:03 smithi110 ceph-mon[28069]: pgmap v14957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:28:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27597.377457 secs 2024-04-26T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:03 smithi193 ceph-mon[32782]: pgmap v14957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:05.493 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:05 smithi196 ceph-mon[32572]: pgmap v14958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:05 smithi110 ceph-mon[28069]: pgmap v14958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:05.609 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:05 smithi193 ceph-mon[32782]: pgmap v14958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:07 smithi193 ceph-mon[32782]: pgmap v14959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:28:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:28:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:07 smithi110 ceph-mon[28069]: pgmap v14959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:28:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:28:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.550 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:07 smithi196 ceph-mon[32572]: pgmap v14959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:07.550 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.550 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.550 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.550 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:07.550 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:28:07.550 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:28:07.550 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:28:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:08 smithi110 ceph-mon[28069]: 22 slow requests, 1 included below; oldest blocked for > 27602.377549 secs 2024-04-26T19:28:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:08 smithi110 ceph-mon[28069]: slow request 23044.205149 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:28:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:08 smithi110 ceph-mon[28069]: pgmap v14960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T19:28:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:08 smithi110 ceph-mon[28069]: pgmap v14961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 562 B/s rd, 1 op/s 2024-04-26T19:28:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:08 smithi193 ceph-mon[32782]: 22 slow requests, 1 included below; oldest blocked for > 27602.377549 secs 2024-04-26T19:28:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:08 smithi193 ceph-mon[32782]: slow request 23044.205149 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:28:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:08 smithi193 ceph-mon[32782]: pgmap v14960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T19:28:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:08 smithi193 ceph-mon[32782]: pgmap v14961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 562 B/s rd, 1 op/s 2024-04-26T19:28:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:08 smithi196 ceph-mon[32572]: 22 slow requests, 1 included below; oldest blocked for > 27602.377549 secs 2024-04-26T19:28:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:08 smithi196 ceph-mon[32572]: slow request 23044.205149 seconds old, received at 2024-04-26T13:04:02.470723+0000: client_request(client.26722:1 getattr pAsLsXsFs #0x1 2024-04-26T13:04:02.465441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:28:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:08 smithi196 ceph-mon[32572]: pgmap v14960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-04-26T19:28:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:08 smithi196 ceph-mon[32572]: pgmap v14961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 562 B/s rd, 1 op/s 2024-04-26T19:28:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:10 smithi110 ceph-mon[28069]: pgmap v14962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:10 smithi193 ceph-mon[32782]: pgmap v14962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:10 smithi196 ceph-mon[32572]: pgmap v14962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:12 smithi110 ceph-mon[28069]: pgmap v14963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:12 smithi193 ceph-mon[32782]: pgmap v14963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:12 smithi196 ceph-mon[32572]: pgmap v14963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27607.377670 secs 2024-04-26T19:28:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27607.377670 secs 2024-04-26T19:28:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27607.377670 secs 2024-04-26T19:28:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:14 smithi110 ceph-mon[28069]: pgmap v14964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:14 smithi193 ceph-mon[32782]: pgmap v14964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:14 smithi196 ceph-mon[32572]: pgmap v14964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:16 smithi193 ceph-mon[32782]: pgmap v14965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:16 smithi196 ceph-mon[32572]: pgmap v14965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:16 smithi110 ceph-mon[28069]: pgmap v14965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27612.377787 secs 2024-04-26T19:28:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:18 smithi193 ceph-mon[32782]: pgmap v14966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:28:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27612.377787 secs 2024-04-26T19:28:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:18 smithi196 ceph-mon[32572]: pgmap v14966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:28:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27612.377787 secs 2024-04-26T19:28:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:18 smithi110 ceph-mon[28069]: pgmap v14966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:28:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:19 smithi193 ceph-mon[32782]: pgmap v14967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:19 smithi196 ceph-mon[32572]: pgmap v14967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:19 smithi110 ceph-mon[28069]: pgmap v14967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:22 smithi196 ceph-mon[32572]: pgmap v14968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:22 smithi110 ceph-mon[28069]: pgmap v14968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:22 smithi193 ceph-mon[32782]: pgmap v14968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27617.377903 secs 2024-04-26T19:28:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27617.377903 secs 2024-04-26T19:28:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27617.377903 secs 2024-04-26T19:28:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:24 smithi196 ceph-mon[32572]: pgmap v14969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:24 smithi110 ceph-mon[28069]: pgmap v14969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:24 smithi193 ceph-mon[32782]: pgmap v14969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:26 smithi196 ceph-mon[32572]: pgmap v14970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:26 smithi110 ceph-mon[28069]: pgmap v14970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:26 smithi193 ceph-mon[32782]: pgmap v14970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27622.378020 secs 2024-04-26T19:28:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:28 smithi196 ceph-mon[32572]: pgmap v14971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27622.378020 secs 2024-04-26T19:28:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:28 smithi110 ceph-mon[28069]: pgmap v14971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27622.378020 secs 2024-04-26T19:28:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:28 smithi193 ceph-mon[32782]: pgmap v14971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:30 smithi196 ceph-mon[32572]: pgmap v14972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:30 smithi110 ceph-mon[28069]: pgmap v14972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:30 smithi193 ceph-mon[32782]: pgmap v14972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:32 smithi196 ceph-mon[32572]: pgmap v14973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:32 smithi110 ceph-mon[28069]: pgmap v14973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:32 smithi193 ceph-mon[32782]: pgmap v14973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27627.378113 secs 2024-04-26T19:28:33.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27627.378113 secs 2024-04-26T19:28:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27627.378113 secs 2024-04-26T19:28:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:34 smithi196 ceph-mon[32572]: pgmap v14974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:34 smithi110 ceph-mon[28069]: pgmap v14974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:34 smithi193 ceph-mon[32782]: pgmap v14974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:36 smithi196 ceph-mon[32572]: pgmap v14975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:36 smithi110 ceph-mon[28069]: pgmap v14975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:36 smithi193 ceph-mon[32782]: pgmap v14975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27632.378252 secs 2024-04-26T19:28:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:38 smithi196 ceph-mon[32572]: pgmap v14976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27632.378252 secs 2024-04-26T19:28:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:38 smithi110 ceph-mon[28069]: pgmap v14976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27632.378252 secs 2024-04-26T19:28:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:38 smithi193 ceph-mon[32782]: pgmap v14976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:40 smithi110 ceph-mon[28069]: pgmap v14977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:40 smithi193 ceph-mon[32782]: pgmap v14977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:40 smithi196 ceph-mon[32572]: pgmap v14977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:42 smithi110 ceph-mon[28069]: pgmap v14978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:42 smithi193 ceph-mon[32782]: pgmap v14978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:42 smithi196 ceph-mon[32572]: pgmap v14978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27637.378400 secs 2024-04-26T19:28:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27637.378400 secs 2024-04-26T19:28:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27637.378400 secs 2024-04-26T19:28:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:44 smithi110 ceph-mon[28069]: pgmap v14979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:44 smithi193 ceph-mon[32782]: pgmap v14979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:44 smithi196 ceph-mon[32572]: pgmap v14979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:46 smithi110 ceph-mon[28069]: pgmap v14980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:46 smithi193 ceph-mon[32782]: pgmap v14980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:46 smithi196 ceph-mon[32572]: pgmap v14980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27642.378550 secs 2024-04-26T19:28:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:48 smithi110 ceph-mon[28069]: pgmap v14981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27642.378550 secs 2024-04-26T19:28:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:48 smithi193 ceph-mon[32782]: pgmap v14981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27642.378550 secs 2024-04-26T19:28:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:48 smithi196 ceph-mon[32572]: pgmap v14981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:50 smithi110 ceph-mon[28069]: pgmap v14982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:50 smithi193 ceph-mon[32782]: pgmap v14982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:50 smithi196 ceph-mon[32572]: pgmap v14982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:52 smithi193 ceph-mon[32782]: pgmap v14983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:52 smithi196 ceph-mon[32572]: pgmap v14983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:52.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:52 smithi110 ceph-mon[28069]: pgmap v14983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27647.378671 secs 2024-04-26T19:28:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27647.378671 secs 2024-04-26T19:28:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27647.378671 secs 2024-04-26T19:28:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:54 smithi193 ceph-mon[32782]: pgmap v14984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:54 smithi196 ceph-mon[32572]: pgmap v14984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:54 smithi110 ceph-mon[28069]: pgmap v14984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:28:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:55 smithi193 ceph-mon[32782]: pgmap v14985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:55 smithi196 ceph-mon[32572]: pgmap v14985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:55 smithi110 ceph-mon[28069]: pgmap v14985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27652.378788 secs 2024-04-26T19:28:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:28:58 smithi196 ceph-mon[32572]: pgmap v14986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27652.378788 secs 2024-04-26T19:28:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:28:58 smithi110 ceph-mon[28069]: pgmap v14986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:28:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27652.378788 secs 2024-04-26T19:28:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:28:58 smithi193 ceph-mon[32782]: pgmap v14986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:00 smithi196 ceph-mon[32572]: pgmap v14987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:00 smithi110 ceph-mon[28069]: pgmap v14987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:00 smithi193 ceph-mon[32782]: pgmap v14987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:02 smithi196 ceph-mon[32572]: pgmap v14988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:02 smithi110 ceph-mon[28069]: pgmap v14988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:02 smithi193 ceph-mon[32782]: pgmap v14988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27657.378852 secs 2024-04-26T19:29:03.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27657.378852 secs 2024-04-26T19:29:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27657.378852 secs 2024-04-26T19:29:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:04 smithi196 ceph-mon[32572]: pgmap v14989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:04 smithi110 ceph-mon[28069]: pgmap v14989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:04 smithi193 ceph-mon[32782]: pgmap v14989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:06 smithi196 ceph-mon[32572]: pgmap v14990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:06 smithi110 ceph-mon[28069]: pgmap v14990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:06 smithi193 ceph-mon[32782]: pgmap v14990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:08.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27662.378942 secs 2024-04-26T19:29:08.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:08 smithi196 ceph-mon[32572]: pgmap v14991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:08.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:29:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27662.378942 secs 2024-04-26T19:29:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:08 smithi110 ceph-mon[28069]: pgmap v14991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:29:08.542 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27662.378942 secs 2024-04-26T19:29:08.542 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:08 smithi193 ceph-mon[32782]: pgmap v14991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:08.543 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:29:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: pgmap v14992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: pgmap v14992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: pgmap v14992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:29:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:29:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:29:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:29:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:29:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:29:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:12 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:29:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:12 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:29:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:12 smithi110 ceph-mon[28069]: pgmap v14993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:12 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:29:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:12 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:29:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:12 smithi193 ceph-mon[32782]: pgmap v14993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:12 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:29:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:12 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:29:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:12 smithi196 ceph-mon[32572]: pgmap v14993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27667.379063 secs 2024-04-26T19:29:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:29:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:29:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27667.379063 secs 2024-04-26T19:29:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:29:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:29:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27667.379063 secs 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:29:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:29:14.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:29:13.593+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:29:14.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:29:13.593+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:29:14.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:29:13.593+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:29:14.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:29:13.593+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:29:14.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:29:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:29:13.593+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:29:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:14 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:29:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:14 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:29:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:14 smithi110 ceph-mon[28069]: pgmap v14994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:29:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:14 smithi110 ceph-mon[28069]: pgmap v14995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:29:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:14 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:29:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:14 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:29:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:14 smithi193 ceph-mon[32782]: pgmap v14994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:29:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:14 smithi193 ceph-mon[32782]: pgmap v14995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:29:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:14 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:29:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:14 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:29:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:14 smithi196 ceph-mon[32572]: pgmap v14994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:29:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:14 smithi196 ceph-mon[32572]: pgmap v14995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:29:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:16 smithi110 ceph-mon[28069]: pgmap v14996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:29:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:16 smithi193 ceph-mon[32782]: pgmap v14996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:29:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:16 smithi196 ceph-mon[32572]: pgmap v14996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:29:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27672.379187 secs 2024-04-26T19:29:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:18 smithi193 ceph-mon[32782]: pgmap v14997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:29:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27672.379187 secs 2024-04-26T19:29:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:18 smithi196 ceph-mon[32572]: pgmap v14997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:29:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27672.379187 secs 2024-04-26T19:29:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:18 smithi110 ceph-mon[28069]: pgmap v14997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:29:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:20 smithi193 ceph-mon[32782]: pgmap v14998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 210 B/s wr, 2 op/s 2024-04-26T19:29:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:20 smithi196 ceph-mon[32572]: pgmap v14998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 210 B/s wr, 2 op/s 2024-04-26T19:29:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:20 smithi110 ceph-mon[28069]: pgmap v14998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 210 B/s wr, 2 op/s 2024-04-26T19:29:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:22 smithi193 ceph-mon[32782]: pgmap v14999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 210 B/s wr, 2 op/s 2024-04-26T19:29:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:22 smithi196 ceph-mon[32572]: pgmap v14999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 210 B/s wr, 2 op/s 2024-04-26T19:29:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:22 smithi110 ceph-mon[28069]: pgmap v14999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 210 B/s wr, 2 op/s 2024-04-26T19:29:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27677.379264 secs 2024-04-26T19:29:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27677.379264 secs 2024-04-26T19:29:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27677.379264 secs 2024-04-26T19:29:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:24 smithi193 ceph-mon[32782]: pgmap v15000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T19:29:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:24 smithi196 ceph-mon[32572]: pgmap v15000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T19:29:24.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:24 smithi110 ceph-mon[28069]: pgmap v15000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T19:29:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:25 smithi193 ceph-mon[32782]: pgmap v15001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:29:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:25 smithi196 ceph-mon[32572]: pgmap v15001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:29:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:25 smithi110 ceph-mon[28069]: pgmap v15001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:29:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:27 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27682.379384 secs 2024-04-26T19:29:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:27 smithi196 ceph-mon[32572]: pgmap v15002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:29:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:27 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27682.379384 secs 2024-04-26T19:29:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:27 smithi110 ceph-mon[28069]: pgmap v15002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:29:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:27 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27682.379384 secs 2024-04-26T19:29:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:27 smithi193 ceph-mon[32782]: pgmap v15002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:29:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:29 smithi196 ceph-mon[32572]: pgmap v15003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:29:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:29 smithi110 ceph-mon[28069]: pgmap v15003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:29:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:29 smithi193 ceph-mon[32782]: pgmap v15003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:29:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:31 smithi196 ceph-mon[32572]: pgmap v15004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:31 smithi110 ceph-mon[28069]: pgmap v15004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:31 smithi193 ceph-mon[32782]: pgmap v15004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27687.379501 secs 2024-04-26T19:29:33.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27687.379501 secs 2024-04-26T19:29:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27687.379501 secs 2024-04-26T19:29:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:33 smithi196 ceph-mon[32572]: pgmap v15005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:34.288 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:33 smithi193 ceph-mon[32782]: pgmap v15005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:33 smithi110 ceph-mon[28069]: pgmap v15005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:35 smithi196 ceph-mon[32572]: pgmap v15006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:35 smithi110 ceph-mon[28069]: pgmap v15006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:35 smithi193 ceph-mon[32782]: pgmap v15006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27692.379603 secs 2024-04-26T19:29:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:37 smithi196 ceph-mon[32572]: pgmap v15007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27692.379603 secs 2024-04-26T19:29:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:37 smithi110 ceph-mon[28069]: pgmap v15007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27692.379603 secs 2024-04-26T19:29:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:37 smithi193 ceph-mon[32782]: pgmap v15007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:40.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:40 smithi110 ceph-mon[28069]: pgmap v15008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:40 smithi193 ceph-mon[32782]: pgmap v15008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:40 smithi196 ceph-mon[32572]: pgmap v15008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:42 smithi110 ceph-mon[28069]: pgmap v15009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:42 smithi193 ceph-mon[32782]: pgmap v15009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:42 smithi196 ceph-mon[32572]: pgmap v15009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27697.379714 secs 2024-04-26T19:29:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27697.379714 secs 2024-04-26T19:29:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27697.379714 secs 2024-04-26T19:29:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:44 smithi110 ceph-mon[28069]: pgmap v15010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:44 smithi193 ceph-mon[32782]: pgmap v15010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:44 smithi196 ceph-mon[32572]: pgmap v15010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:46 smithi110 ceph-mon[28069]: pgmap v15011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:46 smithi193 ceph-mon[32782]: pgmap v15011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:46 smithi196 ceph-mon[32572]: pgmap v15011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27702.379833 secs 2024-04-26T19:29:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:48 smithi110 ceph-mon[28069]: pgmap v15012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27702.379833 secs 2024-04-26T19:29:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:48 smithi193 ceph-mon[32782]: pgmap v15012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27702.379833 secs 2024-04-26T19:29:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:48 smithi196 ceph-mon[32572]: pgmap v15012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:50 smithi193 ceph-mon[32782]: pgmap v15013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:50 smithi196 ceph-mon[32572]: pgmap v15013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:50 smithi110 ceph-mon[28069]: pgmap v15013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:52 smithi193 ceph-mon[32782]: pgmap v15014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:52 smithi196 ceph-mon[32572]: pgmap v15014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:52 smithi110 ceph-mon[28069]: pgmap v15014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27707.379950 secs 2024-04-26T19:29:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27707.379950 secs 2024-04-26T19:29:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27707.379950 secs 2024-04-26T19:29:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:54 smithi193 ceph-mon[32782]: pgmap v15015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:54 smithi196 ceph-mon[32572]: pgmap v15015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:54 smithi110 ceph-mon[28069]: pgmap v15015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:56 smithi193 ceph-mon[32782]: pgmap v15016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:56 smithi196 ceph-mon[32572]: pgmap v15016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:56 smithi110 ceph-mon[28069]: pgmap v15016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:57 smithi193 ceph-mon[32782]: pgmap v15017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:57 smithi196 ceph-mon[32572]: pgmap v15017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:57 smithi110 ceph-mon[28069]: pgmap v15017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:29:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27712.380086 secs 2024-04-26T19:29:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27712.380086 secs 2024-04-26T19:29:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27712.380086 secs 2024-04-26T19:29:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:29:59 smithi196 ceph-mon[32572]: pgmap v15018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:29:59 smithi110 ceph-mon[28069]: pgmap v15018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:29:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:29:59 smithi193 ceph-mon[32782]: pgmap v15018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:30:00.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:30:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:30:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:01 smithi196 ceph-mon[32572]: pgmap v15019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:01 smithi110 ceph-mon[28069]: pgmap v15019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:01 smithi193 ceph-mon[32782]: pgmap v15019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27717.380195 secs 2024-04-26T19:30:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27717.380195 secs 2024-04-26T19:30:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27717.380195 secs 2024-04-26T19:30:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:03 smithi196 ceph-mon[32572]: pgmap v15020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:03.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:03 smithi193 ceph-mon[32782]: pgmap v15020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:03 smithi110 ceph-mon[28069]: pgmap v15020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:05 smithi196 ceph-mon[32572]: pgmap v15021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:05 smithi110 ceph-mon[28069]: pgmap v15021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:06.376 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:05 smithi193 ceph-mon[32782]: pgmap v15021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27722.380293 secs 2024-04-26T19:30:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:07 smithi196 ceph-mon[32572]: pgmap v15022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:08.299 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27722.380293 secs 2024-04-26T19:30:08.300 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:07 smithi110 ceph-mon[28069]: pgmap v15022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27722.380293 secs 2024-04-26T19:30:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:07 smithi193 ceph-mon[32782]: pgmap v15022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:10 smithi110 ceph-mon[28069]: pgmap v15023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:10 smithi193 ceph-mon[32782]: pgmap v15023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:10 smithi196 ceph-mon[32572]: pgmap v15023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:12.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:12 smithi110 ceph-mon[28069]: pgmap v15024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:12 smithi193 ceph-mon[32782]: pgmap v15024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:12 smithi196 ceph-mon[32572]: pgmap v15024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27727.380408 secs 2024-04-26T19:30:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:30:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27727.380408 secs 2024-04-26T19:30:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:30:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27727.380408 secs 2024-04-26T19:30:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:30:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:14 smithi110 ceph-mon[28069]: pgmap v15025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:14 smithi193 ceph-mon[32782]: pgmap v15025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:14 smithi196 ceph-mon[32572]: pgmap v15025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:16 smithi193 ceph-mon[32782]: pgmap v15026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:16 smithi196 ceph-mon[32572]: pgmap v15026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:16.777 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:16 smithi110 ceph-mon[28069]: pgmap v15026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27732.380504 secs 2024-04-26T19:30:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:18 smithi110 ceph-mon[28069]: pgmap v15027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:18.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27732.380504 secs 2024-04-26T19:30:18.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:18 smithi193 ceph-mon[32782]: pgmap v15027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27732.380504 secs 2024-04-26T19:30:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:18 smithi196 ceph-mon[32572]: pgmap v15027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:20 smithi193 ceph-mon[32782]: pgmap v15028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:30:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:30:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:30:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:30:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:30:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:20 smithi196 ceph-mon[32572]: pgmap v15028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:30:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:30:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:30:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:30:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:30:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:20 smithi110 ceph-mon[28069]: pgmap v15028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:30:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:30:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:30:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:30:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:30:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:30:20.958+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:30:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:30:20.958+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T19:30:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:30:20.959+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 214 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T19:30:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:30:20.959+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T19:30:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:30:20.959+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 214 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T19:30:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:30:20.959+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T19:30:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:30:20.960+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 215 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T19:30:20.960 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:30:20.960+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 215 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:30:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:21 smithi193 ceph-mon[32782]: pgmap v15029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 940 B/s rd, 1 op/s 2024-04-26T19:30:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:21 smithi193 ceph-mon[32782]: pgmap v15030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:21 smithi196 ceph-mon[32572]: pgmap v15029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 940 B/s rd, 1 op/s 2024-04-26T19:30:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:21 smithi196 ceph-mon[32572]: pgmap v15030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:21 smithi110 ceph-mon[28069]: pgmap v15029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 940 B/s rd, 1 op/s 2024-04-26T19:30:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:21 smithi110 ceph-mon[28069]: pgmap v15030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27737.380624 secs 2024-04-26T19:30:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:23 smithi193 ceph-mon[32782]: pgmap v15031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 575 B/s rd, 1 op/s 2024-04-26T19:30:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27737.380624 secs 2024-04-26T19:30:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:23 smithi196 ceph-mon[32572]: pgmap v15031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 575 B/s rd, 1 op/s 2024-04-26T19:30:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27737.380624 secs 2024-04-26T19:30:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:23 smithi110 ceph-mon[28069]: pgmap v15031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 575 B/s rd, 1 op/s 2024-04-26T19:30:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:25 smithi193 ceph-mon[32782]: pgmap v15032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:25 smithi196 ceph-mon[32572]: pgmap v15032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:25 smithi110 ceph-mon[28069]: pgmap v15032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:27 smithi193 ceph-mon[32782]: pgmap v15033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:27 smithi196 ceph-mon[32572]: pgmap v15033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:27 smithi110 ceph-mon[28069]: pgmap v15033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27742.380739 secs 2024-04-26T19:30:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27742.380739 secs 2024-04-26T19:30:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27742.380739 secs 2024-04-26T19:30:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:29 smithi110 ceph-mon[28069]: pgmap v15034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:29 smithi193 ceph-mon[32782]: pgmap v15034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:29 smithi196 ceph-mon[32572]: pgmap v15034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:30 smithi193 ceph-mon[32782]: pgmap v15035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:30:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:30 smithi196 ceph-mon[32572]: pgmap v15035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:30:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:30 smithi110 ceph-mon[28069]: pgmap v15035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:30:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27747.380873 secs 2024-04-26T19:30:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:32 smithi193 ceph-mon[32782]: pgmap v15036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27747.380873 secs 2024-04-26T19:30:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:32 smithi196 ceph-mon[32572]: pgmap v15036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27747.380873 secs 2024-04-26T19:30:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:32 smithi110 ceph-mon[28069]: pgmap v15036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:34 smithi193 ceph-mon[32782]: pgmap v15037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:34 smithi196 ceph-mon[32572]: pgmap v15037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:34 smithi110 ceph-mon[28069]: pgmap v15037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:36 smithi193 ceph-mon[32782]: pgmap v15038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:37.127 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:36 smithi110 ceph-mon[28069]: pgmap v15038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:37.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:36 smithi196 ceph-mon[32572]: pgmap v15038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27752.380989 secs 2024-04-26T19:30:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27752.380989 secs 2024-04-26T19:30:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27752.380989 secs 2024-04-26T19:30:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:38 smithi110 ceph-mon[28069]: pgmap v15039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:38 smithi196 ceph-mon[32572]: pgmap v15039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:38 smithi193 ceph-mon[32782]: pgmap v15039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:40 smithi196 ceph-mon[32572]: pgmap v15040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:40 smithi110 ceph-mon[28069]: pgmap v15040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:40 smithi193 ceph-mon[32782]: pgmap v15040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:42 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27757.381106 secs 2024-04-26T19:30:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:42 smithi196 ceph-mon[32572]: pgmap v15041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:42 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27757.381106 secs 2024-04-26T19:30:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:42 smithi110 ceph-mon[28069]: pgmap v15041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:42 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27757.381106 secs 2024-04-26T19:30:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:42 smithi193 ceph-mon[32782]: pgmap v15041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:44 smithi196 ceph-mon[32572]: pgmap v15042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:44 smithi110 ceph-mon[28069]: pgmap v15042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:44 smithi193 ceph-mon[32782]: pgmap v15042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:46 smithi196 ceph-mon[32572]: pgmap v15043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:46 smithi110 ceph-mon[28069]: pgmap v15043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:46 smithi193 ceph-mon[32782]: pgmap v15043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:48.157 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:47 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27762.381205 secs 2024-04-26T19:30:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:47 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27762.381205 secs 2024-04-26T19:30:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:47 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27762.381205 secs 2024-04-26T19:30:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:48 smithi196 ceph-mon[32572]: pgmap v15044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:48 smithi110 ceph-mon[28069]: pgmap v15044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:48 smithi193 ceph-mon[32782]: pgmap v15044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:50 smithi196 ceph-mon[32572]: pgmap v15045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:50 smithi110 ceph-mon[28069]: pgmap v15045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:50 smithi193 ceph-mon[32782]: pgmap v15045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27767.381339 secs 2024-04-26T19:30:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:52 smithi196 ceph-mon[32572]: pgmap v15046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27767.381339 secs 2024-04-26T19:30:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:52 smithi110 ceph-mon[28069]: pgmap v15046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27767.381339 secs 2024-04-26T19:30:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:52 smithi193 ceph-mon[32782]: pgmap v15046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:54 smithi196 ceph-mon[32572]: pgmap v15047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:54 smithi110 ceph-mon[28069]: pgmap v15047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:54 smithi193 ceph-mon[32782]: pgmap v15047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:56 smithi196 ceph-mon[32572]: pgmap v15048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:56 smithi110 ceph-mon[28069]: pgmap v15048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:56 smithi193 ceph-mon[32782]: pgmap v15048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:30:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27772.381473 secs 2024-04-26T19:30:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27772.381473 secs 2024-04-26T19:30:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27772.381473 secs 2024-04-26T19:30:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:30:58 smithi196 ceph-mon[32572]: pgmap v15049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:30:58 smithi110 ceph-mon[28069]: pgmap v15049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:30:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:30:58 smithi193 ceph-mon[32782]: pgmap v15049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:00 smithi196 ceph-mon[32572]: pgmap v15050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:00 smithi110 ceph-mon[28069]: pgmap v15050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:00 smithi193 ceph-mon[32782]: pgmap v15050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27777.381594 secs 2024-04-26T19:31:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:02 smithi196 ceph-mon[32572]: pgmap v15051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27777.381594 secs 2024-04-26T19:31:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:02 smithi110 ceph-mon[28069]: pgmap v15051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27777.381594 secs 2024-04-26T19:31:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:02 smithi193 ceph-mon[32782]: pgmap v15051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:04 smithi196 ceph-mon[32572]: pgmap v15052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:04 smithi110 ceph-mon[28069]: pgmap v15052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:04 smithi193 ceph-mon[32782]: pgmap v15052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:06 smithi196 ceph-mon[32572]: pgmap v15053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:06 smithi110 ceph-mon[28069]: pgmap v15053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:06 smithi193 ceph-mon[32782]: pgmap v15053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27782.381719 secs 2024-04-26T19:31:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27782.381719 secs 2024-04-26T19:31:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27782.381719 secs 2024-04-26T19:31:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:08 smithi196 ceph-mon[32572]: pgmap v15054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:08 smithi110 ceph-mon[28069]: pgmap v15054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:08 smithi193 ceph-mon[32782]: pgmap v15054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:10 smithi196 ceph-mon[32572]: pgmap v15055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:31:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:10 smithi110 ceph-mon[28069]: pgmap v15055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:31:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:10 smithi193 ceph-mon[32782]: pgmap v15055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:31:13.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27787.381829 secs 2024-04-26T19:31:13.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:12 smithi196 ceph-mon[32572]: pgmap v15056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:31:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27787.381829 secs 2024-04-26T19:31:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:12 smithi110 ceph-mon[28069]: pgmap v15056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:31:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27787.381829 secs 2024-04-26T19:31:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:12 smithi193 ceph-mon[32782]: pgmap v15056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:31:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:14 smithi196 ceph-mon[32572]: pgmap v15057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:14 smithi110 ceph-mon[28069]: pgmap v15057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:14 smithi193 ceph-mon[32782]: pgmap v15057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:16 smithi196 ceph-mon[32572]: pgmap v15058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:31:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:16 smithi110 ceph-mon[28069]: pgmap v15058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:31:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:16 smithi193 ceph-mon[32782]: pgmap v15058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:31:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27792.381942 secs 2024-04-26T19:31:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27792.381942 secs 2024-04-26T19:31:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27792.381942 secs 2024-04-26T19:31:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:19 smithi110 ceph-mon[28069]: pgmap v15059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:19 smithi193 ceph-mon[32782]: pgmap v15059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:19 smithi196 ceph-mon[32572]: pgmap v15059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:21 smithi110 ceph-mon[28069]: pgmap v15060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:31:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:21 smithi193 ceph-mon[32782]: pgmap v15060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:31:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:21 smithi196 ceph-mon[32572]: pgmap v15060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:31:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:31:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:31:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:31:22.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:31:22.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:31:22.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:31:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:31:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:31:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:31:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:23 smithi110 ceph-mon[28069]: pgmap v15061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:31:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:23 smithi110 ceph-mon[28069]: pgmap v15062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:31:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27797.382057 secs 2024-04-26T19:31:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:23 smithi193 ceph-mon[32782]: pgmap v15061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:31:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:23 smithi193 ceph-mon[32782]: pgmap v15062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:31:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27797.382057 secs 2024-04-26T19:31:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:23 smithi196 ceph-mon[32572]: pgmap v15061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:31:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:23 smithi196 ceph-mon[32572]: pgmap v15062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:31:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27797.382057 secs 2024-04-26T19:31:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:25 smithi110 ceph-mon[28069]: pgmap v15063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:31:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:25 smithi193 ceph-mon[32782]: pgmap v15063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:31:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:25 smithi196 ceph-mon[32572]: pgmap v15063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:31:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:27 smithi110 ceph-mon[28069]: pgmap v15064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:31:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:27 smithi193 ceph-mon[32782]: pgmap v15064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:31:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:27 smithi196 ceph-mon[32572]: pgmap v15064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:31:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27802.382175 secs 2024-04-26T19:31:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27802.382175 secs 2024-04-26T19:31:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27802.382175 secs 2024-04-26T19:31:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:29 smithi193 ceph-mon[32782]: pgmap v15065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:31:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:29 smithi196 ceph-mon[32572]: pgmap v15065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:31:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:29 smithi110 ceph-mon[28069]: pgmap v15065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:31:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:31 smithi193 ceph-mon[32782]: pgmap v15066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:31:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:31 smithi196 ceph-mon[32572]: pgmap v15066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:31:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:31 smithi110 ceph-mon[28069]: pgmap v15066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:31:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:33 smithi193 ceph-mon[32782]: pgmap v15067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:31:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27807.382292 secs 2024-04-26T19:31:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:33 smithi196 ceph-mon[32572]: pgmap v15067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:31:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27807.382292 secs 2024-04-26T19:31:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:33 smithi110 ceph-mon[28069]: pgmap v15067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:31:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27807.382292 secs 2024-04-26T19:31:35.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:35 smithi193 ceph-mon[32782]: pgmap v15068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:35 smithi196 ceph-mon[32572]: pgmap v15068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:35 smithi110 ceph-mon[28069]: pgmap v15068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:37.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:37 smithi110 ceph-mon[28069]: pgmap v15069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:37 smithi193 ceph-mon[32782]: pgmap v15069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:37 smithi196 ceph-mon[32572]: pgmap v15069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27812.382411 secs 2024-04-26T19:31:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27812.382411 secs 2024-04-26T19:31:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27812.382411 secs 2024-04-26T19:31:39.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:39 smithi193 ceph-mon[32782]: pgmap v15070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:39 smithi196 ceph-mon[32572]: pgmap v15070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:39.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:39 smithi110 ceph-mon[28069]: pgmap v15070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:41 smithi193 ceph-mon[32782]: pgmap v15071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:41 smithi196 ceph-mon[32572]: pgmap v15071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:41 smithi110 ceph-mon[28069]: pgmap v15071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:43 smithi193 ceph-mon[32782]: pgmap v15072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27817.382534 secs 2024-04-26T19:31:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:43 smithi196 ceph-mon[32572]: pgmap v15072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27817.382534 secs 2024-04-26T19:31:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:43 smithi110 ceph-mon[28069]: pgmap v15072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27817.382534 secs 2024-04-26T19:31:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:45 smithi193 ceph-mon[32782]: pgmap v15073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:45 smithi196 ceph-mon[32572]: pgmap v15073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:45 smithi110 ceph-mon[28069]: pgmap v15073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:47 smithi193 ceph-mon[32782]: pgmap v15074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:47 smithi196 ceph-mon[32572]: pgmap v15074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:47 smithi110 ceph-mon[28069]: pgmap v15074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27822.382632 secs 2024-04-26T19:31:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27822.382632 secs 2024-04-26T19:31:48.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27822.382632 secs 2024-04-26T19:31:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:49 smithi196 ceph-mon[32572]: pgmap v15075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:49 smithi110 ceph-mon[28069]: pgmap v15075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:49 smithi193 ceph-mon[32782]: pgmap v15075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:51 smithi196 ceph-mon[32572]: pgmap v15076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:51 smithi110 ceph-mon[28069]: pgmap v15076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:51 smithi193 ceph-mon[32782]: pgmap v15076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:53 smithi196 ceph-mon[32572]: pgmap v15077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27827.382755 secs 2024-04-26T19:31:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:53 smithi110 ceph-mon[28069]: pgmap v15077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27827.382755 secs 2024-04-26T19:31:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:53 smithi193 ceph-mon[32782]: pgmap v15077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27827.382755 secs 2024-04-26T19:31:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:55 smithi196 ceph-mon[32572]: pgmap v15078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:55 smithi110 ceph-mon[28069]: pgmap v15078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:55 smithi193 ceph-mon[32782]: pgmap v15078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:57 smithi196 ceph-mon[32572]: pgmap v15079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:57 smithi110 ceph-mon[28069]: pgmap v15079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:57 smithi193 ceph-mon[32782]: pgmap v15079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:31:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27832.382836 secs 2024-04-26T19:31:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27832.382836 secs 2024-04-26T19:31:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27832.382836 secs 2024-04-26T19:31:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:31:59 smithi196 ceph-mon[32572]: pgmap v15080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:31:59 smithi110 ceph-mon[28069]: pgmap v15080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:31:59 smithi193 ceph-mon[32782]: pgmap v15080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:01 smithi196 ceph-mon[32572]: pgmap v15081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:01 smithi110 ceph-mon[28069]: pgmap v15081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:01 smithi193 ceph-mon[32782]: pgmap v15081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:03.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:03 smithi193 ceph-mon[32782]: pgmap v15082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:03.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27837.382968 secs 2024-04-26T19:32:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:03 smithi196 ceph-mon[32572]: pgmap v15082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27837.382968 secs 2024-04-26T19:32:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:03 smithi110 ceph-mon[28069]: pgmap v15082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27837.382968 secs 2024-04-26T19:32:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:05 smithi196 ceph-mon[32572]: pgmap v15083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:05 smithi110 ceph-mon[28069]: pgmap v15083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:05 smithi193 ceph-mon[32782]: pgmap v15083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:07 smithi196 ceph-mon[32572]: pgmap v15084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:07 smithi110 ceph-mon[28069]: pgmap v15084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:07 smithi193 ceph-mon[32782]: pgmap v15084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27842.383068 secs 2024-04-26T19:32:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27842.383068 secs 2024-04-26T19:32:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27842.383068 secs 2024-04-26T19:32:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:09 smithi196 ceph-mon[32572]: pgmap v15085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:09 smithi110 ceph-mon[28069]: pgmap v15085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:09 smithi193 ceph-mon[32782]: pgmap v15085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:11 smithi196 ceph-mon[32572]: pgmap v15086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:11 smithi110 ceph-mon[28069]: pgmap v15086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:11 smithi193 ceph-mon[32782]: pgmap v15086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:13 smithi196 ceph-mon[32572]: pgmap v15087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27847.383205 secs 2024-04-26T19:32:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:13 smithi110 ceph-mon[28069]: pgmap v15087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27847.383205 secs 2024-04-26T19:32:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:13 smithi193 ceph-mon[32782]: pgmap v15087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27847.383205 secs 2024-04-26T19:32:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:15 smithi196 ceph-mon[32572]: pgmap v15088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:15 smithi110 ceph-mon[28069]: pgmap v15088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:15 smithi193 ceph-mon[32782]: pgmap v15088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:17 smithi196 ceph-mon[32572]: pgmap v15089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:17 smithi110 ceph-mon[28069]: pgmap v15089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:17 smithi193 ceph-mon[32782]: pgmap v15089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27852.383316 secs 2024-04-26T19:32:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27852.383316 secs 2024-04-26T19:32:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27852.383316 secs 2024-04-26T19:32:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:19 smithi196 ceph-mon[32572]: pgmap v15090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:19 smithi110 ceph-mon[28069]: pgmap v15090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:19 smithi193 ceph-mon[32782]: pgmap v15090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:21 smithi196 ceph-mon[32572]: pgmap v15091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:21 smithi110 ceph-mon[28069]: pgmap v15091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:21 smithi193 ceph-mon[32782]: pgmap v15091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:32:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:32:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:32:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:23 smithi196 ceph-mon[32572]: pgmap v15092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27857.383400 secs 2024-04-26T19:32:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:32:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:32:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:32:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:23 smithi110 ceph-mon[28069]: pgmap v15092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27857.383400 secs 2024-04-26T19:32:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:32:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:32:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:32:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:23 smithi193 ceph-mon[32782]: pgmap v15092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27857.383400 secs 2024-04-26T19:32:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:32:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:32:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:32:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:24 smithi110 ceph-mon[28069]: pgmap v15093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:32:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:24 smithi110 ceph-mon[28069]: pgmap v15094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:24 smithi193 ceph-mon[32782]: pgmap v15093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:32:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:24 smithi193 ceph-mon[32782]: pgmap v15094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:24 smithi196 ceph-mon[32572]: pgmap v15093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:32:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:24 smithi196 ceph-mon[32572]: pgmap v15094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:26 smithi110 ceph-mon[28069]: pgmap v15095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:26 smithi193 ceph-mon[32782]: pgmap v15095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:26 smithi196 ceph-mon[32572]: pgmap v15095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27862.383460 secs 2024-04-26T19:32:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:28 smithi110 ceph-mon[28069]: pgmap v15096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:32:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27862.383460 secs 2024-04-26T19:32:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:28 smithi193 ceph-mon[32782]: pgmap v15096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:32:28.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27862.383460 secs 2024-04-26T19:32:28.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:28 smithi196 ceph-mon[32572]: pgmap v15096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:32:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:30 smithi110 ceph-mon[28069]: pgmap v15097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:30 smithi193 ceph-mon[32782]: pgmap v15097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:30 smithi196 ceph-mon[32572]: pgmap v15097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:32 smithi110 ceph-mon[28069]: pgmap v15098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:32 smithi193 ceph-mon[32782]: pgmap v15098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:32 smithi196 ceph-mon[32572]: pgmap v15098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27867.383581 secs 2024-04-26T19:32:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27867.383581 secs 2024-04-26T19:32:33.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27867.383581 secs 2024-04-26T19:32:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:34 smithi110 ceph-mon[28069]: pgmap v15099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:32:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:34 smithi193 ceph-mon[32782]: pgmap v15099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:32:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:34 smithi196 ceph-mon[32572]: pgmap v15099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:32:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:36 smithi193 ceph-mon[32782]: pgmap v15100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:36 smithi196 ceph-mon[32572]: pgmap v15100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:36 smithi110 ceph-mon[28069]: pgmap v15100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:38.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27872.383700 secs 2024-04-26T19:32:38.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:38 smithi110 ceph-mon[28069]: pgmap v15101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27872.383700 secs 2024-04-26T19:32:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:38 smithi193 ceph-mon[32782]: pgmap v15101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27872.383700 secs 2024-04-26T19:32:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:38 smithi196 ceph-mon[32572]: pgmap v15101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:40 smithi193 ceph-mon[32782]: pgmap v15102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:40 smithi196 ceph-mon[32572]: pgmap v15102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:40 smithi110 ceph-mon[28069]: pgmap v15102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:42 smithi193 ceph-mon[32782]: pgmap v15103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:42 smithi196 ceph-mon[32572]: pgmap v15103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:42 smithi110 ceph-mon[28069]: pgmap v15103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27877.383830 secs 2024-04-26T19:32:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27877.383830 secs 2024-04-26T19:32:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27877.383830 secs 2024-04-26T19:32:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:44 smithi193 ceph-mon[32782]: pgmap v15104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:44 smithi196 ceph-mon[32572]: pgmap v15104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:44 smithi110 ceph-mon[28069]: pgmap v15104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:46 smithi193 ceph-mon[32782]: pgmap v15105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:46 smithi196 ceph-mon[32572]: pgmap v15105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:46 smithi110 ceph-mon[28069]: pgmap v15105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27882.383951 secs 2024-04-26T19:32:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:48 smithi193 ceph-mon[32782]: pgmap v15106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27882.383951 secs 2024-04-26T19:32:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:48 smithi196 ceph-mon[32572]: pgmap v15106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27882.383951 secs 2024-04-26T19:32:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:48 smithi110 ceph-mon[28069]: pgmap v15106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:50 smithi193 ceph-mon[32782]: pgmap v15107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:50 smithi196 ceph-mon[32572]: pgmap v15107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:50.795 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:50 smithi110 ceph-mon[28069]: pgmap v15107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:52 smithi193 ceph-mon[32782]: pgmap v15108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:52 smithi196 ceph-mon[32572]: pgmap v15108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:52 smithi110 ceph-mon[28069]: pgmap v15108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27887.384086 secs 2024-04-26T19:32:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27887.384086 secs 2024-04-26T19:32:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27887.384086 secs 2024-04-26T19:32:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:54 smithi193 ceph-mon[32782]: pgmap v15109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:54 smithi196 ceph-mon[32572]: pgmap v15109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:54 smithi110 ceph-mon[28069]: pgmap v15109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:32:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:55 smithi193 ceph-mon[32782]: pgmap v15110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:55 smithi196 ceph-mon[32572]: pgmap v15110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:55 smithi110 ceph-mon[28069]: pgmap v15110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27892.384234 secs 2024-04-26T19:32:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:57 smithi196 ceph-mon[32572]: pgmap v15111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27892.384234 secs 2024-04-26T19:32:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:57 smithi110 ceph-mon[28069]: pgmap v15111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:32:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27892.384234 secs 2024-04-26T19:32:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:57 smithi193 ceph-mon[32782]: pgmap v15111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:32:59 smithi196 ceph-mon[32572]: pgmap v15112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:32:59 smithi110 ceph-mon[28069]: pgmap v15112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:32:59 smithi193 ceph-mon[32782]: pgmap v15112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:02 smithi196 ceph-mon[32572]: pgmap v15113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:02 smithi110 ceph-mon[28069]: pgmap v15113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:02 smithi193 ceph-mon[32782]: pgmap v15113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:03.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27897.384374 secs 2024-04-26T19:33:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27897.384374 secs 2024-04-26T19:33:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27897.384374 secs 2024-04-26T19:33:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:04 smithi110 ceph-mon[28069]: pgmap v15114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:04 smithi193 ceph-mon[32782]: pgmap v15114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:04 smithi196 ceph-mon[32572]: pgmap v15114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:06 smithi110 ceph-mon[28069]: pgmap v15115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:06 smithi193 ceph-mon[32782]: pgmap v15115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:06 smithi196 ceph-mon[32572]: pgmap v15115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27902.384487 secs 2024-04-26T19:33:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:08 smithi110 ceph-mon[28069]: pgmap v15116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27902.384487 secs 2024-04-26T19:33:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:08 smithi193 ceph-mon[32782]: pgmap v15116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27902.384487 secs 2024-04-26T19:33:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:08 smithi196 ceph-mon[32572]: pgmap v15116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:10 smithi193 ceph-mon[32782]: pgmap v15117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:10 smithi196 ceph-mon[32572]: pgmap v15117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:10 smithi110 ceph-mon[28069]: pgmap v15117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:12 smithi193 ceph-mon[32782]: pgmap v15118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:12 smithi196 ceph-mon[32572]: pgmap v15118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:12 smithi110 ceph-mon[28069]: pgmap v15118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27907.384604 secs 2024-04-26T19:33:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27907.384604 secs 2024-04-26T19:33:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27907.384604 secs 2024-04-26T19:33:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:14 smithi193 ceph-mon[32782]: pgmap v15119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:14 smithi196 ceph-mon[32572]: pgmap v15119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:14 smithi110 ceph-mon[28069]: pgmap v15119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.455+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T19:33:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.455+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T19:33:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.455+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:33:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.455+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T19:33:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.456+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:33:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.457+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T19:33:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.457+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T19:33:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.458+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T19:33:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.458+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T19:33:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.458+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:33:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.458+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e070 comp rx=0 tx=0).stop 2024-04-26T19:33:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.458+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T19:33:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.458+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T19:33:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.458+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T19:33:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.458+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T19:33:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.459+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:33:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:16.460+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261406b040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T19:33:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:16 smithi193 ceph-mon[32782]: pgmap v15120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:16 smithi196 ceph-mon[32572]: pgmap v15120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:16 smithi110 ceph-mon[28069]: pgmap v15120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:17 smithi196 ceph-mon[32572]: 22 slow requests, 1 included below; oldest blocked for > 27912.384696 secs 2024-04-26T19:33:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:17 smithi196 ceph-mon[32572]: slow request 1443.646310 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:33:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:17 smithi196 ceph-mon[32572]: pgmap v15121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:17 smithi110 ceph-mon[28069]: 22 slow requests, 1 included below; oldest blocked for > 27912.384696 secs 2024-04-26T19:33:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:17 smithi110 ceph-mon[28069]: slow request 1443.646310 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:33:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:17 smithi110 ceph-mon[28069]: pgmap v15121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:17 smithi193 ceph-mon[32782]: 22 slow requests, 1 included below; oldest blocked for > 27912.384696 secs 2024-04-26T19:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:17 smithi193 ceph-mon[32782]: slow request 1443.646310 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:17 smithi193 ceph-mon[32782]: pgmap v15121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:20 smithi196 ceph-mon[32572]: pgmap v15122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:20 smithi110 ceph-mon[28069]: pgmap v15122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:20 smithi193 ceph-mon[32782]: pgmap v15122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:20.988 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:20.988+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:33:20.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:20.988+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T19:33:20.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:20.989+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 216 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T19:33:20.989 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:33:20.989+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 216 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:33:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:22 smithi110 ceph-mon[28069]: pgmap v15123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:22 smithi193 ceph-mon[32782]: pgmap v15123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:22 smithi196 ceph-mon[32572]: pgmap v15123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27917.384815 secs 2024-04-26T19:33:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27917.384815 secs 2024-04-26T19:33:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27917.384815 secs 2024-04-26T19:33:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:24 smithi110 ceph-mon[28069]: pgmap v15124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:33:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:24 smithi193 ceph-mon[32782]: pgmap v15124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:33:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:24 smithi196 ceph-mon[32572]: pgmap v15124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:33:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:33:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:33:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:33:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:33:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:33:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:33:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:33:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:33:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:33:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:26 smithi110 ceph-mon[28069]: pgmap v15125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:33:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:26 smithi110 ceph-mon[28069]: pgmap v15126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:26 smithi193 ceph-mon[32782]: pgmap v15125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:33:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:26 smithi193 ceph-mon[32782]: pgmap v15126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:26 smithi196 ceph-mon[32572]: pgmap v15125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:33:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:26 smithi196 ceph-mon[32572]: pgmap v15126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:28 smithi193 ceph-mon[32782]: pgmap v15127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27922.384887 secs 2024-04-26T19:33:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:28 smithi196 ceph-mon[32572]: pgmap v15127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27922.384887 secs 2024-04-26T19:33:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:28 smithi110 ceph-mon[28069]: pgmap v15127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27922.384887 secs 2024-04-26T19:33:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:30 smithi193 ceph-mon[32782]: pgmap v15128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:30 smithi196 ceph-mon[32572]: pgmap v15128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:30 smithi110 ceph-mon[28069]: pgmap v15128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:32 smithi193 ceph-mon[32782]: pgmap v15129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:32 smithi196 ceph-mon[32572]: pgmap v15129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:32 smithi110 ceph-mon[28069]: pgmap v15129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27927.384950 secs 2024-04-26T19:33:33.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27927.384950 secs 2024-04-26T19:33:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27927.384950 secs 2024-04-26T19:33:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:34 smithi193 ceph-mon[32782]: pgmap v15130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:34 smithi196 ceph-mon[32572]: pgmap v15130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:34 smithi110 ceph-mon[28069]: pgmap v15130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:33:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:36 smithi193 ceph-mon[32782]: pgmap v15131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:33:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:36 smithi196 ceph-mon[32572]: pgmap v15131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:33:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:36 smithi110 ceph-mon[28069]: pgmap v15131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:33:38.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:38 smithi110 ceph-mon[28069]: pgmap v15132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:38.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27932.385092 secs 2024-04-26T19:33:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:38 smithi193 ceph-mon[32782]: pgmap v15132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27932.385092 secs 2024-04-26T19:33:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:38 smithi196 ceph-mon[32572]: pgmap v15132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27932.385092 secs 2024-04-26T19:33:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:40 smithi193 ceph-mon[32782]: pgmap v15133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:40 smithi196 ceph-mon[32572]: pgmap v15133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:40 smithi110 ceph-mon[28069]: pgmap v15133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:42 smithi193 ceph-mon[32782]: pgmap v15134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:42 smithi196 ceph-mon[32572]: pgmap v15134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:42 smithi110 ceph-mon[28069]: pgmap v15134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27937.385212 secs 2024-04-26T19:33:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27937.385212 secs 2024-04-26T19:33:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27937.385212 secs 2024-04-26T19:33:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:44 smithi193 ceph-mon[32782]: pgmap v15135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:44 smithi196 ceph-mon[32572]: pgmap v15135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:44 smithi110 ceph-mon[28069]: pgmap v15135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:46 smithi193 ceph-mon[32782]: pgmap v15136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:46 smithi196 ceph-mon[32572]: pgmap v15136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:46 smithi110 ceph-mon[28069]: pgmap v15136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:48 smithi193 ceph-mon[32782]: pgmap v15137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27942.385352 secs 2024-04-26T19:33:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:48 smithi196 ceph-mon[32572]: pgmap v15137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27942.385352 secs 2024-04-26T19:33:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:48 smithi110 ceph-mon[28069]: pgmap v15137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27942.385352 secs 2024-04-26T19:33:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:50 smithi193 ceph-mon[32782]: pgmap v15138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:50 smithi196 ceph-mon[32572]: pgmap v15138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:50 smithi110 ceph-mon[28069]: pgmap v15138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:52 smithi193 ceph-mon[32782]: pgmap v15139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:52 smithi196 ceph-mon[32572]: pgmap v15139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:52 smithi110 ceph-mon[28069]: pgmap v15139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27947.385413 secs 2024-04-26T19:33:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27947.385413 secs 2024-04-26T19:33:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27947.385413 secs 2024-04-26T19:33:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:54 smithi196 ceph-mon[32572]: pgmap v15140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:54 smithi110 ceph-mon[28069]: pgmap v15140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:54 smithi193 ceph-mon[32782]: pgmap v15140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:33:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:56 smithi196 ceph-mon[32572]: pgmap v15141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:56 smithi110 ceph-mon[28069]: pgmap v15141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:56 smithi193 ceph-mon[32782]: pgmap v15141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:58 smithi196 ceph-mon[32572]: pgmap v15142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:33:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27952.385554 secs 2024-04-26T19:33:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:58 smithi110 ceph-mon[28069]: pgmap v15142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:33:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27952.385554 secs 2024-04-26T19:33:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:58 smithi193 ceph-mon[32782]: pgmap v15142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:33:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:33:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27952.385554 secs 2024-04-26T19:34:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:00 smithi196 ceph-mon[32572]: pgmap v15143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:00 smithi110 ceph-mon[28069]: pgmap v15143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:00 smithi193 ceph-mon[32782]: pgmap v15143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:02 smithi196 ceph-mon[32572]: pgmap v15144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:02 smithi110 ceph-mon[28069]: pgmap v15144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:02 smithi193 ceph-mon[32782]: pgmap v15144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27957.385676 secs 2024-04-26T19:34:03.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27957.385676 secs 2024-04-26T19:34:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27957.385676 secs 2024-04-26T19:34:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:04 smithi196 ceph-mon[32572]: pgmap v15145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:04 smithi110 ceph-mon[28069]: pgmap v15145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:04 smithi193 ceph-mon[32782]: pgmap v15145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:06 smithi196 ceph-mon[32572]: pgmap v15146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:06 smithi110 ceph-mon[28069]: pgmap v15146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:06 smithi193 ceph-mon[32782]: pgmap v15146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:08 smithi196 ceph-mon[32572]: pgmap v15147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27962.385755 secs 2024-04-26T19:34:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:08 smithi110 ceph-mon[28069]: pgmap v15147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27962.385755 secs 2024-04-26T19:34:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:08 smithi193 ceph-mon[32782]: pgmap v15147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27962.385755 secs 2024-04-26T19:34:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:10 smithi193 ceph-mon[32782]: pgmap v15148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:10 smithi196 ceph-mon[32572]: pgmap v15148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:10 smithi110 ceph-mon[28069]: pgmap v15148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:12 smithi193 ceph-mon[32782]: pgmap v15149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:12 smithi196 ceph-mon[32572]: pgmap v15149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:12 smithi110 ceph-mon[28069]: pgmap v15149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27967.385874 secs 2024-04-26T19:34:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27967.385874 secs 2024-04-26T19:34:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27967.385874 secs 2024-04-26T19:34:14.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:34:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:34:13.820+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:34:14.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:34:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:34:13.820+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:34:14.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:34:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:34:13.820+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:34:14.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:34:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:34:13.820+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:34:14.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:34:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:34:13.820+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:34:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:14 smithi196 ceph-mon[32572]: pgmap v15150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:14 smithi110 ceph-mon[28069]: pgmap v15150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:14 smithi193 ceph-mon[32782]: pgmap v15150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:15 smithi196 ceph-mon[32572]: pgmap v15151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:15 smithi110 ceph-mon[28069]: pgmap v15151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:15 smithi193 ceph-mon[32782]: pgmap v15151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:17 smithi193 ceph-mon[32782]: pgmap v15152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:17 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27972.385995 secs 2024-04-26T19:34:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:17 smithi196 ceph-mon[32572]: pgmap v15152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:17 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27972.385995 secs 2024-04-26T19:34:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:17 smithi110 ceph-mon[28069]: pgmap v15152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:17 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27972.385995 secs 2024-04-26T19:34:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:19 smithi193 ceph-mon[32782]: pgmap v15153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T19:34:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:19 smithi196 ceph-mon[32572]: pgmap v15153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T19:34:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:19 smithi110 ceph-mon[28069]: pgmap v15153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T19:34:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:21 smithi193 ceph-mon[32782]: pgmap v15154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T19:34:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:21 smithi196 ceph-mon[32572]: pgmap v15154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T19:34:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:21 smithi110 ceph-mon[28069]: pgmap v15154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T19:34:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27977.386115 secs 2024-04-26T19:34:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27977.386115 secs 2024-04-26T19:34:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27977.386115 secs 2024-04-26T19:34:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:23 smithi193 ceph-mon[32782]: pgmap v15155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T19:34:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:23 smithi196 ceph-mon[32572]: pgmap v15155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T19:34:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:23 smithi110 ceph-mon[28069]: pgmap v15155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T19:34:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:25 smithi193 ceph-mon[32782]: pgmap v15156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T19:34:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:34:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:25 smithi196 ceph-mon[32572]: pgmap v15156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T19:34:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:34:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:25 smithi110 ceph-mon[28069]: pgmap v15156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T19:34:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:34:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:34:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:34:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:34:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:34:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:34:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:34:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:34:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:28 smithi193 ceph-mon[32782]: pgmap v15157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T19:34:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27982.386188 secs 2024-04-26T19:34:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:28 smithi193 ceph-mon[32782]: pgmap v15158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 296 B/s wr, 15 op/s 2024-04-26T19:34:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:28 smithi193 ceph-mon[32782]: pgmap v15159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T19:34:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:28 smithi196 ceph-mon[32572]: pgmap v15157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T19:34:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27982.386188 secs 2024-04-26T19:34:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:28 smithi196 ceph-mon[32572]: pgmap v15158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 296 B/s wr, 15 op/s 2024-04-26T19:34:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:28 smithi196 ceph-mon[32572]: pgmap v15159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T19:34:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:28 smithi110 ceph-mon[28069]: pgmap v15157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T19:34:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27982.386188 secs 2024-04-26T19:34:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:28 smithi110 ceph-mon[28069]: pgmap v15158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 296 B/s wr, 15 op/s 2024-04-26T19:34:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:28 smithi110 ceph-mon[28069]: pgmap v15159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T19:34:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:30 smithi193 ceph-mon[32782]: pgmap v15160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:30 smithi196 ceph-mon[32572]: pgmap v15160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:30 smithi110 ceph-mon[28069]: pgmap v15160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:32 smithi193 ceph-mon[32782]: pgmap v15161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T19:34:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:32 smithi196 ceph-mon[32572]: pgmap v15161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T19:34:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:32 smithi110 ceph-mon[28069]: pgmap v15161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T19:34:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27987.386336 secs 2024-04-26T19:34:33.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27987.386336 secs 2024-04-26T19:34:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27987.386336 secs 2024-04-26T19:34:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:34 smithi193 ceph-mon[32782]: pgmap v15162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:34.424 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:34 smithi196 ceph-mon[32572]: pgmap v15162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:34 smithi110 ceph-mon[28069]: pgmap v15162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:36 smithi196 ceph-mon[32572]: pgmap v15163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:36 smithi110 ceph-mon[28069]: pgmap v15163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:36 smithi193 ceph-mon[32782]: pgmap v15163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27992.386432 secs 2024-04-26T19:34:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:38 smithi196 ceph-mon[32572]: pgmap v15164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:34:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27992.386432 secs 2024-04-26T19:34:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:38 smithi110 ceph-mon[28069]: pgmap v15164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:34:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27992.386432 secs 2024-04-26T19:34:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:38 smithi193 ceph-mon[32782]: pgmap v15164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:34:40.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:40 smithi196 ceph-mon[32572]: pgmap v15165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:40 smithi110 ceph-mon[28069]: pgmap v15165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:40 smithi193 ceph-mon[32782]: pgmap v15165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:42 smithi196 ceph-mon[32572]: pgmap v15166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:42 smithi110 ceph-mon[28069]: pgmap v15166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:42 smithi193 ceph-mon[32782]: pgmap v15166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 27997.386595 secs 2024-04-26T19:34:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 27997.386595 secs 2024-04-26T19:34:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 27997.386595 secs 2024-04-26T19:34:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:44 smithi196 ceph-mon[32572]: pgmap v15167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:44 smithi110 ceph-mon[28069]: pgmap v15167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:44 smithi193 ceph-mon[32782]: pgmap v15167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:46 smithi196 ceph-mon[32572]: pgmap v15168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:46 smithi110 ceph-mon[28069]: pgmap v15168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:46 smithi193 ceph-mon[32782]: pgmap v15168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28002.386698 secs 2024-04-26T19:34:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:48 smithi196 ceph-mon[32572]: pgmap v15169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28002.386698 secs 2024-04-26T19:34:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:48 smithi110 ceph-mon[28069]: pgmap v15169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28002.386698 secs 2024-04-26T19:34:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:48 smithi193 ceph-mon[32782]: pgmap v15169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:50 smithi196 ceph-mon[32572]: pgmap v15170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:50 smithi110 ceph-mon[28069]: pgmap v15170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:50 smithi193 ceph-mon[32782]: pgmap v15170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:52 smithi196 ceph-mon[32572]: pgmap v15171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:52 smithi110 ceph-mon[28069]: pgmap v15171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:52 smithi193 ceph-mon[32782]: pgmap v15171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28007.386815 secs 2024-04-26T19:34:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28007.386815 secs 2024-04-26T19:34:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28007.386815 secs 2024-04-26T19:34:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:54 smithi196 ceph-mon[32572]: pgmap v15172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:54 smithi110 ceph-mon[28069]: pgmap v15172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:54 smithi193 ceph-mon[32782]: pgmap v15172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:34:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:56 smithi196 ceph-mon[32572]: pgmap v15173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:56 smithi110 ceph-mon[28069]: pgmap v15173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:56 smithi193 ceph-mon[32782]: pgmap v15173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28012.386935 secs 2024-04-26T19:34:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:34:58 smithi196 ceph-mon[32572]: pgmap v15174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28012.386935 secs 2024-04-26T19:34:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:34:58 smithi110 ceph-mon[28069]: pgmap v15174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:34:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28012.386935 secs 2024-04-26T19:34:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:34:58 smithi193 ceph-mon[32782]: pgmap v15174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:00 smithi196 ceph-mon[32572]: pgmap v15175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:00 smithi110 ceph-mon[28069]: pgmap v15175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:00 smithi193 ceph-mon[32782]: pgmap v15175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:02 smithi196 ceph-mon[32572]: pgmap v15176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:02 smithi110 ceph-mon[28069]: pgmap v15176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:02 smithi193 ceph-mon[32782]: pgmap v15176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28017.387050 secs 2024-04-26T19:35:03.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28017.387050 secs 2024-04-26T19:35:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28017.387050 secs 2024-04-26T19:35:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:04 smithi196 ceph-mon[32572]: pgmap v15177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:35:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:04 smithi110 ceph-mon[28069]: pgmap v15177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:35:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:04 smithi193 ceph-mon[32782]: pgmap v15177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:35:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:06 smithi196 ceph-mon[32572]: pgmap v15178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:35:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:06 smithi110 ceph-mon[28069]: pgmap v15178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:35:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:06 smithi193 ceph-mon[32782]: pgmap v15178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:35:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28022.387134 secs 2024-04-26T19:35:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:08 smithi196 ceph-mon[32572]: pgmap v15179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:35:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28022.387134 secs 2024-04-26T19:35:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:08 smithi110 ceph-mon[28069]: pgmap v15179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:35:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28022.387134 secs 2024-04-26T19:35:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:08 smithi193 ceph-mon[32782]: pgmap v15179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:35:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:10 smithi196 ceph-mon[32572]: pgmap v15180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:35:10.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:10 smithi110 ceph-mon[28069]: pgmap v15180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:35:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:10 smithi193 ceph-mon[32782]: pgmap v15180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:35:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:12 smithi196 ceph-mon[32572]: pgmap v15181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:35:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:12 smithi110 ceph-mon[28069]: pgmap v15181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:35:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:12 smithi193 ceph-mon[32782]: pgmap v15181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:35:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28027.387281 secs 2024-04-26T19:35:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28027.387281 secs 2024-04-26T19:35:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28027.387281 secs 2024-04-26T19:35:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:14 smithi110 ceph-mon[28069]: pgmap v15182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:35:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:14 smithi193 ceph-mon[32782]: pgmap v15182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:35:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:14 smithi196 ceph-mon[32572]: pgmap v15182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:35:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:16 smithi110 ceph-mon[28069]: pgmap v15183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:16 smithi193 ceph-mon[32782]: pgmap v15183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:16 smithi196 ceph-mon[32572]: pgmap v15183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28032.387403 secs 2024-04-26T19:35:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:18 smithi110 ceph-mon[28069]: pgmap v15184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28032.387403 secs 2024-04-26T19:35:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:18 smithi193 ceph-mon[32782]: pgmap v15184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28032.387403 secs 2024-04-26T19:35:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:18 smithi196 ceph-mon[32572]: pgmap v15184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:20 smithi110 ceph-mon[28069]: pgmap v15185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:20 smithi193 ceph-mon[32782]: pgmap v15185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:20 smithi196 ceph-mon[32572]: pgmap v15185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:22 smithi110 ceph-mon[28069]: pgmap v15186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:22 smithi193 ceph-mon[32782]: pgmap v15186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:22 smithi196 ceph-mon[32572]: pgmap v15186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28037.387540 secs 2024-04-26T19:35:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28037.387540 secs 2024-04-26T19:35:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28037.387540 secs 2024-04-26T19:35:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:24 smithi193 ceph-mon[32782]: pgmap v15187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:24 smithi196 ceph-mon[32572]: pgmap v15187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:24 smithi110 ceph-mon[28069]: pgmap v15187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:26 smithi193 ceph-mon[32782]: pgmap v15188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:26 smithi196 ceph-mon[32572]: pgmap v15188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:26 smithi110 ceph-mon[28069]: pgmap v15188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:35:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:35:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:35:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28042.387656 secs 2024-04-26T19:35:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:28 smithi193 ceph-mon[32782]: pgmap v15189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28042.387656 secs 2024-04-26T19:35:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:28 smithi196 ceph-mon[32572]: pgmap v15189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28042.387656 secs 2024-04-26T19:35:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:28 smithi110 ceph-mon[28069]: pgmap v15189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:35:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:35:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:35:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:35:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:35:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:35:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:35:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:35:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:35:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:30 smithi193 ceph-mon[32782]: pgmap v15190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:35:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:30 smithi193 ceph-mon[32782]: pgmap v15191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:30 smithi196 ceph-mon[32572]: pgmap v15190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:35:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:30 smithi196 ceph-mon[32572]: pgmap v15191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:30 smithi110 ceph-mon[28069]: pgmap v15190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:35:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:30 smithi110 ceph-mon[28069]: pgmap v15191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:32 smithi193 ceph-mon[32782]: pgmap v15192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:32 smithi196 ceph-mon[32572]: pgmap v15192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:32 smithi110 ceph-mon[28069]: pgmap v15192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28047.387723 secs 2024-04-26T19:35:33.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28047.387723 secs 2024-04-26T19:35:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28047.387723 secs 2024-04-26T19:35:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:34 smithi193 ceph-mon[32782]: pgmap v15193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:34 smithi196 ceph-mon[32572]: pgmap v15193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:34 smithi110 ceph-mon[28069]: pgmap v15193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:36 smithi193 ceph-mon[32782]: pgmap v15194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:36 smithi196 ceph-mon[32572]: pgmap v15194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:36 smithi110 ceph-mon[28069]: pgmap v15194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:38 smithi193 ceph-mon[32782]: pgmap v15195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28052.387844 secs 2024-04-26T19:35:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:38 smithi196 ceph-mon[32572]: pgmap v15195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28052.387844 secs 2024-04-26T19:35:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:38 smithi110 ceph-mon[28069]: pgmap v15195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:35:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28052.387844 secs 2024-04-26T19:35:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:40 smithi193 ceph-mon[32782]: pgmap v15196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:35:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:40 smithi196 ceph-mon[32572]: pgmap v15196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:35:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:40 smithi110 ceph-mon[28069]: pgmap v15196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:35:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:42 smithi193 ceph-mon[32782]: pgmap v15197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:42 smithi196 ceph-mon[32572]: pgmap v15197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:42 smithi110 ceph-mon[28069]: pgmap v15197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28057.387982 secs 2024-04-26T19:35:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28057.387982 secs 2024-04-26T19:35:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28057.387982 secs 2024-04-26T19:35:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:44 smithi196 ceph-mon[32572]: pgmap v15198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:44.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:44 smithi110 ceph-mon[28069]: pgmap v15198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:44 smithi193 ceph-mon[32782]: pgmap v15198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:46 smithi196 ceph-mon[32572]: pgmap v15199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:46 smithi110 ceph-mon[28069]: pgmap v15199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:46 smithi193 ceph-mon[32782]: pgmap v15199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:48 smithi196 ceph-mon[32572]: pgmap v15200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28062.388113 secs 2024-04-26T19:35:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:48 smithi110 ceph-mon[28069]: pgmap v15200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28062.388113 secs 2024-04-26T19:35:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:48 smithi193 ceph-mon[32782]: pgmap v15200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28062.388113 secs 2024-04-26T19:35:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:50 smithi196 ceph-mon[32572]: pgmap v15201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:50 smithi110 ceph-mon[28069]: pgmap v15201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:50 smithi193 ceph-mon[32782]: pgmap v15201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:51 smithi196 ceph-mon[32572]: pgmap v15202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:51 smithi110 ceph-mon[28069]: pgmap v15202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:51 smithi193 ceph-mon[32782]: pgmap v15202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28067.388236 secs 2024-04-26T19:35:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28067.388236 secs 2024-04-26T19:35:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28067.388236 secs 2024-04-26T19:35:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:53 smithi196 ceph-mon[32572]: pgmap v15203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:53 smithi110 ceph-mon[28069]: pgmap v15203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:53 smithi193 ceph-mon[32782]: pgmap v15203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:55 smithi110 ceph-mon[28069]: pgmap v15204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:55 smithi193 ceph-mon[32782]: pgmap v15204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:55 smithi196 ceph-mon[32572]: pgmap v15204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:57 smithi110 ceph-mon[28069]: pgmap v15205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28072.388391 secs 2024-04-26T19:35:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:57 smithi193 ceph-mon[32782]: pgmap v15205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28072.388391 secs 2024-04-26T19:35:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:57 smithi196 ceph-mon[32572]: pgmap v15205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:35:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28072.388391 secs 2024-04-26T19:35:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:35:59 smithi110 ceph-mon[28069]: pgmap v15206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:35:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:35:59 smithi193 ceph-mon[32782]: pgmap v15206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:35:59 smithi196 ceph-mon[32572]: pgmap v15206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:01 smithi110 ceph-mon[28069]: pgmap v15207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:01 smithi193 ceph-mon[32782]: pgmap v15207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:01 smithi196 ceph-mon[32572]: pgmap v15207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28077.388517 secs 2024-04-26T19:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28077.388517 secs 2024-04-26T19:36:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28077.388517 secs 2024-04-26T19:36:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:03 smithi110 ceph-mon[28069]: pgmap v15208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:03 smithi193 ceph-mon[32782]: pgmap v15208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:03.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:03 smithi196 ceph-mon[32572]: pgmap v15208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:05 smithi110 ceph-mon[28069]: pgmap v15209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:05 smithi193 ceph-mon[32782]: pgmap v15209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:05 smithi196 ceph-mon[32572]: pgmap v15209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:07 smithi193 ceph-mon[32782]: pgmap v15210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28082.388644 secs 2024-04-26T19:36:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:07 smithi196 ceph-mon[32572]: pgmap v15210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28082.388644 secs 2024-04-26T19:36:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:07 smithi110 ceph-mon[28069]: pgmap v15210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28082.388644 secs 2024-04-26T19:36:09.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:09 smithi110 ceph-mon[28069]: pgmap v15211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:09 smithi193 ceph-mon[32782]: pgmap v15211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:09 smithi196 ceph-mon[32572]: pgmap v15211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:11 smithi193 ceph-mon[32782]: pgmap v15212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:11 smithi196 ceph-mon[32572]: pgmap v15212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:11 smithi110 ceph-mon[28069]: pgmap v15212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28087.388775 secs 2024-04-26T19:36:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28087.388775 secs 2024-04-26T19:36:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28087.388775 secs 2024-04-26T19:36:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:13 smithi193 ceph-mon[32782]: pgmap v15213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:13 smithi196 ceph-mon[32572]: pgmap v15213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:13 smithi110 ceph-mon[28069]: pgmap v15213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:15 smithi193 ceph-mon[32782]: pgmap v15214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:15 smithi196 ceph-mon[32572]: pgmap v15214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:15 smithi110 ceph-mon[28069]: pgmap v15214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:17 smithi193 ceph-mon[32782]: pgmap v15215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:17 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28092.388899 secs 2024-04-26T19:36:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:17 smithi196 ceph-mon[32572]: pgmap v15215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:17 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28092.388899 secs 2024-04-26T19:36:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:17 smithi110 ceph-mon[28069]: pgmap v15215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:17 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28092.388899 secs 2024-04-26T19:36:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:19 smithi193 ceph-mon[32782]: pgmap v15216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:19 smithi196 ceph-mon[32572]: pgmap v15216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:19 smithi110 ceph-mon[28069]: pgmap v15216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:36:21.019+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T19:36:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:36:21.019+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:36:21.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:36:21.019+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 217 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:36:21.019 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:36:21.019+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 217 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T19:36:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:21 smithi193 ceph-mon[32782]: pgmap v15217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:21 smithi196 ceph-mon[32572]: pgmap v15217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:21 smithi110 ceph-mon[28069]: pgmap v15217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28097.389016 secs 2024-04-26T19:36:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28097.389016 secs 2024-04-26T19:36:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28097.389016 secs 2024-04-26T19:36:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:23 smithi193 ceph-mon[32782]: pgmap v15218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:23 smithi196 ceph-mon[32572]: pgmap v15218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:23 smithi110 ceph-mon[28069]: pgmap v15218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:25 smithi196 ceph-mon[32572]: pgmap v15219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:25 smithi110 ceph-mon[28069]: pgmap v15219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:25 smithi193 ceph-mon[32782]: pgmap v15219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:27 smithi110 ceph-mon[28069]: pgmap v15220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:27 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28102.389085 secs 2024-04-26T19:36:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:27 smithi193 ceph-mon[32782]: pgmap v15220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:27 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28102.389085 secs 2024-04-26T19:36:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:27 smithi196 ceph-mon[32572]: pgmap v15220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:27 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28102.389085 secs 2024-04-26T19:36:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:29 smithi110 ceph-mon[28069]: pgmap v15221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:36:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:29 smithi193 ceph-mon[32782]: pgmap v15221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:36:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:29 smithi196 ceph-mon[32572]: pgmap v15221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:36:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:36:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:36:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:30 smithi110 ceph-mon[28069]: pgmap v15222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:36:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:30 smithi110 ceph-mon[28069]: pgmap v15223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:36:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:36:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:36:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:30 smithi193 ceph-mon[32782]: pgmap v15222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:36:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:30 smithi193 ceph-mon[32782]: pgmap v15223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:36:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:36:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:36:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:30 smithi196 ceph-mon[32572]: pgmap v15222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:36:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:30 smithi196 ceph-mon[32572]: pgmap v15223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:36:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28107.389189 secs 2024-04-26T19:36:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:33 smithi193 ceph-mon[32782]: pgmap v15224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T19:36:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28107.389189 secs 2024-04-26T19:36:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:33 smithi196 ceph-mon[32572]: pgmap v15224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T19:36:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28107.389189 secs 2024-04-26T19:36:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:33 smithi110 ceph-mon[28069]: pgmap v15224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T19:36:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:35 smithi193 ceph-mon[32782]: pgmap v15225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:35 smithi196 ceph-mon[32572]: pgmap v15225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:35 smithi110 ceph-mon[28069]: pgmap v15225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:37 smithi193 ceph-mon[32782]: pgmap v15226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:37 smithi196 ceph-mon[32572]: pgmap v15226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:37 smithi110 ceph-mon[28069]: pgmap v15226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28112.389294 secs 2024-04-26T19:36:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28112.389294 secs 2024-04-26T19:36:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28112.389294 secs 2024-04-26T19:36:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:39 smithi193 ceph-mon[32782]: pgmap v15227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:39.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:39 smithi110 ceph-mon[28069]: pgmap v15227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:39 smithi196 ceph-mon[32572]: pgmap v15227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:36:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:41 smithi193 ceph-mon[32782]: pgmap v15228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:36:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:41 smithi196 ceph-mon[32572]: pgmap v15228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:36:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:41 smithi110 ceph-mon[28069]: pgmap v15228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:36:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28117.389442 secs 2024-04-26T19:36:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:43 smithi193 ceph-mon[32782]: pgmap v15229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28117.389442 secs 2024-04-26T19:36:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:43 smithi196 ceph-mon[32572]: pgmap v15229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28117.389442 secs 2024-04-26T19:36:43.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:43 smithi110 ceph-mon[28069]: pgmap v15229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:45 smithi193 ceph-mon[32782]: pgmap v15230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:45 smithi196 ceph-mon[32572]: pgmap v15230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:45 smithi110 ceph-mon[28069]: pgmap v15230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:47 smithi193 ceph-mon[32782]: pgmap v15231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:47 smithi196 ceph-mon[32572]: pgmap v15231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:47 smithi110 ceph-mon[28069]: pgmap v15231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28122.389593 secs 2024-04-26T19:36:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28122.389593 secs 2024-04-26T19:36:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28122.389593 secs 2024-04-26T19:36:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:49 smithi193 ceph-mon[32782]: pgmap v15232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:49 smithi196 ceph-mon[32572]: pgmap v15232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:49 smithi110 ceph-mon[28069]: pgmap v15232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:51 smithi193 ceph-mon[32782]: pgmap v15233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:51 smithi196 ceph-mon[32572]: pgmap v15233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:51 smithi110 ceph-mon[28069]: pgmap v15233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28127.389717 secs 2024-04-26T19:36:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:53 smithi193 ceph-mon[32782]: pgmap v15234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28127.389717 secs 2024-04-26T19:36:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:53 smithi196 ceph-mon[32572]: pgmap v15234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28127.389717 secs 2024-04-26T19:36:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:53 smithi110 ceph-mon[28069]: pgmap v15234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:55 smithi196 ceph-mon[32572]: pgmap v15235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:55 smithi110 ceph-mon[28069]: pgmap v15235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:55 smithi193 ceph-mon[32782]: pgmap v15235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:57 smithi196 ceph-mon[32572]: pgmap v15236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:57 smithi110 ceph-mon[28069]: pgmap v15236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:57 smithi193 ceph-mon[32782]: pgmap v15236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:36:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28132.389786 secs 2024-04-26T19:36:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28132.389786 secs 2024-04-26T19:36:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28132.389786 secs 2024-04-26T19:36:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:36:59 smithi196 ceph-mon[32572]: pgmap v15237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:36:59 smithi110 ceph-mon[28069]: pgmap v15237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:36:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:36:59 smithi193 ceph-mon[32782]: pgmap v15237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:01 smithi196 ceph-mon[32572]: pgmap v15238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:01 smithi110 ceph-mon[28069]: pgmap v15238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:01 smithi193 ceph-mon[32782]: pgmap v15238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:03.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28137.389902 secs 2024-04-26T19:37:03.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:03 smithi193 ceph-mon[32782]: pgmap v15239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28137.389902 secs 2024-04-26T19:37:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:03 smithi196 ceph-mon[32572]: pgmap v15239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28137.389902 secs 2024-04-26T19:37:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:03 smithi110 ceph-mon[28069]: pgmap v15239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:05 smithi196 ceph-mon[32572]: pgmap v15240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:05 smithi110 ceph-mon[28069]: pgmap v15240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:05 smithi193 ceph-mon[32782]: pgmap v15240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:07 smithi196 ceph-mon[32572]: pgmap v15241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:07 smithi110 ceph-mon[28069]: pgmap v15241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:07 smithi193 ceph-mon[32782]: pgmap v15241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28142.390025 secs 2024-04-26T19:37:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28142.390025 secs 2024-04-26T19:37:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28142.390025 secs 2024-04-26T19:37:09.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:09 smithi110 ceph-mon[28069]: pgmap v15242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:09 smithi196 ceph-mon[32572]: pgmap v15242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:09 smithi193 ceph-mon[32782]: pgmap v15242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:11 smithi196 ceph-mon[32572]: pgmap v15243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:11 smithi110 ceph-mon[28069]: pgmap v15243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:11 smithi193 ceph-mon[32782]: pgmap v15243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28147.390149 secs 2024-04-26T19:37:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:13 smithi196 ceph-mon[32572]: pgmap v15244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28147.390149 secs 2024-04-26T19:37:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:13 smithi110 ceph-mon[28069]: pgmap v15244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28147.390149 secs 2024-04-26T19:37:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:13 smithi193 ceph-mon[32782]: pgmap v15244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:15 smithi196 ceph-mon[32572]: pgmap v15245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:15 smithi110 ceph-mon[28069]: pgmap v15245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:15 smithi193 ceph-mon[32782]: pgmap v15245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:17 smithi196 ceph-mon[32572]: pgmap v15246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:17 smithi110 ceph-mon[28069]: pgmap v15246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:17 smithi193 ceph-mon[32782]: pgmap v15246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28152.390293 secs 2024-04-26T19:37:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28152.390293 secs 2024-04-26T19:37:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28152.390293 secs 2024-04-26T19:37:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:19 smithi196 ceph-mon[32572]: pgmap v15247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:19 smithi110 ceph-mon[28069]: pgmap v15247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:19 smithi193 ceph-mon[32782]: pgmap v15247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:21 smithi196 ceph-mon[32572]: pgmap v15248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:21 smithi110 ceph-mon[28069]: pgmap v15248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:21 smithi193 ceph-mon[32782]: pgmap v15248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28157.390412 secs 2024-04-26T19:37:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:23 smithi196 ceph-mon[32572]: pgmap v15249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28157.390412 secs 2024-04-26T19:37:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:23 smithi110 ceph-mon[28069]: pgmap v15249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28157.390412 secs 2024-04-26T19:37:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:23 smithi193 ceph-mon[32782]: pgmap v15249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:25 smithi196 ceph-mon[32572]: pgmap v15250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:25 smithi110 ceph-mon[28069]: pgmap v15250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:25 smithi193 ceph-mon[32782]: pgmap v15250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:27 smithi196 ceph-mon[32572]: pgmap v15251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:27 smithi110 ceph-mon[28069]: pgmap v15251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:27 smithi193 ceph-mon[32782]: pgmap v15251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28162.390530 secs 2024-04-26T19:37:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28162.390530 secs 2024-04-26T19:37:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28162.390530 secs 2024-04-26T19:37:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:29 smithi196 ceph-mon[32572]: pgmap v15252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:29 smithi110 ceph-mon[28069]: pgmap v15252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:29 smithi193 ceph-mon[32782]: pgmap v15252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:31 smithi196 ceph-mon[32572]: pgmap v15253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:37:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:37:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:37:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:31 smithi110 ceph-mon[28069]: pgmap v15253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:37:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:37:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:37:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:31 smithi193 ceph-mon[32782]: pgmap v15253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:37:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:37:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:37:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28167.390618 secs 2024-04-26T19:37:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:33 smithi110 ceph-mon[28069]: pgmap v15254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:37:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:37:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:37:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28167.390618 secs 2024-04-26T19:37:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:33 smithi193 ceph-mon[32782]: pgmap v15254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:37:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:37:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:37:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28167.390618 secs 2024-04-26T19:37:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:33 smithi196 ceph-mon[32572]: pgmap v15254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:37:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:37:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:37:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:34 smithi110 ceph-mon[28069]: pgmap v15255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T19:37:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:34 smithi110 ceph-mon[28069]: pgmap v15256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:34 smithi193 ceph-mon[32782]: pgmap v15255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T19:37:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:34 smithi193 ceph-mon[32782]: pgmap v15256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:34 smithi196 ceph-mon[32572]: pgmap v15255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T19:37:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:34 smithi196 ceph-mon[32572]: pgmap v15256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:35 smithi196 ceph-mon[32572]: pgmap v15257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:35 smithi110 ceph-mon[28069]: pgmap v15257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:35 smithi193 ceph-mon[32782]: pgmap v15257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:37 smithi193 ceph-mon[32782]: pgmap v15258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T19:37:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28172.390700 secs 2024-04-26T19:37:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:37 smithi196 ceph-mon[32572]: pgmap v15258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T19:37:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28172.390700 secs 2024-04-26T19:37:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:37 smithi110 ceph-mon[28069]: pgmap v15258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T19:37:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28172.390700 secs 2024-04-26T19:37:39.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:39 smithi110 ceph-mon[28069]: pgmap v15259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:39 smithi193 ceph-mon[32782]: pgmap v15259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:39 smithi196 ceph-mon[32572]: pgmap v15259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:41 smithi193 ceph-mon[32782]: pgmap v15260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:41 smithi196 ceph-mon[32572]: pgmap v15260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:41 smithi110 ceph-mon[28069]: pgmap v15260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:42 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28177.390766 secs 2024-04-26T19:37:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:42 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28177.390766 secs 2024-04-26T19:37:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:42 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28177.390766 secs 2024-04-26T19:37:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:43 smithi193 ceph-mon[32782]: pgmap v15261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:37:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:43 smithi196 ceph-mon[32572]: pgmap v15261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:37:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:43 smithi110 ceph-mon[28069]: pgmap v15261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:37:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:45 smithi193 ceph-mon[32782]: pgmap v15262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:45 smithi196 ceph-mon[32572]: pgmap v15262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:45 smithi110 ceph-mon[28069]: pgmap v15262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:47 smithi193 ceph-mon[32782]: pgmap v15263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:47 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28182.390897 secs 2024-04-26T19:37:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:47 smithi196 ceph-mon[32572]: pgmap v15263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:47 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28182.390897 secs 2024-04-26T19:37:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:47 smithi110 ceph-mon[28069]: pgmap v15263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:47 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28182.390897 secs 2024-04-26T19:37:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:49 smithi193 ceph-mon[32782]: pgmap v15264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:49 smithi196 ceph-mon[32572]: pgmap v15264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:49 smithi110 ceph-mon[28069]: pgmap v15264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:51 smithi193 ceph-mon[32782]: pgmap v15265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:51 smithi196 ceph-mon[32572]: pgmap v15265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:51 smithi110 ceph-mon[28069]: pgmap v15265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28187.390977 secs 2024-04-26T19:37:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28187.390977 secs 2024-04-26T19:37:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28187.390977 secs 2024-04-26T19:37:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:53 smithi196 ceph-mon[32572]: pgmap v15266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:53 smithi110 ceph-mon[28069]: pgmap v15266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:53 smithi193 ceph-mon[32782]: pgmap v15266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:37:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:55 smithi196 ceph-mon[32572]: pgmap v15267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:55 smithi110 ceph-mon[28069]: pgmap v15267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:55 smithi193 ceph-mon[32782]: pgmap v15267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:57 smithi196 ceph-mon[32572]: pgmap v15268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28192.391089 secs 2024-04-26T19:37:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:57 smithi110 ceph-mon[28069]: pgmap v15268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28192.391089 secs 2024-04-26T19:37:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:57 smithi193 ceph-mon[32782]: pgmap v15268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:37:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28192.391089 secs 2024-04-26T19:38:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:37:59 smithi196 ceph-mon[32572]: pgmap v15269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:37:59 smithi110 ceph-mon[28069]: pgmap v15269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:37:59 smithi193 ceph-mon[32782]: pgmap v15269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:01 smithi196 ceph-mon[32572]: pgmap v15270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:01 smithi110 ceph-mon[28069]: pgmap v15270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:01 smithi193 ceph-mon[32782]: pgmap v15270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28197.391236 secs 2024-04-26T19:38:03.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28197.391236 secs 2024-04-26T19:38:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28197.391236 secs 2024-04-26T19:38:03.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:03 smithi196 ceph-mon[32572]: pgmap v15271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:03 smithi110 ceph-mon[28069]: pgmap v15271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:03 smithi193 ceph-mon[32782]: pgmap v15271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:05 smithi196 ceph-mon[32572]: pgmap v15272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:05 smithi110 ceph-mon[28069]: pgmap v15272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:05 smithi193 ceph-mon[32782]: pgmap v15272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:07 smithi196 ceph-mon[32572]: pgmap v15273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28202.391383 secs 2024-04-26T19:38:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:07 smithi110 ceph-mon[28069]: pgmap v15273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28202.391383 secs 2024-04-26T19:38:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:07 smithi193 ceph-mon[32782]: pgmap v15273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28202.391383 secs 2024-04-26T19:38:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:09 smithi196 ceph-mon[32572]: pgmap v15274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:09 smithi110 ceph-mon[28069]: pgmap v15274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:09 smithi193 ceph-mon[32782]: pgmap v15274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:11 smithi196 ceph-mon[32572]: pgmap v15275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:11 smithi110 ceph-mon[28069]: pgmap v15275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:11 smithi193 ceph-mon[32782]: pgmap v15275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28207.391521 secs 2024-04-26T19:38:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28207.391521 secs 2024-04-26T19:38:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28207.391521 secs 2024-04-26T19:38:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:13 smithi196 ceph-mon[32572]: pgmap v15276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:13 smithi110 ceph-mon[28069]: pgmap v15276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:13 smithi193 ceph-mon[32782]: pgmap v15276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:15 smithi196 ceph-mon[32572]: pgmap v15277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:15 smithi110 ceph-mon[28069]: pgmap v15277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:15 smithi193 ceph-mon[32782]: pgmap v15277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:17 smithi196 ceph-mon[32572]: pgmap v15278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:17 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28212.391647 secs 2024-04-26T19:38:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:17 smithi110 ceph-mon[28069]: pgmap v15278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:17 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28212.391647 secs 2024-04-26T19:38:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:17 smithi193 ceph-mon[32782]: pgmap v15278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:17 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28212.391647 secs 2024-04-26T19:38:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:19 smithi196 ceph-mon[32572]: pgmap v15279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:19 smithi110 ceph-mon[28069]: pgmap v15279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:19 smithi193 ceph-mon[32782]: pgmap v15279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:21 smithi196 ceph-mon[32572]: pgmap v15280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:21 smithi110 ceph-mon[28069]: pgmap v15280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:21 smithi193 ceph-mon[32782]: pgmap v15280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28217.391724 secs 2024-04-26T19:38:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28217.391724 secs 2024-04-26T19:38:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28217.391724 secs 2024-04-26T19:38:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:23 smithi196 ceph-mon[32572]: pgmap v15281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:23 smithi110 ceph-mon[28069]: pgmap v15281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:23 smithi193 ceph-mon[32782]: pgmap v15281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:25 smithi196 ceph-mon[32572]: pgmap v15282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:25 smithi110 ceph-mon[28069]: pgmap v15282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:25 smithi193 ceph-mon[32782]: pgmap v15282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:27 smithi196 ceph-mon[32572]: pgmap v15283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:27 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28222.391844 secs 2024-04-26T19:38:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:27 smithi110 ceph-mon[28069]: pgmap v15283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:27 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28222.391844 secs 2024-04-26T19:38:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:27 smithi193 ceph-mon[32782]: pgmap v15283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:27 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28222.391844 secs 2024-04-26T19:38:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:29 smithi196 ceph-mon[32572]: pgmap v15284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:29 smithi110 ceph-mon[28069]: pgmap v15284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:29 smithi193 ceph-mon[32782]: pgmap v15284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:31 smithi196 ceph-mon[32572]: pgmap v15285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:31 smithi110 ceph-mon[28069]: pgmap v15285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:31 smithi193 ceph-mon[32782]: pgmap v15285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28227.391956 secs 2024-04-26T19:38:33.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28227.391956 secs 2024-04-26T19:38:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28227.391956 secs 2024-04-26T19:38:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:33 smithi196 ceph-mon[32572]: pgmap v15286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:38:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:33 smithi110 ceph-mon[28069]: pgmap v15286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:38:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:33 smithi193 ceph-mon[32782]: pgmap v15286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:38:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:38:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:38:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:34 smithi110 ceph-mon[28069]: pgmap v15287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:38:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:34 smithi110 ceph-mon[28069]: pgmap v15288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:38:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:38:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:34 smithi193 ceph-mon[32782]: pgmap v15287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:38:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:34 smithi193 ceph-mon[32782]: pgmap v15288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:38:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:38:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:34 smithi196 ceph-mon[32572]: pgmap v15287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:38:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:34 smithi196 ceph-mon[32572]: pgmap v15288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:38:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:38:36.041+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:38:36.041 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:38:36.041+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T19:38:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:38:36.041+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 218 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T19:38:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:38:36.042+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 218 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:38:37.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:37 smithi196 ceph-mon[32572]: pgmap v15289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:37 smithi110 ceph-mon[28069]: pgmap v15289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:37 smithi193 ceph-mon[32782]: pgmap v15289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28232.392075 secs 2024-04-26T19:38:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28232.392075 secs 2024-04-26T19:38:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28232.392075 secs 2024-04-26T19:38:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:39 smithi196 ceph-mon[32572]: pgmap v15290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:39 smithi110 ceph-mon[28069]: pgmap v15290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:39 smithi193 ceph-mon[32782]: pgmap v15290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:41 smithi196 ceph-mon[32572]: pgmap v15291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:41 smithi110 ceph-mon[28069]: pgmap v15291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:41 smithi193 ceph-mon[32782]: pgmap v15291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:38:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28237.392192 secs 2024-04-26T19:38:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:43 smithi196 ceph-mon[32572]: pgmap v15292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T19:38:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28237.392192 secs 2024-04-26T19:38:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:43 smithi110 ceph-mon[28069]: pgmap v15292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T19:38:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28237.392192 secs 2024-04-26T19:38:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:43 smithi193 ceph-mon[32782]: pgmap v15292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T19:38:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:45 smithi196 ceph-mon[32572]: pgmap v15293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:38:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:45 smithi110 ceph-mon[28069]: pgmap v15293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:38:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:45 smithi193 ceph-mon[32782]: pgmap v15293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:38:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:47 smithi196 ceph-mon[32572]: pgmap v15294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:47 smithi110 ceph-mon[28069]: pgmap v15294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:47 smithi193 ceph-mon[32782]: pgmap v15294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28242.392289 secs 2024-04-26T19:38:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28242.392289 secs 2024-04-26T19:38:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28242.392289 secs 2024-04-26T19:38:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:49 smithi196 ceph-mon[32572]: pgmap v15295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:49 smithi110 ceph-mon[28069]: pgmap v15295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:49 smithi193 ceph-mon[32782]: pgmap v15295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:51.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:51 smithi196 ceph-mon[32572]: pgmap v15296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:51 smithi110 ceph-mon[28069]: pgmap v15296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:51 smithi193 ceph-mon[32782]: pgmap v15296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28247.392413 secs 2024-04-26T19:38:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:53 smithi196 ceph-mon[32572]: pgmap v15297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28247.392413 secs 2024-04-26T19:38:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:53 smithi110 ceph-mon[28069]: pgmap v15297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28247.392413 secs 2024-04-26T19:38:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:53 smithi193 ceph-mon[32782]: pgmap v15297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:55 smithi110 ceph-mon[28069]: pgmap v15298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:55 smithi193 ceph-mon[32782]: pgmap v15298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:55 smithi196 ceph-mon[32572]: pgmap v15298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:57 smithi110 ceph-mon[28069]: pgmap v15299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:57 smithi193 ceph-mon[32782]: pgmap v15299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:57 smithi196 ceph-mon[32572]: pgmap v15299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:38:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28252.392512 secs 2024-04-26T19:38:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28252.392512 secs 2024-04-26T19:38:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28252.392512 secs 2024-04-26T19:38:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:38:59 smithi110 ceph-mon[28069]: pgmap v15300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:38:59 smithi193 ceph-mon[32782]: pgmap v15300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:38:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:38:59 smithi196 ceph-mon[32572]: pgmap v15300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:01 smithi110 ceph-mon[28069]: pgmap v15301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:01 smithi193 ceph-mon[32782]: pgmap v15301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:01 smithi196 ceph-mon[32572]: pgmap v15301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28257.392631 secs 2024-04-26T19:39:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:03 smithi110 ceph-mon[28069]: pgmap v15302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:03.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28257.392631 secs 2024-04-26T19:39:03.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:03 smithi196 ceph-mon[32572]: pgmap v15302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28257.392631 secs 2024-04-26T19:39:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:03 smithi193 ceph-mon[32782]: pgmap v15302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:05 smithi193 ceph-mon[32782]: pgmap v15303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:05 smithi196 ceph-mon[32572]: pgmap v15303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:05 smithi110 ceph-mon[28069]: pgmap v15303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:07 smithi193 ceph-mon[32782]: pgmap v15304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:07 smithi196 ceph-mon[32572]: pgmap v15304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:07 smithi110 ceph-mon[28069]: pgmap v15304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28262.392698 secs 2024-04-26T19:39:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28262.392698 secs 2024-04-26T19:39:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28262.392698 secs 2024-04-26T19:39:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:09 smithi193 ceph-mon[32782]: pgmap v15305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:09.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:09 smithi110 ceph-mon[28069]: pgmap v15305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:09 smithi196 ceph-mon[32572]: pgmap v15305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:11 smithi193 ceph-mon[32782]: pgmap v15306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:11 smithi196 ceph-mon[32572]: pgmap v15306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:11 smithi110 ceph-mon[28069]: pgmap v15306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28267.392836 secs 2024-04-26T19:39:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:13 smithi193 ceph-mon[32782]: pgmap v15307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28267.392836 secs 2024-04-26T19:39:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:13 smithi196 ceph-mon[32572]: pgmap v15307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:13.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28267.392836 secs 2024-04-26T19:39:13.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:13 smithi110 ceph-mon[28069]: pgmap v15307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:14.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:39:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:39:13.917+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:39:14.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:39:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:39:13.917+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:39:14.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:39:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:39:13.917+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:39:14.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:39:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:39:13.917+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:39:14.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:39:13 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:39:13.917+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:39:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:15 smithi193 ceph-mon[32782]: pgmap v15308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:15 smithi196 ceph-mon[32572]: pgmap v15308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:15 smithi110 ceph-mon[28069]: pgmap v15308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:17 smithi193 ceph-mon[32782]: pgmap v15309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:17 smithi196 ceph-mon[32572]: pgmap v15309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:17 smithi110 ceph-mon[28069]: pgmap v15309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28272.392901 secs 2024-04-26T19:39:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28272.392901 secs 2024-04-26T19:39:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28272.392901 secs 2024-04-26T19:39:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:19 smithi193 ceph-mon[32782]: pgmap v15310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:39:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:19 smithi196 ceph-mon[32572]: pgmap v15310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:39:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:19 smithi110 ceph-mon[28069]: pgmap v15310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:39:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:39:21.048+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:39:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:39:21.048+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T19:39:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:39:21.048+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 219 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T19:39:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:39:21.049+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 219 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:39:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:21 smithi193 ceph-mon[32782]: pgmap v15311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:39:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:21 smithi196 ceph-mon[32572]: pgmap v15311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:39:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:21 smithi110 ceph-mon[28069]: pgmap v15311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:39:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28277.393019 secs 2024-04-26T19:39:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:23 smithi193 ceph-mon[32782]: pgmap v15312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:39:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28277.393019 secs 2024-04-26T19:39:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:23 smithi196 ceph-mon[32572]: pgmap v15312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:39:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28277.393019 secs 2024-04-26T19:39:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:23 smithi110 ceph-mon[28069]: pgmap v15312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:39:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:25 smithi193 ceph-mon[32782]: pgmap v15313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:39:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:25 smithi196 ceph-mon[32572]: pgmap v15313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:39:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:25 smithi110 ceph-mon[28069]: pgmap v15313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:39:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:27 smithi193 ceph-mon[32782]: pgmap v15314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:39:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:27 smithi196 ceph-mon[32572]: pgmap v15314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:39:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:27 smithi110 ceph-mon[28069]: pgmap v15314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:39:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28282.393147 secs 2024-04-26T19:39:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28282.393147 secs 2024-04-26T19:39:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28282.393147 secs 2024-04-26T19:39:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:29 smithi196 ceph-mon[32572]: pgmap v15315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:39:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:29 smithi110 ceph-mon[28069]: pgmap v15315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:39:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:29 smithi193 ceph-mon[32782]: pgmap v15315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:39:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:31 smithi196 ceph-mon[32572]: pgmap v15316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:31 smithi110 ceph-mon[28069]: pgmap v15316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:31 smithi193 ceph-mon[32782]: pgmap v15316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:33.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28287.393263 secs 2024-04-26T19:39:33.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:33 smithi193 ceph-mon[32782]: pgmap v15317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28287.393263 secs 2024-04-26T19:39:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:33 smithi196 ceph-mon[32572]: pgmap v15317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28287.393263 secs 2024-04-26T19:39:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:33 smithi110 ceph-mon[28069]: pgmap v15317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:35 smithi196 ceph-mon[32572]: pgmap v15318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:39:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:35 smithi193 ceph-mon[32782]: pgmap v15318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:39:35.701 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:35 smithi110 ceph-mon[28069]: pgmap v15318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:35.701 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:39:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: pgmap v15319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: pgmap v15319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: pgmap v15319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28292.393351 secs 2024-04-26T19:39:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28292.393351 secs 2024-04-26T19:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28292.393351 secs 2024-04-26T19:39:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:39:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:39:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:39.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:39 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:39:39.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:39 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:39:39.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:39 smithi110 ceph-mon[28069]: pgmap v15320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:39.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:39.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:39 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:39:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:39 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:39:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:39 smithi196 ceph-mon[32572]: pgmap v15320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:39 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:39:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:39 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:39:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:39 smithi193 ceph-mon[32782]: pgmap v15320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:39:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:39:40.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:39:40.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:39:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:39:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:39:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:39:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:41 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:39:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:41 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:39:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:41 smithi196 ceph-mon[32572]: pgmap v15321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T19:39:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:41 smithi196 ceph-mon[32572]: pgmap v15322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:41 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:39:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:41 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:39:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:41 smithi110 ceph-mon[28069]: pgmap v15321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T19:39:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:41 smithi110 ceph-mon[28069]: pgmap v15322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:41 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:39:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:41 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:39:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:41 smithi193 ceph-mon[32782]: pgmap v15321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T19:39:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:41 smithi193 ceph-mon[32782]: pgmap v15322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28297.393476 secs 2024-04-26T19:39:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:43 smithi196 ceph-mon[32572]: pgmap v15323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28297.393476 secs 2024-04-26T19:39:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:43 smithi110 ceph-mon[28069]: pgmap v15323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28297.393476 secs 2024-04-26T19:39:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:43 smithi193 ceph-mon[32782]: pgmap v15323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:45 smithi196 ceph-mon[32572]: pgmap v15324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:45 smithi110 ceph-mon[28069]: pgmap v15324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:45 smithi193 ceph-mon[32782]: pgmap v15324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:47 smithi196 ceph-mon[32572]: pgmap v15325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:47 smithi110 ceph-mon[28069]: pgmap v15325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:47 smithi193 ceph-mon[32782]: pgmap v15325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28302.393607 secs 2024-04-26T19:39:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28302.393607 secs 2024-04-26T19:39:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28302.393607 secs 2024-04-26T19:39:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:49 smithi196 ceph-mon[32572]: pgmap v15326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:49 smithi110 ceph-mon[28069]: pgmap v15326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:49 smithi193 ceph-mon[32782]: pgmap v15326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:39:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:50 smithi196 ceph-mon[32572]: pgmap v15327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:39:50.775 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:50 smithi110 ceph-mon[28069]: pgmap v15327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:39:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:50 smithi193 ceph-mon[32782]: pgmap v15327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:39:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28307.393674 secs 2024-04-26T19:39:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:52 smithi193 ceph-mon[32782]: pgmap v15328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28307.393674 secs 2024-04-26T19:39:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:52 smithi196 ceph-mon[32572]: pgmap v15328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28307.393674 secs 2024-04-26T19:39:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:52 smithi110 ceph-mon[28069]: pgmap v15328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:54 smithi193 ceph-mon[32782]: pgmap v15329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:54 smithi196 ceph-mon[32572]: pgmap v15329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:54 smithi110 ceph-mon[28069]: pgmap v15329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:56 smithi193 ceph-mon[32782]: pgmap v15330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:56 smithi196 ceph-mon[32572]: pgmap v15330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:56 smithi110 ceph-mon[28069]: pgmap v15330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:39:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28312.393801 secs 2024-04-26T19:39:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28312.393801 secs 2024-04-26T19:39:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28312.393801 secs 2024-04-26T19:39:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:39:58 smithi193 ceph-mon[32782]: pgmap v15331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:39:58 smithi196 ceph-mon[32572]: pgmap v15331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:39:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:39:58 smithi110 ceph-mon[28069]: pgmap v15331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:00 smithi193 ceph-mon[32782]: pgmap v15332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:40:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:00 smithi196 ceph-mon[32572]: pgmap v15332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:40:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:00 smithi110 ceph-mon[28069]: pgmap v15332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:40:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28317.393925 secs 2024-04-26T19:40:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:02 smithi193 ceph-mon[32782]: pgmap v15333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28317.393925 secs 2024-04-26T19:40:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:02 smithi196 ceph-mon[32572]: pgmap v15333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28317.393925 secs 2024-04-26T19:40:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:02 smithi110 ceph-mon[28069]: pgmap v15333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:04 smithi193 ceph-mon[32782]: pgmap v15334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:04 smithi196 ceph-mon[32572]: pgmap v15334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:04 smithi110 ceph-mon[28069]: pgmap v15334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:06 smithi193 ceph-mon[32782]: pgmap v15335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:40:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:06 smithi196 ceph-mon[32572]: pgmap v15335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:40:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:06 smithi110 ceph-mon[28069]: pgmap v15335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:40:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28322.393998 secs 2024-04-26T19:40:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28322.393998 secs 2024-04-26T19:40:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28322.393998 secs 2024-04-26T19:40:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:08 smithi193 ceph-mon[32782]: pgmap v15336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:09.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:08 smithi110 ceph-mon[28069]: pgmap v15336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:08 smithi196 ceph-mon[32572]: pgmap v15336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:10 smithi193 ceph-mon[32782]: pgmap v15337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:40:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:10 smithi196 ceph-mon[32572]: pgmap v15337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:40:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:10 smithi110 ceph-mon[28069]: pgmap v15337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:40:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28327.394130 secs 2024-04-26T19:40:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:12 smithi193 ceph-mon[32782]: pgmap v15338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:40:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28327.394130 secs 2024-04-26T19:40:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:12 smithi196 ceph-mon[32572]: pgmap v15338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:40:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28327.394130 secs 2024-04-26T19:40:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:12 smithi110 ceph-mon[28069]: pgmap v15338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:40:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:14 smithi193 ceph-mon[32782]: pgmap v15339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:14 smithi196 ceph-mon[32572]: pgmap v15339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:14 smithi110 ceph-mon[28069]: pgmap v15339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:16 smithi196 ceph-mon[32572]: pgmap v15340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:16 smithi110 ceph-mon[28069]: pgmap v15340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:16 smithi193 ceph-mon[32782]: pgmap v15340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:17 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28332.394259 secs 2024-04-26T19:40:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:17 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28332.394259 secs 2024-04-26T19:40:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:17 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28332.394259 secs 2024-04-26T19:40:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:18 smithi196 ceph-mon[32572]: pgmap v15341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:18 smithi110 ceph-mon[28069]: pgmap v15341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:18 smithi193 ceph-mon[32782]: pgmap v15341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:20 smithi193 ceph-mon[32782]: pgmap v15342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:20 smithi196 ceph-mon[32572]: pgmap v15342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:20 smithi110 ceph-mon[28069]: pgmap v15342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:22 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28337.394386 secs 2024-04-26T19:40:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:22 smithi196 ceph-mon[32572]: pgmap v15343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:22 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28337.394386 secs 2024-04-26T19:40:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:22 smithi110 ceph-mon[28069]: pgmap v15343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:22 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28337.394386 secs 2024-04-26T19:40:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:22 smithi193 ceph-mon[32782]: pgmap v15343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:24 smithi196 ceph-mon[32572]: pgmap v15344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:24 smithi110 ceph-mon[28069]: pgmap v15344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:24 smithi193 ceph-mon[32782]: pgmap v15344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:26 smithi196 ceph-mon[32572]: pgmap v15345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:26 smithi110 ceph-mon[28069]: pgmap v15345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:26 smithi193 ceph-mon[32782]: pgmap v15345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:27 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28342.394525 secs 2024-04-26T19:40:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:27 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28342.394525 secs 2024-04-26T19:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:27 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28342.394525 secs 2024-04-26T19:40:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:28 smithi196 ceph-mon[32572]: pgmap v15346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:28 smithi110 ceph-mon[28069]: pgmap v15346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:28 smithi193 ceph-mon[32782]: pgmap v15346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:30 smithi196 ceph-mon[32572]: pgmap v15347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:30 smithi110 ceph-mon[28069]: pgmap v15347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:30 smithi193 ceph-mon[32782]: pgmap v15347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:32 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28347.394648 secs 2024-04-26T19:40:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:32 smithi196 ceph-mon[32572]: pgmap v15348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:32 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28347.394648 secs 2024-04-26T19:40:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:32 smithi110 ceph-mon[28069]: pgmap v15348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:32 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28347.394648 secs 2024-04-26T19:40:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:32 smithi193 ceph-mon[32782]: pgmap v15348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:34 smithi196 ceph-mon[32572]: pgmap v15349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:34 smithi110 ceph-mon[28069]: pgmap v15349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:34 smithi193 ceph-mon[32782]: pgmap v15349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:36 smithi196 ceph-mon[32572]: pgmap v15350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:36 smithi110 ceph-mon[28069]: pgmap v15350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:36 smithi193 ceph-mon[32782]: pgmap v15350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:37 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28352.394773 secs 2024-04-26T19:40:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:37 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28352.394773 secs 2024-04-26T19:40:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:37 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28352.394773 secs 2024-04-26T19:40:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:38 smithi196 ceph-mon[32572]: pgmap v15351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:38 smithi110 ceph-mon[28069]: pgmap v15351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:38 smithi193 ceph-mon[32782]: pgmap v15351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:41.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:40 smithi196 ceph-mon[32572]: pgmap v15352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:41.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:40:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:40 smithi110 ceph-mon[28069]: pgmap v15352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:40:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:40 smithi193 ceph-mon[32782]: pgmap v15352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:40:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:40:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:40:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:41 smithi196 ceph-mon[32572]: pgmap v15353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:40:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:41 smithi196 ceph-mon[32572]: pgmap v15354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:40:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:40:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:40:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:41 smithi110 ceph-mon[28069]: pgmap v15353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:40:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:41 smithi110 ceph-mon[28069]: pgmap v15354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:40:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:40:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:40:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:41 smithi193 ceph-mon[32782]: pgmap v15353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:40:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:41 smithi193 ceph-mon[32782]: pgmap v15354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:40:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:42 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28357.394892 secs 2024-04-26T19:40:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:42 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28357.394892 secs 2024-04-26T19:40:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:42 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28357.394892 secs 2024-04-26T19:40:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:43 smithi196 ceph-mon[32572]: pgmap v15355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:43 smithi110 ceph-mon[28069]: pgmap v15355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:43 smithi193 ceph-mon[32782]: pgmap v15355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:46 smithi193 ceph-mon[32782]: pgmap v15356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:46 smithi196 ceph-mon[32572]: pgmap v15356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:46 smithi110 ceph-mon[28069]: pgmap v15356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28362.395033 secs 2024-04-26T19:40:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:48 smithi193 ceph-mon[32782]: pgmap v15357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:40:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28362.395033 secs 2024-04-26T19:40:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:48 smithi196 ceph-mon[32572]: pgmap v15357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:40:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28362.395033 secs 2024-04-26T19:40:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:48 smithi110 ceph-mon[28069]: pgmap v15357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:40:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:50 smithi193 ceph-mon[32782]: pgmap v15358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:50 smithi196 ceph-mon[32572]: pgmap v15358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:50 smithi110 ceph-mon[28069]: pgmap v15358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:40:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:52 smithi193 ceph-mon[32782]: pgmap v15359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:40:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:52 smithi196 ceph-mon[32572]: pgmap v15359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:40:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:52 smithi110 ceph-mon[28069]: pgmap v15359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:40:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28367.395099 secs 2024-04-26T19:40:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28367.395099 secs 2024-04-26T19:40:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28367.395099 secs 2024-04-26T19:40:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:54 smithi196 ceph-mon[32572]: pgmap v15360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:54 smithi110 ceph-mon[28069]: pgmap v15360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:54 smithi193 ceph-mon[32782]: pgmap v15360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:40:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:56 smithi196 ceph-mon[32572]: pgmap v15361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:56 smithi110 ceph-mon[28069]: pgmap v15361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:56 smithi193 ceph-mon[32782]: pgmap v15361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28372.395230 secs 2024-04-26T19:40:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:40:58 smithi196 ceph-mon[32572]: pgmap v15362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28372.395230 secs 2024-04-26T19:40:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:40:58 smithi110 ceph-mon[28069]: pgmap v15362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:40:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28372.395230 secs 2024-04-26T19:40:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:40:58 smithi193 ceph-mon[32782]: pgmap v15362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:00 smithi196 ceph-mon[32572]: pgmap v15363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:00 smithi110 ceph-mon[28069]: pgmap v15363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:00 smithi193 ceph-mon[32782]: pgmap v15363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:02 smithi196 ceph-mon[32572]: pgmap v15364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:02 smithi110 ceph-mon[28069]: pgmap v15364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:02 smithi193 ceph-mon[32782]: pgmap v15364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:03.669 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28377.395326 secs 2024-04-26T19:41:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28377.395326 secs 2024-04-26T19:41:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28377.395326 secs 2024-04-26T19:41:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:04 smithi196 ceph-mon[32572]: pgmap v15365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:04 smithi110 ceph-mon[28069]: pgmap v15365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:04 smithi193 ceph-mon[32782]: pgmap v15365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:06.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:06 smithi193 ceph-mon[32782]: pgmap v15366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:06 smithi196 ceph-mon[32572]: pgmap v15366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:06 smithi110 ceph-mon[28069]: pgmap v15366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28382.395472 secs 2024-04-26T19:41:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:08 smithi196 ceph-mon[32572]: pgmap v15367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28382.395472 secs 2024-04-26T19:41:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:08 smithi110 ceph-mon[28069]: pgmap v15367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28382.395472 secs 2024-04-26T19:41:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:08 smithi193 ceph-mon[32782]: pgmap v15367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:10 smithi196 ceph-mon[32572]: pgmap v15368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:10 smithi110 ceph-mon[28069]: pgmap v15368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:10 smithi193 ceph-mon[32782]: pgmap v15368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:12 smithi196 ceph-mon[32572]: pgmap v15369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:12 smithi110 ceph-mon[28069]: pgmap v15369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:12 smithi193 ceph-mon[32782]: pgmap v15369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28387.395598 secs 2024-04-26T19:41:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28387.395598 secs 2024-04-26T19:41:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28387.395598 secs 2024-04-26T19:41:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:14 smithi196 ceph-mon[32572]: pgmap v15370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:14 smithi110 ceph-mon[28069]: pgmap v15370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:14 smithi193 ceph-mon[32782]: pgmap v15370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:16 smithi196 ceph-mon[32572]: pgmap v15371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:16 smithi110 ceph-mon[28069]: pgmap v15371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:16 smithi193 ceph-mon[32782]: pgmap v15371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28392.395709 secs 2024-04-26T19:41:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:18 smithi196 ceph-mon[32572]: pgmap v15372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28392.395709 secs 2024-04-26T19:41:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:18 smithi110 ceph-mon[28069]: pgmap v15372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28392.395709 secs 2024-04-26T19:41:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:18 smithi193 ceph-mon[32782]: pgmap v15372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:19 smithi110 ceph-mon[28069]: pgmap v15373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:19 smithi193 ceph-mon[32782]: pgmap v15373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:19 smithi196 ceph-mon[32572]: pgmap v15373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:22 smithi193 ceph-mon[32782]: pgmap v15374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:22 smithi196 ceph-mon[32572]: pgmap v15374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:22 smithi110 ceph-mon[28069]: pgmap v15374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28397.395840 secs 2024-04-26T19:41:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28397.395840 secs 2024-04-26T19:41:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28397.395840 secs 2024-04-26T19:41:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:24 smithi196 ceph-mon[32572]: pgmap v15375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:24 smithi110 ceph-mon[28069]: pgmap v15375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:24 smithi193 ceph-mon[32782]: pgmap v15375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:26 smithi196 ceph-mon[32572]: pgmap v15376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:26 smithi110 ceph-mon[28069]: pgmap v15376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:26 smithi193 ceph-mon[32782]: pgmap v15376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28402.395952 secs 2024-04-26T19:41:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:28 smithi196 ceph-mon[32572]: pgmap v15377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28402.395952 secs 2024-04-26T19:41:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:28 smithi110 ceph-mon[28069]: pgmap v15377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28402.395952 secs 2024-04-26T19:41:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:28 smithi193 ceph-mon[32782]: pgmap v15377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:30 smithi196 ceph-mon[32572]: pgmap v15378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:30 smithi110 ceph-mon[28069]: pgmap v15378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:30 smithi193 ceph-mon[32782]: pgmap v15378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:32 smithi196 ceph-mon[32572]: pgmap v15379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:32 smithi110 ceph-mon[28069]: pgmap v15379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:32 smithi193 ceph-mon[32782]: pgmap v15379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28407.396072 secs 2024-04-26T19:41:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28407.396072 secs 2024-04-26T19:41:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28407.396072 secs 2024-04-26T19:41:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:34 smithi196 ceph-mon[32572]: pgmap v15380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:34 smithi110 ceph-mon[28069]: pgmap v15380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:34 smithi193 ceph-mon[32782]: pgmap v15380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:36.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:36 smithi193 ceph-mon[32782]: pgmap v15381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:36 smithi196 ceph-mon[32572]: pgmap v15381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:36 smithi110 ceph-mon[28069]: pgmap v15381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28412.396154 secs 2024-04-26T19:41:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:38 smithi196 ceph-mon[32572]: pgmap v15382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28412.396154 secs 2024-04-26T19:41:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:38 smithi110 ceph-mon[28069]: pgmap v15382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28412.396154 secs 2024-04-26T19:41:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:38 smithi193 ceph-mon[32782]: pgmap v15382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:40 smithi196 ceph-mon[32572]: pgmap v15383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:40 smithi110 ceph-mon[28069]: pgmap v15383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:40 smithi193 ceph-mon[32782]: pgmap v15383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:41:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:42 smithi196 ceph-mon[32572]: pgmap v15384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:41:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:42 smithi110 ceph-mon[28069]: pgmap v15384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:41:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:42 smithi193 ceph-mon[32782]: pgmap v15384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:41:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28417.396245 secs 2024-04-26T19:41:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:41:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:41:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:41:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28417.396245 secs 2024-04-26T19:41:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:41:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:41:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:41:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28417.396245 secs 2024-04-26T19:41:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:41:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:41:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:41:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:44 smithi196 ceph-mon[32572]: pgmap v15385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:41:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:44 smithi196 ceph-mon[32572]: pgmap v15386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:44 smithi110 ceph-mon[28069]: pgmap v15385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:41:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:44 smithi110 ceph-mon[28069]: pgmap v15386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:44 smithi193 ceph-mon[32782]: pgmap v15385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:41:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:44 smithi193 ceph-mon[32782]: pgmap v15386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:46 smithi196 ceph-mon[32572]: pgmap v15387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:46 smithi110 ceph-mon[28069]: pgmap v15387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:46 smithi193 ceph-mon[32782]: pgmap v15387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28422.396380 secs 2024-04-26T19:41:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:48 smithi196 ceph-mon[32572]: pgmap v15388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28422.396380 secs 2024-04-26T19:41:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:48 smithi110 ceph-mon[28069]: pgmap v15388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28422.396380 secs 2024-04-26T19:41:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:48 smithi193 ceph-mon[32782]: pgmap v15388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:50 smithi196 ceph-mon[32572]: pgmap v15389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:50 smithi110 ceph-mon[28069]: pgmap v15389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:50 smithi193 ceph-mon[32782]: pgmap v15389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:51 smithi196 ceph-mon[32572]: pgmap v15390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:51 smithi110 ceph-mon[28069]: pgmap v15390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:51 smithi193 ceph-mon[32782]: pgmap v15390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:41:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28427.396498 secs 2024-04-26T19:41:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28427.396498 secs 2024-04-26T19:41:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28427.396498 secs 2024-04-26T19:41:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:53 smithi193 ceph-mon[32782]: pgmap v15391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:41:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:53 smithi196 ceph-mon[32572]: pgmap v15391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:41:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:53 smithi110 ceph-mon[28069]: pgmap v15391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:41:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:55 smithi196 ceph-mon[32572]: pgmap v15392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:55 smithi110 ceph-mon[28069]: pgmap v15392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:55 smithi193 ceph-mon[32782]: pgmap v15392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28432.396648 secs 2024-04-26T19:41:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:57 smithi196 ceph-mon[32572]: pgmap v15393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28432.396648 secs 2024-04-26T19:41:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:57 smithi110 ceph-mon[28069]: pgmap v15393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:41:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28432.396648 secs 2024-04-26T19:41:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:57 smithi193 ceph-mon[32782]: pgmap v15393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:41:59 smithi196 ceph-mon[32572]: pgmap v15394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:41:59 smithi110 ceph-mon[28069]: pgmap v15394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:41:59 smithi193 ceph-mon[32782]: pgmap v15394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:01 smithi196 ceph-mon[32572]: pgmap v15395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:01 smithi110 ceph-mon[28069]: pgmap v15395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:01 smithi193 ceph-mon[32782]: pgmap v15395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:03.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28437.396712 secs 2024-04-26T19:42:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28437.396712 secs 2024-04-26T19:42:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28437.396712 secs 2024-04-26T19:42:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:03 smithi196 ceph-mon[32572]: pgmap v15396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:03 smithi110 ceph-mon[28069]: pgmap v15396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:03 smithi193 ceph-mon[32782]: pgmap v15396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:05 smithi196 ceph-mon[32572]: pgmap v15397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:05 smithi110 ceph-mon[28069]: pgmap v15397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:05 smithi193 ceph-mon[32782]: pgmap v15397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28442.396790 secs 2024-04-26T19:42:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:07 smithi196 ceph-mon[32572]: pgmap v15398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28442.396790 secs 2024-04-26T19:42:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:07 smithi110 ceph-mon[28069]: pgmap v15398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28442.396790 secs 2024-04-26T19:42:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:07 smithi193 ceph-mon[32782]: pgmap v15398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:09 smithi196 ceph-mon[32572]: pgmap v15399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:09 smithi110 ceph-mon[28069]: pgmap v15399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:09 smithi193 ceph-mon[32782]: pgmap v15399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:11 smithi196 ceph-mon[32572]: pgmap v15400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:11 smithi110 ceph-mon[28069]: pgmap v15400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:11 smithi193 ceph-mon[32782]: pgmap v15400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28447.396912 secs 2024-04-26T19:42:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28447.396912 secs 2024-04-26T19:42:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28447.396912 secs 2024-04-26T19:42:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:13 smithi196 ceph-mon[32572]: pgmap v15401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:13 smithi110 ceph-mon[28069]: pgmap v15401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:13 smithi193 ceph-mon[32782]: pgmap v15401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:15 smithi196 ceph-mon[32572]: pgmap v15402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:15 smithi110 ceph-mon[28069]: pgmap v15402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:15 smithi193 ceph-mon[32782]: pgmap v15402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:17 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28452.397030 secs 2024-04-26T19:42:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:17 smithi196 ceph-mon[32572]: pgmap v15403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:17 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28452.397030 secs 2024-04-26T19:42:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:17 smithi110 ceph-mon[28069]: pgmap v15403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:17 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28452.397030 secs 2024-04-26T19:42:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:17 smithi193 ceph-mon[32782]: pgmap v15403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:19 smithi196 ceph-mon[32572]: pgmap v15404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:19 smithi110 ceph-mon[28069]: pgmap v15404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:19 smithi193 ceph-mon[32782]: pgmap v15404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:42:21.078+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T19:42:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:42:21.078+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:42:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:42:21.079+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 220 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:42:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:42:21.079+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 220 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T19:42:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:22 smithi196 ceph-mon[32572]: pgmap v15405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:22 smithi110 ceph-mon[28069]: pgmap v15405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:22 smithi193 ceph-mon[32782]: pgmap v15405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28457.397148 secs 2024-04-26T19:42:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28457.397148 secs 2024-04-26T19:42:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28457.397148 secs 2024-04-26T19:42:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:24 smithi110 ceph-mon[28069]: pgmap v15406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:24 smithi193 ceph-mon[32782]: pgmap v15406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:24 smithi196 ceph-mon[32572]: pgmap v15406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:26 smithi110 ceph-mon[28069]: pgmap v15407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:26 smithi193 ceph-mon[32782]: pgmap v15407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:26 smithi196 ceph-mon[32572]: pgmap v15407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28462.397281 secs 2024-04-26T19:42:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:28 smithi110 ceph-mon[28069]: pgmap v15408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28462.397281 secs 2024-04-26T19:42:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:28 smithi193 ceph-mon[32782]: pgmap v15408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28462.397281 secs 2024-04-26T19:42:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:28 smithi196 ceph-mon[32572]: pgmap v15408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:30 smithi110 ceph-mon[28069]: pgmap v15409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:30 smithi193 ceph-mon[32782]: pgmap v15409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:30 smithi196 ceph-mon[32572]: pgmap v15409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:32 smithi110 ceph-mon[28069]: pgmap v15410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:32 smithi193 ceph-mon[32782]: pgmap v15410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:32 smithi196 ceph-mon[32572]: pgmap v15410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28467.397404 secs 2024-04-26T19:42:33.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28467.397404 secs 2024-04-26T19:42:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28467.397404 secs 2024-04-26T19:42:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:34 smithi193 ceph-mon[32782]: pgmap v15411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:34 smithi196 ceph-mon[32572]: pgmap v15411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:34 smithi110 ceph-mon[28069]: pgmap v15411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:36 smithi193 ceph-mon[32782]: pgmap v15412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:36 smithi196 ceph-mon[32572]: pgmap v15412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:36 smithi110 ceph-mon[28069]: pgmap v15412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28472.397524 secs 2024-04-26T19:42:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:38 smithi193 ceph-mon[32782]: pgmap v15413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28472.397524 secs 2024-04-26T19:42:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:38 smithi196 ceph-mon[32572]: pgmap v15413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28472.397524 secs 2024-04-26T19:42:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:38 smithi110 ceph-mon[28069]: pgmap v15413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:40.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:40 smithi110 ceph-mon[28069]: pgmap v15414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:40 smithi193 ceph-mon[32782]: pgmap v15414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:40 smithi196 ceph-mon[32572]: pgmap v15414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:42 smithi193 ceph-mon[32782]: pgmap v15415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:42 smithi196 ceph-mon[32572]: pgmap v15415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:42 smithi110 ceph-mon[28069]: pgmap v15415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28477.397653 secs 2024-04-26T19:42:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28477.397653 secs 2024-04-26T19:42:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28477.397653 secs 2024-04-26T19:42:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:44 smithi193 ceph-mon[32782]: pgmap v15416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:42:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:44 smithi196 ceph-mon[32572]: pgmap v15416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:42:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:44 smithi110 ceph-mon[28069]: pgmap v15416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:42:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:42:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:42:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:45 smithi193 ceph-mon[32782]: pgmap v15417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T19:42:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:45 smithi193 ceph-mon[32782]: pgmap v15418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:42:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:42:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:42:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:45 smithi196 ceph-mon[32572]: pgmap v15417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T19:42:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:45 smithi196 ceph-mon[32572]: pgmap v15418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:42:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:42:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:42:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:45 smithi110 ceph-mon[28069]: pgmap v15417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 894 B/s rd, 1 op/s 2024-04-26T19:42:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:45 smithi110 ceph-mon[28069]: pgmap v15418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:42:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:47 smithi196 ceph-mon[32572]: pgmap v15419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:47 smithi110 ceph-mon[28069]: pgmap v15419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:47 smithi193 ceph-mon[32782]: pgmap v15419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28482.397718 secs 2024-04-26T19:42:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28482.397718 secs 2024-04-26T19:42:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28482.397718 secs 2024-04-26T19:42:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:49 smithi196 ceph-mon[32572]: pgmap v15420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:49 smithi110 ceph-mon[28069]: pgmap v15420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:49 smithi193 ceph-mon[32782]: pgmap v15420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:51.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:51 smithi196 ceph-mon[32572]: pgmap v15421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:51 smithi110 ceph-mon[28069]: pgmap v15421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:51 smithi193 ceph-mon[32782]: pgmap v15421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:42:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:53 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28487.397840 secs 2024-04-26T19:42:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:53 smithi196 ceph-mon[32572]: pgmap v15422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 541 B/s rd, 1 op/s 2024-04-26T19:42:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:53 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28487.397840 secs 2024-04-26T19:42:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:53 smithi110 ceph-mon[28069]: pgmap v15422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 541 B/s rd, 1 op/s 2024-04-26T19:42:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:53 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28487.397840 secs 2024-04-26T19:42:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:53 smithi193 ceph-mon[32782]: pgmap v15422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 541 B/s rd, 1 op/s 2024-04-26T19:42:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:55 smithi196 ceph-mon[32572]: pgmap v15423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:42:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:55 smithi110 ceph-mon[28069]: pgmap v15423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:42:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:55 smithi193 ceph-mon[32782]: pgmap v15423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:42:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:57 smithi196 ceph-mon[32572]: pgmap v15424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:57 smithi110 ceph-mon[28069]: pgmap v15424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:57 smithi193 ceph-mon[32782]: pgmap v15424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:42:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:58 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28492.397953 secs 2024-04-26T19:42:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:58 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28492.397953 secs 2024-04-26T19:42:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:58 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28492.397953 secs 2024-04-26T19:42:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:42:59 smithi196 ceph-mon[32572]: pgmap v15425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:42:59 smithi110 ceph-mon[28069]: pgmap v15425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:42:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:42:59 smithi193 ceph-mon[32782]: pgmap v15425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:01 smithi196 ceph-mon[32572]: pgmap v15426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:01 smithi110 ceph-mon[28069]: pgmap v15426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:01 smithi193 ceph-mon[32782]: pgmap v15426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:03 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28497.398037 secs 2024-04-26T19:43:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:03 smithi196 ceph-mon[32572]: pgmap v15427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:03 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28497.398037 secs 2024-04-26T19:43:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:03 smithi110 ceph-mon[28069]: pgmap v15427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:03 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28497.398037 secs 2024-04-26T19:43:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:03 smithi193 ceph-mon[32782]: pgmap v15427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:05 smithi196 ceph-mon[32572]: pgmap v15428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:05 smithi110 ceph-mon[28069]: pgmap v15428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:05 smithi193 ceph-mon[32782]: pgmap v15428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:07 smithi196 ceph-mon[32572]: pgmap v15429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:07 smithi110 ceph-mon[28069]: pgmap v15429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:07 smithi193 ceph-mon[32782]: pgmap v15429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:08 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28502.398159 secs 2024-04-26T19:43:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:08 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28502.398159 secs 2024-04-26T19:43:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:08 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28502.398159 secs 2024-04-26T19:43:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:09 smithi196 ceph-mon[32572]: pgmap v15430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:09 smithi110 ceph-mon[28069]: pgmap v15430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:09 smithi193 ceph-mon[32782]: pgmap v15430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:11 smithi196 ceph-mon[32572]: pgmap v15431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:11 smithi110 ceph-mon[28069]: pgmap v15431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:11 smithi193 ceph-mon[32782]: pgmap v15431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:13 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28507.398284 secs 2024-04-26T19:43:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:13 smithi196 ceph-mon[32572]: pgmap v15432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:13 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28507.398284 secs 2024-04-26T19:43:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:13 smithi110 ceph-mon[28069]: pgmap v15432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:13 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28507.398284 secs 2024-04-26T19:43:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:13 smithi193 ceph-mon[32782]: pgmap v15432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:15 smithi196 ceph-mon[32572]: pgmap v15433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:15 smithi110 ceph-mon[28069]: pgmap v15433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:15 smithi193 ceph-mon[32782]: pgmap v15433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:17 smithi196 ceph-mon[32572]: pgmap v15434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:17 smithi110 ceph-mon[28069]: pgmap v15434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:17 smithi193 ceph-mon[32782]: pgmap v15434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:18 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28512.398406 secs 2024-04-26T19:43:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:18 smithi196 ceph-mon[32572]: pgmap v15435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:18 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28512.398406 secs 2024-04-26T19:43:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:18 smithi110 ceph-mon[28069]: pgmap v15435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:18 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28512.398406 secs 2024-04-26T19:43:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:18 smithi193 ceph-mon[32782]: pgmap v15435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:20 smithi193 ceph-mon[32782]: pgmap v15436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:20 smithi196 ceph-mon[32572]: pgmap v15436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:20 smithi110 ceph-mon[28069]: pgmap v15436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:23 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28517.398501 secs 2024-04-26T19:43:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:23 smithi196 ceph-mon[32572]: pgmap v15437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:23 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28517.398501 secs 2024-04-26T19:43:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:23 smithi110 ceph-mon[28069]: pgmap v15437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:23 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28517.398501 secs 2024-04-26T19:43:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:23 smithi193 ceph-mon[32782]: pgmap v15437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:25 smithi196 ceph-mon[32572]: pgmap v15438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:25 smithi110 ceph-mon[28069]: pgmap v15438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:25 smithi193 ceph-mon[32782]: pgmap v15438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:27 smithi196 ceph-mon[32572]: pgmap v15439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:27 smithi110 ceph-mon[28069]: pgmap v15439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:27 smithi193 ceph-mon[32782]: pgmap v15439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:28 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28522.398613 secs 2024-04-26T19:43:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:28 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28522.398613 secs 2024-04-26T19:43:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:28 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28522.398613 secs 2024-04-26T19:43:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:29 smithi196 ceph-mon[32572]: pgmap v15440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:29 smithi110 ceph-mon[28069]: pgmap v15440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:29 smithi193 ceph-mon[32782]: pgmap v15440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:31 smithi196 ceph-mon[32572]: pgmap v15441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:31 smithi110 ceph-mon[28069]: pgmap v15441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:31 smithi193 ceph-mon[32782]: pgmap v15441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:33 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28527.398730 secs 2024-04-26T19:43:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:33 smithi196 ceph-mon[32572]: pgmap v15442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:33 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28527.398730 secs 2024-04-26T19:43:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:33 smithi110 ceph-mon[28069]: pgmap v15442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:33 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28527.398730 secs 2024-04-26T19:43:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:33 smithi193 ceph-mon[32782]: pgmap v15442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:35 smithi196 ceph-mon[32572]: pgmap v15443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:35 smithi110 ceph-mon[28069]: pgmap v15443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:35 smithi193 ceph-mon[32782]: pgmap v15443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:37 smithi196 ceph-mon[32572]: pgmap v15444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:37 smithi110 ceph-mon[28069]: pgmap v15444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:37 smithi193 ceph-mon[32782]: pgmap v15444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:38 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28532.398840 secs 2024-04-26T19:43:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:38 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28532.398840 secs 2024-04-26T19:43:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:38 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28532.398840 secs 2024-04-26T19:43:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:39 smithi196 ceph-mon[32572]: pgmap v15445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:39 smithi110 ceph-mon[28069]: pgmap v15445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:39 smithi193 ceph-mon[32782]: pgmap v15445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:41 smithi196 ceph-mon[32572]: pgmap v15446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:41 smithi110 ceph-mon[28069]: pgmap v15446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:41 smithi193 ceph-mon[32782]: pgmap v15446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:43 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28537.398923 secs 2024-04-26T19:43:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:43 smithi196 ceph-mon[32572]: pgmap v15447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:43 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28537.398923 secs 2024-04-26T19:43:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:43 smithi110 ceph-mon[28069]: pgmap v15447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:43 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28537.398923 secs 2024-04-26T19:43:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:43 smithi193 ceph-mon[32782]: pgmap v15447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:43:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:45 smithi196 ceph-mon[32572]: pgmap v15448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:43:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:45 smithi110 ceph-mon[28069]: pgmap v15448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:43:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:45 smithi193 ceph-mon[32782]: pgmap v15448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:43:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:43:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:43:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:43:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:43:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:43:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:43:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:43:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:43:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:43:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:47 smithi196 ceph-mon[32572]: pgmap v15449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T19:43:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:47 smithi196 ceph-mon[32572]: pgmap v15450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:47 smithi110 ceph-mon[28069]: pgmap v15449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T19:43:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:47 smithi110 ceph-mon[28069]: pgmap v15450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:47 smithi193 ceph-mon[32782]: pgmap v15449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T19:43:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:47 smithi193 ceph-mon[32782]: pgmap v15450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:48 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28542.399047 secs 2024-04-26T19:43:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:48 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28542.399047 secs 2024-04-26T19:43:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:48 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28542.399047 secs 2024-04-26T19:43:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:49 smithi196 ceph-mon[32572]: pgmap v15451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:49 smithi110 ceph-mon[28069]: pgmap v15451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:49 smithi193 ceph-mon[32782]: pgmap v15451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:50 smithi110 ceph-mon[28069]: pgmap v15452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:50 smithi193 ceph-mon[32782]: pgmap v15452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:50 smithi196 ceph-mon[32572]: pgmap v15452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:52 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28547.399186 secs 2024-04-26T19:43:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:52 smithi196 ceph-mon[32572]: pgmap v15453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:52 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28547.399186 secs 2024-04-26T19:43:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:52 smithi110 ceph-mon[28069]: pgmap v15453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:52 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28547.399186 secs 2024-04-26T19:43:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:52 smithi193 ceph-mon[32782]: pgmap v15453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:54 smithi196 ceph-mon[32572]: pgmap v15454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:54 smithi110 ceph-mon[28069]: pgmap v15454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:54 smithi193 ceph-mon[32782]: pgmap v15454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:56 smithi196 ceph-mon[32572]: pgmap v15455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:43:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:56 smithi110 ceph-mon[28069]: pgmap v15455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:43:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:56 smithi193 ceph-mon[32782]: pgmap v15455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:43:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:57 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28552.399324 secs 2024-04-26T19:43:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:57 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28552.399324 secs 2024-04-26T19:43:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:57 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28552.399324 secs 2024-04-26T19:43:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:43:58 smithi196 ceph-mon[32572]: pgmap v15456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:43:58 smithi110 ceph-mon[28069]: pgmap v15456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:43:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:43:58 smithi193 ceph-mon[32782]: pgmap v15456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:00 smithi196 ceph-mon[32572]: pgmap v15457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:00 smithi110 ceph-mon[28069]: pgmap v15457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:00 smithi193 ceph-mon[32782]: pgmap v15457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:02 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28557.399444 secs 2024-04-26T19:44:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:02 smithi196 ceph-mon[32572]: pgmap v15458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:02 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28557.399444 secs 2024-04-26T19:44:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:02 smithi110 ceph-mon[28069]: pgmap v15458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:02 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28557.399444 secs 2024-04-26T19:44:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:02 smithi193 ceph-mon[32782]: pgmap v15458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:04 smithi196 ceph-mon[32572]: pgmap v15459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:04 smithi110 ceph-mon[28069]: pgmap v15459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:04 smithi193 ceph-mon[32782]: pgmap v15459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:06 smithi196 ceph-mon[32572]: pgmap v15460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:06 smithi110 ceph-mon[28069]: pgmap v15460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:06 smithi193 ceph-mon[32782]: pgmap v15460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:07 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28562.399518 secs 2024-04-26T19:44:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:07 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28562.399518 secs 2024-04-26T19:44:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:07 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28562.399518 secs 2024-04-26T19:44:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:08 smithi196 ceph-mon[32572]: pgmap v15461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:08 smithi110 ceph-mon[28069]: pgmap v15461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:08 smithi193 ceph-mon[32782]: pgmap v15461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:10 smithi193 ceph-mon[32782]: pgmap v15462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:10 smithi196 ceph-mon[32572]: pgmap v15462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:10 smithi110 ceph-mon[28069]: pgmap v15462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:12 smithi196 ceph-mon[32572]: 22 slow requests, 0 included below; oldest blocked for > 28567.399641 secs 2024-04-26T19:44:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:12 smithi196 ceph-mon[32572]: pgmap v15463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:12 smithi110 ceph-mon[28069]: 22 slow requests, 0 included below; oldest blocked for > 28567.399641 secs 2024-04-26T19:44:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:12 smithi110 ceph-mon[28069]: pgmap v15463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:12 smithi193 ceph-mon[32782]: 22 slow requests, 0 included below; oldest blocked for > 28567.399641 secs 2024-04-26T19:44:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:12 smithi193 ceph-mon[32782]: pgmap v15463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:14.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:44:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:44:14.116+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:44:14.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:44:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:44:14.116+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:44:14.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:44:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:44:14.116+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:44:14.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:44:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:44:14.116+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:44:14.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:44:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:44:14.116+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:44:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:14 smithi196 ceph-mon[32572]: pgmap v15464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:14 smithi110 ceph-mon[28069]: pgmap v15464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:14 smithi193 ceph-mon[32782]: pgmap v15464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:16 smithi196 ceph-mon[32572]: pgmap v15465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:16 smithi110 ceph-mon[28069]: pgmap v15465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:16 smithi193 ceph-mon[32782]: pgmap v15465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:17 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28572.399759 secs 2024-04-26T19:44:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:17 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28572.399759 secs 2024-04-26T19:44:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:17 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28572.399759 secs 2024-04-26T19:44:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:18 smithi196 ceph-mon[32572]: pgmap v15466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:18 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:44:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:18 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:44:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:18 smithi110 ceph-mon[28069]: pgmap v15466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:18 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:44:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:18 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:44:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:18 smithi193 ceph-mon[32782]: pgmap v15466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:18 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:44:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:18 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:44:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:20 smithi196 ceph-mon[32572]: pgmap v15467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:20 smithi110 ceph-mon[28069]: pgmap v15467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:20 smithi193 ceph-mon[32782]: pgmap v15467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:22 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28577.399875 secs 2024-04-26T19:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:22 smithi196 ceph-mon[32572]: pgmap v15468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:22 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28577.399875 secs 2024-04-26T19:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:22 smithi110 ceph-mon[28069]: pgmap v15468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:22 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28577.399875 secs 2024-04-26T19:44:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:22 smithi193 ceph-mon[32782]: pgmap v15468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:24 smithi196 ceph-mon[32572]: pgmap v15469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:24 smithi110 ceph-mon[28069]: pgmap v15469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:24 smithi193 ceph-mon[32782]: pgmap v15469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:26 smithi196 ceph-mon[32572]: pgmap v15470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:26 smithi110 ceph-mon[28069]: pgmap v15470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:26 smithi193 ceph-mon[32782]: pgmap v15470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:27 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28582.399974 secs 2024-04-26T19:44:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:27 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28582.399974 secs 2024-04-26T19:44:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:27 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28582.399974 secs 2024-04-26T19:44:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:28 smithi196 ceph-mon[32572]: pgmap v15471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:28 smithi110 ceph-mon[28069]: pgmap v15471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:28 smithi193 ceph-mon[32782]: pgmap v15471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T19:44:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:30 smithi196 ceph-mon[32572]: pgmap v15472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:30 smithi110 ceph-mon[28069]: pgmap v15472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:30 smithi193 ceph-mon[32782]: pgmap v15472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:32 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28587.400097 secs 2024-04-26T19:44:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:32 smithi196 ceph-mon[32572]: pgmap v15473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:32 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28587.400097 secs 2024-04-26T19:44:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:32 smithi110 ceph-mon[28069]: pgmap v15473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:32 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28587.400097 secs 2024-04-26T19:44:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:32 smithi193 ceph-mon[32782]: pgmap v15473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:34 smithi196 ceph-mon[32572]: pgmap v15474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:34 smithi110 ceph-mon[28069]: pgmap v15474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:34 smithi193 ceph-mon[32782]: pgmap v15474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:36 smithi196 ceph-mon[32572]: pgmap v15475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:36 smithi110 ceph-mon[28069]: pgmap v15475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:36 smithi193 ceph-mon[32782]: pgmap v15475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:37 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28592.400219 secs 2024-04-26T19:44:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:37 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28592.400219 secs 2024-04-26T19:44:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:37 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28592.400219 secs 2024-04-26T19:44:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:38 smithi196 ceph-mon[32572]: pgmap v15476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:38 smithi110 ceph-mon[28069]: pgmap v15476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:38 smithi193 ceph-mon[32782]: pgmap v15476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:40 smithi196 ceph-mon[32572]: pgmap v15477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:40 smithi110 ceph-mon[28069]: pgmap v15477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:40 smithi193 ceph-mon[32782]: pgmap v15477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:43 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28597.400337 secs 2024-04-26T19:44:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:43 smithi196 ceph-mon[32572]: pgmap v15478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:43 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28597.400337 secs 2024-04-26T19:44:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:43 smithi110 ceph-mon[28069]: pgmap v15478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:43 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28597.400337 secs 2024-04-26T19:44:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:43 smithi193 ceph-mon[32782]: pgmap v15478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:45 smithi110 ceph-mon[28069]: pgmap v15479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:45 smithi193 ceph-mon[32782]: pgmap v15479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:45 smithi196 ceph-mon[32572]: pgmap v15479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:44:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:47 smithi110 ceph-mon[28069]: pgmap v15480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:44:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:47 smithi193 ceph-mon[32782]: pgmap v15480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:44:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:47 smithi196 ceph-mon[32572]: pgmap v15480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:44:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:44:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:48 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28602.400470 secs 2024-04-26T19:44:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:44:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:44:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:48 smithi110 ceph-mon[28069]: pgmap v15481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 2 op/s 2024-04-26T19:44:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:48 smithi110 ceph-mon[28069]: pgmap v15482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:44:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:44:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:48 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28602.400470 secs 2024-04-26T19:44:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:44:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:44:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:48 smithi193 ceph-mon[32782]: pgmap v15481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 2 op/s 2024-04-26T19:44:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:48 smithi193 ceph-mon[32782]: pgmap v15482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:44:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:44:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:48 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28602.400470 secs 2024-04-26T19:44:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:44:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:44:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:48 smithi196 ceph-mon[32572]: pgmap v15481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 2 op/s 2024-04-26T19:44:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:48 smithi196 ceph-mon[32572]: pgmap v15482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:44:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:44:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:50 smithi196 ceph-mon[32572]: pgmap v15483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:50 smithi110 ceph-mon[28069]: pgmap v15483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:50 smithi193 ceph-mon[32782]: pgmap v15483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:52 smithi196 ceph-mon[32572]: pgmap v15484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:52 smithi110 ceph-mon[28069]: pgmap v15484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:52 smithi193 ceph-mon[32782]: pgmap v15484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:53 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28607.400593 secs 2024-04-26T19:44:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:53 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28607.400593 secs 2024-04-26T19:44:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:53 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28607.400593 secs 2024-04-26T19:44:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:54 smithi196 ceph-mon[32572]: pgmap v15485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:54 smithi110 ceph-mon[28069]: pgmap v15485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:54 smithi193 ceph-mon[32782]: pgmap v15485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:56 smithi196 ceph-mon[32572]: pgmap v15486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:56 smithi110 ceph-mon[28069]: pgmap v15486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:56 smithi193 ceph-mon[32782]: pgmap v15486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:44:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:58 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28612.400692 secs 2024-04-26T19:44:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:44:58 smithi196 ceph-mon[32572]: pgmap v15487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:44:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:58 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28612.400692 secs 2024-04-26T19:44:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:44:58 smithi110 ceph-mon[28069]: pgmap v15487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:44:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:58 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28612.400692 secs 2024-04-26T19:44:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:44:58 smithi193 ceph-mon[32782]: pgmap v15487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:45:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:00 smithi196 ceph-mon[32572]: pgmap v15488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:00 smithi110 ceph-mon[28069]: pgmap v15488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:00 smithi193 ceph-mon[32782]: pgmap v15488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:02 smithi196 ceph-mon[32572]: pgmap v15489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:02 smithi110 ceph-mon[28069]: pgmap v15489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:02 smithi193 ceph-mon[32782]: pgmap v15489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:03 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28617.400787 secs 2024-04-26T19:45:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:03 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28617.400787 secs 2024-04-26T19:45:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:03 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28617.400787 secs 2024-04-26T19:45:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:04 smithi110 ceph-mon[28069]: pgmap v15490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:04 smithi193 ceph-mon[32782]: pgmap v15490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:04 smithi196 ceph-mon[32572]: pgmap v15490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:05 smithi110 ceph-mon[28069]: pgmap v15491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:45:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:05 smithi193 ceph-mon[32782]: pgmap v15491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:45:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:05 smithi196 ceph-mon[32572]: pgmap v15491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:45:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:08 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28622.400908 secs 2024-04-26T19:45:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:08 smithi196 ceph-mon[32572]: pgmap v15492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:08 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28622.400908 secs 2024-04-26T19:45:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:08 smithi110 ceph-mon[28069]: pgmap v15492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:08 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28622.400908 secs 2024-04-26T19:45:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:08 smithi193 ceph-mon[32782]: pgmap v15492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:10 smithi196 ceph-mon[32572]: pgmap v15493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:10 smithi110 ceph-mon[28069]: pgmap v15493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:10 smithi193 ceph-mon[32782]: pgmap v15493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:12 smithi196 ceph-mon[32572]: pgmap v15494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:45:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:12 smithi110 ceph-mon[28069]: pgmap v15494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:45:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:12 smithi193 ceph-mon[32782]: pgmap v15494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:45:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:13 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28627.401042 secs 2024-04-26T19:45:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:13 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28627.401042 secs 2024-04-26T19:45:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:13 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28627.401042 secs 2024-04-26T19:45:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:14 smithi196 ceph-mon[32572]: pgmap v15495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:14 smithi110 ceph-mon[28069]: pgmap v15495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:14 smithi193 ceph-mon[32782]: pgmap v15495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:45:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:16 smithi196 ceph-mon[32572]: pgmap v15496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:16 smithi110 ceph-mon[28069]: pgmap v15496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:16 smithi193 ceph-mon[32782]: pgmap v15496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:18 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28632.401182 secs 2024-04-26T19:45:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:18 smithi196 ceph-mon[32572]: pgmap v15497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:45:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:18 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28632.401182 secs 2024-04-26T19:45:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:18 smithi110 ceph-mon[28069]: pgmap v15497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:45:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:18 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28632.401182 secs 2024-04-26T19:45:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:18 smithi193 ceph-mon[32782]: pgmap v15497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:45:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:20 smithi110 ceph-mon[28069]: pgmap v15498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:20 smithi193 ceph-mon[32782]: pgmap v15498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:20 smithi196 ceph-mon[32572]: pgmap v15498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:45:21.108+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T19:45:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:45:21.108+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:45:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:45:21.110+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 221 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:45:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:45:21.110+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 221 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T19:45:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:21 smithi193 ceph-mon[32782]: pgmap v15499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:21 smithi196 ceph-mon[32572]: pgmap v15499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:21 smithi110 ceph-mon[28069]: pgmap v15499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:22 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28637.401300 secs 2024-04-26T19:45:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:22 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28637.401300 secs 2024-04-26T19:45:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:22 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28637.401300 secs 2024-04-26T19:45:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:23 smithi193 ceph-mon[32782]: pgmap v15500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:23 smithi196 ceph-mon[32572]: pgmap v15500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:23 smithi110 ceph-mon[28069]: pgmap v15500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:26.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:26 smithi196 ceph-mon[32572]: pgmap v15501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:26 smithi110 ceph-mon[28069]: pgmap v15501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:26 smithi193 ceph-mon[32782]: pgmap v15501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:28 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28642.401416 secs 2024-04-26T19:45:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:28 smithi196 ceph-mon[32572]: pgmap v15502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:28 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28642.401416 secs 2024-04-26T19:45:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:28 smithi110 ceph-mon[28069]: pgmap v15502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:28 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28642.401416 secs 2024-04-26T19:45:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:28 smithi193 ceph-mon[32782]: pgmap v15502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:30 smithi196 ceph-mon[32572]: pgmap v15503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:30 smithi110 ceph-mon[28069]: pgmap v15503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:30 smithi193 ceph-mon[32782]: pgmap v15503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:32 smithi196 ceph-mon[32572]: pgmap v15504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:32 smithi110 ceph-mon[28069]: pgmap v15504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:32 smithi193 ceph-mon[32782]: pgmap v15504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:33 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28647.401539 secs 2024-04-26T19:45:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:33 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28647.401539 secs 2024-04-26T19:45:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:33 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28647.401539 secs 2024-04-26T19:45:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:34 smithi196 ceph-mon[32572]: pgmap v15505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:34 smithi110 ceph-mon[28069]: pgmap v15505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:34 smithi193 ceph-mon[32782]: pgmap v15505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:36 smithi110 ceph-mon[28069]: pgmap v15506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:36 smithi193 ceph-mon[32782]: pgmap v15506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:36 smithi196 ceph-mon[32572]: pgmap v15506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:37 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28652.401642 secs 2024-04-26T19:45:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:37 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28652.401642 secs 2024-04-26T19:45:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:37 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28652.401642 secs 2024-04-26T19:45:38.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:38 smithi193 ceph-mon[32782]: pgmap v15507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:38 smithi110 ceph-mon[28069]: pgmap v15507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:38 smithi196 ceph-mon[32572]: pgmap v15507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:39 smithi110 ceph-mon[28069]: pgmap v15508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:39.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:39 smithi193 ceph-mon[32782]: pgmap v15508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:39 smithi196 ceph-mon[32572]: pgmap v15508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:42 smithi196 ceph-mon[32572]: pgmap v15509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:42 smithi110 ceph-mon[28069]: pgmap v15509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:42 smithi193 ceph-mon[32782]: pgmap v15509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:43 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28657.401757 secs 2024-04-26T19:45:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:43 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28657.401757 secs 2024-04-26T19:45:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:43 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28657.401757 secs 2024-04-26T19:45:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:44 smithi196 ceph-mon[32572]: pgmap v15510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:44 smithi110 ceph-mon[28069]: pgmap v15510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:44 smithi193 ceph-mon[32782]: pgmap v15510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:46 smithi196 ceph-mon[32572]: pgmap v15511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:46 smithi110 ceph-mon[28069]: pgmap v15511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:46 smithi193 ceph-mon[32782]: pgmap v15511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:45:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:48 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28662.401875 secs 2024-04-26T19:45:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:48 smithi110 ceph-mon[28069]: pgmap v15512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:45:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:48 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28662.401875 secs 2024-04-26T19:45:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:48 smithi193 ceph-mon[32782]: pgmap v15512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:45:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:48 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28662.401875 secs 2024-04-26T19:45:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:48 smithi196 ceph-mon[32572]: pgmap v15512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:45:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:45:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:45:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:45:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:45:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:45:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:45:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:45:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:45:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:45:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:45:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:50 smithi110 ceph-mon[28069]: pgmap v15513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:45:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:50 smithi110 ceph-mon[28069]: pgmap v15514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:50 smithi193 ceph-mon[32782]: pgmap v15513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:45:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:50 smithi193 ceph-mon[32782]: pgmap v15514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:50 smithi196 ceph-mon[32572]: pgmap v15513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T19:45:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:50 smithi196 ceph-mon[32572]: pgmap v15514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:51 smithi110 ceph-mon[28069]: pgmap v15515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:51 smithi193 ceph-mon[32782]: pgmap v15515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:51 smithi196 ceph-mon[32572]: pgmap v15515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:52 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28667.401994 secs 2024-04-26T19:45:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:52 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28667.401994 secs 2024-04-26T19:45:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:52 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28667.401994 secs 2024-04-26T19:45:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:53 smithi193 ceph-mon[32782]: pgmap v15516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:53 smithi196 ceph-mon[32572]: pgmap v15516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:53 smithi110 ceph-mon[28069]: pgmap v15516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:56 smithi193 ceph-mon[32782]: pgmap v15517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:56 smithi196 ceph-mon[32572]: pgmap v15517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:56 smithi110 ceph-mon[28069]: pgmap v15517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:45:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:58 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28672.402134 secs 2024-04-26T19:45:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:45:58 smithi193 ceph-mon[32782]: pgmap v15518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T19:45:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:58 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28672.402134 secs 2024-04-26T19:45:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:45:58 smithi196 ceph-mon[32572]: pgmap v15518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T19:45:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:58 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28672.402134 secs 2024-04-26T19:45:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:45:58 smithi110 ceph-mon[28069]: pgmap v15518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T19:46:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:00 smithi193 ceph-mon[32782]: pgmap v15519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:46:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:00 smithi196 ceph-mon[32572]: pgmap v15519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:46:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:00 smithi110 ceph-mon[28069]: pgmap v15519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:46:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:02 smithi193 ceph-mon[32782]: pgmap v15520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:02 smithi196 ceph-mon[32572]: pgmap v15520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:02 smithi110 ceph-mon[28069]: pgmap v15520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:03 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28677.402249 secs 2024-04-26T19:46:03.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:03 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28677.402249 secs 2024-04-26T19:46:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:03 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28677.402249 secs 2024-04-26T19:46:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:04 smithi193 ceph-mon[32782]: pgmap v15521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:04 smithi196 ceph-mon[32572]: pgmap v15521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:04 smithi110 ceph-mon[28069]: pgmap v15521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:06 smithi193 ceph-mon[32782]: pgmap v15522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:06 smithi196 ceph-mon[32572]: pgmap v15522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:06 smithi110 ceph-mon[28069]: pgmap v15522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:08 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28682.402368 secs 2024-04-26T19:46:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:08 smithi193 ceph-mon[32782]: pgmap v15523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:08 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28682.402368 secs 2024-04-26T19:46:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:08 smithi196 ceph-mon[32572]: pgmap v15523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:08 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28682.402368 secs 2024-04-26T19:46:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:08 smithi110 ceph-mon[28069]: pgmap v15523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:10 smithi193 ceph-mon[32782]: pgmap v15524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:10 smithi196 ceph-mon[32572]: pgmap v15524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:10 smithi110 ceph-mon[28069]: pgmap v15524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:12 smithi193 ceph-mon[32782]: pgmap v15525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:12 smithi196 ceph-mon[32572]: pgmap v15525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:12 smithi110 ceph-mon[28069]: pgmap v15525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:13 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28687.402484 secs 2024-04-26T19:46:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:13 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28687.402484 secs 2024-04-26T19:46:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:13 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28687.402484 secs 2024-04-26T19:46:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:14 smithi193 ceph-mon[32782]: pgmap v15526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:14 smithi196 ceph-mon[32572]: pgmap v15526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:14 smithi110 ceph-mon[28069]: pgmap v15526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:16 smithi196 ceph-mon[32572]: pgmap v15527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:16 smithi110 ceph-mon[28069]: pgmap v15527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:16 smithi193 ceph-mon[32782]: pgmap v15527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:18 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28692.402601 secs 2024-04-26T19:46:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:18 smithi196 ceph-mon[32572]: pgmap v15528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:18 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28692.402601 secs 2024-04-26T19:46:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:18 smithi110 ceph-mon[28069]: pgmap v15528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:18 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28692.402601 secs 2024-04-26T19:46:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:18 smithi193 ceph-mon[32782]: pgmap v15528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:20 smithi196 ceph-mon[32572]: pgmap v15529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:20 smithi110 ceph-mon[28069]: pgmap v15529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:20 smithi193 ceph-mon[32782]: pgmap v15529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:22 smithi196 ceph-mon[32572]: pgmap v15530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:22 smithi110 ceph-mon[28069]: pgmap v15530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:22 smithi193 ceph-mon[32782]: pgmap v15530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:23 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28697.402714 secs 2024-04-26T19:46:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:23 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28697.402714 secs 2024-04-26T19:46:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:23 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28697.402714 secs 2024-04-26T19:46:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:24 smithi196 ceph-mon[32572]: pgmap v15531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:24 smithi110 ceph-mon[28069]: pgmap v15531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:24 smithi193 ceph-mon[32782]: pgmap v15531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:26 smithi196 ceph-mon[32572]: pgmap v15532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:26 smithi110 ceph-mon[28069]: pgmap v15532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:26 smithi193 ceph-mon[32782]: pgmap v15532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:28 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28702.402851 secs 2024-04-26T19:46:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:28 smithi196 ceph-mon[32572]: pgmap v15533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:28 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28702.402851 secs 2024-04-26T19:46:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:28 smithi110 ceph-mon[28069]: pgmap v15533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:28 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28702.402851 secs 2024-04-26T19:46:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:28 smithi193 ceph-mon[32782]: pgmap v15533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:30 smithi196 ceph-mon[32572]: pgmap v15534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:30 smithi110 ceph-mon[28069]: pgmap v15534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:30 smithi193 ceph-mon[32782]: pgmap v15534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:32 smithi196 ceph-mon[32572]: pgmap v15535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:32 smithi110 ceph-mon[28069]: pgmap v15535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:32 smithi193 ceph-mon[32782]: pgmap v15535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:33 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28707.402969 secs 2024-04-26T19:46:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:33 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28707.402969 secs 2024-04-26T19:46:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:33 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28707.402969 secs 2024-04-26T19:46:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:34 smithi196 ceph-mon[32572]: pgmap v15536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:34 smithi110 ceph-mon[28069]: pgmap v15536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:34 smithi193 ceph-mon[32782]: pgmap v15536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:36 smithi196 ceph-mon[32572]: pgmap v15537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:36 smithi110 ceph-mon[28069]: pgmap v15537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:36 smithi193 ceph-mon[32782]: pgmap v15537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:38 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28712.403034 secs 2024-04-26T19:46:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:38 smithi196 ceph-mon[32572]: pgmap v15538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:38 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28712.403034 secs 2024-04-26T19:46:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:38 smithi110 ceph-mon[28069]: pgmap v15538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:38 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28712.403034 secs 2024-04-26T19:46:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:38 smithi193 ceph-mon[32782]: pgmap v15538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:40 smithi196 ceph-mon[32572]: pgmap v15539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:40 smithi110 ceph-mon[28069]: pgmap v15539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:40 smithi193 ceph-mon[32782]: pgmap v15539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:42 smithi196 ceph-mon[32572]: pgmap v15540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:42 smithi110 ceph-mon[28069]: pgmap v15540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:42 smithi193 ceph-mon[32782]: pgmap v15540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:43 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28717.403170 secs 2024-04-26T19:46:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:43 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28717.403170 secs 2024-04-26T19:46:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:43 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28717.403170 secs 2024-04-26T19:46:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:44 smithi196 ceph-mon[32572]: pgmap v15541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:44 smithi110 ceph-mon[28069]: pgmap v15541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:44 smithi193 ceph-mon[32782]: pgmap v15541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:46 smithi196 ceph-mon[32572]: pgmap v15542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:46 smithi110 ceph-mon[28069]: pgmap v15542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:46 smithi193 ceph-mon[32782]: pgmap v15542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:48 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28722.403286 secs 2024-04-26T19:46:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:48 smithi196 ceph-mon[32572]: pgmap v15543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:48 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28722.403286 secs 2024-04-26T19:46:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:48 smithi110 ceph-mon[28069]: pgmap v15543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:48 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28722.403286 secs 2024-04-26T19:46:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:48 smithi193 ceph-mon[32782]: pgmap v15543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:46:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:50 smithi196 ceph-mon[32572]: pgmap v15544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:46:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:50 smithi110 ceph-mon[28069]: pgmap v15544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:46:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:50 smithi193 ceph-mon[32782]: pgmap v15544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:46:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:46:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:46:51.123+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:46:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:46:51.123+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T19:46:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:46:51.124+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 222 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T19:46:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:46:51.124+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 222 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:46:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:46:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:46:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:46:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:46:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:46:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:46:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:46:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:46:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:46:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:52 smithi110 ceph-mon[28069]: pgmap v15545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:46:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:52 smithi110 ceph-mon[28069]: pgmap v15546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:52 smithi193 ceph-mon[32782]: pgmap v15545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:46:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:52 smithi193 ceph-mon[32782]: pgmap v15546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:52 smithi196 ceph-mon[32572]: pgmap v15545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:46:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:52 smithi196 ceph-mon[32572]: pgmap v15546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:53 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28727.403417 secs 2024-04-26T19:46:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:53 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28727.403417 secs 2024-04-26T19:46:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:53 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28727.403417 secs 2024-04-26T19:46:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:54 smithi110 ceph-mon[28069]: pgmap v15547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:54 smithi193 ceph-mon[32782]: pgmap v15547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:54 smithi196 ceph-mon[32572]: pgmap v15547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:56 smithi110 ceph-mon[28069]: pgmap v15548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:56 smithi193 ceph-mon[32782]: pgmap v15548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:56 smithi196 ceph-mon[32572]: pgmap v15548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:58 smithi110 ceph-mon[28069]: pgmap v15549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:46:58 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28732.403551 secs 2024-04-26T19:46:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:58 smithi193 ceph-mon[32782]: pgmap v15549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:46:58 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28732.403551 secs 2024-04-26T19:46:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:58 smithi196 ceph-mon[32572]: pgmap v15549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:46:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:46:58 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28732.403551 secs 2024-04-26T19:47:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:00 smithi110 ceph-mon[28069]: pgmap v15550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:47:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:00 smithi193 ceph-mon[32782]: pgmap v15550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:47:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:00 smithi196 ceph-mon[32572]: pgmap v15550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:47:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:02 smithi193 ceph-mon[32782]: pgmap v15551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:47:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:02 smithi196 ceph-mon[32572]: pgmap v15551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:47:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:02 smithi110 ceph-mon[28069]: pgmap v15551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:47:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:03 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28737.403669 secs 2024-04-26T19:47:03.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:03 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28737.403669 secs 2024-04-26T19:47:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:03 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28737.403669 secs 2024-04-26T19:47:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:04 smithi193 ceph-mon[32782]: pgmap v15552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:04 smithi196 ceph-mon[32572]: pgmap v15552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:04 smithi110 ceph-mon[28069]: pgmap v15552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:06 smithi193 ceph-mon[32782]: pgmap v15553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:06 smithi196 ceph-mon[32572]: pgmap v15553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:06 smithi110 ceph-mon[28069]: pgmap v15553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:08 smithi193 ceph-mon[32782]: pgmap v15554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:08 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28742.403789 secs 2024-04-26T19:47:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:08 smithi196 ceph-mon[32572]: pgmap v15554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:08 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28742.403789 secs 2024-04-26T19:47:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:08 smithi110 ceph-mon[28069]: pgmap v15554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:08 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28742.403789 secs 2024-04-26T19:47:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:10 smithi193 ceph-mon[32782]: pgmap v15555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:10 smithi196 ceph-mon[32572]: pgmap v15555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:10 smithi110 ceph-mon[28069]: pgmap v15555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:12.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:12 smithi110 ceph-mon[28069]: pgmap v15556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:12 smithi193 ceph-mon[32782]: pgmap v15556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:12 smithi196 ceph-mon[32572]: pgmap v15556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:13 smithi193 ceph-mon[32782]: 2 slow requests, 0 included below; oldest blocked for > 28747.403906 secs 2024-04-26T19:47:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:13 smithi196 ceph-mon[32572]: 2 slow requests, 0 included below; oldest blocked for > 28747.403906 secs 2024-04-26T19:47:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:13 smithi110 ceph-mon[28069]: 2 slow requests, 0 included below; oldest blocked for > 28747.403906 secs 2024-04-26T19:47:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:14 smithi193 ceph-mon[32782]: pgmap v15557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:14 smithi196 ceph-mon[32572]: pgmap v15557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:14 smithi110 ceph-mon[28069]: pgmap v15557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:16 smithi193 ceph-mon[32782]: pgmap v15558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:47:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:16 smithi196 ceph-mon[32572]: pgmap v15558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:47:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:16 smithi110 ceph-mon[28069]: pgmap v15558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:47:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:18 smithi193 ceph-mon[32782]: pgmap v15559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:47:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:18 smithi193 ceph-mon[32782]: 23 slow requests, 1 included below; oldest blocked for > 28752.403969 secs 2024-04-26T19:47:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:18 smithi193 ceph-mon[32782]: slow request 182.575881 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:47:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:18 smithi196 ceph-mon[32572]: pgmap v15559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:47:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:18 smithi196 ceph-mon[32572]: 23 slow requests, 1 included below; oldest blocked for > 28752.403969 secs 2024-04-26T19:47:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:18 smithi196 ceph-mon[32572]: slow request 182.575881 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:47:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:18 smithi110 ceph-mon[28069]: pgmap v15559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:47:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:18 smithi110 ceph-mon[28069]: 23 slow requests, 1 included below; oldest blocked for > 28752.403969 secs 2024-04-26T19:47:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:18 smithi110 ceph-mon[28069]: slow request 182.575881 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:47:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:47:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:47:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:47:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:47:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T19:47:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T19:47:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:20 smithi196 ceph-mon[32572]: pgmap v15560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:20 smithi110 ceph-mon[28069]: pgmap v15560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:20 smithi193 ceph-mon[32782]: pgmap v15560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:22 smithi196 ceph-mon[32572]: pgmap v15561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:47:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:22 smithi110 ceph-mon[28069]: pgmap v15561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:47:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:22 smithi193 ceph-mon[32782]: pgmap v15561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:47:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28757.404110 secs 2024-04-26T19:47:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28757.404110 secs 2024-04-26T19:47:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28757.404110 secs 2024-04-26T19:47:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:24 smithi196 ceph-mon[32572]: pgmap v15562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:24 smithi110 ceph-mon[28069]: pgmap v15562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:24 smithi193 ceph-mon[32782]: pgmap v15562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:26 smithi196 ceph-mon[32572]: pgmap v15563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:26 smithi110 ceph-mon[28069]: pgmap v15563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:26 smithi193 ceph-mon[32782]: pgmap v15563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:28 smithi196 ceph-mon[32572]: pgmap v15564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28762.404226 secs 2024-04-26T19:47:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:28 smithi110 ceph-mon[28069]: pgmap v15564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28762.404226 secs 2024-04-26T19:47:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:28 smithi193 ceph-mon[32782]: pgmap v15564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28762.404226 secs 2024-04-26T19:47:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:30 smithi196 ceph-mon[32572]: pgmap v15565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:30 smithi110 ceph-mon[28069]: pgmap v15565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:30 smithi193 ceph-mon[32782]: pgmap v15565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:32 smithi196 ceph-mon[32572]: pgmap v15566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:32 smithi110 ceph-mon[28069]: pgmap v15566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:32 smithi193 ceph-mon[32782]: pgmap v15566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28767.404369 secs 2024-04-26T19:47:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28767.404369 secs 2024-04-26T19:47:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28767.404369 secs 2024-04-26T19:47:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:34 smithi196 ceph-mon[32572]: pgmap v15567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:34 smithi110 ceph-mon[28069]: pgmap v15567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:34 smithi193 ceph-mon[32782]: pgmap v15567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:36 smithi196 ceph-mon[32572]: pgmap v15568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:36 smithi110 ceph-mon[28069]: pgmap v15568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:36 smithi193 ceph-mon[32782]: pgmap v15568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:38 smithi196 ceph-mon[32572]: pgmap v15569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28772.404486 secs 2024-04-26T19:47:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:38 smithi110 ceph-mon[28069]: pgmap v15569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28772.404486 secs 2024-04-26T19:47:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:38 smithi193 ceph-mon[32782]: pgmap v15569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28772.404486 secs 2024-04-26T19:47:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:40 smithi196 ceph-mon[32572]: pgmap v15570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:40 smithi110 ceph-mon[28069]: pgmap v15570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:40 smithi193 ceph-mon[32782]: pgmap v15570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:42 smithi196 ceph-mon[32572]: pgmap v15571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:42 smithi110 ceph-mon[28069]: pgmap v15571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:42 smithi193 ceph-mon[32782]: pgmap v15571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28777.404625 secs 2024-04-26T19:47:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28777.404625 secs 2024-04-26T19:47:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28777.404625 secs 2024-04-26T19:47:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:44 smithi196 ceph-mon[32572]: pgmap v15572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:44 smithi110 ceph-mon[28069]: pgmap v15572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:44 smithi193 ceph-mon[32782]: pgmap v15572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:46 smithi196 ceph-mon[32572]: pgmap v15573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:46 smithi110 ceph-mon[28069]: pgmap v15573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:46 smithi193 ceph-mon[32782]: pgmap v15573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:48 smithi196 ceph-mon[32572]: pgmap v15574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28782.404743 secs 2024-04-26T19:47:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:48 smithi110 ceph-mon[28069]: pgmap v15574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28782.404743 secs 2024-04-26T19:47:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:48 smithi193 ceph-mon[32782]: pgmap v15574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28782.404743 secs 2024-04-26T19:47:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:50 smithi196 ceph-mon[32572]: pgmap v15575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:50 smithi110 ceph-mon[28069]: pgmap v15575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:50 smithi193 ceph-mon[32782]: pgmap v15575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:47:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:47:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:47:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:52 smithi196 ceph-mon[32572]: pgmap v15576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:47:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:47:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:52 smithi110 ceph-mon[28069]: pgmap v15576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:47:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:47:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:52 smithi193 ceph-mon[32782]: pgmap v15576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:47:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:47:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:47:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28787.404821 secs 2024-04-26T19:47:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:47:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:47:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:47:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28787.404821 secs 2024-04-26T19:47:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:47:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:47:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:47:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28787.404821 secs 2024-04-26T19:47:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:47:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:47:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:47:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:54 smithi196 ceph-mon[32572]: pgmap v15577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:54 smithi196 ceph-mon[32572]: pgmap v15578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T19:47:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:54 smithi196 ceph-mon[32572]: pgmap v15579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:54 smithi110 ceph-mon[28069]: pgmap v15577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:54 smithi110 ceph-mon[28069]: pgmap v15578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T19:47:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:54 smithi110 ceph-mon[28069]: pgmap v15579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:54 smithi193 ceph-mon[32782]: pgmap v15577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:54 smithi193 ceph-mon[32782]: pgmap v15578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T19:47:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:54 smithi193 ceph-mon[32782]: pgmap v15579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:56 smithi110 ceph-mon[28069]: pgmap v15580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:56 smithi193 ceph-mon[32782]: pgmap v15580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:56 smithi196 ceph-mon[32572]: pgmap v15580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:47:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28792.404892 secs 2024-04-26T19:47:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:47:58 smithi110 ceph-mon[28069]: pgmap v15581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T19:47:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28792.404892 secs 2024-04-26T19:47:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:47:58 smithi193 ceph-mon[32782]: pgmap v15581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T19:47:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28792.404892 secs 2024-04-26T19:47:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:47:58 smithi196 ceph-mon[32572]: pgmap v15581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T19:48:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:00 smithi110 ceph-mon[28069]: pgmap v15582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:00 smithi193 ceph-mon[32782]: pgmap v15582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:00 smithi196 ceph-mon[32572]: pgmap v15582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:02 smithi110 ceph-mon[28069]: pgmap v15583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T19:48:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:02 smithi193 ceph-mon[32782]: pgmap v15583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T19:48:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:02 smithi196 ceph-mon[32572]: pgmap v15583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T19:48:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28797.405009 secs 2024-04-26T19:48:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28797.405009 secs 2024-04-26T19:48:03.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28797.405009 secs 2024-04-26T19:48:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:04 smithi110 ceph-mon[28069]: pgmap v15584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:48:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:04 smithi193 ceph-mon[32782]: pgmap v15584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:48:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:04 smithi196 ceph-mon[32572]: pgmap v15584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:48:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:06 smithi110 ceph-mon[28069]: pgmap v15585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:06 smithi193 ceph-mon[32782]: pgmap v15585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:06 smithi196 ceph-mon[32572]: pgmap v15585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:07 smithi193 ceph-mon[32782]: 23 slow requests, 1 included below; oldest blocked for > 28802.405151 secs 2024-04-26T19:48:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:07 smithi193 ceph-mon[32782]: slow request 23043.660445 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:48:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:07 smithi196 ceph-mon[32572]: 23 slow requests, 1 included below; oldest blocked for > 28802.405151 secs 2024-04-26T19:48:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:07 smithi196 ceph-mon[32572]: slow request 23043.660445 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:48:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:07 smithi110 ceph-mon[28069]: 23 slow requests, 1 included below; oldest blocked for > 28802.405151 secs 2024-04-26T19:48:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:07 smithi110 ceph-mon[28069]: slow request 23043.660445 seconds old, received at 2024-04-26T13:24:03.043028+0000: client_request(client.26740:1 getattr pAsLsXsFs #0x1 2024-04-26T13:24:03.038111+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:48:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:08 smithi193 ceph-mon[32782]: pgmap v15586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:08 smithi196 ceph-mon[32572]: pgmap v15586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:08 smithi110 ceph-mon[28069]: pgmap v15586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:09 smithi193 ceph-mon[32782]: pgmap v15587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:09 smithi196 ceph-mon[32572]: pgmap v15587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:09 smithi110 ceph-mon[28069]: pgmap v15587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:12 smithi193 ceph-mon[32782]: pgmap v15588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:12 smithi196 ceph-mon[32572]: pgmap v15588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:12 smithi110 ceph-mon[28069]: pgmap v15588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28807.405222 secs 2024-04-26T19:48:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28807.405222 secs 2024-04-26T19:48:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28807.405222 secs 2024-04-26T19:48:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:14 smithi193 ceph-mon[32782]: pgmap v15589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:14 smithi196 ceph-mon[32572]: pgmap v15589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:14 smithi110 ceph-mon[28069]: pgmap v15589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:16 smithi193 ceph-mon[32782]: pgmap v15590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.457+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T19:48:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.457+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T19:48:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.457+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:48:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.457+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T19:48:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.458+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:48:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.459+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T19:48:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.459+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T19:48:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.460+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T19:48:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.460+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T19:48:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.460+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261406b040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:48:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.460+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261406b040 comp rx=0 tx=0).stop 2024-04-26T19:48:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.460+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T19:48:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.460+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T19:48:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.460+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T19:48:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.460+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T19:48:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.461+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:48:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:16.462+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261402d070 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T19:48:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:16 smithi196 ceph-mon[32572]: pgmap v15590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:16 smithi110 ceph-mon[28069]: pgmap v15590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28812.405339 secs 2024-04-26T19:48:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:18 smithi196 ceph-mon[32572]: pgmap v15591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28812.405339 secs 2024-04-26T19:48:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:18 smithi110 ceph-mon[28069]: pgmap v15591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28812.405339 secs 2024-04-26T19:48:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:18 smithi193 ceph-mon[32782]: pgmap v15591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:20 smithi196 ceph-mon[32572]: pgmap v15592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:20 smithi110 ceph-mon[28069]: pgmap v15592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:20 smithi193 ceph-mon[32782]: pgmap v15592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:21.138 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:21.137+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:48:21.138 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:21.137+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T19:48:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:21.139+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 223 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T19:48:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:48:21.139+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 223 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:48:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:22 smithi196 ceph-mon[32572]: pgmap v15593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:22 smithi110 ceph-mon[28069]: pgmap v15593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:22 smithi193 ceph-mon[32782]: pgmap v15593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28817.405458 secs 2024-04-26T19:48:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28817.405458 secs 2024-04-26T19:48:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28817.405458 secs 2024-04-26T19:48:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:24 smithi196 ceph-mon[32572]: pgmap v15594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:24 smithi110 ceph-mon[28069]: pgmap v15594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:24 smithi193 ceph-mon[32782]: pgmap v15594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:26 smithi196 ceph-mon[32572]: pgmap v15595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:26 smithi110 ceph-mon[28069]: pgmap v15595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:26 smithi193 ceph-mon[32782]: pgmap v15595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28822.405596 secs 2024-04-26T19:48:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:28 smithi196 ceph-mon[32572]: pgmap v15596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28822.405596 secs 2024-04-26T19:48:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:28 smithi110 ceph-mon[28069]: pgmap v15596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28822.405596 secs 2024-04-26T19:48:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:28 smithi193 ceph-mon[32782]: pgmap v15596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:30 smithi196 ceph-mon[32572]: pgmap v15597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:30 smithi110 ceph-mon[28069]: pgmap v15597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:30 smithi193 ceph-mon[32782]: pgmap v15597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:32 smithi196 ceph-mon[32572]: pgmap v15598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:32 smithi110 ceph-mon[28069]: pgmap v15598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:32 smithi193 ceph-mon[32782]: pgmap v15598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28827.405712 secs 2024-04-26T19:48:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28827.405712 secs 2024-04-26T19:48:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28827.405712 secs 2024-04-26T19:48:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:34 smithi196 ceph-mon[32572]: pgmap v15599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:34 smithi110 ceph-mon[28069]: pgmap v15599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:34 smithi193 ceph-mon[32782]: pgmap v15599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:36 smithi196 ceph-mon[32572]: pgmap v15600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:36 smithi110 ceph-mon[28069]: pgmap v15600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:36 smithi193 ceph-mon[32782]: pgmap v15600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28832.405809 secs 2024-04-26T19:48:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:38 smithi196 ceph-mon[32572]: pgmap v15601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28832.405809 secs 2024-04-26T19:48:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:38 smithi110 ceph-mon[28069]: pgmap v15601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28832.405809 secs 2024-04-26T19:48:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:38 smithi193 ceph-mon[32782]: pgmap v15601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:40 smithi196 ceph-mon[32572]: pgmap v15602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:40 smithi110 ceph-mon[28069]: pgmap v15602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:40 smithi193 ceph-mon[32782]: pgmap v15602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:42 smithi196 ceph-mon[32572]: pgmap v15603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:42 smithi110 ceph-mon[28069]: pgmap v15603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:42 smithi193 ceph-mon[32782]: pgmap v15603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28837.405921 secs 2024-04-26T19:48:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28837.405921 secs 2024-04-26T19:48:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28837.405921 secs 2024-04-26T19:48:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:44 smithi196 ceph-mon[32572]: pgmap v15604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:44 smithi110 ceph-mon[28069]: pgmap v15604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:44 smithi193 ceph-mon[32782]: pgmap v15604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:46 smithi196 ceph-mon[32572]: pgmap v15605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:46 smithi110 ceph-mon[28069]: pgmap v15605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:46 smithi193 ceph-mon[32782]: pgmap v15605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28842.406038 secs 2024-04-26T19:48:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:48 smithi196 ceph-mon[32572]: pgmap v15606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28842.406038 secs 2024-04-26T19:48:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:48 smithi110 ceph-mon[28069]: pgmap v15606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28842.406038 secs 2024-04-26T19:48:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:48 smithi193 ceph-mon[32782]: pgmap v15606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:50 smithi196 ceph-mon[32572]: pgmap v15607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:50 smithi110 ceph-mon[28069]: pgmap v15607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:50 smithi193 ceph-mon[32782]: pgmap v15607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:52 smithi196 ceph-mon[32572]: pgmap v15608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:52 smithi110 ceph-mon[28069]: pgmap v15608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:52 smithi193 ceph-mon[32782]: pgmap v15608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:48:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28847.406109 secs 2024-04-26T19:48:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28847.406109 secs 2024-04-26T19:48:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28847.406109 secs 2024-04-26T19:48:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:54 smithi196 ceph-mon[32572]: pgmap v15609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:48:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:54 smithi110 ceph-mon[28069]: pgmap v15609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:48:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:54 smithi193 ceph-mon[32782]: pgmap v15609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:48:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:48:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:48:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:48:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:48:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:48:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:48:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:48:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:48:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:56 smithi110 ceph-mon[28069]: pgmap v15610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s rd, 1 op/s 2024-04-26T19:48:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:56 smithi110 ceph-mon[28069]: pgmap v15611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:48:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:56 smithi193 ceph-mon[32782]: pgmap v15610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s rd, 1 op/s 2024-04-26T19:48:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:56 smithi193 ceph-mon[32782]: pgmap v15611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:48:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:56 smithi196 ceph-mon[32572]: pgmap v15610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 875 B/s rd, 1 op/s 2024-04-26T19:48:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:56 smithi196 ceph-mon[32572]: pgmap v15611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:48:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28852.406219 secs 2024-04-26T19:48:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:48:58 smithi110 ceph-mon[28069]: pgmap v15612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:48:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28852.406219 secs 2024-04-26T19:48:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:48:58 smithi193 ceph-mon[32782]: pgmap v15612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:48:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28852.406219 secs 2024-04-26T19:48:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:48:58 smithi196 ceph-mon[32572]: pgmap v15612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:00 smithi110 ceph-mon[28069]: pgmap v15613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:00 smithi193 ceph-mon[32782]: pgmap v15613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:00 smithi196 ceph-mon[32572]: pgmap v15613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:02 smithi110 ceph-mon[28069]: pgmap v15614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:02 smithi193 ceph-mon[32782]: pgmap v15614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:02 smithi196 ceph-mon[32572]: pgmap v15614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28857.406335 secs 2024-04-26T19:49:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28857.406335 secs 2024-04-26T19:49:03.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28857.406335 secs 2024-04-26T19:49:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:04 smithi110 ceph-mon[28069]: pgmap v15615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:04 smithi193 ceph-mon[32782]: pgmap v15615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:04 smithi196 ceph-mon[32572]: pgmap v15615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:49:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:06 smithi193 ceph-mon[32782]: pgmap v15616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:49:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:06 smithi196 ceph-mon[32572]: pgmap v15616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:49:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:06 smithi110 ceph-mon[28069]: pgmap v15616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:49:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28862.406452 secs 2024-04-26T19:49:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:08 smithi193 ceph-mon[32782]: pgmap v15617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28862.406452 secs 2024-04-26T19:49:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:08 smithi196 ceph-mon[32572]: pgmap v15617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28862.406452 secs 2024-04-26T19:49:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:08 smithi110 ceph-mon[28069]: pgmap v15617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:10 smithi193 ceph-mon[32782]: pgmap v15618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:10 smithi196 ceph-mon[32572]: pgmap v15618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:10 smithi110 ceph-mon[28069]: pgmap v15618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:12.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:12 smithi110 ceph-mon[28069]: pgmap v15619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:12 smithi193 ceph-mon[32782]: pgmap v15619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:12 smithi196 ceph-mon[32572]: pgmap v15619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28867.406585 secs 2024-04-26T19:49:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28867.406585 secs 2024-04-26T19:49:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28867.406585 secs 2024-04-26T19:49:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:14 smithi110 ceph-mon[28069]: pgmap v15620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:14.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:49:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:49:14.214+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:14.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:49:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:49:14.214+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:14.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:49:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:49:14.214+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:14.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:49:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:49:14.214+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:14.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:49:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:49:14.214+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:14 smithi193 ceph-mon[32782]: pgmap v15620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:14 smithi196 ceph-mon[32572]: pgmap v15620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:16 smithi193 ceph-mon[32782]: pgmap v15621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:16 smithi196 ceph-mon[32572]: pgmap v15621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:16 smithi110 ceph-mon[28069]: pgmap v15621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28872.406707 secs 2024-04-26T19:49:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:18 smithi193 ceph-mon[32782]: pgmap v15622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28872.406707 secs 2024-04-26T19:49:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:18 smithi196 ceph-mon[32572]: pgmap v15622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28872.406707 secs 2024-04-26T19:49:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:18 smithi110 ceph-mon[28069]: pgmap v15622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:20 smithi193 ceph-mon[32782]: pgmap v15623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:49:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:20 smithi196 ceph-mon[32572]: pgmap v15623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:49:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:20 smithi110 ceph-mon[28069]: pgmap v15623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:49:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:22 smithi193 ceph-mon[32782]: pgmap v15624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:49:22.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:22 smithi196 ceph-mon[32572]: pgmap v15624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:49:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:22 smithi110 ceph-mon[28069]: pgmap v15624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:49:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28877.406772 secs 2024-04-26T19:49:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28877.406772 secs 2024-04-26T19:49:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28877.406772 secs 2024-04-26T19:49:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:24 smithi193 ceph-mon[32782]: pgmap v15625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:49:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:24 smithi196 ceph-mon[32572]: pgmap v15625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:49:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:24 smithi110 ceph-mon[28069]: pgmap v15625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:49:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:26 smithi196 ceph-mon[32572]: pgmap v15626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:49:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:26 smithi110 ceph-mon[28069]: pgmap v15626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:49:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:26 smithi193 ceph-mon[32782]: pgmap v15626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:49:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28882.406892 secs 2024-04-26T19:49:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:28 smithi196 ceph-mon[32572]: pgmap v15627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:49:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28882.406892 secs 2024-04-26T19:49:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:28 smithi110 ceph-mon[28069]: pgmap v15627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:49:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28882.406892 secs 2024-04-26T19:49:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:28 smithi193 ceph-mon[32782]: pgmap v15627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T19:49:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:30 smithi196 ceph-mon[32572]: pgmap v15628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:49:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:30 smithi110 ceph-mon[28069]: pgmap v15628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:49:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:30 smithi193 ceph-mon[32782]: pgmap v15628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T19:49:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:32 smithi196 ceph-mon[32572]: pgmap v15629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:32 smithi110 ceph-mon[28069]: pgmap v15629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:32 smithi193 ceph-mon[32782]: pgmap v15629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:33.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28887.407021 secs 2024-04-26T19:49:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28887.407021 secs 2024-04-26T19:49:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28887.407021 secs 2024-04-26T19:49:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:34 smithi196 ceph-mon[32572]: pgmap v15630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:34 smithi110 ceph-mon[28069]: pgmap v15630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:34 smithi193 ceph-mon[32782]: pgmap v15630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:36 smithi196 ceph-mon[32572]: pgmap v15631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:36 smithi110 ceph-mon[28069]: pgmap v15631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:36 smithi193 ceph-mon[32782]: pgmap v15631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:38.673 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28892.407132 secs 2024-04-26T19:49:38.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:38 smithi193 ceph-mon[32782]: pgmap v15632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28892.407132 secs 2024-04-26T19:49:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:38 smithi196 ceph-mon[32572]: pgmap v15632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28892.407132 secs 2024-04-26T19:49:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:38 smithi110 ceph-mon[28069]: pgmap v15632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:40 smithi196 ceph-mon[32572]: pgmap v15633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:40 smithi110 ceph-mon[28069]: pgmap v15633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:40 smithi193 ceph-mon[32782]: pgmap v15633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:42 smithi196 ceph-mon[32572]: pgmap v15634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:42 smithi110 ceph-mon[28069]: pgmap v15634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:42 smithi193 ceph-mon[32782]: pgmap v15634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28897.407223 secs 2024-04-26T19:49:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28897.407223 secs 2024-04-26T19:49:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28897.407223 secs 2024-04-26T19:49:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:44 smithi196 ceph-mon[32572]: pgmap v15635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:44 smithi110 ceph-mon[28069]: pgmap v15635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:44 smithi193 ceph-mon[32782]: pgmap v15635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:46 smithi196 ceph-mon[32572]: pgmap v15636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:46 smithi110 ceph-mon[28069]: pgmap v15636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:46 smithi193 ceph-mon[32782]: pgmap v15636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28902.407338 secs 2024-04-26T19:49:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:48 smithi196 ceph-mon[32572]: pgmap v15637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28902.407338 secs 2024-04-26T19:49:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:48 smithi110 ceph-mon[28069]: pgmap v15637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28902.407338 secs 2024-04-26T19:49:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:48 smithi193 ceph-mon[32782]: pgmap v15637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:50 smithi196 ceph-mon[32572]: pgmap v15638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:50 smithi110 ceph-mon[28069]: pgmap v15638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:50 smithi193 ceph-mon[32782]: pgmap v15638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:52 smithi196 ceph-mon[32572]: pgmap v15639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:52 smithi110 ceph-mon[28069]: pgmap v15639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:52 smithi193 ceph-mon[32782]: pgmap v15639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28907.407473 secs 2024-04-26T19:49:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28907.407473 secs 2024-04-26T19:49:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28907.407473 secs 2024-04-26T19:49:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:54 smithi196 ceph-mon[32572]: pgmap v15640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:54 smithi110 ceph-mon[28069]: pgmap v15640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:54 smithi193 ceph-mon[32782]: pgmap v15640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:49:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:49:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:49:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:49:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:56 smithi196 ceph-mon[32572]: pgmap v15641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:56 smithi110 ceph-mon[28069]: pgmap v15641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:56 smithi193 ceph-mon[32782]: pgmap v15641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28912.407539 secs 2024-04-26T19:49:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: pgmap v15642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28912.407539 secs 2024-04-26T19:49:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: pgmap v15642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28912.407539 secs 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: pgmap v15642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:58.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:49:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:59 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:49:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:59 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:49:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:59 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:49:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:59 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:49:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:49:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:59 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:49:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:59 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:49:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:59 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:49:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:59 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:49:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:49:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:59 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T19:49:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:59 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T19:49:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:59 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T19:49:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:59 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T19:49:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:49:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:49:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:50:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:00 smithi196 ceph-mon[32572]: pgmap v15643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:50:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:00 smithi110 ceph-mon[28069]: pgmap v15643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:50:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:00 smithi193 ceph-mon[32782]: pgmap v15643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T19:50:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:50:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:50:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:50:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:50:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: pgmap v15644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T19:50:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: pgmap v15645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:50:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: pgmap v15644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: pgmap v15645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:50:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: pgmap v15644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: pgmap v15645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:50:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28917.407795 secs 2024-04-26T19:50:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:03 smithi193 ceph-mon[32782]: pgmap v15646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:50:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28917.407795 secs 2024-04-26T19:50:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:03 smithi196 ceph-mon[32572]: pgmap v15646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:50:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28917.407795 secs 2024-04-26T19:50:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:03 smithi110 ceph-mon[28069]: pgmap v15646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T19:50:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:05 smithi193 ceph-mon[32782]: pgmap v15647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:05 smithi196 ceph-mon[32572]: pgmap v15647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:05 smithi110 ceph-mon[28069]: pgmap v15647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:07 smithi193 ceph-mon[32782]: pgmap v15648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:07 smithi196 ceph-mon[32572]: pgmap v15648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:07 smithi110 ceph-mon[28069]: pgmap v15648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28922.407807 secs 2024-04-26T19:50:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28922.407807 secs 2024-04-26T19:50:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28922.407807 secs 2024-04-26T19:50:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:09 smithi196 ceph-mon[32572]: pgmap v15649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:09 smithi110 ceph-mon[28069]: pgmap v15649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:09 smithi193 ceph-mon[32782]: pgmap v15649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:10 smithi196 ceph-mon[32572]: pgmap v15650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:50:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:10 smithi110 ceph-mon[28069]: pgmap v15650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:50:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:10 smithi193 ceph-mon[32782]: pgmap v15650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:50:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28927.407926 secs 2024-04-26T19:50:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:13 smithi193 ceph-mon[32782]: pgmap v15651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:13.745 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28927.407926 secs 2024-04-26T19:50:13.745 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:13 smithi110 ceph-mon[28069]: pgmap v15651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28927.407926 secs 2024-04-26T19:50:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:13 smithi196 ceph-mon[32572]: pgmap v15651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:15.451 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:15 smithi110 ceph-mon[28069]: pgmap v15652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:15 smithi193 ceph-mon[32782]: pgmap v15652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:15 smithi196 ceph-mon[32572]: pgmap v15652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:17 smithi196 ceph-mon[32572]: pgmap v15653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:17 smithi110 ceph-mon[28069]: pgmap v15653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:17 smithi193 ceph-mon[32782]: pgmap v15653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:18 smithi196 ceph-mon[32572]: 23 slow requests, 1 included below; oldest blocked for > 28932.408017 secs 2024-04-26T19:50:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:18 smithi196 ceph-mon[32572]: slow request 362.579928 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:50:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:18 smithi110 ceph-mon[28069]: 23 slow requests, 1 included below; oldest blocked for > 28932.408017 secs 2024-04-26T19:50:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:18 smithi110 ceph-mon[28069]: slow request 362.579928 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:50:18.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:18 smithi193 ceph-mon[32782]: 23 slow requests, 1 included below; oldest blocked for > 28932.408017 secs 2024-04-26T19:50:18.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:18 smithi193 ceph-mon[32782]: slow request 362.579928 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:50:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:19 smithi196 ceph-mon[32572]: pgmap v15654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:19 smithi110 ceph-mon[28069]: pgmap v15654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:19 smithi193 ceph-mon[32782]: pgmap v15654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:21 smithi196 ceph-mon[32572]: pgmap v15655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:21 smithi110 ceph-mon[28069]: pgmap v15655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:21 smithi193 ceph-mon[32782]: pgmap v15655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28937.408153 secs 2024-04-26T19:50:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:23 smithi196 ceph-mon[32572]: pgmap v15656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28937.408153 secs 2024-04-26T19:50:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:23 smithi110 ceph-mon[28069]: pgmap v15656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28937.408153 secs 2024-04-26T19:50:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:23 smithi193 ceph-mon[32782]: pgmap v15656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:25 smithi196 ceph-mon[32572]: pgmap v15657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:25 smithi110 ceph-mon[28069]: pgmap v15657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:25 smithi193 ceph-mon[32782]: pgmap v15657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:27 smithi196 ceph-mon[32572]: pgmap v15658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:27 smithi110 ceph-mon[28069]: pgmap v15658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:27 smithi193 ceph-mon[32782]: pgmap v15658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28942.408288 secs 2024-04-26T19:50:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28942.408288 secs 2024-04-26T19:50:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28942.408288 secs 2024-04-26T19:50:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:29 smithi196 ceph-mon[32572]: pgmap v15659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:29 smithi110 ceph-mon[28069]: pgmap v15659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:29 smithi193 ceph-mon[32782]: pgmap v15659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:31 smithi196 ceph-mon[32572]: pgmap v15660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:31 smithi110 ceph-mon[28069]: pgmap v15660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:31 smithi193 ceph-mon[32782]: pgmap v15660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28947.408427 secs 2024-04-26T19:50:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:33 smithi196 ceph-mon[32572]: pgmap v15661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28947.408427 secs 2024-04-26T19:50:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:33 smithi110 ceph-mon[28069]: pgmap v15661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28947.408427 secs 2024-04-26T19:50:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:33 smithi193 ceph-mon[32782]: pgmap v15661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:35.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:35 smithi196 ceph-mon[32572]: pgmap v15662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:35 smithi110 ceph-mon[28069]: pgmap v15662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:35 smithi193 ceph-mon[32782]: pgmap v15662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:37 smithi196 ceph-mon[32572]: pgmap v15663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:37 smithi110 ceph-mon[28069]: pgmap v15663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:37 smithi193 ceph-mon[32782]: pgmap v15663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28952.408552 secs 2024-04-26T19:50:38.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28952.408552 secs 2024-04-26T19:50:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28952.408552 secs 2024-04-26T19:50:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:39 smithi196 ceph-mon[32572]: pgmap v15664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:39 smithi110 ceph-mon[28069]: pgmap v15664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:39.791 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:39 smithi193 ceph-mon[32782]: pgmap v15664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:41 smithi196 ceph-mon[32572]: pgmap v15665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:41 smithi110 ceph-mon[28069]: pgmap v15665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:41 smithi193 ceph-mon[32782]: pgmap v15665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28957.408651 secs 2024-04-26T19:50:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:43 smithi196 ceph-mon[32572]: pgmap v15666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28957.408651 secs 2024-04-26T19:50:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:43 smithi110 ceph-mon[28069]: pgmap v15666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28957.408651 secs 2024-04-26T19:50:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:43 smithi193 ceph-mon[32782]: pgmap v15666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:45 smithi196 ceph-mon[32572]: pgmap v15667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:45 smithi110 ceph-mon[28069]: pgmap v15667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:45 smithi193 ceph-mon[32782]: pgmap v15667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:47 smithi196 ceph-mon[32572]: pgmap v15668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:47 smithi110 ceph-mon[28069]: pgmap v15668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:47 smithi193 ceph-mon[32782]: pgmap v15668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28962.408784 secs 2024-04-26T19:50:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28962.408784 secs 2024-04-26T19:50:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28962.408784 secs 2024-04-26T19:50:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:49 smithi196 ceph-mon[32572]: pgmap v15669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:49 smithi110 ceph-mon[28069]: pgmap v15669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:49 smithi193 ceph-mon[32782]: pgmap v15669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:51 smithi196 ceph-mon[32572]: pgmap v15670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:51 smithi110 ceph-mon[28069]: pgmap v15670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:51 smithi193 ceph-mon[32782]: pgmap v15670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28967.408910 secs 2024-04-26T19:50:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:53 smithi196 ceph-mon[32572]: pgmap v15671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28967.408910 secs 2024-04-26T19:50:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:53 smithi110 ceph-mon[28069]: pgmap v15671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28967.408910 secs 2024-04-26T19:50:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:53 smithi193 ceph-mon[32782]: pgmap v15671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:55 smithi196 ceph-mon[32572]: pgmap v15672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:55 smithi110 ceph-mon[28069]: pgmap v15672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:55 smithi193 ceph-mon[32782]: pgmap v15672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:50:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:57 smithi110 ceph-mon[28069]: pgmap v15673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:57 smithi193 ceph-mon[32782]: pgmap v15673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:57 smithi196 ceph-mon[32572]: pgmap v15673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:50:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28972.409035 secs 2024-04-26T19:50:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28972.409035 secs 2024-04-26T19:50:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28972.409035 secs 2024-04-26T19:50:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:50:59 smithi110 ceph-mon[28069]: pgmap v15674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:50:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:50:59 smithi193 ceph-mon[32782]: pgmap v15674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:50:59 smithi196 ceph-mon[32572]: pgmap v15674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:01 smithi110 ceph-mon[28069]: pgmap v15675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:51:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:01 smithi193 ceph-mon[32782]: pgmap v15675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:51:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:01 smithi196 ceph-mon[32572]: pgmap v15675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:51:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:51:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:51:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:51:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:51:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:51:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:51:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:51:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:51:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:51:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28977.409121 secs 2024-04-26T19:51:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:03 smithi110 ceph-mon[28069]: pgmap v15676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:51:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:03 smithi110 ceph-mon[28069]: pgmap v15677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T19:51:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28977.409121 secs 2024-04-26T19:51:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:03 smithi193 ceph-mon[32782]: pgmap v15676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:51:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:03 smithi193 ceph-mon[32782]: pgmap v15677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T19:51:03.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28977.409121 secs 2024-04-26T19:51:03.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:03 smithi196 ceph-mon[32572]: pgmap v15676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T19:51:03.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:03 smithi196 ceph-mon[32572]: pgmap v15677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T19:51:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:05 smithi193 ceph-mon[32782]: pgmap v15678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:05 smithi196 ceph-mon[32572]: pgmap v15678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:05 smithi110 ceph-mon[28069]: pgmap v15678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:07 smithi193 ceph-mon[32782]: pgmap v15679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:07 smithi196 ceph-mon[32572]: pgmap v15679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:07 smithi110 ceph-mon[28069]: pgmap v15679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28982.409218 secs 2024-04-26T19:51:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28982.409218 secs 2024-04-26T19:51:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28982.409218 secs 2024-04-26T19:51:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:09 smithi193 ceph-mon[32782]: pgmap v15680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:09 smithi196 ceph-mon[32572]: pgmap v15680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:09 smithi110 ceph-mon[28069]: pgmap v15680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:11 smithi193 ceph-mon[32782]: pgmap v15681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:11 smithi196 ceph-mon[32572]: pgmap v15681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:11 smithi110 ceph-mon[28069]: pgmap v15681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:51:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28987.409351 secs 2024-04-26T19:51:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28987.409351 secs 2024-04-26T19:51:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28987.409351 secs 2024-04-26T19:51:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:13 smithi193 ceph-mon[32782]: pgmap v15682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:51:13.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:13 smithi110 ceph-mon[28069]: pgmap v15682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:51:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:13 smithi196 ceph-mon[32572]: pgmap v15682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:51:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:14 smithi196 ceph-mon[32572]: pgmap v15683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:14 smithi110 ceph-mon[28069]: pgmap v15683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:14 smithi193 ceph-mon[32782]: pgmap v15683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:16 smithi196 ceph-mon[32572]: pgmap v15684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:16 smithi110 ceph-mon[28069]: pgmap v15684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:16 smithi193 ceph-mon[32782]: pgmap v15684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28992.409453 secs 2024-04-26T19:51:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28992.409453 secs 2024-04-26T19:51:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28992.409453 secs 2024-04-26T19:51:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:18 smithi196 ceph-mon[32572]: pgmap v15685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:18 smithi110 ceph-mon[28069]: pgmap v15685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:18 smithi193 ceph-mon[32782]: pgmap v15685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:51:21.168+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:51:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:51:21.168+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T19:51:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:51:21.169+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 224 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T19:51:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:51:21.169+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 224 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:51:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:20 smithi196 ceph-mon[32572]: pgmap v15686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:20 smithi110 ceph-mon[28069]: pgmap v15686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:20 smithi193 ceph-mon[32782]: pgmap v15686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 28997.409590 secs 2024-04-26T19:51:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:22 smithi196 ceph-mon[32572]: pgmap v15687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 28997.409590 secs 2024-04-26T19:51:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:22 smithi110 ceph-mon[28069]: pgmap v15687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 28997.409590 secs 2024-04-26T19:51:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:22 smithi193 ceph-mon[32782]: pgmap v15687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:24 smithi196 ceph-mon[32572]: pgmap v15688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:24 smithi110 ceph-mon[28069]: pgmap v15688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:24 smithi193 ceph-mon[32782]: pgmap v15688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:26 smithi196 ceph-mon[32572]: pgmap v15689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:26 smithi110 ceph-mon[28069]: pgmap v15689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:26 smithi193 ceph-mon[32782]: pgmap v15689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29002.409688 secs 2024-04-26T19:51:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29002.409688 secs 2024-04-26T19:51:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29002.409688 secs 2024-04-26T19:51:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:28 smithi196 ceph-mon[32572]: pgmap v15690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:28 smithi110 ceph-mon[28069]: pgmap v15690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:28 smithi193 ceph-mon[32782]: pgmap v15690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:30 smithi196 ceph-mon[32572]: pgmap v15691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:30 smithi110 ceph-mon[28069]: pgmap v15691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:30 smithi193 ceph-mon[32782]: pgmap v15691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29007.409773 secs 2024-04-26T19:51:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:32 smithi196 ceph-mon[32572]: pgmap v15692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29007.409773 secs 2024-04-26T19:51:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:32 smithi110 ceph-mon[28069]: pgmap v15692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29007.409773 secs 2024-04-26T19:51:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:32 smithi193 ceph-mon[32782]: pgmap v15692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:34 smithi196 ceph-mon[32572]: pgmap v15693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:34 smithi110 ceph-mon[28069]: pgmap v15693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:34 smithi193 ceph-mon[32782]: pgmap v15693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:36 smithi196 ceph-mon[32572]: pgmap v15694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:36 smithi110 ceph-mon[28069]: pgmap v15694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:36 smithi193 ceph-mon[32782]: pgmap v15694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29012.409895 secs 2024-04-26T19:51:38.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29012.409895 secs 2024-04-26T19:51:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29012.409895 secs 2024-04-26T19:51:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:39 smithi196 ceph-mon[32572]: pgmap v15695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:39 smithi110 ceph-mon[28069]: pgmap v15695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:39 smithi193 ceph-mon[32782]: pgmap v15695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:41 smithi110 ceph-mon[28069]: pgmap v15696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:41 smithi193 ceph-mon[32782]: pgmap v15696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:41 smithi196 ceph-mon[32572]: pgmap v15696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29017.410013 secs 2024-04-26T19:51:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:43 smithi110 ceph-mon[28069]: pgmap v15697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29017.410013 secs 2024-04-26T19:51:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:43 smithi193 ceph-mon[32782]: pgmap v15697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29017.410013 secs 2024-04-26T19:51:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:43 smithi196 ceph-mon[32572]: pgmap v15697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:45 smithi110 ceph-mon[28069]: pgmap v15698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:45 smithi193 ceph-mon[32782]: pgmap v15698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:45 smithi196 ceph-mon[32572]: pgmap v15698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:47 smithi110 ceph-mon[28069]: pgmap v15699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:47 smithi193 ceph-mon[32782]: pgmap v15699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:47 smithi196 ceph-mon[32572]: pgmap v15699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29022.410120 secs 2024-04-26T19:51:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29022.410120 secs 2024-04-26T19:51:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29022.410120 secs 2024-04-26T19:51:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:49 smithi110 ceph-mon[28069]: pgmap v15700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:49 smithi193 ceph-mon[32782]: pgmap v15700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:49 smithi196 ceph-mon[32572]: pgmap v15700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:51 smithi110 ceph-mon[28069]: pgmap v15701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:51 smithi193 ceph-mon[32782]: pgmap v15701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:51 smithi196 ceph-mon[32572]: pgmap v15701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29027.410237 secs 2024-04-26T19:51:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:53 smithi193 ceph-mon[32782]: pgmap v15702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29027.410237 secs 2024-04-26T19:51:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:53 smithi196 ceph-mon[32572]: pgmap v15702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29027.410237 secs 2024-04-26T19:51:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:53 smithi110 ceph-mon[28069]: pgmap v15702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:55 smithi193 ceph-mon[32782]: pgmap v15703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:55 smithi196 ceph-mon[32572]: pgmap v15703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:55 smithi110 ceph-mon[28069]: pgmap v15703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:57 smithi193 ceph-mon[32782]: pgmap v15704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:57 smithi196 ceph-mon[32572]: pgmap v15704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:57 smithi110 ceph-mon[28069]: pgmap v15704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:51:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29032.410335 secs 2024-04-26T19:51:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29032.410335 secs 2024-04-26T19:51:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29032.410335 secs 2024-04-26T19:51:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:51:59 smithi193 ceph-mon[32782]: pgmap v15705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:51:59 smithi196 ceph-mon[32572]: pgmap v15705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:51:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:51:59 smithi110 ceph-mon[28069]: pgmap v15705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:01 smithi193 ceph-mon[32782]: pgmap v15706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:01 smithi196 ceph-mon[32572]: pgmap v15706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:01 smithi110 ceph-mon[28069]: pgmap v15706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29037.410453 secs 2024-04-26T19:52:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:03 smithi193 ceph-mon[32782]: pgmap v15707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:52:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29037.410453 secs 2024-04-26T19:52:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:03 smithi196 ceph-mon[32572]: pgmap v15707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:52:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29037.410453 secs 2024-04-26T19:52:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:03 smithi110 ceph-mon[28069]: pgmap v15707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:52:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:52:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:52:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:04 smithi193 ceph-mon[32782]: pgmap v15708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:52:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:04 smithi193 ceph-mon[32782]: pgmap v15709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:52:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:52:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:52:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:04 smithi196 ceph-mon[32572]: pgmap v15708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:52:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:04 smithi196 ceph-mon[32572]: pgmap v15709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:52:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:52:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:52:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:04 smithi110 ceph-mon[28069]: pgmap v15708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:52:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:04 smithi110 ceph-mon[28069]: pgmap v15709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:52:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:06 smithi196 ceph-mon[32572]: pgmap v15710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:06 smithi110 ceph-mon[28069]: pgmap v15710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:06 smithi193 ceph-mon[32782]: pgmap v15710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29042.410589 secs 2024-04-26T19:52:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:08 smithi196 ceph-mon[32572]: pgmap v15711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:52:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29042.410589 secs 2024-04-26T19:52:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:08 smithi110 ceph-mon[28069]: pgmap v15711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:52:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29042.410589 secs 2024-04-26T19:52:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:08 smithi193 ceph-mon[32782]: pgmap v15711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T19:52:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:10 smithi196 ceph-mon[32572]: pgmap v15712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:10 smithi110 ceph-mon[28069]: pgmap v15712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:10 smithi193 ceph-mon[32782]: pgmap v15712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:12 smithi196 ceph-mon[32572]: pgmap v15713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:12 smithi110 ceph-mon[28069]: pgmap v15713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:12 smithi193 ceph-mon[32782]: pgmap v15713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:52:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29047.410699 secs 2024-04-26T19:52:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29047.410699 secs 2024-04-26T19:52:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29047.410699 secs 2024-04-26T19:52:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:14 smithi110 ceph-mon[28069]: pgmap v15714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:52:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:14 smithi193 ceph-mon[32782]: pgmap v15714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:52:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:14 smithi196 ceph-mon[32572]: pgmap v15714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:52:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:16 smithi110 ceph-mon[28069]: pgmap v15715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:16 smithi193 ceph-mon[32782]: pgmap v15715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:16 smithi196 ceph-mon[32572]: pgmap v15715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29052.410778 secs 2024-04-26T19:52:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:18 smithi110 ceph-mon[28069]: pgmap v15716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29052.410778 secs 2024-04-26T19:52:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:18 smithi193 ceph-mon[32782]: pgmap v15716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29052.410778 secs 2024-04-26T19:52:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:18 smithi196 ceph-mon[32572]: pgmap v15716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:20 smithi110 ceph-mon[28069]: pgmap v15717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:20 smithi193 ceph-mon[32782]: pgmap v15717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:20 smithi196 ceph-mon[32572]: pgmap v15717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:22 smithi110 ceph-mon[28069]: pgmap v15718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:22 smithi193 ceph-mon[32782]: pgmap v15718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:22 smithi196 ceph-mon[32572]: pgmap v15718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29057.410895 secs 2024-04-26T19:52:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29057.410895 secs 2024-04-26T19:52:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29057.410895 secs 2024-04-26T19:52:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:24 smithi193 ceph-mon[32782]: pgmap v15719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:24 smithi196 ceph-mon[32572]: pgmap v15719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:24 smithi110 ceph-mon[28069]: pgmap v15719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:26 smithi193 ceph-mon[32782]: pgmap v15720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:26 smithi196 ceph-mon[32572]: pgmap v15720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:26 smithi110 ceph-mon[28069]: pgmap v15720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29062.410978 secs 2024-04-26T19:52:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:28 smithi193 ceph-mon[32782]: pgmap v15721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29062.410978 secs 2024-04-26T19:52:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:28 smithi196 ceph-mon[32572]: pgmap v15721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29062.410978 secs 2024-04-26T19:52:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:28 smithi110 ceph-mon[28069]: pgmap v15721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:30 smithi193 ceph-mon[32782]: pgmap v15722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:30 smithi196 ceph-mon[32572]: pgmap v15722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:30 smithi110 ceph-mon[28069]: pgmap v15722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:32 smithi193 ceph-mon[32782]: pgmap v15723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:32 smithi196 ceph-mon[32572]: pgmap v15723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:32 smithi110 ceph-mon[28069]: pgmap v15723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29067.411097 secs 2024-04-26T19:52:33.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29067.411097 secs 2024-04-26T19:52:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29067.411097 secs 2024-04-26T19:52:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:34 smithi193 ceph-mon[32782]: pgmap v15724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:34 smithi196 ceph-mon[32572]: pgmap v15724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:34 smithi110 ceph-mon[28069]: pgmap v15724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:36 smithi193 ceph-mon[32782]: pgmap v15725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:36 smithi196 ceph-mon[32572]: pgmap v15725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:36 smithi110 ceph-mon[28069]: pgmap v15725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29072.411221 secs 2024-04-26T19:52:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29072.411221 secs 2024-04-26T19:52:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29072.411221 secs 2024-04-26T19:52:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:38 smithi193 ceph-mon[32782]: pgmap v15726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:38 smithi196 ceph-mon[32572]: pgmap v15726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:38 smithi110 ceph-mon[28069]: pgmap v15726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:39 smithi193 ceph-mon[32782]: pgmap v15727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:39 smithi196 ceph-mon[32572]: pgmap v15727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:39 smithi110 ceph-mon[28069]: pgmap v15727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:42 smithi196 ceph-mon[32572]: pgmap v15728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:42 smithi110 ceph-mon[28069]: pgmap v15728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:42 smithi193 ceph-mon[32782]: pgmap v15728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29077.411341 secs 2024-04-26T19:52:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29077.411341 secs 2024-04-26T19:52:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29077.411341 secs 2024-04-26T19:52:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:44 smithi110 ceph-mon[28069]: pgmap v15729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:44 smithi193 ceph-mon[32782]: pgmap v15729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:45.008 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:44 smithi196 ceph-mon[32572]: pgmap v15729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:46 smithi110 ceph-mon[28069]: pgmap v15730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:46 smithi193 ceph-mon[32782]: pgmap v15730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:47.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:46 smithi196 ceph-mon[32572]: pgmap v15730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29082.411407 secs 2024-04-26T19:52:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:48 smithi110 ceph-mon[28069]: pgmap v15731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29082.411407 secs 2024-04-26T19:52:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:48 smithi193 ceph-mon[32782]: pgmap v15731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29082.411407 secs 2024-04-26T19:52:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:48 smithi196 ceph-mon[32572]: pgmap v15731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:50 smithi110 ceph-mon[28069]: pgmap v15732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:50 smithi193 ceph-mon[32782]: pgmap v15732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:50 smithi196 ceph-mon[32572]: pgmap v15732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T19:52:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:52 smithi110 ceph-mon[28069]: pgmap v15733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:52 smithi193 ceph-mon[32782]: pgmap v15733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:53.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:52 smithi196 ceph-mon[32572]: pgmap v15733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29087.411548 secs 2024-04-26T19:52:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29087.411548 secs 2024-04-26T19:52:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29087.411548 secs 2024-04-26T19:52:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:54 smithi193 ceph-mon[32782]: pgmap v15734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:54 smithi196 ceph-mon[32572]: pgmap v15734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:54 smithi110 ceph-mon[28069]: pgmap v15734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:56 smithi193 ceph-mon[32782]: pgmap v15735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:57.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:56 smithi196 ceph-mon[32572]: pgmap v15735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:56 smithi110 ceph-mon[28069]: pgmap v15735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:52:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29092.411704 secs 2024-04-26T19:52:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:52:58 smithi193 ceph-mon[32782]: pgmap v15736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29092.411704 secs 2024-04-26T19:52:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:52:58 smithi196 ceph-mon[32572]: pgmap v15736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:52:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29092.411704 secs 2024-04-26T19:52:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:52:58 smithi110 ceph-mon[28069]: pgmap v15736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:00 smithi193 ceph-mon[32782]: pgmap v15737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:00 smithi196 ceph-mon[32572]: pgmap v15737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:00 smithi110 ceph-mon[28069]: pgmap v15737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:02 smithi193 ceph-mon[32782]: pgmap v15738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29097.411848 secs 2024-04-26T19:53:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:02 smithi196 ceph-mon[32572]: pgmap v15738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29097.411848 secs 2024-04-26T19:53:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:02 smithi110 ceph-mon[28069]: pgmap v15738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29097.411848 secs 2024-04-26T19:53:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:04 smithi193 ceph-mon[32782]: pgmap v15739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:53:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:04 smithi196 ceph-mon[32572]: pgmap v15739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:53:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:04 smithi110 ceph-mon[28069]: pgmap v15739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:53:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:53:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:53:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:53:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:53:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:53:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:53:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:53:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:53:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:53:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:06 smithi193 ceph-mon[32782]: pgmap v15740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T19:53:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:06 smithi193 ceph-mon[32782]: pgmap v15741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:06 smithi196 ceph-mon[32572]: pgmap v15740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T19:53:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:06 smithi196 ceph-mon[32572]: pgmap v15741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:06 smithi110 ceph-mon[28069]: pgmap v15740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T19:53:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:06 smithi110 ceph-mon[28069]: pgmap v15741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29102.411915 secs 2024-04-26T19:53:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29102.411915 secs 2024-04-26T19:53:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29102.411915 secs 2024-04-26T19:53:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:08 smithi193 ceph-mon[32782]: pgmap v15742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:53:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:08 smithi196 ceph-mon[32572]: pgmap v15742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:53:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:08 smithi110 ceph-mon[28069]: pgmap v15742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T19:53:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:09 smithi193 ceph-mon[32782]: pgmap v15743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:09 smithi196 ceph-mon[32572]: pgmap v15743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:09 smithi110 ceph-mon[28069]: pgmap v15743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:12 smithi110 ceph-mon[28069]: pgmap v15744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:12 smithi193 ceph-mon[32782]: pgmap v15744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:12 smithi196 ceph-mon[32572]: pgmap v15744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29107.412039 secs 2024-04-26T19:53:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29107.412039 secs 2024-04-26T19:53:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29107.412039 secs 2024-04-26T19:53:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:14 smithi110 ceph-mon[28069]: pgmap v15745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:14 smithi193 ceph-mon[32782]: pgmap v15745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:14 smithi196 ceph-mon[32572]: pgmap v15745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:16 smithi110 ceph-mon[28069]: pgmap v15746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:53:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:16 smithi193 ceph-mon[32782]: pgmap v15746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:53:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:16 smithi196 ceph-mon[32572]: pgmap v15746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:53:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29112.412135 secs 2024-04-26T19:53:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:18 smithi110 ceph-mon[28069]: pgmap v15747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29112.412135 secs 2024-04-26T19:53:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:18 smithi193 ceph-mon[32782]: pgmap v15747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29112.412135 secs 2024-04-26T19:53:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:18 smithi196 ceph-mon[32572]: pgmap v15747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:20 smithi110 ceph-mon[28069]: pgmap v15748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:20 smithi193 ceph-mon[32782]: pgmap v15748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:20 smithi196 ceph-mon[32572]: pgmap v15748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:22 smithi193 ceph-mon[32782]: pgmap v15749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:22 smithi196 ceph-mon[32572]: pgmap v15749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:22 smithi110 ceph-mon[28069]: pgmap v15749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29117.412267 secs 2024-04-26T19:53:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29117.412267 secs 2024-04-26T19:53:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29117.412267 secs 2024-04-26T19:53:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:24 smithi193 ceph-mon[32782]: pgmap v15750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:24 smithi196 ceph-mon[32572]: pgmap v15750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:24 smithi110 ceph-mon[28069]: pgmap v15750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:26 smithi193 ceph-mon[32782]: pgmap v15751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:26 smithi196 ceph-mon[32572]: pgmap v15751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:26 smithi110 ceph-mon[28069]: pgmap v15751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29122.412412 secs 2024-04-26T19:53:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:28 smithi193 ceph-mon[32782]: pgmap v15752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29122.412412 secs 2024-04-26T19:53:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:28 smithi196 ceph-mon[32572]: pgmap v15752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29122.412412 secs 2024-04-26T19:53:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:28 smithi110 ceph-mon[28069]: pgmap v15752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:30 smithi193 ceph-mon[32782]: pgmap v15753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:30 smithi196 ceph-mon[32572]: pgmap v15753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:30 smithi110 ceph-mon[28069]: pgmap v15753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:32 smithi193 ceph-mon[32782]: pgmap v15754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:32 smithi196 ceph-mon[32572]: pgmap v15754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:32 smithi110 ceph-mon[28069]: pgmap v15754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29127.412553 secs 2024-04-26T19:53:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29127.412553 secs 2024-04-26T19:53:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29127.412553 secs 2024-04-26T19:53:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:34 smithi193 ceph-mon[32782]: pgmap v15755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:34.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:34 smithi196 ceph-mon[32572]: pgmap v15755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:34 smithi110 ceph-mon[28069]: pgmap v15755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:36 smithi193 ceph-mon[32782]: pgmap v15756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:36 smithi196 ceph-mon[32572]: pgmap v15756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:36 smithi110 ceph-mon[28069]: pgmap v15756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29132.412657 secs 2024-04-26T19:53:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:38 smithi193 ceph-mon[32782]: pgmap v15757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29132.412657 secs 2024-04-26T19:53:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:38 smithi196 ceph-mon[32572]: pgmap v15757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29132.412657 secs 2024-04-26T19:53:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:38 smithi110 ceph-mon[28069]: pgmap v15757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:40 smithi193 ceph-mon[32782]: pgmap v15758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:40 smithi196 ceph-mon[32572]: pgmap v15758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:40 smithi110 ceph-mon[28069]: pgmap v15758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:42 smithi193 ceph-mon[32782]: pgmap v15759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:42 smithi196 ceph-mon[32572]: pgmap v15759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:42 smithi110 ceph-mon[28069]: pgmap v15759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29137.412779 secs 2024-04-26T19:53:43.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29137.412779 secs 2024-04-26T19:53:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29137.412779 secs 2024-04-26T19:53:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:44 smithi196 ceph-mon[32572]: pgmap v15760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:44 smithi110 ceph-mon[28069]: pgmap v15760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:44 smithi193 ceph-mon[32782]: pgmap v15760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:46 smithi196 ceph-mon[32572]: pgmap v15761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:46 smithi110 ceph-mon[28069]: pgmap v15761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:46 smithi193 ceph-mon[32782]: pgmap v15761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29142.412895 secs 2024-04-26T19:53:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:48 smithi196 ceph-mon[32572]: pgmap v15762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29142.412895 secs 2024-04-26T19:53:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:48 smithi110 ceph-mon[28069]: pgmap v15762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29142.412895 secs 2024-04-26T19:53:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:48 smithi193 ceph-mon[32782]: pgmap v15762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:50 smithi196 ceph-mon[32572]: pgmap v15763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:50 smithi110 ceph-mon[28069]: pgmap v15763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:50 smithi193 ceph-mon[32782]: pgmap v15763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:52 smithi196 ceph-mon[32572]: pgmap v15764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:52 smithi110 ceph-mon[28069]: pgmap v15764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:52 smithi193 ceph-mon[32782]: pgmap v15764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29147.413024 secs 2024-04-26T19:53:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29147.413024 secs 2024-04-26T19:53:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29147.413024 secs 2024-04-26T19:53:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:54 smithi196 ceph-mon[32572]: pgmap v15765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:54 smithi110 ceph-mon[28069]: pgmap v15765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:54 smithi193 ceph-mon[32782]: pgmap v15765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:53:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:56 smithi196 ceph-mon[32572]: pgmap v15766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:56 smithi110 ceph-mon[28069]: pgmap v15766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:56 smithi193 ceph-mon[32782]: pgmap v15766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29152.413150 secs 2024-04-26T19:53:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:53:58 smithi196 ceph-mon[32572]: pgmap v15767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29152.413150 secs 2024-04-26T19:53:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:53:58 smithi110 ceph-mon[28069]: pgmap v15767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:53:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29152.413150 secs 2024-04-26T19:53:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:53:58 smithi193 ceph-mon[32782]: pgmap v15767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:00 smithi196 ceph-mon[32572]: pgmap v15768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:00 smithi110 ceph-mon[28069]: pgmap v15768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:00 smithi193 ceph-mon[32782]: pgmap v15768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:02 smithi196 ceph-mon[32572]: pgmap v15769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:02 smithi110 ceph-mon[28069]: pgmap v15769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:02 smithi193 ceph-mon[32782]: pgmap v15769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29157.413269 secs 2024-04-26T19:54:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29157.413269 secs 2024-04-26T19:54:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29157.413269 secs 2024-04-26T19:54:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:04 smithi196 ceph-mon[32572]: pgmap v15770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:04 smithi110 ceph-mon[28069]: pgmap v15770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:04 smithi193 ceph-mon[32782]: pgmap v15770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:06 smithi196 ceph-mon[32572]: pgmap v15771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:54:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:06 smithi110 ceph-mon[28069]: pgmap v15771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:54:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:06 smithi193 ceph-mon[32782]: pgmap v15771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:54:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:54:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:54:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:07 smithi196 ceph-mon[32572]: pgmap v15772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T19:54:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:07 smithi196 ceph-mon[32572]: pgmap v15773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:07.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:54:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:54:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:54:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:07 smithi110 ceph-mon[28069]: pgmap v15772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T19:54:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:07 smithi110 ceph-mon[28069]: pgmap v15773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:54:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:54:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:54:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:07 smithi193 ceph-mon[32782]: pgmap v15772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T19:54:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:07 smithi193 ceph-mon[32782]: pgmap v15773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:54:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29162.413406 secs 2024-04-26T19:54:08.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29162.413406 secs 2024-04-26T19:54:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29162.413406 secs 2024-04-26T19:54:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:09 smithi196 ceph-mon[32572]: pgmap v15774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:09 smithi110 ceph-mon[28069]: pgmap v15774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:09 smithi193 ceph-mon[32782]: pgmap v15774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:10 smithi193 ceph-mon[32782]: pgmap v15775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:10 smithi196 ceph-mon[32572]: pgmap v15775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:10 smithi110 ceph-mon[28069]: pgmap v15775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29167.413546 secs 2024-04-26T19:54:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:13 smithi193 ceph-mon[32782]: pgmap v15776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:13.995 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29167.413546 secs 2024-04-26T19:54:13.995 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:13 smithi110 ceph-mon[28069]: pgmap v15776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29167.413546 secs 2024-04-26T19:54:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:13 smithi196 ceph-mon[32572]: pgmap v15776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:14.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:54:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:54:14.413+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:14.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:54:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:54:14.413+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:14.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:54:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:54:14.413+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:14.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:54:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:54:14.413+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:14.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:54:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:54:14.413+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:15 smithi193 ceph-mon[32782]: pgmap v15777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:15 smithi196 ceph-mon[32572]: pgmap v15777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:15 smithi110 ceph-mon[28069]: pgmap v15777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:54:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:17 smithi193 ceph-mon[32782]: pgmap v15778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:54:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29172.413638 secs 2024-04-26T19:54:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:17 smithi196 ceph-mon[32572]: pgmap v15778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:54:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29172.413638 secs 2024-04-26T19:54:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:17 smithi110 ceph-mon[28069]: pgmap v15778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:54:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29172.413638 secs 2024-04-26T19:54:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:19 smithi193 ceph-mon[32782]: pgmap v15779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:54:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:19 smithi196 ceph-mon[32572]: pgmap v15779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:54:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:19 smithi110 ceph-mon[28069]: pgmap v15779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:54:21.200 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:54:21.200+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:54:21.200 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:54:21.200+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T19:54:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:54:21.201+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 225 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T19:54:21.201 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:54:21.201+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 225 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:54:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:21 smithi193 ceph-mon[32782]: pgmap v15780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:54:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:21 smithi196 ceph-mon[32572]: pgmap v15780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:54:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:21 smithi110 ceph-mon[28069]: pgmap v15780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:54:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29177.413708 secs 2024-04-26T19:54:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29177.413708 secs 2024-04-26T19:54:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29177.413708 secs 2024-04-26T19:54:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:23 smithi193 ceph-mon[32782]: pgmap v15781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:54:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:23 smithi196 ceph-mon[32572]: pgmap v15781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:54:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:23 smithi110 ceph-mon[28069]: pgmap v15781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:54:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:25 smithi193 ceph-mon[32782]: pgmap v15782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:54:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:25 smithi196 ceph-mon[32572]: pgmap v15782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:54:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:25 smithi110 ceph-mon[28069]: pgmap v15782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:54:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:26 smithi196 ceph-mon[32572]: pgmap v15783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:54:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:26 smithi110 ceph-mon[28069]: pgmap v15783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:54:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:26 smithi193 ceph-mon[32782]: pgmap v15783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T19:54:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29182.413776 secs 2024-04-26T19:54:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29182.413776 secs 2024-04-26T19:54:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29182.413776 secs 2024-04-26T19:54:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:28 smithi196 ceph-mon[32572]: pgmap v15784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:54:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:28 smithi110 ceph-mon[28069]: pgmap v15784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:54:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:28 smithi193 ceph-mon[32782]: pgmap v15784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T19:54:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:31 smithi193 ceph-mon[32782]: pgmap v15785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:31 smithi196 ceph-mon[32572]: pgmap v15785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:31 smithi110 ceph-mon[28069]: pgmap v15785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29187.413896 secs 2024-04-26T19:54:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29187.413896 secs 2024-04-26T19:54:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29187.413896 secs 2024-04-26T19:54:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:33 smithi193 ceph-mon[32782]: pgmap v15786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:33 smithi196 ceph-mon[32572]: pgmap v15786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:33 smithi110 ceph-mon[28069]: pgmap v15786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:35 smithi193 ceph-mon[32782]: pgmap v15787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:35 smithi196 ceph-mon[32572]: pgmap v15787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:35 smithi110 ceph-mon[28069]: pgmap v15787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:37 smithi193 ceph-mon[32782]: pgmap v15788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29192.413982 secs 2024-04-26T19:54:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:37 smithi196 ceph-mon[32572]: pgmap v15788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29192.413982 secs 2024-04-26T19:54:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:37 smithi110 ceph-mon[28069]: pgmap v15788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29192.413982 secs 2024-04-26T19:54:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:39 smithi193 ceph-mon[32782]: pgmap v15789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:39 smithi196 ceph-mon[32572]: pgmap v15789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:39 smithi110 ceph-mon[28069]: pgmap v15789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:41 smithi193 ceph-mon[32782]: pgmap v15790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:41 smithi196 ceph-mon[32572]: pgmap v15790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:41 smithi110 ceph-mon[28069]: pgmap v15790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29197.414134 secs 2024-04-26T19:54:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29197.414134 secs 2024-04-26T19:54:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29197.414134 secs 2024-04-26T19:54:43.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:43 smithi110 ceph-mon[28069]: pgmap v15791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:43 smithi196 ceph-mon[32572]: pgmap v15791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:43 smithi193 ceph-mon[32782]: pgmap v15791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:44 smithi196 ceph-mon[32572]: pgmap v15792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:44 smithi110 ceph-mon[28069]: pgmap v15792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:44 smithi193 ceph-mon[32782]: pgmap v15792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:47 smithi193 ceph-mon[32782]: pgmap v15793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29202.414232 secs 2024-04-26T19:54:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:47 smithi196 ceph-mon[32572]: pgmap v15793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29202.414232 secs 2024-04-26T19:54:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:47 smithi110 ceph-mon[28069]: pgmap v15793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29202.414232 secs 2024-04-26T19:54:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:49 smithi193 ceph-mon[32782]: pgmap v15794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:49 smithi196 ceph-mon[32572]: pgmap v15794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:49 smithi110 ceph-mon[28069]: pgmap v15794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:51 smithi193 ceph-mon[32782]: pgmap v15795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:51 smithi196 ceph-mon[32572]: pgmap v15795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:51 smithi110 ceph-mon[28069]: pgmap v15795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29207.414374 secs 2024-04-26T19:54:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29207.414374 secs 2024-04-26T19:54:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29207.414374 secs 2024-04-26T19:54:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:53 smithi193 ceph-mon[32782]: pgmap v15796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:53 smithi196 ceph-mon[32572]: pgmap v15796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:53 smithi110 ceph-mon[28069]: pgmap v15796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:55 smithi196 ceph-mon[32572]: pgmap v15797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:55 smithi110 ceph-mon[28069]: pgmap v15797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:55 smithi193 ceph-mon[32782]: pgmap v15797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:56 smithi196 ceph-mon[32572]: pgmap v15798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:56 smithi110 ceph-mon[28069]: pgmap v15798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:56 smithi193 ceph-mon[32782]: pgmap v15798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:54:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29212.414501 secs 2024-04-26T19:54:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29212.414501 secs 2024-04-26T19:54:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29212.414501 secs 2024-04-26T19:54:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:54:58 smithi196 ceph-mon[32572]: pgmap v15799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:54:58 smithi110 ceph-mon[28069]: pgmap v15799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:54:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:54:58 smithi193 ceph-mon[32782]: pgmap v15799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:01 smithi193 ceph-mon[32782]: pgmap v15800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:01 smithi196 ceph-mon[32572]: pgmap v15800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:01 smithi110 ceph-mon[28069]: pgmap v15800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29217.414625 secs 2024-04-26T19:55:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29217.414625 secs 2024-04-26T19:55:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29217.414625 secs 2024-04-26T19:55:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:03 smithi193 ceph-mon[32782]: pgmap v15801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:03 smithi196 ceph-mon[32572]: pgmap v15801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:03 smithi110 ceph-mon[28069]: pgmap v15801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:05 smithi196 ceph-mon[32572]: pgmap v15802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:55:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:05 smithi110 ceph-mon[28069]: pgmap v15802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:55:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:05 smithi193 ceph-mon[32782]: pgmap v15802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:55:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:55:06.207+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T19:55:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:55:06.207+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:55:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:55:06.208+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 226 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:55:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:55:06.208+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 226 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T19:55:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:07 smithi196 ceph-mon[32572]: pgmap v15803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:55:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29222.414706 secs 2024-04-26T19:55:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:55:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:07 smithi110 ceph-mon[28069]: pgmap v15803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:55:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29222.414706 secs 2024-04-26T19:55:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:55:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:07 smithi193 ceph-mon[32782]: pgmap v15803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T19:55:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29222.414706 secs 2024-04-26T19:55:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:55:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:55:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:55:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:55:09.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:55:09.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:55:09.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:55:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:55:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:55:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:55:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:09 smithi196 ceph-mon[32572]: pgmap v15804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:09 smithi196 ceph-mon[32572]: pgmap v15805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:09 smithi110 ceph-mon[28069]: pgmap v15804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:09 smithi110 ceph-mon[28069]: pgmap v15805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:09 smithi193 ceph-mon[32782]: pgmap v15804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:09 smithi193 ceph-mon[32782]: pgmap v15805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:10 smithi193 ceph-mon[32782]: pgmap v15806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:10 smithi196 ceph-mon[32572]: pgmap v15806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:10 smithi110 ceph-mon[28069]: pgmap v15806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T19:55:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29227.414787 secs 2024-04-26T19:55:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:13 smithi196 ceph-mon[32572]: pgmap v15807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T19:55:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29227.414787 secs 2024-04-26T19:55:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:13 smithi110 ceph-mon[28069]: pgmap v15807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T19:55:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29227.414787 secs 2024-04-26T19:55:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:13 smithi193 ceph-mon[32782]: pgmap v15807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T19:55:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:15 smithi196 ceph-mon[32572]: pgmap v15808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:55:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:15 smithi110 ceph-mon[28069]: pgmap v15808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:55:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:15 smithi193 ceph-mon[32782]: pgmap v15808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:55:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:17 smithi196 ceph-mon[32572]: pgmap v15809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:55:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:17 smithi110 ceph-mon[28069]: pgmap v15809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:55:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:17 smithi193 ceph-mon[32782]: pgmap v15809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:55:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29232.414918 secs 2024-04-26T19:55:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29232.414918 secs 2024-04-26T19:55:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29232.414918 secs 2024-04-26T19:55:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:19 smithi196 ceph-mon[32572]: pgmap v15810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:55:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:19 smithi110 ceph-mon[28069]: pgmap v15810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:55:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:19 smithi193 ceph-mon[32782]: pgmap v15810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:55:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:21 smithi196 ceph-mon[32572]: pgmap v15811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:21 smithi110 ceph-mon[28069]: pgmap v15811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:21 smithi193 ceph-mon[32782]: pgmap v15811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29237.415042 secs 2024-04-26T19:55:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:23 smithi196 ceph-mon[32572]: pgmap v15812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29237.415042 secs 2024-04-26T19:55:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:23 smithi110 ceph-mon[28069]: pgmap v15812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29237.415042 secs 2024-04-26T19:55:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:23 smithi193 ceph-mon[32782]: pgmap v15812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:25 smithi196 ceph-mon[32572]: pgmap v15813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:25 smithi110 ceph-mon[28069]: pgmap v15813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:25 smithi193 ceph-mon[32782]: pgmap v15813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:27 smithi196 ceph-mon[32572]: pgmap v15814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:27 smithi110 ceph-mon[28069]: pgmap v15814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:27 smithi193 ceph-mon[32782]: pgmap v15814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29242.415184 secs 2024-04-26T19:55:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29242.415184 secs 2024-04-26T19:55:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29242.415184 secs 2024-04-26T19:55:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:29 smithi196 ceph-mon[32572]: pgmap v15815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:29 smithi110 ceph-mon[28069]: pgmap v15815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:29 smithi193 ceph-mon[32782]: pgmap v15815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:31 smithi110 ceph-mon[28069]: pgmap v15816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:31 smithi193 ceph-mon[32782]: pgmap v15816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:31 smithi196 ceph-mon[32572]: pgmap v15816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29247.415308 secs 2024-04-26T19:55:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:33 smithi110 ceph-mon[28069]: pgmap v15817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29247.415308 secs 2024-04-26T19:55:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:33 smithi193 ceph-mon[32782]: pgmap v15817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29247.415308 secs 2024-04-26T19:55:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:33 smithi196 ceph-mon[32572]: pgmap v15817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:35 smithi110 ceph-mon[28069]: pgmap v15818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:35.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:35 smithi196 ceph-mon[32572]: pgmap v15818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:35 smithi193 ceph-mon[32782]: pgmap v15818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:37 smithi110 ceph-mon[28069]: pgmap v15819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:37 smithi193 ceph-mon[32782]: pgmap v15819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:37 smithi196 ceph-mon[32572]: pgmap v15819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29252.415411 secs 2024-04-26T19:55:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29252.415411 secs 2024-04-26T19:55:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29252.415411 secs 2024-04-26T19:55:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:39 smithi110 ceph-mon[28069]: pgmap v15820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:39 smithi193 ceph-mon[32782]: pgmap v15820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:39 smithi196 ceph-mon[32572]: pgmap v15820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:41 smithi110 ceph-mon[28069]: pgmap v15821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:41 smithi193 ceph-mon[32782]: pgmap v15821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:41 smithi196 ceph-mon[32572]: pgmap v15821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29257.415541 secs 2024-04-26T19:55:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:43 smithi193 ceph-mon[32782]: pgmap v15822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29257.415541 secs 2024-04-26T19:55:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:43 smithi196 ceph-mon[32572]: pgmap v15822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29257.415541 secs 2024-04-26T19:55:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:43 smithi110 ceph-mon[28069]: pgmap v15822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:45 smithi193 ceph-mon[32782]: pgmap v15823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:45 smithi196 ceph-mon[32572]: pgmap v15823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:45 smithi110 ceph-mon[28069]: pgmap v15823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:47 smithi193 ceph-mon[32782]: pgmap v15824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:47 smithi196 ceph-mon[32572]: pgmap v15824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:47 smithi110 ceph-mon[28069]: pgmap v15824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29262.415664 secs 2024-04-26T19:55:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29262.415664 secs 2024-04-26T19:55:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29262.415664 secs 2024-04-26T19:55:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:49 smithi193 ceph-mon[32782]: pgmap v15825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:49 smithi196 ceph-mon[32572]: pgmap v15825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:49 smithi110 ceph-mon[28069]: pgmap v15825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:51 smithi193 ceph-mon[32782]: pgmap v15826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:51 smithi196 ceph-mon[32572]: pgmap v15826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:51 smithi110 ceph-mon[28069]: pgmap v15826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29267.415790 secs 2024-04-26T19:55:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:53 smithi193 ceph-mon[32782]: pgmap v15827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29267.415790 secs 2024-04-26T19:55:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:53 smithi196 ceph-mon[32572]: pgmap v15827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29267.415790 secs 2024-04-26T19:55:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:53 smithi110 ceph-mon[28069]: pgmap v15827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:55 smithi193 ceph-mon[32782]: pgmap v15828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:55 smithi196 ceph-mon[32572]: pgmap v15828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:55 smithi110 ceph-mon[28069]: pgmap v15828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:57 smithi193 ceph-mon[32782]: pgmap v15829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:57 smithi196 ceph-mon[32572]: pgmap v15829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:57 smithi110 ceph-mon[28069]: pgmap v15829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:55:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29272.415919 secs 2024-04-26T19:55:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29272.415919 secs 2024-04-26T19:55:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29272.415919 secs 2024-04-26T19:55:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:55:59 smithi193 ceph-mon[32782]: pgmap v15830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:55:59 smithi196 ceph-mon[32572]: pgmap v15830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:55:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:55:59 smithi110 ceph-mon[28069]: pgmap v15830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:01 smithi193 ceph-mon[32782]: pgmap v15831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:01 smithi196 ceph-mon[32572]: pgmap v15831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:01.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:01 smithi110 ceph-mon[28069]: pgmap v15831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29277.416024 secs 2024-04-26T19:56:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:03 smithi193 ceph-mon[32782]: pgmap v15832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29277.416024 secs 2024-04-26T19:56:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:03 smithi196 ceph-mon[32572]: pgmap v15832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29277.416024 secs 2024-04-26T19:56:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:03 smithi110 ceph-mon[28069]: pgmap v15832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:05 smithi193 ceph-mon[32782]: pgmap v15833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:05 smithi196 ceph-mon[32572]: pgmap v15833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:05 smithi110 ceph-mon[28069]: pgmap v15833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:07 smithi193 ceph-mon[32782]: pgmap v15834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:56:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:07 smithi196 ceph-mon[32572]: pgmap v15834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:56:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:07 smithi110 ceph-mon[28069]: pgmap v15834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T19:56:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29282.416158 secs 2024-04-26T19:56:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29282.416158 secs 2024-04-26T19:56:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29282.416158 secs 2024-04-26T19:56:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:09 smithi196 ceph-mon[32572]: pgmap v15835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:56:09.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:09 smithi193 ceph-mon[32782]: pgmap v15835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:09.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:56:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:09 smithi110 ceph-mon[28069]: pgmap v15835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:56:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:56:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:56:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:56:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:56:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:56:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:56:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:56:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:56:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:56:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:11 smithi196 ceph-mon[32572]: pgmap v15836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 798 B/s rd, 1 op/s 2024-04-26T19:56:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:11 smithi196 ceph-mon[32572]: pgmap v15837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T19:56:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:11 smithi110 ceph-mon[28069]: pgmap v15836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 798 B/s rd, 1 op/s 2024-04-26T19:56:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:11 smithi110 ceph-mon[28069]: pgmap v15837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T19:56:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:11 smithi193 ceph-mon[32782]: pgmap v15836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 798 B/s rd, 1 op/s 2024-04-26T19:56:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:11 smithi193 ceph-mon[32782]: pgmap v15837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T19:56:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:13 smithi196 ceph-mon[32572]: pgmap v15838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T19:56:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29287.416280 secs 2024-04-26T19:56:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:13 smithi110 ceph-mon[28069]: pgmap v15838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T19:56:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29287.416280 secs 2024-04-26T19:56:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:13 smithi193 ceph-mon[32782]: pgmap v15838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T19:56:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29287.416280 secs 2024-04-26T19:56:15.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:15 smithi196 ceph-mon[32572]: pgmap v15839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:56:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:15 smithi110 ceph-mon[28069]: pgmap v15839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:56:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:15 smithi193 ceph-mon[32782]: pgmap v15839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:56:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:17 smithi196 ceph-mon[32572]: pgmap v15840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:56:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:17 smithi110 ceph-mon[28069]: pgmap v15840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:56:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:17 smithi193 ceph-mon[32782]: pgmap v15840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:56:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:18 smithi196 ceph-mon[32572]: 23 slow requests, 1 included below; oldest blocked for > 29292.416415 secs 2024-04-26T19:56:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:18 smithi196 ceph-mon[32572]: slow request 722.588326 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:56:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:18 smithi110 ceph-mon[28069]: 23 slow requests, 1 included below; oldest blocked for > 29292.416415 secs 2024-04-26T19:56:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:18 smithi110 ceph-mon[28069]: slow request 722.588326 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:56:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:18 smithi193 ceph-mon[32782]: 23 slow requests, 1 included below; oldest blocked for > 29292.416415 secs 2024-04-26T19:56:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:18 smithi193 ceph-mon[32782]: slow request 722.588326 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:56:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:19 smithi196 ceph-mon[32572]: pgmap v15841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:56:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:19 smithi110 ceph-mon[28069]: pgmap v15841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:56:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:19 smithi193 ceph-mon[32782]: pgmap v15841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:56:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:21 smithi196 ceph-mon[32572]: pgmap v15842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:56:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:21 smithi110 ceph-mon[28069]: pgmap v15842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:56:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:21 smithi193 ceph-mon[32782]: pgmap v15842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:56:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:23 smithi196 ceph-mon[32572]: pgmap v15843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29297.416541 secs 2024-04-26T19:56:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:23 smithi110 ceph-mon[28069]: pgmap v15843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29297.416541 secs 2024-04-26T19:56:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:23 smithi193 ceph-mon[32782]: pgmap v15843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29297.416541 secs 2024-04-26T19:56:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:25 smithi196 ceph-mon[32572]: pgmap v15844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:25 smithi110 ceph-mon[28069]: pgmap v15844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:25 smithi193 ceph-mon[32782]: pgmap v15844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:27 smithi196 ceph-mon[32572]: pgmap v15845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:27 smithi110 ceph-mon[28069]: pgmap v15845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:27 smithi193 ceph-mon[32782]: pgmap v15845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29302.416669 secs 2024-04-26T19:56:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29302.416669 secs 2024-04-26T19:56:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29302.416669 secs 2024-04-26T19:56:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:29 smithi196 ceph-mon[32572]: pgmap v15846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:29 smithi110 ceph-mon[28069]: pgmap v15846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:29 smithi193 ceph-mon[32782]: pgmap v15846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:31 smithi196 ceph-mon[32572]: pgmap v15847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:31 smithi110 ceph-mon[28069]: pgmap v15847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:31 smithi193 ceph-mon[32782]: pgmap v15847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29307.416794 secs 2024-04-26T19:56:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:33 smithi196 ceph-mon[32572]: pgmap v15848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29307.416794 secs 2024-04-26T19:56:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:33 smithi110 ceph-mon[28069]: pgmap v15848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29307.416794 secs 2024-04-26T19:56:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:33 smithi193 ceph-mon[32782]: pgmap v15848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:35 smithi196 ceph-mon[32572]: pgmap v15849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:35 smithi110 ceph-mon[28069]: pgmap v15849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:35 smithi193 ceph-mon[32782]: pgmap v15849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:37 smithi196 ceph-mon[32572]: pgmap v15850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:37 smithi110 ceph-mon[28069]: pgmap v15850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:37 smithi193 ceph-mon[32782]: pgmap v15850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29312.416917 secs 2024-04-26T19:56:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29312.416917 secs 2024-04-26T19:56:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29312.416917 secs 2024-04-26T19:56:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:39 smithi196 ceph-mon[32572]: pgmap v15851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:39.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:39 smithi193 ceph-mon[32782]: pgmap v15851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:39 smithi110 ceph-mon[28069]: pgmap v15851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:41 smithi110 ceph-mon[28069]: pgmap v15852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:41 smithi193 ceph-mon[32782]: pgmap v15852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:41 smithi196 ceph-mon[32572]: pgmap v15852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29317.417040 secs 2024-04-26T19:56:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:43 smithi110 ceph-mon[28069]: pgmap v15853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29317.417040 secs 2024-04-26T19:56:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:43 smithi193 ceph-mon[32782]: pgmap v15853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29317.417040 secs 2024-04-26T19:56:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:43 smithi196 ceph-mon[32572]: pgmap v15853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:45 smithi110 ceph-mon[28069]: pgmap v15854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:45 smithi193 ceph-mon[32782]: pgmap v15854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:45 smithi196 ceph-mon[32572]: pgmap v15854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:47 smithi110 ceph-mon[28069]: pgmap v15855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:47 smithi193 ceph-mon[32782]: pgmap v15855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:47 smithi196 ceph-mon[32572]: pgmap v15855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29322.417164 secs 2024-04-26T19:56:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29322.417164 secs 2024-04-26T19:56:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29322.417164 secs 2024-04-26T19:56:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:49 smithi110 ceph-mon[28069]: pgmap v15856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:49 smithi193 ceph-mon[32782]: pgmap v15856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:49 smithi196 ceph-mon[32572]: pgmap v15856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:51 smithi110 ceph-mon[28069]: pgmap v15857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:51 smithi193 ceph-mon[32782]: pgmap v15857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:51 smithi196 ceph-mon[32572]: pgmap v15857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29327.417225 secs 2024-04-26T19:56:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:53 smithi193 ceph-mon[32782]: pgmap v15858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29327.417225 secs 2024-04-26T19:56:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:53 smithi196 ceph-mon[32572]: pgmap v15858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29327.417225 secs 2024-04-26T19:56:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:53 smithi110 ceph-mon[28069]: pgmap v15858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:55 smithi193 ceph-mon[32782]: pgmap v15859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:55 smithi196 ceph-mon[32572]: pgmap v15859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:55 smithi110 ceph-mon[28069]: pgmap v15859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:56:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:57 smithi193 ceph-mon[32782]: pgmap v15860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:57 smithi196 ceph-mon[32572]: pgmap v15860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:57 smithi110 ceph-mon[28069]: pgmap v15860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:56:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29332.417369 secs 2024-04-26T19:56:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29332.417369 secs 2024-04-26T19:56:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29332.417369 secs 2024-04-26T19:56:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:56:59 smithi193 ceph-mon[32782]: pgmap v15861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:56:59 smithi196 ceph-mon[32572]: pgmap v15861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:56:59 smithi110 ceph-mon[28069]: pgmap v15861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:01 smithi193 ceph-mon[32782]: pgmap v15862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:01 smithi196 ceph-mon[32572]: pgmap v15862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:01 smithi110 ceph-mon[28069]: pgmap v15862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29337.417513 secs 2024-04-26T19:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:03 smithi193 ceph-mon[32782]: pgmap v15863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29337.417513 secs 2024-04-26T19:57:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:03 smithi196 ceph-mon[32572]: pgmap v15863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29337.417513 secs 2024-04-26T19:57:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:03 smithi110 ceph-mon[28069]: pgmap v15863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:05 smithi193 ceph-mon[32782]: pgmap v15864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:05 smithi196 ceph-mon[32572]: pgmap v15864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:05 smithi110 ceph-mon[28069]: pgmap v15864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:07 smithi193 ceph-mon[32782]: pgmap v15865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:07 smithi196 ceph-mon[32572]: pgmap v15865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:07 smithi110 ceph-mon[28069]: pgmap v15865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29342.417661 secs 2024-04-26T19:57:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29342.417661 secs 2024-04-26T19:57:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29342.417661 secs 2024-04-26T19:57:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:09 smithi193 ceph-mon[32782]: pgmap v15866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:09 smithi196 ceph-mon[32572]: pgmap v15866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:09 smithi110 ceph-mon[28069]: pgmap v15866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:57:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:57:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:11 smithi193 ceph-mon[32782]: pgmap v15867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:57:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:57:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:57:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:11 smithi196 ceph-mon[32572]: pgmap v15867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:57:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:57:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:57:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:11 smithi110 ceph-mon[28069]: pgmap v15867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:57:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:57:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:57:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:12 smithi196 ceph-mon[32572]: pgmap v15868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T19:57:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:12 smithi196 ceph-mon[32572]: pgmap v15869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29347.417788 secs 2024-04-26T19:57:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:12 smithi110 ceph-mon[28069]: pgmap v15868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T19:57:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:12 smithi110 ceph-mon[28069]: pgmap v15869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29347.417788 secs 2024-04-26T19:57:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:12 smithi193 ceph-mon[32782]: pgmap v15868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T19:57:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:12 smithi193 ceph-mon[32782]: pgmap v15869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29347.417788 secs 2024-04-26T19:57:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:14 smithi196 ceph-mon[32572]: pgmap v15870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:14 smithi110 ceph-mon[28069]: pgmap v15870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:14 smithi193 ceph-mon[32782]: pgmap v15870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:16 smithi196 ceph-mon[32572]: pgmap v15871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:16 smithi110 ceph-mon[28069]: pgmap v15871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:16 smithi193 ceph-mon[32782]: pgmap v15871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:17 smithi196 ceph-mon[32572]: 23 slow requests, 1 included below; oldest blocked for > 29352.417912 secs 2024-04-26T19:57:18.051 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:17 smithi196 ceph-mon[32572]: slow request 2883.679526 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:57:18.052 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:17 smithi110 ceph-mon[28069]: 23 slow requests, 1 included below; oldest blocked for > 29352.417912 secs 2024-04-26T19:57:18.052 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:17 smithi110 ceph-mon[28069]: slow request 2883.679526 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:57:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:17 smithi193 ceph-mon[32782]: 23 slow requests, 1 included below; oldest blocked for > 29352.417912 secs 2024-04-26T19:57:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:17 smithi193 ceph-mon[32782]: slow request 2883.679526 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:57:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:18 smithi196 ceph-mon[32572]: pgmap v15872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:57:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:18 smithi110 ceph-mon[28069]: pgmap v15872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:57:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:18 smithi193 ceph-mon[32782]: pgmap v15872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T19:57:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:20 smithi196 ceph-mon[32572]: pgmap v15873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:20 smithi110 ceph-mon[28069]: pgmap v15873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:20 smithi193 ceph-mon[32782]: pgmap v15873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:57:21.230 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:57:21.230+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T19:57:21.230 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:57:21.230+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T19:57:21.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:57:21.231+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 227 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T19:57:21.231 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T19:57:21.231+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 227 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T19:57:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:21 smithi196 ceph-mon[32572]: pgmap v15874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:57:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:21 smithi110 ceph-mon[28069]: pgmap v15874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:57:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:21 smithi193 ceph-mon[32782]: pgmap v15874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:57:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29357.418044 secs 2024-04-26T19:57:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29357.418044 secs 2024-04-26T19:57:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29357.418044 secs 2024-04-26T19:57:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:23 smithi196 ceph-mon[32572]: pgmap v15875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:23 smithi110 ceph-mon[28069]: pgmap v15875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:23 smithi193 ceph-mon[32782]: pgmap v15875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:26 smithi193 ceph-mon[32782]: pgmap v15876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:26 smithi196 ceph-mon[32572]: pgmap v15876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:26 smithi110 ceph-mon[28069]: pgmap v15876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29362.418171 secs 2024-04-26T19:57:28.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:28 smithi193 ceph-mon[32782]: pgmap v15877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29362.418171 secs 2024-04-26T19:57:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:28 smithi196 ceph-mon[32572]: pgmap v15877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29362.418171 secs 2024-04-26T19:57:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:28 smithi110 ceph-mon[28069]: pgmap v15877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:30 smithi193 ceph-mon[32782]: pgmap v15878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:30 smithi196 ceph-mon[32572]: pgmap v15878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:30 smithi110 ceph-mon[28069]: pgmap v15878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:32 smithi193 ceph-mon[32782]: pgmap v15879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:32 smithi196 ceph-mon[32572]: pgmap v15879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:32 smithi110 ceph-mon[28069]: pgmap v15879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29367.418279 secs 2024-04-26T19:57:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29367.418279 secs 2024-04-26T19:57:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29367.418279 secs 2024-04-26T19:57:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:34 smithi193 ceph-mon[32782]: pgmap v15880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:34 smithi196 ceph-mon[32572]: pgmap v15880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:34 smithi110 ceph-mon[28069]: pgmap v15880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:36 smithi196 ceph-mon[32572]: pgmap v15881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:36 smithi110 ceph-mon[28069]: pgmap v15881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:36 smithi193 ceph-mon[32782]: pgmap v15881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29372.418412 secs 2024-04-26T19:57:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:38 smithi196 ceph-mon[32572]: pgmap v15882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29372.418412 secs 2024-04-26T19:57:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:38 smithi110 ceph-mon[28069]: pgmap v15882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29372.418412 secs 2024-04-26T19:57:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:38 smithi193 ceph-mon[32782]: pgmap v15882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:40.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:40 smithi193 ceph-mon[32782]: pgmap v15883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:40 smithi196 ceph-mon[32572]: pgmap v15883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:40 smithi110 ceph-mon[28069]: pgmap v15883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:42 smithi196 ceph-mon[32572]: pgmap v15884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:42 smithi110 ceph-mon[28069]: pgmap v15884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:42 smithi193 ceph-mon[32782]: pgmap v15884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:43.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29377.418538 secs 2024-04-26T19:57:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29377.418538 secs 2024-04-26T19:57:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29377.418538 secs 2024-04-26T19:57:44.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:44 smithi110 ceph-mon[28069]: pgmap v15885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:44 smithi196 ceph-mon[32572]: pgmap v15885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:44 smithi193 ceph-mon[32782]: pgmap v15885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:46 smithi196 ceph-mon[32572]: pgmap v15886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:46 smithi110 ceph-mon[28069]: pgmap v15886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:46 smithi193 ceph-mon[32782]: pgmap v15886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29382.418620 secs 2024-04-26T19:57:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:48 smithi196 ceph-mon[32572]: pgmap v15887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29382.418620 secs 2024-04-26T19:57:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:48 smithi110 ceph-mon[28069]: pgmap v15887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29382.418620 secs 2024-04-26T19:57:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:48 smithi193 ceph-mon[32782]: pgmap v15887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:50 smithi196 ceph-mon[32572]: pgmap v15888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:50 smithi110 ceph-mon[28069]: pgmap v15888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:50 smithi193 ceph-mon[32782]: pgmap v15888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:52 smithi196 ceph-mon[32572]: pgmap v15889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:52 smithi110 ceph-mon[28069]: pgmap v15889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:52 smithi193 ceph-mon[32782]: pgmap v15889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29387.418745 secs 2024-04-26T19:57:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29387.418745 secs 2024-04-26T19:57:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29387.418745 secs 2024-04-26T19:57:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:54 smithi196 ceph-mon[32572]: pgmap v15890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:54 smithi110 ceph-mon[28069]: pgmap v15890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:54 smithi193 ceph-mon[32782]: pgmap v15890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:56 smithi196 ceph-mon[32572]: pgmap v15891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:56 smithi110 ceph-mon[28069]: pgmap v15891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:56 smithi193 ceph-mon[32782]: pgmap v15891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29392.418872 secs 2024-04-26T19:57:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:57:58 smithi196 ceph-mon[32572]: pgmap v15892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29392.418872 secs 2024-04-26T19:57:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:57:58 smithi110 ceph-mon[28069]: pgmap v15892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:57:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29392.418872 secs 2024-04-26T19:57:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:57:58 smithi193 ceph-mon[32782]: pgmap v15892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:00 smithi196 ceph-mon[32572]: pgmap v15893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:00 smithi110 ceph-mon[28069]: pgmap v15893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:00 smithi193 ceph-mon[32782]: pgmap v15893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:02 smithi196 ceph-mon[32572]: pgmap v15894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:02 smithi110 ceph-mon[28069]: pgmap v15894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:02 smithi193 ceph-mon[32782]: pgmap v15894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29397.418996 secs 2024-04-26T19:58:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29397.418996 secs 2024-04-26T19:58:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29397.418996 secs 2024-04-26T19:58:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:04 smithi196 ceph-mon[32572]: pgmap v15895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:04 smithi110 ceph-mon[28069]: pgmap v15895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:04 smithi193 ceph-mon[32782]: pgmap v15895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:06 smithi196 ceph-mon[32572]: pgmap v15896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:06 smithi110 ceph-mon[28069]: pgmap v15896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:06 smithi193 ceph-mon[32782]: pgmap v15896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29402.419118 secs 2024-04-26T19:58:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:08 smithi196 ceph-mon[32572]: pgmap v15897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29402.419118 secs 2024-04-26T19:58:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:08 smithi110 ceph-mon[28069]: pgmap v15897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29402.419118 secs 2024-04-26T19:58:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:08 smithi193 ceph-mon[32782]: pgmap v15897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:10 smithi196 ceph-mon[32572]: pgmap v15898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:10 smithi110 ceph-mon[28069]: pgmap v15898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:10 smithi193 ceph-mon[32782]: pgmap v15898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:12 smithi196 ceph-mon[32572]: pgmap v15899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:58:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:12 smithi110 ceph-mon[28069]: pgmap v15899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:58:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:12 smithi193 ceph-mon[32782]: pgmap v15899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:58:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29407.419215 secs 2024-04-26T19:58:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29407.419215 secs 2024-04-26T19:58:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29407.419215 secs 2024-04-26T19:58:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:14 smithi196 ceph-mon[32572]: pgmap v15900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:14 smithi110 ceph-mon[28069]: pgmap v15900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:14 smithi193 ceph-mon[32782]: pgmap v15900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:16 smithi193 ceph-mon[32782]: pgmap v15901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:58:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:58:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:16 smithi110 ceph-mon[28069]: pgmap v15901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:58:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:58:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:16 smithi196 ceph-mon[32572]: pgmap v15901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:58:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:58:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:58:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:17 smithi110 ceph-mon[28069]: pgmap v15902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 962 B/s rd, 1 op/s 2024-04-26T19:58:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:17 smithi110 ceph-mon[28069]: pgmap v15903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:17 smithi193 ceph-mon[32782]: pgmap v15902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 962 B/s rd, 1 op/s 2024-04-26T19:58:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:17 smithi193 ceph-mon[32782]: pgmap v15903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:17 smithi196 ceph-mon[32572]: pgmap v15902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 962 B/s rd, 1 op/s 2024-04-26T19:58:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:17 smithi196 ceph-mon[32572]: pgmap v15903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29412.419335 secs 2024-04-26T19:58:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29412.419335 secs 2024-04-26T19:58:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29412.419335 secs 2024-04-26T19:58:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:19 smithi110 ceph-mon[28069]: pgmap v15904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:19 smithi193 ceph-mon[32782]: pgmap v15904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:19 smithi196 ceph-mon[32572]: pgmap v15904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:21 smithi110 ceph-mon[28069]: pgmap v15905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:21 smithi193 ceph-mon[32782]: pgmap v15905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:21 smithi196 ceph-mon[32572]: pgmap v15905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29417.419467 secs 2024-04-26T19:58:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:23 smithi110 ceph-mon[28069]: pgmap v15906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 592 B/s rd, 1 op/s 2024-04-26T19:58:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29417.419467 secs 2024-04-26T19:58:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:23 smithi193 ceph-mon[32782]: pgmap v15906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 592 B/s rd, 1 op/s 2024-04-26T19:58:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29417.419467 secs 2024-04-26T19:58:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:23 smithi196 ceph-mon[32572]: pgmap v15906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 592 B/s rd, 1 op/s 2024-04-26T19:58:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:25 smithi110 ceph-mon[28069]: pgmap v15907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:25.869 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:25 smithi193 ceph-mon[32782]: pgmap v15907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:25 smithi196 ceph-mon[32572]: pgmap v15907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:27 smithi193 ceph-mon[32782]: pgmap v15908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:58:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:27 smithi196 ceph-mon[32572]: pgmap v15908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:58:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:27 smithi110 ceph-mon[28069]: pgmap v15908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:58:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29422.419610 secs 2024-04-26T19:58:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29422.419610 secs 2024-04-26T19:58:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29422.419610 secs 2024-04-26T19:58:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:29 smithi193 ceph-mon[32782]: pgmap v15909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:29 smithi196 ceph-mon[32572]: pgmap v15909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:29 smithi110 ceph-mon[28069]: pgmap v15909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:31 smithi193 ceph-mon[32782]: pgmap v15910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:31 smithi196 ceph-mon[32572]: pgmap v15910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:31 smithi110 ceph-mon[28069]: pgmap v15910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29427.419733 secs 2024-04-26T19:58:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:33 smithi193 ceph-mon[32782]: pgmap v15911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29427.419733 secs 2024-04-26T19:58:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:33 smithi196 ceph-mon[32572]: pgmap v15911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29427.419733 secs 2024-04-26T19:58:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:33 smithi110 ceph-mon[28069]: pgmap v15911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:35 smithi193 ceph-mon[32782]: pgmap v15912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:35 smithi196 ceph-mon[32572]: pgmap v15912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:35 smithi110 ceph-mon[28069]: pgmap v15912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:37 smithi193 ceph-mon[32782]: pgmap v15913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:37 smithi196 ceph-mon[32572]: pgmap v15913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:37 smithi110 ceph-mon[28069]: pgmap v15913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29432.419834 secs 2024-04-26T19:58:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29432.419834 secs 2024-04-26T19:58:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29432.419834 secs 2024-04-26T19:58:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:39 smithi193 ceph-mon[32782]: pgmap v15914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:39 smithi196 ceph-mon[32572]: pgmap v15914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:39 smithi110 ceph-mon[28069]: pgmap v15914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:41 smithi193 ceph-mon[32782]: pgmap v15915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:41 smithi196 ceph-mon[32572]: pgmap v15915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:41 smithi110 ceph-mon[28069]: pgmap v15915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29437.419961 secs 2024-04-26T19:58:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:43 smithi193 ceph-mon[32782]: pgmap v15916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29437.419961 secs 2024-04-26T19:58:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:43 smithi196 ceph-mon[32572]: pgmap v15916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29437.419961 secs 2024-04-26T19:58:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:43 smithi110 ceph-mon[28069]: pgmap v15916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:45 smithi193 ceph-mon[32782]: pgmap v15917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:45 smithi196 ceph-mon[32572]: pgmap v15917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:45 smithi110 ceph-mon[28069]: pgmap v15917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:47 smithi193 ceph-mon[32782]: pgmap v15918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:47 smithi196 ceph-mon[32572]: pgmap v15918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:47 smithi110 ceph-mon[28069]: pgmap v15918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29442.420102 secs 2024-04-26T19:58:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29442.420102 secs 2024-04-26T19:58:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29442.420102 secs 2024-04-26T19:58:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:49 smithi193 ceph-mon[32782]: pgmap v15919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:49 smithi196 ceph-mon[32572]: pgmap v15919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:49 smithi110 ceph-mon[28069]: pgmap v15919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:51 smithi196 ceph-mon[32572]: pgmap v15920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:51 smithi110 ceph-mon[28069]: pgmap v15920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:51 smithi193 ceph-mon[32782]: pgmap v15920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29447.420245 secs 2024-04-26T19:58:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29447.420245 secs 2024-04-26T19:58:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29447.420245 secs 2024-04-26T19:58:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:53 smithi196 ceph-mon[32572]: pgmap v15921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:53 smithi110 ceph-mon[28069]: pgmap v15921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:53 smithi193 ceph-mon[32782]: pgmap v15921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:55 smithi196 ceph-mon[32572]: pgmap v15922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:55 smithi110 ceph-mon[28069]: pgmap v15922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:55 smithi193 ceph-mon[32782]: pgmap v15922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:57 smithi196 ceph-mon[32572]: pgmap v15923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29452.420400 secs 2024-04-26T19:58:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:57 smithi110 ceph-mon[28069]: pgmap v15923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29452.420400 secs 2024-04-26T19:58:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:57 smithi193 ceph-mon[32782]: pgmap v15923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:58:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29452.420400 secs 2024-04-26T19:59:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:58:59 smithi196 ceph-mon[32572]: pgmap v15924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:58:59 smithi110 ceph-mon[28069]: pgmap v15924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:58:59 smithi193 ceph-mon[32782]: pgmap v15924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:01 smithi196 ceph-mon[32572]: pgmap v15925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:01 smithi110 ceph-mon[28069]: pgmap v15925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:01 smithi193 ceph-mon[32782]: pgmap v15925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29457.420466 secs 2024-04-26T19:59:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29457.420466 secs 2024-04-26T19:59:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29457.420466 secs 2024-04-26T19:59:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:03 smithi196 ceph-mon[32572]: pgmap v15926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:03 smithi110 ceph-mon[28069]: pgmap v15926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:03 smithi193 ceph-mon[32782]: pgmap v15926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:05 smithi196 ceph-mon[32572]: pgmap v15927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:05 smithi110 ceph-mon[28069]: pgmap v15927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:05 smithi193 ceph-mon[32782]: pgmap v15927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:06 smithi196 ceph-mon[32572]: pgmap v15928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:06 smithi110 ceph-mon[28069]: pgmap v15928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:06 smithi193 ceph-mon[32782]: pgmap v15928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29462.420595 secs 2024-04-26T19:59:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29462.420595 secs 2024-04-26T19:59:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29462.420595 secs 2024-04-26T19:59:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:08 smithi196 ceph-mon[32572]: pgmap v15929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:08 smithi110 ceph-mon[28069]: pgmap v15929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:08 smithi193 ceph-mon[32782]: pgmap v15929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:11 smithi110 ceph-mon[28069]: pgmap v15930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:11 smithi193 ceph-mon[32782]: pgmap v15930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:11 smithi196 ceph-mon[32572]: pgmap v15930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29467.420718 secs 2024-04-26T19:59:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:13 smithi110 ceph-mon[28069]: pgmap v15931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29467.420718 secs 2024-04-26T19:59:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:13 smithi193 ceph-mon[32782]: pgmap v15931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29467.420718 secs 2024-04-26T19:59:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:13 smithi196 ceph-mon[32572]: pgmap v15931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:14.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:59:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:59:14.480+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:14.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:59:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:59:14.480+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:14.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:59:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:59:14.480+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:14.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:59:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:59:14.480+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:14.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 19:59:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T19:59:14.480+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:15 smithi110 ceph-mon[28069]: pgmap v15932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:15 smithi193 ceph-mon[32782]: pgmap v15932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:15 smithi196 ceph-mon[32572]: pgmap v15932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:17 smithi193 ceph-mon[32782]: pgmap v15933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:59:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:17 smithi196 ceph-mon[32572]: pgmap v15933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:59:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:17 smithi110 ceph-mon[28069]: pgmap v15933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:59:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29472.420786 secs 2024-04-26T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:18 smithi193 ceph-mon[32782]: pgmap v15934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:18 smithi193 ceph-mon[32782]: pgmap v15935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29472.420786 secs 2024-04-26T19:59:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:59:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:59:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:18 smithi196 ceph-mon[32572]: pgmap v15934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:59:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:18 smithi196 ceph-mon[32572]: pgmap v15935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29472.420786 secs 2024-04-26T19:59:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:59:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:59:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:18 smithi110 ceph-mon[28069]: pgmap v15934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T19:59:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:18 smithi110 ceph-mon[28069]: pgmap v15935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T19:59:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:20 smithi193 ceph-mon[32782]: pgmap v15936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:20 smithi196 ceph-mon[32572]: pgmap v15936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:20 smithi110 ceph-mon[28069]: pgmap v15936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:22 smithi196 ceph-mon[32572]: pgmap v15937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:22 smithi110 ceph-mon[28069]: pgmap v15937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:22 smithi193 ceph-mon[32782]: pgmap v15937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29477.420912 secs 2024-04-26T19:59:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29477.420912 secs 2024-04-26T19:59:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29477.420912 secs 2024-04-26T19:59:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:24 smithi196 ceph-mon[32572]: pgmap v15938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:24 smithi110 ceph-mon[28069]: pgmap v15938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:24 smithi193 ceph-mon[32782]: pgmap v15938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:26 smithi196 ceph-mon[32572]: pgmap v15939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:26 smithi110 ceph-mon[28069]: pgmap v15939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:26 smithi193 ceph-mon[32782]: pgmap v15939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:59:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29482.421029 secs 2024-04-26T19:59:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29482.421029 secs 2024-04-26T19:59:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29482.421029 secs 2024-04-26T19:59:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:28 smithi196 ceph-mon[32572]: pgmap v15940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:59:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:28 smithi110 ceph-mon[28069]: pgmap v15940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:59:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:28 smithi193 ceph-mon[32782]: pgmap v15940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T19:59:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:30 smithi196 ceph-mon[32572]: pgmap v15941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:30 smithi110 ceph-mon[28069]: pgmap v15941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:30 smithi193 ceph-mon[32782]: pgmap v15941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:32 smithi196 ceph-mon[32572]: pgmap v15942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29487.421151 secs 2024-04-26T19:59:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:32 smithi110 ceph-mon[28069]: pgmap v15942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29487.421151 secs 2024-04-26T19:59:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:32 smithi193 ceph-mon[32782]: pgmap v15942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29487.421151 secs 2024-04-26T19:59:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:34 smithi196 ceph-mon[32572]: pgmap v15943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:34 smithi110 ceph-mon[28069]: pgmap v15943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:34 smithi193 ceph-mon[32782]: pgmap v15943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:36 smithi196 ceph-mon[32572]: pgmap v15944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:36 smithi110 ceph-mon[28069]: pgmap v15944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:36 smithi193 ceph-mon[32782]: pgmap v15944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29492.421259 secs 2024-04-26T19:59:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29492.421259 secs 2024-04-26T19:59:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29492.421259 secs 2024-04-26T19:59:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:38 smithi196 ceph-mon[32572]: pgmap v15945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:38 smithi110 ceph-mon[28069]: pgmap v15945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:38 smithi193 ceph-mon[32782]: pgmap v15945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:39 smithi196 ceph-mon[32572]: pgmap v15946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:39 smithi110 ceph-mon[28069]: pgmap v15946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:39 smithi193 ceph-mon[32782]: pgmap v15946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:42 smithi196 ceph-mon[32572]: pgmap v15947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:42 smithi110 ceph-mon[28069]: pgmap v15947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:42 smithi193 ceph-mon[32782]: pgmap v15947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29497.421392 secs 2024-04-26T19:59:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29497.421392 secs 2024-04-26T19:59:44.093 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29497.421392 secs 2024-04-26T19:59:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:44 smithi196 ceph-mon[32572]: pgmap v15948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:45.017 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:44 smithi193 ceph-mon[32782]: pgmap v15948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:44 smithi110 ceph-mon[28069]: pgmap v15948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:46 smithi196 ceph-mon[32572]: pgmap v15949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:46 smithi110 ceph-mon[28069]: pgmap v15949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:46 smithi193 ceph-mon[32782]: pgmap v15949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29502.421528 secs 2024-04-26T19:59:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29502.421528 secs 2024-04-26T19:59:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29502.421528 secs 2024-04-26T19:59:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:48 smithi196 ceph-mon[32572]: pgmap v15950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:48 smithi110 ceph-mon[28069]: pgmap v15950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:48 smithi193 ceph-mon[32782]: pgmap v15950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:50 smithi196 ceph-mon[32572]: pgmap v15951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:50 smithi110 ceph-mon[28069]: pgmap v15951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:50 smithi193 ceph-mon[32782]: pgmap v15951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:52 smithi196 ceph-mon[32572]: pgmap v15952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29507.421646 secs 2024-04-26T19:59:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:52 smithi110 ceph-mon[28069]: pgmap v15952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29507.421646 secs 2024-04-26T19:59:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:52 smithi193 ceph-mon[32782]: pgmap v15952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29507.421646 secs 2024-04-26T19:59:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:54 smithi193 ceph-mon[32782]: pgmap v15953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:54 smithi196 ceph-mon[32572]: pgmap v15953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:54 smithi110 ceph-mon[28069]: pgmap v15953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:56 smithi196 ceph-mon[32572]: pgmap v15954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:56 smithi110 ceph-mon[28069]: pgmap v15954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:56 smithi193 ceph-mon[32782]: pgmap v15954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T19:59:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29512.421752 secs 2024-04-26T19:59:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29512.421752 secs 2024-04-26T19:59:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29512.421752 secs 2024-04-26T19:59:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:58 smithi196 ceph-mon[32572]: pgmap v15955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:58 smithi110 ceph-mon[28069]: pgmap v15955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:59:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:58 smithi193 ceph-mon[32782]: pgmap v15955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 19:59:59 smithi196 ceph-mon[32572]: pgmap v15956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 19:59:59 smithi110 ceph-mon[28069]: pgmap v15956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 19:59:59 smithi193 ceph-mon[32782]: pgmap v15956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:00:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:00:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:00:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:01 smithi196 ceph-mon[32572]: pgmap v15957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:01 smithi110 ceph-mon[28069]: pgmap v15957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:01 smithi193 ceph-mon[32782]: pgmap v15957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29517.421821 secs 2024-04-26T20:00:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29517.421821 secs 2024-04-26T20:00:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29517.421821 secs 2024-04-26T20:00:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:03 smithi196 ceph-mon[32572]: pgmap v15958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:03 smithi110 ceph-mon[28069]: pgmap v15958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:03 smithi193 ceph-mon[32782]: pgmap v15958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:06 smithi196 ceph-mon[32572]: pgmap v15959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:06 smithi110 ceph-mon[28069]: pgmap v15959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:06 smithi193 ceph-mon[32782]: pgmap v15959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:07.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29522.421942 secs 2024-04-26T20:00:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29522.421942 secs 2024-04-26T20:00:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29522.421942 secs 2024-04-26T20:00:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:08 smithi196 ceph-mon[32572]: pgmap v15960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:08 smithi110 ceph-mon[28069]: pgmap v15960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:08 smithi193 ceph-mon[32782]: pgmap v15960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:10 smithi196 ceph-mon[32572]: pgmap v15961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:10 smithi110 ceph-mon[28069]: pgmap v15961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:10 smithi193 ceph-mon[32782]: pgmap v15961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:12.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:12 smithi193 ceph-mon[32782]: pgmap v15962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:12.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29527.422053 secs 2024-04-26T20:00:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:12 smithi196 ceph-mon[32572]: pgmap v15962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29527.422053 secs 2024-04-26T20:00:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:12 smithi110 ceph-mon[28069]: pgmap v15962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29527.422053 secs 2024-04-26T20:00:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:14 smithi196 ceph-mon[32572]: pgmap v15963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:14 smithi110 ceph-mon[28069]: pgmap v15963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:14 smithi193 ceph-mon[32782]: pgmap v15963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:16 smithi196 ceph-mon[32572]: pgmap v15964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:16 smithi110 ceph-mon[28069]: pgmap v15964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:16 smithi193 ceph-mon[32782]: pgmap v15964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29532.422146 secs 2024-04-26T20:00:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29532.422146 secs 2024-04-26T20:00:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29532.422146 secs 2024-04-26T20:00:18.922 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:18 smithi196 ceph-mon[32572]: pgmap v15965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:18.922 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:00:19.026 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:18 smithi193 ceph-mon[32782]: pgmap v15965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:19.026 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:00:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:18 smithi110 ceph-mon[28069]: pgmap v15965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:00:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:20 smithi196 ceph-mon[32572]: pgmap v15966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:20 smithi110 ceph-mon[28069]: pgmap v15966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:20 smithi193 ceph-mon[32782]: pgmap v15966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:21.260 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:00:21.260+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T20:00:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:00:21.260+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:00:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:00:21.261+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 228 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:00:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:00:21.261+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 228 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T20:00:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:22.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:22 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:00:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:22 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:00:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:22 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:00:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:22 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:00:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:22 smithi196 ceph-mon[32572]: pgmap v15967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29537.422287 secs 2024-04-26T20:00:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:23.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:22 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:00:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:22 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:00:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:22 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:00:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:22 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:00:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:22 smithi110 ceph-mon[28069]: pgmap v15967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29537.422287 secs 2024-04-26T20:00:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:22 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:00:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:22 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:00:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:22 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:00:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:22 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:00:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:22 smithi193 ceph-mon[32782]: pgmap v15967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29537.422287 secs 2024-04-26T20:00:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:23 smithi196 ceph-mon[32572]: pgmap v15968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:24.024 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:23 smithi110 ceph-mon[28069]: pgmap v15968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:23 smithi193 ceph-mon[32782]: pgmap v15968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:26 smithi110 ceph-mon[28069]: pgmap v15969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:26 smithi196 ceph-mon[32572]: pgmap v15969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:26 smithi193 ceph-mon[32782]: pgmap v15969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29542.422443 secs 2024-04-26T20:00:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29542.422443 secs 2024-04-26T20:00:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29542.422443 secs 2024-04-26T20:00:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: pgmap v15970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:00:29.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:00:29.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: pgmap v15970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:00:29.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: pgmap v15970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:00:29.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:00:29.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:00:29.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:00:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:29 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:00:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:29 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:00:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:29 smithi196 ceph-mon[32572]: pgmap v15971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 943 B/s rd, 1 op/s 2024-04-26T20:00:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:29 smithi196 ceph-mon[32572]: pgmap v15972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:29 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:00:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:29 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:00:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:29 smithi110 ceph-mon[28069]: pgmap v15971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 943 B/s rd, 1 op/s 2024-04-26T20:00:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:29 smithi110 ceph-mon[28069]: pgmap v15972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:29 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:00:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:29 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:00:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:29 smithi193 ceph-mon[32782]: pgmap v15971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 943 B/s rd, 1 op/s 2024-04-26T20:00:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:29 smithi193 ceph-mon[32782]: pgmap v15972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:31 smithi196 ceph-mon[32572]: pgmap v15973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:31 smithi110 ceph-mon[28069]: pgmap v15973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:31 smithi193 ceph-mon[32782]: pgmap v15973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29547.422578 secs 2024-04-26T20:00:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29547.422578 secs 2024-04-26T20:00:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29547.422578 secs 2024-04-26T20:00:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:33 smithi196 ceph-mon[32572]: pgmap v15974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T20:00:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:33 smithi110 ceph-mon[28069]: pgmap v15974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T20:00:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:33 smithi193 ceph-mon[32782]: pgmap v15974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T20:00:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:35 smithi196 ceph-mon[32572]: pgmap v15975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:35 smithi110 ceph-mon[28069]: pgmap v15975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:35 smithi193 ceph-mon[32782]: pgmap v15975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:37.944 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:37 smithi110 ceph-mon[28069]: pgmap v15976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 578 B/s rd, 1 op/s 2024-04-26T20:00:37.944 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29552.422656 secs 2024-04-26T20:00:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:37 smithi196 ceph-mon[32572]: pgmap v15976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 578 B/s rd, 1 op/s 2024-04-26T20:00:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29552.422656 secs 2024-04-26T20:00:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:37 smithi193 ceph-mon[32782]: pgmap v15976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 578 B/s rd, 1 op/s 2024-04-26T20:00:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29552.422656 secs 2024-04-26T20:00:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:39 smithi196 ceph-mon[32572]: pgmap v15977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:00:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:39 smithi110 ceph-mon[28069]: pgmap v15977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:00:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:39 smithi193 ceph-mon[32782]: pgmap v15977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:00:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:40 smithi196 ceph-mon[32572]: pgmap v15978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:40 smithi110 ceph-mon[28069]: pgmap v15978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:40 smithi193 ceph-mon[32782]: pgmap v15978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29557.422723 secs 2024-04-26T20:00:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:43 smithi110 ceph-mon[28069]: pgmap v15979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:43.825 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29557.422723 secs 2024-04-26T20:00:43.825 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:43 smithi193 ceph-mon[32782]: pgmap v15979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29557.422723 secs 2024-04-26T20:00:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:43 smithi196 ceph-mon[32572]: pgmap v15979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:45 smithi110 ceph-mon[28069]: pgmap v15980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:00:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:45 smithi193 ceph-mon[32782]: pgmap v15980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:00:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:45 smithi196 ceph-mon[32572]: pgmap v15980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:00:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:47 smithi110 ceph-mon[28069]: pgmap v15981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:47 smithi193 ceph-mon[32782]: pgmap v15981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:47 smithi196 ceph-mon[32572]: pgmap v15981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29562.422790 secs 2024-04-26T20:00:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29562.422790 secs 2024-04-26T20:00:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29562.422790 secs 2024-04-26T20:00:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:49 smithi110 ceph-mon[28069]: pgmap v15982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:49 smithi193 ceph-mon[32782]: pgmap v15982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:49 smithi196 ceph-mon[32572]: pgmap v15982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:51 smithi110 ceph-mon[28069]: pgmap v15983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:51.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:51 smithi193 ceph-mon[32782]: pgmap v15983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:51 smithi196 ceph-mon[32572]: pgmap v15983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29567.422921 secs 2024-04-26T20:00:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:53 smithi110 ceph-mon[28069]: pgmap v15984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29567.422921 secs 2024-04-26T20:00:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:53 smithi193 ceph-mon[32782]: pgmap v15984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29567.422921 secs 2024-04-26T20:00:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:53 smithi196 ceph-mon[32572]: pgmap v15984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:00:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:55 smithi193 ceph-mon[32782]: pgmap v15985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:00:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:55 smithi196 ceph-mon[32572]: pgmap v15985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:00:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:55 smithi110 ceph-mon[28069]: pgmap v15985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:00:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:57 smithi193 ceph-mon[32782]: pgmap v15986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:57 smithi196 ceph-mon[32572]: pgmap v15986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:57 smithi110 ceph-mon[28069]: pgmap v15986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:00:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29572.423013 secs 2024-04-26T20:00:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29572.423013 secs 2024-04-26T20:00:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29572.423013 secs 2024-04-26T20:00:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:00:59 smithi193 ceph-mon[32782]: pgmap v15987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:00:59 smithi196 ceph-mon[32572]: pgmap v15987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:00:59 smithi110 ceph-mon[28069]: pgmap v15987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:01 smithi193 ceph-mon[32782]: pgmap v15988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:01.879 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:01 smithi110 ceph-mon[28069]: pgmap v15988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:01.971 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:01 smithi196 ceph-mon[32572]: pgmap v15988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29577.423109 secs 2024-04-26T20:01:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:03 smithi193 ceph-mon[32782]: pgmap v15989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29577.423109 secs 2024-04-26T20:01:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:03 smithi196 ceph-mon[32572]: pgmap v15989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29577.423109 secs 2024-04-26T20:01:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:03 smithi110 ceph-mon[28069]: pgmap v15989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:05 smithi193 ceph-mon[32782]: pgmap v15990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:01:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:05 smithi196 ceph-mon[32572]: pgmap v15990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:01:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:05 smithi110 ceph-mon[28069]: pgmap v15990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:01:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:07 smithi193 ceph-mon[32782]: pgmap v15991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:07 smithi196 ceph-mon[32572]: pgmap v15991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:07 smithi110 ceph-mon[28069]: pgmap v15991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29582.423229 secs 2024-04-26T20:01:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29582.423229 secs 2024-04-26T20:01:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29582.423229 secs 2024-04-26T20:01:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:09 smithi193 ceph-mon[32782]: pgmap v15992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:09 smithi196 ceph-mon[32572]: pgmap v15992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:09 smithi110 ceph-mon[28069]: pgmap v15992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:11 smithi193 ceph-mon[32782]: pgmap v15993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:11 smithi196 ceph-mon[32572]: pgmap v15993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:11 smithi110 ceph-mon[28069]: pgmap v15993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29587.423369 secs 2024-04-26T20:01:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:13 smithi193 ceph-mon[32782]: pgmap v15994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29587.423369 secs 2024-04-26T20:01:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:13 smithi196 ceph-mon[32572]: pgmap v15994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29587.423369 secs 2024-04-26T20:01:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:13 smithi110 ceph-mon[28069]: pgmap v15994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:15 smithi193 ceph-mon[32782]: pgmap v15995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:01:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:15 smithi196 ceph-mon[32572]: pgmap v15995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:01:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:15 smithi110 ceph-mon[28069]: pgmap v15995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:01:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:17 smithi193 ceph-mon[32782]: pgmap v15996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:17 smithi196 ceph-mon[32572]: pgmap v15996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:17 smithi110 ceph-mon[28069]: pgmap v15996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:18.878 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29592.423507 secs 2024-04-26T20:01:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29592.423507 secs 2024-04-26T20:01:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29592.423507 secs 2024-04-26T20:01:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:19 smithi196 ceph-mon[32572]: pgmap v15997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:19 smithi110 ceph-mon[28069]: pgmap v15997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:19 smithi193 ceph-mon[32782]: pgmap v15997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:21 smithi196 ceph-mon[32572]: pgmap v15998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:21 smithi110 ceph-mon[28069]: pgmap v15998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:21 smithi193 ceph-mon[32782]: pgmap v15998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29597.423656 secs 2024-04-26T20:01:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:23 smithi196 ceph-mon[32572]: pgmap v15999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29597.423656 secs 2024-04-26T20:01:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:23 smithi110 ceph-mon[28069]: pgmap v15999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29597.423656 secs 2024-04-26T20:01:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:23 smithi193 ceph-mon[32782]: pgmap v15999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:25 smithi196 ceph-mon[32572]: pgmap v16000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:01:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:25 smithi110 ceph-mon[28069]: pgmap v16000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:01:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:25 smithi193 ceph-mon[32782]: pgmap v16000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:01:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:27 smithi196 ceph-mon[32572]: pgmap v16001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29602.423735 secs 2024-04-26T20:01:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:27 smithi110 ceph-mon[28069]: pgmap v16001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29602.423735 secs 2024-04-26T20:01:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:27 smithi193 ceph-mon[32782]: pgmap v16001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29602.423735 secs 2024-04-26T20:01:29.908 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:29 smithi110 ceph-mon[28069]: pgmap v16002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:29.908 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:01:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:29 smithi196 ceph-mon[32572]: pgmap v16002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:01:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:29 smithi193 ceph-mon[32782]: pgmap v16002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:01:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:01:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:01:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:01:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:01:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:01:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:01:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:01:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:01:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:01:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:31 smithi196 ceph-mon[32572]: pgmap v16003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T20:01:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:31 smithi196 ceph-mon[32572]: pgmap v16004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:31 smithi110 ceph-mon[28069]: pgmap v16003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T20:01:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:31 smithi110 ceph-mon[28069]: pgmap v16004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:31 smithi193 ceph-mon[32782]: pgmap v16003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T20:01:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:31 smithi193 ceph-mon[32782]: pgmap v16004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29607.423810 secs 2024-04-26T20:01:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29607.423810 secs 2024-04-26T20:01:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29607.423810 secs 2024-04-26T20:01:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:33 smithi196 ceph-mon[32572]: pgmap v16005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:01:34.117 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:33 smithi110 ceph-mon[28069]: pgmap v16005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:01:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:33 smithi193 ceph-mon[32782]: pgmap v16005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:01:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:35 smithi196 ceph-mon[32572]: pgmap v16006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:35 smithi110 ceph-mon[28069]: pgmap v16006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:35 smithi193 ceph-mon[32782]: pgmap v16006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:37 smithi196 ceph-mon[32572]: pgmap v16007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29612.423889 secs 2024-04-26T20:01:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:37 smithi110 ceph-mon[28069]: pgmap v16007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29612.423889 secs 2024-04-26T20:01:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:37 smithi193 ceph-mon[32782]: pgmap v16007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29612.423889 secs 2024-04-26T20:01:39.994 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:39 smithi196 ceph-mon[32572]: pgmap v16008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:39 smithi110 ceph-mon[28069]: pgmap v16008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:39 smithi193 ceph-mon[32782]: pgmap v16008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:01:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:41 smithi196 ceph-mon[32572]: pgmap v16009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:01:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:41 smithi110 ceph-mon[28069]: pgmap v16009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:01:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:41 smithi193 ceph-mon[32782]: pgmap v16009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:01:43.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29617.423978 secs 2024-04-26T20:01:43.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29617.423978 secs 2024-04-26T20:01:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29617.423978 secs 2024-04-26T20:01:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:43 smithi196 ceph-mon[32572]: pgmap v16010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:43 smithi110 ceph-mon[28069]: pgmap v16010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:43 smithi193 ceph-mon[32782]: pgmap v16010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:44 smithi196 ceph-mon[32572]: pgmap v16011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:44 smithi110 ceph-mon[28069]: pgmap v16011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:44 smithi193 ceph-mon[32782]: pgmap v16011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:47 smithi110 ceph-mon[28069]: pgmap v16012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:47 smithi193 ceph-mon[32782]: pgmap v16012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:47 smithi196 ceph-mon[32572]: pgmap v16012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29622.424028 secs 2024-04-26T20:01:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29622.424028 secs 2024-04-26T20:01:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29622.424028 secs 2024-04-26T20:01:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:49 smithi193 ceph-mon[32782]: pgmap v16013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:49.503 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:49 smithi196 ceph-mon[32572]: pgmap v16013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:49 smithi110 ceph-mon[28069]: pgmap v16013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:51 smithi193 ceph-mon[32782]: pgmap v16014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:51 smithi196 ceph-mon[32572]: pgmap v16014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:51 smithi110 ceph-mon[28069]: pgmap v16014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29627.424164 secs 2024-04-26T20:01:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:53 smithi193 ceph-mon[32782]: pgmap v16015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29627.424164 secs 2024-04-26T20:01:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:53 smithi196 ceph-mon[32572]: pgmap v16015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29627.424164 secs 2024-04-26T20:01:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:53 smithi110 ceph-mon[28069]: pgmap v16015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:55 smithi193 ceph-mon[32782]: pgmap v16016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:55 smithi196 ceph-mon[32572]: pgmap v16016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:55 smithi110 ceph-mon[28069]: pgmap v16016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:57 smithi193 ceph-mon[32782]: pgmap v16017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:57 smithi196 ceph-mon[32572]: pgmap v16017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:57 smithi110 ceph-mon[28069]: pgmap v16017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:01:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29632.424300 secs 2024-04-26T20:01:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29632.424300 secs 2024-04-26T20:01:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29632.424300 secs 2024-04-26T20:01:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:01:59 smithi193 ceph-mon[32782]: pgmap v16018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:01:59 smithi196 ceph-mon[32572]: pgmap v16018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:01:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:01:59 smithi110 ceph-mon[28069]: pgmap v16018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:01 smithi193 ceph-mon[32782]: pgmap v16019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:01 smithi196 ceph-mon[32572]: pgmap v16019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:01 smithi110 ceph-mon[28069]: pgmap v16019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29637.424434 secs 2024-04-26T20:02:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:03 smithi193 ceph-mon[32782]: pgmap v16020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29637.424434 secs 2024-04-26T20:02:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:03 smithi196 ceph-mon[32572]: pgmap v16020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29637.424434 secs 2024-04-26T20:02:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:03 smithi110 ceph-mon[28069]: pgmap v16020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:05 smithi193 ceph-mon[32782]: pgmap v16021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:05 smithi196 ceph-mon[32572]: pgmap v16021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:05 smithi110 ceph-mon[28069]: pgmap v16021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:07 smithi193 ceph-mon[32782]: pgmap v16022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:07 smithi196 ceph-mon[32572]: pgmap v16022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:07 smithi110 ceph-mon[28069]: pgmap v16022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29642.424591 secs 2024-04-26T20:02:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29642.424591 secs 2024-04-26T20:02:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29642.424591 secs 2024-04-26T20:02:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:09 smithi193 ceph-mon[32782]: pgmap v16023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:09 smithi196 ceph-mon[32572]: pgmap v16023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:09 smithi110 ceph-mon[28069]: pgmap v16023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:10 smithi196 ceph-mon[32572]: pgmap v16024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:11.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:10 smithi110 ceph-mon[28069]: pgmap v16024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:10 smithi193 ceph-mon[32782]: pgmap v16024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29647.424714 secs 2024-04-26T20:02:13.387 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:13 smithi193 ceph-mon[32782]: pgmap v16025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29647.424714 secs 2024-04-26T20:02:13.512 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:13 smithi196 ceph-mon[32572]: pgmap v16025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29647.424714 secs 2024-04-26T20:02:13.607 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:13 smithi110 ceph-mon[28069]: pgmap v16025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:15.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:15 smithi193 ceph-mon[32782]: pgmap v16026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:15 smithi196 ceph-mon[32572]: pgmap v16026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:15 smithi110 ceph-mon[28069]: pgmap v16026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:17.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:17 smithi110 ceph-mon[28069]: pgmap v16027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:17 smithi193 ceph-mon[32782]: pgmap v16027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:17 smithi196 ceph-mon[32572]: pgmap v16027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29652.424781 secs 2024-04-26T20:02:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29652.424781 secs 2024-04-26T20:02:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29652.424781 secs 2024-04-26T20:02:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:19 smithi193 ceph-mon[32782]: pgmap v16028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:19 smithi196 ceph-mon[32572]: pgmap v16028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:19 smithi110 ceph-mon[28069]: pgmap v16028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:21 smithi193 ceph-mon[32782]: pgmap v16029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:21 smithi196 ceph-mon[32572]: pgmap v16029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:21 smithi110 ceph-mon[28069]: pgmap v16029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29657.424892 secs 2024-04-26T20:02:23.385 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:23 smithi193 ceph-mon[32782]: pgmap v16030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29657.424892 secs 2024-04-26T20:02:23.513 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:23 smithi196 ceph-mon[32572]: pgmap v16030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29657.424892 secs 2024-04-26T20:02:23.548 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:23 smithi110 ceph-mon[28069]: pgmap v16030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:25 smithi193 ceph-mon[32782]: pgmap v16031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:25 smithi196 ceph-mon[32572]: pgmap v16031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:25 smithi110 ceph-mon[28069]: pgmap v16031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:27 smithi193 ceph-mon[32782]: pgmap v16032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:27 smithi196 ceph-mon[32572]: pgmap v16032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:27 smithi110 ceph-mon[28069]: pgmap v16032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29662.424956 secs 2024-04-26T20:02:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29662.424956 secs 2024-04-26T20:02:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29662.424956 secs 2024-04-26T20:02:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:29 smithi193 ceph-mon[32782]: pgmap v16033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:29 smithi196 ceph-mon[32572]: pgmap v16033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:29 smithi110 ceph-mon[28069]: pgmap v16033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:31 smithi193 ceph-mon[32782]: pgmap v16034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:31.461 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:02:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:31 smithi196 ceph-mon[32572]: pgmap v16034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:31.512 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:02:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:31 smithi110 ceph-mon[28069]: pgmap v16034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:31.548 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:02:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:02:32.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:02:32.386 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:32 smithi193 ceph-mon[32782]: pgmap v16035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T20:02:32.391 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:32 smithi193 ceph-mon[32782]: pgmap v16036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:32.400 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:02:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:02:32.512 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:02:32.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:32 smithi196 ceph-mon[32572]: pgmap v16035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T20:02:32.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:32 smithi196 ceph-mon[32572]: pgmap v16036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:32.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:02:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:02:32.548 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:02:32.596 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:32 smithi110 ceph-mon[28069]: pgmap v16035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T20:02:32.604 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:32 smithi110 ceph-mon[28069]: pgmap v16036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:32.610 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:02:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29667.425072 secs 2024-04-26T20:02:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29667.425072 secs 2024-04-26T20:02:33.783 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29667.425072 secs 2024-04-26T20:02:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:34 smithi196 ceph-mon[32572]: pgmap v16037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:34 smithi110 ceph-mon[28069]: pgmap v16037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:34 smithi193 ceph-mon[32782]: pgmap v16037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:36 smithi193 ceph-mon[32782]: pgmap v16038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:36 smithi196 ceph-mon[32572]: pgmap v16038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:36 smithi110 ceph-mon[28069]: pgmap v16038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29672.425193 secs 2024-04-26T20:02:38.879 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:38 smithi193 ceph-mon[32782]: pgmap v16039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29672.425193 secs 2024-04-26T20:02:39.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:38 smithi196 ceph-mon[32572]: pgmap v16039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:39.066 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29672.425193 secs 2024-04-26T20:02:39.072 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:38 smithi110 ceph-mon[28069]: pgmap v16039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:40 smithi193 ceph-mon[32782]: pgmap v16040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:40 smithi196 ceph-mon[32572]: pgmap v16040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:40 smithi110 ceph-mon[28069]: pgmap v16040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:02:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:42 smithi193 ceph-mon[32782]: pgmap v16041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:02:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:42 smithi196 ceph-mon[32572]: pgmap v16041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:02:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:42 smithi110 ceph-mon[28069]: pgmap v16041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:02:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29677.425268 secs 2024-04-26T20:02:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29677.425268 secs 2024-04-26T20:02:44.053 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29677.425268 secs 2024-04-26T20:02:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:44 smithi193 ceph-mon[32782]: pgmap v16042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:44 smithi196 ceph-mon[32572]: pgmap v16042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:44 smithi110 ceph-mon[28069]: pgmap v16042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:46 smithi193 ceph-mon[32782]: pgmap v16043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:46 smithi196 ceph-mon[32572]: pgmap v16043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:46 smithi110 ceph-mon[28069]: pgmap v16043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:48.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29682.425401 secs 2024-04-26T20:02:48.979 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:48 smithi110 ceph-mon[28069]: pgmap v16044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:48.986 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29682.425401 secs 2024-04-26T20:02:48.991 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:48 smithi193 ceph-mon[32782]: pgmap v16044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29682.425401 secs 2024-04-26T20:02:49.012 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:48 smithi196 ceph-mon[32572]: pgmap v16044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:50 smithi193 ceph-mon[32782]: pgmap v16045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:50 smithi196 ceph-mon[32572]: pgmap v16045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:50 smithi110 ceph-mon[28069]: pgmap v16045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:52 smithi193 ceph-mon[32782]: pgmap v16046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:52 smithi196 ceph-mon[32572]: pgmap v16046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:52 smithi110 ceph-mon[28069]: pgmap v16046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29687.425533 secs 2024-04-26T20:02:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29687.425533 secs 2024-04-26T20:02:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29687.425533 secs 2024-04-26T20:02:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:54 smithi193 ceph-mon[32782]: pgmap v16047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:54 smithi196 ceph-mon[32572]: pgmap v16047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:55.120 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:54 smithi110 ceph-mon[28069]: pgmap v16047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:56 smithi193 ceph-mon[32782]: pgmap v16048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:56 smithi196 ceph-mon[32572]: pgmap v16048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:56 smithi110 ceph-mon[28069]: pgmap v16048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:02:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29692.425654 secs 2024-04-26T20:02:58.890 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:02:58 smithi193 ceph-mon[32782]: pgmap v16049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29692.425654 secs 2024-04-26T20:02:59.050 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:02:58 smithi196 ceph-mon[32572]: pgmap v16049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:59.057 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29692.425654 secs 2024-04-26T20:02:59.064 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:02:58 smithi110 ceph-mon[28069]: pgmap v16049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:00 smithi196 ceph-mon[32572]: pgmap v16050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:01.240 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:00 smithi193 ceph-mon[32782]: pgmap v16050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:01.406 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:00 smithi110 ceph-mon[28069]: pgmap v16050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:02 smithi196 ceph-mon[32572]: pgmap v16051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:02 smithi110 ceph-mon[28069]: pgmap v16051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:02 smithi193 ceph-mon[32782]: pgmap v16051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29697.425717 secs 2024-04-26T20:03:04.068 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29697.425717 secs 2024-04-26T20:03:04.139 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29697.425717 secs 2024-04-26T20:03:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:04 smithi196 ceph-mon[32572]: pgmap v16052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:05.085 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:04 smithi110 ceph-mon[28069]: pgmap v16052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:04 smithi193 ceph-mon[32782]: pgmap v16052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:06 smithi196 ceph-mon[32572]: pgmap v16053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:07.067 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:06 smithi110 ceph-mon[28069]: pgmap v16053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:07.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:06 smithi193 ceph-mon[32782]: pgmap v16053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29702.425798 secs 2024-04-26T20:03:09.013 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:08 smithi196 ceph-mon[32572]: pgmap v16054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29702.425798 secs 2024-04-26T20:03:09.142 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:08 smithi110 ceph-mon[28069]: pgmap v16054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:09.149 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29702.425798 secs 2024-04-26T20:03:09.155 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:08 smithi193 ceph-mon[32782]: pgmap v16054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:10 smithi196 ceph-mon[32572]: pgmap v16055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:11.054 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:10 smithi110 ceph-mon[28069]: pgmap v16055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:10 smithi193 ceph-mon[32782]: pgmap v16055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:12 smithi196 ceph-mon[32572]: pgmap v16056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:13.129 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:12 smithi193 ceph-mon[32782]: pgmap v16056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:13.136 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:12 smithi110 ceph-mon[28069]: pgmap v16056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29707.425911 secs 2024-04-26T20:03:14.051 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29707.425911 secs 2024-04-26T20:03:14.057 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29707.425911 secs 2024-04-26T20:03:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:14 smithi196 ceph-mon[32572]: pgmap v16057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:14 smithi110 ceph-mon[28069]: pgmap v16057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:14 smithi193 ceph-mon[32782]: pgmap v16057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.458+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T20:03:16.543 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.458+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:03:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.458+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:03:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.458+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T20:03:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.459+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:03:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.460+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T20:03:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.460+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T20:03:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.465+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T20:03:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.465+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:03:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.465+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261402d070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:03:16.601 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.465+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261402d070 comp rx=0 tx=0).stop 2024-04-26T20:03:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.465+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T20:03:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.466+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T20:03:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.466+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:03:16.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.466+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:03:16.632 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.466+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:03:16.641 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:16.468+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614036000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:03:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:16 smithi196 ceph-mon[32572]: pgmap v16058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:16 smithi110 ceph-mon[28069]: pgmap v16058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:16 smithi193 ceph-mon[32782]: pgmap v16058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29712.425980 secs 2024-04-26T20:03:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29712.425980 secs 2024-04-26T20:03:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29712.425980 secs 2024-04-26T20:03:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:18 smithi196 ceph-mon[32572]: pgmap v16059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:18 smithi110 ceph-mon[28069]: pgmap v16059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:18 smithi193 ceph-mon[32782]: pgmap v16059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:20 smithi196 ceph-mon[32572]: pgmap v16060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:20 smithi110 ceph-mon[28069]: pgmap v16060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:20 smithi193 ceph-mon[32782]: pgmap v16060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:21.289 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:21.288+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:03:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:21.288+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T20:03:21.303 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:21.289+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 229 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T20:03:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:21.289+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006300 con 0x55db1be4fdd0 2024-04-26T20:03:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:21.289+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 229 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:03:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:21.289+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:03:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:21.289+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 230 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:03:21.333 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:03:21.290+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 230 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006300 con 0x7f261c104b50 2024-04-26T20:03:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:22 smithi196 ceph-mon[32572]: pgmap v16061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:23.059 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29717.426116 secs 2024-04-26T20:03:23.139 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:22 smithi193 ceph-mon[32782]: pgmap v16061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:23.180 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29717.426116 secs 2024-04-26T20:03:23.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:22 smithi110 ceph-mon[28069]: pgmap v16061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:23.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29717.426116 secs 2024-04-26T20:03:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:24 smithi196 ceph-mon[32572]: pgmap v16062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:25.050 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:24 smithi110 ceph-mon[28069]: pgmap v16062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:24 smithi193 ceph-mon[32782]: pgmap v16062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:26 smithi196 ceph-mon[32572]: pgmap v16063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:26 smithi110 ceph-mon[28069]: pgmap v16063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:26 smithi193 ceph-mon[32782]: pgmap v16063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29722.426214 secs 2024-04-26T20:03:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29722.426214 secs 2024-04-26T20:03:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29722.426214 secs 2024-04-26T20:03:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:28 smithi196 ceph-mon[32572]: pgmap v16064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:28 smithi110 ceph-mon[28069]: pgmap v16064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:28 smithi193 ceph-mon[32782]: pgmap v16064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:30 smithi196 ceph-mon[32572]: pgmap v16065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:30 smithi110 ceph-mon[28069]: pgmap v16065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:30 smithi193 ceph-mon[32782]: pgmap v16065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:31 smithi196 ceph-mon[32572]: pgmap v16066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:31 smithi110 ceph-mon[28069]: pgmap v16066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:31 smithi193 ceph-mon[32782]: pgmap v16066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29727.426349 secs 2024-04-26T20:03:33.022 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:03:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29727.426349 secs 2024-04-26T20:03:33.071 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:03:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29727.426349 secs 2024-04-26T20:03:33.129 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:03:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:03:34.048 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:03:34.055 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:33 smithi196 ceph-mon[32572]: pgmap v16067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:03:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:33 smithi196 ceph-mon[32572]: pgmap v16068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:34.074 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:03:34.081 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:03:34.087 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:03:34.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:33 smithi110 ceph-mon[28069]: pgmap v16067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:03:34.162 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:33 smithi110 ceph-mon[28069]: pgmap v16068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:34.168 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:03:34.175 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:03:34.285 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:03:34.350 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:33 smithi193 ceph-mon[32782]: pgmap v16067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:33 smithi193 ceph-mon[32782]: pgmap v16068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:34.378 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:03:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:36 smithi193 ceph-mon[32782]: pgmap v16069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:36 smithi196 ceph-mon[32572]: pgmap v16069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:36 smithi110 ceph-mon[28069]: pgmap v16069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:38.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29732.426490 secs 2024-04-26T20:03:38.436 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:38 smithi193 ceph-mon[32782]: pgmap v16070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:03:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29732.426490 secs 2024-04-26T20:03:38.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:38 smithi196 ceph-mon[32572]: pgmap v16070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:03:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29732.426490 secs 2024-04-26T20:03:38.551 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:38 smithi110 ceph-mon[28069]: pgmap v16070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:03:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:40 smithi196 ceph-mon[32572]: pgmap v16071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:40 smithi110 ceph-mon[28069]: pgmap v16071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:40 smithi193 ceph-mon[32782]: pgmap v16071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:42 smithi196 ceph-mon[32572]: pgmap v16072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:42 smithi110 ceph-mon[28069]: pgmap v16072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:42 smithi193 ceph-mon[32782]: pgmap v16072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:03:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29737.426556 secs 2024-04-26T20:03:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29737.426556 secs 2024-04-26T20:03:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29737.426556 secs 2024-04-26T20:03:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:44 smithi196 ceph-mon[32572]: pgmap v16073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:03:44.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:44 smithi193 ceph-mon[32782]: pgmap v16073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:03:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:44 smithi110 ceph-mon[28069]: pgmap v16073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:03:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:46 smithi196 ceph-mon[32572]: pgmap v16074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:46 smithi110 ceph-mon[28069]: pgmap v16074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:46 smithi193 ceph-mon[32782]: pgmap v16074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29742.426653 secs 2024-04-26T20:03:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:48 smithi196 ceph-mon[32572]: pgmap v16075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29742.426653 secs 2024-04-26T20:03:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:48 smithi110 ceph-mon[28069]: pgmap v16075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29742.426653 secs 2024-04-26T20:03:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:48 smithi193 ceph-mon[32782]: pgmap v16075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:50 smithi196 ceph-mon[32572]: pgmap v16076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:50 smithi110 ceph-mon[28069]: pgmap v16076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:50 smithi193 ceph-mon[32782]: pgmap v16076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:52 smithi196 ceph-mon[32572]: pgmap v16077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:52 smithi110 ceph-mon[28069]: pgmap v16077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:52 smithi193 ceph-mon[32782]: pgmap v16077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29747.426771 secs 2024-04-26T20:03:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29747.426771 secs 2024-04-26T20:03:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29747.426771 secs 2024-04-26T20:03:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:54 smithi196 ceph-mon[32572]: pgmap v16078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:54 smithi110 ceph-mon[28069]: pgmap v16078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:54 smithi193 ceph-mon[32782]: pgmap v16078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:03:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:56 smithi196 ceph-mon[32572]: pgmap v16079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:56 smithi110 ceph-mon[28069]: pgmap v16079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:56 smithi193 ceph-mon[32782]: pgmap v16079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29752.426895 secs 2024-04-26T20:03:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:03:58 smithi196 ceph-mon[32572]: pgmap v16080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29752.426895 secs 2024-04-26T20:03:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:03:58 smithi110 ceph-mon[28069]: pgmap v16080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29752.426895 secs 2024-04-26T20:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:03:58 smithi193 ceph-mon[32782]: pgmap v16080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:00 smithi196 ceph-mon[32572]: pgmap v16081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:00 smithi110 ceph-mon[28069]: pgmap v16081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:00 smithi193 ceph-mon[32782]: pgmap v16081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:02 smithi196 ceph-mon[32572]: pgmap v16082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:02 smithi110 ceph-mon[28069]: pgmap v16082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:02 smithi193 ceph-mon[32782]: pgmap v16082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29757.427034 secs 2024-04-26T20:04:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29757.427034 secs 2024-04-26T20:04:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29757.427034 secs 2024-04-26T20:04:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:04 smithi196 ceph-mon[32572]: pgmap v16083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:04 smithi110 ceph-mon[28069]: pgmap v16083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:04 smithi193 ceph-mon[32782]: pgmap v16083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:06 smithi196 ceph-mon[32572]: pgmap v16084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:06 smithi110 ceph-mon[28069]: pgmap v16084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:06 smithi193 ceph-mon[32782]: pgmap v16084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29762.427144 secs 2024-04-26T20:04:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:08 smithi196 ceph-mon[32572]: pgmap v16085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29762.427144 secs 2024-04-26T20:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:08 smithi110 ceph-mon[28069]: pgmap v16085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29762.427144 secs 2024-04-26T20:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:08 smithi193 ceph-mon[32782]: pgmap v16085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:10 smithi196 ceph-mon[32572]: pgmap v16086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:10 smithi110 ceph-mon[28069]: pgmap v16086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:10 smithi193 ceph-mon[32782]: pgmap v16086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:12 smithi196 ceph-mon[32572]: pgmap v16087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:12 smithi110 ceph-mon[28069]: pgmap v16087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:12 smithi193 ceph-mon[32782]: pgmap v16087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29767.427261 secs 2024-04-26T20:04:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29767.427261 secs 2024-04-26T20:04:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29767.427261 secs 2024-04-26T20:04:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:14 smithi196 ceph-mon[32572]: pgmap v16088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:14.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:14 smithi193 ceph-mon[32782]: pgmap v16088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:14 smithi110 ceph-mon[28069]: pgmap v16088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:15.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:04:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:04:14.683+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:04:15.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:04:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:04:14.683+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:04:15.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:04:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:04:14.683+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:04:15.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:04:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:04:14.683+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:04:15.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:04:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:04:14.683+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:04:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:16 smithi196 ceph-mon[32572]: pgmap v16089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:16 smithi110 ceph-mon[28069]: pgmap v16089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:16 smithi193 ceph-mon[32782]: pgmap v16089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29772.427415 secs 2024-04-26T20:04:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:18 smithi196 ceph-mon[32572]: pgmap v16090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29772.427415 secs 2024-04-26T20:04:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:18 smithi110 ceph-mon[28069]: pgmap v16090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29772.427415 secs 2024-04-26T20:04:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:18 smithi193 ceph-mon[32782]: pgmap v16090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:20 smithi110 ceph-mon[28069]: pgmap v16091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:20 smithi193 ceph-mon[32782]: pgmap v16091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:20 smithi196 ceph-mon[32572]: pgmap v16091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:22 smithi110 ceph-mon[28069]: pgmap v16092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:22 smithi193 ceph-mon[32782]: pgmap v16092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:22 smithi196 ceph-mon[32572]: pgmap v16092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29777.427530 secs 2024-04-26T20:04:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29777.427530 secs 2024-04-26T20:04:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29777.427530 secs 2024-04-26T20:04:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:24 smithi110 ceph-mon[28069]: pgmap v16093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:24 smithi193 ceph-mon[32782]: pgmap v16093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:24 smithi196 ceph-mon[32572]: pgmap v16093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:26 smithi110 ceph-mon[28069]: pgmap v16094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:26 smithi193 ceph-mon[32782]: pgmap v16094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:26 smithi196 ceph-mon[32572]: pgmap v16094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29782.427647 secs 2024-04-26T20:04:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:28 smithi110 ceph-mon[28069]: pgmap v16095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29782.427647 secs 2024-04-26T20:04:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:28 smithi193 ceph-mon[32782]: pgmap v16095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29782.427647 secs 2024-04-26T20:04:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:28 smithi196 ceph-mon[32572]: pgmap v16095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:30 smithi193 ceph-mon[32782]: pgmap v16096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:30 smithi196 ceph-mon[32572]: pgmap v16096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:30 smithi110 ceph-mon[28069]: pgmap v16096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:04:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:32 smithi193 ceph-mon[32782]: pgmap v16097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:32 smithi196 ceph-mon[32572]: pgmap v16097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:32 smithi110 ceph-mon[28069]: pgmap v16097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29787.427765 secs 2024-04-26T20:04:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29787.427765 secs 2024-04-26T20:04:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29787.427765 secs 2024-04-26T20:04:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:34 smithi193 ceph-mon[32782]: pgmap v16098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:04:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:34 smithi196 ceph-mon[32572]: pgmap v16098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:04:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:34 smithi110 ceph-mon[28069]: pgmap v16098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:04:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:04:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:04:36.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:04:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:04:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:04:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:04:36.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:04:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:36 smithi196 ceph-mon[32572]: pgmap v16099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:36 smithi196 ceph-mon[32572]: pgmap v16100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T20:04:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:36 smithi196 ceph-mon[32572]: pgmap v16101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:36 smithi110 ceph-mon[28069]: pgmap v16099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:36 smithi110 ceph-mon[28069]: pgmap v16100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T20:04:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:36 smithi110 ceph-mon[28069]: pgmap v16101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:36 smithi193 ceph-mon[32782]: pgmap v16099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:36 smithi193 ceph-mon[32782]: pgmap v16100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T20:04:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:36 smithi193 ceph-mon[32782]: pgmap v16101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29792.427878 secs 2024-04-26T20:04:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29792.427878 secs 2024-04-26T20:04:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29792.427878 secs 2024-04-26T20:04:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:38 smithi196 ceph-mon[32572]: pgmap v16102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:38 smithi110 ceph-mon[28069]: pgmap v16102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:38 smithi193 ceph-mon[32782]: pgmap v16102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:39 smithi193 ceph-mon[32782]: pgmap v16103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:39 smithi196 ceph-mon[32572]: pgmap v16103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:39 smithi110 ceph-mon[28069]: pgmap v16103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:42 smithi193 ceph-mon[32782]: pgmap v16104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:04:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:42 smithi196 ceph-mon[32572]: pgmap v16104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:04:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:42 smithi110 ceph-mon[28069]: pgmap v16104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:04:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29797.427996 secs 2024-04-26T20:04:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29797.427996 secs 2024-04-26T20:04:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29797.427996 secs 2024-04-26T20:04:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:44 smithi193 ceph-mon[32782]: pgmap v16105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:44 smithi196 ceph-mon[32572]: pgmap v16105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:44 smithi110 ceph-mon[28069]: pgmap v16105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:46 smithi193 ceph-mon[32782]: pgmap v16106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:04:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:46 smithi196 ceph-mon[32572]: pgmap v16106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:04:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:46 smithi110 ceph-mon[28069]: pgmap v16106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:04:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29802.428118 secs 2024-04-26T20:04:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:48 smithi193 ceph-mon[32782]: pgmap v16107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29802.428118 secs 2024-04-26T20:04:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:48 smithi196 ceph-mon[32572]: pgmap v16107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29802.428118 secs 2024-04-26T20:04:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:48 smithi110 ceph-mon[28069]: pgmap v16107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:50 smithi193 ceph-mon[32782]: pgmap v16108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:50 smithi196 ceph-mon[32572]: pgmap v16108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:50 smithi110 ceph-mon[28069]: pgmap v16108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:52 smithi193 ceph-mon[32782]: pgmap v16109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:52 smithi196 ceph-mon[32572]: pgmap v16109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:52 smithi110 ceph-mon[28069]: pgmap v16109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29807.428234 secs 2024-04-26T20:04:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29807.428234 secs 2024-04-26T20:04:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29807.428234 secs 2024-04-26T20:04:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:54 smithi196 ceph-mon[32572]: pgmap v16110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:54 smithi110 ceph-mon[28069]: pgmap v16110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:54 smithi193 ceph-mon[32782]: pgmap v16110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:56 smithi196 ceph-mon[32572]: pgmap v16111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:56 smithi110 ceph-mon[28069]: pgmap v16111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:56 smithi193 ceph-mon[32782]: pgmap v16111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:04:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29812.428332 secs 2024-04-26T20:04:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:04:58 smithi196 ceph-mon[32572]: pgmap v16112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29812.428332 secs 2024-04-26T20:04:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:04:58 smithi110 ceph-mon[28069]: pgmap v16112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:04:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29812.428332 secs 2024-04-26T20:04:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:04:58 smithi193 ceph-mon[32782]: pgmap v16112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:00 smithi196 ceph-mon[32572]: pgmap v16113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:00 smithi110 ceph-mon[28069]: pgmap v16113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:00 smithi193 ceph-mon[32782]: pgmap v16113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:02 smithi196 ceph-mon[32572]: pgmap v16114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:02 smithi110 ceph-mon[28069]: pgmap v16114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:02 smithi193 ceph-mon[32782]: pgmap v16114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29817.428481 secs 2024-04-26T20:05:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29817.428481 secs 2024-04-26T20:05:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29817.428481 secs 2024-04-26T20:05:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:04 smithi196 ceph-mon[32572]: pgmap v16115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:05:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:04 smithi110 ceph-mon[28069]: pgmap v16115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:05:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:04 smithi193 ceph-mon[32782]: pgmap v16115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:05:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:06 smithi196 ceph-mon[32572]: pgmap v16116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:05:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:06 smithi110 ceph-mon[28069]: pgmap v16116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:05:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:06 smithi193 ceph-mon[32782]: pgmap v16116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:05:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29822.428632 secs 2024-04-26T20:05:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:08 smithi196 ceph-mon[32572]: pgmap v16117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:05:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29822.428632 secs 2024-04-26T20:05:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:08 smithi110 ceph-mon[28069]: pgmap v16117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:05:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29822.428632 secs 2024-04-26T20:05:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:08 smithi193 ceph-mon[32782]: pgmap v16117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:05:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:10 smithi196 ceph-mon[32572]: pgmap v16118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:05:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:10 smithi110 ceph-mon[28069]: pgmap v16118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:05:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:10 smithi193 ceph-mon[32782]: pgmap v16118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:05:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:12 smithi196 ceph-mon[32572]: pgmap v16119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:05:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29827.428749 secs 2024-04-26T20:05:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:12 smithi110 ceph-mon[28069]: pgmap v16119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:05:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29827.428749 secs 2024-04-26T20:05:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:12 smithi193 ceph-mon[32782]: pgmap v16119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:05:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29827.428749 secs 2024-04-26T20:05:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:14 smithi196 ceph-mon[32572]: pgmap v16120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:05:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:14 smithi110 ceph-mon[28069]: pgmap v16120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:05:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:14 smithi193 ceph-mon[32782]: pgmap v16120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:05:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:16 smithi196 ceph-mon[32572]: pgmap v16121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:16 smithi110 ceph-mon[28069]: pgmap v16121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:16 smithi193 ceph-mon[32782]: pgmap v16121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29832.428827 secs 2024-04-26T20:05:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29832.428827 secs 2024-04-26T20:05:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29832.428827 secs 2024-04-26T20:05:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:18 smithi196 ceph-mon[32572]: pgmap v16122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:18 smithi110 ceph-mon[28069]: pgmap v16122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:18 smithi193 ceph-mon[32782]: pgmap v16122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:20 smithi196 ceph-mon[32572]: pgmap v16123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:20 smithi110 ceph-mon[28069]: pgmap v16123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:20 smithi193 ceph-mon[32782]: pgmap v16123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:22 smithi196 ceph-mon[32572]: pgmap v16124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29837.428942 secs 2024-04-26T20:05:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:22 smithi110 ceph-mon[28069]: pgmap v16124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29837.428942 secs 2024-04-26T20:05:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:22 smithi193 ceph-mon[32782]: pgmap v16124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29837.428942 secs 2024-04-26T20:05:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:24 smithi196 ceph-mon[32572]: pgmap v16125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:24 smithi110 ceph-mon[28069]: pgmap v16125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:24 smithi193 ceph-mon[32782]: pgmap v16125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:26 smithi196 ceph-mon[32572]: pgmap v16126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:26 smithi110 ceph-mon[28069]: pgmap v16126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:26 smithi193 ceph-mon[32782]: pgmap v16126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29842.429019 secs 2024-04-26T20:05:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29842.429019 secs 2024-04-26T20:05:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29842.429019 secs 2024-04-26T20:05:29.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:28 smithi196 ceph-mon[32572]: pgmap v16127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:28 smithi110 ceph-mon[28069]: pgmap v16127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:28 smithi193 ceph-mon[32782]: pgmap v16127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:30 smithi196 ceph-mon[32572]: pgmap v16128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:30 smithi110 ceph-mon[28069]: pgmap v16128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:30 smithi193 ceph-mon[32782]: pgmap v16128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:32 smithi196 ceph-mon[32572]: pgmap v16129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29847.429155 secs 2024-04-26T20:05:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:32 smithi110 ceph-mon[28069]: pgmap v16129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29847.429155 secs 2024-04-26T20:05:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:32 smithi193 ceph-mon[32782]: pgmap v16129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29847.429155 secs 2024-04-26T20:05:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:34 smithi110 ceph-mon[28069]: pgmap v16130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:34 smithi193 ceph-mon[32782]: pgmap v16130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:34 smithi196 ceph-mon[32572]: pgmap v16130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:36 smithi110 ceph-mon[28069]: pgmap v16131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:05:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:36 smithi193 ceph-mon[32782]: pgmap v16131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:05:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:36 smithi196 ceph-mon[32572]: pgmap v16131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:05:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29852.429267 secs 2024-04-26T20:05:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:05:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:05:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:37 smithi110 ceph-mon[28069]: pgmap v16132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T20:05:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:37 smithi110 ceph-mon[28069]: pgmap v16133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:05:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:05:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29852.429267 secs 2024-04-26T20:05:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:05:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:05:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:37 smithi193 ceph-mon[32782]: pgmap v16132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T20:05:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:37 smithi193 ceph-mon[32782]: pgmap v16133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:05:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:05:38.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29852.429267 secs 2024-04-26T20:05:38.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:05:38.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:05:38.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:37 smithi196 ceph-mon[32572]: pgmap v16132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T20:05:38.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:37 smithi196 ceph-mon[32572]: pgmap v16133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:05:38.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:05:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:40 smithi193 ceph-mon[32782]: pgmap v16134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:40 smithi196 ceph-mon[32572]: pgmap v16134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:40 smithi110 ceph-mon[28069]: pgmap v16134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:42 smithi193 ceph-mon[32782]: pgmap v16135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:42 smithi196 ceph-mon[32572]: pgmap v16135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:42 smithi110 ceph-mon[28069]: pgmap v16135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29857.429390 secs 2024-04-26T20:05:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29857.429390 secs 2024-04-26T20:05:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29857.429390 secs 2024-04-26T20:05:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:44 smithi193 ceph-mon[32782]: pgmap v16136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:44 smithi196 ceph-mon[32572]: pgmap v16136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:44 smithi110 ceph-mon[28069]: pgmap v16136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:46 smithi193 ceph-mon[32782]: pgmap v16137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:46 smithi196 ceph-mon[32572]: pgmap v16137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:46 smithi110 ceph-mon[28069]: pgmap v16137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29862.429508 secs 2024-04-26T20:05:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:48 smithi193 ceph-mon[32782]: pgmap v16138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:05:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29862.429508 secs 2024-04-26T20:05:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:48 smithi196 ceph-mon[32572]: pgmap v16138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:05:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29862.429508 secs 2024-04-26T20:05:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:48 smithi110 ceph-mon[28069]: pgmap v16138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:05:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:50 smithi196 ceph-mon[32572]: pgmap v16139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:50 smithi110 ceph-mon[28069]: pgmap v16139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:50 smithi193 ceph-mon[32782]: pgmap v16139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:52 smithi196 ceph-mon[32572]: pgmap v16140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:52 smithi110 ceph-mon[28069]: pgmap v16140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:52 smithi193 ceph-mon[32782]: pgmap v16140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29867.429591 secs 2024-04-26T20:05:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29867.429591 secs 2024-04-26T20:05:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29867.429591 secs 2024-04-26T20:05:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:54 smithi196 ceph-mon[32572]: pgmap v16141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:54 smithi110 ceph-mon[28069]: pgmap v16141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:54 smithi193 ceph-mon[32782]: pgmap v16141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:05:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:56 smithi196 ceph-mon[32572]: pgmap v16142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:56 smithi110 ceph-mon[28069]: pgmap v16142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:56 smithi193 ceph-mon[32782]: pgmap v16142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29872.429705 secs 2024-04-26T20:05:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:05:58 smithi196 ceph-mon[32572]: pgmap v16143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29872.429705 secs 2024-04-26T20:05:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:05:58 smithi110 ceph-mon[28069]: pgmap v16143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:05:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29872.429705 secs 2024-04-26T20:05:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:05:58 smithi193 ceph-mon[32782]: pgmap v16143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:00 smithi196 ceph-mon[32572]: pgmap v16144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:00 smithi110 ceph-mon[28069]: pgmap v16144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:00 smithi193 ceph-mon[32782]: pgmap v16144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:02 smithi196 ceph-mon[32572]: pgmap v16145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:02 smithi110 ceph-mon[28069]: pgmap v16145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:02 smithi193 ceph-mon[32782]: pgmap v16145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29877.429790 secs 2024-04-26T20:06:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29877.429790 secs 2024-04-26T20:06:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29877.429790 secs 2024-04-26T20:06:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:04 smithi196 ceph-mon[32572]: pgmap v16146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:04 smithi110 ceph-mon[28069]: pgmap v16146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:04 smithi193 ceph-mon[32782]: pgmap v16146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:06 smithi196 ceph-mon[32572]: pgmap v16147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:06 smithi110 ceph-mon[28069]: pgmap v16147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:06 smithi193 ceph-mon[32782]: pgmap v16147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29882.429872 secs 2024-04-26T20:06:08.643 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:08 smithi196 ceph-mon[32572]: pgmap v16148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:08.683 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29882.429872 secs 2024-04-26T20:06:08.690 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:08 smithi193 ceph-mon[32782]: pgmap v16148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:08.697 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29882.429872 secs 2024-04-26T20:06:08.703 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:08 smithi110 ceph-mon[28069]: pgmap v16148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:10 smithi196 ceph-mon[32572]: pgmap v16149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:10 smithi110 ceph-mon[28069]: pgmap v16149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:10 smithi193 ceph-mon[32782]: pgmap v16149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:12 smithi196 ceph-mon[32572]: pgmap v16150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:12 smithi110 ceph-mon[28069]: pgmap v16150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:12 smithi193 ceph-mon[32782]: pgmap v16150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29887.429974 secs 2024-04-26T20:06:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29887.429974 secs 2024-04-26T20:06:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29887.429974 secs 2024-04-26T20:06:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:14 smithi196 ceph-mon[32572]: pgmap v16151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:14.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:14 smithi193 ceph-mon[32782]: pgmap v16151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:14.603 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:14 smithi110 ceph-mon[28069]: pgmap v16151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:16 smithi196 ceph-mon[32572]: pgmap v16152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:16.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:16 smithi110 ceph-mon[28069]: pgmap v16152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:16 smithi193 ceph-mon[32782]: pgmap v16152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29892.430114 secs 2024-04-26T20:06:18.512 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:18 smithi196 ceph-mon[32572]: pgmap v16153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29892.430114 secs 2024-04-26T20:06:18.548 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:18 smithi110 ceph-mon[28069]: pgmap v16153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29892.430114 secs 2024-04-26T20:06:18.683 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:18 smithi193 ceph-mon[32782]: pgmap v16153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:20 smithi196 ceph-mon[32572]: pgmap v16154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:20 smithi110 ceph-mon[28069]: pgmap v16154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:20 smithi193 ceph-mon[32782]: pgmap v16154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:06:21.320+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:06:21.334 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:06:21.320+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:06:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:06:21.320+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 231 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:06:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:06:21.320+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 231 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:06:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:22 smithi196 ceph-mon[32572]: pgmap v16155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:22.569 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:22 smithi110 ceph-mon[28069]: pgmap v16155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:22 smithi193 ceph-mon[32782]: pgmap v16155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29897.430246 secs 2024-04-26T20:06:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29897.430246 secs 2024-04-26T20:06:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29897.430246 secs 2024-04-26T20:06:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:24 smithi196 ceph-mon[32572]: pgmap v16156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:24 smithi110 ceph-mon[28069]: pgmap v16156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:24 smithi193 ceph-mon[32782]: pgmap v16156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:26 smithi196 ceph-mon[32572]: pgmap v16157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:26 smithi110 ceph-mon[28069]: pgmap v16157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:26 smithi193 ceph-mon[32782]: pgmap v16157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29902.430377 secs 2024-04-26T20:06:28.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:28 smithi196 ceph-mon[32572]: pgmap v16158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29902.430377 secs 2024-04-26T20:06:28.548 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:28 smithi110 ceph-mon[28069]: pgmap v16158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29902.430377 secs 2024-04-26T20:06:28.630 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:28 smithi193 ceph-mon[32782]: pgmap v16158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:30 smithi110 ceph-mon[28069]: pgmap v16159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:30 smithi193 ceph-mon[32782]: pgmap v16159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:30 smithi196 ceph-mon[32572]: pgmap v16159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:32 smithi110 ceph-mon[28069]: pgmap v16160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:32 smithi193 ceph-mon[32782]: pgmap v16160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:32 smithi196 ceph-mon[32572]: pgmap v16160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29907.430442 secs 2024-04-26T20:06:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29907.430442 secs 2024-04-26T20:06:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29907.430442 secs 2024-04-26T20:06:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:34 smithi110 ceph-mon[28069]: pgmap v16161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:34 smithi193 ceph-mon[32782]: pgmap v16161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:34 smithi196 ceph-mon[32572]: pgmap v16161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:36 smithi110 ceph-mon[28069]: pgmap v16162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:36 smithi193 ceph-mon[32782]: pgmap v16162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:36 smithi196 ceph-mon[32572]: pgmap v16162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29912.430543 secs 2024-04-26T20:06:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:38 smithi110 ceph-mon[28069]: pgmap v16163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:06:38.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29912.430543 secs 2024-04-26T20:06:38.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:38 smithi196 ceph-mon[32572]: pgmap v16163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:38.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:06:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29912.430543 secs 2024-04-26T20:06:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:38 smithi193 ceph-mon[32782]: pgmap v16163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:06:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:06:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:06:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:39 smithi193 ceph-mon[32782]: pgmap v16164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:06:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:39 smithi193 ceph-mon[32782]: pgmap v16165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:06:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:06:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:06:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:39 smithi196 ceph-mon[32572]: pgmap v16164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:06:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:39 smithi196 ceph-mon[32572]: pgmap v16165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:06:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:06:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:06:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:39 smithi110 ceph-mon[28069]: pgmap v16164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:06:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:39 smithi110 ceph-mon[28069]: pgmap v16165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:06:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:41 smithi196 ceph-mon[32572]: pgmap v16166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:41 smithi110 ceph-mon[28069]: pgmap v16166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:41 smithi193 ceph-mon[32782]: pgmap v16166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29917.430663 secs 2024-04-26T20:06:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:43 smithi196 ceph-mon[32572]: pgmap v16167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29917.430663 secs 2024-04-26T20:06:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:43 smithi110 ceph-mon[28069]: pgmap v16167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29917.430663 secs 2024-04-26T20:06:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:43 smithi193 ceph-mon[32782]: pgmap v16167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:45 smithi196 ceph-mon[32572]: pgmap v16168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:45 smithi110 ceph-mon[28069]: pgmap v16168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:45 smithi193 ceph-mon[32782]: pgmap v16168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:47 smithi196 ceph-mon[32572]: pgmap v16169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:47 smithi110 ceph-mon[28069]: pgmap v16169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:47 smithi193 ceph-mon[32782]: pgmap v16169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:06:48.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29922.430741 secs 2024-04-26T20:06:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29922.430741 secs 2024-04-26T20:06:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29922.430741 secs 2024-04-26T20:06:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:49 smithi196 ceph-mon[32572]: pgmap v16170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:06:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:49 smithi110 ceph-mon[28069]: pgmap v16170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:06:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:49 smithi193 ceph-mon[32782]: pgmap v16170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:06:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:51 smithi196 ceph-mon[32572]: pgmap v16171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:51 smithi110 ceph-mon[28069]: pgmap v16171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:51 smithi193 ceph-mon[32782]: pgmap v16171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29927.430804 secs 2024-04-26T20:06:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29927.430804 secs 2024-04-26T20:06:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29927.430804 secs 2024-04-26T20:06:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:53 smithi196 ceph-mon[32572]: pgmap v16172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:53 smithi110 ceph-mon[28069]: pgmap v16172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:53 smithi193 ceph-mon[32782]: pgmap v16172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:06:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:55 smithi196 ceph-mon[32572]: pgmap v16173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:55 smithi110 ceph-mon[28069]: pgmap v16173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:55 smithi193 ceph-mon[32782]: pgmap v16173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:57 smithi196 ceph-mon[32572]: pgmap v16174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29932.430927 secs 2024-04-26T20:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:57 smithi110 ceph-mon[28069]: pgmap v16174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29932.430927 secs 2024-04-26T20:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:57 smithi193 ceph-mon[32782]: pgmap v16174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:06:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29932.430927 secs 2024-04-26T20:07:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:06:59 smithi196 ceph-mon[32572]: pgmap v16175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:06:59 smithi110 ceph-mon[28069]: pgmap v16175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:06:59 smithi193 ceph-mon[32782]: pgmap v16175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:01 smithi196 ceph-mon[32572]: pgmap v16176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:02.055 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:01 smithi110 ceph-mon[28069]: pgmap v16176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:01 smithi193 ceph-mon[32782]: pgmap v16176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29937.431042 secs 2024-04-26T20:07:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29937.431042 secs 2024-04-26T20:07:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29937.431042 secs 2024-04-26T20:07:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:03 smithi196 ceph-mon[32572]: pgmap v16177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:03 smithi110 ceph-mon[28069]: pgmap v16177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:03 smithi193 ceph-mon[32782]: pgmap v16177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:05 smithi110 ceph-mon[28069]: pgmap v16178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:05 smithi193 ceph-mon[32782]: pgmap v16178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:05 smithi196 ceph-mon[32572]: pgmap v16178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:07 smithi110 ceph-mon[28069]: pgmap v16179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:08.076 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29942.431158 secs 2024-04-26T20:07:08.085 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:07 smithi196 ceph-mon[32572]: pgmap v16179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:08.092 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29942.431158 secs 2024-04-26T20:07:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:07 smithi193 ceph-mon[32782]: pgmap v16179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:08.130 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29942.431158 secs 2024-04-26T20:07:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:09 smithi110 ceph-mon[28069]: pgmap v16180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:09 smithi193 ceph-mon[32782]: pgmap v16180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:09 smithi196 ceph-mon[32572]: pgmap v16180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:11 smithi110 ceph-mon[28069]: pgmap v16181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:11 smithi193 ceph-mon[32782]: pgmap v16181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:11 smithi196 ceph-mon[32572]: pgmap v16181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29947.431315 secs 2024-04-26T20:07:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29947.431315 secs 2024-04-26T20:07:13.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29947.431315 secs 2024-04-26T20:07:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:13 smithi110 ceph-mon[28069]: pgmap v16182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:13 smithi193 ceph-mon[32782]: pgmap v16182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:13 smithi196 ceph-mon[32572]: pgmap v16182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:14 smithi193 ceph-mon[32782]: pgmap v16183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:14 smithi196 ceph-mon[32572]: pgmap v16183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:14 smithi110 ceph-mon[28069]: pgmap v16183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:17 smithi196 ceph-mon[32572]: pgmap v16184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:17 smithi110 ceph-mon[28069]: pgmap v16184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:17 smithi193 ceph-mon[32782]: pgmap v16184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:18.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29952.431417 secs 2024-04-26T20:07:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29952.431417 secs 2024-04-26T20:07:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29952.431417 secs 2024-04-26T20:07:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:19 smithi196 ceph-mon[32572]: pgmap v16185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:19 smithi110 ceph-mon[28069]: pgmap v16185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:19 smithi193 ceph-mon[32782]: pgmap v16185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:21 smithi196 ceph-mon[32572]: pgmap v16186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:21 smithi110 ceph-mon[28069]: pgmap v16186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:21 smithi193 ceph-mon[32782]: pgmap v16186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29957.431515 secs 2024-04-26T20:07:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29957.431515 secs 2024-04-26T20:07:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29957.431515 secs 2024-04-26T20:07:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:23 smithi196 ceph-mon[32572]: pgmap v16187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:23 smithi110 ceph-mon[28069]: pgmap v16187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:23 smithi193 ceph-mon[32782]: pgmap v16187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:25 smithi196 ceph-mon[32572]: pgmap v16188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:25 smithi110 ceph-mon[28069]: pgmap v16188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:25 smithi193 ceph-mon[32782]: pgmap v16188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:27 smithi196 ceph-mon[32572]: pgmap v16189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29962.431633 secs 2024-04-26T20:07:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:27 smithi110 ceph-mon[28069]: pgmap v16189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29962.431633 secs 2024-04-26T20:07:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:27 smithi193 ceph-mon[32782]: pgmap v16189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29962.431633 secs 2024-04-26T20:07:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:29 smithi196 ceph-mon[32572]: pgmap v16190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:29 smithi110 ceph-mon[28069]: pgmap v16190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:29 smithi193 ceph-mon[32782]: pgmap v16190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:31 smithi196 ceph-mon[32572]: pgmap v16191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:31 smithi110 ceph-mon[28069]: pgmap v16191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:31 smithi193 ceph-mon[32782]: pgmap v16191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29967.431714 secs 2024-04-26T20:07:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29967.431714 secs 2024-04-26T20:07:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29967.431714 secs 2024-04-26T20:07:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:33 smithi196 ceph-mon[32572]: pgmap v16192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:33 smithi110 ceph-mon[28069]: pgmap v16192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:33 smithi193 ceph-mon[32782]: pgmap v16192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:35 smithi196 ceph-mon[32572]: pgmap v16193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:35 smithi110 ceph-mon[28069]: pgmap v16193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:35 smithi193 ceph-mon[32782]: pgmap v16193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:37 smithi110 ceph-mon[28069]: pgmap v16194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29972.431849 secs 2024-04-26T20:07:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:37 smithi193 ceph-mon[32782]: pgmap v16194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29972.431849 secs 2024-04-26T20:07:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:37 smithi196 ceph-mon[32572]: pgmap v16194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29972.431849 secs 2024-04-26T20:07:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:39 smithi110 ceph-mon[28069]: pgmap v16195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:07:40.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:39 smithi196 ceph-mon[32572]: pgmap v16195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:40.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:07:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:39 smithi193 ceph-mon[32782]: pgmap v16195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:07:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:07:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:07:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:07:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:07:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:07:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:07:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:07:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:07:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:07:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:41 smithi110 ceph-mon[28069]: pgmap v16196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T20:07:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:41 smithi110 ceph-mon[28069]: pgmap v16197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:41 smithi193 ceph-mon[32782]: pgmap v16196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T20:07:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:41 smithi193 ceph-mon[32782]: pgmap v16197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:41 smithi196 ceph-mon[32572]: pgmap v16196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T20:07:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:41 smithi196 ceph-mon[32572]: pgmap v16197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29977.431913 secs 2024-04-26T20:07:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29977.431913 secs 2024-04-26T20:07:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29977.431913 secs 2024-04-26T20:07:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:43 smithi110 ceph-mon[28069]: pgmap v16198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:07:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:43 smithi193 ceph-mon[32782]: pgmap v16198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:07:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:43 smithi196 ceph-mon[32572]: pgmap v16198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:07:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:44 smithi193 ceph-mon[32782]: pgmap v16199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:44 smithi196 ceph-mon[32572]: pgmap v16199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:44 smithi110 ceph-mon[28069]: pgmap v16199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:47 smithi196 ceph-mon[32572]: pgmap v16200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:47.551 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:47 smithi110 ceph-mon[28069]: pgmap v16200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:47 smithi193 ceph-mon[32782]: pgmap v16200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:48.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29982.432033 secs 2024-04-26T20:07:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29982.432033 secs 2024-04-26T20:07:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29982.432033 secs 2024-04-26T20:07:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:49 smithi196 ceph-mon[32572]: pgmap v16201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:49.633 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:49 smithi193 ceph-mon[32782]: pgmap v16201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:49.637 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:49 smithi110 ceph-mon[28069]: pgmap v16201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:51 smithi196 ceph-mon[32572]: pgmap v16202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:07:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:51 smithi110 ceph-mon[28069]: pgmap v16202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:07:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:51 smithi193 ceph-mon[32782]: pgmap v16202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:07:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29987.432143 secs 2024-04-26T20:07:53.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:53 smithi196 ceph-mon[32572]: pgmap v16203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29987.432143 secs 2024-04-26T20:07:53.548 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:53 smithi110 ceph-mon[28069]: pgmap v16203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29987.432143 secs 2024-04-26T20:07:53.630 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:53 smithi193 ceph-mon[32782]: pgmap v16203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:55 smithi196 ceph-mon[32572]: pgmap v16204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:55 smithi110 ceph-mon[28069]: pgmap v16204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:55 smithi193 ceph-mon[32782]: pgmap v16204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:57 smithi196 ceph-mon[32572]: pgmap v16205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:57.561 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:57 smithi110 ceph-mon[28069]: pgmap v16205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:57 smithi193 ceph-mon[32782]: pgmap v16205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:07:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29992.432287 secs 2024-04-26T20:07:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29992.432287 secs 2024-04-26T20:07:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29992.432287 secs 2024-04-26T20:07:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:07:59 smithi196 ceph-mon[32572]: pgmap v16206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:07:59 smithi110 ceph-mon[28069]: pgmap v16206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:07:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:07:59 smithi193 ceph-mon[32782]: pgmap v16206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:01.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:01 smithi196 ceph-mon[32572]: pgmap v16207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:01.621 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:01 smithi110 ceph-mon[28069]: pgmap v16207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:01.627 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:01 smithi193 ceph-mon[32782]: pgmap v16207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 29997.432408 secs 2024-04-26T20:08:03.543 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:03 smithi196 ceph-mon[32572]: pgmap v16208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:03.554 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 29997.432408 secs 2024-04-26T20:08:03.562 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:03 smithi110 ceph-mon[28069]: pgmap v16208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 29997.432408 secs 2024-04-26T20:08:03.628 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:03 smithi193 ceph-mon[32782]: pgmap v16208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:05 smithi196 ceph-mon[32572]: pgmap v16209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:05 smithi110 ceph-mon[28069]: pgmap v16209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:05 smithi193 ceph-mon[32782]: pgmap v16209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:07 smithi196 ceph-mon[32572]: pgmap v16210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:07 smithi110 ceph-mon[28069]: pgmap v16210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:07 smithi193 ceph-mon[32782]: pgmap v16210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30002.432472 secs 2024-04-26T20:08:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30002.432472 secs 2024-04-26T20:08:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30002.432472 secs 2024-04-26T20:08:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:09 smithi110 ceph-mon[28069]: pgmap v16211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:09 smithi193 ceph-mon[32782]: pgmap v16211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:09 smithi196 ceph-mon[32572]: pgmap v16211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:11 smithi110 ceph-mon[28069]: pgmap v16212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:11.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:11 smithi196 ceph-mon[32572]: pgmap v16212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:11 smithi193 ceph-mon[32782]: pgmap v16212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30007.432590 secs 2024-04-26T20:08:13.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:13 smithi110 ceph-mon[28069]: pgmap v16213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30007.432590 secs 2024-04-26T20:08:13.651 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:13 smithi193 ceph-mon[32782]: pgmap v16213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30007.432590 secs 2024-04-26T20:08:13.761 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:13 smithi196 ceph-mon[32572]: pgmap v16213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:15 smithi110 ceph-mon[28069]: pgmap v16214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:15 smithi193 ceph-mon[32782]: pgmap v16214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:15 smithi196 ceph-mon[32572]: pgmap v16214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:17 smithi110 ceph-mon[28069]: pgmap v16215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:17 smithi193 ceph-mon[32782]: pgmap v16215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:17 smithi196 ceph-mon[32572]: pgmap v16215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:18 smithi110 ceph-mon[28069]: 23 slow requests, 1 included below; oldest blocked for > 30012.432708 secs 2024-04-26T20:08:18.570 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:18 smithi110 ceph-mon[28069]: slow request 1442.604619 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:08:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:18 smithi193 ceph-mon[32782]: 23 slow requests, 1 included below; oldest blocked for > 30012.432708 secs 2024-04-26T20:08:18.628 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:18 smithi193 ceph-mon[32782]: slow request 1442.604619 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:08:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:18 smithi196 ceph-mon[32572]: 23 slow requests, 1 included below; oldest blocked for > 30012.432708 secs 2024-04-26T20:08:18.766 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:18 smithi196 ceph-mon[32572]: slow request 1442.604619 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:08:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:19 smithi110 ceph-mon[28069]: pgmap v16216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:19 smithi193 ceph-mon[32782]: pgmap v16216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:19 smithi196 ceph-mon[32572]: pgmap v16216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:21 smithi193 ceph-mon[32782]: pgmap v16217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:21 smithi196 ceph-mon[32572]: pgmap v16217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:21 smithi110 ceph-mon[28069]: pgmap v16217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30017.432825 secs 2024-04-26T20:08:23.644 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:23 smithi193 ceph-mon[32782]: pgmap v16218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30017.432825 secs 2024-04-26T20:08:23.791 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:23 smithi196 ceph-mon[32572]: pgmap v16218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:23.798 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30017.432825 secs 2024-04-26T20:08:23.804 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:23 smithi110 ceph-mon[28069]: pgmap v16218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:25 smithi193 ceph-mon[32782]: pgmap v16219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:25 smithi196 ceph-mon[32572]: pgmap v16219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:25 smithi110 ceph-mon[28069]: pgmap v16219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:27 smithi193 ceph-mon[32782]: pgmap v16220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:27 smithi196 ceph-mon[32572]: pgmap v16220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:27.854 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:27 smithi110 ceph-mon[28069]: pgmap v16220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30022.432891 secs 2024-04-26T20:08:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30022.432891 secs 2024-04-26T20:08:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30022.432891 secs 2024-04-26T20:08:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:29 smithi193 ceph-mon[32782]: pgmap v16221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:29 smithi196 ceph-mon[32572]: pgmap v16221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:29 smithi110 ceph-mon[28069]: pgmap v16221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:31 smithi193 ceph-mon[32782]: pgmap v16222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:31 smithi196 ceph-mon[32572]: pgmap v16222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:31 smithi110 ceph-mon[28069]: pgmap v16222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30027.433014 secs 2024-04-26T20:08:33.648 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:33 smithi193 ceph-mon[32782]: pgmap v16223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30027.433014 secs 2024-04-26T20:08:33.830 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:33 smithi196 ceph-mon[32572]: pgmap v16223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:33.846 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30027.433014 secs 2024-04-26T20:08:33.858 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:33 smithi110 ceph-mon[28069]: pgmap v16223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:35 smithi193 ceph-mon[32782]: pgmap v16224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:35 smithi196 ceph-mon[32572]: pgmap v16224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:35 smithi110 ceph-mon[28069]: pgmap v16224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:37 smithi193 ceph-mon[32782]: pgmap v16225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:37 smithi196 ceph-mon[32572]: pgmap v16225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:37.812 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:37 smithi110 ceph-mon[28069]: pgmap v16225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30032.433149 secs 2024-04-26T20:08:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30032.433149 secs 2024-04-26T20:08:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30032.433149 secs 2024-04-26T20:08:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:39 smithi193 ceph-mon[32782]: pgmap v16226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:39.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:39 smithi196 ceph-mon[32572]: pgmap v16226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:39 smithi110 ceph-mon[28069]: pgmap v16226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:41 smithi193 ceph-mon[32782]: pgmap v16227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:41.644 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:08:41.649 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:08:41.655 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:08:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:41 smithi196 ceph-mon[32572]: pgmap v16227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:41.760 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:08:41.767 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:08:41.775 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:08:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:41 smithi110 ceph-mon[28069]: pgmap v16227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:41.797 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:08:41.803 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:08:41.827 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:08:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30037.433267 secs 2024-04-26T20:08:43.778 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:43 smithi196 ceph-mon[32572]: pgmap v16228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:43.789 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:08:43.798 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:08:43.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:43 smithi196 ceph-mon[32572]: pgmap v16229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T20:08:43.851 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:43 smithi196 ceph-mon[32572]: pgmap v16230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:43.924 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:08:43.933 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30037.433267 secs 2024-04-26T20:08:43.942 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:43 smithi193 ceph-mon[32782]: pgmap v16228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:43.953 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:08:43.963 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:08:43.972 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:43 smithi193 ceph-mon[32782]: pgmap v16229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T20:08:43.980 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:43 smithi193 ceph-mon[32782]: pgmap v16230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:43.990 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:08:43.998 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30037.433267 secs 2024-04-26T20:08:44.006 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:43 smithi110 ceph-mon[28069]: pgmap v16228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:44.104 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:08:44.114 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:08:44.220 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:43 smithi110 ceph-mon[28069]: pgmap v16229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-04-26T20:08:44.230 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:43 smithi110 ceph-mon[28069]: pgmap v16230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:44.240 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:08:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:45 smithi196 ceph-mon[32572]: pgmap v16231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:45 smithi110 ceph-mon[28069]: pgmap v16231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:46.159 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:45 smithi193 ceph-mon[32782]: pgmap v16231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:47 smithi196 ceph-mon[32572]: pgmap v16232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:08:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:47 smithi110 ceph-mon[28069]: pgmap v16232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:08:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:47 smithi193 ceph-mon[32782]: pgmap v16232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:08:48.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30042.433384 secs 2024-04-26T20:08:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30042.433384 secs 2024-04-26T20:08:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30042.433384 secs 2024-04-26T20:08:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:49 smithi196 ceph-mon[32572]: pgmap v16233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:49 smithi110 ceph-mon[28069]: pgmap v16233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:49 smithi193 ceph-mon[32782]: pgmap v16233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:51 smithi196 ceph-mon[32572]: pgmap v16234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:52.064 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:51 smithi110 ceph-mon[28069]: pgmap v16234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:51 smithi193 ceph-mon[32782]: pgmap v16234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:08:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30047.433486 secs 2024-04-26T20:08:54.035 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:53 smithi196 ceph-mon[32572]: pgmap v16235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:08:54.048 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30047.433486 secs 2024-04-26T20:08:54.135 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:53 smithi110 ceph-mon[28069]: pgmap v16235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:08:54.200 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30047.433486 secs 2024-04-26T20:08:54.210 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:53 smithi193 ceph-mon[32782]: pgmap v16235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:08:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:55 smithi196 ceph-mon[32572]: pgmap v16236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:55 smithi110 ceph-mon[28069]: pgmap v16236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:55 smithi193 ceph-mon[32782]: pgmap v16236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:57 smithi196 ceph-mon[32572]: pgmap v16237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:57 smithi110 ceph-mon[28069]: pgmap v16237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:57 smithi193 ceph-mon[32782]: pgmap v16237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:08:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30052.433586 secs 2024-04-26T20:08:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30052.433586 secs 2024-04-26T20:08:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30052.433586 secs 2024-04-26T20:09:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:08:59 smithi196 ceph-mon[32572]: pgmap v16238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:08:59 smithi110 ceph-mon[28069]: pgmap v16238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:08:59 smithi193 ceph-mon[32782]: pgmap v16238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:01 smithi196 ceph-mon[32572]: pgmap v16239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:01 smithi110 ceph-mon[28069]: pgmap v16239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:01 smithi193 ceph-mon[32782]: pgmap v16239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30057.433705 secs 2024-04-26T20:09:04.034 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:03 smithi196 ceph-mon[32572]: pgmap v16240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30057.433705 secs 2024-04-26T20:09:04.047 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:03 smithi110 ceph-mon[28069]: pgmap v16240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30057.433705 secs 2024-04-26T20:09:04.127 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:03 smithi193 ceph-mon[32782]: pgmap v16240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:05 smithi196 ceph-mon[32572]: pgmap v16241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:05 smithi110 ceph-mon[28069]: pgmap v16241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:05 smithi193 ceph-mon[32782]: pgmap v16241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:07 smithi196 ceph-mon[32572]: pgmap v16242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:08.023 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30062.433826 secs 2024-04-26T20:09:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:07 smithi110 ceph-mon[28069]: pgmap v16242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:08.047 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30062.433826 secs 2024-04-26T20:09:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:07 smithi193 ceph-mon[32782]: pgmap v16242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:08.137 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30062.433826 secs 2024-04-26T20:09:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:09 smithi196 ceph-mon[32572]: pgmap v16243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:09 smithi110 ceph-mon[28069]: pgmap v16243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:09 smithi193 ceph-mon[32782]: pgmap v16243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:11 smithi196 ceph-mon[32572]: pgmap v16244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:12.052 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:11 smithi110 ceph-mon[28069]: pgmap v16244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:11 smithi193 ceph-mon[32782]: pgmap v16244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30067.433891 secs 2024-04-26T20:09:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30067.433891 secs 2024-04-26T20:09:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30067.433891 secs 2024-04-26T20:09:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:13 smithi196 ceph-mon[32572]: pgmap v16245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:13 smithi110 ceph-mon[28069]: pgmap v16245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:13 smithi193 ceph-mon[32782]: pgmap v16245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:15.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:09:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:09:14.776+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:09:15.072 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:09:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:09:14.776+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:09:15.079 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:09:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:09:14.776+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:09:15.085 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:09:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:09:14.776+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:09:15.090 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:09:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:09:14.776+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:09:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:15 smithi196 ceph-mon[32572]: pgmap v16246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:15 smithi110 ceph-mon[28069]: pgmap v16246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:15 smithi193 ceph-mon[32782]: pgmap v16246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:17 smithi196 ceph-mon[32572]: pgmap v16247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:18.088 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30072.434010 secs 2024-04-26T20:09:18.095 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:17 smithi110 ceph-mon[28069]: pgmap v16247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:18.101 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30072.434010 secs 2024-04-26T20:09:18.166 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:17 smithi193 ceph-mon[32782]: pgmap v16247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:18.195 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30072.434010 secs 2024-04-26T20:09:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:19 smithi110 ceph-mon[28069]: pgmap v16248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:09:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:19 smithi193 ceph-mon[32782]: pgmap v16248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:09:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:19 smithi196 ceph-mon[32572]: pgmap v16248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:09:21.352 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:09:21.351+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:09:21.438 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:09:21.351+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:09:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:09:21.352+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 232 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:09:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:09:21.352+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 232 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:09:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:21 smithi110 ceph-mon[28069]: pgmap v16249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:09:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:21 smithi193 ceph-mon[32782]: pgmap v16249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:09:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:21 smithi196 ceph-mon[32572]: pgmap v16249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:09:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30077.434134 secs 2024-04-26T20:09:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30077.434134 secs 2024-04-26T20:09:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30077.434134 secs 2024-04-26T20:09:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:23 smithi110 ceph-mon[28069]: pgmap v16250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:09:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:23 smithi193 ceph-mon[32782]: pgmap v16250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:09:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:23 smithi196 ceph-mon[32572]: pgmap v16250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:09:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:25 smithi110 ceph-mon[28069]: pgmap v16251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:09:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:25 smithi193 ceph-mon[32782]: pgmap v16251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:09:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:25 smithi196 ceph-mon[32572]: pgmap v16251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:09:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:27 smithi110 ceph-mon[28069]: pgmap v16252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:09:28.061 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30082.434285 secs 2024-04-26T20:09:28.126 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:27 smithi193 ceph-mon[32782]: pgmap v16252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:09:28.134 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30082.434285 secs 2024-04-26T20:09:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:27 smithi196 ceph-mon[32572]: pgmap v16252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:09:28.267 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30082.434285 secs 2024-04-26T20:09:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:29 smithi193 ceph-mon[32782]: pgmap v16253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:09:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:29 smithi196 ceph-mon[32572]: pgmap v16253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:09:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:29 smithi110 ceph-mon[28069]: pgmap v16253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:09:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:31 smithi193 ceph-mon[32782]: pgmap v16254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:31 smithi196 ceph-mon[32572]: pgmap v16254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:31 smithi110 ceph-mon[28069]: pgmap v16254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30087.434418 secs 2024-04-26T20:09:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30087.434418 secs 2024-04-26T20:09:33.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30087.434418 secs 2024-04-26T20:09:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:33 smithi193 ceph-mon[32782]: pgmap v16255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:33 smithi196 ceph-mon[32572]: pgmap v16255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:33 smithi110 ceph-mon[28069]: pgmap v16255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:34 smithi193 ceph-mon[32782]: pgmap v16256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:34 smithi196 ceph-mon[32572]: pgmap v16256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:35.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:34 smithi110 ceph-mon[28069]: pgmap v16256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:37 smithi196 ceph-mon[32572]: pgmap v16257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:37 smithi110 ceph-mon[28069]: pgmap v16257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:37 smithi193 ceph-mon[32782]: pgmap v16257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30092.434537 secs 2024-04-26T20:09:39.095 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30092.434537 secs 2024-04-26T20:09:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30092.434537 secs 2024-04-26T20:09:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:39 smithi196 ceph-mon[32572]: pgmap v16258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:40.089 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:39 smithi110 ceph-mon[28069]: pgmap v16258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:40.137 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:39 smithi193 ceph-mon[32782]: pgmap v16258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:41 smithi196 ceph-mon[32572]: pgmap v16259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:41 smithi110 ceph-mon[28069]: pgmap v16259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:41 smithi193 ceph-mon[32782]: pgmap v16259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30097.434650 secs 2024-04-26T20:09:44.031 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:43 smithi196 ceph-mon[32572]: pgmap v16260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:44.037 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:09:44.043 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.070 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.127 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.147 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30097.434650 secs 2024-04-26T20:09:44.153 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:43 smithi193 ceph-mon[32782]: pgmap v16260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:44.158 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:09:44.163 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.168 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.180 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.185 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30097.434650 secs 2024-04-26T20:09:44.268 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:43 smithi110 ceph-mon[28069]: pgmap v16260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:09:44.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:09:44.385 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.434 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:44.448 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:09:45.018 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:09:45.024 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:45.030 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:09:45.036 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:09:45.042 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:45.048 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:09:45.054 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:09:45.063 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:09:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:45 smithi196 ceph-mon[32572]: pgmap v16261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:09:46.030 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:45 smithi196 ceph-mon[32572]: pgmap v16262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:45 smithi110 ceph-mon[28069]: pgmap v16261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:09:46.120 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:45 smithi110 ceph-mon[28069]: pgmap v16262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:46.127 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:45 smithi193 ceph-mon[32782]: pgmap v16261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:09:46.133 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:45 smithi193 ceph-mon[32782]: pgmap v16262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:47 smithi196 ceph-mon[32572]: pgmap v16263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:47 smithi110 ceph-mon[28069]: pgmap v16263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:47 smithi193 ceph-mon[32782]: pgmap v16263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30102.434793 secs 2024-04-26T20:09:49.065 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30102.434793 secs 2024-04-26T20:09:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30102.434793 secs 2024-04-26T20:09:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:49 smithi196 ceph-mon[32572]: pgmap v16264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:50.088 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:49 smithi110 ceph-mon[28069]: pgmap v16264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:49 smithi193 ceph-mon[32782]: pgmap v16264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:51 smithi196 ceph-mon[32572]: pgmap v16265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:52.153 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:51 smithi193 ceph-mon[32782]: pgmap v16265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:52.196 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:51 smithi110 ceph-mon[28069]: pgmap v16265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:09:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30107.434855 secs 2024-04-26T20:09:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30107.434855 secs 2024-04-26T20:09:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30107.434855 secs 2024-04-26T20:09:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:53 smithi196 ceph-mon[32572]: pgmap v16266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:09:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:53 smithi110 ceph-mon[28069]: pgmap v16266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:09:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:53 smithi193 ceph-mon[32782]: pgmap v16266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:09:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:55 smithi196 ceph-mon[32572]: pgmap v16267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:09:56.170 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:55 smithi193 ceph-mon[32782]: pgmap v16267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:09:56.181 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:55 smithi110 ceph-mon[28069]: pgmap v16267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:09:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:57 smithi196 ceph-mon[32572]: pgmap v16268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:58.078 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30112.434977 secs 2024-04-26T20:09:58.084 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:57 smithi110 ceph-mon[28069]: pgmap v16268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:58.091 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30112.434977 secs 2024-04-26T20:09:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:57 smithi193 ceph-mon[32782]: pgmap v16268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:09:58.127 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30112.434977 secs 2024-04-26T20:10:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:09:59 smithi110 ceph-mon[28069]: pgmap v16269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:09:59 smithi193 ceph-mon[32782]: pgmap v16269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:09:59 smithi196 ceph-mon[32572]: pgmap v16269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:10:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:10:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:10:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:01 smithi110 ceph-mon[28069]: pgmap v16270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:01 smithi193 ceph-mon[32782]: pgmap v16270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:01 smithi196 ceph-mon[32572]: pgmap v16270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30117.435093 secs 2024-04-26T20:10:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30117.435093 secs 2024-04-26T20:10:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30117.435093 secs 2024-04-26T20:10:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:03 smithi110 ceph-mon[28069]: pgmap v16271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:03 smithi193 ceph-mon[32782]: pgmap v16271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:03 smithi196 ceph-mon[32572]: pgmap v16271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:05 smithi110 ceph-mon[28069]: pgmap v16272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:05 smithi193 ceph-mon[32782]: pgmap v16272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:05 smithi196 ceph-mon[32572]: pgmap v16272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:07 smithi193 ceph-mon[32782]: pgmap v16273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:08.151 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30122.435214 secs 2024-04-26T20:10:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:07 smithi196 ceph-mon[32572]: pgmap v16273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:08.293 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30122.435214 secs 2024-04-26T20:10:08.301 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:07 smithi110 ceph-mon[28069]: pgmap v16273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:08.306 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30122.435214 secs 2024-04-26T20:10:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:09 smithi193 ceph-mon[32782]: pgmap v16274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:09 smithi196 ceph-mon[32572]: pgmap v16274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:10.307 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:09 smithi110 ceph-mon[28069]: pgmap v16274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:11 smithi196 ceph-mon[32572]: pgmap v16275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:11.568 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:11 smithi110 ceph-mon[28069]: pgmap v16275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:11 smithi193 ceph-mon[32782]: pgmap v16275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30127.435369 secs 2024-04-26T20:10:13.554 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:13 smithi196 ceph-mon[32572]: pgmap v16276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:13.561 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30127.435369 secs 2024-04-26T20:10:13.567 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:13 smithi110 ceph-mon[28069]: pgmap v16276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30127.435369 secs 2024-04-26T20:10:13.627 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:13 smithi193 ceph-mon[32782]: pgmap v16276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:15 smithi196 ceph-mon[32572]: pgmap v16277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:15 smithi110 ceph-mon[28069]: pgmap v16277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:15 smithi193 ceph-mon[32782]: pgmap v16277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:17 smithi196 ceph-mon[32572]: pgmap v16278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:17.591 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:17 smithi110 ceph-mon[28069]: pgmap v16278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:17 smithi193 ceph-mon[32782]: pgmap v16278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:18 smithi196 ceph-mon[32572]: 23 slow requests, 1 included below; oldest blocked for > 30132.435487 secs 2024-04-26T20:10:18.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:18 smithi196 ceph-mon[32572]: slow request 5764.651049 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:10:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:18 smithi110 ceph-mon[28069]: 23 slow requests, 1 included below; oldest blocked for > 30132.435487 secs 2024-04-26T20:10:18.546 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:18 smithi110 ceph-mon[28069]: slow request 5764.651049 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:10:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:18 smithi193 ceph-mon[32782]: 23 slow requests, 1 included below; oldest blocked for > 30132.435487 secs 2024-04-26T20:10:18.724 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:18 smithi193 ceph-mon[32782]: slow request 5764.651049 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:10:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:19 smithi196 ceph-mon[32572]: pgmap v16279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:19.559 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:19 smithi110 ceph-mon[28069]: pgmap v16279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:19 smithi193 ceph-mon[32782]: pgmap v16279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:21 smithi196 ceph-mon[32572]: pgmap v16280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:21 smithi110 ceph-mon[28069]: pgmap v16280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:21 smithi193 ceph-mon[32782]: pgmap v16280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30137.435629 secs 2024-04-26T20:10:23.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:23 smithi196 ceph-mon[32572]: pgmap v16281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:23.583 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30137.435629 secs 2024-04-26T20:10:23.606 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:23 smithi110 ceph-mon[28069]: pgmap v16281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:23.659 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30137.435629 secs 2024-04-26T20:10:23.664 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:23 smithi193 ceph-mon[32782]: pgmap v16281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:25 smithi196 ceph-mon[32572]: pgmap v16282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:25.600 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:25 smithi110 ceph-mon[28069]: pgmap v16282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:25.625 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:25 smithi193 ceph-mon[32782]: pgmap v16282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:27 smithi196 ceph-mon[32572]: pgmap v16283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:27 smithi110 ceph-mon[28069]: pgmap v16283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:27 smithi193 ceph-mon[32782]: pgmap v16283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30142.435746 secs 2024-04-26T20:10:28.572 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30142.435746 secs 2024-04-26T20:10:28.637 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30142.435746 secs 2024-04-26T20:10:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:29 smithi196 ceph-mon[32572]: pgmap v16284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:29 smithi110 ceph-mon[28069]: pgmap v16284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:29 smithi193 ceph-mon[32782]: pgmap v16284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:31 smithi196 ceph-mon[32572]: pgmap v16285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:31 smithi110 ceph-mon[28069]: pgmap v16285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:31.649 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:31 smithi193 ceph-mon[32782]: pgmap v16285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30147.435870 secs 2024-04-26T20:10:33.552 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:33 smithi110 ceph-mon[28069]: pgmap v16286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30147.435870 secs 2024-04-26T20:10:33.651 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:33 smithi193 ceph-mon[32782]: pgmap v16286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30147.435870 secs 2024-04-26T20:10:33.760 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:33 smithi196 ceph-mon[32572]: pgmap v16286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:35 smithi110 ceph-mon[28069]: pgmap v16287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:35 smithi193 ceph-mon[32782]: pgmap v16287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:35 smithi196 ceph-mon[32572]: pgmap v16287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:37 smithi110 ceph-mon[28069]: pgmap v16288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:37.641 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:37 smithi193 ceph-mon[32782]: pgmap v16288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:37 smithi196 ceph-mon[32572]: pgmap v16288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30152.435969 secs 2024-04-26T20:10:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30152.435969 secs 2024-04-26T20:10:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30152.435969 secs 2024-04-26T20:10:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:39 smithi110 ceph-mon[28069]: pgmap v16289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:39 smithi193 ceph-mon[32782]: pgmap v16289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:39 smithi196 ceph-mon[32572]: pgmap v16289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:41.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:41 smithi196 ceph-mon[32572]: pgmap v16290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:41 smithi193 ceph-mon[32782]: pgmap v16290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:41 smithi110 ceph-mon[28069]: pgmap v16290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:43 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30157.436093 secs 2024-04-26T20:10:43.652 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:43 smithi193 ceph-mon[32782]: pgmap v16291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:43 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30157.436093 secs 2024-04-26T20:10:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:43 smithi196 ceph-mon[32572]: pgmap v16291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:43 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30157.436093 secs 2024-04-26T20:10:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:43 smithi110 ceph-mon[28069]: pgmap v16291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:45.570 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:45 smithi193 ceph-mon[32782]: pgmap v16292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:45.570 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:10:45.701 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:45 smithi110 ceph-mon[28069]: pgmap v16292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:45.702 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:10:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:45 smithi196 ceph-mon[32572]: pgmap v16292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:10:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: pgmap v16293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: pgmap v16293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: pgmap v16293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:10:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:48 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30162.436181 secs 2024-04-26T20:10:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:48 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:10:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:48 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:10:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:48 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:10:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:48 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:10:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:48 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30162.436181 secs 2024-04-26T20:10:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:48 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:10:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:48 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:10:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:48 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:10:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:48 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:10:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:48 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30162.436181 secs 2024-04-26T20:10:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:48 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:10:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:48 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:10:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:48 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:10:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:48 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:10:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:49 smithi193 ceph-mon[32782]: pgmap v16294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:49.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:49 smithi110 ceph-mon[28069]: pgmap v16294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:49 smithi196 ceph-mon[32572]: pgmap v16294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:10:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:10:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:10:51.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:10:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:10:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:10:51.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:10:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:51 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:10:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:51 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:10:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:51 smithi193 ceph-mon[32782]: pgmap v16295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 873 B/s rd, 1 op/s 2024-04-26T20:10:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:51 smithi193 ceph-mon[32782]: pgmap v16296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:51 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:10:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:51 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:10:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:51 smithi196 ceph-mon[32572]: pgmap v16295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 873 B/s rd, 1 op/s 2024-04-26T20:10:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:51 smithi196 ceph-mon[32572]: pgmap v16296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:51 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:10:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:51 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:10:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:51 smithi110 ceph-mon[28069]: pgmap v16295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 873 B/s rd, 1 op/s 2024-04-26T20:10:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:51 smithi110 ceph-mon[28069]: pgmap v16296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:53 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30167.436299 secs 2024-04-26T20:10:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:53 smithi193 ceph-mon[32782]: pgmap v16297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:53 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30167.436299 secs 2024-04-26T20:10:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:53 smithi196 ceph-mon[32572]: pgmap v16297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:53 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30167.436299 secs 2024-04-26T20:10:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:53 smithi110 ceph-mon[28069]: pgmap v16297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:55 smithi193 ceph-mon[32782]: pgmap v16298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:55 smithi196 ceph-mon[32572]: pgmap v16298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:55 smithi110 ceph-mon[28069]: pgmap v16298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:57 smithi193 ceph-mon[32782]: pgmap v16299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:57 smithi196 ceph-mon[32572]: pgmap v16299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:57 smithi110 ceph-mon[28069]: pgmap v16299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:10:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:58 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30172.436419 secs 2024-04-26T20:10:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:58 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30172.436419 secs 2024-04-26T20:10:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:58 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30172.436419 secs 2024-04-26T20:10:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:10:59 smithi193 ceph-mon[32782]: pgmap v16300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:10:59 smithi196 ceph-mon[32572]: pgmap v16300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:10:59 smithi110 ceph-mon[28069]: pgmap v16300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:01 smithi193 ceph-mon[32782]: pgmap v16301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:11:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:01 smithi196 ceph-mon[32572]: pgmap v16301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:11:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:01 smithi110 ceph-mon[28069]: pgmap v16301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:11:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:03 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30177.436583 secs 2024-04-26T20:11:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:03 smithi193 ceph-mon[32782]: pgmap v16302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:03 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30177.436583 secs 2024-04-26T20:11:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:03 smithi196 ceph-mon[32572]: pgmap v16302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:03 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30177.436583 secs 2024-04-26T20:11:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:03 smithi110 ceph-mon[28069]: pgmap v16302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:05 smithi196 ceph-mon[32572]: pgmap v16303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:05 smithi110 ceph-mon[28069]: pgmap v16303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:05 smithi193 ceph-mon[32782]: pgmap v16303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:07 smithi196 ceph-mon[32572]: pgmap v16304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:07 smithi110 ceph-mon[28069]: pgmap v16304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:07 smithi193 ceph-mon[32782]: pgmap v16304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:08 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30182.436678 secs 2024-04-26T20:11:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:08 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30182.436678 secs 2024-04-26T20:11:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:08 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30182.436678 secs 2024-04-26T20:11:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:09 smithi196 ceph-mon[32572]: pgmap v16305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:09 smithi110 ceph-mon[28069]: pgmap v16305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:09 smithi193 ceph-mon[32782]: pgmap v16305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:11 smithi196 ceph-mon[32572]: pgmap v16306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:11 smithi110 ceph-mon[28069]: pgmap v16306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:11 smithi193 ceph-mon[32782]: pgmap v16306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:13 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30187.436823 secs 2024-04-26T20:11:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:13 smithi196 ceph-mon[32572]: pgmap v16307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:13 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30187.436823 secs 2024-04-26T20:11:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:13 smithi110 ceph-mon[28069]: pgmap v16307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:13 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30187.436823 secs 2024-04-26T20:11:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:13 smithi193 ceph-mon[32782]: pgmap v16307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:15.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:15 smithi193 ceph-mon[32782]: pgmap v16308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:15 smithi196 ceph-mon[32572]: pgmap v16308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:15 smithi110 ceph-mon[28069]: pgmap v16308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:17 smithi196 ceph-mon[32572]: pgmap v16309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:17 smithi110 ceph-mon[28069]: pgmap v16309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:17 smithi193 ceph-mon[32782]: pgmap v16309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:18 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30192.436880 secs 2024-04-26T20:11:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:18 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30192.436880 secs 2024-04-26T20:11:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:18 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30192.436880 secs 2024-04-26T20:11:19.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:19 smithi110 ceph-mon[28069]: pgmap v16310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:19 smithi196 ceph-mon[32572]: pgmap v16310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:19 smithi193 ceph-mon[32782]: pgmap v16310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:21 smithi196 ceph-mon[32572]: pgmap v16311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:21 smithi110 ceph-mon[28069]: pgmap v16311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:21 smithi193 ceph-mon[32782]: pgmap v16311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:23 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30197.437010 secs 2024-04-26T20:11:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:23 smithi196 ceph-mon[32572]: pgmap v16312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:23 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30197.437010 secs 2024-04-26T20:11:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:23 smithi110 ceph-mon[28069]: pgmap v16312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:23 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30197.437010 secs 2024-04-26T20:11:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:23 smithi193 ceph-mon[32782]: pgmap v16312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:25 smithi196 ceph-mon[32572]: pgmap v16313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:25 smithi110 ceph-mon[28069]: pgmap v16313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:25 smithi193 ceph-mon[32782]: pgmap v16313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:27 smithi196 ceph-mon[32572]: pgmap v16314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:27 smithi110 ceph-mon[28069]: pgmap v16314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:27 smithi193 ceph-mon[32782]: pgmap v16314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:28 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30202.437094 secs 2024-04-26T20:11:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:28 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30202.437094 secs 2024-04-26T20:11:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:28 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30202.437094 secs 2024-04-26T20:11:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:29 smithi196 ceph-mon[32572]: pgmap v16315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:29 smithi110 ceph-mon[28069]: pgmap v16315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:29 smithi193 ceph-mon[32782]: pgmap v16315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:31 smithi196 ceph-mon[32572]: pgmap v16316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:31 smithi110 ceph-mon[28069]: pgmap v16316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:31 smithi193 ceph-mon[32782]: pgmap v16316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:33 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30207.437223 secs 2024-04-26T20:11:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:33 smithi196 ceph-mon[32572]: pgmap v16317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:33 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30207.437223 secs 2024-04-26T20:11:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:33 smithi110 ceph-mon[28069]: pgmap v16317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:33 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30207.437223 secs 2024-04-26T20:11:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:33 smithi193 ceph-mon[32782]: pgmap v16317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:35 smithi196 ceph-mon[32572]: pgmap v16318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:35 smithi110 ceph-mon[28069]: pgmap v16318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:35 smithi193 ceph-mon[32782]: pgmap v16318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:11:36.374+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:11:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:11:36.374+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:11:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:11:36.375+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 233 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:11:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:11:36.375+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 233 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:11:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:37 smithi196 ceph-mon[32572]: pgmap v16319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:37 smithi110 ceph-mon[28069]: pgmap v16319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:37 smithi193 ceph-mon[32782]: pgmap v16319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:39.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:38 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30212.437364 secs 2024-04-26T20:11:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:38 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30212.437364 secs 2024-04-26T20:11:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:38 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30212.437364 secs 2024-04-26T20:11:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:39 smithi196 ceph-mon[32572]: pgmap v16320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:39 smithi110 ceph-mon[28069]: pgmap v16320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:39 smithi193 ceph-mon[32782]: pgmap v16320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:41 smithi196 ceph-mon[32572]: pgmap v16321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:41 smithi110 ceph-mon[28069]: pgmap v16321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:41 smithi193 ceph-mon[32782]: pgmap v16321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30217.437422 secs 2024-04-26T20:11:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30217.437422 secs 2024-04-26T20:11:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30217.437422 secs 2024-04-26T20:11:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:43 smithi110 ceph-mon[28069]: pgmap v16322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:43 smithi193 ceph-mon[32782]: pgmap v16322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:43 smithi196 ceph-mon[32572]: pgmap v16322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:45 smithi110 ceph-mon[28069]: pgmap v16323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:45 smithi193 ceph-mon[32782]: pgmap v16323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:45 smithi196 ceph-mon[32572]: pgmap v16323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:46 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30222.437547 secs 2024-04-26T20:11:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:46 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30222.437547 secs 2024-04-26T20:11:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:46 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30222.437547 secs 2024-04-26T20:11:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:47 smithi110 ceph-mon[28069]: pgmap v16324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:47 smithi193 ceph-mon[32782]: pgmap v16324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:47 smithi196 ceph-mon[32572]: pgmap v16324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:49 smithi110 ceph-mon[28069]: pgmap v16325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:49 smithi193 ceph-mon[32782]: pgmap v16325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:49 smithi196 ceph-mon[32572]: pgmap v16325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:11:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:51 smithi193 ceph-mon[32782]: pgmap v16326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:11:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:11:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:11:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:51 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30227.437641 secs 2024-04-26T20:11:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:51 smithi196 ceph-mon[32572]: pgmap v16326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:11:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:11:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:11:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:51 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30227.437641 secs 2024-04-26T20:11:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:51 smithi110 ceph-mon[28069]: pgmap v16326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:11:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:11:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:11:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:11:52.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:51 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30227.437641 secs 2024-04-26T20:11:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:52 smithi193 ceph-mon[32782]: pgmap v16327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:11:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:52 smithi193 ceph-mon[32782]: pgmap v16328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:52 smithi196 ceph-mon[32572]: pgmap v16327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:11:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:52 smithi196 ceph-mon[32572]: pgmap v16328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:52 smithi110 ceph-mon[28069]: pgmap v16327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:11:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:52 smithi110 ceph-mon[28069]: pgmap v16328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:54 smithi193 ceph-mon[32782]: pgmap v16329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:54 smithi196 ceph-mon[32572]: pgmap v16329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:54 smithi110 ceph-mon[28069]: pgmap v16329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:56 smithi193 ceph-mon[32782]: pgmap v16330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:56 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30232.437746 secs 2024-04-26T20:11:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:56 smithi196 ceph-mon[32572]: pgmap v16330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:56 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30232.437746 secs 2024-04-26T20:11:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:56 smithi110 ceph-mon[28069]: pgmap v16330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:56 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30232.437746 secs 2024-04-26T20:11:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:11:58 smithi193 ceph-mon[32782]: pgmap v16331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:11:58 smithi196 ceph-mon[32572]: pgmap v16331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:11:59.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:11:58 smithi110 ceph-mon[28069]: pgmap v16331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:00 smithi193 ceph-mon[32782]: pgmap v16332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:00 smithi196 ceph-mon[32572]: pgmap v16332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:00 smithi110 ceph-mon[28069]: pgmap v16332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:01 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30237.437873 secs 2024-04-26T20:12:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:01 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30237.437873 secs 2024-04-26T20:12:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:01 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30237.437873 secs 2024-04-26T20:12:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:02 smithi193 ceph-mon[32782]: pgmap v16333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:12:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:02 smithi196 ceph-mon[32572]: pgmap v16333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:12:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:02 smithi110 ceph-mon[28069]: pgmap v16333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:12:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:03 smithi193 ceph-mon[32782]: pgmap v16334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:03 smithi196 ceph-mon[32572]: pgmap v16334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:03 smithi110 ceph-mon[28069]: pgmap v16334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:06 smithi193 ceph-mon[32782]: pgmap v16335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:06 smithi196 ceph-mon[32572]: pgmap v16335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:06 smithi110 ceph-mon[28069]: pgmap v16335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30242.437974 secs 2024-04-26T20:12:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30242.437974 secs 2024-04-26T20:12:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30242.437974 secs 2024-04-26T20:12:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:08 smithi193 ceph-mon[32782]: pgmap v16336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:08 smithi196 ceph-mon[32572]: pgmap v16336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:08 smithi110 ceph-mon[28069]: pgmap v16336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:10 smithi193 ceph-mon[32782]: pgmap v16337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:10 smithi196 ceph-mon[32572]: pgmap v16337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:10 smithi110 ceph-mon[28069]: pgmap v16337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:12 smithi193 ceph-mon[32782]: pgmap v16338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30247.438080 secs 2024-04-26T20:12:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:12 smithi196 ceph-mon[32572]: pgmap v16338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30247.438080 secs 2024-04-26T20:12:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:12 smithi110 ceph-mon[28069]: pgmap v16338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30247.438080 secs 2024-04-26T20:12:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:14 smithi193 ceph-mon[32782]: pgmap v16339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:14 smithi196 ceph-mon[32572]: pgmap v16339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:14 smithi110 ceph-mon[28069]: pgmap v16339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:16 smithi193 ceph-mon[32782]: pgmap v16340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:16 smithi196 ceph-mon[32572]: pgmap v16340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:16 smithi110 ceph-mon[28069]: pgmap v16340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30252.438206 secs 2024-04-26T20:12:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30252.438206 secs 2024-04-26T20:12:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30252.438206 secs 2024-04-26T20:12:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:18 smithi196 ceph-mon[32572]: pgmap v16341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:18 smithi110 ceph-mon[28069]: pgmap v16341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:18 smithi193 ceph-mon[32782]: pgmap v16341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:20 smithi196 ceph-mon[32572]: pgmap v16342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:20 smithi110 ceph-mon[28069]: pgmap v16342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:20 smithi193 ceph-mon[32782]: pgmap v16342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:21.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:12:21.382+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:12:21.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:12:21.382+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:12:21.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:12:21.383+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 234 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:12:21.383 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:12:21.383+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 234 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:12:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:22 smithi196 ceph-mon[32572]: pgmap v16343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30257.438335 secs 2024-04-26T20:12:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:22 smithi110 ceph-mon[28069]: pgmap v16343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30257.438335 secs 2024-04-26T20:12:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:22 smithi193 ceph-mon[32782]: pgmap v16343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30257.438335 secs 2024-04-26T20:12:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:24 smithi196 ceph-mon[32572]: pgmap v16344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:24 smithi110 ceph-mon[28069]: pgmap v16344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:24 smithi193 ceph-mon[32782]: pgmap v16344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:26 smithi196 ceph-mon[32572]: pgmap v16345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:26 smithi110 ceph-mon[28069]: pgmap v16345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:26 smithi193 ceph-mon[32782]: pgmap v16345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30262.438477 secs 2024-04-26T20:12:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30262.438477 secs 2024-04-26T20:12:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30262.438477 secs 2024-04-26T20:12:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:28 smithi196 ceph-mon[32572]: pgmap v16346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:28 smithi110 ceph-mon[28069]: pgmap v16346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:28 smithi193 ceph-mon[32782]: pgmap v16346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:30 smithi196 ceph-mon[32572]: pgmap v16347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:30 smithi110 ceph-mon[28069]: pgmap v16347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:30 smithi193 ceph-mon[32782]: pgmap v16347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:32 smithi196 ceph-mon[32572]: pgmap v16348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30267.438625 secs 2024-04-26T20:12:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:32 smithi110 ceph-mon[28069]: pgmap v16348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30267.438625 secs 2024-04-26T20:12:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:32 smithi193 ceph-mon[32782]: pgmap v16348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30267.438625 secs 2024-04-26T20:12:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:34 smithi196 ceph-mon[32572]: pgmap v16349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:34 smithi110 ceph-mon[28069]: pgmap v16349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:34 smithi193 ceph-mon[32782]: pgmap v16349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:36 smithi196 ceph-mon[32572]: pgmap v16350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:36 smithi110 ceph-mon[28069]: pgmap v16350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:36 smithi193 ceph-mon[32782]: pgmap v16350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30272.438753 secs 2024-04-26T20:12:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30272.438753 secs 2024-04-26T20:12:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30272.438753 secs 2024-04-26T20:12:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:38 smithi196 ceph-mon[32572]: pgmap v16351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:38 smithi110 ceph-mon[28069]: pgmap v16351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:38 smithi193 ceph-mon[32782]: pgmap v16351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:40 smithi196 ceph-mon[32572]: pgmap v16352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:40 smithi110 ceph-mon[28069]: pgmap v16352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:40 smithi193 ceph-mon[32782]: pgmap v16352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:42 smithi196 ceph-mon[32572]: pgmap v16353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30277.438830 secs 2024-04-26T20:12:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:42 smithi110 ceph-mon[28069]: pgmap v16353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30277.438830 secs 2024-04-26T20:12:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:42 smithi193 ceph-mon[32782]: pgmap v16353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30277.438830 secs 2024-04-26T20:12:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:44 smithi196 ceph-mon[32572]: pgmap v16354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:44 smithi110 ceph-mon[28069]: pgmap v16354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:44 smithi193 ceph-mon[32782]: pgmap v16354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:46 smithi196 ceph-mon[32572]: pgmap v16355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:46 smithi110 ceph-mon[28069]: pgmap v16355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:46 smithi193 ceph-mon[32782]: pgmap v16355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30282.438953 secs 2024-04-26T20:12:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30282.438953 secs 2024-04-26T20:12:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30282.438953 secs 2024-04-26T20:12:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:48 smithi196 ceph-mon[32572]: pgmap v16356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:48 smithi110 ceph-mon[28069]: pgmap v16356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:48 smithi193 ceph-mon[32782]: pgmap v16356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:12:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:50 smithi196 ceph-mon[32572]: pgmap v16357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:50 smithi110 ceph-mon[28069]: pgmap v16357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:50 smithi193 ceph-mon[32782]: pgmap v16357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:52 smithi196 ceph-mon[32572]: pgmap v16358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30287.439079 secs 2024-04-26T20:12:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:52 smithi110 ceph-mon[28069]: pgmap v16358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30287.439079 secs 2024-04-26T20:12:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:52 smithi193 ceph-mon[32782]: pgmap v16358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:12:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30287.439079 secs 2024-04-26T20:12:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:12:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:12:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:12:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:54 smithi196 ceph-mon[32572]: pgmap v16359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:12:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:54 smithi196 ceph-mon[32572]: pgmap v16360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:54 smithi110 ceph-mon[28069]: pgmap v16359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:12:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:54 smithi110 ceph-mon[28069]: pgmap v16360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:54 smithi193 ceph-mon[32782]: pgmap v16359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:12:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:54 smithi193 ceph-mon[32782]: pgmap v16360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:56 smithi196 ceph-mon[32572]: pgmap v16361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:56 smithi110 ceph-mon[28069]: pgmap v16361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:56 smithi193 ceph-mon[32782]: pgmap v16361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:12:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30292.439205 secs 2024-04-26T20:12:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30292.439205 secs 2024-04-26T20:12:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30292.439205 secs 2024-04-26T20:12:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:12:58 smithi110 ceph-mon[28069]: pgmap v16362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T20:12:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:12:58 smithi193 ceph-mon[32782]: pgmap v16362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T20:12:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:12:58 smithi196 ceph-mon[32572]: pgmap v16362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T20:13:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:00 smithi110 ceph-mon[28069]: pgmap v16363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:13:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:00 smithi193 ceph-mon[32782]: pgmap v16363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:13:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:00 smithi196 ceph-mon[32572]: pgmap v16363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:13:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:01 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30297.439344 secs 2024-04-26T20:13:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:01 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30297.439344 secs 2024-04-26T20:13:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:01 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30297.439344 secs 2024-04-26T20:13:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:02 smithi110 ceph-mon[28069]: pgmap v16364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:13:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:02 smithi193 ceph-mon[32782]: pgmap v16364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:13:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:02 smithi196 ceph-mon[32572]: pgmap v16364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:13:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:04 smithi110 ceph-mon[28069]: pgmap v16365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:13:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:04 smithi193 ceph-mon[32782]: pgmap v16365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:13:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:04 smithi196 ceph-mon[32572]: pgmap v16365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:13:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:06 smithi110 ceph-mon[28069]: pgmap v16366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:06 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30302.439482 secs 2024-04-26T20:13:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:06 smithi193 ceph-mon[32782]: pgmap v16366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:06 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30302.439482 secs 2024-04-26T20:13:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:06 smithi196 ceph-mon[32572]: pgmap v16366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:06 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30302.439482 secs 2024-04-26T20:13:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:08 smithi193 ceph-mon[32782]: pgmap v16367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:08 smithi196 ceph-mon[32572]: pgmap v16367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:08 smithi110 ceph-mon[28069]: pgmap v16367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:10 smithi193 ceph-mon[32782]: pgmap v16368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:10 smithi196 ceph-mon[32572]: pgmap v16368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:10 smithi110 ceph-mon[28069]: pgmap v16368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:11 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30307.439611 secs 2024-04-26T20:13:12.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:11 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30307.439611 secs 2024-04-26T20:13:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:11 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30307.439611 secs 2024-04-26T20:13:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:12 smithi193 ceph-mon[32782]: pgmap v16369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:12 smithi196 ceph-mon[32572]: pgmap v16369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:12 smithi110 ceph-mon[28069]: pgmap v16369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:14 smithi193 ceph-mon[32782]: pgmap v16370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:14 smithi196 ceph-mon[32572]: pgmap v16370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:14 smithi110 ceph-mon[28069]: pgmap v16370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:16 smithi193 ceph-mon[32782]: pgmap v16371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:16 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30312.439732 secs 2024-04-26T20:13:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:16 smithi196 ceph-mon[32572]: pgmap v16371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:16 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30312.439732 secs 2024-04-26T20:13:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:16 smithi110 ceph-mon[28069]: pgmap v16371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:16 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30312.439732 secs 2024-04-26T20:13:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:18 smithi193 ceph-mon[32782]: pgmap v16372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:18 smithi196 ceph-mon[32572]: pgmap v16372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:18 smithi110 ceph-mon[28069]: pgmap v16372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:21.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:20 smithi110 ceph-mon[28069]: pgmap v16373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:20 smithi193 ceph-mon[32782]: pgmap v16373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:20 smithi196 ceph-mon[32572]: pgmap v16373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:21 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30317.439868 secs 2024-04-26T20:13:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:21 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30317.439868 secs 2024-04-26T20:13:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:21 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30317.439868 secs 2024-04-26T20:13:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:22 smithi193 ceph-mon[32782]: pgmap v16374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:22 smithi196 ceph-mon[32572]: pgmap v16374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:22 smithi110 ceph-mon[28069]: pgmap v16374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:24 smithi193 ceph-mon[32782]: pgmap v16375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:24 smithi196 ceph-mon[32572]: pgmap v16375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:24 smithi110 ceph-mon[28069]: pgmap v16375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:25 smithi196 ceph-mon[32572]: pgmap v16376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:25 smithi110 ceph-mon[28069]: pgmap v16376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:25 smithi193 ceph-mon[32782]: pgmap v16376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:26 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30322.439984 secs 2024-04-26T20:13:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:26 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30322.439984 secs 2024-04-26T20:13:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:26 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30322.439984 secs 2024-04-26T20:13:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:27 smithi196 ceph-mon[32572]: pgmap v16377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:27 smithi110 ceph-mon[28069]: pgmap v16377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:27 smithi193 ceph-mon[32782]: pgmap v16377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:30 smithi196 ceph-mon[32572]: pgmap v16378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:30 smithi110 ceph-mon[28069]: pgmap v16378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:30 smithi193 ceph-mon[32782]: pgmap v16378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:32 smithi196 ceph-mon[32572]: pgmap v16379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30327.440102 secs 2024-04-26T20:13:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:32 smithi110 ceph-mon[28069]: pgmap v16379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30327.440102 secs 2024-04-26T20:13:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:32 smithi193 ceph-mon[32782]: pgmap v16379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30327.440102 secs 2024-04-26T20:13:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:34 smithi196 ceph-mon[32572]: pgmap v16380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:34 smithi110 ceph-mon[28069]: pgmap v16380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:34 smithi193 ceph-mon[32782]: pgmap v16380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:36 smithi196 ceph-mon[32572]: pgmap v16381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:36 smithi110 ceph-mon[28069]: pgmap v16381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:36 smithi193 ceph-mon[32782]: pgmap v16381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30332.440197 secs 2024-04-26T20:13:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30332.440197 secs 2024-04-26T20:13:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30332.440197 secs 2024-04-26T20:13:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:38 smithi196 ceph-mon[32572]: pgmap v16382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:38 smithi110 ceph-mon[28069]: pgmap v16382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:38 smithi193 ceph-mon[32782]: pgmap v16382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:40 smithi196 ceph-mon[32572]: pgmap v16383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:40 smithi110 ceph-mon[28069]: pgmap v16383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:40 smithi193 ceph-mon[32782]: pgmap v16383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:42 smithi110 ceph-mon[28069]: pgmap v16384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30337.440322 secs 2024-04-26T20:13:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:42 smithi193 ceph-mon[32782]: pgmap v16384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30337.440322 secs 2024-04-26T20:13:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:42 smithi196 ceph-mon[32572]: pgmap v16384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30337.440322 secs 2024-04-26T20:13:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:44 smithi110 ceph-mon[28069]: pgmap v16385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:44 smithi193 ceph-mon[32782]: pgmap v16385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:44 smithi196 ceph-mon[32572]: pgmap v16385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:46 smithi110 ceph-mon[28069]: pgmap v16386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:46 smithi193 ceph-mon[32782]: pgmap v16386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:46 smithi196 ceph-mon[32572]: pgmap v16386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30342.440470 secs 2024-04-26T20:13:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30342.440470 secs 2024-04-26T20:13:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30342.440470 secs 2024-04-26T20:13:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:48 smithi110 ceph-mon[28069]: pgmap v16387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:48 smithi193 ceph-mon[32782]: pgmap v16387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:48 smithi196 ceph-mon[32572]: pgmap v16387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:13:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:50 smithi110 ceph-mon[28069]: pgmap v16388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:50 smithi193 ceph-mon[32782]: pgmap v16388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:50 smithi196 ceph-mon[32572]: pgmap v16388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:52 smithi110 ceph-mon[28069]: pgmap v16389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:13:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30347.440594 secs 2024-04-26T20:13:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:52 smithi193 ceph-mon[32782]: pgmap v16389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:13:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30347.440594 secs 2024-04-26T20:13:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:52 smithi196 ceph-mon[32572]: pgmap v16389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:13:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30347.440594 secs 2024-04-26T20:13:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:54 smithi193 ceph-mon[32782]: pgmap v16390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:54 smithi196 ceph-mon[32572]: pgmap v16390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:54 smithi110 ceph-mon[28069]: pgmap v16390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:13:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:55 smithi193 ceph-mon[32782]: pgmap v16391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 797 B/s rd, 1 op/s 2024-04-26T20:13:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:55 smithi193 ceph-mon[32782]: pgmap v16392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 964 B/s rd, 1 op/s 2024-04-26T20:13:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:13:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:55 smithi196 ceph-mon[32572]: pgmap v16391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 797 B/s rd, 1 op/s 2024-04-26T20:13:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:55 smithi196 ceph-mon[32572]: pgmap v16392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 964 B/s rd, 1 op/s 2024-04-26T20:13:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:13:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:55 smithi110 ceph-mon[28069]: pgmap v16391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 797 B/s rd, 1 op/s 2024-04-26T20:13:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:55 smithi110 ceph-mon[28069]: pgmap v16392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 964 B/s rd, 1 op/s 2024-04-26T20:13:55.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:13:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:56 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30352.440690 secs 2024-04-26T20:13:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:56 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30352.440690 secs 2024-04-26T20:13:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:56 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30352.440690 secs 2024-04-26T20:13:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:57 smithi193 ceph-mon[32782]: pgmap v16393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 964 B/s rd, 1 op/s 2024-04-26T20:13:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:57 smithi196 ceph-mon[32572]: pgmap v16393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 964 B/s rd, 1 op/s 2024-04-26T20:13:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:57 smithi110 ceph-mon[28069]: pgmap v16393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 964 B/s rd, 1 op/s 2024-04-26T20:14:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:13:59 smithi193 ceph-mon[32782]: pgmap v16394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:13:59 smithi196 ceph-mon[32572]: pgmap v16394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:13:59 smithi110 ceph-mon[28069]: pgmap v16394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:01 smithi193 ceph-mon[32782]: pgmap v16395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:01 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30357.440805 secs 2024-04-26T20:14:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:01 smithi196 ceph-mon[32572]: pgmap v16395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:01 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30357.440805 secs 2024-04-26T20:14:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:01 smithi110 ceph-mon[28069]: pgmap v16395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:01 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30357.440805 secs 2024-04-26T20:14:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:03 smithi193 ceph-mon[32782]: pgmap v16396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:03 smithi196 ceph-mon[32572]: pgmap v16396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:03 smithi110 ceph-mon[28069]: pgmap v16396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:05 smithi193 ceph-mon[32782]: pgmap v16397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:14:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:05 smithi196 ceph-mon[32572]: pgmap v16397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:14:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:05 smithi110 ceph-mon[28069]: pgmap v16397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:14:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:06 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30362.440924 secs 2024-04-26T20:14:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:06 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30362.440924 secs 2024-04-26T20:14:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:06 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30362.440924 secs 2024-04-26T20:14:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:07 smithi193 ceph-mon[32782]: pgmap v16398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:07 smithi196 ceph-mon[32572]: pgmap v16398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:07 smithi110 ceph-mon[28069]: pgmap v16398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:09 smithi193 ceph-mon[32782]: pgmap v16399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:09 smithi196 ceph-mon[32572]: pgmap v16399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:09 smithi110 ceph-mon[28069]: pgmap v16399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:11 smithi196 ceph-mon[32572]: pgmap v16400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:11 smithi110 ceph-mon[28069]: pgmap v16400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:11 smithi193 ceph-mon[32782]: pgmap v16400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30367.441052 secs 2024-04-26T20:14:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30367.441052 secs 2024-04-26T20:14:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30367.441052 secs 2024-04-26T20:14:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:13 smithi110 ceph-mon[28069]: pgmap v16401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:13 smithi193 ceph-mon[32782]: pgmap v16401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:13 smithi196 ceph-mon[32572]: pgmap v16401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:15.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:14:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:14:14.983+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:14:15.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:14:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:14:14.983+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:14:15.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:14:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:14:14.983+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:14:15.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:14:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:14:14.983+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:14:15.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:14:14 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:14:14.983+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:14:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:15 smithi110 ceph-mon[28069]: pgmap v16402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:15 smithi193 ceph-mon[32782]: pgmap v16402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:15 smithi196 ceph-mon[32572]: pgmap v16402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:16 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30372.441114 secs 2024-04-26T20:14:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:16 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30372.441114 secs 2024-04-26T20:14:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:16 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30372.441114 secs 2024-04-26T20:14:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:17 smithi193 ceph-mon[32782]: pgmap v16403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:17 smithi196 ceph-mon[32572]: pgmap v16403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:17 smithi110 ceph-mon[28069]: pgmap v16403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:19 smithi193 ceph-mon[32782]: pgmap v16404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T20:14:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:19 smithi196 ceph-mon[32572]: pgmap v16404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T20:14:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:19 smithi110 ceph-mon[28069]: pgmap v16404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T20:14:22.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:21 smithi110 ceph-mon[28069]: pgmap v16405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T20:14:22.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:21 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30377.441234 secs 2024-04-26T20:14:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:21 smithi193 ceph-mon[32782]: pgmap v16405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T20:14:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:21 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30377.441234 secs 2024-04-26T20:14:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:21 smithi196 ceph-mon[32572]: pgmap v16405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T20:14:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:21 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30377.441234 secs 2024-04-26T20:14:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:23 smithi193 ceph-mon[32782]: pgmap v16406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T20:14:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:23 smithi196 ceph-mon[32572]: pgmap v16406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T20:14:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:23 smithi110 ceph-mon[28069]: pgmap v16406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T20:14:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:25 smithi193 ceph-mon[32782]: pgmap v16407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T20:14:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:25 smithi196 ceph-mon[32572]: pgmap v16407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T20:14:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:25 smithi110 ceph-mon[28069]: pgmap v16407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T20:14:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:26 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30382.441355 secs 2024-04-26T20:14:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:26 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30382.441355 secs 2024-04-26T20:14:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:26 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30382.441355 secs 2024-04-26T20:14:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:27 smithi193 ceph-mon[32782]: pgmap v16408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T20:14:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:27 smithi196 ceph-mon[32572]: pgmap v16408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T20:14:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:27 smithi110 ceph-mon[28069]: pgmap v16408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T20:14:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:29 smithi193 ceph-mon[32782]: pgmap v16409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T20:14:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:29 smithi196 ceph-mon[32572]: pgmap v16409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T20:14:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:29 smithi110 ceph-mon[28069]: pgmap v16409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T20:14:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:31 smithi193 ceph-mon[32782]: pgmap v16410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:31 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30387.441492 secs 2024-04-26T20:14:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:31 smithi196 ceph-mon[32572]: pgmap v16410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:31 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30387.441492 secs 2024-04-26T20:14:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:31 smithi110 ceph-mon[28069]: pgmap v16410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:31 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30387.441492 secs 2024-04-26T20:14:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:33 smithi193 ceph-mon[32782]: pgmap v16411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:33 smithi196 ceph-mon[32572]: pgmap v16411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:33 smithi110 ceph-mon[28069]: pgmap v16411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:35 smithi193 ceph-mon[32782]: pgmap v16412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:35 smithi196 ceph-mon[32572]: pgmap v16412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:35 smithi110 ceph-mon[28069]: pgmap v16412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:36 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30392.441631 secs 2024-04-26T20:14:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:36 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30392.441631 secs 2024-04-26T20:14:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:36 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30392.441631 secs 2024-04-26T20:14:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:37 smithi193 ceph-mon[32782]: pgmap v16413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:37 smithi196 ceph-mon[32572]: pgmap v16413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:37 smithi110 ceph-mon[28069]: pgmap v16413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:39 smithi193 ceph-mon[32782]: pgmap v16414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:39 smithi196 ceph-mon[32572]: pgmap v16414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:39 smithi110 ceph-mon[28069]: pgmap v16414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:41 smithi193 ceph-mon[32782]: pgmap v16415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:41 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30397.441783 secs 2024-04-26T20:14:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:41 smithi196 ceph-mon[32572]: pgmap v16415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:41 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30397.441783 secs 2024-04-26T20:14:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:41 smithi110 ceph-mon[28069]: pgmap v16415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:41 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30397.441783 secs 2024-04-26T20:14:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:42 smithi196 ceph-mon[32572]: pgmap v16416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:42 smithi110 ceph-mon[28069]: pgmap v16416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:42 smithi193 ceph-mon[32782]: pgmap v16416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:46.075 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:45 smithi193 ceph-mon[32782]: pgmap v16417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:45 smithi196 ceph-mon[32572]: pgmap v16417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:45 smithi110 ceph-mon[28069]: pgmap v16417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:46 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30402.441848 secs 2024-04-26T20:14:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:46 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30402.441848 secs 2024-04-26T20:14:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:46 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30402.441848 secs 2024-04-26T20:14:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:47 smithi193 ceph-mon[32782]: pgmap v16418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:47 smithi196 ceph-mon[32572]: pgmap v16418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:47 smithi110 ceph-mon[28069]: pgmap v16418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:49 smithi193 ceph-mon[32782]: pgmap v16419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:49 smithi196 ceph-mon[32572]: pgmap v16419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:49 smithi110 ceph-mon[28069]: pgmap v16419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:52.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:51 smithi110 ceph-mon[28069]: pgmap v16420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:52.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:51 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30407.441966 secs 2024-04-26T20:14:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:51 smithi193 ceph-mon[32782]: pgmap v16420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:51 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30407.441966 secs 2024-04-26T20:14:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:51 smithi196 ceph-mon[32572]: pgmap v16420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:51 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30407.441966 secs 2024-04-26T20:14:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:53 smithi193 ceph-mon[32782]: pgmap v16421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:53 smithi196 ceph-mon[32572]: pgmap v16421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:53 smithi110 ceph-mon[28069]: pgmap v16421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:14:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:55 smithi193 ceph-mon[32782]: pgmap v16422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:55 smithi196 ceph-mon[32572]: pgmap v16422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:55 smithi110 ceph-mon[28069]: pgmap v16422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:14:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:14:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:56 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30412.442027 secs 2024-04-26T20:14:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:14:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:56 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30412.442027 secs 2024-04-26T20:14:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:14:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:56 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30412.442027 secs 2024-04-26T20:14:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:57 smithi193 ceph-mon[32782]: pgmap v16423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:14:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:57 smithi193 ceph-mon[32782]: pgmap v16424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:57 smithi196 ceph-mon[32572]: pgmap v16423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:14:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:57 smithi196 ceph-mon[32572]: pgmap v16424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:14:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:57 smithi110 ceph-mon[28069]: pgmap v16423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:14:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:57 smithi110 ceph-mon[28069]: pgmap v16424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:15:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:14:59 smithi193 ceph-mon[32782]: pgmap v16425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:15:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:14:59 smithi196 ceph-mon[32572]: pgmap v16425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:15:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:14:59 smithi110 ceph-mon[28069]: pgmap v16425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:15:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:01 smithi193 ceph-mon[32782]: pgmap v16426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:15:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:01 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30417.442164 secs 2024-04-26T20:15:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:01 smithi196 ceph-mon[32572]: pgmap v16426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:15:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:01 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30417.442164 secs 2024-04-26T20:15:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:01 smithi110 ceph-mon[28069]: pgmap v16426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:15:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:01 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30417.442164 secs 2024-04-26T20:15:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:03 smithi193 ceph-mon[32782]: pgmap v16427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T20:15:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:03 smithi196 ceph-mon[32572]: pgmap v16427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T20:15:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:03 smithi110 ceph-mon[28069]: pgmap v16427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T20:15:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:05 smithi193 ceph-mon[32782]: pgmap v16428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:05 smithi196 ceph-mon[32572]: pgmap v16428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:05 smithi110 ceph-mon[28069]: pgmap v16428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:06 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30422.442262 secs 2024-04-26T20:15:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:06 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30422.442262 secs 2024-04-26T20:15:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:06 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30422.442262 secs 2024-04-26T20:15:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:07 smithi196 ceph-mon[32572]: pgmap v16429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:07 smithi110 ceph-mon[28069]: pgmap v16429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:07 smithi193 ceph-mon[32782]: pgmap v16429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:08 smithi196 ceph-mon[32572]: pgmap v16430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:08 smithi110 ceph-mon[28069]: pgmap v16430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:08 smithi193 ceph-mon[32782]: pgmap v16430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:11 smithi196 ceph-mon[32572]: pgmap v16431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:15:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:11 smithi110 ceph-mon[28069]: pgmap v16431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:15:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:11 smithi193 ceph-mon[32782]: pgmap v16431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:15:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30427.442380 secs 2024-04-26T20:15:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30427.442380 secs 2024-04-26T20:15:12.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30427.442380 secs 2024-04-26T20:15:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:13 smithi196 ceph-mon[32572]: pgmap v16432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:15:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:13 smithi110 ceph-mon[28069]: pgmap v16432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:15:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:13 smithi193 ceph-mon[32782]: pgmap v16432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:15:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:15 smithi196 ceph-mon[32572]: pgmap v16433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:15 smithi110 ceph-mon[28069]: pgmap v16433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:15 smithi193 ceph-mon[32782]: pgmap v16433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:15:17.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:17 smithi193 ceph-mon[32782]: pgmap v16434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:17.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30432.442498 secs 2024-04-26T20:15:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:17 smithi196 ceph-mon[32572]: pgmap v16434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30432.442498 secs 2024-04-26T20:15:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:17 smithi110 ceph-mon[28069]: pgmap v16434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30432.442498 secs 2024-04-26T20:15:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:19 smithi196 ceph-mon[32572]: pgmap v16435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:19 smithi110 ceph-mon[28069]: pgmap v16435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:19 smithi193 ceph-mon[32782]: pgmap v16435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:21.412 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:15:21.411+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:15:21.412 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:15:21.411+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:15:21.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:15:21.412+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 235 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:15:21.413 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:15:21.412+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 235 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:15:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:21 smithi196 ceph-mon[32572]: pgmap v16436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:21 smithi110 ceph-mon[28069]: pgmap v16436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:21 smithi193 ceph-mon[32782]: pgmap v16436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:22.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30437.442621 secs 2024-04-26T20:15:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30437.442621 secs 2024-04-26T20:15:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30437.442621 secs 2024-04-26T20:15:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:23 smithi196 ceph-mon[32572]: pgmap v16437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:23 smithi110 ceph-mon[28069]: pgmap v16437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:23 smithi193 ceph-mon[32782]: pgmap v16437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:25 smithi196 ceph-mon[32572]: pgmap v16438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:25 smithi110 ceph-mon[28069]: pgmap v16438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:25 smithi193 ceph-mon[32782]: pgmap v16438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:27 smithi196 ceph-mon[32572]: pgmap v16439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30442.442737 secs 2024-04-26T20:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:27 smithi110 ceph-mon[28069]: pgmap v16439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30442.442737 secs 2024-04-26T20:15:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:27 smithi193 ceph-mon[32782]: pgmap v16439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30442.442737 secs 2024-04-26T20:15:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:29 smithi196 ceph-mon[32572]: pgmap v16440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:29 smithi110 ceph-mon[28069]: pgmap v16440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:29 smithi193 ceph-mon[32782]: pgmap v16440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:31 smithi196 ceph-mon[32572]: pgmap v16441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:31 smithi110 ceph-mon[28069]: pgmap v16441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:31 smithi193 ceph-mon[32782]: pgmap v16441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30447.442889 secs 2024-04-26T20:15:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30447.442889 secs 2024-04-26T20:15:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30447.442889 secs 2024-04-26T20:15:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:33 smithi196 ceph-mon[32572]: pgmap v16442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:33 smithi110 ceph-mon[28069]: pgmap v16442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:33 smithi193 ceph-mon[32782]: pgmap v16442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:35 smithi196 ceph-mon[32572]: pgmap v16443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:35 smithi110 ceph-mon[28069]: pgmap v16443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:35 smithi193 ceph-mon[32782]: pgmap v16443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:37 smithi196 ceph-mon[32572]: pgmap v16444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30452.443013 secs 2024-04-26T20:15:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:37 smithi110 ceph-mon[28069]: pgmap v16444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30452.443013 secs 2024-04-26T20:15:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:37 smithi193 ceph-mon[32782]: pgmap v16444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30452.443013 secs 2024-04-26T20:15:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:39 smithi196 ceph-mon[32572]: pgmap v16445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:39 smithi110 ceph-mon[28069]: pgmap v16445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:39 smithi193 ceph-mon[32782]: pgmap v16445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:41 smithi196 ceph-mon[32572]: pgmap v16446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:41 smithi110 ceph-mon[28069]: pgmap v16446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:41 smithi193 ceph-mon[32782]: pgmap v16446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30457.443130 secs 2024-04-26T20:15:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30457.443130 secs 2024-04-26T20:15:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30457.443130 secs 2024-04-26T20:15:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:43 smithi110 ceph-mon[28069]: pgmap v16447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:43 smithi193 ceph-mon[32782]: pgmap v16447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:43 smithi196 ceph-mon[32572]: pgmap v16447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:45 smithi110 ceph-mon[28069]: pgmap v16448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:45 smithi193 ceph-mon[32782]: pgmap v16448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:45 smithi196 ceph-mon[32572]: pgmap v16448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:47 smithi110 ceph-mon[28069]: pgmap v16449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30462.443248 secs 2024-04-26T20:15:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:47 smithi193 ceph-mon[32782]: pgmap v16449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30462.443248 secs 2024-04-26T20:15:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:47 smithi196 ceph-mon[32572]: pgmap v16449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30462.443248 secs 2024-04-26T20:15:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:49 smithi110 ceph-mon[28069]: pgmap v16450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:49 smithi193 ceph-mon[32782]: pgmap v16450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:49 smithi196 ceph-mon[32572]: pgmap v16450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:51 smithi110 ceph-mon[28069]: pgmap v16451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:51 smithi193 ceph-mon[32782]: pgmap v16451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:51 smithi196 ceph-mon[32572]: pgmap v16451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30467.443375 secs 2024-04-26T20:15:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30467.443375 secs 2024-04-26T20:15:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30467.443375 secs 2024-04-26T20:15:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:53 smithi193 ceph-mon[32782]: pgmap v16452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:53 smithi196 ceph-mon[32572]: pgmap v16452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:53 smithi110 ceph-mon[28069]: pgmap v16452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:55 smithi193 ceph-mon[32782]: pgmap v16453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:55 smithi196 ceph-mon[32572]: pgmap v16453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:55 smithi110 ceph-mon[28069]: pgmap v16453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:15:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:57 smithi193 ceph-mon[32782]: pgmap v16454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30472.443475 secs 2024-04-26T20:15:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:57 smithi196 ceph-mon[32572]: pgmap v16454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30472.443475 secs 2024-04-26T20:15:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:57 smithi110 ceph-mon[28069]: pgmap v16454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:15:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30472.443475 secs 2024-04-26T20:15:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:15:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:15:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:15:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:59 smithi193 ceph-mon[32782]: pgmap v16455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:15:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:15:59 smithi193 ceph-mon[32782]: pgmap v16456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:59 smithi196 ceph-mon[32572]: pgmap v16455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:16:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:15:59 smithi196 ceph-mon[32572]: pgmap v16456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:59 smithi110 ceph-mon[28069]: pgmap v16455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:16:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:15:59 smithi110 ceph-mon[28069]: pgmap v16456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:01 smithi193 ceph-mon[32782]: pgmap v16457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:01 smithi196 ceph-mon[32572]: pgmap v16457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:01 smithi110 ceph-mon[28069]: pgmap v16457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30477.443556 secs 2024-04-26T20:16:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30477.443556 secs 2024-04-26T20:16:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30477.443556 secs 2024-04-26T20:16:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:03 smithi193 ceph-mon[32782]: pgmap v16458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:03 smithi196 ceph-mon[32572]: pgmap v16458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:03 smithi110 ceph-mon[28069]: pgmap v16458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:05 smithi193 ceph-mon[32782]: pgmap v16459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:05 smithi196 ceph-mon[32572]: pgmap v16459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:05 smithi110 ceph-mon[28069]: pgmap v16459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:07 smithi193 ceph-mon[32782]: pgmap v16460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30482.443673 secs 2024-04-26T20:16:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:07 smithi196 ceph-mon[32572]: pgmap v16460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30482.443673 secs 2024-04-26T20:16:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:07 smithi110 ceph-mon[28069]: pgmap v16460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:16:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30482.443673 secs 2024-04-26T20:16:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:09 smithi193 ceph-mon[32782]: pgmap v16461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:16:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:09 smithi196 ceph-mon[32572]: pgmap v16461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:16:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:09 smithi110 ceph-mon[28069]: pgmap v16461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:16:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:11 smithi193 ceph-mon[32782]: pgmap v16462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:11 smithi196 ceph-mon[32572]: pgmap v16462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:11 smithi110 ceph-mon[28069]: pgmap v16462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30487.443791 secs 2024-04-26T20:16:12.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30487.443791 secs 2024-04-26T20:16:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30487.443791 secs 2024-04-26T20:16:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:13 smithi193 ceph-mon[32782]: pgmap v16463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:13 smithi196 ceph-mon[32572]: pgmap v16463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:13 smithi110 ceph-mon[28069]: pgmap v16463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:15 smithi196 ceph-mon[32572]: pgmap v16464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:15 smithi110 ceph-mon[28069]: pgmap v16464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:15 smithi193 ceph-mon[32782]: pgmap v16464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:17.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:17 smithi193 ceph-mon[32782]: pgmap v16465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:17.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30492.443912 secs 2024-04-26T20:16:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:17 smithi196 ceph-mon[32572]: pgmap v16465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30492.443912 secs 2024-04-26T20:16:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:17 smithi110 ceph-mon[28069]: pgmap v16465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30492.443912 secs 2024-04-26T20:16:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:19 smithi196 ceph-mon[32572]: pgmap v16466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:19 smithi110 ceph-mon[28069]: pgmap v16466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:19 smithi193 ceph-mon[32782]: pgmap v16466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:21 smithi196 ceph-mon[32572]: pgmap v16467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:21 smithi110 ceph-mon[28069]: pgmap v16467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:21 smithi193 ceph-mon[32782]: pgmap v16467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:22.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30497.444033 secs 2024-04-26T20:16:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30497.444033 secs 2024-04-26T20:16:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30497.444033 secs 2024-04-26T20:16:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:23 smithi196 ceph-mon[32572]: pgmap v16468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:23 smithi110 ceph-mon[28069]: pgmap v16468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:23 smithi193 ceph-mon[32782]: pgmap v16468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:25 smithi196 ceph-mon[32572]: pgmap v16469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:25 smithi110 ceph-mon[28069]: pgmap v16469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:25 smithi193 ceph-mon[32782]: pgmap v16469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:27 smithi196 ceph-mon[32572]: pgmap v16470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30502.444171 secs 2024-04-26T20:16:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:27 smithi110 ceph-mon[28069]: pgmap v16470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30502.444171 secs 2024-04-26T20:16:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:27 smithi193 ceph-mon[32782]: pgmap v16470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30502.444171 secs 2024-04-26T20:16:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:29 smithi196 ceph-mon[32572]: pgmap v16471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:29 smithi110 ceph-mon[28069]: pgmap v16471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:29 smithi193 ceph-mon[32782]: pgmap v16471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:31 smithi196 ceph-mon[32572]: pgmap v16472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:31 smithi110 ceph-mon[28069]: pgmap v16472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:31 smithi193 ceph-mon[32782]: pgmap v16472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30507.444311 secs 2024-04-26T20:16:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30507.444311 secs 2024-04-26T20:16:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30507.444311 secs 2024-04-26T20:16:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:33 smithi196 ceph-mon[32572]: pgmap v16473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:33 smithi110 ceph-mon[28069]: pgmap v16473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:33 smithi193 ceph-mon[32782]: pgmap v16473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:35 smithi196 ceph-mon[32572]: pgmap v16474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:35 smithi110 ceph-mon[28069]: pgmap v16474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:35 smithi193 ceph-mon[32782]: pgmap v16474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:37 smithi196 ceph-mon[32572]: pgmap v16475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30512.444443 secs 2024-04-26T20:16:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:37 smithi110 ceph-mon[28069]: pgmap v16475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30512.444443 secs 2024-04-26T20:16:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:37 smithi193 ceph-mon[32782]: pgmap v16475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30512.444443 secs 2024-04-26T20:16:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:39 smithi196 ceph-mon[32572]: pgmap v16476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:39 smithi110 ceph-mon[28069]: pgmap v16476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:39 smithi193 ceph-mon[32782]: pgmap v16476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:41 smithi196 ceph-mon[32572]: pgmap v16477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:41 smithi110 ceph-mon[28069]: pgmap v16477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:41 smithi193 ceph-mon[32782]: pgmap v16477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30517.444582 secs 2024-04-26T20:16:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30517.444582 secs 2024-04-26T20:16:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30517.444582 secs 2024-04-26T20:16:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:43 smithi196 ceph-mon[32572]: pgmap v16478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:43 smithi110 ceph-mon[28069]: pgmap v16478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:43 smithi193 ceph-mon[32782]: pgmap v16478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:45 smithi196 ceph-mon[32572]: pgmap v16479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:45 smithi110 ceph-mon[28069]: pgmap v16479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:45 smithi193 ceph-mon[32782]: pgmap v16479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:47 smithi196 ceph-mon[32572]: pgmap v16480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30522.444735 secs 2024-04-26T20:16:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:47 smithi110 ceph-mon[28069]: pgmap v16480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30522.444735 secs 2024-04-26T20:16:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:47 smithi193 ceph-mon[32782]: pgmap v16480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30522.444735 secs 2024-04-26T20:16:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:49 smithi196 ceph-mon[32572]: pgmap v16481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:49 smithi110 ceph-mon[28069]: pgmap v16481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:49 smithi193 ceph-mon[32782]: pgmap v16481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:51 smithi196 ceph-mon[32572]: pgmap v16482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:51 smithi110 ceph-mon[28069]: pgmap v16482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:51 smithi193 ceph-mon[32782]: pgmap v16482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30527.444800 secs 2024-04-26T20:16:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30527.444800 secs 2024-04-26T20:16:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30527.444800 secs 2024-04-26T20:16:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:53 smithi196 ceph-mon[32572]: pgmap v16483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:53 smithi110 ceph-mon[28069]: pgmap v16483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:53 smithi193 ceph-mon[32782]: pgmap v16483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:55 smithi110 ceph-mon[28069]: pgmap v16484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:55 smithi193 ceph-mon[32782]: pgmap v16484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:55 smithi196 ceph-mon[32572]: pgmap v16484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:16:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:57 smithi110 ceph-mon[28069]: pgmap v16485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30532.444919 secs 2024-04-26T20:16:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:57 smithi193 ceph-mon[32782]: pgmap v16485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30532.444919 secs 2024-04-26T20:16:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:57 smithi196 ceph-mon[32572]: pgmap v16485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:16:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30532.444919 secs 2024-04-26T20:16:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:59 smithi110 ceph-mon[28069]: pgmap v16486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:16:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:17:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:59 smithi193 ceph-mon[32782]: pgmap v16486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:16:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:17:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:59 smithi196 ceph-mon[32572]: pgmap v16486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:16:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:17:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:00 smithi110 ceph-mon[28069]: pgmap v16487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T20:17:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:00 smithi110 ceph-mon[28069]: pgmap v16488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:00 smithi193 ceph-mon[32782]: pgmap v16487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T20:17:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:00 smithi193 ceph-mon[32782]: pgmap v16488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:00 smithi196 ceph-mon[32572]: pgmap v16487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T20:17:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:00 smithi196 ceph-mon[32572]: pgmap v16488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:01 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30537.445014 secs 2024-04-26T20:17:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:01 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30537.445014 secs 2024-04-26T20:17:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:01 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30537.445014 secs 2024-04-26T20:17:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:02 smithi193 ceph-mon[32782]: pgmap v16489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:02 smithi196 ceph-mon[32572]: pgmap v16489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:02 smithi110 ceph-mon[28069]: pgmap v16489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:04 smithi193 ceph-mon[32782]: pgmap v16490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:04 smithi196 ceph-mon[32572]: pgmap v16490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:04 smithi110 ceph-mon[28069]: pgmap v16490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:06 smithi193 ceph-mon[32782]: pgmap v16491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:06 smithi196 ceph-mon[32572]: pgmap v16491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:06 smithi110 ceph-mon[28069]: pgmap v16491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30542.445133 secs 2024-04-26T20:17:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30542.445133 secs 2024-04-26T20:17:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30542.445133 secs 2024-04-26T20:17:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:08 smithi193 ceph-mon[32782]: pgmap v16492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:08 smithi196 ceph-mon[32572]: pgmap v16492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:08 smithi110 ceph-mon[28069]: pgmap v16492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:17:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:10 smithi193 ceph-mon[32782]: pgmap v16493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:17:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:10 smithi196 ceph-mon[32572]: pgmap v16493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:17:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:10 smithi110 ceph-mon[28069]: pgmap v16493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:17:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:12 smithi193 ceph-mon[32782]: pgmap v16494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30547.445281 secs 2024-04-26T20:17:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:12 smithi196 ceph-mon[32572]: pgmap v16494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30547.445281 secs 2024-04-26T20:17:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:12 smithi110 ceph-mon[28069]: pgmap v16494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30547.445281 secs 2024-04-26T20:17:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:14 smithi193 ceph-mon[32782]: pgmap v16495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:14 smithi196 ceph-mon[32572]: pgmap v16495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:14 smithi110 ceph-mon[28069]: pgmap v16495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:16 smithi193 ceph-mon[32782]: pgmap v16496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:16 smithi196 ceph-mon[32572]: pgmap v16496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:16 smithi110 ceph-mon[28069]: pgmap v16496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30552.445400 secs 2024-04-26T20:17:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30552.445400 secs 2024-04-26T20:17:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30552.445400 secs 2024-04-26T20:17:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:18 smithi196 ceph-mon[32572]: pgmap v16497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:18 smithi110 ceph-mon[28069]: pgmap v16497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:18 smithi193 ceph-mon[32782]: pgmap v16497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:20 smithi196 ceph-mon[32572]: pgmap v16498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:20 smithi110 ceph-mon[28069]: pgmap v16498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:20 smithi193 ceph-mon[32782]: pgmap v16498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:22 smithi196 ceph-mon[32572]: pgmap v16499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30557.445476 secs 2024-04-26T20:17:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:22 smithi110 ceph-mon[28069]: pgmap v16499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30557.445476 secs 2024-04-26T20:17:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:22 smithi193 ceph-mon[32782]: pgmap v16499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30557.445476 secs 2024-04-26T20:17:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:24 smithi196 ceph-mon[32572]: pgmap v16500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:24 smithi110 ceph-mon[28069]: pgmap v16500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:24 smithi193 ceph-mon[32782]: pgmap v16500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:26 smithi196 ceph-mon[32572]: pgmap v16501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:26 smithi110 ceph-mon[28069]: pgmap v16501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:26 smithi193 ceph-mon[32782]: pgmap v16501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30562.445593 secs 2024-04-26T20:17:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30562.445593 secs 2024-04-26T20:17:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30562.445593 secs 2024-04-26T20:17:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:28 smithi196 ceph-mon[32572]: pgmap v16502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:28 smithi110 ceph-mon[28069]: pgmap v16502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:28 smithi193 ceph-mon[32782]: pgmap v16502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:30 smithi196 ceph-mon[32572]: pgmap v16503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:30 smithi110 ceph-mon[28069]: pgmap v16503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:30 smithi193 ceph-mon[32782]: pgmap v16503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:32 smithi196 ceph-mon[32572]: pgmap v16504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30567.445714 secs 2024-04-26T20:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:32 smithi110 ceph-mon[28069]: pgmap v16504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30567.445714 secs 2024-04-26T20:17:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:32 smithi193 ceph-mon[32782]: pgmap v16504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30567.445714 secs 2024-04-26T20:17:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:34 smithi196 ceph-mon[32572]: pgmap v16505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:34 smithi110 ceph-mon[28069]: pgmap v16505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:34 smithi193 ceph-mon[32782]: pgmap v16505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:36 smithi196 ceph-mon[32572]: pgmap v16506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:36 smithi110 ceph-mon[28069]: pgmap v16506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:36 smithi193 ceph-mon[32782]: pgmap v16506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30572.445833 secs 2024-04-26T20:17:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30572.445833 secs 2024-04-26T20:17:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30572.445833 secs 2024-04-26T20:17:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:38 smithi196 ceph-mon[32572]: pgmap v16507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:38 smithi110 ceph-mon[28069]: pgmap v16507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:38 smithi193 ceph-mon[32782]: pgmap v16507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:40 smithi196 ceph-mon[32572]: pgmap v16508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:40 smithi110 ceph-mon[28069]: pgmap v16508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:40 smithi193 ceph-mon[32782]: pgmap v16508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:42 smithi196 ceph-mon[32572]: pgmap v16509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30577.445954 secs 2024-04-26T20:17:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:42 smithi110 ceph-mon[28069]: pgmap v16509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30577.445954 secs 2024-04-26T20:17:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:42 smithi193 ceph-mon[32782]: pgmap v16509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30577.445954 secs 2024-04-26T20:17:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:44 smithi196 ceph-mon[32572]: pgmap v16510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:44 smithi110 ceph-mon[28069]: pgmap v16510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:44 smithi193 ceph-mon[32782]: pgmap v16510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:46 smithi196 ceph-mon[32572]: pgmap v16511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:46 smithi110 ceph-mon[28069]: pgmap v16511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:46 smithi193 ceph-mon[32782]: pgmap v16511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30582.446072 secs 2024-04-26T20:17:48.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30582.446072 secs 2024-04-26T20:17:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30582.446072 secs 2024-04-26T20:17:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:48 smithi196 ceph-mon[32572]: pgmap v16512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:48 smithi110 ceph-mon[28069]: pgmap v16512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:48 smithi193 ceph-mon[32782]: pgmap v16512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:50 smithi196 ceph-mon[32572]: pgmap v16513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:50 smithi110 ceph-mon[28069]: pgmap v16513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:50 smithi193 ceph-mon[32782]: pgmap v16513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:52 smithi196 ceph-mon[32572]: pgmap v16514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30587.446160 secs 2024-04-26T20:17:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:52 smithi110 ceph-mon[28069]: pgmap v16514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30587.446160 secs 2024-04-26T20:17:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:52 smithi193 ceph-mon[32782]: pgmap v16514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30587.446160 secs 2024-04-26T20:17:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:54 smithi196 ceph-mon[32572]: pgmap v16515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:54 smithi110 ceph-mon[28069]: pgmap v16515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:54 smithi193 ceph-mon[32782]: pgmap v16515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:56 smithi196 ceph-mon[32572]: pgmap v16516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:56 smithi110 ceph-mon[28069]: pgmap v16516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:56 smithi193 ceph-mon[32782]: pgmap v16516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:17:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30592.446282 secs 2024-04-26T20:17:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30592.446282 secs 2024-04-26T20:17:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30592.446282 secs 2024-04-26T20:17:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:17:58 smithi110 ceph-mon[28069]: pgmap v16517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:17:58 smithi193 ceph-mon[32782]: pgmap v16517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:17:59.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:17:58 smithi196 ceph-mon[32572]: pgmap v16517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:00 smithi110 ceph-mon[28069]: pgmap v16518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:00 smithi193 ceph-mon[32782]: pgmap v16518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:00 smithi196 ceph-mon[32572]: pgmap v16518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:02.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:18:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:18:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:18:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:02 smithi110 ceph-mon[28069]: pgmap v16519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:18:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:02 smithi110 ceph-mon[28069]: pgmap v16520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30597.446401 secs 2024-04-26T20:18:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:02 smithi193 ceph-mon[32782]: pgmap v16519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:18:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:02 smithi193 ceph-mon[32782]: pgmap v16520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30597.446401 secs 2024-04-26T20:18:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:02 smithi196 ceph-mon[32572]: pgmap v16519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:18:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:02 smithi196 ceph-mon[32572]: pgmap v16520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30597.446401 secs 2024-04-26T20:18:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:04 smithi110 ceph-mon[28069]: pgmap v16521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:04 smithi193 ceph-mon[32782]: pgmap v16521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:04 smithi196 ceph-mon[32572]: pgmap v16521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:06 smithi193 ceph-mon[32782]: pgmap v16522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:06 smithi196 ceph-mon[32572]: pgmap v16522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:06 smithi110 ceph-mon[28069]: pgmap v16522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:07 smithi193 ceph-mon[32782]: 23 slow requests, 1 included below; oldest blocked for > 30602.446547 secs 2024-04-26T20:18:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:07 smithi193 ceph-mon[32782]: slow request 23042.840116 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:18:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:07 smithi196 ceph-mon[32572]: 23 slow requests, 1 included below; oldest blocked for > 30602.446547 secs 2024-04-26T20:18:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:07 smithi196 ceph-mon[32572]: slow request 23042.840116 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:18:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:07 smithi110 ceph-mon[28069]: 23 slow requests, 1 included below; oldest blocked for > 30602.446547 secs 2024-04-26T20:18:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:07 smithi110 ceph-mon[28069]: slow request 23042.840116 seconds old, received at 2024-04-26T13:54:03.904752+0000: client_request(client.26776:1 getattr pAsLsXsFs #0x1 2024-04-26T13:54:03.899965+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:18:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:08 smithi193 ceph-mon[32782]: pgmap v16523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:18:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:08 smithi196 ceph-mon[32572]: pgmap v16523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:18:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:08 smithi110 ceph-mon[28069]: pgmap v16523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:18:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:10 smithi193 ceph-mon[32782]: pgmap v16524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:10 smithi196 ceph-mon[32572]: pgmap v16524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:10 smithi110 ceph-mon[28069]: pgmap v16524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:18:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:11 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30607.446661 secs 2024-04-26T20:18:12.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:11 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30607.446661 secs 2024-04-26T20:18:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:11 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30607.446661 secs 2024-04-26T20:18:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:12 smithi193 ceph-mon[32782]: pgmap v16525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:18:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:12 smithi196 ceph-mon[32572]: pgmap v16525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:18:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:12 smithi110 ceph-mon[28069]: pgmap v16525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:18:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:14 smithi193 ceph-mon[32782]: pgmap v16526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:14 smithi196 ceph-mon[32572]: pgmap v16526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:14 smithi110 ceph-mon[28069]: pgmap v16526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.461+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T20:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.461+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.461+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.461+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T20:18:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.462+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.463+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T20:18:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.463+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T20:18:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.471+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900003439) for more than 900000000 us, fault. 2024-04-26T20:18:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.471+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614036000 comp rx=0 tx=0).stop 2024-04-26T20:18:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.471+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T20:18:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.471+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.471+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.472+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:16.474+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614059070 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:16 smithi193 ceph-mon[32782]: pgmap v16527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:16 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30612.446778 secs 2024-04-26T20:18:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:16 smithi196 ceph-mon[32572]: pgmap v16527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:16 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30612.446778 secs 2024-04-26T20:18:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:16 smithi110 ceph-mon[28069]: pgmap v16527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:16 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30612.446778 secs 2024-04-26T20:18:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:18 smithi193 ceph-mon[32782]: pgmap v16528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:18 smithi196 ceph-mon[32572]: pgmap v16528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:18 smithi110 ceph-mon[28069]: pgmap v16528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:20 smithi193 ceph-mon[32782]: pgmap v16529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:20 smithi196 ceph-mon[32572]: pgmap v16529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:20 smithi110 ceph-mon[28069]: pgmap v16529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:21.442+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:18:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:21.442+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:18:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:21.442+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 236 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:18:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:18:21.442+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 236 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:18:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:21 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30617.446858 secs 2024-04-26T20:18:22.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:21 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30617.446858 secs 2024-04-26T20:18:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:21 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30617.446858 secs 2024-04-26T20:18:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:22 smithi193 ceph-mon[32782]: pgmap v16530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:22 smithi196 ceph-mon[32572]: pgmap v16530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:22 smithi110 ceph-mon[28069]: pgmap v16530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:24 smithi193 ceph-mon[32782]: pgmap v16531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:24 smithi196 ceph-mon[32572]: pgmap v16531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:25.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:24 smithi110 ceph-mon[28069]: pgmap v16531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:26 smithi193 ceph-mon[32782]: pgmap v16532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:26 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30622.446983 secs 2024-04-26T20:18:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:26 smithi196 ceph-mon[32572]: pgmap v16532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:26 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30622.446983 secs 2024-04-26T20:18:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:26 smithi110 ceph-mon[28069]: pgmap v16532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:26 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30622.446983 secs 2024-04-26T20:18:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:28 smithi196 ceph-mon[32572]: pgmap v16533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:28 smithi110 ceph-mon[28069]: pgmap v16533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:28 smithi193 ceph-mon[32782]: pgmap v16533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:30 smithi196 ceph-mon[32572]: pgmap v16534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:30 smithi110 ceph-mon[28069]: pgmap v16534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:30 smithi193 ceph-mon[32782]: pgmap v16534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:31 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30627.447117 secs 2024-04-26T20:18:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:31 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30627.447117 secs 2024-04-26T20:18:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:31 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30627.447117 secs 2024-04-26T20:18:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:32 smithi196 ceph-mon[32572]: pgmap v16535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:32 smithi110 ceph-mon[28069]: pgmap v16535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:32 smithi193 ceph-mon[32782]: pgmap v16535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:34 smithi196 ceph-mon[32572]: pgmap v16536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:34 smithi110 ceph-mon[28069]: pgmap v16536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:34 smithi193 ceph-mon[32782]: pgmap v16536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:36 smithi196 ceph-mon[32572]: pgmap v16537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:36 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30632.447213 secs 2024-04-26T20:18:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:36 smithi110 ceph-mon[28069]: pgmap v16537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:36 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30632.447213 secs 2024-04-26T20:18:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:36 smithi193 ceph-mon[32782]: pgmap v16537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:36 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30632.447213 secs 2024-04-26T20:18:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:38 smithi196 ceph-mon[32572]: pgmap v16538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:38 smithi110 ceph-mon[28069]: pgmap v16538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:38 smithi193 ceph-mon[32782]: pgmap v16538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:40 smithi196 ceph-mon[32572]: pgmap v16539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:40 smithi110 ceph-mon[28069]: pgmap v16539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:40 smithi193 ceph-mon[32782]: pgmap v16539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:41 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30637.447364 secs 2024-04-26T20:18:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:41 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30637.447364 secs 2024-04-26T20:18:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:41 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30637.447364 secs 2024-04-26T20:18:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:42 smithi196 ceph-mon[32572]: pgmap v16540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:42 smithi110 ceph-mon[28069]: pgmap v16540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:42 smithi193 ceph-mon[32782]: pgmap v16540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:43 smithi196 ceph-mon[32572]: pgmap v16541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:43 smithi110 ceph-mon[28069]: pgmap v16541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:43 smithi193 ceph-mon[32782]: pgmap v16541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:46 smithi196 ceph-mon[32572]: pgmap v16542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:46 smithi110 ceph-mon[28069]: pgmap v16542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:46 smithi193 ceph-mon[32782]: pgmap v16542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30642.447440 secs 2024-04-26T20:18:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30642.447440 secs 2024-04-26T20:18:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30642.447440 secs 2024-04-26T20:18:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:48 smithi196 ceph-mon[32572]: pgmap v16543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:48.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:48 smithi193 ceph-mon[32782]: pgmap v16543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:48 smithi110 ceph-mon[28069]: pgmap v16543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:50 smithi196 ceph-mon[32572]: pgmap v16544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:50 smithi110 ceph-mon[28069]: pgmap v16544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:50 smithi193 ceph-mon[32782]: pgmap v16544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:52 smithi196 ceph-mon[32572]: pgmap v16545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30647.447548 secs 2024-04-26T20:18:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:52 smithi110 ceph-mon[28069]: pgmap v16545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30647.447548 secs 2024-04-26T20:18:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:52 smithi193 ceph-mon[32782]: pgmap v16545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30647.447548 secs 2024-04-26T20:18:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:54 smithi196 ceph-mon[32572]: pgmap v16546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:54 smithi110 ceph-mon[28069]: pgmap v16546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:54 smithi193 ceph-mon[32782]: pgmap v16546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:18:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:56 smithi196 ceph-mon[32572]: pgmap v16547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:56 smithi110 ceph-mon[28069]: pgmap v16547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:56 smithi193 ceph-mon[32782]: pgmap v16547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30652.447668 secs 2024-04-26T20:18:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30652.447668 secs 2024-04-26T20:18:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30652.447668 secs 2024-04-26T20:18:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:18:58 smithi196 ceph-mon[32572]: pgmap v16548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:18:58 smithi110 ceph-mon[28069]: pgmap v16548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:18:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:18:58 smithi193 ceph-mon[32782]: pgmap v16548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:00 smithi196 ceph-mon[32572]: pgmap v16549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:00.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:00 smithi110 ceph-mon[28069]: pgmap v16549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:00 smithi193 ceph-mon[32782]: pgmap v16549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:02 smithi196 ceph-mon[32572]: pgmap v16550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30657.447756 secs 2024-04-26T20:19:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:19:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:02 smithi110 ceph-mon[28069]: pgmap v16550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30657.447756 secs 2024-04-26T20:19:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:19:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:02 smithi193 ceph-mon[32782]: pgmap v16550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30657.447756 secs 2024-04-26T20:19:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:19:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:19:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:19:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:19:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:04 smithi110 ceph-mon[28069]: pgmap v16551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:04 smithi110 ceph-mon[28069]: pgmap v16552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T20:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:04 smithi110 ceph-mon[28069]: pgmap v16553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:04.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:19:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:04 smithi193 ceph-mon[32782]: pgmap v16551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:04 smithi193 ceph-mon[32782]: pgmap v16552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T20:19:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:04 smithi193 ceph-mon[32782]: pgmap v16553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:19:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:04 smithi196 ceph-mon[32572]: pgmap v16551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:04 smithi196 ceph-mon[32572]: pgmap v16552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T20:19:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:04 smithi196 ceph-mon[32572]: pgmap v16553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:19:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:06 smithi193 ceph-mon[32782]: pgmap v16554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:06 smithi196 ceph-mon[32572]: pgmap v16554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:06 smithi110 ceph-mon[28069]: pgmap v16554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30662.447881 secs 2024-04-26T20:19:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30662.447881 secs 2024-04-26T20:19:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30662.447881 secs 2024-04-26T20:19:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:08 smithi196 ceph-mon[32572]: pgmap v16555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:08 smithi110 ceph-mon[28069]: pgmap v16555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:08 smithi193 ceph-mon[32782]: pgmap v16555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:10 smithi110 ceph-mon[28069]: pgmap v16556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:10 smithi193 ceph-mon[32782]: pgmap v16556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:10 smithi196 ceph-mon[32572]: pgmap v16556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:12 smithi110 ceph-mon[28069]: pgmap v16557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T20:19:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30667.447945 secs 2024-04-26T20:19:12.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:12 smithi196 ceph-mon[32572]: pgmap v16557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T20:19:12.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30667.447945 secs 2024-04-26T20:19:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:12 smithi193 ceph-mon[32782]: pgmap v16557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T20:19:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30667.447945 secs 2024-04-26T20:19:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:14 smithi110 ceph-mon[28069]: pgmap v16558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:19:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:14 smithi193 ceph-mon[32782]: pgmap v16558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:19:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:14 smithi196 ceph-mon[32572]: pgmap v16558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:19:15.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:19:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:19:15.050+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:19:15.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:19:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:19:15.050+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:19:15.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:19:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:19:15.050+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:19:15.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:19:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:19:15.050+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:19:15.543 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:19:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:19:15.050+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:19:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:16 smithi193 ceph-mon[32782]: pgmap v16559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:16 smithi196 ceph-mon[32572]: pgmap v16559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:16 smithi110 ceph-mon[28069]: pgmap v16559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30672.448041 secs 2024-04-26T20:19:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30672.448041 secs 2024-04-26T20:19:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30672.448041 secs 2024-04-26T20:19:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:18 smithi193 ceph-mon[32782]: pgmap v16560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:19:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:18 smithi196 ceph-mon[32572]: pgmap v16560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:19:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:18 smithi110 ceph-mon[28069]: pgmap v16560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:19:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:20 smithi193 ceph-mon[32782]: pgmap v16561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:19:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:20 smithi196 ceph-mon[32572]: pgmap v16561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:19:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:20 smithi110 ceph-mon[28069]: pgmap v16561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:19:22.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:22 smithi110 ceph-mon[28069]: pgmap v16562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:19:22.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30677.448111 secs 2024-04-26T20:19:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:22 smithi193 ceph-mon[32782]: pgmap v16562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:19:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30677.448111 secs 2024-04-26T20:19:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:22 smithi196 ceph-mon[32572]: pgmap v16562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:19:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30677.448111 secs 2024-04-26T20:19:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:24 smithi193 ceph-mon[32782]: pgmap v16563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:19:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:24 smithi196 ceph-mon[32572]: pgmap v16563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:19:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:24 smithi110 ceph-mon[28069]: pgmap v16563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:19:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:26 smithi193 ceph-mon[32782]: pgmap v16564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:19:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:26 smithi196 ceph-mon[32572]: pgmap v16564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:19:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:26 smithi110 ceph-mon[28069]: pgmap v16564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:19:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30682.448244 secs 2024-04-26T20:19:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30682.448244 secs 2024-04-26T20:19:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30682.448244 secs 2024-04-26T20:19:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:28 smithi193 ceph-mon[32782]: pgmap v16565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:19:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:28 smithi196 ceph-mon[32572]: pgmap v16565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:19:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:28 smithi110 ceph-mon[28069]: pgmap v16565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:19:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:30 smithi193 ceph-mon[32782]: pgmap v16566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:30 smithi196 ceph-mon[32572]: pgmap v16566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:30 smithi110 ceph-mon[28069]: pgmap v16566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:32 smithi193 ceph-mon[32782]: pgmap v16567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30687.448306 secs 2024-04-26T20:19:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:32 smithi196 ceph-mon[32572]: pgmap v16567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30687.448306 secs 2024-04-26T20:19:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:32 smithi110 ceph-mon[28069]: pgmap v16567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30687.448306 secs 2024-04-26T20:19:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:34 smithi193 ceph-mon[32782]: pgmap v16568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:34 smithi196 ceph-mon[32572]: pgmap v16568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:34 smithi110 ceph-mon[28069]: pgmap v16568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:36 smithi193 ceph-mon[32782]: pgmap v16569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:36 smithi196 ceph-mon[32572]: pgmap v16569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:36 smithi110 ceph-mon[28069]: pgmap v16569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30692.448427 secs 2024-04-26T20:19:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30692.448427 secs 2024-04-26T20:19:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30692.448427 secs 2024-04-26T20:19:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:38 smithi193 ceph-mon[32782]: pgmap v16570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:39.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:38 smithi196 ceph-mon[32572]: pgmap v16570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:38 smithi110 ceph-mon[28069]: pgmap v16570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:40 smithi196 ceph-mon[32572]: pgmap v16571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:40 smithi110 ceph-mon[28069]: pgmap v16571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:40 smithi193 ceph-mon[32782]: pgmap v16571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:42 smithi196 ceph-mon[32572]: pgmap v16572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30697.448551 secs 2024-04-26T20:19:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:42 smithi110 ceph-mon[28069]: pgmap v16572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30697.448551 secs 2024-04-26T20:19:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:42 smithi193 ceph-mon[32782]: pgmap v16572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30697.448551 secs 2024-04-26T20:19:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:44 smithi196 ceph-mon[32572]: pgmap v16573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:44 smithi110 ceph-mon[28069]: pgmap v16573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:44 smithi193 ceph-mon[32782]: pgmap v16573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:46 smithi196 ceph-mon[32572]: pgmap v16574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:46 smithi110 ceph-mon[28069]: pgmap v16574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:46 smithi193 ceph-mon[32782]: pgmap v16574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30702.448634 secs 2024-04-26T20:19:48.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30702.448634 secs 2024-04-26T20:19:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30702.448634 secs 2024-04-26T20:19:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:48 smithi196 ceph-mon[32572]: pgmap v16575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:48 smithi110 ceph-mon[28069]: pgmap v16575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:48 smithi193 ceph-mon[32782]: pgmap v16575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:50 smithi196 ceph-mon[32572]: pgmap v16576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:50 smithi110 ceph-mon[28069]: pgmap v16576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:50 smithi193 ceph-mon[32782]: pgmap v16576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:19:51.456+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:19:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:19:51.456+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:19:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:19:51.457+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 237 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:19:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:19:51.457+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 237 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:19:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:52 smithi196 ceph-mon[32572]: pgmap v16577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30707.448751 secs 2024-04-26T20:19:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:52 smithi110 ceph-mon[28069]: pgmap v16577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30707.448751 secs 2024-04-26T20:19:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:52 smithi193 ceph-mon[32782]: pgmap v16577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30707.448751 secs 2024-04-26T20:19:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:54 smithi196 ceph-mon[32572]: pgmap v16578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:54 smithi110 ceph-mon[28069]: pgmap v16578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:54 smithi193 ceph-mon[32782]: pgmap v16578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:56 smithi196 ceph-mon[32572]: pgmap v16579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:56 smithi110 ceph-mon[28069]: pgmap v16579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:56 smithi193 ceph-mon[32782]: pgmap v16579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:19:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30712.448871 secs 2024-04-26T20:19:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30712.448871 secs 2024-04-26T20:19:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30712.448871 secs 2024-04-26T20:19:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:19:58 smithi196 ceph-mon[32572]: pgmap v16580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:19:58 smithi110 ceph-mon[28069]: pgmap v16580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:19:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:19:58 smithi193 ceph-mon[32782]: pgmap v16580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:00 smithi196 ceph-mon[32572]: pgmap v16581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:20:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:00 smithi110 ceph-mon[28069]: pgmap v16581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:20:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:00 smithi193 ceph-mon[32782]: pgmap v16581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:20:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:02 smithi196 ceph-mon[32572]: pgmap v16582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30717.448953 secs 2024-04-26T20:20:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:02 smithi110 ceph-mon[28069]: pgmap v16582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30717.448953 secs 2024-04-26T20:20:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:02 smithi193 ceph-mon[32782]: pgmap v16582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30717.448953 secs 2024-04-26T20:20:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:04 smithi196 ceph-mon[32572]: pgmap v16583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:04 smithi110 ceph-mon[28069]: pgmap v16583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:04 smithi193 ceph-mon[32782]: pgmap v16583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:20:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:06 smithi196 ceph-mon[32572]: pgmap v16584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T20:20:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:06 smithi196 ceph-mon[32572]: pgmap v16585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:06 smithi110 ceph-mon[28069]: pgmap v16584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T20:20:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:06 smithi110 ceph-mon[28069]: pgmap v16585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:06 smithi193 ceph-mon[32782]: pgmap v16584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T20:20:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:06 smithi193 ceph-mon[32782]: pgmap v16585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30722.449088 secs 2024-04-26T20:20:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30722.449088 secs 2024-04-26T20:20:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30722.449088 secs 2024-04-26T20:20:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:08 smithi196 ceph-mon[32572]: pgmap v16586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T20:20:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:08 smithi110 ceph-mon[28069]: pgmap v16586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T20:20:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:08 smithi193 ceph-mon[32782]: pgmap v16586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T20:20:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:10 smithi196 ceph-mon[32572]: pgmap v16587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:10 smithi110 ceph-mon[28069]: pgmap v16587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:10 smithi193 ceph-mon[32782]: pgmap v16587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:12 smithi196 ceph-mon[32572]: pgmap v16588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30727.449225 secs 2024-04-26T20:20:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:12 smithi110 ceph-mon[28069]: pgmap v16588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30727.449225 secs 2024-04-26T20:20:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:12 smithi193 ceph-mon[32782]: pgmap v16588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30727.449225 secs 2024-04-26T20:20:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:14 smithi196 ceph-mon[32572]: pgmap v16589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:14 smithi110 ceph-mon[28069]: pgmap v16589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:14 smithi193 ceph-mon[32782]: pgmap v16589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:20:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:16 smithi196 ceph-mon[32572]: pgmap v16590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:20:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:16 smithi110 ceph-mon[28069]: pgmap v16590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:20:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:16 smithi193 ceph-mon[32782]: pgmap v16590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:20:18.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30732.449314 secs 2024-04-26T20:20:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30732.449314 secs 2024-04-26T20:20:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30732.449314 secs 2024-04-26T20:20:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:18 smithi110 ceph-mon[28069]: pgmap v16591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:18 smithi193 ceph-mon[32782]: pgmap v16591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:18 smithi196 ceph-mon[32572]: pgmap v16591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:20 smithi110 ceph-mon[28069]: pgmap v16592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:20 smithi193 ceph-mon[32782]: pgmap v16592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:20 smithi196 ceph-mon[32572]: pgmap v16592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:22 smithi110 ceph-mon[28069]: pgmap v16593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30737.449431 secs 2024-04-26T20:20:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:22 smithi193 ceph-mon[32782]: pgmap v16593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30737.449431 secs 2024-04-26T20:20:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:22 smithi196 ceph-mon[32572]: pgmap v16593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30737.449431 secs 2024-04-26T20:20:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:24 smithi110 ceph-mon[28069]: pgmap v16594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:24 smithi193 ceph-mon[32782]: pgmap v16594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:24 smithi196 ceph-mon[32572]: pgmap v16594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:26 smithi110 ceph-mon[28069]: pgmap v16595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:26 smithi193 ceph-mon[32782]: pgmap v16595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:26 smithi196 ceph-mon[32572]: pgmap v16595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30742.449550 secs 2024-04-26T20:20:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30742.449550 secs 2024-04-26T20:20:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30742.449550 secs 2024-04-26T20:20:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:28 smithi193 ceph-mon[32782]: pgmap v16596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:28 smithi196 ceph-mon[32572]: pgmap v16596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:28 smithi110 ceph-mon[28069]: pgmap v16596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:30 smithi193 ceph-mon[32782]: pgmap v16597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:30 smithi196 ceph-mon[32572]: pgmap v16597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:30 smithi110 ceph-mon[28069]: pgmap v16597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:32 smithi193 ceph-mon[32782]: pgmap v16598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30747.449666 secs 2024-04-26T20:20:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:32 smithi196 ceph-mon[32572]: pgmap v16598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30747.449666 secs 2024-04-26T20:20:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:32 smithi110 ceph-mon[28069]: pgmap v16598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30747.449666 secs 2024-04-26T20:20:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:34 smithi193 ceph-mon[32782]: pgmap v16599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:34 smithi196 ceph-mon[32572]: pgmap v16599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:34 smithi110 ceph-mon[28069]: pgmap v16599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:36 smithi193 ceph-mon[32782]: pgmap v16600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:36 smithi196 ceph-mon[32572]: pgmap v16600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:36 smithi110 ceph-mon[28069]: pgmap v16600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30752.449783 secs 2024-04-26T20:20:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30752.449783 secs 2024-04-26T20:20:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30752.449783 secs 2024-04-26T20:20:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:38 smithi193 ceph-mon[32782]: pgmap v16601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:38 smithi196 ceph-mon[32572]: pgmap v16601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:38 smithi110 ceph-mon[28069]: pgmap v16601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:40 smithi193 ceph-mon[32782]: pgmap v16602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:40 smithi196 ceph-mon[32572]: pgmap v16602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:40 smithi110 ceph-mon[28069]: pgmap v16602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:41 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30757.449902 secs 2024-04-26T20:20:42.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:41 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30757.449902 secs 2024-04-26T20:20:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:41 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30757.449902 secs 2024-04-26T20:20:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:42 smithi193 ceph-mon[32782]: pgmap v16603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:42 smithi196 ceph-mon[32572]: pgmap v16603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:42 smithi110 ceph-mon[28069]: pgmap v16603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:44 smithi193 ceph-mon[32782]: pgmap v16604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:44 smithi196 ceph-mon[32572]: pgmap v16604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:44 smithi110 ceph-mon[28069]: pgmap v16604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:46 smithi193 ceph-mon[32782]: pgmap v16605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:46 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30762.450023 secs 2024-04-26T20:20:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:46 smithi196 ceph-mon[32572]: pgmap v16605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:46 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30762.450023 secs 2024-04-26T20:20:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:46 smithi110 ceph-mon[28069]: pgmap v16605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:46 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30762.450023 secs 2024-04-26T20:20:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:48 smithi193 ceph-mon[32782]: pgmap v16606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:48 smithi196 ceph-mon[32572]: pgmap v16606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:48 smithi110 ceph-mon[28069]: pgmap v16606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:50 smithi193 ceph-mon[32782]: pgmap v16607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:50 smithi196 ceph-mon[32572]: pgmap v16607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:50 smithi110 ceph-mon[28069]: pgmap v16607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:52.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:51 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30767.450159 secs 2024-04-26T20:20:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:51 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30767.450159 secs 2024-04-26T20:20:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:51 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30767.450159 secs 2024-04-26T20:20:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:52 smithi196 ceph-mon[32572]: pgmap v16608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:52 smithi110 ceph-mon[28069]: pgmap v16608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:52 smithi193 ceph-mon[32782]: pgmap v16608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:54 smithi196 ceph-mon[32572]: pgmap v16609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:54 smithi110 ceph-mon[28069]: pgmap v16609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:54 smithi193 ceph-mon[32782]: pgmap v16609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:20:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:56 smithi196 ceph-mon[32572]: pgmap v16610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:56 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30772.450274 secs 2024-04-26T20:20:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:56 smithi110 ceph-mon[28069]: pgmap v16610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:56 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30772.450274 secs 2024-04-26T20:20:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:56 smithi193 ceph-mon[32782]: pgmap v16610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:56 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30772.450274 secs 2024-04-26T20:20:59.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:20:58 smithi196 ceph-mon[32572]: pgmap v16611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:20:58 smithi110 ceph-mon[28069]: pgmap v16611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:20:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:20:58 smithi193 ceph-mon[32782]: pgmap v16611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:00 smithi196 ceph-mon[32572]: pgmap v16612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:00 smithi110 ceph-mon[28069]: pgmap v16612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:00 smithi193 ceph-mon[32782]: pgmap v16612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:01 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30777.450410 secs 2024-04-26T20:21:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:01 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30777.450410 secs 2024-04-26T20:21:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:01 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30777.450410 secs 2024-04-26T20:21:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:02 smithi196 ceph-mon[32572]: pgmap v16613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:21:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:02 smithi110 ceph-mon[28069]: pgmap v16613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:21:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:02 smithi193 ceph-mon[32782]: pgmap v16613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:21:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:04 smithi196 ceph-mon[32572]: pgmap v16614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:04 smithi110 ceph-mon[28069]: pgmap v16614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:04 smithi193 ceph-mon[32782]: pgmap v16614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:06.248 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:06 smithi110 ceph-mon[28069]: pgmap v16615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:21:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:06 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30782.450475 secs 2024-04-26T20:21:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:06 smithi196 ceph-mon[32572]: pgmap v16615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:21:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:06 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30782.450475 secs 2024-04-26T20:21:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:06 smithi193 ceph-mon[32782]: pgmap v16615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:21:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:06 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30782.450475 secs 2024-04-26T20:21:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: pgmap v16616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:21:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: pgmap v16616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:21:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: pgmap v16616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:21:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:08.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:21:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:21:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:21:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:21:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:09.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:09.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:09.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:21:09.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:21:09.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:09.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:10 smithi196 ceph-mon[32572]: pgmap v16617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:10 smithi110 ceph-mon[28069]: pgmap v16617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:10 smithi193 ceph-mon[32782]: pgmap v16617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: pgmap v16618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: pgmap v16619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:11.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:11.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:11.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: pgmap v16618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T20:21:11.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: pgmap v16619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:11.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:21:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:21:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:21:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: pgmap v16618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T20:21:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: pgmap v16619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:11.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:21:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30787.450596 secs 2024-04-26T20:21:12.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30787.450596 secs 2024-04-26T20:21:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30787.450596 secs 2024-04-26T20:21:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:13 smithi196 ceph-mon[32572]: pgmap v16620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:13 smithi110 ceph-mon[28069]: pgmap v16620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:13 smithi193 ceph-mon[32782]: pgmap v16620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:15 smithi193 ceph-mon[32782]: pgmap v16621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:15 smithi196 ceph-mon[32572]: pgmap v16621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:15 smithi110 ceph-mon[28069]: pgmap v16621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:17 smithi193 ceph-mon[32782]: pgmap v16622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30792.450713 secs 2024-04-26T20:21:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:17 smithi196 ceph-mon[32572]: pgmap v16622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30792.450713 secs 2024-04-26T20:21:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:17 smithi110 ceph-mon[28069]: pgmap v16622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30792.450713 secs 2024-04-26T20:21:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:19 smithi193 ceph-mon[32782]: pgmap v16623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:19 smithi196 ceph-mon[32572]: pgmap v16623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:19 smithi110 ceph-mon[28069]: pgmap v16623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:21:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:21:21.472+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:21:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:21:21.472+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:21:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:21:21.473+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 238 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:21:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:21:21.473+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 238 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:21:22.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:21 smithi110 ceph-mon[28069]: pgmap v16624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:21:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:21 smithi193 ceph-mon[32782]: pgmap v16624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:21:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:21 smithi196 ceph-mon[32572]: pgmap v16624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:21:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30797.450802 secs 2024-04-26T20:21:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30797.450802 secs 2024-04-26T20:21:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30797.450802 secs 2024-04-26T20:21:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:23 smithi110 ceph-mon[28069]: pgmap v16625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:23 smithi193 ceph-mon[32782]: pgmap v16625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:23 smithi196 ceph-mon[32572]: pgmap v16625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:25 smithi193 ceph-mon[32782]: pgmap v16626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:25 smithi196 ceph-mon[32572]: pgmap v16626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:25 smithi110 ceph-mon[28069]: pgmap v16626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:26 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30802.450925 secs 2024-04-26T20:21:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:26 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30802.450925 secs 2024-04-26T20:21:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:26 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30802.450925 secs 2024-04-26T20:21:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:27 smithi193 ceph-mon[32782]: pgmap v16627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:27 smithi196 ceph-mon[32572]: pgmap v16627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:27 smithi110 ceph-mon[28069]: pgmap v16627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:29 smithi193 ceph-mon[32782]: pgmap v16628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:29 smithi196 ceph-mon[32572]: pgmap v16628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:29 smithi110 ceph-mon[28069]: pgmap v16628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:31 smithi193 ceph-mon[32782]: pgmap v16629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:31 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30807.451058 secs 2024-04-26T20:21:32.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:31 smithi196 ceph-mon[32572]: pgmap v16629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:32.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:31 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30807.451058 secs 2024-04-26T20:21:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:31 smithi110 ceph-mon[28069]: pgmap v16629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:31 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30807.451058 secs 2024-04-26T20:21:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:33 smithi193 ceph-mon[32782]: pgmap v16630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:33 smithi196 ceph-mon[32572]: pgmap v16630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:33 smithi110 ceph-mon[28069]: pgmap v16630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:35 smithi193 ceph-mon[32782]: pgmap v16631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:35 smithi196 ceph-mon[32572]: pgmap v16631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:35 smithi110 ceph-mon[28069]: pgmap v16631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:36 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30812.451150 secs 2024-04-26T20:21:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:36 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30812.451150 secs 2024-04-26T20:21:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:36 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30812.451150 secs 2024-04-26T20:21:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:37 smithi196 ceph-mon[32572]: pgmap v16632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-04-26T20:21:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:37 smithi110 ceph-mon[28069]: pgmap v16632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-04-26T20:21:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:37 smithi193 ceph-mon[32782]: pgmap v16632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-04-26T20:21:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:39 smithi196 ceph-mon[32572]: pgmap v16633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:39 smithi110 ceph-mon[28069]: pgmap v16633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:39 smithi193 ceph-mon[32782]: pgmap v16633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:41 smithi196 ceph-mon[32572]: pgmap v16634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:41 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30817.451294 secs 2024-04-26T20:21:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:41 smithi110 ceph-mon[28069]: pgmap v16634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:41 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30817.451294 secs 2024-04-26T20:21:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:41 smithi193 ceph-mon[32782]: pgmap v16634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:42.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:41 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30817.451294 secs 2024-04-26T20:21:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:43 smithi196 ceph-mon[32572]: pgmap v16635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:43 smithi110 ceph-mon[28069]: pgmap v16635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:43 smithi193 ceph-mon[32782]: pgmap v16635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:45 smithi196 ceph-mon[32572]: pgmap v16636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:45 smithi110 ceph-mon[28069]: pgmap v16636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:45 smithi193 ceph-mon[32782]: pgmap v16636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:46 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30822.451438 secs 2024-04-26T20:21:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:46 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30822.451438 secs 2024-04-26T20:21:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:46 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30822.451438 secs 2024-04-26T20:21:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:47 smithi196 ceph-mon[32572]: pgmap v16637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:47 smithi110 ceph-mon[28069]: pgmap v16637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:47 smithi193 ceph-mon[32782]: pgmap v16637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:50.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:49 smithi193 ceph-mon[32782]: pgmap v16638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:49 smithi196 ceph-mon[32572]: pgmap v16638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:49 smithi110 ceph-mon[28069]: pgmap v16638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:51 smithi196 ceph-mon[32572]: pgmap v16639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:51 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30827.451603 secs 2024-04-26T20:21:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:51 smithi110 ceph-mon[28069]: pgmap v16639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:51 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30827.451603 secs 2024-04-26T20:21:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:51 smithi193 ceph-mon[32782]: pgmap v16639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:51 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30827.451603 secs 2024-04-26T20:21:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:53 smithi196 ceph-mon[32572]: pgmap v16640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:53 smithi110 ceph-mon[28069]: pgmap v16640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:53 smithi193 ceph-mon[32782]: pgmap v16640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:21:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:55 smithi196 ceph-mon[32572]: pgmap v16641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:55 smithi110 ceph-mon[28069]: pgmap v16641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:55 smithi193 ceph-mon[32782]: pgmap v16641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:56 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30832.451670 secs 2024-04-26T20:21:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:56 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30832.451670 secs 2024-04-26T20:21:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:56 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30832.451670 secs 2024-04-26T20:21:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:57 smithi196 ceph-mon[32572]: pgmap v16642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:57 smithi110 ceph-mon[28069]: pgmap v16642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:21:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:57 smithi193 ceph-mon[32782]: pgmap v16642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:21:59 smithi196 ceph-mon[32572]: pgmap v16643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:21:59 smithi110 ceph-mon[28069]: pgmap v16643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:21:59 smithi193 ceph-mon[32782]: pgmap v16643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:01 smithi196 ceph-mon[32572]: pgmap v16644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:01 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30837.451754 secs 2024-04-26T20:22:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:01 smithi110 ceph-mon[28069]: pgmap v16644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:01 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30837.451754 secs 2024-04-26T20:22:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:01 smithi193 ceph-mon[32782]: pgmap v16644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:01 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30837.451754 secs 2024-04-26T20:22:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:03 smithi196 ceph-mon[32572]: pgmap v16645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:03 smithi110 ceph-mon[28069]: pgmap v16645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:03 smithi193 ceph-mon[32782]: pgmap v16645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:05 smithi196 ceph-mon[32572]: pgmap v16646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:05 smithi110 ceph-mon[28069]: pgmap v16646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:05 smithi193 ceph-mon[32782]: pgmap v16646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:06 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30842.451817 secs 2024-04-26T20:22:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:06 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30842.451817 secs 2024-04-26T20:22:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:06 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30842.451817 secs 2024-04-26T20:22:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:07 smithi196 ceph-mon[32572]: pgmap v16647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:07 smithi110 ceph-mon[28069]: pgmap v16647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:07 smithi193 ceph-mon[32782]: pgmap v16647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:08 smithi196 ceph-mon[32572]: pgmap v16648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:08 smithi110 ceph-mon[28069]: pgmap v16648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:08 smithi193 ceph-mon[32782]: pgmap v16648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:11 smithi196 ceph-mon[32572]: pgmap v16649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:11 smithi110 ceph-mon[28069]: pgmap v16649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:11 smithi193 ceph-mon[32782]: pgmap v16649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30847.451950 secs 2024-04-26T20:22:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:22:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30847.451950 secs 2024-04-26T20:22:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:22:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30847.451950 secs 2024-04-26T20:22:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:22:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:13 smithi196 ceph-mon[32572]: pgmap v16650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:22:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:13 smithi196 ceph-mon[32572]: pgmap v16651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T20:22:13.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:13 smithi110 ceph-mon[28069]: pgmap v16650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:22:13.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:13 smithi110 ceph-mon[28069]: pgmap v16651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T20:22:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:13 smithi193 ceph-mon[32782]: pgmap v16650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:22:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:13 smithi193 ceph-mon[32782]: pgmap v16651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T20:22:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:15 smithi196 ceph-mon[32572]: pgmap v16652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:15 smithi110 ceph-mon[28069]: pgmap v16652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:15 smithi193 ceph-mon[32782]: pgmap v16652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:17 smithi196 ceph-mon[32572]: pgmap v16653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30852.452038 secs 2024-04-26T20:22:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:17 smithi110 ceph-mon[28069]: pgmap v16653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30852.452038 secs 2024-04-26T20:22:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:17 smithi193 ceph-mon[32782]: pgmap v16653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30852.452038 secs 2024-04-26T20:22:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:19 smithi196 ceph-mon[32572]: pgmap v16654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:19 smithi110 ceph-mon[28069]: pgmap v16654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:19 smithi193 ceph-mon[32782]: pgmap v16654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:21 smithi196 ceph-mon[32572]: pgmap v16655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:21 smithi110 ceph-mon[28069]: pgmap v16655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:21 smithi193 ceph-mon[32782]: pgmap v16655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:22:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30857.452158 secs 2024-04-26T20:22:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30857.452158 secs 2024-04-26T20:22:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30857.452158 secs 2024-04-26T20:22:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:23 smithi196 ceph-mon[32572]: pgmap v16656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:22:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:23 smithi110 ceph-mon[28069]: pgmap v16656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:22:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:23 smithi193 ceph-mon[32782]: pgmap v16656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:22:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:25 smithi196 ceph-mon[32572]: pgmap v16657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:22:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:25 smithi110 ceph-mon[28069]: pgmap v16657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:22:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:25 smithi193 ceph-mon[32782]: pgmap v16657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:22:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:27 smithi196 ceph-mon[32572]: pgmap v16658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30862.452287 secs 2024-04-26T20:22:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:27 smithi110 ceph-mon[28069]: pgmap v16658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30862.452287 secs 2024-04-26T20:22:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:27 smithi193 ceph-mon[32782]: pgmap v16658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30862.452287 secs 2024-04-26T20:22:29.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:29 smithi196 ceph-mon[32572]: pgmap v16659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:29 smithi110 ceph-mon[28069]: pgmap v16659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:29 smithi193 ceph-mon[32782]: pgmap v16659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:31 smithi196 ceph-mon[32572]: pgmap v16660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:31 smithi110 ceph-mon[28069]: pgmap v16660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:31 smithi193 ceph-mon[32782]: pgmap v16660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30867.452410 secs 2024-04-26T20:22:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30867.452410 secs 2024-04-26T20:22:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30867.452410 secs 2024-04-26T20:22:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:33 smithi110 ceph-mon[28069]: pgmap v16661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:33 smithi193 ceph-mon[32782]: pgmap v16661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:33 smithi196 ceph-mon[32572]: pgmap v16661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:35 smithi110 ceph-mon[28069]: pgmap v16662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:22:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:35 smithi193 ceph-mon[32782]: pgmap v16662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:22:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:35 smithi196 ceph-mon[32572]: pgmap v16662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:22:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:37 smithi110 ceph-mon[28069]: pgmap v16663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30872.452533 secs 2024-04-26T20:22:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:37 smithi193 ceph-mon[32782]: pgmap v16663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30872.452533 secs 2024-04-26T20:22:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:37 smithi196 ceph-mon[32572]: pgmap v16663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30872.452533 secs 2024-04-26T20:22:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:39 smithi110 ceph-mon[28069]: pgmap v16664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:39 smithi193 ceph-mon[32782]: pgmap v16664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:39 smithi196 ceph-mon[32572]: pgmap v16664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:41 smithi110 ceph-mon[28069]: pgmap v16665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:41.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:41 smithi193 ceph-mon[32782]: pgmap v16665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:41 smithi196 ceph-mon[32572]: pgmap v16665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30877.452661 secs 2024-04-26T20:22:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30877.452661 secs 2024-04-26T20:22:42.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30877.452661 secs 2024-04-26T20:22:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:43 smithi110 ceph-mon[28069]: pgmap v16666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:43 smithi193 ceph-mon[32782]: pgmap v16666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:43 smithi196 ceph-mon[32572]: pgmap v16666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:45 smithi193 ceph-mon[32782]: pgmap v16667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:45 smithi196 ceph-mon[32572]: pgmap v16667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:45 smithi110 ceph-mon[28069]: pgmap v16667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:47 smithi193 ceph-mon[32782]: pgmap v16668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30882.452783 secs 2024-04-26T20:22:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:47 smithi196 ceph-mon[32572]: pgmap v16668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30882.452783 secs 2024-04-26T20:22:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:47 smithi110 ceph-mon[28069]: pgmap v16668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30882.452783 secs 2024-04-26T20:22:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:49 smithi193 ceph-mon[32782]: pgmap v16669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:49 smithi196 ceph-mon[32572]: pgmap v16669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:49 smithi110 ceph-mon[28069]: pgmap v16669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:22:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:51 smithi193 ceph-mon[32782]: pgmap v16670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:51 smithi196 ceph-mon[32572]: pgmap v16670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:51 smithi110 ceph-mon[28069]: pgmap v16670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30887.452892 secs 2024-04-26T20:22:52.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30887.452892 secs 2024-04-26T20:22:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30887.452892 secs 2024-04-26T20:22:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:53 smithi193 ceph-mon[32782]: pgmap v16671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T20:22:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:53 smithi196 ceph-mon[32572]: pgmap v16671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T20:22:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:53 smithi110 ceph-mon[28069]: pgmap v16671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T20:22:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:55 smithi193 ceph-mon[32782]: pgmap v16672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:55 smithi196 ceph-mon[32572]: pgmap v16672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:55 smithi110 ceph-mon[28069]: pgmap v16672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:57 smithi193 ceph-mon[32782]: pgmap v16673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30892.453016 secs 2024-04-26T20:22:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:57 smithi196 ceph-mon[32572]: pgmap v16673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30892.453016 secs 2024-04-26T20:22:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:57 smithi110 ceph-mon[28069]: pgmap v16673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:22:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30892.453016 secs 2024-04-26T20:22:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:22:59 smithi193 ceph-mon[32782]: pgmap v16674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:22:59 smithi196 ceph-mon[32572]: pgmap v16674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:22:59 smithi110 ceph-mon[28069]: pgmap v16674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:01 smithi193 ceph-mon[32782]: pgmap v16675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:01 smithi196 ceph-mon[32572]: pgmap v16675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:01 smithi110 ceph-mon[28069]: pgmap v16675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30897.453153 secs 2024-04-26T20:23:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30897.453153 secs 2024-04-26T20:23:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30897.453153 secs 2024-04-26T20:23:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:03 smithi193 ceph-mon[32782]: pgmap v16676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:03 smithi196 ceph-mon[32572]: pgmap v16676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:03 smithi110 ceph-mon[28069]: pgmap v16676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:05 smithi193 ceph-mon[32782]: pgmap v16677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:23:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:05 smithi196 ceph-mon[32572]: pgmap v16677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:23:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:05 smithi110 ceph-mon[28069]: pgmap v16677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:23:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:07 smithi193 ceph-mon[32782]: pgmap v16678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:07 smithi193 ceph-mon[32782]: 23 slow requests, 1 included below; oldest blocked for > 30902.453249 secs 2024-04-26T20:23:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:07 smithi193 ceph-mon[32782]: slow request 23042.750771 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:23:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:07 smithi196 ceph-mon[32572]: pgmap v16678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:07 smithi196 ceph-mon[32572]: 23 slow requests, 1 included below; oldest blocked for > 30902.453249 secs 2024-04-26T20:23:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:07 smithi196 ceph-mon[32572]: slow request 23042.750771 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:23:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:07 smithi110 ceph-mon[28069]: pgmap v16678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:07 smithi110 ceph-mon[28069]: 23 slow requests, 1 included below; oldest blocked for > 30902.453249 secs 2024-04-26T20:23:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:07 smithi110 ceph-mon[28069]: slow request 23042.750771 seconds old, received at 2024-04-26T13:59:04.000800+0000: client_request(client.26782:1 getattr pAsLsXsFs #0x1 2024-04-26T13:59:03.995455+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:23:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:09 smithi196 ceph-mon[32572]: pgmap v16679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:09 smithi110 ceph-mon[28069]: pgmap v16679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:09 smithi193 ceph-mon[32782]: pgmap v16679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:11 smithi196 ceph-mon[32572]: pgmap v16680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:11 smithi110 ceph-mon[28069]: pgmap v16680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:11 smithi193 ceph-mon[32782]: pgmap v16680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:12.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30907.453377 secs 2024-04-26T20:23:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30907.453377 secs 2024-04-26T20:23:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30907.453377 secs 2024-04-26T20:23:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:13 smithi196 ceph-mon[32572]: pgmap v16681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:13 smithi110 ceph-mon[28069]: pgmap v16681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:13 smithi193 ceph-mon[32782]: pgmap v16681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:14 smithi196 ceph-mon[32572]: pgmap v16682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 2 op/s 2024-04-26T20:23:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:14 smithi196 ceph-mon[32572]: pgmap v16683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:23:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:14 smithi110 ceph-mon[28069]: pgmap v16682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 2 op/s 2024-04-26T20:23:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:14 smithi110 ceph-mon[28069]: pgmap v16683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:23:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:14 smithi193 ceph-mon[32782]: pgmap v16682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 2 op/s 2024-04-26T20:23:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:14 smithi193 ceph-mon[32782]: pgmap v16683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:23:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:16 smithi110 ceph-mon[28069]: pgmap v16684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:16 smithi193 ceph-mon[32782]: pgmap v16684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:16 smithi196 ceph-mon[32572]: pgmap v16684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30912.453503 secs 2024-04-26T20:23:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30912.453503 secs 2024-04-26T20:23:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30912.453503 secs 2024-04-26T20:23:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:18 smithi110 ceph-mon[28069]: pgmap v16685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:18 smithi193 ceph-mon[32782]: pgmap v16685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:18 smithi196 ceph-mon[32572]: pgmap v16685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:20 smithi110 ceph-mon[28069]: pgmap v16686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:20 smithi193 ceph-mon[32782]: pgmap v16686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:20 smithi196 ceph-mon[32572]: pgmap v16686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:23:22.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:21 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30917.453639 secs 2024-04-26T20:23:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:21 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30917.453639 secs 2024-04-26T20:23:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:21 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30917.453639 secs 2024-04-26T20:23:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:22 smithi196 ceph-mon[32572]: pgmap v16687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:23:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:22 smithi110 ceph-mon[28069]: pgmap v16687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:23:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:22 smithi193 ceph-mon[32782]: pgmap v16687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:23:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:24 smithi110 ceph-mon[28069]: pgmap v16688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:23:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:24 smithi193 ceph-mon[32782]: pgmap v16688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:23:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:24 smithi196 ceph-mon[32572]: pgmap v16688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:23:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:26 smithi110 ceph-mon[28069]: pgmap v16689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:26 smithi193 ceph-mon[32782]: pgmap v16689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:26 smithi196 ceph-mon[32572]: pgmap v16689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30922.453764 secs 2024-04-26T20:23:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30922.453764 secs 2024-04-26T20:23:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30922.453764 secs 2024-04-26T20:23:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:28 smithi193 ceph-mon[32782]: pgmap v16690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:28 smithi196 ceph-mon[32572]: pgmap v16690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:28 smithi110 ceph-mon[28069]: pgmap v16690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:30 smithi110 ceph-mon[28069]: pgmap v16691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:30 smithi193 ceph-mon[32782]: pgmap v16691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:30 smithi196 ceph-mon[32572]: pgmap v16691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:31 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30927.453909 secs 2024-04-26T20:23:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:31 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30927.453909 secs 2024-04-26T20:23:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:31 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30927.453909 secs 2024-04-26T20:23:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:32 smithi196 ceph-mon[32572]: pgmap v16692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:32 smithi110 ceph-mon[28069]: pgmap v16692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:32 smithi193 ceph-mon[32782]: pgmap v16692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:34 smithi110 ceph-mon[28069]: pgmap v16693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:34 smithi193 ceph-mon[32782]: pgmap v16693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:34 smithi196 ceph-mon[32572]: pgmap v16693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:36 smithi110 ceph-mon[28069]: pgmap v16694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:36 smithi193 ceph-mon[32782]: pgmap v16694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:36 smithi196 ceph-mon[32572]: pgmap v16694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30932.454013 secs 2024-04-26T20:23:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30932.454013 secs 2024-04-26T20:23:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30932.454013 secs 2024-04-26T20:23:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:38 smithi110 ceph-mon[28069]: pgmap v16695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:38 smithi193 ceph-mon[32782]: pgmap v16695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:38 smithi196 ceph-mon[32572]: pgmap v16695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:40 smithi110 ceph-mon[28069]: pgmap v16696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:40 smithi193 ceph-mon[32782]: pgmap v16696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:40 smithi196 ceph-mon[32572]: pgmap v16696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:41 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30937.454140 secs 2024-04-26T20:23:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:41 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30937.454140 secs 2024-04-26T20:23:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:41 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30937.454140 secs 2024-04-26T20:23:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:42 smithi196 ceph-mon[32572]: pgmap v16697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:42 smithi110 ceph-mon[28069]: pgmap v16697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:42 smithi193 ceph-mon[32782]: pgmap v16697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:44 smithi110 ceph-mon[28069]: pgmap v16698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:44 smithi193 ceph-mon[32782]: pgmap v16698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:44 smithi196 ceph-mon[32572]: pgmap v16698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:46 smithi196 ceph-mon[32572]: pgmap v16699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:46 smithi110 ceph-mon[28069]: pgmap v16699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:46 smithi193 ceph-mon[32782]: pgmap v16699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30942.454280 secs 2024-04-26T20:23:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30942.454280 secs 2024-04-26T20:23:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30942.454280 secs 2024-04-26T20:23:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:48 smithi196 ceph-mon[32572]: pgmap v16700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:48 smithi110 ceph-mon[28069]: pgmap v16700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:48 smithi193 ceph-mon[32782]: pgmap v16700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:50 smithi110 ceph-mon[28069]: pgmap v16701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:50 smithi193 ceph-mon[32782]: pgmap v16701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:50 smithi196 ceph-mon[32572]: pgmap v16701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:52.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:51 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30947.454418 secs 2024-04-26T20:23:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:51 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30947.454418 secs 2024-04-26T20:23:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:51 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30947.454418 secs 2024-04-26T20:23:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:52 smithi196 ceph-mon[32572]: pgmap v16702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:52 smithi110 ceph-mon[28069]: pgmap v16702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:52 smithi193 ceph-mon[32782]: pgmap v16702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:54 smithi110 ceph-mon[28069]: pgmap v16703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:54 smithi193 ceph-mon[32782]: pgmap v16703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:54 smithi196 ceph-mon[32572]: pgmap v16703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:56 smithi110 ceph-mon[28069]: pgmap v16704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:56 smithi193 ceph-mon[32782]: pgmap v16704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:56 smithi196 ceph-mon[32572]: pgmap v16704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:23:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30952.454516 secs 2024-04-26T20:23:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30952.454516 secs 2024-04-26T20:23:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30952.454516 secs 2024-04-26T20:23:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:23:58 smithi193 ceph-mon[32782]: pgmap v16705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:23:58 smithi196 ceph-mon[32572]: pgmap v16705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:23:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:23:58 smithi110 ceph-mon[28069]: pgmap v16705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:00 smithi110 ceph-mon[28069]: pgmap v16706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:00 smithi193 ceph-mon[32782]: pgmap v16706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:00 smithi196 ceph-mon[32572]: pgmap v16706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:01 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30957.454648 secs 2024-04-26T20:24:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:01 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30957.454648 secs 2024-04-26T20:24:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:01 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30957.454648 secs 2024-04-26T20:24:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:02 smithi196 ceph-mon[32572]: pgmap v16707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:02 smithi110 ceph-mon[28069]: pgmap v16707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:02 smithi193 ceph-mon[32782]: pgmap v16707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:04 smithi110 ceph-mon[28069]: pgmap v16708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:04 smithi193 ceph-mon[32782]: pgmap v16708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:04 smithi196 ceph-mon[32572]: pgmap v16708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:06 smithi110 ceph-mon[28069]: pgmap v16709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:06 smithi193 ceph-mon[32782]: pgmap v16709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:06 smithi196 ceph-mon[32572]: pgmap v16709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30962.454775 secs 2024-04-26T20:24:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30962.454775 secs 2024-04-26T20:24:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30962.454775 secs 2024-04-26T20:24:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:08 smithi193 ceph-mon[32782]: pgmap v16710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:08 smithi196 ceph-mon[32572]: pgmap v16710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:08 smithi110 ceph-mon[28069]: pgmap v16710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:10 smithi110 ceph-mon[28069]: pgmap v16711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:10 smithi193 ceph-mon[32782]: pgmap v16711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:10 smithi196 ceph-mon[32572]: pgmap v16711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:11 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30967.454899 secs 2024-04-26T20:24:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:11 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30967.454899 secs 2024-04-26T20:24:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:11 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30967.454899 secs 2024-04-26T20:24:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:12 smithi196 ceph-mon[32572]: pgmap v16712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:12 smithi110 ceph-mon[28069]: pgmap v16712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:12 smithi193 ceph-mon[32782]: pgmap v16712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:14 smithi110 ceph-mon[28069]: pgmap v16713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:14.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:14 smithi193 ceph-mon[32782]: pgmap v16713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:14 smithi196 ceph-mon[32572]: pgmap v16713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:15.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:24:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:24:15.240+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:24:15.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:24:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:24:15.240+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:24:15.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:24:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:24:15.240+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:24:15.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:24:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:24:15.240+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:24:15.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:24:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:24:15.240+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:24:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:16 smithi193 ceph-mon[32782]: pgmap v16714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:24:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:16 smithi193 ceph-mon[32782]: pgmap v16715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:24:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:24:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:16 smithi196 ceph-mon[32572]: pgmap v16714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:24:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:16 smithi196 ceph-mon[32572]: pgmap v16715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:24:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:24:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:16 smithi110 ceph-mon[28069]: pgmap v16714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:24:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:16 smithi110 ceph-mon[28069]: pgmap v16715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:24:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:24:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30972.454982 secs 2024-04-26T20:24:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30972.454982 secs 2024-04-26T20:24:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30972.454982 secs 2024-04-26T20:24:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:18 smithi193 ceph-mon[32782]: pgmap v16716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:18 smithi196 ceph-mon[32572]: pgmap v16716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:18 smithi110 ceph-mon[28069]: pgmap v16716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:20 smithi193 ceph-mon[32782]: pgmap v16717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:20 smithi196 ceph-mon[32572]: pgmap v16717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:20 smithi110 ceph-mon[28069]: pgmap v16717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:21.502 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:24:21.502+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:24:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:24:21.502+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:24:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:24:21.503+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 239 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:24:21.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:24:21.503+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 239 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:24:22.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:22 smithi110 ceph-mon[28069]: pgmap v16718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:22.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30977.455127 secs 2024-04-26T20:24:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:22 smithi193 ceph-mon[32782]: pgmap v16718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30977.455127 secs 2024-04-26T20:24:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:22 smithi196 ceph-mon[32572]: pgmap v16718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30977.455127 secs 2024-04-26T20:24:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:24 smithi193 ceph-mon[32782]: pgmap v16719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:24 smithi196 ceph-mon[32572]: pgmap v16719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:24 smithi110 ceph-mon[28069]: pgmap v16719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 322 B/s wr, 16 op/s 2024-04-26T20:24:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:26 smithi193 ceph-mon[32782]: pgmap v16720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T20:24:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:26 smithi196 ceph-mon[32572]: pgmap v16720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T20:24:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:26 smithi110 ceph-mon[28069]: pgmap v16720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T20:24:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30982.455259 secs 2024-04-26T20:24:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30982.455259 secs 2024-04-26T20:24:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30982.455259 secs 2024-04-26T20:24:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:28 smithi193 ceph-mon[32782]: pgmap v16721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:24:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:28 smithi196 ceph-mon[32572]: pgmap v16721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:24:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:28 smithi110 ceph-mon[28069]: pgmap v16721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:24:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:30 smithi193 ceph-mon[32782]: pgmap v16722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:30 smithi196 ceph-mon[32572]: pgmap v16722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:30 smithi110 ceph-mon[28069]: pgmap v16722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:32 smithi193 ceph-mon[32782]: pgmap v16723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30987.455392 secs 2024-04-26T20:24:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:32 smithi196 ceph-mon[32572]: pgmap v16723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30987.455392 secs 2024-04-26T20:24:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:32 smithi110 ceph-mon[28069]: pgmap v16723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30987.455392 secs 2024-04-26T20:24:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:34 smithi193 ceph-mon[32782]: pgmap v16724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:34 smithi196 ceph-mon[32572]: pgmap v16724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:34 smithi110 ceph-mon[28069]: pgmap v16724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:36 smithi193 ceph-mon[32782]: pgmap v16725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:36 smithi196 ceph-mon[32572]: pgmap v16725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:36 smithi110 ceph-mon[28069]: pgmap v16725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30992.455531 secs 2024-04-26T20:24:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30992.455531 secs 2024-04-26T20:24:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30992.455531 secs 2024-04-26T20:24:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:38 smithi193 ceph-mon[32782]: pgmap v16726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:38 smithi196 ceph-mon[32572]: pgmap v16726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:38 smithi110 ceph-mon[28069]: pgmap v16726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:40 smithi193 ceph-mon[32782]: pgmap v16727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:40 smithi196 ceph-mon[32572]: pgmap v16727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:40 smithi110 ceph-mon[28069]: pgmap v16727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:42 smithi196 ceph-mon[32572]: pgmap v16728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 30997.455637 secs 2024-04-26T20:24:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:42 smithi110 ceph-mon[28069]: pgmap v16728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 30997.455637 secs 2024-04-26T20:24:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:42 smithi193 ceph-mon[32782]: pgmap v16728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 30997.455637 secs 2024-04-26T20:24:45.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:44 smithi196 ceph-mon[32572]: pgmap v16729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:44 smithi110 ceph-mon[28069]: pgmap v16729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:44 smithi193 ceph-mon[32782]: pgmap v16729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:46 smithi196 ceph-mon[32572]: pgmap v16730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:46 smithi110 ceph-mon[28069]: pgmap v16730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:46 smithi193 ceph-mon[32782]: pgmap v16730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31002.455765 secs 2024-04-26T20:24:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31002.455765 secs 2024-04-26T20:24:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31002.455765 secs 2024-04-26T20:24:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:48 smithi196 ceph-mon[32572]: pgmap v16731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:48 smithi110 ceph-mon[28069]: pgmap v16731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:48 smithi193 ceph-mon[32782]: pgmap v16731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:50 smithi196 ceph-mon[32572]: pgmap v16732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:50 smithi110 ceph-mon[28069]: pgmap v16732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:50 smithi193 ceph-mon[32782]: pgmap v16732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:52.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:52 smithi193 ceph-mon[32782]: pgmap v16733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:52.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31007.455879 secs 2024-04-26T20:24:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:52 smithi196 ceph-mon[32572]: pgmap v16733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31007.455879 secs 2024-04-26T20:24:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:52 smithi110 ceph-mon[28069]: pgmap v16733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31007.455879 secs 2024-04-26T20:24:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:54 smithi196 ceph-mon[32572]: pgmap v16734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:54 smithi110 ceph-mon[28069]: pgmap v16734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:54 smithi193 ceph-mon[32782]: pgmap v16734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:56 smithi196 ceph-mon[32572]: pgmap v16735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:56 smithi110 ceph-mon[28069]: pgmap v16735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:56 smithi193 ceph-mon[32782]: pgmap v16735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:24:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31012.455998 secs 2024-04-26T20:24:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31012.455998 secs 2024-04-26T20:24:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31012.455998 secs 2024-04-26T20:24:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:24:58 smithi196 ceph-mon[32572]: pgmap v16736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:24:58 smithi110 ceph-mon[28069]: pgmap v16736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:24:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:24:58 smithi193 ceph-mon[32782]: pgmap v16736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:00 smithi196 ceph-mon[32572]: pgmap v16737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:00 smithi110 ceph-mon[28069]: pgmap v16737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:00 smithi193 ceph-mon[32782]: pgmap v16737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:02 smithi196 ceph-mon[32572]: pgmap v16738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31017.456148 secs 2024-04-26T20:25:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:02 smithi110 ceph-mon[28069]: pgmap v16738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31017.456148 secs 2024-04-26T20:25:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:02 smithi193 ceph-mon[32782]: pgmap v16738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31017.456148 secs 2024-04-26T20:25:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:04 smithi196 ceph-mon[32572]: pgmap v16739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:25:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:04 smithi110 ceph-mon[28069]: pgmap v16739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:25:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:04 smithi193 ceph-mon[32782]: pgmap v16739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:25:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:06 smithi196 ceph-mon[32572]: pgmap v16740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:25:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:06 smithi110 ceph-mon[28069]: pgmap v16740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:25:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:06 smithi193 ceph-mon[32782]: pgmap v16740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:25:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31022.456296 secs 2024-04-26T20:25:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31022.456296 secs 2024-04-26T20:25:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31022.456296 secs 2024-04-26T20:25:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:08 smithi196 ceph-mon[32572]: pgmap v16741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:25:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:08 smithi110 ceph-mon[28069]: pgmap v16741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:25:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:08 smithi193 ceph-mon[32782]: pgmap v16741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:25:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:10 smithi196 ceph-mon[32572]: pgmap v16742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:25:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:10 smithi110 ceph-mon[28069]: pgmap v16742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:25:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:10 smithi193 ceph-mon[32782]: pgmap v16742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:25:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:12 smithi196 ceph-mon[32572]: pgmap v16743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:25:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31027.456391 secs 2024-04-26T20:25:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:12 smithi110 ceph-mon[28069]: pgmap v16743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:25:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31027.456391 secs 2024-04-26T20:25:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:12 smithi193 ceph-mon[32782]: pgmap v16743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:25:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31027.456391 secs 2024-04-26T20:25:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:14 smithi196 ceph-mon[32572]: pgmap v16744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:25:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:14 smithi110 ceph-mon[28069]: pgmap v16744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:25:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:14 smithi193 ceph-mon[32782]: pgmap v16744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:25:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:16 smithi196 ceph-mon[32572]: pgmap v16745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:16 smithi110 ceph-mon[28069]: pgmap v16745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:16 smithi193 ceph-mon[32782]: pgmap v16745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31032.456506 secs 2024-04-26T20:25:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:17 smithi196 ceph-mon[32572]: pgmap v16746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T20:25:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:17 smithi196 ceph-mon[32572]: pgmap v16747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:25:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:25:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31032.456506 secs 2024-04-26T20:25:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:17 smithi110 ceph-mon[28069]: pgmap v16746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T20:25:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:17 smithi110 ceph-mon[28069]: pgmap v16747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:25:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:25:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31032.456506 secs 2024-04-26T20:25:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:17 smithi193 ceph-mon[32782]: pgmap v16746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 1 op/s 2024-04-26T20:25:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:17 smithi193 ceph-mon[32782]: pgmap v16747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:25:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:25:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:19 smithi193 ceph-mon[32782]: pgmap v16748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:19 smithi196 ceph-mon[32572]: pgmap v16748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:19 smithi110 ceph-mon[28069]: pgmap v16748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:21 smithi193 ceph-mon[32782]: pgmap v16749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:21 smithi196 ceph-mon[32572]: pgmap v16749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:21 smithi110 ceph-mon[28069]: pgmap v16749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31037.456602 secs 2024-04-26T20:25:22.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31037.456602 secs 2024-04-26T20:25:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31037.456602 secs 2024-04-26T20:25:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:23 smithi193 ceph-mon[32782]: pgmap v16750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:23 smithi196 ceph-mon[32572]: pgmap v16750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:23 smithi110 ceph-mon[28069]: pgmap v16750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:25 smithi193 ceph-mon[32782]: pgmap v16751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:25 smithi196 ceph-mon[32572]: pgmap v16751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:25 smithi110 ceph-mon[28069]: pgmap v16751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:26 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31042.456725 secs 2024-04-26T20:25:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:26 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31042.456725 secs 2024-04-26T20:25:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:26 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31042.456725 secs 2024-04-26T20:25:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:27 smithi196 ceph-mon[32572]: pgmap v16752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:25:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:27 smithi110 ceph-mon[28069]: pgmap v16752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:25:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:27 smithi193 ceph-mon[32782]: pgmap v16752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:25:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:30 smithi193 ceph-mon[32782]: pgmap v16753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:30 smithi196 ceph-mon[32572]: pgmap v16753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:30 smithi110 ceph-mon[28069]: pgmap v16753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:32 smithi193 ceph-mon[32782]: pgmap v16754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31047.456849 secs 2024-04-26T20:25:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:32 smithi196 ceph-mon[32572]: pgmap v16754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31047.456849 secs 2024-04-26T20:25:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:32 smithi110 ceph-mon[28069]: pgmap v16754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31047.456849 secs 2024-04-26T20:25:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:34 smithi193 ceph-mon[32782]: pgmap v16755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:34 smithi196 ceph-mon[32572]: pgmap v16755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:34 smithi110 ceph-mon[28069]: pgmap v16755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:36 smithi193 ceph-mon[32782]: pgmap v16756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:36 smithi196 ceph-mon[32572]: pgmap v16756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:36 smithi110 ceph-mon[28069]: pgmap v16756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31052.456966 secs 2024-04-26T20:25:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31052.456966 secs 2024-04-26T20:25:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31052.456966 secs 2024-04-26T20:25:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:38 smithi193 ceph-mon[32782]: pgmap v16757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:38 smithi196 ceph-mon[32572]: pgmap v16757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:38 smithi110 ceph-mon[28069]: pgmap v16757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:40 smithi193 ceph-mon[32782]: pgmap v16758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:40 smithi196 ceph-mon[32572]: pgmap v16758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:40 smithi110 ceph-mon[28069]: pgmap v16758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:42 smithi193 ceph-mon[32782]: pgmap v16759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31057.457037 secs 2024-04-26T20:25:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:42 smithi196 ceph-mon[32572]: pgmap v16759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31057.457037 secs 2024-04-26T20:25:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:42 smithi110 ceph-mon[28069]: pgmap v16759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31057.457037 secs 2024-04-26T20:25:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:44 smithi193 ceph-mon[32782]: pgmap v16760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:44 smithi196 ceph-mon[32572]: pgmap v16760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:44 smithi110 ceph-mon[28069]: pgmap v16760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:46 smithi193 ceph-mon[32782]: pgmap v16761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:46 smithi196 ceph-mon[32572]: pgmap v16761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:46 smithi110 ceph-mon[28069]: pgmap v16761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31062.457149 secs 2024-04-26T20:25:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31062.457149 secs 2024-04-26T20:25:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31062.457149 secs 2024-04-26T20:25:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:48 smithi193 ceph-mon[32782]: pgmap v16762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:48 smithi196 ceph-mon[32572]: pgmap v16762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:48 smithi110 ceph-mon[28069]: pgmap v16762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:50 smithi196 ceph-mon[32572]: pgmap v16763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:50 smithi110 ceph-mon[28069]: pgmap v16763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:50 smithi193 ceph-mon[32782]: pgmap v16763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:52.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:52 smithi193 ceph-mon[32782]: pgmap v16764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:52.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31067.457294 secs 2024-04-26T20:25:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:52 smithi196 ceph-mon[32572]: pgmap v16764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31067.457294 secs 2024-04-26T20:25:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:52 smithi110 ceph-mon[28069]: pgmap v16764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31067.457294 secs 2024-04-26T20:25:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:54 smithi196 ceph-mon[32572]: pgmap v16765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:54 smithi110 ceph-mon[28069]: pgmap v16765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:54 smithi193 ceph-mon[32782]: pgmap v16765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:25:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:56 smithi196 ceph-mon[32572]: pgmap v16766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:56 smithi110 ceph-mon[28069]: pgmap v16766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:56 smithi193 ceph-mon[32782]: pgmap v16766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31072.457398 secs 2024-04-26T20:25:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31072.457398 secs 2024-04-26T20:25:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31072.457398 secs 2024-04-26T20:25:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:25:58 smithi196 ceph-mon[32572]: pgmap v16767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:25:58 smithi110 ceph-mon[28069]: pgmap v16767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:25:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:25:58 smithi193 ceph-mon[32782]: pgmap v16767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:00 smithi196 ceph-mon[32572]: pgmap v16768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:00 smithi110 ceph-mon[28069]: pgmap v16768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:00 smithi193 ceph-mon[32782]: pgmap v16768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:02 smithi196 ceph-mon[32572]: pgmap v16769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31077.457516 secs 2024-04-26T20:26:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:02 smithi110 ceph-mon[28069]: pgmap v16769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31077.457516 secs 2024-04-26T20:26:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:02 smithi193 ceph-mon[32782]: pgmap v16769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31077.457516 secs 2024-04-26T20:26:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:04 smithi196 ceph-mon[32572]: pgmap v16770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:04 smithi110 ceph-mon[28069]: pgmap v16770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:04 smithi193 ceph-mon[32782]: pgmap v16770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:06 smithi196 ceph-mon[32572]: pgmap v16771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:06.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:06 smithi110 ceph-mon[28069]: pgmap v16771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:06 smithi193 ceph-mon[32782]: pgmap v16771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31082.457633 secs 2024-04-26T20:26:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31082.457633 secs 2024-04-26T20:26:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31082.457633 secs 2024-04-26T20:26:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:08 smithi196 ceph-mon[32572]: pgmap v16772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:08 smithi110 ceph-mon[28069]: pgmap v16772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:08 smithi193 ceph-mon[32782]: pgmap v16772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:10 smithi196 ceph-mon[32572]: pgmap v16773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:10 smithi110 ceph-mon[28069]: pgmap v16773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:10 smithi193 ceph-mon[32782]: pgmap v16773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:12 smithi110 ceph-mon[28069]: pgmap v16774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31087.457750 secs 2024-04-26T20:26:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:12 smithi193 ceph-mon[32782]: pgmap v16774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31087.457750 secs 2024-04-26T20:26:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:12 smithi196 ceph-mon[32572]: pgmap v16774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31087.457750 secs 2024-04-26T20:26:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:14 smithi110 ceph-mon[28069]: pgmap v16775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:14 smithi193 ceph-mon[32782]: pgmap v16775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:14 smithi196 ceph-mon[32572]: pgmap v16775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:16 smithi110 ceph-mon[28069]: pgmap v16776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:16 smithi193 ceph-mon[32782]: pgmap v16776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:16 smithi196 ceph-mon[32572]: pgmap v16776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31092.457889 secs 2024-04-26T20:26:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31092.457889 secs 2024-04-26T20:26:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31092.457889 secs 2024-04-26T20:26:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:18 smithi110 ceph-mon[28069]: pgmap v16777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:18 smithi193 ceph-mon[32782]: pgmap v16777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:18 smithi196 ceph-mon[32572]: pgmap v16777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:19 smithi193 ceph-mon[32782]: pgmap v16778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:26:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:19 smithi193 ceph-mon[32782]: pgmap v16779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:26:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:19 smithi196 ceph-mon[32572]: pgmap v16778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:26:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:19 smithi196 ceph-mon[32572]: pgmap v16779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:26:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:19 smithi110 ceph-mon[28069]: pgmap v16778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:26:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:19 smithi110 ceph-mon[28069]: pgmap v16779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:20.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:26:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:21 smithi196 ceph-mon[32572]: pgmap v16780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:21 smithi110 ceph-mon[28069]: pgmap v16780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:21 smithi193 ceph-mon[32782]: pgmap v16780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:22.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31097.457955 secs 2024-04-26T20:26:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31097.457955 secs 2024-04-26T20:26:23.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31097.457955 secs 2024-04-26T20:26:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:23 smithi196 ceph-mon[32572]: pgmap v16781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:23 smithi110 ceph-mon[28069]: pgmap v16781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:23 smithi193 ceph-mon[32782]: pgmap v16781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:25 smithi196 ceph-mon[32572]: pgmap v16782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:25 smithi110 ceph-mon[28069]: pgmap v16782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:25 smithi193 ceph-mon[32782]: pgmap v16782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:27 smithi196 ceph-mon[32572]: pgmap v16783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31102.458072 secs 2024-04-26T20:26:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:27 smithi110 ceph-mon[28069]: pgmap v16783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31102.458072 secs 2024-04-26T20:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:27 smithi193 ceph-mon[32782]: pgmap v16783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:26:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31102.458072 secs 2024-04-26T20:26:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:29 smithi196 ceph-mon[32572]: pgmap v16784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:26:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:29 smithi110 ceph-mon[28069]: pgmap v16784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:26:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:29 smithi193 ceph-mon[32782]: pgmap v16784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:26:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:31 smithi196 ceph-mon[32572]: pgmap v16785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:31 smithi110 ceph-mon[28069]: pgmap v16785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:31 smithi193 ceph-mon[32782]: pgmap v16785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31107.458206 secs 2024-04-26T20:26:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31107.458206 secs 2024-04-26T20:26:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31107.458206 secs 2024-04-26T20:26:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:33 smithi196 ceph-mon[32572]: pgmap v16786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:33 smithi110 ceph-mon[28069]: pgmap v16786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:33 smithi193 ceph-mon[32782]: pgmap v16786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:35 smithi196 ceph-mon[32572]: pgmap v16787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:35 smithi110 ceph-mon[28069]: pgmap v16787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:35 smithi193 ceph-mon[32782]: pgmap v16787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:37 smithi196 ceph-mon[32572]: pgmap v16788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:37 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31112.458357 secs 2024-04-26T20:26:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:37 smithi110 ceph-mon[28069]: pgmap v16788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:37 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31112.458357 secs 2024-04-26T20:26:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:37 smithi193 ceph-mon[32782]: pgmap v16788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:37 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31112.458357 secs 2024-04-26T20:26:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:39 smithi196 ceph-mon[32572]: pgmap v16789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:39 smithi110 ceph-mon[28069]: pgmap v16789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:39 smithi193 ceph-mon[32782]: pgmap v16789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:41 smithi196 ceph-mon[32572]: pgmap v16790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:41 smithi110 ceph-mon[28069]: pgmap v16790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:41 smithi193 ceph-mon[32782]: pgmap v16790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:42 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31117.458493 secs 2024-04-26T20:26:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:42 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31117.458493 secs 2024-04-26T20:26:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:42 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31117.458493 secs 2024-04-26T20:26:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:43 smithi196 ceph-mon[32572]: pgmap v16791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:43 smithi110 ceph-mon[28069]: pgmap v16791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:43 smithi193 ceph-mon[32782]: pgmap v16791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:45 smithi196 ceph-mon[32572]: pgmap v16792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:45 smithi110 ceph-mon[28069]: pgmap v16792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:45 smithi193 ceph-mon[32782]: pgmap v16792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:47 smithi196 ceph-mon[32572]: pgmap v16793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31122.458590 secs 2024-04-26T20:26:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:47 smithi110 ceph-mon[28069]: pgmap v16793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31122.458590 secs 2024-04-26T20:26:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:47 smithi193 ceph-mon[32782]: pgmap v16793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31122.458590 secs 2024-04-26T20:26:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:49 smithi196 ceph-mon[32572]: pgmap v16794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:49 smithi110 ceph-mon[28069]: pgmap v16794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:49 smithi193 ceph-mon[32782]: pgmap v16794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:51 smithi196 ceph-mon[32572]: pgmap v16795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:51 smithi110 ceph-mon[28069]: pgmap v16795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:51 smithi193 ceph-mon[32782]: pgmap v16795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31127.458715 secs 2024-04-26T20:26:53.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31127.458715 secs 2024-04-26T20:26:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31127.458715 secs 2024-04-26T20:26:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:53 smithi196 ceph-mon[32572]: pgmap v16796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:53 smithi110 ceph-mon[28069]: pgmap v16796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:53 smithi193 ceph-mon[32782]: pgmap v16796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:26:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:55 smithi196 ceph-mon[32572]: pgmap v16797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:55 smithi110 ceph-mon[28069]: pgmap v16797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:55 smithi193 ceph-mon[32782]: pgmap v16797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:57 smithi196 ceph-mon[32572]: pgmap v16798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31132.458852 secs 2024-04-26T20:26:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:57 smithi110 ceph-mon[28069]: pgmap v16798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31132.458852 secs 2024-04-26T20:26:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:57 smithi193 ceph-mon[32782]: pgmap v16798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:26:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31132.458852 secs 2024-04-26T20:27:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:26:59 smithi196 ceph-mon[32572]: pgmap v16799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:26:59 smithi110 ceph-mon[28069]: pgmap v16799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:26:59 smithi193 ceph-mon[32782]: pgmap v16799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:01 smithi196 ceph-mon[32572]: pgmap v16800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:01 smithi110 ceph-mon[28069]: pgmap v16800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:01 smithi193 ceph-mon[32782]: pgmap v16800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31137.458944 secs 2024-04-26T20:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31137.458944 secs 2024-04-26T20:27:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31137.458944 secs 2024-04-26T20:27:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:03 smithi110 ceph-mon[28069]: pgmap v16801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:03 smithi193 ceph-mon[32782]: pgmap v16801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:03 smithi196 ceph-mon[32572]: pgmap v16801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:05 smithi110 ceph-mon[28069]: pgmap v16802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:05 smithi193 ceph-mon[32782]: pgmap v16802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:05 smithi196 ceph-mon[32572]: pgmap v16802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:07 smithi110 ceph-mon[28069]: pgmap v16803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31142.459046 secs 2024-04-26T20:27:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:07 smithi193 ceph-mon[32782]: pgmap v16803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31142.459046 secs 2024-04-26T20:27:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:07 smithi196 ceph-mon[32572]: pgmap v16803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31142.459046 secs 2024-04-26T20:27:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:09 smithi110 ceph-mon[28069]: pgmap v16804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:09 smithi193 ceph-mon[32782]: pgmap v16804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:09 smithi196 ceph-mon[32572]: pgmap v16804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:11 smithi110 ceph-mon[28069]: pgmap v16805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:11 smithi193 ceph-mon[32782]: pgmap v16805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:11 smithi196 ceph-mon[32572]: pgmap v16805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31147.459162 secs 2024-04-26T20:27:13.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31147.459162 secs 2024-04-26T20:27:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31147.459162 secs 2024-04-26T20:27:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:13 smithi193 ceph-mon[32782]: pgmap v16806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:13 smithi196 ceph-mon[32572]: pgmap v16806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:13 smithi110 ceph-mon[28069]: pgmap v16806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:15 smithi193 ceph-mon[32782]: pgmap v16807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:15 smithi196 ceph-mon[32572]: pgmap v16807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:15 smithi110 ceph-mon[28069]: pgmap v16807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:17 smithi193 ceph-mon[32782]: pgmap v16808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31152.459295 secs 2024-04-26T20:27:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:17 smithi196 ceph-mon[32572]: pgmap v16808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31152.459295 secs 2024-04-26T20:27:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:17 smithi110 ceph-mon[28069]: pgmap v16808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31152.459295 secs 2024-04-26T20:27:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:19 smithi193 ceph-mon[32782]: pgmap v16809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:19 smithi196 ceph-mon[32572]: pgmap v16809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:19 smithi110 ceph-mon[28069]: pgmap v16809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:27:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:27:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:27:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:27:21.532+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:27:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:27:21.532+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:27:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:27:21.533+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 240 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:27:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:27:21.533+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 240 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:27:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:21 smithi193 ceph-mon[32782]: pgmap v16810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T20:27:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:21 smithi193 ceph-mon[32782]: pgmap v16811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:22.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:21 smithi110 ceph-mon[28069]: pgmap v16810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T20:27:22.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:21 smithi110 ceph-mon[28069]: pgmap v16811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:21 smithi196 ceph-mon[32572]: pgmap v16810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T20:27:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:21 smithi196 ceph-mon[32572]: pgmap v16811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31157.459444 secs 2024-04-26T20:27:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31157.459444 secs 2024-04-26T20:27:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31157.459444 secs 2024-04-26T20:27:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:23 smithi193 ceph-mon[32782]: pgmap v16812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T20:27:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:23 smithi196 ceph-mon[32572]: pgmap v16812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T20:27:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:23 smithi110 ceph-mon[28069]: pgmap v16812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T20:27:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:25 smithi193 ceph-mon[32782]: pgmap v16813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:25 smithi196 ceph-mon[32572]: pgmap v16813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:25 smithi110 ceph-mon[28069]: pgmap v16813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:27 smithi193 ceph-mon[32782]: pgmap v16814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:27 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31162.459604 secs 2024-04-26T20:27:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:27 smithi196 ceph-mon[32572]: pgmap v16814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:27 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31162.459604 secs 2024-04-26T20:27:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:27 smithi110 ceph-mon[28069]: pgmap v16814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:27 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31162.459604 secs 2024-04-26T20:27:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:29 smithi193 ceph-mon[32782]: pgmap v16815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:29 smithi196 ceph-mon[32572]: pgmap v16815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:29 smithi110 ceph-mon[28069]: pgmap v16815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:27:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:31 smithi193 ceph-mon[32782]: pgmap v16816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:27:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:31 smithi196 ceph-mon[32572]: pgmap v16816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:27:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:31 smithi110 ceph-mon[28069]: pgmap v16816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:27:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:32 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31167.459724 secs 2024-04-26T20:27:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:32 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31167.459724 secs 2024-04-26T20:27:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:32 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31167.459724 secs 2024-04-26T20:27:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:33 smithi193 ceph-mon[32782]: pgmap v16817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:33 smithi196 ceph-mon[32572]: pgmap v16817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:33 smithi110 ceph-mon[28069]: pgmap v16817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:35 smithi196 ceph-mon[32572]: pgmap v16818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:35 smithi110 ceph-mon[28069]: pgmap v16818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:35 smithi193 ceph-mon[32782]: pgmap v16818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:36 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31172.459836 secs 2024-04-26T20:27:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:36 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31172.459836 secs 2024-04-26T20:27:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:36 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31172.459836 secs 2024-04-26T20:27:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:37 smithi196 ceph-mon[32572]: pgmap v16819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:37 smithi110 ceph-mon[28069]: pgmap v16819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:37 smithi193 ceph-mon[32782]: pgmap v16819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:39 smithi196 ceph-mon[32572]: pgmap v16820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:39 smithi110 ceph-mon[28069]: pgmap v16820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:39 smithi193 ceph-mon[32782]: pgmap v16820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:41 smithi196 ceph-mon[32572]: pgmap v16821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:41 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31177.459945 secs 2024-04-26T20:27:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:41 smithi110 ceph-mon[28069]: pgmap v16821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:41 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31177.459945 secs 2024-04-26T20:27:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:41 smithi193 ceph-mon[32782]: pgmap v16821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:41 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31177.459945 secs 2024-04-26T20:27:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:43 smithi196 ceph-mon[32572]: pgmap v16822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:43 smithi110 ceph-mon[28069]: pgmap v16822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:43 smithi193 ceph-mon[32782]: pgmap v16822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:45 smithi196 ceph-mon[32572]: pgmap v16823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:45 smithi110 ceph-mon[28069]: pgmap v16823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:45 smithi193 ceph-mon[32782]: pgmap v16823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:46 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31182.460029 secs 2024-04-26T20:27:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:46 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31182.460029 secs 2024-04-26T20:27:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:46 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31182.460029 secs 2024-04-26T20:27:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:47 smithi196 ceph-mon[32572]: pgmap v16824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:47 smithi110 ceph-mon[28069]: pgmap v16824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:47 smithi193 ceph-mon[32782]: pgmap v16824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:49 smithi196 ceph-mon[32572]: pgmap v16825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:49 smithi110 ceph-mon[28069]: pgmap v16825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:49 smithi193 ceph-mon[32782]: pgmap v16825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:51 smithi196 ceph-mon[32572]: pgmap v16826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:51 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31187.460161 secs 2024-04-26T20:27:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:51 smithi110 ceph-mon[28069]: pgmap v16826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:51 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31187.460161 secs 2024-04-26T20:27:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:51 smithi193 ceph-mon[32782]: pgmap v16826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:51 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31187.460161 secs 2024-04-26T20:27:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:53 smithi196 ceph-mon[32572]: pgmap v16827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:53 smithi110 ceph-mon[28069]: pgmap v16827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:53 smithi193 ceph-mon[32782]: pgmap v16827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:55 smithi196 ceph-mon[32572]: pgmap v16828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:55 smithi110 ceph-mon[28069]: pgmap v16828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:55 smithi193 ceph-mon[32782]: pgmap v16828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:56 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31192.460276 secs 2024-04-26T20:27:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:56 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31192.460276 secs 2024-04-26T20:27:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:56 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31192.460276 secs 2024-04-26T20:27:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:27:57 smithi196 ceph-mon[32572]: pgmap v16829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:27:57 smithi110 ceph-mon[28069]: pgmap v16829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:27:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:27:57 smithi193 ceph-mon[32782]: pgmap v16829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:00 smithi196 ceph-mon[32572]: pgmap v16830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:00 smithi110 ceph-mon[28069]: pgmap v16830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:00 smithi193 ceph-mon[32782]: pgmap v16830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:02 smithi110 ceph-mon[28069]: pgmap v16831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31197.460373 secs 2024-04-26T20:28:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:02 smithi193 ceph-mon[32782]: pgmap v16831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31197.460373 secs 2024-04-26T20:28:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:02 smithi196 ceph-mon[32572]: pgmap v16831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31197.460373 secs 2024-04-26T20:28:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:04 smithi110 ceph-mon[28069]: pgmap v16832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:04 smithi193 ceph-mon[32782]: pgmap v16832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:04 smithi196 ceph-mon[32572]: pgmap v16832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:06 smithi110 ceph-mon[28069]: pgmap v16833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:06 smithi193 ceph-mon[32782]: pgmap v16833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:06 smithi196 ceph-mon[32572]: pgmap v16833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:28:06.540+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:28:06.540 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:28:06.540+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:28:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:28:06.541+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 241 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:28:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:28:06.541+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 241 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:28:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:07 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31202.460509 secs 2024-04-26T20:28:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:07 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31202.460509 secs 2024-04-26T20:28:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:07 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31202.460509 secs 2024-04-26T20:28:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:08 smithi110 ceph-mon[28069]: pgmap v16834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:08 smithi193 ceph-mon[32782]: pgmap v16834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:08 smithi196 ceph-mon[32572]: pgmap v16834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:09 smithi193 ceph-mon[32782]: pgmap v16835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:09 smithi196 ceph-mon[32572]: pgmap v16835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:09 smithi110 ceph-mon[28069]: pgmap v16835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:11 smithi193 ceph-mon[32782]: pgmap v16836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:11 smithi196 ceph-mon[32572]: pgmap v16836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:11 smithi110 ceph-mon[28069]: pgmap v16836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:12 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31207.460625 secs 2024-04-26T20:28:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:12 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31207.460625 secs 2024-04-26T20:28:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:12 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31207.460625 secs 2024-04-26T20:28:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:13 smithi193 ceph-mon[32782]: pgmap v16837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:13 smithi196 ceph-mon[32572]: pgmap v16837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:13 smithi110 ceph-mon[28069]: pgmap v16837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:15 smithi193 ceph-mon[32782]: pgmap v16838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:15 smithi196 ceph-mon[32572]: pgmap v16838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:15 smithi110 ceph-mon[28069]: pgmap v16838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:17 smithi193 ceph-mon[32782]: pgmap v16839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:17 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31212.460743 secs 2024-04-26T20:28:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:17 smithi196 ceph-mon[32572]: pgmap v16839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:17 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31212.460743 secs 2024-04-26T20:28:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:17 smithi110 ceph-mon[28069]: pgmap v16839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:17 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31212.460743 secs 2024-04-26T20:28:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:19 smithi193 ceph-mon[32782]: pgmap v16840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:19 smithi196 ceph-mon[32572]: pgmap v16840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:19 smithi110 ceph-mon[28069]: pgmap v16840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:28:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:28:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:28:21.848 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:21 smithi196 ceph-mon[32572]: pgmap v16841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:21.849 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:21 smithi193 ceph-mon[32782]: pgmap v16841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:21 smithi110 ceph-mon[28069]: pgmap v16841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:22 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31217.460809 secs 2024-04-26T20:28:22.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:22 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31217.460809 secs 2024-04-26T20:28:22.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:22 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31217.460809 secs 2024-04-26T20:28:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:23 smithi193 ceph-mon[32782]: pgmap v16842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:23 smithi196 ceph-mon[32572]: pgmap v16842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:23 smithi110 ceph-mon[28069]: pgmap v16842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: pgmap v16843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: pgmap v16844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T20:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: pgmap v16845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: pgmap v16843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: pgmap v16844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: pgmap v16845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: pgmap v16843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: pgmap v16844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T20:28:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: pgmap v16845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:26.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:28:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:26 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31222.460875 secs 2024-04-26T20:28:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:26 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31222.460875 secs 2024-04-26T20:28:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:26 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31222.460875 secs 2024-04-26T20:28:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:27 smithi196 ceph-mon[32572]: pgmap v16846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 592 B/s rd, 1 op/s 2024-04-26T20:28:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:27 smithi110 ceph-mon[28069]: pgmap v16846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 592 B/s rd, 1 op/s 2024-04-26T20:28:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:27 smithi193 ceph-mon[32782]: pgmap v16846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 592 B/s rd, 1 op/s 2024-04-26T20:28:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:29 smithi196 ceph-mon[32572]: pgmap v16847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:29 smithi110 ceph-mon[28069]: pgmap v16847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:29 smithi193 ceph-mon[32782]: pgmap v16847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:31 smithi196 ceph-mon[32572]: pgmap v16848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:31 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31227.461003 secs 2024-04-26T20:28:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:31 smithi110 ceph-mon[28069]: pgmap v16848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:31 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31227.461003 secs 2024-04-26T20:28:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:31 smithi193 ceph-mon[32782]: pgmap v16848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:31 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31227.461003 secs 2024-04-26T20:28:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:33 smithi196 ceph-mon[32572]: pgmap v16849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:33 smithi110 ceph-mon[28069]: pgmap v16849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:33 smithi193 ceph-mon[32782]: pgmap v16849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:35 smithi196 ceph-mon[32572]: pgmap v16850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:28:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:35 smithi110 ceph-mon[28069]: pgmap v16850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:28:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:35 smithi193 ceph-mon[32782]: pgmap v16850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:28:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:36 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31232.461137 secs 2024-04-26T20:28:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:36 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31232.461137 secs 2024-04-26T20:28:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:36 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31232.461137 secs 2024-04-26T20:28:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:37 smithi196 ceph-mon[32572]: pgmap v16851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:37 smithi110 ceph-mon[28069]: pgmap v16851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:37 smithi193 ceph-mon[32782]: pgmap v16851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:39 smithi196 ceph-mon[32572]: pgmap v16852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:39 smithi110 ceph-mon[28069]: pgmap v16852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:39 smithi193 ceph-mon[32782]: pgmap v16852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:41 smithi196 ceph-mon[32572]: pgmap v16853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:41 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31237.461288 secs 2024-04-26T20:28:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:41 smithi110 ceph-mon[28069]: pgmap v16853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:41 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31237.461288 secs 2024-04-26T20:28:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:41 smithi193 ceph-mon[32782]: pgmap v16853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:41 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31237.461288 secs 2024-04-26T20:28:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:43 smithi196 ceph-mon[32572]: pgmap v16854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:43 smithi110 ceph-mon[28069]: pgmap v16854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:43 smithi193 ceph-mon[32782]: pgmap v16854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:45 smithi196 ceph-mon[32572]: pgmap v16855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:45 smithi110 ceph-mon[28069]: pgmap v16855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:45 smithi193 ceph-mon[32782]: pgmap v16855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:47 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31242.461438 secs 2024-04-26T20:28:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:47 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31242.461438 secs 2024-04-26T20:28:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:47 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31242.461438 secs 2024-04-26T20:28:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:48 smithi196 ceph-mon[32572]: pgmap v16856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:48 smithi110 ceph-mon[28069]: pgmap v16856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:48 smithi193 ceph-mon[32782]: pgmap v16856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:50 smithi110 ceph-mon[28069]: pgmap v16857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:50 smithi193 ceph-mon[32782]: pgmap v16857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:50 smithi196 ceph-mon[32572]: pgmap v16857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:52 smithi110 ceph-mon[28069]: pgmap v16858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:52 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31247.461596 secs 2024-04-26T20:28:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:52 smithi193 ceph-mon[32782]: pgmap v16858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:52 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31247.461596 secs 2024-04-26T20:28:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:52 smithi196 ceph-mon[32572]: pgmap v16858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:52 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31247.461596 secs 2024-04-26T20:28:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:54 smithi110 ceph-mon[28069]: pgmap v16859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:54 smithi193 ceph-mon[32782]: pgmap v16859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:54 smithi196 ceph-mon[32572]: pgmap v16859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:56 smithi110 ceph-mon[28069]: pgmap v16860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:56 smithi193 ceph-mon[32782]: pgmap v16860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:56 smithi196 ceph-mon[32572]: pgmap v16860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:57 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31252.461652 secs 2024-04-26T20:28:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:57 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31252.461652 secs 2024-04-26T20:28:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:57 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31252.461652 secs 2024-04-26T20:28:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:28:58 smithi110 ceph-mon[28069]: pgmap v16861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:28:58 smithi193 ceph-mon[32782]: pgmap v16861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:28:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:28:58 smithi196 ceph-mon[32572]: pgmap v16861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:00 smithi193 ceph-mon[32782]: pgmap v16862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:00 smithi196 ceph-mon[32572]: pgmap v16862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:00 smithi110 ceph-mon[28069]: pgmap v16862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:02 smithi193 ceph-mon[32782]: pgmap v16863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:02 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31257.461753 secs 2024-04-26T20:29:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:02 smithi196 ceph-mon[32572]: pgmap v16863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:02 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31257.461753 secs 2024-04-26T20:29:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:02 smithi110 ceph-mon[28069]: pgmap v16863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:02 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31257.461753 secs 2024-04-26T20:29:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:03 smithi193 ceph-mon[32782]: pgmap v16864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:03 smithi196 ceph-mon[32572]: pgmap v16864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:03 smithi110 ceph-mon[28069]: pgmap v16864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:05 smithi196 ceph-mon[32572]: pgmap v16865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:05 smithi110 ceph-mon[28069]: pgmap v16865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:05 smithi193 ceph-mon[32782]: pgmap v16865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:06 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31262.461812 secs 2024-04-26T20:29:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:06 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31262.461812 secs 2024-04-26T20:29:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:06 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31262.461812 secs 2024-04-26T20:29:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:07 smithi196 ceph-mon[32572]: pgmap v16866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:07 smithi110 ceph-mon[28069]: pgmap v16866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:07 smithi193 ceph-mon[32782]: pgmap v16866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:09 smithi196 ceph-mon[32572]: pgmap v16867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:09 smithi110 ceph-mon[28069]: pgmap v16867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:09 smithi193 ceph-mon[32782]: pgmap v16867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:11 smithi196 ceph-mon[32572]: pgmap v16868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:11 smithi196 ceph-mon[32572]: 23 slow requests, 0 included below; oldest blocked for > 31267.461889 secs 2024-04-26T20:29:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:11 smithi110 ceph-mon[28069]: pgmap v16868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:11 smithi110 ceph-mon[28069]: 23 slow requests, 0 included below; oldest blocked for > 31267.461889 secs 2024-04-26T20:29:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:11 smithi193 ceph-mon[32782]: pgmap v16868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:11 smithi193 ceph-mon[32782]: 23 slow requests, 0 included below; oldest blocked for > 31267.461889 secs 2024-04-26T20:29:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:13 smithi196 ceph-mon[32572]: pgmap v16869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:13 smithi110 ceph-mon[28069]: pgmap v16869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:13 smithi193 ceph-mon[32782]: pgmap v16869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:15.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:29:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:29:15.334+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:29:15.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:29:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:29:15.334+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:29:15.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:29:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:29:15.334+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:29:15.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:29:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:29:15.334+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:29:15.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:29:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:29:15.334+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:29:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:15 smithi196 ceph-mon[32572]: pgmap v16870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:15 smithi110 ceph-mon[28069]: pgmap v16870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:15 smithi193 ceph-mon[32782]: pgmap v16870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:16 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31272.462006 secs 2024-04-26T20:29:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:16 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31272.462006 secs 2024-04-26T20:29:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:16 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31272.462006 secs 2024-04-26T20:29:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:17 smithi196 ceph-mon[32572]: pgmap v16871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:17 smithi110 ceph-mon[28069]: pgmap v16871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:17 smithi193 ceph-mon[32782]: pgmap v16871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:29:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:29:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:29:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:29:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:29:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:29:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:20 smithi110 ceph-mon[28069]: pgmap v16872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:29:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:20 smithi193 ceph-mon[32782]: pgmap v16872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:29:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:20 smithi196 ceph-mon[32572]: pgmap v16872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:29:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:22 smithi110 ceph-mon[28069]: pgmap v16873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:29:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:22 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31277.462153 secs 2024-04-26T20:29:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:22 smithi193 ceph-mon[32782]: pgmap v16873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:29:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:22 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31277.462153 secs 2024-04-26T20:29:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:22 smithi196 ceph-mon[32572]: pgmap v16873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:29:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:22 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31277.462153 secs 2024-04-26T20:29:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:24 smithi110 ceph-mon[28069]: pgmap v16874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:29:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:24 smithi193 ceph-mon[32782]: pgmap v16874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:29:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:24 smithi196 ceph-mon[32572]: pgmap v16874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:29:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:26 smithi110 ceph-mon[28069]: pgmap v16875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:29:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:26 smithi193 ceph-mon[32782]: pgmap v16875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:29:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:26 smithi196 ceph-mon[32572]: pgmap v16875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:29:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:29:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:29:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:27 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31282.462276 secs 2024-04-26T20:29:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:29:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:29:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:27 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31282.462276 secs 2024-04-26T20:29:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:29:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:29:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:27 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31282.462276 secs 2024-04-26T20:29:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:28 smithi193 ceph-mon[32782]: pgmap v16876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:29:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:29:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:29:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:29:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:28 smithi196 ceph-mon[32572]: pgmap v16876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:29:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:29:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:29:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:29:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:28 smithi110 ceph-mon[28069]: pgmap v16876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:29:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:29:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:29:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:29:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:29 smithi193 ceph-mon[32782]: pgmap v16877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 294 B/s wr, 2 op/s 2024-04-26T20:29:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:29 smithi193 ceph-mon[32782]: pgmap v16878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T20:29:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:29 smithi196 ceph-mon[32572]: pgmap v16877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 294 B/s wr, 2 op/s 2024-04-26T20:29:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:29 smithi196 ceph-mon[32572]: pgmap v16878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T20:29:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:29 smithi110 ceph-mon[28069]: pgmap v16877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 294 B/s wr, 2 op/s 2024-04-26T20:29:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:29 smithi110 ceph-mon[28069]: pgmap v16878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T20:29:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:31 smithi193 ceph-mon[32782]: pgmap v16879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:31 smithi196 ceph-mon[32572]: pgmap v16879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:31 smithi110 ceph-mon[28069]: pgmap v16879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:32 smithi193 ceph-mon[32782]: pgmap v16880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:29:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:32 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31287.462369 secs 2024-04-26T20:29:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:32 smithi196 ceph-mon[32572]: pgmap v16880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:29:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:32 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31287.462369 secs 2024-04-26T20:29:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:32 smithi110 ceph-mon[28069]: pgmap v16880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:29:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:32 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31287.462369 secs 2024-04-26T20:29:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:34 smithi196 ceph-mon[32572]: pgmap v16881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:34 smithi110 ceph-mon[28069]: pgmap v16881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:34 smithi193 ceph-mon[32782]: pgmap v16881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:36 smithi196 ceph-mon[32572]: pgmap v16882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:36 smithi110 ceph-mon[28069]: pgmap v16882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:36 smithi193 ceph-mon[32782]: pgmap v16882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:37 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31292.462512 secs 2024-04-26T20:29:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:37 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31292.462512 secs 2024-04-26T20:29:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:37 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31292.462512 secs 2024-04-26T20:29:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:38 smithi196 ceph-mon[32572]: pgmap v16883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:29:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:38 smithi110 ceph-mon[28069]: pgmap v16883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:29:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:38 smithi193 ceph-mon[32782]: pgmap v16883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:29:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:40 smithi196 ceph-mon[32572]: pgmap v16884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:29:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:40 smithi110 ceph-mon[28069]: pgmap v16884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:29:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:40 smithi193 ceph-mon[32782]: pgmap v16884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:29:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:42 smithi196 ceph-mon[32572]: pgmap v16885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:42 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31297.462638 secs 2024-04-26T20:29:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:42 smithi110 ceph-mon[28069]: pgmap v16885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:42 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31297.462638 secs 2024-04-26T20:29:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:42 smithi193 ceph-mon[32782]: pgmap v16885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:42 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31297.462638 secs 2024-04-26T20:29:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:44 smithi196 ceph-mon[32572]: pgmap v16886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:44 smithi110 ceph-mon[28069]: pgmap v16886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:44 smithi193 ceph-mon[32782]: pgmap v16886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:46 smithi196 ceph-mon[32572]: pgmap v16887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:46 smithi110 ceph-mon[28069]: pgmap v16887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:46 smithi193 ceph-mon[32782]: pgmap v16887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:47 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31302.462743 secs 2024-04-26T20:29:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:47 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31302.462743 secs 2024-04-26T20:29:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:47 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31302.462743 secs 2024-04-26T20:29:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:48 smithi196 ceph-mon[32572]: pgmap v16888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:48 smithi110 ceph-mon[28069]: pgmap v16888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:48 smithi193 ceph-mon[32782]: pgmap v16888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:50 smithi196 ceph-mon[32572]: pgmap v16889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:29:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:50 smithi110 ceph-mon[28069]: pgmap v16889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:29:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:50 smithi193 ceph-mon[32782]: pgmap v16889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:29:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:52 smithi196 ceph-mon[32572]: pgmap v16890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:52 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31307.462827 secs 2024-04-26T20:29:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:52 smithi110 ceph-mon[28069]: pgmap v16890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:52 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31307.462827 secs 2024-04-26T20:29:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:52 smithi193 ceph-mon[32782]: pgmap v16890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:29:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:52 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31307.462827 secs 2024-04-26T20:29:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:54 smithi196 ceph-mon[32572]: pgmap v16891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:54 smithi110 ceph-mon[28069]: pgmap v16891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:54 smithi193 ceph-mon[32782]: pgmap v16891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:56 smithi196 ceph-mon[32572]: pgmap v16892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:29:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:56 smithi110 ceph-mon[28069]: pgmap v16892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:29:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:56 smithi193 ceph-mon[32782]: pgmap v16892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:29:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:57 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31312.462953 secs 2024-04-26T20:29:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:57 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31312.462953 secs 2024-04-26T20:29:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:57 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31312.462953 secs 2024-04-26T20:29:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:29:58 smithi196 ceph-mon[32572]: pgmap v16893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T20:29:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:29:58 smithi110 ceph-mon[28069]: pgmap v16893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T20:29:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:29:58 smithi193 ceph-mon[32782]: pgmap v16893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T20:30:00.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:00 smithi196 ceph-mon[32572]: pgmap v16894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:30:00.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:30:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:00 smithi110 ceph-mon[28069]: pgmap v16894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:30:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:30:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:00 smithi193 ceph-mon[32782]: pgmap v16894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:30:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:30:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:02 smithi196 ceph-mon[32572]: pgmap v16895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:30:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:02 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31317.463102 secs 2024-04-26T20:30:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:02 smithi110 ceph-mon[28069]: pgmap v16895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:30:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:02 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31317.463102 secs 2024-04-26T20:30:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:02 smithi193 ceph-mon[32782]: pgmap v16895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:30:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:02 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31317.463102 secs 2024-04-26T20:30:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:04 smithi196 ceph-mon[32572]: pgmap v16896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:04 smithi110 ceph-mon[28069]: pgmap v16896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:04 smithi193 ceph-mon[32782]: pgmap v16896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:06 smithi196 ceph-mon[32572]: pgmap v16897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:06 smithi110 ceph-mon[28069]: pgmap v16897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:06 smithi193 ceph-mon[32782]: pgmap v16897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:07 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31322.463244 secs 2024-04-26T20:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:07 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31322.463244 secs 2024-04-26T20:30:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:07 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31322.463244 secs 2024-04-26T20:30:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:08 smithi110 ceph-mon[28069]: pgmap v16898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:08 smithi193 ceph-mon[32782]: pgmap v16898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:08 smithi196 ceph-mon[32572]: pgmap v16898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:10 smithi110 ceph-mon[28069]: pgmap v16899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:30:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:10 smithi193 ceph-mon[32782]: pgmap v16899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:30:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:10 smithi196 ceph-mon[32572]: pgmap v16899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:30:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:12 smithi193 ceph-mon[32782]: pgmap v16900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:12 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31327.463387 secs 2024-04-26T20:30:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:12 smithi196 ceph-mon[32572]: pgmap v16900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:12 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31327.463387 secs 2024-04-26T20:30:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:12 smithi110 ceph-mon[28069]: pgmap v16900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:12 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31327.463387 secs 2024-04-26T20:30:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:14 smithi193 ceph-mon[32782]: pgmap v16901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:14 smithi196 ceph-mon[32572]: pgmap v16901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:14 smithi110 ceph-mon[28069]: pgmap v16901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:16 smithi193 ceph-mon[32782]: pgmap v16902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:16 smithi196 ceph-mon[32572]: pgmap v16902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:16 smithi110 ceph-mon[28069]: pgmap v16902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:17 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31332.463513 secs 2024-04-26T20:30:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:17 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31332.463513 secs 2024-04-26T20:30:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:17 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31332.463513 secs 2024-04-26T20:30:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:18 smithi196 ceph-mon[32572]: pgmap v16903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:18 smithi110 ceph-mon[28069]: pgmap v16903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:18 smithi193 ceph-mon[32782]: pgmap v16903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:20 smithi196 ceph-mon[32572]: pgmap v16904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:30:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:20 smithi110 ceph-mon[28069]: pgmap v16904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:30:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:20 smithi193 ceph-mon[32782]: pgmap v16904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:30:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:30:21.562+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:30:21.563 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:30:21.562+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:30:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:30:21.563+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 242 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:30:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:30:21.563+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 242 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:30:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:22 smithi196 ceph-mon[32572]: pgmap v16905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:22 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31337.463638 secs 2024-04-26T20:30:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:22 smithi110 ceph-mon[28069]: pgmap v16905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:22 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31337.463638 secs 2024-04-26T20:30:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:22 smithi193 ceph-mon[32782]: pgmap v16905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:22 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31337.463638 secs 2024-04-26T20:30:24.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:24 smithi193 ceph-mon[32782]: pgmap v16906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:24 smithi196 ceph-mon[32572]: pgmap v16906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:24 smithi110 ceph-mon[28069]: pgmap v16906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:26 smithi196 ceph-mon[32572]: pgmap v16907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:26 smithi110 ceph-mon[28069]: pgmap v16907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:26 smithi193 ceph-mon[32782]: pgmap v16907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:27 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31342.463700 secs 2024-04-26T20:30:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:27 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31342.463700 secs 2024-04-26T20:30:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:27 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31342.463700 secs 2024-04-26T20:30:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:28 smithi196 ceph-mon[32572]: pgmap v16908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:28 smithi110 ceph-mon[28069]: pgmap v16908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:28 smithi193 ceph-mon[32782]: pgmap v16908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:30 smithi196 ceph-mon[32572]: pgmap v16909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:30:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:30 smithi110 ceph-mon[28069]: pgmap v16909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:30:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:30 smithi193 ceph-mon[32782]: pgmap v16909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:30:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:32 smithi196 ceph-mon[32572]: pgmap v16910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:32 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31347.463779 secs 2024-04-26T20:30:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:32 smithi110 ceph-mon[28069]: pgmap v16910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:32 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31347.463779 secs 2024-04-26T20:30:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:32 smithi193 ceph-mon[32782]: pgmap v16910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:32 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31347.463779 secs 2024-04-26T20:30:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:34 smithi196 ceph-mon[32572]: pgmap v16911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:34 smithi110 ceph-mon[28069]: pgmap v16911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:34 smithi193 ceph-mon[32782]: pgmap v16911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:35 smithi196 ceph-mon[32572]: pgmap v16912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 901 B/s rd, 1 op/s 2024-04-26T20:30:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:35 smithi196 ceph-mon[32572]: pgmap v16913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:35 smithi110 ceph-mon[28069]: pgmap v16912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 901 B/s rd, 1 op/s 2024-04-26T20:30:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:35 smithi110 ceph-mon[28069]: pgmap v16913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:35 smithi193 ceph-mon[32782]: pgmap v16912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 901 B/s rd, 1 op/s 2024-04-26T20:30:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:35 smithi193 ceph-mon[32782]: pgmap v16913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:30:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:37 smithi110 ceph-mon[28069]: pgmap v16914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 547 B/s rd, 1 op/s 2024-04-26T20:30:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:37 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31352.463892 secs 2024-04-26T20:30:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:37 smithi193 ceph-mon[32782]: pgmap v16914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 547 B/s rd, 1 op/s 2024-04-26T20:30:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:37 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31352.463892 secs 2024-04-26T20:30:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:37 smithi196 ceph-mon[32572]: pgmap v16914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 547 B/s rd, 1 op/s 2024-04-26T20:30:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:37 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31352.463892 secs 2024-04-26T20:30:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:39 smithi110 ceph-mon[28069]: pgmap v16915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:39 smithi193 ceph-mon[32782]: pgmap v16915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:39 smithi196 ceph-mon[32572]: pgmap v16915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:41 smithi193 ceph-mon[32782]: pgmap v16916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:41 smithi196 ceph-mon[32572]: pgmap v16916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:41 smithi110 ceph-mon[28069]: pgmap v16916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:42 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31357.463972 secs 2024-04-26T20:30:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:42 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31357.463972 secs 2024-04-26T20:30:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:42 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31357.463972 secs 2024-04-26T20:30:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:43 smithi193 ceph-mon[32782]: pgmap v16917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:43 smithi196 ceph-mon[32572]: pgmap v16917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:43 smithi110 ceph-mon[28069]: pgmap v16917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:45 smithi193 ceph-mon[32782]: pgmap v16918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:30:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:45 smithi196 ceph-mon[32572]: pgmap v16918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:30:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:45 smithi110 ceph-mon[28069]: pgmap v16918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:30:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:47 smithi193 ceph-mon[32782]: pgmap v16919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:47 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31362.464117 secs 2024-04-26T20:30:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:47 smithi196 ceph-mon[32572]: pgmap v16919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:47 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31362.464117 secs 2024-04-26T20:30:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:47 smithi110 ceph-mon[28069]: pgmap v16919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:47 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31362.464117 secs 2024-04-26T20:30:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:49 smithi193 ceph-mon[32782]: pgmap v16920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:49 smithi196 ceph-mon[32572]: pgmap v16920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:49 smithi110 ceph-mon[28069]: pgmap v16920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:52.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:51 smithi110 ceph-mon[28069]: pgmap v16921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:51 smithi193 ceph-mon[32782]: pgmap v16921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:51 smithi196 ceph-mon[32572]: pgmap v16921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:52 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31367.464255 secs 2024-04-26T20:30:53.127 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:52 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31367.464255 secs 2024-04-26T20:30:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:52 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31367.464255 secs 2024-04-26T20:30:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:53 smithi193 ceph-mon[32782]: pgmap v16922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:53 smithi196 ceph-mon[32572]: pgmap v16922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:53 smithi110 ceph-mon[28069]: pgmap v16922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:30:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:55 smithi193 ceph-mon[32782]: pgmap v16923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:55 smithi196 ceph-mon[32572]: pgmap v16923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:55 smithi110 ceph-mon[28069]: pgmap v16923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:57 smithi193 ceph-mon[32782]: pgmap v16924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:57 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31372.464380 secs 2024-04-26T20:30:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:57 smithi196 ceph-mon[32572]: pgmap v16924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:57 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31372.464380 secs 2024-04-26T20:30:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:57 smithi110 ceph-mon[28069]: pgmap v16924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:30:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:57 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31372.464380 secs 2024-04-26T20:31:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:30:59 smithi193 ceph-mon[32782]: pgmap v16925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:30:59 smithi196 ceph-mon[32572]: pgmap v16925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:30:59 smithi110 ceph-mon[28069]: pgmap v16925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:01 smithi193 ceph-mon[32782]: pgmap v16926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:01 smithi196 ceph-mon[32572]: pgmap v16926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:01 smithi110 ceph-mon[28069]: pgmap v16926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:02 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31377.464442 secs 2024-04-26T20:31:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:02 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31377.464442 secs 2024-04-26T20:31:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:02 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31377.464442 secs 2024-04-26T20:31:04.163 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:03 smithi110 ceph-mon[28069]: pgmap v16927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:03 smithi196 ceph-mon[32572]: pgmap v16927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:03 smithi193 ceph-mon[32782]: pgmap v16927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:05 smithi196 ceph-mon[32572]: pgmap v16928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:05 smithi110 ceph-mon[28069]: pgmap v16928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:05 smithi193 ceph-mon[32782]: pgmap v16928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:07 smithi196 ceph-mon[32572]: pgmap v16929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:07 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31382.464560 secs 2024-04-26T20:31:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:07 smithi110 ceph-mon[28069]: pgmap v16929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:07 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31382.464560 secs 2024-04-26T20:31:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:07 smithi193 ceph-mon[32782]: pgmap v16929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:07 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31382.464560 secs 2024-04-26T20:31:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:09 smithi196 ceph-mon[32572]: pgmap v16930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:09 smithi110 ceph-mon[28069]: pgmap v16930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:09 smithi193 ceph-mon[32782]: pgmap v16930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:11 smithi196 ceph-mon[32572]: pgmap v16931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:11 smithi110 ceph-mon[28069]: pgmap v16931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:11 smithi193 ceph-mon[32782]: pgmap v16931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:12 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31387.464682 secs 2024-04-26T20:31:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:12 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31387.464682 secs 2024-04-26T20:31:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:12 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31387.464682 secs 2024-04-26T20:31:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:13 smithi196 ceph-mon[32572]: pgmap v16932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:13 smithi110 ceph-mon[28069]: pgmap v16932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:13 smithi193 ceph-mon[32782]: pgmap v16932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:16.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:15 smithi196 ceph-mon[32572]: pgmap v16933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:15 smithi110 ceph-mon[28069]: pgmap v16933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:15 smithi193 ceph-mon[32782]: pgmap v16933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:16 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31392.464810 secs 2024-04-26T20:31:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:16 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31392.464810 secs 2024-04-26T20:31:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:16 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31392.464810 secs 2024-04-26T20:31:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:17 smithi196 ceph-mon[32572]: pgmap v16934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:17 smithi110 ceph-mon[28069]: pgmap v16934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:17 smithi193 ceph-mon[32782]: pgmap v16934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:19 smithi196 ceph-mon[32572]: pgmap v16935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:19 smithi110 ceph-mon[28069]: pgmap v16935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:19 smithi193 ceph-mon[32782]: pgmap v16935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:21 smithi196 ceph-mon[32572]: pgmap v16936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:21 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31397.464942 secs 2024-04-26T20:31:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:21 smithi110 ceph-mon[28069]: pgmap v16936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:21 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31397.464942 secs 2024-04-26T20:31:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:21 smithi193 ceph-mon[32782]: pgmap v16936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:21 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31397.464942 secs 2024-04-26T20:31:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:23 smithi196 ceph-mon[32572]: pgmap v16937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:23 smithi110 ceph-mon[28069]: pgmap v16937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:23 smithi193 ceph-mon[32782]: pgmap v16937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:25 smithi196 ceph-mon[32572]: pgmap v16938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:26.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:25 smithi110 ceph-mon[28069]: pgmap v16938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:25 smithi193 ceph-mon[32782]: pgmap v16938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:26 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31402.465049 secs 2024-04-26T20:31:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:26 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31402.465049 secs 2024-04-26T20:31:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:26 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31402.465049 secs 2024-04-26T20:31:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:27 smithi196 ceph-mon[32572]: pgmap v16939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:27 smithi110 ceph-mon[28069]: pgmap v16939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:27 smithi193 ceph-mon[32782]: pgmap v16939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:29 smithi196 ceph-mon[32572]: pgmap v16940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:29 smithi110 ceph-mon[28069]: pgmap v16940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:29 smithi193 ceph-mon[32782]: pgmap v16940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:31 smithi196 ceph-mon[32572]: pgmap v16941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:31 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31407.465114 secs 2024-04-26T20:31:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:31 smithi110 ceph-mon[28069]: pgmap v16941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:31 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31407.465114 secs 2024-04-26T20:31:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:31 smithi193 ceph-mon[32782]: pgmap v16941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:31 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31407.465114 secs 2024-04-26T20:31:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:33 smithi196 ceph-mon[32572]: pgmap v16942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:33 smithi110 ceph-mon[28069]: pgmap v16942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:33 smithi193 ceph-mon[32782]: pgmap v16942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:35 smithi196 ceph-mon[32572]: pgmap v16943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:36.263 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:35 smithi110 ceph-mon[28069]: pgmap v16943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:36.263 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:35 smithi193 ceph-mon[32782]: pgmap v16943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:36 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31412.465180 secs 2024-04-26T20:31:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:36 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31412.465180 secs 2024-04-26T20:31:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:36 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31412.465180 secs 2024-04-26T20:31:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: pgmap v16944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: pgmap v16944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: pgmap v16944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:38 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:31:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:38 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:31:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:38 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:31:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:38 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:31:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:38 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:31:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:38 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:31:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:38 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:31:39.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:38 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:31:39.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:38 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:31:39.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:38 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:31:39.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:38 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:31:39.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:38 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:31:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:40 smithi196 ceph-mon[32572]: pgmap v16945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:40 smithi110 ceph-mon[28069]: pgmap v16945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:40 smithi193 ceph-mon[32782]: pgmap v16945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:41.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:41.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:41.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:41.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:31:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:41.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:31:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:42 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:31:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:42 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:31:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:42 smithi110 ceph-mon[28069]: pgmap v16946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T20:31:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:42 smithi110 ceph-mon[28069]: pgmap v16947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:42.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:42 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31417.465309 secs 2024-04-26T20:31:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:42 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:31:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:42 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:31:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:42 smithi193 ceph-mon[32782]: pgmap v16946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T20:31:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:42 smithi193 ceph-mon[32782]: pgmap v16947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:42 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31417.465309 secs 2024-04-26T20:31:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:42 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:31:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:42 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:31:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:42 smithi196 ceph-mon[32572]: pgmap v16946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 889 B/s rd, 1 op/s 2024-04-26T20:31:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:42 smithi196 ceph-mon[32572]: pgmap v16947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:42 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31417.465309 secs 2024-04-26T20:31:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:44 smithi110 ceph-mon[28069]: pgmap v16948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T20:31:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:44 smithi193 ceph-mon[32782]: pgmap v16948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T20:31:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:44 smithi196 ceph-mon[32572]: pgmap v16948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T20:31:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:46 smithi110 ceph-mon[28069]: pgmap v16949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:46.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:46 smithi196 ceph-mon[32572]: pgmap v16949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:46 smithi193 ceph-mon[32782]: pgmap v16949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:47 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31422.465452 secs 2024-04-26T20:31:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:47 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31422.465452 secs 2024-04-26T20:31:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:47 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31422.465452 secs 2024-04-26T20:31:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:48 smithi110 ceph-mon[28069]: pgmap v16950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:48 smithi193 ceph-mon[32782]: pgmap v16950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:48 smithi196 ceph-mon[32572]: pgmap v16950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:50 smithi193 ceph-mon[32782]: pgmap v16951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:50 smithi196 ceph-mon[32572]: pgmap v16951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:50 smithi110 ceph-mon[28069]: pgmap v16951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:52.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:52 smithi110 ceph-mon[28069]: pgmap v16952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:31:52.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:52 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31427.465597 secs 2024-04-26T20:31:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:52 smithi193 ceph-mon[32782]: pgmap v16952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:31:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:52 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31427.465597 secs 2024-04-26T20:31:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:52 smithi196 ceph-mon[32572]: pgmap v16952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:31:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:52 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31427.465597 secs 2024-04-26T20:31:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:54 smithi193 ceph-mon[32782]: pgmap v16953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:31:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:54 smithi196 ceph-mon[32572]: pgmap v16953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:31:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:54 smithi110 ceph-mon[28069]: pgmap v16953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:31:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:56 smithi193 ceph-mon[32782]: pgmap v16954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:56 smithi196 ceph-mon[32572]: pgmap v16954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:56 smithi110 ceph-mon[28069]: pgmap v16954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:31:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:57 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31432.465723 secs 2024-04-26T20:31:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:57 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31432.465723 secs 2024-04-26T20:31:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:57 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31432.465723 secs 2024-04-26T20:31:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:31:58 smithi193 ceph-mon[32782]: pgmap v16955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:31:58 smithi196 ceph-mon[32572]: pgmap v16955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:31:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:31:58 smithi110 ceph-mon[28069]: pgmap v16955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:00 smithi193 ceph-mon[32782]: pgmap v16956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:00 smithi196 ceph-mon[32572]: pgmap v16956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:00 smithi110 ceph-mon[28069]: pgmap v16956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:02 smithi193 ceph-mon[32782]: pgmap v16957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:02 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31437.465818 secs 2024-04-26T20:32:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:02 smithi196 ceph-mon[32572]: pgmap v16957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:02 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31437.465818 secs 2024-04-26T20:32:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:02 smithi110 ceph-mon[28069]: pgmap v16957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:02 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31437.465818 secs 2024-04-26T20:32:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:03 smithi193 ceph-mon[32782]: pgmap v16958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:03 smithi196 ceph-mon[32572]: pgmap v16958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:03 smithi110 ceph-mon[28069]: pgmap v16958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:05 smithi193 ceph-mon[32782]: pgmap v16959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:05 smithi196 ceph-mon[32572]: pgmap v16959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:05 smithi110 ceph-mon[28069]: pgmap v16959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:07 smithi193 ceph-mon[32782]: pgmap v16960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:07 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31442.465969 secs 2024-04-26T20:32:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:07 smithi196 ceph-mon[32572]: pgmap v16960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:07 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31442.465969 secs 2024-04-26T20:32:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:07 smithi110 ceph-mon[28069]: pgmap v16960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:07 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31442.465969 secs 2024-04-26T20:32:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:09 smithi193 ceph-mon[32782]: pgmap v16961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:09 smithi196 ceph-mon[32572]: pgmap v16961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:09 smithi110 ceph-mon[28069]: pgmap v16961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:11 smithi193 ceph-mon[32782]: pgmap v16962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:11 smithi196 ceph-mon[32572]: pgmap v16962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:11 smithi110 ceph-mon[28069]: pgmap v16962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:12 smithi193 ceph-mon[32782]: 3 slow requests, 0 included below; oldest blocked for > 31447.466044 secs 2024-04-26T20:32:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:12 smithi196 ceph-mon[32572]: 3 slow requests, 0 included below; oldest blocked for > 31447.466044 secs 2024-04-26T20:32:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:12 smithi110 ceph-mon[28069]: 3 slow requests, 0 included below; oldest blocked for > 31447.466044 secs 2024-04-26T20:32:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:13 smithi193 ceph-mon[32782]: pgmap v16963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:13 smithi196 ceph-mon[32572]: pgmap v16963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:13 smithi110 ceph-mon[28069]: pgmap v16963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:15 smithi193 ceph-mon[32782]: pgmap v16964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:15 smithi196 ceph-mon[32572]: pgmap v16964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:15 smithi110 ceph-mon[28069]: pgmap v16964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:17 smithi193 ceph-mon[32782]: pgmap v16965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:17 smithi193 ceph-mon[32782]: 24 slow requests, 2 included below; oldest blocked for > 31452.466188 secs 2024-04-26T20:32:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:17 smithi193 ceph-mon[32782]: slow request 2882.638099 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:32:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:17 smithi193 ceph-mon[32782]: slow request 181.421649 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T20:32:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:17 smithi196 ceph-mon[32572]: pgmap v16965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:17 smithi196 ceph-mon[32572]: 24 slow requests, 2 included below; oldest blocked for > 31452.466188 secs 2024-04-26T20:32:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:17 smithi196 ceph-mon[32572]: slow request 2882.638099 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:32:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:17 smithi196 ceph-mon[32572]: slow request 181.421649 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T20:32:17.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:17 smithi110 ceph-mon[28069]: pgmap v16965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:17.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:17 smithi110 ceph-mon[28069]: 24 slow requests, 2 included below; oldest blocked for > 31452.466188 secs 2024-04-26T20:32:17.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:17 smithi110 ceph-mon[28069]: slow request 2882.638099 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:32:17.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:17 smithi110 ceph-mon[28069]: slow request 181.421649 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T20:32:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:19 smithi196 ceph-mon[32572]: pgmap v16966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:32:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:32:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:19 smithi110 ceph-mon[28069]: pgmap v16966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:32:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:32:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:19 smithi193 ceph-mon[32782]: pgmap v16966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:32:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:32:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:21 smithi196 ceph-mon[32572]: pgmap v16967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:21 smithi110 ceph-mon[28069]: pgmap v16967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:21 smithi193 ceph-mon[32782]: pgmap v16967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:22.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:22 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31457.466315 secs 2024-04-26T20:32:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:22 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31457.466315 secs 2024-04-26T20:32:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:22 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31457.466315 secs 2024-04-26T20:32:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:23 smithi196 ceph-mon[32572]: pgmap v16968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:23 smithi110 ceph-mon[28069]: pgmap v16968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:23 smithi193 ceph-mon[32782]: pgmap v16968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:25.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:25 smithi193 ceph-mon[32782]: pgmap v16969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:25 smithi196 ceph-mon[32572]: pgmap v16969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:25.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:25 smithi110 ceph-mon[28069]: pgmap v16969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:27 smithi196 ceph-mon[32572]: pgmap v16970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:27 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31462.466457 secs 2024-04-26T20:32:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:27 smithi110 ceph-mon[28069]: pgmap v16970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:27 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31462.466457 secs 2024-04-26T20:32:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:27 smithi193 ceph-mon[32782]: pgmap v16970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:27 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31462.466457 secs 2024-04-26T20:32:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:29 smithi196 ceph-mon[32572]: pgmap v16971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:29.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:29 smithi110 ceph-mon[28069]: pgmap v16971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:29.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:29 smithi193 ceph-mon[32782]: pgmap v16971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:31 smithi196 ceph-mon[32572]: pgmap v16972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:31 smithi110 ceph-mon[28069]: pgmap v16972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:31 smithi193 ceph-mon[32782]: pgmap v16972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:32 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31467.466603 secs 2024-04-26T20:32:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:32 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31467.466603 secs 2024-04-26T20:32:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:32 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31467.466603 secs 2024-04-26T20:32:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:33 smithi196 ceph-mon[32572]: pgmap v16973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:33 smithi110 ceph-mon[28069]: pgmap v16973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:33 smithi193 ceph-mon[32782]: pgmap v16973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T20:32:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:35 smithi196 ceph-mon[32572]: pgmap v16974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:35 smithi110 ceph-mon[28069]: pgmap v16974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:35 smithi193 ceph-mon[32782]: pgmap v16974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:37 smithi196 ceph-mon[32572]: pgmap v16975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:37 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31472.466723 secs 2024-04-26T20:32:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:37 smithi110 ceph-mon[28069]: pgmap v16975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:37 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31472.466723 secs 2024-04-26T20:32:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:37 smithi193 ceph-mon[32782]: pgmap v16975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:37 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31472.466723 secs 2024-04-26T20:32:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:39 smithi196 ceph-mon[32572]: pgmap v16976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:39 smithi110 ceph-mon[28069]: pgmap v16976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:39 smithi193 ceph-mon[32782]: pgmap v16976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:41 smithi196 ceph-mon[32572]: pgmap v16977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:41 smithi110 ceph-mon[28069]: pgmap v16977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:41 smithi193 ceph-mon[32782]: pgmap v16977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:42 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31477.466846 secs 2024-04-26T20:32:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:42 smithi196 ceph-mon[32572]: pgmap v16978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:32:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:42 smithi196 ceph-mon[32572]: pgmap v16979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T20:32:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:32:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:42 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31477.466846 secs 2024-04-26T20:32:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:42 smithi110 ceph-mon[28069]: pgmap v16978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:32:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:42 smithi110 ceph-mon[28069]: pgmap v16979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T20:32:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:32:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:42 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31477.466846 secs 2024-04-26T20:32:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:42 smithi193 ceph-mon[32782]: pgmap v16978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:32:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:42 smithi193 ceph-mon[32782]: pgmap v16979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T20:32:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:32:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:44 smithi196 ceph-mon[32572]: pgmap v16980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:44 smithi110 ceph-mon[28069]: pgmap v16980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:44 smithi193 ceph-mon[32782]: pgmap v16980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:46 smithi196 ceph-mon[32572]: pgmap v16981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:46 smithi110 ceph-mon[28069]: pgmap v16981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:46 smithi193 ceph-mon[32782]: pgmap v16981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:47 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31482.466931 secs 2024-04-26T20:32:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:47 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31482.466931 secs 2024-04-26T20:32:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:47 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31482.466931 secs 2024-04-26T20:32:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:48 smithi196 ceph-mon[32572]: pgmap v16982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:48 smithi110 ceph-mon[28069]: pgmap v16982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:48 smithi193 ceph-mon[32782]: pgmap v16982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:50 smithi196 ceph-mon[32572]: pgmap v16983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:50 smithi110 ceph-mon[28069]: pgmap v16983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:50 smithi193 ceph-mon[32782]: pgmap v16983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:32:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:52 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31487.467059 secs 2024-04-26T20:32:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:52 smithi196 ceph-mon[32572]: pgmap v16984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:32:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:52 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31487.467059 secs 2024-04-26T20:32:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:52 smithi110 ceph-mon[28069]: pgmap v16984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:32:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:52 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31487.467059 secs 2024-04-26T20:32:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:52 smithi193 ceph-mon[32782]: pgmap v16984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:32:55.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:54 smithi193 ceph-mon[32782]: pgmap v16985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:54 smithi196 ceph-mon[32572]: pgmap v16985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:55.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:54 smithi110 ceph-mon[28069]: pgmap v16985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:56 smithi196 ceph-mon[32572]: pgmap v16986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:56 smithi110 ceph-mon[28069]: pgmap v16986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:56 smithi193 ceph-mon[32782]: pgmap v16986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:32:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:57 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31492.467185 secs 2024-04-26T20:32:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:57 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31492.467185 secs 2024-04-26T20:32:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:57 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31492.467185 secs 2024-04-26T20:32:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:32:58 smithi196 ceph-mon[32572]: pgmap v16987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:32:58 smithi110 ceph-mon[28069]: pgmap v16987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:32:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:32:58 smithi193 ceph-mon[32782]: pgmap v16987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:00 smithi196 ceph-mon[32572]: pgmap v16988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:00 smithi110 ceph-mon[28069]: pgmap v16988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:00 smithi193 ceph-mon[32782]: pgmap v16988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:01 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31497.467311 secs 2024-04-26T20:33:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:01 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31497.467311 secs 2024-04-26T20:33:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:01 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31497.467311 secs 2024-04-26T20:33:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:02 smithi196 ceph-mon[32572]: pgmap v16989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:02 smithi110 ceph-mon[28069]: pgmap v16989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:02 smithi193 ceph-mon[32782]: pgmap v16989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:04 smithi196 ceph-mon[32572]: pgmap v16990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:04 smithi110 ceph-mon[28069]: pgmap v16990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:04 smithi193 ceph-mon[32782]: pgmap v16990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:06 smithi196 ceph-mon[32572]: pgmap v16991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:06 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31502.467430 secs 2024-04-26T20:33:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:06 smithi110 ceph-mon[28069]: pgmap v16991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:06 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31502.467430 secs 2024-04-26T20:33:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:06 smithi193 ceph-mon[32782]: pgmap v16991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:06 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31502.467430 secs 2024-04-26T20:33:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:08 smithi196 ceph-mon[32572]: pgmap v16992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:08 smithi110 ceph-mon[28069]: pgmap v16992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:08 smithi193 ceph-mon[32782]: pgmap v16992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:10 smithi196 ceph-mon[32572]: pgmap v16993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:10 smithi110 ceph-mon[28069]: pgmap v16993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:10 smithi193 ceph-mon[32782]: pgmap v16993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:11 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31507.467555 secs 2024-04-26T20:33:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:11 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31507.467555 secs 2024-04-26T20:33:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:11 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31507.467555 secs 2024-04-26T20:33:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:12 smithi196 ceph-mon[32572]: pgmap v16994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:12 smithi110 ceph-mon[28069]: pgmap v16994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:12 smithi193 ceph-mon[32782]: pgmap v16994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:14 smithi196 ceph-mon[32572]: pgmap v16995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:14 smithi110 ceph-mon[28069]: pgmap v16995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:14 smithi193 ceph-mon[32782]: pgmap v16995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.464+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T20:33:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.464+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:33:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.464+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:33:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.464+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T20:33:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.464+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.465+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T20:33:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.465+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T20:33:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.475+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T20:33:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.475+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:33:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.475+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614059070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:33:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.475+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614059070 comp rx=0 tx=0).stop 2024-04-26T20:33:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.475+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T20:33:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.475+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T20:33:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.475+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.475+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.476+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:16.477+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d070 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:16 smithi196 ceph-mon[32572]: pgmap v16996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:16 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31512.467681 secs 2024-04-26T20:33:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:16 smithi110 ceph-mon[28069]: pgmap v16996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:16 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31512.467681 secs 2024-04-26T20:33:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:16 smithi193 ceph-mon[32782]: pgmap v16996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:16 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31512.467681 secs 2024-04-26T20:33:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:19 smithi196 ceph-mon[32572]: pgmap v16997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:19 smithi110 ceph-mon[28069]: pgmap v16997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:19 smithi193 ceph-mon[32782]: pgmap v16997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:21 smithi110 ceph-mon[28069]: pgmap v16998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:21 smithi193 ceph-mon[32782]: pgmap v16998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:21 smithi196 ceph-mon[32572]: pgmap v16998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:21.592+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:33:21.593 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:21.592+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:33:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:21.592+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 243 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:33:21.594 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:33:21.592+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 243 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:33:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:22 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31517.467760 secs 2024-04-26T20:33:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:22 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31517.467760 secs 2024-04-26T20:33:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:22 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31517.467760 secs 2024-04-26T20:33:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:23 smithi110 ceph-mon[28069]: pgmap v16999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:23 smithi193 ceph-mon[32782]: pgmap v16999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:23 smithi196 ceph-mon[32572]: pgmap v16999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:25 smithi110 ceph-mon[28069]: pgmap v17000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:25 smithi193 ceph-mon[32782]: pgmap v17000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:25 smithi196 ceph-mon[32572]: pgmap v17000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:27 smithi110 ceph-mon[28069]: pgmap v17001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:27 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31522.467870 secs 2024-04-26T20:33:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:27 smithi193 ceph-mon[32782]: pgmap v17001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:27 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31522.467870 secs 2024-04-26T20:33:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:27 smithi196 ceph-mon[32572]: pgmap v17001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:27 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31522.467870 secs 2024-04-26T20:33:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:29 smithi110 ceph-mon[28069]: pgmap v17002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:29 smithi193 ceph-mon[32782]: pgmap v17002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:29 smithi196 ceph-mon[32572]: pgmap v17002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:31 smithi110 ceph-mon[28069]: pgmap v17003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:31 smithi193 ceph-mon[32782]: pgmap v17003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:31 smithi196 ceph-mon[32572]: pgmap v17003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:32 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31527.467962 secs 2024-04-26T20:33:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:32 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31527.467962 secs 2024-04-26T20:33:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:32 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31527.467962 secs 2024-04-26T20:33:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:33 smithi193 ceph-mon[32782]: pgmap v17004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:33 smithi196 ceph-mon[32572]: pgmap v17004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:33 smithi110 ceph-mon[28069]: pgmap v17004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:35 smithi193 ceph-mon[32782]: pgmap v17005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:35 smithi196 ceph-mon[32572]: pgmap v17005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:35 smithi110 ceph-mon[28069]: pgmap v17005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:37 smithi193 ceph-mon[32782]: pgmap v17006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:37 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31532.468052 secs 2024-04-26T20:33:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:37 smithi196 ceph-mon[32572]: pgmap v17006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:37 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31532.468052 secs 2024-04-26T20:33:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:37 smithi110 ceph-mon[28069]: pgmap v17006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:37 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31532.468052 secs 2024-04-26T20:33:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:39 smithi193 ceph-mon[32782]: pgmap v17007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:39 smithi196 ceph-mon[32572]: pgmap v17007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:39 smithi110 ceph-mon[28069]: pgmap v17007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:41 smithi193 ceph-mon[32782]: pgmap v17008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:41 smithi196 ceph-mon[32572]: pgmap v17008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:41 smithi110 ceph-mon[28069]: pgmap v17008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:42 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31537.468206 secs 2024-04-26T20:33:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:42 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31537.468206 secs 2024-04-26T20:33:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:42 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31537.468206 secs 2024-04-26T20:33:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:43 smithi193 ceph-mon[32782]: pgmap v17009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:43 smithi196 ceph-mon[32572]: pgmap v17009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:43 smithi110 ceph-mon[28069]: pgmap v17009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:33:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:33:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:33:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:45 smithi193 ceph-mon[32782]: pgmap v17010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:33:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:45 smithi193 ceph-mon[32782]: pgmap v17011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:45 smithi196 ceph-mon[32572]: pgmap v17010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:33:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:45 smithi196 ceph-mon[32572]: pgmap v17011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:45 smithi110 ceph-mon[28069]: pgmap v17010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:33:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:45 smithi110 ceph-mon[28069]: pgmap v17011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:47 smithi193 ceph-mon[32782]: pgmap v17012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:47 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31542.468339 secs 2024-04-26T20:33:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:47 smithi196 ceph-mon[32572]: pgmap v17012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:47 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31542.468339 secs 2024-04-26T20:33:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:47 smithi110 ceph-mon[28069]: pgmap v17012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:47 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31542.468339 secs 2024-04-26T20:33:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:48 smithi196 ceph-mon[32572]: pgmap v17013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:33:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:48 smithi110 ceph-mon[28069]: pgmap v17013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:33:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:48 smithi193 ceph-mon[32782]: pgmap v17013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:33:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:50 smithi196 ceph-mon[32572]: pgmap v17014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:50 smithi110 ceph-mon[28069]: pgmap v17014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:50 smithi193 ceph-mon[32782]: pgmap v17014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:52 smithi196 ceph-mon[32572]: pgmap v17015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:52 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31547.468471 secs 2024-04-26T20:33:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:52 smithi110 ceph-mon[28069]: pgmap v17015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:52 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31547.468471 secs 2024-04-26T20:33:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:52 smithi193 ceph-mon[32782]: pgmap v17015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:33:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:52 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31547.468471 secs 2024-04-26T20:33:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:54 smithi196 ceph-mon[32572]: pgmap v17016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:33:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:54 smithi110 ceph-mon[28069]: pgmap v17016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:33:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:54 smithi193 ceph-mon[32782]: pgmap v17016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:33:56.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:56 smithi193 ceph-mon[32782]: pgmap v17017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:56 smithi196 ceph-mon[32572]: pgmap v17017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:56 smithi110 ceph-mon[28069]: pgmap v17017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:33:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:57 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31552.468623 secs 2024-04-26T20:33:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:57 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31552.468623 secs 2024-04-26T20:33:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:57 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31552.468623 secs 2024-04-26T20:33:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:33:58 smithi196 ceph-mon[32572]: pgmap v17018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:33:58 smithi110 ceph-mon[28069]: pgmap v17018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:33:58 smithi193 ceph-mon[32782]: pgmap v17018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:00 smithi196 ceph-mon[32572]: pgmap v17019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:00 smithi110 ceph-mon[28069]: pgmap v17019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:00 smithi193 ceph-mon[32782]: pgmap v17019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:02 smithi196 ceph-mon[32572]: pgmap v17020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:02 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31557.468729 secs 2024-04-26T20:34:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:02 smithi110 ceph-mon[28069]: pgmap v17020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:02 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31557.468729 secs 2024-04-26T20:34:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:02 smithi193 ceph-mon[32782]: pgmap v17020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:02 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31557.468729 secs 2024-04-26T20:34:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:04 smithi196 ceph-mon[32572]: pgmap v17021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:04 smithi110 ceph-mon[28069]: pgmap v17021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:04 smithi193 ceph-mon[32782]: pgmap v17021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:06 smithi196 ceph-mon[32572]: pgmap v17022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:06 smithi110 ceph-mon[28069]: pgmap v17022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:06 smithi193 ceph-mon[32782]: pgmap v17022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:07 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31562.468830 secs 2024-04-26T20:34:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:07 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31562.468830 secs 2024-04-26T20:34:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:07 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31562.468830 secs 2024-04-26T20:34:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:08 smithi196 ceph-mon[32572]: pgmap v17023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:08 smithi110 ceph-mon[28069]: pgmap v17023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:08 smithi193 ceph-mon[32782]: pgmap v17023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:10 smithi196 ceph-mon[32572]: pgmap v17024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:10 smithi110 ceph-mon[28069]: pgmap v17024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:10 smithi193 ceph-mon[32782]: pgmap v17024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:12 smithi196 ceph-mon[32572]: pgmap v17025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:12 smithi196 ceph-mon[32572]: 24 slow requests, 0 included below; oldest blocked for > 31567.468982 secs 2024-04-26T20:34:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:12 smithi110 ceph-mon[28069]: pgmap v17025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:12 smithi110 ceph-mon[28069]: 24 slow requests, 0 included below; oldest blocked for > 31567.468982 secs 2024-04-26T20:34:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:12 smithi193 ceph-mon[32782]: pgmap v17025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:12 smithi193 ceph-mon[32782]: 24 slow requests, 0 included below; oldest blocked for > 31567.468982 secs 2024-04-26T20:34:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:14 smithi196 ceph-mon[32572]: pgmap v17026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:14 smithi110 ceph-mon[28069]: pgmap v17026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:14 smithi193 ceph-mon[32782]: pgmap v17026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:34:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:34:15.561+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:34:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:34:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:34:15.561+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:34:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:34:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:34:15.561+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:34:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:34:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:34:15.561+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:34:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:34:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:34:15.561+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:34:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:16 smithi196 ceph-mon[32572]: pgmap v17027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:16 smithi110 ceph-mon[28069]: pgmap v17027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:16 smithi193 ceph-mon[32782]: pgmap v17027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31572.469083 secs 2024-04-26T20:34:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31572.469083 secs 2024-04-26T20:34:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31572.469083 secs 2024-04-26T20:34:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:18 smithi196 ceph-mon[32572]: pgmap v17028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:34:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:18 smithi110 ceph-mon[28069]: pgmap v17028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:34:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:18 smithi193 ceph-mon[32782]: pgmap v17028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:34:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:34:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:34:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:34:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:34:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:34:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:34:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:20 smithi196 ceph-mon[32572]: pgmap v17029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T20:34:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:20 smithi110 ceph-mon[28069]: pgmap v17029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T20:34:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:20 smithi193 ceph-mon[32782]: pgmap v17029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T20:34:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:22 smithi196 ceph-mon[32572]: pgmap v17030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T20:34:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31577.469215 secs 2024-04-26T20:34:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:22 smithi110 ceph-mon[28069]: pgmap v17030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T20:34:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31577.469215 secs 2024-04-26T20:34:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:22 smithi193 ceph-mon[32782]: pgmap v17030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T20:34:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31577.469215 secs 2024-04-26T20:34:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:24 smithi196 ceph-mon[32572]: pgmap v17031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:34:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:24 smithi110 ceph-mon[28069]: pgmap v17031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:34:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:24 smithi193 ceph-mon[32782]: pgmap v17031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:34:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:26 smithi196 ceph-mon[32572]: pgmap v17032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T20:34:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:26 smithi110 ceph-mon[28069]: pgmap v17032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T20:34:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:26 smithi193 ceph-mon[32782]: pgmap v17032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T20:34:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31582.469327 secs 2024-04-26T20:34:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31582.469327 secs 2024-04-26T20:34:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31582.469327 secs 2024-04-26T20:34:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:28 smithi110 ceph-mon[28069]: pgmap v17033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:34:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:28 smithi193 ceph-mon[32782]: pgmap v17033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:34:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:28 smithi196 ceph-mon[32572]: pgmap v17033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T20:34:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:30 smithi110 ceph-mon[28069]: pgmap v17034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:30 smithi193 ceph-mon[32782]: pgmap v17034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:30 smithi196 ceph-mon[32572]: pgmap v17034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:32 smithi110 ceph-mon[28069]: pgmap v17035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31587.469400 secs 2024-04-26T20:34:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:32 smithi193 ceph-mon[32782]: pgmap v17035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:33.145 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31587.469400 secs 2024-04-26T20:34:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:32 smithi196 ceph-mon[32572]: pgmap v17035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31587.469400 secs 2024-04-26T20:34:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:34 smithi110 ceph-mon[28069]: pgmap v17036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:34 smithi193 ceph-mon[32782]: pgmap v17036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:34 smithi196 ceph-mon[32572]: pgmap v17036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:36 smithi110 ceph-mon[28069]: pgmap v17037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:36 smithi193 ceph-mon[32782]: pgmap v17037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:36 smithi196 ceph-mon[32572]: pgmap v17037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31592.469519 secs 2024-04-26T20:34:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31592.469519 secs 2024-04-26T20:34:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31592.469519 secs 2024-04-26T20:34:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:38 smithi193 ceph-mon[32782]: pgmap v17038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:38 smithi196 ceph-mon[32572]: pgmap v17038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:38 smithi110 ceph-mon[28069]: pgmap v17038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:40 smithi193 ceph-mon[32782]: pgmap v17039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:40 smithi196 ceph-mon[32572]: pgmap v17039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:40 smithi110 ceph-mon[28069]: pgmap v17039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:42 smithi193 ceph-mon[32782]: pgmap v17040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31597.469636 secs 2024-04-26T20:34:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:42 smithi196 ceph-mon[32572]: pgmap v17040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31597.469636 secs 2024-04-26T20:34:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:42 smithi110 ceph-mon[28069]: pgmap v17040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31597.469636 secs 2024-04-26T20:34:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:44 smithi193 ceph-mon[32782]: pgmap v17041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:44 smithi196 ceph-mon[32572]: pgmap v17041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:44 smithi110 ceph-mon[28069]: pgmap v17041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:34:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:34:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:34:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:34:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:34:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:34:46.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:34:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:47 smithi110 ceph-mon[28069]: pgmap v17042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:47 smithi110 ceph-mon[28069]: pgmap v17043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T20:34:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:47 smithi110 ceph-mon[28069]: pgmap v17044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:34:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31602.469756 secs 2024-04-26T20:34:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:47 smithi193 ceph-mon[32782]: pgmap v17042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:47 smithi193 ceph-mon[32782]: pgmap v17043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T20:34:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:47 smithi193 ceph-mon[32782]: pgmap v17044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:34:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31602.469756 secs 2024-04-26T20:34:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:47 smithi196 ceph-mon[32572]: pgmap v17042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:34:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:47 smithi196 ceph-mon[32572]: pgmap v17043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T20:34:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:47 smithi196 ceph-mon[32572]: pgmap v17044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T20:34:47.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31602.469756 secs 2024-04-26T20:34:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:49 smithi110 ceph-mon[28069]: pgmap v17045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:49.357 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:49 smithi196 ceph-mon[32572]: pgmap v17045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:49 smithi193 ceph-mon[32782]: pgmap v17045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:51 smithi193 ceph-mon[32782]: pgmap v17046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:51 smithi196 ceph-mon[32572]: pgmap v17046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:51 smithi110 ceph-mon[28069]: pgmap v17046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31607.469870 secs 2024-04-26T20:34:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31607.469870 secs 2024-04-26T20:34:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31607.469870 secs 2024-04-26T20:34:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:53 smithi193 ceph-mon[32782]: pgmap v17047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T20:34:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:53 smithi196 ceph-mon[32572]: pgmap v17047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T20:34:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:53 smithi110 ceph-mon[28069]: pgmap v17047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 607 B/s rd, 1 op/s 2024-04-26T20:34:55.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:55 smithi110 ceph-mon[28069]: pgmap v17048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:55 smithi193 ceph-mon[32782]: pgmap v17048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:55 smithi196 ceph-mon[32572]: pgmap v17048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:57 smithi193 ceph-mon[32782]: pgmap v17049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:34:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31612.469993 secs 2024-04-26T20:34:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:57 smithi196 ceph-mon[32572]: pgmap v17049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:34:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31612.469993 secs 2024-04-26T20:34:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:57 smithi110 ceph-mon[28069]: pgmap v17049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:34:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31612.469993 secs 2024-04-26T20:34:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:34:59 smithi196 ceph-mon[32572]: pgmap v17050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:34:59 smithi193 ceph-mon[32782]: pgmap v17050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:34:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:34:59 smithi110 ceph-mon[28069]: pgmap v17050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:01 smithi193 ceph-mon[32782]: pgmap v17051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:01 smithi196 ceph-mon[32572]: pgmap v17051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:01 smithi110 ceph-mon[28069]: pgmap v17051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31617.470111 secs 2024-04-26T20:35:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31617.470111 secs 2024-04-26T20:35:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31617.470111 secs 2024-04-26T20:35:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:03 smithi193 ceph-mon[32782]: pgmap v17052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:03 smithi196 ceph-mon[32572]: pgmap v17052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:03 smithi110 ceph-mon[28069]: pgmap v17052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:05 smithi193 ceph-mon[32782]: pgmap v17053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:35:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:05 smithi196 ceph-mon[32572]: pgmap v17053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:35:05.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:05 smithi110 ceph-mon[28069]: pgmap v17053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:35:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:07 smithi193 ceph-mon[32782]: pgmap v17054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:35:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31622.470250 secs 2024-04-26T20:35:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:07 smithi196 ceph-mon[32572]: pgmap v17054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:35:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31622.470250 secs 2024-04-26T20:35:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:07 smithi110 ceph-mon[28069]: pgmap v17054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:35:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31622.470250 secs 2024-04-26T20:35:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:09 smithi193 ceph-mon[32782]: pgmap v17055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:35:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:09 smithi196 ceph-mon[32572]: pgmap v17055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:35:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:09 smithi110 ceph-mon[28069]: pgmap v17055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:35:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:11 smithi193 ceph-mon[32782]: pgmap v17056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:35:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:11 smithi196 ceph-mon[32572]: pgmap v17056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:35:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:11 smithi110 ceph-mon[28069]: pgmap v17056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:35:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31627.470382 secs 2024-04-26T20:35:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31627.470382 secs 2024-04-26T20:35:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31627.470382 secs 2024-04-26T20:35:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:13 smithi196 ceph-mon[32572]: pgmap v17057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:35:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:13 smithi110 ceph-mon[28069]: pgmap v17057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:35:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:13 smithi193 ceph-mon[32782]: pgmap v17057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:35:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:14 smithi196 ceph-mon[32572]: pgmap v17058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:35:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:14 smithi110 ceph-mon[28069]: pgmap v17058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:35:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:14 smithi193 ceph-mon[32782]: pgmap v17058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:35:17.208 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:16 smithi196 ceph-mon[32572]: pgmap v17059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:16 smithi110 ceph-mon[28069]: pgmap v17059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:16 smithi193 ceph-mon[32782]: pgmap v17059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:17 smithi196 ceph-mon[32572]: 4 slow requests, 1 included below; oldest blocked for > 31632.470505 secs 2024-04-26T20:35:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:17 smithi196 ceph-mon[32572]: slow request 361.425967 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:35:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:17 smithi110 ceph-mon[28069]: 4 slow requests, 1 included below; oldest blocked for > 31632.470505 secs 2024-04-26T20:35:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:17 smithi110 ceph-mon[28069]: slow request 361.425967 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:35:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:17 smithi193 ceph-mon[32782]: 4 slow requests, 1 included below; oldest blocked for > 31632.470505 secs 2024-04-26T20:35:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:17 smithi193 ceph-mon[32782]: slow request 361.425967 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:35:19.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:18 smithi196 ceph-mon[32572]: pgmap v17060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:18 smithi110 ceph-mon[28069]: pgmap v17060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:18 smithi193 ceph-mon[32782]: pgmap v17060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:20 smithi196 ceph-mon[32572]: pgmap v17061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:20 smithi110 ceph-mon[28069]: pgmap v17061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:20 smithi193 ceph-mon[32782]: pgmap v17061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31637.470634 secs 2024-04-26T20:35:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:22 smithi196 ceph-mon[32572]: pgmap v17062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31637.470634 secs 2024-04-26T20:35:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:22 smithi110 ceph-mon[28069]: pgmap v17062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31637.470634 secs 2024-04-26T20:35:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:22 smithi193 ceph-mon[32782]: pgmap v17062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:24 smithi196 ceph-mon[32572]: pgmap v17063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:24 smithi110 ceph-mon[28069]: pgmap v17063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:24 smithi193 ceph-mon[32782]: pgmap v17063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:27.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:26 smithi193 ceph-mon[32782]: pgmap v17064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:26 smithi196 ceph-mon[32572]: pgmap v17064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:26 smithi110 ceph-mon[28069]: pgmap v17064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31642.470752 secs 2024-04-26T20:35:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31642.470752 secs 2024-04-26T20:35:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31642.470752 secs 2024-04-26T20:35:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:28 smithi196 ceph-mon[32572]: pgmap v17065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:28 smithi110 ceph-mon[28069]: pgmap v17065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:28 smithi193 ceph-mon[32782]: pgmap v17065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:30 smithi196 ceph-mon[32572]: pgmap v17066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:30 smithi110 ceph-mon[28069]: pgmap v17066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:30 smithi193 ceph-mon[32782]: pgmap v17066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31647.470892 secs 2024-04-26T20:35:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:32 smithi196 ceph-mon[32572]: pgmap v17067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31647.470892 secs 2024-04-26T20:35:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:32 smithi110 ceph-mon[28069]: pgmap v17067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31647.470892 secs 2024-04-26T20:35:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:32 smithi193 ceph-mon[32782]: pgmap v17067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:34 smithi196 ceph-mon[32572]: pgmap v17068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:34 smithi110 ceph-mon[28069]: pgmap v17068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:34 smithi193 ceph-mon[32782]: pgmap v17068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:36 smithi196 ceph-mon[32572]: pgmap v17069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:36 smithi110 ceph-mon[28069]: pgmap v17069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:36 smithi193 ceph-mon[32782]: pgmap v17069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31652.471004 secs 2024-04-26T20:35:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31652.471004 secs 2024-04-26T20:35:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31652.471004 secs 2024-04-26T20:35:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:38 smithi196 ceph-mon[32572]: pgmap v17070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:38 smithi110 ceph-mon[28069]: pgmap v17070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:38 smithi193 ceph-mon[32782]: pgmap v17070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:40 smithi196 ceph-mon[32572]: pgmap v17071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:40 smithi110 ceph-mon[28069]: pgmap v17071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:41.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:40 smithi193 ceph-mon[32782]: pgmap v17071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:41 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31657.471136 secs 2024-04-26T20:35:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:41 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31657.471136 secs 2024-04-26T20:35:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:41 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31657.471136 secs 2024-04-26T20:35:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:42 smithi196 ceph-mon[32572]: pgmap v17072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:42 smithi110 ceph-mon[28069]: pgmap v17072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:42 smithi193 ceph-mon[32782]: pgmap v17072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:44 smithi196 ceph-mon[32572]: pgmap v17073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:44 smithi110 ceph-mon[28069]: pgmap v17073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:44 smithi193 ceph-mon[32782]: pgmap v17073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:35:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:46 smithi196 ceph-mon[32572]: pgmap v17074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:35:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:46 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31662.471231 secs 2024-04-26T20:35:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:46 smithi110 ceph-mon[28069]: pgmap v17074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:35:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:46 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31662.471231 secs 2024-04-26T20:35:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:46 smithi193 ceph-mon[32782]: pgmap v17074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:35:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:35:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:46 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31662.471231 secs 2024-04-26T20:35:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:35:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:35:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:35:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:48 smithi196 ceph-mon[32572]: pgmap v17075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:35:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:48 smithi196 ceph-mon[32572]: pgmap v17076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:48 smithi110 ceph-mon[28069]: pgmap v17075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:35:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:48 smithi110 ceph-mon[28069]: pgmap v17076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:48 smithi193 ceph-mon[32782]: pgmap v17075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:35:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:48 smithi193 ceph-mon[32782]: pgmap v17076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:50 smithi196 ceph-mon[32572]: pgmap v17077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:50 smithi110 ceph-mon[28069]: pgmap v17077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:50 smithi193 ceph-mon[32782]: pgmap v17077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31667.471329 secs 2024-04-26T20:35:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31667.471329 secs 2024-04-26T20:35:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31667.471329 secs 2024-04-26T20:35:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:53 smithi110 ceph-mon[28069]: pgmap v17078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:53 smithi193 ceph-mon[32782]: pgmap v17078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:53 smithi196 ceph-mon[32572]: pgmap v17078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:55 smithi110 ceph-mon[28069]: pgmap v17079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:55 smithi193 ceph-mon[32782]: pgmap v17079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:55 smithi196 ceph-mon[32572]: pgmap v17079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:57 smithi110 ceph-mon[28069]: pgmap v17080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:57 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31672.471452 secs 2024-04-26T20:35:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:57 smithi193 ceph-mon[32782]: pgmap v17080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:57 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31672.471452 secs 2024-04-26T20:35:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:57 smithi196 ceph-mon[32572]: pgmap v17080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:35:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:57 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31672.471452 secs 2024-04-26T20:35:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:35:59 smithi110 ceph-mon[28069]: pgmap v17081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:35:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:35:59 smithi193 ceph-mon[32782]: pgmap v17081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:35:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:35:59 smithi196 ceph-mon[32572]: pgmap v17081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:36:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:01 smithi110 ceph-mon[28069]: pgmap v17082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:01 smithi193 ceph-mon[32782]: pgmap v17082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:01 smithi196 ceph-mon[32572]: pgmap v17082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:02 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31677.471593 secs 2024-04-26T20:36:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:02 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31677.471593 secs 2024-04-26T20:36:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:02 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31677.471593 secs 2024-04-26T20:36:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:03 smithi193 ceph-mon[32782]: pgmap v17083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:03 smithi196 ceph-mon[32572]: pgmap v17083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:03 smithi110 ceph-mon[28069]: pgmap v17083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:05 smithi193 ceph-mon[32782]: pgmap v17084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:05 smithi196 ceph-mon[32572]: pgmap v17084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:05 smithi110 ceph-mon[28069]: pgmap v17084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:07 smithi193 ceph-mon[32782]: pgmap v17085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31682.471705 secs 2024-04-26T20:36:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:07 smithi196 ceph-mon[32572]: pgmap v17085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31682.471705 secs 2024-04-26T20:36:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:07 smithi110 ceph-mon[28069]: pgmap v17085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31682.471705 secs 2024-04-26T20:36:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:09 smithi193 ceph-mon[32782]: pgmap v17086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:09 smithi196 ceph-mon[32572]: pgmap v17086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:09 smithi110 ceph-mon[28069]: pgmap v17086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:11 smithi193 ceph-mon[32782]: pgmap v17087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:11 smithi196 ceph-mon[32572]: pgmap v17087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:11 smithi110 ceph-mon[28069]: pgmap v17087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31687.471823 secs 2024-04-26T20:36:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31687.471823 secs 2024-04-26T20:36:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31687.471823 secs 2024-04-26T20:36:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:13 smithi193 ceph-mon[32782]: pgmap v17088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:13 smithi196 ceph-mon[32572]: pgmap v17088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:13 smithi110 ceph-mon[28069]: pgmap v17088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:15 smithi193 ceph-mon[32782]: pgmap v17089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:15 smithi196 ceph-mon[32572]: pgmap v17089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:15 smithi110 ceph-mon[28069]: pgmap v17089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:17.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:17 smithi193 ceph-mon[32782]: pgmap v17090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:17.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:17 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31692.471899 secs 2024-04-26T20:36:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:17 smithi196 ceph-mon[32572]: pgmap v17090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:17 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31692.471899 secs 2024-04-26T20:36:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:17 smithi110 ceph-mon[28069]: pgmap v17090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:17 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31692.471899 secs 2024-04-26T20:36:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:19 smithi193 ceph-mon[32782]: pgmap v17091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:19 smithi196 ceph-mon[32572]: pgmap v17091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:19 smithi110 ceph-mon[28069]: pgmap v17091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:21 smithi193 ceph-mon[32782]: pgmap v17092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:21 smithi196 ceph-mon[32572]: pgmap v17092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:21 smithi110 ceph-mon[28069]: pgmap v17092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:21.623 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:36:21.622+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T20:36:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:36:21.622+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T20:36:21.624 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:36:21.623+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 244 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T20:36:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:36:21.623+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:36:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:36:21.623+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 244 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T20:36:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:36:21.623+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0034d0 con 0x55db1be4fdd0 2024-04-26T20:36:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:36:21.623+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 245 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec0034d0 con 0x7f261c104b50 2024-04-26T20:36:21.625 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:36:21.623+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 245 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:36:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:22 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31697.472016 secs 2024-04-26T20:36:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:22 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31697.472016 secs 2024-04-26T20:36:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:22 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31697.472016 secs 2024-04-26T20:36:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:23 smithi193 ceph-mon[32782]: pgmap v17093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:23 smithi196 ceph-mon[32572]: pgmap v17093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:23 smithi110 ceph-mon[28069]: pgmap v17093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:25 smithi193 ceph-mon[32782]: pgmap v17094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:25 smithi196 ceph-mon[32572]: pgmap v17094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:25 smithi110 ceph-mon[28069]: pgmap v17094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:27 smithi196 ceph-mon[32572]: pgmap v17095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:27 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31702.472134 secs 2024-04-26T20:36:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:27 smithi110 ceph-mon[28069]: pgmap v17095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:27 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31702.472134 secs 2024-04-26T20:36:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:27 smithi193 ceph-mon[32782]: pgmap v17095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:27 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31702.472134 secs 2024-04-26T20:36:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:29 smithi196 ceph-mon[32572]: pgmap v17096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:29 smithi110 ceph-mon[28069]: pgmap v17096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:29 smithi193 ceph-mon[32782]: pgmap v17096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:31 smithi196 ceph-mon[32572]: pgmap v17097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:31 smithi110 ceph-mon[28069]: pgmap v17097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:31 smithi193 ceph-mon[32782]: pgmap v17097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:32 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31707.472254 secs 2024-04-26T20:36:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:32 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31707.472254 secs 2024-04-26T20:36:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:32 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31707.472254 secs 2024-04-26T20:36:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:33 smithi196 ceph-mon[32572]: pgmap v17098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:33 smithi110 ceph-mon[28069]: pgmap v17098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:33 smithi193 ceph-mon[32782]: pgmap v17098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:34 smithi196 ceph-mon[32572]: pgmap v17099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:34 smithi110 ceph-mon[28069]: pgmap v17099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:34 smithi193 ceph-mon[32782]: pgmap v17099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:36 smithi196 ceph-mon[32572]: pgmap v17100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:36 smithi110 ceph-mon[28069]: pgmap v17100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:36 smithi193 ceph-mon[32782]: pgmap v17100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:37 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31712.472379 secs 2024-04-26T20:36:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:37 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31712.472379 secs 2024-04-26T20:36:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:37 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31712.472379 secs 2024-04-26T20:36:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:38 smithi196 ceph-mon[32572]: pgmap v17101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:38 smithi110 ceph-mon[28069]: pgmap v17101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:38 smithi193 ceph-mon[32782]: pgmap v17101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:40 smithi196 ceph-mon[32572]: pgmap v17102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:40 smithi110 ceph-mon[28069]: pgmap v17102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:40 smithi193 ceph-mon[32782]: pgmap v17102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:42 smithi196 ceph-mon[32572]: pgmap v17103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:42 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31717.472512 secs 2024-04-26T20:36:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:42 smithi110 ceph-mon[28069]: pgmap v17103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:42 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31717.472512 secs 2024-04-26T20:36:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:42 smithi193 ceph-mon[32782]: pgmap v17103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:42 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31717.472512 secs 2024-04-26T20:36:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:44 smithi196 ceph-mon[32572]: pgmap v17104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:44 smithi110 ceph-mon[28069]: pgmap v17104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:44 smithi193 ceph-mon[32782]: pgmap v17104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:46 smithi196 ceph-mon[32572]: pgmap v17105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:46 smithi110 ceph-mon[28069]: pgmap v17105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:46 smithi193 ceph-mon[32782]: pgmap v17105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:36:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:47 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31722.472620 secs 2024-04-26T20:36:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:47 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31722.472620 secs 2024-04-26T20:36:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:47 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31722.472620 secs 2024-04-26T20:36:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:48 smithi196 ceph-mon[32572]: pgmap v17106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:36:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:48 smithi110 ceph-mon[28069]: pgmap v17106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:36:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:48 smithi193 ceph-mon[32782]: pgmap v17106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:36:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:36:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:36:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:36:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:49 smithi196 ceph-mon[32572]: pgmap v17107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T20:36:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:49 smithi196 ceph-mon[32572]: pgmap v17108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:36:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:36:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:36:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:49 smithi110 ceph-mon[28069]: pgmap v17107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T20:36:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:49 smithi110 ceph-mon[28069]: pgmap v17108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:36:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:36:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:36:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:49 smithi193 ceph-mon[32782]: pgmap v17107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T20:36:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:49 smithi193 ceph-mon[32782]: pgmap v17108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:36:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:51 smithi196 ceph-mon[32572]: pgmap v17109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:51 smithi110 ceph-mon[28069]: pgmap v17109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:51 smithi193 ceph-mon[32782]: pgmap v17109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:52 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31727.472758 secs 2024-04-26T20:36:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:52 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31727.472758 secs 2024-04-26T20:36:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:52 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31727.472758 secs 2024-04-26T20:36:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:53 smithi196 ceph-mon[32572]: pgmap v17110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:53 smithi110 ceph-mon[28069]: pgmap v17110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:53 smithi193 ceph-mon[32782]: pgmap v17110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:55 smithi196 ceph-mon[32572]: pgmap v17111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:55 smithi110 ceph-mon[28069]: pgmap v17111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:55 smithi193 ceph-mon[32782]: pgmap v17111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:56 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31732.472877 secs 2024-04-26T20:36:57.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:56 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31732.472877 secs 2024-04-26T20:36:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:56 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31732.472877 secs 2024-04-26T20:36:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:57 smithi196 ceph-mon[32572]: pgmap v17112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T20:36:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:57 smithi110 ceph-mon[28069]: pgmap v17112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T20:36:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:57 smithi193 ceph-mon[32782]: pgmap v17112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T20:37:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:36:59 smithi196 ceph-mon[32572]: pgmap v17113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:37:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:36:59 smithi110 ceph-mon[28069]: pgmap v17113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:37:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:36:59 smithi193 ceph-mon[32782]: pgmap v17113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:37:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:01 smithi196 ceph-mon[32572]: pgmap v17114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:01 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31737.472996 secs 2024-04-26T20:37:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:01 smithi110 ceph-mon[28069]: pgmap v17114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:01 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31737.472996 secs 2024-04-26T20:37:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:01 smithi193 ceph-mon[32782]: pgmap v17114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:01 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31737.472996 secs 2024-04-26T20:37:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:04 smithi196 ceph-mon[32572]: pgmap v17115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:04 smithi110 ceph-mon[28069]: pgmap v17115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:04 smithi193 ceph-mon[32782]: pgmap v17115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:06 smithi110 ceph-mon[28069]: pgmap v17116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:06 smithi193 ceph-mon[32782]: pgmap v17116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:06 smithi196 ceph-mon[32572]: pgmap v17116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:07 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31742.473113 secs 2024-04-26T20:37:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:07 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31742.473113 secs 2024-04-26T20:37:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:07 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31742.473113 secs 2024-04-26T20:37:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:08 smithi110 ceph-mon[28069]: pgmap v17117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:08 smithi193 ceph-mon[32782]: pgmap v17117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:08 smithi196 ceph-mon[32572]: pgmap v17117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:10 smithi110 ceph-mon[28069]: pgmap v17118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:10 smithi193 ceph-mon[32782]: pgmap v17118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:10 smithi196 ceph-mon[32572]: pgmap v17118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:11 smithi110 ceph-mon[28069]: pgmap v17119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:11 smithi193 ceph-mon[32782]: pgmap v17119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:11 smithi196 ceph-mon[32572]: pgmap v17119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:12 smithi110 ceph-mon[28069]: 4 slow requests, 0 included below; oldest blocked for > 31747.473176 secs 2024-04-26T20:37:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:12 smithi193 ceph-mon[32782]: 4 slow requests, 0 included below; oldest blocked for > 31747.473176 secs 2024-04-26T20:37:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:12 smithi196 ceph-mon[32572]: 4 slow requests, 0 included below; oldest blocked for > 31747.473176 secs 2024-04-26T20:37:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:13 smithi110 ceph-mon[28069]: pgmap v17120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:13 smithi193 ceph-mon[32782]: pgmap v17120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:13 smithi196 ceph-mon[32572]: pgmap v17120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:15 smithi196 ceph-mon[32572]: pgmap v17121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:15 smithi110 ceph-mon[28069]: pgmap v17121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:15 smithi193 ceph-mon[32782]: pgmap v17121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:16 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 31752.473277 secs 2024-04-26T20:37:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:16 smithi196 ceph-mon[32572]: slow request 181.201152 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T20:37:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:16 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 31752.473277 secs 2024-04-26T20:37:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:16 smithi110 ceph-mon[28069]: slow request 181.201152 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T20:37:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:16 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 31752.473277 secs 2024-04-26T20:37:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:16 smithi193 ceph-mon[32782]: slow request 181.201152 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T20:37:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:17 smithi196 ceph-mon[32572]: pgmap v17122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:17 smithi110 ceph-mon[28069]: pgmap v17122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:17 smithi193 ceph-mon[32782]: pgmap v17122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:18 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:37:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:18 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:37:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:18 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:37:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:18 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:37:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:18 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:37:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:18 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:37:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:20 smithi196 ceph-mon[32572]: pgmap v17123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:19 smithi110 ceph-mon[28069]: pgmap v17123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:20 smithi193 ceph-mon[32782]: pgmap v17123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:22 smithi196 ceph-mon[32572]: pgmap v17124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31757.473396 secs 2024-04-26T20:37:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:22 smithi110 ceph-mon[28069]: pgmap v17124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31757.473396 secs 2024-04-26T20:37:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:22 smithi193 ceph-mon[32782]: pgmap v17124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31757.473396 secs 2024-04-26T20:37:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:24 smithi110 ceph-mon[28069]: pgmap v17125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:24 smithi193 ceph-mon[32782]: pgmap v17125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:24 smithi196 ceph-mon[32572]: pgmap v17125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:26 smithi110 ceph-mon[28069]: pgmap v17126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:26 smithi193 ceph-mon[32782]: pgmap v17126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:26 smithi196 ceph-mon[32572]: pgmap v17126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31762.473532 secs 2024-04-26T20:37:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31762.473532 secs 2024-04-26T20:37:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31762.473532 secs 2024-04-26T20:37:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:28 smithi110 ceph-mon[28069]: pgmap v17127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:28 smithi193 ceph-mon[32782]: pgmap v17127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:28 smithi196 ceph-mon[32572]: pgmap v17127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:30 smithi110 ceph-mon[28069]: pgmap v17128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:30 smithi193 ceph-mon[32782]: pgmap v17128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:30 smithi196 ceph-mon[32572]: pgmap v17128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:32 smithi110 ceph-mon[28069]: pgmap v17129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31767.473647 secs 2024-04-26T20:37:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:32 smithi193 ceph-mon[32782]: pgmap v17129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31767.473647 secs 2024-04-26T20:37:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:32 smithi196 ceph-mon[32572]: pgmap v17129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31767.473647 secs 2024-04-26T20:37:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:34 smithi193 ceph-mon[32782]: pgmap v17130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:34 smithi196 ceph-mon[32572]: pgmap v17130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:34 smithi110 ceph-mon[28069]: pgmap v17130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:36 smithi193 ceph-mon[32782]: pgmap v17131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:36 smithi196 ceph-mon[32572]: pgmap v17131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:36 smithi110 ceph-mon[28069]: pgmap v17131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:37.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31772.473768 secs 2024-04-26T20:37:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31772.473768 secs 2024-04-26T20:37:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31772.473768 secs 2024-04-26T20:37:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:38 smithi193 ceph-mon[32782]: pgmap v17132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:38 smithi196 ceph-mon[32572]: pgmap v17132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:38 smithi110 ceph-mon[28069]: pgmap v17132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:40 smithi193 ceph-mon[32782]: pgmap v17133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:40 smithi196 ceph-mon[32572]: pgmap v17133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:40 smithi110 ceph-mon[28069]: pgmap v17133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:42 smithi193 ceph-mon[32782]: pgmap v17134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31777.473890 secs 2024-04-26T20:37:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:42 smithi196 ceph-mon[32572]: pgmap v17134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31777.473890 secs 2024-04-26T20:37:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:42 smithi110 ceph-mon[28069]: pgmap v17134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31777.473890 secs 2024-04-26T20:37:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:44 smithi193 ceph-mon[32782]: pgmap v17135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:44 smithi196 ceph-mon[32572]: pgmap v17135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:44 smithi110 ceph-mon[28069]: pgmap v17135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:46 smithi193 ceph-mon[32782]: pgmap v17136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:46 smithi196 ceph-mon[32572]: pgmap v17136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:46 smithi110 ceph-mon[28069]: pgmap v17136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31782.474005 secs 2024-04-26T20:37:47.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31782.474005 secs 2024-04-26T20:37:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31782.474005 secs 2024-04-26T20:37:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:48 smithi193 ceph-mon[32782]: pgmap v17137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:48 smithi196 ceph-mon[32572]: pgmap v17137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:48 smithi110 ceph-mon[28069]: pgmap v17137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:37:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:50 smithi193 ceph-mon[32782]: pgmap v17138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:37:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:50 smithi196 ceph-mon[32572]: pgmap v17138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:37:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:50 smithi110 ceph-mon[28069]: pgmap v17138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:37:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:37:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:37:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:37:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:37:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:37:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:37:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:37:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:37:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:37:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:37:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:52 smithi193 ceph-mon[32782]: pgmap v17139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:37:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:52 smithi193 ceph-mon[32782]: pgmap v17140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31787.474079 secs 2024-04-26T20:37:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:52 smithi196 ceph-mon[32572]: pgmap v17139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:37:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:52 smithi196 ceph-mon[32572]: pgmap v17140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31787.474079 secs 2024-04-26T20:37:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:52 smithi110 ceph-mon[28069]: pgmap v17139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:37:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:52 smithi110 ceph-mon[28069]: pgmap v17140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31787.474079 secs 2024-04-26T20:37:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:54 smithi193 ceph-mon[32782]: pgmap v17141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:54 smithi196 ceph-mon[32572]: pgmap v17141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:54 smithi110 ceph-mon[28069]: pgmap v17141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:56 smithi193 ceph-mon[32782]: pgmap v17142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:56 smithi196 ceph-mon[32572]: pgmap v17142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:56 smithi110 ceph-mon[28069]: pgmap v17142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31792.474204 secs 2024-04-26T20:37:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31792.474204 secs 2024-04-26T20:37:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31792.474204 secs 2024-04-26T20:37:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:37:58 smithi196 ceph-mon[32572]: pgmap v17143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:37:58 smithi110 ceph-mon[28069]: pgmap v17143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:37:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:37:58 smithi193 ceph-mon[32782]: pgmap v17143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:38:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:00 smithi196 ceph-mon[32572]: pgmap v17144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:38:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:00 smithi110 ceph-mon[28069]: pgmap v17144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:38:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:00 smithi193 ceph-mon[32782]: pgmap v17144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:38:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:02 smithi196 ceph-mon[32572]: pgmap v17145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:38:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31797.474340 secs 2024-04-26T20:38:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:02 smithi110 ceph-mon[28069]: pgmap v17145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:38:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31797.474340 secs 2024-04-26T20:38:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:02 smithi193 ceph-mon[32782]: pgmap v17145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:38:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31797.474340 secs 2024-04-26T20:38:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:04 smithi196 ceph-mon[32572]: pgmap v17146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:04 smithi110 ceph-mon[28069]: pgmap v17146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:04 smithi193 ceph-mon[32782]: pgmap v17146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:06 smithi196 ceph-mon[32572]: pgmap v17147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:06 smithi110 ceph-mon[28069]: pgmap v17147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:06 smithi193 ceph-mon[32782]: pgmap v17147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:07 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 31802.474465 secs 2024-04-26T20:38:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:07 smithi196 ceph-mon[32572]: slow request 23042.287424 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:38:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:07 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 31802.474465 secs 2024-04-26T20:38:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:07 smithi110 ceph-mon[28069]: slow request 23042.287424 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:38:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:07 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 31802.474465 secs 2024-04-26T20:38:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:07 smithi193 ceph-mon[32782]: slow request 23042.287424 seconds old, received at 2024-04-26T14:14:04.485362+0000: client_request(client.26797:1 getattr pAsLsXsFs #0x1 2024-04-26T14:14:04.479639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:38:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:08 smithi196 ceph-mon[32572]: pgmap v17148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:08 smithi110 ceph-mon[28069]: pgmap v17148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:08 smithi193 ceph-mon[32782]: pgmap v17148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:09 smithi196 ceph-mon[32572]: pgmap v17149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:09 smithi110 ceph-mon[28069]: pgmap v17149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:09 smithi193 ceph-mon[32782]: pgmap v17149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:11 smithi110 ceph-mon[28069]: pgmap v17150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:11 smithi193 ceph-mon[32782]: pgmap v17150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:11 smithi196 ceph-mon[32572]: pgmap v17150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31807.474615 secs 2024-04-26T20:38:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31807.474615 secs 2024-04-26T20:38:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31807.474615 secs 2024-04-26T20:38:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:13 smithi193 ceph-mon[32782]: pgmap v17151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:13 smithi196 ceph-mon[32572]: pgmap v17151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:13 smithi110 ceph-mon[28069]: pgmap v17151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:15 smithi193 ceph-mon[32782]: pgmap v17152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:15 smithi196 ceph-mon[32572]: pgmap v17152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:15 smithi110 ceph-mon[28069]: pgmap v17152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:18.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:17 smithi196 ceph-mon[32572]: pgmap v17153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:18.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31812.474733 secs 2024-04-26T20:38:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:17 smithi193 ceph-mon[32782]: pgmap v17153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31812.474733 secs 2024-04-26T20:38:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:17 smithi110 ceph-mon[28069]: pgmap v17153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31812.474733 secs 2024-04-26T20:38:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:19 smithi193 ceph-mon[32782]: pgmap v17154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:19 smithi196 ceph-mon[32572]: pgmap v17154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:19 smithi110 ceph-mon[28069]: pgmap v17154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:21 smithi193 ceph-mon[32782]: pgmap v17155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:21 smithi196 ceph-mon[32572]: pgmap v17155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:21 smithi110 ceph-mon[28069]: pgmap v17155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31817.474844 secs 2024-04-26T20:38:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31817.474844 secs 2024-04-26T20:38:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31817.474844 secs 2024-04-26T20:38:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:23 smithi193 ceph-mon[32782]: pgmap v17156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:23 smithi196 ceph-mon[32572]: pgmap v17156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:23 smithi110 ceph-mon[28069]: pgmap v17156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:26.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:25 smithi110 ceph-mon[28069]: pgmap v17157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:25 smithi193 ceph-mon[32782]: pgmap v17157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:25 smithi196 ceph-mon[32572]: pgmap v17157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:27 smithi193 ceph-mon[32782]: pgmap v17158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:28.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31822.474925 secs 2024-04-26T20:38:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:27 smithi196 ceph-mon[32572]: pgmap v17158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31822.474925 secs 2024-04-26T20:38:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:27 smithi110 ceph-mon[28069]: pgmap v17158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31822.474925 secs 2024-04-26T20:38:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:29 smithi193 ceph-mon[32782]: pgmap v17159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:29 smithi196 ceph-mon[32572]: pgmap v17159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:29 smithi110 ceph-mon[28069]: pgmap v17159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:31 smithi193 ceph-mon[32782]: pgmap v17160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:31 smithi196 ceph-mon[32572]: pgmap v17160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:31 smithi110 ceph-mon[28069]: pgmap v17160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31827.475025 secs 2024-04-26T20:38:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31827.475025 secs 2024-04-26T20:38:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31827.475025 secs 2024-04-26T20:38:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:33 smithi193 ceph-mon[32782]: pgmap v17161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:33 smithi196 ceph-mon[32572]: pgmap v17161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:33 smithi110 ceph-mon[28069]: pgmap v17161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:35 smithi193 ceph-mon[32782]: pgmap v17162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:35 smithi196 ceph-mon[32572]: pgmap v17162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:35 smithi110 ceph-mon[28069]: pgmap v17162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:37 smithi196 ceph-mon[32572]: pgmap v17163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31832.475106 secs 2024-04-26T20:38:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:37 smithi110 ceph-mon[28069]: pgmap v17163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31832.475106 secs 2024-04-26T20:38:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:37 smithi193 ceph-mon[32782]: pgmap v17163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31832.475106 secs 2024-04-26T20:38:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:39 smithi196 ceph-mon[32572]: pgmap v17164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:39 smithi110 ceph-mon[28069]: pgmap v17164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:39 smithi193 ceph-mon[32782]: pgmap v17164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:41 smithi196 ceph-mon[32572]: pgmap v17165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:41 smithi110 ceph-mon[28069]: pgmap v17165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:41 smithi193 ceph-mon[32782]: pgmap v17165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31837.475229 secs 2024-04-26T20:38:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31837.475229 secs 2024-04-26T20:38:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31837.475229 secs 2024-04-26T20:38:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:43 smithi196 ceph-mon[32572]: pgmap v17166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:43 smithi110 ceph-mon[28069]: pgmap v17166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:43 smithi193 ceph-mon[32782]: pgmap v17166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:45 smithi196 ceph-mon[32572]: pgmap v17167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:45 smithi110 ceph-mon[28069]: pgmap v17167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:45 smithi193 ceph-mon[32782]: pgmap v17167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:47 smithi196 ceph-mon[32572]: pgmap v17168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31842.475345 secs 2024-04-26T20:38:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:47 smithi110 ceph-mon[28069]: pgmap v17168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31842.475345 secs 2024-04-26T20:38:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:47 smithi193 ceph-mon[32782]: pgmap v17168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:38:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31842.475345 secs 2024-04-26T20:38:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:49 smithi196 ceph-mon[32572]: pgmap v17169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:49 smithi110 ceph-mon[28069]: pgmap v17169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:49 smithi193 ceph-mon[32782]: pgmap v17169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:38:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:38:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:38:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:51 smithi196 ceph-mon[32572]: pgmap v17170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:38:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:51 smithi110 ceph-mon[28069]: pgmap v17170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:38:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:51 smithi193 ceph-mon[32782]: pgmap v17170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:38:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31847.475463 secs 2024-04-26T20:38:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:38:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:38:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:52 smithi196 ceph-mon[32572]: pgmap v17171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 799 B/s rd, 1 op/s 2024-04-26T20:38:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:38:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31847.475463 secs 2024-04-26T20:38:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:38:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:38:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:52 smithi110 ceph-mon[28069]: pgmap v17171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 799 B/s rd, 1 op/s 2024-04-26T20:38:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:38:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31847.475463 secs 2024-04-26T20:38:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:38:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:38:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:52 smithi193 ceph-mon[32782]: pgmap v17171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 799 B/s rd, 1 op/s 2024-04-26T20:38:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:38:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:55 smithi196 ceph-mon[32572]: pgmap v17172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 799 B/s rd, 1 op/s 2024-04-26T20:38:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:55 smithi110 ceph-mon[28069]: pgmap v17172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 799 B/s rd, 1 op/s 2024-04-26T20:38:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:55 smithi193 ceph-mon[32782]: pgmap v17172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 799 B/s rd, 1 op/s 2024-04-26T20:38:57.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:57 smithi193 ceph-mon[32782]: pgmap v17173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 799 B/s rd, 1 op/s 2024-04-26T20:38:57.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31852.475597 secs 2024-04-26T20:38:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:57 smithi196 ceph-mon[32572]: pgmap v17173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 799 B/s rd, 1 op/s 2024-04-26T20:38:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31852.475597 secs 2024-04-26T20:38:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:57 smithi110 ceph-mon[28069]: pgmap v17173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 799 B/s rd, 1 op/s 2024-04-26T20:38:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31852.475597 secs 2024-04-26T20:38:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:38:59 smithi196 ceph-mon[32572]: pgmap v17174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:38:59 smithi110 ceph-mon[28069]: pgmap v17174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:38:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:38:59 smithi193 ceph-mon[32782]: pgmap v17174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:01 smithi196 ceph-mon[32572]: pgmap v17175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:39:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:01 smithi110 ceph-mon[28069]: pgmap v17175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:39:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:01 smithi193 ceph-mon[32782]: pgmap v17175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:39:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31857.475720 secs 2024-04-26T20:39:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31857.475720 secs 2024-04-26T20:39:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31857.475720 secs 2024-04-26T20:39:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:03 smithi196 ceph-mon[32572]: pgmap v17176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:39:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:03 smithi110 ceph-mon[28069]: pgmap v17176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:39:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:03 smithi193 ceph-mon[32782]: pgmap v17176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:39:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:05 smithi196 ceph-mon[32572]: pgmap v17177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:05 smithi110 ceph-mon[28069]: pgmap v17177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:05 smithi193 ceph-mon[32782]: pgmap v17177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:07 smithi196 ceph-mon[32572]: pgmap v17178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31862.475830 secs 2024-04-26T20:39:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:07 smithi110 ceph-mon[28069]: pgmap v17178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31862.475830 secs 2024-04-26T20:39:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:07 smithi193 ceph-mon[32782]: pgmap v17178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31862.475830 secs 2024-04-26T20:39:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:09 smithi196 ceph-mon[32572]: pgmap v17179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:09 smithi110 ceph-mon[28069]: pgmap v17179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:09 smithi193 ceph-mon[32782]: pgmap v17179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:11 smithi196 ceph-mon[32572]: pgmap v17180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:11 smithi110 ceph-mon[28069]: pgmap v17180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:11 smithi193 ceph-mon[32782]: pgmap v17180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31867.475968 secs 2024-04-26T20:39:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:12 smithi196 ceph-mon[32572]: pgmap v17181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31867.475968 secs 2024-04-26T20:39:12.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:12 smithi110 ceph-mon[28069]: pgmap v17181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31867.475968 secs 2024-04-26T20:39:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:12 smithi193 ceph-mon[32782]: pgmap v17181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:15 smithi196 ceph-mon[32572]: pgmap v17182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:15 smithi110 ceph-mon[28069]: pgmap v17182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:15 smithi193 ceph-mon[32782]: pgmap v17182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:39:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:39:15.653+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:39:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:39:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:39:15.653+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:39:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:39:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:39:15.653+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:39:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:39:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:39:15.653+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:39:16.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:39:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:39:15.653+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:39:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:17 smithi196 ceph-mon[32572]: pgmap v17183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31872.476104 secs 2024-04-26T20:39:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:17 smithi110 ceph-mon[28069]: pgmap v17183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31872.476104 secs 2024-04-26T20:39:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:17 smithi193 ceph-mon[32782]: pgmap v17183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31872.476104 secs 2024-04-26T20:39:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:19 smithi196 ceph-mon[32572]: pgmap v17184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:39:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:19 smithi110 ceph-mon[28069]: pgmap v17184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:39:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:19 smithi193 ceph-mon[32782]: pgmap v17184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:39:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:21 smithi196 ceph-mon[32572]: pgmap v17185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:39:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:21 smithi110 ceph-mon[28069]: pgmap v17185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:39:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:21 smithi193 ceph-mon[32782]: pgmap v17185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:39:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:39:21.653+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec004770 con 0x7f261c104b50 2024-04-26T20:39:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:39:21.653+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:39:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:39:21.654+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 246 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:39:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:39:21.654+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 246 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec004770 con 0x55db1be4fdd0 2024-04-26T20:39:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31877.476178 secs 2024-04-26T20:39:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31877.476178 secs 2024-04-26T20:39:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31877.476178 secs 2024-04-26T20:39:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:23 smithi196 ceph-mon[32572]: pgmap v17186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:39:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:23 smithi110 ceph-mon[28069]: pgmap v17186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:39:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:23 smithi193 ceph-mon[32782]: pgmap v17186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:39:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:25 smithi196 ceph-mon[32572]: pgmap v17187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:39:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:25 smithi110 ceph-mon[28069]: pgmap v17187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:39:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:25 smithi193 ceph-mon[32782]: pgmap v17187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:39:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:27 smithi196 ceph-mon[32572]: pgmap v17188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:39:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31882.476302 secs 2024-04-26T20:39:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:27 smithi110 ceph-mon[28069]: pgmap v17188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:39:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31882.476302 secs 2024-04-26T20:39:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:27 smithi193 ceph-mon[32782]: pgmap v17188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:39:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31882.476302 secs 2024-04-26T20:39:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:28 smithi196 ceph-mon[32572]: pgmap v17189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:39:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:28 smithi110 ceph-mon[28069]: pgmap v17189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:39:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:28 smithi193 ceph-mon[32782]: pgmap v17189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:39:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:31 smithi196 ceph-mon[32572]: pgmap v17190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:31 smithi110 ceph-mon[28069]: pgmap v17190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:31 smithi193 ceph-mon[32782]: pgmap v17190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31887.476367 secs 2024-04-26T20:39:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31887.476367 secs 2024-04-26T20:39:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31887.476367 secs 2024-04-26T20:39:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:33 smithi196 ceph-mon[32572]: pgmap v17191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:33 smithi110 ceph-mon[28069]: pgmap v17191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:33 smithi193 ceph-mon[32782]: pgmap v17191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:35 smithi196 ceph-mon[32572]: pgmap v17192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:35 smithi110 ceph-mon[28069]: pgmap v17192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:35 smithi193 ceph-mon[32782]: pgmap v17192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:37 smithi196 ceph-mon[32572]: pgmap v17193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31892.476507 secs 2024-04-26T20:39:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:37 smithi110 ceph-mon[28069]: pgmap v17193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31892.476507 secs 2024-04-26T20:39:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:37 smithi193 ceph-mon[32782]: pgmap v17193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31892.476507 secs 2024-04-26T20:39:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:39 smithi196 ceph-mon[32572]: pgmap v17194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:39 smithi110 ceph-mon[28069]: pgmap v17194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:39 smithi193 ceph-mon[32782]: pgmap v17194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:41 smithi196 ceph-mon[32572]: pgmap v17195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:41 smithi110 ceph-mon[28069]: pgmap v17195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:41 smithi193 ceph-mon[32782]: pgmap v17195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31897.476594 secs 2024-04-26T20:39:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31897.476594 secs 2024-04-26T20:39:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31897.476594 secs 2024-04-26T20:39:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:43 smithi196 ceph-mon[32572]: pgmap v17196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:43 smithi110 ceph-mon[28069]: pgmap v17196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:43 smithi193 ceph-mon[32782]: pgmap v17196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:44 smithi196 ceph-mon[32572]: pgmap v17197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:44 smithi110 ceph-mon[28069]: pgmap v17197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:44 smithi193 ceph-mon[32782]: pgmap v17197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:47 smithi196 ceph-mon[32572]: pgmap v17198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31902.476691 secs 2024-04-26T20:39:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:47 smithi110 ceph-mon[28069]: pgmap v17198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31902.476691 secs 2024-04-26T20:39:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:47 smithi193 ceph-mon[32782]: pgmap v17198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31902.476691 secs 2024-04-26T20:39:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:49 smithi196 ceph-mon[32572]: pgmap v17199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:49 smithi110 ceph-mon[28069]: pgmap v17199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:49 smithi193 ceph-mon[32782]: pgmap v17199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:51 smithi196 ceph-mon[32572]: pgmap v17200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:51 smithi110 ceph-mon[28069]: pgmap v17200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:51 smithi193 ceph-mon[32782]: pgmap v17200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31907.476801 secs 2024-04-26T20:39:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31907.476801 secs 2024-04-26T20:39:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31907.476801 secs 2024-04-26T20:39:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:53 smithi196 ceph-mon[32572]: pgmap v17201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:39:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:53 smithi110 ceph-mon[28069]: pgmap v17201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:39:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:53 smithi193 ceph-mon[32782]: pgmap v17201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:39:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:39:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:39:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:39:54.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:54 smithi196 ceph-mon[32572]: pgmap v17202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:39:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:39:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:54 smithi110 ceph-mon[28069]: pgmap v17202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:39:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:39:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:54 smithi193 ceph-mon[32782]: pgmap v17202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:39:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:39:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:55 smithi196 ceph-mon[32572]: pgmap v17203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T20:39:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:55 smithi196 ceph-mon[32572]: pgmap v17204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:39:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:39:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:39:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:55 smithi110 ceph-mon[28069]: pgmap v17203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T20:39:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:55 smithi110 ceph-mon[28069]: pgmap v17204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:55.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:39:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:39:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:39:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:55 smithi193 ceph-mon[32782]: pgmap v17203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s 2024-04-26T20:39:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:55 smithi193 ceph-mon[32782]: pgmap v17204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:39:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:57 smithi110 ceph-mon[28069]: pgmap v17205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T20:39:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31912.476925 secs 2024-04-26T20:39:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:57 smithi193 ceph-mon[32782]: pgmap v17205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T20:39:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31912.476925 secs 2024-04-26T20:39:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:57 smithi196 ceph-mon[32572]: pgmap v17205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T20:39:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31912.476925 secs 2024-04-26T20:39:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:39:59 smithi110 ceph-mon[28069]: pgmap v17206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:39:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:39:59 smithi193 ceph-mon[32782]: pgmap v17206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:39:59 smithi196 ceph-mon[32572]: pgmap v17206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:40:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:40:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:40:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:01 smithi193 ceph-mon[32782]: pgmap v17207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:01 smithi196 ceph-mon[32572]: pgmap v17207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:01 smithi110 ceph-mon[28069]: pgmap v17207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31917.477053 secs 2024-04-26T20:40:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31917.477053 secs 2024-04-26T20:40:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31917.477053 secs 2024-04-26T20:40:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:03 smithi193 ceph-mon[32782]: pgmap v17208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:03 smithi196 ceph-mon[32572]: pgmap v17208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:03 smithi110 ceph-mon[28069]: pgmap v17208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:05 smithi193 ceph-mon[32782]: pgmap v17209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:40:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:05 smithi196 ceph-mon[32572]: pgmap v17209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:40:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:05 smithi110 ceph-mon[28069]: pgmap v17209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:40:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:07 smithi193 ceph-mon[32782]: pgmap v17210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31922.477199 secs 2024-04-26T20:40:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:07 smithi196 ceph-mon[32572]: pgmap v17210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31922.477199 secs 2024-04-26T20:40:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:07 smithi110 ceph-mon[28069]: pgmap v17210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31922.477199 secs 2024-04-26T20:40:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:09 smithi193 ceph-mon[32782]: pgmap v17211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:09 smithi196 ceph-mon[32572]: pgmap v17211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:09 smithi110 ceph-mon[28069]: pgmap v17211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:11 smithi193 ceph-mon[32782]: pgmap v17212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:11 smithi196 ceph-mon[32572]: pgmap v17212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:11 smithi110 ceph-mon[28069]: pgmap v17212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31927.477336 secs 2024-04-26T20:40:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31927.477336 secs 2024-04-26T20:40:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31927.477336 secs 2024-04-26T20:40:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:13 smithi193 ceph-mon[32782]: pgmap v17213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:13 smithi196 ceph-mon[32572]: pgmap v17213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:13 smithi110 ceph-mon[28069]: pgmap v17213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:15 smithi193 ceph-mon[32782]: pgmap v17214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:15 smithi196 ceph-mon[32572]: pgmap v17214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:15 smithi110 ceph-mon[28069]: pgmap v17214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:17 smithi193 ceph-mon[32782]: pgmap v17215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:17 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 31932.477482 secs 2024-04-26T20:40:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:17 smithi193 ceph-mon[32782]: slow request 361.205356 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:17 smithi196 ceph-mon[32572]: pgmap v17215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:17 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 31932.477482 secs 2024-04-26T20:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:17 smithi196 ceph-mon[32572]: slow request 361.205356 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:40:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:17 smithi110 ceph-mon[28069]: pgmap v17215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:17 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 31932.477482 secs 2024-04-26T20:40:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:17 smithi110 ceph-mon[28069]: slow request 361.205356 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:40:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:19 smithi193 ceph-mon[32782]: pgmap v17216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:19 smithi196 ceph-mon[32572]: pgmap v17216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:19 smithi110 ceph-mon[28069]: pgmap v17216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:21 smithi193 ceph-mon[32782]: pgmap v17217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:21 smithi196 ceph-mon[32572]: pgmap v17217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:21 smithi110 ceph-mon[28069]: pgmap v17217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31937.477553 secs 2024-04-26T20:40:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31937.477553 secs 2024-04-26T20:40:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31937.477553 secs 2024-04-26T20:40:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:23 smithi196 ceph-mon[32572]: pgmap v17218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:23 smithi110 ceph-mon[28069]: pgmap v17218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:23 smithi193 ceph-mon[32782]: pgmap v17218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:25 smithi196 ceph-mon[32572]: pgmap v17219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:25 smithi110 ceph-mon[28069]: pgmap v17219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:25 smithi193 ceph-mon[32782]: pgmap v17219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:27.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:27 smithi193 ceph-mon[32782]: pgmap v17220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:27.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31942.477672 secs 2024-04-26T20:40:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:27 smithi196 ceph-mon[32572]: pgmap v17220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31942.477672 secs 2024-04-26T20:40:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:27 smithi110 ceph-mon[28069]: pgmap v17220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31942.477672 secs 2024-04-26T20:40:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:29 smithi196 ceph-mon[32572]: pgmap v17221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:29 smithi110 ceph-mon[28069]: pgmap v17221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:29 smithi193 ceph-mon[32782]: pgmap v17221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:31 smithi196 ceph-mon[32572]: pgmap v17222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:31 smithi110 ceph-mon[28069]: pgmap v17222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:31 smithi193 ceph-mon[32782]: pgmap v17222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31947.477773 secs 2024-04-26T20:40:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31947.477773 secs 2024-04-26T20:40:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31947.477773 secs 2024-04-26T20:40:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:33 smithi196 ceph-mon[32572]: pgmap v17223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:33 smithi110 ceph-mon[28069]: pgmap v17223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:33 smithi193 ceph-mon[32782]: pgmap v17223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:35 smithi196 ceph-mon[32572]: pgmap v17224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:35 smithi110 ceph-mon[28069]: pgmap v17224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:35 smithi193 ceph-mon[32782]: pgmap v17224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:37 smithi196 ceph-mon[32572]: pgmap v17225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31952.477914 secs 2024-04-26T20:40:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:37 smithi110 ceph-mon[28069]: pgmap v17225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31952.477914 secs 2024-04-26T20:40:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:37 smithi193 ceph-mon[32782]: pgmap v17225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31952.477914 secs 2024-04-26T20:40:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:39 smithi196 ceph-mon[32572]: pgmap v17226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:39 smithi110 ceph-mon[28069]: pgmap v17226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:39 smithi193 ceph-mon[32782]: pgmap v17226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:41 smithi196 ceph-mon[32572]: pgmap v17227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:41 smithi110 ceph-mon[28069]: pgmap v17227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:41 smithi193 ceph-mon[32782]: pgmap v17227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31957.478035 secs 2024-04-26T20:40:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31957.478035 secs 2024-04-26T20:40:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31957.478035 secs 2024-04-26T20:40:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:43 smithi196 ceph-mon[32572]: pgmap v17228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:43 smithi110 ceph-mon[28069]: pgmap v17228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:43 smithi193 ceph-mon[32782]: pgmap v17228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:45 smithi196 ceph-mon[32572]: pgmap v17229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:45 smithi110 ceph-mon[28069]: pgmap v17229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:45 smithi193 ceph-mon[32782]: pgmap v17229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:47 smithi196 ceph-mon[32572]: pgmap v17230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31962.478134 secs 2024-04-26T20:40:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:47 smithi110 ceph-mon[28069]: pgmap v17230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31962.478134 secs 2024-04-26T20:40:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:47 smithi193 ceph-mon[32782]: pgmap v17230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31962.478134 secs 2024-04-26T20:40:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:49 smithi196 ceph-mon[32572]: pgmap v17231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:49 smithi110 ceph-mon[28069]: pgmap v17231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:49 smithi193 ceph-mon[32782]: pgmap v17231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:51 smithi196 ceph-mon[32572]: pgmap v17232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:51 smithi110 ceph-mon[28069]: pgmap v17232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:51 smithi193 ceph-mon[32782]: pgmap v17232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31967.478254 secs 2024-04-26T20:40:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31967.478254 secs 2024-04-26T20:40:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31967.478254 secs 2024-04-26T20:40:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:53 smithi196 ceph-mon[32572]: pgmap v17233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:53 smithi110 ceph-mon[28069]: pgmap v17233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:53 smithi193 ceph-mon[32782]: pgmap v17233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:40:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:55 smithi196 ceph-mon[32572]: pgmap v17234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:40:56.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:55 smithi110 ceph-mon[28069]: pgmap v17234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:40:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:55 smithi193 ceph-mon[32782]: pgmap v17234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:40:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:40:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:40:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:40:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:56 smithi196 ceph-mon[32572]: pgmap v17235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T20:40:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:56 smithi196 ceph-mon[32572]: pgmap v17236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:40:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:57.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:40:57.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:40:57.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:56 smithi193 ceph-mon[32782]: pgmap v17235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T20:40:57.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:56 smithi193 ceph-mon[32782]: pgmap v17236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:40:57.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:40:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:40:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:56 smithi110 ceph-mon[28069]: pgmap v17235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T20:40:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:56 smithi110 ceph-mon[28069]: pgmap v17236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:40:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:40:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31972.478371 secs 2024-04-26T20:40:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31972.478371 secs 2024-04-26T20:40:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31972.478371 secs 2024-04-26T20:40:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:40:58 smithi110 ceph-mon[28069]: pgmap v17237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:40:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:40:58 smithi193 ceph-mon[32782]: pgmap v17237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:40:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:40:58 smithi196 ceph-mon[32572]: pgmap v17237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:41:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:00 smithi196 ceph-mon[32572]: pgmap v17238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:41:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:00 smithi110 ceph-mon[28069]: pgmap v17238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:41:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:00 smithi193 ceph-mon[32782]: pgmap v17238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:41:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31977.478487 secs 2024-04-26T20:41:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31977.478487 secs 2024-04-26T20:41:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31977.478487 secs 2024-04-26T20:41:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:03 smithi193 ceph-mon[32782]: pgmap v17239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T20:41:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:03 smithi196 ceph-mon[32572]: pgmap v17239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T20:41:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:03 smithi110 ceph-mon[28069]: pgmap v17239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T20:41:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:04 smithi196 ceph-mon[32572]: pgmap v17240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:41:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:04 smithi110 ceph-mon[28069]: pgmap v17240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:41:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:04 smithi193 ceph-mon[32782]: pgmap v17240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:41:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:06 smithi196 ceph-mon[32572]: pgmap v17241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:41:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:06 smithi110 ceph-mon[28069]: pgmap v17241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:41:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:06 smithi193 ceph-mon[32782]: pgmap v17241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:41:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31982.478605 secs 2024-04-26T20:41:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31982.478605 secs 2024-04-26T20:41:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31982.478605 secs 2024-04-26T20:41:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:08 smithi110 ceph-mon[28069]: pgmap v17242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:08 smithi193 ceph-mon[32782]: pgmap v17242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:08 smithi196 ceph-mon[32572]: pgmap v17242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:10 smithi196 ceph-mon[32572]: pgmap v17243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:10 smithi110 ceph-mon[28069]: pgmap v17243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:10 smithi193 ceph-mon[32782]: pgmap v17243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31987.478723 secs 2024-04-26T20:41:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31987.478723 secs 2024-04-26T20:41:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31987.478723 secs 2024-04-26T20:41:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:13 smithi193 ceph-mon[32782]: pgmap v17244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:13 smithi196 ceph-mon[32572]: pgmap v17244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:13 smithi110 ceph-mon[28069]: pgmap v17244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:14 smithi196 ceph-mon[32572]: pgmap v17245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:14 smithi110 ceph-mon[28069]: pgmap v17245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:14 smithi193 ceph-mon[32782]: pgmap v17245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:16 smithi196 ceph-mon[32572]: pgmap v17246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:16 smithi110 ceph-mon[28069]: pgmap v17246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:16 smithi193 ceph-mon[32782]: pgmap v17246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:17 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 31992.478821 secs 2024-04-26T20:41:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:17 smithi196 ceph-mon[32572]: slow request 721.434283 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:41:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:17 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 31992.478821 secs 2024-04-26T20:41:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:17 smithi110 ceph-mon[28069]: slow request 721.434283 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:41:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:17 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 31992.478821 secs 2024-04-26T20:41:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:17 smithi193 ceph-mon[32782]: slow request 721.434283 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:41:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:18 smithi110 ceph-mon[28069]: pgmap v17247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:18 smithi193 ceph-mon[32782]: pgmap v17247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:18 smithi196 ceph-mon[32572]: pgmap v17247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:20 smithi196 ceph-mon[32572]: pgmap v17248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:20 smithi110 ceph-mon[28069]: pgmap v17248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:20 smithi193 ceph-mon[32782]: pgmap v17248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 31997.478905 secs 2024-04-26T20:41:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 31997.478905 secs 2024-04-26T20:41:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 31997.478905 secs 2024-04-26T20:41:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:23 smithi193 ceph-mon[32782]: pgmap v17249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:23 smithi196 ceph-mon[32572]: pgmap v17249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:23 smithi110 ceph-mon[28069]: pgmap v17249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:24 smithi196 ceph-mon[32572]: pgmap v17250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:24 smithi110 ceph-mon[28069]: pgmap v17250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:24 smithi193 ceph-mon[32782]: pgmap v17250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:26 smithi196 ceph-mon[32572]: pgmap v17251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:26 smithi110 ceph-mon[28069]: pgmap v17251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:26 smithi193 ceph-mon[32782]: pgmap v17251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32002.479025 secs 2024-04-26T20:41:27.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32002.479025 secs 2024-04-26T20:41:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32002.479025 secs 2024-04-26T20:41:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:28 smithi110 ceph-mon[28069]: pgmap v17252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:28 smithi193 ceph-mon[32782]: pgmap v17252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:28 smithi196 ceph-mon[32572]: pgmap v17252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:30 smithi196 ceph-mon[32572]: pgmap v17253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:30 smithi110 ceph-mon[28069]: pgmap v17253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:30 smithi193 ceph-mon[32782]: pgmap v17253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32007.479159 secs 2024-04-26T20:41:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32007.479159 secs 2024-04-26T20:41:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32007.479159 secs 2024-04-26T20:41:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:33 smithi193 ceph-mon[32782]: pgmap v17254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:33 smithi196 ceph-mon[32572]: pgmap v17254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:33 smithi110 ceph-mon[28069]: pgmap v17254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:34 smithi196 ceph-mon[32572]: pgmap v17255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:34 smithi110 ceph-mon[28069]: pgmap v17255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:34 smithi193 ceph-mon[32782]: pgmap v17255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:36 smithi196 ceph-mon[32572]: pgmap v17256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:36 smithi110 ceph-mon[28069]: pgmap v17256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:36 smithi193 ceph-mon[32782]: pgmap v17256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32012.479259 secs 2024-04-26T20:41:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32012.479259 secs 2024-04-26T20:41:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32012.479259 secs 2024-04-26T20:41:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:38 smithi110 ceph-mon[28069]: pgmap v17257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:38 smithi193 ceph-mon[32782]: pgmap v17257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:38 smithi196 ceph-mon[32572]: pgmap v17257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:40 smithi110 ceph-mon[28069]: pgmap v17258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:40 smithi193 ceph-mon[32782]: pgmap v17258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:40 smithi196 ceph-mon[32572]: pgmap v17258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32017.479359 secs 2024-04-26T20:41:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32017.479359 secs 2024-04-26T20:41:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32017.479359 secs 2024-04-26T20:41:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:43 smithi193 ceph-mon[32782]: pgmap v17259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:43 smithi196 ceph-mon[32572]: pgmap v17259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:43 smithi110 ceph-mon[28069]: pgmap v17259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:44 smithi110 ceph-mon[28069]: pgmap v17260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:44 smithi193 ceph-mon[32782]: pgmap v17260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:44 smithi196 ceph-mon[32572]: pgmap v17260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:46 smithi110 ceph-mon[28069]: pgmap v17261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:46 smithi193 ceph-mon[32782]: pgmap v17261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:46 smithi196 ceph-mon[32572]: pgmap v17261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32022.479507 secs 2024-04-26T20:41:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32022.479507 secs 2024-04-26T20:41:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32022.479507 secs 2024-04-26T20:41:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:48 smithi110 ceph-mon[28069]: pgmap v17262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:48.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:48 smithi193 ceph-mon[32782]: pgmap v17262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:48 smithi196 ceph-mon[32572]: pgmap v17262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:50 smithi110 ceph-mon[28069]: pgmap v17263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:50.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:50 smithi196 ceph-mon[32572]: pgmap v17263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:50 smithi193 ceph-mon[32782]: pgmap v17263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32027.479646 secs 2024-04-26T20:41:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32027.479646 secs 2024-04-26T20:41:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32027.479646 secs 2024-04-26T20:41:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:53 smithi193 ceph-mon[32782]: pgmap v17264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:53 smithi196 ceph-mon[32572]: pgmap v17264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:53 smithi110 ceph-mon[28069]: pgmap v17264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:54 smithi110 ceph-mon[28069]: pgmap v17265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:54 smithi193 ceph-mon[32782]: pgmap v17265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:54 smithi196 ceph-mon[32572]: pgmap v17265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:56 smithi110 ceph-mon[28069]: pgmap v17266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:56 smithi193 ceph-mon[32782]: pgmap v17266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:56 smithi196 ceph-mon[32572]: pgmap v17266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:41:57.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:41:57.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32032.479732 secs 2024-04-26T20:41:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:41:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32032.479732 secs 2024-04-26T20:41:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:41:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32032.479732 secs 2024-04-26T20:41:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:58 smithi110 ceph-mon[28069]: pgmap v17267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:58 smithi193 ceph-mon[32782]: pgmap v17267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:58 smithi196 ceph-mon[32572]: pgmap v17267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:41:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:41:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:41:59.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:41:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:41:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:41:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:42:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:42:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:00.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:42:00.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:42:00.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: pgmap v17268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:00.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:00.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:42:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:42:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: pgmap v17268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:01.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:01.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:42:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:42:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:42:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:42:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: pgmap v17268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:42:02.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:42:02.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:42:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:42:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:42:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:42:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32037.479854 secs 2024-04-26T20:42:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:02 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:42:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:02 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:42:03.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:02 smithi193 ceph-mon[32782]: pgmap v17269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T20:42:03.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:02 smithi193 ceph-mon[32782]: pgmap v17270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32037.479854 secs 2024-04-26T20:42:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:02 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:42:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:02 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:42:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:02 smithi196 ceph-mon[32572]: pgmap v17269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T20:42:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:02 smithi196 ceph-mon[32572]: pgmap v17270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32037.479854 secs 2024-04-26T20:42:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:02 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:42:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:02 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:42:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:02 smithi110 ceph-mon[28069]: pgmap v17269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T20:42:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:02 smithi110 ceph-mon[28069]: pgmap v17270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:04 smithi193 ceph-mon[32782]: pgmap v17271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:04 smithi196 ceph-mon[32572]: pgmap v17271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:04 smithi110 ceph-mon[28069]: pgmap v17271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:06 smithi196 ceph-mon[32572]: pgmap v17272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:06 smithi110 ceph-mon[28069]: pgmap v17272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:06 smithi193 ceph-mon[32782]: pgmap v17272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32042.479934 secs 2024-04-26T20:42:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32042.479934 secs 2024-04-26T20:42:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32042.479934 secs 2024-04-26T20:42:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:08 smithi196 ceph-mon[32572]: pgmap v17273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:08 smithi110 ceph-mon[28069]: pgmap v17273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:08 smithi193 ceph-mon[32782]: pgmap v17273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:10 smithi196 ceph-mon[32572]: pgmap v17274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:10 smithi110 ceph-mon[28069]: pgmap v17274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:10 smithi193 ceph-mon[32782]: pgmap v17274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:42:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32047.480050 secs 2024-04-26T20:42:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:12 smithi196 ceph-mon[32572]: pgmap v17275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:42:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32047.480050 secs 2024-04-26T20:42:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:12 smithi110 ceph-mon[28069]: pgmap v17275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:42:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32047.480050 secs 2024-04-26T20:42:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:12 smithi193 ceph-mon[32782]: pgmap v17275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:42:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:14 smithi196 ceph-mon[32572]: pgmap v17276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:14 smithi110 ceph-mon[28069]: pgmap v17276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:14 smithi193 ceph-mon[32782]: pgmap v17276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:16 smithi196 ceph-mon[32572]: pgmap v17277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:16 smithi110 ceph-mon[28069]: pgmap v17277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:17.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:16 smithi193 ceph-mon[32782]: pgmap v17277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32052.480204 secs 2024-04-26T20:42:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32052.480204 secs 2024-04-26T20:42:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32052.480204 secs 2024-04-26T20:42:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:18 smithi196 ceph-mon[32572]: pgmap v17278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:18 smithi110 ceph-mon[28069]: pgmap v17278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:18 smithi193 ceph-mon[32782]: pgmap v17278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:20 smithi196 ceph-mon[32572]: pgmap v17279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:20 smithi110 ceph-mon[28069]: pgmap v17279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:20 smithi193 ceph-mon[32782]: pgmap v17279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:42:21.681+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:42:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:42:21.681+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006440 con 0x7f261c104b50 2024-04-26T20:42:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:42:21.682+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 247 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006440 con 0x55db1be4fdd0 2024-04-26T20:42:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:42:21.682+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 247 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:42:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32057.480333 secs 2024-04-26T20:42:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:22 smithi196 ceph-mon[32572]: pgmap v17280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32057.480333 secs 2024-04-26T20:42:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:22 smithi110 ceph-mon[28069]: pgmap v17280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32057.480333 secs 2024-04-26T20:42:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:22 smithi193 ceph-mon[32782]: pgmap v17280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:24 smithi196 ceph-mon[32572]: pgmap v17281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:24 smithi110 ceph-mon[28069]: pgmap v17281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:24 smithi193 ceph-mon[32782]: pgmap v17281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:26 smithi196 ceph-mon[32572]: pgmap v17282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:26 smithi110 ceph-mon[28069]: pgmap v17282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:26 smithi193 ceph-mon[32782]: pgmap v17282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32062.480456 secs 2024-04-26T20:42:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32062.480456 secs 2024-04-26T20:42:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32062.480456 secs 2024-04-26T20:42:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:28 smithi196 ceph-mon[32572]: pgmap v17283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:28 smithi110 ceph-mon[28069]: pgmap v17283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:29.365 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:28 smithi193 ceph-mon[32782]: pgmap v17283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:30 smithi196 ceph-mon[32572]: pgmap v17284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:30 smithi110 ceph-mon[28069]: pgmap v17284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:30 smithi193 ceph-mon[32782]: pgmap v17284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32067.480590 secs 2024-04-26T20:42:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:32 smithi196 ceph-mon[32572]: pgmap v17285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32067.480590 secs 2024-04-26T20:42:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:32 smithi110 ceph-mon[28069]: pgmap v17285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32067.480590 secs 2024-04-26T20:42:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:32 smithi193 ceph-mon[32782]: pgmap v17285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:34 smithi196 ceph-mon[32572]: pgmap v17286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:34 smithi110 ceph-mon[28069]: pgmap v17286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:34 smithi193 ceph-mon[32782]: pgmap v17286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:36 smithi196 ceph-mon[32572]: pgmap v17287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:36 smithi110 ceph-mon[28069]: pgmap v17287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:36 smithi193 ceph-mon[32782]: pgmap v17287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32072.480726 secs 2024-04-26T20:42:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32072.480726 secs 2024-04-26T20:42:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32072.480726 secs 2024-04-26T20:42:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:38 smithi193 ceph-mon[32782]: pgmap v17288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:38 smithi196 ceph-mon[32572]: pgmap v17288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:38 smithi110 ceph-mon[28069]: pgmap v17288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:41 smithi196 ceph-mon[32572]: pgmap v17289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:41 smithi110 ceph-mon[28069]: pgmap v17289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:41 smithi193 ceph-mon[32782]: pgmap v17289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:43 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32077.480841 secs 2024-04-26T20:42:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:43 smithi110 ceph-mon[28069]: pgmap v17290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:43 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32077.480841 secs 2024-04-26T20:42:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:43 smithi193 ceph-mon[32782]: pgmap v17290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:43.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:43 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32077.480841 secs 2024-04-26T20:42:43.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:43 smithi196 ceph-mon[32572]: pgmap v17290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:45 smithi110 ceph-mon[28069]: pgmap v17291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:45 smithi193 ceph-mon[32782]: pgmap v17291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:45 smithi196 ceph-mon[32572]: pgmap v17291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:47 smithi110 ceph-mon[28069]: pgmap v17292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32082.480978 secs 2024-04-26T20:42:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:47 smithi193 ceph-mon[32782]: pgmap v17292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32082.480978 secs 2024-04-26T20:42:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:47 smithi196 ceph-mon[32572]: pgmap v17292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32082.480978 secs 2024-04-26T20:42:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:49 smithi110 ceph-mon[28069]: pgmap v17293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:49 smithi193 ceph-mon[32782]: pgmap v17293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:49 smithi196 ceph-mon[32572]: pgmap v17293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:51 smithi110 ceph-mon[28069]: pgmap v17294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:51.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:51 smithi196 ceph-mon[32572]: pgmap v17294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:51.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:51 smithi193 ceph-mon[32782]: pgmap v17294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32087.481094 secs 2024-04-26T20:42:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32087.481094 secs 2024-04-26T20:42:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32087.481094 secs 2024-04-26T20:42:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:53 smithi110 ceph-mon[28069]: pgmap v17295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:53 smithi193 ceph-mon[32782]: pgmap v17295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:53 smithi196 ceph-mon[32572]: pgmap v17295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:55 smithi193 ceph-mon[32782]: pgmap v17296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:55 smithi196 ceph-mon[32572]: pgmap v17296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:55 smithi110 ceph-mon[28069]: pgmap v17296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:57.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:57 smithi110 ceph-mon[28069]: pgmap v17297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:57.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32092.481233 secs 2024-04-26T20:42:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:57 smithi193 ceph-mon[32782]: pgmap v17297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32092.481233 secs 2024-04-26T20:42:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:57 smithi196 ceph-mon[32572]: pgmap v17297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:42:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32092.481233 secs 2024-04-26T20:42:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:42:59 smithi193 ceph-mon[32782]: pgmap v17298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:42:59 smithi196 ceph-mon[32572]: pgmap v17298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:42:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:42:59 smithi110 ceph-mon[28069]: pgmap v17298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:01 smithi193 ceph-mon[32782]: pgmap v17299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:01 smithi196 ceph-mon[32572]: pgmap v17299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:01 smithi110 ceph-mon[28069]: pgmap v17299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32097.481358 secs 2024-04-26T20:43:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32097.481358 secs 2024-04-26T20:43:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32097.481358 secs 2024-04-26T20:43:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:03 smithi193 ceph-mon[32782]: pgmap v17300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:43:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:03 smithi196 ceph-mon[32572]: pgmap v17300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:43:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:03 smithi110 ceph-mon[28069]: pgmap v17300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:43:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:43:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:43:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:43:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:43:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:43:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:43:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:43:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:43:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:43:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:05 smithi193 ceph-mon[32782]: pgmap v17301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:43:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:05 smithi193 ceph-mon[32782]: pgmap v17302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:05 smithi196 ceph-mon[32572]: pgmap v17301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:43:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:05 smithi196 ceph-mon[32572]: pgmap v17302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:05 smithi110 ceph-mon[28069]: pgmap v17301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:43:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:05 smithi110 ceph-mon[28069]: pgmap v17302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:07 smithi193 ceph-mon[32782]: pgmap v17303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:07 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 32102.481479 secs 2024-04-26T20:43:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:07 smithi193 ceph-mon[32782]: slow request 23042.200001 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:43:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:07 smithi196 ceph-mon[32572]: pgmap v17303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:07 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 32102.481479 secs 2024-04-26T20:43:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:07 smithi196 ceph-mon[32572]: slow request 23042.200001 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:43:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:07 smithi110 ceph-mon[28069]: pgmap v17303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:07 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 32102.481479 secs 2024-04-26T20:43:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:07 smithi110 ceph-mon[28069]: slow request 23042.200001 seconds old, received at 2024-04-26T14:19:04.579799+0000: client_request(client.26741:1 getattr pAsLsXsFs #0x1 2024-04-26T14:19:04.574917+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:43:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:09 smithi193 ceph-mon[32782]: pgmap v17304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:43:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:09 smithi196 ceph-mon[32572]: pgmap v17304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:43:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:09 smithi110 ceph-mon[28069]: pgmap v17304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:43:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:11 smithi193 ceph-mon[32782]: pgmap v17305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:11 smithi196 ceph-mon[32572]: pgmap v17305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:11 smithi110 ceph-mon[28069]: pgmap v17305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32107.481595 secs 2024-04-26T20:43:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32107.481595 secs 2024-04-26T20:43:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32107.481595 secs 2024-04-26T20:43:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:13 smithi193 ceph-mon[32782]: pgmap v17306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:13.901 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:13 smithi110 ceph-mon[28069]: pgmap v17306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:13.901 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:13 smithi196 ceph-mon[32572]: pgmap v17306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:43:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:15 smithi193 ceph-mon[32782]: pgmap v17307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:43:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:15 smithi196 ceph-mon[32572]: pgmap v17307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:43:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:15 smithi110 ceph-mon[28069]: pgmap v17307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:43:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:17 smithi196 ceph-mon[32572]: pgmap v17308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32112.481728 secs 2024-04-26T20:43:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:17 smithi110 ceph-mon[28069]: pgmap v17308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32112.481728 secs 2024-04-26T20:43:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:17 smithi193 ceph-mon[32782]: pgmap v17308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32112.481728 secs 2024-04-26T20:43:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:19 smithi196 ceph-mon[32572]: pgmap v17309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:19 smithi110 ceph-mon[28069]: pgmap v17309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:19 smithi193 ceph-mon[32782]: pgmap v17309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:21 smithi196 ceph-mon[32572]: pgmap v17310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:21 smithi110 ceph-mon[28069]: pgmap v17310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:21 smithi193 ceph-mon[32782]: pgmap v17310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32117.481826 secs 2024-04-26T20:43:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32117.481826 secs 2024-04-26T20:43:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32117.481826 secs 2024-04-26T20:43:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:23 smithi196 ceph-mon[32572]: pgmap v17311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:23 smithi110 ceph-mon[28069]: pgmap v17311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:23 smithi193 ceph-mon[32782]: pgmap v17311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:25 smithi196 ceph-mon[32572]: pgmap v17312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:25 smithi110 ceph-mon[28069]: pgmap v17312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:25 smithi193 ceph-mon[32782]: pgmap v17312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:27.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:27 smithi193 ceph-mon[32782]: pgmap v17313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:27.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32122.481898 secs 2024-04-26T20:43:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:27 smithi196 ceph-mon[32572]: pgmap v17313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32122.481898 secs 2024-04-26T20:43:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:27 smithi110 ceph-mon[28069]: pgmap v17313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32122.481898 secs 2024-04-26T20:43:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:29 smithi196 ceph-mon[32572]: pgmap v17314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:29 smithi110 ceph-mon[28069]: pgmap v17314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:29 smithi193 ceph-mon[32782]: pgmap v17314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:31 smithi196 ceph-mon[32572]: pgmap v17315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:31 smithi110 ceph-mon[28069]: pgmap v17315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:31 smithi193 ceph-mon[32782]: pgmap v17315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32127.481992 secs 2024-04-26T20:43:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32127.481992 secs 2024-04-26T20:43:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32127.481992 secs 2024-04-26T20:43:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:33 smithi196 ceph-mon[32572]: pgmap v17316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:33 smithi110 ceph-mon[28069]: pgmap v17316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:33 smithi193 ceph-mon[32782]: pgmap v17316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:35 smithi196 ceph-mon[32572]: pgmap v17317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:35 smithi110 ceph-mon[28069]: pgmap v17317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:35 smithi193 ceph-mon[32782]: pgmap v17317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:37 smithi196 ceph-mon[32572]: pgmap v17318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32132.482117 secs 2024-04-26T20:43:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:37 smithi110 ceph-mon[28069]: pgmap v17318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32132.482117 secs 2024-04-26T20:43:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:37 smithi193 ceph-mon[32782]: pgmap v17318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32132.482117 secs 2024-04-26T20:43:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:39 smithi196 ceph-mon[32572]: pgmap v17319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:39 smithi110 ceph-mon[28069]: pgmap v17319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:39 smithi193 ceph-mon[32782]: pgmap v17319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:41 smithi196 ceph-mon[32572]: pgmap v17320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:41 smithi110 ceph-mon[28069]: pgmap v17320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:41 smithi193 ceph-mon[32782]: pgmap v17320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32137.482252 secs 2024-04-26T20:43:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32137.482252 secs 2024-04-26T20:43:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32137.482252 secs 2024-04-26T20:43:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:43 smithi196 ceph-mon[32572]: pgmap v17321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:43 smithi110 ceph-mon[28069]: pgmap v17321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:43 smithi193 ceph-mon[32782]: pgmap v17321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:45 smithi196 ceph-mon[32572]: pgmap v17322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:45 smithi110 ceph-mon[28069]: pgmap v17322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:45 smithi193 ceph-mon[32782]: pgmap v17322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:47 smithi196 ceph-mon[32572]: pgmap v17323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32142.482385 secs 2024-04-26T20:43:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:47 smithi110 ceph-mon[28069]: pgmap v17323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32142.482385 secs 2024-04-26T20:43:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:47 smithi193 ceph-mon[32782]: pgmap v17323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32142.482385 secs 2024-04-26T20:43:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:49 smithi196 ceph-mon[32572]: pgmap v17324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:49 smithi110 ceph-mon[28069]: pgmap v17324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:49 smithi193 ceph-mon[32782]: pgmap v17324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:50 smithi196 ceph-mon[32572]: pgmap v17325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:50 smithi110 ceph-mon[28069]: pgmap v17325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:50 smithi193 ceph-mon[32782]: pgmap v17325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:52 smithi196 ceph-mon[32572]: pgmap v17326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32147.482518 secs 2024-04-26T20:43:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:52 smithi110 ceph-mon[28069]: pgmap v17326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32147.482518 secs 2024-04-26T20:43:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:52 smithi193 ceph-mon[32782]: pgmap v17326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32147.482518 secs 2024-04-26T20:43:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:54 smithi196 ceph-mon[32572]: pgmap v17327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:54 smithi110 ceph-mon[28069]: pgmap v17327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:54 smithi193 ceph-mon[32782]: pgmap v17327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:43:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:56 smithi196 ceph-mon[32572]: pgmap v17328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:56 smithi110 ceph-mon[28069]: pgmap v17328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:56 smithi193 ceph-mon[32782]: pgmap v17328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32152.482635 secs 2024-04-26T20:43:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32152.482635 secs 2024-04-26T20:43:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32152.482635 secs 2024-04-26T20:43:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:43:58 smithi196 ceph-mon[32572]: pgmap v17329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:43:58 smithi110 ceph-mon[28069]: pgmap v17329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:43:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:43:58 smithi193 ceph-mon[32782]: pgmap v17329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:00 smithi196 ceph-mon[32572]: pgmap v17330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:00 smithi110 ceph-mon[28069]: pgmap v17330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:00 smithi193 ceph-mon[32782]: pgmap v17330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:02 smithi196 ceph-mon[32572]: pgmap v17331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32157.482713 secs 2024-04-26T20:44:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:02 smithi110 ceph-mon[28069]: pgmap v17331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32157.482713 secs 2024-04-26T20:44:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:02 smithi193 ceph-mon[32782]: pgmap v17331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32157.482713 secs 2024-04-26T20:44:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:44:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:44:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:44:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:04 smithi196 ceph-mon[32572]: pgmap v17332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:44:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:44:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:44:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:04 smithi110 ceph-mon[28069]: pgmap v17332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:44:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:44:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:44:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:04 smithi193 ceph-mon[32782]: pgmap v17332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:44:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:44:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:44:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:05 smithi196 ceph-mon[32572]: pgmap v17333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:44:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:05 smithi196 ceph-mon[32572]: pgmap v17334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:05 smithi110 ceph-mon[28069]: pgmap v17333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:44:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:05 smithi110 ceph-mon[28069]: pgmap v17334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:05 smithi193 ceph-mon[32782]: pgmap v17333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:44:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:05 smithi193 ceph-mon[32782]: pgmap v17334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32162.482789 secs 2024-04-26T20:44:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:07 smithi196 ceph-mon[32572]: pgmap v17335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32162.482789 secs 2024-04-26T20:44:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:07 smithi110 ceph-mon[28069]: pgmap v17335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32162.482789 secs 2024-04-26T20:44:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:07 smithi193 ceph-mon[32782]: pgmap v17335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:09 smithi196 ceph-mon[32572]: pgmap v17336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:09 smithi110 ceph-mon[28069]: pgmap v17336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:09 smithi193 ceph-mon[32782]: pgmap v17336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:11 smithi196 ceph-mon[32572]: pgmap v17337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:11 smithi110 ceph-mon[28069]: pgmap v17337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:11 smithi193 ceph-mon[32782]: pgmap v17337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32167.482904 secs 2024-04-26T20:44:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32167.482904 secs 2024-04-26T20:44:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32167.482904 secs 2024-04-26T20:44:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:13 smithi196 ceph-mon[32572]: pgmap v17338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:13 smithi110 ceph-mon[28069]: pgmap v17338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:13 smithi193 ceph-mon[32782]: pgmap v17338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:44:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:15 smithi196 ceph-mon[32572]: pgmap v17339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:44:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:15 smithi110 ceph-mon[28069]: pgmap v17339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:44:16.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:44:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:44:15.861+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:44:16.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:44:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:44:15.861+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:44:16.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:44:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:44:15.861+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:44:16.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:44:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:44:15.861+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:44:16.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:44:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:44:15.861+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:44:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:15 smithi193 ceph-mon[32782]: pgmap v17339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:44:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32172.483016 secs 2024-04-26T20:44:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:17 smithi196 ceph-mon[32572]: pgmap v17340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32172.483016 secs 2024-04-26T20:44:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:17 smithi110 ceph-mon[28069]: pgmap v17340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32172.483016 secs 2024-04-26T20:44:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:17 smithi193 ceph-mon[32782]: pgmap v17340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:19 smithi196 ceph-mon[32572]: pgmap v17341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:19 smithi110 ceph-mon[28069]: pgmap v17341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:19 smithi193 ceph-mon[32782]: pgmap v17341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:22 smithi196 ceph-mon[32572]: pgmap v17342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:22 smithi110 ceph-mon[28069]: pgmap v17342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:22 smithi193 ceph-mon[32782]: pgmap v17342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:23.267 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:23 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32177.483137 secs 2024-04-26T20:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:23 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32177.483137 secs 2024-04-26T20:44:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:23 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32177.483137 secs 2024-04-26T20:44:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:24 smithi110 ceph-mon[28069]: pgmap v17343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:24 smithi193 ceph-mon[32782]: pgmap v17343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:24 smithi196 ceph-mon[32572]: pgmap v17343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:26 smithi110 ceph-mon[28069]: pgmap v17344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:26 smithi193 ceph-mon[32782]: pgmap v17344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:26 smithi196 ceph-mon[32572]: pgmap v17344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:28 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32182.483254 secs 2024-04-26T20:44:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:28 smithi110 ceph-mon[28069]: pgmap v17345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:28 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32182.483254 secs 2024-04-26T20:44:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:28 smithi193 ceph-mon[32782]: pgmap v17345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:28 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32182.483254 secs 2024-04-26T20:44:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:28 smithi196 ceph-mon[32572]: pgmap v17345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:30 smithi110 ceph-mon[28069]: pgmap v17346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:30 smithi193 ceph-mon[32782]: pgmap v17346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:30 smithi196 ceph-mon[32572]: pgmap v17346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:44:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:32 smithi110 ceph-mon[28069]: pgmap v17347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32187.483372 secs 2024-04-26T20:44:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:32 smithi193 ceph-mon[32782]: pgmap v17347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32187.483372 secs 2024-04-26T20:44:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:32 smithi196 ceph-mon[32572]: pgmap v17347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32187.483372 secs 2024-04-26T20:44:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:34 smithi110 ceph-mon[28069]: pgmap v17348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:34 smithi193 ceph-mon[32782]: pgmap v17348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:34 smithi196 ceph-mon[32572]: pgmap v17348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:36 smithi193 ceph-mon[32782]: pgmap v17349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:36 smithi196 ceph-mon[32572]: pgmap v17349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:36 smithi110 ceph-mon[28069]: pgmap v17349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:36.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:44:36.704+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T20:44:36.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:44:36.704+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:44:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:44:36.705+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 248 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:44:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:44:36.705+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 248 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T20:44:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32192.483492 secs 2024-04-26T20:44:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32192.483492 secs 2024-04-26T20:44:37.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32192.483492 secs 2024-04-26T20:44:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:38 smithi193 ceph-mon[32782]: pgmap v17350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:38 smithi196 ceph-mon[32572]: pgmap v17350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:38 smithi110 ceph-mon[28069]: pgmap v17350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:40 smithi193 ceph-mon[32782]: pgmap v17351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:40 smithi196 ceph-mon[32572]: pgmap v17351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:40 smithi110 ceph-mon[28069]: pgmap v17351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:42 smithi193 ceph-mon[32782]: pgmap v17352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32197.483636 secs 2024-04-26T20:44:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:42 smithi196 ceph-mon[32572]: pgmap v17352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32197.483636 secs 2024-04-26T20:44:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:42 smithi110 ceph-mon[28069]: pgmap v17352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32197.483636 secs 2024-04-26T20:44:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:44 smithi193 ceph-mon[32782]: pgmap v17353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:44.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:44 smithi196 ceph-mon[32572]: pgmap v17353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:44 smithi110 ceph-mon[28069]: pgmap v17353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:46 smithi193 ceph-mon[32782]: pgmap v17354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:46 smithi196 ceph-mon[32572]: pgmap v17354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:46 smithi110 ceph-mon[28069]: pgmap v17354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32202.483715 secs 2024-04-26T20:44:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32202.483715 secs 2024-04-26T20:44:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32202.483715 secs 2024-04-26T20:44:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:48 smithi193 ceph-mon[32782]: pgmap v17355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:48 smithi196 ceph-mon[32572]: pgmap v17355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:48 smithi110 ceph-mon[28069]: pgmap v17355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:50 smithi193 ceph-mon[32782]: pgmap v17356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:50 smithi196 ceph-mon[32572]: pgmap v17356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:50 smithi110 ceph-mon[28069]: pgmap v17356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:52 smithi193 ceph-mon[32782]: pgmap v17357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32207.483829 secs 2024-04-26T20:44:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:52 smithi196 ceph-mon[32572]: pgmap v17357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32207.483829 secs 2024-04-26T20:44:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:52 smithi110 ceph-mon[28069]: pgmap v17357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32207.483829 secs 2024-04-26T20:44:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:54 smithi193 ceph-mon[32782]: pgmap v17358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:54 smithi196 ceph-mon[32572]: pgmap v17358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:54 smithi110 ceph-mon[28069]: pgmap v17358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:44:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:56 smithi193 ceph-mon[32782]: pgmap v17359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:56 smithi196 ceph-mon[32572]: pgmap v17359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:56 smithi110 ceph-mon[28069]: pgmap v17359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32212.483952 secs 2024-04-26T20:44:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32212.483952 secs 2024-04-26T20:44:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32212.483952 secs 2024-04-26T20:44:58.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:44:58 smithi110 ceph-mon[28069]: pgmap v17360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:44:58 smithi196 ceph-mon[32572]: pgmap v17360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:44:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:44:58 smithi193 ceph-mon[32782]: pgmap v17360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:00 smithi196 ceph-mon[32572]: pgmap v17361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:00 smithi110 ceph-mon[28069]: pgmap v17361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:00 smithi193 ceph-mon[32782]: pgmap v17361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:02 smithi196 ceph-mon[32572]: pgmap v17362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32217.484067 secs 2024-04-26T20:45:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:02 smithi110 ceph-mon[28069]: pgmap v17362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32217.484067 secs 2024-04-26T20:45:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:02 smithi193 ceph-mon[32782]: pgmap v17362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32217.484067 secs 2024-04-26T20:45:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:04 smithi196 ceph-mon[32572]: pgmap v17363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:04 smithi110 ceph-mon[28069]: pgmap v17363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:04 smithi193 ceph-mon[32782]: pgmap v17363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:06 smithi196 ceph-mon[32572]: pgmap v17364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:45:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:45:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:06 smithi110 ceph-mon[28069]: pgmap v17364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:45:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:45:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:06 smithi193 ceph-mon[32782]: pgmap v17364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:45:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:45:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:45:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:45:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:45:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32222.484192 secs 2024-04-26T20:45:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:45:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:45:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:45:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32222.484192 secs 2024-04-26T20:45:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:45:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:45:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:45:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32222.484192 secs 2024-04-26T20:45:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:08 smithi196 ceph-mon[32572]: pgmap v17365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:08 smithi110 ceph-mon[28069]: pgmap v17365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:08 smithi193 ceph-mon[32782]: pgmap v17365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:10 smithi196 ceph-mon[32572]: pgmap v17366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:10 smithi110 ceph-mon[28069]: pgmap v17366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:10 smithi193 ceph-mon[32782]: pgmap v17366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:12 smithi196 ceph-mon[32572]: pgmap v17367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32227.484292 secs 2024-04-26T20:45:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:12 smithi110 ceph-mon[28069]: pgmap v17367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32227.484292 secs 2024-04-26T20:45:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:12 smithi193 ceph-mon[32782]: pgmap v17367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32227.484292 secs 2024-04-26T20:45:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:14 smithi196 ceph-mon[32572]: pgmap v17368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:14 smithi110 ceph-mon[28069]: pgmap v17368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:14 smithi193 ceph-mon[32782]: pgmap v17368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:45:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:16 smithi196 ceph-mon[32572]: pgmap v17369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:45:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:16 smithi110 ceph-mon[28069]: pgmap v17369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:45:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:16 smithi193 ceph-mon[32782]: pgmap v17369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:45:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:17 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 32232.484411 secs 2024-04-26T20:45:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:17 smithi196 ceph-mon[32572]: slow request 5763.746025 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:45:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:17 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 32232.484411 secs 2024-04-26T20:45:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:17 smithi110 ceph-mon[28069]: slow request 5763.746025 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:45:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:17 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 32232.484411 secs 2024-04-26T20:45:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:17 smithi193 ceph-mon[32782]: slow request 5763.746025 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:45:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:18 smithi196 ceph-mon[32572]: pgmap v17370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:45:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:18 smithi110 ceph-mon[28069]: pgmap v17370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:45:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:18 smithi193 ceph-mon[32782]: pgmap v17370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:45:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:20 smithi196 ceph-mon[32572]: pgmap v17371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:20 smithi110 ceph-mon[28069]: pgmap v17371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:20 smithi193 ceph-mon[32782]: pgmap v17371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:21.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:45:21.712+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:45:21.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:45:21.712+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T20:45:21.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:45:21.713+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 249 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T20:45:21.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:45:21.713+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 249 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:45:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:22 smithi196 ceph-mon[32572]: pgmap v17372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32237.484523 secs 2024-04-26T20:45:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:22 smithi110 ceph-mon[28069]: pgmap v17372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32237.484523 secs 2024-04-26T20:45:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:22 smithi193 ceph-mon[32782]: pgmap v17372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32237.484523 secs 2024-04-26T20:45:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:24 smithi196 ceph-mon[32572]: pgmap v17373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:24 smithi110 ceph-mon[28069]: pgmap v17373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:24 smithi193 ceph-mon[32782]: pgmap v17373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:26 smithi196 ceph-mon[32572]: pgmap v17374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:26 smithi110 ceph-mon[28069]: pgmap v17374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:26 smithi193 ceph-mon[32782]: pgmap v17374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32242.484636 secs 2024-04-26T20:45:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32242.484636 secs 2024-04-26T20:45:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32242.484636 secs 2024-04-26T20:45:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:28 smithi196 ceph-mon[32572]: pgmap v17375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:28.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:28 smithi193 ceph-mon[32782]: pgmap v17375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:28 smithi110 ceph-mon[28069]: pgmap v17375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:30 smithi196 ceph-mon[32572]: pgmap v17376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:30 smithi110 ceph-mon[28069]: pgmap v17376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:30 smithi193 ceph-mon[32782]: pgmap v17376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:32 smithi196 ceph-mon[32572]: pgmap v17377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32247.484759 secs 2024-04-26T20:45:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:32 smithi110 ceph-mon[28069]: pgmap v17377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32247.484759 secs 2024-04-26T20:45:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:32 smithi193 ceph-mon[32782]: pgmap v17377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32247.484759 secs 2024-04-26T20:45:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:34 smithi196 ceph-mon[32572]: pgmap v17378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:34 smithi110 ceph-mon[28069]: pgmap v17378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:34 smithi193 ceph-mon[32782]: pgmap v17378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:36 smithi196 ceph-mon[32572]: pgmap v17379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:36 smithi110 ceph-mon[28069]: pgmap v17379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:36 smithi193 ceph-mon[32782]: pgmap v17379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32252.484877 secs 2024-04-26T20:45:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32252.484877 secs 2024-04-26T20:45:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32252.484877 secs 2024-04-26T20:45:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:38 smithi196 ceph-mon[32572]: pgmap v17380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:38 smithi110 ceph-mon[28069]: pgmap v17380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:38 smithi193 ceph-mon[32782]: pgmap v17380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:39 smithi193 ceph-mon[32782]: pgmap v17381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:39 smithi196 ceph-mon[32572]: pgmap v17381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:39 smithi110 ceph-mon[28069]: pgmap v17381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:41 smithi110 ceph-mon[28069]: pgmap v17382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:41 smithi193 ceph-mon[32782]: pgmap v17382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:41 smithi196 ceph-mon[32572]: pgmap v17382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32257.485003 secs 2024-04-26T20:45:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32257.485003 secs 2024-04-26T20:45:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32257.485003 secs 2024-04-26T20:45:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:43 smithi193 ceph-mon[32782]: pgmap v17383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:43 smithi196 ceph-mon[32572]: pgmap v17383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:43 smithi110 ceph-mon[28069]: pgmap v17383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:45 smithi193 ceph-mon[32782]: pgmap v17384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:45 smithi196 ceph-mon[32572]: pgmap v17384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:45 smithi110 ceph-mon[28069]: pgmap v17384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:47 smithi193 ceph-mon[32782]: pgmap v17385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32262.485109 secs 2024-04-26T20:45:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:47 smithi196 ceph-mon[32572]: pgmap v17385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32262.485109 secs 2024-04-26T20:45:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:47 smithi110 ceph-mon[28069]: pgmap v17385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32262.485109 secs 2024-04-26T20:45:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:49 smithi193 ceph-mon[32782]: pgmap v17386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:49 smithi196 ceph-mon[32572]: pgmap v17386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:49 smithi110 ceph-mon[28069]: pgmap v17386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:51 smithi193 ceph-mon[32782]: pgmap v17387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:51 smithi196 ceph-mon[32572]: pgmap v17387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:51 smithi110 ceph-mon[28069]: pgmap v17387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32267.485228 secs 2024-04-26T20:45:52.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32267.485228 secs 2024-04-26T20:45:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32267.485228 secs 2024-04-26T20:45:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:53 smithi193 ceph-mon[32782]: pgmap v17388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:53 smithi196 ceph-mon[32572]: pgmap v17388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:53 smithi110 ceph-mon[28069]: pgmap v17388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:45:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:55 smithi193 ceph-mon[32782]: pgmap v17389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:55 smithi196 ceph-mon[32572]: pgmap v17389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:55 smithi110 ceph-mon[28069]: pgmap v17389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:57 smithi193 ceph-mon[32782]: pgmap v17390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32272.485343 secs 2024-04-26T20:45:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:57 smithi196 ceph-mon[32572]: pgmap v17390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32272.485343 secs 2024-04-26T20:45:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:57 smithi110 ceph-mon[28069]: pgmap v17390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:45:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32272.485343 secs 2024-04-26T20:45:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:45:59 smithi193 ceph-mon[32782]: pgmap v17391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:45:59 smithi196 ceph-mon[32572]: pgmap v17391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:45:59 smithi110 ceph-mon[28069]: pgmap v17391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:01 smithi193 ceph-mon[32782]: pgmap v17392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:01 smithi196 ceph-mon[32572]: pgmap v17392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:01 smithi110 ceph-mon[28069]: pgmap v17392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32277.485466 secs 2024-04-26T20:46:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32277.485466 secs 2024-04-26T20:46:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32277.485466 secs 2024-04-26T20:46:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:03 smithi193 ceph-mon[32782]: pgmap v17393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:03 smithi196 ceph-mon[32572]: pgmap v17393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:03 smithi110 ceph-mon[28069]: pgmap v17393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:05 smithi193 ceph-mon[32782]: pgmap v17394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:05 smithi196 ceph-mon[32572]: pgmap v17394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:05 smithi110 ceph-mon[28069]: pgmap v17394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:07 smithi196 ceph-mon[32572]: pgmap v17395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:46:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32282.485538 secs 2024-04-26T20:46:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:07 smithi110 ceph-mon[28069]: pgmap v17395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:46:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32282.485538 secs 2024-04-26T20:46:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:07 smithi193 ceph-mon[32782]: pgmap v17395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:46:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32282.485538 secs 2024-04-26T20:46:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:46:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:46:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:08 smithi196 ceph-mon[32572]: pgmap v17396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:46:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:08 smithi196 ceph-mon[32572]: pgmap v17397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:46:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:46:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:46:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:08 smithi110 ceph-mon[28069]: pgmap v17396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:46:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:08 smithi110 ceph-mon[28069]: pgmap v17397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:46:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:46:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:46:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:08 smithi193 ceph-mon[32782]: pgmap v17396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:46:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:08 smithi193 ceph-mon[32782]: pgmap v17397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:46:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:11 smithi110 ceph-mon[28069]: pgmap v17398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:11 smithi193 ceph-mon[32782]: pgmap v17398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:11 smithi196 ceph-mon[32572]: pgmap v17398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:13 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32287.485675 secs 2024-04-26T20:46:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:13 smithi110 ceph-mon[28069]: pgmap v17399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:46:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:13 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32287.485675 secs 2024-04-26T20:46:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:13 smithi193 ceph-mon[32782]: pgmap v17399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:46:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:13 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32287.485675 secs 2024-04-26T20:46:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:13 smithi196 ceph-mon[32572]: pgmap v17399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T20:46:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:15 smithi193 ceph-mon[32782]: pgmap v17400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:15 smithi196 ceph-mon[32572]: pgmap v17400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:15 smithi110 ceph-mon[28069]: pgmap v17400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:17 smithi193 ceph-mon[32782]: pgmap v17401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:17 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 32292.485829 secs 2024-04-26T20:46:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:17 smithi193 ceph-mon[32782]: slow request 721.213705 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:46:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:17 smithi196 ceph-mon[32572]: pgmap v17401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:17 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 32292.485829 secs 2024-04-26T20:46:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:17 smithi196 ceph-mon[32572]: slow request 721.213705 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:46:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:17 smithi110 ceph-mon[28069]: pgmap v17401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:17 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 32292.485829 secs 2024-04-26T20:46:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:17 smithi110 ceph-mon[28069]: slow request 721.213705 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:46:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:19 smithi193 ceph-mon[32782]: pgmap v17402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T20:46:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:19 smithi196 ceph-mon[32572]: pgmap v17402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T20:46:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:19 smithi110 ceph-mon[28069]: pgmap v17402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T20:46:21.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:21 smithi193 ceph-mon[32782]: pgmap v17403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:46:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:21 smithi196 ceph-mon[32572]: pgmap v17403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:46:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:21 smithi110 ceph-mon[28069]: pgmap v17403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:46:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32297.485959 secs 2024-04-26T20:46:22.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32297.485959 secs 2024-04-26T20:46:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32297.485959 secs 2024-04-26T20:46:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:23 smithi193 ceph-mon[32782]: pgmap v17404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:46:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:23 smithi196 ceph-mon[32572]: pgmap v17404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:46:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:23 smithi110 ceph-mon[28069]: pgmap v17404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:46:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:25 smithi193 ceph-mon[32782]: pgmap v17405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:25 smithi196 ceph-mon[32572]: pgmap v17405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:25 smithi110 ceph-mon[28069]: pgmap v17405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:27 smithi193 ceph-mon[32782]: pgmap v17406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:46:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32302.486082 secs 2024-04-26T20:46:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:27 smithi196 ceph-mon[32572]: pgmap v17406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:46:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32302.486082 secs 2024-04-26T20:46:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:27 smithi110 ceph-mon[28069]: pgmap v17406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:46:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32302.486082 secs 2024-04-26T20:46:29.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:29 smithi110 ceph-mon[28069]: pgmap v17407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:29 smithi193 ceph-mon[32782]: pgmap v17407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:29 smithi196 ceph-mon[32572]: pgmap v17407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:31 smithi193 ceph-mon[32782]: pgmap v17408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:31 smithi196 ceph-mon[32572]: pgmap v17408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:31 smithi110 ceph-mon[28069]: pgmap v17408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32307.486167 secs 2024-04-26T20:46:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32307.486167 secs 2024-04-26T20:46:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32307.486167 secs 2024-04-26T20:46:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:33 smithi193 ceph-mon[32782]: pgmap v17409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:33 smithi196 ceph-mon[32572]: pgmap v17409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:33 smithi110 ceph-mon[28069]: pgmap v17409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:35 smithi193 ceph-mon[32782]: pgmap v17410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:35 smithi196 ceph-mon[32572]: pgmap v17410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:35 smithi110 ceph-mon[28069]: pgmap v17410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:37 smithi193 ceph-mon[32782]: pgmap v17411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32312.486293 secs 2024-04-26T20:46:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:37 smithi196 ceph-mon[32572]: pgmap v17411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32312.486293 secs 2024-04-26T20:46:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:37 smithi110 ceph-mon[28069]: pgmap v17411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32312.486293 secs 2024-04-26T20:46:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:39 smithi193 ceph-mon[32782]: pgmap v17412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:39 smithi196 ceph-mon[32572]: pgmap v17412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:39 smithi110 ceph-mon[28069]: pgmap v17412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:41 smithi196 ceph-mon[32572]: pgmap v17413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:41 smithi110 ceph-mon[28069]: pgmap v17413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:41 smithi193 ceph-mon[32782]: pgmap v17413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32317.486425 secs 2024-04-26T20:46:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32317.486425 secs 2024-04-26T20:46:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32317.486425 secs 2024-04-26T20:46:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:43 smithi196 ceph-mon[32572]: pgmap v17414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:43 smithi110 ceph-mon[28069]: pgmap v17414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:43 smithi193 ceph-mon[32782]: pgmap v17414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:45 smithi196 ceph-mon[32572]: pgmap v17415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:45 smithi110 ceph-mon[28069]: pgmap v17415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:45 smithi193 ceph-mon[32782]: pgmap v17415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:47 smithi196 ceph-mon[32572]: pgmap v17416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32322.486531 secs 2024-04-26T20:46:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:47 smithi110 ceph-mon[28069]: pgmap v17416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32322.486531 secs 2024-04-26T20:46:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:47 smithi193 ceph-mon[32782]: pgmap v17416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32322.486531 secs 2024-04-26T20:46:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:49 smithi196 ceph-mon[32572]: pgmap v17417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:49 smithi110 ceph-mon[28069]: pgmap v17417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:49 smithi193 ceph-mon[32782]: pgmap v17417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:51 smithi196 ceph-mon[32572]: pgmap v17418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:51 smithi110 ceph-mon[28069]: pgmap v17418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:51 smithi193 ceph-mon[32782]: pgmap v17418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32327.486628 secs 2024-04-26T20:46:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32327.486628 secs 2024-04-26T20:46:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32327.486628 secs 2024-04-26T20:46:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:53 smithi196 ceph-mon[32572]: pgmap v17419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:53 smithi110 ceph-mon[28069]: pgmap v17419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:53 smithi193 ceph-mon[32782]: pgmap v17419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:55 smithi196 ceph-mon[32572]: pgmap v17420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:55 smithi110 ceph-mon[28069]: pgmap v17420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:55 smithi193 ceph-mon[32782]: pgmap v17420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:57 smithi196 ceph-mon[32572]: pgmap v17421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32332.486746 secs 2024-04-26T20:46:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:57 smithi110 ceph-mon[28069]: pgmap v17421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32332.486746 secs 2024-04-26T20:46:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:57 smithi193 ceph-mon[32782]: pgmap v17421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:46:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32332.486746 secs 2024-04-26T20:46:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:46:59 smithi196 ceph-mon[32572]: pgmap v17422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:46:59 smithi110 ceph-mon[28069]: pgmap v17422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:46:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:46:59 smithi193 ceph-mon[32782]: pgmap v17422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:01 smithi196 ceph-mon[32572]: pgmap v17423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:01 smithi110 ceph-mon[28069]: pgmap v17423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:01 smithi193 ceph-mon[32782]: pgmap v17423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32337.486863 secs 2024-04-26T20:47:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32337.486863 secs 2024-04-26T20:47:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32337.486863 secs 2024-04-26T20:47:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:03 smithi196 ceph-mon[32572]: pgmap v17424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:03 smithi110 ceph-mon[28069]: pgmap v17424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:03 smithi193 ceph-mon[32782]: pgmap v17424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:05 smithi196 ceph-mon[32572]: pgmap v17425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:05 smithi110 ceph-mon[28069]: pgmap v17425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:05 smithi193 ceph-mon[32782]: pgmap v17425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:07 smithi196 ceph-mon[32572]: pgmap v17426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32342.486980 secs 2024-04-26T20:47:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:07 smithi110 ceph-mon[28069]: pgmap v17426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32342.486980 secs 2024-04-26T20:47:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:07 smithi193 ceph-mon[32782]: pgmap v17426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32342.486980 secs 2024-04-26T20:47:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:09 smithi196 ceph-mon[32572]: pgmap v17427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:47:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:09 smithi110 ceph-mon[28069]: pgmap v17427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:47:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:09 smithi193 ceph-mon[32782]: pgmap v17427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:47:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:47:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:47:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:47:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:47:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:47:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:47:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:47:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:47:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:47:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:11 smithi196 ceph-mon[32572]: pgmap v17428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:47:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:11 smithi196 ceph-mon[32572]: pgmap v17429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:11 smithi110 ceph-mon[28069]: pgmap v17428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:47:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:11 smithi110 ceph-mon[28069]: pgmap v17429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:11 smithi193 ceph-mon[32782]: pgmap v17428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T20:47:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:11 smithi193 ceph-mon[32782]: pgmap v17429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32347.487096 secs 2024-04-26T20:47:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32347.487096 secs 2024-04-26T20:47:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32347.487096 secs 2024-04-26T20:47:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:13 smithi196 ceph-mon[32572]: pgmap v17430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:13 smithi110 ceph-mon[28069]: pgmap v17430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:13 smithi193 ceph-mon[32782]: pgmap v17430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:15 smithi196 ceph-mon[32572]: pgmap v17431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:15 smithi110 ceph-mon[28069]: pgmap v17431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:15 smithi193 ceph-mon[32782]: pgmap v17431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:17 smithi110 ceph-mon[28069]: pgmap v17432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32352.487195 secs 2024-04-26T20:47:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:17 smithi193 ceph-mon[32782]: pgmap v17432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32352.487195 secs 2024-04-26T20:47:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:17 smithi196 ceph-mon[32572]: pgmap v17432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32352.487195 secs 2024-04-26T20:47:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:19 smithi110 ceph-mon[28069]: pgmap v17433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:19 smithi193 ceph-mon[32782]: pgmap v17433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:19 smithi196 ceph-mon[32572]: pgmap v17433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:47:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:21 smithi110 ceph-mon[28069]: pgmap v17434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:47:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:21 smithi193 ceph-mon[32782]: pgmap v17434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:47:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:21 smithi196 ceph-mon[32572]: pgmap v17434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:47:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32357.487315 secs 2024-04-26T20:47:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32357.487315 secs 2024-04-26T20:47:22.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32357.487315 secs 2024-04-26T20:47:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:23 smithi110 ceph-mon[28069]: pgmap v17435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:23 smithi193 ceph-mon[32782]: pgmap v17435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:23 smithi196 ceph-mon[32572]: pgmap v17435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:24 smithi193 ceph-mon[32782]: pgmap v17436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:24 smithi196 ceph-mon[32572]: pgmap v17436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:24 smithi110 ceph-mon[28069]: pgmap v17436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:26 smithi193 ceph-mon[32782]: pgmap v17437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:26 smithi196 ceph-mon[32572]: pgmap v17437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:26 smithi110 ceph-mon[28069]: pgmap v17437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32362.487434 secs 2024-04-26T20:47:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32362.487434 secs 2024-04-26T20:47:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32362.487434 secs 2024-04-26T20:47:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:28 smithi193 ceph-mon[32782]: pgmap v17438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:28 smithi196 ceph-mon[32572]: pgmap v17438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:28 smithi110 ceph-mon[28069]: pgmap v17438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:30 smithi196 ceph-mon[32572]: pgmap v17439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:30 smithi110 ceph-mon[28069]: pgmap v17439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:30 smithi193 ceph-mon[32782]: pgmap v17439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:32 smithi196 ceph-mon[32572]: pgmap v17440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32367.487597 secs 2024-04-26T20:47:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:32 smithi110 ceph-mon[28069]: pgmap v17440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32367.487597 secs 2024-04-26T20:47:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:32 smithi193 ceph-mon[32782]: pgmap v17440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32367.487597 secs 2024-04-26T20:47:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:34 smithi196 ceph-mon[32572]: pgmap v17441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:34 smithi110 ceph-mon[28069]: pgmap v17441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:34 smithi193 ceph-mon[32782]: pgmap v17441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:36 smithi196 ceph-mon[32572]: pgmap v17442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:36 smithi110 ceph-mon[28069]: pgmap v17442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:36 smithi193 ceph-mon[32782]: pgmap v17442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32372.487719 secs 2024-04-26T20:47:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32372.487719 secs 2024-04-26T20:47:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32372.487719 secs 2024-04-26T20:47:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:38 smithi196 ceph-mon[32572]: pgmap v17443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:38 smithi110 ceph-mon[28069]: pgmap v17443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:38 smithi193 ceph-mon[32782]: pgmap v17443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:40 smithi196 ceph-mon[32572]: pgmap v17444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:40 smithi110 ceph-mon[28069]: pgmap v17444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:40 smithi193 ceph-mon[32782]: pgmap v17444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:42 smithi196 ceph-mon[32572]: pgmap v17445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32377.487820 secs 2024-04-26T20:47:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:42 smithi110 ceph-mon[28069]: pgmap v17445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32377.487820 secs 2024-04-26T20:47:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:42 smithi193 ceph-mon[32782]: pgmap v17445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32377.487820 secs 2024-04-26T20:47:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:44 smithi196 ceph-mon[32572]: pgmap v17446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:44 smithi110 ceph-mon[28069]: pgmap v17446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:44 smithi193 ceph-mon[32782]: pgmap v17446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:46 smithi196 ceph-mon[32572]: pgmap v17447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:46 smithi110 ceph-mon[28069]: pgmap v17447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:46 smithi193 ceph-mon[32782]: pgmap v17447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32382.487931 secs 2024-04-26T20:47:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32382.487931 secs 2024-04-26T20:47:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32382.487931 secs 2024-04-26T20:47:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:48 smithi196 ceph-mon[32572]: pgmap v17448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:48 smithi110 ceph-mon[28069]: pgmap v17448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:48 smithi193 ceph-mon[32782]: pgmap v17448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:50 smithi196 ceph-mon[32572]: pgmap v17449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:50 smithi110 ceph-mon[28069]: pgmap v17449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:50 smithi193 ceph-mon[32782]: pgmap v17449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:52 smithi196 ceph-mon[32572]: pgmap v17450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32387.488064 secs 2024-04-26T20:47:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:52 smithi110 ceph-mon[28069]: pgmap v17450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:53.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32387.488064 secs 2024-04-26T20:47:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:52 smithi193 ceph-mon[32782]: pgmap v17450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32387.488064 secs 2024-04-26T20:47:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:54 smithi196 ceph-mon[32572]: pgmap v17451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:54 smithi110 ceph-mon[28069]: pgmap v17451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:54 smithi193 ceph-mon[32782]: pgmap v17451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:56 smithi196 ceph-mon[32572]: pgmap v17452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:56 smithi110 ceph-mon[28069]: pgmap v17452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:56 smithi193 ceph-mon[32782]: pgmap v17452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:47:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32392.488188 secs 2024-04-26T20:47:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32392.488188 secs 2024-04-26T20:47:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32392.488188 secs 2024-04-26T20:47:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:47:58 smithi196 ceph-mon[32572]: pgmap v17453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:47:58 smithi110 ceph-mon[28069]: pgmap v17453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:47:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:47:58 smithi193 ceph-mon[32782]: pgmap v17453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:00 smithi196 ceph-mon[32572]: pgmap v17454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:00 smithi110 ceph-mon[28069]: pgmap v17454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:00 smithi193 ceph-mon[32782]: pgmap v17454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:02 smithi196 ceph-mon[32572]: pgmap v17455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32397.488311 secs 2024-04-26T20:48:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:02 smithi110 ceph-mon[28069]: pgmap v17455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32397.488311 secs 2024-04-26T20:48:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:02 smithi193 ceph-mon[32782]: pgmap v17455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32397.488311 secs 2024-04-26T20:48:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:04 smithi196 ceph-mon[32572]: pgmap v17456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:04 smithi110 ceph-mon[28069]: pgmap v17456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:04 smithi193 ceph-mon[32782]: pgmap v17456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:06 smithi196 ceph-mon[32572]: pgmap v17457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:06 smithi110 ceph-mon[28069]: pgmap v17457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:06 smithi193 ceph-mon[32782]: pgmap v17457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:07 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 32402.488438 secs 2024-04-26T20:48:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:07 smithi196 ceph-mon[32572]: slow request 23041.981924 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:48:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:07 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 32402.488438 secs 2024-04-26T20:48:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:07 smithi110 ceph-mon[28069]: slow request 23041.981924 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:48:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:07 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 32402.488438 secs 2024-04-26T20:48:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:07 smithi193 ceph-mon[32782]: slow request 23041.981924 seconds old, received at 2024-04-26T14:24:04.804836+0000: client_request(client.26806:1 getattr pAsLsXsFs #0x1 2024-04-26T14:24:04.800033+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:48:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:08 smithi196 ceph-mon[32572]: pgmap v17458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:08 smithi110 ceph-mon[28069]: pgmap v17458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:08 smithi193 ceph-mon[32782]: pgmap v17458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:10 smithi110 ceph-mon[28069]: pgmap v17459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:48:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:10 smithi193 ceph-mon[32782]: pgmap v17459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:48:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:10 smithi196 ceph-mon[32572]: pgmap v17459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:48:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:48:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:48:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:11 smithi110 ceph-mon[28069]: pgmap v17460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T20:48:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:11 smithi110 ceph-mon[28069]: pgmap v17461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:12.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:48:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:48:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:48:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:11 smithi193 ceph-mon[32782]: pgmap v17460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T20:48:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:11 smithi193 ceph-mon[32782]: pgmap v17461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:48:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:48:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:48:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:11 smithi196 ceph-mon[32572]: pgmap v17460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T20:48:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:11 smithi196 ceph-mon[32572]: pgmap v17461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:48:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32407.488536 secs 2024-04-26T20:48:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32407.488536 secs 2024-04-26T20:48:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32407.488536 secs 2024-04-26T20:48:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:13 smithi110 ceph-mon[28069]: pgmap v17462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:13 smithi193 ceph-mon[32782]: pgmap v17462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:13 smithi196 ceph-mon[32572]: pgmap v17462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:16 smithi193 ceph-mon[32782]: pgmap v17463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.465+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T20:48:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.465+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:48:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.465+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:48:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.465+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T20:48:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.466+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:48:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.467+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T20:48:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.467+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T20:48:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.477+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T20:48:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.477+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:48:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.477+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:48:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.477+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d070 comp rx=0 tx=0).stop 2024-04-26T20:48:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.477+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T20:48:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.477+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T20:48:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.477+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:48:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.477+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:48:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.478+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:48:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:16.479+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614041000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:48:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:16 smithi196 ceph-mon[32572]: pgmap v17463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:16 smithi110 ceph-mon[28069]: pgmap v17463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32412.488661 secs 2024-04-26T20:48:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32412.488661 secs 2024-04-26T20:48:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32412.488661 secs 2024-04-26T20:48:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:18 smithi193 ceph-mon[32782]: pgmap v17464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T20:48:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:18 smithi196 ceph-mon[32572]: pgmap v17464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T20:48:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:18 smithi110 ceph-mon[28069]: pgmap v17464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T20:48:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:20 smithi193 ceph-mon[32782]: pgmap v17465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:20 smithi196 ceph-mon[32572]: pgmap v17465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:20 smithi110 ceph-mon[28069]: pgmap v17465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:21.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:21.741+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:48:21.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:21.741+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T20:48:21.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:21.742+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 250 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T20:48:21.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:48:21.742+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 250 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:48:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:22 smithi193 ceph-mon[32782]: pgmap v17466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:48:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32417.488784 secs 2024-04-26T20:48:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:22 smithi196 ceph-mon[32572]: pgmap v17466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:48:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32417.488784 secs 2024-04-26T20:48:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:22 smithi110 ceph-mon[28069]: pgmap v17466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:48:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32417.488784 secs 2024-04-26T20:48:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:24 smithi193 ceph-mon[32782]: pgmap v17467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:24 smithi196 ceph-mon[32572]: pgmap v17467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:24 smithi110 ceph-mon[28069]: pgmap v17467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:26 smithi193 ceph-mon[32782]: pgmap v17468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:26 smithi196 ceph-mon[32572]: pgmap v17468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:26 smithi110 ceph-mon[28069]: pgmap v17468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32422.488887 secs 2024-04-26T20:48:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32422.488887 secs 2024-04-26T20:48:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32422.488887 secs 2024-04-26T20:48:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:28 smithi193 ceph-mon[32782]: pgmap v17469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:28 smithi196 ceph-mon[32572]: pgmap v17469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:28 smithi110 ceph-mon[28069]: pgmap v17469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:30 smithi193 ceph-mon[32782]: pgmap v17470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:30 smithi196 ceph-mon[32572]: pgmap v17470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:30 smithi110 ceph-mon[28069]: pgmap v17470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:32 smithi196 ceph-mon[32572]: pgmap v17471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32427.489021 secs 2024-04-26T20:48:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:32 smithi110 ceph-mon[28069]: pgmap v17471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32427.489021 secs 2024-04-26T20:48:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:32 smithi193 ceph-mon[32782]: pgmap v17471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32427.489021 secs 2024-04-26T20:48:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:34 smithi196 ceph-mon[32572]: pgmap v17472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:34 smithi110 ceph-mon[28069]: pgmap v17472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:34 smithi193 ceph-mon[32782]: pgmap v17472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:36 smithi196 ceph-mon[32572]: pgmap v17473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:36 smithi110 ceph-mon[28069]: pgmap v17473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:36 smithi193 ceph-mon[32782]: pgmap v17473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32432.489175 secs 2024-04-26T20:48:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32432.489175 secs 2024-04-26T20:48:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32432.489175 secs 2024-04-26T20:48:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:38 smithi196 ceph-mon[32572]: pgmap v17474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:38 smithi110 ceph-mon[28069]: pgmap v17474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:38 smithi193 ceph-mon[32782]: pgmap v17474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:40 smithi196 ceph-mon[32572]: pgmap v17475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:40 smithi110 ceph-mon[28069]: pgmap v17475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:40 smithi193 ceph-mon[32782]: pgmap v17475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:42 smithi196 ceph-mon[32572]: pgmap v17476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32437.489295 secs 2024-04-26T20:48:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:42 smithi110 ceph-mon[28069]: pgmap v17476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32437.489295 secs 2024-04-26T20:48:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:42 smithi193 ceph-mon[32782]: pgmap v17476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32437.489295 secs 2024-04-26T20:48:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:44 smithi196 ceph-mon[32572]: pgmap v17477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:44 smithi110 ceph-mon[28069]: pgmap v17477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:44 smithi193 ceph-mon[32782]: pgmap v17477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:46 smithi196 ceph-mon[32572]: pgmap v17478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:46 smithi110 ceph-mon[28069]: pgmap v17478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:46 smithi193 ceph-mon[32782]: pgmap v17478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32442.489397 secs 2024-04-26T20:48:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32442.489397 secs 2024-04-26T20:48:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32442.489397 secs 2024-04-26T20:48:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:48 smithi196 ceph-mon[32572]: pgmap v17479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:48 smithi110 ceph-mon[28069]: pgmap v17479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:48 smithi193 ceph-mon[32782]: pgmap v17479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:50 smithi196 ceph-mon[32572]: pgmap v17480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:50 smithi110 ceph-mon[28069]: pgmap v17480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:50 smithi193 ceph-mon[32782]: pgmap v17480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:52 smithi196 ceph-mon[32572]: pgmap v17481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32447.489518 secs 2024-04-26T20:48:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:52 smithi110 ceph-mon[28069]: pgmap v17481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32447.489518 secs 2024-04-26T20:48:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:52 smithi193 ceph-mon[32782]: pgmap v17481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32447.489518 secs 2024-04-26T20:48:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:54 smithi196 ceph-mon[32572]: pgmap v17482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:54 smithi110 ceph-mon[28069]: pgmap v17482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:54 smithi193 ceph-mon[32782]: pgmap v17482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:48:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:56 smithi196 ceph-mon[32572]: pgmap v17483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:56 smithi110 ceph-mon[28069]: pgmap v17483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:56 smithi193 ceph-mon[32782]: pgmap v17483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32452.489635 secs 2024-04-26T20:48:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32452.489635 secs 2024-04-26T20:48:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32452.489635 secs 2024-04-26T20:48:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:48:58 smithi196 ceph-mon[32572]: pgmap v17484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:48:58 smithi110 ceph-mon[28069]: pgmap v17484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:48:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:48:58 smithi193 ceph-mon[32782]: pgmap v17484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:00 smithi196 ceph-mon[32572]: pgmap v17485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:00 smithi110 ceph-mon[28069]: pgmap v17485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:00 smithi193 ceph-mon[32782]: pgmap v17485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:02 smithi196 ceph-mon[32572]: pgmap v17486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32457.489744 secs 2024-04-26T20:49:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:02 smithi110 ceph-mon[28069]: pgmap v17486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32457.489744 secs 2024-04-26T20:49:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:02 smithi193 ceph-mon[32782]: pgmap v17486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32457.489744 secs 2024-04-26T20:49:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:04 smithi196 ceph-mon[32572]: pgmap v17487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:04 smithi110 ceph-mon[28069]: pgmap v17487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:04 smithi193 ceph-mon[32782]: pgmap v17487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:06 smithi196 ceph-mon[32572]: pgmap v17488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:06 smithi110 ceph-mon[28069]: pgmap v17488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:06 smithi193 ceph-mon[32782]: pgmap v17488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32462.489865 secs 2024-04-26T20:49:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32462.489865 secs 2024-04-26T20:49:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32462.489865 secs 2024-04-26T20:49:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:08 smithi196 ceph-mon[32572]: pgmap v17489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:08 smithi110 ceph-mon[28069]: pgmap v17489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:08 smithi193 ceph-mon[32782]: pgmap v17489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:10 smithi196 ceph-mon[32572]: pgmap v17490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:10 smithi110 ceph-mon[28069]: pgmap v17490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:10 smithi193 ceph-mon[32782]: pgmap v17490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:12 smithi196 ceph-mon[32572]: pgmap v17491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:49:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32467.489931 secs 2024-04-26T20:49:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:12 smithi110 ceph-mon[28069]: pgmap v17491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:49:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32467.489931 secs 2024-04-26T20:49:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:12 smithi193 ceph-mon[32782]: pgmap v17491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:49:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32467.489931 secs 2024-04-26T20:49:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:49:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:49:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:49:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:49:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:49:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:49:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:49:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:49:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:49:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:14 smithi110 ceph-mon[28069]: pgmap v17492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:49:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:14 smithi110 ceph-mon[28069]: pgmap v17493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:14 smithi193 ceph-mon[32782]: pgmap v17492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:49:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:14 smithi193 ceph-mon[32782]: pgmap v17493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:14 smithi196 ceph-mon[32572]: pgmap v17492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:49:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:14 smithi196 ceph-mon[32572]: pgmap v17493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:16.273 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:49:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:49:15.956+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:49:16.273 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:49:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:49:15.956+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:49:16.273 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:49:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:49:15.956+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:49:16.273 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:49:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:49:15.956+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:49:16.273 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:49:15 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:49:15.956+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:49:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:16 smithi110 ceph-mon[28069]: pgmap v17494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:16 smithi193 ceph-mon[32782]: pgmap v17494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:16 smithi196 ceph-mon[32572]: pgmap v17494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32472.490050 secs 2024-04-26T20:49:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32472.490050 secs 2024-04-26T20:49:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32472.490050 secs 2024-04-26T20:49:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:18 smithi110 ceph-mon[28069]: pgmap v17495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:18 smithi193 ceph-mon[32782]: pgmap v17495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:18 smithi196 ceph-mon[32572]: pgmap v17495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:20 smithi110 ceph-mon[28069]: pgmap v17496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 215 B/s wr, 2 op/s 2024-04-26T20:49:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:20 smithi193 ceph-mon[32782]: pgmap v17496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 215 B/s wr, 2 op/s 2024-04-26T20:49:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:20 smithi196 ceph-mon[32572]: pgmap v17496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 215 B/s wr, 2 op/s 2024-04-26T20:49:22.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:22 smithi196 ceph-mon[32572]: pgmap v17497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 215 B/s wr, 2 op/s 2024-04-26T20:49:22.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32477.490168 secs 2024-04-26T20:49:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:22 smithi193 ceph-mon[32782]: pgmap v17497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 215 B/s wr, 2 op/s 2024-04-26T20:49:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32477.490168 secs 2024-04-26T20:49:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:22 smithi110 ceph-mon[28069]: pgmap v17497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 215 B/s wr, 2 op/s 2024-04-26T20:49:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32477.490168 secs 2024-04-26T20:49:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:23 smithi193 ceph-mon[32782]: pgmap v17498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T20:49:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:23 smithi196 ceph-mon[32572]: pgmap v17498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T20:49:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:23 smithi110 ceph-mon[28069]: pgmap v17498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T20:49:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:25 smithi193 ceph-mon[32782]: pgmap v17499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:49:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:25 smithi196 ceph-mon[32572]: pgmap v17499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:49:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:25 smithi110 ceph-mon[28069]: pgmap v17499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:49:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:27 smithi193 ceph-mon[32782]: pgmap v17500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:49:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32482.490289 secs 2024-04-26T20:49:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:27 smithi196 ceph-mon[32572]: pgmap v17500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:49:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32482.490289 secs 2024-04-26T20:49:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:27 smithi110 ceph-mon[28069]: pgmap v17500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T20:49:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32482.490289 secs 2024-04-26T20:49:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:29 smithi193 ceph-mon[32782]: pgmap v17501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:49:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:29 smithi196 ceph-mon[32572]: pgmap v17501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:49:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:29 smithi110 ceph-mon[28069]: pgmap v17501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T20:49:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:31 smithi193 ceph-mon[32782]: pgmap v17502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:31 smithi196 ceph-mon[32572]: pgmap v17502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:31 smithi110 ceph-mon[28069]: pgmap v17502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32487.490404 secs 2024-04-26T20:49:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32487.490404 secs 2024-04-26T20:49:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32487.490404 secs 2024-04-26T20:49:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:33 smithi193 ceph-mon[32782]: pgmap v17503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:33 smithi196 ceph-mon[32572]: pgmap v17503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:33 smithi110 ceph-mon[28069]: pgmap v17503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:35 smithi196 ceph-mon[32572]: pgmap v17504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:35 smithi110 ceph-mon[28069]: pgmap v17504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:35 smithi193 ceph-mon[32782]: pgmap v17504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:37 smithi196 ceph-mon[32572]: pgmap v17505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32492.490534 secs 2024-04-26T20:49:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:37 smithi110 ceph-mon[28069]: pgmap v17505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32492.490534 secs 2024-04-26T20:49:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:37 smithi193 ceph-mon[32782]: pgmap v17505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32492.490534 secs 2024-04-26T20:49:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:39 smithi196 ceph-mon[32572]: pgmap v17506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:39 smithi110 ceph-mon[28069]: pgmap v17506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:39 smithi193 ceph-mon[32782]: pgmap v17506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:41 smithi196 ceph-mon[32572]: pgmap v17507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:41 smithi110 ceph-mon[28069]: pgmap v17507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:41 smithi193 ceph-mon[32782]: pgmap v17507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32497.490680 secs 2024-04-26T20:49:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32497.490680 secs 2024-04-26T20:49:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32497.490680 secs 2024-04-26T20:49:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:43 smithi196 ceph-mon[32572]: pgmap v17508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:43 smithi110 ceph-mon[28069]: pgmap v17508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:43 smithi193 ceph-mon[32782]: pgmap v17508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:45 smithi196 ceph-mon[32572]: pgmap v17509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:45 smithi110 ceph-mon[28069]: pgmap v17509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:45 smithi193 ceph-mon[32782]: pgmap v17509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:47 smithi196 ceph-mon[32572]: pgmap v17510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32502.490812 secs 2024-04-26T20:49:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:47 smithi110 ceph-mon[28069]: pgmap v17510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32502.490812 secs 2024-04-26T20:49:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:47 smithi193 ceph-mon[32782]: pgmap v17510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32502.490812 secs 2024-04-26T20:49:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:49 smithi196 ceph-mon[32572]: pgmap v17511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:49 smithi110 ceph-mon[28069]: pgmap v17511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:49 smithi193 ceph-mon[32782]: pgmap v17511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:51 smithi196 ceph-mon[32572]: pgmap v17512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:51 smithi110 ceph-mon[28069]: pgmap v17512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:51 smithi193 ceph-mon[32782]: pgmap v17512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32507.490952 secs 2024-04-26T20:49:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32507.490952 secs 2024-04-26T20:49:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32507.490952 secs 2024-04-26T20:49:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:53 smithi196 ceph-mon[32572]: pgmap v17513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:53 smithi110 ceph-mon[28069]: pgmap v17513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:53 smithi193 ceph-mon[32782]: pgmap v17513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:49:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:55 smithi196 ceph-mon[32572]: pgmap v17514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:55 smithi110 ceph-mon[28069]: pgmap v17514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:55 smithi193 ceph-mon[32782]: pgmap v17514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:57 smithi196 ceph-mon[32572]: pgmap v17515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32512.491052 secs 2024-04-26T20:49:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:57 smithi110 ceph-mon[28069]: pgmap v17515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32512.491052 secs 2024-04-26T20:49:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:57 smithi193 ceph-mon[32782]: pgmap v17515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:49:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32512.491052 secs 2024-04-26T20:50:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:49:59 smithi196 ceph-mon[32572]: pgmap v17516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:49:59 smithi110 ceph-mon[28069]: pgmap v17516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:49:59 smithi193 ceph-mon[32782]: pgmap v17516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:50:01.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:50:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T20:50:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:01 smithi196 ceph-mon[32572]: pgmap v17517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:01 smithi110 ceph-mon[28069]: pgmap v17517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:01 smithi193 ceph-mon[32782]: pgmap v17517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32517.491202 secs 2024-04-26T20:50:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32517.491202 secs 2024-04-26T20:50:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32517.491202 secs 2024-04-26T20:50:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:03 smithi196 ceph-mon[32572]: pgmap v17518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:03 smithi110 ceph-mon[28069]: pgmap v17518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:03 smithi193 ceph-mon[32782]: pgmap v17518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:05 smithi196 ceph-mon[32572]: pgmap v17519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:05 smithi110 ceph-mon[28069]: pgmap v17519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:05 smithi193 ceph-mon[32782]: pgmap v17519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:07 smithi196 ceph-mon[32572]: pgmap v17520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32522.491327 secs 2024-04-26T20:50:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:07 smithi110 ceph-mon[28069]: pgmap v17520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32522.491327 secs 2024-04-26T20:50:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:07 smithi193 ceph-mon[32782]: pgmap v17520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32522.491327 secs 2024-04-26T20:50:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:09 smithi196 ceph-mon[32572]: pgmap v17521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:09 smithi110 ceph-mon[28069]: pgmap v17521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:09 smithi193 ceph-mon[32782]: pgmap v17521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:12 smithi193 ceph-mon[32782]: pgmap v17522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:12 smithi196 ceph-mon[32572]: pgmap v17522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:12 smithi110 ceph-mon[28069]: pgmap v17522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:13 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32527.491442 secs 2024-04-26T20:50:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:50:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:13 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32527.491442 secs 2024-04-26T20:50:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:50:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:13 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32527.491442 secs 2024-04-26T20:50:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:50:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:14 smithi193 ceph-mon[32782]: pgmap v17523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:50:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:50:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:14 smithi196 ceph-mon[32572]: pgmap v17523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:50:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:50:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:14 smithi110 ceph-mon[28069]: pgmap v17523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:50:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:50:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:50:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:50:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:50:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:50:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:50:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:50:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:50:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:50:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:50:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:16 smithi193 ceph-mon[32782]: pgmap v17524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:16 smithi193 ceph-mon[32782]: pgmap v17525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T20:50:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:16 smithi193 ceph-mon[32782]: pgmap v17526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:16 smithi196 ceph-mon[32572]: pgmap v17524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:16 smithi196 ceph-mon[32572]: pgmap v17525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T20:50:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:16 smithi196 ceph-mon[32572]: pgmap v17526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:16 smithi110 ceph-mon[28069]: pgmap v17524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:16 smithi110 ceph-mon[28069]: pgmap v17525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T20:50:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:16 smithi110 ceph-mon[28069]: pgmap v17526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:18 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32532.491559 secs 2024-04-26T20:50:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:18 smithi193 ceph-mon[32782]: pgmap v17527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T20:50:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:18 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32532.491559 secs 2024-04-26T20:50:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:18 smithi196 ceph-mon[32572]: pgmap v17527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T20:50:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:18 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32532.491559 secs 2024-04-26T20:50:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:18 smithi110 ceph-mon[28069]: pgmap v17527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T20:50:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:20 smithi193 ceph-mon[32782]: pgmap v17528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:20 smithi196 ceph-mon[32572]: pgmap v17528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:20 smithi110 ceph-mon[28069]: pgmap v17528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:22 smithi193 ceph-mon[32782]: pgmap v17529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T20:50:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32537.491679 secs 2024-04-26T20:50:22.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:22 smithi196 ceph-mon[32572]: pgmap v17529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T20:50:22.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32537.491679 secs 2024-04-26T20:50:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:22 smithi110 ceph-mon[28069]: pgmap v17529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T20:50:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32537.491679 secs 2024-04-26T20:50:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:24 smithi193 ceph-mon[32782]: pgmap v17530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:24.509 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:24 smithi196 ceph-mon[32572]: pgmap v17530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:24 smithi110 ceph-mon[28069]: pgmap v17530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:26 smithi193 ceph-mon[32782]: pgmap v17531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:50:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:26 smithi196 ceph-mon[32572]: pgmap v17531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:50:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:26 smithi110 ceph-mon[28069]: pgmap v17531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:50:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32542.491798 secs 2024-04-26T20:50:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32542.491798 secs 2024-04-26T20:50:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32542.491798 secs 2024-04-26T20:50:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:28 smithi193 ceph-mon[32782]: pgmap v17532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:28 smithi196 ceph-mon[32572]: pgmap v17532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:28 smithi110 ceph-mon[28069]: pgmap v17532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:30 smithi193 ceph-mon[32782]: pgmap v17533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:30 smithi196 ceph-mon[32572]: pgmap v17533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:30 smithi110 ceph-mon[28069]: pgmap v17533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:32 smithi193 ceph-mon[32782]: pgmap v17534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32547.491912 secs 2024-04-26T20:50:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:32 smithi196 ceph-mon[32572]: pgmap v17534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32547.491912 secs 2024-04-26T20:50:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:32 smithi110 ceph-mon[28069]: pgmap v17534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32547.491912 secs 2024-04-26T20:50:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:34 smithi193 ceph-mon[32782]: pgmap v17535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:34 smithi196 ceph-mon[32572]: pgmap v17535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:34 smithi110 ceph-mon[28069]: pgmap v17535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:36 smithi196 ceph-mon[32572]: pgmap v17536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:36 smithi110 ceph-mon[28069]: pgmap v17536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:36 smithi193 ceph-mon[32782]: pgmap v17536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32552.492009 secs 2024-04-26T20:50:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32552.492009 secs 2024-04-26T20:50:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32552.492009 secs 2024-04-26T20:50:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:38 smithi196 ceph-mon[32572]: pgmap v17537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:38 smithi110 ceph-mon[28069]: pgmap v17537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:38 smithi193 ceph-mon[32782]: pgmap v17537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:40 smithi196 ceph-mon[32572]: pgmap v17538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:40 smithi110 ceph-mon[28069]: pgmap v17538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:40 smithi193 ceph-mon[32782]: pgmap v17538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:42 smithi196 ceph-mon[32572]: pgmap v17539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32557.492125 secs 2024-04-26T20:50:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:42 smithi110 ceph-mon[28069]: pgmap v17539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32557.492125 secs 2024-04-26T20:50:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:42 smithi193 ceph-mon[32782]: pgmap v17539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32557.492125 secs 2024-04-26T20:50:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:44 smithi196 ceph-mon[32572]: pgmap v17540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:44 smithi110 ceph-mon[28069]: pgmap v17540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:44 smithi193 ceph-mon[32782]: pgmap v17540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:46 smithi196 ceph-mon[32572]: pgmap v17541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:46 smithi110 ceph-mon[28069]: pgmap v17541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:46 smithi193 ceph-mon[32782]: pgmap v17541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32562.492255 secs 2024-04-26T20:50:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32562.492255 secs 2024-04-26T20:50:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32562.492255 secs 2024-04-26T20:50:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:48 smithi196 ceph-mon[32572]: pgmap v17542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:48 smithi110 ceph-mon[28069]: pgmap v17542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:48 smithi193 ceph-mon[32782]: pgmap v17542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:50 smithi196 ceph-mon[32572]: pgmap v17543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:50 smithi110 ceph-mon[28069]: pgmap v17543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:50 smithi193 ceph-mon[32782]: pgmap v17543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:52 smithi196 ceph-mon[32572]: pgmap v17544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32567.492389 secs 2024-04-26T20:50:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:52 smithi110 ceph-mon[28069]: pgmap v17544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32567.492389 secs 2024-04-26T20:50:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:52 smithi193 ceph-mon[32782]: pgmap v17544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32567.492389 secs 2024-04-26T20:50:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:54 smithi196 ceph-mon[32572]: pgmap v17545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:54 smithi110 ceph-mon[28069]: pgmap v17545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:54 smithi193 ceph-mon[32782]: pgmap v17545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:50:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:56 smithi196 ceph-mon[32572]: pgmap v17546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:56 smithi110 ceph-mon[28069]: pgmap v17546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:56 smithi193 ceph-mon[32782]: pgmap v17546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32572.492506 secs 2024-04-26T20:50:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32572.492506 secs 2024-04-26T20:50:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32572.492506 secs 2024-04-26T20:50:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:50:58 smithi196 ceph-mon[32572]: pgmap v17547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:50:58 smithi110 ceph-mon[28069]: pgmap v17547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:50:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:50:58 smithi193 ceph-mon[32782]: pgmap v17547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:00 smithi196 ceph-mon[32572]: pgmap v17548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:00 smithi110 ceph-mon[28069]: pgmap v17548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:00 smithi193 ceph-mon[32782]: pgmap v17548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:02 smithi196 ceph-mon[32572]: pgmap v17549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32577.492650 secs 2024-04-26T20:51:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:02 smithi110 ceph-mon[28069]: pgmap v17549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32577.492650 secs 2024-04-26T20:51:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:02 smithi193 ceph-mon[32782]: pgmap v17549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32577.492650 secs 2024-04-26T20:51:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:04 smithi196 ceph-mon[32572]: pgmap v17550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:04 smithi110 ceph-mon[28069]: pgmap v17550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:04 smithi193 ceph-mon[32782]: pgmap v17550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:06 smithi196 ceph-mon[32572]: pgmap v17551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:06 smithi110 ceph-mon[28069]: pgmap v17551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:06 smithi193 ceph-mon[32782]: pgmap v17551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32582.492801 secs 2024-04-26T20:51:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32582.492801 secs 2024-04-26T20:51:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32582.492801 secs 2024-04-26T20:51:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:08 smithi196 ceph-mon[32572]: pgmap v17552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:08 smithi110 ceph-mon[28069]: pgmap v17552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:08 smithi193 ceph-mon[32782]: pgmap v17552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:10 smithi196 ceph-mon[32572]: pgmap v17553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:10 smithi110 ceph-mon[28069]: pgmap v17553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:10 smithi193 ceph-mon[32782]: pgmap v17553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:12 smithi196 ceph-mon[32572]: pgmap v17554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32587.492865 secs 2024-04-26T20:51:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:12 smithi110 ceph-mon[28069]: pgmap v17554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32587.492865 secs 2024-04-26T20:51:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:12 smithi193 ceph-mon[32782]: pgmap v17554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32587.492865 secs 2024-04-26T20:51:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:14 smithi196 ceph-mon[32572]: pgmap v17555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:14 smithi110 ceph-mon[28069]: pgmap v17555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:14 smithi193 ceph-mon[32782]: pgmap v17555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:51:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:51:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:51:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:16 smithi110 ceph-mon[28069]: pgmap v17556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:16 smithi193 ceph-mon[32782]: pgmap v17556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:16 smithi196 ceph-mon[32572]: pgmap v17556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:51:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:51:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32592.492981 secs 2024-04-26T20:51:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:51:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:51:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32592.492981 secs 2024-04-26T20:51:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:51:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:51:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:51:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32592.492981 secs 2024-04-26T20:51:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:18 smithi110 ceph-mon[28069]: pgmap v17557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T20:51:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:18 smithi110 ceph-mon[28069]: pgmap v17558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:18 smithi193 ceph-mon[32782]: pgmap v17557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T20:51:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:18 smithi193 ceph-mon[32782]: pgmap v17558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:18 smithi196 ceph-mon[32572]: pgmap v17557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T20:51:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:18 smithi196 ceph-mon[32572]: pgmap v17558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:20 smithi110 ceph-mon[28069]: pgmap v17559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:20 smithi193 ceph-mon[32782]: pgmap v17559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:20 smithi196 ceph-mon[32572]: pgmap v17559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:51:21.772+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T20:51:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:51:21.772+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:51:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:51:21.773+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 251 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:51:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:51:21.773+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 251 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T20:51:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:22 smithi110 ceph-mon[28069]: pgmap v17560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32597.493098 secs 2024-04-26T20:51:22.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:22 smithi196 ceph-mon[32572]: pgmap v17560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:22.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32597.493098 secs 2024-04-26T20:51:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:22 smithi193 ceph-mon[32782]: pgmap v17560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32597.493098 secs 2024-04-26T20:51:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:24 smithi110 ceph-mon[28069]: pgmap v17561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:24 smithi193 ceph-mon[32782]: pgmap v17561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:24 smithi196 ceph-mon[32572]: pgmap v17561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:26 smithi193 ceph-mon[32782]: pgmap v17562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:26 smithi196 ceph-mon[32572]: pgmap v17562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:26 smithi110 ceph-mon[28069]: pgmap v17562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:51:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32602.493236 secs 2024-04-26T20:51:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32602.493236 secs 2024-04-26T20:51:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32602.493236 secs 2024-04-26T20:51:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:28 smithi193 ceph-mon[32782]: pgmap v17563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:51:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:28 smithi196 ceph-mon[32572]: pgmap v17563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:51:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:28 smithi110 ceph-mon[28069]: pgmap v17563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:51:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:30 smithi193 ceph-mon[32782]: pgmap v17564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:30 smithi196 ceph-mon[32572]: pgmap v17564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:30.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:30 smithi110 ceph-mon[28069]: pgmap v17564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:32.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:32 smithi110 ceph-mon[28069]: pgmap v17565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:32.595 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32607.493351 secs 2024-04-26T20:51:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:32 smithi193 ceph-mon[32782]: pgmap v17565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32607.493351 secs 2024-04-26T20:51:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:32 smithi196 ceph-mon[32572]: pgmap v17565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32607.493351 secs 2024-04-26T20:51:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:34 smithi193 ceph-mon[32782]: pgmap v17566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:34 smithi196 ceph-mon[32572]: pgmap v17566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:34 smithi110 ceph-mon[28069]: pgmap v17566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:36 smithi193 ceph-mon[32782]: pgmap v17567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:36 smithi196 ceph-mon[32572]: pgmap v17567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:36 smithi110 ceph-mon[28069]: pgmap v17567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:37 smithi193 ceph-mon[32782]: pgmap v17568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32612.493491 secs 2024-04-26T20:51:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:37 smithi196 ceph-mon[32572]: pgmap v17568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32612.493491 secs 2024-04-26T20:51:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:37 smithi110 ceph-mon[28069]: pgmap v17568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32612.493491 secs 2024-04-26T20:51:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:39 smithi193 ceph-mon[32782]: pgmap v17569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:39 smithi196 ceph-mon[32572]: pgmap v17569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:39 smithi110 ceph-mon[28069]: pgmap v17569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:41 smithi193 ceph-mon[32782]: pgmap v17570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:41 smithi196 ceph-mon[32572]: pgmap v17570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:41 smithi110 ceph-mon[28069]: pgmap v17570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32617.493608 secs 2024-04-26T20:51:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32617.493608 secs 2024-04-26T20:51:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32617.493608 secs 2024-04-26T20:51:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:43 smithi193 ceph-mon[32782]: pgmap v17571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:43 smithi196 ceph-mon[32572]: pgmap v17571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:43 smithi110 ceph-mon[28069]: pgmap v17571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:45 smithi193 ceph-mon[32782]: pgmap v17572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:45 smithi196 ceph-mon[32572]: pgmap v17572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:45 smithi110 ceph-mon[28069]: pgmap v17572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:47 smithi193 ceph-mon[32782]: pgmap v17573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32622.493688 secs 2024-04-26T20:51:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:47 smithi196 ceph-mon[32572]: pgmap v17573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32622.493688 secs 2024-04-26T20:51:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:47 smithi110 ceph-mon[28069]: pgmap v17573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32622.493688 secs 2024-04-26T20:51:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:49 smithi193 ceph-mon[32782]: pgmap v17574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:49 smithi196 ceph-mon[32572]: pgmap v17574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:49 smithi110 ceph-mon[28069]: pgmap v17574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:51 smithi193 ceph-mon[32782]: pgmap v17575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:51 smithi196 ceph-mon[32572]: pgmap v17575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:51 smithi110 ceph-mon[28069]: pgmap v17575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32627.493780 secs 2024-04-26T20:51:52.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32627.493780 secs 2024-04-26T20:51:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32627.493780 secs 2024-04-26T20:51:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:53 smithi193 ceph-mon[32782]: pgmap v17576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:53 smithi196 ceph-mon[32572]: pgmap v17576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:53 smithi110 ceph-mon[28069]: pgmap v17576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:51:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:55 smithi196 ceph-mon[32572]: pgmap v17577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:55 smithi110 ceph-mon[28069]: pgmap v17577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:55 smithi193 ceph-mon[32782]: pgmap v17577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:57 smithi196 ceph-mon[32572]: pgmap v17578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32632.493913 secs 2024-04-26T20:51:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:57 smithi110 ceph-mon[28069]: pgmap v17578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32632.493913 secs 2024-04-26T20:51:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:57 smithi193 ceph-mon[32782]: pgmap v17578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:51:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32632.493913 secs 2024-04-26T20:52:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:51:59 smithi196 ceph-mon[32572]: pgmap v17579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:51:59 smithi110 ceph-mon[28069]: pgmap v17579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:51:59 smithi193 ceph-mon[32782]: pgmap v17579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:01 smithi196 ceph-mon[32572]: pgmap v17580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:01 smithi110 ceph-mon[28069]: pgmap v17580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:01 smithi193 ceph-mon[32782]: pgmap v17580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:02.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32637.494010 secs 2024-04-26T20:52:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32637.494010 secs 2024-04-26T20:52:03.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32637.494010 secs 2024-04-26T20:52:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:03 smithi196 ceph-mon[32572]: pgmap v17581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:03 smithi110 ceph-mon[28069]: pgmap v17581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:03 smithi193 ceph-mon[32782]: pgmap v17581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:05 smithi196 ceph-mon[32572]: pgmap v17582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:05 smithi110 ceph-mon[28069]: pgmap v17582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:05 smithi193 ceph-mon[32782]: pgmap v17582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:07 smithi196 ceph-mon[32572]: pgmap v17583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32642.494164 secs 2024-04-26T20:52:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:07 smithi110 ceph-mon[28069]: pgmap v17583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32642.494164 secs 2024-04-26T20:52:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:07 smithi193 ceph-mon[32782]: pgmap v17583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32642.494164 secs 2024-04-26T20:52:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:09 smithi196 ceph-mon[32572]: pgmap v17584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:09 smithi110 ceph-mon[28069]: pgmap v17584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:09 smithi193 ceph-mon[32782]: pgmap v17584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:11 smithi196 ceph-mon[32572]: pgmap v17585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:11 smithi110 ceph-mon[28069]: pgmap v17585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:11 smithi193 ceph-mon[32782]: pgmap v17585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32647.494303 secs 2024-04-26T20:52:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32647.494303 secs 2024-04-26T20:52:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32647.494303 secs 2024-04-26T20:52:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:13 smithi196 ceph-mon[32572]: pgmap v17586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:13 smithi110 ceph-mon[28069]: pgmap v17586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:13 smithi193 ceph-mon[32782]: pgmap v17586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:15 smithi196 ceph-mon[32572]: pgmap v17587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:15 smithi110 ceph-mon[28069]: pgmap v17587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:15 smithi193 ceph-mon[32782]: pgmap v17587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:52:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:52:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:52:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:18 smithi193 ceph-mon[32782]: pgmap v17588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:18 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32652.494406 secs 2024-04-26T20:52:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:18 smithi196 ceph-mon[32572]: pgmap v17588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:18 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32652.494406 secs 2024-04-26T20:52:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:18 smithi110 ceph-mon[28069]: pgmap v17588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:18 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32652.494406 secs 2024-04-26T20:52:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: pgmap v17589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: pgmap v17589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: pgmap v17589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:20.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:20.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:20 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:52:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:20 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:52:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:20 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:52:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:20 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:52:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:20 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:52:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:20 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:52:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:20 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:52:21.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:20 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:52:21.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:21.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:20 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T20:52:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:20 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T20:52:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:20 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T20:52:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:20 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T20:52:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:21.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:21 smithi193 ceph-mon[32782]: pgmap v17590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:22.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:21 smithi196 ceph-mon[32572]: pgmap v17590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:21 smithi110 ceph-mon[28069]: pgmap v17590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32657.494527 secs 2024-04-26T20:52:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:52:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:52:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:52:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:52:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: pgmap v17591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:52:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: pgmap v17592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T20:52:23.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32657.494527 secs 2024-04-26T20:52:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:52:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:52:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:52:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:52:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: pgmap v17591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:52:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: pgmap v17592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T20:52:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32657.494527 secs 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:52:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:52:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: pgmap v17591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T20:52:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: pgmap v17592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T20:52:23.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:52:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:25 smithi196 ceph-mon[32572]: pgmap v17593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:25 smithi110 ceph-mon[28069]: pgmap v17593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:25 smithi193 ceph-mon[32782]: pgmap v17593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:27 smithi196 ceph-mon[32572]: pgmap v17594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32662.494669 secs 2024-04-26T20:52:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:27 smithi110 ceph-mon[28069]: pgmap v17594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32662.494669 secs 2024-04-26T20:52:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:27 smithi193 ceph-mon[32782]: pgmap v17594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32662.494669 secs 2024-04-26T20:52:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:29 smithi196 ceph-mon[32572]: pgmap v17595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:29 smithi110 ceph-mon[28069]: pgmap v17595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:29 smithi193 ceph-mon[32782]: pgmap v17595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:31 smithi196 ceph-mon[32572]: pgmap v17596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:31 smithi110 ceph-mon[28069]: pgmap v17596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:31 smithi193 ceph-mon[32782]: pgmap v17596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:52:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32667.494806 secs 2024-04-26T20:52:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32667.494806 secs 2024-04-26T20:52:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32667.494806 secs 2024-04-26T20:52:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:33 smithi196 ceph-mon[32572]: pgmap v17597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:52:33.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:33 smithi193 ceph-mon[32782]: pgmap v17597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:52:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:33 smithi110 ceph-mon[28069]: pgmap v17597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:52:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:35 smithi196 ceph-mon[32572]: pgmap v17598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:35 smithi110 ceph-mon[28069]: pgmap v17598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:35 smithi193 ceph-mon[32782]: pgmap v17598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:37 smithi196 ceph-mon[32572]: pgmap v17599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32672.494925 secs 2024-04-26T20:52:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:37 smithi110 ceph-mon[28069]: pgmap v17599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32672.494925 secs 2024-04-26T20:52:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:37 smithi193 ceph-mon[32782]: pgmap v17599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32672.494925 secs 2024-04-26T20:52:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:39 smithi196 ceph-mon[32572]: pgmap v17600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:39.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:39 smithi110 ceph-mon[28069]: pgmap v17600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:39 smithi193 ceph-mon[32782]: pgmap v17600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:41 smithi196 ceph-mon[32572]: pgmap v17601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:41 smithi110 ceph-mon[28069]: pgmap v17601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:41 smithi193 ceph-mon[32782]: pgmap v17601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32677.495058 secs 2024-04-26T20:52:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32677.495058 secs 2024-04-26T20:52:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32677.495058 secs 2024-04-26T20:52:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:43 smithi196 ceph-mon[32572]: pgmap v17602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:43 smithi110 ceph-mon[28069]: pgmap v17602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:43 smithi193 ceph-mon[32782]: pgmap v17602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:45 smithi196 ceph-mon[32572]: pgmap v17603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:45 smithi110 ceph-mon[28069]: pgmap v17603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:45 smithi193 ceph-mon[32782]: pgmap v17603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:47 smithi196 ceph-mon[32572]: pgmap v17604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32682.495153 secs 2024-04-26T20:52:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:47 smithi110 ceph-mon[28069]: pgmap v17604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32682.495153 secs 2024-04-26T20:52:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:47 smithi193 ceph-mon[32782]: pgmap v17604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32682.495153 secs 2024-04-26T20:52:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:49 smithi196 ceph-mon[32572]: pgmap v17605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:49 smithi110 ceph-mon[28069]: pgmap v17605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:49 smithi193 ceph-mon[32782]: pgmap v17605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:51 smithi110 ceph-mon[28069]: pgmap v17606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:51 smithi193 ceph-mon[32782]: pgmap v17606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:51 smithi196 ceph-mon[32572]: pgmap v17606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:51.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:52:51.786+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T20:52:51.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:52:51.786+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:52:51.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:52:51.787+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 252 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:52:51.789 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:52:51.787+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 252 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T20:52:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32687.495269 secs 2024-04-26T20:52:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32687.495269 secs 2024-04-26T20:52:52.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32687.495269 secs 2024-04-26T20:52:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:53 smithi110 ceph-mon[28069]: pgmap v17607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:53 smithi193 ceph-mon[32782]: pgmap v17607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:53 smithi196 ceph-mon[32572]: pgmap v17607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:55 smithi110 ceph-mon[28069]: pgmap v17608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:55 smithi193 ceph-mon[32782]: pgmap v17608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:55 smithi196 ceph-mon[32572]: pgmap v17608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:57 smithi110 ceph-mon[28069]: pgmap v17609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32692.495380 secs 2024-04-26T20:52:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:57 smithi193 ceph-mon[32782]: pgmap v17609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32692.495380 secs 2024-04-26T20:52:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:57 smithi196 ceph-mon[32572]: pgmap v17609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:52:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32692.495380 secs 2024-04-26T20:52:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:52:59 smithi193 ceph-mon[32782]: pgmap v17610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:52:59 smithi196 ceph-mon[32572]: pgmap v17610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:52:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:52:59 smithi110 ceph-mon[28069]: pgmap v17610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:01 smithi193 ceph-mon[32782]: pgmap v17611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:01 smithi196 ceph-mon[32572]: pgmap v17611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:01 smithi110 ceph-mon[28069]: pgmap v17611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32697.495522 secs 2024-04-26T20:53:02.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32697.495522 secs 2024-04-26T20:53:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32697.495522 secs 2024-04-26T20:53:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:03 smithi193 ceph-mon[32782]: pgmap v17612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:03 smithi196 ceph-mon[32572]: pgmap v17612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:03 smithi110 ceph-mon[28069]: pgmap v17612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:05 smithi193 ceph-mon[32782]: pgmap v17613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:05 smithi196 ceph-mon[32572]: pgmap v17613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:05 smithi110 ceph-mon[28069]: pgmap v17613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:07 smithi193 ceph-mon[32782]: pgmap v17614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32702.495651 secs 2024-04-26T20:53:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:07 smithi196 ceph-mon[32572]: pgmap v17614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32702.495651 secs 2024-04-26T20:53:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:07 smithi110 ceph-mon[28069]: pgmap v17614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32702.495651 secs 2024-04-26T20:53:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:09 smithi193 ceph-mon[32782]: pgmap v17615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:09 smithi196 ceph-mon[32572]: pgmap v17615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:09 smithi110 ceph-mon[28069]: pgmap v17615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:11 smithi193 ceph-mon[32782]: pgmap v17616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:11 smithi196 ceph-mon[32572]: pgmap v17616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:11 smithi110 ceph-mon[28069]: pgmap v17616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32707.495792 secs 2024-04-26T20:53:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32707.495792 secs 2024-04-26T20:53:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32707.495792 secs 2024-04-26T20:53:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:13 smithi193 ceph-mon[32782]: pgmap v17617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:13 smithi196 ceph-mon[32572]: pgmap v17617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:13 smithi110 ceph-mon[28069]: pgmap v17617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:14 smithi193 ceph-mon[32782]: pgmap v17618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:14.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:14 smithi196 ceph-mon[32572]: pgmap v17618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:14 smithi110 ceph-mon[28069]: pgmap v17618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:17 smithi196 ceph-mon[32572]: pgmap v17619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:17 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 32712.495871 secs 2024-04-26T20:53:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:17 smithi196 ceph-mon[32572]: slow request 1441.451332 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:53:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:17 smithi110 ceph-mon[28069]: pgmap v17619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:17 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 32712.495871 secs 2024-04-26T20:53:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:17 smithi110 ceph-mon[28069]: slow request 1441.451332 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:53:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:17 smithi193 ceph-mon[32782]: pgmap v17619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:17 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 32712.495871 secs 2024-04-26T20:53:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:17 smithi193 ceph-mon[32782]: slow request 1441.451332 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:53:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:19 smithi196 ceph-mon[32572]: pgmap v17620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:19 smithi110 ceph-mon[28069]: pgmap v17620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:19 smithi193 ceph-mon[32782]: pgmap v17620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:21 smithi196 ceph-mon[32572]: pgmap v17621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:21 smithi110 ceph-mon[28069]: pgmap v17621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:21 smithi193 ceph-mon[32782]: pgmap v17621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32717.495983 secs 2024-04-26T20:53:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32717.495983 secs 2024-04-26T20:53:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32717.495983 secs 2024-04-26T20:53:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:23 smithi196 ceph-mon[32572]: pgmap v17622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:53:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:23 smithi110 ceph-mon[28069]: pgmap v17622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:53:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:23 smithi193 ceph-mon[32782]: pgmap v17622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:53:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:53:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:53:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:53:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:53:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:53:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:53:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:53:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:53:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:53:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:25 smithi196 ceph-mon[32572]: pgmap v17623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:53:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:25 smithi196 ceph-mon[32572]: pgmap v17624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:25 smithi110 ceph-mon[28069]: pgmap v17623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:53:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:25 smithi110 ceph-mon[28069]: pgmap v17624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:25 smithi193 ceph-mon[32782]: pgmap v17623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:53:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:25 smithi193 ceph-mon[32782]: pgmap v17624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:27 smithi196 ceph-mon[32572]: pgmap v17625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32722.496094 secs 2024-04-26T20:53:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:27 smithi110 ceph-mon[28069]: pgmap v17625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32722.496094 secs 2024-04-26T20:53:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:27 smithi193 ceph-mon[32782]: pgmap v17625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32722.496094 secs 2024-04-26T20:53:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:29 smithi196 ceph-mon[32572]: pgmap v17626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:29 smithi110 ceph-mon[28069]: pgmap v17626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:29 smithi193 ceph-mon[32782]: pgmap v17626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:31 smithi196 ceph-mon[32572]: pgmap v17627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:31 smithi110 ceph-mon[28069]: pgmap v17627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:31 smithi193 ceph-mon[32782]: pgmap v17627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32727.496230 secs 2024-04-26T20:53:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32727.496230 secs 2024-04-26T20:53:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32727.496230 secs 2024-04-26T20:53:33.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:33 smithi193 ceph-mon[32782]: pgmap v17628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:33 smithi110 ceph-mon[28069]: pgmap v17628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:33 smithi196 ceph-mon[32572]: pgmap v17628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:53:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:35 smithi110 ceph-mon[28069]: pgmap v17629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:53:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:35 smithi193 ceph-mon[32782]: pgmap v17629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:53:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:35 smithi196 ceph-mon[32572]: pgmap v17629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:53:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:37 smithi110 ceph-mon[28069]: pgmap v17630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32732.496330 secs 2024-04-26T20:53:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:37 smithi193 ceph-mon[32782]: pgmap v17630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32732.496330 secs 2024-04-26T20:53:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:37 smithi196 ceph-mon[32572]: pgmap v17630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32732.496330 secs 2024-04-26T20:53:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:39 smithi110 ceph-mon[28069]: pgmap v17631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:39 smithi193 ceph-mon[32782]: pgmap v17631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:39 smithi196 ceph-mon[32572]: pgmap v17631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:41 smithi110 ceph-mon[28069]: pgmap v17632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:41 smithi193 ceph-mon[32782]: pgmap v17632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:41 smithi196 ceph-mon[32572]: pgmap v17632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32737.496446 secs 2024-04-26T20:53:42.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32737.496446 secs 2024-04-26T20:53:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32737.496446 secs 2024-04-26T20:53:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:43 smithi193 ceph-mon[32782]: pgmap v17633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:43 smithi196 ceph-mon[32572]: pgmap v17633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:43 smithi110 ceph-mon[28069]: pgmap v17633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:45 smithi193 ceph-mon[32782]: pgmap v17634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:45 smithi196 ceph-mon[32572]: pgmap v17634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:45 smithi110 ceph-mon[28069]: pgmap v17634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:47 smithi193 ceph-mon[32782]: pgmap v17635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32742.496596 secs 2024-04-26T20:53:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:47 smithi196 ceph-mon[32572]: pgmap v17635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32742.496596 secs 2024-04-26T20:53:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:47 smithi110 ceph-mon[28069]: pgmap v17635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32742.496596 secs 2024-04-26T20:53:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:49 smithi193 ceph-mon[32782]: pgmap v17636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:49 smithi196 ceph-mon[32572]: pgmap v17636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:49 smithi110 ceph-mon[28069]: pgmap v17636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:51 smithi193 ceph-mon[32782]: pgmap v17637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:51 smithi196 ceph-mon[32572]: pgmap v17637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:51 smithi110 ceph-mon[28069]: pgmap v17637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32747.496713 secs 2024-04-26T20:53:52.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32747.496713 secs 2024-04-26T20:53:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32747.496713 secs 2024-04-26T20:53:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:53 smithi193 ceph-mon[32782]: pgmap v17638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:53 smithi196 ceph-mon[32572]: pgmap v17638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:53 smithi110 ceph-mon[28069]: pgmap v17638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:55 smithi193 ceph-mon[32782]: pgmap v17639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:55 smithi196 ceph-mon[32572]: pgmap v17639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:55 smithi110 ceph-mon[28069]: pgmap v17639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:57 smithi193 ceph-mon[32782]: pgmap v17640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32752.496824 secs 2024-04-26T20:53:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:57 smithi196 ceph-mon[32572]: pgmap v17640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32752.496824 secs 2024-04-26T20:53:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:57 smithi110 ceph-mon[28069]: pgmap v17640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:53:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32752.496824 secs 2024-04-26T20:53:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:53:59 smithi193 ceph-mon[32782]: pgmap v17641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:53:59 smithi196 ceph-mon[32572]: pgmap v17641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:53:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:53:59 smithi110 ceph-mon[28069]: pgmap v17641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:01 smithi193 ceph-mon[32782]: pgmap v17642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:01 smithi196 ceph-mon[32572]: pgmap v17642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:01 smithi110 ceph-mon[28069]: pgmap v17642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:02 smithi193 ceph-mon[32782]: pgmap v17643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32757.496947 secs 2024-04-26T20:54:02.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:02 smithi110 ceph-mon[28069]: pgmap v17643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:02.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32757.496947 secs 2024-04-26T20:54:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:02 smithi196 ceph-mon[32572]: pgmap v17643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32757.496947 secs 2024-04-26T20:54:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:04 smithi196 ceph-mon[32572]: pgmap v17644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:04 smithi110 ceph-mon[28069]: pgmap v17644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:04 smithi193 ceph-mon[32782]: pgmap v17644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:06 smithi196 ceph-mon[32572]: pgmap v17645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:06 smithi110 ceph-mon[28069]: pgmap v17645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:06 smithi193 ceph-mon[32782]: pgmap v17645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32762.497072 secs 2024-04-26T20:54:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32762.497072 secs 2024-04-26T20:54:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32762.497072 secs 2024-04-26T20:54:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:08 smithi196 ceph-mon[32572]: pgmap v17646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:08 smithi110 ceph-mon[28069]: pgmap v17646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:08 smithi193 ceph-mon[32782]: pgmap v17646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:10 smithi196 ceph-mon[32572]: pgmap v17647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:10 smithi110 ceph-mon[28069]: pgmap v17647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:10 smithi193 ceph-mon[32782]: pgmap v17647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32767.497225 secs 2024-04-26T20:54:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32767.497225 secs 2024-04-26T20:54:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32767.497225 secs 2024-04-26T20:54:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:13 smithi196 ceph-mon[32572]: pgmap v17648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:13 smithi110 ceph-mon[28069]: pgmap v17648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:13 smithi193 ceph-mon[32782]: pgmap v17648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:15 smithi196 ceph-mon[32572]: pgmap v17649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:15 smithi110 ceph-mon[28069]: pgmap v17649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:15 smithi193 ceph-mon[32782]: pgmap v17649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:54:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:54:16.160+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:54:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:54:16.160+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:54:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:54:16.160+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:54:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:54:16.160+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:54:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:54:16.160+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:17 smithi196 ceph-mon[32572]: pgmap v17650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32772.497355 secs 2024-04-26T20:54:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:17 smithi110 ceph-mon[28069]: pgmap v17650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32772.497355 secs 2024-04-26T20:54:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:17 smithi193 ceph-mon[32782]: pgmap v17650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32772.497355 secs 2024-04-26T20:54:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:19 smithi196 ceph-mon[32572]: pgmap v17651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:19 smithi110 ceph-mon[28069]: pgmap v17651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:19 smithi193 ceph-mon[32782]: pgmap v17651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:21 smithi196 ceph-mon[32572]: pgmap v17652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:21 smithi110 ceph-mon[28069]: pgmap v17652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:21 smithi193 ceph-mon[32782]: pgmap v17652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:54:21.802+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T20:54:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:54:21.802+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:54:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:54:21.803+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 253 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:54:21.804 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:54:21.803+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 253 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T20:54:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32777.497457 secs 2024-04-26T20:54:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32777.497457 secs 2024-04-26T20:54:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32777.497457 secs 2024-04-26T20:54:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:23 smithi196 ceph-mon[32572]: pgmap v17653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:23 smithi110 ceph-mon[28069]: pgmap v17653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:23 smithi193 ceph-mon[32782]: pgmap v17653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:54:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:54:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:54:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:25 smithi196 ceph-mon[32572]: pgmap v17654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:54:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:54:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:54:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:25 smithi110 ceph-mon[28069]: pgmap v17654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:54:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:54:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:54:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:25 smithi193 ceph-mon[32782]: pgmap v17654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T20:54:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:54:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:54:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:54:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:26 smithi196 ceph-mon[32572]: pgmap v17655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 177 B/s wr, 13 op/s 2024-04-26T20:54:26.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:26 smithi196 ceph-mon[32572]: pgmap v17656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T20:54:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:26 smithi110 ceph-mon[28069]: pgmap v17655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 177 B/s wr, 13 op/s 2024-04-26T20:54:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:26 smithi110 ceph-mon[28069]: pgmap v17656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T20:54:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:26 smithi193 ceph-mon[32782]: pgmap v17655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 177 B/s wr, 13 op/s 2024-04-26T20:54:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:26 smithi193 ceph-mon[32782]: pgmap v17656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T20:54:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32782.497602 secs 2024-04-26T20:54:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32782.497602 secs 2024-04-26T20:54:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32782.497602 secs 2024-04-26T20:54:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:28 smithi196 ceph-mon[32572]: pgmap v17657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:54:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:28 smithi110 ceph-mon[28069]: pgmap v17657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:54:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:28 smithi193 ceph-mon[32782]: pgmap v17657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:54:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:30 smithi196 ceph-mon[32572]: pgmap v17658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:54:30.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:30 smithi110 ceph-mon[28069]: pgmap v17658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:54:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:30 smithi193 ceph-mon[32782]: pgmap v17658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:54:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:32 smithi196 ceph-mon[32572]: pgmap v17659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:54:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32787.497724 secs 2024-04-26T20:54:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:32 smithi110 ceph-mon[28069]: pgmap v17659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:54:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32787.497724 secs 2024-04-26T20:54:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:32 smithi193 ceph-mon[32782]: pgmap v17659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:54:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32787.497724 secs 2024-04-26T20:54:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:34 smithi196 ceph-mon[32572]: pgmap v17660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:54:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:34 smithi110 ceph-mon[28069]: pgmap v17660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:54:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:34 smithi193 ceph-mon[32782]: pgmap v17660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:54:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:36 smithi196 ceph-mon[32572]: pgmap v17661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:54:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:36 smithi110 ceph-mon[28069]: pgmap v17661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:54:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:36 smithi193 ceph-mon[32782]: pgmap v17661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:54:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32792.497789 secs 2024-04-26T20:54:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32792.497789 secs 2024-04-26T20:54:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32792.497789 secs 2024-04-26T20:54:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:38 smithi196 ceph-mon[32572]: pgmap v17662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:38 smithi110 ceph-mon[28069]: pgmap v17662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:38 smithi193 ceph-mon[32782]: pgmap v17662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:40 smithi196 ceph-mon[32572]: pgmap v17663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:40 smithi110 ceph-mon[28069]: pgmap v17663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:40 smithi193 ceph-mon[32782]: pgmap v17663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:42 smithi110 ceph-mon[28069]: pgmap v17664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32797.497875 secs 2024-04-26T20:54:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:42 smithi193 ceph-mon[32782]: pgmap v17664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32797.497875 secs 2024-04-26T20:54:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:42 smithi196 ceph-mon[32572]: pgmap v17664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32797.497875 secs 2024-04-26T20:54:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:44 smithi110 ceph-mon[28069]: pgmap v17665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:44 smithi193 ceph-mon[32782]: pgmap v17665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:44 smithi196 ceph-mon[32572]: pgmap v17665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:46 smithi110 ceph-mon[28069]: pgmap v17666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:46 smithi193 ceph-mon[32782]: pgmap v17666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:46 smithi196 ceph-mon[32572]: pgmap v17666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32802.497994 secs 2024-04-26T20:54:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32802.497994 secs 2024-04-26T20:54:47.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32802.497994 secs 2024-04-26T20:54:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:48 smithi110 ceph-mon[28069]: pgmap v17667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:48 smithi193 ceph-mon[32782]: pgmap v17667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:48 smithi196 ceph-mon[32572]: pgmap v17667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:54:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:50 smithi110 ceph-mon[28069]: pgmap v17668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:50 smithi193 ceph-mon[32782]: pgmap v17668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:50 smithi196 ceph-mon[32572]: pgmap v17668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:52 smithi110 ceph-mon[28069]: pgmap v17669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:54:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32807.498108 secs 2024-04-26T20:54:52.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:52 smithi196 ceph-mon[32572]: pgmap v17669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:54:52.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32807.498108 secs 2024-04-26T20:54:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:52 smithi193 ceph-mon[32782]: pgmap v17669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:54:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32807.498108 secs 2024-04-26T20:54:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:54 smithi193 ceph-mon[32782]: pgmap v17670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:54 smithi196 ceph-mon[32572]: pgmap v17670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:54 smithi110 ceph-mon[28069]: pgmap v17670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:54:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:56 smithi193 ceph-mon[32782]: pgmap v17671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:54:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:56 smithi196 ceph-mon[32572]: pgmap v17671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:54:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:56 smithi110 ceph-mon[28069]: pgmap v17671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:54:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32812.498204 secs 2024-04-26T20:54:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32812.498204 secs 2024-04-26T20:54:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32812.498204 secs 2024-04-26T20:54:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:54:58 smithi193 ceph-mon[32782]: pgmap v17672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:54:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:54:58 smithi196 ceph-mon[32572]: pgmap v17672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:54:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:54:58 smithi110 ceph-mon[28069]: pgmap v17672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T20:55:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:00 smithi193 ceph-mon[32782]: pgmap v17673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:00 smithi196 ceph-mon[32572]: pgmap v17673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:00 smithi110 ceph-mon[28069]: pgmap v17673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:02.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:02 smithi110 ceph-mon[28069]: pgmap v17674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:02.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32817.498323 secs 2024-04-26T20:55:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:02 smithi193 ceph-mon[32782]: pgmap v17674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32817.498323 secs 2024-04-26T20:55:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:02 smithi196 ceph-mon[32572]: pgmap v17674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32817.498323 secs 2024-04-26T20:55:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:04 smithi193 ceph-mon[32782]: pgmap v17675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:55:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:04 smithi196 ceph-mon[32572]: pgmap v17675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:55:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:04 smithi110 ceph-mon[28069]: pgmap v17675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:55:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:06 smithi193 ceph-mon[32782]: pgmap v17676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:55:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:06 smithi196 ceph-mon[32572]: pgmap v17676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:55:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:06 smithi110 ceph-mon[28069]: pgmap v17676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:55:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32822.498445 secs 2024-04-26T20:55:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32822.498445 secs 2024-04-26T20:55:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32822.498445 secs 2024-04-26T20:55:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:08 smithi193 ceph-mon[32782]: pgmap v17677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:55:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:08 smithi196 ceph-mon[32572]: pgmap v17677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:55:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:08 smithi110 ceph-mon[28069]: pgmap v17677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:55:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:10 smithi193 ceph-mon[32782]: pgmap v17678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:55:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:10 smithi196 ceph-mon[32572]: pgmap v17678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:55:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:10 smithi110 ceph-mon[28069]: pgmap v17678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:55:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:12 smithi193 ceph-mon[32782]: pgmap v17679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:55:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32827.498581 secs 2024-04-26T20:55:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:12 smithi196 ceph-mon[32572]: pgmap v17679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:55:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32827.498581 secs 2024-04-26T20:55:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:12 smithi110 ceph-mon[28069]: pgmap v17679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T20:55:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32827.498581 secs 2024-04-26T20:55:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:14 smithi193 ceph-mon[32782]: pgmap v17680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:55:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:14 smithi196 ceph-mon[32572]: pgmap v17680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:55:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:14 smithi110 ceph-mon[28069]: pgmap v17680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T20:55:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:16 smithi193 ceph-mon[32782]: pgmap v17681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:16 smithi196 ceph-mon[32572]: pgmap v17681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:16 smithi110 ceph-mon[28069]: pgmap v17681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32832.498628 secs 2024-04-26T20:55:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32832.498628 secs 2024-04-26T20:55:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32832.498628 secs 2024-04-26T20:55:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:18 smithi196 ceph-mon[32572]: pgmap v17682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:18 smithi110 ceph-mon[28069]: pgmap v17682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:18 smithi193 ceph-mon[32782]: pgmap v17682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:19 smithi196 ceph-mon[32572]: pgmap v17683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:19 smithi110 ceph-mon[28069]: pgmap v17683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:19 smithi193 ceph-mon[32782]: pgmap v17683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:22 smithi196 ceph-mon[32572]: pgmap v17684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32837.498727 secs 2024-04-26T20:55:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:22 smithi110 ceph-mon[28069]: pgmap v17684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32837.498727 secs 2024-04-26T20:55:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:22 smithi193 ceph-mon[32782]: pgmap v17684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32837.498727 secs 2024-04-26T20:55:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:24 smithi196 ceph-mon[32572]: pgmap v17685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:24 smithi110 ceph-mon[28069]: pgmap v17685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:24 smithi193 ceph-mon[32782]: pgmap v17685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:26 smithi196 ceph-mon[32572]: pgmap v17686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:26 smithi110 ceph-mon[28069]: pgmap v17686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:26 smithi193 ceph-mon[32782]: pgmap v17686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:55:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:55:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:55:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32842.498849 secs 2024-04-26T20:55:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:55:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:55:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:55:27.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32842.498849 secs 2024-04-26T20:55:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:55:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:55:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:55:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32842.498849 secs 2024-04-26T20:55:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:28 smithi196 ceph-mon[32572]: pgmap v17687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T20:55:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:28 smithi196 ceph-mon[32572]: pgmap v17688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:28 smithi110 ceph-mon[28069]: pgmap v17687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T20:55:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:28 smithi110 ceph-mon[28069]: pgmap v17688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:28 smithi193 ceph-mon[32782]: pgmap v17687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T20:55:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:28 smithi193 ceph-mon[32782]: pgmap v17688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:30 smithi110 ceph-mon[28069]: pgmap v17689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:30 smithi193 ceph-mon[32782]: pgmap v17689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:30 smithi196 ceph-mon[32572]: pgmap v17689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:32 smithi110 ceph-mon[28069]: pgmap v17690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32847.498966 secs 2024-04-26T20:55:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:32 smithi193 ceph-mon[32782]: pgmap v17690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32847.498966 secs 2024-04-26T20:55:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:32 smithi196 ceph-mon[32572]: pgmap v17690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32847.498966 secs 2024-04-26T20:55:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:34 smithi110 ceph-mon[28069]: pgmap v17691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:34 smithi193 ceph-mon[32782]: pgmap v17691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:34 smithi196 ceph-mon[32572]: pgmap v17691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:36 smithi110 ceph-mon[28069]: pgmap v17692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:36 smithi193 ceph-mon[32782]: pgmap v17692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:36 smithi196 ceph-mon[32572]: pgmap v17692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:55:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32852.499088 secs 2024-04-26T20:55:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32852.499088 secs 2024-04-26T20:55:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32852.499088 secs 2024-04-26T20:55:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:38 smithi110 ceph-mon[28069]: pgmap v17693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:55:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:38 smithi193 ceph-mon[32782]: pgmap v17693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:55:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:38 smithi196 ceph-mon[32572]: pgmap v17693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:55:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:40 smithi193 ceph-mon[32782]: pgmap v17694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:40 smithi196 ceph-mon[32572]: pgmap v17694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:40 smithi110 ceph-mon[28069]: pgmap v17694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:42 smithi193 ceph-mon[32782]: pgmap v17695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32857.499223 secs 2024-04-26T20:55:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:42 smithi196 ceph-mon[32572]: pgmap v17695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32857.499223 secs 2024-04-26T20:55:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:42 smithi110 ceph-mon[28069]: pgmap v17695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32857.499223 secs 2024-04-26T20:55:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:44 smithi193 ceph-mon[32782]: pgmap v17696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:44 smithi196 ceph-mon[32572]: pgmap v17696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:44 smithi110 ceph-mon[28069]: pgmap v17696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:46 smithi193 ceph-mon[32782]: pgmap v17697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:46 smithi196 ceph-mon[32572]: pgmap v17697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:46 smithi110 ceph-mon[28069]: pgmap v17697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32862.499341 secs 2024-04-26T20:55:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32862.499341 secs 2024-04-26T20:55:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32862.499341 secs 2024-04-26T20:55:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:48 smithi193 ceph-mon[32782]: pgmap v17698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:48 smithi196 ceph-mon[32572]: pgmap v17698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:48 smithi110 ceph-mon[28069]: pgmap v17698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:50 smithi193 ceph-mon[32782]: pgmap v17699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:50 smithi196 ceph-mon[32572]: pgmap v17699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:50 smithi110 ceph-mon[28069]: pgmap v17699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:52 smithi193 ceph-mon[32782]: pgmap v17700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32867.499459 secs 2024-04-26T20:55:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:52 smithi196 ceph-mon[32572]: pgmap v17700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32867.499459 secs 2024-04-26T20:55:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:52 smithi110 ceph-mon[28069]: pgmap v17700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32867.499459 secs 2024-04-26T20:55:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:54 smithi193 ceph-mon[32782]: pgmap v17701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:54 smithi196 ceph-mon[32572]: pgmap v17701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:54 smithi110 ceph-mon[28069]: pgmap v17701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:55:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:56 smithi193 ceph-mon[32782]: pgmap v17702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:56 smithi196 ceph-mon[32572]: pgmap v17702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:56 smithi110 ceph-mon[28069]: pgmap v17702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32872.499593 secs 2024-04-26T20:55:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32872.499593 secs 2024-04-26T20:55:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32872.499593 secs 2024-04-26T20:55:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:55:58 smithi193 ceph-mon[32782]: pgmap v17703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:55:58 smithi196 ceph-mon[32572]: pgmap v17703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:55:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:55:58 smithi110 ceph-mon[28069]: pgmap v17703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:00 smithi193 ceph-mon[32782]: pgmap v17704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:00 smithi196 ceph-mon[32572]: pgmap v17704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:00 smithi110 ceph-mon[28069]: pgmap v17704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:02 smithi193 ceph-mon[32782]: pgmap v17705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32877.499715 secs 2024-04-26T20:56:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:02 smithi196 ceph-mon[32572]: pgmap v17705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32877.499715 secs 2024-04-26T20:56:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:02 smithi110 ceph-mon[28069]: pgmap v17705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32877.499715 secs 2024-04-26T20:56:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:04 smithi193 ceph-mon[32782]: pgmap v17706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:04 smithi196 ceph-mon[32572]: pgmap v17706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:04 smithi110 ceph-mon[28069]: pgmap v17706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:06 smithi196 ceph-mon[32572]: pgmap v17707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:06 smithi110 ceph-mon[28069]: pgmap v17707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:06 smithi193 ceph-mon[32782]: pgmap v17707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32882.499831 secs 2024-04-26T20:56:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32882.499831 secs 2024-04-26T20:56:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32882.499831 secs 2024-04-26T20:56:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:08 smithi196 ceph-mon[32572]: pgmap v17708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:08 smithi110 ceph-mon[28069]: pgmap v17708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:08 smithi193 ceph-mon[32782]: pgmap v17708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:09 smithi196 ceph-mon[32572]: pgmap v17709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:09 smithi110 ceph-mon[28069]: pgmap v17709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:09 smithi193 ceph-mon[32782]: pgmap v17709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:11 smithi193 ceph-mon[32782]: pgmap v17710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:11 smithi196 ceph-mon[32572]: pgmap v17710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:11 smithi110 ceph-mon[28069]: pgmap v17710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32887.499921 secs 2024-04-26T20:56:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32887.499921 secs 2024-04-26T20:56:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32887.499921 secs 2024-04-26T20:56:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:13 smithi193 ceph-mon[32782]: pgmap v17711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:13 smithi196 ceph-mon[32572]: pgmap v17711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:13 smithi110 ceph-mon[28069]: pgmap v17711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:15 smithi193 ceph-mon[32782]: pgmap v17712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:15 smithi196 ceph-mon[32572]: pgmap v17712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:15 smithi110 ceph-mon[28069]: pgmap v17712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:17 smithi193 ceph-mon[32782]: pgmap v17713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32892.500041 secs 2024-04-26T20:56:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:17 smithi196 ceph-mon[32572]: pgmap v17713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32892.500041 secs 2024-04-26T20:56:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:17 smithi110 ceph-mon[28069]: pgmap v17713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32892.500041 secs 2024-04-26T20:56:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:19 smithi193 ceph-mon[32782]: pgmap v17714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:19 smithi196 ceph-mon[32572]: pgmap v17714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:19 smithi110 ceph-mon[28069]: pgmap v17714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:21 smithi193 ceph-mon[32782]: pgmap v17715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:22.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:21 smithi196 ceph-mon[32572]: pgmap v17715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:21 smithi110 ceph-mon[28069]: pgmap v17715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32897.500156 secs 2024-04-26T20:56:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32897.500156 secs 2024-04-26T20:56:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32897.500156 secs 2024-04-26T20:56:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:23 smithi193 ceph-mon[32782]: pgmap v17716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:23 smithi196 ceph-mon[32572]: pgmap v17716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:23 smithi110 ceph-mon[28069]: pgmap v17716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:25 smithi193 ceph-mon[32782]: pgmap v17717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:25 smithi196 ceph-mon[32572]: pgmap v17717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:25 smithi110 ceph-mon[28069]: pgmap v17717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:27 smithi193 ceph-mon[32782]: pgmap v17718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32902.500229 secs 2024-04-26T20:56:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:56:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:27 smithi196 ceph-mon[32572]: pgmap v17718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32902.500229 secs 2024-04-26T20:56:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:56:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:27 smithi110 ceph-mon[28069]: pgmap v17718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32902.500229 secs 2024-04-26T20:56:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:56:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:56:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:56:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:28 smithi193 ceph-mon[32782]: pgmap v17719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:56:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:28 smithi193 ceph-mon[32782]: pgmap v17720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:56:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:56:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:56:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:28 smithi196 ceph-mon[32572]: pgmap v17719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:56:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:28 smithi196 ceph-mon[32572]: pgmap v17720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:56:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:56:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:56:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:28 smithi110 ceph-mon[28069]: pgmap v17719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T20:56:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:28 smithi110 ceph-mon[28069]: pgmap v17720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:56:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:31 smithi193 ceph-mon[32782]: pgmap v17721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:31 smithi196 ceph-mon[32572]: pgmap v17721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:31 smithi110 ceph-mon[28069]: pgmap v17721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32907.500354 secs 2024-04-26T20:56:32.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32907.500354 secs 2024-04-26T20:56:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32907.500354 secs 2024-04-26T20:56:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:33 smithi193 ceph-mon[32782]: pgmap v17722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:56:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:33 smithi196 ceph-mon[32572]: pgmap v17722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:56:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:33 smithi110 ceph-mon[28069]: pgmap v17722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T20:56:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:35 smithi193 ceph-mon[32782]: pgmap v17723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:35 smithi196 ceph-mon[32572]: pgmap v17723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:35 smithi110 ceph-mon[28069]: pgmap v17723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:37 smithi193 ceph-mon[32782]: pgmap v17724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32912.500494 secs 2024-04-26T20:56:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:37 smithi196 ceph-mon[32572]: pgmap v17724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32912.500494 secs 2024-04-26T20:56:37.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:37 smithi110 ceph-mon[28069]: pgmap v17724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:56:37.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32912.500494 secs 2024-04-26T20:56:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:39 smithi196 ceph-mon[32572]: pgmap v17725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:56:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:39 smithi110 ceph-mon[28069]: pgmap v17725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:56:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:39 smithi193 ceph-mon[32782]: pgmap v17725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:56:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:41 smithi196 ceph-mon[32572]: pgmap v17726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:41 smithi110 ceph-mon[28069]: pgmap v17726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:41 smithi193 ceph-mon[32782]: pgmap v17726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32917.500619 secs 2024-04-26T20:56:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32917.500619 secs 2024-04-26T20:56:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32917.500619 secs 2024-04-26T20:56:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:43 smithi196 ceph-mon[32572]: pgmap v17727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:43 smithi110 ceph-mon[28069]: pgmap v17727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:43 smithi193 ceph-mon[32782]: pgmap v17727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:44 smithi196 ceph-mon[32572]: pgmap v17728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:44 smithi110 ceph-mon[28069]: pgmap v17728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:44 smithi193 ceph-mon[32782]: pgmap v17728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:47 smithi193 ceph-mon[32782]: pgmap v17729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32922.500736 secs 2024-04-26T20:56:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:47 smithi196 ceph-mon[32572]: pgmap v17729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32922.500736 secs 2024-04-26T20:56:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:47 smithi110 ceph-mon[28069]: pgmap v17729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32922.500736 secs 2024-04-26T20:56:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:49 smithi193 ceph-mon[32782]: pgmap v17730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:49 smithi196 ceph-mon[32572]: pgmap v17730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:49 smithi110 ceph-mon[28069]: pgmap v17730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:51 smithi193 ceph-mon[32782]: pgmap v17731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:51 smithi196 ceph-mon[32572]: pgmap v17731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:51 smithi110 ceph-mon[28069]: pgmap v17731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32927.500857 secs 2024-04-26T20:56:52.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32927.500857 secs 2024-04-26T20:56:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32927.500857 secs 2024-04-26T20:56:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:53 smithi193 ceph-mon[32782]: pgmap v17732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:53 smithi196 ceph-mon[32572]: pgmap v17732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:53 smithi110 ceph-mon[28069]: pgmap v17732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:55 smithi193 ceph-mon[32782]: pgmap v17733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:55 smithi196 ceph-mon[32572]: pgmap v17733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:55.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:55 smithi110 ceph-mon[28069]: pgmap v17733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:57 smithi196 ceph-mon[32572]: pgmap v17734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32932.500977 secs 2024-04-26T20:56:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:57 smithi110 ceph-mon[28069]: pgmap v17734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32932.500977 secs 2024-04-26T20:56:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:57 smithi193 ceph-mon[32782]: pgmap v17734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:56:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32932.500977 secs 2024-04-26T20:56:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:56:59 smithi196 ceph-mon[32572]: pgmap v17735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:56:59 smithi110 ceph-mon[28069]: pgmap v17735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:56:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:56:59 smithi193 ceph-mon[32782]: pgmap v17735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:01 smithi196 ceph-mon[32572]: pgmap v17736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:01 smithi110 ceph-mon[28069]: pgmap v17736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:01 smithi193 ceph-mon[32782]: pgmap v17736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:02.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32937.501114 secs 2024-04-26T20:57:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32937.501114 secs 2024-04-26T20:57:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32937.501114 secs 2024-04-26T20:57:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:03 smithi196 ceph-mon[32572]: pgmap v17737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:03 smithi110 ceph-mon[28069]: pgmap v17737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:03 smithi193 ceph-mon[32782]: pgmap v17737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:04 smithi196 ceph-mon[32572]: pgmap v17738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:04 smithi110 ceph-mon[28069]: pgmap v17738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:04 smithi193 ceph-mon[32782]: pgmap v17738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:07 smithi193 ceph-mon[32782]: pgmap v17739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32942.501235 secs 2024-04-26T20:57:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:07 smithi196 ceph-mon[32572]: pgmap v17739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32942.501235 secs 2024-04-26T20:57:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:07 smithi110 ceph-mon[28069]: pgmap v17739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32942.501235 secs 2024-04-26T20:57:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:09 smithi193 ceph-mon[32782]: pgmap v17740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:09 smithi196 ceph-mon[32572]: pgmap v17740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:09 smithi110 ceph-mon[28069]: pgmap v17740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:11 smithi193 ceph-mon[32782]: pgmap v17741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:11 smithi196 ceph-mon[32572]: pgmap v17741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:11 smithi110 ceph-mon[28069]: pgmap v17741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32947.501351 secs 2024-04-26T20:57:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32947.501351 secs 2024-04-26T20:57:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32947.501351 secs 2024-04-26T20:57:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:13 smithi196 ceph-mon[32572]: pgmap v17742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:13 smithi110 ceph-mon[28069]: pgmap v17742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:13 smithi193 ceph-mon[32782]: pgmap v17742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:15 smithi196 ceph-mon[32572]: pgmap v17743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:15 smithi110 ceph-mon[28069]: pgmap v17743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:15 smithi193 ceph-mon[32782]: pgmap v17743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:17 smithi196 ceph-mon[32572]: pgmap v17744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:17 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32952.501487 secs 2024-04-26T20:57:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:17 smithi110 ceph-mon[28069]: pgmap v17744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:17 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32952.501487 secs 2024-04-26T20:57:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:17 smithi193 ceph-mon[32782]: pgmap v17744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:17 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32952.501487 secs 2024-04-26T20:57:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:19 smithi196 ceph-mon[32572]: pgmap v17745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:19 smithi110 ceph-mon[28069]: pgmap v17745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:19 smithi193 ceph-mon[32782]: pgmap v17745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:21 smithi196 ceph-mon[32572]: pgmap v17746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:21 smithi110 ceph-mon[28069]: pgmap v17746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:21.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:57:21.833+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T20:57:21.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:57:21.833+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T20:57:21.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:57:21.834+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 254 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T20:57:21.834 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T20:57:21.834+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 254 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T20:57:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:21 smithi193 ceph-mon[32782]: pgmap v17746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:22.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32957.501606 secs 2024-04-26T20:57:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32957.501606 secs 2024-04-26T20:57:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32957.501606 secs 2024-04-26T20:57:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:23 smithi196 ceph-mon[32572]: pgmap v17747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:23 smithi110 ceph-mon[28069]: pgmap v17747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:23 smithi193 ceph-mon[32782]: pgmap v17747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:24 smithi196 ceph-mon[32572]: pgmap v17748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:24 smithi110 ceph-mon[28069]: pgmap v17748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:24 smithi193 ceph-mon[32782]: pgmap v17748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:27 smithi196 ceph-mon[32572]: pgmap v17749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32962.501725 secs 2024-04-26T20:57:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:27 smithi110 ceph-mon[28069]: pgmap v17749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32962.501725 secs 2024-04-26T20:57:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:27 smithi193 ceph-mon[32782]: pgmap v17749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32962.501725 secs 2024-04-26T20:57:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:29 smithi193 ceph-mon[32782]: pgmap v17750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:57:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:29 smithi196 ceph-mon[32572]: pgmap v17750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:57:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:29 smithi110 ceph-mon[28069]: pgmap v17750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:57:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:57:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:57:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:57:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:57:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:57:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:57:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:31 smithi196 ceph-mon[32572]: pgmap v17751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T20:57:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:31 smithi196 ceph-mon[32572]: pgmap v17752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:31 smithi110 ceph-mon[28069]: pgmap v17751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T20:57:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:31 smithi110 ceph-mon[28069]: pgmap v17752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:31 smithi193 ceph-mon[32782]: pgmap v17751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T20:57:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:31 smithi193 ceph-mon[32782]: pgmap v17752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:32.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32967.501814 secs 2024-04-26T20:57:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32967.501814 secs 2024-04-26T20:57:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32967.501814 secs 2024-04-26T20:57:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:33 smithi196 ceph-mon[32572]: pgmap v17753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:33 smithi110 ceph-mon[28069]: pgmap v17753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:33 smithi193 ceph-mon[32782]: pgmap v17753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:35 smithi196 ceph-mon[32572]: pgmap v17754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:35 smithi110 ceph-mon[28069]: pgmap v17754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:35 smithi193 ceph-mon[32782]: pgmap v17754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:37.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:37 smithi193 ceph-mon[32782]: pgmap v17755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:37.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32972.501896 secs 2024-04-26T20:57:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:37 smithi196 ceph-mon[32572]: pgmap v17755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32972.501896 secs 2024-04-26T20:57:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:37 smithi110 ceph-mon[28069]: pgmap v17755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32972.501896 secs 2024-04-26T20:57:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:39 smithi196 ceph-mon[32572]: pgmap v17756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:39 smithi110 ceph-mon[28069]: pgmap v17756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:39 smithi193 ceph-mon[32782]: pgmap v17756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:57:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:40 smithi196 ceph-mon[32572]: pgmap v17757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:57:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:40 smithi110 ceph-mon[28069]: pgmap v17757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:57:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:40 smithi193 ceph-mon[32782]: pgmap v17757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:57:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32977.502015 secs 2024-04-26T20:57:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:42 smithi196 ceph-mon[32572]: pgmap v17758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32977.502015 secs 2024-04-26T20:57:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:42 smithi110 ceph-mon[28069]: pgmap v17758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32977.502015 secs 2024-04-26T20:57:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:42 smithi193 ceph-mon[32782]: pgmap v17758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:44 smithi196 ceph-mon[32572]: pgmap v17759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:44 smithi110 ceph-mon[28069]: pgmap v17759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:44 smithi193 ceph-mon[32782]: pgmap v17759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:46 smithi196 ceph-mon[32572]: pgmap v17760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:46 smithi110 ceph-mon[28069]: pgmap v17760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:46 smithi193 ceph-mon[32782]: pgmap v17760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32982.502137 secs 2024-04-26T20:57:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32982.502137 secs 2024-04-26T20:57:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32982.502137 secs 2024-04-26T20:57:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:48 smithi196 ceph-mon[32572]: pgmap v17761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:48 smithi110 ceph-mon[28069]: pgmap v17761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:48 smithi193 ceph-mon[32782]: pgmap v17761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:50 smithi196 ceph-mon[32572]: pgmap v17762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:50 smithi110 ceph-mon[28069]: pgmap v17762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:50 smithi193 ceph-mon[32782]: pgmap v17762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32987.502254 secs 2024-04-26T20:57:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:52 smithi196 ceph-mon[32572]: pgmap v17763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32987.502254 secs 2024-04-26T20:57:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:52 smithi110 ceph-mon[28069]: pgmap v17763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32987.502254 secs 2024-04-26T20:57:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:52 smithi193 ceph-mon[32782]: pgmap v17763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:54 smithi196 ceph-mon[32572]: pgmap v17764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:54 smithi110 ceph-mon[28069]: pgmap v17764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:54 smithi193 ceph-mon[32782]: pgmap v17764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:56 smithi196 ceph-mon[32572]: pgmap v17765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:56 smithi110 ceph-mon[28069]: pgmap v17765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:56 smithi193 ceph-mon[32782]: pgmap v17765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:57:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32992.502370 secs 2024-04-26T20:57:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32992.502370 secs 2024-04-26T20:57:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32992.502370 secs 2024-04-26T20:57:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:57:58 smithi196 ceph-mon[32572]: pgmap v17766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:57:58 smithi110 ceph-mon[28069]: pgmap v17766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:57:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:57:58 smithi193 ceph-mon[32782]: pgmap v17766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:00 smithi196 ceph-mon[32572]: pgmap v17767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:00 smithi110 ceph-mon[28069]: pgmap v17767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:00 smithi193 ceph-mon[32782]: pgmap v17767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 32997.502491 secs 2024-04-26T20:58:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:02 smithi196 ceph-mon[32572]: pgmap v17768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 32997.502491 secs 2024-04-26T20:58:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:02 smithi110 ceph-mon[28069]: pgmap v17768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 32997.502491 secs 2024-04-26T20:58:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:02 smithi193 ceph-mon[32782]: pgmap v17768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:04 smithi196 ceph-mon[32572]: pgmap v17769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:04 smithi110 ceph-mon[28069]: pgmap v17769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:04 smithi193 ceph-mon[32782]: pgmap v17769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:06 smithi196 ceph-mon[32572]: pgmap v17770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:07.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:06 smithi110 ceph-mon[28069]: pgmap v17770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:06 smithi193 ceph-mon[32782]: pgmap v17770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:08 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33002.502635 secs 2024-04-26T20:58:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:08 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33002.502635 secs 2024-04-26T20:58:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:08 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33002.502635 secs 2024-04-26T20:58:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:09 smithi196 ceph-mon[32572]: pgmap v17771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:09 smithi110 ceph-mon[28069]: pgmap v17771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:09 smithi193 ceph-mon[32782]: pgmap v17771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:11 smithi110 ceph-mon[28069]: pgmap v17772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:11 smithi193 ceph-mon[32782]: pgmap v17772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:11 smithi196 ceph-mon[32572]: pgmap v17772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33007.502698 secs 2024-04-26T20:58:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33007.502698 secs 2024-04-26T20:58:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33007.502698 secs 2024-04-26T20:58:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:13 smithi196 ceph-mon[32572]: pgmap v17773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:13 smithi110 ceph-mon[28069]: pgmap v17773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:13 smithi193 ceph-mon[32782]: pgmap v17773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:15 smithi196 ceph-mon[32572]: pgmap v17774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:15 smithi110 ceph-mon[28069]: pgmap v17774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:15.631 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:15 smithi193 ceph-mon[32782]: pgmap v17774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:17 smithi196 ceph-mon[32572]: pgmap v17775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:17 smithi196 ceph-mon[32572]: 25 slow requests, 1 included below; oldest blocked for > 33012.502822 secs 2024-04-26T20:58:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:17 smithi196 ceph-mon[32572]: slow request 1441.230697 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:58:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:17 smithi110 ceph-mon[28069]: pgmap v17775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:17 smithi110 ceph-mon[28069]: 25 slow requests, 1 included below; oldest blocked for > 33012.502822 secs 2024-04-26T20:58:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:17 smithi110 ceph-mon[28069]: slow request 1441.230697 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:58:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:17 smithi193 ceph-mon[32782]: pgmap v17775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:17 smithi193 ceph-mon[32782]: 25 slow requests, 1 included below; oldest blocked for > 33012.502822 secs 2024-04-26T20:58:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:17 smithi193 ceph-mon[32782]: slow request 1441.230697 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:58:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:19 smithi110 ceph-mon[28069]: pgmap v17776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:19 smithi193 ceph-mon[32782]: pgmap v17776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:19 smithi196 ceph-mon[32572]: pgmap v17776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:21 smithi110 ceph-mon[28069]: pgmap v17777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:21 smithi193 ceph-mon[32782]: pgmap v17777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:21 smithi196 ceph-mon[32572]: pgmap v17777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:22 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33017.502897 secs 2024-04-26T20:58:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:22 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33017.502897 secs 2024-04-26T20:58:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:22 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33017.502897 secs 2024-04-26T20:58:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:23 smithi110 ceph-mon[28069]: pgmap v17778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:23 smithi193 ceph-mon[32782]: pgmap v17778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:23.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:23 smithi196 ceph-mon[32572]: pgmap v17778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:25 smithi110 ceph-mon[28069]: pgmap v17779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:25 smithi193 ceph-mon[32782]: pgmap v17779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:25 smithi196 ceph-mon[32572]: pgmap v17779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:27 smithi110 ceph-mon[28069]: pgmap v17780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:27 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33022.503033 secs 2024-04-26T20:58:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:27 smithi193 ceph-mon[32782]: pgmap v17780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:27 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33022.503033 secs 2024-04-26T20:58:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:27 smithi196 ceph-mon[32572]: pgmap v17780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:27 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33022.503033 secs 2024-04-26T20:58:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:29 smithi110 ceph-mon[28069]: pgmap v17781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:29 smithi193 ceph-mon[32782]: pgmap v17781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:29 smithi196 ceph-mon[32572]: pgmap v17781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:58:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:58:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:58:31.589 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:31 smithi196 ceph-mon[32572]: pgmap v17782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:31.610 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:31 smithi193 ceph-mon[32782]: pgmap v17782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:31 smithi110 ceph-mon[28069]: pgmap v17782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:32.566 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:32 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33027.503143 secs 2024-04-26T20:58:32.587 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:32 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33027.503143 secs 2024-04-26T20:58:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:32 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33027.503143 secs 2024-04-26T20:58:33.570 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:33 smithi196 ceph-mon[32572]: pgmap v17783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:33.601 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:33 smithi193 ceph-mon[32782]: pgmap v17783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:33.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:33 smithi110 ceph-mon[28069]: pgmap v17783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:35 smithi196 ceph-mon[32572]: pgmap v17784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:35.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:58:35.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:35 smithi110 ceph-mon[28069]: pgmap v17784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:58:35.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:35 smithi193 ceph-mon[32782]: pgmap v17784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:58:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:58:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:36 smithi196 ceph-mon[32572]: pgmap v17785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T20:58:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:36 smithi196 ceph-mon[32572]: pgmap v17786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:36 smithi110 ceph-mon[28069]: pgmap v17785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T20:58:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:36 smithi110 ceph-mon[28069]: pgmap v17786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:36 smithi193 ceph-mon[32782]: pgmap v17785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 953 B/s rd, 1 op/s 2024-04-26T20:58:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:36 smithi193 ceph-mon[32782]: pgmap v17786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:37 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33032.503262 secs 2024-04-26T20:58:37.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:37 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33032.503262 secs 2024-04-26T20:58:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:37 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33032.503262 secs 2024-04-26T20:58:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:38 smithi196 ceph-mon[32572]: pgmap v17787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 585 B/s rd, 1 op/s 2024-04-26T20:58:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:38 smithi110 ceph-mon[28069]: pgmap v17787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 585 B/s rd, 1 op/s 2024-04-26T20:58:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:38 smithi193 ceph-mon[32782]: pgmap v17787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 585 B/s rd, 1 op/s 2024-04-26T20:58:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:40 smithi196 ceph-mon[32572]: pgmap v17788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:40 smithi110 ceph-mon[28069]: pgmap v17788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:40 smithi193 ceph-mon[32782]: pgmap v17788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:41 smithi196 ceph-mon[32572]: pgmap v17789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:41 smithi110 ceph-mon[28069]: pgmap v17789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:41 smithi193 ceph-mon[32782]: pgmap v17789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:42 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33037.503380 secs 2024-04-26T20:58:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:42 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33037.503380 secs 2024-04-26T20:58:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:42 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33037.503380 secs 2024-04-26T20:58:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:43 smithi196 ceph-mon[32572]: pgmap v17790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:43 smithi110 ceph-mon[28069]: pgmap v17790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:43 smithi193 ceph-mon[32782]: pgmap v17790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:58:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:45 smithi196 ceph-mon[32572]: pgmap v17791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:58:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:45 smithi110 ceph-mon[28069]: pgmap v17791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:58:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:45 smithi193 ceph-mon[32782]: pgmap v17791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:58:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:47 smithi196 ceph-mon[32572]: pgmap v17792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:47 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33042.503512 secs 2024-04-26T20:58:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:47 smithi110 ceph-mon[28069]: pgmap v17792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:47 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33042.503512 secs 2024-04-26T20:58:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:47 smithi193 ceph-mon[32782]: pgmap v17792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:47 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33042.503512 secs 2024-04-26T20:58:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:49 smithi196 ceph-mon[32572]: pgmap v17793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:49 smithi110 ceph-mon[28069]: pgmap v17793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:49 smithi193 ceph-mon[32782]: pgmap v17793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:51 smithi196 ceph-mon[32572]: pgmap v17794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:51 smithi110 ceph-mon[28069]: pgmap v17794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:51 smithi193 ceph-mon[32782]: pgmap v17794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:52 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33047.503609 secs 2024-04-26T20:58:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:52 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33047.503609 secs 2024-04-26T20:58:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:52 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33047.503609 secs 2024-04-26T20:58:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:53 smithi196 ceph-mon[32572]: pgmap v17795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:53 smithi110 ceph-mon[28069]: pgmap v17795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:53 smithi193 ceph-mon[32782]: pgmap v17795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:55 smithi196 ceph-mon[32572]: pgmap v17796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:55 smithi110 ceph-mon[28069]: pgmap v17796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:55 smithi193 ceph-mon[32782]: pgmap v17796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:57 smithi196 ceph-mon[32572]: pgmap v17797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:57 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33052.503728 secs 2024-04-26T20:58:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:57 smithi110 ceph-mon[28069]: pgmap v17797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:57 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33052.503728 secs 2024-04-26T20:58:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:57 smithi193 ceph-mon[32782]: pgmap v17797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:58:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:57 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33052.503728 secs 2024-04-26T20:59:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:58:59 smithi196 ceph-mon[32572]: pgmap v17798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:58:59 smithi110 ceph-mon[28069]: pgmap v17798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:58:59 smithi193 ceph-mon[32782]: pgmap v17798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:01 smithi196 ceph-mon[32572]: pgmap v17799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:01 smithi110 ceph-mon[28069]: pgmap v17799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:01 smithi193 ceph-mon[32782]: pgmap v17799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:02 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33057.503808 secs 2024-04-26T20:59:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:02 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33057.503808 secs 2024-04-26T20:59:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:02 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33057.503808 secs 2024-04-26T20:59:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:03 smithi196 ceph-mon[32572]: pgmap v17800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:03 smithi110 ceph-mon[28069]: pgmap v17800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:03 smithi193 ceph-mon[32782]: pgmap v17800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:05 smithi196 ceph-mon[32572]: pgmap v17801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:05 smithi110 ceph-mon[28069]: pgmap v17801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:05 smithi193 ceph-mon[32782]: pgmap v17801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:07 smithi110 ceph-mon[28069]: pgmap v17802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:07 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33062.503890 secs 2024-04-26T20:59:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:07 smithi193 ceph-mon[32782]: pgmap v17802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:07 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33062.503890 secs 2024-04-26T20:59:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:07 smithi196 ceph-mon[32572]: pgmap v17802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:07 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33062.503890 secs 2024-04-26T20:59:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:09 smithi110 ceph-mon[28069]: pgmap v17803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:09 smithi193 ceph-mon[32782]: pgmap v17803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:09 smithi196 ceph-mon[32572]: pgmap v17803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:11 smithi110 ceph-mon[28069]: pgmap v17804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:11 smithi193 ceph-mon[32782]: pgmap v17804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:11 smithi196 ceph-mon[32572]: pgmap v17804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:12 smithi110 ceph-mon[28069]: 25 slow requests, 0 included below; oldest blocked for > 33067.504008 secs 2024-04-26T20:59:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:12 smithi193 ceph-mon[32782]: 25 slow requests, 0 included below; oldest blocked for > 33067.504008 secs 2024-04-26T20:59:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:12 smithi196 ceph-mon[32572]: 25 slow requests, 0 included below; oldest blocked for > 33067.504008 secs 2024-04-26T20:59:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:13 smithi110 ceph-mon[28069]: pgmap v17805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:13 smithi193 ceph-mon[32782]: pgmap v17805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:13 smithi196 ceph-mon[32572]: pgmap v17805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:15 smithi110 ceph-mon[28069]: pgmap v17806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:15 smithi193 ceph-mon[32782]: pgmap v17806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:15 smithi196 ceph-mon[32572]: pgmap v17806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:59:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:59:16.252+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:59:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:59:16.252+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:59:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:59:16.252+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:59:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:59:16.252+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:16.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 20:59:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T20:59:16.252+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:17 smithi110 ceph-mon[28069]: pgmap v17807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33072.504126 secs 2024-04-26T20:59:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:17 smithi193 ceph-mon[32782]: pgmap v17807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33072.504126 secs 2024-04-26T20:59:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:17 smithi196 ceph-mon[32572]: pgmap v17807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33072.504126 secs 2024-04-26T20:59:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:19 smithi193 ceph-mon[32782]: pgmap v17808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:59:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:59:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:59:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:19 smithi196 ceph-mon[32572]: pgmap v17808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:59:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:59:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:59:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:19 smithi110 ceph-mon[28069]: pgmap v17808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:59:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T20:59:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T20:59:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:21 smithi193 ceph-mon[32782]: pgmap v17809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:59:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:21 smithi196 ceph-mon[32572]: pgmap v17809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:59:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:21 smithi110 ceph-mon[28069]: pgmap v17809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:59:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33077.504248 secs 2024-04-26T20:59:23.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33077.504248 secs 2024-04-26T20:59:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33077.504248 secs 2024-04-26T20:59:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:23 smithi193 ceph-mon[32782]: pgmap v17810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:59:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:23 smithi196 ceph-mon[32572]: pgmap v17810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:59:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:23 smithi110 ceph-mon[28069]: pgmap v17810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:59:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:25 smithi193 ceph-mon[32782]: pgmap v17811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:59:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:25 smithi196 ceph-mon[32572]: pgmap v17811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:59:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:25 smithi110 ceph-mon[28069]: pgmap v17811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:59:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:27 smithi193 ceph-mon[32782]: pgmap v17812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:59:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33082.504368 secs 2024-04-26T20:59:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:27 smithi196 ceph-mon[32572]: pgmap v17812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:59:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33082.504368 secs 2024-04-26T20:59:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:27 smithi110 ceph-mon[28069]: pgmap v17812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T20:59:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33082.504368 secs 2024-04-26T20:59:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:29 smithi193 ceph-mon[32782]: pgmap v17813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:59:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:29 smithi196 ceph-mon[32572]: pgmap v17813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:59:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:29 smithi110 ceph-mon[28069]: pgmap v17813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T20:59:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:31 smithi193 ceph-mon[32782]: pgmap v17814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:31 smithi196 ceph-mon[32572]: pgmap v17814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:31 smithi110 ceph-mon[28069]: pgmap v17814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33087.504484 secs 2024-04-26T20:59:33.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33087.504484 secs 2024-04-26T20:59:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33087.504484 secs 2024-04-26T20:59:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:33 smithi193 ceph-mon[32782]: pgmap v17815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:33 smithi196 ceph-mon[32572]: pgmap v17815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:33 smithi110 ceph-mon[28069]: pgmap v17815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:35 smithi193 ceph-mon[32782]: pgmap v17816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:35 smithi196 ceph-mon[32572]: pgmap v17816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:35 smithi110 ceph-mon[28069]: pgmap v17816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:36 smithi193 ceph-mon[32782]: pgmap v17817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T20:59:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:36 smithi193 ceph-mon[32782]: pgmap v17818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:59:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:36 smithi196 ceph-mon[32572]: pgmap v17817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T20:59:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:36 smithi196 ceph-mon[32572]: pgmap v17818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:59:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:36 smithi110 ceph-mon[28069]: pgmap v17817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T20:59:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:36 smithi110 ceph-mon[28069]: pgmap v17818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:37.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T20:59:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33092.504601 secs 2024-04-26T20:59:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33092.504601 secs 2024-04-26T20:59:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33092.504601 secs 2024-04-26T20:59:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:38 smithi196 ceph-mon[32572]: pgmap v17819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:38 smithi110 ceph-mon[28069]: pgmap v17819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:38 smithi193 ceph-mon[32782]: pgmap v17819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:41 smithi193 ceph-mon[32782]: pgmap v17820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:41 smithi196 ceph-mon[32572]: pgmap v17820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:41 smithi110 ceph-mon[28069]: pgmap v17820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33097.504738 secs 2024-04-26T20:59:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33097.504738 secs 2024-04-26T20:59:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33097.504738 secs 2024-04-26T20:59:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:43 smithi193 ceph-mon[32782]: pgmap v17821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T20:59:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:43 smithi196 ceph-mon[32572]: pgmap v17821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T20:59:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:43 smithi110 ceph-mon[28069]: pgmap v17821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T20:59:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:45 smithi193 ceph-mon[32782]: pgmap v17822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:45 smithi196 ceph-mon[32572]: pgmap v17822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:45 smithi110 ceph-mon[28069]: pgmap v17822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:59:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:47 smithi193 ceph-mon[32782]: pgmap v17823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:59:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33102.504858 secs 2024-04-26T20:59:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:47 smithi196 ceph-mon[32572]: pgmap v17823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:59:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33102.504858 secs 2024-04-26T20:59:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:47 smithi110 ceph-mon[28069]: pgmap v17823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T20:59:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33102.504858 secs 2024-04-26T20:59:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:49 smithi193 ceph-mon[32782]: pgmap v17824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:49 smithi196 ceph-mon[32572]: pgmap v17824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:49 smithi110 ceph-mon[28069]: pgmap v17824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:51 smithi196 ceph-mon[32572]: pgmap v17825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:51 smithi110 ceph-mon[28069]: pgmap v17825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:51 smithi193 ceph-mon[32782]: pgmap v17825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33107.504974 secs 2024-04-26T20:59:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33107.504974 secs 2024-04-26T20:59:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33107.504974 secs 2024-04-26T20:59:53.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:53 smithi196 ceph-mon[32572]: pgmap v17826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:53 smithi110 ceph-mon[28069]: pgmap v17826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:53 smithi193 ceph-mon[32782]: pgmap v17826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:55 smithi196 ceph-mon[32572]: pgmap v17827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:55 smithi110 ceph-mon[28069]: pgmap v17827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:55 smithi193 ceph-mon[32782]: pgmap v17827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:57 smithi196 ceph-mon[32572]: pgmap v17828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33112.505110 secs 2024-04-26T20:59:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:57 smithi110 ceph-mon[28069]: pgmap v17828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33112.505110 secs 2024-04-26T20:59:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:57 smithi193 ceph-mon[32782]: pgmap v17828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T20:59:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33112.505110 secs 2024-04-26T20:59:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 20:59:59 smithi196 ceph-mon[32572]: pgmap v17829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 20:59:59 smithi110 ceph-mon[28069]: pgmap v17829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 20:59:59 smithi193 ceph-mon[32782]: pgmap v17829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:00:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:00:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:00:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:01 smithi196 ceph-mon[32572]: pgmap v17830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:01 smithi110 ceph-mon[28069]: pgmap v17830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:01 smithi193 ceph-mon[32782]: pgmap v17830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33117.505208 secs 2024-04-26T21:00:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33117.505208 secs 2024-04-26T21:00:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33117.505208 secs 2024-04-26T21:00:03.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:03 smithi110 ceph-mon[28069]: pgmap v17831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:03 smithi196 ceph-mon[32572]: pgmap v17831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:03 smithi193 ceph-mon[32782]: pgmap v17831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:04 smithi196 ceph-mon[32572]: pgmap v17832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:04 smithi110 ceph-mon[28069]: pgmap v17832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:04 smithi193 ceph-mon[32782]: pgmap v17832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:07 smithi193 ceph-mon[32782]: pgmap v17833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33122.505361 secs 2024-04-26T21:00:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:07 smithi196 ceph-mon[32572]: pgmap v17833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33122.505361 secs 2024-04-26T21:00:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:07 smithi110 ceph-mon[28069]: pgmap v17833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33122.505361 secs 2024-04-26T21:00:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:09 smithi193 ceph-mon[32782]: pgmap v17834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:09 smithi196 ceph-mon[32572]: pgmap v17834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:09 smithi110 ceph-mon[28069]: pgmap v17834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:11 smithi196 ceph-mon[32572]: pgmap v17835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:11 smithi110 ceph-mon[28069]: pgmap v17835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:11 smithi193 ceph-mon[32782]: pgmap v17835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33127.505477 secs 2024-04-26T21:00:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33127.505477 secs 2024-04-26T21:00:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33127.505477 secs 2024-04-26T21:00:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:13 smithi196 ceph-mon[32572]: pgmap v17836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:13 smithi110 ceph-mon[28069]: pgmap v17836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:13 smithi193 ceph-mon[32782]: pgmap v17836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:15 smithi196 ceph-mon[32572]: pgmap v17837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:15 smithi110 ceph-mon[28069]: pgmap v17837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:15 smithi193 ceph-mon[32782]: pgmap v17837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:17 smithi196 ceph-mon[32572]: pgmap v17838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33132.505591 secs 2024-04-26T21:00:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:17 smithi110 ceph-mon[28069]: pgmap v17838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33132.505591 secs 2024-04-26T21:00:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:17 smithi193 ceph-mon[32782]: pgmap v17838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33132.505591 secs 2024-04-26T21:00:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:19 smithi196 ceph-mon[32572]: pgmap v17839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:19 smithi110 ceph-mon[28069]: pgmap v17839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:19 smithi193 ceph-mon[32782]: pgmap v17839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:21 smithi196 ceph-mon[32572]: pgmap v17840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:21 smithi110 ceph-mon[28069]: pgmap v17840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:00:21.864+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:00:21.864 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:00:21.864+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:00:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:00:21.864+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 255 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:00:21.865 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:00:21.864+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 255 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:00:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:21 smithi193 ceph-mon[32782]: pgmap v17840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33137.505682 secs 2024-04-26T21:00:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33137.505682 secs 2024-04-26T21:00:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33137.505682 secs 2024-04-26T21:00:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:23 smithi196 ceph-mon[32572]: pgmap v17841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:23 smithi110 ceph-mon[28069]: pgmap v17841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:23 smithi193 ceph-mon[32782]: pgmap v17841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:25 smithi196 ceph-mon[32572]: pgmap v17842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:25 smithi110 ceph-mon[28069]: pgmap v17842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:25 smithi193 ceph-mon[32782]: pgmap v17842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:27 smithi196 ceph-mon[32572]: pgmap v17843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33142.505805 secs 2024-04-26T21:00:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:27 smithi110 ceph-mon[28069]: pgmap v17843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33142.505805 secs 2024-04-26T21:00:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:27 smithi193 ceph-mon[32782]: pgmap v17843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33142.505805 secs 2024-04-26T21:00:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:29 smithi196 ceph-mon[32572]: pgmap v17844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:29 smithi110 ceph-mon[28069]: pgmap v17844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:29 smithi193 ceph-mon[32782]: pgmap v17844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:30 smithi196 ceph-mon[32572]: pgmap v17845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:30 smithi110 ceph-mon[28069]: pgmap v17845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:30 smithi193 ceph-mon[32782]: pgmap v17845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33147.505937 secs 2024-04-26T21:00:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33147.505937 secs 2024-04-26T21:00:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33147.505937 secs 2024-04-26T21:00:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:33 smithi193 ceph-mon[32782]: pgmap v17846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:33 smithi196 ceph-mon[32572]: pgmap v17846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:33 smithi110 ceph-mon[28069]: pgmap v17846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:35 smithi193 ceph-mon[32782]: pgmap v17847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:35 smithi196 ceph-mon[32572]: pgmap v17847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:35 smithi110 ceph-mon[28069]: pgmap v17847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:37 smithi196 ceph-mon[32572]: pgmap v17848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33152.506030 secs 2024-04-26T21:00:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:37 smithi110 ceph-mon[28069]: pgmap v17848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33152.506030 secs 2024-04-26T21:00:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:37 smithi193 ceph-mon[32782]: pgmap v17848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33152.506030 secs 2024-04-26T21:00:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:38 smithi196 ceph-mon[32572]: pgmap v17849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:38.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:38 smithi110 ceph-mon[28069]: pgmap v17849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:38 smithi193 ceph-mon[32782]: pgmap v17849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:41.677 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:41 smithi110 ceph-mon[28069]: pgmap v17850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:41 smithi196 ceph-mon[32572]: pgmap v17850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:41 smithi193 ceph-mon[32782]: pgmap v17850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33157.506126 secs 2024-04-26T21:00:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33157.506126 secs 2024-04-26T21:00:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33157.506126 secs 2024-04-26T21:00:43.708 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:43 smithi110 ceph-mon[28069]: pgmap v17851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:43 smithi196 ceph-mon[32572]: pgmap v17851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:43 smithi193 ceph-mon[32782]: pgmap v17851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:45 smithi196 ceph-mon[32572]: pgmap v17852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:45.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:45 smithi110 ceph-mon[28069]: pgmap v17852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:45.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:45.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:45 smithi193 ceph-mon[32782]: pgmap v17852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:00:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:46 smithi196 ceph-mon[32572]: pgmap v17853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T21:00:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:46 smithi196 ceph-mon[32572]: pgmap v17854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:46 smithi110 ceph-mon[28069]: pgmap v17853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T21:00:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:46 smithi110 ceph-mon[28069]: pgmap v17854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:46 smithi193 ceph-mon[32782]: pgmap v17853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 989 B/s rd, 1 op/s 2024-04-26T21:00:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:46 smithi193 ceph-mon[32782]: pgmap v17854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33162.506265 secs 2024-04-26T21:00:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33162.506265 secs 2024-04-26T21:00:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33162.506265 secs 2024-04-26T21:00:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:48 smithi196 ceph-mon[32572]: pgmap v17855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T21:00:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:48 smithi110 ceph-mon[28069]: pgmap v17855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T21:00:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:48 smithi193 ceph-mon[32782]: pgmap v17855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T21:00:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:50 smithi196 ceph-mon[32572]: pgmap v17856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:50 smithi110 ceph-mon[28069]: pgmap v17856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:50 smithi193 ceph-mon[32782]: pgmap v17856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:52 smithi196 ceph-mon[32572]: pgmap v17857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33167.506382 secs 2024-04-26T21:00:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:52 smithi110 ceph-mon[28069]: pgmap v17857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33167.506382 secs 2024-04-26T21:00:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:52 smithi193 ceph-mon[32782]: pgmap v17857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33167.506382 secs 2024-04-26T21:00:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:54 smithi196 ceph-mon[32572]: pgmap v17858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:54 smithi110 ceph-mon[28069]: pgmap v17858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:54.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:54 smithi193 ceph-mon[32782]: pgmap v17858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:00:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:56 smithi196 ceph-mon[32572]: pgmap v17859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:00:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:56 smithi110 ceph-mon[28069]: pgmap v17859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:00:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:56 smithi193 ceph-mon[32782]: pgmap v17859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:00:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33172.506546 secs 2024-04-26T21:00:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33172.506546 secs 2024-04-26T21:00:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33172.506546 secs 2024-04-26T21:00:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:00:58 smithi196 ceph-mon[32572]: pgmap v17860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:00:58 smithi110 ceph-mon[28069]: pgmap v17860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:00:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:00:58 smithi193 ceph-mon[32782]: pgmap v17860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:00 smithi196 ceph-mon[32572]: pgmap v17861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:00 smithi110 ceph-mon[28069]: pgmap v17861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:00 smithi193 ceph-mon[32782]: pgmap v17861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:01 smithi196 ceph-mon[32572]: pgmap v17862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:01.785 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:01 smithi193 ceph-mon[32782]: pgmap v17862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:01 smithi110 ceph-mon[28069]: pgmap v17862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33177.506641 secs 2024-04-26T21:01:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33177.506641 secs 2024-04-26T21:01:02.875 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33177.506641 secs 2024-04-26T21:01:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:03 smithi196 ceph-mon[32572]: pgmap v17863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:03 smithi110 ceph-mon[28069]: pgmap v17863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:03 smithi193 ceph-mon[32782]: pgmap v17863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:05 smithi196 ceph-mon[32572]: pgmap v17864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:05 smithi110 ceph-mon[28069]: pgmap v17864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:05 smithi193 ceph-mon[32782]: pgmap v17864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:01:06.871+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:01:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:01:06.871+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:01:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:01:06.872+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 256 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:01:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:01:06.872+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 256 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:01:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:07 smithi196 ceph-mon[32572]: pgmap v17865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33182.506754 secs 2024-04-26T21:01:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:07 smithi110 ceph-mon[28069]: pgmap v17865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33182.506754 secs 2024-04-26T21:01:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:07 smithi193 ceph-mon[32782]: pgmap v17865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33182.506754 secs 2024-04-26T21:01:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:09 smithi196 ceph-mon[32572]: pgmap v17866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:09 smithi110 ceph-mon[28069]: pgmap v17866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:09 smithi193 ceph-mon[32782]: pgmap v17866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:12 smithi193 ceph-mon[32782]: pgmap v17867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33187.506877 secs 2024-04-26T21:01:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:12 smithi196 ceph-mon[32572]: pgmap v17867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33187.506877 secs 2024-04-26T21:01:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:12 smithi110 ceph-mon[28069]: pgmap v17867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33187.506877 secs 2024-04-26T21:01:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:14 smithi193 ceph-mon[32782]: pgmap v17868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:14 smithi196 ceph-mon[32572]: pgmap v17868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:14 smithi110 ceph-mon[28069]: pgmap v17868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:16 smithi193 ceph-mon[32782]: pgmap v17869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:16 smithi196 ceph-mon[32572]: pgmap v17869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:16 smithi110 ceph-mon[28069]: pgmap v17869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:17 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33192.506988 secs 2024-04-26T21:01:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:17 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33192.506988 secs 2024-04-26T21:01:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:17 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33192.506988 secs 2024-04-26T21:01:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:18 smithi193 ceph-mon[32782]: pgmap v17870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:18 smithi196 ceph-mon[32572]: pgmap v17870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:18 smithi110 ceph-mon[28069]: pgmap v17870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:20 smithi193 ceph-mon[32782]: pgmap v17871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:20 smithi196 ceph-mon[32572]: pgmap v17871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:20 smithi110 ceph-mon[28069]: pgmap v17871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:22 smithi193 ceph-mon[32782]: pgmap v17872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:22 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33197.507080 secs 2024-04-26T21:01:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:22 smithi196 ceph-mon[32572]: pgmap v17872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:22 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33197.507080 secs 2024-04-26T21:01:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:22 smithi110 ceph-mon[28069]: pgmap v17872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:22 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33197.507080 secs 2024-04-26T21:01:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:24 smithi193 ceph-mon[32782]: pgmap v17873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:24 smithi196 ceph-mon[32572]: pgmap v17873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:24 smithi110 ceph-mon[28069]: pgmap v17873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:26 smithi193 ceph-mon[32782]: pgmap v17874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:26 smithi196 ceph-mon[32572]: pgmap v17874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:26 smithi110 ceph-mon[28069]: pgmap v17874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:27 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33202.507193 secs 2024-04-26T21:01:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:27 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33202.507193 secs 2024-04-26T21:01:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:27 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33202.507193 secs 2024-04-26T21:01:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:28 smithi193 ceph-mon[32782]: pgmap v17875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:28 smithi196 ceph-mon[32572]: pgmap v17875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:28 smithi110 ceph-mon[28069]: pgmap v17875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:30 smithi193 ceph-mon[32782]: pgmap v17876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:30 smithi196 ceph-mon[32572]: pgmap v17876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:30 smithi110 ceph-mon[28069]: pgmap v17876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:32 smithi193 ceph-mon[32782]: pgmap v17877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:32 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33207.507313 secs 2024-04-26T21:01:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:32 smithi196 ceph-mon[32572]: pgmap v17877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:32 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33207.507313 secs 2024-04-26T21:01:32.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:32 smithi110 ceph-mon[28069]: pgmap v17877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:32.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:32 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33207.507313 secs 2024-04-26T21:01:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:34 smithi196 ceph-mon[32572]: pgmap v17878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:34 smithi110 ceph-mon[28069]: pgmap v17878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:34 smithi193 ceph-mon[32782]: pgmap v17878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:36 smithi196 ceph-mon[32572]: pgmap v17879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:36 smithi110 ceph-mon[28069]: pgmap v17879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:36 smithi193 ceph-mon[32782]: pgmap v17879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:37 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33212.507450 secs 2024-04-26T21:01:37.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:37 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33212.507450 secs 2024-04-26T21:01:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:37 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33212.507450 secs 2024-04-26T21:01:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:38 smithi196 ceph-mon[32572]: pgmap v17880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:38 smithi110 ceph-mon[28069]: pgmap v17880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:38 smithi193 ceph-mon[32782]: pgmap v17880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:40 smithi196 ceph-mon[32572]: pgmap v17881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:40.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:40 smithi110 ceph-mon[28069]: pgmap v17881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:40 smithi193 ceph-mon[32782]: pgmap v17881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:42 smithi196 ceph-mon[32572]: pgmap v17882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:42 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33217.507548 secs 2024-04-26T21:01:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:42 smithi110 ceph-mon[28069]: pgmap v17882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:42 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33217.507548 secs 2024-04-26T21:01:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:42 smithi193 ceph-mon[32782]: pgmap v17882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:42 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33217.507548 secs 2024-04-26T21:01:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:44 smithi196 ceph-mon[32572]: pgmap v17883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:44 smithi110 ceph-mon[28069]: pgmap v17883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:44 smithi193 ceph-mon[32782]: pgmap v17883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:46 smithi196 ceph-mon[32572]: pgmap v17884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:46 smithi110 ceph-mon[28069]: pgmap v17884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:46 smithi193 ceph-mon[32782]: pgmap v17884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:01:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:01:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:47 smithi196 ceph-mon[32572]: pgmap v17885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T21:01:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:47 smithi196 ceph-mon[32572]: pgmap v17886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:47 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33222.507645 secs 2024-04-26T21:01:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:47 smithi110 ceph-mon[28069]: pgmap v17885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T21:01:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:47 smithi110 ceph-mon[28069]: pgmap v17886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:47 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33222.507645 secs 2024-04-26T21:01:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:47 smithi193 ceph-mon[32782]: pgmap v17885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 884 B/s rd, 1 op/s 2024-04-26T21:01:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:47 smithi193 ceph-mon[32782]: pgmap v17886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:47 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33222.507645 secs 2024-04-26T21:01:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:49 smithi196 ceph-mon[32572]: pgmap v17887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:49 smithi110 ceph-mon[28069]: pgmap v17887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:49 smithi193 ceph-mon[32782]: pgmap v17887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:51 smithi196 ceph-mon[32572]: pgmap v17888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:51 smithi110 ceph-mon[28069]: pgmap v17888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:51 smithi193 ceph-mon[32782]: pgmap v17888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:52 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33227.507764 secs 2024-04-26T21:01:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:52 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33227.507764 secs 2024-04-26T21:01:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:52 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33227.507764 secs 2024-04-26T21:01:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:53 smithi196 ceph-mon[32572]: pgmap v17889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T21:01:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:53 smithi110 ceph-mon[28069]: pgmap v17889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T21:01:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:53 smithi193 ceph-mon[32782]: pgmap v17889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T21:01:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:55 smithi196 ceph-mon[32572]: pgmap v17890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:55 smithi110 ceph-mon[28069]: pgmap v17890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:55 smithi193 ceph-mon[32782]: pgmap v17890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:01:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:57 smithi196 ceph-mon[32572]: pgmap v17891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:01:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:57 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33232.507887 secs 2024-04-26T21:01:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:57 smithi110 ceph-mon[28069]: pgmap v17891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:01:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:57 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33232.507887 secs 2024-04-26T21:01:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:57 smithi193 ceph-mon[32782]: pgmap v17891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:01:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:57 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33232.507887 secs 2024-04-26T21:01:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:01:59 smithi196 ceph-mon[32572]: pgmap v17892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:01:59 smithi110 ceph-mon[28069]: pgmap v17892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:01:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:01:59 smithi193 ceph-mon[32782]: pgmap v17892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:00 smithi196 ceph-mon[32572]: pgmap v17893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:00 smithi110 ceph-mon[28069]: pgmap v17893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:00 smithi193 ceph-mon[32782]: pgmap v17893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:02 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33237.507997 secs 2024-04-26T21:02:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:02 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33237.507997 secs 2024-04-26T21:02:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:02 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33237.507997 secs 2024-04-26T21:02:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:03 smithi196 ceph-mon[32572]: pgmap v17894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:03 smithi110 ceph-mon[28069]: pgmap v17894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:03 smithi193 ceph-mon[32782]: pgmap v17894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:05 smithi193 ceph-mon[32782]: pgmap v17895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:05 smithi196 ceph-mon[32572]: pgmap v17895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:05 smithi110 ceph-mon[28069]: pgmap v17895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:07 smithi193 ceph-mon[32782]: pgmap v17896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:07 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33242.508115 secs 2024-04-26T21:02:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:07 smithi196 ceph-mon[32572]: pgmap v17896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:07 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33242.508115 secs 2024-04-26T21:02:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:07 smithi110 ceph-mon[28069]: pgmap v17896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:07 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33242.508115 secs 2024-04-26T21:02:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:09 smithi193 ceph-mon[32782]: pgmap v17897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:09 smithi196 ceph-mon[32572]: pgmap v17897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:09 smithi110 ceph-mon[28069]: pgmap v17897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:11 smithi193 ceph-mon[32782]: pgmap v17898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:11.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:11 smithi196 ceph-mon[32572]: pgmap v17898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:11 smithi110 ceph-mon[28069]: pgmap v17898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:12 smithi193 ceph-mon[32782]: 5 slow requests, 0 included below; oldest blocked for > 33247.508266 secs 2024-04-26T21:02:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:12 smithi196 ceph-mon[32572]: 5 slow requests, 0 included below; oldest blocked for > 33247.508266 secs 2024-04-26T21:02:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:12 smithi110 ceph-mon[28069]: 5 slow requests, 0 included below; oldest blocked for > 33247.508266 secs 2024-04-26T21:02:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:13 smithi193 ceph-mon[32782]: pgmap v17899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:13 smithi196 ceph-mon[32572]: pgmap v17899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:13 smithi110 ceph-mon[28069]: pgmap v17899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:15 smithi193 ceph-mon[32782]: pgmap v17900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:15 smithi196 ceph-mon[32572]: pgmap v17900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:15 smithi110 ceph-mon[28069]: pgmap v17900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:17 smithi193 ceph-mon[32782]: pgmap v17901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:17 smithi193 ceph-mon[32782]: 26 slow requests, 2 included below; oldest blocked for > 33252.508388 secs 2024-04-26T21:02:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:17 smithi193 ceph-mon[32782]: slow request 180.544920 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:02:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:17 smithi193 ceph-mon[32782]: slow request 11586.061378 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:17 smithi196 ceph-mon[32572]: pgmap v17901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:17 smithi196 ceph-mon[32572]: 26 slow requests, 2 included below; oldest blocked for > 33252.508388 secs 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:17 smithi196 ceph-mon[32572]: slow request 180.544920 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:02:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:17 smithi196 ceph-mon[32572]: slow request 11586.061378 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:02:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:17 smithi110 ceph-mon[28069]: pgmap v17901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:17 smithi110 ceph-mon[28069]: 26 slow requests, 2 included below; oldest blocked for > 33252.508388 secs 2024-04-26T21:02:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:17 smithi110 ceph-mon[28069]: slow request 180.544920 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:02:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:17 smithi110 ceph-mon[28069]: slow request 11586.061378 seconds old, received at 2024-04-26T17:49:10.745332+0000: client_request(client.26975:1 getattr pAsLsXsFs #0x1 2024-04-26T17:49:10.739627+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:02:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:19 smithi196 ceph-mon[32572]: pgmap v17902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:02:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:02:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:19 smithi110 ceph-mon[28069]: pgmap v17902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:02:19.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:02:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:19 smithi193 ceph-mon[32782]: pgmap v17902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:02:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:02:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:21 smithi196 ceph-mon[32572]: pgmap v17903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:21 smithi110 ceph-mon[28069]: pgmap v17903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:21 smithi193 ceph-mon[32782]: pgmap v17903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:22 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33257.508546 secs 2024-04-26T21:02:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:22 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33257.508546 secs 2024-04-26T21:02:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:22 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33257.508546 secs 2024-04-26T21:02:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:23 smithi196 ceph-mon[32572]: pgmap v17904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:23 smithi110 ceph-mon[28069]: pgmap v17904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:23 smithi193 ceph-mon[32782]: pgmap v17904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:25 smithi196 ceph-mon[32572]: pgmap v17905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:25 smithi110 ceph-mon[28069]: pgmap v17905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:25 smithi193 ceph-mon[32782]: pgmap v17905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:27 smithi196 ceph-mon[32572]: pgmap v17906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:27 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33262.508664 secs 2024-04-26T21:02:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:27 smithi110 ceph-mon[28069]: pgmap v17906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:27 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33262.508664 secs 2024-04-26T21:02:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:27 smithi193 ceph-mon[32782]: pgmap v17906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:27 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33262.508664 secs 2024-04-26T21:02:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:29 smithi196 ceph-mon[32572]: pgmap v17907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:29 smithi110 ceph-mon[28069]: pgmap v17907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:29 smithi193 ceph-mon[32782]: pgmap v17907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:31 smithi196 ceph-mon[32572]: pgmap v17908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:31 smithi110 ceph-mon[28069]: pgmap v17908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:31 smithi193 ceph-mon[32782]: pgmap v17908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:32 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33267.508798 secs 2024-04-26T21:02:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:32 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33267.508798 secs 2024-04-26T21:02:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:32 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33267.508798 secs 2024-04-26T21:02:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:33 smithi196 ceph-mon[32572]: pgmap v17909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:33 smithi110 ceph-mon[28069]: pgmap v17909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:33 smithi193 ceph-mon[32782]: pgmap v17909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:35 smithi196 ceph-mon[32572]: pgmap v17910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:35 smithi110 ceph-mon[28069]: pgmap v17910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:35 smithi193 ceph-mon[32782]: pgmap v17910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:37 smithi196 ceph-mon[32572]: pgmap v17911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:37 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33272.508909 secs 2024-04-26T21:02:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:37 smithi110 ceph-mon[28069]: pgmap v17911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:37 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33272.508909 secs 2024-04-26T21:02:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:37 smithi193 ceph-mon[32782]: pgmap v17911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:37 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33272.508909 secs 2024-04-26T21:02:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:39 smithi196 ceph-mon[32572]: pgmap v17912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:39 smithi110 ceph-mon[28069]: pgmap v17912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:39 smithi193 ceph-mon[32782]: pgmap v17912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:41 smithi196 ceph-mon[32572]: pgmap v17913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:41 smithi110 ceph-mon[28069]: pgmap v17913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:41 smithi193 ceph-mon[32782]: pgmap v17913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:42 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33277.509029 secs 2024-04-26T21:02:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:42 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33277.509029 secs 2024-04-26T21:02:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:42 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33277.509029 secs 2024-04-26T21:02:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:43 smithi196 ceph-mon[32572]: pgmap v17914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:43 smithi110 ceph-mon[28069]: pgmap v17914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:43 smithi193 ceph-mon[32782]: pgmap v17914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:02:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:44 smithi196 ceph-mon[32572]: pgmap v17915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:44 smithi110 ceph-mon[28069]: pgmap v17915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:44 smithi193 ceph-mon[32782]: pgmap v17915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:47 smithi193 ceph-mon[32782]: pgmap v17916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:47 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33282.509136 secs 2024-04-26T21:02:47.629 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:47 smithi196 ceph-mon[32572]: pgmap v17916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:47.629 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:47.629 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:47 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33282.509136 secs 2024-04-26T21:02:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:47 smithi110 ceph-mon[28069]: pgmap v17916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:47 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33282.509136 secs 2024-04-26T21:02:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: pgmap v17917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: pgmap v17917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: pgmap v17917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:02:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:49.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:02:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:02:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:02:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:02:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:51 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:02:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:51 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:02:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:51 smithi193 ceph-mon[32782]: pgmap v17918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:51 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:02:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:51 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:02:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:51 smithi196 ceph-mon[32572]: pgmap v17918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:51 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:02:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:51 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:02:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:51 smithi110 ceph-mon[28069]: pgmap v17918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:02:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33287.509235 secs 2024-04-26T21:02:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:52.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33287.509235 secs 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33287.509235 secs 2024-04-26T21:02:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:02:52.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:52.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:52.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:02:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:53 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:02:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:53 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:02:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:53 smithi196 ceph-mon[32572]: pgmap v17919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 881 B/s rd, 1 op/s 2024-04-26T21:02:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:53 smithi196 ceph-mon[32572]: pgmap v17920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:02:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:53 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:02:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:53 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:02:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:53 smithi110 ceph-mon[28069]: pgmap v17919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 881 B/s rd, 1 op/s 2024-04-26T21:02:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:53 smithi110 ceph-mon[28069]: pgmap v17920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:02:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:53 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:02:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:53 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:02:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:53 smithi193 ceph-mon[32782]: pgmap v17919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 881 B/s rd, 1 op/s 2024-04-26T21:02:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:53 smithi193 ceph-mon[32782]: pgmap v17920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:02:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:55 smithi196 ceph-mon[32572]: pgmap v17921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:02:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:55 smithi110 ceph-mon[28069]: pgmap v17921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:02:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:55 smithi193 ceph-mon[32782]: pgmap v17921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:02:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:57 smithi196 ceph-mon[32572]: pgmap v17922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:02:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:57 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33292.509353 secs 2024-04-26T21:02:57.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:57 smithi110 ceph-mon[28069]: pgmap v17922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:02:57.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:57 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33292.509353 secs 2024-04-26T21:02:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:57 smithi193 ceph-mon[32782]: pgmap v17922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:02:57.899 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:57 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33292.509353 secs 2024-04-26T21:02:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:02:59 smithi196 ceph-mon[32572]: pgmap v17923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:02:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:02:59 smithi110 ceph-mon[28069]: pgmap v17923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:02:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:02:59 smithi193 ceph-mon[32782]: pgmap v17923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:03:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:01 smithi196 ceph-mon[32572]: pgmap v17924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:03:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:01 smithi110 ceph-mon[28069]: pgmap v17924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:03:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:01 smithi193 ceph-mon[32782]: pgmap v17924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:03:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:02 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33297.509478 secs 2024-04-26T21:03:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:02 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33297.509478 secs 2024-04-26T21:03:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:02 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33297.509478 secs 2024-04-26T21:03:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:03 smithi196 ceph-mon[32572]: pgmap v17925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:03:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:03 smithi110 ceph-mon[28069]: pgmap v17925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:03:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:03 smithi193 ceph-mon[32782]: pgmap v17925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:03:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:05 smithi196 ceph-mon[32572]: pgmap v17926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:05 smithi110 ceph-mon[28069]: pgmap v17926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:05 smithi193 ceph-mon[32782]: pgmap v17926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:07 smithi110 ceph-mon[28069]: pgmap v17927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:07 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33302.509601 secs 2024-04-26T21:03:07.695 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:07 smithi193 ceph-mon[32782]: pgmap v17927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:07.695 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:07 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33302.509601 secs 2024-04-26T21:03:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:07 smithi196 ceph-mon[32572]: pgmap v17927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:07 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33302.509601 secs 2024-04-26T21:03:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:09 smithi196 ceph-mon[32572]: pgmap v17928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:09 smithi110 ceph-mon[28069]: pgmap v17928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:09 smithi193 ceph-mon[32782]: pgmap v17928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:11 smithi196 ceph-mon[32572]: pgmap v17929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:11 smithi110 ceph-mon[28069]: pgmap v17929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:11 smithi193 ceph-mon[32782]: pgmap v17929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:12 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33307.509716 secs 2024-04-26T21:03:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:12 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33307.509716 secs 2024-04-26T21:03:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:12 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33307.509716 secs 2024-04-26T21:03:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:13 smithi196 ceph-mon[32572]: pgmap v17930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:13 smithi110 ceph-mon[28069]: pgmap v17930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:13 smithi193 ceph-mon[32782]: pgmap v17930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:15 smithi196 ceph-mon[32572]: pgmap v17931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:15.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:15 smithi110 ceph-mon[28069]: pgmap v17931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:15 smithi193 ceph-mon[32782]: pgmap v17931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.468+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T21:03:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.468+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:03:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.468+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:03:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.468+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T21:03:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.468+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.470+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T21:03:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.470+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T21:03:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.484+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T21:03:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.484+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T21:03:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.484+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614041000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:03:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.484+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614041000 comp rx=0 tx=0).stop 2024-04-26T21:03:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.484+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T21:03:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.484+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T21:03:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.484+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.484+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.484+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:16.485+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614063000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:17 smithi196 ceph-mon[32572]: pgmap v17932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:17 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33312.509859 secs 2024-04-26T21:03:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:17 smithi110 ceph-mon[28069]: pgmap v17932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:17 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33312.509859 secs 2024-04-26T21:03:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:17 smithi193 ceph-mon[32782]: pgmap v17932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:17 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33312.509859 secs 2024-04-26T21:03:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:19 smithi196 ceph-mon[32572]: pgmap v17933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:19 smithi110 ceph-mon[28069]: pgmap v17933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:19 smithi193 ceph-mon[32782]: pgmap v17933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:21 smithi196 ceph-mon[32572]: pgmap v17934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:21 smithi110 ceph-mon[28069]: pgmap v17934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:21 smithi193 ceph-mon[32782]: pgmap v17934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:21.892+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:03:21.894 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:21.892+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:03:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:21.894+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 257 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:03:21.895 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:03:21.894+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 257 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:03:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:22 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33317.509970 secs 2024-04-26T21:03:22.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:22 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33317.509970 secs 2024-04-26T21:03:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:22 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33317.509970 secs 2024-04-26T21:03:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:23 smithi196 ceph-mon[32572]: pgmap v17935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:23 smithi110 ceph-mon[28069]: pgmap v17935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:23 smithi193 ceph-mon[32782]: pgmap v17935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:24 smithi196 ceph-mon[32572]: pgmap v17936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:24 smithi110 ceph-mon[28069]: pgmap v17936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:24 smithi193 ceph-mon[32782]: pgmap v17936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:26 smithi196 ceph-mon[32572]: pgmap v17937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:26 smithi110 ceph-mon[28069]: pgmap v17937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:26 smithi193 ceph-mon[32782]: pgmap v17937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:27 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33322.510081 secs 2024-04-26T21:03:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:27 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33322.510081 secs 2024-04-26T21:03:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:27 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33322.510081 secs 2024-04-26T21:03:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:28 smithi196 ceph-mon[32572]: pgmap v17938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:28 smithi110 ceph-mon[28069]: pgmap v17938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:28 smithi193 ceph-mon[32782]: pgmap v17938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:31 smithi196 ceph-mon[32572]: pgmap v17939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:31 smithi110 ceph-mon[28069]: pgmap v17939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:31 smithi193 ceph-mon[32782]: pgmap v17939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:33 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33327.510199 secs 2024-04-26T21:03:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:33 smithi110 ceph-mon[28069]: pgmap v17940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:33 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33327.510199 secs 2024-04-26T21:03:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:33 smithi193 ceph-mon[32782]: pgmap v17940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:33 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33327.510199 secs 2024-04-26T21:03:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:33 smithi196 ceph-mon[32572]: pgmap v17940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:35 smithi110 ceph-mon[28069]: pgmap v17941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:35 smithi193 ceph-mon[32782]: pgmap v17941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:35 smithi196 ceph-mon[32572]: pgmap v17941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:37 smithi110 ceph-mon[28069]: pgmap v17942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:37 smithi193 ceph-mon[32782]: pgmap v17942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:37 smithi196 ceph-mon[32572]: pgmap v17942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:38 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33332.510273 secs 2024-04-26T21:03:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:38 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33332.510273 secs 2024-04-26T21:03:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:38 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33332.510273 secs 2024-04-26T21:03:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:39 smithi193 ceph-mon[32782]: pgmap v17943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:39 smithi196 ceph-mon[32572]: pgmap v17943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:39 smithi110 ceph-mon[28069]: pgmap v17943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:41.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:41 smithi193 ceph-mon[32782]: pgmap v17944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:41 smithi196 ceph-mon[32572]: pgmap v17944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:41 smithi110 ceph-mon[28069]: pgmap v17944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:43 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33337.510402 secs 2024-04-26T21:03:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:43 smithi193 ceph-mon[32782]: pgmap v17945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:43.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:43 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33337.510402 secs 2024-04-26T21:03:43.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:43 smithi196 ceph-mon[32572]: pgmap v17945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:43 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33337.510402 secs 2024-04-26T21:03:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:43 smithi110 ceph-mon[28069]: pgmap v17945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:45 smithi193 ceph-mon[32782]: pgmap v17946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:45 smithi196 ceph-mon[32572]: pgmap v17946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:45 smithi110 ceph-mon[28069]: pgmap v17946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:47 smithi193 ceph-mon[32782]: pgmap v17947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:47 smithi196 ceph-mon[32572]: pgmap v17947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:47 smithi110 ceph-mon[28069]: pgmap v17947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:03:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:48 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33342.510536 secs 2024-04-26T21:03:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:48 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33342.510536 secs 2024-04-26T21:03:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:48 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33342.510536 secs 2024-04-26T21:03:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:49 smithi193 ceph-mon[32782]: pgmap v17948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:49 smithi196 ceph-mon[32572]: pgmap v17948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:49 smithi110 ceph-mon[28069]: pgmap v17948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:51 smithi193 ceph-mon[32782]: pgmap v17949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:03:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:51 smithi196 ceph-mon[32572]: pgmap v17949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:03:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:51 smithi110 ceph-mon[28069]: pgmap v17949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:03:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:53 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33347.510632 secs 2024-04-26T21:03:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:53 smithi193 ceph-mon[32782]: pgmap v17950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:03:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:53 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33347.510632 secs 2024-04-26T21:03:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:53 smithi196 ceph-mon[32572]: pgmap v17950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:03:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:53 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33347.510632 secs 2024-04-26T21:03:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:53 smithi110 ceph-mon[28069]: pgmap v17950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:03:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:03:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:03:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:54.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:03:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:55 smithi193 ceph-mon[32782]: pgmap v17951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:55 smithi193 ceph-mon[32782]: pgmap v17952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T21:03:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:55 smithi196 ceph-mon[32572]: pgmap v17951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:55 smithi196 ceph-mon[32572]: pgmap v17952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T21:03:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:55 smithi110 ceph-mon[28069]: pgmap v17951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:55 smithi110 ceph-mon[28069]: pgmap v17952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T21:03:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:57 smithi193 ceph-mon[32782]: pgmap v17953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T21:03:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:57 smithi196 ceph-mon[32572]: pgmap v17953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T21:03:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:57 smithi110 ceph-mon[28069]: pgmap v17953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 965 B/s rd, 1 op/s 2024-04-26T21:03:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:58 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33352.510697 secs 2024-04-26T21:03:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:58 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33352.510697 secs 2024-04-26T21:03:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:58 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33352.510697 secs 2024-04-26T21:03:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:03:59 smithi193 ceph-mon[32782]: pgmap v17954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:03:59.496 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:03:59 smithi196 ceph-mon[32572]: pgmap v17954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:03:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:03:59 smithi110 ceph-mon[28069]: pgmap v17954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:04:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:01 smithi196 ceph-mon[32572]: pgmap v17955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:04:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:01 smithi110 ceph-mon[28069]: pgmap v17955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:04:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:01 smithi193 ceph-mon[32782]: pgmap v17955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:04:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:03 smithi196 ceph-mon[32572]: pgmap v17956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:04:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:03 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33357.510814 secs 2024-04-26T21:04:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:03 smithi110 ceph-mon[28069]: pgmap v17956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:04:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:03 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33357.510814 secs 2024-04-26T21:04:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:03 smithi193 ceph-mon[32782]: pgmap v17956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:04:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:03 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33357.510814 secs 2024-04-26T21:04:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:05 smithi196 ceph-mon[32572]: pgmap v17957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:04:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:05 smithi110 ceph-mon[28069]: pgmap v17957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:04:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:05 smithi193 ceph-mon[32782]: pgmap v17957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:04:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:07 smithi196 ceph-mon[32572]: pgmap v17958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:07 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33362.510934 secs 2024-04-26T21:04:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:07 smithi110 ceph-mon[28069]: pgmap v17958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:07 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33362.510934 secs 2024-04-26T21:04:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:07 smithi193 ceph-mon[32782]: pgmap v17958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:07 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33362.510934 secs 2024-04-26T21:04:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:09 smithi196 ceph-mon[32572]: pgmap v17959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:09 smithi110 ceph-mon[28069]: pgmap v17959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:09 smithi193 ceph-mon[32782]: pgmap v17959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:11 smithi196 ceph-mon[32572]: pgmap v17960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:11 smithi110 ceph-mon[28069]: pgmap v17960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:11 smithi193 ceph-mon[32782]: pgmap v17960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:12 smithi196 ceph-mon[32572]: 26 slow requests, 0 included below; oldest blocked for > 33367.511049 secs 2024-04-26T21:04:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:12 smithi110 ceph-mon[28069]: 26 slow requests, 0 included below; oldest blocked for > 33367.511049 secs 2024-04-26T21:04:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:12 smithi193 ceph-mon[32782]: 26 slow requests, 0 included below; oldest blocked for > 33367.511049 secs 2024-04-26T21:04:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:13 smithi196 ceph-mon[32572]: pgmap v17961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:13 smithi110 ceph-mon[28069]: pgmap v17961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:13 smithi193 ceph-mon[32782]: pgmap v17961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:15 smithi196 ceph-mon[32572]: pgmap v17962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:15 smithi110 ceph-mon[28069]: pgmap v17962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:15 smithi193 ceph-mon[32782]: pgmap v17962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:16.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:04:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:04:16.482+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:04:16.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:04:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:04:16.482+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:04:16.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:04:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:04:16.482+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:04:16.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:04:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:04:16.482+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:04:16.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:04:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:04:16.482+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:04:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:17 smithi196 ceph-mon[32572]: pgmap v17963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33372.511168 secs 2024-04-26T21:04:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:17 smithi110 ceph-mon[28069]: pgmap v17963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33372.511168 secs 2024-04-26T21:04:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:17 smithi193 ceph-mon[32782]: pgmap v17963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33372.511168 secs 2024-04-26T21:04:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:19 smithi196 ceph-mon[32572]: pgmap v17964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T21:04:19.802 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:19 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:04:19.802 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:19 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:04:19.803 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:19 smithi110 ceph-mon[28069]: pgmap v17964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T21:04:19.803 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:19 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:04:19.803 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:19 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:04:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:19 smithi193 ceph-mon[32782]: pgmap v17964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T21:04:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:19 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:04:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:19 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:04:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:21 smithi196 ceph-mon[32572]: pgmap v17965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T21:04:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:21 smithi110 ceph-mon[28069]: pgmap v17965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T21:04:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:21 smithi193 ceph-mon[32782]: pgmap v17965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T21:04:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33377.511313 secs 2024-04-26T21:04:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33377.511313 secs 2024-04-26T21:04:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33377.511313 secs 2024-04-26T21:04:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:23 smithi196 ceph-mon[32572]: pgmap v17966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T21:04:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:23 smithi110 ceph-mon[28069]: pgmap v17966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T21:04:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:23 smithi193 ceph-mon[32782]: pgmap v17966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T21:04:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:25 smithi196 ceph-mon[32572]: pgmap v17967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T21:04:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:25 smithi110 ceph-mon[28069]: pgmap v17967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T21:04:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:25 smithi193 ceph-mon[32782]: pgmap v17967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T21:04:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:27 smithi196 ceph-mon[32572]: pgmap v17968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T21:04:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33382.511428 secs 2024-04-26T21:04:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:27 smithi110 ceph-mon[28069]: pgmap v17968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T21:04:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33382.511428 secs 2024-04-26T21:04:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:27 smithi193 ceph-mon[32782]: pgmap v17968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T21:04:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33382.511428 secs 2024-04-26T21:04:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:29 smithi196 ceph-mon[32572]: pgmap v17969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T21:04:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:29 smithi110 ceph-mon[28069]: pgmap v17969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T21:04:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:29 smithi193 ceph-mon[32782]: pgmap v17969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T21:04:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:31 smithi196 ceph-mon[32572]: pgmap v17970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:04:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:31 smithi110 ceph-mon[28069]: pgmap v17970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:04:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:31 smithi193 ceph-mon[32782]: pgmap v17970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:04:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33387.511544 secs 2024-04-26T21:04:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33387.511544 secs 2024-04-26T21:04:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33387.511544 secs 2024-04-26T21:04:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:33 smithi196 ceph-mon[32572]: pgmap v17971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:04:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:33 smithi110 ceph-mon[28069]: pgmap v17971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:04:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:33 smithi193 ceph-mon[32782]: pgmap v17971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:04:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:35 smithi196 ceph-mon[32572]: pgmap v17972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:04:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:35 smithi110 ceph-mon[28069]: pgmap v17972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:04:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:35 smithi193 ceph-mon[32782]: pgmap v17972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:04:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:37 smithi196 ceph-mon[32572]: pgmap v17973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33392.511665 secs 2024-04-26T21:04:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:37 smithi110 ceph-mon[28069]: pgmap v17973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33392.511665 secs 2024-04-26T21:04:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:37 smithi193 ceph-mon[32782]: pgmap v17973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33392.511665 secs 2024-04-26T21:04:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:39 smithi196 ceph-mon[32572]: pgmap v17974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:39 smithi110 ceph-mon[28069]: pgmap v17974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:39 smithi193 ceph-mon[32782]: pgmap v17974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:41 smithi196 ceph-mon[32572]: pgmap v17975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:41 smithi110 ceph-mon[28069]: pgmap v17975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:41 smithi193 ceph-mon[32782]: pgmap v17975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:42.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:42 smithi196 ceph-mon[32572]: pgmap v17976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:42.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33397.511762 secs 2024-04-26T21:04:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:42 smithi110 ceph-mon[28069]: pgmap v17976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33397.511762 secs 2024-04-26T21:04:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:42 smithi193 ceph-mon[32782]: pgmap v17976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33397.511762 secs 2024-04-26T21:04:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:44 smithi193 ceph-mon[32782]: pgmap v17977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:44 smithi196 ceph-mon[32572]: pgmap v17977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:44 smithi110 ceph-mon[28069]: pgmap v17977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:46 smithi193 ceph-mon[32782]: pgmap v17978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:46 smithi196 ceph-mon[32572]: pgmap v17978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:46 smithi110 ceph-mon[28069]: pgmap v17978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33402.511858 secs 2024-04-26T21:04:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33402.511858 secs 2024-04-26T21:04:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33402.511858 secs 2024-04-26T21:04:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:48 smithi193 ceph-mon[32782]: pgmap v17979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:48 smithi196 ceph-mon[32572]: pgmap v17979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:48 smithi110 ceph-mon[28069]: pgmap v17979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:50 smithi193 ceph-mon[32782]: pgmap v17980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:50 smithi196 ceph-mon[32572]: pgmap v17980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:50 smithi110 ceph-mon[28069]: pgmap v17980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:52 smithi193 ceph-mon[32782]: pgmap v17981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33407.511974 secs 2024-04-26T21:04:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:52 smithi196 ceph-mon[32572]: pgmap v17981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33407.511974 secs 2024-04-26T21:04:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:52 smithi110 ceph-mon[28069]: pgmap v17981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33407.511974 secs 2024-04-26T21:04:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:54 smithi193 ceph-mon[32782]: pgmap v17982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:54 smithi196 ceph-mon[32572]: pgmap v17982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:54 smithi110 ceph-mon[28069]: pgmap v17982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:56.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:56.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:56.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:56.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:04:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:57 smithi193 ceph-mon[32782]: pgmap v17983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:57 smithi193 ceph-mon[32782]: pgmap v17984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 994 B/s rd, 1 op/s 2024-04-26T21:04:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:57 smithi193 ceph-mon[32782]: pgmap v17985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T21:04:57.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:57 smithi196 ceph-mon[32572]: pgmap v17983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:57.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:57 smithi196 ceph-mon[32572]: pgmap v17984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 994 B/s rd, 1 op/s 2024-04-26T21:04:57.407 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:57 smithi196 ceph-mon[32572]: pgmap v17985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T21:04:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:57 smithi110 ceph-mon[28069]: pgmap v17983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:04:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:57 smithi110 ceph-mon[28069]: pgmap v17984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 994 B/s rd, 1 op/s 2024-04-26T21:04:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:57 smithi110 ceph-mon[28069]: pgmap v17985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T21:04:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:58 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33412.512096 secs 2024-04-26T21:04:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:58 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33412.512096 secs 2024-04-26T21:04:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:58 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33412.512096 secs 2024-04-26T21:04:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:04:59 smithi193 ceph-mon[32782]: pgmap v17986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:04:59 smithi196 ceph-mon[32572]: pgmap v17986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:04:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:04:59 smithi110 ceph-mon[28069]: pgmap v17986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:01 smithi193 ceph-mon[32782]: pgmap v17987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:01 smithi196 ceph-mon[32572]: pgmap v17987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:01 smithi110 ceph-mon[28069]: pgmap v17987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:03 smithi193 ceph-mon[32782]: pgmap v17988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T21:05:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:03 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33417.512213 secs 2024-04-26T21:05:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:03 smithi196 ceph-mon[32572]: pgmap v17988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T21:05:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:03 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33417.512213 secs 2024-04-26T21:05:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:03 smithi110 ceph-mon[28069]: pgmap v17988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s rd, 1 op/s 2024-04-26T21:05:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:03 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33417.512213 secs 2024-04-26T21:05:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:05 smithi193 ceph-mon[32782]: pgmap v17989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:05:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:05 smithi196 ceph-mon[32572]: pgmap v17989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:05:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:05 smithi110 ceph-mon[28069]: pgmap v17989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:05:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:07 smithi193 ceph-mon[32782]: pgmap v17990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:05:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:07 smithi196 ceph-mon[32572]: pgmap v17990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:05:07.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:07 smithi110 ceph-mon[28069]: pgmap v17990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:05:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:08 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33422.512335 secs 2024-04-26T21:05:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:08 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33422.512335 secs 2024-04-26T21:05:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:08 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33422.512335 secs 2024-04-26T21:05:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:09 smithi193 ceph-mon[32782]: pgmap v17991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:05:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:09 smithi196 ceph-mon[32572]: pgmap v17991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:05:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:09 smithi110 ceph-mon[28069]: pgmap v17991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:05:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:11 smithi193 ceph-mon[32782]: pgmap v17992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:05:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:11 smithi196 ceph-mon[32572]: pgmap v17992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:05:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:11 smithi110 ceph-mon[28069]: pgmap v17992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:05:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:13 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33427.512440 secs 2024-04-26T21:05:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:13 smithi196 ceph-mon[32572]: pgmap v17993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:05:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:13 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33427.512440 secs 2024-04-26T21:05:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:13 smithi110 ceph-mon[28069]: pgmap v17993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:05:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:13 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33427.512440 secs 2024-04-26T21:05:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:13 smithi193 ceph-mon[32782]: pgmap v17993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:05:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:15 smithi196 ceph-mon[32572]: pgmap v17994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:05:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:15 smithi110 ceph-mon[28069]: pgmap v17994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:05:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:15 smithi193 ceph-mon[32782]: pgmap v17994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:05:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:17 smithi196 ceph-mon[32572]: pgmap v17995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:17 smithi110 ceph-mon[28069]: pgmap v17995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:17 smithi193 ceph-mon[32782]: pgmap v17995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:18 smithi196 ceph-mon[32572]: 6 slow requests, 1 included below; oldest blocked for > 33432.512539 secs 2024-04-26T21:05:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:18 smithi196 ceph-mon[32572]: slow request 360.549071 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:05:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:18 smithi110 ceph-mon[28069]: 6 slow requests, 1 included below; oldest blocked for > 33432.512539 secs 2024-04-26T21:05:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:18 smithi110 ceph-mon[28069]: slow request 360.549071 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:05:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:18 smithi193 ceph-mon[32782]: 6 slow requests, 1 included below; oldest blocked for > 33432.512539 secs 2024-04-26T21:05:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:18 smithi193 ceph-mon[32782]: slow request 360.549071 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:05:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:19 smithi196 ceph-mon[32572]: pgmap v17996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:19 smithi110 ceph-mon[28069]: pgmap v17996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:19 smithi193 ceph-mon[32782]: pgmap v17996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:21 smithi196 ceph-mon[32572]: pgmap v17997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:21 smithi110 ceph-mon[28069]: pgmap v17997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:21 smithi193 ceph-mon[32782]: pgmap v17997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:23 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33437.512661 secs 2024-04-26T21:05:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:23 smithi196 ceph-mon[32572]: pgmap v17998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:23 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33437.512661 secs 2024-04-26T21:05:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:23 smithi110 ceph-mon[28069]: pgmap v17998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:23 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33437.512661 secs 2024-04-26T21:05:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:23 smithi193 ceph-mon[32782]: pgmap v17998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:25 smithi196 ceph-mon[32572]: pgmap v17999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:25 smithi110 ceph-mon[28069]: pgmap v17999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:25 smithi193 ceph-mon[32782]: pgmap v17999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:27 smithi196 ceph-mon[32572]: pgmap v18000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:27 smithi110 ceph-mon[28069]: pgmap v18000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:27 smithi193 ceph-mon[32782]: pgmap v18000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:28 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33442.512776 secs 2024-04-26T21:05:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:28 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33442.512776 secs 2024-04-26T21:05:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:28 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33442.512776 secs 2024-04-26T21:05:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:29 smithi196 ceph-mon[32572]: pgmap v18001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:29 smithi110 ceph-mon[28069]: pgmap v18001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:29 smithi193 ceph-mon[32782]: pgmap v18001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:31 smithi196 ceph-mon[32572]: pgmap v18002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:31 smithi110 ceph-mon[28069]: pgmap v18002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:31 smithi193 ceph-mon[32782]: pgmap v18002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:33 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33447.512894 secs 2024-04-26T21:05:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:33 smithi196 ceph-mon[32572]: pgmap v18003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:33 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33447.512894 secs 2024-04-26T21:05:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:33 smithi110 ceph-mon[28069]: pgmap v18003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:33.624 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:33 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33447.512894 secs 2024-04-26T21:05:33.624 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:33 smithi193 ceph-mon[32782]: pgmap v18003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:35 smithi196 ceph-mon[32572]: pgmap v18004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:35 smithi110 ceph-mon[28069]: pgmap v18004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:35 smithi193 ceph-mon[32782]: pgmap v18004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:37 smithi196 ceph-mon[32572]: pgmap v18005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:37 smithi110 ceph-mon[28069]: pgmap v18005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:37 smithi193 ceph-mon[32782]: pgmap v18005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:38 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33452.513011 secs 2024-04-26T21:05:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:38 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33452.513011 secs 2024-04-26T21:05:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:38 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33452.513011 secs 2024-04-26T21:05:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:39 smithi196 ceph-mon[32572]: pgmap v18006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:39 smithi110 ceph-mon[28069]: pgmap v18006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:39 smithi193 ceph-mon[32782]: pgmap v18006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:41 smithi196 ceph-mon[32572]: pgmap v18007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:41 smithi110 ceph-mon[28069]: pgmap v18007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:41 smithi193 ceph-mon[32782]: pgmap v18007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33457.513128 secs 2024-04-26T21:05:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33457.513128 secs 2024-04-26T21:05:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33457.513128 secs 2024-04-26T21:05:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:43 smithi196 ceph-mon[32572]: pgmap v18008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:43 smithi110 ceph-mon[28069]: pgmap v18008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:43 smithi193 ceph-mon[32782]: pgmap v18008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:45 smithi196 ceph-mon[32572]: pgmap v18009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:45 smithi110 ceph-mon[28069]: pgmap v18009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:45 smithi193 ceph-mon[32782]: pgmap v18009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:47 smithi196 ceph-mon[32572]: pgmap v18010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33462.513245 secs 2024-04-26T21:05:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:47 smithi110 ceph-mon[28069]: pgmap v18010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33462.513245 secs 2024-04-26T21:05:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:47 smithi193 ceph-mon[32782]: pgmap v18010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33462.513245 secs 2024-04-26T21:05:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:49 smithi196 ceph-mon[32572]: pgmap v18011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:49 smithi110 ceph-mon[28069]: pgmap v18011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:49 smithi193 ceph-mon[32782]: pgmap v18011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:51 smithi110 ceph-mon[28069]: pgmap v18012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:51 smithi193 ceph-mon[32782]: pgmap v18012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:51 smithi196 ceph-mon[32572]: pgmap v18012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33467.513323 secs 2024-04-26T21:05:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33467.513323 secs 2024-04-26T21:05:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33467.513323 secs 2024-04-26T21:05:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:53 smithi110 ceph-mon[28069]: pgmap v18013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:53 smithi193 ceph-mon[32782]: pgmap v18013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:53 smithi196 ceph-mon[32572]: pgmap v18013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:55 smithi110 ceph-mon[28069]: pgmap v18014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:55 smithi193 ceph-mon[32782]: pgmap v18014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:55 smithi196 ceph-mon[32572]: pgmap v18014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:05:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:57 smithi110 ceph-mon[28069]: pgmap v18015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33472.513441 secs 2024-04-26T21:05:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:57 smithi193 ceph-mon[32782]: pgmap v18015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33472.513441 secs 2024-04-26T21:05:57.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:57 smithi196 ceph-mon[32572]: pgmap v18015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:05:57.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33472.513441 secs 2024-04-26T21:05:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:58 smithi193 ceph-mon[32782]: pgmap v18016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:05:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:58 smithi193 ceph-mon[32782]: pgmap v18017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:05:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:05:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:05:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:58 smithi196 ceph-mon[32572]: pgmap v18016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:05:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:58 smithi196 ceph-mon[32572]: pgmap v18017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:05:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:05:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:05:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:58 smithi110 ceph-mon[28069]: pgmap v18016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:05:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:58 smithi110 ceph-mon[28069]: pgmap v18017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:05:58.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:05:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:06:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:00 smithi196 ceph-mon[32572]: pgmap v18018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:00 smithi110 ceph-mon[28069]: pgmap v18018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:00 smithi193 ceph-mon[32782]: pgmap v18018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:02 smithi196 ceph-mon[32572]: pgmap v18019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33477.513560 secs 2024-04-26T21:06:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:02 smithi110 ceph-mon[28069]: pgmap v18019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33477.513560 secs 2024-04-26T21:06:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:02 smithi193 ceph-mon[32782]: pgmap v18019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33477.513560 secs 2024-04-26T21:06:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:04 smithi196 ceph-mon[32572]: pgmap v18020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:04 smithi110 ceph-mon[28069]: pgmap v18020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:04.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:04 smithi193 ceph-mon[32782]: pgmap v18020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:06 smithi196 ceph-mon[32572]: pgmap v18021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:06 smithi110 ceph-mon[28069]: pgmap v18021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:06 smithi193 ceph-mon[32782]: pgmap v18021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:06:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33482.513656 secs 2024-04-26T21:06:07.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33482.513656 secs 2024-04-26T21:06:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33482.513656 secs 2024-04-26T21:06:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:08 smithi196 ceph-mon[32572]: pgmap v18022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:06:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:08 smithi110 ceph-mon[28069]: pgmap v18022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:06:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:08 smithi193 ceph-mon[32782]: pgmap v18022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:06:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:10 smithi196 ceph-mon[32572]: pgmap v18023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:10 smithi110 ceph-mon[28069]: pgmap v18023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:10 smithi193 ceph-mon[32782]: pgmap v18023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:12 smithi196 ceph-mon[32572]: pgmap v18024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:12 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33487.513755 secs 2024-04-26T21:06:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:12 smithi110 ceph-mon[28069]: pgmap v18024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:12 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33487.513755 secs 2024-04-26T21:06:12.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:12 smithi193 ceph-mon[32782]: pgmap v18024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:12.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:12 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33487.513755 secs 2024-04-26T21:06:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:14 smithi196 ceph-mon[32572]: pgmap v18025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:14 smithi110 ceph-mon[28069]: pgmap v18025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:14 smithi193 ceph-mon[32782]: pgmap v18025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:16 smithi196 ceph-mon[32572]: pgmap v18026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:16 smithi110 ceph-mon[28069]: pgmap v18026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:16 smithi193 ceph-mon[32782]: pgmap v18026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:17 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33492.513880 secs 2024-04-26T21:06:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:17 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33492.513880 secs 2024-04-26T21:06:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:17 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33492.513880 secs 2024-04-26T21:06:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:18 smithi196 ceph-mon[32572]: pgmap v18027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:18 smithi110 ceph-mon[28069]: pgmap v18027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:18 smithi193 ceph-mon[32782]: pgmap v18027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:20 smithi196 ceph-mon[32572]: pgmap v18028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:20 smithi110 ceph-mon[28069]: pgmap v18028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:20 smithi193 ceph-mon[32782]: pgmap v18028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:06:21.924+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:06:21.926 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:06:21.924+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:06:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:06:21.924+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 258 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:06:21.927 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:06:21.925+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 258 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:06:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:22 smithi196 ceph-mon[32572]: pgmap v18029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:22 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33497.513961 secs 2024-04-26T21:06:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:22 smithi110 ceph-mon[28069]: pgmap v18029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:22 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33497.513961 secs 2024-04-26T21:06:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:22 smithi193 ceph-mon[32782]: pgmap v18029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:22 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33497.513961 secs 2024-04-26T21:06:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:24 smithi110 ceph-mon[28069]: pgmap v18030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:24 smithi193 ceph-mon[32782]: pgmap v18030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:24 smithi196 ceph-mon[32572]: pgmap v18030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:25 smithi110 ceph-mon[28069]: pgmap v18031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:25 smithi193 ceph-mon[32782]: pgmap v18031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:25 smithi196 ceph-mon[32572]: pgmap v18031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:27 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33502.514080 secs 2024-04-26T21:06:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:27 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33502.514080 secs 2024-04-26T21:06:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:27 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33502.514080 secs 2024-04-26T21:06:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:28 smithi110 ceph-mon[28069]: pgmap v18032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:28 smithi193 ceph-mon[32782]: pgmap v18032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:28 smithi196 ceph-mon[32572]: pgmap v18032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:30 smithi196 ceph-mon[32572]: pgmap v18033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:30 smithi110 ceph-mon[28069]: pgmap v18033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:30 smithi193 ceph-mon[32782]: pgmap v18033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:32 smithi196 ceph-mon[32572]: pgmap v18034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:32 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33507.514233 secs 2024-04-26T21:06:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:32 smithi110 ceph-mon[28069]: pgmap v18034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:32 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33507.514233 secs 2024-04-26T21:06:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:32 smithi193 ceph-mon[32782]: pgmap v18034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:32 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33507.514233 secs 2024-04-26T21:06:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:34 smithi196 ceph-mon[32572]: pgmap v18035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:34 smithi110 ceph-mon[28069]: pgmap v18035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:34 smithi193 ceph-mon[32782]: pgmap v18035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:36 smithi196 ceph-mon[32572]: pgmap v18036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:36 smithi110 ceph-mon[28069]: pgmap v18036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:36 smithi193 ceph-mon[32782]: pgmap v18036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:37 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33512.514355 secs 2024-04-26T21:06:37.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:37 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33512.514355 secs 2024-04-26T21:06:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:37 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33512.514355 secs 2024-04-26T21:06:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:38 smithi196 ceph-mon[32572]: pgmap v18037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:38 smithi110 ceph-mon[28069]: pgmap v18037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:38 smithi193 ceph-mon[32782]: pgmap v18037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:40 smithi196 ceph-mon[32572]: pgmap v18038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:40 smithi110 ceph-mon[28069]: pgmap v18038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:40 smithi193 ceph-mon[32782]: pgmap v18038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:42.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:42 smithi196 ceph-mon[32572]: pgmap v18039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:42.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:42 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33517.514420 secs 2024-04-26T21:06:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:42 smithi110 ceph-mon[28069]: pgmap v18039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:42 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33517.514420 secs 2024-04-26T21:06:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:42 smithi193 ceph-mon[32782]: pgmap v18039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:42 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33517.514420 secs 2024-04-26T21:06:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:44 smithi196 ceph-mon[32572]: pgmap v18040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:44 smithi110 ceph-mon[28069]: pgmap v18040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:44 smithi193 ceph-mon[32782]: pgmap v18040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:46 smithi196 ceph-mon[32572]: pgmap v18041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:46 smithi110 ceph-mon[28069]: pgmap v18041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:46 smithi193 ceph-mon[32782]: pgmap v18041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:47 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33522.514541 secs 2024-04-26T21:06:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:47 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33522.514541 secs 2024-04-26T21:06:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:47 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33522.514541 secs 2024-04-26T21:06:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:48 smithi110 ceph-mon[28069]: pgmap v18042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:48 smithi193 ceph-mon[32782]: pgmap v18042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:48 smithi196 ceph-mon[32572]: pgmap v18042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:50 smithi110 ceph-mon[28069]: pgmap v18043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:50 smithi193 ceph-mon[32782]: pgmap v18043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:50 smithi196 ceph-mon[32572]: pgmap v18043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:52 smithi110 ceph-mon[28069]: pgmap v18044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:52 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33527.514635 secs 2024-04-26T21:06:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:52 smithi193 ceph-mon[32782]: pgmap v18044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:52 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33527.514635 secs 2024-04-26T21:06:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:52 smithi196 ceph-mon[32572]: pgmap v18044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:52 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33527.514635 secs 2024-04-26T21:06:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:53 smithi110 ceph-mon[28069]: pgmap v18045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:53 smithi193 ceph-mon[32782]: pgmap v18045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:53 smithi196 ceph-mon[32572]: pgmap v18045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:56 smithi196 ceph-mon[32572]: pgmap v18046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:56 smithi110 ceph-mon[28069]: pgmap v18046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:56 smithi193 ceph-mon[32782]: pgmap v18046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:06:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:57 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33532.514720 secs 2024-04-26T21:06:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:57 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33532.514720 secs 2024-04-26T21:06:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:57 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33532.514720 secs 2024-04-26T21:06:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:58 smithi196 ceph-mon[32572]: pgmap v18047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:58 smithi110 ceph-mon[28069]: pgmap v18047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:58 smithi193 ceph-mon[32782]: pgmap v18047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:06:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:06:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:06:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:06:59 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:06:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:06:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:06:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:06:59 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:06:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:06:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:06:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:06:59 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:07:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:00 smithi196 ceph-mon[32572]: pgmap v18048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T21:07:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:00 smithi196 ceph-mon[32572]: pgmap v18049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:00 smithi110 ceph-mon[28069]: pgmap v18048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T21:07:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:00 smithi110 ceph-mon[28069]: pgmap v18049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:00 smithi193 ceph-mon[32782]: pgmap v18048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T21:07:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:00 smithi193 ceph-mon[32782]: pgmap v18049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:02 smithi196 ceph-mon[32572]: pgmap v18050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:02 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33537.514798 secs 2024-04-26T21:07:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:02 smithi110 ceph-mon[28069]: pgmap v18050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:02 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33537.514798 secs 2024-04-26T21:07:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:02 smithi193 ceph-mon[32782]: pgmap v18050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:02 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33537.514798 secs 2024-04-26T21:07:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:04 smithi196 ceph-mon[32572]: pgmap v18051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:04 smithi110 ceph-mon[28069]: pgmap v18051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:04 smithi193 ceph-mon[32782]: pgmap v18051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:06 smithi110 ceph-mon[28069]: pgmap v18052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:06 smithi193 ceph-mon[32782]: pgmap v18052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:06 smithi196 ceph-mon[32572]: pgmap v18052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:07:07.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:07 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33542.514920 secs 2024-04-26T21:07:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:07 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33542.514920 secs 2024-04-26T21:07:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:07 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33542.514920 secs 2024-04-26T21:07:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:08 smithi110 ceph-mon[28069]: pgmap v18053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T21:07:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:08 smithi193 ceph-mon[32782]: pgmap v18053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T21:07:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:08 smithi196 ceph-mon[32572]: pgmap v18053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T21:07:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:09 smithi110 ceph-mon[28069]: pgmap v18054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:07:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:09 smithi193 ceph-mon[32782]: pgmap v18054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:07:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:09 smithi196 ceph-mon[32572]: pgmap v18054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:07:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:12 smithi193 ceph-mon[32782]: pgmap v18055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:12 smithi196 ceph-mon[32572]: pgmap v18055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:12 smithi110 ceph-mon[28069]: pgmap v18055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:13 smithi193 ceph-mon[32782]: 6 slow requests, 0 included below; oldest blocked for > 33547.515001 secs 2024-04-26T21:07:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:13 smithi196 ceph-mon[32572]: 6 slow requests, 0 included below; oldest blocked for > 33547.515001 secs 2024-04-26T21:07:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:13 smithi110 ceph-mon[28069]: 6 slow requests, 0 included below; oldest blocked for > 33547.515001 secs 2024-04-26T21:07:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:14 smithi193 ceph-mon[32782]: pgmap v18056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:14 smithi196 ceph-mon[32572]: pgmap v18056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:14 smithi110 ceph-mon[28069]: pgmap v18056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:16 smithi193 ceph-mon[32782]: pgmap v18057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:16 smithi196 ceph-mon[32572]: pgmap v18057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:16 smithi110 ceph-mon[28069]: pgmap v18057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:18 smithi193 ceph-mon[32782]: 27 slow requests, 1 included below; oldest blocked for > 33552.515143 secs 2024-04-26T21:07:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:18 smithi193 ceph-mon[32782]: slow request 180.323178 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:07:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:18 smithi193 ceph-mon[32782]: pgmap v18058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:18 smithi196 ceph-mon[32572]: 27 slow requests, 1 included below; oldest blocked for > 33552.515143 secs 2024-04-26T21:07:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:18 smithi196 ceph-mon[32572]: slow request 180.323178 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:07:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:18 smithi196 ceph-mon[32572]: pgmap v18058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:18 smithi110 ceph-mon[28069]: 27 slow requests, 1 included below; oldest blocked for > 33552.515143 secs 2024-04-26T21:07:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:18 smithi110 ceph-mon[28069]: slow request 180.323178 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:07:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:18 smithi110 ceph-mon[28069]: pgmap v18058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:20 smithi193 ceph-mon[32782]: pgmap v18059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:20 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:07:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:20 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:07:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:20 smithi196 ceph-mon[32572]: pgmap v18059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:20 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:07:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:20 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:07:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:20 smithi110 ceph-mon[28069]: pgmap v18059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:20 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:07:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:20 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:07:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:22 smithi193 ceph-mon[32782]: pgmap v18060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:22 smithi196 ceph-mon[32572]: pgmap v18060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:22 smithi110 ceph-mon[28069]: pgmap v18060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:23 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33557.515288 secs 2024-04-26T21:07:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:23 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33557.515288 secs 2024-04-26T21:07:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:23 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33557.515288 secs 2024-04-26T21:07:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:24 smithi193 ceph-mon[32782]: pgmap v18061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:24 smithi196 ceph-mon[32572]: pgmap v18061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:24 smithi110 ceph-mon[28069]: pgmap v18061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:26 smithi196 ceph-mon[32572]: pgmap v18062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:26 smithi110 ceph-mon[28069]: pgmap v18062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:26 smithi193 ceph-mon[32782]: pgmap v18062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:28 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33562.515412 secs 2024-04-26T21:07:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:28 smithi196 ceph-mon[32572]: pgmap v18063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:28 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33562.515412 secs 2024-04-26T21:07:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:28 smithi110 ceph-mon[28069]: pgmap v18063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:28 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33562.515412 secs 2024-04-26T21:07:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:28 smithi193 ceph-mon[32782]: pgmap v18063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:30 smithi196 ceph-mon[32572]: pgmap v18064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:30 smithi110 ceph-mon[28069]: pgmap v18064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:30 smithi193 ceph-mon[32782]: pgmap v18064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:32 smithi196 ceph-mon[32572]: pgmap v18065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:32 smithi110 ceph-mon[28069]: pgmap v18065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:32 smithi193 ceph-mon[32782]: pgmap v18065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:33 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33567.515511 secs 2024-04-26T21:07:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:33 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33567.515511 secs 2024-04-26T21:07:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:33 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33567.515511 secs 2024-04-26T21:07:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:34 smithi196 ceph-mon[32572]: pgmap v18066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:34 smithi110 ceph-mon[28069]: pgmap v18066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:34 smithi193 ceph-mon[32782]: pgmap v18066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:36 smithi196 ceph-mon[32572]: pgmap v18067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:36 smithi110 ceph-mon[28069]: pgmap v18067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:36 smithi193 ceph-mon[32782]: pgmap v18067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:38.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:38 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33572.515632 secs 2024-04-26T21:07:38.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:38 smithi193 ceph-mon[32782]: pgmap v18068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:38 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33572.515632 secs 2024-04-26T21:07:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:38 smithi196 ceph-mon[32572]: pgmap v18068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:38 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33572.515632 secs 2024-04-26T21:07:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:38 smithi110 ceph-mon[28069]: pgmap v18068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:40 smithi196 ceph-mon[32572]: pgmap v18069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:40 smithi110 ceph-mon[28069]: pgmap v18069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:40 smithi193 ceph-mon[32782]: pgmap v18069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:42 smithi196 ceph-mon[32572]: pgmap v18070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:42.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:42 smithi110 ceph-mon[28069]: pgmap v18070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:42 smithi193 ceph-mon[32782]: pgmap v18070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:43 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33577.515756 secs 2024-04-26T21:07:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:43 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33577.515756 secs 2024-04-26T21:07:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:43 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33577.515756 secs 2024-04-26T21:07:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:44 smithi196 ceph-mon[32572]: pgmap v18071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:44 smithi110 ceph-mon[28069]: pgmap v18071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:44 smithi193 ceph-mon[32782]: pgmap v18071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:46 smithi196 ceph-mon[32572]: pgmap v18072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:46 smithi110 ceph-mon[28069]: pgmap v18072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:46 smithi193 ceph-mon[32782]: pgmap v18072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:48 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33582.515884 secs 2024-04-26T21:07:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:48 smithi196 ceph-mon[32572]: pgmap v18073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:48 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33582.515884 secs 2024-04-26T21:07:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:48 smithi110 ceph-mon[28069]: pgmap v18073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:48 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33582.515884 secs 2024-04-26T21:07:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:48 smithi193 ceph-mon[32782]: pgmap v18073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:50 smithi196 ceph-mon[32572]: pgmap v18074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:50.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:50 smithi110 ceph-mon[28069]: pgmap v18074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:50 smithi193 ceph-mon[32782]: pgmap v18074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:52 smithi196 ceph-mon[32572]: pgmap v18075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:52 smithi110 ceph-mon[28069]: pgmap v18075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:52 smithi193 ceph-mon[32782]: pgmap v18075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:53 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33587.516003 secs 2024-04-26T21:07:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:53 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33587.516003 secs 2024-04-26T21:07:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:53 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33587.516003 secs 2024-04-26T21:07:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:54 smithi196 ceph-mon[32572]: pgmap v18076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:54 smithi110 ceph-mon[28069]: pgmap v18076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:54 smithi193 ceph-mon[32782]: pgmap v18076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:07:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:56 smithi196 ceph-mon[32572]: pgmap v18077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:56 smithi110 ceph-mon[28069]: pgmap v18077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:56 smithi193 ceph-mon[32782]: pgmap v18077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:58 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33592.516134 secs 2024-04-26T21:07:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:07:58 smithi196 ceph-mon[32572]: pgmap v18078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:58 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33592.516134 secs 2024-04-26T21:07:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:07:58 smithi110 ceph-mon[28069]: pgmap v18078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:07:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:58 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33592.516134 secs 2024-04-26T21:07:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:07:58 smithi193 ceph-mon[32782]: pgmap v18078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:00 smithi196 ceph-mon[32572]: pgmap v18079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:00 smithi110 ceph-mon[28069]: pgmap v18079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:00 smithi193 ceph-mon[32782]: pgmap v18079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:08:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:08:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:08:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:02 smithi196 ceph-mon[32572]: pgmap v18080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:08:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:02 smithi196 ceph-mon[32572]: pgmap v18081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:02 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33597.516218 secs 2024-04-26T21:08:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:02 smithi110 ceph-mon[28069]: pgmap v18080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:08:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:02 smithi110 ceph-mon[28069]: pgmap v18081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:02.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:02 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33597.516218 secs 2024-04-26T21:08:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:02 smithi193 ceph-mon[32782]: pgmap v18080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:08:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:02 smithi193 ceph-mon[32782]: pgmap v18081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:02 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33597.516218 secs 2024-04-26T21:08:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:04 smithi196 ceph-mon[32572]: pgmap v18082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:04 smithi110 ceph-mon[28069]: pgmap v18082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:04 smithi193 ceph-mon[32782]: pgmap v18082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:06 smithi196 ceph-mon[32572]: pgmap v18083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:06 smithi110 ceph-mon[28069]: pgmap v18083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:06 smithi193 ceph-mon[32782]: pgmap v18083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:07 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33602.516360 secs 2024-04-26T21:08:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:07 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33602.516360 secs 2024-04-26T21:08:07.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:07 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33602.516360 secs 2024-04-26T21:08:08.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:08 smithi193 ceph-mon[32782]: pgmap v18084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:08 smithi110 ceph-mon[28069]: pgmap v18084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:08 smithi196 ceph-mon[32572]: pgmap v18084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:10 smithi110 ceph-mon[28069]: pgmap v18085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:10 smithi193 ceph-mon[32782]: pgmap v18085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:10 smithi196 ceph-mon[32572]: pgmap v18085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:08:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:12 smithi110 ceph-mon[28069]: pgmap v18086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:08:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:12 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33607.516459 secs 2024-04-26T21:08:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:12 smithi193 ceph-mon[32782]: pgmap v18086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:08:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:12 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33607.516459 secs 2024-04-26T21:08:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:12 smithi196 ceph-mon[32572]: pgmap v18086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:08:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:12 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33607.516459 secs 2024-04-26T21:08:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:14 smithi110 ceph-mon[28069]: pgmap v18087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:14 smithi193 ceph-mon[32782]: pgmap v18087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:14 smithi196 ceph-mon[32572]: pgmap v18087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:16 smithi110 ceph-mon[28069]: pgmap v18088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:16 smithi193 ceph-mon[32782]: pgmap v18088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:16 smithi196 ceph-mon[32572]: pgmap v18088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:17 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33612.516571 secs 2024-04-26T21:08:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:17 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33612.516571 secs 2024-04-26T21:08:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:17 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33612.516571 secs 2024-04-26T21:08:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:18 smithi193 ceph-mon[32782]: pgmap v18089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:18 smithi196 ceph-mon[32572]: pgmap v18089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:18 smithi110 ceph-mon[28069]: pgmap v18089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:20 smithi193 ceph-mon[32782]: pgmap v18090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:20 smithi196 ceph-mon[32572]: pgmap v18090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:20 smithi110 ceph-mon[28069]: pgmap v18090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:22 smithi193 ceph-mon[32782]: pgmap v18091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:22 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33617.516681 secs 2024-04-26T21:08:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:22 smithi196 ceph-mon[32572]: pgmap v18091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:22 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33617.516681 secs 2024-04-26T21:08:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:22 smithi110 ceph-mon[28069]: pgmap v18091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:22 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33617.516681 secs 2024-04-26T21:08:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:24 smithi193 ceph-mon[32782]: pgmap v18092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:24 smithi196 ceph-mon[32572]: pgmap v18092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:24 smithi110 ceph-mon[28069]: pgmap v18092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:26 smithi193 ceph-mon[32782]: pgmap v18093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:26 smithi196 ceph-mon[32572]: pgmap v18093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:26.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:26 smithi110 ceph-mon[28069]: pgmap v18093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:27 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33622.516815 secs 2024-04-26T21:08:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:27 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33622.516815 secs 2024-04-26T21:08:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:27 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33622.516815 secs 2024-04-26T21:08:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:28 smithi193 ceph-mon[32782]: pgmap v18094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:28.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:28 smithi196 ceph-mon[32572]: pgmap v18094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:28 smithi110 ceph-mon[28069]: pgmap v18094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:30 smithi193 ceph-mon[32782]: pgmap v18095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:30 smithi196 ceph-mon[32572]: pgmap v18095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:30 smithi110 ceph-mon[28069]: pgmap v18095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:32 smithi193 ceph-mon[32782]: pgmap v18096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:32 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33627.516960 secs 2024-04-26T21:08:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:32 smithi196 ceph-mon[32572]: pgmap v18096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:32 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33627.516960 secs 2024-04-26T21:08:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:32 smithi110 ceph-mon[28069]: pgmap v18096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:32 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33627.516960 secs 2024-04-26T21:08:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:34 smithi193 ceph-mon[32782]: pgmap v18097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:34 smithi196 ceph-mon[32572]: pgmap v18097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:34 smithi110 ceph-mon[28069]: pgmap v18097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:36 smithi193 ceph-mon[32782]: pgmap v18098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:36 smithi196 ceph-mon[32572]: pgmap v18098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:36 smithi110 ceph-mon[28069]: pgmap v18098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:37 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33632.517070 secs 2024-04-26T21:08:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:37 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33632.517070 secs 2024-04-26T21:08:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:37 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33632.517070 secs 2024-04-26T21:08:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:38 smithi193 ceph-mon[32782]: pgmap v18099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:38 smithi196 ceph-mon[32572]: pgmap v18099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:38 smithi110 ceph-mon[28069]: pgmap v18099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:40 smithi193 ceph-mon[32782]: pgmap v18100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:40 smithi196 ceph-mon[32572]: pgmap v18100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:40 smithi110 ceph-mon[28069]: pgmap v18100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:42 smithi196 ceph-mon[32572]: pgmap v18101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:42 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33637.517194 secs 2024-04-26T21:08:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:42 smithi110 ceph-mon[28069]: pgmap v18101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:42 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33637.517194 secs 2024-04-26T21:08:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:42 smithi193 ceph-mon[32782]: pgmap v18101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:42 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33637.517194 secs 2024-04-26T21:08:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:44 smithi196 ceph-mon[32572]: pgmap v18102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:44 smithi110 ceph-mon[28069]: pgmap v18102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:44 smithi193 ceph-mon[32782]: pgmap v18102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:46 smithi196 ceph-mon[32572]: pgmap v18103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:46 smithi110 ceph-mon[28069]: pgmap v18103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:46 smithi193 ceph-mon[32782]: pgmap v18103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:47 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33642.517339 secs 2024-04-26T21:08:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:47 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33642.517339 secs 2024-04-26T21:08:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:47 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33642.517339 secs 2024-04-26T21:08:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:48 smithi196 ceph-mon[32572]: pgmap v18104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:48 smithi110 ceph-mon[28069]: pgmap v18104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:48 smithi193 ceph-mon[32782]: pgmap v18104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:50 smithi196 ceph-mon[32572]: pgmap v18105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:50 smithi110 ceph-mon[28069]: pgmap v18105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:50 smithi193 ceph-mon[32782]: pgmap v18105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:52 smithi196 ceph-mon[32572]: pgmap v18106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:52 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33647.517472 secs 2024-04-26T21:08:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:52 smithi110 ceph-mon[28069]: pgmap v18106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:52 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33647.517472 secs 2024-04-26T21:08:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:52 smithi193 ceph-mon[32782]: pgmap v18106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:52 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33647.517472 secs 2024-04-26T21:08:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:54 smithi196 ceph-mon[32572]: pgmap v18107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:54 smithi110 ceph-mon[28069]: pgmap v18107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:54 smithi193 ceph-mon[32782]: pgmap v18107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:08:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:56 smithi196 ceph-mon[32572]: pgmap v18108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:56 smithi110 ceph-mon[28069]: pgmap v18108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:56 smithi193 ceph-mon[32782]: pgmap v18108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:57 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33652.517604 secs 2024-04-26T21:08:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:57 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33652.517604 secs 2024-04-26T21:08:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:57 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33652.517604 secs 2024-04-26T21:08:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:08:58 smithi196 ceph-mon[32572]: pgmap v18109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:08:58 smithi110 ceph-mon[28069]: pgmap v18109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:08:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:08:58 smithi193 ceph-mon[32782]: pgmap v18109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:00 smithi196 ceph-mon[32572]: pgmap v18110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:00 smithi110 ceph-mon[28069]: pgmap v18110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:00 smithi193 ceph-mon[32782]: pgmap v18110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:02 smithi110 ceph-mon[28069]: pgmap v18111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:02 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33657.517724 secs 2024-04-26T21:09:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:02 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:09:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:09:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:02 smithi193 ceph-mon[32782]: pgmap v18111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:02 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33657.517724 secs 2024-04-26T21:09:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:02 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:09:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:09:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:02 smithi196 ceph-mon[32572]: pgmap v18111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:02 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33657.517724 secs 2024-04-26T21:09:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:02 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:09:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:09:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:03 smithi110 ceph-mon[28069]: pgmap v18112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:09:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:03 smithi110 ceph-mon[28069]: pgmap v18113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:09:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:03 smithi193 ceph-mon[32782]: pgmap v18112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:09:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:03 smithi193 ceph-mon[32782]: pgmap v18113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:09:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:03 smithi196 ceph-mon[32572]: pgmap v18112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:09:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:03 smithi196 ceph-mon[32572]: pgmap v18113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:09:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:05 smithi110 ceph-mon[28069]: pgmap v18114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:05 smithi193 ceph-mon[32782]: pgmap v18114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:05 smithi196 ceph-mon[32572]: pgmap v18114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:07 smithi110 ceph-mon[28069]: pgmap v18115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:07 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33662.517816 secs 2024-04-26T21:09:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:07 smithi193 ceph-mon[32782]: pgmap v18115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:07 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33662.517816 secs 2024-04-26T21:09:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:07 smithi196 ceph-mon[32572]: pgmap v18115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:07 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33662.517816 secs 2024-04-26T21:09:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:09 smithi110 ceph-mon[28069]: pgmap v18116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:09 smithi193 ceph-mon[32782]: pgmap v18116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:09 smithi196 ceph-mon[32572]: pgmap v18116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:11 smithi193 ceph-mon[32782]: pgmap v18117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:11 smithi196 ceph-mon[32572]: pgmap v18117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:11 smithi110 ceph-mon[28069]: pgmap v18117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:09:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:12 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33667.517932 secs 2024-04-26T21:09:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:12 smithi193 ceph-mon[32782]: pgmap v18118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:09:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:12 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33667.517932 secs 2024-04-26T21:09:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:12 smithi196 ceph-mon[32572]: pgmap v18118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:09:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:12 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33667.517932 secs 2024-04-26T21:09:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:12 smithi110 ceph-mon[28069]: pgmap v18118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:09:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:15 smithi196 ceph-mon[32572]: pgmap v18119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:15 smithi110 ceph-mon[28069]: pgmap v18119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:15 smithi193 ceph-mon[32782]: pgmap v18119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:09:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:09:16.575+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:09:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:09:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:09:16.575+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:09:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:09:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:09:16.575+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:09:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:09:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:09:16.575+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:09:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:09:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:09:16.575+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:09:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:17 smithi196 ceph-mon[32572]: pgmap v18120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:17 smithi110 ceph-mon[28069]: pgmap v18120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:17 smithi193 ceph-mon[32782]: pgmap v18120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:18 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33672.518052 secs 2024-04-26T21:09:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:18 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33672.518052 secs 2024-04-26T21:09:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:18 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33672.518052 secs 2024-04-26T21:09:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:19 smithi196 ceph-mon[32572]: pgmap v18121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:09:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:19 smithi110 ceph-mon[28069]: pgmap v18121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:09:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:19 smithi193 ceph-mon[32782]: pgmap v18121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:09:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:21 smithi196 ceph-mon[32572]: pgmap v18122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:09:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:21 smithi110 ceph-mon[28069]: pgmap v18122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:09:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:21 smithi193 ceph-mon[32782]: pgmap v18122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:09:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:09:21.954+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:09:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:09:21.954+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:09:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:09:21.955+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 259 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:09:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:09:21.955+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 259 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:09:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:09:21.955+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:09:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:09:21.956+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:09:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:09:21.956+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 260 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:09:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:09:21.956+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 260 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:09:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:23 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33677.518133 secs 2024-04-26T21:09:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:23 smithi196 ceph-mon[32572]: pgmap v18123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:09:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:23 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33677.518133 secs 2024-04-26T21:09:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:23 smithi110 ceph-mon[28069]: pgmap v18123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:09:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:23 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33677.518133 secs 2024-04-26T21:09:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:23 smithi193 ceph-mon[32782]: pgmap v18123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:09:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:25 smithi196 ceph-mon[32572]: pgmap v18124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:09:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:25 smithi110 ceph-mon[28069]: pgmap v18124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:09:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:25 smithi193 ceph-mon[32782]: pgmap v18124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:09:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:27 smithi196 ceph-mon[32572]: pgmap v18125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:09:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:27 smithi110 ceph-mon[28069]: pgmap v18125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:09:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:27 smithi193 ceph-mon[32782]: pgmap v18125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:09:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:28 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33682.518250 secs 2024-04-26T21:09:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:28 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33682.518250 secs 2024-04-26T21:09:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:28 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33682.518250 secs 2024-04-26T21:09:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:29 smithi196 ceph-mon[32572]: pgmap v18126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:09:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:29 smithi110 ceph-mon[28069]: pgmap v18126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:09:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:29 smithi193 ceph-mon[32782]: pgmap v18126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:09:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:31 smithi196 ceph-mon[32572]: pgmap v18127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:31 smithi110 ceph-mon[28069]: pgmap v18127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:31 smithi193 ceph-mon[32782]: pgmap v18127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:32 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33687.518368 secs 2024-04-26T21:09:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:32 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33687.518368 secs 2024-04-26T21:09:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:32 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33687.518368 secs 2024-04-26T21:09:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:33 smithi110 ceph-mon[28069]: pgmap v18128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:33 smithi193 ceph-mon[32782]: pgmap v18128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:33 smithi196 ceph-mon[32572]: pgmap v18128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:35 smithi110 ceph-mon[28069]: pgmap v18129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:35 smithi193 ceph-mon[32782]: pgmap v18129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:35 smithi196 ceph-mon[32572]: pgmap v18129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:37 smithi110 ceph-mon[28069]: pgmap v18130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:37 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33692.518487 secs 2024-04-26T21:09:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:37 smithi193 ceph-mon[32782]: pgmap v18130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:37 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33692.518487 secs 2024-04-26T21:09:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:37 smithi196 ceph-mon[32572]: pgmap v18130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:37 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33692.518487 secs 2024-04-26T21:09:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:39 smithi110 ceph-mon[28069]: pgmap v18131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:39 smithi193 ceph-mon[32782]: pgmap v18131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:39 smithi196 ceph-mon[32572]: pgmap v18131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:41 smithi110 ceph-mon[28069]: pgmap v18132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:41 smithi193 ceph-mon[32782]: pgmap v18132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:41 smithi196 ceph-mon[32572]: pgmap v18132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:42 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33697.518605 secs 2024-04-26T21:09:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:42 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33697.518605 secs 2024-04-26T21:09:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:42 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33697.518605 secs 2024-04-26T21:09:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:43 smithi193 ceph-mon[32782]: pgmap v18133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:43 smithi196 ceph-mon[32572]: pgmap v18133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:43 smithi110 ceph-mon[28069]: pgmap v18133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:45 smithi193 ceph-mon[32782]: pgmap v18134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:45 smithi196 ceph-mon[32572]: pgmap v18134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:45 smithi110 ceph-mon[28069]: pgmap v18134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:47 smithi193 ceph-mon[32782]: pgmap v18135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:47 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33702.518725 secs 2024-04-26T21:09:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:47 smithi196 ceph-mon[32572]: pgmap v18135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:47 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33702.518725 secs 2024-04-26T21:09:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:47 smithi110 ceph-mon[28069]: pgmap v18135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:47 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33702.518725 secs 2024-04-26T21:09:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:49 smithi193 ceph-mon[32782]: pgmap v18136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:49 smithi196 ceph-mon[32572]: pgmap v18136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:49 smithi110 ceph-mon[28069]: pgmap v18136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:51 smithi193 ceph-mon[32782]: pgmap v18137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:51 smithi196 ceph-mon[32572]: pgmap v18137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:51 smithi110 ceph-mon[28069]: pgmap v18137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:52 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33707.518785 secs 2024-04-26T21:09:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:52 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33707.518785 secs 2024-04-26T21:09:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:52 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33707.518785 secs 2024-04-26T21:09:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:53 smithi193 ceph-mon[32782]: pgmap v18138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:53 smithi196 ceph-mon[32572]: pgmap v18138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:53 smithi110 ceph-mon[28069]: pgmap v18138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:55 smithi193 ceph-mon[32782]: pgmap v18139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:55 smithi196 ceph-mon[32572]: pgmap v18139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:55 smithi110 ceph-mon[28069]: pgmap v18139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:57 smithi193 ceph-mon[32782]: pgmap v18140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:57 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33712.518897 secs 2024-04-26T21:09:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:57 smithi196 ceph-mon[32572]: pgmap v18140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:57 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33712.518897 secs 2024-04-26T21:09:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:57 smithi110 ceph-mon[28069]: pgmap v18140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:09:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:57 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33712.518897 secs 2024-04-26T21:09:59.558 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:09:59 smithi196 ceph-mon[32572]: pgmap v18141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:09:59 smithi193 ceph-mon[32782]: pgmap v18141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:09:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:09:59 smithi110 ceph-mon[28069]: pgmap v18141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:10:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:10:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:10:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:01 smithi193 ceph-mon[32782]: pgmap v18142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:01 smithi196 ceph-mon[32572]: pgmap v18142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:01 smithi110 ceph-mon[28069]: pgmap v18142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:02 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33717.518962 secs 2024-04-26T21:10:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:02 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33717.518962 secs 2024-04-26T21:10:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:02 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33717.518962 secs 2024-04-26T21:10:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:03 smithi196 ceph-mon[32572]: pgmap v18143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:03 smithi110 ceph-mon[28069]: pgmap v18143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:03 smithi193 ceph-mon[32782]: pgmap v18143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:10:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:10:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:10:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:05 smithi196 ceph-mon[32572]: pgmap v18144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:10:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:05 smithi196 ceph-mon[32572]: pgmap v18145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:05 smithi110 ceph-mon[28069]: pgmap v18144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:10:05.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:05 smithi110 ceph-mon[28069]: pgmap v18145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:05 smithi193 ceph-mon[32782]: pgmap v18144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:10:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:05 smithi193 ceph-mon[32782]: pgmap v18145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:07 smithi196 ceph-mon[32572]: pgmap v18146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:07 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33722.519082 secs 2024-04-26T21:10:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:07 smithi110 ceph-mon[28069]: pgmap v18146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:07 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33722.519082 secs 2024-04-26T21:10:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:07 smithi193 ceph-mon[32782]: pgmap v18146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:07 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33722.519082 secs 2024-04-26T21:10:09.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:09 smithi110 ceph-mon[28069]: pgmap v18147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:09.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:09 smithi193 ceph-mon[32782]: pgmap v18147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:09 smithi196 ceph-mon[32572]: pgmap v18147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:11 smithi196 ceph-mon[32572]: pgmap v18148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:11 smithi110 ceph-mon[28069]: pgmap v18148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:11 smithi193 ceph-mon[32782]: pgmap v18148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:12 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33727.519220 secs 2024-04-26T21:10:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:12 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33727.519220 secs 2024-04-26T21:10:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:12 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33727.519220 secs 2024-04-26T21:10:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:13 smithi110 ceph-mon[28069]: pgmap v18149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:13 smithi193 ceph-mon[32782]: pgmap v18149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:13 smithi196 ceph-mon[32572]: pgmap v18149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:10:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:15 smithi110 ceph-mon[28069]: pgmap v18150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:10:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:15 smithi193 ceph-mon[32782]: pgmap v18150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:10:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:15 smithi196 ceph-mon[32572]: pgmap v18150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:10:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:17 smithi110 ceph-mon[28069]: pgmap v18151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:17 smithi110 ceph-mon[28069]: 27 slow requests, 1 included below; oldest blocked for > 33732.519339 secs 2024-04-26T21:10:17.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:17 smithi110 ceph-mon[28069]: slow request 360.327374 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:10:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:17 smithi193 ceph-mon[32782]: pgmap v18151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:17 smithi193 ceph-mon[32782]: 27 slow requests, 1 included below; oldest blocked for > 33732.519339 secs 2024-04-26T21:10:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:17 smithi193 ceph-mon[32782]: slow request 360.327374 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:10:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:17 smithi196 ceph-mon[32572]: pgmap v18151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:17 smithi196 ceph-mon[32572]: 27 slow requests, 1 included below; oldest blocked for > 33732.519339 secs 2024-04-26T21:10:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:17 smithi196 ceph-mon[32572]: slow request 360.327374 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:10:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:19 smithi110 ceph-mon[28069]: pgmap v18152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:19 smithi193 ceph-mon[32782]: pgmap v18152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:19 smithi196 ceph-mon[32572]: pgmap v18152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:21 smithi110 ceph-mon[28069]: pgmap v18153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:21 smithi193 ceph-mon[32782]: pgmap v18153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:21 smithi196 ceph-mon[32572]: pgmap v18153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:22 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33737.519461 secs 2024-04-26T21:10:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:22 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33737.519461 secs 2024-04-26T21:10:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:22 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33737.519461 secs 2024-04-26T21:10:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:23 smithi193 ceph-mon[32782]: pgmap v18154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:23 smithi196 ceph-mon[32572]: pgmap v18154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:23 smithi110 ceph-mon[28069]: pgmap v18154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:25 smithi193 ceph-mon[32782]: pgmap v18155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:25 smithi196 ceph-mon[32572]: pgmap v18155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:25 smithi110 ceph-mon[28069]: pgmap v18155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:27 smithi193 ceph-mon[32782]: pgmap v18156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:27 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33742.519555 secs 2024-04-26T21:10:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:27 smithi196 ceph-mon[32572]: pgmap v18156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:27 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33742.519555 secs 2024-04-26T21:10:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:27 smithi110 ceph-mon[28069]: pgmap v18156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:27 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33742.519555 secs 2024-04-26T21:10:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:28 smithi193 ceph-mon[32782]: pgmap v18157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:28 smithi196 ceph-mon[32572]: pgmap v18157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:28 smithi110 ceph-mon[28069]: pgmap v18157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:30 smithi110 ceph-mon[28069]: pgmap v18158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:30 smithi193 ceph-mon[32782]: pgmap v18158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:30 smithi196 ceph-mon[32572]: pgmap v18158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:32 smithi110 ceph-mon[28069]: pgmap v18159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:32 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33747.519678 secs 2024-04-26T21:10:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:32 smithi193 ceph-mon[32782]: pgmap v18159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:32 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33747.519678 secs 2024-04-26T21:10:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:32 smithi196 ceph-mon[32572]: pgmap v18159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:32 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33747.519678 secs 2024-04-26T21:10:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:34 smithi110 ceph-mon[28069]: pgmap v18160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:34 smithi193 ceph-mon[32782]: pgmap v18160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:34 smithi196 ceph-mon[32572]: pgmap v18160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:36 smithi110 ceph-mon[28069]: pgmap v18161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:36 smithi193 ceph-mon[32782]: pgmap v18161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:36 smithi196 ceph-mon[32572]: pgmap v18161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:37 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33752.519804 secs 2024-04-26T21:10:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:37 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33752.519804 secs 2024-04-26T21:10:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:37 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33752.519804 secs 2024-04-26T21:10:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:38 smithi193 ceph-mon[32782]: pgmap v18162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:38 smithi196 ceph-mon[32572]: pgmap v18162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:38 smithi110 ceph-mon[28069]: pgmap v18162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:40 smithi193 ceph-mon[32782]: pgmap v18163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:40 smithi196 ceph-mon[32572]: pgmap v18163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:40 smithi110 ceph-mon[28069]: pgmap v18163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:42 smithi193 ceph-mon[32782]: pgmap v18164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:42 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33757.519905 secs 2024-04-26T21:10:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:42 smithi196 ceph-mon[32572]: pgmap v18164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:42 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33757.519905 secs 2024-04-26T21:10:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:42 smithi110 ceph-mon[28069]: pgmap v18164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:42 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33757.519905 secs 2024-04-26T21:10:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:44 smithi193 ceph-mon[32782]: pgmap v18165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:44 smithi196 ceph-mon[32572]: pgmap v18165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:44 smithi110 ceph-mon[28069]: pgmap v18165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:46 smithi193 ceph-mon[32782]: pgmap v18166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:46 smithi196 ceph-mon[32572]: pgmap v18166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:46 smithi110 ceph-mon[28069]: pgmap v18166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:47 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33762.520047 secs 2024-04-26T21:10:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:47 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33762.520047 secs 2024-04-26T21:10:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:47 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33762.520047 secs 2024-04-26T21:10:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:48 smithi193 ceph-mon[32782]: pgmap v18167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:48 smithi196 ceph-mon[32572]: pgmap v18167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:48 smithi110 ceph-mon[28069]: pgmap v18167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:50 smithi193 ceph-mon[32782]: pgmap v18168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:50 smithi196 ceph-mon[32572]: pgmap v18168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:50 smithi110 ceph-mon[28069]: pgmap v18168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:52 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33767.520192 secs 2024-04-26T21:10:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:52 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33767.520192 secs 2024-04-26T21:10:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:52 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33767.520192 secs 2024-04-26T21:10:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:53 smithi110 ceph-mon[28069]: pgmap v18169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:53 smithi193 ceph-mon[32782]: pgmap v18169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:53 smithi196 ceph-mon[32572]: pgmap v18169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:55 smithi110 ceph-mon[28069]: pgmap v18170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:55 smithi193 ceph-mon[32782]: pgmap v18170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:55 smithi196 ceph-mon[32572]: pgmap v18170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:10:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:57 smithi193 ceph-mon[32782]: pgmap v18171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:57 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33772.520338 secs 2024-04-26T21:10:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:57 smithi196 ceph-mon[32572]: pgmap v18171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:57 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33772.520338 secs 2024-04-26T21:10:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:57 smithi110 ceph-mon[28069]: pgmap v18171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:10:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:57 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33772.520338 secs 2024-04-26T21:10:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:10:59 smithi193 ceph-mon[32782]: pgmap v18172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:10:59 smithi196 ceph-mon[32572]: pgmap v18172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:10:59 smithi110 ceph-mon[28069]: pgmap v18172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:01.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:01 smithi196 ceph-mon[32572]: pgmap v18173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:01 smithi193 ceph-mon[32782]: pgmap v18173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:01 smithi110 ceph-mon[28069]: pgmap v18173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:02 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33777.520467 secs 2024-04-26T21:11:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:02 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33777.520467 secs 2024-04-26T21:11:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:02 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33777.520467 secs 2024-04-26T21:11:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:03 smithi193 ceph-mon[32782]: pgmap v18174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:03 smithi196 ceph-mon[32572]: pgmap v18174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:03 smithi110 ceph-mon[28069]: pgmap v18174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:04 smithi193 ceph-mon[32782]: pgmap v18175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:04 smithi196 ceph-mon[32572]: pgmap v18175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:04 smithi110 ceph-mon[28069]: pgmap v18175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:11:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:11:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:11:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:11:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:11:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:11:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:06 smithi193 ceph-mon[32782]: pgmap v18176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:06 smithi193 ceph-mon[32782]: pgmap v18177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:11:07.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:06 smithi110 ceph-mon[28069]: pgmap v18176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:07.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:07.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:07.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:06 smithi110 ceph-mon[28069]: pgmap v18177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:07.194 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:11:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:06 smithi196 ceph-mon[32572]: pgmap v18176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:06 smithi196 ceph-mon[32572]: pgmap v18177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:11:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:07 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33782.520534 secs 2024-04-26T21:11:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:07 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33782.520534 secs 2024-04-26T21:11:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:07 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33782.520534 secs 2024-04-26T21:11:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:08 smithi193 ceph-mon[32782]: pgmap v18178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:08 smithi196 ceph-mon[32572]: pgmap v18178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:08 smithi110 ceph-mon[28069]: pgmap v18178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:11 smithi196 ceph-mon[32572]: pgmap v18179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:11 smithi110 ceph-mon[28069]: pgmap v18179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:11 smithi193 ceph-mon[32782]: pgmap v18179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:13 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33787.520674 secs 2024-04-26T21:11:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:13 smithi196 ceph-mon[32572]: pgmap v18180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:13 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33787.520674 secs 2024-04-26T21:11:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:13 smithi110 ceph-mon[28069]: pgmap v18180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:13 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33787.520674 secs 2024-04-26T21:11:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:13 smithi193 ceph-mon[32782]: pgmap v18180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:15 smithi196 ceph-mon[32572]: pgmap v18181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:15.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:15 smithi110 ceph-mon[28069]: pgmap v18181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:15 smithi193 ceph-mon[32782]: pgmap v18181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:17 smithi196 ceph-mon[32572]: pgmap v18182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:17 smithi110 ceph-mon[28069]: pgmap v18182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:17 smithi193 ceph-mon[32782]: pgmap v18182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 987 B/s rd, 1 op/s 2024-04-26T21:11:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:18 smithi196 ceph-mon[32572]: 27 slow requests, 1 included below; oldest blocked for > 33792.520795 secs 2024-04-26T21:11:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:18 smithi196 ceph-mon[32572]: slow request 720.557327 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:11:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:18 smithi110 ceph-mon[28069]: 27 slow requests, 1 included below; oldest blocked for > 33792.520795 secs 2024-04-26T21:11:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:18 smithi110 ceph-mon[28069]: slow request 720.557327 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:11:18.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:18 smithi193 ceph-mon[32782]: 27 slow requests, 1 included below; oldest blocked for > 33792.520795 secs 2024-04-26T21:11:18.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:18 smithi193 ceph-mon[32782]: slow request 720.557327 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:11:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:19 smithi196 ceph-mon[32572]: pgmap v18183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:19 smithi110 ceph-mon[28069]: pgmap v18183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:19 smithi193 ceph-mon[32782]: pgmap v18183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:21 smithi196 ceph-mon[32572]: pgmap v18184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:21 smithi110 ceph-mon[28069]: pgmap v18184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:21 smithi193 ceph-mon[32782]: pgmap v18184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:23 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33797.520915 secs 2024-04-26T21:11:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:23 smithi196 ceph-mon[32572]: pgmap v18185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:23 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33797.520915 secs 2024-04-26T21:11:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:23 smithi110 ceph-mon[28069]: pgmap v18185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:23 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33797.520915 secs 2024-04-26T21:11:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:23 smithi193 ceph-mon[32782]: pgmap v18185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:25 smithi196 ceph-mon[32572]: pgmap v18186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:25 smithi110 ceph-mon[28069]: pgmap v18186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:25 smithi193 ceph-mon[32782]: pgmap v18186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:27 smithi196 ceph-mon[32572]: pgmap v18187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:27 smithi110 ceph-mon[28069]: pgmap v18187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:27 smithi193 ceph-mon[32782]: pgmap v18187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:28 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33802.521025 secs 2024-04-26T21:11:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:28 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33802.521025 secs 2024-04-26T21:11:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:28 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33802.521025 secs 2024-04-26T21:11:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:29 smithi196 ceph-mon[32572]: pgmap v18188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:29 smithi110 ceph-mon[28069]: pgmap v18188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:29 smithi193 ceph-mon[32782]: pgmap v18188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:31 smithi196 ceph-mon[32572]: pgmap v18189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:31 smithi110 ceph-mon[28069]: pgmap v18189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:31 smithi193 ceph-mon[32782]: pgmap v18189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:33 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33807.521147 secs 2024-04-26T21:11:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:33 smithi196 ceph-mon[32572]: pgmap v18190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:33 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33807.521147 secs 2024-04-26T21:11:33.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:33 smithi110 ceph-mon[28069]: pgmap v18190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:33 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33807.521147 secs 2024-04-26T21:11:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:33 smithi193 ceph-mon[32782]: pgmap v18190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:35 smithi196 ceph-mon[32572]: pgmap v18191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:35 smithi110 ceph-mon[28069]: pgmap v18191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:35 smithi193 ceph-mon[32782]: pgmap v18191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:37 smithi196 ceph-mon[32572]: pgmap v18192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:37 smithi110 ceph-mon[28069]: pgmap v18192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:37 smithi193 ceph-mon[32782]: pgmap v18192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:38 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33812.521245 secs 2024-04-26T21:11:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:38 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33812.521245 secs 2024-04-26T21:11:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:38 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33812.521245 secs 2024-04-26T21:11:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:39 smithi196 ceph-mon[32572]: pgmap v18193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:39.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:39 smithi193 ceph-mon[32782]: pgmap v18193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:39 smithi110 ceph-mon[28069]: pgmap v18193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:41 smithi196 ceph-mon[32572]: pgmap v18194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:41 smithi110 ceph-mon[28069]: pgmap v18194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:41 smithi193 ceph-mon[32782]: pgmap v18194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:43 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33817.521371 secs 2024-04-26T21:11:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:43 smithi110 ceph-mon[28069]: pgmap v18195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:43 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33817.521371 secs 2024-04-26T21:11:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:43 smithi193 ceph-mon[32782]: pgmap v18195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:43 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33817.521371 secs 2024-04-26T21:11:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:43 smithi196 ceph-mon[32572]: pgmap v18195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:45 smithi110 ceph-mon[28069]: pgmap v18196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:45 smithi193 ceph-mon[32782]: pgmap v18196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:45 smithi196 ceph-mon[32572]: pgmap v18196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:47 smithi110 ceph-mon[28069]: pgmap v18197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:47.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:47 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33822.521489 secs 2024-04-26T21:11:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:47 smithi193 ceph-mon[32782]: pgmap v18197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:47 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33822.521489 secs 2024-04-26T21:11:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:47 smithi196 ceph-mon[32572]: pgmap v18197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:47 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33822.521489 secs 2024-04-26T21:11:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:49 smithi110 ceph-mon[28069]: pgmap v18198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:49 smithi193 ceph-mon[32782]: pgmap v18198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:49 smithi196 ceph-mon[32572]: pgmap v18198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:51 smithi110 ceph-mon[28069]: pgmap v18199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:51 smithi193 ceph-mon[32782]: pgmap v18199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:51 smithi196 ceph-mon[32572]: pgmap v18199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:52 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33827.521605 secs 2024-04-26T21:11:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:52 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33827.521605 secs 2024-04-26T21:11:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:52 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33827.521605 secs 2024-04-26T21:11:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:53 smithi193 ceph-mon[32782]: pgmap v18200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:53 smithi196 ceph-mon[32572]: pgmap v18200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:53 smithi110 ceph-mon[28069]: pgmap v18200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:55 smithi193 ceph-mon[32782]: pgmap v18201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:55 smithi196 ceph-mon[32572]: pgmap v18201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:55 smithi110 ceph-mon[28069]: pgmap v18201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:57 smithi193 ceph-mon[32782]: pgmap v18202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:57 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33832.521704 secs 2024-04-26T21:11:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:57 smithi196 ceph-mon[32572]: pgmap v18202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:57.778 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:57 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33832.521704 secs 2024-04-26T21:11:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:57 smithi110 ceph-mon[28069]: pgmap v18202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:11:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:57 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33832.521704 secs 2024-04-26T21:11:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:11:59 smithi193 ceph-mon[32782]: pgmap v18203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:11:59 smithi196 ceph-mon[32572]: pgmap v18203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:11:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:11:59 smithi110 ceph-mon[28069]: pgmap v18203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:01 smithi193 ceph-mon[32782]: pgmap v18204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:01 smithi196 ceph-mon[32572]: pgmap v18204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:01 smithi110 ceph-mon[28069]: pgmap v18204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:02 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33837.521826 secs 2024-04-26T21:12:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:02 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33837.521826 secs 2024-04-26T21:12:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:02 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33837.521826 secs 2024-04-26T21:12:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:03 smithi193 ceph-mon[32782]: pgmap v18205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:03 smithi196 ceph-mon[32572]: pgmap v18205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:03 smithi110 ceph-mon[28069]: pgmap v18205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:05 smithi193 ceph-mon[32782]: pgmap v18206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:05 smithi196 ceph-mon[32572]: pgmap v18206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:05 smithi110 ceph-mon[28069]: pgmap v18206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:07.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:07 smithi110 ceph-mon[28069]: pgmap v18207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:07.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:07.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:07 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33842.521891 secs 2024-04-26T21:12:07.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.595 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:07 smithi193 ceph-mon[32782]: pgmap v18207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:07 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33842.521891 secs 2024-04-26T21:12:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:07 smithi196 ceph-mon[32572]: pgmap v18207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:07 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33842.521891 secs 2024-04-26T21:12:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:12:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:09 smithi193 ceph-mon[32782]: pgmap v18208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:12:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:09 smithi193 ceph-mon[32782]: pgmap v18209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:09 smithi196 ceph-mon[32572]: pgmap v18208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:12:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:09 smithi196 ceph-mon[32572]: pgmap v18209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:09 smithi110 ceph-mon[28069]: pgmap v18208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:12:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:09 smithi110 ceph-mon[28069]: pgmap v18209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:11 smithi193 ceph-mon[32782]: pgmap v18210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:11 smithi196 ceph-mon[32572]: pgmap v18210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:11 smithi110 ceph-mon[28069]: pgmap v18210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:12 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33847.522015 secs 2024-04-26T21:12:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:12 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33847.522015 secs 2024-04-26T21:12:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:12 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33847.522015 secs 2024-04-26T21:12:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:13 smithi193 ceph-mon[32782]: pgmap v18211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:13 smithi196 ceph-mon[32572]: pgmap v18211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:13 smithi110 ceph-mon[28069]: pgmap v18211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:15 smithi193 ceph-mon[32782]: pgmap v18212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:15 smithi196 ceph-mon[32572]: pgmap v18212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:15 smithi110 ceph-mon[28069]: pgmap v18212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:17 smithi193 ceph-mon[32782]: pgmap v18213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:17 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33852.522138 secs 2024-04-26T21:12:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:17 smithi196 ceph-mon[32572]: pgmap v18213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:17 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33852.522138 secs 2024-04-26T21:12:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:17 smithi110 ceph-mon[28069]: pgmap v18213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:12:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:17 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33852.522138 secs 2024-04-26T21:12:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:19 smithi193 ceph-mon[32782]: pgmap v18214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:12:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:19 smithi196 ceph-mon[32572]: pgmap v18214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:12:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:19 smithi110 ceph-mon[28069]: pgmap v18214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:12:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:21 smithi193 ceph-mon[32782]: pgmap v18215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:12:21.985+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:12:21.985+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:12:21.986+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 261 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:12:21.986+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 261 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:12:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:21 smithi196 ceph-mon[32572]: pgmap v18215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:21 smithi110 ceph-mon[28069]: pgmap v18215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:22 smithi193 ceph-mon[32782]: pgmap v18216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:22 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33857.522212 secs 2024-04-26T21:12:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:22 smithi196 ceph-mon[32572]: pgmap v18216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:22 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33857.522212 secs 2024-04-26T21:12:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:22 smithi110 ceph-mon[28069]: pgmap v18216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:22 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33857.522212 secs 2024-04-26T21:12:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:24 smithi110 ceph-mon[28069]: pgmap v18217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:24 smithi193 ceph-mon[32782]: pgmap v18217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:24 smithi196 ceph-mon[32572]: pgmap v18217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:26 smithi110 ceph-mon[28069]: pgmap v18218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:26 smithi193 ceph-mon[32782]: pgmap v18218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:26 smithi196 ceph-mon[32572]: pgmap v18218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:27 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33862.522347 secs 2024-04-26T21:12:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:27 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33862.522347 secs 2024-04-26T21:12:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:27 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33862.522347 secs 2024-04-26T21:12:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:28 smithi110 ceph-mon[28069]: pgmap v18219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:28 smithi193 ceph-mon[32782]: pgmap v18219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:28 smithi196 ceph-mon[32572]: pgmap v18219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:30 smithi110 ceph-mon[28069]: pgmap v18220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:31.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:30 smithi196 ceph-mon[32572]: pgmap v18220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:30 smithi193 ceph-mon[32782]: pgmap v18220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:32 smithi110 ceph-mon[28069]: pgmap v18221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:32 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33867.522447 secs 2024-04-26T21:12:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:32 smithi193 ceph-mon[32782]: pgmap v18221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:32 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33867.522447 secs 2024-04-26T21:12:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:32 smithi196 ceph-mon[32572]: pgmap v18221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:32 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33867.522447 secs 2024-04-26T21:12:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:34 smithi193 ceph-mon[32782]: pgmap v18222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:34 smithi196 ceph-mon[32572]: pgmap v18222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:34 smithi110 ceph-mon[28069]: pgmap v18222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:37.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:36 smithi110 ceph-mon[28069]: pgmap v18223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:36 smithi193 ceph-mon[32782]: pgmap v18223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:36 smithi196 ceph-mon[32572]: pgmap v18223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:37 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33872.522588 secs 2024-04-26T21:12:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:37 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33872.522588 secs 2024-04-26T21:12:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:37 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33872.522588 secs 2024-04-26T21:12:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:38 smithi193 ceph-mon[32782]: pgmap v18224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:39.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:38 smithi196 ceph-mon[32572]: pgmap v18224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:38 smithi110 ceph-mon[28069]: pgmap v18224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:40 smithi193 ceph-mon[32782]: pgmap v18225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:40 smithi196 ceph-mon[32572]: pgmap v18225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:40 smithi110 ceph-mon[28069]: pgmap v18225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:42 smithi193 ceph-mon[32782]: pgmap v18226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:42 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33877.522657 secs 2024-04-26T21:12:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:42 smithi196 ceph-mon[32572]: pgmap v18226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:42 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33877.522657 secs 2024-04-26T21:12:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:42 smithi110 ceph-mon[28069]: pgmap v18226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:42 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33877.522657 secs 2024-04-26T21:12:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:44 smithi193 ceph-mon[32782]: pgmap v18227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:44 smithi196 ceph-mon[32572]: pgmap v18227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:44 smithi110 ceph-mon[28069]: pgmap v18227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:46 smithi193 ceph-mon[32782]: pgmap v18228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:12:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:46 smithi196 ceph-mon[32572]: pgmap v18228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:12:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:46 smithi110 ceph-mon[28069]: pgmap v18228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:12:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:47 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33882.522770 secs 2024-04-26T21:12:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:47 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33882.522770 secs 2024-04-26T21:12:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:47 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33882.522770 secs 2024-04-26T21:12:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:48 smithi193 ceph-mon[32782]: pgmap v18229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:48 smithi196 ceph-mon[32572]: pgmap v18229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:49.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:48 smithi110 ceph-mon[28069]: pgmap v18229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:50 smithi193 ceph-mon[32782]: pgmap v18230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:12:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:50 smithi196 ceph-mon[32572]: pgmap v18230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:12:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:50 smithi110 ceph-mon[28069]: pgmap v18230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:12:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:52 smithi193 ceph-mon[32782]: pgmap v18231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:12:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:52 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33887.522880 secs 2024-04-26T21:12:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:52 smithi196 ceph-mon[32572]: pgmap v18231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:12:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:52 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33887.522880 secs 2024-04-26T21:12:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:52 smithi110 ceph-mon[28069]: pgmap v18231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:12:53.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:52 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33887.522880 secs 2024-04-26T21:12:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:54 smithi193 ceph-mon[32782]: pgmap v18232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:54 smithi196 ceph-mon[32572]: pgmap v18232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:54 smithi110 ceph-mon[28069]: pgmap v18232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:56 smithi193 ceph-mon[32782]: pgmap v18233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:56 smithi196 ceph-mon[32572]: pgmap v18233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:56 smithi110 ceph-mon[28069]: pgmap v18233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:12:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:57 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33892.522997 secs 2024-04-26T21:12:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:57 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33892.522997 secs 2024-04-26T21:12:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:57 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33892.522997 secs 2024-04-26T21:12:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:12:58 smithi196 ceph-mon[32572]: pgmap v18234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:12:58 smithi110 ceph-mon[28069]: pgmap v18234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:12:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:12:58 smithi193 ceph-mon[32782]: pgmap v18234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:00 smithi196 ceph-mon[32572]: pgmap v18235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:00 smithi110 ceph-mon[28069]: pgmap v18235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:00 smithi193 ceph-mon[32782]: pgmap v18235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:02 smithi196 ceph-mon[32572]: pgmap v18236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:02 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33897.523116 secs 2024-04-26T21:13:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:02 smithi110 ceph-mon[28069]: pgmap v18236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:02 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33897.523116 secs 2024-04-26T21:13:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:02 smithi193 ceph-mon[32782]: pgmap v18236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:02 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33897.523116 secs 2024-04-26T21:13:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:04 smithi196 ceph-mon[32572]: pgmap v18237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:04 smithi110 ceph-mon[28069]: pgmap v18237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:05.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:04 smithi193 ceph-mon[32782]: pgmap v18237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:06 smithi196 ceph-mon[32572]: pgmap v18238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:06 smithi110 ceph-mon[28069]: pgmap v18238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:07.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:06 smithi193 ceph-mon[32782]: pgmap v18238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:07 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33902.523232 secs 2024-04-26T21:13:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:07 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33902.523232 secs 2024-04-26T21:13:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:07 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33902.523232 secs 2024-04-26T21:13:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:08 smithi193 ceph-mon[32782]: pgmap v18239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:08 smithi196 ceph-mon[32572]: pgmap v18239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:09.265 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:08 smithi110 ceph-mon[28069]: pgmap v18239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:09.265 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: pgmap v18240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:11 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: pgmap v18240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.544 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:11 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: pgmap v18240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:11.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:11 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:12 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:13:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:12 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:13:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:12 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:13:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:12 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:13:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:12.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:12 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:13:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:12 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:13:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:12 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:13:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:12 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:13:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:12.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:12 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:13:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:12 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:13:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:12 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:13:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:12 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:13:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:13 smithi196 ceph-mon[32572]: pgmap v18241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:13 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33907.523365 secs 2024-04-26T21:13:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:13 smithi110 ceph-mon[28069]: pgmap v18241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:13 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33907.523365 secs 2024-04-26T21:13:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:13 smithi193 ceph-mon[32782]: pgmap v18241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:13 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33907.523365 secs 2024-04-26T21:13:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:13:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:13:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: pgmap v18242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:13:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: pgmap v18243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:14.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:13:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:13:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: pgmap v18242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:13:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: pgmap v18243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:14.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:13:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:13:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: pgmap v18242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:13:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: pgmap v18243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:14.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:13:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:16 smithi193 ceph-mon[32782]: pgmap v18244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:16 smithi196 ceph-mon[32572]: pgmap v18244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:16.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:16 smithi110 ceph-mon[28069]: pgmap v18244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:17 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33912.523482 secs 2024-04-26T21:13:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:17 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33912.523482 secs 2024-04-26T21:13:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:17 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33912.523482 secs 2024-04-26T21:13:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:18 smithi193 ceph-mon[32782]: pgmap v18245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T21:13:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:18 smithi196 ceph-mon[32572]: pgmap v18245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T21:13:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:18 smithi110 ceph-mon[28069]: pgmap v18245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 535 B/s rd, 1 op/s 2024-04-26T21:13:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:20 smithi193 ceph-mon[32782]: pgmap v18246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:20 smithi196 ceph-mon[32572]: pgmap v18246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:20 smithi110 ceph-mon[28069]: pgmap v18246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:22 smithi193 ceph-mon[32782]: pgmap v18247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:22 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33917.523557 secs 2024-04-26T21:13:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:22 smithi196 ceph-mon[32572]: pgmap v18247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:22 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33917.523557 secs 2024-04-26T21:13:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:22 smithi110 ceph-mon[28069]: pgmap v18247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:13:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:22 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33917.523557 secs 2024-04-26T21:13:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:24 smithi193 ceph-mon[32782]: pgmap v18248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:13:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:24 smithi196 ceph-mon[32572]: pgmap v18248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:13:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:24 smithi110 ceph-mon[28069]: pgmap v18248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:13:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:26 smithi196 ceph-mon[32572]: pgmap v18249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:26 smithi110 ceph-mon[28069]: pgmap v18249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:26 smithi193 ceph-mon[32782]: pgmap v18249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:27 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33922.523673 secs 2024-04-26T21:13:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:27 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33922.523673 secs 2024-04-26T21:13:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:27 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33922.523673 secs 2024-04-26T21:13:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:28 smithi196 ceph-mon[32572]: pgmap v18250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:28.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:28 smithi110 ceph-mon[28069]: pgmap v18250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:28 smithi193 ceph-mon[32782]: pgmap v18250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:30.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:30 smithi196 ceph-mon[32572]: pgmap v18251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:30 smithi110 ceph-mon[28069]: pgmap v18251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:30 smithi193 ceph-mon[32782]: pgmap v18251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:32 smithi196 ceph-mon[32572]: pgmap v18252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:32 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33927.523750 secs 2024-04-26T21:13:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:32 smithi110 ceph-mon[28069]: pgmap v18252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:32 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33927.523750 secs 2024-04-26T21:13:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:32 smithi193 ceph-mon[32782]: pgmap v18252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:32 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33927.523750 secs 2024-04-26T21:13:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:34 smithi196 ceph-mon[32572]: pgmap v18253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:34 smithi110 ceph-mon[28069]: pgmap v18253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:34 smithi193 ceph-mon[32782]: pgmap v18253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:36 smithi196 ceph-mon[32572]: pgmap v18254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:36 smithi110 ceph-mon[28069]: pgmap v18254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:36 smithi193 ceph-mon[32782]: pgmap v18254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:37.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:37 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33932.523871 secs 2024-04-26T21:13:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:37 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33932.523871 secs 2024-04-26T21:13:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:37 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33932.523871 secs 2024-04-26T21:13:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:38 smithi196 ceph-mon[32572]: pgmap v18255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:38 smithi110 ceph-mon[28069]: pgmap v18255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:38 smithi193 ceph-mon[32782]: pgmap v18255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:40.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:40 smithi193 ceph-mon[32782]: pgmap v18256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:40 smithi196 ceph-mon[32572]: pgmap v18256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:40 smithi110 ceph-mon[28069]: pgmap v18256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:42 smithi196 ceph-mon[32572]: pgmap v18257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:42 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33937.524005 secs 2024-04-26T21:13:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:42 smithi110 ceph-mon[28069]: pgmap v18257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:42 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33937.524005 secs 2024-04-26T21:13:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:42 smithi193 ceph-mon[32782]: pgmap v18257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:42 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33937.524005 secs 2024-04-26T21:13:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:44 smithi196 ceph-mon[32572]: pgmap v18258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:44 smithi110 ceph-mon[28069]: pgmap v18258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:44 smithi193 ceph-mon[32782]: pgmap v18258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:46 smithi196 ceph-mon[32572]: pgmap v18259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:46 smithi110 ceph-mon[28069]: pgmap v18259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:46 smithi193 ceph-mon[32782]: pgmap v18259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:47 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33942.524141 secs 2024-04-26T21:13:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:47 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33942.524141 secs 2024-04-26T21:13:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:47 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33942.524141 secs 2024-04-26T21:13:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:48 smithi196 ceph-mon[32572]: pgmap v18260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:48 smithi110 ceph-mon[28069]: pgmap v18260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:48 smithi193 ceph-mon[32782]: pgmap v18260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:50 smithi196 ceph-mon[32572]: pgmap v18261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:50 smithi110 ceph-mon[28069]: pgmap v18261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:50 smithi193 ceph-mon[32782]: pgmap v18261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:52 smithi196 ceph-mon[32572]: pgmap v18262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:52 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33947.524278 secs 2024-04-26T21:13:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:52 smithi110 ceph-mon[28069]: pgmap v18262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:52 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33947.524278 secs 2024-04-26T21:13:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:52 smithi193 ceph-mon[32782]: pgmap v18262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:52 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33947.524278 secs 2024-04-26T21:13:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:54 smithi196 ceph-mon[32572]: pgmap v18263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:54 smithi110 ceph-mon[28069]: pgmap v18263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:54 smithi193 ceph-mon[32782]: pgmap v18263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:13:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:56 smithi196 ceph-mon[32572]: pgmap v18264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:56 smithi110 ceph-mon[28069]: pgmap v18264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:56 smithi193 ceph-mon[32782]: pgmap v18264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:57 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33952.524389 secs 2024-04-26T21:13:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:57 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33952.524389 secs 2024-04-26T21:13:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:57 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33952.524389 secs 2024-04-26T21:13:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:13:58 smithi196 ceph-mon[32572]: pgmap v18265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:13:58 smithi110 ceph-mon[28069]: pgmap v18265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:13:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:13:58 smithi193 ceph-mon[32782]: pgmap v18265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:00 smithi196 ceph-mon[32572]: pgmap v18266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:00 smithi110 ceph-mon[28069]: pgmap v18266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:00 smithi193 ceph-mon[32782]: pgmap v18266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:02 smithi196 ceph-mon[32572]: pgmap v18267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:02 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33957.524507 secs 2024-04-26T21:14:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:02 smithi110 ceph-mon[28069]: pgmap v18267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:02 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33957.524507 secs 2024-04-26T21:14:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:02 smithi193 ceph-mon[32782]: pgmap v18267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:02 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33957.524507 secs 2024-04-26T21:14:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:04 smithi196 ceph-mon[32572]: pgmap v18268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:04 smithi110 ceph-mon[28069]: pgmap v18268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:04 smithi193 ceph-mon[32782]: pgmap v18268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:06 smithi110 ceph-mon[28069]: pgmap v18269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:06 smithi193 ceph-mon[32782]: pgmap v18269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:06 smithi196 ceph-mon[32572]: pgmap v18269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:07 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33962.524641 secs 2024-04-26T21:14:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:07 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33962.524641 secs 2024-04-26T21:14:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:07 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33962.524641 secs 2024-04-26T21:14:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:08 smithi110 ceph-mon[28069]: pgmap v18270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:08 smithi193 ceph-mon[32782]: pgmap v18270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:08 smithi196 ceph-mon[32572]: pgmap v18270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:10 smithi110 ceph-mon[28069]: pgmap v18271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:10 smithi193 ceph-mon[32782]: pgmap v18271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:10 smithi196 ceph-mon[32572]: pgmap v18271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:12 smithi193 ceph-mon[32782]: pgmap v18272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:12 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33967.524731 secs 2024-04-26T21:14:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:12 smithi196 ceph-mon[32572]: pgmap v18272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:12 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33967.524731 secs 2024-04-26T21:14:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:12 smithi110 ceph-mon[28069]: pgmap v18272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:12 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33967.524731 secs 2024-04-26T21:14:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:14 smithi193 ceph-mon[32782]: pgmap v18273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:14 smithi196 ceph-mon[32572]: pgmap v18273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:14 smithi110 ceph-mon[28069]: pgmap v18273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:14:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:14:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:14:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:14:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:14:16.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:14:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:16 smithi193 ceph-mon[32782]: pgmap v18274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T21:14:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:16 smithi193 ceph-mon[32782]: pgmap v18275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:14:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:16 smithi196 ceph-mon[32572]: pgmap v18274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T21:14:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:16 smithi196 ceph-mon[32572]: pgmap v18275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:14:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:16 smithi110 ceph-mon[28069]: pgmap v18274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T21:14:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:16 smithi110 ceph-mon[28069]: pgmap v18275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:14:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:14:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:14:16.781+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:14:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:14:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:14:16.781+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:14:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:14:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:14:16.781+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:14:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:14:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:14:16.781+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:14:17.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:14:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:14:16.781+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:14:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:17 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33972.524841 secs 2024-04-26T21:14:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:17 smithi193 ceph-mon[32782]: pgmap v18276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:14:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:17 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33972.524841 secs 2024-04-26T21:14:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:17 smithi196 ceph-mon[32572]: pgmap v18276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:14:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:17 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33972.524841 secs 2024-04-26T21:14:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:17 smithi110 ceph-mon[28069]: pgmap v18276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:14:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:19 smithi196 ceph-mon[32572]: pgmap v18277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T21:14:20.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:19 smithi110 ceph-mon[28069]: pgmap v18277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T21:14:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:19 smithi193 ceph-mon[32782]: pgmap v18277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T21:14:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:21 smithi196 ceph-mon[32572]: pgmap v18278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T21:14:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:21 smithi110 ceph-mon[28069]: pgmap v18278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T21:14:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:21 smithi193 ceph-mon[32782]: pgmap v18278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T21:14:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:22 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33977.524978 secs 2024-04-26T21:14:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:22 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33977.524978 secs 2024-04-26T21:14:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:22 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33977.524978 secs 2024-04-26T21:14:24.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:23 smithi196 ceph-mon[32572]: pgmap v18279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T21:14:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:23 smithi110 ceph-mon[28069]: pgmap v18279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T21:14:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:23 smithi193 ceph-mon[32782]: pgmap v18279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T21:14:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:25 smithi196 ceph-mon[32572]: pgmap v18280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T21:14:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:25 smithi110 ceph-mon[28069]: pgmap v18280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T21:14:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:25 smithi193 ceph-mon[32782]: pgmap v18280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 204 B/s wr, 15 op/s 2024-04-26T21:14:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:27 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33982.525117 secs 2024-04-26T21:14:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:27 smithi196 ceph-mon[32572]: pgmap v18281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:14:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:27 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33982.525117 secs 2024-04-26T21:14:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:27 smithi110 ceph-mon[28069]: pgmap v18281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:14:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:27 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33982.525117 secs 2024-04-26T21:14:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:27 smithi193 ceph-mon[32782]: pgmap v18281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:14:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:29 smithi196 ceph-mon[32572]: pgmap v18282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:14:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:29 smithi110 ceph-mon[28069]: pgmap v18282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:14:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:29 smithi193 ceph-mon[32782]: pgmap v18282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:14:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:31 smithi196 ceph-mon[32572]: pgmap v18283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:14:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:31 smithi110 ceph-mon[28069]: pgmap v18283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:14:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:31 smithi193 ceph-mon[32782]: pgmap v18283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:14:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:32 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33987.525230 secs 2024-04-26T21:14:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:32 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33987.525230 secs 2024-04-26T21:14:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:32 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33987.525230 secs 2024-04-26T21:14:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:33 smithi196 ceph-mon[32572]: pgmap v18284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:14:34.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:33 smithi110 ceph-mon[28069]: pgmap v18284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:14:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:33 smithi193 ceph-mon[32782]: pgmap v18284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:14:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:35 smithi196 ceph-mon[32572]: pgmap v18285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:35 smithi110 ceph-mon[28069]: pgmap v18285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:35 smithi193 ceph-mon[32782]: pgmap v18285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:37 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33992.525349 secs 2024-04-26T21:14:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:37 smithi196 ceph-mon[32572]: pgmap v18286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:37 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33992.525349 secs 2024-04-26T21:14:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:37 smithi110 ceph-mon[28069]: pgmap v18286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:38.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:37 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33992.525349 secs 2024-04-26T21:14:38.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:37 smithi193 ceph-mon[32782]: pgmap v18286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:39 smithi196 ceph-mon[32572]: pgmap v18287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:39 smithi110 ceph-mon[28069]: pgmap v18287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:39 smithi193 ceph-mon[32782]: pgmap v18287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:41 smithi196 ceph-mon[32572]: pgmap v18288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:41 smithi110 ceph-mon[28069]: pgmap v18288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:42.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:41 smithi193 ceph-mon[32782]: pgmap v18288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:42 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 33997.525446 secs 2024-04-26T21:14:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:42 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 33997.525446 secs 2024-04-26T21:14:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:42 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 33997.525446 secs 2024-04-26T21:14:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:43 smithi196 ceph-mon[32572]: pgmap v18289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:43 smithi110 ceph-mon[28069]: pgmap v18289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:43 smithi193 ceph-mon[32782]: pgmap v18289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:45 smithi196 ceph-mon[32572]: pgmap v18290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:45 smithi110 ceph-mon[28069]: pgmap v18290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:45 smithi193 ceph-mon[32782]: pgmap v18290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:48 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34002.525532 secs 2024-04-26T21:14:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:48 smithi196 ceph-mon[32572]: pgmap v18291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:48 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34002.525532 secs 2024-04-26T21:14:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:48 smithi110 ceph-mon[28069]: pgmap v18291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:48 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34002.525532 secs 2024-04-26T21:14:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:48 smithi193 ceph-mon[32782]: pgmap v18291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:50 smithi110 ceph-mon[28069]: pgmap v18292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:50 smithi193 ceph-mon[32782]: pgmap v18292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:50 smithi196 ceph-mon[32572]: pgmap v18292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:52 smithi110 ceph-mon[28069]: pgmap v18293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:52.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:52 smithi193 ceph-mon[32782]: pgmap v18293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:52 smithi196 ceph-mon[32572]: pgmap v18293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:53 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34007.525643 secs 2024-04-26T21:14:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:53 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34007.525643 secs 2024-04-26T21:14:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:53 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34007.525643 secs 2024-04-26T21:14:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:54 smithi110 ceph-mon[28069]: pgmap v18294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:54 smithi193 ceph-mon[32782]: pgmap v18294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:54 smithi196 ceph-mon[32572]: pgmap v18294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:14:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:56 smithi110 ceph-mon[28069]: pgmap v18295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:56 smithi193 ceph-mon[32782]: pgmap v18295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:56 smithi196 ceph-mon[32572]: pgmap v18295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:58 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34012.525779 secs 2024-04-26T21:14:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:14:58 smithi110 ceph-mon[28069]: pgmap v18296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:58 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34012.525779 secs 2024-04-26T21:14:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:14:58 smithi193 ceph-mon[32782]: pgmap v18296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:14:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:58 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34012.525779 secs 2024-04-26T21:14:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:14:58 smithi196 ceph-mon[32572]: pgmap v18296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:00 smithi110 ceph-mon[28069]: pgmap v18297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:00 smithi193 ceph-mon[32782]: pgmap v18297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:00 smithi196 ceph-mon[32572]: pgmap v18297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:02.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:02 smithi196 ceph-mon[32572]: pgmap v18298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:02 smithi193 ceph-mon[32782]: pgmap v18298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:02 smithi110 ceph-mon[28069]: pgmap v18298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:03 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34017.525890 secs 2024-04-26T21:15:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:03 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34017.525890 secs 2024-04-26T21:15:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:03 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34017.525890 secs 2024-04-26T21:15:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:04 smithi193 ceph-mon[32782]: pgmap v18299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:15:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:04 smithi196 ceph-mon[32572]: pgmap v18299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:15:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:04 smithi110 ceph-mon[28069]: pgmap v18299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:15:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:06 smithi193 ceph-mon[32782]: pgmap v18300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:15:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:06 smithi196 ceph-mon[32572]: pgmap v18300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:15:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:06 smithi110 ceph-mon[28069]: pgmap v18300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:15:08.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:08 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34022.526023 secs 2024-04-26T21:15:08.345 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:08 smithi110 ceph-mon[28069]: pgmap v18301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:15:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:08 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34022.526023 secs 2024-04-26T21:15:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:08 smithi193 ceph-mon[32782]: pgmap v18301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:15:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:08 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34022.526023 secs 2024-04-26T21:15:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:08 smithi196 ceph-mon[32572]: pgmap v18301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:15:10.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:10 smithi193 ceph-mon[32782]: pgmap v18302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:15:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:10 smithi196 ceph-mon[32572]: pgmap v18302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:15:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:10 smithi110 ceph-mon[28069]: pgmap v18302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:15:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:12 smithi193 ceph-mon[32782]: pgmap v18303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:15:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:12 smithi196 ceph-mon[32572]: pgmap v18303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:15:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:12 smithi110 ceph-mon[28069]: pgmap v18303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:15:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:13 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34027.526153 secs 2024-04-26T21:15:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:13 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34027.526153 secs 2024-04-26T21:15:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:13 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34027.526153 secs 2024-04-26T21:15:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:14 smithi193 ceph-mon[32782]: pgmap v18304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:15:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:14 smithi196 ceph-mon[32572]: pgmap v18304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:15:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:14 smithi110 ceph-mon[28069]: pgmap v18304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:15:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:16 smithi193 ceph-mon[32782]: pgmap v18305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:16 smithi196 ceph-mon[32572]: pgmap v18305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:16 smithi110 ceph-mon[28069]: pgmap v18305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:17 smithi193 ceph-mon[32782]: pgmap v18306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T21:15:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:17 smithi193 ceph-mon[32782]: pgmap v18307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:15:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:17 smithi196 ceph-mon[32572]: pgmap v18306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T21:15:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:17 smithi196 ceph-mon[32572]: pgmap v18307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:15:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:17 smithi110 ceph-mon[28069]: pgmap v18306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T21:15:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:17 smithi110 ceph-mon[28069]: pgmap v18307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:17.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:15:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:18 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34032.526307 secs 2024-04-26T21:15:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:18 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34032.526307 secs 2024-04-26T21:15:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:18 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34032.526307 secs 2024-04-26T21:15:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:19 smithi193 ceph-mon[32782]: pgmap v18308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:19 smithi196 ceph-mon[32572]: pgmap v18308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:19 smithi110 ceph-mon[28069]: pgmap v18308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:21 smithi196 ceph-mon[32572]: pgmap v18309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:21 smithi110 ceph-mon[28069]: pgmap v18309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:21 smithi193 ceph-mon[32782]: pgmap v18309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:15:22.015+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:15:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:15:22.015+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:15:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:15:22.016+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 262 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:15:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:15:22.016+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 262 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:15:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:22 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34037.526448 secs 2024-04-26T21:15:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:22 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34037.526448 secs 2024-04-26T21:15:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:22 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34037.526448 secs 2024-04-26T21:15:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:23 smithi110 ceph-mon[28069]: pgmap v18310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:23 smithi193 ceph-mon[32782]: pgmap v18310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:23 smithi196 ceph-mon[32572]: pgmap v18310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:25 smithi110 ceph-mon[28069]: pgmap v18311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:25 smithi193 ceph-mon[32782]: pgmap v18311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:25 smithi196 ceph-mon[32572]: pgmap v18311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:27 smithi110 ceph-mon[28069]: pgmap v18312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:27 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34042.526584 secs 2024-04-26T21:15:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:27 smithi193 ceph-mon[32782]: pgmap v18312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:15:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:27 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34042.526584 secs 2024-04-26T21:15:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:27 smithi196 ceph-mon[32572]: pgmap v18312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:15:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:27 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34042.526584 secs 2024-04-26T21:15:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:29 smithi110 ceph-mon[28069]: pgmap v18313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:29 smithi193 ceph-mon[32782]: pgmap v18313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:29 smithi196 ceph-mon[32572]: pgmap v18313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:31 smithi110 ceph-mon[28069]: pgmap v18314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:31 smithi193 ceph-mon[32782]: pgmap v18314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:31 smithi196 ceph-mon[32572]: pgmap v18314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:32 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34047.526647 secs 2024-04-26T21:15:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:32 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34047.526647 secs 2024-04-26T21:15:32.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:32 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34047.526647 secs 2024-04-26T21:15:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:33 smithi110 ceph-mon[28069]: pgmap v18315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:33 smithi193 ceph-mon[32782]: pgmap v18315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:33 smithi196 ceph-mon[32572]: pgmap v18315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:35 smithi193 ceph-mon[32782]: pgmap v18316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:35 smithi196 ceph-mon[32572]: pgmap v18316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:35 smithi110 ceph-mon[28069]: pgmap v18316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:37 smithi193 ceph-mon[32782]: pgmap v18317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:37 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34052.526708 secs 2024-04-26T21:15:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:37 smithi196 ceph-mon[32572]: pgmap v18317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:37 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34052.526708 secs 2024-04-26T21:15:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:37 smithi110 ceph-mon[28069]: pgmap v18317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:37 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34052.526708 secs 2024-04-26T21:15:39.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:39 smithi110 ceph-mon[28069]: pgmap v18318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:39 smithi193 ceph-mon[32782]: pgmap v18318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:39 smithi196 ceph-mon[32572]: pgmap v18318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:41 smithi193 ceph-mon[32782]: pgmap v18319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:41 smithi196 ceph-mon[32572]: pgmap v18319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:41 smithi110 ceph-mon[28069]: pgmap v18319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:42 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34057.526771 secs 2024-04-26T21:15:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:42 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34057.526771 secs 2024-04-26T21:15:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:42 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34057.526771 secs 2024-04-26T21:15:43.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:43 smithi193 ceph-mon[32782]: pgmap v18320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:43 smithi196 ceph-mon[32572]: pgmap v18320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:43 smithi110 ceph-mon[28069]: pgmap v18320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:45 smithi193 ceph-mon[32782]: pgmap v18321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:45 smithi196 ceph-mon[32572]: pgmap v18321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:45 smithi110 ceph-mon[28069]: pgmap v18321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:47 smithi193 ceph-mon[32782]: pgmap v18322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:47 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34062.526870 secs 2024-04-26T21:15:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:47 smithi196 ceph-mon[32572]: pgmap v18322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:47 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34062.526870 secs 2024-04-26T21:15:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:47 smithi110 ceph-mon[28069]: pgmap v18322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:47 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34062.526870 secs 2024-04-26T21:15:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:49 smithi193 ceph-mon[32782]: pgmap v18323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:49 smithi196 ceph-mon[32572]: pgmap v18323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:49 smithi110 ceph-mon[28069]: pgmap v18323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:51 smithi193 ceph-mon[32782]: pgmap v18324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:51 smithi196 ceph-mon[32572]: pgmap v18324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:51 smithi110 ceph-mon[28069]: pgmap v18324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:52 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34067.526995 secs 2024-04-26T21:15:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:52 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34067.526995 secs 2024-04-26T21:15:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:52 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34067.526995 secs 2024-04-26T21:15:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:53 smithi193 ceph-mon[32782]: pgmap v18325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:53 smithi196 ceph-mon[32572]: pgmap v18325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:53 smithi110 ceph-mon[28069]: pgmap v18325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:15:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:55 smithi193 ceph-mon[32782]: pgmap v18326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:55 smithi196 ceph-mon[32572]: pgmap v18326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:55 smithi110 ceph-mon[28069]: pgmap v18326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:57 smithi193 ceph-mon[32782]: pgmap v18327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:57 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34072.527113 secs 2024-04-26T21:15:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:57 smithi196 ceph-mon[32572]: pgmap v18327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:57 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34072.527113 secs 2024-04-26T21:15:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:57 smithi110 ceph-mon[28069]: pgmap v18327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:15:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:57 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34072.527113 secs 2024-04-26T21:15:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:15:59 smithi193 ceph-mon[32782]: pgmap v18328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:15:59 smithi196 ceph-mon[32572]: pgmap v18328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:15:59 smithi110 ceph-mon[28069]: pgmap v18328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:01 smithi196 ceph-mon[32572]: pgmap v18329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:01 smithi110 ceph-mon[28069]: pgmap v18329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:01 smithi193 ceph-mon[32782]: pgmap v18329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:02.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:02 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34077.527223 secs 2024-04-26T21:16:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:02 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34077.527223 secs 2024-04-26T21:16:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:02 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34077.527223 secs 2024-04-26T21:16:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:03 smithi196 ceph-mon[32572]: pgmap v18330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:03 smithi110 ceph-mon[28069]: pgmap v18330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:03 smithi193 ceph-mon[32782]: pgmap v18330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:04 smithi196 ceph-mon[32572]: pgmap v18331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:04 smithi110 ceph-mon[28069]: pgmap v18331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:04 smithi193 ceph-mon[32782]: pgmap v18331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:07 smithi110 ceph-mon[28069]: pgmap v18332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:07 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34082.527359 secs 2024-04-26T21:16:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:07 smithi193 ceph-mon[32782]: pgmap v18332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:07 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34082.527359 secs 2024-04-26T21:16:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:07 smithi196 ceph-mon[32572]: pgmap v18332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:07 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34082.527359 secs 2024-04-26T21:16:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:09 smithi110 ceph-mon[28069]: pgmap v18333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:09 smithi193 ceph-mon[32782]: pgmap v18333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:09 smithi196 ceph-mon[32572]: pgmap v18333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:11 smithi110 ceph-mon[28069]: pgmap v18334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:11 smithi193 ceph-mon[32782]: pgmap v18334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:11 smithi196 ceph-mon[32572]: pgmap v18334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:12 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34087.527477 secs 2024-04-26T21:16:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:12 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34087.527477 secs 2024-04-26T21:16:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:12 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34087.527477 secs 2024-04-26T21:16:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:13 smithi110 ceph-mon[28069]: pgmap v18335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:13 smithi193 ceph-mon[32782]: pgmap v18335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:13 smithi196 ceph-mon[32572]: pgmap v18335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:15 smithi193 ceph-mon[32782]: pgmap v18336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:15 smithi196 ceph-mon[32572]: pgmap v18336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:15 smithi110 ceph-mon[28069]: pgmap v18336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:17 smithi193 ceph-mon[32782]: pgmap v18337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:17 smithi193 ceph-mon[32782]: 27 slow requests, 1 included below; oldest blocked for > 34092.527583 secs 2024-04-26T21:16:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:17 smithi193 ceph-mon[32782]: slow request 720.335619 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:16:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:17 smithi196 ceph-mon[32572]: pgmap v18337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:17 smithi196 ceph-mon[32572]: 27 slow requests, 1 included below; oldest blocked for > 34092.527583 secs 2024-04-26T21:16:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:17 smithi196 ceph-mon[32572]: slow request 720.335619 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:16:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:17 smithi110 ceph-mon[28069]: pgmap v18337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:17 smithi110 ceph-mon[28069]: 27 slow requests, 1 included below; oldest blocked for > 34092.527583 secs 2024-04-26T21:16:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:17 smithi110 ceph-mon[28069]: slow request 720.335619 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:16:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:16:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:16:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:16:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:19 smithi193 ceph-mon[32782]: pgmap v18338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:16:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:19 smithi196 ceph-mon[32572]: pgmap v18338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:16:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:19 smithi110 ceph-mon[28069]: pgmap v18338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:16:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:21 smithi193 ceph-mon[32782]: pgmap v18339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:21 smithi196 ceph-mon[32572]: pgmap v18339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:21 smithi110 ceph-mon[28069]: pgmap v18339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:22 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34097.527701 secs 2024-04-26T21:16:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:22 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34097.527701 secs 2024-04-26T21:16:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:22 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34097.527701 secs 2024-04-26T21:16:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:23 smithi193 ceph-mon[32782]: pgmap v18340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:23 smithi196 ceph-mon[32572]: pgmap v18340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:23 smithi110 ceph-mon[28069]: pgmap v18340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:25 smithi193 ceph-mon[32782]: pgmap v18341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:25 smithi196 ceph-mon[32572]: pgmap v18341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:26.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:25 smithi110 ceph-mon[28069]: pgmap v18341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:27 smithi193 ceph-mon[32782]: pgmap v18342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:27 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34102.527819 secs 2024-04-26T21:16:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:27 smithi196 ceph-mon[32572]: pgmap v18342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:27 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34102.527819 secs 2024-04-26T21:16:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:27 smithi110 ceph-mon[28069]: pgmap v18342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:16:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:27 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34102.527819 secs 2024-04-26T21:16:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:29 smithi193 ceph-mon[32782]: pgmap v18343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:16:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:29 smithi196 ceph-mon[32572]: pgmap v18343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:16:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:29 smithi110 ceph-mon[28069]: pgmap v18343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:16:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:31 smithi193 ceph-mon[32782]: pgmap v18344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:31 smithi196 ceph-mon[32572]: pgmap v18344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:31 smithi110 ceph-mon[28069]: pgmap v18344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:32 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34107.527938 secs 2024-04-26T21:16:32.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:32 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34107.527938 secs 2024-04-26T21:16:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:32 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34107.527938 secs 2024-04-26T21:16:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:33 smithi193 ceph-mon[32782]: pgmap v18345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:33 smithi196 ceph-mon[32572]: pgmap v18345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:33 smithi110 ceph-mon[28069]: pgmap v18345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:35 smithi193 ceph-mon[32782]: pgmap v18346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:35 smithi196 ceph-mon[32572]: pgmap v18346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:35 smithi110 ceph-mon[28069]: pgmap v18346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:37 smithi193 ceph-mon[32782]: pgmap v18347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:37 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34112.528065 secs 2024-04-26T21:16:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:37 smithi196 ceph-mon[32572]: pgmap v18347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:37 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34112.528065 secs 2024-04-26T21:16:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:37 smithi110 ceph-mon[28069]: pgmap v18347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:37 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34112.528065 secs 2024-04-26T21:16:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:39 smithi196 ceph-mon[32572]: pgmap v18348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:39 smithi110 ceph-mon[28069]: pgmap v18348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:39 smithi193 ceph-mon[32782]: pgmap v18348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:41.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:41 smithi193 ceph-mon[32782]: pgmap v18349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:41 smithi196 ceph-mon[32572]: pgmap v18349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:41 smithi110 ceph-mon[28069]: pgmap v18349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:42 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34117.528169 secs 2024-04-26T21:16:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:42 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34117.528169 secs 2024-04-26T21:16:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:42 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34117.528169 secs 2024-04-26T21:16:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:43 smithi196 ceph-mon[32572]: pgmap v18350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:43 smithi110 ceph-mon[28069]: pgmap v18350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:43 smithi193 ceph-mon[32782]: pgmap v18350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:44 smithi196 ceph-mon[32572]: pgmap v18351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:44 smithi110 ceph-mon[28069]: pgmap v18351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:44 smithi193 ceph-mon[32782]: pgmap v18351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:47 smithi193 ceph-mon[32782]: pgmap v18352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:47 smithi196 ceph-mon[32572]: pgmap v18352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:47 smithi110 ceph-mon[28069]: pgmap v18352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:48 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34122.528260 secs 2024-04-26T21:16:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:48 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34122.528260 secs 2024-04-26T21:16:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:48 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34122.528260 secs 2024-04-26T21:16:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:49 smithi193 ceph-mon[32782]: pgmap v18353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:49 smithi196 ceph-mon[32572]: pgmap v18353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:49 smithi110 ceph-mon[28069]: pgmap v18353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:51 smithi193 ceph-mon[32782]: pgmap v18354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:51 smithi196 ceph-mon[32572]: pgmap v18354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:51 smithi110 ceph-mon[28069]: pgmap v18354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:53 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34127.528378 secs 2024-04-26T21:16:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:53 smithi193 ceph-mon[32782]: pgmap v18355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:53 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34127.528378 secs 2024-04-26T21:16:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:53 smithi196 ceph-mon[32572]: pgmap v18355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:53 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34127.528378 secs 2024-04-26T21:16:53.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:53 smithi110 ceph-mon[28069]: pgmap v18355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:55 smithi193 ceph-mon[32782]: pgmap v18356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:55 smithi196 ceph-mon[32572]: pgmap v18356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:55 smithi110 ceph-mon[28069]: pgmap v18356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:57 smithi193 ceph-mon[32782]: pgmap v18357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:57 smithi196 ceph-mon[32572]: pgmap v18357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:57 smithi110 ceph-mon[28069]: pgmap v18357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:16:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:58 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34132.528473 secs 2024-04-26T21:16:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:58 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34132.528473 secs 2024-04-26T21:16:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:58 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34132.528473 secs 2024-04-26T21:16:59.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:16:59 smithi193 ceph-mon[32782]: pgmap v18358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:59.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:16:59 smithi196 ceph-mon[32572]: pgmap v18358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:16:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:16:59 smithi110 ceph-mon[28069]: pgmap v18358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:01 smithi193 ceph-mon[32782]: pgmap v18359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:01 smithi196 ceph-mon[32572]: pgmap v18359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:01 smithi110 ceph-mon[28069]: pgmap v18359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:03 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34137.528626 secs 2024-04-26T21:17:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:03 smithi196 ceph-mon[32572]: pgmap v18360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:03 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34137.528626 secs 2024-04-26T21:17:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:03 smithi110 ceph-mon[28069]: pgmap v18360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:03 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34137.528626 secs 2024-04-26T21:17:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:03 smithi193 ceph-mon[32782]: pgmap v18360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:05.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:05 smithi196 ceph-mon[32572]: pgmap v18361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:05 smithi110 ceph-mon[28069]: pgmap v18361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:05 smithi193 ceph-mon[32782]: pgmap v18361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:07 smithi196 ceph-mon[32572]: pgmap v18362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:07 smithi110 ceph-mon[28069]: pgmap v18362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:07 smithi193 ceph-mon[32782]: pgmap v18362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:08 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34142.528673 secs 2024-04-26T21:17:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:08 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34142.528673 secs 2024-04-26T21:17:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:08 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34142.528673 secs 2024-04-26T21:17:09.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:09 smithi110 ceph-mon[28069]: pgmap v18363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:09 smithi196 ceph-mon[32572]: pgmap v18363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:09 smithi193 ceph-mon[32782]: pgmap v18363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:11.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:11 smithi193 ceph-mon[32782]: pgmap v18364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:11 smithi196 ceph-mon[32572]: pgmap v18364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:11 smithi110 ceph-mon[28069]: pgmap v18364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:13 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34147.528755 secs 2024-04-26T21:17:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:13 smithi196 ceph-mon[32572]: pgmap v18365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:13 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34147.528755 secs 2024-04-26T21:17:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:13 smithi110 ceph-mon[28069]: pgmap v18365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:13 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34147.528755 secs 2024-04-26T21:17:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:13 smithi193 ceph-mon[32782]: pgmap v18365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:15 smithi196 ceph-mon[32572]: pgmap v18366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:15 smithi110 ceph-mon[28069]: pgmap v18366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:15 smithi193 ceph-mon[32782]: pgmap v18366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:17 smithi196 ceph-mon[32572]: pgmap v18367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:17 smithi110 ceph-mon[28069]: pgmap v18367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:17 smithi193 ceph-mon[32782]: pgmap v18367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:18 smithi196 ceph-mon[32572]: 27 slow requests, 1 included below; oldest blocked for > 34152.528834 secs 2024-04-26T21:17:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:18 smithi196 ceph-mon[32572]: slow request 2881.484296 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:17:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:18 smithi110 ceph-mon[28069]: 27 slow requests, 1 included below; oldest blocked for > 34152.528834 secs 2024-04-26T21:17:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:18 smithi110 ceph-mon[28069]: slow request 2881.484296 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:17:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:18 smithi193 ceph-mon[32782]: 27 slow requests, 1 included below; oldest blocked for > 34152.528834 secs 2024-04-26T21:17:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:18 smithi193 ceph-mon[32782]: slow request 2881.484296 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:17:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:19 smithi196 ceph-mon[32572]: pgmap v18368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:19 smithi110 ceph-mon[28069]: pgmap v18368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:19 smithi193 ceph-mon[32782]: pgmap v18368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:20 smithi196 ceph-mon[32572]: pgmap v18369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:17:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:20 smithi196 ceph-mon[32572]: pgmap v18370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:20.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:17:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:20 smithi110 ceph-mon[28069]: pgmap v18369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:17:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:20 smithi110 ceph-mon[28069]: pgmap v18370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:20.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:17:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:20 smithi193 ceph-mon[32782]: pgmap v18369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:17:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:20 smithi193 ceph-mon[32782]: pgmap v18370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:17:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:22 smithi110 ceph-mon[28069]: pgmap v18371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:22 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34157.528963 secs 2024-04-26T21:17:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:22 smithi193 ceph-mon[32782]: pgmap v18371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:22 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34157.528963 secs 2024-04-26T21:17:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:22 smithi196 ceph-mon[32572]: pgmap v18371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:22 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34157.528963 secs 2024-04-26T21:17:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:24 smithi110 ceph-mon[28069]: pgmap v18372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:24 smithi193 ceph-mon[32782]: pgmap v18372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:24 smithi196 ceph-mon[32572]: pgmap v18372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:26 smithi110 ceph-mon[28069]: pgmap v18373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:26 smithi193 ceph-mon[32782]: pgmap v18373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:26 smithi196 ceph-mon[32572]: pgmap v18373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:27 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34162.529083 secs 2024-04-26T21:17:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:27 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34162.529083 secs 2024-04-26T21:17:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:27 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34162.529083 secs 2024-04-26T21:17:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:28 smithi110 ceph-mon[28069]: pgmap v18374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:28 smithi193 ceph-mon[32782]: pgmap v18374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:28 smithi196 ceph-mon[32572]: pgmap v18374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:17:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:30 smithi110 ceph-mon[28069]: pgmap v18375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:17:30.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:30 smithi193 ceph-mon[32782]: pgmap v18375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:17:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:30 smithi196 ceph-mon[32572]: pgmap v18375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:17:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:32 smithi193 ceph-mon[32782]: pgmap v18376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:32 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34167.529198 secs 2024-04-26T21:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:32 smithi196 ceph-mon[32572]: pgmap v18376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:32 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34167.529198 secs 2024-04-26T21:17:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:32 smithi110 ceph-mon[28069]: pgmap v18376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:33.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:32 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34167.529198 secs 2024-04-26T21:17:34.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:34 smithi196 ceph-mon[32572]: pgmap v18377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:34 smithi193 ceph-mon[32782]: pgmap v18377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:34 smithi110 ceph-mon[28069]: pgmap v18377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:36 smithi193 ceph-mon[32782]: pgmap v18378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:36 smithi196 ceph-mon[32572]: pgmap v18378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:37.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:17:37.037+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:17:37.038 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:17:37.037+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:17:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:17:37.038+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 263 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:17:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:17:37.038+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 263 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:17:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:36 smithi110 ceph-mon[28069]: pgmap v18378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:37 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34172.529325 secs 2024-04-26T21:17:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:37 smithi196 ceph-mon[32572]: pgmap v18379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:37 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34172.529325 secs 2024-04-26T21:17:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:37 smithi110 ceph-mon[28069]: pgmap v18379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:37 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34172.529325 secs 2024-04-26T21:17:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:37 smithi193 ceph-mon[32782]: pgmap v18379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:40 smithi110 ceph-mon[28069]: pgmap v18380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:40 smithi193 ceph-mon[32782]: pgmap v18380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:40 smithi196 ceph-mon[32572]: pgmap v18380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:42 smithi110 ceph-mon[28069]: pgmap v18381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:42 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34177.529447 secs 2024-04-26T21:17:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:42 smithi193 ceph-mon[32782]: pgmap v18381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:42 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34177.529447 secs 2024-04-26T21:17:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:42 smithi196 ceph-mon[32572]: pgmap v18381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:42 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34177.529447 secs 2024-04-26T21:17:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:44 smithi110 ceph-mon[28069]: pgmap v18382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:44 smithi193 ceph-mon[32782]: pgmap v18382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:44 smithi196 ceph-mon[32572]: pgmap v18382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:46 smithi193 ceph-mon[32782]: pgmap v18383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:46 smithi196 ceph-mon[32572]: pgmap v18383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:46 smithi110 ceph-mon[28069]: pgmap v18383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:47 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34182.529587 secs 2024-04-26T21:17:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:47 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34182.529587 secs 2024-04-26T21:17:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:47 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34182.529587 secs 2024-04-26T21:17:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:48 smithi193 ceph-mon[32782]: pgmap v18384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:48 smithi196 ceph-mon[32572]: pgmap v18384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:48 smithi110 ceph-mon[28069]: pgmap v18384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:50 smithi193 ceph-mon[32782]: pgmap v18385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:50 smithi196 ceph-mon[32572]: pgmap v18385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:50 smithi110 ceph-mon[28069]: pgmap v18385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:52 smithi193 ceph-mon[32782]: pgmap v18386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:52 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34187.529735 secs 2024-04-26T21:17:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:52 smithi196 ceph-mon[32572]: pgmap v18386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:52 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34187.529735 secs 2024-04-26T21:17:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:52 smithi110 ceph-mon[28069]: pgmap v18386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:52 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34187.529735 secs 2024-04-26T21:17:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:54 smithi193 ceph-mon[32782]: pgmap v18387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:54 smithi196 ceph-mon[32572]: pgmap v18387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:54 smithi110 ceph-mon[28069]: pgmap v18387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:56 smithi193 ceph-mon[32782]: pgmap v18388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:56 smithi196 ceph-mon[32572]: pgmap v18388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:56 smithi110 ceph-mon[28069]: pgmap v18388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:17:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:57 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34192.529857 secs 2024-04-26T21:17:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:57 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34192.529857 secs 2024-04-26T21:17:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:57 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34192.529857 secs 2024-04-26T21:17:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:17:58 smithi193 ceph-mon[32782]: pgmap v18389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:17:58 smithi196 ceph-mon[32572]: pgmap v18389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:17:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:17:58 smithi110 ceph-mon[28069]: pgmap v18389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:00 smithi193 ceph-mon[32782]: pgmap v18390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:00 smithi196 ceph-mon[32572]: pgmap v18390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:00 smithi110 ceph-mon[28069]: pgmap v18390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:02 smithi193 ceph-mon[32782]: pgmap v18391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:02 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34197.529996 secs 2024-04-26T21:18:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:02 smithi196 ceph-mon[32572]: pgmap v18391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:02 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34197.529996 secs 2024-04-26T21:18:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:02 smithi110 ceph-mon[28069]: pgmap v18391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:02 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34197.529996 secs 2024-04-26T21:18:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:04 smithi193 ceph-mon[32782]: pgmap v18392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:04 smithi196 ceph-mon[32572]: pgmap v18392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:04 smithi110 ceph-mon[28069]: pgmap v18392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:06 smithi193 ceph-mon[32782]: pgmap v18393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:06 smithi196 ceph-mon[32572]: pgmap v18393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:06 smithi110 ceph-mon[28069]: pgmap v18393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:07 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34202.530106 secs 2024-04-26T21:18:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:07 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34202.530106 secs 2024-04-26T21:18:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:07 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34202.530106 secs 2024-04-26T21:18:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:08 smithi196 ceph-mon[32572]: pgmap v18394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:08 smithi110 ceph-mon[28069]: pgmap v18394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:08 smithi193 ceph-mon[32782]: pgmap v18394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:10 smithi196 ceph-mon[32572]: pgmap v18395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:10 smithi110 ceph-mon[28069]: pgmap v18395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:10 smithi193 ceph-mon[32782]: pgmap v18395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:12.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:12 smithi193 ceph-mon[32782]: pgmap v18396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:12.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:12 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34207.530230 secs 2024-04-26T21:18:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:12 smithi196 ceph-mon[32572]: pgmap v18396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:12 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34207.530230 secs 2024-04-26T21:18:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:12 smithi110 ceph-mon[28069]: pgmap v18396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:12 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34207.530230 secs 2024-04-26T21:18:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:14 smithi196 ceph-mon[32572]: pgmap v18397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:14 smithi110 ceph-mon[28069]: pgmap v18397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:14 smithi193 ceph-mon[32782]: pgmap v18397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.470+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T21:18:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.470+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:18:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.470+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:18:16.471 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.470+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T21:18:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.471+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.472+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T21:18:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.472+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T21:18:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.489+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T21:18:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.489+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T21:18:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.489+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614063000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:18:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.489+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614063000 comp rx=0 tx=0).stop 2024-04-26T21:18:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.489+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T21:18:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.489+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T21:18:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.489+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.489+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:16.491 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.490+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:16.492 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:16.491+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614075000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:16 smithi196 ceph-mon[32572]: pgmap v18398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:16 smithi110 ceph-mon[28069]: pgmap v18398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:16 smithi193 ceph-mon[32782]: pgmap v18398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:17 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34212.530369 secs 2024-04-26T21:18:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:17 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34212.530369 secs 2024-04-26T21:18:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:17 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34212.530369 secs 2024-04-26T21:18:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:18 smithi196 ceph-mon[32572]: pgmap v18399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:18 smithi110 ceph-mon[28069]: pgmap v18399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:18 smithi193 ceph-mon[32782]: pgmap v18399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:19 smithi196 ceph-mon[32572]: pgmap v18400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:19 smithi110 ceph-mon[28069]: pgmap v18400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:19 smithi193 ceph-mon[32782]: pgmap v18400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:21 smithi196 ceph-mon[32572]: pgmap v18401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:18:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:21 smithi196 ceph-mon[32572]: pgmap v18402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:22.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:18:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:21 smithi110 ceph-mon[28069]: pgmap v18401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:18:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:21 smithi110 ceph-mon[28069]: pgmap v18402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:22.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:18:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:22.045+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:18:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:22.045+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:18:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:22.046+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 264 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:18:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:18:22.046+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 264 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:18:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:18:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:18:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:21 smithi193 ceph-mon[32782]: pgmap v18401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:18:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:21 smithi193 ceph-mon[32782]: pgmap v18402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:18:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:22 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34217.530525 secs 2024-04-26T21:18:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:22 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34217.530525 secs 2024-04-26T21:18:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:22 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34217.530525 secs 2024-04-26T21:18:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:23 smithi196 ceph-mon[32572]: pgmap v18403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:23 smithi110 ceph-mon[28069]: pgmap v18403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:23 smithi193 ceph-mon[32782]: pgmap v18403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:26 smithi193 ceph-mon[32782]: pgmap v18404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:26 smithi196 ceph-mon[32572]: pgmap v18404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:26 smithi110 ceph-mon[28069]: pgmap v18404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:28 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34222.530656 secs 2024-04-26T21:18:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:28 smithi193 ceph-mon[32782]: pgmap v18405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:18:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:28 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34222.530656 secs 2024-04-26T21:18:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:28 smithi196 ceph-mon[32572]: pgmap v18405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:18:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:28 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34222.530656 secs 2024-04-26T21:18:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:28 smithi110 ceph-mon[28069]: pgmap v18405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:18:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:30 smithi193 ceph-mon[32782]: pgmap v18406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:30 smithi196 ceph-mon[32572]: pgmap v18406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:30 smithi110 ceph-mon[28069]: pgmap v18406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:18:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:32 smithi193 ceph-mon[32782]: pgmap v18407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:18:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:32 smithi196 ceph-mon[32572]: pgmap v18407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:18:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:32 smithi110 ceph-mon[28069]: pgmap v18407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:18:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:33 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34227.530788 secs 2024-04-26T21:18:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:33 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34227.530788 secs 2024-04-26T21:18:33.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:33 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34227.530788 secs 2024-04-26T21:18:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:34 smithi193 ceph-mon[32782]: pgmap v18408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:34.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:34 smithi196 ceph-mon[32572]: pgmap v18408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:34 smithi110 ceph-mon[28069]: pgmap v18408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:36 smithi193 ceph-mon[32782]: pgmap v18409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:36 smithi196 ceph-mon[32572]: pgmap v18409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:36 smithi110 ceph-mon[28069]: pgmap v18409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:38 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34232.530910 secs 2024-04-26T21:18:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:38 smithi193 ceph-mon[32782]: pgmap v18410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:38 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34232.530910 secs 2024-04-26T21:18:38.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:38 smithi196 ceph-mon[32572]: pgmap v18410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:38 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34232.530910 secs 2024-04-26T21:18:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:38 smithi110 ceph-mon[28069]: pgmap v18410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:40 smithi193 ceph-mon[32782]: pgmap v18411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:40 smithi196 ceph-mon[32572]: pgmap v18411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:40 smithi110 ceph-mon[28069]: pgmap v18411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:42 smithi196 ceph-mon[32572]: pgmap v18412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:42 smithi110 ceph-mon[28069]: pgmap v18412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:42 smithi193 ceph-mon[32782]: pgmap v18412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:43 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34237.530986 secs 2024-04-26T21:18:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:43 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34237.530986 secs 2024-04-26T21:18:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:43 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34237.530986 secs 2024-04-26T21:18:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:44 smithi196 ceph-mon[32572]: pgmap v18413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:44 smithi110 ceph-mon[28069]: pgmap v18413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:44 smithi193 ceph-mon[32782]: pgmap v18413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:46.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:46 smithi196 ceph-mon[32572]: pgmap v18414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:46 smithi110 ceph-mon[28069]: pgmap v18414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:46 smithi193 ceph-mon[32782]: pgmap v18414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:48 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34242.531133 secs 2024-04-26T21:18:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:48 smithi196 ceph-mon[32572]: pgmap v18415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:48 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34242.531133 secs 2024-04-26T21:18:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:48 smithi110 ceph-mon[28069]: pgmap v18415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:48 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34242.531133 secs 2024-04-26T21:18:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:48 smithi193 ceph-mon[32782]: pgmap v18415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:50 smithi196 ceph-mon[32572]: pgmap v18416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:50 smithi110 ceph-mon[28069]: pgmap v18416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:50 smithi193 ceph-mon[32782]: pgmap v18416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:52.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:52 smithi196 ceph-mon[32572]: pgmap v18417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:52 smithi110 ceph-mon[28069]: pgmap v18417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:52 smithi193 ceph-mon[32782]: pgmap v18417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:53 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34247.531248 secs 2024-04-26T21:18:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:53 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34247.531248 secs 2024-04-26T21:18:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:53 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34247.531248 secs 2024-04-26T21:18:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:54 smithi196 ceph-mon[32572]: pgmap v18418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:54 smithi110 ceph-mon[28069]: pgmap v18418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:54 smithi193 ceph-mon[32782]: pgmap v18418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:18:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:56 smithi196 ceph-mon[32572]: pgmap v18419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:56 smithi110 ceph-mon[28069]: pgmap v18419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:56 smithi193 ceph-mon[32782]: pgmap v18419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:58 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34252.531367 secs 2024-04-26T21:18:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:18:58 smithi196 ceph-mon[32572]: pgmap v18420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:58 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34252.531367 secs 2024-04-26T21:18:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:18:58 smithi110 ceph-mon[28069]: pgmap v18420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:18:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:58 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34252.531367 secs 2024-04-26T21:18:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:18:58 smithi193 ceph-mon[32782]: pgmap v18420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:00 smithi196 ceph-mon[32572]: pgmap v18421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:00 smithi110 ceph-mon[28069]: pgmap v18421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:00 smithi193 ceph-mon[32782]: pgmap v18421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:02 smithi196 ceph-mon[32572]: pgmap v18422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:02 smithi110 ceph-mon[28069]: pgmap v18422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:02 smithi193 ceph-mon[32782]: pgmap v18422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:03 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34257.531482 secs 2024-04-26T21:19:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:03 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34257.531482 secs 2024-04-26T21:19:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:03 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34257.531482 secs 2024-04-26T21:19:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:04 smithi196 ceph-mon[32572]: pgmap v18423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:04 smithi110 ceph-mon[28069]: pgmap v18423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:04 smithi193 ceph-mon[32782]: pgmap v18423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:06 smithi196 ceph-mon[32572]: pgmap v18424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:06 smithi110 ceph-mon[28069]: pgmap v18424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:06.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:06 smithi193 ceph-mon[32782]: pgmap v18424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:08 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34262.531642 secs 2024-04-26T21:19:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:08 smithi196 ceph-mon[32572]: pgmap v18425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:08 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34262.531642 secs 2024-04-26T21:19:08.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:08 smithi110 ceph-mon[28069]: pgmap v18425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:08 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34262.531642 secs 2024-04-26T21:19:08.629 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:08 smithi193 ceph-mon[32782]: pgmap v18425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:10 smithi196 ceph-mon[32572]: pgmap v18426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:10 smithi110 ceph-mon[28069]: pgmap v18426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:10.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:10 smithi193 ceph-mon[32782]: pgmap v18426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:12 smithi196 ceph-mon[32572]: pgmap v18427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:12 smithi110 ceph-mon[28069]: pgmap v18427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:12 smithi193 ceph-mon[32782]: pgmap v18427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:13 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34267.531773 secs 2024-04-26T21:19:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:13 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34267.531773 secs 2024-04-26T21:19:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:13 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34267.531773 secs 2024-04-26T21:19:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:14 smithi196 ceph-mon[32572]: pgmap v18428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:14 smithi110 ceph-mon[28069]: pgmap v18428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:14.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:14 smithi193 ceph-mon[32782]: pgmap v18428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:16 smithi196 ceph-mon[32572]: pgmap v18429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:16 smithi110 ceph-mon[28069]: pgmap v18429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:16 smithi193 ceph-mon[32782]: pgmap v18429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:17.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:19:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:19:16.874+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:19:17.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:19:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:19:16.874+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:19:17.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:19:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:19:16.874+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:19:17.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:19:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:19:16.874+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:19:17.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:19:16 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:19:16.874+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:19:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:18 smithi196 ceph-mon[32572]: 27 slow requests, 0 included below; oldest blocked for > 34272.531907 secs 2024-04-26T21:19:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:18 smithi196 ceph-mon[32572]: pgmap v18430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:18 smithi110 ceph-mon[28069]: 27 slow requests, 0 included below; oldest blocked for > 34272.531907 secs 2024-04-26T21:19:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:18 smithi110 ceph-mon[28069]: pgmap v18430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:18 smithi193 ceph-mon[32782]: 27 slow requests, 0 included below; oldest blocked for > 34272.531907 secs 2024-04-26T21:19:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:18 smithi193 ceph-mon[32782]: pgmap v18430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:20 smithi196 ceph-mon[32572]: pgmap v18431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:19:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:20 smithi110 ceph-mon[28069]: pgmap v18431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:19:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:20 smithi193 ceph-mon[32782]: pgmap v18431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-04-26T21:19:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:22 smithi110 ceph-mon[28069]: pgmap v18432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T21:19:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:22 smithi193 ceph-mon[32782]: pgmap v18432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T21:19:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:22 smithi196 ceph-mon[32572]: pgmap v18432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-04-26T21:19:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:23 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34277.532012 secs 2024-04-26T21:19:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:19:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:23 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:19:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:23 smithi110 ceph-mon[28069]: pgmap v18433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 264 B/s wr, 2 op/s 2024-04-26T21:19:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:23 smithi110 ceph-mon[28069]: pgmap v18434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 320 B/s wr, 2 op/s 2024-04-26T21:19:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:19:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:23 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34277.532012 secs 2024-04-26T21:19:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:19:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:23 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:19:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:23 smithi193 ceph-mon[32782]: pgmap v18433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 264 B/s wr, 2 op/s 2024-04-26T21:19:23.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:23 smithi193 ceph-mon[32782]: pgmap v18434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 320 B/s wr, 2 op/s 2024-04-26T21:19:23.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:19:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:23 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34277.532012 secs 2024-04-26T21:19:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:19:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:23 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:19:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:23 smithi196 ceph-mon[32572]: pgmap v18433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 264 B/s wr, 2 op/s 2024-04-26T21:19:23.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:23 smithi196 ceph-mon[32572]: pgmap v18434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 320 B/s wr, 2 op/s 2024-04-26T21:19:23.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:19:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:24 smithi196 ceph-mon[32572]: pgmap v18435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 320 B/s wr, 2 op/s 2024-04-26T21:19:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:24 smithi110 ceph-mon[28069]: pgmap v18435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 320 B/s wr, 2 op/s 2024-04-26T21:19:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:24 smithi193 ceph-mon[32782]: pgmap v18435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 320 B/s wr, 2 op/s 2024-04-26T21:19:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:26 smithi196 ceph-mon[32572]: pgmap v18436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 320 B/s wr, 2 op/s 2024-04-26T21:19:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:26 smithi110 ceph-mon[28069]: pgmap v18436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 320 B/s wr, 2 op/s 2024-04-26T21:19:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:26 smithi193 ceph-mon[32782]: pgmap v18436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 320 B/s wr, 2 op/s 2024-04-26T21:19:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:27 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34282.532142 secs 2024-04-26T21:19:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:27 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34282.532142 secs 2024-04-26T21:19:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:27 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34282.532142 secs 2024-04-26T21:19:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:28 smithi196 ceph-mon[32572]: pgmap v18437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:19:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:28 smithi110 ceph-mon[28069]: pgmap v18437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:19:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:28 smithi193 ceph-mon[32782]: pgmap v18437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:19:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:30 smithi196 ceph-mon[32572]: pgmap v18438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:19:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:30 smithi110 ceph-mon[28069]: pgmap v18438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:19:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:30 smithi193 ceph-mon[32782]: pgmap v18438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:19:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:32 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34287.532267 secs 2024-04-26T21:19:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:32 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34287.532267 secs 2024-04-26T21:19:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:32 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34287.532267 secs 2024-04-26T21:19:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:33 smithi196 ceph-mon[32572]: pgmap v18439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:19:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:33 smithi110 ceph-mon[28069]: pgmap v18439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:19:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:33 smithi193 ceph-mon[32782]: pgmap v18439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:19:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:34 smithi196 ceph-mon[32572]: pgmap v18440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:34 smithi110 ceph-mon[28069]: pgmap v18440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:34 smithi193 ceph-mon[32782]: pgmap v18440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:36 smithi196 ceph-mon[32572]: pgmap v18441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:36 smithi110 ceph-mon[28069]: pgmap v18441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:36 smithi193 ceph-mon[32782]: pgmap v18441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:37 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34292.532403 secs 2024-04-26T21:19:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:37 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34292.532403 secs 2024-04-26T21:19:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:37 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34292.532403 secs 2024-04-26T21:19:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:38 smithi196 ceph-mon[32572]: pgmap v18442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:38 smithi110 ceph-mon[28069]: pgmap v18442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:38 smithi193 ceph-mon[32782]: pgmap v18442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:40 smithi196 ceph-mon[32572]: pgmap v18443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:40 smithi110 ceph-mon[28069]: pgmap v18443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:40 smithi193 ceph-mon[32782]: pgmap v18443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:42 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34297.532519 secs 2024-04-26T21:19:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:42 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34297.532519 secs 2024-04-26T21:19:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:42 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34297.532519 secs 2024-04-26T21:19:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:43 smithi196 ceph-mon[32572]: pgmap v18444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:43 smithi110 ceph-mon[28069]: pgmap v18444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:43 smithi193 ceph-mon[32782]: pgmap v18444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:44 smithi196 ceph-mon[32572]: pgmap v18445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:44 smithi110 ceph-mon[28069]: pgmap v18445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:44 smithi193 ceph-mon[32782]: pgmap v18445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:46 smithi196 ceph-mon[32572]: pgmap v18446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:46 smithi110 ceph-mon[28069]: pgmap v18446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:46 smithi193 ceph-mon[32782]: pgmap v18446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:19:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:47 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34302.532641 secs 2024-04-26T21:19:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:47 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34302.532641 secs 2024-04-26T21:19:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:47 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34302.532641 secs 2024-04-26T21:19:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:48 smithi196 ceph-mon[32572]: pgmap v18447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:48 smithi110 ceph-mon[28069]: pgmap v18447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:48 smithi193 ceph-mon[32782]: pgmap v18447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:50 smithi196 ceph-mon[32572]: pgmap v18448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:19:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:50 smithi110 ceph-mon[28069]: pgmap v18448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:19:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:50 smithi193 ceph-mon[32782]: pgmap v18448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:19:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:52 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34307.532761 secs 2024-04-26T21:19:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:52 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34307.532761 secs 2024-04-26T21:19:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:52 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34307.532761 secs 2024-04-26T21:19:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:53 smithi196 ceph-mon[32572]: pgmap v18449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:53 smithi110 ceph-mon[28069]: pgmap v18449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:53 smithi193 ceph-mon[32782]: pgmap v18449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:54 smithi196 ceph-mon[32572]: pgmap v18450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:19:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:54 smithi110 ceph-mon[28069]: pgmap v18450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:19:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:54 smithi193 ceph-mon[32782]: pgmap v18450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:19:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:56 smithi196 ceph-mon[32572]: pgmap v18451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:19:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:56 smithi110 ceph-mon[28069]: pgmap v18451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:19:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:56 smithi193 ceph-mon[32782]: pgmap v18451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:19:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:57 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34312.532863 secs 2024-04-26T21:19:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:57 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34312.532863 secs 2024-04-26T21:19:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:57 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34312.532863 secs 2024-04-26T21:19:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:19:58 smithi196 ceph-mon[32572]: pgmap v18452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:19:58 smithi110 ceph-mon[28069]: pgmap v18452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:19:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:19:58 smithi193 ceph-mon[32782]: pgmap v18452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:00.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:20:00.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:20:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:20:01.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:01 smithi193 ceph-mon[32782]: pgmap v18453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:01.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:01 smithi196 ceph-mon[32572]: pgmap v18453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:01.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:01 smithi110 ceph-mon[28069]: pgmap v18453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:02 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34317.532981 secs 2024-04-26T21:20:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:02 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34317.532981 secs 2024-04-26T21:20:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:02 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34317.532981 secs 2024-04-26T21:20:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:03 smithi196 ceph-mon[32572]: pgmap v18454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:03 smithi110 ceph-mon[28069]: pgmap v18454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:03 smithi193 ceph-mon[32782]: pgmap v18454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:04 smithi196 ceph-mon[32572]: pgmap v18455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:05.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:04 smithi110 ceph-mon[28069]: pgmap v18455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:04 smithi193 ceph-mon[32782]: pgmap v18455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:06 smithi196 ceph-mon[32572]: pgmap v18456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:06 smithi110 ceph-mon[28069]: pgmap v18456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:06 smithi193 ceph-mon[32782]: pgmap v18456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:07 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34322.533066 secs 2024-04-26T21:20:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:07 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34322.533066 secs 2024-04-26T21:20:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:07 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34322.533066 secs 2024-04-26T21:20:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:08 smithi196 ceph-mon[32572]: pgmap v18457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:08 smithi110 ceph-mon[28069]: pgmap v18457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:08 smithi193 ceph-mon[32782]: pgmap v18457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:10 smithi196 ceph-mon[32572]: pgmap v18458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:10 smithi110 ceph-mon[28069]: pgmap v18458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:10 smithi193 ceph-mon[32782]: pgmap v18458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:12 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34327.533185 secs 2024-04-26T21:20:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:12 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34327.533185 secs 2024-04-26T21:20:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:12 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34327.533185 secs 2024-04-26T21:20:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:13 smithi196 ceph-mon[32572]: pgmap v18459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:13 smithi110 ceph-mon[28069]: pgmap v18459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:13 smithi193 ceph-mon[32782]: pgmap v18459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:14 smithi196 ceph-mon[32572]: pgmap v18460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:14 smithi110 ceph-mon[28069]: pgmap v18460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:14 smithi193 ceph-mon[32782]: pgmap v18460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:16 smithi196 ceph-mon[32572]: pgmap v18461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:16 smithi110 ceph-mon[28069]: pgmap v18461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:16 smithi193 ceph-mon[32782]: pgmap v18461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:17 smithi196 ceph-mon[32572]: 7 slow requests, 1 included below; oldest blocked for > 34332.533286 secs 2024-04-26T21:20:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:17 smithi196 ceph-mon[32572]: slow request 5762.705198 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:20:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:17 smithi110 ceph-mon[28069]: 7 slow requests, 1 included below; oldest blocked for > 34332.533286 secs 2024-04-26T21:20:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:17 smithi110 ceph-mon[28069]: slow request 5762.705198 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:20:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:17 smithi193 ceph-mon[32782]: 7 slow requests, 1 included below; oldest blocked for > 34332.533286 secs 2024-04-26T21:20:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:17 smithi193 ceph-mon[32782]: slow request 5762.705198 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:20:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:18 smithi196 ceph-mon[32572]: pgmap v18462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:18 smithi110 ceph-mon[28069]: pgmap v18462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:18 smithi193 ceph-mon[32782]: pgmap v18462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:20 smithi196 ceph-mon[32572]: pgmap v18463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:20 smithi110 ceph-mon[28069]: pgmap v18463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:20 smithi193 ceph-mon[32782]: pgmap v18463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:22 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34337.533433 secs 2024-04-26T21:20:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:22 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34337.533433 secs 2024-04-26T21:20:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:22 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34337.533433 secs 2024-04-26T21:20:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:23 smithi196 ceph-mon[32572]: pgmap v18464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:23 smithi110 ceph-mon[28069]: pgmap v18464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:23.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:23 smithi193 ceph-mon[32782]: pgmap v18464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:24.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:20:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:20:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:20:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:25 smithi196 ceph-mon[32572]: pgmap v18465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:20:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:25 smithi196 ceph-mon[32572]: pgmap v18466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:25.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:25 smithi110 ceph-mon[28069]: pgmap v18465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:20:25.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:25 smithi110 ceph-mon[28069]: pgmap v18466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:25 smithi193 ceph-mon[32782]: pgmap v18465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:20:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:25 smithi193 ceph-mon[32782]: pgmap v18466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:27 smithi196 ceph-mon[32572]: pgmap v18467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:27 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34342.533579 secs 2024-04-26T21:20:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:27 smithi110 ceph-mon[28069]: pgmap v18467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:27 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34342.533579 secs 2024-04-26T21:20:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:27 smithi193 ceph-mon[32782]: pgmap v18467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:27 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34342.533579 secs 2024-04-26T21:20:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:29 smithi196 ceph-mon[32572]: pgmap v18468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:29 smithi110 ceph-mon[28069]: pgmap v18468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:29 smithi193 ceph-mon[32782]: pgmap v18468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:31 smithi196 ceph-mon[32572]: pgmap v18469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:31 smithi110 ceph-mon[28069]: pgmap v18469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:31 smithi193 ceph-mon[32782]: pgmap v18469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:20:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:32 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34347.533691 secs 2024-04-26T21:20:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:32 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34347.533691 secs 2024-04-26T21:20:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:32 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34347.533691 secs 2024-04-26T21:20:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:33 smithi196 ceph-mon[32572]: pgmap v18470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T21:20:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:33 smithi110 ceph-mon[28069]: pgmap v18470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T21:20:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:33 smithi193 ceph-mon[32782]: pgmap v18470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T21:20:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:35 smithi196 ceph-mon[32572]: pgmap v18471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:20:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:35 smithi110 ceph-mon[28069]: pgmap v18471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:20:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:35 smithi193 ceph-mon[32782]: pgmap v18471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:20:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:37 smithi196 ceph-mon[32572]: pgmap v18472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:37 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34352.533796 secs 2024-04-26T21:20:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:37 smithi110 ceph-mon[28069]: pgmap v18472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:37 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34352.533796 secs 2024-04-26T21:20:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:37 smithi193 ceph-mon[32782]: pgmap v18472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:37 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34352.533796 secs 2024-04-26T21:20:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:39 smithi196 ceph-mon[32572]: pgmap v18473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:39 smithi110 ceph-mon[28069]: pgmap v18473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:39 smithi193 ceph-mon[32782]: pgmap v18473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:41 smithi196 ceph-mon[32572]: pgmap v18474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:41 smithi110 ceph-mon[28069]: pgmap v18474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:41 smithi193 ceph-mon[32782]: pgmap v18474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:42 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34357.533921 secs 2024-04-26T21:20:42.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:42 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34357.533921 secs 2024-04-26T21:20:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:42 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34357.533921 secs 2024-04-26T21:20:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:43 smithi196 ceph-mon[32572]: pgmap v18475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:43 smithi110 ceph-mon[28069]: pgmap v18475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:43 smithi193 ceph-mon[32782]: pgmap v18475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:45 smithi196 ceph-mon[32572]: pgmap v18476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:45 smithi110 ceph-mon[28069]: pgmap v18476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:45 smithi193 ceph-mon[32782]: pgmap v18476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:47 smithi196 ceph-mon[32572]: pgmap v18477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:47 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34362.534040 secs 2024-04-26T21:20:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:47 smithi110 ceph-mon[28069]: pgmap v18477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:47 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34362.534040 secs 2024-04-26T21:20:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:47 smithi193 ceph-mon[32782]: pgmap v18477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:47 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34362.534040 secs 2024-04-26T21:20:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:49 smithi196 ceph-mon[32572]: pgmap v18478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:49 smithi110 ceph-mon[28069]: pgmap v18478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:49 smithi193 ceph-mon[32782]: pgmap v18478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:51 smithi196 ceph-mon[32572]: pgmap v18479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:51 smithi110 ceph-mon[28069]: pgmap v18479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:51 smithi193 ceph-mon[32782]: pgmap v18479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:52 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34367.534193 secs 2024-04-26T21:20:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:52 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34367.534193 secs 2024-04-26T21:20:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:52 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34367.534193 secs 2024-04-26T21:20:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:53 smithi196 ceph-mon[32572]: pgmap v18480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:53 smithi110 ceph-mon[28069]: pgmap v18480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:53 smithi193 ceph-mon[32782]: pgmap v18480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:55 smithi110 ceph-mon[28069]: pgmap v18481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:55 smithi193 ceph-mon[32782]: pgmap v18481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:55 smithi196 ceph-mon[32572]: pgmap v18481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:57 smithi110 ceph-mon[28069]: pgmap v18482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:57 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34372.534313 secs 2024-04-26T21:20:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:57 smithi193 ceph-mon[32782]: pgmap v18482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:57 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34372.534313 secs 2024-04-26T21:20:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:57 smithi196 ceph-mon[32572]: pgmap v18482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:20:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:57 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34372.534313 secs 2024-04-26T21:20:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:20:59 smithi110 ceph-mon[28069]: pgmap v18483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:20:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:20:59 smithi193 ceph-mon[32782]: pgmap v18483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:20:59 smithi196 ceph-mon[32572]: pgmap v18483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:01 smithi110 ceph-mon[28069]: pgmap v18484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:01 smithi193 ceph-mon[32782]: pgmap v18484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:01 smithi196 ceph-mon[32572]: pgmap v18484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:02 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34377.534437 secs 2024-04-26T21:21:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:02 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34377.534437 secs 2024-04-26T21:21:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:02 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34377.534437 secs 2024-04-26T21:21:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:03 smithi110 ceph-mon[28069]: pgmap v18485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:03 smithi193 ceph-mon[32782]: pgmap v18485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:03 smithi196 ceph-mon[32572]: pgmap v18485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:05.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:05 smithi196 ceph-mon[32572]: pgmap v18486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:05 smithi193 ceph-mon[32782]: pgmap v18486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:05 smithi110 ceph-mon[28069]: pgmap v18486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:07 smithi193 ceph-mon[32782]: pgmap v18487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:07 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34382.534557 secs 2024-04-26T21:21:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:07 smithi196 ceph-mon[32572]: pgmap v18487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:07 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34382.534557 secs 2024-04-26T21:21:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:07 smithi110 ceph-mon[28069]: pgmap v18487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:07 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34382.534557 secs 2024-04-26T21:21:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:09 smithi193 ceph-mon[32782]: pgmap v18488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:10.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:09 smithi196 ceph-mon[32572]: pgmap v18488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:09 smithi110 ceph-mon[28069]: pgmap v18488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:11.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:11 smithi110 ceph-mon[28069]: pgmap v18489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:11 smithi193 ceph-mon[32782]: pgmap v18489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:11 smithi196 ceph-mon[32572]: pgmap v18489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:12 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34387.534665 secs 2024-04-26T21:21:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:12 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34387.534665 secs 2024-04-26T21:21:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:12 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34387.534665 secs 2024-04-26T21:21:13.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:13 smithi193 ceph-mon[32782]: pgmap v18490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:13 smithi196 ceph-mon[32572]: pgmap v18490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:13 smithi110 ceph-mon[28069]: pgmap v18490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:15 smithi193 ceph-mon[32782]: pgmap v18491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:15 smithi196 ceph-mon[32572]: pgmap v18491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:15 smithi110 ceph-mon[28069]: pgmap v18491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:17 smithi193 ceph-mon[32782]: pgmap v18492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:17 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34392.534802 secs 2024-04-26T21:21:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:17 smithi196 ceph-mon[32572]: pgmap v18492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:17 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34392.534802 secs 2024-04-26T21:21:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:17 smithi110 ceph-mon[28069]: pgmap v18492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:17 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34392.534802 secs 2024-04-26T21:21:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:19 smithi193 ceph-mon[32782]: pgmap v18493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:19 smithi196 ceph-mon[32572]: pgmap v18493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:19 smithi110 ceph-mon[28069]: pgmap v18493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:21 smithi193 ceph-mon[32782]: pgmap v18494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:21 smithi196 ceph-mon[32572]: pgmap v18494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:21 smithi110 ceph-mon[28069]: pgmap v18494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:21:22.076+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:21:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:21:22.076+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:21:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:21:22.077+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 265 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:21:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:21:22.077+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 265 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:21:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:22 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34397.534941 secs 2024-04-26T21:21:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:22 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34397.534941 secs 2024-04-26T21:21:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:22 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34397.534941 secs 2024-04-26T21:21:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:23 smithi193 ceph-mon[32782]: pgmap v18495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:23 smithi196 ceph-mon[32572]: pgmap v18495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:23 smithi110 ceph-mon[28069]: pgmap v18495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:25 smithi196 ceph-mon[32572]: pgmap v18496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:21:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:21:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:21:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:25 smithi110 ceph-mon[28069]: pgmap v18496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:21:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:21:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:21:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:25 smithi193 ceph-mon[32782]: pgmap v18496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:21:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:21:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:21:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:27 smithi196 ceph-mon[32572]: pgmap v18497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:28.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:27 smithi196 ceph-mon[32572]: pgmap v18498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T21:21:28.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:27 smithi196 ceph-mon[32572]: pgmap v18499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:21:28.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:21:28.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:27 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34402.535042 secs 2024-04-26T21:21:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:27 smithi110 ceph-mon[28069]: pgmap v18497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:27 smithi110 ceph-mon[28069]: pgmap v18498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T21:21:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:27 smithi110 ceph-mon[28069]: pgmap v18499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:21:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:21:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:27 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34402.535042 secs 2024-04-26T21:21:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:27 smithi193 ceph-mon[32782]: pgmap v18497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:27 smithi193 ceph-mon[32782]: pgmap v18498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 984 B/s rd, 1 op/s 2024-04-26T21:21:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:27 smithi193 ceph-mon[32782]: pgmap v18499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:21:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:21:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:27 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34402.535042 secs 2024-04-26T21:21:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:28 smithi196 ceph-mon[32572]: pgmap v18500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:28 smithi110 ceph-mon[28069]: pgmap v18500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:28 smithi193 ceph-mon[32782]: pgmap v18500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:30 smithi196 ceph-mon[32572]: pgmap v18501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:21:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:30 smithi110 ceph-mon[28069]: pgmap v18501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:21:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:30 smithi193 ceph-mon[32782]: pgmap v18501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:21:32.472 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:32 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34407.535159 secs 2024-04-26T21:21:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:32 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34407.535159 secs 2024-04-26T21:21:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:32 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34407.535159 secs 2024-04-26T21:21:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:33 smithi196 ceph-mon[32572]: pgmap v18502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:33 smithi110 ceph-mon[28069]: pgmap v18502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:33 smithi193 ceph-mon[32782]: pgmap v18502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:34 smithi196 ceph-mon[32572]: pgmap v18503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:34 smithi110 ceph-mon[28069]: pgmap v18503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:34 smithi193 ceph-mon[32782]: pgmap v18503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:36 smithi196 ceph-mon[32572]: pgmap v18504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:21:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:36 smithi110 ceph-mon[28069]: pgmap v18504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:21:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:36 smithi193 ceph-mon[32782]: pgmap v18504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:21:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:37 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34412.535325 secs 2024-04-26T21:21:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:37 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34412.535325 secs 2024-04-26T21:21:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:37 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34412.535325 secs 2024-04-26T21:21:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:38 smithi110 ceph-mon[28069]: pgmap v18505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:38 smithi193 ceph-mon[32782]: pgmap v18505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:38 smithi196 ceph-mon[32572]: pgmap v18505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:40 smithi196 ceph-mon[32572]: pgmap v18506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:40 smithi110 ceph-mon[28069]: pgmap v18506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:40 smithi193 ceph-mon[32782]: pgmap v18506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:42 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34417.535452 secs 2024-04-26T21:21:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:42 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34417.535452 secs 2024-04-26T21:21:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:42 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34417.535452 secs 2024-04-26T21:21:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:43 smithi196 ceph-mon[32572]: pgmap v18507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:43 smithi110 ceph-mon[28069]: pgmap v18507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:43 smithi193 ceph-mon[32782]: pgmap v18507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:44 smithi196 ceph-mon[32572]: pgmap v18508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:44 smithi110 ceph-mon[28069]: pgmap v18508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:44 smithi193 ceph-mon[32782]: pgmap v18508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:46 smithi196 ceph-mon[32572]: pgmap v18509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:46 smithi110 ceph-mon[28069]: pgmap v18509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:46 smithi193 ceph-mon[32782]: pgmap v18509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:47 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34422.535539 secs 2024-04-26T21:21:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:47 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34422.535539 secs 2024-04-26T21:21:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:47 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34422.535539 secs 2024-04-26T21:21:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:48 smithi110 ceph-mon[28069]: pgmap v18510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:48 smithi193 ceph-mon[32782]: pgmap v18510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:48 smithi196 ceph-mon[32572]: pgmap v18510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:50 smithi196 ceph-mon[32572]: pgmap v18511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:50 smithi110 ceph-mon[28069]: pgmap v18511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:50 smithi193 ceph-mon[32782]: pgmap v18511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:52 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34427.535677 secs 2024-04-26T21:21:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:52 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34427.535677 secs 2024-04-26T21:21:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:52 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34427.535677 secs 2024-04-26T21:21:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:53 smithi196 ceph-mon[32572]: pgmap v18512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:53 smithi110 ceph-mon[28069]: pgmap v18512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:53 smithi193 ceph-mon[32782]: pgmap v18512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:54 smithi196 ceph-mon[32572]: pgmap v18513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:54 smithi110 ceph-mon[28069]: pgmap v18513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:54 smithi193 ceph-mon[32782]: pgmap v18513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:56 smithi196 ceph-mon[32572]: pgmap v18514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:56 smithi110 ceph-mon[28069]: pgmap v18514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:56 smithi193 ceph-mon[32782]: pgmap v18514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:21:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:57 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34432.535808 secs 2024-04-26T21:21:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:57 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34432.535808 secs 2024-04-26T21:21:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:57 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34432.535808 secs 2024-04-26T21:21:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:21:58 smithi110 ceph-mon[28069]: pgmap v18515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:21:58 smithi193 ceph-mon[32782]: pgmap v18515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:21:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:21:58 smithi196 ceph-mon[32572]: pgmap v18515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:00 smithi110 ceph-mon[28069]: pgmap v18516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:00 smithi193 ceph-mon[32782]: pgmap v18516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:00 smithi196 ceph-mon[32572]: pgmap v18516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:02 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34437.535959 secs 2024-04-26T21:22:02.826 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:02 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34437.535959 secs 2024-04-26T21:22:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:02 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34437.535959 secs 2024-04-26T21:22:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:03 smithi196 ceph-mon[32572]: pgmap v18517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:03 smithi110 ceph-mon[28069]: pgmap v18517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:03 smithi193 ceph-mon[32782]: pgmap v18517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:04 smithi110 ceph-mon[28069]: pgmap v18518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:04 smithi193 ceph-mon[32782]: pgmap v18518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:04 smithi196 ceph-mon[32572]: pgmap v18518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:06 smithi110 ceph-mon[28069]: pgmap v18519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:06 smithi193 ceph-mon[32782]: pgmap v18519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:06 smithi196 ceph-mon[32572]: pgmap v18519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:07 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34442.536086 secs 2024-04-26T21:22:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:07 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34442.536086 secs 2024-04-26T21:22:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:07 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34442.536086 secs 2024-04-26T21:22:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:08 smithi110 ceph-mon[28069]: pgmap v18520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:08 smithi193 ceph-mon[32782]: pgmap v18520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:08 smithi196 ceph-mon[32572]: pgmap v18520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:10 smithi110 ceph-mon[28069]: pgmap v18521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:10 smithi193 ceph-mon[32782]: pgmap v18521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:10 smithi196 ceph-mon[32572]: pgmap v18521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:12 smithi193 ceph-mon[32782]: 7 slow requests, 0 included below; oldest blocked for > 34447.536152 secs 2024-04-26T21:22:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:12 smithi193 ceph-mon[32782]: pgmap v18522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:12 smithi196 ceph-mon[32572]: 7 slow requests, 0 included below; oldest blocked for > 34447.536152 secs 2024-04-26T21:22:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:12 smithi196 ceph-mon[32572]: pgmap v18522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:12 smithi110 ceph-mon[28069]: 7 slow requests, 0 included below; oldest blocked for > 34447.536152 secs 2024-04-26T21:22:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:12 smithi110 ceph-mon[28069]: pgmap v18522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:14 smithi110 ceph-mon[28069]: pgmap v18523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:14 smithi193 ceph-mon[32782]: pgmap v18523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:14 smithi196 ceph-mon[32572]: pgmap v18523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:16 smithi110 ceph-mon[28069]: pgmap v18524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:16 smithi193 ceph-mon[32782]: pgmap v18524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:16 smithi196 ceph-mon[32572]: pgmap v18524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:17 smithi110 ceph-mon[28069]: 7 slow requests, 1 included below; oldest blocked for > 34452.536235 secs 2024-04-26T21:22:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:17 smithi110 ceph-mon[28069]: slow request 2881.264109 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:22:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:17 smithi193 ceph-mon[32782]: 7 slow requests, 1 included below; oldest blocked for > 34452.536235 secs 2024-04-26T21:22:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:17 smithi193 ceph-mon[32782]: slow request 2881.264109 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:22:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:17 smithi196 ceph-mon[32572]: 7 slow requests, 1 included below; oldest blocked for > 34452.536235 secs 2024-04-26T21:22:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:17 smithi196 ceph-mon[32572]: slow request 2881.264109 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:22:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:19 smithi110 ceph-mon[28069]: pgmap v18525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:19 smithi193 ceph-mon[32782]: pgmap v18525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:19 smithi196 ceph-mon[32572]: pgmap v18525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:21 smithi110 ceph-mon[28069]: pgmap v18526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:21 smithi193 ceph-mon[32782]: pgmap v18526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:21 smithi196 ceph-mon[32572]: pgmap v18526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:22 smithi110 ceph-mon[28069]: 28 slow requests, 1 included below; oldest blocked for > 34457.536370 secs 2024-04-26T21:22:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:22 smithi110 ceph-mon[28069]: slow request 184.951437 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:22:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:22 smithi193 ceph-mon[32782]: 28 slow requests, 1 included below; oldest blocked for > 34457.536370 secs 2024-04-26T21:22:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:22 smithi193 ceph-mon[32782]: slow request 184.951437 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:22:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:22 smithi196 ceph-mon[32572]: 28 slow requests, 1 included below; oldest blocked for > 34457.536370 secs 2024-04-26T21:22:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:22 smithi196 ceph-mon[32572]: slow request 184.951437 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:22:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:23 smithi110 ceph-mon[28069]: pgmap v18527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:22:24.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:23 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:22:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:23 smithi193 ceph-mon[32782]: pgmap v18527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:22:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:23 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:22:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:23 smithi196 ceph-mon[32572]: pgmap v18527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:22:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:23 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:22:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:25 smithi193 ceph-mon[32782]: pgmap v18528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:25 smithi196 ceph-mon[32572]: pgmap v18528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:25 smithi110 ceph-mon[28069]: pgmap v18528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:27 smithi193 ceph-mon[32782]: pgmap v18529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:27 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34462.536494 secs 2024-04-26T21:22:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:27 smithi196 ceph-mon[32572]: pgmap v18529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:27 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34462.536494 secs 2024-04-26T21:22:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:27 smithi110 ceph-mon[28069]: pgmap v18529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:27 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34462.536494 secs 2024-04-26T21:22:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:28.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:28 smithi193 ceph-mon[32782]: pgmap v18530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:22:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:28 smithi193 ceph-mon[32782]: pgmap v18531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:28 smithi196 ceph-mon[32572]: pgmap v18530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:22:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:28 smithi196 ceph-mon[32572]: pgmap v18531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:28 smithi110 ceph-mon[28069]: pgmap v18530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:22:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:28 smithi110 ceph-mon[28069]: pgmap v18531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:29.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:22:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:31 smithi193 ceph-mon[32782]: pgmap v18532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:31 smithi196 ceph-mon[32572]: pgmap v18532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:31 smithi110 ceph-mon[28069]: pgmap v18532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:32 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34467.536617 secs 2024-04-26T21:22:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:32 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34467.536617 secs 2024-04-26T21:22:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:32 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34467.536617 secs 2024-04-26T21:22:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:33 smithi196 ceph-mon[32572]: pgmap v18533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:22:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:33 smithi110 ceph-mon[28069]: pgmap v18533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:22:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:33 smithi193 ceph-mon[32782]: pgmap v18533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:22:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:35 smithi196 ceph-mon[32572]: pgmap v18534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:35 smithi110 ceph-mon[28069]: pgmap v18534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:35 smithi193 ceph-mon[32782]: pgmap v18534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:37 smithi196 ceph-mon[32572]: pgmap v18535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:37 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34472.536763 secs 2024-04-26T21:22:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:37 smithi110 ceph-mon[28069]: pgmap v18535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:37.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:37 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34472.536763 secs 2024-04-26T21:22:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:37 smithi193 ceph-mon[32782]: pgmap v18535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:22:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:37 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34472.536763 secs 2024-04-26T21:22:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:39 smithi196 ceph-mon[32572]: pgmap v18536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:22:39.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:39 smithi110 ceph-mon[28069]: pgmap v18536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:22:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:39 smithi193 ceph-mon[32782]: pgmap v18536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:22:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:41 smithi196 ceph-mon[32572]: pgmap v18537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:41 smithi110 ceph-mon[28069]: pgmap v18537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:41 smithi193 ceph-mon[32782]: pgmap v18537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:42.695 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34477.536859 secs 2024-04-26T21:22:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34477.536859 secs 2024-04-26T21:22:42.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34477.536859 secs 2024-04-26T21:22:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:43 smithi196 ceph-mon[32572]: pgmap v18538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:43 smithi110 ceph-mon[28069]: pgmap v18538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:43 smithi193 ceph-mon[32782]: pgmap v18538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:45 smithi196 ceph-mon[32572]: pgmap v18539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:22:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:45 smithi110 ceph-mon[28069]: pgmap v18539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:22:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:45 smithi193 ceph-mon[32782]: pgmap v18539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:22:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:47 smithi196 ceph-mon[32572]: pgmap v18540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34482.536947 secs 2024-04-26T21:22:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:47 smithi110 ceph-mon[28069]: pgmap v18540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34482.536947 secs 2024-04-26T21:22:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:47 smithi193 ceph-mon[32782]: pgmap v18540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34482.536947 secs 2024-04-26T21:22:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:49 smithi196 ceph-mon[32572]: pgmap v18541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:49 smithi110 ceph-mon[28069]: pgmap v18541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:49 smithi193 ceph-mon[32782]: pgmap v18541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:51 smithi196 ceph-mon[32572]: pgmap v18542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:51 smithi110 ceph-mon[28069]: pgmap v18542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:51 smithi193 ceph-mon[32782]: pgmap v18542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34487.537088 secs 2024-04-26T21:22:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34487.537088 secs 2024-04-26T21:22:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34487.537088 secs 2024-04-26T21:22:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:53 smithi196 ceph-mon[32572]: pgmap v18543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:53 smithi110 ceph-mon[28069]: pgmap v18543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:53 smithi193 ceph-mon[32782]: pgmap v18543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:55 smithi196 ceph-mon[32572]: pgmap v18544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:22:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:55 smithi110 ceph-mon[28069]: pgmap v18544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:22:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:55 smithi193 ceph-mon[32782]: pgmap v18544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:22:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:57 smithi196 ceph-mon[32572]: pgmap v18545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34492.537159 secs 2024-04-26T21:22:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:57 smithi110 ceph-mon[28069]: pgmap v18545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:57.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34492.537159 secs 2024-04-26T21:22:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:57 smithi193 ceph-mon[32782]: pgmap v18545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:22:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34492.537159 secs 2024-04-26T21:22:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:22:59 smithi196 ceph-mon[32572]: pgmap v18546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:22:59 smithi110 ceph-mon[28069]: pgmap v18546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:22:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:22:59 smithi193 ceph-mon[32782]: pgmap v18546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:01 smithi196 ceph-mon[32572]: pgmap v18547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:01 smithi110 ceph-mon[28069]: pgmap v18547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:01 smithi193 ceph-mon[32782]: pgmap v18547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34497.537302 secs 2024-04-26T21:23:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34497.537302 secs 2024-04-26T21:23:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34497.537302 secs 2024-04-26T21:23:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:03 smithi110 ceph-mon[28069]: pgmap v18548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:03 smithi193 ceph-mon[32782]: pgmap v18548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:03 smithi196 ceph-mon[32572]: pgmap v18548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:05 smithi110 ceph-mon[28069]: pgmap v18549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:23:05.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:05 smithi196 ceph-mon[32572]: pgmap v18549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:23:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:05 smithi193 ceph-mon[32782]: pgmap v18549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:23:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:07 smithi110 ceph-mon[28069]: pgmap v18550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:07.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34502.537426 secs 2024-04-26T21:23:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:07 smithi193 ceph-mon[32782]: pgmap v18550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34502.537426 secs 2024-04-26T21:23:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:07 smithi196 ceph-mon[32572]: pgmap v18550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34502.537426 secs 2024-04-26T21:23:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:09 smithi110 ceph-mon[28069]: pgmap v18551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:09 smithi193 ceph-mon[32782]: pgmap v18551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:09 smithi196 ceph-mon[32572]: pgmap v18551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:11 smithi110 ceph-mon[28069]: pgmap v18552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:11 smithi193 ceph-mon[32782]: pgmap v18552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:11 smithi196 ceph-mon[32572]: pgmap v18552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:12 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34507.537591 secs 2024-04-26T21:23:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:12 smithi193 ceph-mon[32782]: pgmap v18553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:12 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34507.537591 secs 2024-04-26T21:23:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:12 smithi196 ceph-mon[32572]: pgmap v18553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:12 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34507.537591 secs 2024-04-26T21:23:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:12 smithi110 ceph-mon[28069]: pgmap v18553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:15 smithi196 ceph-mon[32572]: pgmap v18554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:23:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:15 smithi110 ceph-mon[28069]: pgmap v18554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:23:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:15 smithi193 ceph-mon[32782]: pgmap v18554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:23:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:17 smithi196 ceph-mon[32572]: pgmap v18555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:17 smithi196 ceph-mon[32572]: 28 slow requests, 1 included below; oldest blocked for > 34512.537712 secs 2024-04-26T21:23:17.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:17 smithi196 ceph-mon[32572]: slow request 1440.574244 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:23:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:17 smithi110 ceph-mon[28069]: pgmap v18555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:17 smithi110 ceph-mon[28069]: 28 slow requests, 1 included below; oldest blocked for > 34512.537712 secs 2024-04-26T21:23:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:17 smithi110 ceph-mon[28069]: slow request 1440.574244 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:23:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:17 smithi193 ceph-mon[32782]: pgmap v18555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:17 smithi193 ceph-mon[32782]: 28 slow requests, 1 included below; oldest blocked for > 34512.537712 secs 2024-04-26T21:23:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:17 smithi193 ceph-mon[32782]: slow request 1440.574244 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:23:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:19 smithi196 ceph-mon[32572]: pgmap v18556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:19 smithi110 ceph-mon[28069]: pgmap v18556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:19 smithi193 ceph-mon[32782]: pgmap v18556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:21 smithi196 ceph-mon[32572]: pgmap v18557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:21 smithi110 ceph-mon[28069]: pgmap v18557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:21 smithi193 ceph-mon[32782]: pgmap v18557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:22 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34517.537839 secs 2024-04-26T21:23:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:22 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34517.537839 secs 2024-04-26T21:23:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:22 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34517.537839 secs 2024-04-26T21:23:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:23 smithi196 ceph-mon[32572]: pgmap v18558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:23 smithi110 ceph-mon[28069]: pgmap v18558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:23 smithi193 ceph-mon[32782]: pgmap v18558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:25.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:25 smithi196 ceph-mon[32572]: pgmap v18559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:23:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:25 smithi110 ceph-mon[28069]: pgmap v18559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:23:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:25 smithi193 ceph-mon[32782]: pgmap v18559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:23:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:27 smithi196 ceph-mon[32572]: pgmap v18560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:27 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34522.537955 secs 2024-04-26T21:23:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:27 smithi110 ceph-mon[28069]: pgmap v18560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:27 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34522.537955 secs 2024-04-26T21:23:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:27 smithi193 ceph-mon[32782]: pgmap v18560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:27 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34522.537955 secs 2024-04-26T21:23:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:29 smithi196 ceph-mon[32572]: pgmap v18561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:29.763 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:29 smithi110 ceph-mon[28069]: pgmap v18561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:29.763 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:29.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:29 smithi193 ceph-mon[32782]: pgmap v18561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:29.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: pgmap v18562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: pgmap v18562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: pgmap v18562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:31.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:23:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:23:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:23:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:23:32.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:32 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34527.538076 secs 2024-04-26T21:23:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:23:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:23:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:23:32.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:23:32.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:32 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34527.538076 secs 2024-04-26T21:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:32.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:23:32.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:23:32.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:32 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34527.538076 secs 2024-04-26T21:23:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:33 smithi110 ceph-mon[28069]: pgmap v18563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:33.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:33 smithi193 ceph-mon[32782]: pgmap v18563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:33 smithi196 ceph-mon[32572]: pgmap v18563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:23:34.882 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:23:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:23:35.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:23:35.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:23:35.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:23:35.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:23:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:35 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:23:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:35 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:23:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:35 smithi193 ceph-mon[32782]: pgmap v18564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 2 op/s 2024-04-26T21:23:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:35 smithi193 ceph-mon[32782]: pgmap v18565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:35.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:35 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:23:35.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:35 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:23:35.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:35 smithi196 ceph-mon[32572]: pgmap v18564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 2 op/s 2024-04-26T21:23:35.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:35 smithi196 ceph-mon[32572]: pgmap v18565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:35 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:23:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:35 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:23:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:35 smithi110 ceph-mon[28069]: pgmap v18564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 2 op/s 2024-04-26T21:23:36.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:35 smithi110 ceph-mon[28069]: pgmap v18565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:37 smithi193 ceph-mon[32782]: pgmap v18566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:37 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34532.538234 secs 2024-04-26T21:23:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:37 smithi196 ceph-mon[32572]: pgmap v18566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:37 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34532.538234 secs 2024-04-26T21:23:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:37 smithi110 ceph-mon[28069]: pgmap v18566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:37 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34532.538234 secs 2024-04-26T21:23:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:39 smithi193 ceph-mon[32782]: pgmap v18567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:39 smithi196 ceph-mon[32572]: pgmap v18567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:39 smithi110 ceph-mon[28069]: pgmap v18567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:41 smithi193 ceph-mon[32782]: pgmap v18568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:41 smithi196 ceph-mon[32572]: pgmap v18568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:41 smithi110 ceph-mon[28069]: pgmap v18568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34537.538307 secs 2024-04-26T21:23:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34537.538307 secs 2024-04-26T21:23:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34537.538307 secs 2024-04-26T21:23:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:43 smithi193 ceph-mon[32782]: pgmap v18569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T21:23:43.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:43 smithi110 ceph-mon[28069]: pgmap v18569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T21:23:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:43 smithi196 ceph-mon[32572]: pgmap v18569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T21:23:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:45 smithi193 ceph-mon[32782]: pgmap v18570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:23:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:45 smithi196 ceph-mon[32572]: pgmap v18570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:23:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:45 smithi110 ceph-mon[28069]: pgmap v18570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:23:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:47 smithi193 ceph-mon[32782]: pgmap v18571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34542.538430 secs 2024-04-26T21:23:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:47 smithi196 ceph-mon[32572]: pgmap v18571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34542.538430 secs 2024-04-26T21:23:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:47 smithi110 ceph-mon[28069]: pgmap v18571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34542.538430 secs 2024-04-26T21:23:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:49 smithi193 ceph-mon[32782]: pgmap v18572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:49 smithi196 ceph-mon[32572]: pgmap v18572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:49 smithi110 ceph-mon[28069]: pgmap v18572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:51 smithi193 ceph-mon[32782]: pgmap v18573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:51 smithi196 ceph-mon[32572]: pgmap v18573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:51 smithi110 ceph-mon[28069]: pgmap v18573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34547.538550 secs 2024-04-26T21:23:53.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34547.538550 secs 2024-04-26T21:23:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34547.538550 secs 2024-04-26T21:23:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:53 smithi193 ceph-mon[32782]: pgmap v18574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:53 smithi196 ceph-mon[32572]: pgmap v18574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:53 smithi110 ceph-mon[28069]: pgmap v18574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:55.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:55 smithi193 ceph-mon[32782]: pgmap v18575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:55 smithi196 ceph-mon[32572]: pgmap v18575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:55 smithi110 ceph-mon[28069]: pgmap v18575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:23:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:57 smithi196 ceph-mon[32572]: pgmap v18576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34552.538681 secs 2024-04-26T21:23:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:57 smithi110 ceph-mon[28069]: pgmap v18576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34552.538681 secs 2024-04-26T21:23:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:57 smithi193 ceph-mon[32782]: pgmap v18576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:23:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34552.538681 secs 2024-04-26T21:24:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:23:59 smithi196 ceph-mon[32572]: pgmap v18577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:23:59 smithi110 ceph-mon[28069]: pgmap v18577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:23:59 smithi193 ceph-mon[32782]: pgmap v18577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:01 smithi196 ceph-mon[32572]: pgmap v18578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:01 smithi110 ceph-mon[28069]: pgmap v18578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:01 smithi193 ceph-mon[32782]: pgmap v18578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34557.538805 secs 2024-04-26T21:24:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34557.538805 secs 2024-04-26T21:24:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34557.538805 secs 2024-04-26T21:24:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:03 smithi196 ceph-mon[32572]: pgmap v18579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:03 smithi110 ceph-mon[28069]: pgmap v18579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:03 smithi193 ceph-mon[32782]: pgmap v18579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:05 smithi196 ceph-mon[32572]: pgmap v18580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:05 smithi110 ceph-mon[28069]: pgmap v18580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:05 smithi193 ceph-mon[32782]: pgmap v18580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:07 smithi196 ceph-mon[32572]: pgmap v18581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34562.538947 secs 2024-04-26T21:24:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:07 smithi110 ceph-mon[28069]: pgmap v18581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34562.538947 secs 2024-04-26T21:24:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:07 smithi193 ceph-mon[32782]: pgmap v18581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34562.538947 secs 2024-04-26T21:24:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:09 smithi196 ceph-mon[32572]: pgmap v18582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:09 smithi110 ceph-mon[28069]: pgmap v18582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:09 smithi193 ceph-mon[32782]: pgmap v18582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:11 smithi196 ceph-mon[32572]: pgmap v18583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:11 smithi110 ceph-mon[28069]: pgmap v18583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:11 smithi193 ceph-mon[32782]: pgmap v18583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:12 smithi193 ceph-mon[32782]: pgmap v18584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:12 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34567.539018 secs 2024-04-26T21:24:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:12 smithi196 ceph-mon[32572]: pgmap v18584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:12 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34567.539018 secs 2024-04-26T21:24:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:12 smithi110 ceph-mon[28069]: pgmap v18584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:13.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:12 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34567.539018 secs 2024-04-26T21:24:15.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:14 smithi110 ceph-mon[28069]: pgmap v18585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:14 smithi193 ceph-mon[32782]: pgmap v18585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:14 smithi196 ceph-mon[32572]: pgmap v18585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:17.102 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:16 smithi110 ceph-mon[28069]: pgmap v18586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:16 smithi193 ceph-mon[32782]: pgmap v18586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:16 smithi196 ceph-mon[32572]: pgmap v18586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:24:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:24:17.099+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:24:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:24:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:24:17.099+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:24:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:24:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:24:17.099+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:24:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:24:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:24:17.099+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:24:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:24:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:24:17.099+0000 7f1b4e200700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:24:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:17 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34572.539115 secs 2024-04-26T21:24:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:17 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34572.539115 secs 2024-04-26T21:24:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:17 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34572.539115 secs 2024-04-26T21:24:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:18 smithi193 ceph-mon[32782]: pgmap v18587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:18 smithi196 ceph-mon[32572]: pgmap v18587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:18 smithi110 ceph-mon[28069]: pgmap v18587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:20 smithi193 ceph-mon[32782]: pgmap v18588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:20 smithi196 ceph-mon[32572]: pgmap v18588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:20 smithi110 ceph-mon[28069]: pgmap v18588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:24:22.105+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:24:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:24:22.105+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:24:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:24:22.106+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 266 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:24:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:24:22.106+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 266 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:24:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:22 smithi193 ceph-mon[32782]: pgmap v18589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:22 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34577.539252 secs 2024-04-26T21:24:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:22 smithi196 ceph-mon[32572]: pgmap v18589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:22 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34577.539252 secs 2024-04-26T21:24:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:22 smithi110 ceph-mon[28069]: pgmap v18589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:23.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:22 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34577.539252 secs 2024-04-26T21:24:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:24 smithi196 ceph-mon[32572]: pgmap v18590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:24 smithi110 ceph-mon[28069]: pgmap v18590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:24 smithi193 ceph-mon[32782]: pgmap v18590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:26 smithi196 ceph-mon[32572]: pgmap v18591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:26 smithi110 ceph-mon[28069]: pgmap v18591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:26 smithi193 ceph-mon[32782]: pgmap v18591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:27 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34582.539319 secs 2024-04-26T21:24:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:27 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34582.539319 secs 2024-04-26T21:24:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:27 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34582.539319 secs 2024-04-26T21:24:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:28 smithi196 ceph-mon[32572]: pgmap v18592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:28 smithi110 ceph-mon[28069]: pgmap v18592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:29.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:28 smithi193 ceph-mon[32782]: pgmap v18592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:24:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:30 smithi196 ceph-mon[32572]: pgmap v18593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:24:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:30 smithi110 ceph-mon[28069]: pgmap v18593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:24:31.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:30 smithi193 ceph-mon[32782]: pgmap v18593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:24:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:32 smithi196 ceph-mon[32572]: pgmap v18594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:24:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:32 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34587.539446 secs 2024-04-26T21:24:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:32 smithi110 ceph-mon[28069]: pgmap v18594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:24:33.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:32 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34587.539446 secs 2024-04-26T21:24:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:32 smithi193 ceph-mon[32782]: pgmap v18594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-04-26T21:24:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:32 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34587.539446 secs 2024-04-26T21:24:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:34 smithi196 ceph-mon[32572]: pgmap v18595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:24:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:34 smithi110 ceph-mon[28069]: pgmap v18595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:24:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:34 smithi193 ceph-mon[32782]: pgmap v18595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:24:35.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:35 smithi196 ceph-mon[32572]: pgmap v18596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T21:24:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:35 smithi196 ceph-mon[32572]: pgmap v18597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:24:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:35 smithi110 ceph-mon[28069]: pgmap v18596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T21:24:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:35 smithi110 ceph-mon[28069]: pgmap v18597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:36.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:24:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:35 smithi193 ceph-mon[32782]: pgmap v18596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T21:24:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:35 smithi193 ceph-mon[32782]: pgmap v18597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:36.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:24:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:37 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34592.539593 secs 2024-04-26T21:24:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:37 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34592.539593 secs 2024-04-26T21:24:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:37 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34592.539593 secs 2024-04-26T21:24:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:38 smithi196 ceph-mon[32572]: pgmap v18598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:24:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:38 smithi110 ceph-mon[28069]: pgmap v18598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:24:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:38 smithi193 ceph-mon[32782]: pgmap v18598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:24:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:40 smithi196 ceph-mon[32572]: pgmap v18599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:40 smithi110 ceph-mon[28069]: pgmap v18599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:40 smithi193 ceph-mon[32782]: pgmap v18599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:42.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:42 smithi196 ceph-mon[32572]: pgmap v18600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:42.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34597.539707 secs 2024-04-26T21:24:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:42 smithi110 ceph-mon[28069]: pgmap v18600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:42.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34597.539707 secs 2024-04-26T21:24:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:42 smithi193 ceph-mon[32782]: pgmap v18600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34597.539707 secs 2024-04-26T21:24:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:44 smithi196 ceph-mon[32572]: pgmap v18601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:44.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:44 smithi110 ceph-mon[28069]: pgmap v18601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:44 smithi193 ceph-mon[32782]: pgmap v18601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:24:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:46 smithi196 ceph-mon[32572]: pgmap v18602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:24:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:46 smithi110 ceph-mon[28069]: pgmap v18602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:24:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:46 smithi193 ceph-mon[32782]: pgmap v18602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:24:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34602.539851 secs 2024-04-26T21:24:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34602.539851 secs 2024-04-26T21:24:47.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34602.539851 secs 2024-04-26T21:24:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:48 smithi196 ceph-mon[32572]: pgmap v18603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:48 smithi110 ceph-mon[28069]: pgmap v18603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:48 smithi193 ceph-mon[32782]: pgmap v18603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:50 smithi196 ceph-mon[32572]: pgmap v18604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:24:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:50 smithi110 ceph-mon[28069]: pgmap v18604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:24:50.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:50 smithi193 ceph-mon[32782]: pgmap v18604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:24:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:52 smithi196 ceph-mon[32572]: pgmap v18605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34607.539970 secs 2024-04-26T21:24:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:52 smithi110 ceph-mon[28069]: pgmap v18605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:52.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34607.539970 secs 2024-04-26T21:24:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:52 smithi193 ceph-mon[32782]: pgmap v18605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34607.539970 secs 2024-04-26T21:24:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:54 smithi196 ceph-mon[32572]: pgmap v18606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:54 smithi110 ceph-mon[28069]: pgmap v18606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:54 smithi193 ceph-mon[32782]: pgmap v18606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:56 smithi196 ceph-mon[32572]: pgmap v18607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:56 smithi110 ceph-mon[28069]: pgmap v18607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:56 smithi193 ceph-mon[32782]: pgmap v18607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:24:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34612.540073 secs 2024-04-26T21:24:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34612.540073 secs 2024-04-26T21:24:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34612.540073 secs 2024-04-26T21:24:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:24:58 smithi110 ceph-mon[28069]: pgmap v18608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:24:58 smithi193 ceph-mon[32782]: pgmap v18608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:24:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:24:58 smithi196 ceph-mon[32572]: pgmap v18608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:00 smithi110 ceph-mon[28069]: pgmap v18609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:25:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:00 smithi193 ceph-mon[32782]: pgmap v18609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:25:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:00 smithi196 ceph-mon[32572]: pgmap v18609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:25:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:02 smithi110 ceph-mon[28069]: pgmap v18610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:02.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34617.540193 secs 2024-04-26T21:25:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:02 smithi193 ceph-mon[32782]: pgmap v18610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34617.540193 secs 2024-04-26T21:25:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:02 smithi196 ceph-mon[32572]: pgmap v18610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34617.540193 secs 2024-04-26T21:25:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:04 smithi110 ceph-mon[28069]: pgmap v18611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:04 smithi193 ceph-mon[32782]: pgmap v18611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:04 smithi196 ceph-mon[32572]: pgmap v18611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:06 smithi110 ceph-mon[28069]: pgmap v18612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:25:06.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:06 smithi196 ceph-mon[32572]: pgmap v18612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:25:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:06 smithi193 ceph-mon[32782]: pgmap v18612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:25:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34622.540331 secs 2024-04-26T21:25:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34622.540331 secs 2024-04-26T21:25:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34622.540331 secs 2024-04-26T21:25:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:08 smithi193 ceph-mon[32782]: pgmap v18613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:08 smithi196 ceph-mon[32572]: pgmap v18613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:08 smithi110 ceph-mon[28069]: pgmap v18613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:10 smithi193 ceph-mon[32782]: pgmap v18614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:10 smithi196 ceph-mon[32572]: pgmap v18614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:10 smithi110 ceph-mon[28069]: pgmap v18614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:12 smithi193 ceph-mon[32782]: pgmap v18615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:25:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:12 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34627.540414 secs 2024-04-26T21:25:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:12 smithi196 ceph-mon[32572]: pgmap v18615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:25:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:12 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34627.540414 secs 2024-04-26T21:25:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:12 smithi110 ceph-mon[28069]: pgmap v18615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:25:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:12 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34627.540414 secs 2024-04-26T21:25:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:14 smithi193 ceph-mon[32782]: pgmap v18616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:14 smithi196 ceph-mon[32572]: pgmap v18616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:14 smithi110 ceph-mon[28069]: pgmap v18616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:25:16.844 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:16 smithi110 ceph-mon[28069]: pgmap v18617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:16 smithi193 ceph-mon[32782]: pgmap v18617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:16 smithi196 ceph-mon[32572]: pgmap v18617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:17 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34632.540541 secs 2024-04-26T21:25:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:17 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34632.540541 secs 2024-04-26T21:25:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:17 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34632.540541 secs 2024-04-26T21:25:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:18 smithi193 ceph-mon[32782]: pgmap v18618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:18 smithi196 ceph-mon[32572]: pgmap v18618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:18 smithi110 ceph-mon[28069]: pgmap v18618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:20 smithi193 ceph-mon[32782]: pgmap v18619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:25:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:20 smithi196 ceph-mon[32572]: pgmap v18619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:25:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:20 smithi110 ceph-mon[28069]: pgmap v18619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:25:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:22 smithi193 ceph-mon[32782]: pgmap v18620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:22 smithi193 ceph-mon[32782]: 28 slow requests, 1 included below; oldest blocked for > 34637.540669 secs 2024-04-26T21:25:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:22 smithi193 ceph-mon[32782]: slow request 364.955736 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:25:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:22 smithi196 ceph-mon[32572]: pgmap v18620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:22 smithi196 ceph-mon[32572]: 28 slow requests, 1 included below; oldest blocked for > 34637.540669 secs 2024-04-26T21:25:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:22 smithi196 ceph-mon[32572]: slow request 364.955736 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:25:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:22 smithi110 ceph-mon[28069]: pgmap v18620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:22 smithi110 ceph-mon[28069]: 28 slow requests, 1 included below; oldest blocked for > 34637.540669 secs 2024-04-26T21:25:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:22 smithi110 ceph-mon[28069]: slow request 364.955736 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:25:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:24 smithi193 ceph-mon[32782]: pgmap v18621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:24 smithi196 ceph-mon[32572]: pgmap v18621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:24 smithi110 ceph-mon[28069]: pgmap v18621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:26 smithi193 ceph-mon[32782]: pgmap v18622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:26 smithi196 ceph-mon[32572]: pgmap v18622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:26 smithi110 ceph-mon[28069]: pgmap v18622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:27 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34642.540788 secs 2024-04-26T21:25:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:27 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34642.540788 secs 2024-04-26T21:25:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:27 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34642.540788 secs 2024-04-26T21:25:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:28 smithi193 ceph-mon[32782]: pgmap v18623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:28 smithi196 ceph-mon[32572]: pgmap v18623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:28 smithi110 ceph-mon[28069]: pgmap v18623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:30 smithi196 ceph-mon[32572]: pgmap v18624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:25:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:30 smithi110 ceph-mon[28069]: pgmap v18624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:25:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:30 smithi193 ceph-mon[32782]: pgmap v18624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:25:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:32 smithi196 ceph-mon[32572]: pgmap v18625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:32 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34647.540901 secs 2024-04-26T21:25:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:32 smithi110 ceph-mon[28069]: pgmap v18625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:32 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34647.540901 secs 2024-04-26T21:25:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:32 smithi193 ceph-mon[32782]: pgmap v18625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:32 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34647.540901 secs 2024-04-26T21:25:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:34 smithi196 ceph-mon[32572]: pgmap v18626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:34 smithi110 ceph-mon[28069]: pgmap v18626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:34 smithi193 ceph-mon[32782]: pgmap v18626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:36 smithi196 ceph-mon[32572]: pgmap v18627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:36 smithi110 ceph-mon[28069]: pgmap v18627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:36 smithi193 ceph-mon[32782]: pgmap v18627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:37 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34652.541028 secs 2024-04-26T21:25:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:25:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:25:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:25:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:37 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34652.541028 secs 2024-04-26T21:25:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:25:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:25:38.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:25:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:37 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34652.541028 secs 2024-04-26T21:25:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:25:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:25:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:25:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:38 smithi196 ceph-mon[32572]: pgmap v18628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:25:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:38 smithi196 ceph-mon[32572]: pgmap v18629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T21:25:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:38 smithi110 ceph-mon[28069]: pgmap v18628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:25:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:38 smithi110 ceph-mon[28069]: pgmap v18629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T21:25:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:38 smithi193 ceph-mon[32782]: pgmap v18628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:25:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:38 smithi193 ceph-mon[32782]: pgmap v18629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T21:25:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:40 smithi196 ceph-mon[32572]: pgmap v18630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:40 smithi110 ceph-mon[28069]: pgmap v18630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:40 smithi193 ceph-mon[32782]: pgmap v18630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:42 smithi196 ceph-mon[32572]: pgmap v18631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34657.541157 secs 2024-04-26T21:25:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:42 smithi110 ceph-mon[28069]: pgmap v18631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34657.541157 secs 2024-04-26T21:25:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:42 smithi193 ceph-mon[32782]: pgmap v18631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34657.541157 secs 2024-04-26T21:25:44.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:44 smithi193 ceph-mon[32782]: pgmap v18632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:44 smithi196 ceph-mon[32572]: pgmap v18632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:44 smithi110 ceph-mon[28069]: pgmap v18632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:46 smithi196 ceph-mon[32572]: pgmap v18633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:46 smithi110 ceph-mon[28069]: pgmap v18633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:46 smithi193 ceph-mon[32782]: pgmap v18633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:25:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34662.541260 secs 2024-04-26T21:25:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34662.541260 secs 2024-04-26T21:25:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34662.541260 secs 2024-04-26T21:25:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:48 smithi196 ceph-mon[32572]: pgmap v18634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:25:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:48 smithi110 ceph-mon[28069]: pgmap v18634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:25:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:48 smithi193 ceph-mon[32782]: pgmap v18634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:25:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:50 smithi196 ceph-mon[32572]: pgmap v18635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:50 smithi110 ceph-mon[28069]: pgmap v18635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:50 smithi193 ceph-mon[32782]: pgmap v18635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:25:52.120+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:25:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:25:52.120+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:25:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:25:52.121+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 267 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:25:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:25:52.121+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 267 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:25:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:52 smithi196 ceph-mon[32572]: pgmap v18636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34667.541406 secs 2024-04-26T21:25:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:52 smithi110 ceph-mon[28069]: pgmap v18636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34667.541406 secs 2024-04-26T21:25:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:52 smithi193 ceph-mon[32782]: pgmap v18636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34667.541406 secs 2024-04-26T21:25:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:54 smithi196 ceph-mon[32572]: pgmap v18637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:54 smithi110 ceph-mon[28069]: pgmap v18637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:54 smithi193 ceph-mon[32782]: pgmap v18637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:25:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:56 smithi196 ceph-mon[32572]: pgmap v18638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:56 smithi110 ceph-mon[28069]: pgmap v18638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:56 smithi193 ceph-mon[32782]: pgmap v18638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34672.541523 secs 2024-04-26T21:25:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34672.541523 secs 2024-04-26T21:25:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34672.541523 secs 2024-04-26T21:25:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:25:58 smithi196 ceph-mon[32572]: pgmap v18639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:25:58 smithi110 ceph-mon[28069]: pgmap v18639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:25:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:25:58 smithi193 ceph-mon[32782]: pgmap v18639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:00 smithi196 ceph-mon[32572]: pgmap v18640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:00 smithi110 ceph-mon[28069]: pgmap v18640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:00 smithi193 ceph-mon[32782]: pgmap v18640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:02 smithi196 ceph-mon[32572]: pgmap v18641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34677.541643 secs 2024-04-26T21:26:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:02 smithi110 ceph-mon[28069]: pgmap v18641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:03.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34677.541643 secs 2024-04-26T21:26:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:02 smithi193 ceph-mon[32782]: pgmap v18641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34677.541643 secs 2024-04-26T21:26:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:04 smithi196 ceph-mon[32572]: pgmap v18642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:04 smithi110 ceph-mon[28069]: pgmap v18642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:04 smithi193 ceph-mon[32782]: pgmap v18642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:06 smithi196 ceph-mon[32572]: pgmap v18643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:06 smithi110 ceph-mon[28069]: pgmap v18643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:06 smithi193 ceph-mon[32782]: pgmap v18643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34682.541762 secs 2024-04-26T21:26:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34682.541762 secs 2024-04-26T21:26:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34682.541762 secs 2024-04-26T21:26:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:08 smithi196 ceph-mon[32572]: pgmap v18644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:08 smithi110 ceph-mon[28069]: pgmap v18644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:08 smithi193 ceph-mon[32782]: pgmap v18644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:10 smithi196 ceph-mon[32572]: pgmap v18645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:10 smithi110 ceph-mon[28069]: pgmap v18645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:10 smithi193 ceph-mon[32782]: pgmap v18645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:11 smithi110 ceph-mon[28069]: pgmap v18646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:11 smithi193 ceph-mon[32782]: pgmap v18646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:11 smithi196 ceph-mon[32572]: pgmap v18646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:12 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34687.541881 secs 2024-04-26T21:26:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:12 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34687.541881 secs 2024-04-26T21:26:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:12 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34687.541881 secs 2024-04-26T21:26:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:13 smithi196 ceph-mon[32572]: pgmap v18647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:14.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:13 smithi193 ceph-mon[32782]: pgmap v18647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:13 smithi110 ceph-mon[28069]: pgmap v18647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:16 smithi196 ceph-mon[32572]: pgmap v18648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:16 smithi110 ceph-mon[28069]: pgmap v18648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:16 smithi193 ceph-mon[32782]: pgmap v18648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:18 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34692.541999 secs 2024-04-26T21:26:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:18 smithi196 ceph-mon[32572]: pgmap v18649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:18 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34692.541999 secs 2024-04-26T21:26:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:18 smithi110 ceph-mon[28069]: pgmap v18649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:18 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34692.541999 secs 2024-04-26T21:26:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:18 smithi193 ceph-mon[32782]: pgmap v18649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:20 smithi196 ceph-mon[32572]: pgmap v18650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:20 smithi110 ceph-mon[28069]: pgmap v18650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:20 smithi193 ceph-mon[32782]: pgmap v18650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:22 smithi196 ceph-mon[32572]: pgmap v18651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:22 smithi110 ceph-mon[28069]: pgmap v18651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:22 smithi193 ceph-mon[32782]: pgmap v18651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:23 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34697.542117 secs 2024-04-26T21:26:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:23 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34697.542117 secs 2024-04-26T21:26:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:23 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34697.542117 secs 2024-04-26T21:26:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:24 smithi196 ceph-mon[32572]: pgmap v18652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:24 smithi110 ceph-mon[28069]: pgmap v18652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:24 smithi193 ceph-mon[32782]: pgmap v18652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:26 smithi196 ceph-mon[32572]: pgmap v18653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:26 smithi110 ceph-mon[28069]: pgmap v18653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:26 smithi193 ceph-mon[32782]: pgmap v18653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:28 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34702.542236 secs 2024-04-26T21:26:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:28 smithi196 ceph-mon[32572]: pgmap v18654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:28 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34702.542236 secs 2024-04-26T21:26:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:28 smithi110 ceph-mon[28069]: pgmap v18654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:28 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34702.542236 secs 2024-04-26T21:26:28.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:28 smithi193 ceph-mon[32782]: pgmap v18654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:30 smithi196 ceph-mon[32572]: pgmap v18655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:30 smithi110 ceph-mon[28069]: pgmap v18655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:30 smithi193 ceph-mon[32782]: pgmap v18655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:32 smithi196 ceph-mon[32572]: pgmap v18656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:32 smithi110 ceph-mon[28069]: pgmap v18656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:32 smithi193 ceph-mon[32782]: pgmap v18656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:33 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34707.542366 secs 2024-04-26T21:26:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:33 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34707.542366 secs 2024-04-26T21:26:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:33 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34707.542366 secs 2024-04-26T21:26:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:34 smithi196 ceph-mon[32572]: pgmap v18657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:34 smithi110 ceph-mon[28069]: pgmap v18657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:34.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:34 smithi193 ceph-mon[32782]: pgmap v18657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:36 smithi196 ceph-mon[32572]: pgmap v18658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:36 smithi110 ceph-mon[28069]: pgmap v18658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:36.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:36 smithi193 ceph-mon[32782]: pgmap v18658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:38 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34712.542470 secs 2024-04-26T21:26:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:38 smithi196 ceph-mon[32572]: pgmap v18659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:38 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34712.542470 secs 2024-04-26T21:26:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:38 smithi110 ceph-mon[28069]: pgmap v18659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:38 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34712.542470 secs 2024-04-26T21:26:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:38 smithi193 ceph-mon[32782]: pgmap v18659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:39 smithi196 ceph-mon[32572]: pgmap v18660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:26:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:39 smithi196 ceph-mon[32572]: pgmap v18661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:26:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:39.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:39.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:39 smithi110 ceph-mon[28069]: pgmap v18660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:26:39.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:39 smithi110 ceph-mon[28069]: pgmap v18661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:39.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:26:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:39 smithi193 ceph-mon[32782]: pgmap v18660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:26:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:39 smithi193 ceph-mon[32782]: pgmap v18661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:26:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:41 smithi193 ceph-mon[32782]: pgmap v18662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:41 smithi196 ceph-mon[32572]: pgmap v18662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:41 smithi110 ceph-mon[28069]: pgmap v18662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34717.542615 secs 2024-04-26T21:26:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34717.542615 secs 2024-04-26T21:26:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34717.542615 secs 2024-04-26T21:26:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:43 smithi196 ceph-mon[32572]: pgmap v18663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:44.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:43 smithi193 ceph-mon[32782]: pgmap v18663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:43 smithi110 ceph-mon[28069]: pgmap v18663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:45 smithi196 ceph-mon[32572]: pgmap v18664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:45 smithi110 ceph-mon[28069]: pgmap v18664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:45 smithi193 ceph-mon[32782]: pgmap v18664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:47 smithi196 ceph-mon[32572]: pgmap v18665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34722.542680 secs 2024-04-26T21:26:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:47 smithi110 ceph-mon[28069]: pgmap v18665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34722.542680 secs 2024-04-26T21:26:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:47 smithi193 ceph-mon[32782]: pgmap v18665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34722.542680 secs 2024-04-26T21:26:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:49 smithi196 ceph-mon[32572]: pgmap v18666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:26:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:49 smithi110 ceph-mon[28069]: pgmap v18666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:26:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:49 smithi193 ceph-mon[32782]: pgmap v18666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:26:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:51 smithi196 ceph-mon[32572]: pgmap v18667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:51 smithi110 ceph-mon[28069]: pgmap v18667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:51 smithi193 ceph-mon[32782]: pgmap v18667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34727.542778 secs 2024-04-26T21:26:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34727.542778 secs 2024-04-26T21:26:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34727.542778 secs 2024-04-26T21:26:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:53 smithi196 ceph-mon[32572]: pgmap v18668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:53 smithi110 ceph-mon[28069]: pgmap v18668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:53 smithi193 ceph-mon[32782]: pgmap v18668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:26:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:55 smithi196 ceph-mon[32572]: pgmap v18669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:55 smithi110 ceph-mon[28069]: pgmap v18669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:55 smithi193 ceph-mon[32782]: pgmap v18669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:57 smithi196 ceph-mon[32572]: pgmap v18670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34732.542858 secs 2024-04-26T21:26:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:57 smithi110 ceph-mon[28069]: pgmap v18670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34732.542858 secs 2024-04-26T21:26:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:57 smithi193 ceph-mon[32782]: pgmap v18670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:26:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34732.542858 secs 2024-04-26T21:27:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:26:59 smithi196 ceph-mon[32572]: pgmap v18671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:26:59 smithi110 ceph-mon[28069]: pgmap v18671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:26:59 smithi193 ceph-mon[32782]: pgmap v18671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:01 smithi196 ceph-mon[32572]: pgmap v18672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:01 smithi110 ceph-mon[28069]: pgmap v18672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:01 smithi193 ceph-mon[32782]: pgmap v18672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34737.542976 secs 2024-04-26T21:27:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34737.542976 secs 2024-04-26T21:27:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34737.542976 secs 2024-04-26T21:27:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:03 smithi196 ceph-mon[32572]: pgmap v18673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:03 smithi110 ceph-mon[28069]: pgmap v18673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:03 smithi193 ceph-mon[32782]: pgmap v18673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:05 smithi196 ceph-mon[32572]: pgmap v18674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:05 smithi110 ceph-mon[28069]: pgmap v18674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:05 smithi193 ceph-mon[32782]: pgmap v18674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:07 smithi196 ceph-mon[32572]: pgmap v18675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34742.543089 secs 2024-04-26T21:27:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:07 smithi110 ceph-mon[28069]: pgmap v18675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34742.543089 secs 2024-04-26T21:27:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:07 smithi193 ceph-mon[32782]: pgmap v18675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34742.543089 secs 2024-04-26T21:27:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:09 smithi196 ceph-mon[32572]: pgmap v18676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:09 smithi110 ceph-mon[28069]: pgmap v18676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:09 smithi193 ceph-mon[32782]: pgmap v18676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:11 smithi196 ceph-mon[32572]: pgmap v18677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:11 smithi110 ceph-mon[28069]: pgmap v18677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:11 smithi193 ceph-mon[32782]: pgmap v18677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:13.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:12 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34747.543214 secs 2024-04-26T21:27:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:12 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34747.543214 secs 2024-04-26T21:27:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:12 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34747.543214 secs 2024-04-26T21:27:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:13 smithi196 ceph-mon[32572]: pgmap v18678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:14.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:13 smithi193 ceph-mon[32782]: pgmap v18678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:13 smithi110 ceph-mon[28069]: pgmap v18678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:15 smithi196 ceph-mon[32572]: pgmap v18679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:15 smithi110 ceph-mon[28069]: pgmap v18679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:15 smithi193 ceph-mon[32782]: pgmap v18679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:17 smithi196 ceph-mon[32572]: pgmap v18680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:17 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34752.543358 secs 2024-04-26T21:27:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:17 smithi110 ceph-mon[28069]: pgmap v18680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:18.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:17 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34752.543358 secs 2024-04-26T21:27:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:17 smithi193 ceph-mon[32782]: pgmap v18680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:17 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34752.543358 secs 2024-04-26T21:27:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:19 smithi196 ceph-mon[32572]: pgmap v18681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:19 smithi110 ceph-mon[28069]: pgmap v18681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:19 smithi193 ceph-mon[32782]: pgmap v18681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:22.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:21 smithi196 ceph-mon[32572]: pgmap v18682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:21 smithi110 ceph-mon[28069]: pgmap v18682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:21 smithi193 ceph-mon[32782]: pgmap v18682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:27:22.136+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:27:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:27:22.136+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:27:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:27:22.136+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 268 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:27:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:27:22.136+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 268 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:27:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:22 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34757.543505 secs 2024-04-26T21:27:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:22 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34757.543505 secs 2024-04-26T21:27:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:22 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34757.543505 secs 2024-04-26T21:27:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:23 smithi110 ceph-mon[28069]: pgmap v18683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:23 smithi193 ceph-mon[32782]: pgmap v18683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:23 smithi196 ceph-mon[32572]: pgmap v18683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:25 smithi110 ceph-mon[28069]: pgmap v18684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:25 smithi193 ceph-mon[32782]: pgmap v18684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:25 smithi196 ceph-mon[32572]: pgmap v18684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:27 smithi110 ceph-mon[28069]: pgmap v18685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:28.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:27 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34762.543639 secs 2024-04-26T21:27:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:27 smithi193 ceph-mon[32782]: pgmap v18685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:27 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34762.543639 secs 2024-04-26T21:27:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:27 smithi196 ceph-mon[32572]: pgmap v18685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:27 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34762.543639 secs 2024-04-26T21:27:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:28 smithi110 ceph-mon[28069]: pgmap v18686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:28 smithi193 ceph-mon[32782]: pgmap v18686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:28 smithi196 ceph-mon[32572]: pgmap v18686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:31 smithi196 ceph-mon[32572]: pgmap v18687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:31 smithi110 ceph-mon[28069]: pgmap v18687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:31 smithi193 ceph-mon[32782]: pgmap v18687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:32 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34767.543761 secs 2024-04-26T21:27:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:32 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34767.543761 secs 2024-04-26T21:27:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:32 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34767.543761 secs 2024-04-26T21:27:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:33 smithi196 ceph-mon[32572]: pgmap v18688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:33 smithi110 ceph-mon[28069]: pgmap v18688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:33 smithi193 ceph-mon[32782]: pgmap v18688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:35 smithi196 ceph-mon[32572]: pgmap v18689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:35 smithi110 ceph-mon[28069]: pgmap v18689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:35 smithi193 ceph-mon[32782]: pgmap v18689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:37 smithi196 ceph-mon[32572]: pgmap v18690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:37 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34772.543827 secs 2024-04-26T21:27:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:37 smithi110 ceph-mon[28069]: pgmap v18690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:37 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34772.543827 secs 2024-04-26T21:27:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:37 smithi193 ceph-mon[32782]: pgmap v18690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:37 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34772.543827 secs 2024-04-26T21:27:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:39 smithi196 ceph-mon[32572]: pgmap v18691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:40.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:39 smithi110 ceph-mon[28069]: pgmap v18691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:40.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:39 smithi193 ceph-mon[32782]: pgmap v18691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:27:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:41.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:27:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:27:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:41 smithi196 ceph-mon[32572]: pgmap v18692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:27:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:41 smithi196 ceph-mon[32572]: pgmap v18693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:41 smithi110 ceph-mon[28069]: pgmap v18692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:27:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:41 smithi110 ceph-mon[28069]: pgmap v18693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:41 smithi193 ceph-mon[32782]: pgmap v18692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:27:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:41 smithi193 ceph-mon[32782]: pgmap v18693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34777.543930 secs 2024-04-26T21:27:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34777.543930 secs 2024-04-26T21:27:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34777.543930 secs 2024-04-26T21:27:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:43 smithi196 ceph-mon[32572]: pgmap v18694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:27:44.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:43 smithi193 ceph-mon[32782]: pgmap v18694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:27:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:43 smithi110 ceph-mon[28069]: pgmap v18694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:27:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:45 smithi196 ceph-mon[32572]: pgmap v18695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:45 smithi110 ceph-mon[28069]: pgmap v18695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:45 smithi193 ceph-mon[32782]: pgmap v18695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:47 smithi196 ceph-mon[32572]: pgmap v18696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34782.544057 secs 2024-04-26T21:27:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:47 smithi110 ceph-mon[28069]: pgmap v18696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34782.544057 secs 2024-04-26T21:27:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:47 smithi193 ceph-mon[32782]: pgmap v18696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34782.544057 secs 2024-04-26T21:27:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:49 smithi196 ceph-mon[32572]: pgmap v18697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:49 smithi110 ceph-mon[28069]: pgmap v18697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:49 smithi193 ceph-mon[32782]: pgmap v18697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:27:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:51 smithi196 ceph-mon[32572]: pgmap v18698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:27:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:51 smithi110 ceph-mon[28069]: pgmap v18698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:27:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:51 smithi193 ceph-mon[32782]: pgmap v18698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:27:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34787.544198 secs 2024-04-26T21:27:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34787.544198 secs 2024-04-26T21:27:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34787.544198 secs 2024-04-26T21:27:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:53 smithi196 ceph-mon[32572]: pgmap v18699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:53 smithi110 ceph-mon[28069]: pgmap v18699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:53 smithi193 ceph-mon[32782]: pgmap v18699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:55 smithi196 ceph-mon[32572]: pgmap v18700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:55 smithi110 ceph-mon[28069]: pgmap v18700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:55 smithi193 ceph-mon[32782]: pgmap v18700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:27:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:57 smithi196 ceph-mon[32572]: pgmap v18701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34792.544321 secs 2024-04-26T21:27:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:57 smithi110 ceph-mon[28069]: pgmap v18701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34792.544321 secs 2024-04-26T21:27:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:57 smithi193 ceph-mon[32782]: pgmap v18701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:27:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34792.544321 secs 2024-04-26T21:28:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:27:59 smithi196 ceph-mon[32572]: pgmap v18702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:27:59 smithi110 ceph-mon[28069]: pgmap v18702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:27:59 smithi193 ceph-mon[32782]: pgmap v18702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:01 smithi196 ceph-mon[32572]: pgmap v18703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:01 smithi110 ceph-mon[28069]: pgmap v18703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:01 smithi193 ceph-mon[32782]: pgmap v18703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34797.544445 secs 2024-04-26T21:28:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34797.544445 secs 2024-04-26T21:28:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34797.544445 secs 2024-04-26T21:28:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:03 smithi110 ceph-mon[28069]: pgmap v18704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:03 smithi193 ceph-mon[32782]: pgmap v18704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:03 smithi196 ceph-mon[32572]: pgmap v18704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:05 smithi110 ceph-mon[28069]: pgmap v18705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:05 smithi193 ceph-mon[32782]: pgmap v18705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:05 smithi196 ceph-mon[32572]: pgmap v18705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:07 smithi110 ceph-mon[28069]: pgmap v18706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34802.544608 secs 2024-04-26T21:28:08.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:07 smithi196 ceph-mon[32572]: pgmap v18706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:08.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34802.544608 secs 2024-04-26T21:28:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:07 smithi193 ceph-mon[32782]: pgmap v18706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34802.544608 secs 2024-04-26T21:28:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:09 smithi110 ceph-mon[28069]: pgmap v18707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:09 smithi193 ceph-mon[32782]: pgmap v18707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:09 smithi196 ceph-mon[32572]: pgmap v18707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:10 smithi193 ceph-mon[32782]: pgmap v18708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:10 smithi196 ceph-mon[32572]: pgmap v18708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:10 smithi110 ceph-mon[28069]: pgmap v18708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:13 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34807.544724 secs 2024-04-26T21:28:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:13 smithi196 ceph-mon[32572]: pgmap v18709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:13 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34807.544724 secs 2024-04-26T21:28:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:13 smithi110 ceph-mon[28069]: pgmap v18709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:13 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34807.544724 secs 2024-04-26T21:28:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:13 smithi193 ceph-mon[32782]: pgmap v18709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:15 smithi196 ceph-mon[32572]: pgmap v18710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:15 smithi110 ceph-mon[28069]: pgmap v18710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:15.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:15 smithi193 ceph-mon[32782]: pgmap v18710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:17 smithi196 ceph-mon[32572]: pgmap v18711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:17 smithi110 ceph-mon[28069]: pgmap v18711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:17 smithi193 ceph-mon[32782]: pgmap v18711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:18 smithi196 ceph-mon[32572]: 28 slow requests, 1 included below; oldest blocked for > 34812.544874 secs 2024-04-26T21:28:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:18 smithi196 ceph-mon[32572]: slow request 1440.352909 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:28:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:18 smithi110 ceph-mon[28069]: 28 slow requests, 1 included below; oldest blocked for > 34812.544874 secs 2024-04-26T21:28:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:18 smithi110 ceph-mon[28069]: slow request 1440.352909 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:28:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:18 smithi193 ceph-mon[32782]: 28 slow requests, 1 included below; oldest blocked for > 34812.544874 secs 2024-04-26T21:28:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:18 smithi193 ceph-mon[32782]: slow request 1440.352909 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:28:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:19 smithi196 ceph-mon[32572]: pgmap v18712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:19 smithi110 ceph-mon[28069]: pgmap v18712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:19 smithi193 ceph-mon[32782]: pgmap v18712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:21 smithi196 ceph-mon[32572]: pgmap v18713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:21 smithi110 ceph-mon[28069]: pgmap v18713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:21 smithi193 ceph-mon[32782]: pgmap v18713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:23 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34817.545006 secs 2024-04-26T21:28:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:23 smithi196 ceph-mon[32572]: pgmap v18714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:23 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34817.545006 secs 2024-04-26T21:28:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:23 smithi110 ceph-mon[28069]: pgmap v18714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:23 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34817.545006 secs 2024-04-26T21:28:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:23 smithi193 ceph-mon[32782]: pgmap v18714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:25 smithi196 ceph-mon[32572]: pgmap v18715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:25 smithi110 ceph-mon[28069]: pgmap v18715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:25 smithi193 ceph-mon[32782]: pgmap v18715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:27 smithi196 ceph-mon[32572]: pgmap v18716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:27 smithi110 ceph-mon[28069]: pgmap v18716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:27 smithi193 ceph-mon[32782]: pgmap v18716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:28 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34822.545123 secs 2024-04-26T21:28:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:28 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34822.545123 secs 2024-04-26T21:28:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:28 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34822.545123 secs 2024-04-26T21:28:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:29 smithi110 ceph-mon[28069]: pgmap v18717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:29 smithi193 ceph-mon[32782]: pgmap v18717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:29 smithi196 ceph-mon[32572]: pgmap v18717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:31 smithi110 ceph-mon[28069]: pgmap v18718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:31 smithi193 ceph-mon[32782]: pgmap v18718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:31 smithi196 ceph-mon[32572]: pgmap v18718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:33 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34827.545251 secs 2024-04-26T21:28:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:33 smithi110 ceph-mon[28069]: pgmap v18719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:33 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34827.545251 secs 2024-04-26T21:28:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:33 smithi193 ceph-mon[32782]: pgmap v18719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:33 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34827.545251 secs 2024-04-26T21:28:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:33 smithi196 ceph-mon[32572]: pgmap v18719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:35 smithi110 ceph-mon[28069]: pgmap v18720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:35 smithi193 ceph-mon[32782]: pgmap v18720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:35 smithi196 ceph-mon[32572]: pgmap v18720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:37.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:37 smithi110 ceph-mon[28069]: pgmap v18721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:37.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:37 smithi193 ceph-mon[32782]: pgmap v18721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:37.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:37 smithi196 ceph-mon[32572]: pgmap v18721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:38 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34832.545393 secs 2024-04-26T21:28:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:38 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34832.545393 secs 2024-04-26T21:28:38.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:38 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34832.545393 secs 2024-04-26T21:28:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:39 smithi193 ceph-mon[32782]: pgmap v18722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:39 smithi196 ceph-mon[32572]: pgmap v18722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:39 smithi110 ceph-mon[28069]: pgmap v18722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:41 smithi193 ceph-mon[32782]: pgmap v18723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:41.752 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:41 smithi196 ceph-mon[32572]: pgmap v18723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:41.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:41 smithi110 ceph-mon[28069]: pgmap v18723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:41.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:43 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34837.545470 secs 2024-04-26T21:28:43.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:43 smithi196 ceph-mon[32572]: pgmap v18724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:43 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34837.545470 secs 2024-04-26T21:28:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:43 smithi193 ceph-mon[32782]: pgmap v18724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:43 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34837.545470 secs 2024-04-26T21:28:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:43 smithi110 ceph-mon[28069]: pgmap v18724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:45 smithi193 ceph-mon[32782]: pgmap v18725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:28:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:45 smithi196 ceph-mon[32572]: pgmap v18725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:28:46.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:45 smithi110 ceph-mon[28069]: pgmap v18725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:28:46.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:28:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:46 smithi110 ceph-mon[28069]: pgmap v18726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 866 B/s rd, 1 op/s 2024-04-26T21:28:47.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:46 smithi110 ceph-mon[28069]: pgmap v18727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:28:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:46 smithi193 ceph-mon[32782]: pgmap v18726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 866 B/s rd, 1 op/s 2024-04-26T21:28:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:46 smithi193 ceph-mon[32782]: pgmap v18727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:28:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:46 smithi196 ceph-mon[32572]: pgmap v18726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 866 B/s rd, 1 op/s 2024-04-26T21:28:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:46 smithi196 ceph-mon[32572]: pgmap v18727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:28:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34842.545575 secs 2024-04-26T21:28:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34842.545575 secs 2024-04-26T21:28:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34842.545575 secs 2024-04-26T21:28:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:48 smithi110 ceph-mon[28069]: pgmap v18728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 474 B/s rd, 1 op/s 2024-04-26T21:28:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:48 smithi193 ceph-mon[32782]: pgmap v18728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 474 B/s rd, 1 op/s 2024-04-26T21:28:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:48 smithi196 ceph-mon[32572]: pgmap v18728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 474 B/s rd, 1 op/s 2024-04-26T21:28:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:49 smithi193 ceph-mon[32782]: pgmap v18729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:28:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:49 smithi196 ceph-mon[32572]: pgmap v18729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:28:50.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:49 smithi110 ceph-mon[28069]: pgmap v18729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:28:52.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:51 smithi193 ceph-mon[32782]: pgmap v18730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:28:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:51 smithi196 ceph-mon[32572]: pgmap v18730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:28:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:51 smithi110 ceph-mon[28069]: pgmap v18730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:28:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34847.545687 secs 2024-04-26T21:28:53.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34847.545687 secs 2024-04-26T21:28:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34847.545687 secs 2024-04-26T21:28:54.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:53 smithi193 ceph-mon[32782]: pgmap v18731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:53 smithi196 ceph-mon[32572]: pgmap v18731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:53 smithi110 ceph-mon[28069]: pgmap v18731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:28:56.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:55 smithi193 ceph-mon[32782]: pgmap v18732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:28:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:55 smithi196 ceph-mon[32572]: pgmap v18732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:28:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:55 smithi110 ceph-mon[28069]: pgmap v18732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:28:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:57 smithi193 ceph-mon[32782]: pgmap v18733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34852.545801 secs 2024-04-26T21:28:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:57 smithi196 ceph-mon[32572]: pgmap v18733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34852.545801 secs 2024-04-26T21:28:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:57 smithi110 ceph-mon[28069]: pgmap v18733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:28:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34852.545801 secs 2024-04-26T21:29:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:28:59 smithi193 ceph-mon[32782]: pgmap v18734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:28:59 smithi196 ceph-mon[32572]: pgmap v18734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:28:59 smithi110 ceph-mon[28069]: pgmap v18734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:01 smithi193 ceph-mon[32782]: pgmap v18735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:01 smithi196 ceph-mon[32572]: pgmap v18735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:01 smithi110 ceph-mon[28069]: pgmap v18735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34857.545914 secs 2024-04-26T21:29:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34857.545914 secs 2024-04-26T21:29:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34857.545914 secs 2024-04-26T21:29:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:03 smithi193 ceph-mon[32782]: pgmap v18736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:03 smithi196 ceph-mon[32572]: pgmap v18736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:03 smithi110 ceph-mon[28069]: pgmap v18736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:05 smithi193 ceph-mon[32782]: pgmap v18737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:05 smithi196 ceph-mon[32572]: pgmap v18737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:05 smithi110 ceph-mon[28069]: pgmap v18737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:07 smithi193 ceph-mon[32782]: pgmap v18738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34862.546065 secs 2024-04-26T21:29:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:07 smithi196 ceph-mon[32572]: pgmap v18738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34862.546065 secs 2024-04-26T21:29:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:07 smithi110 ceph-mon[28069]: pgmap v18738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34862.546065 secs 2024-04-26T21:29:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:09 smithi193 ceph-mon[32782]: pgmap v18739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:09 smithi196 ceph-mon[32572]: pgmap v18739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:09 smithi110 ceph-mon[28069]: pgmap v18739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:11 smithi193 ceph-mon[32782]: pgmap v18740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:11 smithi196 ceph-mon[32572]: pgmap v18740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:11 smithi110 ceph-mon[28069]: pgmap v18740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:12 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34867.546187 secs 2024-04-26T21:29:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:12 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34867.546187 secs 2024-04-26T21:29:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:12 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34867.546187 secs 2024-04-26T21:29:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:13 smithi196 ceph-mon[32572]: pgmap v18741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:14.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:13 smithi110 ceph-mon[28069]: pgmap v18741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:13 smithi193 ceph-mon[32782]: pgmap v18741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:16.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:15 smithi193 ceph-mon[32782]: pgmap v18742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:15 smithi196 ceph-mon[32572]: pgmap v18742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:15 smithi110 ceph-mon[28069]: pgmap v18742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:29:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:29:17.161+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:29:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:29:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:29:17.161+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:29:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:29:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:29:17.161+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:29:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:29:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:29:17.161+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:29:17.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:29:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:29:17.161+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:29:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:17 smithi196 ceph-mon[32572]: pgmap v18743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:17 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34872.546303 secs 2024-04-26T21:29:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:17 smithi110 ceph-mon[28069]: pgmap v18743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:17 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34872.546303 secs 2024-04-26T21:29:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:17 smithi193 ceph-mon[32782]: pgmap v18743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:18.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:17 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34872.546303 secs 2024-04-26T21:29:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:19 smithi196 ceph-mon[32572]: pgmap v18744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:19 smithi110 ceph-mon[28069]: pgmap v18744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:20.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:19 smithi193 ceph-mon[32782]: pgmap v18744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:21 smithi196 ceph-mon[32572]: pgmap v18745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:21 smithi110 ceph-mon[28069]: pgmap v18745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:21 smithi193 ceph-mon[32782]: pgmap v18745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:22 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34877.546426 secs 2024-04-26T21:29:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:22 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34877.546426 secs 2024-04-26T21:29:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:22 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34877.546426 secs 2024-04-26T21:29:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:23 smithi196 ceph-mon[32572]: pgmap v18746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:23 smithi110 ceph-mon[28069]: pgmap v18746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:23 smithi193 ceph-mon[32782]: pgmap v18746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:25 smithi196 ceph-mon[32572]: pgmap v18747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:25 smithi110 ceph-mon[28069]: pgmap v18747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:25 smithi193 ceph-mon[32782]: pgmap v18747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:27 smithi196 ceph-mon[32572]: pgmap v18748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:27 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34882.546550 secs 2024-04-26T21:29:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:27 smithi110 ceph-mon[28069]: pgmap v18748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:27 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34882.546550 secs 2024-04-26T21:29:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:27 smithi193 ceph-mon[32782]: pgmap v18748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:27 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34882.546550 secs 2024-04-26T21:29:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:29 smithi196 ceph-mon[32572]: pgmap v18749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:30.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:29 smithi110 ceph-mon[28069]: pgmap v18749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:29 smithi193 ceph-mon[32782]: pgmap v18749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:31 smithi196 ceph-mon[32572]: pgmap v18750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:31 smithi110 ceph-mon[28069]: pgmap v18750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:32.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:31 smithi193 ceph-mon[32782]: pgmap v18750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:32 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34887.546672 secs 2024-04-26T21:29:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:32 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34887.546672 secs 2024-04-26T21:29:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:32 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34887.546672 secs 2024-04-26T21:29:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:33 smithi196 ceph-mon[32572]: pgmap v18751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:33 smithi110 ceph-mon[28069]: pgmap v18751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:34.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:33 smithi193 ceph-mon[32782]: pgmap v18751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:35 smithi196 ceph-mon[32572]: pgmap v18752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:35 smithi110 ceph-mon[28069]: pgmap v18752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:35 smithi193 ceph-mon[32782]: pgmap v18752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:37 smithi196 ceph-mon[32572]: pgmap v18753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:37 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34892.546792 secs 2024-04-26T21:29:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:37 smithi110 ceph-mon[28069]: pgmap v18753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:38.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:37 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34892.546792 secs 2024-04-26T21:29:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:37 smithi193 ceph-mon[32782]: pgmap v18753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:37 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34892.546792 secs 2024-04-26T21:29:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:39 smithi196 ceph-mon[32572]: pgmap v18754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:39 smithi110 ceph-mon[28069]: pgmap v18754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:39 smithi193 ceph-mon[32782]: pgmap v18754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:41 smithi196 ceph-mon[32572]: pgmap v18755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:41 smithi110 ceph-mon[28069]: pgmap v18755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:41 smithi193 ceph-mon[32782]: pgmap v18755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34897.546928 secs 2024-04-26T21:29:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34897.546928 secs 2024-04-26T21:29:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34897.546928 secs 2024-04-26T21:29:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:43 smithi196 ceph-mon[32572]: pgmap v18756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:43 smithi110 ceph-mon[28069]: pgmap v18756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:44.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:43 smithi193 ceph-mon[32782]: pgmap v18756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:45 smithi196 ceph-mon[32572]: pgmap v18757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:45 smithi110 ceph-mon[28069]: pgmap v18757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:45 smithi193 ceph-mon[32782]: pgmap v18757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:29:46.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:29:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:46 smithi196 ceph-mon[32572]: pgmap v18758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T21:29:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:46 smithi196 ceph-mon[32572]: pgmap v18759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:29:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:29:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:46 smithi110 ceph-mon[28069]: pgmap v18758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T21:29:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:46 smithi110 ceph-mon[28069]: pgmap v18759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:47.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:29:47.357 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:47.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:29:47.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:46 smithi193 ceph-mon[32782]: pgmap v18758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T21:29:47.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:46 smithi193 ceph-mon[32782]: pgmap v18759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:47.358 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:29:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34902.546994 secs 2024-04-26T21:29:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34902.546994 secs 2024-04-26T21:29:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34902.546994 secs 2024-04-26T21:29:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:49 smithi110 ceph-mon[28069]: pgmap v18760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:49.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:49 smithi193 ceph-mon[32782]: pgmap v18760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:49 smithi196 ceph-mon[32572]: pgmap v18760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:51 smithi196 ceph-mon[32572]: pgmap v18761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:51 smithi110 ceph-mon[28069]: pgmap v18761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:51 smithi193 ceph-mon[32782]: pgmap v18761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34907.547060 secs 2024-04-26T21:29:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34907.547060 secs 2024-04-26T21:29:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34907.547060 secs 2024-04-26T21:29:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:53 smithi196 ceph-mon[32572]: pgmap v18762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:29:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:53 smithi110 ceph-mon[28069]: pgmap v18762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:29:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:53 smithi193 ceph-mon[32782]: pgmap v18762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:29:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:55 smithi196 ceph-mon[32572]: pgmap v18763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:55 smithi110 ceph-mon[28069]: pgmap v18763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:55 smithi193 ceph-mon[32782]: pgmap v18763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:29:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:57 smithi196 ceph-mon[32572]: pgmap v18764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:29:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34912.547166 secs 2024-04-26T21:29:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:57 smithi110 ceph-mon[28069]: pgmap v18764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:29:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34912.547166 secs 2024-04-26T21:29:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:57 smithi193 ceph-mon[32782]: pgmap v18764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:29:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34912.547166 secs 2024-04-26T21:29:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:29:59 smithi196 ceph-mon[32572]: pgmap v18765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:29:59 smithi110 ceph-mon[28069]: pgmap v18765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:29:59 smithi193 ceph-mon[32782]: pgmap v18765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:30:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:30:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:30:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:01 smithi196 ceph-mon[32572]: pgmap v18766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:01 smithi110 ceph-mon[28069]: pgmap v18766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:01 smithi193 ceph-mon[32782]: pgmap v18766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34917.547290 secs 2024-04-26T21:30:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34917.547290 secs 2024-04-26T21:30:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34917.547290 secs 2024-04-26T21:30:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:03 smithi196 ceph-mon[32572]: pgmap v18767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:03 smithi110 ceph-mon[28069]: pgmap v18767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:03 smithi193 ceph-mon[32782]: pgmap v18767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:05 smithi196 ceph-mon[32572]: pgmap v18768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:05 smithi110 ceph-mon[28069]: pgmap v18768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:05.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:05 smithi193 ceph-mon[32782]: pgmap v18768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:07 smithi196 ceph-mon[32572]: pgmap v18769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34922.547411 secs 2024-04-26T21:30:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:07 smithi110 ceph-mon[28069]: pgmap v18769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34922.547411 secs 2024-04-26T21:30:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:07 smithi193 ceph-mon[32782]: pgmap v18769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34922.547411 secs 2024-04-26T21:30:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:09 smithi196 ceph-mon[32572]: pgmap v18770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:09 smithi110 ceph-mon[28069]: pgmap v18770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:09.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:09 smithi193 ceph-mon[32782]: pgmap v18770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:11 smithi196 ceph-mon[32572]: pgmap v18771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:11 smithi110 ceph-mon[28069]: pgmap v18771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:11.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:11 smithi193 ceph-mon[32782]: pgmap v18771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:12 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34927.547548 secs 2024-04-26T21:30:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:12 smithi196 ceph-mon[32572]: pgmap v18772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:12 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34927.547548 secs 2024-04-26T21:30:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:12 smithi110 ceph-mon[28069]: pgmap v18772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:12 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34927.547548 secs 2024-04-26T21:30:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:12 smithi193 ceph-mon[32782]: pgmap v18772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:15 smithi196 ceph-mon[32572]: pgmap v18773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:15.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:15 smithi110 ceph-mon[28069]: pgmap v18773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:15 smithi193 ceph-mon[32782]: pgmap v18773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:17 smithi196 ceph-mon[32572]: pgmap v18774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:17 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34932.547646 secs 2024-04-26T21:30:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:17 smithi110 ceph-mon[28069]: pgmap v18774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:17 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34932.547646 secs 2024-04-26T21:30:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:17 smithi193 ceph-mon[32782]: pgmap v18774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:17 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34932.547646 secs 2024-04-26T21:30:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:19 smithi110 ceph-mon[28069]: pgmap v18775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:19 smithi196 ceph-mon[32572]: pgmap v18775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:19 smithi193 ceph-mon[32782]: pgmap v18775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:21 smithi196 ceph-mon[32572]: pgmap v18776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:21 smithi110 ceph-mon[28069]: pgmap v18776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:21 smithi193 ceph-mon[32782]: pgmap v18776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:30:22.164+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:30:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:30:22.164+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:30:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:30:22.166+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 269 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:30:22.168 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:30:22.166+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 269 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:30:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:22 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34937.547769 secs 2024-04-26T21:30:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:22 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34937.547769 secs 2024-04-26T21:30:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:22 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34937.547769 secs 2024-04-26T21:30:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:23 smithi196 ceph-mon[32572]: pgmap v18777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:23 smithi110 ceph-mon[28069]: pgmap v18777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:23.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:23 smithi193 ceph-mon[32782]: pgmap v18777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:25 smithi196 ceph-mon[32572]: pgmap v18778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:25 smithi110 ceph-mon[28069]: pgmap v18778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:25.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:25 smithi193 ceph-mon[32782]: pgmap v18778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:27 smithi196 ceph-mon[32572]: pgmap v18779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:27 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34942.547888 secs 2024-04-26T21:30:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:27 smithi110 ceph-mon[28069]: pgmap v18779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:27 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34942.547888 secs 2024-04-26T21:30:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:27 smithi193 ceph-mon[32782]: pgmap v18779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:27 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34942.547888 secs 2024-04-26T21:30:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:29 smithi196 ceph-mon[32572]: pgmap v18780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:29 smithi110 ceph-mon[28069]: pgmap v18780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:29 smithi193 ceph-mon[32782]: pgmap v18780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:31 smithi196 ceph-mon[32572]: pgmap v18781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:31 smithi110 ceph-mon[28069]: pgmap v18781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:31 smithi193 ceph-mon[32782]: pgmap v18781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:32 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34947.548030 secs 2024-04-26T21:30:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:32 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34947.548030 secs 2024-04-26T21:30:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:32 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34947.548030 secs 2024-04-26T21:30:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:33 smithi196 ceph-mon[32572]: pgmap v18782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:33 smithi110 ceph-mon[28069]: pgmap v18782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:33 smithi193 ceph-mon[32782]: pgmap v18782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:35 smithi196 ceph-mon[32572]: pgmap v18783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:35 smithi110 ceph-mon[28069]: pgmap v18783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:35.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:35 smithi193 ceph-mon[32782]: pgmap v18783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:30:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:37 smithi110 ceph-mon[28069]: pgmap v18784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:37 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34952.548167 secs 2024-04-26T21:30:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:37 smithi193 ceph-mon[32782]: pgmap v18784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:37 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34952.548167 secs 2024-04-26T21:30:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:37 smithi196 ceph-mon[32572]: pgmap v18784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:37 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34952.548167 secs 2024-04-26T21:30:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:39 smithi110 ceph-mon[28069]: pgmap v18785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:39.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:39 smithi196 ceph-mon[32572]: pgmap v18785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:39 smithi193 ceph-mon[32782]: pgmap v18785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:41 smithi110 ceph-mon[28069]: pgmap v18786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:41.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:41 smithi193 ceph-mon[32782]: pgmap v18786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:41 smithi196 ceph-mon[32572]: pgmap v18786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34957.548287 secs 2024-04-26T21:30:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34957.548287 secs 2024-04-26T21:30:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34957.548287 secs 2024-04-26T21:30:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:43 smithi110 ceph-mon[28069]: pgmap v18787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T21:30:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:43 smithi193 ceph-mon[32782]: pgmap v18787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T21:30:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:43 smithi196 ceph-mon[32572]: pgmap v18787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T21:30:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:45 smithi110 ceph-mon[28069]: pgmap v18788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:45.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:45 smithi193 ceph-mon[32782]: pgmap v18788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:45 smithi196 ceph-mon[32572]: pgmap v18788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:47 smithi110 ceph-mon[28069]: pgmap v18789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:47.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34962.548376 secs 2024-04-26T21:30:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:47 smithi193 ceph-mon[32782]: pgmap v18789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34962.548376 secs 2024-04-26T21:30:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:47 smithi196 ceph-mon[32572]: pgmap v18789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34962.548376 secs 2024-04-26T21:30:49.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:49 smithi193 ceph-mon[32782]: pgmap v18790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:49.889 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:49 smithi110 ceph-mon[28069]: pgmap v18790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:49 smithi196 ceph-mon[32572]: pgmap v18790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:51.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:51 smithi193 ceph-mon[32782]: pgmap v18791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:51 smithi196 ceph-mon[32572]: pgmap v18791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:51 smithi110 ceph-mon[28069]: pgmap v18791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:30:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34967.548488 secs 2024-04-26T21:30:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34967.548488 secs 2024-04-26T21:30:53.019 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34967.548488 secs 2024-04-26T21:30:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:53 smithi110 ceph-mon[28069]: pgmap v18792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:30:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:30:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:53.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:53 smithi193 ceph-mon[32782]: pgmap v18792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:30:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:30:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:53.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:53 smithi196 ceph-mon[32572]: pgmap v18792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:30:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:30:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:54 smithi193 ceph-mon[32782]: pgmap v18793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 917 B/s rd, 2 op/s 2024-04-26T21:30:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:54 smithi193 ceph-mon[32782]: pgmap v18794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:30:54.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:30:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:54 smithi196 ceph-mon[32572]: pgmap v18793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 917 B/s rd, 2 op/s 2024-04-26T21:30:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:54 smithi196 ceph-mon[32572]: pgmap v18794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:30:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:30:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:54 smithi110 ceph-mon[28069]: pgmap v18793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 917 B/s rd, 2 op/s 2024-04-26T21:30:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:54 smithi110 ceph-mon[28069]: pgmap v18794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:30:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:30:56.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:56 smithi193 ceph-mon[32782]: pgmap v18795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:30:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:56 smithi196 ceph-mon[32572]: pgmap v18795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:30:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:56 smithi110 ceph-mon[28069]: pgmap v18795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:30:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34972.548607 secs 2024-04-26T21:30:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34972.548607 secs 2024-04-26T21:30:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34972.548607 secs 2024-04-26T21:30:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:30:58 smithi193 ceph-mon[32782]: pgmap v18796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:30:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:30:58 smithi196 ceph-mon[32572]: pgmap v18796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:30:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:30:58 smithi110 ceph-mon[28069]: pgmap v18796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:31:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:00 smithi193 ceph-mon[32782]: pgmap v18797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:31:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:00 smithi196 ceph-mon[32572]: pgmap v18797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:31:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:00 smithi110 ceph-mon[28069]: pgmap v18797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:31:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:02 smithi193 ceph-mon[32782]: pgmap v18798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 558 B/s rd, 1 op/s 2024-04-26T21:31:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34977.548730 secs 2024-04-26T21:31:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:02 smithi196 ceph-mon[32572]: pgmap v18798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 558 B/s rd, 1 op/s 2024-04-26T21:31:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34977.548730 secs 2024-04-26T21:31:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:02 smithi110 ceph-mon[28069]: pgmap v18798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 558 B/s rd, 1 op/s 2024-04-26T21:31:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34977.548730 secs 2024-04-26T21:31:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:04 smithi193 ceph-mon[32782]: pgmap v18799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:31:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:04 smithi196 ceph-mon[32572]: pgmap v18799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:31:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:04 smithi110 ceph-mon[28069]: pgmap v18799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:31:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:06 smithi193 ceph-mon[32782]: pgmap v18800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:06 smithi196 ceph-mon[32572]: pgmap v18800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:06 smithi110 ceph-mon[28069]: pgmap v18800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34982.548850 secs 2024-04-26T21:31:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34982.548850 secs 2024-04-26T21:31:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34982.548850 secs 2024-04-26T21:31:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:08 smithi193 ceph-mon[32782]: pgmap v18801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:08 smithi196 ceph-mon[32572]: pgmap v18801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:08 smithi110 ceph-mon[28069]: pgmap v18801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:10 smithi196 ceph-mon[32572]: pgmap v18802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:10 smithi110 ceph-mon[28069]: pgmap v18802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:10 smithi193 ceph-mon[32782]: pgmap v18802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:12 smithi196 ceph-mon[32572]: pgmap v18803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:12 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34987.548985 secs 2024-04-26T21:31:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:12 smithi110 ceph-mon[28069]: pgmap v18803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:12 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34987.548985 secs 2024-04-26T21:31:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:12 smithi193 ceph-mon[32782]: pgmap v18803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:12 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34987.548985 secs 2024-04-26T21:31:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:14 smithi196 ceph-mon[32572]: pgmap v18804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:14 smithi110 ceph-mon[28069]: pgmap v18804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:14 smithi193 ceph-mon[32782]: pgmap v18804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:16 smithi196 ceph-mon[32572]: pgmap v18805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:16 smithi110 ceph-mon[28069]: pgmap v18805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:16 smithi193 ceph-mon[32782]: pgmap v18805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:17.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:17 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 34992.549086 secs 2024-04-26T21:31:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:17 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 34992.549086 secs 2024-04-26T21:31:18.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:17 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 34992.549086 secs 2024-04-26T21:31:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:18 smithi196 ceph-mon[32572]: pgmap v18806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:18 smithi110 ceph-mon[28069]: pgmap v18806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:18 smithi193 ceph-mon[32782]: pgmap v18806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:20 smithi196 ceph-mon[32572]: pgmap v18807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:20 smithi110 ceph-mon[28069]: pgmap v18807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:20 smithi193 ceph-mon[32782]: pgmap v18807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:22 smithi196 ceph-mon[32572]: pgmap v18808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:22 smithi196 ceph-mon[32572]: 28 slow requests, 1 included below; oldest blocked for > 34997.549210 secs 2024-04-26T21:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:22 smithi196 ceph-mon[32572]: slow request 724.964278 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:31:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:22 smithi110 ceph-mon[28069]: pgmap v18808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:22 smithi110 ceph-mon[28069]: 28 slow requests, 1 included below; oldest blocked for > 34997.549210 secs 2024-04-26T21:31:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:22 smithi110 ceph-mon[28069]: slow request 724.964278 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:31:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:22 smithi193 ceph-mon[32782]: pgmap v18808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:22 smithi193 ceph-mon[32782]: 28 slow requests, 1 included below; oldest blocked for > 34997.549210 secs 2024-04-26T21:31:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:22 smithi193 ceph-mon[32782]: slow request 724.964278 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:31:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:24 smithi196 ceph-mon[32572]: pgmap v18809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:24 smithi110 ceph-mon[28069]: pgmap v18809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:24 smithi193 ceph-mon[32782]: pgmap v18809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:26 smithi196 ceph-mon[32572]: pgmap v18810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:26 smithi110 ceph-mon[28069]: pgmap v18810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:26 smithi193 ceph-mon[32782]: pgmap v18810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:27 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35002.549330 secs 2024-04-26T21:31:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:27 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35002.549330 secs 2024-04-26T21:31:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:27 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35002.549330 secs 2024-04-26T21:31:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:28 smithi196 ceph-mon[32572]: pgmap v18811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:29.011 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:28 smithi110 ceph-mon[28069]: pgmap v18811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:28 smithi193 ceph-mon[32782]: pgmap v18811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:30 smithi196 ceph-mon[32572]: pgmap v18812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:30 smithi110 ceph-mon[28069]: pgmap v18812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:30 smithi193 ceph-mon[32782]: pgmap v18812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:32 smithi196 ceph-mon[32572]: pgmap v18813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:32 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35007.549447 secs 2024-04-26T21:31:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:32 smithi110 ceph-mon[28069]: pgmap v18813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:32 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35007.549447 secs 2024-04-26T21:31:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:32 smithi193 ceph-mon[32782]: pgmap v18813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:32 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35007.549447 secs 2024-04-26T21:31:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:34 smithi196 ceph-mon[32572]: pgmap v18814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:34 smithi110 ceph-mon[28069]: pgmap v18814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:34 smithi193 ceph-mon[32782]: pgmap v18814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:36 smithi196 ceph-mon[32572]: pgmap v18815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:36 smithi110 ceph-mon[28069]: pgmap v18815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:36 smithi193 ceph-mon[32782]: pgmap v18815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:37 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35012.549591 secs 2024-04-26T21:31:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:37 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35012.549591 secs 2024-04-26T21:31:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:37 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35012.549591 secs 2024-04-26T21:31:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:38 smithi196 ceph-mon[32572]: pgmap v18816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:38 smithi110 ceph-mon[28069]: pgmap v18816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:38 smithi193 ceph-mon[32782]: pgmap v18816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:40 smithi196 ceph-mon[32572]: pgmap v18817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:40 smithi110 ceph-mon[28069]: pgmap v18817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:40 smithi193 ceph-mon[32782]: pgmap v18817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:42 smithi196 ceph-mon[32572]: pgmap v18818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35017.549744 secs 2024-04-26T21:31:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:42 smithi110 ceph-mon[28069]: pgmap v18818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:43.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35017.549744 secs 2024-04-26T21:31:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:42 smithi193 ceph-mon[32782]: pgmap v18818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35017.549744 secs 2024-04-26T21:31:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:44 smithi196 ceph-mon[32572]: pgmap v18819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:44 smithi110 ceph-mon[28069]: pgmap v18819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:44 smithi193 ceph-mon[32782]: pgmap v18819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:46 smithi196 ceph-mon[32572]: pgmap v18820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:46 smithi110 ceph-mon[28069]: pgmap v18820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:46 smithi193 ceph-mon[32782]: pgmap v18820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35022.549876 secs 2024-04-26T21:31:48.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35022.549876 secs 2024-04-26T21:31:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35022.549876 secs 2024-04-26T21:31:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:48 smithi196 ceph-mon[32572]: pgmap v18821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:48 smithi110 ceph-mon[28069]: pgmap v18821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:48 smithi193 ceph-mon[32782]: pgmap v18821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:50 smithi110 ceph-mon[28069]: pgmap v18822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:50 smithi193 ceph-mon[32782]: pgmap v18822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:50 smithi196 ceph-mon[32572]: pgmap v18822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:52 smithi110 ceph-mon[28069]: pgmap v18823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35027.549995 secs 2024-04-26T21:31:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:52 smithi193 ceph-mon[32782]: pgmap v18823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35027.549995 secs 2024-04-26T21:31:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:52 smithi196 ceph-mon[32572]: pgmap v18823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35027.549995 secs 2024-04-26T21:31:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:54 smithi110 ceph-mon[28069]: pgmap v18824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:31:55.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:31:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:54 smithi193 ceph-mon[32782]: pgmap v18824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:31:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:31:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:54 smithi196 ceph-mon[32572]: pgmap v18824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:31:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:31:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:31:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:56 smithi110 ceph-mon[28069]: pgmap v18825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:57.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:31:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:56 smithi193 ceph-mon[32782]: pgmap v18825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:31:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:56 smithi196 ceph-mon[32572]: pgmap v18825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:31:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:31:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:57 smithi193 ceph-mon[32782]: pgmap v18826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T21:31:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:57 smithi193 ceph-mon[32782]: pgmap v18827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:31:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35032.550115 secs 2024-04-26T21:31:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:57 smithi196 ceph-mon[32572]: pgmap v18826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T21:31:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:57 smithi196 ceph-mon[32572]: pgmap v18827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:31:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35032.550115 secs 2024-04-26T21:31:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:57 smithi110 ceph-mon[28069]: pgmap v18826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s rd, 1 op/s 2024-04-26T21:31:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:57 smithi110 ceph-mon[28069]: pgmap v18827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:31:58.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35032.550115 secs 2024-04-26T21:32:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:31:59 smithi193 ceph-mon[32782]: pgmap v18828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:31:59 smithi196 ceph-mon[32572]: pgmap v18828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:31:59 smithi110 ceph-mon[28069]: pgmap v18828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:01 smithi193 ceph-mon[32782]: pgmap v18829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:01 smithi196 ceph-mon[32572]: pgmap v18829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:01 smithi110 ceph-mon[28069]: pgmap v18829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35037.550255 secs 2024-04-26T21:32:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35037.550255 secs 2024-04-26T21:32:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35037.550255 secs 2024-04-26T21:32:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:03 smithi193 ceph-mon[32782]: pgmap v18830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:32:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:03 smithi196 ceph-mon[32572]: pgmap v18830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:32:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:03 smithi110 ceph-mon[28069]: pgmap v18830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:32:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:05 smithi193 ceph-mon[32782]: pgmap v18831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:05 smithi196 ceph-mon[32572]: pgmap v18831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:05 smithi110 ceph-mon[28069]: pgmap v18831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:07 smithi193 ceph-mon[32782]: pgmap v18832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:32:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35042.550379 secs 2024-04-26T21:32:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:07 smithi196 ceph-mon[32572]: pgmap v18832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:32:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35042.550379 secs 2024-04-26T21:32:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:07 smithi110 ceph-mon[28069]: pgmap v18832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:32:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35042.550379 secs 2024-04-26T21:32:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:08 smithi196 ceph-mon[32572]: pgmap v18833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:08 smithi110 ceph-mon[28069]: pgmap v18833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:09.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:08 smithi193 ceph-mon[32782]: pgmap v18833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:11 smithi193 ceph-mon[32782]: pgmap v18834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:11 smithi196 ceph-mon[32572]: pgmap v18834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:11 smithi110 ceph-mon[28069]: pgmap v18834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:13 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35047.550512 secs 2024-04-26T21:32:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:13 smithi193 ceph-mon[32782]: pgmap v18835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:13 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35047.550512 secs 2024-04-26T21:32:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:13 smithi196 ceph-mon[32572]: pgmap v18835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:13 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35047.550512 secs 2024-04-26T21:32:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:13 smithi110 ceph-mon[28069]: pgmap v18835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:15.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:15 smithi193 ceph-mon[32782]: pgmap v18836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:15 smithi196 ceph-mon[32572]: pgmap v18836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:15 smithi110 ceph-mon[28069]: pgmap v18836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:17.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:17 smithi193 ceph-mon[32782]: pgmap v18837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:17.376 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:17 smithi110 ceph-mon[28069]: pgmap v18837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:17 smithi196 ceph-mon[32572]: pgmap v18837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:18.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:18 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35052.550646 secs 2024-04-26T21:32:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:18 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35052.550646 secs 2024-04-26T21:32:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:18 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35052.550646 secs 2024-04-26T21:32:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:19 smithi110 ceph-mon[28069]: pgmap v18838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:19 smithi193 ceph-mon[32782]: pgmap v18838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:19 smithi196 ceph-mon[32572]: pgmap v18838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:21 smithi196 ceph-mon[32572]: pgmap v18839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:21 smithi110 ceph-mon[28069]: pgmap v18839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:21.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:21 smithi193 ceph-mon[32782]: pgmap v18839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:23 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35057.550769 secs 2024-04-26T21:32:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:23 smithi196 ceph-mon[32572]: pgmap v18840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:23 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35057.550769 secs 2024-04-26T21:32:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:23 smithi110 ceph-mon[28069]: pgmap v18840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:23 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35057.550769 secs 2024-04-26T21:32:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:23 smithi193 ceph-mon[32782]: pgmap v18840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:25 smithi196 ceph-mon[32572]: pgmap v18841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:25 smithi110 ceph-mon[28069]: pgmap v18841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:25 smithi193 ceph-mon[32782]: pgmap v18841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:27 smithi196 ceph-mon[32572]: pgmap v18842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:27 smithi110 ceph-mon[28069]: pgmap v18842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:27 smithi193 ceph-mon[32782]: pgmap v18842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:28 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35062.550870 secs 2024-04-26T21:32:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:28 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35062.550870 secs 2024-04-26T21:32:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:28 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35062.550870 secs 2024-04-26T21:32:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:29 smithi110 ceph-mon[28069]: pgmap v18843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:29 smithi196 ceph-mon[32572]: pgmap v18843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:29 smithi193 ceph-mon[32782]: pgmap v18843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:31 smithi196 ceph-mon[32572]: pgmap v18844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:31 smithi110 ceph-mon[28069]: pgmap v18844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:31 smithi193 ceph-mon[32782]: pgmap v18844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:33 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35067.550992 secs 2024-04-26T21:32:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:33 smithi196 ceph-mon[32572]: pgmap v18845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:33 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35067.550992 secs 2024-04-26T21:32:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:33 smithi110 ceph-mon[28069]: pgmap v18845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:33 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35067.550992 secs 2024-04-26T21:32:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:33 smithi193 ceph-mon[32782]: pgmap v18845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:35 smithi196 ceph-mon[32572]: pgmap v18846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:35 smithi110 ceph-mon[28069]: pgmap v18846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:35.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:35 smithi193 ceph-mon[32782]: pgmap v18846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:37 smithi196 ceph-mon[32572]: pgmap v18847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:37 smithi110 ceph-mon[28069]: pgmap v18847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:37 smithi193 ceph-mon[32782]: pgmap v18847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:38 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35072.551144 secs 2024-04-26T21:32:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:38 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35072.551144 secs 2024-04-26T21:32:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:38 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35072.551144 secs 2024-04-26T21:32:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:39 smithi196 ceph-mon[32572]: pgmap v18848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:39 smithi110 ceph-mon[28069]: pgmap v18848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:39 smithi193 ceph-mon[32782]: pgmap v18848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:41 smithi196 ceph-mon[32572]: pgmap v18849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:41 smithi110 ceph-mon[28069]: pgmap v18849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:41 smithi193 ceph-mon[32782]: pgmap v18849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:43 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35077.551279 secs 2024-04-26T21:32:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:43 smithi196 ceph-mon[32572]: pgmap v18850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:43 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35077.551279 secs 2024-04-26T21:32:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:43 smithi110 ceph-mon[28069]: pgmap v18850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:43 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35077.551279 secs 2024-04-26T21:32:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:43 smithi193 ceph-mon[32782]: pgmap v18850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:45 smithi196 ceph-mon[32572]: pgmap v18851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:45 smithi110 ceph-mon[28069]: pgmap v18851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:45 smithi193 ceph-mon[32782]: pgmap v18851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:47 smithi196 ceph-mon[32572]: pgmap v18852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:47 smithi110 ceph-mon[28069]: pgmap v18852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:47 smithi193 ceph-mon[32782]: pgmap v18852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:48 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35082.551412 secs 2024-04-26T21:32:48.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:48 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35082.551412 secs 2024-04-26T21:32:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:48 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35082.551412 secs 2024-04-26T21:32:49.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:49 smithi196 ceph-mon[32572]: pgmap v18853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:49 smithi110 ceph-mon[28069]: pgmap v18853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:49.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:49 smithi193 ceph-mon[32782]: pgmap v18853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:51.507 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:51 smithi196 ceph-mon[32572]: pgmap v18854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:51 smithi110 ceph-mon[28069]: pgmap v18854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:51 smithi193 ceph-mon[32782]: pgmap v18854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:53 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35087.551503 secs 2024-04-26T21:32:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:53 smithi196 ceph-mon[32572]: pgmap v18855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:53 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35087.551503 secs 2024-04-26T21:32:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:53 smithi110 ceph-mon[28069]: pgmap v18855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:53 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35087.551503 secs 2024-04-26T21:32:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:53 smithi193 ceph-mon[32782]: pgmap v18855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:55.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:55 smithi196 ceph-mon[32572]: pgmap v18856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:55 smithi110 ceph-mon[28069]: pgmap v18856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:55.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:55 smithi193 ceph-mon[32782]: pgmap v18856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:32:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:57 smithi196 ceph-mon[32572]: pgmap v18857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:57 smithi110 ceph-mon[28069]: pgmap v18857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:57 smithi193 ceph-mon[32782]: pgmap v18857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:32:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:57.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:58 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35092.551651 secs 2024-04-26T21:32:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:58 smithi196 ceph-mon[32572]: pgmap v18858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:32:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:58 smithi196 ceph-mon[32572]: pgmap v18859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:32:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:32:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:58 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35092.551651 secs 2024-04-26T21:32:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:58 smithi110 ceph-mon[28069]: pgmap v18858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:32:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:58 smithi110 ceph-mon[28069]: pgmap v18859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:32:58.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:32:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:32:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:58 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35092.551651 secs 2024-04-26T21:32:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:58 smithi193 ceph-mon[32782]: pgmap v18858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:32:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:58 smithi193 ceph-mon[32782]: pgmap v18859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:32:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:32:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:33:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:00 smithi196 ceph-mon[32572]: pgmap v18860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:00 smithi110 ceph-mon[28069]: pgmap v18860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:00 smithi193 ceph-mon[32782]: pgmap v18860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:02 smithi196 ceph-mon[32572]: pgmap v18861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35097.551781 secs 2024-04-26T21:33:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:02 smithi110 ceph-mon[28069]: pgmap v18861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35097.551781 secs 2024-04-26T21:33:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:02 smithi193 ceph-mon[32782]: pgmap v18861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35097.551781 secs 2024-04-26T21:33:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:04 smithi196 ceph-mon[32572]: pgmap v18862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:04 smithi110 ceph-mon[28069]: pgmap v18862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:04 smithi193 ceph-mon[32782]: pgmap v18862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:06 smithi196 ceph-mon[32572]: pgmap v18863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:06 smithi110 ceph-mon[28069]: pgmap v18863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:06 smithi193 ceph-mon[32782]: pgmap v18863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:33:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35102.551866 secs 2024-04-26T21:33:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35102.551866 secs 2024-04-26T21:33:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35102.551866 secs 2024-04-26T21:33:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:08 smithi196 ceph-mon[32572]: pgmap v18864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:33:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:08 smithi110 ceph-mon[28069]: pgmap v18864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:33:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:08 smithi193 ceph-mon[32782]: pgmap v18864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:33:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:10 smithi196 ceph-mon[32572]: pgmap v18865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:10 smithi110 ceph-mon[28069]: pgmap v18865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:10 smithi193 ceph-mon[32782]: pgmap v18865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:12 smithi196 ceph-mon[32572]: pgmap v18866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:12 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35107.551983 secs 2024-04-26T21:33:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:12 smithi110 ceph-mon[28069]: pgmap v18866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:12 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35107.551983 secs 2024-04-26T21:33:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:12 smithi193 ceph-mon[32782]: pgmap v18866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:12 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35107.551983 secs 2024-04-26T21:33:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:14 smithi196 ceph-mon[32572]: pgmap v18867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:14 smithi110 ceph-mon[28069]: pgmap v18867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:14 smithi193 ceph-mon[32782]: pgmap v18867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.473+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T21:33:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.473+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:33:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.473+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:33:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.473+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T21:33:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.473+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.475+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T21:33:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.475+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T21:33:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.496+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T21:33:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.496+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T21:33:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.496+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614075000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:33:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.496+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f2614075000 comp rx=0 tx=0).stop 2024-04-26T21:33:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.496+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T21:33:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.496+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T21:33:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.496+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.496+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.497+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:16.498+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:16 smithi196 ceph-mon[32572]: pgmap v18868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:16 smithi110 ceph-mon[28069]: pgmap v18868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:16 smithi193 ceph-mon[32782]: pgmap v18868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:18.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:17 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35112.552102 secs 2024-04-26T21:33:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:17 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35112.552102 secs 2024-04-26T21:33:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:17 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35112.552102 secs 2024-04-26T21:33:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:18 smithi110 ceph-mon[28069]: pgmap v18869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:18 smithi193 ceph-mon[32782]: pgmap v18869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:18 smithi196 ceph-mon[32572]: pgmap v18869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:20 smithi110 ceph-mon[28069]: pgmap v18870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:20 smithi193 ceph-mon[32782]: pgmap v18870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:20 smithi196 ceph-mon[32572]: pgmap v18870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:22.193+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:33:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:22.193+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:33:22.194 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:22.193+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 270 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:33:22.195 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:33:22.193+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 270 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:33:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:22 smithi110 ceph-mon[28069]: pgmap v18871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:22 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35117.552176 secs 2024-04-26T21:33:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:22 smithi193 ceph-mon[32782]: pgmap v18871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:22 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35117.552176 secs 2024-04-26T21:33:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:22 smithi196 ceph-mon[32572]: pgmap v18871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:22 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35117.552176 secs 2024-04-26T21:33:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:24 smithi110 ceph-mon[28069]: pgmap v18872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:24 smithi193 ceph-mon[32782]: pgmap v18872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:24 smithi196 ceph-mon[32572]: pgmap v18872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:26 smithi110 ceph-mon[28069]: pgmap v18873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:26 smithi193 ceph-mon[32782]: pgmap v18873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:26 smithi196 ceph-mon[32572]: pgmap v18873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:27 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35122.552322 secs 2024-04-26T21:33:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:27 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35122.552322 secs 2024-04-26T21:33:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:27 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35122.552322 secs 2024-04-26T21:33:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:28 smithi193 ceph-mon[32782]: pgmap v18874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:28 smithi196 ceph-mon[32572]: pgmap v18874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:28 smithi110 ceph-mon[28069]: pgmap v18874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:30 smithi193 ceph-mon[32782]: pgmap v18875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:30 smithi196 ceph-mon[32572]: pgmap v18875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:30 smithi110 ceph-mon[28069]: pgmap v18875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:32 smithi193 ceph-mon[32782]: pgmap v18876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:32 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35127.552421 secs 2024-04-26T21:33:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:32 smithi196 ceph-mon[32572]: pgmap v18876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:32 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35127.552421 secs 2024-04-26T21:33:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:32 smithi110 ceph-mon[28069]: pgmap v18876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:32 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35127.552421 secs 2024-04-26T21:33:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:34 smithi193 ceph-mon[32782]: pgmap v18877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:34 smithi196 ceph-mon[32572]: pgmap v18877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:34 smithi110 ceph-mon[28069]: pgmap v18877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:36 smithi193 ceph-mon[32782]: pgmap v18878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:36 smithi196 ceph-mon[32572]: pgmap v18878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:36 smithi110 ceph-mon[28069]: pgmap v18878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:38 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35132.552544 secs 2024-04-26T21:33:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:38 smithi193 ceph-mon[32782]: pgmap v18879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:38 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35132.552544 secs 2024-04-26T21:33:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:38 smithi196 ceph-mon[32572]: pgmap v18879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:38 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35132.552544 secs 2024-04-26T21:33:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:38 smithi110 ceph-mon[28069]: pgmap v18879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:40 smithi196 ceph-mon[32572]: pgmap v18880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:40 smithi110 ceph-mon[28069]: pgmap v18880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:40 smithi193 ceph-mon[32782]: pgmap v18880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:42 smithi196 ceph-mon[32572]: pgmap v18881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:42 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35137.552673 secs 2024-04-26T21:33:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:42 smithi110 ceph-mon[28069]: pgmap v18881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:42 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35137.552673 secs 2024-04-26T21:33:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:42 smithi193 ceph-mon[32782]: pgmap v18881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:42 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35137.552673 secs 2024-04-26T21:33:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:44 smithi196 ceph-mon[32572]: pgmap v18882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:44 smithi110 ceph-mon[28069]: pgmap v18882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:44 smithi193 ceph-mon[32782]: pgmap v18882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:46 smithi196 ceph-mon[32572]: pgmap v18883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:46 smithi110 ceph-mon[28069]: pgmap v18883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:46 smithi193 ceph-mon[32782]: pgmap v18883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:47 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35142.552738 secs 2024-04-26T21:33:48.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:47 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35142.552738 secs 2024-04-26T21:33:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:47 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35142.552738 secs 2024-04-26T21:33:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:48 smithi196 ceph-mon[32572]: pgmap v18884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:48 smithi110 ceph-mon[28069]: pgmap v18884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:48 smithi193 ceph-mon[32782]: pgmap v18884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:50 smithi196 ceph-mon[32572]: pgmap v18885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:50 smithi110 ceph-mon[28069]: pgmap v18885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:50 smithi193 ceph-mon[32782]: pgmap v18885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:52 smithi110 ceph-mon[28069]: pgmap v18886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:53.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:52 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35147.552822 secs 2024-04-26T21:33:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:52 smithi193 ceph-mon[32782]: pgmap v18886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:52 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35147.552822 secs 2024-04-26T21:33:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:52 smithi196 ceph-mon[32572]: pgmap v18886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:52 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35147.552822 secs 2024-04-26T21:33:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:54 smithi110 ceph-mon[28069]: pgmap v18887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:54 smithi193 ceph-mon[32782]: pgmap v18887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:54 smithi196 ceph-mon[32572]: pgmap v18887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:56 smithi110 ceph-mon[28069]: pgmap v18888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:56 smithi193 ceph-mon[32782]: pgmap v18888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:56 smithi196 ceph-mon[32572]: pgmap v18888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:33:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:57 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35152.552893 secs 2024-04-26T21:33:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:57 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35152.552893 secs 2024-04-26T21:33:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:57 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35152.552893 secs 2024-04-26T21:33:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:58 smithi110 ceph-mon[28069]: pgmap v18889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:33:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:59.092 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:58 smithi193 ceph-mon[32782]: pgmap v18889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:59.092 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:33:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:58 smithi196 ceph-mon[32572]: pgmap v18889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:33:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:33:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: pgmap v18890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: pgmap v18890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: pgmap v18890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:01.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:34:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:34:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:34:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:34:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:02.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:02 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:34:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:02 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:34:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:02 smithi193 ceph-mon[32782]: pgmap v18891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:02 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35157.553007 secs 2024-04-26T21:34:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:02 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:34:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:02 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:34:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:02 smithi196 ceph-mon[32572]: pgmap v18891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:02 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35157.553007 secs 2024-04-26T21:34:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:02 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:34:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:02 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:34:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:02 smithi110 ceph-mon[28069]: pgmap v18891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:03.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:02 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35157.553007 secs 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:04.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:04.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:04.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:04.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:34:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:04 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:34:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:04 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:34:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:04 smithi193 ceph-mon[32782]: pgmap v18892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:34:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:04 smithi193 ceph-mon[32782]: pgmap v18893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:04 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:34:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:04 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:34:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:04 smithi196 ceph-mon[32572]: pgmap v18892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:34:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:04 smithi196 ceph-mon[32572]: pgmap v18893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:04 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:34:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:04 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:34:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:04 smithi110 ceph-mon[28069]: pgmap v18892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:34:05.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:04 smithi110 ceph-mon[28069]: pgmap v18893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:06 smithi193 ceph-mon[32782]: pgmap v18894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:34:07.200+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:34:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:34:07.200+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:34:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:34:07.201+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 271 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:34:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:34:07.201+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 271 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:34:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:06 smithi196 ceph-mon[32572]: pgmap v18894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:06 smithi110 ceph-mon[28069]: pgmap v18894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:07 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35162.553144 secs 2024-04-26T21:34:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:07 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35162.553144 secs 2024-04-26T21:34:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:07 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35162.553144 secs 2024-04-26T21:34:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:08 smithi193 ceph-mon[32782]: pgmap v18895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 540 B/s rd, 1 op/s 2024-04-26T21:34:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:08 smithi196 ceph-mon[32572]: pgmap v18895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 540 B/s rd, 1 op/s 2024-04-26T21:34:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:08 smithi110 ceph-mon[28069]: pgmap v18895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 540 B/s rd, 1 op/s 2024-04-26T21:34:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:10 smithi193 ceph-mon[32782]: pgmap v18896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:10 smithi196 ceph-mon[32572]: pgmap v18896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:10 smithi110 ceph-mon[28069]: pgmap v18896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:12.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:11 smithi196 ceph-mon[32572]: pgmap v18897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:11 smithi110 ceph-mon[28069]: pgmap v18897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:12.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:11 smithi193 ceph-mon[32782]: pgmap v18897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:34:13.348 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:13 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35167.553256 secs 2024-04-26T21:34:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:13 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35167.553256 secs 2024-04-26T21:34:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:13 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35167.553256 secs 2024-04-26T21:34:14.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:14 smithi193 ceph-mon[32782]: pgmap v18898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:34:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:14 smithi196 ceph-mon[32572]: pgmap v18898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:34:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:14 smithi110 ceph-mon[28069]: pgmap v18898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:34:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:16 smithi196 ceph-mon[32572]: pgmap v18899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:16 smithi110 ceph-mon[28069]: pgmap v18899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:16.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:16 smithi193 ceph-mon[32782]: pgmap v18899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:34:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:34:17.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:34:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:34:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:34:17.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:34:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:34:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:34:17.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:34:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:34:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:34:17.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:34:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:34:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:34:17.364+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:34:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:18 smithi196 ceph-mon[32572]: 28 slow requests, 0 included below; oldest blocked for > 35172.553354 secs 2024-04-26T21:34:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:18 smithi196 ceph-mon[32572]: pgmap v18900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:18 smithi110 ceph-mon[28069]: 28 slow requests, 0 included below; oldest blocked for > 35172.553354 secs 2024-04-26T21:34:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:18 smithi110 ceph-mon[28069]: pgmap v18900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:18 smithi193 ceph-mon[32782]: 28 slow requests, 0 included below; oldest blocked for > 35172.553354 secs 2024-04-26T21:34:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:18 smithi193 ceph-mon[32782]: pgmap v18900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:20.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:20 smithi196 ceph-mon[32572]: pgmap v18901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-26T21:34:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:20 smithi110 ceph-mon[28069]: pgmap v18901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-26T21:34:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:20 smithi193 ceph-mon[32782]: pgmap v18901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-26T21:34:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:22 smithi196 ceph-mon[32572]: pgmap v18902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:34:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:22 smithi110 ceph-mon[28069]: pgmap v18902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:34:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:22 smithi193 ceph-mon[32782]: pgmap v18902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:34:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:23 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35177.553495 secs 2024-04-26T21:34:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:23 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35177.553495 secs 2024-04-26T21:34:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:23 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35177.553495 secs 2024-04-26T21:34:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:24 smithi196 ceph-mon[32572]: pgmap v18903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:24 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:34:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:24 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:34:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:24 smithi110 ceph-mon[28069]: pgmap v18903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:24 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:34:24.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:24 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:34:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:24 smithi193 ceph-mon[32782]: pgmap v18903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:24 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:34:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:24 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:34:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:26 smithi196 ceph-mon[32572]: pgmap v18904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:26 smithi110 ceph-mon[28069]: pgmap v18904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:26 smithi193 ceph-mon[32782]: pgmap v18904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:28 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35182.553613 secs 2024-04-26T21:34:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:28 smithi196 ceph-mon[32572]: pgmap v18905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:28 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35182.553613 secs 2024-04-26T21:34:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:28 smithi110 ceph-mon[28069]: pgmap v18905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:28 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35182.553613 secs 2024-04-26T21:34:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:28 smithi193 ceph-mon[32782]: pgmap v18905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:30.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:30 smithi196 ceph-mon[32572]: pgmap v18906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:30 smithi110 ceph-mon[28069]: pgmap v18906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:30 smithi193 ceph-mon[32782]: pgmap v18906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:34:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:32 smithi196 ceph-mon[32572]: pgmap v18907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T21:34:32.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:32 smithi110 ceph-mon[28069]: pgmap v18907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T21:34:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:32 smithi193 ceph-mon[32782]: pgmap v18907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T21:34:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:33 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35187.553694 secs 2024-04-26T21:34:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:33 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35187.553694 secs 2024-04-26T21:34:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:33 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35187.553694 secs 2024-04-26T21:34:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:34 smithi110 ceph-mon[28069]: pgmap v18908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T21:34:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:34 smithi193 ceph-mon[32782]: pgmap v18908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T21:34:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:34 smithi196 ceph-mon[32572]: pgmap v18908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-26T21:34:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:36 smithi110 ceph-mon[28069]: pgmap v18909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:36 smithi193 ceph-mon[32782]: pgmap v18909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:36.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:36 smithi196 ceph-mon[32572]: pgmap v18909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:38 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35192.553777 secs 2024-04-26T21:34:38.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:38 smithi110 ceph-mon[28069]: pgmap v18910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:38 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35192.553777 secs 2024-04-26T21:34:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:38 smithi193 ceph-mon[32782]: pgmap v18910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:38 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35192.553777 secs 2024-04-26T21:34:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:38 smithi196 ceph-mon[32572]: pgmap v18910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:40 smithi110 ceph-mon[28069]: pgmap v18911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:40.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:40 smithi193 ceph-mon[32782]: pgmap v18911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:40 smithi196 ceph-mon[32572]: pgmap v18911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:42 smithi110 ceph-mon[28069]: pgmap v18912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:42.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:42 smithi196 ceph-mon[32572]: pgmap v18912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:42 smithi193 ceph-mon[32782]: pgmap v18912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:43 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35197.553896 secs 2024-04-26T21:34:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:43 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35197.553896 secs 2024-04-26T21:34:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:43 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35197.553896 secs 2024-04-26T21:34:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:44 smithi193 ceph-mon[32782]: pgmap v18913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:44 smithi196 ceph-mon[32572]: pgmap v18913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:44 smithi110 ceph-mon[28069]: pgmap v18913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:46 smithi193 ceph-mon[32782]: pgmap v18914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:46 smithi196 ceph-mon[32572]: pgmap v18914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:46 smithi110 ceph-mon[28069]: pgmap v18914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:48.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:48 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35202.554015 secs 2024-04-26T21:34:48.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:48 smithi110 ceph-mon[28069]: pgmap v18915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:48 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35202.554015 secs 2024-04-26T21:34:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:48 smithi193 ceph-mon[32782]: pgmap v18915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:48 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35202.554015 secs 2024-04-26T21:34:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:48 smithi196 ceph-mon[32572]: pgmap v18915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:50 smithi193 ceph-mon[32782]: pgmap v18916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:50 smithi196 ceph-mon[32572]: pgmap v18916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:50.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:50 smithi110 ceph-mon[28069]: pgmap v18916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:52 smithi193 ceph-mon[32782]: pgmap v18917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:52 smithi196 ceph-mon[32572]: pgmap v18917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:52 smithi110 ceph-mon[28069]: pgmap v18917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:53 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35207.554087 secs 2024-04-26T21:34:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:53 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35207.554087 secs 2024-04-26T21:34:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:53 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35207.554087 secs 2024-04-26T21:34:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:54 smithi193 ceph-mon[32782]: pgmap v18918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:54 smithi196 ceph-mon[32572]: pgmap v18918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:54 smithi110 ceph-mon[28069]: pgmap v18918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:56.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:56 smithi193 ceph-mon[32782]: pgmap v18919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:56 smithi196 ceph-mon[32572]: pgmap v18919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:56 smithi110 ceph-mon[28069]: pgmap v18919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:58 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35212.554208 secs 2024-04-26T21:34:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:34:58 smithi193 ceph-mon[32782]: pgmap v18920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:58 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35212.554208 secs 2024-04-26T21:34:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:34:58 smithi196 ceph-mon[32572]: pgmap v18920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:34:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:58 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35212.554208 secs 2024-04-26T21:34:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:34:58 smithi110 ceph-mon[28069]: pgmap v18920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:00 smithi193 ceph-mon[32782]: pgmap v18921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:00 smithi196 ceph-mon[32572]: pgmap v18921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:00 smithi110 ceph-mon[28069]: pgmap v18921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:02.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:02 smithi193 ceph-mon[32782]: pgmap v18922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:02 smithi196 ceph-mon[32572]: pgmap v18922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:02 smithi110 ceph-mon[28069]: pgmap v18922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:03 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35217.554310 secs 2024-04-26T21:35:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:03 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35217.554310 secs 2024-04-26T21:35:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:03 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35217.554310 secs 2024-04-26T21:35:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:04 smithi193 ceph-mon[32782]: pgmap v18923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:35:04.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:04 smithi196 ceph-mon[32572]: pgmap v18923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:35:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:04 smithi110 ceph-mon[28069]: pgmap v18923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:35:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:06.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:06.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:06.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:35:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:06 smithi196 ceph-mon[32572]: pgmap v18924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:35:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:06 smithi196 ceph-mon[32572]: pgmap v18925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:35:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:06 smithi196 ceph-mon[32572]: pgmap v18926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:35:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:06 smithi110 ceph-mon[28069]: pgmap v18924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:35:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:06 smithi110 ceph-mon[28069]: pgmap v18925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:35:07.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:06 smithi110 ceph-mon[28069]: pgmap v18926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:35:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:06 smithi193 ceph-mon[32782]: pgmap v18924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:35:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:06 smithi193 ceph-mon[32782]: pgmap v18925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:35:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:06 smithi193 ceph-mon[32782]: pgmap v18926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:35:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35222.554467 secs 2024-04-26T21:35:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35222.554467 secs 2024-04-26T21:35:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35222.554467 secs 2024-04-26T21:35:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:08 smithi196 ceph-mon[32572]: pgmap v18927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:35:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:08 smithi110 ceph-mon[28069]: pgmap v18927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:35:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:08 smithi193 ceph-mon[32782]: pgmap v18927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:35:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:10 smithi196 ceph-mon[32572]: pgmap v18928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:35:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:10 smithi110 ceph-mon[28069]: pgmap v18928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:35:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:10 smithi193 ceph-mon[32782]: pgmap v18928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:35:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:12 smithi196 ceph-mon[32572]: pgmap v18929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 618 B/s rd, 1 op/s 2024-04-26T21:35:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35227.554610 secs 2024-04-26T21:35:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:12 smithi110 ceph-mon[28069]: pgmap v18929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 618 B/s rd, 1 op/s 2024-04-26T21:35:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35227.554610 secs 2024-04-26T21:35:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:12 smithi193 ceph-mon[32782]: pgmap v18929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 618 B/s rd, 1 op/s 2024-04-26T21:35:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35227.554610 secs 2024-04-26T21:35:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:14 smithi196 ceph-mon[32572]: pgmap v18930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:14 smithi110 ceph-mon[28069]: pgmap v18930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:14 smithi193 ceph-mon[32782]: pgmap v18930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:16 smithi196 ceph-mon[32572]: pgmap v18931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:35:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:16 smithi110 ceph-mon[28069]: pgmap v18931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:35:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:16 smithi193 ceph-mon[32782]: pgmap v18931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:35:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35232.554749 secs 2024-04-26T21:35:18.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35232.554749 secs 2024-04-26T21:35:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35232.554749 secs 2024-04-26T21:35:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:18 smithi196 ceph-mon[32572]: pgmap v18932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:18 smithi110 ceph-mon[28069]: pgmap v18932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:18 smithi193 ceph-mon[32782]: pgmap v18932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:20 smithi110 ceph-mon[28069]: pgmap v18933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:20 smithi193 ceph-mon[32782]: pgmap v18933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:20 smithi196 ceph-mon[32572]: pgmap v18933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:22 smithi110 ceph-mon[28069]: pgmap v18934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35237.554868 secs 2024-04-26T21:35:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:22 smithi193 ceph-mon[32782]: pgmap v18934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35237.554868 secs 2024-04-26T21:35:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:22 smithi196 ceph-mon[32572]: pgmap v18934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35237.554868 secs 2024-04-26T21:35:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:24 smithi110 ceph-mon[28069]: pgmap v18935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:24 smithi193 ceph-mon[32782]: pgmap v18935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:24 smithi196 ceph-mon[32572]: pgmap v18935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:26 smithi110 ceph-mon[28069]: pgmap v18936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:26 smithi193 ceph-mon[32782]: pgmap v18936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:26 smithi196 ceph-mon[32572]: pgmap v18936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35242.554991 secs 2024-04-26T21:35:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35242.554991 secs 2024-04-26T21:35:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35242.554991 secs 2024-04-26T21:35:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:28 smithi110 ceph-mon[28069]: pgmap v18937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:29.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:28 smithi193 ceph-mon[32782]: pgmap v18937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:29.258 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:28 smithi196 ceph-mon[32572]: pgmap v18937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:30 smithi193 ceph-mon[32782]: pgmap v18938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:30 smithi196 ceph-mon[32572]: pgmap v18938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:30 smithi110 ceph-mon[28069]: pgmap v18938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:32 smithi193 ceph-mon[32782]: pgmap v18939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35247.555102 secs 2024-04-26T21:35:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:32 smithi196 ceph-mon[32572]: pgmap v18939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35247.555102 secs 2024-04-26T21:35:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:32 smithi110 ceph-mon[28069]: pgmap v18939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35247.555102 secs 2024-04-26T21:35:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:34 smithi193 ceph-mon[32782]: pgmap v18940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:35.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:34 smithi196 ceph-mon[32572]: pgmap v18940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:34 smithi110 ceph-mon[28069]: pgmap v18940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:36 smithi193 ceph-mon[32782]: pgmap v18941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:36 smithi196 ceph-mon[32572]: pgmap v18941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:36 smithi110 ceph-mon[28069]: pgmap v18941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35252.555218 secs 2024-04-26T21:35:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35252.555218 secs 2024-04-26T21:35:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35252.555218 secs 2024-04-26T21:35:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:38 smithi193 ceph-mon[32782]: pgmap v18942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:38 smithi196 ceph-mon[32572]: pgmap v18942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:38 smithi110 ceph-mon[28069]: pgmap v18942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:40 smithi193 ceph-mon[32782]: pgmap v18943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:40 smithi196 ceph-mon[32572]: pgmap v18943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:40 smithi110 ceph-mon[28069]: pgmap v18943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:42 smithi193 ceph-mon[32782]: pgmap v18944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35257.555372 secs 2024-04-26T21:35:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:42 smithi196 ceph-mon[32572]: pgmap v18944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35257.555372 secs 2024-04-26T21:35:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:42 smithi110 ceph-mon[28069]: pgmap v18944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35257.555372 secs 2024-04-26T21:35:45.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:44 smithi193 ceph-mon[32782]: pgmap v18945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:44 smithi196 ceph-mon[32572]: pgmap v18945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:44 smithi110 ceph-mon[28069]: pgmap v18945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:47.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:46 smithi193 ceph-mon[32782]: pgmap v18946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:46 smithi196 ceph-mon[32572]: pgmap v18946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:46 smithi110 ceph-mon[28069]: pgmap v18946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35262.555519 secs 2024-04-26T21:35:48.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35262.555519 secs 2024-04-26T21:35:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35262.555519 secs 2024-04-26T21:35:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:48 smithi193 ceph-mon[32782]: pgmap v18947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:48 smithi196 ceph-mon[32572]: pgmap v18947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:48 smithi110 ceph-mon[28069]: pgmap v18947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:50 smithi193 ceph-mon[32782]: pgmap v18948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:50 smithi196 ceph-mon[32572]: pgmap v18948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:50 smithi110 ceph-mon[28069]: pgmap v18948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:52 smithi193 ceph-mon[32782]: pgmap v18949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35267.555643 secs 2024-04-26T21:35:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:52 smithi196 ceph-mon[32572]: pgmap v18949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35267.555643 secs 2024-04-26T21:35:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:52 smithi110 ceph-mon[28069]: pgmap v18949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35267.555643 secs 2024-04-26T21:35:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:54 smithi193 ceph-mon[32782]: pgmap v18950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:54 smithi196 ceph-mon[32572]: pgmap v18950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:54 smithi110 ceph-mon[28069]: pgmap v18950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:56 smithi196 ceph-mon[32572]: pgmap v18951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:56 smithi110 ceph-mon[28069]: pgmap v18951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:56 smithi193 ceph-mon[32782]: pgmap v18951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:35:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35272.555775 secs 2024-04-26T21:35:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:35:57 smithi196 ceph-mon[32572]: pgmap v18952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35272.555775 secs 2024-04-26T21:35:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:35:57 smithi110 ceph-mon[28069]: pgmap v18952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:35:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35272.555775 secs 2024-04-26T21:35:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:35:57 smithi193 ceph-mon[32782]: pgmap v18952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:00 smithi110 ceph-mon[28069]: pgmap v18953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:00 smithi193 ceph-mon[32782]: pgmap v18953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:00 smithi196 ceph-mon[32572]: pgmap v18953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:02 smithi110 ceph-mon[28069]: pgmap v18954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35277.555911 secs 2024-04-26T21:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:02 smithi193 ceph-mon[32782]: pgmap v18954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35277.555911 secs 2024-04-26T21:36:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:02 smithi196 ceph-mon[32572]: pgmap v18954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35277.555911 secs 2024-04-26T21:36:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:04 smithi110 ceph-mon[28069]: pgmap v18955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:04 smithi193 ceph-mon[32782]: pgmap v18955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:04 smithi196 ceph-mon[32572]: pgmap v18955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:06 smithi110 ceph-mon[28069]: pgmap v18956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:06 smithi193 ceph-mon[32782]: pgmap v18956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:06 smithi196 ceph-mon[32572]: pgmap v18956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35282.556011 secs 2024-04-26T21:36:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:36:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35282.556011 secs 2024-04-26T21:36:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:36:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35282.556011 secs 2024-04-26T21:36:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:36:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:08 smithi193 ceph-mon[32782]: pgmap v18957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:36:08.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:08 smithi193 ceph-mon[32782]: pgmap v18958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:36:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:08 smithi196 ceph-mon[32572]: pgmap v18957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:36:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:08 smithi196 ceph-mon[32572]: pgmap v18958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:36:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:08 smithi110 ceph-mon[28069]: pgmap v18957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:36:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:08 smithi110 ceph-mon[28069]: pgmap v18958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:36:10.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:10 smithi193 ceph-mon[32782]: pgmap v18959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:10 smithi196 ceph-mon[32572]: pgmap v18959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:10 smithi110 ceph-mon[28069]: pgmap v18959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:12 smithi193 ceph-mon[32782]: pgmap v18960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35287.556139 secs 2024-04-26T21:36:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:12 smithi196 ceph-mon[32572]: pgmap v18960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35287.556139 secs 2024-04-26T21:36:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:12 smithi110 ceph-mon[28069]: pgmap v18960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:13.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35287.556139 secs 2024-04-26T21:36:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:14 smithi193 ceph-mon[32782]: pgmap v18961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:14 smithi196 ceph-mon[32572]: pgmap v18961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:14 smithi110 ceph-mon[28069]: pgmap v18961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:16.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:16 smithi193 ceph-mon[32782]: pgmap v18962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:16 smithi196 ceph-mon[32572]: pgmap v18962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:16 smithi110 ceph-mon[28069]: pgmap v18962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:36:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35292.556243 secs 2024-04-26T21:36:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35292.556243 secs 2024-04-26T21:36:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35292.556243 secs 2024-04-26T21:36:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:18 smithi193 ceph-mon[32782]: pgmap v18963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:36:18.946 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:18 smithi110 ceph-mon[28069]: pgmap v18963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:36:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:18 smithi196 ceph-mon[32572]: pgmap v18963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:36:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:20 smithi193 ceph-mon[32782]: pgmap v18964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:20 smithi196 ceph-mon[32572]: pgmap v18964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:21.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:20 smithi110 ceph-mon[28069]: pgmap v18964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:22.224 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:36:22.222+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:36:22.224 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:36:22.222+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:36:22.225 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:36:22.223+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 272 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:36:22.225 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:36:22.223+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 272 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:36:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:22 smithi193 ceph-mon[32782]: pgmap v18965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:22 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35297.556372 secs 2024-04-26T21:36:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:22 smithi196 ceph-mon[32572]: pgmap v18965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:22 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35297.556372 secs 2024-04-26T21:36:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:22 smithi110 ceph-mon[28069]: pgmap v18965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:22 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35297.556372 secs 2024-04-26T21:36:24.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:24 smithi193 ceph-mon[32782]: pgmap v18966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:24 smithi196 ceph-mon[32572]: pgmap v18966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:24 smithi110 ceph-mon[28069]: pgmap v18966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:26 smithi193 ceph-mon[32782]: pgmap v18967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:26 smithi196 ceph-mon[32572]: pgmap v18967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:26 smithi110 ceph-mon[28069]: pgmap v18967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:27 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35302.556524 secs 2024-04-26T21:36:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:27 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35302.556524 secs 2024-04-26T21:36:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:27 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35302.556524 secs 2024-04-26T21:36:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:28 smithi193 ceph-mon[32782]: pgmap v18968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:28 smithi196 ceph-mon[32572]: pgmap v18968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:28 smithi110 ceph-mon[28069]: pgmap v18968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:30 smithi196 ceph-mon[32572]: pgmap v18969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:30 smithi110 ceph-mon[28069]: pgmap v18969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:30 smithi193 ceph-mon[32782]: pgmap v18969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:32 smithi196 ceph-mon[32572]: pgmap v18970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:32 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35307.556649 secs 2024-04-26T21:36:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:32 smithi110 ceph-mon[28069]: pgmap v18970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:32 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35307.556649 secs 2024-04-26T21:36:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:32 smithi193 ceph-mon[32782]: pgmap v18970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:32 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35307.556649 secs 2024-04-26T21:36:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:34 smithi196 ceph-mon[32572]: pgmap v18971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:34 smithi110 ceph-mon[28069]: pgmap v18971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:35.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:34 smithi193 ceph-mon[32782]: pgmap v18971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:36 smithi196 ceph-mon[32572]: pgmap v18972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:36 smithi110 ceph-mon[28069]: pgmap v18972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:36 smithi193 ceph-mon[32782]: pgmap v18972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:37 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35312.556769 secs 2024-04-26T21:36:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:37 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35312.556769 secs 2024-04-26T21:36:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:37 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35312.556769 secs 2024-04-26T21:36:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:38 smithi196 ceph-mon[32572]: pgmap v18973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:38 smithi110 ceph-mon[28069]: pgmap v18973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:38 smithi193 ceph-mon[32782]: pgmap v18973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:40 smithi196 ceph-mon[32572]: pgmap v18974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:40 smithi110 ceph-mon[28069]: pgmap v18974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:41.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:40 smithi193 ceph-mon[32782]: pgmap v18974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:42 smithi196 ceph-mon[32572]: pgmap v18975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:42 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35317.556868 secs 2024-04-26T21:36:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:42 smithi110 ceph-mon[28069]: pgmap v18975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:42 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35317.556868 secs 2024-04-26T21:36:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:42 smithi193 ceph-mon[32782]: pgmap v18975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:42 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35317.556868 secs 2024-04-26T21:36:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:44 smithi196 ceph-mon[32572]: pgmap v18976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:44 smithi110 ceph-mon[28069]: pgmap v18976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:44 smithi193 ceph-mon[32782]: pgmap v18976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:46 smithi196 ceph-mon[32572]: pgmap v18977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:46 smithi110 ceph-mon[28069]: pgmap v18977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:46 smithi193 ceph-mon[32782]: pgmap v18977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:47 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35322.556992 secs 2024-04-26T21:36:48.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:47 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35322.556992 secs 2024-04-26T21:36:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:47 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35322.556992 secs 2024-04-26T21:36:48.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:48 smithi110 ceph-mon[28069]: pgmap v18978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:48 smithi196 ceph-mon[32572]: pgmap v18978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:48 smithi193 ceph-mon[32782]: pgmap v18978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:50 smithi196 ceph-mon[32572]: pgmap v18979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:50 smithi110 ceph-mon[28069]: pgmap v18979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:50 smithi193 ceph-mon[32782]: pgmap v18979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:52 smithi196 ceph-mon[32572]: pgmap v18980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:52 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35327.557116 secs 2024-04-26T21:36:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:52 smithi110 ceph-mon[28069]: pgmap v18980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:52 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35327.557116 secs 2024-04-26T21:36:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:52 smithi193 ceph-mon[32782]: pgmap v18980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:52 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35327.557116 secs 2024-04-26T21:36:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:54 smithi196 ceph-mon[32572]: pgmap v18981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:54 smithi110 ceph-mon[28069]: pgmap v18981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:54 smithi193 ceph-mon[32782]: pgmap v18981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:36:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:56 smithi196 ceph-mon[32572]: pgmap v18982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:56 smithi110 ceph-mon[28069]: pgmap v18982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:57.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:56 smithi193 ceph-mon[32782]: pgmap v18982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:57 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35332.557221 secs 2024-04-26T21:36:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:57 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35332.557221 secs 2024-04-26T21:36:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:57 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35332.557221 secs 2024-04-26T21:36:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:36:58 smithi196 ceph-mon[32572]: pgmap v18983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:36:58 smithi110 ceph-mon[28069]: pgmap v18983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:36:59.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:36:58 smithi193 ceph-mon[32782]: pgmap v18983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:00 smithi196 ceph-mon[32572]: pgmap v18984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:00 smithi110 ceph-mon[28069]: pgmap v18984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:00 smithi193 ceph-mon[32782]: pgmap v18984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:02 smithi196 ceph-mon[32572]: pgmap v18985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:02 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35337.557347 secs 2024-04-26T21:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:02 smithi110 ceph-mon[28069]: pgmap v18985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:02 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35337.557347 secs 2024-04-26T21:37:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:02 smithi193 ceph-mon[32782]: pgmap v18985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:02 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35337.557347 secs 2024-04-26T21:37:05.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:04 smithi196 ceph-mon[32572]: pgmap v18986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:04 smithi110 ceph-mon[28069]: pgmap v18986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:05.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:04 smithi193 ceph-mon[32782]: pgmap v18986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:06 smithi196 ceph-mon[32572]: pgmap v18987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:06 smithi110 ceph-mon[28069]: pgmap v18987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:06 smithi193 ceph-mon[32782]: pgmap v18987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:07 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35342.557495 secs 2024-04-26T21:37:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:37:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:07 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35342.557495 secs 2024-04-26T21:37:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:37:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:07 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35342.557495 secs 2024-04-26T21:37:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:37:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:08 smithi196 ceph-mon[32572]: pgmap v18988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:37:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:37:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:37:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:08 smithi110 ceph-mon[28069]: pgmap v18988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:37:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:37:09.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:37:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:08 smithi193 ceph-mon[32782]: pgmap v18988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:37:09.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:37:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:09 smithi110 ceph-mon[28069]: pgmap v18989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:37:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:09 smithi110 ceph-mon[28069]: pgmap v18990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:37:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:09 smithi193 ceph-mon[32782]: pgmap v18989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:37:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:09 smithi193 ceph-mon[32782]: pgmap v18990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:37:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:09 smithi196 ceph-mon[32572]: pgmap v18989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:37:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:09 smithi196 ceph-mon[32572]: pgmap v18990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:37:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:11 smithi110 ceph-mon[28069]: pgmap v18991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:37:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:11 smithi193 ceph-mon[32782]: pgmap v18991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:37:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:11 smithi196 ceph-mon[32572]: pgmap v18991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:37:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:12 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35347.557644 secs 2024-04-26T21:37:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:12 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35347.557644 secs 2024-04-26T21:37:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:12 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35347.557644 secs 2024-04-26T21:37:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:13 smithi110 ceph-mon[28069]: pgmap v18992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:37:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:13 smithi193 ceph-mon[32782]: pgmap v18992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:37:14.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:13 smithi196 ceph-mon[32572]: pgmap v18992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:37:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:15 smithi110 ceph-mon[28069]: pgmap v18993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:37:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:15 smithi193 ceph-mon[32782]: pgmap v18993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:37:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:15 smithi196 ceph-mon[32572]: pgmap v18993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:37:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:17 smithi193 ceph-mon[32782]: pgmap v18994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:37:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:17 smithi193 ceph-mon[32782]: 8 slow requests, 0 included below; oldest blocked for > 35352.557768 secs 2024-04-26T21:37:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:17 smithi196 ceph-mon[32572]: pgmap v18994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:37:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:17 smithi196 ceph-mon[32572]: 8 slow requests, 0 included below; oldest blocked for > 35352.557768 secs 2024-04-26T21:37:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:17 smithi110 ceph-mon[28069]: pgmap v18994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:37:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:17 smithi110 ceph-mon[28069]: 8 slow requests, 0 included below; oldest blocked for > 35352.557768 secs 2024-04-26T21:37:20.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:19 smithi110 ceph-mon[28069]: pgmap v18995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:37:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:19 smithi193 ceph-mon[32782]: pgmap v18995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:37:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:19 smithi196 ceph-mon[32572]: pgmap v18995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:37:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:21 smithi193 ceph-mon[32782]: pgmap v18996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:21 smithi196 ceph-mon[32572]: pgmap v18996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:21 smithi110 ceph-mon[28069]: pgmap v18996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:22 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 35357.557834 secs 2024-04-26T21:37:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:22 smithi193 ceph-mon[32782]: slow request 184.480944 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:37:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:22 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 35357.557834 secs 2024-04-26T21:37:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:22 smithi196 ceph-mon[32572]: slow request 184.480944 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:37:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:22 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 35357.557834 secs 2024-04-26T21:37:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:22 smithi110 ceph-mon[28069]: slow request 184.480944 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:37:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:23 smithi193 ceph-mon[32782]: pgmap v18997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:37:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:23 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:37:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:23 smithi196 ceph-mon[32572]: pgmap v18997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:37:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:23 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:37:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:23 smithi110 ceph-mon[28069]: pgmap v18997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T21:37:24.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:23 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T21:37:26.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:25 smithi193 ceph-mon[32782]: pgmap v18998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:25 smithi196 ceph-mon[32572]: pgmap v18998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:25 smithi110 ceph-mon[28069]: pgmap v18998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:27 smithi193 ceph-mon[32782]: pgmap v18999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35362.557897 secs 2024-04-26T21:37:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:27 smithi196 ceph-mon[32572]: pgmap v18999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35362.557897 secs 2024-04-26T21:37:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:27 smithi110 ceph-mon[28069]: pgmap v18999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35362.557897 secs 2024-04-26T21:37:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:29 smithi193 ceph-mon[32782]: pgmap v19000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:29 smithi196 ceph-mon[32572]: pgmap v19000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:29 smithi110 ceph-mon[28069]: pgmap v19000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:31 smithi193 ceph-mon[32782]: pgmap v19001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:31 smithi196 ceph-mon[32572]: pgmap v19001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:32.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:31 smithi110 ceph-mon[28069]: pgmap v19001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35367.558023 secs 2024-04-26T21:37:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35367.558023 secs 2024-04-26T21:37:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35367.558023 secs 2024-04-26T21:37:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:33 smithi193 ceph-mon[32782]: pgmap v19002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:33 smithi196 ceph-mon[32572]: pgmap v19002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:33 smithi110 ceph-mon[28069]: pgmap v19002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:35 smithi193 ceph-mon[32782]: pgmap v19003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:35 smithi196 ceph-mon[32572]: pgmap v19003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:35 smithi110 ceph-mon[28069]: pgmap v19003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:37 smithi193 ceph-mon[32782]: pgmap v19004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35372.558112 secs 2024-04-26T21:37:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:37 smithi196 ceph-mon[32572]: pgmap v19004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35372.558112 secs 2024-04-26T21:37:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:37 smithi110 ceph-mon[28069]: pgmap v19004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35372.558112 secs 2024-04-26T21:37:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:39 smithi193 ceph-mon[32782]: pgmap v19005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:39 smithi196 ceph-mon[32572]: pgmap v19005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:39 smithi110 ceph-mon[28069]: pgmap v19005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:41 smithi193 ceph-mon[32782]: pgmap v19006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:37:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:41 smithi196 ceph-mon[32572]: pgmap v19006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:37:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:41 smithi110 ceph-mon[28069]: pgmap v19006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:37:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35377.558238 secs 2024-04-26T21:37:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35377.558238 secs 2024-04-26T21:37:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35377.558238 secs 2024-04-26T21:37:44.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:43 smithi196 ceph-mon[32572]: pgmap v19007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:43 smithi110 ceph-mon[28069]: pgmap v19007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:43 smithi193 ceph-mon[32782]: pgmap v19007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:45 smithi196 ceph-mon[32572]: pgmap v19008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:37:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:45 smithi110 ceph-mon[28069]: pgmap v19008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:37:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:45 smithi193 ceph-mon[32782]: pgmap v19008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:37:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:47 smithi196 ceph-mon[32572]: pgmap v19009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:37:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35382.558367 secs 2024-04-26T21:37:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:47 smithi110 ceph-mon[28069]: pgmap v19009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:37:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35382.558367 secs 2024-04-26T21:37:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:47 smithi193 ceph-mon[32782]: pgmap v19009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:37:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35382.558367 secs 2024-04-26T21:37:50.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:49 smithi193 ceph-mon[32782]: pgmap v19010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:49 smithi196 ceph-mon[32572]: pgmap v19010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:49 smithi110 ceph-mon[28069]: pgmap v19010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:50 smithi196 ceph-mon[32572]: pgmap v19011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:50 smithi110 ceph-mon[28069]: pgmap v19011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:50 smithi193 ceph-mon[32782]: pgmap v19011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35387.558478 secs 2024-04-26T21:37:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35387.558478 secs 2024-04-26T21:37:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35387.558478 secs 2024-04-26T21:37:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:53 smithi193 ceph-mon[32782]: pgmap v19012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:53 smithi196 ceph-mon[32572]: pgmap v19012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:53 smithi110 ceph-mon[28069]: pgmap v19012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:37:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:55 smithi196 ceph-mon[32572]: pgmap v19013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:55 smithi110 ceph-mon[28069]: pgmap v19013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:55 smithi193 ceph-mon[32782]: pgmap v19013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:57 smithi196 ceph-mon[32572]: pgmap v19014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35392.558592 secs 2024-04-26T21:37:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:57 smithi110 ceph-mon[28069]: pgmap v19014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35392.558592 secs 2024-04-26T21:37:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:57 smithi193 ceph-mon[32782]: pgmap v19014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:37:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35392.558592 secs 2024-04-26T21:38:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:37:59 smithi196 ceph-mon[32572]: pgmap v19015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:37:59 smithi110 ceph-mon[28069]: pgmap v19015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:00.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:37:59 smithi193 ceph-mon[32782]: pgmap v19015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:01 smithi196 ceph-mon[32572]: pgmap v19016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:01 smithi110 ceph-mon[28069]: pgmap v19016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:02.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:01 smithi193 ceph-mon[32782]: pgmap v19016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35397.558665 secs 2024-04-26T21:38:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35397.558665 secs 2024-04-26T21:38:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35397.558665 secs 2024-04-26T21:38:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:03 smithi196 ceph-mon[32572]: pgmap v19017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:03 smithi110 ceph-mon[28069]: pgmap v19017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:04.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:03 smithi193 ceph-mon[32782]: pgmap v19017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:05 smithi196 ceph-mon[32572]: pgmap v19018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:05 smithi110 ceph-mon[28069]: pgmap v19018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:05 smithi193 ceph-mon[32782]: pgmap v19018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:07 smithi196 ceph-mon[32572]: pgmap v19019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:07 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 35402.558784 secs 2024-04-26T21:38:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:07 smithi196 ceph-mon[32572]: slow request 23040.603402 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:38:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:07 smithi110 ceph-mon[28069]: pgmap v19019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:07 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 35402.558784 secs 2024-04-26T21:38:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:07 smithi110 ceph-mon[28069]: slow request 23040.603402 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:38:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:07 smithi193 ceph-mon[32782]: pgmap v19019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:07 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 35402.558784 secs 2024-04-26T21:38:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:07 smithi193 ceph-mon[32782]: slow request 23040.603402 seconds old, received at 2024-04-26T15:14:06.253705+0000: client_request(client.16542:1 getattr pAsLsXsFs #0x1 2024-04-26T15:14:06.249137+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:09 smithi196 ceph-mon[32572]: pgmap v19020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:38:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:09 smithi110 ceph-mon[28069]: pgmap v19020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:10.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:38:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:09 smithi193 ceph-mon[32782]: pgmap v19020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:38:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:38:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:38:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:38:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:38:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:38:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:38:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:38:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:38:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:38:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:11 smithi110 ceph-mon[28069]: pgmap v19021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:38:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:11 smithi110 ceph-mon[28069]: pgmap v19022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:11 smithi193 ceph-mon[32782]: pgmap v19021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:38:12.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:11 smithi193 ceph-mon[32782]: pgmap v19022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:11 smithi196 ceph-mon[32572]: pgmap v19021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s rd, 1 op/s 2024-04-26T21:38:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:11 smithi196 ceph-mon[32572]: pgmap v19022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35407.558877 secs 2024-04-26T21:38:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:13 smithi196 ceph-mon[32572]: pgmap v19023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T21:38:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35407.558877 secs 2024-04-26T21:38:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:13 smithi110 ceph-mon[28069]: pgmap v19023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T21:38:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35407.558877 secs 2024-04-26T21:38:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:13 smithi193 ceph-mon[32782]: pgmap v19023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 542 B/s rd, 1 op/s 2024-04-26T21:38:15.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:15 smithi196 ceph-mon[32572]: pgmap v19024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:15 smithi110 ceph-mon[28069]: pgmap v19024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:15 smithi193 ceph-mon[32782]: pgmap v19024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:17 smithi196 ceph-mon[32572]: pgmap v19025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:17 smithi110 ceph-mon[28069]: pgmap v19025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:17.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:17 smithi193 ceph-mon[32782]: pgmap v19025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35412.558991 secs 2024-04-26T21:38:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35412.558991 secs 2024-04-26T21:38:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35412.558991 secs 2024-04-26T21:38:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:19 smithi196 ceph-mon[32572]: pgmap v19026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:19 smithi110 ceph-mon[28069]: pgmap v19026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:19 smithi193 ceph-mon[32782]: pgmap v19026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:21.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:21 smithi193 ceph-mon[32782]: pgmap v19027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:38:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:21 smithi196 ceph-mon[32572]: pgmap v19027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:38:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:21 smithi110 ceph-mon[28069]: pgmap v19027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:38:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35417.559101 secs 2024-04-26T21:38:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:23 smithi196 ceph-mon[32572]: pgmap v19028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35417.559101 secs 2024-04-26T21:38:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:23 smithi110 ceph-mon[28069]: pgmap v19028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35417.559101 secs 2024-04-26T21:38:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:23 smithi193 ceph-mon[32782]: pgmap v19028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:25 smithi196 ceph-mon[32572]: pgmap v19029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:25 smithi110 ceph-mon[28069]: pgmap v19029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:25 smithi193 ceph-mon[32782]: pgmap v19029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:27 smithi196 ceph-mon[32572]: pgmap v19030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:27 smithi110 ceph-mon[28069]: pgmap v19030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:27 smithi193 ceph-mon[32782]: pgmap v19030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35422.559212 secs 2024-04-26T21:38:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35422.559212 secs 2024-04-26T21:38:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35422.559212 secs 2024-04-26T21:38:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:29 smithi196 ceph-mon[32572]: pgmap v19031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:29 smithi110 ceph-mon[28069]: pgmap v19031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:29 smithi193 ceph-mon[32782]: pgmap v19031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:31 smithi196 ceph-mon[32572]: pgmap v19032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:31 smithi110 ceph-mon[28069]: pgmap v19032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:31 smithi193 ceph-mon[32782]: pgmap v19032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35427.559331 secs 2024-04-26T21:38:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:33 smithi196 ceph-mon[32572]: pgmap v19033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35427.559331 secs 2024-04-26T21:38:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:33 smithi110 ceph-mon[28069]: pgmap v19033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35427.559331 secs 2024-04-26T21:38:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:33 smithi193 ceph-mon[32782]: pgmap v19033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:35.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:35 smithi196 ceph-mon[32572]: pgmap v19034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:35 smithi110 ceph-mon[28069]: pgmap v19034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:35 smithi193 ceph-mon[32782]: pgmap v19034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:37 smithi196 ceph-mon[32572]: pgmap v19035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:37 smithi110 ceph-mon[28069]: pgmap v19035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:37 smithi193 ceph-mon[32782]: pgmap v19035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35432.559469 secs 2024-04-26T21:38:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35432.559469 secs 2024-04-26T21:38:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35432.559469 secs 2024-04-26T21:38:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:39 smithi196 ceph-mon[32572]: pgmap v19036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:39 smithi110 ceph-mon[28069]: pgmap v19036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:39 smithi193 ceph-mon[32782]: pgmap v19036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:41 smithi196 ceph-mon[32572]: pgmap v19037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:41 smithi110 ceph-mon[28069]: pgmap v19037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:41 smithi193 ceph-mon[32782]: pgmap v19037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35437.559534 secs 2024-04-26T21:38:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:43 smithi196 ceph-mon[32572]: pgmap v19038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35437.559534 secs 2024-04-26T21:38:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:43 smithi110 ceph-mon[28069]: pgmap v19038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35437.559534 secs 2024-04-26T21:38:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:43 smithi193 ceph-mon[32782]: pgmap v19038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:45 smithi196 ceph-mon[32572]: pgmap v19039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:45 smithi110 ceph-mon[28069]: pgmap v19039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:45.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:45 smithi193 ceph-mon[32782]: pgmap v19039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:47 smithi196 ceph-mon[32572]: pgmap v19040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:47 smithi110 ceph-mon[28069]: pgmap v19040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:47 smithi193 ceph-mon[32782]: pgmap v19040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35442.559660 secs 2024-04-26T21:38:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35442.559660 secs 2024-04-26T21:38:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35442.559660 secs 2024-04-26T21:38:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:49 smithi110 ceph-mon[28069]: pgmap v19041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:49 smithi193 ceph-mon[32782]: pgmap v19041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:49 smithi196 ceph-mon[32572]: pgmap v19041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:51 smithi110 ceph-mon[28069]: pgmap v19042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:51 smithi193 ceph-mon[32782]: pgmap v19042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:51 smithi196 ceph-mon[32572]: pgmap v19042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35447.559774 secs 2024-04-26T21:38:53.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:53 smithi110 ceph-mon[28069]: pgmap v19043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35447.559774 secs 2024-04-26T21:38:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:53 smithi193 ceph-mon[32782]: pgmap v19043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35447.559774 secs 2024-04-26T21:38:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:53 smithi196 ceph-mon[32572]: pgmap v19043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:55 smithi110 ceph-mon[28069]: pgmap v19044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:55 smithi193 ceph-mon[32782]: pgmap v19044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:55 smithi196 ceph-mon[32572]: pgmap v19044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:57 smithi110 ceph-mon[28069]: pgmap v19045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:57 smithi193 ceph-mon[32782]: pgmap v19045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:57 smithi196 ceph-mon[32572]: pgmap v19045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:38:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35452.559889 secs 2024-04-26T21:38:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35452.559889 secs 2024-04-26T21:38:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35452.559889 secs 2024-04-26T21:38:59.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:38:59 smithi193 ceph-mon[32782]: pgmap v19046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:38:59 smithi196 ceph-mon[32572]: pgmap v19046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:38:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:38:59 smithi110 ceph-mon[28069]: pgmap v19046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:01 smithi193 ceph-mon[32782]: pgmap v19047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:01 smithi196 ceph-mon[32572]: pgmap v19047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:01.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:01 smithi110 ceph-mon[28069]: pgmap v19047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35457.559952 secs 2024-04-26T21:39:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:03 smithi193 ceph-mon[32782]: pgmap v19048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35457.559952 secs 2024-04-26T21:39:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:03 smithi196 ceph-mon[32572]: pgmap v19048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35457.559952 secs 2024-04-26T21:39:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:03 smithi110 ceph-mon[28069]: pgmap v19048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:05 smithi193 ceph-mon[32782]: pgmap v19049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:05 smithi196 ceph-mon[32572]: pgmap v19049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:05 smithi110 ceph-mon[28069]: pgmap v19049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:07 smithi193 ceph-mon[32782]: pgmap v19050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:07 smithi196 ceph-mon[32572]: pgmap v19050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:07 smithi110 ceph-mon[28069]: pgmap v19050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35462.560068 secs 2024-04-26T21:39:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35462.560068 secs 2024-04-26T21:39:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35462.560068 secs 2024-04-26T21:39:09.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:09 smithi193 ceph-mon[32782]: pgmap v19051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:09 smithi196 ceph-mon[32572]: pgmap v19051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:09 smithi110 ceph-mon[28069]: pgmap v19051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:11 smithi193 ceph-mon[32782]: pgmap v19052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:11.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:39:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:11 smithi196 ceph-mon[32572]: pgmap v19052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:39:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:11 smithi110 ceph-mon[28069]: pgmap v19052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:39:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:39:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:39:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:12 smithi193 ceph-mon[32782]: pgmap v19053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T21:39:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:12 smithi193 ceph-mon[32782]: pgmap v19054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:12.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:39:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:39:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:39:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:12 smithi196 ceph-mon[32572]: pgmap v19053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T21:39:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:12 smithi196 ceph-mon[32572]: pgmap v19054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:39:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:39:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:39:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:12 smithi110 ceph-mon[28069]: pgmap v19053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T21:39:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:12 smithi110 ceph-mon[28069]: pgmap v19054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:12.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:39:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35467.560213 secs 2024-04-26T21:39:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35467.560213 secs 2024-04-26T21:39:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35467.560213 secs 2024-04-26T21:39:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:14 smithi196 ceph-mon[32572]: pgmap v19055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:14 smithi110 ceph-mon[28069]: pgmap v19055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:14 smithi193 ceph-mon[32782]: pgmap v19055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:17.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:16 smithi196 ceph-mon[32572]: pgmap v19056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:16 smithi110 ceph-mon[28069]: pgmap v19056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:16 smithi193 ceph-mon[32782]: pgmap v19056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35472.560358 secs 2024-04-26T21:39:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:39:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:39:17.460+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:39:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:39:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:39:17.460+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:39:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:39:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:39:17.460+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:39:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:39:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:39:17.460+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:39:17.792 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:39:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:39:17.460+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:39:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35472.560358 secs 2024-04-26T21:39:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35472.560358 secs 2024-04-26T21:39:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:18 smithi196 ceph-mon[32572]: pgmap v19057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:18 smithi110 ceph-mon[28069]: pgmap v19057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:18 smithi193 ceph-mon[32782]: pgmap v19057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:20 smithi196 ceph-mon[32572]: pgmap v19058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:20 smithi110 ceph-mon[28069]: pgmap v19058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:21.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:20 smithi193 ceph-mon[32782]: pgmap v19058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:22.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:39:22.254+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:39:22.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:39:22.254+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:39:22.255 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:39:22.255+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 273 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:39:22.256 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:39:22.255+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 273 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:39:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:22 smithi196 ceph-mon[32572]: pgmap v19059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:39:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35477.560484 secs 2024-04-26T21:39:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:22 smithi110 ceph-mon[28069]: pgmap v19059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:39:23.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35477.560484 secs 2024-04-26T21:39:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:22 smithi193 ceph-mon[32782]: pgmap v19059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:39:23.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35477.560484 secs 2024-04-26T21:39:25.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:24 smithi196 ceph-mon[32572]: pgmap v19060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:39:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:24 smithi110 ceph-mon[28069]: pgmap v19060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:39:25.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:24 smithi193 ceph-mon[32782]: pgmap v19060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:39:27.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:26 smithi196 ceph-mon[32572]: pgmap v19061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:39:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:26 smithi110 ceph-mon[28069]: pgmap v19061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:39:27.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:26 smithi193 ceph-mon[32782]: pgmap v19061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:39:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35482.560647 secs 2024-04-26T21:39:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35482.560647 secs 2024-04-26T21:39:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35482.560647 secs 2024-04-26T21:39:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:28 smithi196 ceph-mon[32572]: pgmap v19062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:39:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:28 smithi110 ceph-mon[28069]: pgmap v19062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:39:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:28 smithi193 ceph-mon[32782]: pgmap v19062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:39:31.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:30 smithi196 ceph-mon[32572]: pgmap v19063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:39:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:30 smithi110 ceph-mon[28069]: pgmap v19063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:39:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:30 smithi193 ceph-mon[32782]: pgmap v19063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:39:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:32 smithi196 ceph-mon[32572]: pgmap v19064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:39:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35487.560771 secs 2024-04-26T21:39:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:32 smithi110 ceph-mon[28069]: pgmap v19064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:39:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35487.560771 secs 2024-04-26T21:39:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:32 smithi193 ceph-mon[32782]: pgmap v19064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:39:33.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35487.560771 secs 2024-04-26T21:39:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:34 smithi196 ceph-mon[32572]: pgmap v19065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:39:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:34 smithi110 ceph-mon[28069]: pgmap v19065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:39:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:34 smithi193 ceph-mon[32782]: pgmap v19065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:39:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:36 smithi196 ceph-mon[32572]: pgmap v19066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:36 smithi110 ceph-mon[28069]: pgmap v19066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:36 smithi193 ceph-mon[32782]: pgmap v19066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35492.560901 secs 2024-04-26T21:39:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35492.560901 secs 2024-04-26T21:39:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35492.560901 secs 2024-04-26T21:39:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:38 smithi196 ceph-mon[32572]: pgmap v19067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:38 smithi110 ceph-mon[28069]: pgmap v19067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:38 smithi193 ceph-mon[32782]: pgmap v19067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:40 smithi196 ceph-mon[32572]: pgmap v19068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:40 smithi110 ceph-mon[28069]: pgmap v19068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:40 smithi193 ceph-mon[32782]: pgmap v19068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:42 smithi196 ceph-mon[32572]: pgmap v19069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35497.560978 secs 2024-04-26T21:39:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:42 smithi110 ceph-mon[28069]: pgmap v19069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35497.560978 secs 2024-04-26T21:39:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:42 smithi193 ceph-mon[32782]: pgmap v19069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35497.560978 secs 2024-04-26T21:39:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:44 smithi110 ceph-mon[28069]: pgmap v19070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:44 smithi193 ceph-mon[32782]: pgmap v19070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:44 smithi196 ceph-mon[32572]: pgmap v19070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:46 smithi110 ceph-mon[28069]: pgmap v19071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:47.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:46 smithi196 ceph-mon[32572]: pgmap v19071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:46 smithi193 ceph-mon[32782]: pgmap v19071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35502.561096 secs 2024-04-26T21:39:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35502.561096 secs 2024-04-26T21:39:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35502.561096 secs 2024-04-26T21:39:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:48 smithi110 ceph-mon[28069]: pgmap v19072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:48 smithi193 ceph-mon[32782]: pgmap v19072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:48 smithi196 ceph-mon[32572]: pgmap v19072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:50 smithi110 ceph-mon[28069]: pgmap v19073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:50 smithi193 ceph-mon[32782]: pgmap v19073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:50 smithi196 ceph-mon[32572]: pgmap v19073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:52 smithi110 ceph-mon[28069]: pgmap v19074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35507.561214 secs 2024-04-26T21:39:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:52 smithi193 ceph-mon[32782]: pgmap v19074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35507.561214 secs 2024-04-26T21:39:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:52 smithi196 ceph-mon[32572]: pgmap v19074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35507.561214 secs 2024-04-26T21:39:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:54 smithi193 ceph-mon[32782]: pgmap v19075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:54 smithi196 ceph-mon[32572]: pgmap v19075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:54 smithi110 ceph-mon[28069]: pgmap v19075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:56 smithi193 ceph-mon[32782]: pgmap v19076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:56 smithi196 ceph-mon[32572]: pgmap v19076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:56 smithi110 ceph-mon[28069]: pgmap v19076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:39:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35512.561333 secs 2024-04-26T21:39:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35512.561333 secs 2024-04-26T21:39:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35512.561333 secs 2024-04-26T21:39:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:39:58 smithi193 ceph-mon[32782]: pgmap v19077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:39:58 smithi196 ceph-mon[32572]: pgmap v19077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:39:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:39:58 smithi110 ceph-mon[28069]: pgmap v19077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:00 smithi193 ceph-mon[32782]: pgmap v19078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:01.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:40:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:00 smithi196 ceph-mon[32572]: pgmap v19078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:40:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:00 smithi110 ceph-mon[28069]: pgmap v19078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:40:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:02 smithi193 ceph-mon[32782]: pgmap v19079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35517.561472 secs 2024-04-26T21:40:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:02 smithi196 ceph-mon[32572]: pgmap v19079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35517.561472 secs 2024-04-26T21:40:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:02 smithi110 ceph-mon[28069]: pgmap v19079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35517.561472 secs 2024-04-26T21:40:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:04 smithi193 ceph-mon[32782]: pgmap v19080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:04 smithi196 ceph-mon[32572]: pgmap v19080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:04 smithi110 ceph-mon[28069]: pgmap v19080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:07.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:06 smithi193 ceph-mon[32782]: pgmap v19081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:07.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:06 smithi196 ceph-mon[32572]: pgmap v19081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:06 smithi110 ceph-mon[28069]: pgmap v19081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35522.561595 secs 2024-04-26T21:40:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35522.561595 secs 2024-04-26T21:40:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35522.561595 secs 2024-04-26T21:40:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:08 smithi193 ceph-mon[32782]: pgmap v19082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:08 smithi196 ceph-mon[32572]: pgmap v19082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:08 smithi110 ceph-mon[28069]: pgmap v19082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:10 smithi193 ceph-mon[32782]: pgmap v19083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:10 smithi196 ceph-mon[32572]: pgmap v19083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:10 smithi110 ceph-mon[28069]: pgmap v19083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:12 smithi193 ceph-mon[32782]: pgmap v19084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35527.561657 secs 2024-04-26T21:40:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:40:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:12 smithi196 ceph-mon[32572]: pgmap v19084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35527.561657 secs 2024-04-26T21:40:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:40:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:12 smithi110 ceph-mon[28069]: pgmap v19084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35527.561657 secs 2024-04-26T21:40:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:40:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:40:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:40:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:40:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:40:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:40:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:40:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:40:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:40:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:40:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:14 smithi193 ceph-mon[32782]: pgmap v19085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:40:15.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:14 smithi193 ceph-mon[32782]: pgmap v19086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:14 smithi196 ceph-mon[32572]: pgmap v19085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:40:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:14 smithi196 ceph-mon[32572]: pgmap v19086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:14 smithi110 ceph-mon[28069]: pgmap v19085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:40:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:14 smithi110 ceph-mon[28069]: pgmap v19086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:16 smithi196 ceph-mon[32572]: pgmap v19087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:16 smithi110 ceph-mon[28069]: pgmap v19087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:16 smithi193 ceph-mon[32782]: pgmap v19087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35532.561778 secs 2024-04-26T21:40:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35532.561778 secs 2024-04-26T21:40:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35532.561778 secs 2024-04-26T21:40:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:18 smithi196 ceph-mon[32572]: pgmap v19088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:40:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:18 smithi110 ceph-mon[28069]: pgmap v19088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:40:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:18 smithi193 ceph-mon[32782]: pgmap v19088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T21:40:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:20 smithi196 ceph-mon[32572]: pgmap v19089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:20 smithi110 ceph-mon[28069]: pgmap v19089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:20 smithi193 ceph-mon[32782]: pgmap v19089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:23.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:22 smithi193 ceph-mon[32782]: pgmap v19090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:23.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:22 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 35537.561872 secs 2024-04-26T21:40:23.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:22 smithi193 ceph-mon[32782]: slow request 364.484982 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:40:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:22 smithi196 ceph-mon[32572]: pgmap v19090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:22 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 35537.561872 secs 2024-04-26T21:40:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:22 smithi196 ceph-mon[32572]: slow request 364.484982 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:40:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:22 smithi110 ceph-mon[28069]: pgmap v19090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:40:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:22 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 35537.561872 secs 2024-04-26T21:40:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:22 smithi110 ceph-mon[28069]: slow request 364.484982 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:40:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:24 smithi196 ceph-mon[32572]: pgmap v19091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:40:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:24 smithi110 ceph-mon[28069]: pgmap v19091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:40:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:24 smithi193 ceph-mon[32782]: pgmap v19091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:40:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:26 smithi196 ceph-mon[32572]: pgmap v19092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:26 smithi110 ceph-mon[28069]: pgmap v19092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:26 smithi193 ceph-mon[32782]: pgmap v19092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35542.561990 secs 2024-04-26T21:40:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35542.561990 secs 2024-04-26T21:40:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35542.561990 secs 2024-04-26T21:40:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:28 smithi196 ceph-mon[32572]: pgmap v19093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:28 smithi110 ceph-mon[28069]: pgmap v19093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:28 smithi193 ceph-mon[32782]: pgmap v19093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:30 smithi196 ceph-mon[32572]: pgmap v19094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:31.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:30 smithi110 ceph-mon[28069]: pgmap v19094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:30 smithi193 ceph-mon[32782]: pgmap v19094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:32 smithi196 ceph-mon[32572]: pgmap v19095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35547.562114 secs 2024-04-26T21:40:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:32 smithi110 ceph-mon[28069]: pgmap v19095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35547.562114 secs 2024-04-26T21:40:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:32 smithi193 ceph-mon[32782]: pgmap v19095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35547.562114 secs 2024-04-26T21:40:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:33 smithi196 ceph-mon[32572]: pgmap v19096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:33 smithi110 ceph-mon[28069]: pgmap v19096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:33 smithi193 ceph-mon[32782]: pgmap v19096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:36.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:36 smithi196 ceph-mon[32572]: pgmap v19097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:36 smithi110 ceph-mon[28069]: pgmap v19097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:36 smithi193 ceph-mon[32782]: pgmap v19097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35552.562258 secs 2024-04-26T21:40:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:38 smithi196 ceph-mon[32572]: pgmap v19098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35552.562258 secs 2024-04-26T21:40:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:38 smithi110 ceph-mon[28069]: pgmap v19098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35552.562258 secs 2024-04-26T21:40:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:38 smithi193 ceph-mon[32782]: pgmap v19098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:40 smithi110 ceph-mon[28069]: pgmap v19099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:40 smithi193 ceph-mon[32782]: pgmap v19099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:40 smithi196 ceph-mon[32572]: pgmap v19099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:42 smithi110 ceph-mon[28069]: pgmap v19100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:42 smithi193 ceph-mon[32782]: pgmap v19100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:42 smithi196 ceph-mon[32572]: pgmap v19100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35557.562375 secs 2024-04-26T21:40:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35557.562375 secs 2024-04-26T21:40:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35557.562375 secs 2024-04-26T21:40:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:44 smithi110 ceph-mon[28069]: pgmap v19101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:44 smithi193 ceph-mon[32782]: pgmap v19101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:44 smithi196 ceph-mon[32572]: pgmap v19101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:46 smithi110 ceph-mon[28069]: pgmap v19102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:46 smithi193 ceph-mon[32782]: pgmap v19102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:46 smithi196 ceph-mon[32572]: pgmap v19102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35562.562487 secs 2024-04-26T21:40:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:48 smithi110 ceph-mon[28069]: pgmap v19103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:48.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35562.562487 secs 2024-04-26T21:40:48.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:48 smithi196 ceph-mon[32572]: pgmap v19103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35562.562487 secs 2024-04-26T21:40:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:48 smithi193 ceph-mon[32782]: pgmap v19103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:50 smithi110 ceph-mon[28069]: pgmap v19104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:50 smithi193 ceph-mon[32782]: pgmap v19104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:50 smithi196 ceph-mon[32572]: pgmap v19104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:52 smithi193 ceph-mon[32782]: pgmap v19105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:52 smithi196 ceph-mon[32572]: pgmap v19105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:52 smithi110 ceph-mon[28069]: pgmap v19105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35567.562613 secs 2024-04-26T21:40:53.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35567.562613 secs 2024-04-26T21:40:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35567.562613 secs 2024-04-26T21:40:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:54 smithi193 ceph-mon[32782]: pgmap v19106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:54 smithi196 ceph-mon[32572]: pgmap v19106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:54 smithi110 ceph-mon[28069]: pgmap v19106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:40:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:56 smithi193 ceph-mon[32782]: pgmap v19107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:56 smithi196 ceph-mon[32572]: pgmap v19107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:56 smithi110 ceph-mon[28069]: pgmap v19107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35572.562736 secs 2024-04-26T21:40:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:40:58 smithi193 ceph-mon[32782]: pgmap v19108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35572.562736 secs 2024-04-26T21:40:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:40:58 smithi196 ceph-mon[32572]: pgmap v19108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:40:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35572.562736 secs 2024-04-26T21:40:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:40:58 smithi110 ceph-mon[28069]: pgmap v19108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:00 smithi193 ceph-mon[32782]: pgmap v19109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:00 smithi196 ceph-mon[32572]: pgmap v19109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:00 smithi110 ceph-mon[28069]: pgmap v19109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:02 smithi193 ceph-mon[32782]: pgmap v19110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:02 smithi196 ceph-mon[32572]: pgmap v19110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:02 smithi110 ceph-mon[28069]: pgmap v19110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35577.562804 secs 2024-04-26T21:41:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35577.562804 secs 2024-04-26T21:41:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35577.562804 secs 2024-04-26T21:41:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:04 smithi193 ceph-mon[32782]: pgmap v19111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:04 smithi196 ceph-mon[32572]: pgmap v19111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:04 smithi110 ceph-mon[28069]: pgmap v19111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:06 smithi193 ceph-mon[32782]: pgmap v19112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:06 smithi196 ceph-mon[32572]: pgmap v19112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:06 smithi110 ceph-mon[28069]: pgmap v19112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35582.562930 secs 2024-04-26T21:41:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:08 smithi193 ceph-mon[32782]: pgmap v19113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35582.562930 secs 2024-04-26T21:41:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:08 smithi196 ceph-mon[32572]: pgmap v19113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35582.562930 secs 2024-04-26T21:41:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:08 smithi110 ceph-mon[28069]: pgmap v19113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:10 smithi193 ceph-mon[32782]: pgmap v19114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:10.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:10 smithi196 ceph-mon[32572]: pgmap v19114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:10 smithi110 ceph-mon[28069]: pgmap v19114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:12 smithi193 ceph-mon[32782]: pgmap v19115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:12 smithi196 ceph-mon[32572]: pgmap v19115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:12 smithi110 ceph-mon[28069]: pgmap v19115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35587.563068 secs 2024-04-26T21:41:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35587.563068 secs 2024-04-26T21:41:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35587.563068 secs 2024-04-26T21:41:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:14 smithi196 ceph-mon[32572]: pgmap v19116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:41:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:14 smithi110 ceph-mon[28069]: pgmap v19116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:41:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:14 smithi193 ceph-mon[32782]: pgmap v19116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:41:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:41:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:41:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:15 smithi196 ceph-mon[32572]: pgmap v19117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T21:41:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:15 smithi196 ceph-mon[32572]: pgmap v19118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:41:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:41:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:41:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:15 smithi110 ceph-mon[28069]: pgmap v19117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T21:41:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:15 smithi110 ceph-mon[28069]: pgmap v19118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:41:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:41:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:41:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:15 smithi193 ceph-mon[32782]: pgmap v19117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T21:41:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:15 smithi193 ceph-mon[32782]: pgmap v19118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:41:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:17 smithi196 ceph-mon[32572]: pgmap v19119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35592.563193 secs 2024-04-26T21:41:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:17 smithi110 ceph-mon[28069]: pgmap v19119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35592.563193 secs 2024-04-26T21:41:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:17 smithi193 ceph-mon[32782]: pgmap v19119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35592.563193 secs 2024-04-26T21:41:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:19 smithi110 ceph-mon[28069]: pgmap v19120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:19 smithi193 ceph-mon[32782]: pgmap v19120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:19 smithi196 ceph-mon[32572]: pgmap v19120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:21 smithi110 ceph-mon[28069]: pgmap v19121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:21 smithi193 ceph-mon[32782]: pgmap v19121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:21 smithi196 ceph-mon[32572]: pgmap v19121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35597.563309 secs 2024-04-26T21:41:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35597.563309 secs 2024-04-26T21:41:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35597.563309 secs 2024-04-26T21:41:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:23 smithi110 ceph-mon[28069]: pgmap v19122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:23 smithi193 ceph-mon[32782]: pgmap v19122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:23 smithi196 ceph-mon[32572]: pgmap v19122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:25 smithi110 ceph-mon[28069]: pgmap v19123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:41:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:25 smithi193 ceph-mon[32782]: pgmap v19123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:41:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:25 smithi196 ceph-mon[32572]: pgmap v19123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:41:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:27 smithi110 ceph-mon[28069]: pgmap v19124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35602.563452 secs 2024-04-26T21:41:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:27 smithi193 ceph-mon[32782]: pgmap v19124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35602.563452 secs 2024-04-26T21:41:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:27 smithi196 ceph-mon[32572]: pgmap v19124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35602.563452 secs 2024-04-26T21:41:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:29 smithi193 ceph-mon[32782]: pgmap v19125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:29 smithi196 ceph-mon[32572]: pgmap v19125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:29 smithi110 ceph-mon[28069]: pgmap v19125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:32.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:31 smithi193 ceph-mon[32782]: pgmap v19126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:31 smithi196 ceph-mon[32572]: pgmap v19126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:31 smithi110 ceph-mon[28069]: pgmap v19126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35607.563555 secs 2024-04-26T21:41:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35607.563555 secs 2024-04-26T21:41:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35607.563555 secs 2024-04-26T21:41:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:33 smithi193 ceph-mon[32782]: pgmap v19127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:33 smithi196 ceph-mon[32572]: pgmap v19127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:33 smithi110 ceph-mon[28069]: pgmap v19127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:35 smithi193 ceph-mon[32782]: pgmap v19128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:35 smithi196 ceph-mon[32572]: pgmap v19128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:35 smithi110 ceph-mon[28069]: pgmap v19128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:37 smithi193 ceph-mon[32782]: pgmap v19129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35612.563579 secs 2024-04-26T21:41:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:37 smithi196 ceph-mon[32572]: pgmap v19129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35612.563579 secs 2024-04-26T21:41:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:37 smithi110 ceph-mon[28069]: pgmap v19129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35612.563579 secs 2024-04-26T21:41:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:39 smithi193 ceph-mon[32782]: pgmap v19130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:39 smithi196 ceph-mon[32572]: pgmap v19130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:39 smithi110 ceph-mon[28069]: pgmap v19130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:41 smithi193 ceph-mon[32782]: pgmap v19131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:41 smithi196 ceph-mon[32572]: pgmap v19131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:41 smithi110 ceph-mon[28069]: pgmap v19131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35617.563688 secs 2024-04-26T21:41:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35617.563688 secs 2024-04-26T21:41:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35617.563688 secs 2024-04-26T21:41:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:43 smithi193 ceph-mon[32782]: pgmap v19132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:43 smithi196 ceph-mon[32572]: pgmap v19132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:43 smithi110 ceph-mon[28069]: pgmap v19132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:45 smithi193 ceph-mon[32782]: pgmap v19133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:45 smithi196 ceph-mon[32572]: pgmap v19133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:45 smithi110 ceph-mon[28069]: pgmap v19133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:47 smithi193 ceph-mon[32782]: pgmap v19134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35622.563799 secs 2024-04-26T21:41:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:47 smithi196 ceph-mon[32572]: pgmap v19134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35622.563799 secs 2024-04-26T21:41:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:47 smithi110 ceph-mon[28069]: pgmap v19134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35622.563799 secs 2024-04-26T21:41:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:49 smithi193 ceph-mon[32782]: pgmap v19135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:49 smithi196 ceph-mon[32572]: pgmap v19135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:49 smithi110 ceph-mon[28069]: pgmap v19135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:51 smithi193 ceph-mon[32782]: pgmap v19136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:51 smithi196 ceph-mon[32572]: pgmap v19136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:51 smithi110 ceph-mon[28069]: pgmap v19136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:53.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35627.563864 secs 2024-04-26T21:41:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35627.563864 secs 2024-04-26T21:41:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35627.563864 secs 2024-04-26T21:41:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:53 smithi196 ceph-mon[32572]: pgmap v19137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:53 smithi110 ceph-mon[28069]: pgmap v19137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:53 smithi193 ceph-mon[32782]: pgmap v19137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:41:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:55 smithi196 ceph-mon[32572]: pgmap v19138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:55 smithi110 ceph-mon[28069]: pgmap v19138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:55 smithi193 ceph-mon[32782]: pgmap v19138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:57 smithi196 ceph-mon[32572]: pgmap v19139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35632.563943 secs 2024-04-26T21:41:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:57 smithi110 ceph-mon[28069]: pgmap v19139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35632.563943 secs 2024-04-26T21:41:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:57 smithi193 ceph-mon[32782]: pgmap v19139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:41:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35632.563943 secs 2024-04-26T21:42:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:41:59 smithi196 ceph-mon[32572]: pgmap v19140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:41:59 smithi110 ceph-mon[28069]: pgmap v19140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:41:59 smithi193 ceph-mon[32782]: pgmap v19140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:02.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:01 smithi196 ceph-mon[32572]: pgmap v19141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:01 smithi110 ceph-mon[28069]: pgmap v19141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:01 smithi193 ceph-mon[32782]: pgmap v19141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35637.564045 secs 2024-04-26T21:42:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35637.564045 secs 2024-04-26T21:42:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35637.564045 secs 2024-04-26T21:42:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:03 smithi196 ceph-mon[32572]: pgmap v19142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:03 smithi110 ceph-mon[28069]: pgmap v19142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:03 smithi193 ceph-mon[32782]: pgmap v19142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:05 smithi196 ceph-mon[32572]: pgmap v19143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:05 smithi110 ceph-mon[28069]: pgmap v19143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:05 smithi193 ceph-mon[32782]: pgmap v19143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:07 smithi196 ceph-mon[32572]: pgmap v19144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35642.564141 secs 2024-04-26T21:42:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:07 smithi110 ceph-mon[28069]: pgmap v19144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35642.564141 secs 2024-04-26T21:42:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:07 smithi193 ceph-mon[32782]: pgmap v19144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35642.564141 secs 2024-04-26T21:42:10.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:09 smithi196 ceph-mon[32572]: pgmap v19145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:09 smithi110 ceph-mon[28069]: pgmap v19145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:09 smithi193 ceph-mon[32782]: pgmap v19145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:11 smithi196 ceph-mon[32572]: pgmap v19146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:11 smithi110 ceph-mon[28069]: pgmap v19146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:11 smithi193 ceph-mon[32782]: pgmap v19146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35647.564259 secs 2024-04-26T21:42:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:13 smithi196 ceph-mon[32572]: pgmap v19147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35647.564259 secs 2024-04-26T21:42:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:13 smithi110 ceph-mon[28069]: pgmap v19147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35647.564259 secs 2024-04-26T21:42:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:13 smithi193 ceph-mon[32782]: pgmap v19147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:15 smithi110 ceph-mon[28069]: pgmap v19148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:42:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:15 smithi193 ceph-mon[32782]: pgmap v19148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:42:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:15 smithi196 ceph-mon[32572]: pgmap v19148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:42:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:42:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:42:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:42:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:42:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:42:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:42:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:17 smithi193 ceph-mon[32782]: pgmap v19149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35652.564370 secs 2024-04-26T21:42:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:42:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:42:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:42:18.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:17 smithi196 ceph-mon[32572]: pgmap v19149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:18.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35652.564370 secs 2024-04-26T21:42:18.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:42:18.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:42:18.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:42:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:17 smithi110 ceph-mon[28069]: pgmap v19149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35652.564370 secs 2024-04-26T21:42:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:42:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:42:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:42:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:18 smithi193 ceph-mon[32782]: pgmap v19150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T21:42:19.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:18 smithi193 ceph-mon[32782]: pgmap v19151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:42:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:18 smithi196 ceph-mon[32572]: pgmap v19150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T21:42:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:18 smithi196 ceph-mon[32572]: pgmap v19151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:42:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:18 smithi110 ceph-mon[28069]: pgmap v19150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T21:42:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:18 smithi110 ceph-mon[28069]: pgmap v19151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:42:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:20 smithi193 ceph-mon[32782]: pgmap v19152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:21.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:20 smithi196 ceph-mon[32572]: pgmap v19152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:20 smithi110 ceph-mon[28069]: pgmap v19152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:42:22.284+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T21:42:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:42:22.284+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T21:42:22.285 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:42:22.285+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 274 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T21:42:22.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:42:22.285+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:42:22.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:42:22.285+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 274 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T21:42:22.286 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:42:22.285+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:42:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:42:22.286+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 275 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:42:22.287 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:42:22.286+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 275 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:42:23.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:22 smithi110 ceph-mon[28069]: pgmap v19153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:42:23.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35657.564510 secs 2024-04-26T21:42:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:22 smithi193 ceph-mon[32782]: pgmap v19153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:42:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35657.564510 secs 2024-04-26T21:42:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:22 smithi196 ceph-mon[32572]: pgmap v19153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T21:42:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35657.564510 secs 2024-04-26T21:42:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:24 smithi193 ceph-mon[32782]: pgmap v19154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:24 smithi196 ceph-mon[32572]: pgmap v19154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:24 smithi110 ceph-mon[28069]: pgmap v19154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:26 smithi193 ceph-mon[32782]: pgmap v19155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:26 smithi196 ceph-mon[32572]: pgmap v19155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:26 smithi110 ceph-mon[28069]: pgmap v19155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35662.564621 secs 2024-04-26T21:42:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35662.564621 secs 2024-04-26T21:42:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35662.564621 secs 2024-04-26T21:42:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:28 smithi193 ceph-mon[32782]: pgmap v19156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:42:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:28 smithi196 ceph-mon[32572]: pgmap v19156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:42:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:28 smithi110 ceph-mon[28069]: pgmap v19156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:42:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:30 smithi196 ceph-mon[32572]: pgmap v19157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:30 smithi110 ceph-mon[28069]: pgmap v19157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:30 smithi193 ceph-mon[32782]: pgmap v19157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:32 smithi196 ceph-mon[32572]: pgmap v19158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35667.564739 secs 2024-04-26T21:42:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:32 smithi110 ceph-mon[28069]: pgmap v19158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35667.564739 secs 2024-04-26T21:42:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:32 smithi193 ceph-mon[32782]: pgmap v19158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35667.564739 secs 2024-04-26T21:42:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:34 smithi196 ceph-mon[32572]: pgmap v19159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:34 smithi110 ceph-mon[28069]: pgmap v19159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:34 smithi193 ceph-mon[32782]: pgmap v19159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:36 smithi196 ceph-mon[32572]: pgmap v19160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:36 smithi110 ceph-mon[28069]: pgmap v19160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:36 smithi193 ceph-mon[32782]: pgmap v19160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35672.564860 secs 2024-04-26T21:42:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35672.564860 secs 2024-04-26T21:42:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35672.564860 secs 2024-04-26T21:42:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:38 smithi196 ceph-mon[32572]: pgmap v19161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:38 smithi110 ceph-mon[28069]: pgmap v19161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:38 smithi193 ceph-mon[32782]: pgmap v19161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:40 smithi196 ceph-mon[32572]: pgmap v19162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:40 smithi110 ceph-mon[28069]: pgmap v19162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:40 smithi193 ceph-mon[32782]: pgmap v19162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:42 smithi196 ceph-mon[32572]: pgmap v19163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35677.564978 secs 2024-04-26T21:42:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:42 smithi110 ceph-mon[28069]: pgmap v19163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35677.564978 secs 2024-04-26T21:42:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:42 smithi193 ceph-mon[32782]: pgmap v19163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35677.564978 secs 2024-04-26T21:42:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:44 smithi196 ceph-mon[32572]: pgmap v19164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:44 smithi110 ceph-mon[28069]: pgmap v19164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:44 smithi193 ceph-mon[32782]: pgmap v19164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:46 smithi196 ceph-mon[32572]: pgmap v19165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:46 smithi110 ceph-mon[28069]: pgmap v19165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:46 smithi193 ceph-mon[32782]: pgmap v19165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35682.565097 secs 2024-04-26T21:42:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35682.565097 secs 2024-04-26T21:42:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35682.565097 secs 2024-04-26T21:42:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:48 smithi196 ceph-mon[32572]: pgmap v19166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:48 smithi110 ceph-mon[28069]: pgmap v19166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:48 smithi193 ceph-mon[32782]: pgmap v19166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:50 smithi196 ceph-mon[32572]: pgmap v19167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:50 smithi110 ceph-mon[28069]: pgmap v19167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:50 smithi193 ceph-mon[32782]: pgmap v19167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:52 smithi196 ceph-mon[32572]: pgmap v19168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35687.565191 secs 2024-04-26T21:42:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:52 smithi110 ceph-mon[28069]: pgmap v19168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35687.565191 secs 2024-04-26T21:42:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:52 smithi193 ceph-mon[32782]: pgmap v19168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35687.565191 secs 2024-04-26T21:42:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:54 smithi196 ceph-mon[32572]: pgmap v19169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:54 smithi110 ceph-mon[28069]: pgmap v19169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:54 smithi193 ceph-mon[32782]: pgmap v19169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:42:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:56 smithi196 ceph-mon[32572]: pgmap v19170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:56 smithi110 ceph-mon[28069]: pgmap v19170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:56 smithi193 ceph-mon[32782]: pgmap v19170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35692.565328 secs 2024-04-26T21:42:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35692.565328 secs 2024-04-26T21:42:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35692.565328 secs 2024-04-26T21:42:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:58 smithi196 ceph-mon[32572]: pgmap v19171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:58 smithi110 ceph-mon[28069]: pgmap v19171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:42:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:58 smithi193 ceph-mon[32782]: pgmap v19171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:42:59 smithi196 ceph-mon[32572]: pgmap v19172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:42:59 smithi110 ceph-mon[28069]: pgmap v19172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:42:59 smithi193 ceph-mon[32782]: pgmap v19172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:02 smithi196 ceph-mon[32572]: pgmap v19173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:02 smithi110 ceph-mon[28069]: pgmap v19173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:02 smithi193 ceph-mon[32782]: pgmap v19173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35697.565468 secs 2024-04-26T21:43:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35697.565468 secs 2024-04-26T21:43:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35697.565468 secs 2024-04-26T21:43:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:04 smithi196 ceph-mon[32572]: pgmap v19174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:04 smithi110 ceph-mon[28069]: pgmap v19174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:04 smithi193 ceph-mon[32782]: pgmap v19174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:06.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:06 smithi196 ceph-mon[32572]: pgmap v19175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:06 smithi110 ceph-mon[28069]: pgmap v19175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:06 smithi193 ceph-mon[32782]: pgmap v19175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35702.565555 secs 2024-04-26T21:43:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:08 smithi196 ceph-mon[32572]: pgmap v19176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35702.565555 secs 2024-04-26T21:43:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:08 smithi110 ceph-mon[28069]: pgmap v19176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35702.565555 secs 2024-04-26T21:43:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:08 smithi193 ceph-mon[32782]: pgmap v19176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:10 smithi196 ceph-mon[32572]: pgmap v19177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:10 smithi110 ceph-mon[28069]: pgmap v19177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:10 smithi193 ceph-mon[32782]: pgmap v19177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:12 smithi196 ceph-mon[32572]: pgmap v19178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:12 smithi110 ceph-mon[28069]: pgmap v19178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:12 smithi193 ceph-mon[32782]: pgmap v19178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35707.565659 secs 2024-04-26T21:43:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35707.565659 secs 2024-04-26T21:43:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35707.565659 secs 2024-04-26T21:43:14.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:14 smithi196 ceph-mon[32572]: pgmap v19179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:14 smithi110 ceph-mon[28069]: pgmap v19179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:14 smithi193 ceph-mon[32782]: pgmap v19179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:16 smithi196 ceph-mon[32572]: pgmap v19180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:16 smithi110 ceph-mon[28069]: pgmap v19180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:16 smithi193 ceph-mon[32782]: pgmap v19180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35712.565777 secs 2024-04-26T21:43:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:18 smithi196 ceph-mon[32572]: pgmap v19181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:43:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35712.565777 secs 2024-04-26T21:43:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:18 smithi110 ceph-mon[28069]: pgmap v19181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:43:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35712.565777 secs 2024-04-26T21:43:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:18 smithi193 ceph-mon[32782]: pgmap v19181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:43:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:43:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:43:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:19 smithi110 ceph-mon[28069]: pgmap v19182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:43:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:19 smithi110 ceph-mon[28069]: pgmap v19183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:43:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:43:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:19 smithi193 ceph-mon[32782]: pgmap v19182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:43:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:19 smithi193 ceph-mon[32782]: pgmap v19183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:19.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:43:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:43:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:19 smithi196 ceph-mon[32572]: pgmap v19182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:43:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:19 smithi196 ceph-mon[32572]: pgmap v19183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:43:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:21 smithi196 ceph-mon[32572]: pgmap v19184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:21 smithi110 ceph-mon[28069]: pgmap v19184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:21 smithi193 ceph-mon[32782]: pgmap v19184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:23.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:22 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 35717.565893 secs 2024-04-26T21:43:23.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:22 smithi110 ceph-mon[28069]: slow request 1444.980961 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:43:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:22 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 35717.565893 secs 2024-04-26T21:43:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:22 smithi196 ceph-mon[32572]: slow request 1444.980961 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:43:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:22 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 35717.565893 secs 2024-04-26T21:43:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:22 smithi193 ceph-mon[32782]: slow request 1444.980961 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:43:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:23 smithi196 ceph-mon[32572]: pgmap v19185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:23 smithi110 ceph-mon[28069]: pgmap v19185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:23 smithi193 ceph-mon[32782]: pgmap v19185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:26.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:25 smithi193 ceph-mon[32782]: pgmap v19186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:25 smithi196 ceph-mon[32572]: pgmap v19186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:25 smithi110 ceph-mon[28069]: pgmap v19186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:27 smithi196 ceph-mon[32572]: pgmap v19187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35722.566012 secs 2024-04-26T21:43:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:27 smithi110 ceph-mon[28069]: pgmap v19187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35722.566012 secs 2024-04-26T21:43:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:27 smithi193 ceph-mon[32782]: pgmap v19187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:43:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35722.566012 secs 2024-04-26T21:43:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:29 smithi196 ceph-mon[32572]: pgmap v19188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:43:30.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:29 smithi110 ceph-mon[28069]: pgmap v19188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:43:30.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:29 smithi193 ceph-mon[32782]: pgmap v19188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:43:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:31 smithi196 ceph-mon[32572]: pgmap v19189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:31 smithi110 ceph-mon[28069]: pgmap v19189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:31 smithi193 ceph-mon[32782]: pgmap v19189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35727.566130 secs 2024-04-26T21:43:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35727.566130 secs 2024-04-26T21:43:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35727.566130 secs 2024-04-26T21:43:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:33 smithi196 ceph-mon[32572]: pgmap v19190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:33 smithi110 ceph-mon[28069]: pgmap v19190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:33 smithi193 ceph-mon[32782]: pgmap v19190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:35 smithi196 ceph-mon[32572]: pgmap v19191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:35 smithi110 ceph-mon[28069]: pgmap v19191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:35 smithi193 ceph-mon[32782]: pgmap v19191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:37 smithi196 ceph-mon[32572]: pgmap v19192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35732.566226 secs 2024-04-26T21:43:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:37 smithi110 ceph-mon[28069]: pgmap v19192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35732.566226 secs 2024-04-26T21:43:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:37 smithi193 ceph-mon[32782]: pgmap v19192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35732.566226 secs 2024-04-26T21:43:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:39 smithi196 ceph-mon[32572]: pgmap v19193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:39 smithi110 ceph-mon[28069]: pgmap v19193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:39 smithi193 ceph-mon[32782]: pgmap v19193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:41 smithi196 ceph-mon[32572]: pgmap v19194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:41 smithi110 ceph-mon[28069]: pgmap v19194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:41 smithi193 ceph-mon[32782]: pgmap v19194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35737.566350 secs 2024-04-26T21:43:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35737.566350 secs 2024-04-26T21:43:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35737.566350 secs 2024-04-26T21:43:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:43 smithi196 ceph-mon[32572]: pgmap v19195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:43 smithi110 ceph-mon[28069]: pgmap v19195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:43 smithi193 ceph-mon[32782]: pgmap v19195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:44 smithi196 ceph-mon[32572]: pgmap v19196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:44 smithi110 ceph-mon[28069]: pgmap v19196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:44 smithi193 ceph-mon[32782]: pgmap v19196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:47 smithi196 ceph-mon[32572]: pgmap v19197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35742.566463 secs 2024-04-26T21:43:48.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:47 smithi110 ceph-mon[28069]: pgmap v19197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:48.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35742.566463 secs 2024-04-26T21:43:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:47 smithi193 ceph-mon[32782]: pgmap v19197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35742.566463 secs 2024-04-26T21:43:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:49 smithi196 ceph-mon[32572]: pgmap v19198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:49 smithi110 ceph-mon[28069]: pgmap v19198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:49 smithi193 ceph-mon[32782]: pgmap v19198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:52.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:51 smithi196 ceph-mon[32572]: pgmap v19199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:51 smithi110 ceph-mon[28069]: pgmap v19199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:51 smithi193 ceph-mon[32782]: pgmap v19199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:53.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35747.566594 secs 2024-04-26T21:43:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35747.566594 secs 2024-04-26T21:43:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35747.566594 secs 2024-04-26T21:43:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:53 smithi196 ceph-mon[32572]: pgmap v19200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:53 smithi110 ceph-mon[28069]: pgmap v19200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:53 smithi193 ceph-mon[32782]: pgmap v19200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:43:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:55 smithi196 ceph-mon[32572]: pgmap v19201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:55 smithi110 ceph-mon[28069]: pgmap v19201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:55 smithi193 ceph-mon[32782]: pgmap v19201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:57 smithi196 ceph-mon[32572]: pgmap v19202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:58.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35752.566689 secs 2024-04-26T21:43:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:57 smithi110 ceph-mon[28069]: pgmap v19202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35752.566689 secs 2024-04-26T21:43:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:57 smithi193 ceph-mon[32782]: pgmap v19202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:43:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35752.566689 secs 2024-04-26T21:44:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:43:59 smithi196 ceph-mon[32572]: pgmap v19203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:43:59 smithi110 ceph-mon[28069]: pgmap v19203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:43:59 smithi193 ceph-mon[32782]: pgmap v19203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:02.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:01 smithi196 ceph-mon[32572]: pgmap v19204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:01 smithi110 ceph-mon[28069]: pgmap v19204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:01 smithi193 ceph-mon[32782]: pgmap v19204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35757.566801 secs 2024-04-26T21:44:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35757.566801 secs 2024-04-26T21:44:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35757.566801 secs 2024-04-26T21:44:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:03 smithi196 ceph-mon[32572]: pgmap v19205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:03 smithi110 ceph-mon[28069]: pgmap v19205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:03 smithi193 ceph-mon[32782]: pgmap v19205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:05 smithi196 ceph-mon[32572]: pgmap v19206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:05 smithi110 ceph-mon[28069]: pgmap v19206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:05 smithi193 ceph-mon[32782]: pgmap v19206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:07 smithi196 ceph-mon[32572]: pgmap v19207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35762.566893 secs 2024-04-26T21:44:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:07 smithi110 ceph-mon[28069]: pgmap v19207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35762.566893 secs 2024-04-26T21:44:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:07 smithi193 ceph-mon[32782]: pgmap v19207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35762.566893 secs 2024-04-26T21:44:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:09 smithi110 ceph-mon[28069]: pgmap v19208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:09 smithi193 ceph-mon[32782]: pgmap v19208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:09.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:09 smithi196 ceph-mon[32572]: pgmap v19208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:11 smithi196 ceph-mon[32572]: pgmap v19209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:11 smithi110 ceph-mon[28069]: pgmap v19209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:11 smithi193 ceph-mon[32782]: pgmap v19209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35767.567033 secs 2024-04-26T21:44:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35767.567033 secs 2024-04-26T21:44:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35767.567033 secs 2024-04-26T21:44:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:13 smithi196 ceph-mon[32572]: pgmap v19210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:13 smithi110 ceph-mon[28069]: pgmap v19210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:13 smithi193 ceph-mon[32782]: pgmap v19210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:15 smithi196 ceph-mon[32572]: pgmap v19211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:15 smithi110 ceph-mon[28069]: pgmap v19211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:15 smithi193 ceph-mon[32782]: pgmap v19211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:17.943 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:44:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:44:17.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:44:17.943 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:44:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:44:17.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:44:17.943 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:44:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:44:17.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:44:17.943 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:44:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:44:17.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:44:17.943 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:44:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:44:17.664+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:44:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:17 smithi196 ceph-mon[32572]: pgmap v19212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35772.567151 secs 2024-04-26T21:44:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:17 smithi110 ceph-mon[28069]: pgmap v19212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35772.567151 secs 2024-04-26T21:44:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:17 smithi193 ceph-mon[32782]: pgmap v19212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35772.567151 secs 2024-04-26T21:44:20.202 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:19 smithi193 ceph-mon[32782]: pgmap v19213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:20.202 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:44:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:19 smithi196 ceph-mon[32572]: pgmap v19213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:44:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:19 smithi110 ceph-mon[28069]: pgmap v19213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: pgmap v19214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:21 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: pgmap v19214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:21 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: pgmap v19214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:21 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35777.567279 secs 2024-04-26T21:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35777.567279 secs 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35777.567279 secs 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:23 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:44:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:23 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:44:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:23 smithi196 ceph-mon[32572]: pgmap v19215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T21:44:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:23 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:44:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:23 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:44:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:23 smithi110 ceph-mon[28069]: pgmap v19215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T21:44:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:23 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:44:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:23 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:44:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:23 smithi193 ceph-mon[32782]: pgmap v19215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T21:44:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:24.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:44:25.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:44:25.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:24 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:44:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:44:25.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:24 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:44:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:24 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:44:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:25 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:44:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:25 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:44:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:25 smithi196 ceph-mon[32572]: pgmap v19216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T21:44:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:25 smithi196 ceph-mon[32572]: pgmap v19217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:26.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:25 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:44:26.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:25 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:44:26.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:25 smithi193 ceph-mon[32782]: pgmap v19216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T21:44:26.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:25 smithi193 ceph-mon[32782]: pgmap v19217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:25 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:44:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:25 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:44:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:25 smithi110 ceph-mon[28069]: pgmap v19216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T21:44:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:25 smithi110 ceph-mon[28069]: pgmap v19217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:27 smithi196 ceph-mon[32572]: pgmap v19218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35782.567367 secs 2024-04-26T21:44:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:27 smithi110 ceph-mon[28069]: pgmap v19218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35782.567367 secs 2024-04-26T21:44:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:27 smithi193 ceph-mon[32782]: pgmap v19218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35782.567367 secs 2024-04-26T21:44:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:28 smithi196 ceph-mon[32572]: pgmap v19219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:28 smithi110 ceph-mon[28069]: pgmap v19219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:28 smithi193 ceph-mon[32782]: pgmap v19219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:31 smithi196 ceph-mon[32572]: pgmap v19220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:31 smithi110 ceph-mon[28069]: pgmap v19220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:31 smithi193 ceph-mon[32782]: pgmap v19220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:44:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35787.567499 secs 2024-04-26T21:44:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:33 smithi196 ceph-mon[32572]: pgmap v19221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T21:44:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35787.567499 secs 2024-04-26T21:44:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:33 smithi110 ceph-mon[28069]: pgmap v19221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T21:44:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35787.567499 secs 2024-04-26T21:44:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:33 smithi193 ceph-mon[32782]: pgmap v19221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T21:44:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:35 smithi196 ceph-mon[32572]: pgmap v19222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:44:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:35 smithi110 ceph-mon[28069]: pgmap v19222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:44:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:35 smithi193 ceph-mon[32782]: pgmap v19222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:44:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:37 smithi196 ceph-mon[32572]: pgmap v19223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:37 smithi110 ceph-mon[28069]: pgmap v19223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:37 smithi193 ceph-mon[32782]: pgmap v19223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35792.567656 secs 2024-04-26T21:44:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35792.567656 secs 2024-04-26T21:44:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35792.567656 secs 2024-04-26T21:44:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:39 smithi196 ceph-mon[32572]: pgmap v19224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:39 smithi110 ceph-mon[28069]: pgmap v19224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:39 smithi193 ceph-mon[32782]: pgmap v19224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:41 smithi196 ceph-mon[32572]: pgmap v19225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:41 smithi110 ceph-mon[28069]: pgmap v19225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:41 smithi193 ceph-mon[32782]: pgmap v19225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35797.567748 secs 2024-04-26T21:44:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:43 smithi196 ceph-mon[32572]: pgmap v19226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35797.567748 secs 2024-04-26T21:44:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:43 smithi110 ceph-mon[28069]: pgmap v19226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35797.567748 secs 2024-04-26T21:44:43.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:43 smithi193 ceph-mon[32782]: pgmap v19226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:45 smithi196 ceph-mon[32572]: pgmap v19227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:45 smithi110 ceph-mon[28069]: pgmap v19227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:45 smithi193 ceph-mon[32782]: pgmap v19227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:47 smithi196 ceph-mon[32572]: pgmap v19228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:47 smithi110 ceph-mon[28069]: pgmap v19228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:47 smithi193 ceph-mon[32782]: pgmap v19228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35802.567866 secs 2024-04-26T21:44:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35802.567866 secs 2024-04-26T21:44:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35802.567866 secs 2024-04-26T21:44:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:49 smithi196 ceph-mon[32572]: pgmap v19229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:49 smithi110 ceph-mon[28069]: pgmap v19229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:49 smithi193 ceph-mon[32782]: pgmap v19229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:51 smithi196 ceph-mon[32572]: pgmap v19230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:51 smithi110 ceph-mon[28069]: pgmap v19230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:51 smithi193 ceph-mon[32782]: pgmap v19230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35807.567986 secs 2024-04-26T21:44:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:53 smithi110 ceph-mon[28069]: pgmap v19231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:44:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35807.567986 secs 2024-04-26T21:44:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:53 smithi193 ceph-mon[32782]: pgmap v19231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:44:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35807.567986 secs 2024-04-26T21:44:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:53 smithi196 ceph-mon[32572]: pgmap v19231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:44:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:55 smithi110 ceph-mon[28069]: pgmap v19232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:55 smithi193 ceph-mon[32782]: pgmap v19232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:55 smithi196 ceph-mon[32572]: pgmap v19232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:57 smithi110 ceph-mon[28069]: pgmap v19233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:57 smithi193 ceph-mon[32782]: pgmap v19233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:57 smithi196 ceph-mon[32572]: pgmap v19233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:44:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35812.568064 secs 2024-04-26T21:44:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35812.568064 secs 2024-04-26T21:44:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35812.568064 secs 2024-04-26T21:44:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:44:59 smithi110 ceph-mon[28069]: pgmap v19234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:44:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:44:59 smithi193 ceph-mon[32782]: pgmap v19234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:00.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:44:59 smithi196 ceph-mon[32572]: pgmap v19234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:01 smithi110 ceph-mon[28069]: pgmap v19235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:01 smithi193 ceph-mon[32782]: pgmap v19235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:01 smithi196 ceph-mon[32572]: pgmap v19235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35817.568135 secs 2024-04-26T21:45:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:03 smithi110 ceph-mon[28069]: pgmap v19236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35817.568135 secs 2024-04-26T21:45:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:03 smithi193 ceph-mon[32782]: pgmap v19236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35817.568135 secs 2024-04-26T21:45:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:03 smithi196 ceph-mon[32572]: pgmap v19236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:05 smithi193 ceph-mon[32782]: pgmap v19237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:05 smithi196 ceph-mon[32572]: pgmap v19237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:05 smithi110 ceph-mon[28069]: pgmap v19237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:07 smithi193 ceph-mon[32782]: pgmap v19238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:45:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:07 smithi196 ceph-mon[32572]: pgmap v19238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:45:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:07 smithi110 ceph-mon[28069]: pgmap v19238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:45:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35822.568252 secs 2024-04-26T21:45:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35822.568252 secs 2024-04-26T21:45:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35822.568252 secs 2024-04-26T21:45:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:09 smithi193 ceph-mon[32782]: pgmap v19239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:09 smithi196 ceph-mon[32572]: pgmap v19239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:09 smithi110 ceph-mon[28069]: pgmap v19239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:11 smithi193 ceph-mon[32782]: pgmap v19240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:45:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:11 smithi196 ceph-mon[32572]: pgmap v19240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:45:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:11 smithi110 ceph-mon[28069]: pgmap v19240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:45:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35827.568369 secs 2024-04-26T21:45:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:13 smithi193 ceph-mon[32782]: pgmap v19241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35827.568369 secs 2024-04-26T21:45:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:13 smithi196 ceph-mon[32572]: pgmap v19241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35827.568369 secs 2024-04-26T21:45:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:13 smithi110 ceph-mon[28069]: pgmap v19241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:45:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:15 smithi196 ceph-mon[32572]: pgmap v19242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:45:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:15 smithi110 ceph-mon[28069]: pgmap v19242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:45:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:15 smithi193 ceph-mon[32782]: pgmap v19242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:45:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:17 smithi196 ceph-mon[32572]: pgmap v19243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:17 smithi110 ceph-mon[28069]: pgmap v19243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:17 smithi193 ceph-mon[32782]: pgmap v19243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35832.568486 secs 2024-04-26T21:45:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35832.568486 secs 2024-04-26T21:45:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35832.568486 secs 2024-04-26T21:45:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:19 smithi196 ceph-mon[32572]: pgmap v19244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:19 smithi110 ceph-mon[28069]: pgmap v19244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:19.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:19 smithi193 ceph-mon[32782]: pgmap v19244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:21 smithi196 ceph-mon[32572]: pgmap v19245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:21 smithi110 ceph-mon[28069]: pgmap v19245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:21 smithi193 ceph-mon[32782]: pgmap v19245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:45:22.315+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:45:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:45:22.315+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:45:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:45:22.316+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 276 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:45:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:45:22.316+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 276 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:45:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35837.568604 secs 2024-04-26T21:45:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:23 smithi196 ceph-mon[32572]: pgmap v19246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:45:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35837.568604 secs 2024-04-26T21:45:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:23 smithi110 ceph-mon[28069]: pgmap v19246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:45:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35837.568604 secs 2024-04-26T21:45:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:23 smithi193 ceph-mon[32782]: pgmap v19246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:45:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:25 smithi196 ceph-mon[32572]: pgmap v19247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:45:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:25 smithi110 ceph-mon[28069]: pgmap v19247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:45:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:25 smithi193 ceph-mon[32782]: pgmap v19247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:45:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:45:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:45:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:26 smithi196 ceph-mon[32572]: pgmap v19248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:45:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:26 smithi196 ceph-mon[32572]: pgmap v19249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:45:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:45:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:45:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:26 smithi110 ceph-mon[28069]: pgmap v19248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:45:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:26 smithi110 ceph-mon[28069]: pgmap v19249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:45:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:45:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:45:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:26 smithi193 ceph-mon[32782]: pgmap v19248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:45:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:26 smithi193 ceph-mon[32782]: pgmap v19249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:26.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:45:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35842.568741 secs 2024-04-26T21:45:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35842.568741 secs 2024-04-26T21:45:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35842.568741 secs 2024-04-26T21:45:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:29 smithi193 ceph-mon[32782]: pgmap v19250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:29 smithi196 ceph-mon[32572]: pgmap v19250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:29 smithi110 ceph-mon[28069]: pgmap v19250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:32.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:31 smithi196 ceph-mon[32572]: pgmap v19251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:31 smithi110 ceph-mon[28069]: pgmap v19251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:31 smithi193 ceph-mon[32782]: pgmap v19251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35847.568860 secs 2024-04-26T21:45:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35847.568860 secs 2024-04-26T21:45:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35847.568860 secs 2024-04-26T21:45:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:33 smithi196 ceph-mon[32572]: pgmap v19252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:45:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:33 smithi110 ceph-mon[28069]: pgmap v19252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:45:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:33 smithi193 ceph-mon[32782]: pgmap v19252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:45:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:35 smithi196 ceph-mon[32572]: pgmap v19253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:35 smithi110 ceph-mon[28069]: pgmap v19253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:35 smithi193 ceph-mon[32782]: pgmap v19253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:45:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:37 smithi196 ceph-mon[32572]: pgmap v19254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:45:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35852.568982 secs 2024-04-26T21:45:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:37 smithi110 ceph-mon[28069]: pgmap v19254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:45:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35852.568982 secs 2024-04-26T21:45:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:37 smithi193 ceph-mon[32782]: pgmap v19254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:45:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35852.568982 secs 2024-04-26T21:45:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:39 smithi193 ceph-mon[32782]: pgmap v19255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:39 smithi196 ceph-mon[32572]: pgmap v19255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:39 smithi110 ceph-mon[28069]: pgmap v19255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:41 smithi196 ceph-mon[32572]: pgmap v19256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:41 smithi110 ceph-mon[28069]: pgmap v19256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:41 smithi193 ceph-mon[32782]: pgmap v19256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35857.569051 secs 2024-04-26T21:45:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35857.569051 secs 2024-04-26T21:45:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35857.569051 secs 2024-04-26T21:45:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:43 smithi196 ceph-mon[32572]: pgmap v19257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:43 smithi110 ceph-mon[28069]: pgmap v19257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:43 smithi193 ceph-mon[32782]: pgmap v19257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:45 smithi196 ceph-mon[32572]: pgmap v19258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:45 smithi110 ceph-mon[28069]: pgmap v19258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:45 smithi193 ceph-mon[32782]: pgmap v19258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:47 smithi196 ceph-mon[32572]: pgmap v19259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35862.569142 secs 2024-04-26T21:45:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:47 smithi110 ceph-mon[28069]: pgmap v19259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35862.569142 secs 2024-04-26T21:45:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:47 smithi193 ceph-mon[32782]: pgmap v19259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35862.569142 secs 2024-04-26T21:45:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:49 smithi196 ceph-mon[32572]: pgmap v19260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:49 smithi110 ceph-mon[28069]: pgmap v19260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:49 smithi193 ceph-mon[32782]: pgmap v19260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:51 smithi196 ceph-mon[32572]: pgmap v19261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:51 smithi110 ceph-mon[28069]: pgmap v19261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:51 smithi193 ceph-mon[32782]: pgmap v19261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35867.569281 secs 2024-04-26T21:45:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35867.569281 secs 2024-04-26T21:45:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35867.569281 secs 2024-04-26T21:45:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:53 smithi196 ceph-mon[32572]: pgmap v19262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:53 smithi110 ceph-mon[28069]: pgmap v19262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:53 smithi193 ceph-mon[32782]: pgmap v19262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:55 smithi196 ceph-mon[32572]: pgmap v19263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:55 smithi110 ceph-mon[28069]: pgmap v19263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:55 smithi193 ceph-mon[32782]: pgmap v19263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:45:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:57 smithi196 ceph-mon[32572]: pgmap v19264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35872.569442 secs 2024-04-26T21:45:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:57 smithi110 ceph-mon[28069]: pgmap v19264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35872.569442 secs 2024-04-26T21:45:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:57 smithi193 ceph-mon[32782]: pgmap v19264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:45:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35872.569442 secs 2024-04-26T21:46:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:45:59 smithi196 ceph-mon[32572]: pgmap v19265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:45:59 smithi110 ceph-mon[28069]: pgmap v19265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:45:59 smithi193 ceph-mon[32782]: pgmap v19265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:02.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:01 smithi196 ceph-mon[32572]: pgmap v19266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:01 smithi110 ceph-mon[28069]: pgmap v19266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:01 smithi193 ceph-mon[32782]: pgmap v19266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35877.569546 secs 2024-04-26T21:46:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35877.569546 secs 2024-04-26T21:46:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35877.569546 secs 2024-04-26T21:46:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:03 smithi196 ceph-mon[32572]: pgmap v19267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:03 smithi110 ceph-mon[28069]: pgmap v19267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:03 smithi193 ceph-mon[32782]: pgmap v19267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:06.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:05 smithi196 ceph-mon[32572]: pgmap v19268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:05 smithi110 ceph-mon[28069]: pgmap v19268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:05 smithi193 ceph-mon[32782]: pgmap v19268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:07 smithi196 ceph-mon[32572]: pgmap v19269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35882.569668 secs 2024-04-26T21:46:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:07 smithi110 ceph-mon[28069]: pgmap v19269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35882.569668 secs 2024-04-26T21:46:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:07 smithi193 ceph-mon[32782]: pgmap v19269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35882.569668 secs 2024-04-26T21:46:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:09 smithi110 ceph-mon[28069]: pgmap v19270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:09 smithi193 ceph-mon[32782]: pgmap v19270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:09 smithi196 ceph-mon[32572]: pgmap v19270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:11 smithi110 ceph-mon[28069]: pgmap v19271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:11 smithi193 ceph-mon[32782]: pgmap v19271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:12.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:11 smithi196 ceph-mon[32572]: pgmap v19271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35887.569733 secs 2024-04-26T21:46:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:13 smithi193 ceph-mon[32782]: pgmap v19272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35887.569733 secs 2024-04-26T21:46:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:13 smithi196 ceph-mon[32572]: pgmap v19272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35887.569733 secs 2024-04-26T21:46:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:13 smithi110 ceph-mon[28069]: pgmap v19272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:15 smithi193 ceph-mon[32782]: pgmap v19273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:15 smithi196 ceph-mon[32572]: pgmap v19273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:15 smithi110 ceph-mon[28069]: pgmap v19273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:17 smithi193 ceph-mon[32782]: pgmap v19274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:17 smithi196 ceph-mon[32572]: pgmap v19274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:17 smithi110 ceph-mon[28069]: pgmap v19274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:18 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 35892.569869 secs 2024-04-26T21:46:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:18 smithi193 ceph-mon[32782]: slow request 11524.785431 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:46:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:18 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 35892.569869 secs 2024-04-26T21:46:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:18 smithi196 ceph-mon[32572]: slow request 11524.785431 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:46:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:18 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 35892.569869 secs 2024-04-26T21:46:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:18 smithi110 ceph-mon[28069]: slow request 11524.785431 seconds old, received at 2024-04-26T18:34:12.082760+0000: client_request(client.27085:1 getattr pAsLsXsFs #0x1 2024-04-26T18:34:12.078040+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:46:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:19 smithi193 ceph-mon[32782]: pgmap v19275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:19 smithi196 ceph-mon[32572]: pgmap v19275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:19 smithi110 ceph-mon[28069]: pgmap v19275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:21 smithi193 ceph-mon[32782]: pgmap v19276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:46:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:21 smithi196 ceph-mon[32572]: pgmap v19276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:46:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:21 smithi110 ceph-mon[28069]: pgmap v19276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:46:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:23 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 35897.569992 secs 2024-04-26T21:46:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:23 smithi193 ceph-mon[32782]: slow request 724.493103 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:46:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:23 smithi193 ceph-mon[32782]: pgmap v19277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:46:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:23 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 35897.569992 secs 2024-04-26T21:46:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:23 smithi196 ceph-mon[32572]: slow request 724.493103 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:46:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:23 smithi196 ceph-mon[32572]: pgmap v19277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:46:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:23 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 35897.569992 secs 2024-04-26T21:46:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:23 smithi110 ceph-mon[28069]: slow request 724.493103 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:46:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:23 smithi110 ceph-mon[28069]: pgmap v19277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:46:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:25 smithi193 ceph-mon[32782]: pgmap v19278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:25.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:25 smithi196 ceph-mon[32572]: pgmap v19278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:25 smithi110 ceph-mon[28069]: pgmap v19278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:46:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:46:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:46:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:27 smithi196 ceph-mon[32572]: pgmap v19279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:46:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:27 smithi110 ceph-mon[28069]: pgmap v19279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:46:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:27 smithi193 ceph-mon[32782]: pgmap v19279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:46:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35902.570073 secs 2024-04-26T21:46:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:46:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:46:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:28 smithi196 ceph-mon[32572]: pgmap v19280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:28 smithi196 ceph-mon[32572]: pgmap v19281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:46:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35902.570073 secs 2024-04-26T21:46:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:46:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:46:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:28 smithi110 ceph-mon[28069]: pgmap v19280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:28 smithi110 ceph-mon[28069]: pgmap v19281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:46:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35902.570073 secs 2024-04-26T21:46:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:46:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:46:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:28 smithi193 ceph-mon[32782]: pgmap v19280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:28 smithi193 ceph-mon[32782]: pgmap v19281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:46:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:30 smithi196 ceph-mon[32572]: pgmap v19282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:30 smithi110 ceph-mon[28069]: pgmap v19282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:30 smithi193 ceph-mon[32782]: pgmap v19282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:32 smithi196 ceph-mon[32572]: pgmap v19283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35907.570175 secs 2024-04-26T21:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:32 smithi110 ceph-mon[28069]: pgmap v19283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35907.570175 secs 2024-04-26T21:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:32 smithi193 ceph-mon[32782]: pgmap v19283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35907.570175 secs 2024-04-26T21:46:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:34 smithi196 ceph-mon[32572]: pgmap v19284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:34 smithi110 ceph-mon[28069]: pgmap v19284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:34 smithi193 ceph-mon[32782]: pgmap v19284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:36 smithi196 ceph-mon[32572]: pgmap v19285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:36 smithi110 ceph-mon[28069]: pgmap v19285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:36 smithi193 ceph-mon[32782]: pgmap v19285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:46:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35912.570240 secs 2024-04-26T21:46:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35912.570240 secs 2024-04-26T21:46:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35912.570240 secs 2024-04-26T21:46:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:38 smithi196 ceph-mon[32572]: pgmap v19286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:46:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:38 smithi110 ceph-mon[28069]: pgmap v19286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:46:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:38 smithi193 ceph-mon[32782]: pgmap v19286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:46:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:40 smithi196 ceph-mon[32572]: pgmap v19287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:40 smithi110 ceph-mon[28069]: pgmap v19287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:40 smithi193 ceph-mon[32782]: pgmap v19287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:42 smithi196 ceph-mon[32572]: pgmap v19288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35917.570372 secs 2024-04-26T21:46:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:42 smithi110 ceph-mon[28069]: pgmap v19288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35917.570372 secs 2024-04-26T21:46:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:42 smithi193 ceph-mon[32782]: pgmap v19288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35917.570372 secs 2024-04-26T21:46:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:44 smithi196 ceph-mon[32572]: pgmap v19289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:44 smithi110 ceph-mon[28069]: pgmap v19289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:44 smithi193 ceph-mon[32782]: pgmap v19289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:46 smithi196 ceph-mon[32572]: pgmap v19290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:46 smithi110 ceph-mon[28069]: pgmap v19290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:46 smithi193 ceph-mon[32782]: pgmap v19290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35922.570489 secs 2024-04-26T21:46:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35922.570489 secs 2024-04-26T21:46:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35922.570489 secs 2024-04-26T21:46:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:48 smithi196 ceph-mon[32572]: pgmap v19291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:48 smithi110 ceph-mon[28069]: pgmap v19291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:48 smithi193 ceph-mon[32782]: pgmap v19291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:50 smithi196 ceph-mon[32572]: pgmap v19292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:50 smithi110 ceph-mon[28069]: pgmap v19292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:50 smithi193 ceph-mon[32782]: pgmap v19292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:52 smithi196 ceph-mon[32572]: pgmap v19293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35927.570613 secs 2024-04-26T21:46:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:52 smithi110 ceph-mon[28069]: pgmap v19293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35927.570613 secs 2024-04-26T21:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:52 smithi193 ceph-mon[32782]: pgmap v19293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35927.570613 secs 2024-04-26T21:46:55.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:54 smithi196 ceph-mon[32572]: pgmap v19294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:54 smithi110 ceph-mon[28069]: pgmap v19294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:54 smithi193 ceph-mon[32782]: pgmap v19294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:56 smithi196 ceph-mon[32572]: pgmap v19295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:56 smithi110 ceph-mon[28069]: pgmap v19295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:56 smithi193 ceph-mon[32782]: pgmap v19295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:46:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35932.570740 secs 2024-04-26T21:46:58.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35932.570740 secs 2024-04-26T21:46:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35932.570740 secs 2024-04-26T21:46:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:46:58 smithi196 ceph-mon[32572]: pgmap v19296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:46:58 smithi110 ceph-mon[28069]: pgmap v19296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:46:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:46:58 smithi193 ceph-mon[32782]: pgmap v19296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:00 smithi196 ceph-mon[32572]: pgmap v19297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:00 smithi110 ceph-mon[28069]: pgmap v19297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:00 smithi193 ceph-mon[32782]: pgmap v19297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:02 smithi196 ceph-mon[32572]: pgmap v19298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35937.570834 secs 2024-04-26T21:47:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:02 smithi110 ceph-mon[28069]: pgmap v19298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35937.570834 secs 2024-04-26T21:47:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:02 smithi193 ceph-mon[32782]: pgmap v19298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35937.570834 secs 2024-04-26T21:47:05.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:04 smithi196 ceph-mon[32572]: pgmap v19299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:04 smithi110 ceph-mon[28069]: pgmap v19299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:04 smithi193 ceph-mon[32782]: pgmap v19299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:06 smithi196 ceph-mon[32572]: pgmap v19300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:06 smithi110 ceph-mon[28069]: pgmap v19300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:06 smithi193 ceph-mon[32782]: pgmap v19300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35942.570957 secs 2024-04-26T21:47:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35942.570957 secs 2024-04-26T21:47:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35942.570957 secs 2024-04-26T21:47:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:08 smithi196 ceph-mon[32572]: pgmap v19301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:08 smithi110 ceph-mon[28069]: pgmap v19301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:08 smithi193 ceph-mon[32782]: pgmap v19301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:10 smithi110 ceph-mon[28069]: pgmap v19302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:10 smithi193 ceph-mon[32782]: pgmap v19302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:10 smithi196 ceph-mon[32572]: pgmap v19302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:12 smithi110 ceph-mon[28069]: pgmap v19303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35947.571073 secs 2024-04-26T21:47:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:12 smithi193 ceph-mon[32782]: pgmap v19303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35947.571073 secs 2024-04-26T21:47:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:12 smithi196 ceph-mon[32572]: pgmap v19303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35947.571073 secs 2024-04-26T21:47:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:14 smithi110 ceph-mon[28069]: pgmap v19304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:14 smithi193 ceph-mon[32782]: pgmap v19304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:14 smithi196 ceph-mon[32572]: pgmap v19304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:16 smithi110 ceph-mon[28069]: pgmap v19305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:16 smithi193 ceph-mon[32782]: pgmap v19305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:16 smithi196 ceph-mon[32572]: pgmap v19305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:17 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 35952.571214 secs 2024-04-26T21:47:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:17 smithi110 ceph-mon[28069]: slow request 2880.607746 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:47:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:17 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 35952.571214 secs 2024-04-26T21:47:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:17 smithi193 ceph-mon[32782]: slow request 2880.607746 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:47:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:17 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 35952.571214 secs 2024-04-26T21:47:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:17 smithi196 ceph-mon[32572]: slow request 2880.607746 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:47:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:18 smithi110 ceph-mon[28069]: pgmap v19306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:18 smithi193 ceph-mon[32782]: pgmap v19306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:18 smithi196 ceph-mon[32572]: pgmap v19306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:20 smithi110 ceph-mon[28069]: pgmap v19307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:20 smithi193 ceph-mon[32782]: pgmap v19307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:20 smithi196 ceph-mon[32572]: pgmap v19307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:23.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:22 smithi196 ceph-mon[32572]: pgmap v19308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:23.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35957.571306 secs 2024-04-26T21:47:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:22 smithi193 ceph-mon[32782]: pgmap v19308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35957.571306 secs 2024-04-26T21:47:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:22 smithi110 ceph-mon[28069]: pgmap v19308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35957.571306 secs 2024-04-26T21:47:25.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:24 smithi110 ceph-mon[28069]: pgmap v19309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:24 smithi193 ceph-mon[32782]: pgmap v19309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:25.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:24 smithi196 ceph-mon[32572]: pgmap v19309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:26 smithi193 ceph-mon[32782]: pgmap v19310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:26 smithi196 ceph-mon[32572]: pgmap v19310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:26 smithi110 ceph-mon[28069]: pgmap v19310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35962.571424 secs 2024-04-26T21:47:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35962.571424 secs 2024-04-26T21:47:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35962.571424 secs 2024-04-26T21:47:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:28 smithi193 ceph-mon[32782]: pgmap v19311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:47:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:28 smithi196 ceph-mon[32572]: pgmap v19311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:29.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:47:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:28 smithi110 ceph-mon[28069]: pgmap v19311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:47:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:47:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:47:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:47:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:47:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:47:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:47:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:47:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:47:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:47:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:30 smithi193 ceph-mon[32782]: pgmap v19312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:30 smithi196 ceph-mon[32572]: pgmap v19312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:30 smithi110 ceph-mon[28069]: pgmap v19312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:32 smithi193 ceph-mon[32782]: pgmap v19313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35967.571522 secs 2024-04-26T21:47:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:32 smithi196 ceph-mon[32572]: pgmap v19313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35967.571522 secs 2024-04-26T21:47:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:32 smithi110 ceph-mon[28069]: pgmap v19313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35967.571522 secs 2024-04-26T21:47:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:34 smithi193 ceph-mon[32782]: pgmap v19314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:47:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:34 smithi196 ceph-mon[32572]: pgmap v19314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:47:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:34 smithi110 ceph-mon[28069]: pgmap v19314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:47:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:36 smithi193 ceph-mon[32782]: pgmap v19315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:36 smithi196 ceph-mon[32572]: pgmap v19315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:36 smithi110 ceph-mon[28069]: pgmap v19315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35972.571648 secs 2024-04-26T21:47:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35972.571648 secs 2024-04-26T21:47:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35972.571648 secs 2024-04-26T21:47:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:38 smithi193 ceph-mon[32782]: pgmap v19316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:39.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:38 smithi196 ceph-mon[32572]: pgmap v19316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:38 smithi110 ceph-mon[28069]: pgmap v19316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:40 smithi193 ceph-mon[32782]: pgmap v19317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:40 smithi196 ceph-mon[32572]: pgmap v19317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:40 smithi110 ceph-mon[28069]: pgmap v19317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:47:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:42 smithi193 ceph-mon[32782]: pgmap v19318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35977.571723 secs 2024-04-26T21:47:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:42 smithi196 ceph-mon[32572]: pgmap v19318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35977.571723 secs 2024-04-26T21:47:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:42 smithi110 ceph-mon[28069]: pgmap v19318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35977.571723 secs 2024-04-26T21:47:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:44 smithi196 ceph-mon[32572]: pgmap v19319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:44 smithi110 ceph-mon[28069]: pgmap v19319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:44 smithi193 ceph-mon[32782]: pgmap v19319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:46 smithi196 ceph-mon[32572]: pgmap v19320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:46 smithi110 ceph-mon[28069]: pgmap v19320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:46 smithi193 ceph-mon[32782]: pgmap v19320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35982.571844 secs 2024-04-26T21:47:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35982.571844 secs 2024-04-26T21:47:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35982.571844 secs 2024-04-26T21:47:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:48 smithi196 ceph-mon[32572]: pgmap v19321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:48 smithi110 ceph-mon[28069]: pgmap v19321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:48 smithi193 ceph-mon[32782]: pgmap v19321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:50 smithi196 ceph-mon[32572]: pgmap v19322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:50 smithi110 ceph-mon[28069]: pgmap v19322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:50 smithi193 ceph-mon[32782]: pgmap v19322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:52 smithi196 ceph-mon[32572]: pgmap v19323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35987.571959 secs 2024-04-26T21:47:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:52 smithi110 ceph-mon[28069]: pgmap v19323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35987.571959 secs 2024-04-26T21:47:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:52 smithi193 ceph-mon[32782]: pgmap v19323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35987.571959 secs 2024-04-26T21:47:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:54 smithi196 ceph-mon[32572]: pgmap v19324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:54 smithi110 ceph-mon[28069]: pgmap v19324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:54 smithi193 ceph-mon[32782]: pgmap v19324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:47:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:56 smithi196 ceph-mon[32572]: pgmap v19325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:56 smithi110 ceph-mon[28069]: pgmap v19325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:56 smithi193 ceph-mon[32782]: pgmap v19325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35992.572036 secs 2024-04-26T21:47:58.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35992.572036 secs 2024-04-26T21:47:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35992.572036 secs 2024-04-26T21:47:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:47:58 smithi196 ceph-mon[32572]: pgmap v19326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:47:58 smithi110 ceph-mon[28069]: pgmap v19326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:47:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:47:58 smithi193 ceph-mon[32782]: pgmap v19326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:00 smithi196 ceph-mon[32572]: pgmap v19327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:00 smithi110 ceph-mon[28069]: pgmap v19327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:00 smithi193 ceph-mon[32782]: pgmap v19327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:02 smithi196 ceph-mon[32572]: pgmap v19328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 35997.572154 secs 2024-04-26T21:48:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:02 smithi110 ceph-mon[28069]: pgmap v19328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 35997.572154 secs 2024-04-26T21:48:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:02 smithi193 ceph-mon[32782]: pgmap v19328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 35997.572154 secs 2024-04-26T21:48:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:04 smithi196 ceph-mon[32572]: pgmap v19329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:04 smithi110 ceph-mon[28069]: pgmap v19329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:04 smithi193 ceph-mon[32782]: pgmap v19329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:06 smithi196 ceph-mon[32572]: pgmap v19330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:06 smithi110 ceph-mon[28069]: pgmap v19330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:06 smithi193 ceph-mon[32782]: pgmap v19330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36002.572276 secs 2024-04-26T21:48:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36002.572276 secs 2024-04-26T21:48:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36002.572276 secs 2024-04-26T21:48:09.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:08 smithi196 ceph-mon[32572]: pgmap v19331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:08 smithi110 ceph-mon[28069]: pgmap v19331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:08 smithi193 ceph-mon[32782]: pgmap v19331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:11.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:10 smithi196 ceph-mon[32572]: pgmap v19332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:10 smithi110 ceph-mon[28069]: pgmap v19332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:10 smithi193 ceph-mon[32782]: pgmap v19332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:12 smithi196 ceph-mon[32572]: pgmap v19333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36007.572393 secs 2024-04-26T21:48:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:12 smithi110 ceph-mon[28069]: pgmap v19333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36007.572393 secs 2024-04-26T21:48:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:12 smithi193 ceph-mon[32782]: pgmap v19333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36007.572393 secs 2024-04-26T21:48:15.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:14 smithi196 ceph-mon[32572]: pgmap v19334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:14 smithi110 ceph-mon[28069]: pgmap v19334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:14 smithi193 ceph-mon[32782]: pgmap v19334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.475+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T21:48:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.475+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:48:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.475+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:48:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.475+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T21:48:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.476+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:48:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.477+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T21:48:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.477+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T21:48:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.501+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T21:48:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.501+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T21:48:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.501+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:48:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.501+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f261402d040 comp rx=0 tx=0).stop 2024-04-26T21:48:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.502+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T21:48:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.502+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T21:48:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.502+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:48:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.502+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:48:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.502+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:48:16.504 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:16.504+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:48:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:16 smithi196 ceph-mon[32572]: pgmap v19335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:16 smithi110 ceph-mon[28069]: pgmap v19335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:16 smithi193 ceph-mon[32782]: pgmap v19335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36012.572510 secs 2024-04-26T21:48:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36012.572510 secs 2024-04-26T21:48:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36012.572510 secs 2024-04-26T21:48:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:18 smithi196 ceph-mon[32572]: pgmap v19336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:18 smithi110 ceph-mon[28069]: pgmap v19336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:18 smithi193 ceph-mon[32782]: pgmap v19336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:20 smithi196 ceph-mon[32572]: pgmap v19337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:21.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:20 smithi110 ceph-mon[28069]: pgmap v19337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:20 smithi193 ceph-mon[32782]: pgmap v19337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:22.344+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:48:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:22.344+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:48:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:22.345+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 277 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:48:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:48:22.345+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 277 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:48:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:23 smithi196 ceph-mon[32572]: pgmap v19338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36017.572653 secs 2024-04-26T21:48:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:23 smithi110 ceph-mon[28069]: pgmap v19338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36017.572653 secs 2024-04-26T21:48:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:23 smithi193 ceph-mon[32782]: pgmap v19338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36017.572653 secs 2024-04-26T21:48:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:25 smithi110 ceph-mon[28069]: pgmap v19339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:25 smithi193 ceph-mon[32782]: pgmap v19339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:25 smithi196 ceph-mon[32572]: pgmap v19339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:27 smithi110 ceph-mon[28069]: pgmap v19340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:27 smithi193 ceph-mon[32782]: pgmap v19340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:27 smithi196 ceph-mon[32572]: pgmap v19340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36022.572777 secs 2024-04-26T21:48:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36022.572777 secs 2024-04-26T21:48:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36022.572777 secs 2024-04-26T21:48:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:29 smithi110 ceph-mon[28069]: pgmap v19341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:29 smithi193 ceph-mon[32782]: pgmap v19341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:29 smithi196 ceph-mon[32572]: pgmap v19341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:48:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:48:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:48:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:31 smithi110 ceph-mon[28069]: pgmap v19342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:48:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:48:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:48:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:31 smithi193 ceph-mon[32782]: pgmap v19342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:48:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:48:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:48:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:31 smithi196 ceph-mon[32572]: pgmap v19342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:48:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:48:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:48:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:32 smithi110 ceph-mon[28069]: pgmap v19343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:48:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:32 smithi110 ceph-mon[28069]: pgmap v19344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:32 smithi193 ceph-mon[32782]: pgmap v19343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:48:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:32 smithi193 ceph-mon[32782]: pgmap v19344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:32 smithi196 ceph-mon[32572]: pgmap v19343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T21:48:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:32 smithi196 ceph-mon[32572]: pgmap v19344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36027.572899 secs 2024-04-26T21:48:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:33 smithi193 ceph-mon[32782]: pgmap v19345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36027.572899 secs 2024-04-26T21:48:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:33 smithi196 ceph-mon[32572]: pgmap v19345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36027.572899 secs 2024-04-26T21:48:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:33 smithi110 ceph-mon[28069]: pgmap v19345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:35 smithi196 ceph-mon[32572]: pgmap v19346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:35 smithi110 ceph-mon[28069]: pgmap v19346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:35 smithi193 ceph-mon[32782]: pgmap v19346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:37 smithi110 ceph-mon[28069]: pgmap v19347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36032.573018 secs 2024-04-26T21:48:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:37 smithi193 ceph-mon[32782]: pgmap v19347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36032.573018 secs 2024-04-26T21:48:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:37 smithi196 ceph-mon[32572]: pgmap v19347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36032.573018 secs 2024-04-26T21:48:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:39 smithi110 ceph-mon[28069]: pgmap v19348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:39 smithi193 ceph-mon[32782]: pgmap v19348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:39 smithi196 ceph-mon[32572]: pgmap v19348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:48:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:41 smithi110 ceph-mon[28069]: pgmap v19349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:48:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:41 smithi193 ceph-mon[32782]: pgmap v19349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:48:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:41 smithi196 ceph-mon[32572]: pgmap v19349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:48:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36037.573120 secs 2024-04-26T21:48:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36037.573120 secs 2024-04-26T21:48:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36037.573120 secs 2024-04-26T21:48:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:43 smithi110 ceph-mon[28069]: pgmap v19350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:43 smithi193 ceph-mon[32782]: pgmap v19350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:43 smithi196 ceph-mon[32572]: pgmap v19350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:45 smithi110 ceph-mon[28069]: pgmap v19351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:45 smithi193 ceph-mon[32782]: pgmap v19351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:45 smithi196 ceph-mon[32572]: pgmap v19351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:47 smithi110 ceph-mon[28069]: pgmap v19352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:48.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36042.573264 secs 2024-04-26T21:48:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:47 smithi193 ceph-mon[32782]: pgmap v19352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36042.573264 secs 2024-04-26T21:48:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:47 smithi196 ceph-mon[32572]: pgmap v19352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36042.573264 secs 2024-04-26T21:48:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:49 smithi193 ceph-mon[32782]: pgmap v19353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:49 smithi196 ceph-mon[32572]: pgmap v19353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:49 smithi110 ceph-mon[28069]: pgmap v19353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:51 smithi193 ceph-mon[32782]: pgmap v19354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:51 smithi196 ceph-mon[32572]: pgmap v19354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:51 smithi110 ceph-mon[28069]: pgmap v19354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36047.573383 secs 2024-04-26T21:48:53.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36047.573383 secs 2024-04-26T21:48:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36047.573383 secs 2024-04-26T21:48:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:53 smithi193 ceph-mon[32782]: pgmap v19355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:53 smithi196 ceph-mon[32572]: pgmap v19355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:53 smithi110 ceph-mon[28069]: pgmap v19355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:48:56.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:55 smithi110 ceph-mon[28069]: pgmap v19356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:55 smithi193 ceph-mon[32782]: pgmap v19356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:55 smithi196 ceph-mon[32572]: pgmap v19356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:57 smithi193 ceph-mon[32782]: pgmap v19357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36052.573501 secs 2024-04-26T21:48:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:57 smithi196 ceph-mon[32572]: pgmap v19357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36052.573501 secs 2024-04-26T21:48:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:57 smithi110 ceph-mon[28069]: pgmap v19357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:48:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36052.573501 secs 2024-04-26T21:49:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:48:59 smithi193 ceph-mon[32782]: pgmap v19358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:48:59 smithi196 ceph-mon[32572]: pgmap v19358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:48:59 smithi110 ceph-mon[28069]: pgmap v19358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:01 smithi193 ceph-mon[32782]: pgmap v19359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:01 smithi196 ceph-mon[32572]: pgmap v19359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:01 smithi110 ceph-mon[28069]: pgmap v19359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36057.573622 secs 2024-04-26T21:49:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36057.573622 secs 2024-04-26T21:49:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36057.573622 secs 2024-04-26T21:49:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:03 smithi193 ceph-mon[32782]: pgmap v19360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:03 smithi196 ceph-mon[32572]: pgmap v19360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:03 smithi110 ceph-mon[28069]: pgmap v19360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:05 smithi193 ceph-mon[32782]: pgmap v19361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:05 smithi196 ceph-mon[32572]: pgmap v19361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:05 smithi110 ceph-mon[28069]: pgmap v19361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:07 smithi193 ceph-mon[32782]: pgmap v19362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36062.573739 secs 2024-04-26T21:49:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:07 smithi196 ceph-mon[32572]: pgmap v19362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36062.573739 secs 2024-04-26T21:49:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:07 smithi110 ceph-mon[28069]: pgmap v19362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36062.573739 secs 2024-04-26T21:49:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:09 smithi193 ceph-mon[32782]: pgmap v19363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:09 smithi196 ceph-mon[32572]: pgmap v19363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:09 smithi110 ceph-mon[28069]: pgmap v19363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:11 smithi193 ceph-mon[32782]: pgmap v19364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:11 smithi196 ceph-mon[32572]: pgmap v19364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:11 smithi110 ceph-mon[28069]: pgmap v19364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:13.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36067.573803 secs 2024-04-26T21:49:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36067.573803 secs 2024-04-26T21:49:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36067.573803 secs 2024-04-26T21:49:14.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:13 smithi196 ceph-mon[32572]: pgmap v19365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:13 smithi110 ceph-mon[28069]: pgmap v19365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:13 smithi193 ceph-mon[32782]: pgmap v19365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:16.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:15 smithi196 ceph-mon[32572]: pgmap v19366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:15 smithi110 ceph-mon[28069]: pgmap v19366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:15 smithi193 ceph-mon[32782]: pgmap v19366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:17 smithi110 ceph-mon[28069]: pgmap v19367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36072.573936 secs 2024-04-26T21:49:18.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:49:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:49:17.729+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:49:18.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:49:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:49:17.729+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:49:18.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:49:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:49:17.729+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:49:18.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:49:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:49:17.729+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:49:18.042 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:49:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:49:17.729+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:49:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:17 smithi196 ceph-mon[32572]: pgmap v19367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36072.573936 secs 2024-04-26T21:49:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:17 smithi193 ceph-mon[32782]: pgmap v19367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36072.573936 secs 2024-04-26T21:49:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:19 smithi196 ceph-mon[32572]: pgmap v19368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:19 smithi110 ceph-mon[28069]: pgmap v19368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:19 smithi193 ceph-mon[32782]: pgmap v19368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:21 smithi196 ceph-mon[32572]: pgmap v19369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:21 smithi110 ceph-mon[28069]: pgmap v19369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:21 smithi193 ceph-mon[32782]: pgmap v19369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36077.574051 secs 2024-04-26T21:49:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36077.574051 secs 2024-04-26T21:49:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36077.574051 secs 2024-04-26T21:49:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:23 smithi196 ceph-mon[32572]: pgmap v19370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:49:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:23 smithi110 ceph-mon[28069]: pgmap v19370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:49:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:23 smithi193 ceph-mon[32782]: pgmap v19370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:49:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:25 smithi196 ceph-mon[32572]: pgmap v19371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:49:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:25 smithi110 ceph-mon[28069]: pgmap v19371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:49:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:25 smithi193 ceph-mon[32782]: pgmap v19371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:49:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:27 smithi196 ceph-mon[32572]: pgmap v19372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:49:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36082.574187 secs 2024-04-26T21:49:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:27 smithi110 ceph-mon[28069]: pgmap v19372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:49:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36082.574187 secs 2024-04-26T21:49:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:27 smithi193 ceph-mon[32782]: pgmap v19372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:49:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36082.574187 secs 2024-04-26T21:49:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:29 smithi196 ceph-mon[32572]: pgmap v19373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:49:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:29 smithi110 ceph-mon[28069]: pgmap v19373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:49:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:29 smithi193 ceph-mon[32782]: pgmap v19373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T21:49:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:31 smithi196 ceph-mon[32572]: pgmap v19374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:49:32.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:49:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:31 smithi110 ceph-mon[28069]: pgmap v19374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:49:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:49:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:31 smithi193 ceph-mon[32782]: pgmap v19374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T21:49:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:49:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36087.574332 secs 2024-04-26T21:49:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:49:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:49:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:32 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:49:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36087.574332 secs 2024-04-26T21:49:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:49:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:49:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:32 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:49:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36087.574332 secs 2024-04-26T21:49:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:49:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:49:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:32 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:49:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:33 smithi196 ceph-mon[32572]: pgmap v19375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 979 B/s rd, 178 B/s wr, 1 op/s 2024-04-26T21:49:34.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:33 smithi196 ceph-mon[32572]: pgmap v19376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T21:49:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:33 smithi110 ceph-mon[28069]: pgmap v19375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 979 B/s rd, 178 B/s wr, 1 op/s 2024-04-26T21:49:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:33 smithi110 ceph-mon[28069]: pgmap v19376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T21:49:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:33 smithi193 ceph-mon[32782]: pgmap v19375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 979 B/s rd, 178 B/s wr, 1 op/s 2024-04-26T21:49:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:33 smithi193 ceph-mon[32782]: pgmap v19376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T21:49:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:35 smithi196 ceph-mon[32572]: pgmap v19377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:35 smithi110 ceph-mon[28069]: pgmap v19377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:35 smithi193 ceph-mon[32782]: pgmap v19377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:37 smithi196 ceph-mon[32572]: pgmap v19378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36092.574456 secs 2024-04-26T21:49:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:37 smithi110 ceph-mon[28069]: pgmap v19378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36092.574456 secs 2024-04-26T21:49:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:37 smithi193 ceph-mon[32782]: pgmap v19378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36092.574456 secs 2024-04-26T21:49:40.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:39 smithi196 ceph-mon[32572]: pgmap v19379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:39 smithi110 ceph-mon[28069]: pgmap v19379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:39 smithi193 ceph-mon[32782]: pgmap v19379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:42.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:41 smithi196 ceph-mon[32572]: pgmap v19380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:41 smithi110 ceph-mon[28069]: pgmap v19380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:41 smithi193 ceph-mon[32782]: pgmap v19380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36097.574596 secs 2024-04-26T21:49:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36097.574596 secs 2024-04-26T21:49:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36097.574596 secs 2024-04-26T21:49:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:43 smithi196 ceph-mon[32572]: pgmap v19381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:49:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:43 smithi110 ceph-mon[28069]: pgmap v19381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:49:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:43 smithi193 ceph-mon[32782]: pgmap v19381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:49:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:45 smithi196 ceph-mon[32572]: pgmap v19382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:45 smithi110 ceph-mon[28069]: pgmap v19382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:45 smithi193 ceph-mon[32782]: pgmap v19382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:47 smithi196 ceph-mon[32572]: pgmap v19383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36102.574638 secs 2024-04-26T21:49:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:47 smithi110 ceph-mon[28069]: pgmap v19383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36102.574638 secs 2024-04-26T21:49:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:47 smithi193 ceph-mon[32782]: pgmap v19383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36102.574638 secs 2024-04-26T21:49:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:49 smithi196 ceph-mon[32572]: pgmap v19384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:49 smithi110 ceph-mon[28069]: pgmap v19384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:49 smithi193 ceph-mon[32782]: pgmap v19384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:52 smithi110 ceph-mon[28069]: pgmap v19385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:52 smithi193 ceph-mon[32782]: pgmap v19385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:52 smithi196 ceph-mon[32572]: pgmap v19385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36107.574707 secs 2024-04-26T21:49:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36107.574707 secs 2024-04-26T21:49:53.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36107.574707 secs 2024-04-26T21:49:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:54 smithi110 ceph-mon[28069]: pgmap v19386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:54 smithi193 ceph-mon[32782]: pgmap v19386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:54 smithi196 ceph-mon[32572]: pgmap v19386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:56 smithi110 ceph-mon[28069]: pgmap v19387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:56 smithi193 ceph-mon[32782]: pgmap v19387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:56 smithi196 ceph-mon[32572]: pgmap v19387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:49:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:58 smithi110 ceph-mon[28069]: pgmap v19388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:49:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36112.574818 secs 2024-04-26T21:49:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:58 smithi193 ceph-mon[32782]: pgmap v19388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:49:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36112.574818 secs 2024-04-26T21:49:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:58 smithi196 ceph-mon[32572]: pgmap v19388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:49:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:49:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36112.574818 secs 2024-04-26T21:50:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:00 smithi110 ceph-mon[28069]: pgmap v19389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:50:00.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:00 smithi193 ceph-mon[32782]: pgmap v19389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:00.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:50:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:00 smithi196 ceph-mon[32572]: pgmap v19389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T21:50:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:02 smithi193 ceph-mon[32782]: pgmap v19390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:02.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:02 smithi196 ceph-mon[32572]: pgmap v19390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:02 smithi110 ceph-mon[28069]: pgmap v19390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36117.574937 secs 2024-04-26T21:50:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36117.574937 secs 2024-04-26T21:50:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36117.574937 secs 2024-04-26T21:50:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:04 smithi193 ceph-mon[32782]: pgmap v19391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:04 smithi196 ceph-mon[32572]: pgmap v19391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:04 smithi110 ceph-mon[28069]: pgmap v19391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:05 smithi193 ceph-mon[32782]: pgmap v19392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:05 smithi196 ceph-mon[32572]: pgmap v19392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:05 smithi110 ceph-mon[28069]: pgmap v19392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:07 smithi193 ceph-mon[32782]: pgmap v19393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:07 smithi196 ceph-mon[32572]: pgmap v19393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:07 smithi110 ceph-mon[28069]: pgmap v19393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36122.575039 secs 2024-04-26T21:50:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36122.575039 secs 2024-04-26T21:50:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36122.575039 secs 2024-04-26T21:50:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:09 smithi193 ceph-mon[32782]: pgmap v19394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:09 smithi196 ceph-mon[32572]: pgmap v19394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:09 smithi110 ceph-mon[28069]: pgmap v19394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:11 smithi193 ceph-mon[32782]: pgmap v19395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:11 smithi196 ceph-mon[32572]: pgmap v19395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:11 smithi110 ceph-mon[28069]: pgmap v19395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36127.575141 secs 2024-04-26T21:50:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:13 smithi196 ceph-mon[32572]: pgmap v19396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36127.575141 secs 2024-04-26T21:50:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:13 smithi110 ceph-mon[28069]: pgmap v19396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36127.575141 secs 2024-04-26T21:50:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:13 smithi193 ceph-mon[32782]: pgmap v19396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:15 smithi196 ceph-mon[32572]: pgmap v19397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:15 smithi110 ceph-mon[28069]: pgmap v19397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:15 smithi193 ceph-mon[32782]: pgmap v19397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:17 smithi196 ceph-mon[32572]: pgmap v19398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:17 smithi110 ceph-mon[28069]: pgmap v19398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:17 smithi193 ceph-mon[32782]: pgmap v19398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36132.575263 secs 2024-04-26T21:50:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36132.575263 secs 2024-04-26T21:50:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36132.575263 secs 2024-04-26T21:50:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:19 smithi196 ceph-mon[32572]: pgmap v19399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:19 smithi110 ceph-mon[28069]: pgmap v19399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:19 smithi193 ceph-mon[32782]: pgmap v19399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:21 smithi196 ceph-mon[32572]: pgmap v19400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:21 smithi110 ceph-mon[28069]: pgmap v19400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:21 smithi193 ceph-mon[32782]: pgmap v19400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36137.575380 secs 2024-04-26T21:50:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:23 smithi196 ceph-mon[32572]: pgmap v19401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36137.575380 secs 2024-04-26T21:50:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:23 smithi110 ceph-mon[28069]: pgmap v19401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36137.575380 secs 2024-04-26T21:50:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:23 smithi193 ceph-mon[32782]: pgmap v19401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:25 smithi196 ceph-mon[32572]: pgmap v19402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:25 smithi110 ceph-mon[28069]: pgmap v19402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:25 smithi193 ceph-mon[32782]: pgmap v19402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:27 smithi196 ceph-mon[32572]: pgmap v19403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:27 smithi110 ceph-mon[28069]: pgmap v19403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:27 smithi193 ceph-mon[32782]: pgmap v19403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36142.575509 secs 2024-04-26T21:50:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36142.575509 secs 2024-04-26T21:50:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36142.575509 secs 2024-04-26T21:50:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:29 smithi196 ceph-mon[32572]: pgmap v19404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:29 smithi110 ceph-mon[28069]: pgmap v19404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:29 smithi193 ceph-mon[32782]: pgmap v19404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:31 smithi196 ceph-mon[32572]: pgmap v19405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:31 smithi110 ceph-mon[28069]: pgmap v19405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:31 smithi193 ceph-mon[32782]: pgmap v19405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36147.575583 secs 2024-04-26T21:50:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:33 smithi196 ceph-mon[32572]: pgmap v19406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:33.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:50:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36147.575583 secs 2024-04-26T21:50:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:33 smithi110 ceph-mon[28069]: pgmap v19406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:50:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36147.575583 secs 2024-04-26T21:50:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:33 smithi193 ceph-mon[32782]: pgmap v19406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:50:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:50:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:50:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:34 smithi196 ceph-mon[32572]: pgmap v19407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:50:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:34 smithi196 ceph-mon[32572]: pgmap v19408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:50:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:50:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:50:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:34 smithi110 ceph-mon[28069]: pgmap v19407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:50:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:34 smithi110 ceph-mon[28069]: pgmap v19408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:50:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:50:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:50:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:34 smithi193 ceph-mon[32782]: pgmap v19407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:50:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:34 smithi193 ceph-mon[32782]: pgmap v19408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:50:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:36 smithi196 ceph-mon[32572]: pgmap v19409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:36 smithi110 ceph-mon[28069]: pgmap v19409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:50:37.367+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:50:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:50:37.367+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:50:37.367 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:50:37.367+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 278 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:50:37.368 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:50:37.367+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 278 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:50:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:36 smithi193 ceph-mon[32782]: pgmap v19409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36152.575702 secs 2024-04-26T21:50:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36152.575702 secs 2024-04-26T21:50:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36152.575702 secs 2024-04-26T21:50:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:38 smithi196 ceph-mon[32572]: pgmap v19410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:38 smithi110 ceph-mon[28069]: pgmap v19410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:38 smithi193 ceph-mon[32782]: pgmap v19410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:41.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:40 smithi196 ceph-mon[32572]: pgmap v19411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:40 smithi110 ceph-mon[28069]: pgmap v19411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:40 smithi193 ceph-mon[32782]: pgmap v19411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:42 smithi196 ceph-mon[32572]: pgmap v19412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36157.575770 secs 2024-04-26T21:50:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:42 smithi110 ceph-mon[28069]: pgmap v19412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36157.575770 secs 2024-04-26T21:50:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:42 smithi193 ceph-mon[32782]: pgmap v19412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:50:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36157.575770 secs 2024-04-26T21:50:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:44 smithi196 ceph-mon[32572]: pgmap v19413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:50:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:44 smithi110 ceph-mon[28069]: pgmap v19413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:50:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:44 smithi193 ceph-mon[32782]: pgmap v19413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:50:47.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:46 smithi196 ceph-mon[32572]: pgmap v19414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:46 smithi110 ceph-mon[28069]: pgmap v19414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:47.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:46 smithi193 ceph-mon[32782]: pgmap v19414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36162.575887 secs 2024-04-26T21:50:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36162.575887 secs 2024-04-26T21:50:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36162.575887 secs 2024-04-26T21:50:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:48 smithi196 ceph-mon[32572]: pgmap v19415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:48 smithi110 ceph-mon[28069]: pgmap v19415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:48 smithi193 ceph-mon[32782]: pgmap v19415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:50 smithi196 ceph-mon[32572]: pgmap v19416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:50 smithi110 ceph-mon[28069]: pgmap v19416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:50 smithi193 ceph-mon[32782]: pgmap v19416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:52 smithi196 ceph-mon[32572]: pgmap v19417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36167.575953 secs 2024-04-26T21:50:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:52 smithi110 ceph-mon[28069]: pgmap v19417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36167.575953 secs 2024-04-26T21:50:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:52 smithi193 ceph-mon[32782]: pgmap v19417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36167.575953 secs 2024-04-26T21:50:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:54 smithi196 ceph-mon[32572]: pgmap v19418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:54 smithi110 ceph-mon[28069]: pgmap v19418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:54 smithi193 ceph-mon[32782]: pgmap v19418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:56 smithi196 ceph-mon[32572]: pgmap v19419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:56 smithi110 ceph-mon[28069]: pgmap v19419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:56 smithi193 ceph-mon[32782]: pgmap v19419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:50:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36172.576066 secs 2024-04-26T21:50:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36172.576066 secs 2024-04-26T21:50:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36172.576066 secs 2024-04-26T21:50:59.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:50:58 smithi196 ceph-mon[32572]: pgmap v19420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:50:58 smithi110 ceph-mon[28069]: pgmap v19420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:50:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:50:58 smithi193 ceph-mon[32782]: pgmap v19420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:00 smithi196 ceph-mon[32572]: pgmap v19421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:00 smithi110 ceph-mon[28069]: pgmap v19421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:00 smithi193 ceph-mon[32782]: pgmap v19421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:02 smithi196 ceph-mon[32572]: pgmap v19422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36177.576217 secs 2024-04-26T21:51:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:02 smithi110 ceph-mon[28069]: pgmap v19422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36177.576217 secs 2024-04-26T21:51:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:02 smithi193 ceph-mon[32782]: pgmap v19422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36177.576217 secs 2024-04-26T21:51:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:04 smithi196 ceph-mon[32572]: pgmap v19423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:04 smithi110 ceph-mon[28069]: pgmap v19423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:04 smithi193 ceph-mon[32782]: pgmap v19423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:06 smithi196 ceph-mon[32572]: pgmap v19424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:06 smithi110 ceph-mon[28069]: pgmap v19424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:06 smithi193 ceph-mon[32782]: pgmap v19424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36182.576369 secs 2024-04-26T21:51:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36182.576369 secs 2024-04-26T21:51:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36182.576369 secs 2024-04-26T21:51:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:09 smithi110 ceph-mon[28069]: pgmap v19425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:09 smithi193 ceph-mon[32782]: pgmap v19425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:09 smithi196 ceph-mon[32572]: pgmap v19425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:11.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:11 smithi110 ceph-mon[28069]: pgmap v19426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:11 smithi193 ceph-mon[32782]: pgmap v19426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:11 smithi196 ceph-mon[32572]: pgmap v19426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:13 smithi110 ceph-mon[28069]: pgmap v19427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36187.576482 secs 2024-04-26T21:51:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:13 smithi193 ceph-mon[32782]: pgmap v19427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36187.576482 secs 2024-04-26T21:51:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:13 smithi196 ceph-mon[32572]: pgmap v19427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36187.576482 secs 2024-04-26T21:51:15.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:15 smithi110 ceph-mon[28069]: pgmap v19428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:15 smithi193 ceph-mon[32782]: pgmap v19428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:15 smithi196 ceph-mon[32572]: pgmap v19428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:17 smithi110 ceph-mon[28069]: pgmap v19429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:17 smithi193 ceph-mon[32782]: pgmap v19429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:17 smithi196 ceph-mon[32572]: pgmap v19429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36192.576601 secs 2024-04-26T21:51:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36192.576601 secs 2024-04-26T21:51:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36192.576601 secs 2024-04-26T21:51:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:19 smithi193 ceph-mon[32782]: pgmap v19430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:19.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:19 smithi196 ceph-mon[32572]: pgmap v19430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:19 smithi110 ceph-mon[28069]: pgmap v19430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:21 smithi193 ceph-mon[32782]: pgmap v19431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:21 smithi196 ceph-mon[32572]: pgmap v19431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:21 smithi110 ceph-mon[28069]: pgmap v19431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:51:22.374+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:51:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:51:22.374+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:51:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:51:22.375+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 279 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:51:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:51:22.376+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 279 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:51:23.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:23 smithi196 ceph-mon[32572]: pgmap v19432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:23.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36197.576714 secs 2024-04-26T21:51:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:23 smithi193 ceph-mon[32782]: pgmap v19432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36197.576714 secs 2024-04-26T21:51:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:23 smithi110 ceph-mon[28069]: pgmap v19432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36197.576714 secs 2024-04-26T21:51:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:25 smithi193 ceph-mon[32782]: pgmap v19433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:25 smithi196 ceph-mon[32572]: pgmap v19433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:25 smithi110 ceph-mon[28069]: pgmap v19433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:27.344 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:27 smithi110 ceph-mon[28069]: pgmap v19434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:27 smithi193 ceph-mon[32782]: pgmap v19434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:27 smithi196 ceph-mon[32572]: pgmap v19434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36202.576778 secs 2024-04-26T21:51:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36202.576778 secs 2024-04-26T21:51:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36202.576778 secs 2024-04-26T21:51:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:29 smithi193 ceph-mon[32782]: pgmap v19435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:29 smithi196 ceph-mon[32572]: pgmap v19435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:29 smithi110 ceph-mon[28069]: pgmap v19435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:30 smithi193 ceph-mon[32782]: pgmap v19436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:30 smithi196 ceph-mon[32572]: pgmap v19436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:30 smithi110 ceph-mon[28069]: pgmap v19436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:32 smithi196 ceph-mon[32572]: pgmap v19437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36207.576906 secs 2024-04-26T21:51:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:32 smithi110 ceph-mon[28069]: pgmap v19437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36207.576906 secs 2024-04-26T21:51:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:32 smithi193 ceph-mon[32782]: pgmap v19437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36207.576906 secs 2024-04-26T21:51:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:34 smithi196 ceph-mon[32572]: pgmap v19438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:35.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:51:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:34 smithi110 ceph-mon[28069]: pgmap v19438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:51:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:34 smithi193 ceph-mon[32782]: pgmap v19438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:51:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:51:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:51:36.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:51:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:51:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:51:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:51:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:51:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:51:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:51:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:36 smithi196 ceph-mon[32572]: pgmap v19439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:51:37.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:36 smithi196 ceph-mon[32572]: pgmap v19440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:36 smithi110 ceph-mon[28069]: pgmap v19439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:51:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:36 smithi110 ceph-mon[28069]: pgmap v19440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:36 smithi193 ceph-mon[32782]: pgmap v19439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:51:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:36 smithi193 ceph-mon[32782]: pgmap v19440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36212.577027 secs 2024-04-26T21:51:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:38 smithi196 ceph-mon[32572]: pgmap v19441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:51:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36212.577027 secs 2024-04-26T21:51:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:38 smithi110 ceph-mon[28069]: pgmap v19441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:51:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36212.577027 secs 2024-04-26T21:51:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:38 smithi193 ceph-mon[32782]: pgmap v19441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T21:51:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:40 smithi196 ceph-mon[32572]: pgmap v19442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:40 smithi110 ceph-mon[28069]: pgmap v19442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:40 smithi193 ceph-mon[32782]: pgmap v19442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:42 smithi196 ceph-mon[32572]: pgmap v19443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:42 smithi110 ceph-mon[28069]: pgmap v19443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:42 smithi193 ceph-mon[32782]: pgmap v19443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:43.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36217.577144 secs 2024-04-26T21:51:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36217.577144 secs 2024-04-26T21:51:43.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36217.577144 secs 2024-04-26T21:51:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:44 smithi196 ceph-mon[32572]: pgmap v19444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:44 smithi110 ceph-mon[28069]: pgmap v19444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:44 smithi193 ceph-mon[32782]: pgmap v19444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:51:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:46 smithi196 ceph-mon[32572]: pgmap v19445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:51:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:46 smithi110 ceph-mon[28069]: pgmap v19445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:51:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:46 smithi193 ceph-mon[32782]: pgmap v19445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:51:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36222.577299 secs 2024-04-26T21:51:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:48 smithi196 ceph-mon[32572]: pgmap v19446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36222.577299 secs 2024-04-26T21:51:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:48 smithi110 ceph-mon[28069]: pgmap v19446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36222.577299 secs 2024-04-26T21:51:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:48 smithi193 ceph-mon[32782]: pgmap v19446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:50 smithi196 ceph-mon[32572]: pgmap v19447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:51:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:50 smithi110 ceph-mon[28069]: pgmap v19447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:51:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:50 smithi193 ceph-mon[32782]: pgmap v19447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:51:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:52 smithi196 ceph-mon[32572]: pgmap v19448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:52 smithi110 ceph-mon[28069]: pgmap v19448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:52 smithi193 ceph-mon[32782]: pgmap v19448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36227.577393 secs 2024-04-26T21:51:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36227.577393 secs 2024-04-26T21:51:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36227.577393 secs 2024-04-26T21:51:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:54 smithi110 ceph-mon[28069]: pgmap v19449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:54 smithi193 ceph-mon[32782]: pgmap v19449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:54 smithi196 ceph-mon[32572]: pgmap v19449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:56 smithi110 ceph-mon[28069]: pgmap v19450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:56 smithi193 ceph-mon[32782]: pgmap v19450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:57.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:56 smithi196 ceph-mon[32572]: pgmap v19450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:51:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36232.577529 secs 2024-04-26T21:51:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:51:58 smithi110 ceph-mon[28069]: pgmap v19451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36232.577529 secs 2024-04-26T21:51:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:51:58 smithi193 ceph-mon[32782]: pgmap v19451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:51:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36232.577529 secs 2024-04-26T21:51:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:51:58 smithi196 ceph-mon[32572]: pgmap v19451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:00 smithi110 ceph-mon[28069]: pgmap v19452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:00 smithi193 ceph-mon[32782]: pgmap v19452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:00 smithi196 ceph-mon[32572]: pgmap v19452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:02 smithi110 ceph-mon[28069]: pgmap v19453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:02 smithi193 ceph-mon[32782]: pgmap v19453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:02 smithi196 ceph-mon[32572]: pgmap v19453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36237.577656 secs 2024-04-26T21:52:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36237.577656 secs 2024-04-26T21:52:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36237.577656 secs 2024-04-26T21:52:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:04 smithi193 ceph-mon[32782]: pgmap v19454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:04 smithi196 ceph-mon[32572]: pgmap v19454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:04 smithi110 ceph-mon[28069]: pgmap v19454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:06 smithi193 ceph-mon[32782]: pgmap v19455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:06 smithi196 ceph-mon[32572]: pgmap v19455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:06 smithi110 ceph-mon[28069]: pgmap v19455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36242.577721 secs 2024-04-26T21:52:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:08 smithi193 ceph-mon[32782]: pgmap v19456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36242.577721 secs 2024-04-26T21:52:09.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:08 smithi196 ceph-mon[32572]: pgmap v19456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36242.577721 secs 2024-04-26T21:52:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:08 smithi110 ceph-mon[28069]: pgmap v19456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:10 smithi193 ceph-mon[32782]: pgmap v19457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:10 smithi196 ceph-mon[32572]: pgmap v19457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:10 smithi110 ceph-mon[28069]: pgmap v19457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:12 smithi193 ceph-mon[32782]: pgmap v19458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:12 smithi196 ceph-mon[32572]: pgmap v19458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:12 smithi110 ceph-mon[28069]: pgmap v19458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:13.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36247.577847 secs 2024-04-26T21:52:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36247.577847 secs 2024-04-26T21:52:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36247.577847 secs 2024-04-26T21:52:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:14 smithi193 ceph-mon[32782]: pgmap v19459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:14 smithi196 ceph-mon[32572]: pgmap v19459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:14 smithi110 ceph-mon[28069]: pgmap v19459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:16 smithi193 ceph-mon[32782]: pgmap v19460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:16 smithi196 ceph-mon[32572]: pgmap v19460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:16 smithi110 ceph-mon[28069]: pgmap v19460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:18 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 36252.577925 secs 2024-04-26T21:52:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:18 smithi193 ceph-mon[32782]: slow request 2880.385960 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:52:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:18 smithi193 ceph-mon[32782]: pgmap v19461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:18 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 36252.577925 secs 2024-04-26T21:52:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:18 smithi196 ceph-mon[32572]: slow request 2880.385960 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:52:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:18 smithi196 ceph-mon[32572]: pgmap v19461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:18 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 36252.577925 secs 2024-04-26T21:52:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:18 smithi110 ceph-mon[28069]: slow request 2880.385960 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:52:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:18 smithi110 ceph-mon[28069]: pgmap v19461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:20 smithi193 ceph-mon[32782]: pgmap v19462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:20 smithi196 ceph-mon[32572]: pgmap v19462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:20 smithi110 ceph-mon[28069]: pgmap v19462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:22 smithi193 ceph-mon[32782]: pgmap v19463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:22 smithi196 ceph-mon[32572]: pgmap v19463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:22 smithi110 ceph-mon[28069]: pgmap v19463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36257.578040 secs 2024-04-26T21:52:23.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36257.578040 secs 2024-04-26T21:52:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36257.578040 secs 2024-04-26T21:52:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:24 smithi193 ceph-mon[32782]: pgmap v19464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:24 smithi196 ceph-mon[32572]: pgmap v19464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:24 smithi110 ceph-mon[28069]: pgmap v19464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:26 smithi193 ceph-mon[32782]: pgmap v19465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:26 smithi196 ceph-mon[32572]: pgmap v19465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:26 smithi110 ceph-mon[28069]: pgmap v19465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36262.578185 secs 2024-04-26T21:52:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:28 smithi193 ceph-mon[32782]: pgmap v19466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36262.578185 secs 2024-04-26T21:52:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:28 smithi196 ceph-mon[32572]: pgmap v19466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36262.578185 secs 2024-04-26T21:52:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:28 smithi110 ceph-mon[28069]: pgmap v19466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:30 smithi196 ceph-mon[32572]: pgmap v19467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:30 smithi110 ceph-mon[28069]: pgmap v19467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:30 smithi193 ceph-mon[32782]: pgmap v19467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:52:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:32 smithi196 ceph-mon[32572]: pgmap v19468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:32 smithi110 ceph-mon[28069]: pgmap v19468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:32 smithi193 ceph-mon[32782]: pgmap v19468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36267.578318 secs 2024-04-26T21:52:34.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36267.578318 secs 2024-04-26T21:52:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36267.578318 secs 2024-04-26T21:52:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:34 smithi196 ceph-mon[32572]: pgmap v19469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:34 smithi110 ceph-mon[28069]: pgmap v19469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:34 smithi193 ceph-mon[32782]: pgmap v19469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:36 smithi196 ceph-mon[32572]: pgmap v19470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:52:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:52:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:36 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:52:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:36 smithi110 ceph-mon[28069]: pgmap v19470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:52:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:52:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:36 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:52:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:36 smithi193 ceph-mon[32782]: pgmap v19470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:52:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:52:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:36 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:52:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36272.578476 secs 2024-04-26T21:52:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36272.578476 secs 2024-04-26T21:52:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36272.578476 secs 2024-04-26T21:52:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:38 smithi196 ceph-mon[32572]: pgmap v19471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:52:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:52:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:38 smithi196 ceph-mon[32572]: pgmap v19472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T21:52:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:38 smithi196 ceph-mon[32572]: pgmap v19473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:39.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:52:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:38 smithi110 ceph-mon[28069]: pgmap v19471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:52:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:52:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:38 smithi110 ceph-mon[28069]: pgmap v19472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T21:52:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:38 smithi110 ceph-mon[28069]: pgmap v19473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:52:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:38 smithi193 ceph-mon[32782]: pgmap v19471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:52:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:52:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:38 smithi193 ceph-mon[32782]: pgmap v19472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 981 B/s rd, 1 op/s 2024-04-26T21:52:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:38 smithi193 ceph-mon[32782]: pgmap v19473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:39.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:52:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:40 smithi196 ceph-mon[32572]: pgmap v19474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:40 smithi110 ceph-mon[28069]: pgmap v19474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:40 smithi193 ceph-mon[32782]: pgmap v19474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36277.578637 secs 2024-04-26T21:52:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:42 smithi196 ceph-mon[32572]: pgmap v19475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:52:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36277.578637 secs 2024-04-26T21:52:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:42 smithi110 ceph-mon[28069]: pgmap v19475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:52:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36277.578637 secs 2024-04-26T21:52:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:42 smithi193 ceph-mon[32782]: pgmap v19475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:52:45.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:44 smithi196 ceph-mon[32572]: pgmap v19476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:44 smithi110 ceph-mon[28069]: pgmap v19476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:44 smithi193 ceph-mon[32782]: pgmap v19476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:46 smithi196 ceph-mon[32572]: pgmap v19477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:52:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:46 smithi110 ceph-mon[28069]: pgmap v19477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:52:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:46 smithi193 ceph-mon[32782]: pgmap v19477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 606 B/s rd, 1 op/s 2024-04-26T21:52:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36282.578755 secs 2024-04-26T21:52:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36282.578755 secs 2024-04-26T21:52:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36282.578755 secs 2024-04-26T21:52:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:48 smithi196 ceph-mon[32572]: pgmap v19478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:52:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:48 smithi110 ceph-mon[28069]: pgmap v19478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:52:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:48 smithi193 ceph-mon[32782]: pgmap v19478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:52:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:50 smithi196 ceph-mon[32572]: pgmap v19479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:50 smithi110 ceph-mon[28069]: pgmap v19479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:50 smithi193 ceph-mon[32782]: pgmap v19479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36287.578875 secs 2024-04-26T21:52:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:53 smithi196 ceph-mon[32572]: pgmap v19480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36287.578875 secs 2024-04-26T21:52:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:53 smithi110 ceph-mon[28069]: pgmap v19480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36287.578875 secs 2024-04-26T21:52:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:53 smithi193 ceph-mon[32782]: pgmap v19480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:55 smithi110 ceph-mon[28069]: pgmap v19481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:55 smithi193 ceph-mon[32782]: pgmap v19481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:55 smithi196 ceph-mon[32572]: pgmap v19481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:57 smithi110 ceph-mon[28069]: pgmap v19482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:57 smithi193 ceph-mon[32782]: pgmap v19482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:57 smithi196 ceph-mon[32572]: pgmap v19482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:52:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36292.579002 secs 2024-04-26T21:52:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36292.579002 secs 2024-04-26T21:52:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36292.579002 secs 2024-04-26T21:52:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:52:59 smithi110 ceph-mon[28069]: pgmap v19483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:52:59 smithi193 ceph-mon[32782]: pgmap v19483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:52:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:52:59 smithi196 ceph-mon[32572]: pgmap v19483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:01 smithi110 ceph-mon[28069]: pgmap v19484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:01 smithi193 ceph-mon[32782]: pgmap v19484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:01 smithi196 ceph-mon[32572]: pgmap v19484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36297.579157 secs 2024-04-26T21:53:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:03 smithi110 ceph-mon[28069]: pgmap v19485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36297.579157 secs 2024-04-26T21:53:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:03 smithi193 ceph-mon[32782]: pgmap v19485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36297.579157 secs 2024-04-26T21:53:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:03 smithi196 ceph-mon[32572]: pgmap v19485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:05 smithi193 ceph-mon[32782]: pgmap v19486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:05 smithi196 ceph-mon[32572]: pgmap v19486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:05 smithi110 ceph-mon[28069]: pgmap v19486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:07 smithi193 ceph-mon[32782]: pgmap v19487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:07 smithi196 ceph-mon[32572]: pgmap v19487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:07 smithi110 ceph-mon[28069]: pgmap v19487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:08 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 36302.579280 secs 2024-04-26T21:53:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:08 smithi193 ceph-mon[32782]: slow request 23040.204164 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:53:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:08 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 36302.579280 secs 2024-04-26T21:53:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:08 smithi196 ceph-mon[32572]: slow request 23040.204164 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:53:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:08 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 36302.579280 secs 2024-04-26T21:53:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:08 smithi110 ceph-mon[28069]: slow request 23040.204164 seconds old, received at 2024-04-26T15:29:06.673438+0000: client_request(client.26884:1 getattr pAsLsXsFs #0x1 2024-04-26T15:29:06.668441+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:53:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:09 smithi193 ceph-mon[32782]: pgmap v19488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:09 smithi196 ceph-mon[32572]: pgmap v19488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:09 smithi110 ceph-mon[28069]: pgmap v19488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:11.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:11 smithi193 ceph-mon[32782]: pgmap v19489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:11 smithi196 ceph-mon[32572]: pgmap v19489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:11 smithi110 ceph-mon[28069]: pgmap v19489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36307.579408 secs 2024-04-26T21:53:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:13 smithi193 ceph-mon[32782]: pgmap v19490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36307.579408 secs 2024-04-26T21:53:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:13 smithi196 ceph-mon[32572]: pgmap v19490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36307.579408 secs 2024-04-26T21:53:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:13 smithi110 ceph-mon[28069]: pgmap v19490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:15 smithi193 ceph-mon[32782]: pgmap v19491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:15 smithi196 ceph-mon[32572]: pgmap v19491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:15 smithi110 ceph-mon[28069]: pgmap v19491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:17 smithi193 ceph-mon[32782]: pgmap v19492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:17 smithi196 ceph-mon[32572]: pgmap v19492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:17 smithi110 ceph-mon[28069]: pgmap v19492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36312.579606 secs 2024-04-26T21:53:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36312.579606 secs 2024-04-26T21:53:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36312.579606 secs 2024-04-26T21:53:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:19 smithi193 ceph-mon[32782]: pgmap v19493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:19 smithi196 ceph-mon[32572]: pgmap v19493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:19 smithi110 ceph-mon[28069]: pgmap v19493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:20 smithi193 ceph-mon[32782]: pgmap v19494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:20 smithi196 ceph-mon[32572]: pgmap v19494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:20 smithi110 ceph-mon[28069]: pgmap v19494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36317.579689 secs 2024-04-26T21:53:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:22 smithi196 ceph-mon[32572]: pgmap v19495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36317.579689 secs 2024-04-26T21:53:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:22 smithi110 ceph-mon[28069]: pgmap v19495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36317.579689 secs 2024-04-26T21:53:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:22 smithi193 ceph-mon[32782]: pgmap v19495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:24 smithi196 ceph-mon[32572]: pgmap v19496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:24 smithi110 ceph-mon[28069]: pgmap v19496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:24 smithi193 ceph-mon[32782]: pgmap v19496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:26 smithi196 ceph-mon[32572]: pgmap v19497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:26 smithi110 ceph-mon[28069]: pgmap v19497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:26 smithi193 ceph-mon[32782]: pgmap v19497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36322.579769 secs 2024-04-26T21:53:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36322.579769 secs 2024-04-26T21:53:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36322.579769 secs 2024-04-26T21:53:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:29 smithi110 ceph-mon[28069]: pgmap v19498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:29 smithi193 ceph-mon[32782]: pgmap v19498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:29 smithi196 ceph-mon[32572]: pgmap v19498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:31 smithi110 ceph-mon[28069]: pgmap v19499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:31 smithi193 ceph-mon[32782]: pgmap v19499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:31 smithi196 ceph-mon[32572]: pgmap v19499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36327.579889 secs 2024-04-26T21:53:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:33 smithi110 ceph-mon[28069]: pgmap v19500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36327.579889 secs 2024-04-26T21:53:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:33 smithi193 ceph-mon[32782]: pgmap v19500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36327.579889 secs 2024-04-26T21:53:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:33 smithi196 ceph-mon[32572]: pgmap v19500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:35 smithi110 ceph-mon[28069]: pgmap v19501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:35 smithi193 ceph-mon[32782]: pgmap v19501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:35 smithi196 ceph-mon[32572]: pgmap v19501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:37 smithi193 ceph-mon[32782]: pgmap v19502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:37 smithi196 ceph-mon[32572]: pgmap v19502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:37 smithi110 ceph-mon[28069]: pgmap v19502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:53:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36332.580012 secs 2024-04-26T21:53:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36332.580012 secs 2024-04-26T21:53:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36332.580012 secs 2024-04-26T21:53:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:39 smithi193 ceph-mon[32782]: pgmap v19503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:53:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.501 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:39 smithi110 ceph-mon[28069]: pgmap v19503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:39.501 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:53:39.501 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.501 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.501 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.501 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:39 smithi196 ceph-mon[32572]: pgmap v19503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:53:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:53:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:53:40.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:53:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:53:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:53:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:53:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:53:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:41 smithi193 ceph-mon[32782]: pgmap v19504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:53:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:41 smithi193 ceph-mon[32782]: pgmap v19505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:41 smithi196 ceph-mon[32572]: pgmap v19504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:53:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:41 smithi196 ceph-mon[32572]: pgmap v19505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:41 smithi110 ceph-mon[28069]: pgmap v19504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:53:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:41 smithi110 ceph-mon[28069]: pgmap v19505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:43 smithi193 ceph-mon[32782]: pgmap v19506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:43.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36337.580152 secs 2024-04-26T21:53:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:43 smithi196 ceph-mon[32572]: pgmap v19506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36337.580152 secs 2024-04-26T21:53:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:43 smithi110 ceph-mon[28069]: pgmap v19506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36337.580152 secs 2024-04-26T21:53:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:45 smithi193 ceph-mon[32782]: pgmap v19507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:45 smithi196 ceph-mon[32572]: pgmap v19507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:45 smithi110 ceph-mon[28069]: pgmap v19507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:47 smithi193 ceph-mon[32782]: pgmap v19508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:47 smithi196 ceph-mon[32572]: pgmap v19508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:47 smithi110 ceph-mon[28069]: pgmap v19508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:53:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36342.580252 secs 2024-04-26T21:53:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36342.580252 secs 2024-04-26T21:53:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36342.580252 secs 2024-04-26T21:53:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:49 smithi193 ceph-mon[32782]: pgmap v19509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T21:53:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:49 smithi196 ceph-mon[32572]: pgmap v19509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T21:53:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:49 smithi110 ceph-mon[28069]: pgmap v19509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T21:53:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:50 smithi196 ceph-mon[32572]: pgmap v19510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T21:53:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:50 smithi110 ceph-mon[28069]: pgmap v19510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T21:53:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:50 smithi193 ceph-mon[32782]: pgmap v19510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T21:53:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:52 smithi193 ceph-mon[32782]: pgmap v19511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:53:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:52 smithi196 ceph-mon[32572]: pgmap v19511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:53:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:52 smithi110 ceph-mon[28069]: pgmap v19511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:53:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36347.580397 secs 2024-04-26T21:53:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36347.580397 secs 2024-04-26T21:53:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36347.580397 secs 2024-04-26T21:53:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:54 smithi193 ceph-mon[32782]: pgmap v19512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:54 smithi196 ceph-mon[32572]: pgmap v19512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:54 smithi110 ceph-mon[28069]: pgmap v19512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:56 smithi193 ceph-mon[32782]: pgmap v19513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:53:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:56 smithi196 ceph-mon[32572]: pgmap v19513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:53:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:56 smithi110 ceph-mon[28069]: pgmap v19513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T21:53:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36352.580524 secs 2024-04-26T21:53:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:53:58 smithi193 ceph-mon[32782]: pgmap v19514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36352.580524 secs 2024-04-26T21:53:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:53:58 smithi196 ceph-mon[32572]: pgmap v19514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:53:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36352.580524 secs 2024-04-26T21:53:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:53:58 smithi110 ceph-mon[28069]: pgmap v19514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:00 smithi193 ceph-mon[32782]: pgmap v19515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:00 smithi196 ceph-mon[32572]: pgmap v19515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:00 smithi110 ceph-mon[28069]: pgmap v19515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:02 smithi193 ceph-mon[32782]: pgmap v19516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:02 smithi196 ceph-mon[32572]: pgmap v19516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:02 smithi110 ceph-mon[28069]: pgmap v19516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36357.580653 secs 2024-04-26T21:54:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36357.580653 secs 2024-04-26T21:54:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36357.580653 secs 2024-04-26T21:54:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:04 smithi196 ceph-mon[32572]: pgmap v19517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:05.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:04 smithi193 ceph-mon[32782]: pgmap v19517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:04 smithi110 ceph-mon[28069]: pgmap v19517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:06 smithi196 ceph-mon[32572]: pgmap v19518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:06 smithi110 ceph-mon[28069]: pgmap v19518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:06 smithi193 ceph-mon[32782]: pgmap v19518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36362.580783 secs 2024-04-26T21:54:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:08 smithi196 ceph-mon[32572]: pgmap v19519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36362.580783 secs 2024-04-26T21:54:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:08 smithi110 ceph-mon[28069]: pgmap v19519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36362.580783 secs 2024-04-26T21:54:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:08 smithi193 ceph-mon[32782]: pgmap v19519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:10 smithi196 ceph-mon[32572]: pgmap v19520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:10 smithi110 ceph-mon[28069]: pgmap v19520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:10 smithi193 ceph-mon[32782]: pgmap v19520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:12 smithi196 ceph-mon[32572]: pgmap v19521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36367.580891 secs 2024-04-26T21:54:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:12 smithi110 ceph-mon[28069]: pgmap v19521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36367.580891 secs 2024-04-26T21:54:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:12 smithi193 ceph-mon[32782]: pgmap v19521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36367.580891 secs 2024-04-26T21:54:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:14 smithi196 ceph-mon[32572]: pgmap v19522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:14 smithi110 ceph-mon[28069]: pgmap v19522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:14 smithi193 ceph-mon[32782]: pgmap v19522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:16 smithi196 ceph-mon[32572]: pgmap v19523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:16 smithi110 ceph-mon[28069]: pgmap v19523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:16 smithi193 ceph-mon[32782]: pgmap v19523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:17.965 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36372.581022 secs 2024-04-26T21:54:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36372.581022 secs 2024-04-26T21:54:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36372.581022 secs 2024-04-26T21:54:18.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:54:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:54:17.964+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:54:18.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:54:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:54:17.964+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:54:18.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:54:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:54:17.964+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:54:18.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:54:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:54:17.964+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:54:18.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:54:17 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:54:17.964+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:54:19.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:18 smithi196 ceph-mon[32572]: pgmap v19524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:18 smithi110 ceph-mon[28069]: pgmap v19524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:18 smithi193 ceph-mon[32782]: pgmap v19524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:20 smithi196 ceph-mon[32572]: pgmap v19525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:20 smithi110 ceph-mon[28069]: pgmap v19525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:20 smithi193 ceph-mon[32782]: pgmap v19525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:54:22.404+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:54:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:54:22.404+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:54:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:54:22.405+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 280 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:54:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:54:22.405+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 280 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:54:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:22 smithi196 ceph-mon[32572]: pgmap v19526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36377.581142 secs 2024-04-26T21:54:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:22 smithi110 ceph-mon[28069]: pgmap v19526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36377.581142 secs 2024-04-26T21:54:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:22 smithi193 ceph-mon[32782]: pgmap v19526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36377.581142 secs 2024-04-26T21:54:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:24 smithi196 ceph-mon[32572]: pgmap v19527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:24 smithi110 ceph-mon[28069]: pgmap v19527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:24 smithi193 ceph-mon[32782]: pgmap v19527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:26 smithi196 ceph-mon[32572]: pgmap v19528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:26 smithi110 ceph-mon[28069]: pgmap v19528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:26 smithi193 ceph-mon[32782]: pgmap v19528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36382.581259 secs 2024-04-26T21:54:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36382.581259 secs 2024-04-26T21:54:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36382.581259 secs 2024-04-26T21:54:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:28 smithi196 ceph-mon[32572]: pgmap v19529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:28 smithi110 ceph-mon[28069]: pgmap v19529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:28 smithi193 ceph-mon[32782]: pgmap v19529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:30 smithi196 ceph-mon[32572]: pgmap v19530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:30 smithi110 ceph-mon[28069]: pgmap v19530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:30 smithi193 ceph-mon[32782]: pgmap v19530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:32 smithi196 ceph-mon[32572]: pgmap v19531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36387.581405 secs 2024-04-26T21:54:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:32 smithi110 ceph-mon[28069]: pgmap v19531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36387.581405 secs 2024-04-26T21:54:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:32 smithi193 ceph-mon[32782]: pgmap v19531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36387.581405 secs 2024-04-26T21:54:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:34 smithi196 ceph-mon[32572]: pgmap v19532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:34 smithi110 ceph-mon[28069]: pgmap v19532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:34 smithi193 ceph-mon[32782]: pgmap v19532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T21:54:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:36 smithi196 ceph-mon[32572]: pgmap v19533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:36 smithi110 ceph-mon[28069]: pgmap v19533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:36 smithi193 ceph-mon[32782]: pgmap v19533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36392.581503 secs 2024-04-26T21:54:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36392.581503 secs 2024-04-26T21:54:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36392.581503 secs 2024-04-26T21:54:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:38 smithi196 ceph-mon[32572]: pgmap v19534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:38 smithi110 ceph-mon[28069]: pgmap v19534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:38 smithi193 ceph-mon[32782]: pgmap v19534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:40 smithi193 ceph-mon[32782]: pgmap v19535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:40 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:54:40.892 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:40 smithi196 ceph-mon[32572]: pgmap v19535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:40.892 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:40 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:54:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:40 smithi110 ceph-mon[28069]: pgmap v19535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:40 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: pgmap v19536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36397.581576 secs 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: pgmap v19536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36397.581576 secs 2024-04-26T21:54:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: pgmap v19536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36397.581576 secs 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:43.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:54:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:54:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:54:44.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:54:44.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:44.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:54:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:44.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T21:54:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T21:54:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T21:54:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T21:54:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:44.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:44 smithi193 ceph-mon[32782]: pgmap v19537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:44 smithi196 ceph-mon[32572]: pgmap v19537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:44 smithi110 ceph-mon[28069]: pgmap v19537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:54:46.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:54:46.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: pgmap v19538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T21:54:46.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: pgmap v19539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:46.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:54:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:54:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: pgmap v19538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T21:54:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: pgmap v19539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:46.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: pgmap v19538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: pgmap v19539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:46.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:54:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36402.581694 secs 2024-04-26T21:54:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:48 smithi193 ceph-mon[32782]: pgmap v19540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T21:54:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36402.581694 secs 2024-04-26T21:54:48.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:48 smithi196 ceph-mon[32572]: pgmap v19540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T21:54:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36402.581694 secs 2024-04-26T21:54:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:48 smithi110 ceph-mon[28069]: pgmap v19540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T21:54:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:50 smithi193 ceph-mon[32782]: pgmap v19541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:50 smithi196 ceph-mon[32572]: pgmap v19541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:50 smithi110 ceph-mon[28069]: pgmap v19541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:51 smithi193 ceph-mon[32782]: pgmap v19542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:51 smithi196 ceph-mon[32572]: pgmap v19542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:51 smithi110 ceph-mon[28069]: pgmap v19542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36407.581783 secs 2024-04-26T21:54:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36407.581783 secs 2024-04-26T21:54:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36407.581783 secs 2024-04-26T21:54:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:53 smithi196 ceph-mon[32572]: pgmap v19543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:53 smithi110 ceph-mon[28069]: pgmap v19543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:53 smithi193 ceph-mon[32782]: pgmap v19543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:54:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:56 smithi193 ceph-mon[32782]: pgmap v19544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:54:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:56 smithi196 ceph-mon[32572]: pgmap v19544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:54:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:56 smithi110 ceph-mon[28069]: pgmap v19544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:54:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:57 smithi196 ceph-mon[32572]: pgmap v19545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:57 smithi110 ceph-mon[28069]: pgmap v19545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:57 smithi193 ceph-mon[32782]: pgmap v19545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:54:58.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36412.581902 secs 2024-04-26T21:54:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36412.581902 secs 2024-04-26T21:54:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36412.581902 secs 2024-04-26T21:54:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:54:59 smithi196 ceph-mon[32572]: pgmap v19546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:54:59 smithi110 ceph-mon[28069]: pgmap v19546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:54:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:54:59 smithi193 ceph-mon[32782]: pgmap v19546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:02 smithi193 ceph-mon[32782]: pgmap v19547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:02 smithi196 ceph-mon[32572]: pgmap v19547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:02 smithi110 ceph-mon[28069]: pgmap v19547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36417.582032 secs 2024-04-26T21:55:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:03 smithi193 ceph-mon[32782]: pgmap v19548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:55:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36417.582032 secs 2024-04-26T21:55:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:03 smithi196 ceph-mon[32572]: pgmap v19548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:55:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36417.582032 secs 2024-04-26T21:55:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:03 smithi110 ceph-mon[28069]: pgmap v19548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:55:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:06 smithi193 ceph-mon[32782]: pgmap v19549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:55:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:06 smithi196 ceph-mon[32572]: pgmap v19549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:55:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:06 smithi110 ceph-mon[28069]: pgmap v19549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:55:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:07 smithi196 ceph-mon[32572]: pgmap v19550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:55:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:07 smithi110 ceph-mon[28069]: pgmap v19550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:55:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:07 smithi193 ceph-mon[32782]: pgmap v19550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:55:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36422.582112 secs 2024-04-26T21:55:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36422.582112 secs 2024-04-26T21:55:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36422.582112 secs 2024-04-26T21:55:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:09 smithi196 ceph-mon[32572]: pgmap v19551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:55:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:09 smithi110 ceph-mon[28069]: pgmap v19551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:55:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:09 smithi193 ceph-mon[32782]: pgmap v19551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:55:11.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:11 smithi196 ceph-mon[32572]: pgmap v19552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:55:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:11 smithi110 ceph-mon[28069]: pgmap v19552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:55:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:11 smithi193 ceph-mon[32782]: pgmap v19552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T21:55:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36427.582245 secs 2024-04-26T21:55:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36427.582245 secs 2024-04-26T21:55:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36427.582245 secs 2024-04-26T21:55:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:13 smithi196 ceph-mon[32572]: pgmap v19553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:55:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:13 smithi110 ceph-mon[28069]: pgmap v19553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:55:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:13 smithi193 ceph-mon[32782]: pgmap v19553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T21:55:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:15 smithi196 ceph-mon[32572]: pgmap v19554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:15 smithi110 ceph-mon[28069]: pgmap v19554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:15 smithi193 ceph-mon[32782]: pgmap v19554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:17 smithi196 ceph-mon[32572]: pgmap v19555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:17 smithi110 ceph-mon[28069]: pgmap v19555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:17 smithi193 ceph-mon[32782]: pgmap v19555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36432.582368 secs 2024-04-26T21:55:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36432.582368 secs 2024-04-26T21:55:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36432.582368 secs 2024-04-26T21:55:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:19 smithi196 ceph-mon[32572]: pgmap v19556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:19 smithi110 ceph-mon[28069]: pgmap v19556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:19 smithi193 ceph-mon[32782]: pgmap v19556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:21 smithi196 ceph-mon[32572]: pgmap v19557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:21 smithi110 ceph-mon[28069]: pgmap v19557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:21 smithi193 ceph-mon[32782]: pgmap v19557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36437.582484 secs 2024-04-26T21:55:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36437.582484 secs 2024-04-26T21:55:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36437.582484 secs 2024-04-26T21:55:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:23 smithi196 ceph-mon[32572]: pgmap v19558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:23 smithi110 ceph-mon[28069]: pgmap v19558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:23 smithi193 ceph-mon[32782]: pgmap v19558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:25 smithi196 ceph-mon[32572]: pgmap v19559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:25 smithi110 ceph-mon[28069]: pgmap v19559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:25 smithi193 ceph-mon[32782]: pgmap v19559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:27 smithi196 ceph-mon[32572]: pgmap v19560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:27 smithi110 ceph-mon[28069]: pgmap v19560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:27 smithi193 ceph-mon[32782]: pgmap v19560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:28.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36442.582601 secs 2024-04-26T21:55:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36442.582601 secs 2024-04-26T21:55:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36442.582601 secs 2024-04-26T21:55:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:29 smithi196 ceph-mon[32572]: pgmap v19561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:29 smithi110 ceph-mon[28069]: pgmap v19561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:29 smithi193 ceph-mon[32782]: pgmap v19561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:31 smithi196 ceph-mon[32572]: pgmap v19562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:31 smithi110 ceph-mon[28069]: pgmap v19562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:31 smithi193 ceph-mon[32782]: pgmap v19562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36447.582674 secs 2024-04-26T21:55:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36447.582674 secs 2024-04-26T21:55:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36447.582674 secs 2024-04-26T21:55:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:33 smithi196 ceph-mon[32572]: pgmap v19563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:33 smithi110 ceph-mon[28069]: pgmap v19563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:33 smithi193 ceph-mon[32782]: pgmap v19563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:35 smithi196 ceph-mon[32572]: pgmap v19564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:35 smithi110 ceph-mon[28069]: pgmap v19564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:35 smithi193 ceph-mon[32782]: pgmap v19564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:37.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:37 smithi193 ceph-mon[32782]: pgmap v19565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:37 smithi196 ceph-mon[32572]: pgmap v19565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:37 smithi110 ceph-mon[28069]: pgmap v19565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36452.582797 secs 2024-04-26T21:55:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36452.582797 secs 2024-04-26T21:55:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36452.582797 secs 2024-04-26T21:55:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:39 smithi196 ceph-mon[32572]: pgmap v19566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:39 smithi110 ceph-mon[28069]: pgmap v19566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:39 smithi193 ceph-mon[32782]: pgmap v19566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:41 smithi196 ceph-mon[32572]: pgmap v19567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:41 smithi110 ceph-mon[28069]: pgmap v19567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:41 smithi193 ceph-mon[32782]: pgmap v19567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36457.582886 secs 2024-04-26T21:55:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36457.582886 secs 2024-04-26T21:55:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36457.582886 secs 2024-04-26T21:55:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:43 smithi196 ceph-mon[32572]: pgmap v19568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:43 smithi110 ceph-mon[28069]: pgmap v19568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:43 smithi193 ceph-mon[32782]: pgmap v19568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:55:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:45 smithi196 ceph-mon[32572]: pgmap v19569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:45 smithi110 ceph-mon[28069]: pgmap v19569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:45 smithi193 ceph-mon[32782]: pgmap v19569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:55:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:55:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:55:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:55:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:55:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:55:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:47 smithi196 ceph-mon[32572]: pgmap v19570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T21:55:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:47 smithi196 ceph-mon[32572]: pgmap v19571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:55:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:55:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:55:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:47 smithi110 ceph-mon[28069]: pgmap v19570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T21:55:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:47 smithi110 ceph-mon[28069]: pgmap v19571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:55:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:55:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:55:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:47 smithi193 ceph-mon[32782]: pgmap v19570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 888 B/s rd, 1 op/s 2024-04-26T21:55:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:47 smithi193 ceph-mon[32782]: pgmap v19571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:55:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36462.582974 secs 2024-04-26T21:55:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36462.582974 secs 2024-04-26T21:55:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36462.582974 secs 2024-04-26T21:55:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:49 smithi196 ceph-mon[32572]: pgmap v19572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:49 smithi110 ceph-mon[28069]: pgmap v19572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:49 smithi193 ceph-mon[32782]: pgmap v19572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:51 smithi196 ceph-mon[32572]: pgmap v19573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:51 smithi110 ceph-mon[28069]: pgmap v19573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:51 smithi193 ceph-mon[32782]: pgmap v19573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36467.583038 secs 2024-04-26T21:55:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36467.583038 secs 2024-04-26T21:55:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36467.583038 secs 2024-04-26T21:55:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:53 smithi196 ceph-mon[32572]: pgmap v19574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:53 smithi110 ceph-mon[28069]: pgmap v19574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:53 smithi193 ceph-mon[32782]: pgmap v19574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:55 smithi196 ceph-mon[32572]: pgmap v19575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:55 smithi110 ceph-mon[28069]: pgmap v19575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:55 smithi193 ceph-mon[32782]: pgmap v19575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:55:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:57 smithi196 ceph-mon[32572]: pgmap v19576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:55:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36472.583174 secs 2024-04-26T21:55:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:57 smithi110 ceph-mon[28069]: pgmap v19576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:55:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36472.583174 secs 2024-04-26T21:55:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:57 smithi193 ceph-mon[32782]: pgmap v19576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:55:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36472.583174 secs 2024-04-26T21:56:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:55:59 smithi196 ceph-mon[32572]: pgmap v19577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:55:59 smithi110 ceph-mon[28069]: pgmap v19577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:55:59 smithi193 ceph-mon[32782]: pgmap v19577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:01 smithi196 ceph-mon[32572]: pgmap v19578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:01 smithi110 ceph-mon[28069]: pgmap v19578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:01 smithi193 ceph-mon[32782]: pgmap v19578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36477.583292 secs 2024-04-26T21:56:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36477.583292 secs 2024-04-26T21:56:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36477.583292 secs 2024-04-26T21:56:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:03 smithi196 ceph-mon[32572]: pgmap v19579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:03 smithi110 ceph-mon[28069]: pgmap v19579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:03 smithi193 ceph-mon[32782]: pgmap v19579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:05 smithi196 ceph-mon[32572]: pgmap v19580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:05 smithi110 ceph-mon[28069]: pgmap v19580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:05 smithi193 ceph-mon[32782]: pgmap v19580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:07 smithi196 ceph-mon[32572]: pgmap v19581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36482.583427 secs 2024-04-26T21:56:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:07 smithi110 ceph-mon[28069]: pgmap v19581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36482.583427 secs 2024-04-26T21:56:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:07 smithi193 ceph-mon[32782]: pgmap v19581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36482.583427 secs 2024-04-26T21:56:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:09 smithi196 ceph-mon[32572]: pgmap v19582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:09 smithi110 ceph-mon[28069]: pgmap v19582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:09 smithi193 ceph-mon[32782]: pgmap v19582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:11 smithi196 ceph-mon[32572]: pgmap v19583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:11 smithi110 ceph-mon[28069]: pgmap v19583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:11 smithi193 ceph-mon[32782]: pgmap v19583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36487.583550 secs 2024-04-26T21:56:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:13 smithi193 ceph-mon[32782]: pgmap v19584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36487.583550 secs 2024-04-26T21:56:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:13 smithi196 ceph-mon[32572]: pgmap v19584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36487.583550 secs 2024-04-26T21:56:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:13 smithi110 ceph-mon[28069]: pgmap v19584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:15 smithi196 ceph-mon[32572]: pgmap v19585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:15 smithi110 ceph-mon[28069]: pgmap v19585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:15 smithi193 ceph-mon[32782]: pgmap v19585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:17 smithi196 ceph-mon[32572]: pgmap v19586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36492.583643 secs 2024-04-26T21:56:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:17 smithi110 ceph-mon[28069]: pgmap v19586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36492.583643 secs 2024-04-26T21:56:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:17 smithi193 ceph-mon[32782]: pgmap v19586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36492.583643 secs 2024-04-26T21:56:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:19 smithi196 ceph-mon[32572]: pgmap v19587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:19 smithi110 ceph-mon[28069]: pgmap v19587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:19 smithi193 ceph-mon[32782]: pgmap v19587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:21 smithi196 ceph-mon[32572]: pgmap v19588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:21 smithi110 ceph-mon[28069]: pgmap v19588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:21 smithi193 ceph-mon[32782]: pgmap v19588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36497.583758 secs 2024-04-26T21:56:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36497.583758 secs 2024-04-26T21:56:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36497.583758 secs 2024-04-26T21:56:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:23 smithi196 ceph-mon[32572]: pgmap v19589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:23 smithi110 ceph-mon[28069]: pgmap v19589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:23 smithi193 ceph-mon[32782]: pgmap v19589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:25 smithi196 ceph-mon[32572]: pgmap v19590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:25 smithi110 ceph-mon[28069]: pgmap v19590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:25 smithi193 ceph-mon[32782]: pgmap v19590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:27 smithi196 ceph-mon[32572]: pgmap v19591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36502.583869 secs 2024-04-26T21:56:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:27 smithi110 ceph-mon[28069]: pgmap v19591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36502.583869 secs 2024-04-26T21:56:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:27 smithi193 ceph-mon[32782]: pgmap v19591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36502.583869 secs 2024-04-26T21:56:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:29 smithi196 ceph-mon[32572]: pgmap v19592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:29 smithi110 ceph-mon[28069]: pgmap v19592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:29 smithi193 ceph-mon[32782]: pgmap v19592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:31 smithi196 ceph-mon[32572]: pgmap v19593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:31 smithi110 ceph-mon[28069]: pgmap v19593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:31 smithi193 ceph-mon[32782]: pgmap v19593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36507.584008 secs 2024-04-26T21:56:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36507.584008 secs 2024-04-26T21:56:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36507.584008 secs 2024-04-26T21:56:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:33 smithi196 ceph-mon[32572]: pgmap v19594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:33 smithi110 ceph-mon[28069]: pgmap v19594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:33 smithi193 ceph-mon[32782]: pgmap v19594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:35 smithi196 ceph-mon[32572]: pgmap v19595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:35 smithi110 ceph-mon[28069]: pgmap v19595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:35 smithi193 ceph-mon[32782]: pgmap v19595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:37 smithi196 ceph-mon[32572]: pgmap v19596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36512.584091 secs 2024-04-26T21:56:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:37 smithi110 ceph-mon[28069]: pgmap v19596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36512.584091 secs 2024-04-26T21:56:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:37 smithi193 ceph-mon[32782]: pgmap v19596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36512.584091 secs 2024-04-26T21:56:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:39 smithi196 ceph-mon[32572]: pgmap v19597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:39 smithi110 ceph-mon[28069]: pgmap v19597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:40.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:39 smithi193 ceph-mon[32782]: pgmap v19597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:41 smithi110 ceph-mon[28069]: pgmap v19598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:41 smithi193 ceph-mon[32782]: pgmap v19598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:41 smithi196 ceph-mon[32572]: pgmap v19598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36517.584223 secs 2024-04-26T21:56:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36517.584223 secs 2024-04-26T21:56:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36517.584223 secs 2024-04-26T21:56:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:43 smithi110 ceph-mon[28069]: pgmap v19599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:43 smithi193 ceph-mon[32782]: pgmap v19599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:43 smithi196 ceph-mon[32572]: pgmap v19599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:56:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:45 smithi110 ceph-mon[28069]: pgmap v19600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:45 smithi193 ceph-mon[32782]: pgmap v19600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:45 smithi196 ceph-mon[32572]: pgmap v19600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:47 smithi110 ceph-mon[28069]: pgmap v19601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:56:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36522.584322 secs 2024-04-26T21:56:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:47 smithi193 ceph-mon[32782]: pgmap v19601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:56:48.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36522.584322 secs 2024-04-26T21:56:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:47 smithi196 ceph-mon[32572]: pgmap v19601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:56:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:56:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36522.584322 secs 2024-04-26T21:56:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:56:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:48 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:56:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:56:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:56:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:48 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:56:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:56:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:56:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:48 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:56:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:56:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:49 smithi193 ceph-mon[32782]: pgmap v19602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:56:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:49 smithi193 ceph-mon[32782]: pgmap v19603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:49 smithi196 ceph-mon[32572]: pgmap v19602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:56:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:49 smithi196 ceph-mon[32572]: pgmap v19603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:49 smithi110 ceph-mon[28069]: pgmap v19602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T21:56:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:49 smithi110 ceph-mon[28069]: pgmap v19603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:51 smithi193 ceph-mon[32782]: pgmap v19604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:51 smithi196 ceph-mon[32572]: pgmap v19604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:51 smithi110 ceph-mon[28069]: pgmap v19604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36527.584394 secs 2024-04-26T21:56:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36527.584394 secs 2024-04-26T21:56:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36527.584394 secs 2024-04-26T21:56:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:53 smithi193 ceph-mon[32782]: pgmap v19605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T21:56:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:53 smithi196 ceph-mon[32572]: pgmap v19605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T21:56:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:53 smithi110 ceph-mon[28069]: pgmap v19605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T21:56:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:55 smithi193 ceph-mon[32782]: pgmap v19606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:55 smithi196 ceph-mon[32572]: pgmap v19606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:55 smithi110 ceph-mon[28069]: pgmap v19606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:57 smithi193 ceph-mon[32782]: pgmap v19607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36532.584496 secs 2024-04-26T21:56:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:57 smithi196 ceph-mon[32572]: pgmap v19607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36532.584496 secs 2024-04-26T21:56:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:57 smithi110 ceph-mon[28069]: pgmap v19607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:56:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36532.584496 secs 2024-04-26T21:57:00.094 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:56:59 smithi110 ceph-mon[28069]: pgmap v19608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:57:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:56:59 smithi193 ceph-mon[32782]: pgmap v19608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:57:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:56:59 smithi196 ceph-mon[32572]: pgmap v19608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:57:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:01 smithi193 ceph-mon[32782]: pgmap v19609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:01 smithi196 ceph-mon[32572]: pgmap v19609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:01 smithi110 ceph-mon[28069]: pgmap v19609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36537.584624 secs 2024-04-26T21:57:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36537.584624 secs 2024-04-26T21:57:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36537.584624 secs 2024-04-26T21:57:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:03 smithi193 ceph-mon[32782]: pgmap v19610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:03 smithi196 ceph-mon[32572]: pgmap v19610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:03 smithi110 ceph-mon[28069]: pgmap v19610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:05 smithi193 ceph-mon[32782]: pgmap v19611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:05 smithi196 ceph-mon[32572]: pgmap v19611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:05 smithi110 ceph-mon[28069]: pgmap v19611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:07 smithi193 ceph-mon[32782]: pgmap v19612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36542.584753 secs 2024-04-26T21:57:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:07 smithi196 ceph-mon[32572]: pgmap v19612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36542.584753 secs 2024-04-26T21:57:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:07 smithi110 ceph-mon[28069]: pgmap v19612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36542.584753 secs 2024-04-26T21:57:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:09 smithi193 ceph-mon[32782]: pgmap v19613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:09 smithi196 ceph-mon[32572]: pgmap v19613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:09 smithi110 ceph-mon[28069]: pgmap v19613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:11 smithi196 ceph-mon[32572]: pgmap v19614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:11 smithi110 ceph-mon[28069]: pgmap v19614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:11 smithi193 ceph-mon[32782]: pgmap v19614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36547.584821 secs 2024-04-26T21:57:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36547.584821 secs 2024-04-26T21:57:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36547.584821 secs 2024-04-26T21:57:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:13 smithi196 ceph-mon[32572]: pgmap v19615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:13 smithi110 ceph-mon[28069]: pgmap v19615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:13 smithi193 ceph-mon[32782]: pgmap v19615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:15 smithi196 ceph-mon[32572]: pgmap v19616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:15 smithi110 ceph-mon[28069]: pgmap v19616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:15 smithi193 ceph-mon[32782]: pgmap v19616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:17 smithi196 ceph-mon[32572]: pgmap v19617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36552.584947 secs 2024-04-26T21:57:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:17 smithi110 ceph-mon[28069]: pgmap v19617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36552.584947 secs 2024-04-26T21:57:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:17 smithi193 ceph-mon[32782]: pgmap v19617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36552.584947 secs 2024-04-26T21:57:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:19 smithi196 ceph-mon[32572]: pgmap v19618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:19 smithi110 ceph-mon[28069]: pgmap v19618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:19 smithi193 ceph-mon[32782]: pgmap v19618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:21 smithi196 ceph-mon[32572]: pgmap v19619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:21 smithi110 ceph-mon[28069]: pgmap v19619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:21 smithi193 ceph-mon[32782]: pgmap v19619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:57:22.435+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:57:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:57:22.435+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:57:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:57:22.436+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 281 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:57:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:57:22.436+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 281 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:57:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36557.585071 secs 2024-04-26T21:57:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36557.585071 secs 2024-04-26T21:57:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36557.585071 secs 2024-04-26T21:57:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:23 smithi196 ceph-mon[32572]: pgmap v19620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:23 smithi110 ceph-mon[28069]: pgmap v19620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:23 smithi193 ceph-mon[32782]: pgmap v19620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:25 smithi196 ceph-mon[32572]: pgmap v19621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:25 smithi110 ceph-mon[28069]: pgmap v19621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:25 smithi193 ceph-mon[32782]: pgmap v19621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:27 smithi196 ceph-mon[32572]: pgmap v19622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36562.585146 secs 2024-04-26T21:57:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:27 smithi110 ceph-mon[28069]: pgmap v19622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36562.585146 secs 2024-04-26T21:57:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:27 smithi193 ceph-mon[32782]: pgmap v19622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36562.585146 secs 2024-04-26T21:57:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:29 smithi196 ceph-mon[32572]: pgmap v19623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:29 smithi110 ceph-mon[28069]: pgmap v19623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:29 smithi193 ceph-mon[32782]: pgmap v19623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:31 smithi196 ceph-mon[32572]: pgmap v19624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:31 smithi110 ceph-mon[28069]: pgmap v19624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:31 smithi193 ceph-mon[32782]: pgmap v19624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36567.585269 secs 2024-04-26T21:57:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36567.585269 secs 2024-04-26T21:57:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36567.585269 secs 2024-04-26T21:57:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:33 smithi196 ceph-mon[32572]: pgmap v19625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:33 smithi110 ceph-mon[28069]: pgmap v19625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:33 smithi193 ceph-mon[32782]: pgmap v19625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:35 smithi196 ceph-mon[32572]: pgmap v19626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:35 smithi110 ceph-mon[28069]: pgmap v19626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:35 smithi193 ceph-mon[32782]: pgmap v19626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:37 smithi196 ceph-mon[32572]: pgmap v19627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36572.585416 secs 2024-04-26T21:57:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:37 smithi110 ceph-mon[28069]: pgmap v19627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36572.585416 secs 2024-04-26T21:57:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:37 smithi193 ceph-mon[32782]: pgmap v19627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36572.585416 secs 2024-04-26T21:57:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:39 smithi196 ceph-mon[32572]: pgmap v19628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:39 smithi110 ceph-mon[28069]: pgmap v19628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:39 smithi193 ceph-mon[32782]: pgmap v19628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:41 smithi196 ceph-mon[32572]: pgmap v19629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:41 smithi110 ceph-mon[28069]: pgmap v19629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:41 smithi193 ceph-mon[32782]: pgmap v19629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36577.585543 secs 2024-04-26T21:57:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36577.585543 secs 2024-04-26T21:57:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36577.585543 secs 2024-04-26T21:57:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:43 smithi196 ceph-mon[32572]: pgmap v19630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:43 smithi110 ceph-mon[28069]: pgmap v19630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:43 smithi193 ceph-mon[32782]: pgmap v19630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:45 smithi196 ceph-mon[32572]: pgmap v19631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:45 smithi110 ceph-mon[28069]: pgmap v19631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:45 smithi193 ceph-mon[32782]: pgmap v19631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:47 smithi196 ceph-mon[32572]: pgmap v19632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36582.585641 secs 2024-04-26T21:57:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:47 smithi110 ceph-mon[28069]: pgmap v19632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36582.585641 secs 2024-04-26T21:57:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:47 smithi193 ceph-mon[32782]: pgmap v19632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:57:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36582.585641 secs 2024-04-26T21:57:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:57:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:57:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:57:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:50 smithi110 ceph-mon[28069]: pgmap v19633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:57:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:57:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:57:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:50 smithi193 ceph-mon[32782]: pgmap v19633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:57:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:57:50.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:57:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:50 smithi196 ceph-mon[32572]: pgmap v19633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:57:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:57:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:57:50.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:57:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:51 smithi110 ceph-mon[28069]: pgmap v19634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T21:57:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:51 smithi110 ceph-mon[28069]: pgmap v19635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:51 smithi193 ceph-mon[32782]: pgmap v19634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T21:57:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:51 smithi193 ceph-mon[32782]: pgmap v19635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:51 smithi196 ceph-mon[32572]: pgmap v19634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T21:57:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:51 smithi196 ceph-mon[32572]: pgmap v19635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:53 smithi110 ceph-mon[28069]: pgmap v19636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36587.585770 secs 2024-04-26T21:57:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:53 smithi193 ceph-mon[32782]: pgmap v19636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36587.585770 secs 2024-04-26T21:57:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:53 smithi196 ceph-mon[32572]: pgmap v19636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36587.585770 secs 2024-04-26T21:57:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:55 smithi110 ceph-mon[28069]: pgmap v19637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:55 smithi193 ceph-mon[32782]: pgmap v19637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:55 smithi196 ceph-mon[32572]: pgmap v19637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:57 smithi110 ceph-mon[28069]: pgmap v19638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:57 smithi193 ceph-mon[32782]: pgmap v19638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:57 smithi196 ceph-mon[32572]: pgmap v19638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36592.585891 secs 2024-04-26T21:57:58.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36592.585891 secs 2024-04-26T21:57:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36592.585891 secs 2024-04-26T21:57:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:57:59 smithi193 ceph-mon[32782]: pgmap v19639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:57:59 smithi196 ceph-mon[32572]: pgmap v19639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:57:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:57:59 smithi110 ceph-mon[28069]: pgmap v19639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:58:01.343 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:01 smithi110 ceph-mon[28069]: pgmap v19640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:58:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:01 smithi193 ceph-mon[32782]: pgmap v19640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:58:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:01 smithi196 ceph-mon[32572]: pgmap v19640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:58:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:03 smithi193 ceph-mon[32782]: pgmap v19641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36597.585991 secs 2024-04-26T21:58:03.509 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:03 smithi196 ceph-mon[32572]: pgmap v19641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:03.509 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36597.585991 secs 2024-04-26T21:58:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:03 smithi110 ceph-mon[28069]: pgmap v19641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36597.585991 secs 2024-04-26T21:58:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:05 smithi193 ceph-mon[32782]: pgmap v19642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:05 smithi196 ceph-mon[32572]: pgmap v19642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:05 smithi110 ceph-mon[28069]: pgmap v19642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:07 smithi193 ceph-mon[32782]: pgmap v19643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:07 smithi196 ceph-mon[32572]: pgmap v19643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:07 smithi110 ceph-mon[28069]: pgmap v19643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36602.586077 secs 2024-04-26T21:58:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36602.586077 secs 2024-04-26T21:58:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36602.586077 secs 2024-04-26T21:58:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:09 smithi193 ceph-mon[32782]: pgmap v19644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:09 smithi196 ceph-mon[32572]: pgmap v19644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:09 smithi110 ceph-mon[28069]: pgmap v19644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:11 smithi193 ceph-mon[32782]: pgmap v19645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:11 smithi196 ceph-mon[32572]: pgmap v19645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:11 smithi110 ceph-mon[28069]: pgmap v19645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:13 smithi193 ceph-mon[32782]: pgmap v19646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36607.586206 secs 2024-04-26T21:58:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:13 smithi196 ceph-mon[32572]: pgmap v19646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36607.586206 secs 2024-04-26T21:58:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:13 smithi110 ceph-mon[28069]: pgmap v19646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36607.586206 secs 2024-04-26T21:58:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:15 smithi193 ceph-mon[32782]: pgmap v19647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:15 smithi196 ceph-mon[32572]: pgmap v19647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:15 smithi110 ceph-mon[28069]: pgmap v19647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:17 smithi193 ceph-mon[32782]: pgmap v19648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:17 smithi196 ceph-mon[32572]: pgmap v19648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:17 smithi110 ceph-mon[28069]: pgmap v19648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36612.586329 secs 2024-04-26T21:58:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36612.586329 secs 2024-04-26T21:58:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36612.586329 secs 2024-04-26T21:58:19.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:19 smithi193 ceph-mon[32782]: pgmap v19649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:19 smithi196 ceph-mon[32572]: pgmap v19649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:19 smithi110 ceph-mon[28069]: pgmap v19649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:21 smithi196 ceph-mon[32572]: pgmap v19650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:21 smithi110 ceph-mon[28069]: pgmap v19650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:21 smithi193 ceph-mon[32782]: pgmap v19650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:23 smithi196 ceph-mon[32572]: pgmap v19651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:23 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 36617.586458 secs 2024-04-26T21:58:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:23 smithi196 ceph-mon[32572]: slow request 1444.509568 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:58:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:23 smithi110 ceph-mon[28069]: pgmap v19651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:23 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 36617.586458 secs 2024-04-26T21:58:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:23 smithi110 ceph-mon[28069]: slow request 1444.509568 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:58:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:23 smithi193 ceph-mon[32782]: pgmap v19651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:23 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 36617.586458 secs 2024-04-26T21:58:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:23 smithi193 ceph-mon[32782]: slow request 1444.509568 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:58:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:25 smithi196 ceph-mon[32572]: pgmap v19652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:25 smithi110 ceph-mon[28069]: pgmap v19652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:25 smithi193 ceph-mon[32782]: pgmap v19652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:27 smithi196 ceph-mon[32572]: pgmap v19653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:27 smithi110 ceph-mon[28069]: pgmap v19653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:27 smithi193 ceph-mon[32782]: pgmap v19653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:28.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36622.586588 secs 2024-04-26T21:58:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36622.586588 secs 2024-04-26T21:58:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36622.586588 secs 2024-04-26T21:58:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:29 smithi196 ceph-mon[32572]: pgmap v19654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:29 smithi110 ceph-mon[28069]: pgmap v19654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:29 smithi193 ceph-mon[32782]: pgmap v19654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:30 smithi196 ceph-mon[32572]: pgmap v19655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:30 smithi110 ceph-mon[28069]: pgmap v19655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:30 smithi193 ceph-mon[32782]: pgmap v19655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:32 smithi193 ceph-mon[32782]: pgmap v19656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36627.586661 secs 2024-04-26T21:58:33.245 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:32 smithi110 ceph-mon[28069]: pgmap v19656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:33.245 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36627.586661 secs 2024-04-26T21:58:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:32 smithi196 ceph-mon[32572]: pgmap v19656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:33.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36627.586661 secs 2024-04-26T21:58:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:34 smithi193 ceph-mon[32782]: pgmap v19657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:34 smithi196 ceph-mon[32572]: pgmap v19657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:34 smithi110 ceph-mon[28069]: pgmap v19657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:36 smithi196 ceph-mon[32572]: pgmap v19658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:36 smithi110 ceph-mon[28069]: pgmap v19658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:36 smithi193 ceph-mon[32782]: pgmap v19658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36632.586744 secs 2024-04-26T21:58:38.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36632.586744 secs 2024-04-26T21:58:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36632.586744 secs 2024-04-26T21:58:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:38 smithi196 ceph-mon[32572]: pgmap v19659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:38 smithi110 ceph-mon[28069]: pgmap v19659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:38 smithi193 ceph-mon[32782]: pgmap v19659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:40 smithi196 ceph-mon[32572]: pgmap v19660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:40 smithi110 ceph-mon[28069]: pgmap v19660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:40 smithi193 ceph-mon[32782]: pgmap v19660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:42 smithi196 ceph-mon[32572]: pgmap v19661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36637.586867 secs 2024-04-26T21:58:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:42 smithi110 ceph-mon[28069]: pgmap v19661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36637.586867 secs 2024-04-26T21:58:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:42 smithi193 ceph-mon[32782]: pgmap v19661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36637.586867 secs 2024-04-26T21:58:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:44 smithi196 ceph-mon[32572]: pgmap v19662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:44 smithi110 ceph-mon[28069]: pgmap v19662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:44 smithi193 ceph-mon[32782]: pgmap v19662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:46 smithi196 ceph-mon[32572]: pgmap v19663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:47.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:46 smithi110 ceph-mon[28069]: pgmap v19663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:46 smithi193 ceph-mon[32782]: pgmap v19663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36642.586987 secs 2024-04-26T21:58:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36642.586987 secs 2024-04-26T21:58:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36642.586987 secs 2024-04-26T21:58:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:48 smithi196 ceph-mon[32572]: pgmap v19664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:48 smithi110 ceph-mon[28069]: pgmap v19664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:48 smithi193 ceph-mon[32782]: pgmap v19664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:50 smithi196 ceph-mon[32572]: pgmap v19665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:58:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:50 smithi110 ceph-mon[28069]: pgmap v19665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:58:51.345 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:50 smithi193 ceph-mon[32782]: pgmap v19665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:51.345 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:58:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:58:52.450+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T21:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:58:52.450+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T21:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:58:52.450+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 282 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T21:58:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T21:58:52.450+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 282 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T21:58:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:52 smithi196 ceph-mon[32572]: pgmap v19666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36647.587131 secs 2024-04-26T21:58:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:52 smithi110 ceph-mon[28069]: pgmap v19666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36647.587131 secs 2024-04-26T21:58:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:52 smithi193 ceph-mon[32782]: pgmap v19666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:58:53.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36647.587131 secs 2024-04-26T21:58:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:54 smithi193 ceph-mon[32782]: pgmap v19667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:58:55.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:58:55.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:54 smithi196 ceph-mon[32572]: pgmap v19667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:58:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:58:55.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:54 smithi110 ceph-mon[28069]: pgmap v19667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:58:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:58:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:58:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:55 smithi196 ceph-mon[32572]: pgmap v19668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 1 op/s 2024-04-26T21:58:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:55 smithi196 ceph-mon[32572]: pgmap v19669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:55 smithi110 ceph-mon[28069]: pgmap v19668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 1 op/s 2024-04-26T21:58:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:55 smithi110 ceph-mon[28069]: pgmap v19669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:55 smithi193 ceph-mon[32782]: pgmap v19668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 1 op/s 2024-04-26T21:58:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:55 smithi193 ceph-mon[32782]: pgmap v19669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:58:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:57 smithi196 ceph-mon[32572]: pgmap v19670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 599 B/s rd, 1 op/s 2024-04-26T21:58:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36652.587281 secs 2024-04-26T21:58:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:57 smithi110 ceph-mon[28069]: pgmap v19670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 599 B/s rd, 1 op/s 2024-04-26T21:58:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36652.587281 secs 2024-04-26T21:58:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:57 smithi193 ceph-mon[32782]: pgmap v19670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 599 B/s rd, 1 op/s 2024-04-26T21:58:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36652.587281 secs 2024-04-26T21:59:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:58:59 smithi196 ceph-mon[32572]: pgmap v19671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:58:59 smithi110 ceph-mon[28069]: pgmap v19671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:58:59 smithi193 ceph-mon[32782]: pgmap v19671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:01 smithi196 ceph-mon[32572]: pgmap v19672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:01 smithi110 ceph-mon[28069]: pgmap v19672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:01 smithi193 ceph-mon[32782]: pgmap v19672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36657.587400 secs 2024-04-26T21:59:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36657.587400 secs 2024-04-26T21:59:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36657.587400 secs 2024-04-26T21:59:04.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:03 smithi196 ceph-mon[32572]: pgmap v19673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T21:59:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:03 smithi110 ceph-mon[28069]: pgmap v19673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T21:59:04.319 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:03 smithi193 ceph-mon[32782]: pgmap v19673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-26T21:59:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:05 smithi196 ceph-mon[32572]: pgmap v19674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:59:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:05 smithi110 ceph-mon[28069]: pgmap v19674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:59:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:05 smithi193 ceph-mon[32782]: pgmap v19674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T21:59:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:07 smithi196 ceph-mon[32572]: pgmap v19675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36662.587523 secs 2024-04-26T21:59:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:07 smithi110 ceph-mon[28069]: pgmap v19675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36662.587523 secs 2024-04-26T21:59:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:07 smithi193 ceph-mon[32782]: pgmap v19675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36662.587523 secs 2024-04-26T21:59:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:09 smithi196 ceph-mon[32572]: pgmap v19676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:09 smithi110 ceph-mon[28069]: pgmap v19676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:09 smithi193 ceph-mon[32782]: pgmap v19676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:11 smithi196 ceph-mon[32572]: pgmap v19677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:11 smithi110 ceph-mon[28069]: pgmap v19677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:11 smithi193 ceph-mon[32782]: pgmap v19677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36667.587582 secs 2024-04-26T21:59:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36667.587582 secs 2024-04-26T21:59:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36667.587582 secs 2024-04-26T21:59:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:13 smithi196 ceph-mon[32572]: pgmap v19678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:13 smithi110 ceph-mon[28069]: pgmap v19678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:13 smithi193 ceph-mon[32782]: pgmap v19678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:16 smithi196 ceph-mon[32572]: pgmap v19679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:16 smithi110 ceph-mon[28069]: pgmap v19679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:16 smithi193 ceph-mon[32782]: pgmap v19679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:18 smithi110 ceph-mon[28069]: pgmap v19680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36672.587701 secs 2024-04-26T21:59:18.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:59:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:59:18.031+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:59:18.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:59:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:59:18.031+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:59:18.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:59:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:59:18.031+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:59:18.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:59:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:59:18.031+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:59:18.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 21:59:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T21:59:18.031+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:59:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:18 smithi193 ceph-mon[32782]: pgmap v19680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36672.587701 secs 2024-04-26T21:59:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:18 smithi196 ceph-mon[32572]: pgmap v19680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36672.587701 secs 2024-04-26T21:59:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:20 smithi110 ceph-mon[28069]: pgmap v19681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:20 smithi193 ceph-mon[32782]: pgmap v19681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:20 smithi196 ceph-mon[32572]: pgmap v19681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:22 smithi110 ceph-mon[28069]: pgmap v19682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:22 smithi193 ceph-mon[32782]: pgmap v19682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:22 smithi196 ceph-mon[32572]: pgmap v19682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36677.587822 secs 2024-04-26T21:59:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36677.587822 secs 2024-04-26T21:59:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36677.587822 secs 2024-04-26T21:59:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:24 smithi110 ceph-mon[28069]: pgmap v19683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:24 smithi193 ceph-mon[32782]: pgmap v19683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:24 smithi196 ceph-mon[32572]: pgmap v19683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:26 smithi110 ceph-mon[28069]: pgmap v19684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:26 smithi193 ceph-mon[32782]: pgmap v19684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:26 smithi196 ceph-mon[32572]: pgmap v19684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:28.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:28 smithi196 ceph-mon[32572]: pgmap v19685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:28.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36682.587931 secs 2024-04-26T21:59:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:28 smithi193 ceph-mon[32782]: pgmap v19685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36682.587931 secs 2024-04-26T21:59:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:28 smithi110 ceph-mon[28069]: pgmap v19685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36682.587931 secs 2024-04-26T21:59:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:30 smithi193 ceph-mon[32782]: pgmap v19686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:30 smithi196 ceph-mon[32572]: pgmap v19686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:30 smithi110 ceph-mon[28069]: pgmap v19686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:32 smithi193 ceph-mon[32782]: pgmap v19687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:32 smithi196 ceph-mon[32572]: pgmap v19687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:32 smithi110 ceph-mon[28069]: pgmap v19687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36687.588055 secs 2024-04-26T21:59:33.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36687.588055 secs 2024-04-26T21:59:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36687.588055 secs 2024-04-26T21:59:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:34 smithi193 ceph-mon[32782]: pgmap v19688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:34.477 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:34 smithi110 ceph-mon[28069]: pgmap v19688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:34 smithi196 ceph-mon[32572]: pgmap v19688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:36 smithi193 ceph-mon[32782]: pgmap v19689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:36 smithi196 ceph-mon[32572]: pgmap v19689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:36 smithi110 ceph-mon[28069]: pgmap v19689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:38 smithi193 ceph-mon[32782]: pgmap v19690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36692.588153 secs 2024-04-26T21:59:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:38 smithi196 ceph-mon[32572]: pgmap v19690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36692.588153 secs 2024-04-26T21:59:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:38 smithi110 ceph-mon[28069]: pgmap v19690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36692.588153 secs 2024-04-26T21:59:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:40 smithi193 ceph-mon[32782]: pgmap v19691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:40 smithi196 ceph-mon[32572]: pgmap v19691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:40 smithi110 ceph-mon[28069]: pgmap v19691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:42 smithi193 ceph-mon[32782]: pgmap v19692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:42 smithi196 ceph-mon[32572]: pgmap v19692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:42 smithi110 ceph-mon[28069]: pgmap v19692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36697.588272 secs 2024-04-26T21:59:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36697.588272 secs 2024-04-26T21:59:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36697.588272 secs 2024-04-26T21:59:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:44 smithi193 ceph-mon[32782]: pgmap v19693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:44 smithi196 ceph-mon[32572]: pgmap v19693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:44 smithi110 ceph-mon[28069]: pgmap v19693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:46 smithi193 ceph-mon[32782]: pgmap v19694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:46 smithi196 ceph-mon[32572]: pgmap v19694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:46 smithi110 ceph-mon[28069]: pgmap v19694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:48 smithi193 ceph-mon[32782]: pgmap v19695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36702.588415 secs 2024-04-26T21:59:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:48 smithi196 ceph-mon[32572]: pgmap v19695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36702.588415 secs 2024-04-26T21:59:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:48 smithi110 ceph-mon[28069]: pgmap v19695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36702.588415 secs 2024-04-26T21:59:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:50 smithi193 ceph-mon[32782]: pgmap v19696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:50 smithi196 ceph-mon[32572]: pgmap v19696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:50 smithi110 ceph-mon[28069]: pgmap v19696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:52 smithi193 ceph-mon[32782]: pgmap v19697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:52 smithi196 ceph-mon[32572]: pgmap v19697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:52 smithi110 ceph-mon[28069]: pgmap v19697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T21:59:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36707.588533 secs 2024-04-26T21:59:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36707.588533 secs 2024-04-26T21:59:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36707.588533 secs 2024-04-26T21:59:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:54 smithi196 ceph-mon[32572]: pgmap v19698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:54 smithi110 ceph-mon[28069]: pgmap v19698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:54 smithi193 ceph-mon[32782]: pgmap v19698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:59:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:59:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:59:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:56 smithi196 ceph-mon[32572]: pgmap v19699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:59:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:59:56.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:59:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:56 smithi110 ceph-mon[28069]: pgmap v19699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:59:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:59:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:59:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:56 smithi193 ceph-mon[32782]: pgmap v19699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T21:59:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:59:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:59:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T21:59:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:57 smithi196 ceph-mon[32572]: pgmap v19700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:59:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:57 smithi196 ceph-mon[32572]: pgmap v19701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:59:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:57 smithi110 ceph-mon[28069]: pgmap v19700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:59:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:57 smithi110 ceph-mon[28069]: pgmap v19701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:59:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:57 smithi193 ceph-mon[32782]: pgmap v19700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T21:59:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:57 smithi193 ceph-mon[32782]: pgmap v19701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:59:58.421 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36712.588652 secs 2024-04-26T21:59:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36712.588652 secs 2024-04-26T21:59:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36712.588652 secs 2024-04-26T21:59:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 21:59:59 smithi196 ceph-mon[32572]: pgmap v19702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:59:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 21:59:59 smithi110 ceph-mon[28069]: pgmap v19702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:59:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 21:59:59 smithi193 ceph-mon[32782]: pgmap v19702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:00:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:00:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:00:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:00:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:01 smithi196 ceph-mon[32572]: pgmap v19703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:00:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:01 smithi110 ceph-mon[28069]: pgmap v19703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:00:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:01 smithi193 ceph-mon[32782]: pgmap v19703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:00:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:02 smithi196 ceph-mon[32572]: pgmap v19704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:00:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:02 smithi110 ceph-mon[28069]: pgmap v19704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:00:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:02 smithi193 ceph-mon[32782]: pgmap v19704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:00:03.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36717.588801 secs 2024-04-26T22:00:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36717.588801 secs 2024-04-26T22:00:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36717.588801 secs 2024-04-26T22:00:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:04 smithi196 ceph-mon[32572]: pgmap v19705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:00:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:04 smithi110 ceph-mon[28069]: pgmap v19705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:00:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:04 smithi193 ceph-mon[32782]: pgmap v19705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:00:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:07 smithi110 ceph-mon[28069]: pgmap v19706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:00:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:07 smithi193 ceph-mon[32782]: pgmap v19706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:00:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:07 smithi196 ceph-mon[32572]: pgmap v19706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:00:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36722.588950 secs 2024-04-26T22:00:08.291 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36722.588950 secs 2024-04-26T22:00:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36722.588950 secs 2024-04-26T22:00:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:09 smithi110 ceph-mon[28069]: pgmap v19707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:09 smithi193 ceph-mon[32782]: pgmap v19707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:09 smithi196 ceph-mon[32572]: pgmap v19707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:11 smithi193 ceph-mon[32782]: pgmap v19708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:11.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:11 smithi196 ceph-mon[32572]: pgmap v19708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:11 smithi110 ceph-mon[28069]: pgmap v19708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36727.589084 secs 2024-04-26T22:00:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:13 smithi193 ceph-mon[32782]: pgmap v19709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36727.589084 secs 2024-04-26T22:00:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:13 smithi196 ceph-mon[32572]: pgmap v19709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36727.589084 secs 2024-04-26T22:00:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:13 smithi110 ceph-mon[28069]: pgmap v19709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:15 smithi193 ceph-mon[32782]: pgmap v19710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:15 smithi196 ceph-mon[32572]: pgmap v19710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:15 smithi110 ceph-mon[28069]: pgmap v19710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:17 smithi193 ceph-mon[32782]: pgmap v19711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:17 smithi196 ceph-mon[32572]: pgmap v19711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:17 smithi110 ceph-mon[28069]: pgmap v19711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36732.589176 secs 2024-04-26T22:00:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36732.589176 secs 2024-04-26T22:00:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36732.589176 secs 2024-04-26T22:00:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:19 smithi193 ceph-mon[32782]: pgmap v19712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:19 smithi196 ceph-mon[32572]: pgmap v19712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:19 smithi110 ceph-mon[28069]: pgmap v19712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:21 smithi193 ceph-mon[32782]: pgmap v19713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:21 smithi196 ceph-mon[32572]: pgmap v19713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:21 smithi110 ceph-mon[28069]: pgmap v19713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:00:22.464+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T22:00:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:00:22.464+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:00:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:00:22.465+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 283 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:00:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:00:22.465+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 283 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T22:00:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36737.589296 secs 2024-04-26T22:00:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:23 smithi193 ceph-mon[32782]: pgmap v19714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36737.589296 secs 2024-04-26T22:00:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:23 smithi196 ceph-mon[32572]: pgmap v19714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36737.589296 secs 2024-04-26T22:00:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:23 smithi110 ceph-mon[28069]: pgmap v19714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:25 smithi193 ceph-mon[32782]: pgmap v19715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:25 smithi196 ceph-mon[32572]: pgmap v19715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:25 smithi110 ceph-mon[28069]: pgmap v19715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:27 smithi193 ceph-mon[32782]: pgmap v19716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:27 smithi196 ceph-mon[32572]: pgmap v19716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:27.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:27 smithi110 ceph-mon[28069]: pgmap v19716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36742.589434 secs 2024-04-26T22:00:28.406 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36742.589434 secs 2024-04-26T22:00:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36742.589434 secs 2024-04-26T22:00:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:29 smithi193 ceph-mon[32782]: pgmap v19717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:29 smithi196 ceph-mon[32572]: pgmap v19717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:29 smithi110 ceph-mon[28069]: pgmap v19717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:31 smithi193 ceph-mon[32782]: pgmap v19718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:31 smithi196 ceph-mon[32572]: pgmap v19718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:31 smithi110 ceph-mon[28069]: pgmap v19718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36747.589525 secs 2024-04-26T22:00:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:33 smithi196 ceph-mon[32572]: pgmap v19719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36747.589525 secs 2024-04-26T22:00:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:33 smithi110 ceph-mon[28069]: pgmap v19719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36747.589525 secs 2024-04-26T22:00:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:33 smithi193 ceph-mon[32782]: pgmap v19719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:35 smithi196 ceph-mon[32572]: pgmap v19720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:35 smithi110 ceph-mon[28069]: pgmap v19720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:35 smithi193 ceph-mon[32782]: pgmap v19720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:37 smithi196 ceph-mon[32572]: pgmap v19721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:37 smithi110 ceph-mon[28069]: pgmap v19721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:37 smithi193 ceph-mon[32782]: pgmap v19721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36752.589645 secs 2024-04-26T22:00:38.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36752.589645 secs 2024-04-26T22:00:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36752.589645 secs 2024-04-26T22:00:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:39 smithi196 ceph-mon[32572]: pgmap v19722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:39 smithi110 ceph-mon[28069]: pgmap v19722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:39 smithi193 ceph-mon[32782]: pgmap v19722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:41 smithi196 ceph-mon[32572]: pgmap v19723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:41 smithi110 ceph-mon[28069]: pgmap v19723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:41 smithi193 ceph-mon[32782]: pgmap v19723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36757.589742 secs 2024-04-26T22:00:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:43 smithi196 ceph-mon[32572]: pgmap v19724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36757.589742 secs 2024-04-26T22:00:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:43 smithi110 ceph-mon[28069]: pgmap v19724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36757.589742 secs 2024-04-26T22:00:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:43 smithi193 ceph-mon[32782]: pgmap v19724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:45 smithi196 ceph-mon[32572]: pgmap v19725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:45 smithi110 ceph-mon[28069]: pgmap v19725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:45 smithi193 ceph-mon[32782]: pgmap v19725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:47 smithi196 ceph-mon[32572]: pgmap v19726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:47 smithi110 ceph-mon[28069]: pgmap v19726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:47 smithi193 ceph-mon[32782]: pgmap v19726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36762.589854 secs 2024-04-26T22:00:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36762.589854 secs 2024-04-26T22:00:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36762.589854 secs 2024-04-26T22:00:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:49 smithi196 ceph-mon[32572]: pgmap v19727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:49 smithi110 ceph-mon[28069]: pgmap v19727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:49 smithi193 ceph-mon[32782]: pgmap v19727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:51 smithi196 ceph-mon[32572]: pgmap v19728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:51 smithi110 ceph-mon[28069]: pgmap v19728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:51 smithi193 ceph-mon[32782]: pgmap v19728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:52 smithi196 ceph-mon[32572]: pgmap v19729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:52 smithi110 ceph-mon[28069]: pgmap v19729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:52 smithi193 ceph-mon[32782]: pgmap v19729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36767.589963 secs 2024-04-26T22:00:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36767.589963 secs 2024-04-26T22:00:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36767.589963 secs 2024-04-26T22:00:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:54 smithi196 ceph-mon[32572]: pgmap v19730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:54 smithi110 ceph-mon[28069]: pgmap v19730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:54 smithi193 ceph-mon[32782]: pgmap v19730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:57 smithi193 ceph-mon[32782]: pgmap v19731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:00:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:57 smithi196 ceph-mon[32572]: pgmap v19731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:00:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:57 smithi110 ceph-mon[28069]: pgmap v19731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:00:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:00:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36772.590112 secs 2024-04-26T22:00:58.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36772.590112 secs 2024-04-26T22:00:58.472 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36772.590112 secs 2024-04-26T22:00:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:00:59 smithi193 ceph-mon[32782]: pgmap v19732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:59.440 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:00:59 smithi110 ceph-mon[28069]: pgmap v19732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:00:59 smithi196 ceph-mon[32572]: pgmap v19732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:01 smithi193 ceph-mon[32782]: pgmap v19733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:01 smithi196 ceph-mon[32572]: pgmap v19733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:01 smithi110 ceph-mon[28069]: pgmap v19733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36777.590237 secs 2024-04-26T22:01:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:03 smithi110 ceph-mon[28069]: pgmap v19734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36777.590237 secs 2024-04-26T22:01:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:03 smithi193 ceph-mon[32782]: pgmap v19734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36777.590237 secs 2024-04-26T22:01:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:03 smithi196 ceph-mon[32572]: pgmap v19734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:01:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:01:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:01:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:01:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:04 smithi193 ceph-mon[32782]: pgmap v19735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:01:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:04 smithi193 ceph-mon[32782]: pgmap v19736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:04.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:01:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:01:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:01:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:01:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:01:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:04 smithi196 ceph-mon[32572]: pgmap v19735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:01:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:04 smithi196 ceph-mon[32572]: pgmap v19736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:04.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:01:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:01:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:01:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:01:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:01:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:04 smithi110 ceph-mon[28069]: pgmap v19735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:01:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:04 smithi110 ceph-mon[28069]: pgmap v19736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:01:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:05 smithi196 ceph-mon[32572]: pgmap v19737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:05 smithi110 ceph-mon[28069]: pgmap v19737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:05 smithi193 ceph-mon[32782]: pgmap v19737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:07 smithi196 ceph-mon[32572]: pgmap v19738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 560 B/s rd, 1 op/s 2024-04-26T22:01:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:07 smithi110 ceph-mon[28069]: pgmap v19738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 560 B/s rd, 1 op/s 2024-04-26T22:01:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:07 smithi193 ceph-mon[32782]: pgmap v19738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 560 B/s rd, 1 op/s 2024-04-26T22:01:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36782.590346 secs 2024-04-26T22:01:08.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36782.590346 secs 2024-04-26T22:01:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36782.590346 secs 2024-04-26T22:01:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:09 smithi196 ceph-mon[32572]: pgmap v19739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:09 smithi110 ceph-mon[28069]: pgmap v19739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:09 smithi193 ceph-mon[32782]: pgmap v19739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:11 smithi196 ceph-mon[32572]: pgmap v19740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:11 smithi110 ceph-mon[28069]: pgmap v19740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:11 smithi193 ceph-mon[32782]: pgmap v19740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:01:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36787.590461 secs 2024-04-26T22:01:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36787.590461 secs 2024-04-26T22:01:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36787.590461 secs 2024-04-26T22:01:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:13 smithi110 ceph-mon[28069]: pgmap v19741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:01:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:13 smithi193 ceph-mon[32782]: pgmap v19741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:01:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:13 smithi196 ceph-mon[32572]: pgmap v19741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:01:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:15 smithi196 ceph-mon[32572]: pgmap v19742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:15 smithi110 ceph-mon[28069]: pgmap v19742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:15 smithi193 ceph-mon[32782]: pgmap v19742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:17 smithi196 ceph-mon[32572]: pgmap v19743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:17 smithi110 ceph-mon[28069]: pgmap v19743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:17 smithi193 ceph-mon[32782]: pgmap v19743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36792.590598 secs 2024-04-26T22:01:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36792.590598 secs 2024-04-26T22:01:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36792.590598 secs 2024-04-26T22:01:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:19 smithi196 ceph-mon[32572]: pgmap v19744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:19.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:19 smithi110 ceph-mon[28069]: pgmap v19744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:19 smithi193 ceph-mon[32782]: pgmap v19744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:21 smithi196 ceph-mon[32572]: pgmap v19745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:21 smithi110 ceph-mon[28069]: pgmap v19745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:21 smithi193 ceph-mon[32782]: pgmap v19745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36797.590715 secs 2024-04-26T22:01:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36797.590715 secs 2024-04-26T22:01:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36797.590715 secs 2024-04-26T22:01:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:23 smithi110 ceph-mon[28069]: pgmap v19746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:24.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:23 smithi193 ceph-mon[32782]: pgmap v19746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:23 smithi196 ceph-mon[32572]: pgmap v19746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:25 smithi196 ceph-mon[32572]: pgmap v19747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:25 smithi110 ceph-mon[28069]: pgmap v19747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:25 smithi193 ceph-mon[32782]: pgmap v19747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:27 smithi196 ceph-mon[32572]: pgmap v19748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:27 smithi110 ceph-mon[28069]: pgmap v19748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:27 smithi193 ceph-mon[32782]: pgmap v19748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36802.590800 secs 2024-04-26T22:01:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36802.590800 secs 2024-04-26T22:01:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36802.590800 secs 2024-04-26T22:01:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:29 smithi110 ceph-mon[28069]: pgmap v19749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:29 smithi193 ceph-mon[32782]: pgmap v19749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:29 smithi196 ceph-mon[32572]: pgmap v19749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:31 smithi196 ceph-mon[32572]: pgmap v19750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:31 smithi110 ceph-mon[28069]: pgmap v19750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:31.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:31 smithi193 ceph-mon[32782]: pgmap v19750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36807.590887 secs 2024-04-26T22:01:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36807.590887 secs 2024-04-26T22:01:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36807.590887 secs 2024-04-26T22:01:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:33 smithi110 ceph-mon[28069]: pgmap v19751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:33 smithi193 ceph-mon[32782]: pgmap v19751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:33 smithi196 ceph-mon[32572]: pgmap v19751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:35 smithi196 ceph-mon[32572]: pgmap v19752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:35 smithi110 ceph-mon[28069]: pgmap v19752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:35 smithi193 ceph-mon[32782]: pgmap v19752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:37 smithi196 ceph-mon[32572]: pgmap v19753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:37 smithi110 ceph-mon[28069]: pgmap v19753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:37 smithi193 ceph-mon[32782]: pgmap v19753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36812.590984 secs 2024-04-26T22:01:38.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36812.590984 secs 2024-04-26T22:01:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36812.590984 secs 2024-04-26T22:01:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:39 smithi110 ceph-mon[28069]: pgmap v19754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:39 smithi193 ceph-mon[32782]: pgmap v19754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:39 smithi196 ceph-mon[32572]: pgmap v19754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:41 smithi196 ceph-mon[32572]: pgmap v19755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:41 smithi110 ceph-mon[28069]: pgmap v19755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:41 smithi193 ceph-mon[32782]: pgmap v19755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36817.591076 secs 2024-04-26T22:01:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36817.591076 secs 2024-04-26T22:01:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36817.591076 secs 2024-04-26T22:01:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:43 smithi110 ceph-mon[28069]: pgmap v19756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:43 smithi193 ceph-mon[32782]: pgmap v19756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:43 smithi196 ceph-mon[32572]: pgmap v19756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:45 smithi196 ceph-mon[32572]: pgmap v19757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:45 smithi110 ceph-mon[28069]: pgmap v19757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:45 smithi193 ceph-mon[32782]: pgmap v19757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:47 smithi196 ceph-mon[32572]: pgmap v19758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:47 smithi110 ceph-mon[28069]: pgmap v19758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:47 smithi193 ceph-mon[32782]: pgmap v19758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36822.591157 secs 2024-04-26T22:01:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36822.591157 secs 2024-04-26T22:01:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36822.591157 secs 2024-04-26T22:01:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:49 smithi110 ceph-mon[28069]: pgmap v19759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:49 smithi193 ceph-mon[32782]: pgmap v19759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:49 smithi196 ceph-mon[32572]: pgmap v19759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:51 smithi196 ceph-mon[32572]: pgmap v19760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:51 smithi110 ceph-mon[28069]: pgmap v19760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:51 smithi193 ceph-mon[32782]: pgmap v19760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36827.591275 secs 2024-04-26T22:01:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36827.591275 secs 2024-04-26T22:01:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36827.591275 secs 2024-04-26T22:01:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:53 smithi110 ceph-mon[28069]: pgmap v19761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:53 smithi193 ceph-mon[32782]: pgmap v19761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:53 smithi196 ceph-mon[32572]: pgmap v19761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:55 smithi196 ceph-mon[32572]: pgmap v19762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:55 smithi110 ceph-mon[28069]: pgmap v19762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:55 smithi193 ceph-mon[32782]: pgmap v19762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:57 smithi196 ceph-mon[32572]: pgmap v19763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:57 smithi110 ceph-mon[28069]: pgmap v19763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:57 smithi193 ceph-mon[32782]: pgmap v19763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:01:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36832.591397 secs 2024-04-26T22:01:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36832.591397 secs 2024-04-26T22:01:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36832.591397 secs 2024-04-26T22:01:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:01:59 smithi110 ceph-mon[28069]: pgmap v19764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:01:59 smithi193 ceph-mon[32782]: pgmap v19764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:01:59 smithi196 ceph-mon[32572]: pgmap v19764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:01 smithi196 ceph-mon[32572]: pgmap v19765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:01 smithi110 ceph-mon[28069]: pgmap v19765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:01 smithi193 ceph-mon[32782]: pgmap v19765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36837.591535 secs 2024-04-26T22:02:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36837.591535 secs 2024-04-26T22:02:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36837.591535 secs 2024-04-26T22:02:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:03 smithi110 ceph-mon[28069]: pgmap v19766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:02:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:03 smithi193 ceph-mon[32782]: pgmap v19766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:02:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:03 smithi196 ceph-mon[32572]: pgmap v19766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:02:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:02:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:02:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:02:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:02:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:02:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:02:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:02:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:02:05.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:02:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:05 smithi110 ceph-mon[28069]: pgmap v19767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T22:02:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:05 smithi110 ceph-mon[28069]: pgmap v19768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:05 smithi193 ceph-mon[32782]: pgmap v19767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T22:02:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:05 smithi193 ceph-mon[32782]: pgmap v19768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:05 smithi196 ceph-mon[32572]: pgmap v19767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T22:02:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:05 smithi196 ceph-mon[32572]: pgmap v19768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:07 smithi110 ceph-mon[28069]: pgmap v19769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36842.591654 secs 2024-04-26T22:02:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:07 smithi193 ceph-mon[32782]: pgmap v19769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36842.591654 secs 2024-04-26T22:02:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:07 smithi196 ceph-mon[32572]: pgmap v19769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36842.591654 secs 2024-04-26T22:02:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:09 smithi193 ceph-mon[32782]: pgmap v19770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:09 smithi196 ceph-mon[32572]: pgmap v19770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:09 smithi110 ceph-mon[28069]: pgmap v19770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:11 smithi193 ceph-mon[32782]: pgmap v19771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:11 smithi196 ceph-mon[32572]: pgmap v19771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:11 smithi110 ceph-mon[28069]: pgmap v19771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36847.591773 secs 2024-04-26T22:02:14.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:13 smithi196 ceph-mon[32572]: pgmap v19772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36847.591773 secs 2024-04-26T22:02:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:13 smithi110 ceph-mon[28069]: pgmap v19772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36847.591773 secs 2024-04-26T22:02:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:13 smithi193 ceph-mon[32782]: pgmap v19772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:15 smithi196 ceph-mon[32572]: pgmap v19773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:02:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:15 smithi110 ceph-mon[28069]: pgmap v19773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:02:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:15 smithi193 ceph-mon[32782]: pgmap v19773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:02:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:17 smithi196 ceph-mon[32572]: pgmap v19774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:17 smithi110 ceph-mon[28069]: pgmap v19774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:17 smithi193 ceph-mon[32782]: pgmap v19774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36852.591897 secs 2024-04-26T22:02:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36852.591897 secs 2024-04-26T22:02:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36852.591897 secs 2024-04-26T22:02:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:19 smithi196 ceph-mon[32572]: pgmap v19775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:19 smithi110 ceph-mon[28069]: pgmap v19775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:19 smithi193 ceph-mon[32782]: pgmap v19775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:21 smithi196 ceph-mon[32572]: pgmap v19776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:21 smithi110 ceph-mon[28069]: pgmap v19776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:21 smithi193 ceph-mon[32782]: pgmap v19776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36857.591961 secs 2024-04-26T22:02:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36857.591961 secs 2024-04-26T22:02:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36857.591961 secs 2024-04-26T22:02:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:23 smithi196 ceph-mon[32572]: pgmap v19777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:23 smithi110 ceph-mon[28069]: pgmap v19777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:23 smithi193 ceph-mon[32782]: pgmap v19777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:25 smithi196 ceph-mon[32572]: pgmap v19778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:25 smithi110 ceph-mon[28069]: pgmap v19778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:25 smithi193 ceph-mon[32782]: pgmap v19778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:27 smithi196 ceph-mon[32572]: pgmap v19779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36862.592081 secs 2024-04-26T22:02:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:27 smithi110 ceph-mon[28069]: pgmap v19779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36862.592081 secs 2024-04-26T22:02:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:27 smithi193 ceph-mon[32782]: pgmap v19779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36862.592081 secs 2024-04-26T22:02:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:29 smithi196 ceph-mon[32572]: pgmap v19780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:29 smithi110 ceph-mon[28069]: pgmap v19780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:29 smithi193 ceph-mon[32782]: pgmap v19780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:31 smithi110 ceph-mon[28069]: pgmap v19781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:31 smithi193 ceph-mon[32782]: pgmap v19781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:31 smithi196 ceph-mon[32572]: pgmap v19781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36867.592179 secs 2024-04-26T22:02:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36867.592179 secs 2024-04-26T22:02:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36867.592179 secs 2024-04-26T22:02:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:33 smithi110 ceph-mon[28069]: pgmap v19782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:33 smithi193 ceph-mon[32782]: pgmap v19782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:33 smithi196 ceph-mon[32572]: pgmap v19782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:35 smithi110 ceph-mon[28069]: pgmap v19783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:35 smithi193 ceph-mon[32782]: pgmap v19783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:35 smithi196 ceph-mon[32572]: pgmap v19783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:37 smithi110 ceph-mon[28069]: pgmap v19784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36872.592293 secs 2024-04-26T22:02:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:37 smithi193 ceph-mon[32782]: pgmap v19784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36872.592293 secs 2024-04-26T22:02:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:37 smithi196 ceph-mon[32572]: pgmap v19784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36872.592293 secs 2024-04-26T22:02:40.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:39 smithi110 ceph-mon[28069]: pgmap v19785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:39 smithi193 ceph-mon[32782]: pgmap v19785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:39 smithi196 ceph-mon[32572]: pgmap v19785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:41 smithi110 ceph-mon[28069]: pgmap v19786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:41 smithi193 ceph-mon[32782]: pgmap v19786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:41 smithi196 ceph-mon[32572]: pgmap v19786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36877.592413 secs 2024-04-26T22:02:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36877.592413 secs 2024-04-26T22:02:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36877.592413 secs 2024-04-26T22:02:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:43 smithi193 ceph-mon[32782]: pgmap v19787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:43 smithi196 ceph-mon[32572]: pgmap v19787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:43 smithi110 ceph-mon[28069]: pgmap v19787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:45 smithi193 ceph-mon[32782]: pgmap v19788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:02:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:45 smithi196 ceph-mon[32572]: pgmap v19788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:02:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:45 smithi110 ceph-mon[28069]: pgmap v19788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:02:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:47 smithi193 ceph-mon[32782]: pgmap v19789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:02:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36882.592511 secs 2024-04-26T22:02:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:47 smithi196 ceph-mon[32572]: pgmap v19789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:02:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36882.592511 secs 2024-04-26T22:02:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:47 smithi110 ceph-mon[28069]: pgmap v19789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:02:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36882.592511 secs 2024-04-26T22:02:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:49 smithi193 ceph-mon[32782]: pgmap v19790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:49 smithi196 ceph-mon[32572]: pgmap v19790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:49 smithi110 ceph-mon[28069]: pgmap v19790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:51 smithi193 ceph-mon[32782]: pgmap v19791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:02:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:51 smithi196 ceph-mon[32572]: pgmap v19791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:02:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:51 smithi110 ceph-mon[28069]: pgmap v19791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:02:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36887.592620 secs 2024-04-26T22:02:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36887.592620 secs 2024-04-26T22:02:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36887.592620 secs 2024-04-26T22:02:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:53 smithi193 ceph-mon[32782]: pgmap v19792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:53 smithi196 ceph-mon[32572]: pgmap v19792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:53 smithi110 ceph-mon[28069]: pgmap v19792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:02:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:55 smithi193 ceph-mon[32782]: pgmap v19793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:55 smithi196 ceph-mon[32572]: pgmap v19793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:55 smithi110 ceph-mon[28069]: pgmap v19793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:57 smithi193 ceph-mon[32782]: pgmap v19794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36892.592758 secs 2024-04-26T22:02:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:57 smithi196 ceph-mon[32572]: pgmap v19794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36892.592758 secs 2024-04-26T22:02:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:57 smithi110 ceph-mon[28069]: pgmap v19794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:02:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36892.592758 secs 2024-04-26T22:03:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:02:59 smithi193 ceph-mon[32782]: pgmap v19795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:02:59 smithi196 ceph-mon[32572]: pgmap v19795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:02:59 smithi110 ceph-mon[28069]: pgmap v19795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:01 smithi193 ceph-mon[32782]: pgmap v19796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:01 smithi196 ceph-mon[32572]: pgmap v19796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:01 smithi110 ceph-mon[28069]: pgmap v19796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36897.592876 secs 2024-04-26T22:03:03.193 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36897.592876 secs 2024-04-26T22:03:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36897.592876 secs 2024-04-26T22:03:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:03 smithi196 ceph-mon[32572]: pgmap v19797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:03 smithi110 ceph-mon[28069]: pgmap v19797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:03 smithi193 ceph-mon[32782]: pgmap v19797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:05 smithi196 ceph-mon[32572]: pgmap v19798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:03:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:03:06.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:03:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:05 smithi110 ceph-mon[28069]: pgmap v19798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:03:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:03:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:03:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:05 smithi193 ceph-mon[32782]: pgmap v19798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:03:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:03:06.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:03:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:07 smithi196 ceph-mon[32572]: pgmap v19799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36902.592962 secs 2024-04-26T22:03:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:03:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:03:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:07 smithi196 ceph-mon[32572]: pgmap v19800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T22:03:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:07 smithi196 ceph-mon[32572]: pgmap v19801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:03:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:03:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:07 smithi110 ceph-mon[28069]: pgmap v19799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36902.592962 secs 2024-04-26T22:03:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:03:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:03:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:07 smithi110 ceph-mon[28069]: pgmap v19800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T22:03:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:07 smithi110 ceph-mon[28069]: pgmap v19801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:03:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:03:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:07 smithi193 ceph-mon[32782]: pgmap v19799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36902.592962 secs 2024-04-26T22:03:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:03:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:03:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:07 smithi193 ceph-mon[32782]: pgmap v19800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T22:03:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:07 smithi193 ceph-mon[32782]: pgmap v19801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:03:08.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:03:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:10 smithi196 ceph-mon[32572]: pgmap v19802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:10 smithi110 ceph-mon[28069]: pgmap v19802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:10 smithi193 ceph-mon[32782]: pgmap v19802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:12 smithi196 ceph-mon[32572]: pgmap v19803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:03:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:12 smithi110 ceph-mon[28069]: pgmap v19803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:03:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:12 smithi193 ceph-mon[32782]: pgmap v19803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:03:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:13 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 36907.593077 secs 2024-04-26T22:03:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:13 smithi196 ceph-mon[32572]: slow request 23044.929210 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:03:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:13 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 36907.593077 secs 2024-04-26T22:03:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:13 smithi110 ceph-mon[28069]: slow request 23044.929210 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:03:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:13 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 36907.593077 secs 2024-04-26T22:03:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:13 smithi193 ceph-mon[32782]: slow request 23044.929210 seconds old, received at 2024-04-26T15:39:06.962189+0000: client_request(client.16572:1 getattr pAsLsXsFs #0x1 2024-04-26T15:39:06.957123+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:03:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:14 smithi196 ceph-mon[32572]: pgmap v19804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:14 smithi110 ceph-mon[28069]: pgmap v19804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:14 smithi193 ceph-mon[32782]: pgmap v19804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.476+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T22:03:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.476+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:03:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.476+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:03:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.476+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T22:03:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.477+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.479+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T22:03:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.479+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T22:03:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:16 smithi196 ceph-mon[32572]: pgmap v19805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.508+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T22:03:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.508+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T22:03:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.508+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:03:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.508+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261401e000 comp rx=0 tx=0).stop 2024-04-26T22:03:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.508+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T22:03:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.508+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T22:03:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.508+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.508+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.509+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:16.510+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614058000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:16 smithi110 ceph-mon[28069]: pgmap v19805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:16 smithi193 ceph-mon[32782]: pgmap v19805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36912.593193 secs 2024-04-26T22:03:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:18 smithi196 ceph-mon[32572]: pgmap v19806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:03:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36912.593193 secs 2024-04-26T22:03:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:18 smithi110 ceph-mon[28069]: pgmap v19806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:03:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36912.593193 secs 2024-04-26T22:03:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:18 smithi193 ceph-mon[32782]: pgmap v19806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:03:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:20 smithi196 ceph-mon[32572]: pgmap v19807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:20 smithi110 ceph-mon[28069]: pgmap v19807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:20 smithi193 ceph-mon[32782]: pgmap v19807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:22.494+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T22:03:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:22.494+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:03:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:22.495+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 284 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:03:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:03:22.495+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 284 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T22:03:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:22 smithi196 ceph-mon[32572]: pgmap v19808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:22 smithi110 ceph-mon[28069]: pgmap v19808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:22 smithi193 ceph-mon[32782]: pgmap v19808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36917.593266 secs 2024-04-26T22:03:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36917.593266 secs 2024-04-26T22:03:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36917.593266 secs 2024-04-26T22:03:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:24 smithi196 ceph-mon[32572]: pgmap v19809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:24 smithi110 ceph-mon[28069]: pgmap v19809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:24 smithi193 ceph-mon[32782]: pgmap v19809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:26 smithi196 ceph-mon[32572]: pgmap v19810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:26 smithi110 ceph-mon[28069]: pgmap v19810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:26 smithi193 ceph-mon[32782]: pgmap v19810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36922.593381 secs 2024-04-26T22:03:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:28 smithi196 ceph-mon[32572]: pgmap v19811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36922.593381 secs 2024-04-26T22:03:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:28 smithi110 ceph-mon[28069]: pgmap v19811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36922.593381 secs 2024-04-26T22:03:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:28 smithi193 ceph-mon[32782]: pgmap v19811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:30 smithi196 ceph-mon[32572]: pgmap v19812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:30 smithi110 ceph-mon[28069]: pgmap v19812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:30 smithi193 ceph-mon[32782]: pgmap v19812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:32 smithi196 ceph-mon[32572]: pgmap v19813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:32 smithi110 ceph-mon[28069]: pgmap v19813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:32 smithi193 ceph-mon[32782]: pgmap v19813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36927.593503 secs 2024-04-26T22:03:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36927.593503 secs 2024-04-26T22:03:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36927.593503 secs 2024-04-26T22:03:34.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:34 smithi196 ceph-mon[32572]: pgmap v19814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:34 smithi110 ceph-mon[28069]: pgmap v19814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:34 smithi193 ceph-mon[32782]: pgmap v19814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:36 smithi196 ceph-mon[32572]: pgmap v19815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:36 smithi110 ceph-mon[28069]: pgmap v19815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:36 smithi193 ceph-mon[32782]: pgmap v19815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36932.593646 secs 2024-04-26T22:03:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:38 smithi196 ceph-mon[32572]: pgmap v19816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36932.593646 secs 2024-04-26T22:03:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:38 smithi110 ceph-mon[28069]: pgmap v19816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36932.593646 secs 2024-04-26T22:03:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:38 smithi193 ceph-mon[32782]: pgmap v19816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:39 smithi196 ceph-mon[32572]: pgmap v19817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:39 smithi110 ceph-mon[28069]: pgmap v19817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:39 smithi193 ceph-mon[32782]: pgmap v19817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:42 smithi196 ceph-mon[32572]: pgmap v19818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:42 smithi110 ceph-mon[28069]: pgmap v19818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:42 smithi193 ceph-mon[32782]: pgmap v19818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36937.593786 secs 2024-04-26T22:03:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36937.593786 secs 2024-04-26T22:03:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36937.593786 secs 2024-04-26T22:03:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:44 smithi196 ceph-mon[32572]: pgmap v19819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:44 smithi110 ceph-mon[28069]: pgmap v19819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:44 smithi193 ceph-mon[32782]: pgmap v19819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:46 smithi196 ceph-mon[32572]: pgmap v19820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:46 smithi110 ceph-mon[28069]: pgmap v19820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:46 smithi193 ceph-mon[32782]: pgmap v19820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:48.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36942.593852 secs 2024-04-26T22:03:48.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:48 smithi196 ceph-mon[32572]: pgmap v19821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36942.593852 secs 2024-04-26T22:03:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:48 smithi110 ceph-mon[28069]: pgmap v19821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36942.593852 secs 2024-04-26T22:03:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:48 smithi193 ceph-mon[32782]: pgmap v19821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:50 smithi196 ceph-mon[32572]: pgmap v19822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:50 smithi110 ceph-mon[28069]: pgmap v19822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:50 smithi193 ceph-mon[32782]: pgmap v19822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:52 smithi196 ceph-mon[32572]: pgmap v19823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:52 smithi110 ceph-mon[28069]: pgmap v19823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:52 smithi193 ceph-mon[32782]: pgmap v19823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36947.593947 secs 2024-04-26T22:03:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36947.593947 secs 2024-04-26T22:03:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36947.593947 secs 2024-04-26T22:03:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:54 smithi196 ceph-mon[32572]: pgmap v19824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:54 smithi110 ceph-mon[28069]: pgmap v19824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:54 smithi193 ceph-mon[32782]: pgmap v19824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:03:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:56 smithi196 ceph-mon[32572]: pgmap v19825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:56 smithi110 ceph-mon[28069]: pgmap v19825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:56 smithi193 ceph-mon[32782]: pgmap v19825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36952.594071 secs 2024-04-26T22:03:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:03:58 smithi196 ceph-mon[32572]: pgmap v19826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36952.594071 secs 2024-04-26T22:03:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:03:58 smithi110 ceph-mon[28069]: pgmap v19826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36952.594071 secs 2024-04-26T22:03:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:03:58 smithi193 ceph-mon[32782]: pgmap v19826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:00 smithi196 ceph-mon[32572]: pgmap v19827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:00 smithi110 ceph-mon[28069]: pgmap v19827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:00 smithi193 ceph-mon[32782]: pgmap v19827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:02 smithi196 ceph-mon[32572]: pgmap v19828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:02 smithi110 ceph-mon[28069]: pgmap v19828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:02 smithi193 ceph-mon[32782]: pgmap v19828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36957.594204 secs 2024-04-26T22:04:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36957.594204 secs 2024-04-26T22:04:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36957.594204 secs 2024-04-26T22:04:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:04 smithi196 ceph-mon[32572]: pgmap v19829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:04 smithi110 ceph-mon[28069]: pgmap v19829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:04 smithi193 ceph-mon[32782]: pgmap v19829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:05 smithi196 ceph-mon[32572]: pgmap v19830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:05 smithi110 ceph-mon[28069]: pgmap v19830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:05 smithi193 ceph-mon[32782]: pgmap v19830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36962.594327 secs 2024-04-26T22:04:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:08 smithi196 ceph-mon[32572]: pgmap v19831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:08 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:04:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:08 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36962.594327 secs 2024-04-26T22:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:08 smithi110 ceph-mon[28069]: pgmap v19831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:08 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:08 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36962.594327 secs 2024-04-26T22:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:08 smithi193 ceph-mon[32782]: pgmap v19831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:08 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:08 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:04:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:04:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:04:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:04:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:04:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:04:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:04:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:10 smithi196 ceph-mon[32572]: pgmap v19832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:04:10.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:10 smithi196 ceph-mon[32572]: pgmap v19833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:10 smithi110 ceph-mon[28069]: pgmap v19832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:04:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:10 smithi110 ceph-mon[28069]: pgmap v19833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:10 smithi193 ceph-mon[32782]: pgmap v19832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:04:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:10 smithi193 ceph-mon[32782]: pgmap v19833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:12.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:12 smithi193 ceph-mon[32782]: pgmap v19834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:12 smithi196 ceph-mon[32572]: pgmap v19834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:12 smithi110 ceph-mon[28069]: pgmap v19834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36967.594458 secs 2024-04-26T22:04:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36967.594458 secs 2024-04-26T22:04:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36967.594458 secs 2024-04-26T22:04:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:14 smithi196 ceph-mon[32572]: pgmap v19835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:14 smithi110 ceph-mon[28069]: pgmap v19835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:14 smithi193 ceph-mon[32782]: pgmap v19835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:16 smithi196 ceph-mon[32572]: pgmap v19836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:16 smithi110 ceph-mon[28069]: pgmap v19836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:16 smithi193 ceph-mon[32782]: pgmap v19836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:18 smithi196 ceph-mon[32572]: pgmap v19837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36972.594593 secs 2024-04-26T22:04:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:18 smithi110 ceph-mon[28069]: pgmap v19837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36972.594593 secs 2024-04-26T22:04:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:04:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:04:18.235+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:04:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:04:18.235+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:04:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:04:18.235+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:04:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:04:18.235+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:04:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:04:18.235+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:18 smithi193 ceph-mon[32782]: pgmap v19837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:04:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36972.594593 secs 2024-04-26T22:04:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:20 smithi196 ceph-mon[32572]: pgmap v19838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:04:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:20 smithi110 ceph-mon[28069]: pgmap v19838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:04:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:20 smithi193 ceph-mon[32782]: pgmap v19838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:04:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:22 smithi196 ceph-mon[32572]: pgmap v19839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:22 smithi110 ceph-mon[28069]: pgmap v19839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:22 smithi193 ceph-mon[32782]: pgmap v19839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36977.594656 secs 2024-04-26T22:04:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36977.594656 secs 2024-04-26T22:04:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36977.594656 secs 2024-04-26T22:04:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:24 smithi196 ceph-mon[32572]: pgmap v19840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:04:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:24 smithi110 ceph-mon[28069]: pgmap v19840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:04:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:24 smithi193 ceph-mon[32782]: pgmap v19840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:04:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:26 smithi196 ceph-mon[32572]: pgmap v19841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:04:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:26 smithi110 ceph-mon[28069]: pgmap v19841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:04:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:26 smithi193 ceph-mon[32782]: pgmap v19841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:04:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:28 smithi196 ceph-mon[32572]: pgmap v19842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:04:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36982.594781 secs 2024-04-26T22:04:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:28 smithi110 ceph-mon[28069]: pgmap v19842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:04:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36982.594781 secs 2024-04-26T22:04:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:28 smithi193 ceph-mon[32782]: pgmap v19842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:04:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36982.594781 secs 2024-04-26T22:04:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:29 smithi110 ceph-mon[28069]: pgmap v19843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:04:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:29 smithi193 ceph-mon[32782]: pgmap v19843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:04:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:29 smithi196 ceph-mon[32572]: pgmap v19843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:04:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:31 smithi193 ceph-mon[32782]: pgmap v19844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:04:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:31 smithi196 ceph-mon[32572]: pgmap v19844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:04:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:31 smithi110 ceph-mon[28069]: pgmap v19844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:04:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36987.594902 secs 2024-04-26T22:04:33.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36987.594902 secs 2024-04-26T22:04:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36987.594902 secs 2024-04-26T22:04:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:33 smithi193 ceph-mon[32782]: pgmap v19845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:04:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:33 smithi196 ceph-mon[32572]: pgmap v19845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:04:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:33 smithi110 ceph-mon[28069]: pgmap v19845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:04:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:35 smithi193 ceph-mon[32782]: pgmap v19846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:35 smithi196 ceph-mon[32572]: pgmap v19846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:35 smithi110 ceph-mon[28069]: pgmap v19846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:37 smithi193 ceph-mon[32782]: pgmap v19847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36992.595041 secs 2024-04-26T22:04:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:37 smithi196 ceph-mon[32572]: pgmap v19847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36992.595041 secs 2024-04-26T22:04:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:37 smithi110 ceph-mon[28069]: pgmap v19847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36992.595041 secs 2024-04-26T22:04:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:39 smithi193 ceph-mon[32782]: pgmap v19848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:39 smithi196 ceph-mon[32572]: pgmap v19848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:39 smithi110 ceph-mon[28069]: pgmap v19848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:41 smithi193 ceph-mon[32782]: pgmap v19849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:41 smithi196 ceph-mon[32572]: pgmap v19849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:41 smithi110 ceph-mon[28069]: pgmap v19849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 36997.595164 secs 2024-04-26T22:04:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 36997.595164 secs 2024-04-26T22:04:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 36997.595164 secs 2024-04-26T22:04:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:43 smithi193 ceph-mon[32782]: pgmap v19850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:43 smithi196 ceph-mon[32572]: pgmap v19850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:43 smithi110 ceph-mon[28069]: pgmap v19850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:45 smithi193 ceph-mon[32782]: pgmap v19851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:46.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:45 smithi196 ceph-mon[32572]: pgmap v19851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:45 smithi110 ceph-mon[28069]: pgmap v19851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:47 smithi193 ceph-mon[32782]: pgmap v19852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37002.595263 secs 2024-04-26T22:04:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:47 smithi196 ceph-mon[32572]: pgmap v19852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37002.595263 secs 2024-04-26T22:04:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:47 smithi110 ceph-mon[28069]: pgmap v19852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37002.595263 secs 2024-04-26T22:04:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:49 smithi193 ceph-mon[32782]: pgmap v19853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:49 smithi196 ceph-mon[32572]: pgmap v19853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:49 smithi110 ceph-mon[28069]: pgmap v19853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:51 smithi196 ceph-mon[32572]: pgmap v19854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:51 smithi110 ceph-mon[28069]: pgmap v19854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:51 smithi193 ceph-mon[32782]: pgmap v19854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37007.595388 secs 2024-04-26T22:04:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37007.595388 secs 2024-04-26T22:04:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37007.595388 secs 2024-04-26T22:04:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:53 smithi196 ceph-mon[32572]: pgmap v19855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:53 smithi110 ceph-mon[28069]: pgmap v19855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:53 smithi193 ceph-mon[32782]: pgmap v19855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:04:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:55 smithi196 ceph-mon[32572]: pgmap v19856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:55 smithi110 ceph-mon[28069]: pgmap v19856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:55 smithi193 ceph-mon[32782]: pgmap v19856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:57 smithi196 ceph-mon[32572]: pgmap v19857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37012.595475 secs 2024-04-26T22:04:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:57 smithi110 ceph-mon[28069]: pgmap v19857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37012.595475 secs 2024-04-26T22:04:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:57 smithi193 ceph-mon[32782]: pgmap v19857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:04:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37012.595475 secs 2024-04-26T22:05:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:04:59 smithi196 ceph-mon[32572]: pgmap v19858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:04:59 smithi110 ceph-mon[28069]: pgmap v19858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:04:59 smithi193 ceph-mon[32782]: pgmap v19858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:01 smithi196 ceph-mon[32572]: pgmap v19859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:01 smithi110 ceph-mon[28069]: pgmap v19859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:01 smithi193 ceph-mon[32782]: pgmap v19859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:03.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37017.595591 secs 2024-04-26T22:05:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37017.595591 secs 2024-04-26T22:05:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37017.595591 secs 2024-04-26T22:05:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:03 smithi196 ceph-mon[32572]: pgmap v19860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:05:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:03 smithi110 ceph-mon[28069]: pgmap v19860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:05:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:03 smithi193 ceph-mon[32782]: pgmap v19860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:05:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:05 smithi196 ceph-mon[32572]: pgmap v19861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:05:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:05 smithi110 ceph-mon[28069]: pgmap v19861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:05:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:05 smithi193 ceph-mon[32782]: pgmap v19861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:05:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:07 smithi196 ceph-mon[32572]: pgmap v19862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:05:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37022.595692 secs 2024-04-26T22:05:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:07 smithi110 ceph-mon[28069]: pgmap v19862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:05:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37022.595692 secs 2024-04-26T22:05:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:07 smithi193 ceph-mon[32782]: pgmap v19862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:05:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37022.595692 secs 2024-04-26T22:05:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:09 smithi193 ceph-mon[32782]: pgmap v19863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:05:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:09 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:05:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:09 smithi196 ceph-mon[32572]: pgmap v19863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:05:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:09 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:05:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:09 smithi110 ceph-mon[28069]: pgmap v19863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:05:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:09 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:05:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:12 smithi196 ceph-mon[32572]: pgmap v19864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:05:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:12 smithi110 ceph-mon[28069]: pgmap v19864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:05:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:12 smithi193 ceph-mon[32782]: pgmap v19864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37027.595766 secs 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:05:13.524 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: pgmap v19865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.525 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:13 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37027.595766 secs 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: pgmap v19865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:13 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37027.595766 secs 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:05:13.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:05:13.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:05:13.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: pgmap v19865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:05:13.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:13.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:13 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: pgmap v19866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:05:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:05:16.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:05:16.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: pgmap v19867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 988 B/s rd, 1 op/s 2024-04-26T22:05:16.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: pgmap v19868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:16.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: pgmap v19866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:05:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:05:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:05:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:05:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: pgmap v19867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 988 B/s rd, 1 op/s 2024-04-26T22:05:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: pgmap v19868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: pgmap v19866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: pgmap v19867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 988 B/s rd, 1 op/s 2024-04-26T22:05:16.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: pgmap v19868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:16.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:05:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:18 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 37032.595892 secs 2024-04-26T22:05:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:18 smithi196 ceph-mon[32572]: slow request 5761.551354 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:05:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:18 smithi196 ceph-mon[32572]: pgmap v19869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T22:05:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:18 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 37032.595892 secs 2024-04-26T22:05:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:18 smithi110 ceph-mon[28069]: slow request 5761.551354 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:05:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:18 smithi110 ceph-mon[28069]: pgmap v19869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T22:05:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:18 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 37032.595892 secs 2024-04-26T22:05:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:18 smithi193 ceph-mon[32782]: slow request 5761.551354 seconds old, received at 2024-04-26T20:29:15.342860+0000: client_request(client.27155:1 getattr pAsLsXsFs #0x1 2024-04-26T20:29:15.337691+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:05:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:18 smithi193 ceph-mon[32782]: pgmap v19869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T22:05:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:20 smithi196 ceph-mon[32572]: pgmap v19870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:20 smithi110 ceph-mon[28069]: pgmap v19870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:20 smithi193 ceph-mon[32782]: pgmap v19870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:22 smithi196 ceph-mon[32572]: pgmap v19871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T22:05:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:22 smithi110 ceph-mon[28069]: pgmap v19871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T22:05:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:22 smithi193 ceph-mon[32782]: pgmap v19871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 612 B/s rd, 1 op/s 2024-04-26T22:05:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37037.596016 secs 2024-04-26T22:05:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37037.596016 secs 2024-04-26T22:05:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37037.596016 secs 2024-04-26T22:05:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:24 smithi196 ceph-mon[32572]: pgmap v19872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:24 smithi110 ceph-mon[28069]: pgmap v19872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:24 smithi193 ceph-mon[32782]: pgmap v19872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:26 smithi196 ceph-mon[32572]: pgmap v19873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:05:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:26 smithi110 ceph-mon[28069]: pgmap v19873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:05:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:26 smithi193 ceph-mon[32782]: pgmap v19873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:05:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37042.596131 secs 2024-04-26T22:05:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:28 smithi196 ceph-mon[32572]: pgmap v19874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37042.596131 secs 2024-04-26T22:05:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:28 smithi110 ceph-mon[28069]: pgmap v19874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37042.596131 secs 2024-04-26T22:05:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:28 smithi193 ceph-mon[32782]: pgmap v19874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:30 smithi196 ceph-mon[32572]: pgmap v19875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:30 smithi110 ceph-mon[28069]: pgmap v19875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:30 smithi193 ceph-mon[32782]: pgmap v19875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:32 smithi196 ceph-mon[32572]: pgmap v19876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:32 smithi110 ceph-mon[28069]: pgmap v19876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:32 smithi193 ceph-mon[32782]: pgmap v19876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:33.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37047.596246 secs 2024-04-26T22:05:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37047.596246 secs 2024-04-26T22:05:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37047.596246 secs 2024-04-26T22:05:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:34 smithi196 ceph-mon[32572]: pgmap v19877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:34 smithi110 ceph-mon[28069]: pgmap v19877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:34 smithi193 ceph-mon[32782]: pgmap v19877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:35 smithi110 ceph-mon[28069]: pgmap v19878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:35 smithi193 ceph-mon[32782]: pgmap v19878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:35 smithi196 ceph-mon[32572]: pgmap v19878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37052.596366 secs 2024-04-26T22:05:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:38 smithi196 ceph-mon[32572]: pgmap v19879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37052.596366 secs 2024-04-26T22:05:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:38 smithi110 ceph-mon[28069]: pgmap v19879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37052.596366 secs 2024-04-26T22:05:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:38 smithi193 ceph-mon[32782]: pgmap v19879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:40 smithi196 ceph-mon[32572]: pgmap v19880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:40 smithi110 ceph-mon[28069]: pgmap v19880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:40 smithi193 ceph-mon[32782]: pgmap v19880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:42 smithi196 ceph-mon[32572]: pgmap v19881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:42 smithi110 ceph-mon[28069]: pgmap v19881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:42 smithi193 ceph-mon[32782]: pgmap v19881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37057.596481 secs 2024-04-26T22:05:43.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37057.596481 secs 2024-04-26T22:05:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37057.596481 secs 2024-04-26T22:05:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:44 smithi196 ceph-mon[32572]: pgmap v19882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:44 smithi110 ceph-mon[28069]: pgmap v19882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:44 smithi193 ceph-mon[32782]: pgmap v19882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:46 smithi196 ceph-mon[32572]: pgmap v19883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:46 smithi110 ceph-mon[28069]: pgmap v19883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:46 smithi193 ceph-mon[32782]: pgmap v19883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37062.596622 secs 2024-04-26T22:05:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:48 smithi196 ceph-mon[32572]: pgmap v19884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37062.596622 secs 2024-04-26T22:05:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:48 smithi110 ceph-mon[28069]: pgmap v19884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37062.596622 secs 2024-04-26T22:05:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:48 smithi193 ceph-mon[32782]: pgmap v19884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:50 smithi196 ceph-mon[32572]: pgmap v19885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:50 smithi110 ceph-mon[28069]: pgmap v19885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:50 smithi193 ceph-mon[32782]: pgmap v19885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:52 smithi196 ceph-mon[32572]: pgmap v19886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:52 smithi110 ceph-mon[28069]: pgmap v19886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:52 smithi193 ceph-mon[32782]: pgmap v19886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37067.596736 secs 2024-04-26T22:05:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37067.596736 secs 2024-04-26T22:05:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37067.596736 secs 2024-04-26T22:05:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:54 smithi196 ceph-mon[32572]: pgmap v19887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:54 smithi110 ceph-mon[28069]: pgmap v19887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:54 smithi193 ceph-mon[32782]: pgmap v19887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:55 smithi110 ceph-mon[28069]: pgmap v19888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:55 smithi193 ceph-mon[32782]: pgmap v19888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:55 smithi196 ceph-mon[32572]: pgmap v19888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37072.596816 secs 2024-04-26T22:05:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:05:58 smithi196 ceph-mon[32572]: pgmap v19889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37072.596816 secs 2024-04-26T22:05:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:05:58 smithi110 ceph-mon[28069]: pgmap v19889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:05:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37072.596816 secs 2024-04-26T22:05:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:05:58 smithi193 ceph-mon[32782]: pgmap v19889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:00 smithi196 ceph-mon[32572]: pgmap v19890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:00 smithi110 ceph-mon[28069]: pgmap v19890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:00 smithi193 ceph-mon[32782]: pgmap v19890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:02 smithi196 ceph-mon[32572]: pgmap v19891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:02 smithi110 ceph-mon[28069]: pgmap v19891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:02 smithi193 ceph-mon[32782]: pgmap v19891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37077.596932 secs 2024-04-26T22:06:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37077.596932 secs 2024-04-26T22:06:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37077.596932 secs 2024-04-26T22:06:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:04 smithi196 ceph-mon[32572]: pgmap v19892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:04 smithi110 ceph-mon[28069]: pgmap v19892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:04 smithi193 ceph-mon[32782]: pgmap v19892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:06 smithi196 ceph-mon[32572]: pgmap v19893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:06 smithi110 ceph-mon[28069]: pgmap v19893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:06 smithi193 ceph-mon[32782]: pgmap v19893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37082.597051 secs 2024-04-26T22:06:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:08 smithi196 ceph-mon[32572]: pgmap v19894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37082.597051 secs 2024-04-26T22:06:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:08 smithi110 ceph-mon[28069]: pgmap v19894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37082.597051 secs 2024-04-26T22:06:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:08 smithi193 ceph-mon[32782]: pgmap v19894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:10 smithi196 ceph-mon[32572]: pgmap v19895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:10 smithi110 ceph-mon[28069]: pgmap v19895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:10 smithi193 ceph-mon[32782]: pgmap v19895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:11 smithi193 ceph-mon[32782]: pgmap v19896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:11 smithi196 ceph-mon[32572]: pgmap v19896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:11 smithi110 ceph-mon[28069]: pgmap v19896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37087.597166 secs 2024-04-26T22:06:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37087.597166 secs 2024-04-26T22:06:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37087.597166 secs 2024-04-26T22:06:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:13 smithi193 ceph-mon[32782]: pgmap v19897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:13 smithi196 ceph-mon[32572]: pgmap v19897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:13 smithi110 ceph-mon[28069]: pgmap v19897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:16.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:16 smithi196 ceph-mon[32572]: pgmap v19898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:16.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:06:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:16 smithi110 ceph-mon[28069]: pgmap v19898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:06:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:16 smithi193 ceph-mon[32782]: pgmap v19898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:06:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:06:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:06:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:06:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:06:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:06:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:06:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:06:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:06:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:06:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:18 smithi196 ceph-mon[32572]: pgmap v19899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:06:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:18 smithi196 ceph-mon[32572]: pgmap v19900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37092.597263 secs 2024-04-26T22:06:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:18 smithi110 ceph-mon[28069]: pgmap v19899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:06:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:18 smithi110 ceph-mon[28069]: pgmap v19900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37092.597263 secs 2024-04-26T22:06:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:18 smithi193 ceph-mon[32782]: pgmap v19899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:06:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:18 smithi193 ceph-mon[32782]: pgmap v19900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37092.597263 secs 2024-04-26T22:06:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:20 smithi196 ceph-mon[32572]: pgmap v19901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:20 smithi110 ceph-mon[28069]: pgmap v19901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:20 smithi193 ceph-mon[32782]: pgmap v19901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:22 smithi196 ceph-mon[32572]: pgmap v19902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:06:22.525+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:06:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:06:22.525+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T22:06:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:06:22.526+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 285 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T22:06:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:06:22.526+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 285 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:06:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:22 smithi110 ceph-mon[28069]: pgmap v19902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:22 smithi193 ceph-mon[32782]: pgmap v19902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37097.597384 secs 2024-04-26T22:06:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37097.597384 secs 2024-04-26T22:06:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37097.597384 secs 2024-04-26T22:06:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:24 smithi196 ceph-mon[32572]: pgmap v19903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:24 smithi110 ceph-mon[28069]: pgmap v19903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:24 smithi193 ceph-mon[32782]: pgmap v19903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:25 smithi110 ceph-mon[28069]: pgmap v19904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:25 smithi193 ceph-mon[32782]: pgmap v19904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:25 smithi196 ceph-mon[32572]: pgmap v19904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:06:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:27 smithi110 ceph-mon[28069]: pgmap v19905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:06:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37102.597523 secs 2024-04-26T22:06:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:27 smithi193 ceph-mon[32782]: pgmap v19905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:06:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37102.597523 secs 2024-04-26T22:06:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:27 smithi196 ceph-mon[32572]: pgmap v19905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:06:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37102.597523 secs 2024-04-26T22:06:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:29 smithi110 ceph-mon[28069]: pgmap v19906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:29 smithi193 ceph-mon[32782]: pgmap v19906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:29 smithi196 ceph-mon[32572]: pgmap v19906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:31 smithi110 ceph-mon[28069]: pgmap v19907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:32.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:31 smithi196 ceph-mon[32572]: pgmap v19907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:31 smithi193 ceph-mon[32782]: pgmap v19907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37107.597655 secs 2024-04-26T22:06:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37107.597655 secs 2024-04-26T22:06:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37107.597655 secs 2024-04-26T22:06:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:33 smithi110 ceph-mon[28069]: pgmap v19908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:33 smithi193 ceph-mon[32782]: pgmap v19908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:33 smithi196 ceph-mon[32572]: pgmap v19908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:35 smithi110 ceph-mon[28069]: pgmap v19909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:35 smithi193 ceph-mon[32782]: pgmap v19909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:35 smithi196 ceph-mon[32572]: pgmap v19909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:37 smithi193 ceph-mon[32782]: pgmap v19910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37112.597774 secs 2024-04-26T22:06:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:37 smithi196 ceph-mon[32572]: pgmap v19910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37112.597774 secs 2024-04-26T22:06:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:37 smithi110 ceph-mon[28069]: pgmap v19910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37112.597774 secs 2024-04-26T22:06:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:39 smithi193 ceph-mon[32782]: pgmap v19911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:39 smithi196 ceph-mon[32572]: pgmap v19911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:39 smithi110 ceph-mon[28069]: pgmap v19911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:41 smithi193 ceph-mon[32782]: pgmap v19912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:41 smithi196 ceph-mon[32572]: pgmap v19912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:41 smithi110 ceph-mon[28069]: pgmap v19912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37117.597900 secs 2024-04-26T22:06:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37117.597900 secs 2024-04-26T22:06:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37117.597900 secs 2024-04-26T22:06:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:43 smithi193 ceph-mon[32782]: pgmap v19913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:43 smithi196 ceph-mon[32572]: pgmap v19913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:43 smithi110 ceph-mon[28069]: pgmap v19913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:45 smithi193 ceph-mon[32782]: pgmap v19914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:45 smithi196 ceph-mon[32572]: pgmap v19914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:45 smithi110 ceph-mon[28069]: pgmap v19914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:47 smithi193 ceph-mon[32782]: pgmap v19915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37122.598020 secs 2024-04-26T22:06:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:47 smithi196 ceph-mon[32572]: pgmap v19915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37122.598020 secs 2024-04-26T22:06:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:47 smithi110 ceph-mon[28069]: pgmap v19915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37122.598020 secs 2024-04-26T22:06:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:49 smithi193 ceph-mon[32782]: pgmap v19916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:49 smithi196 ceph-mon[32572]: pgmap v19916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:49 smithi110 ceph-mon[28069]: pgmap v19916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:51 smithi193 ceph-mon[32782]: pgmap v19917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:51 smithi196 ceph-mon[32572]: pgmap v19917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:51 smithi110 ceph-mon[28069]: pgmap v19917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37127.598162 secs 2024-04-26T22:06:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37127.598162 secs 2024-04-26T22:06:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37127.598162 secs 2024-04-26T22:06:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:53 smithi193 ceph-mon[32782]: pgmap v19918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:53 smithi196 ceph-mon[32572]: pgmap v19918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:53 smithi110 ceph-mon[28069]: pgmap v19918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:06:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:55 smithi193 ceph-mon[32782]: pgmap v19919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:55 smithi196 ceph-mon[32572]: pgmap v19919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:55 smithi110 ceph-mon[28069]: pgmap v19919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:57 smithi193 ceph-mon[32782]: pgmap v19920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37132.598286 secs 2024-04-26T22:06:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:57 smithi196 ceph-mon[32572]: pgmap v19920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37132.598286 secs 2024-04-26T22:06:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:57 smithi110 ceph-mon[28069]: pgmap v19920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:06:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37132.598286 secs 2024-04-26T22:07:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:06:59 smithi193 ceph-mon[32782]: pgmap v19921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:06:59 smithi196 ceph-mon[32572]: pgmap v19921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:06:59 smithi110 ceph-mon[28069]: pgmap v19921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:01 smithi193 ceph-mon[32782]: pgmap v19922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:01 smithi196 ceph-mon[32572]: pgmap v19922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:01 smithi110 ceph-mon[28069]: pgmap v19922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:03.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37137.598381 secs 2024-04-26T22:07:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37137.598381 secs 2024-04-26T22:07:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37137.598381 secs 2024-04-26T22:07:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:03 smithi196 ceph-mon[32572]: pgmap v19923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:03 smithi110 ceph-mon[28069]: pgmap v19923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:03 smithi193 ceph-mon[32782]: pgmap v19923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:05 smithi196 ceph-mon[32572]: pgmap v19924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:05 smithi110 ceph-mon[28069]: pgmap v19924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:05 smithi193 ceph-mon[32782]: pgmap v19924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:07:07.533+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T22:07:07.533 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:07:07.533+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:07:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:07:07.534+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 286 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:07:07.534 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:07:07.534+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 286 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T22:07:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:07 smithi196 ceph-mon[32572]: pgmap v19925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37142.598501 secs 2024-04-26T22:07:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:07 smithi110 ceph-mon[28069]: pgmap v19925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37142.598501 secs 2024-04-26T22:07:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:07 smithi193 ceph-mon[32782]: pgmap v19925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37142.598501 secs 2024-04-26T22:07:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:09 smithi196 ceph-mon[32572]: pgmap v19926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:09 smithi110 ceph-mon[28069]: pgmap v19926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:09 smithi193 ceph-mon[32782]: pgmap v19926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:11 smithi196 ceph-mon[32572]: pgmap v19927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:12.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:11 smithi110 ceph-mon[28069]: pgmap v19927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:11 smithi193 ceph-mon[32782]: pgmap v19927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37147.598589 secs 2024-04-26T22:07:13.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37147.598589 secs 2024-04-26T22:07:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37147.598589 secs 2024-04-26T22:07:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:13 smithi196 ceph-mon[32572]: pgmap v19928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:13 smithi110 ceph-mon[28069]: pgmap v19928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:13 smithi193 ceph-mon[32782]: pgmap v19928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:15 smithi196 ceph-mon[32572]: pgmap v19929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:15 smithi110 ceph-mon[28069]: pgmap v19929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:15 smithi193 ceph-mon[32782]: pgmap v19929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:17 smithi196 ceph-mon[32572]: pgmap v19930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:17 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 37152.598657 secs 2024-04-26T22:07:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:17 smithi196 ceph-mon[32572]: slow request 2880.013725 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:07:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:07:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:17 smithi110 ceph-mon[28069]: pgmap v19930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:17 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 37152.598657 secs 2024-04-26T22:07:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:17 smithi110 ceph-mon[28069]: slow request 2880.013725 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:07:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:07:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:17 smithi193 ceph-mon[32782]: pgmap v19930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:17 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 37152.598657 secs 2024-04-26T22:07:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:17 smithi193 ceph-mon[32782]: slow request 2880.013725 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:07:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:07:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:07:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:07:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:07:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:07:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:07:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:07:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:07:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:07:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:07:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:19 smithi196 ceph-mon[32572]: pgmap v19931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:07:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:19 smithi196 ceph-mon[32572]: pgmap v19932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:19 smithi110 ceph-mon[28069]: pgmap v19931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:07:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:19 smithi110 ceph-mon[28069]: pgmap v19932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:19 smithi193 ceph-mon[32782]: pgmap v19931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:07:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:19 smithi193 ceph-mon[32782]: pgmap v19932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:21 smithi196 ceph-mon[32572]: pgmap v19933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:21 smithi110 ceph-mon[28069]: pgmap v19933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:22.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:21 smithi193 ceph-mon[32782]: pgmap v19933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37157.598796 secs 2024-04-26T22:07:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37157.598796 secs 2024-04-26T22:07:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37157.598796 secs 2024-04-26T22:07:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:23 smithi196 ceph-mon[32572]: pgmap v19934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:07:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:23 smithi110 ceph-mon[28069]: pgmap v19934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:07:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:23 smithi193 ceph-mon[32782]: pgmap v19934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:07:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:25 smithi196 ceph-mon[32572]: pgmap v19935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:25 smithi110 ceph-mon[28069]: pgmap v19935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:25 smithi193 ceph-mon[32782]: pgmap v19935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:27 smithi196 ceph-mon[32572]: pgmap v19936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37162.598938 secs 2024-04-26T22:07:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:27 smithi110 ceph-mon[28069]: pgmap v19936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37162.598938 secs 2024-04-26T22:07:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:27 smithi193 ceph-mon[32782]: pgmap v19936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:07:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37162.598938 secs 2024-04-26T22:07:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:29 smithi196 ceph-mon[32572]: pgmap v19937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:07:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:29 smithi110 ceph-mon[28069]: pgmap v19937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:07:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:29 smithi193 ceph-mon[32782]: pgmap v19937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:07:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:31 smithi196 ceph-mon[32572]: pgmap v19938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:31 smithi110 ceph-mon[28069]: pgmap v19938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:31 smithi193 ceph-mon[32782]: pgmap v19938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37167.599083 secs 2024-04-26T22:07:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37167.599083 secs 2024-04-26T22:07:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37167.599083 secs 2024-04-26T22:07:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:33 smithi196 ceph-mon[32572]: pgmap v19939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:07:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:33 smithi110 ceph-mon[28069]: pgmap v19939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:07:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:33 smithi193 ceph-mon[32782]: pgmap v19939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:07:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:35 smithi196 ceph-mon[32572]: pgmap v19940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:35 smithi110 ceph-mon[28069]: pgmap v19940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:35 smithi193 ceph-mon[32782]: pgmap v19940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:37 smithi196 ceph-mon[32572]: pgmap v19941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37172.599202 secs 2024-04-26T22:07:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:37 smithi110 ceph-mon[28069]: pgmap v19941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37172.599202 secs 2024-04-26T22:07:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:37 smithi193 ceph-mon[32782]: pgmap v19941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37172.599202 secs 2024-04-26T22:07:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:40 smithi196 ceph-mon[32572]: pgmap v19942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:40 smithi110 ceph-mon[28069]: pgmap v19942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:40 smithi193 ceph-mon[32782]: pgmap v19942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:42 smithi110 ceph-mon[28069]: pgmap v19943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:42 smithi193 ceph-mon[32782]: pgmap v19943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:42 smithi196 ceph-mon[32572]: pgmap v19943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:43.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37177.599264 secs 2024-04-26T22:07:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37177.599264 secs 2024-04-26T22:07:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37177.599264 secs 2024-04-26T22:07:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:44 smithi110 ceph-mon[28069]: pgmap v19944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:07:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:44 smithi193 ceph-mon[32782]: pgmap v19944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:07:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:44 smithi196 ceph-mon[32572]: pgmap v19944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:07:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:46 smithi110 ceph-mon[28069]: pgmap v19945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:46 smithi193 ceph-mon[32782]: pgmap v19945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:46 smithi196 ceph-mon[32572]: pgmap v19945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:48 smithi110 ceph-mon[28069]: pgmap v19946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37182.599398 secs 2024-04-26T22:07:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:48 smithi193 ceph-mon[32782]: pgmap v19946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37182.599398 secs 2024-04-26T22:07:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:48 smithi196 ceph-mon[32572]: pgmap v19946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37182.599398 secs 2024-04-26T22:07:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:50 smithi110 ceph-mon[28069]: pgmap v19947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:50 smithi193 ceph-mon[32782]: pgmap v19947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:50 smithi196 ceph-mon[32572]: pgmap v19947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:52 smithi110 ceph-mon[28069]: pgmap v19948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:52 smithi193 ceph-mon[32782]: pgmap v19948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:52 smithi196 ceph-mon[32572]: pgmap v19948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37187.599548 secs 2024-04-26T22:07:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37187.599548 secs 2024-04-26T22:07:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37187.599548 secs 2024-04-26T22:07:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:54 smithi193 ceph-mon[32782]: pgmap v19949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:07:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:54 smithi196 ceph-mon[32572]: pgmap v19949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:07:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:54 smithi110 ceph-mon[28069]: pgmap v19949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:07:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:56 smithi193 ceph-mon[32782]: pgmap v19950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:56 smithi196 ceph-mon[32572]: pgmap v19950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:56 smithi110 ceph-mon[28069]: pgmap v19950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:07:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:58 smithi193 ceph-mon[32782]: pgmap v19951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:07:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37192.599665 secs 2024-04-26T22:07:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:58 smithi196 ceph-mon[32572]: pgmap v19951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:07:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37192.599665 secs 2024-04-26T22:07:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:58 smithi110 ceph-mon[28069]: pgmap v19951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:07:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:07:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37192.599665 secs 2024-04-26T22:08:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:00 smithi193 ceph-mon[32782]: pgmap v19952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:00 smithi196 ceph-mon[32572]: pgmap v19952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:00 smithi110 ceph-mon[28069]: pgmap v19952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:02 smithi193 ceph-mon[32782]: pgmap v19953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:02 smithi196 ceph-mon[32572]: pgmap v19953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:02 smithi110 ceph-mon[28069]: pgmap v19953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37197.599747 secs 2024-04-26T22:08:03.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37197.599747 secs 2024-04-26T22:08:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37197.599747 secs 2024-04-26T22:08:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:04 smithi193 ceph-mon[32782]: pgmap v19954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:08:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:04 smithi196 ceph-mon[32572]: pgmap v19954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:08:04.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:04 smithi110 ceph-mon[28069]: pgmap v19954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:08:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:06 smithi193 ceph-mon[32782]: pgmap v19955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:06 smithi196 ceph-mon[32572]: pgmap v19955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:06.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:06 smithi110 ceph-mon[28069]: pgmap v19955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:08 smithi193 ceph-mon[32782]: pgmap v19956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37202.599824 secs 2024-04-26T22:08:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:08 smithi196 ceph-mon[32572]: pgmap v19956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37202.599824 secs 2024-04-26T22:08:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:08 smithi110 ceph-mon[28069]: pgmap v19956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37202.599824 secs 2024-04-26T22:08:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:10 smithi193 ceph-mon[32782]: pgmap v19957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:10 smithi196 ceph-mon[32572]: pgmap v19957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:10.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:10 smithi110 ceph-mon[28069]: pgmap v19957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:12 smithi193 ceph-mon[32782]: pgmap v19958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:12 smithi196 ceph-mon[32572]: pgmap v19958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:12 smithi110 ceph-mon[28069]: pgmap v19958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:13 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 37207.599902 secs 2024-04-26T22:08:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:13 smithi193 ceph-mon[32782]: slow request 23044.710789 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:08:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:13 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 37207.599902 secs 2024-04-26T22:08:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:13 smithi196 ceph-mon[32572]: slow request 23044.710789 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:08:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:13 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 37207.599902 secs 2024-04-26T22:08:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:13 smithi110 ceph-mon[28069]: slow request 23044.710789 seconds old, received at 2024-04-26T15:44:07.187435+0000: client_request(client.26899:1 getattr pAsLsXsFs #0x1 2024-04-26T15:44:07.181572+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:08:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:14 smithi196 ceph-mon[32572]: pgmap v19959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:08:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:14 smithi110 ceph-mon[28069]: pgmap v19959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:08:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:14 smithi193 ceph-mon[32782]: pgmap v19959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:08:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:16 smithi196 ceph-mon[32572]: pgmap v19960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:16 smithi110 ceph-mon[28069]: pgmap v19960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:16 smithi193 ceph-mon[32782]: pgmap v19960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:18 smithi196 ceph-mon[32572]: pgmap v19961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37212.600023 secs 2024-04-26T22:08:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:18 smithi110 ceph-mon[28069]: pgmap v19961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37212.600023 secs 2024-04-26T22:08:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:18 smithi193 ceph-mon[32782]: pgmap v19961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:18.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37212.600023 secs 2024-04-26T22:08:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:08:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:08:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:08:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:20 smithi196 ceph-mon[32572]: pgmap v19962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:08:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:08:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:08:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:20 smithi110 ceph-mon[28069]: pgmap v19962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:08:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:08:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:08:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:20 smithi193 ceph-mon[32782]: pgmap v19962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:08:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:08:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:08:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:21 smithi196 ceph-mon[32572]: pgmap v19963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:08:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:21 smithi196 ceph-mon[32572]: pgmap v19964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:21 smithi110 ceph-mon[28069]: pgmap v19963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:08:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:21 smithi110 ceph-mon[28069]: pgmap v19964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:21 smithi193 ceph-mon[32782]: pgmap v19963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:08:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:21 smithi193 ceph-mon[32782]: pgmap v19964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37217.600139 secs 2024-04-26T22:08:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:23 smithi196 ceph-mon[32572]: pgmap v19965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:08:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37217.600139 secs 2024-04-26T22:08:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:23 smithi110 ceph-mon[28069]: pgmap v19965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:08:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37217.600139 secs 2024-04-26T22:08:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:23 smithi193 ceph-mon[32782]: pgmap v19965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:08:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:25 smithi196 ceph-mon[32572]: pgmap v19966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:25 smithi110 ceph-mon[28069]: pgmap v19966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:25 smithi193 ceph-mon[32782]: pgmap v19966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:27 smithi196 ceph-mon[32572]: pgmap v19967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:27 smithi110 ceph-mon[28069]: pgmap v19967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:27 smithi193 ceph-mon[32782]: pgmap v19967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37222.600258 secs 2024-04-26T22:08:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37222.600258 secs 2024-04-26T22:08:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37222.600258 secs 2024-04-26T22:08:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:29 smithi196 ceph-mon[32572]: pgmap v19968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:29 smithi110 ceph-mon[28069]: pgmap v19968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:29 smithi193 ceph-mon[32782]: pgmap v19968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:08:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:31 smithi196 ceph-mon[32572]: pgmap v19969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:08:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:31 smithi110 ceph-mon[28069]: pgmap v19969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:08:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:31 smithi193 ceph-mon[32782]: pgmap v19969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:08:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37227.600379 secs 2024-04-26T22:08:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:33 smithi196 ceph-mon[32572]: pgmap v19970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37227.600379 secs 2024-04-26T22:08:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:33 smithi110 ceph-mon[28069]: pgmap v19970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37227.600379 secs 2024-04-26T22:08:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:33 smithi193 ceph-mon[32782]: pgmap v19970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:35 smithi196 ceph-mon[32572]: pgmap v19971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:35.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:35 smithi110 ceph-mon[28069]: pgmap v19971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:35 smithi193 ceph-mon[32782]: pgmap v19971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:37 smithi196 ceph-mon[32572]: pgmap v19972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:37 smithi110 ceph-mon[28069]: pgmap v19972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:37 smithi193 ceph-mon[32782]: pgmap v19972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37232.600505 secs 2024-04-26T22:08:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37232.600505 secs 2024-04-26T22:08:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37232.600505 secs 2024-04-26T22:08:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:39 smithi196 ceph-mon[32572]: pgmap v19973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:39 smithi110 ceph-mon[28069]: pgmap v19973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:39 smithi193 ceph-mon[32782]: pgmap v19973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:41 smithi196 ceph-mon[32572]: pgmap v19974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:41 smithi110 ceph-mon[28069]: pgmap v19974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:41 smithi193 ceph-mon[32782]: pgmap v19974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37237.600654 secs 2024-04-26T22:08:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:43 smithi196 ceph-mon[32572]: pgmap v19975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37237.600654 secs 2024-04-26T22:08:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:43 smithi110 ceph-mon[28069]: pgmap v19975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37237.600654 secs 2024-04-26T22:08:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:43 smithi193 ceph-mon[32782]: pgmap v19975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:45 smithi196 ceph-mon[32572]: pgmap v19976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:45 smithi110 ceph-mon[28069]: pgmap v19976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:45 smithi193 ceph-mon[32782]: pgmap v19976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:47 smithi196 ceph-mon[32572]: pgmap v19977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:47 smithi110 ceph-mon[28069]: pgmap v19977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:47 smithi193 ceph-mon[32782]: pgmap v19977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37242.600750 secs 2024-04-26T22:08:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37242.600750 secs 2024-04-26T22:08:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37242.600750 secs 2024-04-26T22:08:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:49 smithi196 ceph-mon[32572]: pgmap v19978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:49 smithi110 ceph-mon[28069]: pgmap v19978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:49 smithi193 ceph-mon[32782]: pgmap v19978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:51 smithi110 ceph-mon[28069]: pgmap v19979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:51 smithi193 ceph-mon[32782]: pgmap v19979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:51 smithi196 ceph-mon[32572]: pgmap v19979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37247.600876 secs 2024-04-26T22:08:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:53 smithi110 ceph-mon[28069]: pgmap v19980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37247.600876 secs 2024-04-26T22:08:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:53 smithi193 ceph-mon[32782]: pgmap v19980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37247.600876 secs 2024-04-26T22:08:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:53 smithi196 ceph-mon[32572]: pgmap v19980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:55 smithi110 ceph-mon[28069]: pgmap v19981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:55 smithi193 ceph-mon[32782]: pgmap v19981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:55 smithi196 ceph-mon[32572]: pgmap v19981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:57 smithi110 ceph-mon[28069]: pgmap v19982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:57 smithi193 ceph-mon[32782]: pgmap v19982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:57 smithi196 ceph-mon[32572]: pgmap v19982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:08:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37252.601003 secs 2024-04-26T22:08:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37252.601003 secs 2024-04-26T22:08:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37252.601003 secs 2024-04-26T22:08:59.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:08:59 smithi110 ceph-mon[28069]: pgmap v19983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:08:59 smithi193 ceph-mon[32782]: pgmap v19983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:08:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:08:59 smithi196 ceph-mon[32572]: pgmap v19983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:00 smithi193 ceph-mon[32782]: pgmap v19984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:00 smithi196 ceph-mon[32572]: pgmap v19984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:00 smithi110 ceph-mon[28069]: pgmap v19984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37257.601133 secs 2024-04-26T22:09:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:03 smithi110 ceph-mon[28069]: pgmap v19985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37257.601133 secs 2024-04-26T22:09:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:03 smithi193 ceph-mon[32782]: pgmap v19985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:03.457 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37257.601133 secs 2024-04-26T22:09:03.458 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:03 smithi196 ceph-mon[32572]: pgmap v19985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:05 smithi110 ceph-mon[28069]: pgmap v19986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:05 smithi193 ceph-mon[32782]: pgmap v19986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:05 smithi196 ceph-mon[32572]: pgmap v19986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:07 smithi110 ceph-mon[28069]: pgmap v19987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:07 smithi193 ceph-mon[32782]: pgmap v19987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:07 smithi196 ceph-mon[32572]: pgmap v19987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37262.601261 secs 2024-04-26T22:09:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37262.601261 secs 2024-04-26T22:09:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37262.601261 secs 2024-04-26T22:09:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:09 smithi110 ceph-mon[28069]: pgmap v19988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:09 smithi193 ceph-mon[32782]: pgmap v19988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:09 smithi196 ceph-mon[32572]: pgmap v19988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:11 smithi110 ceph-mon[28069]: pgmap v19989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:11 smithi193 ceph-mon[32782]: pgmap v19989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:11 smithi196 ceph-mon[32572]: pgmap v19989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37267.601388 secs 2024-04-26T22:09:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:13 smithi193 ceph-mon[32782]: pgmap v19990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37267.601388 secs 2024-04-26T22:09:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:13 smithi196 ceph-mon[32572]: pgmap v19990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37267.601388 secs 2024-04-26T22:09:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:13 smithi110 ceph-mon[28069]: pgmap v19990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:15 smithi193 ceph-mon[32782]: pgmap v19991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:15 smithi196 ceph-mon[32572]: pgmap v19991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:15 smithi110 ceph-mon[28069]: pgmap v19991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:17 smithi193 ceph-mon[32782]: pgmap v19992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:17 smithi196 ceph-mon[32572]: pgmap v19992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:17 smithi110 ceph-mon[28069]: pgmap v19992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37272.601466 secs 2024-04-26T22:09:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37272.601466 secs 2024-04-26T22:09:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37272.601466 secs 2024-04-26T22:09:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:09:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:09:18.301+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:09:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:09:18.301+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:09:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:09:18.301+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:09:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:09:18.301+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:18.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:09:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:09:18.301+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:19 smithi193 ceph-mon[32782]: pgmap v19993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:19 smithi196 ceph-mon[32572]: pgmap v19993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:19 smithi110 ceph-mon[28069]: pgmap v19993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:21 smithi193 ceph-mon[32782]: pgmap v19994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:21 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:09:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:21 smithi196 ceph-mon[32572]: pgmap v19994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:21 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:09:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:21 smithi110 ceph-mon[28069]: pgmap v19994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:21 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:09:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:09:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:09:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:09:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:09:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:09:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:09:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:09:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:09:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:09:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:09:22.556+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T22:09:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:09:22.556+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:09:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:09:22.557+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 287 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:09:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:09:22.557+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 287 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T22:09:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:23 smithi193 ceph-mon[32782]: pgmap v19995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:09:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:23 smithi193 ceph-mon[32782]: pgmap v19996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:09:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37277.601605 secs 2024-04-26T22:09:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:23 smithi196 ceph-mon[32572]: pgmap v19995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:09:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:23 smithi196 ceph-mon[32572]: pgmap v19996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:09:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37277.601605 secs 2024-04-26T22:09:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:23 smithi110 ceph-mon[28069]: pgmap v19995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:09:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:23 smithi110 ceph-mon[28069]: pgmap v19996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:09:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37277.601605 secs 2024-04-26T22:09:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:25 smithi193 ceph-mon[32782]: pgmap v19997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:25 smithi196 ceph-mon[32572]: pgmap v19997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:25.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:25 smithi110 ceph-mon[28069]: pgmap v19997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:27 smithi193 ceph-mon[32782]: pgmap v19998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:27 smithi196 ceph-mon[32572]: pgmap v19998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:27 smithi110 ceph-mon[28069]: pgmap v19998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37282.601734 secs 2024-04-26T22:09:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37282.601734 secs 2024-04-26T22:09:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37282.601734 secs 2024-04-26T22:09:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:29 smithi193 ceph-mon[32782]: pgmap v19999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:29 smithi196 ceph-mon[32572]: pgmap v19999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:29 smithi110 ceph-mon[28069]: pgmap v19999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:31 smithi193 ceph-mon[32782]: pgmap v20000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:31 smithi196 ceph-mon[32572]: pgmap v20000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:31 smithi110 ceph-mon[28069]: pgmap v20000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 214 B/s wr, 2 op/s 2024-04-26T22:09:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:33 smithi193 ceph-mon[32782]: pgmap v20001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T22:09:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37287.601851 secs 2024-04-26T22:09:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:33 smithi196 ceph-mon[32572]: pgmap v20001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T22:09:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37287.601851 secs 2024-04-26T22:09:33.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:33 smithi110 ceph-mon[28069]: pgmap v20001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T22:09:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37287.601851 secs 2024-04-26T22:09:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:35 smithi196 ceph-mon[32572]: pgmap v20002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:09:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:35 smithi110 ceph-mon[28069]: pgmap v20002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:09:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:35 smithi193 ceph-mon[32782]: pgmap v20002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:09:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:37 smithi196 ceph-mon[32572]: pgmap v20003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:37 smithi110 ceph-mon[28069]: pgmap v20003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:37 smithi193 ceph-mon[32782]: pgmap v20003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37292.601968 secs 2024-04-26T22:09:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37292.601968 secs 2024-04-26T22:09:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37292.601968 secs 2024-04-26T22:09:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:39 smithi196 ceph-mon[32572]: pgmap v20004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:39 smithi110 ceph-mon[28069]: pgmap v20004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:39 smithi193 ceph-mon[32782]: pgmap v20004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:41 smithi196 ceph-mon[32572]: pgmap v20005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:41 smithi110 ceph-mon[28069]: pgmap v20005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:41 smithi193 ceph-mon[32782]: pgmap v20005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:43.423 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:43 smithi193 ceph-mon[32782]: pgmap v20006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:43.424 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37297.602047 secs 2024-04-26T22:09:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:43 smithi196 ceph-mon[32572]: pgmap v20006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37297.602047 secs 2024-04-26T22:09:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:43 smithi110 ceph-mon[28069]: pgmap v20006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37297.602047 secs 2024-04-26T22:09:45.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:45 smithi196 ceph-mon[32572]: pgmap v20007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:45.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:45 smithi110 ceph-mon[28069]: pgmap v20007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:45 smithi193 ceph-mon[32782]: pgmap v20007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:47 smithi196 ceph-mon[32572]: pgmap v20008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:47 smithi110 ceph-mon[28069]: pgmap v20008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:47 smithi193 ceph-mon[32782]: pgmap v20008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37302.602164 secs 2024-04-26T22:09:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37302.602164 secs 2024-04-26T22:09:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37302.602164 secs 2024-04-26T22:09:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:49 smithi196 ceph-mon[32572]: pgmap v20009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:49.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:49 smithi110 ceph-mon[28069]: pgmap v20009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:49 smithi193 ceph-mon[32782]: pgmap v20009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:51 smithi196 ceph-mon[32572]: pgmap v20010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:51.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:51 smithi110 ceph-mon[28069]: pgmap v20010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:51 smithi193 ceph-mon[32782]: pgmap v20010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:53 smithi196 ceph-mon[32572]: pgmap v20011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:53.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37307.602279 secs 2024-04-26T22:09:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:53 smithi110 ceph-mon[28069]: pgmap v20011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37307.602279 secs 2024-04-26T22:09:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:53 smithi193 ceph-mon[32782]: pgmap v20011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37307.602279 secs 2024-04-26T22:09:55.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:55 smithi196 ceph-mon[32572]: pgmap v20012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:55.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:55 smithi110 ceph-mon[28069]: pgmap v20012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:55 smithi193 ceph-mon[32782]: pgmap v20012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:57 smithi196 ceph-mon[32572]: pgmap v20013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:57 smithi110 ceph-mon[28069]: pgmap v20013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:57 smithi193 ceph-mon[32782]: pgmap v20013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:09:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37312.602401 secs 2024-04-26T22:09:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37312.602401 secs 2024-04-26T22:09:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37312.602401 secs 2024-04-26T22:09:59.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:09:59 smithi196 ceph-mon[32572]: pgmap v20014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:09:59 smithi110 ceph-mon[28069]: pgmap v20014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:09:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:09:59 smithi193 ceph-mon[32782]: pgmap v20014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:00.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:10:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:10:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:10:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:01 smithi196 ceph-mon[32572]: pgmap v20015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:01 smithi110 ceph-mon[28069]: pgmap v20015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:01 smithi193 ceph-mon[32782]: pgmap v20015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:03 smithi196 ceph-mon[32572]: pgmap v20016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37317.602550 secs 2024-04-26T22:10:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:03 smithi110 ceph-mon[28069]: pgmap v20016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37317.602550 secs 2024-04-26T22:10:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:03 smithi193 ceph-mon[32782]: pgmap v20016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37317.602550 secs 2024-04-26T22:10:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:05 smithi110 ceph-mon[28069]: pgmap v20017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:05 smithi196 ceph-mon[32572]: pgmap v20017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:05 smithi193 ceph-mon[32782]: pgmap v20017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:07 smithi196 ceph-mon[32572]: pgmap v20018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:07 smithi110 ceph-mon[28069]: pgmap v20018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:07 smithi193 ceph-mon[32782]: pgmap v20018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37322.602667 secs 2024-04-26T22:10:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37322.602667 secs 2024-04-26T22:10:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37322.602667 secs 2024-04-26T22:10:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:09 smithi196 ceph-mon[32572]: pgmap v20019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:09 smithi110 ceph-mon[28069]: pgmap v20019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:09 smithi193 ceph-mon[32782]: pgmap v20019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:11 smithi196 ceph-mon[32572]: pgmap v20020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:11 smithi110 ceph-mon[28069]: pgmap v20020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:11 smithi193 ceph-mon[32782]: pgmap v20020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:13 smithi110 ceph-mon[28069]: pgmap v20021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37327.602736 secs 2024-04-26T22:10:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:13 smithi193 ceph-mon[32782]: pgmap v20021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37327.602736 secs 2024-04-26T22:10:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:13 smithi196 ceph-mon[32572]: pgmap v20021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37327.602736 secs 2024-04-26T22:10:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:15 smithi110 ceph-mon[28069]: pgmap v20022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:15 smithi193 ceph-mon[32782]: pgmap v20022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:15 smithi196 ceph-mon[32572]: pgmap v20022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:17 smithi110 ceph-mon[28069]: pgmap v20023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:17 smithi193 ceph-mon[32782]: pgmap v20023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:17 smithi196 ceph-mon[32572]: pgmap v20023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:18 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 37332.602855 secs 2024-04-26T22:10:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:18 smithi110 ceph-mon[28069]: slow request 5761.330730 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:10:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:18 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 37332.602855 secs 2024-04-26T22:10:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:18 smithi193 ceph-mon[32782]: slow request 5761.330730 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:10:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:18 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 37332.602855 secs 2024-04-26T22:10:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:18 smithi196 ceph-mon[32572]: slow request 5761.330730 seconds old, received at 2024-04-26T20:34:15.570447+0000: client_request(client.16911:1 getattr pAsLsXsFs #0x1 2024-04-26T20:34:15.565034+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:10:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:19 smithi110 ceph-mon[28069]: pgmap v20024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:19 smithi193 ceph-mon[32782]: pgmap v20024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:19 smithi196 ceph-mon[32572]: pgmap v20024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:21.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:21 smithi110 ceph-mon[28069]: pgmap v20025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:21 smithi193 ceph-mon[32782]: pgmap v20025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:21 smithi196 ceph-mon[32572]: pgmap v20025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:22.584 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:10:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:10:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:10:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:23 smithi193 ceph-mon[32782]: pgmap v20026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37337.602951 secs 2024-04-26T22:10:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:10:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:23 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:10:23.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:23 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:10:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:23 smithi196 ceph-mon[32572]: pgmap v20026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37337.602951 secs 2024-04-26T22:10:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:10:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:23 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:10:23.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:23 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:10:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:23 smithi110 ceph-mon[28069]: pgmap v20026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37337.602951 secs 2024-04-26T22:10:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:10:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:23 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:10:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:23 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:10:24.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:24 smithi193 ceph-mon[32782]: pgmap v20027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:10:24.624 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:24 smithi193 ceph-mon[32782]: pgmap v20028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:24 smithi196 ceph-mon[32572]: pgmap v20027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:10:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:24 smithi196 ceph-mon[32572]: pgmap v20028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:24 smithi110 ceph-mon[28069]: pgmap v20027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:10:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:24 smithi110 ceph-mon[28069]: pgmap v20028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:25 smithi193 ceph-mon[32782]: pgmap v20029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:25 smithi196 ceph-mon[32572]: pgmap v20029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:25 smithi110 ceph-mon[28069]: pgmap v20029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37342.603086 secs 2024-04-26T22:10:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:28 smithi196 ceph-mon[32572]: pgmap v20030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:10:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37342.603086 secs 2024-04-26T22:10:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:28 smithi110 ceph-mon[28069]: pgmap v20030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:10:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37342.603086 secs 2024-04-26T22:10:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:28 smithi193 ceph-mon[32782]: pgmap v20030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:10:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:30 smithi196 ceph-mon[32572]: pgmap v20031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:30 smithi110 ceph-mon[28069]: pgmap v20031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:30 smithi193 ceph-mon[32782]: pgmap v20031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:32 smithi196 ceph-mon[32572]: pgmap v20032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:32 smithi110 ceph-mon[28069]: pgmap v20032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:32 smithi193 ceph-mon[32782]: pgmap v20032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:10:33.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37347.603181 secs 2024-04-26T22:10:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37347.603181 secs 2024-04-26T22:10:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37347.603181 secs 2024-04-26T22:10:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:34 smithi196 ceph-mon[32572]: pgmap v20033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:10:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:34 smithi110 ceph-mon[28069]: pgmap v20033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:10:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:34 smithi193 ceph-mon[32782]: pgmap v20033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:10:36.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:36 smithi196 ceph-mon[32572]: pgmap v20034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:36 smithi110 ceph-mon[28069]: pgmap v20034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:36 smithi193 ceph-mon[32782]: pgmap v20034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37352.603304 secs 2024-04-26T22:10:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:38 smithi196 ceph-mon[32572]: pgmap v20035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37352.603304 secs 2024-04-26T22:10:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:38 smithi110 ceph-mon[28069]: pgmap v20035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37352.603304 secs 2024-04-26T22:10:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:38 smithi193 ceph-mon[32782]: pgmap v20035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:40 smithi196 ceph-mon[32572]: pgmap v20036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:40 smithi110 ceph-mon[28069]: pgmap v20036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:40 smithi193 ceph-mon[32782]: pgmap v20036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:42 smithi196 ceph-mon[32572]: pgmap v20037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:42 smithi110 ceph-mon[28069]: pgmap v20037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:42 smithi193 ceph-mon[32782]: pgmap v20037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37357.603441 secs 2024-04-26T22:10:43.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37357.603441 secs 2024-04-26T22:10:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37357.603441 secs 2024-04-26T22:10:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:44 smithi196 ceph-mon[32572]: pgmap v20038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:44 smithi110 ceph-mon[28069]: pgmap v20038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:44 smithi193 ceph-mon[32782]: pgmap v20038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:46 smithi196 ceph-mon[32572]: pgmap v20039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:46 smithi110 ceph-mon[28069]: pgmap v20039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:46 smithi193 ceph-mon[32782]: pgmap v20039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37362.603587 secs 2024-04-26T22:10:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:48 smithi196 ceph-mon[32572]: pgmap v20040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37362.603587 secs 2024-04-26T22:10:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:48 smithi110 ceph-mon[28069]: pgmap v20040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37362.603587 secs 2024-04-26T22:10:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:48 smithi193 ceph-mon[32782]: pgmap v20040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:50 smithi196 ceph-mon[32572]: pgmap v20041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:50 smithi110 ceph-mon[28069]: pgmap v20041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:50 smithi193 ceph-mon[32782]: pgmap v20041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:52 smithi196 ceph-mon[32572]: pgmap v20042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:52 smithi110 ceph-mon[28069]: pgmap v20042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:52 smithi193 ceph-mon[32782]: pgmap v20042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37367.603725 secs 2024-04-26T22:10:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37367.603725 secs 2024-04-26T22:10:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37367.603725 secs 2024-04-26T22:10:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:54 smithi110 ceph-mon[28069]: pgmap v20043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:54 smithi193 ceph-mon[32782]: pgmap v20043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:54 smithi196 ceph-mon[32572]: pgmap v20043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:10:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:56 smithi110 ceph-mon[28069]: pgmap v20044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:56 smithi193 ceph-mon[32782]: pgmap v20044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:56 smithi196 ceph-mon[32572]: pgmap v20044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37372.603843 secs 2024-04-26T22:10:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:10:58 smithi110 ceph-mon[28069]: pgmap v20045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37372.603843 secs 2024-04-26T22:10:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:10:58 smithi193 ceph-mon[32782]: pgmap v20045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:10:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37372.603843 secs 2024-04-26T22:10:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:10:58 smithi196 ceph-mon[32572]: pgmap v20045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:00 smithi110 ceph-mon[28069]: pgmap v20046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:00 smithi193 ceph-mon[32782]: pgmap v20046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:00 smithi196 ceph-mon[32572]: pgmap v20046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:02 smithi193 ceph-mon[32782]: pgmap v20047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:02 smithi196 ceph-mon[32572]: pgmap v20047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:02 smithi110 ceph-mon[28069]: pgmap v20047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37377.603936 secs 2024-04-26T22:11:03.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37377.603936 secs 2024-04-26T22:11:03.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37377.603936 secs 2024-04-26T22:11:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:04 smithi193 ceph-mon[32782]: pgmap v20048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:04 smithi196 ceph-mon[32572]: pgmap v20048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:04 smithi110 ceph-mon[28069]: pgmap v20048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:06 smithi193 ceph-mon[32782]: pgmap v20049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:06 smithi196 ceph-mon[32572]: pgmap v20049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:06 smithi110 ceph-mon[28069]: pgmap v20049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:07 smithi193 ceph-mon[32782]: pgmap v20050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:07 smithi196 ceph-mon[32572]: pgmap v20050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:07 smithi110 ceph-mon[28069]: pgmap v20050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37382.604000 secs 2024-04-26T22:11:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37382.604000 secs 2024-04-26T22:11:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37382.604000 secs 2024-04-26T22:11:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:09 smithi193 ceph-mon[32782]: pgmap v20051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:09 smithi196 ceph-mon[32572]: pgmap v20051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:09 smithi110 ceph-mon[28069]: pgmap v20051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:12 smithi196 ceph-mon[32572]: pgmap v20052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:12 smithi110 ceph-mon[28069]: pgmap v20052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:12 smithi193 ceph-mon[32782]: pgmap v20052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37387.604085 secs 2024-04-26T22:11:13.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37387.604085 secs 2024-04-26T22:11:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37387.604085 secs 2024-04-26T22:11:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:14 smithi196 ceph-mon[32572]: pgmap v20053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:14 smithi110 ceph-mon[28069]: pgmap v20053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:14 smithi193 ceph-mon[32782]: pgmap v20053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:16 smithi196 ceph-mon[32572]: pgmap v20054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:16 smithi110 ceph-mon[28069]: pgmap v20054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:16 smithi193 ceph-mon[32782]: pgmap v20054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37392.604235 secs 2024-04-26T22:11:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:18 smithi196 ceph-mon[32572]: pgmap v20055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37392.604235 secs 2024-04-26T22:11:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:18 smithi110 ceph-mon[28069]: pgmap v20055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37392.604235 secs 2024-04-26T22:11:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:18 smithi193 ceph-mon[32782]: pgmap v20055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:20 smithi196 ceph-mon[32572]: pgmap v20056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:20 smithi110 ceph-mon[28069]: pgmap v20056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:20 smithi193 ceph-mon[32782]: pgmap v20056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:22 smithi196 ceph-mon[32572]: pgmap v20057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:22 smithi110 ceph-mon[28069]: pgmap v20057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:22 smithi193 ceph-mon[32782]: pgmap v20057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37397.604354 secs 2024-04-26T22:11:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37397.604354 secs 2024-04-26T22:11:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37397.604354 secs 2024-04-26T22:11:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:24 smithi196 ceph-mon[32572]: pgmap v20058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:24.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:24 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:11:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:24 smithi110 ceph-mon[28069]: pgmap v20058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:24 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:11:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:24 smithi193 ceph-mon[32782]: pgmap v20058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:24 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:11:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:11:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:11:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:11:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:11:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:11:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:11:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:11:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:11:25.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:11:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:26 smithi196 ceph-mon[32572]: pgmap v20059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:11:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:26 smithi196 ceph-mon[32572]: pgmap v20060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:26 smithi110 ceph-mon[28069]: pgmap v20059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:11:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:26 smithi110 ceph-mon[28069]: pgmap v20060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:26 smithi193 ceph-mon[32782]: pgmap v20059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:11:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:26 smithi193 ceph-mon[32782]: pgmap v20060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:28 smithi110 ceph-mon[28069]: pgmap v20061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37402.604479 secs 2024-04-26T22:11:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:28 smithi193 ceph-mon[32782]: pgmap v20061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37402.604479 secs 2024-04-26T22:11:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:28 smithi196 ceph-mon[32572]: pgmap v20061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37402.604479 secs 2024-04-26T22:11:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:30 smithi110 ceph-mon[28069]: pgmap v20062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:30 smithi193 ceph-mon[32782]: pgmap v20062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:30 smithi196 ceph-mon[32572]: pgmap v20062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:32 smithi110 ceph-mon[28069]: pgmap v20063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:32 smithi193 ceph-mon[32782]: pgmap v20063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:32 smithi196 ceph-mon[32572]: pgmap v20063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:11:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37407.604595 secs 2024-04-26T22:11:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37407.604595 secs 2024-04-26T22:11:33.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37407.604595 secs 2024-04-26T22:11:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:34 smithi110 ceph-mon[28069]: pgmap v20064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T22:11:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:34 smithi193 ceph-mon[32782]: pgmap v20064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T22:11:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:34 smithi196 ceph-mon[32572]: pgmap v20064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 961 B/s rd, 1 op/s 2024-04-26T22:11:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:36 smithi110 ceph-mon[28069]: pgmap v20065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T22:11:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:36 smithi193 ceph-mon[32782]: pgmap v20065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T22:11:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:36 smithi196 ceph-mon[32572]: pgmap v20065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T22:11:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:38 smithi110 ceph-mon[28069]: pgmap v20066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:11:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37412.604673 secs 2024-04-26T22:11:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:38 smithi193 ceph-mon[32782]: pgmap v20066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:11:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37412.604673 secs 2024-04-26T22:11:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:38 smithi196 ceph-mon[32572]: pgmap v20066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:11:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37412.604673 secs 2024-04-26T22:11:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:40 smithi193 ceph-mon[32782]: pgmap v20067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:40 smithi196 ceph-mon[32572]: pgmap v20067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:40 smithi110 ceph-mon[28069]: pgmap v20067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:42 smithi193 ceph-mon[32782]: pgmap v20068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:11:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:42 smithi196 ceph-mon[32572]: pgmap v20068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:11:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:42 smithi110 ceph-mon[28069]: pgmap v20068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:11:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37417.604735 secs 2024-04-26T22:11:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37417.604735 secs 2024-04-26T22:11:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37417.604735 secs 2024-04-26T22:11:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:44 smithi193 ceph-mon[32782]: pgmap v20069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:44 smithi196 ceph-mon[32572]: pgmap v20069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:44 smithi110 ceph-mon[28069]: pgmap v20069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:46.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:46 smithi193 ceph-mon[32782]: pgmap v20070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:46 smithi196 ceph-mon[32572]: pgmap v20070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:46 smithi110 ceph-mon[28069]: pgmap v20070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:48 smithi193 ceph-mon[32782]: pgmap v20071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37422.604835 secs 2024-04-26T22:11:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:48 smithi196 ceph-mon[32572]: pgmap v20071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37422.604835 secs 2024-04-26T22:11:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:48 smithi110 ceph-mon[28069]: pgmap v20071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37422.604835 secs 2024-04-26T22:11:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:49 smithi193 ceph-mon[32782]: pgmap v20072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:49 smithi196 ceph-mon[32572]: pgmap v20072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:49 smithi110 ceph-mon[28069]: pgmap v20072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:51 smithi110 ceph-mon[28069]: pgmap v20073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:51 smithi193 ceph-mon[32782]: pgmap v20073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:51 smithi196 ceph-mon[32572]: pgmap v20073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37427.604935 secs 2024-04-26T22:11:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:53 smithi193 ceph-mon[32782]: pgmap v20074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37427.604935 secs 2024-04-26T22:11:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:53 smithi196 ceph-mon[32572]: pgmap v20074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37427.604935 secs 2024-04-26T22:11:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:53 smithi110 ceph-mon[28069]: pgmap v20074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:11:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:55 smithi193 ceph-mon[32782]: pgmap v20075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:55 smithi196 ceph-mon[32572]: pgmap v20075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:55 smithi110 ceph-mon[28069]: pgmap v20075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:57 smithi193 ceph-mon[32782]: pgmap v20076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37432.605055 secs 2024-04-26T22:11:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:57 smithi196 ceph-mon[32572]: pgmap v20076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37432.605055 secs 2024-04-26T22:11:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:57 smithi110 ceph-mon[28069]: pgmap v20076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:11:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37432.605055 secs 2024-04-26T22:12:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:11:59 smithi193 ceph-mon[32782]: pgmap v20077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:11:59 smithi196 ceph-mon[32572]: pgmap v20077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:11:59 smithi110 ceph-mon[28069]: pgmap v20077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:01 smithi193 ceph-mon[32782]: pgmap v20078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:01 smithi196 ceph-mon[32572]: pgmap v20078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:01 smithi110 ceph-mon[28069]: pgmap v20078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37437.605179 secs 2024-04-26T22:12:03.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37437.605179 secs 2024-04-26T22:12:03.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37437.605179 secs 2024-04-26T22:12:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:03 smithi193 ceph-mon[32782]: pgmap v20079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:03 smithi196 ceph-mon[32572]: pgmap v20079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:03 smithi110 ceph-mon[28069]: pgmap v20079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:05 smithi193 ceph-mon[32782]: pgmap v20080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:05 smithi196 ceph-mon[32572]: pgmap v20080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:05 smithi110 ceph-mon[28069]: pgmap v20080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:07 smithi193 ceph-mon[32782]: pgmap v20081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37442.605297 secs 2024-04-26T22:12:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:07 smithi196 ceph-mon[32572]: pgmap v20081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37442.605297 secs 2024-04-26T22:12:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:07 smithi110 ceph-mon[28069]: pgmap v20081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37442.605297 secs 2024-04-26T22:12:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:09 smithi193 ceph-mon[32782]: pgmap v20082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:09 smithi196 ceph-mon[32572]: pgmap v20082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:09 smithi110 ceph-mon[28069]: pgmap v20082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:11 smithi193 ceph-mon[32782]: pgmap v20083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:11 smithi196 ceph-mon[32572]: pgmap v20083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:11 smithi110 ceph-mon[28069]: pgmap v20083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37447.605433 secs 2024-04-26T22:12:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37447.605433 secs 2024-04-26T22:12:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37447.605433 secs 2024-04-26T22:12:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:13 smithi193 ceph-mon[32782]: pgmap v20084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:13 smithi196 ceph-mon[32572]: pgmap v20084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:13 smithi110 ceph-mon[28069]: pgmap v20084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:15 smithi193 ceph-mon[32782]: pgmap v20085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:15 smithi196 ceph-mon[32572]: pgmap v20085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:15 smithi110 ceph-mon[28069]: pgmap v20085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:17 smithi193 ceph-mon[32782]: pgmap v20086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37452.605549 secs 2024-04-26T22:12:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:17 smithi196 ceph-mon[32572]: pgmap v20086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37452.605549 secs 2024-04-26T22:12:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:17 smithi110 ceph-mon[28069]: pgmap v20086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37452.605549 secs 2024-04-26T22:12:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:19 smithi196 ceph-mon[32572]: pgmap v20087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:19 smithi110 ceph-mon[28069]: pgmap v20087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:19 smithi193 ceph-mon[32782]: pgmap v20087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:21 smithi196 ceph-mon[32572]: pgmap v20088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:21 smithi110 ceph-mon[28069]: pgmap v20088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:21 smithi193 ceph-mon[32782]: pgmap v20088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:22.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:12:22.586+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T22:12:22.587 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:12:22.586+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:12:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:12:22.587+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 288 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:12:22.588 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:12:22.588+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 288 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T22:12:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37457.605632 secs 2024-04-26T22:12:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37457.605632 secs 2024-04-26T22:12:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37457.605632 secs 2024-04-26T22:12:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:23 smithi196 ceph-mon[32572]: pgmap v20089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:23 smithi110 ceph-mon[28069]: pgmap v20089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:23 smithi193 ceph-mon[32782]: pgmap v20089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:25 smithi196 ceph-mon[32572]: pgmap v20090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:12:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:25 smithi110 ceph-mon[28069]: pgmap v20090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:12:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:25 smithi193 ceph-mon[32782]: pgmap v20090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:12:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:12:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:12:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:26 smithi196 ceph-mon[32572]: pgmap v20091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:12:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:26 smithi196 ceph-mon[32572]: pgmap v20092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:27.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:12:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:12:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:12:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:26 smithi110 ceph-mon[28069]: pgmap v20091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:12:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:26 smithi110 ceph-mon[28069]: pgmap v20092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:12:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:12:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:12:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:26 smithi193 ceph-mon[32782]: pgmap v20091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:12:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:26 smithi193 ceph-mon[32782]: pgmap v20092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:12:28.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37462.605727 secs 2024-04-26T22:12:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37462.605727 secs 2024-04-26T22:12:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37462.605727 secs 2024-04-26T22:12:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:28 smithi196 ceph-mon[32572]: pgmap v20093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:28 smithi110 ceph-mon[28069]: pgmap v20093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:28 smithi193 ceph-mon[32782]: pgmap v20093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:30 smithi196 ceph-mon[32572]: pgmap v20094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:30 smithi110 ceph-mon[28069]: pgmap v20094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:30 smithi193 ceph-mon[32782]: pgmap v20094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:32 smithi196 ceph-mon[32572]: pgmap v20095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:12:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:32 smithi110 ceph-mon[28069]: pgmap v20095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:12:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:32 smithi193 ceph-mon[32782]: pgmap v20095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:12:33.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37467.605845 secs 2024-04-26T22:12:33.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37467.605845 secs 2024-04-26T22:12:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37467.605845 secs 2024-04-26T22:12:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:34 smithi196 ceph-mon[32572]: pgmap v20096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:34 smithi110 ceph-mon[28069]: pgmap v20096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:34 smithi193 ceph-mon[32782]: pgmap v20096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:12:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:36 smithi196 ceph-mon[32572]: pgmap v20097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:12:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:36 smithi110 ceph-mon[28069]: pgmap v20097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:12:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:36 smithi193 ceph-mon[32782]: pgmap v20097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:12:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37472.605969 secs 2024-04-26T22:12:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37472.605969 secs 2024-04-26T22:12:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37472.605969 secs 2024-04-26T22:12:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:38 smithi193 ceph-mon[32782]: pgmap v20098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:38 smithi196 ceph-mon[32572]: pgmap v20098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:38 smithi110 ceph-mon[28069]: pgmap v20098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:40 smithi196 ceph-mon[32572]: pgmap v20099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:40 smithi110 ceph-mon[28069]: pgmap v20099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:40 smithi193 ceph-mon[32782]: pgmap v20099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:42 smithi196 ceph-mon[32572]: pgmap v20100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:42 smithi110 ceph-mon[28069]: pgmap v20100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:42 smithi193 ceph-mon[32782]: pgmap v20100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37477.606105 secs 2024-04-26T22:12:43.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37477.606105 secs 2024-04-26T22:12:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37477.606105 secs 2024-04-26T22:12:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:44 smithi196 ceph-mon[32572]: pgmap v20101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:44 smithi110 ceph-mon[28069]: pgmap v20101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:44 smithi193 ceph-mon[32782]: pgmap v20101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:46 smithi196 ceph-mon[32572]: pgmap v20102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:46 smithi110 ceph-mon[28069]: pgmap v20102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:46 smithi193 ceph-mon[32782]: pgmap v20102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37482.606227 secs 2024-04-26T22:12:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37482.606227 secs 2024-04-26T22:12:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37482.606227 secs 2024-04-26T22:12:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:48 smithi196 ceph-mon[32572]: pgmap v20103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:48 smithi110 ceph-mon[28069]: pgmap v20103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:49.379 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:48 smithi193 ceph-mon[32782]: pgmap v20103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:50 smithi196 ceph-mon[32572]: pgmap v20104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:50 smithi110 ceph-mon[28069]: pgmap v20104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:50 smithi193 ceph-mon[32782]: pgmap v20104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:52 smithi196 ceph-mon[32572]: pgmap v20105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:52 smithi110 ceph-mon[28069]: pgmap v20105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:52 smithi193 ceph-mon[32782]: pgmap v20105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37487.606372 secs 2024-04-26T22:12:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37487.606372 secs 2024-04-26T22:12:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37487.606372 secs 2024-04-26T22:12:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:54 smithi196 ceph-mon[32572]: pgmap v20106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:54 smithi110 ceph-mon[28069]: pgmap v20106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:54 smithi193 ceph-mon[32782]: pgmap v20106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:56 smithi196 ceph-mon[32572]: pgmap v20107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:56 smithi110 ceph-mon[28069]: pgmap v20107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:56 smithi193 ceph-mon[32782]: pgmap v20107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:12:58.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37492.606512 secs 2024-04-26T22:12:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37492.606512 secs 2024-04-26T22:12:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37492.606512 secs 2024-04-26T22:12:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:12:58 smithi196 ceph-mon[32572]: pgmap v20108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:12:58 smithi110 ceph-mon[28069]: pgmap v20108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:12:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:12:58 smithi193 ceph-mon[32782]: pgmap v20108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:00 smithi196 ceph-mon[32572]: pgmap v20109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:00 smithi110 ceph-mon[28069]: pgmap v20109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:00 smithi193 ceph-mon[32782]: pgmap v20109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:02 smithi196 ceph-mon[32572]: pgmap v20110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:02 smithi110 ceph-mon[28069]: pgmap v20110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:02 smithi193 ceph-mon[32782]: pgmap v20110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:03.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37497.606643 secs 2024-04-26T22:13:03.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37497.606643 secs 2024-04-26T22:13:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37497.606643 secs 2024-04-26T22:13:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:04 smithi196 ceph-mon[32572]: pgmap v20111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:04 smithi110 ceph-mon[28069]: pgmap v20111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:04 smithi193 ceph-mon[32782]: pgmap v20111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:06 smithi196 ceph-mon[32572]: pgmap v20112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:06 smithi110 ceph-mon[28069]: pgmap v20112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:06 smithi193 ceph-mon[32782]: pgmap v20112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37502.606768 secs 2024-04-26T22:13:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37502.606768 secs 2024-04-26T22:13:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37502.606768 secs 2024-04-26T22:13:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:08 smithi196 ceph-mon[32572]: pgmap v20113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:08 smithi110 ceph-mon[28069]: pgmap v20113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:08 smithi193 ceph-mon[32782]: pgmap v20113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:10 smithi196 ceph-mon[32572]: pgmap v20114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:10 smithi110 ceph-mon[28069]: pgmap v20114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:10 smithi193 ceph-mon[32782]: pgmap v20114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:12 smithi196 ceph-mon[32572]: pgmap v20115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:12 smithi110 ceph-mon[28069]: pgmap v20115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:12 smithi193 ceph-mon[32782]: pgmap v20115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:13 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 37507.606885 secs 2024-04-26T22:13:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:13 smithi196 ceph-mon[32572]: slow request 23044.624645 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:13:13.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:13 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 37507.606885 secs 2024-04-26T22:13:13.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:13 smithi193 ceph-mon[32782]: slow request 23044.624645 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:13:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:13 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 37507.606885 secs 2024-04-26T22:13:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:13 smithi110 ceph-mon[28069]: slow request 23044.624645 seconds old, received at 2024-04-26T15:49:07.280562+0000: client_request(client.26843:1 getattr pAsLsXsFs #0x1 2024-04-26T15:49:07.275475+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:13:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:14 smithi196 ceph-mon[32572]: pgmap v20116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:14 smithi110 ceph-mon[28069]: pgmap v20116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:14 smithi193 ceph-mon[32782]: pgmap v20116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:16 smithi196 ceph-mon[32572]: pgmap v20117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:16 smithi110 ceph-mon[28069]: pgmap v20117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:16 smithi193 ceph-mon[32782]: pgmap v20117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37512.606947 secs 2024-04-26T22:13:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37512.606947 secs 2024-04-26T22:13:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37512.606947 secs 2024-04-26T22:13:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:18 smithi196 ceph-mon[32572]: pgmap v20118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:18 smithi110 ceph-mon[28069]: pgmap v20118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:18 smithi193 ceph-mon[32782]: pgmap v20118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:20 smithi196 ceph-mon[32572]: pgmap v20119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:20 smithi110 ceph-mon[28069]: pgmap v20119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:20 smithi193 ceph-mon[32782]: pgmap v20119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:22 smithi196 ceph-mon[32572]: pgmap v20120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:22 smithi110 ceph-mon[28069]: pgmap v20120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:22 smithi193 ceph-mon[32782]: pgmap v20120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37517.607073 secs 2024-04-26T22:13:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37517.607073 secs 2024-04-26T22:13:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37517.607073 secs 2024-04-26T22:13:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:24 smithi196 ceph-mon[32572]: pgmap v20121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:24 smithi110 ceph-mon[28069]: pgmap v20121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:24 smithi193 ceph-mon[32782]: pgmap v20121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:26 smithi196 ceph-mon[32572]: pgmap v20122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:26 smithi110 ceph-mon[28069]: pgmap v20122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:26 smithi193 ceph-mon[32782]: pgmap v20122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:13:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:13:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:13:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:13:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:13:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:13:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:13:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:13:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:13:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37522.607163 secs 2024-04-26T22:13:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:28 smithi196 ceph-mon[32572]: pgmap v20123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37522.607163 secs 2024-04-26T22:13:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:28 smithi110 ceph-mon[28069]: pgmap v20123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37522.607163 secs 2024-04-26T22:13:28.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:28 smithi193 ceph-mon[32782]: pgmap v20123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:13:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:13:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:29 smithi196 ceph-mon[32572]: pgmap v20124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 995 B/s rd, 1 op/s 2024-04-26T22:13:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:29 smithi196 ceph-mon[32572]: pgmap v20125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:13:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:13:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:13:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:29 smithi110 ceph-mon[28069]: pgmap v20124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 995 B/s rd, 1 op/s 2024-04-26T22:13:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:29 smithi110 ceph-mon[28069]: pgmap v20125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:13:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:13:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:13:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:29 smithi193 ceph-mon[32782]: pgmap v20124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 995 B/s rd, 1 op/s 2024-04-26T22:13:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:29 smithi193 ceph-mon[32782]: pgmap v20125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:29.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:13:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:31 smithi196 ceph-mon[32572]: pgmap v20126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:31 smithi110 ceph-mon[28069]: pgmap v20126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:31 smithi193 ceph-mon[32782]: pgmap v20126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37527.607267 secs 2024-04-26T22:13:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:33 smithi196 ceph-mon[32572]: pgmap v20127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37527.607267 secs 2024-04-26T22:13:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:33 smithi110 ceph-mon[28069]: pgmap v20127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37527.607267 secs 2024-04-26T22:13:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:33 smithi193 ceph-mon[32782]: pgmap v20127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:35 smithi196 ceph-mon[32572]: pgmap v20128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:35 smithi110 ceph-mon[28069]: pgmap v20128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:35 smithi193 ceph-mon[32782]: pgmap v20128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:37 smithi196 ceph-mon[32572]: pgmap v20129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T22:13:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:37 smithi110 ceph-mon[28069]: pgmap v20129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T22:13:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:37 smithi193 ceph-mon[32782]: pgmap v20129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 617 B/s rd, 1 op/s 2024-04-26T22:13:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37532.607396 secs 2024-04-26T22:13:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37532.607396 secs 2024-04-26T22:13:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37532.607396 secs 2024-04-26T22:13:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:39 smithi196 ceph-mon[32572]: pgmap v20130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:13:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:39 smithi110 ceph-mon[28069]: pgmap v20130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:13:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:39 smithi193 ceph-mon[32782]: pgmap v20130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:13:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:41 smithi196 ceph-mon[32572]: pgmap v20131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:41 smithi110 ceph-mon[28069]: pgmap v20131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:42.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:41 smithi193 ceph-mon[32782]: pgmap v20131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37537.607539 secs 2024-04-26T22:13:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:43 smithi196 ceph-mon[32572]: pgmap v20132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37537.607539 secs 2024-04-26T22:13:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:43 smithi110 ceph-mon[28069]: pgmap v20132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37537.607539 secs 2024-04-26T22:13:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:43 smithi193 ceph-mon[32782]: pgmap v20132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:45 smithi196 ceph-mon[32572]: pgmap v20133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:45 smithi110 ceph-mon[28069]: pgmap v20133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:45 smithi193 ceph-mon[32782]: pgmap v20133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:47 smithi196 ceph-mon[32572]: pgmap v20134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:47 smithi110 ceph-mon[28069]: pgmap v20134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:47 smithi193 ceph-mon[32782]: pgmap v20134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37542.607637 secs 2024-04-26T22:13:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37542.607637 secs 2024-04-26T22:13:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37542.607637 secs 2024-04-26T22:13:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:49 smithi196 ceph-mon[32572]: pgmap v20135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:49 smithi110 ceph-mon[28069]: pgmap v20135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:49 smithi193 ceph-mon[32782]: pgmap v20135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:52.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:51 smithi196 ceph-mon[32572]: pgmap v20136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:51 smithi110 ceph-mon[28069]: pgmap v20136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:51 smithi193 ceph-mon[32782]: pgmap v20136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37547.607768 secs 2024-04-26T22:13:54.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:53 smithi196 ceph-mon[32572]: pgmap v20137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37547.607768 secs 2024-04-26T22:13:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:53 smithi110 ceph-mon[28069]: pgmap v20137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37547.607768 secs 2024-04-26T22:13:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:53 smithi193 ceph-mon[32782]: pgmap v20137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:13:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:55 smithi196 ceph-mon[32572]: pgmap v20138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:55 smithi110 ceph-mon[28069]: pgmap v20138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:55 smithi193 ceph-mon[32782]: pgmap v20138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:57 smithi196 ceph-mon[32572]: pgmap v20139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:57 smithi110 ceph-mon[28069]: pgmap v20139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:57 smithi193 ceph-mon[32782]: pgmap v20139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:13:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37552.607830 secs 2024-04-26T22:13:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37552.607830 secs 2024-04-26T22:13:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37552.607830 secs 2024-04-26T22:14:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:13:59 smithi110 ceph-mon[28069]: pgmap v20140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:13:59 smithi193 ceph-mon[32782]: pgmap v20140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:13:59 smithi196 ceph-mon[32572]: pgmap v20140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:01 smithi110 ceph-mon[28069]: pgmap v20141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:01 smithi193 ceph-mon[32782]: pgmap v20141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:01 smithi196 ceph-mon[32572]: pgmap v20141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37557.607961 secs 2024-04-26T22:14:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:03 smithi110 ceph-mon[28069]: pgmap v20142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:04.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37557.607961 secs 2024-04-26T22:14:04.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:03 smithi196 ceph-mon[32572]: pgmap v20142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37557.607961 secs 2024-04-26T22:14:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:03 smithi193 ceph-mon[32782]: pgmap v20142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:05 smithi110 ceph-mon[28069]: pgmap v20143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:05 smithi193 ceph-mon[32782]: pgmap v20143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:05 smithi196 ceph-mon[32572]: pgmap v20143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:07 smithi110 ceph-mon[28069]: pgmap v20144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:07 smithi193 ceph-mon[32782]: pgmap v20144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:07 smithi196 ceph-mon[32572]: pgmap v20144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37562.608083 secs 2024-04-26T22:14:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37562.608083 secs 2024-04-26T22:14:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37562.608083 secs 2024-04-26T22:14:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:09 smithi110 ceph-mon[28069]: pgmap v20145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:09 smithi193 ceph-mon[32782]: pgmap v20145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:09 smithi196 ceph-mon[32572]: pgmap v20145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:11 smithi193 ceph-mon[32782]: pgmap v20146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:11 smithi196 ceph-mon[32572]: pgmap v20146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:11 smithi110 ceph-mon[28069]: pgmap v20146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37567.608205 secs 2024-04-26T22:14:14.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:13 smithi193 ceph-mon[32782]: pgmap v20147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37567.608205 secs 2024-04-26T22:14:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:13 smithi196 ceph-mon[32572]: pgmap v20147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37567.608205 secs 2024-04-26T22:14:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:13 smithi110 ceph-mon[28069]: pgmap v20147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:15 smithi193 ceph-mon[32782]: pgmap v20148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:15 smithi196 ceph-mon[32572]: pgmap v20148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:15 smithi110 ceph-mon[28069]: pgmap v20148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:17 smithi193 ceph-mon[32782]: pgmap v20149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:17 smithi196 ceph-mon[32572]: pgmap v20149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:17 smithi110 ceph-mon[28069]: pgmap v20149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:18.819 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:14:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:14:18.540+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:18.819 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:14:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:14:18.540+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:18.819 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:14:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:14:18.540+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:18.819 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:14:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:14:18.540+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:18.819 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:14:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:14:18.540+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37572.608350 secs 2024-04-26T22:14:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37572.608350 secs 2024-04-26T22:14:19.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37572.608350 secs 2024-04-26T22:14:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:19 smithi193 ceph-mon[32782]: pgmap v20150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:19 smithi196 ceph-mon[32572]: pgmap v20150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:19 smithi110 ceph-mon[28069]: pgmap v20150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:21 smithi193 ceph-mon[32782]: pgmap v20151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:21 smithi196 ceph-mon[32572]: pgmap v20151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:21 smithi110 ceph-mon[28069]: pgmap v20151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37577.608493 secs 2024-04-26T22:14:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37577.608493 secs 2024-04-26T22:14:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37577.608493 secs 2024-04-26T22:14:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:23 smithi193 ceph-mon[32782]: pgmap v20152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:23 smithi196 ceph-mon[32572]: pgmap v20152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:23 smithi110 ceph-mon[28069]: pgmap v20152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:25 smithi193 ceph-mon[32782]: pgmap v20153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:25 smithi196 ceph-mon[32572]: pgmap v20153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:25 smithi110 ceph-mon[28069]: pgmap v20153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:27 smithi193 ceph-mon[32782]: pgmap v20154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37582.608649 secs 2024-04-26T22:14:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:27 smithi196 ceph-mon[32572]: pgmap v20154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37582.608649 secs 2024-04-26T22:14:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:27 smithi110 ceph-mon[28069]: pgmap v20154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37582.608649 secs 2024-04-26T22:14:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:29 smithi193 ceph-mon[32782]: pgmap v20155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:14:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:29 smithi196 ceph-mon[32572]: pgmap v20155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:14:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:29 smithi110 ceph-mon[28069]: pgmap v20155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:14:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:14:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:14:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:14:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:30 smithi193 ceph-mon[32782]: pgmap v20156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 176 B/s wr, 13 op/s 2024-04-26T22:14:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:14:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:14:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:30 smithi196 ceph-mon[32572]: pgmap v20156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 176 B/s wr, 13 op/s 2024-04-26T22:14:31.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:14:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:14:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:30 smithi110 ceph-mon[28069]: pgmap v20156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 176 B/s wr, 13 op/s 2024-04-26T22:14:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:14:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37587.608726 secs 2024-04-26T22:14:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:33 smithi110 ceph-mon[28069]: pgmap v20157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 176 B/s wr, 13 op/s 2024-04-26T22:14:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37587.608726 secs 2024-04-26T22:14:33.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:33 smithi193 ceph-mon[32782]: pgmap v20157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 176 B/s wr, 13 op/s 2024-04-26T22:14:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37587.608726 secs 2024-04-26T22:14:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:33 smithi196 ceph-mon[32572]: pgmap v20157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 176 B/s wr, 13 op/s 2024-04-26T22:14:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:35 smithi110 ceph-mon[28069]: pgmap v20158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:14:35.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:35 smithi196 ceph-mon[32572]: pgmap v20158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:14:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:35 smithi193 ceph-mon[32782]: pgmap v20158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:14:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:37 smithi110 ceph-mon[28069]: pgmap v20159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:14:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:37 smithi193 ceph-mon[32782]: pgmap v20159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:14:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:37 smithi196 ceph-mon[32572]: pgmap v20159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:14:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37592.608862 secs 2024-04-26T22:14:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37592.608862 secs 2024-04-26T22:14:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37592.608862 secs 2024-04-26T22:14:39.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:39 smithi193 ceph-mon[32782]: pgmap v20160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:14:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:39 smithi196 ceph-mon[32572]: pgmap v20160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:14:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:39 smithi110 ceph-mon[28069]: pgmap v20160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:14:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:41 smithi193 ceph-mon[32782]: pgmap v20161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:14:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:41 smithi196 ceph-mon[32572]: pgmap v20161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:14:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:41 smithi110 ceph-mon[28069]: pgmap v20161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:14:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37597.609019 secs 2024-04-26T22:14:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:43 smithi193 ceph-mon[32782]: pgmap v20162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37597.609019 secs 2024-04-26T22:14:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:43 smithi196 ceph-mon[32572]: pgmap v20162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37597.609019 secs 2024-04-26T22:14:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:43 smithi110 ceph-mon[28069]: pgmap v20162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:45 smithi193 ceph-mon[32782]: pgmap v20163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:45 smithi196 ceph-mon[32572]: pgmap v20163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:45 smithi110 ceph-mon[28069]: pgmap v20163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:47 smithi193 ceph-mon[32782]: pgmap v20164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:47 smithi196 ceph-mon[32572]: pgmap v20164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:47 smithi110 ceph-mon[28069]: pgmap v20164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37602.609139 secs 2024-04-26T22:14:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37602.609139 secs 2024-04-26T22:14:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37602.609139 secs 2024-04-26T22:14:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:49 smithi193 ceph-mon[32782]: pgmap v20165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:49 smithi196 ceph-mon[32572]: pgmap v20165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:49 smithi110 ceph-mon[28069]: pgmap v20165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:51 smithi193 ceph-mon[32782]: pgmap v20166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:51 smithi196 ceph-mon[32572]: pgmap v20166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:51 smithi110 ceph-mon[28069]: pgmap v20166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37607.609260 secs 2024-04-26T22:14:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:53 smithi193 ceph-mon[32782]: pgmap v20167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37607.609260 secs 2024-04-26T22:14:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:53 smithi196 ceph-mon[32572]: pgmap v20167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37607.609260 secs 2024-04-26T22:14:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:53 smithi110 ceph-mon[28069]: pgmap v20167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:55 smithi193 ceph-mon[32782]: pgmap v20168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:55 smithi196 ceph-mon[32572]: pgmap v20168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:55 smithi110 ceph-mon[28069]: pgmap v20168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:57 smithi193 ceph-mon[32782]: pgmap v20169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:57 smithi196 ceph-mon[32572]: pgmap v20169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:57 smithi110 ceph-mon[28069]: pgmap v20169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:14:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37612.609378 secs 2024-04-26T22:14:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37612.609378 secs 2024-04-26T22:14:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37612.609378 secs 2024-04-26T22:14:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:14:59 smithi193 ceph-mon[32782]: pgmap v20170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:14:59 smithi196 ceph-mon[32572]: pgmap v20170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:14:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:14:59 smithi110 ceph-mon[28069]: pgmap v20170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:00 smithi196 ceph-mon[32572]: pgmap v20171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:00 smithi110 ceph-mon[28069]: pgmap v20171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:00 smithi193 ceph-mon[32782]: pgmap v20171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37617.609500 secs 2024-04-26T22:15:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:03 smithi110 ceph-mon[28069]: pgmap v20172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37617.609500 secs 2024-04-26T22:15:03.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:03 smithi193 ceph-mon[32782]: pgmap v20172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37617.609500 secs 2024-04-26T22:15:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:03 smithi196 ceph-mon[32572]: pgmap v20172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:05.556 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:05 smithi196 ceph-mon[32572]: pgmap v20173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:15:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:05 smithi193 ceph-mon[32782]: pgmap v20173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:15:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:05 smithi110 ceph-mon[28069]: pgmap v20173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:15:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:07 smithi193 ceph-mon[32782]: pgmap v20174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:15:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:07 smithi196 ceph-mon[32572]: pgmap v20174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:15:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:07 smithi110 ceph-mon[28069]: pgmap v20174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:15:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37622.609621 secs 2024-04-26T22:15:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37622.609621 secs 2024-04-26T22:15:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37622.609621 secs 2024-04-26T22:15:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:09 smithi193 ceph-mon[32782]: pgmap v20175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:15:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:09 smithi196 ceph-mon[32572]: pgmap v20175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:15:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:09 smithi110 ceph-mon[28069]: pgmap v20175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:15:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:11 smithi193 ceph-mon[32782]: pgmap v20176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:15:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:11 smithi196 ceph-mon[32572]: pgmap v20176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:15:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:11 smithi110 ceph-mon[28069]: pgmap v20176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:15:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37627.609763 secs 2024-04-26T22:15:13.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:13 smithi193 ceph-mon[32782]: pgmap v20177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:15:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37627.609763 secs 2024-04-26T22:15:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:13 smithi196 ceph-mon[32572]: pgmap v20177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:15:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37627.609763 secs 2024-04-26T22:15:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:13 smithi110 ceph-mon[28069]: pgmap v20177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:15:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:15 smithi193 ceph-mon[32782]: pgmap v20178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:15:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:15 smithi196 ceph-mon[32572]: pgmap v20178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:15:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:15 smithi110 ceph-mon[28069]: pgmap v20178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:15:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:17 smithi193 ceph-mon[32782]: pgmap v20179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:17 smithi196 ceph-mon[32572]: pgmap v20179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:17 smithi110 ceph-mon[28069]: pgmap v20179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37632.609843 secs 2024-04-26T22:15:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37632.609843 secs 2024-04-26T22:15:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37632.609843 secs 2024-04-26T22:15:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:19 smithi193 ceph-mon[32782]: pgmap v20180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:19 smithi196 ceph-mon[32572]: pgmap v20180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:19.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:19 smithi110 ceph-mon[28069]: pgmap v20180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:21 smithi193 ceph-mon[32782]: pgmap v20181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:21 smithi196 ceph-mon[32572]: pgmap v20181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:21 smithi110 ceph-mon[28069]: pgmap v20181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:15:22.619+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T22:15:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:15:22.618+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:15:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:15:22.620+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 289 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:15:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:15:22.620+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:15:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:15:22.620+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 289 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T22:15:22.620 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:15:22.620+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:15:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:15:22.621+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 290 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:15:22.621 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:15:22.621+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 290 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:15:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37637.609923 secs 2024-04-26T22:15:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:23 smithi193 ceph-mon[32782]: pgmap v20182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37637.609923 secs 2024-04-26T22:15:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:23 smithi196 ceph-mon[32572]: pgmap v20182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37637.609923 secs 2024-04-26T22:15:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:23 smithi110 ceph-mon[28069]: pgmap v20182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:25 smithi193 ceph-mon[32782]: pgmap v20183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:25 smithi196 ceph-mon[32572]: pgmap v20183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:25 smithi110 ceph-mon[28069]: pgmap v20183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:27 smithi193 ceph-mon[32782]: pgmap v20184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:27 smithi196 ceph-mon[32572]: pgmap v20184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:27 smithi110 ceph-mon[28069]: pgmap v20184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37642.610039 secs 2024-04-26T22:15:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37642.610039 secs 2024-04-26T22:15:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37642.610039 secs 2024-04-26T22:15:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:29 smithi196 ceph-mon[32572]: pgmap v20185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:29 smithi110 ceph-mon[28069]: pgmap v20185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:29 smithi193 ceph-mon[32782]: pgmap v20185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:30 smithi196 ceph-mon[32572]: pgmap v20186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:30 smithi110 ceph-mon[28069]: pgmap v20186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:30 smithi193 ceph-mon[32782]: pgmap v20186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:15:31.682 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:15:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:15:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:32 smithi196 ceph-mon[32572]: pgmap v20187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:32 smithi110 ceph-mon[28069]: pgmap v20187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:32 smithi193 ceph-mon[32782]: pgmap v20187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37647.610105 secs 2024-04-26T22:15:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:33.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:33 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:15:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37647.610105 secs 2024-04-26T22:15:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:33 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37647.610105 secs 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:34.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:33 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:15:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:34 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:15:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:34 smithi193 ceph-mon[32782]: pgmap v20188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:34 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:15:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:34 smithi196 ceph-mon[32572]: pgmap v20188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:35.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:34 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:15:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:34 smithi110 ceph-mon[28069]: pgmap v20188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:15:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:36.185 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.185 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.185 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.185 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.185 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.185 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.185 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.186 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.186 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:15:36.186 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:15:36.186 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:36.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.294 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:36.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:15:36.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:15:36.295 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:15:37.118 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:36 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:15:37.118 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:36 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:15:37.118 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:36 smithi196 ceph-mon[32572]: pgmap v20189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:15:37.118 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:36 smithi196 ceph-mon[32572]: pgmap v20190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:36 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:15:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:36 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:15:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:36 smithi193 ceph-mon[32782]: pgmap v20189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:15:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:36 smithi193 ceph-mon[32782]: pgmap v20190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:36 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:15:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:36 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:15:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:36 smithi110 ceph-mon[28069]: pgmap v20189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:15:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:36 smithi110 ceph-mon[28069]: pgmap v20190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37652.610218 secs 2024-04-26T22:15:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37652.610218 secs 2024-04-26T22:15:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37652.610218 secs 2024-04-26T22:15:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:38 smithi193 ceph-mon[32782]: pgmap v20191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:38 smithi196 ceph-mon[32572]: pgmap v20191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:38 smithi110 ceph-mon[28069]: pgmap v20191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:41.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:40 smithi193 ceph-mon[32782]: pgmap v20192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:40 smithi196 ceph-mon[32572]: pgmap v20192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:41.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:40 smithi110 ceph-mon[28069]: pgmap v20192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:42 smithi193 ceph-mon[32782]: pgmap v20193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:43.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37657.610339 secs 2024-04-26T22:15:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:42 smithi196 ceph-mon[32572]: pgmap v20193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37657.610339 secs 2024-04-26T22:15:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:42 smithi110 ceph-mon[28069]: pgmap v20193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37657.610339 secs 2024-04-26T22:15:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:44 smithi193 ceph-mon[32782]: pgmap v20194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:44 smithi196 ceph-mon[32572]: pgmap v20194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:44 smithi110 ceph-mon[28069]: pgmap v20194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:47.131 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:46 smithi193 ceph-mon[32782]: pgmap v20195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:15:47.184 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:46 smithi196 ceph-mon[32572]: pgmap v20195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:15:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:46 smithi110 ceph-mon[28069]: pgmap v20195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:15:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37662.610397 secs 2024-04-26T22:15:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37662.610397 secs 2024-04-26T22:15:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37662.610397 secs 2024-04-26T22:15:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:48 smithi196 ceph-mon[32572]: pgmap v20196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:48 smithi110 ceph-mon[28069]: pgmap v20196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:48 smithi193 ceph-mon[32782]: pgmap v20196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:50 smithi196 ceph-mon[32572]: pgmap v20197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:50 smithi110 ceph-mon[28069]: pgmap v20197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:50 smithi193 ceph-mon[32782]: pgmap v20197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:52 smithi196 ceph-mon[32572]: pgmap v20198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37667.610537 secs 2024-04-26T22:15:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:52 smithi110 ceph-mon[28069]: pgmap v20198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37667.610537 secs 2024-04-26T22:15:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:52 smithi193 ceph-mon[32782]: pgmap v20198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37667.610537 secs 2024-04-26T22:15:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:54 smithi196 ceph-mon[32572]: pgmap v20199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:54 smithi110 ceph-mon[28069]: pgmap v20199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:54 smithi193 ceph-mon[32782]: pgmap v20199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:57.199 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:56 smithi193 ceph-mon[32782]: pgmap v20200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:56 smithi196 ceph-mon[32572]: pgmap v20200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:56 smithi110 ceph-mon[28069]: pgmap v20200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:15:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37672.610614 secs 2024-04-26T22:15:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37672.610614 secs 2024-04-26T22:15:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37672.610614 secs 2024-04-26T22:15:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:15:58 smithi196 ceph-mon[32572]: pgmap v20201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:15:58 smithi110 ceph-mon[28069]: pgmap v20201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:15:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:15:58 smithi193 ceph-mon[32782]: pgmap v20201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:00 smithi196 ceph-mon[32572]: pgmap v20202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:00 smithi110 ceph-mon[28069]: pgmap v20202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:00 smithi193 ceph-mon[32782]: pgmap v20202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:02 smithi196 ceph-mon[32572]: pgmap v20203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37677.610738 secs 2024-04-26T22:16:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:02 smithi110 ceph-mon[28069]: pgmap v20203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37677.610738 secs 2024-04-26T22:16:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:02 smithi193 ceph-mon[32782]: pgmap v20203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37677.610738 secs 2024-04-26T22:16:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:04 smithi196 ceph-mon[32572]: pgmap v20204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:04 smithi110 ceph-mon[28069]: pgmap v20204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:04 smithi193 ceph-mon[32782]: pgmap v20204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:06 smithi196 ceph-mon[32572]: pgmap v20205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:06 smithi110 ceph-mon[28069]: pgmap v20205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:06 smithi193 ceph-mon[32782]: pgmap v20205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37682.610861 secs 2024-04-26T22:16:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37682.610861 secs 2024-04-26T22:16:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37682.610861 secs 2024-04-26T22:16:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:08 smithi196 ceph-mon[32572]: pgmap v20206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:08 smithi110 ceph-mon[28069]: pgmap v20206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:08 smithi193 ceph-mon[32782]: pgmap v20206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:10 smithi196 ceph-mon[32572]: pgmap v20207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:10 smithi110 ceph-mon[28069]: pgmap v20207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:10 smithi193 ceph-mon[32782]: pgmap v20207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:12 smithi196 ceph-mon[32572]: pgmap v20208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37687.610978 secs 2024-04-26T22:16:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:12 smithi110 ceph-mon[28069]: pgmap v20208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37687.610978 secs 2024-04-26T22:16:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:12 smithi193 ceph-mon[32782]: pgmap v20208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37687.610978 secs 2024-04-26T22:16:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:14 smithi196 ceph-mon[32572]: pgmap v20209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:14 smithi110 ceph-mon[28069]: pgmap v20209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:14 smithi193 ceph-mon[32782]: pgmap v20209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:16 smithi196 ceph-mon[32572]: pgmap v20210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:17.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:16 smithi110 ceph-mon[28069]: pgmap v20210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:16 smithi193 ceph-mon[32782]: pgmap v20210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37692.611038 secs 2024-04-26T22:16:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37692.611038 secs 2024-04-26T22:16:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37692.611038 secs 2024-04-26T22:16:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:18 smithi196 ceph-mon[32572]: pgmap v20211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:18 smithi110 ceph-mon[28069]: pgmap v20211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:18 smithi193 ceph-mon[32782]: pgmap v20211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:20 smithi196 ceph-mon[32572]: pgmap v20212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:20 smithi110 ceph-mon[28069]: pgmap v20212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:20 smithi193 ceph-mon[32782]: pgmap v20212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:22 smithi196 ceph-mon[32572]: pgmap v20213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:23.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37697.611194 secs 2024-04-26T22:16:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:22 smithi110 ceph-mon[28069]: pgmap v20213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37697.611194 secs 2024-04-26T22:16:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:22 smithi193 ceph-mon[32782]: pgmap v20213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:23.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37697.611194 secs 2024-04-26T22:16:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:24 smithi196 ceph-mon[32572]: pgmap v20214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:25.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:24 smithi110 ceph-mon[28069]: pgmap v20214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:24 smithi193 ceph-mon[32782]: pgmap v20214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:27 smithi196 ceph-mon[32572]: pgmap v20215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:27 smithi110 ceph-mon[28069]: pgmap v20215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:27 smithi193 ceph-mon[32782]: pgmap v20215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37702.611346 secs 2024-04-26T22:16:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37702.611346 secs 2024-04-26T22:16:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37702.611346 secs 2024-04-26T22:16:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:29 smithi110 ceph-mon[28069]: pgmap v20216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:29 smithi193 ceph-mon[32782]: pgmap v20216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:29 smithi196 ceph-mon[32572]: pgmap v20216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:31 smithi110 ceph-mon[28069]: pgmap v20217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:31 smithi193 ceph-mon[32782]: pgmap v20217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:31 smithi196 ceph-mon[32572]: pgmap v20217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:33 smithi110 ceph-mon[28069]: pgmap v20218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37707.611485 secs 2024-04-26T22:16:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:33 smithi193 ceph-mon[32782]: pgmap v20218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37707.611485 secs 2024-04-26T22:16:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:33 smithi196 ceph-mon[32572]: pgmap v20218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37707.611485 secs 2024-04-26T22:16:35.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:35 smithi110 ceph-mon[28069]: pgmap v20219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:35.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:35 smithi196 ceph-mon[32572]: pgmap v20219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:35 smithi193 ceph-mon[32782]: pgmap v20219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:37 smithi110 ceph-mon[28069]: pgmap v20220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:37.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:16:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:37 smithi193 ceph-mon[32782]: pgmap v20220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:37.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:16:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:37 smithi196 ceph-mon[32572]: pgmap v20220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:16:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37712.611605 secs 2024-04-26T22:16:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:16:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:16:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:38 smithi193 ceph-mon[32782]: pgmap v20221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:16:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:38 smithi193 ceph-mon[32782]: pgmap v20222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:16:38.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:38 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:16:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37712.611605 secs 2024-04-26T22:16:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:16:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:16:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:38 smithi196 ceph-mon[32572]: pgmap v20221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:16:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:38 smithi196 ceph-mon[32572]: pgmap v20222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:16:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:38 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:16:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37712.611605 secs 2024-04-26T22:16:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:16:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:16:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:38 smithi110 ceph-mon[28069]: pgmap v20221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:16:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:38 smithi110 ceph-mon[28069]: pgmap v20222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:16:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:38 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:16:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:39 smithi196 ceph-mon[32572]: pgmap v20223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:39 smithi110 ceph-mon[28069]: pgmap v20223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:39 smithi193 ceph-mon[32782]: pgmap v20223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:41 smithi196 ceph-mon[32572]: pgmap v20224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:41 smithi110 ceph-mon[28069]: pgmap v20224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:41 smithi193 ceph-mon[32782]: pgmap v20224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37717.611670 secs 2024-04-26T22:16:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37717.611670 secs 2024-04-26T22:16:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37717.611670 secs 2024-04-26T22:16:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:43 smithi196 ceph-mon[32572]: pgmap v20225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:43 smithi110 ceph-mon[28069]: pgmap v20225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:43 smithi193 ceph-mon[32782]: pgmap v20225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:45 smithi196 ceph-mon[32572]: pgmap v20226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:45 smithi110 ceph-mon[28069]: pgmap v20226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:45 smithi193 ceph-mon[32782]: pgmap v20226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:16:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:47 smithi196 ceph-mon[32572]: pgmap v20227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:16:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:47 smithi110 ceph-mon[28069]: pgmap v20227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:16:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:47 smithi193 ceph-mon[32782]: pgmap v20227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:16:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37722.611796 secs 2024-04-26T22:16:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37722.611796 secs 2024-04-26T22:16:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37722.611796 secs 2024-04-26T22:16:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:49 smithi196 ceph-mon[32572]: pgmap v20228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:16:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:49 smithi110 ceph-mon[28069]: pgmap v20228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:16:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:49 smithi193 ceph-mon[32782]: pgmap v20228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:16:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:51 smithi196 ceph-mon[32572]: pgmap v20229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:51 smithi110 ceph-mon[28069]: pgmap v20229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:51 smithi193 ceph-mon[32782]: pgmap v20229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37727.611867 secs 2024-04-26T22:16:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37727.611867 secs 2024-04-26T22:16:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37727.611867 secs 2024-04-26T22:16:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:53 smithi196 ceph-mon[32572]: pgmap v20230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:53 smithi110 ceph-mon[28069]: pgmap v20230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:53 smithi193 ceph-mon[32782]: pgmap v20230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:55 smithi196 ceph-mon[32572]: pgmap v20231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:55 smithi110 ceph-mon[28069]: pgmap v20231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:55 smithi193 ceph-mon[32782]: pgmap v20231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:16:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:57 smithi196 ceph-mon[32572]: pgmap v20232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:57 smithi110 ceph-mon[28069]: pgmap v20232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:57 smithi193 ceph-mon[32782]: pgmap v20232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:16:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37732.611990 secs 2024-04-26T22:16:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37732.611990 secs 2024-04-26T22:16:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37732.611990 secs 2024-04-26T22:16:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:16:59 smithi196 ceph-mon[32572]: pgmap v20233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:16:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:16:59 smithi110 ceph-mon[28069]: pgmap v20233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:16:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:16:59 smithi193 ceph-mon[32782]: pgmap v20233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:01 smithi196 ceph-mon[32572]: pgmap v20234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:01 smithi110 ceph-mon[28069]: pgmap v20234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:01 smithi193 ceph-mon[32782]: pgmap v20234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37737.612111 secs 2024-04-26T22:17:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37737.612111 secs 2024-04-26T22:17:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37737.612111 secs 2024-04-26T22:17:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:03 smithi196 ceph-mon[32572]: pgmap v20235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:03 smithi110 ceph-mon[28069]: pgmap v20235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:03 smithi193 ceph-mon[32782]: pgmap v20235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:05 smithi196 ceph-mon[32572]: pgmap v20236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:05 smithi110 ceph-mon[28069]: pgmap v20236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:05 smithi193 ceph-mon[32782]: pgmap v20236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:07 smithi196 ceph-mon[32572]: pgmap v20237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:07 smithi110 ceph-mon[28069]: pgmap v20237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:07 smithi193 ceph-mon[32782]: pgmap v20237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37742.612212 secs 2024-04-26T22:17:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37742.612212 secs 2024-04-26T22:17:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37742.612212 secs 2024-04-26T22:17:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:09 smithi196 ceph-mon[32572]: pgmap v20238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:09 smithi110 ceph-mon[28069]: pgmap v20238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:09 smithi193 ceph-mon[32782]: pgmap v20238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:11 smithi196 ceph-mon[32572]: pgmap v20239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:11 smithi110 ceph-mon[28069]: pgmap v20239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:11 smithi193 ceph-mon[32782]: pgmap v20239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37747.612334 secs 2024-04-26T22:17:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37747.612334 secs 2024-04-26T22:17:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37747.612334 secs 2024-04-26T22:17:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:13 smithi196 ceph-mon[32572]: pgmap v20240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:13 smithi110 ceph-mon[28069]: pgmap v20240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:13 smithi193 ceph-mon[32782]: pgmap v20240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:15 smithi196 ceph-mon[32572]: pgmap v20241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:15 smithi110 ceph-mon[28069]: pgmap v20241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:15 smithi193 ceph-mon[32782]: pgmap v20241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:17 smithi196 ceph-mon[32572]: pgmap v20242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:17 smithi110 ceph-mon[28069]: pgmap v20242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:17 smithi193 ceph-mon[32782]: pgmap v20242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37752.612458 secs 2024-04-26T22:17:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37752.612458 secs 2024-04-26T22:17:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37752.612458 secs 2024-04-26T22:17:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:19 smithi196 ceph-mon[32572]: pgmap v20243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:19 smithi110 ceph-mon[28069]: pgmap v20243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:19 smithi193 ceph-mon[32782]: pgmap v20243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:21 smithi196 ceph-mon[32572]: pgmap v20244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:21 smithi110 ceph-mon[28069]: pgmap v20244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:21 smithi193 ceph-mon[32782]: pgmap v20244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37757.612605 secs 2024-04-26T22:17:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37757.612605 secs 2024-04-26T22:17:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37757.612605 secs 2024-04-26T22:17:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:23 smithi196 ceph-mon[32572]: pgmap v20245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:23 smithi110 ceph-mon[28069]: pgmap v20245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:23 smithi193 ceph-mon[32782]: pgmap v20245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:25 smithi196 ceph-mon[32572]: pgmap v20246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:25 smithi110 ceph-mon[28069]: pgmap v20246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:25 smithi193 ceph-mon[32782]: pgmap v20246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:27 smithi196 ceph-mon[32572]: pgmap v20247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:27 smithi110 ceph-mon[28069]: pgmap v20247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:27 smithi193 ceph-mon[32782]: pgmap v20247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37762.612722 secs 2024-04-26T22:17:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37762.612722 secs 2024-04-26T22:17:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37762.612722 secs 2024-04-26T22:17:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:29 smithi196 ceph-mon[32572]: pgmap v20248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:29 smithi110 ceph-mon[28069]: pgmap v20248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:29 smithi193 ceph-mon[32782]: pgmap v20248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:17:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:31 smithi196 ceph-mon[32572]: pgmap v20249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:31 smithi110 ceph-mon[28069]: pgmap v20249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:31 smithi193 ceph-mon[32782]: pgmap v20249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37767.612859 secs 2024-04-26T22:17:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37767.612859 secs 2024-04-26T22:17:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37767.612859 secs 2024-04-26T22:17:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:33 smithi196 ceph-mon[32572]: pgmap v20250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:33 smithi110 ceph-mon[28069]: pgmap v20250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:33 smithi193 ceph-mon[32782]: pgmap v20250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:35 smithi196 ceph-mon[32572]: pgmap v20251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:35 smithi110 ceph-mon[28069]: pgmap v20251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:35 smithi193 ceph-mon[32782]: pgmap v20251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:37 smithi196 ceph-mon[32572]: pgmap v20252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:37 smithi110 ceph-mon[28069]: pgmap v20252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:37 smithi193 ceph-mon[32782]: pgmap v20252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37772.612969 secs 2024-04-26T22:17:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:17:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37772.612969 secs 2024-04-26T22:17:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:17:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37772.612969 secs 2024-04-26T22:17:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:17:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:17:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:17:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:39 smithi196 ceph-mon[32572]: pgmap v20253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 2 op/s 2024-04-26T22:17:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:39 smithi196 ceph-mon[32572]: pgmap v20254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:39.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:17:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:17:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:17:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:39 smithi110 ceph-mon[28069]: pgmap v20253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 2 op/s 2024-04-26T22:17:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:39 smithi110 ceph-mon[28069]: pgmap v20254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:17:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:17:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:17:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:39 smithi193 ceph-mon[32782]: pgmap v20253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 891 B/s rd, 2 op/s 2024-04-26T22:17:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:39 smithi193 ceph-mon[32782]: pgmap v20254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:39.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:17:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:41 smithi196 ceph-mon[32572]: pgmap v20255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:41 smithi110 ceph-mon[28069]: pgmap v20255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:41 smithi193 ceph-mon[32782]: pgmap v20255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37777.613067 secs 2024-04-26T22:17:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37777.613067 secs 2024-04-26T22:17:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37777.613067 secs 2024-04-26T22:17:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:43 smithi196 ceph-mon[32572]: pgmap v20256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:43 smithi110 ceph-mon[28069]: pgmap v20256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:43 smithi193 ceph-mon[32782]: pgmap v20256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:45 smithi196 ceph-mon[32572]: pgmap v20257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:45 smithi110 ceph-mon[28069]: pgmap v20257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:45 smithi193 ceph-mon[32782]: pgmap v20257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:47 smithi196 ceph-mon[32572]: pgmap v20258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T22:17:48.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37782.613167 secs 2024-04-26T22:17:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:47 smithi110 ceph-mon[28069]: pgmap v20258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T22:17:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37782.613167 secs 2024-04-26T22:17:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:47 smithi193 ceph-mon[32782]: pgmap v20258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 539 B/s rd, 1 op/s 2024-04-26T22:17:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37782.613167 secs 2024-04-26T22:17:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:49 smithi196 ceph-mon[32572]: pgmap v20259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:17:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:49 smithi110 ceph-mon[28069]: pgmap v20259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:17:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:49 smithi193 ceph-mon[32782]: pgmap v20259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:17:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:51 smithi196 ceph-mon[32572]: pgmap v20260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:51 smithi110 ceph-mon[28069]: pgmap v20260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:51 smithi193 ceph-mon[32782]: pgmap v20260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37787.613310 secs 2024-04-26T22:17:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37787.613310 secs 2024-04-26T22:17:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37787.613310 secs 2024-04-26T22:17:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:53 smithi196 ceph-mon[32572]: pgmap v20261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:53 smithi110 ceph-mon[28069]: pgmap v20261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:53 smithi193 ceph-mon[32782]: pgmap v20261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:17:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:55 smithi196 ceph-mon[32572]: pgmap v20262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:55 smithi110 ceph-mon[28069]: pgmap v20262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:55 smithi193 ceph-mon[32782]: pgmap v20262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:57 smithi196 ceph-mon[32572]: pgmap v20263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37792.613454 secs 2024-04-26T22:17:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:57 smithi110 ceph-mon[28069]: pgmap v20263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37792.613454 secs 2024-04-26T22:17:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:57 smithi193 ceph-mon[32782]: pgmap v20263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:17:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37792.613454 secs 2024-04-26T22:18:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:17:59 smithi196 ceph-mon[32572]: pgmap v20264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:17:59 smithi110 ceph-mon[28069]: pgmap v20264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:17:59 smithi193 ceph-mon[32782]: pgmap v20264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:01 smithi196 ceph-mon[32572]: pgmap v20265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:01 smithi110 ceph-mon[28069]: pgmap v20265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:02.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:01 smithi193 ceph-mon[32782]: pgmap v20265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37797.613526 secs 2024-04-26T22:18:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37797.613526 secs 2024-04-26T22:18:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37797.613526 secs 2024-04-26T22:18:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:04 smithi110 ceph-mon[28069]: pgmap v20266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:04 smithi193 ceph-mon[32782]: pgmap v20266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:04 smithi196 ceph-mon[32572]: pgmap v20266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:06 smithi110 ceph-mon[28069]: pgmap v20267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:06.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:06 smithi196 ceph-mon[32572]: pgmap v20267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:06 smithi193 ceph-mon[32782]: pgmap v20267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:08 smithi110 ceph-mon[28069]: pgmap v20268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37802.613653 secs 2024-04-26T22:18:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:08 smithi193 ceph-mon[32782]: pgmap v20268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37802.613653 secs 2024-04-26T22:18:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:08 smithi196 ceph-mon[32572]: pgmap v20268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:08.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37802.613653 secs 2024-04-26T22:18:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:10 smithi110 ceph-mon[28069]: pgmap v20269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:10 smithi193 ceph-mon[32782]: pgmap v20269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:10 smithi196 ceph-mon[32572]: pgmap v20269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:12 smithi110 ceph-mon[28069]: pgmap v20270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:12 smithi193 ceph-mon[32782]: pgmap v20270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:12 smithi196 ceph-mon[32572]: pgmap v20270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:13 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 37807.613779 secs 2024-04-26T22:18:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:13 smithi193 ceph-mon[32782]: slow request 23044.406263 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:18:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:13 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 37807.613779 secs 2024-04-26T22:18:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:13 smithi196 ceph-mon[32572]: slow request 23044.406263 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:18:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:13 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 37807.613779 secs 2024-04-26T22:18:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:13 smithi110 ceph-mon[28069]: slow request 23044.406263 seconds old, received at 2024-04-26T15:54:07.505837+0000: client_request(client.26849:1 getattr pAsLsXsFs #0x1 2024-04-26T15:54:07.501155+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:18:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:14 smithi193 ceph-mon[32782]: pgmap v20271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:14 smithi196 ceph-mon[32572]: pgmap v20271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:14 smithi110 ceph-mon[28069]: pgmap v20271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:16 smithi193 ceph-mon[32782]: pgmap v20272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.480+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).tick idle (900000789) for more than 900000000 us, fault. 2024-04-26T22:18:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.480+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T22:18:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.480+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:18:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.482+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T22:18:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.482+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T22:18:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:16 smithi196 ceph-mon[32572]: pgmap v20272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.515+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T22:18:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.515+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T22:18:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.515+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614058000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:18:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.515+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614058000 comp rx=0 tx=0).stop 2024-04-26T22:18:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.515+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T22:18:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.515+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T22:18:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.515+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:18:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.515+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:18:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.515+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:18:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:16.517+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261402d040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:18:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:16 smithi110 ceph-mon[28069]: pgmap v20272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:18 smithi193 ceph-mon[32782]: pgmap v20273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37812.613904 secs 2024-04-26T22:18:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:18 smithi196 ceph-mon[32572]: pgmap v20273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37812.613904 secs 2024-04-26T22:18:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:18 smithi110 ceph-mon[28069]: pgmap v20273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:18.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37812.613904 secs 2024-04-26T22:18:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:20 smithi193 ceph-mon[32782]: pgmap v20274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:20 smithi196 ceph-mon[32572]: pgmap v20274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:20 smithi110 ceph-mon[28069]: pgmap v20274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:22 smithi193 ceph-mon[32782]: pgmap v20275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:22 smithi196 ceph-mon[32572]: pgmap v20275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:22 smithi110 ceph-mon[28069]: pgmap v20275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:22.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:22.650+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:18:22.650 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:22.650+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:18:22.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:22.651+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 291 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:18:22.651 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:18:22.651+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 291 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:18:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37817.613975 secs 2024-04-26T22:18:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37817.613975 secs 2024-04-26T22:18:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37817.613975 secs 2024-04-26T22:18:24.374 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:24 smithi193 ceph-mon[32782]: pgmap v20276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:24 smithi196 ceph-mon[32572]: pgmap v20276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:24 smithi110 ceph-mon[28069]: pgmap v20276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:26 smithi193 ceph-mon[32782]: pgmap v20277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:26 smithi196 ceph-mon[32572]: pgmap v20277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:26 smithi110 ceph-mon[28069]: pgmap v20277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:28 smithi193 ceph-mon[32782]: pgmap v20278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37822.614103 secs 2024-04-26T22:18:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:28 smithi196 ceph-mon[32572]: pgmap v20278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37822.614103 secs 2024-04-26T22:18:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:28 smithi110 ceph-mon[28069]: pgmap v20278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37822.614103 secs 2024-04-26T22:18:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:30 smithi193 ceph-mon[32782]: pgmap v20279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:30 smithi196 ceph-mon[32572]: pgmap v20279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:30 smithi110 ceph-mon[28069]: pgmap v20279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:32 smithi196 ceph-mon[32572]: pgmap v20280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:32 smithi110 ceph-mon[28069]: pgmap v20280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:32 smithi193 ceph-mon[32782]: pgmap v20280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:33.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37827.614228 secs 2024-04-26T22:18:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37827.614228 secs 2024-04-26T22:18:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37827.614228 secs 2024-04-26T22:18:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:34 smithi196 ceph-mon[32572]: pgmap v20281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:34 smithi110 ceph-mon[28069]: pgmap v20281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:34 smithi193 ceph-mon[32782]: pgmap v20281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:36 smithi196 ceph-mon[32572]: pgmap v20282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:36 smithi110 ceph-mon[28069]: pgmap v20282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:36 smithi193 ceph-mon[32782]: pgmap v20282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:38 smithi196 ceph-mon[32572]: pgmap v20283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37832.614383 secs 2024-04-26T22:18:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:38 smithi110 ceph-mon[28069]: pgmap v20283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37832.614383 secs 2024-04-26T22:18:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:38 smithi193 ceph-mon[32782]: pgmap v20283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37832.614383 secs 2024-04-26T22:18:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:18:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:18:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:18:40.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:40 smithi196 ceph-mon[32572]: pgmap v20284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:40 smithi110 ceph-mon[28069]: pgmap v20284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:40 smithi193 ceph-mon[32782]: pgmap v20284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:18:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:18:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:41 smithi196 ceph-mon[32572]: pgmap v20285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 802 B/s rd, 1 op/s 2024-04-26T22:18:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:41 smithi196 ceph-mon[32572]: pgmap v20286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T22:18:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:18:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:18:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:18:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:41 smithi110 ceph-mon[28069]: pgmap v20285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 802 B/s rd, 1 op/s 2024-04-26T22:18:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:41 smithi110 ceph-mon[28069]: pgmap v20286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T22:18:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:18:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:18:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:18:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:41 smithi193 ceph-mon[32782]: pgmap v20285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 802 B/s rd, 1 op/s 2024-04-26T22:18:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:41 smithi193 ceph-mon[32782]: pgmap v20286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T22:18:41.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:18:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:42 smithi196 ceph-mon[32572]: pgmap v20287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 1 op/s 2024-04-26T22:18:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:42 smithi110 ceph-mon[28069]: pgmap v20287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 1 op/s 2024-04-26T22:18:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:42 smithi193 ceph-mon[32782]: pgmap v20287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 1 op/s 2024-04-26T22:18:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37837.614446 secs 2024-04-26T22:18:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37837.614446 secs 2024-04-26T22:18:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37837.614446 secs 2024-04-26T22:18:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:44 smithi196 ceph-mon[32572]: pgmap v20288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T22:18:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:44 smithi110 ceph-mon[28069]: pgmap v20288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T22:18:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:44 smithi193 ceph-mon[32782]: pgmap v20288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T22:18:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:46 smithi196 ceph-mon[32572]: pgmap v20289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T22:18:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:46 smithi110 ceph-mon[28069]: pgmap v20289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T22:18:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:46 smithi193 ceph-mon[32782]: pgmap v20289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 B/s rd, 2 op/s 2024-04-26T22:18:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37842.614611 secs 2024-04-26T22:18:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37842.614611 secs 2024-04-26T22:18:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37842.614611 secs 2024-04-26T22:18:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:48 smithi196 ceph-mon[32572]: pgmap v20290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:18:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:48 smithi110 ceph-mon[28069]: pgmap v20290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:18:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:48 smithi193 ceph-mon[32782]: pgmap v20290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:18:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:50 smithi196 ceph-mon[32572]: pgmap v20291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:18:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:50 smithi110 ceph-mon[28069]: pgmap v20291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:18:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:50 smithi193 ceph-mon[32782]: pgmap v20291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:18:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:52 smithi196 ceph-mon[32572]: pgmap v20292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:52 smithi110 ceph-mon[28069]: pgmap v20292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:52 smithi193 ceph-mon[32782]: pgmap v20292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37847.614706 secs 2024-04-26T22:18:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37847.614706 secs 2024-04-26T22:18:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37847.614706 secs 2024-04-26T22:18:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:54 smithi196 ceph-mon[32572]: pgmap v20293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:18:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:54 smithi110 ceph-mon[28069]: pgmap v20293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:18:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:54 smithi193 ceph-mon[32782]: pgmap v20293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:18:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:56 smithi196 ceph-mon[32572]: pgmap v20294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:56 smithi110 ceph-mon[28069]: pgmap v20294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:56 smithi193 ceph-mon[32782]: pgmap v20294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:18:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37852.614800 secs 2024-04-26T22:18:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37852.614800 secs 2024-04-26T22:18:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37852.614800 secs 2024-04-26T22:18:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:18:58 smithi196 ceph-mon[32572]: pgmap v20295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:18:58 smithi110 ceph-mon[28069]: pgmap v20295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:18:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:18:58 smithi193 ceph-mon[32782]: pgmap v20295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:00 smithi196 ceph-mon[32572]: pgmap v20296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:00 smithi110 ceph-mon[28069]: pgmap v20296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:00 smithi193 ceph-mon[32782]: pgmap v20296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:02 smithi196 ceph-mon[32572]: pgmap v20297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:02 smithi110 ceph-mon[28069]: pgmap v20297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:02 smithi193 ceph-mon[32782]: pgmap v20297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37857.614927 secs 2024-04-26T22:19:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37857.614927 secs 2024-04-26T22:19:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37857.614927 secs 2024-04-26T22:19:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:04 smithi196 ceph-mon[32572]: pgmap v20298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:04 smithi110 ceph-mon[28069]: pgmap v20298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:04 smithi193 ceph-mon[32782]: pgmap v20298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:06 smithi196 ceph-mon[32572]: pgmap v20299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:06 smithi110 ceph-mon[28069]: pgmap v20299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:06 smithi193 ceph-mon[32782]: pgmap v20299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37862.615007 secs 2024-04-26T22:19:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37862.615007 secs 2024-04-26T22:19:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37862.615007 secs 2024-04-26T22:19:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:08 smithi196 ceph-mon[32572]: pgmap v20300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:09.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:08 smithi110 ceph-mon[28069]: pgmap v20300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:08 smithi193 ceph-mon[32782]: pgmap v20300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:10 smithi196 ceph-mon[32572]: pgmap v20301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:10 smithi110 ceph-mon[28069]: pgmap v20301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:10 smithi193 ceph-mon[32782]: pgmap v20301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:12 smithi196 ceph-mon[32572]: pgmap v20302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:12 smithi110 ceph-mon[28069]: pgmap v20302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:12 smithi193 ceph-mon[32782]: pgmap v20302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37867.615124 secs 2024-04-26T22:19:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37867.615124 secs 2024-04-26T22:19:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37867.615124 secs 2024-04-26T22:19:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:14 smithi196 ceph-mon[32572]: pgmap v20303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:14 smithi110 ceph-mon[28069]: pgmap v20303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:14 smithi193 ceph-mon[32782]: pgmap v20303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:16 smithi196 ceph-mon[32572]: pgmap v20304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:16 smithi110 ceph-mon[28069]: pgmap v20304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:16 smithi193 ceph-mon[32782]: pgmap v20304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37872.615258 secs 2024-04-26T22:19:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37872.615258 secs 2024-04-26T22:19:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37872.615258 secs 2024-04-26T22:19:18.930 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:19:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:19:18.609+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:19:18.930 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:19:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:19:18.609+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:19:18.930 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:19:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:19:18.609+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:19:18.930 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:19:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:19:18.609+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:19:18.930 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:19:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:19:18.609+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:19:19.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:18 smithi196 ceph-mon[32572]: pgmap v20305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:19.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:18 smithi110 ceph-mon[28069]: pgmap v20305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:18 smithi193 ceph-mon[32782]: pgmap v20305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:20 smithi196 ceph-mon[32572]: pgmap v20306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:20 smithi110 ceph-mon[28069]: pgmap v20306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:20 smithi193 ceph-mon[32782]: pgmap v20306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:22 smithi196 ceph-mon[32572]: pgmap v20307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:22 smithi110 ceph-mon[28069]: pgmap v20307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:22 smithi193 ceph-mon[32782]: pgmap v20307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37877.615404 secs 2024-04-26T22:19:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37877.615404 secs 2024-04-26T22:19:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37877.615404 secs 2024-04-26T22:19:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:24 smithi196 ceph-mon[32572]: pgmap v20308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:24 smithi110 ceph-mon[28069]: pgmap v20308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:24 smithi193 ceph-mon[32782]: pgmap v20308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:26 smithi196 ceph-mon[32572]: pgmap v20309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:26 smithi110 ceph-mon[28069]: pgmap v20309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:26 smithi193 ceph-mon[32782]: pgmap v20309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37882.615546 secs 2024-04-26T22:19:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37882.615546 secs 2024-04-26T22:19:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37882.615546 secs 2024-04-26T22:19:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:28 smithi196 ceph-mon[32572]: pgmap v20310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:29.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:28 smithi110 ceph-mon[28069]: pgmap v20310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:28 smithi193 ceph-mon[32782]: pgmap v20310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:30 smithi196 ceph-mon[32572]: pgmap v20311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:30 smithi110 ceph-mon[28069]: pgmap v20311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:30 smithi193 ceph-mon[32782]: pgmap v20311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:32 smithi196 ceph-mon[32572]: pgmap v20312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:32 smithi110 ceph-mon[28069]: pgmap v20312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:32 smithi193 ceph-mon[32782]: pgmap v20312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37887.615674 secs 2024-04-26T22:19:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37887.615674 secs 2024-04-26T22:19:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37887.615674 secs 2024-04-26T22:19:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:34 smithi196 ceph-mon[32572]: pgmap v20313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:34 smithi110 ceph-mon[28069]: pgmap v20313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:34 smithi193 ceph-mon[32782]: pgmap v20313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:19:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:36 smithi196 ceph-mon[32572]: pgmap v20314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:36 smithi110 ceph-mon[28069]: pgmap v20314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:36 smithi193 ceph-mon[32782]: pgmap v20314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37892.615760 secs 2024-04-26T22:19:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37892.615760 secs 2024-04-26T22:19:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37892.615760 secs 2024-04-26T22:19:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:38 smithi196 ceph-mon[32572]: pgmap v20315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:38 smithi110 ceph-mon[28069]: pgmap v20315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:39.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:38 smithi193 ceph-mon[32782]: pgmap v20315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:40 smithi196 ceph-mon[32572]: pgmap v20316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:40 smithi110 ceph-mon[28069]: pgmap v20316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:40 smithi193 ceph-mon[32782]: pgmap v20316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:19:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:19:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:19:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:19:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:19:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:42 smithi196 ceph-mon[32572]: pgmap v20317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T22:19:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:42 smithi196 ceph-mon[32572]: pgmap v20318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T22:19:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:19:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:19:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:19:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:42 smithi110 ceph-mon[28069]: pgmap v20317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T22:19:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:42 smithi110 ceph-mon[28069]: pgmap v20318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T22:19:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:19:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:19:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:19:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:42 smithi193 ceph-mon[32782]: pgmap v20317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 890 B/s rd, 1 op/s 2024-04-26T22:19:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:42 smithi193 ceph-mon[32782]: pgmap v20318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 538 B/s rd, 1 op/s 2024-04-26T22:19:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:19:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37897.615913 secs 2024-04-26T22:19:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37897.615913 secs 2024-04-26T22:19:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37897.615913 secs 2024-04-26T22:19:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:44 smithi196 ceph-mon[32572]: pgmap v20319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:44 smithi110 ceph-mon[28069]: pgmap v20319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:44 smithi193 ceph-mon[32782]: pgmap v20319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:46 smithi196 ceph-mon[32572]: pgmap v20320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:46 smithi110 ceph-mon[28069]: pgmap v20320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:47.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:46 smithi193 ceph-mon[32782]: pgmap v20320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37902.616013 secs 2024-04-26T22:19:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37902.616013 secs 2024-04-26T22:19:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37902.616013 secs 2024-04-26T22:19:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:48 smithi196 ceph-mon[32572]: pgmap v20321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:48 smithi110 ceph-mon[28069]: pgmap v20321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:48 smithi193 ceph-mon[32782]: pgmap v20321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:51.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:50 smithi196 ceph-mon[32572]: pgmap v20322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:50 smithi110 ceph-mon[28069]: pgmap v20322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:51.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:50 smithi193 ceph-mon[32782]: pgmap v20322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:52 smithi196 ceph-mon[32572]: pgmap v20323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:19:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37907.616136 secs 2024-04-26T22:19:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:52 smithi110 ceph-mon[28069]: pgmap v20323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:19:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37907.616136 secs 2024-04-26T22:19:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:52 smithi193 ceph-mon[32782]: pgmap v20323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:19:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37907.616136 secs 2024-04-26T22:19:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:54 smithi196 ceph-mon[32572]: pgmap v20324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:54 smithi110 ceph-mon[28069]: pgmap v20324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:54 smithi193 ceph-mon[32782]: pgmap v20324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:56 smithi196 ceph-mon[32572]: pgmap v20325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:56 smithi110 ceph-mon[28069]: pgmap v20325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:56 smithi193 ceph-mon[32782]: pgmap v20325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:19:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37912.616263 secs 2024-04-26T22:19:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37912.616263 secs 2024-04-26T22:19:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37912.616263 secs 2024-04-26T22:19:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:19:59 smithi196 ceph-mon[32572]: pgmap v20326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:19:59 smithi110 ceph-mon[28069]: pgmap v20326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:19:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:19:59 smithi193 ceph-mon[32782]: pgmap v20326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:20:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:20:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:20:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:01 smithi110 ceph-mon[28069]: pgmap v20327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:01 smithi193 ceph-mon[32782]: pgmap v20327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:01 smithi196 ceph-mon[32572]: pgmap v20327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:03 smithi110 ceph-mon[28069]: pgmap v20328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37917.616339 secs 2024-04-26T22:20:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:03 smithi193 ceph-mon[32782]: pgmap v20328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:03.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37917.616339 secs 2024-04-26T22:20:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:03 smithi196 ceph-mon[32572]: pgmap v20328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:03.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37917.616339 secs 2024-04-26T22:20:05.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:05 smithi110 ceph-mon[28069]: pgmap v20329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:05 smithi193 ceph-mon[32782]: pgmap v20329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:05 smithi196 ceph-mon[32572]: pgmap v20329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:07.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:07 smithi110 ceph-mon[28069]: pgmap v20330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:07.306 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:07 smithi196 ceph-mon[32572]: pgmap v20330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:07 smithi193 ceph-mon[32782]: pgmap v20330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37922.616459 secs 2024-04-26T22:20:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37922.616459 secs 2024-04-26T22:20:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37922.616459 secs 2024-04-26T22:20:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:09 smithi193 ceph-mon[32782]: pgmap v20331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:09 smithi196 ceph-mon[32572]: pgmap v20331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:09 smithi110 ceph-mon[28069]: pgmap v20331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:11.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:11 smithi193 ceph-mon[32782]: pgmap v20332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:11 smithi196 ceph-mon[32572]: pgmap v20332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:11 smithi110 ceph-mon[28069]: pgmap v20332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:13 smithi193 ceph-mon[32782]: pgmap v20333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:13.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37927.616604 secs 2024-04-26T22:20:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:13 smithi196 ceph-mon[32572]: pgmap v20333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37927.616604 secs 2024-04-26T22:20:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:13 smithi110 ceph-mon[28069]: pgmap v20333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37927.616604 secs 2024-04-26T22:20:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:15 smithi193 ceph-mon[32782]: pgmap v20334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:15 smithi196 ceph-mon[32572]: pgmap v20334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:15 smithi110 ceph-mon[28069]: pgmap v20334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:17.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:17 smithi193 ceph-mon[32782]: pgmap v20335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:17 smithi196 ceph-mon[32572]: pgmap v20335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:17 smithi110 ceph-mon[28069]: pgmap v20335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37932.616664 secs 2024-04-26T22:20:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37932.616664 secs 2024-04-26T22:20:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37932.616664 secs 2024-04-26T22:20:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:19 smithi193 ceph-mon[32782]: pgmap v20336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:19 smithi196 ceph-mon[32572]: pgmap v20336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:19 smithi110 ceph-mon[28069]: pgmap v20336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:21.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:21 smithi193 ceph-mon[32782]: pgmap v20337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:21.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:21 smithi196 ceph-mon[32572]: pgmap v20337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:21 smithi110 ceph-mon[28069]: pgmap v20337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:23 smithi193 ceph-mon[32782]: pgmap v20338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37937.616791 secs 2024-04-26T22:20:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:23 smithi196 ceph-mon[32572]: pgmap v20338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37937.616791 secs 2024-04-26T22:20:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:23 smithi110 ceph-mon[28069]: pgmap v20338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:23.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37937.616791 secs 2024-04-26T22:20:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:25 smithi193 ceph-mon[32782]: pgmap v20339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:25 smithi196 ceph-mon[32572]: pgmap v20339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:25 smithi110 ceph-mon[28069]: pgmap v20339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:27 smithi193 ceph-mon[32782]: pgmap v20340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:27 smithi196 ceph-mon[32572]: pgmap v20340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:27 smithi110 ceph-mon[28069]: pgmap v20340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37942.616914 secs 2024-04-26T22:20:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37942.616914 secs 2024-04-26T22:20:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37942.616914 secs 2024-04-26T22:20:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:29 smithi193 ceph-mon[32782]: pgmap v20341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:29.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:29 smithi196 ceph-mon[32572]: pgmap v20341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:29 smithi110 ceph-mon[28069]: pgmap v20341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:31 smithi193 ceph-mon[32782]: pgmap v20342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:31.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:31 smithi196 ceph-mon[32572]: pgmap v20342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:31.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:31 smithi110 ceph-mon[28069]: pgmap v20342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37947.617012 secs 2024-04-26T22:20:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:33 smithi193 ceph-mon[32782]: pgmap v20343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37947.617012 secs 2024-04-26T22:20:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:33 smithi196 ceph-mon[32572]: pgmap v20343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37947.617012 secs 2024-04-26T22:20:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:33 smithi110 ceph-mon[28069]: pgmap v20343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:35 smithi196 ceph-mon[32572]: pgmap v20344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:35 smithi110 ceph-mon[28069]: pgmap v20344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:35 smithi193 ceph-mon[32782]: pgmap v20344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:37 smithi196 ceph-mon[32572]: pgmap v20345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:37 smithi110 ceph-mon[28069]: pgmap v20345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:37 smithi193 ceph-mon[32782]: pgmap v20345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37952.617156 secs 2024-04-26T22:20:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37952.617156 secs 2024-04-26T22:20:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37952.617156 secs 2024-04-26T22:20:39.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:39 smithi196 ceph-mon[32572]: pgmap v20346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:39.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:39 smithi110 ceph-mon[28069]: pgmap v20346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:39 smithi193 ceph-mon[32782]: pgmap v20346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:41.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:41 smithi196 ceph-mon[32572]: pgmap v20347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:41.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:41 smithi110 ceph-mon[28069]: pgmap v20347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:41 smithi193 ceph-mon[32782]: pgmap v20347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37957.617286 secs 2024-04-26T22:20:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:43 smithi196 ceph-mon[32572]: pgmap v20348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:43.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:20:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37957.617286 secs 2024-04-26T22:20:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:43 smithi110 ceph-mon[28069]: pgmap v20348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:20:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37957.617286 secs 2024-04-26T22:20:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:43 smithi193 ceph-mon[32782]: pgmap v20348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:20:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:20:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:44 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:20:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:44 smithi196 ceph-mon[32572]: pgmap v20349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:20:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:44 smithi196 ceph-mon[32572]: pgmap v20350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:44.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:44 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:20:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:20:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:44 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:20:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:44 smithi110 ceph-mon[28069]: pgmap v20349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:20:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:44 smithi110 ceph-mon[28069]: pgmap v20350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:44 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:20:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:20:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:44 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:20:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:44 smithi193 ceph-mon[32782]: pgmap v20349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:20:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:44 smithi193 ceph-mon[32782]: pgmap v20350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:44.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:44 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:20:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:45 smithi196 ceph-mon[32572]: pgmap v20351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:45 smithi110 ceph-mon[28069]: pgmap v20351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:45 smithi193 ceph-mon[32782]: pgmap v20351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:47 smithi196 ceph-mon[32572]: pgmap v20352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T22:20:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:47 smithi110 ceph-mon[28069]: pgmap v20352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T22:20:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:47 smithi193 ceph-mon[32782]: pgmap v20352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-26T22:20:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37962.617408 secs 2024-04-26T22:20:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37962.617408 secs 2024-04-26T22:20:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37962.617408 secs 2024-04-26T22:20:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:49 smithi196 ceph-mon[32572]: pgmap v20353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:49 smithi110 ceph-mon[28069]: pgmap v20353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:49 smithi193 ceph-mon[32782]: pgmap v20353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:51 smithi196 ceph-mon[32572]: pgmap v20354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:51 smithi110 ceph-mon[28069]: pgmap v20354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:51 smithi193 ceph-mon[32782]: pgmap v20354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37967.617548 secs 2024-04-26T22:20:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37967.617548 secs 2024-04-26T22:20:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37967.617548 secs 2024-04-26T22:20:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:53 smithi196 ceph-mon[32572]: pgmap v20355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:20:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:53 smithi110 ceph-mon[28069]: pgmap v20355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:20:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:53 smithi193 ceph-mon[32782]: pgmap v20355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:20:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:55 smithi196 ceph-mon[32572]: pgmap v20356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:55 smithi110 ceph-mon[28069]: pgmap v20356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:55 smithi193 ceph-mon[32782]: pgmap v20356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:20:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:57 smithi196 ceph-mon[32572]: pgmap v20357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:57 smithi110 ceph-mon[28069]: pgmap v20357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:57 smithi193 ceph-mon[32782]: pgmap v20357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:20:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37972.617677 secs 2024-04-26T22:20:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37972.617677 secs 2024-04-26T22:20:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37972.617677 secs 2024-04-26T22:20:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:20:59 smithi196 ceph-mon[32572]: pgmap v20358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:20:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:20:59 smithi110 ceph-mon[28069]: pgmap v20358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:20:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:20:59 smithi193 ceph-mon[32782]: pgmap v20358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:01 smithi196 ceph-mon[32572]: pgmap v20359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:01 smithi110 ceph-mon[28069]: pgmap v20359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:01 smithi193 ceph-mon[32782]: pgmap v20359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37977.617801 secs 2024-04-26T22:21:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37977.617801 secs 2024-04-26T22:21:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37977.617801 secs 2024-04-26T22:21:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:03 smithi196 ceph-mon[32572]: pgmap v20360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:03 smithi110 ceph-mon[28069]: pgmap v20360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:03 smithi193 ceph-mon[32782]: pgmap v20360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:05 smithi196 ceph-mon[32572]: pgmap v20361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:05 smithi110 ceph-mon[28069]: pgmap v20361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:05 smithi193 ceph-mon[32782]: pgmap v20361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:07 smithi196 ceph-mon[32572]: pgmap v20362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:07 smithi110 ceph-mon[28069]: pgmap v20362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:07 smithi193 ceph-mon[32782]: pgmap v20362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37982.617926 secs 2024-04-26T22:21:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37982.617926 secs 2024-04-26T22:21:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37982.617926 secs 2024-04-26T22:21:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:09 smithi196 ceph-mon[32572]: pgmap v20363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:09 smithi110 ceph-mon[28069]: pgmap v20363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:09 smithi193 ceph-mon[32782]: pgmap v20363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:11 smithi196 ceph-mon[32572]: pgmap v20364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:11 smithi110 ceph-mon[28069]: pgmap v20364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:11 smithi193 ceph-mon[32782]: pgmap v20364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37987.618045 secs 2024-04-26T22:21:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37987.618045 secs 2024-04-26T22:21:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37987.618045 secs 2024-04-26T22:21:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:13 smithi196 ceph-mon[32572]: pgmap v20365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:13 smithi110 ceph-mon[28069]: pgmap v20365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:13 smithi193 ceph-mon[32782]: pgmap v20365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:15 smithi196 ceph-mon[32572]: pgmap v20366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:15.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:15 smithi110 ceph-mon[28069]: pgmap v20366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:15 smithi193 ceph-mon[32782]: pgmap v20366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:17 smithi196 ceph-mon[32572]: pgmap v20367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:17 smithi110 ceph-mon[28069]: pgmap v20367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:17 smithi193 ceph-mon[32782]: pgmap v20367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:18 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 37992.618159 secs 2024-04-26T22:21:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:18 smithi196 ceph-mon[32572]: slow request 11523.879773 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:21:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:18 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 37992.618159 secs 2024-04-26T22:21:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:18 smithi110 ceph-mon[28069]: slow request 11523.879773 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:21:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:18 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 37992.618159 secs 2024-04-26T22:21:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:18 smithi193 ceph-mon[32782]: slow request 11523.879773 seconds old, received at 2024-04-26T19:09:13.036708+0000: client_request(client.27124:1 getattr pAsLsXsFs #0x1 2024-04-26T19:09:13.031999+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:21:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:19 smithi110 ceph-mon[28069]: pgmap v20368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:19 smithi193 ceph-mon[32782]: pgmap v20368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:19 smithi196 ceph-mon[32572]: pgmap v20368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:21 smithi196 ceph-mon[32572]: pgmap v20369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:21 smithi110 ceph-mon[28069]: pgmap v20369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:21 smithi193 ceph-mon[32782]: pgmap v20369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:22.681 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:21:22.681+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:21:22.681 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:21:22.681+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:21:22.682 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:21:22.681+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 292 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:21:22.682 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:21:22.682+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 292 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:21:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 37997.618306 secs 2024-04-26T22:21:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 37997.618306 secs 2024-04-26T22:21:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 37997.618306 secs 2024-04-26T22:21:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:23 smithi196 ceph-mon[32572]: pgmap v20370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:23 smithi110 ceph-mon[28069]: pgmap v20370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:23 smithi193 ceph-mon[32782]: pgmap v20370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:25 smithi196 ceph-mon[32572]: pgmap v20371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:25 smithi110 ceph-mon[28069]: pgmap v20371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:25 smithi193 ceph-mon[32782]: pgmap v20371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:27 smithi196 ceph-mon[32572]: pgmap v20372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:27 smithi110 ceph-mon[28069]: pgmap v20372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:27 smithi193 ceph-mon[32782]: pgmap v20372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38002.618452 secs 2024-04-26T22:21:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38002.618452 secs 2024-04-26T22:21:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38002.618452 secs 2024-04-26T22:21:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:29 smithi110 ceph-mon[28069]: pgmap v20373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:29 smithi193 ceph-mon[32782]: pgmap v20373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:29 smithi196 ceph-mon[32572]: pgmap v20373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:31 smithi196 ceph-mon[32572]: pgmap v20374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:31 smithi110 ceph-mon[28069]: pgmap v20374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:31 smithi193 ceph-mon[32782]: pgmap v20374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38007.618593 secs 2024-04-26T22:21:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38007.618593 secs 2024-04-26T22:21:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38007.618593 secs 2024-04-26T22:21:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:33 smithi196 ceph-mon[32572]: pgmap v20375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:33 smithi110 ceph-mon[28069]: pgmap v20375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:33 smithi193 ceph-mon[32782]: pgmap v20375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:35 smithi196 ceph-mon[32572]: pgmap v20376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:35 smithi110 ceph-mon[28069]: pgmap v20376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:35 smithi193 ceph-mon[32782]: pgmap v20376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:37 smithi196 ceph-mon[32572]: pgmap v20377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:37 smithi110 ceph-mon[28069]: pgmap v20377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:37 smithi193 ceph-mon[32782]: pgmap v20377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38012.618698 secs 2024-04-26T22:21:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38012.618698 secs 2024-04-26T22:21:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38012.618698 secs 2024-04-26T22:21:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:39 smithi110 ceph-mon[28069]: pgmap v20378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:39 smithi193 ceph-mon[32782]: pgmap v20378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:39 smithi196 ceph-mon[32572]: pgmap v20378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:21:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:41 smithi196 ceph-mon[32572]: pgmap v20379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:41 smithi110 ceph-mon[28069]: pgmap v20379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:41 smithi193 ceph-mon[32782]: pgmap v20379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38017.618836 secs 2024-04-26T22:21:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38017.618836 secs 2024-04-26T22:21:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38017.618836 secs 2024-04-26T22:21:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:43 smithi196 ceph-mon[32572]: pgmap v20380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:21:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:43 smithi110 ceph-mon[28069]: pgmap v20380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:21:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:43 smithi193 ceph-mon[32782]: pgmap v20380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:21:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:21:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:21:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:45 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:21:45.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:45 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:21:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:21:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:45 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:21:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:45 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:21:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:21:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:45 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:21:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:45 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:21:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:46 smithi193 ceph-mon[32782]: pgmap v20381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:21:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:46 smithi193 ceph-mon[32782]: pgmap v20382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:46 smithi196 ceph-mon[32572]: pgmap v20381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:21:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:46 smithi196 ceph-mon[32572]: pgmap v20382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:46 smithi110 ceph-mon[28069]: pgmap v20381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:21:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:46 smithi110 ceph-mon[28069]: pgmap v20382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38022.618945 secs 2024-04-26T22:21:48.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:48 smithi193 ceph-mon[32782]: pgmap v20383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T22:21:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38022.618945 secs 2024-04-26T22:21:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:48 smithi196 ceph-mon[32572]: pgmap v20383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T22:21:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38022.618945 secs 2024-04-26T22:21:48.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:48 smithi110 ceph-mon[28069]: pgmap v20383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 534 B/s rd, 1 op/s 2024-04-26T22:21:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:50 smithi193 ceph-mon[32782]: pgmap v20384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:50 smithi196 ceph-mon[32572]: pgmap v20384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:50.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:50 smithi110 ceph-mon[28069]: pgmap v20384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:52 smithi193 ceph-mon[32782]: pgmap v20385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:52 smithi196 ceph-mon[32572]: pgmap v20385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:52 smithi110 ceph-mon[28069]: pgmap v20385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38027.619070 secs 2024-04-26T22:21:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38027.619070 secs 2024-04-26T22:21:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38027.619070 secs 2024-04-26T22:21:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:54 smithi193 ceph-mon[32782]: pgmap v20386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:54.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:54 smithi196 ceph-mon[32572]: pgmap v20386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:54.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:54 smithi110 ceph-mon[28069]: pgmap v20386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:21:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:56 smithi193 ceph-mon[32782]: pgmap v20387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:21:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:56 smithi196 ceph-mon[32572]: pgmap v20387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:21:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:56 smithi110 ceph-mon[28069]: pgmap v20387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:21:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38032.619197 secs 2024-04-26T22:21:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:21:58 smithi196 ceph-mon[32572]: pgmap v20388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38032.619197 secs 2024-04-26T22:21:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:21:58 smithi110 ceph-mon[28069]: pgmap v20388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:21:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38032.619197 secs 2024-04-26T22:21:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:21:58 smithi193 ceph-mon[32782]: pgmap v20388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:00 smithi196 ceph-mon[32572]: pgmap v20389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:00.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:00 smithi110 ceph-mon[28069]: pgmap v20389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:00 smithi193 ceph-mon[32782]: pgmap v20389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:02 smithi196 ceph-mon[32572]: pgmap v20390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:02 smithi110 ceph-mon[28069]: pgmap v20390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:02 smithi193 ceph-mon[32782]: pgmap v20390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:03.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38037.619338 secs 2024-04-26T22:22:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38037.619338 secs 2024-04-26T22:22:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38037.619338 secs 2024-04-26T22:22:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:04 smithi196 ceph-mon[32572]: pgmap v20391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:04 smithi110 ceph-mon[28069]: pgmap v20391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:04 smithi193 ceph-mon[32782]: pgmap v20391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:06 smithi196 ceph-mon[32572]: pgmap v20392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:06 smithi110 ceph-mon[28069]: pgmap v20392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:06 smithi193 ceph-mon[32782]: pgmap v20392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38042.619462 secs 2024-04-26T22:22:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:08 smithi196 ceph-mon[32572]: pgmap v20393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38042.619462 secs 2024-04-26T22:22:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:08 smithi110 ceph-mon[28069]: pgmap v20393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38042.619462 secs 2024-04-26T22:22:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:08 smithi193 ceph-mon[32782]: pgmap v20393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:10 smithi196 ceph-mon[32572]: pgmap v20394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:10 smithi110 ceph-mon[28069]: pgmap v20394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:10 smithi193 ceph-mon[32782]: pgmap v20394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:12 smithi196 ceph-mon[32572]: pgmap v20395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:12 smithi110 ceph-mon[28069]: pgmap v20395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:12 smithi193 ceph-mon[32782]: pgmap v20395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:13.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38047.619555 secs 2024-04-26T22:22:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38047.619555 secs 2024-04-26T22:22:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38047.619555 secs 2024-04-26T22:22:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:14 smithi196 ceph-mon[32572]: pgmap v20396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:14 smithi110 ceph-mon[28069]: pgmap v20396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:14 smithi193 ceph-mon[32782]: pgmap v20396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:16 smithi196 ceph-mon[32572]: pgmap v20397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:16 smithi110 ceph-mon[28069]: pgmap v20397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:16 smithi193 ceph-mon[32782]: pgmap v20397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38052.619679 secs 2024-04-26T22:22:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:18 smithi196 ceph-mon[32572]: pgmap v20398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38052.619679 secs 2024-04-26T22:22:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:18 smithi110 ceph-mon[28069]: pgmap v20398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38052.619679 secs 2024-04-26T22:22:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:18 smithi193 ceph-mon[32782]: pgmap v20398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:20 smithi196 ceph-mon[32572]: pgmap v20399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:20 smithi110 ceph-mon[28069]: pgmap v20399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:20 smithi193 ceph-mon[32782]: pgmap v20399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:22.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:22 smithi196 ceph-mon[32572]: pgmap v20400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:22 smithi110 ceph-mon[28069]: pgmap v20400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:22 smithi193 ceph-mon[32782]: pgmap v20400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:23 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 38057.619801 secs 2024-04-26T22:22:23.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:23 smithi196 ceph-mon[32572]: slow request 2884.542911 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:22:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:23 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 38057.619801 secs 2024-04-26T22:22:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:23 smithi110 ceph-mon[28069]: slow request 2884.542911 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:22:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:23 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 38057.619801 secs 2024-04-26T22:22:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:23 smithi193 ceph-mon[32782]: slow request 2884.542911 seconds old, received at 2024-04-26T21:34:17.375212+0000: client_request(client.27230:1 getattr pAsLsXsFs #0x1 2024-04-26T21:34:17.369466+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:22:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:24 smithi196 ceph-mon[32572]: pgmap v20401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:24 smithi110 ceph-mon[28069]: pgmap v20401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:24 smithi193 ceph-mon[32782]: pgmap v20401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:26 smithi196 ceph-mon[32572]: pgmap v20402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:26 smithi110 ceph-mon[28069]: pgmap v20402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:26 smithi193 ceph-mon[32782]: pgmap v20402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38062.619921 secs 2024-04-26T22:22:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:28 smithi196 ceph-mon[32572]: pgmap v20403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38062.619921 secs 2024-04-26T22:22:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:28 smithi110 ceph-mon[28069]: pgmap v20403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38062.619921 secs 2024-04-26T22:22:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:28 smithi193 ceph-mon[32782]: pgmap v20403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:30 smithi196 ceph-mon[32572]: pgmap v20404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:30 smithi110 ceph-mon[28069]: pgmap v20404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:30 smithi193 ceph-mon[32782]: pgmap v20404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:32 smithi196 ceph-mon[32572]: pgmap v20405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:32 smithi110 ceph-mon[28069]: pgmap v20405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:32 smithi193 ceph-mon[32782]: pgmap v20405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38067.620043 secs 2024-04-26T22:22:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38067.620043 secs 2024-04-26T22:22:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38067.620043 secs 2024-04-26T22:22:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:34 smithi196 ceph-mon[32572]: pgmap v20406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:34 smithi110 ceph-mon[28069]: pgmap v20406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:34 smithi193 ceph-mon[32782]: pgmap v20406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:36 smithi196 ceph-mon[32572]: pgmap v20407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:36 smithi110 ceph-mon[28069]: pgmap v20407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:36 smithi193 ceph-mon[32782]: pgmap v20407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38072.620187 secs 2024-04-26T22:22:38.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:38 smithi196 ceph-mon[32572]: pgmap v20408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38072.620187 secs 2024-04-26T22:22:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:38 smithi110 ceph-mon[28069]: pgmap v20408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38072.620187 secs 2024-04-26T22:22:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:38 smithi193 ceph-mon[32782]: pgmap v20408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:40 smithi110 ceph-mon[28069]: pgmap v20409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:40 smithi193 ceph-mon[32782]: pgmap v20409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:40 smithi196 ceph-mon[32572]: pgmap v20409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:42 smithi110 ceph-mon[28069]: pgmap v20410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:42 smithi193 ceph-mon[32782]: pgmap v20410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:42 smithi196 ceph-mon[32572]: pgmap v20410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38077.620269 secs 2024-04-26T22:22:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38077.620269 secs 2024-04-26T22:22:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38077.620269 secs 2024-04-26T22:22:44.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:44 smithi110 ceph-mon[28069]: pgmap v20411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:44 smithi193 ceph-mon[32782]: pgmap v20411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:44 smithi196 ceph-mon[32572]: pgmap v20411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:22:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:46 smithi110 ceph-mon[28069]: pgmap v20412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:46.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:22:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:46 smithi193 ceph-mon[32782]: pgmap v20412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:22:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:46 smithi196 ceph-mon[32572]: pgmap v20412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:22:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:22:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:22:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:22:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:47 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:22:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:22:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:22:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:47 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:22:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:22:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:22:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:47 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:22:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:48 smithi193 ceph-mon[32782]: pgmap v20413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T22:22:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:48 smithi193 ceph-mon[32782]: pgmap v20414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:48.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38082.620410 secs 2024-04-26T22:22:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:48 smithi196 ceph-mon[32572]: pgmap v20413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T22:22:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:48 smithi196 ceph-mon[32572]: pgmap v20414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38082.620410 secs 2024-04-26T22:22:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:48 smithi110 ceph-mon[28069]: pgmap v20413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T22:22:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:48 smithi110 ceph-mon[28069]: pgmap v20414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38082.620410 secs 2024-04-26T22:22:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:50 smithi193 ceph-mon[32782]: pgmap v20415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:50 smithi196 ceph-mon[32572]: pgmap v20415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:50 smithi110 ceph-mon[28069]: pgmap v20415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:52 smithi193 ceph-mon[32782]: pgmap v20416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:52 smithi196 ceph-mon[32572]: pgmap v20416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:52 smithi110 ceph-mon[28069]: pgmap v20416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38087.620533 secs 2024-04-26T22:22:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38087.620533 secs 2024-04-26T22:22:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38087.620533 secs 2024-04-26T22:22:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:54 smithi193 ceph-mon[32782]: pgmap v20417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:54 smithi196 ceph-mon[32572]: pgmap v20417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:54 smithi110 ceph-mon[28069]: pgmap v20417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:56 smithi193 ceph-mon[32782]: pgmap v20418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:56 smithi196 ceph-mon[32572]: pgmap v20418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:56 smithi110 ceph-mon[28069]: pgmap v20418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:22:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:58 smithi193 ceph-mon[32782]: pgmap v20419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:22:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:22:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38092.620659 secs 2024-04-26T22:22:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:58 smithi196 ceph-mon[32572]: pgmap v20419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:22:58.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:22:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38092.620659 secs 2024-04-26T22:22:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:58 smithi110 ceph-mon[28069]: pgmap v20419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:22:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:22:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38092.620659 secs 2024-04-26T22:23:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:00 smithi193 ceph-mon[32782]: pgmap v20420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:00 smithi196 ceph-mon[32572]: pgmap v20420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:00 smithi110 ceph-mon[28069]: pgmap v20420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:02 smithi193 ceph-mon[32782]: pgmap v20421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:02 smithi196 ceph-mon[32572]: pgmap v20421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:02 smithi110 ceph-mon[28069]: pgmap v20421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38097.620778 secs 2024-04-26T22:23:03.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38097.620778 secs 2024-04-26T22:23:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38097.620778 secs 2024-04-26T22:23:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:04 smithi193 ceph-mon[32782]: pgmap v20422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:04 smithi196 ceph-mon[32572]: pgmap v20422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:04 smithi110 ceph-mon[28069]: pgmap v20422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:06 smithi193 ceph-mon[32782]: pgmap v20423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:06 smithi196 ceph-mon[32572]: pgmap v20423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:06 smithi110 ceph-mon[28069]: pgmap v20423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:08 smithi193 ceph-mon[32782]: pgmap v20424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:08.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38102.620895 secs 2024-04-26T22:23:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:08 smithi196 ceph-mon[32572]: pgmap v20424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38102.620895 secs 2024-04-26T22:23:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:08 smithi110 ceph-mon[28069]: pgmap v20424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38102.620895 secs 2024-04-26T22:23:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:10 smithi193 ceph-mon[32782]: pgmap v20425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:10 smithi196 ceph-mon[32572]: pgmap v20425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:10 smithi110 ceph-mon[28069]: pgmap v20425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:12 smithi193 ceph-mon[32782]: pgmap v20426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:12 smithi196 ceph-mon[32572]: pgmap v20426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:12 smithi110 ceph-mon[28069]: pgmap v20426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38107.620970 secs 2024-04-26T22:23:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38107.620970 secs 2024-04-26T22:23:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38107.620970 secs 2024-04-26T22:23:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:14 smithi196 ceph-mon[32572]: pgmap v20427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:14 smithi110 ceph-mon[28069]: pgmap v20427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:14 smithi193 ceph-mon[32782]: pgmap v20427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:16 smithi196 ceph-mon[32572]: pgmap v20428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:16 smithi110 ceph-mon[28069]: pgmap v20428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:16 smithi193 ceph-mon[32782]: pgmap v20428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:18.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:18 smithi193 ceph-mon[32782]: pgmap v20429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:18.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38112.621103 secs 2024-04-26T22:23:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:18 smithi196 ceph-mon[32572]: pgmap v20429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38112.621103 secs 2024-04-26T22:23:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:18 smithi110 ceph-mon[28069]: pgmap v20429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38112.621103 secs 2024-04-26T22:23:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:20 smithi196 ceph-mon[32572]: pgmap v20430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:20 smithi110 ceph-mon[28069]: pgmap v20430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:20 smithi193 ceph-mon[32782]: pgmap v20430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:22 smithi196 ceph-mon[32572]: pgmap v20431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:22 smithi110 ceph-mon[28069]: pgmap v20431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:22 smithi193 ceph-mon[32782]: pgmap v20431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38117.621185 secs 2024-04-26T22:23:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38117.621185 secs 2024-04-26T22:23:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38117.621185 secs 2024-04-26T22:23:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:24 smithi196 ceph-mon[32572]: pgmap v20432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:24 smithi110 ceph-mon[28069]: pgmap v20432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:24 smithi193 ceph-mon[32782]: pgmap v20432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:26 smithi196 ceph-mon[32572]: pgmap v20433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:26 smithi110 ceph-mon[28069]: pgmap v20433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:26 smithi193 ceph-mon[32782]: pgmap v20433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:28 smithi196 ceph-mon[32572]: pgmap v20434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38122.621311 secs 2024-04-26T22:23:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:28 smithi110 ceph-mon[28069]: pgmap v20434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38122.621311 secs 2024-04-26T22:23:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:28 smithi193 ceph-mon[32782]: pgmap v20434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38122.621311 secs 2024-04-26T22:23:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:30 smithi196 ceph-mon[32572]: pgmap v20435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:30 smithi110 ceph-mon[28069]: pgmap v20435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:30 smithi193 ceph-mon[32782]: pgmap v20435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:32 smithi196 ceph-mon[32572]: pgmap v20436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:32 smithi110 ceph-mon[28069]: pgmap v20436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:32 smithi193 ceph-mon[32782]: pgmap v20436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38127.621436 secs 2024-04-26T22:23:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38127.621436 secs 2024-04-26T22:23:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38127.621436 secs 2024-04-26T22:23:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:34 smithi196 ceph-mon[32572]: pgmap v20437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:34 smithi110 ceph-mon[28069]: pgmap v20437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:34 smithi193 ceph-mon[32782]: pgmap v20437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:36 smithi196 ceph-mon[32572]: pgmap v20438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:36 smithi110 ceph-mon[28069]: pgmap v20438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:36.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:36 smithi193 ceph-mon[32782]: pgmap v20438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:37.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:23:37.703+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:23:37.704 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:23:37.704+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:23:37.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:23:37.704+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 293 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:23:37.705 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:23:37.704+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 293 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:23:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:38 smithi196 ceph-mon[32572]: pgmap v20439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38132.621558 secs 2024-04-26T22:23:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:38 smithi110 ceph-mon[28069]: pgmap v20439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38132.621558 secs 2024-04-26T22:23:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:38 smithi193 ceph-mon[32782]: pgmap v20439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:38.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38132.621558 secs 2024-04-26T22:23:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:40 smithi196 ceph-mon[32572]: pgmap v20440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:40 smithi110 ceph-mon[28069]: pgmap v20440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:40 smithi193 ceph-mon[32782]: pgmap v20440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:41 smithi110 ceph-mon[28069]: pgmap v20441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:41 smithi193 ceph-mon[32782]: pgmap v20441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:41 smithi196 ceph-mon[32572]: pgmap v20441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38137.621678 secs 2024-04-26T22:23:44.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:43 smithi196 ceph-mon[32572]: pgmap v20442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38137.621678 secs 2024-04-26T22:23:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:43 smithi110 ceph-mon[28069]: pgmap v20442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38137.621678 secs 2024-04-26T22:23:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:43 smithi193 ceph-mon[32782]: pgmap v20442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:45 smithi196 ceph-mon[32572]: pgmap v20443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:46.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:45 smithi110 ceph-mon[28069]: pgmap v20443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:45 smithi193 ceph-mon[32782]: pgmap v20443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:47 smithi196 ceph-mon[32572]: pgmap v20444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:47 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:23:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:47 smithi110 ceph-mon[28069]: pgmap v20444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:47 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:23:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:47 smithi193 ceph-mon[32782]: pgmap v20444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:23:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:47 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:23:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38142.621799 secs 2024-04-26T22:23:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:23:49.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:23:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38142.621799 secs 2024-04-26T22:23:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:23:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:23:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38142.621799 secs 2024-04-26T22:23:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:23:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:23:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:49 smithi193 ceph-mon[32782]: pgmap v20445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:23:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:23:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:49 smithi193 ceph-mon[32782]: pgmap v20446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T22:23:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:49 smithi193 ceph-mon[32782]: pgmap v20447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:23:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:49 smithi196 ceph-mon[32572]: pgmap v20445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:23:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:23:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:49 smithi196 ceph-mon[32572]: pgmap v20446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T22:23:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:49 smithi196 ceph-mon[32572]: pgmap v20447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:23:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:49 smithi110 ceph-mon[28069]: pgmap v20445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:23:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:23:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:49 smithi110 ceph-mon[28069]: pgmap v20446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 985 B/s rd, 1 op/s 2024-04-26T22:23:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:49 smithi110 ceph-mon[28069]: pgmap v20447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:23:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:52 smithi196 ceph-mon[32572]: pgmap v20448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:23:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:52 smithi110 ceph-mon[28069]: pgmap v20448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:23:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:52 smithi193 ceph-mon[32782]: pgmap v20448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:23:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38147.621939 secs 2024-04-26T22:23:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38147.621939 secs 2024-04-26T22:23:53.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38147.621939 secs 2024-04-26T22:23:54.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:54 smithi196 ceph-mon[32572]: pgmap v20449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:54.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:54 smithi110 ceph-mon[28069]: pgmap v20449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:54.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:54 smithi193 ceph-mon[32782]: pgmap v20449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:56 smithi196 ceph-mon[32572]: pgmap v20450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:56.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:56 smithi110 ceph-mon[28069]: pgmap v20450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:56 smithi193 ceph-mon[32782]: pgmap v20450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:23:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38152.622070 secs 2024-04-26T22:23:58.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:23:58 smithi196 ceph-mon[32572]: pgmap v20451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:23:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38152.622070 secs 2024-04-26T22:23:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:23:58 smithi110 ceph-mon[28069]: pgmap v20451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:23:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38152.622070 secs 2024-04-26T22:23:58.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:23:58 smithi193 ceph-mon[32782]: pgmap v20451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 610 B/s rd, 1 op/s 2024-04-26T22:24:00.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:00 smithi196 ceph-mon[32572]: pgmap v20452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:24:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:00 smithi110 ceph-mon[28069]: pgmap v20452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:24:00.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:00 smithi193 ceph-mon[32782]: pgmap v20452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:24:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:02 smithi196 ceph-mon[32572]: pgmap v20453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:02 smithi110 ceph-mon[28069]: pgmap v20453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:02 smithi193 ceph-mon[32782]: pgmap v20453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:03.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38157.622208 secs 2024-04-26T22:24:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38157.622208 secs 2024-04-26T22:24:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38157.622208 secs 2024-04-26T22:24:04.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:04 smithi196 ceph-mon[32572]: pgmap v20454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:04 smithi110 ceph-mon[28069]: pgmap v20454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:04 smithi193 ceph-mon[32782]: pgmap v20454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:06.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:06 smithi196 ceph-mon[32572]: pgmap v20455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:06 smithi110 ceph-mon[28069]: pgmap v20455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:06 smithi193 ceph-mon[32782]: pgmap v20455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38162.622271 secs 2024-04-26T22:24:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:08 smithi196 ceph-mon[32572]: pgmap v20456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38162.622271 secs 2024-04-26T22:24:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:08 smithi110 ceph-mon[28069]: pgmap v20456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38162.622271 secs 2024-04-26T22:24:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:08 smithi193 ceph-mon[32782]: pgmap v20456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:10.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:10 smithi196 ceph-mon[32572]: pgmap v20457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:10.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:10 smithi110 ceph-mon[28069]: pgmap v20457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:10 smithi193 ceph-mon[32782]: pgmap v20457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:12 smithi196 ceph-mon[32572]: pgmap v20458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:12 smithi110 ceph-mon[28069]: pgmap v20458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:12 smithi193 ceph-mon[32782]: pgmap v20458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38167.622372 secs 2024-04-26T22:24:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38167.622372 secs 2024-04-26T22:24:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38167.622372 secs 2024-04-26T22:24:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:14 smithi196 ceph-mon[32572]: pgmap v20459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:14.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:14 smithi110 ceph-mon[28069]: pgmap v20459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:14 smithi193 ceph-mon[32782]: pgmap v20459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:16 smithi196 ceph-mon[32572]: pgmap v20460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:16.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:16 smithi110 ceph-mon[28069]: pgmap v20460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:16 smithi193 ceph-mon[32782]: pgmap v20460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38172.622497 secs 2024-04-26T22:24:18.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:18 smithi196 ceph-mon[32572]: pgmap v20461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38172.622497 secs 2024-04-26T22:24:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:18 smithi110 ceph-mon[28069]: pgmap v20461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38172.622497 secs 2024-04-26T22:24:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:18 smithi193 ceph-mon[32782]: pgmap v20461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:19.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:24:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:24:18.817+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:24:19.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:24:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:24:18.817+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:24:19.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:24:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:24:18.817+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:24:19.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:24:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:24:18.817+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:24:19.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:24:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:24:18.817+0000 7f1b4ec00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:24:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:20 smithi196 ceph-mon[32572]: pgmap v20462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:20.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:20 smithi110 ceph-mon[28069]: pgmap v20462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:20 smithi193 ceph-mon[32782]: pgmap v20462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:22 smithi196 ceph-mon[32572]: pgmap v20463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:22 smithi110 ceph-mon[28069]: pgmap v20463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:22 smithi193 ceph-mon[32782]: pgmap v20463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:22.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:24:22.711+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:24:22.712 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:24:22.711+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:24:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:24:22.712+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 294 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:24:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:24:22.712+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 294 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:24:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38177.622614 secs 2024-04-26T22:24:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38177.622614 secs 2024-04-26T22:24:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38177.622614 secs 2024-04-26T22:24:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:24 smithi196 ceph-mon[32572]: pgmap v20464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:24:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:24 smithi110 ceph-mon[28069]: pgmap v20464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:24:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:24 smithi193 ceph-mon[32782]: pgmap v20464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:24:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:26 smithi196 ceph-mon[32572]: pgmap v20465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:24:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:26 smithi110 ceph-mon[28069]: pgmap v20465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:24:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:26 smithi193 ceph-mon[32782]: pgmap v20465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:24:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38182.622739 secs 2024-04-26T22:24:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:28 smithi196 ceph-mon[32572]: pgmap v20466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:24:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38182.622739 secs 2024-04-26T22:24:28.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:28 smithi110 ceph-mon[28069]: pgmap v20466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:24:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38182.622739 secs 2024-04-26T22:24:28.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:28 smithi193 ceph-mon[32782]: pgmap v20466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:24:30.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:30 smithi110 ceph-mon[28069]: pgmap v20467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:24:30.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:30 smithi193 ceph-mon[32782]: pgmap v20467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:24:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:30 smithi196 ceph-mon[32572]: pgmap v20467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:24:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:32 smithi110 ceph-mon[28069]: pgmap v20468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:24:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:32 smithi193 ceph-mon[32782]: pgmap v20468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:24:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:32 smithi196 ceph-mon[32572]: pgmap v20468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:24:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38187.622859 secs 2024-04-26T22:24:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38187.622859 secs 2024-04-26T22:24:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38187.622859 secs 2024-04-26T22:24:34.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:34 smithi110 ceph-mon[28069]: pgmap v20469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:24:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:34 smithi193 ceph-mon[32782]: pgmap v20469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:24:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:34 smithi196 ceph-mon[32572]: pgmap v20469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:24:36.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:36 smithi110 ceph-mon[28069]: pgmap v20470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:36 smithi193 ceph-mon[32782]: pgmap v20470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:36 smithi196 ceph-mon[32572]: pgmap v20470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38192.622986 secs 2024-04-26T22:24:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:38 smithi110 ceph-mon[28069]: pgmap v20471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:38.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38192.622986 secs 2024-04-26T22:24:38.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:38 smithi196 ceph-mon[32572]: pgmap v20471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38192.622986 secs 2024-04-26T22:24:38.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:38 smithi193 ceph-mon[32782]: pgmap v20471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:40.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:40 smithi110 ceph-mon[28069]: pgmap v20472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:40 smithi193 ceph-mon[32782]: pgmap v20472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:40 smithi196 ceph-mon[32572]: pgmap v20472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:42 smithi193 ceph-mon[32782]: pgmap v20473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:42 smithi196 ceph-mon[32572]: pgmap v20473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:42 smithi110 ceph-mon[28069]: pgmap v20473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38197.623105 secs 2024-04-26T22:24:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38197.623105 secs 2024-04-26T22:24:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38197.623105 secs 2024-04-26T22:24:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:44 smithi193 ceph-mon[32782]: pgmap v20474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:44 smithi196 ceph-mon[32572]: pgmap v20474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:44 smithi110 ceph-mon[28069]: pgmap v20474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:46 smithi193 ceph-mon[32782]: pgmap v20475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:46 smithi196 ceph-mon[32572]: pgmap v20475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:46 smithi110 ceph-mon[28069]: pgmap v20475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38202.623256 secs 2024-04-26T22:24:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:48 smithi193 ceph-mon[32782]: pgmap v20476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38202.623256 secs 2024-04-26T22:24:48.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:48 smithi196 ceph-mon[32572]: pgmap v20476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38202.623256 secs 2024-04-26T22:24:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:48 smithi110 ceph-mon[28069]: pgmap v20476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:24:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:50 smithi193 ceph-mon[32782]: pgmap v20477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:24:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:50 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:50 smithi196 ceph-mon[32572]: pgmap v20477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:24:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:50 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:50 smithi110 ceph-mon[28069]: pgmap v20477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:24:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:24:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:50 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:24:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:24:51.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:24:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:24:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:24:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:24:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:24:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:52 smithi193 ceph-mon[32782]: pgmap v20478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T22:24:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:52 smithi193 ceph-mon[32782]: pgmap v20479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:52 smithi196 ceph-mon[32572]: pgmap v20478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T22:24:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:52 smithi196 ceph-mon[32572]: pgmap v20479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:52 smithi110 ceph-mon[28069]: pgmap v20478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 878 B/s rd, 1 op/s 2024-04-26T22:24:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:52 smithi110 ceph-mon[28069]: pgmap v20479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38207.623372 secs 2024-04-26T22:24:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38207.623372 secs 2024-04-26T22:24:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38207.623372 secs 2024-04-26T22:24:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:54 smithi193 ceph-mon[32782]: pgmap v20480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:54 smithi196 ceph-mon[32572]: pgmap v20480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:54 smithi110 ceph-mon[28069]: pgmap v20480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:56 smithi193 ceph-mon[32782]: pgmap v20481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:56 smithi196 ceph-mon[32572]: pgmap v20481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:56 smithi110 ceph-mon[28069]: pgmap v20481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:58 smithi193 ceph-mon[32782]: pgmap v20482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:24:58 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38212.623495 secs 2024-04-26T22:24:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:58 smithi196 ceph-mon[32572]: pgmap v20482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:58.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:24:58 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38212.623495 secs 2024-04-26T22:24:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:58 smithi110 ceph-mon[28069]: pgmap v20482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:24:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:24:58 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38212.623495 secs 2024-04-26T22:25:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:00 smithi196 ceph-mon[32572]: pgmap v20483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:25:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:00 smithi110 ceph-mon[28069]: pgmap v20483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:25:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:00 smithi193 ceph-mon[32782]: pgmap v20483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:25:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:02 smithi196 ceph-mon[32572]: pgmap v20484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:25:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:02 smithi110 ceph-mon[28069]: pgmap v20484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:25:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:02 smithi193 ceph-mon[32782]: pgmap v20484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:25:03.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38217.623585 secs 2024-04-26T22:25:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38217.623585 secs 2024-04-26T22:25:03.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38217.623585 secs 2024-04-26T22:25:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:04 smithi196 ceph-mon[32572]: pgmap v20485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:25:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:04 smithi110 ceph-mon[28069]: pgmap v20485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:25:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:04 smithi193 ceph-mon[32782]: pgmap v20485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:25:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:06 smithi196 ceph-mon[32572]: pgmap v20486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:25:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:06 smithi110 ceph-mon[28069]: pgmap v20486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:25:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:06 smithi193 ceph-mon[32782]: pgmap v20486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:25:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:08 smithi196 ceph-mon[32572]: pgmap v20487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:25:08.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38222.623711 secs 2024-04-26T22:25:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:08 smithi110 ceph-mon[28069]: pgmap v20487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:25:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38222.623711 secs 2024-04-26T22:25:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:08 smithi193 ceph-mon[32782]: pgmap v20487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:25:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38222.623711 secs 2024-04-26T22:25:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:10 smithi196 ceph-mon[32572]: pgmap v20488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:25:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:10 smithi110 ceph-mon[28069]: pgmap v20488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:25:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:10 smithi193 ceph-mon[32782]: pgmap v20488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:25:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:12 smithi196 ceph-mon[32572]: pgmap v20489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:25:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:12 smithi110 ceph-mon[28069]: pgmap v20489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:25:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:12 smithi193 ceph-mon[32782]: pgmap v20489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:25:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38227.623836 secs 2024-04-26T22:25:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38227.623836 secs 2024-04-26T22:25:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38227.623836 secs 2024-04-26T22:25:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:14 smithi196 ceph-mon[32572]: pgmap v20490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:25:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:14 smithi110 ceph-mon[28069]: pgmap v20490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:25:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:14 smithi193 ceph-mon[32782]: pgmap v20490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:25:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:16 smithi196 ceph-mon[32572]: pgmap v20491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:16 smithi110 ceph-mon[28069]: pgmap v20491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:16 smithi193 ceph-mon[32782]: pgmap v20491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:18 smithi196 ceph-mon[32572]: pgmap v20492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:18 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38232.623968 secs 2024-04-26T22:25:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:18 smithi110 ceph-mon[28069]: pgmap v20492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:18 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38232.623968 secs 2024-04-26T22:25:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:18 smithi193 ceph-mon[32782]: pgmap v20492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:18 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38232.623968 secs 2024-04-26T22:25:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:20 smithi196 ceph-mon[32572]: pgmap v20493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:20 smithi110 ceph-mon[28069]: pgmap v20493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:20 smithi193 ceph-mon[32782]: pgmap v20493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:22 smithi196 ceph-mon[32572]: pgmap v20494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:22 smithi110 ceph-mon[28069]: pgmap v20494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:22 smithi193 ceph-mon[32782]: pgmap v20494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38237.624118 secs 2024-04-26T22:25:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38237.624118 secs 2024-04-26T22:25:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38237.624118 secs 2024-04-26T22:25:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:24 smithi196 ceph-mon[32572]: pgmap v20495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:24 smithi110 ceph-mon[28069]: pgmap v20495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:24 smithi193 ceph-mon[32782]: pgmap v20495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:26 smithi196 ceph-mon[32572]: pgmap v20496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:26 smithi110 ceph-mon[28069]: pgmap v20496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:26 smithi193 ceph-mon[32782]: pgmap v20496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:28 smithi196 ceph-mon[32572]: pgmap v20497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38242.624230 secs 2024-04-26T22:25:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:28 smithi110 ceph-mon[28069]: pgmap v20497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38242.624230 secs 2024-04-26T22:25:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:28 smithi193 ceph-mon[32782]: pgmap v20497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38242.624230 secs 2024-04-26T22:25:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:30 smithi196 ceph-mon[32572]: pgmap v20498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:30 smithi110 ceph-mon[28069]: pgmap v20498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:30 smithi193 ceph-mon[32782]: pgmap v20498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:32 smithi196 ceph-mon[32572]: pgmap v20499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:32 smithi110 ceph-mon[28069]: pgmap v20499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:32 smithi193 ceph-mon[32782]: pgmap v20499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38247.624350 secs 2024-04-26T22:25:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38247.624350 secs 2024-04-26T22:25:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38247.624350 secs 2024-04-26T22:25:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:34 smithi196 ceph-mon[32572]: pgmap v20500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:34 smithi110 ceph-mon[28069]: pgmap v20500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:34 smithi193 ceph-mon[32782]: pgmap v20500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:35 smithi110 ceph-mon[28069]: pgmap v20501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:35 smithi193 ceph-mon[32782]: pgmap v20501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:35 smithi196 ceph-mon[32572]: pgmap v20501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:37 smithi193 ceph-mon[32782]: pgmap v20502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:37 smithi196 ceph-mon[32572]: pgmap v20502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:37 smithi110 ceph-mon[28069]: pgmap v20502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:38 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38252.624493 secs 2024-04-26T22:25:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:38 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38252.624493 secs 2024-04-26T22:25:39.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:38 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38252.624493 secs 2024-04-26T22:25:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:39 smithi193 ceph-mon[32782]: pgmap v20503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:39 smithi196 ceph-mon[32572]: pgmap v20503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:40.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:39 smithi110 ceph-mon[28069]: pgmap v20503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:41 smithi193 ceph-mon[32782]: pgmap v20504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:41 smithi196 ceph-mon[32572]: pgmap v20504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:42.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:41 smithi110 ceph-mon[28069]: pgmap v20504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:43 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38257.624619 secs 2024-04-26T22:25:44.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:43 smithi193 ceph-mon[32782]: pgmap v20505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:43 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38257.624619 secs 2024-04-26T22:25:44.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:43 smithi196 ceph-mon[32572]: pgmap v20505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:43 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38257.624619 secs 2024-04-26T22:25:44.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:43 smithi110 ceph-mon[28069]: pgmap v20505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:45 smithi193 ceph-mon[32782]: pgmap v20506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:45 smithi196 ceph-mon[32572]: pgmap v20506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:46.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:45 smithi110 ceph-mon[28069]: pgmap v20506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:47 smithi193 ceph-mon[32782]: pgmap v20507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:47 smithi196 ceph-mon[32572]: pgmap v20507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:47 smithi110 ceph-mon[28069]: pgmap v20507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:49.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:48 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38262.624709 secs 2024-04-26T22:25:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:48 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38262.624709 secs 2024-04-26T22:25:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:48 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38262.624709 secs 2024-04-26T22:25:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:49 smithi196 ceph-mon[32572]: pgmap v20508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:50.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:49 smithi193 ceph-mon[32782]: pgmap v20508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:50.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:49 smithi110 ceph-mon[28069]: pgmap v20508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:52.147 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:51 smithi196 ceph-mon[32572]: pgmap v20509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:52.147 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:25:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:51 smithi110 ceph-mon[28069]: pgmap v20509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:25:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:51 smithi193 ceph-mon[32782]: pgmap v20509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38267.624768 secs 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: pgmap v20510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:53 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38267.624768 secs 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: pgmap v20510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:53 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38267.624768 secs 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: pgmap v20510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:54.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:53 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:25:55.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:54 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:25:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:25:55.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:54 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:55.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:25:55.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:54 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:25:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:55 smithi196 ceph-mon[32572]: pgmap v20511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:55 smithi110 ceph-mon[28069]: pgmap v20511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:55 smithi193 ceph-mon[32782]: pgmap v20511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:25:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:56.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:25:57.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:25:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:25:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:25:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: pgmap v20512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T22:25:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: pgmap v20513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:25:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:57.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:56 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38272.624867 secs 2024-04-26T22:25:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: pgmap v20512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: pgmap v20513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:57.292 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:56 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38272.624867 secs 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:25:57.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: pgmap v20512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 885 B/s rd, 1 op/s 2024-04-26T22:25:57.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: pgmap v20513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:25:57.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:25:57.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:56 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38272.624867 secs 2024-04-26T22:25:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:25:59 smithi196 ceph-mon[32572]: pgmap v20514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:25:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:25:59 smithi110 ceph-mon[28069]: pgmap v20514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:25:59.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:25:59 smithi193 ceph-mon[32782]: pgmap v20514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:01 smithi196 ceph-mon[32572]: pgmap v20515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:01 smithi110 ceph-mon[28069]: pgmap v20515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:01 smithi193 ceph-mon[32782]: pgmap v20515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38277.624947 secs 2024-04-26T22:26:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38277.624947 secs 2024-04-26T22:26:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38277.624947 secs 2024-04-26T22:26:03.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:03 smithi110 ceph-mon[28069]: pgmap v20516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:26:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:03 smithi196 ceph-mon[32572]: pgmap v20516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:26:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:03 smithi193 ceph-mon[32782]: pgmap v20516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:26:05.431 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:05 smithi110 ceph-mon[28069]: pgmap v20517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:05 smithi196 ceph-mon[32572]: pgmap v20517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:05 smithi193 ceph-mon[32782]: pgmap v20517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:07 smithi196 ceph-mon[32572]: pgmap v20518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:26:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38282.625095 secs 2024-04-26T22:26:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:07 smithi110 ceph-mon[28069]: pgmap v20518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:26:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38282.625095 secs 2024-04-26T22:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:07 smithi193 ceph-mon[32782]: pgmap v20518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:26:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38282.625095 secs 2024-04-26T22:26:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:09 smithi196 ceph-mon[32572]: pgmap v20519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:09 smithi110 ceph-mon[28069]: pgmap v20519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:09 smithi193 ceph-mon[32782]: pgmap v20519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:11.753 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:11 smithi196 ceph-mon[32572]: pgmap v20520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:11 smithi110 ceph-mon[28069]: pgmap v20520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:11 smithi193 ceph-mon[32782]: pgmap v20520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38287.625220 secs 2024-04-26T22:26:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38287.625220 secs 2024-04-26T22:26:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38287.625220 secs 2024-04-26T22:26:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:13 smithi196 ceph-mon[32572]: pgmap v20521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:13 smithi110 ceph-mon[28069]: pgmap v20521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:13 smithi193 ceph-mon[32782]: pgmap v20521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:15 smithi196 ceph-mon[32572]: pgmap v20522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:15 smithi110 ceph-mon[28069]: pgmap v20522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:15 smithi193 ceph-mon[32782]: pgmap v20522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:17 smithi196 ceph-mon[32572]: pgmap v20523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38292.625343 secs 2024-04-26T22:26:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:17 smithi110 ceph-mon[28069]: pgmap v20523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38292.625343 secs 2024-04-26T22:26:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:17 smithi193 ceph-mon[32782]: pgmap v20523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38292.625343 secs 2024-04-26T22:26:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:19 smithi196 ceph-mon[32572]: pgmap v20524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:19 smithi110 ceph-mon[28069]: pgmap v20524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:19 smithi193 ceph-mon[32782]: pgmap v20524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:21 smithi196 ceph-mon[32572]: pgmap v20525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:21 smithi110 ceph-mon[28069]: pgmap v20525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:21 smithi193 ceph-mon[32782]: pgmap v20525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38297.625464 secs 2024-04-26T22:26:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38297.625464 secs 2024-04-26T22:26:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38297.625464 secs 2024-04-26T22:26:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:23 smithi196 ceph-mon[32572]: pgmap v20526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:23 smithi110 ceph-mon[28069]: pgmap v20526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:23 smithi193 ceph-mon[32782]: pgmap v20526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:25 smithi196 ceph-mon[32572]: pgmap v20527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:25 smithi110 ceph-mon[28069]: pgmap v20527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:25 smithi193 ceph-mon[32782]: pgmap v20527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:27 smithi196 ceph-mon[32572]: pgmap v20528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38302.625609 secs 2024-04-26T22:26:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:27 smithi110 ceph-mon[28069]: pgmap v20528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38302.625609 secs 2024-04-26T22:26:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:27 smithi193 ceph-mon[32782]: pgmap v20528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38302.625609 secs 2024-04-26T22:26:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:28 smithi110 ceph-mon[28069]: pgmap v20529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:28 smithi193 ceph-mon[32782]: pgmap v20529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:28 smithi196 ceph-mon[32572]: pgmap v20529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:31 smithi196 ceph-mon[32572]: pgmap v20530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:31 smithi110 ceph-mon[28069]: pgmap v20530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:31 smithi193 ceph-mon[32782]: pgmap v20530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38307.625728 secs 2024-04-26T22:26:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38307.625728 secs 2024-04-26T22:26:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38307.625728 secs 2024-04-26T22:26:33.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:33 smithi110 ceph-mon[28069]: pgmap v20531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:33 smithi196 ceph-mon[32572]: pgmap v20531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:33 smithi193 ceph-mon[32782]: pgmap v20531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:35 smithi196 ceph-mon[32572]: pgmap v20532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:35 smithi110 ceph-mon[28069]: pgmap v20532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:35 smithi193 ceph-mon[32782]: pgmap v20532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:37 smithi196 ceph-mon[32572]: pgmap v20533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38312.625856 secs 2024-04-26T22:26:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:37 smithi110 ceph-mon[28069]: pgmap v20533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38312.625856 secs 2024-04-26T22:26:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:37 smithi193 ceph-mon[32782]: pgmap v20533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38312.625856 secs 2024-04-26T22:26:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:39 smithi196 ceph-mon[32572]: pgmap v20534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:39 smithi110 ceph-mon[28069]: pgmap v20534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:39 smithi193 ceph-mon[32782]: pgmap v20534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:41 smithi196 ceph-mon[32572]: pgmap v20535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:41 smithi110 ceph-mon[28069]: pgmap v20535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:41 smithi193 ceph-mon[32782]: pgmap v20535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38317.625941 secs 2024-04-26T22:26:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38317.625941 secs 2024-04-26T22:26:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38317.625941 secs 2024-04-26T22:26:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:43 smithi196 ceph-mon[32572]: pgmap v20536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:43 smithi110 ceph-mon[28069]: pgmap v20536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:43 smithi193 ceph-mon[32782]: pgmap v20536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:45 smithi196 ceph-mon[32572]: pgmap v20537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:45 smithi110 ceph-mon[28069]: pgmap v20537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:45 smithi193 ceph-mon[32782]: pgmap v20537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:47 smithi196 ceph-mon[32572]: pgmap v20538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38322.626063 secs 2024-04-26T22:26:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:47 smithi110 ceph-mon[28069]: pgmap v20538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38322.626063 secs 2024-04-26T22:26:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:47 smithi193 ceph-mon[32782]: pgmap v20538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38322.626063 secs 2024-04-26T22:26:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:49 smithi196 ceph-mon[32572]: pgmap v20539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:49 smithi110 ceph-mon[28069]: pgmap v20539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:49 smithi193 ceph-mon[32782]: pgmap v20539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:51 smithi196 ceph-mon[32572]: pgmap v20540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:51 smithi110 ceph-mon[28069]: pgmap v20540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:51 smithi193 ceph-mon[32782]: pgmap v20540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38327.626213 secs 2024-04-26T22:26:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38327.626213 secs 2024-04-26T22:26:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38327.626213 secs 2024-04-26T22:26:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:53 smithi196 ceph-mon[32572]: pgmap v20541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:53 smithi110 ceph-mon[28069]: pgmap v20541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:53.870 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:53 smithi193 ceph-mon[32782]: pgmap v20541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:26:55.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:55 smithi110 ceph-mon[28069]: pgmap v20542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:55 smithi193 ceph-mon[32782]: pgmap v20542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:55 smithi196 ceph-mon[32572]: pgmap v20542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:26:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:56 smithi193 ceph-mon[32782]: pgmap v20543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:56 smithi196 ceph-mon[32572]: pgmap v20543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:56 smithi110 ceph-mon[28069]: pgmap v20543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:26:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:26:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38332.626308 secs 2024-04-26T22:26:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:26:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38332.626308 secs 2024-04-26T22:26:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:26:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38332.626308 secs 2024-04-26T22:26:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:26:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:26:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:58 smithi193 ceph-mon[32782]: pgmap v20544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:26:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:58 smithi193 ceph-mon[32782]: pgmap v20545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:26:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:26:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:26:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:26:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:58 smithi196 ceph-mon[32572]: pgmap v20544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:26:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:58 smithi196 ceph-mon[32572]: pgmap v20545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:26:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:26:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:26:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:26:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:58 smithi110 ceph-mon[28069]: pgmap v20544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:26:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:58 smithi110 ceph-mon[28069]: pgmap v20545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:26:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:26:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:27:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:01 smithi196 ceph-mon[32572]: pgmap v20546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:27:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:01 smithi110 ceph-mon[28069]: pgmap v20546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:27:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:01 smithi193 ceph-mon[32782]: pgmap v20546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:27:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38337.626456 secs 2024-04-26T22:27:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38337.626456 secs 2024-04-26T22:27:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38337.626456 secs 2024-04-26T22:27:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:03 smithi196 ceph-mon[32572]: pgmap v20547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 525 B/s rd, 1 op/s 2024-04-26T22:27:03.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:03 smithi110 ceph-mon[28069]: pgmap v20547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 525 B/s rd, 1 op/s 2024-04-26T22:27:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:03 smithi193 ceph-mon[32782]: pgmap v20547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 525 B/s rd, 1 op/s 2024-04-26T22:27:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:05 smithi196 ceph-mon[32572]: pgmap v20548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:27:05.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:05 smithi110 ceph-mon[28069]: pgmap v20548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:27:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:05 smithi193 ceph-mon[32782]: pgmap v20548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:27:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:07 smithi196 ceph-mon[32572]: pgmap v20549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:27:07.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38342.626604 secs 2024-04-26T22:27:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:07 smithi110 ceph-mon[28069]: pgmap v20549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:27:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38342.626604 secs 2024-04-26T22:27:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:07 smithi193 ceph-mon[32782]: pgmap v20549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:27:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38342.626604 secs 2024-04-26T22:27:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:09 smithi196 ceph-mon[32572]: pgmap v20550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:27:09.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:09 smithi110 ceph-mon[28069]: pgmap v20550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:27:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:09 smithi193 ceph-mon[32782]: pgmap v20550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:27:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:11 smithi196 ceph-mon[32572]: pgmap v20551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:11.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:11 smithi110 ceph-mon[28069]: pgmap v20551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:11 smithi193 ceph-mon[32782]: pgmap v20551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38347.626699 secs 2024-04-26T22:27:12.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38347.626699 secs 2024-04-26T22:27:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38347.626699 secs 2024-04-26T22:27:13.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:13 smithi196 ceph-mon[32572]: pgmap v20552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:13.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:13 smithi110 ceph-mon[28069]: pgmap v20552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:13 smithi193 ceph-mon[32782]: pgmap v20552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:15.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:15 smithi196 ceph-mon[32572]: pgmap v20553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:15.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:15 smithi110 ceph-mon[28069]: pgmap v20553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:15 smithi193 ceph-mon[32782]: pgmap v20553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:17 smithi196 ceph-mon[32572]: pgmap v20554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:17.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38352.626837 secs 2024-04-26T22:27:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:17 smithi110 ceph-mon[28069]: pgmap v20554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38352.626837 secs 2024-04-26T22:27:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:17 smithi193 ceph-mon[32782]: pgmap v20554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38352.626837 secs 2024-04-26T22:27:19.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:19 smithi196 ceph-mon[32572]: pgmap v20555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:19 smithi110 ceph-mon[28069]: pgmap v20555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:19 smithi193 ceph-mon[32782]: pgmap v20555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:21.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:21 smithi196 ceph-mon[32572]: pgmap v20556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:21.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:21 smithi110 ceph-mon[28069]: pgmap v20556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:21 smithi193 ceph-mon[32782]: pgmap v20556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38357.626930 secs 2024-04-26T22:27:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38357.626930 secs 2024-04-26T22:27:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:27:22.742+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:27:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:27:22.742+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:27:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:27:22.742+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 295 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:27:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:27:22.742+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 295 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:27:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38357.626930 secs 2024-04-26T22:27:23.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:23 smithi110 ceph-mon[28069]: pgmap v20557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:23 smithi193 ceph-mon[32782]: pgmap v20557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:23.759 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:23 smithi196 ceph-mon[32572]: pgmap v20557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:25 smithi110 ceph-mon[28069]: pgmap v20558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:25 smithi193 ceph-mon[32782]: pgmap v20558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:25 smithi196 ceph-mon[32572]: pgmap v20558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:27 smithi110 ceph-mon[28069]: pgmap v20559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38362.627056 secs 2024-04-26T22:27:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:27 smithi193 ceph-mon[32782]: pgmap v20559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38362.627056 secs 2024-04-26T22:27:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:27 smithi196 ceph-mon[32572]: pgmap v20559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38362.627056 secs 2024-04-26T22:27:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:29 smithi110 ceph-mon[28069]: pgmap v20560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:29.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:29 smithi193 ceph-mon[32782]: pgmap v20560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:29 smithi196 ceph-mon[32572]: pgmap v20560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:31 smithi110 ceph-mon[28069]: pgmap v20561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:27:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:31 smithi193 ceph-mon[32782]: pgmap v20561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:27:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:31 smithi196 ceph-mon[32572]: pgmap v20561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:27:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38367.627169 secs 2024-04-26T22:27:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38367.627169 secs 2024-04-26T22:27:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38367.627169 secs 2024-04-26T22:27:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:33 smithi193 ceph-mon[32782]: pgmap v20562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:27:33.693 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:33 smithi110 ceph-mon[28069]: pgmap v20562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:27:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:33 smithi196 ceph-mon[32572]: pgmap v20562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:27:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:35 smithi193 ceph-mon[32782]: pgmap v20563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:35 smithi196 ceph-mon[32572]: pgmap v20563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:35 smithi110 ceph-mon[28069]: pgmap v20563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:37 smithi193 ceph-mon[32782]: pgmap v20564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:27:37.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38372.627308 secs 2024-04-26T22:27:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:37 smithi196 ceph-mon[32572]: pgmap v20564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:27:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38372.627308 secs 2024-04-26T22:27:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:37 smithi110 ceph-mon[28069]: pgmap v20564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:27:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38372.627308 secs 2024-04-26T22:27:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:39 smithi193 ceph-mon[32782]: pgmap v20565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:39 smithi196 ceph-mon[32572]: pgmap v20565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:39 smithi110 ceph-mon[28069]: pgmap v20565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:41 smithi193 ceph-mon[32782]: pgmap v20566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:41 smithi196 ceph-mon[32572]: pgmap v20566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:41 smithi110 ceph-mon[28069]: pgmap v20566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38377.627429 secs 2024-04-26T22:27:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38377.627429 secs 2024-04-26T22:27:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38377.627429 secs 2024-04-26T22:27:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:43 smithi193 ceph-mon[32782]: pgmap v20567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:43 smithi196 ceph-mon[32572]: pgmap v20567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:43 smithi110 ceph-mon[28069]: pgmap v20567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:45 smithi193 ceph-mon[32782]: pgmap v20568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:45 smithi196 ceph-mon[32572]: pgmap v20568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:45 smithi110 ceph-mon[28069]: pgmap v20568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:47 smithi193 ceph-mon[32782]: pgmap v20569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:47.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38382.627560 secs 2024-04-26T22:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:47 smithi196 ceph-mon[32572]: pgmap v20569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38382.627560 secs 2024-04-26T22:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:47 smithi110 ceph-mon[28069]: pgmap v20569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38382.627560 secs 2024-04-26T22:27:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:49 smithi193 ceph-mon[32782]: pgmap v20570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:49 smithi196 ceph-mon[32572]: pgmap v20570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:49 smithi110 ceph-mon[28069]: pgmap v20570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:51 smithi193 ceph-mon[32782]: pgmap v20571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:51 smithi196 ceph-mon[32572]: pgmap v20571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:51 smithi110 ceph-mon[28069]: pgmap v20571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38387.627690 secs 2024-04-26T22:27:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38387.627690 secs 2024-04-26T22:27:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38387.627690 secs 2024-04-26T22:27:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:53 smithi193 ceph-mon[32782]: pgmap v20572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:53 smithi196 ceph-mon[32572]: pgmap v20572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:53 smithi110 ceph-mon[28069]: pgmap v20572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:55 smithi193 ceph-mon[32782]: pgmap v20573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:55 smithi196 ceph-mon[32572]: pgmap v20573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:55 smithi110 ceph-mon[28069]: pgmap v20573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:57 smithi196 ceph-mon[32572]: pgmap v20574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38392.627815 secs 2024-04-26T22:27:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:57 smithi110 ceph-mon[28069]: pgmap v20574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38392.627815 secs 2024-04-26T22:27:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:57 smithi193 ceph-mon[32782]: pgmap v20574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:27:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38392.627815 secs 2024-04-26T22:27:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:59 smithi196 ceph-mon[32572]: pgmap v20575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:59.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:27:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:27:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:59 smithi110 ceph-mon[28069]: pgmap v20575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:27:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:27:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:59 smithi193 ceph-mon[32782]: pgmap v20575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:27:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:27:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:28:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:28:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:28:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:28:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:28:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:28:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:28:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:28:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:28:00.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:28:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:01 smithi196 ceph-mon[32572]: pgmap v20576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:28:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:01 smithi196 ceph-mon[32572]: pgmap v20577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:01 smithi110 ceph-mon[28069]: pgmap v20576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:28:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:01 smithi110 ceph-mon[28069]: pgmap v20577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:01 smithi193 ceph-mon[32782]: pgmap v20576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:28:01.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:01 smithi193 ceph-mon[32782]: pgmap v20577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38397.627950 secs 2024-04-26T22:28:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38397.627950 secs 2024-04-26T22:28:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38397.627950 secs 2024-04-26T22:28:03.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:03 smithi110 ceph-mon[28069]: pgmap v20578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:03 smithi196 ceph-mon[32572]: pgmap v20578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:03 smithi193 ceph-mon[32782]: pgmap v20578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:05 smithi196 ceph-mon[32572]: pgmap v20579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:05 smithi110 ceph-mon[28069]: pgmap v20579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:05 smithi193 ceph-mon[32782]: pgmap v20579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:07 smithi196 ceph-mon[32572]: pgmap v20580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38402.628069 secs 2024-04-26T22:28:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:07 smithi110 ceph-mon[28069]: pgmap v20580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38402.628069 secs 2024-04-26T22:28:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:07 smithi193 ceph-mon[32782]: pgmap v20580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38402.628069 secs 2024-04-26T22:28:09.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:09 smithi196 ceph-mon[32572]: pgmap v20581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:09 smithi110 ceph-mon[28069]: pgmap v20581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:09 smithi193 ceph-mon[32782]: pgmap v20581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:28:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:11 smithi196 ceph-mon[32572]: pgmap v20582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:28:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:11 smithi110 ceph-mon[28069]: pgmap v20582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:28:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:11 smithi193 ceph-mon[32782]: pgmap v20582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:28:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:12 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 38407.628196 secs 2024-04-26T22:28:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:12 smithi196 ceph-mon[32572]: slow request 23044.105461 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:28:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:12 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 38407.628196 secs 2024-04-26T22:28:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:12 smithi110 ceph-mon[28069]: slow request 23044.105461 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:28:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:12 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 38407.628196 secs 2024-04-26T22:28:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:12 smithi193 ceph-mon[32782]: slow request 23044.105461 seconds old, received at 2024-04-26T16:04:07.821057+0000: client_request(client.26861:1 getattr pAsLsXsFs #0x1 2024-04-26T16:04:07.816253+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:28:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:13 smithi196 ceph-mon[32572]: pgmap v20583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:13 smithi110 ceph-mon[28069]: pgmap v20583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:13 smithi193 ceph-mon[32782]: pgmap v20583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:15.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:15 smithi196 ceph-mon[32572]: pgmap v20584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:15 smithi110 ceph-mon[28069]: pgmap v20584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:15 smithi193 ceph-mon[32782]: pgmap v20584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:17 smithi196 ceph-mon[32572]: pgmap v20585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38412.628338 secs 2024-04-26T22:28:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:17 smithi110 ceph-mon[28069]: pgmap v20585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38412.628338 secs 2024-04-26T22:28:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:17 smithi193 ceph-mon[32782]: pgmap v20585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38412.628338 secs 2024-04-26T22:28:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:19 smithi196 ceph-mon[32572]: pgmap v20586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:19 smithi110 ceph-mon[28069]: pgmap v20586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:19 smithi193 ceph-mon[32782]: pgmap v20586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:21.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:21 smithi196 ceph-mon[32572]: pgmap v20587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:21.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:21 smithi110 ceph-mon[28069]: pgmap v20587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:21.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:21 smithi193 ceph-mon[32782]: pgmap v20587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38417.628482 secs 2024-04-26T22:28:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38417.628482 secs 2024-04-26T22:28:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38417.628482 secs 2024-04-26T22:28:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:23 smithi196 ceph-mon[32572]: pgmap v20588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:23 smithi110 ceph-mon[28069]: pgmap v20588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:23 smithi193 ceph-mon[32782]: pgmap v20588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:25 smithi196 ceph-mon[32572]: pgmap v20589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:25 smithi110 ceph-mon[28069]: pgmap v20589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:25 smithi193 ceph-mon[32782]: pgmap v20589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:27 smithi196 ceph-mon[32572]: pgmap v20590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38422.628631 secs 2024-04-26T22:28:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:27 smithi110 ceph-mon[28069]: pgmap v20590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38422.628631 secs 2024-04-26T22:28:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:27 smithi193 ceph-mon[32782]: pgmap v20590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38422.628631 secs 2024-04-26T22:28:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:29 smithi196 ceph-mon[32572]: pgmap v20591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:29 smithi110 ceph-mon[28069]: pgmap v20591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:29 smithi193 ceph-mon[32782]: pgmap v20591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:31 smithi196 ceph-mon[32572]: pgmap v20592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:31 smithi110 ceph-mon[28069]: pgmap v20592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:31 smithi193 ceph-mon[32782]: pgmap v20592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38427.628725 secs 2024-04-26T22:28:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38427.628725 secs 2024-04-26T22:28:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38427.628725 secs 2024-04-26T22:28:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:33 smithi110 ceph-mon[28069]: pgmap v20593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:33 smithi193 ceph-mon[32782]: pgmap v20593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:33 smithi196 ceph-mon[32572]: pgmap v20593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:35 smithi110 ceph-mon[28069]: pgmap v20594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:35 smithi193 ceph-mon[32782]: pgmap v20594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:35 smithi196 ceph-mon[32572]: pgmap v20594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:37 smithi110 ceph-mon[28069]: pgmap v20595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38432.628884 secs 2024-04-26T22:28:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:37 smithi193 ceph-mon[32782]: pgmap v20595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38432.628884 secs 2024-04-26T22:28:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:37 smithi196 ceph-mon[32572]: pgmap v20595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38432.628884 secs 2024-04-26T22:28:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:39 smithi110 ceph-mon[28069]: pgmap v20596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:39.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:39 smithi196 ceph-mon[32572]: pgmap v20596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:39 smithi193 ceph-mon[32782]: pgmap v20596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:40.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:40 smithi193 ceph-mon[32782]: pgmap v20597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:40 smithi196 ceph-mon[32572]: pgmap v20597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:40 smithi110 ceph-mon[28069]: pgmap v20597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:42 smithi193 ceph-mon[32782]: pgmap v20598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38437.628972 secs 2024-04-26T22:28:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:42 smithi196 ceph-mon[32572]: pgmap v20598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:43.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38437.628972 secs 2024-04-26T22:28:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:42 smithi110 ceph-mon[28069]: pgmap v20598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:43.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38437.628972 secs 2024-04-26T22:28:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:44 smithi193 ceph-mon[32782]: pgmap v20599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:44 smithi196 ceph-mon[32572]: pgmap v20599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:45.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:44 smithi110 ceph-mon[28069]: pgmap v20599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:46 smithi193 ceph-mon[32782]: pgmap v20600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:46 smithi196 ceph-mon[32572]: pgmap v20600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:47.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:46 smithi110 ceph-mon[28069]: pgmap v20600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38442.629114 secs 2024-04-26T22:28:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38442.629114 secs 2024-04-26T22:28:48.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38442.629114 secs 2024-04-26T22:28:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:48 smithi193 ceph-mon[32782]: pgmap v20601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:48 smithi196 ceph-mon[32572]: pgmap v20601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:49.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:48 smithi110 ceph-mon[28069]: pgmap v20601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:50 smithi193 ceph-mon[32782]: pgmap v20602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:50 smithi196 ceph-mon[32572]: pgmap v20602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:51.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:50 smithi110 ceph-mon[28069]: pgmap v20602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:52 smithi193 ceph-mon[32782]: pgmap v20603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:53.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38447.629246 secs 2024-04-26T22:28:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:52 smithi196 ceph-mon[32572]: pgmap v20603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:53.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38447.629246 secs 2024-04-26T22:28:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:52 smithi110 ceph-mon[28069]: pgmap v20603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38447.629246 secs 2024-04-26T22:28:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:54 smithi193 ceph-mon[32782]: pgmap v20604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:54 smithi196 ceph-mon[32572]: pgmap v20604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:55.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:54 smithi110 ceph-mon[28069]: pgmap v20604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:56 smithi193 ceph-mon[32782]: pgmap v20605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:56 smithi196 ceph-mon[32572]: pgmap v20605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:57.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:56 smithi110 ceph-mon[28069]: pgmap v20605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:28:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38452.629371 secs 2024-04-26T22:28:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38452.629371 secs 2024-04-26T22:28:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38452.629371 secs 2024-04-26T22:28:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:28:58 smithi193 ceph-mon[32782]: pgmap v20606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:28:58 smithi196 ceph-mon[32572]: pgmap v20606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:28:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:28:58 smithi110 ceph-mon[28069]: pgmap v20606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:00 smithi196 ceph-mon[32572]: pgmap v20607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:29:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:00 smithi110 ceph-mon[28069]: pgmap v20607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:29:01.339 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:00 smithi193 ceph-mon[32782]: pgmap v20607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:01.339 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:29:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:02 smithi193 ceph-mon[32782]: pgmap v20608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38457.629522 secs 2024-04-26T22:29:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:02 smithi196 ceph-mon[32572]: pgmap v20608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:03.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38457.629522 secs 2024-04-26T22:29:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:02 smithi110 ceph-mon[28069]: pgmap v20608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38457.629522 secs 2024-04-26T22:29:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:05 smithi193 ceph-mon[32782]: pgmap v20609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:29:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:29:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:05 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:05 smithi196 ceph-mon[32572]: pgmap v20609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:29:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:29:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:05 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:05 smithi110 ceph-mon[28069]: pgmap v20609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:29:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:29:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:05 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:29:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:06 smithi110 ceph-mon[28069]: pgmap v20610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 950 B/s rd, 1 op/s 2024-04-26T22:29:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:06 smithi110 ceph-mon[28069]: pgmap v20611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:06 smithi193 ceph-mon[32782]: pgmap v20610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 950 B/s rd, 1 op/s 2024-04-26T22:29:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:06 smithi193 ceph-mon[32782]: pgmap v20611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:06 smithi196 ceph-mon[32572]: pgmap v20610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 950 B/s rd, 1 op/s 2024-04-26T22:29:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:06 smithi196 ceph-mon[32572]: pgmap v20611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38462.629669 secs 2024-04-26T22:29:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38462.629669 secs 2024-04-26T22:29:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38462.629669 secs 2024-04-26T22:29:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:08 smithi110 ceph-mon[28069]: pgmap v20612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 583 B/s rd, 1 op/s 2024-04-26T22:29:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:08 smithi193 ceph-mon[32782]: pgmap v20612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 583 B/s rd, 1 op/s 2024-04-26T22:29:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:08 smithi196 ceph-mon[32572]: pgmap v20612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 583 B/s rd, 1 op/s 2024-04-26T22:29:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:09 smithi193 ceph-mon[32782]: pgmap v20613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:09.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:09 smithi196 ceph-mon[32572]: pgmap v20613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:09 smithi110 ceph-mon[28069]: pgmap v20613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:11 smithi193 ceph-mon[32782]: pgmap v20614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:11 smithi196 ceph-mon[32572]: pgmap v20614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:11 smithi110 ceph-mon[28069]: pgmap v20614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38467.629787 secs 2024-04-26T22:29:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38467.629787 secs 2024-04-26T22:29:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38467.629787 secs 2024-04-26T22:29:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:14 smithi193 ceph-mon[32782]: pgmap v20615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:14.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:14 smithi196 ceph-mon[32572]: pgmap v20615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:14 smithi110 ceph-mon[28069]: pgmap v20615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:16 smithi193 ceph-mon[32782]: pgmap v20616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:29:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:16 smithi196 ceph-mon[32572]: pgmap v20616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:29:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:16 smithi110 ceph-mon[28069]: pgmap v20616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:29:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38472.629909 secs 2024-04-26T22:29:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38472.629909 secs 2024-04-26T22:29:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38472.629909 secs 2024-04-26T22:29:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:18 smithi193 ceph-mon[32782]: pgmap v20617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:18 smithi196 ceph-mon[32572]: pgmap v20617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:18 smithi110 ceph-mon[28069]: pgmap v20617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:19.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:29:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:29:18.885+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:29:19.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:29:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:29:18.885+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:29:19.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:29:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:29:18.885+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:29:19.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:29:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:29:18.885+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:29:19.292 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:29:18 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:29:18.885+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:29:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:20 smithi193 ceph-mon[32782]: pgmap v20618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:20 smithi196 ceph-mon[32572]: pgmap v20618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:20 smithi110 ceph-mon[28069]: pgmap v20618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:22 smithi193 ceph-mon[32782]: pgmap v20619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38477.629993 secs 2024-04-26T22:29:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:22 smithi196 ceph-mon[32572]: pgmap v20619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38477.629993 secs 2024-04-26T22:29:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:22 smithi110 ceph-mon[28069]: pgmap v20619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38477.629993 secs 2024-04-26T22:29:24.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:24 smithi193 ceph-mon[32782]: pgmap v20620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:29:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:24 smithi196 ceph-mon[32572]: pgmap v20620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:29:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:24 smithi110 ceph-mon[28069]: pgmap v20620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:29:26.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:26 smithi193 ceph-mon[32782]: pgmap v20621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:29:26.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:26 smithi196 ceph-mon[32572]: pgmap v20621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:29:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:26 smithi110 ceph-mon[28069]: pgmap v20621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:29:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38482.630118 secs 2024-04-26T22:29:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38482.630118 secs 2024-04-26T22:29:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38482.630118 secs 2024-04-26T22:29:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:28 smithi193 ceph-mon[32782]: pgmap v20622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:29:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:28 smithi196 ceph-mon[32572]: pgmap v20622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:29:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:28 smithi110 ceph-mon[28069]: pgmap v20622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:29:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:30 smithi196 ceph-mon[32572]: pgmap v20623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:29:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:30 smithi110 ceph-mon[28069]: pgmap v20623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:29:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:30 smithi193 ceph-mon[32782]: pgmap v20623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:29:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:32 smithi196 ceph-mon[32572]: pgmap v20624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:29:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38487.630239 secs 2024-04-26T22:29:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:32 smithi110 ceph-mon[28069]: pgmap v20624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:29:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38487.630239 secs 2024-04-26T22:29:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:32 smithi193 ceph-mon[32782]: pgmap v20624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:29:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38487.630239 secs 2024-04-26T22:29:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:34 smithi196 ceph-mon[32572]: pgmap v20625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:29:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:34 smithi110 ceph-mon[28069]: pgmap v20625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:29:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:34 smithi193 ceph-mon[32782]: pgmap v20625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:29:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:36 smithi196 ceph-mon[32572]: pgmap v20626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:36 smithi110 ceph-mon[28069]: pgmap v20626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:36 smithi193 ceph-mon[32782]: pgmap v20626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38492.630360 secs 2024-04-26T22:29:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38492.630360 secs 2024-04-26T22:29:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38492.630360 secs 2024-04-26T22:29:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:38 smithi196 ceph-mon[32572]: pgmap v20627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:38 smithi110 ceph-mon[28069]: pgmap v20627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:38 smithi193 ceph-mon[32782]: pgmap v20627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:40 smithi196 ceph-mon[32572]: pgmap v20628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:40 smithi110 ceph-mon[28069]: pgmap v20628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:40 smithi193 ceph-mon[32782]: pgmap v20628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:42 smithi196 ceph-mon[32572]: pgmap v20629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38497.630484 secs 2024-04-26T22:29:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:42 smithi110 ceph-mon[28069]: pgmap v20629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38497.630484 secs 2024-04-26T22:29:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:42 smithi193 ceph-mon[32782]: pgmap v20629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38497.630484 secs 2024-04-26T22:29:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:44 smithi196 ceph-mon[32572]: pgmap v20630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:44 smithi110 ceph-mon[28069]: pgmap v20630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:44 smithi193 ceph-mon[32782]: pgmap v20630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:46 smithi196 ceph-mon[32572]: pgmap v20631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:46 smithi110 ceph-mon[28069]: pgmap v20631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:46 smithi193 ceph-mon[32782]: pgmap v20631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38502.630587 secs 2024-04-26T22:29:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38502.630587 secs 2024-04-26T22:29:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38502.630587 secs 2024-04-26T22:29:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:48 smithi196 ceph-mon[32572]: pgmap v20632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:48 smithi110 ceph-mon[28069]: pgmap v20632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:48 smithi193 ceph-mon[32782]: pgmap v20632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:50 smithi196 ceph-mon[32572]: pgmap v20633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:50 smithi110 ceph-mon[28069]: pgmap v20633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:50 smithi193 ceph-mon[32782]: pgmap v20633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:52 smithi196 ceph-mon[32572]: pgmap v20634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38507.630724 secs 2024-04-26T22:29:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:52 smithi110 ceph-mon[28069]: pgmap v20634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38507.630724 secs 2024-04-26T22:29:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:52 smithi193 ceph-mon[32782]: pgmap v20634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38507.630724 secs 2024-04-26T22:29:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:54 smithi196 ceph-mon[32572]: pgmap v20635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:54 smithi110 ceph-mon[28069]: pgmap v20635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:54 smithi193 ceph-mon[32782]: pgmap v20635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:29:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:56 smithi196 ceph-mon[32572]: pgmap v20636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:56 smithi110 ceph-mon[28069]: pgmap v20636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:56 smithi193 ceph-mon[32782]: pgmap v20636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38512.630851 secs 2024-04-26T22:29:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38512.630851 secs 2024-04-26T22:29:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38512.630851 secs 2024-04-26T22:29:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:29:58 smithi196 ceph-mon[32572]: pgmap v20637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:29:58 smithi110 ceph-mon[28069]: pgmap v20637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:29:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:29:58 smithi193 ceph-mon[32782]: pgmap v20637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:00 smithi196 ceph-mon[32572]: pgmap v20638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:30:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:00 smithi110 ceph-mon[28069]: pgmap v20638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:30:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:00 smithi193 ceph-mon[32782]: pgmap v20638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:30:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:02 smithi196 ceph-mon[32572]: pgmap v20639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38517.630996 secs 2024-04-26T22:30:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:02 smithi110 ceph-mon[28069]: pgmap v20639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38517.630996 secs 2024-04-26T22:30:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:02 smithi193 ceph-mon[32782]: pgmap v20639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38517.630996 secs 2024-04-26T22:30:04.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:04 smithi196 ceph-mon[32572]: pgmap v20640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:04 smithi110 ceph-mon[28069]: pgmap v20640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:04 smithi193 ceph-mon[32782]: pgmap v20640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:30:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:30:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:06 smithi196 ceph-mon[32572]: pgmap v20641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:30:06.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:06 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:06 smithi110 ceph-mon[28069]: pgmap v20641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:30:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:06 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:30:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:06 smithi193 ceph-mon[32782]: pgmap v20641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:30:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:30:06.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:06 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:30:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:07 smithi110 ceph-mon[28069]: pgmap v20642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:30:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:07 smithi110 ceph-mon[28069]: pgmap v20643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38522.631119 secs 2024-04-26T22:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:07 smithi193 ceph-mon[32782]: pgmap v20642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:30:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:07 smithi193 ceph-mon[32782]: pgmap v20643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38522.631119 secs 2024-04-26T22:30:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:07 smithi196 ceph-mon[32572]: pgmap v20642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:30:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:07 smithi196 ceph-mon[32572]: pgmap v20643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38522.631119 secs 2024-04-26T22:30:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:09 smithi110 ceph-mon[28069]: pgmap v20644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:09 smithi193 ceph-mon[32782]: pgmap v20644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:09 smithi196 ceph-mon[32572]: pgmap v20644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:11 smithi110 ceph-mon[28069]: pgmap v20645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:11.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:11 smithi196 ceph-mon[32572]: pgmap v20645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:11 smithi193 ceph-mon[32782]: pgmap v20645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38527.631246 secs 2024-04-26T22:30:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38527.631246 secs 2024-04-26T22:30:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38527.631246 secs 2024-04-26T22:30:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:13 smithi110 ceph-mon[28069]: pgmap v20646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:30:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:13 smithi193 ceph-mon[32782]: pgmap v20646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:30:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:13 smithi196 ceph-mon[32572]: pgmap v20646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:30:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:15 smithi110 ceph-mon[28069]: pgmap v20647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:15 smithi193 ceph-mon[32782]: pgmap v20647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:15 smithi196 ceph-mon[32572]: pgmap v20647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:30:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:17 smithi193 ceph-mon[32782]: pgmap v20648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:30:17.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38532.631386 secs 2024-04-26T22:30:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:17 smithi196 ceph-mon[32572]: pgmap v20648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:30:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38532.631386 secs 2024-04-26T22:30:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:17 smithi110 ceph-mon[28069]: pgmap v20648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:30:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38532.631386 secs 2024-04-26T22:30:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:19 smithi193 ceph-mon[32782]: pgmap v20649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:19 smithi196 ceph-mon[32572]: pgmap v20649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:19 smithi110 ceph-mon[28069]: pgmap v20649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:21 smithi193 ceph-mon[32782]: pgmap v20650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:21 smithi196 ceph-mon[32572]: pgmap v20650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:21 smithi110 ceph-mon[28069]: pgmap v20650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:30:22.770+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:30:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:30:22.770+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:30:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:30:22.770+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 296 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:30:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:30:22.770+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 296 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:30:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38537.631522 secs 2024-04-26T22:30:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:22 smithi193 ceph-mon[32782]: pgmap v20651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38537.631522 secs 2024-04-26T22:30:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:22 smithi196 ceph-mon[32572]: pgmap v20651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38537.631522 secs 2024-04-26T22:30:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:22 smithi110 ceph-mon[28069]: pgmap v20651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:25 smithi193 ceph-mon[32782]: pgmap v20652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:25.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:25 smithi196 ceph-mon[32572]: pgmap v20652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:25 smithi110 ceph-mon[28069]: pgmap v20652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:27 smithi196 ceph-mon[32572]: pgmap v20653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38542.631649 secs 2024-04-26T22:30:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:27 smithi110 ceph-mon[28069]: pgmap v20653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38542.631649 secs 2024-04-26T22:30:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:27 smithi193 ceph-mon[32782]: pgmap v20653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38542.631649 secs 2024-04-26T22:30:29.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:29 smithi196 ceph-mon[32572]: pgmap v20654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:29 smithi110 ceph-mon[28069]: pgmap v20654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:29 smithi193 ceph-mon[32782]: pgmap v20654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:31.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:31 smithi196 ceph-mon[32572]: pgmap v20655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:31.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:31 smithi110 ceph-mon[28069]: pgmap v20655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:31 smithi193 ceph-mon[32782]: pgmap v20655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38547.631710 secs 2024-04-26T22:30:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38547.631710 secs 2024-04-26T22:30:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38547.631710 secs 2024-04-26T22:30:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:33 smithi196 ceph-mon[32572]: pgmap v20656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:33.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:33 smithi110 ceph-mon[28069]: pgmap v20656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:33 smithi193 ceph-mon[32782]: pgmap v20656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:35 smithi193 ceph-mon[32782]: pgmap v20657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:35.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:35 smithi196 ceph-mon[32572]: pgmap v20657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:35.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:35 smithi110 ceph-mon[28069]: pgmap v20657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:37 smithi196 ceph-mon[32572]: pgmap v20658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:37.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38552.631856 secs 2024-04-26T22:30:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:37 smithi110 ceph-mon[28069]: pgmap v20658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38552.631856 secs 2024-04-26T22:30:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:37 smithi193 ceph-mon[32782]: pgmap v20658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38552.631856 secs 2024-04-26T22:30:39.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:39 smithi196 ceph-mon[32572]: pgmap v20659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:39.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:39 smithi110 ceph-mon[28069]: pgmap v20659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:39 smithi193 ceph-mon[32782]: pgmap v20659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:41.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:41 smithi196 ceph-mon[32572]: pgmap v20660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:41.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:41 smithi110 ceph-mon[28069]: pgmap v20660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:41 smithi193 ceph-mon[32782]: pgmap v20660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:42.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38557.631977 secs 2024-04-26T22:30:42.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38557.631977 secs 2024-04-26T22:30:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38557.631977 secs 2024-04-26T22:30:43.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:43 smithi196 ceph-mon[32572]: pgmap v20661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:43.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:43 smithi110 ceph-mon[28069]: pgmap v20661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:43 smithi193 ceph-mon[32782]: pgmap v20661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:45.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:45 smithi196 ceph-mon[32572]: pgmap v20662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:45.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:45 smithi110 ceph-mon[28069]: pgmap v20662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:45.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:45 smithi193 ceph-mon[32782]: pgmap v20662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:47 smithi196 ceph-mon[32572]: pgmap v20663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:47.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38562.632095 secs 2024-04-26T22:30:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:47 smithi110 ceph-mon[28069]: pgmap v20663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:47.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38562.632095 secs 2024-04-26T22:30:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:47 smithi193 ceph-mon[32782]: pgmap v20663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38562.632095 secs 2024-04-26T22:30:49.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:49 smithi196 ceph-mon[32572]: pgmap v20664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:49.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:49 smithi110 ceph-mon[28069]: pgmap v20664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:49.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:49 smithi193 ceph-mon[32782]: pgmap v20664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:51.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:51 smithi196 ceph-mon[32572]: pgmap v20665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:51 smithi110 ceph-mon[28069]: pgmap v20665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:51 smithi193 ceph-mon[32782]: pgmap v20665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:52.523 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38567.632216 secs 2024-04-26T22:30:52.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38567.632216 secs 2024-04-26T22:30:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38567.632216 secs 2024-04-26T22:30:53.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:53 smithi110 ceph-mon[28069]: pgmap v20666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:53 smithi193 ceph-mon[32782]: pgmap v20666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:53 smithi196 ceph-mon[32572]: pgmap v20666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:55.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:55 smithi110 ceph-mon[28069]: pgmap v20667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:55.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:55 smithi193 ceph-mon[32782]: pgmap v20667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:55 smithi196 ceph-mon[32572]: pgmap v20667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:57 smithi110 ceph-mon[28069]: pgmap v20668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38572.632340 secs 2024-04-26T22:30:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:57 smithi193 ceph-mon[32782]: pgmap v20668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38572.632340 secs 2024-04-26T22:30:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:57 smithi196 ceph-mon[32572]: pgmap v20668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:30:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38572.632340 secs 2024-04-26T22:30:59.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:30:59 smithi110 ceph-mon[28069]: pgmap v20669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:59.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:30:59 smithi193 ceph-mon[32782]: pgmap v20669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:30:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:30:59 smithi196 ceph-mon[32572]: pgmap v20669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:01.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:01 smithi110 ceph-mon[28069]: pgmap v20670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:01.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:01 smithi193 ceph-mon[32782]: pgmap v20670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:01 smithi196 ceph-mon[32572]: pgmap v20670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38577.632458 secs 2024-04-26T22:31:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38577.632458 secs 2024-04-26T22:31:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38577.632458 secs 2024-04-26T22:31:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:03 smithi193 ceph-mon[32782]: pgmap v20671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:03 smithi196 ceph-mon[32572]: pgmap v20671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:03 smithi110 ceph-mon[28069]: pgmap v20671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:05.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:05 smithi110 ceph-mon[28069]: pgmap v20672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:05 smithi193 ceph-mon[32782]: pgmap v20672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:05 smithi196 ceph-mon[32572]: pgmap v20672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:07 smithi193 ceph-mon[32782]: pgmap v20673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:31:07.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38582.632552 secs 2024-04-26T22:31:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:07 smithi196 ceph-mon[32572]: pgmap v20673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:31:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38582.632552 secs 2024-04-26T22:31:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:07 smithi110 ceph-mon[28069]: pgmap v20673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:31:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38582.632552 secs 2024-04-26T22:31:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:09 smithi193 ceph-mon[32782]: pgmap v20674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:09.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:09 smithi196 ceph-mon[32572]: pgmap v20674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:09 smithi110 ceph-mon[28069]: pgmap v20674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:11 smithi193 ceph-mon[32782]: pgmap v20675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:11.735 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:11 smithi110 ceph-mon[28069]: pgmap v20675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:11 smithi196 ceph-mon[32572]: pgmap v20675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:12.476 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38587.632672 secs 2024-04-26T22:31:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38587.632672 secs 2024-04-26T22:31:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38587.632672 secs 2024-04-26T22:31:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:13 smithi193 ceph-mon[32782]: pgmap v20676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:13 smithi196 ceph-mon[32572]: pgmap v20676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:13 smithi110 ceph-mon[28069]: pgmap v20676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:31:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:31:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:31:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:31:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:14 smithi193 ceph-mon[32782]: pgmap v20677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:31:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:14 smithi193 ceph-mon[32782]: pgmap v20678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:14.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:14 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:31:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:31:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:31:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:31:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:31:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:14 smithi196 ceph-mon[32572]: pgmap v20677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:31:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:14 smithi196 ceph-mon[32572]: pgmap v20678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:14 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:31:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:31:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:31:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:31:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:31:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:14 smithi110 ceph-mon[28069]: pgmap v20677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:31:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:14 smithi110 ceph-mon[28069]: pgmap v20678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:15.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:14 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:31:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:16 smithi196 ceph-mon[32572]: pgmap v20679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:16 smithi110 ceph-mon[28069]: pgmap v20679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:16 smithi193 ceph-mon[32782]: pgmap v20679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38592.632799 secs 2024-04-26T22:31:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38592.632799 secs 2024-04-26T22:31:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38592.632799 secs 2024-04-26T22:31:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:18 smithi196 ceph-mon[32572]: pgmap v20680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:18 smithi110 ceph-mon[28069]: pgmap v20680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:18 smithi193 ceph-mon[32782]: pgmap v20680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:20 smithi196 ceph-mon[32572]: pgmap v20681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:20 smithi110 ceph-mon[28069]: pgmap v20681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:20 smithi193 ceph-mon[32782]: pgmap v20681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:22 smithi196 ceph-mon[32572]: pgmap v20682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38597.632924 secs 2024-04-26T22:31:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:22 smithi110 ceph-mon[28069]: pgmap v20682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38597.632924 secs 2024-04-26T22:31:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:22 smithi193 ceph-mon[32782]: pgmap v20682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:31:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38597.632924 secs 2024-04-26T22:31:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:24 smithi196 ceph-mon[32572]: pgmap v20683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:31:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:24 smithi110 ceph-mon[28069]: pgmap v20683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:31:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:24 smithi193 ceph-mon[32782]: pgmap v20683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:31:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:26 smithi196 ceph-mon[32572]: pgmap v20684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:26 smithi110 ceph-mon[28069]: pgmap v20684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:26 smithi193 ceph-mon[32782]: pgmap v20684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38602.633024 secs 2024-04-26T22:31:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38602.633024 secs 2024-04-26T22:31:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38602.633024 secs 2024-04-26T22:31:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:29 smithi193 ceph-mon[32782]: pgmap v20685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:29 smithi196 ceph-mon[32572]: pgmap v20685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:29 smithi110 ceph-mon[28069]: pgmap v20685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:31 smithi196 ceph-mon[32572]: pgmap v20686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:31 smithi110 ceph-mon[28069]: pgmap v20686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:31 smithi193 ceph-mon[32782]: pgmap v20686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38607.633133 secs 2024-04-26T22:31:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38607.633133 secs 2024-04-26T22:31:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38607.633133 secs 2024-04-26T22:31:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:33 smithi196 ceph-mon[32572]: pgmap v20687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:33 smithi110 ceph-mon[28069]: pgmap v20687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:33 smithi193 ceph-mon[32782]: pgmap v20687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:35 smithi196 ceph-mon[32572]: pgmap v20688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:35 smithi110 ceph-mon[28069]: pgmap v20688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:35 smithi193 ceph-mon[32782]: pgmap v20688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:37 smithi110 ceph-mon[28069]: pgmap v20689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38612.633265 secs 2024-04-26T22:31:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:37 smithi196 ceph-mon[32572]: pgmap v20689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38612.633265 secs 2024-04-26T22:31:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:37 smithi193 ceph-mon[32782]: pgmap v20689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38612.633265 secs 2024-04-26T22:31:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:39 smithi196 ceph-mon[32572]: pgmap v20690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:39 smithi110 ceph-mon[28069]: pgmap v20690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:39 smithi193 ceph-mon[32782]: pgmap v20690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:41.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:41 smithi196 ceph-mon[32572]: pgmap v20691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:41 smithi110 ceph-mon[28069]: pgmap v20691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:41 smithi193 ceph-mon[32782]: pgmap v20691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38617.633417 secs 2024-04-26T22:31:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38617.633417 secs 2024-04-26T22:31:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38617.633417 secs 2024-04-26T22:31:43.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:43 smithi196 ceph-mon[32572]: pgmap v20692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:43 smithi110 ceph-mon[28069]: pgmap v20692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:43 smithi193 ceph-mon[32782]: pgmap v20692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:45.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:45 smithi196 ceph-mon[32572]: pgmap v20693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:45 smithi110 ceph-mon[28069]: pgmap v20693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:45 smithi193 ceph-mon[32782]: pgmap v20693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:47 smithi196 ceph-mon[32572]: pgmap v20694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38622.633583 secs 2024-04-26T22:31:47.794 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:47 smithi110 ceph-mon[28069]: pgmap v20694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:47.795 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38622.633583 secs 2024-04-26T22:31:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:47 smithi193 ceph-mon[32782]: pgmap v20694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38622.633583 secs 2024-04-26T22:31:49.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:49 smithi196 ceph-mon[32572]: pgmap v20695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:49 smithi110 ceph-mon[28069]: pgmap v20695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:49 smithi193 ceph-mon[32782]: pgmap v20695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:51.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:51 smithi196 ceph-mon[32572]: pgmap v20696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:51 smithi110 ceph-mon[28069]: pgmap v20696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:51 smithi193 ceph-mon[32782]: pgmap v20696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38627.633667 secs 2024-04-26T22:31:52.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38627.633667 secs 2024-04-26T22:31:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:31:52.787+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:31:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:31:52.787+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:31:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:31:52.787+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 297 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:31:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:31:52.787+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 297 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:31:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38627.633667 secs 2024-04-26T22:31:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:53 smithi196 ceph-mon[32572]: pgmap v20697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:53 smithi110 ceph-mon[28069]: pgmap v20697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:53 smithi193 ceph-mon[32782]: pgmap v20697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:55.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:55 smithi196 ceph-mon[32572]: pgmap v20698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:55 smithi110 ceph-mon[28069]: pgmap v20698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:55 smithi193 ceph-mon[32782]: pgmap v20698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:57 smithi196 ceph-mon[32572]: pgmap v20699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38632.633791 secs 2024-04-26T22:31:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:57 smithi110 ceph-mon[28069]: pgmap v20699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38632.633791 secs 2024-04-26T22:31:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:57 smithi193 ceph-mon[32782]: pgmap v20699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:31:57.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38632.633791 secs 2024-04-26T22:31:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:31:59 smithi196 ceph-mon[32572]: pgmap v20700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:31:59 smithi110 ceph-mon[28069]: pgmap v20700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:31:59 smithi193 ceph-mon[32782]: pgmap v20700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:01 smithi196 ceph-mon[32572]: pgmap v20701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:01 smithi110 ceph-mon[28069]: pgmap v20701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:01 smithi193 ceph-mon[32782]: pgmap v20701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38637.633914 secs 2024-04-26T22:32:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38637.633914 secs 2024-04-26T22:32:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38637.633914 secs 2024-04-26T22:32:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:03 smithi196 ceph-mon[32572]: pgmap v20702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:03 smithi110 ceph-mon[28069]: pgmap v20702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:03 smithi193 ceph-mon[32782]: pgmap v20702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:05.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:05 smithi196 ceph-mon[32572]: pgmap v20703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:05 smithi110 ceph-mon[28069]: pgmap v20703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:05 smithi193 ceph-mon[32782]: pgmap v20703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:07 smithi196 ceph-mon[32572]: pgmap v20704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:07.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38642.634044 secs 2024-04-26T22:32:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:07 smithi110 ceph-mon[28069]: pgmap v20704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38642.634044 secs 2024-04-26T22:32:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:07 smithi193 ceph-mon[32782]: pgmap v20704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38642.634044 secs 2024-04-26T22:32:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:09 smithi196 ceph-mon[32572]: pgmap v20705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:09 smithi110 ceph-mon[28069]: pgmap v20705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:09 smithi193 ceph-mon[32782]: pgmap v20705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:11 smithi110 ceph-mon[28069]: pgmap v20706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:11 smithi193 ceph-mon[32782]: pgmap v20706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:11 smithi196 ceph-mon[32572]: pgmap v20706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38647.634184 secs 2024-04-26T22:32:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38647.634184 secs 2024-04-26T22:32:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38647.634184 secs 2024-04-26T22:32:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:13 smithi110 ceph-mon[28069]: pgmap v20707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:13 smithi193 ceph-mon[32782]: pgmap v20707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:13 smithi196 ceph-mon[32572]: pgmap v20707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:14 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:32:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:14 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:32:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:14 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:32:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:15 smithi110 ceph-mon[28069]: pgmap v20708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:32:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:15 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:32:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:15 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:32:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:15 smithi193 ceph-mon[32782]: pgmap v20708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:32:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:15 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:32:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:15 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:32:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:15 smithi196 ceph-mon[32572]: pgmap v20708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:32:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:15 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:32:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:15 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:32:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:16 smithi193 ceph-mon[32782]: pgmap v20709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:32:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:16 smithi193 ceph-mon[32782]: pgmap v20710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:16 smithi196 ceph-mon[32572]: pgmap v20709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:32:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:16 smithi196 ceph-mon[32572]: pgmap v20710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:16 smithi110 ceph-mon[28069]: pgmap v20709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 883 B/s rd, 1 op/s 2024-04-26T22:32:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:16 smithi110 ceph-mon[28069]: pgmap v20710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38652.634305 secs 2024-04-26T22:32:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38652.634305 secs 2024-04-26T22:32:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38652.634305 secs 2024-04-26T22:32:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:18 smithi193 ceph-mon[32782]: pgmap v20711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:32:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:18 smithi196 ceph-mon[32572]: pgmap v20711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:32:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:18 smithi110 ceph-mon[28069]: pgmap v20711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T22:32:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:20 smithi193 ceph-mon[32782]: pgmap v20712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:20 smithi196 ceph-mon[32572]: pgmap v20712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:20 smithi110 ceph-mon[28069]: pgmap v20712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:22 smithi193 ceph-mon[32782]: pgmap v20713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38657.634428 secs 2024-04-26T22:32:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:22 smithi196 ceph-mon[32572]: pgmap v20713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38657.634428 secs 2024-04-26T22:32:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:22 smithi110 ceph-mon[28069]: pgmap v20713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38657.634428 secs 2024-04-26T22:32:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:24 smithi193 ceph-mon[32782]: pgmap v20714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:24 smithi196 ceph-mon[32572]: pgmap v20714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:24 smithi110 ceph-mon[28069]: pgmap v20714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:32:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:26 smithi193 ceph-mon[32782]: pgmap v20715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:32:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:26 smithi196 ceph-mon[32572]: pgmap v20715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:32:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:26 smithi110 ceph-mon[28069]: pgmap v20715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:32:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38662.634553 secs 2024-04-26T22:32:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38662.634553 secs 2024-04-26T22:32:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38662.634553 secs 2024-04-26T22:32:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:28 smithi193 ceph-mon[32782]: pgmap v20716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:28 smithi196 ceph-mon[32572]: pgmap v20716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:28 smithi110 ceph-mon[28069]: pgmap v20716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:29 smithi193 ceph-mon[32782]: pgmap v20717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:29 smithi196 ceph-mon[32572]: pgmap v20717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:29 smithi110 ceph-mon[28069]: pgmap v20717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:32 smithi110 ceph-mon[28069]: pgmap v20718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:32.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38667.634642 secs 2024-04-26T22:32:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:32 smithi193 ceph-mon[32782]: pgmap v20718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38667.634642 secs 2024-04-26T22:32:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:32 smithi196 ceph-mon[32572]: pgmap v20718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38667.634642 secs 2024-04-26T22:32:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:34 smithi193 ceph-mon[32782]: pgmap v20719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:34 smithi196 ceph-mon[32572]: pgmap v20719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:34 smithi110 ceph-mon[28069]: pgmap v20719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:36.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:36 smithi110 ceph-mon[28069]: pgmap v20720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:36 smithi193 ceph-mon[32782]: pgmap v20720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:36 smithi196 ceph-mon[32572]: pgmap v20720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38672.634725 secs 2024-04-26T22:32:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38672.634725 secs 2024-04-26T22:32:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38672.634725 secs 2024-04-26T22:32:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:38 smithi193 ceph-mon[32782]: pgmap v20721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:38 smithi196 ceph-mon[32572]: pgmap v20721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:38 smithi110 ceph-mon[28069]: pgmap v20721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:40 smithi193 ceph-mon[32782]: pgmap v20722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:40.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:40 smithi196 ceph-mon[32572]: pgmap v20722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:40 smithi110 ceph-mon[28069]: pgmap v20722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:42 smithi193 ceph-mon[32782]: pgmap v20723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:42.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38677.634838 secs 2024-04-26T22:32:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:42 smithi196 ceph-mon[32572]: pgmap v20723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38677.634838 secs 2024-04-26T22:32:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:42 smithi110 ceph-mon[28069]: pgmap v20723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38677.634838 secs 2024-04-26T22:32:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:44 smithi193 ceph-mon[32782]: pgmap v20724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:44.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:44 smithi196 ceph-mon[32572]: pgmap v20724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:44 smithi110 ceph-mon[28069]: pgmap v20724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:46 smithi193 ceph-mon[32782]: pgmap v20725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:46 smithi196 ceph-mon[32572]: pgmap v20725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:46 smithi110 ceph-mon[28069]: pgmap v20725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38682.634954 secs 2024-04-26T22:32:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38682.634954 secs 2024-04-26T22:32:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38682.634954 secs 2024-04-26T22:32:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:48 smithi193 ceph-mon[32782]: pgmap v20726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:48 smithi196 ceph-mon[32572]: pgmap v20726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:48 smithi110 ceph-mon[28069]: pgmap v20726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:50 smithi193 ceph-mon[32782]: pgmap v20727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:50 smithi196 ceph-mon[32572]: pgmap v20727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:50 smithi110 ceph-mon[28069]: pgmap v20727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:52 smithi193 ceph-mon[32782]: pgmap v20728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38687.635033 secs 2024-04-26T22:32:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:52 smithi196 ceph-mon[32572]: pgmap v20728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38687.635033 secs 2024-04-26T22:32:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:52 smithi110 ceph-mon[28069]: pgmap v20728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38687.635033 secs 2024-04-26T22:32:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:54 smithi193 ceph-mon[32782]: pgmap v20729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:54 smithi196 ceph-mon[32572]: pgmap v20729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:54 smithi110 ceph-mon[28069]: pgmap v20729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:32:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:56 smithi193 ceph-mon[32782]: pgmap v20730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:56 smithi196 ceph-mon[32572]: pgmap v20730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:56 smithi110 ceph-mon[28069]: pgmap v20730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38692.635159 secs 2024-04-26T22:32:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38692.635159 secs 2024-04-26T22:32:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38692.635159 secs 2024-04-26T22:32:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:32:58 smithi196 ceph-mon[32572]: pgmap v20731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:32:58 smithi110 ceph-mon[28069]: pgmap v20731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:32:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:32:58 smithi193 ceph-mon[32782]: pgmap v20731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:00.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:00 smithi196 ceph-mon[32572]: pgmap v20732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:00 smithi110 ceph-mon[28069]: pgmap v20732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:00 smithi193 ceph-mon[32782]: pgmap v20732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:02 smithi196 ceph-mon[32572]: pgmap v20733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38697.635297 secs 2024-04-26T22:33:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:02 smithi110 ceph-mon[28069]: pgmap v20733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38697.635297 secs 2024-04-26T22:33:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:02 smithi193 ceph-mon[32782]: pgmap v20733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38697.635297 secs 2024-04-26T22:33:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:04 smithi196 ceph-mon[32572]: pgmap v20734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:04 smithi110 ceph-mon[28069]: pgmap v20734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:04 smithi193 ceph-mon[32782]: pgmap v20734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:06 smithi196 ceph-mon[32572]: pgmap v20735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:06.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:06 smithi110 ceph-mon[28069]: pgmap v20735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:06 smithi193 ceph-mon[32782]: pgmap v20735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38702.635417 secs 2024-04-26T22:33:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38702.635417 secs 2024-04-26T22:33:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38702.635417 secs 2024-04-26T22:33:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:08 smithi196 ceph-mon[32572]: pgmap v20736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:08 smithi110 ceph-mon[28069]: pgmap v20736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:08 smithi193 ceph-mon[32782]: pgmap v20736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:10 smithi196 ceph-mon[32572]: pgmap v20737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:10 smithi110 ceph-mon[28069]: pgmap v20737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:10 smithi193 ceph-mon[32782]: pgmap v20737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:12 smithi196 ceph-mon[32572]: pgmap v20738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:12 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 38707.635538 secs 2024-04-26T22:33:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:12 smithi196 ceph-mon[32572]: slow request 23044.021362 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:33:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:12 smithi110 ceph-mon[28069]: pgmap v20738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:12 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 38707.635538 secs 2024-04-26T22:33:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:12 smithi110 ceph-mon[28069]: slow request 23044.021362 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:33:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:12 smithi193 ceph-mon[32782]: pgmap v20738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:12 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 38707.635538 secs 2024-04-26T22:33:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:12 smithi193 ceph-mon[32782]: slow request 23044.021362 seconds old, received at 2024-04-26T16:09:07.912497+0000: client_request(client.26867:1 getattr pAsLsXsFs #0x1 2024-04-26T16:09:07.908244+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:33:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:14 smithi196 ceph-mon[32572]: pgmap v20739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:14 smithi110 ceph-mon[28069]: pgmap v20739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:14 smithi193 ceph-mon[32782]: pgmap v20739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.481+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T22:33:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.481+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:33:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.481+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:33:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.481+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T22:33:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.482+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:33:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.482+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T22:33:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.482+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T22:33:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.520+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T22:33:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.520+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T22:33:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.520+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261402d040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:33:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.520+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2614002230 tx=0x7f261402d040 comp rx=0 tx=0).stop 2024-04-26T22:33:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.520+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T22:33:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.520+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T22:33:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.520+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:33:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.520+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:33:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.520+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:33:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:16.522+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614036000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:33:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:16 smithi196 ceph-mon[32572]: pgmap v20740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:16.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:33:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:16 smithi110 ceph-mon[28069]: pgmap v20740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:33:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:16 smithi193 ceph-mon[32782]: pgmap v20740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:33:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:33:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:33:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:17 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:33:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38712.635603 secs 2024-04-26T22:33:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:33:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:33:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:17 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:33:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38712.635603 secs 2024-04-26T22:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:17 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:33:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38712.635603 secs 2024-04-26T22:33:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:18 smithi196 ceph-mon[32572]: pgmap v20741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:33:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:18 smithi196 ceph-mon[32572]: pgmap v20742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:18 smithi110 ceph-mon[28069]: pgmap v20741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:33:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:18 smithi110 ceph-mon[28069]: pgmap v20742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:18 smithi193 ceph-mon[32782]: pgmap v20741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:33:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:18 smithi193 ceph-mon[32782]: pgmap v20742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:20 smithi196 ceph-mon[32572]: pgmap v20743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:20 smithi110 ceph-mon[28069]: pgmap v20743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:20 smithi193 ceph-mon[32782]: pgmap v20743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:22.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:22 smithi196 ceph-mon[32572]: pgmap v20744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:22.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38717.635675 secs 2024-04-26T22:33:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:22 smithi110 ceph-mon[28069]: pgmap v20744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38717.635675 secs 2024-04-26T22:33:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:22.802+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:33:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:22.802+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:33:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:22.803+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 298 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:33:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:33:22.803+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 298 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:33:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:22 smithi193 ceph-mon[32782]: pgmap v20744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38717.635675 secs 2024-04-26T22:33:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:24 smithi196 ceph-mon[32572]: pgmap v20745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:24 smithi110 ceph-mon[28069]: pgmap v20745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:24 smithi193 ceph-mon[32782]: pgmap v20745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:26 smithi196 ceph-mon[32572]: pgmap v20746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:26 smithi110 ceph-mon[28069]: pgmap v20746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:26 smithi193 ceph-mon[32782]: pgmap v20746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:33:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38722.635775 secs 2024-04-26T22:33:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38722.635775 secs 2024-04-26T22:33:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38722.635775 secs 2024-04-26T22:33:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:28 smithi196 ceph-mon[32572]: pgmap v20747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:33:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:28 smithi110 ceph-mon[28069]: pgmap v20747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:33:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:28 smithi193 ceph-mon[32782]: pgmap v20747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:33:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:30 smithi196 ceph-mon[32572]: pgmap v20748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:30 smithi110 ceph-mon[28069]: pgmap v20748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:30 smithi193 ceph-mon[32782]: pgmap v20748: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:32 smithi196 ceph-mon[32572]: pgmap v20749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38727.635912 secs 2024-04-26T22:33:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:32 smithi110 ceph-mon[28069]: pgmap v20749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38727.635912 secs 2024-04-26T22:33:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:32 smithi193 ceph-mon[32782]: pgmap v20749: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38727.635912 secs 2024-04-26T22:33:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:34 smithi196 ceph-mon[32572]: pgmap v20750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:34 smithi110 ceph-mon[28069]: pgmap v20750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:34 smithi193 ceph-mon[32782]: pgmap v20750: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:36 smithi196 ceph-mon[32572]: pgmap v20751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:36 smithi110 ceph-mon[28069]: pgmap v20751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:36 smithi193 ceph-mon[32782]: pgmap v20751: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38732.636030 secs 2024-04-26T22:33:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38732.636030 secs 2024-04-26T22:33:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38732.636030 secs 2024-04-26T22:33:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:38 smithi110 ceph-mon[28069]: pgmap v20752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:38 smithi193 ceph-mon[32782]: pgmap v20752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:38 smithi196 ceph-mon[32572]: pgmap v20752: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:40 smithi110 ceph-mon[28069]: pgmap v20753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:40 smithi193 ceph-mon[32782]: pgmap v20753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:41.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:40 smithi196 ceph-mon[32572]: pgmap v20753: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:42 smithi110 ceph-mon[28069]: pgmap v20754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38737.636146 secs 2024-04-26T22:33:42.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:42 smithi196 ceph-mon[32572]: pgmap v20754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:42.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38737.636146 secs 2024-04-26T22:33:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:42 smithi193 ceph-mon[32782]: pgmap v20754: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38737.636146 secs 2024-04-26T22:33:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:44 smithi110 ceph-mon[28069]: pgmap v20755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:44.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:44 smithi193 ceph-mon[32782]: pgmap v20755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:44 smithi196 ceph-mon[32572]: pgmap v20755: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:46 smithi110 ceph-mon[28069]: pgmap v20756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:46 smithi193 ceph-mon[32782]: pgmap v20756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:46 smithi196 ceph-mon[32572]: pgmap v20756: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38742.636290 secs 2024-04-26T22:33:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38742.636290 secs 2024-04-26T22:33:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38742.636290 secs 2024-04-26T22:33:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:48 smithi193 ceph-mon[32782]: pgmap v20757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:48 smithi196 ceph-mon[32572]: pgmap v20757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:48 smithi110 ceph-mon[28069]: pgmap v20757: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:50 smithi193 ceph-mon[32782]: pgmap v20758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:50 smithi196 ceph-mon[32572]: pgmap v20758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:50 smithi110 ceph-mon[28069]: pgmap v20758: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:52 smithi193 ceph-mon[32782]: pgmap v20759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38747.636425 secs 2024-04-26T22:33:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:52 smithi196 ceph-mon[32572]: pgmap v20759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38747.636425 secs 2024-04-26T22:33:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:52 smithi110 ceph-mon[28069]: pgmap v20759: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38747.636425 secs 2024-04-26T22:33:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:54 smithi193 ceph-mon[32782]: pgmap v20760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:54 smithi196 ceph-mon[32572]: pgmap v20760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:54 smithi110 ceph-mon[28069]: pgmap v20760: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:33:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:56 smithi193 ceph-mon[32782]: pgmap v20761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:56 smithi196 ceph-mon[32572]: pgmap v20761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:56 smithi110 ceph-mon[28069]: pgmap v20761: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38752.636581 secs 2024-04-26T22:33:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38752.636581 secs 2024-04-26T22:33:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38752.636581 secs 2024-04-26T22:33:58.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:33:58 smithi193 ceph-mon[32782]: pgmap v20762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:59.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:33:58 smithi196 ceph-mon[32572]: pgmap v20762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:33:59.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:33:58 smithi110 ceph-mon[28069]: pgmap v20762: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:00 smithi193 ceph-mon[32782]: pgmap v20763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:00 smithi196 ceph-mon[32572]: pgmap v20763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:00 smithi110 ceph-mon[28069]: pgmap v20763: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:02 smithi193 ceph-mon[32782]: pgmap v20764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38757.636650 secs 2024-04-26T22:34:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:02 smithi196 ceph-mon[32572]: pgmap v20764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38757.636650 secs 2024-04-26T22:34:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:02 smithi110 ceph-mon[28069]: pgmap v20764: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38757.636650 secs 2024-04-26T22:34:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:04 smithi193 ceph-mon[32782]: pgmap v20765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:04 smithi196 ceph-mon[32572]: pgmap v20765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:04 smithi110 ceph-mon[28069]: pgmap v20765: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:05 smithi196 ceph-mon[32572]: pgmap v20766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:05 smithi110 ceph-mon[28069]: pgmap v20766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:05 smithi193 ceph-mon[32782]: pgmap v20766: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:07 smithi193 ceph-mon[32782]: pgmap v20767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38762.636771 secs 2024-04-26T22:34:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:07 smithi196 ceph-mon[32572]: pgmap v20767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38762.636771 secs 2024-04-26T22:34:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:07 smithi110 ceph-mon[28069]: pgmap v20767: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38762.636771 secs 2024-04-26T22:34:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:09 smithi196 ceph-mon[32572]: pgmap v20768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:09 smithi110 ceph-mon[28069]: pgmap v20768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:09 smithi193 ceph-mon[32782]: pgmap v20768: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:11 smithi196 ceph-mon[32572]: pgmap v20769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:11 smithi110 ceph-mon[28069]: pgmap v20769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:11 smithi193 ceph-mon[32782]: pgmap v20769: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38767.636849 secs 2024-04-26T22:34:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38767.636849 secs 2024-04-26T22:34:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38767.636849 secs 2024-04-26T22:34:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:14 smithi196 ceph-mon[32572]: pgmap v20770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:14.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:14 smithi110 ceph-mon[28069]: pgmap v20770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:14 smithi193 ceph-mon[32782]: pgmap v20770: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:16 smithi196 ceph-mon[32572]: pgmap v20771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:16 smithi110 ceph-mon[28069]: pgmap v20771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:16 smithi193 ceph-mon[32782]: pgmap v20771: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38772.636967 secs 2024-04-26T22:34:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:34:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38772.636967 secs 2024-04-26T22:34:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:34:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38772.636967 secs 2024-04-26T22:34:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:34:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:18 smithi196 ceph-mon[32572]: pgmap v20772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:34:18.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:34:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:18 smithi110 ceph-mon[28069]: pgmap v20772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:34:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:34:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:18 smithi193 ceph-mon[32782]: pgmap v20772: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:34:18.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:34:19.459 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:34:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:34:19.139+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:34:19.459 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:34:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:34:19.139+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:34:19.459 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:34:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:34:19.139+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:34:19.459 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:34:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:34:19.139+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:34:19.459 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:34:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:34:19.139+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:34:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:34:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:19 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:34:19.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:19 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:34:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:34:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:19 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:34:19.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:19 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:34:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:34:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:19 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:34:19.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:19 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:34:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:20 smithi196 ceph-mon[32572]: pgmap v20773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:20 smithi196 ceph-mon[32572]: pgmap v20774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 983 B/s rd, 1 op/s 2024-04-26T22:34:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:20 smithi196 ceph-mon[32572]: pgmap v20775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:20 smithi110 ceph-mon[28069]: pgmap v20773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:20 smithi110 ceph-mon[28069]: pgmap v20774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 983 B/s rd, 1 op/s 2024-04-26T22:34:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:20 smithi110 ceph-mon[28069]: pgmap v20775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:20 smithi193 ceph-mon[32782]: pgmap v20773: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:20 smithi193 ceph-mon[32782]: pgmap v20774: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 983 B/s rd, 1 op/s 2024-04-26T22:34:20.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:20 smithi193 ceph-mon[32782]: pgmap v20775: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:22 smithi196 ceph-mon[32572]: pgmap v20776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T22:34:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38777.637106 secs 2024-04-26T22:34:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:22 smithi110 ceph-mon[28069]: pgmap v20776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T22:34:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38777.637106 secs 2024-04-26T22:34:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:22 smithi193 ceph-mon[32782]: pgmap v20776: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 609 B/s rd, 1 op/s 2024-04-26T22:34:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38777.637106 secs 2024-04-26T22:34:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:24 smithi196 ceph-mon[32572]: pgmap v20777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 365 B/s wr, 19 op/s 2024-04-26T22:34:24.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:24 smithi110 ceph-mon[28069]: pgmap v20777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 365 B/s wr, 19 op/s 2024-04-26T22:34:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:24 smithi193 ceph-mon[32782]: pgmap v20777: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 365 B/s wr, 19 op/s 2024-04-26T22:34:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:26 smithi196 ceph-mon[32572]: pgmap v20778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 365 B/s wr, 19 op/s 2024-04-26T22:34:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:26 smithi110 ceph-mon[28069]: pgmap v20778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 365 B/s wr, 19 op/s 2024-04-26T22:34:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:26 smithi193 ceph-mon[32782]: pgmap v20778: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 365 B/s wr, 19 op/s 2024-04-26T22:34:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38782.637230 secs 2024-04-26T22:34:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38782.637230 secs 2024-04-26T22:34:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38782.637230 secs 2024-04-26T22:34:28.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:28 smithi196 ceph-mon[32572]: pgmap v20779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 365 B/s wr, 17 op/s 2024-04-26T22:34:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:28 smithi110 ceph-mon[28069]: pgmap v20779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 365 B/s wr, 17 op/s 2024-04-26T22:34:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:28 smithi193 ceph-mon[32782]: pgmap v20779: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 365 B/s wr, 17 op/s 2024-04-26T22:34:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:30 smithi196 ceph-mon[32572]: pgmap v20780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T22:34:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:30 smithi110 ceph-mon[28069]: pgmap v20780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T22:34:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:30 smithi193 ceph-mon[32782]: pgmap v20780: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 307 B/s wr, 15 op/s 2024-04-26T22:34:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:32 smithi196 ceph-mon[32572]: pgmap v20781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T22:34:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38787.637360 secs 2024-04-26T22:34:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:32 smithi110 ceph-mon[28069]: pgmap v20781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T22:34:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38787.637360 secs 2024-04-26T22:34:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:32 smithi193 ceph-mon[32782]: pgmap v20781: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-26T22:34:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38787.637360 secs 2024-04-26T22:34:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:34 smithi196 ceph-mon[32572]: pgmap v20782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T22:34:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:34 smithi110 ceph-mon[28069]: pgmap v20782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T22:34:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:34 smithi193 ceph-mon[32782]: pgmap v20782: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-26T22:34:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:36 smithi110 ceph-mon[28069]: pgmap v20783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:36 smithi193 ceph-mon[32782]: pgmap v20783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:36 smithi196 ceph-mon[32572]: pgmap v20783: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38792.637478 secs 2024-04-26T22:34:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38792.637478 secs 2024-04-26T22:34:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38792.637478 secs 2024-04-26T22:34:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:38 smithi110 ceph-mon[28069]: pgmap v20784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:38 smithi193 ceph-mon[32782]: pgmap v20784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:38 smithi196 ceph-mon[32572]: pgmap v20784: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:40 smithi110 ceph-mon[28069]: pgmap v20785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:40 smithi193 ceph-mon[32782]: pgmap v20785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:40 smithi196 ceph-mon[32572]: pgmap v20785: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:42 smithi110 ceph-mon[28069]: pgmap v20786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38797.637595 secs 2024-04-26T22:34:42.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:42 smithi196 ceph-mon[32572]: pgmap v20786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:42.806 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38797.637595 secs 2024-04-26T22:34:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:42 smithi193 ceph-mon[32782]: pgmap v20786: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38797.637595 secs 2024-04-26T22:34:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:44 smithi110 ceph-mon[28069]: pgmap v20787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:44 smithi193 ceph-mon[32782]: pgmap v20787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:44 smithi196 ceph-mon[32572]: pgmap v20787: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:46 smithi193 ceph-mon[32782]: pgmap v20788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:46 smithi196 ceph-mon[32572]: pgmap v20788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:46 smithi110 ceph-mon[28069]: pgmap v20788: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38802.637725 secs 2024-04-26T22:34:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38802.637725 secs 2024-04-26T22:34:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38802.637725 secs 2024-04-26T22:34:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:48 smithi193 ceph-mon[32782]: pgmap v20789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:48 smithi196 ceph-mon[32572]: pgmap v20789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:48 smithi110 ceph-mon[28069]: pgmap v20789: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:50 smithi193 ceph-mon[32782]: pgmap v20790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:50 smithi196 ceph-mon[32572]: pgmap v20790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:50 smithi110 ceph-mon[28069]: pgmap v20790: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:52 smithi193 ceph-mon[32782]: pgmap v20791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38807.637846 secs 2024-04-26T22:34:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:52 smithi196 ceph-mon[32572]: pgmap v20791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38807.637846 secs 2024-04-26T22:34:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:52 smithi110 ceph-mon[28069]: pgmap v20791: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38807.637846 secs 2024-04-26T22:34:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:54 smithi193 ceph-mon[32782]: pgmap v20792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:54 smithi196 ceph-mon[32572]: pgmap v20792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:54 smithi110 ceph-mon[28069]: pgmap v20792: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:34:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:56 smithi193 ceph-mon[32782]: pgmap v20793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:56 smithi196 ceph-mon[32572]: pgmap v20793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:56 smithi110 ceph-mon[28069]: pgmap v20793: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38812.637946 secs 2024-04-26T22:34:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38812.637946 secs 2024-04-26T22:34:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38812.637946 secs 2024-04-26T22:34:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:34:58 smithi193 ceph-mon[32782]: pgmap v20794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:34:58 smithi196 ceph-mon[32572]: pgmap v20794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:34:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:34:58 smithi110 ceph-mon[28069]: pgmap v20794: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:00 smithi193 ceph-mon[32782]: pgmap v20795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:00 smithi196 ceph-mon[32572]: pgmap v20795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:00 smithi110 ceph-mon[28069]: pgmap v20795: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:02 smithi193 ceph-mon[32782]: pgmap v20796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38817.638061 secs 2024-04-26T22:35:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:02 smithi196 ceph-mon[32572]: pgmap v20796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38817.638061 secs 2024-04-26T22:35:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:02 smithi110 ceph-mon[28069]: pgmap v20796: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38817.638061 secs 2024-04-26T22:35:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:04 smithi193 ceph-mon[32782]: pgmap v20797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:35:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:04 smithi196 ceph-mon[32572]: pgmap v20797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:35:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:04 smithi110 ceph-mon[28069]: pgmap v20797: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:35:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:06 smithi193 ceph-mon[32782]: pgmap v20798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:35:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:06 smithi196 ceph-mon[32572]: pgmap v20798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:35:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:06 smithi110 ceph-mon[28069]: pgmap v20798: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:35:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38822.638140 secs 2024-04-26T22:35:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:07 smithi196 ceph-mon[32572]: pgmap v20799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:35:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38822.638140 secs 2024-04-26T22:35:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:07 smithi110 ceph-mon[28069]: pgmap v20799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:35:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38822.638140 secs 2024-04-26T22:35:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:07 smithi193 ceph-mon[32782]: pgmap v20799: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:35:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:10 smithi193 ceph-mon[32782]: pgmap v20800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:35:10.744 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:10 smithi110 ceph-mon[28069]: pgmap v20800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:35:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:10 smithi196 ceph-mon[32572]: pgmap v20800: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:35:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:12 smithi193 ceph-mon[32782]: pgmap v20801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:35:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38827.638287 secs 2024-04-26T22:35:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:12 smithi196 ceph-mon[32572]: pgmap v20801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:35:12.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38827.638287 secs 2024-04-26T22:35:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:12 smithi110 ceph-mon[28069]: pgmap v20801: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:35:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38827.638287 secs 2024-04-26T22:35:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:14 smithi193 ceph-mon[32782]: pgmap v20802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:35:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:14 smithi196 ceph-mon[32572]: pgmap v20802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:35:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:14 smithi110 ceph-mon[28069]: pgmap v20802: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:35:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:16 smithi193 ceph-mon[32782]: pgmap v20803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:16 smithi196 ceph-mon[32572]: pgmap v20803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:16 smithi110 ceph-mon[28069]: pgmap v20803: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:17 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 38832.638424 secs 2024-04-26T22:35:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:17 smithi193 ceph-mon[32782]: slow request 5760.674956 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:35:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:17 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 38832.638424 secs 2024-04-26T22:35:17.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:17 smithi196 ceph-mon[32572]: slow request 5760.674956 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:35:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:17 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 38832.638424 secs 2024-04-26T22:35:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:17 smithi110 ceph-mon[28069]: slow request 5760.674956 seconds old, received at 2024-04-26T20:59:16.261790+0000: client_request(client.27244:1 getattr pAsLsXsFs #0x1 2024-04-26T20:59:16.256480+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:35:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:18 smithi193 ceph-mon[32782]: pgmap v20804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:18 smithi196 ceph-mon[32572]: pgmap v20804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:18.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:18 smithi110 ceph-mon[28069]: pgmap v20804: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:20 smithi193 ceph-mon[32782]: pgmap v20805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:20 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:35:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:20 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:20 smithi196 ceph-mon[32572]: pgmap v20805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:20 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:35:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:20 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:20 smithi110 ceph-mon[28069]: pgmap v20805: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:20 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:35:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:20 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: pgmap v20806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:35:22.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:35:22.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.623 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38837.638560 secs 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: pgmap v20806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:35:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38837.638560 secs 2024-04-26T22:35:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: pgmap v20806: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:35:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:35:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:35:22.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38837.638560 secs 2024-04-26T22:35:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:23 smithi193 ceph-mon[32782]: pgmap v20807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 977 B/s rd, 1 op/s 2024-04-26T22:35:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:23 smithi193 ceph-mon[32782]: pgmap v20808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T22:35:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:23 smithi196 ceph-mon[32572]: pgmap v20807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 977 B/s rd, 1 op/s 2024-04-26T22:35:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:23 smithi196 ceph-mon[32572]: pgmap v20808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T22:35:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:23 smithi110 ceph-mon[28069]: pgmap v20807: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 977 B/s rd, 1 op/s 2024-04-26T22:35:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:23 smithi110 ceph-mon[28069]: pgmap v20808: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 603 B/s rd, 1 op/s 2024-04-26T22:35:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:25 smithi193 ceph-mon[32782]: pgmap v20809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:25 smithi196 ceph-mon[32572]: pgmap v20809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:25.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:25 smithi110 ceph-mon[28069]: pgmap v20809: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:27 smithi193 ceph-mon[32782]: pgmap v20810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:27.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38842.638678 secs 2024-04-26T22:35:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:27 smithi196 ceph-mon[32572]: pgmap v20810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38842.638678 secs 2024-04-26T22:35:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:27 smithi110 ceph-mon[28069]: pgmap v20810: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38842.638678 secs 2024-04-26T22:35:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:29 smithi193 ceph-mon[32782]: pgmap v20811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:29 smithi196 ceph-mon[32572]: pgmap v20811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:29.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:29 smithi110 ceph-mon[28069]: pgmap v20811: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:31 smithi196 ceph-mon[32572]: pgmap v20812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:31 smithi110 ceph-mon[28069]: pgmap v20812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:31 smithi193 ceph-mon[32782]: pgmap v20812: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38847.638798 secs 2024-04-26T22:35:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38847.638798 secs 2024-04-26T22:35:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38847.638798 secs 2024-04-26T22:35:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:33 smithi196 ceph-mon[32572]: pgmap v20813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:35:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:33 smithi110 ceph-mon[28069]: pgmap v20813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:35:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:33 smithi193 ceph-mon[32782]: pgmap v20813: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:35:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:35 smithi196 ceph-mon[32572]: pgmap v20814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:35 smithi110 ceph-mon[28069]: pgmap v20814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:35 smithi193 ceph-mon[32782]: pgmap v20814: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:37 smithi196 ceph-mon[32572]: pgmap v20815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38852.638909 secs 2024-04-26T22:35:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:37 smithi110 ceph-mon[28069]: pgmap v20815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38852.638909 secs 2024-04-26T22:35:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:37 smithi193 ceph-mon[32782]: pgmap v20815: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38852.638909 secs 2024-04-26T22:35:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:39 smithi196 ceph-mon[32572]: pgmap v20816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:39 smithi110 ceph-mon[28069]: pgmap v20816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:39 smithi193 ceph-mon[32782]: pgmap v20816: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:41 smithi196 ceph-mon[32572]: pgmap v20817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:41 smithi110 ceph-mon[28069]: pgmap v20817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:41 smithi193 ceph-mon[32782]: pgmap v20817: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38857.639017 secs 2024-04-26T22:35:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38857.639017 secs 2024-04-26T22:35:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38857.639017 secs 2024-04-26T22:35:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:43 smithi196 ceph-mon[32572]: pgmap v20818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:43 smithi110 ceph-mon[28069]: pgmap v20818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:43.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:43 smithi193 ceph-mon[32782]: pgmap v20818: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:45 smithi196 ceph-mon[32572]: pgmap v20819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:45 smithi110 ceph-mon[28069]: pgmap v20819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:45 smithi193 ceph-mon[32782]: pgmap v20819: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:47 smithi196 ceph-mon[32572]: pgmap v20820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38862.639114 secs 2024-04-26T22:35:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:47 smithi110 ceph-mon[28069]: pgmap v20820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38862.639114 secs 2024-04-26T22:35:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:47 smithi193 ceph-mon[32782]: pgmap v20820: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38862.639114 secs 2024-04-26T22:35:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:49 smithi196 ceph-mon[32572]: pgmap v20821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:49 smithi110 ceph-mon[28069]: pgmap v20821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:49 smithi193 ceph-mon[32782]: pgmap v20821: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:51 smithi196 ceph-mon[32572]: pgmap v20822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:51.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:51 smithi110 ceph-mon[28069]: pgmap v20822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:51 smithi193 ceph-mon[32782]: pgmap v20822: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38867.639236 secs 2024-04-26T22:35:52.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38867.639236 secs 2024-04-26T22:35:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38867.639236 secs 2024-04-26T22:35:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:53 smithi196 ceph-mon[32572]: pgmap v20823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:53 smithi110 ceph-mon[28069]: pgmap v20823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:53 smithi193 ceph-mon[32782]: pgmap v20823: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:55 smithi196 ceph-mon[32572]: pgmap v20824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:55.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:55 smithi110 ceph-mon[28069]: pgmap v20824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:55 smithi193 ceph-mon[32782]: pgmap v20824: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:57 smithi196 ceph-mon[32572]: pgmap v20825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38872.639355 secs 2024-04-26T22:35:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:57 smithi110 ceph-mon[28069]: pgmap v20825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38872.639355 secs 2024-04-26T22:35:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:57 smithi193 ceph-mon[32782]: pgmap v20825: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:35:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38872.639355 secs 2024-04-26T22:35:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:35:59 smithi196 ceph-mon[32572]: pgmap v20826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:59.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:35:59 smithi110 ceph-mon[28069]: pgmap v20826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:35:59 smithi193 ceph-mon[32782]: pgmap v20826: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:01.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:01 smithi196 ceph-mon[32572]: pgmap v20827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:01 smithi110 ceph-mon[28069]: pgmap v20827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:01 smithi193 ceph-mon[32782]: pgmap v20827: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38877.639472 secs 2024-04-26T22:36:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38877.639472 secs 2024-04-26T22:36:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38877.639472 secs 2024-04-26T22:36:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:03 smithi196 ceph-mon[32572]: pgmap v20828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:03 smithi110 ceph-mon[28069]: pgmap v20828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:03 smithi193 ceph-mon[32782]: pgmap v20828: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:05 smithi196 ceph-mon[32572]: pgmap v20829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:05.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:05 smithi110 ceph-mon[28069]: pgmap v20829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:05 smithi193 ceph-mon[32782]: pgmap v20829: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:07 smithi110 ceph-mon[28069]: pgmap v20830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38882.639589 secs 2024-04-26T22:36:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:07 smithi193 ceph-mon[32782]: pgmap v20830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38882.639589 secs 2024-04-26T22:36:08.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:07 smithi196 ceph-mon[32572]: pgmap v20830: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:08.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38882.639589 secs 2024-04-26T22:36:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:09 smithi110 ceph-mon[28069]: pgmap v20831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:09 smithi193 ceph-mon[32782]: pgmap v20831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:09 smithi196 ceph-mon[32572]: pgmap v20831: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:11.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:11 smithi110 ceph-mon[28069]: pgmap v20832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:11 smithi193 ceph-mon[32782]: pgmap v20832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:11 smithi196 ceph-mon[32572]: pgmap v20832: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:12.795 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38887.639706 secs 2024-04-26T22:36:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38887.639706 secs 2024-04-26T22:36:12.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38887.639706 secs 2024-04-26T22:36:13.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:13 smithi110 ceph-mon[28069]: pgmap v20833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:13 smithi193 ceph-mon[32782]: pgmap v20833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:13 smithi196 ceph-mon[32572]: pgmap v20833: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:15.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:15 smithi110 ceph-mon[28069]: pgmap v20834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:15.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:15 smithi193 ceph-mon[32782]: pgmap v20834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:15 smithi196 ceph-mon[32572]: pgmap v20834: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:17 smithi110 ceph-mon[28069]: pgmap v20835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38892.639859 secs 2024-04-26T22:36:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:17 smithi193 ceph-mon[32782]: pgmap v20835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38892.639859 secs 2024-04-26T22:36:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:17 smithi196 ceph-mon[32572]: pgmap v20835: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38892.639859 secs 2024-04-26T22:36:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:19 smithi193 ceph-mon[32782]: pgmap v20836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:19 smithi196 ceph-mon[32572]: pgmap v20836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:19 smithi110 ceph-mon[28069]: pgmap v20836: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:21 smithi193 ceph-mon[32782]: pgmap v20837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:21 smithi196 ceph-mon[32572]: pgmap v20837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:21 smithi110 ceph-mon[28069]: pgmap v20837: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:36:22.832+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:36:22.832+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:36:22.833+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 299 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:36:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:36:22.833+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 299 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:36:22.836 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38897.639978 secs 2024-04-26T22:36:22.836 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:22 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:36:22.843 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38897.639978 secs 2024-04-26T22:36:22.843 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:22 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:36:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38897.639978 secs 2024-04-26T22:36:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:22 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:36:23.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:23 smithi110 ceph-mon[28069]: pgmap v20838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:23 smithi193 ceph-mon[32782]: pgmap v20838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:23 smithi196 ceph-mon[32572]: pgmap v20838: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:25.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: pgmap v20839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: pgmap v20839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: pgmap v20839: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:25.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:36:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:36:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:36:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:36:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:26 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:26.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:26 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:26.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:26 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:27 smithi193 ceph-mon[32782]: pgmap v20840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:36:27.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38902.640099 secs 2024-04-26T22:36:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:27 smithi196 ceph-mon[32572]: pgmap v20840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:36:27.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38902.640099 secs 2024-04-26T22:36:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:27 smithi110 ceph-mon[28069]: pgmap v20840: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:36:27.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38902.640099 secs 2024-04-26T22:36:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:36:28.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: pgmap v20841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:28.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: pgmap v20842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s rd, 1 op/s 2024-04-26T22:36:28.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:28 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:36:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: pgmap v20841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:28.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: pgmap v20842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s rd, 1 op/s 2024-04-26T22:36:28.506 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:28 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: pgmap v20841: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: pgmap v20842: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s rd, 1 op/s 2024-04-26T22:36:28.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:28 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:36:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:30 smithi193 ceph-mon[32782]: pgmap v20843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s rd, 1 op/s 2024-04-26T22:36:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:30 smithi196 ceph-mon[32572]: pgmap v20843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s rd, 1 op/s 2024-04-26T22:36:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:30 smithi110 ceph-mon[28069]: pgmap v20843: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s rd, 1 op/s 2024-04-26T22:36:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:32 smithi193 ceph-mon[32782]: pgmap v20844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s rd, 1 op/s 2024-04-26T22:36:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38907.640213 secs 2024-04-26T22:36:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:32 smithi196 ceph-mon[32572]: pgmap v20844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s rd, 1 op/s 2024-04-26T22:36:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38907.640213 secs 2024-04-26T22:36:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:32 smithi110 ceph-mon[28069]: pgmap v20844: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 941 B/s rd, 1 op/s 2024-04-26T22:36:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38907.640213 secs 2024-04-26T22:36:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:34 smithi193 ceph-mon[32782]: pgmap v20845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:36:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:34 smithi196 ceph-mon[32572]: pgmap v20845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:36:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:34 smithi110 ceph-mon[28069]: pgmap v20845: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:36:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:36 smithi193 ceph-mon[32782]: pgmap v20846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:36:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:36 smithi196 ceph-mon[32572]: pgmap v20846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:36:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:36 smithi110 ceph-mon[28069]: pgmap v20846: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:36:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38912.640339 secs 2024-04-26T22:36:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38912.640339 secs 2024-04-26T22:36:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38912.640339 secs 2024-04-26T22:36:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:38 smithi196 ceph-mon[32572]: pgmap v20847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:36:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:38 smithi110 ceph-mon[28069]: pgmap v20847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:36:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:38 smithi193 ceph-mon[32782]: pgmap v20847: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:36:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:40 smithi196 ceph-mon[32572]: pgmap v20848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:40 smithi110 ceph-mon[28069]: pgmap v20848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:40 smithi193 ceph-mon[32782]: pgmap v20848: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:41.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:41 smithi110 ceph-mon[28069]: pgmap v20849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:41 smithi196 ceph-mon[32572]: pgmap v20849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:41 smithi193 ceph-mon[32782]: pgmap v20849: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38917.640457 secs 2024-04-26T22:36:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38917.640457 secs 2024-04-26T22:36:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38917.640457 secs 2024-04-26T22:36:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:43 smithi196 ceph-mon[32572]: pgmap v20850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:44.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:43 smithi110 ceph-mon[28069]: pgmap v20850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:43 smithi193 ceph-mon[32782]: pgmap v20850: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:46 smithi193 ceph-mon[32782]: pgmap v20851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:46 smithi196 ceph-mon[32572]: pgmap v20851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:46 smithi110 ceph-mon[28069]: pgmap v20851: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38922.640590 secs 2024-04-26T22:36:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38922.640590 secs 2024-04-26T22:36:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38922.640590 secs 2024-04-26T22:36:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:48 smithi193 ceph-mon[32782]: pgmap v20852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:48 smithi196 ceph-mon[32572]: pgmap v20852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:48 smithi110 ceph-mon[28069]: pgmap v20852: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:50 smithi193 ceph-mon[32782]: pgmap v20853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:50 smithi196 ceph-mon[32572]: pgmap v20853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:50 smithi110 ceph-mon[28069]: pgmap v20853: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:52.946 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:52 smithi193 ceph-mon[32782]: pgmap v20854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:52.946 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38927.640705 secs 2024-04-26T22:36:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:52 smithi196 ceph-mon[32572]: pgmap v20854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38927.640705 secs 2024-04-26T22:36:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:52 smithi110 ceph-mon[28069]: pgmap v20854: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38927.640705 secs 2024-04-26T22:36:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:54 smithi196 ceph-mon[32572]: pgmap v20855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:54 smithi110 ceph-mon[28069]: pgmap v20855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:54 smithi193 ceph-mon[32782]: pgmap v20855: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:55 smithi196 ceph-mon[32572]: pgmap v20856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:55 smithi110 ceph-mon[28069]: pgmap v20856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:55 smithi193 ceph-mon[32782]: pgmap v20856: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:36:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38932.640817 secs 2024-04-26T22:36:57.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38932.640817 secs 2024-04-26T22:36:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38932.640817 secs 2024-04-26T22:36:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:36:58 smithi193 ceph-mon[32782]: pgmap v20857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:36:58 smithi196 ceph-mon[32572]: pgmap v20857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:36:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:36:58 smithi110 ceph-mon[28069]: pgmap v20857: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:00 smithi193 ceph-mon[32782]: pgmap v20858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:01.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:00 smithi196 ceph-mon[32572]: pgmap v20858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:00 smithi110 ceph-mon[28069]: pgmap v20858: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:02 smithi193 ceph-mon[32782]: pgmap v20859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38937.640925 secs 2024-04-26T22:37:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:02 smithi196 ceph-mon[32572]: pgmap v20859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38937.640925 secs 2024-04-26T22:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:02 smithi110 ceph-mon[28069]: pgmap v20859: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38937.640925 secs 2024-04-26T22:37:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:04 smithi193 ceph-mon[32782]: pgmap v20860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:04 smithi196 ceph-mon[32572]: pgmap v20860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:04 smithi110 ceph-mon[28069]: pgmap v20860: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:06 smithi196 ceph-mon[32572]: pgmap v20861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:06 smithi110 ceph-mon[28069]: pgmap v20861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:06 smithi193 ceph-mon[32782]: pgmap v20861: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38942.641049 secs 2024-04-26T22:37:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38942.641049 secs 2024-04-26T22:37:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38942.641049 secs 2024-04-26T22:37:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:08 smithi196 ceph-mon[32572]: pgmap v20862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:08 smithi110 ceph-mon[28069]: pgmap v20862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:08 smithi193 ceph-mon[32782]: pgmap v20862: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:10 smithi196 ceph-mon[32572]: pgmap v20863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:10 smithi110 ceph-mon[28069]: pgmap v20863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:10 smithi193 ceph-mon[32782]: pgmap v20863: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:11.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:11 smithi110 ceph-mon[28069]: pgmap v20864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:11 smithi196 ceph-mon[32572]: pgmap v20864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:11 smithi193 ceph-mon[32782]: pgmap v20864: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38947.641164 secs 2024-04-26T22:37:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38947.641164 secs 2024-04-26T22:37:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38947.641164 secs 2024-04-26T22:37:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:13 smithi196 ceph-mon[32572]: pgmap v20865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:13 smithi110 ceph-mon[28069]: pgmap v20865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:13 smithi193 ceph-mon[32782]: pgmap v20865: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:16 smithi193 ceph-mon[32782]: pgmap v20866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:16 smithi196 ceph-mon[32572]: pgmap v20866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:16 smithi110 ceph-mon[28069]: pgmap v20866: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38952.641290 secs 2024-04-26T22:37:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38952.641290 secs 2024-04-26T22:37:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38952.641290 secs 2024-04-26T22:37:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:18 smithi196 ceph-mon[32572]: pgmap v20867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:18 smithi110 ceph-mon[28069]: pgmap v20867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:18 smithi193 ceph-mon[32782]: pgmap v20867: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:20 smithi196 ceph-mon[32572]: pgmap v20868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:20 smithi110 ceph-mon[28069]: pgmap v20868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:20 smithi193 ceph-mon[32782]: pgmap v20868: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:22.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:22 smithi193 ceph-mon[32782]: pgmap v20869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:22.924 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38957.641413 secs 2024-04-26T22:37:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:22 smithi196 ceph-mon[32572]: pgmap v20869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38957.641413 secs 2024-04-26T22:37:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:22 smithi110 ceph-mon[28069]: pgmap v20869: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38957.641413 secs 2024-04-26T22:37:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:23 smithi196 ceph-mon[32572]: pgmap v20870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:23 smithi110 ceph-mon[28069]: pgmap v20870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:23 smithi193 ceph-mon[32782]: pgmap v20870: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:26 smithi196 ceph-mon[32572]: pgmap v20871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:26 smithi110 ceph-mon[28069]: pgmap v20871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:26 smithi193 ceph-mon[32782]: pgmap v20871: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:28.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38962.641516 secs 2024-04-26T22:37:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38962.641516 secs 2024-04-26T22:37:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38962.641516 secs 2024-04-26T22:37:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:28 smithi196 ceph-mon[32572]: pgmap v20872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:29.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:37:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:28 smithi110 ceph-mon[28069]: pgmap v20872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:37:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:28 smithi193 ceph-mon[32782]: pgmap v20872: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:37:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:37:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:37:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:37:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:37:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:37:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:37:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:37:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:37:30.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:37:31.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:30 smithi196 ceph-mon[32572]: pgmap v20873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 876 B/s rd, 1 op/s 2024-04-26T22:37:31.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:30 smithi196 ceph-mon[32572]: pgmap v20874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:30 smithi110 ceph-mon[28069]: pgmap v20873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 876 B/s rd, 1 op/s 2024-04-26T22:37:31.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:30 smithi110 ceph-mon[28069]: pgmap v20874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:30 smithi193 ceph-mon[32782]: pgmap v20873: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 876 B/s rd, 1 op/s 2024-04-26T22:37:31.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:30 smithi193 ceph-mon[32782]: pgmap v20874: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:31 smithi196 ceph-mon[32572]: pgmap v20875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:31 smithi110 ceph-mon[28069]: pgmap v20875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:31 smithi193 ceph-mon[32782]: pgmap v20875: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38967.641632 secs 2024-04-26T22:37:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38967.641632 secs 2024-04-26T22:37:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38967.641632 secs 2024-04-26T22:37:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:33 smithi196 ceph-mon[32572]: pgmap v20876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:33 smithi110 ceph-mon[28069]: pgmap v20876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:33 smithi193 ceph-mon[32782]: pgmap v20876: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:36 smithi193 ceph-mon[32782]: pgmap v20877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:36 smithi196 ceph-mon[32572]: pgmap v20877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:36 smithi110 ceph-mon[28069]: pgmap v20877: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:37:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38972.641757 secs 2024-04-26T22:37:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38972.641757 secs 2024-04-26T22:37:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38972.641757 secs 2024-04-26T22:37:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:38 smithi193 ceph-mon[32782]: pgmap v20878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 528 B/s rd, 1 op/s 2024-04-26T22:37:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:38 smithi196 ceph-mon[32572]: pgmap v20878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 528 B/s rd, 1 op/s 2024-04-26T22:37:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:38 smithi110 ceph-mon[28069]: pgmap v20878: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 528 B/s rd, 1 op/s 2024-04-26T22:37:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:40 smithi193 ceph-mon[32782]: pgmap v20879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:37:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:40 smithi196 ceph-mon[32572]: pgmap v20879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:37:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:40 smithi110 ceph-mon[28069]: pgmap v20879: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:37:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:42 smithi110 ceph-mon[28069]: pgmap v20880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38977.641872 secs 2024-04-26T22:37:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:42 smithi193 ceph-mon[32782]: pgmap v20880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38977.641872 secs 2024-04-26T22:37:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:42 smithi196 ceph-mon[32572]: pgmap v20880: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38977.641872 secs 2024-04-26T22:37:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:44 smithi193 ceph-mon[32782]: pgmap v20881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:44 smithi196 ceph-mon[32572]: pgmap v20881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:44 smithi110 ceph-mon[28069]: pgmap v20881: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:46 smithi193 ceph-mon[32782]: pgmap v20882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:46 smithi196 ceph-mon[32572]: pgmap v20882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:46 smithi110 ceph-mon[28069]: pgmap v20882: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38982.641989 secs 2024-04-26T22:37:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38982.641989 secs 2024-04-26T22:37:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38982.641989 secs 2024-04-26T22:37:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:48 smithi193 ceph-mon[32782]: pgmap v20883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:48 smithi196 ceph-mon[32572]: pgmap v20883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:48 smithi110 ceph-mon[28069]: pgmap v20883: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:50 smithi193 ceph-mon[32782]: pgmap v20884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:50 smithi196 ceph-mon[32572]: pgmap v20884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:50 smithi110 ceph-mon[28069]: pgmap v20884: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:52 smithi193 ceph-mon[32782]: pgmap v20885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:52.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38987.642105 secs 2024-04-26T22:37:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:52 smithi196 ceph-mon[32572]: pgmap v20885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38987.642105 secs 2024-04-26T22:37:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:52 smithi110 ceph-mon[28069]: pgmap v20885: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38987.642105 secs 2024-04-26T22:37:54.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:54 smithi193 ceph-mon[32782]: pgmap v20886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:54 smithi196 ceph-mon[32572]: pgmap v20886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:54 smithi110 ceph-mon[28069]: pgmap v20886: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:37:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:56 smithi193 ceph-mon[32782]: pgmap v20887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:56.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:56 smithi196 ceph-mon[32572]: pgmap v20887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:56 smithi110 ceph-mon[28069]: pgmap v20887: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38992.642205 secs 2024-04-26T22:37:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38992.642205 secs 2024-04-26T22:37:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38992.642205 secs 2024-04-26T22:37:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:37:58 smithi196 ceph-mon[32572]: pgmap v20888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:58.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:37:58 smithi110 ceph-mon[28069]: pgmap v20888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:37:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:37:58 smithi193 ceph-mon[32782]: pgmap v20888: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:00 smithi196 ceph-mon[32572]: pgmap v20889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:00 smithi110 ceph-mon[28069]: pgmap v20889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:00 smithi193 ceph-mon[32782]: pgmap v20889: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:02 smithi196 ceph-mon[32572]: pgmap v20890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:02.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 38997.642327 secs 2024-04-26T22:38:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:02 smithi110 ceph-mon[28069]: pgmap v20890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 38997.642327 secs 2024-04-26T22:38:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:02 smithi193 ceph-mon[32782]: pgmap v20890: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:02.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 38997.642327 secs 2024-04-26T22:38:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:04 smithi196 ceph-mon[32572]: pgmap v20891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:04 smithi110 ceph-mon[28069]: pgmap v20891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:04 smithi193 ceph-mon[32782]: pgmap v20891: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:06 smithi196 ceph-mon[32572]: pgmap v20892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:06 smithi110 ceph-mon[28069]: pgmap v20892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:06 smithi193 ceph-mon[32782]: pgmap v20892: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39002.642445 secs 2024-04-26T22:38:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39002.642445 secs 2024-04-26T22:38:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39002.642445 secs 2024-04-26T22:38:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:08 smithi196 ceph-mon[32572]: pgmap v20893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:08.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:08 smithi110 ceph-mon[28069]: pgmap v20893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:08 smithi193 ceph-mon[32782]: pgmap v20893: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:10 smithi196 ceph-mon[32572]: pgmap v20894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:10.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:10 smithi110 ceph-mon[28069]: pgmap v20894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:10 smithi193 ceph-mon[32782]: pgmap v20894: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:12 smithi196 ceph-mon[32572]: pgmap v20895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39007.642581 secs 2024-04-26T22:38:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:12 smithi110 ceph-mon[28069]: pgmap v20895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39007.642581 secs 2024-04-26T22:38:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:12 smithi193 ceph-mon[32782]: pgmap v20895: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39007.642581 secs 2024-04-26T22:38:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:14 smithi110 ceph-mon[28069]: pgmap v20896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:14 smithi193 ceph-mon[32782]: pgmap v20896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:14 smithi196 ceph-mon[32572]: pgmap v20896: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:16 smithi110 ceph-mon[28069]: pgmap v20897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:16 smithi193 ceph-mon[32782]: pgmap v20897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:16 smithi196 ceph-mon[32572]: pgmap v20897: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39012.642710 secs 2024-04-26T22:38:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39012.642710 secs 2024-04-26T22:38:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39012.642710 secs 2024-04-26T22:38:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:18 smithi193 ceph-mon[32782]: pgmap v20898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:18 smithi196 ceph-mon[32572]: pgmap v20898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:18 smithi110 ceph-mon[28069]: pgmap v20898: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:20 smithi193 ceph-mon[32782]: pgmap v20899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:20 smithi196 ceph-mon[32572]: pgmap v20899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:21.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:20 smithi110 ceph-mon[28069]: pgmap v20899: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:22.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:22 smithi193 ceph-mon[32782]: pgmap v20900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:22.913 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39017.642835 secs 2024-04-26T22:38:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:22 smithi196 ceph-mon[32572]: pgmap v20900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39017.642835 secs 2024-04-26T22:38:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:22 smithi110 ceph-mon[28069]: pgmap v20900: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39017.642835 secs 2024-04-26T22:38:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:24 smithi193 ceph-mon[32782]: pgmap v20901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:24 smithi196 ceph-mon[32572]: pgmap v20901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:25.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:24 smithi110 ceph-mon[28069]: pgmap v20901: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:26 smithi193 ceph-mon[32782]: pgmap v20902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:26 smithi196 ceph-mon[32572]: pgmap v20902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:26 smithi110 ceph-mon[28069]: pgmap v20902: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39022.642961 secs 2024-04-26T22:38:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39022.642961 secs 2024-04-26T22:38:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39022.642961 secs 2024-04-26T22:38:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:28 smithi193 ceph-mon[32782]: pgmap v20903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:28 smithi196 ceph-mon[32572]: pgmap v20903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:28 smithi110 ceph-mon[28069]: pgmap v20903: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:38:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:38:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:38:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:30 smithi193 ceph-mon[32782]: pgmap v20904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:30 smithi196 ceph-mon[32572]: pgmap v20904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:30 smithi110 ceph-mon[28069]: pgmap v20904: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:38:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:31 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:38:31.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:31 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:38:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:38:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:31 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:38:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:31 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:38:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:38:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:31 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:38:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:31 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:38:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:32 smithi193 ceph-mon[32782]: pgmap v20905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:38:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:32 smithi193 ceph-mon[32782]: pgmap v20906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:32.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39027.643088 secs 2024-04-26T22:38:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:32 smithi196 ceph-mon[32572]: pgmap v20905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:38:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:32 smithi196 ceph-mon[32572]: pgmap v20906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39027.643088 secs 2024-04-26T22:38:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:32 smithi110 ceph-mon[28069]: pgmap v20905: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:38:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:32 smithi110 ceph-mon[28069]: pgmap v20906: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39027.643088 secs 2024-04-26T22:38:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:34 smithi193 ceph-mon[32782]: pgmap v20907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:34 smithi196 ceph-mon[32572]: pgmap v20907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:34 smithi110 ceph-mon[28069]: pgmap v20907: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:36 smithi193 ceph-mon[32782]: pgmap v20908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:37.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:36 smithi196 ceph-mon[32572]: pgmap v20908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:36 smithi110 ceph-mon[28069]: pgmap v20908: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39032.643170 secs 2024-04-26T22:38:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39032.643170 secs 2024-04-26T22:38:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39032.643170 secs 2024-04-26T22:38:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:38 smithi196 ceph-mon[32572]: pgmap v20909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:38 smithi110 ceph-mon[28069]: pgmap v20909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:38 smithi193 ceph-mon[32782]: pgmap v20909: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:40 smithi196 ceph-mon[32572]: pgmap v20910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:40 smithi110 ceph-mon[28069]: pgmap v20910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:40 smithi193 ceph-mon[32782]: pgmap v20910: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:38:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:42 smithi196 ceph-mon[32572]: pgmap v20911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:38:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39037.643312 secs 2024-04-26T22:38:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:42 smithi110 ceph-mon[28069]: pgmap v20911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:38:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39037.643312 secs 2024-04-26T22:38:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:42 smithi193 ceph-mon[32782]: pgmap v20911: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:38:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39037.643312 secs 2024-04-26T22:38:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:44 smithi196 ceph-mon[32572]: pgmap v20912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:44 smithi110 ceph-mon[28069]: pgmap v20912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:44 smithi193 ceph-mon[32782]: pgmap v20912: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:46 smithi196 ceph-mon[32572]: pgmap v20913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:46 smithi110 ceph-mon[28069]: pgmap v20913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:46 smithi193 ceph-mon[32782]: pgmap v20913: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39042.643459 secs 2024-04-26T22:38:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39042.643459 secs 2024-04-26T22:38:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39042.643459 secs 2024-04-26T22:38:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:48 smithi196 ceph-mon[32572]: pgmap v20914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:48 smithi110 ceph-mon[28069]: pgmap v20914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:48 smithi193 ceph-mon[32782]: pgmap v20914: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:49 smithi196 ceph-mon[32572]: pgmap v20915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:49 smithi110 ceph-mon[28069]: pgmap v20915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:49 smithi193 ceph-mon[32782]: pgmap v20915: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:51 smithi196 ceph-mon[32572]: pgmap v20916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:52.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:51 smithi110 ceph-mon[28069]: pgmap v20916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:51 smithi193 ceph-mon[32782]: pgmap v20916: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39047.643602 secs 2024-04-26T22:38:53.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39047.643602 secs 2024-04-26T22:38:53.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39047.643602 secs 2024-04-26T22:38:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:53 smithi196 ceph-mon[32572]: pgmap v20917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:54.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:53 smithi110 ceph-mon[28069]: pgmap v20917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:53 smithi193 ceph-mon[32782]: pgmap v20917: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:38:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:55 smithi196 ceph-mon[32572]: pgmap v20918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:55 smithi110 ceph-mon[28069]: pgmap v20918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:55 smithi193 ceph-mon[32782]: pgmap v20918: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:57 smithi196 ceph-mon[32572]: pgmap v20919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:58.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39052.643735 secs 2024-04-26T22:38:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:57 smithi110 ceph-mon[28069]: pgmap v20919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39052.643735 secs 2024-04-26T22:38:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:57 smithi193 ceph-mon[32782]: pgmap v20919: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:38:58.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39052.643735 secs 2024-04-26T22:39:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:38:59 smithi196 ceph-mon[32572]: pgmap v20920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:00.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:38:59 smithi110 ceph-mon[28069]: pgmap v20920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:38:59 smithi193 ceph-mon[32782]: pgmap v20920: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:01 smithi196 ceph-mon[32572]: pgmap v20921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:01 smithi110 ceph-mon[28069]: pgmap v20921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:02.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:01 smithi193 ceph-mon[32782]: pgmap v20921: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39057.643854 secs 2024-04-26T22:39:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39057.643854 secs 2024-04-26T22:39:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39057.643854 secs 2024-04-26T22:39:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:03 smithi196 ceph-mon[32572]: pgmap v20922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:03 smithi110 ceph-mon[28069]: pgmap v20922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:04.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:03 smithi193 ceph-mon[32782]: pgmap v20922: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:05 smithi196 ceph-mon[32572]: pgmap v20923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:06.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:05 smithi110 ceph-mon[28069]: pgmap v20923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:05 smithi193 ceph-mon[32782]: pgmap v20923: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:07 smithi196 ceph-mon[32572]: pgmap v20924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:08.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39062.643916 secs 2024-04-26T22:39:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:07 smithi110 ceph-mon[28069]: pgmap v20924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39062.643916 secs 2024-04-26T22:39:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:07 smithi193 ceph-mon[32782]: pgmap v20924: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39062.643916 secs 2024-04-26T22:39:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:09 smithi196 ceph-mon[32572]: pgmap v20925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:10.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:09 smithi110 ceph-mon[28069]: pgmap v20925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:09 smithi193 ceph-mon[32782]: pgmap v20925: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:11 smithi196 ceph-mon[32572]: pgmap v20926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:12.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:11 smithi110 ceph-mon[28069]: pgmap v20926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:11 smithi193 ceph-mon[32782]: pgmap v20926: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39067.644015 secs 2024-04-26T22:39:13.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39067.644015 secs 2024-04-26T22:39:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39067.644015 secs 2024-04-26T22:39:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:13 smithi196 ceph-mon[32572]: pgmap v20927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:14.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:13 smithi110 ceph-mon[28069]: pgmap v20927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:13 smithi193 ceph-mon[32782]: pgmap v20927: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:15 smithi196 ceph-mon[32572]: pgmap v20928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:16.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:15 smithi110 ceph-mon[28069]: pgmap v20928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:16.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:15 smithi193 ceph-mon[32782]: pgmap v20928: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:17 smithi196 ceph-mon[32572]: pgmap v20929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39072.644111 secs 2024-04-26T22:39:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:17 smithi110 ceph-mon[28069]: pgmap v20929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39072.644111 secs 2024-04-26T22:39:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:17 smithi193 ceph-mon[32782]: pgmap v20929: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39072.644111 secs 2024-04-26T22:39:19.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:39:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:39:19.230+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:39:19.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:39:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:39:19.230+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:39:19.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:39:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:39:19.230+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:39:19.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:39:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:39:19.230+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:39:19.542 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:39:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:39:19.230+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:39:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:19 smithi196 ceph-mon[32572]: pgmap v20930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:19 smithi110 ceph-mon[28069]: pgmap v20930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:19 smithi193 ceph-mon[32782]: pgmap v20930: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:21 smithi196 ceph-mon[32572]: pgmap v20931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:22.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:21 smithi110 ceph-mon[28069]: pgmap v20931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:21 smithi193 ceph-mon[32782]: pgmap v20931: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:39:22.873+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:39:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:39:22.873+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:39:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:39:22.874+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 300 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:39:22.875 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:39:22.874+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 300 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:39:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39077.644234 secs 2024-04-26T22:39:23.273 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39077.644234 secs 2024-04-26T22:39:23.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39077.644234 secs 2024-04-26T22:39:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:24 smithi196 ceph-mon[32572]: pgmap v20932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:39:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:24 smithi110 ceph-mon[28069]: pgmap v20932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:39:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:24 smithi193 ceph-mon[32782]: pgmap v20932: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:39:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:26 smithi110 ceph-mon[28069]: pgmap v20933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:39:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:26 smithi193 ceph-mon[32782]: pgmap v20933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:39:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:26 smithi196 ceph-mon[32572]: pgmap v20933: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:39:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:28 smithi110 ceph-mon[28069]: pgmap v20934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:39:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:28 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39082.644357 secs 2024-04-26T22:39:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:28 smithi193 ceph-mon[32782]: pgmap v20934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:39:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:28 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39082.644357 secs 2024-04-26T22:39:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:28 smithi196 ceph-mon[32572]: pgmap v20934: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:39:28.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:28 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39082.644357 secs 2024-04-26T22:39:30.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:30 smithi110 ceph-mon[28069]: pgmap v20935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:39:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:30 smithi193 ceph-mon[32782]: pgmap v20935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:39:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:30 smithi196 ceph-mon[32572]: pgmap v20935: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:39:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:32 smithi110 ceph-mon[28069]: pgmap v20936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:39:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:32 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:39:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:32 smithi193 ceph-mon[32782]: pgmap v20936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:39:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:32 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:39:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:32 smithi196 ceph-mon[32572]: pgmap v20936: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:39:32.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:32 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:39:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:33 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39087.644504 secs 2024-04-26T22:39:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:39:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:39:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:33 smithi110 ceph-mon[28069]: pgmap v20937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 177 B/s wr, 2 op/s 2024-04-26T22:39:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:33 smithi110 ceph-mon[28069]: pgmap v20938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:39:33.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:33 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:39:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:33 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39087.644504 secs 2024-04-26T22:39:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:39:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:39:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:33 smithi193 ceph-mon[32782]: pgmap v20937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 177 B/s wr, 2 op/s 2024-04-26T22:39:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:33 smithi193 ceph-mon[32782]: pgmap v20938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:39:33.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:33 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:39:33.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:33 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39087.644504 secs 2024-04-26T22:39:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:39:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:39:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:33 smithi196 ceph-mon[32572]: pgmap v20937: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 975 B/s rd, 177 B/s wr, 2 op/s 2024-04-26T22:39:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:33 smithi196 ceph-mon[32572]: pgmap v20938: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:39:33.505 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:33 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:39:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:35 smithi196 ceph-mon[32572]: pgmap v20939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:35 smithi110 ceph-mon[28069]: pgmap v20939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:35 smithi193 ceph-mon[32782]: pgmap v20939: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:37 smithi196 ceph-mon[32572]: pgmap v20940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39092.644633 secs 2024-04-26T22:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:37 smithi110 ceph-mon[28069]: pgmap v20940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39092.644633 secs 2024-04-26T22:39:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:37 smithi193 ceph-mon[32782]: pgmap v20940: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39092.644633 secs 2024-04-26T22:39:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:39 smithi196 ceph-mon[32572]: pgmap v20941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:39 smithi110 ceph-mon[28069]: pgmap v20941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:39 smithi193 ceph-mon[32782]: pgmap v20941: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:41 smithi196 ceph-mon[32572]: pgmap v20942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:41 smithi110 ceph-mon[28069]: pgmap v20942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:41 smithi193 ceph-mon[32782]: pgmap v20942: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:39:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39097.644774 secs 2024-04-26T22:39:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39097.644774 secs 2024-04-26T22:39:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39097.644774 secs 2024-04-26T22:39:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:43 smithi196 ceph-mon[32572]: pgmap v20943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:39:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:43 smithi110 ceph-mon[28069]: pgmap v20943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:39:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:43 smithi193 ceph-mon[32782]: pgmap v20943: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:39:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:45 smithi196 ceph-mon[32572]: pgmap v20944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:45 smithi110 ceph-mon[28069]: pgmap v20944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:45 smithi193 ceph-mon[32782]: pgmap v20944: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:47 smithi196 ceph-mon[32572]: pgmap v20945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39102.644881 secs 2024-04-26T22:39:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:47 smithi110 ceph-mon[28069]: pgmap v20945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39102.644881 secs 2024-04-26T22:39:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:47 smithi193 ceph-mon[32782]: pgmap v20945: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39102.644881 secs 2024-04-26T22:39:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:49 smithi196 ceph-mon[32572]: pgmap v20946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:49 smithi110 ceph-mon[28069]: pgmap v20946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:49 smithi193 ceph-mon[32782]: pgmap v20946: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:51 smithi196 ceph-mon[32572]: pgmap v20947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:51.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:51 smithi110 ceph-mon[28069]: pgmap v20947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:51 smithi193 ceph-mon[32782]: pgmap v20947: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39107.644979 secs 2024-04-26T22:39:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39107.644979 secs 2024-04-26T22:39:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39107.644979 secs 2024-04-26T22:39:53.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:53 smithi196 ceph-mon[32572]: pgmap v20948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:39:53.773 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:53 smithi193 ceph-mon[32782]: pgmap v20948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:39:53.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:53 smithi110 ceph-mon[28069]: pgmap v20948: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:39:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:55 smithi193 ceph-mon[32782]: pgmap v20949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:56.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:55 smithi196 ceph-mon[32572]: pgmap v20949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:55 smithi110 ceph-mon[28069]: pgmap v20949: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:39:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:57 smithi193 ceph-mon[32782]: pgmap v20950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39112.645114 secs 2024-04-26T22:39:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:57 smithi196 ceph-mon[32572]: pgmap v20950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:58.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39112.645114 secs 2024-04-26T22:39:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:57 smithi110 ceph-mon[28069]: pgmap v20950: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:39:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39112.645114 secs 2024-04-26T22:39:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:39:59 smithi193 ceph-mon[32782]: pgmap v20951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:39:59 smithi196 ceph-mon[32572]: pgmap v20951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:39:59 smithi110 ceph-mon[28069]: pgmap v20951: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:40:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:40:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:40:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:01 smithi193 ceph-mon[32782]: pgmap v20952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:01 smithi196 ceph-mon[32572]: pgmap v20952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:01 smithi110 ceph-mon[28069]: pgmap v20952: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39117.645258 secs 2024-04-26T22:40:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39117.645258 secs 2024-04-26T22:40:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39117.645258 secs 2024-04-26T22:40:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:03 smithi193 ceph-mon[32782]: pgmap v20953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:40:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:03 smithi196 ceph-mon[32572]: pgmap v20953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:40:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:03 smithi110 ceph-mon[28069]: pgmap v20953: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:40:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:05 smithi193 ceph-mon[32782]: pgmap v20954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:05 smithi196 ceph-mon[32572]: pgmap v20954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:05 smithi110 ceph-mon[28069]: pgmap v20954: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:07 smithi193 ceph-mon[32782]: pgmap v20955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39122.645382 secs 2024-04-26T22:40:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:40:07.880+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:40:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:40:07.880+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:40:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:40:07.881+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 301 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:40:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:40:07.881+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 301 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:40:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:07 smithi196 ceph-mon[32572]: pgmap v20955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39122.645382 secs 2024-04-26T22:40:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:07 smithi110 ceph-mon[28069]: pgmap v20955: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39122.645382 secs 2024-04-26T22:40:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:09 smithi193 ceph-mon[32782]: pgmap v20956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:09 smithi196 ceph-mon[32572]: pgmap v20956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:09 smithi110 ceph-mon[28069]: pgmap v20956: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:11 smithi196 ceph-mon[32572]: pgmap v20957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:11 smithi110 ceph-mon[28069]: pgmap v20957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:11 smithi193 ceph-mon[32782]: pgmap v20957: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:12.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39127.645497 secs 2024-04-26T22:40:12.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39127.645497 secs 2024-04-26T22:40:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39127.645497 secs 2024-04-26T22:40:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:13 smithi196 ceph-mon[32572]: pgmap v20958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:14.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:13 smithi110 ceph-mon[28069]: pgmap v20958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:13 smithi193 ceph-mon[32782]: pgmap v20958: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:15 smithi196 ceph-mon[32572]: pgmap v20959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:15 smithi110 ceph-mon[28069]: pgmap v20959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:15 smithi193 ceph-mon[32782]: pgmap v20959: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:17 smithi196 ceph-mon[32572]: pgmap v20960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:17 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 39132.645622 secs 2024-04-26T22:40:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:17 smithi196 ceph-mon[32572]: slow request 5760.453657 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:40:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:17 smithi110 ceph-mon[28069]: pgmap v20960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:17 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 39132.645622 secs 2024-04-26T22:40:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:17 smithi110 ceph-mon[28069]: slow request 5760.453657 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:40:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:17 smithi193 ceph-mon[32782]: pgmap v20960: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:17 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 39132.645622 secs 2024-04-26T22:40:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:17 smithi193 ceph-mon[32782]: slow request 5760.453657 seconds old, received at 2024-04-26T21:04:16.490287+0000: client_request(client.27194:1 getattr pAsLsXsFs #0x1 2024-04-26T21:04:16.485887+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:40:20.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:19 smithi196 ceph-mon[32572]: pgmap v20961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:19 smithi110 ceph-mon[28069]: pgmap v20961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:20.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:19 smithi193 ceph-mon[32782]: pgmap v20961: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:21 smithi196 ceph-mon[32572]: pgmap v20962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:21 smithi110 ceph-mon[28069]: pgmap v20962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:22.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:21 smithi193 ceph-mon[32782]: pgmap v20962: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39137.645736 secs 2024-04-26T22:40:23.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39137.645736 secs 2024-04-26T22:40:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39137.645736 secs 2024-04-26T22:40:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:23 smithi196 ceph-mon[32572]: pgmap v20963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:23 smithi110 ceph-mon[28069]: pgmap v20963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:23 smithi193 ceph-mon[32782]: pgmap v20963: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:26.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:25 smithi196 ceph-mon[32572]: pgmap v20964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:26.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:25 smithi110 ceph-mon[28069]: pgmap v20964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:25 smithi193 ceph-mon[32782]: pgmap v20964: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:27 smithi196 ceph-mon[32572]: pgmap v20965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39142.645857 secs 2024-04-26T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:27 smithi110 ceph-mon[28069]: pgmap v20965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39142.645857 secs 2024-04-26T22:40:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:27 smithi193 ceph-mon[32782]: pgmap v20965: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:28.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39142.645857 secs 2024-04-26T22:40:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:28 smithi196 ceph-mon[32572]: pgmap v20966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:28 smithi110 ceph-mon[28069]: pgmap v20966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:28 smithi193 ceph-mon[32782]: pgmap v20966: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:31.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:31 smithi196 ceph-mon[32572]: pgmap v20967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:31.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:31 smithi110 ceph-mon[28069]: pgmap v20967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:31 smithi193 ceph-mon[32782]: pgmap v20967: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39147.645996 secs 2024-04-26T22:40:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39147.645996 secs 2024-04-26T22:40:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39147.645996 secs 2024-04-26T22:40:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:33 smithi196 ceph-mon[32572]: pgmap v20968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:33 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:40:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:33 smithi110 ceph-mon[28069]: pgmap v20968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:33 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:40:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:33 smithi193 ceph-mon[32782]: pgmap v20968: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:33 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:40:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:40:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:40:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:34 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:40:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:40:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:40:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:34 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:40:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:40:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:40:34.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:34 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:40:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:35 smithi196 ceph-mon[32572]: pgmap v20969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:40:35.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:35 smithi196 ceph-mon[32572]: pgmap v20970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:35 smithi110 ceph-mon[28069]: pgmap v20969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:40:35.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:35 smithi110 ceph-mon[28069]: pgmap v20970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:35 smithi193 ceph-mon[32782]: pgmap v20969: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:40:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:35 smithi193 ceph-mon[32782]: pgmap v20970: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:37 smithi196 ceph-mon[32572]: pgmap v20971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:37.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39152.646074 secs 2024-04-26T22:40:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:37 smithi110 ceph-mon[28069]: pgmap v20971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39152.646074 secs 2024-04-26T22:40:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:37 smithi193 ceph-mon[32782]: pgmap v20971: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:37.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39152.646074 secs 2024-04-26T22:40:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:39 smithi196 ceph-mon[32572]: pgmap v20972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:39 smithi110 ceph-mon[28069]: pgmap v20972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:39 smithi193 ceph-mon[32782]: pgmap v20972: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:41.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:41 smithi110 ceph-mon[28069]: pgmap v20973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:41 smithi193 ceph-mon[32782]: pgmap v20973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:41 smithi196 ceph-mon[32572]: pgmap v20973: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:40:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39157.646221 secs 2024-04-26T22:40:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39157.646221 secs 2024-04-26T22:40:42.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39157.646221 secs 2024-04-26T22:40:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:43 smithi110 ceph-mon[28069]: pgmap v20974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:40:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:43 smithi193 ceph-mon[32782]: pgmap v20974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:40:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:43 smithi196 ceph-mon[32572]: pgmap v20974: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:40:45.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:45 smithi110 ceph-mon[28069]: pgmap v20975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:40:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:45 smithi193 ceph-mon[32782]: pgmap v20975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:40:46.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:45 smithi196 ceph-mon[32572]: pgmap v20975: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:40:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:47 smithi110 ceph-mon[28069]: pgmap v20976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39162.646361 secs 2024-04-26T22:40:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:47 smithi193 ceph-mon[32782]: pgmap v20976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39162.646361 secs 2024-04-26T22:40:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:47 smithi196 ceph-mon[32572]: pgmap v20976: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:48.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39162.646361 secs 2024-04-26T22:40:49.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:49 smithi110 ceph-mon[28069]: pgmap v20977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:49 smithi193 ceph-mon[32782]: pgmap v20977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:49 smithi196 ceph-mon[32572]: pgmap v20977: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:51 smithi193 ceph-mon[32782]: pgmap v20978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:51 smithi196 ceph-mon[32572]: pgmap v20978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:51 smithi110 ceph-mon[28069]: pgmap v20978: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39167.646493 secs 2024-04-26T22:40:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39167.646493 secs 2024-04-26T22:40:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39167.646493 secs 2024-04-26T22:40:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:53 smithi193 ceph-mon[32782]: pgmap v20979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:53 smithi196 ceph-mon[32572]: pgmap v20979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:53 smithi110 ceph-mon[28069]: pgmap v20979: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:55 smithi193 ceph-mon[32782]: pgmap v20980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:55 smithi196 ceph-mon[32572]: pgmap v20980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:56.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:55 smithi110 ceph-mon[28069]: pgmap v20980: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:40:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:57 smithi193 ceph-mon[32782]: pgmap v20981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39172.646639 secs 2024-04-26T22:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:57 smithi196 ceph-mon[32572]: pgmap v20981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39172.646639 secs 2024-04-26T22:40:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:57 smithi110 ceph-mon[28069]: pgmap v20981: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:40:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39172.646639 secs 2024-04-26T22:40:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:40:59 smithi193 ceph-mon[32782]: pgmap v20982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:40:59 smithi196 ceph-mon[32572]: pgmap v20982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:00.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:40:59 smithi110 ceph-mon[28069]: pgmap v20982: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:01 smithi193 ceph-mon[32782]: pgmap v20983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:01 smithi196 ceph-mon[32572]: pgmap v20983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:01 smithi110 ceph-mon[28069]: pgmap v20983: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39177.646775 secs 2024-04-26T22:41:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39177.646775 secs 2024-04-26T22:41:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39177.646775 secs 2024-04-26T22:41:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:03 smithi193 ceph-mon[32782]: pgmap v20984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:03 smithi196 ceph-mon[32572]: pgmap v20984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:04.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:03 smithi110 ceph-mon[28069]: pgmap v20984: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:05 smithi193 ceph-mon[32782]: pgmap v20985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:05 smithi196 ceph-mon[32572]: pgmap v20985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:06.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:05 smithi110 ceph-mon[28069]: pgmap v20985: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:07 smithi193 ceph-mon[32782]: pgmap v20986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39182.646888 secs 2024-04-26T22:41:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:07 smithi196 ceph-mon[32572]: pgmap v20986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39182.646888 secs 2024-04-26T22:41:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:07 smithi110 ceph-mon[28069]: pgmap v20986: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39182.646888 secs 2024-04-26T22:41:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:09 smithi193 ceph-mon[32782]: pgmap v20987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:09 smithi196 ceph-mon[32572]: pgmap v20987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:09 smithi110 ceph-mon[28069]: pgmap v20987: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:11 smithi193 ceph-mon[32782]: pgmap v20988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:12.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:11 smithi196 ceph-mon[32572]: pgmap v20988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:11 smithi110 ceph-mon[28069]: pgmap v20988: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39187.646965 secs 2024-04-26T22:41:12.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39187.646965 secs 2024-04-26T22:41:12.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39187.646965 secs 2024-04-26T22:41:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:13 smithi196 ceph-mon[32572]: pgmap v20989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:13 smithi110 ceph-mon[28069]: pgmap v20989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:13 smithi193 ceph-mon[32782]: pgmap v20989: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:16.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:15 smithi196 ceph-mon[32572]: pgmap v20990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:15 smithi110 ceph-mon[28069]: pgmap v20990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:16.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:15 smithi193 ceph-mon[32782]: pgmap v20990: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:17 smithi196 ceph-mon[32572]: pgmap v20991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:18.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39192.647113 secs 2024-04-26T22:41:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:17 smithi110 ceph-mon[28069]: pgmap v20991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39192.647113 secs 2024-04-26T22:41:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:17 smithi193 ceph-mon[32782]: pgmap v20991: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39192.647113 secs 2024-04-26T22:41:20.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:19 smithi196 ceph-mon[32572]: pgmap v20992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:19 smithi110 ceph-mon[28069]: pgmap v20992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:19 smithi193 ceph-mon[32782]: pgmap v20992: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:21 smithi196 ceph-mon[32572]: pgmap v20993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:22.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:21 smithi110 ceph-mon[28069]: pgmap v20993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:21 smithi193 ceph-mon[32782]: pgmap v20993: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:23.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39197.647256 secs 2024-04-26T22:41:23.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39197.647256 secs 2024-04-26T22:41:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39197.647256 secs 2024-04-26T22:41:24.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:23 smithi196 ceph-mon[32572]: pgmap v20994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:23 smithi110 ceph-mon[28069]: pgmap v20994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:23 smithi193 ceph-mon[32782]: pgmap v20994: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:25 smithi196 ceph-mon[32572]: pgmap v20995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:25 smithi110 ceph-mon[28069]: pgmap v20995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:25 smithi193 ceph-mon[32782]: pgmap v20995: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:27 smithi196 ceph-mon[32572]: pgmap v20996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:28.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39202.647389 secs 2024-04-26T22:41:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:27 smithi110 ceph-mon[28069]: pgmap v20996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39202.647389 secs 2024-04-26T22:41:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:27 smithi193 ceph-mon[32782]: pgmap v20996: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39202.647389 secs 2024-04-26T22:41:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:29 smithi196 ceph-mon[32572]: pgmap v20997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:30.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:29 smithi110 ceph-mon[28069]: pgmap v20997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:29 smithi193 ceph-mon[32782]: pgmap v20997: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:31 smithi196 ceph-mon[32572]: pgmap v20998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:32.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:31 smithi110 ceph-mon[28069]: pgmap v20998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:31 smithi193 ceph-mon[32782]: pgmap v20998: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39207.647518 secs 2024-04-26T22:41:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39207.647518 secs 2024-04-26T22:41:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39207.647518 secs 2024-04-26T22:41:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:33 smithi196 ceph-mon[32572]: pgmap v20999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:34.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:33 smithi110 ceph-mon[28069]: pgmap v20999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:33 smithi193 ceph-mon[32782]: pgmap v20999: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:34 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:41:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:34 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:41:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:34 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:41:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:35 smithi196 ceph-mon[32572]: pgmap v21000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:41:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:35 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:41:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:35 smithi196 ceph-mon[32572]: pgmap v21001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:41:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:35 smithi196 ceph-mon[32572]: pgmap v21002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:36.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:35 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:41:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:35 smithi110 ceph-mon[28069]: pgmap v21000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:41:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:35 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:41:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:35 smithi110 ceph-mon[28069]: pgmap v21001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:41:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:35 smithi110 ceph-mon[28069]: pgmap v21002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:36.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:35 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:41:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:35 smithi193 ceph-mon[32782]: pgmap v21000: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:41:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:35 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:41:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:35 smithi193 ceph-mon[32782]: pgmap v21001: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:41:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:35 smithi193 ceph-mon[32782]: pgmap v21002: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:36.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:35 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:41:37.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39212.647657 secs 2024-04-26T22:41:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39212.647657 secs 2024-04-26T22:41:37.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39212.647657 secs 2024-04-26T22:41:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:38 smithi196 ceph-mon[32572]: pgmap v21003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:38.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:38 smithi110 ceph-mon[28069]: pgmap v21003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:38 smithi193 ceph-mon[32782]: pgmap v21003: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:40 smithi193 ceph-mon[32782]: pgmap v21004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:40 smithi196 ceph-mon[32572]: pgmap v21004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:40 smithi110 ceph-mon[28069]: pgmap v21004: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:42.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:42 smithi110 ceph-mon[28069]: pgmap v21005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:42.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39217.647791 secs 2024-04-26T22:41:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:42 smithi193 ceph-mon[32782]: pgmap v21005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:42.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39217.647791 secs 2024-04-26T22:41:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:42 smithi196 ceph-mon[32572]: pgmap v21005: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:43.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39217.647791 secs 2024-04-26T22:41:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:44 smithi193 ceph-mon[32782]: pgmap v21006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:45.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:44 smithi196 ceph-mon[32572]: pgmap v21006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:44 smithi110 ceph-mon[28069]: pgmap v21006: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:41:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:46 smithi193 ceph-mon[32782]: pgmap v21007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:41:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:46 smithi196 ceph-mon[32572]: pgmap v21007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:41:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:46 smithi110 ceph-mon[28069]: pgmap v21007: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:41:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39222.647921 secs 2024-04-26T22:41:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39222.647921 secs 2024-04-26T22:41:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39222.647921 secs 2024-04-26T22:41:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:48 smithi193 ceph-mon[32782]: pgmap v21008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:48 smithi196 ceph-mon[32572]: pgmap v21008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:48 smithi110 ceph-mon[28069]: pgmap v21008: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:50 smithi193 ceph-mon[32782]: pgmap v21009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:50 smithi196 ceph-mon[32572]: pgmap v21009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:50 smithi110 ceph-mon[28069]: pgmap v21009: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:52 smithi193 ceph-mon[32782]: pgmap v21010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:52.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39227.648049 secs 2024-04-26T22:41:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:52 smithi196 ceph-mon[32572]: pgmap v21010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:53.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39227.648049 secs 2024-04-26T22:41:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:52 smithi110 ceph-mon[28069]: pgmap v21010: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39227.648049 secs 2024-04-26T22:41:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:54 smithi193 ceph-mon[32782]: pgmap v21011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:54 smithi196 ceph-mon[32572]: pgmap v21011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:55.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:54 smithi110 ceph-mon[28069]: pgmap v21011: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:56 smithi196 ceph-mon[32572]: pgmap v21012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:57.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:56 smithi110 ceph-mon[28069]: pgmap v21012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:56 smithi193 ceph-mon[32782]: pgmap v21012: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:41:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39232.648171 secs 2024-04-26T22:41:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39232.648171 secs 2024-04-26T22:41:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39232.648171 secs 2024-04-26T22:41:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:41:58 smithi196 ceph-mon[32572]: pgmap v21013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:41:58 smithi110 ceph-mon[28069]: pgmap v21013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:41:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:41:58 smithi193 ceph-mon[32782]: pgmap v21013: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:00 smithi196 ceph-mon[32572]: pgmap v21014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:01.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:00 smithi110 ceph-mon[28069]: pgmap v21014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:01.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:00 smithi193 ceph-mon[32782]: pgmap v21014: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:02 smithi196 ceph-mon[32572]: pgmap v21015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39237.648315 secs 2024-04-26T22:42:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:02 smithi110 ceph-mon[28069]: pgmap v21015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39237.648315 secs 2024-04-26T22:42:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:02 smithi193 ceph-mon[32782]: pgmap v21015: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:03.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39237.648315 secs 2024-04-26T22:42:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:04 smithi196 ceph-mon[32572]: pgmap v21016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:05.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:04 smithi110 ceph-mon[28069]: pgmap v21016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:04 smithi193 ceph-mon[32782]: pgmap v21016: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:06 smithi196 ceph-mon[32572]: pgmap v21017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:07.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:06 smithi110 ceph-mon[28069]: pgmap v21017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:06 smithi193 ceph-mon[32782]: pgmap v21017: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39242.648453 secs 2024-04-26T22:42:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39242.648453 secs 2024-04-26T22:42:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39242.648453 secs 2024-04-26T22:42:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:08 smithi196 ceph-mon[32572]: pgmap v21018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:08 smithi110 ceph-mon[28069]: pgmap v21018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:08 smithi193 ceph-mon[32782]: pgmap v21018: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:11.007 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:10 smithi196 ceph-mon[32572]: pgmap v21019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:10 smithi110 ceph-mon[28069]: pgmap v21019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:10 smithi193 ceph-mon[32782]: pgmap v21019: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:12 smithi196 ceph-mon[32572]: pgmap v21020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:13.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39247.648592 secs 2024-04-26T22:42:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:12 smithi110 ceph-mon[28069]: pgmap v21020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39247.648592 secs 2024-04-26T22:42:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:12 smithi193 ceph-mon[32782]: pgmap v21020: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:13.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39247.648592 secs 2024-04-26T22:42:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:14 smithi196 ceph-mon[32572]: pgmap v21021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:15.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:14 smithi110 ceph-mon[28069]: pgmap v21021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:14 smithi193 ceph-mon[32782]: pgmap v21021: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:16 smithi196 ceph-mon[32572]: pgmap v21022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:16 smithi110 ceph-mon[28069]: pgmap v21022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:16 smithi193 ceph-mon[32782]: pgmap v21022: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39252.648714 secs 2024-04-26T22:42:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39252.648714 secs 2024-04-26T22:42:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39252.648714 secs 2024-04-26T22:42:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:18 smithi196 ceph-mon[32572]: pgmap v21023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:18 smithi110 ceph-mon[28069]: pgmap v21023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:18 smithi193 ceph-mon[32782]: pgmap v21023: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:19 smithi196 ceph-mon[32572]: pgmap v21024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:20.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:19 smithi110 ceph-mon[28069]: pgmap v21024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:19 smithi193 ceph-mon[32782]: pgmap v21024: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:22 smithi193 ceph-mon[32782]: pgmap v21025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39257.648828 secs 2024-04-26T22:42:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:42:22.903+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:42:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:42:22.903+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:42:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:42:22.904+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 302 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:42:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:42:22.904+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 302 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:42:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:22 smithi196 ceph-mon[32572]: pgmap v21025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39257.648828 secs 2024-04-26T22:42:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:22 smithi110 ceph-mon[28069]: pgmap v21025: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39257.648828 secs 2024-04-26T22:42:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:24 smithi193 ceph-mon[32782]: pgmap v21026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:24 smithi196 ceph-mon[32572]: pgmap v21026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:24 smithi110 ceph-mon[28069]: pgmap v21026: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:26 smithi193 ceph-mon[32782]: pgmap v21027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:26 smithi196 ceph-mon[32572]: pgmap v21027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:26 smithi110 ceph-mon[28069]: pgmap v21027: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39262.648926 secs 2024-04-26T22:42:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39262.648926 secs 2024-04-26T22:42:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39262.648926 secs 2024-04-26T22:42:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:28 smithi193 ceph-mon[32782]: pgmap v21028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:28 smithi196 ceph-mon[32572]: pgmap v21028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:29.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:28 smithi110 ceph-mon[28069]: pgmap v21028: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:30 smithi196 ceph-mon[32572]: pgmap v21029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:31.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:30 smithi110 ceph-mon[28069]: pgmap v21029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:30 smithi193 ceph-mon[32782]: pgmap v21029: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:32 smithi196 ceph-mon[32572]: pgmap v21030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:33.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39267.649056 secs 2024-04-26T22:42:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:32 smithi110 ceph-mon[28069]: pgmap v21030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39267.649056 secs 2024-04-26T22:42:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:32 smithi193 ceph-mon[32782]: pgmap v21030: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39267.649056 secs 2024-04-26T22:42:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:34 smithi196 ceph-mon[32572]: pgmap v21031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:34 smithi110 ceph-mon[28069]: pgmap v21031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:34 smithi193 ceph-mon[32782]: pgmap v21031: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:36 smithi196 ceph-mon[32572]: pgmap v21032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:37.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:36 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:42:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:36 smithi110 ceph-mon[28069]: pgmap v21032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:36 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:42:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:36 smithi193 ceph-mon[32782]: pgmap v21032: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:36 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:42:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39272.649191 secs 2024-04-26T22:42:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:42:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:37 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:42:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:37 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:42:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39272.649191 secs 2024-04-26T22:42:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:42:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:37 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:42:38.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:37 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:42:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39272.649191 secs 2024-04-26T22:42:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:42:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:37 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:42:38.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:37 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:42:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:38 smithi196 ceph-mon[32572]: pgmap v21033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:42:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:38 smithi196 ceph-mon[32572]: pgmap v21034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T22:42:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:38 smithi110 ceph-mon[28069]: pgmap v21033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:42:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:38 smithi110 ceph-mon[28069]: pgmap v21034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T22:42:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:38 smithi193 ceph-mon[32782]: pgmap v21033: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:42:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:38 smithi193 ceph-mon[32782]: pgmap v21034: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T22:42:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:40 smithi196 ceph-mon[32572]: pgmap v21035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:40 smithi110 ceph-mon[28069]: pgmap v21035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:40 smithi193 ceph-mon[32782]: pgmap v21035: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:42 smithi196 ceph-mon[32572]: pgmap v21036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39277.649325 secs 2024-04-26T22:42:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:42 smithi110 ceph-mon[28069]: pgmap v21036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39277.649325 secs 2024-04-26T22:42:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:42 smithi193 ceph-mon[32782]: pgmap v21036: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39277.649325 secs 2024-04-26T22:42:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:44 smithi196 ceph-mon[32572]: pgmap v21037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:44 smithi110 ceph-mon[28069]: pgmap v21037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:44 smithi193 ceph-mon[32782]: pgmap v21037: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:46 smithi196 ceph-mon[32572]: pgmap v21038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:46 smithi110 ceph-mon[28069]: pgmap v21038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:46 smithi193 ceph-mon[32782]: pgmap v21038: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:42:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39282.649462 secs 2024-04-26T22:42:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39282.649462 secs 2024-04-26T22:42:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39282.649462 secs 2024-04-26T22:42:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:48 smithi196 ceph-mon[32572]: pgmap v21039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:42:49.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:48 smithi110 ceph-mon[28069]: pgmap v21039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:42:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:48 smithi193 ceph-mon[32782]: pgmap v21039: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:42:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:50 smithi196 ceph-mon[32572]: pgmap v21040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:50 smithi110 ceph-mon[28069]: pgmap v21040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:50 smithi193 ceph-mon[32782]: pgmap v21040: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:52 smithi196 ceph-mon[32572]: pgmap v21041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39287.649542 secs 2024-04-26T22:42:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:52 smithi110 ceph-mon[28069]: pgmap v21041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39287.649542 secs 2024-04-26T22:42:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:52 smithi193 ceph-mon[32782]: pgmap v21041: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39287.649542 secs 2024-04-26T22:42:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:53 smithi196 ceph-mon[32572]: pgmap v21042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:54.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:53 smithi193 ceph-mon[32782]: pgmap v21042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:53 smithi110 ceph-mon[28069]: pgmap v21042: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:42:56.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:56 smithi196 ceph-mon[32572]: pgmap v21043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:56.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:56 smithi110 ceph-mon[28069]: pgmap v21043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:56.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:56 smithi193 ceph-mon[32782]: pgmap v21043: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39292.649661 secs 2024-04-26T22:42:57.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39292.649661 secs 2024-04-26T22:42:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39292.649661 secs 2024-04-26T22:42:58.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:42:58 smithi110 ceph-mon[28069]: pgmap v21044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:58.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:42:58 smithi193 ceph-mon[32782]: pgmap v21044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:42:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:42:58 smithi196 ceph-mon[32572]: pgmap v21044: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:00.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:00 smithi110 ceph-mon[28069]: pgmap v21045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:00 smithi193 ceph-mon[32782]: pgmap v21045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:00 smithi196 ceph-mon[32572]: pgmap v21045: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:02 smithi110 ceph-mon[28069]: pgmap v21046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:02.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39297.649750 secs 2024-04-26T22:43:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:02 smithi193 ceph-mon[32782]: pgmap v21046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39297.649750 secs 2024-04-26T22:43:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:02 smithi196 ceph-mon[32572]: pgmap v21046: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39297.649750 secs 2024-04-26T22:43:04.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:04 smithi110 ceph-mon[28069]: pgmap v21047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:04 smithi193 ceph-mon[32782]: pgmap v21047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:04 smithi196 ceph-mon[32572]: pgmap v21047: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:06.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:06 smithi110 ceph-mon[28069]: pgmap v21048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:06.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:06 smithi193 ceph-mon[32782]: pgmap v21048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:06 smithi196 ceph-mon[32572]: pgmap v21048: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39302.649868 secs 2024-04-26T22:43:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39302.649868 secs 2024-04-26T22:43:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39302.649868 secs 2024-04-26T22:43:08.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:08 smithi110 ceph-mon[28069]: pgmap v21049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:08.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:08 smithi193 ceph-mon[32782]: pgmap v21049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:08 smithi196 ceph-mon[32572]: pgmap v21049: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:10.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:10 smithi193 ceph-mon[32782]: pgmap v21050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:10 smithi196 ceph-mon[32572]: pgmap v21050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:10 smithi110 ceph-mon[28069]: pgmap v21050: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:12.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:12 smithi196 ceph-mon[32572]: pgmap v21051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:12.557 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39307.649931 secs 2024-04-26T22:43:12.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:12 smithi110 ceph-mon[28069]: pgmap v21051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:12.594 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39307.649931 secs 2024-04-26T22:43:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:12 smithi193 ceph-mon[32782]: pgmap v21051: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39307.649931 secs 2024-04-26T22:43:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:14 smithi193 ceph-mon[32782]: pgmap v21052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:14 smithi196 ceph-mon[32572]: pgmap v21052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:14 smithi110 ceph-mon[28069]: pgmap v21052: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:16 smithi193 ceph-mon[32782]: pgmap v21053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:16 smithi196 ceph-mon[32572]: pgmap v21053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:16.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:16 smithi110 ceph-mon[28069]: pgmap v21053: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39312.650051 secs 2024-04-26T22:43:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39312.650051 secs 2024-04-26T22:43:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39312.650051 secs 2024-04-26T22:43:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:18 smithi193 ceph-mon[32782]: pgmap v21054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:18 smithi196 ceph-mon[32572]: pgmap v21054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:18 smithi110 ceph-mon[28069]: pgmap v21054: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:20 smithi193 ceph-mon[32782]: pgmap v21055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:20 smithi196 ceph-mon[32572]: pgmap v21055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:20.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:20 smithi110 ceph-mon[28069]: pgmap v21055: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:22 smithi193 ceph-mon[32782]: pgmap v21056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39317.650167 secs 2024-04-26T22:43:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:22 smithi196 ceph-mon[32572]: pgmap v21056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39317.650167 secs 2024-04-26T22:43:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:22 smithi110 ceph-mon[28069]: pgmap v21056: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:22.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39317.650167 secs 2024-04-26T22:43:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:24 smithi193 ceph-mon[32782]: pgmap v21057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:24 smithi196 ceph-mon[32572]: pgmap v21057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:24 smithi110 ceph-mon[28069]: pgmap v21057: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:26 smithi193 ceph-mon[32782]: pgmap v21058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:26 smithi196 ceph-mon[32572]: pgmap v21058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:26.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:26 smithi110 ceph-mon[28069]: pgmap v21058: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39322.650304 secs 2024-04-26T22:43:27.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39322.650304 secs 2024-04-26T22:43:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39322.650304 secs 2024-04-26T22:43:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:28 smithi193 ceph-mon[32782]: pgmap v21059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:28 smithi196 ceph-mon[32572]: pgmap v21059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:28 smithi110 ceph-mon[28069]: pgmap v21059: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:30 smithi193 ceph-mon[32782]: pgmap v21060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:30 smithi196 ceph-mon[32572]: pgmap v21060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:30.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:30 smithi110 ceph-mon[28069]: pgmap v21060: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:32 smithi193 ceph-mon[32782]: pgmap v21061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:32.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39327.650431 secs 2024-04-26T22:43:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:32 smithi196 ceph-mon[32572]: pgmap v21061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39327.650431 secs 2024-04-26T22:43:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:32 smithi110 ceph-mon[28069]: pgmap v21061: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39327.650431 secs 2024-04-26T22:43:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:34 smithi196 ceph-mon[32572]: pgmap v21062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:34.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:34 smithi110 ceph-mon[28069]: pgmap v21062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:34 smithi193 ceph-mon[32782]: pgmap v21062: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:36 smithi196 ceph-mon[32572]: pgmap v21063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:36 smithi110 ceph-mon[28069]: pgmap v21063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:36 smithi193 ceph-mon[32782]: pgmap v21063: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39332.650550 secs 2024-04-26T22:43:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39332.650550 secs 2024-04-26T22:43:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39332.650550 secs 2024-04-26T22:43:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:38 smithi196 ceph-mon[32572]: pgmap v21064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:38.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:38 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:43:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:38 smithi110 ceph-mon[28069]: pgmap v21064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:38.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:38 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:43:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:38 smithi193 ceph-mon[32782]: pgmap v21064: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:38 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:43:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:43:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:43:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:39 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:43:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:43:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:43:39.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:39 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:43:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:43:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:43:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:39 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:43:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:40 smithi196 ceph-mon[32572]: pgmap v21065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:43:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:40 smithi196 ceph-mon[32572]: pgmap v21066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:40 smithi110 ceph-mon[28069]: pgmap v21065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:43:40.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:40 smithi110 ceph-mon[28069]: pgmap v21066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:40 smithi193 ceph-mon[32782]: pgmap v21065: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:43:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:40 smithi193 ceph-mon[32782]: pgmap v21066: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:42 smithi196 ceph-mon[32572]: pgmap v21067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39337.650664 secs 2024-04-26T22:43:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:42 smithi110 ceph-mon[28069]: pgmap v21067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:42.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39337.650664 secs 2024-04-26T22:43:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:42 smithi193 ceph-mon[32782]: pgmap v21067: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39337.650664 secs 2024-04-26T22:43:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:44 smithi196 ceph-mon[32572]: pgmap v21068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:44 smithi110 ceph-mon[28069]: pgmap v21068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:44 smithi193 ceph-mon[32782]: pgmap v21068: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:46 smithi196 ceph-mon[32572]: pgmap v21069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:46 smithi110 ceph-mon[28069]: pgmap v21069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:46 smithi193 ceph-mon[32782]: pgmap v21069: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39342.650764 secs 2024-04-26T22:43:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39342.650764 secs 2024-04-26T22:43:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39342.650764 secs 2024-04-26T22:43:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:48 smithi196 ceph-mon[32572]: pgmap v21070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:48 smithi110 ceph-mon[28069]: pgmap v21070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:48 smithi193 ceph-mon[32782]: pgmap v21070: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:43:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:50 smithi196 ceph-mon[32572]: pgmap v21071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:43:50.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:50 smithi110 ceph-mon[28069]: pgmap v21071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:43:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:50 smithi193 ceph-mon[32782]: pgmap v21071: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:43:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:52 smithi196 ceph-mon[32572]: pgmap v21072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39347.650881 secs 2024-04-26T22:43:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:52 smithi110 ceph-mon[28069]: pgmap v21072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:52.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39347.650881 secs 2024-04-26T22:43:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:52 smithi193 ceph-mon[32782]: pgmap v21072: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39347.650881 secs 2024-04-26T22:43:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:54 smithi196 ceph-mon[32572]: pgmap v21073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:54 smithi110 ceph-mon[28069]: pgmap v21073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:54 smithi193 ceph-mon[32782]: pgmap v21073: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:43:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:56 smithi196 ceph-mon[32572]: pgmap v21074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:56 smithi110 ceph-mon[28069]: pgmap v21074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:56 smithi193 ceph-mon[32782]: pgmap v21074: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39352.650994 secs 2024-04-26T22:43:57.793 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39352.650994 secs 2024-04-26T22:43:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39352.650994 secs 2024-04-26T22:43:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:43:58 smithi196 ceph-mon[32572]: pgmap v21075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:43:58 smithi110 ceph-mon[28069]: pgmap v21075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:43:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:43:58 smithi193 ceph-mon[32782]: pgmap v21075: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:00 smithi196 ceph-mon[32572]: pgmap v21076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:00.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:00 smithi110 ceph-mon[28069]: pgmap v21076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:00 smithi193 ceph-mon[32782]: pgmap v21076: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:02 smithi196 ceph-mon[32572]: pgmap v21077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39357.651114 secs 2024-04-26T22:44:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:02 smithi110 ceph-mon[28069]: pgmap v21077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39357.651114 secs 2024-04-26T22:44:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:02 smithi193 ceph-mon[32782]: pgmap v21077: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39357.651114 secs 2024-04-26T22:44:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:04 smithi196 ceph-mon[32572]: pgmap v21078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:04.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:04 smithi110 ceph-mon[28069]: pgmap v21078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:04.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:04 smithi193 ceph-mon[32782]: pgmap v21078: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:06 smithi196 ceph-mon[32572]: pgmap v21079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:06.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:06 smithi110 ceph-mon[28069]: pgmap v21079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:06 smithi193 ceph-mon[32782]: pgmap v21079: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39362.651260 secs 2024-04-26T22:44:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39362.651260 secs 2024-04-26T22:44:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39362.651260 secs 2024-04-26T22:44:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:08 smithi196 ceph-mon[32572]: pgmap v21080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:08 smithi110 ceph-mon[28069]: pgmap v21080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:08 smithi193 ceph-mon[32782]: pgmap v21080: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:10 smithi110 ceph-mon[28069]: pgmap v21081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:10.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:10 smithi193 ceph-mon[32782]: pgmap v21081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:10 smithi196 ceph-mon[32572]: pgmap v21081: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:12 smithi110 ceph-mon[28069]: pgmap v21082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39367.651378 secs 2024-04-26T22:44:12.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:12 smithi196 ceph-mon[32572]: pgmap v21082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:12.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39367.651378 secs 2024-04-26T22:44:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:12 smithi193 ceph-mon[32782]: pgmap v21082: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:12.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39367.651378 secs 2024-04-26T22:44:14.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:14 smithi110 ceph-mon[28069]: pgmap v21083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:14 smithi193 ceph-mon[32782]: pgmap v21083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:14 smithi196 ceph-mon[32572]: pgmap v21083: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:16 smithi110 ceph-mon[28069]: pgmap v21084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:16 smithi193 ceph-mon[32782]: pgmap v21084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:16 smithi196 ceph-mon[32572]: pgmap v21084: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:17.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39372.651513 secs 2024-04-26T22:44:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39372.651513 secs 2024-04-26T22:44:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39372.651513 secs 2024-04-26T22:44:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:18 smithi110 ceph-mon[28069]: pgmap v21085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:18 smithi193 ceph-mon[32782]: pgmap v21085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:18 smithi196 ceph-mon[32572]: pgmap v21085: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:19.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:44:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:44:19.437+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:44:19.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:44:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:44:19.437+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:44:19.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:44:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:44:19.437+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:44:19.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:44:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:44:19.437+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:44:19.791 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:44:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:44:19.437+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:44:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:20 smithi110 ceph-mon[28069]: pgmap v21086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:20 smithi193 ceph-mon[32782]: pgmap v21086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:20 smithi196 ceph-mon[32572]: pgmap v21086: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:22 smithi193 ceph-mon[32782]: pgmap v21087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39377.651614 secs 2024-04-26T22:44:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:22 smithi196 ceph-mon[32572]: pgmap v21087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39377.651614 secs 2024-04-26T22:44:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:22 smithi110 ceph-mon[28069]: pgmap v21087: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39377.651614 secs 2024-04-26T22:44:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:24 smithi193 ceph-mon[32782]: pgmap v21088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:44:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:24 smithi196 ceph-mon[32572]: pgmap v21088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:44:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:24 smithi110 ceph-mon[28069]: pgmap v21088: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:44:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:26 smithi193 ceph-mon[32782]: pgmap v21089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:44:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:26 smithi196 ceph-mon[32572]: pgmap v21089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:44:27.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:26 smithi110 ceph-mon[28069]: pgmap v21089: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:44:27.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39382.651696 secs 2024-04-26T22:44:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39382.651696 secs 2024-04-26T22:44:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39382.651696 secs 2024-04-26T22:44:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:28 smithi193 ceph-mon[32782]: pgmap v21090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:44:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:28 smithi196 ceph-mon[32572]: pgmap v21090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:44:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:28 smithi110 ceph-mon[28069]: pgmap v21090: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:44:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:30 smithi193 ceph-mon[32782]: pgmap v21091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:44:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:30 smithi196 ceph-mon[32572]: pgmap v21091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:44:31.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:30 smithi110 ceph-mon[28069]: pgmap v21091: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:44:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:32 smithi193 ceph-mon[32782]: pgmap v21092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:44:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39387.651819 secs 2024-04-26T22:44:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:32 smithi196 ceph-mon[32572]: pgmap v21092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:44:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39387.651819 secs 2024-04-26T22:44:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:32 smithi110 ceph-mon[28069]: pgmap v21092: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-26T22:44:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39387.651819 secs 2024-04-26T22:44:34.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:34 smithi193 ceph-mon[32782]: pgmap v21093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:44:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:34 smithi196 ceph-mon[32572]: pgmap v21093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:44:35.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:34 smithi110 ceph-mon[28069]: pgmap v21093: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T22:44:36.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:36 smithi193 ceph-mon[32782]: pgmap v21094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:36 smithi196 ceph-mon[32572]: pgmap v21094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:37.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:36 smithi110 ceph-mon[28069]: pgmap v21094: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39392.651890 secs 2024-04-26T22:44:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39392.651890 secs 2024-04-26T22:44:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39392.651890 secs 2024-04-26T22:44:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:38 smithi193 ceph-mon[32782]: pgmap v21095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:38 smithi196 ceph-mon[32572]: pgmap v21095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:39.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:38 smithi110 ceph-mon[28069]: pgmap v21095: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:39 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:44:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:39 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:44:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:39 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:44:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:40 smithi193 ceph-mon[32782]: pgmap v21096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:44:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:40 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:44:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:40 smithi196 ceph-mon[32572]: pgmap v21096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:44:41.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:40 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:44:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:40 smithi110 ceph-mon[28069]: pgmap v21096: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:44:41.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:40 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:44:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:44:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:41 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:44:42.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:41 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:44:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:44:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:41 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:44:42.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:41 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:44:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:44:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:41 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:44:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:41 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:44:42.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:42 smithi196 ceph-mon[32572]: pgmap v21097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:42.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:42 smithi196 ceph-mon[32572]: pgmap v21098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s rd, 1 op/s 2024-04-26T22:44:42.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:42 smithi196 ceph-mon[32572]: pgmap v21099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T22:44:42.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39397.652046 secs 2024-04-26T22:44:42.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:42 smithi110 ceph-mon[28069]: pgmap v21097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:42.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:42 smithi110 ceph-mon[28069]: pgmap v21098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s rd, 1 op/s 2024-04-26T22:44:42.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:42 smithi110 ceph-mon[28069]: pgmap v21099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T22:44:42.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39397.652046 secs 2024-04-26T22:44:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:42 smithi193 ceph-mon[32782]: pgmap v21097: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:42 smithi193 ceph-mon[32782]: pgmap v21098: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s rd, 1 op/s 2024-04-26T22:44:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:42 smithi193 ceph-mon[32782]: pgmap v21099: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T22:44:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39397.652046 secs 2024-04-26T22:44:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:44 smithi196 ceph-mon[32572]: pgmap v21100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:45.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:44 smithi110 ceph-mon[28069]: pgmap v21100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:44 smithi193 ceph-mon[32782]: pgmap v21100: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:47.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:46 smithi196 ceph-mon[32572]: pgmap v21101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:47.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:46 smithi110 ceph-mon[28069]: pgmap v21101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:46 smithi193 ceph-mon[32782]: pgmap v21101: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39402.652165 secs 2024-04-26T22:44:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39402.652165 secs 2024-04-26T22:44:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39402.652165 secs 2024-04-26T22:44:49.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:48 smithi196 ceph-mon[32572]: pgmap v21102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T22:44:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:48 smithi110 ceph-mon[28069]: pgmap v21102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T22:44:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:48 smithi193 ceph-mon[32782]: pgmap v21102: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 613 B/s rd, 1 op/s 2024-04-26T22:44:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:50 smithi196 ceph-mon[32572]: pgmap v21103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:50 smithi110 ceph-mon[28069]: pgmap v21103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:50 smithi193 ceph-mon[32782]: pgmap v21103: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:52 smithi196 ceph-mon[32572]: pgmap v21104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:44:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39407.652286 secs 2024-04-26T22:44:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:52 smithi110 ceph-mon[28069]: pgmap v21104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:44:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39407.652286 secs 2024-04-26T22:44:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:52 smithi193 ceph-mon[32782]: pgmap v21104: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:44:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39407.652286 secs 2024-04-26T22:44:54.923 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:54 smithi193 ceph-mon[32782]: pgmap v21105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:54 smithi196 ceph-mon[32572]: pgmap v21105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:54 smithi110 ceph-mon[28069]: pgmap v21105: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:44:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:56 smithi196 ceph-mon[32572]: pgmap v21106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:56 smithi110 ceph-mon[28069]: pgmap v21106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:56 smithi193 ceph-mon[32782]: pgmap v21106: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39412.652425 secs 2024-04-26T22:44:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39412.652425 secs 2024-04-26T22:44:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39412.652425 secs 2024-04-26T22:44:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:44:58 smithi196 ceph-mon[32572]: pgmap v21107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:44:58 smithi110 ceph-mon[28069]: pgmap v21107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:44:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:44:58 smithi193 ceph-mon[32782]: pgmap v21107: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:00 smithi196 ceph-mon[32572]: pgmap v21108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:00 smithi110 ceph-mon[28069]: pgmap v21108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:00 smithi193 ceph-mon[32782]: pgmap v21108: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:02 smithi196 ceph-mon[32572]: pgmap v21109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39417.652539 secs 2024-04-26T22:45:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:02 smithi110 ceph-mon[28069]: pgmap v21109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39417.652539 secs 2024-04-26T22:45:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:02 smithi193 ceph-mon[32782]: pgmap v21109: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39417.652539 secs 2024-04-26T22:45:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:04 smithi196 ceph-mon[32572]: pgmap v21110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:45:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:04 smithi110 ceph-mon[28069]: pgmap v21110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:45:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:04 smithi193 ceph-mon[32782]: pgmap v21110: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:45:07.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:06 smithi196 ceph-mon[32572]: pgmap v21111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:45:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:06 smithi110 ceph-mon[28069]: pgmap v21111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:45:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:06 smithi193 ceph-mon[32782]: pgmap v21111: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:45:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39422.652676 secs 2024-04-26T22:45:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39422.652676 secs 2024-04-26T22:45:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39422.652676 secs 2024-04-26T22:45:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:08 smithi196 ceph-mon[32572]: pgmap v21112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:45:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:08 smithi110 ceph-mon[28069]: pgmap v21112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:45:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:08 smithi193 ceph-mon[32782]: pgmap v21112: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:45:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:10 smithi196 ceph-mon[32572]: pgmap v21113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:45:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:10 smithi110 ceph-mon[28069]: pgmap v21113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:45:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:10 smithi193 ceph-mon[32782]: pgmap v21113: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:45:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:12 smithi196 ceph-mon[32572]: pgmap v21114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:45:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39427.652789 secs 2024-04-26T22:45:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:12 smithi110 ceph-mon[28069]: pgmap v21114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:45:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39427.652789 secs 2024-04-26T22:45:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:12 smithi193 ceph-mon[32782]: pgmap v21114: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:45:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39427.652789 secs 2024-04-26T22:45:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:13 smithi196 ceph-mon[32572]: pgmap v21115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:45:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:13 smithi110 ceph-mon[28069]: pgmap v21115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:45:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:13 smithi193 ceph-mon[32782]: pgmap v21115: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:45:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:16 smithi196 ceph-mon[32572]: pgmap v21116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:16 smithi110 ceph-mon[28069]: pgmap v21116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:16 smithi193 ceph-mon[32782]: pgmap v21116: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39432.652909 secs 2024-04-26T22:45:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39432.652909 secs 2024-04-26T22:45:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39432.652909 secs 2024-04-26T22:45:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:18 smithi110 ceph-mon[28069]: pgmap v21117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:18 smithi193 ceph-mon[32782]: pgmap v21117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:18 smithi196 ceph-mon[32572]: pgmap v21117: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:20 smithi110 ceph-mon[28069]: pgmap v21118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:20 smithi193 ceph-mon[32782]: pgmap v21118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:20.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:20 smithi196 ceph-mon[32572]: pgmap v21118: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:22 smithi110 ceph-mon[28069]: pgmap v21119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:22.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39437.653020 secs 2024-04-26T22:45:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:22 smithi193 ceph-mon[32782]: pgmap v21119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:22.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39437.653020 secs 2024-04-26T22:45:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:22 smithi196 ceph-mon[32572]: pgmap v21119: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:22.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39437.653020 secs 2024-04-26T22:45:22.933 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:45:22.933+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:45:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:45:22.933+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:45:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:45:22.934+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 303 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:45:22.934 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:45:22.934+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 303 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:45:24.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:24 smithi110 ceph-mon[28069]: pgmap v21120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:24 smithi193 ceph-mon[32782]: pgmap v21120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:24 smithi196 ceph-mon[32572]: pgmap v21120: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:26.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:26 smithi110 ceph-mon[28069]: pgmap v21121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:45:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:26 smithi193 ceph-mon[32782]: pgmap v21121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:45:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:26 smithi196 ceph-mon[32572]: pgmap v21121: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:45:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39442.653137 secs 2024-04-26T22:45:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39442.653137 secs 2024-04-26T22:45:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39442.653137 secs 2024-04-26T22:45:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:28 smithi193 ceph-mon[32782]: pgmap v21122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:45:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:28 smithi196 ceph-mon[32572]: pgmap v21122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:45:28.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:28 smithi110 ceph-mon[28069]: pgmap v21122: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:45:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:30 smithi193 ceph-mon[32782]: pgmap v21123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:30 smithi196 ceph-mon[32572]: pgmap v21123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:30 smithi110 ceph-mon[28069]: pgmap v21123: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:32 smithi193 ceph-mon[32782]: pgmap v21124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:45:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39447.653251 secs 2024-04-26T22:45:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:32 smithi196 ceph-mon[32572]: pgmap v21124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:45:32.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39447.653251 secs 2024-04-26T22:45:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:32 smithi110 ceph-mon[28069]: pgmap v21124: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:45:32.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39447.653251 secs 2024-04-26T22:45:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:34 smithi193 ceph-mon[32782]: pgmap v21125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:34.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:34 smithi196 ceph-mon[32572]: pgmap v21125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:34 smithi110 ceph-mon[28069]: pgmap v21125: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:36 smithi193 ceph-mon[32782]: pgmap v21126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:36.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:36 smithi196 ceph-mon[32572]: pgmap v21126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:36.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:36 smithi110 ceph-mon[28069]: pgmap v21126: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39452.653391 secs 2024-04-26T22:45:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39452.653391 secs 2024-04-26T22:45:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39452.653391 secs 2024-04-26T22:45:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:38 smithi193 ceph-mon[32782]: pgmap v21127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:38 smithi196 ceph-mon[32572]: pgmap v21127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:38 smithi110 ceph-mon[28069]: pgmap v21127: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:40 smithi193 ceph-mon[32782]: pgmap v21128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:40.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:40 smithi196 ceph-mon[32572]: pgmap v21128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:40.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:40 smithi110 ceph-mon[28069]: pgmap v21128: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:45:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:42 smithi110 ceph-mon[28069]: pgmap v21129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:42 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:45:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39457.653489 secs 2024-04-26T22:45:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:42 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:42 smithi193 ceph-mon[32782]: pgmap v21129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:42 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:45:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39457.653489 secs 2024-04-26T22:45:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:42 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:42 smithi196 ceph-mon[32572]: pgmap v21129: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:42 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:45:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39457.653489 secs 2024-04-26T22:45:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:42.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:42 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:45:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:45:43.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:43 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:45:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:45:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:43 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:45:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:45:43.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:43 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:45:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:44 smithi193 ceph-mon[32782]: pgmap v21130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:45:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:44 smithi193 ceph-mon[32782]: pgmap v21131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:44 smithi196 ceph-mon[32572]: pgmap v21130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:45:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:44 smithi196 ceph-mon[32572]: pgmap v21131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:44 smithi110 ceph-mon[28069]: pgmap v21130: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:45:44.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:44 smithi110 ceph-mon[28069]: pgmap v21131: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:46 smithi193 ceph-mon[32782]: pgmap v21132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:46 smithi196 ceph-mon[32572]: pgmap v21132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:46 smithi110 ceph-mon[28069]: pgmap v21132: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39462.653611 secs 2024-04-26T22:45:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39462.653611 secs 2024-04-26T22:45:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39462.653611 secs 2024-04-26T22:45:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:48 smithi193 ceph-mon[32782]: pgmap v21133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:48 smithi196 ceph-mon[32572]: pgmap v21133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:48.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:48 smithi110 ceph-mon[28069]: pgmap v21133: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:50 smithi196 ceph-mon[32572]: pgmap v21134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:50 smithi110 ceph-mon[28069]: pgmap v21134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:50 smithi193 ceph-mon[32782]: pgmap v21134: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:52 smithi196 ceph-mon[32572]: pgmap v21135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:52.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39467.653682 secs 2024-04-26T22:45:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:52 smithi110 ceph-mon[28069]: pgmap v21135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39467.653682 secs 2024-04-26T22:45:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:52 smithi193 ceph-mon[32782]: pgmap v21135: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39467.653682 secs 2024-04-26T22:45:54.674 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:54 smithi193 ceph-mon[32782]: pgmap v21136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:45:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:54 smithi196 ceph-mon[32572]: pgmap v21136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:45:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:54 smithi110 ceph-mon[28069]: pgmap v21136: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:45:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:56 smithi196 ceph-mon[32572]: pgmap v21137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:56 smithi110 ceph-mon[28069]: pgmap v21137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:56 smithi193 ceph-mon[32782]: pgmap v21137: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39472.653803 secs 2024-04-26T22:45:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39472.653803 secs 2024-04-26T22:45:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39472.653803 secs 2024-04-26T22:45:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:45:58 smithi196 ceph-mon[32572]: pgmap v21138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:45:58 smithi110 ceph-mon[28069]: pgmap v21138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:45:58.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:45:58 smithi193 ceph-mon[32782]: pgmap v21138: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:00 smithi196 ceph-mon[32572]: pgmap v21139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:00 smithi110 ceph-mon[28069]: pgmap v21139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:00 smithi193 ceph-mon[32782]: pgmap v21139: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:02 smithi196 ceph-mon[32572]: pgmap v21140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39477.653917 secs 2024-04-26T22:46:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:02 smithi110 ceph-mon[28069]: pgmap v21140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39477.653917 secs 2024-04-26T22:46:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:02 smithi193 ceph-mon[32782]: pgmap v21140: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39477.653917 secs 2024-04-26T22:46:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:04 smithi196 ceph-mon[32572]: pgmap v21141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:04 smithi110 ceph-mon[28069]: pgmap v21141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:04 smithi193 ceph-mon[32782]: pgmap v21141: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:06 smithi196 ceph-mon[32572]: pgmap v21142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:06 smithi110 ceph-mon[28069]: pgmap v21142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:06 smithi193 ceph-mon[32782]: pgmap v21142: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39482.654041 secs 2024-04-26T22:46:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39482.654041 secs 2024-04-26T22:46:07.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39482.654041 secs 2024-04-26T22:46:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:08 smithi196 ceph-mon[32572]: pgmap v21143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:08.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:08 smithi110 ceph-mon[28069]: pgmap v21143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:08 smithi193 ceph-mon[32782]: pgmap v21143: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:10 smithi196 ceph-mon[32572]: pgmap v21144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:10 smithi110 ceph-mon[28069]: pgmap v21144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:10 smithi193 ceph-mon[32782]: pgmap v21144: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:12 smithi196 ceph-mon[32572]: pgmap v21145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39487.654163 secs 2024-04-26T22:46:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:12 smithi110 ceph-mon[28069]: pgmap v21145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39487.654163 secs 2024-04-26T22:46:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:12 smithi193 ceph-mon[32782]: pgmap v21145: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39487.654163 secs 2024-04-26T22:46:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:14 smithi196 ceph-mon[32572]: pgmap v21146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:14 smithi110 ceph-mon[28069]: pgmap v21146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:14 smithi193 ceph-mon[32782]: pgmap v21146: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:16 smithi196 ceph-mon[32572]: pgmap v21147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:16 smithi110 ceph-mon[28069]: pgmap v21147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:16 smithi193 ceph-mon[32782]: pgmap v21147: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39492.654286 secs 2024-04-26T22:46:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39492.654286 secs 2024-04-26T22:46:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39492.654286 secs 2024-04-26T22:46:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:18 smithi196 ceph-mon[32572]: pgmap v21148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:18 smithi110 ceph-mon[28069]: pgmap v21148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:18 smithi193 ceph-mon[32782]: pgmap v21148: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:21.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:20 smithi196 ceph-mon[32572]: pgmap v21149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:20 smithi110 ceph-mon[28069]: pgmap v21149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:20 smithi193 ceph-mon[32782]: pgmap v21149: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:22 smithi196 ceph-mon[32572]: pgmap v21150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39497.654420 secs 2024-04-26T22:46:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:22 smithi110 ceph-mon[28069]: pgmap v21150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39497.654420 secs 2024-04-26T22:46:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:22 smithi193 ceph-mon[32782]: pgmap v21150: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39497.654420 secs 2024-04-26T22:46:24.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:23 smithi193 ceph-mon[32782]: pgmap v21151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:23 smithi110 ceph-mon[28069]: pgmap v21151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:23 smithi196 ceph-mon[32572]: pgmap v21151: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:25 smithi193 ceph-mon[32782]: pgmap v21152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:25 smithi196 ceph-mon[32572]: pgmap v21152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:26.293 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:25 smithi110 ceph-mon[28069]: pgmap v21152: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:27 smithi196 ceph-mon[32572]: pgmap v21153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39502.654559 secs 2024-04-26T22:46:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:27 smithi110 ceph-mon[28069]: pgmap v21153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39502.654559 secs 2024-04-26T22:46:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:27 smithi193 ceph-mon[32782]: pgmap v21153: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39502.654559 secs 2024-04-26T22:46:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:29 smithi196 ceph-mon[32572]: pgmap v21154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:29 smithi110 ceph-mon[28069]: pgmap v21154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:30.375 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:29 smithi193 ceph-mon[32782]: pgmap v21154: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:31 smithi196 ceph-mon[32572]: pgmap v21155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:31 smithi110 ceph-mon[28069]: pgmap v21155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:31 smithi193 ceph-mon[32782]: pgmap v21155: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39507.654675 secs 2024-04-26T22:46:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39507.654675 secs 2024-04-26T22:46:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39507.654675 secs 2024-04-26T22:46:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:33 smithi196 ceph-mon[32572]: pgmap v21156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:33 smithi110 ceph-mon[28069]: pgmap v21156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:33 smithi193 ceph-mon[32782]: pgmap v21156: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:35 smithi196 ceph-mon[32572]: pgmap v21157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:35 smithi110 ceph-mon[28069]: pgmap v21157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:35 smithi193 ceph-mon[32782]: pgmap v21157: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:37 smithi196 ceph-mon[32572]: pgmap v21158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:38.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39512.654795 secs 2024-04-26T22:46:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:37 smithi110 ceph-mon[28069]: pgmap v21158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39512.654795 secs 2024-04-26T22:46:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:37 smithi193 ceph-mon[32782]: pgmap v21158: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39512.654795 secs 2024-04-26T22:46:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:39 smithi196 ceph-mon[32572]: pgmap v21159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:39 smithi110 ceph-mon[28069]: pgmap v21159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:39 smithi193 ceph-mon[32782]: pgmap v21159: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:41 smithi196 ceph-mon[32572]: pgmap v21160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:41 smithi110 ceph-mon[28069]: pgmap v21160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:41 smithi193 ceph-mon[32782]: pgmap v21160: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39517.654870 secs 2024-04-26T22:46:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39517.654870 secs 2024-04-26T22:46:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39517.654870 secs 2024-04-26T22:46:44.243 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:43 smithi193 ceph-mon[32782]: pgmap v21161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:44.243 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:43 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:46:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:43 smithi196 ceph-mon[32572]: pgmap v21161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:43 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:46:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:43 smithi110 ceph-mon[28069]: pgmap v21161: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:43 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:46:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: pgmap v21162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.756 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:46 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: pgmap v21162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.792 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:46 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: pgmap v21162: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:46.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:46 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:47 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:46:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:47 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:46:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:47 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:46:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:47 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:46:47.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39522.654978 secs 2024-04-26T22:46:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:47 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:46:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:47 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:46:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:47 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:46:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:47 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:46:47.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39522.654978 secs 2024-04-26T22:46:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:47 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:46:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:47 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:46:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:47 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:46:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:47 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:46:47.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39522.654978 secs 2024-04-26T22:46:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:48 smithi196 ceph-mon[32572]: pgmap v21163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:48 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:48 smithi110 ceph-mon[28069]: pgmap v21163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:49.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:48 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:48 smithi193 ceph-mon[32782]: pgmap v21163: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:46:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:48 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:46:50.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:46:50.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:49 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:46:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:46:50.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:49 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:46:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:46:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:46:50.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:49 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:46:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:50 smithi196 ceph-mon[32572]: pgmap v21164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:50 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:46:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:50 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:46:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:50 smithi196 ceph-mon[32572]: pgmap v21165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 B/s rd, 1 op/s 2024-04-26T22:46:51.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:50 smithi196 ceph-mon[32572]: pgmap v21166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:50 smithi110 ceph-mon[28069]: pgmap v21164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:50 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:46:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:50 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:46:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:50 smithi110 ceph-mon[28069]: pgmap v21165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 B/s rd, 1 op/s 2024-04-26T22:46:51.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:50 smithi110 ceph-mon[28069]: pgmap v21166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:50 smithi193 ceph-mon[32782]: pgmap v21164: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:50 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:46:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:50 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:46:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:50 smithi193 ceph-mon[32782]: pgmap v21165: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 B/s rd, 1 op/s 2024-04-26T22:46:51.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:50 smithi193 ceph-mon[32782]: pgmap v21166: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:52 smithi196 ceph-mon[32572]: pgmap v21167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 622 B/s rd, 1 op/s 2024-04-26T22:46:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39527.655121 secs 2024-04-26T22:46:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:52 smithi110 ceph-mon[28069]: pgmap v21167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 622 B/s rd, 1 op/s 2024-04-26T22:46:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39527.655121 secs 2024-04-26T22:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:52 smithi193 ceph-mon[32782]: pgmap v21167: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 622 B/s rd, 1 op/s 2024-04-26T22:46:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39527.655121 secs 2024-04-26T22:46:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:54 smithi196 ceph-mon[32572]: pgmap v21168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:54 smithi110 ceph-mon[28069]: pgmap v21168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:54 smithi193 ceph-mon[32782]: pgmap v21168: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:56 smithi196 ceph-mon[32572]: pgmap v21169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:56 smithi110 ceph-mon[28069]: pgmap v21169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:56 smithi193 ceph-mon[32782]: pgmap v21169: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:46:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39532.655209 secs 2024-04-26T22:46:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39532.655209 secs 2024-04-26T22:46:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39532.655209 secs 2024-04-26T22:46:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:46:58 smithi196 ceph-mon[32572]: pgmap v21170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 622 B/s rd, 1 op/s 2024-04-26T22:46:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:46:58 smithi110 ceph-mon[28069]: pgmap v21170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 622 B/s rd, 1 op/s 2024-04-26T22:46:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:46:58 smithi193 ceph-mon[32782]: pgmap v21170: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 622 B/s rd, 1 op/s 2024-04-26T22:47:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:00 smithi196 ceph-mon[32572]: pgmap v21171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:47:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:00 smithi110 ceph-mon[28069]: pgmap v21171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:47:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:00 smithi193 ceph-mon[32782]: pgmap v21171: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:47:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:02 smithi196 ceph-mon[32572]: pgmap v21172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:03.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39537.655340 secs 2024-04-26T22:47:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:02 smithi110 ceph-mon[28069]: pgmap v21172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:03.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39537.655340 secs 2024-04-26T22:47:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:02 smithi193 ceph-mon[32782]: pgmap v21172: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39537.655340 secs 2024-04-26T22:47:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:04 smithi196 ceph-mon[32572]: pgmap v21173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:04 smithi110 ceph-mon[28069]: pgmap v21173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:04 smithi193 ceph-mon[32782]: pgmap v21173: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:06 smithi196 ceph-mon[32572]: pgmap v21174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:06 smithi110 ceph-mon[28069]: pgmap v21174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:06 smithi193 ceph-mon[32782]: pgmap v21174: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39542.655479 secs 2024-04-26T22:47:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39542.655479 secs 2024-04-26T22:47:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39542.655479 secs 2024-04-26T22:47:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:08 smithi196 ceph-mon[32572]: pgmap v21175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:08 smithi110 ceph-mon[28069]: pgmap v21175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:08 smithi193 ceph-mon[32782]: pgmap v21175: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:10 smithi196 ceph-mon[32572]: pgmap v21176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:10 smithi110 ceph-mon[28069]: pgmap v21176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:10 smithi193 ceph-mon[32782]: pgmap v21176: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:12 smithi196 ceph-mon[32572]: pgmap v21177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39547.655613 secs 2024-04-26T22:47:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:12 smithi110 ceph-mon[28069]: pgmap v21177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39547.655613 secs 2024-04-26T22:47:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:12 smithi193 ceph-mon[32782]: pgmap v21177: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39547.655613 secs 2024-04-26T22:47:14.930 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:14 smithi110 ceph-mon[28069]: pgmap v21178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:14 smithi196 ceph-mon[32572]: pgmap v21178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:14 smithi193 ceph-mon[32782]: pgmap v21178: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:17.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:16 smithi110 ceph-mon[28069]: pgmap v21179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:16 smithi193 ceph-mon[32782]: pgmap v21179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:16 smithi196 ceph-mon[32572]: pgmap v21179: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39552.655682 secs 2024-04-26T22:47:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39552.655682 secs 2024-04-26T22:47:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39552.655682 secs 2024-04-26T22:47:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:18 smithi110 ceph-mon[28069]: pgmap v21180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:18 smithi193 ceph-mon[32782]: pgmap v21180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:18 smithi196 ceph-mon[32572]: pgmap v21180: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:19 smithi110 ceph-mon[28069]: pgmap v21181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:19 smithi193 ceph-mon[32782]: pgmap v21181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:19 smithi196 ceph-mon[32572]: pgmap v21181: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:22 smithi193 ceph-mon[32782]: pgmap v21182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:22 smithi196 ceph-mon[32572]: pgmap v21182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:22 smithi110 ceph-mon[28069]: pgmap v21182: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:23 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39557.655773 secs 2024-04-26T22:47:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:23 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39557.655773 secs 2024-04-26T22:47:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:23 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39557.655773 secs 2024-04-26T22:47:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:24 smithi196 ceph-mon[32572]: pgmap v21183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:24 smithi110 ceph-mon[28069]: pgmap v21183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:24 smithi193 ceph-mon[32782]: pgmap v21183: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:26 smithi110 ceph-mon[28069]: pgmap v21184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:26 smithi196 ceph-mon[32572]: pgmap v21184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:26 smithi193 ceph-mon[32782]: pgmap v21184: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:27.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39562.655867 secs 2024-04-26T22:47:27.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39562.655867 secs 2024-04-26T22:47:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39562.655867 secs 2024-04-26T22:47:28.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:28 smithi196 ceph-mon[32572]: pgmap v21185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:28 smithi110 ceph-mon[28069]: pgmap v21185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:28 smithi193 ceph-mon[32782]: pgmap v21185: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:30.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:30 smithi196 ceph-mon[32572]: pgmap v21186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:30.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:30 smithi110 ceph-mon[28069]: pgmap v21186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:30.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:30 smithi193 ceph-mon[32782]: pgmap v21186: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:32 smithi196 ceph-mon[32572]: pgmap v21187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:32.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39567.655996 secs 2024-04-26T22:47:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:32 smithi110 ceph-mon[28069]: pgmap v21187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:32.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39567.655996 secs 2024-04-26T22:47:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:32 smithi193 ceph-mon[32782]: pgmap v21187: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39567.655996 secs 2024-04-26T22:47:34.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:34 smithi196 ceph-mon[32572]: pgmap v21188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:34.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:34 smithi110 ceph-mon[28069]: pgmap v21188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:34.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:34 smithi193 ceph-mon[32782]: pgmap v21188: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:36.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:36 smithi196 ceph-mon[32572]: pgmap v21189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:36.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:36 smithi110 ceph-mon[28069]: pgmap v21189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:36.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:36 smithi193 ceph-mon[32782]: pgmap v21189: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39572.656075 secs 2024-04-26T22:47:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39572.656075 secs 2024-04-26T22:47:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39572.656075 secs 2024-04-26T22:47:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:38 smithi196 ceph-mon[32572]: pgmap v21190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:38 smithi110 ceph-mon[28069]: pgmap v21190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:38 smithi193 ceph-mon[32782]: pgmap v21190: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:40.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:40 smithi196 ceph-mon[32572]: pgmap v21191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:40.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:40 smithi110 ceph-mon[28069]: pgmap v21191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:40.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:40 smithi193 ceph-mon[32782]: pgmap v21191: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:42 smithi196 ceph-mon[32572]: pgmap v21192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:42.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39577.656145 secs 2024-04-26T22:47:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:42 smithi110 ceph-mon[28069]: pgmap v21192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39577.656145 secs 2024-04-26T22:47:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:42 smithi193 ceph-mon[32782]: pgmap v21192: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39577.656145 secs 2024-04-26T22:47:44.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:44 smithi196 ceph-mon[32572]: pgmap v21193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:44.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:44 smithi110 ceph-mon[28069]: pgmap v21193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:44.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:44 smithi193 ceph-mon[32782]: pgmap v21193: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:46.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:46 smithi196 ceph-mon[32572]: pgmap v21194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:46.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:46 smithi110 ceph-mon[28069]: pgmap v21194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:46.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:46 smithi193 ceph-mon[32782]: pgmap v21194: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39582.656259 secs 2024-04-26T22:47:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39582.656259 secs 2024-04-26T22:47:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39582.656259 secs 2024-04-26T22:47:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:48 smithi196 ceph-mon[32572]: pgmap v21195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:48 smithi110 ceph-mon[28069]: pgmap v21195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:48 smithi193 ceph-mon[32782]: pgmap v21195: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:47:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:50 smithi196 ceph-mon[32572]: pgmap v21196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:50.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:50 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:47:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:50 smithi110 ceph-mon[28069]: pgmap v21196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:50.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:50 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:47:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:50 smithi193 ceph-mon[32782]: pgmap v21196: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:47:50.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:50 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:47:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:47:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:47:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:51 smithi196 ceph-mon[32572]: pgmap v21197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:47:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:51 smithi196 ceph-mon[32572]: pgmap v21198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:51.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:51 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:47:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:47:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:47:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:51 smithi110 ceph-mon[28069]: pgmap v21197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:47:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:51 smithi110 ceph-mon[28069]: pgmap v21198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:51.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:51 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:47:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:47:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:47:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:51 smithi193 ceph-mon[32782]: pgmap v21197: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:47:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:51 smithi193 ceph-mon[32782]: pgmap v21198: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:51.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:51 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:47:52.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39587.656374 secs 2024-04-26T22:47:52.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39587.656374 secs 2024-04-26T22:47:52.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39587.656374 secs 2024-04-26T22:47:53.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:53 smithi196 ceph-mon[32572]: pgmap v21199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:53.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:53 smithi110 ceph-mon[28069]: pgmap v21199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:53.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:53 smithi193 ceph-mon[32782]: pgmap v21199: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:55 smithi196 ceph-mon[32572]: pgmap v21200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:55 smithi110 ceph-mon[28069]: pgmap v21200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:55 smithi193 ceph-mon[32782]: pgmap v21200: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:57 smithi196 ceph-mon[32572]: pgmap v21201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39592.656494 secs 2024-04-26T22:47:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:57 smithi110 ceph-mon[28069]: pgmap v21201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39592.656494 secs 2024-04-26T22:47:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:57 smithi193 ceph-mon[32782]: pgmap v21201: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:47:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39592.656494 secs 2024-04-26T22:48:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:47:59 smithi196 ceph-mon[32572]: pgmap v21202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:47:59 smithi110 ceph-mon[28069]: pgmap v21202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:47:59 smithi193 ceph-mon[32782]: pgmap v21202: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:01 smithi196 ceph-mon[32572]: pgmap v21203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:48:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:01 smithi110 ceph-mon[28069]: pgmap v21203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:48:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:01 smithi193 ceph-mon[32782]: pgmap v21203: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:48:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39597.656635 secs 2024-04-26T22:48:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39597.656635 secs 2024-04-26T22:48:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39597.656635 secs 2024-04-26T22:48:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:03 smithi196 ceph-mon[32572]: pgmap v21204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:03 smithi110 ceph-mon[28069]: pgmap v21204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:03 smithi193 ceph-mon[32782]: pgmap v21204: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:05 smithi196 ceph-mon[32572]: pgmap v21205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:05 smithi110 ceph-mon[28069]: pgmap v21205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:05 smithi193 ceph-mon[32782]: pgmap v21205: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:07 smithi196 ceph-mon[32572]: pgmap v21206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39602.656762 secs 2024-04-26T22:48:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:07 smithi110 ceph-mon[28069]: pgmap v21206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39602.656762 secs 2024-04-26T22:48:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:07 smithi193 ceph-mon[32782]: pgmap v21206: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39602.656762 secs 2024-04-26T22:48:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:09 smithi196 ceph-mon[32572]: pgmap v21207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:09 smithi110 ceph-mon[28069]: pgmap v21207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:09 smithi193 ceph-mon[32782]: pgmap v21207: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:11 smithi196 ceph-mon[32572]: pgmap v21208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:11 smithi110 ceph-mon[28069]: pgmap v21208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:11 smithi193 ceph-mon[32782]: pgmap v21208: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39607.656890 secs 2024-04-26T22:48:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39607.656890 secs 2024-04-26T22:48:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39607.656890 secs 2024-04-26T22:48:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:13 smithi196 ceph-mon[32572]: pgmap v21209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:13 smithi110 ceph-mon[28069]: pgmap v21209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:13 smithi193 ceph-mon[32782]: pgmap v21209: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:15 smithi110 ceph-mon[28069]: pgmap v21210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:15 smithi193 ceph-mon[32782]: pgmap v21210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:15 smithi196 ceph-mon[32572]: pgmap v21210: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.484+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T22:48:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.484+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:48:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.484+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:48:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.484+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T22:48:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.485+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:48:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.486+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T22:48:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.486+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T22:48:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.525+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T22:48:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.525+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T22:48:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.525+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614036000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:48:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.525+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614036000 comp rx=0 tx=0).stop 2024-04-26T22:48:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.525+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T22:48:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.525+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 msgr2=0x7f26000b4670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T22:48:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.525+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:48:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.525+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:48:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.526+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:48:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:16.528+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2614004010 tx=0x7f2614075000 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:48:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:17 smithi110 ceph-mon[28069]: pgmap v21211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39612.656987 secs 2024-04-26T22:48:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:17 smithi193 ceph-mon[32782]: pgmap v21211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:18.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39612.656987 secs 2024-04-26T22:48:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:17 smithi196 ceph-mon[32572]: pgmap v21211: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39612.656987 secs 2024-04-26T22:48:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:19 smithi110 ceph-mon[28069]: pgmap v21212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:19 smithi193 ceph-mon[32782]: pgmap v21212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:19 smithi196 ceph-mon[32572]: pgmap v21212: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:21 smithi110 ceph-mon[28069]: pgmap v21213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:21 smithi193 ceph-mon[32782]: pgmap v21213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:21 smithi196 ceph-mon[32572]: pgmap v21213: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:22.962+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec006130 con 0x7f261c104b50 2024-04-26T22:48:22.962 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:22.962+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8003690 con 0x55db1be4fdd0 2024-04-26T22:48:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:22.963+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 304 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f25e8003690 con 0x7f261c104b50 2024-04-26T22:48:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:22.963+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 304 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f25ec006130 con 0x55db1be4fdd0 2024-04-26T22:48:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:22.963+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:48:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:22.963+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T22:48:22.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:22.964+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 305 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T22:48:22.964 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:48:22.964+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 305 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:48:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39617.657100 secs 2024-04-26T22:48:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:22 smithi110 ceph-mon[28069]: pgmap v21214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39617.657100 secs 2024-04-26T22:48:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:22 smithi193 ceph-mon[32782]: pgmap v21214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39617.657100 secs 2024-04-26T22:48:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:22 smithi196 ceph-mon[32572]: pgmap v21214: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:25 smithi196 ceph-mon[32572]: pgmap v21215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:25 smithi110 ceph-mon[28069]: pgmap v21215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:25 smithi193 ceph-mon[32782]: pgmap v21215: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:27 smithi196 ceph-mon[32572]: pgmap v21216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39622.657218 secs 2024-04-26T22:48:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:27 smithi110 ceph-mon[28069]: pgmap v21216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39622.657218 secs 2024-04-26T22:48:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:27 smithi193 ceph-mon[32782]: pgmap v21216: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39622.657218 secs 2024-04-26T22:48:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:29 smithi196 ceph-mon[32572]: pgmap v21217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:29 smithi110 ceph-mon[28069]: pgmap v21217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:29 smithi193 ceph-mon[32782]: pgmap v21217: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:31 smithi196 ceph-mon[32572]: pgmap v21218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:31 smithi110 ceph-mon[28069]: pgmap v21218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:31 smithi193 ceph-mon[32782]: pgmap v21218: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39627.657332 secs 2024-04-26T22:48:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39627.657332 secs 2024-04-26T22:48:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39627.657332 secs 2024-04-26T22:48:34.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:33 smithi196 ceph-mon[32572]: pgmap v21219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:33 smithi110 ceph-mon[28069]: pgmap v21219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:33 smithi193 ceph-mon[32782]: pgmap v21219: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:35 smithi196 ceph-mon[32572]: pgmap v21220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:35 smithi110 ceph-mon[28069]: pgmap v21220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:35 smithi193 ceph-mon[32782]: pgmap v21220: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:37 smithi196 ceph-mon[32572]: pgmap v21221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:38.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39632.657472 secs 2024-04-26T22:48:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:37 smithi110 ceph-mon[28069]: pgmap v21221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39632.657472 secs 2024-04-26T22:48:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:37 smithi193 ceph-mon[32782]: pgmap v21221: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39632.657472 secs 2024-04-26T22:48:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:39 smithi196 ceph-mon[32572]: pgmap v21222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:39 smithi110 ceph-mon[28069]: pgmap v21222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:39 smithi193 ceph-mon[32782]: pgmap v21222: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:41 smithi196 ceph-mon[32572]: pgmap v21223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:41 smithi110 ceph-mon[28069]: pgmap v21223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:41 smithi193 ceph-mon[32782]: pgmap v21223: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39637.657581 secs 2024-04-26T22:48:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39637.657581 secs 2024-04-26T22:48:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39637.657581 secs 2024-04-26T22:48:44.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:43 smithi196 ceph-mon[32572]: pgmap v21224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:43 smithi110 ceph-mon[28069]: pgmap v21224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:43 smithi193 ceph-mon[32782]: pgmap v21224: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:46.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:45 smithi196 ceph-mon[32572]: pgmap v21225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:45 smithi110 ceph-mon[28069]: pgmap v21225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:45 smithi193 ceph-mon[32782]: pgmap v21225: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:47 smithi196 ceph-mon[32572]: pgmap v21226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39642.657705 secs 2024-04-26T22:48:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:47 smithi110 ceph-mon[28069]: pgmap v21226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39642.657705 secs 2024-04-26T22:48:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:47 smithi193 ceph-mon[32782]: pgmap v21226: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39642.657705 secs 2024-04-26T22:48:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:49 smithi110 ceph-mon[28069]: pgmap v21227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:49 smithi193 ceph-mon[32782]: pgmap v21227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:49 smithi196 ceph-mon[32572]: pgmap v21227: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:48:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:51 smithi110 ceph-mon[28069]: pgmap v21228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:52.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:51 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:48:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:51 smithi193 ceph-mon[32782]: pgmap v21228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:51 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:48:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:51 smithi196 ceph-mon[32572]: pgmap v21228: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:48:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:51 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:48:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39647.657812 secs 2024-04-26T22:48:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:48:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:52 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:48:53.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:52 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:48:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39647.657812 secs 2024-04-26T22:48:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:48:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:52 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:48:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:52 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:48:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39647.657812 secs 2024-04-26T22:48:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:48:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:52 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:48:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:52 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:48:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:53 smithi110 ceph-mon[28069]: pgmap v21229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:48:54.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:53 smithi110 ceph-mon[28069]: pgmap v21230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:48:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:53 smithi193 ceph-mon[32782]: pgmap v21229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:48:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:53 smithi193 ceph-mon[32782]: pgmap v21230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:48:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:53 smithi196 ceph-mon[32572]: pgmap v21229: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T22:48:54.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:53 smithi196 ceph-mon[32572]: pgmap v21230: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T22:48:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:55 smithi110 ceph-mon[28069]: pgmap v21231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:55 smithi193 ceph-mon[32782]: pgmap v21231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:55 smithi196 ceph-mon[32572]: pgmap v21231: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:57 smithi110 ceph-mon[28069]: pgmap v21232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39652.657896 secs 2024-04-26T22:48:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:57 smithi193 ceph-mon[32782]: pgmap v21232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39652.657896 secs 2024-04-26T22:48:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:57 smithi196 ceph-mon[32572]: pgmap v21232: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39652.657896 secs 2024-04-26T22:48:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:48:58 smithi193 ceph-mon[32782]: pgmap v21233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:48:58 smithi196 ceph-mon[32572]: pgmap v21233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:48:59.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:48:58 smithi110 ceph-mon[28069]: pgmap v21233: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:01 smithi196 ceph-mon[32572]: pgmap v21234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:01 smithi110 ceph-mon[28069]: pgmap v21234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:01.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:01 smithi193 ceph-mon[32782]: pgmap v21234: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39657.658014 secs 2024-04-26T22:49:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39657.658014 secs 2024-04-26T22:49:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39657.658014 secs 2024-04-26T22:49:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:03 smithi196 ceph-mon[32572]: pgmap v21235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:49:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:03 smithi110 ceph-mon[28069]: pgmap v21235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:49:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:03 smithi193 ceph-mon[32782]: pgmap v21235: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:49:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:05 smithi196 ceph-mon[32572]: pgmap v21236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:05 smithi110 ceph-mon[28069]: pgmap v21236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:05.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:05 smithi193 ceph-mon[32782]: pgmap v21236: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:07 smithi196 ceph-mon[32572]: pgmap v21237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39662.658151 secs 2024-04-26T22:49:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:07 smithi110 ceph-mon[28069]: pgmap v21237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:07.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39662.658151 secs 2024-04-26T22:49:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:07 smithi193 ceph-mon[32782]: pgmap v21237: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39662.658151 secs 2024-04-26T22:49:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:09 smithi110 ceph-mon[28069]: pgmap v21238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:09 smithi193 ceph-mon[32782]: pgmap v21238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:09 smithi196 ceph-mon[32572]: pgmap v21238: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:11 smithi110 ceph-mon[28069]: pgmap v21239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:11 smithi193 ceph-mon[32782]: pgmap v21239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:11.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:11 smithi196 ceph-mon[32572]: pgmap v21239: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:12.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39667.658289 secs 2024-04-26T22:49:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39667.658289 secs 2024-04-26T22:49:12.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39667.658289 secs 2024-04-26T22:49:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:13 smithi110 ceph-mon[28069]: pgmap v21240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:13 smithi193 ceph-mon[32782]: pgmap v21240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:13 smithi196 ceph-mon[32572]: pgmap v21240: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:15.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:15 smithi110 ceph-mon[28069]: pgmap v21241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:15.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:15 smithi193 ceph-mon[32782]: pgmap v21241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:15.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:15 smithi196 ceph-mon[32572]: pgmap v21241: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:17 smithi110 ceph-mon[28069]: pgmap v21242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39672.658380 secs 2024-04-26T22:49:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:17 smithi193 ceph-mon[32782]: pgmap v21242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39672.658380 secs 2024-04-26T22:49:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:17 smithi196 ceph-mon[32572]: pgmap v21242: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39672.658380 secs 2024-04-26T22:49:19.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:19 smithi110 ceph-mon[28069]: pgmap v21243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:19.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:49:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:49:19.506+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:49:19.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:49:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:49:19.506+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:49:19.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:49:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:49:19.506+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:49:19.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:49:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:49:19.506+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:49:19.541 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:49:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:49:19.506+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:49:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:19 smithi193 ceph-mon[32782]: pgmap v21243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:19 smithi196 ceph-mon[32572]: pgmap v21243: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:21 smithi193 ceph-mon[32782]: pgmap v21244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:21 smithi196 ceph-mon[32572]: pgmap v21244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:21 smithi110 ceph-mon[28069]: pgmap v21244: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39677.658520 secs 2024-04-26T22:49:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39677.658520 secs 2024-04-26T22:49:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39677.658520 secs 2024-04-26T22:49:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:23 smithi193 ceph-mon[32782]: pgmap v21245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:23 smithi196 ceph-mon[32572]: pgmap v21245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:23 smithi110 ceph-mon[28069]: pgmap v21245: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:25 smithi193 ceph-mon[32782]: pgmap v21246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:49:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:25 smithi196 ceph-mon[32572]: pgmap v21246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:49:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:25 smithi110 ceph-mon[28069]: pgmap v21246: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:49:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:27 smithi193 ceph-mon[32782]: pgmap v21247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:49:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39682.658669 secs 2024-04-26T22:49:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:27 smithi196 ceph-mon[32572]: pgmap v21247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:49:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39682.658669 secs 2024-04-26T22:49:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:27 smithi110 ceph-mon[28069]: pgmap v21247: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:49:27.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39682.658669 secs 2024-04-26T22:49:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:29 smithi193 ceph-mon[32782]: pgmap v21248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:49:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:29 smithi196 ceph-mon[32572]: pgmap v21248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:49:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:29 smithi110 ceph-mon[28069]: pgmap v21248: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:49:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:31 smithi193 ceph-mon[32782]: pgmap v21249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:49:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:31 smithi196 ceph-mon[32572]: pgmap v21249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:49:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:31 smithi110 ceph-mon[28069]: pgmap v21249: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:49:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39687.658765 secs 2024-04-26T22:49:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39687.658765 secs 2024-04-26T22:49:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39687.658765 secs 2024-04-26T22:49:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:33 smithi193 ceph-mon[32782]: pgmap v21250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:49:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:33 smithi196 ceph-mon[32572]: pgmap v21250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:49:33.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:33 smithi110 ceph-mon[28069]: pgmap v21250: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:49:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:35 smithi193 ceph-mon[32782]: pgmap v21251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:49:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:35 smithi196 ceph-mon[32572]: pgmap v21251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:49:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:35 smithi110 ceph-mon[28069]: pgmap v21251: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:49:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:37 smithi193 ceph-mon[32782]: pgmap v21252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39692.658862 secs 2024-04-26T22:49:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:37 smithi196 ceph-mon[32572]: pgmap v21252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39692.658862 secs 2024-04-26T22:49:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:37 smithi110 ceph-mon[28069]: pgmap v21252: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39692.658862 secs 2024-04-26T22:49:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:39 smithi193 ceph-mon[32782]: pgmap v21253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:39 smithi196 ceph-mon[32572]: pgmap v21253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:39 smithi110 ceph-mon[28069]: pgmap v21253: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:41 smithi193 ceph-mon[32782]: pgmap v21254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:41 smithi196 ceph-mon[32572]: pgmap v21254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:41 smithi110 ceph-mon[28069]: pgmap v21254: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39697.658986 secs 2024-04-26T22:49:42.656 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39697.658986 secs 2024-04-26T22:49:42.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39697.658986 secs 2024-04-26T22:49:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:43 smithi196 ceph-mon[32572]: pgmap v21255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:43 smithi110 ceph-mon[28069]: pgmap v21255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:43 smithi193 ceph-mon[32782]: pgmap v21255: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:45 smithi196 ceph-mon[32572]: pgmap v21256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:45 smithi110 ceph-mon[28069]: pgmap v21256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:45 smithi193 ceph-mon[32782]: pgmap v21256: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:47 smithi196 ceph-mon[32572]: pgmap v21257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39702.659056 secs 2024-04-26T22:49:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:47 smithi110 ceph-mon[28069]: pgmap v21257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39702.659056 secs 2024-04-26T22:49:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:47 smithi193 ceph-mon[32782]: pgmap v21257: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39702.659056 secs 2024-04-26T22:49:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:49 smithi196 ceph-mon[32572]: pgmap v21258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:49 smithi110 ceph-mon[28069]: pgmap v21258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:49 smithi193 ceph-mon[32782]: pgmap v21258: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:49:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:51 smithi196 ceph-mon[32572]: pgmap v21259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:51 smithi110 ceph-mon[28069]: pgmap v21259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:51 smithi193 ceph-mon[32782]: pgmap v21259: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39707.659171 secs 2024-04-26T22:49:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39707.659171 secs 2024-04-26T22:49:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39707.659171 secs 2024-04-26T22:49:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:53 smithi196 ceph-mon[32572]: pgmap v21260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:53 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:49:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:53 smithi110 ceph-mon[28069]: pgmap v21260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:53 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:49:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:53 smithi193 ceph-mon[32782]: pgmap v21260: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:49:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:53 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:49:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:49:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:49:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:54 smithi196 ceph-mon[32572]: pgmap v21261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:49:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:54 smithi196 ceph-mon[32572]: pgmap v21262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:54.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:54 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:49:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:49:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:49:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:54 smithi110 ceph-mon[28069]: pgmap v21261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:49:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:54 smithi110 ceph-mon[28069]: pgmap v21262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:54.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:54 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:49:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:49:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:49:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:54 smithi193 ceph-mon[32782]: pgmap v21261: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:49:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:54 smithi193 ceph-mon[32782]: pgmap v21262: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:54 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:49:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:56 smithi110 ceph-mon[28069]: pgmap v21263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:56 smithi193 ceph-mon[32782]: pgmap v21263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:56 smithi196 ceph-mon[32572]: pgmap v21263: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39712.659305 secs 2024-04-26T22:49:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39712.659305 secs 2024-04-26T22:49:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39712.659305 secs 2024-04-26T22:49:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:58 smithi193 ceph-mon[32782]: pgmap v21264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:58 smithi196 ceph-mon[32572]: pgmap v21264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:49:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:58 smithi110 ceph-mon[28069]: pgmap v21264: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:00.069 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:49:59 smithi110 ceph-mon[28069]: pgmap v21265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:49:59 smithi193 ceph-mon[32782]: pgmap v21265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:00.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:49:59 smithi196 ceph-mon[32572]: pgmap v21265: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:50:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:50:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T22:50:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:01 smithi193 ceph-mon[32782]: pgmap v21266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:01 smithi196 ceph-mon[32572]: pgmap v21266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:02.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:01 smithi110 ceph-mon[28069]: pgmap v21266: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39717.659439 secs 2024-04-26T22:50:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39717.659439 secs 2024-04-26T22:50:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39717.659439 secs 2024-04-26T22:50:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:03 smithi193 ceph-mon[32782]: pgmap v21267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:50:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:03 smithi196 ceph-mon[32572]: pgmap v21267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:50:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:03 smithi110 ceph-mon[28069]: pgmap v21267: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:50:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:06 smithi193 ceph-mon[32782]: pgmap v21268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:06 smithi196 ceph-mon[32572]: pgmap v21268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:06 smithi110 ceph-mon[28069]: pgmap v21268: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39722.659556 secs 2024-04-26T22:50:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39722.659556 secs 2024-04-26T22:50:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39722.659556 secs 2024-04-26T22:50:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:08 smithi193 ceph-mon[32782]: pgmap v21269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:08 smithi196 ceph-mon[32572]: pgmap v21269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:08 smithi110 ceph-mon[28069]: pgmap v21269: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:09 smithi193 ceph-mon[32782]: pgmap v21270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:09 smithi196 ceph-mon[32572]: pgmap v21270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:09 smithi110 ceph-mon[28069]: pgmap v21270: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:12 smithi193 ceph-mon[32782]: pgmap v21271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39727.659676 secs 2024-04-26T22:50:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:12 smithi196 ceph-mon[32572]: pgmap v21271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39727.659676 secs 2024-04-26T22:50:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:12 smithi110 ceph-mon[28069]: pgmap v21271: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39727.659676 secs 2024-04-26T22:50:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:14 smithi193 ceph-mon[32782]: pgmap v21272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:14 smithi196 ceph-mon[32572]: pgmap v21272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:14 smithi110 ceph-mon[28069]: pgmap v21272: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:15 smithi193 ceph-mon[32782]: pgmap v21273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:15 smithi196 ceph-mon[32572]: pgmap v21273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:15 smithi110 ceph-mon[28069]: pgmap v21273: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:17.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39732.659755 secs 2024-04-26T22:50:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39732.659755 secs 2024-04-26T22:50:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39732.659755 secs 2024-04-26T22:50:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:18 smithi196 ceph-mon[32572]: pgmap v21274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:18 smithi110 ceph-mon[28069]: pgmap v21274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:18 smithi193 ceph-mon[32782]: pgmap v21274: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:20 smithi193 ceph-mon[32782]: pgmap v21275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:20 smithi196 ceph-mon[32572]: pgmap v21275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:21.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:20 smithi110 ceph-mon[28069]: pgmap v21275: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:21 smithi193 ceph-mon[32782]: pgmap v21276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:21 smithi196 ceph-mon[32572]: pgmap v21276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:21 smithi110 ceph-mon[28069]: pgmap v21276: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39737.659870 secs 2024-04-26T22:50:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39737.659870 secs 2024-04-26T22:50:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39737.659870 secs 2024-04-26T22:50:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:23 smithi193 ceph-mon[32782]: pgmap v21277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:23 smithi196 ceph-mon[32572]: pgmap v21277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:23 smithi110 ceph-mon[28069]: pgmap v21277: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:26 smithi193 ceph-mon[32782]: pgmap v21278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:26 smithi196 ceph-mon[32572]: pgmap v21278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:26 smithi110 ceph-mon[28069]: pgmap v21278: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39742.660021 secs 2024-04-26T22:50:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:27 smithi193 ceph-mon[32782]: pgmap v21279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39742.660021 secs 2024-04-26T22:50:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:27 smithi196 ceph-mon[32572]: pgmap v21279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39742.660021 secs 2024-04-26T22:50:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:27 smithi110 ceph-mon[28069]: pgmap v21279: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:29 smithi193 ceph-mon[32782]: pgmap v21280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:29 smithi196 ceph-mon[32572]: pgmap v21280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:29 smithi110 ceph-mon[28069]: pgmap v21280: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:31 smithi193 ceph-mon[32782]: pgmap v21281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:31 smithi196 ceph-mon[32572]: pgmap v21281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:31 smithi110 ceph-mon[28069]: pgmap v21281: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39747.660139 secs 2024-04-26T22:50:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39747.660139 secs 2024-04-26T22:50:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39747.660139 secs 2024-04-26T22:50:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:33 smithi193 ceph-mon[32782]: pgmap v21282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:33 smithi196 ceph-mon[32572]: pgmap v21282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:33 smithi110 ceph-mon[28069]: pgmap v21282: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:35 smithi193 ceph-mon[32782]: pgmap v21283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:35 smithi196 ceph-mon[32572]: pgmap v21283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:35 smithi110 ceph-mon[28069]: pgmap v21283: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:37.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39752.660252 secs 2024-04-26T22:50:37.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39752.660252 secs 2024-04-26T22:50:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39752.660252 secs 2024-04-26T22:50:38.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:38 smithi196 ceph-mon[32572]: pgmap v21284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:38.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:38 smithi110 ceph-mon[28069]: pgmap v21284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:38 smithi193 ceph-mon[32782]: pgmap v21284: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:39 smithi193 ceph-mon[32782]: pgmap v21285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:39 smithi196 ceph-mon[32572]: pgmap v21285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:39 smithi110 ceph-mon[28069]: pgmap v21285: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:41 smithi193 ceph-mon[32782]: pgmap v21286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:41 smithi196 ceph-mon[32572]: pgmap v21286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:41 smithi110 ceph-mon[28069]: pgmap v21286: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39757.660381 secs 2024-04-26T22:50:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39757.660381 secs 2024-04-26T22:50:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39757.660381 secs 2024-04-26T22:50:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:43 smithi193 ceph-mon[32782]: pgmap v21287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:43 smithi196 ceph-mon[32572]: pgmap v21287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:43 smithi110 ceph-mon[28069]: pgmap v21287: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:45 smithi193 ceph-mon[32782]: pgmap v21288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:45 smithi196 ceph-mon[32572]: pgmap v21288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:45 smithi110 ceph-mon[28069]: pgmap v21288: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:47.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39762.660498 secs 2024-04-26T22:50:47.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39762.660498 secs 2024-04-26T22:50:47.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39762.660498 secs 2024-04-26T22:50:48.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:48 smithi196 ceph-mon[32572]: pgmap v21289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:48.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:48 smithi110 ceph-mon[28069]: pgmap v21289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:48.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:48 smithi193 ceph-mon[32782]: pgmap v21289: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:49 smithi193 ceph-mon[32782]: pgmap v21290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:49 smithi196 ceph-mon[32572]: pgmap v21290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:49 smithi110 ceph-mon[28069]: pgmap v21290: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:51 smithi193 ceph-mon[32782]: pgmap v21291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:51 smithi196 ceph-mon[32572]: pgmap v21291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:51 smithi110 ceph-mon[28069]: pgmap v21291: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:50:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39767.660596 secs 2024-04-26T22:50:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39767.660596 secs 2024-04-26T22:50:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39767.660596 secs 2024-04-26T22:50:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:53 smithi193 ceph-mon[32782]: pgmap v21292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:53 smithi196 ceph-mon[32572]: pgmap v21292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:53 smithi110 ceph-mon[28069]: pgmap v21292: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:50:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:54 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:50:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:54 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:50:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:54 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:50:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:50:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:55 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:50:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:55 smithi196 ceph-mon[32572]: pgmap v21293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:50:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:55 smithi196 ceph-mon[32572]: pgmap v21294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:56.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:55 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:50:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:50:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:55 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:50:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:55 smithi110 ceph-mon[28069]: pgmap v21293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:50:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:55 smithi110 ceph-mon[28069]: pgmap v21294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:56.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:55 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:50:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:50:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:55 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:50:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:55 smithi193 ceph-mon[32782]: pgmap v21293: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 886 B/s rd, 1 op/s 2024-04-26T22:50:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:55 smithi193 ceph-mon[32782]: pgmap v21294: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:50:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:55 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:50:57.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39772.660712 secs 2024-04-26T22:50:57.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39772.660712 secs 2024-04-26T22:50:57.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39772.660712 secs 2024-04-26T22:50:58.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:50:58 smithi196 ceph-mon[32572]: pgmap v21295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:50:58.522 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:50:58 smithi193 ceph-mon[32782]: pgmap v21295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:50:58.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:50:58 smithi110 ceph-mon[28069]: pgmap v21295: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:51:00.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:00 smithi193 ceph-mon[32782]: pgmap v21296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:51:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:00 smithi196 ceph-mon[32572]: pgmap v21296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:51:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:00 smithi110 ceph-mon[28069]: pgmap v21296: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:51:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:02 smithi193 ceph-mon[32782]: pgmap v21297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:51:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39777.660834 secs 2024-04-26T22:51:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:02 smithi196 ceph-mon[32572]: pgmap v21297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:51:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39777.660834 secs 2024-04-26T22:51:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:02 smithi110 ceph-mon[28069]: pgmap v21297: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:51:02.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39777.660834 secs 2024-04-26T22:51:04.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:04 smithi193 ceph-mon[32782]: pgmap v21298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:51:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:04 smithi196 ceph-mon[32572]: pgmap v21298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:51:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:04 smithi110 ceph-mon[28069]: pgmap v21298: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:51:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:06 smithi196 ceph-mon[32572]: pgmap v21299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:51:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:06 smithi110 ceph-mon[28069]: pgmap v21299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:51:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:06 smithi193 ceph-mon[32782]: pgmap v21299: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:51:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39782.660951 secs 2024-04-26T22:51:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39782.660951 secs 2024-04-26T22:51:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39782.660951 secs 2024-04-26T22:51:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:08 smithi196 ceph-mon[32572]: pgmap v21300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:08 smithi110 ceph-mon[28069]: pgmap v21300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:08 smithi193 ceph-mon[32782]: pgmap v21300: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:10 smithi196 ceph-mon[32572]: pgmap v21301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:10 smithi110 ceph-mon[28069]: pgmap v21301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:10 smithi193 ceph-mon[32782]: pgmap v21301: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:12 smithi196 ceph-mon[32572]: pgmap v21302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39787.661025 secs 2024-04-26T22:51:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:12 smithi110 ceph-mon[28069]: pgmap v21302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39787.661025 secs 2024-04-26T22:51:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:12 smithi193 ceph-mon[32782]: pgmap v21302: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39787.661025 secs 2024-04-26T22:51:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:14 smithi196 ceph-mon[32572]: pgmap v21303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:14 smithi110 ceph-mon[28069]: pgmap v21303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:14 smithi193 ceph-mon[32782]: pgmap v21303: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:16 smithi196 ceph-mon[32572]: pgmap v21304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:16 smithi110 ceph-mon[28069]: pgmap v21304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:16 smithi193 ceph-mon[32782]: pgmap v21304: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39792.661164 secs 2024-04-26T22:51:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39792.661164 secs 2024-04-26T22:51:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39792.661164 secs 2024-04-26T22:51:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:18 smithi196 ceph-mon[32572]: pgmap v21305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:18 smithi110 ceph-mon[28069]: pgmap v21305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:18 smithi193 ceph-mon[32782]: pgmap v21305: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:20.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:20 smithi196 ceph-mon[32572]: pgmap v21306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:20 smithi110 ceph-mon[28069]: pgmap v21306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:20 smithi193 ceph-mon[32782]: pgmap v21306: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:22 smithi196 ceph-mon[32572]: pgmap v21307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39797.661280 secs 2024-04-26T22:51:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:22 smithi110 ceph-mon[28069]: pgmap v21307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39797.661280 secs 2024-04-26T22:51:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:22 smithi193 ceph-mon[32782]: pgmap v21307: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39797.661280 secs 2024-04-26T22:51:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:51:22.992+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063d0 con 0x7f261c104b50 2024-04-26T22:51:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:51:22.992+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:51:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:51:22.993+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 306 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:51:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:51:22.993+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 306 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063d0 con 0x55db1be4fdd0 2024-04-26T22:51:24.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:24 smithi196 ceph-mon[32572]: pgmap v21308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:24 smithi110 ceph-mon[28069]: pgmap v21308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:24 smithi193 ceph-mon[32782]: pgmap v21308: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:26.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:26 smithi196 ceph-mon[32572]: pgmap v21309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:26 smithi110 ceph-mon[28069]: pgmap v21309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:26 smithi193 ceph-mon[32782]: pgmap v21309: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39802.661399 secs 2024-04-26T22:51:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39802.661399 secs 2024-04-26T22:51:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39802.661399 secs 2024-04-26T22:51:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:28 smithi196 ceph-mon[32572]: pgmap v21310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:28.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:28 smithi193 ceph-mon[32782]: pgmap v21310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:28 smithi110 ceph-mon[28069]: pgmap v21310: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:30.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:30 smithi196 ceph-mon[32572]: pgmap v21311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:30 smithi110 ceph-mon[28069]: pgmap v21311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:30 smithi193 ceph-mon[32782]: pgmap v21311: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:32 smithi196 ceph-mon[32572]: pgmap v21312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39807.661513 secs 2024-04-26T22:51:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:32 smithi110 ceph-mon[28069]: pgmap v21312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39807.661513 secs 2024-04-26T22:51:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:32 smithi193 ceph-mon[32782]: pgmap v21312: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39807.661513 secs 2024-04-26T22:51:34.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:34 smithi196 ceph-mon[32572]: pgmap v21313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:34.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:34 smithi110 ceph-mon[28069]: pgmap v21313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:34 smithi193 ceph-mon[32782]: pgmap v21313: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:36.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:36 smithi196 ceph-mon[32572]: pgmap v21314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:36.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:36 smithi110 ceph-mon[28069]: pgmap v21314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:36 smithi193 ceph-mon[32782]: pgmap v21314: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39812.661632 secs 2024-04-26T22:51:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39812.661632 secs 2024-04-26T22:51:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39812.661632 secs 2024-04-26T22:51:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:38 smithi196 ceph-mon[32572]: pgmap v21315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:38 smithi110 ceph-mon[28069]: pgmap v21315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:38 smithi193 ceph-mon[32782]: pgmap v21315: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:39 smithi193 ceph-mon[32782]: pgmap v21316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:39 smithi196 ceph-mon[32572]: pgmap v21316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:39 smithi110 ceph-mon[28069]: pgmap v21316: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:42 smithi196 ceph-mon[32572]: pgmap v21317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39817.661723 secs 2024-04-26T22:51:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:42 smithi110 ceph-mon[28069]: pgmap v21317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39817.661723 secs 2024-04-26T22:51:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:42 smithi193 ceph-mon[32782]: pgmap v21317: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39817.661723 secs 2024-04-26T22:51:44.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:44 smithi196 ceph-mon[32572]: pgmap v21318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:44.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:44 smithi110 ceph-mon[28069]: pgmap v21318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:44 smithi193 ceph-mon[32782]: pgmap v21318: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:46.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:46 smithi196 ceph-mon[32572]: pgmap v21319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:46.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:46 smithi110 ceph-mon[28069]: pgmap v21319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:46 smithi193 ceph-mon[32782]: pgmap v21319: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39822.661834 secs 2024-04-26T22:51:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39822.661834 secs 2024-04-26T22:51:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39822.661834 secs 2024-04-26T22:51:48.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:48 smithi196 ceph-mon[32572]: pgmap v21320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:48.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:48 smithi110 ceph-mon[28069]: pgmap v21320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:48.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:48 smithi193 ceph-mon[32782]: pgmap v21320: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:50.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:50 smithi196 ceph-mon[32572]: pgmap v21321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:50.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:50 smithi110 ceph-mon[28069]: pgmap v21321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:50 smithi193 ceph-mon[32782]: pgmap v21321: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:51:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:52 smithi196 ceph-mon[32572]: pgmap v21322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39827.661947 secs 2024-04-26T22:51:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:52 smithi110 ceph-mon[28069]: pgmap v21322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39827.661947 secs 2024-04-26T22:51:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:52 smithi193 ceph-mon[32782]: pgmap v21322: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39827.661947 secs 2024-04-26T22:51:54.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:54 smithi196 ceph-mon[32572]: pgmap v21323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:54.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:54 smithi110 ceph-mon[28069]: pgmap v21323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:54 smithi193 ceph-mon[32782]: pgmap v21323: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:51:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:56 smithi196 ceph-mon[32572]: pgmap v21324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:56.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:56 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:51:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:56 smithi110 ceph-mon[28069]: pgmap v21324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:56 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:51:56.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:56 smithi193 ceph-mon[32782]: pgmap v21324: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:51:56.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:56 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:51:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39832.662024 secs 2024-04-26T22:51:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:51:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:51:57.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:57 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:51:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39832.662024 secs 2024-04-26T22:51:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:51:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:51:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:57 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:51:57.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39832.662024 secs 2024-04-26T22:51:57.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:51:57.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:51:57.874 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:57 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:51:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:58 smithi196 ceph-mon[32572]: pgmap v21325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:51:58.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:51:58 smithi196 ceph-mon[32572]: pgmap v21326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T22:51:58.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:58 smithi193 ceph-mon[32782]: pgmap v21325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:51:58.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:51:58 smithi193 ceph-mon[32782]: pgmap v21326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T22:51:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:58 smithi110 ceph-mon[28069]: pgmap v21325: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:51:58.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:51:58 smithi110 ceph-mon[28069]: pgmap v21326: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 530 B/s rd, 1 op/s 2024-04-26T22:52:00.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:00 smithi196 ceph-mon[32572]: pgmap v21327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:00.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:00 smithi110 ceph-mon[28069]: pgmap v21327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:00.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:00 smithi193 ceph-mon[32782]: pgmap v21327: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:02 smithi196 ceph-mon[32572]: pgmap v21328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39837.662095 secs 2024-04-26T22:52:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:02 smithi110 ceph-mon[28069]: pgmap v21328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39837.662095 secs 2024-04-26T22:52:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:02 smithi193 ceph-mon[32782]: pgmap v21328: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39837.662095 secs 2024-04-26T22:52:04.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:04 smithi196 ceph-mon[32572]: pgmap v21329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:04.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:04 smithi110 ceph-mon[28069]: pgmap v21329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:04.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:04 smithi193 ceph-mon[32782]: pgmap v21329: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:06.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:06 smithi196 ceph-mon[32572]: pgmap v21330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:06.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:06 smithi110 ceph-mon[28069]: pgmap v21330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:06.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:06 smithi193 ceph-mon[32782]: pgmap v21330: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:52:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39842.662212 secs 2024-04-26T22:52:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39842.662212 secs 2024-04-26T22:52:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39842.662212 secs 2024-04-26T22:52:08.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:08 smithi196 ceph-mon[32572]: pgmap v21331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:52:08.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:08 smithi110 ceph-mon[28069]: pgmap v21331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:52:08.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:08 smithi193 ceph-mon[32782]: pgmap v21331: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:52:10.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:10 smithi196 ceph-mon[32572]: pgmap v21332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:10.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:10 smithi110 ceph-mon[28069]: pgmap v21332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:10.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:10 smithi193 ceph-mon[32782]: pgmap v21332: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:12 smithi196 ceph-mon[32572]: pgmap v21333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:12.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39847.662327 secs 2024-04-26T22:52:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:12 smithi110 ceph-mon[28069]: pgmap v21333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:12.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39847.662327 secs 2024-04-26T22:52:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:12 smithi193 ceph-mon[32782]: pgmap v21333: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39847.662327 secs 2024-04-26T22:52:14.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:14 smithi196 ceph-mon[32572]: pgmap v21334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:14.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:14 smithi110 ceph-mon[28069]: pgmap v21334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:14.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:14 smithi193 ceph-mon[32782]: pgmap v21334: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:16.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:16 smithi196 ceph-mon[32572]: pgmap v21335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:16.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:16 smithi110 ceph-mon[28069]: pgmap v21335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:16.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:16 smithi193 ceph-mon[32782]: pgmap v21335: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39852.662480 secs 2024-04-26T22:52:17.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39852.662480 secs 2024-04-26T22:52:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39852.662480 secs 2024-04-26T22:52:18.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:18 smithi196 ceph-mon[32572]: pgmap v21336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:18.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:18 smithi110 ceph-mon[28069]: pgmap v21336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:18.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:18 smithi193 ceph-mon[32782]: pgmap v21336: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:20.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:20 smithi110 ceph-mon[28069]: pgmap v21337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:20.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:20 smithi193 ceph-mon[32782]: pgmap v21337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:20 smithi196 ceph-mon[32572]: pgmap v21337: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:22 smithi110 ceph-mon[28069]: pgmap v21338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39857.662623 secs 2024-04-26T22:52:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:22 smithi193 ceph-mon[32782]: pgmap v21338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39857.662623 secs 2024-04-26T22:52:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:22 smithi196 ceph-mon[32572]: pgmap v21338: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39857.662623 secs 2024-04-26T22:52:24.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:24 smithi110 ceph-mon[28069]: pgmap v21339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:24.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:24 smithi193 ceph-mon[32782]: pgmap v21339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:24 smithi196 ceph-mon[32572]: pgmap v21339: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:26.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:26 smithi110 ceph-mon[28069]: pgmap v21340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:26.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:26 smithi193 ceph-mon[32782]: pgmap v21340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:26 smithi196 ceph-mon[32572]: pgmap v21340: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39862.662743 secs 2024-04-26T22:52:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39862.662743 secs 2024-04-26T22:52:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39862.662743 secs 2024-04-26T22:52:28.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:28 smithi110 ceph-mon[28069]: pgmap v21341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:28.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:28 smithi193 ceph-mon[32782]: pgmap v21341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:28 smithi196 ceph-mon[32572]: pgmap v21341: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:30.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:30 smithi110 ceph-mon[28069]: pgmap v21342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:30.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:30 smithi193 ceph-mon[32782]: pgmap v21342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:31.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:30 smithi196 ceph-mon[32572]: pgmap v21342: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:32 smithi193 ceph-mon[32782]: pgmap v21343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39867.662863 secs 2024-04-26T22:52:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:32 smithi196 ceph-mon[32572]: pgmap v21343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39867.662863 secs 2024-04-26T22:52:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:32 smithi110 ceph-mon[28069]: pgmap v21343: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39867.662863 secs 2024-04-26T22:52:34.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:34 smithi193 ceph-mon[32782]: pgmap v21344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:34 smithi196 ceph-mon[32572]: pgmap v21344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:34 smithi110 ceph-mon[28069]: pgmap v21344: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:36.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:36 smithi193 ceph-mon[32782]: pgmap v21345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:52:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:36 smithi196 ceph-mon[32572]: pgmap v21345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:52:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:36 smithi110 ceph-mon[28069]: pgmap v21345: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:52:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39872.662942 secs 2024-04-26T22:52:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39872.662942 secs 2024-04-26T22:52:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39872.662942 secs 2024-04-26T22:52:38.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:38 smithi193 ceph-mon[32782]: pgmap v21346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:52:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:38 smithi196 ceph-mon[32572]: pgmap v21346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:52:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:38 smithi110 ceph-mon[28069]: pgmap v21346: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:52:40.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:40 smithi193 ceph-mon[32782]: pgmap v21347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:40 smithi196 ceph-mon[32572]: pgmap v21347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:40 smithi110 ceph-mon[28069]: pgmap v21347: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:42.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:42 smithi110 ceph-mon[28069]: pgmap v21348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:52:42.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39877.663017 secs 2024-04-26T22:52:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:42 smithi193 ceph-mon[32782]: pgmap v21348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:52:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39877.663017 secs 2024-04-26T22:52:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:42 smithi196 ceph-mon[32572]: pgmap v21348: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-04-26T22:52:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39877.663017 secs 2024-04-26T22:52:44.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:44 smithi193 ceph-mon[32782]: pgmap v21349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:44 smithi196 ceph-mon[32572]: pgmap v21349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:44 smithi110 ceph-mon[28069]: pgmap v21349: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:46.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:46 smithi193 ceph-mon[32782]: pgmap v21350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:46 smithi196 ceph-mon[32572]: pgmap v21350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:46 smithi110 ceph-mon[28069]: pgmap v21350: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39882.663154 secs 2024-04-26T22:52:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39882.663154 secs 2024-04-26T22:52:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39882.663154 secs 2024-04-26T22:52:48.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:48 smithi193 ceph-mon[32782]: pgmap v21351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:48 smithi196 ceph-mon[32572]: pgmap v21351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:48 smithi110 ceph-mon[28069]: pgmap v21351: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:50.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:50 smithi193 ceph-mon[32782]: pgmap v21352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:50 smithi196 ceph-mon[32572]: pgmap v21352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:50 smithi110 ceph-mon[28069]: pgmap v21352: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:52 smithi193 ceph-mon[32782]: pgmap v21353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39887.663269 secs 2024-04-26T22:52:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:52 smithi196 ceph-mon[32572]: pgmap v21353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39887.663269 secs 2024-04-26T22:52:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:52 smithi110 ceph-mon[28069]: pgmap v21353: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39887.663269 secs 2024-04-26T22:52:54.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:54 smithi193 ceph-mon[32782]: pgmap v21354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:54 smithi196 ceph-mon[32572]: pgmap v21354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:54 smithi110 ceph-mon[28069]: pgmap v21354: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:52:56.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:56 smithi193 ceph-mon[32782]: pgmap v21355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:56 smithi196 ceph-mon[32572]: pgmap v21355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:56 smithi110 ceph-mon[28069]: pgmap v21355: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39892.663405 secs 2024-04-26T22:52:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:57 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:52:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39892.663405 secs 2024-04-26T22:52:58.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:57 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:52:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39892.663405 secs 2024-04-26T22:52:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:57 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:52:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:58 smithi196 ceph-mon[32572]: pgmap v21356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:52:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:58 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:52:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:58 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:52:59.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:58 smithi193 ceph-mon[32782]: pgmap v21356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:59.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:52:59.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:58 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:52:59.023 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:58 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:52:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:58 smithi110 ceph-mon[28069]: pgmap v21356: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:52:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:52:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:58 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:52:59.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:58 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:53:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:59 smithi196 ceph-mon[32572]: pgmap v21357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:53:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:52:59 smithi196 ceph-mon[32572]: pgmap v21358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:59 smithi110 ceph-mon[28069]: pgmap v21357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:53:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:52:59 smithi110 ceph-mon[28069]: pgmap v21358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:59 smithi193 ceph-mon[32782]: pgmap v21357: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T22:53:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:52:59 smithi193 ceph-mon[32782]: pgmap v21358: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:01 smithi196 ceph-mon[32572]: pgmap v21359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:02.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:01 smithi110 ceph-mon[28069]: pgmap v21359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:01 smithi193 ceph-mon[32782]: pgmap v21359: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39897.663523 secs 2024-04-26T22:53:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39897.663523 secs 2024-04-26T22:53:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39897.663523 secs 2024-04-26T22:53:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:03 smithi196 ceph-mon[32572]: pgmap v21360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:03 smithi110 ceph-mon[28069]: pgmap v21360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:03 smithi193 ceph-mon[32782]: pgmap v21360: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:05 smithi196 ceph-mon[32572]: pgmap v21361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:05 smithi110 ceph-mon[28069]: pgmap v21361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:05 smithi193 ceph-mon[32782]: pgmap v21361: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:07 smithi196 ceph-mon[32572]: pgmap v21362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39902.663636 secs 2024-04-26T22:53:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:07 smithi110 ceph-mon[28069]: pgmap v21362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39902.663636 secs 2024-04-26T22:53:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:07 smithi193 ceph-mon[32782]: pgmap v21362: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:53:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39902.663636 secs 2024-04-26T22:53:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:09 smithi196 ceph-mon[32572]: pgmap v21363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:53:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:09 smithi110 ceph-mon[28069]: pgmap v21363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:53:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:09 smithi193 ceph-mon[32782]: pgmap v21363: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:53:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:11 smithi196 ceph-mon[32572]: pgmap v21364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:11 smithi110 ceph-mon[28069]: pgmap v21364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:11 smithi193 ceph-mon[32782]: pgmap v21364: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:12.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39907.663696 secs 2024-04-26T22:53:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39907.663696 secs 2024-04-26T22:53:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39907.663696 secs 2024-04-26T22:53:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:13 smithi196 ceph-mon[32572]: pgmap v21365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:13 smithi110 ceph-mon[28069]: pgmap v21365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:13 smithi193 ceph-mon[32782]: pgmap v21365: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:15 smithi196 ceph-mon[32572]: pgmap v21366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:15 smithi110 ceph-mon[28069]: pgmap v21366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:15 smithi193 ceph-mon[32782]: pgmap v21366: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:17 smithi196 ceph-mon[32572]: pgmap v21367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39912.663849 secs 2024-04-26T22:53:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:17 smithi110 ceph-mon[28069]: pgmap v21367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39912.663849 secs 2024-04-26T22:53:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:17 smithi193 ceph-mon[32782]: pgmap v21367: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39912.663849 secs 2024-04-26T22:53:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:19 smithi196 ceph-mon[32572]: pgmap v21368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:19 smithi110 ceph-mon[28069]: pgmap v21368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:19 smithi193 ceph-mon[32782]: pgmap v21368: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:21 smithi196 ceph-mon[32572]: pgmap v21369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:21 smithi110 ceph-mon[28069]: pgmap v21369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:21 smithi193 ceph-mon[32782]: pgmap v21369: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39917.663930 secs 2024-04-26T22:53:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39917.663930 secs 2024-04-26T22:53:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39917.663930 secs 2024-04-26T22:53:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:23 smithi196 ceph-mon[32572]: pgmap v21370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:24.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:23 smithi110 ceph-mon[28069]: pgmap v21370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:23 smithi193 ceph-mon[32782]: pgmap v21370: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:25 smithi196 ceph-mon[32572]: pgmap v21371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:25 smithi110 ceph-mon[28069]: pgmap v21371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:25 smithi193 ceph-mon[32782]: pgmap v21371: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:27 smithi196 ceph-mon[32572]: pgmap v21372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39922.664047 secs 2024-04-26T22:53:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:27 smithi110 ceph-mon[28069]: pgmap v21372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39922.664047 secs 2024-04-26T22:53:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:27 smithi193 ceph-mon[32782]: pgmap v21372: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39922.664047 secs 2024-04-26T22:53:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:29 smithi196 ceph-mon[32572]: pgmap v21373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:29 smithi110 ceph-mon[28069]: pgmap v21373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:29 smithi193 ceph-mon[32782]: pgmap v21373: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:31 smithi110 ceph-mon[28069]: pgmap v21374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:31 smithi193 ceph-mon[32782]: pgmap v21374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:31 smithi196 ceph-mon[32572]: pgmap v21374: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39927.664141 secs 2024-04-26T22:53:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39927.664141 secs 2024-04-26T22:53:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39927.664141 secs 2024-04-26T22:53:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:33 smithi110 ceph-mon[28069]: pgmap v21375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:33 smithi193 ceph-mon[32782]: pgmap v21375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:33 smithi196 ceph-mon[32572]: pgmap v21375: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:35 smithi110 ceph-mon[28069]: pgmap v21376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:35 smithi193 ceph-mon[32782]: pgmap v21376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:35 smithi196 ceph-mon[32572]: pgmap v21376: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:37 smithi110 ceph-mon[28069]: pgmap v21377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39932.664283 secs 2024-04-26T22:53:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:37 smithi193 ceph-mon[32782]: pgmap v21377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39932.664283 secs 2024-04-26T22:53:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:37 smithi196 ceph-mon[32572]: pgmap v21377: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39932.664283 secs 2024-04-26T22:53:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:39 smithi110 ceph-mon[28069]: pgmap v21378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:39 smithi193 ceph-mon[32782]: pgmap v21378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:39 smithi196 ceph-mon[32572]: pgmap v21378: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:41 smithi110 ceph-mon[28069]: pgmap v21379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:42.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:41 smithi196 ceph-mon[32572]: pgmap v21379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:41 smithi193 ceph-mon[32782]: pgmap v21379: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39937.664403 secs 2024-04-26T22:53:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39937.664403 secs 2024-04-26T22:53:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39937.664403 secs 2024-04-26T22:53:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:43 smithi193 ceph-mon[32782]: pgmap v21380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:43 smithi196 ceph-mon[32572]: pgmap v21380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:43 smithi110 ceph-mon[28069]: pgmap v21380: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:45 smithi193 ceph-mon[32782]: pgmap v21381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:45 smithi196 ceph-mon[32572]: pgmap v21381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:45 smithi110 ceph-mon[28069]: pgmap v21381: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:47 smithi193 ceph-mon[32782]: pgmap v21382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39942.664537 secs 2024-04-26T22:53:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:47 smithi196 ceph-mon[32572]: pgmap v21382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39942.664537 secs 2024-04-26T22:53:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:47 smithi110 ceph-mon[28069]: pgmap v21382: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39942.664537 secs 2024-04-26T22:53:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:49 smithi193 ceph-mon[32782]: pgmap v21383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:49 smithi196 ceph-mon[32572]: pgmap v21383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:49 smithi110 ceph-mon[28069]: pgmap v21383: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:51 smithi193 ceph-mon[32782]: pgmap v21384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:51 smithi196 ceph-mon[32572]: pgmap v21384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:51 smithi110 ceph-mon[28069]: pgmap v21384: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39947.664663 secs 2024-04-26T22:53:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39947.664663 secs 2024-04-26T22:53:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39947.664663 secs 2024-04-26T22:53:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:53 smithi193 ceph-mon[32782]: pgmap v21385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:53 smithi196 ceph-mon[32572]: pgmap v21385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:53 smithi110 ceph-mon[28069]: pgmap v21385: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:55 smithi193 ceph-mon[32782]: pgmap v21386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:55 smithi196 ceph-mon[32572]: pgmap v21386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:55 smithi110 ceph-mon[28069]: pgmap v21386: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:57 smithi193 ceph-mon[32782]: pgmap v21387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39952.664786 secs 2024-04-26T22:53:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:57 smithi196 ceph-mon[32572]: pgmap v21387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39952.664786 secs 2024-04-26T22:53:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:57 smithi110 ceph-mon[28069]: pgmap v21387: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:53:58.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39952.664786 secs 2024-04-26T22:53:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:58 smithi193 ceph-mon[32782]: pgmap v21388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:58 smithi196 ceph-mon[32572]: pgmap v21388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:53:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:58 smithi110 ceph-mon[28069]: pgmap v21388: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:53:59 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:54:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:53:59 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:54:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:53:59 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:54:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:54:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:00 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:54:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:00 smithi193 ceph-mon[32782]: pgmap v21389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:54:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:00 smithi193 ceph-mon[32782]: pgmap v21390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:00 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:54:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:54:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:00 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:54:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:00 smithi196 ceph-mon[32572]: pgmap v21389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:54:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:00 smithi196 ceph-mon[32572]: pgmap v21390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:01.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:00 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:54:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:54:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:00 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:54:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:00 smithi110 ceph-mon[28069]: pgmap v21389: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:54:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:00 smithi110 ceph-mon[28069]: pgmap v21390: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:01.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:00 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:54:02.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39957.664846 secs 2024-04-26T22:54:02.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39957.664846 secs 2024-04-26T22:54:02.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39957.664846 secs 2024-04-26T22:54:03.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:03 smithi110 ceph-mon[28069]: pgmap v21391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T22:54:03.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:03 smithi193 ceph-mon[32782]: pgmap v21391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T22:54:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:03 smithi196 ceph-mon[32572]: pgmap v21391: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 531 B/s rd, 1 op/s 2024-04-26T22:54:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:05 smithi110 ceph-mon[28069]: pgmap v21392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:05.622 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:05 smithi193 ceph-mon[32782]: pgmap v21392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:05 smithi196 ceph-mon[32572]: pgmap v21392: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:07 smithi110 ceph-mon[28069]: pgmap v21393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39962.664970 secs 2024-04-26T22:54:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:07 smithi193 ceph-mon[32782]: pgmap v21393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:07.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39962.664970 secs 2024-04-26T22:54:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:07 smithi196 ceph-mon[32572]: pgmap v21393: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:07.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39962.664970 secs 2024-04-26T22:54:09.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:09 smithi193 ceph-mon[32782]: pgmap v21394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:09.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:09 smithi196 ceph-mon[32572]: pgmap v21394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:09.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:09 smithi110 ceph-mon[28069]: pgmap v21394: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:54:11.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:11 smithi193 ceph-mon[32782]: pgmap v21395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:54:11.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:11 smithi196 ceph-mon[32572]: pgmap v21395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:54:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:11 smithi110 ceph-mon[28069]: pgmap v21395: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:54:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39967.665101 secs 2024-04-26T22:54:12.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39967.665101 secs 2024-04-26T22:54:12.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39967.665101 secs 2024-04-26T22:54:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:13 smithi193 ceph-mon[32782]: pgmap v21396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:13.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:13 smithi196 ceph-mon[32572]: pgmap v21396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:13 smithi110 ceph-mon[28069]: pgmap v21396: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:15.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:14 smithi196 ceph-mon[32572]: pgmap v21397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:14 smithi110 ceph-mon[28069]: pgmap v21397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:15.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:14 smithi193 ceph-mon[32782]: pgmap v21397: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:17.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:17 smithi110 ceph-mon[28069]: pgmap v21398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:17.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39972.665240 secs 2024-04-26T22:54:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:17 smithi193 ceph-mon[32782]: pgmap v21398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:17.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39972.665240 secs 2024-04-26T22:54:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:17 smithi196 ceph-mon[32572]: pgmap v21398: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:17.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39972.665240 secs 2024-04-26T22:54:19.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:19 smithi110 ceph-mon[28069]: pgmap v21399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:19.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:19 smithi193 ceph-mon[32782]: pgmap v21399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:19.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:19 smithi196 ceph-mon[32572]: pgmap v21399: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:20.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:54:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:54:19.741+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:54:20.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:54:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:54:19.741+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:54:20.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:54:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:54:19.741+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:54:20.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:54:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:54:19.741+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:54:20.041 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:54:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:54:19.741+0000 7f1b4f600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:54:21.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:21 smithi193 ceph-mon[32782]: pgmap v21400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:21 smithi196 ceph-mon[32572]: pgmap v21400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:21 smithi110 ceph-mon[28069]: pgmap v21400: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39977.665356 secs 2024-04-26T22:54:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39977.665356 secs 2024-04-26T22:54:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39977.665356 secs 2024-04-26T22:54:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:54:23.022+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063b0 con 0x7f261c104b50 2024-04-26T22:54:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:54:23.022+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:54:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:54:23.023+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 307 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:54:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:54:23.023+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 307 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063b0 con 0x55db1be4fdd0 2024-04-26T22:54:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:23 smithi193 ceph-mon[32782]: pgmap v21401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:23 smithi196 ceph-mon[32572]: pgmap v21401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:23 smithi110 ceph-mon[28069]: pgmap v21401: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:25.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:25 smithi193 ceph-mon[32782]: pgmap v21402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:25 smithi196 ceph-mon[32572]: pgmap v21402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:25 smithi110 ceph-mon[28069]: pgmap v21402: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:27 smithi193 ceph-mon[32782]: pgmap v21403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:27.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39982.665474 secs 2024-04-26T22:54:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:27 smithi196 ceph-mon[32572]: pgmap v21403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39982.665474 secs 2024-04-26T22:54:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:27 smithi110 ceph-mon[28069]: pgmap v21403: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39982.665474 secs 2024-04-26T22:54:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:29 smithi193 ceph-mon[32782]: pgmap v21404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:29 smithi196 ceph-mon[32572]: pgmap v21404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:29 smithi110 ceph-mon[28069]: pgmap v21404: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:31.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:31 smithi193 ceph-mon[32782]: pgmap v21405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:31 smithi196 ceph-mon[32572]: pgmap v21405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:31 smithi110 ceph-mon[28069]: pgmap v21405: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:32.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39987.665588 secs 2024-04-26T22:54:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39987.665588 secs 2024-04-26T22:54:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39987.665588 secs 2024-04-26T22:54:33.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:33 smithi193 ceph-mon[32782]: pgmap v21406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:33 smithi196 ceph-mon[32572]: pgmap v21406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:33 smithi110 ceph-mon[28069]: pgmap v21406: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:35.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:35 smithi193 ceph-mon[32782]: pgmap v21407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:35 smithi196 ceph-mon[32572]: pgmap v21407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:35 smithi110 ceph-mon[28069]: pgmap v21407: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T22:54:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:37 smithi193 ceph-mon[32782]: pgmap v21408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39992.665707 secs 2024-04-26T22:54:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:37 smithi196 ceph-mon[32572]: pgmap v21408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39992.665707 secs 2024-04-26T22:54:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:37 smithi110 ceph-mon[28069]: pgmap v21408: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39992.665707 secs 2024-04-26T22:54:39.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:39 smithi193 ceph-mon[32782]: pgmap v21409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:39 smithi196 ceph-mon[32572]: pgmap v21409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:39 smithi110 ceph-mon[28069]: pgmap v21409: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:41.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:41 smithi193 ceph-mon[32782]: pgmap v21410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:41 smithi196 ceph-mon[32572]: pgmap v21410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:41 smithi110 ceph-mon[28069]: pgmap v21410: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:42.655 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 39997.665779 secs 2024-04-26T22:54:42.692 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 39997.665779 secs 2024-04-26T22:54:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 39997.665779 secs 2024-04-26T22:54:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:43 smithi196 ceph-mon[32572]: pgmap v21411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:43 smithi110 ceph-mon[28069]: pgmap v21411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:43 smithi193 ceph-mon[32782]: pgmap v21411: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:45 smithi196 ceph-mon[32572]: pgmap v21412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:45 smithi110 ceph-mon[28069]: pgmap v21412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:45 smithi193 ceph-mon[32782]: pgmap v21412: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:47 smithi196 ceph-mon[32572]: pgmap v21413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40002.665909 secs 2024-04-26T22:54:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:47 smithi110 ceph-mon[28069]: pgmap v21413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40002.665909 secs 2024-04-26T22:54:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:47 smithi193 ceph-mon[32782]: pgmap v21413: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40002.665909 secs 2024-04-26T22:54:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:49 smithi196 ceph-mon[32572]: pgmap v21414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:49 smithi110 ceph-mon[28069]: pgmap v21414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:49 smithi193 ceph-mon[32782]: pgmap v21414: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:51 smithi196 ceph-mon[32572]: pgmap v21415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:51 smithi110 ceph-mon[28069]: pgmap v21415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:51 smithi193 ceph-mon[32782]: pgmap v21415: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40007.666039 secs 2024-04-26T22:54:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40007.666039 secs 2024-04-26T22:54:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40007.666039 secs 2024-04-26T22:54:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:53 smithi196 ceph-mon[32572]: pgmap v21416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:53 smithi110 ceph-mon[28069]: pgmap v21416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:53 smithi193 ceph-mon[32782]: pgmap v21416: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:55 smithi196 ceph-mon[32572]: pgmap v21417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:55 smithi110 ceph-mon[28069]: pgmap v21417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:55 smithi193 ceph-mon[32782]: pgmap v21417: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:57 smithi196 ceph-mon[32572]: pgmap v21418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40012.666143 secs 2024-04-26T22:54:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:57 smithi110 ceph-mon[28069]: pgmap v21418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40012.666143 secs 2024-04-26T22:54:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:57 smithi193 ceph-mon[32782]: pgmap v21418: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:54:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40012.666143 secs 2024-04-26T22:54:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:54:59 smithi196 ceph-mon[32572]: pgmap v21419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:54:59 smithi110 ceph-mon[28069]: pgmap v21419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:54:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:54:59 smithi193 ceph-mon[32782]: pgmap v21419: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:01 smithi196 ceph-mon[32572]: pgmap v21420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:01 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:55:01.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:01 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:55:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:01 smithi110 ceph-mon[28069]: pgmap v21420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:01 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:55:01.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:01 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:55:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:01 smithi193 ceph-mon[32782]: pgmap v21420: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:01 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:55:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:01 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:55:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:02 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:55:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40017.666234 secs 2024-04-26T22:55:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:02 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:55:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40017.666234 secs 2024-04-26T22:55:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:02 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:55:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40017.666234 secs 2024-04-26T22:55:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:03 smithi196 ceph-mon[32572]: pgmap v21421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:55:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:55:03.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:03 smithi196 ceph-mon[32572]: pgmap v21422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:03 smithi196 ceph-mon[32572]: pgmap v21423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:03.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:55:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:03 smithi110 ceph-mon[28069]: pgmap v21421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:55:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:55:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:03 smithi110 ceph-mon[28069]: pgmap v21422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:03 smithi110 ceph-mon[28069]: pgmap v21423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:03.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:55:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:03 smithi193 ceph-mon[32782]: pgmap v21421: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:55:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:55:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:03 smithi193 ceph-mon[32782]: pgmap v21422: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:03 smithi193 ceph-mon[32782]: pgmap v21423: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:55:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:05 smithi196 ceph-mon[32572]: pgmap v21424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:05 smithi110 ceph-mon[28069]: pgmap v21424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:05 smithi193 ceph-mon[32782]: pgmap v21424: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:07 smithi196 ceph-mon[32572]: pgmap v21425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:55:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40022.666315 secs 2024-04-26T22:55:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:07 smithi110 ceph-mon[28069]: pgmap v21425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:55:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40022.666315 secs 2024-04-26T22:55:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:07 smithi193 ceph-mon[32782]: pgmap v21425: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T22:55:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40022.666315 secs 2024-04-26T22:55:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:09 smithi196 ceph-mon[32572]: pgmap v21426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:09 smithi110 ceph-mon[28069]: pgmap v21426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:09 smithi193 ceph-mon[32782]: pgmap v21426: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:11 smithi110 ceph-mon[28069]: pgmap v21427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:11 smithi193 ceph-mon[32782]: pgmap v21427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:11 smithi196 ceph-mon[32572]: pgmap v21427: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:55:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40027.666430 secs 2024-04-26T22:55:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40027.666430 secs 2024-04-26T22:55:13.156 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40027.666430 secs 2024-04-26T22:55:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:13 smithi110 ceph-mon[28069]: pgmap v21428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:55:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:13 smithi193 ceph-mon[32782]: pgmap v21428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:55:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:13 smithi196 ceph-mon[32572]: pgmap v21428: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:55:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:15 smithi110 ceph-mon[28069]: pgmap v21429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:15 smithi193 ceph-mon[32782]: pgmap v21429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:15 smithi196 ceph-mon[32572]: pgmap v21429: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:17 smithi110 ceph-mon[28069]: pgmap v21430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:17 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 40032.666547 secs 2024-04-26T22:55:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:17 smithi110 ceph-mon[28069]: slow request 5760.081616 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:55:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:17 smithi193 ceph-mon[32782]: pgmap v21430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:17 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 40032.666547 secs 2024-04-26T22:55:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:17 smithi193 ceph-mon[32782]: slow request 5760.081616 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:55:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:17 smithi196 ceph-mon[32572]: pgmap v21430: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:17 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 40032.666547 secs 2024-04-26T22:55:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:17 smithi196 ceph-mon[32572]: slow request 5760.081616 seconds old, received at 2024-04-26T21:19:16.883254+0000: client_request(client.27265:1 getattr pAsLsXsFs #0x1 2024-04-26T21:19:16.878226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:55:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:19 smithi110 ceph-mon[28069]: pgmap v21431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:19 smithi193 ceph-mon[32782]: pgmap v21431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:20.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:19 smithi196 ceph-mon[32572]: pgmap v21431: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:21 smithi193 ceph-mon[32782]: pgmap v21432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:21 smithi196 ceph-mon[32572]: pgmap v21432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:21 smithi110 ceph-mon[28069]: pgmap v21432: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40037.666583 secs 2024-04-26T22:55:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40037.666583 secs 2024-04-26T22:55:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40037.666583 secs 2024-04-26T22:55:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:23 smithi193 ceph-mon[32782]: pgmap v21433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:23 smithi196 ceph-mon[32572]: pgmap v21433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:23 smithi110 ceph-mon[28069]: pgmap v21433: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:25 smithi193 ceph-mon[32782]: pgmap v21434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:25 smithi196 ceph-mon[32572]: pgmap v21434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:25 smithi110 ceph-mon[28069]: pgmap v21434: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:27 smithi193 ceph-mon[32782]: pgmap v21435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40042.666707 secs 2024-04-26T22:55:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:27 smithi196 ceph-mon[32572]: pgmap v21435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40042.666707 secs 2024-04-26T22:55:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:27 smithi110 ceph-mon[28069]: pgmap v21435: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40042.666707 secs 2024-04-26T22:55:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:29 smithi193 ceph-mon[32782]: pgmap v21436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:29 smithi196 ceph-mon[32572]: pgmap v21436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:29 smithi110 ceph-mon[28069]: pgmap v21436: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:31 smithi193 ceph-mon[32782]: pgmap v21437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:31 smithi196 ceph-mon[32572]: pgmap v21437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:31 smithi110 ceph-mon[28069]: pgmap v21437: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40047.666816 secs 2024-04-26T22:55:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40047.666816 secs 2024-04-26T22:55:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40047.666816 secs 2024-04-26T22:55:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:33 smithi193 ceph-mon[32782]: pgmap v21438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:33 smithi196 ceph-mon[32572]: pgmap v21438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:33 smithi110 ceph-mon[28069]: pgmap v21438: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:35 smithi193 ceph-mon[32782]: pgmap v21439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:35 smithi196 ceph-mon[32572]: pgmap v21439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:35 smithi110 ceph-mon[28069]: pgmap v21439: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:37 smithi193 ceph-mon[32782]: pgmap v21440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40052.666968 secs 2024-04-26T22:55:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:37 smithi196 ceph-mon[32572]: pgmap v21440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40052.666968 secs 2024-04-26T22:55:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:37 smithi110 ceph-mon[28069]: pgmap v21440: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40052.666968 secs 2024-04-26T22:55:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:39 smithi193 ceph-mon[32782]: pgmap v21441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:39 smithi196 ceph-mon[32572]: pgmap v21441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:39 smithi110 ceph-mon[28069]: pgmap v21441: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:41 smithi193 ceph-mon[32782]: pgmap v21442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:41 smithi196 ceph-mon[32572]: pgmap v21442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:41 smithi110 ceph-mon[28069]: pgmap v21442: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40057.667091 secs 2024-04-26T22:55:43.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40057.667091 secs 2024-04-26T22:55:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40057.667091 secs 2024-04-26T22:55:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:43 smithi193 ceph-mon[32782]: pgmap v21443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:43 smithi196 ceph-mon[32572]: pgmap v21443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:43 smithi110 ceph-mon[28069]: pgmap v21443: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:44 smithi196 ceph-mon[32572]: pgmap v21444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:45.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:44 smithi110 ceph-mon[28069]: pgmap v21444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:45.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:44 smithi193 ceph-mon[32782]: pgmap v21444: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:47 smithi110 ceph-mon[28069]: pgmap v21445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40062.667217 secs 2024-04-26T22:55:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:47 smithi193 ceph-mon[32782]: pgmap v21445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40062.667217 secs 2024-04-26T22:55:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:47 smithi196 ceph-mon[32572]: pgmap v21445: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40062.667217 secs 2024-04-26T22:55:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:49 smithi110 ceph-mon[28069]: pgmap v21446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:49 smithi193 ceph-mon[32782]: pgmap v21446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:49 smithi196 ceph-mon[32572]: pgmap v21446: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:51 smithi110 ceph-mon[28069]: pgmap v21447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:51 smithi193 ceph-mon[32782]: pgmap v21447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:51 smithi196 ceph-mon[32572]: pgmap v21447: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40067.667352 secs 2024-04-26T22:55:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40067.667352 secs 2024-04-26T22:55:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40067.667352 secs 2024-04-26T22:55:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:53 smithi110 ceph-mon[28069]: pgmap v21448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:53 smithi193 ceph-mon[32782]: pgmap v21448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:53 smithi196 ceph-mon[32572]: pgmap v21448: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:55:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:55 smithi193 ceph-mon[32782]: pgmap v21449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:55 smithi196 ceph-mon[32572]: pgmap v21449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:55 smithi110 ceph-mon[28069]: pgmap v21449: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:57 smithi193 ceph-mon[32782]: pgmap v21450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40072.667473 secs 2024-04-26T22:55:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:57 smithi196 ceph-mon[32572]: pgmap v21450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40072.667473 secs 2024-04-26T22:55:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:57 smithi110 ceph-mon[28069]: pgmap v21450: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:55:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40072.667473 secs 2024-04-26T22:56:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:55:59 smithi193 ceph-mon[32782]: pgmap v21451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:55:59 smithi196 ceph-mon[32572]: pgmap v21451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:55:59 smithi110 ceph-mon[28069]: pgmap v21451: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:01 smithi193 ceph-mon[32782]: pgmap v21452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:01 smithi196 ceph-mon[32572]: pgmap v21452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:01 smithi110 ceph-mon[28069]: pgmap v21452: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:03.125 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40077.667538 secs 2024-04-26T22:56:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40077.667538 secs 2024-04-26T22:56:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40077.667538 secs 2024-04-26T22:56:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:03 smithi193 ceph-mon[32782]: pgmap v21453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:03 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:56:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:03 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:03 smithi196 ceph-mon[32572]: pgmap v21453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:03 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:56:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:03 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:03 smithi110 ceph-mon[28069]: pgmap v21453: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:03 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:56:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:04.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:03 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:56:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:04 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:56:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:04 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:56:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:04 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:56:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:04 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:56:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:04 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:56:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:04 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:56:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:05 smithi193 ceph-mon[32782]: pgmap v21454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:56:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:05 smithi193 ceph-mon[32782]: pgmap v21455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:05 smithi196 ceph-mon[32572]: pgmap v21454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:56:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:05 smithi196 ceph-mon[32572]: pgmap v21455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:05 smithi110 ceph-mon[28069]: pgmap v21454: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 879 B/s rd, 1 op/s 2024-04-26T22:56:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:05 smithi110 ceph-mon[28069]: pgmap v21455: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:07 smithi193 ceph-mon[32782]: pgmap v21456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40082.667663 secs 2024-04-26T22:56:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:07 smithi196 ceph-mon[32572]: pgmap v21456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40082.667663 secs 2024-04-26T22:56:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:07 smithi110 ceph-mon[28069]: pgmap v21456: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:08.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40082.667663 secs 2024-04-26T22:56:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:09 smithi193 ceph-mon[32782]: pgmap v21457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:09 smithi196 ceph-mon[32572]: pgmap v21457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:09 smithi110 ceph-mon[28069]: pgmap v21457: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:11 smithi193 ceph-mon[32782]: pgmap v21458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:11 smithi196 ceph-mon[32572]: pgmap v21458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:11 smithi110 ceph-mon[28069]: pgmap v21458: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:56:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40087.667775 secs 2024-04-26T22:56:13.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40087.667775 secs 2024-04-26T22:56:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40087.667775 secs 2024-04-26T22:56:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:13 smithi193 ceph-mon[32782]: pgmap v21459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:56:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:13 smithi196 ceph-mon[32572]: pgmap v21459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:56:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:13 smithi110 ceph-mon[28069]: pgmap v21459: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-26T22:56:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:15 smithi193 ceph-mon[32782]: pgmap v21460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:56:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:15 smithi196 ceph-mon[32572]: pgmap v21460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:56:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:15 smithi110 ceph-mon[28069]: pgmap v21460: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:56:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:17 smithi196 ceph-mon[32572]: pgmap v21461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:17 smithi196 ceph-mon[32572]: 29 slow requests, 1 included below; oldest blocked for > 40092.667897 secs 2024-04-26T22:56:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:17 smithi196 ceph-mon[32572]: slow request 11522.839809 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:56:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:17 smithi110 ceph-mon[28069]: pgmap v21461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:17 smithi110 ceph-mon[28069]: 29 slow requests, 1 included below; oldest blocked for > 40092.667897 secs 2024-04-26T22:56:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:17 smithi110 ceph-mon[28069]: slow request 11522.839809 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:56:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:17 smithi193 ceph-mon[32782]: pgmap v21461: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:17 smithi193 ceph-mon[32782]: 29 slow requests, 1 included below; oldest blocked for > 40092.667897 secs 2024-04-26T22:56:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:17 smithi193 ceph-mon[32782]: slow request 11522.839809 seconds old, received at 2024-04-26T19:44:14.126411+0000: client_request(client.16851:1 getattr pAsLsXsFs #0x1 2024-04-26T19:44:14.121495+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:56:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:18 smithi196 ceph-mon[32572]: pgmap v21462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:18 smithi110 ceph-mon[28069]: pgmap v21462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:18 smithi193 ceph-mon[32782]: pgmap v21462: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:21.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:21 smithi196 ceph-mon[32572]: pgmap v21463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:21.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:21 smithi110 ceph-mon[28069]: pgmap v21463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:21 smithi193 ceph-mon[32782]: pgmap v21463: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:22.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40097.668042 secs 2024-04-26T22:56:22.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40097.668042 secs 2024-04-26T22:56:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40097.668042 secs 2024-04-26T22:56:23.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:23 smithi196 ceph-mon[32572]: pgmap v21464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:23.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:23 smithi110 ceph-mon[28069]: pgmap v21464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:23 smithi193 ceph-mon[32782]: pgmap v21464: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:25.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:25 smithi196 ceph-mon[32572]: pgmap v21465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:25.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:25 smithi110 ceph-mon[28069]: pgmap v21465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:25 smithi193 ceph-mon[32782]: pgmap v21465: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:27 smithi196 ceph-mon[32572]: pgmap v21466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:27.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40102.668180 secs 2024-04-26T22:56:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:27 smithi110 ceph-mon[28069]: pgmap v21466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:27.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40102.668180 secs 2024-04-26T22:56:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:27 smithi193 ceph-mon[32782]: pgmap v21466: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40102.668180 secs 2024-04-26T22:56:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:29 smithi196 ceph-mon[32572]: pgmap v21467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:29.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:29 smithi110 ceph-mon[28069]: pgmap v21467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:29 smithi193 ceph-mon[32782]: pgmap v21467: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:31.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:31 smithi196 ceph-mon[32572]: pgmap v21468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:31.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:31 smithi110 ceph-mon[28069]: pgmap v21468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:31.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:31 smithi193 ceph-mon[32782]: pgmap v21468: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:32.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40107.668297 secs 2024-04-26T22:56:32.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40107.668297 secs 2024-04-26T22:56:32.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40107.668297 secs 2024-04-26T22:56:33.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:33 smithi196 ceph-mon[32572]: pgmap v21469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:33.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:33 smithi110 ceph-mon[28069]: pgmap v21469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:33.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:33 smithi193 ceph-mon[32782]: pgmap v21469: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:35.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:35 smithi196 ceph-mon[32572]: pgmap v21470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:35.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:35 smithi110 ceph-mon[28069]: pgmap v21470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:35.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:35 smithi193 ceph-mon[32782]: pgmap v21470: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:37 smithi196 ceph-mon[32572]: pgmap v21471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40112.668446 secs 2024-04-26T22:56:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:37 smithi110 ceph-mon[28069]: pgmap v21471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40112.668446 secs 2024-04-26T22:56:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:37 smithi193 ceph-mon[32782]: pgmap v21471: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40112.668446 secs 2024-04-26T22:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:56:38.044+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:56:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:56:38.044+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063b0 con 0x7f261c104b50 2024-04-26T22:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:56:38.045+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 308 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0063b0 con 0x55db1be4fdd0 2024-04-26T22:56:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:56:38.045+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 308 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:56:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:39 smithi196 ceph-mon[32572]: pgmap v21472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:39 smithi110 ceph-mon[28069]: pgmap v21472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:39 smithi193 ceph-mon[32782]: pgmap v21472: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:41 smithi196 ceph-mon[32572]: pgmap v21473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:41 smithi110 ceph-mon[28069]: pgmap v21473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:41 smithi193 ceph-mon[32782]: pgmap v21473: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40117.668595 secs 2024-04-26T22:56:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40117.668595 secs 2024-04-26T22:56:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40117.668595 secs 2024-04-26T22:56:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:43 smithi196 ceph-mon[32572]: pgmap v21474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:43 smithi110 ceph-mon[28069]: pgmap v21474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:43 smithi193 ceph-mon[32782]: pgmap v21474: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:45 smithi196 ceph-mon[32572]: pgmap v21475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:45 smithi110 ceph-mon[28069]: pgmap v21475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:45 smithi193 ceph-mon[32782]: pgmap v21475: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:47 smithi196 ceph-mon[32572]: pgmap v21476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40122.668713 secs 2024-04-26T22:56:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:47 smithi110 ceph-mon[28069]: pgmap v21476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40122.668713 secs 2024-04-26T22:56:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:47 smithi193 ceph-mon[32782]: pgmap v21476: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40122.668713 secs 2024-04-26T22:56:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:49 smithi110 ceph-mon[28069]: pgmap v21477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:49 smithi193 ceph-mon[32782]: pgmap v21477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:49 smithi196 ceph-mon[32572]: pgmap v21477: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:51 smithi110 ceph-mon[28069]: pgmap v21478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:51 smithi193 ceph-mon[32782]: pgmap v21478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:51 smithi196 ceph-mon[32572]: pgmap v21478: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40127.668828 secs 2024-04-26T22:56:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40127.668828 secs 2024-04-26T22:56:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40127.668828 secs 2024-04-26T22:56:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:53 smithi110 ceph-mon[28069]: pgmap v21479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:53 smithi193 ceph-mon[32782]: pgmap v21479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:53 smithi196 ceph-mon[32572]: pgmap v21479: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:56:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:55 smithi110 ceph-mon[28069]: pgmap v21480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:55 smithi193 ceph-mon[32782]: pgmap v21480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:55 smithi196 ceph-mon[32572]: pgmap v21480: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:56:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:57 smithi110 ceph-mon[28069]: pgmap v21481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40132.668959 secs 2024-04-26T22:56:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:57 smithi193 ceph-mon[32782]: pgmap v21481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40132.668959 secs 2024-04-26T22:56:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:57 smithi196 ceph-mon[32572]: pgmap v21481: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:56:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40132.668959 secs 2024-04-26T22:56:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:56:59 smithi193 ceph-mon[32782]: pgmap v21482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:56:59 smithi196 ceph-mon[32572]: pgmap v21482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:56:59 smithi110 ceph-mon[28069]: pgmap v21482: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:01 smithi193 ceph-mon[32782]: pgmap v21483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:01 smithi196 ceph-mon[32572]: pgmap v21483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:01 smithi110 ceph-mon[28069]: pgmap v21483: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40137.669070 secs 2024-04-26T22:57:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40137.669070 secs 2024-04-26T22:57:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40137.669070 secs 2024-04-26T22:57:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:03 smithi193 ceph-mon[32782]: pgmap v21484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:03 smithi196 ceph-mon[32572]: pgmap v21484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:03 smithi110 ceph-mon[28069]: pgmap v21484: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:05 smithi196 ceph-mon[32572]: pgmap v21485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:57:05.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:05 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:57:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:05 smithi193 ceph-mon[32782]: pgmap v21485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:57:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:05 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:57:05.948 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:05 smithi110 ceph-mon[28069]: pgmap v21485: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:57:05.949 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:05 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: pgmap v21486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40142.669141 secs 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:07 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: pgmap v21486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40142.669141 secs 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.043 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:07 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: pgmap v21486: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40142.669141 secs 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:08.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:07 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:08 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:57:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:08 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:57:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:08 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:57:09.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:08 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:57:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:08 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:57:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:08 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:57:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:08 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:57:09.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:08 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:57:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:08 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi193 to 176.2M 2024-04-26T22:57:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:08 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi193 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-04-26T22:57:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:08 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-04-26T22:57:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:08 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi196 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-26T22:57:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:09 smithi196 ceph-mon[32572]: pgmap v21487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:10.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:09 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:09 smithi110 ceph-mon[28069]: pgmap v21487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:10.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:09 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:09 smithi193 ceph-mon[32782]: pgmap v21487: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:10.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:09 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:57:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:57:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:10 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:57:11.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:57:11.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:10 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:57:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:57:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:57:11.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:10 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:57:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:11 smithi196 ceph-mon[32572]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:57:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:11 smithi196 ceph-mon[32572]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:57:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:11 smithi196 ceph-mon[32572]: pgmap v21488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T22:57:12.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:11 smithi196 ceph-mon[32572]: pgmap v21489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:11 smithi110 ceph-mon[28069]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:57:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:11 smithi110 ceph-mon[28069]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:57:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:11 smithi110 ceph-mon[28069]: pgmap v21488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T22:57:12.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:11 smithi110 ceph-mon[28069]: pgmap v21489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:11 smithi193 ceph-mon[32782]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-04-26T22:57:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:11 smithi193 ceph-mon[32782]: Unable to set osd_memory_target on smithi110 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-04-26T22:57:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:11 smithi193 ceph-mon[32782]: pgmap v21488: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 880 B/s rd, 1 op/s 2024-04-26T22:57:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:11 smithi193 ceph-mon[32782]: pgmap v21489: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40147.669240 secs 2024-04-26T22:57:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40147.669240 secs 2024-04-26T22:57:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40147.669240 secs 2024-04-26T22:57:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:13 smithi196 ceph-mon[32572]: pgmap v21490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T22:57:14.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:13 smithi110 ceph-mon[28069]: pgmap v21490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T22:57:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:13 smithi193 ceph-mon[32782]: pgmap v21490: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 532 B/s rd, 1 op/s 2024-04-26T22:57:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:15 smithi110 ceph-mon[28069]: pgmap v21491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:15 smithi193 ceph-mon[32782]: pgmap v21491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:15 smithi196 ceph-mon[32572]: pgmap v21491: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:17 smithi110 ceph-mon[28069]: pgmap v21492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:18.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40152.669383 secs 2024-04-26T22:57:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:17 smithi193 ceph-mon[32782]: pgmap v21492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40152.669383 secs 2024-04-26T22:57:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:17 smithi196 ceph-mon[32572]: pgmap v21492: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40152.669383 secs 2024-04-26T22:57:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:19 smithi110 ceph-mon[28069]: pgmap v21493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:19 smithi193 ceph-mon[32782]: pgmap v21493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:19 smithi196 ceph-mon[32572]: pgmap v21493: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:57:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:21 smithi110 ceph-mon[28069]: pgmap v21494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:57:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:21 smithi193 ceph-mon[32782]: pgmap v21494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:57:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:21 smithi196 ceph-mon[32572]: pgmap v21494: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:57:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40157.669450 secs 2024-04-26T22:57:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:57:23.052+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T22:57:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:57:23.052+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063b0 con 0x7f261c104b50 2024-04-26T22:57:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:57:23.053+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 309 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063b0 con 0x55db1be4fdd0 2024-04-26T22:57:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T22:57:23.053+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 309 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T22:57:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40157.669450 secs 2024-04-26T22:57:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40157.669450 secs 2024-04-26T22:57:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:23 smithi110 ceph-mon[28069]: pgmap v21495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:23 smithi193 ceph-mon[32782]: pgmap v21495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:23 smithi196 ceph-mon[32572]: pgmap v21495: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:25 smithi193 ceph-mon[32782]: pgmap v21496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:26.152 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:25 smithi110 ceph-mon[28069]: pgmap v21496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:25 smithi196 ceph-mon[32572]: pgmap v21496: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:27 smithi193 ceph-mon[32782]: pgmap v21497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40162.669585 secs 2024-04-26T22:57:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:27 smithi196 ceph-mon[32572]: pgmap v21497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40162.669585 secs 2024-04-26T22:57:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:27 smithi110 ceph-mon[28069]: pgmap v21497: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40162.669585 secs 2024-04-26T22:57:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:29 smithi193 ceph-mon[32782]: pgmap v21498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:29 smithi196 ceph-mon[32572]: pgmap v21498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:29 smithi110 ceph-mon[28069]: pgmap v21498: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:31 smithi193 ceph-mon[32782]: pgmap v21499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:31 smithi196 ceph-mon[32572]: pgmap v21499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:31 smithi110 ceph-mon[28069]: pgmap v21499: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40167.669724 secs 2024-04-26T22:57:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40167.669724 secs 2024-04-26T22:57:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40167.669724 secs 2024-04-26T22:57:34.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:33 smithi193 ceph-mon[32782]: pgmap v21500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:33 smithi196 ceph-mon[32572]: pgmap v21500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:33 smithi110 ceph-mon[28069]: pgmap v21500: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:35 smithi193 ceph-mon[32782]: pgmap v21501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:35 smithi196 ceph-mon[32572]: pgmap v21501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:36.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:35 smithi110 ceph-mon[28069]: pgmap v21501: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:37 smithi193 ceph-mon[32782]: pgmap v21502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40172.669806 secs 2024-04-26T22:57:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:37 smithi196 ceph-mon[32572]: pgmap v21502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40172.669806 secs 2024-04-26T22:57:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:37 smithi110 ceph-mon[28069]: pgmap v21502: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40172.669806 secs 2024-04-26T22:57:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:39 smithi193 ceph-mon[32782]: pgmap v21503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:39 smithi196 ceph-mon[32572]: pgmap v21503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:39 smithi110 ceph-mon[28069]: pgmap v21503: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:42.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:41 smithi110 ceph-mon[28069]: pgmap v21504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:41 smithi193 ceph-mon[32782]: pgmap v21504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:41 smithi196 ceph-mon[32572]: pgmap v21504: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40177.669889 secs 2024-04-26T22:57:43.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40177.669889 secs 2024-04-26T22:57:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40177.669889 secs 2024-04-26T22:57:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:43 smithi193 ceph-mon[32782]: pgmap v21505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:43 smithi196 ceph-mon[32572]: pgmap v21505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:43 smithi110 ceph-mon[28069]: pgmap v21505: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:45 smithi193 ceph-mon[32782]: pgmap v21506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:45 smithi196 ceph-mon[32572]: pgmap v21506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:45 smithi110 ceph-mon[28069]: pgmap v21506: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:47 smithi193 ceph-mon[32782]: pgmap v21507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40182.670012 secs 2024-04-26T22:57:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:47 smithi196 ceph-mon[32572]: pgmap v21507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40182.670012 secs 2024-04-26T22:57:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:47 smithi110 ceph-mon[28069]: pgmap v21507: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40182.670012 secs 2024-04-26T22:57:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:49 smithi193 ceph-mon[32782]: pgmap v21508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:50.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:49 smithi196 ceph-mon[32572]: pgmap v21508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:49 smithi110 ceph-mon[28069]: pgmap v21508: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:51 smithi196 ceph-mon[32572]: pgmap v21509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:51 smithi110 ceph-mon[28069]: pgmap v21509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:51 smithi193 ceph-mon[32782]: pgmap v21509: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40187.670131 secs 2024-04-26T22:57:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40187.670131 secs 2024-04-26T22:57:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40187.670131 secs 2024-04-26T22:57:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:53 smithi196 ceph-mon[32572]: pgmap v21510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:53 smithi110 ceph-mon[28069]: pgmap v21510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:53 smithi193 ceph-mon[32782]: pgmap v21510: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:55 smithi196 ceph-mon[32572]: pgmap v21511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:55 smithi110 ceph-mon[28069]: pgmap v21511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:55 smithi193 ceph-mon[32782]: pgmap v21511: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:56 smithi196 ceph-mon[32572]: pgmap v21512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:56 smithi110 ceph-mon[28069]: pgmap v21512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:56 smithi193 ceph-mon[32782]: pgmap v21512: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:57:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40192.670227 secs 2024-04-26T22:57:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40192.670227 secs 2024-04-26T22:57:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40192.670227 secs 2024-04-26T22:57:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:57:58 smithi196 ceph-mon[32572]: pgmap v21513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:59.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:57:58 smithi193 ceph-mon[32782]: pgmap v21513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:57:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:57:58 smithi110 ceph-mon[28069]: pgmap v21513: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:01 smithi193 ceph-mon[32782]: pgmap v21514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:01.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:01 smithi196 ceph-mon[32572]: pgmap v21514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:01.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:01 smithi110 ceph-mon[28069]: pgmap v21514: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:03 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40197.670315 secs 2024-04-26T22:58:03.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:03 smithi193 ceph-mon[32782]: pgmap v21515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:03 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40197.670315 secs 2024-04-26T22:58:03.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:03 smithi196 ceph-mon[32572]: pgmap v21515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:03.542 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:03 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40197.670315 secs 2024-04-26T22:58:03.543 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:03 smithi110 ceph-mon[28069]: pgmap v21515: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:05 smithi193 ceph-mon[32782]: pgmap v21516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:05.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:05 smithi196 ceph-mon[32572]: pgmap v21516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:05.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:05 smithi110 ceph-mon[28069]: pgmap v21516: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:07 smithi193 ceph-mon[32782]: pgmap v21517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:07.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:07 smithi196 ceph-mon[32572]: pgmap v21517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:07.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:07 smithi110 ceph-mon[28069]: pgmap v21517: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:08 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40202.670438 secs 2024-04-26T22:58:08.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:08 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40202.670438 secs 2024-04-26T22:58:08.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:08 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40202.670438 secs 2024-04-26T22:58:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:09 smithi193 ceph-mon[32782]: pgmap v21518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:09.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:09 smithi196 ceph-mon[32572]: pgmap v21518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:09.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:09 smithi110 ceph-mon[28069]: pgmap v21518: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:11 smithi193 ceph-mon[32782]: pgmap v21519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:11 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:58:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:11 smithi196 ceph-mon[32572]: pgmap v21519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:11.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:11 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:58:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:11 smithi110 ceph-mon[28069]: pgmap v21519: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:11.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:11 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:58:12.442 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:58:12.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:58:12.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:12 smithi110 ceph-mon[28069]: pgmap v21520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T22:58:12.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:12 smithi110 ceph-mon[28069]: pgmap v21521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:12.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:12 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:58:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:58:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:58:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:12 smithi196 ceph-mon[32572]: pgmap v21520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T22:58:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:12 smithi196 ceph-mon[32572]: pgmap v21521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:12.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:12 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:58:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:58:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:58:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:12 smithi193 ceph-mon[32782]: pgmap v21520: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 882 B/s rd, 1 op/s 2024-04-26T22:58:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:12 smithi193 ceph-mon[32782]: pgmap v21521: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:12.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:12 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:58:13.405 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:13 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40207.670549 secs 2024-04-26T22:58:13.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:13 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40207.670549 secs 2024-04-26T22:58:13.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:13 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40207.670549 secs 2024-04-26T22:58:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:14 smithi196 ceph-mon[32572]: pgmap v21522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:14.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:14 smithi110 ceph-mon[28069]: pgmap v21522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:14.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:14 smithi193 ceph-mon[32782]: pgmap v21522: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:16 smithi196 ceph-mon[32572]: pgmap v21523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:16 smithi110 ceph-mon[28069]: pgmap v21523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:16 smithi193 ceph-mon[32782]: pgmap v21523: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40212.670644 secs 2024-04-26T22:58:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40212.670644 secs 2024-04-26T22:58:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40212.670644 secs 2024-04-26T22:58:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:18 smithi196 ceph-mon[32572]: pgmap v21524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:18 smithi110 ceph-mon[28069]: pgmap v21524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:18 smithi193 ceph-mon[32782]: pgmap v21524: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:21.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:20 smithi196 ceph-mon[32572]: pgmap v21525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:20 smithi110 ceph-mon[28069]: pgmap v21525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:20 smithi193 ceph-mon[32782]: pgmap v21525: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:58:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:22 smithi196 ceph-mon[32572]: pgmap v21526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:58:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:22 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40217.670755 secs 2024-04-26T22:58:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:22 smithi110 ceph-mon[28069]: pgmap v21526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:58:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:22 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40217.670755 secs 2024-04-26T22:58:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:22 smithi193 ceph-mon[32782]: pgmap v21526: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T22:58:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:22 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40217.670755 secs 2024-04-26T22:58:25.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:24 smithi196 ceph-mon[32572]: pgmap v21527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:25.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:24 smithi110 ceph-mon[28069]: pgmap v21527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:24 smithi193 ceph-mon[32782]: pgmap v21527: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:27.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:26 smithi196 ceph-mon[32572]: pgmap v21528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:27.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:26 smithi110 ceph-mon[28069]: pgmap v21528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:26 smithi193 ceph-mon[32782]: pgmap v21528: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:27 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40222.670875 secs 2024-04-26T22:58:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:27 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40222.670875 secs 2024-04-26T22:58:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:27 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40222.670875 secs 2024-04-26T22:58:29.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:28 smithi196 ceph-mon[32572]: pgmap v21529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:29.022 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:28 smithi193 ceph-mon[32782]: pgmap v21529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:29.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:28 smithi110 ceph-mon[28069]: pgmap v21529: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:29 smithi196 ceph-mon[32572]: pgmap v21530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:29 smithi110 ceph-mon[28069]: pgmap v21530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:29 smithi193 ceph-mon[32782]: pgmap v21530: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:32 smithi196 ceph-mon[32572]: pgmap v21531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:32 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40227.670989 secs 2024-04-26T22:58:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:32 smithi110 ceph-mon[28069]: pgmap v21531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:33.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:32 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40227.670989 secs 2024-04-26T22:58:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:32 smithi193 ceph-mon[32782]: pgmap v21531: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:32 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40227.670989 secs 2024-04-26T22:58:35.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:34 smithi196 ceph-mon[32572]: pgmap v21532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:35.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:34 smithi110 ceph-mon[28069]: pgmap v21532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:34 smithi193 ceph-mon[32782]: pgmap v21532: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:37.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:36 smithi196 ceph-mon[32572]: pgmap v21533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:37.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:36 smithi110 ceph-mon[28069]: pgmap v21533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:37.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:36 smithi193 ceph-mon[32782]: pgmap v21533: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:37 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40232.671088 secs 2024-04-26T22:58:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:37 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40232.671088 secs 2024-04-26T22:58:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:37 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40232.671088 secs 2024-04-26T22:58:39.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:38 smithi196 ceph-mon[32572]: pgmap v21534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:39.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:38 smithi110 ceph-mon[28069]: pgmap v21534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:38 smithi193 ceph-mon[32782]: pgmap v21534: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:40 smithi196 ceph-mon[32572]: pgmap v21535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:40 smithi110 ceph-mon[28069]: pgmap v21535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:40 smithi193 ceph-mon[32782]: pgmap v21535: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:42 smithi196 ceph-mon[32572]: pgmap v21536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:42 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40237.671187 secs 2024-04-26T22:58:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:42 smithi110 ceph-mon[28069]: pgmap v21536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:42 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40237.671187 secs 2024-04-26T22:58:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:42 smithi193 ceph-mon[32782]: pgmap v21536: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:42 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40237.671187 secs 2024-04-26T22:58:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:44 smithi196 ceph-mon[32572]: pgmap v21537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:44 smithi110 ceph-mon[28069]: pgmap v21537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:44 smithi193 ceph-mon[32782]: pgmap v21537: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:46 smithi196 ceph-mon[32572]: pgmap v21538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:46 smithi110 ceph-mon[28069]: pgmap v21538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:46 smithi193 ceph-mon[32782]: pgmap v21538: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:47 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40242.671314 secs 2024-04-26T22:58:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:47 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40242.671314 secs 2024-04-26T22:58:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:47 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40242.671314 secs 2024-04-26T22:58:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:48 smithi196 ceph-mon[32572]: pgmap v21539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:48 smithi110 ceph-mon[28069]: pgmap v21539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:48 smithi193 ceph-mon[32782]: pgmap v21539: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:50 smithi110 ceph-mon[28069]: pgmap v21540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:50 smithi193 ceph-mon[32782]: pgmap v21540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:50 smithi196 ceph-mon[32572]: pgmap v21540: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:52 smithi110 ceph-mon[28069]: pgmap v21541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:53.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:52 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40247.671428 secs 2024-04-26T22:58:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:52 smithi193 ceph-mon[32782]: pgmap v21541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:52 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40247.671428 secs 2024-04-26T22:58:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:52 smithi196 ceph-mon[32572]: pgmap v21541: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:52 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40247.671428 secs 2024-04-26T22:58:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:54 smithi110 ceph-mon[28069]: pgmap v21542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:54 smithi193 ceph-mon[32782]: pgmap v21542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:54 smithi196 ceph-mon[32572]: pgmap v21542: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:57.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:56 smithi110 ceph-mon[28069]: pgmap v21543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:56 smithi193 ceph-mon[32782]: pgmap v21543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:56 smithi196 ceph-mon[32572]: pgmap v21543: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:58:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:57 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40252.671555 secs 2024-04-26T22:58:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:57 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40252.671555 secs 2024-04-26T22:58:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:57 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40252.671555 secs 2024-04-26T22:58:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:58:58 smithi110 ceph-mon[28069]: pgmap v21544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:58:58 smithi193 ceph-mon[32782]: pgmap v21544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:58:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:58:58 smithi196 ceph-mon[32572]: pgmap v21544: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:00 smithi110 ceph-mon[28069]: pgmap v21545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:00 smithi193 ceph-mon[32782]: pgmap v21545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:00 smithi196 ceph-mon[32572]: pgmap v21545: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:02 smithi193 ceph-mon[32782]: pgmap v21546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:02 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40257.671675 secs 2024-04-26T22:59:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:02 smithi196 ceph-mon[32572]: pgmap v21546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:02 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40257.671675 secs 2024-04-26T22:59:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:02 smithi110 ceph-mon[28069]: pgmap v21546: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:02 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40257.671675 secs 2024-04-26T22:59:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:04 smithi193 ceph-mon[32782]: pgmap v21547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:04 smithi196 ceph-mon[32572]: pgmap v21547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:04 smithi110 ceph-mon[28069]: pgmap v21547: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:06 smithi193 ceph-mon[32782]: pgmap v21548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:06 smithi196 ceph-mon[32572]: pgmap v21548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:06 smithi110 ceph-mon[28069]: pgmap v21548: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:07 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40262.671795 secs 2024-04-26T22:59:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:07 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40262.671795 secs 2024-04-26T22:59:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:07 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40262.671795 secs 2024-04-26T22:59:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:08 smithi193 ceph-mon[32782]: pgmap v21549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:08 smithi196 ceph-mon[32572]: pgmap v21549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:08 smithi110 ceph-mon[28069]: pgmap v21549: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:10 smithi193 ceph-mon[32782]: pgmap v21550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:10 smithi196 ceph-mon[32572]: pgmap v21550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:10 smithi110 ceph-mon[28069]: pgmap v21550: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:13.092 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:12 smithi110 ceph-mon[28069]: pgmap v21551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:13.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:12 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:59:13.093 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:12 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40267.671874 secs 2024-04-26T22:59:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:12 smithi193 ceph-mon[32782]: pgmap v21551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:12 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:59:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:12 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40267.671874 secs 2024-04-26T22:59:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:12 smithi196 ceph-mon[32572]: pgmap v21551: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:12 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:59:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:12 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40267.671874 secs 2024-04-26T22:59:15.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:14 smithi196 ceph-mon[32572]: pgmap v21552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:15.044 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:14 smithi193 ceph-mon[32782]: pgmap v21552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:15.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:14 smithi110 ceph-mon[28069]: pgmap v21552: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:16 smithi193 ceph-mon[32782]: pgmap v21553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:59:17.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:16 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:59:17.123 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:16 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:16 smithi196 ceph-mon[32572]: pgmap v21553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:59:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:16 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:59:17.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:16 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:16 smithi110 ceph-mon[28069]: pgmap v21553: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:59:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:16 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:59:17.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:16 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T22:59:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:17 smithi193 ceph-mon[32782]: pgmap v21554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 947 B/s rd, 1 op/s 2024-04-26T22:59:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:17 smithi193 ceph-mon[32782]: pgmap v21555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 581 B/s rd, 1 op/s 2024-04-26T22:59:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:17 smithi193 ceph-mon[32782]: 29 slow requests, 0 included below; oldest blocked for > 40272.671970 secs 2024-04-26T22:59:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:17 smithi196 ceph-mon[32572]: pgmap v21554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 947 B/s rd, 1 op/s 2024-04-26T22:59:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:17 smithi196 ceph-mon[32572]: pgmap v21555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 581 B/s rd, 1 op/s 2024-04-26T22:59:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:17 smithi196 ceph-mon[32572]: 29 slow requests, 0 included below; oldest blocked for > 40272.671970 secs 2024-04-26T22:59:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:17 smithi110 ceph-mon[28069]: pgmap v21554: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 947 B/s rd, 1 op/s 2024-04-26T22:59:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:17 smithi110 ceph-mon[28069]: pgmap v21555: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 581 B/s rd, 1 op/s 2024-04-26T22:59:18.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:17 smithi110 ceph-mon[28069]: 29 slow requests, 0 included below; oldest blocked for > 40272.671970 secs 2024-04-26T22:59:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:19 smithi193 ceph-mon[32782]: pgmap v21556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:59:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:19 smithi196 ceph-mon[32572]: pgmap v21556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:59:20.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:19 smithi110 ceph-mon[28069]: pgmap v21556: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:59:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:59:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:59:19.809+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:59:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:59:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:59:19.809+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:59:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:59:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:59:19.809+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:59:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:59:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:59:19.809+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:59:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 22:59:19 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T22:59:19.809+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:59:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:21 smithi193 ceph-mon[32782]: pgmap v21557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:59:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:21 smithi196 ceph-mon[32572]: pgmap v21557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:59:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:21 smithi110 ceph-mon[28069]: pgmap v21557: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:59:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:22 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40277.672084 secs 2024-04-26T22:59:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:22 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40277.672084 secs 2024-04-26T22:59:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:22 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40277.672084 secs 2024-04-26T22:59:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:23 smithi193 ceph-mon[32782]: pgmap v21558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 116 B/s wr, 1 op/s 2024-04-26T22:59:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T22:59:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:23 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T22:59:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:23 smithi196 ceph-mon[32572]: pgmap v21558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 116 B/s wr, 1 op/s 2024-04-26T22:59:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T22:59:24.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:23 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T22:59:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:23 smithi110 ceph-mon[28069]: pgmap v21558: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 116 B/s wr, 1 op/s 2024-04-26T22:59:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T22:59:24.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:23 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T22:59:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:25 smithi193 ceph-mon[32782]: pgmap v21559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 232 B/s wr, 2 op/s 2024-04-26T22:59:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:25 smithi196 ceph-mon[32572]: pgmap v21559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 232 B/s wr, 2 op/s 2024-04-26T22:59:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:25 smithi110 ceph-mon[28069]: pgmap v21559: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 232 B/s wr, 2 op/s 2024-04-26T22:59:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:27 smithi196 ceph-mon[32572]: pgmap v21560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T22:59:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:27 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40282.672203 secs 2024-04-26T22:59:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:27 smithi110 ceph-mon[28069]: pgmap v21560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T22:59:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:27 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40282.672203 secs 2024-04-26T22:59:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:27 smithi193 ceph-mon[32782]: pgmap v21560: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-04-26T22:59:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:27 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40282.672203 secs 2024-04-26T22:59:30.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:29 smithi193 ceph-mon[32782]: pgmap v21561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:59:30.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:29 smithi196 ceph-mon[32572]: pgmap v21561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:59:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:29 smithi110 ceph-mon[28069]: pgmap v21561: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:59:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:31 smithi196 ceph-mon[32572]: pgmap v21562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:59:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:31 smithi110 ceph-mon[28069]: pgmap v21562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:59:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:31 smithi193 ceph-mon[32782]: pgmap v21562: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-26T22:59:33.259 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:32 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40287.672334 secs 2024-04-26T22:59:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:32 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40287.672334 secs 2024-04-26T22:59:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:32 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40287.672334 secs 2024-04-26T22:59:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:33 smithi196 ceph-mon[32572]: pgmap v21563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:59:34.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:33 smithi110 ceph-mon[28069]: pgmap v21563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:59:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:33 smithi193 ceph-mon[32782]: pgmap v21563: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-26T22:59:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:35 smithi196 ceph-mon[32572]: pgmap v21564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-04-26T22:59:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:35 smithi110 ceph-mon[28069]: pgmap v21564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-04-26T22:59:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:35 smithi193 ceph-mon[32782]: pgmap v21564: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 2 op/s 2024-04-26T22:59:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:37 smithi196 ceph-mon[32572]: pgmap v21565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:37 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40292.672452 secs 2024-04-26T22:59:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:37 smithi110 ceph-mon[28069]: pgmap v21565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:38.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:37 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40292.672452 secs 2024-04-26T22:59:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:37 smithi193 ceph-mon[32782]: pgmap v21565: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:37 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40292.672452 secs 2024-04-26T22:59:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:39 smithi196 ceph-mon[32572]: pgmap v21566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:39 smithi110 ceph-mon[28069]: pgmap v21566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:39 smithi193 ceph-mon[32782]: pgmap v21566: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:40 smithi196 ceph-mon[32572]: pgmap v21567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:40 smithi110 ceph-mon[28069]: pgmap v21567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:41.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:40 smithi193 ceph-mon[32782]: pgmap v21567: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:42.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:42 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40297.672586 secs 2024-04-26T22:59:42.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:42 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40297.672586 secs 2024-04-26T22:59:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:42 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40297.672586 secs 2024-04-26T22:59:43.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:43 smithi110 ceph-mon[28069]: pgmap v21568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:43.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:43 smithi193 ceph-mon[32782]: pgmap v21568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:43 smithi196 ceph-mon[32572]: pgmap v21568: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:45 smithi110 ceph-mon[28069]: pgmap v21569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:59:45.828 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:45 smithi196 ceph-mon[32572]: pgmap v21569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:59:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:45 smithi193 ceph-mon[32782]: pgmap v21569: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:59:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:47 smithi110 ceph-mon[28069]: pgmap v21570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:47 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40302.672698 secs 2024-04-26T22:59:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:47 smithi193 ceph-mon[32782]: pgmap v21570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:47 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40302.672698 secs 2024-04-26T22:59:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:47 smithi196 ceph-mon[32572]: pgmap v21570: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:47 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40302.672698 secs 2024-04-26T22:59:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:49 smithi193 ceph-mon[32782]: pgmap v21571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:50.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:49 smithi196 ceph-mon[32572]: pgmap v21571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:49 smithi110 ceph-mon[28069]: pgmap v21571: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:51 smithi193 ceph-mon[32782]: pgmap v21572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:52.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:51 smithi196 ceph-mon[32572]: pgmap v21572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:51 smithi110 ceph-mon[28069]: pgmap v21572: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:52 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40307.672812 secs 2024-04-26T22:59:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:52 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40307.672812 secs 2024-04-26T22:59:53.042 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:52 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40307.672812 secs 2024-04-26T22:59:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:53 smithi193 ceph-mon[32782]: pgmap v21573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:54.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:53 smithi196 ceph-mon[32572]: pgmap v21573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:54.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:53 smithi110 ceph-mon[28069]: pgmap v21573: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:59:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:55 smithi193 ceph-mon[32782]: pgmap v21574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:59:56.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:55 smithi196 ceph-mon[32572]: pgmap v21574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:59:56.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:55 smithi110 ceph-mon[28069]: pgmap v21574: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T22:59:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:57 smithi193 ceph-mon[32782]: pgmap v21575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:57 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40312.672953 secs 2024-04-26T22:59:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:57 smithi196 ceph-mon[32572]: pgmap v21575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:57 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40312.672953 secs 2024-04-26T22:59:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:57 smithi110 ceph-mon[28069]: pgmap v21575: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T22:59:58.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:57 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40312.672953 secs 2024-04-26T22:59:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 22:59:59 smithi193 ceph-mon[32782]: pgmap v21576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:00.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 22:59:59 smithi196 ceph-mon[32572]: pgmap v21576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:00.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 22:59:59 smithi110 ceph-mon[28069]: pgmap v21576: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:00.873 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:00 smithi193 ceph-mon[32782]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T23:00:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:00 smithi196 ceph-mon[32572]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T23:00:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:00 smithi110 ceph-mon[28069]: overall HEALTH_WARN 9 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem has a failed mds daemon; 1 MDSs report slow requests 2024-04-26T23:00:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:01 smithi193 ceph-mon[32782]: pgmap v21577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:02.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:01 smithi196 ceph-mon[32572]: pgmap v21577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:02.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:01 smithi110 ceph-mon[28069]: pgmap v21577: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:02 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40317.673089 secs 2024-04-26T23:00:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:02 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40317.673089 secs 2024-04-26T23:00:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:02 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40317.673089 secs 2024-04-26T23:00:03.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:03 smithi193 ceph-mon[32782]: pgmap v21578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:03 smithi196 ceph-mon[32572]: pgmap v21578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:04.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:03 smithi110 ceph-mon[28069]: pgmap v21578: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:05 smithi193 ceph-mon[32782]: pgmap v21579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:00:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:05 smithi196 ceph-mon[32572]: pgmap v21579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:00:06.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:05 smithi110 ceph-mon[28069]: pgmap v21579: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:00:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:07 smithi193 ceph-mon[32782]: pgmap v21580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:07 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40322.673191 secs 2024-04-26T23:00:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:07 smithi196 ceph-mon[32572]: pgmap v21580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:07 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40322.673191 secs 2024-04-26T23:00:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:07 smithi110 ceph-mon[28069]: pgmap v21580: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:07 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40322.673191 secs 2024-04-26T23:00:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:09 smithi196 ceph-mon[32572]: pgmap v21581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:10.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:09 smithi110 ceph-mon[28069]: pgmap v21581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:09 smithi193 ceph-mon[32782]: pgmap v21581: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:11 smithi196 ceph-mon[32572]: pgmap v21582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:12.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:11 smithi110 ceph-mon[28069]: pgmap v21582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:11 smithi193 ceph-mon[32782]: pgmap v21582: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:12 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40327.673293 secs 2024-04-26T23:00:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:12 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40327.673293 secs 2024-04-26T23:00:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:12 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40327.673293 secs 2024-04-26T23:00:13.942 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:13 smithi110 ceph-mon[28069]: pgmap v21583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:13 smithi196 ceph-mon[32572]: pgmap v21583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:13 smithi193 ceph-mon[32782]: pgmap v21583: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:15 smithi196 ceph-mon[32572]: pgmap v21584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:00:16.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:15 smithi110 ceph-mon[28069]: pgmap v21584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:00:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:15 smithi193 ceph-mon[32782]: pgmap v21584: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:00:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:17 smithi196 ceph-mon[32572]: pgmap v21585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:17 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:00:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:17 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40332.673386 secs 2024-04-26T23:00:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:17 smithi110 ceph-mon[28069]: pgmap v21585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:17 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:00:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:17 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40332.673386 secs 2024-04-26T23:00:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:17 smithi193 ceph-mon[32782]: pgmap v21585: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:17 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:00:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:17 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40332.673386 secs 2024-04-26T23:00:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:00:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:00:19.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:18 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:00:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:00:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:00:19.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:18 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:00:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:00:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:00:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:18 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:00:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:19 smithi196 ceph-mon[32572]: pgmap v21586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T23:00:20.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:19 smithi196 ceph-mon[32572]: pgmap v21587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:19 smithi110 ceph-mon[28069]: pgmap v21586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T23:00:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:19 smithi110 ceph-mon[28069]: pgmap v21587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:19 smithi193 ceph-mon[32782]: pgmap v21586: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T23:00:20.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:19 smithi193 ceph-mon[32782]: pgmap v21587: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:22.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:21 smithi196 ceph-mon[32572]: pgmap v21588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:22.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:21 smithi110 ceph-mon[28069]: pgmap v21588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:22.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:21 smithi193 ceph-mon[32782]: pgmap v21588: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:22 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40337.673520 secs 2024-04-26T23:00:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:22 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40337.673520 secs 2024-04-26T23:00:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:00:23.081+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T23:00:23.081 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:00:23.081+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063b0 con 0x7f261c104b50 2024-04-26T23:00:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:00:23.082+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 310 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063b0 con 0x55db1be4fdd0 2024-04-26T23:00:23.082 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:00:23.082+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 310 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T23:00:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:22 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40337.673520 secs 2024-04-26T23:00:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:23 smithi196 ceph-mon[32572]: pgmap v21589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T23:00:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:23 smithi110 ceph-mon[28069]: pgmap v21589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T23:00:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:23 smithi193 ceph-mon[32782]: pgmap v21589: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 533 B/s rd, 1 op/s 2024-04-26T23:00:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:25 smithi196 ceph-mon[32572]: pgmap v21590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:25 smithi110 ceph-mon[28069]: pgmap v21590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:26.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:25 smithi193 ceph-mon[32782]: pgmap v21590: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:27 smithi196 ceph-mon[32572]: pgmap v21591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:27 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40342.673632 secs 2024-04-26T23:00:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:27 smithi110 ceph-mon[28069]: pgmap v21591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:27 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40342.673632 secs 2024-04-26T23:00:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:27 smithi193 ceph-mon[32782]: pgmap v21591: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:00:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:27 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40342.673632 secs 2024-04-26T23:00:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:29 smithi196 ceph-mon[32572]: pgmap v21592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:00:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:29 smithi110 ceph-mon[28069]: pgmap v21592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:00:30.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:29 smithi193 ceph-mon[32782]: pgmap v21592: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:00:32.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:31 smithi196 ceph-mon[32572]: pgmap v21593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:32.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:31 smithi110 ceph-mon[28069]: pgmap v21593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:31 smithi193 ceph-mon[32782]: pgmap v21593: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:33.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:32 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40347.673705 secs 2024-04-26T23:00:33.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:32 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40347.673705 secs 2024-04-26T23:00:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:32 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40347.673705 secs 2024-04-26T23:00:34.006 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:33 smithi196 ceph-mon[32572]: pgmap v21594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:34.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:33 smithi110 ceph-mon[28069]: pgmap v21594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:33 smithi193 ceph-mon[32782]: pgmap v21594: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:36.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:35 smithi196 ceph-mon[32572]: pgmap v21595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:36.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:35 smithi110 ceph-mon[28069]: pgmap v21595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:36.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:35 smithi193 ceph-mon[32782]: pgmap v21595: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:37 smithi196 ceph-mon[32572]: pgmap v21596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:38.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:37 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40352.673832 secs 2024-04-26T23:00:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:37 smithi110 ceph-mon[28069]: pgmap v21596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:38.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:37 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40352.673832 secs 2024-04-26T23:00:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:37 smithi193 ceph-mon[32782]: pgmap v21596: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:37 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40352.673832 secs 2024-04-26T23:00:40.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:39 smithi196 ceph-mon[32572]: pgmap v21597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:40.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:39 smithi110 ceph-mon[28069]: pgmap v21597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:40.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:39 smithi193 ceph-mon[32782]: pgmap v21597: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:42.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:41 smithi196 ceph-mon[32572]: pgmap v21598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:42.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:41 smithi110 ceph-mon[28069]: pgmap v21598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:42.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:41 smithi193 ceph-mon[32782]: pgmap v21598: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:42 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40357.673955 secs 2024-04-26T23:00:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:42 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40357.673955 secs 2024-04-26T23:00:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:42 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40357.673955 secs 2024-04-26T23:00:44.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:43 smithi110 ceph-mon[28069]: pgmap v21599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:44.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:43 smithi193 ceph-mon[32782]: pgmap v21599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:43 smithi196 ceph-mon[32572]: pgmap v21599: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:46.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:45 smithi110 ceph-mon[28069]: pgmap v21600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:46.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:45 smithi196 ceph-mon[32572]: pgmap v21600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:46.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:45 smithi193 ceph-mon[32782]: pgmap v21600: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:47 smithi110 ceph-mon[28069]: pgmap v21601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:48.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:47 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40362.674075 secs 2024-04-26T23:00:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:47 smithi193 ceph-mon[32782]: pgmap v21601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:47 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40362.674075 secs 2024-04-26T23:00:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:47 smithi196 ceph-mon[32572]: pgmap v21601: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:47 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40362.674075 secs 2024-04-26T23:00:50.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:49 smithi110 ceph-mon[28069]: pgmap v21602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:50.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:49 smithi193 ceph-mon[32782]: pgmap v21602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:49 smithi196 ceph-mon[32572]: pgmap v21602: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:52.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:51 smithi110 ceph-mon[28069]: pgmap v21603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:52.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:51 smithi193 ceph-mon[32782]: pgmap v21603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:51 smithi196 ceph-mon[32572]: pgmap v21603: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:52 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40367.674190 secs 2024-04-26T23:00:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:52 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40367.674190 secs 2024-04-26T23:00:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:52 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40367.674190 secs 2024-04-26T23:00:54.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:53 smithi193 ceph-mon[32782]: pgmap v21604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:53 smithi196 ceph-mon[32572]: pgmap v21604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:53 smithi110 ceph-mon[28069]: pgmap v21604: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:56.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:55 smithi193 ceph-mon[32782]: pgmap v21605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:55 smithi196 ceph-mon[32572]: pgmap v21605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:55 smithi110 ceph-mon[28069]: pgmap v21605: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:00:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:57 smithi193 ceph-mon[32782]: pgmap v21606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:57 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40372.674302 secs 2024-04-26T23:00:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:57 smithi196 ceph-mon[32572]: pgmap v21606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:57 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40372.674302 secs 2024-04-26T23:00:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:57 smithi110 ceph-mon[28069]: pgmap v21606: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:00:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:57 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40372.674302 secs 2024-04-26T23:01:00.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:00:59 smithi193 ceph-mon[32782]: pgmap v21607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:00:59 smithi196 ceph-mon[32572]: pgmap v21607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:00:59 smithi110 ceph-mon[28069]: pgmap v21607: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:02.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:01 smithi193 ceph-mon[32782]: pgmap v21608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:01 smithi196 ceph-mon[32572]: pgmap v21608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:01 smithi110 ceph-mon[28069]: pgmap v21608: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:02 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40377.674428 secs 2024-04-26T23:01:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:02 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40377.674428 secs 2024-04-26T23:01:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:02 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40377.674428 secs 2024-04-26T23:01:04.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:03 smithi193 ceph-mon[32782]: pgmap v21609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:04.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:03 smithi196 ceph-mon[32572]: pgmap v21609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:04.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:03 smithi110 ceph-mon[28069]: pgmap v21609: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:06.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:05 smithi193 ceph-mon[32782]: pgmap v21610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:06.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:05 smithi196 ceph-mon[32572]: pgmap v21610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:05 smithi110 ceph-mon[28069]: pgmap v21610: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:07 smithi193 ceph-mon[32782]: pgmap v21611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:07 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40382.674547 secs 2024-04-26T23:01:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:07 smithi196 ceph-mon[32572]: pgmap v21611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:07 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40382.674547 secs 2024-04-26T23:01:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:07 smithi110 ceph-mon[28069]: pgmap v21611: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:07 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40382.674547 secs 2024-04-26T23:01:10.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:09 smithi193 ceph-mon[32782]: pgmap v21612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:09 smithi196 ceph-mon[32572]: pgmap v21612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:09 smithi110 ceph-mon[28069]: pgmap v21612: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:12.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:11 smithi193 ceph-mon[32782]: pgmap v21613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:11 smithi196 ceph-mon[32572]: pgmap v21613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:11 smithi110 ceph-mon[28069]: pgmap v21613: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:12 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40387.674661 secs 2024-04-26T23:01:13.192 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:12 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40387.674661 secs 2024-04-26T23:01:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:12 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40387.674661 secs 2024-04-26T23:01:14.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:13 smithi193 ceph-mon[32782]: pgmap v21614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:13 smithi196 ceph-mon[32572]: pgmap v21614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:13 smithi110 ceph-mon[28069]: pgmap v21614: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:16.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:15 smithi193 ceph-mon[32782]: pgmap v21615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:15 smithi196 ceph-mon[32572]: pgmap v21615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:15 smithi110 ceph-mon[28069]: pgmap v21615: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:17 smithi196 ceph-mon[32572]: pgmap v21616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:18.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:17 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40392.674794 secs 2024-04-26T23:01:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:17 smithi110 ceph-mon[28069]: pgmap v21616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:17 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40392.674794 secs 2024-04-26T23:01:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:17 smithi193 ceph-mon[32782]: pgmap v21616: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:17 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40392.674794 secs 2024-04-26T23:01:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:18 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:01:19.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:18 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:01:19.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:18 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:01:20.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:19 smithi196 ceph-mon[32572]: pgmap v21617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:19 smithi110 ceph-mon[28069]: pgmap v21617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:19 smithi193 ceph-mon[32782]: pgmap v21617: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:22.229 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:21 smithi110 ceph-mon[28069]: pgmap v21618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:21 smithi196 ceph-mon[32572]: pgmap v21618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:21 smithi193 ceph-mon[32782]: pgmap v21618: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:22 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40397.674921 secs 2024-04-26T23:01:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:22 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40397.674921 secs 2024-04-26T23:01:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:22 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40397.674921 secs 2024-04-26T23:01:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:23 smithi196 ceph-mon[32572]: pgmap v21619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:23 smithi110 ceph-mon[28069]: pgmap v21619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:23 smithi193 ceph-mon[32782]: pgmap v21619: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:25 smithi196 ceph-mon[32572]: pgmap v21620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:01:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:01:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:01:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:25 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:01:26.255 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:25 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:01:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:25 smithi110 ceph-mon[28069]: pgmap v21620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:01:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:01:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:01:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:25 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:01:26.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:25 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:01:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:25 smithi193 ceph-mon[32782]: pgmap v21620: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:01:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:01:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:01:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:25 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:01:26.372 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:25 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:01:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:26 smithi196 ceph-mon[32572]: pgmap v21621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 893 B/s rd, 1 op/s 2024-04-26T23:01:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:26 smithi196 ceph-mon[32572]: pgmap v21622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:01:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:26 smithi110 ceph-mon[28069]: pgmap v21621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 893 B/s rd, 1 op/s 2024-04-26T23:01:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:26 smithi110 ceph-mon[28069]: pgmap v21622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:01:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:26 smithi193 ceph-mon[32782]: pgmap v21621: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 893 B/s rd, 1 op/s 2024-04-26T23:01:27.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:26 smithi193 ceph-mon[32782]: pgmap v21622: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:01:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:27 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40402.675025 secs 2024-04-26T23:01:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:27 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40402.675025 secs 2024-04-26T23:01:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:27 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40402.675025 secs 2024-04-26T23:01:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:28 smithi196 ceph-mon[32572]: pgmap v21623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:28 smithi110 ceph-mon[28069]: pgmap v21623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:29.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:28 smithi193 ceph-mon[32782]: pgmap v21623: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:30 smithi196 ceph-mon[32572]: pgmap v21624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:30 smithi110 ceph-mon[28069]: pgmap v21624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:30 smithi193 ceph-mon[32782]: pgmap v21624: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:32 smithi196 ceph-mon[32572]: pgmap v21625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:32 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40407.675167 secs 2024-04-26T23:01:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:32 smithi110 ceph-mon[28069]: pgmap v21625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:32 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40407.675167 secs 2024-04-26T23:01:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:32 smithi193 ceph-mon[32782]: pgmap v21625: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:33.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:32 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40407.675167 secs 2024-04-26T23:01:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:34 smithi196 ceph-mon[32572]: pgmap v21626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:34 smithi110 ceph-mon[28069]: pgmap v21626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:34 smithi193 ceph-mon[32782]: pgmap v21626: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 973 B/s rd, 2 op/s 2024-04-26T23:01:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:35 smithi196 ceph-mon[32572]: pgmap v21627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T23:01:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:35 smithi110 ceph-mon[28069]: pgmap v21627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T23:01:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:35 smithi193 ceph-mon[32782]: pgmap v21627: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 1 op/s 2024-04-26T23:01:37.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:37 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40412.675264 secs 2024-04-26T23:01:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:37 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40412.675264 secs 2024-04-26T23:01:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:37 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40412.675264 secs 2024-04-26T23:01:38.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:38 smithi193 ceph-mon[32782]: pgmap v21628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:38.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:38 smithi196 ceph-mon[32572]: pgmap v21628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:38.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:38 smithi110 ceph-mon[28069]: pgmap v21628: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:41.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:40 smithi196 ceph-mon[32572]: pgmap v21629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:41.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:40 smithi110 ceph-mon[28069]: pgmap v21629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:40 smithi193 ceph-mon[32782]: pgmap v21629: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:42 smithi196 ceph-mon[32572]: pgmap v21630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:43.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:42 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40417.675410 secs 2024-04-26T23:01:43.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:42 smithi110 ceph-mon[28069]: pgmap v21630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:43.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:42 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40417.675410 secs 2024-04-26T23:01:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:42 smithi193 ceph-mon[32782]: pgmap v21630: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:42 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40417.675410 secs 2024-04-26T23:01:45.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:44 smithi196 ceph-mon[32572]: pgmap v21631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:45.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:44 smithi110 ceph-mon[28069]: pgmap v21631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:44 smithi193 ceph-mon[32782]: pgmap v21631: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:47.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:46 smithi196 ceph-mon[32572]: pgmap v21632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:46 smithi110 ceph-mon[28069]: pgmap v21632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:46 smithi193 ceph-mon[32782]: pgmap v21632: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:48.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:47 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40422.675522 secs 2024-04-26T23:01:48.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:47 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40422.675522 secs 2024-04-26T23:01:48.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:47 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40422.675522 secs 2024-04-26T23:01:49.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:48 smithi196 ceph-mon[32572]: pgmap v21633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:49.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:48 smithi110 ceph-mon[28069]: pgmap v21633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:49.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:48 smithi193 ceph-mon[32782]: pgmap v21633: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:51.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:50 smithi196 ceph-mon[32572]: pgmap v21634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:51.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:50 smithi110 ceph-mon[28069]: pgmap v21634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:51.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:50 smithi193 ceph-mon[32782]: pgmap v21634: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:52 smithi196 ceph-mon[32572]: pgmap v21635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:53.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:52 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40427.675612 secs 2024-04-26T23:01:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:52 smithi110 ceph-mon[28069]: pgmap v21635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:53.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:52 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40427.675612 secs 2024-04-26T23:01:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:52 smithi193 ceph-mon[32782]: pgmap v21635: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:53.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:52 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40427.675612 secs 2024-04-26T23:01:55.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:54 smithi196 ceph-mon[32572]: pgmap v21636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:55.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:54 smithi110 ceph-mon[28069]: pgmap v21636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:55.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:54 smithi193 ceph-mon[32782]: pgmap v21636: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:56.955 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:56 smithi110 ceph-mon[28069]: pgmap v21637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:57.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:56 smithi196 ceph-mon[32572]: pgmap v21637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:57.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:56 smithi193 ceph-mon[32782]: pgmap v21637: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:01:58.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:57 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40432.675729 secs 2024-04-26T23:01:58.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:57 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40432.675729 secs 2024-04-26T23:01:58.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:57 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40432.675729 secs 2024-04-26T23:01:59.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:01:58 smithi196 ceph-mon[32572]: pgmap v21638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:59.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:01:58 smithi110 ceph-mon[28069]: pgmap v21638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:59.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:01:58 smithi193 ceph-mon[32782]: pgmap v21638: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:01.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:00 smithi196 ceph-mon[32572]: pgmap v21639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:01.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:00 smithi110 ceph-mon[28069]: pgmap v21639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:01.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:00 smithi193 ceph-mon[32782]: pgmap v21639: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:02 smithi196 ceph-mon[32572]: pgmap v21640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:03.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:02 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40437.675844 secs 2024-04-26T23:02:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:02 smithi110 ceph-mon[28069]: pgmap v21640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:03.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:02 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40437.675844 secs 2024-04-26T23:02:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:02 smithi193 ceph-mon[32782]: pgmap v21640: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:03.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:02 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40437.675844 secs 2024-04-26T23:02:05.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:04 smithi196 ceph-mon[32572]: pgmap v21641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:05.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:04 smithi110 ceph-mon[28069]: pgmap v21641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:05.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:04 smithi193 ceph-mon[32782]: pgmap v21641: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:07.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:06 smithi196 ceph-mon[32572]: pgmap v21642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:07.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:06 smithi110 ceph-mon[28069]: pgmap v21642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:07.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:06 smithi193 ceph-mon[32782]: pgmap v21642: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:07 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40442.675957 secs 2024-04-26T23:02:08.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:07 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40442.675957 secs 2024-04-26T23:02:08.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:07 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40442.675957 secs 2024-04-26T23:02:09.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:08 smithi196 ceph-mon[32572]: pgmap v21643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:09.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:08 smithi110 ceph-mon[28069]: pgmap v21643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:09.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:08 smithi193 ceph-mon[32782]: pgmap v21643: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:11.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:10 smithi196 ceph-mon[32572]: pgmap v21644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:11.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:10 smithi110 ceph-mon[28069]: pgmap v21644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:11.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:10 smithi193 ceph-mon[32782]: pgmap v21644: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:12 smithi196 ceph-mon[32572]: pgmap v21645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:12 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40447.676066 secs 2024-04-26T23:02:13.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:12 smithi110 ceph-mon[28069]: pgmap v21645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:13.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:12 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40447.676066 secs 2024-04-26T23:02:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:12 smithi193 ceph-mon[32782]: pgmap v21645: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:13.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:12 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40447.676066 secs 2024-04-26T23:02:15.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:14 smithi196 ceph-mon[32572]: pgmap v21646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:15.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:14 smithi110 ceph-mon[28069]: pgmap v21646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:15.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:14 smithi193 ceph-mon[32782]: pgmap v21646: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:17.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:16 smithi196 ceph-mon[32572]: pgmap v21647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:17.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:16 smithi110 ceph-mon[28069]: pgmap v21647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:17.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:16 smithi193 ceph-mon[32782]: pgmap v21647: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:18.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:17 smithi110 ceph-mon[28069]: 9 slow requests, 0 included below; oldest blocked for > 40452.676210 secs 2024-04-26T23:02:18.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:17 smithi193 ceph-mon[32782]: 9 slow requests, 0 included below; oldest blocked for > 40452.676210 secs 2024-04-26T23:02:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:17 smithi196 ceph-mon[32572]: 9 slow requests, 0 included below; oldest blocked for > 40452.676210 secs 2024-04-26T23:02:19.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:18 smithi110 ceph-mon[28069]: pgmap v21648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:19.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:18 smithi193 ceph-mon[32782]: pgmap v21648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:19.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:18 smithi196 ceph-mon[32572]: pgmap v21648: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:21.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:20 smithi110 ceph-mon[28069]: pgmap v21649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:21.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:20 smithi193 ceph-mon[32782]: pgmap v21649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:21.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:20 smithi196 ceph-mon[32572]: pgmap v21649: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:22 smithi110 ceph-mon[28069]: pgmap v21650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:22 smithi110 ceph-mon[28069]: 30 slow requests, 1 included below; oldest blocked for > 40457.676326 secs 2024-04-26T23:02:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:22 smithi110 ceph-mon[28069]: slow request 182.157528 seconds old, received at 2024-04-26T22:59:19.817120+0000: client_request(client.27317:1 getattr pAsLsXsFs #0x1 2024-04-26T22:59:19.812447+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:02:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:22 smithi193 ceph-mon[32782]: pgmap v21650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:22 smithi193 ceph-mon[32782]: 30 slow requests, 1 included below; oldest blocked for > 40457.676326 secs 2024-04-26T23:02:23.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:22 smithi193 ceph-mon[32782]: slow request 182.157528 seconds old, received at 2024-04-26T22:59:19.817120+0000: client_request(client.27317:1 getattr pAsLsXsFs #0x1 2024-04-26T22:59:19.812447+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:02:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:22 smithi196 ceph-mon[32572]: pgmap v21650: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:22 smithi196 ceph-mon[32572]: 30 slow requests, 1 included below; oldest blocked for > 40457.676326 secs 2024-04-26T23:02:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:22 smithi196 ceph-mon[32572]: slow request 182.157528 seconds old, received at 2024-04-26T22:59:19.817120+0000: client_request(client.27317:1 getattr pAsLsXsFs #0x1 2024-04-26T22:59:19.812447+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:02:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:23 smithi193 ceph-mon[32782]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T23:02:24.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:23 smithi193 ceph-mon[32782]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T23:02:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:23 smithi196 ceph-mon[32572]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T23:02:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:23 smithi196 ceph-mon[32572]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T23:02:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:23 smithi110 ceph-mon[28069]: mds.? [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] up:active 2024-04-26T23:02:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:23 smithi110 ceph-mon[28069]: fsmap cephfs:2/3 {0=b=up:active,2=g=up:resolve} 1 up:standby-replay, 1 failed 2024-04-26T23:02:25.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:24 smithi193 ceph-mon[32782]: pgmap v21651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:25.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:24 smithi196 ceph-mon[32572]: pgmap v21651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:25.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:24 smithi110 ceph-mon[28069]: pgmap v21651: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:26 smithi193 ceph-mon[32782]: pgmap v21652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:27.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:26 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:02:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:26 smithi196 ceph-mon[32572]: pgmap v21652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:27.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:26 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:02:27.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:26 smithi110 ceph-mon[28069]: pgmap v21652: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:27.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:26 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:02:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:27 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40462.676480 secs 2024-04-26T23:02:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:02:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:27 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:02:28.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:27 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:02:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:27 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40462.676480 secs 2024-04-26T23:02:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:02:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:27 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:02:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:27 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:02:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:27 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40462.676480 secs 2024-04-26T23:02:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:02:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:27 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:02:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:27 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:02:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:28 smithi193 ceph-mon[32782]: pgmap v21653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T23:02:29.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:28 smithi193 ceph-mon[32782]: pgmap v21654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T23:02:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:28 smithi196 ceph-mon[32572]: pgmap v21653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T23:02:29.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:28 smithi196 ceph-mon[32572]: pgmap v21654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T23:02:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:28 smithi110 ceph-mon[28069]: pgmap v21653: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 1 op/s 2024-04-26T23:02:29.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:28 smithi110 ceph-mon[28069]: pgmap v21654: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 536 B/s rd, 1 op/s 2024-04-26T23:02:31.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:30 smithi193 ceph-mon[32782]: pgmap v21655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:30 smithi196 ceph-mon[32572]: pgmap v21655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:30 smithi110 ceph-mon[28069]: pgmap v21655: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:32 smithi193 ceph-mon[32782]: pgmap v21656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:32 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40467.676609 secs 2024-04-26T23:02:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:32 smithi196 ceph-mon[32572]: pgmap v21656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:32 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40467.676609 secs 2024-04-26T23:02:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:32 smithi110 ceph-mon[28069]: pgmap v21656: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:32 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40467.676609 secs 2024-04-26T23:02:35.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:34 smithi193 ceph-mon[32782]: pgmap v21657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:34 smithi196 ceph-mon[32572]: pgmap v21657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:34 smithi110 ceph-mon[28069]: pgmap v21657: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:37.122 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:36 smithi193 ceph-mon[32782]: pgmap v21658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:37.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:36 smithi196 ceph-mon[32572]: pgmap v21658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:37.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:36 smithi110 ceph-mon[28069]: pgmap v21658: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:02:38.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:37 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40472.676735 secs 2024-04-26T23:02:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:37 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40472.676735 secs 2024-04-26T23:02:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:37 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40472.676735 secs 2024-04-26T23:02:39.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:38 smithi193 ceph-mon[32782]: pgmap v21659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:02:39.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:38 smithi196 ceph-mon[32572]: pgmap v21659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:02:39.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:38 smithi110 ceph-mon[28069]: pgmap v21659: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:02:41.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:40 smithi193 ceph-mon[32782]: pgmap v21660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:41.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:40 smithi196 ceph-mon[32572]: pgmap v21660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:41.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:40 smithi110 ceph-mon[28069]: pgmap v21660: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:42 smithi193 ceph-mon[32782]: pgmap v21661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:43.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:42 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40477.676852 secs 2024-04-26T23:02:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:42 smithi196 ceph-mon[32572]: pgmap v21661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:42 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40477.676852 secs 2024-04-26T23:02:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:42 smithi110 ceph-mon[28069]: pgmap v21661: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:42 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40477.676852 secs 2024-04-26T23:02:45.120 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:44 smithi110 ceph-mon[28069]: pgmap v21662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:45.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:44 smithi193 ceph-mon[32782]: pgmap v21662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:45.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:44 smithi196 ceph-mon[32572]: pgmap v21662: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:47.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:46 smithi110 ceph-mon[28069]: pgmap v21663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:47.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:46 smithi193 ceph-mon[32782]: pgmap v21663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:47.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:46 smithi196 ceph-mon[32572]: pgmap v21663: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:47 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40482.677013 secs 2024-04-26T23:02:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:47 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40482.677013 secs 2024-04-26T23:02:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:47 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40482.677013 secs 2024-04-26T23:02:49.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:48 smithi196 ceph-mon[32572]: pgmap v21664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:49.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:48 smithi110 ceph-mon[28069]: pgmap v21664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:49.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:48 smithi193 ceph-mon[32782]: pgmap v21664: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:51.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:50 smithi196 ceph-mon[32572]: pgmap v21665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:51.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:50 smithi110 ceph-mon[28069]: pgmap v21665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:51.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:50 smithi193 ceph-mon[32782]: pgmap v21665: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:52 smithi196 ceph-mon[32572]: pgmap v21666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:52 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40487.677162 secs 2024-04-26T23:02:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:52 smithi110 ceph-mon[28069]: pgmap v21666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:52 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40487.677162 secs 2024-04-26T23:02:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:52 smithi193 ceph-mon[32782]: pgmap v21666: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:52 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40487.677162 secs 2024-04-26T23:02:55.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:54 smithi196 ceph-mon[32572]: pgmap v21667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:55.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:54 smithi110 ceph-mon[28069]: pgmap v21667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:55.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:54 smithi193 ceph-mon[32782]: pgmap v21667: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:57.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:56 smithi196 ceph-mon[32572]: pgmap v21668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:57.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:56 smithi110 ceph-mon[28069]: pgmap v21668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:57.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:56 smithi193 ceph-mon[32782]: pgmap v21668: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:57 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40492.677307 secs 2024-04-26T23:02:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:57 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40492.677307 secs 2024-04-26T23:02:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:57 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40492.677307 secs 2024-04-26T23:02:59.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:02:58 smithi196 ceph-mon[32572]: pgmap v21669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:59.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:02:58 smithi110 ceph-mon[28069]: pgmap v21669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:02:59.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:02:58 smithi193 ceph-mon[32782]: pgmap v21669: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:01.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:00 smithi196 ceph-mon[32572]: pgmap v21670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:01.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:00 smithi110 ceph-mon[28069]: pgmap v21670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:01.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:00 smithi193 ceph-mon[32782]: pgmap v21670: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:03.173 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:02 smithi193 ceph-mon[32782]: pgmap v21671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:03.174 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:02 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40497.677433 secs 2024-04-26T23:03:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:02 smithi196 ceph-mon[32572]: pgmap v21671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:02 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40497.677433 secs 2024-04-26T23:03:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:02 smithi110 ceph-mon[28069]: pgmap v21671: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:03.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:02 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40497.677433 secs 2024-04-26T23:03:05.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:04 smithi196 ceph-mon[32572]: pgmap v21672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:05.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:04 smithi110 ceph-mon[28069]: pgmap v21672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:05.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:04 smithi193 ceph-mon[32782]: pgmap v21672: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:07.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:06 smithi196 ceph-mon[32572]: pgmap v21673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:07.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:06 smithi110 ceph-mon[28069]: pgmap v21673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:07.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:06 smithi193 ceph-mon[32782]: pgmap v21673: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:07 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40502.677578 secs 2024-04-26T23:03:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:07 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40502.677578 secs 2024-04-26T23:03:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:07 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40502.677578 secs 2024-04-26T23:03:09.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:08 smithi196 ceph-mon[32572]: pgmap v21674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:09.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:08 smithi110 ceph-mon[28069]: pgmap v21674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:09.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:08 smithi193 ceph-mon[32782]: pgmap v21674: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:11.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:10 smithi196 ceph-mon[32572]: pgmap v21675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:11.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:10 smithi110 ceph-mon[28069]: pgmap v21675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:11.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:10 smithi193 ceph-mon[32782]: pgmap v21675: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:12 smithi196 ceph-mon[32572]: pgmap v21676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:12 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40507.677723 secs 2024-04-26T23:03:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:12 smithi110 ceph-mon[28069]: pgmap v21676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:12 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40507.677723 secs 2024-04-26T23:03:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:12 smithi193 ceph-mon[32782]: pgmap v21676: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:12 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40507.677723 secs 2024-04-26T23:03:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:14 smithi110 ceph-mon[28069]: pgmap v21677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:14 smithi193 ceph-mon[32782]: pgmap v21677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:14.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:14 smithi196 ceph-mon[32572]: pgmap v21677: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.488+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:03:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.488+0000 7f2612a00640 1 -- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 msgr2=0x55db1bed3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:03:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.488+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:03:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.488+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=READY pgs=531 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T23:03:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.488+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 unknown :-1 s=BANNER_CONNECTING pgs=531 cs=44 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:03:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.489+0000 7f2612a00640 1 --2- 172.21.15.110:0/2875381562 >> [v2:172.21.15.193:6838/64494456,v1:172.21.15.193:6839/64494456] conn(0x55db1bed1920 0x55db1bed3d40 crc :-1 s=READY pgs=531 cs=44 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa67ad8f6fe487f server_cookie=91424e71eb51637f in_seq=0 out_seq=0 2024-04-26T23:03:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.489+0000 7f2608c00640 10 client.16308 ms_handle_connect on v2:172.21.15.193:6838/64494456 2024-04-26T23:03:16.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:16 smithi196 ceph-mon[32572]: pgmap v21678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.528+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T23:03:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.528+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:03:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.528+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2614004010 tx=0x7f2614075000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:03:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.528+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2614004010 tx=0x7f2614075000 comp rx=0 tx=0).stop 2024-04-26T23:03:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.528+0000 7f261be00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.110:6800/2061324969, fault. 2024-04-26T23:03:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.528+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 msgr2=0x7f26000a5170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:03:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.528+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a49b0 0x7f26000a5170 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:03:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.528+0000 7f2618c00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:03:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.529+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:03:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:16.530+0000 7f261be00640 1 --2- 172.21.15.110:0/3398481431 >> [v2:172.21.15.110:6800/2061324969,v1:172.21.15.110:6801/2061324969] conn(0x7f26000a4d90 0x7f26000b4670 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2614004450 tx=0x7f2614037040 comp rx=0 tx=0).ready entity=mgr.25028 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:03:16.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:16 smithi110 ceph-mon[28069]: pgmap v21678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:16.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:16 smithi193 ceph-mon[32782]: pgmap v21678: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:18 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40512.677863 secs 2024-04-26T23:03:18.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:18 smithi196 ceph-mon[32572]: pgmap v21679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:18.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:18 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40512.677863 secs 2024-04-26T23:03:18.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:18 smithi110 ceph-mon[28069]: pgmap v21679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:18 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40512.677863 secs 2024-04-26T23:03:18.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:18 smithi193 ceph-mon[32782]: pgmap v21679: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:20.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:20 smithi196 ceph-mon[32572]: pgmap v21680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:20.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:20 smithi110 ceph-mon[28069]: pgmap v21680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:20.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:20 smithi193 ceph-mon[32782]: pgmap v21680: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:22.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:22 smithi196 ceph-mon[32572]: pgmap v21681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:22.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:22 smithi110 ceph-mon[28069]: pgmap v21681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:22.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:22 smithi193 ceph-mon[32782]: pgmap v21681: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:23.110+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T23:03:23.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:23.110+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f25ec0063b0 con 0x7f261c104b50 2024-04-26T23:03:23.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:23.111+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 311 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f25ec0063b0 con 0x55db1be4fdd0 2024-04-26T23:03:23.112 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:03:23.111+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 311 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T23:03:23.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:23 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40517.677933 secs 2024-04-26T23:03:23.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:23 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40517.677933 secs 2024-04-26T23:03:23.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:23 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40517.677933 secs 2024-04-26T23:03:24.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:24 smithi196 ceph-mon[32572]: pgmap v21682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:24.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:24 smithi110 ceph-mon[28069]: pgmap v21682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:24.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:24 smithi193 ceph-mon[32782]: pgmap v21682: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:26.504 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:26 smithi196 ceph-mon[32572]: pgmap v21683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:26.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:26 smithi110 ceph-mon[28069]: pgmap v21683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:26.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:26 smithi193 ceph-mon[32782]: pgmap v21683: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:28 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40522.678053 secs 2024-04-26T23:03:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:28 smithi110 ceph-mon[28069]: pgmap v21684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:28.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:28 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:03:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:28 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40522.678053 secs 2024-04-26T23:03:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:28 smithi193 ceph-mon[32782]: pgmap v21684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:28.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:28 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:03:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:28 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40522.678053 secs 2024-04-26T23:03:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:28 smithi196 ceph-mon[32572]: pgmap v21684: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:28.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:28 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:03:29.540 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:03:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:03:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:29 smithi110 ceph-mon[28069]: pgmap v21685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T23:03:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:29 smithi110 ceph-mon[28069]: pgmap v21686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:29.541 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:29 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:03:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:03:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:03:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:29 smithi193 ceph-mon[32782]: pgmap v21685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T23:03:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:29 smithi193 ceph-mon[32782]: pgmap v21686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:29.621 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:29 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:03:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:03:29.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:03:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:29 smithi196 ceph-mon[32572]: pgmap v21685: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-26T23:03:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:29 smithi196 ceph-mon[32572]: pgmap v21686: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:29.755 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:29 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:03:32.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:31 smithi193 ceph-mon[32782]: pgmap v21687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:31 smithi196 ceph-mon[32572]: pgmap v21687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:31 smithi110 ceph-mon[28069]: pgmap v21687: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:33.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:32 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40527.678183 secs 2024-04-26T23:03:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:32 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40527.678183 secs 2024-04-26T23:03:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:32 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40527.678183 secs 2024-04-26T23:03:34.121 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:33 smithi193 ceph-mon[32782]: pgmap v21688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:33 smithi196 ceph-mon[32572]: pgmap v21688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:33 smithi110 ceph-mon[28069]: pgmap v21688: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:36.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:35 smithi196 ceph-mon[32572]: pgmap v21689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:36.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:35 smithi110 ceph-mon[28069]: pgmap v21689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:36.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:35 smithi193 ceph-mon[32782]: pgmap v21689: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:37 smithi196 ceph-mon[32572]: pgmap v21690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:38.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:37 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40532.678319 secs 2024-04-26T23:03:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:37 smithi110 ceph-mon[28069]: pgmap v21690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:38.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:37 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40532.678319 secs 2024-04-26T23:03:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:37 smithi193 ceph-mon[32782]: pgmap v21690: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:03:38.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:37 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40532.678319 secs 2024-04-26T23:03:40.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:39 smithi196 ceph-mon[32572]: pgmap v21691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:03:40.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:39 smithi110 ceph-mon[28069]: pgmap v21691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:03:40.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:39 smithi193 ceph-mon[32782]: pgmap v21691: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:03:42.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:41 smithi196 ceph-mon[32572]: pgmap v21692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:42.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:41 smithi110 ceph-mon[28069]: pgmap v21692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:42.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:41 smithi193 ceph-mon[32782]: pgmap v21692: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:43.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:42 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40537.678441 secs 2024-04-26T23:03:43.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:42 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40537.678441 secs 2024-04-26T23:03:43.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:42 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40537.678441 secs 2024-04-26T23:03:44.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:43 smithi196 ceph-mon[32572]: pgmap v21693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:44.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:43 smithi110 ceph-mon[28069]: pgmap v21693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:44.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:43 smithi193 ceph-mon[32782]: pgmap v21693: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:46.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:45 smithi196 ceph-mon[32572]: pgmap v21694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:46.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:45 smithi110 ceph-mon[28069]: pgmap v21694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:46.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:45 smithi193 ceph-mon[32782]: pgmap v21694: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:47 smithi196 ceph-mon[32572]: pgmap v21695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:48.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:47 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40542.678590 secs 2024-04-26T23:03:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:47 smithi110 ceph-mon[28069]: pgmap v21695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:48.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:47 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40542.678590 secs 2024-04-26T23:03:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:47 smithi193 ceph-mon[32782]: pgmap v21695: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:48.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:47 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40542.678590 secs 2024-04-26T23:03:50.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:49 smithi196 ceph-mon[32572]: pgmap v21696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:50.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:49 smithi110 ceph-mon[28069]: pgmap v21696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:50.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:49 smithi193 ceph-mon[32782]: pgmap v21696: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:52.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:51 smithi196 ceph-mon[32572]: pgmap v21697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:52.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:51 smithi110 ceph-mon[28069]: pgmap v21697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:52.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:51 smithi193 ceph-mon[32782]: pgmap v21697: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:53.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:52 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40547.678707 secs 2024-04-26T23:03:53.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:52 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40547.678707 secs 2024-04-26T23:03:53.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:52 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40547.678707 secs 2024-04-26T23:03:54.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:53 smithi196 ceph-mon[32572]: pgmap v21698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:54.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:53 smithi110 ceph-mon[28069]: pgmap v21698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:54.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:53 smithi193 ceph-mon[32782]: pgmap v21698: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:03:56.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:55 smithi196 ceph-mon[32572]: pgmap v21699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:56.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:55 smithi110 ceph-mon[28069]: pgmap v21699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:56.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:55 smithi193 ceph-mon[32782]: pgmap v21699: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:57 smithi196 ceph-mon[32572]: pgmap v21700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:58.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:57 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40552.678832 secs 2024-04-26T23:03:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:57 smithi110 ceph-mon[28069]: pgmap v21700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:58.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:57 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40552.678832 secs 2024-04-26T23:03:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:57 smithi193 ceph-mon[32782]: pgmap v21700: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:03:58.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:57 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40552.678832 secs 2024-04-26T23:04:00.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:03:59 smithi196 ceph-mon[32572]: pgmap v21701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:00.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:03:59 smithi110 ceph-mon[28069]: pgmap v21701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:00.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:03:59 smithi193 ceph-mon[32782]: pgmap v21701: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:02.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:01 smithi196 ceph-mon[32572]: pgmap v21702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:02.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:01 smithi110 ceph-mon[28069]: pgmap v21702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:02.373 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:01 smithi193 ceph-mon[32782]: pgmap v21702: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:02 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40557.678908 secs 2024-04-26T23:04:03.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:02 smithi196 ceph-mon[32572]: pgmap v21703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:03.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:02 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40557.678908 secs 2024-04-26T23:04:03.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:02 smithi193 ceph-mon[32782]: pgmap v21703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:02 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40557.678908 secs 2024-04-26T23:04:03.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:02 smithi110 ceph-mon[28069]: pgmap v21703: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:06.257 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:05 smithi196 ceph-mon[32572]: pgmap v21704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:06.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:05 smithi110 ceph-mon[28069]: pgmap v21704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:06.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:05 smithi193 ceph-mon[32782]: pgmap v21704: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:07 smithi196 ceph-mon[32572]: pgmap v21705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:08.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:07 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40562.678999 secs 2024-04-26T23:04:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:07 smithi110 ceph-mon[28069]: pgmap v21705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:08.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:07 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40562.678999 secs 2024-04-26T23:04:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:07 smithi193 ceph-mon[32782]: pgmap v21705: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:08.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:07 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40562.678999 secs 2024-04-26T23:04:10.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:09 smithi196 ceph-mon[32572]: pgmap v21706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:10.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:09 smithi110 ceph-mon[28069]: pgmap v21706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:10.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:09 smithi193 ceph-mon[32782]: pgmap v21706: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:12.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:11 smithi196 ceph-mon[32572]: pgmap v21707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:12.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:11 smithi110 ceph-mon[28069]: pgmap v21707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:12.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:11 smithi193 ceph-mon[32782]: pgmap v21707: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:13.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:12 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40567.679115 secs 2024-04-26T23:04:13.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:12 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40567.679115 secs 2024-04-26T23:04:13.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:12 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40567.679115 secs 2024-04-26T23:04:14.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:13 smithi196 ceph-mon[32572]: pgmap v21708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:14.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:13 smithi110 ceph-mon[28069]: pgmap v21708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:14.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:13 smithi193 ceph-mon[32782]: pgmap v21708: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:16.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:15 smithi196 ceph-mon[32572]: pgmap v21709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:16.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:15 smithi110 ceph-mon[28069]: pgmap v21709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:16.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:15 smithi193 ceph-mon[32782]: pgmap v21709: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:17 smithi196 ceph-mon[32572]: pgmap v21710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:18.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:17 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40572.679268 secs 2024-04-26T23:04:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:17 smithi110 ceph-mon[28069]: pgmap v21710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:18.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:17 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40572.679268 secs 2024-04-26T23:04:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:17 smithi193 ceph-mon[32782]: pgmap v21710: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:18.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:17 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40572.679268 secs 2024-04-26T23:04:20.253 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:19 smithi196 ceph-mon[32572]: pgmap v21711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:20.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:19 smithi110 ceph-mon[28069]: pgmap v21711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 23:04:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T23:04:20.042+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 23:04:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T23:04:20.042+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 23:04:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T23:04:20.042+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 23:04:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T23:04:20.042+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:20.291 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Apr 26 23:04:20 smithi110 ceph-6e439470-03be-11ef-bc93-c7b262605968-mgr-x[28296]: 2024-04-26T23:04:20.042+0000 7f1b50000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:20.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:19 smithi193 ceph-mon[32782]: pgmap v21711: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:22.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:21 smithi196 ceph-mon[32572]: pgmap v21712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:22.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:21 smithi110 ceph-mon[28069]: pgmap v21712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:22.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:21 smithi193 ceph-mon[32782]: pgmap v21712: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:23.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:22 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40577.679415 secs 2024-04-26T23:04:23.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:22 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40577.679415 secs 2024-04-26T23:04:23.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:22 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40577.679415 secs 2024-04-26T23:04:24.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:23 smithi196 ceph-mon[32572]: pgmap v21713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:24.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:23 smithi110 ceph-mon[28069]: pgmap v21713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:24.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:23 smithi193 ceph-mon[32782]: pgmap v21713: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:26.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:25 smithi196 ceph-mon[32572]: pgmap v21714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:26.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:25 smithi110 ceph-mon[28069]: pgmap v21714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:26.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:25 smithi193 ceph-mon[32782]: pgmap v21714: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:27 smithi196 ceph-mon[32572]: pgmap v21715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:28.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:27 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40582.679513 secs 2024-04-26T23:04:28.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:27 smithi110 ceph-mon[28069]: pgmap v21715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:28.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:27 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40582.679513 secs 2024-04-26T23:04:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:27 smithi193 ceph-mon[32782]: pgmap v21715: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:28.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:27 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40582.679513 secs 2024-04-26T23:04:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:29 smithi196 ceph-mon[32572]: pgmap v21716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:30.005 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:29 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:04:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:29 smithi110 ceph-mon[28069]: pgmap v21716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:30.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:29 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:04:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:29 smithi193 ceph-mon[32782]: pgmap v21716: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 170 B/s wr, 13 op/s 2024-04-26T23:04:30.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:29 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:04:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:04:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:30 smithi196 ceph-mon[32572]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:04:31.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:30 smithi196 ceph-mon[32572]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:04:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:04:31.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:30 smithi110 ceph-mon[28069]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:04:31.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:30 smithi110 ceph-mon[28069]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:04:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:04:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:30 smithi193 ceph-mon[32782]: from='mgr.25028 172.21.15.110:0/994888996' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:04:31.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:30 smithi193 ceph-mon[32782]: from='mgr.25028 ' entity='mgr.x' 2024-04-26T23:04:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:31 smithi196 ceph-mon[32572]: pgmap v21717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 177 B/s wr, 13 op/s 2024-04-26T23:04:32.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:31 smithi196 ceph-mon[32572]: pgmap v21718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T23:04:32.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:31 smithi110 ceph-mon[28069]: pgmap v21717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 177 B/s wr, 13 op/s 2024-04-26T23:04:32.291 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:31 smithi110 ceph-mon[28069]: pgmap v21718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T23:04:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:31 smithi193 ceph-mon[32782]: pgmap v21717: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 177 B/s wr, 13 op/s 2024-04-26T23:04:32.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:31 smithi193 ceph-mon[32782]: pgmap v21718: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 214 B/s wr, 16 op/s 2024-04-26T23:04:33.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:32 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40587.679579 secs 2024-04-26T23:04:33.272 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:32 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40587.679579 secs 2024-04-26T23:04:33.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:32 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40587.679579 secs 2024-04-26T23:04:34.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:33 smithi196 ceph-mon[32572]: pgmap v21719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T23:04:34.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:33 smithi110 ceph-mon[28069]: pgmap v21719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T23:04:34.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:33 smithi193 ceph-mon[32782]: pgmap v21719: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 537 B/s rd, 1 op/s 2024-04-26T23:04:35.254 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:34 smithi196 ceph-mon[32572]: pgmap v21720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:04:35.290 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:34 smithi110 ceph-mon[28069]: pgmap v21720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:04:35.371 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:34 smithi193 ceph-mon[32782]: pgmap v21720: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:04:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:37 smithi196 ceph-mon[32572]: pgmap v21721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:04:37.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:37 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40592.679699 secs 2024-04-26T23:04:37.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:37 smithi110 ceph-mon[28069]: pgmap v21721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:04:37.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:37 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40592.679699 secs 2024-04-26T23:04:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:37 smithi193 ceph-mon[32782]: pgmap v21721: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:04:37.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:37 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40592.679699 secs 2024-04-26T23:04:39.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:39 smithi196 ceph-mon[32572]: pgmap v21722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:04:39.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:39 smithi110 ceph-mon[28069]: pgmap v21722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:04:39.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:39 smithi193 ceph-mon[32782]: pgmap v21722: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:04:41.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:41 smithi196 ceph-mon[32572]: pgmap v21723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:04:41.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:41 smithi110 ceph-mon[28069]: pgmap v21723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:04:41.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:41 smithi193 ceph-mon[32782]: pgmap v21723: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-04-26T23:04:42.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:42 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40597.679790 secs 2024-04-26T23:04:42.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:42 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40597.679790 secs 2024-04-26T23:04:42.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:42 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40597.679790 secs 2024-04-26T23:04:43.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:43 smithi196 ceph-mon[32572]: pgmap v21724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:04:43.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:43 smithi110 ceph-mon[28069]: pgmap v21724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:04:43.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:43 smithi193 ceph-mon[32782]: pgmap v21724: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:04:45.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:45 smithi196 ceph-mon[32572]: pgmap v21725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:45.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:45 smithi110 ceph-mon[28069]: pgmap v21725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:45.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:45 smithi193 ceph-mon[32782]: pgmap v21725: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:47 smithi196 ceph-mon[32572]: pgmap v21726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:47.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:47 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40602.679913 secs 2024-04-26T23:04:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:47 smithi110 ceph-mon[28069]: pgmap v21726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:47.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:47 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40602.679913 secs 2024-04-26T23:04:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:47 smithi193 ceph-mon[32782]: pgmap v21726: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:47.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:47 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40602.679913 secs 2024-04-26T23:04:49.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:49 smithi196 ceph-mon[32572]: pgmap v21727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:49.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:49 smithi110 ceph-mon[28069]: pgmap v21727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:49.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:49 smithi193 ceph-mon[32782]: pgmap v21727: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:51.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:51 smithi196 ceph-mon[32572]: pgmap v21728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:51.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:51 smithi110 ceph-mon[28069]: pgmap v21728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:51.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:51 smithi193 ceph-mon[32782]: pgmap v21728: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:52.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:52 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40607.680034 secs 2024-04-26T23:04:52.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:52 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40607.680034 secs 2024-04-26T23:04:52.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:52 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40607.680034 secs 2024-04-26T23:04:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:04:53.126+0000 7f25ff400640 1 -- 172.21.15.110:0/2875381562 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25e8006380 con 0x55db1be4fdd0 2024-04-26T23:04:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:04:53.126+0000 7f2613400640 1 -- 172.21.15.110:0/3398481431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f25ec0063b0 con 0x7f261c104b50 2024-04-26T23:04:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:04:53.127+0000 7f2608c00640 1 -- 172.21.15.110:0/2875381562 <== mon.0 v2:172.21.15.110:3300/0 312 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25ec0063b0 con 0x55db1be4fdd0 2024-04-26T23:04:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi110.front.sepia.ceph.com.smithi110.stderr:2024-04-26T23:04:53.127+0000 7f2618c00640 1 -- 172.21.15.110:0/3398481431 <== mon.0 v2:172.21.15.110:3300/0 312 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f25e8006380 con 0x7f261c104b50 2024-04-26T23:04:53.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:53 smithi196 ceph-mon[32572]: pgmap v21729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:04:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:53 smithi110 ceph-mon[28069]: pgmap v21729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:04:53.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:53 smithi193 ceph-mon[32782]: pgmap v21729: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 2 op/s 2024-04-26T23:04:55.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:55 smithi196 ceph-mon[32572]: pgmap v21730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:55.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:55 smithi110 ceph-mon[28069]: pgmap v21730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:55.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:55 smithi193 ceph-mon[32782]: pgmap v21730: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:57 smithi196 ceph-mon[32572]: pgmap v21731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:57.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:57 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40612.680181 secs 2024-04-26T23:04:57.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:57 smithi110 ceph-mon[28069]: pgmap v21731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:57.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:57 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40612.680181 secs 2024-04-26T23:04:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:57 smithi193 ceph-mon[32782]: pgmap v21731: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:04:57.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:57 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40612.680181 secs 2024-04-26T23:04:59.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:04:59 smithi196 ceph-mon[32572]: pgmap v21732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:59.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:04:59 smithi110 ceph-mon[28069]: pgmap v21732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:04:59.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:04:59 smithi193 ceph-mon[32782]: pgmap v21732: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:01.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:01 smithi196 ceph-mon[32572]: pgmap v21733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:01.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:01 smithi110 ceph-mon[28069]: pgmap v21733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:01.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:01 smithi193 ceph-mon[32782]: pgmap v21733: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:02.754 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:02 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40617.680312 secs 2024-04-26T23:05:02.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:02 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40617.680312 secs 2024-04-26T23:05:02.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:02 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40617.680312 secs 2024-04-26T23:05:03.772 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:03 smithi193 ceph-mon[32782]: pgmap v21734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:03.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:03 smithi110 ceph-mon[28069]: pgmap v21734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:04.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:03 smithi196 ceph-mon[32572]: pgmap v21734: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:05.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:05 smithi110 ceph-mon[28069]: pgmap v21735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:05.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:05 smithi193 ceph-mon[32782]: pgmap v21735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:06.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:05 smithi196 ceph-mon[32572]: pgmap v21735: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:07.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:07 smithi110 ceph-mon[28069]: pgmap v21736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T23:05:07.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:07 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40622.680441 secs 2024-04-26T23:05:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:07 smithi193 ceph-mon[32782]: pgmap v21736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T23:05:07.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:07 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40622.680441 secs 2024-04-26T23:05:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:07 smithi196 ceph-mon[32572]: pgmap v21736: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T23:05:08.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:07 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40622.680441 secs 2024-04-26T23:05:09.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:09 smithi110 ceph-mon[28069]: pgmap v21737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:09.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:09 smithi193 ceph-mon[32782]: pgmap v21737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:10.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:09 smithi196 ceph-mon[32572]: pgmap v21737: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:11.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:11 smithi110 ceph-mon[28069]: pgmap v21738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T23:05:11.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:11 smithi193 ceph-mon[32782]: pgmap v21738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T23:05:12.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:11 smithi196 ceph-mon[32572]: pgmap v21738: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-26T23:05:12.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:12 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40627.680558 secs 2024-04-26T23:05:12.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:12 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40627.680558 secs 2024-04-26T23:05:13.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:12 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40627.680558 secs 2024-04-26T23:05:13.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:13 smithi110 ceph-mon[28069]: pgmap v21739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:13.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:13 smithi193 ceph-mon[32782]: pgmap v21739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:14.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:13 smithi196 ceph-mon[32572]: pgmap v21739: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T23:05:15.872 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:15 smithi193 ceph-mon[32782]: pgmap v21740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:16.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:15 smithi196 ceph-mon[32572]: pgmap v21740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:16.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:15 smithi110 ceph-mon[28069]: pgmap v21740: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:17.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:17 smithi110 ceph-mon[28069]: pgmap v21741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:17.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:17 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40632.680699 secs 2024-04-26T23:05:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:17 smithi193 ceph-mon[32782]: pgmap v21741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:17.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:17 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40632.680699 secs 2024-04-26T23:05:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:17 smithi196 ceph-mon[32572]: pgmap v21741: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:18.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:17 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40632.680699 secs 2024-04-26T23:05:19.807 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:19 smithi196 ceph-mon[32572]: pgmap v21742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:19.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:19 smithi193 ceph-mon[32782]: pgmap v21742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:20.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:19 smithi110 ceph-mon[28069]: pgmap v21742: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:21.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:21 smithi193 ceph-mon[32782]: pgmap v21743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:22.048 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:21 smithi110 ceph-mon[28069]: pgmap v21743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:22.048 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:21 smithi196 ceph-mon[32572]: pgmap v21743: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:22 smithi193 ceph-mon[32782]: 30 slow requests, 1 included below; oldest blocked for > 40637.680813 secs 2024-04-26T23:05:22.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:22 smithi193 ceph-mon[32782]: slow request 362.162015 seconds old, received at 2024-04-26T22:59:19.817120+0000: client_request(client.27317:1 getattr pAsLsXsFs #0x1 2024-04-26T22:59:19.812447+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:05:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:22 smithi196 ceph-mon[32572]: 30 slow requests, 1 included below; oldest blocked for > 40637.680813 secs 2024-04-26T23:05:23.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:22 smithi196 ceph-mon[32572]: slow request 362.162015 seconds old, received at 2024-04-26T22:59:19.817120+0000: client_request(client.27317:1 getattr pAsLsXsFs #0x1 2024-04-26T22:59:19.812447+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:05:23.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:22 smithi110 ceph-mon[28069]: 30 slow requests, 1 included below; oldest blocked for > 40637.680813 secs 2024-04-26T23:05:23.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:22 smithi110 ceph-mon[28069]: slow request 362.162015 seconds old, received at 2024-04-26T22:59:19.817120+0000: client_request(client.27317:1 getattr pAsLsXsFs #0x1 2024-04-26T22:59:19.812447+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:05:23.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:23 smithi193 ceph-mon[32782]: pgmap v21744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:24.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:23 smithi196 ceph-mon[32572]: pgmap v21744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:24.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:23 smithi110 ceph-mon[28069]: pgmap v21744: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:25.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:25 smithi193 ceph-mon[32782]: pgmap v21745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:26.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:25 smithi196 ceph-mon[32572]: pgmap v21745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:26.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:25 smithi110 ceph-mon[28069]: pgmap v21745: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:27 smithi193 ceph-mon[32782]: pgmap v21746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:27.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:27 smithi193 ceph-mon[32782]: 30 slow requests, 0 included below; oldest blocked for > 40642.680917 secs 2024-04-26T23:05:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:27 smithi196 ceph-mon[32572]: pgmap v21746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:28.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:27 smithi196 ceph-mon[32572]: 30 slow requests, 0 included below; oldest blocked for > 40642.680917 secs 2024-04-26T23:05:28.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:27 smithi110 ceph-mon[28069]: pgmap v21746: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-04-26T23:05:28.041 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:27 smithi110 ceph-mon[28069]: 30 slow requests, 0 included below; oldest blocked for > 40642.680917 secs 2024-04-26T23:05:29.871 INFO:journalctl@ceph.mon.b.smithi193.stdout:Apr 26 23:05:29 smithi193 ceph-mon[32782]: pgmap v21747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:30.004 INFO:journalctl@ceph.mon.c.smithi196.stdout:Apr 26 23:05:29 smithi196 ceph-mon[32572]: pgmap v21747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:30.040 INFO:journalctl@ceph.mon.a.smithi110.stdout:Apr 26 23:05:29 smithi110 ceph-mon[28069]: pgmap v21747: 97 pgs: 97 active+clean; 2.7 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:05:31.717 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-04-26T23:05:31.718 DEBUG:teuthology.task.console_log:Killing console logger for smithi110 2024-04-26T23:05:31.718 DEBUG:teuthology.task.console_log:Killing console logger for smithi193 2024-04-26T23:05:31.719 DEBUG:teuthology.task.console_log:Killing console logger for smithi196 2024-04-26T23:05:31.719 DEBUG:teuthology.exit:Finished running handlers